2023-12-22T08:22:13.222 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-22T08:22:13.223 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --name rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi --verbose --archive /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286 -- /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286/orig.config.yaml 2023-12-22T08:22:13.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:22:13.340 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286 branch: rishabh-mdscap-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: null first_in_suite: false job_id: '7499286' kernel: client: branch: testing flavor: default kdb: true sha1: 623393c9d50c04c7ea1d88824b8e92712e3e5611 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-mdscap-reef ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mdscap-reef sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9974 sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c sleep_before_teardown: 0 subset: 301/512 suite: fs suite_branch: rishabh-mdscap-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNE9elxAczHrM6urpdArnbg2TFLF1wkSBp3viqQLTId2ooi52+E1VQB/nkduBlv/u+/UIxEfJEPMgyyY0BecKkA= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKNmjedloL64n43IMt3Mcm+izzdIOLcGF9cnDSrqCjfmmVsYH5+0UNlLIyr0oEhuIBgJ4vkcAwEiVNEtgl9V+PY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9680d2aba1e76f64ade295c81599c97907457848 timestamp: 2023-12-22_08:10:43 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-22T08:22:13.340 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa; will attempt to use it 2023-12-22T08:22:13.341 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks 2023-12-22T08:22:13.341 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-22T08:22:13.342 INFO:teuthology.task.internal:Checking packages... 2023-12-22T08:22:13.364 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '24e2e32ab893c11f7e31ee84381b2f961d1b317c' 2023-12-22T08:22:13.364 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-22T08:22:13.364 INFO:teuthology.packaging:ref: None 2023-12-22T08:22:13.364 INFO:teuthology.packaging:tag: None 2023-12-22T08:22:13.364 INFO:teuthology.packaging:branch: rishabh-mdscap-reef 2023-12-22T08:22:13.364 INFO:teuthology.packaging:sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T08:22:13.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-mdscap-reef 2023-12-22T08:22:13.579 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-1377.g24e2e32a 2023-12-22T08:22:13.581 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-22T08:22:13.586 INFO:teuthology.task.internal:no buildpackages task found 2023-12-22T08:22:13.587 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-22T08:22:13.612 INFO:teuthology.task.internal:Saving configuration 2023-12-22T08:22:13.629 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-22T08:22:13.634 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T08:22:13.660 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:12:01.420872', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNE9elxAczHrM6urpdArnbg2TFLF1wkSBp3viqQLTId2ooi52+E1VQB/nkduBlv/u+/UIxEfJEPMgyyY0BecKkA='} 2023-12-22T08:22:13.683 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:12:01.422159', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKNmjedloL64n43IMt3Mcm+izzdIOLcGF9cnDSrqCjfmmVsYH5+0UNlLIyr0oEhuIBgJ4vkcAwEiVNEtgl9V+PY='} 2023-12-22T08:22:13.683 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-22T08:22:13.689 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-22T08:22:13.689 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-22T08:22:13.689 INFO:teuthology.run_tasks:Running task console_log... 2023-12-22T08:22:13.754 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f65c0063dc0>, signals=[15]) 2023-12-22T08:22:13.754 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-22T08:22:13.759 INFO:teuthology.task.internal:Opening connections... 2023-12-22T08:22:13.759 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:22:13.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:22:13.860 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:22:13.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:22:13.941 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-22T08:22:13.948 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-12-22T08:22:13.966 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-12-22T08:22:13.966 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-12-22T08:22:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2023-12-22T08:22:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2023-12-22T08:22:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2023-12-22T08:22:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2023-12-22T08:22:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2023-12-22T08:22:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2023-12-22T08:22:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-22T08:22:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-12-22T08:22:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2023-12-22T08:22:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-22T08:22:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2023-12-22T08:22:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:22:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-22T08:22:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T08:22:14.025 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-12-22T08:22:14.048 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-12-22T08:22:14.065 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-12-22T08:22:14.065 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-12-22T08:22:14.122 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-12-22T08:22:14.122 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2023-12-22T08:22:14.122 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-12-22T08:22:14.122 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-12-22T08:22:14.122 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2023-12-22T08:22:14.122 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2023-12-22T08:22:14.122 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-22T08:22:14.122 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-12-22T08:22:14.122 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2023-12-22T08:22:14.122 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-22T08:22:14.123 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-12-22T08:22:14.123 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:22:14.123 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-22T08:22:14.123 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T08:22:14.123 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-12-22T08:22:14.147 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-22T08:22:14.156 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-22T08:22:14.161 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-22T08:22:14.161 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2023-12-22T08:22:14.164 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2023-12-22T08:22:14.180 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-22T08:22:14.185 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-22T08:22:14.185 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2023-12-22T08:22:14.222 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2023-12-22T08:22:14.246 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-22T08:22:14.298 INFO:teuthology.run_tasks:Running task kernel... 2023-12-22T08:22:14.312 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'} 2023-12-22T08:22:14.312 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-12-22T08:22:14.313 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-22T08:22:14.313 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-22T08:22:14.314 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-22T08:22:14.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:22:14.330 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-22T08:22:14.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:22:14.334 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-22T08:22:14.528 DEBUG:teuthology.task.kernel:sha1 for client.1 is 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:22:14.528 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "623393c9d50c04c7ea1d88824b8e92712e3e5611"... 2023-12-22T08:22:14.528 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-12-22T08:22:14.545 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-361.el9.x86_64 2023-12-22T08:22:14.545 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:22:14.546 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-22T08:22:14.546 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum upgrade -y linux-firmware 2023-12-22T08:22:14.633 DEBUG:teuthology.task.kernel:sha1 for client.0 is 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:22:14.634 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "623393c9d50c04c7ea1d88824b8e92712e3e5611"... 2023-12-22T08:22:14.634 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2023-12-22T08:22:14.652 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-361.el9.x86_64 2023-12-22T08:22:14.652 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:22:14.652 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-22T08:22:14.653 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum upgrade -y linux-firmware 2023-12-22T08:22:16.936 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-9 - AppStream 8.6 MB/s | 6.4 MB 00:00 2023-12-22T08:22:17.888 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS-9 - AppStream 4.1 MB/s | 6.4 MB 00:01 2023-12-22T08:22:18.287 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-9 - BaseOS 6.6 MB/s | 2.0 MB 00:00 2023-12-22T08:22:19.202 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 7.9 MB 00:00 2023-12-22T08:22:19.263 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2023-12-22T08:22:20.562 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 7.9 MB 00:00 2023-12-22T08:22:22.578 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 18 MB 00:02 2023-12-22T08:22:25.313 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 5.1 MB/s | 18 MB 00:03 2023-12-22T08:22:26.937 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 5.8 MB 00:00 2023-12-22T08:22:28.504 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 15 kB 00:00 2023-12-22T08:22:30.063 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 5.8 MB 00:01 2023-12-22T08:22:31.067 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 8.2 MB/s | 20 MB 00:02 2023-12-22T08:22:31.906 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 15 kB 00:00 2023-12-22T08:22:33.600 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-12-22T08:22:35.939 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-12-22T08:22:38.329 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-22T08:22:38.342 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-22T08:22:38.343 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-12-22T08:22:38.343 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-22T08:22:38.343 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2023-12-22T08:22:38.343 INFO:teuthology.orchestra.run.smithi089.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-22T08:22:38.343 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:22:38.343 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-22T08:22:38.343 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-22T08:22:38.343 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 1 Package 2023-12-22T08:22:38.343 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:22:38.343 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 328 M 2023-12-22T08:22:38.343 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-22T08:22:38.599 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2023-12-22T08:22:41.064 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-22T08:22:41.078 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-22T08:22:41.078 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2023-12-22T08:22:41.078 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-22T08:22:41.078 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2023-12-22T08:22:41.078 INFO:teuthology.orchestra.run.smithi038.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-22T08:22:41.078 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:22:41.078 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-22T08:22:41.078 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2023-12-22T08:22:41.078 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 1 Package 2023-12-22T08:22:41.078 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:22:41.078 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 328 M 2023-12-22T08:22:41.078 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-22T08:22:49.426 INFO:teuthology.orchestra.run.smithi038.stdout:linux-firmware-20231030-141.el9.noarch.rpm 39 MB/s | 328 MB 00:08 2023-12-22T08:22:49.426 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-22T08:22:49.427 INFO:teuthology.orchestra.run.smithi038.stdout:Total 39 MB/s | 328 MB 00:08 2023-12-22T08:22:49.427 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-22T08:22:49.527 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-22T08:22:49.527 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-22T08:22:51.718 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-22T08:22:51.719 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-22T08:22:52.056 INFO:teuthology.orchestra.run.smithi089.stdout:linux-firmware-20231030-141.el9.noarch.rpm 24 MB/s | 328 MB 00:13 2023-12-22T08:22:52.057 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-22T08:22:52.057 INFO:teuthology.orchestra.run.smithi089.stdout:Total 24 MB/s | 328 MB 00:13 2023-12-22T08:22:52.058 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-22T08:22:52.176 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-22T08:22:52.176 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-22T08:22:54.286 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-22T08:22:54.286 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-22T08:22:57.751 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-22T08:22:58.209 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-22T08:22:58.302 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:22:59.295 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:22:59.295 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-22T08:22:59.675 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:22:59.676 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:22:59.676 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2023-12-22T08:22:59.676 INFO:teuthology.orchestra.run.smithi038.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-22T08:22:59.676 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:22:59.676 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-22T08:22:59.963 INFO:teuthology.task.kernel:Downloading kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.0... 2023-12-22T08:22:59.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:23:00.204 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/ 2023-12-22T08:23:00.204 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g623393c9d50c-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-22T08:23:00.207 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi038.front.sepia.ceph.com to complete... 2023-12-22T08:23:00.333 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-22T08:23:00.716 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-22T08:23:00.811 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:23:01.628 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:23:01.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-22T08:23:02.057 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:23:02.057 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:23:02.057 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2023-12-22T08:23:02.057 INFO:teuthology.orchestra.run.smithi089.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-22T08:23:02.057 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:23:02.057 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-22T08:23:02.350 INFO:teuthology.task.kernel:Downloading kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.1... 2023-12-22T08:23:02.350 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:23:02.586 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/ 2023-12-22T08:23:02.587 DEBUG:teuthology.orchestra.run.smithi089:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g623393c9d50c-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-22T08:23:02.590 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi089.front.sepia.ceph.com to complete... 2023-12-22T08:23:26.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22 08:23:26 URL:https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/kernel-6.6.0_g623393c9d50c-1.x86_64.rpm [320178570/320178570] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-22T08:23:26.290 INFO:teuthology.orchestra.run.smithi089.stderr:FINISHED --2023-12-22 08:23:26-- 2023-12-22T08:23:26.290 INFO:teuthology.orchestra.run.smithi089.stderr:Total wall clock time: 24s 2023-12-22T08:23:26.290 INFO:teuthology.orchestra.run.smithi089.stderr:Downloaded: 1 files, 305M in 23s (13.1 MB/s) 2023-12-22T08:23:26.293 INFO:teuthology.task.kernel:Installing kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.1... 2023-12-22T08:23:26.293 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-22T08:23:28.143 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying... ######################################## 2023-12-22T08:23:28.220 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing... ######################################## 2023-12-22T08:23:28.300 INFO:teuthology.orchestra.run.smithi089.stdout:Updating / installing... 2023-12-22T08:23:35.382 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-6.6.0_g623393c9d50c-1 ######################################## 2023-12-22T08:23:38.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22 08:23:38 URL:https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/kernel-6.6.0_g623393c9d50c-1.x86_64.rpm [320178570/320178570] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-22T08:23:38.748 INFO:teuthology.orchestra.run.smithi038.stderr:FINISHED --2023-12-22 08:23:38-- 2023-12-22T08:23:38.748 INFO:teuthology.orchestra.run.smithi038.stderr:Total wall clock time: 39s 2023-12-22T08:23:38.748 INFO:teuthology.orchestra.run.smithi038.stderr:Downloaded: 1 files, 305M in 38s (8.05 MB/s) 2023-12-22T08:23:38.751 INFO:teuthology.task.kernel:Installing kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.0... 2023-12-22T08:23:38.751 DEBUG:teuthology.orchestra.run.smithi038:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-22T08:23:40.690 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying... ######################################## 2023-12-22T08:23:40.749 INFO:teuthology.orchestra.run.smithi038.stdout:Preparing... ######################################## 2023-12-22T08:23:40.834 INFO:teuthology.orchestra.run.smithi038.stdout:Updating / installing... 2023-12-22T08:23:48.177 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-6.6.0_g623393c9d50c-1 ######################################## 2023-12-22T08:23:50.959 INFO:teuthology.orchestra.run.smithi089.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-22T08:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-22T08:24:12.071 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-22T08:24:12.072 DEBUG:teuthology.orchestra.run.smithi089:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-22T08:24:12.149 INFO:teuthology.orchestra.run.smithi089.stdout:/boot/System.map-6.6.0-g623393c9d50c 2023-12-22T08:24:12.149 INFO:teuthology.orchestra.run.smithi089.stdout:/boot/config-6.6.0-g623393c9d50c 2023-12-22T08:24:12.149 INFO:teuthology.orchestra.run.smithi089.stdout:/boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-22T08:24:12.149 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c 2023-12-22T08:24:12.149 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel 2023-12-22T08:24:12.149 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch 2023-12-22T08:24:12.149 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86 2023-12-22T08:24:12.149 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto 2023-12-22T08:24:12.149 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-22T08:24:12.149 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-22T08:24:12.149 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-22T08:24:12.150 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm.ko 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ansi_cprng.ko 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/anubis.ko 2023-12-22T08:24:12.151 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/arc4.ko 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_memcpy.ko 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_pq.ko 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_tx.ko 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_xor.ko 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/raid6test.ko 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authenc.ko 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authencesn.ko 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blake2b_generic.ko 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_common.ko 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_generic.ko 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/camellia_generic.ko 2023-12-22T08:24:12.152 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast5_generic.ko 2023-12-22T08:24:12.153 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast6_generic.ko 2023-12-22T08:24:12.153 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast_common.ko 2023-12-22T08:24:12.153 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ccm.ko 2023-12-22T08:24:12.153 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cmac.ko 2023-12-22T08:24:12.153 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crc32_generic.ko 2023-12-22T08:24:12.153 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_engine.ko 2023-12-22T08:24:12.153 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_user.ko 2023-12-22T08:24:12.153 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cts.ko 2023-12-22T08:24:12.153 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/des_generic.ko 2023-12-22T08:24:12.153 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/dh_generic.ko 2023-12-22T08:24:12.153 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/echainiv.ko 2023-12-22T08:24:12.153 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/essiv.ko 2023-12-22T08:24:12.153 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/fcrypt.ko 2023-12-22T08:24:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/khazad.ko 2023-12-22T08:24:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4.ko 2023-12-22T08:24:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4hc.ko 2023-12-22T08:24:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/md4.ko 2023-12-22T08:24:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/michael_mic.ko 2023-12-22T08:24:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcbc.ko 2023-12-22T08:24:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcrypt.ko 2023-12-22T08:24:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/rmd160.ko 2023-12-22T08:24:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/seed.ko 2023-12-22T08:24:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/serpent_generic.ko 2023-12-22T08:24:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tcrypt.ko 2023-12-22T08:24:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tea.ko 2023-12-22T08:24:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_common.ko 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_generic.ko 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/vmac.ko 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/wp512.ko 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xcbc.ko 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xor.ko 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xxhash_generic.ko 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_pad.ko 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/custom_method.ko 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/ec_sys.ko 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/platform_profile.ko 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbs.ko 2023-12-22T08:24:12.155 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbshc.ko 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/video.ko 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/acard-ahci.ko 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ahci_platform.ko 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ata_generic.ko 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/libahci_platform.ko 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_acpi.ko 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ali.ko 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_amd.ko 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_artop.ko 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atiixp.ko 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atp867x.ko 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd640.ko 2023-12-22T08:24:12.156 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd64x.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cypress.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_efar.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt366.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt37x.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it8213.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it821x.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_jmicron.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_marvell.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_mpiix.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_netcell.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ninja32.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87410.ko 2023-12-22T08:24:12.157 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87415.ko 2023-12-22T08:24:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_oldpiix.ko 2023-12-22T08:24:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_opti.ko 2023-12-22T08:24:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_optidma.ko 2023-12-22T08:24:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pcmcia.ko 2023-12-22T08:24:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-22T08:24:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-22T08:24:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_piccolo.ko 2023-12-22T08:24:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_rdc.ko 2023-12-22T08:24:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sch.ko 2023-12-22T08:24:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_serverworks.ko 2023-12-22T08:24:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sil680.ko 2023-12-22T08:24:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sis.ko 2023-12-22T08:24:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sl82c105.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_triflex.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_via.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pdc_adma.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_inic162x.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_mv.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_nv.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_promise.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_qstor.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil24.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sis.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_svw.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sx4.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_uli.ko 2023-12-22T08:24:12.159 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_via.ko 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_vsc.ko 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay/ks0108.ko 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma/bcma.ko 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe/aoe.ko 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/brd.ko 2023-12-22T08:24:12.160 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd/drbd.ko 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/floppy.ko 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/loop.ko 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/nbd.ko 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk/null_blk.ko 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/pktcdvd.ko 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/rbd.ko 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/virtio_blk.ko 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkfront.ko 2023-12-22T08:24:12.161 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram/zram.ko 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hangcheck-timer.ko 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/via-rng.ko 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-22T08:24:12.162 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/lp.ko 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave/mwave.ko 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ppdev.ko 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tlclk.ko 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm.ko 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/uv_mmtimer.ko 2023-12-22T08:24:12.163 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/virtio_console.ko 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp.ko 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common 2023-12-22T08:24:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-aes.ko 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-sha.ko 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca/dca.ko 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/devfreq 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat 2023-12-22T08:24:12.165 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/amd64_edac.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/e752x_edac.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/edac_mce_amd.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3000_edac.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3200_edac.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5100_edac.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5400_edac.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7300_edac.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7core_edac.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i82975x_edac.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/ie31200_edac.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/sb_edac.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/x38_edac.ko 2023-12-22T08:24:12.166 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/edd.ko 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-ich.ko 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-appleir.ko 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-aureal.ko 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-axff.ko 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-dr.ko 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elecom.ko 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elo.ko 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-emsff.ko 2023-12-22T08:24:12.167 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gaff.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gt683r.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gyration.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtekff.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-hyperv.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-icade.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-keytouch.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-kye.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lcpower.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-led.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lenovo.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-22T08:24:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-multitouch.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ortek.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-penmount.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-petalynx.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-picolcd.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-pl.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-plantronics.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-primax.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-rmi.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-common.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-22T08:24:12.169 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-saitek.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-samsung.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sjoy.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sony.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-speedlink.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-steelseries.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sunplus.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-22T08:24:12.170 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tivo.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tmff.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-topseed.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-twinhan.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-uclogic.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-waltop.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-wiimote.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-xinmo.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zpff.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zydacron.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/uhid.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/wacom.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_balloon.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_utils.ko 2023-12-22T08:24:12.171 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_vmbus.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru3.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7414.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7418.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adc128d818.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1025.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1026.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1029.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1031.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm9240.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ads7828.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7410.ko 2023-12-22T08:24:12.172 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7411.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7462.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7470.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7475.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7x10.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/amc6821.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/applesmc.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asb100.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asc7621.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/atxp1.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/coretemp.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dme1737.ko 2023-12-22T08:24:12.173 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds1621.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds620.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc1403.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc6w201.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71805f.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71882fg.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f75375s.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fam15h_power.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fschmd.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g760a.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g762.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl518sm.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl520sm.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5500_temp.ko 2023-12-22T08:24:12.174 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5k_amb.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmaem.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmpex.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina209.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina2xx.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/it87.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k10temp.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k8temp.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lineage-pem.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm63.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm73.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm75.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm77.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm78.ko 2023-12-22T08:24:12.175 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm80.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm83.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm85.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm87.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm90.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm92.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm93.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95234.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95241.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95245.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc2945.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4151.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4215.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4222.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4245.ko 2023-12-22T08:24:12.176 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4260.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4261.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max16065.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1619.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1668.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max197.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6639.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6650.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6697.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/mcp3021.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6683.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775-core.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct7802.ko 2023-12-22T08:24:12.177 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87360.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87427.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pcf8591.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-22T08:24:12.178 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/powr1220.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5627.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5636.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht15.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht21.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/shtc1.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sis5595.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47b397.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m1.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m192.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/thmc50.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp102.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp103.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp401.ko 2023-12-22T08:24:12.179 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp421.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via-cputemp.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via686a.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt1211.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt8231.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627ehf.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627hf.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83781d.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83791d.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83792d.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83793.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83795.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l785ts.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l786ng.ko 2023-12-22T08:24:12.180 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c 2023-12-22T08:24:12.181 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos 2023-12-22T08:24:12.181 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-22T08:24:12.181 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-22T08:24:12.181 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses 2023-12-22T08:24:12.181 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-22T08:24:12.181 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-22T08:24:12.181 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-22T08:24:12.181 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-22T08:24:12.181 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-22T08:24:12.181 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-22T08:24:12.181 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-22T08:24:12.181 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-22T08:24:12.182 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-dev.ko 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-mux.ko 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-smbus.ko 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-stub.ko 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_core.ko 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-22T08:24:12.183 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser 2023-12-22T08:24:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/gameport.ko 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/joydev.ko 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-22T08:24:12.185 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/appletouch.ko 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/bcm5974.ko 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/cyapatp.ko 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/sermouse.ko 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/altera_ps2.ko 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/arc_ps2.ko 2023-12-22T08:24:12.186 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/serio_raw.ko 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/sparse-keymap.ko 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-blinkm.ko 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3530.ko 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lp3944.ko 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-ss4200.ko 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-22T08:24:12.187 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache/bcache.ko 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-bio-prison.ko 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache-smq.ko 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache.ko 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-crypt.ko 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-delay.ko 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-flakey.ko 2023-12-22T08:24:12.188 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-log-userspace.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-multipath.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-queue-length.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-raid.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-round-robin.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-service-time.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-switch.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-thin-pool.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-verity.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/faulty.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/linear.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/multipath.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid0.ko 2023-12-22T08:24:12.189 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid1.ko 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid10.ko 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid456.ko 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptbase.ko 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptctl.ko 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptfc.ko 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptlan.ko 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptsas.ko 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptscsih.ko 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptspi.ko 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_ich.ko 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_sch.ko 2023-12-22T08:24:12.190 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/mfd-core.ko 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/sm501.ko 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/viperboard.ko 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/vx855.ko 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/wl1273-core.ko 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds9802als.ko 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds990x.ko 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/bh1770glc.ko 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710/cb710.ko 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom 2023-12-22T08:24:12.191 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/at24.ko 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/max6875.ko 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/enclosure.ko 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/hpilo.ko 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29003.ko 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29020.ko 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-me.ko 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-txe.ko 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei.ko 2023-12-22T08:24:12.192 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-gru 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_7xx1.ko 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_core.ko 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tsl2550.ko 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_balloon.ko 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding/bonding.ko 2023-12-22T08:24:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa 2023-12-22T08:24:12.194 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53 2023-12-22T08:24:12.194 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-22T08:24:12.194 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dummy.ko 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/eql.ko 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-22T08:24:12.195 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-22T08:24:12.196 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-22T08:24:12.197 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-22T08:24:12.198 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-22T08:24:12.198 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet 2023-12-22T08:24:12.198 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-22T08:24:12.198 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-22T08:24:12.198 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade 2023-12-22T08:24:12.198 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna 2023-12-22T08:24:12.198 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-22T08:24:12.198 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio 2023-12-22T08:24:12.198 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-22T08:24:12.198 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-22T08:24:12.199 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-22T08:24:12.199 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-22T08:24:12.199 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-22T08:24:12.199 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-22T08:24:12.199 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-22T08:24:12.199 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-22T08:24:12.199 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-22T08:24:12.199 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-22T08:24:12.199 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco 2023-12-22T08:24:12.199 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dnet.ko 2023-12-22T08:24:12.200 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ethoc.ko 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fealnx.ko 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e 2023-12-22T08:24:12.201 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/jme.ko 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-22T08:24:12.202 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi 2023-12-22T08:24:12.203 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-22T08:24:12.204 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rocker 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-22T08:24:12.205 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-22T08:24:12.206 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/geneve.ko 2023-12-22T08:24:12.207 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ifb.ko 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvlan.ko 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvtap.ko 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio.ko 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mii.ko 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/net_failover.ko 2023-12-22T08:24:12.208 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/netconsole.ko 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/nlmon.ko 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/amd.ko 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm87xx.ko 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/broadcom.ko 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/cicada.ko 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/davicom.ko 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/dp83640.ko 2023-12-22T08:24:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/et1011c.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/icplus.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/lxt.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/marvell.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/micrel.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/national.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/phylink.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/qsemi.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/realtek.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/smsc.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/ste10Xp.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/vitesse.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_async.ko 2023-12-22T08:24:12.210 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppoe.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppox.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pptp.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slhc.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slip.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/sungem_phy.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tap.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-22T08:24:12.211 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_random.ko 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tun.ko 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/veth.ko 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/virtio_net.ko 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan/vxlan.ko 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netfront.ko 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb/ntb.ko 2023-12-22T08:24:12.212 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme-core.ko 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme.ko 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport.ko 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_cs.ko 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_pc.ko 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_serial.ko 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pcie 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/xen-pcifront.ko 2023-12-22T08:24:12.213 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/i82092.ko 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pd6729.ko 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acerhdf.ko 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-22T08:24:12.214 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/hdaps.ko 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel_ips.ko 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-22T08:24:12.215 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi.ko 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps_parport.ko 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/pps_core.ko 2023-12-22T08:24:12.216 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp.ko 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp_kvm.ko 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-em3027.ko 2023-12-22T08:24:12.217 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max6900.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-22T08:24:12.218 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-x1205.ko 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-9xxx.ko 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-sas.ko 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-xxxx.ko 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/BusLogic.ko 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/a100u2w.ko 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/advansys.ko 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-22T08:24:12.219 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/am53c974.ko 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/atp870u.ko 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa/bfa.ko 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ch.ko 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor 2023-12-22T08:24:12.220 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dc395x.ko 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dmx3191d.ko 2023-12-22T08:24:12.221 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esp_scsi.ko 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic/fnic.ko 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hpsa.ko 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hptiop.ko 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hv_storvsc.ko 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/initio.ko 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ipr.ko 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ips.ko 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci/isci.ko 2023-12-22T08:24:12.222 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc/libfc.ko 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi.ko 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas/libsas.ko 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid.ko 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-22T08:24:12.223 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvumi.ko 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pmcraid.ko 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla1280.ko 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/raid_class.ko 2023-12-22T08:24:12.224 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_debug.ko 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ses.ko 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/st.ko 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/stex.ko 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/virtio_scsi.ko 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/wd719x.ko 2023-12-22T08:24:12.225 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb/ssb.ko 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_file.ko 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_iblock.ko 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_mod.ko 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_pscsi.ko 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_user.ko 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal 2023-12-22T08:24:12.226 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-22T08:24:12.227 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_gsm.ko 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_hdlc.ko 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/nozomi.ko 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/arc_uart.ko 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs 2023-12-22T08:24:12.228 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio.ko 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_aec.ko 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_cif.ko 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_pci_generic.ko 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_sercos3.ko 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-acm.ko 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-22T08:24:12.229 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usblp.ko 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usbtmc.ko 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/mdc800.ko 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/microtek.ko 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/adutux.ko 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/appledisplay.ko 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi26.ko 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi62.ko 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ezusb.ko 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/idmouse.ko 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/iowarrior.ko 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-22T08:24:12.230 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ldusb.ko 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/legousbtower.ko 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usb3503.ko 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usblcd.ko 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/uss720.ko 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/yurex.ko 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-generic.ko 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/aircable.ko 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ark3116.ko 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-22T08:24:12.231 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ch341.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cp210x.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cyberjack.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/empeg.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_ti.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipaq.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipw.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ir-usb.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan.ko 2023-12-22T08:24:12.232 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mct_u232.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7720.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7840.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/navman.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/omninet.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/opticon.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/option.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/oti6858.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/pl2303.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcaux.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcserial.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/quatech2.ko 2023-12-22T08:24:12.233 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/safe_serial.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/sierra.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ssu100.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/symbolserial.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_debug.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/visor.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/whiteheat.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/uas.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-22T08:24:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-karma.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/usb-storage.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-22T08:24:12.235 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio.ko 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost.ko 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_net.ko 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_scsi.ko 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/apple_bl.ko 2023-12-22T08:24:12.236 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lcd.ko 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio.ko 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_balloon.ko 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_mmio.ko 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci.ko 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_ring.ko 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2482.ko 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2490.ko 2023-12-22T08:24:12.237 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/wire.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-22T08:24:12.238 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/hpwdt.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/i6300esb.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ib700wdt.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ibmasr.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it87_wdt.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/machzwd.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/nv_tco.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-22T08:24:12.239 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/softdog.ko 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/via_wdt.ko 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wdt_pci.ko 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/xen_wdt.ko 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-evtchn.ko 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntalloc.ko 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntdev.ko 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback 2023-12-22T08:24:12.240 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-privcmd.ko 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p/9p.ko 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs/affs.ko 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs/befs.ko 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/binfmt_misc.ko 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs/btrfs.ko 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles 2023-12-22T08:24:12.241 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles/cachefiles.ko 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph/ceph.ko 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda/coda.ko 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs/cramfs.ko 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm/dlm.ko 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ecryptfs 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs/f2fs.ko 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/fat.ko 2023-12-22T08:24:12.242 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/msdos.ko 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/vfat.ko 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache/fscache.ko 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/cuse.ko 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/fuse.ko 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2/gfs2.ko 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs/hfs.ko 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus/hfsplus.ko 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs 2023-12-22T08:24:12.243 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs/isofs.ko 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs/jfs.ko 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd/lockd.ko 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix/minix.ko 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs/netfs.ko 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout 2023-12-22T08:24:12.244 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfs.ko 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv3.ko 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv4.ko 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/grace.ko 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/nfs_acl.ko 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd/nfsd.ko 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2/nilfs2.ko 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-celtic.ko 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-centeuro.ko 2023-12-22T08:24:12.245 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-croatian.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-cyrillic.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-gaelic.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-greek.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-iceland.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-inuit.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-roman.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-romanian.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-turkish.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1250.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1251.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1255.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp737.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp775.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp850.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp852.ko 2023-12-22T08:24:12.246 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp855.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp857.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp860.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp861.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp862.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp863.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp864.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp865.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp866.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp869.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp874.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp932.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp936.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp949.ko 2023-12-22T08:24:12.247 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp950.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_euc-jp.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-1.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-13.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-14.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-15.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-2.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-3.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-4.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-5.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-6.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-7.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-9.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-r.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-ru.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-u.ko 2023-12-22T08:24:12.248 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_utf8.ko 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2.ko 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs 2023-12-22T08:24:12.249 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs/overlay.ko 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore/ramoops.ko 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs/reiserfs.ko 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs/romfs.ko 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client/cifs.ko 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_arc4.ko 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_md4.ko 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs/squashfs.ko 2023-12-22T08:24:12.250 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv/sysv.ko 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf/udf.ko 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs/ufs.ko 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs/xfs.ko 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/rcu 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/rcu/rcutorture.ko 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/torture.ko 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/trace 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/asn1_encoder.ko 2023-12-22T08:24:12.251 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc-itu-t.ko 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc8.ko 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libarc4.ko 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libdes.ko 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/libcrc32c.ko 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lru_cache.ko 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4_compress.ko 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4hc_compress.ko 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/math 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/math/cordic.ko 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6/raid6_pq.ko 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon 2023-12-22T08:24:12.252 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_bm.ko 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_fsm.ko 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_kmp.ko 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/zstd 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/zstd/zstd_compress.ko 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/mm 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/mm/hwpoison-inject.ko 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/6lowpan.ko 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_dest.ko 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_fragment.ko 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_hop.ko 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-22T08:24:12.253 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_mobility.ko 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_routing.ko 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_udp.ko 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/garp.ko 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/mrp.ko 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/p8022.ko 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/psnap.ko 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/stp.ko 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q/8021q.ko 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet.ko 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_fd.ko 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_rdma.ko 2023-12-22T08:24:12.254 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_virtio.ko 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv/batman-adv.ko 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/br_netfilter.ko 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/bridge.ko 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-22T08:24:12.255 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtables.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-22T08:24:12.256 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph/libceph.ko 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core/failover.ko 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core/pktgen.ko 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp.ko 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_diag.ko 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv4.ko 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv6.ko 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dns_resolver 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dns_resolver/dns_resolver.ko 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/dsa_core.ko 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_brcm.ko 2023-12-22T08:24:12.257 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_dsa.ko 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_none.ko 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_trailer.ko 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154.ko 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ah4.ko 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/esp4.ko 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/fou.ko 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/gre.ko 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/inet_diag.ko 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_gre.ko 2023-12-22T08:24:12.258 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_tunnel.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_vti.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipcomp.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipip.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-22T08:24:12.259 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_bic.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_dctcp.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_diag.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_highspeed.ko 2023-12-22T08:24:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_htcp.ko 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_hybla.ko 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_illinois.ko 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_lp.ko 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_scalable.ko 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_vegas.ko 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_veno.ko 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_westwood.ko 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_yeah.ko 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tunnel4.ko 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_diag.ko 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_tunnel.ko 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6 2023-12-22T08:24:12.261 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ah6.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/esp6.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/fou6.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_tunnel.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_vti.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ipcomp6.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-22T08:24:12.262 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-22T08:24:12.263 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/sit.ko 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/tunnel6.ko 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/key 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/key/af_key.ko 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_core.ko 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_eth.ko 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip.ko 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip6.ko 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_netlink.ko 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ppp.ko 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/llc 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/llc.ko 2023-12-22T08:24:12.264 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154/mac802154.ko 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls/mpls_gso.ko 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set.ko 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-22T08:24:12.265 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-22T08:24:12.266 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conncount.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-22T08:24:12.267 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_log_syslog.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_irc.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_sip.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-22T08:24:12.268 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_tables.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_log.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_chain_nat.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_compat.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_ct.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fib.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_hash.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_limit.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_log.ko 2023-12-22T08:24:12.269 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_masq.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_nat.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_numgen.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_queue.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_quota.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_redir.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject_inet.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_socket.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_tunnel.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_AUDIT.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-22T08:24:12.270 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CT.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_DSCP.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HL.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HMARK.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LED.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LOG.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NETMAP.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFLOG.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_RATEEST.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_SECMARK.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-22T08:24:12.271 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TEE.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TPROXY.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TRACE.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_addrtype.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_bpf.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cgroup.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cluster.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_comment.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connbytes.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlabel.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlimit.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connmark.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_conntrack.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cpu.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dccp.ko 2023-12-22T08:24:12.272 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_devgroup.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dscp.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ecn.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_esp.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hashlimit.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_helper.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hl.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipcomp.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_iprange.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipvs.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_l2tp.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_length.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_limit.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mac.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mark.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_multiport.ko 2023-12-22T08:24:12.273 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nat.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nfacct.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_osf.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_owner.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_physdev.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_pkttype.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_policy.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_quota.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_rateest.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_realm.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_recent.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_sctp.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_set.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_socket.ko 2023-12-22T08:24:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_state.ko 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_statistic.ko 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_string.ko 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_tcpmss.ko 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_time.ko 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_u32.ko 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink/netlink_diag.ko 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh/nsh.ko 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/openvswitch.ko 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-geneve.ko 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-gre.ko 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-vxlan.ko 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/packet 2023-12-22T08:24:12.275 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/packet/af_packet_diag.ko 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds.ko 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_rdma.ko 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_tcp.ko 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_csum.ko 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_gact.ko 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_ipt.ko 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_mirred.ko 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_nat.ko 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_pedit.ko 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_police.ko 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_simple.ko 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_skbedit.ko 2023-12-22T08:24:12.276 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_vlan.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_basic.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_bpf.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_flow.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_fw.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_route.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_u32.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_cmp.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_ipset.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_meta.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_nbyte.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_text.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_u32.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_choke.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_codel.ko 2023-12-22T08:24:12.277 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_drr.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_fq.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_gred.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hfsc.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hhf.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_htb.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_ingress.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio_lib.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_multiq.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_netem.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_pie.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_plug.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_prio.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_qfq.ko 2023-12-22T08:24:12.278 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_red.ko 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfb.ko 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfq.ko 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_tbf.ko 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_teql.ko 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp.ko 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp_diag.ko 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/sunrpc.ko 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-22T08:24:12.279 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc 2023-12-22T08:24:12.280 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/diag.ko 2023-12-22T08:24:12.280 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/tipc.ko 2023-12-22T08:24:12.280 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/unix 2023-12-22T08:24:12.280 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/unix/unix_diag.ko 2023-12-22T08:24:12.280 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock 2023-12-22T08:24:12.280 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-22T08:24:12.280 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-22T08:24:12.280 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock.ko 2023-12-22T08:24:12.280 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-22T08:24:12.280 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-22T08:24:12.280 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm 2023-12-22T08:24:12.280 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-22T08:24:12.280 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/encrypted-keys 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/trusted-keys 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/trusted-keys/trusted.ko 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib/irqbypass.ko 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.alias 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.alias.bin 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.alias.bin 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.bin 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.modinfo 2023-12-22T08:24:12.281 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.dep 2023-12-22T08:24:12.282 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.dep.bin 2023-12-22T08:24:12.282 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.devname 2023-12-22T08:24:12.282 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.order 2023-12-22T08:24:12.282 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.softdep 2023-12-22T08:24:12.282 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.symbols 2023-12-22T08:24:12.282 INFO:teuthology.orchestra.run.smithi089.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.symbols.bin 2023-12-22T08:24:12.282 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g623393c9d50c 2023-12-22T08:24:12.283 DEBUG:teuthology.orchestra.run.smithi089:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-22T08:24:12.304 INFO:teuthology.orchestra.run.smithi089.stdout:postinstall scriptlet (using /bin/sh): 2023-12-22T08:24:12.305 INFO:teuthology.orchestra.run.smithi089.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g623393c9d50c -a -r /boot/System.map-6.6.0-g623393c9d50c ]; then 2023-12-22T08:24:12.305 INFO:teuthology.orchestra.run.smithi089.stdout:cp /boot/vmlinuz-6.6.0-g623393c9d50c /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm 2023-12-22T08:24:12.305 INFO:teuthology.orchestra.run.smithi089.stdout:cp /boot/System.map-6.6.0-g623393c9d50c /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:24:12.305 INFO:teuthology.orchestra.run.smithi089.stdout:rm -f /boot/vmlinuz-6.6.0-g623393c9d50c /boot/System.map-6.6.0-g623393c9d50c 2023-12-22T08:24:12.305 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/installkernel 6.6.0-g623393c9d50c /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:24:12.305 INFO:teuthology.orchestra.run.smithi089.stdout:rm -f /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:24:12.305 INFO:teuthology.orchestra.run.smithi089.stdout:fi 2023-12-22T08:24:12.305 INFO:teuthology.orchestra.run.smithi089.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-22T08:24:12.305 INFO:teuthology.orchestra.run.smithi089.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-22T08:24:12.305 INFO:teuthology.orchestra.run.smithi089.stdout:new-kernel-pkg --remove 6.6.0-g623393c9d50c --rminitrd --initrdfile=/boot/initramfs-6.6.0-g623393c9d50c.img 2023-12-22T08:24:12.305 INFO:teuthology.orchestra.run.smithi089.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-22T08:24:12.306 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-install remove 6.6.0-g623393c9d50c 2023-12-22T08:24:12.306 INFO:teuthology.orchestra.run.smithi089.stdout:fi 2023-12-22T08:24:12.306 INFO:teuthology.orchestra.run.smithi089.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-22T08:24:12.306 INFO:teuthology.orchestra.run.smithi089.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-22T08:24:12.306 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/update-bootloader --remove 6.6.0-g623393c9d50c 2023-12-22T08:24:12.306 INFO:teuthology.orchestra.run.smithi089.stdout:fi 2023-12-22T08:24:12.307 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2023-12-22T08:24:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2023-12-22T08:24:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2023-12-22T08:24:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.06 2023-12-22T08:24:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 68.el9 2023-12-22T08:24:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2023-12-22T08:24:12.391 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:Group : Unspecified 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 8264254 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : builder@centos.org 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-22T08:24:12.392 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-22T08:24:12.393 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2023-12-22T08:24:12.393 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:24:12.393 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2023-12-22T08:24:12.393 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-22T08:24:12.394 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 6.6.0-g623393c9d50c 2023-12-22T08:24:12.394 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-22T08:24:13.074 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2023-12-22T08:24:14.529 INFO:teuthology.orchestra.run.smithi089.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-22T08:24:14.562 INFO:teuthology.orchestra.run.smithi089.stderr:done 2023-12-22T08:24:14.564 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-22T08:24:14.578 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.niD0aKcNGn 2023-12-22T08:24:14.578 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.niD0aKcNGn 2023-12-22T08:24:14.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.niD0aKcNGn 2023-12-22T08:24:14.797 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.niD0aKcNGn is 6KB 2023-12-22T08:24:14.846 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.niD0aKcNGn 2023-12-22T08:24:14.860 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2023-12-22T08:24:14.925 INFO:teuthology.orchestra.run.smithi089.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-22T08:24:14.925 INFO:teuthology.orchestra.run.smithi089.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-22T08:24:14.925 INFO:teuthology.orchestra.run.smithi089.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-22T08:24:14.925 INFO:teuthology.orchestra.run.smithi089.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g623393c9d50c.conf 2023-12-22T08:24:14.927 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g623393c9d50c 2023-12-22T08:24:15.087 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2023-12-22T08:24:23.848 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi038.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-22T08:24:23.849 DEBUG:teuthology.orchestra.run.smithi038:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-22T08:24:23.949 INFO:teuthology.orchestra.run.smithi038.stdout:/boot/System.map-6.6.0-g623393c9d50c 2023-12-22T08:24:23.949 INFO:teuthology.orchestra.run.smithi038.stdout:/boot/config-6.6.0-g623393c9d50c 2023-12-22T08:24:23.949 INFO:teuthology.orchestra.run.smithi038.stdout:/boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-22T08:24:23.949 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c 2023-12-22T08:24:23.949 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel 2023-12-22T08:24:23.949 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch 2023-12-22T08:24:23.949 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-22T08:24:23.950 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-22T08:24:23.951 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm.ko 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ansi_cprng.ko 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/anubis.ko 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/arc4.ko 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_memcpy.ko 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_pq.ko 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_tx.ko 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_xor.ko 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/raid6test.ko 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authenc.ko 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authencesn.ko 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blake2b_generic.ko 2023-12-22T08:24:23.952 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_common.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_generic.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/camellia_generic.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast5_generic.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast6_generic.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast_common.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ccm.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cmac.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crc32_generic.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_engine.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_user.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cts.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/des_generic.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/dh_generic.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/echainiv.ko 2023-12-22T08:24:23.953 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/essiv.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/fcrypt.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/khazad.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4hc.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/md4.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/michael_mic.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcbc.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcrypt.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/rmd160.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/seed.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/serpent_generic.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tcrypt.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tea.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_common.ko 2023-12-22T08:24:23.954 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_generic.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/vmac.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/wp512.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xcbc.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xor.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xxhash_generic.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_pad.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/custom_method.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/ec_sys.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/platform_profile.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbs.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbshc.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/video.ko 2023-12-22T08:24:23.955 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/acard-ahci.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ahci_platform.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ata_generic.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/libahci_platform.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_acpi.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ali.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_amd.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_artop.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atiixp.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atp867x.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd640.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd64x.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cypress.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_efar.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt366.ko 2023-12-22T08:24:23.956 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt37x.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it8213.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it821x.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_jmicron.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_marvell.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_mpiix.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_netcell.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ninja32.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87410.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87415.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_oldpiix.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_opti.ko 2023-12-22T08:24:23.957 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_optidma.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pcmcia.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_piccolo.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_rdc.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sch.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_serverworks.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sil680.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sis.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sl82c105.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_triflex.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_via.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pdc_adma.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_inic162x.ko 2023-12-22T08:24:23.958 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_mv.ko 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_nv.ko 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_promise.ko 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_qstor.ko 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil.ko 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil24.ko 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sis.ko 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_svw.ko 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sx4.ko 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_uli.ko 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_via.ko 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_vsc.ko 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay/ks0108.ko 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap 2023-12-22T08:24:23.959 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma/bcma.ko 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe/aoe.ko 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/brd.ko 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd/drbd.ko 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/floppy.ko 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/loop.ko 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/nbd.ko 2023-12-22T08:24:23.960 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk/null_blk.ko 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/pktcdvd.ko 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/rbd.ko 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/virtio_blk.ko 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkfront.ko 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram/zram.ko 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hangcheck-timer.ko 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-22T08:24:23.961 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/via-rng.ko 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/lp.ko 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave/mwave.ko 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ppdev.ko 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tlclk.ko 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm 2023-12-22T08:24:23.962 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/uv_mmtimer.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/virtio_console.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-22T08:24:23.963 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp.ko 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-aes.ko 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-sha.ko 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca/dca.ko 2023-12-22T08:24:23.964 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/devfreq 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/amd64_edac.ko 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/e752x_edac.ko 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/edac_mce_amd.ko 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3000_edac.ko 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3200_edac.ko 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5100_edac.ko 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5400_edac.ko 2023-12-22T08:24:23.965 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7300_edac.ko 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7core_edac.ko 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i82975x_edac.ko 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/ie31200_edac.ko 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/sb_edac.ko 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/x38_edac.ko 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/edd.ko 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-ich.ko 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-appleir.ko 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-aureal.ko 2023-12-22T08:24:23.966 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-axff.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-dr.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elecom.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elo.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-emsff.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gaff.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gt683r.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gyration.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtekff.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-hyperv.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-icade.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-keytouch.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-kye.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lcpower.ko 2023-12-22T08:24:23.967 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-led.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lenovo.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-multitouch.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ortek.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-penmount.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-petalynx.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-picolcd.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-pl.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-plantronics.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-primax.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-rmi.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-common.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-22T08:24:23.968 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-saitek.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-samsung.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sjoy.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sony.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-speedlink.ko 2023-12-22T08:24:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-steelseries.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sunplus.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tivo.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tmff.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-topseed.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-twinhan.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-uclogic.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-waltop.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-wiimote.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-xinmo.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zpff.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zydacron.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/uhid.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/wacom.ko 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv 2023-12-22T08:24:23.970 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_balloon.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_utils.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_vmbus.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru3.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7414.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7418.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adc128d818.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1025.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1026.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1029.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1031.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm9240.ko 2023-12-22T08:24:23.971 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ads7828.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7410.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7411.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7462.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7470.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7475.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7x10.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/amc6821.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/applesmc.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asb100.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asc7621.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/atxp1.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/coretemp.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dme1737.ko 2023-12-22T08:24:23.972 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds1621.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds620.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc1403.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc6w201.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71805f.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71882fg.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f75375s.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fam15h_power.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fschmd.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g760a.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g762.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl518sm.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl520sm.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5500_temp.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5k_amb.ko 2023-12-22T08:24:23.973 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmaem.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmpex.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina209.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina2xx.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/it87.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k10temp.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k8temp.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lineage-pem.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm63.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm73.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm75.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm77.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm78.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm80.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm83.ko 2023-12-22T08:24:23.974 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm85.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm87.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm90.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm92.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm93.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95234.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95241.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95245.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc2945.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4151.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4215.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4222.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4245.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4260.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4261.ko 2023-12-22T08:24:23.975 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max16065.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1619.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1668.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max197.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6639.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6650.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6697.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/mcp3021.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6683.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775-core.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct7802.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87360.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87427.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pcf8591.ko 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus 2023-12-22T08:24:23.976 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/powr1220.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5627.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5636.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-22T08:24:23.977 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht15.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht21.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/shtc1.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sis5595.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47b397.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m1.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m192.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/thmc50.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp102.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp103.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp401.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp421.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via-cputemp.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via686a.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt1211.ko 2023-12-22T08:24:23.978 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt8231.ko 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627ehf.ko 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627hf.ko 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83781d.ko 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83791d.ko 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83792d.ko 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83793.ko 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83795.ko 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l785ts.ko 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l786ng.ko 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-22T08:24:23.979 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-22T08:24:23.980 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-dev.ko 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-mux.ko 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-smbus.ko 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-stub.ko 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_core.ko 2023-12-22T08:24:23.981 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp 2023-12-22T08:24:23.982 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib 2023-12-22T08:24:23.983 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-22T08:24:23.983 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser 2023-12-22T08:24:23.983 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-22T08:24:23.983 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert 2023-12-22T08:24:23.983 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-22T08:24:23.983 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp 2023-12-22T08:24:23.983 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-22T08:24:23.983 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt 2023-12-22T08:24:23.983 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-22T08:24:23.983 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input 2023-12-22T08:24:23.983 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport 2023-12-22T08:24:23.983 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/gameport.ko 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/joydev.ko 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/appletouch.ko 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/bcm5974.ko 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/cyapatp.ko 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/sermouse.ko 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-22T08:24:23.984 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/altera_ps2.ko 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/arc_ps2.ko 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/serio_raw.ko 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/sparse-keymap.ko 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-blinkm.ko 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3530.ko 2023-12-22T08:24:23.985 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lp3944.ko 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-ss4200.ko 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache/bcache.ko 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-bio-prison.ko 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache-smq.ko 2023-12-22T08:24:23.986 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-crypt.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-delay.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-flakey.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-log-userspace.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-multipath.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-queue-length.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-raid.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-round-robin.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-service-time.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-switch.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-thin-pool.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-verity.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/faulty.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/linear.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/multipath.ko 2023-12-22T08:24:23.987 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid0.ko 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid1.ko 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid10.ko 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid456.ko 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptbase.ko 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptctl.ko 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptfc.ko 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptlan.ko 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptsas.ko 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptscsih.ko 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptspi.ko 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd 2023-12-22T08:24:23.988 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_ich.ko 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_sch.ko 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/mfd-core.ko 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/sm501.ko 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/viperboard.ko 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/vx855.ko 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/wl1273-core.ko 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds9802als.ko 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds990x.ko 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/bh1770glc.ko 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710 2023-12-22T08:24:23.989 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710/cb710.ko 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/at24.ko 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/max6875.ko 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/enclosure.ko 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/hpilo.ko 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29003.ko 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29020.ko 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-me.ko 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-txe.ko 2023-12-22T08:24:23.990 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei.ko 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-gru 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_7xx1.ko 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_core.ko 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tsl2550.ko 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_balloon.ko 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding/bonding.ko 2023-12-22T08:24:23.991 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dummy.ko 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/eql.ko 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-22T08:24:23.992 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-22T08:24:23.993 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-22T08:24:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-22T08:24:23.995 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink 2023-12-22T08:24:23.996 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dnet.ko 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ethoc.ko 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fealnx.ko 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-22T08:24:23.997 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/jme.ko 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell 2023-12-22T08:24:23.998 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-22T08:24:23.999 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-22T08:24:24.000 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rocker 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-22T08:24:24.001 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-22T08:24:24.002 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/geneve.ko 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154 2023-12-22T08:24:24.003 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ifb.ko 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvlan.ko 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvtap.ko 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio.ko 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mii.ko 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/net_failover.ko 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/netconsole.ko 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/nlmon.ko 2023-12-22T08:24:24.004 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/amd.ko 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm87xx.ko 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/broadcom.ko 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/cicada.ko 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/davicom.ko 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/dp83640.ko 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/et1011c.ko 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/icplus.ko 2023-12-22T08:24:24.005 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/lxt.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/marvell.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/micrel.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/national.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/phylink.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/qsemi.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/realtek.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/smsc.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/ste10Xp.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/vitesse.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_async.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-22T08:24:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppoe.ko 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppox.ko 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pptp.ko 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slhc.ko 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slip.ko 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/sungem_phy.ko 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tap.ko 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team.ko 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_random.ko 2023-12-22T08:24:24.007 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tun.ko 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/veth.ko 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/virtio_net.ko 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan/vxlan.ko 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netfront.ko 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb/ntb.ko 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host 2023-12-22T08:24:24.008 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme-core.ko 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme.ko 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport.ko 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_cs.ko 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_pc.ko 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_serial.ko 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pcie 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/xen-pcifront.ko 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/i82092.ko 2023-12-22T08:24:24.009 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pd6729.ko 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acerhdf.ko 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-22T08:24:24.010 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/hdaps.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel_ips.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-22T08:24:24.011 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi.ko 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps_parport.ko 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/pps_core.ko 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp.ko 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp_kvm.ko 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc 2023-12-22T08:24:24.012 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-em3027.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-22T08:24:24.013 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max6900.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-x1205.ko 2023-12-22T08:24:24.014 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-9xxx.ko 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-sas.ko 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-xxxx.ko 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/BusLogic.ko 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/a100u2w.ko 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/advansys.ko 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/am53c974.ko 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/atp870u.ko 2023-12-22T08:24:24.015 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa/bfa.ko 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ch.ko 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-22T08:24:24.016 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dc395x.ko 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dmx3191d.ko 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esp_scsi.ko 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic 2023-12-22T08:24:24.017 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic/fnic.ko 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hpsa.ko 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hptiop.ko 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hv_storvsc.ko 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/initio.ko 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ipr.ko 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ips.ko 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci/isci.ko 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc/libfc.ko 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi.ko 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-22T08:24:24.018 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas/libsas.ko 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid.ko 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvumi.ko 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-22T08:24:24.019 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pmcraid.ko 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla1280.ko 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/raid_class.ko 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_debug.ko 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ses.ko 2023-12-22T08:24:24.020 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/st.ko 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/stex.ko 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/virtio_scsi.ko 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/wd719x.ko 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb/ssb.ko 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_file.ko 2023-12-22T08:24:24.021 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_iblock.ko 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_mod.ko 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_pscsi.ko 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_user.ko 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-22T08:24:24.022 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_gsm.ko 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_hdlc.ko 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/nozomi.ko 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial 2023-12-22T08:24:24.023 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/arc_uart.ko 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio.ko 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_aec.ko 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_cif.ko 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_pci_generic.ko 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_sercos3.ko 2023-12-22T08:24:24.024 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-acm.ko 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usblp.ko 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usbtmc.ko 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/mdc800.ko 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/microtek.ko 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/adutux.ko 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/appledisplay.ko 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi26.ko 2023-12-22T08:24:24.025 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi62.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ezusb.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/idmouse.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/iowarrior.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ldusb.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/legousbtower.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usb3503.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usblcd.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/uss720.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/yurex.ko 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy 2023-12-22T08:24:24.026 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-generic.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/aircable.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ark3116.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ch341.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cp210x.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cyberjack.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/empeg.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_ti.ko 2023-12-22T08:24:24.027 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipaq.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipw.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ir-usb.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mct_u232.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7720.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7840.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/navman.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/omninet.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/opticon.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/option.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/oti6858.ko 2023-12-22T08:24:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/pl2303.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcaux.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcserial.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/quatech2.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/safe_serial.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/sierra.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ssu100.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/symbolserial.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_debug.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/visor.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/whiteheat.ko 2023-12-22T08:24:24.029 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/uas.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-karma.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-22T08:24:24.030 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/usb-storage.ko 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio.ko 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost.ko 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_net.ko 2023-12-22T08:24:24.031 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_scsi.ko 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/apple_bl.ko 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lcd.ko 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio.ko 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_balloon.ko 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_mmio.ko 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci.ko 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_ring.ko 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1 2023-12-22T08:24:24.032 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2482.ko 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2490.ko 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-22T08:24:24.033 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/wire.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/hpwdt.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/i6300esb.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ib700wdt.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ibmasr.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it87_wdt.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/machzwd.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/nv_tco.ko 2023-12-22T08:24:24.034 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/softdog.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/via_wdt.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wdt_pci.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/xen_wdt.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-evtchn.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntalloc.ko 2023-12-22T08:24:24.035 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntdev.ko 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-privcmd.ko 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p/9p.ko 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs/affs.ko 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs/befs.ko 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/binfmt_misc.ko 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs 2023-12-22T08:24:24.036 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs/btrfs.ko 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles/cachefiles.ko 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph/ceph.ko 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda/coda.ko 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs/cramfs.ko 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm/dlm.ko 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ecryptfs 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs/f2fs.ko 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat 2023-12-22T08:24:24.037 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/fat.ko 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/msdos.ko 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/vfat.ko 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache/fscache.ko 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/cuse.ko 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/fuse.ko 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2/gfs2.ko 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs/hfs.ko 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus/hfsplus.ko 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs 2023-12-22T08:24:24.038 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs/isofs.ko 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs/jfs.ko 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd/lockd.ko 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix/minix.ko 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs/netfs.ko 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-22T08:24:24.039 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfs.ko 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv3.ko 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv4.ko 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/grace.ko 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/nfs_acl.ko 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd/nfsd.ko 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2/nilfs2.ko 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-celtic.ko 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-centeuro.ko 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-croatian.ko 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-cyrillic.ko 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-gaelic.ko 2023-12-22T08:24:24.040 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-greek.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-iceland.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-inuit.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-roman.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-romanian.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-turkish.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1250.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1251.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1255.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp737.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp775.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp850.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp852.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp855.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp857.ko 2023-12-22T08:24:24.041 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp860.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp861.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp862.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp863.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp864.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp865.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp866.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp869.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp874.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp932.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp936.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp949.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp950.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_euc-jp.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-1.ko 2023-12-22T08:24:24.042 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-13.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-14.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-15.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-2.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-3.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-4.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-5.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-6.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-7.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-9.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-r.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-ru.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-u.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_utf8.ko 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2 2023-12-22T08:24:24.043 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2.ko 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs/overlay.ko 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore/ramoops.ko 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs/reiserfs.ko 2023-12-22T08:24:24.044 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs/romfs.ko 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client/cifs.ko 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_arc4.ko 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_md4.ko 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs/squashfs.ko 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv/sysv.ko 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf/udf.ko 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs 2023-12-22T08:24:24.045 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs/ufs.ko 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs/xfs.ko 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/rcu 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/rcu/rcutorture.ko 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/torture.ko 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/trace 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/asn1_encoder.ko 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc-itu-t.ko 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc8.ko 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libarc4.ko 2023-12-22T08:24:24.046 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libdes.ko 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/libcrc32c.ko 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lru_cache.ko 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4_compress.ko 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4hc_compress.ko 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/math 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/math/cordic.ko 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6/raid6_pq.ko 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_bm.ko 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_fsm.ko 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_kmp.ko 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/zstd 2023-12-22T08:24:24.047 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/zstd/zstd_compress.ko 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/mm 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/mm/hwpoison-inject.ko 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/6lowpan.ko 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_dest.ko 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_fragment.ko 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_hop.ko 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_mobility.ko 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_routing.ko 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_udp.ko 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/garp.ko 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/mrp.ko 2023-12-22T08:24:24.048 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/p8022.ko 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/psnap.ko 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/stp.ko 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q/8021q.ko 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet.ko 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_fd.ko 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_rdma.ko 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_virtio.ko 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv/batman-adv.ko 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/br_netfilter.ko 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/bridge.ko 2023-12-22T08:24:24.049 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-22T08:24:24.050 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtables.ko 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph/libceph.ko 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core/failover.ko 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core/pktgen.ko 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp 2023-12-22T08:24:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp.ko 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_diag.ko 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv4.ko 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv6.ko 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dns_resolver 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dns_resolver/dns_resolver.ko 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/dsa_core.ko 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_brcm.ko 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_dsa.ko 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_none.ko 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_trailer.ko 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154.ko 2023-12-22T08:24:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ah4.ko 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/esp4.ko 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/fou.ko 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/gre.ko 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/inet_diag.ko 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_gre.ko 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_tunnel.ko 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_vti.ko 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipcomp.ko 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipip.ko 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-22T08:24:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-22T08:24:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_bic.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_dctcp.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_diag.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_highspeed.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_htcp.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_hybla.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_illinois.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_lp.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_scalable.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_vegas.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_veno.ko 2023-12-22T08:24:24.055 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_westwood.ko 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_yeah.ko 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tunnel4.ko 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_diag.ko 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_tunnel.ko 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ah6.ko 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/esp6.ko 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/fou6.ko 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_tunnel.ko 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_vti.ko 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ipcomp6.ko 2023-12-22T08:24:24.056 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter 2023-12-22T08:24:24.057 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-22T08:24:24.057 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-22T08:24:24.057 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-22T08:24:24.057 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-22T08:24:24.058 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-22T08:24:24.059 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-22T08:24:24.059 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-22T08:24:24.059 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-22T08:24:24.059 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-22T08:24:24.059 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-22T08:24:24.059 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/sit.ko 2023-12-22T08:24:24.059 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/tunnel6.ko 2023-12-22T08:24:24.059 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-22T08:24:24.059 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/key 2023-12-22T08:24:24.059 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/key/af_key.ko 2023-12-22T08:24:24.059 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp 2023-12-22T08:24:24.059 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_core.ko 2023-12-22T08:24:24.060 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-22T08:24:24.060 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_eth.ko 2023-12-22T08:24:24.060 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip.ko 2023-12-22T08:24:24.060 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip6.ko 2023-12-22T08:24:24.060 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_netlink.ko 2023-12-22T08:24:24.060 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ppp.ko 2023-12-22T08:24:24.060 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/llc 2023-12-22T08:24:24.060 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/llc.ko 2023-12-22T08:24:24.060 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154 2023-12-22T08:24:24.060 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154/mac802154.ko 2023-12-22T08:24:24.060 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls 2023-12-22T08:24:24.060 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls/mpls_gso.ko 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set.ko 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-22T08:24:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-22T08:24:24.062 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conncount.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-22T08:24:24.063 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_log_syslog.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_irc.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_sip.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-22T08:24:24.064 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_tables.ko 2023-12-22T08:24:24.065 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink.ko 2023-12-22T08:24:24.065 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-22T08:24:24.065 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_log.ko 2023-12-22T08:24:24.065 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-22T08:24:24.065 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-22T08:24:24.065 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_chain_nat.ko 2023-12-22T08:24:24.065 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_compat.ko 2023-12-22T08:24:24.065 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_ct.ko 2023-12-22T08:24:24.065 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fib.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_hash.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_limit.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_log.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_masq.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_nat.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_numgen.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_queue.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_quota.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_redir.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject_inet.ko 2023-12-22T08:24:24.066 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_socket.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_tunnel.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_AUDIT.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CT.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_DSCP.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HL.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HMARK.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LED.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LOG.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NETMAP.ko 2023-12-22T08:24:24.067 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFLOG.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_RATEEST.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_SECMARK.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TEE.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TPROXY.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TRACE.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_addrtype.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_bpf.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cgroup.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cluster.ko 2023-12-22T08:24:24.068 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_comment.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connbytes.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlabel.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlimit.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connmark.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_conntrack.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cpu.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dccp.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_devgroup.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dscp.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ecn.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_esp.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hashlimit.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_helper.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hl.ko 2023-12-22T08:24:24.069 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipcomp.ko 2023-12-22T08:24:24.070 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_iprange.ko 2023-12-22T08:24:24.070 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipvs.ko 2023-12-22T08:24:24.070 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_l2tp.ko 2023-12-22T08:24:24.070 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_length.ko 2023-12-22T08:24:24.070 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_limit.ko 2023-12-22T08:24:24.070 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mac.ko 2023-12-22T08:24:24.070 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mark.ko 2023-12-22T08:24:24.070 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_multiport.ko 2023-12-22T08:24:24.070 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nat.ko 2023-12-22T08:24:24.070 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nfacct.ko 2023-12-22T08:24:24.071 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_osf.ko 2023-12-22T08:24:24.071 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_owner.ko 2023-12-22T08:24:24.071 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_physdev.ko 2023-12-22T08:24:24.071 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_pkttype.ko 2023-12-22T08:24:24.071 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_policy.ko 2023-12-22T08:24:24.071 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_quota.ko 2023-12-22T08:24:24.071 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_rateest.ko 2023-12-22T08:24:24.071 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_realm.ko 2023-12-22T08:24:24.071 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_recent.ko 2023-12-22T08:24:24.071 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_sctp.ko 2023-12-22T08:24:24.071 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_set.ko 2023-12-22T08:24:24.071 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_socket.ko 2023-12-22T08:24:24.071 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_state.ko 2023-12-22T08:24:24.072 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_statistic.ko 2023-12-22T08:24:24.072 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_string.ko 2023-12-22T08:24:24.072 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_tcpmss.ko 2023-12-22T08:24:24.072 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_time.ko 2023-12-22T08:24:24.072 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_u32.ko 2023-12-22T08:24:24.072 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink 2023-12-22T08:24:24.072 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink/netlink_diag.ko 2023-12-22T08:24:24.072 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh 2023-12-22T08:24:24.072 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh/nsh.ko 2023-12-22T08:24:24.072 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch 2023-12-22T08:24:24.072 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/openvswitch.ko 2023-12-22T08:24:24.073 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-geneve.ko 2023-12-22T08:24:24.073 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-gre.ko 2023-12-22T08:24:24.073 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-vxlan.ko 2023-12-22T08:24:24.073 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/packet 2023-12-22T08:24:24.073 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/packet/af_packet_diag.ko 2023-12-22T08:24:24.073 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds 2023-12-22T08:24:24.074 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds.ko 2023-12-22T08:24:24.074 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_rdma.ko 2023-12-22T08:24:24.074 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_tcp.ko 2023-12-22T08:24:24.074 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched 2023-12-22T08:24:24.074 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_csum.ko 2023-12-22T08:24:24.074 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_gact.ko 2023-12-22T08:24:24.074 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_ipt.ko 2023-12-22T08:24:24.075 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_mirred.ko 2023-12-22T08:24:24.075 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_nat.ko 2023-12-22T08:24:24.075 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_pedit.ko 2023-12-22T08:24:24.075 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_police.ko 2023-12-22T08:24:24.075 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_simple.ko 2023-12-22T08:24:24.075 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_skbedit.ko 2023-12-22T08:24:24.076 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_vlan.ko 2023-12-22T08:24:24.076 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_basic.ko 2023-12-22T08:24:24.076 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_bpf.ko 2023-12-22T08:24:24.076 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_flow.ko 2023-12-22T08:24:24.076 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_fw.ko 2023-12-22T08:24:24.077 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_route.ko 2023-12-22T08:24:24.077 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_u32.ko 2023-12-22T08:24:24.077 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_cmp.ko 2023-12-22T08:24:24.077 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_ipset.ko 2023-12-22T08:24:24.077 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_meta.ko 2023-12-22T08:24:24.077 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_nbyte.ko 2023-12-22T08:24:24.077 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_text.ko 2023-12-22T08:24:24.077 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_u32.ko 2023-12-22T08:24:24.077 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_choke.ko 2023-12-22T08:24:24.078 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_codel.ko 2023-12-22T08:24:24.078 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_drr.ko 2023-12-22T08:24:24.078 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_fq.ko 2023-12-22T08:24:24.078 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_gred.ko 2023-12-22T08:24:24.078 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hfsc.ko 2023-12-22T08:24:24.078 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hhf.ko 2023-12-22T08:24:24.078 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_htb.ko 2023-12-22T08:24:24.078 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_ingress.ko 2023-12-22T08:24:24.078 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio.ko 2023-12-22T08:24:24.078 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio_lib.ko 2023-12-22T08:24:24.079 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_multiq.ko 2023-12-22T08:24:24.079 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_netem.ko 2023-12-22T08:24:24.079 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_pie.ko 2023-12-22T08:24:24.079 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_plug.ko 2023-12-22T08:24:24.079 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_prio.ko 2023-12-22T08:24:24.079 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_qfq.ko 2023-12-22T08:24:24.079 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_red.ko 2023-12-22T08:24:24.080 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfb.ko 2023-12-22T08:24:24.080 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfq.ko 2023-12-22T08:24:24.080 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_tbf.ko 2023-12-22T08:24:24.080 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_teql.ko 2023-12-22T08:24:24.080 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp 2023-12-22T08:24:24.080 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp.ko 2023-12-22T08:24:24.080 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp_diag.ko 2023-12-22T08:24:24.080 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc 2023-12-22T08:24:24.080 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss 2023-12-22T08:24:24.080 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-22T08:24:24.080 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-22T08:24:24.080 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/sunrpc.ko 2023-12-22T08:24:24.081 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma 2023-12-22T08:24:24.081 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-22T08:24:24.081 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc 2023-12-22T08:24:24.081 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/diag.ko 2023-12-22T08:24:24.081 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/tipc.ko 2023-12-22T08:24:24.081 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/unix 2023-12-22T08:24:24.081 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/unix/unix_diag.ko 2023-12-22T08:24:24.081 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock 2023-12-22T08:24:24.081 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-22T08:24:24.081 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-22T08:24:24.082 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock.ko 2023-12-22T08:24:24.082 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-22T08:24:24.082 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-22T08:24:24.082 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm 2023-12-22T08:24:24.082 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-22T08:24:24.082 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security 2023-12-22T08:24:24.082 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys 2023-12-22T08:24:24.082 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/encrypted-keys 2023-12-22T08:24:24.082 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-22T08:24:24.082 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/trusted-keys 2023-12-22T08:24:24.082 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/trusted-keys/trusted.ko 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib/irqbypass.ko 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.alias 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.alias.bin 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.alias.bin 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.bin 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.modinfo 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.dep 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.dep.bin 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.devname 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.order 2023-12-22T08:24:24.083 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.softdep 2023-12-22T08:24:24.084 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.symbols 2023-12-22T08:24:24.084 INFO:teuthology.orchestra.run.smithi038.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.symbols.bin 2023-12-22T08:24:24.084 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g623393c9d50c 2023-12-22T08:24:24.084 DEBUG:teuthology.orchestra.run.smithi038:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-22T08:24:24.108 INFO:teuthology.orchestra.run.smithi038.stdout:postinstall scriptlet (using /bin/sh): 2023-12-22T08:24:24.108 INFO:teuthology.orchestra.run.smithi038.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g623393c9d50c -a -r /boot/System.map-6.6.0-g623393c9d50c ]; then 2023-12-22T08:24:24.108 INFO:teuthology.orchestra.run.smithi038.stdout:cp /boot/vmlinuz-6.6.0-g623393c9d50c /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm 2023-12-22T08:24:24.108 INFO:teuthology.orchestra.run.smithi038.stdout:cp /boot/System.map-6.6.0-g623393c9d50c /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:24:24.108 INFO:teuthology.orchestra.run.smithi038.stdout:rm -f /boot/vmlinuz-6.6.0-g623393c9d50c /boot/System.map-6.6.0-g623393c9d50c 2023-12-22T08:24:24.108 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/installkernel 6.6.0-g623393c9d50c /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:24:24.108 INFO:teuthology.orchestra.run.smithi038.stdout:rm -f /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:24:24.108 INFO:teuthology.orchestra.run.smithi038.stdout:fi 2023-12-22T08:24:24.108 INFO:teuthology.orchestra.run.smithi038.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-22T08:24:24.109 INFO:teuthology.orchestra.run.smithi038.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-22T08:24:24.109 INFO:teuthology.orchestra.run.smithi038.stdout:new-kernel-pkg --remove 6.6.0-g623393c9d50c --rminitrd --initrdfile=/boot/initramfs-6.6.0-g623393c9d50c.img 2023-12-22T08:24:24.109 INFO:teuthology.orchestra.run.smithi038.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-22T08:24:24.109 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-install remove 6.6.0-g623393c9d50c 2023-12-22T08:24:24.109 INFO:teuthology.orchestra.run.smithi038.stdout:fi 2023-12-22T08:24:24.109 INFO:teuthology.orchestra.run.smithi038.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-22T08:24:24.109 INFO:teuthology.orchestra.run.smithi038.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-22T08:24:24.109 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/update-bootloader --remove 6.6.0-g623393c9d50c 2023-12-22T08:24:24.109 INFO:teuthology.orchestra.run.smithi038.stdout:fi 2023-12-22T08:24:24.110 DEBUG:teuthology.orchestra.run.smithi038:> sudo rpm -qi grub2-tools 2023-12-22T08:24:24.190 INFO:teuthology.orchestra.run.smithi038.stdout:Name : grub2-tools 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:Epoch : 1 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:Version : 2.06 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:Release : 68.el9 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: x86_64 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:Group : Unspecified 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:Size : 8264254 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:License : GPLv3+ 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:Packager : builder@centos.org 2023-12-22T08:24:24.191 INFO:teuthology.orchestra.run.smithi038.stdout:Vendor : CentOS 2023-12-22T08:24:24.192 INFO:teuthology.orchestra.run.smithi038.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-22T08:24:24.192 INFO:teuthology.orchestra.run.smithi038.stdout:Summary : Support tools for GRUB. 2023-12-22T08:24:24.192 INFO:teuthology.orchestra.run.smithi038.stdout:Description : 2023-12-22T08:24:24.192 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:24:24.192 INFO:teuthology.orchestra.run.smithi038.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-22T08:24:24.192 INFO:teuthology.orchestra.run.smithi038.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-22T08:24:24.192 INFO:teuthology.orchestra.run.smithi038.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-22T08:24:24.192 INFO:teuthology.orchestra.run.smithi038.stdout:hardware devices. 2023-12-22T08:24:24.192 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:24:24.192 INFO:teuthology.orchestra.run.smithi038.stdout:This subpackage provides tools for support of all platforms. 2023-12-22T08:24:24.193 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-22T08:24:24.193 INFO:teuthology.task.kernel:Updating grub on smithi038 to boot 6.6.0-g623393c9d50c 2023-12-22T08:24:24.193 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-22T08:24:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:Generating grub configuration file ... 2023-12-22T08:24:26.284 INFO:teuthology.orchestra.run.smithi038.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-22T08:24:26.319 INFO:teuthology.orchestra.run.smithi038.stderr:done 2023-12-22T08:24:26.322 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2023-12-22T08:24:26.336 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.YpdPneUbw4 2023-12-22T08:24:26.337 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YpdPneUbw4 2023-12-22T08:24:26.408 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.YpdPneUbw4 2023-12-22T08:24:26.548 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.YpdPneUbw4 is 6KB 2023-12-22T08:24:26.596 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.YpdPneUbw4 2023-12-22T08:24:26.611 DEBUG:teuthology.orchestra.run.smithi038:> sudo /bin/ls /boot/loader/entries || true 2023-12-22T08:24:26.684 INFO:teuthology.orchestra.run.smithi038.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-22T08:24:26.684 INFO:teuthology.orchestra.run.smithi038.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-22T08:24:26.684 INFO:teuthology.orchestra.run.smithi038.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-22T08:24:26.684 INFO:teuthology.orchestra.run.smithi038.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g623393c9d50c.conf 2023-12-22T08:24:26.686 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g623393c9d50c 2023-12-22T08:24:26.826 DEBUG:teuthology.orchestra.run.smithi038:> sudo shutdown -r now 2023-12-22T08:24:45.105 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-22T08:24:45.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-22T08:24:45.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:24:56.842 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-22T08:24:56.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-22T08:24:56.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:25:03.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-22T08:25:12.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-22T08:25:12.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:25:15.570 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-22T08:25:27.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-22T08:25:27.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:25:46.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-12-22T08:25:56.856 DEBUG:teuthology.orchestra.remote:timed out 2023-12-22T08:26:01.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-22T08:26:01.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:26:03.179 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-12-22T08:26:03.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-22T08:26:03.785 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g623393c9d50c"... 2023-12-22T08:26:03.785 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-12-22T08:26:03.825 INFO:teuthology.orchestra.run.smithi089.stdout:6.6.0-g623393c9d50c 2023-12-22T08:26:03.825 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g623393c9d50c vs 6.6.0-g623393c9d50c 2023-12-22T08:26:03.825 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-22T08:26:03.825 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-22T08:26:04.826 DEBUG:teuthology.parallel:result is None 2023-12-22T08:26:05.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-22T08:26:05.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:26:06.218 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-12-22T08:26:06.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-22T08:26:06.973 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g623393c9d50c"... 2023-12-22T08:26:06.973 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2023-12-22T08:26:07.031 INFO:teuthology.orchestra.run.smithi038.stdout:6.6.0-g623393c9d50c 2023-12-22T08:26:07.031 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g623393c9d50c vs 6.6.0-g623393c9d50c 2023-12-22T08:26:07.031 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-22T08:26:07.031 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-22T08:26:08.034 DEBUG:teuthology.parallel:result is None 2023-12-22T08:26:08.034 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-22T08:26:08.042 INFO:teuthology.task.internal:Creating test directory... 2023-12-22T08:26:08.043 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-22T08:26:08.049 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-22T08:26:08.098 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-22T08:26:08.108 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-22T08:26:08.117 INFO:teuthology.task.internal:Creating archive directory... 2023-12-22T08:26:08.117 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-22T08:26:08.135 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-22T08:26:08.189 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-22T08:26:08.196 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-22T08:26:08.196 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-22T08:26:08.222 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-22T08:26:08.365 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T08:26:08.409 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T08:26:08.432 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T08:26:08.479 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T08:26:08.483 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-22T08:26:08.491 INFO:teuthology.task.internal:Configuring sudo... 2023-12-22T08:26:08.491 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-22T08:26:08.499 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-22T08:26:08.581 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-22T08:26:08.591 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-22T08:26:08.591 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-22T08:26:08.596 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-22T08:26:08.642 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T08:26:08.746 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T08:26:08.833 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T08:26:08.911 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T08:26:08.998 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:26:08.998 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-22T08:26:09.112 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T08:26:09.186 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T08:26:09.267 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T08:26:09.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T08:26:09.434 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:26:09.434 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-22T08:26:09.540 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2023-12-22T08:26:09.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2023-12-22T08:26:09.674 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-22T08:26:09.729 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-22T08:26:10.066 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-22T08:26:10.075 INFO:teuthology.task.internal:Starting timer... 2023-12-22T08:26:10.075 INFO:teuthology.run_tasks:Running task pcp... 2023-12-22T08:26:10.097 INFO:teuthology.run_tasks:Running task selinux... 2023-12-22T08:26:10.107 DEBUG:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2023-12-22T08:26:10.218 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: 2023-12-22T08:26:10.223 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2023-12-22T08:26:10.349 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2023-12-22T08:26:10.353 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-22T08:26:10.353 DEBUG:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2023-12-22T08:26:10.417 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2023-12-22T08:26:10.418 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2023-12-22T08:26:10.470 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2023-12-22T08:26:10.470 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi038.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive'} 2023-12-22T08:26:10.470 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-22T08:26:10.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:26:10.555 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-22T08:26:10.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:26:10.641 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-22T08:26:10.641 DEBUG:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2023-12-22T08:26:10.728 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2023-12-22T08:26:10.817 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-22T08:26:10.830 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-22T08:26:10.857 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-22T08:26:10.858 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi089.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-22T08:36:46.253 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com')] 2023-12-22T08:36:46.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-22T08:36:46.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:46.396 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-12-22T08:36:46.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-12-22T08:36:46.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-22T08:36:46.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:46.705 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-12-22T08:36:46.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-22T08:36:46.863 INFO:teuthology.run_tasks:Running task clock... 2023-12-22T08:36:46.873 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-22T08:36:46.873 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-22T08:36:46.874 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T08:36:46.883 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-22T08:36:46.883 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T08:36:46.980 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-22T08:36:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-22T08:36:47.028 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-22T08:36:47.047 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-22T08:36:47.123 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2023-12-22T08:36:47.145 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: ntpd: command not found 2023-12-22T08:36:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2023-12-22T08:36:47.190 INFO:teuthology.orchestra.run.smithi038.stdout:506 Cannot talk to daemon 2023-12-22T08:36:47.216 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-22T08:36:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-22T08:36:47.267 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-22T08:36:47.300 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-22T08:36:47.395 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2023-12-22T08:36:47.403 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-22T08:36:47.403 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-12-22T08:36:47.403 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:47.403 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:47.403 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:47.403 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:47.435 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2023-12-22T08:36:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-22T08:36:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2023-12-22T08:36:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:47.444 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:47.446 INFO:teuthology.run_tasks:Running task install... 2023-12-22T08:36:47.454 DEBUG:teuthology.task.install:project ceph 2023-12-22T08:36:47.455 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}} 2023-12-22T08:36:47.455 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'} 2023-12-22T08:36:47.455 INFO:teuthology.task.install:Using flavor: default 2023-12-22T08:36:47.461 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-22T08:36:47.461 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-22T08:36:47.462 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-22T08:36:47.462 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T08:36:47.464 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-22T08:36:47.464 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T08:36:47.604 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-22T08:36:47.604 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-22T08:36:47.676 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-22T08:36:47.676 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-22T08:36:47.930 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-22T08:36:47.930 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:36:47.930 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-22T08:36:48.038 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-22T08:36:48.039 DEBUG:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-22T08:36:48.058 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-22T08:36:48.059 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:36:48.059 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-22T08:36:48.162 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-22T08:36:48.163 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-22T08:36:48.188 DEBUG:teuthology.orchestra.run.smithi038:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-22T08:36:48.302 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-22T08:36:48.336 DEBUG:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-22T08:36:48.432 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-22T08:36:48.433 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2023-12-22T08:36:48.436 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum clean all 2023-12-22T08:36:48.523 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2023-12-22T08:36:48.527 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2023-12-22T08:36:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:73 files removed 2023-12-22T08:36:48.839 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-22T08:36:48.886 INFO:teuthology.orchestra.run.smithi089.stdout:73 files removed 2023-12-22T08:36:48.925 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-22T08:36:50.479 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 74 kB/s | 77 kB 00:01 2023-12-22T08:36:50.560 INFO:teuthology.orchestra.run.smithi038.stdout:ceph packages for x86_64 65 kB/s | 77 kB 00:01 2023-12-22T08:36:51.404 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 11 kB/s | 9.5 kB 00:00 2023-12-22T08:36:51.494 INFO:teuthology.orchestra.run.smithi038.stdout:ceph noarch packages 11 kB/s | 9.5 kB 00:00 2023-12-22T08:36:52.380 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 2.1 kB/s | 1.9 kB 00:00 2023-12-22T08:36:52.503 INFO:teuthology.orchestra.run.smithi038.stdout:ceph source packages 2.0 kB/s | 1.9 kB 00:00 2023-12-22T08:36:52.958 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-12-22T08:36:53.107 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-12-22T08:36:54.642 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-9 - BaseOS 4.4 MB/s | 2.0 MB 00:00 2023-12-22T08:36:54.798 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2023-12-22T08:36:55.970 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 7.9 MB 00:00 2023-12-22T08:36:56.330 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 7.9 MB 00:01 2023-12-22T08:36:59.004 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-12-22T08:37:03.708 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 5.8 MB 00:00 2023-12-22T08:37:05.294 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 15 kB 00:00 2023-12-22T08:37:06.588 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2023-12-22T08:37:12.438 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2023-12-22T08:37:15.356 INFO:teuthology.orchestra.run.smithi038.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T08:37:15.358 INFO:teuthology.orchestra.run.smithi038.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T08:37:15.382 INFO:teuthology.orchestra.run.smithi038.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-22T08:37:15.383 INFO:teuthology.orchestra.run.smithi038.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-22T08:37:15.385 INFO:teuthology.orchestra.run.smithi038.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-22T08:37:15.386 INFO:teuthology.orchestra.run.smithi038.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-22T08:37:15.389 INFO:teuthology.orchestra.run.smithi038.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-22T08:37:15.393 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-22T08:37:15.394 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-22T08:37:15.482 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-12-22T08:37:15.498 INFO:teuthology.orchestra.run.smithi038.stdout:============================================================================================ 2023-12-22T08:37:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2023-12-22T08:37:15.498 INFO:teuthology.orchestra.run.smithi038.stdout:============================================================================================ 2023-12-22T08:37:15.498 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-12-22T08:37:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-22T08:37:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-22T08:37:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-22T08:37:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-22T08:37:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-22T08:37:15.498 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-22T08:37:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-22T08:37:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-22T08:37:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-22T08:37:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-22T08:37:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-22T08:37:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-22T08:37:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-22T08:37:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-22T08:37:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-22T08:37:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-22T08:37:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-22T08:37:15.499 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-22T08:37:15.500 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-22T08:37:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-22T08:37:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T08:37:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-22T08:37:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2023-12-22T08:37:15.501 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2023-12-22T08:37:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager x86_64 1:1.45.9-1.el9 CentOS-BaseOS 2.2 M 2023-12-22T08:37:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-libnm x86_64 1:1.45.9-1.el9 CentOS-BaseOS 1.8 M 2023-12-22T08:37:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-team x86_64 1:1.45.9-1.el9 CentOS-BaseOS 42 k 2023-12-22T08:37:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-tui x86_64 1:1.45.9-1.el9 CentOS-BaseOS 246 k 2023-12-22T08:37:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-22T08:37:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2023-12-22T08:37:15.501 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2023-12-22T08:37:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2023-12-22T08:37:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-22T08:37:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-22T08:37:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-22T08:37:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T08:37:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2023-12-22T08:37:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2023-12-22T08:37:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-22T08:37:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2023-12-22T08:37:15.502 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2023-12-22T08:37:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-22T08:37:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-22T08:37:15.502 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2023-12-22T08:37:15.503 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-22T08:37:15.504 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-22T08:37:15.505 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-22T08:37:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-22T08:37:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-22T08:37:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-22T08:37:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-22T08:37:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-22T08:37:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth noarch 1:2.25.2-1.el9 epel 199 k 2023-12-22T08:37:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-22T08:37:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-22T08:37:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-22T08:37:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-22T08:37:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-22T08:37:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-22T08:37:15.506 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-22T08:37:15.507 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-22T08:37:15.508 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-22T08:37:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2023-12-22T08:37:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-22T08:37:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-22T08:37:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-22T08:37:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-22T08:37:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-22T08:37:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-22T08:37:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-22T08:37:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-22T08:37:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-22T08:37:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-22T08:37:15.509 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-22T08:37:15.509 INFO:teuthology.orchestra.run.smithi038.stdout:Installing weak dependencies: 2023-12-22T08:37:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-22T08:37:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:37:15.510 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-12-22T08:37:15.510 INFO:teuthology.orchestra.run.smithi038.stdout:============================================================================================ 2023-12-22T08:37:15.510 INFO:teuthology.orchestra.run.smithi038.stdout:Install 139 Packages 2023-12-22T08:37:15.510 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 16 Packages 2023-12-22T08:37:15.510 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:37:15.510 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 200 M 2023-12-22T08:37:15.511 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-12-22T08:37:16.306 INFO:teuthology.orchestra.run.smithi038.stdout:(1/155): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 16 kB/s | 6.5 kB 00:00 2023-12-22T08:37:16.704 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 977 kB/s | 18 MB 00:19 2023-12-22T08:37:17.247 INFO:teuthology.orchestra.run.smithi038.stdout:(2/155): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 892 kB/s | 839 kB 00:00 2023-12-22T08:37:17.414 INFO:teuthology.orchestra.run.smithi038.stdout:(3/155): ceph-immutable-object-cache-18.2.0-137 860 kB/s | 142 kB 00:00 2023-12-22T08:37:18.706 INFO:teuthology.orchestra.run.smithi038.stdout:(4/155): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 1.9 MB/s | 5.2 MB 00:02 2023-12-22T08:37:18.940 INFO:teuthology.orchestra.run.smithi038.stdout:(5/155): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 1.4 MB/s | 2.1 MB 00:01 2023-12-22T08:37:19.282 INFO:teuthology.orchestra.run.smithi038.stdout:(6/155): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 2.5 MB/s | 1.4 MB 00:00 2023-12-22T08:37:22.048 INFO:teuthology.orchestra.run.smithi038.stdout:(7/155): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 1.4 MB/s | 4.4 MB 00:03 2023-12-22T08:37:26.048 INFO:teuthology.orchestra.run.smithi038.stdout:(8/155): ceph-osd-18.2.0-1377.g24e2e32a.el9.x86 2.6 MB/s | 18 MB 00:06 2023-12-22T08:37:26.132 INFO:teuthology.orchestra.run.smithi038.stdout:(9/155): ceph-selinux-18.2.0-1377.g24e2e32a.el9 294 kB/s | 24 kB 00:00 2023-12-22T08:37:27.145 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 889 kB/s | 5.8 MB 00:06 2023-12-22T08:37:27.626 INFO:teuthology.orchestra.run.smithi038.stdout:(10/155): ceph-radosgw-18.2.0-1377.g24e2e32a.el 1.4 MB/s | 7.7 MB 00:05 2023-12-22T08:37:27.799 INFO:teuthology.orchestra.run.smithi038.stdout:(11/155): cephfs-mirror-18.2.0-1377.g24e2e32a.e 1.2 MB/s | 219 kB 00:00 2023-12-22T08:37:27.891 INFO:teuthology.orchestra.run.smithi038.stdout:(12/155): cephfs-shell-18.2.0-1377.g24e2e32a.el 297 kB/s | 27 kB 00:00 2023-12-22T08:37:27.991 INFO:teuthology.orchestra.run.smithi038.stdout:(13/155): libcephfs-devel-18.2.0-1377.g24e2e32a 314 kB/s | 31 kB 00:00 2023-12-22T08:37:28.458 INFO:teuthology.orchestra.run.smithi038.stdout:(14/155): libcephfs2-18.2.0-1377.g24e2e32a.el9. 1.4 MB/s | 658 kB 00:00 2023-12-22T08:37:28.650 INFO:teuthology.orchestra.run.smithi038.stdout:(15/155): libcephsqlite-18.2.0-1377.g24e2e32a.e 868 kB/s | 166 kB 00:00 2023-12-22T08:37:28.746 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 15 kB 00:00 2023-12-22T08:37:28.975 INFO:teuthology.orchestra.run.smithi038.stdout:(16/155): librados-devel-18.2.0-1377.g24e2e32a. 391 kB/s | 127 kB 00:00 2023-12-22T08:37:29.450 INFO:teuthology.orchestra.run.smithi038.stdout:(17/155): libradosstriper1-18.2.0-1377.g24e2e32 1.0 MB/s | 474 kB 00:00 2023-12-22T08:37:31.262 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 20 MB 00:02 2023-12-22T08:37:32.618 INFO:teuthology.orchestra.run.smithi038.stdout:(18/155): ceph-common-18.2.0-1377.g24e2e32a.el9 1.1 MB/s | 18 MB 00:16 2023-12-22T08:37:32.751 INFO:teuthology.orchestra.run.smithi038.stdout:(19/155): python3-ceph-argparse-18.2.0-1377.g24 341 kB/s | 45 kB 00:00 2023-12-22T08:37:32.943 INFO:teuthology.orchestra.run.smithi038.stdout:(20/155): python3-ceph-common-18.2.0-1377.g24e2 653 kB/s | 124 kB 00:00 2023-12-22T08:37:33.151 INFO:teuthology.orchestra.run.smithi038.stdout:(21/155): librgw2-18.2.0-1377.g24e2e32a.el9.x86 1.2 MB/s | 4.5 MB 00:03 2023-12-22T08:37:33.176 INFO:teuthology.orchestra.run.smithi038.stdout:(22/155): python3-cephfs-18.2.0-1377.g24e2e32a. 695 kB/s | 162 kB 00:00 2023-12-22T08:37:33.468 INFO:teuthology.orchestra.run.smithi038.stdout:(23/155): python3-rbd-18.2.0-1377.g24e2e32a.el9 1.0 MB/s | 297 kB 00:00 2023-12-22T08:37:33.502 INFO:teuthology.orchestra.run.smithi038.stdout:(24/155): python3-rados-18.2.0-1377.g24e2e32a.e 914 kB/s | 319 kB 00:00 2023-12-22T08:37:33.586 INFO:teuthology.orchestra.run.smithi038.stdout:(25/155): python3-rgw-18.2.0-1377.g24e2e32a.el9 856 kB/s | 99 kB 00:00 2023-12-22T08:37:33.611 INFO:teuthology.orchestra.run.smithi038.stdout:(26/155): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 803 kB/s | 87 kB 00:00 2023-12-22T08:37:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:(27/155): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 982 kB/s | 171 kB 00:00 2023-12-22T08:37:33.878 INFO:teuthology.orchestra.run.smithi038.stdout:(28/155): ceph-grafana-dashboards-18.2.0-1377.g 255 kB/s | 23 kB 00:00 2023-12-22T08:37:34.037 INFO:teuthology.orchestra.run.smithi038.stdout:(29/155): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 839 kB/s | 132 kB 00:00 2023-12-22T08:37:35.304 INFO:teuthology.orchestra.run.smithi038.stdout:(30/155): ceph-mgr-dashboard-18.2.0-1377.g24e2e 1.4 MB/s | 1.8 MB 00:01 2023-12-22T08:37:35.712 INFO:teuthology.orchestra.run.smithi038.stdout:(31/155): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 1.4 MB/s | 3.0 MB 00:02 2023-12-22T08:37:35.921 INFO:teuthology.orchestra.run.smithi038.stdout:(32/155): ceph-mgr-modules-core-18.2.0-1377.g24 1.1 MB/s | 242 kB 00:00 2023-12-22T08:37:36.054 INFO:teuthology.orchestra.run.smithi038.stdout:(33/155): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 379 kB/s | 50 kB 00:00 2023-12-22T08:37:36.171 INFO:teuthology.orchestra.run.smithi038.stdout:(34/155): ceph-prometheus-alerts-18.2.0-1377.g2 126 kB/s | 15 kB 00:00 2023-12-22T08:37:36.380 INFO:teuthology.orchestra.run.smithi038.stdout:(35/155): ceph-volume-18.2.0-1377.g24e2e32a.el9 1.2 MB/s | 262 kB 00:00 2023-12-22T08:37:36.580 INFO:teuthology.orchestra.run.smithi038.stdout:(36/155): cephadm-18.2.0-1377.g24e2e32a.el9.noa 1.1 MB/s | 221 kB 00:00 2023-12-22T08:37:36.689 INFO:teuthology.orchestra.run.smithi038.stdout:(37/155): cephfs-top-18.2.0-1377.g24e2e32a.el9. 168 kB/s | 18 kB 00:00 2023-12-22T08:37:36.856 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-12-22T08:37:36.881 INFO:teuthology.orchestra.run.smithi038.stdout:(38/155): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2023-12-22T08:37:36.940 INFO:teuthology.orchestra.run.smithi038.stdout:(39/155): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 920 kB 00:00 2023-12-22T08:37:36.982 INFO:teuthology.orchestra.run.smithi038.stdout:(40/155): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2023-12-22T08:37:37.015 INFO:teuthology.orchestra.run.smithi038.stdout:(41/155): elfutils-libelf-devel-0.190-2.el9.x86 630 kB/s | 20 kB 00:00 2023-12-22T08:37:37.057 INFO:teuthology.orchestra.run.smithi038.stdout:(42/155): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 307 kB 00:00 2023-12-22T08:37:37.091 INFO:teuthology.orchestra.run.smithi038.stdout:(43/155): flexiblas-3.0.4-8.el9.x86_64.rpm 978 kB/s | 32 kB 00:00 2023-12-22T08:37:37.208 INFO:teuthology.orchestra.run.smithi038.stdout:(44/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2023-12-22T08:37:37.241 INFO:teuthology.orchestra.run.smithi038.stdout:(45/155): flexiblas-openblas-openmp-3.0.4-8.el9 531 kB/s | 17 kB 00:00 2023-12-22T08:37:37.283 INFO:teuthology.orchestra.run.smithi038.stdout:(46/155): libaio-devel-0.3.111-13.el9.x86_64.rp 247 kB/s | 10 kB 00:00 2023-12-22T08:37:37.325 INFO:teuthology.orchestra.run.smithi038.stdout:(47/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2023-12-22T08:37:37.367 INFO:teuthology.orchestra.run.smithi038.stdout:(48/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 44 kB 00:00 2023-12-22T08:37:37.443 INFO:teuthology.orchestra.run.smithi038.stdout:(49/155): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 661 kB 00:00 2023-12-22T08:37:37.493 INFO:teuthology.orchestra.run.smithi038.stdout:(50/155): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2023-12-22T08:37:37.527 INFO:teuthology.orchestra.run.smithi038.stdout:(51/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 756 kB/s | 24 kB 00:00 2023-12-22T08:37:37.560 INFO:teuthology.orchestra.run.smithi038.stdout:(52/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-12-22T08:37:37.602 INFO:teuthology.orchestra.run.smithi038.stdout:(53/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.7 MB/s | 282 kB 00:00 2023-12-22T08:37:37.636 INFO:teuthology.orchestra.run.smithi038.stdout:(54/155): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-12-22T08:37:37.786 INFO:teuthology.orchestra.run.smithi038.stdout:(55/155): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2023-12-22T08:37:37.912 INFO:teuthology.orchestra.run.smithi038.stdout:(56/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 24 MB/s | 3.0 MB 00:00 2023-12-22T08:37:37.995 INFO:teuthology.orchestra.run.smithi038.stdout:(57/155): postgresql-13.11-1.el9.x86_64.rpm 18 MB/s | 1.5 MB 00:00 2023-12-22T08:37:38.070 INFO:teuthology.orchestra.run.smithi038.stdout:(58/155): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2023-12-22T08:37:38.112 INFO:teuthology.orchestra.run.smithi038.stdout:(59/155): postgresql-private-libs-13.11-1.el9.x 3.2 MB/s | 134 kB 00:00 2023-12-22T08:37:38.296 INFO:teuthology.orchestra.run.smithi038.stdout:(60/155): postgresql-server-13.11-1.el9.x86_64. 31 MB/s | 5.7 MB 00:00 2023-12-22T08:37:38.355 INFO:teuthology.orchestra.run.smithi038.stdout:(61/155): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2023-12-22T08:37:38.555 INFO:teuthology.orchestra.run.smithi038.stdout:(62/155): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 5.8 MB 00:00 2023-12-22T08:37:38.597 INFO:teuthology.orchestra.run.smithi038.stdout:(63/155): python3-jinja2-2.11.3-4.el9.noarch.rp 5.5 MB/s | 228 kB 00:00 2023-12-22T08:37:38.630 INFO:teuthology.orchestra.run.smithi038.stdout:(64/155): python3-jsonpatch-1.21-16.el9.noarch. 752 kB/s | 24 kB 00:00 2023-12-22T08:37:38.664 INFO:teuthology.orchestra.run.smithi038.stdout:(65/155): python3-jsonpointer-2.0-4.el9.noarch. 548 kB/s | 18 kB 00:00 2023-12-22T08:37:38.706 INFO:teuthology.orchestra.run.smithi038.stdout:(66/155): python3-mako-1.1.4-6.el9.noarch.rpm 3.5 MB/s | 144 kB 00:00 2023-12-22T08:37:38.740 INFO:teuthology.orchestra.run.smithi038.stdout:(67/155): python3-markupsafe-1.1.1-12.el9.x86_6 977 kB/s | 32 kB 00:00 2023-12-22T08:37:38.890 INFO:teuthology.orchestra.run.smithi038.stdout:(68/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2023-12-22T08:37:38.940 INFO:teuthology.orchestra.run.smithi038.stdout:(69/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.4 MB/s | 217 kB 00:00 2023-12-22T08:37:38.999 INFO:teuthology.orchestra.run.smithi038.stdout:(70/155): python3-oauthlib-3.1.1-5.el9.noarch.r 3.0 MB/s | 174 kB 00:00 2023-12-22T08:37:39.033 INFO:teuthology.orchestra.run.smithi038.stdout:(71/155): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2023-12-22T08:37:39.075 INFO:teuthology.orchestra.run.smithi038.stdout:(72/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2023-12-22T08:37:39.117 INFO:teuthology.orchestra.run.smithi038.stdout:(73/155): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2023-12-22T08:37:39.150 INFO:teuthology.orchestra.run.smithi038.stdout:(74/155): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2023-12-22T08:37:39.184 INFO:teuthology.orchestra.run.smithi038.stdout:(75/155): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2023-12-22T08:37:39.634 INFO:teuthology.orchestra.run.smithi038.stdout:(76/155): ceph-mgr-diskprediction-local-18.2.0- 1.7 MB/s | 7.4 MB 00:04 2023-12-22T08:37:39.674 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T08:37:39.675 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T08:37:39.698 INFO:teuthology.orchestra.run.smithi089.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-22T08:37:39.699 INFO:teuthology.orchestra.run.smithi089.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-22T08:37:39.701 INFO:teuthology.orchestra.run.smithi089.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-22T08:37:39.702 INFO:teuthology.orchestra.run.smithi089.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-22T08:37:39.705 INFO:teuthology.orchestra.run.smithi089.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-22T08:37:39.708 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-22T08:37:39.710 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-22T08:37:39.790 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-22T08:37:39.808 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================================ 2023-12-22T08:37:39.808 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-12-22T08:37:39.808 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================================ 2023-12-22T08:37:39.808 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-22T08:37:39.809 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-22T08:37:39.810 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager x86_64 1:1.45.9-1.el9 CentOS-BaseOS 2.2 M 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-libnm x86_64 1:1.45.9-1.el9 CentOS-BaseOS 1.8 M 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-team x86_64 1:1.45.9-1.el9 CentOS-BaseOS 42 k 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-tui x86_64 1:1.45.9-1.el9 CentOS-BaseOS 246 k 2023-12-22T08:37:39.811 INFO:teuthology.orchestra.run.smithi089.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-22T08:37:39.812 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-22T08:37:39.813 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T08:37:39.813 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-22T08:37:39.813 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-22T08:37:39.813 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-22T08:37:39.813 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-22T08:37:39.813 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T08:37:39.813 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-22T08:37:39.813 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-22T08:37:39.813 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-22T08:37:39.813 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-22T08:37:39.813 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-22T08:37:39.813 INFO:teuthology.orchestra.run.smithi089.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-22T08:37:39.813 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-22T08:37:39.814 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-22T08:37:39.815 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-22T08:37:39.816 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-22T08:37:39.816 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-22T08:37:39.816 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-22T08:37:39.816 INFO:teuthology.orchestra.run.smithi089.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-22T08:37:39.816 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-22T08:37:39.816 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-22T08:37:39.816 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.25.2-1.el9 epel 199 k 2023-12-22T08:37:39.816 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-22T08:37:39.816 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-22T08:37:39.816 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-22T08:37:39.816 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-22T08:37:39.816 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-22T08:37:39.816 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-22T08:37:39.817 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-22T08:37:39.817 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-22T08:37:39.817 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-22T08:37:39.817 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-22T08:37:39.817 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-22T08:37:39.817 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-22T08:37:39.817 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-22T08:37:39.817 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-22T08:37:39.817 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-22T08:37:39.817 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-22T08:37:39.817 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-22T08:37:39.817 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-22T08:37:39.817 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-22T08:37:39.818 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-22T08:37:39.819 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-22T08:37:39.820 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-22T08:37:39.820 INFO:teuthology.orchestra.run.smithi089.stdout:Installing weak dependencies: 2023-12-22T08:37:39.820 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-22T08:37:39.820 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:37:39.820 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-22T08:37:39.820 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================================ 2023-12-22T08:37:39.820 INFO:teuthology.orchestra.run.smithi089.stdout:Install 139 Packages 2023-12-22T08:37:39.820 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 16 Packages 2023-12-22T08:37:39.820 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:37:39.821 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 200 M 2023-12-22T08:37:39.821 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-22T08:37:39.876 INFO:teuthology.orchestra.run.smithi038.stdout:(77/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2023-12-22T08:37:39.901 INFO:teuthology.orchestra.run.smithi038.stdout:(78/155): python3-toml-0.10.2-6.el9.noarch.rpm 153 kB/s | 39 kB 00:00 2023-12-22T08:37:39.927 INFO:teuthology.orchestra.run.smithi038.stdout:(79/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 845 kB/s | 41 kB 00:00 2023-12-22T08:37:39.960 INFO:teuthology.orchestra.run.smithi038.stdout:(80/155): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 300 kB 00:00 2023-12-22T08:37:39.985 INFO:teuthology.orchestra.run.smithi038.stdout:(81/155): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2023-12-22T08:37:40.011 INFO:teuthology.orchestra.run.smithi038.stdout:(82/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-12-22T08:37:40.036 INFO:teuthology.orchestra.run.smithi038.stdout:(83/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2023-12-22T08:37:40.062 INFO:teuthology.orchestra.run.smithi038.stdout:(84/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 904 kB/s | 44 kB 00:00 2023-12-22T08:37:40.089 INFO:teuthology.orchestra.run.smithi038.stdout:(85/155): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-12-22T08:37:40.120 INFO:teuthology.orchestra.run.smithi038.stdout:(86/155): jq-1.6-16.el9.x86_64.rpm 3.2 MB/s | 186 kB 00:00 2023-12-22T08:37:40.179 INFO:teuthology.orchestra.run.smithi038.stdout:(87/155): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.8 MB/s | 803 kB 00:00 2023-12-22T08:37:40.204 INFO:teuthology.orchestra.run.smithi038.stdout:(88/155): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2023-12-22T08:37:40.238 INFO:teuthology.orchestra.run.smithi038.stdout:(89/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.8 MB/s | 217 kB 00:00 2023-12-22T08:37:40.271 INFO:teuthology.orchestra.run.smithi038.stdout:(90/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 241 kB 00:00 2023-12-22T08:37:40.322 INFO:teuthology.orchestra.run.smithi038.stdout:(91/155): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-12-22T08:37:40.339 INFO:teuthology.orchestra.run.smithi038.stdout:(92/155): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-12-22T08:37:40.381 INFO:teuthology.orchestra.run.smithi038.stdout:(93/155): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 124 kB 00:00 2023-12-22T08:37:40.406 INFO:teuthology.orchestra.run.smithi038.stdout:(94/155): python3-requests-2.25.1-7.el9.noarch. 1.7 MB/s | 113 kB 00:00 2023-12-22T08:37:40.440 INFO:teuthology.orchestra.run.smithi038.stdout:(95/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-12-22T08:37:40.599 INFO:teuthology.orchestra.run.smithi089.stdout:(1/155): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 17 kB/s | 6.5 kB 00:00 2023-12-22T08:37:40.640 INFO:teuthology.orchestra.run.smithi038.stdout:(96/155): python3-devel-3.9.17-2.el9.x86_64.rpm 1.0 MB/s | 245 kB 00:00 2023-12-22T08:37:41.007 INFO:teuthology.orchestra.run.smithi038.stdout:(97/155): fmt-8.1.1-5.el9.x86_64.rpm 196 kB/s | 111 kB 00:00 2023-12-22T08:37:41.282 INFO:teuthology.orchestra.run.smithi038.stdout:(98/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 482 kB/s | 309 kB 00:00 2023-12-22T08:37:41.399 INFO:teuthology.orchestra.run.smithi038.stdout:(99/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 224 kB/s | 26 kB 00:00 2023-12-22T08:37:41.516 INFO:teuthology.orchestra.run.smithi038.stdout:(100/155): liboath-2.6.7-2.el9.x86_64.rpm 420 kB/s | 49 kB 00:00 2023-12-22T08:37:41.624 INFO:teuthology.orchestra.run.smithi089.stdout:(2/155): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 820 kB/s | 839 kB 00:01 2023-12-22T08:37:41.625 INFO:teuthology.orchestra.run.smithi038.stdout:(101/155): libarrow-9.0.0-10.el9.x86_64.rpm 7.2 MB/s | 4.4 MB 00:00 2023-12-22T08:37:41.650 INFO:teuthology.orchestra.run.smithi038.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 508 kB/s | 67 kB 00:00 2023-12-22T08:37:41.792 INFO:teuthology.orchestra.run.smithi038.stdout:(103/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.9 MB/s | 838 kB 00:00 2023-12-22T08:37:41.833 INFO:teuthology.orchestra.run.smithi089.stdout:(3/155): ceph-immutable-object-cache-18.2.0-137 688 kB/s | 142 kB 00:00 2023-12-22T08:37:41.884 INFO:teuthology.orchestra.run.smithi038.stdout:(104/155): python3-asyncssh-2.13.2-3.el9.noarch 2.3 MB/s | 548 kB 00:00 2023-12-22T08:37:41.901 INFO:teuthology.orchestra.run.smithi038.stdout:(105/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 405 kB/s | 43 kB 00:00 2023-12-22T08:37:41.976 INFO:teuthology.orchestra.run.smithi038.stdout:(106/155): python3-cachetools-4.2.4-1.el9.noarc 354 kB/s | 32 kB 00:00 2023-12-22T08:37:41.993 INFO:teuthology.orchestra.run.smithi038.stdout:(107/155): python3-certifi-2021.10.8-2.el9.noar 164 kB/s | 15 kB 00:00 2023-12-22T08:37:42.041 INFO:teuthology.orchestra.run.smithi089.stdout:(4/155): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 2.8 MB/s | 5.2 MB 00:01 2023-12-22T08:37:42.085 INFO:teuthology.orchestra.run.smithi038.stdout:(108/155): python3-cheroot-8.6.0-4.el9.noarch.r 1.6 MB/s | 172 kB 00:00 2023-12-22T08:37:42.127 INFO:teuthology.orchestra.run.smithi038.stdout:(109/155): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2023-12-22T08:37:42.228 INFO:teuthology.orchestra.run.smithi038.stdout:(110/155): python3-colorama-0.4.4-12.el9.noarch 354 kB/s | 35 kB 00:00 2023-12-22T08:37:42.261 INFO:teuthology.orchestra.run.smithi038.stdout:(111/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.7 MB/s | 303 kB 00:00 2023-12-22T08:37:42.336 INFO:teuthology.orchestra.run.smithi038.stdout:(112/155): python3-google-auth-2.25.2-1.el9.noa 1.8 MB/s | 199 kB 00:00 2023-12-22T08:37:42.362 INFO:teuthology.orchestra.run.smithi038.stdout:(113/155): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2023-12-22T08:37:42.366 INFO:teuthology.orchestra.run.smithi089.stdout:(5/155): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 4.5 MB/s | 1.4 MB 00:00 2023-12-22T08:37:42.437 INFO:teuthology.orchestra.run.smithi038.stdout:(114/155): python3-jaraco-classes-3.2.1-5.el9.n 178 kB/s | 18 kB 00:00 2023-12-22T08:37:42.495 INFO:teuthology.orchestra.run.smithi038.stdout:(115/155): python3-jaraco-collections-3.0.0-8.e 174 kB/s | 23 kB 00:00 2023-12-22T08:37:42.538 INFO:teuthology.orchestra.run.smithi038.stdout:(116/155): python3-jaraco-functools-3.5.0-2.el9 195 kB/s | 19 kB 00:00 2023-12-22T08:37:42.613 INFO:teuthology.orchestra.run.smithi038.stdout:(117/155): python3-jaraco-text-3.2.0-6.el9.noar 169 kB/s | 20 kB 00:00 2023-12-22T08:37:42.638 INFO:teuthology.orchestra.run.smithi038.stdout:(118/155): python3-jwt+crypto-2.4.0-1.el9.noarc 91 kB/s | 9.0 kB 00:00 2023-12-22T08:37:42.713 INFO:teuthology.orchestra.run.smithi038.stdout:(119/155): python3-jwt-2.4.0-1.el9.noarch.rpm 411 kB/s | 41 kB 00:00 2023-12-22T08:37:42.789 INFO:teuthology.orchestra.run.smithi038.stdout:(120/155): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2023-12-22T08:37:42.823 INFO:teuthology.orchestra.run.smithi038.stdout:(121/155): python3-logutils-0.3.5-21.el9.noarch 428 kB/s | 46 kB 00:00 2023-12-22T08:37:42.898 INFO:teuthology.orchestra.run.smithi038.stdout:(122/155): python3-more-itertools-8.12.0-2.el9. 730 kB/s | 79 kB 00:00 2023-12-22T08:37:42.931 INFO:teuthology.orchestra.run.smithi038.stdout:(123/155): python3-natsort-7.1.1-5.el9.noarch.r 535 kB/s | 58 kB 00:00 2023-12-22T08:37:43.175 INFO:teuthology.orchestra.run.smithi089.stdout:(6/155): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 5.5 MB/s | 4.4 MB 00:00 2023-12-22T08:37:43.365 INFO:teuthology.orchestra.run.smithi038.stdout:(124/155): ceph-test-18.2.0-1377.g24e2e32a.el9. 2.3 MB/s | 40 MB 00:17 2023-12-22T08:37:43.390 INFO:teuthology.orchestra.run.smithi038.stdout:(125/155): python3-portend-3.1.0-2.el9.noarch.r 36 kB/s | 16 kB 00:00 2023-12-22T08:37:43.424 INFO:teuthology.orchestra.run.smithi038.stdout:(126/155): python3-pecan-1.4.2-3.el9.noarch.rpm 519 kB/s | 272 kB 00:00 2023-12-22T08:37:43.517 INFO:teuthology.orchestra.run.smithi089.stdout:(7/155): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 1.3 MB/s | 2.1 MB 00:01 2023-12-22T08:37:43.557 INFO:teuthology.orchestra.run.smithi038.stdout:(127/155): python3-pyperclip-1.8.2-2.el9.noarch 170 kB/s | 28 kB 00:00 2023-12-22T08:37:43.583 INFO:teuthology.orchestra.run.smithi038.stdout:(128/155): python3-repoze-lru-0.7-16.el9.noarch 195 kB/s | 31 kB 00:00 2023-12-22T08:37:43.691 INFO:teuthology.orchestra.run.smithi038.stdout:(129/155): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-12-22T08:37:43.717 INFO:teuthology.orchestra.run.smithi038.stdout:(130/155): python3-rsa-4.9-2.el9.noarch.rpm 447 kB/s | 59 kB 00:00 2023-12-22T08:37:43.792 INFO:teuthology.orchestra.run.smithi038.stdout:(131/155): python3-tempora-5.0.0-2.el9.noarch.r 361 kB/s | 36 kB 00:00 2023-12-22T08:37:43.817 INFO:teuthology.orchestra.run.smithi038.stdout:(132/155): python3-typing-extensions-4.4.0-2.el 511 kB/s | 51 kB 00:00 2023-12-22T08:37:43.901 INFO:teuthology.orchestra.run.smithi038.stdout:(133/155): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2023-12-22T08:37:43.948 INFO:teuthology.orchestra.run.smithi038.stdout:(134/155): python3-websocket-client-1.2.3-2.el9 691 kB/s | 90 kB 00:00 2023-12-22T08:37:43.977 INFO:teuthology.orchestra.run.smithi038.stdout:(135/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 147 kB/s | 90 kB 00:00 2023-12-22T08:37:44.043 INFO:teuthology.orchestra.run.smithi038.stdout:(136/155): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2023-12-22T08:37:44.077 INFO:teuthology.orchestra.run.smithi038.stdout:(137/155): python3-zc-lockfile-2.0-10.el9.noarc 156 kB/s | 20 kB 00:00 2023-12-22T08:37:44.185 INFO:teuthology.orchestra.run.smithi038.stdout:(138/155): re2-20211101-3.el9.x86_64.rpm 920 kB/s | 192 kB 00:00 2023-12-22T08:37:44.261 INFO:teuthology.orchestra.run.smithi038.stdout:(139/155): thrift-0.15.0-2.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2023-12-22T08:37:44.303 INFO:teuthology.orchestra.run.smithi038.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-12-22T08:37:44.403 INFO:teuthology.orchestra.run.smithi038.stdout:(141/155): NetworkManager-1.45.9-1.el9.x86_64.r 23 MB/s | 2.2 MB 00:00 2023-12-22T08:37:44.520 INFO:teuthology.orchestra.run.smithi038.stdout:(142/155): NetworkManager-libnm-1.45.9-1.el9.x8 15 MB/s | 1.8 MB 00:00 2023-12-22T08:37:44.562 INFO:teuthology.orchestra.run.smithi038.stdout:(143/155): NetworkManager-team-1.45.9-1.el9.x86 1.0 MB/s | 42 kB 00:00 2023-12-22T08:37:44.854 INFO:teuthology.orchestra.run.smithi038.stdout:(144/155): NetworkManager-tui-1.45.9-1.el9.x86_ 847 kB/s | 246 kB 00:00 2023-12-22T08:37:44.887 INFO:teuthology.orchestra.run.smithi038.stdout:(145/155): acl-2.3.1-4.el9.x86_64.rpm 2.1 MB/s | 69 kB 00:00 2023-12-22T08:37:44.922 INFO:teuthology.orchestra.run.smithi038.stdout:(146/155): elfutils-debuginfod-client-0.190-2.e 1.1 MB/s | 35 kB 00:00 2023-12-22T08:37:44.963 INFO:teuthology.orchestra.run.smithi038.stdout:(147/155): elfutils-libelf-0.190-2.el9.x86_64.r 4.6 MB/s | 191 kB 00:00 2023-12-22T08:37:45.005 INFO:teuthology.orchestra.run.smithi038.stdout:(148/155): elfutils-libs-0.190-2.el9.x86_64.rpm 6.1 MB/s | 254 kB 00:00 2023-12-22T08:37:45.056 INFO:teuthology.orchestra.run.smithi038.stdout:(149/155): libacl-2.3.1-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2023-12-22T08:37:45.148 INFO:teuthology.orchestra.run.smithi038.stdout:(150/155): openssl-3.0.7-25.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2023-12-22T08:37:45.239 INFO:teuthology.orchestra.run.smithi038.stdout:(151/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 24 MB/s | 2.1 MB 00:00 2023-12-22T08:37:45.282 INFO:teuthology.orchestra.run.smithi038.stdout:(152/155): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2023-12-22T08:37:45.349 INFO:teuthology.orchestra.run.smithi038.stdout:(153/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2023-12-22T08:37:46.049 INFO:teuthology.orchestra.run.smithi038.stdout:(154/155): librbd1-18.2.0-1377.g24e2e32a.el9.x8 1.6 MB/s | 3.0 MB 00:01 2023-12-22T08:37:46.274 INFO:teuthology.orchestra.run.smithi038.stdout:(155/155): librados2-18.2.0-1377.g24e2e32a.el9. 1.5 MB/s | 3.3 MB 00:02 2023-12-22T08:37:46.287 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-12-22T08:37:46.287 INFO:teuthology.orchestra.run.smithi038.stdout:Total 6.5 MB/s | 200 MB 00:30 2023-12-22T08:37:46.342 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-12-22T08:37:46.365 INFO:teuthology.orchestra.run.smithi089.stdout:(8/155): ceph-osd-18.2.0-1377.g24e2e32a.el9.x86 5.5 MB/s | 18 MB 00:03 2023-12-22T08:37:46.451 INFO:teuthology.orchestra.run.smithi089.stdout:(9/155): ceph-selinux-18.2.0-1377.g24e2e32a.el9 286 kB/s | 24 kB 00:00 2023-12-22T08:37:46.700 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-12-22T08:37:46.701 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-12-22T08:37:48.826 INFO:teuthology.orchestra.run.smithi089.stdout:(10/155): ceph-radosgw-18.2.0-1377.g24e2e32a.el 1.5 MB/s | 7.7 MB 00:05 2023-12-22T08:37:48.896 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-12-22T08:37:48.896 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-12-22T08:37:48.985 INFO:teuthology.orchestra.run.smithi089.stdout:(11/155): cephfs-mirror-18.2.0-1377.g24e2e32a.e 1.4 MB/s | 219 kB 00:00 2023-12-22T08:37:49.077 INFO:teuthology.orchestra.run.smithi089.stdout:(12/155): cephfs-shell-18.2.0-1377.g24e2e32a.el 299 kB/s | 27 kB 00:00 2023-12-22T08:37:49.160 INFO:teuthology.orchestra.run.smithi089.stdout:(13/155): libcephfs-devel-18.2.0-1377.g24e2e32a 376 kB/s | 31 kB 00:00 2023-12-22T08:37:49.536 INFO:teuthology.orchestra.run.smithi089.stdout:(14/155): libcephfs2-18.2.0-1377.g24e2e32a.el9. 1.7 MB/s | 658 kB 00:00 2023-12-22T08:37:49.702 INFO:teuthology.orchestra.run.smithi089.stdout:(15/155): libcephsqlite-18.2.0-1377.g24e2e32a.e 1.0 MB/s | 166 kB 00:00 2023-12-22T08:37:49.811 INFO:teuthology.orchestra.run.smithi089.stdout:(16/155): librados-devel-18.2.0-1377.g24e2e32a. 1.2 MB/s | 127 kB 00:00 2023-12-22T08:37:50.153 INFO:teuthology.orchestra.run.smithi089.stdout:(17/155): libradosstriper1-18.2.0-1377.g24e2e32 1.4 MB/s | 474 kB 00:00 2023-12-22T08:37:54.187 INFO:teuthology.orchestra.run.smithi089.stdout:(18/155): ceph-common-18.2.0-1377.g24e2e32a.el9 1.3 MB/s | 18 MB 00:13 2023-12-22T08:37:54.697 INFO:teuthology.orchestra.run.smithi089.stdout:(19/155): ceph-test-18.2.0-1377.g24e2e32a.el9.x 4.8 MB/s | 40 MB 00:08 2023-12-22T08:37:54.722 INFO:teuthology.orchestra.run.smithi089.stdout:(20/155): python3-ceph-argparse-18.2.0-1377.g24 84 kB/s | 45 kB 00:00 2023-12-22T08:37:54.823 INFO:teuthology.orchestra.run.smithi089.stdout:(21/155): librgw2-18.2.0-1377.g24e2e32a.el9.x86 976 kB/s | 4.5 MB 00:04 2023-12-22T08:37:54.857 INFO:teuthology.orchestra.run.smithi089.stdout:(22/155): python3-ceph-common-18.2.0-1377.g24e2 790 kB/s | 124 kB 00:00 2023-12-22T08:37:54.924 INFO:teuthology.orchestra.run.smithi089.stdout:(23/155): python3-cephfs-18.2.0-1377.g24e2e32a. 809 kB/s | 162 kB 00:00 2023-12-22T08:37:55.024 INFO:teuthology.orchestra.run.smithi089.stdout:(24/155): python3-rbd-18.2.0-1377.g24e2e32a.el9 1.7 MB/s | 297 kB 00:00 2023-12-22T08:37:55.049 INFO:teuthology.orchestra.run.smithi089.stdout:(25/155): python3-rgw-18.2.0-1377.g24e2e32a.el9 798 kB/s | 99 kB 00:00 2023-12-22T08:37:55.124 INFO:teuthology.orchestra.run.smithi089.stdout:(26/155): python3-rados-18.2.0-1377.g24e2e32a.e 1.0 MB/s | 319 kB 00:00 2023-12-22T08:37:55.342 INFO:teuthology.orchestra.run.smithi089.stdout:(27/155): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 274 kB/s | 87 kB 00:00 2023-12-22T08:37:55.434 INFO:teuthology.orchestra.run.smithi089.stdout:(28/155): ceph-grafana-dashboards-18.2.0-1377.g 255 kB/s | 23 kB 00:00 2023-12-22T08:37:55.467 INFO:teuthology.orchestra.run.smithi089.stdout:(29/155): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 500 kB/s | 171 kB 00:00 2023-12-22T08:37:55.526 INFO:teuthology.orchestra.run.smithi089.stdout:(30/155): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 1.4 MB/s | 132 kB 00:00 2023-12-22T08:37:55.564 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-12-22T08:37:55.712 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2023-12-22T08:37:55.748 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/171 2023-12-22T08:37:55.820 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/171 2023-12-22T08:37:55.879 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/171 2023-12-22T08:37:55.941 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2023-12-22T08:37:56.048 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2023-12-22T08:37:56.477 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2023-12-22T08:37:56.505 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:37:56.657 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:37:56.689 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:37:56.819 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:37:56.860 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T08:37:57.012 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2023-12-22T08:37:57.051 INFO:teuthology.orchestra.run.smithi089.stdout:(31/155): ceph-mgr-dashboard-18.2.0-1377.g24e2e 1.1 MB/s | 1.8 MB 00:01 2023-12-22T08:37:57.126 INFO:teuthology.orchestra.run.smithi089.stdout:(32/155): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 1.4 MB/s | 3.0 MB 00:02 2023-12-22T08:37:57.138 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2023-12-22T08:37:57.235 INFO:teuthology.orchestra.run.smithi089.stdout:(33/155): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 467 kB/s | 50 kB 00:00 2023-12-22T08:37:57.260 INFO:teuthology.orchestra.run.smithi089.stdout:(34/155): ceph-mgr-modules-core-18.2.0-1377.g24 1.1 MB/s | 242 kB 00:00 2023-12-22T08:37:57.336 INFO:teuthology.orchestra.run.smithi089.stdout:(35/155): ceph-prometheus-alerts-18.2.0-1377.g2 147 kB/s | 15 kB 00:00 2023-12-22T08:37:57.452 INFO:teuthology.orchestra.run.smithi089.stdout:(36/155): cephadm-18.2.0-1377.g24e2e32a.el9.noa 1.9 MB/s | 221 kB 00:00 2023-12-22T08:37:57.457 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2023-12-22T08:37:57.486 INFO:teuthology.orchestra.run.smithi089.stdout:(37/155): ceph-volume-18.2.0-1377.g24e2e32a.el9 1.1 MB/s | 262 kB 00:00 2023-12-22T08:37:57.514 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2023-12-22T08:37:57.538 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T08:37:57.595 INFO:teuthology.orchestra.run.smithi089.stdout:(38/155): cephfs-top-18.2.0-1377.g24e2e32a.el9. 128 kB/s | 18 kB 00:00 2023-12-22T08:37:57.681 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T08:37:57.695 INFO:teuthology.orchestra.run.smithi089.stdout:(39/155): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 662 kB 00:00 2023-12-22T08:37:57.722 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T08:37:57.745 INFO:teuthology.orchestra.run.smithi089.stdout:(40/155): bison-3.7.4-5.el9.x86_64.rpm 6.1 MB/s | 920 kB 00:00 2023-12-22T08:37:57.771 INFO:teuthology.orchestra.run.smithi089.stdout:(41/155): boost-program-options-1.75.0-8.el9.x8 1.5 MB/s | 106 kB 00:00 2023-12-22T08:37:57.796 INFO:teuthology.orchestra.run.smithi089.stdout:(42/155): elfutils-libelf-devel-0.190-2.el9.x86 421 kB/s | 20 kB 00:00 2023-12-22T08:37:57.806 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T08:37:57.830 INFO:teuthology.orchestra.run.smithi089.stdout:(43/155): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2023-12-22T08:37:57.855 INFO:teuthology.orchestra.run.smithi089.stdout:(44/155): flexiblas-3.0.4-8.el9.x86_64.rpm 573 kB/s | 32 kB 00:00 2023-12-22T08:37:57.956 INFO:teuthology.orchestra.run.smithi089.stdout:(45/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2023-12-22T08:37:57.972 INFO:teuthology.orchestra.run.smithi089.stdout:(46/155): flexiblas-openblas-openmp-3.0.4-8.el9 169 kB/s | 17 kB 00:00 2023-12-22T08:37:58.117 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2023-12-22T08:37:58.140 INFO:teuthology.orchestra.run.smithi089.stdout:(47/155): ceph-mgr-diskprediction-local-18.2.0- 2.8 MB/s | 7.4 MB 00:02 2023-12-22T08:37:58.165 INFO:teuthology.orchestra.run.smithi089.stdout:(48/155): libaio-devel-0.3.111-13.el9.x86_64.rp 53 kB/s | 10 kB 00:00 2023-12-22T08:37:58.190 INFO:teuthology.orchestra.run.smithi089.stdout:(49/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 737 kB/s | 159 kB 00:00 2023-12-22T08:37:58.207 INFO:teuthology.orchestra.run.smithi089.stdout:(50/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 683 kB/s | 44 kB 00:00 2023-12-22T08:37:58.257 INFO:teuthology.orchestra.run.smithi089.stdout:(51/155): libtool-2.4.6-45.el9.x86_64.rpm 8.7 MB/s | 578 kB 00:00 2023-12-22T08:37:58.300 INFO:teuthology.orchestra.run.smithi089.stdout:(52/155): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 661 kB 00:00 2023-12-22T08:37:58.310 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T08:37:58.316 INFO:teuthology.orchestra.run.smithi089.stdout:(53/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 231 kB/s | 24 kB 00:00 2023-12-22T08:37:58.333 INFO:teuthology.orchestra.run.smithi089.stdout:(54/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 46 kB 00:00 2023-12-22T08:37:58.350 INFO:teuthology.orchestra.run.smithi089.stdout:(55/155): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-12-22T08:37:58.392 INFO:teuthology.orchestra.run.smithi089.stdout:(56/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-12-22T08:37:58.399 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T08:37:58.517 INFO:teuthology.orchestra.run.smithi089.stdout:(57/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 19 MB/s | 3.0 MB 00:00 2023-12-22T08:37:58.605 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:37:58.626 INFO:teuthology.orchestra.run.smithi089.stdout:(58/155): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2023-12-22T08:37:58.655 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:37:58.676 INFO:teuthology.orchestra.run.smithi089.stdout:(59/155): postgresql-13.11-1.el9.x86_64.rpm 5.5 MB/s | 1.5 MB 00:00 2023-12-22T08:37:58.718 INFO:teuthology.orchestra.run.smithi089.stdout:(60/155): postgresql-contrib-13.11-1.el9.x86_64 4.3 MB/s | 811 kB 00:00 2023-12-22T08:37:58.760 INFO:teuthology.orchestra.run.smithi089.stdout:(61/155): postgresql-private-libs-13.11-1.el9.x 1.7 MB/s | 134 kB 00:00 2023-12-22T08:37:58.902 INFO:teuthology.orchestra.run.smithi089.stdout:(62/155): postgresql-server-13.11-1.el9.x86_64. 26 MB/s | 5.7 MB 00:00 2023-12-22T08:37:58.947 INFO:teuthology.orchestra.run.smithi089.stdout:(63/155): python3-attrs-20.3.0-7.el9.noarch.rpm 368 kB/s | 78 kB 00:00 2023-12-22T08:37:59.086 INFO:teuthology.orchestra.run.smithi089.stdout:(64/155): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2023-12-22T08:37:59.109 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:37:59.111 INFO:teuthology.orchestra.run.smithi089.stdout:(65/155): python3-jsonpatch-1.21-16.el9.noarch. 163 kB/s | 24 kB 00:00 2023-12-22T08:37:59.153 INFO:teuthology.orchestra.run.smithi089.stdout:(66/155): python3-jinja2-2.11.3-4.el9.noarch.rp 1.2 MB/s | 228 kB 00:00 2023-12-22T08:37:59.178 INFO:teuthology.orchestra.run.smithi089.stdout:(67/155): python3-jsonpointer-2.0-4.el9.noarch. 283 kB/s | 18 kB 00:00 2023-12-22T08:37:59.179 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2023-12-22T08:37:59.204 INFO:teuthology.orchestra.run.smithi089.stdout:(68/155): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 144 kB 00:00 2023-12-22T08:37:59.229 INFO:teuthology.orchestra.run.smithi089.stdout:(69/155): python3-markupsafe-1.1.1-12.el9.x86_6 432 kB/s | 32 kB 00:00 2023-12-22T08:37:59.279 INFO:teuthology.orchestra.run.smithi089.stdout:(70/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 217 kB 00:00 2023-12-22T08:37:59.316 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2023-12-22T08:37:59.391 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2023-12-22T08:37:59.413 INFO:teuthology.orchestra.run.smithi089.stdout:(71/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2023-12-22T08:37:59.424 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2023-12-22T08:37:59.438 INFO:teuthology.orchestra.run.smithi089.stdout:(72/155): python3-oauthlib-3.1.1-5.el9.noarch.r 871 kB/s | 174 kB 00:00 2023-12-22T08:37:59.464 INFO:teuthology.orchestra.run.smithi089.stdout:(73/155): python3-prettytable-0.7.2-27.el9.noar 243 kB/s | 41 kB 00:00 2023-12-22T08:37:59.483 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/171 2023-12-22T08:37:59.506 INFO:teuthology.orchestra.run.smithi089.stdout:(74/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2023-12-22T08:37:59.531 INFO:teuthology.orchestra.run.smithi089.stdout:(75/155): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2023-12-22T08:37:59.535 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/171 2023-12-22T08:37:59.556 INFO:teuthology.orchestra.run.smithi089.stdout:(76/155): python3-pytz-2021.1-5.el9.noarch.rpm 523 kB/s | 47 kB 00:00 2023-12-22T08:37:59.606 INFO:teuthology.orchestra.run.smithi089.stdout:(77/155): python3-toml-0.10.2-6.el9.noarch.rpm 801 kB/s | 39 kB 00:00 2023-12-22T08:37:59.648 INFO:teuthology.orchestra.run.smithi089.stdout:(78/155): python3-requests-oauthlib-1.3.0-12.el 472 kB/s | 43 kB 00:00 2023-12-22T08:37:59.652 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2023-12-22T08:37:59.710 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2023-12-22T08:37:59.744 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2023-12-22T08:37:59.864 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/171 2023-12-22T08:37:59.915 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 30/171 2023-12-22T08:37:59.969 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 31/171 2023-12-22T08:37:59.974 INFO:teuthology.orchestra.run.smithi089.stdout:(79/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2023-12-22T08:38:00.007 INFO:teuthology.orchestra.run.smithi089.stdout:(80/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 107 kB/s | 41 kB 00:00 2023-12-22T08:38:00.032 INFO:teuthology.orchestra.run.smithi089.stdout:(81/155): socat-1.7.4.1-5.el9.x86_64.rpm 811 kB/s | 300 kB 00:00 2023-12-22T08:38:00.049 INFO:teuthology.orchestra.run.smithi089.stdout:(82/155): uuid-1.6.2-55.el9.x86_64.rpm 792 kB/s | 56 kB 00:00 2023-12-22T08:38:00.075 INFO:teuthology.orchestra.run.smithi089.stdout:(83/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.1 MB/s | 87 kB 00:00 2023-12-22T08:38:00.087 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 32/171 2023-12-22T08:38:00.091 INFO:teuthology.orchestra.run.smithi089.stdout:(84/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2023-12-22T08:38:00.175 INFO:teuthology.orchestra.run.smithi089.stdout:(85/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 356 kB/s | 44 kB 00:00 2023-12-22T08:38:00.201 INFO:teuthology.orchestra.run.smithi089.stdout:(86/155): fuse-2.9.9-15.el9.x86_64.rpm 732 kB/s | 79 kB 00:00 2023-12-22T08:38:00.226 INFO:teuthology.orchestra.run.smithi089.stdout:(87/155): jq-1.6-16.el9.x86_64.rpm 1.4 MB/s | 186 kB 00:00 2023-12-22T08:38:00.276 INFO:teuthology.orchestra.run.smithi089.stdout:(88/155): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.0 MB/s | 803 kB 00:00 2023-12-22T08:38:00.279 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/171 2023-12-22T08:38:00.318 INFO:teuthology.orchestra.run.smithi089.stdout:(89/155): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2023-12-22T08:38:00.343 INFO:teuthology.orchestra.run.smithi089.stdout:(90/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.9 MB/s | 217 kB 00:00 2023-12-22T08:38:00.350 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/171 2023-12-22T08:38:00.377 INFO:teuthology.orchestra.run.smithi089.stdout:(91/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.4 MB/s | 241 kB 00:00 2023-12-22T08:38:00.411 INFO:teuthology.orchestra.run.smithi089.stdout:(92/155): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-12-22T08:38:00.469 INFO:teuthology.orchestra.run.smithi089.stdout:(93/155): python3-cryptography-36.0.1-4.el9.x86 9.3 MB/s | 1.1 MB 00:00 2023-12-22T08:38:00.495 INFO:teuthology.orchestra.run.smithi089.stdout:(94/155): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 124 kB 00:00 2023-12-22T08:38:00.520 INFO:teuthology.orchestra.run.smithi089.stdout:(95/155): python3-requests-2.25.1-7.el9.noarch. 1.1 MB/s | 113 kB 00:00 2023-12-22T08:38:00.553 INFO:teuthology.orchestra.run.smithi089.stdout:(96/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-12-22T08:38:00.787 INFO:teuthology.orchestra.run.smithi089.stdout:(97/155): python3-devel-3.9.17-2.el9.x86_64.rpm 846 kB/s | 245 kB 00:00 2023-12-22T08:38:01.076 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/171 2023-12-22T08:38:01.178 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/171 2023-12-22T08:38:01.179 INFO:teuthology.orchestra.run.smithi089.stdout:(98/155): fmt-8.1.1-5.el9.x86_64.rpm 169 kB/s | 111 kB 00:00 2023-12-22T08:38:01.220 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/171 2023-12-22T08:38:01.263 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 38/171 2023-12-22T08:38:01.303 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 39/171 2023-12-22T08:38:01.304 INFO:teuthology.orchestra.run.smithi089.stdout:(99/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 412 kB/s | 309 kB 00:00 2023-12-22T08:38:01.392 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/171 2023-12-22T08:38:01.430 INFO:teuthology.orchestra.run.smithi089.stdout:(100/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 104 kB/s | 26 kB 00:00 2023-12-22T08:38:01.556 INFO:teuthology.orchestra.run.smithi089.stdout:(101/155): liboath-2.6.7-2.el9.x86_64.rpm 196 kB/s | 49 kB 00:00 2023-12-22T08:38:01.616 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/171 2023-12-22T08:38:01.674 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/171 2023-12-22T08:38:01.681 INFO:teuthology.orchestra.run.smithi089.stdout:(102/155): libarrow-9.0.0-10.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2023-12-22T08:38:01.706 INFO:teuthology.orchestra.run.smithi089.stdout:(103/155): libunwind-1.6.2-1.el9.x86_64.rpm 249 kB/s | 67 kB 00:00 2023-12-22T08:38:01.756 INFO:teuthology.orchestra.run.smithi089.stdout:(104/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.2 MB/s | 838 kB 00:00 2023-12-22T08:38:01.830 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/171 2023-12-22T08:38:01.865 INFO:teuthology.orchestra.run.smithi089.stdout:(105/155): python3-asyncssh-2.13.2-3.el9.noarch 3.6 MB/s | 548 kB 00:00 2023-12-22T08:38:01.869 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 44/171 2023-12-22T08:38:01.890 INFO:teuthology.orchestra.run.smithi089.stdout:(106/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 248 kB/s | 43 kB 00:00 2023-12-22T08:38:01.915 INFO:teuthology.orchestra.run.smithi089.stdout:(107/155): python3-cachetools-4.2.4-1.el9.noarc 203 kB/s | 32 kB 00:00 2023-12-22T08:38:01.948 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/171 2023-12-22T08:38:02.016 INFO:teuthology.orchestra.run.smithi089.stdout:(108/155): python3-certifi-2021.10.8-2.el9.noar 121 kB/s | 15 kB 00:00 2023-12-22T08:38:02.041 INFO:teuthology.orchestra.run.smithi089.stdout:(109/155): python3-cheroot-8.6.0-4.el9.noarch.r 1.1 MB/s | 172 kB 00:00 2023-12-22T08:38:02.044 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/171 2023-12-22T08:38:02.086 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/171 2023-12-22T08:38:02.091 INFO:teuthology.orchestra.run.smithi089.stdout:(110/155): python3-cherrypy-18.6.1-2.el9.noarch 2.0 MB/s | 358 kB 00:00 2023-12-22T08:38:02.126 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/171 2023-12-22T08:38:02.150 INFO:teuthology.orchestra.run.smithi089.stdout:(111/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2023-12-22T08:38:02.167 INFO:teuthology.orchestra.run.smithi089.stdout:(112/155): python3-colorama-0.4.4-12.el9.noarch 282 kB/s | 35 kB 00:00 2023-12-22T08:38:02.201 INFO:teuthology.orchestra.run.smithi089.stdout:(113/155): python3-google-auth-2.25.2-1.el9.noa 1.8 MB/s | 199 kB 00:00 2023-12-22T08:38:02.204 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/171 2023-12-22T08:38:02.251 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/171 2023-12-22T08:38:02.267 INFO:teuthology.orchestra.run.smithi089.stdout:(114/155): python3-jaraco-8.2.1-3.el9.noarch.rp 92 kB/s | 11 kB 00:00 2023-12-22T08:38:02.285 INFO:teuthology.orchestra.run.smithi089.stdout:(115/155): python3-jaraco-classes-3.2.1-5.el9.n 151 kB/s | 18 kB 00:00 2023-12-22T08:38:02.310 INFO:teuthology.orchestra.run.smithi089.stdout:(116/155): python3-jaraco-collections-3.0.0-8.e 214 kB/s | 23 kB 00:00 2023-12-22T08:38:02.319 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/171 2023-12-22T08:38:02.360 INFO:teuthology.orchestra.run.smithi089.stdout:(117/155): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2023-12-22T08:38:02.382 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/171 2023-12-22T08:38:02.393 INFO:teuthology.orchestra.run.smithi089.stdout:(118/155): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2023-12-22T08:38:02.419 INFO:teuthology.orchestra.run.smithi089.stdout:(119/155): python3-jwt+crypto-2.4.0-1.el9.noarc 83 kB/s | 9.0 kB 00:00 2023-12-22T08:38:02.469 INFO:teuthology.orchestra.run.smithi089.stdout:(120/155): python3-jwt-2.4.0-1.el9.noarch.rpm 377 kB/s | 41 kB 00:00 2023-12-22T08:38:02.588 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/171 2023-12-22T08:38:02.603 INFO:teuthology.orchestra.run.smithi089.stdout:(121/155): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2023-12-22T08:38:02.620 INFO:teuthology.orchestra.run.smithi089.stdout:(122/155): python3-logutils-0.3.5-21.el9.noarch 231 kB/s | 46 kB 00:00 2023-12-22T08:38:02.641 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/171 2023-12-22T08:38:02.645 INFO:teuthology.orchestra.run.smithi089.stdout:(123/155): python3-more-itertools-8.12.0-2.el9. 451 kB/s | 79 kB 00:00 2023-12-22T08:38:02.679 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 55/171 2023-12-22T08:38:02.720 INFO:teuthology.orchestra.run.smithi089.stdout:(124/155): python3-natsort-7.1.1-5.el9.noarch.r 501 kB/s | 58 kB 00:00 2023-12-22T08:38:02.739 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/171 2023-12-22T08:38:02.813 INFO:teuthology.orchestra.run.smithi089.stdout:(125/155): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2023-12-22T08:38:02.846 INFO:teuthology.orchestra.run.smithi089.stdout:(126/155): python3-portend-3.1.0-2.el9.noarch.r 82 kB/s | 16 kB 00:00 2023-12-22T08:38:02.871 INFO:teuthology.orchestra.run.smithi089.stdout:(127/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 599 kB/s | 90 kB 00:00 2023-12-22T08:38:02.882 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/171 2023-12-22T08:38:02.905 INFO:teuthology.orchestra.run.smithi089.stdout:(128/155): python3-pyperclip-1.8.2-2.el9.noarch 312 kB/s | 28 kB 00:00 2023-12-22T08:38:02.927 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-google-auth-1:2.25.2-1.el9.noarch 58/171 2023-12-22T08:38:02.976 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/171 2023-12-22T08:38:02.980 INFO:teuthology.orchestra.run.smithi089.stdout:(129/155): python3-repoze-lru-0.7-16.el9.noarch 285 kB/s | 31 kB 00:00 2023-12-22T08:38:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/171 2023-12-22T08:38:03.039 INFO:teuthology.orchestra.run.smithi089.stdout:(130/155): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2023-12-22T08:38:03.056 INFO:teuthology.orchestra.run.smithi089.stdout:(131/155): python3-rsa-4.9-2.el9.noarch.rpm 393 kB/s | 59 kB 00:00 2023-12-22T08:38:03.058 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 61/171 2023-12-22T08:38:03.106 INFO:teuthology.orchestra.run.smithi089.stdout:(132/155): python3-tempora-5.0.0-2.el9.noarch.r 286 kB/s | 36 kB 00:00 2023-12-22T08:38:03.165 INFO:teuthology.orchestra.run.smithi089.stdout:(133/155): python3-typing-extensions-4.4.0-2.el 410 kB/s | 51 kB 00:00 2023-12-22T08:38:03.199 INFO:teuthology.orchestra.run.smithi089.stdout:(134/155): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2023-12-22T08:38:03.228 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fmt-8.1.1-5.el9.x86_64 62/171 2023-12-22T08:38:03.240 INFO:teuthology.orchestra.run.smithi089.stdout:(135/155): python3-websocket-client-1.2.3-2.el9 672 kB/s | 90 kB 00:00 2023-12-22T08:38:03.284 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 63/171 2023-12-22T08:38:03.291 INFO:teuthology.orchestra.run.smithi089.stdout:(136/155): python3-werkzeug-2.0.3-3.el9.1.noarc 3.4 MB/s | 427 kB 00:00 2023-12-22T08:38:03.316 INFO:teuthology.orchestra.run.smithi089.stdout:(137/155): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2023-12-22T08:38:03.350 INFO:teuthology.orchestra.run.smithi089.stdout:(138/155): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2023-12-22T08:38:03.367 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ply-3.11-14.el9.noarch 64/171 2023-12-22T08:38:03.454 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 65/171 2023-12-22T08:38:03.467 INFO:teuthology.orchestra.run.smithi089.stdout:(139/155): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2023-12-22T08:38:03.500 INFO:teuthology.orchestra.run.smithi089.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-22T08:38:03.617 INFO:teuthology.orchestra.run.smithi089.stdout:(141/155): NetworkManager-1.45.9-1.el9.x86_64.r 19 MB/s | 2.2 MB 00:00 2023-12-22T08:38:03.709 INFO:teuthology.orchestra.run.smithi089.stdout:(142/155): NetworkManager-libnm-1.45.9-1.el9.x8 20 MB/s | 1.8 MB 00:00 2023-12-22T08:38:03.743 INFO:teuthology.orchestra.run.smithi089.stdout:(143/155): NetworkManager-team-1.45.9-1.el9.x86 1.3 MB/s | 42 kB 00:00 2023-12-22T08:38:03.754 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 66/171 2023-12-22T08:38:03.793 INFO:teuthology.orchestra.run.smithi089.stdout:(144/155): NetworkManager-tui-1.45.9-1.el9.x86_ 4.9 MB/s | 246 kB 00:00 2023-12-22T08:38:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 67/171 2023-12-22T08:38:03.827 INFO:teuthology.orchestra.run.smithi089.stdout:(145/155): acl-2.3.1-4.el9.x86_64.rpm 2.1 MB/s | 69 kB 00:00 2023-12-22T08:38:03.861 INFO:teuthology.orchestra.run.smithi089.stdout:(146/155): elfutils-debuginfod-client-0.190-2.e 1.1 MB/s | 35 kB 00:00 2023-12-22T08:38:03.903 INFO:teuthology.orchestra.run.smithi089.stdout:(147/155): elfutils-libelf-0.190-2.el9.x86_64.r 4.6 MB/s | 191 kB 00:00 2023-12-22T08:38:03.945 INFO:teuthology.orchestra.run.smithi089.stdout:(148/155): elfutils-libs-0.190-2.el9.x86_64.rpm 6.1 MB/s | 254 kB 00:00 2023-12-22T08:38:03.978 INFO:teuthology.orchestra.run.smithi089.stdout:(149/155): libacl-2.3.1-4.el9.x86_64.rpm 677 kB/s | 22 kB 00:00 2023-12-22T08:38:03.985 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 68/171 2023-12-22T08:38:04.039 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 69/171 2023-12-22T08:38:04.045 INFO:teuthology.orchestra.run.smithi089.stdout:(150/155): openssl-3.0.7-25.el9.x86_64.rpm 17 MB/s | 1.2 MB 00:00 2023-12-22T08:38:04.071 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 70/171 2023-12-22T08:38:04.111 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 71/171 2023-12-22T08:38:04.154 INFO:teuthology.orchestra.run.smithi089.stdout:(151/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 20 MB/s | 2.1 MB 00:00 2023-12-22T08:38:04.155 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2023-12-22T08:38:04.196 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2023-12-22T08:38:04.196 INFO:teuthology.orchestra.run.smithi089.stdout:(152/155): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2023-12-22T08:38:04.246 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2023-12-22T08:38:04.271 INFO:teuthology.orchestra.run.smithi089.stdout:(153/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2023-12-22T08:38:04.285 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2023-12-22T08:38:04.338 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2023-12-22T08:38:04.401 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2023-12-22T08:38:04.478 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2023-12-22T08:38:04.552 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2023-12-22T08:38:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2023-12-22T08:38:05.030 INFO:teuthology.orchestra.run.smithi089.stdout:(154/155): librbd1-18.2.0-1377.g24e2e32a.el9.x8 1.8 MB/s | 3.0 MB 00:01 2023-12-22T08:38:05.070 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2023-12-22T08:38:05.113 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2023-12-22T08:38:05.150 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2023-12-22T08:38:05.215 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2023-12-22T08:38:05.260 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2023-12-22T08:38:05.423 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2023-12-22T08:38:05.467 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2023-12-22T08:38:05.617 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2023-12-22T08:38:05.682 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2023-12-22T08:38:06.670 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2023-12-22T08:38:06.722 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2023-12-22T08:38:06.755 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2023-12-22T08:38:06.812 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2023-12-22T08:38:06.927 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2023-12-22T08:38:06.972 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2023-12-22T08:38:07.219 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2023-12-22T08:38:07.252 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2023-12-22T08:38:07.355 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2023-12-22T08:38:07.389 INFO:teuthology.orchestra.run.smithi089.stdout:(155/155): librados2-18.2.0-1377.g24e2e32a.el9. 822 kB/s | 3.3 MB 00:04 2023-12-22T08:38:07.400 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-22T08:38:07.401 INFO:teuthology.orchestra.run.smithi089.stdout:Total 7.3 MB/s | 200 MB 00:27 2023-12-22T08:38:07.458 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-22T08:38:07.799 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-22T08:38:07.799 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-22T08:38:08.198 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2023-12-22T08:38:08.344 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2023-12-22T08:38:09.928 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-22T08:38:09.928 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-22T08:38:09.977 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2023-12-22T08:38:10.067 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2023-12-22T08:38:10.102 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2023-12-22T08:38:10.145 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2023-12-22T08:38:10.576 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2023-12-22T08:38:10.604 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T08:38:10.725 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T08:38:10.760 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 107/171 2023-12-22T08:38:10.817 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2023-12-22T08:38:11.297 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2023-12-22T08:38:11.324 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T08:38:11.432 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T08:38:11.460 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/171 2023-12-22T08:38:13.812 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:38:13.847 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:38:14.502 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:38:14.576 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T08:38:14.732 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T08:38:14.732 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-22T08:38:14.732 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-22T08:38:14.733 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:14.776 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T08:38:16.279 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-22T08:38:16.451 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2023-12-22T08:38:16.488 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/171 2023-12-22T08:38:16.561 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/171 2023-12-22T08:38:16.625 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/171 2023-12-22T08:38:16.664 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2023-12-22T08:38:16.764 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2023-12-22T08:38:17.168 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2023-12-22T08:38:17.220 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:38:17.371 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:38:17.404 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:38:17.527 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:38:17.571 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T08:38:17.721 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2023-12-22T08:38:18.165 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2023-12-22T08:38:18.221 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2023-12-22T08:38:18.246 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T08:38:18.391 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T08:38:18.413 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T08:38:18.496 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T08:38:18.827 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2023-12-22T08:38:19.062 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T08:38:19.141 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T08:38:19.348 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:38:19.406 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:38:19.840 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:38:19.887 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2023-12-22T08:38:19.994 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2023-12-22T08:38:20.068 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2023-12-22T08:38:20.108 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2023-12-22T08:38:20.163 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/171 2023-12-22T08:38:20.218 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/171 2023-12-22T08:38:20.320 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2023-12-22T08:38:20.368 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2023-12-22T08:38:20.402 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2023-12-22T08:38:20.510 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/171 2023-12-22T08:38:20.567 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 30/171 2023-12-22T08:38:20.618 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 31/171 2023-12-22T08:38:20.740 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 32/171 2023-12-22T08:38:20.921 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/171 2023-12-22T08:38:20.993 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/171 2023-12-22T08:38:21.696 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/171 2023-12-22T08:38:21.798 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/171 2023-12-22T08:38:21.845 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/171 2023-12-22T08:38:21.891 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 38/171 2023-12-22T08:38:21.931 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 39/171 2023-12-22T08:38:21.998 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/171 2023-12-22T08:38:22.194 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/171 2023-12-22T08:38:22.278 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/171 2023-12-22T08:38:22.450 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/171 2023-12-22T08:38:22.489 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 44/171 2023-12-22T08:38:22.555 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/171 2023-12-22T08:38:22.643 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/171 2023-12-22T08:38:22.683 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/171 2023-12-22T08:38:22.721 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/171 2023-12-22T08:38:22.787 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/171 2023-12-22T08:38:22.838 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/171 2023-12-22T08:38:22.899 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/171 2023-12-22T08:38:22.960 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/171 2023-12-22T08:38:23.145 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/171 2023-12-22T08:38:23.194 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/171 2023-12-22T08:38:23.249 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 55/171 2023-12-22T08:38:23.299 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/171 2023-12-22T08:38:23.429 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/171 2023-12-22T08:38:23.466 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.25.2-1.el9.noarch 58/171 2023-12-22T08:38:23.513 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/171 2023-12-22T08:38:23.557 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/171 2023-12-22T08:38:23.596 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 61/171 2023-12-22T08:38:23.759 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fmt-8.1.1-5.el9.x86_64 62/171 2023-12-22T08:38:23.813 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 63/171 2023-12-22T08:38:23.882 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 64/171 2023-12-22T08:38:23.963 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 65/171 2023-12-22T08:38:24.249 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 66/171 2023-12-22T08:38:24.317 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 67/171 2023-12-22T08:38:24.490 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 68/171 2023-12-22T08:38:24.545 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 69/171 2023-12-22T08:38:24.569 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 70/171 2023-12-22T08:38:24.608 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 71/171 2023-12-22T08:38:24.653 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2023-12-22T08:38:24.694 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2023-12-22T08:38:24.751 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2023-12-22T08:38:24.801 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2023-12-22T08:38:24.855 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2023-12-22T08:38:24.917 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2023-12-22T08:38:24.991 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2023-12-22T08:38:25.073 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2023-12-22T08:38:25.122 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2023-12-22T08:38:25.268 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2023-12-22T08:38:25.313 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2023-12-22T08:38:25.365 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2023-12-22T08:38:25.440 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2023-12-22T08:38:25.485 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2023-12-22T08:38:25.632 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2023-12-22T08:38:25.674 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2023-12-22T08:38:25.817 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2023-12-22T08:38:25.872 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2023-12-22T08:38:26.859 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2023-12-22T08:38:26.914 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2023-12-22T08:38:26.947 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2023-12-22T08:38:27.004 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2023-12-22T08:38:27.116 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2023-12-22T08:38:27.156 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2023-12-22T08:38:27.388 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2023-12-22T08:38:27.429 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2023-12-22T08:38:27.521 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2023-12-22T08:38:28.076 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T08:38:28.076 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /sys 2023-12-22T08:38:28.076 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /proc 2023-12-22T08:38:28.076 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /mnt 2023-12-22T08:38:28.076 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /var/tmp 2023-12-22T08:38:28.077 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /home 2023-12-22T08:38:28.077 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /root 2023-12-22T08:38:28.077 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /tmp 2023-12-22T08:38:28.077 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:28.299 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T08:38:28.329 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2023-12-22T08:38:28.347 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T08:38:28.347 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:28.347 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-22T08:38:28.347 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:28.467 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2023-12-22T08:38:30.001 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2023-12-22T08:38:30.087 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2023-12-22T08:38:30.124 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2023-12-22T08:38:30.154 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T08:38:30.160 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2023-12-22T08:38:30.265 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T08:38:30.265 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:30.265 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-22T08:38:30.265 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T08:38:30.265 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T08:38:30.265 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:30.514 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2023-12-22T08:38:30.514 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T08:38:30.551 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T08:38:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T08:38:30.596 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:30.596 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-22T08:38:30.596 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T08:38:30.597 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T08:38:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:30.672 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T08:38:30.707 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 107/171 2023-12-22T08:38:30.764 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2023-12-22T08:38:31.111 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T08:38:31.199 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:31.223 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2023-12-22T08:38:31.254 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T08:38:31.313 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2023-12-22T08:38:31.354 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T08:38:31.382 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/171 2023-12-22T08:38:31.927 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T08:38:31.965 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T08:38:32.013 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 121/171 2023-12-22T08:38:32.128 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 122/171 2023-12-22T08:38:32.160 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T08:38:32.499 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T08:38:32.536 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T08:38:33.716 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T08:38:33.736 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T08:38:33.817 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:38:33.853 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:38:33.886 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T08:38:34.076 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 126/171 2023-12-22T08:38:34.105 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T08:38:34.207 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T08:38:34.208 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:34.208 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-22T08:38:34.208 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T08:38:34.208 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T08:38:34.208 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:34.264 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T08:38:34.307 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T08:38:34.367 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 129/171 2023-12-22T08:38:34.473 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:38:34.516 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T08:38:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T08:38:34.678 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-22T08:38:34.678 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-22T08:38:34.678 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:38:34.726 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T08:38:35.209 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2023-12-22T08:38:35.241 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T08:38:35.346 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T08:38:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-22T08:38:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T08:38:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T08:38:35.347 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:35.400 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T08:38:35.508 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T08:38:35.509 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:35.509 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-22T08:38:35.509 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:35.624 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T08:38:35.742 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T08:38:35.742 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:35.742 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-22T08:38:35.742 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T08:38:35.743 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T08:38:35.743 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:40.499 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/171 2023-12-22T08:38:40.547 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/171 2023-12-22T08:38:40.602 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 137/171 2023-12-22T08:38:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2023-12-22T08:38:40.677 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2023-12-22T08:38:40.976 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T08:38:41.121 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2023-12-22T08:38:41.161 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T08:38:41.186 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 143/171 2023-12-22T08:38:41.225 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2023-12-22T08:38:41.271 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-team-1:1.45.9-1.el9.x86_64 145/171 2023-12-22T08:38:41.449 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-tui-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T08:38:41.522 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2023-12-22T08:38:41.555 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2023-12-22T08:38:42.488 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:38:42.535 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:38:42.637 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:38:42.730 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2023-12-22T08:38:44.142 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 151/171 2023-12-22T08:38:44.216 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2023-12-22T08:38:44.261 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2023-12-22T08:38:44.409 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2023-12-22T08:38:44.443 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2023-12-22T08:38:44.485 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2023-12-22T08:38:44.520 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T08:38:44.562 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2023-12-22T08:38:44.562 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T08:38:44.728 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T08:38:44.779 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2023-12-22T08:38:44.833 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2023-12-22T08:38:44.874 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2023-12-22T08:38:44.907 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2023-12-22T08:38:44.908 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T08:38:45.103 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T08:38:45.134 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2023-12-22T08:38:45.176 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:38:45.176 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:38:45.525 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:38:45.525 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T08:38:45.659 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T08:38:45.703 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2023-12-22T08:38:45.748 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2023-12-22T08:38:45.796 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2023-12-22T08:38:45.920 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T08:38:46.200 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T08:38:46.201 INFO:teuthology.orchestra.run.smithi038.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-22T08:38:46.201 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:47.572 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T08:38:47.573 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2023-12-22T08:38:47.573 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2023-12-22T08:38:47.573 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2023-12-22T08:38:47.573 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2023-12-22T08:38:47.573 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2023-12-22T08:38:47.573 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2023-12-22T08:38:47.573 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2023-12-22T08:38:47.573 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:38:47.795 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T08:38:47.841 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T08:38:47.842 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:47.842 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-22T08:38:47.842 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:38:49.548 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T08:38:49.630 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T08:38:49.630 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:49.630 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-22T08:38:49.630 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T08:38:49.630 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T08:38:49.631 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:38:49.865 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T08:38:49.939 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T08:38:49.939 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:49.939 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-22T08:38:49.939 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T08:38:49.939 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T08:38:49.939 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:38:50.450 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T08:38:50.520 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T08:38:50.520 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:50.520 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-22T08:38:50.520 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T08:38:50.520 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T08:38:50.520 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:38:50.635 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2023-12-22T08:38:50.738 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/171 2023-12-22T08:38:50.738 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/171 2023-12-22T08:38:50.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/171 2023-12-22T08:38:50.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/171 2023-12-22T08:38:50.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/171 2023-12-22T08:38:50.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/171 2023-12-22T08:38:50.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/171 2023-12-22T08:38:50.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:38:50.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:38:50.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T08:38:50.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/171 2023-12-22T08:38:50.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/171 2023-12-22T08:38:50.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/171 2023-12-22T08:38:50.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/171 2023-12-22T08:38:50.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/171 2023-12-22T08:38:50.740 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/171 2023-12-22T08:38:50.740 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/171 2023-12-22T08:38:50.740 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/171 2023-12-22T08:38:50.740 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/171 2023-12-22T08:38:50.740 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/171 2023-12-22T08:38:50.740 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/171 2023-12-22T08:38:50.740 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/171 2023-12-22T08:38:50.740 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/171 2023-12-22T08:38:50.740 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/171 2023-12-22T08:38:50.740 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/171 2023-12-22T08:38:50.757 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/171 2023-12-22T08:38:50.758 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/171 2023-12-22T08:38:50.758 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/171 2023-12-22T08:38:50.758 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/171 2023-12-22T08:38:50.758 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/171 2023-12-22T08:38:50.758 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/171 2023-12-22T08:38:50.758 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/171 2023-12-22T08:38:50.758 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/171 2023-12-22T08:38:50.758 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/171 2023-12-22T08:38:50.758 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/171 2023-12-22T08:38:50.758 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/171 2023-12-22T08:38:50.758 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/171 2023-12-22T08:38:50.758 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/171 2023-12-22T08:38:50.758 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2023-12-22T08:38:50.759 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 58/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/171 2023-12-22T08:38:50.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 80/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 81/171 2023-12-22T08:38:50.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 82/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 83/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jq-1.6-16.el9.x86_64 87/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 90/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 91/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 92/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ply-3.11-14.el9.noarch 93/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 94/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 95/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 96/171 2023-12-22T08:38:50.762 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/171 2023-12-22T08:38:50.763 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-google-auth-1:2.25.2-1.el9.noarch 113/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2023-12-22T08:38:50.764 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2023-12-22T08:38:50.765 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 148/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-team-1:1.45.9-1.el9.x86_64 150/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-tui-1:1.45.9-1.el9.x86_64 152/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2023-12-22T08:38:50.766 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2023-12-22T08:38:50.767 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2023-12-22T08:38:51.437 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T08:38:51.470 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T08:38:51.524 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 121/171 2023-12-22T08:38:51.626 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 122/171 2023-12-22T08:38:51.665 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T08:38:51.989 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T08:38:52.034 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T08:38:52.930 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2023-12-22T08:38:52.930 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-1:1.45.9-1.el9.x86_64 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-team-1:1.45.9-1.el9.x86_64 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-tui-1:1.45.9-1.el9.x86_64 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout: acl-2.3.1-4.el9.x86_64 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-0.190-2.el9.x86_64 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libs-0.190-2.el9.x86_64 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.931 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-6.3.0-1.el9.x86_64 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout: automake-1.16.2-8.el9.noarch 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout: bison-3.7.4-5.el9.x86_64 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.932 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:52.933 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: flex-2.6.4-9.el9.x86_64 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: jq-1.6-16.el9.x86_64 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-22T08:38:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-13.11-1.el9.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-22T08:38:52.936 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-22T08:38:52.937 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-22T08:38:52.938 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-22T08:38:52.938 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth-1:2.25.2-1.el9.noarch 2023-12-22T08:38:52.938 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-22T08:38:52.938 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-22T08:38:52.938 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-22T08:38:52.938 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-22T08:38:52.938 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-22T08:38:52.938 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-22T08:38:52.938 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-22T08:38:52.938 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-22T08:38:52.938 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-22T08:38:52.938 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-22T08:38:52.938 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply-3.11-14.el9.noarch 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-22T08:38:52.939 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-22T08:38:52.940 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3-1.26.5-5.el9.noarch 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: re2-1:20211101-3.el9.x86_64 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-22T08:38:52.941 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2023-12-22T08:38:52.942 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-22T08:38:52.942 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-22T08:38:52.942 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:38:52.942 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-12-22T08:38:53.162 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T08:38:53.192 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T08:38:53.333 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T08:38:53.500 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 126/171 2023-12-22T08:38:53.528 DEBUG:teuthology.parallel:result is None 2023-12-22T08:38:53.528 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T08:38:53.598 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T08:38:53.598 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:53.598 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-22T08:38:53.599 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T08:38:53.599 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T08:38:53.599 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:38:53.654 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T08:38:53.692 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T08:38:53.785 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 129/171 2023-12-22T08:38:54.596 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2023-12-22T08:38:54.631 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T08:38:54.708 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T08:38:54.708 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:54.708 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-22T08:38:54.708 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T08:38:54.708 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T08:38:54.708 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:38:54.765 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T08:38:54.855 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T08:38:54.855 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:54.855 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-22T08:38:54.855 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:38:54.924 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T08:38:55.006 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T08:38:55.006 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:55.006 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-22T08:38:55.006 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T08:38:55.006 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T08:38:55.006 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:38:55.401 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T08:38:55.473 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T08:38:55.473 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:55.473 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-22T08:38:55.473 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T08:38:55.474 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T08:38:55.474 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:38:59.456 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/171 2023-12-22T08:38:59.512 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/171 2023-12-22T08:38:59.567 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 137/171 2023-12-22T08:38:59.605 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2023-12-22T08:38:59.644 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2023-12-22T08:38:59.927 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T08:39:00.047 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2023-12-22T08:39:00.077 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T08:39:00.119 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 143/171 2023-12-22T08:39:00.167 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2023-12-22T08:39:00.206 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-team-1:1.45.9-1.el9.x86_64 145/171 2023-12-22T08:39:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-tui-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T08:39:00.422 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2023-12-22T08:39:00.464 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2023-12-22T08:39:01.280 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:39:01.330 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:39:01.430 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:39:01.492 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2023-12-22T08:39:02.852 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 151/171 2023-12-22T08:39:02.929 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2023-12-22T08:39:03.010 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2023-12-22T08:39:03.142 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2023-12-22T08:39:03.190 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2023-12-22T08:39:03.231 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2023-12-22T08:39:03.266 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T08:39:03.307 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2023-12-22T08:39:03.307 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T08:39:03.424 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T08:39:03.475 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2023-12-22T08:39:03.521 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2023-12-22T08:39:03.563 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2023-12-22T08:39:03.595 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2023-12-22T08:39:03.596 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T08:39:03.734 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T08:39:03.772 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2023-12-22T08:39:03.822 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:39:03.822 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:39:04.163 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:39:04.163 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T08:39:04.297 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T08:39:04.333 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2023-12-22T08:39:04.376 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2023-12-22T08:39:04.419 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2023-12-22T08:39:04.547 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T08:39:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T08:39:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-22T08:39:04.811 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/171 2023-12-22T08:39:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/171 2023-12-22T08:39:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/171 2023-12-22T08:39:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/171 2023-12-22T08:39:09.700 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/171 2023-12-22T08:39:09.701 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/171 2023-12-22T08:39:09.702 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2023-12-22T08:39:09.703 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 58/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/171 2023-12-22T08:39:09.704 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/171 2023-12-22T08:39:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 80/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 81/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 82/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 83/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : jq-1.6-16.el9.x86_64 87/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/171 2023-12-22T08:39:09.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 90/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 91/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 92/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 93/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 94/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 95/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 96/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/171 2023-12-22T08:39:09.707 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/171 2023-12-22T08:39:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/171 2023-12-22T08:39:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/171 2023-12-22T08:39:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/171 2023-12-22T08:39:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/171 2023-12-22T08:39:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/171 2023-12-22T08:39:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/171 2023-12-22T08:39:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/171 2023-12-22T08:39:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.25.2-1.el9.noarch 113/171 2023-12-22T08:39:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/171 2023-12-22T08:39:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/171 2023-12-22T08:39:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/171 2023-12-22T08:39:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/171 2023-12-22T08:39:09.708 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2023-12-22T08:39:09.709 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2023-12-22T08:39:09.710 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 148/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-team-1:1.45.9-1.el9.x86_64 150/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-tui-1:1.45.9-1.el9.x86_64 152/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2023-12-22T08:39:09.711 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2023-12-22T08:39:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2023-12-22T08:39:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2023-12-22T08:39:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2023-12-22T08:39:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2023-12-22T08:39:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2023-12-22T08:39:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2023-12-22T08:39:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2023-12-22T08:39:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2023-12-22T08:39:09.712 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2023-12-22T08:39:11.916 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2023-12-22T08:39:11.916 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:11.916 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2023-12-22T08:39:11.916 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-1:1.45.9-1.el9.x86_64 2023-12-22T08:39:11.916 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 2023-12-22T08:39:11.916 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-team-1:1.45.9-1.el9.x86_64 2023-12-22T08:39:11.916 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-tui-1:1.45.9-1.el9.x86_64 2023-12-22T08:39:11.916 INFO:teuthology.orchestra.run.smithi089.stdout: acl-2.3.1-4.el9.x86_64 2023-12-22T08:39:11.916 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2023-12-22T08:39:11.916 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-0.190-2.el9.x86_64 2023-12-22T08:39:11.917 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libs-0.190-2.el9.x86_64 2023-12-22T08:39:11.917 INFO:teuthology.orchestra.run.smithi089.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-22T08:39:11.917 INFO:teuthology.orchestra.run.smithi089.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-22T08:39:11.917 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.917 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.917 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-22T08:39:11.917 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-22T08:39:11.917 INFO:teuthology.orchestra.run.smithi089.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-22T08:39:11.917 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-6.3.0-1.el9.x86_64 2023-12-22T08:39:11.917 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-22T08:39:11.917 INFO:teuthology.orchestra.run.smithi089.stdout: automake-1.16.2-8.el9.noarch 2023-12-22T08:39:11.917 INFO:teuthology.orchestra.run.smithi089.stdout: bison-3.7.4-5.el9.x86_64 2023-12-22T08:39:11.917 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-22T08:39:11.918 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.918 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.918 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.918 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.918 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:11.918 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.918 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.918 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.918 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:11.918 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:11.918 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:11.918 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:11.918 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:11.919 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.919 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.919 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:11.919 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.919 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.919 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.919 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:11.919 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:11.919 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.919 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.919 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:11.919 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2023-12-22T08:39:11.919 INFO:teuthology.orchestra.run.smithi089.stdout: flex-2.6.4-9.el9.x86_64 2023-12-22T08:39:11.920 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-22T08:39:11.920 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-22T08:39:11.920 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-22T08:39:11.920 INFO:teuthology.orchestra.run.smithi089.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-22T08:39:11.920 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-22T08:39:11.920 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-22T08:39:11.920 INFO:teuthology.orchestra.run.smithi089.stdout: jq-1.6-16.el9.x86_64 2023-12-22T08:39:11.920 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-22T08:39:11.920 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-22T08:39:11.920 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-22T08:39:11.920 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.920 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.921 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.921 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-22T08:39:11.921 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-22T08:39:11.921 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-22T08:39:11.921 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-22T08:39:11.921 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-22T08:39:11.921 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.921 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.921 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-22T08:39:11.921 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.921 INFO:teuthology.orchestra.run.smithi089.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-22T08:39:11.921 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-13.11-1.el9.x86_64 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-22T08:39:11.922 INFO:teuthology.orchestra.run.smithi089.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-22T08:39:11.923 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-22T08:39:11.923 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-22T08:39:11.923 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-22T08:39:11.923 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.923 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.923 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.923 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-22T08:39:11.923 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-22T08:39:11.923 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-22T08:39:11.923 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-22T08:39:11.924 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-22T08:39:11.924 INFO:teuthology.orchestra.run.smithi089.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-22T08:39:11.924 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-22T08:39:11.924 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-22T08:39:11.924 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.25.2-1.el9.noarch 2023-12-22T08:39:11.924 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-22T08:39:11.924 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-22T08:39:11.925 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-22T08:39:11.925 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-22T08:39:11.925 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-22T08:39:11.925 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-22T08:39:11.925 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-22T08:39:11.925 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-22T08:39:11.925 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-22T08:39:11.925 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-22T08:39:11.925 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-22T08:39:11.925 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-22T08:39:11.927 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3-1.26.5-5.el9.noarch 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: re2-1:20211101-3.el9.x86_64 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-22T08:39:11.928 INFO:teuthology.orchestra.run.smithi089.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-22T08:39:11.929 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2023-12-22T08:39:11.929 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-22T08:39:11.929 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-22T08:39:11.929 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:11.929 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-22T08:39:12.526 DEBUG:teuthology.parallel:result is None 2023-12-22T08:39:12.527 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T08:39:12.669 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-22T08:39:12.748 INFO:teuthology.orchestra.run.smithi038.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-22T08:39:12.748 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-22T08:39:12.748 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-22T08:39:12.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T08:39:12.959 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-22T08:39:13.017 INFO:teuthology.orchestra.run.smithi089.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-22T08:39:13.017 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-22T08:39:13.017 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-22T08:39:13.019 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-22T08:39:13.019 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:13.019 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-22T08:39:13.136 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:13.136 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-22T08:39:13.237 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-22T08:39:13.237 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:13.237 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2023-12-22T08:39:13.346 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-22T08:39:13.449 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:13.449 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2023-12-22T08:39:13.533 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-22T08:39:13.648 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-22T08:39:13.648 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:13.648 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-22T08:39:13.760 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-22T08:39:13.907 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:13.907 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-22T08:39:13.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-22T08:39:14.109 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-22T08:39:14.110 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:14.110 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2023-12-22T08:39:14.218 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-22T08:39:14.321 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:14.322 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2023-12-22T08:39:14.400 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-22T08:39:14.516 INFO:teuthology.run_tasks:Running task ceph... 2023-12-22T08:39:14.604 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-22T08:39:14.604 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 777 /var/log/ceph 2023-12-22T08:39:14.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2023-12-22T08:39:14.722 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-22T08:39:14.723 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-22T08:39:14.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-22T08:39:14.825 INFO:tasks.ceph:Creating extra log directories... 2023-12-22T08:39:14.825 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-22T08:39:14.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-22T08:39:14.928 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-22T08:39:14.929 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-22T08:39:14.929 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-22T08:39:14.929 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:14.929 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-22T08:39:14.987 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-22T08:39:15.286 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-22T08:39:15.395 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:15.395 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-22T08:39:15.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-22T08:39:15.654 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-22T08:39:15.731 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-22T08:39:15.731 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-22T08:39:15.731 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286', 'branch': 'rishabh-mdscap-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': None, 'first_in_suite': False, 'job_id': '7499286', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-mdscap-reef'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mdscap-reef', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9974, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'sleep_before_teardown': 0, 'subset': '301/512', 'suite': 'fs', 'suite_branch': 'rishabh-mdscap-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi038.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNE9elxAczHrM6urpdArnbg2TFLF1wkSBp3viqQLTId2ooi52+E1VQB/nkduBlv/u+/UIxEfJEPMgyyY0BecKkA=', 'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKNmjedloL64n43IMt3Mcm+izzdIOLcGF9cnDSrqCjfmmVsYH5+0UNlLIyr0oEhuIBgJ4vkcAwEiVNEtgl9V+PY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9680d2aba1e76f64ade295c81599c97907457848', 'timestamp': '2023-12-22_08:10:43', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-22T08:39:15.732 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-22T08:39:15.742 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-22T08:39:15.796 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/run/ceph 2023-12-22T08:39:15.802 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2023-12-22T08:39:15.901 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:15.901 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/scratch_devs of=/dev/stdout 2023-12-22T08:39:15.960 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-22T08:39:15.960 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 2023-12-22T08:39:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-22T08:39:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:16.016 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-12-22T08:39:16.016 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:16.016 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:16.016 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-12-22 08:38:46.684080914 +0000 2023-12-22T08:39:16.016 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-12-22 08:35:57.604857081 +0000 2023-12-22T08:39:16.016 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-12-22 08:35:57.604857081 +0000 2023-12-22T08:39:16.016 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2023-12-22 08:35:57.604857081 +0000 2023-12-22T08:39:16.017 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-22T08:39:16.109 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-12-22T08:39:16.109 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-12-22T08:39:16.109 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000453723 s, 1.1 MB/s 2023-12-22T08:39:16.113 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-22T08:39:16.175 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 2023-12-22T08:39:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-22T08:39:16.231 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:16.231 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 650 Links: 1 2023-12-22T08:39:16.231 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:16.231 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:16.231 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-12-22 08:38:46.685080895 +0000 2023-12-22T08:39:16.231 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-12-22 08:35:58.667836669 +0000 2023-12-22T08:39:16.231 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-12-22 08:35:58.667836669 +0000 2023-12-22T08:39:16.232 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2023-12-22 08:35:58.667836669 +0000 2023-12-22T08:39:16.232 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-22T08:39:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-12-22T08:39:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-12-22T08:39:16.330 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000698297 s, 733 kB/s 2023-12-22T08:39:16.335 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-22T08:39:16.387 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 2023-12-22T08:39:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-22T08:39:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:16.438 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 672 Links: 1 2023-12-22T08:39:16.438 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:16.438 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:16.438 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-12-22 08:38:46.686080875 +0000 2023-12-22T08:39:16.438 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-12-22 08:35:59.780815297 +0000 2023-12-22T08:39:16.438 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-12-22 08:35:59.780815297 +0000 2023-12-22T08:39:16.438 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2023-12-22 08:35:59.780815297 +0000 2023-12-22T08:39:16.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-22T08:39:16.536 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-12-22T08:39:16.536 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-12-22T08:39:16.536 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000721566 s, 710 kB/s 2023-12-22T08:39:16.540 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-22T08:39:16.604 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 2023-12-22T08:39:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-22T08:39:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:16.664 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-12-22T08:39:16.664 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:16.664 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:16.664 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-12-22 08:38:46.686080875 +0000 2023-12-22T08:39:16.664 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-12-22 08:36:00.869794386 +0000 2023-12-22T08:39:16.664 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-12-22 08:36:00.869794386 +0000 2023-12-22T08:39:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2023-12-22 08:36:00.869794386 +0000 2023-12-22T08:39:16.664 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-22T08:39:16.760 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-12-22T08:39:16.760 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-12-22T08:39:16.761 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000570118 s, 898 kB/s 2023-12-22T08:39:16.764 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-22T08:39:16.828 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:16.828 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:16.828 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2023-12-22T08:39:16.879 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-22T08:39:16.879 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2023-12-22T08:39:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-22T08:39:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:16.924 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-12-22T08:39:16.924 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:16.924 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:16.924 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-22 08:39:05.273725863 +0000 2023-12-22T08:39:16.924 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-22 08:35:36.266365990 +0000 2023-12-22T08:39:16.924 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-22 08:35:36.266365990 +0000 2023-12-22T08:39:16.924 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-22 08:35:36.266365990 +0000 2023-12-22T08:39:16.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-22T08:39:17.036 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-22T08:39:17.036 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-22T08:39:17.036 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000364253 s, 1.4 MB/s 2023-12-22T08:39:17.039 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-22T08:39:17.083 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2023-12-22T08:39:17.165 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-22T08:39:17.165 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:17.165 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 653 Links: 1 2023-12-22T08:39:17.165 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:17.166 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:17.166 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-22 08:39:05.274725840 +0000 2023-12-22T08:39:17.166 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-22 08:35:37.285342251 +0000 2023-12-22T08:39:17.166 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-22 08:35:37.285342251 +0000 2023-12-22T08:39:17.166 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-22 08:35:37.285342251 +0000 2023-12-22T08:39:17.166 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-22T08:39:17.274 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-22T08:39:17.275 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-22T08:39:17.275 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000322842 s, 1.6 MB/s 2023-12-22T08:39:17.277 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-22T08:39:17.320 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2023-12-22T08:39:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-22T08:39:17.402 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:17.402 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-12-22T08:39:17.402 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:17.402 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:17.402 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-22 08:39:05.274725840 +0000 2023-12-22T08:39:17.402 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-22 08:35:38.307318441 +0000 2023-12-22T08:39:17.403 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-22 08:35:38.307318441 +0000 2023-12-22T08:39:17.403 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-22 08:35:38.307318441 +0000 2023-12-22T08:39:17.403 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-22T08:39:17.535 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-22T08:39:17.535 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-22T08:39:17.535 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000843991 s, 607 kB/s 2023-12-22T08:39:17.538 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-22T08:39:17.582 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2023-12-22T08:39:17.662 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-22T08:39:17.662 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:17.662 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 688 Links: 1 2023-12-22T08:39:17.663 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:17.663 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:17.663 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-22 08:39:05.275725816 +0000 2023-12-22T08:39:17.663 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-22 08:35:39.399293001 +0000 2023-12-22T08:39:17.663 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-22 08:35:39.399293001 +0000 2023-12-22T08:39:17.663 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-22 08:35:39.399293001 +0000 2023-12-22T08:39:17.663 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-22T08:39:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-22T08:39:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-22T08:39:17.774 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000307669 s, 1.7 MB/s 2023-12-22T08:39:17.777 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-22T08:39:17.820 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:17.820 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-22T08:39:17.820 INFO:tasks.ceph:Generating config... 2023-12-22T08:39:17.822 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-22T08:39:17.822 INFO:tasks.ceph:[client] debug client = 20 2023-12-22T08:39:17.822 INFO:tasks.ceph:[client] debug ms = 1 2023-12-22T08:39:17.822 INFO:tasks.ceph:[client] pid file = 2023-12-22T08:39:17.822 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-22T08:39:17.822 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-22T08:39:17.822 INFO:tasks.ceph:[client.0] debug client = 20 2023-12-22T08:39:17.822 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-12-22T08:39:17.822 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-12-22T08:39:17.822 INFO:tasks.ceph:[client.1] debug client = 20 2023-12-22T08:39:17.822 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-12-22T08:39:17.823 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-12-22T08:39:17.823 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-22T08:39:17.823 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-22T08:39:17.824 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-22T08:39:17.824 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-22T08:39:17.824 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-12-22T08:39:17.824 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-12-22T08:39:17.824 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-12-22T08:39:17.824 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-22T08:39:17.824 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-22T08:39:17.824 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-22T08:39:17.824 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-22T08:39:17.824 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-22T08:39:17.824 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-22T08:39:17.824 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-22T08:39:17.824 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-22T08:39:17.824 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-22T08:39:17.824 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-22T08:39:17.825 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-12-22T08:39:17.825 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-22T08:39:17.825 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-22T08:39:17.825 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-22T08:39:17.825 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-12-22T08:39:17.825 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-12-22T08:39:17.825 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-12-22T08:39:17.825 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-22T08:39:17.825 INFO:tasks.ceph:Setting up mon.a... 2023-12-22T08:39:17.825 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-22T08:39:17.981 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.keyring 2023-12-22T08:39:17.990 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-22T08:39:18.141 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-22T08:39:18.244 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.38'), ('mon.b', '172.21.15.89'), ('mon.c', '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]')] 2023-12-22T08:39:18.245 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.38,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-22T08:39:18.246 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:18.246 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-22T08:39:18.306 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.38 --add b 172.21.15.89 --addv c '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:18.466 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:18.466 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: generated fsid 893856d7-5d01-4896-9127-f971dbad2b97 2023-12-22T08:39:18.466 INFO:teuthology.orchestra.run.smithi038.stdout:setting min_mon_release = pacific 2023-12-22T08:39:18.466 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 0 2023-12-22T08:39:18.466 INFO:teuthology.orchestra.run.smithi038.stdout:fsid 893856d7-5d01-4896-9127-f971dbad2b97 2023-12-22T08:39:18.466 INFO:teuthology.orchestra.run.smithi038.stdout:last_changed 2023-12-22T08:39:18.464593+0000 2023-12-22T08:39:18.466 INFO:teuthology.orchestra.run.smithi038.stdout:created 2023-12-22T08:39:18.464593+0000 2023-12-22T08:39:18.466 INFO:teuthology.orchestra.run.smithi038.stdout:min_mon_release 16 (pacific) 2023-12-22T08:39:18.466 INFO:teuthology.orchestra.run.smithi038.stdout:election_strategy: 1 2023-12-22T08:39:18.467 INFO:teuthology.orchestra.run.smithi038.stdout:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2023-12-22T08:39:18.467 INFO:teuthology.orchestra.run.smithi038.stdout:1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2023-12-22T08:39:18.467 INFO:teuthology.orchestra.run.smithi038.stdout:2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2023-12-22T08:39:18.467 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-22T08:39:18.470 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-22T08:39:18.529 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 893856d7-5d01-4896-9127-f971dbad2b97... 2023-12-22T08:39:18.530 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-22T08:39:18.536 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-22T08:39:18.703 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2023-12-22T08:39:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2023-12-22T08:39:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-22T08:39:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2023-12-22T08:39:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2023-12-22T08:39:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2023-12-22T08:39:18.704 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2023-12-22T08:39:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2023-12-22T08:39:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2023-12-22T08:39:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2023-12-22T08:39:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-22T08:39:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2023-12-22T08:39:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2023-12-22T08:39:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-22T08:39:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.705 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2023-12-22T08:39:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2023-12-22T08:39:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2023-12-22T08:39:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2023-12-22T08:39:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2023-12-22T08:39:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2023-12-22T08:39:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2023-12-22T08:39:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2023-12-22T08:39:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-22T08:39:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-22T08:39:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2023-12-22T08:39:18.706 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.38,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on skipped message = False 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 893856d7-5d01-4896-9127-f971dbad2b97 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2023-12-22T08:39:18.707 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2023-12-22T08:39:18.708 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2023-12-22T08:39:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2023-12-22T08:39:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2023-12-22T08:39:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2023-12-22T08:39:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2023-12-22T08:39:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2023-12-22T08:39:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2023-12-22T08:39:18.709 INFO:teuthology.orchestra.run.smithi089.stdout: bdev async discard = True 2023-12-22T08:39:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: bdev enable discard = True 2023-12-22T08:39:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore allocator = bitmap 2023-12-22T08:39:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2023-12-22T08:39:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2023-12-22T08:39:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 1/20 2023-12-22T08:39:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 1/20 2023-12-22T08:39:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-22T08:39:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2023-12-22T08:39:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 4/10 2023-12-22T08:39:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: memstore device bytes = 200000000 2023-12-22T08:39:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2023-12-22T08:39:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2023-12-22T08:39:18.713 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2023-12-22T08:39:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 1.0 2023-12-22T08:39:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: osd mon report interval = 5 2023-12-22T08:39:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = memstore 2023-12-22T08:39:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-12-22T08:39:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.714 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2023-12-22T08:39:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-22T08:39:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2023-12-22T08:39:18.714 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-12-22T08:39:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-12-22T08:39:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-12-22T08:39:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-12-22T08:39:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2023-12-22T08:39:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.715 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2023-12-22T08:39:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-22T08:39:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-12-22T08:39:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2023-12-22T08:39:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-12-22T08:39:18.715 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2023-12-22T08:39:18.716 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: mon op complaint time = 120 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull ratio = 0.6 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.7 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.6 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: client mount timeout = 600 2023-12-22T08:39:18.717 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = "" 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: debug objectcacher = 20 2023-12-22T08:39:18.718 INFO:teuthology.orchestra.run.smithi089.stdout: debug objecter = 20 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: debug objectcacher = 20 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: debug objecter = 20 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds = 20 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds balancer = 20 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug frag = True 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug scatterstat = True 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: mds op complaint time = 180 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: mds verify scatter = True 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-12-22T08:39:18.719 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-12-22T08:39:18.720 INFO:teuthology.orchestra.run.smithi038.stdout:[global] 2023-12-22T08:39:18.720 INFO:teuthology.orchestra.run.smithi038.stdout: chdir = "" 2023-12-22T08:39:18.720 INFO:teuthology.orchestra.run.smithi038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-22T08:39:18.720 INFO:teuthology.orchestra.run.smithi038.stdout: auth supported = cephx 2023-12-22T08:39:18.720 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.720 INFO:teuthology.orchestra.run.smithi038.stdout: filestore xattr use omap = true 2023-12-22T08:39:18.720 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.720 INFO:teuthology.orchestra.run.smithi038.stdout: mon clock drift allowed = 1.000 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: osd crush chooseleaf type = 0 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: auth debug = true 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on old message = true 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on bug = true 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: mon pg warn max object skew = 0 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: # disable pg_autoscaler by default for new pools 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default size = 2 2023-12-22T08:39:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow primary affinity = true 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow pg remap = true 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on legacy crush tunables = false 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on crush straw calc version zero = false 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on no sortbitwise = false 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on osd down out interval zero = false 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on too few osds = false 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: mon_allow_pool_size_one = true 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.722 INFO:teuthology.orchestra.run.smithi038.stdout: osd default data pool replay window = 5 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: mon allow pool delete = true 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: mon cluster log file level = debug 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: debug asserts on shutdown = true 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: mon health detail to clog = false 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: mon host = "172.21.15.38,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on skipped message = False 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: fsid = 893856d7-5d01-4896-9127-f971dbad2b97 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout:[osd] 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: osd journal size = 100 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub load threshold = 5.0 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub max interval = 600 2023-12-22T08:39:18.723 INFO:teuthology.orchestra.run.smithi038.stdout: osd mclock profile = high_recovery_ops 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: osd recover clone overlap = true 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: osd recovery max chunk = 1048576 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug shutdown = true 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug op order = true 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug verify stray on activate = true 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: osd open classes on start = true 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug pg log writeout = true 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: osd deep scrub update digest min age = 30 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: osd map max advance = 10 2023-12-22T08:39:18.724 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: journal zero on create = true 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: filestore ondisk finisher threads = 3 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: filestore apply finisher threads = 3 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: bdev debug aio = true 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug misdirected ops = true 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: bdev async discard = True 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: bdev enable discard = True 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore allocator = bitmap 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore block size = 96636764160 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore fsck on mount = True 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluefs = 1/20 2023-12-22T08:39:18.725 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluestore = 1/20 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: debug osd = 20 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: debug rocksdb = 4/10 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: memstore device bytes = 200000000 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd backfillfull_ratio = 0.85 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd full ratio = 0.9 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd nearfull ratio = 0.8 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: osd failsafe full ratio = 1.0 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: osd mon report interval = 5 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: osd objectstore = memstore 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: osd op complaint time = 180 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr] 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-12-22T08:39:18.726 INFO:teuthology.orchestra.run.smithi038.stdout: debug mgr = 20 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: mgr/telemetry/nag = false 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout:[mon] 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: debug paxos = 20 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: mon data avail warn = 5 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: mon mgr mkfs grace = 240 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2023-12-22T08:39:18.727 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd reporter subtree level = osd 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd prime pg temp = true 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: auth mon ticket ttl = 660 # 11m 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: auth service ticket ttl = 240 # 4m 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: # don't complain about insecure global_id in the test suite 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: # 1m isn't quite enough 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: mon_down_mkfs_grace = 2m 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.728 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_filestore_osds = false 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: mon op complaint time = 120 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd backfillfull ratio = 0.6 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd full ratio = 0.7 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd nearfull ratio = 0.6 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout:[client] 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: rgw cache enabled = true 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable ops log = true 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable usage log = true 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: client mount timeout = 600 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: debug client = 20 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-12-22T08:39:18.729 INFO:teuthology.orchestra.run.smithi038.stdout: pid file = "" 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout: rados mon op timeout = 900 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout: rados osd op timeout = 900 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.a] 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.b] 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.c] 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a] 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.c] 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.b] 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.d] 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout: debug client = 20 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout: debug objectcacher = 20 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout: debug objecter = 20 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout:[client.1] 2023-12-22T08:39:18.730 INFO:teuthology.orchestra.run.smithi038.stdout: debug client = 20 2023-12-22T08:39:18.731 INFO:teuthology.orchestra.run.smithi038.stdout: debug objectcacher = 20 2023-12-22T08:39:18.731 INFO:teuthology.orchestra.run.smithi038.stdout: debug objecter = 20 2023-12-22T08:39:18.731 INFO:teuthology.orchestra.run.smithi038.stdout:[mds] 2023-12-22T08:39:18.731 INFO:teuthology.orchestra.run.smithi038.stdout: debug mds = 20 2023-12-22T08:39:18.731 INFO:teuthology.orchestra.run.smithi038.stdout: debug mds balancer = 20 2023-12-22T08:39:18.731 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-12-22T08:39:18.731 INFO:teuthology.orchestra.run.smithi038.stdout: mds debug frag = True 2023-12-22T08:39:18.731 INFO:teuthology.orchestra.run.smithi038.stdout: mds debug scatterstat = True 2023-12-22T08:39:18.731 INFO:teuthology.orchestra.run.smithi038.stdout: mds op complaint time = 180 2023-12-22T08:39:18.731 INFO:teuthology.orchestra.run.smithi038.stdout: mds verify scatter = True 2023-12-22T08:39:18.731 INFO:teuthology.orchestra.run.smithi038.stdout: osd op complaint time = 180 2023-12-22T08:39:18.731 INFO:teuthology.orchestra.run.smithi038.stdout: rados mon op timeout = 900 2023-12-22T08:39:18.731 INFO:teuthology.orchestra.run.smithi038.stdout: rados osd op timeout = 900 2023-12-22T08:39:18.764 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-22T08:39:18.765 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-22T08:39:18.917 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-22T08:39:18.917 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:18.921 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-22T08:39:18.976 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:18.976 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-22T08:39:19.031 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:39:19.031 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:19.031 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-22T08:39:19.031 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-22T08:39:19.189 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:19.189 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:19.293 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:39:19.293 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:19.293 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-22T08:39:19.293 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-22T08:39:19.437 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:19.437 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:19.529 INFO:tasks.ceph:Setting up mon nodes... 2023-12-22T08:39:19.533 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-22T08:39:19.534 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-22T08:39:19.743 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-22T08:39:19.755 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-22T08:39:19.919 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-22T08:39:19.927 INFO:tasks.ceph:Setting up mds nodes... 2023-12-22T08:39:19.928 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-22T08:39:20.142 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-22T08:39:20.152 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-22T08:39:20.249 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-22T08:39:20.439 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-22T08:39:20.448 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-22T08:39:20.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-22T08:39:20.710 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-22T08:39:20.715 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-22T08:39:20.804 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-22T08:39:20.985 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-22T08:39:20.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-22T08:39:21.094 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-22T08:39:21.095 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-22T08:39:21.239 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-22T08:39:21.313 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-22T08:39:21.451 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-22T08:39:21.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-22T08:39:21.643 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-22T08:39:21.698 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-22T08:39:21.825 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-22T08:39:21.876 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-22T08:39:21.877 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-22T08:39:21.877 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-22T08:39:21.987 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:21.987 INFO:tasks.ceph:role: osd.0 2023-12-22T08:39:21.987 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:39:21.987 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-22T08:39:22.117 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:39:22.117 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:39:22.117 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:39:22.117 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:39:22.117 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:39:22.117 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:39:22.117 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:39:22.117 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:39:22.117 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:39:22.118 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:39:23.434 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-12-22T08:39:23.441 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-12-22T08:39:23.441 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-22T08:39:23.572 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-22T08:39:23.666 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-22T08:39:23.761 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:23.762 INFO:tasks.ceph:role: osd.1 2023-12-22T08:39:23.762 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:39:23.762 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-22T08:39:23.890 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:39:23.891 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:39:23.891 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:39:23.891 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:39:23.891 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:39:23.891 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:39:23.891 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:39:23.891 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:39:23.891 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:39:23.891 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:39:25.216 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-12-22T08:39:25.225 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-12-22T08:39:25.225 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-22T08:39:25.352 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-22T08:39:25.451 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-22T08:39:25.550 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:25.550 INFO:tasks.ceph:role: osd.2 2023-12-22T08:39:25.550 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:39:25.550 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-22T08:39:25.677 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:39:25.678 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:39:25.678 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:39:25.678 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:39:25.678 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:39:25.678 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:39:25.678 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:39:25.678 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:39:25.678 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:39:25.678 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:39:27.004 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-12-22T08:39:27.011 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-12-22T08:39:27.012 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-22T08:39:27.141 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-22T08:39:27.235 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-22T08:39:27.328 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:27.328 INFO:tasks.ceph:role: osd.3 2023-12-22T08:39:27.328 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:39:27.329 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-22T08:39:27.456 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:39:27.456 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:39:27.456 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:39:27.456 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:39:27.456 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:39:27.457 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:39:27.457 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:39:27.457 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:39:27.457 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:39:27.457 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:39:28.777 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-12-22T08:39:28.783 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-12-22T08:39:28.784 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-22T08:39:28.916 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-22T08:39:29.010 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:29.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:29.168+0000 7ff586a0f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-22T08:39:29.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:29.169+0000 7ff586a0f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-22T08:39:29.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:29.172+0000 7ff586a0f500 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-12-22T08:39:29.201 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-22T08:39:29.306 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:29.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:29.458+0000 7f6122707500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-22T08:39:29.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:29.459+0000 7f6122707500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-22T08:39:29.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:29.461+0000 7f6122707500 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-12-22T08:39:29.508 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-22T08:39:29.613 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:29.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:29.766+0000 7f1793972500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-22T08:39:29.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:29.768+0000 7f1793972500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-22T08:39:29.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:29.770+0000 7f1793972500 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-12-22T08:39:29.816 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-22T08:39:29.917 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:30.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:30.057+0000 7f0785212500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-22T08:39:30.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:30.057+0000 7f0785212500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-22T08:39:30.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:30.060+0000 7f0785212500 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-12-22T08:39:30.120 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-22T08:39:30.225 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-22T08:39:30.328 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:30.328 INFO:tasks.ceph:role: osd.4 2023-12-22T08:39:30.328 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:39:30.328 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-22T08:39:30.427 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:39:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:39:30.427 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:39:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:39:30.428 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:39:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:39:30.428 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:39:30.428 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:39:30.428 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:39:30.428 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:39:30.943 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-12-22T08:39:30.952 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-12-22T08:39:30.952 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-22T08:39:31.136 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-22T08:39:31.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-22T08:39:31.335 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:31.335 INFO:tasks.ceph:role: osd.5 2023-12-22T08:39:31.335 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:39:31.335 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-22T08:39:31.426 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:39:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:39:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:39:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:39:31.426 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:39:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:39:31.426 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:39:31.426 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:39:31.426 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:39:31.426 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:39:31.909 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-12-22T08:39:31.915 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-12-22T08:39:31.916 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-22T08:39:32.058 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-22T08:39:32.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-22T08:39:32.248 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:32.248 INFO:tasks.ceph:role: osd.6 2023-12-22T08:39:32.248 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:39:32.248 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-22T08:39:32.349 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:39:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:39:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:39:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:39:32.349 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:39:32.349 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:39:32.349 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:39:32.349 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:39:32.350 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:39:32.350 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:39:32.873 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-12-22T08:39:32.877 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-12-22T08:39:32.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-22T08:39:33.082 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-22T08:39:33.188 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-22T08:39:33.303 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:33.303 INFO:tasks.ceph:role: osd.7 2023-12-22T08:39:33.303 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:39:33.304 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-22T08:39:33.406 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:39:33.406 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:39:33.406 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:39:33.406 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:39:33.406 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:39:33.406 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:39:33.406 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:39:33.406 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:39:33.406 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:39:33.407 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:39:33.877 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-12-22T08:39:33.883 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-12-22T08:39:33.883 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-22T08:39:34.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-22T08:39:34.120 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:34.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:34.265+0000 7f854c91e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-22T08:39:34.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:34.267+0000 7f854c91e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-22T08:39:34.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:34.274+0000 7f854c91e500 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-12-22T08:39:34.307 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-22T08:39:34.397 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:34.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:34.534+0000 7f9a9f249500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-22T08:39:34.540 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:34.538+0000 7f9a9f249500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-22T08:39:34.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:34.546+0000 7f9a9f249500 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-12-22T08:39:34.578 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-22T08:39:34.669 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:34.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:34.798+0000 7f9b922cf500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-22T08:39:34.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:34.803+0000 7f9b922cf500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-22T08:39:34.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:34.810+0000 7f9b922cf500 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-12-22T08:39:34.847 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-22T08:39:34.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:35.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:35.072+0000 7f9233210500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-22T08:39:35.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:35.073+0000 7f9233210500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-22T08:39:35.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:35.075+0000 7f9233210500 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-12-22T08:39:35.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-22T08:39:35.187 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-22T08:39:35.187 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:35.187 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-22T08:39:35.299 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:35.300 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-22T08:39:35.409 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:35.409 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-22T08:39:35.511 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:35.511 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-22T08:39:35.612 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:35.612 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-22T08:39:35.717 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:35.717 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-22T08:39:35.822 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:35.822 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-22T08:39:35.926 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:35.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-22T08:39:36.028 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:36.028 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-22T08:39:36.113 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:36.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-22T08:39:36.251 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:36.252 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-22T08:39:36.348 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:36.348 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-22T08:39:36.447 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:36.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-22T08:39:36.541 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:36.541 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-22T08:39:36.636 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:36.637 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-22T08:39:36.700 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:36.700 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-22T08:39:36.757 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:36.757 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-22T08:39:36.816 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:36.816 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-22T08:39:36.870 INFO:tasks.ceph:Adding keys to all mons... 2023-12-22T08:39:36.870 DEBUG:teuthology.orchestra.run.smithi038:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-22T08:39:36.879 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-22T08:39:36.972 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2023-12-22T08:39:36.972 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA3S4VlED5ALBAAComDf9woKBt/IXcez+Udmg== 2023-12-22T08:39:36.972 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-12-22T08:39:36.972 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA4S4Vl57dkCBAAeliJIPc49iRBk2mp8WYv8A== 2023-12-22T08:39:36.972 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-12-22T08:39:36.972 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA4S4Vl7poXGhAA+ZSohyj4dAOs6B5dZKTLAg== 2023-12-22T08:39:36.972 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2023-12-22T08:39:36.972 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBBS4VlnVQaChAAxfWmPqwo5D4qBYkAP/6dHQ== 2023-12-22T08:39:36.972 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2023-12-22T08:39:36.972 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBBS4Vll2dlGxAAbqx4rxnz4FWIKl9OGqcwtw== 2023-12-22T08:39:36.972 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBBS4VljQ3HLRAAfyrtqD4n6Da8Rl/6UKmv7g== 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBCS4VlOat4AxAAIkAGRvGGWrrwx/ppMbexWQ== 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA3S4VlTHG+NhAAUNkVtrDuoK2OEsy1HHkt2A== 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA4S4Vl0C0+KhAAkCsjfyn19nOz1xTyhZkbPQ== 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA4S4VlTBuoOhAArKX4AiOQRGawIyAnInIhCg== 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBGS4Vlwg7TDxAA+L504F+Hw/6FTJ63cV3ZXg== 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBGS4Vlx8zgHxAALBDm/sSYqw/fn4nLNQbu4A== 2023-12-22T08:39:36.973 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.6] 2023-12-22T08:39:36.974 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBGS4Vlx5OdLxAAaMP09nYI3HKiuhPARgnCOw== 2023-12-22T08:39:36.974 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.7] 2023-12-22T08:39:36.974 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBHS4Vl/15bBBAA4maatkcgA0axcZY/L9r/IA== 2023-12-22T08:39:36.974 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-12-22T08:39:36.974 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA5S4VlgDspDhAA0TWGbk4AbuOhCNotPej29A== 2023-12-22T08:39:36.974 INFO:teuthology.orchestra.run.smithi089.stdout:[client.2] 2023-12-22T08:39:36.974 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA5S4VliOHMGhAARaM8FC/0maNMToLGhBR4Tg== 2023-12-22T08:39:36.974 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2023-12-22T08:39:36.974 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA5S4VlwSk/JhAAM3faae43p4/gw9BmyxLpJA== 2023-12-22T08:39:36.974 INFO:teuthology.orchestra.run.smithi089.stdout:[client.3] 2023-12-22T08:39:36.974 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA5S4VlV/MVMRAAyN1643IAOTLOLuz4DqMZ8A== 2023-12-22T08:39:36.976 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.y] 2023-12-22T08:39:36.976 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQA3S4VlED5ALBAAComDf9woKBt/IXcez+Udmg== 2023-12-22T08:39:36.976 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a] 2023-12-22T08:39:36.976 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQA4S4Vl57dkCBAAeliJIPc49iRBk2mp8WYv8A== 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.c] 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQA4S4Vl7poXGhAA+ZSohyj4dAOs6B5dZKTLAg== 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.0] 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBBS4VlnVQaChAAxfWmPqwo5D4qBYkAP/6dHQ== 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.1] 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBBS4Vll2dlGxAAbqx4rxnz4FWIKl9OGqcwtw== 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.2] 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBBS4VljQ3HLRAAfyrtqD4n6Da8Rl/6UKmv7g== 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.3] 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBCS4VlOat4AxAAIkAGRvGGWrrwx/ppMbexWQ== 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.x] 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQA3S4VlTHG+NhAAUNkVtrDuoK2OEsy1HHkt2A== 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.b] 2023-12-22T08:39:36.977 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQA4S4Vl0C0+KhAAkCsjfyn19nOz1xTyhZkbPQ== 2023-12-22T08:39:36.978 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.d] 2023-12-22T08:39:36.978 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQA4S4VlTBuoOhAArKX4AiOQRGawIyAnInIhCg== 2023-12-22T08:39:36.978 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.4] 2023-12-22T08:39:36.978 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBGS4Vlwg7TDxAA+L504F+Hw/6FTJ63cV3ZXg== 2023-12-22T08:39:36.978 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.5] 2023-12-22T08:39:36.978 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBGS4Vlx8zgHxAALBDm/sSYqw/fn4nLNQbu4A== 2023-12-22T08:39:36.978 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.6] 2023-12-22T08:39:36.978 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBGS4Vlx5OdLxAAaMP09nYI3HKiuhPARgnCOw== 2023-12-22T08:39:36.981 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.7] 2023-12-22T08:39:36.981 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBHS4Vl/15bBBAA4maatkcgA0axcZY/L9r/IA== 2023-12-22T08:39:36.981 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2023-12-22T08:39:36.981 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQA5S4VlgDspDhAA0TWGbk4AbuOhCNotPej29A== 2023-12-22T08:39:36.981 INFO:teuthology.orchestra.run.smithi038.stdout:[client.2] 2023-12-22T08:39:36.981 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQA5S4VliOHMGhAARaM8FC/0maNMToLGhBR4Tg== 2023-12-22T08:39:36.981 INFO:teuthology.orchestra.run.smithi038.stdout:[client.1] 2023-12-22T08:39:36.982 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQA5S4VlwSk/JhAAM3faae43p4/gw9BmyxLpJA== 2023-12-22T08:39:36.982 INFO:teuthology.orchestra.run.smithi038.stdout:[client.3] 2023-12-22T08:39:36.982 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQA5S4VlV/MVMRAAyN1643IAOTLOLuz4DqMZ8A== 2023-12-22T08:39:36.983 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T08:39:36.991 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T08:39:37.139 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:39:37.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:39:37.284 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:39:37.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:39:37.434 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:37.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:37.581 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:37.587 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:37.735 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:37.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:37.885 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:37.891 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:38.034 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T08:39:38.043 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T08:39:38.191 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:39:38.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:39:38.344 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:39:38.353 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:39:38.506 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:38.512 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:38.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:38.669 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:38.814 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:38.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:38.962 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:38.968 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:39:39.113 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T08:39:39.119 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T08:39:39.266 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T08:39:39.272 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T08:39:39.420 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T08:39:39.426 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T08:39:39.571 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T08:39:39.578 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T08:39:39.727 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-22T08:39:39.727 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-22T08:39:39.837 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-22T08:39:40.026 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-22T08:39:40.127 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-22T08:39:40.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-22T08:39:40.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-22T08:39:40.473 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-22T08:39:40.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-22T08:39:40.722 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-22T08:39:40.809 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:40.818 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:40.874 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-22T08:39:40.874 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-22T08:39:40.874 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-22T08:39:40.880 INFO:tasks.ceph.mon.a:Started 2023-12-22T08:39:40.880 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-22T08:39:40.881 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-22T08:39:40.886 INFO:tasks.ceph.mon.b:Started 2023-12-22T08:39:40.886 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-22T08:39:40.886 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-22T08:39:40.893 INFO:tasks.ceph.mon.c:Started 2023-12-22T08:39:40.893 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-22T08:39:40.893 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-22T08:39:40.894 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-22T08:39:40.899 INFO:tasks.ceph.mgr.y:Started 2023-12-22T08:39:40.899 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-22T08:39:40.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-22T08:39:40.905 INFO:tasks.ceph.mgr.x:Started 2023-12-22T08:39:40.905 INFO:tasks.ceph:Setting crush tunables to default 2023-12-22T08:39:40.905 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd crush tunables default 2023-12-22T08:39:41.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.096+0000 7f66a4ea1640 1 Processor -- start 2023-12-22T08:39:41.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.096+0000 7f66a4ea1640 1 -- start start 2023-12-22T08:39:41.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f66a4ea1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a01403e0 0x7f66a00cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:41.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f66a4ea1640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f66a0161090 0x7f66a00b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:41.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f66a4ea1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f66a00b3b40 0x7f66a015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:41.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f66a4ea1640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a0162010 con 0x7f66a0161090 2023-12-22T08:39:41.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f66a4ea1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a01614f0 con 0x7f66a00b3b40 2023-12-22T08:39:41.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f66a4ea1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0161770 con 0x7f66a01403e0 2023-12-22T08:39:41.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f669e59c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a01403e0 0x7f66a00cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:41.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f669e59c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a01403e0 0x7f66a00cf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:54152/0 (socket says 172.21.15.38:54152) 2023-12-22T08:39:41.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f669e59c640 1 -- 172.21.15.38:0/2664231086 learned_addr learned my addr 172.21.15.38:0/2664231086 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:41.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f669ed9d640 1 --2- 172.21.15.38:0/2664231086 >> v2:172.21.15.89:3300/0 conn(0x7f66a00b3b40 0x7f66a015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:41.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f6697fff640 1 --2- 172.21.15.38:0/2664231086 >> v2:172.21.15.38:3300/0 conn(0x7f66a0161090 0x7f66a00b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:41.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f669e59c640 1 -- 172.21.15.38:0/2664231086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a01403e0 msgr2=0x7f66a00cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-22T08:39:41.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f669e59c640 1 -- 172.21.15.38:0/2664231086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a01403e0 msgr2=0x7f66a00cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-22T08:39:41.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f669e59c640 1 --2- 172.21.15.38:0/2664231086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a01403e0 0x7f66a00cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-22T08:39:41.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f669ed9d640 1 -- 172.21.15.38:0/2664231086 >> v2:172.21.15.89:3300/0 conn(0x7f66a00b3b40 msgr2=0x7f66a015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-22T08:39:41.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f669e59c640 1 --2- 172.21.15.38:0/2664231086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a01403e0 0x7f66a00cf930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-22T08:39:41.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f669ed9d640 1 -- 172.21.15.38:0/2664231086 >> v2:172.21.15.89:3300/0 conn(0x7f66a00b3b40 msgr2=0x7f66a015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-22T08:39:41.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f669ed9d640 1 --2- 172.21.15.38:0/2664231086 >> v2:172.21.15.89:3300/0 conn(0x7f66a00b3b40 0x7f66a015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-22T08:39:41.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f669ed9d640 1 --2- 172.21.15.38:0/2664231086 >> v2:172.21.15.89:3300/0 conn(0x7f66a00b3b40 0x7f66a015e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-22T08:39:41.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f6697fff640 1 -- 172.21.15.38:0/2664231086 >> v2:172.21.15.38:3300/0 conn(0x7f66a0161090 msgr2=0x7f66a00b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-22T08:39:41.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f6697fff640 1 -- 172.21.15.38:0/2664231086 >> v2:172.21.15.38:3300/0 conn(0x7f66a0161090 msgr2=0x7f66a00b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-22T08:39:41.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f6697fff640 1 --2- 172.21.15.38:0/2664231086 >> v2:172.21.15.38:3300/0 conn(0x7f66a0161090 0x7f66a00b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-22T08:39:41.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.098+0000 7f6697fff640 1 --2- 172.21.15.38:0/2664231086 >> v2:172.21.15.38:3300/0 conn(0x7f66a0161090 0x7f66a00b3600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-22T08:39:41.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.299+0000 7f669ed9d640 1 --2- 172.21.15.38:0/2664231086 >> v2:172.21.15.89:3300/0 conn(0x7f66a00b3b40 0x7f66a015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:41.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.299+0000 7f669e59c640 1 --2- 172.21.15.38:0/2664231086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a01403e0 0x7f66a00cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:41.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.299+0000 7f6697fff640 1 --2- 172.21.15.38:0/2664231086 >> v2:172.21.15.38:3300/0 conn(0x7f66a0161090 0x7f66a00b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:41.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.300+0000 7f669e59c640 1 -- 172.21.15.38:0/2664231086 >> v2:172.21.15.89:3300/0 conn(0x7f66a00b3b40 msgr2=0x7f66a015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:41.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.300+0000 7f669e59c640 1 --2- 172.21.15.38:0/2664231086 >> v2:172.21.15.89:3300/0 conn(0x7f66a00b3b40 0x7f66a015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:41.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.300+0000 7f669e59c640 1 -- 172.21.15.38:0/2664231086 >> v2:172.21.15.38:3300/0 conn(0x7f66a0161090 msgr2=0x7f66a00b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:41.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.300+0000 7f669e59c640 1 --2- 172.21.15.38:0/2664231086 >> v2:172.21.15.38:3300/0 conn(0x7f66a0161090 0x7f66a00b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:41.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.300+0000 7f669e59c640 1 -- 172.21.15.38:0/2664231086 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a0161a50 con 0x7f66a01403e0 2023-12-22T08:39:41.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.301+0000 7f669e59c640 1 --2- 172.21.15.38:0/2664231086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a01403e0 0x7f66a00cf930 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f66a00b3fd0 tx=0x7f669002bc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0e06038d21c72a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:41.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.302+0000 7f669dd9b640 1 -- 172.21.15.38:0/2664231086 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669002ca20 con 0x7f66a01403e0 2023-12-22T08:39:41.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.302+0000 7f669dd9b640 1 -- 172.21.15.38:0/2664231086 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669002cb80 con 0x7f66a01403e0 2023-12-22T08:39:41.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.302+0000 7f669dd9b640 1 -- 172.21.15.38:0/2664231086 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690034440 con 0x7f66a01403e0 2023-12-22T08:39:41.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.303+0000 7f66a4ea1640 1 -- 172.21.15.38:0/2664231086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a01403e0 msgr2=0x7f66a00cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:41.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.303+0000 7f66a4ea1640 1 --2- 172.21.15.38:0/2664231086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a01403e0 0x7f66a00cf930 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f66a00b3fd0 tx=0x7f669002bc70 comp rx=0 tx=0).stop 2023-12-22T08:39:41.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.303+0000 7f66a4ea1640 1 -- 172.21.15.38:0/2664231086 shutdown_connections 2023-12-22T08:39:41.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.303+0000 7f66a4ea1640 1 --2- 172.21.15.38:0/2664231086 >> v2:172.21.15.89:3300/0 conn(0x7f66a00b3b40 0x7f66a015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:41.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.303+0000 7f66a4ea1640 1 --2- 172.21.15.38:0/2664231086 >> v2:172.21.15.38:3300/0 conn(0x7f66a0161090 0x7f66a00b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:41.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.303+0000 7f66a4ea1640 1 --2- 172.21.15.38:0/2664231086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a01403e0 0x7f66a00cf930 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:41.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.303+0000 7f66a4ea1640 1 -- 172.21.15.38:0/2664231086 >> 172.21.15.38:0/2664231086 conn(0x7f66a006f640 msgr2=0x7f66a00d1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:41.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.303+0000 7f66a4ea1640 1 -- 172.21.15.38:0/2664231086 shutdown_connections 2023-12-22T08:39:41.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.303+0000 7f66a4ea1640 1 -- 172.21.15.38:0/2664231086 wait complete. 2023-12-22T08:39:41.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.306+0000 7f66a4ea1640 1 Processor -- start 2023-12-22T08:39:41.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.306+0000 7f66a4ea1640 1 -- start start 2023-12-22T08:39:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.307+0000 7f66a4ea1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66a00b3b40 0x7f66a00d1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.307+0000 7f66a4ea1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66a01403e0 0x7f66a0156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.307+0000 7f66a4ea1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a0161090 0x7f66a01567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.307+0000 7f66a4ea1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00d08c0 con 0x7f66a01403e0 2023-12-22T08:39:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.307+0000 7f66a4ea1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0143990 con 0x7f66a00b3b40 2023-12-22T08:39:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.308+0000 7f66a4ea1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00d0b00 con 0x7f66a0161090 2023-12-22T08:39:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.308+0000 7f669ed9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a0161090 0x7f66a01567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.308+0000 7f669ed9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a0161090 0x7f66a01567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:54184/0 (socket says 172.21.15.38:54184) 2023-12-22T08:39:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.308+0000 7f669ed9d640 1 -- 172.21.15.38:0/3399466742 learned_addr learned my addr 172.21.15.38:0/3399466742 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.308+0000 7f6697fff640 1 --2- 172.21.15.38:0/3399466742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66a01403e0 0x7f66a0156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.308+0000 7f669e59c640 1 --2- 172.21.15.38:0/3399466742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66a00b3b40 0x7f66a00d1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.309+0000 7f669ed9d640 1 -- 172.21.15.38:0/3399466742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66a00b3b40 msgr2=0x7f66a00d1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.309+0000 7f669ed9d640 1 --2- 172.21.15.38:0/3399466742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66a00b3b40 0x7f66a00d1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.309+0000 7f669ed9d640 1 -- 172.21.15.38:0/3399466742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66a01403e0 msgr2=0x7f66a0156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.309+0000 7f669ed9d640 1 --2- 172.21.15.38:0/3399466742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66a01403e0 0x7f66a0156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.309+0000 7f669ed9d640 1 -- 172.21.15.38:0/3399466742 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900095b0 con 0x7f66a0161090 2023-12-22T08:39:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.309+0000 7f669e59c640 1 --2- 172.21.15.38:0/3399466742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66a00b3b40 0x7f66a00d1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:39:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.309+0000 7f669ed9d640 1 --2- 172.21.15.38:0/3399466742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a0161090 0x7f66a01567d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6698004630 tx=0x7f6698007700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.309+0000 7f6696ffd640 1 -- 172.21.15.38:0/3399466742 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800ab30 con 0x7f66a0161090 2023-12-22T08:39:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.309+0000 7f6696ffd640 1 -- 172.21.15.38:0/3399466742 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6698009bf0 con 0x7f66a0161090 2023-12-22T08:39:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.309+0000 7f6696ffd640 1 -- 172.21.15.38:0/3399466742 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800a030 con 0x7f66a0161090 2023-12-22T08:39:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.309+0000 7f66a4ea1640 1 -- 172.21.15.38:0/3399466742 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a00d0de0 con 0x7f66a0161090 2023-12-22T08:39:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.310+0000 7f66a4ea1640 1 -- 172.21.15.38:0/3399466742 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a01435b0 con 0x7f66a0161090 2023-12-22T08:39:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.310+0000 7f6696ffd640 1 -- 172.21.15.38:0/3399466742 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f669800a190 con 0x7f66a0161090 2023-12-22T08:39:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.310+0000 7f6696ffd640 1 -- 172.21.15.38:0/3399466742 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6698015c40 con 0x7f66a0161090 2023-12-22T08:39:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.311+0000 7f66a4ea1640 1 -- 172.21.15.38:0/3399466742 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a00d1300 con 0x7f66a0161090 2023-12-22T08:39:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.317+0000 7f6696ffd640 1 -- 172.21.15.38:0/3399466742 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f66a00d1300 con 0x7f66a0161090 2023-12-22T08:39:41.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.396+0000 7f66a4ea1640 1 -- 172.21.15.38:0/3399466742 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f66a0143740 con 0x7f66a0161090 2023-12-22T08:39:41.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.407+0000 7f6696ffd640 1 -- 172.21.15.38:0/3399466742 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f669801a070 con 0x7f66a0161090 2023-12-22T08:39:41.409 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2023-12-22T08:39:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.409+0000 7f66a4ea1640 1 -- 172.21.15.38:0/3399466742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a0161090 msgr2=0x7f66a01567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.409+0000 7f66a4ea1640 1 --2- 172.21.15.38:0/3399466742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a0161090 0x7f66a01567d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6698004630 tx=0x7f6698007700 comp rx=0 tx=0).stop 2023-12-22T08:39:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.409+0000 7f66a4ea1640 1 -- 172.21.15.38:0/3399466742 shutdown_connections 2023-12-22T08:39:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.409+0000 7f66a4ea1640 1 --2- 172.21.15.38:0/3399466742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a0161090 0x7f66a01567d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.409+0000 7f66a4ea1640 1 --2- 172.21.15.38:0/3399466742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66a01403e0 0x7f66a0156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.409+0000 7f66a4ea1640 1 --2- 172.21.15.38:0/3399466742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66a00b3b40 0x7f66a00d1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.409+0000 7f66a4ea1640 1 -- 172.21.15.38:0/3399466742 >> 172.21.15.38:0/3399466742 conn(0x7f66a006f640 msgr2=0x7f66a00b6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.409+0000 7f66a4ea1640 1 -- 172.21.15.38:0/3399466742 shutdown_connections 2023-12-22T08:39:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:41.409+0000 7f66a4ea1640 1 -- 172.21.15.38:0/3399466742 wait complete. 2023-12-22T08:39:41.430 INFO:tasks.ceph:check_enable_crimson: False 2023-12-22T08:39:41.430 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-22T08:39:41.430 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:41.431 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-22T08:39:41.524 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:41.524 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-22T08:39:41.615 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:41.615 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-22T08:39:41.748 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:39:41.748 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-22T08:39:41.834 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:41.834 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-22T08:39:41.852 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:41.851+0000 7f5305013040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-22T08:39:41.910 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:41.908+0000 7f01e820f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-22T08:39:41.914 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:41.913+0000 7f5305013040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-22T08:39:41.926 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:41.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-22T08:39:41.976 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:41.974+0000 7f01e820f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-22T08:39:42.009 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:42.009 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-22T08:39:42.145 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:39:42.145 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-22T08:39:42.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-12-22T08:39:42.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.463+0000 7f2c4898e640 1 Processor -- start 2023-12-22T08:39:42.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.463+0000 7f2c4898e640 1 -- start start 2023-12-22T08:39:42.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.465+0000 7f2c4898e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c440b3b20 0x7f2c441467f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:42.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.465+0000 7f2c4898e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2c440b6a00 0x7f2c44146d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:42.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.465+0000 7f2c4898e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c440b8e60 con 0x7f2c440b6620 2023-12-22T08:39:42.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.465+0000 7f2c4898e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c440b4430 con 0x7f2c440b6a00 2023-12-22T08:39:42.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.465+0000 7f2c4898e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440b4710 con 0x7f2c440b3b20 2023-12-22T08:39:42.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.465+0000 7f2c3bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c440b3b20 0x7f2c441467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:42.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.465+0000 7f2c43fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2c440b6a00 0x7f2c44146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:42.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.465+0000 7f2c3bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c440b3b20 0x7f2c441467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54746/0 (socket says 172.21.15.89:54746) 2023-12-22T08:39:42.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.465+0000 7f2c3bfff640 1 -- 172.21.15.89:0/1006119935 learned_addr learned my addr 172.21.15.89:0/1006119935 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.466+0000 7f2c43fff640 1 -- 172.21.15.89:0/1006119935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c440b3b20 msgr2=0x7f2c441467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.466+0000 7f2c43fff640 1 --2- 172.21.15.89:0/1006119935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c440b3b20 0x7f2c441467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.466+0000 7f2c43fff640 1 -- 172.21.15.89:0/1006119935 >> v1:172.21.15.38:6789/0 conn(0x7f2c440b6620 legacy=0x7f2c440b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.466+0000 7f2c43fff640 1 -- 172.21.15.89:0/1006119935 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c440b49f0 con 0x7f2c440b6a00 2023-12-22T08:39:42.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.467+0000 7f2c43fff640 1 --2- 172.21.15.89:0/1006119935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c440b6a00 0x7f2c44146d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2c4415d9e0 tx=0x7f2c3c02bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7be05b0d9da01d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:42.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.468+0000 7f2c42ffd640 1 -- 172.21.15.89:0/1006119935 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c02cb20 con 0x7f2c440b6a00 2023-12-22T08:39:42.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.468+0000 7f2c42ffd640 1 -- 172.21.15.89:0/1006119935 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c02cc80 con 0x7f2c440b6a00 2023-12-22T08:39:42.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.468+0000 7f2c42ffd640 1 -- 172.21.15.89:0/1006119935 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c034440 con 0x7f2c440b6a00 2023-12-22T08:39:42.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.468+0000 7f2c4898e640 1 -- 172.21.15.89:0/1006119935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c440b6a00 msgr2=0x7f2c44146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:42.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.468+0000 7f2c4898e640 1 --2- 172.21.15.89:0/1006119935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c440b6a00 0x7f2c44146d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2c4415d9e0 tx=0x7f2c3c02bd70 comp rx=0 tx=0).stop 2023-12-22T08:39:42.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.468+0000 7f2c4898e640 1 -- 172.21.15.89:0/1006119935 shutdown_connections 2023-12-22T08:39:42.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.468+0000 7f2c4898e640 1 --2- 172.21.15.89:0/1006119935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c440b3b20 0x7f2c441467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.468+0000 7f2c4898e640 1 --2- 172.21.15.89:0/1006119935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c440b6a00 0x7f2c44146d30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.468+0000 7f2c4898e640 1 -- 172.21.15.89:0/1006119935 >> 172.21.15.89:0/1006119935 conn(0x7f2c440d32c0 msgr2=0x7f2c440d36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:42.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.468+0000 7f2c4898e640 1 -- 172.21.15.89:0/1006119935 shutdown_connections 2023-12-22T08:39:42.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.468+0000 7f2c4898e640 1 -- 172.21.15.89:0/1006119935 wait complete. 2023-12-22T08:39:42.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.470+0000 7f2c4898e640 1 Processor -- start 2023-12-22T08:39:42.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.471+0000 7f2c4898e640 1 -- start start 2023-12-22T08:39:42.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.472+0000 7f2c4898e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c440b6620 0x7f2c44141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:42.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.472+0000 7f2c4898e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c440b6a00 0x7f2c4415e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:42.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.472+0000 7f2c4898e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c44145850 0x7f2c44145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:42.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.472+0000 7f2c4898e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44146240 con 0x7f2c44145850 2023-12-22T08:39:42.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.472+0000 7f2c4898e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4415ab50 con 0x7f2c440b6a00 2023-12-22T08:39:42.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.472+0000 7f2c4898e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440aad60 con 0x7f2c440b6620 2023-12-22T08:39:42.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.472+0000 7f2c3bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c440b6a00 0x7f2c4415e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:42.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.472+0000 7f2c437fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c440b6620 0x7f2c44141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:42.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.472+0000 7f2c3bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c440b6a00 0x7f2c4415e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34570/0 (socket says 172.21.15.89:34570) 2023-12-22T08:39:42.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.472+0000 7f2c3bfff640 1 -- 172.21.15.89:0/1877962161 learned_addr learned my addr 172.21.15.89:0/1877962161 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:42.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.472+0000 7f2c43fff640 1 --2- 172.21.15.89:0/1877962161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c44145850 0x7f2c44145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:42.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.473+0000 7f2c3bfff640 1 -- 172.21.15.89:0/1877962161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c440b6620 msgr2=0x7f2c44141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:42.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.473+0000 7f2c3bfff640 1 --2- 172.21.15.89:0/1877962161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c440b6620 0x7f2c44141960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.473+0000 7f2c3bfff640 1 -- 172.21.15.89:0/1877962161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c44145850 msgr2=0x7f2c44145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:42.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.473+0000 7f2c3bfff640 1 --2- 172.21.15.89:0/1877962161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c44145850 0x7f2c44145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.473+0000 7f2c3bfff640 1 -- 172.21.15.89:0/1877962161 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c009a70 con 0x7f2c440b6a00 2023-12-22T08:39:42.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.473+0000 7f2c437fe640 1 --2- 172.21.15.89:0/1877962161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c440b6620 0x7f2c44141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:39:42.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.473+0000 7f2c3bfff640 1 --2- 172.21.15.89:0/1877962161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c440b6a00 0x7f2c4415e1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00e900 tx=0x7f2c2c00edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:42.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.473+0000 7f2c40ff9640 1 -- 172.21.15.89:0/1877962161 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00ca00 con 0x7f2c440b6a00 2023-12-22T08:39:42.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.473+0000 7f2c40ff9640 1 -- 172.21.15.89:0/1877962161 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c00cb60 con 0x7f2c440b6a00 2023-12-22T08:39:42.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.473+0000 7f2c4898e640 1 -- 172.21.15.89:0/1877962161 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c440aa4c0 con 0x7f2c440b6a00 2023-12-22T08:39:42.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.473+0000 7f2c40ff9640 1 -- 172.21.15.89:0/1877962161 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c013470 con 0x7f2c440b6a00 2023-12-22T08:39:42.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.473+0000 7f2c4898e640 1 -- 172.21.15.89:0/1877962161 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c440aaa80 con 0x7f2c440b6a00 2023-12-22T08:39:42.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.474+0000 7f2c40ff9640 1 -- 172.21.15.89:0/1877962161 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2c2c005c90 con 0x7f2c440b6a00 2023-12-22T08:39:42.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.474+0000 7f2c40ff9640 1 -- 172.21.15.89:0/1877962161 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2c2c013910 con 0x7f2c440b6a00 2023-12-22T08:39:42.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.474+0000 7f2c4898e640 1 -- 172.21.15.89:0/1877962161 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c44061910 con 0x7f2c440b6a00 2023-12-22T08:39:42.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.477+0000 7f2c40ff9640 1 -- 172.21.15.89:0/1877962161 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f2c2c021060 con 0x7f2c440b6a00 2023-12-22T08:39:42.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.556+0000 7f2c4898e640 1 -- 172.21.15.89:0/1877962161 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f2c440b5d40 con 0x7f2c440b6a00 2023-12-22T08:39:42.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.566+0000 7f2c40ff9640 1 -- 172.21.15.89:0/1877962161 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2c2c017070 con 0x7f2c440b6a00 2023-12-22T08:39:42.569 INFO:teuthology.orchestra.run.smithi089.stdout:0 2023-12-22T08:39:42.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.567+0000 7f2c4898e640 1 -- 172.21.15.89:0/1877962161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c440b6a00 msgr2=0x7f2c4415e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:42.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.567+0000 7f2c4898e640 1 --2- 172.21.15.89:0/1877962161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c440b6a00 0x7f2c4415e1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00e900 tx=0x7f2c2c00edc0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.567+0000 7f2c4898e640 1 -- 172.21.15.89:0/1877962161 shutdown_connections 2023-12-22T08:39:42.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.567+0000 7f2c4898e640 1 --2- 172.21.15.89:0/1877962161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c44145850 0x7f2c44145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.567+0000 7f2c4898e640 1 --2- 172.21.15.89:0/1877962161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c440b6a00 0x7f2c4415e1e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.567+0000 7f2c4898e640 1 --2- 172.21.15.89:0/1877962161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c440b6620 0x7f2c44141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.567+0000 7f2c4898e640 1 -- 172.21.15.89:0/1877962161 >> 172.21.15.89:0/1877962161 conn(0x7f2c440d32c0 msgr2=0x7f2c440d36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:42.570 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.567+0000 7f2c4898e640 1 -- 172.21.15.89:0/1877962161 shutdown_connections 2023-12-22T08:39:42.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.568+0000 7f2c4898e640 1 -- 172.21.15.89:0/1877962161 wait complete. 2023-12-22T08:39:42.587 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-12-22T08:39:42.619 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:42.616+0000 7f01e820f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-22T08:39:42.637 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:42.635+0000 7f5305013040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-22T08:39:42.685 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:42.683+0000 7f01e820f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-22T08:39:42.701 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:42.699+0000 7f5305013040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-22T08:39:42.739 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:42.736+0000 7f01e820f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-22T08:39:42.755 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:42.752+0000 7f5305013040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-22T08:39:42.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.773+0000 7f949bd9f640 1 Processor -- start 2023-12-22T08:39:42.776 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.773+0000 7f949bd9f640 1 -- start start 2023-12-22T08:39:42.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.775+0000 7f949bd9f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 0x7f94940b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:42.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.775+0000 7f949bd9f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f94940b5900 0x7f94940b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:42.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.775+0000 7f949bd9f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94940b7e30 con 0x7f9494160ad0 2023-12-22T08:39:42.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.775+0000 7f949bd9f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94940d0f90 con 0x7f94940b5900 2023-12-22T08:39:42.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.775+0000 7f949bd9f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94940b8080 con 0x7f94940b9370 2023-12-22T08:39:42.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.776+0000 7f949933a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 0x7f94940b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:42.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.776+0000 7f949933a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 0x7f94940b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54776/0 (socket says 172.21.15.89:54776) 2023-12-22T08:39:42.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.776+0000 7f949933a640 1 -- 172.21.15.89:0/2534050450 learned_addr learned my addr 172.21.15.89:0/2534050450 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:42.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.776+0000 7f949a33c640 1 --2- 172.21.15.89:0/2534050450 >> v2:172.21.15.38:3300/0 conn(0x7f94940b5900 0x7f94940b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:42.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.776+0000 7f949933a640 1 -- 172.21.15.89:0/2534050450 >> v2:172.21.15.38:3300/0 conn(0x7f94940b5900 msgr2=0x7f94940b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:42.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.776+0000 7f949933a640 1 --2- 172.21.15.89:0/2534050450 >> v2:172.21.15.38:3300/0 conn(0x7f94940b5900 0x7f94940b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.776+0000 7f949933a640 1 -- 172.21.15.89:0/2534050450 >> v1:172.21.15.38:6789/0 conn(0x7f9494160ad0 legacy=0x7f94940b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:42.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.776+0000 7f949933a640 1 -- 172.21.15.89:0/2534050450 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94940b8360 con 0x7f94940b9370 2023-12-22T08:39:42.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.777+0000 7f949933a640 1 --2- 172.21.15.89:0/2534050450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 0x7f94940b3600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9484009870 tx=0x7f948402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e8808a7afc24299 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:42.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.777+0000 7f9498b39640 1 -- 172.21.15.89:0/2534050450 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484030840 con 0x7f94940b9370 2023-12-22T08:39:42.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.777+0000 7f9498b39640 1 -- 172.21.15.89:0/2534050450 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94840309a0 con 0x7f94940b9370 2023-12-22T08:39:42.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.777+0000 7f9498b39640 1 -- 172.21.15.89:0/2534050450 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484030d30 con 0x7f94940b9370 2023-12-22T08:39:42.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.778+0000 7f949bd9f640 1 -- 172.21.15.89:0/2534050450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 msgr2=0x7f94940b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:42.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.778+0000 7f949bd9f640 1 --2- 172.21.15.89:0/2534050450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 0x7f94940b3600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9484009870 tx=0x7f948402b980 comp rx=0 tx=0).stop 2023-12-22T08:39:42.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.778+0000 7f949bd9f640 1 -- 172.21.15.89:0/2534050450 shutdown_connections 2023-12-22T08:39:42.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.778+0000 7f949bd9f640 1 --2- 172.21.15.89:0/2534050450 >> v2:172.21.15.38:3300/0 conn(0x7f94940b5900 0x7f94940b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.778+0000 7f949bd9f640 1 --2- 172.21.15.89:0/2534050450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 0x7f94940b3600 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.778+0000 7f949bd9f640 1 -- 172.21.15.89:0/2534050450 >> 172.21.15.89:0/2534050450 conn(0x7f9494071670 msgr2=0x7f9494071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:42.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.778+0000 7f949bd9f640 1 -- 172.21.15.89:0/2534050450 shutdown_connections 2023-12-22T08:39:42.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.778+0000 7f949bd9f640 1 -- 172.21.15.89:0/2534050450 wait complete. 2023-12-22T08:39:42.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.780+0000 7f949bd9f640 1 Processor -- start 2023-12-22T08:39:42.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.780+0000 7f949bd9f640 1 -- start start 2023-12-22T08:39:42.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.781+0000 7f949bd9f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94940b5900 0x7f949415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:42.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.781+0000 7f949bd9f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 0x7f949414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:42.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.781+0000 7f949bd9f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494160ad0 0x7f949406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:42.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.781+0000 7f949bd9f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94941e79c0 con 0x7f9494160ad0 2023-12-22T08:39:42.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.781+0000 7f949bd9f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94941e6e40 con 0x7f94940b5900 2023-12-22T08:39:42.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.781+0000 7f949bd9f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94941e7120 con 0x7f94940b9370 2023-12-22T08:39:42.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.781+0000 7f949933a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 0x7f949414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:42.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.781+0000 7f9499b3b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94940b5900 0x7f949415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:42.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.782+0000 7f949933a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 0x7f949414ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54790/0 (socket says 172.21.15.89:54790) 2023-12-22T08:39:42.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.782+0000 7f949933a640 1 -- 172.21.15.89:0/948074702 learned_addr learned my addr 172.21.15.89:0/948074702 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:42.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.782+0000 7f949a33c640 1 --2- 172.21.15.89:0/948074702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494160ad0 0x7f949406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:42.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.782+0000 7f949933a640 1 -- 172.21.15.89:0/948074702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94940b5900 msgr2=0x7f949415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:42.785 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.782+0000 7f949933a640 1 --2- 172.21.15.89:0/948074702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94940b5900 0x7f949415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.782+0000 7f949933a640 1 -- 172.21.15.89:0/948074702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494160ad0 msgr2=0x7f949406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:42.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.782+0000 7f949933a640 1 --2- 172.21.15.89:0/948074702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494160ad0 0x7f949406ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.782+0000 7f949933a640 1 -- 172.21.15.89:0/948074702 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94840094d0 con 0x7f94940b9370 2023-12-22T08:39:42.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.782+0000 7f949933a640 1 --2- 172.21.15.89:0/948074702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 0x7f949414ee20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9484000c00 tx=0x7f9484004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:42.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.783+0000 7f948a7fc640 1 -- 172.21.15.89:0/948074702 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484039c90 con 0x7f94940b9370 2023-12-22T08:39:42.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.783+0000 7f948a7fc640 1 -- 172.21.15.89:0/948074702 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9484039df0 con 0x7f94940b9370 2023-12-22T08:39:42.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.783+0000 7f948a7fc640 1 -- 172.21.15.89:0/948074702 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484043640 con 0x7f94940b9370 2023-12-22T08:39:42.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.783+0000 7f949bd9f640 1 -- 172.21.15.89:0/948074702 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94941e7400 con 0x7f94940b9370 2023-12-22T08:39:42.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.783+0000 7f949bd9f640 1 -- 172.21.15.89:0/948074702 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9494157fd0 con 0x7f94940b9370 2023-12-22T08:39:42.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.783+0000 7f948a7fc640 1 -- 172.21.15.89:0/948074702 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9484043aa0 con 0x7f94940b9370 2023-12-22T08:39:42.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.783+0000 7f948a7fc640 1 -- 172.21.15.89:0/948074702 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f948403e070 con 0x7f94940b9370 2023-12-22T08:39:42.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.784+0000 7f949bd9f640 1 -- 172.21.15.89:0/948074702 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9494061910 con 0x7f94940b9370 2023-12-22T08:39:42.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.786+0000 7f948a7fc640 1 -- 172.21.15.89:0/948074702 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f9484034070 con 0x7f94940b9370 2023-12-22T08:39:42.811 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:42.808+0000 7f01e820f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-22T08:39:42.821 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:42.818+0000 7f5305013040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-22T08:39:42.862 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:42.860+0000 7f01e820f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-22T08:39:42.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.865+0000 7f949bd9f640 1 -- 172.21.15.89:0/948074702 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f949415f830 con 0x7f94940b9370 2023-12-22T08:39:42.873 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:42.871+0000 7f5305013040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-22T08:39:42.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.874+0000 7f948a7fc640 1 -- 172.21.15.89:0/948074702 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f948404d460 con 0x7f94940b9370 2023-12-22T08:39:42.876 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-22T08:39:42.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.875+0000 7f949bd9f640 1 -- 172.21.15.89:0/948074702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 msgr2=0x7f949414ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:42.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.875+0000 7f949bd9f640 1 --2- 172.21.15.89:0/948074702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 0x7f949414ee20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9484000c00 tx=0x7f9484004730 comp rx=0 tx=0).stop 2023-12-22T08:39:42.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.875+0000 7f949bd9f640 1 -- 172.21.15.89:0/948074702 shutdown_connections 2023-12-22T08:39:42.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.875+0000 7f949bd9f640 1 --2- 172.21.15.89:0/948074702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494160ad0 0x7f949406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.875+0000 7f949bd9f640 1 --2- 172.21.15.89:0/948074702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94940b9370 0x7f949414ee20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.875+0000 7f949bd9f640 1 --2- 172.21.15.89:0/948074702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94940b5900 0x7f949415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:42.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.875+0000 7f949bd9f640 1 -- 172.21.15.89:0/948074702 >> 172.21.15.89:0/948074702 conn(0x7f9494071670 msgr2=0x7f94940b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:42.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.875+0000 7f949bd9f640 1 -- 172.21.15.89:0/948074702 shutdown_connections 2023-12-22T08:39:42.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:42.875+0000 7f949bd9f640 1 -- 172.21.15.89:0/948074702 wait complete. 2023-12-22T08:39:42.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-12-22T08:39:42.981 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:42.978+0000 7f01e820f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-22T08:39:42.992 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:42.989+0000 7f5305013040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-22T08:39:43.065 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:43.063+0000 7f01e820f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-22T08:39:43.076 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:43.073+0000 7f5305013040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-22T08:39:43.122 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:43.119+0000 7f01e820f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-22T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.126+0000 7f709a3d9640 1 Processor -- start 2023-12-22T08:39:43.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.127+0000 7f709a3d9640 1 -- start start 2023-12-22T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.128+0000 7f709a3d9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 0x7f70940b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.128+0000 7f709a3d9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f70940b4610 0x7f70940b5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.128+0000 7f709a3d9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70940b7e30 con 0x7f70940b9370 2023-12-22T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.128+0000 7f709a3d9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70940d0f90 con 0x7f70940b4610 2023-12-22T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.128+0000 7f709a3d9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70940b8080 con 0x7f7094160ad0 2023-12-22T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.128+0000 7f7093fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 0x7f70940b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.129+0000 7f7093fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 0x7f70940b51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54794/0 (socket says 172.21.15.89:54794) 2023-12-22T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.129+0000 7f7093fff640 1 -- 172.21.15.89:0/1579582478 learned_addr learned my addr 172.21.15.89:0/1579582478 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.129+0000 7f7098976640 1 --2- 172.21.15.89:0/1579582478 >> v2:172.21.15.89:3300/0 conn(0x7f70940b4610 0x7f70940b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.129+0000 7f7093fff640 1 -- 172.21.15.89:0/1579582478 >> v2:172.21.15.89:3300/0 conn(0x7f70940b4610 msgr2=0x7f70940b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.129+0000 7f7093fff640 1 --2- 172.21.15.89:0/1579582478 >> v2:172.21.15.89:3300/0 conn(0x7f70940b4610 0x7f70940b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.129+0000 7f7093fff640 1 -- 172.21.15.89:0/1579582478 >> v1:172.21.15.89:6789/0 conn(0x7f70940b9370 legacy=0x7f70940d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.129+0000 7f7093fff640 1 -- 172.21.15.89:0/1579582478 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70940b8360 con 0x7f7094160ad0 2023-12-22T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.130+0000 7f7093fff640 1 --2- 172.21.15.89:0/1579582478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 0x7f70940b51f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7084009870 tx=0x7f708402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=757b5589926dd6ff server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.130+0000 7f70937fe640 1 -- 172.21.15.89:0/1579582478 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084030840 con 0x7f7094160ad0 2023-12-22T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.130+0000 7f70937fe640 1 -- 172.21.15.89:0/1579582478 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70840309a0 con 0x7f7094160ad0 2023-12-22T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.130+0000 7f70937fe640 1 -- 172.21.15.89:0/1579582478 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084030d30 con 0x7f7094160ad0 2023-12-22T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.131+0000 7f709a3d9640 1 -- 172.21.15.89:0/1579582478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 msgr2=0x7f70940b51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.131+0000 7f709a3d9640 1 --2- 172.21.15.89:0/1579582478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 0x7f70940b51f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7084009870 tx=0x7f708402b980 comp rx=0 tx=0).stop 2023-12-22T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.131+0000 7f709a3d9640 1 -- 172.21.15.89:0/1579582478 shutdown_connections 2023-12-22T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.131+0000 7f709a3d9640 1 --2- 172.21.15.89:0/1579582478 >> v2:172.21.15.89:3300/0 conn(0x7f70940b4610 0x7f70940b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.131+0000 7f709a3d9640 1 --2- 172.21.15.89:0/1579582478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 0x7f70940b51f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.131+0000 7f709a3d9640 1 -- 172.21.15.89:0/1579582478 >> 172.21.15.89:0/1579582478 conn(0x7f7094071670 msgr2=0x7f7094071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.131+0000 7f709a3d9640 1 -- 172.21.15.89:0/1579582478 shutdown_connections 2023-12-22T08:39:43.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.131+0000 7f709a3d9640 1 -- 172.21.15.89:0/1579582478 wait complete. 2023-12-22T08:39:43.135 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:43.130+0000 7f5305013040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-22T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.133+0000 7f709a3d9640 1 Processor -- start 2023-12-22T08:39:43.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.133+0000 7f709a3d9640 1 -- start start 2023-12-22T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.134+0000 7f709a3d9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70940b4610 0x7f709415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.134+0000 7f709a3d9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70940b9370 0x7f7094159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.134+0000 7f709a3d9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 0x7f7094152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.134+0000 7f709a3d9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70941539a0 con 0x7f70940b4610 2023-12-22T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.134+0000 7f709a3d9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70941f5ea0 con 0x7f70940b9370 2023-12-22T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.134+0000 7f709a3d9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7094153410 con 0x7f7094160ad0 2023-12-22T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.134+0000 7f7098976640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 0x7f7094152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.134+0000 7f708bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70940b9370 0x7f7094159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.134+0000 7f7098976640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 0x7f7094152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54806/0 (socket says 172.21.15.89:54806) 2023-12-22T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.134+0000 7f7098976640 1 -- 172.21.15.89:0/1528167287 learned_addr learned my addr 172.21.15.89:0/1528167287 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:43.138 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.134+0000 7f7093fff640 1 --2- 172.21.15.89:0/1528167287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70940b4610 0x7f709415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.135+0000 7f7098976640 1 -- 172.21.15.89:0/1528167287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70940b9370 msgr2=0x7f7094159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.135+0000 7f7098976640 1 --2- 172.21.15.89:0/1528167287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70940b9370 0x7f7094159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.135+0000 7f7098976640 1 -- 172.21.15.89:0/1528167287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70940b4610 msgr2=0x7f709415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.135+0000 7f7098976640 1 --2- 172.21.15.89:0/1528167287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70940b4610 0x7f709415fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.135+0000 7f7098976640 1 -- 172.21.15.89:0/1528167287 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70840094d0 con 0x7f7094160ad0 2023-12-22T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.135+0000 7f7098976640 1 --2- 172.21.15.89:0/1528167287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 0x7f7094152ed0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f708c007e30 tx=0x7f708c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.135+0000 7f70917fa640 1 -- 172.21.15.89:0/1528167287 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c014620 con 0x7f7094160ad0 2023-12-22T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.135+0000 7f70917fa640 1 -- 172.21.15.89:0/1528167287 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c00ee90 con 0x7f7094160ad0 2023-12-22T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.135+0000 7f70917fa640 1 -- 172.21.15.89:0/1528167287 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c0149c0 con 0x7f7094160ad0 2023-12-22T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.135+0000 7f709a3d9640 1 -- 172.21.15.89:0/1528167287 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70941f60f0 con 0x7f7094160ad0 2023-12-22T08:39:43.141 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.135+0000 7f709a3d9640 1 -- 172.21.15.89:0/1528167287 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70941f66b0 con 0x7f7094160ad0 2023-12-22T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.136+0000 7f70917fa640 1 -- 172.21.15.89:0/1528167287 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f708c01e460 con 0x7f7094160ad0 2023-12-22T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.136+0000 7f70917fa640 1 -- 172.21.15.89:0/1528167287 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f708c01eb30 con 0x7f7094160ad0 2023-12-22T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.136+0000 7f709a3d9640 1 -- 172.21.15.89:0/1528167287 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7094061910 con 0x7f7094160ad0 2023-12-22T08:39:43.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.139+0000 7f70917fa640 1 -- 172.21.15.89:0/1528167287 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f708c01e710 con 0x7f7094160ad0 2023-12-22T08:39:43.186 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:43.183+0000 7f01e820f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-22T08:39:43.196 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:43.193+0000 7f5305013040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-22T08:39:43.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.216+0000 7f709a3d9640 1 -- 172.21.15.89:0/1528167287 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f70940d1810 con 0x7f7094160ad0 2023-12-22T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.225+0000 7f70917fa640 1 -- 172.21.15.89:0/1528167287 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f708c02d0b0 con 0x7f7094160ad0 2023-12-22T08:39:43.227 INFO:teuthology.orchestra.run.smithi089.stdout:2 2023-12-22T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.226+0000 7f709a3d9640 1 -- 172.21.15.89:0/1528167287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 msgr2=0x7f7094152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.226+0000 7f709a3d9640 1 --2- 172.21.15.89:0/1528167287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 0x7f7094152ed0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f708c007e30 tx=0x7f708c00e4b0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.226+0000 7f709a3d9640 1 -- 172.21.15.89:0/1528167287 shutdown_connections 2023-12-22T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.226+0000 7f709a3d9640 1 --2- 172.21.15.89:0/1528167287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7094160ad0 0x7f7094152ed0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.226+0000 7f709a3d9640 1 --2- 172.21.15.89:0/1528167287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70940b9370 0x7f7094159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.226+0000 7f709a3d9640 1 --2- 172.21.15.89:0/1528167287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70940b4610 0x7f709415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.226+0000 7f709a3d9640 1 -- 172.21.15.89:0/1528167287 >> 172.21.15.89:0/1528167287 conn(0x7f7094071670 msgr2=0x7f70940d2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.226+0000 7f709a3d9640 1 -- 172.21.15.89:0/1528167287 shutdown_connections 2023-12-22T08:39:43.229 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.226+0000 7f709a3d9640 1 -- 172.21.15.89:0/1528167287 wait complete. 2023-12-22T08:39:43.243 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:43.241+0000 7f01e820f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-22T08:39:43.245 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-12-22T08:39:43.254 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:43.252+0000 7f5305013040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-22T08:39:43.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.480+0000 7fee57c51640 1 Processor -- start 2023-12-22T08:39:43.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.480+0000 7fee57c51640 1 -- start start 2023-12-22T08:39:43.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.481+0000 7fee57c51640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee500b9370 0x7fee500b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.482+0000 7fee57c51640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee500b7e30 con 0x7fee500b5900 2023-12-22T08:39:43.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.482+0000 7fee57c51640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee500d0f90 con 0x7fee50160ad0 2023-12-22T08:39:43.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.482+0000 7fee57c51640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee500b8080 con 0x7fee500b9370 2023-12-22T08:39:43.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.482+0000 7fee551ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee500b9370 0x7fee500b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:43.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.482+0000 7fee551ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee500b9370 0x7fee500b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54810/0 (socket says 172.21.15.89:54810) 2023-12-22T08:39:43.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.482+0000 7fee559ed640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fee50160ad0 0x7fee500b51f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:43066/0 (socket says 172.21.15.89:43066) 2023-12-22T08:39:43.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.482+0000 7fee551ec640 1 -- 172.21.15.89:0/3062888344 learned_addr learned my addr 172.21.15.89:0/3062888344 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:43.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.482+0000 7fee551ec640 1 -- 172.21.15.89:0/3062888344 >> v1:172.21.15.89:6789/0 conn(0x7fee50160ad0 legacy=0x7fee500b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.482+0000 7fee551ec640 1 -- 172.21.15.89:0/3062888344 >> v1:172.21.15.38:6789/0 conn(0x7fee500b5900 legacy=0x7fee500b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:43.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.482+0000 7fee551ec640 1 -- 172.21.15.89:0/3062888344 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500b8360 con 0x7fee500b9370 2023-12-22T08:39:43.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.483+0000 7fee551ec640 1 --2- 172.21.15.89:0/3062888344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee500b9370 0x7fee500b3600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fee400098a0 tx=0x7fee4002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71533d1fda58c7bd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:43.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.484+0000 7fee549eb640 1 -- 172.21.15.89:0/3062888344 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee40030840 con 0x7fee500b9370 2023-12-22T08:39:43.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.484+0000 7fee549eb640 1 -- 172.21.15.89:0/3062888344 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee400309a0 con 0x7fee500b9370 2023-12-22T08:39:43.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.484+0000 7fee549eb640 1 -- 172.21.15.89:0/3062888344 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee40030d30 con 0x7fee500b9370 2023-12-22T08:39:43.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.484+0000 7fee57c51640 1 -- 172.21.15.89:0/3062888344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee500b9370 msgr2=0x7fee500b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.484+0000 7fee57c51640 1 --2- 172.21.15.89:0/3062888344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee500b9370 0x7fee500b3600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fee400098a0 tx=0x7fee4002b980 comp rx=0 tx=0).stop 2023-12-22T08:39:43.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.484+0000 7fee57c51640 1 -- 172.21.15.89:0/3062888344 shutdown_connections 2023-12-22T08:39:43.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.484+0000 7fee57c51640 1 --2- 172.21.15.89:0/3062888344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee500b9370 0x7fee500b3600 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.484+0000 7fee57c51640 1 -- 172.21.15.89:0/3062888344 >> 172.21.15.89:0/3062888344 conn(0x7fee50071670 msgr2=0x7fee50071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:43.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.485+0000 7fee57c51640 1 -- 172.21.15.89:0/3062888344 shutdown_connections 2023-12-22T08:39:43.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.485+0000 7fee57c51640 1 -- 172.21.15.89:0/3062888344 wait complete. 2023-12-22T08:39:43.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.486+0000 7fee57c51640 1 Processor -- start 2023-12-22T08:39:43.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.486+0000 7fee57c51640 1 -- start start 2023-12-22T08:39:43.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.487+0000 7fee57c51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee500b5900 0x7fee500b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.487+0000 7fee57c51640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee500b9370 0x7fee500b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.487+0000 7fee57c51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee50160ad0 0x7fee50157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.487+0000 7fee57c51640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50157d70 con 0x7fee50160ad0 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.487+0000 7fee57c51640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee500b2540 con 0x7fee500b5900 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.487+0000 7fee57c51640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee500b2770 con 0x7fee500b9370 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.487+0000 7fee559ed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee500b5900 0x7fee500b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.487+0000 7fee559ed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee500b5900 0x7fee500b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34594/0 (socket says 172.21.15.89:34594) 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.487+0000 7fee559ed640 1 -- 172.21.15.89:0/3877159690 learned_addr learned my addr 172.21.15.89:0/3877159690 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.487+0000 7fee551ec640 1 --2- 172.21.15.89:0/3877159690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee500b9370 0x7fee500b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.488+0000 7fee561ee640 1 --2- 172.21.15.89:0/3877159690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee50160ad0 0x7fee50157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.488+0000 7fee559ed640 1 -- 172.21.15.89:0/3877159690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee500b9370 msgr2=0x7fee500b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.488+0000 7fee559ed640 1 --2- 172.21.15.89:0/3877159690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee500b9370 0x7fee500b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.488+0000 7fee559ed640 1 -- 172.21.15.89:0/3877159690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee50160ad0 msgr2=0x7fee50157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.488+0000 7fee559ed640 1 --2- 172.21.15.89:0/3877159690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee50160ad0 0x7fee50157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.488+0000 7fee559ed640 1 -- 172.21.15.89:0/3877159690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee400094d0 con 0x7fee500b5900 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.488+0000 7fee551ec640 1 --2- 172.21.15.89:0/3877159690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee500b9370 0x7fee500b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.488+0000 7fee561ee640 1 --2- 172.21.15.89:0/3877159690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee50160ad0 0x7fee50157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:39:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.488+0000 7fee559ed640 1 --2- 172.21.15.89:0/3877159690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee500b5900 0x7fee500b1000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00c410 tx=0x7fee4c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.488+0000 7fee467fc640 1 -- 172.21.15.89:0/3877159690 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0074e0 con 0x7fee500b5900 2023-12-22T08:39:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.488+0000 7fee467fc640 1 -- 172.21.15.89:0/3877159690 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c007640 con 0x7fee500b5900 2023-12-22T08:39:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.488+0000 7fee467fc640 1 -- 172.21.15.89:0/3877159690 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0049e0 con 0x7fee500b5900 2023-12-22T08:39:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.488+0000 7fee57c51640 1 -- 172.21.15.89:0/3877159690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee500ac9f0 con 0x7fee500b5900 2023-12-22T08:39:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.489+0000 7fee57c51640 1 -- 172.21.15.89:0/3877159690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee500acfb0 con 0x7fee500b5900 2023-12-22T08:39:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.489+0000 7fee467fc640 1 -- 172.21.15.89:0/3877159690 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fee4c013400 con 0x7fee500b5900 2023-12-22T08:39:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.489+0000 7fee467fc640 1 -- 172.21.15.89:0/3877159690 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fee4c013b40 con 0x7fee500b5900 2023-12-22T08:39:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.490+0000 7fee57c51640 1 -- 172.21.15.89:0/3877159690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee50061910 con 0x7fee500b5900 2023-12-22T08:39:43.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.492+0000 7fee467fc640 1 -- 172.21.15.89:0/3877159690 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fee4c013d80 con 0x7fee500b5900 2023-12-22T08:39:43.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.570+0000 7fee57c51640 1 -- 172.21.15.89:0/3877159690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7fee500b2cf0 con 0x7fee500b5900 2023-12-22T08:39:43.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.577+0000 7fee467fc640 1 -- 172.21.15.89:0/3877159690 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fee4c013780 con 0x7fee500b5900 2023-12-22T08:39:43.580 INFO:teuthology.orchestra.run.smithi089.stdout:3 2023-12-22T08:39:43.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.578+0000 7fee57c51640 1 -- 172.21.15.89:0/3877159690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee500b5900 msgr2=0x7fee500b1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.578+0000 7fee57c51640 1 --2- 172.21.15.89:0/3877159690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee500b5900 0x7fee500b1000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00c410 tx=0x7fee4c00c8d0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.578+0000 7fee57c51640 1 -- 172.21.15.89:0/3877159690 shutdown_connections 2023-12-22T08:39:43.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.578+0000 7fee57c51640 1 --2- 172.21.15.89:0/3877159690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee50160ad0 0x7fee50157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.579+0000 7fee57c51640 1 --2- 172.21.15.89:0/3877159690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee500b9370 0x7fee500b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.579+0000 7fee57c51640 1 --2- 172.21.15.89:0/3877159690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee500b5900 0x7fee500b1000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.579+0000 7fee57c51640 1 -- 172.21.15.89:0/3877159690 >> 172.21.15.89:0/3877159690 conn(0x7fee50071670 msgr2=0x7fee5015f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:43.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.579+0000 7fee57c51640 1 -- 172.21.15.89:0/3877159690 shutdown_connections 2023-12-22T08:39:43.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.579+0000 7fee57c51640 1 -- 172.21.15.89:0/3877159690 wait complete. 2023-12-22T08:39:43.596 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-12-22T08:39:43.719 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:43.716+0000 7f01e820f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-22T08:39:43.729 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:43.726+0000 7f5305013040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-22T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.788+0000 7f993a095640 1 Processor -- start 2023-12-22T08:39:43.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.789+0000 7f993a095640 1 -- start start 2023-12-22T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.790+0000 7f993a095640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99340b3b20 0x7f99341467f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.793 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.790+0000 7f993a095640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99340b6a00 0x7f9934146d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.790+0000 7f993a095640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99340b8e60 con 0x7f99340b6620 2023-12-22T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.790+0000 7f993a095640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99340b4430 con 0x7f99340b6a00 2023-12-22T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.790+0000 7f993a095640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99340b4710 con 0x7f99340b3b20 2023-12-22T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.791+0000 7f9939093640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f99340b6620 0x7f99340b8750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:43080/0 (socket says 172.21.15.89:43080) 2023-12-22T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.791+0000 7f9939093640 1 -- 172.21.15.89:0/2381029956 learned_addr learned my addr 172.21.15.89:0/2381029956 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-22T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.791+0000 7f9938892640 1 --2- 172.21.15.89:0/2381029956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99340b3b20 0x7f99341467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.791+0000 7f9939894640 1 --2- 172.21.15.89:0/2381029956 >> v2:172.21.15.38:3300/0 conn(0x7f99340b6a00 0x7f9934146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.791+0000 7f9938892640 1 -- 172.21.15.89:0/2381029956 >> v2:172.21.15.38:3300/0 conn(0x7f99340b6a00 msgr2=0x7f9934146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.791+0000 7f9938892640 1 --2- 172.21.15.89:0/2381029956 >> v2:172.21.15.38:3300/0 conn(0x7f99340b6a00 0x7f9934146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.791+0000 7f9938892640 1 -- 172.21.15.89:0/2381029956 >> v1:172.21.15.89:6789/0 conn(0x7f99340b6620 legacy=0x7f99340b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.791+0000 7f9938892640 1 -- 172.21.15.89:0/2381029956 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99340b49f0 con 0x7f99340b3b20 2023-12-22T08:39:43.794 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.791+0000 7f992bfff640 1 -- 172.21.15.89:0/2381029956 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089820222 0 0) 0x7f99340b8e60 con 0x7f99340b6620 2023-12-22T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.793+0000 7f9938892640 1 --2- 172.21.15.89:0/2381029956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99340b3b20 0x7f99341467f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f99240097a0 tx=0x7f992402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1b240a5949e23cd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.793+0000 7f992bfff640 1 -- 172.21.15.89:0/2381029956 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992402e070 con 0x7f99340b3b20 2023-12-22T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.793+0000 7f992bfff640 1 -- 172.21.15.89:0/2381029956 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99240315a0 con 0x7f99340b3b20 2023-12-22T08:39:43.795 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.793+0000 7f992bfff640 1 -- 172.21.15.89:0/2381029956 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924031930 con 0x7f99340b3b20 2023-12-22T08:39:43.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.793+0000 7f993a095640 1 -- 172.21.15.89:0/2381029956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99340b3b20 msgr2=0x7f99341467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.793+0000 7f993a095640 1 --2- 172.21.15.89:0/2381029956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99340b3b20 0x7f99341467f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f99240097a0 tx=0x7f992402b840 comp rx=0 tx=0).stop 2023-12-22T08:39:43.796 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.794+0000 7f993a095640 1 -- 172.21.15.89:0/2381029956 shutdown_connections 2023-12-22T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.794+0000 7f993a095640 1 --2- 172.21.15.89:0/2381029956 >> v2:172.21.15.38:3300/0 conn(0x7f99340b6a00 0x7f9934146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.794+0000 7f993a095640 1 --2- 172.21.15.89:0/2381029956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99340b3b20 0x7f99341467f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.794+0000 7f993a095640 1 -- 172.21.15.89:0/2381029956 >> 172.21.15.89:0/2381029956 conn(0x7f99340d32c0 msgr2=0x7f99340d36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.794+0000 7f993a095640 1 -- 172.21.15.89:0/2381029956 shutdown_connections 2023-12-22T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.794+0000 7f993a095640 1 -- 172.21.15.89:0/2381029956 wait complete. 2023-12-22T08:39:43.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.795+0000 7f993a095640 1 Processor -- start 2023-12-22T08:39:43.798 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.795+0000 7f993a095640 1 -- start start 2023-12-22T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.796+0000 7f993a095640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99340b6620 0x7f9934156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.796+0000 7f993a095640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99340b6a00 0x7f9934144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.796+0000 7f993a095640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9934145ef0 0x7f993413e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.796+0000 7f993a095640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993413e460 con 0x7f99340b6620 2023-12-22T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.796+0000 7f993a095640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9934156e70 con 0x7f9934145ef0 2023-12-22T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.796+0000 7f993a095640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993413d7e0 con 0x7f99340b6a00 2023-12-22T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.797+0000 7f9939894640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9934145ef0 0x7f993413e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.797+0000 7f9938892640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99340b6a00 0x7f9934144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.797+0000 7f9939894640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9934145ef0 0x7f993413e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34598/0 (socket says 172.21.15.89:34598) 2023-12-22T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.797+0000 7f9939894640 1 -- 172.21.15.89:0/267078623 learned_addr learned my addr 172.21.15.89:0/267078623 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.797+0000 7f9938892640 1 -- 172.21.15.89:0/267078623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9934145ef0 msgr2=0x7f993413e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.797+0000 7f9938892640 1 --2- 172.21.15.89:0/267078623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9934145ef0 0x7f993413e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.800 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.797+0000 7f9938892640 1 -- 172.21.15.89:0/267078623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99340b6620 msgr2=0x7f9934156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.797+0000 7f9938892640 1 --2- 172.21.15.89:0/267078623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99340b6620 0x7f9934156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.797+0000 7f9938892640 1 -- 172.21.15.89:0/267078623 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9924009400 con 0x7f99340b6a00 2023-12-22T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.797+0000 7f9939894640 1 --2- 172.21.15.89:0/267078623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9934145ef0 0x7f993413e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:39:43.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.797+0000 7f9938892640 1 --2- 172.21.15.89:0/267078623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99340b6a00 0x7f9934144990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f99340b4850 tx=0x7f99240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.798+0000 7f9929ffb640 1 -- 172.21.15.89:0/267078623 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924032840 con 0x7f99340b6a00 2023-12-22T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.798+0000 7f9929ffb640 1 -- 172.21.15.89:0/267078623 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99240329c0 con 0x7f99340b6a00 2023-12-22T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.798+0000 7f9929ffb640 1 -- 172.21.15.89:0/267078623 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924032d70 con 0x7f99340b6a00 2023-12-22T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.798+0000 7f993a095640 1 -- 172.21.15.89:0/267078623 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993413dac0 con 0x7f99340b6a00 2023-12-22T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.798+0000 7f993a095640 1 -- 172.21.15.89:0/267078623 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993413e080 con 0x7f99340b6a00 2023-12-22T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.798+0000 7f9929ffb640 1 -- 172.21.15.89:0/267078623 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9924045740 con 0x7f99340b6a00 2023-12-22T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.798+0000 7f9929ffb640 1 -- 172.21.15.89:0/267078623 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f992403b710 con 0x7f99340b6a00 2023-12-22T08:39:43.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.799+0000 7f993a095640 1 -- 172.21.15.89:0/267078623 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993413e210 con 0x7f99340b6a00 2023-12-22T08:39:43.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.801+0000 7f9929ffb640 1 -- 172.21.15.89:0/267078623 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f99240459f0 con 0x7f99340b6a00 2023-12-22T08:39:43.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.879+0000 7f993a095640 1 -- 172.21.15.89:0/267078623 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7f9934061910 con 0x7f99340b6a00 2023-12-22T08:39:43.886 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:43.884+0000 7f01e820f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-22T08:39:43.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.886+0000 7f9929ffb640 1 -- 172.21.15.89:0/267078623 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9924045b90 con 0x7f99340b6a00 2023-12-22T08:39:43.889 INFO:teuthology.orchestra.run.smithi089.stdout:4 2023-12-22T08:39:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.887+0000 7f993a095640 1 -- 172.21.15.89:0/267078623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99340b6a00 msgr2=0x7f9934144990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.887+0000 7f993a095640 1 --2- 172.21.15.89:0/267078623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99340b6a00 0x7f9934144990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f99340b4850 tx=0x7f99240046c0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.887+0000 7f993a095640 1 -- 172.21.15.89:0/267078623 shutdown_connections 2023-12-22T08:39:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.888+0000 7f993a095640 1 --2- 172.21.15.89:0/267078623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9934145ef0 0x7f993413e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.888+0000 7f993a095640 1 --2- 172.21.15.89:0/267078623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99340b6a00 0x7f9934144990 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.888+0000 7f993a095640 1 --2- 172.21.15.89:0/267078623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99340b6620 0x7f9934156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:43.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.888+0000 7f993a095640 1 -- 172.21.15.89:0/267078623 >> 172.21.15.89:0/267078623 conn(0x7f99340d32c0 msgr2=0x7f99340d36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:43.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.888+0000 7f993a095640 1 -- 172.21.15.89:0/267078623 shutdown_connections 2023-12-22T08:39:43.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:43.888+0000 7f993a095640 1 -- 172.21.15.89:0/267078623 wait complete. 2023-12-22T08:39:43.899 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:43.896+0000 7f5305013040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-22T08:39:43.906 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-12-22T08:39:44.029 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:44.027+0000 7f5305013040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-22T08:39:44.038 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:44.035+0000 7f01e820f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-22T08:39:44.085 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:44.082+0000 7f5305013040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-22T08:39:44.092 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:44.090+0000 7f01e820f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-22T08:39:44.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.094+0000 7fabd568f640 1 Processor -- start 2023-12-22T08:39:44.097 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.094+0000 7fabd568f640 1 -- start start 2023-12-22T08:39:44.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.096+0000 7fabd568f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fabd0160ad0 0x7fabd00b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.099 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.096+0000 7fabd568f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 0x7fabd00b5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.096+0000 7fabd568f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd00b7e30 con 0x7fabd00d1420 2023-12-22T08:39:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.096+0000 7fabd568f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd00d0f90 con 0x7fabd0160ad0 2023-12-22T08:39:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.096+0000 7fabd568f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00b8080 con 0x7fabd00b9370 2023-12-22T08:39:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.097+0000 7fabc7fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 0x7fabd00b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.097+0000 7fabc7fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 0x7fabd00b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54854/0 (socket says 172.21.15.89:54854) 2023-12-22T08:39:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.097+0000 7fabc7fff640 1 -- 172.21.15.89:0/3269617300 learned_addr learned my addr 172.21.15.89:0/3269617300 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.097+0000 7fabceffd640 1 --2- 172.21.15.89:0/3269617300 >> v2:172.21.15.38:3300/0 conn(0x7fabd0160ad0 0x7fabd00b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.097+0000 7fabc7fff640 1 -- 172.21.15.89:0/3269617300 >> v2:172.21.15.38:3300/0 conn(0x7fabd0160ad0 msgr2=0x7fabd00b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.097+0000 7fabc7fff640 1 --2- 172.21.15.89:0/3269617300 >> v2:172.21.15.38:3300/0 conn(0x7fabd0160ad0 0x7fabd00b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.097+0000 7fabc7fff640 1 -- 172.21.15.89:0/3269617300 >> v1:172.21.15.38:6789/0 conn(0x7fabd00d1420 legacy=0x7fabd00d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.097+0000 7fabc7fff640 1 -- 172.21.15.89:0/3269617300 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd00b8360 con 0x7fabd00b9370 2023-12-22T08:39:44.100 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.097+0000 7fabceffd640 1 --2- 172.21.15.89:0/3269617300 >> v2:172.21.15.38:3300/0 conn(0x7fabd0160ad0 0x7fabd00b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:39:44.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.098+0000 7fabc7fff640 1 --2- 172.21.15.89:0/3269617300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 0x7fabd00b5730 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009870 tx=0x7fabb802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=669944ab16730bea server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:44.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.099+0000 7fabce7fc640 1 -- 172.21.15.89:0/3269617300 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8031640 con 0x7fabd00b9370 2023-12-22T08:39:44.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.099+0000 7fabce7fc640 1 -- 172.21.15.89:0/3269617300 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb80317a0 con 0x7fabd00b9370 2023-12-22T08:39:44.101 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.099+0000 7fabce7fc640 1 -- 172.21.15.89:0/3269617300 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8031b30 con 0x7fabd00b9370 2023-12-22T08:39:44.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.099+0000 7fabd568f640 1 -- 172.21.15.89:0/3269617300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 msgr2=0x7fabd00b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.099+0000 7fabd568f640 1 --2- 172.21.15.89:0/3269617300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 0x7fabd00b5730 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009870 tx=0x7fabb802b8f0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.099+0000 7fabd568f640 1 -- 172.21.15.89:0/3269617300 shutdown_connections 2023-12-22T08:39:44.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.099+0000 7fabd568f640 1 --2- 172.21.15.89:0/3269617300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 0x7fabd00b5730 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.102 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.099+0000 7fabd568f640 1 --2- 172.21.15.89:0/3269617300 >> v2:172.21.15.38:3300/0 conn(0x7fabd0160ad0 0x7fabd00b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.099+0000 7fabd568f640 1 -- 172.21.15.89:0/3269617300 >> 172.21.15.89:0/3269617300 conn(0x7fabd0071670 msgr2=0x7fabd0071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:44.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.100+0000 7fabd568f640 1 -- 172.21.15.89:0/3269617300 shutdown_connections 2023-12-22T08:39:44.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.100+0000 7fabd568f640 1 -- 172.21.15.89:0/3269617300 wait complete. 2023-12-22T08:39:44.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.101+0000 7fabd568f640 1 Processor -- start 2023-12-22T08:39:44.104 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.101+0000 7fabd568f640 1 -- start start 2023-12-22T08:39:44.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.102+0000 7fabd568f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 0x7fabd01580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.102+0000 7fabd568f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd00d1420 0x7fabd0145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.102+0000 7fabd568f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd0160ad0 0x7fabd0155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.102+0000 7fabd568f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0155700 con 0x7fabd0160ad0 2023-12-22T08:39:44.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.102+0000 7fabd568f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0156c70 con 0x7fabd00d1420 2023-12-22T08:39:44.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.102+0000 7fabd568f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0155140 con 0x7fabd00b9370 2023-12-22T08:39:44.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.103+0000 7fabceffd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 0x7fabd01580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.103+0000 7fabc7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd00d1420 0x7fabd0145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.103+0000 7fabceffd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 0x7fabd01580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54862/0 (socket says 172.21.15.89:54862) 2023-12-22T08:39:44.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.103+0000 7fabceffd640 1 -- 172.21.15.89:0/331010230 learned_addr learned my addr 172.21.15.89:0/331010230 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:44.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.103+0000 7fabcf7fe640 1 --2- 172.21.15.89:0/331010230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd0160ad0 0x7fabd0155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.103+0000 7fabceffd640 1 -- 172.21.15.89:0/331010230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd00d1420 msgr2=0x7fabd0145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.103+0000 7fabceffd640 1 --2- 172.21.15.89:0/331010230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd00d1420 0x7fabd0145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.103+0000 7fabceffd640 1 -- 172.21.15.89:0/331010230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd0160ad0 msgr2=0x7fabd0155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.103+0000 7fabceffd640 1 --2- 172.21.15.89:0/331010230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd0160ad0 0x7fabd0155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.103+0000 7fabceffd640 1 -- 172.21.15.89:0/331010230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb80094d0 con 0x7fabd00b9370 2023-12-22T08:39:44.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.103+0000 7fabc7fff640 1 --2- 172.21.15.89:0/331010230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd00d1420 0x7fabd0145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:39:44.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.103+0000 7fabceffd640 1 --2- 172.21.15.89:0/331010230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 0x7fabd01580c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fabc000d800 tx=0x7fabc000dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:44.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.104+0000 7fabc77fe640 1 -- 172.21.15.89:0/331010230 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0004030 con 0x7fabd00b9370 2023-12-22T08:39:44.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.104+0000 7fabc77fe640 1 -- 172.21.15.89:0/331010230 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc0004190 con 0x7fabd00b9370 2023-12-22T08:39:44.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.104+0000 7fabc77fe640 1 -- 172.21.15.89:0/331010230 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0004520 con 0x7fabd00b9370 2023-12-22T08:39:44.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.104+0000 7fabd568f640 1 -- 172.21.15.89:0/331010230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd0155420 con 0x7fabd00b9370 2023-12-22T08:39:44.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.104+0000 7fabd568f640 1 -- 172.21.15.89:0/331010230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd006cf00 con 0x7fabd00b9370 2023-12-22T08:39:44.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.104+0000 7fabc77fe640 1 -- 172.21.15.89:0/331010230 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fabc00099a0 con 0x7fabd00b9370 2023-12-22T08:39:44.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.104+0000 7fabc77fe640 1 -- 172.21.15.89:0/331010230 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fabc0003ca0 con 0x7fabd00b9370 2023-12-22T08:39:44.109 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.105+0000 7fabd568f640 1 -- 172.21.15.89:0/331010230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd006ca50 con 0x7fabd00b9370 2023-12-22T08:39:44.111 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.109+0000 7fabc77fe640 1 -- 172.21.15.89:0/331010230 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fabc0009c50 con 0x7fabd00b9370 2023-12-22T08:39:44.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.188+0000 7fabd568f640 1 -- 172.21.15.89:0/331010230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7fabd0061910 con 0x7fabd00b9370 2023-12-22T08:39:44.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.196+0000 7fabc77fe640 1 -- 172.21.15.89:0/331010230 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fabc0003610 con 0x7fabd00b9370 2023-12-22T08:39:44.199 INFO:teuthology.orchestra.run.smithi089.stdout:5 2023-12-22T08:39:44.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.197+0000 7fabd568f640 1 -- 172.21.15.89:0/331010230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 msgr2=0x7fabd01580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.197+0000 7fabd568f640 1 --2- 172.21.15.89:0/331010230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 0x7fabd01580c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fabc000d800 tx=0x7fabc000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.198+0000 7fabd568f640 1 -- 172.21.15.89:0/331010230 shutdown_connections 2023-12-22T08:39:44.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.198+0000 7fabd568f640 1 --2- 172.21.15.89:0/331010230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd0160ad0 0x7fabd0155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.198+0000 7fabd568f640 1 --2- 172.21.15.89:0/331010230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd00d1420 0x7fabd0145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.198+0000 7fabd568f640 1 --2- 172.21.15.89:0/331010230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd00b9370 0x7fabd01580c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.198+0000 7fabd568f640 1 -- 172.21.15.89:0/331010230 >> 172.21.15.89:0/331010230 conn(0x7fabd0071670 msgr2=0x7fabd0151310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:44.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.198+0000 7fabd568f640 1 -- 172.21.15.89:0/331010230 shutdown_connections 2023-12-22T08:39:44.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.198+0000 7fabd568f640 1 -- 172.21.15.89:0/331010230 wait complete. 2023-12-22T08:39:44.201 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:44.198+0000 7f5305013040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-22T08:39:44.208 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:44.206+0000 7f01e820f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-22T08:39:44.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-12-22T08:39:44.317 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:44.314+0000 7f5305013040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-22T08:39:44.326 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:44.324+0000 7f01e820f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-22T08:39:44.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.408+0000 7f2d1c9ae640 1 Processor -- start 2023-12-22T08:39:44.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.408+0000 7f2d1c9ae640 1 -- start start 2023-12-22T08:39:44.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.409+0000 7f2d1c9ae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d1806bc10 0x7f2d1806fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.410+0000 7f2d1c9ae640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d180cc060 con 0x7f2d180d0440 2023-12-22T08:39:44.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.410+0000 7f2d1c9ae640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d180cc340 con 0x7f2d1806bff0 2023-12-22T08:39:44.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.410+0000 7f2d1c9ae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180cc620 con 0x7f2d1806bc10 2023-12-22T08:39:44.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.410+0000 7f2d177fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d1806bc10 0x7f2d1806fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.410+0000 7f2d16ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2d1806bff0 0x7f2d1815eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:43094/0 (socket says 172.21.15.89:43094) 2023-12-22T08:39:44.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.410+0000 7f2d16ffd640 1 -- 172.21.15.89:0/3670817952 learned_addr learned my addr 172.21.15.89:0/3670817952 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-22T08:39:44.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.410+0000 7f2d177fe640 1 -- 172.21.15.89:0/3670817952 >> v1:172.21.15.89:6789/0 conn(0x7f2d1806bff0 legacy=0x7f2d1815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.410+0000 7f2d177fe640 1 -- 172.21.15.89:0/3670817952 >> v1:172.21.15.38:6789/0 conn(0x7f2d180d0440 legacy=0x7f2d180d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:44.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.410+0000 7f2d167fc640 1 -- 172.21.15.89:0/3670817952 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837704688 0 0) 0x7f2d180cc340 con 0x7f2d1806bff0 2023-12-22T08:39:44.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.411+0000 7f2d177fe640 1 -- 172.21.15.89:0/3670817952 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180cc900 con 0x7f2d1806bc10 2023-12-22T08:39:44.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.412+0000 7f2d177fe640 1 --2- 172.21.15.89:0/3670817952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d1806bc10 0x7f2d1806fc60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d080097d0 tx=0x7f2d0802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=958d1e7ef16832a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:44.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.412+0000 7f2d167fc640 1 -- 172.21.15.89:0/3670817952 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08031890 con 0x7f2d1806bc10 2023-12-22T08:39:44.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.412+0000 7f2d167fc640 1 -- 172.21.15.89:0/3670817952 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d080319f0 con 0x7f2d1806bc10 2023-12-22T08:39:44.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.412+0000 7f2d167fc640 1 -- 172.21.15.89:0/3670817952 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08031d80 con 0x7f2d1806bc10 2023-12-22T08:39:44.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.413+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/3670817952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d1806bc10 msgr2=0x7f2d1806fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.413+0000 7f2d1c9ae640 1 --2- 172.21.15.89:0/3670817952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d1806bc10 0x7f2d1806fc60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d080097d0 tx=0x7f2d0802b930 comp rx=0 tx=0).stop 2023-12-22T08:39:44.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.413+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/3670817952 shutdown_connections 2023-12-22T08:39:44.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.413+0000 7f2d1c9ae640 1 --2- 172.21.15.89:0/3670817952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d1806bc10 0x7f2d1806fc60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.413+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/3670817952 >> 172.21.15.89:0/3670817952 conn(0x7f2d1806ab10 msgr2=0x7f2d18060720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:44.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.413+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/3670817952 shutdown_connections 2023-12-22T08:39:44.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.413+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/3670817952 wait complete. 2023-12-22T08:39:44.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.415+0000 7f2d1c9ae640 1 Processor -- start 2023-12-22T08:39:44.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.415+0000 7f2d1c9ae640 1 -- start start 2023-12-22T08:39:44.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d1c9ae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d1806bc10 0x7f2d181591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d1c9ae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d1806bff0 0x7f2d181439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d1c9ae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d180d0440 0x7f2d1815ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d1c9ae640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18158da0 con 0x7f2d1806bc10 2023-12-22T08:39:44.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d1c9ae640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18143f00 con 0x7f2d180d0440 2023-12-22T08:39:44.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d1c9ae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18158160 con 0x7f2d1806bff0 2023-12-22T08:39:44.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d16ffd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d1806bff0 0x7f2d181439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d17fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d180d0440 0x7f2d1815ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d16ffd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d1806bff0 0x7f2d181439c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54876/0 (socket says 172.21.15.89:54876) 2023-12-22T08:39:44.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d16ffd640 1 -- 172.21.15.89:0/1571389133 learned_addr learned my addr 172.21.15.89:0/1571389133 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:44.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d177fe640 1 --2- 172.21.15.89:0/1571389133 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d1806bc10 0x7f2d181591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d16ffd640 1 -- 172.21.15.89:0/1571389133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d180d0440 msgr2=0x7f2d1815ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d16ffd640 1 --2- 172.21.15.89:0/1571389133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d180d0440 0x7f2d1815ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d16ffd640 1 -- 172.21.15.89:0/1571389133 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d1806bc10 msgr2=0x7f2d181591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d16ffd640 1 --2- 172.21.15.89:0/1571389133 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d1806bc10 0x7f2d181591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.416+0000 7f2d16ffd640 1 -- 172.21.15.89:0/1571389133 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d08009400 con 0x7f2d1806bff0 2023-12-22T08:39:44.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.417+0000 7f2d16ffd640 1 --2- 172.21.15.89:0/1571389133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d1806bff0 0x7f2d181439c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00c4d0 tx=0x7f2d0c00c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:44.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.417+0000 7f2cfffff640 1 -- 172.21.15.89:0/1571389133 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c0074e0 con 0x7f2d1806bff0 2023-12-22T08:39:44.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.417+0000 7f2cfffff640 1 -- 172.21.15.89:0/1571389133 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c007640 con 0x7f2d1806bff0 2023-12-22T08:39:44.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.417+0000 7f2cfffff640 1 -- 172.21.15.89:0/1571389133 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c004a20 con 0x7f2d1806bff0 2023-12-22T08:39:44.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.417+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/1571389133 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d18158400 con 0x7f2d1806bff0 2023-12-22T08:39:44.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.417+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/1571389133 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d181589c0 con 0x7f2d1806bff0 2023-12-22T08:39:44.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.417+0000 7f2cfffff640 1 -- 172.21.15.89:0/1571389133 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2d0c012400 con 0x7f2d1806bff0 2023-12-22T08:39:44.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.418+0000 7f2cfffff640 1 -- 172.21.15.89:0/1571389133 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f2d0c012ca0 con 0x7f2d1806bff0 2023-12-22T08:39:44.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.418+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/1571389133 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d18158ee0 con 0x7f2d1806bff0 2023-12-22T08:39:44.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.421+0000 7f2cfffff640 1 -- 172.21.15.89:0/1571389133 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f2d18158ee0 con 0x7f2d1806bff0 2023-12-22T08:39:44.484 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:44.480+0000 7f5305013040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-22T08:39:44.493 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:44.490+0000 7f01e820f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-22T08:39:44.500 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.498+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/1571389133 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7f2d18061910 con 0x7f2d1806bff0 2023-12-22T08:39:44.508 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.505+0000 7f2cfffff640 1 -- 172.21.15.89:0/1571389133 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d0c021060 con 0x7f2d1806bff0 2023-12-22T08:39:44.508 INFO:teuthology.orchestra.run.smithi089.stdout:6 2023-12-22T08:39:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.506+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/1571389133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d1806bff0 msgr2=0x7f2d181439c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.506+0000 7f2d1c9ae640 1 --2- 172.21.15.89:0/1571389133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d1806bff0 0x7f2d181439c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00c4d0 tx=0x7f2d0c00c990 comp rx=0 tx=0).stop 2023-12-22T08:39:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.507+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/1571389133 shutdown_connections 2023-12-22T08:39:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.507+0000 7f2d1c9ae640 1 --2- 172.21.15.89:0/1571389133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d180d0440 0x7f2d1815ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.507+0000 7f2d1c9ae640 1 --2- 172.21.15.89:0/1571389133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d1806bff0 0x7f2d181439c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.507+0000 7f2d1c9ae640 1 --2- 172.21.15.89:0/1571389133 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d1806bc10 0x7f2d181591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.507+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/1571389133 >> 172.21.15.89:0/1571389133 conn(0x7f2d1806ab10 msgr2=0x7f2d180b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.507+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/1571389133 shutdown_connections 2023-12-22T08:39:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.507+0000 7f2d1c9ae640 1 -- 172.21.15.89:0/1571389133 wait complete. 2023-12-22T08:39:44.526 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-12-22T08:39:44.536 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:44.533+0000 7f5305013040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-22T08:39:44.547 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:44.545+0000 7f01e820f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-22T08:39:44.702 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:44.699+0000 7f5305013040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-22T08:39:44.712 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:44.710+0000 7f01e820f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-22T08:39:44.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.711+0000 7f6fef461640 1 Processor -- start 2023-12-22T08:39:44.713 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.711+0000 7f6fef461640 1 -- start start 2023-12-22T08:39:44.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.713+0000 7f6fef461640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6fe8144ba0 0x7f6fe80b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.713+0000 7f6fef461640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe815ba60 0x7f6fe80b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.713+0000 7f6fef461640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe80b3f00 con 0x7f6fe80b5870 2023-12-22T08:39:44.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.713+0000 7f6fef461640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe80b5d00 con 0x7f6fe8144ba0 2023-12-22T08:39:44.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.713+0000 7f6fef461640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80b41e0 con 0x7f6fe815ba60 2023-12-22T08:39:44.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.713+0000 7f6fec9fc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe815ba60 0x7f6fe80b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.713+0000 7f6fec9fc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe815ba60 0x7f6fe80b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54880/0 (socket says 172.21.15.89:54880) 2023-12-22T08:39:44.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.713+0000 7f6fed9fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6fe80b5870 0x7f6fe815ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:43110/0 (socket says 172.21.15.89:43110) 2023-12-22T08:39:44.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.713+0000 7f6fec9fc640 1 -- 172.21.15.89:0/3444982026 learned_addr learned my addr 172.21.15.89:0/3444982026 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:44.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.714+0000 7f6fed1fd640 1 --2- 172.21.15.89:0/3444982026 >> v2:172.21.15.38:3300/0 conn(0x7f6fe8144ba0 0x7f6fe80b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.714+0000 7f6fec9fc640 1 -- 172.21.15.89:0/3444982026 >> v2:172.21.15.38:3300/0 conn(0x7f6fe8144ba0 msgr2=0x7f6fe80b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:44.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.714+0000 7f6fec9fc640 1 --2- 172.21.15.89:0/3444982026 >> v2:172.21.15.38:3300/0 conn(0x7f6fe8144ba0 0x7f6fe80b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.714+0000 7f6fec9fc640 1 -- 172.21.15.89:0/3444982026 >> v1:172.21.15.89:6789/0 conn(0x7f6fe80b5870 legacy=0x7f6fe815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.714+0000 7f6fec9fc640 1 -- 172.21.15.89:0/3444982026 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe80b44c0 con 0x7f6fe815ba60 2023-12-22T08:39:44.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.714+0000 7f6fdffff640 1 -- 172.21.15.89:0/3444982026 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192654522 0 0) 0x7f6fe80b3f00 con 0x7f6fe80b5870 2023-12-22T08:39:44.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.715+0000 7f6fec9fc640 1 --2- 172.21.15.89:0/3444982026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe815ba60 0x7f6fe80b5330 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8009870 tx=0x7f6fd802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=577e2a6eda34089 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:44.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.716+0000 7f6fdffff640 1 -- 172.21.15.89:0/3444982026 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8030840 con 0x7f6fe815ba60 2023-12-22T08:39:44.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.716+0000 7f6fdffff640 1 -- 172.21.15.89:0/3444982026 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd80309a0 con 0x7f6fe815ba60 2023-12-22T08:39:44.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.716+0000 7f6fdffff640 1 -- 172.21.15.89:0/3444982026 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8030d30 con 0x7f6fe815ba60 2023-12-22T08:39:44.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.717+0000 7f6fef461640 1 -- 172.21.15.89:0/3444982026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe815ba60 msgr2=0x7f6fe80b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.717+0000 7f6fef461640 1 --2- 172.21.15.89:0/3444982026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe815ba60 0x7f6fe80b5330 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8009870 tx=0x7f6fd802b980 comp rx=0 tx=0).stop 2023-12-22T08:39:44.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.717+0000 7f6fef461640 1 -- 172.21.15.89:0/3444982026 shutdown_connections 2023-12-22T08:39:44.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.717+0000 7f6fef461640 1 --2- 172.21.15.89:0/3444982026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe815ba60 0x7f6fe80b5330 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.717+0000 7f6fef461640 1 --2- 172.21.15.89:0/3444982026 >> v2:172.21.15.38:3300/0 conn(0x7f6fe8144ba0 0x7f6fe80b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.717+0000 7f6fef461640 1 -- 172.21.15.89:0/3444982026 >> 172.21.15.89:0/3444982026 conn(0x7f6fe806f460 msgr2=0x7f6fe806f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:44.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.717+0000 7f6fef461640 1 -- 172.21.15.89:0/3444982026 shutdown_connections 2023-12-22T08:39:44.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.717+0000 7f6fef461640 1 -- 172.21.15.89:0/3444982026 wait complete. 2023-12-22T08:39:44.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.720+0000 7f6fef461640 1 Processor -- start 2023-12-22T08:39:44.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.720+0000 7f6fef461640 1 -- start start 2023-12-22T08:39:44.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.721+0000 7f6fef461640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe80b5870 0x7f6fe813edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.721+0000 7f6fef461640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe8144ba0 0x7f6fe81f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.721+0000 7f6fef461640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fe815ba60 0x7f6fe81f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.721+0000 7f6fef461640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe806ade0 con 0x7f6fe815ba60 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.721+0000 7f6fef461640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe806b640 con 0x7f6fe8144ba0 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.721+0000 7f6fef461640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80cab40 con 0x7f6fe80b5870 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.722+0000 7f6fec9fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe8144ba0 0x7f6fe81f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.722+0000 7f6fed1fd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe80b5870 0x7f6fe813edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.722+0000 7f6fed1fd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe80b5870 0x7f6fe813edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:54892/0 (socket says 172.21.15.89:54892) 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.722+0000 7f6fed1fd640 1 -- 172.21.15.89:0/1480490366 learned_addr learned my addr 172.21.15.89:0/1480490366 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.722+0000 7f6fed9fe640 1 --2- 172.21.15.89:0/1480490366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fe815ba60 0x7f6fe81f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.722+0000 7f6fed1fd640 1 -- 172.21.15.89:0/1480490366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe8144ba0 msgr2=0x7f6fe81f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.722+0000 7f6fed1fd640 1 --2- 172.21.15.89:0/1480490366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe8144ba0 0x7f6fe81f2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.722+0000 7f6fed1fd640 1 -- 172.21.15.89:0/1480490366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fe815ba60 msgr2=0x7f6fe81f2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.722+0000 7f6fed1fd640 1 --2- 172.21.15.89:0/1480490366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fe815ba60 0x7f6fe81f2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.722+0000 7f6fed1fd640 1 -- 172.21.15.89:0/1480490366 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd80094d0 con 0x7f6fe80b5870 2023-12-22T08:39:44.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.722+0000 7f6fec9fc640 1 --2- 172.21.15.89:0/1480490366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe8144ba0 0x7f6fe81f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:39:44.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.722+0000 7f6fed1fd640 1 --2- 172.21.15.89:0/1480490366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe80b5870 0x7f6fe813edf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400d800 tx=0x7f6fe400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:44.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.723+0000 7f6fddffb640 1 -- 172.21.15.89:0/1480490366 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe400b6c0 con 0x7f6fe80b5870 2023-12-22T08:39:44.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.723+0000 7f6fddffb640 1 -- 172.21.15.89:0/1480490366 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe400b820 con 0x7f6fe80b5870 2023-12-22T08:39:44.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.723+0000 7f6fddffb640 1 -- 172.21.15.89:0/1480490366 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe400bbb0 con 0x7f6fe80b5870 2023-12-22T08:39:44.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.723+0000 7f6fef461640 1 -- 172.21.15.89:0/1480490366 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe806aff0 con 0x7f6fe80b5870 2023-12-22T08:39:44.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.723+0000 7f6fef461640 1 -- 172.21.15.89:0/1480490366 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe813f330 con 0x7f6fe80b5870 2023-12-22T08:39:44.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.723+0000 7f6fddffb640 1 -- 172.21.15.89:0/1480490366 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6fe401e760 con 0x7f6fe80b5870 2023-12-22T08:39:44.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.723+0000 7f6fddffb640 1 -- 172.21.15.89:0/1480490366 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6fe400bd10 con 0x7f6fe80b5870 2023-12-22T08:39:44.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.724+0000 7f6fef461640 1 -- 172.21.15.89:0/1480490366 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe80b4750 con 0x7f6fe80b5870 2023-12-22T08:39:44.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.726+0000 7f6fddffb640 1 -- 172.21.15.89:0/1480490366 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f6fe4014570 con 0x7f6fe80b5870 2023-12-22T08:39:44.806 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.803+0000 7f6fef461640 1 -- 172.21.15.89:0/1480490366 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f6fe815ca90 con 0x7f6fe80b5870 2023-12-22T08:39:44.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.810+0000 7f6fddffb640 1 -- 172.21.15.89:0/1480490366 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6fe401eae0 con 0x7f6fe80b5870 2023-12-22T08:39:44.813 INFO:teuthology.orchestra.run.smithi089.stdout:7 2023-12-22T08:39:44.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.812+0000 7f6fef461640 1 -- 172.21.15.89:0/1480490366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe80b5870 msgr2=0x7f6fe813edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:44.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.812+0000 7f6fef461640 1 --2- 172.21.15.89:0/1480490366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe80b5870 0x7f6fe813edf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400d800 tx=0x7f6fe400dcc0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.812+0000 7f6fef461640 1 -- 172.21.15.89:0/1480490366 shutdown_connections 2023-12-22T08:39:44.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.812+0000 7f6fef461640 1 --2- 172.21.15.89:0/1480490366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fe815ba60 0x7f6fe81f2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.812+0000 7f6fef461640 1 --2- 172.21.15.89:0/1480490366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe8144ba0 0x7f6fe81f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.812+0000 7f6fef461640 1 --2- 172.21.15.89:0/1480490366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fe80b5870 0x7f6fe813edf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:44.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.812+0000 7f6fef461640 1 -- 172.21.15.89:0/1480490366 >> 172.21.15.89:0/1480490366 conn(0x7f6fe806f460 msgr2=0x7f6fe815ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:44.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.812+0000 7f6fef461640 1 -- 172.21.15.89:0/1480490366 shutdown_connections 2023-12-22T08:39:44.815 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-22T08:39:44.812+0000 7f6fef461640 1 -- 172.21.15.89:0/1480490366 wait complete. 2023-12-22T08:39:44.830 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-22T08:39:44.831 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-22T08:39:44.839 INFO:tasks.ceph.osd.0:Started 2023-12-22T08:39:44.840 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-22T08:39:44.840 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-22T08:39:44.848 INFO:tasks.ceph.osd.1:Started 2023-12-22T08:39:44.848 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-22T08:39:44.848 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-22T08:39:44.857 INFO:tasks.ceph.osd.2:Started 2023-12-22T08:39:44.857 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-22T08:39:44.858 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-22T08:39:44.864 INFO:tasks.ceph.osd.3:Started 2023-12-22T08:39:44.865 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-22T08:39:44.865 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-22T08:39:44.879 INFO:tasks.ceph.osd.4:Started 2023-12-22T08:39:44.879 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-22T08:39:44.879 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-22T08:39:44.887 INFO:tasks.ceph.osd.5:Started 2023-12-22T08:39:44.887 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-22T08:39:44.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-22T08:39:44.894 INFO:tasks.ceph.osd.6:Started 2023-12-22T08:39:44.894 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-22T08:39:44.894 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-22T08:39:44.899 INFO:tasks.ceph.osd.7:Started 2023-12-22T08:39:44.899 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:39:45.030 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-12-22T08:39:45.028+0000 7f2a20729500 -1 Falling back to public interface 2023-12-22T08:39:45.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-12-22T08:39:45.044+0000 7fcc0ec0e500 -1 Falling back to public interface 2023-12-22T08:39:45.049 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-12-22T08:39:45.047+0000 7f2a20729500 -1 osd.0 0 log_to_monitors true 2023-12-22T08:39:45.054 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-12-22T08:39:45.052+0000 7f4cbe01a500 -1 Falling back to public interface 2023-12-22T08:39:45.058 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-12-22T08:39:45.055+0000 7ff25aa16500 -1 Falling back to public interface 2023-12-22T08:39:45.065 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-12-22T08:39:45.062+0000 7fe81f412500 -1 Falling back to public interface 2023-12-22T08:39:45.077 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-12-22T08:39:45.074+0000 7f4cbe01a500 -1 osd.4 0 log_to_monitors true 2023-12-22T08:39:45.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-12-22T08:39:45.075+0000 7fcc0ec0e500 -1 osd.1 0 log_to_monitors true 2023-12-22T08:39:45.078 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-12-22T08:39:45.075+0000 7f28da994500 -1 Falling back to public interface 2023-12-22T08:39:45.080 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-12-22T08:39:45.078+0000 7fc3ac174500 -1 Falling back to public interface 2023-12-22T08:39:45.087 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-12-22T08:39:45.084+0000 7ff25aa16500 -1 osd.6 0 log_to_monitors true 2023-12-22T08:39:45.088 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-12-22T08:39:45.086+0000 7fe996c1d500 -1 Falling back to public interface 2023-12-22T08:39:45.096 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-12-22T08:39:45.094+0000 7fe81f412500 -1 osd.3 0 log_to_monitors true 2023-12-22T08:39:45.109 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-12-22T08:39:45.106+0000 7fc3ac174500 -1 osd.5 0 log_to_monitors true 2023-12-22T08:39:45.112 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-12-22T08:39:45.109+0000 7fe996c1d500 -1 osd.7 0 log_to_monitors true 2023-12-22T08:39:45.112 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-12-22T08:39:45.110+0000 7f28da994500 -1 osd.2 0 log_to_monitors true 2023-12-22T08:39:45.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.136+0000 7fc0bf101640 1 Processor -- start 2023-12-22T08:39:45.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.136+0000 7fc0bf101640 1 -- start start 2023-12-22T08:39:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.137+0000 7fc0bf101640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc0b815db30 0x7fc0b806ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.137+0000 7fc0bf101640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b815eb20 con 0x7fc0b80b3f90 2023-12-22T08:39:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.137+0000 7fc0bf101640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b8070770 con 0x7fc0b815e740 2023-12-22T08:39:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.137+0000 7fc0bf101640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b815df40 con 0x7fc0b815db30 2023-12-22T08:39:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.137+0000 7fc0b7fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc0b80b3f90 0x7fc0b8070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60470/0 (socket says 172.21.15.38:60470) 2023-12-22T08:39:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.137+0000 7fc0b7fff640 1 -- 172.21.15.38:0/3187298799 learned_addr learned my addr 172.21.15.38:0/3187298799 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:39:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.137+0000 7fc0bd69e640 1 --2- 172.21.15.38:0/3187298799 >> v2:172.21.15.38:3300/0 conn(0x7fc0b815db30 0x7fc0b806ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:45.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.138+0000 7fc0bd69e640 1 -- 172.21.15.38:0/3187298799 >> v1:172.21.15.89:6789/0 conn(0x7fc0b815e740 legacy=0x7fc0b80b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:45.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.138+0000 7fc0bd69e640 1 -- 172.21.15.38:0/3187298799 >> v1:172.21.15.38:6789/0 conn(0x7fc0b80b3f90 legacy=0x7fc0b8070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:45.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.138+0000 7fc0bd69e640 1 -- 172.21.15.38:0/3187298799 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b806d180 con 0x7fc0b815db30 2023-12-22T08:39:45.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.139+0000 7fc0bd69e640 1 --2- 172.21.15.38:0/3187298799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0b815db30 0x7fc0b806ca50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009d90 tx=0x7fc0b002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bed051abc22643b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:45.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.139+0000 7fc0b77fe640 1 -- 172.21.15.38:0/3187298799 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b002cb40 con 0x7fc0b815db30 2023-12-22T08:39:45.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.139+0000 7fc0b77fe640 1 -- 172.21.15.38:0/3187298799 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b002cca0 con 0x7fc0b815db30 2023-12-22T08:39:45.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.139+0000 7fc0b77fe640 1 -- 172.21.15.38:0/3187298799 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0034660 con 0x7fc0b815db30 2023-12-22T08:39:45.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.140+0000 7fc0bf101640 1 -- 172.21.15.38:0/3187298799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0b815db30 msgr2=0x7fc0b806ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:45.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.140+0000 7fc0bf101640 1 --2- 172.21.15.38:0/3187298799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0b815db30 0x7fc0b806ca50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009d90 tx=0x7fc0b002bd90 comp rx=0 tx=0).stop 2023-12-22T08:39:45.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.140+0000 7fc0bf101640 1 -- 172.21.15.38:0/3187298799 shutdown_connections 2023-12-22T08:39:45.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.140+0000 7fc0bf101640 1 --2- 172.21.15.38:0/3187298799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0b815db30 0x7fc0b806ca50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:45.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.140+0000 7fc0bf101640 1 -- 172.21.15.38:0/3187298799 >> 172.21.15.38:0/3187298799 conn(0x7fc0b80cfea0 msgr2=0x7fc0b80d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:45.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.140+0000 7fc0bf101640 1 -- 172.21.15.38:0/3187298799 shutdown_connections 2023-12-22T08:39:45.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.140+0000 7fc0bf101640 1 -- 172.21.15.38:0/3187298799 wait complete. 2023-12-22T08:39:45.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.142+0000 7fc0bf101640 1 Processor -- start 2023-12-22T08:39:45.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.143+0000 7fc0bf101640 1 -- start start 2023-12-22T08:39:45.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.144+0000 7fc0bf101640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0b80b3f90 0x7fc0b8156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:45.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.144+0000 7fc0bf101640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0b815db30 0x7fc0b8160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.144+0000 7fc0bf101640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0b815e740 0x7fc0b8161460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.144+0000 7fc0bf101640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b81f2dc0 con 0x7fc0b815db30 2023-12-22T08:39:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.144+0000 7fc0bf101640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b81f2fd0 con 0x7fc0b80b3f90 2023-12-22T08:39:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.144+0000 7fc0bf101640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b81f3270 con 0x7fc0b815e740 2023-12-22T08:39:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.144+0000 7fc0b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0b815db30 0x7fc0b8160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.145+0000 7fc0b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0b815db30 0x7fc0b8160f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58020/0 (socket says 172.21.15.38:58020) 2023-12-22T08:39:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.145+0000 7fc0b7fff640 1 -- 172.21.15.38:0/3518821406 learned_addr learned my addr 172.21.15.38:0/3518821406 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.145+0000 7fc0bce9d640 1 --2- 172.21.15.38:0/3518821406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0b80b3f90 0x7fc0b8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.145+0000 7fc0bd69e640 1 --2- 172.21.15.38:0/3518821406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0b815e740 0x7fc0b8161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.145+0000 7fc0b7fff640 1 -- 172.21.15.38:0/3518821406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0b815e740 msgr2=0x7fc0b8161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.145+0000 7fc0b7fff640 1 --2- 172.21.15.38:0/3518821406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0b815e740 0x7fc0b8161460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.145+0000 7fc0b7fff640 1 -- 172.21.15.38:0/3518821406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0b80b3f90 msgr2=0x7fc0b8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.145+0000 7fc0b7fff640 1 --2- 172.21.15.38:0/3518821406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0b80b3f90 0x7fc0b8156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:45.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.145+0000 7fc0b7fff640 1 -- 172.21.15.38:0/3518821406 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b0009a70 con 0x7fc0b815db30 2023-12-22T08:39:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.145+0000 7fc0b7fff640 1 --2- 172.21.15.38:0/3518821406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0b815db30 0x7fc0b8160f20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c4a0 tx=0x7fc0a400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.146+0000 7fc0b57fa640 1 -- 172.21.15.38:0/3518821406 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4005ce0 con 0x7fc0b815db30 2023-12-22T08:39:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.146+0000 7fc0b57fa640 1 -- 172.21.15.38:0/3518821406 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a4005e40 con 0x7fc0b815db30 2023-12-22T08:39:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.146+0000 7fc0b57fa640 1 -- 172.21.15.38:0/3518821406 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4007270 con 0x7fc0b815db30 2023-12-22T08:39:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.146+0000 7fc0bf101640 1 -- 172.21.15.38:0/3518821406 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b81f3550 con 0x7fc0b815db30 2023-12-22T08:39:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.146+0000 7fc0bf101640 1 -- 172.21.15.38:0/3518821406 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b81f3b10 con 0x7fc0b815db30 2023-12-22T08:39:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.146+0000 7fc0b57fa640 1 -- 172.21.15.38:0/3518821406 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc0a4012400 con 0x7fc0b815db30 2023-12-22T08:39:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.147+0000 7fc0b57fa640 1 -- 172.21.15.38:0/3518821406 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc0a4012d80 con 0x7fc0b815db30 2023-12-22T08:39:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.147+0000 7fc0bf101640 1 -- 172.21.15.38:0/3518821406 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b81f3d00 con 0x7fc0b815db30 2023-12-22T08:39:45.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.150+0000 7fc0b57fa640 1 -- 172.21.15.38:0/3518821406 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fc0a4021060 con 0x7fc0b815db30 2023-12-22T08:39:45.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.215+0000 7fc0bf101640 1 -- 172.21.15.38:0/3518821406 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0b8061910 con 0x7fc0b815db30 2023-12-22T08:39:45.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.216+0000 7fc0b57fa640 1 -- 172.21.15.38:0/3518821406 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc0a4017070 con 0x7fc0b815db30 2023-12-22T08:39:45.219 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:45.219 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":10,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:44.806169+0000","last_up_change":"0.000000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:39:45.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.217+0000 7fc0bf101640 1 -- 172.21.15.38:0/3518821406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0b815db30 msgr2=0x7fc0b8160f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:45.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.217+0000 7fc0bf101640 1 --2- 172.21.15.38:0/3518821406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0b815db30 0x7fc0b8160f20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c4a0 tx=0x7fc0a400c960 comp rx=0 tx=0).stop 2023-12-22T08:39:45.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.218+0000 7fc0bf101640 1 -- 172.21.15.38:0/3518821406 shutdown_connections 2023-12-22T08:39:45.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.218+0000 7fc0bf101640 1 --2- 172.21.15.38:0/3518821406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0b815e740 0x7fc0b8161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:45.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.218+0000 7fc0bf101640 1 --2- 172.21.15.38:0/3518821406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0b815db30 0x7fc0b8160f20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:45.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.218+0000 7fc0bf101640 1 --2- 172.21.15.38:0/3518821406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0b80b3f90 0x7fc0b8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:45.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.218+0000 7fc0bf101640 1 -- 172.21.15.38:0/3518821406 >> 172.21.15.38:0/3518821406 conn(0x7fc0b80cfea0 msgr2=0x7fc0b80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:45.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.218+0000 7fc0bf101640 1 -- 172.21.15.38:0/3518821406 shutdown_connections 2023-12-22T08:39:45.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:45.218+0000 7fc0bf101640 1 -- 172.21.15.38:0/3518821406 wait complete. 2023-12-22T08:39:45.237 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-22T08:39:45.237 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-22T08:39:45.733 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:39:45.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:39:45.846 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:45.844+0000 7f01e820f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-22T08:39:45.888 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:45.885+0000 7f5305013040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-22T08:39:46.041 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-22T08:39:46.158 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:46.155+0000 7f01e820f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-22T08:39:46.217 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.214+0000 7f99ac8c3640 1 Processor -- start 2023-12-22T08:39:46.217 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.215+0000 7f99ac8c3640 1 -- start start 2023-12-22T08:39:46.218 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:46.215+0000 7f5305013040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-22T08:39:46.218 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:46.214+0000 7f01e820f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-22T08:39:46.219 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.216+0000 7f99ac8c3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99a81608f0 0x7f99a80d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:46.220 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.216+0000 7f99ac8c3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f99a80b21a0 0x7f99a80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:46.220 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.216+0000 7f99ac8c3640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a80d0550 con 0x7f99a8160cd0 2023-12-22T08:39:46.220 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.216+0000 7f99ac8c3640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a80aff60 con 0x7f99a81608f0 2023-12-22T08:39:46.220 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.216+0000 7f99ac8c3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a80d3c80 con 0x7f99a80b21a0 2023-12-22T08:39:46.220 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.217+0000 7f99a6d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99a81608f0 0x7f99a80d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:46.220 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.217+0000 7f999ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f99a8160cd0 0x7f99a80b0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60474/0 (socket says 172.21.15.38:60474) 2023-12-22T08:39:46.220 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.217+0000 7f99a6d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99a81608f0 0x7f99a80d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58032/0 (socket says 172.21.15.38:58032) 2023-12-22T08:39:46.221 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.217+0000 7f999ffff640 1 -- 172.21.15.38:0/3529309671 learned_addr learned my addr 172.21.15.38:0/3529309671 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:39:46.221 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.217+0000 7f99a759e640 1 --2- 172.21.15.38:0/3529309671 >> v2:172.21.15.89:3300/0 conn(0x7f99a80b21a0 0x7f99a80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:46.221 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.217+0000 7f99a6d9d640 1 -- 172.21.15.38:0/3529309671 >> v2:172.21.15.89:3300/0 conn(0x7f99a80b21a0 msgr2=0x7f99a80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:46.221 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.217+0000 7f99a6d9d640 1 --2- 172.21.15.38:0/3529309671 >> v2:172.21.15.89:3300/0 conn(0x7f99a80b21a0 0x7f99a80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:46.221 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.217+0000 7f99a6d9d640 1 -- 172.21.15.38:0/3529309671 >> v1:172.21.15.38:6789/0 conn(0x7f99a8160cd0 legacy=0x7f99a80b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:46.221 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.217+0000 7f99a659c640 1 -- 172.21.15.38:0/3529309671 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364423364 0 0) 0x7f99a80d0550 con 0x7f99a8160cd0 2023-12-22T08:39:46.222 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.217+0000 7f99a6d9d640 1 -- 172.21.15.38:0/3529309671 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a80d0f40 con 0x7f99a81608f0 2023-12-22T08:39:46.222 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.219+0000 7f99a6d9d640 1 --2- 172.21.15.38:0/3529309671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a81608f0 0x7f99a80d1640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f99a808c0c0 tx=0x7f999802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8c1df3b1d7a844 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:46.223 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.219+0000 7f99a659c640 1 -- 172.21.15.38:0/3529309671 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998031710 con 0x7f99a81608f0 2023-12-22T08:39:46.223 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.219+0000 7f99a659c640 1 -- 172.21.15.38:0/3529309671 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999802f050 con 0x7f99a81608f0 2023-12-22T08:39:46.223 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.219+0000 7f99a659c640 1 -- 172.21.15.38:0/3529309671 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998031a90 con 0x7f99a81608f0 2023-12-22T08:39:46.223 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.220+0000 7f99ac8c3640 1 -- 172.21.15.38:0/3529309671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a81608f0 msgr2=0x7f99a80d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:46.223 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.220+0000 7f99ac8c3640 1 --2- 172.21.15.38:0/3529309671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a81608f0 0x7f99a80d1640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f99a808c0c0 tx=0x7f999802b7b0 comp rx=0 tx=0).stop 2023-12-22T08:39:46.223 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.220+0000 7f99ac8c3640 1 -- 172.21.15.38:0/3529309671 shutdown_connections 2023-12-22T08:39:46.223 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.220+0000 7f99ac8c3640 1 --2- 172.21.15.38:0/3529309671 >> v2:172.21.15.89:3300/0 conn(0x7f99a80b21a0 0x7f99a80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:46.223 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.220+0000 7f99ac8c3640 1 --2- 172.21.15.38:0/3529309671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a81608f0 0x7f99a80d1640 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:46.223 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.220+0000 7f99ac8c3640 1 -- 172.21.15.38:0/3529309671 >> 172.21.15.38:0/3529309671 conn(0x7f99a80d3160 msgr2=0x7f99a80d3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:46.223 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.220+0000 7f99ac8c3640 1 -- 172.21.15.38:0/3529309671 shutdown_connections 2023-12-22T08:39:46.223 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.220+0000 7f99ac8c3640 1 -- 172.21.15.38:0/3529309671 wait complete. 2023-12-22T08:39:46.224 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.222+0000 7f99ac8c3640 1 Processor -- start 2023-12-22T08:39:46.224 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.222+0000 7f99ac8c3640 1 -- start start 2023-12-22T08:39:46.227 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.223+0000 7f99ac8c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a80b21a0 0x7f99a8153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:46.227 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.223+0000 7f99ac8c3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99a81608f0 0x7f99a80caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:46.227 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.223+0000 7f99ac8c3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99a8160cd0 0x7f99a80caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:46.227 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.223+0000 7f99ac8c3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a80cb8a0 con 0x7f99a80b21a0 2023-12-22T08:39:46.227 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.223+0000 7f99ac8c3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a81e7ab0 con 0x7f99a81608f0 2023-12-22T08:39:46.227 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.223+0000 7f99ac8c3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a81e6a10 con 0x7f99a8160cd0 2023-12-22T08:39:46.227 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.223+0000 7f99a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a80b21a0 0x7f99a8153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:46.227 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.223+0000 7f99a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a80b21a0 0x7f99a8153920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58040/0 (socket says 172.21.15.38:58040) 2023-12-22T08:39:46.227 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.223+0000 7f99a6d9d640 1 -- 172.21.15.38:0/1606150028 learned_addr learned my addr 172.21.15.38:0/1606150028 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:46.227 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.224+0000 7f99a759e640 1 --2- 172.21.15.38:0/1606150028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99a8160cd0 0x7f99a80caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:46.228 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.224+0000 7f99a6d9d640 1 -- 172.21.15.38:0/1606150028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99a8160cd0 msgr2=0x7f99a80caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:46.228 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.224+0000 7f99a6d9d640 1 --2- 172.21.15.38:0/1606150028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99a8160cd0 0x7f99a80caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:46.228 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.224+0000 7f99a6d9d640 1 -- 172.21.15.38:0/1606150028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99a81608f0 msgr2=0x7f99a80caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:46.228 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.224+0000 7f99a6d9d640 1 --2- 172.21.15.38:0/1606150028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99a81608f0 0x7f99a80caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:46.228 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.224+0000 7f99a6d9d640 1 -- 172.21.15.38:0/1606150028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998009400 con 0x7f99a80b21a0 2023-12-22T08:39:46.228 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.224+0000 7f99a6d9d640 1 --2- 172.21.15.38:0/1606150028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a80b21a0 0x7f99a8153920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9998000c00 tx=0x7f99980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:46.229 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.225+0000 7f999f7fe640 1 -- 172.21.15.38:0/1606150028 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998033910 con 0x7f99a80b21a0 2023-12-22T08:39:46.229 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.225+0000 7f99ac8c3640 1 -- 172.21.15.38:0/1606150028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a81e6cf0 con 0x7f99a80b21a0 2023-12-22T08:39:46.229 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.225+0000 7f999f7fe640 1 -- 172.21.15.38:0/1606150028 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9998033a70 con 0x7f99a80b21a0 2023-12-22T08:39:46.230 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.225+0000 7f999f7fe640 1 -- 172.21.15.38:0/1606150028 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998033e20 con 0x7f99a80b21a0 2023-12-22T08:39:46.230 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.225+0000 7f99ac8c3640 1 -- 172.21.15.38:0/1606150028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a81e72b0 con 0x7f99a80b21a0 2023-12-22T08:39:46.230 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.225+0000 7f999f7fe640 1 -- 172.21.15.38:0/1606150028 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f999803a040 con 0x7f99a80b21a0 2023-12-22T08:39:46.230 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.225+0000 7f999f7fe640 1 -- 172.21.15.38:0/1606150028 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1883+0+0 (secure 0 0 0) 0x7f999803cd00 con 0x7f99a80b21a0 2023-12-22T08:39:46.230 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.226+0000 7f99ac8c3640 1 -- 172.21.15.38:0/1606150028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a80d1640 con 0x7f99a80b21a0 2023-12-22T08:39:46.231 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.228+0000 7f999f7fe640 1 -- 172.21.15.38:0/1606150028 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f999804d060 con 0x7f99a80b21a0 2023-12-22T08:39:46.283 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:46.280+0000 7f5305013040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-22T08:39:46.297 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.295+0000 7f99ac8c3640 1 -- 172.21.15.38:0/1606150028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99a8061910 con 0x7f99a80b21a0 2023-12-22T08:39:46.298 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.296+0000 7f999f7fe640 1 -- 172.21.15.38:0/1606150028 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9998057090 con 0x7f99a80b21a0 2023-12-22T08:39:46.299 INFO:teuthology.misc.health.smithi038.stdout: 2023-12-22T08:39:46.299 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":11,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:45.808599+0000","last_up_change":"0.000000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:39:46.300 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.297+0000 7f99ac8c3640 1 -- 172.21.15.38:0/1606150028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a80b21a0 msgr2=0x7f99a8153920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:46.300 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.297+0000 7f99ac8c3640 1 --2- 172.21.15.38:0/1606150028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a80b21a0 0x7f99a8153920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9998000c00 tx=0x7f99980046c0 comp rx=0 tx=0).stop 2023-12-22T08:39:46.300 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.297+0000 7f99ac8c3640 1 -- 172.21.15.38:0/1606150028 shutdown_connections 2023-12-22T08:39:46.300 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.297+0000 7f99ac8c3640 1 --2- 172.21.15.38:0/1606150028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99a8160cd0 0x7f99a80caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:46.300 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.297+0000 7f99ac8c3640 1 --2- 172.21.15.38:0/1606150028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99a81608f0 0x7f99a80caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:46.301 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.297+0000 7f99ac8c3640 1 --2- 172.21.15.38:0/1606150028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99a80b21a0 0x7f99a8153920 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:46.301 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.297+0000 7f99ac8c3640 1 -- 172.21.15.38:0/1606150028 >> 172.21.15.38:0/1606150028 conn(0x7f99a80d3160 msgr2=0x7f99a80d3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:46.301 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.298+0000 7f99ac8c3640 1 -- 172.21.15.38:0/1606150028 shutdown_connections 2023-12-22T08:39:46.301 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:46.298+0000 7f99ac8c3640 1 -- 172.21.15.38:0/1606150028 wait complete. 2023-12-22T08:39:46.313 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-22T08:39:46.330 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:46.328+0000 7f01e820f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-22T08:39:46.410 INFO:tasks.ceph.mgr.y.smithi038.stderr:2023-12-22T08:39:46.408+0000 7f5305013040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-22T08:39:46.854 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-12-22T08:39:46.851+0000 7f2a1c6b4640 -1 osd.0 0 waiting for initial osdmap 2023-12-22T08:39:46.854 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-12-22T08:39:46.852+0000 7f4cb9a7a640 -1 osd.4 0 waiting for initial osdmap 2023-12-22T08:39:46.858 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-12-22T08:39:46.855+0000 7f4cb30ad640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:39:46.858 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-12-22T08:39:46.855+0000 7f2a15ce7640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:39:46.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-12-22T08:39:46.862+0000 7fcc0ace2640 -1 osd.1 0 waiting for initial osdmap 2023-12-22T08:39:46.865 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-12-22T08:39:46.862+0000 7ff25637b640 -1 osd.6 0 waiting for initial osdmap 2023-12-22T08:39:46.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2023-12-22T08:39:46.865+0000 7fcc03afe640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:39:46.868 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-12-22T08:39:46.866+0000 7ff24f9ae640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:39:46.872 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-12-22T08:39:46.870+0000 7fe992e20640 -1 osd.7 0 waiting for initial osdmap 2023-12-22T08:39:46.873 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-12-22T08:39:46.871+0000 7fc3a80ff640 -1 osd.5 0 waiting for initial osdmap 2023-12-22T08:39:46.875 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-12-22T08:39:46.873+0000 7fe98bc3c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:39:46.877 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-12-22T08:39:46.874+0000 7fc3a1732640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:39:46.882 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-12-22T08:39:46.880+0000 7fe81ada6640 -1 osd.3 0 waiting for initial osdmap 2023-12-22T08:39:46.883 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-12-22T08:39:46.880+0000 7f28d6921640 -1 osd.2 0 waiting for initial osdmap 2023-12-22T08:39:46.887 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-12-22T08:39:46.884+0000 7fe8143d9640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:39:46.889 INFO:tasks.ceph.osd.2.smithi038.stderr:2023-12-22T08:39:46.886+0000 7f28cff54640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:39:47.383 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:47.379+0000 7f01892a9640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-22T08:39:47.383 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-12-22T08:39:47.380+0000 7f01892a9640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-22T08:39:53.120 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-22T08:39:53.322 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.319+0000 7f0a71918640 1 Processor -- start 2023-12-22T08:39:53.322 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.319+0000 7f0a71918640 1 -- start start 2023-12-22T08:39:53.324 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.321+0000 7f0a71918640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a6c15d540 0x7f0a6c0cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:53.325 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.321+0000 7f0a71918640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0a6c0b8510 0x7f0a6c0ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:53.325 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.321+0000 7f0a71918640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c0b7470 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.325 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.321+0000 7f0a71918640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c15d920 con 0x7f0a6c15d540 2023-12-22T08:39:53.325 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.321+0000 7f0a71918640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c0b7750 con 0x7f0a6c0b8510 2023-12-22T08:39:53.325 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.321+0000 7f0a6affd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a6c15d540 0x7f0a6c0cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:53.326 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.321+0000 7f0a6affd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a6c15d540 0x7f0a6c0cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37172/0 (socket says 172.21.15.38:37172) 2023-12-22T08:39:53.326 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.321+0000 7f0a6affd640 1 -- 172.21.15.38:0/1751644572 learned_addr learned my addr 172.21.15.38:0/1751644572 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:53.326 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.321+0000 7f0a6b7fe640 1 --2- 172.21.15.38:0/1751644572 >> v2:172.21.15.89:3300/0 conn(0x7f0a6c0b8510 0x7f0a6c0ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:53.326 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.321+0000 7f0a6affd640 1 -- 172.21.15.38:0/1751644572 >> v2:172.21.15.89:3300/0 conn(0x7f0a6c0b8510 msgr2=0x7f0a6c0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:53.326 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.321+0000 7f0a6affd640 1 --2- 172.21.15.38:0/1751644572 >> v2:172.21.15.89:3300/0 conn(0x7f0a6c0b8510 0x7f0a6c0ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.326 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.321+0000 7f0a6affd640 1 -- 172.21.15.38:0/1751644572 >> v1:172.21.15.89:6789/0 conn(0x7f0a6c0b6f70 legacy=0x7f0a6c0d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:53.327 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.322+0000 7f0a6affd640 1 -- 172.21.15.38:0/1751644572 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c0b7a30 con 0x7f0a6c15d540 2023-12-22T08:39:53.329 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.323+0000 7f0a6affd640 1 --2- 172.21.15.38:0/1751644572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6c15d540 0x7f0a6c0cdf90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0d1610 tx=0x7f0a5c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83de965d057219a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:53.330 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.323+0000 7f0a6a7fc640 1 -- 172.21.15.38:0/1751644572 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c031870 con 0x7f0a6c15d540 2023-12-22T08:39:53.330 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.323+0000 7f0a6a7fc640 1 -- 172.21.15.38:0/1751644572 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c0319d0 con 0x7f0a6c15d540 2023-12-22T08:39:53.330 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.323+0000 7f0a6a7fc640 1 -- 172.21.15.38:0/1751644572 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c031d60 con 0x7f0a6c15d540 2023-12-22T08:39:53.330 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.324+0000 7f0a71918640 1 -- 172.21.15.38:0/1751644572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6c15d540 msgr2=0x7f0a6c0cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:53.330 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.324+0000 7f0a71918640 1 --2- 172.21.15.38:0/1751644572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6c15d540 0x7f0a6c0cdf90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0d1610 tx=0x7f0a5c02b910 comp rx=0 tx=0).stop 2023-12-22T08:39:53.330 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.324+0000 7f0a71918640 1 -- 172.21.15.38:0/1751644572 shutdown_connections 2023-12-22T08:39:53.331 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.324+0000 7f0a71918640 1 --2- 172.21.15.38:0/1751644572 >> v2:172.21.15.89:3300/0 conn(0x7f0a6c0b8510 0x7f0a6c0ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.331 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.324+0000 7f0a71918640 1 --2- 172.21.15.38:0/1751644572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6c15d540 0x7f0a6c0cdf90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.331 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.324+0000 7f0a71918640 1 -- 172.21.15.38:0/1751644572 >> 172.21.15.38:0/1751644572 conn(0x7f0a6c0732a0 msgr2=0x7f0a6c0736b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:53.331 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.324+0000 7f0a71918640 1 -- 172.21.15.38:0/1751644572 shutdown_connections 2023-12-22T08:39:53.331 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.324+0000 7f0a71918640 1 -- 172.21.15.38:0/1751644572 wait complete. 2023-12-22T08:39:53.331 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.326+0000 7f0a71918640 1 Processor -- start 2023-12-22T08:39:53.332 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.327+0000 7f0a71918640 1 -- start start 2023-12-22T08:39:53.336 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.328+0000 7f0a71918640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6c0b6f70 0x7f0a6c152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:53.336 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.328+0000 7f0a71918640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a6c0b8510 0x7f0a6c1e7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:53.337 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.328+0000 7f0a71918640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a6c15d540 0x7f0a6c1f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:53.337 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.328+0000 7f0a71918640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c1524e0 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.337 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.328+0000 7f0a71918640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c1f6ed0 con 0x7f0a6c15d540 2023-12-22T08:39:53.337 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.328+0000 7f0a71918640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c1f71b0 con 0x7f0a6c0b8510 2023-12-22T08:39:53.337 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.328+0000 7f0a6affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6c0b6f70 0x7f0a6c152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:53.338 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.328+0000 7f0a6affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6c0b6f70 0x7f0a6c152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37180/0 (socket says 172.21.15.38:37180) 2023-12-22T08:39:53.338 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.328+0000 7f0a6affd640 1 -- 172.21.15.38:0/1425089795 learned_addr learned my addr 172.21.15.38:0/1425089795 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:53.338 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.329+0000 7f0a6b7fe640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a6c15d540 0x7f0a6c1f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:53.338 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.329+0000 7f0a627fc640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a6c0b8510 0x7f0a6c1e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:53.339 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.329+0000 7f0a6affd640 1 -- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a6c0b8510 msgr2=0x7f0a6c1e7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:53.339 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.329+0000 7f0a6affd640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a6c0b8510 0x7f0a6c1e7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.339 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.329+0000 7f0a6affd640 1 -- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a6c15d540 msgr2=0x7f0a6c1f6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:53.339 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.329+0000 7f0a6affd640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a6c15d540 0x7f0a6c1f6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.339 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.329+0000 7f0a6affd640 1 -- 172.21.15.38:0/1425089795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c0094d0 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.339 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.329+0000 7f0a627fc640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a6c0b8510 0x7f0a6c1e7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:39:53.339 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.329+0000 7f0a6affd640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6c0b6f70 0x7f0a6c152ef0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c000c00 tx=0x7f0a5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:53.340 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.329+0000 7f0a68ff9640 1 -- 172.21.15.38:0/1425089795 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c03abe0 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.340 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.329+0000 7f0a68ff9640 1 -- 172.21.15.38:0/1425089795 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c03ad40 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.341 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.329+0000 7f0a68ff9640 1 -- 172.21.15.38:0/1425089795 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c044610 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.341 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.329+0000 7f0a71918640 1 -- 172.21.15.38:0/1425089795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6c1526f0 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.341 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.330+0000 7f0a71918640 1 -- 172.21.15.38:0/1425089795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c153430 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.341 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.331+0000 7f0a71918640 1 -- 172.21.15.38:0/1425089795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6c152c10 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.341 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.332+0000 7f0a68ff9640 1 -- 172.21.15.38:0/1425089795 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0a5c04d450 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.342 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.333+0000 7f0a68ff9640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a4c06a430 0x7f0a4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:53.342 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.333+0000 7f0a68ff9640 1 -- 172.21.15.38:0/1425089795 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0a5c02d040 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.342 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.333+0000 7f0a627fc640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a4c06a430 0x7f0a4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:53.343 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.334+0000 7f0a627fc640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a4c06a430 0x7f0a4c06c8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0cf840 tx=0x7f0a54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:53.343 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.338+0000 7f0a68ff9640 1 -- 172.21.15.38:0/1425089795 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0a6c152c10 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.537 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.534+0000 7f0a71918640 1 -- 172.21.15.38:0/1425089795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a6c152c10 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.538 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.536+0000 7f0a68ff9640 1 -- 172.21.15.38:0/1425089795 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12334 (secure 0 0 0) 0x7f0a6c152c10 con 0x7f0a6c0b6f70 2023-12-22T08:39:53.539 INFO:teuthology.misc.health.smithi038.stdout: 2023-12-22T08:39:53.539 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":16,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:50.850363+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:39:53.541 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.538+0000 7f0a71918640 1 -- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a4c06a430 msgr2=0x7f0a4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:53.542 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.538+0000 7f0a71918640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a4c06a430 0x7f0a4c06c8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0cf840 tx=0x7f0a54009040 comp rx=0 tx=0).stop 2023-12-22T08:39:53.542 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.538+0000 7f0a71918640 1 -- 172.21.15.38:0/1425089795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6c0b6f70 msgr2=0x7f0a6c152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:53.542 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.538+0000 7f0a71918640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6c0b6f70 0x7f0a6c152ef0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c000c00 tx=0x7f0a5c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.542 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.538+0000 7f0a71918640 1 -- 172.21.15.38:0/1425089795 shutdown_connections 2023-12-22T08:39:53.542 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.538+0000 7f0a71918640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a6c15d540 0x7f0a6c1f6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.542 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.538+0000 7f0a71918640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a6c0b8510 0x7f0a6c1e7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.542 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.538+0000 7f0a71918640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a4c06a430 0x7f0a4c06c8f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.542 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.538+0000 7f0a71918640 1 --2- 172.21.15.38:0/1425089795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a6c0b6f70 0x7f0a6c152ef0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.542 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.539+0000 7f0a71918640 1 -- 172.21.15.38:0/1425089795 >> 172.21.15.38:0/1425089795 conn(0x7f0a6c0732a0 msgr2=0x7f0a6c0d36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:53.542 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.539+0000 7f0a71918640 1 -- 172.21.15.38:0/1425089795 shutdown_connections 2023-12-22T08:39:53.542 INFO:teuthology.misc.health.smithi038.stderr:2023-12-22T08:39:53.539+0000 7f0a71918640 1 -- 172.21.15.38:0/1425089795 wait complete. 2023-12-22T08:39:53.557 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-22T08:39:53.557 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-22T08:39:53.558 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T08:39:53.558 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T08:39:53.566 INFO:tasks.ceph.mds.a:Started 2023-12-22T08:39:53.566 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T08:39:53.567 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T08:39:53.575 INFO:tasks.ceph.mds.c:Started 2023-12-22T08:39:53.575 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T08:39:53.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T08:39:53.584 INFO:tasks.ceph.mds.b:Started 2023-12-22T08:39:53.585 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T08:39:53.585 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T08:39:53.593 INFO:tasks.ceph.mds.d:Started 2023-12-22T08:39:53.594 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-22T08:39:53.594 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:39:53.727 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:39:53.728 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:39:53.754 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-22T08:39:53.758 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-12-22T08:39:53.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.784+0000 7f23e3f22640 1 Processor -- start 2023-12-22T08:39:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.784+0000 7f23e3f22640 1 -- start start 2023-12-22T08:39:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.785+0000 7f23e3f22640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f23dc0d1800 0x7f23dc15dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.785+0000 7f23e3f22640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f23dc146fc0 0x7f23dc15e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.785+0000 7f23e3f22640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc162200 con 0x7f23dc146be0 2023-12-22T08:39:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.785+0000 7f23e3f22640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23dc15ed10 con 0x7f23dc0d1800 2023-12-22T08:39:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.785+0000 7f23e3f22640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23dc161440 con 0x7f23dc146fc0 2023-12-22T08:39:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.786+0000 7f23e24bf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f23dc146fc0 0x7f23dc15e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.786+0000 7f23e1cbe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f23dc146be0 0x7f23dc0d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:37586/0 (socket says 172.21.15.38:37586) 2023-12-22T08:39:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.786+0000 7f23e1cbe640 1 -- 172.21.15.38:0/4185845067 learned_addr learned my addr 172.21.15.38:0/4185845067 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:39:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.786+0000 7f23e14bd640 1 --2- 172.21.15.38:0/4185845067 >> v2:172.21.15.38:3300/0 conn(0x7f23dc0d1800 0x7f23dc15dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.786+0000 7f23e0cbc640 1 -- 172.21.15.38:0/4185845067 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096500939 0 0) 0x7f23dc162200 con 0x7f23dc146be0 2023-12-22T08:39:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.786+0000 7f23e0cbc640 1 -- 172.21.15.38:0/4185845067 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c8003520 con 0x7f23dc146be0 2023-12-22T08:39:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.786+0000 7f23e24bf640 1 -- 172.21.15.38:0/4185845067 >> v2:172.21.15.38:3300/0 conn(0x7f23dc0d1800 msgr2=0x7f23dc15dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.786+0000 7f23e24bf640 1 --2- 172.21.15.38:0/4185845067 >> v2:172.21.15.38:3300/0 conn(0x7f23dc0d1800 0x7f23dc15dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.786+0000 7f23e24bf640 1 -- 172.21.15.38:0/4185845067 >> v1:172.21.15.89:6789/0 conn(0x7f23dc146be0 legacy=0x7f23dc0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.786+0000 7f23e24bf640 1 -- 172.21.15.38:0/4185845067 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc161720 con 0x7f23dc146fc0 2023-12-22T08:39:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.786+0000 7f23e14bd640 1 --2- 172.21.15.38:0/4185845067 >> v2:172.21.15.38:3300/0 conn(0x7f23dc0d1800 0x7f23dc15dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:39:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.787+0000 7f23e24bf640 1 --2- 172.21.15.38:0/4185845067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23dc146fc0 0x7f23dc15e4f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f23dc06d5c0 tx=0x7f23d402bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=418da20e6cdf4bf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:53.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.788+0000 7f23e0cbc640 1 -- 172.21.15.38:0/4185845067 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d402cc70 con 0x7f23dc146fc0 2023-12-22T08:39:53.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.788+0000 7f23e0cbc640 1 -- 172.21.15.38:0/4185845067 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d402cdd0 con 0x7f23dc146fc0 2023-12-22T08:39:53.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.788+0000 7f23e0cbc640 1 -- 172.21.15.38:0/4185845067 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4034660 con 0x7f23dc146fc0 2023-12-22T08:39:53.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.788+0000 7f23e3f22640 1 -- 172.21.15.38:0/4185845067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23dc146fc0 msgr2=0x7f23dc15e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:53.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.788+0000 7f23e3f22640 1 --2- 172.21.15.38:0/4185845067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23dc146fc0 0x7f23dc15e4f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f23dc06d5c0 tx=0x7f23d402bec0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.788+0000 7f23e3f22640 1 -- 172.21.15.38:0/4185845067 shutdown_connections 2023-12-22T08:39:53.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.788+0000 7f23e3f22640 1 --2- 172.21.15.38:0/4185845067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23dc146fc0 0x7f23dc15e4f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.788+0000 7f23e3f22640 1 --2- 172.21.15.38:0/4185845067 >> v2:172.21.15.38:3300/0 conn(0x7f23dc0d1800 0x7f23dc15dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.788+0000 7f23e3f22640 1 -- 172.21.15.38:0/4185845067 >> 172.21.15.38:0/4185845067 conn(0x7f23dc06c5e0 msgr2=0x7f23dc06c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:53.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.789+0000 7f23e3f22640 1 -- 172.21.15.38:0/4185845067 shutdown_connections 2023-12-22T08:39:53.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.789+0000 7f23e3f22640 1 -- 172.21.15.38:0/4185845067 wait complete. 2023-12-22T08:39:53.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.790+0000 7f23e3f22640 1 Processor -- start 2023-12-22T08:39:53.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.790+0000 7f23e3f22640 1 -- start start 2023-12-22T08:39:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.791+0000 7f23e3f22640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23dc0d1800 0x7f23dc144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.791+0000 7f23e3f22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23dc146be0 0x7f23dc0ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.791+0000 7f23e3f22640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23dc146fc0 0x7f23dc1575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.791+0000 7f23e3f22640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0ccfd0 con 0x7f23dc0d1800 2023-12-22T08:39:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.791+0000 7f23e3f22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0cc070 con 0x7f23dc146be0 2023-12-22T08:39:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.791+0000 7f23e3f22640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0cc350 con 0x7f23dc146fc0 2023-12-22T08:39:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.792+0000 7f23e1cbe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23dc0d1800 0x7f23dc144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.792+0000 7f23e1cbe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23dc0d1800 0x7f23dc144e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37220/0 (socket says 172.21.15.38:37220) 2023-12-22T08:39:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.792+0000 7f23e1cbe640 1 -- 172.21.15.38:0/3144308782 learned_addr learned my addr 172.21.15.38:0/3144308782 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.792+0000 7f23e14bd640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23dc146be0 0x7f23dc0ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.792+0000 7f23e24bf640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23dc146fc0 0x7f23dc1575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.792+0000 7f23e1cbe640 1 -- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23dc146fc0 msgr2=0x7f23dc1575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.792+0000 7f23e1cbe640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23dc146fc0 0x7f23dc1575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.792+0000 7f23e1cbe640 1 -- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23dc146be0 msgr2=0x7f23dc0ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.792+0000 7f23e1cbe640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23dc146be0 0x7f23dc0ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.792+0000 7f23e1cbe640 1 -- 172.21.15.38:0/3144308782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc009400 con 0x7f23dc0d1800 2023-12-22T08:39:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.793+0000 7f23e1cbe640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23dc0d1800 0x7f23dc144e20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f23d800c500 tx=0x7f23d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:53.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.793+0000 7f23d27fc640 1 -- 172.21.15.38:0/3144308782 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8005ce0 con 0x7f23dc0d1800 2023-12-22T08:39:53.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.793+0000 7f23d27fc640 1 -- 172.21.15.38:0/3144308782 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d8005e40 con 0x7f23dc0d1800 2023-12-22T08:39:53.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.793+0000 7f23e3f22640 1 -- 172.21.15.38:0/3144308782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d4009a70 con 0x7f23dc0d1800 2023-12-22T08:39:53.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.793+0000 7f23d27fc640 1 -- 172.21.15.38:0/3144308782 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8007330 con 0x7f23dc0d1800 2023-12-22T08:39:53.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.793+0000 7f23e3f22640 1 -- 172.21.15.38:0/3144308782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc0cc910 con 0x7f23dc0d1800 2023-12-22T08:39:53.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.794+0000 7f23e3f22640 1 -- 172.21.15.38:0/3144308782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23dc061910 con 0x7f23dc0d1800 2023-12-22T08:39:53.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.795+0000 7f23d27fc640 1 -- 172.21.15.38:0/3144308782 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f23d8007550 con 0x7f23dc0d1800 2023-12-22T08:39:53.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.796+0000 7f23d27fc640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23c006a430 0x7f23c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:53.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.796+0000 7f23d27fc640 1 -- 172.21.15.38:0/3144308782 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23d8087b30 con 0x7f23dc0d1800 2023-12-22T08:39:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.797+0000 7f23e14bd640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23c006a430 0x7f23c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.797+0000 7f23e14bd640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23c006a430 0x7f23c006c8f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f23dc06b1b0 tx=0x7f23cc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:53.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.801+0000 7f23d27fc640 1 -- 172.21.15.38:0/3144308782 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f23d8053670 con 0x7f23dc0d1800 2023-12-22T08:39:53.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.995+0000 7f23e3f22640 1 -- 172.21.15.38:0/3144308782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23dc06bbc0 con 0x7f23dc0d1800 2023-12-22T08:39:53.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.996+0000 7f23d27fc640 1 -- 172.21.15.38:0/3144308782 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12334 (secure 0 0 0) 0x7f23d8017090 con 0x7f23dc0d1800 2023-12-22T08:39:53.999 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:53.999 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:50.850363+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:39:54.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.999+0000 7f23e3f22640 1 -- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23c006a430 msgr2=0x7f23c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.999+0000 7f23e3f22640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23c006a430 0x7f23c006c8f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f23dc06b1b0 tx=0x7f23cc009190 comp rx=0 tx=0).stop 2023-12-22T08:39:54.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.999+0000 7f23e3f22640 1 -- 172.21.15.38:0/3144308782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23dc0d1800 msgr2=0x7f23dc144e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.999+0000 7f23e3f22640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23dc0d1800 0x7f23dc144e20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f23d800c500 tx=0x7f23d800c9c0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.999+0000 7f23e3f22640 1 -- 172.21.15.38:0/3144308782 shutdown_connections 2023-12-22T08:39:54.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.999+0000 7f23e3f22640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23dc146fc0 0x7f23dc1575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.999+0000 7f23e3f22640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23dc146be0 0x7f23dc0ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.999+0000 7f23e3f22640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23c006a430 0x7f23c006c8f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.999+0000 7f23e3f22640 1 --2- 172.21.15.38:0/3144308782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23dc0d1800 0x7f23dc144e20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.999+0000 7f23e3f22640 1 -- 172.21.15.38:0/3144308782 >> 172.21.15.38:0/3144308782 conn(0x7f23dc06c5e0 msgr2=0x7f23dc06a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:54.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:53.999+0000 7f23e3f22640 1 -- 172.21.15.38:0/3144308782 shutdown_connections 2023-12-22T08:39:54.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.000+0000 7f23e3f22640 1 -- 172.21.15.38:0/3144308782 wait complete. 2023-12-22T08:39:54.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:39:54.022 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:39:54.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.248+0000 7f1e1a23f640 1 Processor -- start 2023-12-22T08:39:54.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.249+0000 7f1e1a23f640 1 -- start start 2023-12-22T08:39:54.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.250+0000 7f1e1a23f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1e14066dd0 0x7f1e1415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.250+0000 7f1e1a23f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e140b0fd0 0x7f1e140b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.250+0000 7f1e1a23f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1415a900 con 0x7f1e14159a10 2023-12-22T08:39:54.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.250+0000 7f1e1a23f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e140b19a0 con 0x7f1e14066dd0 2023-12-22T08:39:54.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.250+0000 7f1e1a23f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1415a620 con 0x7f1e140b0fd0 2023-12-22T08:39:54.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.251+0000 7f1e1923d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1e14066dd0 0x7f1e1415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.251+0000 7f1e1923d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1e14066dd0 0x7f1e1415dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37234/0 (socket says 172.21.15.38:37234) 2023-12-22T08:39:54.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.251+0000 7f1e1923d640 1 -- 172.21.15.38:0/4003572101 learned_addr learned my addr 172.21.15.38:0/4003572101 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:54.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.251+0000 7f1e18a3c640 1 --2- 172.21.15.38:0/4003572101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e140b0fd0 0x7f1e140b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.251+0000 7f1e1923d640 1 -- 172.21.15.38:0/4003572101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e140b0fd0 msgr2=0x7f1e140b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:54.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.251+0000 7f1e0bfff640 1 -- 172.21.15.38:0/4003572101 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870001862 0 0) 0x7f1e1415a900 con 0x7f1e14159a10 2023-12-22T08:39:54.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.251+0000 7f1e1923d640 1 --2- 172.21.15.38:0/4003572101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e140b0fd0 0x7f1e140b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.251+0000 7f1e1923d640 1 -- 172.21.15.38:0/4003572101 >> v1:172.21.15.38:6789/0 conn(0x7f1e14159a10 legacy=0x7f1e14159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.251+0000 7f1e1923d640 1 -- 172.21.15.38:0/4003572101 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1415d0d0 con 0x7f1e14066dd0 2023-12-22T08:39:54.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.251+0000 7f1e18a3c640 1 --2- 172.21.15.38:0/4003572101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e140b0fd0 0x7f1e140b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:39:54.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.252+0000 7f1e1923d640 1 --2- 172.21.15.38:0/4003572101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e14066dd0 0x7f1e1415dbb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009870 tx=0x7f1e1002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae6eefd930e83ad server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:54.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.253+0000 7f1e0bfff640 1 -- 172.21.15.38:0/4003572101 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10030840 con 0x7f1e14066dd0 2023-12-22T08:39:54.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.253+0000 7f1e0bfff640 1 -- 172.21.15.38:0/4003572101 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e100309a0 con 0x7f1e14066dd0 2023-12-22T08:39:54.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.253+0000 7f1e0bfff640 1 -- 172.21.15.38:0/4003572101 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10030d30 con 0x7f1e14066dd0 2023-12-22T08:39:54.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.253+0000 7f1e1a23f640 1 -- 172.21.15.38:0/4003572101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e14066dd0 msgr2=0x7f1e1415dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.253+0000 7f1e1a23f640 1 --2- 172.21.15.38:0/4003572101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e14066dd0 0x7f1e1415dbb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009870 tx=0x7f1e1002b980 comp rx=0 tx=0).stop 2023-12-22T08:39:54.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.253+0000 7f1e1a23f640 1 -- 172.21.15.38:0/4003572101 shutdown_connections 2023-12-22T08:39:54.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.253+0000 7f1e1a23f640 1 --2- 172.21.15.38:0/4003572101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e140b0fd0 0x7f1e140b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.253+0000 7f1e1a23f640 1 --2- 172.21.15.38:0/4003572101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e14066dd0 0x7f1e1415dbb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.253+0000 7f1e1a23f640 1 -- 172.21.15.38:0/4003572101 >> 172.21.15.38:0/4003572101 conn(0x7f1e14070730 msgr2=0x7f1e14070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:54.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.253+0000 7f1e1a23f640 1 -- 172.21.15.38:0/4003572101 shutdown_connections 2023-12-22T08:39:54.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.253+0000 7f1e1a23f640 1 -- 172.21.15.38:0/4003572101 wait complete. 2023-12-22T08:39:54.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.255+0000 7f1e1a23f640 1 Processor -- start 2023-12-22T08:39:54.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.255+0000 7f1e1a23f640 1 -- start start 2023-12-22T08:39:54.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.256+0000 7f1e1a23f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e14066dd0 0x7f1e140aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.256+0000 7f1e1a23f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e140b0fd0 0x7f1e14143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.256+0000 7f1e1a23f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e14159a10 0x7f1e14153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.256+0000 7f1e1a23f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140af560 con 0x7f1e140b0fd0 2023-12-22T08:39:54.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.256+0000 7f1e1a23f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140af840 con 0x7f1e14066dd0 2023-12-22T08:39:54.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.256+0000 7f1e1a23f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140afb20 con 0x7f1e14159a10 2023-12-22T08:39:54.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.256+0000 7f1e18a3c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e140b0fd0 0x7f1e14143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.257+0000 7f1e18a3c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e140b0fd0 0x7f1e14143b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37236/0 (socket says 172.21.15.38:37236) 2023-12-22T08:39:54.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.257+0000 7f1e18a3c640 1 -- 172.21.15.38:0/515153940 learned_addr learned my addr 172.21.15.38:0/515153940 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:54.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.257+0000 7f1e19a3e640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e14159a10 0x7f1e14153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.257+0000 7f1e1923d640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e14066dd0 0x7f1e140aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.257+0000 7f1e18a3c640 1 -- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e14159a10 msgr2=0x7f1e14153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.257+0000 7f1e18a3c640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e14159a10 0x7f1e14153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.257+0000 7f1e18a3c640 1 -- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e14066dd0 msgr2=0x7f1e140aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.257+0000 7f1e18a3c640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e14066dd0 0x7f1e140aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.257+0000 7f1e18a3c640 1 -- 172.21.15.38:0/515153940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e100094d0 con 0x7f1e140b0fd0 2023-12-22T08:39:54.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.257+0000 7f1e18a3c640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e140b0fd0 0x7f1e14143b30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400c7f0 tx=0x7f1e0400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:54.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.258+0000 7f1e09ffb640 1 -- 172.21.15.38:0/515153940 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04007820 con 0x7f1e140b0fd0 2023-12-22T08:39:54.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.258+0000 7f1e09ffb640 1 -- 172.21.15.38:0/515153940 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e04007980 con 0x7f1e140b0fd0 2023-12-22T08:39:54.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.258+0000 7f1e09ffb640 1 -- 172.21.15.38:0/515153940 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04007cf0 con 0x7f1e140b0fd0 2023-12-22T08:39:54.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.258+0000 7f1e1a23f640 1 -- 172.21.15.38:0/515153940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e140afe00 con 0x7f1e140b0fd0 2023-12-22T08:39:54.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.258+0000 7f1e1a23f640 1 -- 172.21.15.38:0/515153940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e14144070 con 0x7f1e140b0fd0 2023-12-22T08:39:54.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.259+0000 7f1e1a23f640 1 -- 172.21.15.38:0/515153940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e14061910 con 0x7f1e140b0fd0 2023-12-22T08:39:54.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.260+0000 7f1e09ffb640 1 -- 172.21.15.38:0/515153940 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1e040113f0 con 0x7f1e140b0fd0 2023-12-22T08:39:54.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.261+0000 7f1e09ffb640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1df806a430 0x7f1df806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.261+0000 7f1e09ffb640 1 -- 172.21.15.38:0/515153940 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1e04088900 con 0x7f1e140b0fd0 2023-12-22T08:39:54.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.262+0000 7f1e1923d640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1df806a430 0x7f1df806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.263+0000 7f1e1923d640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1df806a430 0x7f1df806c8f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1e10036000 tx=0x7f1e1003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:54.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.266+0000 7f1e09ffb640 1 -- 172.21.15.38:0/515153940 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1e04054230 con 0x7f1e140b0fd0 2023-12-22T08:39:54.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.461+0000 7f1e1a23f640 1 -- 172.21.15.38:0/515153940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e1415d380 con 0x7f1e140b0fd0 2023-12-22T08:39:54.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.462+0000 7f1e09ffb640 1 -- 172.21.15.38:0/515153940 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e0401f0a0 con 0x7f1e140b0fd0 2023-12-22T08:39:54.465 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:39:54.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.465+0000 7f1e1a23f640 1 -- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1df806a430 msgr2=0x7f1df806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.465+0000 7f1e1a23f640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1df806a430 0x7f1df806c8f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1e10036000 tx=0x7f1e1003b040 comp rx=0 tx=0).stop 2023-12-22T08:39:54.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.465+0000 7f1e1a23f640 1 -- 172.21.15.38:0/515153940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e140b0fd0 msgr2=0x7f1e14143b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.465+0000 7f1e1a23f640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e140b0fd0 0x7f1e14143b30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400c7f0 tx=0x7f1e0400ccb0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.465+0000 7f1e1a23f640 1 -- 172.21.15.38:0/515153940 shutdown_connections 2023-12-22T08:39:54.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.465+0000 7f1e1a23f640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e14159a10 0x7f1e14153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.465+0000 7f1e1a23f640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1df806a430 0x7f1df806c8f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.465+0000 7f1e1a23f640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e140b0fd0 0x7f1e14143b30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.465+0000 7f1e1a23f640 1 --2- 172.21.15.38:0/515153940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e14066dd0 0x7f1e140aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.465+0000 7f1e1a23f640 1 -- 172.21.15.38:0/515153940 >> 172.21.15.38:0/515153940 conn(0x7f1e14070730 msgr2=0x7f1e140b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:54.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.465+0000 7f1e1a23f640 1 -- 172.21.15.38:0/515153940 shutdown_connections 2023-12-22T08:39:54.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.465+0000 7f1e1a23f640 1 -- 172.21.15.38:0/515153940 wait complete. 2023-12-22T08:39:54.487 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:39:54.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.709+0000 7f3401149640 1 Processor -- start 2023-12-22T08:39:54.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.709+0000 7f3401149640 1 -- start start 2023-12-22T08:39:54.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.711+0000 7f3401149640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33fc15df70 0x7f33fc15e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.711+0000 7f3401149640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33fc0d30b0 con 0x7f33fc15d480 2023-12-22T08:39:54.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.711+0000 7f3401149640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33fc0d1eb0 con 0x7f33fc0d2c30 2023-12-22T08:39:54.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.711+0000 7f3401149640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc0d2150 con 0x7f33fc15df70 2023-12-22T08:39:54.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.712+0000 7f33fbfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f33fc15d480 0x7f33fc0a5140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56814/0 (socket says 172.21.15.38:56814) 2023-12-22T08:39:54.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.712+0000 7f33fbfff640 1 -- 172.21.15.38:0/3249764119 learned_addr learned my addr 172.21.15.38:0/3249764119 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:39:54.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.712+0000 7f3400948640 1 --2- 172.21.15.38:0/3249764119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33fc15df70 0x7f33fc15e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.712+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248930346 0 0) 0x7f33fc0d30b0 con 0x7f33fc15d480 2023-12-22T08:39:54.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.712+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e4003520 con 0x7f33fc15d480 2023-12-22T08:39:54.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.712+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2234965009 0 0) 0x7f33e4003520 con 0x7f33fc15d480 2023-12-22T08:39:54.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.712+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33fc15df70 msgr2=0x7f33fc15e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:54.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.712+0000 7f33faffd640 1 --2- 172.21.15.38:0/3249764119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33fc15df70 0x7f33fc15e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.712+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 >> v1:172.21.15.89:6789/0 conn(0x7f33fc0d2c30 legacy=0x7f33fc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.712+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc0d2430 con 0x7f33fc15d480 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.712+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f33ec001670 con 0x7f33fc15d480 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.712+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 >> v1:172.21.15.38:6789/0 conn(0x7f33fc15d480 legacy=0x7f33fc0a5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33faffd640 1 --2- 172.21.15.38:0/3249764119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e40039a0 0x7f33e4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33faffd640 1 --2- 172.21.15.38:0/3249764119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33e4004350 0x7f33e4004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33faffd640 1 --2- 172.21.15.38:0/3249764119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33fc15df70 0x7f33e4005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc0d2150 con 0x7f33e4004350 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e400ba60 con 0x7f33e40039a0 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e400bc20 con 0x7f33fc15df70 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33fb7fe640 1 --2- 172.21.15.38:0/3249764119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33e4004350 0x7f33e4004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33fbfff640 1 --2- 172.21.15.38:0/3249764119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e40039a0 0x7f33e4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f3400948640 1 --2- 172.21.15.38:0/3249764119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33fc15df70 0x7f33e4005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33fb7fe640 1 -- 172.21.15.38:0/3249764119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33fc15df70 msgr2=0x7f33e4005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33fb7fe640 1 --2- 172.21.15.38:0/3249764119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33fc15df70 0x7f33e4005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33fb7fe640 1 -- 172.21.15.38:0/3249764119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e40039a0 msgr2=0x7f33e4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:54.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33fb7fe640 1 --2- 172.21.15.38:0/3249764119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e40039a0 0x7f33e4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33fb7fe640 1 -- 172.21.15.38:0/3249764119 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e4003520 con 0x7f33e4004350 2023-12-22T08:39:54.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.713+0000 7f33fbfff640 1 --2- 172.21.15.38:0/3249764119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33e40039a0 0x7f33e4003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:39:54.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.715+0000 7f33fb7fe640 1 --2- 172.21.15.38:0/3249764119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33e4004350 0x7f33e4004820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f33f0001910 tx=0x7f33e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a3b15e9b16f46a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:54.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.715+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0032620 con 0x7f33e4004350 2023-12-22T08:39:54.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.715+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f0032780 con 0x7f33e4004350 2023-12-22T08:39:54.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.715+0000 7f33faffd640 1 -- 172.21.15.38:0/3249764119 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0032b10 con 0x7f33e4004350 2023-12-22T08:39:54.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.715+0000 7f3401149640 1 -- 172.21.15.38:0/3249764119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33e4004350 msgr2=0x7f33e4004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.715+0000 7f3401149640 1 --2- 172.21.15.38:0/3249764119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33e4004350 0x7f33e4004820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f33f0001910 tx=0x7f33e40057f0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.715+0000 7f3400948640 1 -- 172.21.15.38:0/3249764119 reap_dead start 2023-12-22T08:39:54.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.716+0000 7f3401149640 1 -- 172.21.15.38:0/3249764119 shutdown_connections 2023-12-22T08:39:54.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.716+0000 7f3401149640 1 -- 172.21.15.38:0/3249764119 >> 172.21.15.38:0/3249764119 conn(0x7f33fc06ced0 msgr2=0x7f33fc071260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:54.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.716+0000 7f3401149640 1 -- 172.21.15.38:0/3249764119 shutdown_connections 2023-12-22T08:39:54.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.716+0000 7f3401149640 1 -- 172.21.15.38:0/3249764119 wait complete. 2023-12-22T08:39:54.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.717+0000 7f3401149640 1 Processor -- start 2023-12-22T08:39:54.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.718+0000 7f3401149640 1 -- start start 2023-12-22T08:39:54.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f3401149640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33e4004350 0x7f33fc146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f3401149640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33fc1f23f0 0x7f33fc160980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f3401149640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33fc160ec0 0x7f33fc15fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f3401149640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc1521d0 con 0x7f33e4004350 2023-12-22T08:39:54.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f3401149640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc161340 con 0x7f33fc1f23f0 2023-12-22T08:39:54.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f3401149640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc146b80 con 0x7f33fc160ec0 2023-12-22T08:39:54.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f33fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33e4004350 0x7f33fc146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f33fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33e4004350 0x7f33fc146640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37252/0 (socket says 172.21.15.38:37252) 2023-12-22T08:39:54.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f33fbfff640 1 -- 172.21.15.38:0/322145586 learned_addr learned my addr 172.21.15.38:0/322145586 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:54.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f33fb7fe640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33fc1f23f0 0x7f33fc160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f3400948640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33fc160ec0 0x7f33fc15fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f33fbfff640 1 -- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33fc160ec0 msgr2=0x7f33fc15fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f33fbfff640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33fc160ec0 0x7f33fc15fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f33fbfff640 1 -- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33fc1f23f0 msgr2=0x7f33fc160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f33fbfff640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33fc1f23f0 0x7f33fc160980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.719+0000 7f33fbfff640 1 -- 172.21.15.38:0/322145586 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc1523e0 con 0x7f33e4004350 2023-12-22T08:39:54.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.720+0000 7f33fbfff640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33e4004350 0x7f33fc146640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00e730 tx=0x7f33ec00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:54.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.720+0000 7f33f8ff9640 1 -- 172.21.15.38:0/322145586 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00c6c0 con 0x7f33e4004350 2023-12-22T08:39:54.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.720+0000 7f33f8ff9640 1 -- 172.21.15.38:0/322145586 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec00c820 con 0x7f33e4004350 2023-12-22T08:39:54.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.720+0000 7f33f8ff9640 1 -- 172.21.15.38:0/322145586 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00cbd0 con 0x7f33e4004350 2023-12-22T08:39:54.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.720+0000 7f3401149640 1 -- 172.21.15.38:0/322145586 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33fc1526c0 con 0x7f33e4004350 2023-12-22T08:39:54.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.720+0000 7f3401149640 1 -- 172.21.15.38:0/322145586 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33fc152c80 con 0x7f33e4004350 2023-12-22T08:39:54.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.721+0000 7f3401149640 1 -- 172.21.15.38:0/322145586 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33fc061910 con 0x7f33e4004350 2023-12-22T08:39:54.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.722+0000 7f33f8ff9640 1 -- 172.21.15.38:0/322145586 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f33ec00cd30 con 0x7f33e4004350 2023-12-22T08:39:54.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.723+0000 7f33f8ff9640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f33e806a430 0x7f33e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:54.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.723+0000 7f33f8ff9640 1 -- 172.21.15.38:0/322145586 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f33ec088390 con 0x7f33e4004350 2023-12-22T08:39:54.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.724+0000 7f33fb7fe640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f33e806a430 0x7f33e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:54.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.725+0000 7f33fb7fe640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f33e806a430 0x7f33e806c8f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f33f0036000 tx=0x7f33f0009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:54.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.727+0000 7f33f8ff9640 1 -- 172.21.15.38:0/322145586 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f33ec053cd0 con 0x7f33e4004350 2023-12-22T08:39:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.958+0000 7f3401149640 1 -- 172.21.15.38:0/322145586 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33fc071e30 con 0x7f33e4004350 2023-12-22T08:39:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.959+0000 7f33f8ff9640 1 -- 172.21.15.38:0/322145586 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f33ec0572f0 con 0x7f33e4004350 2023-12-22T08:39:54.961 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:54.962 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/444746330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":444746330},{"type":"v1","addr":"172.21.15.38:6833","nonce":444746330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/3918267418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":3918267418},{"type":"v1","addr":"172.21.15.38:6835","nonce":3918267418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2511997570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2511997570},{"type":"v1","addr":"172.21.15.89:6835","nonce":2511997570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2902919630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2902919630},{"type":"v1","addr":"172.21.15.89:6837","nonce":2902919630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-22T08:39:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 3 2023-12-22T08:39:54.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.961+0000 7f3401149640 1 -- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f33e806a430 msgr2=0x7f33e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.961+0000 7f3401149640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f33e806a430 0x7f33e806c8f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f33f0036000 tx=0x7f33f0009030 comp rx=0 tx=0).stop 2023-12-22T08:39:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.961+0000 7f3401149640 1 -- 172.21.15.38:0/322145586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33e4004350 msgr2=0x7f33fc146640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.961+0000 7f3401149640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33e4004350 0x7f33fc146640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00e730 tx=0x7f33ec00ebf0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.961+0000 7f3401149640 1 -- 172.21.15.38:0/322145586 shutdown_connections 2023-12-22T08:39:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.961+0000 7f3401149640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33fc160ec0 0x7f33fc15fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.961+0000 7f3401149640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33fc1f23f0 0x7f33fc160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.961+0000 7f3401149640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f33e806a430 0x7f33e806c8f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.961+0000 7f3401149640 1 --2- 172.21.15.38:0/322145586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f33e4004350 0x7f33fc146640 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.961+0000 7f3401149640 1 -- 172.21.15.38:0/322145586 >> 172.21.15.38:0/322145586 conn(0x7f33fc06ced0 msgr2=0x7f33fc06f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.962+0000 7f3401149640 1 -- 172.21.15.38:0/322145586 shutdown_connections 2023-12-22T08:39:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:54.962+0000 7f3401149640 1 -- 172.21.15.38:0/322145586 wait complete. 2023-12-22T08:39:54.984 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:39:55.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.211+0000 7f55dbfff640 1 Processor -- start 2023-12-22T08:39:55.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.212+0000 7f55dbfff640 1 -- start start 2023-12-22T08:39:55.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.213+0000 7f55dbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f55dc15b420 0x7f55dc06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:55.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.213+0000 7f55dbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55dc0a44a0 0x7f55dc0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:55.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.214+0000 7f55dbfff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55dc0cdae0 con 0x7f55dc070e30 2023-12-22T08:39:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.214+0000 7f55dbfff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55dc06dec0 con 0x7f55dc15b420 2023-12-22T08:39:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.214+0000 7f55dbfff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55dc071250 con 0x7f55dc0a44a0 2023-12-22T08:39:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.214+0000 7f55db7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f55dc070e30 0x7f55dc06f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56820/0 (socket says 172.21.15.38:56820) 2023-12-22T08:39:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.214+0000 7f55db7fe640 1 -- 172.21.15.38:0/948002898 learned_addr learned my addr 172.21.15.38:0/948002898 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:39:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.214+0000 7f55daffd640 1 --2- 172.21.15.38:0/948002898 >> v2:172.21.15.38:3300/0 conn(0x7f55dc15b420 0x7f55dc06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.214+0000 7f55d3fff640 1 --2- 172.21.15.38:0/948002898 >> v2:172.21.15.89:3300/0 conn(0x7f55dc0a44a0 0x7f55dc0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:55.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.214+0000 7f55daffd640 1 -- 172.21.15.38:0/948002898 >> v2:172.21.15.89:3300/0 conn(0x7f55dc0a44a0 msgr2=0x7f55dc0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:55.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.214+0000 7f55daffd640 1 --2- 172.21.15.38:0/948002898 >> v2:172.21.15.89:3300/0 conn(0x7f55dc0a44a0 0x7f55dc0708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.214+0000 7f55daffd640 1 -- 172.21.15.38:0/948002898 >> v1:172.21.15.38:6789/0 conn(0x7f55dc070e30 legacy=0x7f55dc06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:55.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.215+0000 7f55daffd640 1 -- 172.21.15.38:0/948002898 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc15b800 con 0x7f55dc15b420 2023-12-22T08:39:55.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.216+0000 7f55daffd640 1 --2- 172.21.15.38:0/948002898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc15b420 0x7f55dc06d980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f55dc06bb90 tx=0x7f55cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb25e0b79af43c69 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:55.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.216+0000 7f55da7fc640 1 -- 172.21.15.38:0/948002898 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc031830 con 0x7f55dc15b420 2023-12-22T08:39:55.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.216+0000 7f55da7fc640 1 -- 172.21.15.38:0/948002898 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc031990 con 0x7f55dc15b420 2023-12-22T08:39:55.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.216+0000 7f55da7fc640 1 -- 172.21.15.38:0/948002898 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc031d20 con 0x7f55dc15b420 2023-12-22T08:39:55.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.216+0000 7f55dbfff640 1 -- 172.21.15.38:0/948002898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc15b420 msgr2=0x7f55dc06d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:55.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.216+0000 7f55dbfff640 1 --2- 172.21.15.38:0/948002898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc15b420 0x7f55dc06d980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f55dc06bb90 tx=0x7f55cc02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.217+0000 7f55dbfff640 1 -- 172.21.15.38:0/948002898 shutdown_connections 2023-12-22T08:39:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.217+0000 7f55dbfff640 1 --2- 172.21.15.38:0/948002898 >> v2:172.21.15.89:3300/0 conn(0x7f55dc0a44a0 0x7f55dc0708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.217+0000 7f55dbfff640 1 --2- 172.21.15.38:0/948002898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc15b420 0x7f55dc06d980 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.217+0000 7f55dbfff640 1 -- 172.21.15.38:0/948002898 >> 172.21.15.38:0/948002898 conn(0x7f55dc0b1f70 msgr2=0x7f55dc0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.217+0000 7f55dbfff640 1 -- 172.21.15.38:0/948002898 shutdown_connections 2023-12-22T08:39:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.217+0000 7f55dbfff640 1 -- 172.21.15.38:0/948002898 wait complete. 2023-12-22T08:39:55.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.219+0000 7f55dbfff640 1 Processor -- start 2023-12-22T08:39:55.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.219+0000 7f55dbfff640 1 -- start start 2023-12-22T08:39:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55dbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc070e30 0x7f55dc151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55dbfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55dc0a44a0 0x7f55dc1f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55dbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55dc15b420 0x7f55dc1f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55dbfff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc154ab0 con 0x7f55dc070e30 2023-12-22T08:39:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55dbfff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc0a1ce0 con 0x7f55dc15b420 2023-12-22T08:39:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55dbfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc154210 con 0x7f55dc0a44a0 2023-12-22T08:39:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55daffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc070e30 0x7f55dc151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55daffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc070e30 0x7f55dc151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37272/0 (socket says 172.21.15.38:37272) 2023-12-22T08:39:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55daffd640 1 -- 172.21.15.38:0/2925401083 learned_addr learned my addr 172.21.15.38:0/2925401083 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55d3fff640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55dc0a44a0 0x7f55dc1f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55db7fe640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55dc15b420 0x7f55dc1f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55daffd640 1 -- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55dc0a44a0 msgr2=0x7f55dc1f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55daffd640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55dc0a44a0 0x7f55dc1f6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55daffd640 1 -- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55dc15b420 msgr2=0x7f55dc1f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.220+0000 7f55daffd640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55dc15b420 0x7f55dc1f65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.221+0000 7f55daffd640 1 -- 172.21.15.38:0/2925401083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc009400 con 0x7f55dc070e30 2023-12-22T08:39:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.221+0000 7f55daffd640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc070e30 0x7f55dc151b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009890 tx=0x7f55cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:55.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.221+0000 7f55d37fe640 1 -- 172.21.15.38:0/2925401083 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc03ba70 con 0x7f55dc070e30 2023-12-22T08:39:55.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.221+0000 7f55d37fe640 1 -- 172.21.15.38:0/2925401083 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc03bbf0 con 0x7f55dc070e30 2023-12-22T08:39:55.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.221+0000 7f55d37fe640 1 -- 172.21.15.38:0/2925401083 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc045400 con 0x7f55dc070e30 2023-12-22T08:39:55.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.221+0000 7f55dbfff640 1 -- 172.21.15.38:0/2925401083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55dc1544f0 con 0x7f55dc070e30 2023-12-22T08:39:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.221+0000 7f55dbfff640 1 -- 172.21.15.38:0/2925401083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55dc152050 con 0x7f55dc070e30 2023-12-22T08:39:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.222+0000 7f55dbfff640 1 -- 172.21.15.38:0/2925401083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55dc0a1a40 con 0x7f55dc070e30 2023-12-22T08:39:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.223+0000 7f55d37fe640 1 -- 172.21.15.38:0/2925401083 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f55cc04e440 con 0x7f55dc070e30 2023-12-22T08:39:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.224+0000 7f55d37fe640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f55bc06a430 0x7f55bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.224+0000 7f55d37fe640 1 -- 172.21.15.38:0/2925401083 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f55cc0aa840 con 0x7f55dc070e30 2023-12-22T08:39:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.225+0000 7f55d3fff640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f55bc06a430 0x7f55bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:55.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.226+0000 7f55d3fff640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f55bc06a430 0x7f55bc06c8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f55dc066130 tx=0x7f55c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:55.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.229+0000 7f55d37fe640 1 -- 172.21.15.38:0/2925401083 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f55dc0a1a40 con 0x7f55dc070e30 2023-12-22T08:39:55.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.420+0000 7f55dbfff640 1 -- 172.21.15.38:0/2925401083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55dc0a1a40 con 0x7f55dc070e30 2023-12-22T08:39:55.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.422+0000 7f55d37fe640 1 -- 172.21.15.38:0/2925401083 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12334 (secure 0 0 0) 0x7f55dc0a1a40 con 0x7f55dc070e30 2023-12-22T08:39:55.425 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:55.425 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:50.850363+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:39:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.425+0000 7f55dbfff640 1 -- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f55bc06a430 msgr2=0x7f55bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.425+0000 7f55dbfff640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f55bc06a430 0x7f55bc06c8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f55dc066130 tx=0x7f55c4008040 comp rx=0 tx=0).stop 2023-12-22T08:39:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.425+0000 7f55dbfff640 1 -- 172.21.15.38:0/2925401083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc070e30 msgr2=0x7f55dc151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.425+0000 7f55dbfff640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc070e30 0x7f55dc151b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009890 tx=0x7f55cc0046c0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.425+0000 7f55dbfff640 1 -- 172.21.15.38:0/2925401083 shutdown_connections 2023-12-22T08:39:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.425+0000 7f55dbfff640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55dc15b420 0x7f55dc1f65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.425+0000 7f55dbfff640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55dc0a44a0 0x7f55dc1f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.425+0000 7f55dbfff640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f55bc06a430 0x7f55bc06c8f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.425+0000 7f55dbfff640 1 --2- 172.21.15.38:0/2925401083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc070e30 0x7f55dc151b10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.425+0000 7f55dbfff640 1 -- 172.21.15.38:0/2925401083 >> 172.21.15.38:0/2925401083 conn(0x7f55dc0b1f70 msgr2=0x7f55dc09de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:55.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.426+0000 7f55dbfff640 1 -- 172.21.15.38:0/2925401083 shutdown_connections 2023-12-22T08:39:55.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.426+0000 7f55dbfff640 1 -- 172.21.15.38:0/2925401083 wait complete. 2023-12-22T08:39:55.450 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:39:55.450 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:39:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.680+0000 7f43e350a640 1 Processor -- start 2023-12-22T08:39:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.680+0000 7f43e350a640 1 -- start start 2023-12-22T08:39:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.681+0000 7f43e350a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc1619c0 0x7f43dc0b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.681+0000 7f43e350a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f43dc06f960 0x7f43dc161da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.682+0000 7f43e350a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43dc0ce6e0 con 0x7f43dc0ceb70 2023-12-22T08:39:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.682+0000 7f43e350a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc0b4db0 con 0x7f43dc06f960 2023-12-22T08:39:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.682+0000 7f43e350a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0b5090 con 0x7f43dc1619c0 2023-12-22T08:39:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.682+0000 7f43e1aa7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f43dc06f960 0x7f43dc161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.682+0000 7f43e1aa7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f43dc06f960 0x7f43dc161da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37282/0 (socket says 172.21.15.38:37282) 2023-12-22T08:39:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.682+0000 7f43e1aa7640 1 -- 172.21.15.38:0/82609729 learned_addr learned my addr 172.21.15.38:0/82609729 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.682+0000 7f43e12a6640 1 --2- 172.21.15.38:0/82609729 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc1619c0 0x7f43dc0b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.683+0000 7f43e1aa7640 1 -- 172.21.15.38:0/82609729 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc1619c0 msgr2=0x7f43dc0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.683+0000 7f43e1aa7640 1 --2- 172.21.15.38:0/82609729 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc1619c0 0x7f43dc0b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.683+0000 7f43e1aa7640 1 -- 172.21.15.38:0/82609729 >> v1:172.21.15.89:6789/0 conn(0x7f43dc0ceb70 legacy=0x7f43dc06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.683+0000 7f43e1aa7640 1 -- 172.21.15.38:0/82609729 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0ce370 con 0x7f43dc06f960 2023-12-22T08:39:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.685+0000 7f43e1aa7640 1 --2- 172.21.15.38:0/82609729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43dc06f960 0x7f43dc161da0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009e50 tx=0x7f43d402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770071782032f6ff server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.685+0000 7f43d3fff640 1 -- 172.21.15.38:0/82609729 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d402cb00 con 0x7f43dc06f960 2023-12-22T08:39:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.685+0000 7f43d3fff640 1 -- 172.21.15.38:0/82609729 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d402cc60 con 0x7f43dc06f960 2023-12-22T08:39:55.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.685+0000 7f43d3fff640 1 -- 172.21.15.38:0/82609729 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40343f0 con 0x7f43dc06f960 2023-12-22T08:39:55.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.686+0000 7f43e350a640 1 -- 172.21.15.38:0/82609729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43dc06f960 msgr2=0x7f43dc161da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.686+0000 7f43e350a640 1 --2- 172.21.15.38:0/82609729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43dc06f960 0x7f43dc161da0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009e50 tx=0x7f43d402bf60 comp rx=0 tx=0).stop 2023-12-22T08:39:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.686+0000 7f43e350a640 1 -- 172.21.15.38:0/82609729 shutdown_connections 2023-12-22T08:39:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.686+0000 7f43e350a640 1 --2- 172.21.15.38:0/82609729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43dc06f960 0x7f43dc161da0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.686+0000 7f43e350a640 1 --2- 172.21.15.38:0/82609729 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc1619c0 0x7f43dc0b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.686+0000 7f43e350a640 1 -- 172.21.15.38:0/82609729 >> 172.21.15.38:0/82609729 conn(0x7f43dc0b20c0 msgr2=0x7f43dc0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.686+0000 7f43e350a640 1 -- 172.21.15.38:0/82609729 shutdown_connections 2023-12-22T08:39:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.686+0000 7f43e350a640 1 -- 172.21.15.38:0/82609729 wait complete. 2023-12-22T08:39:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.688+0000 7f43e350a640 1 Processor -- start 2023-12-22T08:39:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.688+0000 7f43e350a640 1 -- start start 2023-12-22T08:39:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.689+0000 7f43e350a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc06f960 0x7f43dc15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.689+0000 7f43e350a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0ceb70 0x7f43dc1493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.689+0000 7f43e350a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43dc1619c0 0x7f43dc160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.689+0000 7f43e350a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc149ce0 con 0x7f43dc1619c0 2023-12-22T08:39:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.689+0000 7f43e350a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc149930 con 0x7f43dc0ceb70 2023-12-22T08:39:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.689+0000 7f43e350a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc149f50 con 0x7f43dc06f960 2023-12-22T08:39:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.690+0000 7f43e1aa7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43dc1619c0 0x7f43dc160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.690+0000 7f43e1aa7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43dc1619c0 0x7f43dc160420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37294/0 (socket says 172.21.15.38:37294) 2023-12-22T08:39:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.690+0000 7f43e1aa7640 1 -- 172.21.15.38:0/2227291627 learned_addr learned my addr 172.21.15.38:0/2227291627 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.690+0000 7f43e12a6640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc06f960 0x7f43dc15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.690+0000 7f43e0aa5640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0ceb70 0x7f43dc1493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.690+0000 7f43e1aa7640 1 -- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc06f960 msgr2=0x7f43dc15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.690+0000 7f43e1aa7640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc06f960 0x7f43dc15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.690+0000 7f43e1aa7640 1 -- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0ceb70 msgr2=0x7f43dc1493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.690+0000 7f43e1aa7640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0ceb70 0x7f43dc1493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.690+0000 7f43e1aa7640 1 -- 172.21.15.38:0/2227291627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4009b30 con 0x7f43dc1619c0 2023-12-22T08:39:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.691+0000 7f43e1aa7640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43dc1619c0 0x7f43dc160420 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f43d4036040 tx=0x7f43d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.691+0000 7f43d1ffb640 1 -- 172.21.15.38:0/2227291627 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4009510 con 0x7f43dc1619c0 2023-12-22T08:39:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.691+0000 7f43d1ffb640 1 -- 172.21.15.38:0/2227291627 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d403e450 con 0x7f43dc1619c0 2023-12-22T08:39:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.691+0000 7f43e350a640 1 -- 172.21.15.38:0/2227291627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc14a230 con 0x7f43dc1619c0 2023-12-22T08:39:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.691+0000 7f43d1ffb640 1 -- 172.21.15.38:0/2227291627 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d403e800 con 0x7f43dc1619c0 2023-12-22T08:39:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.691+0000 7f43e350a640 1 -- 172.21.15.38:0/2227291627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc14a7f0 con 0x7f43dc1619c0 2023-12-22T08:39:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.692+0000 7f43e350a640 1 -- 172.21.15.38:0/2227291627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc0b4a60 con 0x7f43dc1619c0 2023-12-22T08:39:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.693+0000 7f43d1ffb640 1 -- 172.21.15.38:0/2227291627 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f43d403e960 con 0x7f43dc1619c0 2023-12-22T08:39:55.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.694+0000 7f43d1ffb640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f43c006a430 0x7f43c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:55.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.694+0000 7f43d1ffb640 1 -- 172.21.15.38:0/2227291627 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f43d40ab330 con 0x7f43dc1619c0 2023-12-22T08:39:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.695+0000 7f43e12a6640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f43c006a430 0x7f43c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:55.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.696+0000 7f43e12a6640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f43c006a430 0x7f43c006c8f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009a30 tx=0x7f43d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:55.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.698+0000 7f43d1ffb640 1 -- 172.21.15.38:0/2227291627 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f43d4076c70 con 0x7f43dc1619c0 2023-12-22T08:39:55.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.892+0000 7f43e350a640 1 -- 172.21.15.38:0/2227291627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43dc061910 con 0x7f43dc1619c0 2023-12-22T08:39:55.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.893+0000 7f43d1ffb640 1 -- 172.21.15.38:0/2227291627 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43d407a290 con 0x7f43dc1619c0 2023-12-22T08:39:55.896 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:39:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.896+0000 7f43e350a640 1 -- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f43c006a430 msgr2=0x7f43c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.896+0000 7f43e350a640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f43c006a430 0x7f43c006c8f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009a30 tx=0x7f43d8008040 comp rx=0 tx=0).stop 2023-12-22T08:39:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.896+0000 7f43e350a640 1 -- 172.21.15.38:0/2227291627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43dc1619c0 msgr2=0x7f43dc160420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.896+0000 7f43e350a640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43dc1619c0 0x7f43dc160420 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f43d4036040 tx=0x7f43d4004a40 comp rx=0 tx=0).stop 2023-12-22T08:39:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.896+0000 7f43e350a640 1 -- 172.21.15.38:0/2227291627 shutdown_connections 2023-12-22T08:39:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.896+0000 7f43e350a640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f43c006a430 0x7f43c006c8f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.896+0000 7f43e350a640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43dc1619c0 0x7f43dc160420 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.896+0000 7f43e350a640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43dc0ceb70 0x7f43dc1493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.896+0000 7f43e350a640 1 --2- 172.21.15.38:0/2227291627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43dc06f960 0x7f43dc15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.896+0000 7f43e350a640 1 -- 172.21.15.38:0/2227291627 >> 172.21.15.38:0/2227291627 conn(0x7f43dc0b20c0 msgr2=0x7f43dc0b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.896+0000 7f43e350a640 1 -- 172.21.15.38:0/2227291627 shutdown_connections 2023-12-22T08:39:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:55.896+0000 7f43e350a640 1 -- 172.21.15.38:0/2227291627 wait complete. 2023-12-22T08:39:55.919 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T08:39:56.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.145+0000 7f7700b6d640 1 Processor -- start 2023-12-22T08:39:56.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.145+0000 7f7700b6d640 1 -- start start 2023-12-22T08:39:56.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.146+0000 7f7700b6d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76fc144d10 0x7f76fc0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:56.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.146+0000 7f7700b6d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76fc0cc670 0x7f76fc0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:56.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.147+0000 7f7700b6d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76fc1450f0 con 0x7f76fc0b2590 2023-12-22T08:39:56.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.147+0000 7f7700b6d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76fc0b2a20 con 0x7f76fc0cc670 2023-12-22T08:39:56.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.147+0000 7f7700b6d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc0ce010 con 0x7f76fc144d10 2023-12-22T08:39:56.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.147+0000 7f76f9d9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76fc0cc670 0x7f76fc0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:56.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.147+0000 7f76f9d9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76fc0cc670 0x7f76fc0b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37302/0 (socket says 172.21.15.38:37302) 2023-12-22T08:39:56.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.147+0000 7f76f9d9b640 1 -- 172.21.15.38:0/2075203264 learned_addr learned my addr 172.21.15.38:0/2075203264 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:56.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.147+0000 7f76fa59c640 1 --2- 172.21.15.38:0/2075203264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76fc144d10 0x7f76fc0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:56.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.147+0000 7f76f9d9b640 1 -- 172.21.15.38:0/2075203264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76fc144d10 msgr2=0x7f76fc0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:56.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.147+0000 7f76f9d9b640 1 --2- 172.21.15.38:0/2075203264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76fc144d10 0x7f76fc0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.147+0000 7f76f9d9b640 1 -- 172.21.15.38:0/2075203264 >> v1:172.21.15.89:6789/0 conn(0x7f76fc0b2590 legacy=0x7f76fc15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:56.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.148+0000 7f76f9d9b640 1 -- 172.21.15.38:0/2075203264 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc0ce2f0 con 0x7f76fc0cc670 2023-12-22T08:39:56.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.149+0000 7f76f9d9b640 1 --2- 172.21.15.38:0/2075203264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0cc670 0x7f76fc0b2050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009870 tx=0x7f76f002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d939f62b73c2c05 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:56.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.149+0000 7f76f959a640 1 -- 172.21.15.38:0/2075203264 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0030840 con 0x7f76fc0cc670 2023-12-22T08:39:56.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.149+0000 7f76f959a640 1 -- 172.21.15.38:0/2075203264 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f00309a0 con 0x7f76fc0cc670 2023-12-22T08:39:56.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.149+0000 7f76f959a640 1 -- 172.21.15.38:0/2075203264 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0030d30 con 0x7f76fc0cc670 2023-12-22T08:39:56.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.150+0000 7f7700b6d640 1 -- 172.21.15.38:0/2075203264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0cc670 msgr2=0x7f76fc0b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:56.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.150+0000 7f7700b6d640 1 --2- 172.21.15.38:0/2075203264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0cc670 0x7f76fc0b2050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009870 tx=0x7f76f002b980 comp rx=0 tx=0).stop 2023-12-22T08:39:56.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.150+0000 7f7700b6d640 1 -- 172.21.15.38:0/2075203264 shutdown_connections 2023-12-22T08:39:56.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.150+0000 7f7700b6d640 1 --2- 172.21.15.38:0/2075203264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc0cc670 0x7f76fc0b2050 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.150+0000 7f7700b6d640 1 --2- 172.21.15.38:0/2075203264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76fc144d10 0x7f76fc0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.150+0000 7f7700b6d640 1 -- 172.21.15.38:0/2075203264 >> 172.21.15.38:0/2075203264 conn(0x7f76fc0cf070 msgr2=0x7f76fc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:56.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.150+0000 7f7700b6d640 1 -- 172.21.15.38:0/2075203264 shutdown_connections 2023-12-22T08:39:56.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.150+0000 7f7700b6d640 1 -- 172.21.15.38:0/2075203264 wait complete. 2023-12-22T08:39:56.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.152+0000 7f7700b6d640 1 Processor -- start 2023-12-22T08:39:56.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.152+0000 7f7700b6d640 1 -- start start 2023-12-22T08:39:56.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.153+0000 7f7700b6d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76fc0b2590 0x7f76fc13f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:56.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.153+0000 7f7700b6d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76fc144d10 0x7f76fc139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:56.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.153+0000 7f7700b6d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc13e1c0 0x7f76fc13e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:56.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.153+0000 7f7700b6d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc142e40 con 0x7f76fc13e1c0 2023-12-22T08:39:56.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.153+0000 7f7700b6d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc143120 con 0x7f76fc0b2590 2023-12-22T08:39:56.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.153+0000 7f7700b6d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc143400 con 0x7f76fc144d10 2023-12-22T08:39:56.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.153+0000 7f76fad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc13e1c0 0x7f76fc13e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:56.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.153+0000 7f76fad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc13e1c0 0x7f76fc13e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37304/0 (socket says 172.21.15.38:37304) 2023-12-22T08:39:56.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.153+0000 7f76fad9d640 1 -- 172.21.15.38:0/3539243399 learned_addr learned my addr 172.21.15.38:0/3539243399 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:56.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.154+0000 7f76fa59c640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76fc0b2590 0x7f76fc13f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:56.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.154+0000 7f76f9d9b640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76fc144d10 0x7f76fc139880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:56.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.154+0000 7f76fad9d640 1 -- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76fc144d10 msgr2=0x7f76fc139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:56.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.154+0000 7f76fad9d640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76fc144d10 0x7f76fc139880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.154+0000 7f76fad9d640 1 -- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76fc0b2590 msgr2=0x7f76fc13f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:56.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.154+0000 7f76fad9d640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76fc0b2590 0x7f76fc13f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.154+0000 7f76fad9d640 1 -- 172.21.15.38:0/3539243399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f00094d0 con 0x7f76fc13e1c0 2023-12-22T08:39:56.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.154+0000 7f76fad9d640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc13e1c0 0x7f76fc13e670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f76f4001eb0 tx=0x7f76f400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:56.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.154+0000 7f76eaffd640 1 -- 172.21.15.38:0/3539243399 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40052d0 con 0x7f76fc13e1c0 2023-12-22T08:39:56.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.155+0000 7f76eaffd640 1 -- 172.21.15.38:0/3539243399 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f4005430 con 0x7f76fc13e1c0 2023-12-22T08:39:56.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.155+0000 7f76eaffd640 1 -- 172.21.15.38:0/3539243399 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4003810 con 0x7f76fc13e1c0 2023-12-22T08:39:56.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.155+0000 7f7700b6d640 1 -- 172.21.15.38:0/3539243399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76fc1436e0 con 0x7f76fc13e1c0 2023-12-22T08:39:56.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.155+0000 7f7700b6d640 1 -- 172.21.15.38:0/3539243399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76fc157150 con 0x7f76fc13e1c0 2023-12-22T08:39:56.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.156+0000 7f7700b6d640 1 -- 172.21.15.38:0/3539243399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76fc142f80 con 0x7f76fc13e1c0 2023-12-22T08:39:56.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.157+0000 7f76eaffd640 1 -- 172.21.15.38:0/3539243399 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f76f4003970 con 0x7f76fc13e1c0 2023-12-22T08:39:56.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.158+0000 7f76eaffd640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76dc06a430 0x7f76dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:56.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.158+0000 7f76eaffd640 1 -- 172.21.15.38:0/3539243399 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76f4087c10 con 0x7f76fc13e1c0 2023-12-22T08:39:56.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.159+0000 7f76fa59c640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76dc06a430 0x7f76dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:56.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.160+0000 7f76fa59c640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76dc06a430 0x7f76dc06c8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0099c0 tx=0x7f76ec003990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:56.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.163+0000 7f76eaffd640 1 -- 172.21.15.38:0/3539243399 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f76fc142f80 con 0x7f76fc13e1c0 2023-12-22T08:39:56.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.357+0000 7f7700b6d640 1 -- 172.21.15.38:0/3539243399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f76fc142f80 con 0x7f76fc13e1c0 2023-12-22T08:39:56.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.358+0000 7f76eaffd640 1 -- 172.21.15.38:0/3539243399 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f76fc142f80 con 0x7f76fc13e1c0 2023-12-22T08:39:56.361 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:56.361 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-12-22T08:39:56.361 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:39:56.361 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-12-22T08:39:56.361 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-12-22T08:39:56.361 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:39:56.361 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-12-22T08:39:56.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.361+0000 7f7700b6d640 1 -- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76dc06a430 msgr2=0x7f76dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:56.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.361+0000 7f7700b6d640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76dc06a430 0x7f76dc06c8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0099c0 tx=0x7f76ec003990 comp rx=0 tx=0).stop 2023-12-22T08:39:56.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.361+0000 7f7700b6d640 1 -- 172.21.15.38:0/3539243399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc13e1c0 msgr2=0x7f76fc13e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:56.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.361+0000 7f7700b6d640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc13e1c0 0x7f76fc13e670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f76f4001eb0 tx=0x7f76f400c890 comp rx=0 tx=0).stop 2023-12-22T08:39:56.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.361+0000 7f7700b6d640 1 -- 172.21.15.38:0/3539243399 shutdown_connections 2023-12-22T08:39:56.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.361+0000 7f7700b6d640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76dc06a430 0x7f76dc06c8f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.361+0000 7f7700b6d640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76fc13e1c0 0x7f76fc13e670 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.361+0000 7f7700b6d640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76fc144d10 0x7f76fc139880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.361+0000 7f7700b6d640 1 --2- 172.21.15.38:0/3539243399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76fc0b2590 0x7f76fc13f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.361+0000 7f7700b6d640 1 -- 172.21.15.38:0/3539243399 >> 172.21.15.38:0/3539243399 conn(0x7f76fc0cf070 msgr2=0x7f76fc141b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:56.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.361+0000 7f7700b6d640 1 -- 172.21.15.38:0/3539243399 shutdown_connections 2023-12-22T08:39:56.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.361+0000 7f7700b6d640 1 -- 172.21.15.38:0/3539243399 wait complete. 2023-12-22T08:39:56.382 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T08:39:56.382 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T08:39:56.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.599+0000 7fd2904ec640 1 Processor -- start 2023-12-22T08:39:56.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.600+0000 7fd2904ec640 1 -- start start 2023-12-22T08:39:56.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.601+0000 7fd2904ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28813fb30 0x7fd28813ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:56.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.601+0000 7fd2904ec640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd28813d050 0x7fd2880cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:56.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.601+0000 7fd2904ec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2880ced50 con 0x7fd2880ce180 2023-12-22T08:39:56.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.601+0000 7fd2904ec640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd288070c10 con 0x7fd28813d050 2023-12-22T08:39:56.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.601+0000 7fd2904ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28813d8a0 con 0x7fd28813fb30 2023-12-22T08:39:56.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.602+0000 7fd28e288640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28813fb30 0x7fd28813ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:56.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.602+0000 7fd28e288640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28813fb30 0x7fd28813ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:48656/0 (socket says 172.21.15.38:48656) 2023-12-22T08:39:56.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.602+0000 7fd28e288640 1 -- 172.21.15.38:0/912042935 learned_addr learned my addr 172.21.15.38:0/912042935 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:56.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.602+0000 7fd28da87640 1 --2- 172.21.15.38:0/912042935 >> v2:172.21.15.89:3300/0 conn(0x7fd28813d050 0x7fd2880cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:56.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.603+0000 7fd28da87640 1 -- 172.21.15.38:0/912042935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28813fb30 msgr2=0x7fd28813ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:56.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.603+0000 7fd28da87640 1 --2- 172.21.15.38:0/912042935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28813fb30 0x7fd28813ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.603+0000 7fd28da87640 1 -- 172.21.15.38:0/912042935 >> v1:172.21.15.89:6789/0 conn(0x7fd2880ce180 legacy=0x7fd28815dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:56.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.603+0000 7fd28da87640 1 -- 172.21.15.38:0/912042935 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2880ce790 con 0x7fd28813d050 2023-12-22T08:39:56.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.603+0000 7fd28e288640 1 --2- 172.21.15.38:0/912042935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28813fb30 0x7fd28813ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:39:56.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.604+0000 7fd28da87640 1 --2- 172.21.15.38:0/912042935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28813d050 0x7fd2880cdc40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0097a0 tx=0x7fd27c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bb4dcf2af58a5ba server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:56.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.605+0000 7fd28d286640 1 -- 172.21.15.38:0/912042935 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c031780 con 0x7fd28813d050 2023-12-22T08:39:56.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.605+0000 7fd28d286640 1 -- 172.21.15.38:0/912042935 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c0318e0 con 0x7fd28813d050 2023-12-22T08:39:56.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.605+0000 7fd28d286640 1 -- 172.21.15.38:0/912042935 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c031c70 con 0x7fd28813d050 2023-12-22T08:39:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.606+0000 7fd2904ec640 1 -- 172.21.15.38:0/912042935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28813d050 msgr2=0x7fd2880cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.606+0000 7fd2904ec640 1 --2- 172.21.15.38:0/912042935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28813d050 0x7fd2880cdc40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0097a0 tx=0x7fd27c02b820 comp rx=0 tx=0).stop 2023-12-22T08:39:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.606+0000 7fd2904ec640 1 -- 172.21.15.38:0/912042935 shutdown_connections 2023-12-22T08:39:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.606+0000 7fd2904ec640 1 --2- 172.21.15.38:0/912042935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28813d050 0x7fd2880cdc40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.606+0000 7fd2904ec640 1 --2- 172.21.15.38:0/912042935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28813fb30 0x7fd28813ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.606+0000 7fd2904ec640 1 -- 172.21.15.38:0/912042935 >> 172.21.15.38:0/912042935 conn(0x7fd28806f880 msgr2=0x7fd2880b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.606+0000 7fd2904ec640 1 -- 172.21.15.38:0/912042935 shutdown_connections 2023-12-22T08:39:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.606+0000 7fd2904ec640 1 -- 172.21.15.38:0/912042935 wait complete. 2023-12-22T08:39:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.607+0000 7fd2904ec640 1 Processor -- start 2023-12-22T08:39:56.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.608+0000 7fd2904ec640 1 -- start start 2023-12-22T08:39:56.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.609+0000 7fd2904ec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880ce180 0x7fd2880ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:56.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.609+0000 7fd2904ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28813d050 0x7fd2880a9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:56.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.609+0000 7fd2904ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28813fb30 0x7fd288159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:56.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.609+0000 7fd2904ec640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28815a240 con 0x7fd2880ce180 2023-12-22T08:39:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.609+0000 7fd2904ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28806cac0 con 0x7fd28813fb30 2023-12-22T08:39:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.609+0000 7fd2904ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880a9940 con 0x7fd28813d050 2023-12-22T08:39:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.609+0000 7fd28e288640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880ce180 0x7fd2880ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.609+0000 7fd28ea89640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28813fb30 0x7fd288159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.609+0000 7fd28e288640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880ce180 0x7fd2880ad5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37320/0 (socket says 172.21.15.38:37320) 2023-12-22T08:39:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.609+0000 7fd28e288640 1 -- 172.21.15.38:0/3150662377 learned_addr learned my addr 172.21.15.38:0/3150662377 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.609+0000 7fd28da87640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28813d050 0x7fd2880a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.610+0000 7fd28e288640 1 -- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28813d050 msgr2=0x7fd2880a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.610+0000 7fd28e288640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28813d050 0x7fd2880a9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.610+0000 7fd28e288640 1 -- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28813fb30 msgr2=0x7fd288159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:56.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.610+0000 7fd28e288640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28813fb30 0x7fd288159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:56.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.610+0000 7fd28e288640 1 -- 172.21.15.38:0/3150662377 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd278009b30 con 0x7fd2880ce180 2023-12-22T08:39:56.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.610+0000 7fd28da87640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28813d050 0x7fd2880a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:39:56.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.610+0000 7fd28e288640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880ce180 0x7fd2880ad5c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd27800efc0 tx=0x7fd27800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:56.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.610+0000 7fd286ffd640 1 -- 172.21.15.38:0/3150662377 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27800ce60 con 0x7fd2880ce180 2023-12-22T08:39:56.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.610+0000 7fd286ffd640 1 -- 172.21.15.38:0/3150662377 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27800f040 con 0x7fd2880ce180 2023-12-22T08:39:56.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.610+0000 7fd2904ec640 1 -- 172.21.15.38:0/3150662377 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c009400 con 0x7fd2880ce180 2023-12-22T08:39:56.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.610+0000 7fd286ffd640 1 -- 172.21.15.38:0/3150662377 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278014680 con 0x7fd2880ce180 2023-12-22T08:39:56.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.610+0000 7fd2904ec640 1 -- 172.21.15.38:0/3150662377 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28806c470 con 0x7fd2880ce180 2023-12-22T08:39:56.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.611+0000 7fd2904ec640 1 -- 172.21.15.38:0/3150662377 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd288061910 con 0x7fd2880ce180 2023-12-22T08:39:56.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.613+0000 7fd286ffd640 1 -- 172.21.15.38:0/3150662377 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd2780147e0 con 0x7fd2880ce180 2023-12-22T08:39:56.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.614+0000 7fd286ffd640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd27406a430 0x7fd27406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:56.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.614+0000 7fd286ffd640 1 -- 172.21.15.38:0/3150662377 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd278088de0 con 0x7fd2880ce180 2023-12-22T08:39:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.615+0000 7fd28da87640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd27406a430 0x7fd27406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.616+0000 7fd28da87640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd27406a430 0x7fd27406c8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd27c036000 tx=0x7fd27c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:56.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.619+0000 7fd286ffd640 1 -- 172.21.15.38:0/3150662377 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd278054710 con 0x7fd2880ce180 2023-12-22T08:39:56.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:56.815+0000 7fd2904ec640 1 -- 172.21.15.38:0/3150662377 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd28813ee90 con 0x7fd2880ce180 2023-12-22T08:39:57.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.093+0000 7fd286ffd640 1 -- 172.21.15.38:0/3150662377 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd278057d30 con 0x7fd2880ce180 2023-12-22T08:39:57.097 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-12-22T08:39:57.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.100+0000 7fd2904ec640 1 -- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd27406a430 msgr2=0x7fd27406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:57.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.100+0000 7fd2904ec640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd27406a430 0x7fd27406c8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd27c036000 tx=0x7fd27c03d040 comp rx=0 tx=0).stop 2023-12-22T08:39:57.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.100+0000 7fd2904ec640 1 -- 172.21.15.38:0/3150662377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880ce180 msgr2=0x7fd2880ad5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:57.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.100+0000 7fd2904ec640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880ce180 0x7fd2880ad5c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd27800efc0 tx=0x7fd27800c490 comp rx=0 tx=0).stop 2023-12-22T08:39:57.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.100+0000 7fd2904ec640 1 -- 172.21.15.38:0/3150662377 shutdown_connections 2023-12-22T08:39:57.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.100+0000 7fd2904ec640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd28813fb30 0x7fd288159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:57.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.100+0000 7fd2904ec640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd28813d050 0x7fd2880a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:57.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.100+0000 7fd2904ec640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd27406a430 0x7fd27406c8f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:57.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.100+0000 7fd2904ec640 1 --2- 172.21.15.38:0/3150662377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880ce180 0x7fd2880ad5c0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd27800efc0 tx=0x7fd27800c490 comp rx=0 tx=0).stop 2023-12-22T08:39:57.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.100+0000 7fd2904ec640 1 -- 172.21.15.38:0/3150662377 >> 172.21.15.38:0/3150662377 conn(0x7fd28806f880 msgr2=0x7fd2880aec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:57.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.104+0000 7fd2904ec640 1 -- 172.21.15.38:0/3150662377 shutdown_connections 2023-12-22T08:39:57.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.104+0000 7fd2904ec640 1 -- 172.21.15.38:0/3150662377 wait complete. 2023-12-22T08:39:57.130 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T08:39:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.345+0000 7f92f14d7640 1 Processor -- start 2023-12-22T08:39:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.345+0000 7f92f14d7640 1 -- start start 2023-12-22T08:39:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.346+0000 7f92f14d7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f92ec15ad90 0x7f92ec0caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.346+0000 7f92f14d7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ec15e050 0x7f92ec0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.346+0000 7f92f14d7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec15e630 con 0x7f92ec161bb0 2023-12-22T08:39:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.346+0000 7f92f14d7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ec0ce2c0 con 0x7f92ec15ad90 2023-12-22T08:39:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.346+0000 7f92f14d7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec15e910 con 0x7f92ec15e050 2023-12-22T08:39:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.347+0000 7f92f0cd6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ec15e050 0x7f92ec0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.347+0000 7f92f0cd6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ec15e050 0x7f92ec0cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:48670/0 (socket says 172.21.15.38:48670) 2023-12-22T08:39:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.347+0000 7f92f0cd6640 1 -- 172.21.15.38:0/1739979707 learned_addr learned my addr 172.21.15.38:0/1739979707 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.347+0000 7f92ebfff640 1 --2- 172.21.15.38:0/1739979707 >> v2:172.21.15.89:3300/0 conn(0x7f92ec15ad90 0x7f92ec0caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:57.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.348+0000 7f92f0cd6640 1 -- 172.21.15.38:0/1739979707 >> v2:172.21.15.89:3300/0 conn(0x7f92ec15ad90 msgr2=0x7f92ec0caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:57.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.348+0000 7f92f0cd6640 1 --2- 172.21.15.38:0/1739979707 >> v2:172.21.15.89:3300/0 conn(0x7f92ec15ad90 0x7f92ec0caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:57.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.348+0000 7f92f0cd6640 1 -- 172.21.15.38:0/1739979707 >> v1:172.21.15.89:6789/0 conn(0x7f92ec161bb0 legacy=0x7f92ec15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:57.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.348+0000 7f92f0cd6640 1 -- 172.21.15.38:0/1739979707 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec1610d0 con 0x7f92ec15e050 2023-12-22T08:39:57.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.348+0000 7f92eb7fe640 1 -- 172.21.15.38:0/1739979707 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353109033 0 0) 0x7f92ec15e630 con 0x7f92ec161bb0 2023-12-22T08:39:57.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.349+0000 7f92f0cd6640 1 --2- 172.21.15.38:0/1739979707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ec15e050 0x7f92ec0cb410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009e50 tx=0x7f92e402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3672870bd836e89e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:57.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.350+0000 7f92eb7fe640 1 -- 172.21.15.38:0/1739979707 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e402cb00 con 0x7f92ec15e050 2023-12-22T08:39:57.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.350+0000 7f92eb7fe640 1 -- 172.21.15.38:0/1739979707 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e402cc60 con 0x7f92ec15e050 2023-12-22T08:39:57.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.350+0000 7f92eb7fe640 1 -- 172.21.15.38:0/1739979707 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e40343f0 con 0x7f92ec15e050 2023-12-22T08:39:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.350+0000 7f92f14d7640 1 -- 172.21.15.38:0/1739979707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ec15e050 msgr2=0x7f92ec0cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.350+0000 7f92f14d7640 1 --2- 172.21.15.38:0/1739979707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ec15e050 0x7f92ec0cb410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009e50 tx=0x7f92e402bf60 comp rx=0 tx=0).stop 2023-12-22T08:39:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.350+0000 7f92f14d7640 1 -- 172.21.15.38:0/1739979707 shutdown_connections 2023-12-22T08:39:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.350+0000 7f92f14d7640 1 --2- 172.21.15.38:0/1739979707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ec15e050 0x7f92ec0cb410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.350+0000 7f92f14d7640 1 --2- 172.21.15.38:0/1739979707 >> v2:172.21.15.89:3300/0 conn(0x7f92ec15ad90 0x7f92ec0caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.350+0000 7f92f14d7640 1 -- 172.21.15.38:0/1739979707 >> 172.21.15.38:0/1739979707 conn(0x7f92ec0d31c0 msgr2=0x7f92ec0d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.350+0000 7f92f14d7640 1 -- 172.21.15.38:0/1739979707 shutdown_connections 2023-12-22T08:39:57.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.351+0000 7f92f14d7640 1 -- 172.21.15.38:0/1739979707 wait complete. 2023-12-22T08:39:57.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.352+0000 7f92f14d7640 1 Processor -- start 2023-12-22T08:39:57.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.353+0000 7f92f14d7640 1 -- start start 2023-12-22T08:39:57.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.353+0000 7f92f14d7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ec15ad90 0x7f92ec15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:57.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.354+0000 7f92f14d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ec15e050 0x7f92ec15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:57.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.354+0000 7f92f14d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92ec161bb0 0x7f92ec15f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:57.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.354+0000 7f92f14d7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0a9cd0 con 0x7f92ec161bb0 2023-12-22T08:39:57.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.354+0000 7f92f14d7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0c6cf0 con 0x7f92ec15e050 2023-12-22T08:39:57.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.354+0000 7f92f14d7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec0c72b0 con 0x7f92ec15ad90 2023-12-22T08:39:57.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.354+0000 7f92f0cd6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92ec161bb0 0x7f92ec15f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:57.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.354+0000 7f92f0cd6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92ec161bb0 0x7f92ec15f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37324/0 (socket says 172.21.15.38:37324) 2023-12-22T08:39:57.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.354+0000 7f92f0cd6640 1 -- 172.21.15.38:0/1417590636 learned_addr learned my addr 172.21.15.38:0/1417590636 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:57.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.354+0000 7f92ebfff640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ec15ad90 0x7f92ec15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:57.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.354+0000 7f92e3fff640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ec15e050 0x7f92ec15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:57.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.355+0000 7f92f0cd6640 1 -- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ec15ad90 msgr2=0x7f92ec15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:57.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.355+0000 7f92f0cd6640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ec15ad90 0x7f92ec15c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:57.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.355+0000 7f92f0cd6640 1 -- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ec15e050 msgr2=0x7f92ec15c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:57.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.355+0000 7f92f0cd6640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ec15e050 0x7f92ec15c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:57.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.355+0000 7f92f0cd6640 1 -- 172.21.15.38:0/1417590636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e4009b30 con 0x7f92ec161bb0 2023-12-22T08:39:57.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.355+0000 7f92f0cd6640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92ec161bb0 0x7f92ec15f4f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f92e4036040 tx=0x7f92e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:57.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.355+0000 7f92e97fa640 1 -- 172.21.15.38:0/1417590636 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4009510 con 0x7f92ec161bb0 2023-12-22T08:39:57.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.355+0000 7f92e97fa640 1 -- 172.21.15.38:0/1417590636 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e4040470 con 0x7f92ec161bb0 2023-12-22T08:39:57.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.355+0000 7f92f14d7640 1 -- 172.21.15.38:0/1417590636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec160270 con 0x7f92ec161bb0 2023-12-22T08:39:57.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.356+0000 7f92e97fa640 1 -- 172.21.15.38:0/1417590636 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4040800 con 0x7f92ec161bb0 2023-12-22T08:39:57.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.356+0000 7f92f14d7640 1 -- 172.21.15.38:0/1417590636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec0c6f40 con 0x7f92ec161bb0 2023-12-22T08:39:57.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.357+0000 7f92f14d7640 1 -- 172.21.15.38:0/1417590636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec0c7440 con 0x7f92ec161bb0 2023-12-22T08:39:57.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.358+0000 7f92e97fa640 1 -- 172.21.15.38:0/1417590636 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f92e4040960 con 0x7f92ec161bb0 2023-12-22T08:39:57.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.360+0000 7f92e97fa640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f92cc06a430 0x7f92cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:57.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.360+0000 7f92e97fa640 1 -- 172.21.15.38:0/1417590636 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f92e40abef0 con 0x7f92ec161bb0 2023-12-22T08:39:57.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.360+0000 7f92ebfff640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f92cc06a430 0x7f92cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:57.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.361+0000 7f92ebfff640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f92cc06a430 0x7f92cc06c8f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009b40 tx=0x7f92dc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:57.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.364+0000 7f92e97fa640 1 -- 172.21.15.38:0/1417590636 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f92e4077750 con 0x7f92ec161bb0 2023-12-22T08:39:57.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:57.562+0000 7f92f14d7640 1 -- 172.21.15.38:0/1417590636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f92ec061910 con 0x7f92ec161bb0 2023-12-22T08:39:58.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.108+0000 7f92e97fa640 1 -- 172.21.15.38:0/1417590636 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f92e407ad70 con 0x7f92ec161bb0 2023-12-22T08:39:58.113 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-12-22T08:39:58.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.117+0000 7f92f14d7640 1 -- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f92cc06a430 msgr2=0x7f92cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:58.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.117+0000 7f92f14d7640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f92cc06a430 0x7f92cc06c8f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009b40 tx=0x7f92dc009190 comp rx=0 tx=0).stop 2023-12-22T08:39:58.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.117+0000 7f92f14d7640 1 -- 172.21.15.38:0/1417590636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92ec161bb0 msgr2=0x7f92ec15f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:58.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.117+0000 7f92f14d7640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92ec161bb0 0x7f92ec15f4f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f92e4036040 tx=0x7f92e4004a40 comp rx=0 tx=0).stop 2023-12-22T08:39:58.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.118+0000 7f92f14d7640 1 -- 172.21.15.38:0/1417590636 shutdown_connections 2023-12-22T08:39:58.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.118+0000 7f92f14d7640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f92cc06a430 0x7f92cc06c8f0 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009b40 tx=0x7f92dc009190 comp rx=0 tx=0).stop 2023-12-22T08:39:58.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.118+0000 7f92f14d7640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92ec161bb0 0x7f92ec15f4f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.118+0000 7f92f14d7640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ec15e050 0x7f92ec15c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.118+0000 7f92f14d7640 1 --2- 172.21.15.38:0/1417590636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ec15ad90 0x7f92ec15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.118+0000 7f92f14d7640 1 -- 172.21.15.38:0/1417590636 >> 172.21.15.38:0/1417590636 conn(0x7f92ec0d31c0 msgr2=0x7f92ec0d35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:58.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.123+0000 7f92f14d7640 1 -- 172.21.15.38:0/1417590636 shutdown_connections 2023-12-22T08:39:58.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.123+0000 7f92f14d7640 1 -- 172.21.15.38:0/1417590636 wait complete. 2023-12-22T08:39:58.150 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T08:39:58.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.348+0000 7f87434ec640 1 Processor -- start 2023-12-22T08:39:58.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.348+0000 7f87434ec640 1 -- start start 2023-12-22T08:39:58.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.349+0000 7f87434ec640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f873c143600 0x7f873c15e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.349+0000 7f87434ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f873c0cea50 0x7f873c0ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.350+0000 7f87434ec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873c15ea00 con 0x7f873c06d590 2023-12-22T08:39:58.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.350+0000 7f87434ec640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873c0cf410 con 0x7f873c143600 2023-12-22T08:39:58.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.350+0000 7f87434ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c140f70 con 0x7f873c0cea50 2023-12-22T08:39:58.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.350+0000 7f8740a87640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f873c0cea50 0x7f873c0ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.350+0000 7f8741288640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f873c143600 0x7f873c15e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.350+0000 7f8740a87640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f873c0cea50 0x7f873c0ceed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:48686/0 (socket says 172.21.15.38:48686) 2023-12-22T08:39:58.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.350+0000 7f8740a87640 1 -- 172.21.15.38:0/2929452123 learned_addr learned my addr 172.21.15.38:0/2929452123 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:58.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.351+0000 7f8740a87640 1 -- 172.21.15.38:0/2929452123 >> v2:172.21.15.89:3300/0 conn(0x7f873c143600 msgr2=0x7f873c15e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:58.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.351+0000 7f8740a87640 1 --2- 172.21.15.38:0/2929452123 >> v2:172.21.15.89:3300/0 conn(0x7f873c143600 0x7f873c15e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.351+0000 7f8740a87640 1 -- 172.21.15.38:0/2929452123 >> v1:172.21.15.89:6789/0 conn(0x7f873c06d590 legacy=0x7f873c06d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:58.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.351+0000 7f8740a87640 1 -- 172.21.15.38:0/2929452123 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c06c300 con 0x7f873c0cea50 2023-12-22T08:39:58.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.352+0000 7f8740a87640 1 --2- 172.21.15.38:0/2929452123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f873c0cea50 0x7f873c0ceed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8730009870 tx=0x7f873002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ae5320a0f053b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:58.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.353+0000 7f873bfff640 1 -- 172.21.15.38:0/2929452123 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730030840 con 0x7f873c0cea50 2023-12-22T08:39:58.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.353+0000 7f873bfff640 1 -- 172.21.15.38:0/2929452123 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87300309a0 con 0x7f873c0cea50 2023-12-22T08:39:58.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.353+0000 7f873bfff640 1 -- 172.21.15.38:0/2929452123 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730030d30 con 0x7f873c0cea50 2023-12-22T08:39:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.353+0000 7f87434ec640 1 -- 172.21.15.38:0/2929452123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f873c0cea50 msgr2=0x7f873c0ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.353+0000 7f87434ec640 1 --2- 172.21.15.38:0/2929452123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f873c0cea50 0x7f873c0ceed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8730009870 tx=0x7f873002b980 comp rx=0 tx=0).stop 2023-12-22T08:39:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.353+0000 7f87434ec640 1 -- 172.21.15.38:0/2929452123 shutdown_connections 2023-12-22T08:39:58.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.353+0000 7f87434ec640 1 --2- 172.21.15.38:0/2929452123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f873c0cea50 0x7f873c0ceed0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.353+0000 7f87434ec640 1 --2- 172.21.15.38:0/2929452123 >> v2:172.21.15.89:3300/0 conn(0x7f873c143600 0x7f873c15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.353+0000 7f87434ec640 1 -- 172.21.15.38:0/2929452123 >> 172.21.15.38:0/2929452123 conn(0x7f873c0cfe70 msgr2=0x7f873c0d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:58.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.354+0000 7f87434ec640 1 -- 172.21.15.38:0/2929452123 shutdown_connections 2023-12-22T08:39:58.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.354+0000 7f87434ec640 1 -- 172.21.15.38:0/2929452123 wait complete. 2023-12-22T08:39:58.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.355+0000 7f87434ec640 1 Processor -- start 2023-12-22T08:39:58.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.356+0000 7f87434ec640 1 -- start start 2023-12-22T08:39:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.356+0000 7f87434ec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f873c06d590 0x7f873c13fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.356+0000 7f87434ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f873c0cea50 0x7f873c09e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f87434ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f873c143600 0x7f873c142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f87434ec640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c156170 con 0x7f873c06d590 2023-12-22T08:39:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f87434ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c157be0 con 0x7f873c143600 2023-12-22T08:39:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f87434ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c1554f0 con 0x7f873c0cea50 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f8741288640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f873c06d590 0x7f873c13fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f8741288640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f873c06d590 0x7f873c13fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37340/0 (socket says 172.21.15.38:37340) 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f8741288640 1 -- 172.21.15.38:0/1595856225 learned_addr learned my addr 172.21.15.38:0/1595856225 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f8740a87640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f873c0cea50 0x7f873c09e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f8741a89640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f873c143600 0x7f873c142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f8741288640 1 -- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f873c0cea50 msgr2=0x7f873c09e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f8741288640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f873c0cea50 0x7f873c09e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f8741288640 1 -- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f873c143600 msgr2=0x7f873c142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f8741288640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f873c143600 0x7f873c142190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f8741288640 1 -- 172.21.15.38:0/1595856225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87300094d0 con 0x7f873c06d590 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.357+0000 7f8741a89640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f873c143600 0x7f873c142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.358+0000 7f8741288640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f873c06d590 0x7f873c13fdd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f872c009db0 tx=0x7f872c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.358+0000 7f8739ffb640 1 -- 172.21.15.38:0/1595856225 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c014480 con 0x7f873c06d590 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.358+0000 7f8739ffb640 1 -- 172.21.15.38:0/1595856225 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c00f040 con 0x7f873c06d590 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.358+0000 7f87434ec640 1 -- 172.21.15.38:0/1595856225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873c1557d0 con 0x7f873c06d590 2023-12-22T08:39:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.358+0000 7f8739ffb640 1 -- 172.21.15.38:0/1595856225 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c014800 con 0x7f873c06d590 2023-12-22T08:39:58.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.358+0000 7f87434ec640 1 -- 172.21.15.38:0/1595856225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873c155d90 con 0x7f873c06d590 2023-12-22T08:39:58.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.359+0000 7f87434ec640 1 -- 172.21.15.38:0/1595856225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873c061910 con 0x7f873c06d590 2023-12-22T08:39:58.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.361+0000 7f8739ffb640 1 -- 172.21.15.38:0/1595856225 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f872c014960 con 0x7f873c06d590 2023-12-22T08:39:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.362+0000 7f8739ffb640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f872806a460 0x7f872806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.362+0000 7f8739ffb640 1 -- 172.21.15.38:0/1595856225 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f872c089560 con 0x7f873c06d590 2023-12-22T08:39:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.363+0000 7f8740a87640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f872806a460 0x7f872806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.364+0000 7f8740a87640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f872806a460 0x7f872806c920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8730036000 tx=0x7f8730008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.368+0000 7f8739ffb640 1 -- 172.21.15.38:0/1595856225 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f872c054b10 con 0x7f873c06d590 2023-12-22T08:39:58.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.598+0000 7f87434ec640 1 -- 172.21.15.38:0/1595856225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f873c0b21d0 con 0x7f873c06d590 2023-12-22T08:39:58.620 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 2 and data pool 3 2023-12-22T08:39:58.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.616+0000 7f8739ffb640 1 -- 172.21.15.38:0/1595856225 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f872c058130 con 0x7f873c06d590 2023-12-22T08:39:58.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.621+0000 7f87434ec640 1 -- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f872806a460 msgr2=0x7f872806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:58.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.621+0000 7f87434ec640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f872806a460 0x7f872806c920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8730036000 tx=0x7f8730008030 comp rx=0 tx=0).stop 2023-12-22T08:39:58.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.621+0000 7f87434ec640 1 -- 172.21.15.38:0/1595856225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f873c06d590 msgr2=0x7f873c13fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:58.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.621+0000 7f87434ec640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f873c06d590 0x7f873c13fdd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f872c009db0 tx=0x7f872c00c490 comp rx=0 tx=0).stop 2023-12-22T08:39:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.624+0000 7f87434ec640 1 -- 172.21.15.38:0/1595856225 shutdown_connections 2023-12-22T08:39:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.624+0000 7f87434ec640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f873c143600 0x7f873c142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.624+0000 7f87434ec640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f873c0cea50 0x7f873c09e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.624+0000 7f87434ec640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f872806a460 0x7f872806c920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.624+0000 7f87434ec640 1 --2- 172.21.15.38:0/1595856225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f873c06d590 0x7f873c13fdd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.624+0000 7f87434ec640 1 -- 172.21.15.38:0/1595856225 >> 172.21.15.38:0/1595856225 conn(0x7f873c0cfe70 msgr2=0x7f873c160530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:58.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.625+0000 7f87434ec640 1 -- 172.21.15.38:0/1595856225 shutdown_connections 2023-12-22T08:39:58.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.626+0000 7f87434ec640 1 -- 172.21.15.38:0/1595856225 wait complete. 2023-12-22T08:39:58.656 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:39:58.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.843+0000 7f3b96ff6640 1 Processor -- start 2023-12-22T08:39:58.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.843+0000 7f3b96ff6640 1 -- start start 2023-12-22T08:39:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.845+0000 7f3b96ff6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b900b2050 0x7f3b900b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.845+0000 7f3b96ff6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b901450f0 con 0x7f3b90070800 2023-12-22T08:39:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.845+0000 7f3b96ff6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b900b29f0 con 0x7f3b90144d10 2023-12-22T08:39:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.845+0000 7f3b96ff6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900cc840 con 0x7f3b900b2050 2023-12-22T08:39:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.846+0000 7f3b95593640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3b90070800 0x7f3b90070c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56828/0 (socket says 172.21.15.38:56828) 2023-12-22T08:39:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.846+0000 7f3b95593640 1 -- 172.21.15.38:0/3258060281 learned_addr learned my addr 172.21.15.38:0/3258060281 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:39:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.846+0000 7f3b8ffff640 1 --2- 172.21.15.38:0/3258060281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b900b2050 0x7f3b900b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.846+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543980130 0 0) 0x7f3b901450f0 con 0x7f3b90070800 2023-12-22T08:39:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.846+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b80003520 con 0x7f3b90070800 2023-12-22T08:39:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.846+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993703086 0 0) 0x7f3b900b29f0 con 0x7f3b90144d10 2023-12-22T08:39:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.846+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b901450f0 con 0x7f3b90144d10 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.846+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2679840394 0 0) 0x7f3b80003520 con 0x7f3b90070800 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.846+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b900b2050 msgr2=0x7f3b900b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.846+0000 7f3b8f7fe640 1 --2- 172.21.15.38:0/3258060281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b900b2050 0x7f3b900b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.847+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 >> v1:172.21.15.89:6789/0 conn(0x7f3b90144d10 legacy=0x7f3b900cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.847+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b900ce010 con 0x7f3b90070800 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.847+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f3b880019f0 con 0x7f3b90070800 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.847+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 >> v1:172.21.15.38:6789/0 conn(0x7f3b90070800 legacy=0x7f3b90070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.847+0000 7f3b8f7fe640 1 --2- 172.21.15.38:0/3258060281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b80003b30 0x7f3b80003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.847+0000 7f3b8f7fe640 1 --2- 172.21.15.38:0/3258060281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b900b2050 0x7f3b800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.847+0000 7f3b8f7fe640 1 --2- 172.21.15.38:0/3258060281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b80004d00 0x7f3b80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.847+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900cc840 con 0x7f3b80003b30 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.847+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8000ba30 con 0x7f3b80004d00 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.847+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8000bbf0 con 0x7f3b900b2050 2023-12-22T08:39:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.847+0000 7f3b94d92640 1 --2- 172.21.15.38:0/3258060281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b80003b30 0x7f3b80003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.847+0000 7f3b8ffff640 1 --2- 172.21.15.38:0/3258060281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b900b2050 0x7f3b800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.847+0000 7f3b95593640 1 --2- 172.21.15.38:0/3258060281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b80004d00 0x7f3b80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.848+0000 7f3b94d92640 1 -- 172.21.15.38:0/3258060281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b900b2050 msgr2=0x7f3b800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.848+0000 7f3b94d92640 1 --2- 172.21.15.38:0/3258060281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b900b2050 0x7f3b800047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.848+0000 7f3b94d92640 1 -- 172.21.15.38:0/3258060281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b80004d00 msgr2=0x7f3b80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.848+0000 7f3b94d92640 1 --2- 172.21.15.38:0/3258060281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b80004d00 0x7f3b80005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.848+0000 7f3b94d92640 1 -- 172.21.15.38:0/3258060281 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b80003520 con 0x7f3b80003b30 2023-12-22T08:39:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.849+0000 7f3b94d92640 1 --2- 172.21.15.38:0/3258060281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b80003b30 0x7f3b80003f30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b840018d0 tx=0x7f3b800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed565bfdcc16d40 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:58.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.849+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b840052d0 con 0x7f3b80003b30 2023-12-22T08:39:58.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.849+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b84005430 con 0x7f3b80003b30 2023-12-22T08:39:58.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.849+0000 7f3b8f7fe640 1 -- 172.21.15.38:0/3258060281 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84003810 con 0x7f3b80003b30 2023-12-22T08:39:58.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.849+0000 7f3b96ff6640 1 -- 172.21.15.38:0/3258060281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b80003b30 msgr2=0x7f3b80003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:58.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.849+0000 7f3b96ff6640 1 --2- 172.21.15.38:0/3258060281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b80003b30 0x7f3b80003f30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b840018d0 tx=0x7f3b800057f0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.849+0000 7f3b95593640 1 -- 172.21.15.38:0/3258060281 reap_dead start 2023-12-22T08:39:58.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.850+0000 7f3b96ff6640 1 -- 172.21.15.38:0/3258060281 shutdown_connections 2023-12-22T08:39:58.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.850+0000 7f3b96ff6640 1 -- 172.21.15.38:0/3258060281 >> 172.21.15.38:0/3258060281 conn(0x7f3b900cf070 msgr2=0x7f3b900cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:58.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.850+0000 7f3b96ff6640 1 -- 172.21.15.38:0/3258060281 shutdown_connections 2023-12-22T08:39:58.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.850+0000 7f3b96ff6640 1 -- 172.21.15.38:0/3258060281 wait complete. 2023-12-22T08:39:58.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.851+0000 7f3b96ff6640 1 Processor -- start 2023-12-22T08:39:58.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.852+0000 7f3b96ff6640 1 -- start start 2023-12-22T08:39:58.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b96ff6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b80003b30 0x7f3b90154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b96ff6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b901f33e0 0x7f3b90156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b96ff6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b901565c0 0x7f3b9006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b96ff6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b901f2fc0 con 0x7f3b901565c0 2023-12-22T08:39:58.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b96ff6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b90155450 con 0x7f3b80003b30 2023-12-22T08:39:58.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b96ff6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b901f2960 con 0x7f3b901f33e0 2023-12-22T08:39:58.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b95593640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b901565c0 0x7f3b9006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b95593640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b901565c0 0x7f3b9006c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37364/0 (socket says 172.21.15.38:37364) 2023-12-22T08:39:58.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b95593640 1 -- 172.21.15.38:0/94890760 learned_addr learned my addr 172.21.15.38:0/94890760 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b94d92640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b80003b30 0x7f3b90154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b8ffff640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b901f33e0 0x7f3b90156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b95593640 1 -- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b901f33e0 msgr2=0x7f3b90156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b95593640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b901f33e0 0x7f3b90156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b95593640 1 -- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b80003b30 msgr2=0x7f3b90154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b95593640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b80003b30 0x7f3b90154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.853+0000 7f3b95593640 1 -- 172.21.15.38:0/94890760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90156b00 con 0x7f3b901565c0 2023-12-22T08:39:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.854+0000 7f3b95593640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b901565c0 0x7f3b9006c3c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b9006e740 tx=0x7f3b88007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.854+0000 7f3b8d7fa640 1 -- 172.21.15.38:0/94890760 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8800eab0 con 0x7f3b901565c0 2023-12-22T08:39:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.854+0000 7f3b8d7fa640 1 -- 172.21.15.38:0/94890760 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8800ec30 con 0x7f3b901565c0 2023-12-22T08:39:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.854+0000 7f3b8d7fa640 1 -- 172.21.15.38:0/94890760 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88014430 con 0x7f3b901565c0 2023-12-22T08:39:58.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.854+0000 7f3b96ff6640 1 -- 172.21.15.38:0/94890760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b90156de0 con 0x7f3b901565c0 2023-12-22T08:39:58.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.854+0000 7f3b96ff6640 1 -- 172.21.15.38:0/94890760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b901f3860 con 0x7f3b901565c0 2023-12-22T08:39:58.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.855+0000 7f3b96ff6640 1 -- 172.21.15.38:0/94890760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b90156fd0 con 0x7f3b901565c0 2023-12-22T08:39:58.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.856+0000 7f3b8d7fa640 1 -- 172.21.15.38:0/94890760 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3b88014590 con 0x7f3b901565c0 2023-12-22T08:39:58.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.857+0000 7f3b8d7fa640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3b7406a460 0x7f3b7406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:58.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.857+0000 7f3b8d7fa640 1 -- 172.21.15.38:0/94890760 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b880884e0 con 0x7f3b901565c0 2023-12-22T08:39:58.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.858+0000 7f3b94d92640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3b7406a460 0x7f3b7406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:58.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.859+0000 7f3b94d92640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3b7406a460 0x7f3b7406c920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3b84034000 tx=0x7f3b84031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:58.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:58.862+0000 7f3b8d7fa640 1 -- 172.21.15.38:0/94890760 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3b90156fd0 con 0x7f3b901565c0 2023-12-22T08:39:59.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.059+0000 7f3b96ff6640 1 -- 172.21.15.38:0/94890760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b90156fd0 con 0x7f3b901565c0 2023-12-22T08:39:59.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.062+0000 7f3b8d7fa640 1 -- 172.21.15.38:0/94890760 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16006 (secure 0 0 0) 0x7f3b90156fd0 con 0x7f3b901565c0 2023-12-22T08:39:59.065 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:59.065 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":19,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:58.600344+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:39:59.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.065+0000 7f3b96ff6640 1 -- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3b7406a460 msgr2=0x7f3b7406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:59.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.065+0000 7f3b96ff6640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3b7406a460 0x7f3b7406c920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3b84034000 tx=0x7f3b84031000 comp rx=0 tx=0).stop 2023-12-22T08:39:59.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.065+0000 7f3b96ff6640 1 -- 172.21.15.38:0/94890760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b901565c0 msgr2=0x7f3b9006c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:59.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.065+0000 7f3b96ff6640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b901565c0 0x7f3b9006c3c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b9006e740 tx=0x7f3b88007bc0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.065+0000 7f3b96ff6640 1 -- 172.21.15.38:0/94890760 shutdown_connections 2023-12-22T08:39:59.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.065+0000 7f3b96ff6640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3b7406a460 0x7f3b7406c920 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.065+0000 7f3b96ff6640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b901565c0 0x7f3b9006c3c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.065+0000 7f3b96ff6640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b901f33e0 0x7f3b90156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.065+0000 7f3b96ff6640 1 --2- 172.21.15.38:0/94890760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b80003b30 0x7f3b90154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.065+0000 7f3b96ff6640 1 -- 172.21.15.38:0/94890760 >> 172.21.15.38:0/94890760 conn(0x7f3b900cf070 msgr2=0x7f3b900b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:59.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.065+0000 7f3b96ff6640 1 -- 172.21.15.38:0/94890760 shutdown_connections 2023-12-22T08:39:59.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.065+0000 7f3b96ff6640 1 -- 172.21.15.38:0/94890760 wait complete. 2023-12-22T08:39:59.087 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:39:59.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.313+0000 7f02e45f6640 1 Processor -- start 2023-12-22T08:39:59.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.313+0000 7f02e45f6640 1 -- start start 2023-12-22T08:39:59.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.314+0000 7f02e45f6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0b3f90 0x7f02dc15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:59.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.314+0000 7f02e45f6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f02dc06ca50 0x7f02dc070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:59.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.315+0000 7f02e45f6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02dc15eb20 con 0x7f02dc15e740 2023-12-22T08:39:59.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.315+0000 7f02e45f6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc06e650 con 0x7f02dc06ca50 2023-12-22T08:39:59.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.315+0000 7f02e45f6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc070770 con 0x7f02dc0b3f90 2023-12-22T08:39:59.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.315+0000 7f02e2b93640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f02dc06ca50 0x7f02dc070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:59.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.315+0000 7f02e2392640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f02dc15e740 0x7f02dc0b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56832/0 (socket says 172.21.15.38:56832) 2023-12-22T08:39:59.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.315+0000 7f02e2392640 1 -- 172.21.15.38:0/2529721777 learned_addr learned my addr 172.21.15.38:0/2529721777 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:39:59.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.315+0000 7f02e1b91640 1 --2- 172.21.15.38:0/2529721777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0b3f90 0x7f02dc15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:59.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.315+0000 7f02e2b93640 1 -- 172.21.15.38:0/2529721777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0b3f90 msgr2=0x7f02dc15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:59.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.315+0000 7f02e2b93640 1 --2- 172.21.15.38:0/2529721777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0b3f90 0x7f02dc15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.315+0000 7f02e2b93640 1 -- 172.21.15.38:0/2529721777 >> v1:172.21.15.38:6789/0 conn(0x7f02dc15e740 legacy=0x7f02dc0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.315+0000 7f02e1390640 1 -- 172.21.15.38:0/2529721777 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753125272 0 0) 0x7f02dc15eb20 con 0x7f02dc15e740 2023-12-22T08:39:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.315+0000 7f02e2b93640 1 -- 172.21.15.38:0/2529721777 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc06cec0 con 0x7f02dc06ca50 2023-12-22T08:39:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.317+0000 7f02e2b93640 1 --2- 172.21.15.38:0/2529721777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc06ca50 0x7f02dc070c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02d40097a0 tx=0x7f02d402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1e6e12dd20e032 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.317+0000 7f02e1390640 1 -- 172.21.15.38:0/2529721777 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d402f050 con 0x7f02dc06ca50 2023-12-22T08:39:59.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.317+0000 7f02e1390640 1 -- 172.21.15.38:0/2529721777 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d4031700 con 0x7f02dc06ca50 2023-12-22T08:39:59.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.317+0000 7f02e1390640 1 -- 172.21.15.38:0/2529721777 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4031a90 con 0x7f02dc06ca50 2023-12-22T08:39:59.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.318+0000 7f02e45f6640 1 -- 172.21.15.38:0/2529721777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc06ca50 msgr2=0x7f02dc070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.318+0000 7f02e45f6640 1 --2- 172.21.15.38:0/2529721777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc06ca50 0x7f02dc070c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02d40097a0 tx=0x7f02d402b7a0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.318+0000 7f02e45f6640 1 -- 172.21.15.38:0/2529721777 shutdown_connections 2023-12-22T08:39:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.318+0000 7f02e45f6640 1 --2- 172.21.15.38:0/2529721777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc06ca50 0x7f02dc070c00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.318+0000 7f02e45f6640 1 --2- 172.21.15.38:0/2529721777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0b3f90 0x7f02dc15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.318+0000 7f02e45f6640 1 -- 172.21.15.38:0/2529721777 >> 172.21.15.38:0/2529721777 conn(0x7f02dc0cfea0 msgr2=0x7f02dc0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.318+0000 7f02e45f6640 1 -- 172.21.15.38:0/2529721777 shutdown_connections 2023-12-22T08:39:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.318+0000 7f02e45f6640 1 -- 172.21.15.38:0/2529721777 wait complete. 2023-12-22T08:39:59.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.319+0000 7f02e45f6640 1 Processor -- start 2023-12-22T08:39:59.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.320+0000 7f02e45f6640 1 -- start start 2023-12-22T08:39:59.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e45f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02dc06ca50 0x7f02dc153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:59.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e45f6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0b3f90 0x7f02dc158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:59.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e45f6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc15e740 0x7f02dc15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:59.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e45f6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc1538a0 con 0x7f02dc15e740 2023-12-22T08:39:59.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e45f6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0b5a40 con 0x7f02dc06ca50 2023-12-22T08:39:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e45f6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0b8590 con 0x7f02dc0b3f90 2023-12-22T08:39:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e2b93640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc15e740 0x7f02dc15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e2b93640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc15e740 0x7f02dc15a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37394/0 (socket says 172.21.15.38:37394) 2023-12-22T08:39:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e2b93640 1 -- 172.21.15.38:0/1708113832 learned_addr learned my addr 172.21.15.38:0/1708113832 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e1b91640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0b3f90 0x7f02dc158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e2392640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02dc06ca50 0x7f02dc153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e2b93640 1 -- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0b3f90 msgr2=0x7f02dc158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e2b93640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0b3f90 0x7f02dc158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.321+0000 7f02e2b93640 1 -- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02dc06ca50 msgr2=0x7f02dc153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.322+0000 7f02e2b93640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02dc06ca50 0x7f02dc153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.322+0000 7f02e2b93640 1 -- 172.21.15.38:0/1708113832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d4009400 con 0x7f02dc15e740 2023-12-22T08:39:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.322+0000 7f02e2b93640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc15e740 0x7f02dc15a0f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f02d40097a0 tx=0x7f02d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.322+0000 7f02d2ffd640 1 -- 172.21.15.38:0/1708113832 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4004030 con 0x7f02dc15e740 2023-12-22T08:39:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.322+0000 7f02d2ffd640 1 -- 172.21.15.38:0/1708113832 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d4004190 con 0x7f02dc15e740 2023-12-22T08:39:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.322+0000 7f02d2ffd640 1 -- 172.21.15.38:0/1708113832 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d40339b0 con 0x7f02dc15e740 2023-12-22T08:39:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.322+0000 7f02e45f6640 1 -- 172.21.15.38:0/1708113832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02dc0b8870 con 0x7f02dc15e740 2023-12-22T08:39:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.322+0000 7f02e45f6640 1 -- 172.21.15.38:0/1708113832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc0b5fe0 con 0x7f02dc15e740 2023-12-22T08:39:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.323+0000 7f02e45f6640 1 -- 172.21.15.38:0/1708113832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02dc061910 con 0x7f02dc15e740 2023-12-22T08:39:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.324+0000 7f02d2ffd640 1 -- 172.21.15.38:0/1708113832 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f02d4033b10 con 0x7f02dc15e740 2023-12-22T08:39:59.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.325+0000 7f02d2ffd640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02c006a430 0x7f02c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:59.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.325+0000 7f02d2ffd640 1 -- 172.21.15.38:0/1708113832 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02d40aab90 con 0x7f02dc15e740 2023-12-22T08:39:59.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.326+0000 7f02e2392640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02c006a430 0x7f02c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:59.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.327+0000 7f02e2392640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02c006a430 0x7f02c006c8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f02d80012e0 tx=0x7f02d8007ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:59.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.329+0000 7f02d2ffd640 1 -- 172.21.15.38:0/1708113832 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f02d4076200 con 0x7f02dc15e740 2023-12-22T08:39:59.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.524+0000 7f02e45f6640 1 -- 172.21.15.38:0/1708113832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02dc159ed0 con 0x7f02dc15e740 2023-12-22T08:39:59.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.526+0000 7f02d2ffd640 1 -- 172.21.15.38:0/1708113832 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16006 (secure 0 0 0) 0x7f02d4038020 con 0x7f02dc15e740 2023-12-22T08:39:59.529 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:39:59.529 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":19,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:58.600344+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:39:59.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.529+0000 7f02e45f6640 1 -- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02c006a430 msgr2=0x7f02c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:59.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.529+0000 7f02e45f6640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02c006a430 0x7f02c006c8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f02d80012e0 tx=0x7f02d8007ed0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.529+0000 7f02e45f6640 1 -- 172.21.15.38:0/1708113832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc15e740 msgr2=0x7f02dc15a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:59.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.529+0000 7f02e45f6640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc15e740 0x7f02dc15a0f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f02d40097a0 tx=0x7f02d40046c0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.529+0000 7f02e45f6640 1 -- 172.21.15.38:0/1708113832 shutdown_connections 2023-12-22T08:39:59.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.529+0000 7f02e45f6640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02c006a430 0x7f02c006c8f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.529+0000 7f02e45f6640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc15e740 0x7f02dc15a0f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.529+0000 7f02e45f6640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0b3f90 0x7f02dc158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.529+0000 7f02e45f6640 1 --2- 172.21.15.38:0/1708113832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02dc06ca50 0x7f02dc153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.529+0000 7f02e45f6640 1 -- 172.21.15.38:0/1708113832 >> 172.21.15.38:0/1708113832 conn(0x7f02dc0cfea0 msgr2=0x7f02dc0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:59.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.529+0000 7f02e45f6640 1 -- 172.21.15.38:0/1708113832 shutdown_connections 2023-12-22T08:39:59.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.529+0000 7f02e45f6640 1 -- 172.21.15.38:0/1708113832 wait complete. 2023-12-22T08:39:59.552 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T08:39:59.755 INFO:tasks.ceph.mds.d.smithi089.stderr:2023-12-22T08:39:59.752+0000 7f53f6930640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:39:59.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.776+0000 7fa542327640 1 Processor -- start 2023-12-22T08:39:59.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.777+0000 7fa542327640 1 -- start start 2023-12-22T08:39:59.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.778+0000 7fa542327640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa53c144d10 0x7fa53c0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:59.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.778+0000 7fa542327640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa53c0cc670 0x7fa53c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:59.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.778+0000 7fa542327640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c1450f0 con 0x7fa53c0b2590 2023-12-22T08:39:59.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.778+0000 7fa542327640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53c0b2a20 con 0x7fa53c144d10 2023-12-22T08:39:59.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.778+0000 7fa542327640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0ce010 con 0x7fa53c0cc670 2023-12-22T08:39:59.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.779+0000 7fa53bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa53c144d10 0x7fa53c0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:59.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.779+0000 7fa53bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa53c144d10 0x7fa53c0cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37398/0 (socket says 172.21.15.38:37398) 2023-12-22T08:39:59.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.779+0000 7fa53bfff640 1 -- 172.21.15.38:0/4226247621 learned_addr learned my addr 172.21.15.38:0/4226247621 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:59.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.779+0000 7fa533fff640 1 --2- 172.21.15.38:0/4226247621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa53c0cc670 0x7fa53c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:59.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.779+0000 7fa53bfff640 1 -- 172.21.15.38:0/4226247621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa53c0cc670 msgr2=0x7fa53c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:39:59.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.779+0000 7fa53bfff640 1 --2- 172.21.15.38:0/4226247621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa53c0cc670 0x7fa53c0b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.780+0000 7fa53bfff640 1 -- 172.21.15.38:0/4226247621 >> v1:172.21.15.89:6789/0 conn(0x7fa53c0b2590 legacy=0x7fa53c15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:59.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.780+0000 7fa53bfff640 1 -- 172.21.15.38:0/4226247621 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c0ce2f0 con 0x7fa53c144d10 2023-12-22T08:39:59.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.781+0000 7fa53bfff640 1 --2- 172.21.15.38:0/4226247621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa53c144d10 0x7fa53c0cc130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009870 tx=0x7fa52c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2722892afc2d52df server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:59.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.781+0000 7fa53b7fe640 1 -- 172.21.15.38:0/4226247621 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c030840 con 0x7fa53c144d10 2023-12-22T08:39:59.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.781+0000 7fa53b7fe640 1 -- 172.21.15.38:0/4226247621 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c0309a0 con 0x7fa53c144d10 2023-12-22T08:39:59.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.781+0000 7fa53b7fe640 1 -- 172.21.15.38:0/4226247621 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c030d30 con 0x7fa53c144d10 2023-12-22T08:39:59.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.782+0000 7fa542327640 1 -- 172.21.15.38:0/4226247621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa53c144d10 msgr2=0x7fa53c0cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:59.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.782+0000 7fa542327640 1 --2- 172.21.15.38:0/4226247621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa53c144d10 0x7fa53c0cc130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009870 tx=0x7fa52c02b980 comp rx=0 tx=0).stop 2023-12-22T08:39:59.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.782+0000 7fa542327640 1 -- 172.21.15.38:0/4226247621 shutdown_connections 2023-12-22T08:39:59.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.782+0000 7fa542327640 1 --2- 172.21.15.38:0/4226247621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa53c0cc670 0x7fa53c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.782+0000 7fa542327640 1 --2- 172.21.15.38:0/4226247621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa53c144d10 0x7fa53c0cc130 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.782+0000 7fa542327640 1 -- 172.21.15.38:0/4226247621 >> 172.21.15.38:0/4226247621 conn(0x7fa53c0cf070 msgr2=0x7fa53c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:39:59.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.782+0000 7fa542327640 1 -- 172.21.15.38:0/4226247621 shutdown_connections 2023-12-22T08:39:59.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.782+0000 7fa542327640 1 -- 172.21.15.38:0/4226247621 wait complete. 2023-12-22T08:39:59.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.784+0000 7fa542327640 1 Processor -- start 2023-12-22T08:39:59.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.784+0000 7fa542327640 1 -- start start 2023-12-22T08:39:59.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.785+0000 7fa542327640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa53c0b2590 0x7fa53c1e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:59.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.785+0000 7fa542327640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa53c144d10 0x7fa53c155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:59.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.785+0000 7fa542327640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa53c1578f0 0x7fa53c157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:59.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.785+0000 7fa542327640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c06c320 con 0x7fa53c1578f0 2023-12-22T08:39:59.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.785+0000 7fa542327640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c06c870 con 0x7fa53c0b2590 2023-12-22T08:39:59.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.785+0000 7fa542327640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c1e5410 con 0x7fa53c144d10 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.785+0000 7fa5408c4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa53c1578f0 0x7fa53c157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.785+0000 7fa5408c4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa53c1578f0 0x7fa53c157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37410/0 (socket says 172.21.15.38:37410) 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.785+0000 7fa5408c4640 1 -- 172.21.15.38:0/16359196 learned_addr learned my addr 172.21.15.38:0/16359196 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.786+0000 7fa533fff640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa53c144d10 0x7fa53c155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.786+0000 7fa53bfff640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa53c0b2590 0x7fa53c1e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.786+0000 7fa5408c4640 1 -- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa53c144d10 msgr2=0x7fa53c155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.786+0000 7fa5408c4640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa53c144d10 0x7fa53c155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.786+0000 7fa5408c4640 1 -- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa53c0b2590 msgr2=0x7fa53c1e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.786+0000 7fa5408c4640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa53c0b2590 0x7fa53c1e4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.786+0000 7fa5408c4640 1 -- 172.21.15.38:0/16359196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c0094d0 con 0x7fa53c1578f0 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.786+0000 7fa5408c4640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa53c1578f0 0x7fa53c157d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa53400c7a0 tx=0x7fa53400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.786+0000 7fa5397fa640 1 -- 172.21.15.38:0/16359196 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534003b70 con 0x7fa53c1578f0 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.786+0000 7fa5397fa640 1 -- 172.21.15.38:0/16359196 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa534003cf0 con 0x7fa53c1578f0 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.786+0000 7fa5397fa640 1 -- 172.21.15.38:0/16359196 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534003ea0 con 0x7fa53c1578f0 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.787+0000 7fa542327640 1 -- 172.21.15.38:0/16359196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53c1583b0 con 0x7fa53c1578f0 2023-12-22T08:39:59.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.787+0000 7fa542327640 1 -- 172.21.15.38:0/16359196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c06c500 con 0x7fa53c1578f0 2023-12-22T08:39:59.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.788+0000 7fa542327640 1 -- 172.21.15.38:0/16359196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53c1588d0 con 0x7fa53c1578f0 2023-12-22T08:39:59.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.789+0000 7fa5397fa640 1 -- 172.21.15.38:0/16359196 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa53400aa90 con 0x7fa53c1578f0 2023-12-22T08:39:59.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.790+0000 7fa5397fa640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa51c06a430 0x7fa51c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:39:59.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.790+0000 7fa5397fa640 1 -- 172.21.15.38:0/16359196 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa534088830 con 0x7fa53c1578f0 2023-12-22T08:39:59.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.790+0000 7fa53bfff640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa51c06a430 0x7fa51c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:39:59.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.791+0000 7fa53bfff640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa51c06a430 0x7fa51c06c8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa52c036000 tx=0x7fa52c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:39:59.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:39:59.794+0000 7fa5397fa640 1 -- 172.21.15.38:0/16359196 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa53c1588d0 con 0x7fa53c1578f0 2023-12-22T08:40:00.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.031+0000 7fa542327640 1 -- 172.21.15.38:0/16359196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa53c1588d0 con 0x7fa53c1578f0 2023-12-22T08:40:00.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.632+0000 7fa5397fa640 1 -- 172.21.15.38:0/16359196 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa53c1588d0 con 0x7fa53c1578f0 2023-12-22T08:40:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.635+0000 7fa542327640 1 -- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa51c06a430 msgr2=0x7fa51c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.635+0000 7fa542327640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa51c06a430 0x7fa51c06c8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa52c036000 tx=0x7fa52c03b040 comp rx=0 tx=0).stop 2023-12-22T08:40:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.635+0000 7fa542327640 1 -- 172.21.15.38:0/16359196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa53c1578f0 msgr2=0x7fa53c157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.635+0000 7fa542327640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa53c1578f0 0x7fa53c157d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa53400c7a0 tx=0x7fa53400cc60 comp rx=0 tx=0).stop 2023-12-22T08:40:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.636+0000 7fa542327640 1 -- 172.21.15.38:0/16359196 shutdown_connections 2023-12-22T08:40:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.636+0000 7fa542327640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa51c06a430 0x7fa51c06c8f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.636+0000 7fa542327640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa53c1578f0 0x7fa53c157d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:00.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.636+0000 7fa542327640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa53c144d10 0x7fa53c155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:00.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.636+0000 7fa542327640 1 --2- 172.21.15.38:0/16359196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa53c0b2590 0x7fa53c1e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:00.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.636+0000 7fa542327640 1 -- 172.21.15.38:0/16359196 >> 172.21.15.38:0/16359196 conn(0x7fa53c0cf070 msgr2=0x7fa53c0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:00.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.636+0000 7fa542327640 1 -- 172.21.15.38:0/16359196 shutdown_connections 2023-12-22T08:40:00.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.636+0000 7fa542327640 1 -- 172.21.15.38:0/16359196 wait complete. 2023-12-22T08:40:00.661 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled']} 2023-12-22T08:40:00.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T08:40:00.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.891+0000 7fe1c5e7d640 1 Processor -- start 2023-12-22T08:40:00.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.892+0000 7fe1c5e7d640 1 -- start start 2023-12-22T08:40:00.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.893+0000 7fe1c5e7d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c015e740 0x7fe1c015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:00.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.893+0000 7fe1c5e7d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe1c006ca50 0x7fe1c00b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:00.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.894+0000 7fe1c5e7d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c00b4210 con 0x7fe1c00b3dc0 2023-12-22T08:40:00.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.894+0000 7fe1c5e7d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c006e650 con 0x7fe1c006ca50 2023-12-22T08:40:00.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.894+0000 7fe1c5e7d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c015eb20 con 0x7fe1c015e740 2023-12-22T08:40:00.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.894+0000 7fe1bf7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c015e740 0x7fe1c015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:00.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.894+0000 7fe1bf7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c015e740 0x7fe1c015db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:48742/0 (socket says 172.21.15.38:48742) 2023-12-22T08:40:00.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.894+0000 7fe1bf7fe640 1 -- 172.21.15.38:0/4260953346 learned_addr learned my addr 172.21.15.38:0/4260953346 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:00.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.894+0000 7fe1b7fff640 1 --2- 172.21.15.38:0/4260953346 >> v2:172.21.15.89:3300/0 conn(0x7fe1c006ca50 0x7fe1c00b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:00.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.895+0000 7fe1bf7fe640 1 -- 172.21.15.38:0/4260953346 >> v2:172.21.15.89:3300/0 conn(0x7fe1c006ca50 msgr2=0x7fe1c00b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:00.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.895+0000 7fe1bf7fe640 1 --2- 172.21.15.38:0/4260953346 >> v2:172.21.15.89:3300/0 conn(0x7fe1c006ca50 0x7fe1c00b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:00.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.895+0000 7fe1bf7fe640 1 -- 172.21.15.38:0/4260953346 >> v1:172.21.15.89:6789/0 conn(0x7fe1c00b3dc0 legacy=0x7fe1c0161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:00.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.895+0000 7fe1bf7fe640 1 -- 172.21.15.38:0/4260953346 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c0070770 con 0x7fe1c015e740 2023-12-22T08:40:00.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.896+0000 7fe1bf7fe640 1 --2- 172.21.15.38:0/4260953346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c015e740 0x7fe1c015db30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009870 tx=0x7fe1b002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=426cc9ce5eb80a47 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:00.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.897+0000 7fe1beffd640 1 -- 172.21.15.38:0/4260953346 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00317c0 con 0x7fe1c015e740 2023-12-22T08:40:00.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.897+0000 7fe1beffd640 1 -- 172.21.15.38:0/4260953346 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b0031920 con 0x7fe1c015e740 2023-12-22T08:40:00.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.897+0000 7fe1beffd640 1 -- 172.21.15.38:0/4260953346 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0031cb0 con 0x7fe1c015e740 2023-12-22T08:40:00.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.897+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/4260953346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c015e740 msgr2=0x7fe1c015db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:00.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.897+0000 7fe1c5e7d640 1 --2- 172.21.15.38:0/4260953346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c015e740 0x7fe1c015db30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009870 tx=0x7fe1b002b860 comp rx=0 tx=0).stop 2023-12-22T08:40:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.898+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/4260953346 shutdown_connections 2023-12-22T08:40:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.898+0000 7fe1c5e7d640 1 --2- 172.21.15.38:0/4260953346 >> v2:172.21.15.89:3300/0 conn(0x7fe1c006ca50 0x7fe1c00b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.898+0000 7fe1c5e7d640 1 --2- 172.21.15.38:0/4260953346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c015e740 0x7fe1c015db30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.898+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/4260953346 >> 172.21.15.38:0/4260953346 conn(0x7fe1c00cfea0 msgr2=0x7fe1c00d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.898+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/4260953346 shutdown_connections 2023-12-22T08:40:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.898+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/4260953346 wait complete. 2023-12-22T08:40:00.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.899+0000 7fe1c5e7d640 1 Processor -- start 2023-12-22T08:40:00.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.900+0000 7fe1c5e7d640 1 -- start start 2023-12-22T08:40:00.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.901+0000 7fe1c5e7d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c006ca50 0x7fe1c01424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:00.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.901+0000 7fe1c5e7d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c00b3dc0 0x7fe1c00b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:00.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.901+0000 7fe1c5e7d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c015e740 0x7fe1c00b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:00.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.901+0000 7fe1c5e7d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00b2610 con 0x7fe1c015e740 2023-12-22T08:40:00.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.901+0000 7fe1c5e7d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0142fe0 con 0x7fe1c006ca50 2023-12-22T08:40:00.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.901+0000 7fe1c5e7d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00b7b50 con 0x7fe1c00b3dc0 2023-12-22T08:40:00.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.901+0000 7fe1bffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c015e740 0x7fe1c00b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:00.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.901+0000 7fe1bffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c015e740 0x7fe1c00b20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37422/0 (socket says 172.21.15.38:37422) 2023-12-22T08:40:00.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.901+0000 7fe1bffff640 1 -- 172.21.15.38:0/1659252694 learned_addr learned my addr 172.21.15.38:0/1659252694 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:00.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.901+0000 7fe1b7fff640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c00b3dc0 0x7fe1c00b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:00.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.902+0000 7fe1bf7fe640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c006ca50 0x7fe1c01424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:00.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.902+0000 7fe1bffff640 1 -- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c00b3dc0 msgr2=0x7fe1c00b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:00.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.902+0000 7fe1bffff640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c00b3dc0 0x7fe1c00b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.902+0000 7fe1bffff640 1 -- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c006ca50 msgr2=0x7fe1c01424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.902+0000 7fe1bffff640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c006ca50 0x7fe1c01424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.902+0000 7fe1bffff640 1 -- 172.21.15.38:0/1659252694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b00094d0 con 0x7fe1c015e740 2023-12-22T08:40:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.902+0000 7fe1bffff640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c015e740 0x7fe1c00b20d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800c7a0 tx=0x7fe1b800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.902+0000 7fe1bcff9640 1 -- 172.21.15.38:0/1659252694 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8003b70 con 0x7fe1c015e740 2023-12-22T08:40:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.902+0000 7fe1bcff9640 1 -- 172.21.15.38:0/1659252694 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b8003cf0 con 0x7fe1c015e740 2023-12-22T08:40:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.902+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/1659252694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c00b7e30 con 0x7fe1c015e740 2023-12-22T08:40:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.902+0000 7fe1bcff9640 1 -- 172.21.15.38:0/1659252694 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8003ea0 con 0x7fe1c015e740 2023-12-22T08:40:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.903+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/1659252694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c01429f0 con 0x7fe1c015e740 2023-12-22T08:40:00.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.904+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/1659252694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c0143190 con 0x7fe1c015e740 2023-12-22T08:40:00.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.905+0000 7fe1bcff9640 1 -- 172.21.15.38:0/1659252694 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe1b800aa90 con 0x7fe1c015e740 2023-12-22T08:40:00.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.906+0000 7fe1bcff9640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1a006a430 0x7fe1a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:00.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.906+0000 7fe1bcff9640 1 -- 172.21.15.38:0/1659252694 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1b8088540 con 0x7fe1c015e740 2023-12-22T08:40:00.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.906+0000 7fe1bf7fe640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1a006a430 0x7fe1a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:00.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.907+0000 7fe1bf7fe640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1a006a430 0x7fe1a006c8f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0036000 tx=0x7fe1b003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:00.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:00.910+0000 7fe1bcff9640 1 -- 172.21.15.38:0/1659252694 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe1c0143190 con 0x7fe1c015e740 2023-12-22T08:40:01.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:01.145+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/1659252694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe1c00b4210 con 0x7fe1c015e740 2023-12-22T08:40:02.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.083+0000 7fe1bcff9640 1 -- 172.21.15.38:0/1659252694 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe1c00b4210 con 0x7fe1c015e740 2023-12-22T08:40:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.087+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1a006a430 msgr2=0x7fe1a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.087+0000 7fe1c5e7d640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1a006a430 0x7fe1a006c8f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0036000 tx=0x7fe1b003d040 comp rx=0 tx=0).stop 2023-12-22T08:40:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.087+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/1659252694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c015e740 msgr2=0x7fe1c00b20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.087+0000 7fe1c5e7d640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c015e740 0x7fe1c00b20d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800c7a0 tx=0x7fe1b800cc60 comp rx=0 tx=0).stop 2023-12-22T08:40:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.087+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/1659252694 shutdown_connections 2023-12-22T08:40:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.087+0000 7fe1c5e7d640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1a006a430 0x7fe1a006c8f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.087+0000 7fe1c5e7d640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c015e740 0x7fe1c00b20d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.087+0000 7fe1c5e7d640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c00b3dc0 0x7fe1c00b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.087+0000 7fe1c5e7d640 1 --2- 172.21.15.38:0/1659252694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c006ca50 0x7fe1c01424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.087+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/1659252694 >> 172.21.15.38:0/1659252694 conn(0x7fe1c00cfea0 msgr2=0x7fe1c015d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:02.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.087+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/1659252694 shutdown_connections 2023-12-22T08:40:02.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.087+0000 7fe1c5e7d640 1 -- 172.21.15.38:0/1659252694 wait complete. 2023-12-22T08:40:02.114 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T08:40:02.114 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:40:02.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.337+0000 7f8e868c4640 1 Processor -- start 2023-12-22T08:40:02.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.337+0000 7f8e868c4640 1 -- start start 2023-12-22T08:40:02.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.339+0000 7f8e868c4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8e800b2050 0x7f8e800b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:02.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.339+0000 7f8e868c4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8e80070800 0x7f8e80070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:02.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.339+0000 7f8e868c4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e801450f0 con 0x7f8e80144d10 2023-12-22T08:40:02.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.339+0000 7f8e868c4640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e800cc840 con 0x7f8e80070800 2023-12-22T08:40:02.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.339+0000 7f8e868c4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e800ce010 con 0x7f8e800b2050 2023-12-22T08:40:02.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.340+0000 7f8e84e61640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8e80070800 0x7f8e80070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:02.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.340+0000 7f8e84e61640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8e80070800 0x7f8e80070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42190/0 (socket says 172.21.15.38:42190) 2023-12-22T08:40:02.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.340+0000 7f8e84e61640 1 -- 172.21.15.38:0/511308598 learned_addr learned my addr 172.21.15.38:0/511308598 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:02.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.340+0000 7f8e777fe640 1 --2- 172.21.15.38:0/511308598 >> v2:172.21.15.89:3300/0 conn(0x7f8e800b2050 0x7f8e800b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:02.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.340+0000 7f8e84e61640 1 -- 172.21.15.38:0/511308598 >> v2:172.21.15.89:3300/0 conn(0x7f8e800b2050 msgr2=0x7f8e800b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:02.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.340+0000 7f8e84e61640 1 --2- 172.21.15.38:0/511308598 >> v2:172.21.15.89:3300/0 conn(0x7f8e800b2050 0x7f8e800b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.340+0000 7f8e84e61640 1 -- 172.21.15.38:0/511308598 >> v1:172.21.15.89:6789/0 conn(0x7f8e80144d10 legacy=0x7f8e800cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:02.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.340+0000 7f8e84e61640 1 -- 172.21.15.38:0/511308598 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e800b29f0 con 0x7f8e80070800 2023-12-22T08:40:02.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.341+0000 7f8e84e61640 1 --2- 172.21.15.38:0/511308598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e80070800 0x7f8e80070be0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e800b32f0 tx=0x7f8e7802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df9d718e34c5567 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:02.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.342+0000 7f8e7f7fe640 1 -- 172.21.15.38:0/511308598 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e78030860 con 0x7f8e80070800 2023-12-22T08:40:02.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.342+0000 7f8e7f7fe640 1 -- 172.21.15.38:0/511308598 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e780309c0 con 0x7f8e80070800 2023-12-22T08:40:02.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.342+0000 7f8e7f7fe640 1 -- 172.21.15.38:0/511308598 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e78030d50 con 0x7f8e80070800 2023-12-22T08:40:02.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.342+0000 7f8e868c4640 1 -- 172.21.15.38:0/511308598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e80070800 msgr2=0x7f8e80070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:02.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.342+0000 7f8e868c4640 1 --2- 172.21.15.38:0/511308598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e80070800 0x7f8e80070be0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e800b32f0 tx=0x7f8e7802b9a0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.342+0000 7f8e868c4640 1 -- 172.21.15.38:0/511308598 shutdown_connections 2023-12-22T08:40:02.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.342+0000 7f8e868c4640 1 --2- 172.21.15.38:0/511308598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e80070800 0x7f8e80070be0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.343+0000 7f8e868c4640 1 --2- 172.21.15.38:0/511308598 >> v2:172.21.15.89:3300/0 conn(0x7f8e800b2050 0x7f8e800b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.343+0000 7f8e868c4640 1 -- 172.21.15.38:0/511308598 >> 172.21.15.38:0/511308598 conn(0x7f8e800cf070 msgr2=0x7f8e800cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:02.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.343+0000 7f8e868c4640 1 -- 172.21.15.38:0/511308598 shutdown_connections 2023-12-22T08:40:02.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.343+0000 7f8e868c4640 1 -- 172.21.15.38:0/511308598 wait complete. 2023-12-22T08:40:02.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.344+0000 7f8e868c4640 1 Processor -- start 2023-12-22T08:40:02.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.345+0000 7f8e868c4640 1 -- start start 2023-12-22T08:40:02.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.345+0000 7f8e868c4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e80070800 0x7f8e80154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:02.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.345+0000 7f8e868c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e800b2050 0x7f8e800afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:02.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e868c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e80144d10 0x7f8e801325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:02.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e868c4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800af800 con 0x7f8e80070800 2023-12-22T08:40:02.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e868c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800aebc0 con 0x7f8e80144d10 2023-12-22T08:40:02.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e868c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800aee60 con 0x7f8e800b2050 2023-12-22T08:40:02.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e7ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e80070800 0x7f8e80154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:02.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e7ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e80070800 0x7f8e80154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42192/0 (socket says 172.21.15.38:42192) 2023-12-22T08:40:02.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e7ffff640 1 -- 172.21.15.38:0/462698513 learned_addr learned my addr 172.21.15.38:0/462698513 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:02.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e84e61640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e80144d10 0x7f8e801325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:02.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e777fe640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e800b2050 0x7f8e800afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:02.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e7ffff640 1 -- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e800b2050 msgr2=0x7f8e800afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:02.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e7ffff640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e800b2050 0x7f8e800afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e7ffff640 1 -- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e80144d10 msgr2=0x7f8e801325c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:02.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e7ffff640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e80144d10 0x7f8e801325c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.346+0000 7f8e7ffff640 1 -- 172.21.15.38:0/462698513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e780094d0 con 0x7f8e80070800 2023-12-22T08:40:02.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.347+0000 7f8e7ffff640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e80070800 0x7f8e80154cd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000c400 tx=0x7f8e7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:02.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.347+0000 7f8e7d7fa640 1 -- 172.21.15.38:0/462698513 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e700052d0 con 0x7f8e80070800 2023-12-22T08:40:02.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.347+0000 7f8e7d7fa640 1 -- 172.21.15.38:0/462698513 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e70005430 con 0x7f8e80070800 2023-12-22T08:40:02.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.347+0000 7f8e7d7fa640 1 -- 172.21.15.38:0/462698513 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70003830 con 0x7f8e80070800 2023-12-22T08:40:02.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.347+0000 7f8e868c4640 1 -- 172.21.15.38:0/462698513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e800af140 con 0x7f8e80070800 2023-12-22T08:40:02.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.347+0000 7f8e868c4640 1 -- 172.21.15.38:0/462698513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e80155210 con 0x7f8e80070800 2023-12-22T08:40:02.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.348+0000 7f8e868c4640 1 -- 172.21.15.38:0/462698513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e801559e0 con 0x7f8e80070800 2023-12-22T08:40:02.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.349+0000 7f8e7d7fa640 1 -- 172.21.15.38:0/462698513 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8e70003990 con 0x7f8e80070800 2023-12-22T08:40:02.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.350+0000 7f8e7d7fa640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e6006a430 0x7f8e6006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:02.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.350+0000 7f8e7d7fa640 1 -- 172.21.15.38:0/462698513 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e70087f60 con 0x7f8e80070800 2023-12-22T08:40:02.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.351+0000 7f8e777fe640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e6006a430 0x7f8e6006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:02.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.352+0000 7f8e777fe640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e6006a430 0x7f8e6006c8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8e800b2cc0 tx=0x7f8e6800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:02.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.355+0000 7f8e7d7fa640 1 -- 172.21.15.38:0/462698513 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8e700534b0 con 0x7f8e80070800 2023-12-22T08:40:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.585+0000 7f8e868c4640 1 -- 172.21.15.38:0/462698513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e80061910 con 0x7f8e80070800 2023-12-22T08:40:02.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.586+0000 7f8e7d7fa640 1 -- 172.21.15.38:0/462698513 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4639 (secure 0 0 0) 0x7f8e70056ad0 con 0x7f8e80070800 2023-12-22T08:40:02.589 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:02.589 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/444746330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":444746330},{"type":"v1","addr":"172.21.15.38:6833","nonce":444746330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/3918267418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":3918267418},{"type":"v1","addr":"172.21.15.38:6835","nonce":3918267418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2511997570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2511997570},{"type":"v1","addr":"172.21.15.89:6835","nonce":2511997570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:39:58.600709+0000","modified":"2023-12-22T08:40:02.076114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2902919630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2902919630},{"type":"v1","addr":"172.21.15.89:6837","nonce":2902919630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:40:02.589 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-12-22T08:40:02.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.589+0000 7f8e868c4640 1 -- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e6006a430 msgr2=0x7f8e6006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:02.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.589+0000 7f8e868c4640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e6006a430 0x7f8e6006c8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8e800b2cc0 tx=0x7f8e6800b040 comp rx=0 tx=0).stop 2023-12-22T08:40:02.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.589+0000 7f8e868c4640 1 -- 172.21.15.38:0/462698513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e80070800 msgr2=0x7f8e80154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:02.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.589+0000 7f8e868c4640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e80070800 0x7f8e80154cd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000c400 tx=0x7f8e7000c8c0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.589+0000 7f8e868c4640 1 -- 172.21.15.38:0/462698513 shutdown_connections 2023-12-22T08:40:02.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.589+0000 7f8e868c4640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e80144d10 0x7f8e801325c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.589+0000 7f8e868c4640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e800b2050 0x7f8e800afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.589+0000 7f8e868c4640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e6006a430 0x7f8e6006c8f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.589+0000 7f8e868c4640 1 --2- 172.21.15.38:0/462698513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e80070800 0x7f8e80154cd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.589+0000 7f8e868c4640 1 -- 172.21.15.38:0/462698513 >> 172.21.15.38:0/462698513 conn(0x7f8e800cf070 msgr2=0x7f8e8015b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:02.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.589+0000 7f8e868c4640 1 -- 172.21.15.38:0/462698513 shutdown_connections 2023-12-22T08:40:02.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.589+0000 7f8e868c4640 1 -- 172.21.15.38:0/462698513 wait complete. 2023-12-22T08:40:02.611 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:02.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.833+0000 7f257359e640 1 Processor -- start 2023-12-22T08:40:02.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.833+0000 7f257359e640 1 -- start start 2023-12-22T08:40:02.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.834+0000 7f257359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f257406d210 0x7f257415e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:02.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.835+0000 7f257359e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f257406d5f0 0x7f2574070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:02.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.835+0000 7f257359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25740706d0 con 0x7f25740cb4c0 2023-12-22T08:40:02.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.835+0000 7f257359e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25740cbf40 con 0x7f257406d5f0 2023-12-22T08:40:02.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.835+0000 7f257359e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25740ce840 con 0x7f257406d210 2023-12-22T08:40:02.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.835+0000 7f2572d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f257406d5f0 0x7f2574070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:02.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.835+0000 7f2572d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f257406d5f0 0x7f2574070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42200/0 (socket says 172.21.15.38:42200) 2023-12-22T08:40:02.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.835+0000 7f2572d9d640 1 -- 172.21.15.38:0/3067954991 learned_addr learned my addr 172.21.15.38:0/3067954991 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:02.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.835+0000 7f257259c640 1 --2- 172.21.15.38:0/3067954991 >> v2:172.21.15.89:3300/0 conn(0x7f257406d210 0x7f257415e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:02.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.836+0000 7f2572d9d640 1 -- 172.21.15.38:0/3067954991 >> v2:172.21.15.89:3300/0 conn(0x7f257406d210 msgr2=0x7f257415e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:02.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.836+0000 7f2572d9d640 1 --2- 172.21.15.38:0/3067954991 >> v2:172.21.15.89:3300/0 conn(0x7f257406d210 0x7f257415e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.836+0000 7f2572d9d640 1 -- 172.21.15.38:0/3067954991 >> v1:172.21.15.89:6789/0 conn(0x7f25740cb4c0 legacy=0x7f2574159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:02.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.836+0000 7f2572d9d640 1 -- 172.21.15.38:0/3067954991 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25740ceb20 con 0x7f257406d5f0 2023-12-22T08:40:02.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.837+0000 7f2572d9d640 1 --2- 172.21.15.38:0/3067954991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f257406d5f0 0x7f2574070b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f257406a7f0 tx=0x7f256c02e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea97c58379fac99 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:02.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.837+0000 7f2571d9b640 1 -- 172.21.15.38:0/3067954991 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c00b0d0 con 0x7f257406d5f0 2023-12-22T08:40:02.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.837+0000 7f2571d9b640 1 -- 172.21.15.38:0/3067954991 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c00b230 con 0x7f257406d5f0 2023-12-22T08:40:02.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.837+0000 7f2571d9b640 1 -- 172.21.15.38:0/3067954991 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c009600 con 0x7f257406d5f0 2023-12-22T08:40:02.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.838+0000 7f257359e640 1 -- 172.21.15.38:0/3067954991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f257406d5f0 msgr2=0x7f2574070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:02.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.838+0000 7f257359e640 1 --2- 172.21.15.38:0/3067954991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f257406d5f0 0x7f2574070b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f257406a7f0 tx=0x7f256c02e180 comp rx=0 tx=0).stop 2023-12-22T08:40:02.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.838+0000 7f257359e640 1 -- 172.21.15.38:0/3067954991 shutdown_connections 2023-12-22T08:40:02.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.838+0000 7f257359e640 1 --2- 172.21.15.38:0/3067954991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f257406d5f0 0x7f2574070b60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.838+0000 7f257359e640 1 --2- 172.21.15.38:0/3067954991 >> v2:172.21.15.89:3300/0 conn(0x7f257406d210 0x7f257415e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.838+0000 7f257359e640 1 -- 172.21.15.38:0/3067954991 >> 172.21.15.38:0/3067954991 conn(0x7f25740b1f70 msgr2=0x7f25740b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:02.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.838+0000 7f257359e640 1 -- 172.21.15.38:0/3067954991 shutdown_connections 2023-12-22T08:40:02.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.838+0000 7f257359e640 1 -- 172.21.15.38:0/3067954991 wait complete. 2023-12-22T08:40:02.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.840+0000 7f257359e640 1 Processor -- start 2023-12-22T08:40:02.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.840+0000 7f257359e640 1 -- start start 2023-12-22T08:40:02.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.841+0000 7f257359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f257406d210 0x7f257413fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:02.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.841+0000 7f257359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f257406d5f0 0x7f25740a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:02.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.841+0000 7f257359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25740cb4c0 0x7f25741408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:02.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.841+0000 7f257359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25741427b0 con 0x7f257406d5f0 2023-12-22T08:40:02.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.841+0000 7f257359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25741435d0 con 0x7f25740cb4c0 2023-12-22T08:40:02.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.841+0000 7f257359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25741429c0 con 0x7f257406d210 2023-12-22T08:40:02.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.841+0000 7f256bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f257406d5f0 0x7f25740a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:02.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.841+0000 7f256bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f257406d5f0 0x7f25740a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42208/0 (socket says 172.21.15.38:42208) 2023-12-22T08:40:02.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.841+0000 7f256bfff640 1 -- 172.21.15.38:0/4028552096 learned_addr learned my addr 172.21.15.38:0/4028552096 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:02.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.841+0000 7f2572d9d640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25740cb4c0 0x7f25741408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:02.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.841+0000 7f257259c640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f257406d210 0x7f257413fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:02.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.841+0000 7f256bfff640 1 -- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f257406d210 msgr2=0x7f257413fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:02.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.842+0000 7f256bfff640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f257406d210 0x7f257413fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.842+0000 7f256bfff640 1 -- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25740cb4c0 msgr2=0x7f25741408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:02.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.842+0000 7f256bfff640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25740cb4c0 0x7f25741408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:02.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.842+0000 7f256bfff640 1 -- 172.21.15.38:0/4028552096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c00bd40 con 0x7f257406d5f0 2023-12-22T08:40:02.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.842+0000 7f256bfff640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f257406d5f0 0x7f25740a33c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f255c00c430 tx=0x7f255c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:02.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.842+0000 7f256affd640 1 -- 172.21.15.38:0/4028552096 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c0052d0 con 0x7f257406d5f0 2023-12-22T08:40:02.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.842+0000 7f256affd640 1 -- 172.21.15.38:0/4028552096 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c005430 con 0x7f257406d5f0 2023-12-22T08:40:02.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.842+0000 7f257359e640 1 -- 172.21.15.38:0/4028552096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2574142ca0 con 0x7f257406d5f0 2023-12-22T08:40:02.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.842+0000 7f256affd640 1 -- 172.21.15.38:0/4028552096 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c003830 con 0x7f257406d5f0 2023-12-22T08:40:02.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.842+0000 7f257359e640 1 -- 172.21.15.38:0/4028552096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2574143260 con 0x7f257406d5f0 2023-12-22T08:40:02.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.843+0000 7f257359e640 1 -- 172.21.15.38:0/4028552096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2574143710 con 0x7f257406d5f0 2023-12-22T08:40:02.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.844+0000 7f256affd640 1 -- 172.21.15.38:0/4028552096 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f255c003990 con 0x7f257406d5f0 2023-12-22T08:40:02.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.845+0000 7f256affd640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f255406a430 0x7f255406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:02.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.845+0000 7f256affd640 1 -- 172.21.15.38:0/4028552096 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f255c087fb0 con 0x7f257406d5f0 2023-12-22T08:40:02.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.846+0000 7f257259c640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f255406a430 0x7f255406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:02.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.847+0000 7f257259c640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f255406a430 0x7f255406c8f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2564006fd0 tx=0x7f2564008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:02.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:02.850+0000 7f256affd640 1 -- 172.21.15.38:0/4028552096 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2574143710 con 0x7f257406d5f0 2023-12-22T08:40:03.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.042+0000 7f257359e640 1 -- 172.21.15.38:0/4028552096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2574143710 con 0x7f257406d5f0 2023-12-22T08:40:03.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.045+0000 7f256affd640 1 -- 172.21.15.38:0/4028552096 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f2574143710 con 0x7f257406d5f0 2023-12-22T08:40:03.048 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:03.048 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:59.604518+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:03.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.048+0000 7f257359e640 1 -- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f255406a430 msgr2=0x7f255406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:03.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.048+0000 7f257359e640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f255406a430 0x7f255406c8f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2564006fd0 tx=0x7f2564008040 comp rx=0 tx=0).stop 2023-12-22T08:40:03.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.048+0000 7f257359e640 1 -- 172.21.15.38:0/4028552096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f257406d5f0 msgr2=0x7f25740a33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:03.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.048+0000 7f257359e640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f257406d5f0 0x7f25740a33c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f255c00c430 tx=0x7f255c00c8f0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.048+0000 7f257359e640 1 -- 172.21.15.38:0/4028552096 shutdown_connections 2023-12-22T08:40:03.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.048+0000 7f257359e640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25740cb4c0 0x7f25741408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.048+0000 7f257359e640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f255406a430 0x7f255406c8f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.048+0000 7f257359e640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f257406d5f0 0x7f25740a33c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.048+0000 7f257359e640 1 --2- 172.21.15.38:0/4028552096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f257406d210 0x7f257413fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.048+0000 7f257359e640 1 -- 172.21.15.38:0/4028552096 >> 172.21.15.38:0/4028552096 conn(0x7f25740b1f70 msgr2=0x7f2574070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:03.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.048+0000 7f257359e640 1 -- 172.21.15.38:0/4028552096 shutdown_connections 2023-12-22T08:40:03.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.048+0000 7f257359e640 1 -- 172.21.15.38:0/4028552096 wait complete. 2023-12-22T08:40:03.070 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T08:40:03.070 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:40:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.295+0000 7febab295640 1 Processor -- start 2023-12-22T08:40:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.295+0000 7febab295640 1 -- start start 2023-12-22T08:40:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.297+0000 7febab295640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feba40a44a0 0x7feba40708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.297+0000 7febab295640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4070e30 0x7feba415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.297+0000 7febab295640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40cdae0 con 0x7feba415b420 2023-12-22T08:40:03.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.297+0000 7febab295640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba4071250 con 0x7feba40a44a0 2023-12-22T08:40:03.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.297+0000 7febab295640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba415b800 con 0x7feba4070e30 2023-12-22T08:40:03.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.297+0000 7febaa293640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7feba415b420 0x7feba406d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51512/0 (socket says 172.21.15.38:51512) 2023-12-22T08:40:03.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.297+0000 7febaa293640 1 -- 172.21.15.38:0/3933324003 learned_addr learned my addr 172.21.15.38:0/3933324003 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:03.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.297+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286370665 0 0) 0x7feba40cdae0 con 0x7feba415b420 2023-12-22T08:40:03.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.297+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb90003520 con 0x7feba415b420 2023-12-22T08:40:03.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.297+0000 7feba9a92640 1 --2- 172.21.15.38:0/3933324003 >> v2:172.21.15.89:3300/0 conn(0x7feba40a44a0 0x7feba40708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.297+0000 7febaaa94640 1 --2- 172.21.15.38:0/3933324003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4070e30 0x7feba415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4233943809 0 0) 0x7feb90003520 con 0x7feba415b420 2023-12-22T08:40:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4070e30 msgr2=0x7feba415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 --2- 172.21.15.38:0/3933324003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4070e30 0x7feba415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 >> v2:172.21.15.89:3300/0 conn(0x7feba40a44a0 msgr2=0x7feba40708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 --2- 172.21.15.38:0/3933324003 >> v2:172.21.15.89:3300/0 conn(0x7feba40a44a0 0x7feba40708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40cdd30 con 0x7feba415b420 2023-12-22T08:40:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7feba0001670 con 0x7feba415b420 2023-12-22T08:40:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 >> v1:172.21.15.38:6789/0 conn(0x7feba415b420 legacy=0x7feba406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 --2- 172.21.15.38:0/3933324003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90003970 0x7feb90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 --2- 172.21.15.38:0/3933324003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4070e30 0x7feb900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 --2- 172.21.15.38:0/3933324003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb90004d00 0x7feb90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba4071250 con 0x7feb90004d00 2023-12-22T08:40:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba415b800 con 0x7feb90003970 2023-12-22T08:40:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9000b980 con 0x7feba4070e30 2023-12-22T08:40:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.298+0000 7febaaa94640 1 --2- 172.21.15.38:0/3933324003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb90004d00 0x7feb90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.299+0000 7febaa293640 1 --2- 172.21.15.38:0/3933324003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90003970 0x7feb90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.299+0000 7feba9a92640 1 --2- 172.21.15.38:0/3933324003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4070e30 0x7feb900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.299+0000 7febaaa94640 1 -- 172.21.15.38:0/3933324003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4070e30 msgr2=0x7feb900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.299+0000 7febaaa94640 1 --2- 172.21.15.38:0/3933324003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4070e30 0x7feb900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.299+0000 7febaaa94640 1 -- 172.21.15.38:0/3933324003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90003970 msgr2=0x7feb90003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.299+0000 7febaaa94640 1 --2- 172.21.15.38:0/3933324003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90003970 0x7feb90003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.299+0000 7febaaa94640 1 -- 172.21.15.38:0/3933324003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90003520 con 0x7feb90004d00 2023-12-22T08:40:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.299+0000 7feba9a92640 1 --2- 172.21.15.38:0/3933324003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4070e30 0x7feb900047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:03.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.300+0000 7febaaa94640 1 --2- 172.21.15.38:0/3933324003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb90004d00 0x7feb90005180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00e170 tx=0x7feb900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2830fc56af49e107 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:03.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.300+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c02cbf0 con 0x7feb90004d00 2023-12-22T08:40:03.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.300+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c00f040 con 0x7feb90004d00 2023-12-22T08:40:03.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.300+0000 7feba9291640 1 -- 172.21.15.38:0/3933324003 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c034440 con 0x7feb90004d00 2023-12-22T08:40:03.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.301+0000 7febab295640 1 -- 172.21.15.38:0/3933324003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb90004d00 msgr2=0x7feb90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.301+0000 7febab295640 1 --2- 172.21.15.38:0/3933324003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb90004d00 0x7feb90005180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00e170 tx=0x7feb900057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.301+0000 7febaaa94640 1 -- 172.21.15.38:0/3933324003 reap_dead start 2023-12-22T08:40:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.301+0000 7febab295640 1 -- 172.21.15.38:0/3933324003 shutdown_connections 2023-12-22T08:40:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.301+0000 7febab295640 1 -- 172.21.15.38:0/3933324003 >> 172.21.15.38:0/3933324003 conn(0x7feba40b1f70 msgr2=0x7feba40b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.301+0000 7febab295640 1 -- 172.21.15.38:0/3933324003 shutdown_connections 2023-12-22T08:40:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.301+0000 7febab295640 1 -- 172.21.15.38:0/3933324003 wait complete. 2023-12-22T08:40:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.303+0000 7febab295640 1 Processor -- start 2023-12-22T08:40:03.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.303+0000 7febab295640 1 -- start start 2023-12-22T08:40:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.304+0000 7febab295640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90004d00 0x7feba41f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.304+0000 7febab295640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4099a70 0x7feba409f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.304+0000 7febab295640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feba40a2140 0x7feba40a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.304+0000 7febab295640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba40a2b10 con 0x7feba40a2140 2023-12-22T08:40:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.304+0000 7febab295640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba409a860 con 0x7feb90004d00 2023-12-22T08:40:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.304+0000 7febab295640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba409a2a0 con 0x7feba4099a70 2023-12-22T08:40:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.305+0000 7febaaa94640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feba40a2140 0x7feba40a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.305+0000 7febaaa94640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feba40a2140 0x7feba40a25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42222/0 (socket says 172.21.15.38:42222) 2023-12-22T08:40:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.305+0000 7febaaa94640 1 -- 172.21.15.38:0/2286737630 learned_addr learned my addr 172.21.15.38:0/2286737630 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.305+0000 7feba9a92640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4099a70 0x7feba409f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.305+0000 7febaa293640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90004d00 0x7feba41f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.305+0000 7febaaa94640 1 -- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4099a70 msgr2=0x7feba409f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.305+0000 7febaaa94640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4099a70 0x7feba409f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.305+0000 7febaaa94640 1 -- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90004d00 msgr2=0x7feba41f13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.305+0000 7febaaa94640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90004d00 0x7feba41f13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.305+0000 7febaaa94640 1 -- 172.21.15.38:0/2286737630 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba409a580 con 0x7feba40a2140 2023-12-22T08:40:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.305+0000 7feba9a92640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4099a70 0x7feba409f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.305+0000 7febaaa94640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feba40a2140 0x7feba40a25d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00e170 tx=0x7feb9c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.306+0000 7feb9affd640 1 -- 172.21.15.38:0/2286737630 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c043070 con 0x7feba40a2140 2023-12-22T08:40:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.306+0000 7feb9affd640 1 -- 172.21.15.38:0/2286737630 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c034b50 con 0x7feba40a2140 2023-12-22T08:40:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.306+0000 7feb9affd640 1 -- 172.21.15.38:0/2286737630 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c02dea0 con 0x7feba40a2140 2023-12-22T08:40:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.306+0000 7febab295640 1 -- 172.21.15.38:0/2286737630 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba41f1c10 con 0x7feba40a2140 2023-12-22T08:40:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.306+0000 7febab295640 1 -- 172.21.15.38:0/2286737630 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba41f1930 con 0x7feba40a2140 2023-12-22T08:40:03.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.307+0000 7febab295640 1 -- 172.21.15.38:0/2286737630 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba4061910 con 0x7feba40a2140 2023-12-22T08:40:03.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.308+0000 7feb9affd640 1 -- 172.21.15.38:0/2286737630 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feb9c03e440 con 0x7feba40a2140 2023-12-22T08:40:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.309+0000 7feb9affd640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb8806a460 0x7feb8806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.309+0000 7feb9affd640 1 -- 172.21.15.38:0/2286737630 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb9c0aa540 con 0x7feba40a2140 2023-12-22T08:40:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.310+0000 7febaa293640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb8806a460 0x7feb8806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.311+0000 7febaa293640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb8806a460 0x7feb8806c920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feba0001eb0 tx=0x7feba0000f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.314+0000 7feb9affd640 1 -- 172.21.15.38:0/2286737630 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feb9c075b20 con 0x7feba40a2140 2023-12-22T08:40:03.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.502+0000 7febab295640 1 -- 172.21.15.38:0/2286737630 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feba40ce2f0 con 0x7feb8806a460 2023-12-22T08:40:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.527+0000 7feb9affd640 1 -- 172.21.15.38:0/2286737630 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257076 (secure 0 0 0) 0x7feba0005e00 con 0x7feb8806a460 2023-12-22T08:40:03.534 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:40:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.532+0000 7febab295640 1 -- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb8806a460 msgr2=0x7feb8806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.532+0000 7febab295640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb8806a460 0x7feb8806c920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feba0001eb0 tx=0x7feba0000f50 comp rx=0 tx=0).stop 2023-12-22T08:40:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.532+0000 7febab295640 1 -- 172.21.15.38:0/2286737630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feba40a2140 msgr2=0x7feba40a25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.532+0000 7febab295640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feba40a2140 0x7feba40a25d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00e170 tx=0x7feb9c009750 comp rx=0 tx=0).stop 2023-12-22T08:40:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.533+0000 7febab295640 1 -- 172.21.15.38:0/2286737630 shutdown_connections 2023-12-22T08:40:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.533+0000 7febab295640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb8806a460 0x7feb8806c920 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.533+0000 7febab295640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feba40a2140 0x7feba40a25d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.533+0000 7febab295640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba4099a70 0x7feba409f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.533+0000 7febab295640 1 --2- 172.21.15.38:0/2286737630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb90004d00 0x7feba41f13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.533+0000 7febab295640 1 -- 172.21.15.38:0/2286737630 >> 172.21.15.38:0/2286737630 conn(0x7feba40b1f70 msgr2=0x7feba406c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.533+0000 7febab295640 1 -- 172.21.15.38:0/2286737630 shutdown_connections 2023-12-22T08:40:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.533+0000 7febab295640 1 -- 172.21.15.38:0/2286737630 wait complete. 2023-12-22T08:40:03.556 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-12-22T08:40:02.354702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1571,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560928,"statfs":{"total":1600000000,"available":1598390354,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.263138"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.114552+0000","last_change":"2023-12-22T08:39:58.114552+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.114552+0000","last_undegraded":"2023-12-22T08:39:58.114552+0000","last_fullsized":"2023-12-22T08:39:58.114552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.112181+0000","last_change":"2023-12-22T08:39:58.112181+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.112181+0000","last_undegraded":"2023-12-22T08:39:58.112181+0000","last_fullsized":"2023-12-22T08:39:58.112181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.115977+0000","last_change":"2023-12-22T08:39:58.115977+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.115977+0000","last_undegraded":"2023-12-22T08:39:58.115977+0000","last_fullsized":"2023-12-22T08:39:58.115977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.115139+0000","last_change":"2023-12-22T08:39:58.115139+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.115139+0000","last_undegraded":"2023-12-22T08:39:58.115139+0000","last_fullsized":"2023-12-22T08:39:58.115139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.113179+0000","last_change":"2023-12-22T08:39:58.113179+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.113179+0000","last_undegraded":"2023-12-22T08:39:58.113179+0000","last_fullsized":"2023-12-22T08:39:58.113179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.116404+0000","last_change":"2023-12-22T08:39:58.116404+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.116404+0000","last_undegraded":"2023-12-22T08:39:58.116404+0000","last_fullsized":"2023-12-22T08:39:58.116404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.119157+0000","last_change":"2023-12-22T08:39:58.119157+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.119157+0000","last_undegraded":"2023-12-22T08:39:58.119157+0000","last_fullsized":"2023-12-22T08:39:58.119157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.115104+0000","last_change":"2023-12-22T08:39:58.115104+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.115104+0000","last_undegraded":"2023-12-22T08:39:58.115104+0000","last_fullsized":"2023-12-22T08:39:58.115104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.111733+0000","last_change":"2023-12-22T08:39:58.111733+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.111733+0000","last_undegraded":"2023-12-22T08:39:58.111733+0000","last_fullsized":"2023-12-22T08:39:58.111733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.114130+0000","last_change":"2023-12-22T08:39:58.114130+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.114130+0000","last_undegraded":"2023-12-22T08:39:58.114130+0000","last_fullsized":"2023-12-22T08:39:58.114130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.114130+0000","last_change":"2023-12-22T08:39:58.114130+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.114130+0000","last_undegraded":"2023-12-22T08:39:58.114130+0000","last_fullsized":"2023-12-22T08:39:58.114130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.122213+0000","last_change":"2023-12-22T08:39:58.122213+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.122213+0000","last_undegraded":"2023-12-22T08:39:58.122213+0000","last_fullsized":"2023-12-22T08:39:58.122213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.112794+0000","last_change":"2023-12-22T08:39:58.112794+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.112794+0000","last_undegraded":"2023-12-22T08:39:58.112794+0000","last_fullsized":"2023-12-22T08:39:58.112794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.111321+0000","last_change":"2023-12-22T08:39:58.111321+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.111321+0000","last_undegraded":"2023-12-22T08:39:58.111321+0000","last_fullsized":"2023-12-22T08:39:58.111321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.115702+0000","last_change":"2023-12-22T08:39:58.115702+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.115702+0000","last_undegraded":"2023-12-22T08:39:58.115702+0000","last_fullsized":"2023-12-22T08:39:58.115702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.121029+0000","last_change":"2023-12-22T08:39:58.121029+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.121029+0000","last_undegraded":"2023-12-22T08:39:58.121029+0000","last_fullsized":"2023-12-22T08:39:58.121029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.121556+0000","last_change":"2023-12-22T08:39:58.121556+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.121556+0000","last_undegraded":"2023-12-22T08:39:58.121556+0000","last_fullsized":"2023-12-22T08:39:58.121556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.116588+0000","last_change":"2023-12-22T08:39:58.116588+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.116588+0000","last_undegraded":"2023-12-22T08:39:58.116588+0000","last_fullsized":"2023-12-22T08:39:58.116588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.122067+0000","last_change":"2023-12-22T08:39:58.122067+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.122067+0000","last_undegraded":"2023-12-22T08:39:58.122067+0000","last_fullsized":"2023-12-22T08:39:58.122067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:24:09.483177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.113701+0000","last_change":"2023-12-22T08:39:58.113701+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.113701+0000","last_undegraded":"2023-12-22T08:39:58.113701+0000","last_fullsized":"2023-12-22T08:39:58.113701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.127797+0000","last_change":"2023-12-22T08:39:58.127797+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.127797+0000","last_undegraded":"2023-12-22T08:39:58.127797+0000","last_fullsized":"2023-12-22T08:39:58.127797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.111785+0000","last_change":"2023-12-22T08:39:58.111785+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.111785+0000","last_undegraded":"2023-12-22T08:39:58.111785+0000","last_fullsized":"2023-12-22T08:39:58.111785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.112587+0000","last_change":"2023-12-22T08:39:58.112587+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.112587+0000","last_undegraded":"2023-12-22T08:39:58.112587+0000","last_fullsized":"2023-12-22T08:39:58.112587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.119819+0000","last_change":"2023-12-22T08:39:58.119819+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.119819+0000","last_undegraded":"2023-12-22T08:39:58.119819+0000","last_fullsized":"2023-12-22T08:39:58.119819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:22.933973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.113433+0000","last_change":"2023-12-22T08:39:58.113433+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.113433+0000","last_undegraded":"2023-12-22T08:39:58.113433+0000","last_fullsized":"2023-12-22T08:39:58.113433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.116079+0000","last_change":"2023-12-22T08:39:58.116079+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.116079+0000","last_undegraded":"2023-12-22T08:39:58.116079+0000","last_fullsized":"2023-12-22T08:39:58.116079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.112149+0000","last_change":"2023-12-22T08:39:58.112149+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.112149+0000","last_undegraded":"2023-12-22T08:39:58.112149+0000","last_fullsized":"2023-12-22T08:39:58.112149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.110323+0000","last_change":"2023-12-22T08:39:58.110323+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.110323+0000","last_undegraded":"2023-12-22T08:39:58.110323+0000","last_fullsized":"2023-12-22T08:39:58.110323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:59:30.195380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.118842+0000","last_change":"2023-12-22T08:39:58.118842+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.118842+0000","last_undegraded":"2023-12-22T08:39:58.118842+0000","last_fullsized":"2023-12-22T08:39:58.118842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.118030+0000","last_change":"2023-12-22T08:39:58.118030+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.118030+0000","last_undegraded":"2023-12-22T08:39:58.118030+0000","last_fullsized":"2023-12-22T08:39:58.118030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:13:34.205933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.121492+0000","last_change":"2023-12-22T08:39:58.121492+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.121492+0000","last_undegraded":"2023-12-22T08:39:58.121492+0000","last_fullsized":"2023-12-22T08:39:58.121492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.117296+0000","last_change":"2023-12-22T08:39:58.117296+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.117296+0000","last_undegraded":"2023-12-22T08:39:58.117296+0000","last_fullsized":"2023-12-22T08:39:58.117296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.119535+0000","last_change":"2023-12-22T08:39:58.119535+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.119535+0000","last_undegraded":"2023-12-22T08:39:58.119535+0000","last_fullsized":"2023-12-22T08:39:58.119535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.123991+0000","last_change":"2023-12-22T08:39:58.118326+0000","last_active":"2023-12-22T08:39:58.123991+0000","last_peered":"2023-12-22T08:39:58.123991+0000","last_clean":"2023-12-22T08:39:58.123991+0000","last_became_active":"2023-12-22T08:39:58.117693+0000","last_became_peered":"2023-12-22T08:39:58.117693+0000","last_unstale":"2023-12-22T08:39:58.123991+0000","last_undegraded":"2023-12-22T08:39:58.123991+0000","last_fullsized":"2023-12-22T08:39:58.123991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.124543+0000","last_change":"2023-12-22T08:39:58.124543+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.124543+0000","last_undegraded":"2023-12-22T08:39:58.124543+0000","last_fullsized":"2023-12-22T08:39:58.124543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.126547+0000","last_change":"2023-12-22T08:39:58.124015+0000","last_active":"2023-12-22T08:39:58.126547+0000","last_peered":"2023-12-22T08:39:58.126547+0000","last_clean":"2023-12-22T08:39:58.126547+0000","last_became_active":"2023-12-22T08:39:58.123750+0000","last_became_peered":"2023-12-22T08:39:58.123750+0000","last_unstale":"2023-12-22T08:39:58.126547+0000","last_undegraded":"2023-12-22T08:39:58.126547+0000","last_fullsized":"2023-12-22T08:39:58.126547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:32.352283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.126760+0000","last_change":"2023-12-22T08:39:58.126588+0000","last_active":"2023-12-22T08:39:58.126760+0000","last_peered":"2023-12-22T08:39:58.126760+0000","last_clean":"2023-12-22T08:39:58.126760+0000","last_became_active":"2023-12-22T08:39:58.126277+0000","last_became_peered":"2023-12-22T08:39:58.126277+0000","last_unstale":"2023-12-22T08:39:58.126760+0000","last_undegraded":"2023-12-22T08:39:58.126760+0000","last_fullsized":"2023-12-22T08:39:58.126760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.110434+0000","last_change":"2023-12-22T08:39:58.110434+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.110434+0000","last_undegraded":"2023-12-22T08:39:58.110434+0000","last_fullsized":"2023-12-22T08:39:58.110434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:26:26.790794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.129197+0000","last_change":"2023-12-22T08:39:58.129064+0000","last_active":"2023-12-22T08:39:58.129197+0000","last_peered":"2023-12-22T08:39:58.129197+0000","last_clean":"2023-12-22T08:39:58.129197+0000","last_became_active":"2023-12-22T08:39:58.127921+0000","last_became_peered":"2023-12-22T08:39:58.127921+0000","last_unstale":"2023-12-22T08:39:58.129197+0000","last_undegraded":"2023-12-22T08:39:58.129197+0000","last_fullsized":"2023-12-22T08:39:58.129197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.122711+0000","last_change":"2023-12-22T08:39:58.122711+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.122711+0000","last_undegraded":"2023-12-22T08:39:58.122711+0000","last_fullsized":"2023-12-22T08:39:58.122711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128702+0000","last_change":"2023-12-22T08:39:58.128425+0000","last_active":"2023-12-22T08:39:58.128702+0000","last_peered":"2023-12-22T08:39:58.128702+0000","last_clean":"2023-12-22T08:39:58.128702+0000","last_became_active":"2023-12-22T08:39:58.128139+0000","last_became_peered":"2023-12-22T08:39:58.128139+0000","last_unstale":"2023-12-22T08:39:58.128702+0000","last_undegraded":"2023-12-22T08:39:58.128702+0000","last_fullsized":"2023-12-22T08:39:58.128702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.116907+0000","last_change":"2023-12-22T08:39:58.116907+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.116907+0000","last_undegraded":"2023-12-22T08:39:58.116907+0000","last_fullsized":"2023-12-22T08:39:58.116907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.124586+0000","last_change":"2023-12-22T08:39:58.123417+0000","last_active":"2023-12-22T08:39:58.124586+0000","last_peered":"2023-12-22T08:39:58.124586+0000","last_clean":"2023-12-22T08:39:58.124586+0000","last_became_active":"2023-12-22T08:39:58.122926+0000","last_became_peered":"2023-12-22T08:39:58.122926+0000","last_unstale":"2023-12-22T08:39:58.124586+0000","last_undegraded":"2023-12-22T08:39:58.124586+0000","last_fullsized":"2023-12-22T08:39:58.124586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.111776+0000","last_change":"2023-12-22T08:39:58.111776+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.111776+0000","last_undegraded":"2023-12-22T08:39:58.111776+0000","last_fullsized":"2023-12-22T08:39:58.111776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:37.333505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.129272+0000","last_change":"2023-12-22T08:39:58.129066+0000","last_active":"2023-12-22T08:39:58.129272+0000","last_peered":"2023-12-22T08:39:58.129272+0000","last_clean":"2023-12-22T08:39:58.129272+0000","last_became_active":"2023-12-22T08:39:58.128536+0000","last_became_peered":"2023-12-22T08:39:58.128536+0000","last_unstale":"2023-12-22T08:39:58.129272+0000","last_undegraded":"2023-12-22T08:39:58.129272+0000","last_fullsized":"2023-12-22T08:39:58.129272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.119200+0000","last_change":"2023-12-22T08:39:58.119200+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.119200+0000","last_undegraded":"2023-12-22T08:39:58.119200+0000","last_fullsized":"2023-12-22T08:39:58.119200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:24:34.120013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.127062+0000","last_change":"2023-12-22T08:39:58.126247+0000","last_active":"2023-12-22T08:39:58.127062+0000","last_peered":"2023-12-22T08:39:58.127062+0000","last_clean":"2023-12-22T08:39:58.127062+0000","last_became_active":"2023-12-22T08:39:58.125863+0000","last_became_peered":"2023-12-22T08:39:58.125863+0000","last_unstale":"2023-12-22T08:39:58.127062+0000","last_undegraded":"2023-12-22T08:39:58.127062+0000","last_fullsized":"2023-12-22T08:39:58.127062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.120298+0000","last_change":"2023-12-22T08:39:58.120298+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.120298+0000","last_undegraded":"2023-12-22T08:39:58.120298+0000","last_fullsized":"2023-12-22T08:39:58.120298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.126455+0000","last_change":"2023-12-22T08:39:58.123764+0000","last_active":"2023-12-22T08:39:58.126455+0000","last_peered":"2023-12-22T08:39:58.126455+0000","last_clean":"2023-12-22T08:39:58.126455+0000","last_became_active":"2023-12-22T08:39:58.123431+0000","last_became_peered":"2023-12-22T08:39:58.123431+0000","last_unstale":"2023-12-22T08:39:58.126455+0000","last_undegraded":"2023-12-22T08:39:58.126455+0000","last_fullsized":"2023-12-22T08:39:58.126455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.108271+0000","last_change":"2023-12-22T08:39:58.108271+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.108271+0000","last_undegraded":"2023-12-22T08:39:58.108271+0000","last_fullsized":"2023-12-22T08:39:58.108271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.126566+0000","last_change":"2023-12-22T08:39:58.124254+0000","last_active":"2023-12-22T08:39:58.126566+0000","last_peered":"2023-12-22T08:39:58.126566+0000","last_clean":"2023-12-22T08:39:58.126566+0000","last_became_active":"2023-12-22T08:39:58.123937+0000","last_became_peered":"2023-12-22T08:39:58.123937+0000","last_unstale":"2023-12-22T08:39:58.126566+0000","last_undegraded":"2023-12-22T08:39:58.126566+0000","last_fullsized":"2023-12-22T08:39:58.126566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.117232+0000","last_change":"2023-12-22T08:39:58.117232+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.117232+0000","last_undegraded":"2023-12-22T08:39:58.117232+0000","last_fullsized":"2023-12-22T08:39:58.117232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:16.702062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.130543+0000","last_change":"2023-12-22T08:39:58.130462+0000","last_active":"2023-12-22T08:39:58.130543+0000","last_peered":"2023-12-22T08:39:58.130543+0000","last_clean":"2023-12-22T08:39:58.130543+0000","last_became_active":"2023-12-22T08:39:58.130246+0000","last_became_peered":"2023-12-22T08:39:58.130246+0000","last_unstale":"2023-12-22T08:39:58.130543+0000","last_undegraded":"2023-12-22T08:39:58.130543+0000","last_fullsized":"2023-12-22T08:39:58.130543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.111812+0000","last_change":"2023-12-22T08:39:58.111812+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.111812+0000","last_undegraded":"2023-12-22T08:39:58.111812+0000","last_fullsized":"2023-12-22T08:39:58.111812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.127955+0000","last_change":"2023-12-22T08:39:58.127791+0000","last_active":"2023-12-22T08:39:58.127955+0000","last_peered":"2023-12-22T08:39:58.127955+0000","last_clean":"2023-12-22T08:39:58.127955+0000","last_became_active":"2023-12-22T08:39:58.126674+0000","last_became_peered":"2023-12-22T08:39:58.126674+0000","last_unstale":"2023-12-22T08:39:58.127955+0000","last_undegraded":"2023-12-22T08:39:58.127955+0000","last_fullsized":"2023-12-22T08:39:58.127955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.120988+0000","last_change":"2023-12-22T08:39:58.120988+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.120988+0000","last_undegraded":"2023-12-22T08:39:58.120988+0000","last_fullsized":"2023-12-22T08:39:58.120988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:53:42.342046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.131406+0000","last_change":"2023-12-22T08:39:58.131328+0000","last_active":"2023-12-22T08:39:58.131406+0000","last_peered":"2023-12-22T08:39:58.131406+0000","last_clean":"2023-12-22T08:39:58.131406+0000","last_became_active":"2023-12-22T08:39:58.131102+0000","last_became_peered":"2023-12-22T08:39:58.131102+0000","last_unstale":"2023-12-22T08:39:58.131406+0000","last_undegraded":"2023-12-22T08:39:58.131406+0000","last_fullsized":"2023-12-22T08:39:58.131406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.115673+0000","last_change":"2023-12-22T08:39:58.115673+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.115673+0000","last_undegraded":"2023-12-22T08:39:58.115673+0000","last_fullsized":"2023-12-22T08:39:58.115673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.131247+0000","last_change":"2023-12-22T08:39:58.128619+0000","last_active":"2023-12-22T08:39:58.131247+0000","last_peered":"2023-12-22T08:39:58.131247+0000","last_clean":"2023-12-22T08:39:58.131247+0000","last_became_active":"2023-12-22T08:39:58.128357+0000","last_became_peered":"2023-12-22T08:39:58.128357+0000","last_unstale":"2023-12-22T08:39:58.131247+0000","last_undegraded":"2023-12-22T08:39:58.131247+0000","last_fullsized":"2023-12-22T08:39:58.131247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.121989+0000","last_change":"2023-12-22T08:39:58.121989+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.121989+0000","last_undegraded":"2023-12-22T08:39:58.121989+0000","last_fullsized":"2023-12-22T08:39:58.121989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.124789+0000","last_change":"2023-12-22T08:39:58.124679+0000","last_active":"2023-12-22T08:39:58.124789+0000","last_peered":"2023-12-22T08:39:58.124789+0000","last_clean":"2023-12-22T08:39:58.124789+0000","last_became_active":"2023-12-22T08:39:58.124446+0000","last_became_peered":"2023-12-22T08:39:58.124446+0000","last_unstale":"2023-12-22T08:39:58.124789+0000","last_undegraded":"2023-12-22T08:39:58.124789+0000","last_fullsized":"2023-12-22T08:39:58.124789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.120639+0000","last_change":"2023-12-22T08:39:58.120639+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.120639+0000","last_undegraded":"2023-12-22T08:39:58.120639+0000","last_fullsized":"2023-12-22T08:39:58.120639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128808+0000","last_change":"2023-12-22T08:39:58.125976+0000","last_active":"2023-12-22T08:39:58.128808+0000","last_peered":"2023-12-22T08:39:58.128808+0000","last_clean":"2023-12-22T08:39:58.128808+0000","last_became_active":"2023-12-22T08:39:58.125728+0000","last_became_peered":"2023-12-22T08:39:58.125728+0000","last_unstale":"2023-12-22T08:39:58.128808+0000","last_undegraded":"2023-12-22T08:39:58.128808+0000","last_fullsized":"2023-12-22T08:39:58.128808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.120668+0000","last_change":"2023-12-22T08:39:58.120668+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.120668+0000","last_undegraded":"2023-12-22T08:39:58.120668+0000","last_fullsized":"2023-12-22T08:39:58.120668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-12-22T08:39:57.103979+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:39:57.103979+0000","last_peered":"2023-12-22T08:39:57.103979+0000","last_clean":"2023-12-22T08:39:57.103979+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:39:57.103979+0000","last_undegraded":"2023-12-22T08:39:57.103979+0000","last_fullsized":"2023-12-22T08:39:57.103979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128445+0000","last_change":"2023-12-22T08:39:58.128257+0000","last_active":"2023-12-22T08:39:58.128445+0000","last_peered":"2023-12-22T08:39:58.128445+0000","last_clean":"2023-12-22T08:39:58.128445+0000","last_became_active":"2023-12-22T08:39:58.127185+0000","last_became_peered":"2023-12-22T08:39:58.127185+0000","last_unstale":"2023-12-22T08:39:58.128445+0000","last_undegraded":"2023-12-22T08:39:58.128445+0000","last_fullsized":"2023-12-22T08:39:58.128445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:34.256489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.121001+0000","last_change":"2023-12-22T08:39:58.121001+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.121001+0000","last_undegraded":"2023-12-22T08:39:58.121001+0000","last_fullsized":"2023-12-22T08:39:58.121001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.110118+0000","last_change":"2023-12-22T08:39:58.109900+0000","last_active":"2023-12-22T08:39:58.110118+0000","last_peered":"2023-12-22T08:39:58.110118+0000","last_clean":"2023-12-22T08:39:58.110118+0000","last_became_active":"2023-12-22T08:39:58.109127+0000","last_became_peered":"2023-12-22T08:39:58.109127+0000","last_unstale":"2023-12-22T08:39:58.110118+0000","last_undegraded":"2023-12-22T08:39:58.110118+0000","last_fullsized":"2023-12-22T08:39:58.110118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.109247+0000","last_change":"2023-12-22T08:39:58.109247+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.109247+0000","last_undegraded":"2023-12-22T08:39:58.109247+0000","last_fullsized":"2023-12-22T08:39:58.109247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128924+0000","last_change":"2023-12-22T08:39:58.128822+0000","last_active":"2023-12-22T08:39:58.128924+0000","last_peered":"2023-12-22T08:39:58.128924+0000","last_clean":"2023-12-22T08:39:58.128924+0000","last_became_active":"2023-12-22T08:39:58.128142+0000","last_became_peered":"2023-12-22T08:39:58.128142+0000","last_unstale":"2023-12-22T08:39:58.128924+0000","last_undegraded":"2023-12-22T08:39:58.128924+0000","last_fullsized":"2023-12-22T08:39:58.128924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.108776+0000","last_change":"2023-12-22T08:39:58.108776+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.108776+0000","last_undegraded":"2023-12-22T08:39:58.108776+0000","last_fullsized":"2023-12-22T08:39:58.108776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.109518+0000","last_change":"2023-12-22T08:39:58.109274+0000","last_active":"2023-12-22T08:39:58.109518+0000","last_peered":"2023-12-22T08:39:58.109518+0000","last_clean":"2023-12-22T08:39:58.109518+0000","last_became_active":"2023-12-22T08:39:58.108715+0000","last_became_peered":"2023-12-22T08:39:58.108715+0000","last_unstale":"2023-12-22T08:39:58.109518+0000","last_undegraded":"2023-12-22T08:39:58.109518+0000","last_fullsized":"2023-12-22T08:39:58.109518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.113318+0000","last_change":"2023-12-22T08:39:58.113318+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.113318+0000","last_undegraded":"2023-12-22T08:39:58.113318+0000","last_fullsized":"2023-12-22T08:39:58.113318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.127891+0000","last_change":"2023-12-22T08:39:58.127367+0000","last_active":"2023-12-22T08:39:58.127891+0000","last_peered":"2023-12-22T08:39:58.127891+0000","last_clean":"2023-12-22T08:39:58.127891+0000","last_became_active":"2023-12-22T08:39:58.124150+0000","last_became_peered":"2023-12-22T08:39:58.124150+0000","last_unstale":"2023-12-22T08:39:58.127891+0000","last_undegraded":"2023-12-22T08:39:58.127891+0000","last_fullsized":"2023-12-22T08:39:58.127891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.114066+0000","last_change":"2023-12-22T08:39:58.114066+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.114066+0000","last_undegraded":"2023-12-22T08:39:58.114066+0000","last_fullsized":"2023-12-22T08:39:58.114066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128825+0000","last_change":"2023-12-22T08:39:58.128760+0000","last_active":"2023-12-22T08:39:58.128825+0000","last_peered":"2023-12-22T08:39:58.128825+0000","last_clean":"2023-12-22T08:39:58.128825+0000","last_became_active":"2023-12-22T08:39:58.128499+0000","last_became_peered":"2023-12-22T08:39:58.128499+0000","last_unstale":"2023-12-22T08:39:58.128825+0000","last_undegraded":"2023-12-22T08:39:58.128825+0000","last_fullsized":"2023-12-22T08:39:58.128825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:15.265494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.107262+0000","last_change":"2023-12-22T08:39:58.107262+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.107262+0000","last_undegraded":"2023-12-22T08:39:58.107262+0000","last_fullsized":"2023-12-22T08:39:58.107262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.131199+0000","last_change":"2023-12-22T08:39:58.129601+0000","last_active":"2023-12-22T08:39:58.131199+0000","last_peered":"2023-12-22T08:39:58.131199+0000","last_clean":"2023-12-22T08:39:58.131199+0000","last_became_active":"2023-12-22T08:39:58.129236+0000","last_became_peered":"2023-12-22T08:39:58.129236+0000","last_unstale":"2023-12-22T08:39:58.131199+0000","last_undegraded":"2023-12-22T08:39:58.131199+0000","last_fullsized":"2023-12-22T08:39:58.131199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.122388+0000","last_change":"2023-12-22T08:39:58.122388+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.122388+0000","last_undegraded":"2023-12-22T08:39:58.122388+0000","last_fullsized":"2023-12-22T08:39:58.122388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.127319+0000","last_change":"2023-12-22T08:39:58.127199+0000","last_active":"2023-12-22T08:39:58.127319+0000","last_peered":"2023-12-22T08:39:58.127319+0000","last_clean":"2023-12-22T08:39:58.127319+0000","last_became_active":"2023-12-22T08:39:58.126735+0000","last_became_peered":"2023-12-22T08:39:58.126735+0000","last_unstale":"2023-12-22T08:39:58.127319+0000","last_undegraded":"2023-12-22T08:39:58.127319+0000","last_fullsized":"2023-12-22T08:39:58.127319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:12.048994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.119663+0000","last_change":"2023-12-22T08:39:58.119663+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.119663+0000","last_undegraded":"2023-12-22T08:39:58.119663+0000","last_fullsized":"2023-12-22T08:39:58.119663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.125608+0000","last_change":"2023-12-22T08:39:58.125513+0000","last_active":"2023-12-22T08:39:58.125608+0000","last_peered":"2023-12-22T08:39:58.125608+0000","last_clean":"2023-12-22T08:39:58.125608+0000","last_became_active":"2023-12-22T08:39:58.125286+0000","last_became_peered":"2023-12-22T08:39:58.125286+0000","last_unstale":"2023-12-22T08:39:58.125608+0000","last_undegraded":"2023-12-22T08:39:58.125608+0000","last_fullsized":"2023-12-22T08:39:58.125608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.116785+0000","last_change":"2023-12-22T08:39:58.116785+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.116785+0000","last_undegraded":"2023-12-22T08:39:58.116785+0000","last_fullsized":"2023-12-22T08:39:58.116785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:01.993745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.127399+0000","last_change":"2023-12-22T08:39:58.127163+0000","last_active":"2023-12-22T08:39:58.127399+0000","last_peered":"2023-12-22T08:39:58.127399+0000","last_clean":"2023-12-22T08:39:58.127399+0000","last_became_active":"2023-12-22T08:39:58.125842+0000","last_became_peered":"2023-12-22T08:39:58.125842+0000","last_unstale":"2023-12-22T08:39:58.127399+0000","last_undegraded":"2023-12-22T08:39:58.127399+0000","last_fullsized":"2023-12-22T08:39:58.127399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.123470+0000","last_change":"2023-12-22T08:39:58.123470+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.123470+0000","last_undegraded":"2023-12-22T08:39:58.123470+0000","last_fullsized":"2023-12-22T08:39:58.123470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.129873+0000","last_change":"2023-12-22T08:39:58.129742+0000","last_active":"2023-12-22T08:39:58.129873+0000","last_peered":"2023-12-22T08:39:58.129873+0000","last_clean":"2023-12-22T08:39:58.129873+0000","last_became_active":"2023-12-22T08:39:58.129522+0000","last_became_peered":"2023-12-22T08:39:58.129522+0000","last_unstale":"2023-12-22T08:39:58.129873+0000","last_undegraded":"2023-12-22T08:39:58.129873+0000","last_fullsized":"2023-12-22T08:39:58.129873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.115433+0000","last_change":"2023-12-22T08:39:58.115433+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.115433+0000","last_undegraded":"2023-12-22T08:39:58.115433+0000","last_fullsized":"2023-12-22T08:39:58.115433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128473+0000","last_change":"2023-12-22T08:39:58.128411+0000","last_active":"2023-12-22T08:39:58.128473+0000","last_peered":"2023-12-22T08:39:58.128473+0000","last_clean":"2023-12-22T08:39:58.128473+0000","last_became_active":"2023-12-22T08:39:58.127849+0000","last_became_peered":"2023-12-22T08:39:58.127849+0000","last_unstale":"2023-12-22T08:39:58.128473+0000","last_undegraded":"2023-12-22T08:39:58.128473+0000","last_fullsized":"2023-12-22T08:39:58.128473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:25.721681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.116987+0000","last_change":"2023-12-22T08:39:58.116987+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.116987+0000","last_undegraded":"2023-12-22T08:39:58.116987+0000","last_fullsized":"2023-12-22T08:39:58.116987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.117624+0000","last_change":"2023-12-22T08:39:58.117624+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.117624+0000","last_undegraded":"2023-12-22T08:39:58.117624+0000","last_fullsized":"2023-12-22T08:39:58.117624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:35.423369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.124805+0000","last_change":"2023-12-22T08:39:58.124586+0000","last_active":"2023-12-22T08:39:58.124805+0000","last_peered":"2023-12-22T08:39:58.124805+0000","last_clean":"2023-12-22T08:39:58.124805+0000","last_became_active":"2023-12-22T08:39:58.123428+0000","last_became_peered":"2023-12-22T08:39:58.123428+0000","last_unstale":"2023-12-22T08:39:58.124805+0000","last_undegraded":"2023-12-22T08:39:58.124805+0000","last_fullsized":"2023-12-22T08:39:58.124805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.118498+0000","last_change":"2023-12-22T08:39:58.118498+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.118498+0000","last_undegraded":"2023-12-22T08:39:58.118498+0000","last_fullsized":"2023-12-22T08:39:58.118498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.129613+0000","last_change":"2023-12-22T08:39:58.129551+0000","last_active":"2023-12-22T08:39:58.129613+0000","last_peered":"2023-12-22T08:39:58.129613+0000","last_clean":"2023-12-22T08:39:58.129613+0000","last_became_active":"2023-12-22T08:39:58.129237+0000","last_became_peered":"2023-12-22T08:39:58.129237+0000","last_unstale":"2023-12-22T08:39:58.129613+0000","last_undegraded":"2023-12-22T08:39:58.129613+0000","last_fullsized":"2023-12-22T08:39:58.129613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.108833+0000","last_change":"2023-12-22T08:39:58.108833+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.108833+0000","last_undegraded":"2023-12-22T08:39:58.108833+0000","last_fullsized":"2023-12-22T08:39:58.108833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:58:42.417309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128070+0000","last_change":"2023-12-22T08:39:58.127899+0000","last_active":"2023-12-22T08:39:58.128070+0000","last_peered":"2023-12-22T08:39:58.128070+0000","last_clean":"2023-12-22T08:39:58.128070+0000","last_became_active":"2023-12-22T08:39:58.126733+0000","last_became_peered":"2023-12-22T08:39:58.126733+0000","last_unstale":"2023-12-22T08:39:58.128070+0000","last_undegraded":"2023-12-22T08:39:58.128070+0000","last_fullsized":"2023-12-22T08:39:58.128070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.111556+0000","last_change":"2023-12-22T08:39:58.111556+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.111556+0000","last_undegraded":"2023-12-22T08:39:58.111556+0000","last_fullsized":"2023-12-22T08:39:58.111556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.131269+0000","last_change":"2023-12-22T08:39:58.130439+0000","last_active":"2023-12-22T08:39:58.131269+0000","last_peered":"2023-12-22T08:39:58.131269+0000","last_clean":"2023-12-22T08:39:58.131269+0000","last_became_active":"2023-12-22T08:39:58.130196+0000","last_became_peered":"2023-12-22T08:39:58.130196+0000","last_unstale":"2023-12-22T08:39:58.131269+0000","last_undegraded":"2023-12-22T08:39:58.131269+0000","last_fullsized":"2023-12-22T08:39:58.131269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6910000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.546}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.925}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]}]}],"pool_statfs":[]}} 2023-12-22T08:40:03.561 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:40:03.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.815+0000 7f8114873640 1 Processor -- start 2023-12-22T08:40:03.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.815+0000 7f8114873640 1 -- start start 2023-12-22T08:40:03.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.817+0000 7f8114873640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81100a44a0 0x7f81100708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.817+0000 7f8114873640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81100cdae0 con 0x7f811015b420 2023-12-22T08:40:03.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.817+0000 7f8114873640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8110071250 con 0x7f8110070e30 2023-12-22T08:40:03.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.817+0000 7f8114873640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811015b800 con 0x7f81100a44a0 2023-12-22T08:40:03.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.817+0000 7f810f7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f811015b420 0x7f811006d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51514/0 (socket says 172.21.15.38:51514) 2023-12-22T08:40:03.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.817+0000 7f810f7fe640 1 -- 172.21.15.38:0/2027664025 learned_addr learned my addr 172.21.15.38:0/2027664025 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:03.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.817+0000 7f810effd640 1 --2- 172.21.15.38:0/2027664025 >> v2:172.21.15.89:3300/0 conn(0x7f81100a44a0 0x7f81100708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697240680 0 0) 0x7f81100cdae0 con 0x7f811015b420 2023-12-22T08:40:03.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80f8003520 con 0x7f811015b420 2023-12-22T08:40:03.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 887016308 0 0) 0x7f80f8003520 con 0x7f811015b420 2023-12-22T08:40:03.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 >> v2:172.21.15.89:3300/0 conn(0x7f81100a44a0 msgr2=0x7f81100708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 --2- 172.21.15.38:0/2027664025 >> v2:172.21.15.89:3300/0 conn(0x7f81100a44a0 0x7f81100708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 >> v1:172.21.15.89:6789/0 conn(0x7f8110070e30 legacy=0x7f811015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81100cdd30 con 0x7f811015b420 2023-12-22T08:40:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f8100001670 con 0x7f811015b420 2023-12-22T08:40:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 >> v1:172.21.15.38:6789/0 conn(0x7f811015b420 legacy=0x7f811006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 --2- 172.21.15.38:0/2027664025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f80039c0 0x7f80f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 --2- 172.21.15.38:0/2027664025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f80047c0 0x7f80f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 --2- 172.21.15.38:0/2027664025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f8005180 0x7f80f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811015b800 con 0x7f80f80039c0 2023-12-22T08:40:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f800c080 con 0x7f80f80047c0 2023-12-22T08:40:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f800c240 con 0x7f80f8005180 2023-12-22T08:40:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.818+0000 7f810effd640 1 --2- 172.21.15.38:0/2027664025 >> v2:172.21.15.89:3300/0 conn(0x7f81100a44a0 0x7f81100708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:03.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.819+0000 7f810f7fe640 1 --2- 172.21.15.38:0/2027664025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f80039c0 0x7f80f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.819+0000 7f810effd640 1 --2- 172.21.15.38:0/2027664025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f80047c0 0x7f80f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.819+0000 7f810ffff640 1 --2- 172.21.15.38:0/2027664025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f8005180 0x7f80f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.819+0000 7f810f7fe640 1 -- 172.21.15.38:0/2027664025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f8005180 msgr2=0x7f80f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.819+0000 7f810f7fe640 1 --2- 172.21.15.38:0/2027664025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f8005180 0x7f80f800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.819+0000 7f810f7fe640 1 -- 172.21.15.38:0/2027664025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f80047c0 msgr2=0x7f80f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.819+0000 7f810f7fe640 1 --2- 172.21.15.38:0/2027664025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f80047c0 0x7f80f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.819+0000 7f810f7fe640 1 -- 172.21.15.38:0/2027664025 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f8003520 con 0x7f80f80039c0 2023-12-22T08:40:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.819+0000 7f810ffff640 1 --2- 172.21.15.38:0/2027664025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f8005180 0x7f80f800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.819+0000 7f810effd640 1 --2- 172.21.15.38:0/2027664025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f80047c0 0x7f80f8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.819+0000 7f810ffff640 1 -- 172.21.15.38:0/2027664025 reap_dead start 2023-12-22T08:40:03.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.820+0000 7f810f7fe640 1 --2- 172.21.15.38:0/2027664025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f80039c0 0x7f80f8003de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f810000c0e0 tx=0x7f80f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0c04a0cdda3382 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:03.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.820+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100005ad0 con 0x7f80f80039c0 2023-12-22T08:40:03.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.820+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100005c30 con 0x7f80f80039c0 2023-12-22T08:40:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.820+0000 7f810e7fc640 1 -- 172.21.15.38:0/2027664025 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810002ca30 con 0x7f80f80039c0 2023-12-22T08:40:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.821+0000 7f8114873640 1 -- 172.21.15.38:0/2027664025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f80039c0 msgr2=0x7f80f8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.821+0000 7f8114873640 1 --2- 172.21.15.38:0/2027664025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f80039c0 0x7f80f8003de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f810000c0e0 tx=0x7f80f80057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.821+0000 7f8114873640 1 -- 172.21.15.38:0/2027664025 shutdown_connections 2023-12-22T08:40:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.821+0000 7f8114873640 1 --2- 172.21.15.38:0/2027664025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f80039c0 0x7f80f8003de0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.821+0000 7f8114873640 1 -- 172.21.15.38:0/2027664025 >> 172.21.15.38:0/2027664025 conn(0x7f81100b1f70 msgr2=0x7f81100b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.821+0000 7f8114873640 1 -- 172.21.15.38:0/2027664025 shutdown_connections 2023-12-22T08:40:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.821+0000 7f8114873640 1 -- 172.21.15.38:0/2027664025 wait complete. 2023-12-22T08:40:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.823+0000 7f8114873640 1 Processor -- start 2023-12-22T08:40:03.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.823+0000 7f8114873640 1 -- start start 2023-12-22T08:40:03.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.824+0000 7f8114873640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f80039c0 0x7f81100a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.824+0000 7f8114873640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81101521a0 0x7f811014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.824+0000 7f8114873640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8110155980 0x7f8110155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.824+0000 7f8114873640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8110156340 con 0x7f80f80039c0 2023-12-22T08:40:03.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.824+0000 7f8114873640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100a3900 con 0x7f8110155980 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.824+0000 7f8114873640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8110152920 con 0x7f81101521a0 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.825+0000 7f810f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f80039c0 0x7f81100a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.825+0000 7f810f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f80039c0 0x7f81100a29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42246/0 (socket says 172.21.15.38:42246) 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.825+0000 7f810f7fe640 1 -- 172.21.15.38:0/1340385539 learned_addr learned my addr 172.21.15.38:0/1340385539 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.825+0000 7f810effd640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81101521a0 0x7f811014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.825+0000 7f810ffff640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8110155980 0x7f8110155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.825+0000 7f810f7fe640 1 -- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81101521a0 msgr2=0x7f811014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.825+0000 7f810f7fe640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81101521a0 0x7f811014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.825+0000 7f810f7fe640 1 -- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8110155980 msgr2=0x7f8110155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.825+0000 7f810f7fe640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8110155980 0x7f8110155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.825+0000 7f810f7fe640 1 -- 172.21.15.38:0/1340385539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81100a3060 con 0x7f80f80039c0 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.825+0000 7f810ffff640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8110155980 0x7f8110155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.825+0000 7f810f7fe640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f80039c0 0x7f81100a29c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8100000c00 tx=0x7f810002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:03.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.826+0000 7f80f7fff640 1 -- 172.21.15.38:0/1340385539 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810003c040 con 0x7f80f80039c0 2023-12-22T08:40:03.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.826+0000 7f80f7fff640 1 -- 172.21.15.38:0/1340385539 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810002cc20 con 0x7f80f80039c0 2023-12-22T08:40:03.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.826+0000 7f80f7fff640 1 -- 172.21.15.38:0/1340385539 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100007070 con 0x7f80f80039c0 2023-12-22T08:40:03.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.826+0000 7f8114873640 1 -- 172.21.15.38:0/1340385539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81100a3340 con 0x7f80f80039c0 2023-12-22T08:40:03.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.826+0000 7f8114873640 1 -- 172.21.15.38:0/1340385539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8110153520 con 0x7f80f80039c0 2023-12-22T08:40:03.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.827+0000 7f8114873640 1 -- 172.21.15.38:0/1340385539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81101536b0 con 0x7f80f80039c0 2023-12-22T08:40:03.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.828+0000 7f80f7fff640 1 -- 172.21.15.38:0/1340385539 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8100032070 con 0x7f80f80039c0 2023-12-22T08:40:03.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.829+0000 7f80f7fff640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80fc06a460 0x7f80fc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:03.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.829+0000 7f80f7fff640 1 -- 172.21.15.38:0/1340385539 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81000a9e90 con 0x7f80f80039c0 2023-12-22T08:40:03.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.830+0000 7f810effd640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80fc06a460 0x7f80fc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.831+0000 7f810effd640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80fc06a460 0x7f80fc06c920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f81101f6020 tx=0x7f8104008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:03.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:03.833+0000 7f80f7fff640 1 -- 172.21.15.38:0/1340385539 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8100075470 con 0x7f80f80039c0 2023-12-22T08:40:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.027+0000 7f8114873640 1 -- 172.21.15.38:0/1340385539 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81100ce2f0 con 0x7f80fc06a460 2023-12-22T08:40:04.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.049+0000 7f80f7fff640 1 -- 172.21.15.38:0/1340385539 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+257076 (secure 0 0 0) 0x7f8104004030 con 0x7f80fc06a460 2023-12-22T08:40:04.055 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:04.057 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:40:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.056+0000 7f8114873640 1 -- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80fc06a460 msgr2=0x7f80fc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.056+0000 7f8114873640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80fc06a460 0x7f80fc06c920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f81101f6020 tx=0x7f8104008040 comp rx=0 tx=0).stop 2023-12-22T08:40:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.056+0000 7f8114873640 1 -- 172.21.15.38:0/1340385539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f80039c0 msgr2=0x7f81100a29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.056+0000 7f8114873640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f80039c0 0x7f81100a29c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8100000c00 tx=0x7f810002e070 comp rx=0 tx=0).stop 2023-12-22T08:40:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.056+0000 7f8114873640 1 -- 172.21.15.38:0/1340385539 shutdown_connections 2023-12-22T08:40:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.056+0000 7f8114873640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8110155980 0x7f8110155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.056+0000 7f8114873640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81101521a0 0x7f811014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.056+0000 7f8114873640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80fc06a460 0x7f80fc06c920 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.056+0000 7f8114873640 1 --2- 172.21.15.38:0/1340385539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f80039c0 0x7f81100a29c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.056+0000 7f8114873640 1 -- 172.21.15.38:0/1340385539 >> 172.21.15.38:0/1340385539 conn(0x7f81100b1f70 msgr2=0x7f81100cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:04.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.056+0000 7f8114873640 1 -- 172.21.15.38:0/1340385539 shutdown_connections 2023-12-22T08:40:04.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.056+0000 7f8114873640 1 -- 172.21.15.38:0/1340385539 wait complete. 2023-12-22T08:40:04.078 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-12-22T08:40:02.354702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1571,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560928,"statfs":{"total":1600000000,"available":1598390354,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.263138"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.114552+0000","last_change":"2023-12-22T08:39:58.114552+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.114552+0000","last_undegraded":"2023-12-22T08:39:58.114552+0000","last_fullsized":"2023-12-22T08:39:58.114552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.112181+0000","last_change":"2023-12-22T08:39:58.112181+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.112181+0000","last_undegraded":"2023-12-22T08:39:58.112181+0000","last_fullsized":"2023-12-22T08:39:58.112181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.115977+0000","last_change":"2023-12-22T08:39:58.115977+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.115977+0000","last_undegraded":"2023-12-22T08:39:58.115977+0000","last_fullsized":"2023-12-22T08:39:58.115977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.115139+0000","last_change":"2023-12-22T08:39:58.115139+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.115139+0000","last_undegraded":"2023-12-22T08:39:58.115139+0000","last_fullsized":"2023-12-22T08:39:58.115139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.113179+0000","last_change":"2023-12-22T08:39:58.113179+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.113179+0000","last_undegraded":"2023-12-22T08:39:58.113179+0000","last_fullsized":"2023-12-22T08:39:58.113179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.116404+0000","last_change":"2023-12-22T08:39:58.116404+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.116404+0000","last_undegraded":"2023-12-22T08:39:58.116404+0000","last_fullsized":"2023-12-22T08:39:58.116404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.119157+0000","last_change":"2023-12-22T08:39:58.119157+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.119157+0000","last_undegraded":"2023-12-22T08:39:58.119157+0000","last_fullsized":"2023-12-22T08:39:58.119157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.115104+0000","last_change":"2023-12-22T08:39:58.115104+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.115104+0000","last_undegraded":"2023-12-22T08:39:58.115104+0000","last_fullsized":"2023-12-22T08:39:58.115104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.111733+0000","last_change":"2023-12-22T08:39:58.111733+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.111733+0000","last_undegraded":"2023-12-22T08:39:58.111733+0000","last_fullsized":"2023-12-22T08:39:58.111733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.114130+0000","last_change":"2023-12-22T08:39:58.114130+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.114130+0000","last_undegraded":"2023-12-22T08:39:58.114130+0000","last_fullsized":"2023-12-22T08:39:58.114130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.114130+0000","last_change":"2023-12-22T08:39:58.114130+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.114130+0000","last_undegraded":"2023-12-22T08:39:58.114130+0000","last_fullsized":"2023-12-22T08:39:58.114130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.122213+0000","last_change":"2023-12-22T08:39:58.122213+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.122213+0000","last_undegraded":"2023-12-22T08:39:58.122213+0000","last_fullsized":"2023-12-22T08:39:58.122213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.112794+0000","last_change":"2023-12-22T08:39:58.112794+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.112794+0000","last_undegraded":"2023-12-22T08:39:58.112794+0000","last_fullsized":"2023-12-22T08:39:58.112794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.111321+0000","last_change":"2023-12-22T08:39:58.111321+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.111321+0000","last_undegraded":"2023-12-22T08:39:58.111321+0000","last_fullsized":"2023-12-22T08:39:58.111321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.115702+0000","last_change":"2023-12-22T08:39:58.115702+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.115702+0000","last_undegraded":"2023-12-22T08:39:58.115702+0000","last_fullsized":"2023-12-22T08:39:58.115702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.121029+0000","last_change":"2023-12-22T08:39:58.121029+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.121029+0000","last_undegraded":"2023-12-22T08:39:58.121029+0000","last_fullsized":"2023-12-22T08:39:58.121029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.121556+0000","last_change":"2023-12-22T08:39:58.121556+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.121556+0000","last_undegraded":"2023-12-22T08:39:58.121556+0000","last_fullsized":"2023-12-22T08:39:58.121556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.116588+0000","last_change":"2023-12-22T08:39:58.116588+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.116588+0000","last_undegraded":"2023-12-22T08:39:58.116588+0000","last_fullsized":"2023-12-22T08:39:58.116588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.122067+0000","last_change":"2023-12-22T08:39:58.122067+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.122067+0000","last_undegraded":"2023-12-22T08:39:58.122067+0000","last_fullsized":"2023-12-22T08:39:58.122067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:24:09.483177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.113701+0000","last_change":"2023-12-22T08:39:58.113701+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.113701+0000","last_undegraded":"2023-12-22T08:39:58.113701+0000","last_fullsized":"2023-12-22T08:39:58.113701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.127797+0000","last_change":"2023-12-22T08:39:58.127797+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.127797+0000","last_undegraded":"2023-12-22T08:39:58.127797+0000","last_fullsized":"2023-12-22T08:39:58.127797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.111785+0000","last_change":"2023-12-22T08:39:58.111785+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.111785+0000","last_undegraded":"2023-12-22T08:39:58.111785+0000","last_fullsized":"2023-12-22T08:39:58.111785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.112587+0000","last_change":"2023-12-22T08:39:58.112587+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.112587+0000","last_undegraded":"2023-12-22T08:39:58.112587+0000","last_fullsized":"2023-12-22T08:39:58.112587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.119819+0000","last_change":"2023-12-22T08:39:58.119819+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.119819+0000","last_undegraded":"2023-12-22T08:39:58.119819+0000","last_fullsized":"2023-12-22T08:39:58.119819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:22.933973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.113433+0000","last_change":"2023-12-22T08:39:58.113433+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.113433+0000","last_undegraded":"2023-12-22T08:39:58.113433+0000","last_fullsized":"2023-12-22T08:39:58.113433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.116079+0000","last_change":"2023-12-22T08:39:58.116079+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.116079+0000","last_undegraded":"2023-12-22T08:39:58.116079+0000","last_fullsized":"2023-12-22T08:39:58.116079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.112149+0000","last_change":"2023-12-22T08:39:58.112149+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.112149+0000","last_undegraded":"2023-12-22T08:39:58.112149+0000","last_fullsized":"2023-12-22T08:39:58.112149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.110323+0000","last_change":"2023-12-22T08:39:58.110323+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.110323+0000","last_undegraded":"2023-12-22T08:39:58.110323+0000","last_fullsized":"2023-12-22T08:39:58.110323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:59:30.195380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.118842+0000","last_change":"2023-12-22T08:39:58.118842+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.118842+0000","last_undegraded":"2023-12-22T08:39:58.118842+0000","last_fullsized":"2023-12-22T08:39:58.118842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.118030+0000","last_change":"2023-12-22T08:39:58.118030+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.118030+0000","last_undegraded":"2023-12-22T08:39:58.118030+0000","last_fullsized":"2023-12-22T08:39:58.118030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:13:34.205933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.121492+0000","last_change":"2023-12-22T08:39:58.121492+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.121492+0000","last_undegraded":"2023-12-22T08:39:58.121492+0000","last_fullsized":"2023-12-22T08:39:58.121492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.117296+0000","last_change":"2023-12-22T08:39:58.117296+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.117296+0000","last_undegraded":"2023-12-22T08:39:58.117296+0000","last_fullsized":"2023-12-22T08:39:58.117296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.119535+0000","last_change":"2023-12-22T08:39:58.119535+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.119535+0000","last_undegraded":"2023-12-22T08:39:58.119535+0000","last_fullsized":"2023-12-22T08:39:58.119535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.123991+0000","last_change":"2023-12-22T08:39:58.118326+0000","last_active":"2023-12-22T08:39:58.123991+0000","last_peered":"2023-12-22T08:39:58.123991+0000","last_clean":"2023-12-22T08:39:58.123991+0000","last_became_active":"2023-12-22T08:39:58.117693+0000","last_became_peered":"2023-12-22T08:39:58.117693+0000","last_unstale":"2023-12-22T08:39:58.123991+0000","last_undegraded":"2023-12-22T08:39:58.123991+0000","last_fullsized":"2023-12-22T08:39:58.123991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.124543+0000","last_change":"2023-12-22T08:39:58.124543+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.124543+0000","last_undegraded":"2023-12-22T08:39:58.124543+0000","last_fullsized":"2023-12-22T08:39:58.124543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.126547+0000","last_change":"2023-12-22T08:39:58.124015+0000","last_active":"2023-12-22T08:39:58.126547+0000","last_peered":"2023-12-22T08:39:58.126547+0000","last_clean":"2023-12-22T08:39:58.126547+0000","last_became_active":"2023-12-22T08:39:58.123750+0000","last_became_peered":"2023-12-22T08:39:58.123750+0000","last_unstale":"2023-12-22T08:39:58.126547+0000","last_undegraded":"2023-12-22T08:39:58.126547+0000","last_fullsized":"2023-12-22T08:39:58.126547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:32.352283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.126760+0000","last_change":"2023-12-22T08:39:58.126588+0000","last_active":"2023-12-22T08:39:58.126760+0000","last_peered":"2023-12-22T08:39:58.126760+0000","last_clean":"2023-12-22T08:39:58.126760+0000","last_became_active":"2023-12-22T08:39:58.126277+0000","last_became_peered":"2023-12-22T08:39:58.126277+0000","last_unstale":"2023-12-22T08:39:58.126760+0000","last_undegraded":"2023-12-22T08:39:58.126760+0000","last_fullsized":"2023-12-22T08:39:58.126760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.110434+0000","last_change":"2023-12-22T08:39:58.110434+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.110434+0000","last_undegraded":"2023-12-22T08:39:58.110434+0000","last_fullsized":"2023-12-22T08:39:58.110434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:26:26.790794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.129197+0000","last_change":"2023-12-22T08:39:58.129064+0000","last_active":"2023-12-22T08:39:58.129197+0000","last_peered":"2023-12-22T08:39:58.129197+0000","last_clean":"2023-12-22T08:39:58.129197+0000","last_became_active":"2023-12-22T08:39:58.127921+0000","last_became_peered":"2023-12-22T08:39:58.127921+0000","last_unstale":"2023-12-22T08:39:58.129197+0000","last_undegraded":"2023-12-22T08:39:58.129197+0000","last_fullsized":"2023-12-22T08:39:58.129197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.122711+0000","last_change":"2023-12-22T08:39:58.122711+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.122711+0000","last_undegraded":"2023-12-22T08:39:58.122711+0000","last_fullsized":"2023-12-22T08:39:58.122711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128702+0000","last_change":"2023-12-22T08:39:58.128425+0000","last_active":"2023-12-22T08:39:58.128702+0000","last_peered":"2023-12-22T08:39:58.128702+0000","last_clean":"2023-12-22T08:39:58.128702+0000","last_became_active":"2023-12-22T08:39:58.128139+0000","last_became_peered":"2023-12-22T08:39:58.128139+0000","last_unstale":"2023-12-22T08:39:58.128702+0000","last_undegraded":"2023-12-22T08:39:58.128702+0000","last_fullsized":"2023-12-22T08:39:58.128702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.116907+0000","last_change":"2023-12-22T08:39:58.116907+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.116907+0000","last_undegraded":"2023-12-22T08:39:58.116907+0000","last_fullsized":"2023-12-22T08:39:58.116907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.124586+0000","last_change":"2023-12-22T08:39:58.123417+0000","last_active":"2023-12-22T08:39:58.124586+0000","last_peered":"2023-12-22T08:39:58.124586+0000","last_clean":"2023-12-22T08:39:58.124586+0000","last_became_active":"2023-12-22T08:39:58.122926+0000","last_became_peered":"2023-12-22T08:39:58.122926+0000","last_unstale":"2023-12-22T08:39:58.124586+0000","last_undegraded":"2023-12-22T08:39:58.124586+0000","last_fullsized":"2023-12-22T08:39:58.124586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.111776+0000","last_change":"2023-12-22T08:39:58.111776+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.111776+0000","last_undegraded":"2023-12-22T08:39:58.111776+0000","last_fullsized":"2023-12-22T08:39:58.111776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:37.333505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.129272+0000","last_change":"2023-12-22T08:39:58.129066+0000","last_active":"2023-12-22T08:39:58.129272+0000","last_peered":"2023-12-22T08:39:58.129272+0000","last_clean":"2023-12-22T08:39:58.129272+0000","last_became_active":"2023-12-22T08:39:58.128536+0000","last_became_peered":"2023-12-22T08:39:58.128536+0000","last_unstale":"2023-12-22T08:39:58.129272+0000","last_undegraded":"2023-12-22T08:39:58.129272+0000","last_fullsized":"2023-12-22T08:39:58.129272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.119200+0000","last_change":"2023-12-22T08:39:58.119200+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.119200+0000","last_undegraded":"2023-12-22T08:39:58.119200+0000","last_fullsized":"2023-12-22T08:39:58.119200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:24:34.120013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.127062+0000","last_change":"2023-12-22T08:39:58.126247+0000","last_active":"2023-12-22T08:39:58.127062+0000","last_peered":"2023-12-22T08:39:58.127062+0000","last_clean":"2023-12-22T08:39:58.127062+0000","last_became_active":"2023-12-22T08:39:58.125863+0000","last_became_peered":"2023-12-22T08:39:58.125863+0000","last_unstale":"2023-12-22T08:39:58.127062+0000","last_undegraded":"2023-12-22T08:39:58.127062+0000","last_fullsized":"2023-12-22T08:39:58.127062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.120298+0000","last_change":"2023-12-22T08:39:58.120298+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.120298+0000","last_undegraded":"2023-12-22T08:39:58.120298+0000","last_fullsized":"2023-12-22T08:39:58.120298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.126455+0000","last_change":"2023-12-22T08:39:58.123764+0000","last_active":"2023-12-22T08:39:58.126455+0000","last_peered":"2023-12-22T08:39:58.126455+0000","last_clean":"2023-12-22T08:39:58.126455+0000","last_became_active":"2023-12-22T08:39:58.123431+0000","last_became_peered":"2023-12-22T08:39:58.123431+0000","last_unstale":"2023-12-22T08:39:58.126455+0000","last_undegraded":"2023-12-22T08:39:58.126455+0000","last_fullsized":"2023-12-22T08:39:58.126455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.108271+0000","last_change":"2023-12-22T08:39:58.108271+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.108271+0000","last_undegraded":"2023-12-22T08:39:58.108271+0000","last_fullsized":"2023-12-22T08:39:58.108271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.126566+0000","last_change":"2023-12-22T08:39:58.124254+0000","last_active":"2023-12-22T08:39:58.126566+0000","last_peered":"2023-12-22T08:39:58.126566+0000","last_clean":"2023-12-22T08:39:58.126566+0000","last_became_active":"2023-12-22T08:39:58.123937+0000","last_became_peered":"2023-12-22T08:39:58.123937+0000","last_unstale":"2023-12-22T08:39:58.126566+0000","last_undegraded":"2023-12-22T08:39:58.126566+0000","last_fullsized":"2023-12-22T08:39:58.126566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.117232+0000","last_change":"2023-12-22T08:39:58.117232+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.117232+0000","last_undegraded":"2023-12-22T08:39:58.117232+0000","last_fullsized":"2023-12-22T08:39:58.117232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:16.702062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.130543+0000","last_change":"2023-12-22T08:39:58.130462+0000","last_active":"2023-12-22T08:39:58.130543+0000","last_peered":"2023-12-22T08:39:58.130543+0000","last_clean":"2023-12-22T08:39:58.130543+0000","last_became_active":"2023-12-22T08:39:58.130246+0000","last_became_peered":"2023-12-22T08:39:58.130246+0000","last_unstale":"2023-12-22T08:39:58.130543+0000","last_undegraded":"2023-12-22T08:39:58.130543+0000","last_fullsized":"2023-12-22T08:39:58.130543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.111812+0000","last_change":"2023-12-22T08:39:58.111812+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.111812+0000","last_undegraded":"2023-12-22T08:39:58.111812+0000","last_fullsized":"2023-12-22T08:39:58.111812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.127955+0000","last_change":"2023-12-22T08:39:58.127791+0000","last_active":"2023-12-22T08:39:58.127955+0000","last_peered":"2023-12-22T08:39:58.127955+0000","last_clean":"2023-12-22T08:39:58.127955+0000","last_became_active":"2023-12-22T08:39:58.126674+0000","last_became_peered":"2023-12-22T08:39:58.126674+0000","last_unstale":"2023-12-22T08:39:58.127955+0000","last_undegraded":"2023-12-22T08:39:58.127955+0000","last_fullsized":"2023-12-22T08:39:58.127955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.120988+0000","last_change":"2023-12-22T08:39:58.120988+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.120988+0000","last_undegraded":"2023-12-22T08:39:58.120988+0000","last_fullsized":"2023-12-22T08:39:58.120988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:53:42.342046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.131406+0000","last_change":"2023-12-22T08:39:58.131328+0000","last_active":"2023-12-22T08:39:58.131406+0000","last_peered":"2023-12-22T08:39:58.131406+0000","last_clean":"2023-12-22T08:39:58.131406+0000","last_became_active":"2023-12-22T08:39:58.131102+0000","last_became_peered":"2023-12-22T08:39:58.131102+0000","last_unstale":"2023-12-22T08:39:58.131406+0000","last_undegraded":"2023-12-22T08:39:58.131406+0000","last_fullsized":"2023-12-22T08:39:58.131406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.115673+0000","last_change":"2023-12-22T08:39:58.115673+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.115673+0000","last_undegraded":"2023-12-22T08:39:58.115673+0000","last_fullsized":"2023-12-22T08:39:58.115673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.131247+0000","last_change":"2023-12-22T08:39:58.128619+0000","last_active":"2023-12-22T08:39:58.131247+0000","last_peered":"2023-12-22T08:39:58.131247+0000","last_clean":"2023-12-22T08:39:58.131247+0000","last_became_active":"2023-12-22T08:39:58.128357+0000","last_became_peered":"2023-12-22T08:39:58.128357+0000","last_unstale":"2023-12-22T08:39:58.131247+0000","last_undegraded":"2023-12-22T08:39:58.131247+0000","last_fullsized":"2023-12-22T08:39:58.131247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.121989+0000","last_change":"2023-12-22T08:39:58.121989+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.121989+0000","last_undegraded":"2023-12-22T08:39:58.121989+0000","last_fullsized":"2023-12-22T08:39:58.121989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.124789+0000","last_change":"2023-12-22T08:39:58.124679+0000","last_active":"2023-12-22T08:39:58.124789+0000","last_peered":"2023-12-22T08:39:58.124789+0000","last_clean":"2023-12-22T08:39:58.124789+0000","last_became_active":"2023-12-22T08:39:58.124446+0000","last_became_peered":"2023-12-22T08:39:58.124446+0000","last_unstale":"2023-12-22T08:39:58.124789+0000","last_undegraded":"2023-12-22T08:39:58.124789+0000","last_fullsized":"2023-12-22T08:39:58.124789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.120639+0000","last_change":"2023-12-22T08:39:58.120639+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.120639+0000","last_undegraded":"2023-12-22T08:39:58.120639+0000","last_fullsized":"2023-12-22T08:39:58.120639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128808+0000","last_change":"2023-12-22T08:39:58.125976+0000","last_active":"2023-12-22T08:39:58.128808+0000","last_peered":"2023-12-22T08:39:58.128808+0000","last_clean":"2023-12-22T08:39:58.128808+0000","last_became_active":"2023-12-22T08:39:58.125728+0000","last_became_peered":"2023-12-22T08:39:58.125728+0000","last_unstale":"2023-12-22T08:39:58.128808+0000","last_undegraded":"2023-12-22T08:39:58.128808+0000","last_fullsized":"2023-12-22T08:39:58.128808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.120668+0000","last_change":"2023-12-22T08:39:58.120668+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.120668+0000","last_undegraded":"2023-12-22T08:39:58.120668+0000","last_fullsized":"2023-12-22T08:39:58.120668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-12-22T08:39:57.103979+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:39:57.103979+0000","last_peered":"2023-12-22T08:39:57.103979+0000","last_clean":"2023-12-22T08:39:57.103979+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:39:57.103979+0000","last_undegraded":"2023-12-22T08:39:57.103979+0000","last_fullsized":"2023-12-22T08:39:57.103979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128445+0000","last_change":"2023-12-22T08:39:58.128257+0000","last_active":"2023-12-22T08:39:58.128445+0000","last_peered":"2023-12-22T08:39:58.128445+0000","last_clean":"2023-12-22T08:39:58.128445+0000","last_became_active":"2023-12-22T08:39:58.127185+0000","last_became_peered":"2023-12-22T08:39:58.127185+0000","last_unstale":"2023-12-22T08:39:58.128445+0000","last_undegraded":"2023-12-22T08:39:58.128445+0000","last_fullsized":"2023-12-22T08:39:58.128445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:34.256489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.121001+0000","last_change":"2023-12-22T08:39:58.121001+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.121001+0000","last_undegraded":"2023-12-22T08:39:58.121001+0000","last_fullsized":"2023-12-22T08:39:58.121001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.110118+0000","last_change":"2023-12-22T08:39:58.109900+0000","last_active":"2023-12-22T08:39:58.110118+0000","last_peered":"2023-12-22T08:39:58.110118+0000","last_clean":"2023-12-22T08:39:58.110118+0000","last_became_active":"2023-12-22T08:39:58.109127+0000","last_became_peered":"2023-12-22T08:39:58.109127+0000","last_unstale":"2023-12-22T08:39:58.110118+0000","last_undegraded":"2023-12-22T08:39:58.110118+0000","last_fullsized":"2023-12-22T08:39:58.110118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.109247+0000","last_change":"2023-12-22T08:39:58.109247+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.109247+0000","last_undegraded":"2023-12-22T08:39:58.109247+0000","last_fullsized":"2023-12-22T08:39:58.109247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128924+0000","last_change":"2023-12-22T08:39:58.128822+0000","last_active":"2023-12-22T08:39:58.128924+0000","last_peered":"2023-12-22T08:39:58.128924+0000","last_clean":"2023-12-22T08:39:58.128924+0000","last_became_active":"2023-12-22T08:39:58.128142+0000","last_became_peered":"2023-12-22T08:39:58.128142+0000","last_unstale":"2023-12-22T08:39:58.128924+0000","last_undegraded":"2023-12-22T08:39:58.128924+0000","last_fullsized":"2023-12-22T08:39:58.128924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.108776+0000","last_change":"2023-12-22T08:39:58.108776+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.108776+0000","last_undegraded":"2023-12-22T08:39:58.108776+0000","last_fullsized":"2023-12-22T08:39:58.108776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.109518+0000","last_change":"2023-12-22T08:39:58.109274+0000","last_active":"2023-12-22T08:39:58.109518+0000","last_peered":"2023-12-22T08:39:58.109518+0000","last_clean":"2023-12-22T08:39:58.109518+0000","last_became_active":"2023-12-22T08:39:58.108715+0000","last_became_peered":"2023-12-22T08:39:58.108715+0000","last_unstale":"2023-12-22T08:39:58.109518+0000","last_undegraded":"2023-12-22T08:39:58.109518+0000","last_fullsized":"2023-12-22T08:39:58.109518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.113318+0000","last_change":"2023-12-22T08:39:58.113318+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.113318+0000","last_undegraded":"2023-12-22T08:39:58.113318+0000","last_fullsized":"2023-12-22T08:39:58.113318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.127891+0000","last_change":"2023-12-22T08:39:58.127367+0000","last_active":"2023-12-22T08:39:58.127891+0000","last_peered":"2023-12-22T08:39:58.127891+0000","last_clean":"2023-12-22T08:39:58.127891+0000","last_became_active":"2023-12-22T08:39:58.124150+0000","last_became_peered":"2023-12-22T08:39:58.124150+0000","last_unstale":"2023-12-22T08:39:58.127891+0000","last_undegraded":"2023-12-22T08:39:58.127891+0000","last_fullsized":"2023-12-22T08:39:58.127891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.114066+0000","last_change":"2023-12-22T08:39:58.114066+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.114066+0000","last_undegraded":"2023-12-22T08:39:58.114066+0000","last_fullsized":"2023-12-22T08:39:58.114066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128825+0000","last_change":"2023-12-22T08:39:58.128760+0000","last_active":"2023-12-22T08:39:58.128825+0000","last_peered":"2023-12-22T08:39:58.128825+0000","last_clean":"2023-12-22T08:39:58.128825+0000","last_became_active":"2023-12-22T08:39:58.128499+0000","last_became_peered":"2023-12-22T08:39:58.128499+0000","last_unstale":"2023-12-22T08:39:58.128825+0000","last_undegraded":"2023-12-22T08:39:58.128825+0000","last_fullsized":"2023-12-22T08:39:58.128825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:15.265494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.107262+0000","last_change":"2023-12-22T08:39:58.107262+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.107262+0000","last_undegraded":"2023-12-22T08:39:58.107262+0000","last_fullsized":"2023-12-22T08:39:58.107262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.131199+0000","last_change":"2023-12-22T08:39:58.129601+0000","last_active":"2023-12-22T08:39:58.131199+0000","last_peered":"2023-12-22T08:39:58.131199+0000","last_clean":"2023-12-22T08:39:58.131199+0000","last_became_active":"2023-12-22T08:39:58.129236+0000","last_became_peered":"2023-12-22T08:39:58.129236+0000","last_unstale":"2023-12-22T08:39:58.131199+0000","last_undegraded":"2023-12-22T08:39:58.131199+0000","last_fullsized":"2023-12-22T08:39:58.131199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.122388+0000","last_change":"2023-12-22T08:39:58.122388+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.122388+0000","last_undegraded":"2023-12-22T08:39:58.122388+0000","last_fullsized":"2023-12-22T08:39:58.122388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.127319+0000","last_change":"2023-12-22T08:39:58.127199+0000","last_active":"2023-12-22T08:39:58.127319+0000","last_peered":"2023-12-22T08:39:58.127319+0000","last_clean":"2023-12-22T08:39:58.127319+0000","last_became_active":"2023-12-22T08:39:58.126735+0000","last_became_peered":"2023-12-22T08:39:58.126735+0000","last_unstale":"2023-12-22T08:39:58.127319+0000","last_undegraded":"2023-12-22T08:39:58.127319+0000","last_fullsized":"2023-12-22T08:39:58.127319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:12.048994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.119663+0000","last_change":"2023-12-22T08:39:58.119663+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.119663+0000","last_undegraded":"2023-12-22T08:39:58.119663+0000","last_fullsized":"2023-12-22T08:39:58.119663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.125608+0000","last_change":"2023-12-22T08:39:58.125513+0000","last_active":"2023-12-22T08:39:58.125608+0000","last_peered":"2023-12-22T08:39:58.125608+0000","last_clean":"2023-12-22T08:39:58.125608+0000","last_became_active":"2023-12-22T08:39:58.125286+0000","last_became_peered":"2023-12-22T08:39:58.125286+0000","last_unstale":"2023-12-22T08:39:58.125608+0000","last_undegraded":"2023-12-22T08:39:58.125608+0000","last_fullsized":"2023-12-22T08:39:58.125608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.116785+0000","last_change":"2023-12-22T08:39:58.116785+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.116785+0000","last_undegraded":"2023-12-22T08:39:58.116785+0000","last_fullsized":"2023-12-22T08:39:58.116785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:01.993745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.127399+0000","last_change":"2023-12-22T08:39:58.127163+0000","last_active":"2023-12-22T08:39:58.127399+0000","last_peered":"2023-12-22T08:39:58.127399+0000","last_clean":"2023-12-22T08:39:58.127399+0000","last_became_active":"2023-12-22T08:39:58.125842+0000","last_became_peered":"2023-12-22T08:39:58.125842+0000","last_unstale":"2023-12-22T08:39:58.127399+0000","last_undegraded":"2023-12-22T08:39:58.127399+0000","last_fullsized":"2023-12-22T08:39:58.127399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.123470+0000","last_change":"2023-12-22T08:39:58.123470+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.123470+0000","last_undegraded":"2023-12-22T08:39:58.123470+0000","last_fullsized":"2023-12-22T08:39:58.123470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.129873+0000","last_change":"2023-12-22T08:39:58.129742+0000","last_active":"2023-12-22T08:39:58.129873+0000","last_peered":"2023-12-22T08:39:58.129873+0000","last_clean":"2023-12-22T08:39:58.129873+0000","last_became_active":"2023-12-22T08:39:58.129522+0000","last_became_peered":"2023-12-22T08:39:58.129522+0000","last_unstale":"2023-12-22T08:39:58.129873+0000","last_undegraded":"2023-12-22T08:39:58.129873+0000","last_fullsized":"2023-12-22T08:39:58.129873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.115433+0000","last_change":"2023-12-22T08:39:58.115433+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.115433+0000","last_undegraded":"2023-12-22T08:39:58.115433+0000","last_fullsized":"2023-12-22T08:39:58.115433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128473+0000","last_change":"2023-12-22T08:39:58.128411+0000","last_active":"2023-12-22T08:39:58.128473+0000","last_peered":"2023-12-22T08:39:58.128473+0000","last_clean":"2023-12-22T08:39:58.128473+0000","last_became_active":"2023-12-22T08:39:58.127849+0000","last_became_peered":"2023-12-22T08:39:58.127849+0000","last_unstale":"2023-12-22T08:39:58.128473+0000","last_undegraded":"2023-12-22T08:39:58.128473+0000","last_fullsized":"2023-12-22T08:39:58.128473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:25.721681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.116987+0000","last_change":"2023-12-22T08:39:58.116987+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.116987+0000","last_undegraded":"2023-12-22T08:39:58.116987+0000","last_fullsized":"2023-12-22T08:39:58.116987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.117624+0000","last_change":"2023-12-22T08:39:58.117624+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.117624+0000","last_undegraded":"2023-12-22T08:39:58.117624+0000","last_fullsized":"2023-12-22T08:39:58.117624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:35.423369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.124805+0000","last_change":"2023-12-22T08:39:58.124586+0000","last_active":"2023-12-22T08:39:58.124805+0000","last_peered":"2023-12-22T08:39:58.124805+0000","last_clean":"2023-12-22T08:39:58.124805+0000","last_became_active":"2023-12-22T08:39:58.123428+0000","last_became_peered":"2023-12-22T08:39:58.123428+0000","last_unstale":"2023-12-22T08:39:58.124805+0000","last_undegraded":"2023-12-22T08:39:58.124805+0000","last_fullsized":"2023-12-22T08:39:58.124805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.118498+0000","last_change":"2023-12-22T08:39:58.118498+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.118498+0000","last_undegraded":"2023-12-22T08:39:58.118498+0000","last_fullsized":"2023-12-22T08:39:58.118498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.129613+0000","last_change":"2023-12-22T08:39:58.129551+0000","last_active":"2023-12-22T08:39:58.129613+0000","last_peered":"2023-12-22T08:39:58.129613+0000","last_clean":"2023-12-22T08:39:58.129613+0000","last_became_active":"2023-12-22T08:39:58.129237+0000","last_became_peered":"2023-12-22T08:39:58.129237+0000","last_unstale":"2023-12-22T08:39:58.129613+0000","last_undegraded":"2023-12-22T08:39:58.129613+0000","last_fullsized":"2023-12-22T08:39:58.129613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.108833+0000","last_change":"2023-12-22T08:39:58.108833+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.108833+0000","last_undegraded":"2023-12-22T08:39:58.108833+0000","last_fullsized":"2023-12-22T08:39:58.108833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:58:42.417309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.128070+0000","last_change":"2023-12-22T08:39:58.127899+0000","last_active":"2023-12-22T08:39:58.128070+0000","last_peered":"2023-12-22T08:39:58.128070+0000","last_clean":"2023-12-22T08:39:58.128070+0000","last_became_active":"2023-12-22T08:39:58.126733+0000","last_became_peered":"2023-12-22T08:39:58.126733+0000","last_unstale":"2023-12-22T08:39:58.128070+0000","last_undegraded":"2023-12-22T08:39:58.128070+0000","last_fullsized":"2023-12-22T08:39:58.128070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2023-12-22T08:39:58.111556+0000","last_change":"2023-12-22T08:39:58.111556+0000","last_active":"2023-12-22T08:39:58.089988+0000","last_peered":"2023-12-22T08:39:58.089988+0000","last_clean":"2023-12-22T08:39:58.089988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:39:58.111556+0000","last_undegraded":"2023-12-22T08:39:58.111556+0000","last_fullsized":"2023-12-22T08:39:58.111556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.131269+0000","last_change":"2023-12-22T08:39:58.130439+0000","last_active":"2023-12-22T08:39:58.131269+0000","last_peered":"2023-12-22T08:39:58.131269+0000","last_clean":"2023-12-22T08:39:58.131269+0000","last_became_active":"2023-12-22T08:39:58.130196+0000","last_became_peered":"2023-12-22T08:39:58.130196+0000","last_unstale":"2023-12-22T08:39:58.131269+0000","last_undegraded":"2023-12-22T08:39:58.131269+0000","last_fullsized":"2023-12-22T08:39:58.131269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6910000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194680,"statfs":{"total":200000000,"available":199352988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":56,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195256,"statfs":{"total":200000000,"available":199942337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.546}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.925}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]}]}],"pool_statfs":[]}} 2023-12-22T08:40:04.082 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:40:04.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.352+0000 7fdc22b1b640 1 Processor -- start 2023-12-22T08:40:04.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.352+0000 7fdc22b1b640 1 -- start start 2023-12-22T08:40:04.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.354+0000 7fdc22b1b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc1c0b2050 0x7fdc1c0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:04.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.354+0000 7fdc22b1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c070800 0x7fdc1c070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:04.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.354+0000 7fdc22b1b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1c1450f0 con 0x7fdc1c144d10 2023-12-22T08:40:04.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.354+0000 7fdc22b1b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1c0cc840 con 0x7fdc1c0b2050 2023-12-22T08:40:04.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.354+0000 7fdc22b1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c0ce010 con 0x7fdc1c070800 2023-12-22T08:40:04.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.355+0000 7fdc208b7640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdc1c144d10 0x7fdc1c0cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51520/0 (socket says 172.21.15.38:51520) 2023-12-22T08:40:04.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.355+0000 7fdc208b7640 1 -- 172.21.15.38:0/1168289469 learned_addr learned my addr 172.21.15.38:0/1168289469 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:04.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.355+0000 7fdc1bfff640 1 --2- 172.21.15.38:0/1168289469 >> v2:172.21.15.89:3300/0 conn(0x7fdc1c0b2050 0x7fdc1c0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:04.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.355+0000 7fdc210b8640 1 --2- 172.21.15.38:0/1168289469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c070800 0x7fdc1c070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:04.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.355+0000 7fdc1b7fe640 1 -- 172.21.15.38:0/1168289469 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009152208 0 0) 0x7fdc1c1450f0 con 0x7fdc1c144d10 2023-12-22T08:40:04.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.355+0000 7fdc1b7fe640 1 -- 172.21.15.38:0/1168289469 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc0c003520 con 0x7fdc1c144d10 2023-12-22T08:40:04.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.356+0000 7fdc1bfff640 1 -- 172.21.15.38:0/1168289469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c070800 msgr2=0x7fdc1c070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:04.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.356+0000 7fdc1bfff640 1 --2- 172.21.15.38:0/1168289469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c070800 0x7fdc1c070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.356+0000 7fdc1bfff640 1 -- 172.21.15.38:0/1168289469 >> v1:172.21.15.38:6789/0 conn(0x7fdc1c144d10 legacy=0x7fdc1c0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:04.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.356+0000 7fdc1bfff640 1 -- 172.21.15.38:0/1168289469 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c0b29f0 con 0x7fdc1c0b2050 2023-12-22T08:40:04.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.357+0000 7fdc1bfff640 1 --2- 172.21.15.38:0/1168289469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c0b2050 0x7fdc1c0b24b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc080097a0 tx=0x7fdc0802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6265a23f7368d062 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:04.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.358+0000 7fdc1b7fe640 1 -- 172.21.15.38:0/1168289469 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0802d040 con 0x7fdc1c0b2050 2023-12-22T08:40:04.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.358+0000 7fdc1b7fe640 1 -- 172.21.15.38:0/1168289469 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc08031810 con 0x7fdc1c0b2050 2023-12-22T08:40:04.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.358+0000 7fdc1b7fe640 1 -- 172.21.15.38:0/1168289469 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08031ba0 con 0x7fdc1c0b2050 2023-12-22T08:40:04.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.358+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1168289469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c0b2050 msgr2=0x7fdc1c0b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:04.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.358+0000 7fdc22b1b640 1 --2- 172.21.15.38:0/1168289469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c0b2050 0x7fdc1c0b24b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc080097a0 tx=0x7fdc0802b8b0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.358+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1168289469 shutdown_connections 2023-12-22T08:40:04.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.358+0000 7fdc22b1b640 1 --2- 172.21.15.38:0/1168289469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c070800 0x7fdc1c070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.358+0000 7fdc22b1b640 1 --2- 172.21.15.38:0/1168289469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c0b2050 0x7fdc1c0b24b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.359+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1168289469 >> 172.21.15.38:0/1168289469 conn(0x7fdc1c0cf070 msgr2=0x7fdc1c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:04.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.359+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1168289469 shutdown_connections 2023-12-22T08:40:04.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.359+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1168289469 wait complete. 2023-12-22T08:40:04.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.360+0000 7fdc22b1b640 1 Processor -- start 2023-12-22T08:40:04.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.361+0000 7fdc22b1b640 1 -- start start 2023-12-22T08:40:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.361+0000 7fdc22b1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c070800 0x7fdc1c15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.361+0000 7fdc22b1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c0b2050 0x7fdc1c15d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.361+0000 7fdc22b1b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c144d10 0x7fdc1c1f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc22b1b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c133dc0 con 0x7fdc1c144d10 2023-12-22T08:40:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc22b1b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c1340a0 con 0x7fdc1c070800 2023-12-22T08:40:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc22b1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c134380 con 0x7fdc1c0b2050 2023-12-22T08:40:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc210b8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c144d10 0x7fdc1c1f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc210b8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c144d10 0x7fdc1c1f5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42256/0 (socket says 172.21.15.38:42256) 2023-12-22T08:40:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc210b8640 1 -- 172.21.15.38:0/1756512988 learned_addr learned my addr 172.21.15.38:0/1756512988 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc208b7640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c070800 0x7fdc1c15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc1bfff640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c0b2050 0x7fdc1c15d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc210b8640 1 -- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c0b2050 msgr2=0x7fdc1c15d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:04.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc210b8640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c0b2050 0x7fdc1c15d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc210b8640 1 -- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c070800 msgr2=0x7fdc1c15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:04.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc210b8640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c070800 0x7fdc1c15cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc210b8640 1 -- 172.21.15.38:0/1756512988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc08009400 con 0x7fdc1c144d10 2023-12-22T08:40:04.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.362+0000 7fdc1bfff640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c0b2050 0x7fdc1c15d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:04.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.363+0000 7fdc210b8640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c144d10 0x7fdc1c1f5e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400efc0 tx=0x7fdc1400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:04.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.363+0000 7fdc197fa640 1 -- 172.21.15.38:0/1756512988 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14014480 con 0x7fdc1c144d10 2023-12-22T08:40:04.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.363+0000 7fdc197fa640 1 -- 172.21.15.38:0/1756512988 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1400f040 con 0x7fdc1c144d10 2023-12-22T08:40:04.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.363+0000 7fdc197fa640 1 -- 172.21.15.38:0/1756512988 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14014820 con 0x7fdc1c144d10 2023-12-22T08:40:04.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.363+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1756512988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1c134660 con 0x7fdc1c144d10 2023-12-22T08:40:04.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.363+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1756512988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1c0b4880 con 0x7fdc1c144d10 2023-12-22T08:40:04.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.364+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1756512988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1c134b80 con 0x7fdc1c144d10 2023-12-22T08:40:04.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.365+0000 7fdc197fa640 1 -- 172.21.15.38:0/1756512988 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc14014980 con 0x7fdc1c144d10 2023-12-22T08:40:04.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.367+0000 7fdc197fa640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:04.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.367+0000 7fdc197fa640 1 -- 172.21.15.38:0/1756512988 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc14089520 con 0x7fdc1c144d10 2023-12-22T08:40:04.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.367+0000 7fdc208b7640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:04.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.368+0000 7fdc208b7640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc0006a430 0x7fdc0006c8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdc10005880 tx=0x7fdc10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:04.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.371+0000 7fdc197fa640 1 -- 172.21.15.38:0/1756512988 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdc1c134b80 con 0x7fdc1c144d10 2023-12-22T08:40:04.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.560+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1756512988 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc1c134210 con 0x7fdc0006a430 2023-12-22T08:40:04.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.581+0000 7fdc197fa640 1 -- 172.21.15.38:0/1756512988 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259933 (secure 0 0 0) 0x7fdc1c134210 con 0x7fdc0006a430 2023-12-22T08:40:04.587 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:04.589 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:40:04.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.586+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc0006a430 msgr2=0x7fdc0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:04.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.586+0000 7fdc22b1b640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc0006a430 0x7fdc0006c8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdc10005880 tx=0x7fdc10009040 comp rx=0 tx=0).stop 2023-12-22T08:40:04.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.586+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1756512988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c144d10 msgr2=0x7fdc1c1f5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:04.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.586+0000 7fdc22b1b640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c144d10 0x7fdc1c1f5e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400efc0 tx=0x7fdc1400c490 comp rx=0 tx=0).stop 2023-12-22T08:40:04.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.586+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1756512988 shutdown_connections 2023-12-22T08:40:04.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.586+0000 7fdc22b1b640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.586+0000 7fdc22b1b640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c144d10 0x7fdc1c1f5e10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.586+0000 7fdc22b1b640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c0b2050 0x7fdc1c15d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.586+0000 7fdc22b1b640 1 --2- 172.21.15.38:0/1756512988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c070800 0x7fdc1c15cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.586+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1756512988 >> 172.21.15.38:0/1756512988 conn(0x7fdc1c0cf070 msgr2=0x7fdc1c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:04.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.586+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1756512988 shutdown_connections 2023-12-22T08:40:04.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.586+0000 7fdc22b1b640 1 -- 172.21.15.38:0/1756512988 wait complete. 2023-12-22T08:40:04.609 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-22T08:40:04.355303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560790,"statfs":{"total":1600000000,"available":1598249655,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.255365"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641233+0000","last_change":"2023-12-22T08:39:58.637334+0000","last_active":"2023-12-22T08:39:58.641233+0000","last_peered":"2023-12-22T08:39:58.641233+0000","last_clean":"2023-12-22T08:39:58.641233+0000","last_became_active":"2023-12-22T08:39:58.633668+0000","last_became_peered":"2023-12-22T08:39:58.633668+0000","last_unstale":"2023-12-22T08:39:58.641233+0000","last_undegraded":"2023-12-22T08:39:58.641233+0000","last_fullsized":"2023-12-22T08:39:58.641233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.638651+0000","last_change":"2023-12-22T08:39:58.638511+0000","last_active":"2023-12-22T08:39:58.638651+0000","last_peered":"2023-12-22T08:39:58.638651+0000","last_clean":"2023-12-22T08:39:58.638651+0000","last_became_active":"2023-12-22T08:39:58.638133+0000","last_became_peered":"2023-12-22T08:39:58.638133+0000","last_unstale":"2023-12-22T08:39:58.638651+0000","last_undegraded":"2023-12-22T08:39:58.638651+0000","last_fullsized":"2023-12-22T08:39:58.638651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626853+0000","last_change":"2023-12-22T08:39:58.624493+0000","last_active":"2023-12-22T08:39:58.626853+0000","last_peered":"2023-12-22T08:39:58.626853+0000","last_clean":"2023-12-22T08:39:58.626853+0000","last_became_active":"2023-12-22T08:39:58.624182+0000","last_became_peered":"2023-12-22T08:39:58.624182+0000","last_unstale":"2023-12-22T08:39:58.626853+0000","last_undegraded":"2023-12-22T08:39:58.626853+0000","last_fullsized":"2023-12-22T08:39:58.626853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.622961+0000","last_change":"2023-12-22T08:39:58.622751+0000","last_active":"2023-12-22T08:39:58.622961+0000","last_peered":"2023-12-22T08:39:58.622961+0000","last_clean":"2023-12-22T08:39:58.622961+0000","last_became_active":"2023-12-22T08:39:58.622558+0000","last_became_peered":"2023-12-22T08:39:58.622558+0000","last_unstale":"2023-12-22T08:39:58.622961+0000","last_undegraded":"2023-12-22T08:39:58.622961+0000","last_fullsized":"2023-12-22T08:39:58.622961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643514+0000","last_change":"2023-12-22T08:39:58.643416+0000","last_active":"2023-12-22T08:39:58.643514+0000","last_peered":"2023-12-22T08:39:58.643514+0000","last_clean":"2023-12-22T08:39:58.643514+0000","last_became_active":"2023-12-22T08:39:58.641676+0000","last_became_peered":"2023-12-22T08:39:58.641676+0000","last_unstale":"2023-12-22T08:39:58.643514+0000","last_undegraded":"2023-12-22T08:39:58.643514+0000","last_fullsized":"2023-12-22T08:39:58.643514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628427+0000","last_change":"2023-12-22T08:39:58.627296+0000","last_active":"2023-12-22T08:39:58.628427+0000","last_peered":"2023-12-22T08:39:58.628427+0000","last_clean":"2023-12-22T08:39:58.628427+0000","last_became_active":"2023-12-22T08:39:58.626081+0000","last_became_peered":"2023-12-22T08:39:58.626081+0000","last_unstale":"2023-12-22T08:39:58.628427+0000","last_undegraded":"2023-12-22T08:39:58.628427+0000","last_fullsized":"2023-12-22T08:39:58.628427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632558+0000","last_change":"2023-12-22T08:39:58.627560+0000","last_active":"2023-12-22T08:39:58.632558+0000","last_peered":"2023-12-22T08:39:58.632558+0000","last_clean":"2023-12-22T08:39:58.632558+0000","last_became_active":"2023-12-22T08:39:58.627301+0000","last_became_peered":"2023-12-22T08:39:58.627301+0000","last_unstale":"2023-12-22T08:39:58.632558+0000","last_undegraded":"2023-12-22T08:39:58.632558+0000","last_fullsized":"2023-12-22T08:39:58.632558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635551+0000","last_change":"2023-12-22T08:39:58.635478+0000","last_active":"2023-12-22T08:39:58.635551+0000","last_peered":"2023-12-22T08:39:58.635551+0000","last_clean":"2023-12-22T08:39:58.635551+0000","last_became_active":"2023-12-22T08:39:58.634102+0000","last_became_peered":"2023-12-22T08:39:58.634102+0000","last_unstale":"2023-12-22T08:39:58.635551+0000","last_undegraded":"2023-12-22T08:39:58.635551+0000","last_fullsized":"2023-12-22T08:39:58.635551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628795+0000","last_change":"2023-12-22T08:39:58.627844+0000","last_active":"2023-12-22T08:39:58.628795+0000","last_peered":"2023-12-22T08:39:58.628795+0000","last_clean":"2023-12-22T08:39:58.628795+0000","last_became_active":"2023-12-22T08:39:58.627437+0000","last_became_peered":"2023-12-22T08:39:58.627437+0000","last_unstale":"2023-12-22T08:39:58.628795+0000","last_undegraded":"2023-12-22T08:39:58.628795+0000","last_fullsized":"2023-12-22T08:39:58.628795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643969+0000","last_change":"2023-12-22T08:39:58.643662+0000","last_active":"2023-12-22T08:39:58.643969+0000","last_peered":"2023-12-22T08:39:58.643969+0000","last_clean":"2023-12-22T08:39:58.643969+0000","last_became_active":"2023-12-22T08:39:58.642844+0000","last_became_peered":"2023-12-22T08:39:58.642844+0000","last_unstale":"2023-12-22T08:39:58.643969+0000","last_undegraded":"2023-12-22T08:39:58.643969+0000","last_fullsized":"2023-12-22T08:39:58.643969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634533+0000","last_change":"2023-12-22T08:39:58.633899+0000","last_active":"2023-12-22T08:39:58.634533+0000","last_peered":"2023-12-22T08:39:58.634533+0000","last_clean":"2023-12-22T08:39:58.634533+0000","last_became_active":"2023-12-22T08:39:58.633388+0000","last_became_peered":"2023-12-22T08:39:58.633388+0000","last_unstale":"2023-12-22T08:39:58.634533+0000","last_undegraded":"2023-12-22T08:39:58.634533+0000","last_fullsized":"2023-12-22T08:39:58.634533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641187+0000","last_change":"2023-12-22T08:39:58.635496+0000","last_active":"2023-12-22T08:39:58.641187+0000","last_peered":"2023-12-22T08:39:58.641187+0000","last_clean":"2023-12-22T08:39:58.641187+0000","last_became_active":"2023-12-22T08:39:58.635138+0000","last_became_peered":"2023-12-22T08:39:58.635138+0000","last_unstale":"2023-12-22T08:39:58.641187+0000","last_undegraded":"2023-12-22T08:39:58.641187+0000","last_fullsized":"2023-12-22T08:39:58.641187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642527+0000","last_change":"2023-12-22T08:39:58.642430+0000","last_active":"2023-12-22T08:39:58.642527+0000","last_peered":"2023-12-22T08:39:58.642527+0000","last_clean":"2023-12-22T08:39:58.642527+0000","last_became_active":"2023-12-22T08:39:58.642158+0000","last_became_peered":"2023-12-22T08:39:58.642158+0000","last_unstale":"2023-12-22T08:39:58.642527+0000","last_undegraded":"2023-12-22T08:39:58.642527+0000","last_fullsized":"2023-12-22T08:39:58.642527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633485+0000","last_change":"2023-12-22T08:39:58.632386+0000","last_active":"2023-12-22T08:39:58.633485+0000","last_peered":"2023-12-22T08:39:58.633485+0000","last_clean":"2023-12-22T08:39:58.633485+0000","last_became_active":"2023-12-22T08:39:58.632076+0000","last_became_peered":"2023-12-22T08:39:58.632076+0000","last_unstale":"2023-12-22T08:39:58.633485+0000","last_undegraded":"2023-12-22T08:39:58.633485+0000","last_fullsized":"2023-12-22T08:39:58.633485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642784+0000","last_change":"2023-12-22T08:39:58.642703+0000","last_active":"2023-12-22T08:39:58.642784+0000","last_peered":"2023-12-22T08:39:58.642784+0000","last_clean":"2023-12-22T08:39:58.642784+0000","last_became_active":"2023-12-22T08:39:58.642445+0000","last_became_peered":"2023-12-22T08:39:58.642445+0000","last_unstale":"2023-12-22T08:39:58.642784+0000","last_undegraded":"2023-12-22T08:39:58.642784+0000","last_fullsized":"2023-12-22T08:39:58.642784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632403+0000","last_change":"2023-12-22T08:39:58.631912+0000","last_active":"2023-12-22T08:39:58.632403+0000","last_peered":"2023-12-22T08:39:58.632403+0000","last_clean":"2023-12-22T08:39:58.632403+0000","last_became_active":"2023-12-22T08:39:58.631582+0000","last_became_peered":"2023-12-22T08:39:58.631582+0000","last_unstale":"2023-12-22T08:39:58.632403+0000","last_undegraded":"2023-12-22T08:39:58.632403+0000","last_fullsized":"2023-12-22T08:39:58.632403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631724+0000","last_change":"2023-12-22T08:39:58.631577+0000","last_active":"2023-12-22T08:39:58.631724+0000","last_peered":"2023-12-22T08:39:58.631724+0000","last_clean":"2023-12-22T08:39:58.631724+0000","last_became_active":"2023-12-22T08:39:58.630007+0000","last_became_peered":"2023-12-22T08:39:58.630007+0000","last_unstale":"2023-12-22T08:39:58.631724+0000","last_undegraded":"2023-12-22T08:39:58.631724+0000","last_fullsized":"2023-12-22T08:39:58.631724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631082+0000","last_change":"2023-12-22T08:39:58.630931+0000","last_active":"2023-12-22T08:39:58.631082+0000","last_peered":"2023-12-22T08:39:58.631082+0000","last_clean":"2023-12-22T08:39:58.631082+0000","last_became_active":"2023-12-22T08:39:58.629526+0000","last_became_peered":"2023-12-22T08:39:58.629526+0000","last_unstale":"2023-12-22T08:39:58.631082+0000","last_undegraded":"2023-12-22T08:39:58.631082+0000","last_fullsized":"2023-12-22T08:39:58.631082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625568+0000","last_change":"2023-12-22T08:39:58.625439+0000","last_active":"2023-12-22T08:39:58.625568+0000","last_peered":"2023-12-22T08:39:58.625568+0000","last_clean":"2023-12-22T08:39:58.625568+0000","last_became_active":"2023-12-22T08:39:58.625072+0000","last_became_peered":"2023-12-22T08:39:58.625072+0000","last_unstale":"2023-12-22T08:39:58.625568+0000","last_undegraded":"2023-12-22T08:39:58.625568+0000","last_fullsized":"2023-12-22T08:39:58.625568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:24:09.483177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643984+0000","last_change":"2023-12-22T08:39:58.643819+0000","last_active":"2023-12-22T08:39:58.643984+0000","last_peered":"2023-12-22T08:39:58.643984+0000","last_clean":"2023-12-22T08:39:58.643984+0000","last_became_active":"2023-12-22T08:39:58.643147+0000","last_became_peered":"2023-12-22T08:39:58.643147+0000","last_unstale":"2023-12-22T08:39:58.643984+0000","last_undegraded":"2023-12-22T08:39:58.643984+0000","last_fullsized":"2023-12-22T08:39:58.643984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630682+0000","last_change":"2023-12-22T08:39:58.630595+0000","last_active":"2023-12-22T08:39:58.630682+0000","last_peered":"2023-12-22T08:39:58.630682+0000","last_clean":"2023-12-22T08:39:58.630682+0000","last_became_active":"2023-12-22T08:39:58.630241+0000","last_became_peered":"2023-12-22T08:39:58.630241+0000","last_unstale":"2023-12-22T08:39:58.630682+0000","last_undegraded":"2023-12-22T08:39:58.630682+0000","last_fullsized":"2023-12-22T08:39:58.630682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629920+0000","last_change":"2023-12-22T08:39:58.629733+0000","last_active":"2023-12-22T08:39:58.629920+0000","last_peered":"2023-12-22T08:39:58.629920+0000","last_clean":"2023-12-22T08:39:58.629920+0000","last_became_active":"2023-12-22T08:39:58.629485+0000","last_became_peered":"2023-12-22T08:39:58.629485+0000","last_unstale":"2023-12-22T08:39:58.629920+0000","last_undegraded":"2023-12-22T08:39:58.629920+0000","last_fullsized":"2023-12-22T08:39:58.629920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.618810+0000","last_change":"2023-12-22T08:39:58.618183+0000","last_active":"2023-12-22T08:39:58.618810+0000","last_peered":"2023-12-22T08:39:58.618810+0000","last_clean":"2023-12-22T08:39:58.618810+0000","last_became_active":"2023-12-22T08:39:58.617884+0000","last_became_peered":"2023-12-22T08:39:58.617884+0000","last_unstale":"2023-12-22T08:39:58.618810+0000","last_undegraded":"2023-12-22T08:39:58.618810+0000","last_fullsized":"2023-12-22T08:39:58.618810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619546+0000","last_change":"2023-12-22T08:39:58.619439+0000","last_active":"2023-12-22T08:39:58.619546+0000","last_peered":"2023-12-22T08:39:58.619546+0000","last_clean":"2023-12-22T08:39:58.619546+0000","last_became_active":"2023-12-22T08:39:58.617801+0000","last_became_peered":"2023-12-22T08:39:58.617801+0000","last_unstale":"2023-12-22T08:39:58.619546+0000","last_undegraded":"2023-12-22T08:39:58.619546+0000","last_fullsized":"2023-12-22T08:39:58.619546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:22.933973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623909+0000","last_change":"2023-12-22T08:39:58.621731+0000","last_active":"2023-12-22T08:39:58.623909+0000","last_peered":"2023-12-22T08:39:58.623909+0000","last_clean":"2023-12-22T08:39:58.623909+0000","last_became_active":"2023-12-22T08:39:58.621245+0000","last_became_peered":"2023-12-22T08:39:58.621245+0000","last_unstale":"2023-12-22T08:39:58.623909+0000","last_undegraded":"2023-12-22T08:39:58.623909+0000","last_fullsized":"2023-12-22T08:39:58.623909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.622887+0000","last_change":"2023-12-22T08:39:58.621295+0000","last_active":"2023-12-22T08:39:58.622887+0000","last_peered":"2023-12-22T08:39:58.622887+0000","last_clean":"2023-12-22T08:39:58.622887+0000","last_became_active":"2023-12-22T08:39:58.621071+0000","last_became_peered":"2023-12-22T08:39:58.621071+0000","last_unstale":"2023-12-22T08:39:58.622887+0000","last_undegraded":"2023-12-22T08:39:58.622887+0000","last_fullsized":"2023-12-22T08:39:58.622887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635278+0000","last_change":"2023-12-22T08:39:58.635200+0000","last_active":"2023-12-22T08:39:58.635278+0000","last_peered":"2023-12-22T08:39:58.635278+0000","last_clean":"2023-12-22T08:39:58.635278+0000","last_became_active":"2023-12-22T08:39:58.634590+0000","last_became_peered":"2023-12-22T08:39:58.634590+0000","last_unstale":"2023-12-22T08:39:58.635278+0000","last_undegraded":"2023-12-22T08:39:58.635278+0000","last_fullsized":"2023-12-22T08:39:58.635278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635766+0000","last_change":"2023-12-22T08:39:58.635639+0000","last_active":"2023-12-22T08:39:58.635766+0000","last_peered":"2023-12-22T08:39:58.635766+0000","last_clean":"2023-12-22T08:39:58.635766+0000","last_became_active":"2023-12-22T08:39:58.634556+0000","last_became_peered":"2023-12-22T08:39:58.634556+0000","last_unstale":"2023-12-22T08:39:58.635766+0000","last_undegraded":"2023-12-22T08:39:58.635766+0000","last_fullsized":"2023-12-22T08:39:58.635766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:59:30.195380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619288+0000","last_change":"2023-12-22T08:39:58.619128+0000","last_active":"2023-12-22T08:39:58.619288+0000","last_peered":"2023-12-22T08:39:58.619288+0000","last_clean":"2023-12-22T08:39:58.619288+0000","last_became_active":"2023-12-22T08:39:58.618488+0000","last_became_peered":"2023-12-22T08:39:58.618488+0000","last_unstale":"2023-12-22T08:39:58.619288+0000","last_undegraded":"2023-12-22T08:39:58.619288+0000","last_fullsized":"2023-12-22T08:39:58.619288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.617164+0000","last_change":"2023-12-22T08:39:58.616544+0000","last_active":"2023-12-22T08:39:58.617164+0000","last_peered":"2023-12-22T08:39:58.617164+0000","last_clean":"2023-12-22T08:39:58.617164+0000","last_became_active":"2023-12-22T08:39:58.616182+0000","last_became_peered":"2023-12-22T08:39:58.616182+0000","last_unstale":"2023-12-22T08:39:58.617164+0000","last_undegraded":"2023-12-22T08:39:58.617164+0000","last_fullsized":"2023-12-22T08:39:58.617164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:13:34.205933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.627549+0000","last_change":"2023-12-22T08:39:58.627478+0000","last_active":"2023-12-22T08:39:58.627549+0000","last_peered":"2023-12-22T08:39:58.627549+0000","last_clean":"2023-12-22T08:39:58.627549+0000","last_became_active":"2023-12-22T08:39:58.626043+0000","last_became_peered":"2023-12-22T08:39:58.626043+0000","last_unstale":"2023-12-22T08:39:58.627549+0000","last_undegraded":"2023-12-22T08:39:58.627549+0000","last_fullsized":"2023-12-22T08:39:58.627549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639910+0000","last_change":"2023-12-22T08:39:58.638489+0000","last_active":"2023-12-22T08:39:58.639910+0000","last_peered":"2023-12-22T08:39:58.639910+0000","last_clean":"2023-12-22T08:39:58.639910+0000","last_became_active":"2023-12-22T08:39:58.638260+0000","last_became_peered":"2023-12-22T08:39:58.638260+0000","last_unstale":"2023-12-22T08:39:58.639910+0000","last_undegraded":"2023-12-22T08:39:58.639910+0000","last_fullsized":"2023-12-22T08:39:58.639910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628825+0000","last_change":"2023-12-22T08:39:58.628717+0000","last_active":"2023-12-22T08:39:58.628825+0000","last_peered":"2023-12-22T08:39:58.628825+0000","last_clean":"2023-12-22T08:39:58.628825+0000","last_became_active":"2023-12-22T08:39:58.628336+0000","last_became_peered":"2023-12-22T08:39:58.628336+0000","last_unstale":"2023-12-22T08:39:58.628825+0000","last_undegraded":"2023-12-22T08:39:58.628825+0000","last_fullsized":"2023-12-22T08:39:58.628825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.638316+0000","last_change":"2023-12-22T08:39:58.118326+0000","last_active":"2023-12-22T08:39:58.638316+0000","last_peered":"2023-12-22T08:39:58.638316+0000","last_clean":"2023-12-22T08:39:58.638316+0000","last_became_active":"2023-12-22T08:39:58.117693+0000","last_became_peered":"2023-12-22T08:39:58.117693+0000","last_unstale":"2023-12-22T08:39:58.638316+0000","last_undegraded":"2023-12-22T08:39:58.638316+0000","last_fullsized":"2023-12-22T08:39:58.638316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639287+0000","last_change":"2023-12-22T08:39:58.637716+0000","last_active":"2023-12-22T08:39:58.639287+0000","last_peered":"2023-12-22T08:39:58.639287+0000","last_clean":"2023-12-22T08:39:58.639287+0000","last_became_active":"2023-12-22T08:39:58.637494+0000","last_became_peered":"2023-12-22T08:39:58.637494+0000","last_unstale":"2023-12-22T08:39:58.639287+0000","last_undegraded":"2023-12-22T08:39:58.639287+0000","last_fullsized":"2023-12-22T08:39:58.639287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642478+0000","last_change":"2023-12-22T08:39:58.124015+0000","last_active":"2023-12-22T08:39:58.642478+0000","last_peered":"2023-12-22T08:39:58.642478+0000","last_clean":"2023-12-22T08:39:58.642478+0000","last_became_active":"2023-12-22T08:39:58.123750+0000","last_became_peered":"2023-12-22T08:39:58.123750+0000","last_unstale":"2023-12-22T08:39:58.642478+0000","last_undegraded":"2023-12-22T08:39:58.642478+0000","last_fullsized":"2023-12-22T08:39:58.642478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:32.352283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631688+0000","last_change":"2023-12-22T08:39:58.126588+0000","last_active":"2023-12-22T08:39:58.631688+0000","last_peered":"2023-12-22T08:39:58.631688+0000","last_clean":"2023-12-22T08:39:58.631688+0000","last_became_active":"2023-12-22T08:39:58.126277+0000","last_became_peered":"2023-12-22T08:39:58.126277+0000","last_unstale":"2023-12-22T08:39:58.631688+0000","last_undegraded":"2023-12-22T08:39:58.631688+0000","last_fullsized":"2023-12-22T08:39:58.631688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631434+0000","last_change":"2023-12-22T08:39:58.631377+0000","last_active":"2023-12-22T08:39:58.631434+0000","last_peered":"2023-12-22T08:39:58.631434+0000","last_clean":"2023-12-22T08:39:58.631434+0000","last_became_active":"2023-12-22T08:39:58.630993+0000","last_became_peered":"2023-12-22T08:39:58.630993+0000","last_unstale":"2023-12-22T08:39:58.631434+0000","last_undegraded":"2023-12-22T08:39:58.631434+0000","last_fullsized":"2023-12-22T08:39:58.631434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:26:26.790794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.612908+0000","last_change":"2023-12-22T08:39:58.129064+0000","last_active":"2023-12-22T08:39:58.612908+0000","last_peered":"2023-12-22T08:39:58.612908+0000","last_clean":"2023-12-22T08:39:58.612908+0000","last_became_active":"2023-12-22T08:39:58.127921+0000","last_became_peered":"2023-12-22T08:39:58.127921+0000","last_unstale":"2023-12-22T08:39:58.612908+0000","last_undegraded":"2023-12-22T08:39:58.612908+0000","last_fullsized":"2023-12-22T08:39:58.612908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632098+0000","last_change":"2023-12-22T08:39:58.631767+0000","last_active":"2023-12-22T08:39:58.632098+0000","last_peered":"2023-12-22T08:39:58.632098+0000","last_clean":"2023-12-22T08:39:58.632098+0000","last_became_active":"2023-12-22T08:39:58.629195+0000","last_became_peered":"2023-12-22T08:39:58.629195+0000","last_unstale":"2023-12-22T08:39:58.632098+0000","last_undegraded":"2023-12-22T08:39:58.632098+0000","last_fullsized":"2023-12-22T08:39:58.632098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.620316+0000","last_change":"2023-12-22T08:39:58.128425+0000","last_active":"2023-12-22T08:39:58.620316+0000","last_peered":"2023-12-22T08:39:58.620316+0000","last_clean":"2023-12-22T08:39:58.620316+0000","last_became_active":"2023-12-22T08:39:58.128139+0000","last_became_peered":"2023-12-22T08:39:58.128139+0000","last_unstale":"2023-12-22T08:39:58.620316+0000","last_undegraded":"2023-12-22T08:39:58.620316+0000","last_fullsized":"2023-12-22T08:39:58.620316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628459+0000","last_change":"2023-12-22T08:39:58.628264+0000","last_active":"2023-12-22T08:39:58.628459+0000","last_peered":"2023-12-22T08:39:58.628459+0000","last_clean":"2023-12-22T08:39:58.628459+0000","last_became_active":"2023-12-22T08:39:58.627878+0000","last_became_peered":"2023-12-22T08:39:58.627878+0000","last_unstale":"2023-12-22T08:39:58.628459+0000","last_undegraded":"2023-12-22T08:39:58.628459+0000","last_fullsized":"2023-12-22T08:39:58.628459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626441+0000","last_change":"2023-12-22T08:39:58.123417+0000","last_active":"2023-12-22T08:39:58.626441+0000","last_peered":"2023-12-22T08:39:58.626441+0000","last_clean":"2023-12-22T08:39:58.626441+0000","last_became_active":"2023-12-22T08:39:58.122926+0000","last_became_peered":"2023-12-22T08:39:58.122926+0000","last_unstale":"2023-12-22T08:39:58.626441+0000","last_undegraded":"2023-12-22T08:39:58.626441+0000","last_fullsized":"2023-12-22T08:39:58.626441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.616535+0000","last_change":"2023-12-22T08:39:58.616456+0000","last_active":"2023-12-22T08:39:58.616535+0000","last_peered":"2023-12-22T08:39:58.616535+0000","last_clean":"2023-12-22T08:39:58.616535+0000","last_became_active":"2023-12-22T08:39:58.616235+0000","last_became_peered":"2023-12-22T08:39:58.616235+0000","last_unstale":"2023-12-22T08:39:58.616535+0000","last_undegraded":"2023-12-22T08:39:58.616535+0000","last_fullsized":"2023-12-22T08:39:58.616535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:37.333505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635460+0000","last_change":"2023-12-22T08:39:58.129066+0000","last_active":"2023-12-22T08:39:58.635460+0000","last_peered":"2023-12-22T08:39:58.635460+0000","last_clean":"2023-12-22T08:39:58.635460+0000","last_became_active":"2023-12-22T08:39:58.128536+0000","last_became_peered":"2023-12-22T08:39:58.128536+0000","last_unstale":"2023-12-22T08:39:58.635460+0000","last_undegraded":"2023-12-22T08:39:58.635460+0000","last_fullsized":"2023-12-22T08:39:58.635460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629952+0000","last_change":"2023-12-22T08:39:58.629869+0000","last_active":"2023-12-22T08:39:58.629952+0000","last_peered":"2023-12-22T08:39:58.629952+0000","last_clean":"2023-12-22T08:39:58.629952+0000","last_became_active":"2023-12-22T08:39:58.629618+0000","last_became_peered":"2023-12-22T08:39:58.629618+0000","last_unstale":"2023-12-22T08:39:58.629952+0000","last_undegraded":"2023-12-22T08:39:58.629952+0000","last_fullsized":"2023-12-22T08:39:58.629952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:24:34.120013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642495+0000","last_change":"2023-12-22T08:39:58.126247+0000","last_active":"2023-12-22T08:39:58.642495+0000","last_peered":"2023-12-22T08:39:58.642495+0000","last_clean":"2023-12-22T08:39:58.642495+0000","last_became_active":"2023-12-22T08:39:58.125863+0000","last_became_peered":"2023-12-22T08:39:58.125863+0000","last_unstale":"2023-12-22T08:39:58.642495+0000","last_undegraded":"2023-12-22T08:39:58.642495+0000","last_fullsized":"2023-12-22T08:39:58.642495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641409+0000","last_change":"2023-12-22T08:39:58.641015+0000","last_active":"2023-12-22T08:39:58.641409+0000","last_peered":"2023-12-22T08:39:58.641409+0000","last_clean":"2023-12-22T08:39:58.641409+0000","last_became_active":"2023-12-22T08:39:58.640705+0000","last_became_peered":"2023-12-22T08:39:58.640705+0000","last_unstale":"2023-12-22T08:39:58.641409+0000","last_undegraded":"2023-12-22T08:39:58.641409+0000","last_fullsized":"2023-12-22T08:39:58.641409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642932+0000","last_change":"2023-12-22T08:39:58.123764+0000","last_active":"2023-12-22T08:39:58.642932+0000","last_peered":"2023-12-22T08:39:58.642932+0000","last_clean":"2023-12-22T08:39:58.642932+0000","last_became_active":"2023-12-22T08:39:58.123431+0000","last_became_peered":"2023-12-22T08:39:58.123431+0000","last_unstale":"2023-12-22T08:39:58.642932+0000","last_undegraded":"2023-12-22T08:39:58.642932+0000","last_fullsized":"2023-12-22T08:39:58.642932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634178+0000","last_change":"2023-12-22T08:39:58.634043+0000","last_active":"2023-12-22T08:39:58.634178+0000","last_peered":"2023-12-22T08:39:58.634178+0000","last_clean":"2023-12-22T08:39:58.634178+0000","last_became_active":"2023-12-22T08:39:58.633774+0000","last_became_peered":"2023-12-22T08:39:58.633774+0000","last_unstale":"2023-12-22T08:39:58.634178+0000","last_undegraded":"2023-12-22T08:39:58.634178+0000","last_fullsized":"2023-12-22T08:39:58.634178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.614467+0000","last_change":"2023-12-22T08:39:58.124254+0000","last_active":"2023-12-22T08:39:58.614467+0000","last_peered":"2023-12-22T08:39:58.614467+0000","last_clean":"2023-12-22T08:39:58.614467+0000","last_became_active":"2023-12-22T08:39:58.123937+0000","last_became_peered":"2023-12-22T08:39:58.123937+0000","last_unstale":"2023-12-22T08:39:58.614467+0000","last_undegraded":"2023-12-22T08:39:58.614467+0000","last_fullsized":"2023-12-22T08:39:58.614467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.644230+0000","last_change":"2023-12-22T08:39:58.644158+0000","last_active":"2023-12-22T08:39:58.644230+0000","last_peered":"2023-12-22T08:39:58.644230+0000","last_clean":"2023-12-22T08:39:58.644230+0000","last_became_active":"2023-12-22T08:39:58.643919+0000","last_became_peered":"2023-12-22T08:39:58.643919+0000","last_unstale":"2023-12-22T08:39:58.644230+0000","last_undegraded":"2023-12-22T08:39:58.644230+0000","last_fullsized":"2023-12-22T08:39:58.644230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:16.702062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626541+0000","last_change":"2023-12-22T08:39:58.130462+0000","last_active":"2023-12-22T08:39:58.626541+0000","last_peered":"2023-12-22T08:39:58.626541+0000","last_clean":"2023-12-22T08:39:58.626541+0000","last_became_active":"2023-12-22T08:39:58.130246+0000","last_became_peered":"2023-12-22T08:39:58.130246+0000","last_unstale":"2023-12-22T08:39:58.626541+0000","last_undegraded":"2023-12-22T08:39:58.626541+0000","last_fullsized":"2023-12-22T08:39:58.626541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628811+0000","last_change":"2023-12-22T08:39:58.628587+0000","last_active":"2023-12-22T08:39:58.628811+0000","last_peered":"2023-12-22T08:39:58.628811+0000","last_clean":"2023-12-22T08:39:58.628811+0000","last_became_active":"2023-12-22T08:39:58.626918+0000","last_became_peered":"2023-12-22T08:39:58.626918+0000","last_unstale":"2023-12-22T08:39:58.628811+0000","last_undegraded":"2023-12-22T08:39:58.628811+0000","last_fullsized":"2023-12-22T08:39:58.628811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641108+0000","last_change":"2023-12-22T08:39:58.127791+0000","last_active":"2023-12-22T08:39:58.641108+0000","last_peered":"2023-12-22T08:39:58.641108+0000","last_clean":"2023-12-22T08:39:58.641108+0000","last_became_active":"2023-12-22T08:39:58.126674+0000","last_became_peered":"2023-12-22T08:39:58.126674+0000","last_unstale":"2023-12-22T08:39:58.641108+0000","last_undegraded":"2023-12-22T08:39:58.641108+0000","last_fullsized":"2023-12-22T08:39:58.641108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632387+0000","last_change":"2023-12-22T08:39:58.631847+0000","last_active":"2023-12-22T08:39:58.632387+0000","last_peered":"2023-12-22T08:39:58.632387+0000","last_clean":"2023-12-22T08:39:58.632387+0000","last_became_active":"2023-12-22T08:39:58.631202+0000","last_became_peered":"2023-12-22T08:39:58.631202+0000","last_unstale":"2023-12-22T08:39:58.632387+0000","last_undegraded":"2023-12-22T08:39:58.632387+0000","last_fullsized":"2023-12-22T08:39:58.632387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:53:42.342046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643020+0000","last_change":"2023-12-22T08:39:58.131328+0000","last_active":"2023-12-22T08:39:58.643020+0000","last_peered":"2023-12-22T08:39:58.643020+0000","last_clean":"2023-12-22T08:39:58.643020+0000","last_became_active":"2023-12-22T08:39:58.131102+0000","last_became_peered":"2023-12-22T08:39:58.131102+0000","last_unstale":"2023-12-22T08:39:58.643020+0000","last_undegraded":"2023-12-22T08:39:58.643020+0000","last_fullsized":"2023-12-22T08:39:58.643020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.644219+0000","last_change":"2023-12-22T08:39:58.644149+0000","last_active":"2023-12-22T08:39:58.644219+0000","last_peered":"2023-12-22T08:39:58.644219+0000","last_clean":"2023-12-22T08:39:58.644219+0000","last_became_active":"2023-12-22T08:39:58.643782+0000","last_became_peered":"2023-12-22T08:39:58.643782+0000","last_unstale":"2023-12-22T08:39:58.644219+0000","last_undegraded":"2023-12-22T08:39:58.644219+0000","last_fullsized":"2023-12-22T08:39:58.644219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639405+0000","last_change":"2023-12-22T08:39:58.128619+0000","last_active":"2023-12-22T08:39:58.639405+0000","last_peered":"2023-12-22T08:39:58.639405+0000","last_clean":"2023-12-22T08:39:58.639405+0000","last_became_active":"2023-12-22T08:39:58.128357+0000","last_became_peered":"2023-12-22T08:39:58.128357+0000","last_unstale":"2023-12-22T08:39:58.639405+0000","last_undegraded":"2023-12-22T08:39:58.639405+0000","last_fullsized":"2023-12-22T08:39:58.639405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634241+0000","last_change":"2023-12-22T08:39:58.633374+0000","last_active":"2023-12-22T08:39:58.634241+0000","last_peered":"2023-12-22T08:39:58.634241+0000","last_clean":"2023-12-22T08:39:58.634241+0000","last_became_active":"2023-12-22T08:39:58.633140+0000","last_became_peered":"2023-12-22T08:39:58.633140+0000","last_unstale":"2023-12-22T08:39:58.634241+0000","last_undegraded":"2023-12-22T08:39:58.634241+0000","last_fullsized":"2023-12-22T08:39:58.634241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632780+0000","last_change":"2023-12-22T08:39:58.124679+0000","last_active":"2023-12-22T08:39:58.632780+0000","last_peered":"2023-12-22T08:39:58.632780+0000","last_clean":"2023-12-22T08:39:58.632780+0000","last_became_active":"2023-12-22T08:39:58.124446+0000","last_became_peered":"2023-12-22T08:39:58.124446+0000","last_unstale":"2023-12-22T08:39:58.632780+0000","last_undegraded":"2023-12-22T08:39:58.632780+0000","last_fullsized":"2023-12-22T08:39:58.632780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635014+0000","last_change":"2023-12-22T08:39:58.634622+0000","last_active":"2023-12-22T08:39:58.635014+0000","last_peered":"2023-12-22T08:39:58.635014+0000","last_clean":"2023-12-22T08:39:58.635014+0000","last_became_active":"2023-12-22T08:39:58.627769+0000","last_became_peered":"2023-12-22T08:39:58.627769+0000","last_unstale":"2023-12-22T08:39:58.635014+0000","last_undegraded":"2023-12-22T08:39:58.635014+0000","last_fullsized":"2023-12-22T08:39:58.635014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625945+0000","last_change":"2023-12-22T08:39:58.125976+0000","last_active":"2023-12-22T08:39:58.625945+0000","last_peered":"2023-12-22T08:39:58.625945+0000","last_clean":"2023-12-22T08:39:58.625945+0000","last_became_active":"2023-12-22T08:39:58.125728+0000","last_became_peered":"2023-12-22T08:39:58.125728+0000","last_unstale":"2023-12-22T08:39:58.625945+0000","last_undegraded":"2023-12-22T08:39:58.625945+0000","last_fullsized":"2023-12-22T08:39:58.625945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623852+0000","last_change":"2023-12-22T08:39:58.623592+0000","last_active":"2023-12-22T08:39:58.623852+0000","last_peered":"2023-12-22T08:39:58.623852+0000","last_clean":"2023-12-22T08:39:58.623852+0000","last_became_active":"2023-12-22T08:39:58.623129+0000","last_became_peered":"2023-12-22T08:39:58.623129+0000","last_unstale":"2023-12-22T08:39:58.623852+0000","last_undegraded":"2023-12-22T08:39:58.623852+0000","last_fullsized":"2023-12-22T08:39:58.623852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.618653+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:39:58.618653+0000","last_peered":"2023-12-22T08:39:58.618653+0000","last_clean":"2023-12-22T08:39:58.618653+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:39:58.618653+0000","last_undegraded":"2023-12-22T08:39:58.618653+0000","last_fullsized":"2023-12-22T08:39:58.618653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.614777+0000","last_change":"2023-12-22T08:39:58.128257+0000","last_active":"2023-12-22T08:39:58.614777+0000","last_peered":"2023-12-22T08:39:58.614777+0000","last_clean":"2023-12-22T08:39:58.614777+0000","last_became_active":"2023-12-22T08:39:58.127185+0000","last_became_peered":"2023-12-22T08:39:58.127185+0000","last_unstale":"2023-12-22T08:39:58.614777+0000","last_undegraded":"2023-12-22T08:39:58.614777+0000","last_fullsized":"2023-12-22T08:39:58.614777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:34.256489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630391+0000","last_change":"2023-12-22T08:39:58.630318+0000","last_active":"2023-12-22T08:39:58.630391+0000","last_peered":"2023-12-22T08:39:58.630391+0000","last_clean":"2023-12-22T08:39:58.630391+0000","last_became_active":"2023-12-22T08:39:58.630077+0000","last_became_peered":"2023-12-22T08:39:58.630077+0000","last_unstale":"2023-12-22T08:39:58.630391+0000","last_undegraded":"2023-12-22T08:39:58.630391+0000","last_fullsized":"2023-12-22T08:39:58.630391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.616306+0000","last_change":"2023-12-22T08:39:58.109900+0000","last_active":"2023-12-22T08:39:58.616306+0000","last_peered":"2023-12-22T08:39:58.616306+0000","last_clean":"2023-12-22T08:39:58.616306+0000","last_became_active":"2023-12-22T08:39:58.109127+0000","last_became_peered":"2023-12-22T08:39:58.109127+0000","last_unstale":"2023-12-22T08:39:58.616306+0000","last_undegraded":"2023-12-22T08:39:58.616306+0000","last_fullsized":"2023-12-22T08:39:58.616306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635903+0000","last_change":"2023-12-22T08:39:58.635825+0000","last_active":"2023-12-22T08:39:58.635903+0000","last_peered":"2023-12-22T08:39:58.635903+0000","last_clean":"2023-12-22T08:39:58.635903+0000","last_became_active":"2023-12-22T08:39:58.635203+0000","last_became_peered":"2023-12-22T08:39:58.635203+0000","last_unstale":"2023-12-22T08:39:58.635903+0000","last_undegraded":"2023-12-22T08:39:58.635903+0000","last_fullsized":"2023-12-22T08:39:58.635903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.617739+0000","last_change":"2023-12-22T08:39:58.128822+0000","last_active":"2023-12-22T08:39:58.617739+0000","last_peered":"2023-12-22T08:39:58.617739+0000","last_clean":"2023-12-22T08:39:58.617739+0000","last_became_active":"2023-12-22T08:39:58.128142+0000","last_became_peered":"2023-12-22T08:39:58.128142+0000","last_unstale":"2023-12-22T08:39:58.617739+0000","last_undegraded":"2023-12-22T08:39:58.617739+0000","last_fullsized":"2023-12-22T08:39:58.617739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619266+0000","last_change":"2023-12-22T08:39:58.618953+0000","last_active":"2023-12-22T08:39:58.619266+0000","last_peered":"2023-12-22T08:39:58.619266+0000","last_clean":"2023-12-22T08:39:58.619266+0000","last_became_active":"2023-12-22T08:39:58.618178+0000","last_became_peered":"2023-12-22T08:39:58.618178+0000","last_unstale":"2023-12-22T08:39:58.619266+0000","last_undegraded":"2023-12-22T08:39:58.619266+0000","last_fullsized":"2023-12-22T08:39:58.619266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.612537+0000","last_change":"2023-12-22T08:39:58.109274+0000","last_active":"2023-12-22T08:39:58.612537+0000","last_peered":"2023-12-22T08:39:58.612537+0000","last_clean":"2023-12-22T08:39:58.612537+0000","last_became_active":"2023-12-22T08:39:58.108715+0000","last_became_peered":"2023-12-22T08:39:58.108715+0000","last_unstale":"2023-12-22T08:39:58.612537+0000","last_undegraded":"2023-12-22T08:39:58.612537+0000","last_fullsized":"2023-12-22T08:39:58.612537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641249+0000","last_change":"2023-12-22T08:39:58.640517+0000","last_active":"2023-12-22T08:39:58.641249+0000","last_peered":"2023-12-22T08:39:58.641249+0000","last_clean":"2023-12-22T08:39:58.641249+0000","last_became_active":"2023-12-22T08:39:58.640288+0000","last_became_peered":"2023-12-22T08:39:58.640288+0000","last_unstale":"2023-12-22T08:39:58.641249+0000","last_undegraded":"2023-12-22T08:39:58.641249+0000","last_fullsized":"2023-12-22T08:39:58.641249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.611243+0000","last_change":"2023-12-22T08:39:58.127367+0000","last_active":"2023-12-22T08:39:58.611243+0000","last_peered":"2023-12-22T08:39:58.611243+0000","last_clean":"2023-12-22T08:39:58.611243+0000","last_became_active":"2023-12-22T08:39:58.124150+0000","last_became_peered":"2023-12-22T08:39:58.124150+0000","last_unstale":"2023-12-22T08:39:58.611243+0000","last_undegraded":"2023-12-22T08:39:58.611243+0000","last_fullsized":"2023-12-22T08:39:58.611243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.636519+0000","last_change":"2023-12-22T08:39:58.636058+0000","last_active":"2023-12-22T08:39:58.636519+0000","last_peered":"2023-12-22T08:39:58.636519+0000","last_clean":"2023-12-22T08:39:58.636519+0000","last_became_active":"2023-12-22T08:39:58.635817+0000","last_became_peered":"2023-12-22T08:39:58.635817+0000","last_unstale":"2023-12-22T08:39:58.636519+0000","last_undegraded":"2023-12-22T08:39:58.636519+0000","last_fullsized":"2023-12-22T08:39:58.636519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.615958+0000","last_change":"2023-12-22T08:39:58.128760+0000","last_active":"2023-12-22T08:39:58.615958+0000","last_peered":"2023-12-22T08:39:58.615958+0000","last_clean":"2023-12-22T08:39:58.615958+0000","last_became_active":"2023-12-22T08:39:58.128499+0000","last_became_peered":"2023-12-22T08:39:58.128499+0000","last_unstale":"2023-12-22T08:39:58.615958+0000","last_undegraded":"2023-12-22T08:39:58.615958+0000","last_fullsized":"2023-12-22T08:39:58.615958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:15.265494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633467+0000","last_change":"2023-12-22T08:39:58.630593+0000","last_active":"2023-12-22T08:39:58.633467+0000","last_peered":"2023-12-22T08:39:58.633467+0000","last_clean":"2023-12-22T08:39:58.633467+0000","last_became_active":"2023-12-22T08:39:58.629117+0000","last_became_peered":"2023-12-22T08:39:58.629117+0000","last_unstale":"2023-12-22T08:39:58.633467+0000","last_undegraded":"2023-12-22T08:39:58.633467+0000","last_fullsized":"2023-12-22T08:39:58.633467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.620856+0000","last_change":"2023-12-22T08:39:58.129601+0000","last_active":"2023-12-22T08:39:58.620856+0000","last_peered":"2023-12-22T08:39:58.620856+0000","last_clean":"2023-12-22T08:39:58.620856+0000","last_became_active":"2023-12-22T08:39:58.129236+0000","last_became_peered":"2023-12-22T08:39:58.129236+0000","last_unstale":"2023-12-22T08:39:58.620856+0000","last_undegraded":"2023-12-22T08:39:58.620856+0000","last_fullsized":"2023-12-22T08:39:58.620856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639661+0000","last_change":"2023-12-22T08:39:58.639582+0000","last_active":"2023-12-22T08:39:58.639661+0000","last_peered":"2023-12-22T08:39:58.639661+0000","last_clean":"2023-12-22T08:39:58.639661+0000","last_became_active":"2023-12-22T08:39:58.638759+0000","last_became_peered":"2023-12-22T08:39:58.638759+0000","last_unstale":"2023-12-22T08:39:58.639661+0000","last_undegraded":"2023-12-22T08:39:58.639661+0000","last_fullsized":"2023-12-22T08:39:58.639661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642267+0000","last_change":"2023-12-22T08:39:58.127199+0000","last_active":"2023-12-22T08:39:58.642267+0000","last_peered":"2023-12-22T08:39:58.642267+0000","last_clean":"2023-12-22T08:39:58.642267+0000","last_became_active":"2023-12-22T08:39:58.126735+0000","last_became_peered":"2023-12-22T08:39:58.126735+0000","last_unstale":"2023-12-22T08:39:58.642267+0000","last_undegraded":"2023-12-22T08:39:58.642267+0000","last_fullsized":"2023-12-22T08:39:58.642267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:12.048994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.627309+0000","last_change":"2023-12-22T08:39:58.627233+0000","last_active":"2023-12-22T08:39:58.627309+0000","last_peered":"2023-12-22T08:39:58.627309+0000","last_clean":"2023-12-22T08:39:58.627309+0000","last_became_active":"2023-12-22T08:39:58.626937+0000","last_became_peered":"2023-12-22T08:39:58.626937+0000","last_unstale":"2023-12-22T08:39:58.627309+0000","last_undegraded":"2023-12-22T08:39:58.627309+0000","last_fullsized":"2023-12-22T08:39:58.627309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625536+0000","last_change":"2023-12-22T08:39:58.125513+0000","last_active":"2023-12-22T08:39:58.625536+0000","last_peered":"2023-12-22T08:39:58.625536+0000","last_clean":"2023-12-22T08:39:58.625536+0000","last_became_active":"2023-12-22T08:39:58.125286+0000","last_became_peered":"2023-12-22T08:39:58.125286+0000","last_unstale":"2023-12-22T08:39:58.625536+0000","last_undegraded":"2023-12-22T08:39:58.625536+0000","last_fullsized":"2023-12-22T08:39:58.625536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623822+0000","last_change":"2023-12-22T08:39:58.622884+0000","last_active":"2023-12-22T08:39:58.623822+0000","last_peered":"2023-12-22T08:39:58.623822+0000","last_clean":"2023-12-22T08:39:58.623822+0000","last_became_active":"2023-12-22T08:39:58.622531+0000","last_became_peered":"2023-12-22T08:39:58.622531+0000","last_unstale":"2023-12-22T08:39:58.623822+0000","last_undegraded":"2023-12-22T08:39:58.623822+0000","last_fullsized":"2023-12-22T08:39:58.623822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:01.993745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.620792+0000","last_change":"2023-12-22T08:39:58.127163+0000","last_active":"2023-12-22T08:39:58.620792+0000","last_peered":"2023-12-22T08:39:58.620792+0000","last_clean":"2023-12-22T08:39:58.620792+0000","last_became_active":"2023-12-22T08:39:58.125842+0000","last_became_peered":"2023-12-22T08:39:58.125842+0000","last_unstale":"2023-12-22T08:39:58.620792+0000","last_undegraded":"2023-12-22T08:39:58.620792+0000","last_fullsized":"2023-12-22T08:39:58.620792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629967+0000","last_change":"2023-12-22T08:39:58.628998+0000","last_active":"2023-12-22T08:39:58.629967+0000","last_peered":"2023-12-22T08:39:58.629967+0000","last_clean":"2023-12-22T08:39:58.629967+0000","last_became_active":"2023-12-22T08:39:58.628022+0000","last_became_peered":"2023-12-22T08:39:58.628022+0000","last_unstale":"2023-12-22T08:39:58.629967+0000","last_undegraded":"2023-12-22T08:39:58.629967+0000","last_fullsized":"2023-12-22T08:39:58.629967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631814+0000","last_change":"2023-12-22T08:39:58.129742+0000","last_active":"2023-12-22T08:39:58.631814+0000","last_peered":"2023-12-22T08:39:58.631814+0000","last_clean":"2023-12-22T08:39:58.631814+0000","last_became_active":"2023-12-22T08:39:58.129522+0000","last_became_peered":"2023-12-22T08:39:58.129522+0000","last_unstale":"2023-12-22T08:39:58.631814+0000","last_undegraded":"2023-12-22T08:39:58.631814+0000","last_fullsized":"2023-12-22T08:39:58.631814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.636842+0000","last_change":"2023-12-22T08:39:58.636766+0000","last_active":"2023-12-22T08:39:58.636842+0000","last_peered":"2023-12-22T08:39:58.636842+0000","last_clean":"2023-12-22T08:39:58.636842+0000","last_became_active":"2023-12-22T08:39:58.636550+0000","last_became_peered":"2023-12-22T08:39:58.636550+0000","last_unstale":"2023-12-22T08:39:58.636842+0000","last_undegraded":"2023-12-22T08:39:58.636842+0000","last_fullsized":"2023-12-22T08:39:58.636842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.637828+0000","last_change":"2023-12-22T08:39:58.128411+0000","last_active":"2023-12-22T08:39:58.637828+0000","last_peered":"2023-12-22T08:39:58.637828+0000","last_clean":"2023-12-22T08:39:58.637828+0000","last_became_active":"2023-12-22T08:39:58.127849+0000","last_became_peered":"2023-12-22T08:39:58.127849+0000","last_unstale":"2023-12-22T08:39:58.637828+0000","last_undegraded":"2023-12-22T08:39:58.637828+0000","last_fullsized":"2023-12-22T08:39:58.637828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:25.721681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.624467+0000","last_change":"2023-12-22T08:39:58.624131+0000","last_active":"2023-12-22T08:39:58.624467+0000","last_peered":"2023-12-22T08:39:58.624467+0000","last_clean":"2023-12-22T08:39:58.624467+0000","last_became_active":"2023-12-22T08:39:58.621786+0000","last_became_peered":"2023-12-22T08:39:58.621786+0000","last_unstale":"2023-12-22T08:39:58.624467+0000","last_undegraded":"2023-12-22T08:39:58.624467+0000","last_fullsized":"2023-12-22T08:39:58.624467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642965+0000","last_change":"2023-12-22T08:39:58.642425+0000","last_active":"2023-12-22T08:39:58.642965+0000","last_peered":"2023-12-22T08:39:58.642965+0000","last_clean":"2023-12-22T08:39:58.642965+0000","last_became_active":"2023-12-22T08:39:58.642201+0000","last_became_peered":"2023-12-22T08:39:58.642201+0000","last_unstale":"2023-12-22T08:39:58.642965+0000","last_undegraded":"2023-12-22T08:39:58.642965+0000","last_fullsized":"2023-12-22T08:39:58.642965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:35.423369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643104+0000","last_change":"2023-12-22T08:39:58.124586+0000","last_active":"2023-12-22T08:39:58.643104+0000","last_peered":"2023-12-22T08:39:58.643104+0000","last_clean":"2023-12-22T08:39:58.643104+0000","last_became_active":"2023-12-22T08:39:58.123428+0000","last_became_peered":"2023-12-22T08:39:58.123428+0000","last_unstale":"2023-12-22T08:39:58.643104+0000","last_undegraded":"2023-12-22T08:39:58.643104+0000","last_fullsized":"2023-12-22T08:39:58.643104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630950+0000","last_change":"2023-12-22T08:39:58.630694+0000","last_active":"2023-12-22T08:39:58.630950+0000","last_peered":"2023-12-22T08:39:58.630950+0000","last_clean":"2023-12-22T08:39:58.630950+0000","last_became_active":"2023-12-22T08:39:58.630420+0000","last_became_peered":"2023-12-22T08:39:58.630420+0000","last_unstale":"2023-12-22T08:39:58.630950+0000","last_undegraded":"2023-12-22T08:39:58.630950+0000","last_fullsized":"2023-12-22T08:39:58.630950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.645513+0000","last_change":"2023-12-22T08:39:58.129551+0000","last_active":"2023-12-22T08:39:58.645513+0000","last_peered":"2023-12-22T08:39:58.645513+0000","last_clean":"2023-12-22T08:39:58.645513+0000","last_became_active":"2023-12-22T08:39:58.129237+0000","last_became_peered":"2023-12-22T08:39:58.129237+0000","last_unstale":"2023-12-22T08:39:58.645513+0000","last_undegraded":"2023-12-22T08:39:58.645513+0000","last_fullsized":"2023-12-22T08:39:58.645513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623969+0000","last_change":"2023-12-22T08:39:58.623889+0000","last_active":"2023-12-22T08:39:58.623969+0000","last_peered":"2023-12-22T08:39:58.623969+0000","last_clean":"2023-12-22T08:39:58.623969+0000","last_became_active":"2023-12-22T08:39:58.621334+0000","last_became_peered":"2023-12-22T08:39:58.621334+0000","last_unstale":"2023-12-22T08:39:58.623969+0000","last_undegraded":"2023-12-22T08:39:58.623969+0000","last_fullsized":"2023-12-22T08:39:58.623969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:58:42.417309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633418+0000","last_change":"2023-12-22T08:39:58.127899+0000","last_active":"2023-12-22T08:39:58.633418+0000","last_peered":"2023-12-22T08:39:58.633418+0000","last_clean":"2023-12-22T08:39:58.633418+0000","last_became_active":"2023-12-22T08:39:58.126733+0000","last_became_peered":"2023-12-22T08:39:58.126733+0000","last_unstale":"2023-12-22T08:39:58.633418+0000","last_undegraded":"2023-12-22T08:39:58.633418+0000","last_fullsized":"2023-12-22T08:39:58.633418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623951+0000","last_change":"2023-12-22T08:39:58.623648+0000","last_active":"2023-12-22T08:39:58.623951+0000","last_peered":"2023-12-22T08:39:58.623951+0000","last_clean":"2023-12-22T08:39:58.623951+0000","last_became_active":"2023-12-22T08:39:58.623415+0000","last_became_peered":"2023-12-22T08:39:58.623415+0000","last_unstale":"2023-12-22T08:39:58.623951+0000","last_undegraded":"2023-12-22T08:39:58.623951+0000","last_fullsized":"2023-12-22T08:39:58.623951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639516+0000","last_change":"2023-12-22T08:39:58.130439+0000","last_active":"2023-12-22T08:39:58.639516+0000","last_peered":"2023-12-22T08:39:58.639516+0000","last_clean":"2023-12-22T08:39:58.639516+0000","last_became_active":"2023-12-22T08:39:58.130196+0000","last_became_peered":"2023-12-22T08:39:58.130196+0000","last_unstale":"2023-12-22T08:39:58.639516+0000","last_undegraded":"2023-12-22T08:39:58.639516+0000","last_fullsized":"2023-12-22T08:39:58.639516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.536}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7270000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194667,"statfs":{"total":200000000,"available":199339821,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.798}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5880000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6279999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.79}]}]}],"pool_statfs":[]}} 2023-12-22T08:40:04.613 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-22T08:40:04.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.878+0000 7fe605fdc640 1 Processor -- start 2023-12-22T08:40:04.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.878+0000 7fe605fdc640 1 -- start start 2023-12-22T08:40:04.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.880+0000 7fe605fdc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe60015b420 0x7fe60006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:04.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.880+0000 7fe605fdc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe600071000 0x7fe60015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:04.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.880+0000 7fe605fdc640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6000cdae0 con 0x7fe6000a44a0 2023-12-22T08:40:04.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.880+0000 7fe605fdc640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60006dec0 con 0x7fe60015b420 2023-12-22T08:40:04.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.880+0000 7fe605fdc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60015b800 con 0x7fe600071000 2023-12-22T08:40:04.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.880+0000 7fe5f7fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe6000a44a0 0x7fe6000708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51532/0 (socket says 172.21.15.38:51532) 2023-12-22T08:40:04.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.880+0000 7fe5f7fff640 1 -- 172.21.15.38:0/3071994778 learned_addr learned my addr 172.21.15.38:0/3071994778 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:04.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.880+0000 7fe604fda640 1 --2- 172.21.15.38:0/3071994778 >> v2:172.21.15.89:3300/0 conn(0x7fe60015b420 0x7fe60006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:04.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.880+0000 7fe6057db640 1 --2- 172.21.15.38:0/3071994778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe600071000 0x7fe60015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:04.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.880+0000 7fe5f77fe640 1 -- 172.21.15.38:0/3071994778 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634640966 0 0) 0x7fe6000cdae0 con 0x7fe6000a44a0 2023-12-22T08:40:04.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.881+0000 7fe5f77fe640 1 -- 172.21.15.38:0/3071994778 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e8003520 con 0x7fe6000a44a0 2023-12-22T08:40:04.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.881+0000 7fe604fda640 1 -- 172.21.15.38:0/3071994778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe600071000 msgr2=0x7fe60015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:04.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.881+0000 7fe604fda640 1 --2- 172.21.15.38:0/3071994778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe600071000 0x7fe60015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.881+0000 7fe604fda640 1 -- 172.21.15.38:0/3071994778 >> v1:172.21.15.38:6789/0 conn(0x7fe6000a44a0 legacy=0x7fe6000708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:04.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.881+0000 7fe5f77fe640 1 -- 172.21.15.38:0/3071994778 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2605562686 0 0) 0x7fe5e8003520 con 0x7fe6000a44a0 2023-12-22T08:40:04.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.881+0000 7fe604fda640 1 -- 172.21.15.38:0/3071994778 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000cdd30 con 0x7fe60015b420 2023-12-22T08:40:04.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.882+0000 7fe604fda640 1 --2- 172.21.15.38:0/3071994778 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60015b420 0x7fe60006d980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0097a0 tx=0x7fe5fc02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d5ad6b1582039c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:04.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.883+0000 7fe5f77fe640 1 -- 172.21.15.38:0/3071994778 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0001670 con 0x7fe60015b420 2023-12-22T08:40:04.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.883+0000 7fe5f77fe640 1 -- 172.21.15.38:0/3071994778 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc02e050 con 0x7fe60015b420 2023-12-22T08:40:04.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.883+0000 7fe5f77fe640 1 -- 172.21.15.38:0/3071994778 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc030730 con 0x7fe60015b420 2023-12-22T08:40:04.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.883+0000 7fe605fdc640 1 -- 172.21.15.38:0/3071994778 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60015b420 msgr2=0x7fe60006d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:04.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.883+0000 7fe605fdc640 1 --2- 172.21.15.38:0/3071994778 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60015b420 0x7fe60006d980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0097a0 tx=0x7fe5fc02b790 comp rx=0 tx=0).stop 2023-12-22T08:40:04.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.884+0000 7fe605fdc640 1 -- 172.21.15.38:0/3071994778 shutdown_connections 2023-12-22T08:40:04.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.884+0000 7fe605fdc640 1 --2- 172.21.15.38:0/3071994778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe600071000 0x7fe60015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.884+0000 7fe605fdc640 1 --2- 172.21.15.38:0/3071994778 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60015b420 0x7fe60006d980 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.884+0000 7fe605fdc640 1 -- 172.21.15.38:0/3071994778 >> 172.21.15.38:0/3071994778 conn(0x7fe6000b1f70 msgr2=0x7fe6000b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:04.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.884+0000 7fe605fdc640 1 -- 172.21.15.38:0/3071994778 shutdown_connections 2023-12-22T08:40:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.884+0000 7fe605fdc640 1 -- 172.21.15.38:0/3071994778 wait complete. 2023-12-22T08:40:04.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.885+0000 7fe605fdc640 1 Processor -- start 2023-12-22T08:40:04.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.886+0000 7fe605fdc640 1 -- start start 2023-12-22T08:40:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.886+0000 7fe605fdc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe600071000 0x7fe6001f41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe605fdc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6000a44a0 0x7fe600150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe605fdc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60015b420 0x7fe6001511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe605fdc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600151710 con 0x7fe6000a44a0 2023-12-22T08:40:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe605fdc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600150800 con 0x7fe60015b420 2023-12-22T08:40:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe605fdc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60014fbf0 con 0x7fe600071000 2023-12-22T08:40:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe5f7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6000a44a0 0x7fe600150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe5f7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6000a44a0 0x7fe600150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42264/0 (socket says 172.21.15.38:42264) 2023-12-22T08:40:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe5f7fff640 1 -- 172.21.15.38:0/1600591742 learned_addr learned my addr 172.21.15.38:0/1600591742 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe6057db640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60015b420 0x7fe6001511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe604fda640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe600071000 0x7fe6001f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe5f7fff640 1 -- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe600071000 msgr2=0x7fe6001f41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe5f7fff640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe600071000 0x7fe6001f41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe5f7fff640 1 -- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60015b420 msgr2=0x7fe6001511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe5f7fff640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60015b420 0x7fe6001511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe5f7fff640 1 -- 172.21.15.38:0/1600591742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc009400 con 0x7fe6000a44a0 2023-12-22T08:40:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.887+0000 7fe604fda640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe600071000 0x7fe6001f41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.888+0000 7fe5f7fff640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6000a44a0 0x7fe600150c90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000c730 tx=0x7fe5f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.888+0000 7fe5f57fa640 1 -- 172.21.15.38:0/1600591742 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0005ad0 con 0x7fe6000a44a0 2023-12-22T08:40:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.888+0000 7fe5f57fa640 1 -- 172.21.15.38:0/1600591742 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f0005c30 con 0x7fe6000a44a0 2023-12-22T08:40:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.888+0000 7fe605fdc640 1 -- 172.21.15.38:0/1600591742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60014fed0 con 0x7fe6000a44a0 2023-12-22T08:40:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.888+0000 7fe5f57fa640 1 -- 172.21.15.38:0/1600591742 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0007070 con 0x7fe6000a44a0 2023-12-22T08:40:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.888+0000 7fe605fdc640 1 -- 172.21.15.38:0/1600591742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe600150490 con 0x7fe6000a44a0 2023-12-22T08:40:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.889+0000 7fe605fdc640 1 -- 172.21.15.38:0/1600591742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe600061910 con 0x7fe6000a44a0 2023-12-22T08:40:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.890+0000 7fe5f57fa640 1 -- 172.21.15.38:0/1600591742 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe5f00071d0 con 0x7fe6000a44a0 2023-12-22T08:40:04.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.891+0000 7fe5f57fa640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5ec06a430 0x7fe5ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:04.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.891+0000 7fe5f57fa640 1 -- 172.21.15.38:0/1600591742 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5f00886d0 con 0x7fe6000a44a0 2023-12-22T08:40:04.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.892+0000 7fe604fda640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5ec06a430 0x7fe5ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:04.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.893+0000 7fe604fda640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5ec06a430 0x7fe5ec06c8f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc034000 tx=0x7fe5fc02f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:04.895+0000 7fe5f57fa640 1 -- 172.21.15.38:0/1600591742 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe5f0053ba0 con 0x7fe6000a44a0 2023-12-22T08:40:05.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.162+0000 7fe605fdc640 1 -- 172.21.15.38:0/1600591742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe6000cb5c0 con 0x7fe6000a44a0 2023-12-22T08:40:05.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.162+0000 7fe5f57fa640 1 -- 172.21.15.38:0/1600591742 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1004 (secure 0 0 0) 0x7fe5f00571c0 con 0x7fe6000a44a0 2023-12-22T08:40:05.165 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:05.165 INFO:teuthology.orchestra.run.smithi038.stdout:{"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":24,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1703234387,"num_in_osds":8,"osd_in_since":1703234384,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":1750345,"bytes_avail":1598249655,"bytes_total":1600000000,"write_bytes_sec":2291,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4273}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-12-22T08:39:41.089959+0000","services":{}},"progress_events":{}} 2023-12-22T08:40:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.165+0000 7fe605fdc640 1 -- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5ec06a430 msgr2=0x7fe5ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.165+0000 7fe605fdc640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5ec06a430 0x7fe5ec06c8f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc034000 tx=0x7fe5fc02f000 comp rx=0 tx=0).stop 2023-12-22T08:40:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.165+0000 7fe605fdc640 1 -- 172.21.15.38:0/1600591742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6000a44a0 msgr2=0x7fe600150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.165+0000 7fe605fdc640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6000a44a0 0x7fe600150c90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000c730 tx=0x7fe5f000cbf0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.165+0000 7fe605fdc640 1 -- 172.21.15.38:0/1600591742 shutdown_connections 2023-12-22T08:40:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.165+0000 7fe605fdc640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe60015b420 0x7fe6001511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.165+0000 7fe605fdc640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5ec06a430 0x7fe5ec06c8f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.165+0000 7fe605fdc640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6000a44a0 0x7fe600150c90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.165+0000 7fe605fdc640 1 --2- 172.21.15.38:0/1600591742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe600071000 0x7fe6001f41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.165+0000 7fe605fdc640 1 -- 172.21.15.38:0/1600591742 >> 172.21.15.38:0/1600591742 conn(0x7fe6000b1f70 msgr2=0x7fe6000cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.165+0000 7fe605fdc640 1 -- 172.21.15.38:0/1600591742 shutdown_connections 2023-12-22T08:40:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.165+0000 7fe605fdc640 1 -- 172.21.15.38:0/1600591742 wait complete. 2023-12-22T08:40:05.186 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-22T08:40:05.186 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:40:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.407+0000 7fabdfd1b640 1 Processor -- start 2023-12-22T08:40:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.407+0000 7fabdfd1b640 1 -- start start 2023-12-22T08:40:05.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.409+0000 7fabdfd1b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fabd8146bc0 0x7fabd80b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:05.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.409+0000 7fabdfd1b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fabd80d2a20 0x7fabd80d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:05.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.409+0000 7fabdfd1b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd80d03a0 con 0x7fabd80b4550 2023-12-22T08:40:05.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.409+0000 7fabdfd1b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd8146fa0 con 0x7fabd8146bc0 2023-12-22T08:40:05.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.409+0000 7fabdfd1b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd80b49d0 con 0x7fabd80d2a20 2023-12-22T08:40:05.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.410+0000 7fabddab7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fabd8146bc0 0x7fabd80b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:05.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.410+0000 7fabdd2b6640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fabd80b4550 0x7fabd80d2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51548/0 (socket says 172.21.15.38:51548) 2023-12-22T08:40:05.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.410+0000 7fabdd2b6640 1 -- 172.21.15.38:0/3427668961 learned_addr learned my addr 172.21.15.38:0/3427668961 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:05.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.410+0000 7fabde2b8640 1 --2- 172.21.15.38:0/3427668961 >> v2:172.21.15.89:3300/0 conn(0x7fabd80d2a20 0x7fabd80d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:05.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.410+0000 7fabddab7640 1 -- 172.21.15.38:0/3427668961 >> v2:172.21.15.89:3300/0 conn(0x7fabd80d2a20 msgr2=0x7fabd80d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:05.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.410+0000 7fabddab7640 1 --2- 172.21.15.38:0/3427668961 >> v2:172.21.15.89:3300/0 conn(0x7fabd80d2a20 0x7fabd80d0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.410+0000 7fabddab7640 1 -- 172.21.15.38:0/3427668961 >> v1:172.21.15.38:6789/0 conn(0x7fabd80b4550 legacy=0x7fabd80d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:05.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.410+0000 7fabdcab5640 1 -- 172.21.15.38:0/3427668961 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86347106 0 0) 0x7fabd80d03a0 con 0x7fabd80b4550 2023-12-22T08:40:05.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.410+0000 7fabddab7640 1 -- 172.21.15.38:0/3427668961 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd80cfa70 con 0x7fabd8146bc0 2023-12-22T08:40:05.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.412+0000 7fabddab7640 1 --2- 172.21.15.38:0/3427668961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd8146bc0 0x7fabd80b4010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fabd8061710 tx=0x7fabd402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272c433d793493c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:05.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.412+0000 7fabdcab5640 1 -- 172.21.15.38:0/3427668961 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd402e070 con 0x7fabd8146bc0 2023-12-22T08:40:05.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.412+0000 7fabdcab5640 1 -- 172.21.15.38:0/3427668961 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd40315a0 con 0x7fabd8146bc0 2023-12-22T08:40:05.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.412+0000 7fabdcab5640 1 -- 172.21.15.38:0/3427668961 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4031930 con 0x7fabd8146bc0 2023-12-22T08:40:05.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.413+0000 7fabdfd1b640 1 -- 172.21.15.38:0/3427668961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd8146bc0 msgr2=0x7fabd80b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:05.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.413+0000 7fabdfd1b640 1 --2- 172.21.15.38:0/3427668961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd8146bc0 0x7fabd80b4010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fabd8061710 tx=0x7fabd402b840 comp rx=0 tx=0).stop 2023-12-22T08:40:05.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.413+0000 7fabdfd1b640 1 -- 172.21.15.38:0/3427668961 shutdown_connections 2023-12-22T08:40:05.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.413+0000 7fabdfd1b640 1 --2- 172.21.15.38:0/3427668961 >> v2:172.21.15.89:3300/0 conn(0x7fabd80d2a20 0x7fabd80d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.413+0000 7fabdfd1b640 1 --2- 172.21.15.38:0/3427668961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd8146bc0 0x7fabd80b4010 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.413+0000 7fabdfd1b640 1 -- 172.21.15.38:0/3427668961 >> 172.21.15.38:0/3427668961 conn(0x7fabd806cdf0 msgr2=0x7fabd8071260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:05.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.413+0000 7fabdfd1b640 1 -- 172.21.15.38:0/3427668961 shutdown_connections 2023-12-22T08:40:05.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.413+0000 7fabdfd1b640 1 -- 172.21.15.38:0/3427668961 wait complete. 2023-12-22T08:40:05.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.415+0000 7fabdfd1b640 1 Processor -- start 2023-12-22T08:40:05.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.415+0000 7fabdfd1b640 1 -- start start 2023-12-22T08:40:05.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.416+0000 7fabdfd1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd80b4550 0x7fabd813ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:05.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.416+0000 7fabdfd1b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd80d2a20 0x7fabd81537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:05.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.416+0000 7fabdfd1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd8146bc0 0x7fabd813bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:05.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.416+0000 7fabdfd1b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8143e30 con 0x7fabd80d2a20 2023-12-22T08:40:05.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.416+0000 7fabdfd1b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8144080 con 0x7fabd80b4550 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.416+0000 7fabdfd1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8144360 con 0x7fabd8146bc0 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.417+0000 7fabdd2b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd80d2a20 0x7fabd81537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.417+0000 7fabdd2b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd80d2a20 0x7fabd81537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42290/0 (socket says 172.21.15.38:42290) 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.417+0000 7fabdd2b6640 1 -- 172.21.15.38:0/1356991685 learned_addr learned my addr 172.21.15.38:0/1356991685 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.417+0000 7fabddab7640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd80b4550 0x7fabd813ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.417+0000 7fabde2b8640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd8146bc0 0x7fabd813bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.417+0000 7fabdd2b6640 1 -- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd8146bc0 msgr2=0x7fabd813bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.417+0000 7fabdd2b6640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd8146bc0 0x7fabd813bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.417+0000 7fabdd2b6640 1 -- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd80b4550 msgr2=0x7fabd813ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.417+0000 7fabdd2b6640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd80b4550 0x7fabd813ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.417+0000 7fabdd2b6640 1 -- 172.21.15.38:0/1356991685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd4009400 con 0x7fabd80d2a20 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.417+0000 7fabdd2b6640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd80d2a20 0x7fabd81537d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fabc800c4d0 tx=0x7fabc800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.418+0000 7fabce7fc640 1 -- 172.21.15.38:0/1356991685 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc80074e0 con 0x7fabd80d2a20 2023-12-22T08:40:05.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.418+0000 7fabce7fc640 1 -- 172.21.15.38:0/1356991685 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc8007660 con 0x7fabd80d2a20 2023-12-22T08:40:05.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.418+0000 7fabce7fc640 1 -- 172.21.15.38:0/1356991685 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8004a20 con 0x7fabd80d2a20 2023-12-22T08:40:05.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.418+0000 7fabdfd1b640 1 -- 172.21.15.38:0/1356991685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd8144640 con 0x7fabd80d2a20 2023-12-22T08:40:05.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.418+0000 7fabdfd1b640 1 -- 172.21.15.38:0/1356991685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd8153d10 con 0x7fabd80d2a20 2023-12-22T08:40:05.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.419+0000 7fabdfd1b640 1 -- 172.21.15.38:0/1356991685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd8061910 con 0x7fabd80d2a20 2023-12-22T08:40:05.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.420+0000 7fabce7fc640 1 -- 172.21.15.38:0/1356991685 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fabc8004b80 con 0x7fabd80d2a20 2023-12-22T08:40:05.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.421+0000 7fabce7fc640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fabbc06a430 0x7fabbc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:05.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.421+0000 7fabce7fc640 1 -- 172.21.15.38:0/1356991685 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabc8087b80 con 0x7fabd80d2a20 2023-12-22T08:40:05.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.422+0000 7fabddab7640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fabbc06a430 0x7fabbc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:05.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.423+0000 7fabddab7640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fabbc06a430 0x7fabbc06c8f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fabd4036000 tx=0x7fabd403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:05.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.426+0000 7fabce7fc640 1 -- 172.21.15.38:0/1356991685 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fabc8053160 con 0x7fabd80d2a20 2023-12-22T08:40:05.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.615+0000 7fabdfd1b640 1 -- 172.21.15.38:0/1356991685 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabd80d0030 con 0x7fabbc06a430 2023-12-22T08:40:05.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.636+0000 7fabce7fc640 1 -- 172.21.15.38:0/1356991685 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259933 (secure 0 0 0) 0x7fabd40319f0 con 0x7fabbc06a430 2023-12-22T08:40:05.641 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:05.643 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:40:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.642+0000 7fabdfd1b640 1 -- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fabbc06a430 msgr2=0x7fabbc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.642+0000 7fabdfd1b640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fabbc06a430 0x7fabbc06c8f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fabd4036000 tx=0x7fabd403d040 comp rx=0 tx=0).stop 2023-12-22T08:40:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.642+0000 7fabdfd1b640 1 -- 172.21.15.38:0/1356991685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd80d2a20 msgr2=0x7fabd81537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.642+0000 7fabdfd1b640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd80d2a20 0x7fabd81537d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fabc800c4d0 tx=0x7fabc800c990 comp rx=0 tx=0).stop 2023-12-22T08:40:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.642+0000 7fabdfd1b640 1 -- 172.21.15.38:0/1356991685 shutdown_connections 2023-12-22T08:40:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.642+0000 7fabdfd1b640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabd8146bc0 0x7fabd813bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.642+0000 7fabdfd1b640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fabbc06a430 0x7fabbc06c8f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.642+0000 7fabdfd1b640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabd80d2a20 0x7fabd81537d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.642+0000 7fabdfd1b640 1 --2- 172.21.15.38:0/1356991685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabd80b4550 0x7fabd813ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.642+0000 7fabdfd1b640 1 -- 172.21.15.38:0/1356991685 >> 172.21.15.38:0/1356991685 conn(0x7fabd806cdf0 msgr2=0x7fabd80d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.643+0000 7fabdfd1b640 1 -- 172.21.15.38:0/1356991685 shutdown_connections 2023-12-22T08:40:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:05.643+0000 7fabdfd1b640 1 -- 172.21.15.38:0/1356991685 wait complete. 2023-12-22T08:40:05.665 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-22T08:40:04.355303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560790,"statfs":{"total":1600000000,"available":1598249655,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.255365"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641233+0000","last_change":"2023-12-22T08:39:58.637334+0000","last_active":"2023-12-22T08:39:58.641233+0000","last_peered":"2023-12-22T08:39:58.641233+0000","last_clean":"2023-12-22T08:39:58.641233+0000","last_became_active":"2023-12-22T08:39:58.633668+0000","last_became_peered":"2023-12-22T08:39:58.633668+0000","last_unstale":"2023-12-22T08:39:58.641233+0000","last_undegraded":"2023-12-22T08:39:58.641233+0000","last_fullsized":"2023-12-22T08:39:58.641233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.638651+0000","last_change":"2023-12-22T08:39:58.638511+0000","last_active":"2023-12-22T08:39:58.638651+0000","last_peered":"2023-12-22T08:39:58.638651+0000","last_clean":"2023-12-22T08:39:58.638651+0000","last_became_active":"2023-12-22T08:39:58.638133+0000","last_became_peered":"2023-12-22T08:39:58.638133+0000","last_unstale":"2023-12-22T08:39:58.638651+0000","last_undegraded":"2023-12-22T08:39:58.638651+0000","last_fullsized":"2023-12-22T08:39:58.638651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626853+0000","last_change":"2023-12-22T08:39:58.624493+0000","last_active":"2023-12-22T08:39:58.626853+0000","last_peered":"2023-12-22T08:39:58.626853+0000","last_clean":"2023-12-22T08:39:58.626853+0000","last_became_active":"2023-12-22T08:39:58.624182+0000","last_became_peered":"2023-12-22T08:39:58.624182+0000","last_unstale":"2023-12-22T08:39:58.626853+0000","last_undegraded":"2023-12-22T08:39:58.626853+0000","last_fullsized":"2023-12-22T08:39:58.626853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.622961+0000","last_change":"2023-12-22T08:39:58.622751+0000","last_active":"2023-12-22T08:39:58.622961+0000","last_peered":"2023-12-22T08:39:58.622961+0000","last_clean":"2023-12-22T08:39:58.622961+0000","last_became_active":"2023-12-22T08:39:58.622558+0000","last_became_peered":"2023-12-22T08:39:58.622558+0000","last_unstale":"2023-12-22T08:39:58.622961+0000","last_undegraded":"2023-12-22T08:39:58.622961+0000","last_fullsized":"2023-12-22T08:39:58.622961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643514+0000","last_change":"2023-12-22T08:39:58.643416+0000","last_active":"2023-12-22T08:39:58.643514+0000","last_peered":"2023-12-22T08:39:58.643514+0000","last_clean":"2023-12-22T08:39:58.643514+0000","last_became_active":"2023-12-22T08:39:58.641676+0000","last_became_peered":"2023-12-22T08:39:58.641676+0000","last_unstale":"2023-12-22T08:39:58.643514+0000","last_undegraded":"2023-12-22T08:39:58.643514+0000","last_fullsized":"2023-12-22T08:39:58.643514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628427+0000","last_change":"2023-12-22T08:39:58.627296+0000","last_active":"2023-12-22T08:39:58.628427+0000","last_peered":"2023-12-22T08:39:58.628427+0000","last_clean":"2023-12-22T08:39:58.628427+0000","last_became_active":"2023-12-22T08:39:58.626081+0000","last_became_peered":"2023-12-22T08:39:58.626081+0000","last_unstale":"2023-12-22T08:39:58.628427+0000","last_undegraded":"2023-12-22T08:39:58.628427+0000","last_fullsized":"2023-12-22T08:39:58.628427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632558+0000","last_change":"2023-12-22T08:39:58.627560+0000","last_active":"2023-12-22T08:39:58.632558+0000","last_peered":"2023-12-22T08:39:58.632558+0000","last_clean":"2023-12-22T08:39:58.632558+0000","last_became_active":"2023-12-22T08:39:58.627301+0000","last_became_peered":"2023-12-22T08:39:58.627301+0000","last_unstale":"2023-12-22T08:39:58.632558+0000","last_undegraded":"2023-12-22T08:39:58.632558+0000","last_fullsized":"2023-12-22T08:39:58.632558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635551+0000","last_change":"2023-12-22T08:39:58.635478+0000","last_active":"2023-12-22T08:39:58.635551+0000","last_peered":"2023-12-22T08:39:58.635551+0000","last_clean":"2023-12-22T08:39:58.635551+0000","last_became_active":"2023-12-22T08:39:58.634102+0000","last_became_peered":"2023-12-22T08:39:58.634102+0000","last_unstale":"2023-12-22T08:39:58.635551+0000","last_undegraded":"2023-12-22T08:39:58.635551+0000","last_fullsized":"2023-12-22T08:39:58.635551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628795+0000","last_change":"2023-12-22T08:39:58.627844+0000","last_active":"2023-12-22T08:39:58.628795+0000","last_peered":"2023-12-22T08:39:58.628795+0000","last_clean":"2023-12-22T08:39:58.628795+0000","last_became_active":"2023-12-22T08:39:58.627437+0000","last_became_peered":"2023-12-22T08:39:58.627437+0000","last_unstale":"2023-12-22T08:39:58.628795+0000","last_undegraded":"2023-12-22T08:39:58.628795+0000","last_fullsized":"2023-12-22T08:39:58.628795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643969+0000","last_change":"2023-12-22T08:39:58.643662+0000","last_active":"2023-12-22T08:39:58.643969+0000","last_peered":"2023-12-22T08:39:58.643969+0000","last_clean":"2023-12-22T08:39:58.643969+0000","last_became_active":"2023-12-22T08:39:58.642844+0000","last_became_peered":"2023-12-22T08:39:58.642844+0000","last_unstale":"2023-12-22T08:39:58.643969+0000","last_undegraded":"2023-12-22T08:39:58.643969+0000","last_fullsized":"2023-12-22T08:39:58.643969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634533+0000","last_change":"2023-12-22T08:39:58.633899+0000","last_active":"2023-12-22T08:39:58.634533+0000","last_peered":"2023-12-22T08:39:58.634533+0000","last_clean":"2023-12-22T08:39:58.634533+0000","last_became_active":"2023-12-22T08:39:58.633388+0000","last_became_peered":"2023-12-22T08:39:58.633388+0000","last_unstale":"2023-12-22T08:39:58.634533+0000","last_undegraded":"2023-12-22T08:39:58.634533+0000","last_fullsized":"2023-12-22T08:39:58.634533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641187+0000","last_change":"2023-12-22T08:39:58.635496+0000","last_active":"2023-12-22T08:39:58.641187+0000","last_peered":"2023-12-22T08:39:58.641187+0000","last_clean":"2023-12-22T08:39:58.641187+0000","last_became_active":"2023-12-22T08:39:58.635138+0000","last_became_peered":"2023-12-22T08:39:58.635138+0000","last_unstale":"2023-12-22T08:39:58.641187+0000","last_undegraded":"2023-12-22T08:39:58.641187+0000","last_fullsized":"2023-12-22T08:39:58.641187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642527+0000","last_change":"2023-12-22T08:39:58.642430+0000","last_active":"2023-12-22T08:39:58.642527+0000","last_peered":"2023-12-22T08:39:58.642527+0000","last_clean":"2023-12-22T08:39:58.642527+0000","last_became_active":"2023-12-22T08:39:58.642158+0000","last_became_peered":"2023-12-22T08:39:58.642158+0000","last_unstale":"2023-12-22T08:39:58.642527+0000","last_undegraded":"2023-12-22T08:39:58.642527+0000","last_fullsized":"2023-12-22T08:39:58.642527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633485+0000","last_change":"2023-12-22T08:39:58.632386+0000","last_active":"2023-12-22T08:39:58.633485+0000","last_peered":"2023-12-22T08:39:58.633485+0000","last_clean":"2023-12-22T08:39:58.633485+0000","last_became_active":"2023-12-22T08:39:58.632076+0000","last_became_peered":"2023-12-22T08:39:58.632076+0000","last_unstale":"2023-12-22T08:39:58.633485+0000","last_undegraded":"2023-12-22T08:39:58.633485+0000","last_fullsized":"2023-12-22T08:39:58.633485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642784+0000","last_change":"2023-12-22T08:39:58.642703+0000","last_active":"2023-12-22T08:39:58.642784+0000","last_peered":"2023-12-22T08:39:58.642784+0000","last_clean":"2023-12-22T08:39:58.642784+0000","last_became_active":"2023-12-22T08:39:58.642445+0000","last_became_peered":"2023-12-22T08:39:58.642445+0000","last_unstale":"2023-12-22T08:39:58.642784+0000","last_undegraded":"2023-12-22T08:39:58.642784+0000","last_fullsized":"2023-12-22T08:39:58.642784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632403+0000","last_change":"2023-12-22T08:39:58.631912+0000","last_active":"2023-12-22T08:39:58.632403+0000","last_peered":"2023-12-22T08:39:58.632403+0000","last_clean":"2023-12-22T08:39:58.632403+0000","last_became_active":"2023-12-22T08:39:58.631582+0000","last_became_peered":"2023-12-22T08:39:58.631582+0000","last_unstale":"2023-12-22T08:39:58.632403+0000","last_undegraded":"2023-12-22T08:39:58.632403+0000","last_fullsized":"2023-12-22T08:39:58.632403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631724+0000","last_change":"2023-12-22T08:39:58.631577+0000","last_active":"2023-12-22T08:39:58.631724+0000","last_peered":"2023-12-22T08:39:58.631724+0000","last_clean":"2023-12-22T08:39:58.631724+0000","last_became_active":"2023-12-22T08:39:58.630007+0000","last_became_peered":"2023-12-22T08:39:58.630007+0000","last_unstale":"2023-12-22T08:39:58.631724+0000","last_undegraded":"2023-12-22T08:39:58.631724+0000","last_fullsized":"2023-12-22T08:39:58.631724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631082+0000","last_change":"2023-12-22T08:39:58.630931+0000","last_active":"2023-12-22T08:39:58.631082+0000","last_peered":"2023-12-22T08:39:58.631082+0000","last_clean":"2023-12-22T08:39:58.631082+0000","last_became_active":"2023-12-22T08:39:58.629526+0000","last_became_peered":"2023-12-22T08:39:58.629526+0000","last_unstale":"2023-12-22T08:39:58.631082+0000","last_undegraded":"2023-12-22T08:39:58.631082+0000","last_fullsized":"2023-12-22T08:39:58.631082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625568+0000","last_change":"2023-12-22T08:39:58.625439+0000","last_active":"2023-12-22T08:39:58.625568+0000","last_peered":"2023-12-22T08:39:58.625568+0000","last_clean":"2023-12-22T08:39:58.625568+0000","last_became_active":"2023-12-22T08:39:58.625072+0000","last_became_peered":"2023-12-22T08:39:58.625072+0000","last_unstale":"2023-12-22T08:39:58.625568+0000","last_undegraded":"2023-12-22T08:39:58.625568+0000","last_fullsized":"2023-12-22T08:39:58.625568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:24:09.483177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643984+0000","last_change":"2023-12-22T08:39:58.643819+0000","last_active":"2023-12-22T08:39:58.643984+0000","last_peered":"2023-12-22T08:39:58.643984+0000","last_clean":"2023-12-22T08:39:58.643984+0000","last_became_active":"2023-12-22T08:39:58.643147+0000","last_became_peered":"2023-12-22T08:39:58.643147+0000","last_unstale":"2023-12-22T08:39:58.643984+0000","last_undegraded":"2023-12-22T08:39:58.643984+0000","last_fullsized":"2023-12-22T08:39:58.643984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630682+0000","last_change":"2023-12-22T08:39:58.630595+0000","last_active":"2023-12-22T08:39:58.630682+0000","last_peered":"2023-12-22T08:39:58.630682+0000","last_clean":"2023-12-22T08:39:58.630682+0000","last_became_active":"2023-12-22T08:39:58.630241+0000","last_became_peered":"2023-12-22T08:39:58.630241+0000","last_unstale":"2023-12-22T08:39:58.630682+0000","last_undegraded":"2023-12-22T08:39:58.630682+0000","last_fullsized":"2023-12-22T08:39:58.630682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629920+0000","last_change":"2023-12-22T08:39:58.629733+0000","last_active":"2023-12-22T08:39:58.629920+0000","last_peered":"2023-12-22T08:39:58.629920+0000","last_clean":"2023-12-22T08:39:58.629920+0000","last_became_active":"2023-12-22T08:39:58.629485+0000","last_became_peered":"2023-12-22T08:39:58.629485+0000","last_unstale":"2023-12-22T08:39:58.629920+0000","last_undegraded":"2023-12-22T08:39:58.629920+0000","last_fullsized":"2023-12-22T08:39:58.629920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.618810+0000","last_change":"2023-12-22T08:39:58.618183+0000","last_active":"2023-12-22T08:39:58.618810+0000","last_peered":"2023-12-22T08:39:58.618810+0000","last_clean":"2023-12-22T08:39:58.618810+0000","last_became_active":"2023-12-22T08:39:58.617884+0000","last_became_peered":"2023-12-22T08:39:58.617884+0000","last_unstale":"2023-12-22T08:39:58.618810+0000","last_undegraded":"2023-12-22T08:39:58.618810+0000","last_fullsized":"2023-12-22T08:39:58.618810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619546+0000","last_change":"2023-12-22T08:39:58.619439+0000","last_active":"2023-12-22T08:39:58.619546+0000","last_peered":"2023-12-22T08:39:58.619546+0000","last_clean":"2023-12-22T08:39:58.619546+0000","last_became_active":"2023-12-22T08:39:58.617801+0000","last_became_peered":"2023-12-22T08:39:58.617801+0000","last_unstale":"2023-12-22T08:39:58.619546+0000","last_undegraded":"2023-12-22T08:39:58.619546+0000","last_fullsized":"2023-12-22T08:39:58.619546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:22.933973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623909+0000","last_change":"2023-12-22T08:39:58.621731+0000","last_active":"2023-12-22T08:39:58.623909+0000","last_peered":"2023-12-22T08:39:58.623909+0000","last_clean":"2023-12-22T08:39:58.623909+0000","last_became_active":"2023-12-22T08:39:58.621245+0000","last_became_peered":"2023-12-22T08:39:58.621245+0000","last_unstale":"2023-12-22T08:39:58.623909+0000","last_undegraded":"2023-12-22T08:39:58.623909+0000","last_fullsized":"2023-12-22T08:39:58.623909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.622887+0000","last_change":"2023-12-22T08:39:58.621295+0000","last_active":"2023-12-22T08:39:58.622887+0000","last_peered":"2023-12-22T08:39:58.622887+0000","last_clean":"2023-12-22T08:39:58.622887+0000","last_became_active":"2023-12-22T08:39:58.621071+0000","last_became_peered":"2023-12-22T08:39:58.621071+0000","last_unstale":"2023-12-22T08:39:58.622887+0000","last_undegraded":"2023-12-22T08:39:58.622887+0000","last_fullsized":"2023-12-22T08:39:58.622887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635278+0000","last_change":"2023-12-22T08:39:58.635200+0000","last_active":"2023-12-22T08:39:58.635278+0000","last_peered":"2023-12-22T08:39:58.635278+0000","last_clean":"2023-12-22T08:39:58.635278+0000","last_became_active":"2023-12-22T08:39:58.634590+0000","last_became_peered":"2023-12-22T08:39:58.634590+0000","last_unstale":"2023-12-22T08:39:58.635278+0000","last_undegraded":"2023-12-22T08:39:58.635278+0000","last_fullsized":"2023-12-22T08:39:58.635278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635766+0000","last_change":"2023-12-22T08:39:58.635639+0000","last_active":"2023-12-22T08:39:58.635766+0000","last_peered":"2023-12-22T08:39:58.635766+0000","last_clean":"2023-12-22T08:39:58.635766+0000","last_became_active":"2023-12-22T08:39:58.634556+0000","last_became_peered":"2023-12-22T08:39:58.634556+0000","last_unstale":"2023-12-22T08:39:58.635766+0000","last_undegraded":"2023-12-22T08:39:58.635766+0000","last_fullsized":"2023-12-22T08:39:58.635766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:59:30.195380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619288+0000","last_change":"2023-12-22T08:39:58.619128+0000","last_active":"2023-12-22T08:39:58.619288+0000","last_peered":"2023-12-22T08:39:58.619288+0000","last_clean":"2023-12-22T08:39:58.619288+0000","last_became_active":"2023-12-22T08:39:58.618488+0000","last_became_peered":"2023-12-22T08:39:58.618488+0000","last_unstale":"2023-12-22T08:39:58.619288+0000","last_undegraded":"2023-12-22T08:39:58.619288+0000","last_fullsized":"2023-12-22T08:39:58.619288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.617164+0000","last_change":"2023-12-22T08:39:58.616544+0000","last_active":"2023-12-22T08:39:58.617164+0000","last_peered":"2023-12-22T08:39:58.617164+0000","last_clean":"2023-12-22T08:39:58.617164+0000","last_became_active":"2023-12-22T08:39:58.616182+0000","last_became_peered":"2023-12-22T08:39:58.616182+0000","last_unstale":"2023-12-22T08:39:58.617164+0000","last_undegraded":"2023-12-22T08:39:58.617164+0000","last_fullsized":"2023-12-22T08:39:58.617164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:13:34.205933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.627549+0000","last_change":"2023-12-22T08:39:58.627478+0000","last_active":"2023-12-22T08:39:58.627549+0000","last_peered":"2023-12-22T08:39:58.627549+0000","last_clean":"2023-12-22T08:39:58.627549+0000","last_became_active":"2023-12-22T08:39:58.626043+0000","last_became_peered":"2023-12-22T08:39:58.626043+0000","last_unstale":"2023-12-22T08:39:58.627549+0000","last_undegraded":"2023-12-22T08:39:58.627549+0000","last_fullsized":"2023-12-22T08:39:58.627549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639910+0000","last_change":"2023-12-22T08:39:58.638489+0000","last_active":"2023-12-22T08:39:58.639910+0000","last_peered":"2023-12-22T08:39:58.639910+0000","last_clean":"2023-12-22T08:39:58.639910+0000","last_became_active":"2023-12-22T08:39:58.638260+0000","last_became_peered":"2023-12-22T08:39:58.638260+0000","last_unstale":"2023-12-22T08:39:58.639910+0000","last_undegraded":"2023-12-22T08:39:58.639910+0000","last_fullsized":"2023-12-22T08:39:58.639910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628825+0000","last_change":"2023-12-22T08:39:58.628717+0000","last_active":"2023-12-22T08:39:58.628825+0000","last_peered":"2023-12-22T08:39:58.628825+0000","last_clean":"2023-12-22T08:39:58.628825+0000","last_became_active":"2023-12-22T08:39:58.628336+0000","last_became_peered":"2023-12-22T08:39:58.628336+0000","last_unstale":"2023-12-22T08:39:58.628825+0000","last_undegraded":"2023-12-22T08:39:58.628825+0000","last_fullsized":"2023-12-22T08:39:58.628825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.638316+0000","last_change":"2023-12-22T08:39:58.118326+0000","last_active":"2023-12-22T08:39:58.638316+0000","last_peered":"2023-12-22T08:39:58.638316+0000","last_clean":"2023-12-22T08:39:58.638316+0000","last_became_active":"2023-12-22T08:39:58.117693+0000","last_became_peered":"2023-12-22T08:39:58.117693+0000","last_unstale":"2023-12-22T08:39:58.638316+0000","last_undegraded":"2023-12-22T08:39:58.638316+0000","last_fullsized":"2023-12-22T08:39:58.638316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639287+0000","last_change":"2023-12-22T08:39:58.637716+0000","last_active":"2023-12-22T08:39:58.639287+0000","last_peered":"2023-12-22T08:39:58.639287+0000","last_clean":"2023-12-22T08:39:58.639287+0000","last_became_active":"2023-12-22T08:39:58.637494+0000","last_became_peered":"2023-12-22T08:39:58.637494+0000","last_unstale":"2023-12-22T08:39:58.639287+0000","last_undegraded":"2023-12-22T08:39:58.639287+0000","last_fullsized":"2023-12-22T08:39:58.639287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642478+0000","last_change":"2023-12-22T08:39:58.124015+0000","last_active":"2023-12-22T08:39:58.642478+0000","last_peered":"2023-12-22T08:39:58.642478+0000","last_clean":"2023-12-22T08:39:58.642478+0000","last_became_active":"2023-12-22T08:39:58.123750+0000","last_became_peered":"2023-12-22T08:39:58.123750+0000","last_unstale":"2023-12-22T08:39:58.642478+0000","last_undegraded":"2023-12-22T08:39:58.642478+0000","last_fullsized":"2023-12-22T08:39:58.642478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:32.352283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631688+0000","last_change":"2023-12-22T08:39:58.126588+0000","last_active":"2023-12-22T08:39:58.631688+0000","last_peered":"2023-12-22T08:39:58.631688+0000","last_clean":"2023-12-22T08:39:58.631688+0000","last_became_active":"2023-12-22T08:39:58.126277+0000","last_became_peered":"2023-12-22T08:39:58.126277+0000","last_unstale":"2023-12-22T08:39:58.631688+0000","last_undegraded":"2023-12-22T08:39:58.631688+0000","last_fullsized":"2023-12-22T08:39:58.631688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631434+0000","last_change":"2023-12-22T08:39:58.631377+0000","last_active":"2023-12-22T08:39:58.631434+0000","last_peered":"2023-12-22T08:39:58.631434+0000","last_clean":"2023-12-22T08:39:58.631434+0000","last_became_active":"2023-12-22T08:39:58.630993+0000","last_became_peered":"2023-12-22T08:39:58.630993+0000","last_unstale":"2023-12-22T08:39:58.631434+0000","last_undegraded":"2023-12-22T08:39:58.631434+0000","last_fullsized":"2023-12-22T08:39:58.631434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:26:26.790794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.612908+0000","last_change":"2023-12-22T08:39:58.129064+0000","last_active":"2023-12-22T08:39:58.612908+0000","last_peered":"2023-12-22T08:39:58.612908+0000","last_clean":"2023-12-22T08:39:58.612908+0000","last_became_active":"2023-12-22T08:39:58.127921+0000","last_became_peered":"2023-12-22T08:39:58.127921+0000","last_unstale":"2023-12-22T08:39:58.612908+0000","last_undegraded":"2023-12-22T08:39:58.612908+0000","last_fullsized":"2023-12-22T08:39:58.612908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632098+0000","last_change":"2023-12-22T08:39:58.631767+0000","last_active":"2023-12-22T08:39:58.632098+0000","last_peered":"2023-12-22T08:39:58.632098+0000","last_clean":"2023-12-22T08:39:58.632098+0000","last_became_active":"2023-12-22T08:39:58.629195+0000","last_became_peered":"2023-12-22T08:39:58.629195+0000","last_unstale":"2023-12-22T08:39:58.632098+0000","last_undegraded":"2023-12-22T08:39:58.632098+0000","last_fullsized":"2023-12-22T08:39:58.632098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.620316+0000","last_change":"2023-12-22T08:39:58.128425+0000","last_active":"2023-12-22T08:39:58.620316+0000","last_peered":"2023-12-22T08:39:58.620316+0000","last_clean":"2023-12-22T08:39:58.620316+0000","last_became_active":"2023-12-22T08:39:58.128139+0000","last_became_peered":"2023-12-22T08:39:58.128139+0000","last_unstale":"2023-12-22T08:39:58.620316+0000","last_undegraded":"2023-12-22T08:39:58.620316+0000","last_fullsized":"2023-12-22T08:39:58.620316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628459+0000","last_change":"2023-12-22T08:39:58.628264+0000","last_active":"2023-12-22T08:39:58.628459+0000","last_peered":"2023-12-22T08:39:58.628459+0000","last_clean":"2023-12-22T08:39:58.628459+0000","last_became_active":"2023-12-22T08:39:58.627878+0000","last_became_peered":"2023-12-22T08:39:58.627878+0000","last_unstale":"2023-12-22T08:39:58.628459+0000","last_undegraded":"2023-12-22T08:39:58.628459+0000","last_fullsized":"2023-12-22T08:39:58.628459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626441+0000","last_change":"2023-12-22T08:39:58.123417+0000","last_active":"2023-12-22T08:39:58.626441+0000","last_peered":"2023-12-22T08:39:58.626441+0000","last_clean":"2023-12-22T08:39:58.626441+0000","last_became_active":"2023-12-22T08:39:58.122926+0000","last_became_peered":"2023-12-22T08:39:58.122926+0000","last_unstale":"2023-12-22T08:39:58.626441+0000","last_undegraded":"2023-12-22T08:39:58.626441+0000","last_fullsized":"2023-12-22T08:39:58.626441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.616535+0000","last_change":"2023-12-22T08:39:58.616456+0000","last_active":"2023-12-22T08:39:58.616535+0000","last_peered":"2023-12-22T08:39:58.616535+0000","last_clean":"2023-12-22T08:39:58.616535+0000","last_became_active":"2023-12-22T08:39:58.616235+0000","last_became_peered":"2023-12-22T08:39:58.616235+0000","last_unstale":"2023-12-22T08:39:58.616535+0000","last_undegraded":"2023-12-22T08:39:58.616535+0000","last_fullsized":"2023-12-22T08:39:58.616535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:37.333505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635460+0000","last_change":"2023-12-22T08:39:58.129066+0000","last_active":"2023-12-22T08:39:58.635460+0000","last_peered":"2023-12-22T08:39:58.635460+0000","last_clean":"2023-12-22T08:39:58.635460+0000","last_became_active":"2023-12-22T08:39:58.128536+0000","last_became_peered":"2023-12-22T08:39:58.128536+0000","last_unstale":"2023-12-22T08:39:58.635460+0000","last_undegraded":"2023-12-22T08:39:58.635460+0000","last_fullsized":"2023-12-22T08:39:58.635460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629952+0000","last_change":"2023-12-22T08:39:58.629869+0000","last_active":"2023-12-22T08:39:58.629952+0000","last_peered":"2023-12-22T08:39:58.629952+0000","last_clean":"2023-12-22T08:39:58.629952+0000","last_became_active":"2023-12-22T08:39:58.629618+0000","last_became_peered":"2023-12-22T08:39:58.629618+0000","last_unstale":"2023-12-22T08:39:58.629952+0000","last_undegraded":"2023-12-22T08:39:58.629952+0000","last_fullsized":"2023-12-22T08:39:58.629952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:24:34.120013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642495+0000","last_change":"2023-12-22T08:39:58.126247+0000","last_active":"2023-12-22T08:39:58.642495+0000","last_peered":"2023-12-22T08:39:58.642495+0000","last_clean":"2023-12-22T08:39:58.642495+0000","last_became_active":"2023-12-22T08:39:58.125863+0000","last_became_peered":"2023-12-22T08:39:58.125863+0000","last_unstale":"2023-12-22T08:39:58.642495+0000","last_undegraded":"2023-12-22T08:39:58.642495+0000","last_fullsized":"2023-12-22T08:39:58.642495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641409+0000","last_change":"2023-12-22T08:39:58.641015+0000","last_active":"2023-12-22T08:39:58.641409+0000","last_peered":"2023-12-22T08:39:58.641409+0000","last_clean":"2023-12-22T08:39:58.641409+0000","last_became_active":"2023-12-22T08:39:58.640705+0000","last_became_peered":"2023-12-22T08:39:58.640705+0000","last_unstale":"2023-12-22T08:39:58.641409+0000","last_undegraded":"2023-12-22T08:39:58.641409+0000","last_fullsized":"2023-12-22T08:39:58.641409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642932+0000","last_change":"2023-12-22T08:39:58.123764+0000","last_active":"2023-12-22T08:39:58.642932+0000","last_peered":"2023-12-22T08:39:58.642932+0000","last_clean":"2023-12-22T08:39:58.642932+0000","last_became_active":"2023-12-22T08:39:58.123431+0000","last_became_peered":"2023-12-22T08:39:58.123431+0000","last_unstale":"2023-12-22T08:39:58.642932+0000","last_undegraded":"2023-12-22T08:39:58.642932+0000","last_fullsized":"2023-12-22T08:39:58.642932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634178+0000","last_change":"2023-12-22T08:39:58.634043+0000","last_active":"2023-12-22T08:39:58.634178+0000","last_peered":"2023-12-22T08:39:58.634178+0000","last_clean":"2023-12-22T08:39:58.634178+0000","last_became_active":"2023-12-22T08:39:58.633774+0000","last_became_peered":"2023-12-22T08:39:58.633774+0000","last_unstale":"2023-12-22T08:39:58.634178+0000","last_undegraded":"2023-12-22T08:39:58.634178+0000","last_fullsized":"2023-12-22T08:39:58.634178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.614467+0000","last_change":"2023-12-22T08:39:58.124254+0000","last_active":"2023-12-22T08:39:58.614467+0000","last_peered":"2023-12-22T08:39:58.614467+0000","last_clean":"2023-12-22T08:39:58.614467+0000","last_became_active":"2023-12-22T08:39:58.123937+0000","last_became_peered":"2023-12-22T08:39:58.123937+0000","last_unstale":"2023-12-22T08:39:58.614467+0000","last_undegraded":"2023-12-22T08:39:58.614467+0000","last_fullsized":"2023-12-22T08:39:58.614467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.644230+0000","last_change":"2023-12-22T08:39:58.644158+0000","last_active":"2023-12-22T08:39:58.644230+0000","last_peered":"2023-12-22T08:39:58.644230+0000","last_clean":"2023-12-22T08:39:58.644230+0000","last_became_active":"2023-12-22T08:39:58.643919+0000","last_became_peered":"2023-12-22T08:39:58.643919+0000","last_unstale":"2023-12-22T08:39:58.644230+0000","last_undegraded":"2023-12-22T08:39:58.644230+0000","last_fullsized":"2023-12-22T08:39:58.644230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:16.702062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626541+0000","last_change":"2023-12-22T08:39:58.130462+0000","last_active":"2023-12-22T08:39:58.626541+0000","last_peered":"2023-12-22T08:39:58.626541+0000","last_clean":"2023-12-22T08:39:58.626541+0000","last_became_active":"2023-12-22T08:39:58.130246+0000","last_became_peered":"2023-12-22T08:39:58.130246+0000","last_unstale":"2023-12-22T08:39:58.626541+0000","last_undegraded":"2023-12-22T08:39:58.626541+0000","last_fullsized":"2023-12-22T08:39:58.626541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628811+0000","last_change":"2023-12-22T08:39:58.628587+0000","last_active":"2023-12-22T08:39:58.628811+0000","last_peered":"2023-12-22T08:39:58.628811+0000","last_clean":"2023-12-22T08:39:58.628811+0000","last_became_active":"2023-12-22T08:39:58.626918+0000","last_became_peered":"2023-12-22T08:39:58.626918+0000","last_unstale":"2023-12-22T08:39:58.628811+0000","last_undegraded":"2023-12-22T08:39:58.628811+0000","last_fullsized":"2023-12-22T08:39:58.628811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641108+0000","last_change":"2023-12-22T08:39:58.127791+0000","last_active":"2023-12-22T08:39:58.641108+0000","last_peered":"2023-12-22T08:39:58.641108+0000","last_clean":"2023-12-22T08:39:58.641108+0000","last_became_active":"2023-12-22T08:39:58.126674+0000","last_became_peered":"2023-12-22T08:39:58.126674+0000","last_unstale":"2023-12-22T08:39:58.641108+0000","last_undegraded":"2023-12-22T08:39:58.641108+0000","last_fullsized":"2023-12-22T08:39:58.641108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632387+0000","last_change":"2023-12-22T08:39:58.631847+0000","last_active":"2023-12-22T08:39:58.632387+0000","last_peered":"2023-12-22T08:39:58.632387+0000","last_clean":"2023-12-22T08:39:58.632387+0000","last_became_active":"2023-12-22T08:39:58.631202+0000","last_became_peered":"2023-12-22T08:39:58.631202+0000","last_unstale":"2023-12-22T08:39:58.632387+0000","last_undegraded":"2023-12-22T08:39:58.632387+0000","last_fullsized":"2023-12-22T08:39:58.632387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:53:42.342046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643020+0000","last_change":"2023-12-22T08:39:58.131328+0000","last_active":"2023-12-22T08:39:58.643020+0000","last_peered":"2023-12-22T08:39:58.643020+0000","last_clean":"2023-12-22T08:39:58.643020+0000","last_became_active":"2023-12-22T08:39:58.131102+0000","last_became_peered":"2023-12-22T08:39:58.131102+0000","last_unstale":"2023-12-22T08:39:58.643020+0000","last_undegraded":"2023-12-22T08:39:58.643020+0000","last_fullsized":"2023-12-22T08:39:58.643020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.644219+0000","last_change":"2023-12-22T08:39:58.644149+0000","last_active":"2023-12-22T08:39:58.644219+0000","last_peered":"2023-12-22T08:39:58.644219+0000","last_clean":"2023-12-22T08:39:58.644219+0000","last_became_active":"2023-12-22T08:39:58.643782+0000","last_became_peered":"2023-12-22T08:39:58.643782+0000","last_unstale":"2023-12-22T08:39:58.644219+0000","last_undegraded":"2023-12-22T08:39:58.644219+0000","last_fullsized":"2023-12-22T08:39:58.644219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639405+0000","last_change":"2023-12-22T08:39:58.128619+0000","last_active":"2023-12-22T08:39:58.639405+0000","last_peered":"2023-12-22T08:39:58.639405+0000","last_clean":"2023-12-22T08:39:58.639405+0000","last_became_active":"2023-12-22T08:39:58.128357+0000","last_became_peered":"2023-12-22T08:39:58.128357+0000","last_unstale":"2023-12-22T08:39:58.639405+0000","last_undegraded":"2023-12-22T08:39:58.639405+0000","last_fullsized":"2023-12-22T08:39:58.639405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634241+0000","last_change":"2023-12-22T08:39:58.633374+0000","last_active":"2023-12-22T08:39:58.634241+0000","last_peered":"2023-12-22T08:39:58.634241+0000","last_clean":"2023-12-22T08:39:58.634241+0000","last_became_active":"2023-12-22T08:39:58.633140+0000","last_became_peered":"2023-12-22T08:39:58.633140+0000","last_unstale":"2023-12-22T08:39:58.634241+0000","last_undegraded":"2023-12-22T08:39:58.634241+0000","last_fullsized":"2023-12-22T08:39:58.634241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632780+0000","last_change":"2023-12-22T08:39:58.124679+0000","last_active":"2023-12-22T08:39:58.632780+0000","last_peered":"2023-12-22T08:39:58.632780+0000","last_clean":"2023-12-22T08:39:58.632780+0000","last_became_active":"2023-12-22T08:39:58.124446+0000","last_became_peered":"2023-12-22T08:39:58.124446+0000","last_unstale":"2023-12-22T08:39:58.632780+0000","last_undegraded":"2023-12-22T08:39:58.632780+0000","last_fullsized":"2023-12-22T08:39:58.632780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635014+0000","last_change":"2023-12-22T08:39:58.634622+0000","last_active":"2023-12-22T08:39:58.635014+0000","last_peered":"2023-12-22T08:39:58.635014+0000","last_clean":"2023-12-22T08:39:58.635014+0000","last_became_active":"2023-12-22T08:39:58.627769+0000","last_became_peered":"2023-12-22T08:39:58.627769+0000","last_unstale":"2023-12-22T08:39:58.635014+0000","last_undegraded":"2023-12-22T08:39:58.635014+0000","last_fullsized":"2023-12-22T08:39:58.635014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625945+0000","last_change":"2023-12-22T08:39:58.125976+0000","last_active":"2023-12-22T08:39:58.625945+0000","last_peered":"2023-12-22T08:39:58.625945+0000","last_clean":"2023-12-22T08:39:58.625945+0000","last_became_active":"2023-12-22T08:39:58.125728+0000","last_became_peered":"2023-12-22T08:39:58.125728+0000","last_unstale":"2023-12-22T08:39:58.625945+0000","last_undegraded":"2023-12-22T08:39:58.625945+0000","last_fullsized":"2023-12-22T08:39:58.625945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623852+0000","last_change":"2023-12-22T08:39:58.623592+0000","last_active":"2023-12-22T08:39:58.623852+0000","last_peered":"2023-12-22T08:39:58.623852+0000","last_clean":"2023-12-22T08:39:58.623852+0000","last_became_active":"2023-12-22T08:39:58.623129+0000","last_became_peered":"2023-12-22T08:39:58.623129+0000","last_unstale":"2023-12-22T08:39:58.623852+0000","last_undegraded":"2023-12-22T08:39:58.623852+0000","last_fullsized":"2023-12-22T08:39:58.623852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.618653+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:39:58.618653+0000","last_peered":"2023-12-22T08:39:58.618653+0000","last_clean":"2023-12-22T08:39:58.618653+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:39:58.618653+0000","last_undegraded":"2023-12-22T08:39:58.618653+0000","last_fullsized":"2023-12-22T08:39:58.618653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.614777+0000","last_change":"2023-12-22T08:39:58.128257+0000","last_active":"2023-12-22T08:39:58.614777+0000","last_peered":"2023-12-22T08:39:58.614777+0000","last_clean":"2023-12-22T08:39:58.614777+0000","last_became_active":"2023-12-22T08:39:58.127185+0000","last_became_peered":"2023-12-22T08:39:58.127185+0000","last_unstale":"2023-12-22T08:39:58.614777+0000","last_undegraded":"2023-12-22T08:39:58.614777+0000","last_fullsized":"2023-12-22T08:39:58.614777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:34.256489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630391+0000","last_change":"2023-12-22T08:39:58.630318+0000","last_active":"2023-12-22T08:39:58.630391+0000","last_peered":"2023-12-22T08:39:58.630391+0000","last_clean":"2023-12-22T08:39:58.630391+0000","last_became_active":"2023-12-22T08:39:58.630077+0000","last_became_peered":"2023-12-22T08:39:58.630077+0000","last_unstale":"2023-12-22T08:39:58.630391+0000","last_undegraded":"2023-12-22T08:39:58.630391+0000","last_fullsized":"2023-12-22T08:39:58.630391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.616306+0000","last_change":"2023-12-22T08:39:58.109900+0000","last_active":"2023-12-22T08:39:58.616306+0000","last_peered":"2023-12-22T08:39:58.616306+0000","last_clean":"2023-12-22T08:39:58.616306+0000","last_became_active":"2023-12-22T08:39:58.109127+0000","last_became_peered":"2023-12-22T08:39:58.109127+0000","last_unstale":"2023-12-22T08:39:58.616306+0000","last_undegraded":"2023-12-22T08:39:58.616306+0000","last_fullsized":"2023-12-22T08:39:58.616306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635903+0000","last_change":"2023-12-22T08:39:58.635825+0000","last_active":"2023-12-22T08:39:58.635903+0000","last_peered":"2023-12-22T08:39:58.635903+0000","last_clean":"2023-12-22T08:39:58.635903+0000","last_became_active":"2023-12-22T08:39:58.635203+0000","last_became_peered":"2023-12-22T08:39:58.635203+0000","last_unstale":"2023-12-22T08:39:58.635903+0000","last_undegraded":"2023-12-22T08:39:58.635903+0000","last_fullsized":"2023-12-22T08:39:58.635903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.617739+0000","last_change":"2023-12-22T08:39:58.128822+0000","last_active":"2023-12-22T08:39:58.617739+0000","last_peered":"2023-12-22T08:39:58.617739+0000","last_clean":"2023-12-22T08:39:58.617739+0000","last_became_active":"2023-12-22T08:39:58.128142+0000","last_became_peered":"2023-12-22T08:39:58.128142+0000","last_unstale":"2023-12-22T08:39:58.617739+0000","last_undegraded":"2023-12-22T08:39:58.617739+0000","last_fullsized":"2023-12-22T08:39:58.617739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619266+0000","last_change":"2023-12-22T08:39:58.618953+0000","last_active":"2023-12-22T08:39:58.619266+0000","last_peered":"2023-12-22T08:39:58.619266+0000","last_clean":"2023-12-22T08:39:58.619266+0000","last_became_active":"2023-12-22T08:39:58.618178+0000","last_became_peered":"2023-12-22T08:39:58.618178+0000","last_unstale":"2023-12-22T08:39:58.619266+0000","last_undegraded":"2023-12-22T08:39:58.619266+0000","last_fullsized":"2023-12-22T08:39:58.619266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.612537+0000","last_change":"2023-12-22T08:39:58.109274+0000","last_active":"2023-12-22T08:39:58.612537+0000","last_peered":"2023-12-22T08:39:58.612537+0000","last_clean":"2023-12-22T08:39:58.612537+0000","last_became_active":"2023-12-22T08:39:58.108715+0000","last_became_peered":"2023-12-22T08:39:58.108715+0000","last_unstale":"2023-12-22T08:39:58.612537+0000","last_undegraded":"2023-12-22T08:39:58.612537+0000","last_fullsized":"2023-12-22T08:39:58.612537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641249+0000","last_change":"2023-12-22T08:39:58.640517+0000","last_active":"2023-12-22T08:39:58.641249+0000","last_peered":"2023-12-22T08:39:58.641249+0000","last_clean":"2023-12-22T08:39:58.641249+0000","last_became_active":"2023-12-22T08:39:58.640288+0000","last_became_peered":"2023-12-22T08:39:58.640288+0000","last_unstale":"2023-12-22T08:39:58.641249+0000","last_undegraded":"2023-12-22T08:39:58.641249+0000","last_fullsized":"2023-12-22T08:39:58.641249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.611243+0000","last_change":"2023-12-22T08:39:58.127367+0000","last_active":"2023-12-22T08:39:58.611243+0000","last_peered":"2023-12-22T08:39:58.611243+0000","last_clean":"2023-12-22T08:39:58.611243+0000","last_became_active":"2023-12-22T08:39:58.124150+0000","last_became_peered":"2023-12-22T08:39:58.124150+0000","last_unstale":"2023-12-22T08:39:58.611243+0000","last_undegraded":"2023-12-22T08:39:58.611243+0000","last_fullsized":"2023-12-22T08:39:58.611243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.636519+0000","last_change":"2023-12-22T08:39:58.636058+0000","last_active":"2023-12-22T08:39:58.636519+0000","last_peered":"2023-12-22T08:39:58.636519+0000","last_clean":"2023-12-22T08:39:58.636519+0000","last_became_active":"2023-12-22T08:39:58.635817+0000","last_became_peered":"2023-12-22T08:39:58.635817+0000","last_unstale":"2023-12-22T08:39:58.636519+0000","last_undegraded":"2023-12-22T08:39:58.636519+0000","last_fullsized":"2023-12-22T08:39:58.636519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.615958+0000","last_change":"2023-12-22T08:39:58.128760+0000","last_active":"2023-12-22T08:39:58.615958+0000","last_peered":"2023-12-22T08:39:58.615958+0000","last_clean":"2023-12-22T08:39:58.615958+0000","last_became_active":"2023-12-22T08:39:58.128499+0000","last_became_peered":"2023-12-22T08:39:58.128499+0000","last_unstale":"2023-12-22T08:39:58.615958+0000","last_undegraded":"2023-12-22T08:39:58.615958+0000","last_fullsized":"2023-12-22T08:39:58.615958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:15.265494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633467+0000","last_change":"2023-12-22T08:39:58.630593+0000","last_active":"2023-12-22T08:39:58.633467+0000","last_peered":"2023-12-22T08:39:58.633467+0000","last_clean":"2023-12-22T08:39:58.633467+0000","last_became_active":"2023-12-22T08:39:58.629117+0000","last_became_peered":"2023-12-22T08:39:58.629117+0000","last_unstale":"2023-12-22T08:39:58.633467+0000","last_undegraded":"2023-12-22T08:39:58.633467+0000","last_fullsized":"2023-12-22T08:39:58.633467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.620856+0000","last_change":"2023-12-22T08:39:58.129601+0000","last_active":"2023-12-22T08:39:58.620856+0000","last_peered":"2023-12-22T08:39:58.620856+0000","last_clean":"2023-12-22T08:39:58.620856+0000","last_became_active":"2023-12-22T08:39:58.129236+0000","last_became_peered":"2023-12-22T08:39:58.129236+0000","last_unstale":"2023-12-22T08:39:58.620856+0000","last_undegraded":"2023-12-22T08:39:58.620856+0000","last_fullsized":"2023-12-22T08:39:58.620856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639661+0000","last_change":"2023-12-22T08:39:58.639582+0000","last_active":"2023-12-22T08:39:58.639661+0000","last_peered":"2023-12-22T08:39:58.639661+0000","last_clean":"2023-12-22T08:39:58.639661+0000","last_became_active":"2023-12-22T08:39:58.638759+0000","last_became_peered":"2023-12-22T08:39:58.638759+0000","last_unstale":"2023-12-22T08:39:58.639661+0000","last_undegraded":"2023-12-22T08:39:58.639661+0000","last_fullsized":"2023-12-22T08:39:58.639661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642267+0000","last_change":"2023-12-22T08:39:58.127199+0000","last_active":"2023-12-22T08:39:58.642267+0000","last_peered":"2023-12-22T08:39:58.642267+0000","last_clean":"2023-12-22T08:39:58.642267+0000","last_became_active":"2023-12-22T08:39:58.126735+0000","last_became_peered":"2023-12-22T08:39:58.126735+0000","last_unstale":"2023-12-22T08:39:58.642267+0000","last_undegraded":"2023-12-22T08:39:58.642267+0000","last_fullsized":"2023-12-22T08:39:58.642267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:12.048994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.627309+0000","last_change":"2023-12-22T08:39:58.627233+0000","last_active":"2023-12-22T08:39:58.627309+0000","last_peered":"2023-12-22T08:39:58.627309+0000","last_clean":"2023-12-22T08:39:58.627309+0000","last_became_active":"2023-12-22T08:39:58.626937+0000","last_became_peered":"2023-12-22T08:39:58.626937+0000","last_unstale":"2023-12-22T08:39:58.627309+0000","last_undegraded":"2023-12-22T08:39:58.627309+0000","last_fullsized":"2023-12-22T08:39:58.627309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625536+0000","last_change":"2023-12-22T08:39:58.125513+0000","last_active":"2023-12-22T08:39:58.625536+0000","last_peered":"2023-12-22T08:39:58.625536+0000","last_clean":"2023-12-22T08:39:58.625536+0000","last_became_active":"2023-12-22T08:39:58.125286+0000","last_became_peered":"2023-12-22T08:39:58.125286+0000","last_unstale":"2023-12-22T08:39:58.625536+0000","last_undegraded":"2023-12-22T08:39:58.625536+0000","last_fullsized":"2023-12-22T08:39:58.625536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623822+0000","last_change":"2023-12-22T08:39:58.622884+0000","last_active":"2023-12-22T08:39:58.623822+0000","last_peered":"2023-12-22T08:39:58.623822+0000","last_clean":"2023-12-22T08:39:58.623822+0000","last_became_active":"2023-12-22T08:39:58.622531+0000","last_became_peered":"2023-12-22T08:39:58.622531+0000","last_unstale":"2023-12-22T08:39:58.623822+0000","last_undegraded":"2023-12-22T08:39:58.623822+0000","last_fullsized":"2023-12-22T08:39:58.623822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:01.993745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.620792+0000","last_change":"2023-12-22T08:39:58.127163+0000","last_active":"2023-12-22T08:39:58.620792+0000","last_peered":"2023-12-22T08:39:58.620792+0000","last_clean":"2023-12-22T08:39:58.620792+0000","last_became_active":"2023-12-22T08:39:58.125842+0000","last_became_peered":"2023-12-22T08:39:58.125842+0000","last_unstale":"2023-12-22T08:39:58.620792+0000","last_undegraded":"2023-12-22T08:39:58.620792+0000","last_fullsized":"2023-12-22T08:39:58.620792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629967+0000","last_change":"2023-12-22T08:39:58.628998+0000","last_active":"2023-12-22T08:39:58.629967+0000","last_peered":"2023-12-22T08:39:58.629967+0000","last_clean":"2023-12-22T08:39:58.629967+0000","last_became_active":"2023-12-22T08:39:58.628022+0000","last_became_peered":"2023-12-22T08:39:58.628022+0000","last_unstale":"2023-12-22T08:39:58.629967+0000","last_undegraded":"2023-12-22T08:39:58.629967+0000","last_fullsized":"2023-12-22T08:39:58.629967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631814+0000","last_change":"2023-12-22T08:39:58.129742+0000","last_active":"2023-12-22T08:39:58.631814+0000","last_peered":"2023-12-22T08:39:58.631814+0000","last_clean":"2023-12-22T08:39:58.631814+0000","last_became_active":"2023-12-22T08:39:58.129522+0000","last_became_peered":"2023-12-22T08:39:58.129522+0000","last_unstale":"2023-12-22T08:39:58.631814+0000","last_undegraded":"2023-12-22T08:39:58.631814+0000","last_fullsized":"2023-12-22T08:39:58.631814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.636842+0000","last_change":"2023-12-22T08:39:58.636766+0000","last_active":"2023-12-22T08:39:58.636842+0000","last_peered":"2023-12-22T08:39:58.636842+0000","last_clean":"2023-12-22T08:39:58.636842+0000","last_became_active":"2023-12-22T08:39:58.636550+0000","last_became_peered":"2023-12-22T08:39:58.636550+0000","last_unstale":"2023-12-22T08:39:58.636842+0000","last_undegraded":"2023-12-22T08:39:58.636842+0000","last_fullsized":"2023-12-22T08:39:58.636842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.637828+0000","last_change":"2023-12-22T08:39:58.128411+0000","last_active":"2023-12-22T08:39:58.637828+0000","last_peered":"2023-12-22T08:39:58.637828+0000","last_clean":"2023-12-22T08:39:58.637828+0000","last_became_active":"2023-12-22T08:39:58.127849+0000","last_became_peered":"2023-12-22T08:39:58.127849+0000","last_unstale":"2023-12-22T08:39:58.637828+0000","last_undegraded":"2023-12-22T08:39:58.637828+0000","last_fullsized":"2023-12-22T08:39:58.637828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:25.721681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.624467+0000","last_change":"2023-12-22T08:39:58.624131+0000","last_active":"2023-12-22T08:39:58.624467+0000","last_peered":"2023-12-22T08:39:58.624467+0000","last_clean":"2023-12-22T08:39:58.624467+0000","last_became_active":"2023-12-22T08:39:58.621786+0000","last_became_peered":"2023-12-22T08:39:58.621786+0000","last_unstale":"2023-12-22T08:39:58.624467+0000","last_undegraded":"2023-12-22T08:39:58.624467+0000","last_fullsized":"2023-12-22T08:39:58.624467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642965+0000","last_change":"2023-12-22T08:39:58.642425+0000","last_active":"2023-12-22T08:39:58.642965+0000","last_peered":"2023-12-22T08:39:58.642965+0000","last_clean":"2023-12-22T08:39:58.642965+0000","last_became_active":"2023-12-22T08:39:58.642201+0000","last_became_peered":"2023-12-22T08:39:58.642201+0000","last_unstale":"2023-12-22T08:39:58.642965+0000","last_undegraded":"2023-12-22T08:39:58.642965+0000","last_fullsized":"2023-12-22T08:39:58.642965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:35.423369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643104+0000","last_change":"2023-12-22T08:39:58.124586+0000","last_active":"2023-12-22T08:39:58.643104+0000","last_peered":"2023-12-22T08:39:58.643104+0000","last_clean":"2023-12-22T08:39:58.643104+0000","last_became_active":"2023-12-22T08:39:58.123428+0000","last_became_peered":"2023-12-22T08:39:58.123428+0000","last_unstale":"2023-12-22T08:39:58.643104+0000","last_undegraded":"2023-12-22T08:39:58.643104+0000","last_fullsized":"2023-12-22T08:39:58.643104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630950+0000","last_change":"2023-12-22T08:39:58.630694+0000","last_active":"2023-12-22T08:39:58.630950+0000","last_peered":"2023-12-22T08:39:58.630950+0000","last_clean":"2023-12-22T08:39:58.630950+0000","last_became_active":"2023-12-22T08:39:58.630420+0000","last_became_peered":"2023-12-22T08:39:58.630420+0000","last_unstale":"2023-12-22T08:39:58.630950+0000","last_undegraded":"2023-12-22T08:39:58.630950+0000","last_fullsized":"2023-12-22T08:39:58.630950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.645513+0000","last_change":"2023-12-22T08:39:58.129551+0000","last_active":"2023-12-22T08:39:58.645513+0000","last_peered":"2023-12-22T08:39:58.645513+0000","last_clean":"2023-12-22T08:39:58.645513+0000","last_became_active":"2023-12-22T08:39:58.129237+0000","last_became_peered":"2023-12-22T08:39:58.129237+0000","last_unstale":"2023-12-22T08:39:58.645513+0000","last_undegraded":"2023-12-22T08:39:58.645513+0000","last_fullsized":"2023-12-22T08:39:58.645513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623969+0000","last_change":"2023-12-22T08:39:58.623889+0000","last_active":"2023-12-22T08:39:58.623969+0000","last_peered":"2023-12-22T08:39:58.623969+0000","last_clean":"2023-12-22T08:39:58.623969+0000","last_became_active":"2023-12-22T08:39:58.621334+0000","last_became_peered":"2023-12-22T08:39:58.621334+0000","last_unstale":"2023-12-22T08:39:58.623969+0000","last_undegraded":"2023-12-22T08:39:58.623969+0000","last_fullsized":"2023-12-22T08:39:58.623969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:58:42.417309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633418+0000","last_change":"2023-12-22T08:39:58.127899+0000","last_active":"2023-12-22T08:39:58.633418+0000","last_peered":"2023-12-22T08:39:58.633418+0000","last_clean":"2023-12-22T08:39:58.633418+0000","last_became_active":"2023-12-22T08:39:58.126733+0000","last_became_peered":"2023-12-22T08:39:58.126733+0000","last_unstale":"2023-12-22T08:39:58.633418+0000","last_undegraded":"2023-12-22T08:39:58.633418+0000","last_fullsized":"2023-12-22T08:39:58.633418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623951+0000","last_change":"2023-12-22T08:39:58.623648+0000","last_active":"2023-12-22T08:39:58.623951+0000","last_peered":"2023-12-22T08:39:58.623951+0000","last_clean":"2023-12-22T08:39:58.623951+0000","last_became_active":"2023-12-22T08:39:58.623415+0000","last_became_peered":"2023-12-22T08:39:58.623415+0000","last_unstale":"2023-12-22T08:39:58.623951+0000","last_undegraded":"2023-12-22T08:39:58.623951+0000","last_fullsized":"2023-12-22T08:39:58.623951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639516+0000","last_change":"2023-12-22T08:39:58.130439+0000","last_active":"2023-12-22T08:39:58.639516+0000","last_peered":"2023-12-22T08:39:58.639516+0000","last_clean":"2023-12-22T08:39:58.639516+0000","last_became_active":"2023-12-22T08:39:58.130196+0000","last_became_peered":"2023-12-22T08:39:58.130196+0000","last_unstale":"2023-12-22T08:39:58.639516+0000","last_undegraded":"2023-12-22T08:39:58.639516+0000","last_fullsized":"2023-12-22T08:39:58.639516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.536}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7270000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194667,"statfs":{"total":200000000,"available":199339821,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.798}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5880000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6279999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.79}]}]}],"pool_statfs":[]}} 2023-12-22T08:40:08.670 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:40:08.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.906+0000 7f1304992640 1 Processor -- start 2023-12-22T08:40:08.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.906+0000 7f1304992640 1 -- start start 2023-12-22T08:40:08.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.908+0000 7f1304992640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f13000b3f90 0x7f130015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:08.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.908+0000 7f1304992640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130015eb20 con 0x7f130006ca50 2023-12-22T08:40:08.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.908+0000 7f1304992640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1300070770 con 0x7f130015e740 2023-12-22T08:40:08.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.908+0000 7f1304992640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130006e650 con 0x7f13000b3f90 2023-12-22T08:40:08.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.908+0000 7f12fed9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f130006ca50 0x7f1300070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51562/0 (socket says 172.21.15.38:51562) 2023-12-22T08:40:08.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.908+0000 7f12fed9d640 1 -- 172.21.15.38:0/2208585728 learned_addr learned my addr 172.21.15.38:0/2208585728 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.908+0000 7f12fdd9b640 1 --2- 172.21.15.38:0/2208585728 >> v2:172.21.15.89:3300/0 conn(0x7f13000b3f90 0x7f130015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.908+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333193967 0 0) 0x7f130015eb20 con 0x7f130006ca50 2023-12-22T08:40:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ec003520 con 0x7f130006ca50 2023-12-22T08:40:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210863350 0 0) 0x7f12ec003520 con 0x7f130006ca50 2023-12-22T08:40:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 >> v2:172.21.15.89:3300/0 conn(0x7f13000b3f90 msgr2=0x7f130015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 --2- 172.21.15.38:0/2208585728 >> v2:172.21.15.89:3300/0 conn(0x7f13000b3f90 0x7f130015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 >> v1:172.21.15.89:6789/0 conn(0x7f130015e740 legacy=0x7f13000b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130006d180 con 0x7f130006ca50 2023-12-22T08:40:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f12f8001670 con 0x7f130006ca50 2023-12-22T08:40:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 >> v1:172.21.15.38:6789/0 conn(0x7f130006ca50 legacy=0x7f1300070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 --2- 172.21.15.38:0/2208585728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ec0039c0 0x7f12ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 --2- 172.21.15.38:0/2208585728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12ec0047c0 0x7f12ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:08.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 --2- 172.21.15.38:0/2208585728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ec0052a0 0x7f12ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:08.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130006e650 con 0x7f12ec0039c0 2023-12-22T08:40:08.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec00c1a0 con 0x7f12ec0052a0 2023-12-22T08:40:08.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec00c360 con 0x7f12ec0047c0 2023-12-22T08:40:08.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.909+0000 7f12fe59c640 1 --2- 172.21.15.38:0/2208585728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ec0039c0 0x7f12ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:08.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.910+0000 7f12fdd9b640 1 --2- 172.21.15.38:0/2208585728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12ec0047c0 0x7f12ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:08.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.910+0000 7f12fed9d640 1 --2- 172.21.15.38:0/2208585728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ec0052a0 0x7f12ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:08.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.910+0000 7f12fe59c640 1 -- 172.21.15.38:0/2208585728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12ec0047c0 msgr2=0x7f12ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:08.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.910+0000 7f12fe59c640 1 --2- 172.21.15.38:0/2208585728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12ec0047c0 0x7f12ec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:08.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.910+0000 7f12fe59c640 1 -- 172.21.15.38:0/2208585728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ec0052a0 msgr2=0x7f12ec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:08.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.910+0000 7f12fe59c640 1 --2- 172.21.15.38:0/2208585728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ec0052a0 0x7f12ec00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:08.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.910+0000 7f12fe59c640 1 -- 172.21.15.38:0/2208585728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec003520 con 0x7f12ec0039c0 2023-12-22T08:40:08.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.910+0000 7f12fed9d640 1 --2- 172.21.15.38:0/2208585728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ec0052a0 0x7f12ec00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:08.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.910+0000 7f12fed9d640 1 -- 172.21.15.38:0/2208585728 reap_dead start 2023-12-22T08:40:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.911+0000 7f12fe59c640 1 --2- 172.21.15.38:0/2208585728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ec0039c0 0x7f12ec003de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f12f0001e50 tx=0x7f12ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6235277f97562e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.911+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0003b70 con 0x7f12ec0039c0 2023-12-22T08:40:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.911+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f0003cd0 con 0x7f12ec0039c0 2023-12-22T08:40:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.911+0000 7f12fd59a640 1 -- 172.21.15.38:0/2208585728 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0005310 con 0x7f12ec0039c0 2023-12-22T08:40:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.912+0000 7f1304992640 1 -- 172.21.15.38:0/2208585728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ec0039c0 msgr2=0x7f12ec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.912+0000 7f1304992640 1 --2- 172.21.15.38:0/2208585728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ec0039c0 0x7f12ec003de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f12f0001e50 tx=0x7f12ec0057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.912+0000 7f1304992640 1 -- 172.21.15.38:0/2208585728 shutdown_connections 2023-12-22T08:40:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.912+0000 7f1304992640 1 --2- 172.21.15.38:0/2208585728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12ec0039c0 0x7f12ec003de0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.912+0000 7f1304992640 1 -- 172.21.15.38:0/2208585728 >> 172.21.15.38:0/2208585728 conn(0x7f13000cfea0 msgr2=0x7f13000d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.912+0000 7f1304992640 1 -- 172.21.15.38:0/2208585728 shutdown_connections 2023-12-22T08:40:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.912+0000 7f1304992640 1 -- 172.21.15.38:0/2208585728 wait complete. 2023-12-22T08:40:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.914+0000 7f1304992640 1 Processor -- start 2023-12-22T08:40:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.914+0000 7f1304992640 1 -- start start 2023-12-22T08:40:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.915+0000 7f1304992640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ec0039c0 0x7f13000b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.915+0000 7f1304992640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13000b6b00 0x7f13000afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.915+0000 7f1304992640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13001581f0 0x7f13000d2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.915+0000 7f1304992640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000b0360 con 0x7f13000b6b00 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.915+0000 7f1304992640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000ac8e0 con 0x7f12ec0039c0 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.915+0000 7f1304992640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13000acbc0 con 0x7f13001581f0 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.915+0000 7f12fdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13000b6b00 0x7f13000afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.915+0000 7f12fdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13000b6b00 0x7f13000afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42304/0 (socket says 172.21.15.38:42304) 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.915+0000 7f12fdd9b640 1 -- 172.21.15.38:0/2768393061 learned_addr learned my addr 172.21.15.38:0/2768393061 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.916+0000 7f12fed9d640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13001581f0 0x7f13000d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.916+0000 7f12fdd9b640 1 -- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13001581f0 msgr2=0x7f13000d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.916+0000 7f12fdd9b640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13001581f0 0x7f13000d2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.916+0000 7f12fdd9b640 1 -- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ec0039c0 msgr2=0x7f13000b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.916+0000 7f12fe59c640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ec0039c0 0x7f13000b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.916+0000 7f12fdd9b640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ec0039c0 0x7f13000b7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.916+0000 7f12fdd9b640 1 -- 172.21.15.38:0/2768393061 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000acea0 con 0x7f13000b6b00 2023-12-22T08:40:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.916+0000 7f12fdd9b640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13000b6b00 0x7f13000afe20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f12e80116d0 tx=0x7f12e8011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.916+0000 7f12f6ffd640 1 -- 172.21.15.38:0/2768393061 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e800f9c0 con 0x7f13000b6b00 2023-12-22T08:40:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.916+0000 7f12f6ffd640 1 -- 172.21.15.38:0/2768393061 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e800fb20 con 0x7f13000b6b00 2023-12-22T08:40:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.916+0000 7f12f6ffd640 1 -- 172.21.15.38:0/2768393061 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e800fe90 con 0x7f13000b6b00 2023-12-22T08:40:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.916+0000 7f1304992640 1 -- 172.21.15.38:0/2768393061 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13000ad180 con 0x7f13000b6b00 2023-12-22T08:40:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.917+0000 7f1304992640 1 -- 172.21.15.38:0/2768393061 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13000ad740 con 0x7f13000b6b00 2023-12-22T08:40:08.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.918+0000 7f1304992640 1 -- 172.21.15.38:0/2768393061 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1300061910 con 0x7f13000b6b00 2023-12-22T08:40:08.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.919+0000 7f12f6ffd640 1 -- 172.21.15.38:0/2768393061 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f12e8015460 con 0x7f13000b6b00 2023-12-22T08:40:08.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.920+0000 7f12f6ffd640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12e006a460 0x7f12e006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:08.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.920+0000 7f12f6ffd640 1 -- 172.21.15.38:0/2768393061 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12e8088dd0 con 0x7f13000b6b00 2023-12-22T08:40:08.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.921+0000 7f12fe59c640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12e006a460 0x7f12e006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:08.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.922+0000 7f12fe59c640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12e006a460 0x7f12e006c920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f12f0034000 tx=0x7f12f0009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:08.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:08.925+0000 7f12f6ffd640 1 -- 172.21.15.38:0/2768393061 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f12e8054460 con 0x7f13000b6b00 2023-12-22T08:40:09.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.116+0000 7f1304992640 1 -- 172.21.15.38:0/2768393061 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f130006d740 con 0x7f12e006a460 2023-12-22T08:40:09.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.137+0000 7f12f6ffd640 1 -- 172.21.15.38:0/2768393061 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259933 (secure 0 0 0) 0x7f12f0003b10 con 0x7f12e006a460 2023-12-22T08:40:09.142 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:09.145 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:40:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.144+0000 7f1304992640 1 -- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12e006a460 msgr2=0x7f12e006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.144+0000 7f1304992640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12e006a460 0x7f12e006c920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f12f0034000 tx=0x7f12f0009030 comp rx=0 tx=0).stop 2023-12-22T08:40:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.144+0000 7f1304992640 1 -- 172.21.15.38:0/2768393061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13000b6b00 msgr2=0x7f13000afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.144+0000 7f1304992640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13000b6b00 0x7f13000afe20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f12e80116d0 tx=0x7f12e8011b90 comp rx=0 tx=0).stop 2023-12-22T08:40:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.144+0000 7f1304992640 1 -- 172.21.15.38:0/2768393061 shutdown_connections 2023-12-22T08:40:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.144+0000 7f1304992640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13001581f0 0x7f13000d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.144+0000 7f1304992640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12e006a460 0x7f12e006c920 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.144+0000 7f1304992640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13000b6b00 0x7f13000afe20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.144+0000 7f1304992640 1 --2- 172.21.15.38:0/2768393061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12ec0039c0 0x7f13000b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.144+0000 7f1304992640 1 -- 172.21.15.38:0/2768393061 >> 172.21.15.38:0/2768393061 conn(0x7f13000cfea0 msgr2=0x7f1300160f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.144+0000 7f1304992640 1 -- 172.21.15.38:0/2768393061 shutdown_connections 2023-12-22T08:40:09.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.144+0000 7f1304992640 1 -- 172.21.15.38:0/2768393061 wait complete. 2023-12-22T08:40:09.168 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-22T08:40:08.356969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560790,"statfs":{"total":1600000000,"available":1598249655,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.745595"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641233+0000","last_change":"2023-12-22T08:39:58.637334+0000","last_active":"2023-12-22T08:39:58.641233+0000","last_peered":"2023-12-22T08:39:58.641233+0000","last_clean":"2023-12-22T08:39:58.641233+0000","last_became_active":"2023-12-22T08:39:58.633668+0000","last_became_peered":"2023-12-22T08:39:58.633668+0000","last_unstale":"2023-12-22T08:39:58.641233+0000","last_undegraded":"2023-12-22T08:39:58.641233+0000","last_fullsized":"2023-12-22T08:39:58.641233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.638651+0000","last_change":"2023-12-22T08:39:58.638511+0000","last_active":"2023-12-22T08:39:58.638651+0000","last_peered":"2023-12-22T08:39:58.638651+0000","last_clean":"2023-12-22T08:39:58.638651+0000","last_became_active":"2023-12-22T08:39:58.638133+0000","last_became_peered":"2023-12-22T08:39:58.638133+0000","last_unstale":"2023-12-22T08:39:58.638651+0000","last_undegraded":"2023-12-22T08:39:58.638651+0000","last_fullsized":"2023-12-22T08:39:58.638651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626853+0000","last_change":"2023-12-22T08:39:58.624493+0000","last_active":"2023-12-22T08:39:58.626853+0000","last_peered":"2023-12-22T08:39:58.626853+0000","last_clean":"2023-12-22T08:39:58.626853+0000","last_became_active":"2023-12-22T08:39:58.624182+0000","last_became_peered":"2023-12-22T08:39:58.624182+0000","last_unstale":"2023-12-22T08:39:58.626853+0000","last_undegraded":"2023-12-22T08:39:58.626853+0000","last_fullsized":"2023-12-22T08:39:58.626853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.622961+0000","last_change":"2023-12-22T08:39:58.622751+0000","last_active":"2023-12-22T08:39:58.622961+0000","last_peered":"2023-12-22T08:39:58.622961+0000","last_clean":"2023-12-22T08:39:58.622961+0000","last_became_active":"2023-12-22T08:39:58.622558+0000","last_became_peered":"2023-12-22T08:39:58.622558+0000","last_unstale":"2023-12-22T08:39:58.622961+0000","last_undegraded":"2023-12-22T08:39:58.622961+0000","last_fullsized":"2023-12-22T08:39:58.622961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643514+0000","last_change":"2023-12-22T08:39:58.643416+0000","last_active":"2023-12-22T08:39:58.643514+0000","last_peered":"2023-12-22T08:39:58.643514+0000","last_clean":"2023-12-22T08:39:58.643514+0000","last_became_active":"2023-12-22T08:39:58.641676+0000","last_became_peered":"2023-12-22T08:39:58.641676+0000","last_unstale":"2023-12-22T08:39:58.643514+0000","last_undegraded":"2023-12-22T08:39:58.643514+0000","last_fullsized":"2023-12-22T08:39:58.643514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628427+0000","last_change":"2023-12-22T08:39:58.627296+0000","last_active":"2023-12-22T08:39:58.628427+0000","last_peered":"2023-12-22T08:39:58.628427+0000","last_clean":"2023-12-22T08:39:58.628427+0000","last_became_active":"2023-12-22T08:39:58.626081+0000","last_became_peered":"2023-12-22T08:39:58.626081+0000","last_unstale":"2023-12-22T08:39:58.628427+0000","last_undegraded":"2023-12-22T08:39:58.628427+0000","last_fullsized":"2023-12-22T08:39:58.628427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632558+0000","last_change":"2023-12-22T08:39:58.627560+0000","last_active":"2023-12-22T08:39:58.632558+0000","last_peered":"2023-12-22T08:39:58.632558+0000","last_clean":"2023-12-22T08:39:58.632558+0000","last_became_active":"2023-12-22T08:39:58.627301+0000","last_became_peered":"2023-12-22T08:39:58.627301+0000","last_unstale":"2023-12-22T08:39:58.632558+0000","last_undegraded":"2023-12-22T08:39:58.632558+0000","last_fullsized":"2023-12-22T08:39:58.632558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635551+0000","last_change":"2023-12-22T08:39:58.635478+0000","last_active":"2023-12-22T08:39:58.635551+0000","last_peered":"2023-12-22T08:39:58.635551+0000","last_clean":"2023-12-22T08:39:58.635551+0000","last_became_active":"2023-12-22T08:39:58.634102+0000","last_became_peered":"2023-12-22T08:39:58.634102+0000","last_unstale":"2023-12-22T08:39:58.635551+0000","last_undegraded":"2023-12-22T08:39:58.635551+0000","last_fullsized":"2023-12-22T08:39:58.635551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628795+0000","last_change":"2023-12-22T08:39:58.627844+0000","last_active":"2023-12-22T08:39:58.628795+0000","last_peered":"2023-12-22T08:39:58.628795+0000","last_clean":"2023-12-22T08:39:58.628795+0000","last_became_active":"2023-12-22T08:39:58.627437+0000","last_became_peered":"2023-12-22T08:39:58.627437+0000","last_unstale":"2023-12-22T08:39:58.628795+0000","last_undegraded":"2023-12-22T08:39:58.628795+0000","last_fullsized":"2023-12-22T08:39:58.628795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643969+0000","last_change":"2023-12-22T08:39:58.643662+0000","last_active":"2023-12-22T08:39:58.643969+0000","last_peered":"2023-12-22T08:39:58.643969+0000","last_clean":"2023-12-22T08:39:58.643969+0000","last_became_active":"2023-12-22T08:39:58.642844+0000","last_became_peered":"2023-12-22T08:39:58.642844+0000","last_unstale":"2023-12-22T08:39:58.643969+0000","last_undegraded":"2023-12-22T08:39:58.643969+0000","last_fullsized":"2023-12-22T08:39:58.643969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634533+0000","last_change":"2023-12-22T08:39:58.633899+0000","last_active":"2023-12-22T08:39:58.634533+0000","last_peered":"2023-12-22T08:39:58.634533+0000","last_clean":"2023-12-22T08:39:58.634533+0000","last_became_active":"2023-12-22T08:39:58.633388+0000","last_became_peered":"2023-12-22T08:39:58.633388+0000","last_unstale":"2023-12-22T08:39:58.634533+0000","last_undegraded":"2023-12-22T08:39:58.634533+0000","last_fullsized":"2023-12-22T08:39:58.634533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641187+0000","last_change":"2023-12-22T08:39:58.635496+0000","last_active":"2023-12-22T08:39:58.641187+0000","last_peered":"2023-12-22T08:39:58.641187+0000","last_clean":"2023-12-22T08:39:58.641187+0000","last_became_active":"2023-12-22T08:39:58.635138+0000","last_became_peered":"2023-12-22T08:39:58.635138+0000","last_unstale":"2023-12-22T08:39:58.641187+0000","last_undegraded":"2023-12-22T08:39:58.641187+0000","last_fullsized":"2023-12-22T08:39:58.641187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642527+0000","last_change":"2023-12-22T08:39:58.642430+0000","last_active":"2023-12-22T08:39:58.642527+0000","last_peered":"2023-12-22T08:39:58.642527+0000","last_clean":"2023-12-22T08:39:58.642527+0000","last_became_active":"2023-12-22T08:39:58.642158+0000","last_became_peered":"2023-12-22T08:39:58.642158+0000","last_unstale":"2023-12-22T08:39:58.642527+0000","last_undegraded":"2023-12-22T08:39:58.642527+0000","last_fullsized":"2023-12-22T08:39:58.642527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633485+0000","last_change":"2023-12-22T08:39:58.632386+0000","last_active":"2023-12-22T08:39:58.633485+0000","last_peered":"2023-12-22T08:39:58.633485+0000","last_clean":"2023-12-22T08:39:58.633485+0000","last_became_active":"2023-12-22T08:39:58.632076+0000","last_became_peered":"2023-12-22T08:39:58.632076+0000","last_unstale":"2023-12-22T08:39:58.633485+0000","last_undegraded":"2023-12-22T08:39:58.633485+0000","last_fullsized":"2023-12-22T08:39:58.633485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642784+0000","last_change":"2023-12-22T08:39:58.642703+0000","last_active":"2023-12-22T08:39:58.642784+0000","last_peered":"2023-12-22T08:39:58.642784+0000","last_clean":"2023-12-22T08:39:58.642784+0000","last_became_active":"2023-12-22T08:39:58.642445+0000","last_became_peered":"2023-12-22T08:39:58.642445+0000","last_unstale":"2023-12-22T08:39:58.642784+0000","last_undegraded":"2023-12-22T08:39:58.642784+0000","last_fullsized":"2023-12-22T08:39:58.642784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632403+0000","last_change":"2023-12-22T08:39:58.631912+0000","last_active":"2023-12-22T08:39:58.632403+0000","last_peered":"2023-12-22T08:39:58.632403+0000","last_clean":"2023-12-22T08:39:58.632403+0000","last_became_active":"2023-12-22T08:39:58.631582+0000","last_became_peered":"2023-12-22T08:39:58.631582+0000","last_unstale":"2023-12-22T08:39:58.632403+0000","last_undegraded":"2023-12-22T08:39:58.632403+0000","last_fullsized":"2023-12-22T08:39:58.632403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631724+0000","last_change":"2023-12-22T08:39:58.631577+0000","last_active":"2023-12-22T08:39:58.631724+0000","last_peered":"2023-12-22T08:39:58.631724+0000","last_clean":"2023-12-22T08:39:58.631724+0000","last_became_active":"2023-12-22T08:39:58.630007+0000","last_became_peered":"2023-12-22T08:39:58.630007+0000","last_unstale":"2023-12-22T08:39:58.631724+0000","last_undegraded":"2023-12-22T08:39:58.631724+0000","last_fullsized":"2023-12-22T08:39:58.631724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631082+0000","last_change":"2023-12-22T08:39:58.630931+0000","last_active":"2023-12-22T08:39:58.631082+0000","last_peered":"2023-12-22T08:39:58.631082+0000","last_clean":"2023-12-22T08:39:58.631082+0000","last_became_active":"2023-12-22T08:39:58.629526+0000","last_became_peered":"2023-12-22T08:39:58.629526+0000","last_unstale":"2023-12-22T08:39:58.631082+0000","last_undegraded":"2023-12-22T08:39:58.631082+0000","last_fullsized":"2023-12-22T08:39:58.631082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625568+0000","last_change":"2023-12-22T08:39:58.625439+0000","last_active":"2023-12-22T08:39:58.625568+0000","last_peered":"2023-12-22T08:39:58.625568+0000","last_clean":"2023-12-22T08:39:58.625568+0000","last_became_active":"2023-12-22T08:39:58.625072+0000","last_became_peered":"2023-12-22T08:39:58.625072+0000","last_unstale":"2023-12-22T08:39:58.625568+0000","last_undegraded":"2023-12-22T08:39:58.625568+0000","last_fullsized":"2023-12-22T08:39:58.625568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:24:09.483177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643984+0000","last_change":"2023-12-22T08:39:58.643819+0000","last_active":"2023-12-22T08:39:58.643984+0000","last_peered":"2023-12-22T08:39:58.643984+0000","last_clean":"2023-12-22T08:39:58.643984+0000","last_became_active":"2023-12-22T08:39:58.643147+0000","last_became_peered":"2023-12-22T08:39:58.643147+0000","last_unstale":"2023-12-22T08:39:58.643984+0000","last_undegraded":"2023-12-22T08:39:58.643984+0000","last_fullsized":"2023-12-22T08:39:58.643984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630682+0000","last_change":"2023-12-22T08:39:58.630595+0000","last_active":"2023-12-22T08:39:58.630682+0000","last_peered":"2023-12-22T08:39:58.630682+0000","last_clean":"2023-12-22T08:39:58.630682+0000","last_became_active":"2023-12-22T08:39:58.630241+0000","last_became_peered":"2023-12-22T08:39:58.630241+0000","last_unstale":"2023-12-22T08:39:58.630682+0000","last_undegraded":"2023-12-22T08:39:58.630682+0000","last_fullsized":"2023-12-22T08:39:58.630682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629920+0000","last_change":"2023-12-22T08:39:58.629733+0000","last_active":"2023-12-22T08:39:58.629920+0000","last_peered":"2023-12-22T08:39:58.629920+0000","last_clean":"2023-12-22T08:39:58.629920+0000","last_became_active":"2023-12-22T08:39:58.629485+0000","last_became_peered":"2023-12-22T08:39:58.629485+0000","last_unstale":"2023-12-22T08:39:58.629920+0000","last_undegraded":"2023-12-22T08:39:58.629920+0000","last_fullsized":"2023-12-22T08:39:58.629920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.618810+0000","last_change":"2023-12-22T08:39:58.618183+0000","last_active":"2023-12-22T08:39:58.618810+0000","last_peered":"2023-12-22T08:39:58.618810+0000","last_clean":"2023-12-22T08:39:58.618810+0000","last_became_active":"2023-12-22T08:39:58.617884+0000","last_became_peered":"2023-12-22T08:39:58.617884+0000","last_unstale":"2023-12-22T08:39:58.618810+0000","last_undegraded":"2023-12-22T08:39:58.618810+0000","last_fullsized":"2023-12-22T08:39:58.618810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619546+0000","last_change":"2023-12-22T08:39:58.619439+0000","last_active":"2023-12-22T08:39:58.619546+0000","last_peered":"2023-12-22T08:39:58.619546+0000","last_clean":"2023-12-22T08:39:58.619546+0000","last_became_active":"2023-12-22T08:39:58.617801+0000","last_became_peered":"2023-12-22T08:39:58.617801+0000","last_unstale":"2023-12-22T08:39:58.619546+0000","last_undegraded":"2023-12-22T08:39:58.619546+0000","last_fullsized":"2023-12-22T08:39:58.619546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:22.933973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623909+0000","last_change":"2023-12-22T08:39:58.621731+0000","last_active":"2023-12-22T08:39:58.623909+0000","last_peered":"2023-12-22T08:39:58.623909+0000","last_clean":"2023-12-22T08:39:58.623909+0000","last_became_active":"2023-12-22T08:39:58.621245+0000","last_became_peered":"2023-12-22T08:39:58.621245+0000","last_unstale":"2023-12-22T08:39:58.623909+0000","last_undegraded":"2023-12-22T08:39:58.623909+0000","last_fullsized":"2023-12-22T08:39:58.623909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.622887+0000","last_change":"2023-12-22T08:39:58.621295+0000","last_active":"2023-12-22T08:39:58.622887+0000","last_peered":"2023-12-22T08:39:58.622887+0000","last_clean":"2023-12-22T08:39:58.622887+0000","last_became_active":"2023-12-22T08:39:58.621071+0000","last_became_peered":"2023-12-22T08:39:58.621071+0000","last_unstale":"2023-12-22T08:39:58.622887+0000","last_undegraded":"2023-12-22T08:39:58.622887+0000","last_fullsized":"2023-12-22T08:39:58.622887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635278+0000","last_change":"2023-12-22T08:39:58.635200+0000","last_active":"2023-12-22T08:39:58.635278+0000","last_peered":"2023-12-22T08:39:58.635278+0000","last_clean":"2023-12-22T08:39:58.635278+0000","last_became_active":"2023-12-22T08:39:58.634590+0000","last_became_peered":"2023-12-22T08:39:58.634590+0000","last_unstale":"2023-12-22T08:39:58.635278+0000","last_undegraded":"2023-12-22T08:39:58.635278+0000","last_fullsized":"2023-12-22T08:39:58.635278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635766+0000","last_change":"2023-12-22T08:39:58.635639+0000","last_active":"2023-12-22T08:39:58.635766+0000","last_peered":"2023-12-22T08:39:58.635766+0000","last_clean":"2023-12-22T08:39:58.635766+0000","last_became_active":"2023-12-22T08:39:58.634556+0000","last_became_peered":"2023-12-22T08:39:58.634556+0000","last_unstale":"2023-12-22T08:39:58.635766+0000","last_undegraded":"2023-12-22T08:39:58.635766+0000","last_fullsized":"2023-12-22T08:39:58.635766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:59:30.195380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619288+0000","last_change":"2023-12-22T08:39:58.619128+0000","last_active":"2023-12-22T08:39:58.619288+0000","last_peered":"2023-12-22T08:39:58.619288+0000","last_clean":"2023-12-22T08:39:58.619288+0000","last_became_active":"2023-12-22T08:39:58.618488+0000","last_became_peered":"2023-12-22T08:39:58.618488+0000","last_unstale":"2023-12-22T08:39:58.619288+0000","last_undegraded":"2023-12-22T08:39:58.619288+0000","last_fullsized":"2023-12-22T08:39:58.619288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.617164+0000","last_change":"2023-12-22T08:39:58.616544+0000","last_active":"2023-12-22T08:39:58.617164+0000","last_peered":"2023-12-22T08:39:58.617164+0000","last_clean":"2023-12-22T08:39:58.617164+0000","last_became_active":"2023-12-22T08:39:58.616182+0000","last_became_peered":"2023-12-22T08:39:58.616182+0000","last_unstale":"2023-12-22T08:39:58.617164+0000","last_undegraded":"2023-12-22T08:39:58.617164+0000","last_fullsized":"2023-12-22T08:39:58.617164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:13:34.205933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.627549+0000","last_change":"2023-12-22T08:39:58.627478+0000","last_active":"2023-12-22T08:39:58.627549+0000","last_peered":"2023-12-22T08:39:58.627549+0000","last_clean":"2023-12-22T08:39:58.627549+0000","last_became_active":"2023-12-22T08:39:58.626043+0000","last_became_peered":"2023-12-22T08:39:58.626043+0000","last_unstale":"2023-12-22T08:39:58.627549+0000","last_undegraded":"2023-12-22T08:39:58.627549+0000","last_fullsized":"2023-12-22T08:39:58.627549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639910+0000","last_change":"2023-12-22T08:39:58.638489+0000","last_active":"2023-12-22T08:39:58.639910+0000","last_peered":"2023-12-22T08:39:58.639910+0000","last_clean":"2023-12-22T08:39:58.639910+0000","last_became_active":"2023-12-22T08:39:58.638260+0000","last_became_peered":"2023-12-22T08:39:58.638260+0000","last_unstale":"2023-12-22T08:39:58.639910+0000","last_undegraded":"2023-12-22T08:39:58.639910+0000","last_fullsized":"2023-12-22T08:39:58.639910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628825+0000","last_change":"2023-12-22T08:39:58.628717+0000","last_active":"2023-12-22T08:39:58.628825+0000","last_peered":"2023-12-22T08:39:58.628825+0000","last_clean":"2023-12-22T08:39:58.628825+0000","last_became_active":"2023-12-22T08:39:58.628336+0000","last_became_peered":"2023-12-22T08:39:58.628336+0000","last_unstale":"2023-12-22T08:39:58.628825+0000","last_undegraded":"2023-12-22T08:39:58.628825+0000","last_fullsized":"2023-12-22T08:39:58.628825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.638316+0000","last_change":"2023-12-22T08:39:58.118326+0000","last_active":"2023-12-22T08:39:58.638316+0000","last_peered":"2023-12-22T08:39:58.638316+0000","last_clean":"2023-12-22T08:39:58.638316+0000","last_became_active":"2023-12-22T08:39:58.117693+0000","last_became_peered":"2023-12-22T08:39:58.117693+0000","last_unstale":"2023-12-22T08:39:58.638316+0000","last_undegraded":"2023-12-22T08:39:58.638316+0000","last_fullsized":"2023-12-22T08:39:58.638316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639287+0000","last_change":"2023-12-22T08:39:58.637716+0000","last_active":"2023-12-22T08:39:58.639287+0000","last_peered":"2023-12-22T08:39:58.639287+0000","last_clean":"2023-12-22T08:39:58.639287+0000","last_became_active":"2023-12-22T08:39:58.637494+0000","last_became_peered":"2023-12-22T08:39:58.637494+0000","last_unstale":"2023-12-22T08:39:58.639287+0000","last_undegraded":"2023-12-22T08:39:58.639287+0000","last_fullsized":"2023-12-22T08:39:58.639287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642478+0000","last_change":"2023-12-22T08:39:58.124015+0000","last_active":"2023-12-22T08:39:58.642478+0000","last_peered":"2023-12-22T08:39:58.642478+0000","last_clean":"2023-12-22T08:39:58.642478+0000","last_became_active":"2023-12-22T08:39:58.123750+0000","last_became_peered":"2023-12-22T08:39:58.123750+0000","last_unstale":"2023-12-22T08:39:58.642478+0000","last_undegraded":"2023-12-22T08:39:58.642478+0000","last_fullsized":"2023-12-22T08:39:58.642478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:32.352283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631688+0000","last_change":"2023-12-22T08:39:58.126588+0000","last_active":"2023-12-22T08:39:58.631688+0000","last_peered":"2023-12-22T08:39:58.631688+0000","last_clean":"2023-12-22T08:39:58.631688+0000","last_became_active":"2023-12-22T08:39:58.126277+0000","last_became_peered":"2023-12-22T08:39:58.126277+0000","last_unstale":"2023-12-22T08:39:58.631688+0000","last_undegraded":"2023-12-22T08:39:58.631688+0000","last_fullsized":"2023-12-22T08:39:58.631688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631434+0000","last_change":"2023-12-22T08:39:58.631377+0000","last_active":"2023-12-22T08:39:58.631434+0000","last_peered":"2023-12-22T08:39:58.631434+0000","last_clean":"2023-12-22T08:39:58.631434+0000","last_became_active":"2023-12-22T08:39:58.630993+0000","last_became_peered":"2023-12-22T08:39:58.630993+0000","last_unstale":"2023-12-22T08:39:58.631434+0000","last_undegraded":"2023-12-22T08:39:58.631434+0000","last_fullsized":"2023-12-22T08:39:58.631434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:26:26.790794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.612908+0000","last_change":"2023-12-22T08:39:58.129064+0000","last_active":"2023-12-22T08:39:58.612908+0000","last_peered":"2023-12-22T08:39:58.612908+0000","last_clean":"2023-12-22T08:39:58.612908+0000","last_became_active":"2023-12-22T08:39:58.127921+0000","last_became_peered":"2023-12-22T08:39:58.127921+0000","last_unstale":"2023-12-22T08:39:58.612908+0000","last_undegraded":"2023-12-22T08:39:58.612908+0000","last_fullsized":"2023-12-22T08:39:58.612908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632098+0000","last_change":"2023-12-22T08:39:58.631767+0000","last_active":"2023-12-22T08:39:58.632098+0000","last_peered":"2023-12-22T08:39:58.632098+0000","last_clean":"2023-12-22T08:39:58.632098+0000","last_became_active":"2023-12-22T08:39:58.629195+0000","last_became_peered":"2023-12-22T08:39:58.629195+0000","last_unstale":"2023-12-22T08:39:58.632098+0000","last_undegraded":"2023-12-22T08:39:58.632098+0000","last_fullsized":"2023-12-22T08:39:58.632098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.620316+0000","last_change":"2023-12-22T08:39:58.128425+0000","last_active":"2023-12-22T08:39:58.620316+0000","last_peered":"2023-12-22T08:39:58.620316+0000","last_clean":"2023-12-22T08:39:58.620316+0000","last_became_active":"2023-12-22T08:39:58.128139+0000","last_became_peered":"2023-12-22T08:39:58.128139+0000","last_unstale":"2023-12-22T08:39:58.620316+0000","last_undegraded":"2023-12-22T08:39:58.620316+0000","last_fullsized":"2023-12-22T08:39:58.620316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628459+0000","last_change":"2023-12-22T08:39:58.628264+0000","last_active":"2023-12-22T08:39:58.628459+0000","last_peered":"2023-12-22T08:39:58.628459+0000","last_clean":"2023-12-22T08:39:58.628459+0000","last_became_active":"2023-12-22T08:39:58.627878+0000","last_became_peered":"2023-12-22T08:39:58.627878+0000","last_unstale":"2023-12-22T08:39:58.628459+0000","last_undegraded":"2023-12-22T08:39:58.628459+0000","last_fullsized":"2023-12-22T08:39:58.628459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626441+0000","last_change":"2023-12-22T08:39:58.123417+0000","last_active":"2023-12-22T08:39:58.626441+0000","last_peered":"2023-12-22T08:39:58.626441+0000","last_clean":"2023-12-22T08:39:58.626441+0000","last_became_active":"2023-12-22T08:39:58.122926+0000","last_became_peered":"2023-12-22T08:39:58.122926+0000","last_unstale":"2023-12-22T08:39:58.626441+0000","last_undegraded":"2023-12-22T08:39:58.626441+0000","last_fullsized":"2023-12-22T08:39:58.626441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.616535+0000","last_change":"2023-12-22T08:39:58.616456+0000","last_active":"2023-12-22T08:39:58.616535+0000","last_peered":"2023-12-22T08:39:58.616535+0000","last_clean":"2023-12-22T08:39:58.616535+0000","last_became_active":"2023-12-22T08:39:58.616235+0000","last_became_peered":"2023-12-22T08:39:58.616235+0000","last_unstale":"2023-12-22T08:39:58.616535+0000","last_undegraded":"2023-12-22T08:39:58.616535+0000","last_fullsized":"2023-12-22T08:39:58.616535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:37.333505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635460+0000","last_change":"2023-12-22T08:39:58.129066+0000","last_active":"2023-12-22T08:39:58.635460+0000","last_peered":"2023-12-22T08:39:58.635460+0000","last_clean":"2023-12-22T08:39:58.635460+0000","last_became_active":"2023-12-22T08:39:58.128536+0000","last_became_peered":"2023-12-22T08:39:58.128536+0000","last_unstale":"2023-12-22T08:39:58.635460+0000","last_undegraded":"2023-12-22T08:39:58.635460+0000","last_fullsized":"2023-12-22T08:39:58.635460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629952+0000","last_change":"2023-12-22T08:39:58.629869+0000","last_active":"2023-12-22T08:39:58.629952+0000","last_peered":"2023-12-22T08:39:58.629952+0000","last_clean":"2023-12-22T08:39:58.629952+0000","last_became_active":"2023-12-22T08:39:58.629618+0000","last_became_peered":"2023-12-22T08:39:58.629618+0000","last_unstale":"2023-12-22T08:39:58.629952+0000","last_undegraded":"2023-12-22T08:39:58.629952+0000","last_fullsized":"2023-12-22T08:39:58.629952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:24:34.120013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642495+0000","last_change":"2023-12-22T08:39:58.126247+0000","last_active":"2023-12-22T08:39:58.642495+0000","last_peered":"2023-12-22T08:39:58.642495+0000","last_clean":"2023-12-22T08:39:58.642495+0000","last_became_active":"2023-12-22T08:39:58.125863+0000","last_became_peered":"2023-12-22T08:39:58.125863+0000","last_unstale":"2023-12-22T08:39:58.642495+0000","last_undegraded":"2023-12-22T08:39:58.642495+0000","last_fullsized":"2023-12-22T08:39:58.642495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641409+0000","last_change":"2023-12-22T08:39:58.641015+0000","last_active":"2023-12-22T08:39:58.641409+0000","last_peered":"2023-12-22T08:39:58.641409+0000","last_clean":"2023-12-22T08:39:58.641409+0000","last_became_active":"2023-12-22T08:39:58.640705+0000","last_became_peered":"2023-12-22T08:39:58.640705+0000","last_unstale":"2023-12-22T08:39:58.641409+0000","last_undegraded":"2023-12-22T08:39:58.641409+0000","last_fullsized":"2023-12-22T08:39:58.641409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642932+0000","last_change":"2023-12-22T08:39:58.123764+0000","last_active":"2023-12-22T08:39:58.642932+0000","last_peered":"2023-12-22T08:39:58.642932+0000","last_clean":"2023-12-22T08:39:58.642932+0000","last_became_active":"2023-12-22T08:39:58.123431+0000","last_became_peered":"2023-12-22T08:39:58.123431+0000","last_unstale":"2023-12-22T08:39:58.642932+0000","last_undegraded":"2023-12-22T08:39:58.642932+0000","last_fullsized":"2023-12-22T08:39:58.642932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634178+0000","last_change":"2023-12-22T08:39:58.634043+0000","last_active":"2023-12-22T08:39:58.634178+0000","last_peered":"2023-12-22T08:39:58.634178+0000","last_clean":"2023-12-22T08:39:58.634178+0000","last_became_active":"2023-12-22T08:39:58.633774+0000","last_became_peered":"2023-12-22T08:39:58.633774+0000","last_unstale":"2023-12-22T08:39:58.634178+0000","last_undegraded":"2023-12-22T08:39:58.634178+0000","last_fullsized":"2023-12-22T08:39:58.634178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.614467+0000","last_change":"2023-12-22T08:39:58.124254+0000","last_active":"2023-12-22T08:39:58.614467+0000","last_peered":"2023-12-22T08:39:58.614467+0000","last_clean":"2023-12-22T08:39:58.614467+0000","last_became_active":"2023-12-22T08:39:58.123937+0000","last_became_peered":"2023-12-22T08:39:58.123937+0000","last_unstale":"2023-12-22T08:39:58.614467+0000","last_undegraded":"2023-12-22T08:39:58.614467+0000","last_fullsized":"2023-12-22T08:39:58.614467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.644230+0000","last_change":"2023-12-22T08:39:58.644158+0000","last_active":"2023-12-22T08:39:58.644230+0000","last_peered":"2023-12-22T08:39:58.644230+0000","last_clean":"2023-12-22T08:39:58.644230+0000","last_became_active":"2023-12-22T08:39:58.643919+0000","last_became_peered":"2023-12-22T08:39:58.643919+0000","last_unstale":"2023-12-22T08:39:58.644230+0000","last_undegraded":"2023-12-22T08:39:58.644230+0000","last_fullsized":"2023-12-22T08:39:58.644230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:16.702062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626541+0000","last_change":"2023-12-22T08:39:58.130462+0000","last_active":"2023-12-22T08:39:58.626541+0000","last_peered":"2023-12-22T08:39:58.626541+0000","last_clean":"2023-12-22T08:39:58.626541+0000","last_became_active":"2023-12-22T08:39:58.130246+0000","last_became_peered":"2023-12-22T08:39:58.130246+0000","last_unstale":"2023-12-22T08:39:58.626541+0000","last_undegraded":"2023-12-22T08:39:58.626541+0000","last_fullsized":"2023-12-22T08:39:58.626541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628811+0000","last_change":"2023-12-22T08:39:58.628587+0000","last_active":"2023-12-22T08:39:58.628811+0000","last_peered":"2023-12-22T08:39:58.628811+0000","last_clean":"2023-12-22T08:39:58.628811+0000","last_became_active":"2023-12-22T08:39:58.626918+0000","last_became_peered":"2023-12-22T08:39:58.626918+0000","last_unstale":"2023-12-22T08:39:58.628811+0000","last_undegraded":"2023-12-22T08:39:58.628811+0000","last_fullsized":"2023-12-22T08:39:58.628811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641108+0000","last_change":"2023-12-22T08:39:58.127791+0000","last_active":"2023-12-22T08:39:58.641108+0000","last_peered":"2023-12-22T08:39:58.641108+0000","last_clean":"2023-12-22T08:39:58.641108+0000","last_became_active":"2023-12-22T08:39:58.126674+0000","last_became_peered":"2023-12-22T08:39:58.126674+0000","last_unstale":"2023-12-22T08:39:58.641108+0000","last_undegraded":"2023-12-22T08:39:58.641108+0000","last_fullsized":"2023-12-22T08:39:58.641108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632387+0000","last_change":"2023-12-22T08:39:58.631847+0000","last_active":"2023-12-22T08:39:58.632387+0000","last_peered":"2023-12-22T08:39:58.632387+0000","last_clean":"2023-12-22T08:39:58.632387+0000","last_became_active":"2023-12-22T08:39:58.631202+0000","last_became_peered":"2023-12-22T08:39:58.631202+0000","last_unstale":"2023-12-22T08:39:58.632387+0000","last_undegraded":"2023-12-22T08:39:58.632387+0000","last_fullsized":"2023-12-22T08:39:58.632387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:53:42.342046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643020+0000","last_change":"2023-12-22T08:39:58.131328+0000","last_active":"2023-12-22T08:39:58.643020+0000","last_peered":"2023-12-22T08:39:58.643020+0000","last_clean":"2023-12-22T08:39:58.643020+0000","last_became_active":"2023-12-22T08:39:58.131102+0000","last_became_peered":"2023-12-22T08:39:58.131102+0000","last_unstale":"2023-12-22T08:39:58.643020+0000","last_undegraded":"2023-12-22T08:39:58.643020+0000","last_fullsized":"2023-12-22T08:39:58.643020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.644219+0000","last_change":"2023-12-22T08:39:58.644149+0000","last_active":"2023-12-22T08:39:58.644219+0000","last_peered":"2023-12-22T08:39:58.644219+0000","last_clean":"2023-12-22T08:39:58.644219+0000","last_became_active":"2023-12-22T08:39:58.643782+0000","last_became_peered":"2023-12-22T08:39:58.643782+0000","last_unstale":"2023-12-22T08:39:58.644219+0000","last_undegraded":"2023-12-22T08:39:58.644219+0000","last_fullsized":"2023-12-22T08:39:58.644219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639405+0000","last_change":"2023-12-22T08:39:58.128619+0000","last_active":"2023-12-22T08:39:58.639405+0000","last_peered":"2023-12-22T08:39:58.639405+0000","last_clean":"2023-12-22T08:39:58.639405+0000","last_became_active":"2023-12-22T08:39:58.128357+0000","last_became_peered":"2023-12-22T08:39:58.128357+0000","last_unstale":"2023-12-22T08:39:58.639405+0000","last_undegraded":"2023-12-22T08:39:58.639405+0000","last_fullsized":"2023-12-22T08:39:58.639405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634241+0000","last_change":"2023-12-22T08:39:58.633374+0000","last_active":"2023-12-22T08:39:58.634241+0000","last_peered":"2023-12-22T08:39:58.634241+0000","last_clean":"2023-12-22T08:39:58.634241+0000","last_became_active":"2023-12-22T08:39:58.633140+0000","last_became_peered":"2023-12-22T08:39:58.633140+0000","last_unstale":"2023-12-22T08:39:58.634241+0000","last_undegraded":"2023-12-22T08:39:58.634241+0000","last_fullsized":"2023-12-22T08:39:58.634241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632780+0000","last_change":"2023-12-22T08:39:58.124679+0000","last_active":"2023-12-22T08:39:58.632780+0000","last_peered":"2023-12-22T08:39:58.632780+0000","last_clean":"2023-12-22T08:39:58.632780+0000","last_became_active":"2023-12-22T08:39:58.124446+0000","last_became_peered":"2023-12-22T08:39:58.124446+0000","last_unstale":"2023-12-22T08:39:58.632780+0000","last_undegraded":"2023-12-22T08:39:58.632780+0000","last_fullsized":"2023-12-22T08:39:58.632780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635014+0000","last_change":"2023-12-22T08:39:58.634622+0000","last_active":"2023-12-22T08:39:58.635014+0000","last_peered":"2023-12-22T08:39:58.635014+0000","last_clean":"2023-12-22T08:39:58.635014+0000","last_became_active":"2023-12-22T08:39:58.627769+0000","last_became_peered":"2023-12-22T08:39:58.627769+0000","last_unstale":"2023-12-22T08:39:58.635014+0000","last_undegraded":"2023-12-22T08:39:58.635014+0000","last_fullsized":"2023-12-22T08:39:58.635014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625945+0000","last_change":"2023-12-22T08:39:58.125976+0000","last_active":"2023-12-22T08:39:58.625945+0000","last_peered":"2023-12-22T08:39:58.625945+0000","last_clean":"2023-12-22T08:39:58.625945+0000","last_became_active":"2023-12-22T08:39:58.125728+0000","last_became_peered":"2023-12-22T08:39:58.125728+0000","last_unstale":"2023-12-22T08:39:58.625945+0000","last_undegraded":"2023-12-22T08:39:58.625945+0000","last_fullsized":"2023-12-22T08:39:58.625945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623852+0000","last_change":"2023-12-22T08:39:58.623592+0000","last_active":"2023-12-22T08:39:58.623852+0000","last_peered":"2023-12-22T08:39:58.623852+0000","last_clean":"2023-12-22T08:39:58.623852+0000","last_became_active":"2023-12-22T08:39:58.623129+0000","last_became_peered":"2023-12-22T08:39:58.623129+0000","last_unstale":"2023-12-22T08:39:58.623852+0000","last_undegraded":"2023-12-22T08:39:58.623852+0000","last_fullsized":"2023-12-22T08:39:58.623852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.618653+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:39:58.618653+0000","last_peered":"2023-12-22T08:39:58.618653+0000","last_clean":"2023-12-22T08:39:58.618653+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:39:58.618653+0000","last_undegraded":"2023-12-22T08:39:58.618653+0000","last_fullsized":"2023-12-22T08:39:58.618653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.614777+0000","last_change":"2023-12-22T08:39:58.128257+0000","last_active":"2023-12-22T08:39:58.614777+0000","last_peered":"2023-12-22T08:39:58.614777+0000","last_clean":"2023-12-22T08:39:58.614777+0000","last_became_active":"2023-12-22T08:39:58.127185+0000","last_became_peered":"2023-12-22T08:39:58.127185+0000","last_unstale":"2023-12-22T08:39:58.614777+0000","last_undegraded":"2023-12-22T08:39:58.614777+0000","last_fullsized":"2023-12-22T08:39:58.614777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:34.256489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630391+0000","last_change":"2023-12-22T08:39:58.630318+0000","last_active":"2023-12-22T08:39:58.630391+0000","last_peered":"2023-12-22T08:39:58.630391+0000","last_clean":"2023-12-22T08:39:58.630391+0000","last_became_active":"2023-12-22T08:39:58.630077+0000","last_became_peered":"2023-12-22T08:39:58.630077+0000","last_unstale":"2023-12-22T08:39:58.630391+0000","last_undegraded":"2023-12-22T08:39:58.630391+0000","last_fullsized":"2023-12-22T08:39:58.630391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.616306+0000","last_change":"2023-12-22T08:39:58.109900+0000","last_active":"2023-12-22T08:39:58.616306+0000","last_peered":"2023-12-22T08:39:58.616306+0000","last_clean":"2023-12-22T08:39:58.616306+0000","last_became_active":"2023-12-22T08:39:58.109127+0000","last_became_peered":"2023-12-22T08:39:58.109127+0000","last_unstale":"2023-12-22T08:39:58.616306+0000","last_undegraded":"2023-12-22T08:39:58.616306+0000","last_fullsized":"2023-12-22T08:39:58.616306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635903+0000","last_change":"2023-12-22T08:39:58.635825+0000","last_active":"2023-12-22T08:39:58.635903+0000","last_peered":"2023-12-22T08:39:58.635903+0000","last_clean":"2023-12-22T08:39:58.635903+0000","last_became_active":"2023-12-22T08:39:58.635203+0000","last_became_peered":"2023-12-22T08:39:58.635203+0000","last_unstale":"2023-12-22T08:39:58.635903+0000","last_undegraded":"2023-12-22T08:39:58.635903+0000","last_fullsized":"2023-12-22T08:39:58.635903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.617739+0000","last_change":"2023-12-22T08:39:58.128822+0000","last_active":"2023-12-22T08:39:58.617739+0000","last_peered":"2023-12-22T08:39:58.617739+0000","last_clean":"2023-12-22T08:39:58.617739+0000","last_became_active":"2023-12-22T08:39:58.128142+0000","last_became_peered":"2023-12-22T08:39:58.128142+0000","last_unstale":"2023-12-22T08:39:58.617739+0000","last_undegraded":"2023-12-22T08:39:58.617739+0000","last_fullsized":"2023-12-22T08:39:58.617739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619266+0000","last_change":"2023-12-22T08:39:58.618953+0000","last_active":"2023-12-22T08:39:58.619266+0000","last_peered":"2023-12-22T08:39:58.619266+0000","last_clean":"2023-12-22T08:39:58.619266+0000","last_became_active":"2023-12-22T08:39:58.618178+0000","last_became_peered":"2023-12-22T08:39:58.618178+0000","last_unstale":"2023-12-22T08:39:58.619266+0000","last_undegraded":"2023-12-22T08:39:58.619266+0000","last_fullsized":"2023-12-22T08:39:58.619266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.612537+0000","last_change":"2023-12-22T08:39:58.109274+0000","last_active":"2023-12-22T08:39:58.612537+0000","last_peered":"2023-12-22T08:39:58.612537+0000","last_clean":"2023-12-22T08:39:58.612537+0000","last_became_active":"2023-12-22T08:39:58.108715+0000","last_became_peered":"2023-12-22T08:39:58.108715+0000","last_unstale":"2023-12-22T08:39:58.612537+0000","last_undegraded":"2023-12-22T08:39:58.612537+0000","last_fullsized":"2023-12-22T08:39:58.612537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641249+0000","last_change":"2023-12-22T08:39:58.640517+0000","last_active":"2023-12-22T08:39:58.641249+0000","last_peered":"2023-12-22T08:39:58.641249+0000","last_clean":"2023-12-22T08:39:58.641249+0000","last_became_active":"2023-12-22T08:39:58.640288+0000","last_became_peered":"2023-12-22T08:39:58.640288+0000","last_unstale":"2023-12-22T08:39:58.641249+0000","last_undegraded":"2023-12-22T08:39:58.641249+0000","last_fullsized":"2023-12-22T08:39:58.641249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.611243+0000","last_change":"2023-12-22T08:39:58.127367+0000","last_active":"2023-12-22T08:39:58.611243+0000","last_peered":"2023-12-22T08:39:58.611243+0000","last_clean":"2023-12-22T08:39:58.611243+0000","last_became_active":"2023-12-22T08:39:58.124150+0000","last_became_peered":"2023-12-22T08:39:58.124150+0000","last_unstale":"2023-12-22T08:39:58.611243+0000","last_undegraded":"2023-12-22T08:39:58.611243+0000","last_fullsized":"2023-12-22T08:39:58.611243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.636519+0000","last_change":"2023-12-22T08:39:58.636058+0000","last_active":"2023-12-22T08:39:58.636519+0000","last_peered":"2023-12-22T08:39:58.636519+0000","last_clean":"2023-12-22T08:39:58.636519+0000","last_became_active":"2023-12-22T08:39:58.635817+0000","last_became_peered":"2023-12-22T08:39:58.635817+0000","last_unstale":"2023-12-22T08:39:58.636519+0000","last_undegraded":"2023-12-22T08:39:58.636519+0000","last_fullsized":"2023-12-22T08:39:58.636519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.615958+0000","last_change":"2023-12-22T08:39:58.128760+0000","last_active":"2023-12-22T08:39:58.615958+0000","last_peered":"2023-12-22T08:39:58.615958+0000","last_clean":"2023-12-22T08:39:58.615958+0000","last_became_active":"2023-12-22T08:39:58.128499+0000","last_became_peered":"2023-12-22T08:39:58.128499+0000","last_unstale":"2023-12-22T08:39:58.615958+0000","last_undegraded":"2023-12-22T08:39:58.615958+0000","last_fullsized":"2023-12-22T08:39:58.615958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:15.265494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633467+0000","last_change":"2023-12-22T08:39:58.630593+0000","last_active":"2023-12-22T08:39:58.633467+0000","last_peered":"2023-12-22T08:39:58.633467+0000","last_clean":"2023-12-22T08:39:58.633467+0000","last_became_active":"2023-12-22T08:39:58.629117+0000","last_became_peered":"2023-12-22T08:39:58.629117+0000","last_unstale":"2023-12-22T08:39:58.633467+0000","last_undegraded":"2023-12-22T08:39:58.633467+0000","last_fullsized":"2023-12-22T08:39:58.633467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.620856+0000","last_change":"2023-12-22T08:39:58.129601+0000","last_active":"2023-12-22T08:39:58.620856+0000","last_peered":"2023-12-22T08:39:58.620856+0000","last_clean":"2023-12-22T08:39:58.620856+0000","last_became_active":"2023-12-22T08:39:58.129236+0000","last_became_peered":"2023-12-22T08:39:58.129236+0000","last_unstale":"2023-12-22T08:39:58.620856+0000","last_undegraded":"2023-12-22T08:39:58.620856+0000","last_fullsized":"2023-12-22T08:39:58.620856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639661+0000","last_change":"2023-12-22T08:39:58.639582+0000","last_active":"2023-12-22T08:39:58.639661+0000","last_peered":"2023-12-22T08:39:58.639661+0000","last_clean":"2023-12-22T08:39:58.639661+0000","last_became_active":"2023-12-22T08:39:58.638759+0000","last_became_peered":"2023-12-22T08:39:58.638759+0000","last_unstale":"2023-12-22T08:39:58.639661+0000","last_undegraded":"2023-12-22T08:39:58.639661+0000","last_fullsized":"2023-12-22T08:39:58.639661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642267+0000","last_change":"2023-12-22T08:39:58.127199+0000","last_active":"2023-12-22T08:39:58.642267+0000","last_peered":"2023-12-22T08:39:58.642267+0000","last_clean":"2023-12-22T08:39:58.642267+0000","last_became_active":"2023-12-22T08:39:58.126735+0000","last_became_peered":"2023-12-22T08:39:58.126735+0000","last_unstale":"2023-12-22T08:39:58.642267+0000","last_undegraded":"2023-12-22T08:39:58.642267+0000","last_fullsized":"2023-12-22T08:39:58.642267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:12.048994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.627309+0000","last_change":"2023-12-22T08:39:58.627233+0000","last_active":"2023-12-22T08:39:58.627309+0000","last_peered":"2023-12-22T08:39:58.627309+0000","last_clean":"2023-12-22T08:39:58.627309+0000","last_became_active":"2023-12-22T08:39:58.626937+0000","last_became_peered":"2023-12-22T08:39:58.626937+0000","last_unstale":"2023-12-22T08:39:58.627309+0000","last_undegraded":"2023-12-22T08:39:58.627309+0000","last_fullsized":"2023-12-22T08:39:58.627309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625536+0000","last_change":"2023-12-22T08:39:58.125513+0000","last_active":"2023-12-22T08:39:58.625536+0000","last_peered":"2023-12-22T08:39:58.625536+0000","last_clean":"2023-12-22T08:39:58.625536+0000","last_became_active":"2023-12-22T08:39:58.125286+0000","last_became_peered":"2023-12-22T08:39:58.125286+0000","last_unstale":"2023-12-22T08:39:58.625536+0000","last_undegraded":"2023-12-22T08:39:58.625536+0000","last_fullsized":"2023-12-22T08:39:58.625536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623822+0000","last_change":"2023-12-22T08:39:58.622884+0000","last_active":"2023-12-22T08:39:58.623822+0000","last_peered":"2023-12-22T08:39:58.623822+0000","last_clean":"2023-12-22T08:39:58.623822+0000","last_became_active":"2023-12-22T08:39:58.622531+0000","last_became_peered":"2023-12-22T08:39:58.622531+0000","last_unstale":"2023-12-22T08:39:58.623822+0000","last_undegraded":"2023-12-22T08:39:58.623822+0000","last_fullsized":"2023-12-22T08:39:58.623822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:01.993745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.620792+0000","last_change":"2023-12-22T08:39:58.127163+0000","last_active":"2023-12-22T08:39:58.620792+0000","last_peered":"2023-12-22T08:39:58.620792+0000","last_clean":"2023-12-22T08:39:58.620792+0000","last_became_active":"2023-12-22T08:39:58.125842+0000","last_became_peered":"2023-12-22T08:39:58.125842+0000","last_unstale":"2023-12-22T08:39:58.620792+0000","last_undegraded":"2023-12-22T08:39:58.620792+0000","last_fullsized":"2023-12-22T08:39:58.620792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629967+0000","last_change":"2023-12-22T08:39:58.628998+0000","last_active":"2023-12-22T08:39:58.629967+0000","last_peered":"2023-12-22T08:39:58.629967+0000","last_clean":"2023-12-22T08:39:58.629967+0000","last_became_active":"2023-12-22T08:39:58.628022+0000","last_became_peered":"2023-12-22T08:39:58.628022+0000","last_unstale":"2023-12-22T08:39:58.629967+0000","last_undegraded":"2023-12-22T08:39:58.629967+0000","last_fullsized":"2023-12-22T08:39:58.629967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631814+0000","last_change":"2023-12-22T08:39:58.129742+0000","last_active":"2023-12-22T08:39:58.631814+0000","last_peered":"2023-12-22T08:39:58.631814+0000","last_clean":"2023-12-22T08:39:58.631814+0000","last_became_active":"2023-12-22T08:39:58.129522+0000","last_became_peered":"2023-12-22T08:39:58.129522+0000","last_unstale":"2023-12-22T08:39:58.631814+0000","last_undegraded":"2023-12-22T08:39:58.631814+0000","last_fullsized":"2023-12-22T08:39:58.631814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.636842+0000","last_change":"2023-12-22T08:39:58.636766+0000","last_active":"2023-12-22T08:39:58.636842+0000","last_peered":"2023-12-22T08:39:58.636842+0000","last_clean":"2023-12-22T08:39:58.636842+0000","last_became_active":"2023-12-22T08:39:58.636550+0000","last_became_peered":"2023-12-22T08:39:58.636550+0000","last_unstale":"2023-12-22T08:39:58.636842+0000","last_undegraded":"2023-12-22T08:39:58.636842+0000","last_fullsized":"2023-12-22T08:39:58.636842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.637828+0000","last_change":"2023-12-22T08:39:58.128411+0000","last_active":"2023-12-22T08:39:58.637828+0000","last_peered":"2023-12-22T08:39:58.637828+0000","last_clean":"2023-12-22T08:39:58.637828+0000","last_became_active":"2023-12-22T08:39:58.127849+0000","last_became_peered":"2023-12-22T08:39:58.127849+0000","last_unstale":"2023-12-22T08:39:58.637828+0000","last_undegraded":"2023-12-22T08:39:58.637828+0000","last_fullsized":"2023-12-22T08:39:58.637828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:25.721681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.624467+0000","last_change":"2023-12-22T08:39:58.624131+0000","last_active":"2023-12-22T08:39:58.624467+0000","last_peered":"2023-12-22T08:39:58.624467+0000","last_clean":"2023-12-22T08:39:58.624467+0000","last_became_active":"2023-12-22T08:39:58.621786+0000","last_became_peered":"2023-12-22T08:39:58.621786+0000","last_unstale":"2023-12-22T08:39:58.624467+0000","last_undegraded":"2023-12-22T08:39:58.624467+0000","last_fullsized":"2023-12-22T08:39:58.624467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642965+0000","last_change":"2023-12-22T08:39:58.642425+0000","last_active":"2023-12-22T08:39:58.642965+0000","last_peered":"2023-12-22T08:39:58.642965+0000","last_clean":"2023-12-22T08:39:58.642965+0000","last_became_active":"2023-12-22T08:39:58.642201+0000","last_became_peered":"2023-12-22T08:39:58.642201+0000","last_unstale":"2023-12-22T08:39:58.642965+0000","last_undegraded":"2023-12-22T08:39:58.642965+0000","last_fullsized":"2023-12-22T08:39:58.642965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:35.423369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643104+0000","last_change":"2023-12-22T08:39:58.124586+0000","last_active":"2023-12-22T08:39:58.643104+0000","last_peered":"2023-12-22T08:39:58.643104+0000","last_clean":"2023-12-22T08:39:58.643104+0000","last_became_active":"2023-12-22T08:39:58.123428+0000","last_became_peered":"2023-12-22T08:39:58.123428+0000","last_unstale":"2023-12-22T08:39:58.643104+0000","last_undegraded":"2023-12-22T08:39:58.643104+0000","last_fullsized":"2023-12-22T08:39:58.643104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630950+0000","last_change":"2023-12-22T08:39:58.630694+0000","last_active":"2023-12-22T08:39:58.630950+0000","last_peered":"2023-12-22T08:39:58.630950+0000","last_clean":"2023-12-22T08:39:58.630950+0000","last_became_active":"2023-12-22T08:39:58.630420+0000","last_became_peered":"2023-12-22T08:39:58.630420+0000","last_unstale":"2023-12-22T08:39:58.630950+0000","last_undegraded":"2023-12-22T08:39:58.630950+0000","last_fullsized":"2023-12-22T08:39:58.630950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.645513+0000","last_change":"2023-12-22T08:39:58.129551+0000","last_active":"2023-12-22T08:39:58.645513+0000","last_peered":"2023-12-22T08:39:58.645513+0000","last_clean":"2023-12-22T08:39:58.645513+0000","last_became_active":"2023-12-22T08:39:58.129237+0000","last_became_peered":"2023-12-22T08:39:58.129237+0000","last_unstale":"2023-12-22T08:39:58.645513+0000","last_undegraded":"2023-12-22T08:39:58.645513+0000","last_fullsized":"2023-12-22T08:39:58.645513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623969+0000","last_change":"2023-12-22T08:39:58.623889+0000","last_active":"2023-12-22T08:39:58.623969+0000","last_peered":"2023-12-22T08:39:58.623969+0000","last_clean":"2023-12-22T08:39:58.623969+0000","last_became_active":"2023-12-22T08:39:58.621334+0000","last_became_peered":"2023-12-22T08:39:58.621334+0000","last_unstale":"2023-12-22T08:39:58.623969+0000","last_undegraded":"2023-12-22T08:39:58.623969+0000","last_fullsized":"2023-12-22T08:39:58.623969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:58:42.417309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633418+0000","last_change":"2023-12-22T08:39:58.127899+0000","last_active":"2023-12-22T08:39:58.633418+0000","last_peered":"2023-12-22T08:39:58.633418+0000","last_clean":"2023-12-22T08:39:58.633418+0000","last_became_active":"2023-12-22T08:39:58.126733+0000","last_became_peered":"2023-12-22T08:39:58.126733+0000","last_unstale":"2023-12-22T08:39:58.633418+0000","last_undegraded":"2023-12-22T08:39:58.633418+0000","last_fullsized":"2023-12-22T08:39:58.633418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623951+0000","last_change":"2023-12-22T08:39:58.623648+0000","last_active":"2023-12-22T08:39:58.623951+0000","last_peered":"2023-12-22T08:39:58.623951+0000","last_clean":"2023-12-22T08:39:58.623951+0000","last_became_active":"2023-12-22T08:39:58.623415+0000","last_became_peered":"2023-12-22T08:39:58.623415+0000","last_unstale":"2023-12-22T08:39:58.623951+0000","last_undegraded":"2023-12-22T08:39:58.623951+0000","last_fullsized":"2023-12-22T08:39:58.623951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639516+0000","last_change":"2023-12-22T08:39:58.130439+0000","last_active":"2023-12-22T08:39:58.639516+0000","last_peered":"2023-12-22T08:39:58.639516+0000","last_clean":"2023-12-22T08:39:58.639516+0000","last_became_active":"2023-12-22T08:39:58.130196+0000","last_became_peered":"2023-12-22T08:39:58.130196+0000","last_unstale":"2023-12-22T08:39:58.639516+0000","last_undegraded":"2023-12-22T08:39:58.639516+0000","last_fullsized":"2023-12-22T08:39:58.639516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.536}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7270000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194667,"statfs":{"total":200000000,"available":199339821,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.798}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5880000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6279999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.79}]}]}],"pool_statfs":[]}} 2023-12-22T08:40:09.172 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T08:40:09.172 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-22T08:40:09.172 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-22T08:40:09.172 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-22T08:40:09.173 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-22T08:40:09.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.440+0000 7f032b59e640 1 Processor -- start 2023-12-22T08:40:09.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.440+0000 7f032b59e640 1 -- start start 2023-12-22T08:40:09.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.442+0000 7f032b59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f032c071680 0x7f032c162f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:09.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.442+0000 7f032b59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f032c0b2a90 0x7f032c0ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:09.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.442+0000 7f032b59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032c0cb1d0 con 0x7f032c0cadc0 2023-12-22T08:40:09.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.442+0000 7f032b59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032c162ce0 con 0x7f032c0b2a90 2023-12-22T08:40:09.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.442+0000 7f032b59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032c0b2f40 con 0x7f032c071680 2023-12-22T08:40:09.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.442+0000 7f0323fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f032c0b2a90 0x7f032c0ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:09.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.443+0000 7f032ad9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f032c0cadc0 0x7f032c06d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51578/0 (socket says 172.21.15.38:51578) 2023-12-22T08:40:09.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.443+0000 7f032ad9d640 1 -- 172.21.15.38:0/1742645885 learned_addr learned my addr 172.21.15.38:0/1742645885 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:09.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.443+0000 7f032a59c640 1 --2- 172.21.15.38:0/1742645885 >> v2:172.21.15.89:3300/0 conn(0x7f032c071680 0x7f032c162f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:09.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.443+0000 7f0323fff640 1 -- 172.21.15.38:0/1742645885 >> v2:172.21.15.89:3300/0 conn(0x7f032c071680 msgr2=0x7f032c162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:09.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.443+0000 7f0323fff640 1 --2- 172.21.15.38:0/1742645885 >> v2:172.21.15.89:3300/0 conn(0x7f032c071680 0x7f032c162f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.443+0000 7f0323fff640 1 -- 172.21.15.38:0/1742645885 >> v1:172.21.15.38:6789/0 conn(0x7f032c0cadc0 legacy=0x7f032c06d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:09.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.443+0000 7f0323fff640 1 -- 172.21.15.38:0/1742645885 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c162160 con 0x7f032c0b2a90 2023-12-22T08:40:09.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.444+0000 7f0323fff640 1 --2- 172.21.15.38:0/1742645885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c0b2a90 0x7f032c0ca880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f032c06e7e0 tx=0x7f031402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2954b44fcac17b2c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:09.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.445+0000 7f0329d9b640 1 -- 172.21.15.38:0/1742645885 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314031830 con 0x7f032c0b2a90 2023-12-22T08:40:09.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.445+0000 7f0329d9b640 1 -- 172.21.15.38:0/1742645885 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0314031990 con 0x7f032c0b2a90 2023-12-22T08:40:09.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.445+0000 7f0329d9b640 1 -- 172.21.15.38:0/1742645885 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314031d20 con 0x7f032c0b2a90 2023-12-22T08:40:09.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.445+0000 7f032b59e640 1 -- 172.21.15.38:0/1742645885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c0b2a90 msgr2=0x7f032c0ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:09.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.445+0000 7f032b59e640 1 --2- 172.21.15.38:0/1742645885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c0b2a90 0x7f032c0ca880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f032c06e7e0 tx=0x7f031402b8d0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.445+0000 7f032b59e640 1 -- 172.21.15.38:0/1742645885 shutdown_connections 2023-12-22T08:40:09.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.445+0000 7f032b59e640 1 --2- 172.21.15.38:0/1742645885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c0b2a90 0x7f032c0ca880 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.445+0000 7f032b59e640 1 --2- 172.21.15.38:0/1742645885 >> v2:172.21.15.89:3300/0 conn(0x7f032c071680 0x7f032c162f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.445+0000 7f032b59e640 1 -- 172.21.15.38:0/1742645885 >> 172.21.15.38:0/1742645885 conn(0x7f032c0b1f70 msgr2=0x7f032c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:09.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.445+0000 7f032b59e640 1 -- 172.21.15.38:0/1742645885 shutdown_connections 2023-12-22T08:40:09.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.445+0000 7f032b59e640 1 -- 172.21.15.38:0/1742645885 wait complete. 2023-12-22T08:40:09.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.447+0000 7f032b59e640 1 Processor -- start 2023-12-22T08:40:09.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.447+0000 7f032b59e640 1 -- start start 2023-12-22T08:40:09.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.448+0000 7f032b59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f032c071680 0x7f032c152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:09.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.448+0000 7f032b59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c0b2a90 0x7f032c0ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:09.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.448+0000 7f032b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f032c0cadc0 0x7f032c153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:09.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.448+0000 7f032b59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c15a2b0 con 0x7f032c0b2a90 2023-12-22T08:40:09.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.448+0000 7f032b59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c159980 con 0x7f032c071680 2023-12-22T08:40:09.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.448+0000 7f032b59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032c159c60 con 0x7f032c0cadc0 2023-12-22T08:40:09.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.449+0000 7f0323fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c0b2a90 0x7f032c0ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:09.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.449+0000 7f0323fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c0b2a90 0x7f032c0ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42330/0 (socket says 172.21.15.38:42330) 2023-12-22T08:40:09.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.449+0000 7f0323fff640 1 -- 172.21.15.38:0/2352815892 learned_addr learned my addr 172.21.15.38:0/2352815892 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:09.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.449+0000 7f032a59c640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f032c071680 0x7f032c152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:09.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.449+0000 7f032ad9d640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f032c0cadc0 0x7f032c153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.449+0000 7f0323fff640 1 -- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f032c0cadc0 msgr2=0x7f032c153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.449+0000 7f0323fff640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f032c0cadc0 0x7f032c153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.449+0000 7f0323fff640 1 -- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f032c071680 msgr2=0x7f032c152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.449+0000 7f0323fff640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f032c071680 0x7f032c152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.449+0000 7f0323fff640 1 -- 172.21.15.38:0/2352815892 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0314009400 con 0x7f032c0b2a90 2023-12-22T08:40:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.449+0000 7f032a59c640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f032c071680 0x7f032c152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.450+0000 7f0323fff640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c0b2a90 0x7f032c0ae630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0314009890 tx=0x7f03140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.450+0000 7f0322ffd640 1 -- 172.21.15.38:0/2352815892 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031403a6f0 con 0x7f032c0b2a90 2023-12-22T08:40:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.450+0000 7f0322ffd640 1 -- 172.21.15.38:0/2352815892 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031403a870 con 0x7f032c0b2a90 2023-12-22T08:40:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.450+0000 7f0322ffd640 1 -- 172.21.15.38:0/2352815892 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031403ac20 con 0x7f032c0b2a90 2023-12-22T08:40:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.450+0000 7f032b59e640 1 -- 172.21.15.38:0/2352815892 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032c159f40 con 0x7f032c0b2a90 2023-12-22T08:40:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.450+0000 7f032b59e640 1 -- 172.21.15.38:0/2352815892 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032c1595a0 con 0x7f032c0b2a90 2023-12-22T08:40:09.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.451+0000 7f032b59e640 1 -- 172.21.15.38:0/2352815892 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032c15a100 con 0x7f032c0b2a90 2023-12-22T08:40:09.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.452+0000 7f0322ffd640 1 -- 172.21.15.38:0/2352815892 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0314043410 con 0x7f032c0b2a90 2023-12-22T08:40:09.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.453+0000 7f0322ffd640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f030c06a430 0x7f030c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:09.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.453+0000 7f0322ffd640 1 -- 172.21.15.38:0/2352815892 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03140aa560 con 0x7f032c0b2a90 2023-12-22T08:40:09.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.454+0000 7f032a59c640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f030c06a430 0x7f030c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:09.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.455+0000 7f032a59c640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f030c06a430 0x7f030c06c8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f032c154bd0 tx=0x7f031c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:09.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.457+0000 7f0322ffd640 1 -- 172.21.15.38:0/2352815892 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0314075ab0 con 0x7f032c0b2a90 2023-12-22T08:40:09.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.699+0000 7f032b59e640 1 -- 172.21.15.38:0/2352815892 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f032c061910 con 0x7f032c0b2a90 2023-12-22T08:40:09.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.704+0000 7f0322ffd640 1 -- 172.21.15.38:0/2352815892 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169959 (secure 0 0 0) 0x7f03140790d0 con 0x7f032c0b2a90 2023-12-22T08:40:09.708 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:09.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.708+0000 7f032b59e640 1 -- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f030c06a430 msgr2=0x7f030c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:09.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.708+0000 7f032b59e640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f030c06a430 0x7f030c06c8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f032c154bd0 tx=0x7f031c008040 comp rx=0 tx=0).stop 2023-12-22T08:40:09.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.708+0000 7f032b59e640 1 -- 172.21.15.38:0/2352815892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c0b2a90 msgr2=0x7f032c0ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:09.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.708+0000 7f032b59e640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c0b2a90 0x7f032c0ae630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0314009890 tx=0x7f03140046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.709+0000 7f032b59e640 1 -- 172.21.15.38:0/2352815892 shutdown_connections 2023-12-22T08:40:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.709+0000 7f032b59e640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f032c0cadc0 0x7f032c153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.709+0000 7f032b59e640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f030c06a430 0x7f030c06c8f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.709+0000 7f032b59e640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c0b2a90 0x7f032c0ae630 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.709+0000 7f032b59e640 1 --2- 172.21.15.38:0/2352815892 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f032c071680 0x7f032c152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.709+0000 7f032b59e640 1 -- 172.21.15.38:0/2352815892 >> 172.21.15.38:0/2352815892 conn(0x7f032c0b1f70 msgr2=0x7f032c162eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.709+0000 7f032b59e640 1 -- 172.21.15.38:0/2352815892 shutdown_connections 2023-12-22T08:40:09.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.709+0000 7f032b59e640 1 -- 172.21.15.38:0/2352815892 wait complete. 2023-12-22T08:40:09.731 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":83768},{"type":"v1","addr":"172.21.15.89:6833","nonce":83768}]},"active_addr":"172.21.15.89:6833/83768","active_change":"2023-12-22T08:39:46.330948+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":415314368}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":2659315067}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":418592802}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":32127040}]}]} 2023-12-22T08:40:09.735 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-22T08:40:09.735 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-22T08:40:09.735 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:09.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.957+0000 7fe1cde31640 1 Processor -- start 2023-12-22T08:40:09.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.958+0000 7fe1cde31640 1 -- start start 2023-12-22T08:40:09.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.959+0000 7fe1cde31640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe1c815e740 0x7fe1c815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:09.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.959+0000 7fe1cde31640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe1c80b3f90 0x7fe1c8070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:09.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.959+0000 7fe1cde31640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c815eb20 con 0x7fe1c806ca50 2023-12-22T08:40:09.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.960+0000 7fe1cde31640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c806e650 con 0x7fe1c815e740 2023-12-22T08:40:09.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.960+0000 7fe1cde31640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c8070770 con 0x7fe1c80b3f90 2023-12-22T08:40:09.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.960+0000 7fe1c77fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe1c815e740 0x7fe1c815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:09.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.960+0000 7fe1c77fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe1c815e740 0x7fe1c815db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42332/0 (socket says 172.21.15.38:42332) 2023-12-22T08:40:09.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.960+0000 7fe1c77fe640 1 -- 172.21.15.38:0/334456721 learned_addr learned my addr 172.21.15.38:0/334456721 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:09.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.960+0000 7fe1c77fe640 1 -- 172.21.15.38:0/334456721 >> v2:172.21.15.89:3300/0 conn(0x7fe1c80b3f90 msgr2=0x7fe1c8070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:09.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.960+0000 7fe1c77fe640 1 --2- 172.21.15.38:0/334456721 >> v2:172.21.15.89:3300/0 conn(0x7fe1c80b3f90 0x7fe1c8070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.960+0000 7fe1c77fe640 1 -- 172.21.15.38:0/334456721 >> v1:172.21.15.89:6789/0 conn(0x7fe1c806ca50 legacy=0x7fe1c80b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:09.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.960+0000 7fe1c77fe640 1 -- 172.21.15.38:0/334456721 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c806cec0 con 0x7fe1c815e740 2023-12-22T08:40:09.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.961+0000 7fe1c77fe640 1 --2- 172.21.15.38:0/334456721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c815e740 0x7fe1c815db30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1c815b700 tx=0x7fe1b802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282b21d82ec9fcf0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:09.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.962+0000 7fe1c6ffd640 1 -- 172.21.15.38:0/334456721 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b802c960 con 0x7fe1c815e740 2023-12-22T08:40:09.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.962+0000 7fe1c6ffd640 1 -- 172.21.15.38:0/334456721 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b802cac0 con 0x7fe1c815e740 2023-12-22T08:40:09.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.962+0000 7fe1c6ffd640 1 -- 172.21.15.38:0/334456721 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b802ce50 con 0x7fe1c815e740 2023-12-22T08:40:09.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.962+0000 7fe1cde31640 1 -- 172.21.15.38:0/334456721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c815e740 msgr2=0x7fe1c815db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:09.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.962+0000 7fe1cde31640 1 --2- 172.21.15.38:0/334456721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c815e740 0x7fe1c815db30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe1c815b700 tx=0x7fe1b802bdc0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.962+0000 7fe1cde31640 1 -- 172.21.15.38:0/334456721 shutdown_connections 2023-12-22T08:40:09.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.962+0000 7fe1cde31640 1 --2- 172.21.15.38:0/334456721 >> v2:172.21.15.89:3300/0 conn(0x7fe1c80b3f90 0x7fe1c8070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.962+0000 7fe1cde31640 1 --2- 172.21.15.38:0/334456721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c815e740 0x7fe1c815db30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.962+0000 7fe1cde31640 1 -- 172.21.15.38:0/334456721 >> 172.21.15.38:0/334456721 conn(0x7fe1c80cfea0 msgr2=0x7fe1c80d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:09.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.963+0000 7fe1cde31640 1 -- 172.21.15.38:0/334456721 shutdown_connections 2023-12-22T08:40:09.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.963+0000 7fe1cde31640 1 -- 172.21.15.38:0/334456721 wait complete. 2023-12-22T08:40:09.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.964+0000 7fe1cde31640 1 Processor -- start 2023-12-22T08:40:09.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.965+0000 7fe1cde31640 1 -- start start 2023-12-22T08:40:09.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.965+0000 7fe1cde31640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c806ca50 0x7fe1c81576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:09.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1cde31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c80b3f90 0x7fe1c8146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:09.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1cde31640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c815e740 0x7fe1c81f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:09.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1cde31640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8157c00 con 0x7fe1c815e740 2023-12-22T08:40:09.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1cde31640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8151770 con 0x7fe1c80b3f90 2023-12-22T08:40:09.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1cde31640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c81471f0 con 0x7fe1c806ca50 2023-12-22T08:40:09.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1c7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c815e740 0x7fe1c81f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:09.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1c7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c815e740 0x7fe1c81f33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42346/0 (socket says 172.21.15.38:42346) 2023-12-22T08:40:09.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1c7fff640 1 -- 172.21.15.38:0/3598954995 learned_addr learned my addr 172.21.15.38:0/3598954995 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:09.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1beffd640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c80b3f90 0x7fe1c8146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:09.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1c77fe640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c806ca50 0x7fe1c81576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:09.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1c7fff640 1 -- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c806ca50 msgr2=0x7fe1c81576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:09.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1c7fff640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c806ca50 0x7fe1c81576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1c7fff640 1 -- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c80b3f90 msgr2=0x7fe1c8146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:09.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1c7fff640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c80b3f90 0x7fe1c8146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:09.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1c7fff640 1 -- 172.21.15.38:0/3598954995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8009b30 con 0x7fe1c815e740 2023-12-22T08:40:09.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.966+0000 7fe1c77fe640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c806ca50 0x7fe1c81576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:09.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.967+0000 7fe1c7fff640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c815e740 0x7fe1c81f33e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009fd0 tx=0x7fe1c000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:09.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.967+0000 7fe1c4ff9640 1 -- 172.21.15.38:0/3598954995 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0011830 con 0x7fe1c815e740 2023-12-22T08:40:09.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.967+0000 7fe1c4ff9640 1 -- 172.21.15.38:0/3598954995 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c0011990 con 0x7fe1c815e740 2023-12-22T08:40:09.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.967+0000 7fe1cde31640 1 -- 172.21.15.38:0/3598954995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c81594c0 con 0x7fe1c815e740 2023-12-22T08:40:09.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.967+0000 7fe1c4ff9640 1 -- 172.21.15.38:0/3598954995 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0011d20 con 0x7fe1c815e740 2023-12-22T08:40:09.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.967+0000 7fe1cde31640 1 -- 172.21.15.38:0/3598954995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c8159a80 con 0x7fe1c815e740 2023-12-22T08:40:09.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.968+0000 7fe1cde31640 1 -- 172.21.15.38:0/3598954995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c8061910 con 0x7fe1c815e740 2023-12-22T08:40:09.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.969+0000 7fe1c4ff9640 1 -- 172.21.15.38:0/3598954995 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe1c001b460 con 0x7fe1c815e740 2023-12-22T08:40:09.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.970+0000 7fe1c4ff9640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1a806a460 0x7fe1a806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:09.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.970+0000 7fe1c4ff9640 1 -- 172.21.15.38:0/3598954995 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1c0088660 con 0x7fe1c815e740 2023-12-22T08:40:09.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.971+0000 7fe1c77fe640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1a806a460 0x7fe1a806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:09.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.972+0000 7fe1c77fe640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1a806a460 0x7fe1a806c920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8035000 tx=0x7fe1b8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:09.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:09.975+0000 7fe1c4ff9640 1 -- 172.21.15.38:0/3598954995 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe1c0053ce0 con 0x7fe1c815e740 2023-12-22T08:40:10.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.169+0000 7fe1cde31640 1 -- 172.21.15.38:0/3598954995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1c806c340 con 0x7fe1c815e740 2023-12-22T08:40:10.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.172+0000 7fe1c4ff9640 1 -- 172.21.15.38:0/3598954995 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15993 (secure 0 0 0) 0x7fe1c0057300 con 0x7fe1c815e740 2023-12-22T08:40:10.175 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:10.175 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:59.604518+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:10.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.175+0000 7fe1cde31640 1 -- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1a806a460 msgr2=0x7fe1a806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.175+0000 7fe1cde31640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1a806a460 0x7fe1a806c920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8035000 tx=0x7fe1b8030000 comp rx=0 tx=0).stop 2023-12-22T08:40:10.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.175+0000 7fe1cde31640 1 -- 172.21.15.38:0/3598954995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c815e740 msgr2=0x7fe1c81f33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.175+0000 7fe1cde31640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c815e740 0x7fe1c81f33e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009fd0 tx=0x7fe1c000b8e0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.175+0000 7fe1cde31640 1 -- 172.21.15.38:0/3598954995 shutdown_connections 2023-12-22T08:40:10.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.175+0000 7fe1cde31640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1a806a460 0x7fe1a806c920 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.175+0000 7fe1cde31640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c815e740 0x7fe1c81f33e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.175+0000 7fe1cde31640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1c80b3f90 0x7fe1c8146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.175+0000 7fe1cde31640 1 --2- 172.21.15.38:0/3598954995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1c806ca50 0x7fe1c81576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.175+0000 7fe1cde31640 1 -- 172.21.15.38:0/3598954995 >> 172.21.15.38:0/3598954995 conn(0x7fe1c80cfea0 msgr2=0x7fe1c8160f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:10.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.175+0000 7fe1cde31640 1 -- 172.21.15.38:0/3598954995 shutdown_connections 2023-12-22T08:40:10.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.175+0000 7fe1cde31640 1 -- 172.21.15.38:0/3598954995 wait complete. 2023-12-22T08:40:10.196 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-22T08:40:10.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:10.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.404+0000 7f1eba6ca640 1 Processor -- start 2023-12-22T08:40:10.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.405+0000 7f1eba6ca640 1 -- start start 2023-12-22T08:40:10.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.406+0000 7f1eba6ca640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1eb415e740 0x7f1eb415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.406+0000 7f1eba6ca640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1eb406ca50 0x7f1eb40b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.406+0000 7f1eba6ca640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb40b4210 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.406+0000 7f1eba6ca640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb406e650 con 0x7f1eb415e740 2023-12-22T08:40:10.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.406+0000 7f1eba6ca640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb415eb20 con 0x7f1eb406ca50 2023-12-22T08:40:10.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.407+0000 7f1eb3fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1eb415e740 0x7f1eb415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.407+0000 7f1eb3fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1eb415e740 0x7f1eb415db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42360/0 (socket says 172.21.15.38:42360) 2023-12-22T08:40:10.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.407+0000 7f1eb3fff640 1 -- 172.21.15.38:0/1687819065 learned_addr learned my addr 172.21.15.38:0/1687819065 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:10.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.407+0000 7f1eb3fff640 1 -- 172.21.15.38:0/1687819065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1eb406ca50 msgr2=0x7f1eb40b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:10.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.407+0000 7f1eb37fe640 1 --2- 172.21.15.38:0/1687819065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1eb406ca50 0x7f1eb40b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.407+0000 7f1eb3fff640 1 --2- 172.21.15.38:0/1687819065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1eb406ca50 0x7f1eb40b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.407+0000 7f1eb3fff640 1 -- 172.21.15.38:0/1687819065 >> v1:172.21.15.89:6789/0 conn(0x7f1eb40b3dc0 legacy=0x7f1eb4161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.407+0000 7f1eb3fff640 1 -- 172.21.15.38:0/1687819065 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb4070770 con 0x7f1eb415e740 2023-12-22T08:40:10.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.407+0000 7f1eb37fe640 1 --2- 172.21.15.38:0/1687819065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1eb406ca50 0x7f1eb40b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:10.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.408+0000 7f1eb3fff640 1 --2- 172.21.15.38:0/1687819065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1eb415e740 0x7f1eb415db30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009e50 tx=0x7f1ea402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ab782eac13e537 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:10.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.409+0000 7f1eb2ffd640 1 -- 172.21.15.38:0/1687819065 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea402c9f0 con 0x7f1eb415e740 2023-12-22T08:40:10.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.409+0000 7f1eb2ffd640 1 -- 172.21.15.38:0/1687819065 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea402cb50 con 0x7f1eb415e740 2023-12-22T08:40:10.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.409+0000 7f1eb2ffd640 1 -- 172.21.15.38:0/1687819065 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea40343f0 con 0x7f1eb415e740 2023-12-22T08:40:10.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.409+0000 7f1eba6ca640 1 -- 172.21.15.38:0/1687819065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1eb415e740 msgr2=0x7f1eb415db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.409+0000 7f1eba6ca640 1 --2- 172.21.15.38:0/1687819065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1eb415e740 0x7f1eb415db30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009e50 tx=0x7f1ea402be50 comp rx=0 tx=0).stop 2023-12-22T08:40:10.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.409+0000 7f1eba6ca640 1 -- 172.21.15.38:0/1687819065 shutdown_connections 2023-12-22T08:40:10.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.409+0000 7f1eba6ca640 1 --2- 172.21.15.38:0/1687819065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1eb406ca50 0x7f1eb40b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.409+0000 7f1eba6ca640 1 --2- 172.21.15.38:0/1687819065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1eb415e740 0x7f1eb415db30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.409+0000 7f1eba6ca640 1 -- 172.21.15.38:0/1687819065 >> 172.21.15.38:0/1687819065 conn(0x7f1eb40cfea0 msgr2=0x7f1eb40d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:10.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.409+0000 7f1eba6ca640 1 -- 172.21.15.38:0/1687819065 shutdown_connections 2023-12-22T08:40:10.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.409+0000 7f1eba6ca640 1 -- 172.21.15.38:0/1687819065 wait complete. 2023-12-22T08:40:10.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.411+0000 7f1eba6ca640 1 Processor -- start 2023-12-22T08:40:10.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.411+0000 7f1eba6ca640 1 -- start start 2023-12-22T08:40:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.412+0000 7f1eba6ca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1eb406ca50 0x7f1eb41581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.412+0000 7f1eba6ca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1eb40b3dc0 0x7f1eb415ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.412+0000 7f1eba6ca640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1eb415e740 0x7f1eb414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.412+0000 7f1eba6ca640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb40b6b80 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.412+0000 7f1eba6ca640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb41550a0 con 0x7f1eb406ca50 2023-12-22T08:40:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.412+0000 7f1eba6ca640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb4155380 con 0x7f1eb415e740 2023-12-22T08:40:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.413+0000 7f1eb37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1eb40b3dc0 0x7f1eb415ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.413+0000 7f1eb37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1eb40b3dc0 0x7f1eb415ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42376/0 (socket says 172.21.15.38:42376) 2023-12-22T08:40:10.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.413+0000 7f1eb37fe640 1 -- 172.21.15.38:0/3994730853 learned_addr learned my addr 172.21.15.38:0/3994730853 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.413+0000 7f1eb3fff640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1eb406ca50 0x7f1eb41581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.413+0000 7f1eb8c67640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1eb415e740 0x7f1eb414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.413+0000 7f1eb37fe640 1 -- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1eb415e740 msgr2=0x7f1eb414db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.413+0000 7f1eb37fe640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1eb415e740 0x7f1eb414db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.413+0000 7f1eb37fe640 1 -- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1eb406ca50 msgr2=0x7f1eb41581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.413+0000 7f1eb37fe640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1eb406ca50 0x7f1eb41581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.413+0000 7f1eb37fe640 1 -- 172.21.15.38:0/3994730853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea4009b30 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.414+0000 7f1eb37fe640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1eb40b3dc0 0x7f1eb415ca10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00c7f0 tx=0x7f1e9c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.414+0000 7f1eb0ff9640 1 -- 172.21.15.38:0/3994730853 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c007a30 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.414+0000 7f1eb0ff9640 1 -- 172.21.15.38:0/3994730853 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c007b90 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.414+0000 7f1eb0ff9640 1 -- 172.21.15.38:0/3994730853 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c00ce40 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.414+0000 7f1eba6ca640 1 -- 172.21.15.38:0/3994730853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb4155660 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.414+0000 7f1eba6ca640 1 -- 172.21.15.38:0/3994730853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb415cf50 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.415+0000 7f1eba6ca640 1 -- 172.21.15.38:0/3994730853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb40b6d80 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.416+0000 7f1eb0ff9640 1 -- 172.21.15.38:0/3994730853 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1e9c0113f0 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.417+0000 7f1eb0ff9640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e9406a430 0x7f1e9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.418+0000 7f1eb0ff9640 1 -- 172.21.15.38:0/3994730853 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e9c088af0 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.418+0000 7f1eb3fff640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e9406a430 0x7f1e9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.419+0000 7f1eb3fff640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e9406a430 0x7f1e9406c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4035000 tx=0x7f1ea4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:10.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.422+0000 7f1eb0ff9640 1 -- 172.21.15.38:0/3994730853 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1eb40b6d80 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.619+0000 7f1eba6ca640 1 -- 172.21.15.38:0/3994730853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1eb4061910 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.622+0000 7f1eb0ff9640 1 -- 172.21.15.38:0/3994730853 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f1e9c01f090 con 0x7f1eb40b3dc0 2023-12-22T08:40:10.624 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:10.625 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:59.604518+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:10.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.624+0000 7f1eba6ca640 1 -- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e9406a430 msgr2=0x7f1e9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.624+0000 7f1eba6ca640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e9406a430 0x7f1e9406c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4035000 tx=0x7f1ea4030000 comp rx=0 tx=0).stop 2023-12-22T08:40:10.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.624+0000 7f1eba6ca640 1 -- 172.21.15.38:0/3994730853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1eb40b3dc0 msgr2=0x7f1eb415ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.624+0000 7f1eba6ca640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1eb40b3dc0 0x7f1eb415ca10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00c7f0 tx=0x7f1e9c00cbf0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.625+0000 7f1eba6ca640 1 -- 172.21.15.38:0/3994730853 shutdown_connections 2023-12-22T08:40:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.625+0000 7f1eba6ca640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1eb415e740 0x7f1eb414db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.625+0000 7f1eba6ca640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e9406a430 0x7f1e9406c8f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.625+0000 7f1eba6ca640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1eb40b3dc0 0x7f1eb415ca10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.625+0000 7f1eba6ca640 1 --2- 172.21.15.38:0/3994730853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1eb406ca50 0x7f1eb41581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.625+0000 7f1eba6ca640 1 -- 172.21.15.38:0/3994730853 >> 172.21.15.38:0/3994730853 conn(0x7f1eb40cfea0 msgr2=0x7f1eb40d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.625+0000 7f1eba6ca640 1 -- 172.21.15.38:0/3994730853 shutdown_connections 2023-12-22T08:40:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.625+0000 7f1eba6ca640 1 -- 172.21.15.38:0/3994730853 wait complete. 2023-12-22T08:40:10.647 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-22T08:40:10.648 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-22T08:40:10.648 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-22T08:40:10.649 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-22T08:40:10.649 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-22T08:40:10.649 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-22T08:40:10.650 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-22T08:40:10.650 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-22T08:40:10.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.953+0000 7f0c75d01640 1 Processor -- start 2023-12-22T08:40:10.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.953+0000 7f0c75d01640 1 -- start start 2023-12-22T08:40:10.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.956+0000 7f0c75d01640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68038ea0 0x7f0c6803a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.956+0000 7f0c75d01640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c68055e40 con 0x7f0c680e1230 2023-12-22T08:40:10.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.956+0000 7f0c75d01640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c680e1610 con 0x7f0c680562d0 2023-12-22T08:40:10.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.956+0000 7f0c75d01640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68054f60 con 0x7f0c68038ea0 2023-12-22T08:40:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.957+0000 7f0c6f7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0c680e1230 0x7f0c68054850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51584/0 (socket says 172.21.15.38:51584) 2023-12-22T08:40:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.957+0000 7f0c6f7fe640 1 -- 172.21.15.38:0/857436219 learned_addr learned my addr 172.21.15.38:0/857436219 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:10.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.958+0000 7f0c6ffff640 1 --2- 172.21.15.38:0/857436219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68038ea0 0x7f0c6803a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.959+0000 7f0c6e7fc640 1 -- 172.21.15.38:0/857436219 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309227469 0 0) 0x7f0c68055e40 con 0x7f0c680e1230 2023-12-22T08:40:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.959+0000 7f0c6e7fc640 1 -- 172.21.15.38:0/857436219 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c60003520 con 0x7f0c680e1230 2023-12-22T08:40:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.959+0000 7f0c6e7fc640 1 -- 172.21.15.38:0/857436219 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533143498 0 0) 0x7f0c680e1610 con 0x7f0c680562d0 2023-12-22T08:40:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.959+0000 7f0c6e7fc640 1 -- 172.21.15.38:0/857436219 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c68055e40 con 0x7f0c680562d0 2023-12-22T08:40:10.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.960+0000 7f0c6ffff640 1 -- 172.21.15.38:0/857436219 >> v1:172.21.15.89:6789/0 conn(0x7f0c680562d0 legacy=0x7f0c68038790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.960+0000 7f0c6ffff640 1 -- 172.21.15.38:0/857436219 >> v1:172.21.15.38:6789/0 conn(0x7f0c680e1230 legacy=0x7f0c68054850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.960+0000 7f0c6ffff640 1 -- 172.21.15.38:0/857436219 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c68055230 con 0x7f0c68038ea0 2023-12-22T08:40:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.961+0000 7f0c6ffff640 1 --2- 172.21.15.38:0/857436219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68038ea0 0x7f0c6803a1b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0c70074a40 tx=0x7f0c70070f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8932abcb96912399 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.962+0000 7f0c6e7fc640 1 -- 172.21.15.38:0/857436219 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c700b31d0 con 0x7f0c68038ea0 2023-12-22T08:40:10.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.962+0000 7f0c6e7fc640 1 -- 172.21.15.38:0/857436219 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c700a9030 con 0x7f0c68038ea0 2023-12-22T08:40:10.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.963+0000 7f0c6e7fc640 1 -- 172.21.15.38:0/857436219 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c700b3600 con 0x7f0c68038ea0 2023-12-22T08:40:10.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.964+0000 7f0c75d01640 1 -- 172.21.15.38:0/857436219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68038ea0 msgr2=0x7f0c6803a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.964+0000 7f0c75d01640 1 --2- 172.21.15.38:0/857436219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68038ea0 0x7f0c6803a1b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0c70074a40 tx=0x7f0c70070f90 comp rx=0 tx=0).stop 2023-12-22T08:40:10.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.964+0000 7f7b55f6e640 1 Processor -- start 2023-12-22T08:40:10.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.964+0000 7f7b55f6e640 1 -- start start 2023-12-22T08:40:10.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.964+0000 7f0c75d01640 1 -- 172.21.15.38:0/857436219 shutdown_connections 2023-12-22T08:40:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.964+0000 7f0c75d01640 1 --2- 172.21.15.38:0/857436219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68038ea0 0x7f0c6803a1b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.964+0000 7f0c75d01640 1 -- 172.21.15.38:0/857436219 >> 172.21.15.38:0/857436219 conn(0x7f0c68056d10 msgr2=0x7f0c680570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.966+0000 7f0c75d01640 1 -- 172.21.15.38:0/857436219 shutdown_connections 2023-12-22T08:40:10.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.966+0000 7f0c75d01640 1 -- 172.21.15.38:0/857436219 wait complete. 2023-12-22T08:40:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.966+0000 7f7b55f6e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b480e3240 0x7f7b4804f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.966+0000 7f7b55f6e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7b4804fd90 0x7f7b48052c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.966+0000 7f7b55f6e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b480501f0 con 0x7f7b48053190 2023-12-22T08:40:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.966+0000 7f7b55f6e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b480e3620 con 0x7f7b4804fd90 2023-12-22T08:40:10.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.966+0000 7f7b55f6e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48053910 con 0x7f7b480e3240 2023-12-22T08:40:10.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.967+0000 7f7b4ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7b48053190 0x7f7b48005db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51588/0 (socket says 172.21.15.38:51588) 2023-12-22T08:40:10.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.967+0000 7f7b4ffff640 1 -- 172.21.15.38:0/1111889884 learned_addr learned my addr 172.21.15.38:0/1111889884 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:10.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.967+0000 7f7b4effd640 1 --2- 172.21.15.38:0/1111889884 >> v2:172.21.15.38:3300/0 conn(0x7f7b4804fd90 0x7f7b48052c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.968+0000 7f7b4effd640 1 -- 172.21.15.38:0/1111889884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b480e3240 msgr2=0x7f7b4804f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:10.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.968+0000 7f7b4effd640 1 --2- 172.21.15.38:0/1111889884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b480e3240 0x7f7b4804f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.968+0000 7f7b4effd640 1 -- 172.21.15.38:0/1111889884 >> v1:172.21.15.38:6789/0 conn(0x7f7b48053190 legacy=0x7f7b48005db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.968+0000 7f7b4effd640 1 -- 172.21.15.38:0/1111889884 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b48053bf0 con 0x7f7b4804fd90 2023-12-22T08:40:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.966+0000 7f7f4dbd9640 1 Processor -- start 2023-12-22T08:40:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.969+0000 7f0c75d01640 1 Processor -- start 2023-12-22T08:40:10.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.969+0000 7f0c75d01640 1 -- start start 2023-12-22T08:40:10.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.969+0000 7f7b4effd640 1 --2- 172.21.15.38:0/1111889884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4804fd90 0x7f7b48052c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0097a0 tx=0x7f7b3c02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ede228557e10ee0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:10.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.970+0000 7f7c25dd0640 1 Processor -- start 2023-12-22T08:40:10.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.970+0000 7f7c25dd0640 1 -- start start 2023-12-22T08:40:10.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.968+0000 7f7f4dbd9640 1 -- start start 2023-12-22T08:40:10.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.970+0000 7f7b4e7fc640 1 -- 172.21.15.38:0/1111889884 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c030710 con 0x7f7b4804fd90 2023-12-22T08:40:10.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.970+0000 7f7b4e7fc640 1 -- 172.21.15.38:0/1111889884 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c02e050 con 0x7f7b4804fd90 2023-12-22T08:40:10.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.970+0000 7f7b4e7fc640 1 -- 172.21.15.38:0/1111889884 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c030a90 con 0x7f7b4804fd90 2023-12-22T08:40:10.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.970+0000 7f7f4dbd9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f4815e740 0x7f7f4815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.970+0000 7f7f4dbd9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7f4806ca50 0x7f7f480b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.971+0000 7f7f4dbd9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f480b4210 con 0x7f7f480b3dc0 2023-12-22T08:40:10.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.971+0000 7f7f4dbd9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f4806e650 con 0x7f7f4806ca50 2023-12-22T08:40:10.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.971+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1111889884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4804fd90 msgr2=0x7f7b48052c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.971+0000 7f7b55f6e640 1 --2- 172.21.15.38:0/1111889884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4804fd90 0x7f7b48052c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0097a0 tx=0x7f7b3c02b790 comp rx=0 tx=0).stop 2023-12-22T08:40:10.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.971+0000 7f7f4dbd9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4815eb20 con 0x7f7f4815e740 2023-12-22T08:40:10.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.971+0000 7f7f477fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f4815e740 0x7f7f4815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.971+0000 7f7f47fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7f480b3dc0 0x7f7f48161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:51472/0 (socket says 172.21.15.38:51472) 2023-12-22T08:40:10.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.971+0000 7f7f47fff640 1 -- 172.21.15.38:0/3646962960 learned_addr learned my addr 172.21.15.38:0/3646962960 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:10.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.971+0000 7f7f3effd640 1 --2- 172.21.15.38:0/3646962960 >> v2:172.21.15.89:3300/0 conn(0x7f7f4806ca50 0x7f7f480b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f0c75d01640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68038ea0 0x7f0c6804c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f0c75d01640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680562d0 0x7f0c6804ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f7c25dd0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c2015e740 0x7f7c2015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f7c25dd0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7c2006ca50 0x7f7c200b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f7f477fe640 1 -- 172.21.15.38:0/3646962960 >> v2:172.21.15.89:3300/0 conn(0x7f7f4806ca50 msgr2=0x7f7f480b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:10.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f14e3a31640 1 Processor -- start 2023-12-22T08:40:10.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f7f477fe640 1 --2- 172.21.15.38:0/3646962960 >> v2:172.21.15.89:3300/0 conn(0x7f7f4806ca50 0x7f7f480b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f7f477fe640 1 -- 172.21.15.38:0/3646962960 >> v1:172.21.15.89:6789/0 conn(0x7f7f480b3dc0 legacy=0x7f7f48161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f7f477fe640 1 -- 172.21.15.38:0/3646962960 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f48070770 con 0x7f7f4815e740 2023-12-22T08:40:10.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f7c25dd0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c200b3dc0 0x7f7c20161120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f7c25dd0640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2006e650 con 0x7f7c2015e740 2023-12-22T08:40:10.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f7c25dd0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c200b4210 con 0x7f7c2006ca50 2023-12-22T08:40:10.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f7c25dd0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2015eb20 con 0x7f7c200b3dc0 2023-12-22T08:40:10.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f7c1f7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c2015e740 0x7f7c2015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f7c1f7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c2015e740 0x7f7c2015db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42400/0 (socket says 172.21.15.38:42400) 2023-12-22T08:40:10.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f7c1f7fe640 1 -- 172.21.15.38:0/390837713 learned_addr learned my addr 172.21.15.38:0/390837713 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:10.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f7c1ffff640 1 --2- 172.21.15.38:0/390837713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c200b3dc0 0x7f7c20161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f7c1f7fe640 1 -- 172.21.15.38:0/390837713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c200b3dc0 msgr2=0x7f7c20161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:10.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f7c1f7fe640 1 --2- 172.21.15.38:0/390837713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c200b3dc0 0x7f7c20161120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f7c1f7fe640 1 -- 172.21.15.38:0/390837713 >> v2:172.21.15.89:3300/0 conn(0x7f7c2006ca50 msgr2=0x7f7c200b3880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-22T08:40:10.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f7c1f7fe640 1 --2- 172.21.15.38:0/390837713 >> v2:172.21.15.89:3300/0 conn(0x7f7c2006ca50 0x7f7c200b3880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f7c1f7fe640 1 -- 172.21.15.38:0/390837713 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c20070770 con 0x7f7c2015e740 2023-12-22T08:40:10.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.972+0000 7f14e3a31640 1 -- start start 2023-12-22T08:40:10.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f0c75d01640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680e1230 0x7f0c68179510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f0c75d01640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6804be60 con 0x7f0c680e1230 2023-12-22T08:40:10.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f0c75d01640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68179a50 con 0x7f0c680562d0 2023-12-22T08:40:10.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f0c75d01640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6804b1e0 con 0x7f0c68038ea0 2023-12-22T08:40:10.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f0c6f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68038ea0 0x7f0c6804c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.974+0000 7f0c6f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68038ea0 0x7f0c6804c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:59122/0 (socket says 172.21.15.38:59122) 2023-12-22T08:40:10.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.974+0000 7f0c6f7fe640 1 -- 172.21.15.38:0/2068312053 learned_addr learned my addr 172.21.15.38:0/2068312053 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:10.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.974+0000 7f0c6ffff640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680e1230 0x7f0c68179510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.974+0000 7f0c6effd640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680562d0 0x7f0c6804ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.974+0000 7f0c6ffff640 1 -- 172.21.15.38:0/2068312053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68038ea0 msgr2=0x7f0c6804c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.974+0000 7f0c6ffff640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68038ea0 0x7f0c6804c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.974+0000 7f0c6ffff640 1 -- 172.21.15.38:0/2068312053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680562d0 msgr2=0x7f0c6804ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.974+0000 7f0c6ffff640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680562d0 0x7f0c6804ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.974+0000 7f0c6ffff640 1 -- 172.21.15.38:0/2068312053 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7006ee70 con 0x7f0c680e1230 2023-12-22T08:40:10.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.974+0000 7f0c6effd640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680562d0 0x7f0c6804ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:10.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.974+0000 7f14e3a31640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14dc15e740 0x7f14dc15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.975+0000 7f14e3a31640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f14dc06ca50 0x7f14dc0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.975+0000 7f14e3a31640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14dc0b4210 con 0x7f14dc0b3dc0 2023-12-22T08:40:10.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1111889884 shutdown_connections 2023-12-22T08:40:10.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f7b55f6e640 1 --2- 172.21.15.38:0/1111889884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4804fd90 0x7f7b48052c50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f7b55f6e640 1 --2- 172.21.15.38:0/1111889884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b480e3240 0x7f7b4804f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.973+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1111889884 >> 172.21.15.38:0/1111889884 conn(0x7f7b48009f90 msgr2=0x7f7b4800a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:10.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.974+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1111889884 shutdown_connections 2023-12-22T08:40:10.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.974+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1111889884 wait complete. 2023-12-22T08:40:10.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.975+0000 7f7c1f7fe640 1 --2- 172.21.15.38:0/390837713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2015e740 0x7f7c2015db30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7c200d32d0 tx=0x7f7c1002b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3f3940f0932c5d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:10.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.975+0000 7f7f477fe640 1 --2- 172.21.15.38:0/3646962960 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f4815e740 0x7f7f4815db30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f300097a0 tx=0x7f7f3002b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=282d0ed92ba0023c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:10.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.975+0000 7f14e3a31640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14dc06e650 con 0x7f14dc06ca50 2023-12-22T08:40:10.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.975+0000 7f14e3a31640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc15eb20 con 0x7f14dc15e740 2023-12-22T08:40:10.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.975+0000 7f14e1fce640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f14dc0b3dc0 0x7f14dc161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51598/0 (socket says 172.21.15.38:51598) 2023-12-22T08:40:10.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.975+0000 7f14e1fce640 1 -- 172.21.15.38:0/1300705895 learned_addr learned my addr 172.21.15.38:0/1300705895 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:10.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.975+0000 7fc208226640 1 Processor -- start 2023-12-22T08:40:10.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.975+0000 7f7c1e7fc640 1 -- 172.21.15.38:0/390837713 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10031760 con 0x7f7c2015e740 2023-12-22T08:40:10.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.976+0000 7f7c1e7fc640 1 -- 172.21.15.38:0/390837713 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c100318c0 con 0x7f7c2015e740 2023-12-22T08:40:10.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.976+0000 7f7c1e7fc640 1 -- 172.21.15.38:0/390837713 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10031c50 con 0x7f7c2015e740 2023-12-22T08:40:10.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.976+0000 7f14e0fcc640 1 --2- 172.21.15.38:0/1300705895 >> v2:172.21.15.89:3300/0 conn(0x7f14dc06ca50 0x7f14dc0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.976+0000 7fc208226640 1 -- start start 2023-12-22T08:40:10.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.976+0000 7f7f46ffd640 1 -- 172.21.15.38:0/3646962960 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30031520 con 0x7f7f4815e740 2023-12-22T08:40:10.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.976+0000 7f7f46ffd640 1 -- 172.21.15.38:0/3646962960 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f30031680 con 0x7f7f4815e740 2023-12-22T08:40:10.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.976+0000 7f7f46ffd640 1 -- 172.21.15.38:0/3646962960 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f300319f0 con 0x7f7f4815e740 2023-12-22T08:40:10.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.976+0000 7f0c6ffff640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680e1230 0x7f0c68179510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0c70000b60 tx=0x7f0c70067e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:10.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.976+0000 7f14d3fff640 1 -- 172.21.15.38:0/1300705895 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425092398 0 0) 0x7f14d8001110 con 0x7f14dc0b3dc0 2023-12-22T08:40:10.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.976+0000 7f14d3fff640 1 -- 172.21.15.38:0/1300705895 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14c8003520 con 0x7f14dc0b3dc0 2023-12-22T08:40:10.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.976+0000 7f14e17cd640 1 --2- 172.21.15.38:0/1300705895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14dc15e740 0x7f14dc15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.976+0000 7f7c25dd0640 1 -- 172.21.15.38:0/390837713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2015e740 msgr2=0x7f7c2015db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7c25dd0640 1 --2- 172.21.15.38:0/390837713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2015e740 0x7f7c2015db30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7c200d32d0 tx=0x7f7c1002b800 comp rx=0 tx=0).stop 2023-12-22T08:40:10.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 -- 172.21.15.38:0/1300705895 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 567622369 0 0) 0x7f14c8003520 con 0x7f14dc0b3dc0 2023-12-22T08:40:10.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 -- 172.21.15.38:0/1300705895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14dc15e740 msgr2=0x7f14dc15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/3646962960 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f4815e740 msgr2=0x7f7f4815db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7f4dbd9640 1 --2- 172.21.15.38:0/3646962960 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f4815e740 0x7f7f4815db30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f300097a0 tx=0x7f7f3002b7c0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7c25dd0640 1 -- 172.21.15.38:0/390837713 shutdown_connections 2023-12-22T08:40:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7c25dd0640 1 --2- 172.21.15.38:0/390837713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c200b3dc0 0x7f7c20161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7c25dd0640 1 --2- 172.21.15.38:0/390837713 >> v2:172.21.15.89:3300/0 conn(0x7f7c2006ca50 0x7f7c200b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7c25dd0640 1 --2- 172.21.15.38:0/390837713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2015e740 0x7f7c2015db30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7c25dd0640 1 -- 172.21.15.38:0/390837713 >> 172.21.15.38:0/390837713 conn(0x7f7c200cfea0 msgr2=0x7f7c200d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:10.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/3646962960 shutdown_connections 2023-12-22T08:40:10.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7f4dbd9640 1 --2- 172.21.15.38:0/3646962960 >> v2:172.21.15.89:3300/0 conn(0x7f7f4806ca50 0x7f7f480b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7f4dbd9640 1 --2- 172.21.15.38:0/3646962960 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f4815e740 0x7f7f4815db30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/3646962960 >> 172.21.15.38:0/3646962960 conn(0x7f7f480cfea0 msgr2=0x7f7f480d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:10.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7c25dd0640 1 -- 172.21.15.38:0/390837713 shutdown_connections 2023-12-22T08:40:10.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f7c25dd0640 1 -- 172.21.15.38:0/390837713 wait complete. 2023-12-22T08:40:10.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 --2- 172.21.15.38:0/1300705895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14dc15e740 0x7f14dc15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 -- 172.21.15.38:0/1300705895 >> v2:172.21.15.89:3300/0 conn(0x7f14dc06ca50 msgr2=0x7f14dc0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:10.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 --2- 172.21.15.38:0/1300705895 >> v2:172.21.15.89:3300/0 conn(0x7f14dc06ca50 0x7f14dc0b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:10.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 -- 172.21.15.38:0/1300705895 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc070770 con 0x7f14dc0b3dc0 2023-12-22T08:40:10.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 -- 172.21.15.38:0/1300705895 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f14d8001800 con 0x7f14dc0b3dc0 2023-12-22T08:40:10.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 -- 172.21.15.38:0/1300705895 >> v1:172.21.15.38:6789/0 conn(0x7f14dc0b3dc0 legacy=0x7f14dc161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 --2- 172.21.15.38:0/1300705895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14c8003970 0x7f14c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 --2- 172.21.15.38:0/1300705895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14c80047c0 0x7f14c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 --2- 172.21.15.38:0/1300705895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14dc15e740 0x7f14c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 -- 172.21.15.38:0/1300705895 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc06e650 con 0x7f14c80047c0 2023-12-22T08:40:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 -- 172.21.15.38:0/1300705895 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc15eb20 con 0x7f14c8003970 2023-12-22T08:40:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.977+0000 7f14d3fff640 1 -- 172.21.15.38:0/1300705895 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80142c0 con 0x7f14dc15e740 2023-12-22T08:40:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7f0c5bfff640 1 -- 172.21.15.38:0/2068312053 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c700b3e90 con 0x7f0c680e1230 2023-12-22T08:40:10.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7f7b55f6e640 1 Processor -- start 2023-12-22T08:40:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7f14e1fce640 1 --2- 172.21.15.38:0/1300705895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14dc15e740 0x7f14c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7f14e17cd640 1 --2- 172.21.15.38:0/1300705895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14c8003970 0x7f14c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7f0c5bfff640 1 -- 172.21.15.38:0/2068312053 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c700ac070 con 0x7f0c680e1230 2023-12-22T08:40:10.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7f7b55f6e640 1 -- start start 2023-12-22T08:40:10.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7fc208226640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc200161df0 0x7fc2001611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7fc208226640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc200161700 0x7fc200070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:10.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7fc208226640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc200161b40 con 0x7fc200146e40 2023-12-22T08:40:10.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7f0c5bfff640 1 -- 172.21.15.38:0/2068312053 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c700af610 con 0x7f0c680e1230 2023-12-22T08:40:10.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7f0c75d01640 1 -- 172.21.15.38:0/2068312053 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6804b4c0 con 0x7f0c680e1230 2023-12-22T08:40:10.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7fc208226640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2000cfdc0 con 0x7fc200161df0 2023-12-22T08:40:10.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7fc208226640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2000b4da0 con 0x7fc200161700 2023-12-22T08:40:10.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.978+0000 7f0c75d01640 1 -- 172.21.15.38:0/2068312053 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6804ba80 con 0x7f0c680e1230 2023-12-22T08:40:10.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.979+0000 7f14e1fce640 1 -- 172.21.15.38:0/1300705895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14c8003970 msgr2=0x7f14c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:10.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.979+0000 7fc2067c3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc200161700 0x7fc200070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.979+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/3646962960 shutdown_connections 2023-12-22T08:40:10.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.979+0000 7fc2057c1640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc200161df0 0x7fc2001611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:10.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.979+0000 7fc2067c3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc200161700 0x7fc200070ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:34198/0 (socket says 172.21.15.38:34198) 2023-12-22T08:40:10.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.979+0000 7fc2067c3640 1 -- 172.21.15.38:0/3985371058 learned_addr learned my addr 172.21.15.38:0/3985371058 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.979+0000 7f14e1fce640 1 --2- 172.21.15.38:0/1300705895 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14c8003970 0x7f14c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.980+0000 7f0c75d01640 1 -- 172.21.15.38:0/2068312053 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c680557f0 con 0x7f0c680e1230 2023-12-22T08:40:11.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.980+0000 7fc2067c3640 1 -- 172.21.15.38:0/3985371058 >> v2:172.21.15.38:3300/0 conn(0x7fc200161df0 msgr2=0x7fc2001611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.980+0000 7f7b55f6e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4804fd90 0x7f7b480d1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.980+0000 7f7b55f6e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b48053190 0x7f7b48038de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.980+0000 7f7b55f6e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b480e3240 0x7f7b480e5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.980+0000 7f7b55f6e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480e47c0 con 0x7f7b4804fd90 2023-12-22T08:40:11.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.980+0000 7f7b55f6e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480e44e0 con 0x7f7b480e3240 2023-12-22T08:40:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.979+0000 7f14e1fce640 1 -- 172.21.15.38:0/1300705895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14c80047c0 msgr2=0x7f14c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.979+0000 7f14e1fce640 1 --2- 172.21.15.38:0/1300705895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14c80047c0 0x7f14c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.980+0000 7fc2067c3640 1 --2- 172.21.15.38:0/3985371058 >> v2:172.21.15.38:3300/0 conn(0x7fc200161df0 0x7fc2001611c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.980+0000 7fc2067c3640 1 -- 172.21.15.38:0/3985371058 >> v1:172.21.15.89:6789/0 conn(0x7fc200146e40 legacy=0x7fc2000cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.979+0000 7f14e1fce640 1 -- 172.21.15.38:0/1300705895 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc070770 con 0x7f14dc15e740 2023-12-22T08:40:11.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.980+0000 7fc2067c3640 1 -- 172.21.15.38:0/3985371058 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2000b4120 con 0x7fc200161700 2023-12-22T08:40:11.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.980+0000 7f7b55f6e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480d0950 con 0x7f7b48053190 2023-12-22T08:40:11.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.979+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/3646962960 wait complete. 2023-12-22T08:40:11.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.981+0000 7f7c25dd0640 1 Processor -- start 2023-12-22T08:40:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.981+0000 7f7c25dd0640 1 -- start start 2023-12-22T08:40:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.981+0000 7f14e1fce640 1 --2- 172.21.15.38:0/1300705895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14dc15e740 0x7f14c8005180 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c210 tx=0x7f14c80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bae2f82baa9d0d9c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.982+0000 7f7b4effd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b48053190 0x7f7b48038de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.982+0000 7f14d3fff640 1 -- 172.21.15.38:0/1300705895 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d802cae0 con 0x7f14dc15e740 2023-12-22T08:40:11.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.982+0000 7f7b4f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4804fd90 0x7f7b480d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.982+0000 7f7b4f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4804fd90 0x7f7b480d1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42450/0 (socket says 172.21.15.38:42450) 2023-12-22T08:40:11.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.982+0000 7f14d3fff640 1 -- 172.21.15.38:0/1300705895 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d802cc60 con 0x7f14dc15e740 2023-12-22T08:40:11.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.982+0000 7f7b4f7fe640 1 -- 172.21.15.38:0/1671605911 learned_addr learned my addr 172.21.15.38:0/1671605911 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.982+0000 7fc2067c3640 1 --2- 172.21.15.38:0/3985371058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc200161700 0x7fc200070ae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc20006ca60 tx=0x7fc1f802bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c460b97e4307d5e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.982+0000 7f7f4dbd9640 1 Processor -- start 2023-12-22T08:40:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.982+0000 7f7b4ffff640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b480e3240 0x7f7b480e5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.982+0000 7fb29c30a640 1 Processor -- start 2023-12-22T08:40:11.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.982+0000 7fb29c30a640 1 -- start start 2023-12-22T08:40:11.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.983+0000 7f7f4dbd9640 1 -- start start 2023-12-22T08:40:11.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.983+0000 7f7b4ffff640 1 -- 172.21.15.38:0/1671605911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b48053190 msgr2=0x7f7b48038de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.983+0000 7f7b4ffff640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b48053190 0x7f7b48038de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.983+0000 7fc204fc0640 1 -- 172.21.15.38:0/3985371058 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f802c960 con 0x7fc200161700 2023-12-22T08:40:11.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.983+0000 7f7b4ffff640 1 -- 172.21.15.38:0/1671605911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4804fd90 msgr2=0x7f7b480d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.983+0000 7fc204fc0640 1 -- 172.21.15.38:0/3985371058 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f802cac0 con 0x7fc200161700 2023-12-22T08:40:11.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.983+0000 7fc204fc0640 1 -- 172.21.15.38:0/3985371058 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f802ce50 con 0x7fc200161700 2023-12-22T08:40:11.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.983+0000 7f7b4ffff640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4804fd90 0x7f7b480d1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.984+0000 7f0c5bfff640 1 -- 172.21.15.38:0/2068312053 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0c700af770 con 0x7f0c680e1230 2023-12-22T08:40:11.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.983+0000 7f7b4ffff640 1 -- 172.21.15.38:0/1671605911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c009400 con 0x7f7b480e3240 2023-12-22T08:40:11.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.983+0000 7f14e3a31640 1 -- 172.21.15.38:0/1300705895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14dc15e740 msgr2=0x7f14c8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.983+0000 7f14e3a31640 1 --2- 172.21.15.38:0/1300705895 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14dc15e740 0x7f14c8005180 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c210 tx=0x7f14c80057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.983+0000 7f7b4f7fe640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b4804fd90 0x7f7b480d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:11.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.984+0000 7f14e1fce640 1 -- 172.21.15.38:0/1300705895 reap_dead start 2023-12-22T08:40:11.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.984+0000 7f14e3a31640 1 -- 172.21.15.38:0/1300705895 shutdown_connections 2023-12-22T08:40:11.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.984+0000 7f14e3a31640 1 -- 172.21.15.38:0/1300705895 >> 172.21.15.38:0/1300705895 conn(0x7f14dc0cfea0 msgr2=0x7f14dc0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.984+0000 7f7c25dd0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2006ca50 0x7f7c200b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.984+0000 7f7b4ffff640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b480e3240 0x7f7b480e5cc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b50074000 tx=0x7f7b5006ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.984+0000 7f14e3a31640 1 -- 172.21.15.38:0/1300705895 shutdown_connections 2023-12-22T08:40:11.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.984+0000 7f14e3a31640 1 -- 172.21.15.38:0/1300705895 wait complete. 2023-12-22T08:40:11.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.984+0000 7f7c25dd0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c200b3dc0 0x7f7c2014eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7f4dbd9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f4806ca50 0x7f7f48157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7f4dbd9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f480b3dc0 0x7f7f48141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7f4dbd9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f4815e740 0x7f7f48156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7f4dbd9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f481f3a10 con 0x7f7f4806ca50 2023-12-22T08:40:11.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7f4dbd9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48142770 con 0x7f7f4815e740 2023-12-22T08:40:11.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7f4dbd9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48141b60 con 0x7f7f480b3dc0 2023-12-22T08:40:11.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.984+0000 7f7c25dd0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c2015e740 0x7f7c20155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.984+0000 7f7c25dd0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20156780 con 0x7f7c2006ca50 2023-12-22T08:40:11.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.984+0000 7f7c25dd0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20156a60 con 0x7f7c2015e740 2023-12-22T08:40:11.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.984+0000 7f7c25dd0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20156d40 con 0x7f7c200b3dc0 2023-12-22T08:40:11.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7c1f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2006ca50 0x7f7c200b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7c1f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2006ca50 0x7f7c200b6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42466/0 (socket says 172.21.15.38:42466) 2023-12-22T08:40:11.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7c1f7fe640 1 -- 172.21.15.38:0/1553178488 learned_addr learned my addr 172.21.15.38:0/1553178488 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7fb29c30a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb2940b2050 0x7fb294162a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7fc208226640 1 -- 172.21.15.38:0/3985371058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc200161700 msgr2=0x7fc200070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7b3bfff640 1 -- 172.21.15.38:0/1671605911 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5004e080 con 0x7f7b480e3240 2023-12-22T08:40:11.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7b3bfff640 1 -- 172.21.15.38:0/1671605911 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5006e040 con 0x7f7b480e3240 2023-12-22T08:40:11.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7b3bfff640 1 -- 172.21.15.38:0/1671605911 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5004e220 con 0x7f7b480e3240 2023-12-22T08:40:11.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7fc208226640 1 --2- 172.21.15.38:0/3985371058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc200161700 0x7fc200070ae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc20006ca60 tx=0x7fc1f802bdc0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7c1ffff640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c2015e740 0x7f7c20155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1671605911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b480d0c30 con 0x7f7b480e3240 2023-12-22T08:40:11.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7c1effd640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c200b3dc0 0x7f7c2014eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f0c5bfff640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0c5406a480 0x7f0c5406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f0c5bfff640 1 -- 172.21.15.38:0/2068312053 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c70125580 con 0x7f0c680e1230 2023-12-22T08:40:11.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7f0c5bfff640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] conn(0x7f0c54072530 0x7f0c54074950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7f0c5bfff640 1 -- 172.21.15.38:0/2068312053 --> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c54075000 con 0x7f0c54072530 2023-12-22T08:40:11.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1671605911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b480d1970 con 0x7f7b480e3240 2023-12-22T08:40:11.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7f0c5bfff640 1 -- 172.21.15.38:0/2068312053 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c701258f0 con 0x7f0c680e1230 2023-12-22T08:40:11.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7f477fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f4806ca50 0x7f7f48157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7f477fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f4806ca50 0x7f7f48157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42474/0 (socket says 172.21.15.38:42474) 2023-12-22T08:40:11.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7f7f477fe640 1 -- 172.21.15.38:0/2437211023 learned_addr learned my addr 172.21.15.38:0/2437211023 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7f7f47fff640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f4815e740 0x7f7f48156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7fb29a0a6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb2940b2050 0x7fb294162a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.985+0000 7fb29a0a6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb2940b2050 0x7fb294162a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:34218/0 (socket says 172.21.15.38:34218) 2023-12-22T08:40:11.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7fb29c30a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb294165e50 0x7fb2940b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7fb29c30a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2941659c0 con 0x7fb29406c190 2023-12-22T08:40:11.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7fb29c30a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb294162f70 con 0x7fb2940b2050 2023-12-22T08:40:11.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7fb29c30a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb294165690 con 0x7fb294165e50 2023-12-22T08:40:11.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7f7f3effd640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f480b3dc0 0x7f7f48141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7fb29a0a6640 1 -- 172.21.15.38:0/2926683041 learned_addr learned my addr 172.21.15.38:0/2926683041 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7fb29a8a7640 1 --2- 172.21.15.38:0/2926683041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb294165e50 0x7fb2940b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7f7c1f7fe640 1 -- 172.21.15.38:0/1553178488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c200b3dc0 msgr2=0x7f7c2014eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7f7c1f7fe640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c200b3dc0 0x7f7c2014eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7f7c1f7fe640 1 -- 172.21.15.38:0/1553178488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c2015e740 msgr2=0x7f7c20155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7f7c1f7fe640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c2015e740 0x7f7c20155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7f7c1f7fe640 1 -- 172.21.15.38:0/1553178488 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100094d0 con 0x7f7c2006ca50 2023-12-22T08:40:11.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7f7c1effd640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c200b3dc0 0x7f7c2014eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:11.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.986+0000 7f7c1ffff640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c2015e740 0x7f7c20155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:11.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7fc208226640 1 -- 172.21.15.38:0/3985371058 shutdown_connections 2023-12-22T08:40:11.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7fc208226640 1 --2- 172.21.15.38:0/3985371058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc200161700 0x7fc200070ae0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7fc208226640 1 --2- 172.21.15.38:0/3985371058 >> v2:172.21.15.38:3300/0 conn(0x7fc200161df0 0x7fc2001611c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7fc208226640 1 -- 172.21.15.38:0/3985371058 >> 172.21.15.38:0/3985371058 conn(0x7fc2000cff10 msgr2=0x7fc2000d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7f0c6effd640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] conn(0x7f0c54072530 0x7f0c54074950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7f0c6f7fe640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0c5406a480 0x7f0c5406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7fd8eea8f640 1 Processor -- start 2023-12-22T08:40:11.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7fc208226640 1 -- 172.21.15.38:0/3985371058 shutdown_connections 2023-12-22T08:40:11.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7f7c1f7fe640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2006ca50 0x7f7c200b6f10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c1002b840 tx=0x7f7c100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7f7f477fe640 1 -- 172.21.15.38:0/2437211023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f480b3dc0 msgr2=0x7f7f48141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7f7f477fe640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f480b3dc0 0x7f7f48141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7f7f477fe640 1 -- 172.21.15.38:0/2437211023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f4815e740 msgr2=0x7f7f48156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7f7f477fe640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f4815e740 0x7f7f48156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7f7f477fe640 1 -- 172.21.15.38:0/2437211023 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f30009400 con 0x7f7f4806ca50 2023-12-22T08:40:11.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7f7f47fff640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f4815e740 0x7f7f48156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:11.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7f7f477fe640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f4806ca50 0x7f7f48157700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7f30000c00 tx=0x7f7f300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7fd8eea8f640 1 -- start start 2023-12-22T08:40:11.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7fb2990a4640 1 -- 172.21.15.38:0/2926683041 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119751805 0 0) 0x7fb2941659c0 con 0x7fb29406c190 2023-12-22T08:40:11.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7fb2990a4640 1 -- 172.21.15.38:0/2926683041 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb27c003520 con 0x7fb29406c190 2023-12-22T08:40:11.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.988+0000 7fb29a8a7640 1 -- 172.21.15.38:0/2926683041 >> v2:172.21.15.89:3300/0 conn(0x7fb2940b2050 msgr2=0x7fb294162a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:11.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.988+0000 7fb29a8a7640 1 --2- 172.21.15.38:0/2926683041 >> v2:172.21.15.89:3300/0 conn(0x7fb2940b2050 0x7fb294162a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.988+0000 7fb29a8a7640 1 -- 172.21.15.38:0/2926683041 >> v1:172.21.15.38:6789/0 conn(0x7fb29406c190 legacy=0x7fb2940b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.988+0000 7fb29a8a7640 1 -- 172.21.15.38:0/2926683041 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29406cba0 con 0x7fb294165e50 2023-12-22T08:40:11.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.988+0000 7f7c07fff640 1 -- 172.21.15.38:0/1553178488 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1003b800 con 0x7f7c2006ca50 2023-12-22T08:40:11.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.988+0000 7f7c07fff640 1 -- 172.21.15.38:0/1553178488 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1003b980 con 0x7f7c2006ca50 2023-12-22T08:40:11.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.988+0000 7f7c07fff640 1 -- 172.21.15.38:0/1553178488 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1003bd30 con 0x7f7c2006ca50 2023-12-22T08:40:11.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.988+0000 7f7c25dd0640 1 -- 172.21.15.38:0/1553178488 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c20157020 con 0x7f7c2006ca50 2023-12-22T08:40:11.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.988+0000 7f7f44ff9640 1 -- 172.21.15.38:0/2437211023 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30003a20 con 0x7f7f4806ca50 2023-12-22T08:40:11.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.988+0000 7f7f44ff9640 1 -- 172.21.15.38:0/2437211023 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f30003b80 con 0x7f7f4806ca50 2023-12-22T08:40:11.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.988+0000 7f7f44ff9640 1 -- 172.21.15.38:0/2437211023 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f300044c0 con 0x7f7f4806ca50 2023-12-22T08:40:11.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.988+0000 7f0c6effd640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] conn(0x7f0c54072530 0x7f0c54074950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.989+0000 7f14e3a31640 1 Processor -- start 2023-12-22T08:40:11.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.988+0000 7f7c25dd0640 1 -- 172.21.15.38:0/1553178488 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c20156400 con 0x7f7c2006ca50 2023-12-22T08:40:11.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.989+0000 7f0c5bfff640 1 -- 172.21.15.38:0/2068312053 <== osd.0 v2:172.21.15.38:6800/84128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f0c54075000 con 0x7f0c54072530 2023-12-22T08:40:11.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.989+0000 7fd8eea8f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd8e815e740 0x7fd8e815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.989+0000 7fd8eea8f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e806ca50 0x7fd8e80b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.990+0000 7fd8eea8f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e80b4210 con 0x7fd8e80b3dc0 2023-12-22T08:40:11.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.990+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1671605911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b480541b0 con 0x7f7b480e3240 2023-12-22T08:40:11.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.990+0000 7f14e3a31640 1 -- start start 2023-12-22T08:40:11.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.990+0000 7fd8eea8f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e806e650 con 0x7fd8e815e740 2023-12-22T08:40:11.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.990+0000 7fd8eea8f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e815eb20 con 0x7fd8e806ca50 2023-12-22T08:40:11.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.990+0000 7f7c25dd0640 1 -- 172.21.15.38:0/1553178488 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c20156bd0 con 0x7f7c2006ca50 2023-12-22T08:40:11.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.991+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/2437211023 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f48141e40 con 0x7f7f4806ca50 2023-12-22T08:40:11.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.991+0000 7fd8ec82b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd8e815e740 0x7fd8e815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.991+0000 7fd8ec82b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd8e815e740 0x7fd8e815db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42476/0 (socket says 172.21.15.38:42476) 2023-12-22T08:40:11.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.991+0000 7fd8ec82b640 1 -- 172.21.15.38:0/2414515560 learned_addr learned my addr 172.21.15.38:0/2414515560 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.991+0000 7fd8e7fff640 1 --2- 172.21.15.38:0/2414515560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e806ca50 0x7fd8e80b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.991+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/2437211023 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f48142400 con 0x7f7f4806ca50 2023-12-22T08:40:11.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.991+0000 7f7b3bfff640 1 -- 172.21.15.38:0/1671605911 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7b50090070 con 0x7f7b480e3240 2023-12-22T08:40:11.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.987+0000 7fc208226640 1 -- 172.21.15.38:0/3985371058 wait complete. 2023-12-22T08:40:11.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.990+0000 7fc208226640 1 Processor -- start 2023-12-22T08:40:11.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.990+0000 7fc208226640 1 -- start start 2023-12-22T08:40:11.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.992+0000 7f14e3a31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14dc14c250 0x7f14dc14f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.992+0000 7f14e3a31640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14dc14c630 0x7f14dc0b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.992+0000 7f14e3a31640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14dc1500f0 0x7f14dc150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.992+0000 7f14e3a31640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc14cdb0 con 0x7f14dc14c630 2023-12-22T08:40:11.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.992+0000 7f14e3a31640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc150ac0 con 0x7f14dc14c250 2023-12-22T08:40:11.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.992+0000 7f14e3a31640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc14ef90 con 0x7f14dc1500f0 2023-12-22T08:40:11.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.992+0000 7fc208226640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc200146e40 0x7fc200155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.992+0000 7fb29a8a7640 1 --2- 172.21.15.38:0/2926683041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb294165e50 0x7fb2940b3600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0097a0 tx=0x7fb28c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42b64ca411eb5e6f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.992+0000 7fd8ec82b640 1 -- 172.21.15.38:0/2414515560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e806ca50 msgr2=0x7fd8e80b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:11.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.992+0000 7fd8ec82b640 1 --2- 172.21.15.38:0/2414515560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e806ca50 0x7fd8e80b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.992+0000 7fd8ec82b640 1 -- 172.21.15.38:0/2414515560 >> v1:172.21.15.89:6789/0 conn(0x7fd8e80b3dc0 legacy=0x7fd8e8161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.992+0000 7fd8ec82b640 1 -- 172.21.15.38:0/2414515560 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e8070770 con 0x7fd8e815e740 2023-12-22T08:40:11.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7f14e17cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14dc14c250 0x7f14dc14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7f14e17cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14dc14c250 0x7f14dc14f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:34238/0 (socket says 172.21.15.38:34238) 2023-12-22T08:40:11.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7f14e17cd640 1 -- 172.21.15.38:0/631316274 learned_addr learned my addr 172.21.15.38:0/631316274 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.992+0000 7f7c07fff640 1 -- 172.21.15.38:0/1553178488 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c1004e450 con 0x7f7c2006ca50 2023-12-22T08:40:11.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7f14e1fce640 1 --2- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14dc1500f0 0x7f14dc150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7fb2990a4640 1 -- 172.21.15.38:0/2926683041 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c031830 con 0x7fb294165e50 2023-12-22T08:40:11.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7fb2990a4640 1 -- 172.21.15.38:0/2926683041 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c031990 con 0x7fb294165e50 2023-12-22T08:40:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7fc208226640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc200161700 0x7fc20013d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7fb2990a4640 1 -- 172.21.15.38:0/2926683041 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c031d20 con 0x7fb294165e50 2023-12-22T08:40:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7f7b3bfff640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b3406a460 0x7f7b3406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7f7b3bfff640 1 -- 172.21.15.38:0/1671605911 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b500d21c0 con 0x7f7b480e3240 2023-12-22T08:40:11.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/2437211023 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f4806d460 con 0x7f7f4806ca50 2023-12-22T08:40:11.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f7b3bfff640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] conn(0x7f7b34073210 0x7f7b340756b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7f14e17cd640 1 -- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14dc1500f0 msgr2=0x7f14dc150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7f14e17cd640 1 --2- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f14dc1500f0 0x7f14dc150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f14e17cd640 1 -- 172.21.15.38:0/631316274 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14dc14c630 msgr2=0x7f14dc0b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f14e17cd640 1 --2- 172.21.15.38:0/631316274 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14dc14c630 0x7f14dc0b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f14e17cd640 1 -- 172.21.15.38:0/631316274 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc0b8a70 con 0x7f14dc14c250 2023-12-22T08:40:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f7b3bfff640 1 -- 172.21.15.38:0/1671605911 --> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b34075d80 con 0x7f7b34073210 2023-12-22T08:40:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.993+0000 7fc208226640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc200161df0 0x7fc2000d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7fc205fc2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc200146e40 0x7fc200155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f7b4f7fe640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b3406a460 0x7f7b3406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f7c07fff640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7c0c06a500 0x7f7c0c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f7c07fff640 1 -- 172.21.15.38:0/1553178488 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c1002f050 con 0x7f7c2006ca50 2023-12-22T08:40:11.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f7c07fff640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] conn(0x7f7c0c0726a0 0x7f7c0c074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f7c07fff640 1 -- 172.21.15.38:0/1553178488 --> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c0c075170 con 0x7f7c0c0726a0 2023-12-22T08:40:11.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f7c07fff640 1 -- 172.21.15.38:0/1553178488 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c10075c50 con 0x7f7c2006ca50 2023-12-22T08:40:11.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f14e17cd640 1 --2- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14dc14c250 0x7f14dc14f420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f14d40046d0 tx=0x7f14d4007700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7fc205fc2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc200146e40 0x7fc200155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:34244/0 (socket says 172.21.15.38:34244) 2023-12-22T08:40:11.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7fc208226640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20013e3f0 con 0x7fc200161df0 2023-12-22T08:40:11.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7fc208226640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20013e6d0 con 0x7fc200146e40 2023-12-22T08:40:11.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7fc208226640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc200155030 con 0x7fc200161700 2023-12-22T08:40:11.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f0c6f7fe640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0c5406a480 0x7f0c5406c940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0c64000f60 tx=0x7f0c64007e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f7b3bfff640 1 -- 172.21.15.38:0/1671605911 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b500d1890 con 0x7f7b480e3240 2023-12-22T08:40:11.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7fb29c30a640 1 -- 172.21.15.38:0/2926683041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb294165e50 msgr2=0x7fb2940b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7fb29c30a640 1 --2- 172.21.15.38:0/2926683041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb294165e50 0x7fb2940b3600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0097a0 tx=0x7fb28c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7fc205fc2640 1 -- 172.21.15.38:0/600407636 learned_addr learned my addr 172.21.15.38:0/600407636 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.994+0000 7f7b4effd640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] conn(0x7f7b34073210 0x7f7b340756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7f7c1effd640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7c0c06a500 0x7f7c0c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7f7c1ffff640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] conn(0x7f7c0c0726a0 0x7f7c0c074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7fb29c30a640 1 -- 172.21.15.38:0/2926683041 shutdown_connections 2023-12-22T08:40:11.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7fb29c30a640 1 --2- 172.21.15.38:0/2926683041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb294165e50 0x7fb2940b3600 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7fb29c30a640 1 --2- 172.21.15.38:0/2926683041 >> v2:172.21.15.89:3300/0 conn(0x7fb2940b2050 0x7fb294162a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7fb29c30a640 1 -- 172.21.15.38:0/2926683041 >> 172.21.15.38:0/2926683041 conn(0x7fb2940cf070 msgr2=0x7fb2940cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7fd8ec82b640 1 --2- 172.21.15.38:0/2414515560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8e815e740 0x7fd8e815db30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009e50 tx=0x7fd8e002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62dc402b48823b14 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7fb29c30a640 1 -- 172.21.15.38:0/2926683041 shutdown_connections 2023-12-22T08:40:11.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7fc2067c3640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc200161df0 0x7fc2000d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7fc2057c1640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc200161700 0x7fc20013d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.996+0000 7f7f44ff9640 1 -- 172.21.15.38:0/2437211023 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f3003a070 con 0x7f7f4806ca50 2023-12-22T08:40:11.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.996+0000 7fd8e77fe640 1 -- 172.21.15.38:0/2414515560 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e002c9f0 con 0x7fd8e815e740 2023-12-22T08:40:11.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.996+0000 7f7b4effd640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] conn(0x7f7b34073210 0x7f7b340756b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.996+0000 7f7c1ffff640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] conn(0x7f7c0c0726a0 0x7f7c0c074ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7f14d1ffb640 1 -- 172.21.15.38:0/631316274 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4009c30 con 0x7f14dc14c250 2023-12-22T08:40:11.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7f14d1ffb640 1 -- 172.21.15.38:0/631316274 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d4015420 con 0x7f14dc14c250 2023-12-22T08:40:11.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7f14d1ffb640 1 -- 172.21.15.38:0/631316274 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d40157d0 con 0x7f14dc14c250 2023-12-22T08:40:11.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.996+0000 7fc2067c3640 1 -- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc200161700 msgr2=0x7fc20013d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.996+0000 7fc2067c3640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc200161700 0x7fc20013d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.995+0000 7f14e3a31640 1 -- 172.21.15.38:0/631316274 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14dc14e940 con 0x7f14dc14c250 2023-12-22T08:40:11.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.996+0000 7fc2067c3640 1 -- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc200146e40 msgr2=0x7fc200155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.996+0000 7fc2067c3640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc200146e40 0x7fc200155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.996+0000 7f14e3a31640 1 -- 172.21.15.38:0/631316274 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14dc0b8d50 con 0x7f14dc14c250 2023-12-22T08:40:11.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.996+0000 7fc2067c3640 1 -- 172.21.15.38:0/600407636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f8009b30 con 0x7fc200161df0 2023-12-22T08:40:11.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.996+0000 7fd8e77fe640 1 -- 172.21.15.38:0/2414515560 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e002cb50 con 0x7fd8e815e740 2023-12-22T08:40:11.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.996+0000 7fd8e77fe640 1 -- 172.21.15.38:0/2414515560 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e00343f0 con 0x7fd8e815e740 2023-12-22T08:40:11.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.996+0000 7fb29c30a640 1 -- 172.21.15.38:0/2926683041 wait complete. 2023-12-22T08:40:11.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.997+0000 7fc2067c3640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc200161df0 0x7fc2000d38a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8032000 tx=0x7fc1f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.997+0000 7f7b4f7fe640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b3406a460 0x7f7b3406c920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009950 tx=0x7f7b44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.997+0000 7f7f44ff9640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f2806a430 0x7f7f2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.997+0000 7f7f44ff9640 1 -- 172.21.15.38:0/2437211023 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f30031ea0 con 0x7f7f4806ca50 2023-12-22T08:40:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7f7f44ff9640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] conn(0x7f7f280731e0 0x7f7f28075680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7f7f44ff9640 1 -- 172.21.15.38:0/2437211023 --> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f28075d50 con 0x7f7f280731e0 2023-12-22T08:40:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7f7f44ff9640 1 -- 172.21.15.38:0/2437211023 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f30079470 con 0x7f7f4806ca50 2023-12-22T08:40:11.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7f7c1effd640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7c0c06a500 0x7f7c0c06c9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7c2015b590 tx=0x7f7c14009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7fd8eea8f640 1 -- 172.21.15.38:0/2414515560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8e815e740 msgr2=0x7fd8e815db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7fd8eea8f640 1 --2- 172.21.15.38:0/2414515560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8e815e740 0x7fd8e815db30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009e50 tx=0x7fd8e002be50 comp rx=0 tx=0).stop 2023-12-22T08:40:11.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7fd8eea8f640 1 -- 172.21.15.38:0/2414515560 shutdown_connections 2023-12-22T08:40:11.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7fd8eea8f640 1 --2- 172.21.15.38:0/2414515560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e806ca50 0x7fd8e80b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7fd8eea8f640 1 --2- 172.21.15.38:0/2414515560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8e815e740 0x7fd8e815db30 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009e50 tx=0x7fd8e002be50 comp rx=0 tx=0).stop 2023-12-22T08:40:11.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7fd8eea8f640 1 -- 172.21.15.38:0/2414515560 >> 172.21.15.38:0/2414515560 conn(0x7fd8e80cfea0 msgr2=0x7fd8e80d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7fc1f67fc640 1 -- 172.21.15.38:0/600407636 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f803e450 con 0x7fc200161df0 2023-12-22T08:40:11.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7fc1f67fc640 1 -- 172.21.15.38:0/600407636 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f803e5b0 con 0x7fc200161df0 2023-12-22T08:40:11.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7fc1f67fc640 1 -- 172.21.15.38:0/600407636 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f803e960 con 0x7fc200161df0 2023-12-22T08:40:11.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7fc208226640 1 -- 172.21.15.38:0/600407636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc200155310 con 0x7fc200161df0 2023-12-22T08:40:11.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7fc208226640 1 -- 172.21.15.38:0/600407636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2000b8f50 con 0x7fc200161df0 2023-12-22T08:40:11.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7f7f47fff640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] conn(0x7f7f280731e0 0x7f7f28075680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7f7f3effd640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f2806a430 0x7f7f2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.998+0000 7fb29c30a640 1 Processor -- start 2023-12-22T08:40:11.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.999+0000 7f7b3bfff640 1 -- 172.21.15.38:0/1671605911 <== osd.1 v2:172.21.15.38:6808/84127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f7b34075d80 con 0x7f7b34073210 2023-12-22T08:40:11.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.999+0000 7f7c07fff640 1 -- 172.21.15.38:0/1553178488 <== osd.3 v2:172.21.15.38:6816/84138 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f7c0c075170 con 0x7f7c0c0726a0 2023-12-22T08:40:11.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.999+0000 7f14e3a31640 1 -- 172.21.15.38:0/631316274 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14dc06d460 con 0x7f14dc14c250 2023-12-22T08:40:11.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:10.999+0000 7fb29c30a640 1 -- start start 2023-12-22T08:40:11.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.000+0000 7fd8eea8f640 1 -- 172.21.15.38:0/2414515560 shutdown_connections 2023-12-22T08:40:11.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.000+0000 7f14d1ffb640 1 -- 172.21.15.38:0/631316274 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f14d4015930 con 0x7f14dc14c250 2023-12-22T08:40:11.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.000+0000 7fb29c30a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb29406c190 0x7fb2941f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.001+0000 7fb29c30a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2940b2050 0x7fb2941fa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.001+0000 7fb29c30a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb294165e50 0x7fb294158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.001+0000 7fb29c30a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2941f6d00 con 0x7fb29406c190 2023-12-22T08:40:11.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.001+0000 7fb29c30a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29415b7e0 con 0x7fb294165e50 2023-12-22T08:40:11.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.001+0000 7fb29c30a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29415bac0 con 0x7fb2940b2050 2023-12-22T08:40:11.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.001+0000 7fb29a0a6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb29406c190 0x7fb2941f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.001+0000 7fb29a0a6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb29406c190 0x7fb2941f67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34826/0 (socket says 172.21.15.38:34826) 2023-12-22T08:40:11.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.001+0000 7fb29a0a6640 1 -- 172.21.15.38:0/3391027288 learned_addr learned my addr 172.21.15.38:0/3391027288 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.000+0000 7fc208226640 1 -- 172.21.15.38:0/600407636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1e8000fc0 con 0x7fc200161df0 2023-12-22T08:40:11.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.000+0000 7fd8eea8f640 1 -- 172.21.15.38:0/2414515560 wait complete. 2023-12-22T08:40:11.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.001+0000 7fb2998a5640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2940b2050 0x7fb2941fa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.001+0000 7f7f3effd640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f2806a430 0x7f7f2806c8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f48161e30 tx=0x7f7f38009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.002+0000 7fb29a8a7640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb294165e50 0x7fb294158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.002+0000 7f14d1ffb640 1 --2- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f14c006a430 0x7f14c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.002+0000 7f14d1ffb640 1 -- 172.21.15.38:0/631316274 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14d40894d0 con 0x7f14dc14c250 2023-12-22T08:40:11.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.002+0000 7f14d1ffb640 1 --2- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] conn(0x7f14c00725d0 0x7f14c00749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.002+0000 7f14d1ffb640 1 -- 172.21.15.38:0/631316274 --> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14c00750a0 con 0x7f14c00725d0 2023-12-22T08:40:11.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.002+0000 7f14d1ffb640 1 -- 172.21.15.38:0/631316274 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14d408bab0 con 0x7f14dc14c250 2023-12-22T08:40:11.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.002+0000 7fc1f67fc640 1 -- 172.21.15.38:0/600407636 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc1f803eac0 con 0x7fc200161df0 2023-12-22T08:40:11.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.002+0000 7fb29a0a6640 1 -- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2940b2050 msgr2=0x7fb2941fa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.002+0000 7fb29a0a6640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2940b2050 0x7fb2941fa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.002+0000 7fb29a0a6640 1 -- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb294165e50 msgr2=0x7fb294158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.002+0000 7fb29a0a6640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb294165e50 0x7fb294158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.002+0000 7fb29a0a6640 1 -- 172.21.15.38:0/3391027288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c009400 con 0x7fb29406c190 2023-12-22T08:40:11.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.003+0000 7fd8eea8f640 1 Processor -- start 2023-12-22T08:40:11.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.003+0000 7fb29a8a7640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb294165e50 0x7fb294158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:11.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.003+0000 7fb2998a5640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb2940b2050 0x7fb2941fa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:11.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.002+0000 7f7f47fff640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] conn(0x7f7f280731e0 0x7f7f28075680 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.003+0000 7fb29a0a6640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb29406c190 0x7fb2941f67c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb288009f70 tx=0x7fb28800c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.003+0000 7fd8eea8f640 1 -- start start 2023-12-22T08:40:11.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.003+0000 7f7f44ff9640 1 -- 172.21.15.38:0/2437211023 <== osd.2 v2:172.21.15.38:6824/84132 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f7f28075d50 con 0x7f7f280731e0 2023-12-22T08:40:11.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.003+0000 7f14e0fcc640 1 --2- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f14c006a430 0x7f14c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.004+0000 7f14e1fce640 1 --2- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] conn(0x7f14c00725d0 0x7f14c00749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.003+0000 7fb292ffd640 1 -- 172.21.15.38:0/3391027288 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2880090d0 con 0x7fb29406c190 2023-12-22T08:40:11.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.004+0000 7fb292ffd640 1 -- 172.21.15.38:0/3391027288 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28800f040 con 0x7fb29406c190 2023-12-22T08:40:11.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.004+0000 7fb292ffd640 1 -- 172.21.15.38:0/3391027288 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288014480 con 0x7fb29406c190 2023-12-22T08:40:11.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.004+0000 7fb29c30a640 1 -- 172.21.15.38:0/3391027288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29415bda0 con 0x7fb29406c190 2023-12-22T08:40:11.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.005+0000 7fd8eea8f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e806ca50 0x7fd8e8148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.005+0000 7fd8eea8f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8e80b3dc0 0x7fd8e8154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.005+0000 7fd8eea8f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e8155270 0x7fd8e815feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.005+0000 7f14e0fcc640 1 --2- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f14c006a430 0x7f14c006c8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f14cc006a90 tx=0x7f14cc006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.005+0000 7f14e1fce640 1 --2- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] conn(0x7f14c00725d0 0x7f14c00749f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.005+0000 7fb29c30a640 1 -- 172.21.15.38:0/3391027288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29415c360 con 0x7fb29406c190 2023-12-22T08:40:11.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.005+0000 7fd8e7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8e80b3dc0 0x7fd8e8154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.005+0000 7fd8ec82b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e806ca50 0x7fd8e8148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.005+0000 7fc1f67fc640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc1e406a460 0x7fc1e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.006+0000 7fc1f67fc640 1 -- 172.21.15.38:0/600407636 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1f80ab2d0 con 0x7fc200161df0 2023-12-22T08:40:11.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.006+0000 7fc1f67fc640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] conn(0x7fc1e4072680 0x7fc1e4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.006+0000 7fc1f67fc640 1 -- 172.21.15.38:0/600407636 --> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1e4075150 con 0x7fc1e4072680 2023-12-22T08:40:11.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.006+0000 7fc1f67fc640 1 -- 172.21.15.38:0/600407636 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1f80ad8f0 con 0x7fc200161df0 2023-12-22T08:40:11.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.005+0000 7fd8ec82b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e806ca50 0x7fd8e8148e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:56006/0 (socket says 172.21.15.38:56006) 2023-12-22T08:40:11.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.005+0000 7fd8ec82b640 1 -- 172.21.15.38:0/268626911 learned_addr learned my addr 172.21.15.38:0/268626911 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.005+0000 7fd8eea8f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e8158ef0 con 0x7fd8e80b3dc0 2023-12-22T08:40:11.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.005+0000 7fd8ed02c640 1 --2- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e8155270 0x7fd8e815feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.006+0000 7fd8eea8f640 1 -- 172.21.15.38:0/268626911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e8149370 con 0x7fd8e8155270 2023-12-22T08:40:11.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.006+0000 7fd8eea8f640 1 -- 172.21.15.38:0/268626911 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e8155830 con 0x7fd8e806ca50 2023-12-22T08:40:11.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.006+0000 7fb29c30a640 1 -- 172.21.15.38:0/3391027288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb29406c620 con 0x7fb29406c190 2023-12-22T08:40:11.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.007+0000 7fc2057c1640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] conn(0x7fc1e4072680 0x7fc1e4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.007+0000 7fc205fc2640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc1e406a460 0x7fc1e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.007+0000 7fd8e7fff640 1 -- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e806ca50 msgr2=0x7fd8e8148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.007+0000 7fd8e7fff640 1 --2- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8e806ca50 0x7fd8e8148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.007+0000 7fd8e7fff640 1 -- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e8155270 msgr2=0x7fd8e815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.007+0000 7fd8e7fff640 1 --2- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8e8155270 0x7fd8e815feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.007+0000 7fd8e7fff640 1 -- 172.21.15.38:0/268626911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e0009b30 con 0x7fd8e80b3dc0 2023-12-22T08:40:11.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.007+0000 7fb292ffd640 1 -- 172.21.15.38:0/3391027288 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb2880145e0 con 0x7fb29406c190 2023-12-22T08:40:11.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.007+0000 7f14d1ffb640 1 -- 172.21.15.38:0/631316274 <== osd.4 v2:172.21.15.89:6800/84338 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f14c00750a0 con 0x7f14c00725d0 2023-12-22T08:40:11.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.008+0000 7fd8e7fff640 1 --2- 172.21.15.38:0/268626911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8e80b3dc0 0x7fd8e8154d30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800e880 tx=0x7fd8d800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.008+0000 7fc205fc2640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc1e406a460 0x7fc1e406c920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc200140d60 tx=0x7fc1fc009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.008+0000 7fd8e57fa640 1 -- 172.21.15.38:0/268626911 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d800c940 con 0x7fd8e80b3dc0 2023-12-22T08:40:11.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.008+0000 7fd8e57fa640 1 -- 172.21.15.38:0/268626911 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d800caa0 con 0x7fd8e80b3dc0 2023-12-22T08:40:11.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.008+0000 7fd8e57fa640 1 -- 172.21.15.38:0/268626911 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d800ce50 con 0x7fd8e80b3dc0 2023-12-22T08:40:11.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.009+0000 7fb292ffd640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb28006a480 0x7fb28006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.009+0000 7fb292ffd640 1 -- 172.21.15.38:0/3391027288 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb28808fad0 con 0x7fb29406c190 2023-12-22T08:40:11.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.009+0000 7fb292ffd640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] conn(0x7fb2800726a0 0x7fb280074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.010+0000 7fc2057c1640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] conn(0x7fc1e4072680 0x7fc1e4074aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.009+0000 7fd8eea8f640 1 -- 172.21.15.38:0/268626911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e8155b10 con 0x7fd8e80b3dc0 2023-12-22T08:40:11.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.010+0000 7fd8eea8f640 1 -- 172.21.15.38:0/268626911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e81560d0 con 0x7fd8e80b3dc0 2023-12-22T08:40:11.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.010+0000 7fb292ffd640 1 -- 172.21.15.38:0/3391027288 --> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb280075170 con 0x7fb2800726a0 2023-12-22T08:40:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.010+0000 7fb292ffd640 1 -- 172.21.15.38:0/3391027288 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb28808fe90 con 0x7fb29406c190 2023-12-22T08:40:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.010+0000 7fb2998a5640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb28006a480 0x7fb28006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.010+0000 7fb29a8a7640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] conn(0x7fb2800726a0 0x7fb280074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.011+0000 7fd8eea8f640 1 -- 172.21.15.38:0/268626911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8e806d460 con 0x7fd8e80b3dc0 2023-12-22T08:40:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.011+0000 7fb2998a5640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb28006a480 0x7fb28006c940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb2940adc00 tx=0x7fb284009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.012+0000 7fb29a8a7640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] conn(0x7fb2800726a0 0x7fb280074ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.012+0000 7fc1f67fc640 1 -- 172.21.15.38:0/600407636 <== osd.6 v2:172.21.15.89:6808/84337 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fc1e4075150 con 0x7fc1e4072680 2023-12-22T08:40:11.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.014+0000 7fd8e57fa640 1 -- 172.21.15.38:0/268626911 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd8d8013470 con 0x7fd8e80b3dc0 2023-12-22T08:40:11.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.015+0000 7fb292ffd640 1 -- 172.21.15.38:0/3391027288 <== osd.5 v2:172.21.15.89:6816/84339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fb280075170 con 0x7fb2800726a0 2023-12-22T08:40:11.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.017+0000 7f0c75d01640 1 -- 172.21.15.38:0/2068312053 --> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c68055510 con 0x7f0c54072530 2023-12-22T08:40:11.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.017+0000 7fd8e57fa640 1 --2- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd8d406a480 0x7fd8d406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.018+0000 7fd8e57fa640 1 -- 172.21.15.38:0/268626911 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8d8088940 con 0x7fd8e80b3dc0 2023-12-22T08:40:11.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.018+0000 7fd8e57fa640 1 --2- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] conn(0x7fd8d40726a0 0x7fd8d4074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.018+0000 7fd8e57fa640 1 -- 172.21.15.38:0/268626911 --> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8d4075170 con 0x7fd8d40726a0 2023-12-22T08:40:11.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.018+0000 7fd8e57fa640 1 -- 172.21.15.38:0/268626911 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8d808d2c0 con 0x7fd8e80b3dc0 2023-12-22T08:40:11.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.019+0000 7f0c5bfff640 1 -- 172.21.15.38:0/2068312053 <== osd.0 v2:172.21.15.38:6800/84128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c5c001350 con 0x7f0c54072530 2023-12-22T08:40:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.019+0000 7fd8ed02c640 1 --2- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] conn(0x7fd8d40726a0 0x7fd8d4074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.019+0000 7fd8ec82b640 1 --2- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd8d406a480 0x7fd8d406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.019+0000 7f0c75d01640 1 -- 172.21.15.38:0/2068312053 >> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] conn(0x7f0c54072530 msgr2=0x7f0c54074950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.019+0000 7f0c75d01640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] conn(0x7f0c54072530 0x7f0c54074950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.020+0000 7f0c75d01640 1 -- 172.21.15.38:0/2068312053 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0c5406a480 msgr2=0x7f0c5406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.020+0000 7f0c75d01640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0c5406a480 0x7f0c5406c940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0c64000f60 tx=0x7f0c64007e10 comp rx=0 tx=0).stop 2023-12-22T08:40:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.020+0000 7f0c75d01640 1 -- 172.21.15.38:0/2068312053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680e1230 msgr2=0x7f0c68179510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.020+0000 7f0c75d01640 1 --2- 172.21.15.38:0/2068312053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680e1230 0x7f0c68179510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0c70000b60 tx=0x7f0c70067e90 comp rx=0 tx=0).stop 2023-12-22T08:40:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.020+0000 7f0c6ffff640 1 -- 172.21.15.38:0/2068312053 reap_dead start 2023-12-22T08:40:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.020+0000 7fd8ed02c640 1 --2- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] conn(0x7fd8d40726a0 0x7fd8d4074ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.020+0000 7fd8ec82b640 1 --2- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd8d406a480 0x7fd8d406c940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd8e002be90 tx=0x7fd8e0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.020+0000 7f0c75d01640 1 -- 172.21.15.38:0/2068312053 shutdown_connections 2023-12-22T08:40:11.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.020+0000 7f0c75d01640 1 -- 172.21.15.38:0/2068312053 >> 172.21.15.38:0/2068312053 conn(0x7f0c68056d10 msgr2=0x7f0c68054850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.021+0000 7f0c75d01640 1 -- 172.21.15.38:0/2068312053 shutdown_connections 2023-12-22T08:40:11.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.021+0000 7f0c75d01640 1 -- 172.21.15.38:0/2068312053 wait complete. 2023-12-22T08:40:11.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.022+0000 7fd8e57fa640 1 -- 172.21.15.38:0/268626911 <== osd.7 v2:172.21.15.89:6821/84340 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fd8d4075170 con 0x7fd8d40726a0 2023-12-22T08:40:11.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.028+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1671605911 --> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7b48053ed0 con 0x7f7b34073210 2023-12-22T08:40:11.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.029+0000 7f7b3bfff640 1 -- 172.21.15.38:0/1671605911 <== osd.1 v2:172.21.15.38:6808/84127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7b3c006e10 con 0x7f7b34073210 2023-12-22T08:40:11.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.029+0000 7f7c25dd0640 1 -- 172.21.15.38:0/1553178488 --> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c2006d180 con 0x7f7c0c0726a0 2023-12-22T08:40:11.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.030+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1671605911 >> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] conn(0x7f7b34073210 msgr2=0x7f7b340756b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.030+0000 7f7b55f6e640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] conn(0x7f7b34073210 0x7f7b340756b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.030+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1671605911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b3406a460 msgr2=0x7f7b3406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.030+0000 7f7b55f6e640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b3406a460 0x7f7b3406c920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009950 tx=0x7f7b44008040 comp rx=0 tx=0).stop 2023-12-22T08:40:11.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.030+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1671605911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b480e3240 msgr2=0x7f7b480e5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.030+0000 7f7b55f6e640 1 --2- 172.21.15.38:0/1671605911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b480e3240 0x7f7b480e5cc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b50074000 tx=0x7f7b5006ef60 comp rx=0 tx=0).stop 2023-12-22T08:40:11.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.030+0000 7f7b4ffff640 1 -- 172.21.15.38:0/1671605911 reap_dead start 2023-12-22T08:40:11.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.031+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1671605911 shutdown_connections 2023-12-22T08:40:11.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.031+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1671605911 >> 172.21.15.38:0/1671605911 conn(0x7f7b48009f90 msgr2=0x7f7b48034e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.031+0000 7f7c07fff640 1 -- 172.21.15.38:0/1553178488 <== osd.3 v2:172.21.15.38:6816/84138 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7c0c075170 con 0x7f7c0c0726a0 2023-12-22T08:40:11.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.031+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1671605911 shutdown_connections 2023-12-22T08:40:11.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.031+0000 7f7b55f6e640 1 -- 172.21.15.38:0/1671605911 wait complete. 2023-12-22T08:40:11.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.032+0000 7f7c25dd0640 1 -- 172.21.15.38:0/1553178488 >> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] conn(0x7f7c0c0726a0 msgr2=0x7f7c0c074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.032+0000 7f7c25dd0640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] conn(0x7f7c0c0726a0 0x7f7c0c074ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.033+0000 7f7c25dd0640 1 -- 172.21.15.38:0/1553178488 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7c0c06a500 msgr2=0x7f7c0c06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.033+0000 7f7c25dd0640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7c0c06a500 0x7f7c0c06c9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7c2015b590 tx=0x7f7c14009060 comp rx=0 tx=0).stop 2023-12-22T08:40:11.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.033+0000 7f7c25dd0640 1 -- 172.21.15.38:0/1553178488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2006ca50 msgr2=0x7f7c200b6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.033+0000 7f7c25dd0640 1 --2- 172.21.15.38:0/1553178488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c2006ca50 0x7f7c200b6f10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c1002b840 tx=0x7f7c100046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.033+0000 7f7c1ffff640 1 -- 172.21.15.38:0/1553178488 reap_dead start 2023-12-22T08:40:11.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.033+0000 7f7c25dd0640 1 -- 172.21.15.38:0/1553178488 shutdown_connections 2023-12-22T08:40:11.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.033+0000 7f7c25dd0640 1 -- 172.21.15.38:0/1553178488 >> 172.21.15.38:0/1553178488 conn(0x7f7c200cfea0 msgr2=0x7f7c201617b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.033+0000 7f7c25dd0640 1 -- 172.21.15.38:0/1553178488 shutdown_connections 2023-12-22T08:40:11.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.033+0000 7f7c25dd0640 1 -- 172.21.15.38:0/1553178488 wait complete. 2023-12-22T08:40:11.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.035+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/2437211023 --> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f4806d180 con 0x7f7f280731e0 2023-12-22T08:40:11.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.036+0000 7f7f44ff9640 1 -- 172.21.15.38:0/2437211023 <== osd.2 v2:172.21.15.38:6824/84132 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7f40001e10 con 0x7f7f280731e0 2023-12-22T08:40:11.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.036+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/2437211023 >> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] conn(0x7f7f280731e0 msgr2=0x7f7f28075680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.037+0000 7f7f4dbd9640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] conn(0x7f7f280731e0 0x7f7f28075680 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.037+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/2437211023 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f2806a430 msgr2=0x7f7f2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.037+0000 7f7f4dbd9640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f2806a430 0x7f7f2806c8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f48161e30 tx=0x7f7f38009190 comp rx=0 tx=0).stop 2023-12-22T08:40:11.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.038+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/2437211023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f4806ca50 msgr2=0x7f7f48157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.038+0000 7f7f4dbd9640 1 --2- 172.21.15.38:0/2437211023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f4806ca50 0x7f7f48157700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7f30000c00 tx=0x7f7f300046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.038+0000 7f7f47fff640 1 -- 172.21.15.38:0/2437211023 reap_dead start 2023-12-22T08:40:11.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.038+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/2437211023 shutdown_connections 2023-12-22T08:40:11.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.038+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/2437211023 >> 172.21.15.38:0/2437211023 conn(0x7f7f480cfea0 msgr2=0x7f7f48160f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.040+0000 7f14e3a31640 1 -- 172.21.15.38:0/631316274 --> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14dc06d180 con 0x7f14c00725d0 2023-12-22T08:40:11.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.040+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/2437211023 shutdown_connections 2023-12-22T08:40:11.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.040+0000 7f7f4dbd9640 1 -- 172.21.15.38:0/2437211023 wait complete. 2023-12-22T08:40:11.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.041+0000 7f14d1ffb640 1 -- 172.21.15.38:0/631316274 <== osd.4 v2:172.21.15.89:6800/84338 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f14d8001080 con 0x7f14c00725d0 2023-12-22T08:40:11.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.041+0000 7f14e3a31640 1 -- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] conn(0x7f14c00725d0 msgr2=0x7f14c00749f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.041+0000 7f14e3a31640 1 --2- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] conn(0x7f14c00725d0 0x7f14c00749f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.077 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:11.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.042+0000 7f14e3a31640 1 -- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f14c006a430 msgr2=0x7f14c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.042+0000 7f14e3a31640 1 --2- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f14c006a430 0x7f14c006c8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f14cc006a90 tx=0x7f14cc006a20 comp rx=0 tx=0).stop 2023-12-22T08:40:11.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.042+0000 7f14e3a31640 1 -- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14dc14c250 msgr2=0x7f14dc14f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.042+0000 7f14e3a31640 1 --2- 172.21.15.38:0/631316274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14dc14c250 0x7f14dc14f420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f14d40046d0 tx=0x7f14d4007700 comp rx=0 tx=0).stop 2023-12-22T08:40:11.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.042+0000 7f14e1fce640 1 -- 172.21.15.38:0/631316274 reap_dead start 2023-12-22T08:40:11.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.042+0000 7f14e3a31640 1 -- 172.21.15.38:0/631316274 shutdown_connections 2023-12-22T08:40:11.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.042+0000 7f14e3a31640 1 -- 172.21.15.38:0/631316274 >> 172.21.15.38:0/631316274 conn(0x7f14dc0cfea0 msgr2=0x7f14dc154280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.042+0000 7f14e3a31640 1 -- 172.21.15.38:0/631316274 shutdown_connections 2023-12-22T08:40:11.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.042+0000 7f14e3a31640 1 -- 172.21.15.38:0/631316274 wait complete. 2023-12-22T08:40:11.079 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-22T08:40:11.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.043+0000 7fb29c30a640 1 -- 172.21.15.38:0/3391027288 --> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb29406ce80 con 0x7fb2800726a0 2023-12-22T08:40:11.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.042+0000 7fc208226640 1 -- 172.21.15.38:0/600407636 --> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc1e8002cb0 con 0x7fc1e4072680 2023-12-22T08:40:11.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.043+0000 7fc1f67fc640 1 -- 172.21.15.38:0/600407636 <== osd.6 v2:172.21.15.89:6808/84337 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc1e8002cb0 con 0x7fc1e4072680 2023-12-22T08:40:11.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.043+0000 7fc208226640 1 -- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] conn(0x7fc1e4072680 msgr2=0x7fc1e4074aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.043+0000 7fc208226640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] conn(0x7fc1e4072680 0x7fc1e4074aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.044+0000 7fb292ffd640 1 -- 172.21.15.38:0/3391027288 <== osd.5 v2:172.21.15.89:6816/84339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb28c031630 con 0x7fb2800726a0 2023-12-22T08:40:11.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.044+0000 7fc208226640 1 -- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc1e406a460 msgr2=0x7fc1e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.044+0000 7fc208226640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc1e406a460 0x7fc1e406c920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc200140d60 tx=0x7fc1fc009110 comp rx=0 tx=0).stop 2023-12-22T08:40:11.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.045+0000 7fc208226640 1 -- 172.21.15.38:0/600407636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc200161df0 msgr2=0x7fc2000d38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.045+0000 7fc208226640 1 --2- 172.21.15.38:0/600407636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc200161df0 0x7fc2000d38a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8032000 tx=0x7fc1f8004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:11.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.045+0000 7fc2067c3640 1 -- 172.21.15.38:0/600407636 reap_dead start 2023-12-22T08:40:11.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.045+0000 7fc208226640 1 -- 172.21.15.38:0/600407636 shutdown_connections 2023-12-22T08:40:11.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.045+0000 7fc208226640 1 -- 172.21.15.38:0/600407636 >> 172.21.15.38:0/600407636 conn(0x7fc2000cff10 msgr2=0x7fc2000d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.045+0000 7fc208226640 1 -- 172.21.15.38:0/600407636 shutdown_connections 2023-12-22T08:40:11.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.045+0000 7fb29c30a640 1 -- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] conn(0x7fb2800726a0 msgr2=0x7fb280074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.045+0000 7fb29c30a640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] conn(0x7fb2800726a0 0x7fb280074ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.045+0000 7fb29c30a640 1 -- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb28006a480 msgr2=0x7fb28006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.045+0000 7fb29c30a640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb28006a480 0x7fb28006c940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb2940adc00 tx=0x7fb284009040 comp rx=0 tx=0).stop 2023-12-22T08:40:11.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.045+0000 7fb29c30a640 1 -- 172.21.15.38:0/3391027288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb29406c190 msgr2=0x7fb2941f67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.045+0000 7fb29c30a640 1 --2- 172.21.15.38:0/3391027288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb29406c190 0x7fb2941f67c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb288009f70 tx=0x7fb28800c550 comp rx=0 tx=0).stop 2023-12-22T08:40:11.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.046+0000 7fb29a8a7640 1 -- 172.21.15.38:0/3391027288 reap_dead start 2023-12-22T08:40:11.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.046+0000 7fb29c30a640 1 -- 172.21.15.38:0/3391027288 shutdown_connections 2023-12-22T08:40:11.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.046+0000 7fb29c30a640 1 -- 172.21.15.38:0/3391027288 >> 172.21.15.38:0/3391027288 conn(0x7fb2940cf070 msgr2=0x7fb2940b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.046+0000 7fc208226640 1 -- 172.21.15.38:0/600407636 wait complete. 2023-12-22T08:40:11.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.046+0000 7fb29c30a640 1 -- 172.21.15.38:0/3391027288 shutdown_connections 2023-12-22T08:40:11.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.046+0000 7fb29c30a640 1 -- 172.21.15.38:0/3391027288 wait complete. 2023-12-22T08:40:11.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.054+0000 7fd8eea8f640 1 -- 172.21.15.38:0/268626911 --> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd8e806d180 con 0x7fd8d40726a0 2023-12-22T08:40:11.085 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:11.085 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-22T08:40:11.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.055+0000 7fd8e57fa640 1 -- 172.21.15.38:0/268626911 <== osd.7 v2:172.21.15.89:6821/84340 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd8dc001420 con 0x7fd8d40726a0 2023-12-22T08:40:11.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.056+0000 7fd8eea8f640 1 -- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] conn(0x7fd8d40726a0 msgr2=0x7fd8d4074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.056+0000 7fd8eea8f640 1 --2- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] conn(0x7fd8d40726a0 0x7fd8d4074ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.056+0000 7fd8eea8f640 1 -- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd8d406a480 msgr2=0x7fd8d406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.056+0000 7fd8eea8f640 1 --2- 172.21.15.38:0/268626911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd8d406a480 0x7fd8d406c940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd8e002be90 tx=0x7fd8e0030000 comp rx=0 tx=0).stop 2023-12-22T08:40:11.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.056+0000 7fd8eea8f640 1 -- 172.21.15.38:0/268626911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8e80b3dc0 msgr2=0x7fd8e8154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.056+0000 7fd8eea8f640 1 --2- 172.21.15.38:0/268626911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8e80b3dc0 0x7fd8e8154d30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800e880 tx=0x7fd8d800ed40 comp rx=0 tx=0).stop 2023-12-22T08:40:11.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.056+0000 7fd8ed02c640 1 -- 172.21.15.38:0/268626911 reap_dead start 2023-12-22T08:40:11.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.056+0000 7fd8eea8f640 1 -- 172.21.15.38:0/268626911 shutdown_connections 2023-12-22T08:40:11.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.056+0000 7fd8eea8f640 1 -- 172.21.15.38:0/268626911 >> 172.21.15.38:0/268626911 conn(0x7fd8e80cfea0 msgr2=0x7fd8e815d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.057+0000 7fd8eea8f640 1 -- 172.21.15.38:0/268626911 shutdown_connections 2023-12-22T08:40:11.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.057+0000 7fd8eea8f640 1 -- 172.21.15.38:0/268626911 wait complete. 2023-12-22T08:40:11.088 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:11.088 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-22T08:40:11.089 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:11.089 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-22T08:40:11.090 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:11.090 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:11.091 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-22T08:40:11.091 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-22T08:40:11.092 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:11.092 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-22T08:40:11.093 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:11.093 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-22T08:40:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.428+0000 7f1def59e640 1 Processor -- start 2023-12-22T08:40:11.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.428+0000 7f1def59e640 1 -- start start 2023-12-22T08:40:11.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.430+0000 7f1def59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1de80eb260 0x7f1de80eb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.430+0000 7f1def59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1de803ec50 0x7f1de80ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.430+0000 7f1def59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de80385e0 con 0x7f1de8057c70 2023-12-22T08:40:11.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.430+0000 7f1def59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de8057850 con 0x7f1de803ec50 2023-12-22T08:40:11.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.430+0000 7f1def59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80540c0 con 0x7f1de80eb260 2023-12-22T08:40:11.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.431+0000 7f1deed9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1de8057c70 0x7f1de8058100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:58152/0 (socket says 172.21.15.38:58152) 2023-12-22T08:40:11.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.431+0000 7f1deed9d640 1 -- 172.21.15.38:0/4001533946 learned_addr learned my addr 172.21.15.38:0/4001533946 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:11.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.432+0000 7f1dee59c640 1 --2- 172.21.15.38:0/4001533946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1de80eb260 0x7f1de80eb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.431+0000 7f02fb57e640 1 Processor -- start 2023-12-22T08:40:11.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.432+0000 7f1dedd9b640 1 --2- 172.21.15.38:0/4001533946 >> v2:172.21.15.38:3300/0 conn(0x7f1de803ec50 0x7f1de80ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.432+0000 7f02fb57e640 1 -- start start 2023-12-22T08:40:11.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.433+0000 7f1ded59a640 1 -- 172.21.15.38:0/4001533946 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727172841 0 0) 0x7f1de80385e0 con 0x7f1de8057c70 2023-12-22T08:40:11.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.433+0000 7f1ded59a640 1 -- 172.21.15.38:0/4001533946 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dd8003520 con 0x7f1de8057c70 2023-12-22T08:40:11.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.433+0000 7f1dedd9b640 1 -- 172.21.15.38:0/4001533946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1de80eb260 msgr2=0x7f1de80eb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:11.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.433+0000 7f1dedd9b640 1 --2- 172.21.15.38:0/4001533946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1de80eb260 0x7f1de80eb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.433+0000 7f1dedd9b640 1 -- 172.21.15.38:0/4001533946 >> v1:172.21.15.89:6789/0 conn(0x7f1de8057c70 legacy=0x7f1de8058100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.433+0000 7f1dedd9b640 1 -- 172.21.15.38:0/4001533946 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de80543a0 con 0x7f1de803ec50 2023-12-22T08:40:11.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.434+0000 7f02fb57e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f02f4071ac0 0x7f02f4162880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.434+0000 7f02fb57e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02f40b1e90 0x7f02f4165a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.435+0000 7f02fb57e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f4162dc0 con 0x7f02f4165fd0 2023-12-22T08:40:11.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.435+0000 7f02fb57e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f4161d20 con 0x7f02f4071ac0 2023-12-22T08:40:11.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.435+0000 7f02fb57e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40b2350 con 0x7f02f40b1e90 2023-12-22T08:40:11.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.435+0000 7f02f8b19640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02f40b1e90 0x7f02f4165a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.435+0000 7f02f9b1b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f02f4165fd0 0x7f02f40cca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49654/0 (socket says 172.21.15.38:49654) 2023-12-22T08:40:11.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.435+0000 7f02f9b1b640 1 -- 172.21.15.38:0/2686549174 learned_addr learned my addr 172.21.15.38:0/2686549174 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:11.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.435+0000 7f02f931a640 1 --2- 172.21.15.38:0/2686549174 >> v2:172.21.15.38:3300/0 conn(0x7f02f4071ac0 0x7f02f4162880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.436+0000 7f02f8b19640 1 -- 172.21.15.38:0/2686549174 >> v2:172.21.15.38:3300/0 conn(0x7f02f4071ac0 msgr2=0x7f02f4162880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:11.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.436+0000 7f02f8b19640 1 --2- 172.21.15.38:0/2686549174 >> v2:172.21.15.38:3300/0 conn(0x7f02f4071ac0 0x7f02f4162880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.436+0000 7f02f8b19640 1 -- 172.21.15.38:0/2686549174 >> v1:172.21.15.38:6789/0 conn(0x7f02f4165fd0 legacy=0x7f02f40cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.436+0000 7f02f8b19640 1 -- 172.21.15.38:0/2686549174 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f40b2630 con 0x7f02f40b1e90 2023-12-22T08:40:11.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.437+0000 7f1dedd9b640 1 --2- 172.21.15.38:0/4001533946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1de803ec50 0x7f1de80ebb80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1de00097a0 tx=0x7f1de002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705954c9b0375a3b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.437+0000 7f02f931a640 1 --2- 172.21.15.38:0/2686549174 >> v2:172.21.15.38:3300/0 conn(0x7f02f4071ac0 0x7f02f4162880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:11.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.438+0000 7f1ded59a640 1 -- 172.21.15.38:0/4001533946 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0031780 con 0x7f1de803ec50 2023-12-22T08:40:11.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.438+0000 7f02f8b19640 1 --2- 172.21.15.38:0/2686549174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02f40b1e90 0x7f02f4165a90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f02f00097a0 tx=0x7f02f002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4527f970f2343b33 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.438+0000 7f1ded59a640 1 -- 172.21.15.38:0/4001533946 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de00318e0 con 0x7f1de803ec50 2023-12-22T08:40:11.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.438+0000 7f02ebfff640 1 -- 172.21.15.38:0/2686549174 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0031640 con 0x7f02f40b1e90 2023-12-22T08:40:11.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.439+0000 7f02ebfff640 1 -- 172.21.15.38:0/2686549174 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f00317a0 con 0x7f02f40b1e90 2023-12-22T08:40:11.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.439+0000 7f02ebfff640 1 -- 172.21.15.38:0/2686549174 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0031b70 con 0x7f02f40b1e90 2023-12-22T08:40:11.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.439+0000 7f1def59e640 1 -- 172.21.15.38:0/4001533946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1de803ec50 msgr2=0x7f1de80ebb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.439+0000 7f1ded59a640 1 -- 172.21.15.38:0/4001533946 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0031780 con 0x7f1de803ec50 2023-12-22T08:40:11.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.440+0000 7f1def59e640 1 --2- 172.21.15.38:0/4001533946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1de803ec50 0x7f1de80ebb80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1de00097a0 tx=0x7f1de002b820 comp rx=0 tx=0).stop 2023-12-22T08:40:11.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.440+0000 7f02fb57e640 1 -- 172.21.15.38:0/2686549174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02f40b1e90 msgr2=0x7f02f4165a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.440+0000 7f1def59e640 1 -- 172.21.15.38:0/4001533946 shutdown_connections 2023-12-22T08:40:11.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.440+0000 7f1def59e640 1 --2- 172.21.15.38:0/4001533946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1de803ec50 0x7f1de80ebb80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.440+0000 7f1def59e640 1 --2- 172.21.15.38:0/4001533946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1de80eb260 0x7f1de80eb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.440+0000 7f1def59e640 1 -- 172.21.15.38:0/4001533946 >> 172.21.15.38:0/4001533946 conn(0x7f1de8055a40 msgr2=0x7f1de8055e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.440+0000 7f1def59e640 1 -- 172.21.15.38:0/4001533946 shutdown_connections 2023-12-22T08:40:11.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.440+0000 7f02fb57e640 1 --2- 172.21.15.38:0/2686549174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02f40b1e90 0x7f02f4165a90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f02f00097a0 tx=0x7f02f002b8f0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.440+0000 7f02fb57e640 1 -- 172.21.15.38:0/2686549174 shutdown_connections 2023-12-22T08:40:11.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.440+0000 7f02fb57e640 1 --2- 172.21.15.38:0/2686549174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02f40b1e90 0x7f02f4165a90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.440+0000 7f02fb57e640 1 --2- 172.21.15.38:0/2686549174 >> v2:172.21.15.38:3300/0 conn(0x7f02f4071ac0 0x7f02f4162880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.440+0000 7f02fb57e640 1 -- 172.21.15.38:0/2686549174 >> 172.21.15.38:0/2686549174 conn(0x7f02f40cee70 msgr2=0x7f02f40cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.440+0000 7f1def59e640 1 -- 172.21.15.38:0/4001533946 wait complete. 2023-12-22T08:40:11.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.441+0000 7f02fb57e640 1 -- 172.21.15.38:0/2686549174 shutdown_connections 2023-12-22T08:40:11.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.441+0000 7f02fb57e640 1 -- 172.21.15.38:0/2686549174 wait complete. 2023-12-22T08:40:11.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.443+0000 7f1def59e640 1 Processor -- start 2023-12-22T08:40:11.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.444+0000 7f1def59e640 1 -- start start 2023-12-22T08:40:11.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.444+0000 7f02fb57e640 1 Processor -- start 2023-12-22T08:40:11.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.444+0000 7f02fb57e640 1 -- start start 2023-12-22T08:40:11.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.446+0000 7f1def59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1de803ec50 0x7f1de80e4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.446+0000 7f1def59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8057c70 0x7f1de804db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.446+0000 7f02fb57e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02f4071ac0 0x7f02f40c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.446+0000 7f02fb57e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02f40b1e90 0x7f02f40af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.446+0000 7f02fb57e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02f4165fd0 0x7f02f40c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.446+0000 7f02fb57e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40c5f40 con 0x7f02f4071ac0 2023-12-22T08:40:11.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.446+0000 7f02fb57e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40c6220 con 0x7f02f40b1e90 2023-12-22T08:40:11.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.446+0000 7f02fb57e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40c6500 con 0x7f02f4165fd0 2023-12-22T08:40:11.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.446+0000 7f1def59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1de80eb260 0x7f1de8037c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.447+0000 7f1def59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de8009f50 con 0x7f1de80eb260 2023-12-22T08:40:11.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.447+0000 7f02f931a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02f4071ac0 0x7f02f40c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.447+0000 7f02f9b1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02f4165fd0 0x7f02f40c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.447+0000 7f1def59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de817deb0 con 0x7f1de8057c70 2023-12-22T08:40:11.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.447+0000 7f1def59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de804e080 con 0x7f1de803ec50 2023-12-22T08:40:11.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.447+0000 7f1dedd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8057c70 0x7f1de804db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.447+0000 7f02f8b19640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02f40b1e90 0x7f02f40af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.447+0000 7f1dedd9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8057c70 0x7f1de804db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:58468/0 (socket says 172.21.15.38:58468) 2023-12-22T08:40:11.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.447+0000 7f1dedd9b640 1 -- 172.21.15.38:0/493994579 learned_addr learned my addr 172.21.15.38:0/493994579 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.447+0000 7f02f9b1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02f4165fd0 0x7f02f40c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:56054/0 (socket says 172.21.15.38:56054) 2023-12-22T08:40:11.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.448+0000 7f02f8b19640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02f40b1e90 0x7f02f40af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:58460/0 (socket says 172.21.15.38:58460) 2023-12-22T08:40:11.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.448+0000 7f02f9b1b640 1 -- 172.21.15.38:0/1459082971 learned_addr learned my addr 172.21.15.38:0/1459082971 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.448+0000 7f1dee59c640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1de803ec50 0x7f1de80e4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.449+0000 7f1dedd9b640 1 -- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1de803ec50 msgr2=0x7f1de80e4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.449+0000 7f1dedd9b640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1de803ec50 0x7f1de80e4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.449+0000 7f1dedd9b640 1 -- 172.21.15.38:0/493994579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1de80eb260 msgr2=0x7f1de8037c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.449+0000 7f1dedd9b640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1de80eb260 0x7f1de8037c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.449+0000 7f1dedd9b640 1 -- 172.21.15.38:0/493994579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0009400 con 0x7f1de8057c70 2023-12-22T08:40:11.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.449+0000 7f02f931a640 1 -- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02f4165fd0 msgr2=0x7f02f40c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.450+0000 7f1dee59c640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1de803ec50 0x7f1de80e4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:11.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.450+0000 7f02f931a640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02f4165fd0 0x7f02f40c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.450+0000 7f02f931a640 1 -- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02f40b1e90 msgr2=0x7f02f40af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.450+0000 7f02f931a640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02f40b1e90 0x7f02f40af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.450+0000 7f02f931a640 1 -- 172.21.15.38:0/1459082971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec009a70 con 0x7f02f4071ac0 2023-12-22T08:40:11.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.450+0000 7f02f8b19640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02f40b1e90 0x7f02f40af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:11.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.450+0000 7f0e6dbf6640 1 Processor -- start 2023-12-22T08:40:11.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.450+0000 7f1dedd9b640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8057c70 0x7f1de804db40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1de00098c0 tx=0x7f1de00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.450+0000 7f02f9b1b640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02f4165fd0 0x7f02f40c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:11.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.450+0000 7f0e6dbf6640 1 -- start start 2023-12-22T08:40:11.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.450+0000 7fb5bbfff640 1 Processor -- start 2023-12-22T08:40:11.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.451+0000 7f1ddeffd640 1 -- 172.21.15.38:0/493994579 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0003810 con 0x7f1de8057c70 2023-12-22T08:40:11.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.451+0000 7f02f931a640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02f4071ac0 0x7f02f40c8350 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00efc0 tx=0x7f02ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.451+0000 7f1ddeffd640 1 -- 172.21.15.38:0/493994579 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de0040070 con 0x7f1de8057c70 2023-12-22T08:40:11.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.451+0000 7f807ffff640 1 Processor -- start 2023-12-22T08:40:11.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.451+0000 7f1ddeffd640 1 -- 172.21.15.38:0/493994579 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0003bb0 con 0x7f1de8057c70 2023-12-22T08:40:11.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.451+0000 7fb5bbfff640 1 -- start start 2023-12-22T08:40:11.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.451+0000 7f1def59e640 1 -- 172.21.15.38:0/493994579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de817d230 con 0x7f1de8057c70 2023-12-22T08:40:11.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.451+0000 7f1def59e640 1 -- 172.21.15.38:0/493994579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de817d7f0 con 0x7f1de8057c70 2023-12-22T08:40:11.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.452+0000 7f02e9ffb640 1 -- 172.21.15.38:0/1459082971 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec014480 con 0x7f02f4071ac0 2023-12-22T08:40:11.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.452+0000 7f807ffff640 1 -- start start 2023-12-22T08:40:11.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.452+0000 7f02e9ffb640 1 -- 172.21.15.38:0/1459082971 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec00f040 con 0x7f02f4071ac0 2023-12-22T08:40:11.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.452+0000 7f02e9ffb640 1 -- 172.21.15.38:0/1459082971 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec014820 con 0x7f02f4071ac0 2023-12-22T08:40:11.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.452+0000 7f1def59e640 1 -- 172.21.15.38:0/493994579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de80573f0 con 0x7f1de8057c70 2023-12-22T08:40:11.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.453+0000 7f02fb57e640 1 -- 172.21.15.38:0/1459082971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f0009400 con 0x7f02f4071ac0 2023-12-22T08:40:11.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.453+0000 7f02fb57e640 1 -- 172.21.15.38:0/1459082971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f40c6ac0 con 0x7f02f4071ac0 2023-12-22T08:40:11.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.453+0000 7f0e6dbf6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0e680b22c0 0x7f0e680b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.453+0000 7f0e6dbf6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e680cb830 0x7f0e680cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.453+0000 7f0e6dbf6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e680cc200 con 0x7f0e680b26a0 2023-12-22T08:40:11.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.453+0000 7f0e6dbf6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6806c610 con 0x7f0e680b22c0 2023-12-22T08:40:11.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.453+0000 7f0e6dbf6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e680b4510 con 0x7f0e680cb830 2023-12-22T08:40:11.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.453+0000 7fb5bbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5b40344e0 0x7fb5b404f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.453+0000 7fb5bbfff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b400b360 con 0x7fb5b40eaad0 2023-12-22T08:40:11.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.453+0000 7fb5bbfff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b40548b0 con 0x7fb5b4052b40 2023-12-22T08:40:11.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.453+0000 7fb5bbfff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b4053100 con 0x7fb5b40344e0 2023-12-22T08:40:11.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.454+0000 7f0e677fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0e680b22c0 0x7f0e680b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.454+0000 7f0e66ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0e680b26a0 0x7f0e6806ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:58158/0 (socket says 172.21.15.38:58158) 2023-12-22T08:40:11.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.454+0000 7f0e66ffd640 1 -- 172.21.15.38:0/3224309046 learned_addr learned my addr 172.21.15.38:0/3224309046 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:11.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.454+0000 7fb5bb7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb5b4052b40 0x7fb5b4048b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:58164/0 (socket says 172.21.15.38:58164) 2023-12-22T08:40:11.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.454+0000 7fb5bb7fe640 1 -- 172.21.15.38:0/3277022510 learned_addr learned my addr 172.21.15.38:0/3277022510 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:11.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.454+0000 7f0e67fff640 1 --2- 172.21.15.38:0/3224309046 >> v2:172.21.15.89:3300/0 conn(0x7f0e680cb830 0x7f0e680cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.454+0000 7f807ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f808006a3d0 0x7f80800cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.454+0000 7f807ffff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808015aed0 con 0x7f80800cbf70 2023-12-22T08:40:11.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.454+0000 7f807ffff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808015a8e0 con 0x7f808015c8f0 2023-12-22T08:40:11.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.454+0000 7f807ffff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80800cd740 con 0x7f808006a3d0 2023-12-22T08:40:11.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.455+0000 7f807effd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f808015c8f0 0x7f80800cb860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:58168/0 (socket says 172.21.15.38:58168) 2023-12-22T08:40:11.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.455+0000 7f807effd640 1 -- 172.21.15.38:0/568712617 learned_addr learned my addr 172.21.15.38:0/568712617 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:11.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.454+0000 7f02fb57e640 1 -- 172.21.15.38:0/1459082971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f4061910 con 0x7f02f4071ac0 2023-12-22T08:40:11.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.455+0000 7f807f7fe640 1 --2- 172.21.15.38:0/568712617 >> v2:172.21.15.38:3300/0 conn(0x7f808006a3d0 0x7f80800cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.456+0000 7f1ddeffd640 1 -- 172.21.15.38:0/493994579 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1de0003d10 con 0x7f1de8057c70 2023-12-22T08:40:11.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.456+0000 7f0e67fff640 1 -- 172.21.15.38:0/3224309046 >> v2:172.21.15.38:3300/0 conn(0x7f0e680b22c0 msgr2=0x7f0e680b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:11.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.456+0000 7f0e67fff640 1 --2- 172.21.15.38:0/3224309046 >> v2:172.21.15.38:3300/0 conn(0x7f0e680b22c0 0x7f0e680b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.456+0000 7f0e67fff640 1 -- 172.21.15.38:0/3224309046 >> v1:172.21.15.89:6789/0 conn(0x7f0e680b26a0 legacy=0x7f0e6806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.456+0000 7f0e67fff640 1 -- 172.21.15.38:0/3224309046 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e680b3f50 con 0x7f0e680cb830 2023-12-22T08:40:11.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.455+0000 7fb5ba7fc640 1 --2- 172.21.15.38:0/3277022510 >> v2:172.21.15.89:3300/0 conn(0x7fb5b40344e0 0x7fb5b404f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.456+0000 7fb5b9ffb640 1 -- 172.21.15.38:0/3277022510 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010339465 0 0) 0x7fb5b400b360 con 0x7fb5b40eaad0 2023-12-22T08:40:11.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.457+0000 7fb5b9ffb640 1 -- 172.21.15.38:0/3277022510 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5a4003520 con 0x7fb5b40eaad0 2023-12-22T08:40:11.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.457+0000 7fb5b9ffb640 1 -- 172.21.15.38:0/3277022510 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4063028851 0 0) 0x7fb5a4003520 con 0x7fb5b40eaad0 2023-12-22T08:40:11.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.457+0000 7fb5ba7fc640 1 -- 172.21.15.38:0/3277022510 >> v1:172.21.15.89:6789/0 conn(0x7fb5b4052b40 legacy=0x7fb5b4048b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.457+0000 7fb5ba7fc640 1 -- 172.21.15.38:0/3277022510 >> v1:172.21.15.38:6789/0 conn(0x7fb5b40eaad0 legacy=0x7fb5b40541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.457+0000 7fb5ba7fc640 1 -- 172.21.15.38:0/3277022510 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b40533e0 con 0x7fb5b40344e0 2023-12-22T08:40:11.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.456+0000 7f807f7fe640 1 -- 172.21.15.38:0/568712617 >> v1:172.21.15.89:6789/0 conn(0x7f808015c8f0 legacy=0x7f80800cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.456+0000 7f807f7fe640 1 -- 172.21.15.38:0/568712617 >> v1:172.21.15.38:6789/0 conn(0x7f80800cbf70 legacy=0x7f80800ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:11.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.456+0000 7f807f7fe640 1 -- 172.21.15.38:0/568712617 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8080159d60 con 0x7f808006a3d0 2023-12-22T08:40:11.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.458+0000 7f0e67fff640 1 --2- 172.21.15.38:0/3224309046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e680cb830 0x7f0e680cbcc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e680cdf90 tx=0x7f0e6002be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26e06eae9583f51e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.458+0000 7f02e9ffb640 1 -- 172.21.15.38:0/1459082971 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f02ec014980 con 0x7f02f4071ac0 2023-12-22T08:40:11.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.458+0000 7f1ddeffd640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1dd006a4d0 0x7f1dd006c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.458+0000 7f1ddeffd640 1 -- 172.21.15.38:0/493994579 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1de0042070 con 0x7f1de8057c70 2023-12-22T08:40:11.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.459+0000 7f807f7fe640 1 --2- 172.21.15.38:0/568712617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f808006a3d0 0x7f80800cdb90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8078009d90 tx=0x7f807802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d26faf35fc1fb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.459+0000 7fb5ba7fc640 1 --2- 172.21.15.38:0/3277022510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40344e0 0x7fb5b404f710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00097a0 tx=0x7fb5b002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bada81c1d39ee41 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.459+0000 7f1dee59c640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1dd006a4d0 0x7f1dd006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.460+0000 7f02e9ffb640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02d806a500 0x7f02d806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.460+0000 7f02e9ffb640 1 -- 172.21.15.38:0/1459082971 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02ec0896f0 con 0x7f02f4071ac0 2023-12-22T08:40:11.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.460+0000 7f02f8b19640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02d806a500 0x7f02d806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.461+0000 7f1dee59c640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1dd006a4d0 0x7f1dd006c990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009ac0 tx=0x7f1de4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.462+0000 7f02f8b19640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02d806a500 0x7f02d806c9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f02f0036000 tx=0x7f02f003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.462+0000 7fd8a7417640 1 Processor -- start 2023-12-22T08:40:11.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.462+0000 7fd8a7417640 1 -- start start 2023-12-22T08:40:11.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.463+0000 7f989f17e640 1 Processor -- start 2023-12-22T08:40:11.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.463+0000 7f989f17e640 1 -- start start 2023-12-22T08:40:11.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.463+0000 7fd8a7417640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd8a00b3f90 0x7fd8a015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.463+0000 7fd8a7417640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a006ca50 0x7fd8a0070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.463+0000 7fd8a7417640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a015eb20 con 0x7fd8a015e740 2023-12-22T08:40:11.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.463+0000 7fd8a7417640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a006e650 con 0x7fd8a00b3f90 2023-12-22T08:40:11.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.463+0000 7fd8a7417640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0070770 con 0x7fd8a006ca50 2023-12-22T08:40:11.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.464+0000 7fd8a51b3640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd8a015e740 0x7fd8a00b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49682/0 (socket says 172.21.15.38:49682) 2023-12-22T08:40:11.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.464+0000 7fd8a51b3640 1 -- 172.21.15.38:0/1169779175 learned_addr learned my addr 172.21.15.38:0/1169779175 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:11.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.464+0000 7fd8a59b4640 1 --2- 172.21.15.38:0/1169779175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a006ca50 0x7fd8a0070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.464+0000 7fd8a49b2640 1 --2- 172.21.15.38:0/1169779175 >> v2:172.21.15.89:3300/0 conn(0x7fd8a00b3f90 0x7fd8a015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.464+0000 7f989f17e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9890051e20 0x7f9890009e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.465+0000 7fd8a59b4640 1 -- 172.21.15.38:0/1169779175 >> v2:172.21.15.89:3300/0 conn(0x7fd8a00b3f90 msgr2=0x7fd8a015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:11.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.465+0000 7fd8a59b4640 1 --2- 172.21.15.38:0/1169779175 >> v2:172.21.15.89:3300/0 conn(0x7fd8a00b3f90 0x7fd8a015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.465+0000 7fd8a59b4640 1 -- 172.21.15.38:0/1169779175 >> v1:172.21.15.38:6789/0 conn(0x7fd8a015e740 legacy=0x7fd8a00b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.465+0000 7fd8a59b4640 1 -- 172.21.15.38:0/1169779175 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a006d180 con 0x7fd8a006ca50 2023-12-22T08:40:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.465+0000 7f989f17e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9890052260 0x7f989000a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.465+0000 7f989f17e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98900e1900 con 0x7f98900e1520 2023-12-22T08:40:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.465+0000 7f989f17e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9890055440 con 0x7f9890052260 2023-12-22T08:40:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.465+0000 7f989f17e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9890055700 con 0x7f9890051e20 2023-12-22T08:40:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.465+0000 7f989e17c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f98900e1520 0x7f98900561e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49688/0 (socket says 172.21.15.38:49688) 2023-12-22T08:40:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.465+0000 7f989e17c640 1 -- 172.21.15.38:0/3533532073 learned_addr learned my addr 172.21.15.38:0/3533532073 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.465+0000 7f989d97b640 1 --2- 172.21.15.38:0/3533532073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9890051e20 0x7f9890009e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.465+0000 7f989e97d640 1 --2- 172.21.15.38:0/3533532073 >> v2:172.21.15.89:3300/0 conn(0x7f9890052260 0x7f989000a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.466+0000 7f989d97b640 1 -- 172.21.15.38:0/3533532073 >> v2:172.21.15.89:3300/0 conn(0x7f9890052260 msgr2=0x7f989000a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:11.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.466+0000 7f989d97b640 1 --2- 172.21.15.38:0/3533532073 >> v2:172.21.15.89:3300/0 conn(0x7f9890052260 0x7f989000a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.466+0000 7f989d97b640 1 -- 172.21.15.38:0/3533532073 >> v1:172.21.15.38:6789/0 conn(0x7f98900e1520 legacy=0x7f98900561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.466+0000 7f989d97b640 1 -- 172.21.15.38:0/3533532073 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98900559e0 con 0x7f9890051e20 2023-12-22T08:40:11.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.466+0000 7f989e97d640 1 --2- 172.21.15.38:0/3533532073 >> v2:172.21.15.89:3300/0 conn(0x7f9890052260 0x7f989000a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:11.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.466+0000 7fd8a59b4640 1 --2- 172.21.15.38:0/1169779175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a006ca50 0x7fd8a0070c00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd898009d90 tx=0x7fd89802bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b97272702ba7716f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.467+0000 7fd897fff640 1 -- 172.21.15.38:0/1169779175 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89802cb30 con 0x7fd8a006ca50 2023-12-22T08:40:11.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.467+0000 7fd897fff640 1 -- 172.21.15.38:0/1169779175 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89802cc90 con 0x7fd8a006ca50 2023-12-22T08:40:11.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.467+0000 7fd897fff640 1 -- 172.21.15.38:0/1169779175 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898034440 con 0x7fd8a006ca50 2023-12-22T08:40:11.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.467+0000 7f989d97b640 1 --2- 172.21.15.38:0/3533532073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9890051e20 0x7f9890009e40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f98880097a0 tx=0x7f988802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66b68cb41ac679a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.467+0000 7fd8a7417640 1 -- 172.21.15.38:0/1169779175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a006ca50 msgr2=0x7fd8a0070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.467+0000 7fd8a7417640 1 --2- 172.21.15.38:0/1169779175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a006ca50 0x7fd8a0070c00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd898009d90 tx=0x7fd89802bd80 comp rx=0 tx=0).stop 2023-12-22T08:40:11.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.468+0000 7fd8a7417640 1 -- 172.21.15.38:0/1169779175 shutdown_connections 2023-12-22T08:40:11.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.468+0000 7fd8a7417640 1 --2- 172.21.15.38:0/1169779175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a006ca50 0x7fd8a0070c00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.468+0000 7fd8a7417640 1 --2- 172.21.15.38:0/1169779175 >> v2:172.21.15.89:3300/0 conn(0x7fd8a00b3f90 0x7fd8a015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.468+0000 7fd8a7417640 1 -- 172.21.15.38:0/1169779175 >> 172.21.15.38:0/1169779175 conn(0x7fd8a00cfea0 msgr2=0x7fd8a00d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.468+0000 7fd8a7417640 1 -- 172.21.15.38:0/1169779175 shutdown_connections 2023-12-22T08:40:11.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.468+0000 7f989d17a640 1 -- 172.21.15.38:0/3533532073 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888031830 con 0x7f9890051e20 2023-12-22T08:40:11.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.468+0000 7f989d17a640 1 -- 172.21.15.38:0/3533532073 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9888031990 con 0x7f9890051e20 2023-12-22T08:40:11.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.468+0000 7f989d17a640 1 -- 172.21.15.38:0/3533532073 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888031d20 con 0x7f9890051e20 2023-12-22T08:40:11.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.468+0000 7f807dffb640 1 -- 172.21.15.38:0/568712617 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807802cc60 con 0x7f808006a3d0 2023-12-22T08:40:11.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.468+0000 7fd8a7417640 1 -- 172.21.15.38:0/1169779175 wait complete. 2023-12-22T08:40:11.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.468+0000 7f807dffb640 1 -- 172.21.15.38:0/568712617 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807802cdc0 con 0x7f808006a3d0 2023-12-22T08:40:11.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.468+0000 7f807dffb640 1 -- 172.21.15.38:0/568712617 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078034660 con 0x7f808006a3d0 2023-12-22T08:40:11.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f02e9ffb640 1 -- 172.21.15.38:0/1459082971 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f02ec054d70 con 0x7f02f4071ac0 2023-12-22T08:40:11.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f989f17e640 1 -- 172.21.15.38:0/3533532073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9890051e20 msgr2=0x7f9890009e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f989f17e640 1 --2- 172.21.15.38:0/3533532073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9890051e20 0x7f9890009e40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f98880097a0 tx=0x7f988802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f989f17e640 1 -- 172.21.15.38:0/3533532073 shutdown_connections 2023-12-22T08:40:11.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f989f17e640 1 --2- 172.21.15.38:0/3533532073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9890051e20 0x7f9890009e40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f989f17e640 1 --2- 172.21.15.38:0/3533532073 >> v2:172.21.15.89:3300/0 conn(0x7f9890052260 0x7f989000a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f989f17e640 1 -- 172.21.15.38:0/3533532073 >> 172.21.15.38:0/3533532073 conn(0x7f9890056dc0 msgr2=0x7f98900571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f807ffff640 1 -- 172.21.15.38:0/568712617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f808006a3d0 msgr2=0x7f80800cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f807ffff640 1 --2- 172.21.15.38:0/568712617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f808006a3d0 0x7f80800cdb90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8078009d90 tx=0x7f807802beb0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f989f17e640 1 -- 172.21.15.38:0/3533532073 shutdown_connections 2023-12-22T08:40:11.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f807ffff640 1 -- 172.21.15.38:0/568712617 shutdown_connections 2023-12-22T08:40:11.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f807ffff640 1 --2- 172.21.15.38:0/568712617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f808006a3d0 0x7f80800cdb90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f807ffff640 1 -- 172.21.15.38:0/568712617 >> 172.21.15.38:0/568712617 conn(0x7f80800b1f70 msgr2=0x7f80800b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f807ffff640 1 -- 172.21.15.38:0/568712617 shutdown_connections 2023-12-22T08:40:11.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.469+0000 7f989f17e640 1 -- 172.21.15.38:0/3533532073 wait complete. 2023-12-22T08:40:11.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.470+0000 7f807ffff640 1 -- 172.21.15.38:0/568712617 wait complete. 2023-12-22T08:40:11.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.470+0000 7fd8a7417640 1 Processor -- start 2023-12-22T08:40:11.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.470+0000 7fd8a7417640 1 -- start start 2023-12-22T08:40:11.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.470+0000 7f22e4f3c640 1 Processor -- start 2023-12-22T08:40:11.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.470+0000 7f22e4f3c640 1 -- start start 2023-12-22T08:40:11.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.471+0000 7fd8a7417640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8a006ca50 0x7fd8a01559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.471+0000 7fd8a7417640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a00b3f90 0x7fd8a01478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.471+0000 7fd8a7417640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8a015e740 0x7fd8a014a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.471+0000 7fd8a7417640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0147e10 con 0x7fd8a015e740 2023-12-22T08:40:11.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.471+0000 7fd8a7417640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a014a880 con 0x7fd8a006ca50 2023-12-22T08:40:11.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.471+0000 7fd8a7417640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0155fc0 con 0x7fd8a00b3f90 2023-12-22T08:40:11.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.471+0000 7f989f17e640 1 Processor -- start 2023-12-22T08:40:11.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.471+0000 7f989f17e640 1 -- start start 2023-12-22T08:40:11.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.472+0000 7f807ffff640 1 Processor -- start 2023-12-22T08:40:11.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.472+0000 7fd8a59b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8a015e740 0x7fd8a014a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.472+0000 7fd8a59b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8a015e740 0x7fd8a014a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34886/0 (socket says 172.21.15.38:34886) 2023-12-22T08:40:11.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.472+0000 7fd8a59b4640 1 -- 172.21.15.38:0/4105354195 learned_addr learned my addr 172.21.15.38:0/4105354195 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.472+0000 7fd8a51b3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8a006ca50 0x7fd8a01559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.472+0000 7fd8a49b2640 1 --2- 172.21.15.38:0/4105354195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a00b3f90 0x7fd8a01478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.472+0000 7f807ffff640 1 -- start start 2023-12-22T08:40:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.472+0000 7fd8a59b4640 1 -- 172.21.15.38:0/4105354195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a00b3f90 msgr2=0x7fd8a01478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.472+0000 7fd8a59b4640 1 --2- 172.21.15.38:0/4105354195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a00b3f90 0x7fd8a01478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.472+0000 7fd8a59b4640 1 -- 172.21.15.38:0/4105354195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8a006ca50 msgr2=0x7fd8a01559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.472+0000 7fd8a59b4640 1 --2- 172.21.15.38:0/4105354195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8a006ca50 0x7fd8a01559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.472+0000 7fd8a59b4640 1 -- 172.21.15.38:0/4105354195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd898009a70 con 0x7fd8a015e740 2023-12-22T08:40:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f989f17e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9890051e20 0x7f98901784d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.472+0000 7f22e4f3c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e015ec50 0x7f22e00d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f22e4f3c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f22e00d0b60 0x7f22e006f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f22e4f3c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e015a8d0 con 0x7f22e0143f10 2023-12-22T08:40:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f22e4f3c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e00d0fd0 con 0x7f22e00d0b60 2023-12-22T08:40:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f22e4f3c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e00cfd60 con 0x7f22e015ec50 2023-12-22T08:40:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7fd8a59b4640 1 --2- 172.21.15.38:0/4105354195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8a015e740 0x7fd8a014a340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd898009d90 tx=0x7fd898004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f989f17e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9890052260 0x7f9890031bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f989f17e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98900e1520 0x7f98900e1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f989f17e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9890032490 con 0x7f9890052260 2023-12-22T08:40:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f989f17e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9890032770 con 0x7f98900e1520 2023-12-22T08:40:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f989f17e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9890032a50 con 0x7f9890051e20 2023-12-22T08:40:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f989d97b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9890052260 0x7f9890031bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f989d97b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9890052260 0x7f9890031bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34888/0 (socket says 172.21.15.38:34888) 2023-12-22T08:40:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f989d97b640 1 -- 172.21.15.38:0/368441285 learned_addr learned my addr 172.21.15.38:0/368441285 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7fd895ffb640 1 -- 172.21.15.38:0/4105354195 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898009450 con 0x7fd8a015e740 2023-12-22T08:40:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7fd895ffb640 1 -- 172.21.15.38:0/4105354195 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd898040450 con 0x7fd8a015e740 2023-12-22T08:40:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7fd895ffb640 1 -- 172.21.15.38:0/4105354195 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898040800 con 0x7fd8a015e740 2023-12-22T08:40:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f989e17c640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9890051e20 0x7f98901784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f22d5d9b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e015ec50 0x7f22e00d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f22d5d9b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e015ec50 0x7f22e00d0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:56082/0 (socket says 172.21.15.38:56082) 2023-12-22T08:40:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f22d5d9b640 1 -- 172.21.15.38:0/2843849294 learned_addr learned my addr 172.21.15.38:0/2843849294 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7f22ded9d640 1 --2- 172.21.15.38:0/2843849294 >> v2:172.21.15.38:3300/0 conn(0x7f22e00d0b60 0x7f22e006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.473+0000 7fd8a7417640 1 -- 172.21.15.38:0/4105354195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a01562a0 con 0x7fd8a015e740 2023-12-22T08:40:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.474+0000 7fd8a7417640 1 -- 172.21.15.38:0/4105354195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a0156860 con 0x7fd8a015e740 2023-12-22T08:40:11.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.474+0000 7f989e97d640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98900e1520 0x7f98900e1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.474+0000 7f989d97b640 1 -- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9890051e20 msgr2=0x7f98901784d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.474+0000 7f989d97b640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9890051e20 0x7f98901784d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.474+0000 7f989d97b640 1 -- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98900e1520 msgr2=0x7f98900e1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.474+0000 7f989d97b640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98900e1520 0x7f98900e1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.474+0000 7f989d97b640 1 -- 172.21.15.38:0/368441285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98980680e0 con 0x7f9890052260 2023-12-22T08:40:11.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.474+0000 7f989e17c640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9890051e20 0x7f98901784d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.474+0000 7f807ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f808006a3d0 0x7f80801696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.474+0000 7f22d5d9b640 1 -- 172.21.15.38:0/2843849294 >> v2:172.21.15.38:3300/0 conn(0x7f22e00d0b60 msgr2=0x7f22e006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.474+0000 7f807ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80800cbf70 0x7f80800ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.474+0000 7f989d97b640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9890052260 0x7f9890031bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98880098c0 tx=0x7f98880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f807ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f808015c8f0 0x7f80800cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f988effd640 1 -- 172.21.15.38:0/368441285 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988803a6f0 con 0x7f9890052260 2023-12-22T08:40:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f988effd640 1 -- 172.21.15.38:0/368441285 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988803a850 con 0x7f9890052260 2023-12-22T08:40:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f988effd640 1 -- 172.21.15.38:0/368441285 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988803ac00 con 0x7f9890052260 2023-12-22T08:40:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f989f17e640 1 -- 172.21.15.38:0/368441285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9888009400 con 0x7f9890052260 2023-12-22T08:40:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f807effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f808006a3d0 0x7f80801696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f807effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f808006a3d0 0x7f80801696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34902/0 (socket says 172.21.15.38:34902) 2023-12-22T08:40:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f807e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80800cbf70 0x7f80800ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f807e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80800cbf70 0x7f80800ad010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:58526/0 (socket says 172.21.15.38:58526) 2023-12-22T08:40:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f807ffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80800ad550 con 0x7f808006a3d0 2023-12-22T08:40:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f807ffff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80800a3ba0 con 0x7f80800cbf70 2023-12-22T08:40:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f807ffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8080149340 con 0x7f808015c8f0 2023-12-22T08:40:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f0e667fc640 1 -- 172.21.15.38:0/3224309046 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6002cbe0 con 0x7f0e680cb830 2023-12-22T08:40:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f0e667fc640 1 -- 172.21.15.38:0/3224309046 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6002cd40 con 0x7f0e680cb830 2023-12-22T08:40:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f0e667fc640 1 -- 172.21.15.38:0/3224309046 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60034660 con 0x7f0e680cb830 2023-12-22T08:40:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.475+0000 7f989f17e640 1 -- 172.21.15.38:0/368441285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9890033010 con 0x7f9890052260 2023-12-22T08:40:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7f807effd640 1 -- 172.21.15.38:0/964349465 learned_addr learned my addr 172.21.15.38:0/964349465 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.477+0000 7f1ddeffd640 1 -- 172.21.15.38:0/493994579 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1de0076ac0 con 0x7f1de8057c70 2023-12-22T08:40:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7fb5b9ffb640 1 -- 172.21.15.38:0/3277022510 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b002f050 con 0x7fb5b40344e0 2023-12-22T08:40:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7fb5b9ffb640 1 -- 172.21.15.38:0/3277022510 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b0031500 con 0x7fb5b40344e0 2023-12-22T08:40:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7fb5b9ffb640 1 -- 172.21.15.38:0/3277022510 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac001690 con 0x7fb5b40344e0 2023-12-22T08:40:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7f807f7fe640 1 --2- 172.21.15.38:0/964349465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f808015c8f0 0x7f80800cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7f807effd640 1 -- 172.21.15.38:0/964349465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f808015c8f0 msgr2=0x7f80800cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7f807effd640 1 --2- 172.21.15.38:0/964349465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f808015c8f0 0x7f80800cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7f807effd640 1 -- 172.21.15.38:0/964349465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80800cbf70 msgr2=0x7f80800ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7f807effd640 1 --2- 172.21.15.38:0/964349465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80800cbf70 0x7f80800ad010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7f807effd640 1 -- 172.21.15.38:0/964349465 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8078009a70 con 0x7f808006a3d0 2023-12-22T08:40:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7f22ddd9b640 1 -- 172.21.15.38:0/2843849294 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259274096 0 0) 0x7f22e015a8d0 con 0x7f22e0143f10 2023-12-22T08:40:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7f22d5d9b640 1 --2- 172.21.15.38:0/2843849294 >> v2:172.21.15.38:3300/0 conn(0x7f22e00d0b60 0x7f22e006f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7f22d5d9b640 1 -- 172.21.15.38:0/2843849294 >> v1:172.21.15.38:6789/0 conn(0x7f22e0143f10 legacy=0x7f22e00cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.476+0000 7f22d5d9b640 1 -- 172.21.15.38:0/2843849294 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e015ab40 con 0x7f22e015ec50 2023-12-22T08:40:11.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.477+0000 7fd8a7417640 1 -- 172.21.15.38:0/4105354195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a0061910 con 0x7fd8a015e740 2023-12-22T08:40:11.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.477+0000 7fd895ffb640 1 -- 172.21.15.38:0/4105354195 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd898040960 con 0x7fd8a015e740 2023-12-22T08:40:11.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.477+0000 7f22ded9d640 1 --2- 172.21.15.38:0/2843849294 >> v2:172.21.15.38:3300/0 conn(0x7f22e00d0b60 0x7f22e006f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:11.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.477+0000 7f807effd640 1 --2- 172.21.15.38:0/964349465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f808006a3d0 0x7f80801696a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f807000c780 tx=0x7f807000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.477+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/3224309046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e680cb830 msgr2=0x7f0e680cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.477+0000 7f0e6dbf6640 1 --2- 172.21.15.38:0/3224309046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e680cb830 0x7f0e680cbcc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e680cdf90 tx=0x7f0e6002be30 comp rx=0 tx=0).stop 2023-12-22T08:40:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.478+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/3224309046 shutdown_connections 2023-12-22T08:40:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.478+0000 7f0e6dbf6640 1 --2- 172.21.15.38:0/3224309046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e680cb830 0x7f0e680cbcc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.478+0000 7f0e6dbf6640 1 --2- 172.21.15.38:0/3224309046 >> v2:172.21.15.38:3300/0 conn(0x7f0e680b22c0 0x7f0e680b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.478+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/3224309046 >> 172.21.15.38:0/3224309046 conn(0x7f0e680cf070 msgr2=0x7f0e680cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.478+0000 7f989f17e640 1 -- 172.21.15.38:0/368441285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9890033230 con 0x7f9890052260 2023-12-22T08:40:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.478+0000 7f22d5d9b640 1 --2- 172.21.15.38:0/2843849294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e015ec50 0x7f22e00d0620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009870 tx=0x7f22c802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40b39b231c4f0a15 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.478+0000 7f80677fe640 1 -- 172.21.15.38:0/964349465 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80700058b0 con 0x7f808006a3d0 2023-12-22T08:40:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.478+0000 7f807ffff640 1 -- 172.21.15.38:0/964349465 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80800afd50 con 0x7f808006a3d0 2023-12-22T08:40:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.478+0000 7f807ffff640 1 -- 172.21.15.38:0/964349465 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80800a4090 con 0x7f808006a3d0 2023-12-22T08:40:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.478+0000 7f22ddd9b640 1 -- 172.21.15.38:0/2843849294 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8030840 con 0x7f22e015ec50 2023-12-22T08:40:11.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.479+0000 7fb5bbfff640 1 -- 172.21.15.38:0/3277022510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40344e0 msgr2=0x7fb5b404f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.479+0000 7fb5bbfff640 1 --2- 172.21.15.38:0/3277022510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40344e0 0x7fb5b404f710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00097a0 tx=0x7fb5b002b820 comp rx=0 tx=0).stop 2023-12-22T08:40:11.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.479+0000 7fb5bbfff640 1 -- 172.21.15.38:0/3277022510 shutdown_connections 2023-12-22T08:40:11.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.479+0000 7fb5bbfff640 1 --2- 172.21.15.38:0/3277022510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40344e0 0x7fb5b404f710 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.479+0000 7fb5bbfff640 1 -- 172.21.15.38:0/3277022510 >> 172.21.15.38:0/3277022510 conn(0x7fb5b400a4f0 msgr2=0x7fb5b400a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.479+0000 7fb5bbfff640 1 -- 172.21.15.38:0/3277022510 shutdown_connections 2023-12-22T08:40:11.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.480+0000 7f807ffff640 1 -- 172.21.15.38:0/964349465 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8080061910 con 0x7f808006a3d0 2023-12-22T08:40:11.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.480+0000 7f22ddd9b640 1 -- 172.21.15.38:0/2843849294 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c80309a0 con 0x7f22e015ec50 2023-12-22T08:40:11.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.480+0000 7f22ddd9b640 1 -- 172.21.15.38:0/2843849294 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8030d30 con 0x7f22e015ec50 2023-12-22T08:40:11.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.481+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2843849294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e015ec50 msgr2=0x7f22e00d0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.481+0000 7f22e4f3c640 1 --2- 172.21.15.38:0/2843849294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e015ec50 0x7f22e00d0620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009870 tx=0x7f22c802b980 comp rx=0 tx=0).stop 2023-12-22T08:40:11.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.480+0000 7fb5bbfff640 1 -- 172.21.15.38:0/3277022510 wait complete. 2023-12-22T08:40:11.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.481+0000 7f988effd640 1 -- 172.21.15.38:0/368441285 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f988804c3b0 con 0x7f9890052260 2023-12-22T08:40:11.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.478+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/3224309046 shutdown_connections 2023-12-22T08:40:11.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.478+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/3224309046 wait complete. 2023-12-22T08:40:11.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.481+0000 7f0e6dbf6640 1 Processor -- start 2023-12-22T08:40:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.481+0000 7fd895ffb640 1 --2- 172.21.15.38:0/4105354195 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd88406a500 0x7fd88406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.481+0000 7fd895ffb640 1 -- 172.21.15.38:0/4105354195 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8980ab450 con 0x7fd8a015e740 2023-12-22T08:40:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.481+0000 7fd8a51b3640 1 --2- 172.21.15.38:0/4105354195 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd88406a500 0x7fd88406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.482+0000 7f0e6dbf6640 1 -- start start 2023-12-22T08:40:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.482+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2843849294 shutdown_connections 2023-12-22T08:40:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.482+0000 7f22e4f3c640 1 --2- 172.21.15.38:0/2843849294 >> v2:172.21.15.38:3300/0 conn(0x7f22e00d0b60 0x7f22e006f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.482+0000 7f22e4f3c640 1 --2- 172.21.15.38:0/2843849294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e015ec50 0x7f22e00d0620 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.482+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2843849294 >> 172.21.15.38:0/2843849294 conn(0x7f22e0071840 msgr2=0x7f22e0071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.483+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2843849294 shutdown_connections 2023-12-22T08:40:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.483+0000 7f988effd640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f987c06a500 0x7f987c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.483+0000 7f0e6dbf6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e680b22c0 0x7f0e6815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.483+0000 7f0e6dbf6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e680b26a0 0x7f0e6815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.483+0000 7f0e6dbf6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e680cb830 0x7f0e682033c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.483+0000 7f0e6dbf6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e681597f0 con 0x7f0e680b26a0 2023-12-22T08:40:11.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.483+0000 7f0e6dbf6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68203900 con 0x7f0e680b22c0 2023-12-22T08:40:11.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.483+0000 7f0e6dbf6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e68158b70 con 0x7f0e680cb830 2023-12-22T08:40:11.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.483+0000 7fd8a51b3640 1 --2- 172.21.15.38:0/4105354195 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd88406a500 0x7fd88406c9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd89c005880 tx=0x7fd89c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.483+0000 7f988effd640 1 -- 172.21.15.38:0/368441285 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98880aa6e0 con 0x7f9890052260 2023-12-22T08:40:11.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.483+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2843849294 wait complete. 2023-12-22T08:40:11.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.484+0000 7f0e677fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e680b22c0 0x7f0e6815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.484+0000 7f0e677fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e680b22c0 0x7f0e6815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:58528/0 (socket says 172.21.15.38:58528) 2023-12-22T08:40:11.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.484+0000 7f0e677fe640 1 -- 172.21.15.38:0/1008254431 learned_addr learned my addr 172.21.15.38:0/1008254431 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.484+0000 7f989e17c640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f987c06a500 0x7f987c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.482+0000 7fb5bbfff640 1 Processor -- start 2023-12-22T08:40:11.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.484+0000 7fb5bbfff640 1 -- start start 2023-12-22T08:40:11.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.485+0000 7f989e17c640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f987c06a500 0x7f987c06c9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9894005880 tx=0x7f9894009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.485+0000 7f0e67fff640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e680cb830 0x7f0e682033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.485+0000 7f0e677fe640 1 -- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e680cb830 msgr2=0x7f0e682033c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.485+0000 7f0e677fe640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e680cb830 0x7f0e682033c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.485+0000 7f0e677fe640 1 -- 172.21.15.38:0/1008254431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e680b26a0 msgr2=0x7f0e6815bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.485+0000 7f0e677fe640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e680b26a0 0x7f0e6815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.485+0000 7f0e677fe640 1 -- 172.21.15.38:0/1008254431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60009a70 con 0x7f0e680b22c0 2023-12-22T08:40:11.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7fb5bbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40344e0 0x7fb5b40deec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7fb5bbfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4052b40 0x7fb5b404c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7f0e677fe640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e680b22c0 0x7f0e6815ec90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800d800 tx=0x7f0e5800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7fb5bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b40eaad0 0x7fb5b4036d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7fb5bbfff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b40df400 con 0x7fb5b40eaad0 2023-12-22T08:40:11.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7fb5bbfff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b404c7a0 con 0x7fb5b40344e0 2023-12-22T08:40:11.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7fb5bbfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b404c1e0 con 0x7fb5b4052b40 2023-12-22T08:40:11.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7f0e67fff640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e680cb830 0x7f0e682033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:11.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7fb5bb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b40eaad0 0x7fb5b4036d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7fb5bb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b40eaad0 0x7fb5b4036d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34914/0 (socket says 172.21.15.38:34914) 2023-12-22T08:40:11.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7fb5bb7fe640 1 -- 172.21.15.38:0/2667412052 learned_addr learned my addr 172.21.15.38:0/2667412052 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7fb5baffd640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40344e0 0x7fb5b40deec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7fb5ba7fc640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4052b40 0x7fb5b404c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.487+0000 7f80677fe640 1 -- 172.21.15.38:0/964349465 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8070005a10 con 0x7f808006a3d0 2023-12-22T08:40:11.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.487+0000 7f80677fe640 1 -- 172.21.15.38:0/964349465 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070005de0 con 0x7f808006a3d0 2023-12-22T08:40:11.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.487+0000 7f0e5ffff640 1 -- 172.21.15.38:0/1008254431 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800b6c0 con 0x7f0e680b22c0 2023-12-22T08:40:11.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.487+0000 7f0e5ffff640 1 -- 172.21.15.38:0/1008254431 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5800b820 con 0x7f0e680b22c0 2023-12-22T08:40:11.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.487+0000 7f0e5ffff640 1 -- 172.21.15.38:0/1008254431 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800bb90 con 0x7f0e680b22c0 2023-12-22T08:40:11.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.487+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/1008254431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e68158e50 con 0x7f0e680b22c0 2023-12-22T08:40:11.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.487+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/1008254431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e68159410 con 0x7f0e680b22c0 2023-12-22T08:40:11.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.488+0000 7fd895ffb640 1 -- 172.21.15.38:0/4105354195 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd898076a20 con 0x7fd8a015e740 2023-12-22T08:40:11.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.486+0000 7f22e4f3c640 1 Processor -- start 2023-12-22T08:40:11.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.488+0000 7f22e4f3c640 1 -- start start 2023-12-22T08:40:11.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.487+0000 7fb5baffd640 1 -- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4052b40 msgr2=0x7fb5b404c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.487+0000 7fb5baffd640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4052b40 0x7fb5b404c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.487+0000 7fb5baffd640 1 -- 172.21.15.38:0/2667412052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b40eaad0 msgr2=0x7fb5b4036d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.487+0000 7fb5baffd640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b40eaad0 0x7fb5b4036d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.488+0000 7fb5baffd640 1 -- 172.21.15.38:0/2667412052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b0009400 con 0x7fb5b40344e0 2023-12-22T08:40:11.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.489+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/1008254431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e68061910 con 0x7f0e680b22c0 2023-12-22T08:40:11.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.489+0000 7fb5baffd640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40344e0 0x7fb5b40deec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00c4a0 tx=0x7fb5ac00c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7fb5a3fff640 1 -- 172.21.15.38:0/2667412052 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac005480 con 0x7fb5b40344e0 2023-12-22T08:40:11.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7fb5a3fff640 1 -- 172.21.15.38:0/2667412052 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac0035f0 con 0x7fb5b40344e0 2023-12-22T08:40:11.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7fb5bbfff640 1 -- 172.21.15.38:0/2667412052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b404c4c0 con 0x7fb5b40344e0 2023-12-22T08:40:11.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7fb5a3fff640 1 -- 172.21.15.38:0/2667412052 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0039c0 con 0x7fb5b40344e0 2023-12-22T08:40:11.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7f22e4f3c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22e00d0b60 0x7f22e00cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7f22e4f3c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e0143f10 0x7f22e0159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7f22e4f3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22e015ec50 0x7f22e013ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7f22e4f3c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e015a370 con 0x7f22e00d0b60 2023-12-22T08:40:11.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7f22e4f3c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e00cc890 con 0x7f22e015ec50 2023-12-22T08:40:11.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7f22e4f3c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e00cbc80 con 0x7f22e0143f10 2023-12-22T08:40:11.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7fb5bbfff640 1 -- 172.21.15.38:0/2667412052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b40df9b0 con 0x7fb5b40344e0 2023-12-22T08:40:11.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7f22d5d9b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e0143f10 0x7f22e0159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7f22d5d9b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e0143f10 0x7f22e0159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:56128/0 (socket says 172.21.15.38:56128) 2023-12-22T08:40:11.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.490+0000 7f22d5d9b640 1 -- 172.21.15.38:0/2124761696 learned_addr learned my addr 172.21.15.38:0/2124761696 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:11.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.491+0000 7f22de59c640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22e00d0b60 0x7f22e00cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.491+0000 7f0e5ffff640 1 -- 172.21.15.38:0/1008254431 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0e5800bcf0 con 0x7f0e680b22c0 2023-12-22T08:40:11.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.491+0000 7f22ded9d640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22e015ec50 0x7f22e013ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.491+0000 7fb5bbfff640 1 -- 172.21.15.38:0/2667412052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b40057d0 con 0x7fb5b40344e0 2023-12-22T08:40:11.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.491+0000 7f22d5d9b640 1 -- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22e015ec50 msgr2=0x7f22e013ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.491+0000 7f22d5d9b640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22e015ec50 0x7f22e013ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.491+0000 7f22d5d9b640 1 -- 172.21.15.38:0/2124761696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22e00d0b60 msgr2=0x7f22e00cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.491+0000 7f22d5d9b640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22e00d0b60 0x7f22e00cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.491+0000 7f22d5d9b640 1 -- 172.21.15.38:0/2124761696 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c80094d0 con 0x7f22e0143f10 2023-12-22T08:40:11.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.492+0000 7f22de59c640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22e00d0b60 0x7f22e00cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:11.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.492+0000 7f22d5d9b640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e0143f10 0x7f22e0159e30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22c80090b0 tx=0x7f22c80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.493+0000 7f0e5ffff640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0e4806a480 0x7f0e4806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.493+0000 7f22d77fe640 1 -- 172.21.15.38:0/2124761696 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c803e070 con 0x7f22e0143f10 2023-12-22T08:40:11.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.493+0000 7f22d77fe640 1 -- 172.21.15.38:0/2124761696 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c8039d10 con 0x7f22e0143f10 2023-12-22T08:40:11.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.493+0000 7f22d77fe640 1 -- 172.21.15.38:0/2124761696 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8042610 con 0x7f22e0143f10 2023-12-22T08:40:11.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.493+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2124761696 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e00cbf60 con 0x7f22e0143f10 2023-12-22T08:40:11.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.493+0000 7f0e5ffff640 1 -- 172.21.15.38:0/1008254431 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e58089420 con 0x7f0e680b22c0 2023-12-22T08:40:11.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.493+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2124761696 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e00cc520 con 0x7f22e0143f10 2023-12-22T08:40:11.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.493+0000 7f0e66ffd640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0e4806a480 0x7f0e4806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.494+0000 7f0e66ffd640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0e4806a480 0x7f0e4806c940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0e50000f60 tx=0x7f0e50007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.494+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2124761696 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e0061910 con 0x7f22e0143f10 2023-12-22T08:40:11.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.495+0000 7f988effd640 1 -- 172.21.15.38:0/368441285 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9888075cb0 con 0x7f9890052260 2023-12-22T08:40:11.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.497+0000 7f80677fe640 1 -- 172.21.15.38:0/964349465 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8070007070 con 0x7f808006a3d0 2023-12-22T08:40:11.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.498+0000 7f80677fe640 1 --2- 172.21.15.38:0/964349465 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f806c06a430 0x7f806c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.497+0000 7f22d77fe640 1 -- 172.21.15.38:0/2124761696 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f22c8042770 con 0x7f22e0143f10 2023-12-22T08:40:11.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.498+0000 7f22d77fe640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f22c006a530 0x7f22c006c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.499+0000 7f22d77fe640 1 -- 172.21.15.38:0/2124761696 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22c80abba0 con 0x7f22e0143f10 2023-12-22T08:40:11.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.499+0000 7f80677fe640 1 -- 172.21.15.38:0/964349465 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8070088600 con 0x7f808006a3d0 2023-12-22T08:40:11.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.499+0000 7f807e7fc640 1 --2- 172.21.15.38:0/964349465 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f806c06a430 0x7f806c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.499+0000 7f22de59c640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f22c006a530 0x7f22c006c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.501+0000 7f807e7fc640 1 --2- 172.21.15.38:0/964349465 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f806c06a430 0x7f806c06c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f808016aa80 tx=0x7f8074009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.501+0000 7f22de59c640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f22c006a530 0x7f22c006c9f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22d00012e0 tx=0x7f22d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.505+0000 7f0e5ffff640 1 -- 172.21.15.38:0/1008254431 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0e58054a80 con 0x7f0e680b22c0 2023-12-22T08:40:11.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.505+0000 7f80677fe640 1 -- 172.21.15.38:0/964349465 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8070053cf0 con 0x7f808006a3d0 2023-12-22T08:40:11.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.508+0000 7fb5a3fff640 1 -- 172.21.15.38:0/2667412052 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb5ac003b20 con 0x7fb5b40344e0 2023-12-22T08:40:11.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.509+0000 7fb5a3fff640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5a806a430 0x7fb5a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:11.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.510+0000 7fb5a3fff640 1 -- 172.21.15.38:0/2667412052 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5ac088190 con 0x7fb5b40344e0 2023-12-22T08:40:11.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.511+0000 7fb5ba7fc640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5a806a430 0x7fb5a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:11.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.512+0000 7fb5ba7fc640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5a806a430 0x7fb5a806c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0035000 tx=0x7fb5b0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:11.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.513+0000 7f22d77fe640 1 -- 172.21.15.38:0/2124761696 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f22c8077290 con 0x7f22e0143f10 2023-12-22T08:40:11.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.519+0000 7fb5a3fff640 1 -- 172.21.15.38:0/2667412052 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb5ac0539a0 con 0x7fb5b40344e0 2023-12-22T08:40:11.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.889+0000 7f1def59e640 1 -- 172.21.15.38:0/493994579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1de80057d0 con 0x7f1de8057c70 2023-12-22T08:40:11.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.890+0000 7f1ddeffd640 1 -- 172.21.15.38:0/493994579 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1de0006e10 con 0x7f1de8057c70 2023-12-22T08:40:11.893 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-12-22T08:40:11.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.893+0000 7f1def59e640 1 -- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1dd006a4d0 msgr2=0x7f1dd006c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.894+0000 7f1def59e640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1dd006a4d0 0x7f1dd006c990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009ac0 tx=0x7f1de4008040 comp rx=0 tx=0).stop 2023-12-22T08:40:11.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.894+0000 7f1def59e640 1 -- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8057c70 msgr2=0x7f1de804db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.894+0000 7f1def59e640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8057c70 0x7f1de804db40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1de00098c0 tx=0x7f1de00046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.894+0000 7f1def59e640 1 -- 172.21.15.38:0/493994579 shutdown_connections 2023-12-22T08:40:11.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.894+0000 7f1def59e640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1dd006a4d0 0x7f1dd006c990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.894+0000 7f1def59e640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1de80eb260 0x7f1de8037c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.895+0000 7f1def59e640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1de8057c70 0x7f1de804db40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.895+0000 7f1def59e640 1 --2- 172.21.15.38:0/493994579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1de803ec50 0x7f1de80e4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.895+0000 7f1def59e640 1 -- 172.21.15.38:0/493994579 >> 172.21.15.38:0/493994579 conn(0x7f1de8055a40 msgr2=0x7f1de803a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.895+0000 7f1def59e640 1 -- 172.21.15.38:0/493994579 shutdown_connections 2023-12-22T08:40:11.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.895+0000 7f1def59e640 1 -- 172.21.15.38:0/493994579 wait complete. 2023-12-22T08:40:11.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.901+0000 7f02fb57e640 1 -- 172.21.15.38:0/1459082971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f02f40c5c00 con 0x7f02f4071ac0 2023-12-22T08:40:11.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.902+0000 7f02e9ffb640 1 -- 172.21.15.38:0/1459082971 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f02ec058390 con 0x7f02f4071ac0 2023-12-22T08:40:11.907 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-12-22T08:40:11.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.906+0000 7f02fb57e640 1 -- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02d806a500 msgr2=0x7f02d806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.906+0000 7f02fb57e640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02d806a500 0x7f02d806c9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f02f0036000 tx=0x7f02f003d040 comp rx=0 tx=0).stop 2023-12-22T08:40:11.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.906+0000 7f02fb57e640 1 -- 172.21.15.38:0/1459082971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02f4071ac0 msgr2=0x7f02f40c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.906+0000 7f02fb57e640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02f4071ac0 0x7f02f40c8350 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00efc0 tx=0x7f02ec00c490 comp rx=0 tx=0).stop 2023-12-22T08:40:11.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.906+0000 7f02fb57e640 1 -- 172.21.15.38:0/1459082971 shutdown_connections 2023-12-22T08:40:11.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.906+0000 7f02fb57e640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02f4165fd0 0x7f02f40c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.906+0000 7f02fb57e640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02f40b1e90 0x7f02f40af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.906+0000 7f989f17e640 1 -- 172.21.15.38:0/368441285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f98900057d0 con 0x7f9890052260 2023-12-22T08:40:11.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.906+0000 7f02fb57e640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02d806a500 0x7f02d806c9c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.906+0000 7f02fb57e640 1 --2- 172.21.15.38:0/1459082971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02f4071ac0 0x7f02f40c8350 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.906+0000 7f02fb57e640 1 -- 172.21.15.38:0/1459082971 >> 172.21.15.38:0/1459082971 conn(0x7f02f40cee70 msgr2=0x7f02f406d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.907+0000 7f02fb57e640 1 -- 172.21.15.38:0/1459082971 shutdown_connections 2023-12-22T08:40:11.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.907+0000 7f02fb57e640 1 -- 172.21.15.38:0/1459082971 wait complete. 2023-12-22T08:40:11.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.907+0000 7f988effd640 1 -- 172.21.15.38:0/368441285 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98880792d0 con 0x7f9890052260 2023-12-22T08:40:11.911 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-12-22T08:40:11.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.911+0000 7f989f17e640 1 -- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f987c06a500 msgr2=0x7f987c06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.911+0000 7f989f17e640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f987c06a500 0x7f987c06c9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9894005880 tx=0x7f9894009040 comp rx=0 tx=0).stop 2023-12-22T08:40:11.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.911+0000 7f989f17e640 1 -- 172.21.15.38:0/368441285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9890052260 msgr2=0x7f9890031bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.911+0000 7f989f17e640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9890052260 0x7f9890031bd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98880098c0 tx=0x7f98880046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.912+0000 7f989f17e640 1 -- 172.21.15.38:0/368441285 shutdown_connections 2023-12-22T08:40:11.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.912+0000 7f989f17e640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98900e1520 0x7f98900e1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.912+0000 7f989f17e640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f987c06a500 0x7f987c06c9c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.912+0000 7f989f17e640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9890052260 0x7f9890031bd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.912+0000 7f989f17e640 1 --2- 172.21.15.38:0/368441285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9890051e20 0x7f98901784d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.912+0000 7f989f17e640 1 -- 172.21.15.38:0/368441285 >> 172.21.15.38:0/368441285 conn(0x7f9890056dc0 msgr2=0x7f98900094a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.913+0000 7f989f17e640 1 -- 172.21.15.38:0/368441285 shutdown_connections 2023-12-22T08:40:11.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.913+0000 7fd8a7417640 1 -- 172.21.15.38:0/4105354195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd8a015b430 con 0x7fd8a015e740 2023-12-22T08:40:11.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.913+0000 7f989f17e640 1 -- 172.21.15.38:0/368441285 wait complete. 2023-12-22T08:40:11.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.914+0000 7fd895ffb640 1 -- 172.21.15.38:0/4105354195 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd89807a040 con 0x7fd8a015e740 2023-12-22T08:40:11.923 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-12-22T08:40:11.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.917+0000 7fd8a7417640 1 -- 172.21.15.38:0/4105354195 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd88406a500 msgr2=0x7fd88406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.918+0000 7fd8a7417640 1 --2- 172.21.15.38:0/4105354195 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd88406a500 0x7fd88406c9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd89c005880 tx=0x7fd89c009040 comp rx=0 tx=0).stop 2023-12-22T08:40:11.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.918+0000 7fd8a7417640 1 -- 172.21.15.38:0/4105354195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8a015e740 msgr2=0x7fd8a014a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.918+0000 7fd8a7417640 1 --2- 172.21.15.38:0/4105354195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8a015e740 0x7fd8a014a340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd898009d90 tx=0x7fd898004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:11.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.918+0000 7fd8a7417640 1 -- 172.21.15.38:0/4105354195 shutdown_connections 2023-12-22T08:40:11.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.918+0000 7fd8a7417640 1 --2- 172.21.15.38:0/4105354195 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd88406a500 0x7fd88406c9c0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd89c005880 tx=0x7fd89c009040 comp rx=0 tx=0).stop 2023-12-22T08:40:11.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.918+0000 7fd8a7417640 1 --2- 172.21.15.38:0/4105354195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8a015e740 0x7fd8a014a340 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.918+0000 7fd8a7417640 1 --2- 172.21.15.38:0/4105354195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8a00b3f90 0x7fd8a01478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.918+0000 7fd8a7417640 1 --2- 172.21.15.38:0/4105354195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd8a006ca50 0x7fd8a01559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.918+0000 7fd8a7417640 1 -- 172.21.15.38:0/4105354195 >> 172.21.15.38:0/4105354195 conn(0x7fd8a00cfea0 msgr2=0x7fd8a00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.919+0000 7fd8a7417640 1 -- 172.21.15.38:0/4105354195 shutdown_connections 2023-12-22T08:40:11.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.920+0000 7fd8a7417640 1 -- 172.21.15.38:0/4105354195 wait complete. 2023-12-22T08:40:11.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-12-22T08:40:11.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.928+0000 7f807ffff640 1 -- 172.21.15.38:0/964349465 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f808006db60 con 0x7f808006a3d0 2023-12-22T08:40:11.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.929+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/1008254431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e6806ce20 con 0x7f0e680b22c0 2023-12-22T08:40:11.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.929+0000 7f80677fe640 1 -- 172.21.15.38:0/964349465 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8070017090 con 0x7f808006a3d0 2023-12-22T08:40:11.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.929+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2124761696 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f22e006e2f0 con 0x7f22e0143f10 2023-12-22T08:40:11.932 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-12-22T08:40:11.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.930+0000 7f0e5ffff640 1 -- 172.21.15.38:0/1008254431 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e580580a0 con 0x7f0e680b22c0 2023-12-22T08:40:11.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.930+0000 7f22d77fe640 1 -- 172.21.15.38:0/2124761696 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22c8034090 con 0x7f22e0143f10 2023-12-22T08:40:11.933 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-12-22T08:40:11.933 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-12-22T08:40:11.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.932+0000 7f807ffff640 1 -- 172.21.15.38:0/964349465 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f806c06a430 msgr2=0x7f806c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.932+0000 7f807ffff640 1 --2- 172.21.15.38:0/964349465 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f806c06a430 0x7f806c06c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f808016aa80 tx=0x7f8074009060 comp rx=0 tx=0).stop 2023-12-22T08:40:11.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.932+0000 7f807ffff640 1 -- 172.21.15.38:0/964349465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f808006a3d0 msgr2=0x7f80801696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.932+0000 7f807ffff640 1 --2- 172.21.15.38:0/964349465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f808006a3d0 0x7f80801696a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f807000c780 tx=0x7f807000cc40 comp rx=0 tx=0).stop 2023-12-22T08:40:11.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f807ffff640 1 -- 172.21.15.38:0/964349465 shutdown_connections 2023-12-22T08:40:11.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f807ffff640 1 --2- 172.21.15.38:0/964349465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f808015c8f0 0x7f80800cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f807ffff640 1 --2- 172.21.15.38:0/964349465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80800cbf70 0x7f80800ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f807ffff640 1 --2- 172.21.15.38:0/964349465 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f806c06a430 0x7f806c06c8f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f807ffff640 1 --2- 172.21.15.38:0/964349465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f808006a3d0 0x7f80801696a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f807ffff640 1 -- 172.21.15.38:0/964349465 >> 172.21.15.38:0/964349465 conn(0x7f80800b1f70 msgr2=0x7f808014a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f807ffff640 1 -- 172.21.15.38:0/964349465 shutdown_connections 2023-12-22T08:40:11.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f807ffff640 1 -- 172.21.15.38:0/964349465 wait complete. 2023-12-22T08:40:11.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f22c006a530 msgr2=0x7f22c006c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f22e4f3c640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f22c006a530 0x7f22c006c9f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22d00012e0 tx=0x7f22d0009040 comp rx=0 tx=0).stop 2023-12-22T08:40:11.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e0143f10 msgr2=0x7f22e0159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f22e4f3c640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e0143f10 0x7f22e0159e30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22c80090b0 tx=0x7f22c80046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0e4806a480 msgr2=0x7f0e4806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f0e6dbf6640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0e4806a480 0x7f0e4806c940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0e50000f60 tx=0x7f0e50007a80 comp rx=0 tx=0).stop 2023-12-22T08:40:11.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e680b22c0 msgr2=0x7f0e6815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.933+0000 7f0e6dbf6640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e680b22c0 0x7f0e6815ec90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800d800 tx=0x7f0e5800dcc0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2124761696 shutdown_connections 2023-12-22T08:40:11.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f22e4f3c640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22e015ec50 0x7f22e013ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f22e4f3c640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22e0143f10 0x7f22e0159e30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f22e4f3c640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f22c006a530 0x7f22c006c9f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f22e4f3c640 1 --2- 172.21.15.38:0/2124761696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22e00d0b60 0x7f22e00cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2124761696 >> 172.21.15.38:0/2124761696 conn(0x7f22e0071840 msgr2=0x7f22e0141500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/1008254431 shutdown_connections 2023-12-22T08:40:11.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f0e6dbf6640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e680cb830 0x7f0e682033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f0e6dbf6640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0e4806a480 0x7f0e4806c940 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f0e6dbf6640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e680b26a0 0x7f0e6815bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f0e6dbf6640 1 --2- 172.21.15.38:0/1008254431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e680b22c0 0x7f0e6815ec90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/1008254431 >> 172.21.15.38:0/1008254431 conn(0x7f0e680cf070 msgr2=0x7f0e68070c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/1008254431 shutdown_connections 2023-12-22T08:40:11.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.934+0000 7f0e6dbf6640 1 -- 172.21.15.38:0/1008254431 wait complete. 2023-12-22T08:40:11.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-12-22T08:40:11.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.936+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2124761696 shutdown_connections 2023-12-22T08:40:11.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.936+0000 7f22e4f3c640 1 -- 172.21.15.38:0/2124761696 wait complete. 2023-12-22T08:40:11.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-12-22T08:40:11.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.941+0000 7fb5bbfff640 1 -- 172.21.15.38:0/2667412052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb5b404f4c0 con 0x7fb5b40344e0 2023-12-22T08:40:11.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.942+0000 7fb5a3fff640 1 -- 172.21.15.38:0/2667412052 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5ac017020 con 0x7fb5b40344e0 2023-12-22T08:40:11.945 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2023-12-22T08:40:11.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-12-22T08:40:11.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.944+0000 7fb5bbfff640 1 -- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5a806a430 msgr2=0x7fb5a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.944+0000 7fb5bbfff640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5a806a430 0x7fb5a806c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0035000 tx=0x7fb5b0008030 comp rx=0 tx=0).stop 2023-12-22T08:40:11.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.944+0000 7fb5bbfff640 1 -- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40344e0 msgr2=0x7fb5b40deec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:11.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.944+0000 7fb5bbfff640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40344e0 0x7fb5b40deec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00c4a0 tx=0x7fb5ac00c960 comp rx=0 tx=0).stop 2023-12-22T08:40:11.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.945+0000 7fb5bbfff640 1 -- 172.21.15.38:0/2667412052 shutdown_connections 2023-12-22T08:40:11.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.945+0000 7fb5bbfff640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5a806a430 0x7fb5a806c8f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.945+0000 7fb5bbfff640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b40eaad0 0x7fb5b4036d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.945+0000 7fb5bbfff640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4052b40 0x7fb5b404c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.945+0000 7fb5bbfff640 1 --2- 172.21.15.38:0/2667412052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40344e0 0x7fb5b40deec0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:11.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.945+0000 7fb5bbfff640 1 -- 172.21.15.38:0/2667412052 >> 172.21.15.38:0/2667412052 conn(0x7fb5b400a4f0 msgr2=0x7fb5b4034e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:11.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.945+0000 7fb5bbfff640 1 -- 172.21.15.38:0/2667412052 shutdown_connections 2023-12-22T08:40:11.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:11.945+0000 7fb5bbfff640 1 -- 172.21.15.38:0/2667412052 wait complete. 2023-12-22T08:40:11.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-12-22T08:40:11.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-12-22T08:40:11.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-12-22T08:40:11.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-12-22T08:40:12.927 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-22T08:40:12.940 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-22T08:40:12.945 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-22T08:40:12.948 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-22T08:40:12.960 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-22T08:40:12.965 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-22T08:40:12.966 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-22T08:40:12.966 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-22T08:40:13.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.228+0000 7f2a12f39640 1 Processor -- start 2023-12-22T08:40:13.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.228+0000 7f2a12f39640 1 -- start start 2023-12-22T08:40:13.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.231+0000 7f2a12f39640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a040562d0 0x7f2a04038790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.232+0000 7f2a12f39640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2a04056730 0x7f2a04038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.232+0000 7f2a12f39640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a04055e40 con 0x7f2a040e1230 2023-12-22T08:40:13.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.233+0000 7f2a0bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a040562d0 0x7f2a04038790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.233+0000 7f2a10cd5640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2a040e1230 0x7f2a04054850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49708/0 (socket says 172.21.15.38:49708) 2023-12-22T08:40:13.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.233+0000 7f2a10cd5640 1 -- 172.21.15.38:0/2658770707 learned_addr learned my addr 172.21.15.38:0/2658770707 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:13.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.234+0000 7f2a12f39640 1 -- 172.21.15.38:0/2658770707 --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a040e1610 con 0x7f2a04056730 2023-12-22T08:40:13.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.234+0000 7f2a12f39640 1 -- 172.21.15.38:0/2658770707 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a04054f60 con 0x7f2a040562d0 2023-12-22T08:40:13.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.233+0000 7f2a114d6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2a04056730 0x7f2a04038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.236+0000 7f2a114d6640 1 -- 172.21.15.38:0/2658770707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a040562d0 msgr2=0x7f2a04038790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:13.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.236+0000 7f2a114d6640 1 --2- 172.21.15.38:0/2658770707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a040562d0 0x7f2a04038790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.236+0000 7f2a114d6640 1 -- 172.21.15.38:0/2658770707 >> v1:172.21.15.38:6789/0 conn(0x7f2a040e1230 legacy=0x7f2a04054850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.236+0000 7f2a0b7fe640 1 -- 172.21.15.38:0/2658770707 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187863638 0 0) 0x7f2a04055e40 con 0x7f2a040e1230 2023-12-22T08:40:13.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.236+0000 7f2a114d6640 1 -- 172.21.15.38:0/2658770707 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a04055230 con 0x7f2a04056730 2023-12-22T08:40:13.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.237+0000 7f2a0bfff640 1 --2- 172.21.15.38:0/2658770707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a040562d0 0x7f2a04038790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:13.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.239+0000 7f2a114d6640 1 --2- 172.21.15.38:0/2658770707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a04056730 0x7f2a04038cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c074a40 tx=0x7f2a0c0a6720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afa27bf4ea7dfc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.239+0000 7f2a0b7fe640 1 -- 172.21.15.38:0/2658770707 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0b31d0 con 0x7f2a04056730 2023-12-22T08:40:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.240+0000 7f2a0b7fe640 1 -- 172.21.15.38:0/2658770707 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c0a9030 con 0x7f2a04056730 2023-12-22T08:40:13.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.241+0000 7f2a0b7fe640 1 -- 172.21.15.38:0/2658770707 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0b31d0 con 0x7f2a04056730 2023-12-22T08:40:13.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.241+0000 7f2a12f39640 1 -- 172.21.15.38:0/2658770707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a04056730 msgr2=0x7f2a04038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.241+0000 7f2a12f39640 1 --2- 172.21.15.38:0/2658770707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a04056730 0x7f2a04038cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c074a40 tx=0x7f2a0c0a6720 comp rx=0 tx=0).stop 2023-12-22T08:40:13.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.242+0000 7f2a12f39640 1 -- 172.21.15.38:0/2658770707 shutdown_connections 2023-12-22T08:40:13.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.242+0000 7f2a12f39640 1 --2- 172.21.15.38:0/2658770707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a04056730 0x7f2a04038cd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.242+0000 7f2a12f39640 1 --2- 172.21.15.38:0/2658770707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a040562d0 0x7f2a04038790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.243+0000 7f2a12f39640 1 -- 172.21.15.38:0/2658770707 >> 172.21.15.38:0/2658770707 conn(0x7f2a04056d10 msgr2=0x7f2a040570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.243+0000 7f2a12f39640 1 -- 172.21.15.38:0/2658770707 shutdown_connections 2023-12-22T08:40:13.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.243+0000 7f2a12f39640 1 -- 172.21.15.38:0/2658770707 wait complete. 2023-12-22T08:40:13.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.247+0000 7f2a12f39640 1 Processor -- start 2023-12-22T08:40:13.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.247+0000 7f2a12f39640 1 -- start start 2023-12-22T08:40:13.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.249+0000 7f2a12f39640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a040562d0 0x7f2a040dce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.250+0000 7f2a12f39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a04056730 0x7f2a040db4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.250+0000 7f2a12f39640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a040e1230 0x7f2a0403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.251+0000 7f2a114d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a040e1230 0x7f2a0403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.251+0000 7f2a114d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a040e1230 0x7f2a0403add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34942/0 (socket says 172.21.15.38:34942) 2023-12-22T08:40:13.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.251+0000 7f2a12f39640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040dd6a0 con 0x7f2a040e1230 2023-12-22T08:40:13.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.251+0000 7f2a12f39640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040dd980 con 0x7f2a04056730 2023-12-22T08:40:13.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.251+0000 7f2a12f39640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040ddc60 con 0x7f2a040562d0 2023-12-22T08:40:13.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.252+0000 7f2a114d6640 1 -- 172.21.15.38:0/3041296473 learned_addr learned my addr 172.21.15.38:0/3041296473 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:13.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.252+0000 7f2a0bfff640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a04056730 0x7f2a040db4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.252+0000 7f2a10cd5640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a040562d0 0x7f2a040dce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.253+0000 7f2a114d6640 1 -- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a040562d0 msgr2=0x7f2a040dce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.253+0000 7f2a114d6640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a040562d0 0x7f2a040dce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.253+0000 7f2a114d6640 1 -- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a04056730 msgr2=0x7f2a040db4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.253+0000 7f2a114d6640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a04056730 0x7f2a040db4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.253+0000 7f2a114d6640 1 -- 172.21.15.38:0/3041296473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c06ee70 con 0x7f2a040e1230 2023-12-22T08:40:13.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.254+0000 7f2a114d6640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a040e1230 0x7f2a0403add0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c072860 tx=0x7f2a0c067e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.255+0000 7f2a097fa640 1 -- 172.21.15.38:0/3041296473 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0bd410 con 0x7f2a040e1230 2023-12-22T08:40:13.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.255+0000 7f2a097fa640 1 -- 172.21.15.38:0/3041296473 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c0bd570 con 0x7f2a040e1230 2023-12-22T08:40:13.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.256+0000 7f2a097fa640 1 -- 172.21.15.38:0/3041296473 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0bd410 con 0x7f2a040e1230 2023-12-22T08:40:13.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.256+0000 7f2a12f39640 1 -- 172.21.15.38:0/3041296473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a040ddf40 con 0x7f2a040e1230 2023-12-22T08:40:13.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.256+0000 7f2a12f39640 1 -- 172.21.15.38:0/3041296473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a040db9e0 con 0x7f2a040e1230 2023-12-22T08:40:13.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.260+0000 7f2a097fa640 1 -- 172.21.15.38:0/3041296473 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2a0c0c6440 con 0x7f2a040e1230 2023-12-22T08:40:13.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.262+0000 7f2a097fa640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29f006a490 0x7f29f006c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.262+0000 7f2a097fa640 1 -- 172.21.15.38:0/3041296473 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a0c124890 con 0x7f2a040e1230 2023-12-22T08:40:13.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.263+0000 7f2a12f39640 1 -- 172.21.15.38:0/3041296473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a040056c0 con 0x7f2a040e1230 2023-12-22T08:40:13.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.263+0000 7f2a10cd5640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29f006a490 0x7f29f006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.265+0000 7f2a10cd5640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29f006a490 0x7f29f006c950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29f8001030 tx=0x7f29f8007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.273+0000 7f2a097fa640 1 -- 172.21.15.38:0/3041296473 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2a0c0efde0 con 0x7f2a040e1230 2023-12-22T08:40:13.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.284+0000 7f3927d6e640 1 Processor -- start 2023-12-22T08:40:13.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.284+0000 7f3927d6e640 1 -- start start 2023-12-22T08:40:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.286+0000 7f3927d6e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39200ce770 0x7f392016a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.287+0000 7f3927d6e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f39200c52b0 0x7f39200c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.287+0000 7f3927d6e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39200b2ae0 con 0x7f392006f250 2023-12-22T08:40:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.287+0000 7f3927d6e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39200c5c70 con 0x7f39200c52b0 2023-12-22T08:40:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.287+0000 7f3927d6e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39200b25a0 con 0x7f39200ce770 2023-12-22T08:40:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.287+0000 7f3925309640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f392006f250 0x7f39200b1e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49718/0 (socket says 172.21.15.38:49718) 2023-12-22T08:40:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.287+0000 7f3925309640 1 -- 172.21.15.38:0/914449660 learned_addr learned my addr 172.21.15.38:0/914449660 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.287+0000 7f3925b0a640 1 --2- 172.21.15.38:0/914449660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39200ce770 0x7f392016a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.288+0000 7f392630b640 1 --2- 172.21.15.38:0/914449660 >> v2:172.21.15.89:3300/0 conn(0x7f39200c52b0 0x7f39200c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.289+0000 7f392630b640 1 -- 172.21.15.38:0/914449660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39200ce770 msgr2=0x7f392016a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.289+0000 7f392630b640 1 --2- 172.21.15.38:0/914449660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39200ce770 0x7f392016a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.289+0000 7f392630b640 1 -- 172.21.15.38:0/914449660 >> v1:172.21.15.38:6789/0 conn(0x7f392006f250 legacy=0x7f39200b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.289+0000 7f392630b640 1 -- 172.21.15.38:0/914449660 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392016dda0 con 0x7f39200c52b0 2023-12-22T08:40:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.291+0000 7f0f63877640 1 Processor -- start 2023-12-22T08:40:13.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.291+0000 7f392630b640 1 --2- 172.21.15.38:0/914449660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39200c52b0 0x7f39200c5730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39100097a0 tx=0x7f391002b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b3ecd4ac3367f58 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.293+0000 7f3924b08640 1 -- 172.21.15.38:0/914449660 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910030710 con 0x7f39200c52b0 2023-12-22T08:40:13.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.293+0000 7f3924b08640 1 -- 172.21.15.38:0/914449660 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391002e050 con 0x7f39200c52b0 2023-12-22T08:40:13.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.293+0000 7f3924b08640 1 -- 172.21.15.38:0/914449660 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910030ad0 con 0x7f39200c52b0 2023-12-22T08:40:13.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.291+0000 7f0f63877640 1 -- start start 2023-12-22T08:40:13.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.294+0000 7f0f63877640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0f5c15e740 0x7f0f5c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.294+0000 7f0f63877640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0f5c06ca50 0x7f0f5c0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.294+0000 7f0f63877640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f5c0b3dc0 0x7f0f5c161120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.294+0000 7f0f63877640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5c06e650 con 0x7f0f5c06ca50 2023-12-22T08:40:13.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.294+0000 7f0f63877640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5c0b4210 con 0x7f0f5c15e740 2023-12-22T08:40:13.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.294+0000 7f3927d6e640 1 -- 172.21.15.38:0/914449660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39200c52b0 msgr2=0x7f39200c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.294+0000 7f0f63877640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c15eb20 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.294+0000 7f3927d6e640 1 --2- 172.21.15.38:0/914449660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39200c52b0 0x7f39200c5730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39100097a0 tx=0x7f391002b680 comp rx=0 tx=0).stop 2023-12-22T08:40:13.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.295+0000 7f3927d6e640 1 -- 172.21.15.38:0/914449660 shutdown_connections 2023-12-22T08:40:13.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.295+0000 7f3927d6e640 1 --2- 172.21.15.38:0/914449660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39200c52b0 0x7f39200c5730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.295+0000 7f3927d6e640 1 --2- 172.21.15.38:0/914449660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39200ce770 0x7f392016a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.295+0000 7f3927d6e640 1 -- 172.21.15.38:0/914449660 >> 172.21.15.38:0/914449660 conn(0x7f39200cee70 msgr2=0x7f39200cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.295+0000 7f0f60e12640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0f5c06ca50 0x7f0f5c0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.295+0000 7f3927d6e640 1 -- 172.21.15.38:0/914449660 shutdown_connections 2023-12-22T08:40:13.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.295+0000 7f0f60e12640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0f5c06ca50 0x7f0f5c0b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34952/0 (socket says 172.21.15.38:34952) 2023-12-22T08:40:13.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.295+0000 7f0f60e12640 1 -- 172.21.15.38:0/4066536014 learned_addr learned my addr 172.21.15.38:0/4066536014 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:13.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.295+0000 7f3927d6e640 1 -- 172.21.15.38:0/914449660 wait complete. 2023-12-22T08:40:13.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.296+0000 7f0f61613640 1 --2- 172.21.15.38:0/4066536014 >> v2:172.21.15.89:3300/0 conn(0x7f0f5c15e740 0x7f0f5c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.296+0000 7f0f61e14640 1 --2- 172.21.15.38:0/4066536014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f5c0b3dc0 0x7f0f5c161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.296+0000 7f0f60e12640 1 -- 172.21.15.38:0/4066536014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f5c0b3dc0 msgr2=0x7f0f5c161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:13.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.296+0000 7f0f60e12640 1 --2- 172.21.15.38:0/4066536014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f5c0b3dc0 0x7f0f5c161120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.296+0000 7f0f60e12640 1 -- 172.21.15.38:0/4066536014 >> v2:172.21.15.89:3300/0 conn(0x7f0f5c15e740 msgr2=0x7f0f5c15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:13.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.296+0000 7f0f60e12640 1 --2- 172.21.15.38:0/4066536014 >> v2:172.21.15.89:3300/0 conn(0x7f0f5c15e740 0x7f0f5c15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.296+0000 7f0f60e12640 1 -- 172.21.15.38:0/4066536014 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c070770 con 0x7f0f5c06ca50 2023-12-22T08:40:13.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.298+0000 7f0f60e12640 1 --2- 172.21.15.38:0/4066536014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f5c06ca50 0x7f0f5c0b3880 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c06ca20 tx=0x7f0f4c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c75f2aeb54822d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.298+0000 7f3927d6e640 1 Processor -- start 2023-12-22T08:40:13.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.298+0000 7f223e514640 1 Processor -- start 2023-12-22T08:40:13.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.298+0000 7f0f53fff640 1 -- 172.21.15.38:0/4066536014 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c02e070 con 0x7f0f5c06ca50 2023-12-22T08:40:13.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.298+0000 7f3927d6e640 1 -- start start 2023-12-22T08:40:13.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.299+0000 7f0f53fff640 1 -- 172.21.15.38:0/4066536014 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c0315a0 con 0x7f0f5c06ca50 2023-12-22T08:40:13.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.299+0000 7f0f53fff640 1 -- 172.21.15.38:0/4066536014 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c031970 con 0x7f0f5c06ca50 2023-12-22T08:40:13.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.300+0000 7f0f63877640 1 -- 172.21.15.38:0/4066536014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f5c06ca50 msgr2=0x7f0f5c0b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.300+0000 7f0f63877640 1 --2- 172.21.15.38:0/4066536014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f5c06ca50 0x7f0f5c0b3880 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c06ca20 tx=0x7f0f4c02b840 comp rx=0 tx=0).stop 2023-12-22T08:40:13.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.300+0000 7f3927d6e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f392006f250 0x7f3920079ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.298+0000 7f223e514640 1 -- start start 2023-12-22T08:40:13.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.300+0000 7f223e514640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f223806c190 0x7f22380ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.300+0000 7f223e514640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223815a5b0 con 0x7f22380b2760 2023-12-22T08:40:13.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.300+0000 7f223e514640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22380aea90 con 0x7f2238153be0 2023-12-22T08:40:13.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.300+0000 7f223e514640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2238159ca0 con 0x7f223806c190 2023-12-22T08:40:13.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.301+0000 7f0f63877640 1 -- 172.21.15.38:0/4066536014 shutdown_connections 2023-12-22T08:40:13.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.301+0000 7f223cab1640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f223806c190 0x7f22380ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.301+0000 7f3927d6e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39200c52b0 0x7f3920203c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.301+0000 7f0f63877640 1 --2- 172.21.15.38:0/4066536014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f5c0b3dc0 0x7f0f5c161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.301+0000 7f0f63877640 1 --2- 172.21.15.38:0/4066536014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f5c06ca50 0x7f0f5c0b3880 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.301+0000 7f0f63877640 1 --2- 172.21.15.38:0/4066536014 >> v2:172.21.15.89:3300/0 conn(0x7f0f5c15e740 0x7f0f5c15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.301+0000 7f0f63877640 1 -- 172.21.15.38:0/4066536014 >> 172.21.15.38:0/4066536014 conn(0x7f0f5c0cfea0 msgr2=0x7f0f5c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.301+0000 7f3927d6e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39200ce770 0x7f39200b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.301+0000 7f223cab1640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f223806c190 0x7f22380ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34982/0 (socket says 172.21.15.38:34982) 2023-12-22T08:40:13.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.301+0000 7f223cab1640 1 -- 172.21.15.38:0/971476411 learned_addr learned my addr 172.21.15.38:0/971476411 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:13.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.302+0000 7f0f63877640 1 -- 172.21.15.38:0/4066536014 shutdown_connections 2023-12-22T08:40:13.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.302+0000 7f3927d6e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3920207000 con 0x7f392006f250 2023-12-22T08:40:13.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.302+0000 7f3925b0a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f392006f250 0x7f3920079ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.302+0000 7f392630b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39200ce770 0x7f39200b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.302+0000 7f392630b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39200ce770 0x7f39200b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:58574/0 (socket says 172.21.15.38:58574) 2023-12-22T08:40:13.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.302+0000 7f392630b640 1 -- 172.21.15.38:0/948772568 learned_addr learned my addr 172.21.15.38:0/948772568 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:13.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.302+0000 7f0f63877640 1 -- 172.21.15.38:0/4066536014 wait complete. 2023-12-22T08:40:13.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.302+0000 7f223cab1640 1 -- 172.21.15.38:0/971476411 >> v1:172.21.15.89:6789/0 conn(0x7f2238153be0 legacy=0x7f22380b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.303+0000 7f223cab1640 1 -- 172.21.15.38:0/971476411 >> v1:172.21.15.38:6789/0 conn(0x7f22380b2760 legacy=0x7f22380b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:13.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.302+0000 7f3925309640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39200c52b0 0x7f3920203c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.303+0000 7f223cab1640 1 -- 172.21.15.38:0/971476411 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22380ced10 con 0x7f223806c190 2023-12-22T08:40:13.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.303+0000 7f3927d6e640 1 -- 172.21.15.38:0/948772568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39200c3e90 con 0x7f39200ce770 2023-12-22T08:40:13.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.303+0000 7f3927d6e640 1 -- 172.21.15.38:0/948772568 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3920206d20 con 0x7f39200c52b0 2023-12-22T08:40:13.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.304+0000 7f3925b0a640 1 -- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39200c52b0 msgr2=0x7f3920203c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.304+0000 7f3925b0a640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39200c52b0 0x7f3920203c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.304+0000 7f223cab1640 1 --2- 172.21.15.38:0/971476411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f223806c190 0x7f22380ce680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f223000b1a0 tx=0x7f223002c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afb23864fc882e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.304+0000 7f3925b0a640 1 -- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39200ce770 msgr2=0x7f39200b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.304+0000 7f3925b0a640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39200ce770 0x7f39200b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.304+0000 7f3925b0a640 1 -- 172.21.15.38:0/948772568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3910009400 con 0x7f392006f250 2023-12-22T08:40:13.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.305+0000 7f392630b640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39200ce770 0x7f39200b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:13.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.305+0000 7f0f63877640 1 Processor -- start 2023-12-22T08:40:13.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.305+0000 7f2236ffd640 1 -- 172.21.15.38:0/971476411 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223002cb70 con 0x7f223806c190 2023-12-22T08:40:13.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.305+0000 7f3925b0a640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f392006f250 0x7f3920079ff0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f391800efc0 tx=0x7f391800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.305+0000 7f1119c26640 1 Processor -- start 2023-12-22T08:40:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.305+0000 7f2236ffd640 1 -- 172.21.15.38:0/971476411 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223002ccd0 con 0x7f223806c190 2023-12-22T08:40:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.305+0000 7f2236ffd640 1 -- 172.21.15.38:0/971476411 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230034610 con 0x7f223806c190 2023-12-22T08:40:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.305+0000 7f1119c26640 1 -- start start 2023-12-22T08:40:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.306+0000 7f0f63877640 1 -- start start 2023-12-22T08:40:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.306+0000 7f39167fc640 1 -- 172.21.15.38:0/948772568 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918014480 con 0x7f392006f250 2023-12-22T08:40:13.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.306+0000 7f39167fc640 1 -- 172.21.15.38:0/948772568 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391800f040 con 0x7f392006f250 2023-12-22T08:40:13.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.306+0000 7f39167fc640 1 -- 172.21.15.38:0/948772568 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918014800 con 0x7f392006f250 2023-12-22T08:40:13.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.306+0000 7f223e514640 1 -- 172.21.15.38:0/971476411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f223806c190 msgr2=0x7f22380ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.307+0000 7f223e514640 1 --2- 172.21.15.38:0/971476411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f223806c190 0x7f22380ce680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f223000b1a0 tx=0x7f223002c1d0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.307+0000 7f223e514640 1 -- 172.21.15.38:0/971476411 shutdown_connections 2023-12-22T08:40:13.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.307+0000 7f223e514640 1 --2- 172.21.15.38:0/971476411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f223806c190 0x7f22380ce680 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.307+0000 7f223e514640 1 -- 172.21.15.38:0/971476411 >> 172.21.15.38:0/971476411 conn(0x7f22380cf070 msgr2=0x7f22380cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.307+0000 7f223e514640 1 -- 172.21.15.38:0/971476411 shutdown_connections 2023-12-22T08:40:13.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.307+0000 7f223e514640 1 -- 172.21.15.38:0/971476411 wait complete. 2023-12-22T08:40:13.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.307+0000 7f3927d6e640 1 -- 172.21.15.38:0/948772568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39200c3840 con 0x7f392006f250 2023-12-22T08:40:13.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.308+0000 7fc63a5dc640 1 Processor -- start 2023-12-22T08:40:13.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.308+0000 7f1119c26640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f11140cb830 0x7f11140cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.308+0000 7f1119c26640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11140b3d10 con 0x7f11140b22c0 2023-12-22T08:40:13.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.308+0000 7f1119c26640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11140cc200 con 0x7f11140b26a0 2023-12-22T08:40:13.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.308+0000 7f1119c26640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111406c610 con 0x7f11140cb830 2023-12-22T08:40:13.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.309+0000 7f0f63877640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c06ca50 0x7f0f5c0b7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.309+0000 7f0f63877640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f5c0b3dc0 0x7f0f5c145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.309+0000 7f0f63877640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f5c15e740 0x7f0f5c1460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.309+0000 7f0f63877640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c201430 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.309+0000 7f0f63877640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0b7f10 con 0x7f0f5c06ca50 2023-12-22T08:40:13.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.309+0000 7f0f63877640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0b81f0 con 0x7f0f5c15e740 2023-12-22T08:40:13.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.309+0000 7f0f60e12640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f5c0b3dc0 0x7f0f5c145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.310+0000 7f0f61e14640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f5c15e740 0x7f0f5c1460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.310+0000 7f0f61e14640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f5c15e740 0x7f0f5c1460b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:56202/0 (socket says 172.21.15.38:56202) 2023-12-22T08:40:13.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.310+0000 7f0f61e14640 1 -- 172.21.15.38:0/1337168166 learned_addr learned my addr 172.21.15.38:0/1337168166 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:13.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.310+0000 7f0f60e12640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f5c0b3dc0 0x7f0f5c145b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34992/0 (socket says 172.21.15.38:34992) 2023-12-22T08:40:13.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.310+0000 7f0f61613640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c06ca50 0x7f0f5c0b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.308+0000 7f3927d6e640 1 -- 172.21.15.38:0/948772568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3920089bc0 con 0x7f392006f250 2023-12-22T08:40:13.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.309+0000 7f11137fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f11140b22c0 0x7f11140b3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49738/0 (socket says 172.21.15.38:49738) 2023-12-22T08:40:13.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.309+0000 7f11137fe640 1 -- 172.21.15.38:0/2583823381 learned_addr learned my addr 172.21.15.38:0/2583823381 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:13.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.309+0000 7f1113fff640 1 --2- 172.21.15.38:0/2583823381 >> v2:172.21.15.89:3300/0 conn(0x7f11140cb830 0x7f11140cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.310+0000 7f0f60e12640 1 -- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f5c15e740 msgr2=0x7f0f5c1460b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7f0f60e12640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f5c15e740 0x7f0f5c1460b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7f0f60e12640 1 -- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c06ca50 msgr2=0x7f0f5c0b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7f0f60e12640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c06ca50 0x7f0f5c0b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7f0f60e12640 1 -- 172.21.15.38:0/1337168166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c0094d0 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7f223e514640 1 Processor -- start 2023-12-22T08:40:13.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.308+0000 7fc63a5dc640 1 -- start start 2023-12-22T08:40:13.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7f223e514640 1 -- start start 2023-12-22T08:40:13.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.310+0000 7fc63a5dc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 0x7fc62c0540e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.310+0000 7fc63a5dc640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c054620 con 0x7fc62c0e3140 2023-12-22T08:40:13.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.310+0000 7fc63a5dc640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c058ca0 con 0x7fc62c03e950 2023-12-22T08:40:13.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.310+0000 7fc63a5dc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c057510 con 0x7fc62c053c90 2023-12-22T08:40:13.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7fc639ddb640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 0x7fc62c0540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7fc639ddb640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 0x7fc62c0540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:56214/0 (socket says 172.21.15.38:56214) 2023-12-22T08:40:13.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7f11127fc640 1 -- 172.21.15.38:0/2583823381 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690504522 0 0) 0x7f1104001110 con 0x7f11140b22c0 2023-12-22T08:40:13.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7f11127fc640 1 -- 172.21.15.38:0/2583823381 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10fc003520 con 0x7f11140b22c0 2023-12-22T08:40:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7f11127fc640 1 -- 172.21.15.38:0/2583823381 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131158412 0 0) 0x7f11140cc200 con 0x7f11140b26a0 2023-12-22T08:40:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7f11127fc640 1 -- 172.21.15.38:0/2583823381 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1104001110 con 0x7f11140b26a0 2023-12-22T08:40:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.312+0000 7f11127fc640 1 -- 172.21.15.38:0/2583823381 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2541218131 0 0) 0x7f10fc003520 con 0x7f11140b22c0 2023-12-22T08:40:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.312+0000 7f1113fff640 1 -- 172.21.15.38:0/2583823381 >> v1:172.21.15.89:6789/0 conn(0x7f11140b26a0 legacy=0x7f111406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.312+0000 7f1113fff640 1 -- 172.21.15.38:0/2583823381 >> v1:172.21.15.38:6789/0 conn(0x7f11140b22c0 legacy=0x7f11140b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.312+0000 7f1113fff640 1 -- 172.21.15.38:0/2583823381 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11140b4510 con 0x7f11140cb830 2023-12-22T08:40:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7f0f61e14640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f5c15e740 0x7f0f5c1460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7f0f61613640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c06ca50 0x7f0f5c0b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:13.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.311+0000 7fc639ddb640 1 -- 172.21.15.38:0/975937136 learned_addr learned my addr 172.21.15.38:0/975937136 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:13.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.312+0000 7f0f60e12640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f5c0b3dc0 0x7f0f5c145b70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c033000 tx=0x7f0f4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.312+0000 7f39167fc640 1 -- 172.21.15.38:0/948772568 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3918014960 con 0x7f392006f250 2023-12-22T08:40:13.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.312+0000 7f3927d6e640 1 -- 172.21.15.38:0/948772568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39200c3680 con 0x7f392006f250 2023-12-22T08:40:13.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.313+0000 7fc62bfff640 1 -- 172.21.15.38:0/975937136 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594890058 0 0) 0x7fc62c058ca0 con 0x7fc62c03e950 2023-12-22T08:40:13.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.313+0000 7fc62bfff640 1 -- 172.21.15.38:0/975937136 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc620003520 con 0x7fc62c03e950 2023-12-22T08:40:13.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.314+0000 7f39167fc640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f390406a480 0x7f390406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.314+0000 7f223e514640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f223806c190 0x7f22380b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.314+0000 7f223e514640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22380b2760 0x7f2238158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.314+0000 7f223e514640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2238153be0 0x7f223814a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.314+0000 7f2237fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f223806c190 0x7f22380b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.315+0000 7f22377fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22380b2760 0x7f2238158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.315+0000 7f2237fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f223806c190 0x7f22380b0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:56228/0 (socket says 172.21.15.38:56228) 2023-12-22T08:40:13.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.314+0000 7f1113fff640 1 --2- 172.21.15.38:0/2583823381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11140cb830 0x7f11140cbcc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f110c009d90 tx=0x7f110c02bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bae2878ff0deb9c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.315+0000 7f22377fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22380b2760 0x7f2238158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35008/0 (socket says 172.21.15.38:35008) 2023-12-22T08:40:13.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.313+0000 7fc639ddb640 1 -- 172.21.15.38:0/975937136 >> v1:172.21.15.89:6789/0 conn(0x7fc62c03e950 legacy=0x7fc62c058590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.314+0000 7fc639ddb640 1 -- 172.21.15.38:0/975937136 >> v1:172.21.15.38:6789/0 conn(0x7fc62c0e3140 legacy=0x7fc62c0e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.314+0000 7fc639ddb640 1 -- 172.21.15.38:0/975937136 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c0577f0 con 0x7fc62c053c90 2023-12-22T08:40:13.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.314+0000 7f39167fc640 1 -- 172.21.15.38:0/948772568 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3918088980 con 0x7f392006f250 2023-12-22T08:40:13.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.315+0000 7f3925309640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f390406a480 0x7f390406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.315+0000 7f2237fff640 1 -- 172.21.15.38:0/439052372 learned_addr learned my addr 172.21.15.38:0/439052372 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:13.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.315+0000 7f223e514640 1 -- 172.21.15.38:0/439052372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223814c900 con 0x7f22380b2760 2023-12-22T08:40:13.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.315+0000 7f223e514640 1 -- 172.21.15.38:0/439052372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223814f950 con 0x7f2238153be0 2023-12-22T08:40:13.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.315+0000 7f223e514640 1 -- 172.21.15.38:0/439052372 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223814fc30 con 0x7f223806c190 2023-12-22T08:40:13.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.315+0000 7f11127fc640 1 -- 172.21.15.38:0/2583823381 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104001800 con 0x7f11140cb830 2023-12-22T08:40:13.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.315+0000 7fc639ddb640 1 --2- 172.21.15.38:0/975937136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 0x7fc62c0540e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc634072a60 tx=0x7fc6340a6280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2672ec306c15c242 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.315+0000 7f11127fc640 1 -- 172.21.15.38:0/2583823381 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c02c8c0 con 0x7f11140cb830 2023-12-22T08:40:13.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.315+0000 7f11127fc640 1 -- 172.21.15.38:0/2583823381 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c02cc50 con 0x7f11140cb830 2023-12-22T08:40:13.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.316+0000 7fc62bfff640 1 -- 172.21.15.38:0/975937136 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6340a6e80 con 0x7fc62c053c90 2023-12-22T08:40:13.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.316+0000 7fc62bfff640 1 -- 172.21.15.38:0/975937136 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6340aa070 con 0x7fc62c053c90 2023-12-22T08:40:13.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.316+0000 7fc62bfff640 1 -- 172.21.15.38:0/975937136 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6340b3320 con 0x7fc62c053c90 2023-12-22T08:40:13.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.316+0000 7f223cab1640 1 --2- 172.21.15.38:0/439052372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2238153be0 0x7f223814a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.316+0000 7f22377fe640 1 -- 172.21.15.38:0/439052372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f223806c190 msgr2=0x7f22380b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.316+0000 7f22377fe640 1 --2- 172.21.15.38:0/439052372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f223806c190 0x7f22380b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.316+0000 7f22377fe640 1 -- 172.21.15.38:0/439052372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2238153be0 msgr2=0x7f223814a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.316+0000 7f22377fe640 1 --2- 172.21.15.38:0/439052372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2238153be0 0x7f223814a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.316+0000 7f22377fe640 1 -- 172.21.15.38:0/439052372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2230009b30 con 0x7f22380b2760 2023-12-22T08:40:13.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7fc63a5dc640 1 -- 172.21.15.38:0/975937136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 msgr2=0x7fc62c0540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7fc63a5dc640 1 --2- 172.21.15.38:0/975937136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 0x7fc62c0540e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc634072a60 tx=0x7fc6340a6280 comp rx=0 tx=0).stop 2023-12-22T08:40:13.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7f1119c26640 1 -- 172.21.15.38:0/2583823381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11140cb830 msgr2=0x7f11140cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7f1119c26640 1 --2- 172.21.15.38:0/2583823381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11140cb830 0x7f11140cbcc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f110c009d90 tx=0x7f110c02bd90 comp rx=0 tx=0).stop 2023-12-22T08:40:13.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7f22377fe640 1 --2- 172.21.15.38:0/439052372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22380b2760 0x7f2238158f00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f222800c410 tx=0x7f222800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7fc63a5dc640 1 -- 172.21.15.38:0/975937136 shutdown_connections 2023-12-22T08:40:13.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7fc63a5dc640 1 --2- 172.21.15.38:0/975937136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 0x7fc62c0540e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7fc63a5dc640 1 -- 172.21.15.38:0/975937136 >> 172.21.15.38:0/975937136 conn(0x7fc62c055a40 msgr2=0x7fc62c055e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7f1119c26640 1 -- 172.21.15.38:0/2583823381 shutdown_connections 2023-12-22T08:40:13.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7f3925309640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f390406a480 0x7f390406c940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f392008a330 tx=0x7f391c007e00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7f1119c26640 1 --2- 172.21.15.38:0/2583823381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11140cb830 0x7f11140cbcc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7fc63a5dc640 1 -- 172.21.15.38:0/975937136 shutdown_connections 2023-12-22T08:40:13.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7fc63a5dc640 1 -- 172.21.15.38:0/975937136 wait complete. 2023-12-22T08:40:13.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.317+0000 7f1119c26640 1 -- 172.21.15.38:0/2583823381 >> 172.21.15.38:0/2583823381 conn(0x7f11140cf070 msgr2=0x7f11140cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.318+0000 7f1119c26640 1 -- 172.21.15.38:0/2583823381 shutdown_connections 2023-12-22T08:40:13.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.318+0000 7f1119c26640 1 -- 172.21.15.38:0/2583823381 wait complete. 2023-12-22T08:40:13.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.320+0000 7fc9630b2640 1 Processor -- start 2023-12-22T08:40:13.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.320+0000 7f1119c26640 1 Processor -- start 2023-12-22T08:40:13.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.321+0000 7f39167fc640 1 -- 172.21.15.38:0/948772568 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3918054010 con 0x7f392006f250 2023-12-22T08:40:13.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.321+0000 7f2234ff9640 1 -- 172.21.15.38:0/439052372 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228005230 con 0x7f22380b2760 2023-12-22T08:40:13.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.321+0000 7f223e514640 1 -- 172.21.15.38:0/439052372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223814cb50 con 0x7f22380b2760 2023-12-22T08:40:13.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.320+0000 7fc63a5dc640 1 Processor -- start 2023-12-22T08:40:13.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.320+0000 7fc63a5dc640 1 -- start start 2023-12-22T08:40:13.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.320+0000 7f1119c26640 1 -- start start 2023-12-22T08:40:13.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.321+0000 7f1119c26640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11140b22c0 0x7f11141630e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.321+0000 7f1119c26640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11140b26a0 0x7f11140ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.321+0000 7f0f51ffb640 1 -- 172.21.15.38:0/1337168166 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c032840 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.321+0000 7f1119c26640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11140cb830 0x7f111415ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.321+0000 7f1119c26640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11140a86f0 con 0x7f11140b22c0 2023-12-22T08:40:13.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.321+0000 7f1119c26640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1114163770 con 0x7f11140cb830 2023-12-22T08:40:13.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.321+0000 7f1119c26640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1114163a50 con 0x7f11140b26a0 2023-12-22T08:40:13.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.321+0000 7f223e514640 1 -- 172.21.15.38:0/439052372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223814f5b0 con 0x7f22380b2760 2023-12-22T08:40:13.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.321+0000 7f2234ff9640 1 -- 172.21.15.38:0/439052372 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2228005390 con 0x7f22380b2760 2023-12-22T08:40:13.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.321+0000 7f0f63877640 1 -- 172.21.15.38:0/1337168166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c0b84d0 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.322+0000 7f0f63877640 1 -- 172.21.15.38:0/1337168166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c15aa00 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.320+0000 7fc9630b2640 1 -- start start 2023-12-22T08:40:13.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.322+0000 7f1112ffd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11140b26a0 0x7f11140ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.323+0000 7fc63a5dc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c03e950 0x7fc62c0d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.323+0000 7fc63a5dc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 0x7fc62c0510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.322+0000 7f1112ffd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11140b26a0 0x7f11140ad490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:56232/0 (socket says 172.21.15.38:56232) 2023-12-22T08:40:13.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.322+0000 7f1112ffd640 1 -- 172.21.15.38:0/4260406890 learned_addr learned my addr 172.21.15.38:0/4260406890 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:13.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.322+0000 7f1113fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11140cb830 0x7f111415ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.323+0000 7f0f63877640 1 -- 172.21.15.38:0/1337168166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c2015a0 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.323+0000 7f0f51ffb640 1 -- 172.21.15.38:0/1337168166 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c0329a0 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.323+0000 7fc63a5dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62c0e3140 0x7fc62c17cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.323+0000 7fc63a5dc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c051a50 con 0x7fc62c03e950 2023-12-22T08:40:13.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.323+0000 7fc63a5dc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c051d30 con 0x7fc62c0e3140 2023-12-22T08:40:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.323+0000 7fc63a5dc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c052010 con 0x7fc62c053c90 2023-12-22T08:40:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.323+0000 7fc9630b2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c15e740 0x7fc95c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.323+0000 7fc9630b2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc95c0b3f90 0x7fc95c070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.323+0000 7fc9630b2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95c15eb20 con 0x7fc95c06ca50 2023-12-22T08:40:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.323+0000 7fc9630b2640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95c06e650 con 0x7fc95c0b3f90 2023-12-22T08:40:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.323+0000 7fc9630b2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c070770 con 0x7fc95c15e740 2023-12-22T08:40:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.324+0000 7fc960e4e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c15e740 0x7fc95c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.324+0000 7f223e514640 1 -- 172.21.15.38:0/439052372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223814d070 con 0x7f22380b2760 2023-12-22T08:40:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.324+0000 7f0f51ffb640 1 -- 172.21.15.38:0/1337168166 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c032d10 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.324+0000 7f2234ff9640 1 -- 172.21.15.38:0/439052372 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22280047e0 con 0x7f22380b2760 2023-12-22T08:40:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.324+0000 7fc638dd9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 0x7fc62c0510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.324+0000 7fc638dd9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 0x7fc62c0510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:56246/0 (socket says 172.21.15.38:56246) 2023-12-22T08:40:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.324+0000 7fc638dd9640 1 -- 172.21.15.38:0/2719806884 learned_addr learned my addr 172.21.15.38:0/2719806884 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.324+0000 7f3073b2e640 1 Processor -- start 2023-12-22T08:40:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.324+0000 7f3073b2e640 1 -- start start 2023-12-22T08:40:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.324+0000 7fc960e4e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c15e740 0x7fc95c15db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:56242/0 (socket says 172.21.15.38:56242) 2023-12-22T08:40:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.324+0000 7fc960e4e640 1 -- 172.21.15.38:0/3593186671 learned_addr learned my addr 172.21.15.38:0/3593186671 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.324+0000 7fc6395da640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c03e950 0x7fc62c0d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.325+0000 7f1112ffd640 1 -- 172.21.15.38:0/4260406890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11140cb830 msgr2=0x7f111415ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.325+0000 7f1112ffd640 1 --2- 172.21.15.38:0/4260406890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11140cb830 0x7f111415ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.325+0000 7f1112ffd640 1 -- 172.21.15.38:0/4260406890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11140b22c0 msgr2=0x7f11141630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.325+0000 7f1112ffd640 1 --2- 172.21.15.38:0/4260406890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11140b22c0 0x7f11141630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.325+0000 7f1112ffd640 1 -- 172.21.15.38:0/4260406890 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c009a70 con 0x7f11140b26a0 2023-12-22T08:40:13.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.325+0000 7fc639ddb640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62c0e3140 0x7fc62c17cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.325+0000 7fc960e4e640 1 -- 172.21.15.38:0/3593186671 >> v2:172.21.15.38:3300/0 conn(0x7fc95c0b3f90 msgr2=0x7fc95c070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:13.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.325+0000 7fc960e4e640 1 --2- 172.21.15.38:0/3593186671 >> v2:172.21.15.38:3300/0 conn(0x7fc95c0b3f90 0x7fc95c070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.325+0000 7fc960e4e640 1 -- 172.21.15.38:0/3593186671 >> v1:172.21.15.89:6789/0 conn(0x7fc95c06ca50 legacy=0x7fc95c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.325+0000 7fc960e4e640 1 -- 172.21.15.38:0/3593186671 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c06d180 con 0x7fc95c15e740 2023-12-22T08:40:13.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.325+0000 7f1112ffd640 1 --2- 172.21.15.38:0/4260406890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11140b26a0 0x7f11140ad490 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f110800c490 tx=0x7f110800c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.326+0000 7fc638dd9640 1 -- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62c0e3140 msgr2=0x7fc62c17cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.326+0000 7fc638dd9640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62c0e3140 0x7fc62c17cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.326+0000 7fc638dd9640 1 -- 172.21.15.38:0/2719806884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c03e950 msgr2=0x7fc62c0d49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.326+0000 7fc638dd9640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c03e950 0x7fc62c0d49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.326+0000 7fc638dd9640 1 -- 172.21.15.38:0/2719806884 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6340680e0 con 0x7fc62c053c90 2023-12-22T08:40:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.326+0000 7fc6395da640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c03e950 0x7fc62c0d49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.327+0000 7f3073b2e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f306c15e740 0x7f306c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.327+0000 7f3073b2e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f306c0b3f90 0x7f306c070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.327+0000 7f3073b2e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c15eb20 con 0x7f306c06ca50 2023-12-22T08:40:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.327+0000 7f3073b2e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c06e650 con 0x7f306c15e740 2023-12-22T08:40:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.327+0000 7f3073b2e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c070770 con 0x7f306c0b3f90 2023-12-22T08:40:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.327+0000 7fc960e4e640 1 --2- 172.21.15.38:0/3593186671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c15e740 0x7fc95c15db30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc958009870 tx=0x7fc95802b6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efddb51bc9c6b16 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.327+0000 7f10fbfff640 1 -- 172.21.15.38:0/4260406890 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108005480 con 0x7f11140b26a0 2023-12-22T08:40:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.327+0000 7f10fbfff640 1 -- 172.21.15.38:0/4260406890 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11080035f0 con 0x7f11140b26a0 2023-12-22T08:40:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.327+0000 7f1119c26640 1 -- 172.21.15.38:0/4260406890 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1114163d30 con 0x7f11140b26a0 2023-12-22T08:40:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.327+0000 7f10fbfff640 1 -- 172.21.15.38:0/4260406890 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108003a40 con 0x7f11140b26a0 2023-12-22T08:40:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.327+0000 7f1119c26640 1 -- 172.21.15.38:0/4260406890 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11141642f0 con 0x7f11140b26a0 2023-12-22T08:40:13.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.328+0000 7fc9537fe640 1 -- 172.21.15.38:0/3593186671 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958030710 con 0x7fc95c15e740 2023-12-22T08:40:13.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.328+0000 7fc9537fe640 1 -- 172.21.15.38:0/3593186671 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95802e050 con 0x7fc95c15e740 2023-12-22T08:40:13.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.328+0000 7fc9537fe640 1 -- 172.21.15.38:0/3593186671 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958030a90 con 0x7fc95c15e740 2023-12-22T08:40:13.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.328+0000 7f30710c9640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f306c06ca50 0x7f306c0b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49760/0 (socket says 172.21.15.38:49760) 2023-12-22T08:40:13.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.328+0000 7f30710c9640 1 -- 172.21.15.38:0/682585216 learned_addr learned my addr 172.21.15.38:0/682585216 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:13.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.329+0000 7f30718ca640 1 --2- 172.21.15.38:0/682585216 >> v2:172.21.15.38:3300/0 conn(0x7f306c15e740 0x7f306c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.329+0000 7fc638dd9640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 0x7fc62c0510e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc63000c430 tx=0x7fc63000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.329+0000 7f0f51ffb640 1 -- 172.21.15.38:0/1337168166 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f4c0453f0 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.329+0000 7f1119c26640 1 -- 172.21.15.38:0/4260406890 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1114164510 con 0x7f11140b26a0 2023-12-22T08:40:13.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.328+0000 7f2234ff9640 1 -- 172.21.15.38:0/439052372 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2228004940 con 0x7f22380b2760 2023-12-22T08:40:13.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.329+0000 7f2234ff9640 1 --2- 172.21.15.38:0/439052372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f221806a430 0x7f221806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.329+0000 7f2234ff9640 1 -- 172.21.15.38:0/439052372 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2228088850 con 0x7f22380b2760 2023-12-22T08:40:13.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.329+0000 7fc9630b2640 1 -- 172.21.15.38:0/3593186671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c15e740 msgr2=0x7fc95c15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.329+0000 7fc9630b2640 1 --2- 172.21.15.38:0/3593186671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c15e740 0x7fc95c15db30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc958009870 tx=0x7fc95802b6b0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.330+0000 7fc9630b2640 1 -- 172.21.15.38:0/3593186671 shutdown_connections 2023-12-22T08:40:13.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.330+0000 7fc9630b2640 1 --2- 172.21.15.38:0/3593186671 >> v2:172.21.15.38:3300/0 conn(0x7fc95c0b3f90 0x7fc95c070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.330+0000 7fc9630b2640 1 --2- 172.21.15.38:0/3593186671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c15e740 0x7fc95c15db30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.330+0000 7fc9630b2640 1 -- 172.21.15.38:0/3593186671 >> 172.21.15.38:0/3593186671 conn(0x7fc95c0cfea0 msgr2=0x7fc95c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.329+0000 7f30720cb640 1 --2- 172.21.15.38:0/682585216 >> v2:172.21.15.89:3300/0 conn(0x7f306c0b3f90 0x7f306c070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.329+0000 7f30718ca640 1 -- 172.21.15.38:0/682585216 >> v2:172.21.15.89:3300/0 conn(0x7f306c0b3f90 msgr2=0x7f306c070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:13.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.329+0000 7f30718ca640 1 --2- 172.21.15.38:0/682585216 >> v2:172.21.15.89:3300/0 conn(0x7f306c0b3f90 0x7f306c070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.329+0000 7f30718ca640 1 -- 172.21.15.38:0/682585216 >> v1:172.21.15.38:6789/0 conn(0x7f306c06ca50 legacy=0x7f306c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.329+0000 7f30718ca640 1 -- 172.21.15.38:0/682585216 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c06cec0 con 0x7f306c15e740 2023-12-22T08:40:13.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.330+0000 7f30720cb640 1 --2- 172.21.15.38:0/682585216 >> v2:172.21.15.89:3300/0 conn(0x7f306c0b3f90 0x7f306c070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:13.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.331+0000 7f2237fff640 1 --2- 172.21.15.38:0/439052372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f221806a430 0x7f221806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.330+0000 7fc9630b2640 1 -- 172.21.15.38:0/3593186671 shutdown_connections 2023-12-22T08:40:13.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.330+0000 7fc9630b2640 1 -- 172.21.15.38:0/3593186671 wait complete. 2023-12-22T08:40:13.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.331+0000 7fc629ffb640 1 -- 172.21.15.38:0/2719806884 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6300052d0 con 0x7fc62c053c90 2023-12-22T08:40:13.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.331+0000 7fc629ffb640 1 -- 172.21.15.38:0/2719806884 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc630005450 con 0x7fc62c053c90 2023-12-22T08:40:13.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.331+0000 7fc629ffb640 1 -- 172.21.15.38:0/2719806884 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630003830 con 0x7fc62c053c90 2023-12-22T08:40:13.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.331+0000 7f30718ca640 1 --2- 172.21.15.38:0/682585216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f306c15e740 0x7f306c15db30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f306c15b700 tx=0x7f306802b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7c0b0f1f869e7a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.331+0000 7f0f51ffb640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f4006a430 0x7f0f4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.331+0000 7f0f51ffb640 1 -- 172.21.15.38:0/1337168166 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f4c0aa1d0 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.332+0000 7f0f61613640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f4006a430 0x7f0f4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.332+0000 7f2237fff640 1 --2- 172.21.15.38:0/439052372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f221806a430 0x7f221806c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2220007fd0 tx=0x7f2220009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.332+0000 7f10fbfff640 1 -- 172.21.15.38:0/4260406890 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1108003ba0 con 0x7f11140b26a0 2023-12-22T08:40:13.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.331+0000 7fc63a5dc640 1 -- 172.21.15.38:0/2719806884 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62c0522f0 con 0x7fc62c053c90 2023-12-22T08:40:13.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.332+0000 7fc63a5dc640 1 -- 172.21.15.38:0/2719806884 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c0d4f10 con 0x7fc62c053c90 2023-12-22T08:40:13.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.333+0000 7fc9630b2640 1 Processor -- start 2023-12-22T08:40:13.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.333+0000 7fc63a5dc640 1 -- 172.21.15.38:0/2719806884 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62c052810 con 0x7fc62c053c90 2023-12-22T08:40:13.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.333+0000 7f10fbfff640 1 --2- 172.21.15.38:0/4260406890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f110006a430 0x7f110006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.333+0000 7fc9630b2640 1 -- start start 2023-12-22T08:40:13.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.334+0000 7f10fbfff640 1 -- 172.21.15.38:0/4260406890 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1108087ee0 con 0x7f11140b26a0 2023-12-22T08:40:13.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.334+0000 7f0f61613640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f4006a430 0x7f0f4006c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f58006fd0 tx=0x7f0f58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.334+0000 7f11137fe640 1 --2- 172.21.15.38:0/4260406890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f110006a430 0x7f110006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.335+0000 7fc9630b2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc95c06ca50 0x7fc95c152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.335+0000 7f2234ff9640 1 -- 172.21.15.38:0/439052372 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2228053e50 con 0x7f22380b2760 2023-12-22T08:40:13.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.335+0000 7fc9630b2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c0b3f90 0x7fc95c158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.335+0000 7fc9630b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c15e740 0x7fc95c14d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.335+0000 7fc9630b2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c0b60c0 con 0x7fc95c06ca50 2023-12-22T08:40:13.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.335+0000 7fc960e4e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc95c06ca50 0x7fc95c152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.335+0000 7fc9630b2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c158950 con 0x7fc95c15e740 2023-12-22T08:40:13.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.335+0000 7fc9630b2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c152d10 con 0x7fc95c0b3f90 2023-12-22T08:40:13.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.335+0000 7fc960e4e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc95c06ca50 0x7fc95c152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35034/0 (socket says 172.21.15.38:35034) 2023-12-22T08:40:13.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.335+0000 7fc960e4e640 1 -- 172.21.15.38:0/1533779903 learned_addr learned my addr 172.21.15.38:0/1533779903 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:13.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.335+0000 7f11137fe640 1 --2- 172.21.15.38:0/4260406890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f110006a430 0x7f110006c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1104001510 tx=0x7f11040013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.336+0000 7fc953fff640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c0b3f90 0x7fc95c158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.336+0000 7fc96164f640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c15e740 0x7fc95c14d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.336+0000 7fc960e4e640 1 -- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c0b3f90 msgr2=0x7fc95c158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.336+0000 7fc960e4e640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c0b3f90 0x7fc95c158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.336+0000 7fc960e4e640 1 -- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c15e740 msgr2=0x7fc95c14d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.336+0000 7fc960e4e640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c15e740 0x7fc95c14d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.336+0000 7fc960e4e640 1 -- 172.21.15.38:0/1533779903 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580094d0 con 0x7fc95c06ca50 2023-12-22T08:40:13.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.336+0000 7fc96164f640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c15e740 0x7fc95c14d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:13.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.336+0000 7fc960e4e640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc95c06ca50 0x7fc95c152680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc9580090b0 tx=0x7fc9580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.340+0000 7fc9517fa640 1 -- 172.21.15.38:0/1533779903 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958032990 con 0x7fc95c06ca50 2023-12-22T08:40:13.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.340+0000 7fc9517fa640 1 -- 172.21.15.38:0/1533779903 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958032b10 con 0x7fc95c06ca50 2023-12-22T08:40:13.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.340+0000 7fc9517fa640 1 -- 172.21.15.38:0/1533779903 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95803c470 con 0x7fc95c06ca50 2023-12-22T08:40:13.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.340+0000 7f30708c8640 1 -- 172.21.15.38:0/682585216 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068033620 con 0x7f306c15e740 2023-12-22T08:40:13.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.340+0000 7f30708c8640 1 -- 172.21.15.38:0/682585216 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3068033780 con 0x7f306c15e740 2023-12-22T08:40:13.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.340+0000 7fc9630b2640 1 -- 172.21.15.38:0/1533779903 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c152ff0 con 0x7fc95c06ca50 2023-12-22T08:40:13.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.340+0000 7f30708c8640 1 -- 172.21.15.38:0/682585216 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068033b10 con 0x7f306c15e740 2023-12-22T08:40:13.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.340+0000 7fc9630b2640 1 -- 172.21.15.38:0/1533779903 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95c0b5ce0 con 0x7fc95c06ca50 2023-12-22T08:40:13.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.340+0000 7f0f51ffb640 1 -- 172.21.15.38:0/1337168166 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0f4c075850 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.340+0000 7f3073b2e640 1 -- 172.21.15.38:0/682585216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f306c15e740 msgr2=0x7f306c15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.340+0000 7f3073b2e640 1 --2- 172.21.15.38:0/682585216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f306c15e740 0x7f306c15db30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f306c15b700 tx=0x7f306802b7d0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.341+0000 7f3073b2e640 1 -- 172.21.15.38:0/682585216 shutdown_connections 2023-12-22T08:40:13.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.341+0000 7f3073b2e640 1 --2- 172.21.15.38:0/682585216 >> v2:172.21.15.89:3300/0 conn(0x7f306c0b3f90 0x7f306c070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.341+0000 7f3073b2e640 1 --2- 172.21.15.38:0/682585216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f306c15e740 0x7f306c15db30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.341+0000 7f3073b2e640 1 -- 172.21.15.38:0/682585216 >> 172.21.15.38:0/682585216 conn(0x7f306c0cfea0 msgr2=0x7f306c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.341+0000 7f3073b2e640 1 -- 172.21.15.38:0/682585216 shutdown_connections 2023-12-22T08:40:13.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.341+0000 7f3073b2e640 1 -- 172.21.15.38:0/682585216 wait complete. 2023-12-22T08:40:13.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.342+0000 7fc9630b2640 1 -- 172.21.15.38:0/1533779903 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95c0b6200 con 0x7fc95c06ca50 2023-12-22T08:40:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.343+0000 7fc9517fa640 1 -- 172.21.15.38:0/1533779903 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc958039040 con 0x7fc95c06ca50 2023-12-22T08:40:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.344+0000 7fc9517fa640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc94806a430 0x7fc94806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.344+0000 7fc9517fa640 1 -- 172.21.15.38:0/1533779903 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9580aab50 con 0x7fc95c06ca50 2023-12-22T08:40:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.345+0000 7fc953fff640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc94806a430 0x7fc94806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.345+0000 7f3073b2e640 1 Processor -- start 2023-12-22T08:40:13.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.345+0000 7f10fbfff640 1 -- 172.21.15.38:0/4260406890 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f11080535f0 con 0x7f11140b26a0 2023-12-22T08:40:13.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.345+0000 7f3073b2e640 1 -- start start 2023-12-22T08:40:13.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.347+0000 7f3073b2e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f306c06ca50 0x7f306c139fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.347+0000 7f3073b2e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f306c0b3f90 0x7f306c13c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.347+0000 7f3073b2e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f306c15e740 0x7f306c151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.347+0000 7f3073b2e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c13cb30 con 0x7f306c06ca50 2023-12-22T08:40:13.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.347+0000 7f3073b2e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c13ce10 con 0x7f306c15e740 2023-12-22T08:40:13.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.347+0000 7f3073b2e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c151270 con 0x7f306c0b3f90 2023-12-22T08:40:13.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.348+0000 7fc953fff640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc94806a430 0x7fc94806c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc95c153780 tx=0x7fc94c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.348+0000 7f30710c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f306c0b3f90 0x7f306c13c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.348+0000 7f30710c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f306c0b3f90 0x7f306c13c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:56258/0 (socket says 172.21.15.38:56258) 2023-12-22T08:40:13.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.348+0000 7f30710c9640 1 -- 172.21.15.38:0/1934313089 learned_addr learned my addr 172.21.15.38:0/1934313089 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:13.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.348+0000 7fc629ffb640 1 -- 172.21.15.38:0/2719806884 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc630003990 con 0x7fc62c053c90 2023-12-22T08:40:13.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.348+0000 7f30718ca640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f306c06ca50 0x7f306c139fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.348+0000 7f30720cb640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f306c15e740 0x7f306c151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.349+0000 7f30720cb640 1 -- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f306c0b3f90 msgr2=0x7f306c13c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.349+0000 7f30720cb640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f306c0b3f90 0x7f306c13c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.349+0000 7f30720cb640 1 -- 172.21.15.38:0/1934313089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f306c06ca50 msgr2=0x7f306c139fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.349+0000 7f30720cb640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f306c06ca50 0x7f306c139fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.349+0000 7f30720cb640 1 -- 172.21.15.38:0/1934313089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068009400 con 0x7f306c15e740 2023-12-22T08:40:13.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.350+0000 7f30720cb640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f306c15e740 0x7f306c151a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f306400cdf0 tx=0x7f306400a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.350+0000 7fc629ffb640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc61806a480 0x7fc61806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.350+0000 7fc629ffb640 1 -- 172.21.15.38:0/2719806884 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6300881a0 con 0x7fc62c053c90 2023-12-22T08:40:13.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.350+0000 7fc6395da640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc61806a480 0x7fc61806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.351+0000 7f30627fc640 1 -- 172.21.15.38:0/1934313089 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306400d840 con 0x7f306c15e740 2023-12-22T08:40:13.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.351+0000 7f30627fc640 1 -- 172.21.15.38:0/1934313089 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306400d9a0 con 0x7f306c15e740 2023-12-22T08:40:13.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.351+0000 7f30627fc640 1 -- 172.21.15.38:0/1934313089 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306400d840 con 0x7f306c15e740 2023-12-22T08:40:13.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.351+0000 7f3073b2e640 1 -- 172.21.15.38:0/1934313089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c151550 con 0x7f306c15e740 2023-12-22T08:40:13.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.351+0000 7f3073b2e640 1 -- 172.21.15.38:0/1934313089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c14e840 con 0x7f306c15e740 2023-12-22T08:40:13.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.353+0000 7fc9517fa640 1 -- 172.21.15.38:0/1533779903 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc9580761b0 con 0x7fc95c06ca50 2023-12-22T08:40:13.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.353+0000 7fc6395da640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc61806a480 0x7fc61806c940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc624000f60 tx=0x7fc624009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.353+0000 7f3073b2e640 1 -- 172.21.15.38:0/1934313089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c151740 con 0x7f306c15e740 2023-12-22T08:40:13.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.356+0000 7f30627fc640 1 -- 172.21.15.38:0/1934313089 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f306400db50 con 0x7f306c15e740 2023-12-22T08:40:13.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.357+0000 7f30627fc640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f305006a490 0x7f305006c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:13.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.358+0000 7f30627fc640 1 -- 172.21.15.38:0/1934313089 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30640585b0 con 0x7f306c15e740 2023-12-22T08:40:13.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.358+0000 7f30718ca640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f305006a490 0x7f305006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:13.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.360+0000 7f30718ca640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f305006a490 0x7f305006c950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3068035000 tx=0x7f3068008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:13.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.363+0000 7fc629ffb640 1 -- 172.21.15.38:0/2719806884 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc6300538b0 con 0x7fc62c053c90 2023-12-22T08:40:13.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.371+0000 7f30627fc640 1 -- 172.21.15.38:0/1934313089 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3064055080 con 0x7f306c15e740 2023-12-22T08:40:13.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.678+0000 7f2a12f39640 1 -- 172.21.15.38:0/3041296473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2a04007cd0 con 0x7f2a040e1230 2023-12-22T08:40:13.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.679+0000 7f2a097fa640 1 -- 172.21.15.38:0/3041296473 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a0c0f3400 con 0x7f2a040e1230 2023-12-22T08:40:13.681 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:13.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.682+0000 7f2a12f39640 1 -- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29f006a490 msgr2=0x7f29f006c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.682+0000 7f2a12f39640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29f006a490 0x7f29f006c950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29f8001030 tx=0x7f29f8007b50 comp rx=0 tx=0).stop 2023-12-22T08:40:13.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.683+0000 7f2a12f39640 1 -- 172.21.15.38:0/3041296473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a040e1230 msgr2=0x7f2a0403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.683+0000 7f2a12f39640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a040e1230 0x7f2a0403add0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c072860 tx=0x7f2a0c067e90 comp rx=0 tx=0).stop 2023-12-22T08:40:13.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.683+0000 7f2a12f39640 1 -- 172.21.15.38:0/3041296473 shutdown_connections 2023-12-22T08:40:13.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.683+0000 7f2a12f39640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29f006a490 0x7f29f006c950 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.683+0000 7f2a12f39640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a040e1230 0x7f2a0403add0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.684+0000 7f2a12f39640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a04056730 0x7f2a040db4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.684+0000 7f2a12f39640 1 --2- 172.21.15.38:0/3041296473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a040562d0 0x7f2a040dce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.684+0000 7f2a12f39640 1 -- 172.21.15.38:0/3041296473 >> 172.21.15.38:0/3041296473 conn(0x7f2a04056d10 msgr2=0x7f2a040e0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.684+0000 7f2a12f39640 1 -- 172.21.15.38:0/3041296473 shutdown_connections 2023-12-22T08:40:13.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.684+0000 7f2a12f39640 1 -- 172.21.15.38:0/3041296473 wait complete. 2023-12-22T08:40:13.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-12-22T08:40:13.714 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:13.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.742+0000 7fc63a5dc640 1 -- 172.21.15.38:0/2719806884 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc62c052810 con 0x7fc62c053c90 2023-12-22T08:40:13.746 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:13.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.743+0000 7fc629ffb640 1 -- 172.21.15.38:0/2719806884 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc630017020 con 0x7fc62c053c90 2023-12-22T08:40:13.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.745+0000 7fc63a5dc640 1 -- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc61806a480 msgr2=0x7fc61806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.746+0000 7fc63a5dc640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc61806a480 0x7fc61806c940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc624000f60 tx=0x7fc624009040 comp rx=0 tx=0).stop 2023-12-22T08:40:13.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.746+0000 7fc63a5dc640 1 -- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 msgr2=0x7fc62c0510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.746+0000 7fc63a5dc640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 0x7fc62c0510e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc63000c430 tx=0x7fc63000c8f0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.746+0000 7fc63a5dc640 1 -- 172.21.15.38:0/2719806884 shutdown_connections 2023-12-22T08:40:13.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.746+0000 7fc63a5dc640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc62c0e3140 0x7fc62c17cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.746+0000 7fc63a5dc640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc62c053c90 0x7fc62c0510e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.746+0000 7fc63a5dc640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc61806a480 0x7fc61806c940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.746+0000 7fc63a5dc640 1 --2- 172.21.15.38:0/2719806884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc62c03e950 0x7fc62c0d49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.746+0000 7fc63a5dc640 1 -- 172.21.15.38:0/2719806884 >> 172.21.15.38:0/2719806884 conn(0x7fc62c055a40 msgr2=0x7fc62c0e6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.746+0000 7fc63a5dc640 1 -- 172.21.15.38:0/2719806884 shutdown_connections 2023-12-22T08:40:13.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.746+0000 7fc63a5dc640 1 -- 172.21.15.38:0/2719806884 wait complete. 2023-12-22T08:40:13.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.760+0000 7f0f63877640 1 -- 172.21.15.38:0/1337168166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0f5c0b8330 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.761+0000 7f0f51ffb640 1 -- 172.21.15.38:0/1337168166 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f5c0b8330 con 0x7f0f5c0b3dc0 2023-12-22T08:40:13.764 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:13.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.762+0000 7f3927d6e640 1 -- 172.21.15.38:0/948772568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3920061910 con 0x7f392006f250 2023-12-22T08:40:13.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-12-22T08:40:13.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.763+0000 7f39167fc640 1 -- 172.21.15.38:0/948772568 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3918057630 con 0x7f392006f250 2023-12-22T08:40:13.767 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:13.767 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.763+0000 7f223e514640 1 -- 172.21.15.38:0/439052372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f223814d070 con 0x7f22380b2760 2023-12-22T08:40:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.764+0000 7f2234ff9640 1 -- 172.21.15.38:0/439052372 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f223814d070 con 0x7f22380b2760 2023-12-22T08:40:13.768 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:13.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.764+0000 7f0f63877640 1 -- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f4006a430 msgr2=0x7f0f4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.764+0000 7f0f63877640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f4006a430 0x7f0f4006c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f58006fd0 tx=0x7f0f58008040 comp rx=0 tx=0).stop 2023-12-22T08:40:13.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.764+0000 7f0f63877640 1 -- 172.21.15.38:0/1337168166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f5c0b3dc0 msgr2=0x7f0f5c145b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.764+0000 7f0f63877640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f5c0b3dc0 0x7f0f5c145b70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c033000 tx=0x7f0f4c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.765+0000 7f0f63877640 1 -- 172.21.15.38:0/1337168166 shutdown_connections 2023-12-22T08:40:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.765+0000 7f0f63877640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f5c15e740 0x7f0f5c1460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.765+0000 7f0f63877640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f4006a430 0x7f0f4006c8f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.765+0000 7f0f63877640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f5c0b3dc0 0x7f0f5c145b70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.765+0000 7f0f63877640 1 --2- 172.21.15.38:0/1337168166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f5c06ca50 0x7f0f5c0b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.765+0000 7f0f63877640 1 -- 172.21.15.38:0/1337168166 >> 172.21.15.38:0/1337168166 conn(0x7f0f5c0cfea0 msgr2=0x7f0f5c0d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.765+0000 7f0f63877640 1 -- 172.21.15.38:0/1337168166 shutdown_connections 2023-12-22T08:40:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.766+0000 7f0f63877640 1 -- 172.21.15.38:0/1337168166 wait complete. 2023-12-22T08:40:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.766+0000 7f3927d6e640 1 -- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f390406a480 msgr2=0x7f390406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.766+0000 7f3927d6e640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f390406a480 0x7f390406c940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f392008a330 tx=0x7f391c007e00 comp rx=0 tx=0).stop 2023-12-22T08:40:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.766+0000 7f3927d6e640 1 -- 172.21.15.38:0/948772568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f392006f250 msgr2=0x7f3920079ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.766+0000 7f3927d6e640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f392006f250 0x7f3920079ff0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f391800efc0 tx=0x7f391800c490 comp rx=0 tx=0).stop 2023-12-22T08:40:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.766+0000 7f3927d6e640 1 -- 172.21.15.38:0/948772568 shutdown_connections 2023-12-22T08:40:13.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.766+0000 7f3927d6e640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39200ce770 0x7f39200b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.766+0000 7f3927d6e640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39200c52b0 0x7f3920203c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.766+0000 7f3927d6e640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f390406a480 0x7f390406c940 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.766+0000 7f3927d6e640 1 --2- 172.21.15.38:0/948772568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f392006f250 0x7f3920079ff0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.767+0000 7f3927d6e640 1 -- 172.21.15.38:0/948772568 >> 172.21.15.38:0/948772568 conn(0x7f39200cee70 msgr2=0x7f39200cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.767+0000 7f3927d6e640 1 -- 172.21.15.38:0/948772568 shutdown_connections 2023-12-22T08:40:13.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.767+0000 7f3927d6e640 1 -- 172.21.15.38:0/948772568 wait complete. 2023-12-22T08:40:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.767+0000 7f223e514640 1 -- 172.21.15.38:0/439052372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f221806a430 msgr2=0x7f221806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.767+0000 7f223e514640 1 --2- 172.21.15.38:0/439052372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f221806a430 0x7f221806c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2220007fd0 tx=0x7f2220009040 comp rx=0 tx=0).stop 2023-12-22T08:40:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.767+0000 7f223e514640 1 -- 172.21.15.38:0/439052372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22380b2760 msgr2=0x7f2238158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.767+0000 7f223e514640 1 --2- 172.21.15.38:0/439052372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22380b2760 0x7f2238158f00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f222800c410 tx=0x7f222800c8d0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.767+0000 7f223e514640 1 -- 172.21.15.38:0/439052372 shutdown_connections 2023-12-22T08:40:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.767+0000 7f223e514640 1 --2- 172.21.15.38:0/439052372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2238153be0 0x7f223814a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.767+0000 7f223e514640 1 --2- 172.21.15.38:0/439052372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f221806a430 0x7f221806c8f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.767+0000 7f223e514640 1 --2- 172.21.15.38:0/439052372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22380b2760 0x7f2238158f00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.767+0000 7f223e514640 1 --2- 172.21.15.38:0/439052372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f223806c190 0x7f22380b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.767+0000 7f223e514640 1 -- 172.21.15.38:0/439052372 >> 172.21.15.38:0/439052372 conn(0x7f22380cf070 msgr2=0x7f2238152950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.768+0000 7f223e514640 1 -- 172.21.15.38:0/439052372 shutdown_connections 2023-12-22T08:40:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.768+0000 7f223e514640 1 -- 172.21.15.38:0/439052372 wait complete. 2023-12-22T08:40:13.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.774+0000 7f1119c26640 1 -- 172.21.15.38:0/4260406890 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1114163b90 con 0x7f11140b26a0 2023-12-22T08:40:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.775+0000 7f10fbfff640 1 -- 172.21.15.38:0/4260406890 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1114163b90 con 0x7f11140b26a0 2023-12-22T08:40:13.778 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.776+0000 7fc9630b2640 1 -- 172.21.15.38:0/1533779903 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc95c061910 con 0x7fc95c06ca50 2023-12-22T08:40:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.776+0000 7fc9517fa640 1 -- 172.21.15.38:0/1533779903 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc95804d020 con 0x7fc95c06ca50 2023-12-22T08:40:13.779 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:13.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.779+0000 7f1119c26640 1 -- 172.21.15.38:0/4260406890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f110006a430 msgr2=0x7f110006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.779+0000 7f1119c26640 1 --2- 172.21.15.38:0/4260406890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f110006a430 0x7f110006c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1104001510 tx=0x7f11040013e0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.779+0000 7f1119c26640 1 -- 172.21.15.38:0/4260406890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11140b26a0 msgr2=0x7f11140ad490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.779+0000 7f1119c26640 1 --2- 172.21.15.38:0/4260406890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11140b26a0 0x7f11140ad490 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f110800c490 tx=0x7f110800c950 comp rx=0 tx=0).stop 2023-12-22T08:40:13.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.779+0000 7f1119c26640 1 -- 172.21.15.38:0/4260406890 shutdown_connections 2023-12-22T08:40:13.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.779+0000 7f1119c26640 1 --2- 172.21.15.38:0/4260406890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11140cb830 0x7f111415ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.779+0000 7f1119c26640 1 --2- 172.21.15.38:0/4260406890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11140b26a0 0x7f11140ad490 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.779+0000 7f1119c26640 1 --2- 172.21.15.38:0/4260406890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f110006a430 0x7f110006c8f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.779+0000 7f1119c26640 1 --2- 172.21.15.38:0/4260406890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11140b22c0 0x7f11141630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.779+0000 7f1119c26640 1 -- 172.21.15.38:0/4260406890 >> 172.21.15.38:0/4260406890 conn(0x7f11140cf070 msgr2=0x7f111415f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.779+0000 7f1119c26640 1 -- 172.21.15.38:0/4260406890 shutdown_connections 2023-12-22T08:40:13.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.780+0000 7f1119c26640 1 -- 172.21.15.38:0/4260406890 wait complete. 2023-12-22T08:40:13.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.780+0000 7fc9630b2640 1 -- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc94806a430 msgr2=0x7fc94806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.780+0000 7fc9630b2640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc94806a430 0x7fc94806c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc95c153780 tx=0x7fc94c009040 comp rx=0 tx=0).stop 2023-12-22T08:40:13.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.780+0000 7fc9630b2640 1 -- 172.21.15.38:0/1533779903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc95c06ca50 msgr2=0x7fc95c152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.780+0000 7fc9630b2640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc95c06ca50 0x7fc95c152680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc9580090b0 tx=0x7fc9580046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.780+0000 7fc9630b2640 1 -- 172.21.15.38:0/1533779903 shutdown_connections 2023-12-22T08:40:13.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.780+0000 7fc9630b2640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc95c15e740 0x7fc95c14d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.780+0000 7fc9630b2640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc95c0b3f90 0x7fc95c158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.780+0000 7fc9630b2640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc94806a430 0x7fc94806c8f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.780+0000 7fc9630b2640 1 --2- 172.21.15.38:0/1533779903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc95c06ca50 0x7fc95c152680 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.780+0000 7fc9630b2640 1 -- 172.21.15.38:0/1533779903 >> 172.21.15.38:0/1533779903 conn(0x7fc95c0cfea0 msgr2=0x7fc95c160f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.781+0000 7fc9630b2640 1 -- 172.21.15.38:0/1533779903 shutdown_connections 2023-12-22T08:40:13.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.781+0000 7fc9630b2640 1 -- 172.21.15.38:0/1533779903 wait complete. 2023-12-22T08:40:13.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-12-22T08:40:13.792 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:13.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-12-22T08:40:13.796 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:13.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-12-22T08:40:13.797 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:13.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.796+0000 7f3073b2e640 1 -- 172.21.15.38:0/1934313089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f306c13cfa0 con 0x7f306c15e740 2023-12-22T08:40:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.797+0000 7f30627fc640 1 -- 172.21.15.38:0/1934313089 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f306401a070 con 0x7f306c15e740 2023-12-22T08:40:13.800 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2023-12-22T08:40:13.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-12-22T08:40:13.802 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:13.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.800+0000 7f3073b2e640 1 -- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f305006a490 msgr2=0x7f305006c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.800+0000 7f3073b2e640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f305006a490 0x7f305006c950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3068035000 tx=0x7f3068008030 comp rx=0 tx=0).stop 2023-12-22T08:40:13.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.800+0000 7f3073b2e640 1 -- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f306c15e740 msgr2=0x7f306c151a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:13.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.800+0000 7f3073b2e640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f306c15e740 0x7f306c151a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f306400cdf0 tx=0x7f306400a710 comp rx=0 tx=0).stop 2023-12-22T08:40:13.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.800+0000 7f3073b2e640 1 -- 172.21.15.38:0/1934313089 shutdown_connections 2023-12-22T08:40:13.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.800+0000 7f3073b2e640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f306c15e740 0x7f306c151a70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.800+0000 7f3073b2e640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f306c0b3f90 0x7f306c13c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.800+0000 7f3073b2e640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f305006a490 0x7f305006c950 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.800+0000 7f3073b2e640 1 --2- 172.21.15.38:0/1934313089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f306c06ca50 0x7f306c139fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:13.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.800+0000 7f3073b2e640 1 -- 172.21.15.38:0/1934313089 >> 172.21.15.38:0/1934313089 conn(0x7f306c0cfea0 msgr2=0x7f306c160f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:13.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.800+0000 7f3073b2e640 1 -- 172.21.15.38:0/1934313089 shutdown_connections 2023-12-22T08:40:13.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:13.800+0000 7f3073b2e640 1 -- 172.21.15.38:0/1934313089 wait complete. 2023-12-22T08:40:13.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-12-22T08:40:13.808 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:13.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-12-22T08:40:13.819 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:13.819 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-22T08:40:13.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:40:14.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.074+0000 7f4451d2c640 1 Processor -- start 2023-12-22T08:40:14.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.074+0000 7f4451d2c640 1 -- start start 2023-12-22T08:40:14.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.075+0000 7f4451d2c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f444c15b420 0x7f444c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:14.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.075+0000 7f4451d2c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c071000 0x7f444c15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:14.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.075+0000 7f4451d2c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444c0cdae0 con 0x7f444c0a44a0 2023-12-22T08:40:14.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.075+0000 7f4451d2c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444c06dec0 con 0x7f444c15b420 2023-12-22T08:40:14.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.075+0000 7f4451d2c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c15b800 con 0x7f444c071000 2023-12-22T08:40:14.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.075+0000 7f4450d2a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f444c15b420 0x7f444c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:14.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.075+0000 7f4450d2a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f444c15b420 0x7f444c06d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35044/0 (socket says 172.21.15.38:35044) 2023-12-22T08:40:14.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.075+0000 7f4450d2a640 1 -- 172.21.15.38:0/565698064 learned_addr learned my addr 172.21.15.38:0/565698064 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:14.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.076+0000 7f445152b640 1 --2- 172.21.15.38:0/565698064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c071000 0x7f444c15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:14.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.076+0000 7f4450d2a640 1 -- 172.21.15.38:0/565698064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c071000 msgr2=0x7f444c15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:14.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.076+0000 7f4450d2a640 1 --2- 172.21.15.38:0/565698064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c071000 0x7f444c15baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.076+0000 7f4450d2a640 1 -- 172.21.15.38:0/565698064 >> v1:172.21.15.89:6789/0 conn(0x7f444c0a44a0 legacy=0x7f444c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:14.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.076+0000 7f4450d2a640 1 -- 172.21.15.38:0/565698064 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0cdd30 con 0x7f444c15b420 2023-12-22T08:40:14.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.077+0000 7f4450d2a640 1 --2- 172.21.15.38:0/565698064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c15b420 0x7f444c06d980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f443c009870 tx=0x7f443c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f9d172f0662580 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:14.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.077+0000 7f444b7fe640 1 -- 172.21.15.38:0/565698064 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c031640 con 0x7f444c15b420 2023-12-22T08:40:14.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.077+0000 7f444b7fe640 1 -- 172.21.15.38:0/565698064 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c0317a0 con 0x7f444c15b420 2023-12-22T08:40:14.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.077+0000 7f444b7fe640 1 -- 172.21.15.38:0/565698064 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c031b30 con 0x7f444c15b420 2023-12-22T08:40:14.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.078+0000 7f4451d2c640 1 -- 172.21.15.38:0/565698064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c15b420 msgr2=0x7f444c06d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:14.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.078+0000 7f4451d2c640 1 --2- 172.21.15.38:0/565698064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c15b420 0x7f444c06d980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f443c009870 tx=0x7f443c02b8f0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.078+0000 7f4451d2c640 1 -- 172.21.15.38:0/565698064 shutdown_connections 2023-12-22T08:40:14.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.078+0000 7f4451d2c640 1 --2- 172.21.15.38:0/565698064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c071000 0x7f444c15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.078+0000 7f4451d2c640 1 --2- 172.21.15.38:0/565698064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c15b420 0x7f444c06d980 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.078+0000 7f4451d2c640 1 -- 172.21.15.38:0/565698064 >> 172.21.15.38:0/565698064 conn(0x7f444c0b1f70 msgr2=0x7f444c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:14.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.078+0000 7f4451d2c640 1 -- 172.21.15.38:0/565698064 shutdown_connections 2023-12-22T08:40:14.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.078+0000 7f4451d2c640 1 -- 172.21.15.38:0/565698064 wait complete. 2023-12-22T08:40:14.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.080+0000 7f4451d2c640 1 Processor -- start 2023-12-22T08:40:14.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.080+0000 7f4451d2c640 1 -- start start 2023-12-22T08:40:14.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.081+0000 7f4451d2c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c071000 0x7f444c154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.081+0000 7f4451d2c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c0a44a0 0x7f444c1492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.081+0000 7f4451d2c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f444c15b420 0x7f444c0a28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.081+0000 7f4451d2c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0a2df0 con 0x7f444c0a44a0 2023-12-22T08:40:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.081+0000 7f4451d2c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c1f2dc0 con 0x7f444c15b420 2023-12-22T08:40:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.081+0000 7f4451d2c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c1f3de0 con 0x7f444c071000 2023-12-22T08:40:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.081+0000 7f444bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c0a44a0 0x7f444c1492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.082+0000 7f444bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c0a44a0 0x7f444c1492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35054/0 (socket says 172.21.15.38:35054) 2023-12-22T08:40:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.082+0000 7f444bfff640 1 -- 172.21.15.38:0/2390962397 learned_addr learned my addr 172.21.15.38:0/2390962397 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.082+0000 7f4450d2a640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c071000 0x7f444c154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.082+0000 7f445152b640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f444c15b420 0x7f444c0a28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.082+0000 7f444bfff640 1 -- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c071000 msgr2=0x7f444c154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.082+0000 7f444bfff640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c071000 0x7f444c154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.082+0000 7f444bfff640 1 -- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f444c15b420 msgr2=0x7f444c0a28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:14.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.082+0000 7f444bfff640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f444c15b420 0x7f444c0a28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.082+0000 7f444bfff640 1 -- 172.21.15.38:0/2390962397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c0094d0 con 0x7f444c0a44a0 2023-12-22T08:40:14.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.082+0000 7f445152b640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f444c15b420 0x7f444c0a28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:14.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.082+0000 7f444bfff640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c0a44a0 0x7f444c1492e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f444000b9e0 tx=0x7f444000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:14.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.082+0000 7f44497fa640 1 -- 172.21.15.38:0/2390962397 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444000cba0 con 0x7f444c0a44a0 2023-12-22T08:40:14.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.083+0000 7f44497fa640 1 -- 172.21.15.38:0/2390962397 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444000cd00 con 0x7f444c0a44a0 2023-12-22T08:40:14.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.083+0000 7f44497fa640 1 -- 172.21.15.38:0/2390962397 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440014680 con 0x7f444c0a44a0 2023-12-22T08:40:14.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.083+0000 7f4451d2c640 1 -- 172.21.15.38:0/2390962397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444c1517d0 con 0x7f444c0a44a0 2023-12-22T08:40:14.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.083+0000 7f4451d2c640 1 -- 172.21.15.38:0/2390962397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f444c1f3300 con 0x7f444c0a44a0 2023-12-22T08:40:14.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.084+0000 7f4451d2c640 1 -- 172.21.15.38:0/2390962397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444c061910 con 0x7f444c0a44a0 2023-12-22T08:40:14.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.084+0000 7f44497fa640 1 -- 172.21.15.38:0/2390962397 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f44400147e0 con 0x7f444c0a44a0 2023-12-22T08:40:14.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.085+0000 7f44497fa640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f443806a430 0x7f443806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:14.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.085+0000 7f44497fa640 1 -- 172.21.15.38:0/2390962397 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4440088870 con 0x7f444c0a44a0 2023-12-22T08:40:14.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.086+0000 7f4450d2a640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f443806a430 0x7f443806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:14.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.087+0000 7f4450d2a640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f443806a430 0x7f443806c8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f443c036000 tx=0x7f443c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:14.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.090+0000 7f44497fa640 1 -- 172.21.15.38:0/2390962397 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4440053e60 con 0x7f444c0a44a0 2023-12-22T08:40:14.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.274+0000 7f4451d2c640 1 -- 172.21.15.38:0/2390962397 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f444c0ce2f0 con 0x7f443806a430 2023-12-22T08:40:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.295+0000 7f44497fa640 1 -- 172.21.15.38:0/2390962397 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260046 (secure 0 0 0) 0x7f443c0315e0 con 0x7f443806a430 2023-12-22T08:40:14.301 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:40:14.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.300+0000 7f4451d2c640 1 -- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f443806a430 msgr2=0x7f443806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.300+0000 7f4451d2c640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f443806a430 0x7f443806c8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f443c036000 tx=0x7f443c03c040 comp rx=0 tx=0).stop 2023-12-22T08:40:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.300+0000 7f4451d2c640 1 -- 172.21.15.38:0/2390962397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c0a44a0 msgr2=0x7f444c1492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.300+0000 7f4451d2c640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c0a44a0 0x7f444c1492e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f444000b9e0 tx=0x7f444000bea0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.300+0000 7f4451d2c640 1 -- 172.21.15.38:0/2390962397 shutdown_connections 2023-12-22T08:40:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.300+0000 7f4451d2c640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f444c15b420 0x7f444c0a28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.300+0000 7f4451d2c640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f443806a430 0x7f443806c8f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.300+0000 7f4451d2c640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f444c0a44a0 0x7f444c1492e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.300+0000 7f4451d2c640 1 --2- 172.21.15.38:0/2390962397 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f444c071000 0x7f444c154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.300+0000 7f4451d2c640 1 -- 172.21.15.38:0/2390962397 >> 172.21.15.38:0/2390962397 conn(0x7f444c0b1f70 msgr2=0x7f444c06c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.300+0000 7f4451d2c640 1 -- 172.21.15.38:0/2390962397 shutdown_connections 2023-12-22T08:40:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.300+0000 7f4451d2c640 1 -- 172.21.15.38:0/2390962397 wait complete. 2023-12-22T08:40:14.320 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-22T08:40:12.358771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560790,"statfs":{"total":1600000000,"available":1598249655,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004778"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641233+0000","last_change":"2023-12-22T08:39:58.637334+0000","last_active":"2023-12-22T08:39:58.641233+0000","last_peered":"2023-12-22T08:39:58.641233+0000","last_clean":"2023-12-22T08:39:58.641233+0000","last_became_active":"2023-12-22T08:39:58.633668+0000","last_became_peered":"2023-12-22T08:39:58.633668+0000","last_unstale":"2023-12-22T08:39:58.641233+0000","last_undegraded":"2023-12-22T08:39:58.641233+0000","last_fullsized":"2023-12-22T08:39:58.641233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.638651+0000","last_change":"2023-12-22T08:39:58.638511+0000","last_active":"2023-12-22T08:39:58.638651+0000","last_peered":"2023-12-22T08:39:58.638651+0000","last_clean":"2023-12-22T08:39:58.638651+0000","last_became_active":"2023-12-22T08:39:58.638133+0000","last_became_peered":"2023-12-22T08:39:58.638133+0000","last_unstale":"2023-12-22T08:39:58.638651+0000","last_undegraded":"2023-12-22T08:39:58.638651+0000","last_fullsized":"2023-12-22T08:39:58.638651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626853+0000","last_change":"2023-12-22T08:39:58.624493+0000","last_active":"2023-12-22T08:39:58.626853+0000","last_peered":"2023-12-22T08:39:58.626853+0000","last_clean":"2023-12-22T08:39:58.626853+0000","last_became_active":"2023-12-22T08:39:58.624182+0000","last_became_peered":"2023-12-22T08:39:58.624182+0000","last_unstale":"2023-12-22T08:39:58.626853+0000","last_undegraded":"2023-12-22T08:39:58.626853+0000","last_fullsized":"2023-12-22T08:39:58.626853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.622961+0000","last_change":"2023-12-22T08:39:58.622751+0000","last_active":"2023-12-22T08:39:58.622961+0000","last_peered":"2023-12-22T08:39:58.622961+0000","last_clean":"2023-12-22T08:39:58.622961+0000","last_became_active":"2023-12-22T08:39:58.622558+0000","last_became_peered":"2023-12-22T08:39:58.622558+0000","last_unstale":"2023-12-22T08:39:58.622961+0000","last_undegraded":"2023-12-22T08:39:58.622961+0000","last_fullsized":"2023-12-22T08:39:58.622961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643514+0000","last_change":"2023-12-22T08:39:58.643416+0000","last_active":"2023-12-22T08:39:58.643514+0000","last_peered":"2023-12-22T08:39:58.643514+0000","last_clean":"2023-12-22T08:39:58.643514+0000","last_became_active":"2023-12-22T08:39:58.641676+0000","last_became_peered":"2023-12-22T08:39:58.641676+0000","last_unstale":"2023-12-22T08:39:58.643514+0000","last_undegraded":"2023-12-22T08:39:58.643514+0000","last_fullsized":"2023-12-22T08:39:58.643514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628427+0000","last_change":"2023-12-22T08:39:58.627296+0000","last_active":"2023-12-22T08:39:58.628427+0000","last_peered":"2023-12-22T08:39:58.628427+0000","last_clean":"2023-12-22T08:39:58.628427+0000","last_became_active":"2023-12-22T08:39:58.626081+0000","last_became_peered":"2023-12-22T08:39:58.626081+0000","last_unstale":"2023-12-22T08:39:58.628427+0000","last_undegraded":"2023-12-22T08:39:58.628427+0000","last_fullsized":"2023-12-22T08:39:58.628427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632558+0000","last_change":"2023-12-22T08:39:58.627560+0000","last_active":"2023-12-22T08:39:58.632558+0000","last_peered":"2023-12-22T08:39:58.632558+0000","last_clean":"2023-12-22T08:39:58.632558+0000","last_became_active":"2023-12-22T08:39:58.627301+0000","last_became_peered":"2023-12-22T08:39:58.627301+0000","last_unstale":"2023-12-22T08:39:58.632558+0000","last_undegraded":"2023-12-22T08:39:58.632558+0000","last_fullsized":"2023-12-22T08:39:58.632558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635551+0000","last_change":"2023-12-22T08:39:58.635478+0000","last_active":"2023-12-22T08:39:58.635551+0000","last_peered":"2023-12-22T08:39:58.635551+0000","last_clean":"2023-12-22T08:39:58.635551+0000","last_became_active":"2023-12-22T08:39:58.634102+0000","last_became_peered":"2023-12-22T08:39:58.634102+0000","last_unstale":"2023-12-22T08:39:58.635551+0000","last_undegraded":"2023-12-22T08:39:58.635551+0000","last_fullsized":"2023-12-22T08:39:58.635551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628795+0000","last_change":"2023-12-22T08:39:58.627844+0000","last_active":"2023-12-22T08:39:58.628795+0000","last_peered":"2023-12-22T08:39:58.628795+0000","last_clean":"2023-12-22T08:39:58.628795+0000","last_became_active":"2023-12-22T08:39:58.627437+0000","last_became_peered":"2023-12-22T08:39:58.627437+0000","last_unstale":"2023-12-22T08:39:58.628795+0000","last_undegraded":"2023-12-22T08:39:58.628795+0000","last_fullsized":"2023-12-22T08:39:58.628795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643969+0000","last_change":"2023-12-22T08:39:58.643662+0000","last_active":"2023-12-22T08:39:58.643969+0000","last_peered":"2023-12-22T08:39:58.643969+0000","last_clean":"2023-12-22T08:39:58.643969+0000","last_became_active":"2023-12-22T08:39:58.642844+0000","last_became_peered":"2023-12-22T08:39:58.642844+0000","last_unstale":"2023-12-22T08:39:58.643969+0000","last_undegraded":"2023-12-22T08:39:58.643969+0000","last_fullsized":"2023-12-22T08:39:58.643969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634533+0000","last_change":"2023-12-22T08:39:58.633899+0000","last_active":"2023-12-22T08:39:58.634533+0000","last_peered":"2023-12-22T08:39:58.634533+0000","last_clean":"2023-12-22T08:39:58.634533+0000","last_became_active":"2023-12-22T08:39:58.633388+0000","last_became_peered":"2023-12-22T08:39:58.633388+0000","last_unstale":"2023-12-22T08:39:58.634533+0000","last_undegraded":"2023-12-22T08:39:58.634533+0000","last_fullsized":"2023-12-22T08:39:58.634533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641187+0000","last_change":"2023-12-22T08:39:58.635496+0000","last_active":"2023-12-22T08:39:58.641187+0000","last_peered":"2023-12-22T08:39:58.641187+0000","last_clean":"2023-12-22T08:39:58.641187+0000","last_became_active":"2023-12-22T08:39:58.635138+0000","last_became_peered":"2023-12-22T08:39:58.635138+0000","last_unstale":"2023-12-22T08:39:58.641187+0000","last_undegraded":"2023-12-22T08:39:58.641187+0000","last_fullsized":"2023-12-22T08:39:58.641187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642527+0000","last_change":"2023-12-22T08:39:58.642430+0000","last_active":"2023-12-22T08:39:58.642527+0000","last_peered":"2023-12-22T08:39:58.642527+0000","last_clean":"2023-12-22T08:39:58.642527+0000","last_became_active":"2023-12-22T08:39:58.642158+0000","last_became_peered":"2023-12-22T08:39:58.642158+0000","last_unstale":"2023-12-22T08:39:58.642527+0000","last_undegraded":"2023-12-22T08:39:58.642527+0000","last_fullsized":"2023-12-22T08:39:58.642527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633485+0000","last_change":"2023-12-22T08:39:58.632386+0000","last_active":"2023-12-22T08:39:58.633485+0000","last_peered":"2023-12-22T08:39:58.633485+0000","last_clean":"2023-12-22T08:39:58.633485+0000","last_became_active":"2023-12-22T08:39:58.632076+0000","last_became_peered":"2023-12-22T08:39:58.632076+0000","last_unstale":"2023-12-22T08:39:58.633485+0000","last_undegraded":"2023-12-22T08:39:58.633485+0000","last_fullsized":"2023-12-22T08:39:58.633485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642784+0000","last_change":"2023-12-22T08:39:58.642703+0000","last_active":"2023-12-22T08:39:58.642784+0000","last_peered":"2023-12-22T08:39:58.642784+0000","last_clean":"2023-12-22T08:39:58.642784+0000","last_became_active":"2023-12-22T08:39:58.642445+0000","last_became_peered":"2023-12-22T08:39:58.642445+0000","last_unstale":"2023-12-22T08:39:58.642784+0000","last_undegraded":"2023-12-22T08:39:58.642784+0000","last_fullsized":"2023-12-22T08:39:58.642784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632403+0000","last_change":"2023-12-22T08:39:58.631912+0000","last_active":"2023-12-22T08:39:58.632403+0000","last_peered":"2023-12-22T08:39:58.632403+0000","last_clean":"2023-12-22T08:39:58.632403+0000","last_became_active":"2023-12-22T08:39:58.631582+0000","last_became_peered":"2023-12-22T08:39:58.631582+0000","last_unstale":"2023-12-22T08:39:58.632403+0000","last_undegraded":"2023-12-22T08:39:58.632403+0000","last_fullsized":"2023-12-22T08:39:58.632403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631724+0000","last_change":"2023-12-22T08:39:58.631577+0000","last_active":"2023-12-22T08:39:58.631724+0000","last_peered":"2023-12-22T08:39:58.631724+0000","last_clean":"2023-12-22T08:39:58.631724+0000","last_became_active":"2023-12-22T08:39:58.630007+0000","last_became_peered":"2023-12-22T08:39:58.630007+0000","last_unstale":"2023-12-22T08:39:58.631724+0000","last_undegraded":"2023-12-22T08:39:58.631724+0000","last_fullsized":"2023-12-22T08:39:58.631724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631082+0000","last_change":"2023-12-22T08:39:58.630931+0000","last_active":"2023-12-22T08:39:58.631082+0000","last_peered":"2023-12-22T08:39:58.631082+0000","last_clean":"2023-12-22T08:39:58.631082+0000","last_became_active":"2023-12-22T08:39:58.629526+0000","last_became_peered":"2023-12-22T08:39:58.629526+0000","last_unstale":"2023-12-22T08:39:58.631082+0000","last_undegraded":"2023-12-22T08:39:58.631082+0000","last_fullsized":"2023-12-22T08:39:58.631082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625568+0000","last_change":"2023-12-22T08:39:58.625439+0000","last_active":"2023-12-22T08:39:58.625568+0000","last_peered":"2023-12-22T08:39:58.625568+0000","last_clean":"2023-12-22T08:39:58.625568+0000","last_became_active":"2023-12-22T08:39:58.625072+0000","last_became_peered":"2023-12-22T08:39:58.625072+0000","last_unstale":"2023-12-22T08:39:58.625568+0000","last_undegraded":"2023-12-22T08:39:58.625568+0000","last_fullsized":"2023-12-22T08:39:58.625568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:24:09.483177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643984+0000","last_change":"2023-12-22T08:39:58.643819+0000","last_active":"2023-12-22T08:39:58.643984+0000","last_peered":"2023-12-22T08:39:58.643984+0000","last_clean":"2023-12-22T08:39:58.643984+0000","last_became_active":"2023-12-22T08:39:58.643147+0000","last_became_peered":"2023-12-22T08:39:58.643147+0000","last_unstale":"2023-12-22T08:39:58.643984+0000","last_undegraded":"2023-12-22T08:39:58.643984+0000","last_fullsized":"2023-12-22T08:39:58.643984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630682+0000","last_change":"2023-12-22T08:39:58.630595+0000","last_active":"2023-12-22T08:39:58.630682+0000","last_peered":"2023-12-22T08:39:58.630682+0000","last_clean":"2023-12-22T08:39:58.630682+0000","last_became_active":"2023-12-22T08:39:58.630241+0000","last_became_peered":"2023-12-22T08:39:58.630241+0000","last_unstale":"2023-12-22T08:39:58.630682+0000","last_undegraded":"2023-12-22T08:39:58.630682+0000","last_fullsized":"2023-12-22T08:39:58.630682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629920+0000","last_change":"2023-12-22T08:39:58.629733+0000","last_active":"2023-12-22T08:39:58.629920+0000","last_peered":"2023-12-22T08:39:58.629920+0000","last_clean":"2023-12-22T08:39:58.629920+0000","last_became_active":"2023-12-22T08:39:58.629485+0000","last_became_peered":"2023-12-22T08:39:58.629485+0000","last_unstale":"2023-12-22T08:39:58.629920+0000","last_undegraded":"2023-12-22T08:39:58.629920+0000","last_fullsized":"2023-12-22T08:39:58.629920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.618810+0000","last_change":"2023-12-22T08:39:58.618183+0000","last_active":"2023-12-22T08:39:58.618810+0000","last_peered":"2023-12-22T08:39:58.618810+0000","last_clean":"2023-12-22T08:39:58.618810+0000","last_became_active":"2023-12-22T08:39:58.617884+0000","last_became_peered":"2023-12-22T08:39:58.617884+0000","last_unstale":"2023-12-22T08:39:58.618810+0000","last_undegraded":"2023-12-22T08:39:58.618810+0000","last_fullsized":"2023-12-22T08:39:58.618810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619546+0000","last_change":"2023-12-22T08:39:58.619439+0000","last_active":"2023-12-22T08:39:58.619546+0000","last_peered":"2023-12-22T08:39:58.619546+0000","last_clean":"2023-12-22T08:39:58.619546+0000","last_became_active":"2023-12-22T08:39:58.617801+0000","last_became_peered":"2023-12-22T08:39:58.617801+0000","last_unstale":"2023-12-22T08:39:58.619546+0000","last_undegraded":"2023-12-22T08:39:58.619546+0000","last_fullsized":"2023-12-22T08:39:58.619546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:22.933973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623909+0000","last_change":"2023-12-22T08:39:58.621731+0000","last_active":"2023-12-22T08:39:58.623909+0000","last_peered":"2023-12-22T08:39:58.623909+0000","last_clean":"2023-12-22T08:39:58.623909+0000","last_became_active":"2023-12-22T08:39:58.621245+0000","last_became_peered":"2023-12-22T08:39:58.621245+0000","last_unstale":"2023-12-22T08:39:58.623909+0000","last_undegraded":"2023-12-22T08:39:58.623909+0000","last_fullsized":"2023-12-22T08:39:58.623909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.622887+0000","last_change":"2023-12-22T08:39:58.621295+0000","last_active":"2023-12-22T08:39:58.622887+0000","last_peered":"2023-12-22T08:39:58.622887+0000","last_clean":"2023-12-22T08:39:58.622887+0000","last_became_active":"2023-12-22T08:39:58.621071+0000","last_became_peered":"2023-12-22T08:39:58.621071+0000","last_unstale":"2023-12-22T08:39:58.622887+0000","last_undegraded":"2023-12-22T08:39:58.622887+0000","last_fullsized":"2023-12-22T08:39:58.622887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635278+0000","last_change":"2023-12-22T08:39:58.635200+0000","last_active":"2023-12-22T08:39:58.635278+0000","last_peered":"2023-12-22T08:39:58.635278+0000","last_clean":"2023-12-22T08:39:58.635278+0000","last_became_active":"2023-12-22T08:39:58.634590+0000","last_became_peered":"2023-12-22T08:39:58.634590+0000","last_unstale":"2023-12-22T08:39:58.635278+0000","last_undegraded":"2023-12-22T08:39:58.635278+0000","last_fullsized":"2023-12-22T08:39:58.635278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635766+0000","last_change":"2023-12-22T08:39:58.635639+0000","last_active":"2023-12-22T08:39:58.635766+0000","last_peered":"2023-12-22T08:39:58.635766+0000","last_clean":"2023-12-22T08:39:58.635766+0000","last_became_active":"2023-12-22T08:39:58.634556+0000","last_became_peered":"2023-12-22T08:39:58.634556+0000","last_unstale":"2023-12-22T08:39:58.635766+0000","last_undegraded":"2023-12-22T08:39:58.635766+0000","last_fullsized":"2023-12-22T08:39:58.635766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:59:30.195380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619288+0000","last_change":"2023-12-22T08:39:58.619128+0000","last_active":"2023-12-22T08:39:58.619288+0000","last_peered":"2023-12-22T08:39:58.619288+0000","last_clean":"2023-12-22T08:39:58.619288+0000","last_became_active":"2023-12-22T08:39:58.618488+0000","last_became_peered":"2023-12-22T08:39:58.618488+0000","last_unstale":"2023-12-22T08:39:58.619288+0000","last_undegraded":"2023-12-22T08:39:58.619288+0000","last_fullsized":"2023-12-22T08:39:58.619288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.617164+0000","last_change":"2023-12-22T08:39:58.616544+0000","last_active":"2023-12-22T08:39:58.617164+0000","last_peered":"2023-12-22T08:39:58.617164+0000","last_clean":"2023-12-22T08:39:58.617164+0000","last_became_active":"2023-12-22T08:39:58.616182+0000","last_became_peered":"2023-12-22T08:39:58.616182+0000","last_unstale":"2023-12-22T08:39:58.617164+0000","last_undegraded":"2023-12-22T08:39:58.617164+0000","last_fullsized":"2023-12-22T08:39:58.617164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:13:34.205933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.627549+0000","last_change":"2023-12-22T08:39:58.627478+0000","last_active":"2023-12-22T08:39:58.627549+0000","last_peered":"2023-12-22T08:39:58.627549+0000","last_clean":"2023-12-22T08:39:58.627549+0000","last_became_active":"2023-12-22T08:39:58.626043+0000","last_became_peered":"2023-12-22T08:39:58.626043+0000","last_unstale":"2023-12-22T08:39:58.627549+0000","last_undegraded":"2023-12-22T08:39:58.627549+0000","last_fullsized":"2023-12-22T08:39:58.627549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639910+0000","last_change":"2023-12-22T08:39:58.638489+0000","last_active":"2023-12-22T08:39:58.639910+0000","last_peered":"2023-12-22T08:39:58.639910+0000","last_clean":"2023-12-22T08:39:58.639910+0000","last_became_active":"2023-12-22T08:39:58.638260+0000","last_became_peered":"2023-12-22T08:39:58.638260+0000","last_unstale":"2023-12-22T08:39:58.639910+0000","last_undegraded":"2023-12-22T08:39:58.639910+0000","last_fullsized":"2023-12-22T08:39:58.639910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628825+0000","last_change":"2023-12-22T08:39:58.628717+0000","last_active":"2023-12-22T08:39:58.628825+0000","last_peered":"2023-12-22T08:39:58.628825+0000","last_clean":"2023-12-22T08:39:58.628825+0000","last_became_active":"2023-12-22T08:39:58.628336+0000","last_became_peered":"2023-12-22T08:39:58.628336+0000","last_unstale":"2023-12-22T08:39:58.628825+0000","last_undegraded":"2023-12-22T08:39:58.628825+0000","last_fullsized":"2023-12-22T08:39:58.628825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.638316+0000","last_change":"2023-12-22T08:39:58.118326+0000","last_active":"2023-12-22T08:39:58.638316+0000","last_peered":"2023-12-22T08:39:58.638316+0000","last_clean":"2023-12-22T08:39:58.638316+0000","last_became_active":"2023-12-22T08:39:58.117693+0000","last_became_peered":"2023-12-22T08:39:58.117693+0000","last_unstale":"2023-12-22T08:39:58.638316+0000","last_undegraded":"2023-12-22T08:39:58.638316+0000","last_fullsized":"2023-12-22T08:39:58.638316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639287+0000","last_change":"2023-12-22T08:39:58.637716+0000","last_active":"2023-12-22T08:39:58.639287+0000","last_peered":"2023-12-22T08:39:58.639287+0000","last_clean":"2023-12-22T08:39:58.639287+0000","last_became_active":"2023-12-22T08:39:58.637494+0000","last_became_peered":"2023-12-22T08:39:58.637494+0000","last_unstale":"2023-12-22T08:39:58.639287+0000","last_undegraded":"2023-12-22T08:39:58.639287+0000","last_fullsized":"2023-12-22T08:39:58.639287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642478+0000","last_change":"2023-12-22T08:39:58.124015+0000","last_active":"2023-12-22T08:39:58.642478+0000","last_peered":"2023-12-22T08:39:58.642478+0000","last_clean":"2023-12-22T08:39:58.642478+0000","last_became_active":"2023-12-22T08:39:58.123750+0000","last_became_peered":"2023-12-22T08:39:58.123750+0000","last_unstale":"2023-12-22T08:39:58.642478+0000","last_undegraded":"2023-12-22T08:39:58.642478+0000","last_fullsized":"2023-12-22T08:39:58.642478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:32.352283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631688+0000","last_change":"2023-12-22T08:39:58.126588+0000","last_active":"2023-12-22T08:39:58.631688+0000","last_peered":"2023-12-22T08:39:58.631688+0000","last_clean":"2023-12-22T08:39:58.631688+0000","last_became_active":"2023-12-22T08:39:58.126277+0000","last_became_peered":"2023-12-22T08:39:58.126277+0000","last_unstale":"2023-12-22T08:39:58.631688+0000","last_undegraded":"2023-12-22T08:39:58.631688+0000","last_fullsized":"2023-12-22T08:39:58.631688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631434+0000","last_change":"2023-12-22T08:39:58.631377+0000","last_active":"2023-12-22T08:39:58.631434+0000","last_peered":"2023-12-22T08:39:58.631434+0000","last_clean":"2023-12-22T08:39:58.631434+0000","last_became_active":"2023-12-22T08:39:58.630993+0000","last_became_peered":"2023-12-22T08:39:58.630993+0000","last_unstale":"2023-12-22T08:39:58.631434+0000","last_undegraded":"2023-12-22T08:39:58.631434+0000","last_fullsized":"2023-12-22T08:39:58.631434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:26:26.790794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.612908+0000","last_change":"2023-12-22T08:39:58.129064+0000","last_active":"2023-12-22T08:39:58.612908+0000","last_peered":"2023-12-22T08:39:58.612908+0000","last_clean":"2023-12-22T08:39:58.612908+0000","last_became_active":"2023-12-22T08:39:58.127921+0000","last_became_peered":"2023-12-22T08:39:58.127921+0000","last_unstale":"2023-12-22T08:39:58.612908+0000","last_undegraded":"2023-12-22T08:39:58.612908+0000","last_fullsized":"2023-12-22T08:39:58.612908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632098+0000","last_change":"2023-12-22T08:39:58.631767+0000","last_active":"2023-12-22T08:39:58.632098+0000","last_peered":"2023-12-22T08:39:58.632098+0000","last_clean":"2023-12-22T08:39:58.632098+0000","last_became_active":"2023-12-22T08:39:58.629195+0000","last_became_peered":"2023-12-22T08:39:58.629195+0000","last_unstale":"2023-12-22T08:39:58.632098+0000","last_undegraded":"2023-12-22T08:39:58.632098+0000","last_fullsized":"2023-12-22T08:39:58.632098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.620316+0000","last_change":"2023-12-22T08:39:58.128425+0000","last_active":"2023-12-22T08:39:58.620316+0000","last_peered":"2023-12-22T08:39:58.620316+0000","last_clean":"2023-12-22T08:39:58.620316+0000","last_became_active":"2023-12-22T08:39:58.128139+0000","last_became_peered":"2023-12-22T08:39:58.128139+0000","last_unstale":"2023-12-22T08:39:58.620316+0000","last_undegraded":"2023-12-22T08:39:58.620316+0000","last_fullsized":"2023-12-22T08:39:58.620316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628459+0000","last_change":"2023-12-22T08:39:58.628264+0000","last_active":"2023-12-22T08:39:58.628459+0000","last_peered":"2023-12-22T08:39:58.628459+0000","last_clean":"2023-12-22T08:39:58.628459+0000","last_became_active":"2023-12-22T08:39:58.627878+0000","last_became_peered":"2023-12-22T08:39:58.627878+0000","last_unstale":"2023-12-22T08:39:58.628459+0000","last_undegraded":"2023-12-22T08:39:58.628459+0000","last_fullsized":"2023-12-22T08:39:58.628459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626441+0000","last_change":"2023-12-22T08:39:58.123417+0000","last_active":"2023-12-22T08:39:58.626441+0000","last_peered":"2023-12-22T08:39:58.626441+0000","last_clean":"2023-12-22T08:39:58.626441+0000","last_became_active":"2023-12-22T08:39:58.122926+0000","last_became_peered":"2023-12-22T08:39:58.122926+0000","last_unstale":"2023-12-22T08:39:58.626441+0000","last_undegraded":"2023-12-22T08:39:58.626441+0000","last_fullsized":"2023-12-22T08:39:58.626441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.616535+0000","last_change":"2023-12-22T08:39:58.616456+0000","last_active":"2023-12-22T08:39:58.616535+0000","last_peered":"2023-12-22T08:39:58.616535+0000","last_clean":"2023-12-22T08:39:58.616535+0000","last_became_active":"2023-12-22T08:39:58.616235+0000","last_became_peered":"2023-12-22T08:39:58.616235+0000","last_unstale":"2023-12-22T08:39:58.616535+0000","last_undegraded":"2023-12-22T08:39:58.616535+0000","last_fullsized":"2023-12-22T08:39:58.616535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:37.333505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635460+0000","last_change":"2023-12-22T08:39:58.129066+0000","last_active":"2023-12-22T08:39:58.635460+0000","last_peered":"2023-12-22T08:39:58.635460+0000","last_clean":"2023-12-22T08:39:58.635460+0000","last_became_active":"2023-12-22T08:39:58.128536+0000","last_became_peered":"2023-12-22T08:39:58.128536+0000","last_unstale":"2023-12-22T08:39:58.635460+0000","last_undegraded":"2023-12-22T08:39:58.635460+0000","last_fullsized":"2023-12-22T08:39:58.635460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629952+0000","last_change":"2023-12-22T08:39:58.629869+0000","last_active":"2023-12-22T08:39:58.629952+0000","last_peered":"2023-12-22T08:39:58.629952+0000","last_clean":"2023-12-22T08:39:58.629952+0000","last_became_active":"2023-12-22T08:39:58.629618+0000","last_became_peered":"2023-12-22T08:39:58.629618+0000","last_unstale":"2023-12-22T08:39:58.629952+0000","last_undegraded":"2023-12-22T08:39:58.629952+0000","last_fullsized":"2023-12-22T08:39:58.629952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:24:34.120013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642495+0000","last_change":"2023-12-22T08:39:58.126247+0000","last_active":"2023-12-22T08:39:58.642495+0000","last_peered":"2023-12-22T08:39:58.642495+0000","last_clean":"2023-12-22T08:39:58.642495+0000","last_became_active":"2023-12-22T08:39:58.125863+0000","last_became_peered":"2023-12-22T08:39:58.125863+0000","last_unstale":"2023-12-22T08:39:58.642495+0000","last_undegraded":"2023-12-22T08:39:58.642495+0000","last_fullsized":"2023-12-22T08:39:58.642495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641409+0000","last_change":"2023-12-22T08:39:58.641015+0000","last_active":"2023-12-22T08:39:58.641409+0000","last_peered":"2023-12-22T08:39:58.641409+0000","last_clean":"2023-12-22T08:39:58.641409+0000","last_became_active":"2023-12-22T08:39:58.640705+0000","last_became_peered":"2023-12-22T08:39:58.640705+0000","last_unstale":"2023-12-22T08:39:58.641409+0000","last_undegraded":"2023-12-22T08:39:58.641409+0000","last_fullsized":"2023-12-22T08:39:58.641409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642932+0000","last_change":"2023-12-22T08:39:58.123764+0000","last_active":"2023-12-22T08:39:58.642932+0000","last_peered":"2023-12-22T08:39:58.642932+0000","last_clean":"2023-12-22T08:39:58.642932+0000","last_became_active":"2023-12-22T08:39:58.123431+0000","last_became_peered":"2023-12-22T08:39:58.123431+0000","last_unstale":"2023-12-22T08:39:58.642932+0000","last_undegraded":"2023-12-22T08:39:58.642932+0000","last_fullsized":"2023-12-22T08:39:58.642932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634178+0000","last_change":"2023-12-22T08:39:58.634043+0000","last_active":"2023-12-22T08:39:58.634178+0000","last_peered":"2023-12-22T08:39:58.634178+0000","last_clean":"2023-12-22T08:39:58.634178+0000","last_became_active":"2023-12-22T08:39:58.633774+0000","last_became_peered":"2023-12-22T08:39:58.633774+0000","last_unstale":"2023-12-22T08:39:58.634178+0000","last_undegraded":"2023-12-22T08:39:58.634178+0000","last_fullsized":"2023-12-22T08:39:58.634178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.614467+0000","last_change":"2023-12-22T08:39:58.124254+0000","last_active":"2023-12-22T08:39:58.614467+0000","last_peered":"2023-12-22T08:39:58.614467+0000","last_clean":"2023-12-22T08:39:58.614467+0000","last_became_active":"2023-12-22T08:39:58.123937+0000","last_became_peered":"2023-12-22T08:39:58.123937+0000","last_unstale":"2023-12-22T08:39:58.614467+0000","last_undegraded":"2023-12-22T08:39:58.614467+0000","last_fullsized":"2023-12-22T08:39:58.614467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.644230+0000","last_change":"2023-12-22T08:39:58.644158+0000","last_active":"2023-12-22T08:39:58.644230+0000","last_peered":"2023-12-22T08:39:58.644230+0000","last_clean":"2023-12-22T08:39:58.644230+0000","last_became_active":"2023-12-22T08:39:58.643919+0000","last_became_peered":"2023-12-22T08:39:58.643919+0000","last_unstale":"2023-12-22T08:39:58.644230+0000","last_undegraded":"2023-12-22T08:39:58.644230+0000","last_fullsized":"2023-12-22T08:39:58.644230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:16.702062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626541+0000","last_change":"2023-12-22T08:39:58.130462+0000","last_active":"2023-12-22T08:39:58.626541+0000","last_peered":"2023-12-22T08:39:58.626541+0000","last_clean":"2023-12-22T08:39:58.626541+0000","last_became_active":"2023-12-22T08:39:58.130246+0000","last_became_peered":"2023-12-22T08:39:58.130246+0000","last_unstale":"2023-12-22T08:39:58.626541+0000","last_undegraded":"2023-12-22T08:39:58.626541+0000","last_fullsized":"2023-12-22T08:39:58.626541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628811+0000","last_change":"2023-12-22T08:39:58.628587+0000","last_active":"2023-12-22T08:39:58.628811+0000","last_peered":"2023-12-22T08:39:58.628811+0000","last_clean":"2023-12-22T08:39:58.628811+0000","last_became_active":"2023-12-22T08:39:58.626918+0000","last_became_peered":"2023-12-22T08:39:58.626918+0000","last_unstale":"2023-12-22T08:39:58.628811+0000","last_undegraded":"2023-12-22T08:39:58.628811+0000","last_fullsized":"2023-12-22T08:39:58.628811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641108+0000","last_change":"2023-12-22T08:39:58.127791+0000","last_active":"2023-12-22T08:39:58.641108+0000","last_peered":"2023-12-22T08:39:58.641108+0000","last_clean":"2023-12-22T08:39:58.641108+0000","last_became_active":"2023-12-22T08:39:58.126674+0000","last_became_peered":"2023-12-22T08:39:58.126674+0000","last_unstale":"2023-12-22T08:39:58.641108+0000","last_undegraded":"2023-12-22T08:39:58.641108+0000","last_fullsized":"2023-12-22T08:39:58.641108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632387+0000","last_change":"2023-12-22T08:39:58.631847+0000","last_active":"2023-12-22T08:39:58.632387+0000","last_peered":"2023-12-22T08:39:58.632387+0000","last_clean":"2023-12-22T08:39:58.632387+0000","last_became_active":"2023-12-22T08:39:58.631202+0000","last_became_peered":"2023-12-22T08:39:58.631202+0000","last_unstale":"2023-12-22T08:39:58.632387+0000","last_undegraded":"2023-12-22T08:39:58.632387+0000","last_fullsized":"2023-12-22T08:39:58.632387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:53:42.342046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643020+0000","last_change":"2023-12-22T08:39:58.131328+0000","last_active":"2023-12-22T08:39:58.643020+0000","last_peered":"2023-12-22T08:39:58.643020+0000","last_clean":"2023-12-22T08:39:58.643020+0000","last_became_active":"2023-12-22T08:39:58.131102+0000","last_became_peered":"2023-12-22T08:39:58.131102+0000","last_unstale":"2023-12-22T08:39:58.643020+0000","last_undegraded":"2023-12-22T08:39:58.643020+0000","last_fullsized":"2023-12-22T08:39:58.643020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.644219+0000","last_change":"2023-12-22T08:39:58.644149+0000","last_active":"2023-12-22T08:39:58.644219+0000","last_peered":"2023-12-22T08:39:58.644219+0000","last_clean":"2023-12-22T08:39:58.644219+0000","last_became_active":"2023-12-22T08:39:58.643782+0000","last_became_peered":"2023-12-22T08:39:58.643782+0000","last_unstale":"2023-12-22T08:39:58.644219+0000","last_undegraded":"2023-12-22T08:39:58.644219+0000","last_fullsized":"2023-12-22T08:39:58.644219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639405+0000","last_change":"2023-12-22T08:39:58.128619+0000","last_active":"2023-12-22T08:39:58.639405+0000","last_peered":"2023-12-22T08:39:58.639405+0000","last_clean":"2023-12-22T08:39:58.639405+0000","last_became_active":"2023-12-22T08:39:58.128357+0000","last_became_peered":"2023-12-22T08:39:58.128357+0000","last_unstale":"2023-12-22T08:39:58.639405+0000","last_undegraded":"2023-12-22T08:39:58.639405+0000","last_fullsized":"2023-12-22T08:39:58.639405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634241+0000","last_change":"2023-12-22T08:39:58.633374+0000","last_active":"2023-12-22T08:39:58.634241+0000","last_peered":"2023-12-22T08:39:58.634241+0000","last_clean":"2023-12-22T08:39:58.634241+0000","last_became_active":"2023-12-22T08:39:58.633140+0000","last_became_peered":"2023-12-22T08:39:58.633140+0000","last_unstale":"2023-12-22T08:39:58.634241+0000","last_undegraded":"2023-12-22T08:39:58.634241+0000","last_fullsized":"2023-12-22T08:39:58.634241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632780+0000","last_change":"2023-12-22T08:39:58.124679+0000","last_active":"2023-12-22T08:39:58.632780+0000","last_peered":"2023-12-22T08:39:58.632780+0000","last_clean":"2023-12-22T08:39:58.632780+0000","last_became_active":"2023-12-22T08:39:58.124446+0000","last_became_peered":"2023-12-22T08:39:58.124446+0000","last_unstale":"2023-12-22T08:39:58.632780+0000","last_undegraded":"2023-12-22T08:39:58.632780+0000","last_fullsized":"2023-12-22T08:39:58.632780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635014+0000","last_change":"2023-12-22T08:39:58.634622+0000","last_active":"2023-12-22T08:39:58.635014+0000","last_peered":"2023-12-22T08:39:58.635014+0000","last_clean":"2023-12-22T08:39:58.635014+0000","last_became_active":"2023-12-22T08:39:58.627769+0000","last_became_peered":"2023-12-22T08:39:58.627769+0000","last_unstale":"2023-12-22T08:39:58.635014+0000","last_undegraded":"2023-12-22T08:39:58.635014+0000","last_fullsized":"2023-12-22T08:39:58.635014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625945+0000","last_change":"2023-12-22T08:39:58.125976+0000","last_active":"2023-12-22T08:39:58.625945+0000","last_peered":"2023-12-22T08:39:58.625945+0000","last_clean":"2023-12-22T08:39:58.625945+0000","last_became_active":"2023-12-22T08:39:58.125728+0000","last_became_peered":"2023-12-22T08:39:58.125728+0000","last_unstale":"2023-12-22T08:39:58.625945+0000","last_undegraded":"2023-12-22T08:39:58.625945+0000","last_fullsized":"2023-12-22T08:39:58.625945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623852+0000","last_change":"2023-12-22T08:39:58.623592+0000","last_active":"2023-12-22T08:39:58.623852+0000","last_peered":"2023-12-22T08:39:58.623852+0000","last_clean":"2023-12-22T08:39:58.623852+0000","last_became_active":"2023-12-22T08:39:58.623129+0000","last_became_peered":"2023-12-22T08:39:58.623129+0000","last_unstale":"2023-12-22T08:39:58.623852+0000","last_undegraded":"2023-12-22T08:39:58.623852+0000","last_fullsized":"2023-12-22T08:39:58.623852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.618653+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:39:58.618653+0000","last_peered":"2023-12-22T08:39:58.618653+0000","last_clean":"2023-12-22T08:39:58.618653+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:39:58.618653+0000","last_undegraded":"2023-12-22T08:39:58.618653+0000","last_fullsized":"2023-12-22T08:39:58.618653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.614777+0000","last_change":"2023-12-22T08:39:58.128257+0000","last_active":"2023-12-22T08:39:58.614777+0000","last_peered":"2023-12-22T08:39:58.614777+0000","last_clean":"2023-12-22T08:39:58.614777+0000","last_became_active":"2023-12-22T08:39:58.127185+0000","last_became_peered":"2023-12-22T08:39:58.127185+0000","last_unstale":"2023-12-22T08:39:58.614777+0000","last_undegraded":"2023-12-22T08:39:58.614777+0000","last_fullsized":"2023-12-22T08:39:58.614777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:34.256489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630391+0000","last_change":"2023-12-22T08:39:58.630318+0000","last_active":"2023-12-22T08:39:58.630391+0000","last_peered":"2023-12-22T08:39:58.630391+0000","last_clean":"2023-12-22T08:39:58.630391+0000","last_became_active":"2023-12-22T08:39:58.630077+0000","last_became_peered":"2023-12-22T08:39:58.630077+0000","last_unstale":"2023-12-22T08:39:58.630391+0000","last_undegraded":"2023-12-22T08:39:58.630391+0000","last_fullsized":"2023-12-22T08:39:58.630391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.616306+0000","last_change":"2023-12-22T08:39:58.109900+0000","last_active":"2023-12-22T08:39:58.616306+0000","last_peered":"2023-12-22T08:39:58.616306+0000","last_clean":"2023-12-22T08:39:58.616306+0000","last_became_active":"2023-12-22T08:39:58.109127+0000","last_became_peered":"2023-12-22T08:39:58.109127+0000","last_unstale":"2023-12-22T08:39:58.616306+0000","last_undegraded":"2023-12-22T08:39:58.616306+0000","last_fullsized":"2023-12-22T08:39:58.616306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635903+0000","last_change":"2023-12-22T08:39:58.635825+0000","last_active":"2023-12-22T08:39:58.635903+0000","last_peered":"2023-12-22T08:39:58.635903+0000","last_clean":"2023-12-22T08:39:58.635903+0000","last_became_active":"2023-12-22T08:39:58.635203+0000","last_became_peered":"2023-12-22T08:39:58.635203+0000","last_unstale":"2023-12-22T08:39:58.635903+0000","last_undegraded":"2023-12-22T08:39:58.635903+0000","last_fullsized":"2023-12-22T08:39:58.635903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.617739+0000","last_change":"2023-12-22T08:39:58.128822+0000","last_active":"2023-12-22T08:39:58.617739+0000","last_peered":"2023-12-22T08:39:58.617739+0000","last_clean":"2023-12-22T08:39:58.617739+0000","last_became_active":"2023-12-22T08:39:58.128142+0000","last_became_peered":"2023-12-22T08:39:58.128142+0000","last_unstale":"2023-12-22T08:39:58.617739+0000","last_undegraded":"2023-12-22T08:39:58.617739+0000","last_fullsized":"2023-12-22T08:39:58.617739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619266+0000","last_change":"2023-12-22T08:39:58.618953+0000","last_active":"2023-12-22T08:39:58.619266+0000","last_peered":"2023-12-22T08:39:58.619266+0000","last_clean":"2023-12-22T08:39:58.619266+0000","last_became_active":"2023-12-22T08:39:58.618178+0000","last_became_peered":"2023-12-22T08:39:58.618178+0000","last_unstale":"2023-12-22T08:39:58.619266+0000","last_undegraded":"2023-12-22T08:39:58.619266+0000","last_fullsized":"2023-12-22T08:39:58.619266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.612537+0000","last_change":"2023-12-22T08:39:58.109274+0000","last_active":"2023-12-22T08:39:58.612537+0000","last_peered":"2023-12-22T08:39:58.612537+0000","last_clean":"2023-12-22T08:39:58.612537+0000","last_became_active":"2023-12-22T08:39:58.108715+0000","last_became_peered":"2023-12-22T08:39:58.108715+0000","last_unstale":"2023-12-22T08:39:58.612537+0000","last_undegraded":"2023-12-22T08:39:58.612537+0000","last_fullsized":"2023-12-22T08:39:58.612537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641249+0000","last_change":"2023-12-22T08:39:58.640517+0000","last_active":"2023-12-22T08:39:58.641249+0000","last_peered":"2023-12-22T08:39:58.641249+0000","last_clean":"2023-12-22T08:39:58.641249+0000","last_became_active":"2023-12-22T08:39:58.640288+0000","last_became_peered":"2023-12-22T08:39:58.640288+0000","last_unstale":"2023-12-22T08:39:58.641249+0000","last_undegraded":"2023-12-22T08:39:58.641249+0000","last_fullsized":"2023-12-22T08:39:58.641249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.611243+0000","last_change":"2023-12-22T08:39:58.127367+0000","last_active":"2023-12-22T08:39:58.611243+0000","last_peered":"2023-12-22T08:39:58.611243+0000","last_clean":"2023-12-22T08:39:58.611243+0000","last_became_active":"2023-12-22T08:39:58.124150+0000","last_became_peered":"2023-12-22T08:39:58.124150+0000","last_unstale":"2023-12-22T08:39:58.611243+0000","last_undegraded":"2023-12-22T08:39:58.611243+0000","last_fullsized":"2023-12-22T08:39:58.611243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.636519+0000","last_change":"2023-12-22T08:39:58.636058+0000","last_active":"2023-12-22T08:39:58.636519+0000","last_peered":"2023-12-22T08:39:58.636519+0000","last_clean":"2023-12-22T08:39:58.636519+0000","last_became_active":"2023-12-22T08:39:58.635817+0000","last_became_peered":"2023-12-22T08:39:58.635817+0000","last_unstale":"2023-12-22T08:39:58.636519+0000","last_undegraded":"2023-12-22T08:39:58.636519+0000","last_fullsized":"2023-12-22T08:39:58.636519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.615958+0000","last_change":"2023-12-22T08:39:58.128760+0000","last_active":"2023-12-22T08:39:58.615958+0000","last_peered":"2023-12-22T08:39:58.615958+0000","last_clean":"2023-12-22T08:39:58.615958+0000","last_became_active":"2023-12-22T08:39:58.128499+0000","last_became_peered":"2023-12-22T08:39:58.128499+0000","last_unstale":"2023-12-22T08:39:58.615958+0000","last_undegraded":"2023-12-22T08:39:58.615958+0000","last_fullsized":"2023-12-22T08:39:58.615958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:15.265494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633467+0000","last_change":"2023-12-22T08:39:58.630593+0000","last_active":"2023-12-22T08:39:58.633467+0000","last_peered":"2023-12-22T08:39:58.633467+0000","last_clean":"2023-12-22T08:39:58.633467+0000","last_became_active":"2023-12-22T08:39:58.629117+0000","last_became_peered":"2023-12-22T08:39:58.629117+0000","last_unstale":"2023-12-22T08:39:58.633467+0000","last_undegraded":"2023-12-22T08:39:58.633467+0000","last_fullsized":"2023-12-22T08:39:58.633467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:39:59.613300+0000","last_change":"2023-12-22T08:39:58.129601+0000","last_active":"2023-12-22T08:39:59.613300+0000","last_peered":"2023-12-22T08:39:59.613300+0000","last_clean":"2023-12-22T08:39:59.613300+0000","last_became_active":"2023-12-22T08:39:58.129236+0000","last_became_peered":"2023-12-22T08:39:58.129236+0000","last_unstale":"2023-12-22T08:39:59.613300+0000","last_undegraded":"2023-12-22T08:39:59.613300+0000","last_fullsized":"2023-12-22T08:39:59.613300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639661+0000","last_change":"2023-12-22T08:39:58.639582+0000","last_active":"2023-12-22T08:39:58.639661+0000","last_peered":"2023-12-22T08:39:58.639661+0000","last_clean":"2023-12-22T08:39:58.639661+0000","last_became_active":"2023-12-22T08:39:58.638759+0000","last_became_peered":"2023-12-22T08:39:58.638759+0000","last_unstale":"2023-12-22T08:39:58.639661+0000","last_undegraded":"2023-12-22T08:39:58.639661+0000","last_fullsized":"2023-12-22T08:39:58.639661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642267+0000","last_change":"2023-12-22T08:39:58.127199+0000","last_active":"2023-12-22T08:39:58.642267+0000","last_peered":"2023-12-22T08:39:58.642267+0000","last_clean":"2023-12-22T08:39:58.642267+0000","last_became_active":"2023-12-22T08:39:58.126735+0000","last_became_peered":"2023-12-22T08:39:58.126735+0000","last_unstale":"2023-12-22T08:39:58.642267+0000","last_undegraded":"2023-12-22T08:39:58.642267+0000","last_fullsized":"2023-12-22T08:39:58.642267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:12.048994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.627309+0000","last_change":"2023-12-22T08:39:58.627233+0000","last_active":"2023-12-22T08:39:58.627309+0000","last_peered":"2023-12-22T08:39:58.627309+0000","last_clean":"2023-12-22T08:39:58.627309+0000","last_became_active":"2023-12-22T08:39:58.626937+0000","last_became_peered":"2023-12-22T08:39:58.626937+0000","last_unstale":"2023-12-22T08:39:58.627309+0000","last_undegraded":"2023-12-22T08:39:58.627309+0000","last_fullsized":"2023-12-22T08:39:58.627309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625536+0000","last_change":"2023-12-22T08:39:58.125513+0000","last_active":"2023-12-22T08:39:58.625536+0000","last_peered":"2023-12-22T08:39:58.625536+0000","last_clean":"2023-12-22T08:39:58.625536+0000","last_became_active":"2023-12-22T08:39:58.125286+0000","last_became_peered":"2023-12-22T08:39:58.125286+0000","last_unstale":"2023-12-22T08:39:58.625536+0000","last_undegraded":"2023-12-22T08:39:58.625536+0000","last_fullsized":"2023-12-22T08:39:58.625536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623822+0000","last_change":"2023-12-22T08:39:58.622884+0000","last_active":"2023-12-22T08:39:58.623822+0000","last_peered":"2023-12-22T08:39:58.623822+0000","last_clean":"2023-12-22T08:39:58.623822+0000","last_became_active":"2023-12-22T08:39:58.622531+0000","last_became_peered":"2023-12-22T08:39:58.622531+0000","last_unstale":"2023-12-22T08:39:58.623822+0000","last_undegraded":"2023-12-22T08:39:58.623822+0000","last_fullsized":"2023-12-22T08:39:58.623822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:01.993745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.620792+0000","last_change":"2023-12-22T08:39:58.127163+0000","last_active":"2023-12-22T08:39:58.620792+0000","last_peered":"2023-12-22T08:39:58.620792+0000","last_clean":"2023-12-22T08:39:58.620792+0000","last_became_active":"2023-12-22T08:39:58.125842+0000","last_became_peered":"2023-12-22T08:39:58.125842+0000","last_unstale":"2023-12-22T08:39:58.620792+0000","last_undegraded":"2023-12-22T08:39:58.620792+0000","last_fullsized":"2023-12-22T08:39:58.620792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629967+0000","last_change":"2023-12-22T08:39:58.628998+0000","last_active":"2023-12-22T08:39:58.629967+0000","last_peered":"2023-12-22T08:39:58.629967+0000","last_clean":"2023-12-22T08:39:58.629967+0000","last_became_active":"2023-12-22T08:39:58.628022+0000","last_became_peered":"2023-12-22T08:39:58.628022+0000","last_unstale":"2023-12-22T08:39:58.629967+0000","last_undegraded":"2023-12-22T08:39:58.629967+0000","last_fullsized":"2023-12-22T08:39:58.629967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631814+0000","last_change":"2023-12-22T08:39:58.129742+0000","last_active":"2023-12-22T08:39:58.631814+0000","last_peered":"2023-12-22T08:39:58.631814+0000","last_clean":"2023-12-22T08:39:58.631814+0000","last_became_active":"2023-12-22T08:39:58.129522+0000","last_became_peered":"2023-12-22T08:39:58.129522+0000","last_unstale":"2023-12-22T08:39:58.631814+0000","last_undegraded":"2023-12-22T08:39:58.631814+0000","last_fullsized":"2023-12-22T08:39:58.631814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.636842+0000","last_change":"2023-12-22T08:39:58.636766+0000","last_active":"2023-12-22T08:39:58.636842+0000","last_peered":"2023-12-22T08:39:58.636842+0000","last_clean":"2023-12-22T08:39:58.636842+0000","last_became_active":"2023-12-22T08:39:58.636550+0000","last_became_peered":"2023-12-22T08:39:58.636550+0000","last_unstale":"2023-12-22T08:39:58.636842+0000","last_undegraded":"2023-12-22T08:39:58.636842+0000","last_fullsized":"2023-12-22T08:39:58.636842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.637828+0000","last_change":"2023-12-22T08:39:58.128411+0000","last_active":"2023-12-22T08:39:58.637828+0000","last_peered":"2023-12-22T08:39:58.637828+0000","last_clean":"2023-12-22T08:39:58.637828+0000","last_became_active":"2023-12-22T08:39:58.127849+0000","last_became_peered":"2023-12-22T08:39:58.127849+0000","last_unstale":"2023-12-22T08:39:58.637828+0000","last_undegraded":"2023-12-22T08:39:58.637828+0000","last_fullsized":"2023-12-22T08:39:58.637828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:25.721681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.624467+0000","last_change":"2023-12-22T08:39:58.624131+0000","last_active":"2023-12-22T08:39:58.624467+0000","last_peered":"2023-12-22T08:39:58.624467+0000","last_clean":"2023-12-22T08:39:58.624467+0000","last_became_active":"2023-12-22T08:39:58.621786+0000","last_became_peered":"2023-12-22T08:39:58.621786+0000","last_unstale":"2023-12-22T08:39:58.624467+0000","last_undegraded":"2023-12-22T08:39:58.624467+0000","last_fullsized":"2023-12-22T08:39:58.624467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642965+0000","last_change":"2023-12-22T08:39:58.642425+0000","last_active":"2023-12-22T08:39:58.642965+0000","last_peered":"2023-12-22T08:39:58.642965+0000","last_clean":"2023-12-22T08:39:58.642965+0000","last_became_active":"2023-12-22T08:39:58.642201+0000","last_became_peered":"2023-12-22T08:39:58.642201+0000","last_unstale":"2023-12-22T08:39:58.642965+0000","last_undegraded":"2023-12-22T08:39:58.642965+0000","last_fullsized":"2023-12-22T08:39:58.642965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:35.423369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643104+0000","last_change":"2023-12-22T08:39:58.124586+0000","last_active":"2023-12-22T08:39:58.643104+0000","last_peered":"2023-12-22T08:39:58.643104+0000","last_clean":"2023-12-22T08:39:58.643104+0000","last_became_active":"2023-12-22T08:39:58.123428+0000","last_became_peered":"2023-12-22T08:39:58.123428+0000","last_unstale":"2023-12-22T08:39:58.643104+0000","last_undegraded":"2023-12-22T08:39:58.643104+0000","last_fullsized":"2023-12-22T08:39:58.643104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630950+0000","last_change":"2023-12-22T08:39:58.630694+0000","last_active":"2023-12-22T08:39:58.630950+0000","last_peered":"2023-12-22T08:39:58.630950+0000","last_clean":"2023-12-22T08:39:58.630950+0000","last_became_active":"2023-12-22T08:39:58.630420+0000","last_became_peered":"2023-12-22T08:39:58.630420+0000","last_unstale":"2023-12-22T08:39:58.630950+0000","last_undegraded":"2023-12-22T08:39:58.630950+0000","last_fullsized":"2023-12-22T08:39:58.630950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.645513+0000","last_change":"2023-12-22T08:39:58.129551+0000","last_active":"2023-12-22T08:39:58.645513+0000","last_peered":"2023-12-22T08:39:58.645513+0000","last_clean":"2023-12-22T08:39:58.645513+0000","last_became_active":"2023-12-22T08:39:58.129237+0000","last_became_peered":"2023-12-22T08:39:58.129237+0000","last_unstale":"2023-12-22T08:39:58.645513+0000","last_undegraded":"2023-12-22T08:39:58.645513+0000","last_fullsized":"2023-12-22T08:39:58.645513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623969+0000","last_change":"2023-12-22T08:39:58.623889+0000","last_active":"2023-12-22T08:39:58.623969+0000","last_peered":"2023-12-22T08:39:58.623969+0000","last_clean":"2023-12-22T08:39:58.623969+0000","last_became_active":"2023-12-22T08:39:58.621334+0000","last_became_peered":"2023-12-22T08:39:58.621334+0000","last_unstale":"2023-12-22T08:39:58.623969+0000","last_undegraded":"2023-12-22T08:39:58.623969+0000","last_fullsized":"2023-12-22T08:39:58.623969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:58:42.417309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633418+0000","last_change":"2023-12-22T08:39:58.127899+0000","last_active":"2023-12-22T08:39:58.633418+0000","last_peered":"2023-12-22T08:39:58.633418+0000","last_clean":"2023-12-22T08:39:58.633418+0000","last_became_active":"2023-12-22T08:39:58.126733+0000","last_became_peered":"2023-12-22T08:39:58.126733+0000","last_unstale":"2023-12-22T08:39:58.633418+0000","last_undegraded":"2023-12-22T08:39:58.633418+0000","last_fullsized":"2023-12-22T08:39:58.633418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623951+0000","last_change":"2023-12-22T08:39:58.623648+0000","last_active":"2023-12-22T08:39:58.623951+0000","last_peered":"2023-12-22T08:39:58.623951+0000","last_clean":"2023-12-22T08:39:58.623951+0000","last_became_active":"2023-12-22T08:39:58.623415+0000","last_became_peered":"2023-12-22T08:39:58.623415+0000","last_unstale":"2023-12-22T08:39:58.623951+0000","last_undegraded":"2023-12-22T08:39:58.623951+0000","last_fullsized":"2023-12-22T08:39:58.623951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639516+0000","last_change":"2023-12-22T08:39:58.130439+0000","last_active":"2023-12-22T08:39:58.639516+0000","last_peered":"2023-12-22T08:39:58.639516+0000","last_clean":"2023-12-22T08:39:58.639516+0000","last_became_active":"2023-12-22T08:39:58.130196+0000","last_became_peered":"2023-12-22T08:39:58.130196+0000","last_unstale":"2023-12-22T08:39:58.639516+0000","last_undegraded":"2023-12-22T08:39:58.639516+0000","last_fullsized":"2023-12-22T08:39:58.639516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194667,"statfs":{"total":200000000,"available":199339821,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3479999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1779999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2210000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.383}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.863}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]}]}],"pool_statfs":[]}} 2023-12-22T08:40:14.324 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:40:14.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.590+0000 7f82da0b2640 1 Processor -- start 2023-12-22T08:40:14.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.590+0000 7f82da0b2640 1 -- start start 2023-12-22T08:40:14.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.591+0000 7f82da0b2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d406d210 0x7f82d415e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:14.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.591+0000 7f82da0b2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f82d406d5f0 0x7f82d4070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:14.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.591+0000 7f82da0b2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d40706d0 con 0x7f82d40cb4c0 2023-12-22T08:40:14.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.591+0000 7f82da0b2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d40cbf40 con 0x7f82d406d5f0 2023-12-22T08:40:14.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.591+0000 7f82da0b2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d40ce840 con 0x7f82d406d210 2023-12-22T08:40:14.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.592+0000 7f82d90b0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d406d210 0x7f82d415e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:14.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.592+0000 7f82d90b0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d406d210 0x7f82d415e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:56284/0 (socket says 172.21.15.38:56284) 2023-12-22T08:40:14.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.592+0000 7f82d90b0640 1 -- 172.21.15.38:0/1234818583 learned_addr learned my addr 172.21.15.38:0/1234818583 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:14.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.592+0000 7f82d98b1640 1 --2- 172.21.15.38:0/1234818583 >> v2:172.21.15.89:3300/0 conn(0x7f82d406d5f0 0x7f82d4070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:14.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.593+0000 7f82d90b0640 1 -- 172.21.15.38:0/1234818583 >> v2:172.21.15.89:3300/0 conn(0x7f82d406d5f0 msgr2=0x7f82d4070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:14.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.593+0000 7f82d90b0640 1 --2- 172.21.15.38:0/1234818583 >> v2:172.21.15.89:3300/0 conn(0x7f82d406d5f0 0x7f82d4070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.593+0000 7f82d90b0640 1 -- 172.21.15.38:0/1234818583 >> v1:172.21.15.89:6789/0 conn(0x7f82d40cb4c0 legacy=0x7f82d4159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:14.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.593+0000 7f82d90b0640 1 -- 172.21.15.38:0/1234818583 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d40ceb20 con 0x7f82d406d210 2023-12-22T08:40:14.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.593+0000 7f82cbfff640 1 -- 172.21.15.38:0/1234818583 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24516440 0 0) 0x7f82d40706d0 con 0x7f82d40cb4c0 2023-12-22T08:40:14.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.594+0000 7f82d90b0640 1 --2- 172.21.15.38:0/1234818583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d406d210 0x7f82d415e830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009870 tx=0x7f82d002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcf8b811e6193a3b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:14.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.595+0000 7f82cbfff640 1 -- 172.21.15.38:0/1234818583 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0030840 con 0x7f82d406d210 2023-12-22T08:40:14.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.595+0000 7f82cbfff640 1 -- 172.21.15.38:0/1234818583 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d00309a0 con 0x7f82d406d210 2023-12-22T08:40:14.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.595+0000 7f82cbfff640 1 -- 172.21.15.38:0/1234818583 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0030d30 con 0x7f82d406d210 2023-12-22T08:40:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.595+0000 7f82da0b2640 1 -- 172.21.15.38:0/1234818583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d406d210 msgr2=0x7f82d415e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.595+0000 7f82da0b2640 1 --2- 172.21.15.38:0/1234818583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d406d210 0x7f82d415e830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009870 tx=0x7f82d002b980 comp rx=0 tx=0).stop 2023-12-22T08:40:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.595+0000 7f82da0b2640 1 -- 172.21.15.38:0/1234818583 shutdown_connections 2023-12-22T08:40:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.595+0000 7f82da0b2640 1 --2- 172.21.15.38:0/1234818583 >> v2:172.21.15.89:3300/0 conn(0x7f82d406d5f0 0x7f82d4070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.595+0000 7f82da0b2640 1 --2- 172.21.15.38:0/1234818583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d406d210 0x7f82d415e830 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.595+0000 7f82da0b2640 1 -- 172.21.15.38:0/1234818583 >> 172.21.15.38:0/1234818583 conn(0x7f82d40b1f70 msgr2=0x7f82d40b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.596+0000 7f82da0b2640 1 -- 172.21.15.38:0/1234818583 shutdown_connections 2023-12-22T08:40:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.596+0000 7f82da0b2640 1 -- 172.21.15.38:0/1234818583 wait complete. 2023-12-22T08:40:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.597+0000 7f82da0b2640 1 Processor -- start 2023-12-22T08:40:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.598+0000 7f82da0b2640 1 -- start start 2023-12-22T08:40:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82da0b2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d406d210 0x7f82d4157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82da0b2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d406d5f0 0x7f82d414ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82da0b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d40cb4c0 0x7f82d406f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82da0b2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d40a0350 con 0x7f82d406d5f0 2023-12-22T08:40:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82da0b2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d4157eb0 con 0x7f82d40cb4c0 2023-12-22T08:40:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82da0b2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d415d2f0 con 0x7f82d406d210 2023-12-22T08:40:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82d88af640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d406d5f0 0x7f82d414ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82d88af640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d406d5f0 0x7f82d414ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35062/0 (socket says 172.21.15.38:35062) 2023-12-22T08:40:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82d88af640 1 -- 172.21.15.38:0/2036825611 learned_addr learned my addr 172.21.15.38:0/2036825611 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82d98b1640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d40cb4c0 0x7f82d406f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82d90b0640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d406d210 0x7f82d4157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82d88af640 1 -- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d406d210 msgr2=0x7f82d4157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82d88af640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d406d210 0x7f82d4157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82d88af640 1 -- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d40cb4c0 msgr2=0x7f82d406f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.599+0000 7f82d88af640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d40cb4c0 0x7f82d406f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.600+0000 7f82d88af640 1 -- 172.21.15.38:0/2036825611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d00094d0 con 0x7f82d406d5f0 2023-12-22T08:40:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.600+0000 7f82d88af640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d406d5f0 0x7f82d414ce80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f82c400c410 tx=0x7f82c400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.600+0000 7f82c9ffb640 1 -- 172.21.15.38:0/2036825611 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40035f0 con 0x7f82d406d5f0 2023-12-22T08:40:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.600+0000 7f82c9ffb640 1 -- 172.21.15.38:0/2036825611 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c4003770 con 0x7f82d406d5f0 2023-12-22T08:40:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.600+0000 7f82c9ffb640 1 -- 172.21.15.38:0/2036825611 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4003b20 con 0x7f82d406d5f0 2023-12-22T08:40:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.600+0000 7f82da0b2640 1 -- 172.21.15.38:0/2036825611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d415d5d0 con 0x7f82d406d5f0 2023-12-22T08:40:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.600+0000 7f82da0b2640 1 -- 172.21.15.38:0/2036825611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d40a26e0 con 0x7f82d406d5f0 2023-12-22T08:40:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.601+0000 7f82da0b2640 1 -- 172.21.15.38:0/2036825611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d40a0500 con 0x7f82d406d5f0 2023-12-22T08:40:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.602+0000 7f82c9ffb640 1 -- 172.21.15.38:0/2036825611 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f82c4003c80 con 0x7f82d406d5f0 2023-12-22T08:40:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.603+0000 7f82c9ffb640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f82b806a430 0x7f82b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.603+0000 7f82c9ffb640 1 -- 172.21.15.38:0/2036825611 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82c4087fd0 con 0x7f82d406d5f0 2023-12-22T08:40:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.604+0000 7f82d90b0640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f82b806a430 0x7f82b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:14.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.605+0000 7f82d90b0640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f82b806a430 0x7f82b806c8f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82d0036000 tx=0x7f82d0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:14.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.608+0000 7f82c9ffb640 1 -- 172.21.15.38:0/2036825611 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f82c4053520 con 0x7f82d406d5f0 2023-12-22T08:40:14.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.793+0000 7f82da0b2640 1 -- 172.21.15.38:0/2036825611 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82d415a3f0 con 0x7f82b806a430 2023-12-22T08:40:14.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.814+0000 7f82c9ffb640 1 -- 172.21.15.38:0/2036825611 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260059 (secure 0 0 0) 0x7f82d0044470 con 0x7f82b806a430 2023-12-22T08:40:14.820 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:14.821 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:40:14.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.819+0000 7f82da0b2640 1 -- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f82b806a430 msgr2=0x7f82b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:14.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.819+0000 7f82da0b2640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f82b806a430 0x7f82b806c8f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82d0036000 tx=0x7f82d0008030 comp rx=0 tx=0).stop 2023-12-22T08:40:14.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.819+0000 7f82da0b2640 1 -- 172.21.15.38:0/2036825611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d406d5f0 msgr2=0x7f82d414ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:14.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.819+0000 7f82da0b2640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d406d5f0 0x7f82d414ce80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f82c400c410 tx=0x7f82c400c8d0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.819+0000 7f82da0b2640 1 -- 172.21.15.38:0/2036825611 shutdown_connections 2023-12-22T08:40:14.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.819+0000 7f82da0b2640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d40cb4c0 0x7f82d406f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.819+0000 7f82da0b2640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f82b806a430 0x7f82b806c8f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.819+0000 7f82da0b2640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82d406d5f0 0x7f82d414ce80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.819+0000 7f82da0b2640 1 --2- 172.21.15.38:0/2036825611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82d406d210 0x7f82d4157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:14.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.819+0000 7f82da0b2640 1 -- 172.21.15.38:0/2036825611 >> 172.21.15.38:0/2036825611 conn(0x7f82d40b1f70 msgr2=0x7f82d415e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:14.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.819+0000 7f82da0b2640 1 -- 172.21.15.38:0/2036825611 shutdown_connections 2023-12-22T08:40:14.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:14.819+0000 7f82da0b2640 1 -- 172.21.15.38:0/2036825611 wait complete. 2023-12-22T08:40:14.840 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-22T08:40:14.359756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1709,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560790,"statfs":{"total":1600000000,"available":1598249655,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005054"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641233+0000","last_change":"2023-12-22T08:39:58.637334+0000","last_active":"2023-12-22T08:39:58.641233+0000","last_peered":"2023-12-22T08:39:58.641233+0000","last_clean":"2023-12-22T08:39:58.641233+0000","last_became_active":"2023-12-22T08:39:58.633668+0000","last_became_peered":"2023-12-22T08:39:58.633668+0000","last_unstale":"2023-12-22T08:39:58.641233+0000","last_undegraded":"2023-12-22T08:39:58.641233+0000","last_fullsized":"2023-12-22T08:39:58.641233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.638651+0000","last_change":"2023-12-22T08:39:58.638511+0000","last_active":"2023-12-22T08:39:58.638651+0000","last_peered":"2023-12-22T08:39:58.638651+0000","last_clean":"2023-12-22T08:39:58.638651+0000","last_became_active":"2023-12-22T08:39:58.638133+0000","last_became_peered":"2023-12-22T08:39:58.638133+0000","last_unstale":"2023-12-22T08:39:58.638651+0000","last_undegraded":"2023-12-22T08:39:58.638651+0000","last_fullsized":"2023-12-22T08:39:58.638651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626853+0000","last_change":"2023-12-22T08:39:58.624493+0000","last_active":"2023-12-22T08:39:58.626853+0000","last_peered":"2023-12-22T08:39:58.626853+0000","last_clean":"2023-12-22T08:39:58.626853+0000","last_became_active":"2023-12-22T08:39:58.624182+0000","last_became_peered":"2023-12-22T08:39:58.624182+0000","last_unstale":"2023-12-22T08:39:58.626853+0000","last_undegraded":"2023-12-22T08:39:58.626853+0000","last_fullsized":"2023-12-22T08:39:58.626853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.622961+0000","last_change":"2023-12-22T08:39:58.622751+0000","last_active":"2023-12-22T08:39:58.622961+0000","last_peered":"2023-12-22T08:39:58.622961+0000","last_clean":"2023-12-22T08:39:58.622961+0000","last_became_active":"2023-12-22T08:39:58.622558+0000","last_became_peered":"2023-12-22T08:39:58.622558+0000","last_unstale":"2023-12-22T08:39:58.622961+0000","last_undegraded":"2023-12-22T08:39:58.622961+0000","last_fullsized":"2023-12-22T08:39:58.622961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643514+0000","last_change":"2023-12-22T08:39:58.643416+0000","last_active":"2023-12-22T08:39:58.643514+0000","last_peered":"2023-12-22T08:39:58.643514+0000","last_clean":"2023-12-22T08:39:58.643514+0000","last_became_active":"2023-12-22T08:39:58.641676+0000","last_became_peered":"2023-12-22T08:39:58.641676+0000","last_unstale":"2023-12-22T08:39:58.643514+0000","last_undegraded":"2023-12-22T08:39:58.643514+0000","last_fullsized":"2023-12-22T08:39:58.643514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628427+0000","last_change":"2023-12-22T08:39:58.627296+0000","last_active":"2023-12-22T08:39:58.628427+0000","last_peered":"2023-12-22T08:39:58.628427+0000","last_clean":"2023-12-22T08:39:58.628427+0000","last_became_active":"2023-12-22T08:39:58.626081+0000","last_became_peered":"2023-12-22T08:39:58.626081+0000","last_unstale":"2023-12-22T08:39:58.628427+0000","last_undegraded":"2023-12-22T08:39:58.628427+0000","last_fullsized":"2023-12-22T08:39:58.628427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632558+0000","last_change":"2023-12-22T08:39:58.627560+0000","last_active":"2023-12-22T08:39:58.632558+0000","last_peered":"2023-12-22T08:39:58.632558+0000","last_clean":"2023-12-22T08:39:58.632558+0000","last_became_active":"2023-12-22T08:39:58.627301+0000","last_became_peered":"2023-12-22T08:39:58.627301+0000","last_unstale":"2023-12-22T08:39:58.632558+0000","last_undegraded":"2023-12-22T08:39:58.632558+0000","last_fullsized":"2023-12-22T08:39:58.632558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635551+0000","last_change":"2023-12-22T08:39:58.635478+0000","last_active":"2023-12-22T08:39:58.635551+0000","last_peered":"2023-12-22T08:39:58.635551+0000","last_clean":"2023-12-22T08:39:58.635551+0000","last_became_active":"2023-12-22T08:39:58.634102+0000","last_became_peered":"2023-12-22T08:39:58.634102+0000","last_unstale":"2023-12-22T08:39:58.635551+0000","last_undegraded":"2023-12-22T08:39:58.635551+0000","last_fullsized":"2023-12-22T08:39:58.635551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628795+0000","last_change":"2023-12-22T08:39:58.627844+0000","last_active":"2023-12-22T08:39:58.628795+0000","last_peered":"2023-12-22T08:39:58.628795+0000","last_clean":"2023-12-22T08:39:58.628795+0000","last_became_active":"2023-12-22T08:39:58.627437+0000","last_became_peered":"2023-12-22T08:39:58.627437+0000","last_unstale":"2023-12-22T08:39:58.628795+0000","last_undegraded":"2023-12-22T08:39:58.628795+0000","last_fullsized":"2023-12-22T08:39:58.628795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643969+0000","last_change":"2023-12-22T08:39:58.643662+0000","last_active":"2023-12-22T08:39:58.643969+0000","last_peered":"2023-12-22T08:39:58.643969+0000","last_clean":"2023-12-22T08:39:58.643969+0000","last_became_active":"2023-12-22T08:39:58.642844+0000","last_became_peered":"2023-12-22T08:39:58.642844+0000","last_unstale":"2023-12-22T08:39:58.643969+0000","last_undegraded":"2023-12-22T08:39:58.643969+0000","last_fullsized":"2023-12-22T08:39:58.643969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634533+0000","last_change":"2023-12-22T08:39:58.633899+0000","last_active":"2023-12-22T08:39:58.634533+0000","last_peered":"2023-12-22T08:39:58.634533+0000","last_clean":"2023-12-22T08:39:58.634533+0000","last_became_active":"2023-12-22T08:39:58.633388+0000","last_became_peered":"2023-12-22T08:39:58.633388+0000","last_unstale":"2023-12-22T08:39:58.634533+0000","last_undegraded":"2023-12-22T08:39:58.634533+0000","last_fullsized":"2023-12-22T08:39:58.634533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641187+0000","last_change":"2023-12-22T08:39:58.635496+0000","last_active":"2023-12-22T08:39:58.641187+0000","last_peered":"2023-12-22T08:39:58.641187+0000","last_clean":"2023-12-22T08:39:58.641187+0000","last_became_active":"2023-12-22T08:39:58.635138+0000","last_became_peered":"2023-12-22T08:39:58.635138+0000","last_unstale":"2023-12-22T08:39:58.641187+0000","last_undegraded":"2023-12-22T08:39:58.641187+0000","last_fullsized":"2023-12-22T08:39:58.641187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642527+0000","last_change":"2023-12-22T08:39:58.642430+0000","last_active":"2023-12-22T08:39:58.642527+0000","last_peered":"2023-12-22T08:39:58.642527+0000","last_clean":"2023-12-22T08:39:58.642527+0000","last_became_active":"2023-12-22T08:39:58.642158+0000","last_became_peered":"2023-12-22T08:39:58.642158+0000","last_unstale":"2023-12-22T08:39:58.642527+0000","last_undegraded":"2023-12-22T08:39:58.642527+0000","last_fullsized":"2023-12-22T08:39:58.642527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633485+0000","last_change":"2023-12-22T08:39:58.632386+0000","last_active":"2023-12-22T08:39:58.633485+0000","last_peered":"2023-12-22T08:39:58.633485+0000","last_clean":"2023-12-22T08:39:58.633485+0000","last_became_active":"2023-12-22T08:39:58.632076+0000","last_became_peered":"2023-12-22T08:39:58.632076+0000","last_unstale":"2023-12-22T08:39:58.633485+0000","last_undegraded":"2023-12-22T08:39:58.633485+0000","last_fullsized":"2023-12-22T08:39:58.633485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642784+0000","last_change":"2023-12-22T08:39:58.642703+0000","last_active":"2023-12-22T08:39:58.642784+0000","last_peered":"2023-12-22T08:39:58.642784+0000","last_clean":"2023-12-22T08:39:58.642784+0000","last_became_active":"2023-12-22T08:39:58.642445+0000","last_became_peered":"2023-12-22T08:39:58.642445+0000","last_unstale":"2023-12-22T08:39:58.642784+0000","last_undegraded":"2023-12-22T08:39:58.642784+0000","last_fullsized":"2023-12-22T08:39:58.642784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:09.218330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632403+0000","last_change":"2023-12-22T08:39:58.631912+0000","last_active":"2023-12-22T08:39:58.632403+0000","last_peered":"2023-12-22T08:39:58.632403+0000","last_clean":"2023-12-22T08:39:58.632403+0000","last_became_active":"2023-12-22T08:39:58.631582+0000","last_became_peered":"2023-12-22T08:39:58.631582+0000","last_unstale":"2023-12-22T08:39:58.632403+0000","last_undegraded":"2023-12-22T08:39:58.632403+0000","last_fullsized":"2023-12-22T08:39:58.632403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:40:34.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631724+0000","last_change":"2023-12-22T08:39:58.631577+0000","last_active":"2023-12-22T08:39:58.631724+0000","last_peered":"2023-12-22T08:39:58.631724+0000","last_clean":"2023-12-22T08:39:58.631724+0000","last_became_active":"2023-12-22T08:39:58.630007+0000","last_became_peered":"2023-12-22T08:39:58.630007+0000","last_unstale":"2023-12-22T08:39:58.631724+0000","last_undegraded":"2023-12-22T08:39:58.631724+0000","last_fullsized":"2023-12-22T08:39:58.631724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631082+0000","last_change":"2023-12-22T08:39:58.630931+0000","last_active":"2023-12-22T08:39:58.631082+0000","last_peered":"2023-12-22T08:39:58.631082+0000","last_clean":"2023-12-22T08:39:58.631082+0000","last_became_active":"2023-12-22T08:39:58.629526+0000","last_became_peered":"2023-12-22T08:39:58.629526+0000","last_unstale":"2023-12-22T08:39:58.631082+0000","last_undegraded":"2023-12-22T08:39:58.631082+0000","last_fullsized":"2023-12-22T08:39:58.631082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625568+0000","last_change":"2023-12-22T08:39:58.625439+0000","last_active":"2023-12-22T08:39:58.625568+0000","last_peered":"2023-12-22T08:39:58.625568+0000","last_clean":"2023-12-22T08:39:58.625568+0000","last_became_active":"2023-12-22T08:39:58.625072+0000","last_became_peered":"2023-12-22T08:39:58.625072+0000","last_unstale":"2023-12-22T08:39:58.625568+0000","last_undegraded":"2023-12-22T08:39:58.625568+0000","last_fullsized":"2023-12-22T08:39:58.625568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:24:09.483177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643984+0000","last_change":"2023-12-22T08:39:58.643819+0000","last_active":"2023-12-22T08:39:58.643984+0000","last_peered":"2023-12-22T08:39:58.643984+0000","last_clean":"2023-12-22T08:39:58.643984+0000","last_became_active":"2023-12-22T08:39:58.643147+0000","last_became_peered":"2023-12-22T08:39:58.643147+0000","last_unstale":"2023-12-22T08:39:58.643984+0000","last_undegraded":"2023-12-22T08:39:58.643984+0000","last_fullsized":"2023-12-22T08:39:58.643984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630682+0000","last_change":"2023-12-22T08:39:58.630595+0000","last_active":"2023-12-22T08:39:58.630682+0000","last_peered":"2023-12-22T08:39:58.630682+0000","last_clean":"2023-12-22T08:39:58.630682+0000","last_became_active":"2023-12-22T08:39:58.630241+0000","last_became_peered":"2023-12-22T08:39:58.630241+0000","last_unstale":"2023-12-22T08:39:58.630682+0000","last_undegraded":"2023-12-22T08:39:58.630682+0000","last_fullsized":"2023-12-22T08:39:58.630682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629920+0000","last_change":"2023-12-22T08:39:58.629733+0000","last_active":"2023-12-22T08:39:58.629920+0000","last_peered":"2023-12-22T08:39:58.629920+0000","last_clean":"2023-12-22T08:39:58.629920+0000","last_became_active":"2023-12-22T08:39:58.629485+0000","last_became_peered":"2023-12-22T08:39:58.629485+0000","last_unstale":"2023-12-22T08:39:58.629920+0000","last_undegraded":"2023-12-22T08:39:58.629920+0000","last_fullsized":"2023-12-22T08:39:58.629920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.618810+0000","last_change":"2023-12-22T08:39:58.618183+0000","last_active":"2023-12-22T08:39:58.618810+0000","last_peered":"2023-12-22T08:39:58.618810+0000","last_clean":"2023-12-22T08:39:58.618810+0000","last_became_active":"2023-12-22T08:39:58.617884+0000","last_became_peered":"2023-12-22T08:39:58.617884+0000","last_unstale":"2023-12-22T08:39:58.618810+0000","last_undegraded":"2023-12-22T08:39:58.618810+0000","last_fullsized":"2023-12-22T08:39:58.618810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619546+0000","last_change":"2023-12-22T08:39:58.619439+0000","last_active":"2023-12-22T08:39:58.619546+0000","last_peered":"2023-12-22T08:39:58.619546+0000","last_clean":"2023-12-22T08:39:58.619546+0000","last_became_active":"2023-12-22T08:39:58.617801+0000","last_became_peered":"2023-12-22T08:39:58.617801+0000","last_unstale":"2023-12-22T08:39:58.619546+0000","last_undegraded":"2023-12-22T08:39:58.619546+0000","last_fullsized":"2023-12-22T08:39:58.619546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:22.933973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623909+0000","last_change":"2023-12-22T08:39:58.621731+0000","last_active":"2023-12-22T08:39:58.623909+0000","last_peered":"2023-12-22T08:39:58.623909+0000","last_clean":"2023-12-22T08:39:58.623909+0000","last_became_active":"2023-12-22T08:39:58.621245+0000","last_became_peered":"2023-12-22T08:39:58.621245+0000","last_unstale":"2023-12-22T08:39:58.623909+0000","last_undegraded":"2023-12-22T08:39:58.623909+0000","last_fullsized":"2023-12-22T08:39:58.623909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.622887+0000","last_change":"2023-12-22T08:39:58.621295+0000","last_active":"2023-12-22T08:39:58.622887+0000","last_peered":"2023-12-22T08:39:58.622887+0000","last_clean":"2023-12-22T08:39:58.622887+0000","last_became_active":"2023-12-22T08:39:58.621071+0000","last_became_peered":"2023-12-22T08:39:58.621071+0000","last_unstale":"2023-12-22T08:39:58.622887+0000","last_undegraded":"2023-12-22T08:39:58.622887+0000","last_fullsized":"2023-12-22T08:39:58.622887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635278+0000","last_change":"2023-12-22T08:39:58.635200+0000","last_active":"2023-12-22T08:39:58.635278+0000","last_peered":"2023-12-22T08:39:58.635278+0000","last_clean":"2023-12-22T08:39:58.635278+0000","last_became_active":"2023-12-22T08:39:58.634590+0000","last_became_peered":"2023-12-22T08:39:58.634590+0000","last_unstale":"2023-12-22T08:39:58.635278+0000","last_undegraded":"2023-12-22T08:39:58.635278+0000","last_fullsized":"2023-12-22T08:39:58.635278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:12.895574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635766+0000","last_change":"2023-12-22T08:39:58.635639+0000","last_active":"2023-12-22T08:39:58.635766+0000","last_peered":"2023-12-22T08:39:58.635766+0000","last_clean":"2023-12-22T08:39:58.635766+0000","last_became_active":"2023-12-22T08:39:58.634556+0000","last_became_peered":"2023-12-22T08:39:58.634556+0000","last_unstale":"2023-12-22T08:39:58.635766+0000","last_undegraded":"2023-12-22T08:39:58.635766+0000","last_fullsized":"2023-12-22T08:39:58.635766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:59:30.195380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619288+0000","last_change":"2023-12-22T08:39:58.619128+0000","last_active":"2023-12-22T08:39:58.619288+0000","last_peered":"2023-12-22T08:39:58.619288+0000","last_clean":"2023-12-22T08:39:58.619288+0000","last_became_active":"2023-12-22T08:39:58.618488+0000","last_became_peered":"2023-12-22T08:39:58.618488+0000","last_unstale":"2023-12-22T08:39:58.619288+0000","last_undegraded":"2023-12-22T08:39:58.619288+0000","last_fullsized":"2023-12-22T08:39:58.619288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.617164+0000","last_change":"2023-12-22T08:39:58.616544+0000","last_active":"2023-12-22T08:39:58.617164+0000","last_peered":"2023-12-22T08:39:58.617164+0000","last_clean":"2023-12-22T08:39:58.617164+0000","last_became_active":"2023-12-22T08:39:58.616182+0000","last_became_peered":"2023-12-22T08:39:58.616182+0000","last_unstale":"2023-12-22T08:39:58.617164+0000","last_undegraded":"2023-12-22T08:39:58.617164+0000","last_fullsized":"2023-12-22T08:39:58.617164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:13:34.205933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.627549+0000","last_change":"2023-12-22T08:39:58.627478+0000","last_active":"2023-12-22T08:39:58.627549+0000","last_peered":"2023-12-22T08:39:58.627549+0000","last_clean":"2023-12-22T08:39:58.627549+0000","last_became_active":"2023-12-22T08:39:58.626043+0000","last_became_peered":"2023-12-22T08:39:58.626043+0000","last_unstale":"2023-12-22T08:39:58.627549+0000","last_undegraded":"2023-12-22T08:39:58.627549+0000","last_fullsized":"2023-12-22T08:39:58.627549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639910+0000","last_change":"2023-12-22T08:39:58.638489+0000","last_active":"2023-12-22T08:39:58.639910+0000","last_peered":"2023-12-22T08:39:58.639910+0000","last_clean":"2023-12-22T08:39:58.639910+0000","last_became_active":"2023-12-22T08:39:58.638260+0000","last_became_peered":"2023-12-22T08:39:58.638260+0000","last_unstale":"2023-12-22T08:39:58.639910+0000","last_undegraded":"2023-12-22T08:39:58.639910+0000","last_fullsized":"2023-12-22T08:39:58.639910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628825+0000","last_change":"2023-12-22T08:39:58.628717+0000","last_active":"2023-12-22T08:39:58.628825+0000","last_peered":"2023-12-22T08:39:58.628825+0000","last_clean":"2023-12-22T08:39:58.628825+0000","last_became_active":"2023-12-22T08:39:58.628336+0000","last_became_peered":"2023-12-22T08:39:58.628336+0000","last_unstale":"2023-12-22T08:39:58.628825+0000","last_undegraded":"2023-12-22T08:39:58.628825+0000","last_fullsized":"2023-12-22T08:39:58.628825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:26.736651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.638316+0000","last_change":"2023-12-22T08:39:58.118326+0000","last_active":"2023-12-22T08:39:58.638316+0000","last_peered":"2023-12-22T08:39:58.638316+0000","last_clean":"2023-12-22T08:39:58.638316+0000","last_became_active":"2023-12-22T08:39:58.117693+0000","last_became_peered":"2023-12-22T08:39:58.117693+0000","last_unstale":"2023-12-22T08:39:58.638316+0000","last_undegraded":"2023-12-22T08:39:58.638316+0000","last_fullsized":"2023-12-22T08:39:58.638316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639287+0000","last_change":"2023-12-22T08:39:58.637716+0000","last_active":"2023-12-22T08:39:58.639287+0000","last_peered":"2023-12-22T08:39:58.639287+0000","last_clean":"2023-12-22T08:39:58.639287+0000","last_became_active":"2023-12-22T08:39:58.637494+0000","last_became_peered":"2023-12-22T08:39:58.637494+0000","last_unstale":"2023-12-22T08:39:58.639287+0000","last_undegraded":"2023-12-22T08:39:58.639287+0000","last_fullsized":"2023-12-22T08:39:58.639287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:20.854636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642478+0000","last_change":"2023-12-22T08:39:58.124015+0000","last_active":"2023-12-22T08:39:58.642478+0000","last_peered":"2023-12-22T08:39:58.642478+0000","last_clean":"2023-12-22T08:39:58.642478+0000","last_became_active":"2023-12-22T08:39:58.123750+0000","last_became_peered":"2023-12-22T08:39:58.123750+0000","last_unstale":"2023-12-22T08:39:58.642478+0000","last_undegraded":"2023-12-22T08:39:58.642478+0000","last_fullsized":"2023-12-22T08:39:58.642478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:32.352283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631688+0000","last_change":"2023-12-22T08:39:58.126588+0000","last_active":"2023-12-22T08:39:58.631688+0000","last_peered":"2023-12-22T08:39:58.631688+0000","last_clean":"2023-12-22T08:39:58.631688+0000","last_became_active":"2023-12-22T08:39:58.126277+0000","last_became_peered":"2023-12-22T08:39:58.126277+0000","last_unstale":"2023-12-22T08:39:58.631688+0000","last_undegraded":"2023-12-22T08:39:58.631688+0000","last_fullsized":"2023-12-22T08:39:58.631688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631434+0000","last_change":"2023-12-22T08:39:58.631377+0000","last_active":"2023-12-22T08:39:58.631434+0000","last_peered":"2023-12-22T08:39:58.631434+0000","last_clean":"2023-12-22T08:39:58.631434+0000","last_became_active":"2023-12-22T08:39:58.630993+0000","last_became_peered":"2023-12-22T08:39:58.630993+0000","last_unstale":"2023-12-22T08:39:58.631434+0000","last_undegraded":"2023-12-22T08:39:58.631434+0000","last_fullsized":"2023-12-22T08:39:58.631434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:26:26.790794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.612908+0000","last_change":"2023-12-22T08:39:58.129064+0000","last_active":"2023-12-22T08:39:58.612908+0000","last_peered":"2023-12-22T08:39:58.612908+0000","last_clean":"2023-12-22T08:39:58.612908+0000","last_became_active":"2023-12-22T08:39:58.127921+0000","last_became_peered":"2023-12-22T08:39:58.127921+0000","last_unstale":"2023-12-22T08:39:58.612908+0000","last_undegraded":"2023-12-22T08:39:58.612908+0000","last_fullsized":"2023-12-22T08:39:58.612908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632098+0000","last_change":"2023-12-22T08:39:58.631767+0000","last_active":"2023-12-22T08:39:58.632098+0000","last_peered":"2023-12-22T08:39:58.632098+0000","last_clean":"2023-12-22T08:39:58.632098+0000","last_became_active":"2023-12-22T08:39:58.629195+0000","last_became_peered":"2023-12-22T08:39:58.629195+0000","last_unstale":"2023-12-22T08:39:58.632098+0000","last_undegraded":"2023-12-22T08:39:58.632098+0000","last_fullsized":"2023-12-22T08:39:58.632098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.620316+0000","last_change":"2023-12-22T08:39:58.128425+0000","last_active":"2023-12-22T08:39:58.620316+0000","last_peered":"2023-12-22T08:39:58.620316+0000","last_clean":"2023-12-22T08:39:58.620316+0000","last_became_active":"2023-12-22T08:39:58.128139+0000","last_became_peered":"2023-12-22T08:39:58.128139+0000","last_unstale":"2023-12-22T08:39:58.620316+0000","last_undegraded":"2023-12-22T08:39:58.620316+0000","last_fullsized":"2023-12-22T08:39:58.620316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628459+0000","last_change":"2023-12-22T08:39:58.628264+0000","last_active":"2023-12-22T08:39:58.628459+0000","last_peered":"2023-12-22T08:39:58.628459+0000","last_clean":"2023-12-22T08:39:58.628459+0000","last_became_active":"2023-12-22T08:39:58.627878+0000","last_became_peered":"2023-12-22T08:39:58.627878+0000","last_unstale":"2023-12-22T08:39:58.628459+0000","last_undegraded":"2023-12-22T08:39:58.628459+0000","last_fullsized":"2023-12-22T08:39:58.628459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:16.280464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626441+0000","last_change":"2023-12-22T08:39:58.123417+0000","last_active":"2023-12-22T08:39:58.626441+0000","last_peered":"2023-12-22T08:39:58.626441+0000","last_clean":"2023-12-22T08:39:58.626441+0000","last_became_active":"2023-12-22T08:39:58.122926+0000","last_became_peered":"2023-12-22T08:39:58.122926+0000","last_unstale":"2023-12-22T08:39:58.626441+0000","last_undegraded":"2023-12-22T08:39:58.626441+0000","last_fullsized":"2023-12-22T08:39:58.626441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.616535+0000","last_change":"2023-12-22T08:39:58.616456+0000","last_active":"2023-12-22T08:39:58.616535+0000","last_peered":"2023-12-22T08:39:58.616535+0000","last_clean":"2023-12-22T08:39:58.616535+0000","last_became_active":"2023-12-22T08:39:58.616235+0000","last_became_peered":"2023-12-22T08:39:58.616235+0000","last_unstale":"2023-12-22T08:39:58.616535+0000","last_undegraded":"2023-12-22T08:39:58.616535+0000","last_fullsized":"2023-12-22T08:39:58.616535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:54:37.333505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635460+0000","last_change":"2023-12-22T08:39:58.129066+0000","last_active":"2023-12-22T08:39:58.635460+0000","last_peered":"2023-12-22T08:39:58.635460+0000","last_clean":"2023-12-22T08:39:58.635460+0000","last_became_active":"2023-12-22T08:39:58.128536+0000","last_became_peered":"2023-12-22T08:39:58.128536+0000","last_unstale":"2023-12-22T08:39:58.635460+0000","last_undegraded":"2023-12-22T08:39:58.635460+0000","last_fullsized":"2023-12-22T08:39:58.635460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629952+0000","last_change":"2023-12-22T08:39:58.629869+0000","last_active":"2023-12-22T08:39:58.629952+0000","last_peered":"2023-12-22T08:39:58.629952+0000","last_clean":"2023-12-22T08:39:58.629952+0000","last_became_active":"2023-12-22T08:39:58.629618+0000","last_became_peered":"2023-12-22T08:39:58.629618+0000","last_unstale":"2023-12-22T08:39:58.629952+0000","last_undegraded":"2023-12-22T08:39:58.629952+0000","last_fullsized":"2023-12-22T08:39:58.629952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:24:34.120013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642495+0000","last_change":"2023-12-22T08:39:58.126247+0000","last_active":"2023-12-22T08:39:58.642495+0000","last_peered":"2023-12-22T08:39:58.642495+0000","last_clean":"2023-12-22T08:39:58.642495+0000","last_became_active":"2023-12-22T08:39:58.125863+0000","last_became_peered":"2023-12-22T08:39:58.125863+0000","last_unstale":"2023-12-22T08:39:58.642495+0000","last_undegraded":"2023-12-22T08:39:58.642495+0000","last_fullsized":"2023-12-22T08:39:58.642495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641409+0000","last_change":"2023-12-22T08:39:58.641015+0000","last_active":"2023-12-22T08:39:58.641409+0000","last_peered":"2023-12-22T08:39:58.641409+0000","last_clean":"2023-12-22T08:39:58.641409+0000","last_became_active":"2023-12-22T08:39:58.640705+0000","last_became_peered":"2023-12-22T08:39:58.640705+0000","last_unstale":"2023-12-22T08:39:58.641409+0000","last_undegraded":"2023-12-22T08:39:58.641409+0000","last_fullsized":"2023-12-22T08:39:58.641409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:09:26.794355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642932+0000","last_change":"2023-12-22T08:39:58.123764+0000","last_active":"2023-12-22T08:39:58.642932+0000","last_peered":"2023-12-22T08:39:58.642932+0000","last_clean":"2023-12-22T08:39:58.642932+0000","last_became_active":"2023-12-22T08:39:58.123431+0000","last_became_peered":"2023-12-22T08:39:58.123431+0000","last_unstale":"2023-12-22T08:39:58.642932+0000","last_undegraded":"2023-12-22T08:39:58.642932+0000","last_fullsized":"2023-12-22T08:39:58.642932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634178+0000","last_change":"2023-12-22T08:39:58.634043+0000","last_active":"2023-12-22T08:39:58.634178+0000","last_peered":"2023-12-22T08:39:58.634178+0000","last_clean":"2023-12-22T08:39:58.634178+0000","last_became_active":"2023-12-22T08:39:58.633774+0000","last_became_peered":"2023-12-22T08:39:58.633774+0000","last_unstale":"2023-12-22T08:39:58.634178+0000","last_undegraded":"2023-12-22T08:39:58.634178+0000","last_fullsized":"2023-12-22T08:39:58.634178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.614467+0000","last_change":"2023-12-22T08:39:58.124254+0000","last_active":"2023-12-22T08:39:58.614467+0000","last_peered":"2023-12-22T08:39:58.614467+0000","last_clean":"2023-12-22T08:39:58.614467+0000","last_became_active":"2023-12-22T08:39:58.123937+0000","last_became_peered":"2023-12-22T08:39:58.123937+0000","last_unstale":"2023-12-22T08:39:58.614467+0000","last_undegraded":"2023-12-22T08:39:58.614467+0000","last_fullsized":"2023-12-22T08:39:58.614467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.644230+0000","last_change":"2023-12-22T08:39:58.644158+0000","last_active":"2023-12-22T08:39:58.644230+0000","last_peered":"2023-12-22T08:39:58.644230+0000","last_clean":"2023-12-22T08:39:58.644230+0000","last_became_active":"2023-12-22T08:39:58.643919+0000","last_became_peered":"2023-12-22T08:39:58.643919+0000","last_unstale":"2023-12-22T08:39:58.644230+0000","last_undegraded":"2023-12-22T08:39:58.644230+0000","last_fullsized":"2023-12-22T08:39:58.644230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:16.702062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.626541+0000","last_change":"2023-12-22T08:39:58.130462+0000","last_active":"2023-12-22T08:39:58.626541+0000","last_peered":"2023-12-22T08:39:58.626541+0000","last_clean":"2023-12-22T08:39:58.626541+0000","last_became_active":"2023-12-22T08:39:58.130246+0000","last_became_peered":"2023-12-22T08:39:58.130246+0000","last_unstale":"2023-12-22T08:39:58.626541+0000","last_undegraded":"2023-12-22T08:39:58.626541+0000","last_fullsized":"2023-12-22T08:39:58.626541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.628811+0000","last_change":"2023-12-22T08:39:58.628587+0000","last_active":"2023-12-22T08:39:58.628811+0000","last_peered":"2023-12-22T08:39:58.628811+0000","last_clean":"2023-12-22T08:39:58.628811+0000","last_became_active":"2023-12-22T08:39:58.626918+0000","last_became_peered":"2023-12-22T08:39:58.626918+0000","last_unstale":"2023-12-22T08:39:58.628811+0000","last_undegraded":"2023-12-22T08:39:58.628811+0000","last_fullsized":"2023-12-22T08:39:58.628811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641108+0000","last_change":"2023-12-22T08:39:58.127791+0000","last_active":"2023-12-22T08:39:58.641108+0000","last_peered":"2023-12-22T08:39:58.641108+0000","last_clean":"2023-12-22T08:39:58.641108+0000","last_became_active":"2023-12-22T08:39:58.126674+0000","last_became_peered":"2023-12-22T08:39:58.126674+0000","last_unstale":"2023-12-22T08:39:58.641108+0000","last_undegraded":"2023-12-22T08:39:58.641108+0000","last_fullsized":"2023-12-22T08:39:58.641108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632387+0000","last_change":"2023-12-22T08:39:58.631847+0000","last_active":"2023-12-22T08:39:58.632387+0000","last_peered":"2023-12-22T08:39:58.632387+0000","last_clean":"2023-12-22T08:39:58.632387+0000","last_became_active":"2023-12-22T08:39:58.631202+0000","last_became_peered":"2023-12-22T08:39:58.631202+0000","last_unstale":"2023-12-22T08:39:58.632387+0000","last_undegraded":"2023-12-22T08:39:58.632387+0000","last_fullsized":"2023-12-22T08:39:58.632387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:53:42.342046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643020+0000","last_change":"2023-12-22T08:39:58.131328+0000","last_active":"2023-12-22T08:39:58.643020+0000","last_peered":"2023-12-22T08:39:58.643020+0000","last_clean":"2023-12-22T08:39:58.643020+0000","last_became_active":"2023-12-22T08:39:58.131102+0000","last_became_peered":"2023-12-22T08:39:58.131102+0000","last_unstale":"2023-12-22T08:39:58.643020+0000","last_undegraded":"2023-12-22T08:39:58.643020+0000","last_fullsized":"2023-12-22T08:39:58.643020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:23:56.464880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.644219+0000","last_change":"2023-12-22T08:39:58.644149+0000","last_active":"2023-12-22T08:39:58.644219+0000","last_peered":"2023-12-22T08:39:58.644219+0000","last_clean":"2023-12-22T08:39:58.644219+0000","last_became_active":"2023-12-22T08:39:58.643782+0000","last_became_peered":"2023-12-22T08:39:58.643782+0000","last_unstale":"2023-12-22T08:39:58.644219+0000","last_undegraded":"2023-12-22T08:39:58.644219+0000","last_fullsized":"2023-12-22T08:39:58.644219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:37.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639405+0000","last_change":"2023-12-22T08:39:58.128619+0000","last_active":"2023-12-22T08:39:58.639405+0000","last_peered":"2023-12-22T08:39:58.639405+0000","last_clean":"2023-12-22T08:39:58.639405+0000","last_became_active":"2023-12-22T08:39:58.128357+0000","last_became_peered":"2023-12-22T08:39:58.128357+0000","last_unstale":"2023-12-22T08:39:58.639405+0000","last_undegraded":"2023-12-22T08:39:58.639405+0000","last_fullsized":"2023-12-22T08:39:58.639405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.634241+0000","last_change":"2023-12-22T08:39:58.633374+0000","last_active":"2023-12-22T08:39:58.634241+0000","last_peered":"2023-12-22T08:39:58.634241+0000","last_clean":"2023-12-22T08:39:58.634241+0000","last_became_active":"2023-12-22T08:39:58.633140+0000","last_became_peered":"2023-12-22T08:39:58.633140+0000","last_unstale":"2023-12-22T08:39:58.634241+0000","last_undegraded":"2023-12-22T08:39:58.634241+0000","last_fullsized":"2023-12-22T08:39:58.634241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:41.284115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.632780+0000","last_change":"2023-12-22T08:39:58.124679+0000","last_active":"2023-12-22T08:39:58.632780+0000","last_peered":"2023-12-22T08:39:58.632780+0000","last_clean":"2023-12-22T08:39:58.632780+0000","last_became_active":"2023-12-22T08:39:58.124446+0000","last_became_peered":"2023-12-22T08:39:58.124446+0000","last_unstale":"2023-12-22T08:39:58.632780+0000","last_undegraded":"2023-12-22T08:39:58.632780+0000","last_fullsized":"2023-12-22T08:39:58.632780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:57.160939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635014+0000","last_change":"2023-12-22T08:39:58.634622+0000","last_active":"2023-12-22T08:39:58.635014+0000","last_peered":"2023-12-22T08:39:58.635014+0000","last_clean":"2023-12-22T08:39:58.635014+0000","last_became_active":"2023-12-22T08:39:58.627769+0000","last_became_peered":"2023-12-22T08:39:58.627769+0000","last_unstale":"2023-12-22T08:39:58.635014+0000","last_undegraded":"2023-12-22T08:39:58.635014+0000","last_fullsized":"2023-12-22T08:39:58.635014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:30.253611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625945+0000","last_change":"2023-12-22T08:39:58.125976+0000","last_active":"2023-12-22T08:39:58.625945+0000","last_peered":"2023-12-22T08:39:58.625945+0000","last_clean":"2023-12-22T08:39:58.625945+0000","last_became_active":"2023-12-22T08:39:58.125728+0000","last_became_peered":"2023-12-22T08:39:58.125728+0000","last_unstale":"2023-12-22T08:39:58.625945+0000","last_undegraded":"2023-12-22T08:39:58.625945+0000","last_fullsized":"2023-12-22T08:39:58.625945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623852+0000","last_change":"2023-12-22T08:39:58.623592+0000","last_active":"2023-12-22T08:39:58.623852+0000","last_peered":"2023-12-22T08:39:58.623852+0000","last_clean":"2023-12-22T08:39:58.623852+0000","last_became_active":"2023-12-22T08:39:58.623129+0000","last_became_peered":"2023-12-22T08:39:58.623129+0000","last_unstale":"2023-12-22T08:39:58.623852+0000","last_undegraded":"2023-12-22T08:39:58.623852+0000","last_fullsized":"2023-12-22T08:39:58.623852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:06.561215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.618653+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:39:58.618653+0000","last_peered":"2023-12-22T08:39:58.618653+0000","last_clean":"2023-12-22T08:39:58.618653+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:39:58.618653+0000","last_undegraded":"2023-12-22T08:39:58.618653+0000","last_fullsized":"2023-12-22T08:39:58.618653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.614777+0000","last_change":"2023-12-22T08:39:58.128257+0000","last_active":"2023-12-22T08:39:58.614777+0000","last_peered":"2023-12-22T08:39:58.614777+0000","last_clean":"2023-12-22T08:39:58.614777+0000","last_became_active":"2023-12-22T08:39:58.127185+0000","last_became_peered":"2023-12-22T08:39:58.127185+0000","last_unstale":"2023-12-22T08:39:58.614777+0000","last_undegraded":"2023-12-22T08:39:58.614777+0000","last_fullsized":"2023-12-22T08:39:58.614777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:34.256489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630391+0000","last_change":"2023-12-22T08:39:58.630318+0000","last_active":"2023-12-22T08:39:58.630391+0000","last_peered":"2023-12-22T08:39:58.630391+0000","last_clean":"2023-12-22T08:39:58.630391+0000","last_became_active":"2023-12-22T08:39:58.630077+0000","last_became_peered":"2023-12-22T08:39:58.630077+0000","last_unstale":"2023-12-22T08:39:58.630391+0000","last_undegraded":"2023-12-22T08:39:58.630391+0000","last_fullsized":"2023-12-22T08:39:58.630391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.616306+0000","last_change":"2023-12-22T08:39:58.109900+0000","last_active":"2023-12-22T08:39:58.616306+0000","last_peered":"2023-12-22T08:39:58.616306+0000","last_clean":"2023-12-22T08:39:58.616306+0000","last_became_active":"2023-12-22T08:39:58.109127+0000","last_became_peered":"2023-12-22T08:39:58.109127+0000","last_unstale":"2023-12-22T08:39:58.616306+0000","last_undegraded":"2023-12-22T08:39:58.616306+0000","last_fullsized":"2023-12-22T08:39:58.616306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.635903+0000","last_change":"2023-12-22T08:39:58.635825+0000","last_active":"2023-12-22T08:39:58.635903+0000","last_peered":"2023-12-22T08:39:58.635903+0000","last_clean":"2023-12-22T08:39:58.635903+0000","last_became_active":"2023-12-22T08:39:58.635203+0000","last_became_peered":"2023-12-22T08:39:58.635203+0000","last_unstale":"2023-12-22T08:39:58.635903+0000","last_undegraded":"2023-12-22T08:39:58.635903+0000","last_fullsized":"2023-12-22T08:39:58.635903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.617739+0000","last_change":"2023-12-22T08:39:58.128822+0000","last_active":"2023-12-22T08:39:58.617739+0000","last_peered":"2023-12-22T08:39:58.617739+0000","last_clean":"2023-12-22T08:39:58.617739+0000","last_became_active":"2023-12-22T08:39:58.128142+0000","last_became_peered":"2023-12-22T08:39:58.128142+0000","last_unstale":"2023-12-22T08:39:58.617739+0000","last_undegraded":"2023-12-22T08:39:58.617739+0000","last_fullsized":"2023-12-22T08:39:58.617739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:13.782104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.619266+0000","last_change":"2023-12-22T08:39:58.618953+0000","last_active":"2023-12-22T08:39:58.619266+0000","last_peered":"2023-12-22T08:39:58.619266+0000","last_clean":"2023-12-22T08:39:58.619266+0000","last_became_active":"2023-12-22T08:39:58.618178+0000","last_became_peered":"2023-12-22T08:39:58.618178+0000","last_unstale":"2023-12-22T08:39:58.619266+0000","last_undegraded":"2023-12-22T08:39:58.619266+0000","last_fullsized":"2023-12-22T08:39:58.619266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:23:49.465945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.612537+0000","last_change":"2023-12-22T08:39:58.109274+0000","last_active":"2023-12-22T08:39:58.612537+0000","last_peered":"2023-12-22T08:39:58.612537+0000","last_clean":"2023-12-22T08:39:58.612537+0000","last_became_active":"2023-12-22T08:39:58.108715+0000","last_became_peered":"2023-12-22T08:39:58.108715+0000","last_unstale":"2023-12-22T08:39:58.612537+0000","last_undegraded":"2023-12-22T08:39:58.612537+0000","last_fullsized":"2023-12-22T08:39:58.612537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.641249+0000","last_change":"2023-12-22T08:39:58.640517+0000","last_active":"2023-12-22T08:39:58.641249+0000","last_peered":"2023-12-22T08:39:58.641249+0000","last_clean":"2023-12-22T08:39:58.641249+0000","last_became_active":"2023-12-22T08:39:58.640288+0000","last_became_peered":"2023-12-22T08:39:58.640288+0000","last_unstale":"2023-12-22T08:39:58.641249+0000","last_undegraded":"2023-12-22T08:39:58.641249+0000","last_fullsized":"2023-12-22T08:39:58.641249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:23:37.981460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.611243+0000","last_change":"2023-12-22T08:39:58.127367+0000","last_active":"2023-12-22T08:39:58.611243+0000","last_peered":"2023-12-22T08:39:58.611243+0000","last_clean":"2023-12-22T08:39:58.611243+0000","last_became_active":"2023-12-22T08:39:58.124150+0000","last_became_peered":"2023-12-22T08:39:58.124150+0000","last_unstale":"2023-12-22T08:39:58.611243+0000","last_undegraded":"2023-12-22T08:39:58.611243+0000","last_fullsized":"2023-12-22T08:39:58.611243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.636519+0000","last_change":"2023-12-22T08:39:58.636058+0000","last_active":"2023-12-22T08:39:58.636519+0000","last_peered":"2023-12-22T08:39:58.636519+0000","last_clean":"2023-12-22T08:39:58.636519+0000","last_became_active":"2023-12-22T08:39:58.635817+0000","last_became_peered":"2023-12-22T08:39:58.635817+0000","last_unstale":"2023-12-22T08:39:58.636519+0000","last_undegraded":"2023-12-22T08:39:58.636519+0000","last_fullsized":"2023-12-22T08:39:58.636519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:35.271459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.615958+0000","last_change":"2023-12-22T08:39:58.128760+0000","last_active":"2023-12-22T08:39:58.615958+0000","last_peered":"2023-12-22T08:39:58.615958+0000","last_clean":"2023-12-22T08:39:58.615958+0000","last_became_active":"2023-12-22T08:39:58.128499+0000","last_became_peered":"2023-12-22T08:39:58.128499+0000","last_unstale":"2023-12-22T08:39:58.615958+0000","last_undegraded":"2023-12-22T08:39:58.615958+0000","last_fullsized":"2023-12-22T08:39:58.615958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:15.265494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633467+0000","last_change":"2023-12-22T08:39:58.630593+0000","last_active":"2023-12-22T08:39:58.633467+0000","last_peered":"2023-12-22T08:39:58.633467+0000","last_clean":"2023-12-22T08:39:58.633467+0000","last_became_active":"2023-12-22T08:39:58.629117+0000","last_became_peered":"2023-12-22T08:39:58.629117+0000","last_unstale":"2023-12-22T08:39:58.633467+0000","last_undegraded":"2023-12-22T08:39:58.633467+0000","last_fullsized":"2023-12-22T08:39:58.633467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.391323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:39:59.613300+0000","last_change":"2023-12-22T08:39:58.129601+0000","last_active":"2023-12-22T08:39:59.613300+0000","last_peered":"2023-12-22T08:39:59.613300+0000","last_clean":"2023-12-22T08:39:59.613300+0000","last_became_active":"2023-12-22T08:39:58.129236+0000","last_became_peered":"2023-12-22T08:39:58.129236+0000","last_unstale":"2023-12-22T08:39:59.613300+0000","last_undegraded":"2023-12-22T08:39:59.613300+0000","last_fullsized":"2023-12-22T08:39:59.613300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:05.704053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639661+0000","last_change":"2023-12-22T08:39:58.639582+0000","last_active":"2023-12-22T08:39:58.639661+0000","last_peered":"2023-12-22T08:39:58.639661+0000","last_clean":"2023-12-22T08:39:58.639661+0000","last_became_active":"2023-12-22T08:39:58.638759+0000","last_became_peered":"2023-12-22T08:39:58.638759+0000","last_unstale":"2023-12-22T08:39:58.639661+0000","last_undegraded":"2023-12-22T08:39:58.639661+0000","last_fullsized":"2023-12-22T08:39:58.639661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:41:52.043211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642267+0000","last_change":"2023-12-22T08:39:58.127199+0000","last_active":"2023-12-22T08:39:58.642267+0000","last_peered":"2023-12-22T08:39:58.642267+0000","last_clean":"2023-12-22T08:39:58.642267+0000","last_became_active":"2023-12-22T08:39:58.126735+0000","last_became_peered":"2023-12-22T08:39:58.126735+0000","last_unstale":"2023-12-22T08:39:58.642267+0000","last_undegraded":"2023-12-22T08:39:58.642267+0000","last_fullsized":"2023-12-22T08:39:58.642267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:12.048994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.627309+0000","last_change":"2023-12-22T08:39:58.627233+0000","last_active":"2023-12-22T08:39:58.627309+0000","last_peered":"2023-12-22T08:39:58.627309+0000","last_clean":"2023-12-22T08:39:58.627309+0000","last_became_active":"2023-12-22T08:39:58.626937+0000","last_became_peered":"2023-12-22T08:39:58.626937+0000","last_unstale":"2023-12-22T08:39:58.627309+0000","last_undegraded":"2023-12-22T08:39:58.627309+0000","last_fullsized":"2023-12-22T08:39:58.627309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:36:59.203937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.625536+0000","last_change":"2023-12-22T08:39:58.125513+0000","last_active":"2023-12-22T08:39:58.625536+0000","last_peered":"2023-12-22T08:39:58.625536+0000","last_clean":"2023-12-22T08:39:58.625536+0000","last_became_active":"2023-12-22T08:39:58.125286+0000","last_became_peered":"2023-12-22T08:39:58.125286+0000","last_unstale":"2023-12-22T08:39:58.625536+0000","last_undegraded":"2023-12-22T08:39:58.625536+0000","last_fullsized":"2023-12-22T08:39:58.625536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623822+0000","last_change":"2023-12-22T08:39:58.622884+0000","last_active":"2023-12-22T08:39:58.623822+0000","last_peered":"2023-12-22T08:39:58.623822+0000","last_clean":"2023-12-22T08:39:58.623822+0000","last_became_active":"2023-12-22T08:39:58.622531+0000","last_became_peered":"2023-12-22T08:39:58.622531+0000","last_unstale":"2023-12-22T08:39:58.623822+0000","last_undegraded":"2023-12-22T08:39:58.623822+0000","last_fullsized":"2023-12-22T08:39:58.623822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:01.993745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.620792+0000","last_change":"2023-12-22T08:39:58.127163+0000","last_active":"2023-12-22T08:39:58.620792+0000","last_peered":"2023-12-22T08:39:58.620792+0000","last_clean":"2023-12-22T08:39:58.620792+0000","last_became_active":"2023-12-22T08:39:58.125842+0000","last_became_peered":"2023-12-22T08:39:58.125842+0000","last_unstale":"2023-12-22T08:39:58.620792+0000","last_undegraded":"2023-12-22T08:39:58.620792+0000","last_fullsized":"2023-12-22T08:39:58.620792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:03.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.629967+0000","last_change":"2023-12-22T08:39:58.628998+0000","last_active":"2023-12-22T08:39:58.629967+0000","last_peered":"2023-12-22T08:39:58.629967+0000","last_clean":"2023-12-22T08:39:58.629967+0000","last_became_active":"2023-12-22T08:39:58.628022+0000","last_became_peered":"2023-12-22T08:39:58.628022+0000","last_unstale":"2023-12-22T08:39:58.629967+0000","last_undegraded":"2023-12-22T08:39:58.629967+0000","last_fullsized":"2023-12-22T08:39:58.629967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:27:43.120329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.631814+0000","last_change":"2023-12-22T08:39:58.129742+0000","last_active":"2023-12-22T08:39:58.631814+0000","last_peered":"2023-12-22T08:39:58.631814+0000","last_clean":"2023-12-22T08:39:58.631814+0000","last_became_active":"2023-12-22T08:39:58.129522+0000","last_became_peered":"2023-12-22T08:39:58.129522+0000","last_unstale":"2023-12-22T08:39:58.631814+0000","last_undegraded":"2023-12-22T08:39:58.631814+0000","last_fullsized":"2023-12-22T08:39:58.631814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:33.382643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.636842+0000","last_change":"2023-12-22T08:39:58.636766+0000","last_active":"2023-12-22T08:39:58.636842+0000","last_peered":"2023-12-22T08:39:58.636842+0000","last_clean":"2023-12-22T08:39:58.636842+0000","last_became_active":"2023-12-22T08:39:58.636550+0000","last_became_peered":"2023-12-22T08:39:58.636550+0000","last_unstale":"2023-12-22T08:39:58.636842+0000","last_undegraded":"2023-12-22T08:39:58.636842+0000","last_fullsized":"2023-12-22T08:39:58.636842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:13.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.637828+0000","last_change":"2023-12-22T08:39:58.128411+0000","last_active":"2023-12-22T08:39:58.637828+0000","last_peered":"2023-12-22T08:39:58.637828+0000","last_clean":"2023-12-22T08:39:58.637828+0000","last_became_active":"2023-12-22T08:39:58.127849+0000","last_became_peered":"2023-12-22T08:39:58.127849+0000","last_unstale":"2023-12-22T08:39:58.637828+0000","last_undegraded":"2023-12-22T08:39:58.637828+0000","last_fullsized":"2023-12-22T08:39:58.637828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:25.721681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.624467+0000","last_change":"2023-12-22T08:39:58.624131+0000","last_active":"2023-12-22T08:39:58.624467+0000","last_peered":"2023-12-22T08:39:58.624467+0000","last_clean":"2023-12-22T08:39:58.624467+0000","last_became_active":"2023-12-22T08:39:58.621786+0000","last_became_peered":"2023-12-22T08:39:58.621786+0000","last_unstale":"2023-12-22T08:39:58.624467+0000","last_undegraded":"2023-12-22T08:39:58.624467+0000","last_fullsized":"2023-12-22T08:39:58.624467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.642965+0000","last_change":"2023-12-22T08:39:58.642425+0000","last_active":"2023-12-22T08:39:58.642965+0000","last_peered":"2023-12-22T08:39:58.642965+0000","last_clean":"2023-12-22T08:39:58.642965+0000","last_became_active":"2023-12-22T08:39:58.642201+0000","last_became_peered":"2023-12-22T08:39:58.642201+0000","last_unstale":"2023-12-22T08:39:58.642965+0000","last_undegraded":"2023-12-22T08:39:58.642965+0000","last_fullsized":"2023-12-22T08:39:58.642965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:35.423369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.643104+0000","last_change":"2023-12-22T08:39:58.124586+0000","last_active":"2023-12-22T08:39:58.643104+0000","last_peered":"2023-12-22T08:39:58.643104+0000","last_clean":"2023-12-22T08:39:58.643104+0000","last_became_active":"2023-12-22T08:39:58.123428+0000","last_became_peered":"2023-12-22T08:39:58.123428+0000","last_unstale":"2023-12-22T08:39:58.643104+0000","last_undegraded":"2023-12-22T08:39:58.643104+0000","last_fullsized":"2023-12-22T08:39:58.643104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:36.134770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.630950+0000","last_change":"2023-12-22T08:39:58.630694+0000","last_active":"2023-12-22T08:39:58.630950+0000","last_peered":"2023-12-22T08:39:58.630950+0000","last_clean":"2023-12-22T08:39:58.630950+0000","last_became_active":"2023-12-22T08:39:58.630420+0000","last_became_peered":"2023-12-22T08:39:58.630420+0000","last_unstale":"2023-12-22T08:39:58.630950+0000","last_undegraded":"2023-12-22T08:39:58.630950+0000","last_fullsized":"2023-12-22T08:39:58.630950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:33.367253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.645513+0000","last_change":"2023-12-22T08:39:58.129551+0000","last_active":"2023-12-22T08:39:58.645513+0000","last_peered":"2023-12-22T08:39:58.645513+0000","last_clean":"2023-12-22T08:39:58.645513+0000","last_became_active":"2023-12-22T08:39:58.129237+0000","last_became_peered":"2023-12-22T08:39:58.129237+0000","last_unstale":"2023-12-22T08:39:58.645513+0000","last_undegraded":"2023-12-22T08:39:58.645513+0000","last_fullsized":"2023-12-22T08:39:58.645513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623969+0000","last_change":"2023-12-22T08:39:58.623889+0000","last_active":"2023-12-22T08:39:58.623969+0000","last_peered":"2023-12-22T08:39:58.623969+0000","last_clean":"2023-12-22T08:39:58.623969+0000","last_became_active":"2023-12-22T08:39:58.621334+0000","last_became_peered":"2023-12-22T08:39:58.621334+0000","last_unstale":"2023-12-22T08:39:58.623969+0000","last_undegraded":"2023-12-22T08:39:58.623969+0000","last_fullsized":"2023-12-22T08:39:58.623969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:58:42.417309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.633418+0000","last_change":"2023-12-22T08:39:58.127899+0000","last_active":"2023-12-22T08:39:58.633418+0000","last_peered":"2023-12-22T08:39:58.633418+0000","last_clean":"2023-12-22T08:39:58.633418+0000","last_became_active":"2023-12-22T08:39:58.126733+0000","last_became_peered":"2023-12-22T08:39:58.126733+0000","last_unstale":"2023-12-22T08:39:58.633418+0000","last_undegraded":"2023-12-22T08:39:58.633418+0000","last_fullsized":"2023-12-22T08:39:58.633418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:07.215866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.623951+0000","last_change":"2023-12-22T08:39:58.623648+0000","last_active":"2023-12-22T08:39:58.623951+0000","last_peered":"2023-12-22T08:39:58.623951+0000","last_clean":"2023-12-22T08:39:58.623951+0000","last_became_active":"2023-12-22T08:39:58.623415+0000","last_became_peered":"2023-12-22T08:39:58.623415+0000","last_unstale":"2023-12-22T08:39:58.623951+0000","last_undegraded":"2023-12-22T08:39:58.623951+0000","last_fullsized":"2023-12-22T08:39:58.623951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:58.089988+0000","last_clean_scrub_stamp":"2023-12-22T08:39:58.089988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:10.087290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:39:58.639516+0000","last_change":"2023-12-22T08:39:58.130439+0000","last_active":"2023-12-22T08:39:58.639516+0000","last_peered":"2023-12-22T08:39:58.639516+0000","last_clean":"2023-12-22T08:39:58.639516+0000","last_became_active":"2023-12-22T08:39:58.130196+0000","last_became_peered":"2023-12-22T08:39:58.130196+0000","last_unstale":"2023-12-22T08:39:58.639516+0000","last_undegraded":"2023-12-22T08:39:58.639516+0000","last_fullsized":"2023-12-22T08:39:58.639516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:57.075019+0000","last_clean_scrub_stamp":"2023-12-22T08:39:57.075019+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:03.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194667,"statfs":{"total":200000000,"available":199339821,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":71,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927026,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199928680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3479999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1779999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2210000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.383}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.863}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]}]}],"pool_statfs":[]}} 2023-12-22T08:40:14.844 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-22T08:40:14.844 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-22T08:40:14.844 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-22T08:40:14.844 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-22T08:40:15.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.104+0000 7f048e08a640 1 Processor -- start 2023-12-22T08:40:15.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.104+0000 7f048e08a640 1 -- start start 2023-12-22T08:40:15.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.106+0000 7f048e08a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0488157980 0x7f048815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.106+0000 7f048e08a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f04880b3ff0 0x7f048806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.106+0000 7f048e08a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04880d1520 con 0x7f04880b44a0 2023-12-22T08:40:15.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.106+0000 7f048e08a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04880d1800 con 0x7f0488157980 2023-12-22T08:40:15.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.106+0000 7f048e08a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04880d1ae0 con 0x7f04880b3ff0 2023-12-22T08:40:15.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.106+0000 7f048d088640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0488157980 0x7f048815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.106+0000 7f048d889640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f04880b44a0 0x7f04880d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49768/0 (socket says 172.21.15.38:49768) 2023-12-22T08:40:15.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.106+0000 7f048d889640 1 -- 172.21.15.38:0/3796357684 learned_addr learned my addr 172.21.15.38:0/3796357684 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:15.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.107+0000 7f048c887640 1 --2- 172.21.15.38:0/3796357684 >> v2:172.21.15.89:3300/0 conn(0x7f04880b3ff0 0x7f048806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.107+0000 7f048d088640 1 -- 172.21.15.38:0/3796357684 >> v2:172.21.15.89:3300/0 conn(0x7f04880b3ff0 msgr2=0x7f048806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:15.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.107+0000 7f048d088640 1 --2- 172.21.15.38:0/3796357684 >> v2:172.21.15.89:3300/0 conn(0x7f04880b3ff0 0x7f048806cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.107+0000 7f047ffff640 1 -- 172.21.15.38:0/3796357684 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114662428 0 0) 0x7f04880d1520 con 0x7f04880b44a0 2023-12-22T08:40:15.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.107+0000 7f048d088640 1 -- 172.21.15.38:0/3796357684 >> v1:172.21.15.38:6789/0 conn(0x7f04880b44a0 legacy=0x7f04880d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:15.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.107+0000 7f048d088640 1 -- 172.21.15.38:0/3796357684 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04880d1dc0 con 0x7f0488157980 2023-12-22T08:40:15.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.109+0000 7f048d088640 1 --2- 172.21.15.38:0/3796357684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0488157980 0x7f048815eb10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04880d3f10 tx=0x7f048402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0edc8c7527de970 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:15.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.109+0000 7f047ffff640 1 -- 172.21.15.38:0/3796357684 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484031830 con 0x7f0488157980 2023-12-22T08:40:15.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.109+0000 7f047ffff640 1 -- 172.21.15.38:0/3796357684 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0484031990 con 0x7f0488157980 2023-12-22T08:40:15.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.109+0000 7f047ffff640 1 -- 172.21.15.38:0/3796357684 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484031d20 con 0x7f0488157980 2023-12-22T08:40:15.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.110+0000 7f048e08a640 1 -- 172.21.15.38:0/3796357684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0488157980 msgr2=0x7f048815eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:15.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.110+0000 7f048e08a640 1 --2- 172.21.15.38:0/3796357684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0488157980 0x7f048815eb10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04880d3f10 tx=0x7f048402b8d0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.110+0000 7f048e08a640 1 -- 172.21.15.38:0/3796357684 shutdown_connections 2023-12-22T08:40:15.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.110+0000 7f048e08a640 1 --2- 172.21.15.38:0/3796357684 >> v2:172.21.15.89:3300/0 conn(0x7f04880b3ff0 0x7f048806cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.110+0000 7f048e08a640 1 --2- 172.21.15.38:0/3796357684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0488157980 0x7f048815eb10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.110+0000 7f048e08a640 1 -- 172.21.15.38:0/3796357684 >> 172.21.15.38:0/3796357684 conn(0x7f04880d31f0 msgr2=0x7f04880d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:15.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.110+0000 7f048e08a640 1 -- 172.21.15.38:0/3796357684 shutdown_connections 2023-12-22T08:40:15.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.110+0000 7f048e08a640 1 -- 172.21.15.38:0/3796357684 wait complete. 2023-12-22T08:40:15.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.112+0000 7f048e08a640 1 Processor -- start 2023-12-22T08:40:15.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.112+0000 7f048e08a640 1 -- start start 2023-12-22T08:40:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.113+0000 7f048e08a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04880b3ff0 0x7f04881f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.113+0000 7f048e08a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04880b44a0 0x7f04881f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.113+0000 7f048e08a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0488157980 0x7f048815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.113+0000 7f048e08a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048815fed0 con 0x7f04880b44a0 2023-12-22T08:40:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.113+0000 7f048e08a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04881601b0 con 0x7f04880b3ff0 2023-12-22T08:40:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.113+0000 7f048e08a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04881590d0 con 0x7f0488157980 2023-12-22T08:40:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.113+0000 7f048c887640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04880b44a0 0x7f04881f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.113+0000 7f048c887640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04880b44a0 0x7f04881f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35070/0 (socket says 172.21.15.38:35070) 2023-12-22T08:40:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.113+0000 7f048c887640 1 -- 172.21.15.38:0/3873567096 learned_addr learned my addr 172.21.15.38:0/3873567096 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.113+0000 7f048d088640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04880b3ff0 0x7f04881f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.113+0000 7f048d889640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0488157980 0x7f048815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.114+0000 7f048c887640 1 -- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0488157980 msgr2=0x7f048815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.114+0000 7f048c887640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0488157980 0x7f048815cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.114+0000 7f048c887640 1 -- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04880b3ff0 msgr2=0x7f04881f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.114+0000 7f048c887640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04880b3ff0 0x7f04881f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.114+0000 7f048c887640 1 -- 172.21.15.38:0/3873567096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0484009400 con 0x7f04880b44a0 2023-12-22T08:40:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.114+0000 7f048c887640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04880b44a0 0x7f04881f5770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f047800d5f0 tx=0x7f047800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.114+0000 7f047dffb640 1 -- 172.21.15.38:0/3873567096 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04780125f0 con 0x7f04880b44a0 2023-12-22T08:40:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.114+0000 7f047dffb640 1 -- 172.21.15.38:0/3873567096 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0478012750 con 0x7f04880b44a0 2023-12-22T08:40:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.114+0000 7f047dffb640 1 -- 172.21.15.38:0/3873567096 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478012b00 con 0x7f04880b44a0 2023-12-22T08:40:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.114+0000 7f048e08a640 1 -- 172.21.15.38:0/3873567096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04881593b0 con 0x7f04880b44a0 2023-12-22T08:40:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.114+0000 7f048e08a640 1 -- 172.21.15.38:0/3873567096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048815faf0 con 0x7f04880b44a0 2023-12-22T08:40:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.116+0000 7f048e08a640 1 -- 172.21.15.38:0/3873567096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0488158f30 con 0x7f04880b44a0 2023-12-22T08:40:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.116+0000 7f047dffb640 1 -- 172.21.15.38:0/3873567096 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0478012c60 con 0x7f04880b44a0 2023-12-22T08:40:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.117+0000 7f047dffb640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f046c06a460 0x7f046c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.117+0000 7f047dffb640 1 -- 172.21.15.38:0/3873567096 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0478088d70 con 0x7f04880b44a0 2023-12-22T08:40:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.118+0000 7f048d088640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f046c06a460 0x7f046c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.119+0000 7f048d088640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f046c06a460 0x7f046c06c920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0484036000 tx=0x7f048403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:15.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.121+0000 7f047dffb640 1 -- 172.21.15.38:0/3873567096 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0488158f30 con 0x7f04880b44a0 2023-12-22T08:40:15.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.356+0000 7f048e08a640 1 -- 172.21.15.38:0/3873567096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0488158f30 con 0x7f04880b44a0 2023-12-22T08:40:15.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.357+0000 7f047dffb640 1 -- 172.21.15.38:0/3873567096 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0488158f30 con 0x7f04880b44a0 2023-12-22T08:40:15.360 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:15.360 INFO:teuthology.orchestra.run.smithi038.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-22T08:40:15.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.360+0000 7f048e08a640 1 -- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f046c06a460 msgr2=0x7f046c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:15.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.360+0000 7f048e08a640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f046c06a460 0x7f046c06c920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0484036000 tx=0x7f048403c040 comp rx=0 tx=0).stop 2023-12-22T08:40:15.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.360+0000 7f048e08a640 1 -- 172.21.15.38:0/3873567096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04880b44a0 msgr2=0x7f04881f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.360+0000 7f048e08a640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04880b44a0 0x7f04881f5770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f047800d5f0 tx=0x7f047800dab0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.360+0000 7f048e08a640 1 -- 172.21.15.38:0/3873567096 shutdown_connections 2023-12-22T08:40:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.360+0000 7f048e08a640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0488157980 0x7f048815cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.360+0000 7f048e08a640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f046c06a460 0x7f046c06c920 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.360+0000 7f048e08a640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04880b44a0 0x7f04881f5770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.360+0000 7f048e08a640 1 --2- 172.21.15.38:0/3873567096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04880b3ff0 0x7f04881f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.360+0000 7f048e08a640 1 -- 172.21.15.38:0/3873567096 >> 172.21.15.38:0/3873567096 conn(0x7f04880d31f0 msgr2=0x7f0488156b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.361+0000 7f048e08a640 1 -- 172.21.15.38:0/3873567096 shutdown_connections 2023-12-22T08:40:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.361+0000 7f048e08a640 1 -- 172.21.15.38:0/3873567096 wait complete. 2023-12-22T08:40:15.384 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-22T08:40:15.384 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:15.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.605+0000 7f0f9359e640 1 Processor -- start 2023-12-22T08:40:15.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.605+0000 7f0f9359e640 1 -- start start 2023-12-22T08:40:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.607+0000 7f0f9359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9415b420 0x7f0f9406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.607+0000 7f0f9359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0f94071000 0x7f0f9415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.607+0000 7f0f9359e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f940cdae0 con 0x7f0f940a44a0 2023-12-22T08:40:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.607+0000 7f0f9359e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9406dec0 con 0x7f0f94071000 2023-12-22T08:40:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.607+0000 7f0f9359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9415b800 con 0x7f0f9415b420 2023-12-22T08:40:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.607+0000 7f0f91d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0f940a44a0 0x7f0f940708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49784/0 (socket says 172.21.15.38:49784) 2023-12-22T08:40:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.607+0000 7f0f91d9b640 1 -- 172.21.15.38:0/4041321084 learned_addr learned my addr 172.21.15.38:0/4041321084 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.607+0000 7f0f9259c640 1 --2- 172.21.15.38:0/4041321084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9415b420 0x7f0f9406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.607+0000 7f0f92d9d640 1 --2- 172.21.15.38:0/4041321084 >> v2:172.21.15.89:3300/0 conn(0x7f0f94071000 0x7f0f9415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.607+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247376012 0 0) 0x7f0f940cdae0 con 0x7f0f940a44a0 2023-12-22T08:40:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f7c003520 con 0x7f0f940a44a0 2023-12-22T08:40:15.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1243006035 0 0) 0x7f0f7c003520 con 0x7f0f940a44a0 2023-12-22T08:40:15.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9415b420 msgr2=0x7f0f9406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:15.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 --2- 172.21.15.38:0/4041321084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9415b420 0x7f0f9406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 >> v2:172.21.15.89:3300/0 conn(0x7f0f94071000 msgr2=0x7f0f9415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:15.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 --2- 172.21.15.38:0/4041321084 >> v2:172.21.15.89:3300/0 conn(0x7f0f94071000 0x7f0f9415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f940cdd30 con 0x7f0f940a44a0 2023-12-22T08:40:15.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f0f88001670 con 0x7f0f940a44a0 2023-12-22T08:40:15.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 >> v1:172.21.15.38:6789/0 conn(0x7f0f940a44a0 legacy=0x7f0f940708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:15.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 --2- 172.21.15.38:0/4041321084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f7c003970 0x7f0f7c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 --2- 172.21.15.38:0/4041321084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9415b420 0x7f0f7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 --2- 172.21.15.38:0/4041321084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f7c004d00 0x7f0f7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9406dec0 con 0x7f0f7c003970 2023-12-22T08:40:15.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9415b800 con 0x7f0f7c004d00 2023-12-22T08:40:15.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c00b980 con 0x7f0f9415b420 2023-12-22T08:40:15.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.608+0000 7f0f9259c640 1 --2- 172.21.15.38:0/4041321084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f7c003970 0x7f0f7c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.609+0000 7f0f91d9b640 1 --2- 172.21.15.38:0/4041321084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9415b420 0x7f0f7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.609+0000 7f0f9259c640 1 -- 172.21.15.38:0/4041321084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9415b420 msgr2=0x7f0f7c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:15.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.609+0000 7f0f9259c640 1 --2- 172.21.15.38:0/4041321084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9415b420 0x7f0f7c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.609+0000 7f0f92d9d640 1 --2- 172.21.15.38:0/4041321084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f7c004d00 0x7f0f7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.609+0000 7f0f9259c640 1 -- 172.21.15.38:0/4041321084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f7c004d00 msgr2=0x7f0f7c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:15.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.609+0000 7f0f9259c640 1 --2- 172.21.15.38:0/4041321084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f7c004d00 0x7f0f7c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.609+0000 7f0f9259c640 1 -- 172.21.15.38:0/4041321084 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c003520 con 0x7f0f7c003970 2023-12-22T08:40:15.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.609+0000 7f0f91d9b640 1 --2- 172.21.15.38:0/4041321084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9415b420 0x7f0f7c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:15.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.610+0000 7f0f9259c640 1 --2- 172.21.15.38:0/4041321084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f7c003970 0x7f0f7c003d90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009ac0 tx=0x7f0f7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5974ca6a9f908db server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:15.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.610+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8402c6b0 con 0x7f0f7c003970 2023-12-22T08:40:15.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.610+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8402c810 con 0x7f0f7c003970 2023-12-22T08:40:15.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.610+0000 7f0f9159a640 1 -- 172.21.15.38:0/4041321084 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8402cba0 con 0x7f0f7c003970 2023-12-22T08:40:15.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.611+0000 7f0f9359e640 1 -- 172.21.15.38:0/4041321084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f7c003970 msgr2=0x7f0f7c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:15.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.611+0000 7f0f9359e640 1 --2- 172.21.15.38:0/4041321084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f7c003970 0x7f0f7c003d90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009ac0 tx=0x7f0f7c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.611+0000 7f0f92d9d640 1 -- 172.21.15.38:0/4041321084 reap_dead start 2023-12-22T08:40:15.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.611+0000 7f0f9359e640 1 -- 172.21.15.38:0/4041321084 shutdown_connections 2023-12-22T08:40:15.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.611+0000 7f0f9359e640 1 -- 172.21.15.38:0/4041321084 >> 172.21.15.38:0/4041321084 conn(0x7f0f940b1f70 msgr2=0x7f0f940b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:15.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.611+0000 7f0f9359e640 1 -- 172.21.15.38:0/4041321084 shutdown_connections 2023-12-22T08:40:15.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.611+0000 7f0f9359e640 1 -- 172.21.15.38:0/4041321084 wait complete. 2023-12-22T08:40:15.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.613+0000 7f0f9359e640 1 Processor -- start 2023-12-22T08:40:15.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.613+0000 7f0f9359e640 1 -- start start 2023-12-22T08:40:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.614+0000 7f0f9359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f7c003970 0x7f0f9406c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.614+0000 7f0f9359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f940a2bc0 0x7f0f940a3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.614+0000 7f0f9359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f940a3580 0x7f0f941586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.614+0000 7f0f9359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f940a3a00 con 0x7f0f940a2bc0 2023-12-22T08:40:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.614+0000 7f0f9359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f941479e0 con 0x7f0f940a3580 2023-12-22T08:40:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.614+0000 7f0f9359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f94157bc0 con 0x7f0f7c003970 2023-12-22T08:40:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.615+0000 7f0f91d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f940a2bc0 0x7f0f940a3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.615+0000 7f0f91d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f940a2bc0 0x7f0f940a3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35096/0 (socket says 172.21.15.38:35096) 2023-12-22T08:40:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.615+0000 7f0f91d9b640 1 -- 172.21.15.38:0/1459678550 learned_addr learned my addr 172.21.15.38:0/1459678550 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.615+0000 7f0f9259c640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f7c003970 0x7f0f9406c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.615+0000 7f0f92d9d640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f940a3580 0x7f0f941586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.615+0000 7f0f91d9b640 1 -- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f7c003970 msgr2=0x7f0f9406c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:15.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.615+0000 7f0f91d9b640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f7c003970 0x7f0f9406c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.615+0000 7f0f91d9b640 1 -- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f940a3580 msgr2=0x7f0f941586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:15.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.615+0000 7f0f91d9b640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f940a3580 0x7f0f941586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.615+0000 7f0f91d9b640 1 -- 172.21.15.38:0/1459678550 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f94157ea0 con 0x7f0f940a2bc0 2023-12-22T08:40:15.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.615+0000 7f0f91d9b640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f940a2bc0 0x7f0f940a3040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800d7f0 tx=0x7f0f8800dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:15.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.616+0000 7f0f82ffd640 1 -- 172.21.15.38:0/1459678550 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f880074e0 con 0x7f0f940a2bc0 2023-12-22T08:40:15.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.616+0000 7f0f82ffd640 1 -- 172.21.15.38:0/1459678550 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f88007640 con 0x7f0f940a2bc0 2023-12-22T08:40:15.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.616+0000 7f0f82ffd640 1 -- 172.21.15.38:0/1459678550 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88004a00 con 0x7f0f940a2bc0 2023-12-22T08:40:15.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.616+0000 7f0f9359e640 1 -- 172.21.15.38:0/1459678550 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f94158180 con 0x7f0f940a2bc0 2023-12-22T08:40:15.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.616+0000 7f0f9359e640 1 -- 172.21.15.38:0/1459678550 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9406c740 con 0x7f0f940a2bc0 2023-12-22T08:40:15.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.617+0000 7f0f9359e640 1 -- 172.21.15.38:0/1459678550 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f94061910 con 0x7f0f940a2bc0 2023-12-22T08:40:15.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.618+0000 7f0f82ffd640 1 -- 172.21.15.38:0/1459678550 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f88004b60 con 0x7f0f940a2bc0 2023-12-22T08:40:15.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.619+0000 7f0f82ffd640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f7406a430 0x7f0f7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:15.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.619+0000 7f0f82ffd640 1 -- 172.21.15.38:0/1459678550 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f88088210 con 0x7f0f940a2bc0 2023-12-22T08:40:15.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.619+0000 7f0f9259c640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f7406a430 0x7f0f7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:15.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.620+0000 7f0f9259c640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f7406a430 0x7f0f7406c8f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f84036000 tx=0x7f0f84030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:15.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.623+0000 7f0f82ffd640 1 -- 172.21.15.38:0/1459678550 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0f88053890 con 0x7f0f940a2bc0 2023-12-22T08:40:15.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.809+0000 7f0f9359e640 1 -- 172.21.15.38:0/1459678550 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f940cb5c0 con 0x7f0f940a2bc0 2023-12-22T08:40:15.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.811+0000 7f0f82ffd640 1 -- 172.21.15.38:0/1459678550 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f0f88056eb0 con 0x7f0f940a2bc0 2023-12-22T08:40:15.814 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:15.814 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:59.604518+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:15.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.813+0000 7f0f9359e640 1 -- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f7406a430 msgr2=0x7f0f7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:15.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.813+0000 7f0f9359e640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f7406a430 0x7f0f7406c8f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f84036000 tx=0x7f0f84030000 comp rx=0 tx=0).stop 2023-12-22T08:40:15.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.814+0000 7f0f9359e640 1 -- 172.21.15.38:0/1459678550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f940a2bc0 msgr2=0x7f0f940a3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:15.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.814+0000 7f0f9359e640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f940a2bc0 0x7f0f940a3040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800d7f0 tx=0x7f0f8800dcb0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.814+0000 7f0f9359e640 1 -- 172.21.15.38:0/1459678550 shutdown_connections 2023-12-22T08:40:15.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.814+0000 7f0f9359e640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f940a3580 0x7f0f941586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.814+0000 7f0f9359e640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f7406a430 0x7f0f7406c8f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.814+0000 7f0f9359e640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f940a2bc0 0x7f0f940a3040 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.814+0000 7f0f9359e640 1 --2- 172.21.15.38:0/1459678550 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f7c003970 0x7f0f9406c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:15.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.814+0000 7f0f9359e640 1 -- 172.21.15.38:0/1459678550 >> 172.21.15.38:0/1459678550 conn(0x7f0f940b1f70 msgr2=0x7f0f9415d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:15.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.814+0000 7f0f9359e640 1 -- 172.21.15.38:0/1459678550 shutdown_connections 2023-12-22T08:40:15.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:15.814+0000 7f0f9359e640 1 -- 172.21.15.38:0/1459678550 wait complete. 2023-12-22T08:40:15.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:39:56.873963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:39:57.616447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:15.836 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:15.890 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:40:15.896 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:40:16.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.039+0000 7f1685fea640 1 Processor -- start 2023-12-22T08:40:16.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.039+0000 7f1685fea640 1 -- start start 2023-12-22T08:40:16.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.040+0000 7f1685fea640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1680070f50 0x7f16800713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.040+0000 7f1685fea640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1680162d40 0x7f1680165130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.040+0000 7f1685fea640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168006d5f0 con 0x7f1680070b70 2023-12-22T08:40:16.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.040+0000 7f1685fea640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1680144fa0 con 0x7f1680162d40 2023-12-22T08:40:16.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.040+0000 7f1685fea640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168006da80 con 0x7f1680070f50 2023-12-22T08:40:16.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.041+0000 7f16857e9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1680162d40 0x7f1680165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.041+0000 7f16857e9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1680162d40 0x7f1680165130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35110/0 (socket says 172.21.15.38:35110) 2023-12-22T08:40:16.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.041+0000 7f16857e9640 1 -- 172.21.15.38:0/1279130039 learned_addr learned my addr 172.21.15.38:0/1279130039 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:16.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.041+0000 7f167ffff640 1 --2- 172.21.15.38:0/1279130039 >> v2:172.21.15.89:3300/0 conn(0x7f1680070f50 0x7f16800713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.041+0000 7f16857e9640 1 -- 172.21.15.38:0/1279130039 >> v2:172.21.15.89:3300/0 conn(0x7f1680070f50 msgr2=0x7f16800713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:16.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.041+0000 7f16857e9640 1 --2- 172.21.15.38:0/1279130039 >> v2:172.21.15.89:3300/0 conn(0x7f1680070f50 0x7f16800713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.041+0000 7f16857e9640 1 -- 172.21.15.38:0/1279130039 >> v1:172.21.15.89:6789/0 conn(0x7f1680070b70 legacy=0x7f168006bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.041+0000 7f16857e9640 1 -- 172.21.15.38:0/1279130039 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168006c9e0 con 0x7f1680162d40 2023-12-22T08:40:16.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.041+0000 7f167ffff640 1 --2- 172.21.15.38:0/1279130039 >> v2:172.21.15.89:3300/0 conn(0x7f1680070f50 0x7f16800713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:16.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.042+0000 7f16857e9640 1 --2- 172.21.15.38:0/1279130039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1680162d40 0x7f1680165130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f168009d0f0 tx=0x7f167802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0deaf8a743b35b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:16.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.043+0000 7f167f7fe640 1 -- 172.21.15.38:0/1279130039 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167802cb20 con 0x7f1680162d40 2023-12-22T08:40:16.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.043+0000 7f167f7fe640 1 -- 172.21.15.38:0/1279130039 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167802cc80 con 0x7f1680162d40 2023-12-22T08:40:16.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.043+0000 7f167f7fe640 1 -- 172.21.15.38:0/1279130039 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16780343f0 con 0x7f1680162d40 2023-12-22T08:40:16.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.043+0000 7f1685fea640 1 -- 172.21.15.38:0/1279130039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1680162d40 msgr2=0x7f1680165130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.043+0000 7f1685fea640 1 --2- 172.21.15.38:0/1279130039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1680162d40 0x7f1680165130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f168009d0f0 tx=0x7f167802bf80 comp rx=0 tx=0).stop 2023-12-22T08:40:16.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.043+0000 7f1685fea640 1 -- 172.21.15.38:0/1279130039 shutdown_connections 2023-12-22T08:40:16.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.043+0000 7f1685fea640 1 --2- 172.21.15.38:0/1279130039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1680162d40 0x7f1680165130 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.043+0000 7f1685fea640 1 --2- 172.21.15.38:0/1279130039 >> v2:172.21.15.89:3300/0 conn(0x7f1680070f50 0x7f16800713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.043+0000 7f1685fea640 1 -- 172.21.15.38:0/1279130039 >> 172.21.15.38:0/1279130039 conn(0x7f16800b0b60 msgr2=0x7f16800b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:16.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.043+0000 7f1685fea640 1 -- 172.21.15.38:0/1279130039 shutdown_connections 2023-12-22T08:40:16.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.043+0000 7f1685fea640 1 -- 172.21.15.38:0/1279130039 wait complete. 2023-12-22T08:40:16.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.045+0000 7f1685fea640 1 Processor -- start 2023-12-22T08:40:16.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.045+0000 7f1685fea640 1 -- start start 2023-12-22T08:40:16.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.046+0000 7f1685fea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1680070b70 0x7f168015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.046+0000 7f1685fea640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1680070f50 0x7f16800ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.046+0000 7f1685fea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1680162d40 0x7f168013f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.046+0000 7f1685fea640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800abe40 con 0x7f1680162d40 2023-12-22T08:40:16.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.046+0000 7f1685fea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800ac0e0 con 0x7f1680070b70 2023-12-22T08:40:16.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.046+0000 7f1685fea640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16800ac3c0 con 0x7f1680070f50 2023-12-22T08:40:16.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.046+0000 7f16857e9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1680162d40 0x7f168013f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.046+0000 7f16857e9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1680162d40 0x7f168013f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35126/0 (socket says 172.21.15.38:35126) 2023-12-22T08:40:16.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.046+0000 7f16857e9640 1 -- 172.21.15.38:0/3729598794 learned_addr learned my addr 172.21.15.38:0/3729598794 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:16.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.046+0000 7f1684fe8640 1 --2- 172.21.15.38:0/3729598794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1680070b70 0x7f168015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.047+0000 7f16857e9640 1 -- 172.21.15.38:0/3729598794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1680070f50 msgr2=0x7f16800ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.047+0000 7f16857e9640 1 --2- 172.21.15.38:0/3729598794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1680070f50 0x7f16800ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.047+0000 7f16857e9640 1 -- 172.21.15.38:0/3729598794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1680070b70 msgr2=0x7f168015ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.047+0000 7f16857e9640 1 --2- 172.21.15.38:0/3729598794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1680070b70 0x7f168015ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.047+0000 7f16857e9640 1 -- 172.21.15.38:0/3729598794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678009b30 con 0x7f1680162d40 2023-12-22T08:40:16.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.047+0000 7f16857e9640 1 --2- 172.21.15.38:0/3729598794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1680162d40 0x7f168013f400 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1678036040 tx=0x7f1678004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:16.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.047+0000 7f167d7fa640 1 -- 172.21.15.38:0/3729598794 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1678009510 con 0x7f1680162d40 2023-12-22T08:40:16.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.047+0000 7f167d7fa640 1 -- 172.21.15.38:0/3729598794 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167802c920 con 0x7f1680162d40 2023-12-22T08:40:16.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.047+0000 7f167d7fa640 1 -- 172.21.15.38:0/3729598794 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167803e690 con 0x7f1680162d40 2023-12-22T08:40:16.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.047+0000 7f1685fea640 1 -- 172.21.15.38:0/3729598794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16800ac6a0 con 0x7f1680162d40 2023-12-22T08:40:16.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.047+0000 7f1685fea640 1 -- 172.21.15.38:0/3729598794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1680099a70 con 0x7f1680162d40 2023-12-22T08:40:16.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.049+0000 7f1685fea640 1 -- 172.21.15.38:0/3729598794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16800acb60 con 0x7f1680162d40 2023-12-22T08:40:16.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.049+0000 7f167d7fa640 1 -- 172.21.15.38:0/3729598794 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f167803e7f0 con 0x7f1680162d40 2023-12-22T08:40:16.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.050+0000 7f167d7fa640 1 --2- 172.21.15.38:0/3729598794 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f166406a430 0x7f166406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.050+0000 7f167d7fa640 1 -- 172.21.15.38:0/3729598794 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16780ab4f0 con 0x7f1680162d40 2023-12-22T08:40:16.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.051+0000 7f1684fe8640 1 --2- 172.21.15.38:0/3729598794 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f166406a430 0x7f166406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.052+0000 7f1684fe8640 1 --2- 172.21.15.38:0/3729598794 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f166406a430 0x7f166406c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16800ad060 tx=0x7f1674009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:16.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.054+0000 7f167d7fa640 1 -- 172.21.15.38:0/3729598794 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1678076a40 con 0x7f1680162d40 2023-12-22T08:40:16.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.257+0000 7f1685fea640 1 -- 172.21.15.38:0/3729598794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1680061910 con 0x7f1680162d40 2023-12-22T08:40:16.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.258+0000 7f167d7fa640 1 -- 172.21.15.38:0/3729598794 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f167807a060 con 0x7f1680162d40 2023-12-22T08:40:16.261 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:40:16.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.260+0000 7f1685fea640 1 -- 172.21.15.38:0/3729598794 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f166406a430 msgr2=0x7f166406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.260+0000 7f1685fea640 1 --2- 172.21.15.38:0/3729598794 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f166406a430 0x7f166406c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16800ad060 tx=0x7f1674009040 comp rx=0 tx=0).stop 2023-12-22T08:40:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.260+0000 7f1685fea640 1 -- 172.21.15.38:0/3729598794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1680162d40 msgr2=0x7f168013f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.260+0000 7f1685fea640 1 --2- 172.21.15.38:0/3729598794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1680162d40 0x7f168013f400 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1678036040 tx=0x7f1678004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.261+0000 7f1685fea640 1 -- 172.21.15.38:0/3729598794 shutdown_connections 2023-12-22T08:40:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.261+0000 7f1685fea640 1 --2- 172.21.15.38:0/3729598794 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f166406a430 0x7f166406c8f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.261+0000 7f1685fea640 1 --2- 172.21.15.38:0/3729598794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1680162d40 0x7f168013f400 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.261+0000 7f1685fea640 1 --2- 172.21.15.38:0/3729598794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1680070f50 0x7f16800ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.261+0000 7f1685fea640 1 --2- 172.21.15.38:0/3729598794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1680070b70 0x7f168015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.261+0000 7f1685fea640 1 -- 172.21.15.38:0/3729598794 >> 172.21.15.38:0/3729598794 conn(0x7f16800b0b60 msgr2=0x7f16800cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.261+0000 7f1685fea640 1 -- 172.21.15.38:0/3729598794 shutdown_connections 2023-12-22T08:40:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.261+0000 7f1685fea640 1 -- 172.21.15.38:0/3729598794 wait complete. 2023-12-22T08:40:16.282 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:16.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.507+0000 7fb9c939b640 1 Processor -- start 2023-12-22T08:40:16.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.507+0000 7fb9c939b640 1 -- start start 2023-12-22T08:40:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.509+0000 7fb9c939b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9c4071d80 0x7fb9c40a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.509+0000 7fb9c939b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb9c40a35a0 0x7fb9c4161040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.509+0000 7fb9c939b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c406c2a0 con 0x7fb9c4161580 2023-12-22T08:40:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.509+0000 7fb9c939b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c40a44a0 con 0x7fb9c40a35a0 2023-12-22T08:40:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.509+0000 7fb9c939b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c40a3a00 con 0x7fb9c4071d80 2023-12-22T08:40:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.509+0000 7fb9bb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb9c40a35a0 0x7fb9c4161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.509+0000 7fb9c8b9a640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb9c4161580 0x7fb9c415da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49796/0 (socket says 172.21.15.38:49796) 2023-12-22T08:40:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.509+0000 7fb9c8b9a640 1 -- 172.21.15.38:0/2310210677 learned_addr learned my addr 172.21.15.38:0/2310210677 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:16.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.509+0000 7fb9c3fff640 1 --2- 172.21.15.38:0/2310210677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9c4071d80 0x7fb9c40a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.510+0000 7fb9bb7fe640 1 -- 172.21.15.38:0/2310210677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9c4071d80 msgr2=0x7fb9c40a3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:16.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.510+0000 7fb9bb7fe640 1 --2- 172.21.15.38:0/2310210677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9c4071d80 0x7fb9c40a3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.510+0000 7fb9bb7fe640 1 -- 172.21.15.38:0/2310210677 >> v1:172.21.15.38:6789/0 conn(0x7fb9c4161580 legacy=0x7fb9c415da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.510+0000 7fb9bb7fe640 1 -- 172.21.15.38:0/2310210677 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c4072160 con 0x7fb9c40a35a0 2023-12-22T08:40:16.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.510+0000 7fb9c3fff640 1 --2- 172.21.15.38:0/2310210677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9c4071d80 0x7fb9c40a3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:16.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.510+0000 7fb9c37fe640 1 -- 172.21.15.38:0/2310210677 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382909346 0 0) 0x7fb9c406c2a0 con 0x7fb9c4161580 2023-12-22T08:40:16.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.511+0000 7fb9bb7fe640 1 --2- 172.21.15.38:0/2310210677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9c40a35a0 0x7fb9c4161040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0097a0 tx=0x7fb9ac02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c87edbb8df2adbc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:16.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.511+0000 7fb9c37fe640 1 -- 172.21.15.38:0/2310210677 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac02d040 con 0x7fb9c40a35a0 2023-12-22T08:40:16.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.511+0000 7fb9c37fe640 1 -- 172.21.15.38:0/2310210677 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac031810 con 0x7fb9c40a35a0 2023-12-22T08:40:16.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.511+0000 7fb9c37fe640 1 -- 172.21.15.38:0/2310210677 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac031ba0 con 0x7fb9c40a35a0 2023-12-22T08:40:16.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.512+0000 7fb9c939b640 1 -- 172.21.15.38:0/2310210677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9c40a35a0 msgr2=0x7fb9c4161040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.512+0000 7fb9c939b640 1 --2- 172.21.15.38:0/2310210677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9c40a35a0 0x7fb9c4161040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0097a0 tx=0x7fb9ac02b8b0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.512+0000 7fb9c939b640 1 -- 172.21.15.38:0/2310210677 shutdown_connections 2023-12-22T08:40:16.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.512+0000 7fb9c939b640 1 --2- 172.21.15.38:0/2310210677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9c40a35a0 0x7fb9c4161040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.512+0000 7fb9c939b640 1 --2- 172.21.15.38:0/2310210677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9c4071d80 0x7fb9c40a3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.512+0000 7fb9c939b640 1 -- 172.21.15.38:0/2310210677 >> 172.21.15.38:0/2310210677 conn(0x7fb9c40cf000 msgr2=0x7fb9c40cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:16.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.512+0000 7fb9c939b640 1 -- 172.21.15.38:0/2310210677 shutdown_connections 2023-12-22T08:40:16.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.512+0000 7fb9c939b640 1 -- 172.21.15.38:0/2310210677 wait complete. 2023-12-22T08:40:16.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.514+0000 7fb9c939b640 1 Processor -- start 2023-12-22T08:40:16.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.514+0000 7fb9c939b640 1 -- start start 2023-12-22T08:40:16.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.515+0000 7fb9c939b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9c4071d80 0x7fb9c41f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.515+0000 7fb9c939b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9c40a35a0 0x7fb9c41f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.515+0000 7fb9c939b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c4161580 0x7fb9c4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.515+0000 7fb9c939b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c41f3970 con 0x7fb9c4071d80 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.515+0000 7fb9c939b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c41f6670 con 0x7fb9c4161580 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.515+0000 7fb9c939b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c40af900 con 0x7fb9c40a35a0 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.515+0000 7fb9c3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9c4071d80 0x7fb9c41f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.515+0000 7fb9c3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9c4071d80 0x7fb9c41f6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35136/0 (socket says 172.21.15.38:35136) 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.515+0000 7fb9c3fff640 1 -- 172.21.15.38:0/3212671026 learned_addr learned my addr 172.21.15.38:0/3212671026 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.516+0000 7fb9bb7fe640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9c40a35a0 0x7fb9c41f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.516+0000 7fb9c3fff640 1 -- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9c40a35a0 msgr2=0x7fb9c41f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.516+0000 7fb9c3fff640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9c40a35a0 0x7fb9c41f3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.516+0000 7fb9c3fff640 1 -- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c4161580 msgr2=0x7fb9c4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.516+0000 7fb9c8b9a640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c4161580 0x7fb9c4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.516+0000 7fb9c3fff640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c4161580 0x7fb9c4151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.516+0000 7fb9c3fff640 1 -- 172.21.15.38:0/3212671026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac009400 con 0x7fb9c4071d80 2023-12-22T08:40:16.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.516+0000 7fb9c3fff640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9c4071d80 0x7fb9c41f6b00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009fc0 tx=0x7fb9b400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:16.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.516+0000 7fb9c17fa640 1 -- 172.21.15.38:0/3212671026 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4003b90 con 0x7fb9c4071d80 2023-12-22T08:40:16.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.516+0000 7fb9c17fa640 1 -- 172.21.15.38:0/3212671026 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b400f040 con 0x7fb9c4071d80 2023-12-22T08:40:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.517+0000 7fb9c17fa640 1 -- 172.21.15.38:0/3212671026 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4004030 con 0x7fb9c4071d80 2023-12-22T08:40:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.517+0000 7fb9c939b640 1 -- 172.21.15.38:0/3212671026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c41f6020 con 0x7fb9c4071d80 2023-12-22T08:40:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.517+0000 7fb9c939b640 1 -- 172.21.15.38:0/3212671026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c40b0590 con 0x7fb9c4071d80 2023-12-22T08:40:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.518+0000 7fb9c939b640 1 -- 172.21.15.38:0/3212671026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c4061910 con 0x7fb9c4071d80 2023-12-22T08:40:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.519+0000 7fb9c17fa640 1 -- 172.21.15.38:0/3212671026 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb9b4004190 con 0x7fb9c4071d80 2023-12-22T08:40:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.520+0000 7fb9c17fa640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb9a406a430 0x7fb9a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.520+0000 7fb9c17fa640 1 -- 172.21.15.38:0/3212671026 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9b4088c60 con 0x7fb9c4071d80 2023-12-22T08:40:16.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.520+0000 7fb9bb7fe640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb9a406a430 0x7fb9a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.521+0000 7fb9bb7fe640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb9a406a430 0x7fb9a406c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac036000 tx=0x7fb9ac03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:16.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.524+0000 7fb9c17fa640 1 -- 172.21.15.38:0/3212671026 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb9b4054270 con 0x7fb9c4071d80 2023-12-22T08:40:16.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.718+0000 7fb9c939b640 1 -- 172.21.15.38:0/3212671026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9c415b370 con 0x7fb9c4071d80 2023-12-22T08:40:16.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.719+0000 7fb9c17fa640 1 -- 172.21.15.38:0/3212671026 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9b4057890 con 0x7fb9c4071d80 2023-12-22T08:40:16.722 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:40:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.721+0000 7fb9c939b640 1 -- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb9a406a430 msgr2=0x7fb9a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.721+0000 7fb9c939b640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb9a406a430 0x7fb9a406c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac036000 tx=0x7fb9ac03c040 comp rx=0 tx=0).stop 2023-12-22T08:40:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.722+0000 7fb9c939b640 1 -- 172.21.15.38:0/3212671026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9c4071d80 msgr2=0x7fb9c41f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.722+0000 7fb9c939b640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9c4071d80 0x7fb9c41f6b00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009fc0 tx=0x7fb9b400d560 comp rx=0 tx=0).stop 2023-12-22T08:40:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.722+0000 7fb9c939b640 1 -- 172.21.15.38:0/3212671026 shutdown_connections 2023-12-22T08:40:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.722+0000 7fb9c939b640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c4161580 0x7fb9c4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.722+0000 7fb9c939b640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9c40a35a0 0x7fb9c41f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.722+0000 7fb9c939b640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb9a406a430 0x7fb9a406c8f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.722+0000 7fb9c939b640 1 --2- 172.21.15.38:0/3212671026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9c4071d80 0x7fb9c41f6b00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.722+0000 7fb9c939b640 1 -- 172.21.15.38:0/3212671026 >> 172.21.15.38:0/3212671026 conn(0x7fb9c40cf000 msgr2=0x7fb9c415e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.722+0000 7fb9c939b640 1 -- 172.21.15.38:0/3212671026 shutdown_connections 2023-12-22T08:40:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.722+0000 7fb9c939b640 1 -- 172.21.15.38:0/3212671026 wait complete. 2023-12-22T08:40:16.742 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:16.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.924+0000 7f29db28b640 1 Processor -- start 2023-12-22T08:40:16.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.924+0000 7f29db28b640 1 -- start start 2023-12-22T08:40:16.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.925+0000 7f29db28b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29d406df00 0x7f29d40ac360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.925+0000 7f29db28b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d4071da0 con 0x7f29d4070360 2023-12-22T08:40:16.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.925+0000 7f29db28b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d40b4ca0 con 0x7f29d415d840 2023-12-22T08:40:16.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.925+0000 7f29db28b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d40b4f80 con 0x7f29d406df00 2023-12-22T08:40:16.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.926+0000 7f29d8826640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29d406df00 0x7f29d40ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.926+0000 7f29d9828640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f29d4070360 0x7f29d40ac8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49808/0 (socket says 172.21.15.38:49808) 2023-12-22T08:40:16.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.926+0000 7f29d8826640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29d406df00 0x7f29d40ac360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35152/0 (socket says 172.21.15.38:35152) 2023-12-22T08:40:16.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.926+0000 7f29d9828640 1 -- 172.21.15.38:0/2791271356 learned_addr learned my addr 172.21.15.38:0/2791271356 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:16.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.926+0000 7f29d8826640 1 -- 172.21.15.38:0/2791271356 >> v1:172.21.15.89:6789/0 conn(0x7f29d415d840 legacy=0x7f29d406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.926+0000 7f29d8826640 1 -- 172.21.15.38:0/2791271356 >> v1:172.21.15.38:6789/0 conn(0x7f29d4070360 legacy=0x7f29d40ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.926+0000 7f29d8826640 1 -- 172.21.15.38:0/2791271356 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40b5260 con 0x7f29d406df00 2023-12-22T08:40:16.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.928+0000 7f29d8826640 1 --2- 172.21.15.38:0/2791271356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29d406df00 0x7f29d40ac360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f29c40097a0 tx=0x7f29c402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d6b8429a5bf5dc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:16.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.928+0000 7f29cbfff640 1 -- 172.21.15.38:0/2791271356 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4030610 con 0x7f29d406df00 2023-12-22T08:40:16.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.928+0000 7f29cbfff640 1 -- 172.21.15.38:0/2791271356 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c4030770 con 0x7f29d406df00 2023-12-22T08:40:16.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.928+0000 7f29cbfff640 1 -- 172.21.15.38:0/2791271356 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4030b00 con 0x7f29d406df00 2023-12-22T08:40:16.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.929+0000 7f29db28b640 1 -- 172.21.15.38:0/2791271356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29d406df00 msgr2=0x7f29d40ac360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.929+0000 7f29db28b640 1 --2- 172.21.15.38:0/2791271356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29d406df00 0x7f29d40ac360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f29c40097a0 tx=0x7f29c402b960 comp rx=0 tx=0).stop 2023-12-22T08:40:16.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.929+0000 7f29db28b640 1 -- 172.21.15.38:0/2791271356 shutdown_connections 2023-12-22T08:40:16.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.929+0000 7f29db28b640 1 --2- 172.21.15.38:0/2791271356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29d406df00 0x7f29d40ac360 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.929+0000 7f29db28b640 1 -- 172.21.15.38:0/2791271356 >> 172.21.15.38:0/2791271356 conn(0x7f29d40cf440 msgr2=0x7f29d40cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:16.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.929+0000 7f29db28b640 1 -- 172.21.15.38:0/2791271356 shutdown_connections 2023-12-22T08:40:16.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.929+0000 7f29db28b640 1 -- 172.21.15.38:0/2791271356 wait complete. 2023-12-22T08:40:16.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.931+0000 7f29db28b640 1 Processor -- start 2023-12-22T08:40:16.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.931+0000 7f29db28b640 1 -- start start 2023-12-22T08:40:16.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.932+0000 7f29db28b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29d406df00 0x7f29d414e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.932+0000 7f29db28b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29d4070360 0x7f29d40ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.932+0000 7f29db28b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29d415d840 0x7f29d40ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.932+0000 7f29db28b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d415e6a0 con 0x7f29d4070360 2023-12-22T08:40:16.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.932+0000 7f29db28b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d4157d00 con 0x7f29d406df00 2023-12-22T08:40:16.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.932+0000 7f29db28b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d4157fe0 con 0x7f29d415d840 2023-12-22T08:40:16.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.932+0000 7f29d8826640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29d4070360 0x7f29d40ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.932+0000 7f29d8826640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29d4070360 0x7f29d40ac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35154/0 (socket says 172.21.15.38:35154) 2023-12-22T08:40:16.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.932+0000 7f29d8826640 1 -- 172.21.15.38:0/1611719464 learned_addr learned my addr 172.21.15.38:0/1611719464 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.933+0000 7f29d8826640 1 -- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29d415d840 msgr2=0x7f29d40ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.933+0000 7f29d8826640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29d415d840 0x7f29d40ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.933+0000 7f29d8826640 1 -- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29d406df00 msgr2=0x7f29d414e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.933+0000 7f29d9027640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29d406df00 0x7f29d414e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.933+0000 7f29d8826640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29d406df00 0x7f29d414e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.933+0000 7f29d8826640 1 -- 172.21.15.38:0/1611719464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c4009400 con 0x7f29d4070360 2023-12-22T08:40:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.933+0000 7f29d9027640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29d406df00 0x7f29d414e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.933+0000 7f29d8826640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29d4070360 0x7f29d40ac270 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29c402bf70 tx=0x7f29c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.933+0000 7f29c9ffb640 1 -- 172.21.15.38:0/1611719464 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c403e040 con 0x7f29d4070360 2023-12-22T08:40:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.934+0000 7f29c9ffb640 1 -- 172.21.15.38:0/1611719464 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c4039cb0 con 0x7f29d4070360 2023-12-22T08:40:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.934+0000 7f29c9ffb640 1 -- 172.21.15.38:0/1611719464 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4044630 con 0x7f29d4070360 2023-12-22T08:40:16.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.934+0000 7f29db28b640 1 -- 172.21.15.38:0/1611719464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d415e2c0 con 0x7f29d4070360 2023-12-22T08:40:16.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.934+0000 7f29db28b640 1 -- 172.21.15.38:0/1611719464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d414edb0 con 0x7f29d4070360 2023-12-22T08:40:16.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.935+0000 7f29db28b640 1 -- 172.21.15.38:0/1611719464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d415e7e0 con 0x7f29d4070360 2023-12-22T08:40:16.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.937+0000 7f29c9ffb640 1 -- 172.21.15.38:0/1611719464 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f29c4043390 con 0x7f29d4070360 2023-12-22T08:40:16.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.938+0000 7f29c9ffb640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29b806a430 0x7f29b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:16.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.938+0000 7f29c9ffb640 1 -- 172.21.15.38:0/1611719464 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29c40aabe0 con 0x7f29d4070360 2023-12-22T08:40:16.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.939+0000 7f29d9027640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29b806a430 0x7f29b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:16.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.940+0000 7f29d9027640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29b806a430 0x7f29b806c8f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29d0000f60 tx=0x7f29d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:16.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:16.943+0000 7f29c9ffb640 1 -- 172.21.15.38:0/1611719464 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f29d415e7e0 con 0x7f29d4070360 2023-12-22T08:40:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.133+0000 7f29db28b640 1 -- 172.21.15.38:0/1611719464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29d415e7e0 con 0x7f29d4070360 2023-12-22T08:40:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.134+0000 7f29c9ffb640 1 -- 172.21.15.38:0/1611719464 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29d415e7e0 con 0x7f29d4070360 2023-12-22T08:40:17.137 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:40:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.136+0000 7f29db28b640 1 -- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29b806a430 msgr2=0x7f29b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.136+0000 7f29db28b640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29b806a430 0x7f29b806c8f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29d0000f60 tx=0x7f29d0009040 comp rx=0 tx=0).stop 2023-12-22T08:40:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.136+0000 7f29db28b640 1 -- 172.21.15.38:0/1611719464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29d4070360 msgr2=0x7f29d40ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.136+0000 7f29db28b640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29d4070360 0x7f29d40ac270 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29c402bf70 tx=0x7f29c4004730 comp rx=0 tx=0).stop 2023-12-22T08:40:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.136+0000 7f29db28b640 1 -- 172.21.15.38:0/1611719464 shutdown_connections 2023-12-22T08:40:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.136+0000 7f29db28b640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29d415d840 0x7f29d40ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.136+0000 7f29db28b640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29b806a430 0x7f29b806c8f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.136+0000 7f29db28b640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29d4070360 0x7f29d40ac270 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.136+0000 7f29db28b640 1 --2- 172.21.15.38:0/1611719464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29d406df00 0x7f29d414e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.136+0000 7f29db28b640 1 -- 172.21.15.38:0/1611719464 >> 172.21.15.38:0/1611719464 conn(0x7f29d40cf440 msgr2=0x7f29d40adca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:17.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.136+0000 7f29db28b640 1 -- 172.21.15.38:0/1611719464 shutdown_connections 2023-12-22T08:40:17.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.137+0000 7f29db28b640 1 -- 172.21.15.38:0/1611719464 wait complete. 2023-12-22T08:40:17.156 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:40:17.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.365+0000 7fabc21c4640 1 Processor -- start 2023-12-22T08:40:17.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.365+0000 7fabc21c4640 1 -- start start 2023-12-22T08:40:17.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.367+0000 7fabc21c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabbc0b2e90 0x7fabbc142d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:17.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.367+0000 7fabc21c4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fabbc1407b0 0x7fabbc1432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:17.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.367+0000 7fabc21c4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc143a10 con 0x7fabbc1403d0 2023-12-22T08:40:17.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.367+0000 7fabc21c4640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc143cf0 con 0x7fabbc1407b0 2023-12-22T08:40:17.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.367+0000 7fabc21c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0d0960 con 0x7fabbc0b2e90 2023-12-22T08:40:17.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.367+0000 7fabbbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fabbc1407b0 0x7fabbc1432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.368+0000 7fabbbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fabbc1407b0 0x7fabbc1432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35162/0 (socket says 172.21.15.38:35162) 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.368+0000 7fabbb7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fabbc1403d0 0x7fabbc0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49822/0 (socket says 172.21.15.38:49822) 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.368+0000 7fabbbfff640 1 -- 172.21.15.38:0/1441995044 learned_addr learned my addr 172.21.15.38:0/1441995044 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.368+0000 7fabbaffd640 1 --2- 172.21.15.38:0/1441995044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabbc0b2e90 0x7fabbc142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.368+0000 7fabbbfff640 1 -- 172.21.15.38:0/1441995044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabbc0b2e90 msgr2=0x7fabbc142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.368+0000 7fabbbfff640 1 --2- 172.21.15.38:0/1441995044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabbc0b2e90 0x7fabbc142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.368+0000 7fabbbfff640 1 -- 172.21.15.38:0/1441995044 >> v1:172.21.15.38:6789/0 conn(0x7fabbc1403d0 legacy=0x7fabbc0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.368+0000 7fabbbfff640 1 -- 172.21.15.38:0/1441995044 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc1613c0 con 0x7fabbc1407b0 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.369+0000 7fabbbfff640 1 --2- 172.21.15.38:0/1441995044 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabbc1407b0 0x7fabbc1432d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009e50 tx=0x7fabb402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c96bb5ee5742570 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.369+0000 7fabba7fc640 1 -- 172.21.15.38:0/1441995044 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb402ca80 con 0x7fabbc1407b0 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.370+0000 7fabba7fc640 1 -- 172.21.15.38:0/1441995044 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb402cbe0 con 0x7fabbc1407b0 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.370+0000 7fabba7fc640 1 -- 172.21.15.38:0/1441995044 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb40343f0 con 0x7fabbc1407b0 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.370+0000 7fabc21c4640 1 -- 172.21.15.38:0/1441995044 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabbc1407b0 msgr2=0x7fabbc1432d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:17.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.370+0000 7fabc21c4640 1 --2- 172.21.15.38:0/1441995044 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabbc1407b0 0x7fabbc1432d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009e50 tx=0x7fabb402bee0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.370+0000 7fabc21c4640 1 -- 172.21.15.38:0/1441995044 shutdown_connections 2023-12-22T08:40:17.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.370+0000 7fabc21c4640 1 --2- 172.21.15.38:0/1441995044 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabbc1407b0 0x7fabbc1432d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.370+0000 7fabc21c4640 1 --2- 172.21.15.38:0/1441995044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabbc0b2e90 0x7fabbc142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.370+0000 7fabc21c4640 1 -- 172.21.15.38:0/1441995044 >> 172.21.15.38:0/1441995044 conn(0x7fabbc071840 msgr2=0x7fabbc071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:17.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.370+0000 7fabc21c4640 1 -- 172.21.15.38:0/1441995044 shutdown_connections 2023-12-22T08:40:17.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.370+0000 7fabc21c4640 1 -- 172.21.15.38:0/1441995044 wait complete. 2023-12-22T08:40:17.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.372+0000 7fabc21c4640 1 Processor -- start 2023-12-22T08:40:17.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.372+0000 7fabc21c4640 1 -- start start 2023-12-22T08:40:17.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.373+0000 7fabc21c4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabbc0b2e90 0x7fabbc1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:17.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.373+0000 7fabc21c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabbc1403d0 0x7fabbc142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:17.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.373+0000 7fabc21c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabbc1407b0 0x7fabbc143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:17.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.373+0000 7fabc21c4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc153900 con 0x7fabbc0b2e90 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.373+0000 7fabc21c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0b63a0 con 0x7fabbc1407b0 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.373+0000 7fabc21c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc154d50 con 0x7fabbc1403d0 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.373+0000 7fabbb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabbc0b2e90 0x7fabbc1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.373+0000 7fabbb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabbc0b2e90 0x7fabbc1533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35174/0 (socket says 172.21.15.38:35174) 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.373+0000 7fabbb7fe640 1 -- 172.21.15.38:0/2677453848 learned_addr learned my addr 172.21.15.38:0/2677453848 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.374+0000 7fabbb7fe640 1 -- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabbc1403d0 msgr2=0x7fabbc142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.374+0000 7fabbaffd640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabbc1403d0 0x7fabbc142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.374+0000 7fabbb7fe640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabbc1403d0 0x7fabbc142ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.374+0000 7fabbb7fe640 1 -- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabbc1407b0 msgr2=0x7fabbc143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.374+0000 7fabbbfff640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabbc1407b0 0x7fabbc143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.374+0000 7fabbb7fe640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabbc1407b0 0x7fabbc143000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.374+0000 7fabbb7fe640 1 -- 172.21.15.38:0/2677453848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4009b30 con 0x7fabbc0b2e90 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.374+0000 7fabbb7fe640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabbc0b2e90 0x7fabbc1533c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c4d0 tx=0x7fabac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:17.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.374+0000 7faba3fff640 1 -- 172.21.15.38:0/2677453848 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac007480 con 0x7fabbc0b2e90 2023-12-22T08:40:17.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.374+0000 7faba3fff640 1 -- 172.21.15.38:0/2677453848 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac0075e0 con 0x7fabbc0b2e90 2023-12-22T08:40:17.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.374+0000 7faba3fff640 1 -- 172.21.15.38:0/2677453848 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac0049e0 con 0x7fabbc0b2e90 2023-12-22T08:40:17.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.374+0000 7fabc21c4640 1 -- 172.21.15.38:0/2677453848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabbc155030 con 0x7fabbc0b2e90 2023-12-22T08:40:17.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.375+0000 7fabc21c4640 1 -- 172.21.15.38:0/2677453848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc1555f0 con 0x7fabbc0b2e90 2023-12-22T08:40:17.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.376+0000 7fabc21c4640 1 -- 172.21.15.38:0/2677453848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc061910 con 0x7fabbc0b2e90 2023-12-22T08:40:17.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.376+0000 7faba3fff640 1 -- 172.21.15.38:0/2677453848 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fabac004b40 con 0x7fabbc0b2e90 2023-12-22T08:40:17.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.377+0000 7faba3fff640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faba806a430 0x7faba806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:17.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.377+0000 7faba3fff640 1 -- 172.21.15.38:0/2677453848 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabac087a30 con 0x7fabbc0b2e90 2023-12-22T08:40:17.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.378+0000 7fabbaffd640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faba806a430 0x7faba806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:17.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.379+0000 7fabbaffd640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faba806a430 0x7faba806c8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fabbc136550 tx=0x7fabb0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:17.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.382+0000 7faba3fff640 1 -- 172.21.15.38:0/2677453848 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fabac053030 con 0x7fabbc0b2e90 2023-12-22T08:40:17.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.609+0000 7fabc21c4640 1 -- 172.21.15.38:0/2677453848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabbc06dd20 con 0x7fabbc0b2e90 2023-12-22T08:40:17.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.610+0000 7faba3fff640 1 -- 172.21.15.38:0/2677453848 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4639 (secure 0 0 0) 0x7fabac018020 con 0x7fabbc0b2e90 2023-12-22T08:40:17.613 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:17.613 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/444746330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":444746330},{"type":"v1","addr":"172.21.15.38:6833","nonce":444746330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/3918267418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":3918267418},{"type":"v1","addr":"172.21.15.38:6835","nonce":3918267418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2511997570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2511997570},{"type":"v1","addr":"172.21.15.89:6835","nonce":2511997570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:39:58.600709+0000","modified":"2023-12-22T08:40:02.076114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2902919630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2902919630},{"type":"v1","addr":"172.21.15.89:6837","nonce":2902919630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:40:17.614 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-12-22T08:40:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.613+0000 7fabc21c4640 1 -- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faba806a430 msgr2=0x7faba806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.613+0000 7fabc21c4640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faba806a430 0x7faba806c8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fabbc136550 tx=0x7fabb0008040 comp rx=0 tx=0).stop 2023-12-22T08:40:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.613+0000 7fabc21c4640 1 -- 172.21.15.38:0/2677453848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabbc0b2e90 msgr2=0x7fabbc1533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.613+0000 7fabc21c4640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabbc0b2e90 0x7fabbc1533c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c4d0 tx=0x7fabac00c990 comp rx=0 tx=0).stop 2023-12-22T08:40:17.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.613+0000 7fabc21c4640 1 -- 172.21.15.38:0/2677453848 shutdown_connections 2023-12-22T08:40:17.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.613+0000 7fabc21c4640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabbc1407b0 0x7fabbc143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.613+0000 7fabc21c4640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabbc1403d0 0x7fabbc142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.613+0000 7fabc21c4640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faba806a430 0x7faba806c8f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.613+0000 7fabc21c4640 1 --2- 172.21.15.38:0/2677453848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fabbc0b2e90 0x7fabbc1533c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.613+0000 7fabc21c4640 1 -- 172.21.15.38:0/2677453848 >> 172.21.15.38:0/2677453848 conn(0x7fabbc071840 msgr2=0x7fabbc071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:17.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.613+0000 7fabc21c4640 1 -- 172.21.15.38:0/2677453848 shutdown_connections 2023-12-22T08:40:17.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.613+0000 7fabc21c4640 1 -- 172.21.15.38:0/2677453848 wait complete. 2023-12-22T08:40:17.635 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:17.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.832+0000 7fbdc0f94640 1 Processor -- start 2023-12-22T08:40:17.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.832+0000 7fbdc0f94640 1 -- start start 2023-12-22T08:40:17.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.834+0000 7fbdc0f94640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbdbc0caf90 0x7fbdbc162f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:17.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.834+0000 7fbdc0f94640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0b2a90 0x7fbdbc06d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:17.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.834+0000 7fbdc0f94640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc162ce0 con 0x7fbdbc071680 2023-12-22T08:40:17.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.834+0000 7fbdc0f94640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc162160 con 0x7fbdbc0caf90 2023-12-22T08:40:17.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.834+0000 7fbdc0f94640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc162440 con 0x7fbdbc0b2a90 2023-12-22T08:40:17.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.835+0000 7fbdbbfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0b2a90 0x7fbdbc06d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:17.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.835+0000 7fbdbbfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0b2a90 0x7fbdbc06d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:56382/0 (socket says 172.21.15.38:56382) 2023-12-22T08:40:17.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.835+0000 7fbdbbfff640 1 -- 172.21.15.38:0/4045712099 learned_addr learned my addr 172.21.15.38:0/4045712099 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:17.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.835+0000 7fbdbaffd640 1 --2- 172.21.15.38:0/4045712099 >> v2:172.21.15.89:3300/0 conn(0x7fbdbc0caf90 0x7fbdbc162f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:17.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.835+0000 7fbdbbfff640 1 -- 172.21.15.38:0/4045712099 >> v2:172.21.15.89:3300/0 conn(0x7fbdbc0caf90 msgr2=0x7fbdbc162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:17.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.835+0000 7fbdbbfff640 1 --2- 172.21.15.38:0/4045712099 >> v2:172.21.15.89:3300/0 conn(0x7fbdbc0caf90 0x7fbdbc162f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.835+0000 7fbdbbfff640 1 -- 172.21.15.38:0/4045712099 >> v1:172.21.15.89:6789/0 conn(0x7fbdbc071680 legacy=0x7fbdbc0ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:17.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.835+0000 7fbdbbfff640 1 -- 172.21.15.38:0/4045712099 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc162720 con 0x7fbdbc0b2a90 2023-12-22T08:40:17.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.837+0000 7fbdbbfff640 1 --2- 172.21.15.38:0/4045712099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0b2a90 0x7fbdbc06d280 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40098a0 tx=0x7fbdb402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e7b7aca7f877ef4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:17.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.837+0000 7fbdba7fc640 1 -- 172.21.15.38:0/4045712099 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4030840 con 0x7fbdbc0b2a90 2023-12-22T08:40:17.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.837+0000 7fbdba7fc640 1 -- 172.21.15.38:0/4045712099 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb40309a0 con 0x7fbdbc0b2a90 2023-12-22T08:40:17.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.837+0000 7fbdba7fc640 1 -- 172.21.15.38:0/4045712099 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4030d30 con 0x7fbdbc0b2a90 2023-12-22T08:40:17.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.838+0000 7fbdc0f94640 1 -- 172.21.15.38:0/4045712099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0b2a90 msgr2=0x7fbdbc06d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:17.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.838+0000 7fbdc0f94640 1 --2- 172.21.15.38:0/4045712099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0b2a90 0x7fbdbc06d280 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40098a0 tx=0x7fbdb402b980 comp rx=0 tx=0).stop 2023-12-22T08:40:17.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.838+0000 7fbdc0f94640 1 -- 172.21.15.38:0/4045712099 shutdown_connections 2023-12-22T08:40:17.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.838+0000 7fbdc0f94640 1 --2- 172.21.15.38:0/4045712099 >> v2:172.21.15.89:3300/0 conn(0x7fbdbc0caf90 0x7fbdbc162f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.838+0000 7fbdc0f94640 1 --2- 172.21.15.38:0/4045712099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0b2a90 0x7fbdbc06d280 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.838+0000 7fbdc0f94640 1 -- 172.21.15.38:0/4045712099 >> 172.21.15.38:0/4045712099 conn(0x7fbdbc0b1f70 msgr2=0x7fbdbc0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:17.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.838+0000 7fbdc0f94640 1 -- 172.21.15.38:0/4045712099 shutdown_connections 2023-12-22T08:40:17.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.838+0000 7fbdc0f94640 1 -- 172.21.15.38:0/4045712099 wait complete. 2023-12-22T08:40:17.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.840+0000 7fbdc0f94640 1 Processor -- start 2023-12-22T08:40:17.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.840+0000 7fbdc0f94640 1 -- start start 2023-12-22T08:40:17.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.841+0000 7fbdc0f94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdbc071680 0x7fbdbc0ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:17.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.841+0000 7fbdc0f94640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0b2a90 0x7fbdbc1492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:17.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.841+0000 7fbdc0f94640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdbc0caf90 0x7fbdbc14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:17.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.841+0000 7fbdc0f94640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc147650 con 0x7fbdbc0caf90 2023-12-22T08:40:17.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.841+0000 7fbdc0f94640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc15c440 con 0x7fbdbc071680 2023-12-22T08:40:17.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.841+0000 7fbdc0f94640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc15b830 con 0x7fbdbc0b2a90 2023-12-22T08:40:17.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.841+0000 7fbdbbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdbc0caf90 0x7fbdbc14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:17.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.841+0000 7fbdbbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdbc0caf90 0x7fbdbc14ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35184/0 (socket says 172.21.15.38:35184) 2023-12-22T08:40:17.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.841+0000 7fbdbbfff640 1 -- 172.21.15.38:0/2208464865 learned_addr learned my addr 172.21.15.38:0/2208464865 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:17.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.842+0000 7fbdbb7fe640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdbc071680 0x7fbdbc0ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:17.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.842+0000 7fbdbaffd640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0b2a90 0x7fbdbc1492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:17.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.842+0000 7fbdbbfff640 1 -- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0b2a90 msgr2=0x7fbdbc1492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:17.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.842+0000 7fbdbbfff640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0b2a90 0x7fbdbc1492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.842+0000 7fbdbbfff640 1 -- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdbc071680 msgr2=0x7fbdbc0ade20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:17.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.842+0000 7fbdbbfff640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdbc071680 0x7fbdbc0ade20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:17.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.842+0000 7fbdbbfff640 1 -- 172.21.15.38:0/2208464865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb40094d0 con 0x7fbdbc0caf90 2023-12-22T08:40:17.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.842+0000 7fbdbbfff640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdbc0caf90 0x7fbdbc14ad80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbdb402b9c0 tx=0x7fbdb4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:17.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.842+0000 7fbdb3fff640 1 -- 172.21.15.38:0/2208464865 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4039c10 con 0x7fbdbc0caf90 2023-12-22T08:40:17.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.842+0000 7fbdb3fff640 1 -- 172.21.15.38:0/2208464865 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb4039d70 con 0x7fbdbc0caf90 2023-12-22T08:40:17.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.842+0000 7fbdb3fff640 1 -- 172.21.15.38:0/2208464865 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4043640 con 0x7fbdbc0caf90 2023-12-22T08:40:17.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.842+0000 7fbdc0f94640 1 -- 172.21.15.38:0/2208464865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc15bb10 con 0x7fbdbc0caf90 2023-12-22T08:40:17.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.843+0000 7fbdc0f94640 1 -- 172.21.15.38:0/2208464865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc15c0d0 con 0x7fbdbc0caf90 2023-12-22T08:40:17.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.844+0000 7fbdc0f94640 1 -- 172.21.15.38:0/2208464865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc15c5d0 con 0x7fbdbc0caf90 2023-12-22T08:40:17.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.845+0000 7fbdb3fff640 1 -- 172.21.15.38:0/2208464865 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbdb40437a0 con 0x7fbdbc0caf90 2023-12-22T08:40:17.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.845+0000 7fbdb3fff640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbd9c06a430 0x7fbd9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:17.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.846+0000 7fbdb3fff640 1 -- 172.21.15.38:0/2208464865 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdb403e070 con 0x7fbdbc0caf90 2023-12-22T08:40:17.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.846+0000 7fbdbb7fe640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbd9c06a430 0x7fbd9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:17.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.847+0000 7fbdbb7fe640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbd9c06a430 0x7fbd9c06c8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbdac000f60 tx=0x7fbdac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:17.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:17.850+0000 7fbdb3fff640 1 -- 172.21.15.38:0/2208464865 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbdb4076ed0 con 0x7fbdbc0caf90 2023-12-22T08:40:18.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.039+0000 7fbdc0f94640 1 -- 172.21.15.38:0/2208464865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdbc061910 con 0x7fbdbc0caf90 2023-12-22T08:40:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.041+0000 7fbdb3fff640 1 -- 172.21.15.38:0/2208464865 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15993 (secure 0 0 0) 0x7fbdb407a4f0 con 0x7fbdbc0caf90 2023-12-22T08:40:18.044 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:18.044 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:59.604518+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:18.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.044+0000 7fbdc0f94640 1 -- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbd9c06a430 msgr2=0x7fbd9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.044+0000 7fbdc0f94640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbd9c06a430 0x7fbd9c06c8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbdac000f60 tx=0x7fbdac009040 comp rx=0 tx=0).stop 2023-12-22T08:40:18.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.044+0000 7fbdc0f94640 1 -- 172.21.15.38:0/2208464865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdbc0caf90 msgr2=0x7fbdbc14ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.044+0000 7fbdc0f94640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdbc0caf90 0x7fbdbc14ad80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbdb402b9c0 tx=0x7fbdb4004730 comp rx=0 tx=0).stop 2023-12-22T08:40:18.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.044+0000 7fbdc0f94640 1 -- 172.21.15.38:0/2208464865 shutdown_connections 2023-12-22T08:40:18.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.044+0000 7fbdc0f94640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbd9c06a430 0x7fbd9c06c8f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.044+0000 7fbdc0f94640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdbc0caf90 0x7fbdbc14ad80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.044+0000 7fbdc0f94640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdbc0b2a90 0x7fbdbc1492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.044+0000 7fbdc0f94640 1 --2- 172.21.15.38:0/2208464865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdbc071680 0x7fbdbc0ade20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.044+0000 7fbdc0f94640 1 -- 172.21.15.38:0/2208464865 >> 172.21.15.38:0/2208464865 conn(0x7fbdbc0b1f70 msgr2=0x7fbdbc0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.044+0000 7fbdc0f94640 1 -- 172.21.15.38:0/2208464865 shutdown_connections 2023-12-22T08:40:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.044+0000 7fbdc0f94640 1 -- 172.21.15.38:0/2208464865 wait complete. 2023-12-22T08:40:18.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:39:56.873963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:39:57.616447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:18.066 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:18.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.286+0000 7f62bf09e640 1 Processor -- start 2023-12-22T08:40:18.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.286+0000 7f62bf09e640 1 -- start start 2023-12-22T08:40:18.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.288+0000 7f62bf09e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f62b815d1c0 0x7f62b8070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:18.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.288+0000 7f62bf09e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62b815d5a0 0x7f62b8070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:18.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.288+0000 7f62bf09e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b815de50 con 0x7f62b80d0060 2023-12-22T08:40:18.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.288+0000 7f62bf09e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b80d0be0 con 0x7f62b815d1c0 2023-12-22T08:40:18.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.288+0000 7f62bf09e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80d0dd0 con 0x7f62b815d5a0 2023-12-22T08:40:18.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.289+0000 7f62be09c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f62b815d1c0 0x7f62b8070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:18.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.289+0000 7f62be09c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f62b815d1c0 0x7f62b8070970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35186/0 (socket says 172.21.15.38:35186) 2023-12-22T08:40:18.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.289+0000 7f62be09c640 1 -- 172.21.15.38:0/3875959733 learned_addr learned my addr 172.21.15.38:0/3875959733 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:18.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.289+0000 7f62be89d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f62b80d0060 0x7f62b80d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49836/0 (socket says 172.21.15.38:49836) 2023-12-22T08:40:18.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.289+0000 7f62bd89b640 1 --2- 172.21.15.38:0/3875959733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62b815d5a0 0x7f62b8070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:18.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.289+0000 7f62be09c640 1 -- 172.21.15.38:0/3875959733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62b815d5a0 msgr2=0x7f62b8070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:18.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.289+0000 7f62be09c640 1 --2- 172.21.15.38:0/3875959733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62b815d5a0 0x7f62b8070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.289+0000 7f62be09c640 1 -- 172.21.15.38:0/3875959733 >> v1:172.21.15.38:6789/0 conn(0x7f62b80d0060 legacy=0x7f62b80d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.289+0000 7f62be09c640 1 -- 172.21.15.38:0/3875959733 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b80d10b0 con 0x7f62b815d1c0 2023-12-22T08:40:18.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.289+0000 7f62bd09a640 1 -- 172.21.15.38:0/3875959733 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653953105 0 0) 0x7f62b815de50 con 0x7f62b80d0060 2023-12-22T08:40:18.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.290+0000 7f62be09c640 1 --2- 172.21.15.38:0/3875959733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62b815d1c0 0x7f62b8070970 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009e50 tx=0x7f62b402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4a0140ca09f7b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:18.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.291+0000 7f62bd09a640 1 -- 172.21.15.38:0/3875959733 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b402cb00 con 0x7f62b815d1c0 2023-12-22T08:40:18.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.291+0000 7f62bd09a640 1 -- 172.21.15.38:0/3875959733 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b402cc60 con 0x7f62b815d1c0 2023-12-22T08:40:18.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.291+0000 7f62bd09a640 1 -- 172.21.15.38:0/3875959733 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b40343f0 con 0x7f62b815d1c0 2023-12-22T08:40:18.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.291+0000 7f62bf09e640 1 -- 172.21.15.38:0/3875959733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62b815d1c0 msgr2=0x7f62b8070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.291+0000 7f62bf09e640 1 --2- 172.21.15.38:0/3875959733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62b815d1c0 0x7f62b8070970 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009e50 tx=0x7f62b402bf60 comp rx=0 tx=0).stop 2023-12-22T08:40:18.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.291+0000 7f62bf09e640 1 -- 172.21.15.38:0/3875959733 shutdown_connections 2023-12-22T08:40:18.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.291+0000 7f62bf09e640 1 --2- 172.21.15.38:0/3875959733 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62b815d5a0 0x7f62b8070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.291+0000 7f62bf09e640 1 --2- 172.21.15.38:0/3875959733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62b815d1c0 0x7f62b8070970 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.291+0000 7f62bf09e640 1 -- 172.21.15.38:0/3875959733 >> 172.21.15.38:0/3875959733 conn(0x7f62b806bf90 msgr2=0x7f62b806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:18.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.291+0000 7f62bf09e640 1 -- 172.21.15.38:0/3875959733 shutdown_connections 2023-12-22T08:40:18.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.292+0000 7f62bf09e640 1 -- 172.21.15.38:0/3875959733 wait complete. 2023-12-22T08:40:18.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.293+0000 7f62bf09e640 1 Processor -- start 2023-12-22T08:40:18.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.293+0000 7f62bf09e640 1 -- start start 2023-12-22T08:40:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.294+0000 7f62bf09e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b80d0060 0x7f62b81530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.294+0000 7f62bf09e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62b815d1c0 0x7f62b813fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.294+0000 7f62bf09e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62b815d5a0 0x7f62b8142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.294+0000 7f62bf09e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81460e0 con 0x7f62b815d1c0 2023-12-22T08:40:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.294+0000 7f62bf09e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b813ff50 con 0x7f62b80d0060 2023-12-22T08:40:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.294+0000 7f62bf09e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81431d0 con 0x7f62b815d5a0 2023-12-22T08:40:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.295+0000 7f62bd89b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62b815d1c0 0x7f62b813fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.295+0000 7f62bd89b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62b815d1c0 0x7f62b813fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35192/0 (socket says 172.21.15.38:35192) 2023-12-22T08:40:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.295+0000 7f62bd89b640 1 -- 172.21.15.38:0/3391312002 learned_addr learned my addr 172.21.15.38:0/3391312002 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.295+0000 7f62be09c640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b80d0060 0x7f62b81530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.295+0000 7f62be89d640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62b815d5a0 0x7f62b8142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:18.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.295+0000 7f62bd89b640 1 -- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62b815d5a0 msgr2=0x7f62b8142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.295+0000 7f62bd89b640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62b815d5a0 0x7f62b8142c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.295+0000 7f62bd89b640 1 -- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b80d0060 msgr2=0x7f62b81530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.295+0000 7f62bd89b640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b80d0060 0x7f62b81530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.295+0000 7f62bd89b640 1 -- 172.21.15.38:0/3391312002 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4009b30 con 0x7f62b815d1c0 2023-12-22T08:40:18.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.295+0000 7f62bd89b640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62b815d1c0 0x7f62b813fa10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f62a800d5f0 tx=0x7f62a800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:18.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.296+0000 7f62aeffd640 1 -- 172.21.15.38:0/3391312002 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a80125f0 con 0x7f62b815d1c0 2023-12-22T08:40:18.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.296+0000 7f62aeffd640 1 -- 172.21.15.38:0/3391312002 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a8012750 con 0x7f62b815d1c0 2023-12-22T08:40:18.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.296+0000 7f62bf09e640 1 -- 172.21.15.38:0/3391312002 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b8153750 con 0x7f62b815d1c0 2023-12-22T08:40:18.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.296+0000 7f62aeffd640 1 -- 172.21.15.38:0/3391312002 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8012b00 con 0x7f62b815d1c0 2023-12-22T08:40:18.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.296+0000 7f62bf09e640 1 -- 172.21.15.38:0/3391312002 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b81e5ee0 con 0x7f62b815d1c0 2023-12-22T08:40:18.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.297+0000 7f62bf09e640 1 -- 172.21.15.38:0/3391312002 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b8061910 con 0x7f62b815d1c0 2023-12-22T08:40:18.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.298+0000 7f62aeffd640 1 -- 172.21.15.38:0/3391312002 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f62a8012c60 con 0x7f62b815d1c0 2023-12-22T08:40:18.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.299+0000 7f62aeffd640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f629c06a430 0x7f629c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:18.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.299+0000 7f62aeffd640 1 -- 172.21.15.38:0/3391312002 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62a8088de0 con 0x7f62b815d1c0 2023-12-22T08:40:18.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.299+0000 7f62be09c640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f629c06a430 0x7f629c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:18.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.300+0000 7f62be09c640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f629c06a430 0x7f629c06c8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f62b4035000 tx=0x7f62b4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:18.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.303+0000 7f62aeffd640 1 -- 172.21.15.38:0/3391312002 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f62a8054330 con 0x7f62b815d1c0 2023-12-22T08:40:18.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.506+0000 7f62bf09e640 1 -- 172.21.15.38:0/3391312002 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62b8072060 con 0x7f62b815d1c0 2023-12-22T08:40:18.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.506+0000 7f62aeffd640 1 -- 172.21.15.38:0/3391312002 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62a8057950 con 0x7f62b815d1c0 2023-12-22T08:40:18.509 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:40:18.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.509+0000 7f62bf09e640 1 -- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f629c06a430 msgr2=0x7f629c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.509+0000 7f62bf09e640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f629c06a430 0x7f629c06c8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f62b4035000 tx=0x7f62b4030000 comp rx=0 tx=0).stop 2023-12-22T08:40:18.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.509+0000 7f62bf09e640 1 -- 172.21.15.38:0/3391312002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62b815d1c0 msgr2=0x7f62b813fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.509+0000 7f62bf09e640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62b815d1c0 0x7f62b813fa10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f62a800d5f0 tx=0x7f62a800dab0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.510+0000 7f62bf09e640 1 -- 172.21.15.38:0/3391312002 shutdown_connections 2023-12-22T08:40:18.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.510+0000 7f62bf09e640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62b815d5a0 0x7f62b8142c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.510+0000 7f62bf09e640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f629c06a430 0x7f629c06c8f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.510+0000 7f62bf09e640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62b815d1c0 0x7f62b813fa10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.510+0000 7f62bf09e640 1 --2- 172.21.15.38:0/3391312002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62b80d0060 0x7f62b81530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.510+0000 7f62bf09e640 1 -- 172.21.15.38:0/3391312002 >> 172.21.15.38:0/3391312002 conn(0x7f62b806bf90 msgr2=0x7f62b806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:18.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.510+0000 7f62bf09e640 1 -- 172.21.15.38:0/3391312002 shutdown_connections 2023-12-22T08:40:18.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.510+0000 7f62bf09e640 1 -- 172.21.15.38:0/3391312002 wait complete. 2023-12-22T08:40:18.533 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:18.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.763+0000 7fd1487d9640 1 Processor -- start 2023-12-22T08:40:18.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.763+0000 7fd1487d9640 1 -- start start 2023-12-22T08:40:18.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.765+0000 7fd1487d9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd1400b2050 0x7fd1400b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:18.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.765+0000 7fd1487d9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd140070800 0x7fd140070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:18.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.765+0000 7fd1487d9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1401450f0 con 0x7fd140144d10 2023-12-22T08:40:18.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.765+0000 7fd1487d9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1400cc840 con 0x7fd1400b2050 2023-12-22T08:40:18.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.765+0000 7fd1487d9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400ce010 con 0x7fd140070800 2023-12-22T08:40:18.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.765+0000 7fd145d74640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd1400b2050 0x7fd1400b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:18.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.765+0000 7fd145d74640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd1400b2050 0x7fd1400b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35208/0 (socket says 172.21.15.38:35208) 2023-12-22T08:40:18.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.765+0000 7fd145d74640 1 -- 172.21.15.38:0/2099647105 learned_addr learned my addr 172.21.15.38:0/2099647105 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:18.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.766+0000 7fd145d74640 1 -- 172.21.15.38:0/2099647105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd140070800 msgr2=0x7fd140070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:18.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.766+0000 7fd146d76640 1 --2- 172.21.15.38:0/2099647105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd140070800 0x7fd140070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:18.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.766+0000 7fd145d74640 1 --2- 172.21.15.38:0/2099647105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd140070800 0x7fd140070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.766+0000 7fd145d74640 1 -- 172.21.15.38:0/2099647105 >> v1:172.21.15.89:6789/0 conn(0x7fd140144d10 legacy=0x7fd1400cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.766+0000 7fd145d74640 1 -- 172.21.15.38:0/2099647105 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400b29f0 con 0x7fd1400b2050 2023-12-22T08:40:18.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.766+0000 7fd146d76640 1 --2- 172.21.15.38:0/2099647105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd140070800 0x7fd140070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:18.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.767+0000 7fd145d74640 1 --2- 172.21.15.38:0/2099647105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1400b2050 0x7fd1400b24b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd130009870 tx=0x7fd13002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a066fa3313629b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:18.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.767+0000 7fd145573640 1 -- 172.21.15.38:0/2099647105 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130030840 con 0x7fd1400b2050 2023-12-22T08:40:18.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.767+0000 7fd145573640 1 -- 172.21.15.38:0/2099647105 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1300309a0 con 0x7fd1400b2050 2023-12-22T08:40:18.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.767+0000 7fd145573640 1 -- 172.21.15.38:0/2099647105 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130030d30 con 0x7fd1400b2050 2023-12-22T08:40:18.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.768+0000 7fd1487d9640 1 -- 172.21.15.38:0/2099647105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1400b2050 msgr2=0x7fd1400b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.768+0000 7fd1487d9640 1 --2- 172.21.15.38:0/2099647105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1400b2050 0x7fd1400b24b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd130009870 tx=0x7fd13002b980 comp rx=0 tx=0).stop 2023-12-22T08:40:18.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.768+0000 7fd1487d9640 1 -- 172.21.15.38:0/2099647105 shutdown_connections 2023-12-22T08:40:18.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.768+0000 7fd1487d9640 1 --2- 172.21.15.38:0/2099647105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1400b2050 0x7fd1400b24b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.768+0000 7fd1487d9640 1 --2- 172.21.15.38:0/2099647105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd140070800 0x7fd140070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.768+0000 7fd1487d9640 1 -- 172.21.15.38:0/2099647105 >> 172.21.15.38:0/2099647105 conn(0x7fd1400cf070 msgr2=0x7fd1400cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:18.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.768+0000 7fd1487d9640 1 -- 172.21.15.38:0/2099647105 shutdown_connections 2023-12-22T08:40:18.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.768+0000 7fd1487d9640 1 -- 172.21.15.38:0/2099647105 wait complete. 2023-12-22T08:40:18.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.770+0000 7fd1487d9640 1 Processor -- start 2023-12-22T08:40:18.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.770+0000 7fd1487d9640 1 -- start start 2023-12-22T08:40:18.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.771+0000 7fd1487d9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd140070800 0x7fd140140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:18.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.771+0000 7fd1487d9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1400b2050 0x7fd14015f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:18.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.771+0000 7fd1487d9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd140144d10 0x7fd14006c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:18.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.771+0000 7fd1487d9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14006ccb0 con 0x7fd140144d10 2023-12-22T08:40:18.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.771+0000 7fd1487d9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14006cec0 con 0x7fd1400b2050 2023-12-22T08:40:18.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.771+0000 7fd1487d9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14006d1a0 con 0x7fd140070800 2023-12-22T08:40:18.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.772+0000 7fd146d76640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd140144d10 0x7fd14006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:18.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.772+0000 7fd146d76640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd140144d10 0x7fd14006c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35212/0 (socket says 172.21.15.38:35212) 2023-12-22T08:40:18.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.772+0000 7fd146d76640 1 -- 172.21.15.38:0/4204204370 learned_addr learned my addr 172.21.15.38:0/4204204370 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:18.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.772+0000 7fd145d74640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1400b2050 0x7fd14015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:18.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.772+0000 7fd146575640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd140070800 0x7fd140140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:18.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.772+0000 7fd146d76640 1 -- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd140070800 msgr2=0x7fd140140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.772+0000 7fd146d76640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd140070800 0x7fd140140d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.772+0000 7fd146d76640 1 -- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1400b2050 msgr2=0x7fd14015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.772+0000 7fd146d76640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1400b2050 0x7fd14015f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.772+0000 7fd146d76640 1 -- 172.21.15.38:0/4204204370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1300094d0 con 0x7fd140144d10 2023-12-22T08:40:18.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.773+0000 7fd146d76640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd140144d10 0x7fd14006c770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd13800c7f0 tx=0x7fd13800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:18.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.773+0000 7fd136ffd640 1 -- 172.21.15.38:0/4204204370 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138007820 con 0x7fd140144d10 2023-12-22T08:40:18.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.773+0000 7fd136ffd640 1 -- 172.21.15.38:0/4204204370 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd138007980 con 0x7fd140144d10 2023-12-22T08:40:18.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.773+0000 7fd136ffd640 1 -- 172.21.15.38:0/4204204370 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138007d70 con 0x7fd140144d10 2023-12-22T08:40:18.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.773+0000 7fd1487d9640 1 -- 172.21.15.38:0/4204204370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14006d480 con 0x7fd140144d10 2023-12-22T08:40:18.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.773+0000 7fd1487d9640 1 -- 172.21.15.38:0/4204204370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14006da40 con 0x7fd140144d10 2023-12-22T08:40:18.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.774+0000 7fd1487d9640 1 -- 172.21.15.38:0/4204204370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14006dc30 con 0x7fd140144d10 2023-12-22T08:40:18.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.775+0000 7fd136ffd640 1 -- 172.21.15.38:0/4204204370 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1380113f0 con 0x7fd140144d10 2023-12-22T08:40:18.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.776+0000 7fd136ffd640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd12406a430 0x7fd12406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:18.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.777+0000 7fd136ffd640 1 -- 172.21.15.38:0/4204204370 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd138088c60 con 0x7fd140144d10 2023-12-22T08:40:18.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.777+0000 7fd146575640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd12406a430 0x7fd12406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:18.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.778+0000 7fd146575640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd12406a430 0x7fd12406c8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd13c007fd0 tx=0x7fd13c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:18.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.781+0000 7fd136ffd640 1 -- 172.21.15.38:0/4204204370 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd138054260 con 0x7fd140144d10 2023-12-22T08:40:18.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.974+0000 7fd1487d9640 1 -- 172.21.15.38:0/4204204370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd140061910 con 0x7fd140144d10 2023-12-22T08:40:18.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.975+0000 7fd136ffd640 1 -- 172.21.15.38:0/4204204370 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd13801f020 con 0x7fd140144d10 2023-12-22T08:40:18.978 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:40:18.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.977+0000 7fd1487d9640 1 -- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd12406a430 msgr2=0x7fd12406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.977+0000 7fd1487d9640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd12406a430 0x7fd12406c8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd13c007fd0 tx=0x7fd13c009040 comp rx=0 tx=0).stop 2023-12-22T08:40:18.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.977+0000 7fd1487d9640 1 -- 172.21.15.38:0/4204204370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd140144d10 msgr2=0x7fd14006c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:18.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.977+0000 7fd1487d9640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd140144d10 0x7fd14006c770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd13800c7f0 tx=0x7fd13800ccb0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.978+0000 7fd1487d9640 1 -- 172.21.15.38:0/4204204370 shutdown_connections 2023-12-22T08:40:18.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.978+0000 7fd1487d9640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd12406a430 0x7fd12406c8f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.978+0000 7fd1487d9640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd140144d10 0x7fd14006c770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.978+0000 7fd1487d9640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1400b2050 0x7fd14015f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.978+0000 7fd1487d9640 1 --2- 172.21.15.38:0/4204204370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd140070800 0x7fd140140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:18.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.978+0000 7fd1487d9640 1 -- 172.21.15.38:0/4204204370 >> 172.21.15.38:0/4204204370 conn(0x7fd1400cf070 msgr2=0x7fd1400ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:18.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.978+0000 7fd1487d9640 1 -- 172.21.15.38:0/4204204370 shutdown_connections 2023-12-22T08:40:18.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:18.978+0000 7fd1487d9640 1 -- 172.21.15.38:0/4204204370 wait complete. 2023-12-22T08:40:18.999 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:19.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.219+0000 7f939d392640 1 Processor -- start 2023-12-22T08:40:19.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.219+0000 7f939d392640 1 -- start start 2023-12-22T08:40:19.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.221+0000 7f939d392640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93980ca820 0x7f9398161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:19.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.221+0000 7f939d392640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93981619a0 con 0x7f9398161570 2023-12-22T08:40:19.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.221+0000 7f939d392640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93980ccbb0 con 0x7f9398157a40 2023-12-22T08:40:19.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.221+0000 7f939d392640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939806a470 con 0x7f93980ca820 2023-12-22T08:40:19.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.222+0000 7f93977fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9398161570 0x7f939806a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49848/0 (socket says 172.21.15.38:49848) 2023-12-22T08:40:19.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.222+0000 7f93977fe640 1 -- 172.21.15.38:0/633673388 learned_addr learned my addr 172.21.15.38:0/633673388 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:19.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.222+0000 7f93967fc640 1 --2- 172.21.15.38:0/633673388 >> v2:172.21.15.89:3300/0 conn(0x7f93980ca820 0x7f9398161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:19.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.222+0000 7f9395ffb640 1 -- 172.21.15.38:0/633673388 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093933051 0 0) 0x7f93981619a0 con 0x7f9398161570 2023-12-22T08:40:19.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.222+0000 7f9395ffb640 1 -- 172.21.15.38:0/633673388 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9384003520 con 0x7f9398161570 2023-12-22T08:40:19.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.223+0000 7f93967fc640 1 -- 172.21.15.38:0/633673388 >> v1:172.21.15.89:6789/0 conn(0x7f9398157a40 legacy=0x7f93980d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:19.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.223+0000 7f93967fc640 1 -- 172.21.15.38:0/633673388 >> v1:172.21.15.38:6789/0 conn(0x7f9398161570 legacy=0x7f939806a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:19.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.223+0000 7f9395ffb640 1 -- 172.21.15.38:0/633673388 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1677317092 0 0) 0x7f9384003520 con 0x7f9398161570 2023-12-22T08:40:19.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.223+0000 7f93967fc640 1 -- 172.21.15.38:0/633673388 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93980cce50 con 0x7f93980ca820 2023-12-22T08:40:19.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.224+0000 7f93967fc640 1 --2- 172.21.15.38:0/633673388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ca820 0x7f9398161030 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f93800097a0 tx=0x7f938002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f174472e4c0d28c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:19.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.224+0000 7f9395ffb640 1 -- 172.21.15.38:0/633673388 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938002f050 con 0x7f93980ca820 2023-12-22T08:40:19.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.225+0000 7f9395ffb640 1 -- 172.21.15.38:0/633673388 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9380031500 con 0x7f93980ca820 2023-12-22T08:40:19.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.225+0000 7f9395ffb640 1 -- 172.21.15.38:0/633673388 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390001670 con 0x7f93980ca820 2023-12-22T08:40:19.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.225+0000 7f939d392640 1 -- 172.21.15.38:0/633673388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ca820 msgr2=0x7f9398161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:19.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.225+0000 7f939d392640 1 --2- 172.21.15.38:0/633673388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ca820 0x7f9398161030 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f93800097a0 tx=0x7f938002b820 comp rx=0 tx=0).stop 2023-12-22T08:40:19.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.225+0000 7f939d392640 1 -- 172.21.15.38:0/633673388 shutdown_connections 2023-12-22T08:40:19.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.225+0000 7f939d392640 1 --2- 172.21.15.38:0/633673388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ca820 0x7f9398161030 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.225+0000 7f939d392640 1 -- 172.21.15.38:0/633673388 >> 172.21.15.38:0/633673388 conn(0x7f939806c5e0 msgr2=0x7f939806c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:19.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.225+0000 7f939d392640 1 -- 172.21.15.38:0/633673388 shutdown_connections 2023-12-22T08:40:19.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.225+0000 7f939d392640 1 -- 172.21.15.38:0/633673388 wait complete. 2023-12-22T08:40:19.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.227+0000 7f939d392640 1 Processor -- start 2023-12-22T08:40:19.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.227+0000 7f939d392640 1 -- start start 2023-12-22T08:40:19.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.228+0000 7f939d392640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ca820 0x7f939814b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:19.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.228+0000 7f939d392640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9398157a40 0x7f939815a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:19.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.228+0000 7f939d392640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9398161570 0x7f93980b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:19.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.228+0000 7f939d392640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93981592b0 con 0x7f9398157a40 2023-12-22T08:40:19.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.228+0000 7f939d392640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939814bd00 con 0x7f93980ca820 2023-12-22T08:40:19.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.228+0000 7f939d392640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9398159d90 con 0x7f9398161570 2023-12-22T08:40:19.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.228+0000 7f93967fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9398157a40 0x7f939815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:19.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.229+0000 7f93967fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9398157a40 0x7f939815a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35220/0 (socket says 172.21.15.38:35220) 2023-12-22T08:40:19.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.229+0000 7f93967fc640 1 -- 172.21.15.38:0/3759283904 learned_addr learned my addr 172.21.15.38:0/3759283904 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:19.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.229+0000 7f93977fe640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9398161570 0x7f93980b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:19.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.229+0000 7f9396ffd640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ca820 0x7f939814b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:19.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.229+0000 7f93967fc640 1 -- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9398161570 msgr2=0x7f93980b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:19.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.229+0000 7f93967fc640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9398161570 0x7f93980b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.229+0000 7f93967fc640 1 -- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ca820 msgr2=0x7f939814b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:19.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.229+0000 7f93967fc640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ca820 0x7f939814b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.229+0000 7f93967fc640 1 -- 172.21.15.38:0/3759283904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9380009400 con 0x7f9398157a40 2023-12-22T08:40:19.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.229+0000 7f9396ffd640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ca820 0x7f939814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:19.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.229+0000 7f93967fc640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9398157a40 0x7f939815a010 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9380036040 tx=0x7f93800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:19.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.230+0000 7f938f7fe640 1 -- 172.21.15.38:0/3759283904 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380031870 con 0x7f9398157a40 2023-12-22T08:40:19.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.230+0000 7f938f7fe640 1 -- 172.21.15.38:0/3759283904 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93800319f0 con 0x7f9398157a40 2023-12-22T08:40:19.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.230+0000 7f938f7fe640 1 -- 172.21.15.38:0/3759283904 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380031da0 con 0x7f9398157a40 2023-12-22T08:40:19.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.230+0000 7f939d392640 1 -- 172.21.15.38:0/3759283904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939815a550 con 0x7f9398157a40 2023-12-22T08:40:19.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.230+0000 7f939d392640 1 -- 172.21.15.38:0/3759283904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9398158910 con 0x7f9398157a40 2023-12-22T08:40:19.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.231+0000 7f939d392640 1 -- 172.21.15.38:0/3759283904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9398061910 con 0x7f9398157a40 2023-12-22T08:40:19.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.232+0000 7f938f7fe640 1 -- 172.21.15.38:0/3759283904 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f938003a050 con 0x7f9398157a40 2023-12-22T08:40:19.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.233+0000 7f938f7fe640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f937806a480 0x7f937806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:19.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.233+0000 7f938f7fe640 1 -- 172.21.15.38:0/3759283904 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93800aa450 con 0x7f9398157a40 2023-12-22T08:40:19.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.234+0000 7f9396ffd640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f937806a480 0x7f937806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:19.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.235+0000 7f9396ffd640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f937806a480 0x7f937806c940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93980b7660 tx=0x7f9388009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:19.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.237+0000 7f938f7fe640 1 -- 172.21.15.38:0/3759283904 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9380075a60 con 0x7f9398157a40 2023-12-22T08:40:19.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.431+0000 7f939d392640 1 -- 172.21.15.38:0/3759283904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f93980a6b40 con 0x7f9398157a40 2023-12-22T08:40:19.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.431+0000 7f938f7fe640 1 -- 172.21.15.38:0/3759283904 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f93800380a0 con 0x7f9398157a40 2023-12-22T08:40:19.434 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:40:19.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.434+0000 7f939d392640 1 -- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f937806a480 msgr2=0x7f937806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:19.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.434+0000 7f939d392640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f937806a480 0x7f937806c940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93980b7660 tx=0x7f9388009040 comp rx=0 tx=0).stop 2023-12-22T08:40:19.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.434+0000 7f939d392640 1 -- 172.21.15.38:0/3759283904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9398157a40 msgr2=0x7f939815a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.434+0000 7f939d392640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9398157a40 0x7f939815a010 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9380036040 tx=0x7f93800046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.434+0000 7f939d392640 1 -- 172.21.15.38:0/3759283904 shutdown_connections 2023-12-22T08:40:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.434+0000 7f939d392640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9398161570 0x7f93980b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.434+0000 7f939d392640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f937806a480 0x7f937806c940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.435+0000 7f939d392640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9398157a40 0x7f939815a010 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.435+0000 7f939d392640 1 --2- 172.21.15.38:0/3759283904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93980ca820 0x7f939814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.435+0000 7f939d392640 1 -- 172.21.15.38:0/3759283904 >> 172.21.15.38:0/3759283904 conn(0x7f939806c5e0 msgr2=0x7f939806d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.435+0000 7f939d392640 1 -- 172.21.15.38:0/3759283904 shutdown_connections 2023-12-22T08:40:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.435+0000 7f939d392640 1 -- 172.21.15.38:0/3759283904 wait complete. 2023-12-22T08:40:19.456 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:40:19.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.677+0000 7f23bc8fa640 1 Processor -- start 2023-12-22T08:40:19.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.677+0000 7f23bc8fa640 1 -- start start 2023-12-22T08:40:19.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.679+0000 7f23bc8fa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f23b8161340 0x7f23b8071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:19.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.679+0000 7f23bc8fa640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23b8161720 0x7f23b80ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:19.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.679+0000 7f23bc8fa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b80ce950 con 0x7f23b8071fa0 2023-12-22T08:40:19.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.679+0000 7f23bc8fa640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b80cdd40 con 0x7f23b8161340 2023-12-22T08:40:19.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.679+0000 7f23bc8fa640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b80ce020 con 0x7f23b8161720 2023-12-22T08:40:19.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.679+0000 7f23b7fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23b8161720 0x7f23b80ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:19.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.680+0000 7f23b6ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f23b8071fa0 0x7f23b80adca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:58306/0 (socket says 172.21.15.38:58306) 2023-12-22T08:40:19.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.680+0000 7f23b6ffd640 1 -- 172.21.15.38:0/2151716268 learned_addr learned my addr 172.21.15.38:0/2151716268 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:19.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.680+0000 7f23b77fe640 1 --2- 172.21.15.38:0/2151716268 >> v2:172.21.15.89:3300/0 conn(0x7f23b8161340 0x7f23b8071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:19.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.680+0000 7f23b7fff640 1 -- 172.21.15.38:0/2151716268 >> v2:172.21.15.89:3300/0 conn(0x7f23b8161340 msgr2=0x7f23b8071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:19.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.680+0000 7f23b7fff640 1 --2- 172.21.15.38:0/2151716268 >> v2:172.21.15.89:3300/0 conn(0x7f23b8161340 0x7f23b8071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.680+0000 7f23b7fff640 1 -- 172.21.15.38:0/2151716268 >> v1:172.21.15.89:6789/0 conn(0x7f23b8071fa0 legacy=0x7f23b80adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:19.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.680+0000 7f23b67fc640 1 -- 172.21.15.38:0/2151716268 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991479010 0 0) 0x7f23b80ce950 con 0x7f23b8071fa0 2023-12-22T08:40:19.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.680+0000 7f23b7fff640 1 -- 172.21.15.38:0/2151716268 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b80ce300 con 0x7f23b8161720 2023-12-22T08:40:19.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.682+0000 7f23b7fff640 1 --2- 172.21.15.38:0/2151716268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23b8161720 0x7f23b80ae3b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009d90 tx=0x7f23b002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ba268eb38a44b94 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:19.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.682+0000 7f23b67fc640 1 -- 172.21.15.38:0/2151716268 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b002cbc0 con 0x7f23b8161720 2023-12-22T08:40:19.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.682+0000 7f23b67fc640 1 -- 172.21.15.38:0/2151716268 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b002cd20 con 0x7f23b8161720 2023-12-22T08:40:19.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.682+0000 7f23b67fc640 1 -- 172.21.15.38:0/2151716268 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0034660 con 0x7f23b8161720 2023-12-22T08:40:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.683+0000 7f23bc8fa640 1 -- 172.21.15.38:0/2151716268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23b8161720 msgr2=0x7f23b80ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.683+0000 7f23bc8fa640 1 --2- 172.21.15.38:0/2151716268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23b8161720 0x7f23b80ae3b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009d90 tx=0x7f23b002be10 comp rx=0 tx=0).stop 2023-12-22T08:40:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.683+0000 7f23bc8fa640 1 -- 172.21.15.38:0/2151716268 shutdown_connections 2023-12-22T08:40:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.683+0000 7f23bc8fa640 1 --2- 172.21.15.38:0/2151716268 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23b8161720 0x7f23b80ae3b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.683+0000 7f23bc8fa640 1 --2- 172.21.15.38:0/2151716268 >> v2:172.21.15.89:3300/0 conn(0x7f23b8161340 0x7f23b8071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.683+0000 7f23bc8fa640 1 -- 172.21.15.38:0/2151716268 >> 172.21.15.38:0/2151716268 conn(0x7f23b80b1f70 msgr2=0x7f23b80b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:19.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.683+0000 7f23bc8fa640 1 -- 172.21.15.38:0/2151716268 shutdown_connections 2023-12-22T08:40:19.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.683+0000 7f23bc8fa640 1 -- 172.21.15.38:0/2151716268 wait complete. 2023-12-22T08:40:19.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.685+0000 7f23bc8fa640 1 Processor -- start 2023-12-22T08:40:19.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.685+0000 7f23bc8fa640 1 -- start start 2023-12-22T08:40:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.686+0000 7f23bc8fa640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23b8071fa0 0x7f23b815d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:19.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.686+0000 7f23bc8fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b8161340 0x7f23b81f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:19.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.686+0000 7f23bc8fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23b8161720 0x7f23b8144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:19.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.686+0000 7f23bc8fa640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b815fd50 con 0x7f23b8161720 2023-12-22T08:40:19.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.686+0000 7f23bc8fa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b815f420 con 0x7f23b8161340 2023-12-22T08:40:19.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.686+0000 7f23bc8fa640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b815f700 con 0x7f23b8071fa0 2023-12-22T08:40:19.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.687+0000 7f23b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23b8161720 0x7f23b8144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:19.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.687+0000 7f23b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23b8161720 0x7f23b8144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35224/0 (socket says 172.21.15.38:35224) 2023-12-22T08:40:19.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.687+0000 7f23b7fff640 1 -- 172.21.15.38:0/855517216 learned_addr learned my addr 172.21.15.38:0/855517216 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:19.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.687+0000 7f23b77fe640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23b8071fa0 0x7f23b815d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:19.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.687+0000 7f23b6ffd640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b8161340 0x7f23b81f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:19.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.687+0000 7f23b7fff640 1 -- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23b8071fa0 msgr2=0x7f23b815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:19.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.687+0000 7f23b7fff640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23b8071fa0 0x7f23b815d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.687+0000 7f23b7fff640 1 -- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b8161340 msgr2=0x7f23b81f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:19.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.687+0000 7f23b7fff640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b8161340 0x7f23b81f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.687+0000 7f23b7fff640 1 -- 172.21.15.38:0/855517216 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b0009a70 con 0x7f23b8161720 2023-12-22T08:40:19.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.688+0000 7f23b7fff640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23b8161720 0x7f23b8144b70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009d90 tx=0x7f23b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:19.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.688+0000 7f239ffff640 1 -- 172.21.15.38:0/855517216 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0040650 con 0x7f23b8161720 2023-12-22T08:40:19.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.688+0000 7f239ffff640 1 -- 172.21.15.38:0/855517216 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b002ce90 con 0x7f23b8161720 2023-12-22T08:40:19.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.688+0000 7f239ffff640 1 -- 172.21.15.38:0/855517216 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b00409f0 con 0x7f23b8161720 2023-12-22T08:40:19.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.688+0000 7f23bc8fa640 1 -- 172.21.15.38:0/855517216 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b815f9e0 con 0x7f23b8161720 2023-12-22T08:40:19.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.688+0000 7f23bc8fa640 1 -- 172.21.15.38:0/855517216 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b815f0d0 con 0x7f23b8161720 2023-12-22T08:40:19.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.689+0000 7f23bc8fa640 1 -- 172.21.15.38:0/855517216 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b815ff00 con 0x7f23b8161720 2023-12-22T08:40:19.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.690+0000 7f239ffff640 1 -- 172.21.15.38:0/855517216 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f23b0040b50 con 0x7f23b8161720 2023-12-22T08:40:19.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.691+0000 7f239ffff640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23a406a430 0x7f23a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:19.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.691+0000 7f239ffff640 1 -- 172.21.15.38:0/855517216 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23b00ab5f0 con 0x7f23b8161720 2023-12-22T08:40:19.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.691+0000 7f23b77fe640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23a406a430 0x7f23a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:19.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.692+0000 7f23b77fe640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23a406a430 0x7f23a406c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009ad0 tx=0x7f23a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:19.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.695+0000 7f239ffff640 1 -- 172.21.15.38:0/855517216 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f23b815ff00 con 0x7f23b8161720 2023-12-22T08:40:19.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.928+0000 7f23bc8fa640 1 -- 172.21.15.38:0/855517216 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23b8061910 con 0x7f23b8161720 2023-12-22T08:40:19.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.928+0000 7f239ffff640 1 -- 172.21.15.38:0/855517216 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4639 (secure 0 0 0) 0x7f23b0076b40 con 0x7f23b8161720 2023-12-22T08:40:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:19.931 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/444746330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":444746330},{"type":"v1","addr":"172.21.15.38:6833","nonce":444746330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/3918267418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":3918267418},{"type":"v1","addr":"172.21.15.38:6835","nonce":3918267418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2511997570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2511997570},{"type":"v1","addr":"172.21.15.89:6835","nonce":2511997570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:39:58.600709+0000","modified":"2023-12-22T08:40:02.076114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2902919630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2902919630},{"type":"v1","addr":"172.21.15.89:6837","nonce":2902919630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:40:19.931 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-12-22T08:40:19.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.931+0000 7f23bc8fa640 1 -- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23a406a430 msgr2=0x7f23a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:19.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.931+0000 7f23bc8fa640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23a406a430 0x7f23a406c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009ad0 tx=0x7f23a8008040 comp rx=0 tx=0).stop 2023-12-22T08:40:19.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.931+0000 7f23bc8fa640 1 -- 172.21.15.38:0/855517216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23b8161720 msgr2=0x7f23b8144b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:19.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.931+0000 7f23bc8fa640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23b8161720 0x7f23b8144b70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009d90 tx=0x7f23b0004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:19.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.931+0000 7f23bc8fa640 1 -- 172.21.15.38:0/855517216 shutdown_connections 2023-12-22T08:40:19.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.931+0000 7f23bc8fa640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23a406a430 0x7f23a406c8f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.931+0000 7f23bc8fa640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23b8161720 0x7f23b8144b70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.931+0000 7f23bc8fa640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b8161340 0x7f23b81f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.931+0000 7f23bc8fa640 1 --2- 172.21.15.38:0/855517216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23b8071fa0 0x7f23b815d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:19.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.931+0000 7f23bc8fa640 1 -- 172.21.15.38:0/855517216 >> 172.21.15.38:0/855517216 conn(0x7f23b80b1f70 msgr2=0x7f23b815be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:19.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.931+0000 7f23bc8fa640 1 -- 172.21.15.38:0/855517216 shutdown_connections 2023-12-22T08:40:19.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:19.932+0000 7f23bc8fa640 1 -- 172.21.15.38:0/855517216 wait complete. 2023-12-22T08:40:19.953 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:20.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.173+0000 7f560eccc640 1 Processor -- start 2023-12-22T08:40:20.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.173+0000 7f560eccc640 1 -- start start 2023-12-22T08:40:20.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.175+0000 7f560eccc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560806d5f0 0x7f560815e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.175+0000 7f560eccc640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56080706d0 con 0x7f56080cb4c0 2023-12-22T08:40:20.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.175+0000 7f560eccc640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56080cbf40 con 0x7f560806d210 2023-12-22T08:40:20.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.175+0000 7f560eccc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080ce840 con 0x7f560806d5f0 2023-12-22T08:40:20.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.175+0000 7f560d4c9640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f56080cb4c0 0x7f5608070b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49854/0 (socket says 172.21.15.38:49854) 2023-12-22T08:40:20.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.175+0000 7f560d4c9640 1 -- 172.21.15.38:0/1317278107 learned_addr learned my addr 172.21.15.38:0/1317278107 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:20.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.176+0000 7f560e4cb640 1 --2- 172.21.15.38:0/1317278107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560806d5f0 0x7f560815e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.176+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499342920 0 0) 0x7f56080706d0 con 0x7f56080cb4c0 2023-12-22T08:40:20.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.176+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f4003520 con 0x7f56080cb4c0 2023-12-22T08:40:20.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.176+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473419027 0 0) 0x7f56080cbf40 con 0x7f560806d210 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.176+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56080706d0 con 0x7f560806d210 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.176+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1500978102 0 0) 0x7f55f4003520 con 0x7f56080cb4c0 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.176+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560806d5f0 msgr2=0x7f560815e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.176+0000 7f560ccc8640 1 --2- 172.21.15.38:0/1317278107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560806d5f0 0x7f560815e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.176+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 >> v1:172.21.15.89:6789/0 conn(0x7f560806d210 legacy=0x7f5608159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.176+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56080ceb20 con 0x7f56080cb4c0 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.176+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f55f8001670 con 0x7f56080cb4c0 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.176+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 >> v1:172.21.15.38:6789/0 conn(0x7f56080cb4c0 legacy=0x7f5608070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.176+0000 7f560ccc8640 1 --2- 172.21.15.38:0/1317278107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f4003b30 0x7f55f4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560ccc8640 1 --2- 172.21.15.38:0/1317278107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f40047c0 0x7f55f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560ccc8640 1 --2- 172.21.15.38:0/1317278107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560806d5f0 0x7f55f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080ce840 con 0x7f55f40047c0 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f400ba30 con 0x7f55f4003b30 2023-12-22T08:40:20.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f400bbf0 con 0x7f560806d5f0 2023-12-22T08:40:20.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560d4c9640 1 --2- 172.21.15.38:0/1317278107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f40047c0 0x7f55f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560dcca640 1 --2- 172.21.15.38:0/1317278107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f4003b30 0x7f55f4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560e4cb640 1 --2- 172.21.15.38:0/1317278107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560806d5f0 0x7f55f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560d4c9640 1 -- 172.21.15.38:0/1317278107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560806d5f0 msgr2=0x7f55f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:20.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560d4c9640 1 --2- 172.21.15.38:0/1317278107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560806d5f0 0x7f55f4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560d4c9640 1 -- 172.21.15.38:0/1317278107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f4003b30 msgr2=0x7f55f4003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:20.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560d4c9640 1 --2- 172.21.15.38:0/1317278107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f4003b30 0x7f55f4003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560d4c9640 1 -- 172.21.15.38:0/1317278107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f4003520 con 0x7f55f40047c0 2023-12-22T08:40:20.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.177+0000 7f560e4cb640 1 --2- 172.21.15.38:0/1317278107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f560806d5f0 0x7f55f4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:20.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.178+0000 7f560d4c9640 1 --2- 172.21.15.38:0/1317278107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f40047c0 0x7f55f4004c40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f55f8007f90 tx=0x7f55f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de44e07a7ecb0764 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:20.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.179+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f802eb80 con 0x7f55f40047c0 2023-12-22T08:40:20.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.179+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f802ece0 con 0x7f55f40047c0 2023-12-22T08:40:20.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.179+0000 7f560ccc8640 1 -- 172.21.15.38:0/1317278107 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8005af0 con 0x7f55f40047c0 2023-12-22T08:40:20.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.179+0000 7f560eccc640 1 -- 172.21.15.38:0/1317278107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f40047c0 msgr2=0x7f55f4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:20.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.179+0000 7f560eccc640 1 --2- 172.21.15.38:0/1317278107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f40047c0 0x7f55f4004c40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f55f8007f90 tx=0x7f55f40057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.179+0000 7f560e4cb640 1 -- 172.21.15.38:0/1317278107 reap_dead start 2023-12-22T08:40:20.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.179+0000 7f560eccc640 1 -- 172.21.15.38:0/1317278107 shutdown_connections 2023-12-22T08:40:20.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.179+0000 7f560eccc640 1 -- 172.21.15.38:0/1317278107 >> 172.21.15.38:0/1317278107 conn(0x7f56080b1f70 msgr2=0x7f56080b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:20.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.179+0000 7f560eccc640 1 -- 172.21.15.38:0/1317278107 shutdown_connections 2023-12-22T08:40:20.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.179+0000 7f560eccc640 1 -- 172.21.15.38:0/1317278107 wait complete. 2023-12-22T08:40:20.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.181+0000 7f560eccc640 1 Processor -- start 2023-12-22T08:40:20.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.181+0000 7f560eccc640 1 -- start start 2023-12-22T08:40:20.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.182+0000 7f560eccc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55f40047c0 0x7f56081f2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.182+0000 7f560eccc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56080a2870 0x7f5608154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.182+0000 7f560eccc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56081f3950 0x7f560806fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.182+0000 7f560eccc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c2070 con 0x7f56081f3950 2023-12-22T08:40:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.182+0000 7f560eccc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5608158910 con 0x7f56080a2870 2023-12-22T08:40:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.182+0000 7f560eccc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080a0480 con 0x7f55f40047c0 2023-12-22T08:40:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.182+0000 7f560e4cb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56081f3950 0x7f560806fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.182+0000 7f560e4cb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56081f3950 0x7f560806fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35228/0 (socket says 172.21.15.38:35228) 2023-12-22T08:40:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.182+0000 7f560e4cb640 1 -- 172.21.15.38:0/3516137830 learned_addr learned my addr 172.21.15.38:0/3516137830 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.183+0000 7f560dcca640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55f40047c0 0x7f56081f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.183+0000 7f560e4cb640 1 -- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55f40047c0 msgr2=0x7f56081f2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.183+0000 7f560e4cb640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55f40047c0 0x7f56081f2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.183+0000 7f560d4c9640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56080a2870 0x7f5608154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.183+0000 7f560e4cb640 1 -- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56080a2870 msgr2=0x7f5608154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:20.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.183+0000 7f560e4cb640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56080a2870 0x7f5608154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.183+0000 7f560e4cb640 1 -- 172.21.15.38:0/3516137830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56080a2cf0 con 0x7f56081f3950 2023-12-22T08:40:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.183+0000 7f560dcca640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55f40047c0 0x7f56081f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.183+0000 7f560e4cb640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56081f3950 0x7f560806fa90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f560806ede0 tx=0x7f560000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.183+0000 7f55fe7fc640 1 -- 172.21.15.38:0/3516137830 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600017400 con 0x7f56081f3950 2023-12-22T08:40:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.184+0000 7f55fe7fc640 1 -- 172.21.15.38:0/3516137830 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5600011040 con 0x7f56081f3950 2023-12-22T08:40:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.184+0000 7f55fe7fc640 1 -- 172.21.15.38:0/3516137830 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600017780 con 0x7f56081f3950 2023-12-22T08:40:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.184+0000 7f560eccc640 1 -- 172.21.15.38:0/3516137830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5608154fa0 con 0x7f56081f3950 2023-12-22T08:40:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.184+0000 7f560eccc640 1 -- 172.21.15.38:0/3516137830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56081f30a0 con 0x7f56081f3950 2023-12-22T08:40:20.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.185+0000 7f560eccc640 1 -- 172.21.15.38:0/3516137830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5608061910 con 0x7f56081f3950 2023-12-22T08:40:20.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.186+0000 7f55fe7fc640 1 -- 172.21.15.38:0/3516137830 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f56000203b0 con 0x7f56081f3950 2023-12-22T08:40:20.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.187+0000 7f55fe7fc640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f55ec06a430 0x7f55ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.187+0000 7f55fe7fc640 1 -- 172.21.15.38:0/3516137830 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5600088cd0 con 0x7f56081f3950 2023-12-22T08:40:20.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.187+0000 7f560dcca640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f55ec06a430 0x7f55ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.188+0000 7f560dcca640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f55ec06a430 0x7f55ec06c8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5604007850 tx=0x7f5604009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:20.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.191+0000 7f55fe7fc640 1 -- 172.21.15.38:0/3516137830 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5600054190 con 0x7f56081f3950 2023-12-22T08:40:20.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.388+0000 7f560eccc640 1 -- 172.21.15.38:0/3516137830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5608159e70 con 0x7f56081f3950 2023-12-22T08:40:20.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.390+0000 7f55fe7fc640 1 -- 172.21.15.38:0/3516137830 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f560001c090 con 0x7f56081f3950 2023-12-22T08:40:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:20.393 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:59.604518+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:20.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.393+0000 7f560eccc640 1 -- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f55ec06a430 msgr2=0x7f55ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:20.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.393+0000 7f560eccc640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f55ec06a430 0x7f55ec06c8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5604007850 tx=0x7f5604009040 comp rx=0 tx=0).stop 2023-12-22T08:40:20.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.393+0000 7f560eccc640 1 -- 172.21.15.38:0/3516137830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56081f3950 msgr2=0x7f560806fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:20.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.393+0000 7f560eccc640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56081f3950 0x7f560806fa90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f560806ede0 tx=0x7f560000f4a0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.393+0000 7f560eccc640 1 -- 172.21.15.38:0/3516137830 shutdown_connections 2023-12-22T08:40:20.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.393+0000 7f560eccc640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f55ec06a430 0x7f55ec06c8f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.393+0000 7f560eccc640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56081f3950 0x7f560806fa90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.393+0000 7f560eccc640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56080a2870 0x7f5608154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.393+0000 7f560eccc640 1 --2- 172.21.15.38:0/3516137830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55f40047c0 0x7f56081f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.393+0000 7f560eccc640 1 -- 172.21.15.38:0/3516137830 >> 172.21.15.38:0/3516137830 conn(0x7f56080b1f70 msgr2=0x7f560809df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:20.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.393+0000 7f560eccc640 1 -- 172.21.15.38:0/3516137830 shutdown_connections 2023-12-22T08:40:20.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.393+0000 7f560eccc640 1 -- 172.21.15.38:0/3516137830 wait complete. 2023-12-22T08:40:20.417 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:40:20.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.648+0000 7fda03b01640 1 Processor -- start 2023-12-22T08:40:20.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.648+0000 7fda03b01640 1 -- start start 2023-12-22T08:40:20.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.650+0000 7fda03b01640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc0b26a0 0x7fd9fc06ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.650+0000 7fda03b01640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd9fc06cf50 0x7fd9fc0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.650+0000 7fda03b01640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc0b3d10 con 0x7fd9fc0b22c0 2023-12-22T08:40:20.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.650+0000 7fda03b01640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc06c610 con 0x7fd9fc06cf50 2023-12-22T08:40:20.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.650+0000 7fda03b01640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc0b4510 con 0x7fd9fc0b26a0 2023-12-22T08:40:20.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.650+0000 7fda0209e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd9fc06cf50 0x7fd9fc0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.650+0000 7fda0209e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd9fc06cf50 0x7fd9fc0cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35242/0 (socket says 172.21.15.38:35242) 2023-12-22T08:40:20.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.650+0000 7fda0209e640 1 -- 172.21.15.38:0/1399337041 learned_addr learned my addr 172.21.15.38:0/1399337041 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:20.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.651+0000 7fda0109c640 1 --2- 172.21.15.38:0/1399337041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc0b26a0 0x7fd9fc06ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.651+0000 7fda0209e640 1 -- 172.21.15.38:0/1399337041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc0b26a0 msgr2=0x7fd9fc06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:20.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.651+0000 7fda0209e640 1 --2- 172.21.15.38:0/1399337041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc0b26a0 0x7fd9fc06ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.651+0000 7fda0209e640 1 -- 172.21.15.38:0/1399337041 >> v1:172.21.15.89:6789/0 conn(0x7fd9fc0b22c0 legacy=0x7fd9fc0b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:20.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.651+0000 7fda0209e640 1 -- 172.21.15.38:0/1399337041 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc0b3f50 con 0x7fd9fc06cf50 2023-12-22T08:40:20.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.652+0000 7fda0209e640 1 --2- 172.21.15.38:0/1399337041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9fc06cf50 0x7fd9fc0cb830 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009e50 tx=0x7fd9f402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc810de1076bfb2e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:20.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.653+0000 7fda0089b640 1 -- 172.21.15.38:0/1399337041 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f402ca70 con 0x7fd9fc06cf50 2023-12-22T08:40:20.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.653+0000 7fda0089b640 1 -- 172.21.15.38:0/1399337041 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f402cbd0 con 0x7fd9fc06cf50 2023-12-22T08:40:20.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.653+0000 7fda0089b640 1 -- 172.21.15.38:0/1399337041 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f40343f0 con 0x7fd9fc06cf50 2023-12-22T08:40:20.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.653+0000 7fda03b01640 1 -- 172.21.15.38:0/1399337041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9fc06cf50 msgr2=0x7fd9fc0cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:20.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.653+0000 7fda03b01640 1 --2- 172.21.15.38:0/1399337041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9fc06cf50 0x7fd9fc0cb830 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009e50 tx=0x7fd9f402bed0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.654+0000 7fda03b01640 1 -- 172.21.15.38:0/1399337041 shutdown_connections 2023-12-22T08:40:20.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.654+0000 7fda03b01640 1 --2- 172.21.15.38:0/1399337041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9fc06cf50 0x7fd9fc0cb830 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.654+0000 7fda03b01640 1 --2- 172.21.15.38:0/1399337041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc0b26a0 0x7fd9fc06ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.654+0000 7fda03b01640 1 -- 172.21.15.38:0/1399337041 >> 172.21.15.38:0/1399337041 conn(0x7fd9fc0cf070 msgr2=0x7fd9fc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:20.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.654+0000 7fda03b01640 1 -- 172.21.15.38:0/1399337041 shutdown_connections 2023-12-22T08:40:20.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.654+0000 7fda03b01640 1 -- 172.21.15.38:0/1399337041 wait complete. 2023-12-22T08:40:20.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.656+0000 7fda03b01640 1 Processor -- start 2023-12-22T08:40:20.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.656+0000 7fda03b01640 1 -- start start 2023-12-22T08:40:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.657+0000 7fda03b01640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9fc06cf50 0x7fd9fc14a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.657+0000 7fda03b01640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc0b22c0 0x7fd9fc15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.657+0000 7fda03b01640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc0b26a0 0x7fd9fc1eb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.657+0000 7fda03b01640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc156bb0 con 0x7fd9fc06cf50 2023-12-22T08:40:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.657+0000 7fda03b01640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc15d340 con 0x7fd9fc0b26a0 2023-12-22T08:40:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.657+0000 7fda03b01640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc156e00 con 0x7fd9fc0b22c0 2023-12-22T08:40:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.657+0000 7fda0189d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9fc06cf50 0x7fd9fc14a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.657+0000 7fda0189d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9fc06cf50 0x7fd9fc14a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35258/0 (socket says 172.21.15.38:35258) 2023-12-22T08:40:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.657+0000 7fda0189d640 1 -- 172.21.15.38:0/4131332322 learned_addr learned my addr 172.21.15.38:0/4131332322 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.658+0000 7fda0109c640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc0b22c0 0x7fd9fc15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.658+0000 7fda0209e640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc0b26a0 0x7fd9fc1eb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.658+0000 7fda0189d640 1 -- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc0b22c0 msgr2=0x7fd9fc15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:20.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.658+0000 7fda0189d640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc0b22c0 0x7fd9fc15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.658+0000 7fda0189d640 1 -- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc0b26a0 msgr2=0x7fd9fc1eb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:20.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.658+0000 7fda0189d640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc0b26a0 0x7fd9fc1eb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.658+0000 7fda0189d640 1 -- 172.21.15.38:0/4131332322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f4009b30 con 0x7fd9fc06cf50 2023-12-22T08:40:20.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.658+0000 7fda0189d640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9fc06cf50 0x7fd9fc14a3d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800c450 tx=0x7fd9f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:20.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.658+0000 7fd9f27fc640 1 -- 172.21.15.38:0/4131332322 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80052d0 con 0x7fd9fc06cf50 2023-12-22T08:40:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.659+0000 7fd9f27fc640 1 -- 172.21.15.38:0/4131332322 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f8005430 con 0x7fd9fc06cf50 2023-12-22T08:40:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.659+0000 7fd9f27fc640 1 -- 172.21.15.38:0/4131332322 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8012870 con 0x7fd9fc06cf50 2023-12-22T08:40:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.659+0000 7fda03b01640 1 -- 172.21.15.38:0/4131332322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc1570e0 con 0x7fd9fc06cf50 2023-12-22T08:40:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.659+0000 7fda03b01640 1 -- 172.21.15.38:0/4131332322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc15a6e0 con 0x7fd9fc06cf50 2023-12-22T08:40:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.660+0000 7fda03b01640 1 -- 172.21.15.38:0/4131332322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9fc157600 con 0x7fd9fc06cf50 2023-12-22T08:40:20.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.661+0000 7fd9f27fc640 1 -- 172.21.15.38:0/4131332322 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd9f80129d0 con 0x7fd9fc06cf50 2023-12-22T08:40:20.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.662+0000 7fd9f27fc640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd9e006a460 0x7fd9e006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:20.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.662+0000 7fd9f27fc640 1 -- 172.21.15.38:0/4131332322 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9f80882e0 con 0x7fd9fc06cf50 2023-12-22T08:40:20.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.663+0000 7fda0109c640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd9e006a460 0x7fd9e006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:20.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.664+0000 7fda0109c640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd9e006a460 0x7fd9e006c920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0cef00 tx=0x7fd9ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:20.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.667+0000 7fd9f27fc640 1 -- 172.21.15.38:0/4131332322 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd9fc157600 con 0x7fd9fc06cf50 2023-12-22T08:40:20.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.896+0000 7fda03b01640 1 -- 172.21.15.38:0/4131332322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9fc0b3d10 con 0x7fd9fc06cf50 2023-12-22T08:40:20.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.897+0000 7fd9f27fc640 1 -- 172.21.15.38:0/4131332322 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4639 (secure 0 0 0) 0x7fd9fc0b3d10 con 0x7fd9fc06cf50 2023-12-22T08:40:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:20.900 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/444746330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":444746330},{"type":"v1","addr":"172.21.15.38:6833","nonce":444746330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/3918267418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":3918267418},{"type":"v1","addr":"172.21.15.38:6835","nonce":3918267418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2511997570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2511997570},{"type":"v1","addr":"172.21.15.89:6835","nonce":2511997570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:39:58.600709+0000","modified":"2023-12-22T08:40:02.076114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2902919630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2902919630},{"type":"v1","addr":"172.21.15.89:6837","nonce":2902919630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:40:20.901 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-12-22T08:40:20.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.900+0000 7fda03b01640 1 -- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd9e006a460 msgr2=0x7fd9e006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:20.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.900+0000 7fda03b01640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd9e006a460 0x7fd9e006c920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0cef00 tx=0x7fd9ec008040 comp rx=0 tx=0).stop 2023-12-22T08:40:20.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.900+0000 7fda03b01640 1 -- 172.21.15.38:0/4131332322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9fc06cf50 msgr2=0x7fd9fc14a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:20.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.900+0000 7fda03b01640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9fc06cf50 0x7fd9fc14a3d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800c450 tx=0x7fd9f800c910 comp rx=0 tx=0).stop 2023-12-22T08:40:20.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.900+0000 7fda03b01640 1 -- 172.21.15.38:0/4131332322 shutdown_connections 2023-12-22T08:40:20.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.900+0000 7fda03b01640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9fc0b26a0 0x7fd9fc1eb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.900+0000 7fda03b01640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9fc0b22c0 0x7fd9fc15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.900+0000 7fda03b01640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd9e006a460 0x7fd9e006c920 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.900+0000 7fda03b01640 1 --2- 172.21.15.38:0/4131332322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9fc06cf50 0x7fd9fc14a3d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:20.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.900+0000 7fda03b01640 1 -- 172.21.15.38:0/4131332322 >> 172.21.15.38:0/4131332322 conn(0x7fd9fc0cf070 msgr2=0x7fd9fc160410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:20.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.900+0000 7fda03b01640 1 -- 172.21.15.38:0/4131332322 shutdown_connections 2023-12-22T08:40:20.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:20.900+0000 7fda03b01640 1 -- 172.21.15.38:0/4131332322 wait complete. 2023-12-22T08:40:21.322 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T08:39:58.600709+0000', 'modified': '2023-12-22T08:40:02.076114+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6837/2902919630', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6836', 'nonce': 2902919630}, {'type': 'v1', 'addr': '172.21.15.89:6837', 'nonce': 2902919630}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T08:40:21.322 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T08:40:21.323 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-22T08:40:21.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.550+0000 7f1065c80640 1 Processor -- start 2023-12-22T08:40:21.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.550+0000 7f1065c80640 1 -- start start 2023-12-22T08:40:21.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.552+0000 7f1065c80640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10600cb5e0 0x7f106015d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.552+0000 7f1065c80640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1060161bb0 0x7f106015de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.552+0000 7f1065c80640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106015e3c0 con 0x7f106015ad90 2023-12-22T08:40:21.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.552+0000 7f1065c80640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10600ce2c0 con 0x7f1060161bb0 2023-12-22T08:40:21.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.552+0000 7f1065c80640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106015e910 con 0x7f10600cb5e0 2023-12-22T08:40:21.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.552+0000 7f1064c7e640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f106015ad90 0x7f10600caed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39578/0 (socket says 172.21.15.38:39578) 2023-12-22T08:40:21.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.552+0000 7f1064c7e640 1 -- 172.21.15.38:0/4001954928 learned_addr learned my addr 172.21.15.38:0/4001954928 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:21.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.552+0000 7f106547f640 1 --2- 172.21.15.38:0/4001954928 >> v2:172.21.15.38:3300/0 conn(0x7f1060161bb0 0x7f106015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.553+0000 7f105ffff640 1 --2- 172.21.15.38:0/4001954928 >> v2:172.21.15.89:3300/0 conn(0x7f10600cb5e0 0x7f106015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.553+0000 7f106547f640 1 -- 172.21.15.38:0/4001954928 >> v2:172.21.15.89:3300/0 conn(0x7f10600cb5e0 msgr2=0x7f106015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:21.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.553+0000 7f106547f640 1 --2- 172.21.15.38:0/4001954928 >> v2:172.21.15.89:3300/0 conn(0x7f10600cb5e0 0x7f106015d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.553+0000 7f106547f640 1 -- 172.21.15.38:0/4001954928 >> v1:172.21.15.38:6789/0 conn(0x7f106015ad90 legacy=0x7f10600caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.553+0000 7f106547f640 1 -- 172.21.15.38:0/4001954928 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106015e630 con 0x7f1060161bb0 2023-12-22T08:40:21.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.553+0000 7f105f7fe640 1 -- 172.21.15.38:0/4001954928 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080256282 0 0) 0x7f106015e3c0 con 0x7f106015ad90 2023-12-22T08:40:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.554+0000 7f106547f640 1 --2- 172.21.15.38:0/4001954928 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1060161bb0 0x7f106015de80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10600d0d40 tx=0x7f105802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c478b6d81078bc75 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.554+0000 7f105f7fe640 1 -- 172.21.15.38:0/4001954928 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105802cc80 con 0x7f1060161bb0 2023-12-22T08:40:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.554+0000 7f105f7fe640 1 -- 172.21.15.38:0/4001954928 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105802cde0 con 0x7f1060161bb0 2023-12-22T08:40:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.554+0000 7f105f7fe640 1 -- 172.21.15.38:0/4001954928 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058034660 con 0x7f1060161bb0 2023-12-22T08:40:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.555+0000 7f1065c80640 1 -- 172.21.15.38:0/4001954928 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1060161bb0 msgr2=0x7f106015de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.555+0000 7f1065c80640 1 --2- 172.21.15.38:0/4001954928 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1060161bb0 0x7f106015de80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f10600d0d40 tx=0x7f105802bed0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.555+0000 7f1065c80640 1 -- 172.21.15.38:0/4001954928 shutdown_connections 2023-12-22T08:40:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.555+0000 7f1065c80640 1 --2- 172.21.15.38:0/4001954928 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1060161bb0 0x7f106015de80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.555+0000 7f1065c80640 1 --2- 172.21.15.38:0/4001954928 >> v2:172.21.15.89:3300/0 conn(0x7f10600cb5e0 0x7f106015d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.555+0000 7f1065c80640 1 -- 172.21.15.38:0/4001954928 >> 172.21.15.38:0/4001954928 conn(0x7f10600d31c0 msgr2=0x7f10600d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.555+0000 7f1065c80640 1 -- 172.21.15.38:0/4001954928 shutdown_connections 2023-12-22T08:40:21.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.555+0000 7f1065c80640 1 -- 172.21.15.38:0/4001954928 wait complete. 2023-12-22T08:40:21.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.557+0000 7f1065c80640 1 Processor -- start 2023-12-22T08:40:21.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.557+0000 7f1065c80640 1 -- start start 2023-12-22T08:40:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.558+0000 7f1065c80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10600cb5e0 0x7f1060140d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.558+0000 7f1065c80640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f106015ad90 0x7f1060152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.558+0000 7f1065c80640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1060161bb0 0x7f10600c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.558+0000 7f1065c80640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1060152540 con 0x7f106015ad90 2023-12-22T08:40:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.558+0000 7f1065c80640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c6eb0 con 0x7f10600cb5e0 2023-12-22T08:40:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.558+0000 7f1065c80640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c7190 con 0x7f1060161bb0 2023-12-22T08:40:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.558+0000 7f105ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f106015ad90 0x7f1060152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.558+0000 7f105ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f106015ad90 0x7f1060152000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43148/0 (socket says 172.21.15.38:43148) 2023-12-22T08:40:21.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.558+0000 7f105ffff640 1 -- 172.21.15.38:0/3729316726 learned_addr learned my addr 172.21.15.38:0/3729316726 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:21.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.559+0000 7f106547f640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1060161bb0 0x7f10600c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.559+0000 7f1064c7e640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10600cb5e0 0x7f1060140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.559+0000 7f105ffff640 1 -- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1060161bb0 msgr2=0x7f10600c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.559+0000 7f105ffff640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1060161bb0 0x7f10600c7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.559+0000 7f105ffff640 1 -- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10600cb5e0 msgr2=0x7f1060140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.559+0000 7f105ffff640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10600cb5e0 0x7f1060140d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.559+0000 7f105ffff640 1 -- 172.21.15.38:0/3729316726 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058009a70 con 0x7f106015ad90 2023-12-22T08:40:21.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.559+0000 7f105ffff640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f106015ad90 0x7f1060152000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f104c00d800 tx=0x7f104c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:21.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.559+0000 7f105d7fa640 1 -- 172.21.15.38:0/3729316726 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c00b6c0 con 0x7f106015ad90 2023-12-22T08:40:21.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.559+0000 7f105d7fa640 1 -- 172.21.15.38:0/3729316726 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c00b820 con 0x7f106015ad90 2023-12-22T08:40:21.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.559+0000 7f105d7fa640 1 -- 172.21.15.38:0/3729316726 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c00bbb0 con 0x7f106015ad90 2023-12-22T08:40:21.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.559+0000 7f1065c80640 1 -- 172.21.15.38:0/3729316726 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10600c7470 con 0x7f106015ad90 2023-12-22T08:40:21.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.559+0000 7f1065c80640 1 -- 172.21.15.38:0/3729316726 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10600c7a30 con 0x7f106015ad90 2023-12-22T08:40:21.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.561+0000 7f105d7fa640 1 -- 172.21.15.38:0/3729316726 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f104c00bd10 con 0x7f106015ad90 2023-12-22T08:40:21.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.562+0000 7f105d7fa640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f104406a460 0x7f104406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.562+0000 7f105d7fa640 1 -- 172.21.15.38:0/3729316726 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f104c088ec0 con 0x7f106015ad90 2023-12-22T08:40:21.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.563+0000 7f1064c7e640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f104406a460 0x7f104406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.563+0000 7f1069a4e740 1 Processor -- start 2023-12-22T08:40:21.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.564+0000 7f1069a4e740 1 -- start start 2023-12-22T08:40:21.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.564+0000 7f1064c7e640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f104406a460 0x7f104406c920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1054007fd0 tx=0x7f1054009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.564+0000 7f1069a4e740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998b0f10 0x5639998b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.564+0000 7f1069a4e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563999880e90 0x5639998ae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.564+0000 7f1069a4e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 0x5639998ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f1069a4e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639997f0f80 con 0x563999880e90 2023-12-22T08:40:21.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f1069a4e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639997ee710 con 0x563999884a90 2023-12-22T08:40:21.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f1069a4e740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639997ea000 con 0x5639998b0f10 2023-12-22T08:40:21.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f105ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563999880e90 0x5639998ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f105ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563999880e90 0x5639998ae180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43160/0 (socket says 172.21.15.38:43160) 2023-12-22T08:40:21.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f105ffff640 1 -- 172.21.15.38:0/2202331538 learned_addr learned my addr 172.21.15.38:0/2202331538 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:21.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f1064c7e640 1 --2- 172.21.15.38:0/2202331538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998b0f10 0x5639998b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f105ffff640 1 -- 172.21.15.38:0/2202331538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998b0f10 msgr2=0x5639998b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:21.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f105ffff640 1 --2- 172.21.15.38:0/2202331538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998b0f10 0x5639998b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f106547f640 1 --2- 172.21.15.38:0/2202331538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 0x5639998ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f105ffff640 1 -- 172.21.15.38:0/2202331538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 msgr2=0x5639998ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:21.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f105ffff640 1 --2- 172.21.15.38:0/2202331538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 0x5639998ae6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f105ffff640 1 -- 172.21.15.38:0/2202331538 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639997b1690 con 0x563999880e90 2023-12-22T08:40:21.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.565+0000 7f105ffff640 1 --2- 172.21.15.38:0/2202331538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563999880e90 0x5639998ae180 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f104c0872f0 tx=0x7f104c057d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7256c46f73c5a2a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:21.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.566+0000 7f104a7fc640 1 -- 172.21.15.38:0/2202331538 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c05bf00 con 0x563999880e90 2023-12-22T08:40:21.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.566+0000 7f104a7fc640 1 -- 172.21.15.38:0/2202331538 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c05b070 con 0x563999880e90 2023-12-22T08:40:21.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.566+0000 7f104a7fc640 1 -- 172.21.15.38:0/2202331538 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c0600b0 con 0x563999880e90 2023-12-22T08:40:21.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.566+0000 7f1069a4e740 1 -- 172.21.15.38:0/2202331538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563999880e90 msgr2=0x5639998ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.566+0000 7f1069a4e740 1 --2- 172.21.15.38:0/2202331538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563999880e90 0x5639998ae180 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f104c0872f0 tx=0x7f104c057d40 comp rx=0 tx=0).stop 2023-12-22T08:40:21.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.566+0000 7f1069a4e740 1 -- 172.21.15.38:0/2202331538 shutdown_connections 2023-12-22T08:40:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.566+0000 7f1069a4e740 1 --2- 172.21.15.38:0/2202331538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 0x5639998ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.566+0000 7f1069a4e740 1 --2- 172.21.15.38:0/2202331538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563999880e90 0x5639998ae180 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.566+0000 7f1069a4e740 1 --2- 172.21.15.38:0/2202331538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998b0f10 0x5639998b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.566+0000 7f1069a4e740 1 -- 172.21.15.38:0/2202331538 >> 172.21.15.38:0/2202331538 conn(0x5639998831a0 msgr2=0x5639998cbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.567+0000 7f1069a4e740 1 -- 172.21.15.38:0/2202331538 shutdown_connections 2023-12-22T08:40:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.567+0000 7f1069a4e740 1 -- 172.21.15.38:0/2202331538 wait complete. 2023-12-22T08:40:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.567+0000 7f1069a4e740 1 -- start start 2023-12-22T08:40:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.567+0000 7f1069a4e740 1 Processor -- start 2023-12-22T08:40:21.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.568+0000 7f1069a4e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 0x5639998dacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.568+0000 7f1069a4e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x5639998a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.568+0000 7f1069a4e740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998ab880 0x5639998de840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.568+0000 7f1069a4e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56399978b7d0 con 0x5639998b0f10 2023-12-22T08:40:21.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.568+0000 7f1069a4e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56399978b470 con 0x563999884a90 2023-12-22T08:40:21.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.568+0000 7f1069a4e740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x563999551f20 con 0x5639998ab880 2023-12-22T08:40:21.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.568+0000 7f1069a4e740 10 client.0 _ll_register_callbacks cb 0x5639997da1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:40:21.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.569+0000 7f105ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x5639998a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.569+0000 7f105ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x5639998a9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43162/0 (socket says 172.21.15.38:43162) 2023-12-22T08:40:21.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.569+0000 7f105ffff640 1 -- 172.21.15.38:0/4095707568 learned_addr learned my addr 172.21.15.38:0/4095707568 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.569+0000 7f1064c7e640 1 --2- 172.21.15.38:0/4095707568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 0x5639998dacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.569+0000 7f105ffff640 1 -- 172.21.15.38:0/4095707568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998ab880 msgr2=0x5639998de840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.569+0000 7f105ffff640 1 --2- 172.21.15.38:0/4095707568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998ab880 0x5639998de840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.569+0000 7f105ffff640 1 -- 172.21.15.38:0/4095707568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 msgr2=0x5639998dacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.569+0000 7f105ffff640 1 --2- 172.21.15.38:0/4095707568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 0x5639998dacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.569+0000 7f105ffff640 1 -- 172.21.15.38:0/4095707568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10600c7a30 con 0x5639998b0f10 2023-12-22T08:40:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.569+0000 7f105ffff640 1 --2- 172.21.15.38:0/4095707568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x5639998a9ad0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f104c00b4b0 tx=0x7f104c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cf9bb60ab389d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.569+0000 7f103f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:40:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.569+0000 7f103f7fe640 1 -- 172.21.15.38:0/4095707568 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c05bf00 con 0x5639998b0f10 2023-12-22T08:40:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.570+0000 7f103f7fe640 1 -- 172.21.15.38:0/4095707568 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f104c0600b0 con 0x5639998b0f10 2023-12-22T08:40:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.570+0000 7f1069a4e740 1 -- 172.21.15.38:0/4095707568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563999814550 con 0x5639998b0f10 2023-12-22T08:40:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.570+0000 7f103f7fe640 1 -- 172.21.15.38:0/4095707568 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f104c0575c0 con 0x5639998b0f10 2023-12-22T08:40:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.570+0000 7f1069a4e740 10 client.4641 fetch_fsmap learned FSMap version 8 2023-12-22T08:40:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.570+0000 7f1069a4e740 1 -- 172.21.15.38:0/4095707568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5639997e8680 con 0x5639998b0f10 2023-12-22T08:40:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.570+0000 7f103f7fe640 1 -- 172.21.15.38:0/4095707568 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563999814550 con 0x5639998b0f10 2023-12-22T08:40:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.570+0000 7f103f7fe640 1 -- 172.21.15.38:0/4095707568 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 8) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f104c05fc20 con 0x5639998b0f10 2023-12-22T08:40:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.570+0000 7f1069a4e740 10 client.4641 fetch_fsmap finished waiting for FSMap version 8 2023-12-22T08:40:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.570+0000 7f1069a4e740 10 client.4641 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-22T08:40:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.570+0000 7f1069a4e740 20 client.4641 populate_metadata read hostname 'smithi038' 2023-12-22T08:40:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.570+0000 7f1069a4e740 1 --2- 172.21.15.38:0/4095707568 >> [v2:172.21.15.89:6836/2902919630,v1:172.21.15.89:6837/2902919630] conn(0x5639998b4c60 0x5639998a7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.570+0000 7f1069a4e740 4 client.4641 mds_command: new command op to 4273 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T08:40:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.570+0000 7f1069a4e740 1 -- 172.21.15.38:0/4095707568 --> [v2:172.21.15.89:6836/2902919630,v1:172.21.15.89:6837/2902919630] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639997dcb50 con 0x5639998b4c60 2023-12-22T08:40:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.571+0000 7f1064c7e640 1 --2- 172.21.15.38:0/4095707568 >> [v2:172.21.15.89:6836/2902919630,v1:172.21.15.89:6837/2902919630] conn(0x5639998b4c60 0x5639998a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.572+0000 7f1064c7e640 1 --2- 172.21.15.38:0/4095707568 >> [v2:172.21.15.89:6836/2902919630,v1:172.21.15.89:6837/2902919630] conn(0x5639998b4c60 0x5639998a7440 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83f0a720c91843c6 server_cookie=9de90186e124f38b in_seq=0 out_seq=0 2023-12-22T08:40:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.572+0000 7f103f7fe640 10 client.4641 ms_handle_connect on v2:172.21.15.89:6836/2902919630 2023-12-22T08:40:21.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f103f7fe640 1 -- 172.21.15.38:0/4095707568 <== mds.0 v2:172.21.15.89:6836/2902919630 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5639997dcb50 con 0x5639998b4c60 2023-12-22T08:40:21.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f103f7fe640 10 client.4641 handle_command_reply: tid=0 2023-12-22T08:40:21.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f1069a4e740 1 client.4641 shutdown 2023-12-22T08:40:21.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f1069a4e740 1 -- 172.21.15.38:0/4095707568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 msgr2=0x5639998a9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f1069a4e740 1 --2- 172.21.15.38:0/4095707568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x5639998a9ad0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f104c00b4b0 tx=0x7f104c010000 comp rx=0 tx=0).stop 2023-12-22T08:40:21.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f1069a4e740 1 -- 172.21.15.38:0/4095707568 shutdown_connections 2023-12-22T08:40:21.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f1069a4e740 1 --2- 172.21.15.38:0/4095707568 >> [v2:172.21.15.89:6836/2902919630,v1:172.21.15.89:6837/2902919630] conn(0x5639998b4c60 0x5639998a7440 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f1069a4e740 1 --2- 172.21.15.38:0/4095707568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998ab880 0x5639998de840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f1069a4e740 1 --2- 172.21.15.38:0/4095707568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x5639998a9ad0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f1069a4e740 1 --2- 172.21.15.38:0/4095707568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 0x5639998dacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f103f7fe640 0 client.4641 ms_handle_reset on v2:172.21.15.89:6836/2902919630 2023-12-22T08:40:21.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f1069a4e740 1 -- 172.21.15.38:0/4095707568 >> 172.21.15.38:0/4095707568 conn(0x563999880e90 msgr2=0x563999885240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:21.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f1069a4e740 1 -- 172.21.15.38:0/4095707568 shutdown_connections 2023-12-22T08:40:21.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.574+0000 7f1069a4e740 1 -- 172.21.15.38:0/4095707568 wait complete. 2023-12-22T08:40:21.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.575+0000 7f1069a4e740 20 client.4641 trim_cache size 0 max 16384 2023-12-22T08:40:21.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.591+0000 7f1069a4e740 1 Processor -- start 2023-12-22T08:40:21.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.591+0000 7f1069a4e740 1 -- start start 2023-12-22T08:40:21.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.592+0000 7f1069a4e740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563999884a90 0x5639998b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.592+0000 7f1069a4e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5639998ab880 0x5639998adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.592+0000 7f1069a4e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x563999885cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.592+0000 7f1069a4e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639998aad70 con 0x5639998b0f10 2023-12-22T08:40:21.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.592+0000 7f1069a4e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639997f3520 con 0x5639998ab880 2023-12-22T08:40:21.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.592+0000 7f1069a4e740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639998da6f0 con 0x563999884a90 2023-12-22T08:40:21.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.592+0000 7f106547f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x563999885cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.592+0000 7f106547f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x563999885cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43168/0 (socket says 172.21.15.38:43168) 2023-12-22T08:40:21.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.592+0000 7f106547f640 1 -- 172.21.15.38:0/1053197680 learned_addr learned my addr 172.21.15.38:0/1053197680 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:21.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.593+0000 7f1064c7e640 1 --2- 172.21.15.38:0/1053197680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563999884a90 0x5639998b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.593+0000 7f105ffff640 1 --2- 172.21.15.38:0/1053197680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5639998ab880 0x5639998adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.593+0000 7f106547f640 1 -- 172.21.15.38:0/1053197680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563999884a90 msgr2=0x5639998b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:21.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.593+0000 7f106547f640 1 --2- 172.21.15.38:0/1053197680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563999884a90 0x5639998b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.593+0000 7f106547f640 1 -- 172.21.15.38:0/1053197680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5639998ab880 msgr2=0x5639998adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:21.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.593+0000 7f106547f640 1 --2- 172.21.15.38:0/1053197680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5639998ab880 0x5639998adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.593+0000 7f106547f640 1 -- 172.21.15.38:0/1053197680 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56399978a9e0 con 0x5639998b0f10 2023-12-22T08:40:21.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.593+0000 7f106547f640 1 --2- 172.21.15.38:0/1053197680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x563999885cd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1058009e80 tx=0x7f105802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea39fc1a60c8318e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:21.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.593+0000 7f104affd640 1 -- 172.21.15.38:0/1053197680 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105803f480 con 0x5639998b0f10 2023-12-22T08:40:21.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.593+0000 7f104affd640 1 -- 172.21.15.38:0/1053197680 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105803f600 con 0x5639998b0f10 2023-12-22T08:40:21.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.593+0000 7f104affd640 1 -- 172.21.15.38:0/1053197680 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105803f9b0 con 0x5639998b0f10 2023-12-22T08:40:21.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.594+0000 7f1069a4e740 1 -- 172.21.15.38:0/1053197680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 msgr2=0x563999885cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.594+0000 7f1069a4e740 1 --2- 172.21.15.38:0/1053197680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x563999885cd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1058009e80 tx=0x7f105802e070 comp rx=0 tx=0).stop 2023-12-22T08:40:21.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.594+0000 7f1069a4e740 1 -- 172.21.15.38:0/1053197680 shutdown_connections 2023-12-22T08:40:21.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.594+0000 7f1069a4e740 1 --2- 172.21.15.38:0/1053197680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x563999885cd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.594+0000 7f1069a4e740 1 --2- 172.21.15.38:0/1053197680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5639998ab880 0x5639998adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.594+0000 7f1069a4e740 1 --2- 172.21.15.38:0/1053197680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563999884a90 0x5639998b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.594+0000 7f1069a4e740 1 -- 172.21.15.38:0/1053197680 >> 172.21.15.38:0/1053197680 conn(0x563999880e90 msgr2=0x563999885350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:21.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.594+0000 7f1069a4e740 1 -- 172.21.15.38:0/1053197680 shutdown_connections 2023-12-22T08:40:21.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.594+0000 7f1069a4e740 1 -- 172.21.15.38:0/1053197680 wait complete. 2023-12-22T08:40:21.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.595+0000 7f1069a4e740 1 -- start start 2023-12-22T08:40:21.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.595+0000 7f1069a4e740 1 Processor -- start 2023-12-22T08:40:21.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.596+0000 7f1069a4e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 0x563999886b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.596+0000 7f1069a4e740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998ab880 0x56399991a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.596+0000 7f1069a4e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x5639998b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.596+0000 7f1069a4e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639998adae0 con 0x5639998b0f10 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.596+0000 7f1069a4e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639998ac940 con 0x563999884a90 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.596+0000 7f1069a4e740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639998a7eb0 con 0x5639998ab880 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.596+0000 7f1069a4e740 10 client.0 _ll_register_callbacks cb 0x7f104c054410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.596+0000 7f106547f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x5639998b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.596+0000 7f106547f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x5639998b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43172/0 (socket says 172.21.15.38:43172) 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.596+0000 7f106547f640 1 -- 172.21.15.38:0/3812660264 learned_addr learned my addr 172.21.15.38:0/3812660264 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.597+0000 7f1064c7e640 1 --2- 172.21.15.38:0/3812660264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 0x563999886b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.597+0000 7f105ffff640 1 --2- 172.21.15.38:0/3812660264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998ab880 0x56399991a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.597+0000 7f106547f640 1 -- 172.21.15.38:0/3812660264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998ab880 msgr2=0x56399991a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.597+0000 7f106547f640 1 --2- 172.21.15.38:0/3812660264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998ab880 0x56399991a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.597+0000 7f106547f640 1 -- 172.21.15.38:0/3812660264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 msgr2=0x563999886b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.597+0000 7f106547f640 1 --2- 172.21.15.38:0/3812660264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 0x563999886b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.597+0000 7f106547f640 1 -- 172.21.15.38:0/3812660264 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106015e630 con 0x5639998b0f10 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.597+0000 7f106547f640 1 --2- 172.21.15.38:0/3812660264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x5639998b3630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f105802bf10 tx=0x7f1058004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0973321cb0f01e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.597+0000 7f103f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.597+0000 7f103f7fe640 1 -- 172.21.15.38:0/3812660264 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105803fb80 con 0x5639998b0f10 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.597+0000 7f103f7fe640 1 -- 172.21.15.38:0/3812660264 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f105803fce0 con 0x5639998b0f10 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.597+0000 7f1069a4e740 1 -- 172.21.15.38:0/3812660264 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f104c05b070 con 0x5639998b0f10 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.598+0000 7f103f7fe640 1 -- 172.21.15.38:0/3812660264 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f105803fea0 con 0x5639998b0f10 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.598+0000 7f1069a4e740 10 client.4647 fetch_fsmap learned FSMap version 8 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.598+0000 7f1069a4e740 1 -- 172.21.15.38:0/3812660264 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5639997afef0 con 0x5639998b0f10 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.598+0000 7f103f7fe640 1 -- 172.21.15.38:0/3812660264 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c05b070 con 0x5639998b0f10 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.598+0000 7f103f7fe640 1 -- 172.21.15.38:0/3812660264 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 8) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f1058004040 con 0x5639998b0f10 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.598+0000 7f1069a4e740 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.598+0000 7f1069a4e740 10 client.4647 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.598+0000 7f1069a4e740 20 client.4647 populate_metadata read hostname 'smithi038' 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.598+0000 7f1069a4e740 1 --2- 172.21.15.38:0/3812660264 >> [v2:172.21.15.89:6836/2902919630,v1:172.21.15.89:6837/2902919630] conn(0x5639998cd6b0 0x5639998cda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.598+0000 7f1069a4e740 4 client.4647 mds_command: new command op to 4273 tid=0[{"prefix": "status"}] 2023-12-22T08:40:21.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.598+0000 7f1069a4e740 1 -- 172.21.15.38:0/3812660264 --> [v2:172.21.15.89:6836/2902919630,v1:172.21.15.89:6837/2902919630] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5639997e3080 con 0x5639998cd6b0 2023-12-22T08:40:21.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.599+0000 7f1064c7e640 1 --2- 172.21.15.38:0/3812660264 >> [v2:172.21.15.89:6836/2902919630,v1:172.21.15.89:6837/2902919630] conn(0x5639998cd6b0 0x5639998cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.599+0000 7f1064c7e640 1 --2- 172.21.15.38:0/3812660264 >> [v2:172.21.15.89:6836/2902919630,v1:172.21.15.89:6837/2902919630] conn(0x5639998cd6b0 0x5639998cda90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25b7af18e5b2d091 server_cookie=6a10683a0e1583ce in_seq=0 out_seq=0 2023-12-22T08:40:21.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.599+0000 7f103f7fe640 10 client.4647 ms_handle_connect on v2:172.21.15.89:6836/2902919630 2023-12-22T08:40:21.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f103f7fe640 1 -- 172.21.15.38:0/3812660264 <== mds.0 v2:172.21.15.89:6836/2902919630 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5639997e3080 con 0x5639998cd6b0 2023-12-22T08:40:21.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f103f7fe640 10 client.4647 handle_command_reply: tid=0 2023-12-22T08:40:21.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f1069a4e740 1 client.4647 shutdown 2023-12-22T08:40:21.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f1069a4e740 1 -- 172.21.15.38:0/3812660264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 msgr2=0x5639998b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f1069a4e740 1 --2- 172.21.15.38:0/3812660264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x5639998b3630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f105802bf10 tx=0x7f1058004ab0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f1069a4e740 1 -- 172.21.15.38:0/3812660264 shutdown_connections 2023-12-22T08:40:21.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f1069a4e740 1 --2- 172.21.15.38:0/3812660264 >> [v2:172.21.15.89:6836/2902919630,v1:172.21.15.89:6837/2902919630] conn(0x5639998cd6b0 0x5639998cda90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f1069a4e740 1 --2- 172.21.15.38:0/3812660264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639998b0f10 0x5639998b3630 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f1069a4e740 1 --2- 172.21.15.38:0/3812660264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5639998ab880 0x56399991a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f103f7fe640 0 client.4647 ms_handle_reset on v2:172.21.15.89:6836/2902919630 2023-12-22T08:40:21.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f1069a4e740 1 --2- 172.21.15.38:0/3812660264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563999884a90 0x563999886b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f1069a4e740 1 -- 172.21.15.38:0/3812660264 >> 172.21.15.38:0/3812660264 conn(0x563999880e90 msgr2=0x5639998adeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:21.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f1069a4e740 1 -- 172.21.15.38:0/3812660264 shutdown_connections 2023-12-22T08:40:21.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.600+0000 7f1069a4e740 1 -- 172.21.15.38:0/3812660264 wait complete. 2023-12-22T08:40:21.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.601+0000 7f1069a4e740 20 client.4647 trim_cache size 0 max 16384 2023-12-22T08:40:21.606 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:40:21.606 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:40:21.606 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-12-22T08:40:21.607 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4273, 2023-12-22T08:40:21.607 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-12-22T08:40:21.607 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-12-22T08:40:21.607 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-12-22T08:40:21.607 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 22.991829891999998, 2023-12-22T08:40:21.607 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 8, 2023-12-22T08:40:21.607 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 20, 2023-12-22T08:40:21.607 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 20, 2023-12-22T08:40:21.607 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 27.839754865 2023-12-22T08:40:21.607 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:40:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.601+0000 7f1065c80640 1 -- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f104406a460 msgr2=0x7f104406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.601+0000 7f1065c80640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f104406a460 0x7f104406c920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1054007fd0 tx=0x7f1054009040 comp rx=0 tx=0).stop 2023-12-22T08:40:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.601+0000 7f1065c80640 1 -- 172.21.15.38:0/3729316726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f106015ad90 msgr2=0x7f1060152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.601+0000 7f1065c80640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f106015ad90 0x7f1060152000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f104c00d800 tx=0x7f104c00dcc0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.601+0000 7f1065c80640 1 -- 172.21.15.38:0/3729316726 shutdown_connections 2023-12-22T08:40:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.601+0000 7f1065c80640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1060161bb0 0x7f10600c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.601+0000 7f1065c80640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f104406a460 0x7f104406c920 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.601+0000 7f1065c80640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f106015ad90 0x7f1060152000 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.601+0000 7f1065c80640 1 --2- 172.21.15.38:0/3729316726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10600cb5e0 0x7f1060140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.601+0000 7f1065c80640 1 -- 172.21.15.38:0/3729316726 >> 172.21.15.38:0/3729316726 conn(0x7f10600d31c0 msgr2=0x7f1060160590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:21.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.601+0000 7f1065c80640 1 -- 172.21.15.38:0/3729316726 shutdown_connections 2023-12-22T08:40:21.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:21.601+0000 7f1065c80640 1 -- 172.21.15.38:0/3729316726 wait complete. 2023-12-22T08:40:21.620 INFO:teuthology.run_tasks:Running task kclient... 2023-12-22T08:40:21.647 INFO:tasks.kclient:Mounting kernel clients... 2023-12-22T08:40:21.648 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-22T08:40:21.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:21.648 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:40:21.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:21.708 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2023-12-22T08:40:21.815 INFO:teuthology.orchestra.run.smithi038.stderr:Cannot find device "ceph-brx" 2023-12-22T08:40:21.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:40:21.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:21.819 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:40:21.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:21.878 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2023-12-22T08:40:21.983 INFO:teuthology.orchestra.run.smithi038.stderr:Cannot find device "ceph-brx" 2023-12-22T08:40:21.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:40:21.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:21.988 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:40:22.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:22.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-12-22T08:40:22.153 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2023-12-22T08:40:22.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:40:22.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:22.158 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:40:22.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:22.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-12-22T08:40:22.303 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2023-12-22T08:40:22.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:40:22.308 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-12-22T08:40:22.308 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-22T08:40:22.308 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:40:22.308 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:40:22.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.541+0000 7effd359e640 1 Processor -- start 2023-12-22T08:40:22.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.541+0000 7effd359e640 1 -- start start 2023-12-22T08:40:22.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.543+0000 7effd359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7effd4071000 0x7effd4165f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.543+0000 7effd359e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd40cdae0 con 0x7effd40a44a0 2023-12-22T08:40:22.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.543+0000 7effd359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd415b800 con 0x7effd415b420 2023-12-22T08:40:22.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.543+0000 7effd359e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd40cdd30 con 0x7effd4071000 2023-12-22T08:40:22.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.543+0000 7effc9d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7effd40a44a0 0x7effd40708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39584/0 (socket says 172.21.15.38:39584) 2023-12-22T08:40:22.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.543+0000 7effc9d9b640 1 -- 172.21.15.38:0/1035699883 learned_addr learned my addr 172.21.15.38:0/1035699883 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:22.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.544+0000 7effd2d9d640 1 --2- 172.21.15.38:0/1035699883 >> v2:172.21.15.89:3300/0 conn(0x7effd4071000 0x7effd4165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.544+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887605181 0 0) 0x7effd40cdae0 con 0x7effd40a44a0 2023-12-22T08:40:22.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.544+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effc0003520 con 0x7effd40a44a0 2023-12-22T08:40:22.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.544+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1734182104 0 0) 0x7effc0003520 con 0x7effd40a44a0 2023-12-22T08:40:22.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.544+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 >> v2:172.21.15.89:3300/0 conn(0x7effd4071000 msgr2=0x7effd4165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:22.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.544+0000 7effd1d9b640 1 --2- 172.21.15.38:0/1035699883 >> v2:172.21.15.89:3300/0 conn(0x7effd4071000 0x7effd4165f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.544+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 >> v1:172.21.15.89:6789/0 conn(0x7effd415b420 legacy=0x7effd406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.544+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd40ce010 con 0x7effd40a44a0 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.544+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7effbc001670 con 0x7effd40a44a0 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.544+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 >> v1:172.21.15.38:6789/0 conn(0x7effd40a44a0 legacy=0x7effd40708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effd1d9b640 1 --2- 172.21.15.38:0/1035699883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc00039c0 0x7effc0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effd1d9b640 1 --2- 172.21.15.38:0/1035699883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effc00047c0 0x7effc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effd1d9b640 1 --2- 172.21.15.38:0/1035699883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effc0005180 0x7effc000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd40cdd30 con 0x7effc00047c0 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc000c080 con 0x7effc00039c0 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc000c240 con 0x7effc0005180 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effc9d9b640 1 --2- 172.21.15.38:0/1035699883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effc00047c0 0x7effc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effd259c640 1 --2- 172.21.15.38:0/1035699883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc00039c0 0x7effc0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effc9d9b640 1 -- 172.21.15.38:0/1035699883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effc0005180 msgr2=0x7effc000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:22.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effc9d9b640 1 --2- 172.21.15.38:0/1035699883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effc0005180 0x7effc000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effc9d9b640 1 -- 172.21.15.38:0/1035699883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc00039c0 msgr2=0x7effc0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:22.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effc9d9b640 1 --2- 172.21.15.38:0/1035699883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc00039c0 0x7effc0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effc9d9b640 1 -- 172.21.15.38:0/1035699883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc0003520 con 0x7effc00047c0 2023-12-22T08:40:22.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effd259c640 1 --2- 172.21.15.38:0/1035699883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effc00039c0 0x7effc0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:22.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.545+0000 7effd2d9d640 1 -- 172.21.15.38:0/1035699883 reap_dead start 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.546+0000 7effc9d9b640 1 --2- 172.21.15.38:0/1035699883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effc00047c0 0x7effc0004c40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7effd40b3170 tx=0x7effc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922c706efe63ae91 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.547+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc005ad0 con 0x7effc00047c0 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.547+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc005c30 con 0x7effc00047c0 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.547+0000 7effd1d9b640 1 -- 172.21.15.38:0/1035699883 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc0072b0 con 0x7effc00047c0 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.547+0000 7effd359e640 1 -- 172.21.15.38:0/1035699883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effc00047c0 msgr2=0x7effc0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.547+0000 7effd359e640 1 --2- 172.21.15.38:0/1035699883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effc00047c0 0x7effc0004c40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7effd40b3170 tx=0x7effc00057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.547+0000 7effd359e640 1 -- 172.21.15.38:0/1035699883 shutdown_connections 2023-12-22T08:40:22.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.547+0000 7effd359e640 1 --2- 172.21.15.38:0/1035699883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effc00047c0 0x7effc0004c40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.547+0000 7effd359e640 1 -- 172.21.15.38:0/1035699883 >> 172.21.15.38:0/1035699883 conn(0x7effd40b1f70 msgr2=0x7effd40b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:22.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.547+0000 7effd359e640 1 -- 172.21.15.38:0/1035699883 shutdown_connections 2023-12-22T08:40:22.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.547+0000 7effd359e640 1 -- 172.21.15.38:0/1035699883 wait complete. 2023-12-22T08:40:22.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.549+0000 7effd359e640 1 Processor -- start 2023-12-22T08:40:22.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.549+0000 7effd359e640 1 -- start start 2023-12-22T08:40:22.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.550+0000 7effd359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effc00047c0 0x7effd414d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.550+0000 7effd359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effd40ccca0 0x7effd409eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.550+0000 7effd359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effd40cd120 0x7effd409f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.550+0000 7effd359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd40cc880 con 0x7effd40cd120 2023-12-22T08:40:22.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.550+0000 7effd359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd40cbc00 con 0x7effd40ccca0 2023-12-22T08:40:22.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.550+0000 7effd359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd40cbee0 con 0x7effc00047c0 2023-12-22T08:40:22.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.551+0000 7effd2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effd40cd120 0x7effd409f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.551+0000 7effd2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effd40cd120 0x7effd409f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43194/0 (socket says 172.21.15.38:43194) 2023-12-22T08:40:22.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.551+0000 7effd2d9d640 1 -- 172.21.15.38:0/2176574768 learned_addr learned my addr 172.21.15.38:0/2176574768 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:22.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.551+0000 7effc9d9b640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effd40ccca0 0x7effd409eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.551+0000 7effd259c640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effc00047c0 0x7effd414d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.551+0000 7effd2d9d640 1 -- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effc00047c0 msgr2=0x7effd414d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.551+0000 7effd2d9d640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effc00047c0 0x7effd414d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.551+0000 7effd2d9d640 1 -- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effd40ccca0 msgr2=0x7effd409eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.551+0000 7effd2d9d640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effd40ccca0 0x7effd409eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.551+0000 7effd2d9d640 1 -- 172.21.15.38:0/2176574768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd40cc1c0 con 0x7effd40cd120 2023-12-22T08:40:22.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.552+0000 7effd2d9d640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effd40cd120 0x7effd409f410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7effd404e330 tx=0x7effcc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:22.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.552+0000 7effcb7fe640 1 -- 172.21.15.38:0/2176574768 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc010040 con 0x7effd40cd120 2023-12-22T08:40:22.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.552+0000 7effcb7fe640 1 -- 172.21.15.38:0/2176574768 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effcc00bc80 con 0x7effd40cd120 2023-12-22T08:40:22.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.552+0000 7effcb7fe640 1 -- 172.21.15.38:0/2176574768 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc014400 con 0x7effd40cd120 2023-12-22T08:40:22.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.552+0000 7effd359e640 1 -- 172.21.15.38:0/2176574768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd40cc4a0 con 0x7effd40cd120 2023-12-22T08:40:22.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.552+0000 7effd359e640 1 -- 172.21.15.38:0/2176574768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd40cb8d0 con 0x7effd40cd120 2023-12-22T08:40:22.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.553+0000 7effd359e640 1 -- 172.21.15.38:0/2176574768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd40cc9c0 con 0x7effd40cd120 2023-12-22T08:40:22.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.554+0000 7effcb7fe640 1 -- 172.21.15.38:0/2176574768 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7effcc014560 con 0x7effd40cd120 2023-12-22T08:40:22.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.555+0000 7effcb7fe640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7effb406a430 0x7effb406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.555+0000 7effcb7fe640 1 -- 172.21.15.38:0/2176574768 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effcc089100 con 0x7effd40cd120 2023-12-22T08:40:22.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.556+0000 7effd259c640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7effb406a430 0x7effb406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.557+0000 7effd259c640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7effb406a430 0x7effb406c8f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7effd415d3b0 tx=0x7effc4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:22.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.560+0000 7effcb7fe640 1 -- 172.21.15.38:0/2176574768 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7effd40cc9c0 con 0x7effd40cd120 2023-12-22T08:40:22.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.796+0000 7effd359e640 1 -- 172.21.15.38:0/2176574768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7effd40cc9c0 con 0x7effd40cd120 2023-12-22T08:40:22.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.797+0000 7effcb7fe640 1 -- 172.21.15.38:0/2176574768 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7effd40cc9c0 con 0x7effd40cd120 2023-12-22T08:40:22.800 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:40:22.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.800+0000 7effd359e640 1 -- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7effb406a430 msgr2=0x7effb406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.800+0000 7effd359e640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7effb406a430 0x7effb406c8f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7effd415d3b0 tx=0x7effc4009040 comp rx=0 tx=0).stop 2023-12-22T08:40:22.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.800+0000 7effd359e640 1 -- 172.21.15.38:0/2176574768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effd40cd120 msgr2=0x7effd409f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.800+0000 7effd359e640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effd40cd120 0x7effd409f410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7effd404e330 tx=0x7effcc00b480 comp rx=0 tx=0).stop 2023-12-22T08:40:22.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.800+0000 7effd359e640 1 -- 172.21.15.38:0/2176574768 shutdown_connections 2023-12-22T08:40:22.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.800+0000 7effd359e640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7effb406a430 0x7effb406c8f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.800+0000 7effd359e640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effd40cd120 0x7effd409f410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.800+0000 7effd359e640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7effd40ccca0 0x7effd409eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.800+0000 7effd359e640 1 --2- 172.21.15.38:0/2176574768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7effc00047c0 0x7effd414d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.800+0000 7effd359e640 1 -- 172.21.15.38:0/2176574768 >> 172.21.15.38:0/2176574768 conn(0x7effd40b1f70 msgr2=0x7effd415c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:22.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.800+0000 7effd359e640 1 -- 172.21.15.38:0/2176574768 shutdown_connections 2023-12-22T08:40:22.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:22.800+0000 7effd359e640 1 -- 172.21.15.38:0/2176574768 wait complete. 2023-12-22T08:40:22.824 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-22T08:40:22.824 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:40:22.824 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-12-22T08:40:22.824 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T08:40:22.824 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:40:22.824 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-22T08:40:22.824 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-22T08:40:22.824 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:40:22.824 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:40:22.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:22.825 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-12-22T08:40:22.879 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:40:22.880 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:40:22.880 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:40:22.880 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:22.880 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:40:22.880 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:22.880 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:22.880 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:22.880 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-12-22T08:40:22.880 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:22.880 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:22.880 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-12-22T08:40:22.880 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:40:22.880 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:22.881 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-12-22T08:40:22.881 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-22T08:40:22.881 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42343sec preferred_lft 42343sec 2023-12-22T08:40:22.881 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-22T08:40:22.881 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:22.881 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:22.881 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:22.881 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-12-22T08:40:22.882 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-22T08:40:22.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:22.882 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:40:22.882 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:40:22.882 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add name ceph-brx type bridge 2023-12-22T08:40:22.883 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr flush dev ceph-brx 2023-12-22T08:40:22.883 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set ceph-brx up 2023-12-22T08:40:22.883 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-22T08:40:22.883 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:40:23.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:23.367 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:40:23.453 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-12-22T08:40:23.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:23.456 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-12-22T08:40:23.512 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-12-22T08:40:23.512 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:40:23.512 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-22T08:40:23.512 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-22T08:40:23.513 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:40:23.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:23.513 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:40:23.513 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:40:23.513 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T08:40:23.513 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T08:40:23.513 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T08:40:23.513 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:40:24.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:24.291 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:40:24.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:24.352 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list-id 2023-12-22T08:40:24.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:24.410 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:40:24.410 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:40:24.410 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:40:24.410 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-22T08:40:24.410 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:40:24.564 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-22T08:40:24.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:24.564 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:40:24.565 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:40:24.565 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-22T08:40:24.565 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-22T08:40:24.565 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-22T08:40:24.565 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-22T08:40:24.565 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-22T08:40:24.565 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:40:24.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:24.853 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:40:24.854 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:40:24.854 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-12-22T08:40:24.854 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set dev brx.0 master ceph-brx 2023-12-22T08:40:24.854 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:40:25.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:40:25.020 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T08:40:25.075 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:40:25.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:40:25.075 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:40:25.129 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-22T08:40:25.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:25.129 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:40:25.287 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:40:25.287 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:40:25.781 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:40:25.781 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:40:25.781 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:40:25.781 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with new device syntax: 0@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:40:25.782 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:40:25.783 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T08:40:25.783 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:40:25.783 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:40:25.783 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:40:25.783 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:40:25.787 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:40:25.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:25.787 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:40:25.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:25.887 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:40:25.970 INFO:teuthology.orchestra.run.smithi038.stdout:client4496 2023-12-22T08:40:25.970 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:40:25.970 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:26.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:26.030 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:40:26.112 INFO:teuthology.orchestra.run.smithi038.stdout:client4496 2023-12-22T08:40:26.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:26.112 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:40:26.195 INFO:teuthology.orchestra.run.smithi038.stdout:client4496 2023-12-22T08:40:26.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:26.196 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/893856d7-5d01-4896-9127-f971dbad2b97.client4496/status') 2023-12-22T08:40:26.308 INFO:teuthology.orchestra.run.smithi038.stdout:instance: client.4496 (3)172.21.15.38:0/2518261953 2023-12-22T08:40:26.308 INFO:teuthology.orchestra.run.smithi038.stdout:blocklisted: false 2023-12-22T08:40:26.309 INFO:teuthology.orchestra.run.smithi038.stderr:0+1 records in 2023-12-22T08:40:26.309 INFO:teuthology.orchestra.run.smithi038.stderr:0+1 records out 2023-12-22T08:40:26.309 INFO:teuthology.orchestra.run.smithi038.stderr:70 bytes copied, 8.8081e-05 s, 795 kB/s 2023-12-22T08:40:26.312 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-12-22T08:40:26.312 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-22T08:40:26.312 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-22T08:40:26.313 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:40:26.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.535+0000 7fdc60d37640 1 Processor -- start 2023-12-22T08:40:26.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.535+0000 7fdc60d37640 1 -- start start 2023-12-22T08:40:26.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.537+0000 7fdc60d37640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdc5c06d210 0x7fdc5c15e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:26.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.537+0000 7fdc60d37640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5c0cb4c0 0x7fdc5c159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:26.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.537+0000 7fdc60d37640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc5c06d5f0 0x7fdc5c15a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:26.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.537+0000 7fdc60d37640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5c0706d0 con 0x7fdc5c06d210 2023-12-22T08:40:26.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.537+0000 7fdc60d37640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5c0cbf40 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.537+0000 7fdc60d37640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c15a760 con 0x7fdc5c0cb4c0 2023-12-22T08:40:26.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.538+0000 7fdc5b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdc5c06d210 0x7fdc5c15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:26.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.538+0000 7fdc5b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdc5c06d210 0x7fdc5c15e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43202/0 (socket says 172.21.15.38:43202) 2023-12-22T08:40:26.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.538+0000 7fdc5b7fe640 1 -- 172.21.15.38:0/86252652 learned_addr learned my addr 172.21.15.38:0/86252652 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:26.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.538+0000 7fdc5bfff640 1 --2- 172.21.15.38:0/86252652 >> v2:172.21.15.89:3300/0 conn(0x7fdc5c06d5f0 0x7fdc5c15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:26.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.538+0000 7fdc53fff640 1 --2- 172.21.15.38:0/86252652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5c0cb4c0 0x7fdc5c159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:26.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.538+0000 7fdc5b7fe640 1 -- 172.21.15.38:0/86252652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5c0cb4c0 msgr2=0x7fdc5c159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:26.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.538+0000 7fdc5b7fe640 1 --2- 172.21.15.38:0/86252652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5c0cb4c0 0x7fdc5c159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:26.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.538+0000 7fdc5b7fe640 1 -- 172.21.15.38:0/86252652 >> v2:172.21.15.89:3300/0 conn(0x7fdc5c06d5f0 msgr2=0x7fdc5c15a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:26.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.538+0000 7fdc5b7fe640 1 --2- 172.21.15.38:0/86252652 >> v2:172.21.15.89:3300/0 conn(0x7fdc5c06d5f0 0x7fdc5c15a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:26.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.538+0000 7fdc5b7fe640 1 -- 172.21.15.38:0/86252652 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c0ce840 con 0x7fdc5c06d210 2023-12-22T08:40:26.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.539+0000 7fdc5b7fe640 1 --2- 172.21.15.38:0/86252652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc5c06d210 0x7fdc5c15e830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c15dd80 tx=0x7fdc4c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b628a9137669b6e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:26.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.539+0000 7fdc5affd640 1 -- 172.21.15.38:0/86252652 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c031860 con 0x7fdc5c06d210 2023-12-22T08:40:26.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.540+0000 7fdc5affd640 1 -- 172.21.15.38:0/86252652 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c0319c0 con 0x7fdc5c06d210 2023-12-22T08:40:26.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.540+0000 7fdc5affd640 1 -- 172.21.15.38:0/86252652 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c031d50 con 0x7fdc5c06d210 2023-12-22T08:40:26.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.540+0000 7fdc60d37640 1 -- 172.21.15.38:0/86252652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc5c06d210 msgr2=0x7fdc5c15e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:26.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.540+0000 7fdc60d37640 1 --2- 172.21.15.38:0/86252652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc5c06d210 0x7fdc5c15e830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c15dd80 tx=0x7fdc4c02b900 comp rx=0 tx=0).stop 2023-12-22T08:40:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.540+0000 7fdc60d37640 1 -- 172.21.15.38:0/86252652 shutdown_connections 2023-12-22T08:40:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.540+0000 7fdc60d37640 1 --2- 172.21.15.38:0/86252652 >> v2:172.21.15.89:3300/0 conn(0x7fdc5c06d5f0 0x7fdc5c15a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.540+0000 7fdc60d37640 1 --2- 172.21.15.38:0/86252652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5c0cb4c0 0x7fdc5c159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.540+0000 7fdc60d37640 1 --2- 172.21.15.38:0/86252652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc5c06d210 0x7fdc5c15e830 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.540+0000 7fdc60d37640 1 -- 172.21.15.38:0/86252652 >> 172.21.15.38:0/86252652 conn(0x7fdc5c0b1f70 msgr2=0x7fdc5c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.540+0000 7fdc60d37640 1 -- 172.21.15.38:0/86252652 shutdown_connections 2023-12-22T08:40:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.540+0000 7fdc60d37640 1 -- 172.21.15.38:0/86252652 wait complete. 2023-12-22T08:40:26.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.543+0000 7fdc60d37640 1 Processor -- start 2023-12-22T08:40:26.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.543+0000 7fdc60d37640 1 -- start start 2023-12-22T08:40:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.544+0000 7fdc60d37640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5c06d210 0x7fdc5c158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.544+0000 7fdc60d37640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc5c06d5f0 0x7fdc5c09d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.544+0000 7fdc60d37640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5c0cb4c0 0x7fdc5c09a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.544+0000 7fdc60d37640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c09a5f0 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.544+0000 7fdc60d37640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c158a50 con 0x7fdc5c06d210 2023-12-22T08:40:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.544+0000 7fdc60d37640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c0b0510 con 0x7fdc5c0cb4c0 2023-12-22T08:40:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.545+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc5c06d5f0 0x7fdc5c09d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.545+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc5c06d5f0 0x7fdc5c09d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43210/0 (socket says 172.21.15.38:43210) 2023-12-22T08:40:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.545+0000 7fdc53fff640 1 -- 172.21.15.38:0/3860833815 learned_addr learned my addr 172.21.15.38:0/3860833815 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.545+0000 7fdc5b7fe640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5c06d210 0x7fdc5c158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.545+0000 7fdc5bfff640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5c0cb4c0 0x7fdc5c09a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.545+0000 7fdc53fff640 1 -- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5c0cb4c0 msgr2=0x7fdc5c09a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.545+0000 7fdc53fff640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5c0cb4c0 0x7fdc5c09a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.545+0000 7fdc53fff640 1 -- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5c06d210 msgr2=0x7fdc5c158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.545+0000 7fdc53fff640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5c06d210 0x7fdc5c158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.545+0000 7fdc53fff640 1 -- 172.21.15.38:0/3860833815 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c0094d0 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.546+0000 7fdc53fff640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc5c06d5f0 0x7fdc5c09d500 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400d5f0 tx=0x7fdc4400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.546+0000 7fdc58ff9640 1 -- 172.21.15.38:0/3860833815 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc440125f0 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.546+0000 7fdc58ff9640 1 -- 172.21.15.38:0/3860833815 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc44012750 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.546+0000 7fdc58ff9640 1 -- 172.21.15.38:0/3860833815 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44012b00 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.546+0000 7fdc60d37640 1 -- 172.21.15.38:0/3860833815 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5c099a70 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.546+0000 7fdc60d37640 1 -- 172.21.15.38:0/3860833815 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5c09a030 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.547+0000 7fdc60d37640 1 -- 172.21.15.38:0/3860833815 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc5c061910 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.548+0000 7fdc58ff9640 1 -- 172.21.15.38:0/3860833815 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc44012c60 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.549+0000 7fdc58ff9640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc3c06a430 0x7fdc3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:26.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.549+0000 7fdc58ff9640 1 -- 172.21.15.38:0/3860833815 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc44088d90 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.550+0000 7fdc5b7fe640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc3c06a430 0x7fdc3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:26.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.551+0000 7fdc5b7fe640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc3c06a430 0x7fdc3c06c8f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c036000 tx=0x7fdc4c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:26.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.554+0000 7fdc58ff9640 1 -- 172.21.15.38:0/3860833815 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdc44054370 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.786+0000 7fdc60d37640 1 -- 172.21.15.38:0/3860833815 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdc5c0b2e10 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.787+0000 7fdc58ff9640 1 -- 172.21.15.38:0/3860833815 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdc44057990 con 0x7fdc5c06d5f0 2023-12-22T08:40:26.789 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:40:26.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.789+0000 7fdc60d37640 1 -- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc3c06a430 msgr2=0x7fdc3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:26.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.789+0000 7fdc60d37640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc3c06a430 0x7fdc3c06c8f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c036000 tx=0x7fdc4c03c040 comp rx=0 tx=0).stop 2023-12-22T08:40:26.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.789+0000 7fdc60d37640 1 -- 172.21.15.38:0/3860833815 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc5c06d5f0 msgr2=0x7fdc5c09d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:26.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.789+0000 7fdc60d37640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc5c06d5f0 0x7fdc5c09d500 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400d5f0 tx=0x7fdc4400dab0 comp rx=0 tx=0).stop 2023-12-22T08:40:26.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.789+0000 7fdc60d37640 1 -- 172.21.15.38:0/3860833815 shutdown_connections 2023-12-22T08:40:26.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.789+0000 7fdc60d37640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5c0cb4c0 0x7fdc5c09a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:26.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.789+0000 7fdc60d37640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc3c06a430 0x7fdc3c06c8f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:26.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.789+0000 7fdc60d37640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc5c06d5f0 0x7fdc5c09d500 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:26.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.789+0000 7fdc60d37640 1 --2- 172.21.15.38:0/3860833815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5c06d210 0x7fdc5c158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:26.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.789+0000 7fdc60d37640 1 -- 172.21.15.38:0/3860833815 >> 172.21.15.38:0/3860833815 conn(0x7fdc5c0b1f70 msgr2=0x7fdc5c159f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:26.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.790+0000 7fdc60d37640 1 -- 172.21.15.38:0/3860833815 shutdown_connections 2023-12-22T08:40:26.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:26.790+0000 7fdc60d37640 1 -- 172.21.15.38:0/3860833815 wait complete. 2023-12-22T08:40:26.812 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-22T08:40:26.812 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:40:26.812 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-12-22T08:40:26.813 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-22T08:40:26.813 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-22T08:40:26.813 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-22T08:40:26.813 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-22T08:40:26.813 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:40:26.813 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-22T08:40:26.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:26.813 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-12-22T08:40:26.867 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:40:26.867 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:40:26.867 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:40:26.867 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:26.867 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:40:26.867 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:26.867 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:26.868 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:26.868 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-12-22T08:40:26.868 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:26.868 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:26.868 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-12-22T08:40:26.868 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:40:26.868 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:26.868 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-12-22T08:40:26.868 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-22T08:40:26.868 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42339sec preferred_lft 42339sec 2023-12-22T08:40:26.868 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-22T08:40:26.868 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:26.869 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:26.869 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:26.869 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-12-22T08:40:26.869 INFO:teuthology.orchestra.run.smithi038.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:40:26.869 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:c3:65:6c:32:2e brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:26.869 INFO:teuthology.orchestra.run.smithi038.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:40:26.869 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:26.869 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::5440:f6ff:fe40:85a/64 scope link 2023-12-22T08:40:26.869 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:26.869 INFO:teuthology.orchestra.run.smithi038.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:40:26.869 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:c3:65:6c:32:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:40:26.869 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::e4c3:65ff:fe6c:322e/64 scope link 2023-12-22T08:40:26.870 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:26.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:26.870 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:40:26.961 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-12-22T08:40:26.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:26.966 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-12-22T08:40:27.023 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-12-22T08:40:27.024 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:40:27.024 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-22T08:40:27.024 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-22T08:40:27.024 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:40:27.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:27.024 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:40:27.024 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:40:27.024 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T08:40:27.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T08:40:27.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T08:40:27.025 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:40:27.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:27.218 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:40:27.275 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:40:27.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:27.275 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list-id 2023-12-22T08:40:27.328 INFO:teuthology.orchestra.run.smithi038.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-22T08:40:27.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:27.329 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:40:27.329 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:40:27.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T08:40:27.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-22T08:40:27.329 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:40:27.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:27.489 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-22T08:40:27.588 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:40:27.588 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:40:27.588 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:40:27.588 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:27.588 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:40:27.588 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:27.588 INFO:teuthology.orchestra.run.smithi038.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:40:27.588 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:04:86:65:f2:c1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-22T08:40:27.588 INFO:teuthology.orchestra.run.smithi038.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-22T08:40:27.588 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:27.589 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::e404:86ff:fe65:f2c1/64 scope link 2023-12-22T08:40:27.589 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:27.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:27.592 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-22T08:40:27.697 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:40:27.697 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:40:27.697 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:40:27.697 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:27.697 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:40:27.697 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:27.697 INFO:teuthology.orchestra.run.smithi038.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:40:27.697 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:04:86:65:f2:c1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-22T08:40:27.697 INFO:teuthology.orchestra.run.smithi038.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-22T08:40:27.697 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:27.698 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::e404:86ff:fe65:f2c1/64 scope link 2023-12-22T08:40:27.698 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:27.702 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-22T08:40:27.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:27.702 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:40:27.702 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:40:27.702 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-22T08:40:27.703 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-22T08:40:27.703 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-22T08:40:27.703 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-22T08:40:27.703 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-22T08:40:27.703 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:40:28.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:28.006 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:40:28.006 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:40:28.006 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.1 up 2023-12-22T08:40:28.007 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set dev brx.1 master ceph-brx 2023-12-22T08:40:28.007 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:40:28.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:40:28.196 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-22T08:40:28.245 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-22T08:40:28.245 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:40:28.245 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-22T08:40:28.295 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-12-22T08:40:28.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:28.295 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:40:28.437 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:40:28.437 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:40:28.470 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:40:28.471 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:40:28.471 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:40:28.471 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with new device syntax: 2@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:40:28.471 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:40:28.472 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2023-12-22T08:40:28.472 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:40:28.472 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:40:28.473 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:40:28.473 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:40:28.476 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:40:28.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:28.476 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-22T08:40:28.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:28.565 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:40:28.626 INFO:teuthology.orchestra.run.smithi038.stdout:client4505 2023-12-22T08:40:28.626 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:40:28.626 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:28.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:28.681 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:40:28.741 INFO:teuthology.orchestra.run.smithi038.stdout:client4505 2023-12-22T08:40:28.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:28.742 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:40:28.806 INFO:teuthology.orchestra.run.smithi038.stdout:client4505 2023-12-22T08:40:28.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:28.806 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/893856d7-5d01-4896-9127-f971dbad2b97.client4505/status') 2023-12-22T08:40:28.914 INFO:teuthology.orchestra.run.smithi038.stdout:instance: client.4505 (3)172.21.15.38:0/3822338962 2023-12-22T08:40:28.914 INFO:teuthology.orchestra.run.smithi038.stdout:blocklisted: false 2023-12-22T08:40:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:0+1 records in 2023-12-22T08:40:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:0+1 records out 2023-12-22T08:40:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:70 bytes copied, 9.8581e-05 s, 710 kB/s 2023-12-22T08:40:28.918 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-12-22T08:40:28.918 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-22T08:40:28.918 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T08:40:28.919 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:40:29.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.138+0000 7f19a4dae640 1 Processor -- start 2023-12-22T08:40:29.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.138+0000 7f19a4dae640 1 -- start start 2023-12-22T08:40:29.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.140+0000 7f19a4dae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19a01547a0 0x7f19a015b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:29.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.140+0000 7f19a4dae640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f19a0071b90 0x7f19a0070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:29.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.140+0000 7f19a4dae640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a00716a0 con 0x7f19a0154b80 2023-12-22T08:40:29.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.140+0000 7f19a4dae640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a00710e0 con 0x7f19a0071b90 2023-12-22T08:40:29.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.140+0000 7f19a4dae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00713c0 con 0x7f19a01547a0 2023-12-22T08:40:29.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.140+0000 7f199ed9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f19a0154b80 0x7f19a00ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39600/0 (socket says 172.21.15.38:39600) 2023-12-22T08:40:29.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.140+0000 7f199ed9d640 1 -- 172.21.15.38:0/3144702913 learned_addr learned my addr 172.21.15.38:0/3144702913 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:29.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.141+0000 7f199e59c640 1 --2- 172.21.15.38:0/3144702913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19a01547a0 0x7f19a015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:29.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.141+0000 7f199dd9b640 1 --2- 172.21.15.38:0/3144702913 >> v2:172.21.15.89:3300/0 conn(0x7f19a0071b90 0x7f19a0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:29.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.141+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714070299 0 0) 0x7f19a00716a0 con 0x7f19a0154b80 2023-12-22T08:40:29.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.141+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1988005730 con 0x7f19a0154b80 2023-12-22T08:40:29.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.141+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 850781645 0 0) 0x7f1988005730 con 0x7f19a0154b80 2023-12-22T08:40:29.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.141+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19a01547a0 msgr2=0x7f19a015b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:29.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.141+0000 7f199d59a640 1 --2- 172.21.15.38:0/3144702913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19a01547a0 0x7f19a015b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:29.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.141+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 >> v2:172.21.15.89:3300/0 conn(0x7f19a0071b90 msgr2=0x7f19a0070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:29.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.141+0000 7f199d59a640 1 --2- 172.21.15.38:0/3144702913 >> v2:172.21.15.89:3300/0 conn(0x7f19a0071b90 0x7f19a0070770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:29.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.141+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a015ab00 con 0x7f19a0154b80 2023-12-22T08:40:29.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.141+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f19980019f0 con 0x7f19a0154b80 2023-12-22T08:40:29.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.142+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 >> v1:172.21.15.38:6789/0 conn(0x7f19a0154b80 legacy=0x7f19a00ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:29.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.142+0000 7f199d59a640 1 --2- 172.21.15.38:0/3144702913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1988005b80 0x7f1988005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:29.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.142+0000 7f199d59a640 1 --2- 172.21.15.38:0/3144702913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19880069d0 0x7f1988006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:29.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.142+0000 7f199d59a640 1 --2- 172.21.15.38:0/3144702913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19a01547a0 0x7f1988007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:29.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.142+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00710e0 con 0x7f1988005b80 2023-12-22T08:40:29.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.142+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00713c0 con 0x7f19880069d0 2023-12-22T08:40:29.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.142+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198800db90 con 0x7f19a01547a0 2023-12-22T08:40:29.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.142+0000 7f199e59c640 1 --2- 172.21.15.38:0/3144702913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1988005b80 0x7f1988005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:29.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.142+0000 7f199e59c640 1 -- 172.21.15.38:0/3144702913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19a01547a0 msgr2=0x7f1988007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:29.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.142+0000 7f199e59c640 1 --2- 172.21.15.38:0/3144702913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19a01547a0 0x7f1988007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.142+0000 7f199e59c640 1 -- 172.21.15.38:0/3144702913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19880069d0 msgr2=0x7f1988006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.142+0000 7f199e59c640 1 --2- 172.21.15.38:0/3144702913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f19880069d0 0x7f1988006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.142+0000 7f199e59c640 1 -- 172.21.15.38:0/3144702913 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1988005730 con 0x7f1988005b80 2023-12-22T08:40:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.143+0000 7f199e59c640 1 --2- 172.21.15.38:0/3144702913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1988005b80 0x7f1988005fa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1990009ac0 tx=0x7f1988007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8562572be2f9b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.144+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199002c6d0 con 0x7f1988005b80 2023-12-22T08:40:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.144+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199002c830 con 0x7f1988005b80 2023-12-22T08:40:29.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.144+0000 7f199d59a640 1 -- 172.21.15.38:0/3144702913 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199002cbc0 con 0x7f1988005b80 2023-12-22T08:40:29.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.144+0000 7f19a4dae640 1 -- 172.21.15.38:0/3144702913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1988005b80 msgr2=0x7f1988005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:29.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.144+0000 7f19a4dae640 1 --2- 172.21.15.38:0/3144702913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1988005b80 0x7f1988005fa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1990009ac0 tx=0x7f1988007a00 comp rx=0 tx=0).stop 2023-12-22T08:40:29.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.144+0000 7f199ed9d640 1 -- 172.21.15.38:0/3144702913 reap_dead start 2023-12-22T08:40:29.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.144+0000 7f19a4dae640 1 -- 172.21.15.38:0/3144702913 shutdown_connections 2023-12-22T08:40:29.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.144+0000 7f19a4dae640 1 -- 172.21.15.38:0/3144702913 >> 172.21.15.38:0/3144702913 conn(0x7f19a00cf070 msgr2=0x7f19a00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:29.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.145+0000 7f19a4dae640 1 -- 172.21.15.38:0/3144702913 shutdown_connections 2023-12-22T08:40:29.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.145+0000 7f19a4dae640 1 -- 172.21.15.38:0/3144702913 wait complete. 2023-12-22T08:40:29.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.146+0000 7f19a4dae640 1 Processor -- start 2023-12-22T08:40:29.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.147+0000 7f19a4dae640 1 -- start start 2023-12-22T08:40:29.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.147+0000 7f19a4dae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1988005b80 0x7f19a014de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:29.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.147+0000 7f19a4dae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19a00c3fd0 0x7f19a00cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:29.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.147+0000 7f19a4dae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19a00cd6c0 0x7f19a00c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:29.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.147+0000 7f19a4dae640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00cdb70 con 0x7f19a00c3fd0 2023-12-22T08:40:29.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.147+0000 7f19a4dae640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a01f27b0 con 0x7f1988005b80 2023-12-22T08:40:29.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.147+0000 7f19a4dae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a014e350 con 0x7f19a00cd6c0 2023-12-22T08:40:29.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.148+0000 7f199dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19a00c3fd0 0x7f19a00cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:29.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.148+0000 7f199dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19a00c3fd0 0x7f19a00cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43232/0 (socket says 172.21.15.38:43232) 2023-12-22T08:40:29.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.148+0000 7f199dd9b640 1 -- 172.21.15.38:0/1637678021 learned_addr learned my addr 172.21.15.38:0/1637678021 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:29.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.148+0000 7f199ed9d640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19a00cd6c0 0x7f19a00c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:29.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.148+0000 7f199e59c640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1988005b80 0x7f19a014de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:29.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.148+0000 7f199dd9b640 1 -- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19a00cd6c0 msgr2=0x7f19a00c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:29.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.148+0000 7f199dd9b640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19a00cd6c0 0x7f19a00c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:29.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.148+0000 7f199dd9b640 1 -- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1988005b80 msgr2=0x7f19a014de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:29.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.148+0000 7f199dd9b640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1988005b80 0x7f19a014de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:29.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.148+0000 7f199dd9b640 1 -- 172.21.15.38:0/1637678021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a01f29c0 con 0x7f19a00c3fd0 2023-12-22T08:40:29.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.149+0000 7f199dd9b640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19a00c3fd0 0x7f19a00cd180 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f199400e860 tx=0x7f199400ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:29.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.149+0000 7f198effd640 1 -- 172.21.15.38:0/1637678021 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994009600 con 0x7f19a00c3fd0 2023-12-22T08:40:29.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.149+0000 7f198effd640 1 -- 172.21.15.38:0/1637678021 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199400c940 con 0x7f19a00c3fd0 2023-12-22T08:40:29.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.149+0000 7f19a4dae640 1 -- 172.21.15.38:0/1637678021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a01f2c60 con 0x7f19a00c3fd0 2023-12-22T08:40:29.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.149+0000 7f198effd640 1 -- 172.21.15.38:0/1637678021 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199400ccd0 con 0x7f19a00c3fd0 2023-12-22T08:40:29.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.149+0000 7f19a4dae640 1 -- 172.21.15.38:0/1637678021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a01f3220 con 0x7f19a00c3fd0 2023-12-22T08:40:29.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.150+0000 7f19a4dae640 1 -- 172.21.15.38:0/1637678021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a0061910 con 0x7f19a00c3fd0 2023-12-22T08:40:29.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.151+0000 7f198effd640 1 -- 172.21.15.38:0/1637678021 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1994013470 con 0x7f19a00c3fd0 2023-12-22T08:40:29.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.152+0000 7f198effd640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f198006a460 0x7f198006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:29.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.152+0000 7f198effd640 1 -- 172.21.15.38:0/1637678021 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1994088ae0 con 0x7f19a00c3fd0 2023-12-22T08:40:29.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.153+0000 7f199e59c640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f198006a460 0x7f198006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:29.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.154+0000 7f199e59c640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f198006a460 0x7f198006c920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1990036000 tx=0x7f1990030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:29.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.157+0000 7f198effd640 1 -- 172.21.15.38:0/1637678021 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1994054030 con 0x7f19a00c3fd0 2023-12-22T08:40:29.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.393+0000 7f19a4dae640 1 -- 172.21.15.38:0/1637678021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f19a00cb950 con 0x7f19a00c3fd0 2023-12-22T08:40:29.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.393+0000 7f198effd640 1 -- 172.21.15.38:0/1637678021 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1994017070 con 0x7f19a00c3fd0 2023-12-22T08:40:29.396 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:40:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.396+0000 7f19a4dae640 1 -- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f198006a460 msgr2=0x7f198006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.396+0000 7f19a4dae640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f198006a460 0x7f198006c920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1990036000 tx=0x7f1990030000 comp rx=0 tx=0).stop 2023-12-22T08:40:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.396+0000 7f19a4dae640 1 -- 172.21.15.38:0/1637678021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19a00c3fd0 msgr2=0x7f19a00cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.396+0000 7f19a4dae640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19a00c3fd0 0x7f19a00cd180 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f199400e860 tx=0x7f199400ed20 comp rx=0 tx=0).stop 2023-12-22T08:40:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.396+0000 7f19a4dae640 1 -- 172.21.15.38:0/1637678021 shutdown_connections 2023-12-22T08:40:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.396+0000 7f19a4dae640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19a00cd6c0 0x7f19a00c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.396+0000 7f19a4dae640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f198006a460 0x7f198006c920 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.396+0000 7f19a4dae640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19a00c3fd0 0x7f19a00cd180 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.396+0000 7f19a4dae640 1 --2- 172.21.15.38:0/1637678021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1988005b80 0x7f19a014de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:29.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.396+0000 7f19a4dae640 1 -- 172.21.15.38:0/1637678021 >> 172.21.15.38:0/1637678021 conn(0x7f19a00cf070 msgr2=0x7f19a015d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:29.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.396+0000 7f19a4dae640 1 -- 172.21.15.38:0/1637678021 shutdown_connections 2023-12-22T08:40:29.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:29.396+0000 7f19a4dae640 1 -- 172.21.15.38:0/1637678021 wait complete. 2023-12-22T08:40:29.416 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-22T08:40:29.417 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:40:29.417 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-22T08:40:29.417 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T08:40:29.417 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T08:40:29.417 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-22T08:40:29.417 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-22T08:40:29.417 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:40:29.417 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:40:29.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:29.417 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-22T08:40:29.478 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:40:29.479 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:40:29.479 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:40:29.479 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:29.479 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:40:29.479 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:29.479 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:29.479 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:29.479 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-22T08:40:29.479 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:29.479 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:29.479 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-22T08:40:29.479 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:29.480 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:29.480 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:40:29.480 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:29.480 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:40:29.480 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42332sec preferred_lft 42332sec 2023-12-22T08:40:29.480 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-22T08:40:29.480 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:29.480 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-22T08:40:29.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:29.480 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:40:29.481 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:40:29.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add name ceph-brx type bridge 2023-12-22T08:40:29.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr flush dev ceph-brx 2023-12-22T08:40:29.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set ceph-brx up 2023-12-22T08:40:29.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-22T08:40:29.481 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:40:29.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:29.939 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:40:30.021 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-22T08:40:30.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:30.025 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-22T08:40:30.089 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-22T08:40:30.089 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:40:30.089 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:40:30.089 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:40:30.089 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:40:30.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:30.090 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:40:30.090 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:40:30.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:40:30.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:40:30.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:40:30.090 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:40:30.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:30.858 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:40:30.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:30.915 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2023-12-22T08:40:30.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:30.965 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:40:30.965 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:40:30.965 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T08:40:30.965 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-22T08:40:30.965 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:40:31.106 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-22T08:40:31.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:31.106 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:40:31.106 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:40:31.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-22T08:40:31.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-22T08:40:31.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-22T08:40:31.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-22T08:40:31.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-22T08:40:31.107 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:40:31.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:31.401 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:40:31.401 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:40:31.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-22T08:40:31.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.0 master ceph-brx 2023-12-22T08:40:31.401 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:40:31.568 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:40:31.568 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T08:40:31.618 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:40:31.618 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:40:31.618 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:40:31.667 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-22T08:40:31.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:31.667 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:40:31.803 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:40:31.803 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:40:32.248 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:40:32.248 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:40:32.248 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:40:32.248 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 1@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:40:32.249 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:40:32.251 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T08:40:32.251 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:40:32.251 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:40:32.251 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:40:32.251 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:40:32.255 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:40:32.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:32.255 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:40:32.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:32.340 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:40:32.395 INFO:teuthology.orchestra.run.smithi089.stdout:client4668 2023-12-22T08:40:32.395 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:40:32.395 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:32.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:32.444 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:40:32.548 INFO:teuthology.orchestra.run.smithi089.stdout:client4668 2023-12-22T08:40:32.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:32.549 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:40:32.609 INFO:teuthology.orchestra.run.smithi089.stdout:client4668 2023-12-22T08:40:32.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:32.610 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/893856d7-5d01-4896-9127-f971dbad2b97.client4668/status') 2023-12-22T08:40:32.703 INFO:teuthology.orchestra.run.smithi089.stdout:instance: client.4668 (3)172.21.15.89:0/1250390155 2023-12-22T08:40:32.704 INFO:teuthology.orchestra.run.smithi089.stdout:blocklisted: false 2023-12-22T08:40:32.704 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records in 2023-12-22T08:40:32.704 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records out 2023-12-22T08:40:32.704 INFO:teuthology.orchestra.run.smithi089.stderr:70 bytes copied, 7.304e-05 s, 958 kB/s 2023-12-22T08:40:32.707 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-12-22T08:40:32.708 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-22T08:40:32.708 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-22T08:40:32.708 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:40:32.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.933+0000 7f1123fff640 1 Processor -- start 2023-12-22T08:40:32.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.933+0000 7f1123fff640 1 -- start start 2023-12-22T08:40:32.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.935+0000 7f1123fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f112406d5f0 0x7f112415e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.935+0000 7f1123fff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11240706d0 con 0x7f11240cb4c0 2023-12-22T08:40:32.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.935+0000 7f1123fff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11240cbf40 con 0x7f112406d210 2023-12-22T08:40:32.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.935+0000 7f1123fff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11240ce840 con 0x7f112406d5f0 2023-12-22T08:40:32.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.936+0000 7f111a7fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f11240cb4c0 0x7f1124070b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44806/0 (socket says 172.21.15.38:44806) 2023-12-22T08:40:32.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.936+0000 7f111a7fc640 1 -- 172.21.15.38:0/1260589235 learned_addr learned my addr 172.21.15.38:0/1260589235 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:32.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.936+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742968651 0 0) 0x7f11240706d0 con 0x7f11240cb4c0 2023-12-22T08:40:32.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.936+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1104003520 con 0x7f11240cb4c0 2023-12-22T08:40:32.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.936+0000 7f11237fe640 1 --2- 172.21.15.38:0/1260589235 >> v2:172.21.15.89:3300/0 conn(0x7f112406d5f0 0x7f112415e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 505162909 0 0) 0x7f1104003520 con 0x7f11240cb4c0 2023-12-22T08:40:32.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 >> v2:172.21.15.89:3300/0 conn(0x7f112406d5f0 msgr2=0x7f112415e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:32.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11227fc640 1 --2- 172.21.15.38:0/1260589235 >> v2:172.21.15.89:3300/0 conn(0x7f112406d5f0 0x7f112415e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 >> v1:172.21.15.89:6789/0 conn(0x7f112406d210 legacy=0x7f1124159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11240ceb20 con 0x7f11240cb4c0 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f110c001670 con 0x7f11240cb4c0 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 >> v1:172.21.15.38:6789/0 conn(0x7f11240cb4c0 legacy=0x7f1124070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11227fc640 1 --2- 172.21.15.38:0/1260589235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11040039c0 0x7f1104003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11227fc640 1 --2- 172.21.15.38:0/1260589235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11040047c0 0x7f1104004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11227fc640 1 --2- 172.21.15.38:0/1260589235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11040051d0 0x7f110400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11240ce840 con 0x7f11040051d0 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110400c120 con 0x7f11040039c0 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110400c2e0 con 0x7f11040047c0 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f11237fe640 1 --2- 172.21.15.38:0/1260589235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11040051d0 0x7f110400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f1122ffd640 1 --2- 172.21.15.38:0/1260589235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11040039c0 0x7f1104003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.937+0000 7f111a7fc640 1 --2- 172.21.15.38:0/1260589235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11040047c0 0x7f1104004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.938+0000 7f11237fe640 1 -- 172.21.15.38:0/1260589235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11040047c0 msgr2=0x7f1104004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:32.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.938+0000 7f11237fe640 1 --2- 172.21.15.38:0/1260589235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11040047c0 0x7f1104004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.938+0000 7f11237fe640 1 -- 172.21.15.38:0/1260589235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11040039c0 msgr2=0x7f1104003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.938+0000 7f11237fe640 1 --2- 172.21.15.38:0/1260589235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11040039c0 0x7f1104003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.938+0000 7f11237fe640 1 -- 172.21.15.38:0/1260589235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1104003520 con 0x7f11040051d0 2023-12-22T08:40:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.938+0000 7f11237fe640 1 -- 172.21.15.38:0/1260589235 reap_dead start 2023-12-22T08:40:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.939+0000 7f11237fe640 1 --2- 172.21.15.38:0/1260589235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11040051d0 0x7f110400b980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f111c007360 tx=0x7f11040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18b074d96f01beb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.939+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c02ccf0 con 0x7f11040051d0 2023-12-22T08:40:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.939+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c02ce90 con 0x7f11040051d0 2023-12-22T08:40:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.939+0000 7f11227fc640 1 -- 172.21.15.38:0/1260589235 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c003bd0 con 0x7f11040051d0 2023-12-22T08:40:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.939+0000 7f1123fff640 1 -- 172.21.15.38:0/1260589235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11040051d0 msgr2=0x7f110400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.939+0000 7f1123fff640 1 --2- 172.21.15.38:0/1260589235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11040051d0 0x7f110400b980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f111c007360 tx=0x7f11040057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.940+0000 7f1123fff640 1 -- 172.21.15.38:0/1260589235 shutdown_connections 2023-12-22T08:40:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.940+0000 7f1123fff640 1 --2- 172.21.15.38:0/1260589235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11040051d0 0x7f110400b980 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.940+0000 7f1123fff640 1 -- 172.21.15.38:0/1260589235 >> 172.21.15.38:0/1260589235 conn(0x7f11240b1f70 msgr2=0x7f11240b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.940+0000 7f1123fff640 1 -- 172.21.15.38:0/1260589235 shutdown_connections 2023-12-22T08:40:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.940+0000 7f1123fff640 1 -- 172.21.15.38:0/1260589235 wait complete. 2023-12-22T08:40:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.942+0000 7f1123fff640 1 Processor -- start 2023-12-22T08:40:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.942+0000 7f1123fff640 1 -- start start 2023-12-22T08:40:32.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.943+0000 7f1123fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11040051d0 0x7f112406f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.943+0000 7f1123fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f112409a020 0x7f112415b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.943+0000 7f1123fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f112415bed0 0x7f112415c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.943+0000 7f1123fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112414f370 con 0x7f112409a020 2023-12-22T08:40:32.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.943+0000 7f1123fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112414f650 con 0x7f112415bed0 2023-12-22T08:40:32.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.943+0000 7f1123fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112414f930 con 0x7f11040051d0 2023-12-22T08:40:32.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.943+0000 7f111a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f112409a020 0x7f112415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.943+0000 7f111a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f112409a020 0x7f112415b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53516/0 (socket says 172.21.15.38:53516) 2023-12-22T08:40:32.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.943+0000 7f111a7fc640 1 -- 172.21.15.38:0/574060087 learned_addr learned my addr 172.21.15.38:0/574060087 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:32.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.944+0000 7f1122ffd640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11040051d0 0x7f112406f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.944+0000 7f11237fe640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f112415bed0 0x7f112415c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.944+0000 7f111a7fc640 1 -- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11040051d0 msgr2=0x7f112406f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:32.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.944+0000 7f111a7fc640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11040051d0 0x7f112406f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.944+0000 7f111a7fc640 1 -- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f112415bed0 msgr2=0x7f112415c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:32.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.944+0000 7f111a7fc640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f112415bed0 0x7f112415c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.944+0000 7f111a7fc640 1 -- 172.21.15.38:0/574060087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11240c8b20 con 0x7f112409a020 2023-12-22T08:40:32.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.944+0000 7f111a7fc640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f112409a020 0x7f112415b990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f110c00d7a0 tx=0x7f110c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:32.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.944+0000 7f1120ff9640 1 -- 172.21.15.38:0/574060087 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0074e0 con 0x7f112409a020 2023-12-22T08:40:32.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.944+0000 7f1120ff9640 1 -- 172.21.15.38:0/574060087 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c007640 con 0x7f112409a020 2023-12-22T08:40:32.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.944+0000 7f1123fff640 1 -- 172.21.15.38:0/574060087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11240c8e00 con 0x7f112409a020 2023-12-22T08:40:32.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.944+0000 7f1120ff9640 1 -- 172.21.15.38:0/574060087 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c004a20 con 0x7f112409a020 2023-12-22T08:40:32.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.944+0000 7f1123fff640 1 -- 172.21.15.38:0/574060087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112406fbe0 con 0x7f112409a020 2023-12-22T08:40:32.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.946+0000 7f1123fff640 1 -- 172.21.15.38:0/574060087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11240a01c0 con 0x7f112409a020 2023-12-22T08:40:32.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.947+0000 7f1120ff9640 1 -- 172.21.15.38:0/574060087 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f110c004b80 con 0x7f112409a020 2023-12-22T08:40:32.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.948+0000 7f1120ff9640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f110806a430 0x7f110806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.948+0000 7f1120ff9640 1 -- 172.21.15.38:0/574060087 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f110c088400 con 0x7f112409a020 2023-12-22T08:40:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.949+0000 7f1122ffd640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f110806a430 0x7f110806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.950+0000 7f1122ffd640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f110806a430 0x7f110806c8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1114007fd0 tx=0x7f1114009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:32.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:32.953+0000 7f1120ff9640 1 -- 172.21.15.38:0/574060087 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f110c053950 con 0x7f112409a020 2023-12-22T08:40:33.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.185+0000 7f1123fff640 1 -- 172.21.15.38:0/574060087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f11240c9040 con 0x7f112409a020 2023-12-22T08:40:33.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.186+0000 7f1120ff9640 1 -- 172.21.15.38:0/574060087 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f110c019060 con 0x7f112409a020 2023-12-22T08:40:33.187 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:40:33.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.188+0000 7f1123fff640 1 -- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f110806a430 msgr2=0x7f110806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:33.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.188+0000 7f1123fff640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f110806a430 0x7f110806c8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1114007fd0 tx=0x7f1114009040 comp rx=0 tx=0).stop 2023-12-22T08:40:33.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.188+0000 7f1123fff640 1 -- 172.21.15.38:0/574060087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f112409a020 msgr2=0x7f112415b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:33.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.188+0000 7f1123fff640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f112409a020 0x7f112415b990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f110c00d7a0 tx=0x7f110c00dc60 comp rx=0 tx=0).stop 2023-12-22T08:40:33.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.188+0000 7f1123fff640 1 -- 172.21.15.38:0/574060087 shutdown_connections 2023-12-22T08:40:33.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.188+0000 7f1123fff640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f112415bed0 0x7f112415c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:33.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.188+0000 7f1123fff640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f110806a430 0x7f110806c8f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:33.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.188+0000 7f1123fff640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f112409a020 0x7f112415b990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:33.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.188+0000 7f1123fff640 1 --2- 172.21.15.38:0/574060087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11040051d0 0x7f112406f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:33.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.188+0000 7f1123fff640 1 -- 172.21.15.38:0/574060087 >> 172.21.15.38:0/574060087 conn(0x7f11240b1f70 msgr2=0x7f112415d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:33.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.189+0000 7f1123fff640 1 -- 172.21.15.38:0/574060087 shutdown_connections 2023-12-22T08:40:33.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:33.189+0000 7f1123fff640 1 -- 172.21.15.38:0/574060087 wait complete. 2023-12-22T08:40:33.210 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-22T08:40:33.210 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:40:33.210 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-22T08:40:33.210 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-22T08:40:33.210 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-22T08:40:33.210 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-22T08:40:33.210 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-22T08:40:33.210 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:40:33.210 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-22T08:40:33.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:33.210 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-22T08:40:33.271 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:40:33.271 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:40:33.271 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:40:33.271 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:33.271 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:40:33.271 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:33.271 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:33.271 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:33.271 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-22T08:40:33.271 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:33.271 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42328sec preferred_lft 42328sec 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8e:46:07:65:e3:1f brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::9cc2:a9ff:fe75:e812/64 scope link 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:33.272 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:40:33.273 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8e:46:07:65:e3:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T08:40:33.273 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::8c46:7ff:fe65:e31f/64 scope link tentative 2023-12-22T08:40:33.273 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:33.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:33.274 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:40:33.359 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-22T08:40:33.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:33.363 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-22T08:40:33.418 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-22T08:40:33.418 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:40:33.418 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:40:33.418 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:40:33.418 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:40:33.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:33.419 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:40:33.419 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:40:33.419 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:40:33.419 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:40:33.419 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:40:33.419 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:40:33.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:33.600 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:40:33.654 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T08:40:33.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:33.655 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2023-12-22T08:40:33.710 INFO:teuthology.orchestra.run.smithi089.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-22T08:40:33.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:33.712 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:40:33.713 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:40:33.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T08:40:33.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-22T08:40:33.713 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:40:33.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:33.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-22T08:40:33.946 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:40:33.946 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:40:33.946 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:40:33.946 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:33.946 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:40:33.946 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:33.946 INFO:teuthology.orchestra.run.smithi089.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:40:33.946 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 22:87:5a:b3:4f:c3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-22T08:40:33.946 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-22T08:40:33.947 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:33.947 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2087:5aff:feb3:4fc3/64 scope link 2023-12-22T08:40:33.947 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:33.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:33.950 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-22T08:40:34.049 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:40:34.049 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:40:34.049 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:40:34.049 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:34.050 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:40:34.050 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:34.050 INFO:teuthology.orchestra.run.smithi089.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:40:34.050 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 22:87:5a:b3:4f:c3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-22T08:40:34.050 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-22T08:40:34.050 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:34.050 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2087:5aff:feb3:4fc3/64 scope link 2023-12-22T08:40:34.050 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:34.053 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-22T08:40:34.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:34.054 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:40:34.054 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:40:34.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-22T08:40:34.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-22T08:40:34.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-22T08:40:34.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-22T08:40:34.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-22T08:40:34.054 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:40:34.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:34.319 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:40:34.319 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:40:34.319 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.1 up 2023-12-22T08:40:34.319 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.1 master ceph-brx 2023-12-22T08:40:34.319 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:40:34.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:40:34.480 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-22T08:40:34.531 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-22T08:40:34.531 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:40:34.531 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-22T08:40:34.582 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-12-22T08:40:34.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:34.681 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:40:34.830 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:40:34.831 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:40:34.865 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:40:34.865 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:40:34.865 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:40:34.865 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 3@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:40:34.865 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:40:34.868 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2023-12-22T08:40:34.868 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:40:34.868 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:40:34.868 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:40:34.869 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:40:34.874 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:40:34.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:34.874 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-22T08:40:34.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:34.963 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:40:35.021 INFO:teuthology.orchestra.run.smithi089.stdout:client4642 2023-12-22T08:40:35.021 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:40:35.021 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:35.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:35.070 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:40:35.170 INFO:teuthology.orchestra.run.smithi089.stdout:client4642 2023-12-22T08:40:35.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:35.171 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:40:35.228 INFO:teuthology.orchestra.run.smithi089.stdout:client4642 2023-12-22T08:40:35.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:35.228 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/893856d7-5d01-4896-9127-f971dbad2b97.client4642/status') 2023-12-22T08:40:35.320 INFO:teuthology.orchestra.run.smithi089.stdout:instance: client.4642 (3)192.168.0.2:0/2254662004 2023-12-22T08:40:35.320 INFO:teuthology.orchestra.run.smithi089.stdout:blocklisted: false 2023-12-22T08:40:35.320 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records in 2023-12-22T08:40:35.320 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records out 2023-12-22T08:40:35.320 INFO:teuthology.orchestra.run.smithi089.stderr:69 bytes copied, 8.4523e-05 s, 816 kB/s 2023-12-22T08:40:35.324 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-22T08:40:35.340 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:35.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.566+0000 7f3060451640 1 Processor -- start 2023-12-22T08:40:35.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.566+0000 7f3060451640 1 -- start start 2023-12-22T08:40:35.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.568+0000 7f3060451640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f305815d470 0x7f30580b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:35.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.568+0000 7f3060451640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580ac8e0 con 0x7f305815d850 2023-12-22T08:40:35.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.568+0000 7f3060451640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580b4550 con 0x7f3058071ea0 2023-12-22T08:40:35.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.568+0000 7f3060451640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30580ada40 con 0x7f305815d470 2023-12-22T08:40:35.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.568+0000 7f305e1ed640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f305815d470 0x7f30580b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:35.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.568+0000 7f305d9ec640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f305815d850 0x7f30580ad330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44814/0 (socket says 172.21.15.38:44814) 2023-12-22T08:40:35.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.568+0000 7f305d9ec640 1 -- 172.21.15.38:0/3876730037 learned_addr learned my addr 172.21.15.38:0/3876730037 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:35.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.569+0000 7f305e1ed640 1 -- 172.21.15.38:0/3876730037 >> v1:172.21.15.89:6789/0 conn(0x7f3058071ea0 legacy=0x7f30580b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:35.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.569+0000 7f305e1ed640 1 -- 172.21.15.38:0/3876730037 >> v1:172.21.15.38:6789/0 conn(0x7f305815d850 legacy=0x7f30580ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:35.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.569+0000 7f305d1eb640 1 -- 172.21.15.38:0/3876730037 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097064709 0 0) 0x7f30580ac8e0 con 0x7f305815d850 2023-12-22T08:40:35.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.569+0000 7f305e1ed640 1 -- 172.21.15.38:0/3876730037 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580b4940 con 0x7f305815d470 2023-12-22T08:40:35.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.571+0000 7f305e1ed640 1 --2- 172.21.15.38:0/3876730037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f305815d470 0x7f30580b4010 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f30540097a0 tx=0x7f305402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40072925ac215d9d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:35.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.571+0000 7f305d1eb640 1 -- 172.21.15.38:0/3876730037 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054031830 con 0x7f305815d470 2023-12-22T08:40:35.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.571+0000 7f305d1eb640 1 -- 172.21.15.38:0/3876730037 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3054031990 con 0x7f305815d470 2023-12-22T08:40:35.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.571+0000 7f305d1eb640 1 -- 172.21.15.38:0/3876730037 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054031d20 con 0x7f305815d470 2023-12-22T08:40:35.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.571+0000 7f3060451640 1 -- 172.21.15.38:0/3876730037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f305815d470 msgr2=0x7f30580b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:35.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.571+0000 7f3060451640 1 --2- 172.21.15.38:0/3876730037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f305815d470 0x7f30580b4010 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f30540097a0 tx=0x7f305402b8d0 comp rx=0 tx=0).stop 2023-12-22T08:40:35.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.572+0000 7f3060451640 1 -- 172.21.15.38:0/3876730037 shutdown_connections 2023-12-22T08:40:35.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.572+0000 7f3060451640 1 --2- 172.21.15.38:0/3876730037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f305815d470 0x7f30580b4010 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:35.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.572+0000 7f3060451640 1 -- 172.21.15.38:0/3876730037 >> 172.21.15.38:0/3876730037 conn(0x7f30580cf070 msgr2=0x7f30580cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:35.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.572+0000 7f3060451640 1 -- 172.21.15.38:0/3876730037 shutdown_connections 2023-12-22T08:40:35.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.572+0000 7f3060451640 1 -- 172.21.15.38:0/3876730037 wait complete. 2023-12-22T08:40:35.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.573+0000 7f3060451640 1 Processor -- start 2023-12-22T08:40:35.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.574+0000 7f3060451640 1 -- start start 2023-12-22T08:40:35.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.574+0000 7f3060451640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3058071ea0 0x7f30580cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:35.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f3060451640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f305815d470 0x7f3058153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:35.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f3060451640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f305815d850 0x7f3058153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:35.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f3060451640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580cb900 con 0x7f3058071ea0 2023-12-22T08:40:35.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f3060451640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30581542f0 con 0x7f305815d470 2023-12-22T08:40:35.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f3060451640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305815e7c0 con 0x7f305815d850 2023-12-22T08:40:35.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f305e1ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3058071ea0 0x7f30580cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:35.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f305e1ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3058071ea0 0x7f30580cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53522/0 (socket says 172.21.15.38:53522) 2023-12-22T08:40:35.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f305e1ed640 1 -- 172.21.15.38:0/722560069 learned_addr learned my addr 172.21.15.38:0/722560069 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:35.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f305d9ec640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f305815d470 0x7f3058153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:35.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f305e9ee640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f305815d850 0x7f3058153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:35.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f305e1ed640 1 -- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f305815d850 msgr2=0x7f3058153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:35.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f305e1ed640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f305815d850 0x7f3058153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:35.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f305e1ed640 1 -- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f305815d470 msgr2=0x7f3058153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:35.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f305e1ed640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f305815d470 0x7f3058153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:35.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.575+0000 7f305e1ed640 1 -- 172.21.15.38:0/722560069 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3054009400 con 0x7f3058071ea0 2023-12-22T08:40:35.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.576+0000 7f305e1ed640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3058071ea0 0x7f30580cdab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f30540098c0 tx=0x7f30540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:35.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.576+0000 7f304effd640 1 -- 172.21.15.38:0/722560069 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305403ba70 con 0x7f3058071ea0 2023-12-22T08:40:35.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.576+0000 7f304effd640 1 -- 172.21.15.38:0/722560069 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305403bbd0 con 0x7f3058071ea0 2023-12-22T08:40:35.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.576+0000 7f3060451640 1 -- 172.21.15.38:0/722560069 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305815eaa0 con 0x7f3058071ea0 2023-12-22T08:40:35.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.576+0000 7f304effd640 1 -- 172.21.15.38:0/722560069 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540453f0 con 0x7f3058071ea0 2023-12-22T08:40:35.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.576+0000 7f3060451640 1 -- 172.21.15.38:0/722560069 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305815f060 con 0x7f3058071ea0 2023-12-22T08:40:35.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.578+0000 7f3060451640 1 -- 172.21.15.38:0/722560069 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30580b35e0 con 0x7f3058071ea0 2023-12-22T08:40:35.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.578+0000 7f304effd640 1 -- 172.21.15.38:0/722560069 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f305404e450 con 0x7f3058071ea0 2023-12-22T08:40:35.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.579+0000 7f304effd640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f303c06a430 0x7f303c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:35.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.579+0000 7f304effd640 1 -- 172.21.15.38:0/722560069 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30540aac80 con 0x7f3058071ea0 2023-12-22T08:40:35.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.580+0000 7f305d9ec640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f303c06a430 0x7f303c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:35.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.581+0000 7f305d9ec640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f303c06a430 0x7f303c06c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f30580cd660 tx=0x7f3048007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:35.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.584+0000 7f304effd640 1 -- 172.21.15.38:0/722560069 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f30540762f0 con 0x7f3058071ea0 2023-12-22T08:40:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.779+0000 7f3060451640 1 -- 172.21.15.38:0/722560069 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3058061910 con 0x7f3058071ea0 2023-12-22T08:40:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.781+0000 7f304effd640 1 -- 172.21.15.38:0/722560069 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f3054079910 con 0x7f3058071ea0 2023-12-22T08:40:35.783 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:35.784 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:59.604518+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:35.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.783+0000 7f3060451640 1 -- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f303c06a430 msgr2=0x7f303c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:35.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.783+0000 7f3060451640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f303c06a430 0x7f303c06c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f30580cd660 tx=0x7f3048007c00 comp rx=0 tx=0).stop 2023-12-22T08:40:35.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.783+0000 7f3060451640 1 -- 172.21.15.38:0/722560069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3058071ea0 msgr2=0x7f30580cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.783+0000 7f3060451640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3058071ea0 0x7f30580cdab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f30540098c0 tx=0x7f30540046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.784+0000 7f3060451640 1 -- 172.21.15.38:0/722560069 shutdown_connections 2023-12-22T08:40:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.784+0000 7f3060451640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f305815d850 0x7f3058153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.784+0000 7f3060451640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f305815d470 0x7f3058153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.784+0000 7f3060451640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f303c06a430 0x7f303c06c8f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.784+0000 7f3060451640 1 --2- 172.21.15.38:0/722560069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3058071ea0 0x7f30580cdab0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.784+0000 7f3060451640 1 -- 172.21.15.38:0/722560069 >> 172.21.15.38:0/722560069 conn(0x7f30580cf070 msgr2=0x7f30580b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.784+0000 7f3060451640 1 -- 172.21.15.38:0/722560069 shutdown_connections 2023-12-22T08:40:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:35.784+0000 7f3060451640 1 -- 172.21.15.38:0/722560069 wait complete. 2023-12-22T08:40:35.805 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:39:56.873963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:39:57.616447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:35.806 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:36.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.015+0000 7f95c88a1640 1 Processor -- start 2023-12-22T08:40:36.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.016+0000 7f95c88a1640 1 -- start start 2023-12-22T08:40:36.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.017+0000 7f95c88a1640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f95c41619c0 0x7f95c40b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.017+0000 7f95c88a1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95c40ceb70 0x7f95c406f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.017+0000 7f95c88a1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95c4070000 0x7f95c406f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.017+0000 7f95c88a1640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c40ce6e0 con 0x7f95c41619c0 2023-12-22T08:40:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.017+0000 7f95c88a1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c40b4db0 con 0x7f95c4070000 2023-12-22T08:40:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.017+0000 7f95c88a1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40b5090 con 0x7f95c40ceb70 2023-12-22T08:40:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.018+0000 7f95c259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f95c41619c0 0x7f95c40b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.018+0000 7f95c259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f95c41619c0 0x7f95c40b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53532/0 (socket says 172.21.15.38:53532) 2023-12-22T08:40:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.018+0000 7f95c259c640 1 -- 172.21.15.38:0/670248398 learned_addr learned my addr 172.21.15.38:0/670248398 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.018+0000 7f95bbfff640 1 --2- 172.21.15.38:0/670248398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95c40ceb70 0x7f95c406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.018+0000 7f95c2d9d640 1 --2- 172.21.15.38:0/670248398 >> v2:172.21.15.89:3300/0 conn(0x7f95c4070000 0x7f95c406f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.018+0000 7f95c259c640 1 -- 172.21.15.38:0/670248398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95c40ceb70 msgr2=0x7f95c406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.018+0000 7f95c259c640 1 --2- 172.21.15.38:0/670248398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95c40ceb70 0x7f95c406f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.018+0000 7f95c259c640 1 -- 172.21.15.38:0/670248398 >> v2:172.21.15.89:3300/0 conn(0x7f95c4070000 msgr2=0x7f95c406f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:36.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.018+0000 7f95c259c640 1 --2- 172.21.15.38:0/670248398 >> v2:172.21.15.89:3300/0 conn(0x7f95c4070000 0x7f95c406f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.018+0000 7f95c259c640 1 -- 172.21.15.38:0/670248398 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c40ce370 con 0x7f95c41619c0 2023-12-22T08:40:36.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.020+0000 7f95c259c640 1 --2- 172.21.15.38:0/670248398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95c41619c0 0x7f95c40b4560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f95c406c0b0 tx=0x7f95b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb2040519876bef server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:36.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.020+0000 7f95c1d9b640 1 -- 172.21.15.38:0/670248398 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4031870 con 0x7f95c41619c0 2023-12-22T08:40:36.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.021+0000 7f95c1d9b640 1 -- 172.21.15.38:0/670248398 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b40319d0 con 0x7f95c41619c0 2023-12-22T08:40:36.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.021+0000 7f95c1d9b640 1 -- 172.21.15.38:0/670248398 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4031d60 con 0x7f95c41619c0 2023-12-22T08:40:36.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.021+0000 7f95c88a1640 1 -- 172.21.15.38:0/670248398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95c41619c0 msgr2=0x7f95c40b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.021+0000 7f95c88a1640 1 --2- 172.21.15.38:0/670248398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95c41619c0 0x7f95c40b4560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f95c406c0b0 tx=0x7f95b402b910 comp rx=0 tx=0).stop 2023-12-22T08:40:36.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.021+0000 7f95c88a1640 1 -- 172.21.15.38:0/670248398 shutdown_connections 2023-12-22T08:40:36.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.021+0000 7f95c88a1640 1 --2- 172.21.15.38:0/670248398 >> v2:172.21.15.89:3300/0 conn(0x7f95c4070000 0x7f95c406f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.021+0000 7f95c88a1640 1 --2- 172.21.15.38:0/670248398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95c40ceb70 0x7f95c406f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.021+0000 7f95c88a1640 1 --2- 172.21.15.38:0/670248398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95c41619c0 0x7f95c40b4560 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.021+0000 7f95c88a1640 1 -- 172.21.15.38:0/670248398 >> 172.21.15.38:0/670248398 conn(0x7f95c40b20c0 msgr2=0x7f95c40b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:36.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.021+0000 7f95c88a1640 1 -- 172.21.15.38:0/670248398 shutdown_connections 2023-12-22T08:40:36.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.021+0000 7f95c88a1640 1 -- 172.21.15.38:0/670248398 wait complete. 2023-12-22T08:40:36.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.023+0000 7f95c88a1640 1 Processor -- start 2023-12-22T08:40:36.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.023+0000 7f95c88a1640 1 -- start start 2023-12-22T08:40:36.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.024+0000 7f95c88a1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95c4070000 0x7f95c41f9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.024+0000 7f95c88a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95c40ceb70 0x7f95c41534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.024+0000 7f95c88a1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95c41619c0 0x7f95c41539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.024+0000 7f95c88a1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c415a070 con 0x7f95c41619c0 2023-12-22T08:40:36.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.024+0000 7f95c88a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c41fa4c0 con 0x7f95c40ceb70 2023-12-22T08:40:36.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.024+0000 7f95c88a1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c415a310 con 0x7f95c4070000 2023-12-22T08:40:36.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.025+0000 7f95c2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95c41619c0 0x7f95c41539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.025+0000 7f95c2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95c41619c0 0x7f95c41539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53542/0 (socket says 172.21.15.38:53542) 2023-12-22T08:40:36.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.025+0000 7f95c2d9d640 1 -- 172.21.15.38:0/3123899159 learned_addr learned my addr 172.21.15.38:0/3123899159 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:36.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.025+0000 7f95c259c640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95c4070000 0x7f95c41f9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.025+0000 7f95bbfff640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95c40ceb70 0x7f95c41534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.025+0000 7f95c2d9d640 1 -- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95c4070000 msgr2=0x7f95c41f9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.025+0000 7f95c2d9d640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95c4070000 0x7f95c41f9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.025+0000 7f95c2d9d640 1 -- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95c40ceb70 msgr2=0x7f95c41534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.025+0000 7f95c2d9d640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95c40ceb70 0x7f95c41534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.025+0000 7f95c2d9d640 1 -- 172.21.15.38:0/3123899159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b40094d0 con 0x7f95c41619c0 2023-12-22T08:40:36.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.026+0000 7f95c2d9d640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95c41619c0 0x7f95c41539f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f95bc007d60 tx=0x7f95bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:36.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.026+0000 7f95baffd640 1 -- 172.21.15.38:0/3123899159 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc014420 con 0x7f95c41619c0 2023-12-22T08:40:36.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.026+0000 7f95baffd640 1 -- 172.21.15.38:0/3123899159 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc0145a0 con 0x7f95c41619c0 2023-12-22T08:40:36.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.026+0000 7f95baffd640 1 -- 172.21.15.38:0/3123899159 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc014950 con 0x7f95c41619c0 2023-12-22T08:40:36.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.026+0000 7f95c88a1640 1 -- 172.21.15.38:0/3123899159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c415a5f0 con 0x7f95c41619c0 2023-12-22T08:40:36.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.026+0000 7f95c88a1640 1 -- 172.21.15.38:0/3123899159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c415abb0 con 0x7f95c41619c0 2023-12-22T08:40:36.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.027+0000 7f95c88a1640 1 -- 172.21.15.38:0/3123899159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c4061910 con 0x7f95c41619c0 2023-12-22T08:40:36.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.028+0000 7f95baffd640 1 -- 172.21.15.38:0/3123899159 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f95bc014ab0 con 0x7f95c41619c0 2023-12-22T08:40:36.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.029+0000 7f95baffd640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f95a406a430 0x7f95a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.030+0000 7f95baffd640 1 -- 172.21.15.38:0/3123899159 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95bc089280 con 0x7f95c41619c0 2023-12-22T08:40:36.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.030+0000 7f95c259c640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f95a406a430 0x7f95a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.031+0000 7f95c259c640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f95a406a430 0x7f95a406c8f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f95b4036000 tx=0x7f95b403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:36.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.033+0000 7f95baffd640 1 -- 172.21.15.38:0/3123899159 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f95bc0547d0 con 0x7f95c41619c0 2023-12-22T08:40:36.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.229+0000 7f95c88a1640 1 -- 172.21.15.38:0/3123899159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95c415c720 con 0x7f95c41619c0 2023-12-22T08:40:36.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.230+0000 7f95baffd640 1 -- 172.21.15.38:0/3123899159 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95bc057df0 con 0x7f95c41619c0 2023-12-22T08:40:36.233 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:40:36.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.233+0000 7f95c88a1640 1 -- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f95a406a430 msgr2=0x7f95a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.233+0000 7f95c88a1640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f95a406a430 0x7f95a406c8f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f95b4036000 tx=0x7f95b403c040 comp rx=0 tx=0).stop 2023-12-22T08:40:36.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.233+0000 7f95c88a1640 1 -- 172.21.15.38:0/3123899159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95c41619c0 msgr2=0x7f95c41539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.233+0000 7f95c88a1640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95c41619c0 0x7f95c41539f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f95bc007d60 tx=0x7f95bc00e4b0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.233+0000 7f95c88a1640 1 -- 172.21.15.38:0/3123899159 shutdown_connections 2023-12-22T08:40:36.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.233+0000 7f95c88a1640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f95a406a430 0x7f95a406c8f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.233+0000 7f95c88a1640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95c41619c0 0x7f95c41539f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.233+0000 7f95c88a1640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95c40ceb70 0x7f95c41534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.233+0000 7f95c88a1640 1 --2- 172.21.15.38:0/3123899159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95c4070000 0x7f95c41f9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.233+0000 7f95c88a1640 1 -- 172.21.15.38:0/3123899159 >> 172.21.15.38:0/3123899159 conn(0x7f95c40b20c0 msgr2=0x7f95c4152200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:36.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.233+0000 7f95c88a1640 1 -- 172.21.15.38:0/3123899159 shutdown_connections 2023-12-22T08:40:36.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.234+0000 7f95c88a1640 1 -- 172.21.15.38:0/3123899159 wait complete. 2023-12-22T08:40:36.255 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:36.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.463+0000 7fdb90210640 1 Processor -- start 2023-12-22T08:40:36.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.464+0000 7fdb90210640 1 -- start start 2023-12-22T08:40:36.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.465+0000 7fdb90210640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdb8815e740 0x7fdb8815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.465+0000 7fdb90210640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8815eb20 con 0x7fdb8806ca50 2023-12-22T08:40:36.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.465+0000 7fdb90210640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb88070770 con 0x7fdb880b3f90 2023-12-22T08:40:36.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.465+0000 7fdb90210640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8806e650 con 0x7fdb8815e740 2023-12-22T08:40:36.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.465+0000 7fdb8d7ab640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdb8806ca50 0x7fdb880b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44818/0 (socket says 172.21.15.38:44818) 2023-12-22T08:40:36.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.465+0000 7fdb8d7ab640 1 -- 172.21.15.38:0/1588576236 learned_addr learned my addr 172.21.15.38:0/1588576236 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.466+0000 7fdb8dfac640 1 --2- 172.21.15.38:0/1588576236 >> v2:172.21.15.89:3300/0 conn(0x7fdb8815e740 0x7fdb8815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.466+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337448802 0 0) 0x7fdb8815eb20 con 0x7fdb8806ca50 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.466+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb74003520 con 0x7fdb8806ca50 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.466+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3510752899 0 0) 0x7fdb74003520 con 0x7fdb8806ca50 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.466+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 >> v2:172.21.15.89:3300/0 conn(0x7fdb8815e740 msgr2=0x7fdb8815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.466+0000 7fdb8cfaa640 1 --2- 172.21.15.38:0/1588576236 >> v2:172.21.15.89:3300/0 conn(0x7fdb8815e740 0x7fdb8815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.466+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 >> v1:172.21.15.89:6789/0 conn(0x7fdb880b3f90 legacy=0x7fdb88070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.466+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8806cec0 con 0x7fdb8806ca50 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.466+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fdb78001670 con 0x7fdb8806ca50 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.466+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 >> v1:172.21.15.38:6789/0 conn(0x7fdb8806ca50 legacy=0x7fdb880b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8cfaa640 1 --2- 172.21.15.38:0/1588576236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb74003970 0x7fdb74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8cfaa640 1 --2- 172.21.15.38:0/1588576236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb740047c0 0x7fdb74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8cfaa640 1 --2- 172.21.15.38:0/1588576236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb740052a0 0x7fdb7400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8806e650 con 0x7fdb740047c0 2023-12-22T08:40:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7400c170 con 0x7fdb740052a0 2023-12-22T08:40:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7400c330 con 0x7fdb74003970 2023-12-22T08:40:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8d7ab640 1 --2- 172.21.15.38:0/1588576236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb740047c0 0x7fdb74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8dfac640 1 --2- 172.21.15.38:0/1588576236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb74003970 0x7fdb74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8e7ad640 1 --2- 172.21.15.38:0/1588576236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb740052a0 0x7fdb7400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8d7ab640 1 -- 172.21.15.38:0/1588576236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb74003970 msgr2=0x7fdb74003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8d7ab640 1 --2- 172.21.15.38:0/1588576236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb74003970 0x7fdb74003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8d7ab640 1 -- 172.21.15.38:0/1588576236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb740052a0 msgr2=0x7fdb7400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8d7ab640 1 --2- 172.21.15.38:0/1588576236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb740052a0 0x7fdb7400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8d7ab640 1 -- 172.21.15.38:0/1588576236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb74003520 con 0x7fdb740047c0 2023-12-22T08:40:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.467+0000 7fdb8e7ad640 1 -- 172.21.15.38:0/1588576236 reap_dead start 2023-12-22T08:40:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.469+0000 7fdb8d7ab640 1 --2- 172.21.15.38:0/1588576236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb740047c0 0x7fdb74004c40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800c210 tx=0x7fdb740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676e03ca31bf28ba server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.469+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78005ad0 con 0x7fdb740047c0 2023-12-22T08:40:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.469+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb78005c30 con 0x7fdb740047c0 2023-12-22T08:40:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.469+0000 7fdb8cfaa640 1 -- 172.21.15.38:0/1588576236 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7802cad0 con 0x7fdb740047c0 2023-12-22T08:40:36.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.470+0000 7fdb90210640 1 -- 172.21.15.38:0/1588576236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb740047c0 msgr2=0x7fdb74004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.470+0000 7fdb90210640 1 --2- 172.21.15.38:0/1588576236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb740047c0 0x7fdb74004c40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800c210 tx=0x7fdb740057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.470+0000 7fdb90210640 1 -- 172.21.15.38:0/1588576236 shutdown_connections 2023-12-22T08:40:36.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.470+0000 7fdb90210640 1 --2- 172.21.15.38:0/1588576236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb740047c0 0x7fdb74004c40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.470+0000 7fdb90210640 1 -- 172.21.15.38:0/1588576236 >> 172.21.15.38:0/1588576236 conn(0x7fdb880cfea0 msgr2=0x7fdb880d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:36.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.470+0000 7fdb90210640 1 -- 172.21.15.38:0/1588576236 shutdown_connections 2023-12-22T08:40:36.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.470+0000 7fdb90210640 1 -- 172.21.15.38:0/1588576236 wait complete. 2023-12-22T08:40:36.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.473+0000 7fdb90210640 1 Processor -- start 2023-12-22T08:40:36.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.473+0000 7fdb90210640 1 -- start start 2023-12-22T08:40:36.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.475+0000 7fdb90210640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb740047c0 0x7fdb880b8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.475+0000 7fdb90210640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb880b7890 0x7fdb88149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.475+0000 7fdb90210640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb88156320 0x7fdb881567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.475+0000 7fdb90210640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb881f5d40 con 0x7fdb740047c0 2023-12-22T08:40:36.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.475+0000 7fdb90210640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb880b80c0 con 0x7fdb88156320 2023-12-22T08:40:36.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.475+0000 7fdb90210640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb88149cd0 con 0x7fdb880b7890 2023-12-22T08:40:36.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.475+0000 7fdb8dfac640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb740047c0 0x7fdb880b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.475+0000 7fdb8dfac640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb740047c0 0x7fdb880b8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53546/0 (socket says 172.21.15.38:53546) 2023-12-22T08:40:36.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.475+0000 7fdb8dfac640 1 -- 172.21.15.38:0/3169124820 learned_addr learned my addr 172.21.15.38:0/3169124820 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:36.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.476+0000 7fdb8dfac640 1 -- 172.21.15.38:0/3169124820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb880b7890 msgr2=0x7fdb88149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.476+0000 7fdb8dfac640 1 --2- 172.21.15.38:0/3169124820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb880b7890 0x7fdb88149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.476+0000 7fdb8dfac640 1 -- 172.21.15.38:0/3169124820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb88156320 msgr2=0x7fdb881567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.476+0000 7fdb8dfac640 1 --2- 172.21.15.38:0/3169124820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb88156320 0x7fdb881567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.476+0000 7fdb8dfac640 1 -- 172.21.15.38:0/3169124820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb88156d10 con 0x7fdb740047c0 2023-12-22T08:40:36.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.476+0000 7fdb8dfac640 1 --2- 172.21.15.38:0/3169124820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb740047c0 0x7fdb880b8470 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdb840114e0 tx=0x7fdb840119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:36.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.476+0000 7fdb7e7fc640 1 -- 172.21.15.38:0/3169124820 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb84015870 con 0x7fdb740047c0 2023-12-22T08:40:36.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.476+0000 7fdb7e7fc640 1 -- 172.21.15.38:0/3169124820 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb840159d0 con 0x7fdb740047c0 2023-12-22T08:40:36.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.476+0000 7fdb90210640 1 -- 172.21.15.38:0/3169124820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb880b7de0 con 0x7fdb740047c0 2023-12-22T08:40:36.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.477+0000 7fdb7e7fc640 1 -- 172.21.15.38:0/3169124820 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb84015d40 con 0x7fdb740047c0 2023-12-22T08:40:36.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.477+0000 7fdb90210640 1 -- 172.21.15.38:0/3169124820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb88155ae0 con 0x7fdb740047c0 2023-12-22T08:40:36.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.478+0000 7fdb90210640 1 -- 172.21.15.38:0/3169124820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb88155660 con 0x7fdb740047c0 2023-12-22T08:40:36.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.479+0000 7fdb7e7fc640 1 -- 172.21.15.38:0/3169124820 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdb84013400 con 0x7fdb740047c0 2023-12-22T08:40:36.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.480+0000 7fdb7e7fc640 1 --2- 172.21.15.38:0/3169124820 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdb6c06a430 0x7fdb6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.481+0000 7fdb7e7fc640 1 -- 172.21.15.38:0/3169124820 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb840890d0 con 0x7fdb740047c0 2023-12-22T08:40:36.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.481+0000 7fdb8d7ab640 1 --2- 172.21.15.38:0/3169124820 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdb6c06a430 0x7fdb6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.482+0000 7fdb8d7ab640 1 --2- 172.21.15.38:0/3169124820 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdb6c06a430 0x7fdb6c06c8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdb78034000 tx=0x7fdb78039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:36.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.485+0000 7fdb7e7fc640 1 -- 172.21.15.38:0/3169124820 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdb88155660 con 0x7fdb740047c0 2023-12-22T08:40:36.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.680+0000 7fdb90210640 1 -- 172.21.15.38:0/3169124820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb88155660 con 0x7fdb740047c0 2023-12-22T08:40:36.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.681+0000 7fdb7e7fc640 1 -- 172.21.15.38:0/3169124820 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdb88155660 con 0x7fdb740047c0 2023-12-22T08:40:36.684 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:40:36.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.684+0000 7fdb90210640 1 -- 172.21.15.38:0/3169124820 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdb6c06a430 msgr2=0x7fdb6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.684+0000 7fdb90210640 1 --2- 172.21.15.38:0/3169124820 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdb6c06a430 0x7fdb6c06c8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdb78034000 tx=0x7fdb78039040 comp rx=0 tx=0).stop 2023-12-22T08:40:36.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.684+0000 7fdb90210640 1 -- 172.21.15.38:0/3169124820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb740047c0 msgr2=0x7fdb880b8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.684+0000 7fdb90210640 1 --2- 172.21.15.38:0/3169124820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb740047c0 0x7fdb880b8470 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdb840114e0 tx=0x7fdb840119a0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.684+0000 7fdb90210640 1 -- 172.21.15.38:0/3169124820 shutdown_connections 2023-12-22T08:40:36.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.684+0000 7fdb90210640 1 --2- 172.21.15.38:0/3169124820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb88156320 0x7fdb881567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.684+0000 7fdb90210640 1 --2- 172.21.15.38:0/3169124820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb880b7890 0x7fdb88149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.684+0000 7fdb90210640 1 --2- 172.21.15.38:0/3169124820 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdb6c06a430 0x7fdb6c06c8f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.684+0000 7fdb90210640 1 --2- 172.21.15.38:0/3169124820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb740047c0 0x7fdb880b8470 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.684+0000 7fdb90210640 1 -- 172.21.15.38:0/3169124820 >> 172.21.15.38:0/3169124820 conn(0x7fdb880cfea0 msgr2=0x7fdb88153e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:36.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.684+0000 7fdb90210640 1 -- 172.21.15.38:0/3169124820 shutdown_connections 2023-12-22T08:40:36.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.684+0000 7fdb90210640 1 -- 172.21.15.38:0/3169124820 wait complete. 2023-12-22T08:40:36.705 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:36.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.905+0000 7fe188865640 1 Processor -- start 2023-12-22T08:40:36.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.906+0000 7fe188865640 1 -- start start 2023-12-22T08:40:36.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.907+0000 7fe188865640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe18415d1c0 0x7fe184070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.907+0000 7fe188865640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe18415d5a0 0x7fe184070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.907+0000 7fe188865640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe1840d0060 0x7fe1840d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.907+0000 7fe188865640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18415de50 con 0x7fe18415d5a0 2023-12-22T08:40:36.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.907+0000 7fe188865640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1840d0dd0 con 0x7fe1840d0060 2023-12-22T08:40:36.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.907+0000 7fe188865640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840d10b0 con 0x7fe18415d1c0 2023-12-22T08:40:36.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.908+0000 7fe18259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe18415d5a0 0x7fe184070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.908+0000 7fe18259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe18415d5a0 0x7fe184070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53560/0 (socket says 172.21.15.38:53560) 2023-12-22T08:40:36.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.908+0000 7fe18259c640 1 -- 172.21.15.38:0/2022874327 learned_addr learned my addr 172.21.15.38:0/2022874327 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:36.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.908+0000 7fe182d9d640 1 --2- 172.21.15.38:0/2022874327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe18415d1c0 0x7fe184070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.908+0000 7fe18359e640 1 --2- 172.21.15.38:0/2022874327 >> v2:172.21.15.89:3300/0 conn(0x7fe1840d0060 0x7fe1840d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.908+0000 7fe18259c640 1 -- 172.21.15.38:0/2022874327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe18415d1c0 msgr2=0x7fe184070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:36.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.908+0000 7fe18259c640 1 --2- 172.21.15.38:0/2022874327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe18415d1c0 0x7fe184070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.908+0000 7fe18259c640 1 -- 172.21.15.38:0/2022874327 >> v2:172.21.15.89:3300/0 conn(0x7fe1840d0060 msgr2=0x7fe1840d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:36.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.908+0000 7fe18259c640 1 --2- 172.21.15.38:0/2022874327 >> v2:172.21.15.89:3300/0 conn(0x7fe1840d0060 0x7fe1840d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.908+0000 7fe18259c640 1 -- 172.21.15.38:0/2022874327 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18415dae0 con 0x7fe18415d5a0 2023-12-22T08:40:36.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.908+0000 7fe18359e640 1 --2- 172.21.15.38:0/2022874327 >> v2:172.21.15.89:3300/0 conn(0x7fe1840d0060 0x7fe1840d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:36.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.910+0000 7fe18259c640 1 --2- 172.21.15.38:0/2022874327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18415d5a0 0x7fe184070eb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe184066830 tx=0x7fe17802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37acfa359c0a705f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:36.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.910+0000 7fe181d9b640 1 -- 172.21.15.38:0/2022874327 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178031870 con 0x7fe18415d5a0 2023-12-22T08:40:36.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.910+0000 7fe181d9b640 1 -- 172.21.15.38:0/2022874327 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1780319d0 con 0x7fe18415d5a0 2023-12-22T08:40:36.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.910+0000 7fe181d9b640 1 -- 172.21.15.38:0/2022874327 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178031d60 con 0x7fe18415d5a0 2023-12-22T08:40:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.911+0000 7fe188865640 1 -- 172.21.15.38:0/2022874327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18415d5a0 msgr2=0x7fe184070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.911+0000 7fe188865640 1 --2- 172.21.15.38:0/2022874327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18415d5a0 0x7fe184070eb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe184066830 tx=0x7fe17802b910 comp rx=0 tx=0).stop 2023-12-22T08:40:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.911+0000 7fe188865640 1 -- 172.21.15.38:0/2022874327 shutdown_connections 2023-12-22T08:40:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.911+0000 7fe188865640 1 --2- 172.21.15.38:0/2022874327 >> v2:172.21.15.89:3300/0 conn(0x7fe1840d0060 0x7fe1840d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.911+0000 7fe188865640 1 --2- 172.21.15.38:0/2022874327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18415d5a0 0x7fe184070eb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.911+0000 7fe188865640 1 --2- 172.21.15.38:0/2022874327 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe18415d1c0 0x7fe184070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.911+0000 7fe188865640 1 -- 172.21.15.38:0/2022874327 >> 172.21.15.38:0/2022874327 conn(0x7fe18406bf90 msgr2=0x7fe18406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.911+0000 7fe188865640 1 -- 172.21.15.38:0/2022874327 shutdown_connections 2023-12-22T08:40:36.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.911+0000 7fe188865640 1 -- 172.21.15.38:0/2022874327 wait complete. 2023-12-22T08:40:36.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.914+0000 7fe188865640 1 Processor -- start 2023-12-22T08:40:36.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.914+0000 7fe188865640 1 -- start start 2023-12-22T08:40:36.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.915+0000 7fe188865640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1840d0060 0x7fe184154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.915+0000 7fe188865640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18415d1c0 0x7fe184143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.915+0000 7fe188865640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe18415d5a0 0x7fe184155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.915+0000 7fe188865640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe184155490 con 0x7fe18415d1c0 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.915+0000 7fe188865640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe184154880 con 0x7fe18415d5a0 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.915+0000 7fe188865640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe184154b60 con 0x7fe1840d0060 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.916+0000 7fe18259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18415d1c0 0x7fe184143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.916+0000 7fe18259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18415d1c0 0x7fe184143c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53562/0 (socket says 172.21.15.38:53562) 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.916+0000 7fe18259c640 1 -- 172.21.15.38:0/2317701950 learned_addr learned my addr 172.21.15.38:0/2317701950 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.916+0000 7fe182d9d640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1840d0060 0x7fe184154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.916+0000 7fe18359e640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe18415d5a0 0x7fe184155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.916+0000 7fe18259c640 1 -- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1840d0060 msgr2=0x7fe184154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.916+0000 7fe18259c640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1840d0060 0x7fe184154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.916+0000 7fe18259c640 1 -- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe18415d5a0 msgr2=0x7fe184155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:36.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.916+0000 7fe18259c640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe18415d5a0 0x7fe184155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.916+0000 7fe18259c640 1 -- 172.21.15.38:0/2317701950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1780094d0 con 0x7fe18415d1c0 2023-12-22T08:40:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.916+0000 7fe182d9d640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1840d0060 0x7fe184154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.917+0000 7fe18259c640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18415d1c0 0x7fe184143c70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe17802b950 tx=0x7fe1780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.917+0000 7fe16b7fe640 1 -- 172.21.15.38:0/2317701950 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17803ad30 con 0x7fe18415d1c0 2023-12-22T08:40:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.917+0000 7fe16b7fe640 1 -- 172.21.15.38:0/2317701950 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1780443f0 con 0x7fe18415d1c0 2023-12-22T08:40:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.917+0000 7fe188865640 1 -- 172.21.15.38:0/2317701950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe184154e40 con 0x7fe18415d1c0 2023-12-22T08:40:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.917+0000 7fe16b7fe640 1 -- 172.21.15.38:0/2317701950 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780447a0 con 0x7fe18415d1c0 2023-12-22T08:40:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.917+0000 7fe188865640 1 -- 172.21.15.38:0/2317701950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe184154590 con 0x7fe18415d1c0 2023-12-22T08:40:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.918+0000 7fe188865640 1 -- 172.21.15.38:0/2317701950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe184155600 con 0x7fe18415d1c0 2023-12-22T08:40:36.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.919+0000 7fe16b7fe640 1 -- 172.21.15.38:0/2317701950 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe17804d450 con 0x7fe18415d1c0 2023-12-22T08:40:36.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.921+0000 7fe16b7fe640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe17006a430 0x7fe17006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:36.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.921+0000 7fe16b7fe640 1 -- 172.21.15.38:0/2317701950 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe17802d040 con 0x7fe18415d1c0 2023-12-22T08:40:36.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.921+0000 7fe182d9d640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe17006a430 0x7fe17006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:36.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.922+0000 7fe182d9d640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe17006a430 0x7fe17006c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe174006fd0 tx=0x7fe174008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:36.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:36.925+0000 7fe16b7fe640 1 -- 172.21.15.38:0/2317701950 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe1780af070 con 0x7fe18415d1c0 2023-12-22T08:40:37.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.117+0000 7fe188865640 1 -- 172.21.15.38:0/2317701950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1840d14e0 con 0x7fe18415d1c0 2023-12-22T08:40:37.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.117+0000 7fe16b7fe640 1 -- 172.21.15.38:0/2317701950 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe178035020 con 0x7fe18415d1c0 2023-12-22T08:40:37.120 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:40:37.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.120+0000 7fe188865640 1 -- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe17006a430 msgr2=0x7fe17006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:37.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.120+0000 7fe188865640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe17006a430 0x7fe17006c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe174006fd0 tx=0x7fe174008040 comp rx=0 tx=0).stop 2023-12-22T08:40:37.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.120+0000 7fe188865640 1 -- 172.21.15.38:0/2317701950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18415d1c0 msgr2=0x7fe184143c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:37.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.120+0000 7fe188865640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18415d1c0 0x7fe184143c70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe17802b950 tx=0x7fe1780046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.120+0000 7fe188865640 1 -- 172.21.15.38:0/2317701950 shutdown_connections 2023-12-22T08:40:37.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.120+0000 7fe188865640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe18415d5a0 0x7fe184155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.120+0000 7fe188865640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe17006a430 0x7fe17006c8f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.120+0000 7fe188865640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe18415d1c0 0x7fe184143c70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.120+0000 7fe188865640 1 --2- 172.21.15.38:0/2317701950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1840d0060 0x7fe184154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.120+0000 7fe188865640 1 -- 172.21.15.38:0/2317701950 >> 172.21.15.38:0/2317701950 conn(0x7fe18406bf90 msgr2=0x7fe18415b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:37.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.120+0000 7fe188865640 1 -- 172.21.15.38:0/2317701950 shutdown_connections 2023-12-22T08:40:37.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.120+0000 7fe188865640 1 -- 172.21.15.38:0/2317701950 wait complete. 2023-12-22T08:40:37.139 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:37.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.336+0000 7f73ee12e640 1 Processor -- start 2023-12-22T08:40:37.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.336+0000 7f73ee12e640 1 -- start start 2023-12-22T08:40:37.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.337+0000 7f73ee12e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73e80cc9a0 0x7f73e806f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:37.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.337+0000 7f73ee12e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f73e815b5f0 0x7f73e80c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:37.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.337+0000 7f73ee12e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e80b1360 con 0x7f73e815b210 2023-12-22T08:40:37.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.337+0000 7f73ee12e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e815ff00 con 0x7f73e815b5f0 2023-12-22T08:40:37.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.337+0000 7f73ee12e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e815f9d0 con 0x7f73e80cc9a0 2023-12-22T08:40:37.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.338+0000 7f73e7fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f73e815b5f0 0x7f73e80c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:37.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.338+0000 7f73e7fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f73e815b5f0 0x7f73e80c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53574/0 (socket says 172.21.15.38:53574) 2023-12-22T08:40:37.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.338+0000 7f73e7fff640 1 -- 172.21.15.38:0/910091248 learned_addr learned my addr 172.21.15.38:0/910091248 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:37.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.338+0000 7f73deffd640 1 --2- 172.21.15.38:0/910091248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73e80cc9a0 0x7f73e806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:37.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.338+0000 7f73e7fff640 1 -- 172.21.15.38:0/910091248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73e80cc9a0 msgr2=0x7f73e806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:37.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.338+0000 7f73e7fff640 1 --2- 172.21.15.38:0/910091248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73e80cc9a0 0x7f73e806f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.338+0000 7f73e7fff640 1 -- 172.21.15.38:0/910091248 >> v1:172.21.15.89:6789/0 conn(0x7f73e815b210 legacy=0x7f73e80cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:37.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.338+0000 7f73e7fff640 1 -- 172.21.15.38:0/910091248 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80c7990 con 0x7f73e815b5f0 2023-12-22T08:40:37.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.339+0000 7f73e7fff640 1 --2- 172.21.15.38:0/910091248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e815b5f0 0x7f73e80c8130 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009870 tx=0x7f73e002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d240086f8b977d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:37.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.340+0000 7f73e6ffd640 1 -- 172.21.15.38:0/910091248 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0031740 con 0x7f73e815b5f0 2023-12-22T08:40:37.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.340+0000 7f73e6ffd640 1 -- 172.21.15.38:0/910091248 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e00318a0 con 0x7f73e815b5f0 2023-12-22T08:40:37.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.340+0000 7f73e6ffd640 1 -- 172.21.15.38:0/910091248 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0031c30 con 0x7f73e815b5f0 2023-12-22T08:40:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.340+0000 7f73ee12e640 1 -- 172.21.15.38:0/910091248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e815b5f0 msgr2=0x7f73e80c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.340+0000 7f73ee12e640 1 --2- 172.21.15.38:0/910091248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e815b5f0 0x7f73e80c8130 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009870 tx=0x7f73e002b7e0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.340+0000 7f73ee12e640 1 -- 172.21.15.38:0/910091248 shutdown_connections 2023-12-22T08:40:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.340+0000 7f73ee12e640 1 --2- 172.21.15.38:0/910091248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e815b5f0 0x7f73e80c8130 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.340+0000 7f73ee12e640 1 --2- 172.21.15.38:0/910091248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73e80cc9a0 0x7f73e806f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.340+0000 7f73ee12e640 1 -- 172.21.15.38:0/910091248 >> 172.21.15.38:0/910091248 conn(0x7f73e806b160 msgr2=0x7f73e80b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.340+0000 7f73ee12e640 1 -- 172.21.15.38:0/910091248 shutdown_connections 2023-12-22T08:40:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.340+0000 7f73ee12e640 1 -- 172.21.15.38:0/910091248 wait complete. 2023-12-22T08:40:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.342+0000 7f73ee12e640 1 Processor -- start 2023-12-22T08:40:37.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.342+0000 7f73ee12e640 1 -- start start 2023-12-22T08:40:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.343+0000 7f73ee12e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73e80cc9a0 0x7f73e8155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.343+0000 7f73ee12e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73e815b210 0x7f73e814e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.343+0000 7f73ee12e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e815b5f0 0x7f73e8157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.343+0000 7f73ee12e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8153620 con 0x7f73e815b5f0 2023-12-22T08:40:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.343+0000 7f73ee12e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8158250 con 0x7f73e815b210 2023-12-22T08:40:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.343+0000 7f73ee12e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8152f60 con 0x7f73e80cc9a0 2023-12-22T08:40:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.344+0000 7f73e7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e815b5f0 0x7f73e8157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.344+0000 7f73e7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e815b5f0 0x7f73e8157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53586/0 (socket says 172.21.15.38:53586) 2023-12-22T08:40:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.344+0000 7f73e7fff640 1 -- 172.21.15.38:0/296971125 learned_addr learned my addr 172.21.15.38:0/296971125 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.344+0000 7f73deffd640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73e815b210 0x7f73e814e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.344+0000 7f73e77fe640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73e80cc9a0 0x7f73e8155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.344+0000 7f73e7fff640 1 -- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73e80cc9a0 msgr2=0x7f73e8155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.344+0000 7f73e7fff640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73e80cc9a0 0x7f73e8155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.344+0000 7f73e7fff640 1 -- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73e815b210 msgr2=0x7f73e814e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.344+0000 7f73e7fff640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73e815b210 0x7f73e814e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.344+0000 7f73e7fff640 1 -- 172.21.15.38:0/296971125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e00094d0 con 0x7f73e815b5f0 2023-12-22T08:40:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.344+0000 7f73e7fff640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e815b5f0 0x7f73e8157900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73e002b820 tx=0x7f73e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.345+0000 7f73e4ff9640 1 -- 172.21.15.38:0/296971125 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0033c70 con 0x7f73e815b5f0 2023-12-22T08:40:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.345+0000 7f73e4ff9640 1 -- 172.21.15.38:0/296971125 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e0033dd0 con 0x7f73e815b5f0 2023-12-22T08:40:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.345+0000 7f73e4ff9640 1 -- 172.21.15.38:0/296971125 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e003c640 con 0x7f73e815b5f0 2023-12-22T08:40:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.345+0000 7f73ee12e640 1 -- 172.21.15.38:0/296971125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e8153240 con 0x7f73e815b5f0 2023-12-22T08:40:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.345+0000 7f73ee12e640 1 -- 172.21.15.38:0/296971125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e8158020 con 0x7f73e815b5f0 2023-12-22T08:40:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.346+0000 7f73ee12e640 1 -- 172.21.15.38:0/296971125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e8153760 con 0x7f73e815b5f0 2023-12-22T08:40:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.347+0000 7f73e4ff9640 1 -- 172.21.15.38:0/296971125 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f73e003a040 con 0x7f73e815b5f0 2023-12-22T08:40:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.348+0000 7f73e4ff9640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73c806a430 0x7f73c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.348+0000 7f73e4ff9640 1 -- 172.21.15.38:0/296971125 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73e00aa0d0 con 0x7f73e815b5f0 2023-12-22T08:40:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.348+0000 7f73e77fe640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73c806a430 0x7f73c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:37.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.349+0000 7f73e77fe640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73c806a430 0x7f73c806c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f73d8005520 tx=0x7f73d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:37.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.352+0000 7f73e4ff9640 1 -- 172.21.15.38:0/296971125 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f73e8153760 con 0x7f73e815b5f0 2023-12-22T08:40:37.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.543+0000 7f73ee12e640 1 -- 172.21.15.38:0/296971125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73e80b1360 con 0x7f73e815b5f0 2023-12-22T08:40:37.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.545+0000 7f73e4ff9640 1 -- 172.21.15.38:0/296971125 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f73e80b1360 con 0x7f73e815b5f0 2023-12-22T08:40:37.548 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:37.548 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:59.604518+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.547+0000 7f73ee12e640 1 -- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73c806a430 msgr2=0x7f73c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.547+0000 7f73ee12e640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73c806a430 0x7f73c806c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f73d8005520 tx=0x7f73d8009040 comp rx=0 tx=0).stop 2023-12-22T08:40:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.548+0000 7f73ee12e640 1 -- 172.21.15.38:0/296971125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e815b5f0 msgr2=0x7f73e8157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.548+0000 7f73ee12e640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e815b5f0 0x7f73e8157900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f73e002b820 tx=0x7f73e00046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.548+0000 7f73ee12e640 1 -- 172.21.15.38:0/296971125 shutdown_connections 2023-12-22T08:40:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.548+0000 7f73ee12e640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73c806a430 0x7f73c806c8f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.548+0000 7f73ee12e640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73e815b5f0 0x7f73e8157900 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.548+0000 7f73ee12e640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73e815b210 0x7f73e814e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.548+0000 7f73ee12e640 1 --2- 172.21.15.38:0/296971125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73e80cc9a0 0x7f73e8155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.548+0000 7f73ee12e640 1 -- 172.21.15.38:0/296971125 >> 172.21.15.38:0/296971125 conn(0x7f73e806b160 msgr2=0x7f73e815a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.548+0000 7f73ee12e640 1 -- 172.21.15.38:0/296971125 shutdown_connections 2023-12-22T08:40:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.548+0000 7f73ee12e640 1 -- 172.21.15.38:0/296971125 wait complete. 2023-12-22T08:40:37.569 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:39:56.873963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:39:57.616447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:37.569 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:37.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.788+0000 7f0c67fff640 1 Processor -- start 2023-12-22T08:40:37.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.789+0000 7f0c67fff640 1 -- start start 2023-12-22T08:40:37.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.791+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c6815d1c0 0x7f0c68070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:37.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.791+0000 7f0c67fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0c680d0770 0x7f0c68070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:37.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.791+0000 7f0c67fff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6815de50 con 0x7f0c6815d5a0 2023-12-22T08:40:37.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.791+0000 7f0c67fff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c680d0be0 con 0x7f0c680d0770 2023-12-22T08:40:37.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.791+0000 7f0c67fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680d0dd0 con 0x7f0c6815d1c0 2023-12-22T08:40:37.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.791+0000 7f0c677fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0c680d0770 0x7f0c68070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:37.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.791+0000 7f0c677fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0c680d0770 0x7f0c68070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53602/0 (socket says 172.21.15.38:53602) 2023-12-22T08:40:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.791+0000 7f0c677fe640 1 -- 172.21.15.38:0/1061387645 learned_addr learned my addr 172.21.15.38:0/1061387645 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.792+0000 7f0c66ffd640 1 --2- 172.21.15.38:0/1061387645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c6815d1c0 0x7f0c68070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.792+0000 7f0c677fe640 1 -- 172.21.15.38:0/1061387645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c6815d1c0 msgr2=0x7f0c68070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.792+0000 7f0c677fe640 1 --2- 172.21.15.38:0/1061387645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c6815d1c0 0x7f0c68070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.792+0000 7f0c677fe640 1 -- 172.21.15.38:0/1061387645 >> v1:172.21.15.89:6789/0 conn(0x7f0c6815d5a0 legacy=0x7f0c680d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.792+0000 7f0c677fe640 1 -- 172.21.15.38:0/1061387645 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680d10b0 con 0x7f0c680d0770 2023-12-22T08:40:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.792+0000 7f0c66ffd640 1 --2- 172.21.15.38:0/1061387645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c6815d1c0 0x7f0c68070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:37.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.793+0000 7f0c677fe640 1 --2- 172.21.15.38:0/1061387645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680d0770 0x7f0c68070eb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009e50 tx=0x7f0c6002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d763a0a13e02809c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:37.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.794+0000 7f0c667fc640 1 -- 172.21.15.38:0/1061387645 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6002ca70 con 0x7f0c680d0770 2023-12-22T08:40:37.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.794+0000 7f0c667fc640 1 -- 172.21.15.38:0/1061387645 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6002cbd0 con 0x7f0c680d0770 2023-12-22T08:40:37.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.794+0000 7f0c667fc640 1 -- 172.21.15.38:0/1061387645 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c600343f0 con 0x7f0c680d0770 2023-12-22T08:40:37.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.794+0000 7f0c67fff640 1 -- 172.21.15.38:0/1061387645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680d0770 msgr2=0x7f0c68070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:37.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.794+0000 7f0c67fff640 1 --2- 172.21.15.38:0/1061387645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680d0770 0x7f0c68070eb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009e50 tx=0x7f0c6002bed0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.794+0000 7f0c67fff640 1 -- 172.21.15.38:0/1061387645 shutdown_connections 2023-12-22T08:40:37.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.794+0000 7f0c67fff640 1 --2- 172.21.15.38:0/1061387645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680d0770 0x7f0c68070eb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.794+0000 7f0c67fff640 1 --2- 172.21.15.38:0/1061387645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c6815d1c0 0x7f0c68070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.794+0000 7f0c67fff640 1 -- 172.21.15.38:0/1061387645 >> 172.21.15.38:0/1061387645 conn(0x7f0c6806bf90 msgr2=0x7f0c6806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:37.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.795+0000 7f0c67fff640 1 -- 172.21.15.38:0/1061387645 shutdown_connections 2023-12-22T08:40:37.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.795+0000 7f0c67fff640 1 -- 172.21.15.38:0/1061387645 wait complete. 2023-12-22T08:40:37.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.796+0000 7f0c67fff640 1 Processor -- start 2023-12-22T08:40:37.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.796+0000 7f0c67fff640 1 -- start start 2023-12-22T08:40:37.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.797+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680d0770 0x7f0c681595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:37.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.797+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c6815d1c0 0x7f0c681f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:37.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.797+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c6815d5a0 0x7f0c6815f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:37.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.797+0000 7f0c67fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680b6ab0 con 0x7f0c680d0770 2023-12-22T08:40:37.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.797+0000 7f0c67fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680b7030 con 0x7f0c6815d5a0 2023-12-22T08:40:37.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.798+0000 7f0c67fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680b7310 con 0x7f0c6815d1c0 2023-12-22T08:40:37.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.798+0000 7f0c66ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680d0770 0x7f0c681595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:37.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.798+0000 7f0c66ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680d0770 0x7f0c681595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53612/0 (socket says 172.21.15.38:53612) 2023-12-22T08:40:37.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.798+0000 7f0c66ffd640 1 -- 172.21.15.38:0/3690337318 learned_addr learned my addr 172.21.15.38:0/3690337318 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:37.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.798+0000 7f0c677fe640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c6815d5a0 0x7f0c6815f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:37.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.798+0000 7f0c5ffff640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c6815d1c0 0x7f0c681f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:37.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.798+0000 7f0c66ffd640 1 -- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c6815d1c0 msgr2=0x7f0c681f4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:37.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.798+0000 7f0c66ffd640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c6815d1c0 0x7f0c681f4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.798+0000 7f0c66ffd640 1 -- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c6815d5a0 msgr2=0x7f0c6815f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:37.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.798+0000 7f0c66ffd640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c6815d5a0 0x7f0c6815f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:37.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.798+0000 7f0c66ffd640 1 -- 172.21.15.38:0/3690337318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c60009b30 con 0x7f0c680d0770 2023-12-22T08:40:37.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.799+0000 7f0c66ffd640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680d0770 0x7f0c681595b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800c7f0 tx=0x7f0c5800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:37.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.799+0000 7f0c5f7fe640 1 -- 172.21.15.38:0/3690337318 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58007a30 con 0x7f0c680d0770 2023-12-22T08:40:37.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.799+0000 7f0c5f7fe640 1 -- 172.21.15.38:0/3690337318 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c58007b90 con 0x7f0c680d0770 2023-12-22T08:40:37.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.799+0000 7f0c5f7fe640 1 -- 172.21.15.38:0/3690337318 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5800ce40 con 0x7f0c680d0770 2023-12-22T08:40:37.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.799+0000 7f0c67fff640 1 -- 172.21.15.38:0/3690337318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c680b75f0 con 0x7f0c680d0770 2023-12-22T08:40:37.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.799+0000 7f0c67fff640 1 -- 172.21.15.38:0/3690337318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6815fef0 con 0x7f0c680d0770 2023-12-22T08:40:37.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.800+0000 7f0c67fff640 1 -- 172.21.15.38:0/3690337318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c680b7b10 con 0x7f0c680d0770 2023-12-22T08:40:37.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.801+0000 7f0c5f7fe640 1 -- 172.21.15.38:0/3690337318 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0c580113f0 con 0x7f0c680d0770 2023-12-22T08:40:37.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.802+0000 7f0c5f7fe640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0c4806a430 0x7f0c4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:37.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.802+0000 7f0c5f7fe640 1 -- 172.21.15.38:0/3690337318 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c58088be0 con 0x7f0c680d0770 2023-12-22T08:40:37.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.803+0000 7f0c5ffff640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0c4806a430 0x7f0c4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:37.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.804+0000 7f0c5ffff640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0c4806a430 0x7f0c4806c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0c6815be50 tx=0x7f0c50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:37.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.806+0000 7f0c5f7fe640 1 -- 172.21.15.38:0/3690337318 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0c680b7b10 con 0x7f0c680d0770 2023-12-22T08:40:38.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:37.999+0000 7f0c67fff640 1 -- 172.21.15.38:0/3690337318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c680b7b10 con 0x7f0c680d0770 2023-12-22T08:40:38.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.000+0000 7f0c5f7fe640 1 -- 172.21.15.38:0/3690337318 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c680b7b10 con 0x7f0c680d0770 2023-12-22T08:40:38.003 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:40:38.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.002+0000 7f0c67fff640 1 -- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0c4806a430 msgr2=0x7f0c4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.002+0000 7f0c67fff640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0c4806a430 0x7f0c4806c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0c6815be50 tx=0x7f0c50008040 comp rx=0 tx=0).stop 2023-12-22T08:40:38.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.002+0000 7f0c67fff640 1 -- 172.21.15.38:0/3690337318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680d0770 msgr2=0x7f0c681595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.002+0000 7f0c67fff640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680d0770 0x7f0c681595b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800c7f0 tx=0x7f0c5800cbf0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.003+0000 7f0c67fff640 1 -- 172.21.15.38:0/3690337318 shutdown_connections 2023-12-22T08:40:38.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.003+0000 7f0c67fff640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c6815d5a0 0x7f0c6815f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.003+0000 7f0c67fff640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c6815d1c0 0x7f0c681f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.003+0000 7f0c67fff640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0c4806a430 0x7f0c4806c8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.003+0000 7f0c67fff640 1 --2- 172.21.15.38:0/3690337318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c680d0770 0x7f0c681595b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.003+0000 7f0c67fff640 1 -- 172.21.15.38:0/3690337318 >> 172.21.15.38:0/3690337318 conn(0x7f0c6806bf90 msgr2=0x7f0c6815b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:38.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.003+0000 7f0c67fff640 1 -- 172.21.15.38:0/3690337318 shutdown_connections 2023-12-22T08:40:38.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.003+0000 7f0c67fff640 1 -- 172.21.15.38:0/3690337318 wait complete. 2023-12-22T08:40:38.024 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:38.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.239+0000 7f3134c65640 1 Processor -- start 2023-12-22T08:40:38.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.239+0000 7f3134c65640 1 -- start start 2023-12-22T08:40:38.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.241+0000 7f3134c65640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3130143820 0x7f31300cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.241+0000 7f3134c65640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31300b28c0 0x7f313006ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.241+0000 7f3134c65640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313015dbc0 con 0x7f31300cc920 2023-12-22T08:40:38.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.241+0000 7f3134c65640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f313015de80 con 0x7f3130143820 2023-12-22T08:40:38.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.241+0000 7f3134c65640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313015e160 con 0x7f31300b28c0 2023-12-22T08:40:38.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.242+0000 7f312f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3130143820 0x7f31300cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:38.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.242+0000 7f312ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31300b28c0 0x7f313006ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:38.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.242+0000 7f312f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3130143820 0x7f31300cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:56554/0 (socket says 172.21.15.38:56554) 2023-12-22T08:40:38.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.242+0000 7f312f7fe640 1 -- 172.21.15.38:0/2789892611 learned_addr learned my addr 172.21.15.38:0/2789892611 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:38.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.243+0000 7f312ffff640 1 -- 172.21.15.38:0/2789892611 >> v2:172.21.15.89:3300/0 conn(0x7f3130143820 msgr2=0x7f31300cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:38.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.243+0000 7f312ffff640 1 --2- 172.21.15.38:0/2789892611 >> v2:172.21.15.89:3300/0 conn(0x7f3130143820 0x7f31300cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.243+0000 7f312ffff640 1 -- 172.21.15.38:0/2789892611 >> v1:172.21.15.89:6789/0 conn(0x7f31300cc920 legacy=0x7f31300b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.243+0000 7f312ffff640 1 -- 172.21.15.38:0/2789892611 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313015e440 con 0x7f31300b28c0 2023-12-22T08:40:38.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.243+0000 7f312f7fe640 1 --2- 172.21.15.38:0/2789892611 >> v2:172.21.15.89:3300/0 conn(0x7f3130143820 0x7f31300cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:38.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.244+0000 7f312ffff640 1 --2- 172.21.15.38:0/2789892611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31300b28c0 0x7f313006ffe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3128009d90 tx=0x7f312802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f95ba44af993b098 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:38.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.244+0000 7f312e7fc640 1 -- 172.21.15.38:0/2789892611 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312802cc60 con 0x7f31300b28c0 2023-12-22T08:40:38.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.245+0000 7f312e7fc640 1 -- 172.21.15.38:0/2789892611 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312802cdc0 con 0x7f31300b28c0 2023-12-22T08:40:38.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.245+0000 7f312e7fc640 1 -- 172.21.15.38:0/2789892611 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128034660 con 0x7f31300b28c0 2023-12-22T08:40:38.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.245+0000 7f3134c65640 1 -- 172.21.15.38:0/2789892611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31300b28c0 msgr2=0x7f313006ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.245+0000 7f3134c65640 1 --2- 172.21.15.38:0/2789892611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31300b28c0 0x7f313006ffe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3128009d90 tx=0x7f312802beb0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.245+0000 7f3134c65640 1 -- 172.21.15.38:0/2789892611 shutdown_connections 2023-12-22T08:40:38.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.245+0000 7f3134c65640 1 --2- 172.21.15.38:0/2789892611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31300b28c0 0x7f313006ffe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.245+0000 7f3134c65640 1 --2- 172.21.15.38:0/2789892611 >> v2:172.21.15.89:3300/0 conn(0x7f3130143820 0x7f31300cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.245+0000 7f3134c65640 1 -- 172.21.15.38:0/2789892611 >> 172.21.15.38:0/2789892611 conn(0x7f31300b0c40 msgr2=0x7f31300b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:38.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.245+0000 7f3134c65640 1 -- 172.21.15.38:0/2789892611 shutdown_connections 2023-12-22T08:40:38.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.245+0000 7f3134c65640 1 -- 172.21.15.38:0/2789892611 wait complete. 2023-12-22T08:40:38.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.247+0000 7f3134c65640 1 Processor -- start 2023-12-22T08:40:38.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.247+0000 7f3134c65640 1 -- start start 2023-12-22T08:40:38.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.248+0000 7f3134c65640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31300b28c0 0x7f3130156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.248+0000 7f3134c65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31300cc920 0x7f313013a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.248+0000 7f3134c65640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3130143820 0x7f313013acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.248+0000 7f3134c65640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313013cbd0 con 0x7f3130143820 2023-12-22T08:40:38.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.248+0000 7f3134c65640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31301f1910 con 0x7f31300cc920 2023-12-22T08:40:38.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.248+0000 7f3134c65640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3130156fb0 con 0x7f31300b28c0 2023-12-22T08:40:38.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.249+0000 7f312ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3130143820 0x7f313013acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:38.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.249+0000 7f312ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3130143820 0x7f313013acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53616/0 (socket says 172.21.15.38:53616) 2023-12-22T08:40:38.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.249+0000 7f312ffff640 1 -- 172.21.15.38:0/1531127618 learned_addr learned my addr 172.21.15.38:0/1531127618 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:38.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.249+0000 7f312effd640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31300cc920 0x7f313013a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:38.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.249+0000 7f312f7fe640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31300b28c0 0x7f3130156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:38.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.249+0000 7f312ffff640 1 -- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31300b28c0 msgr2=0x7f3130156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.249+0000 7f312ffff640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31300b28c0 0x7f3130156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.249+0000 7f312ffff640 1 -- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31300cc920 msgr2=0x7f313013a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.249+0000 7f312ffff640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31300cc920 0x7f313013a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.249+0000 7f312ffff640 1 -- 172.21.15.38:0/1531127618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31200094d0 con 0x7f3130143820 2023-12-22T08:40:38.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.250+0000 7f312ffff640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3130143820 0x7f313013acd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3128009eb0 tx=0x7f3128004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:38.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.250+0000 7f3117fff640 1 -- 172.21.15.38:0/1531127618 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312803e610 con 0x7f3130143820 2023-12-22T08:40:38.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.250+0000 7f3117fff640 1 -- 172.21.15.38:0/1531127618 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312803e770 con 0x7f3130143820 2023-12-22T08:40:38.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.250+0000 7f3134c65640 1 -- 172.21.15.38:0/1531127618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3128009a70 con 0x7f3130143820 2023-12-22T08:40:38.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.250+0000 7f3117fff640 1 -- 172.21.15.38:0/1531127618 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312803eb20 con 0x7f3130143820 2023-12-22T08:40:38.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.250+0000 7f3134c65640 1 -- 172.21.15.38:0/1531127618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313013c510 con 0x7f3130143820 2023-12-22T08:40:38.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.251+0000 7f3134c65640 1 -- 172.21.15.38:0/1531127618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f313013cd10 con 0x7f3130143820 2023-12-22T08:40:38.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.252+0000 7f3117fff640 1 -- 172.21.15.38:0/1531127618 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f312803b050 con 0x7f3130143820 2023-12-22T08:40:38.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.253+0000 7f3117fff640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f311c06a430 0x7f311c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.253+0000 7f3117fff640 1 -- 172.21.15.38:0/1531127618 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31280aab70 con 0x7f3130143820 2023-12-22T08:40:38.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.254+0000 7f312f7fe640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f311c06a430 0x7f311c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:38.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.255+0000 7f312f7fe640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f311c06a430 0x7f311c06c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f31301594f0 tx=0x7f3120008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:38.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.258+0000 7f3117fff640 1 -- 172.21.15.38:0/1531127618 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f313013cd10 con 0x7f3130143820 2023-12-22T08:40:38.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.452+0000 7f3134c65640 1 -- 172.21.15.38:0/1531127618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f313013cd10 con 0x7f3130143820 2023-12-22T08:40:38.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.453+0000 7f3117fff640 1 -- 172.21.15.38:0/1531127618 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3128039020 con 0x7f3130143820 2023-12-22T08:40:38.455 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:40:38.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.455+0000 7f3134c65640 1 -- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f311c06a430 msgr2=0x7f311c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.455+0000 7f3134c65640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f311c06a430 0x7f311c06c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f31301594f0 tx=0x7f3120008040 comp rx=0 tx=0).stop 2023-12-22T08:40:38.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.455+0000 7f3134c65640 1 -- 172.21.15.38:0/1531127618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3130143820 msgr2=0x7f313013acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.455+0000 7f3134c65640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3130143820 0x7f313013acd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3128009eb0 tx=0x7f3128004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.455+0000 7f3134c65640 1 -- 172.21.15.38:0/1531127618 shutdown_connections 2023-12-22T08:40:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.455+0000 7f3134c65640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f311c06a430 0x7f311c06c8f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.455+0000 7f3134c65640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3130143820 0x7f313013acd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.455+0000 7f3134c65640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31300cc920 0x7f313013a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.455+0000 7f3134c65640 1 --2- 172.21.15.38:0/1531127618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31300b28c0 0x7f3130156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.455+0000 7f3134c65640 1 -- 172.21.15.38:0/1531127618 >> 172.21.15.38:0/1531127618 conn(0x7f31300b0c40 msgr2=0x7f313006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.456+0000 7f3134c65640 1 -- 172.21.15.38:0/1531127618 shutdown_connections 2023-12-22T08:40:38.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.456+0000 7f3134c65640 1 -- 172.21.15.38:0/1531127618 wait complete. 2023-12-22T08:40:38.477 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:38.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.708+0000 7f2aca6c0640 1 Processor -- start 2023-12-22T08:40:38.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.709+0000 7f2aca6c0640 1 -- start start 2023-12-22T08:40:38.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.710+0000 7f2aca6c0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2ac415a370 0x7f2ac4071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.711+0000 7f2aca6c0640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac40cd080 con 0x7f2ac415b3c0 2023-12-22T08:40:38.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.711+0000 7f2aca6c0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac4070070 con 0x7f2ac406c260 2023-12-22T08:40:38.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.711+0000 7f2aca6c0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac415b940 con 0x7f2ac415a370 2023-12-22T08:40:38.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.711+0000 7f2abb7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2ac415b3c0 0x7f2ac406f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44834/0 (socket says 172.21.15.38:44834) 2023-12-22T08:40:38.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.711+0000 7f2abb7fe640 1 -- 172.21.15.38:0/2201671310 learned_addr learned my addr 172.21.15.38:0/2201671310 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:38.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.711+0000 7f2ac3fff640 1 --2- 172.21.15.38:0/2201671310 >> v2:172.21.15.89:3300/0 conn(0x7f2ac415a370 0x7f2ac4071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:38.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.711+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215914668 0 0) 0x7f2ac40cd080 con 0x7f2ac415b3c0 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.711+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab0003520 con 0x7f2ac415b3c0 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3425636457 0 0) 0x7f2ab0003520 con 0x7f2ac415b3c0 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 >> v2:172.21.15.89:3300/0 conn(0x7f2ac415a370 msgr2=0x7f2ac4071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2ac37fe640 1 --2- 172.21.15.38:0/2201671310 >> v2:172.21.15.89:3300/0 conn(0x7f2ac415a370 0x7f2ac4071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 >> v1:172.21.15.89:6789/0 conn(0x7f2ac406c260 legacy=0x7f2ac406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac40cd320 con 0x7f2ac415b3c0 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f2aac001670 con 0x7f2ac415b3c0 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 >> v1:172.21.15.38:6789/0 conn(0x7f2ac415b3c0 legacy=0x7f2ac406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2ac37fe640 1 --2- 172.21.15.38:0/2201671310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab0003970 0x7f2ab0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2ac37fe640 1 --2- 172.21.15.38:0/2201671310 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ab00047c0 0x7f2ab0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2ac37fe640 1 --2- 172.21.15.38:0/2201671310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ab0005180 0x7f2ab000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac415b940 con 0x7f2ab00047c0 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab000c120 con 0x7f2ab0003970 2023-12-22T08:40:38.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab000c2e0 con 0x7f2ab0005180 2023-12-22T08:40:38.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.712+0000 7f2abb7fe640 1 --2- 172.21.15.38:0/2201671310 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ab00047c0 0x7f2ab0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:38.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.713+0000 7f2ac3fff640 1 --2- 172.21.15.38:0/2201671310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab0003970 0x7f2ab0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:38.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.713+0000 7f2abb7fe640 1 -- 172.21.15.38:0/2201671310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ab0005180 msgr2=0x7f2ab000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:38.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.713+0000 7f2abb7fe640 1 --2- 172.21.15.38:0/2201671310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ab0005180 0x7f2ab000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.713+0000 7f2abb7fe640 1 -- 172.21.15.38:0/2201671310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab0003970 msgr2=0x7f2ab0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:38.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.713+0000 7f2abb7fe640 1 --2- 172.21.15.38:0/2201671310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab0003970 0x7f2ab0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.713+0000 7f2ac8c5d640 1 -- 172.21.15.38:0/2201671310 reap_dead start 2023-12-22T08:40:38.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.713+0000 7f2abb7fe640 1 -- 172.21.15.38:0/2201671310 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0003520 con 0x7f2ab00047c0 2023-12-22T08:40:38.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.714+0000 7f2abb7fe640 1 --2- 172.21.15.38:0/2201671310 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ab00047c0 0x7f2ab0004c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c210 tx=0x7f2ab00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0dca2d8a730e43 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:38.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.714+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac005ad0 con 0x7f2ab00047c0 2023-12-22T08:40:38.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.714+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac005c30 con 0x7f2ab00047c0 2023-12-22T08:40:38.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.714+0000 7f2ac37fe640 1 -- 172.21.15.38:0/2201671310 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac02cad0 con 0x7f2ab00047c0 2023-12-22T08:40:38.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.715+0000 7f2aca6c0640 1 -- 172.21.15.38:0/2201671310 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ab00047c0 msgr2=0x7f2ab0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.715+0000 7f2aca6c0640 1 --2- 172.21.15.38:0/2201671310 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ab00047c0 0x7f2ab0004c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c210 tx=0x7f2ab00057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.715+0000 7f2aca6c0640 1 -- 172.21.15.38:0/2201671310 shutdown_connections 2023-12-22T08:40:38.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.715+0000 7f2aca6c0640 1 --2- 172.21.15.38:0/2201671310 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ab00047c0 0x7f2ab0004c40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.715+0000 7f2aca6c0640 1 -- 172.21.15.38:0/2201671310 >> 172.21.15.38:0/2201671310 conn(0x7f2ac40b20c0 msgr2=0x7f2ac40b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:38.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.715+0000 7f2aca6c0640 1 -- 172.21.15.38:0/2201671310 shutdown_connections 2023-12-22T08:40:38.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.715+0000 7f2aca6c0640 1 -- 172.21.15.38:0/2201671310 wait complete. 2023-12-22T08:40:38.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.717+0000 7f2aca6c0640 1 Processor -- start 2023-12-22T08:40:38.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.717+0000 7f2aca6c0640 1 -- start start 2023-12-22T08:40:38.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.718+0000 7f2aca6c0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab00047c0 0x7f2ac41f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.718+0000 7f2aca6c0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ac41f3a80 0x7f2ac4154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.718+0000 7f2aca6c0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ac4155180 0x7f2ac4158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.718+0000 7f2aca6c0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac4155600 con 0x7f2ac4155180 2023-12-22T08:40:38.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.718+0000 7f2aca6c0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac41544d0 con 0x7f2ab00047c0 2023-12-22T08:40:38.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.718+0000 7f2aca6c0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac41538c0 con 0x7f2ac41f3a80 2023-12-22T08:40:38.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.718+0000 7f2ac8c5d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ac4155180 0x7f2ac4158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:38.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.718+0000 7f2ac8c5d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ac4155180 0x7f2ac4158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53632/0 (socket says 172.21.15.38:53632) 2023-12-22T08:40:38.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.718+0000 7f2ac8c5d640 1 -- 172.21.15.38:0/626859358 learned_addr learned my addr 172.21.15.38:0/626859358 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:38.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.719+0000 7f2ac3fff640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab00047c0 0x7f2ac41f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:38.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.719+0000 7f2abb7fe640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ac41f3a80 0x7f2ac4154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:38.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.719+0000 7f2ac8c5d640 1 -- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ac41f3a80 msgr2=0x7f2ac4154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.719+0000 7f2ac8c5d640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ac41f3a80 0x7f2ac4154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.719+0000 7f2ac8c5d640 1 -- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab00047c0 msgr2=0x7f2ac41f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.719+0000 7f2ac8c5d640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab00047c0 0x7f2ac41f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.719+0000 7f2ac8c5d640 1 -- 172.21.15.38:0/626859358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac4153ba0 con 0x7f2ac4155180 2023-12-22T08:40:38.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.719+0000 7f2ac3fff640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab00047c0 0x7f2ac41f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:38.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.719+0000 7f2ac8c5d640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ac4155180 0x7f2ac4158910 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2ac406a5a0 tx=0x7f2abc00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:38.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.719+0000 7f2ac17fa640 1 -- 172.21.15.38:0/626859358 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc0074e0 con 0x7f2ac4155180 2023-12-22T08:40:38.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.719+0000 7f2ac17fa640 1 -- 172.21.15.38:0/626859358 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc007660 con 0x7f2ac4155180 2023-12-22T08:40:38.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.719+0000 7f2ac17fa640 1 -- 172.21.15.38:0/626859358 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc005a00 con 0x7f2ac4155180 2023-12-22T08:40:38.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.720+0000 7f2aca6c0640 1 -- 172.21.15.38:0/626859358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac4153e80 con 0x7f2ac4155180 2023-12-22T08:40:38.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.720+0000 7f2aca6c0640 1 -- 172.21.15.38:0/626859358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac4154960 con 0x7f2ac4155180 2023-12-22T08:40:38.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.721+0000 7f2aca6c0640 1 -- 172.21.15.38:0/626859358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac4061910 con 0x7f2ac4155180 2023-12-22T08:40:38.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.722+0000 7f2ac17fa640 1 -- 172.21.15.38:0/626859358 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2abc005b60 con 0x7f2ac4155180 2023-12-22T08:40:38.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.723+0000 7f2ac17fa640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2aa406a430 0x7f2aa406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:38.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.723+0000 7f2ac17fa640 1 -- 172.21.15.38:0/626859358 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2abc087650 con 0x7f2ac4155180 2023-12-22T08:40:38.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.723+0000 7f2ac3fff640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2aa406a430 0x7f2aa406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:38.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.724+0000 7f2ac3fff640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2aa406a430 0x7f2aa406c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2ac404f860 tx=0x7f2ab400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:38.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.727+0000 7f2ac17fa640 1 -- 172.21.15.38:0/626859358 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2abc052ba0 con 0x7f2ac4155180 2023-12-22T08:40:38.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.918+0000 7f2aca6c0640 1 -- 172.21.15.38:0/626859358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ac40cc8d0 con 0x7f2ac4155180 2023-12-22T08:40:38.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.920+0000 7f2ac17fa640 1 -- 172.21.15.38:0/626859358 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2abc00cea0 con 0x7f2ac4155180 2023-12-22T08:40:38.922 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:40:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.922+0000 7f2aca6c0640 1 -- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2aa406a430 msgr2=0x7f2aa406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.922+0000 7f2aca6c0640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2aa406a430 0x7f2aa406c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2ac404f860 tx=0x7f2ab400b040 comp rx=0 tx=0).stop 2023-12-22T08:40:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.922+0000 7f2aca6c0640 1 -- 172.21.15.38:0/626859358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ac4155180 msgr2=0x7f2ac4158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.922+0000 7f2aca6c0640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ac4155180 0x7f2ac4158910 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2ac406a5a0 tx=0x7f2abc00c820 comp rx=0 tx=0).stop 2023-12-22T08:40:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.922+0000 7f2aca6c0640 1 -- 172.21.15.38:0/626859358 shutdown_connections 2023-12-22T08:40:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.922+0000 7f2aca6c0640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2aa406a430 0x7f2aa406c8f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.922+0000 7f2aca6c0640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ac4155180 0x7f2ac4158910 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.922+0000 7f2aca6c0640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ac41f3a80 0x7f2ac4154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.922+0000 7f2aca6c0640 1 --2- 172.21.15.38:0/626859358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ab00047c0 0x7f2ac41f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:38.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.922+0000 7f2aca6c0640 1 -- 172.21.15.38:0/626859358 >> 172.21.15.38:0/626859358 conn(0x7f2ac40b20c0 msgr2=0x7f2ac415a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:38.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.922+0000 7f2aca6c0640 1 -- 172.21.15.38:0/626859358 shutdown_connections 2023-12-22T08:40:38.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:38.922+0000 7f2aca6c0640 1 -- 172.21.15.38:0/626859358 wait complete. 2023-12-22T08:40:38.945 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:39.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.162+0000 7f3f261b5640 1 Processor -- start 2023-12-22T08:40:39.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.162+0000 7f3f261b5640 1 -- start start 2023-12-22T08:40:39.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.164+0000 7f3f261b5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3f200cb4c0 0x7f3f2015e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.164+0000 7f3f261b5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3f2006d5f0 0x7f3f20070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.164+0000 7f3f261b5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f200706d0 con 0x7f3f2006d210 2023-12-22T08:40:39.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.164+0000 7f3f261b5640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f200cbf40 con 0x7f3f2006d5f0 2023-12-22T08:40:39.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.164+0000 7f3f261b5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f200ce840 con 0x7f3f200cb4c0 2023-12-22T08:40:39.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.164+0000 7f3f259b4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3f2006d5f0 0x7f3f20070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.165+0000 7f3f259b4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3f2006d5f0 0x7f3f20070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53640/0 (socket says 172.21.15.38:53640) 2023-12-22T08:40:39.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.165+0000 7f3f259b4640 1 -- 172.21.15.38:0/2849455179 learned_addr learned my addr 172.21.15.38:0/2849455179 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:39.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.165+0000 7f3f249b2640 1 --2- 172.21.15.38:0/2849455179 >> v2:172.21.15.89:3300/0 conn(0x7f3f200cb4c0 0x7f3f2015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.165+0000 7f3f259b4640 1 -- 172.21.15.38:0/2849455179 >> v2:172.21.15.89:3300/0 conn(0x7f3f200cb4c0 msgr2=0x7f3f2015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:39.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.165+0000 7f3f259b4640 1 --2- 172.21.15.38:0/2849455179 >> v2:172.21.15.89:3300/0 conn(0x7f3f200cb4c0 0x7f3f2015e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.165+0000 7f3f259b4640 1 -- 172.21.15.38:0/2849455179 >> v1:172.21.15.89:6789/0 conn(0x7f3f2006d210 legacy=0x7f3f20159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:39.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.165+0000 7f3f259b4640 1 -- 172.21.15.38:0/2849455179 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f200ceb20 con 0x7f3f2006d5f0 2023-12-22T08:40:39.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.166+0000 7f3f259b4640 1 --2- 172.21.15.38:0/2849455179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f2006d5f0 0x7f3f20070b60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f200a4590 tx=0x7f3f1802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67414ec5c43187bf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.167+0000 7f3f17fff640 1 -- 172.21.15.38:0/2849455179 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1802ca80 con 0x7f3f2006d5f0 2023-12-22T08:40:39.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.167+0000 7f3f17fff640 1 -- 172.21.15.38:0/2849455179 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1802cbe0 con 0x7f3f2006d5f0 2023-12-22T08:40:39.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.167+0000 7f3f17fff640 1 -- 172.21.15.38:0/2849455179 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180343f0 con 0x7f3f2006d5f0 2023-12-22T08:40:39.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.167+0000 7f3f261b5640 1 -- 172.21.15.38:0/2849455179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f2006d5f0 msgr2=0x7f3f20070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.167+0000 7f3f261b5640 1 --2- 172.21.15.38:0/2849455179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f2006d5f0 0x7f3f20070b60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f200a4590 tx=0x7f3f1802bee0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.167+0000 7f3f261b5640 1 -- 172.21.15.38:0/2849455179 shutdown_connections 2023-12-22T08:40:39.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.167+0000 7f3f261b5640 1 --2- 172.21.15.38:0/2849455179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f2006d5f0 0x7f3f20070b60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.167+0000 7f3f261b5640 1 --2- 172.21.15.38:0/2849455179 >> v2:172.21.15.89:3300/0 conn(0x7f3f200cb4c0 0x7f3f2015e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.167+0000 7f3f261b5640 1 -- 172.21.15.38:0/2849455179 >> 172.21.15.38:0/2849455179 conn(0x7f3f200b1f70 msgr2=0x7f3f200b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:39.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.167+0000 7f3f261b5640 1 -- 172.21.15.38:0/2849455179 shutdown_connections 2023-12-22T08:40:39.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.167+0000 7f3f261b5640 1 -- 172.21.15.38:0/2849455179 wait complete. 2023-12-22T08:40:39.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.169+0000 7f3f261b5640 1 Processor -- start 2023-12-22T08:40:39.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.169+0000 7f3f261b5640 1 -- start start 2023-12-22T08:40:39.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.170+0000 7f3f261b5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f2006d210 0x7f3f201451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.170+0000 7f3f261b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f2006d5f0 0x7f3f2015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.170+0000 7f3f261b5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f200cb4c0 0x7f3f2015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.170+0000 7f3f261b5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2015c600 con 0x7f3f200cb4c0 2023-12-22T08:40:39.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.170+0000 7f3f261b5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f201f1d80 con 0x7f3f2006d5f0 2023-12-22T08:40:39.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.170+0000 7f3f261b5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f20145720 con 0x7f3f2006d210 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.170+0000 7f3f259b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f200cb4c0 0x7f3f2015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.170+0000 7f3f259b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f200cb4c0 0x7f3f2015bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53652/0 (socket says 172.21.15.38:53652) 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.170+0000 7f3f259b4640 1 -- 172.21.15.38:0/2833312243 learned_addr learned my addr 172.21.15.38:0/2833312243 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.171+0000 7f3f259b4640 1 -- 172.21.15.38:0/2833312243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f2006d210 msgr2=0x7f3f201451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.171+0000 7f3f259b4640 1 --2- 172.21.15.38:0/2833312243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f2006d210 0x7f3f201451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.171+0000 7f3f259b4640 1 -- 172.21.15.38:0/2833312243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f2006d5f0 msgr2=0x7f3f2015b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.171+0000 7f3f259b4640 1 --2- 172.21.15.38:0/2833312243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f2006d5f0 0x7f3f2015b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.171+0000 7f3f259b4640 1 -- 172.21.15.38:0/2833312243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18009b30 con 0x7f3f200cb4c0 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.171+0000 7f3f259b4640 1 --2- 172.21.15.38:0/2833312243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f200cb4c0 0x7f3f2015bbd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009f40 tx=0x7f3f18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.171+0000 7f3f15ffb640 1 -- 172.21.15.38:0/2833312243 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18009510 con 0x7f3f200cb4c0 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.171+0000 7f3f15ffb640 1 -- 172.21.15.38:0/2833312243 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1803e450 con 0x7f3f200cb4c0 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.171+0000 7f3f15ffb640 1 -- 172.21.15.38:0/2833312243 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1803e800 con 0x7f3f200cb4c0 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.171+0000 7f3f261b5640 1 -- 172.21.15.38:0/2833312243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f201f1450 con 0x7f3f200cb4c0 2023-12-22T08:40:39.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.172+0000 7f3f261b5640 1 -- 172.21.15.38:0/2833312243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f201f1a10 con 0x7f3f200cb4c0 2023-12-22T08:40:39.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.173+0000 7f3f261b5640 1 -- 172.21.15.38:0/2833312243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f20061910 con 0x7f3f200cb4c0 2023-12-22T08:40:39.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.174+0000 7f3f15ffb640 1 -- 172.21.15.38:0/2833312243 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f1802cd50 con 0x7f3f200cb4c0 2023-12-22T08:40:39.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.175+0000 7f3f15ffb640 1 --2- 172.21.15.38:0/2833312243 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3f0406a430 0x7f3f0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.175+0000 7f3f15ffb640 1 -- 172.21.15.38:0/2833312243 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f180ab4f0 con 0x7f3f200cb4c0 2023-12-22T08:40:39.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.175+0000 7f3f251b3640 1 --2- 172.21.15.38:0/2833312243 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3f0406a430 0x7f3f0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.176+0000 7f3f251b3640 1 --2- 172.21.15.38:0/2833312243 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3f0406a430 0x7f3f0406c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c003cc0 tx=0x7f3f1c0079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.179+0000 7f3f15ffb640 1 -- 172.21.15.38:0/2833312243 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3f18076a40 con 0x7f3f200cb4c0 2023-12-22T08:40:39.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.373+0000 7f3f261b5640 1 -- 172.21.15.38:0/2833312243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f200b2e10 con 0x7f3f200cb4c0 2023-12-22T08:40:39.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.375+0000 7f3f15ffb640 1 -- 172.21.15.38:0/2833312243 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f3f1807a060 con 0x7f3f200cb4c0 2023-12-22T08:40:39.378 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:39.378 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:59.604518+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:39.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.378+0000 7f3f261b5640 1 -- 172.21.15.38:0/2833312243 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3f0406a430 msgr2=0x7f3f0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.378+0000 7f3f261b5640 1 --2- 172.21.15.38:0/2833312243 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3f0406a430 0x7f3f0406c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c003cc0 tx=0x7f3f1c0079b0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.378+0000 7f3f261b5640 1 -- 172.21.15.38:0/2833312243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f200cb4c0 msgr2=0x7f3f2015bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.378+0000 7f3f261b5640 1 --2- 172.21.15.38:0/2833312243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f200cb4c0 0x7f3f2015bbd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009f40 tx=0x7f3f18004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:39.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.378+0000 7f3f261b5640 1 -- 172.21.15.38:0/2833312243 shutdown_connections 2023-12-22T08:40:39.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.378+0000 7f3f261b5640 1 --2- 172.21.15.38:0/2833312243 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3f0406a430 0x7f3f0406c8f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.378+0000 7f3f261b5640 1 --2- 172.21.15.38:0/2833312243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f200cb4c0 0x7f3f2015bbd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.378+0000 7f3f261b5640 1 --2- 172.21.15.38:0/2833312243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f2006d5f0 0x7f3f2015b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.378+0000 7f3f261b5640 1 --2- 172.21.15.38:0/2833312243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f2006d210 0x7f3f201451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.378+0000 7f3f261b5640 1 -- 172.21.15.38:0/2833312243 >> 172.21.15.38:0/2833312243 conn(0x7f3f200b1f70 msgr2=0x7f3f2015a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:39.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.378+0000 7f3f261b5640 1 -- 172.21.15.38:0/2833312243 shutdown_connections 2023-12-22T08:40:39.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.378+0000 7f3f261b5640 1 -- 172.21.15.38:0/2833312243 wait complete. 2023-12-22T08:40:39.402 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:39:56.873963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:39:57.616447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:39.403 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:39.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.626+0000 7f8ab6250640 1 Processor -- start 2023-12-22T08:40:39.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.626+0000 7f8ab6250640 1 -- start start 2023-12-22T08:40:39.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.628+0000 7f8ab6250640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab00ae6a0 0x7f8ab00712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.628+0000 7f8ab6250640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab0161ba0 con 0x7f8ab006d360 2023-12-22T08:40:39.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.628+0000 7f8ab6250640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab00acc00 con 0x7f8ab0070f10 2023-12-22T08:40:39.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.628+0000 7f8ab6250640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab006f960 con 0x7f8ab00ae6a0 2023-12-22T08:40:39.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.629+0000 7f8ab5a4f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8ab006d360 0x7f8ab016b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44848/0 (socket says 172.21.15.38:44848) 2023-12-22T08:40:39.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.629+0000 7f8ab5a4f640 1 -- 172.21.15.38:0/3268002602 learned_addr learned my addr 172.21.15.38:0/3268002602 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:39.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.629+0000 7f8ab4a4d640 1 --2- 172.21.15.38:0/3268002602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab00ae6a0 0x7f8ab00712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.629+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325867214 0 0) 0x7f8aa8001490 con 0x7f8ab006d360 2023-12-22T08:40:39.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.629+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a9c003520 con 0x7f8ab006d360 2023-12-22T08:40:39.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1560845442 0 0) 0x7f8a9c003520 con 0x7f8ab006d360 2023-12-22T08:40:39.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab00ae6a0 msgr2=0x7f8ab00712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:39.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8aa7fff640 1 --2- 172.21.15.38:0/3268002602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab00ae6a0 0x7f8ab00712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 >> v1:172.21.15.89:6789/0 conn(0x7f8ab0070f10 legacy=0x7f8ab006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab00acea0 con 0x7f8ab006d360 2023-12-22T08:40:39.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f8aa8001b80 con 0x7f8ab006d360 2023-12-22T08:40:39.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 >> v1:172.21.15.38:6789/0 conn(0x7f8ab006d360 legacy=0x7f8ab016b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8aa7fff640 1 --2- 172.21.15.38:0/3268002602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a9c0039a0 0x7f8a9c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8aa7fff640 1 --2- 172.21.15.38:0/3268002602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab00ae6a0 0x7f8a9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8aa7fff640 1 --2- 172.21.15.38:0/3268002602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c004d00 0x7f8a9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab006f960 con 0x7f8a9c004d00 2023-12-22T08:40:39.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c00ba60 con 0x7f8a9c0039a0 2023-12-22T08:40:39.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c00bc20 con 0x7f8ab00ae6a0 2023-12-22T08:40:39.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.630+0000 7f8ab5a4f640 1 --2- 172.21.15.38:0/3268002602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c004d00 0x7f8a9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.631+0000 7f8ab524e640 1 --2- 172.21.15.38:0/3268002602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a9c0039a0 0x7f8a9c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.631+0000 7f8ab4a4d640 1 --2- 172.21.15.38:0/3268002602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab00ae6a0 0x7f8a9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.631+0000 7f8ab5a4f640 1 -- 172.21.15.38:0/3268002602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab00ae6a0 msgr2=0x7f8a9c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:39.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.631+0000 7f8ab5a4f640 1 --2- 172.21.15.38:0/3268002602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab00ae6a0 0x7f8a9c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.631+0000 7f8ab5a4f640 1 -- 172.21.15.38:0/3268002602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a9c0039a0 msgr2=0x7f8a9c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:39.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.631+0000 7f8ab5a4f640 1 --2- 172.21.15.38:0/3268002602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a9c0039a0 0x7f8a9c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.631+0000 7f8ab5a4f640 1 -- 172.21.15.38:0/3268002602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c003520 con 0x7f8a9c004d00 2023-12-22T08:40:39.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.631+0000 7f8ab4a4d640 1 --2- 172.21.15.38:0/3268002602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ab00ae6a0 0x7f8a9c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:39.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.632+0000 7f8ab5a4f640 1 --2- 172.21.15.38:0/3268002602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c004d00 0x7f8a9c005180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800a780 tx=0x7f8a9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5603b806c476001 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.632+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80072d0 con 0x7f8a9c004d00 2023-12-22T08:40:39.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.632+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa802f070 con 0x7f8a9c004d00 2023-12-22T08:40:39.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.632+0000 7f8aa7fff640 1 -- 172.21.15.38:0/3268002602 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8007670 con 0x7f8a9c004d00 2023-12-22T08:40:39.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.633+0000 7f8ab6250640 1 -- 172.21.15.38:0/3268002602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c004d00 msgr2=0x7f8a9c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.633+0000 7f8ab6250640 1 --2- 172.21.15.38:0/3268002602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c004d00 0x7f8a9c005180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800a780 tx=0x7f8a9c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.633+0000 7f8ab5a4f640 1 -- 172.21.15.38:0/3268002602 reap_dead start 2023-12-22T08:40:39.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.633+0000 7f8ab6250640 1 -- 172.21.15.38:0/3268002602 shutdown_connections 2023-12-22T08:40:39.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.633+0000 7f8ab6250640 1 -- 172.21.15.38:0/3268002602 >> 172.21.15.38:0/3268002602 conn(0x7f8ab00b0b60 msgr2=0x7f8ab00b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:39.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.633+0000 7f8ab6250640 1 -- 172.21.15.38:0/3268002602 shutdown_connections 2023-12-22T08:40:39.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.633+0000 7f8ab6250640 1 -- 172.21.15.38:0/3268002602 wait complete. 2023-12-22T08:40:39.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.635+0000 7f8ab6250640 1 Processor -- start 2023-12-22T08:40:39.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.635+0000 7f8ab6250640 1 -- start start 2023-12-22T08:40:39.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.636+0000 7f8ab6250640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a9c004d00 0x7f8ab009ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.636+0000 7f8ab6250640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab009c6a0 0x7f8ab015a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.636+0000 7f8ab6250640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab009cb20 0x7f8ab015a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.636+0000 7f8ab6250640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab009c280 con 0x7f8ab009c6a0 2023-12-22T08:40:39.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.636+0000 7f8ab6250640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab009b3b0 con 0x7f8ab009cb20 2023-12-22T08:40:39.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.636+0000 7f8ab6250640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab009b600 con 0x7f8a9c004d00 2023-12-22T08:40:39.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.636+0000 7f8ab4a4d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab009c6a0 0x7f8ab015a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.636+0000 7f8ab4a4d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab009c6a0 0x7f8ab015a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53660/0 (socket says 172.21.15.38:53660) 2023-12-22T08:40:39.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.636+0000 7f8ab4a4d640 1 -- 172.21.15.38:0/2430548193 learned_addr learned my addr 172.21.15.38:0/2430548193 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:39.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.637+0000 7f8ab524e640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a9c004d00 0x7f8ab009ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.637+0000 7f8ab5a4f640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab009cb20 0x7f8ab015a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.637+0000 7f8ab4a4d640 1 -- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a9c004d00 msgr2=0x7f8ab009ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.637+0000 7f8ab4a4d640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a9c004d00 0x7f8ab009ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.637+0000 7f8ab4a4d640 1 -- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab009cb20 msgr2=0x7f8ab015a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.637+0000 7f8ab4a4d640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab009cb20 0x7f8ab015a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.637+0000 7f8ab4a4d640 1 -- 172.21.15.38:0/2430548193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab009b8e0 con 0x7f8ab009c6a0 2023-12-22T08:40:39.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.637+0000 7f8ab5a4f640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab009cb20 0x7f8ab015a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:39.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.637+0000 7f8ab4a4d640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab009c6a0 0x7f8ab015a2b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00108b0 tx=0x7f8aa0010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.638+0000 7f8aa5ffb640 1 -- 172.21.15.38:0/2430548193 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa000eb60 con 0x7f8ab009c6a0 2023-12-22T08:40:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.638+0000 7f8aa5ffb640 1 -- 172.21.15.38:0/2430548193 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa000ecc0 con 0x7f8ab009c6a0 2023-12-22T08:40:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.638+0000 7f8aa5ffb640 1 -- 172.21.15.38:0/2430548193 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa001c400 con 0x7f8ab009c6a0 2023-12-22T08:40:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.638+0000 7f8ab6250640 1 -- 172.21.15.38:0/2430548193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab009bbc0 con 0x7f8ab009c6a0 2023-12-22T08:40:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.638+0000 7f8ab6250640 1 -- 172.21.15.38:0/2430548193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab014ae10 con 0x7f8ab009c6a0 2023-12-22T08:40:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.639+0000 7f8ab6250640 1 -- 172.21.15.38:0/2430548193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab009c3c0 con 0x7f8ab009c6a0 2023-12-22T08:40:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.640+0000 7f8aa5ffb640 1 -- 172.21.15.38:0/2430548193 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8aa001c560 con 0x7f8ab009c6a0 2023-12-22T08:40:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.641+0000 7f8aa5ffb640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a9406a430 0x7f8a9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.641+0000 7f8aa5ffb640 1 -- 172.21.15.38:0/2430548193 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8aa0088e90 con 0x7f8ab009c6a0 2023-12-22T08:40:39.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.642+0000 7f8ab524e640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a9406a430 0x7f8a9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.643+0000 7f8ab524e640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a9406a430 0x7f8a9406c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8aac005540 tx=0x7f8aac007c50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.645+0000 7f8aa5ffb640 1 -- 172.21.15.38:0/2430548193 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8aa00545c0 con 0x7f8ab009c6a0 2023-12-22T08:40:39.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.837+0000 7f8ab6250640 1 -- 172.21.15.38:0/2430548193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ab0061910 con 0x7f8ab009c6a0 2023-12-22T08:40:39.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.838+0000 7f8aa5ffb640 1 -- 172.21.15.38:0/2430548193 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8aa0057be0 con 0x7f8ab009c6a0 2023-12-22T08:40:39.840 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:40:39.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.840+0000 7f8ab6250640 1 -- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a9406a430 msgr2=0x7f8a9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.840+0000 7f8ab6250640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a9406a430 0x7f8a9406c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8aac005540 tx=0x7f8aac007c50 comp rx=0 tx=0).stop 2023-12-22T08:40:39.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.840+0000 7f8ab6250640 1 -- 172.21.15.38:0/2430548193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab009c6a0 msgr2=0x7f8ab015a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.840+0000 7f8ab6250640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab009c6a0 0x7f8ab015a2b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00108b0 tx=0x7f8aa0010d70 comp rx=0 tx=0).stop 2023-12-22T08:40:39.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.840+0000 7f8ab6250640 1 -- 172.21.15.38:0/2430548193 shutdown_connections 2023-12-22T08:40:39.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.840+0000 7f8ab6250640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ab009cb20 0x7f8ab015a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.840+0000 7f8ab6250640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a9406a430 0x7f8a9406c8f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.840+0000 7f8ab6250640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ab009c6a0 0x7f8ab015a2b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.840+0000 7f8ab6250640 1 --2- 172.21.15.38:0/2430548193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a9c004d00 0x7f8ab009ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.840+0000 7f8ab6250640 1 -- 172.21.15.38:0/2430548193 >> 172.21.15.38:0/2430548193 conn(0x7f8ab00b0b60 msgr2=0x7f8ab015f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:39.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.841+0000 7f8ab6250640 1 -- 172.21.15.38:0/2430548193 shutdown_connections 2023-12-22T08:40:39.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:39.841+0000 7f8ab6250640 1 -- 172.21.15.38:0/2430548193 wait complete. 2023-12-22T08:40:39.862 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:40.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.085+0000 7ff370a18640 1 Processor -- start 2023-12-22T08:40:40.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.086+0000 7ff370a18640 1 -- start start 2023-12-22T08:40:40.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.087+0000 7ff370a18640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff36c09c980 0x7ff36c15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.087+0000 7ff370a18640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff36c071460 0x7ff36c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.087+0000 7ff370a18640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36c071df0 con 0x7ff36c15b0e0 2023-12-22T08:40:40.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.087+0000 7ff370a18640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36c15edf0 con 0x7ff36c071460 2023-12-22T08:40:40.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.087+0000 7ff370a18640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c15bd90 con 0x7ff36c09c980 2023-12-22T08:40:40.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.088+0000 7ff36ad9d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff36c15b0e0 0x7ff36c15b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:40750/0 (socket says 172.21.15.38:40750) 2023-12-22T08:40:40.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.088+0000 7ff36ad9d640 1 -- 172.21.15.38:0/221190430 learned_addr learned my addr 172.21.15.38:0/221190430 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:40.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.088+0000 7ff36b59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff36c071460 0x7ff36c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.088+0000 7ff36a59c640 1 --2- 172.21.15.38:0/221190430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff36c09c980 0x7ff36c15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.088+0000 7ff36a59c640 1 -- 172.21.15.38:0/221190430 >> v2:172.21.15.89:3300/0 conn(0x7ff36c071460 msgr2=0x7ff36c0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:40.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.088+0000 7ff36a59c640 1 --2- 172.21.15.38:0/221190430 >> v2:172.21.15.89:3300/0 conn(0x7ff36c071460 0x7ff36c0718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.088+0000 7ff36a59c640 1 -- 172.21.15.38:0/221190430 >> v1:172.21.15.89:6789/0 conn(0x7ff36c15b0e0 legacy=0x7ff36c15b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.088+0000 7ff36a59c640 1 -- 172.21.15.38:0/221190430 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c15c070 con 0x7ff36c09c980 2023-12-22T08:40:40.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.090+0000 7ff36a59c640 1 --2- 172.21.15.38:0/221190430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff36c09c980 0x7ff36c15c9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff3540097a0 tx=0x7ff35402b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f54c0284cd469732 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:40.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.090+0000 7ff369d9b640 1 -- 172.21.15.38:0/221190430 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3540316f0 con 0x7ff36c09c980 2023-12-22T08:40:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.090+0000 7ff369d9b640 1 -- 172.21.15.38:0/221190430 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff354031850 con 0x7ff36c09c980 2023-12-22T08:40:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.090+0000 7ff369d9b640 1 -- 172.21.15.38:0/221190430 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354031be0 con 0x7ff36c09c980 2023-12-22T08:40:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.091+0000 7ff370a18640 1 -- 172.21.15.38:0/221190430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff36c09c980 msgr2=0x7ff36c15c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.091+0000 7ff370a18640 1 --2- 172.21.15.38:0/221190430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff36c09c980 0x7ff36c15c9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff3540097a0 tx=0x7ff35402b790 comp rx=0 tx=0).stop 2023-12-22T08:40:40.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.091+0000 7ff370a18640 1 -- 172.21.15.38:0/221190430 shutdown_connections 2023-12-22T08:40:40.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.091+0000 7ff370a18640 1 --2- 172.21.15.38:0/221190430 >> v2:172.21.15.89:3300/0 conn(0x7ff36c071460 0x7ff36c0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.091+0000 7ff370a18640 1 --2- 172.21.15.38:0/221190430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff36c09c980 0x7ff36c15c9c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.091+0000 7ff370a18640 1 -- 172.21.15.38:0/221190430 >> 172.21.15.38:0/221190430 conn(0x7ff36c0cf000 msgr2=0x7ff36c0cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:40.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.091+0000 7ff370a18640 1 -- 172.21.15.38:0/221190430 shutdown_connections 2023-12-22T08:40:40.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.091+0000 7ff370a18640 1 -- 172.21.15.38:0/221190430 wait complete. 2023-12-22T08:40:40.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.093+0000 7ff370a18640 1 Processor -- start 2023-12-22T08:40:40.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.093+0000 7ff370a18640 1 -- start start 2023-12-22T08:40:40.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.094+0000 7ff370a18640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff36c071460 0x7ff36c1482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.094+0000 7ff370a18640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff36c09c980 0x7ff36c15f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.094+0000 7ff370a18640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff36c15b0e0 0x7ff36c15f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.094+0000 7ff370a18640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c148800 con 0x7ff36c15b0e0 2023-12-22T08:40:40.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.094+0000 7ff370a18640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c14a590 con 0x7ff36c09c980 2023-12-22T08:40:40.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.094+0000 7ff370a18640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c14a870 con 0x7ff36c071460 2023-12-22T08:40:40.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.094+0000 7ff36b59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff36c15b0e0 0x7ff36c15f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.094+0000 7ff36b59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff36c15b0e0 0x7ff36c15f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53670/0 (socket says 172.21.15.38:53670) 2023-12-22T08:40:40.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.094+0000 7ff36b59e640 1 -- 172.21.15.38:0/1273406292 learned_addr learned my addr 172.21.15.38:0/1273406292 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:40.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.094+0000 7ff36a59c640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff36c09c980 0x7ff36c15f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.094+0000 7ff36ad9d640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff36c071460 0x7ff36c1482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.095+0000 7ff36b59e640 1 -- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff36c071460 msgr2=0x7ff36c1482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.095+0000 7ff36b59e640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff36c071460 0x7ff36c1482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.095+0000 7ff36b59e640 1 -- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff36c09c980 msgr2=0x7ff36c15f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.095+0000 7ff36b59e640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff36c09c980 0x7ff36c15f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.095+0000 7ff36b59e640 1 -- 172.21.15.38:0/1273406292 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff354009400 con 0x7ff36c15b0e0 2023-12-22T08:40:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.095+0000 7ff36b59e640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff36c15b0e0 0x7ff36c15f6c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff36400efc0 tx=0x7ff36400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.095+0000 7ff3637fe640 1 -- 172.21.15.38:0/1273406292 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364014480 con 0x7ff36c15b0e0 2023-12-22T08:40:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.095+0000 7ff3637fe640 1 -- 172.21.15.38:0/1273406292 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36400f040 con 0x7ff36c15b0e0 2023-12-22T08:40:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.095+0000 7ff370a18640 1 -- 172.21.15.38:0/1273406292 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36c14ab50 con 0x7ff36c15b0e0 2023-12-22T08:40:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.095+0000 7ff3637fe640 1 -- 172.21.15.38:0/1273406292 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364014820 con 0x7ff36c15b0e0 2023-12-22T08:40:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.096+0000 7ff370a18640 1 -- 172.21.15.38:0/1273406292 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36c14b110 con 0x7ff36c15b0e0 2023-12-22T08:40:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.097+0000 7ff370a18640 1 -- 172.21.15.38:0/1273406292 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36c14b300 con 0x7ff36c15b0e0 2023-12-22T08:40:40.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.098+0000 7ff3637fe640 1 -- 172.21.15.38:0/1273406292 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff364014980 con 0x7ff36c15b0e0 2023-12-22T08:40:40.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.099+0000 7ff3637fe640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff34c06a430 0x7ff34c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.099+0000 7ff3637fe640 1 -- 172.21.15.38:0/1273406292 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3640894b0 con 0x7ff36c15b0e0 2023-12-22T08:40:40.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.100+0000 7ff36ad9d640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff34c06a430 0x7ff34c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.101+0000 7ff36ad9d640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff34c06a430 0x7ff34c06c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff35c005880 tx=0x7ff35c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:40.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.104+0000 7ff3637fe640 1 -- 172.21.15.38:0/1273406292 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff364054a20 con 0x7ff36c15b0e0 2023-12-22T08:40:40.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.295+0000 7ff370a18640 1 -- 172.21.15.38:0/1273406292 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff36c061910 con 0x7ff36c15b0e0 2023-12-22T08:40:40.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.296+0000 7ff3637fe640 1 -- 172.21.15.38:0/1273406292 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff364058040 con 0x7ff36c15b0e0 2023-12-22T08:40:40.299 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:40:40.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.299+0000 7ff370a18640 1 -- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff34c06a430 msgr2=0x7ff34c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.299+0000 7ff370a18640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff34c06a430 0x7ff34c06c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff35c005880 tx=0x7ff35c009040 comp rx=0 tx=0).stop 2023-12-22T08:40:40.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.299+0000 7ff370a18640 1 -- 172.21.15.38:0/1273406292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff36c15b0e0 msgr2=0x7ff36c15f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.299+0000 7ff370a18640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff36c15b0e0 0x7ff36c15f6c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff36400efc0 tx=0x7ff36400c490 comp rx=0 tx=0).stop 2023-12-22T08:40:40.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.299+0000 7ff370a18640 1 -- 172.21.15.38:0/1273406292 shutdown_connections 2023-12-22T08:40:40.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.299+0000 7ff370a18640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff34c06a430 0x7ff34c06c8f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.299+0000 7ff370a18640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff36c15b0e0 0x7ff36c15f6c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.299+0000 7ff370a18640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff36c09c980 0x7ff36c15f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.299+0000 7ff370a18640 1 --2- 172.21.15.38:0/1273406292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff36c071460 0x7ff36c1482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.299+0000 7ff370a18640 1 -- 172.21.15.38:0/1273406292 >> 172.21.15.38:0/1273406292 conn(0x7ff36c0cf000 msgr2=0x7ff36c0cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:40.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.299+0000 7ff370a18640 1 -- 172.21.15.38:0/1273406292 shutdown_connections 2023-12-22T08:40:40.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.299+0000 7ff370a18640 1 -- 172.21.15.38:0/1273406292 wait complete. 2023-12-22T08:40:40.322 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:40.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.541+0000 7f7f22f9b640 1 Processor -- start 2023-12-22T08:40:40.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.541+0000 7f7f22f9b640 1 -- start start 2023-12-22T08:40:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.543+0000 7f7f22f9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7f1c070b70 0x7f7f1c06bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.543+0000 7f7f22f9b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1c06d5f0 con 0x7f7f1c06c4d0 2023-12-22T08:40:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.543+0000 7f7f22f9b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1c144fa0 con 0x7f7f1c071660 2023-12-22T08:40:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.543+0000 7f7f22f9b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1c06da80 con 0x7f7f1c070b70 2023-12-22T08:40:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.543+0000 7f7f21f99640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7f1c070b70 0x7f7f1c06bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.544+0000 7f7f21f99640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7f1c070b70 0x7f7f1c06bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53672/0 (socket says 172.21.15.38:53672) 2023-12-22T08:40:40.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.544+0000 7f7f21f99640 1 -- 172.21.15.38:0/3541164477 learned_addr learned my addr 172.21.15.38:0/3541164477 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:40.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.544+0000 7f7f21f99640 1 -- 172.21.15.38:0/3541164477 >> v1:172.21.15.89:6789/0 conn(0x7f7f1c071660 legacy=0x7f7f1c164d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:40.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.544+0000 7f7f21f99640 1 -- 172.21.15.38:0/3541164477 >> v1:172.21.15.38:6789/0 conn(0x7f7f1c06c4d0 legacy=0x7f7f1c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.544+0000 7f7f21f99640 1 -- 172.21.15.38:0/3541164477 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c06c9e0 con 0x7f7f1c070b70 2023-12-22T08:40:40.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.545+0000 7f7f21f99640 1 --2- 172.21.15.38:0/3541164477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f1c070b70 0x7f7f1c06bf90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009870 tx=0x7f7f1802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848e3df11ad28e2d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:40.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.546+0000 7f7f20f97640 1 -- 172.21.15.38:0/3541164477 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18030850 con 0x7f7f1c070b70 2023-12-22T08:40:40.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.546+0000 7f7f20f97640 1 -- 172.21.15.38:0/3541164477 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f180309b0 con 0x7f7f1c070b70 2023-12-22T08:40:40.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.546+0000 7f7f20f97640 1 -- 172.21.15.38:0/3541164477 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18030d40 con 0x7f7f1c070b70 2023-12-22T08:40:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.546+0000 7f7f22f9b640 1 -- 172.21.15.38:0/3541164477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f1c070b70 msgr2=0x7f7f1c06bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.546+0000 7f7f22f9b640 1 --2- 172.21.15.38:0/3541164477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f1c070b70 0x7f7f1c06bf90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009870 tx=0x7f7f1802b990 comp rx=0 tx=0).stop 2023-12-22T08:40:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.546+0000 7f7f22f9b640 1 -- 172.21.15.38:0/3541164477 shutdown_connections 2023-12-22T08:40:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.546+0000 7f7f22f9b640 1 --2- 172.21.15.38:0/3541164477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f1c070b70 0x7f7f1c06bf90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.546+0000 7f7f22f9b640 1 -- 172.21.15.38:0/3541164477 >> 172.21.15.38:0/3541164477 conn(0x7f7f1c0b0b60 msgr2=0x7f7f1c0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.546+0000 7f7f22f9b640 1 -- 172.21.15.38:0/3541164477 shutdown_connections 2023-12-22T08:40:40.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.546+0000 7f7f22f9b640 1 -- 172.21.15.38:0/3541164477 wait complete. 2023-12-22T08:40:40.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.548+0000 7f7f22f9b640 1 Processor -- start 2023-12-22T08:40:40.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.548+0000 7f7f22f9b640 1 -- start start 2023-12-22T08:40:40.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.549+0000 7f7f22f9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f1c06c4d0 0x7f7f1c0abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.549+0000 7f7f22f9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f1c070b70 0x7f7f1c0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.549+0000 7f7f22f9b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f1c071660 0x7f7f1c0af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.549+0000 7f7f22f9b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c13c540 con 0x7f7f1c070b70 2023-12-22T08:40:40.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.549+0000 7f7f22f9b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c13f820 con 0x7f7f1c06c4d0 2023-12-22T08:40:40.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.549+0000 7f7f22f9b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c13fb00 con 0x7f7f1c071660 2023-12-22T08:40:40.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.549+0000 7f7f21798640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f1c070b70 0x7f7f1c0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.550+0000 7f7f21798640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f1c070b70 0x7f7f1c0ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53688/0 (socket says 172.21.15.38:53688) 2023-12-22T08:40:40.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.550+0000 7f7f21798640 1 -- 172.21.15.38:0/1941386193 learned_addr learned my addr 172.21.15.38:0/1941386193 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:40.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.550+0000 7f7f21f99640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f1c06c4d0 0x7f7f1c0abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.550+0000 7f7f21798640 1 -- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f1c071660 msgr2=0x7f7f1c0af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.550+0000 7f7f2279a640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f1c071660 0x7f7f1c0af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.550+0000 7f7f21798640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f1c071660 0x7f7f1c0af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.550+0000 7f7f21798640 1 -- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f1c06c4d0 msgr2=0x7f7f1c0abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.550+0000 7f7f21798640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f1c06c4d0 0x7f7f1c0abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.550+0000 7f7f21798640 1 -- 172.21.15.38:0/1941386193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f180094d0 con 0x7f7f1c070b70 2023-12-22T08:40:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.550+0000 7f7f21f99640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f1c06c4d0 0x7f7f1c0abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.550+0000 7f7f21798640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f1c070b70 0x7f7f1c0ac8e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00c400 tx=0x7f7f0c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.550+0000 7f7f127fc640 1 -- 172.21.15.38:0/1941386193 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0052d0 con 0x7f7f1c070b70 2023-12-22T08:40:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.551+0000 7f7f127fc640 1 -- 172.21.15.38:0/1941386193 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c005430 con 0x7f7f1c070b70 2023-12-22T08:40:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.551+0000 7f7f22f9b640 1 -- 172.21.15.38:0/1941386193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1c13fde0 con 0x7f7f1c070b70 2023-12-22T08:40:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.551+0000 7f7f127fc640 1 -- 172.21.15.38:0/1941386193 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c003830 con 0x7f7f1c070b70 2023-12-22T08:40:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.551+0000 7f7f22f9b640 1 -- 172.21.15.38:0/1941386193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c1403a0 con 0x7f7f1c070b70 2023-12-22T08:40:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.552+0000 7f7f22f9b640 1 -- 172.21.15.38:0/1941386193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1c065fd0 con 0x7f7f1c070b70 2023-12-22T08:40:40.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.553+0000 7f7f127fc640 1 -- 172.21.15.38:0/1941386193 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f0c003990 con 0x7f7f1c070b70 2023-12-22T08:40:40.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.554+0000 7f7f127fc640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f0006a430 0x7f7f0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.554+0000 7f7f127fc640 1 -- 172.21.15.38:0/1941386193 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f0c087fb0 con 0x7f7f1c070b70 2023-12-22T08:40:40.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.555+0000 7f7f21f99640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f0006a430 0x7f7f0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.556+0000 7f7f21f99640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f0006a430 0x7f7f0006c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7f18036000 tx=0x7f7f1803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:40.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.558+0000 7f7f127fc640 1 -- 172.21.15.38:0/1941386193 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7f0c053500 con 0x7f7f1c070b70 2023-12-22T08:40:40.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.754+0000 7f7f22f9b640 1 -- 172.21.15.38:0/1941386193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f1c061910 con 0x7f7f1c070b70 2023-12-22T08:40:40.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.755+0000 7f7f127fc640 1 -- 172.21.15.38:0/1941386193 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7f0c017020 con 0x7f7f1c070b70 2023-12-22T08:40:40.757 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:40:40.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.757+0000 7f7f22f9b640 1 -- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f0006a430 msgr2=0x7f7f0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.757+0000 7f7f22f9b640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f0006a430 0x7f7f0006c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7f18036000 tx=0x7f7f1803b040 comp rx=0 tx=0).stop 2023-12-22T08:40:40.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.757+0000 7f7f22f9b640 1 -- 172.21.15.38:0/1941386193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f1c070b70 msgr2=0x7f7f1c0ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.757+0000 7f7f22f9b640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f1c070b70 0x7f7f1c0ac8e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00c400 tx=0x7f7f0c00c8c0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.757+0000 7f7f22f9b640 1 -- 172.21.15.38:0/1941386193 shutdown_connections 2023-12-22T08:40:40.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.757+0000 7f7f22f9b640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f1c071660 0x7f7f1c0af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.757+0000 7f7f22f9b640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f0006a430 0x7f7f0006c8f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.757+0000 7f7f22f9b640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f1c070b70 0x7f7f1c0ac8e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.757+0000 7f7f22f9b640 1 --2- 172.21.15.38:0/1941386193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f1c06c4d0 0x7f7f1c0abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.757+0000 7f7f22f9b640 1 -- 172.21.15.38:0/1941386193 >> 172.21.15.38:0/1941386193 conn(0x7f7f1c0b0b60 msgr2=0x7f7f1c144260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:40.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.758+0000 7f7f22f9b640 1 -- 172.21.15.38:0/1941386193 shutdown_connections 2023-12-22T08:40:40.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:40.758+0000 7f7f22f9b640 1 -- 172.21.15.38:0/1941386193 wait complete. 2023-12-22T08:40:40.779 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:41.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.001+0000 7f57f4c4d640 1 Processor -- start 2023-12-22T08:40:41.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.001+0000 7f57f4c4d640 1 -- start start 2023-12-22T08:40:41.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.002+0000 7f57f4c4d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57f015b420 0x7f57f006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.002+0000 7f57f4c4d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f57f00a44a0 0x7f57f00708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.002+0000 7f57f4c4d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f00cdae0 con 0x7f57f0070e30 2023-12-22T08:40:41.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.002+0000 7f57f4c4d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f0071260 con 0x7f57f00a44a0 2023-12-22T08:40:41.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.002+0000 7f57f4c4d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f006dec0 con 0x7f57f015b420 2023-12-22T08:40:41.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.003+0000 7f57effff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f57f0070e30 0x7f57f006f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42874/0 (socket says 172.21.15.38:42874) 2023-12-22T08:40:41.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.003+0000 7f57effff640 1 -- 172.21.15.38:0/2770262960 learned_addr learned my addr 172.21.15.38:0/2770262960 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:41.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.003+0000 7f57e7fff640 1 --2- 172.21.15.38:0/2770262960 >> v2:172.21.15.38:3300/0 conn(0x7f57f00a44a0 0x7f57f00708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.003+0000 7f57ef7fe640 1 --2- 172.21.15.38:0/2770262960 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57f015b420 0x7f57f006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.003+0000 7f57eeffd640 1 -- 172.21.15.38:0/2770262960 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323317756 0 0) 0x7f57f00cdae0 con 0x7f57f0070e30 2023-12-22T08:40:41.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.003+0000 7f57eeffd640 1 -- 172.21.15.38:0/2770262960 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57dc003520 con 0x7f57f0070e30 2023-12-22T08:40:41.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.004+0000 7f57e7fff640 1 -- 172.21.15.38:0/2770262960 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57f015b420 msgr2=0x7f57f006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:41.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.004+0000 7f57e7fff640 1 --2- 172.21.15.38:0/2770262960 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57f015b420 0x7f57f006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.004+0000 7f57e7fff640 1 -- 172.21.15.38:0/2770262960 >> v1:172.21.15.38:6789/0 conn(0x7f57f0070e30 legacy=0x7f57f006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.004+0000 7f57e7fff640 1 -- 172.21.15.38:0/2770262960 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f015b800 con 0x7f57f00a44a0 2023-12-22T08:40:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.005+0000 7f57e7fff640 1 --2- 172.21.15.38:0/2770262960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f00a44a0 0x7f57f00708f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f57d80097a0 tx=0x7f57d802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d1f1ec097e04fa server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.005+0000 7f57eeffd640 1 -- 172.21.15.38:0/2770262960 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d802d040 con 0x7f57f00a44a0 2023-12-22T08:40:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.005+0000 7f57eeffd640 1 -- 172.21.15.38:0/2770262960 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d8031810 con 0x7f57f00a44a0 2023-12-22T08:40:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.005+0000 7f57eeffd640 1 -- 172.21.15.38:0/2770262960 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8031ba0 con 0x7f57f00a44a0 2023-12-22T08:40:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.006+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2770262960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f00a44a0 msgr2=0x7f57f00708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.006+0000 7f57f4c4d640 1 --2- 172.21.15.38:0/2770262960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f00a44a0 0x7f57f00708f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f57d80097a0 tx=0x7f57d802b8b0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.006+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2770262960 shutdown_connections 2023-12-22T08:40:41.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.006+0000 7f57f4c4d640 1 --2- 172.21.15.38:0/2770262960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f00a44a0 0x7f57f00708f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.006+0000 7f57f4c4d640 1 --2- 172.21.15.38:0/2770262960 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57f015b420 0x7f57f006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.006+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2770262960 >> 172.21.15.38:0/2770262960 conn(0x7f57f00b1f70 msgr2=0x7f57f00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:41.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.006+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2770262960 shutdown_connections 2023-12-22T08:40:41.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.006+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2770262960 wait complete. 2023-12-22T08:40:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.008+0000 7f57f4c4d640 1 Processor -- start 2023-12-22T08:40:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.008+0000 7f57f4c4d640 1 -- start start 2023-12-22T08:40:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.009+0000 7f57f4c4d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f0070e30 0x7f57f00c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.009+0000 7f57f4c4d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57f00a44a0 0x7f57f00a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.009+0000 7f57f4c4d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57f015b420 0x7f57f00a3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.009+0000 7f57f4c4d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f00a3990 con 0x7f57f0070e30 2023-12-22T08:40:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.009+0000 7f57f4c4d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f00a36c0 con 0x7f57f00a44a0 2023-12-22T08:40:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.009+0000 7f57f4c4d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f014bfe0 con 0x7f57f015b420 2023-12-22T08:40:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.009+0000 7f57ef7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f0070e30 0x7f57f00c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.009+0000 7f57ef7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f0070e30 0x7f57f00c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49766/0 (socket says 172.21.15.38:49766) 2023-12-22T08:40:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.009+0000 7f57ef7fe640 1 -- 172.21.15.38:0/2456953010 learned_addr learned my addr 172.21.15.38:0/2456953010 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.010+0000 7f57e7fff640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57f00a44a0 0x7f57f00a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.010+0000 7f57effff640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57f015b420 0x7f57f00a3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.010+0000 7f57ef7fe640 1 -- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57f015b420 msgr2=0x7f57f00a3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.010+0000 7f57ef7fe640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57f015b420 0x7f57f00a3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.010+0000 7f57ef7fe640 1 -- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57f00a44a0 msgr2=0x7f57f00a2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.010+0000 7f57ef7fe640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57f00a44a0 0x7f57f00a2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.010+0000 7f57ef7fe640 1 -- 172.21.15.38:0/2456953010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d8009400 con 0x7f57f0070e30 2023-12-22T08:40:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.010+0000 7f57ef7fe640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f0070e30 0x7f57f00c4fe0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f57e000d5f0 tx=0x7f57e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.010+0000 7f57ecff9640 1 -- 172.21.15.38:0/2456953010 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e00125f0 con 0x7f57f0070e30 2023-12-22T08:40:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.010+0000 7f57ecff9640 1 -- 172.21.15.38:0/2456953010 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e0012750 con 0x7f57f0070e30 2023-12-22T08:40:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.010+0000 7f57ecff9640 1 -- 172.21.15.38:0/2456953010 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0012b00 con 0x7f57f0070e30 2023-12-22T08:40:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.010+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2456953010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f014c2c0 con 0x7f57f0070e30 2023-12-22T08:40:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.010+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2456953010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f00c5520 con 0x7f57f0070e30 2023-12-22T08:40:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.012+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2456953010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f014cbf0 con 0x7f57f0070e30 2023-12-22T08:40:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.012+0000 7f57ecff9640 1 -- 172.21.15.38:0/2456953010 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f57e0012c60 con 0x7f57f0070e30 2023-12-22T08:40:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.013+0000 7f57ecff9640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f57d006a430 0x7f57d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.013+0000 7f57ecff9640 1 -- 172.21.15.38:0/2456953010 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57e0088db0 con 0x7f57f0070e30 2023-12-22T08:40:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.014+0000 7f57e7fff640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f57d006a430 0x7f57d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.015+0000 7f57e7fff640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f57d006a430 0x7f57d006c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f57d8036000 tx=0x7f57d803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.018+0000 7f57ecff9640 1 -- 172.21.15.38:0/2456953010 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f57e008d070 con 0x7f57f0070e30 2023-12-22T08:40:41.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.216+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2456953010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57f0061910 con 0x7f57f0070e30 2023-12-22T08:40:41.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.220+0000 7f57ecff9640 1 -- 172.21.15.38:0/2456953010 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f57e0054390 con 0x7f57f0070e30 2023-12-22T08:40:41.223 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:41.223 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:59.604518+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:41.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.223+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f57d006a430 msgr2=0x7f57d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.223+0000 7f57f4c4d640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f57d006a430 0x7f57d006c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f57d8036000 tx=0x7f57d803c040 comp rx=0 tx=0).stop 2023-12-22T08:40:41.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.223+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2456953010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f0070e30 msgr2=0x7f57f00c4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.223+0000 7f57f4c4d640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f0070e30 0x7f57f00c4fe0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f57e000d5f0 tx=0x7f57e000dab0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.223+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2456953010 shutdown_connections 2023-12-22T08:40:41.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.223+0000 7f57f4c4d640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57f015b420 0x7f57f00a3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.223+0000 7f57f4c4d640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57f00a44a0 0x7f57f00a2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.223+0000 7f57f4c4d640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f57d006a430 0x7f57d006c8f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.223+0000 7f57f4c4d640 1 --2- 172.21.15.38:0/2456953010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f0070e30 0x7f57f00c4fe0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.223+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2456953010 >> 172.21.15.38:0/2456953010 conn(0x7f57f00b1f70 msgr2=0x7f57f015d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:41.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.223+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2456953010 shutdown_connections 2023-12-22T08:40:41.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.223+0000 7f57f4c4d640 1 -- 172.21.15.38:0/2456953010 wait complete. 2023-12-22T08:40:41.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:39:56.873963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:39:57.616447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:41.244 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:41.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.466+0000 7f891de33640 1 Processor -- start 2023-12-22T08:40:41.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.466+0000 7f891de33640 1 -- start start 2023-12-22T08:40:41.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.468+0000 7f891de33640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8918071080 0x7f89180d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.468+0000 7f891de33640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891815d5a0 0x7f89180d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.468+0000 7f891de33640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891815de50 con 0x7f891815d1c0 2023-12-22T08:40:41.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.468+0000 7f891de33640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89180d0dd0 con 0x7f8918071080 2023-12-22T08:40:41.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.468+0000 7f891de33640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89180d10b0 con 0x7f891815d5a0 2023-12-22T08:40:41.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.469+0000 7f8917fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8918071080 0x7f89180d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.469+0000 7f891d632640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891815d5a0 0x7f89180d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.469+0000 7f8917fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8918071080 0x7f89180d0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:45138/0 (socket says 172.21.15.38:45138) 2023-12-22T08:40:41.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.469+0000 7f8917fff640 1 -- 172.21.15.38:0/4010922811 learned_addr learned my addr 172.21.15.38:0/4010922811 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:41.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.470+0000 7f891d632640 1 -- 172.21.15.38:0/4010922811 >> v2:172.21.15.89:3300/0 conn(0x7f8918071080 msgr2=0x7f89180d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:41.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.470+0000 7f891d632640 1 --2- 172.21.15.38:0/4010922811 >> v2:172.21.15.89:3300/0 conn(0x7f8918071080 0x7f89180d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.470+0000 7f891d632640 1 -- 172.21.15.38:0/4010922811 >> v1:172.21.15.89:6789/0 conn(0x7f891815d1c0 legacy=0x7f8918070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.470+0000 7f891d632640 1 -- 172.21.15.38:0/4010922811 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891815dae0 con 0x7f891815d5a0 2023-12-22T08:40:41.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.470+0000 7f8917fff640 1 --2- 172.21.15.38:0/4010922811 >> v2:172.21.15.89:3300/0 conn(0x7f8918071080 0x7f89180d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:41.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.471+0000 7f891d632640 1 --2- 172.21.15.38:0/4010922811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891815d5a0 0x7f89180d05a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8910009d90 tx=0x7f891002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75909ee9fd216e7a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:41.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.472+0000 7f89177fe640 1 -- 172.21.15.38:0/4010922811 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891002cc60 con 0x7f891815d5a0 2023-12-22T08:40:41.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.472+0000 7f89177fe640 1 -- 172.21.15.38:0/4010922811 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891002cdc0 con 0x7f891815d5a0 2023-12-22T08:40:41.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.472+0000 7f89177fe640 1 -- 172.21.15.38:0/4010922811 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910034660 con 0x7f891815d5a0 2023-12-22T08:40:41.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.472+0000 7f891de33640 1 -- 172.21.15.38:0/4010922811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891815d5a0 msgr2=0x7f89180d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.472+0000 7f891de33640 1 --2- 172.21.15.38:0/4010922811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891815d5a0 0x7f89180d05a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8910009d90 tx=0x7f891002beb0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.473+0000 7f891de33640 1 -- 172.21.15.38:0/4010922811 shutdown_connections 2023-12-22T08:40:41.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.473+0000 7f891de33640 1 --2- 172.21.15.38:0/4010922811 >> v2:172.21.15.89:3300/0 conn(0x7f8918071080 0x7f89180d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.473+0000 7f891de33640 1 --2- 172.21.15.38:0/4010922811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891815d5a0 0x7f89180d05a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.473+0000 7f891de33640 1 -- 172.21.15.38:0/4010922811 >> 172.21.15.38:0/4010922811 conn(0x7f891806bf90 msgr2=0x7f891806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:41.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.473+0000 7f891de33640 1 -- 172.21.15.38:0/4010922811 shutdown_connections 2023-12-22T08:40:41.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.473+0000 7f891de33640 1 -- 172.21.15.38:0/4010922811 wait complete. 2023-12-22T08:40:41.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.474+0000 7f891de33640 1 Processor -- start 2023-12-22T08:40:41.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.475+0000 7f891de33640 1 -- start start 2023-12-22T08:40:41.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.476+0000 7f891de33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8918071080 0x7f89180b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.476+0000 7f891de33640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891815d1c0 0x7f89180b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.476+0000 7f891de33640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891815d5a0 0x7f8918144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.476+0000 7f891de33640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89181f5de0 con 0x7f891815d5a0 2023-12-22T08:40:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.476+0000 7f891de33640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89181f6960 con 0x7f8918071080 2023-12-22T08:40:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.476+0000 7f891de33640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8918148b80 con 0x7f891815d1c0 2023-12-22T08:40:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.476+0000 7f8917fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891815d1c0 0x7f89180b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.476+0000 7f891ce31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8918071080 0x7f89180b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.477+0000 7f8917fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891815d1c0 0x7f89180b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:54318/0 (socket says 172.21.15.38:54318) 2023-12-22T08:40:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.477+0000 7f8917fff640 1 -- 172.21.15.38:0/1914740286 learned_addr learned my addr 172.21.15.38:0/1914740286 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.477+0000 7f891d632640 1 --2- 172.21.15.38:0/1914740286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891815d5a0 0x7f8918144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.477+0000 7f891d632640 1 -- 172.21.15.38:0/1914740286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891815d1c0 msgr2=0x7f89180b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.477+0000 7f891d632640 1 --2- 172.21.15.38:0/1914740286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891815d1c0 0x7f89180b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.477+0000 7f891d632640 1 -- 172.21.15.38:0/1914740286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8918071080 msgr2=0x7f89180b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.477+0000 7f891d632640 1 --2- 172.21.15.38:0/1914740286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8918071080 0x7f89180b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.477+0000 7f891d632640 1 -- 172.21.15.38:0/1914740286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89040094d0 con 0x7f891815d5a0 2023-12-22T08:40:41.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.478+0000 7f891d632640 1 --2- 172.21.15.38:0/1914740286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891815d5a0 0x7f8918144c10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f89180d11f0 tx=0x7f8910004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:41.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.478+0000 7f89157fa640 1 -- 172.21.15.38:0/1914740286 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910040650 con 0x7f891815d5a0 2023-12-22T08:40:41.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.478+0000 7f89157fa640 1 -- 172.21.15.38:0/1914740286 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89100407b0 con 0x7f891815d5a0 2023-12-22T08:40:41.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.478+0000 7f89157fa640 1 -- 172.21.15.38:0/1914740286 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910040b60 con 0x7f891815d5a0 2023-12-22T08:40:41.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.478+0000 7f891de33640 1 -- 172.21.15.38:0/1914740286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8910009a70 con 0x7f891815d5a0 2023-12-22T08:40:41.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.478+0000 7f891de33640 1 -- 172.21.15.38:0/1914740286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89181f6310 con 0x7f891815d5a0 2023-12-22T08:40:41.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.479+0000 7f891de33640 1 -- 172.21.15.38:0/1914740286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8918061910 con 0x7f891815d5a0 2023-12-22T08:40:41.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.480+0000 7f89157fa640 1 -- 172.21.15.38:0/1914740286 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8910040cc0 con 0x7f891815d5a0 2023-12-22T08:40:41.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.481+0000 7f89157fa640 1 --2- 172.21.15.38:0/1914740286 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88fc06a480 0x7f88fc06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.481+0000 7f89157fa640 1 -- 172.21.15.38:0/1914740286 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89100ab390 con 0x7f891815d5a0 2023-12-22T08:40:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.482+0000 7f891ce31640 1 --2- 172.21.15.38:0/1914740286 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88fc06a480 0x7f88fc06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.483+0000 7f891ce31640 1 --2- 172.21.15.38:0/1914740286 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88fc06a480 0x7f88fc06c940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f890c000f60 tx=0x7f890c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:41.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.486+0000 7f89157fa640 1 -- 172.21.15.38:0/1914740286 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8910076ba0 con 0x7f891815d5a0 2023-12-22T08:40:41.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.677+0000 7f891de33640 1 -- 172.21.15.38:0/1914740286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89181f6aa0 con 0x7f891815d5a0 2023-12-22T08:40:41.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.678+0000 7f89157fa640 1 -- 172.21.15.38:0/1914740286 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8910009450 con 0x7f891815d5a0 2023-12-22T08:40:41.681 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:40:41.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.681+0000 7f891de33640 1 -- 172.21.15.38:0/1914740286 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88fc06a480 msgr2=0x7f88fc06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.681+0000 7f891de33640 1 --2- 172.21.15.38:0/1914740286 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88fc06a480 0x7f88fc06c940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f890c000f60 tx=0x7f890c009040 comp rx=0 tx=0).stop 2023-12-22T08:40:41.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.681+0000 7f891de33640 1 -- 172.21.15.38:0/1914740286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891815d5a0 msgr2=0x7f8918144c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.681+0000 7f891de33640 1 --2- 172.21.15.38:0/1914740286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891815d5a0 0x7f8918144c10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f89180d11f0 tx=0x7f8910004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:41.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.681+0000 7f891de33640 1 -- 172.21.15.38:0/1914740286 shutdown_connections 2023-12-22T08:40:41.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.681+0000 7f891de33640 1 --2- 172.21.15.38:0/1914740286 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88fc06a480 0x7f88fc06c940 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.681+0000 7f891de33640 1 --2- 172.21.15.38:0/1914740286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f891815d5a0 0x7f8918144c10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.681+0000 7f891de33640 1 --2- 172.21.15.38:0/1914740286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891815d1c0 0x7f89180b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.681+0000 7f891de33640 1 --2- 172.21.15.38:0/1914740286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8918071080 0x7f89180b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.681+0000 7f891de33640 1 -- 172.21.15.38:0/1914740286 >> 172.21.15.38:0/1914740286 conn(0x7f891806bf90 msgr2=0x7f891815f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:41.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.681+0000 7f891de33640 1 -- 172.21.15.38:0/1914740286 shutdown_connections 2023-12-22T08:40:41.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.681+0000 7f891de33640 1 -- 172.21.15.38:0/1914740286 wait complete. 2023-12-22T08:40:41.702 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:41.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.927+0000 7fdffffff640 1 Processor -- start 2023-12-22T08:40:41.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.928+0000 7fdffffff640 1 -- start start 2023-12-22T08:40:41.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.930+0000 7fdffffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe00015ad90 0x7fe0000caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.930+0000 7fdffffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe000161bb0 0x7fe0000cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.930+0000 7fdffffff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00015e630 con 0x7fe00015d940 2023-12-22T08:40:41.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.930+0000 7fdffffff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0000ce2c0 con 0x7fe00015ad90 2023-12-22T08:40:41.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.930+0000 7fdffffff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00015e910 con 0x7fe000161bb0 2023-12-22T08:40:41.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.930+0000 7fdffeffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe00015ad90 0x7fe0000caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.930+0000 7fdfff7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe00015d940 0x7fe00015dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42880/0 (socket says 172.21.15.38:42880) 2023-12-22T08:40:41.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.930+0000 7fdfff7fe640 1 -- 172.21.15.38:0/3615186724 learned_addr learned my addr 172.21.15.38:0/3615186724 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:41.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.930+0000 7fdff7fff640 1 --2- 172.21.15.38:0/3615186724 >> v2:172.21.15.89:3300/0 conn(0x7fe000161bb0 0x7fe0000cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.931+0000 7fdffeffd640 1 -- 172.21.15.38:0/3615186724 >> v2:172.21.15.89:3300/0 conn(0x7fe000161bb0 msgr2=0x7fe0000cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:41.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.931+0000 7fdffeffd640 1 --2- 172.21.15.38:0/3615186724 >> v2:172.21.15.89:3300/0 conn(0x7fe000161bb0 0x7fe0000cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.931+0000 7fdffeffd640 1 -- 172.21.15.38:0/3615186724 >> v1:172.21.15.38:6789/0 conn(0x7fe00015d940 legacy=0x7fe00015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.931+0000 7fdffeffd640 1 -- 172.21.15.38:0/3615186724 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0001610d0 con 0x7fe00015ad90 2023-12-22T08:40:41.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.931+0000 7fdffe7fc640 1 -- 172.21.15.38:0/3615186724 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496660843 0 0) 0x7fe00015e630 con 0x7fe00015d940 2023-12-22T08:40:41.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.932+0000 7fdffeffd640 1 --2- 172.21.15.38:0/3615186724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe00015ad90 0x7fe0000caed0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe0000d0d40 tx=0x7fdff002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239078f135a6f071 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:41.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.932+0000 7fdffe7fc640 1 -- 172.21.15.38:0/3615186724 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0031830 con 0x7fe00015ad90 2023-12-22T08:40:41.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.932+0000 7fdffe7fc640 1 -- 172.21.15.38:0/3615186724 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff0031990 con 0x7fe00015ad90 2023-12-22T08:40:41.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.932+0000 7fdffe7fc640 1 -- 172.21.15.38:0/3615186724 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0031d20 con 0x7fe00015ad90 2023-12-22T08:40:41.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.933+0000 7fdffffff640 1 -- 172.21.15.38:0/3615186724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe00015ad90 msgr2=0x7fe0000caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.933+0000 7fdffffff640 1 --2- 172.21.15.38:0/3615186724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe00015ad90 0x7fe0000caed0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe0000d0d40 tx=0x7fdff002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.933+0000 7fdffffff640 1 -- 172.21.15.38:0/3615186724 shutdown_connections 2023-12-22T08:40:41.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.933+0000 7fdffffff640 1 --2- 172.21.15.38:0/3615186724 >> v2:172.21.15.89:3300/0 conn(0x7fe000161bb0 0x7fe0000cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.933+0000 7fdffffff640 1 --2- 172.21.15.38:0/3615186724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe00015ad90 0x7fe0000caed0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.933+0000 7fdffffff640 1 -- 172.21.15.38:0/3615186724 >> 172.21.15.38:0/3615186724 conn(0x7fe0000d31c0 msgr2=0x7fe0000d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:41.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.933+0000 7fdffffff640 1 -- 172.21.15.38:0/3615186724 shutdown_connections 2023-12-22T08:40:41.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.933+0000 7fdffffff640 1 -- 172.21.15.38:0/3615186724 wait complete. 2023-12-22T08:40:41.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.935+0000 7fdffffff640 1 Processor -- start 2023-12-22T08:40:41.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.935+0000 7fdffffff640 1 -- start start 2023-12-22T08:40:41.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.936+0000 7fdffffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe00015ad90 0x7fe0000c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.936+0000 7fdffffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe00015d940 0x7fe00014dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.936+0000 7fdffffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe000161bb0 0x7fe0000c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.936+0000 7fdffffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00014e7e0 con 0x7fe00015ad90 2023-12-22T08:40:41.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.936+0000 7fdffffff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000c76c0 con 0x7fe00015d940 2023-12-22T08:40:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.936+0000 7fdffffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00014e260 con 0x7fe000161bb0 2023-12-22T08:40:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.936+0000 7fdffeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe00015ad90 0x7fe0000c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.936+0000 7fdffeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe00015ad90 0x7fe0000c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49784/0 (socket says 172.21.15.38:49784) 2023-12-22T08:40:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.936+0000 7fdffeffd640 1 -- 172.21.15.38:0/1872640144 learned_addr learned my addr 172.21.15.38:0/1872640144 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.936+0000 7fdfff7fe640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe000161bb0 0x7fe0000c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.936+0000 7fdff7fff640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe00015d940 0x7fe00014dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.936+0000 7fdffeffd640 1 -- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe000161bb0 msgr2=0x7fe0000c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.937+0000 7fdffeffd640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe000161bb0 0x7fe0000c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.937+0000 7fdffeffd640 1 -- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe00015d940 msgr2=0x7fe00014dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.937+0000 7fdffeffd640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe00015d940 0x7fe00014dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.937+0000 7fdffeffd640 1 -- 172.21.15.38:0/1872640144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0009400 con 0x7fe00015ad90 2023-12-22T08:40:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.937+0000 7fdff7fff640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe00015d940 0x7fe00014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.937+0000 7fdffeffd640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe00015ad90 0x7fe0000c7b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdff002bee0 tx=0x7fdff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:41.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.937+0000 7fdffcff9640 1 -- 172.21.15.38:0/1872640144 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff003a6f0 con 0x7fe00015ad90 2023-12-22T08:40:41.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.937+0000 7fdffcff9640 1 -- 172.21.15.38:0/1872640144 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff003a870 con 0x7fe00015ad90 2023-12-22T08:40:41.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.937+0000 7fdffffff640 1 -- 172.21.15.38:0/1872640144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe000157de0 con 0x7fe00015ad90 2023-12-22T08:40:41.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.937+0000 7fdffcff9640 1 -- 172.21.15.38:0/1872640144 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff003ac20 con 0x7fe00015ad90 2023-12-22T08:40:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.937+0000 7fdffffff640 1 -- 172.21.15.38:0/1872640144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0000c7070 con 0x7fe00015ad90 2023-12-22T08:40:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.938+0000 7fdffffff640 1 -- 172.21.15.38:0/1872640144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0000c8090 con 0x7fe00015ad90 2023-12-22T08:40:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.940+0000 7fdffcff9640 1 -- 172.21.15.38:0/1872640144 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdff0030380 con 0x7fe00015ad90 2023-12-22T08:40:41.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.940+0000 7fdffcff9640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdfe006a430 0x7fdfe006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:41.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.941+0000 7fdffcff9640 1 -- 172.21.15.38:0/1872640144 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdff00aa450 con 0x7fe00015ad90 2023-12-22T08:40:41.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.941+0000 7fdff7fff640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdfe006a430 0x7fdfe006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:41.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.942+0000 7fdff7fff640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdfe006a430 0x7fdfe006c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8006fd0 tx=0x7fdfe8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:41.945+0000 7fdffcff9640 1 -- 172.21.15.38:0/1872640144 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdff0075910 con 0x7fe00015ad90 2023-12-22T08:40:42.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.139+0000 7fdffffff640 1 -- 172.21.15.38:0/1872640144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe000061910 con 0x7fe00015ad90 2023-12-22T08:40:42.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.140+0000 7fdffcff9640 1 -- 172.21.15.38:0/1872640144 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdff0078f30 con 0x7fe00015ad90 2023-12-22T08:40:42.143 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:40:42.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.143+0000 7fdffffff640 1 -- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdfe006a430 msgr2=0x7fdfe006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.143+0000 7fdffffff640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdfe006a430 0x7fdfe006c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8006fd0 tx=0x7fdfe8008040 comp rx=0 tx=0).stop 2023-12-22T08:40:42.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.143+0000 7fdffffff640 1 -- 172.21.15.38:0/1872640144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe00015ad90 msgr2=0x7fe0000c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.143+0000 7fdffffff640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe00015ad90 0x7fe0000c7b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdff002bee0 tx=0x7fdff00046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.143+0000 7fdffffff640 1 -- 172.21.15.38:0/1872640144 shutdown_connections 2023-12-22T08:40:42.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.143+0000 7fdffffff640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe000161bb0 0x7fe0000c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.143+0000 7fdffffff640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe00015d940 0x7fe00014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.143+0000 7fdffffff640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdfe006a430 0x7fdfe006c8f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.143+0000 7fdffffff640 1 --2- 172.21.15.38:0/1872640144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe00015ad90 0x7fe0000c7b50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.143+0000 7fdffffff640 1 -- 172.21.15.38:0/1872640144 >> 172.21.15.38:0/1872640144 conn(0x7fe0000d31c0 msgr2=0x7fe00014efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:42.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.143+0000 7fdffffff640 1 -- 172.21.15.38:0/1872640144 shutdown_connections 2023-12-22T08:40:42.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.143+0000 7fdffffff640 1 -- 172.21.15.38:0/1872640144 wait complete. 2023-12-22T08:40:42.165 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:42.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.395+0000 7f653bf16640 1 Processor -- start 2023-12-22T08:40:42.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.395+0000 7f653bf16640 1 -- start start 2023-12-22T08:40:42.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.396+0000 7f653bf16640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6534143600 0x7f653415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.396+0000 7f653bf16640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65340ceed0 0x7f653406dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.396+0000 7f653bf16640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653415ea00 con 0x7f65340cea50 2023-12-22T08:40:42.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.396+0000 7f653bf16640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6534140f70 con 0x7f65340ceed0 2023-12-22T08:40:42.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.396+0000 7f653bf16640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65340cf360 con 0x7f6534143600 2023-12-22T08:40:42.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.397+0000 7f653a4b3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65340ceed0 0x7f653406dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.397+0000 7f653a4b3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65340ceed0 0x7f653406dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49792/0 (socket says 172.21.15.38:49792) 2023-12-22T08:40:42.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.397+0000 7f653a4b3640 1 -- 172.21.15.38:0/33289530 learned_addr learned my addr 172.21.15.38:0/33289530 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:42.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.397+0000 7f6539cb2640 1 --2- 172.21.15.38:0/33289530 >> v2:172.21.15.89:3300/0 conn(0x7f6534143600 0x7f653415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.397+0000 7f653a4b3640 1 -- 172.21.15.38:0/33289530 >> v2:172.21.15.89:3300/0 conn(0x7f6534143600 msgr2=0x7f653415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:42.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.397+0000 7f653a4b3640 1 --2- 172.21.15.38:0/33289530 >> v2:172.21.15.89:3300/0 conn(0x7f6534143600 0x7f653415e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.397+0000 7f653a4b3640 1 -- 172.21.15.38:0/33289530 >> v1:172.21.15.89:6789/0 conn(0x7f65340cea50 legacy=0x7f653406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:42.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.397+0000 7f653a4b3640 1 -- 172.21.15.38:0/33289530 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653406c300 con 0x7f65340ceed0 2023-12-22T08:40:42.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.398+0000 7f653a4b3640 1 --2- 172.21.15.38:0/33289530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65340ceed0 0x7f653406dca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f652c009870 tx=0x7f652c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df36e7119e41cd0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:42.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.399+0000 7f6538cb0640 1 -- 172.21.15.38:0/33289530 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c031870 con 0x7f65340ceed0 2023-12-22T08:40:42.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.399+0000 7f6538cb0640 1 -- 172.21.15.38:0/33289530 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c0319d0 con 0x7f65340ceed0 2023-12-22T08:40:42.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.399+0000 7f6538cb0640 1 -- 172.21.15.38:0/33289530 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c031d60 con 0x7f65340ceed0 2023-12-22T08:40:42.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.399+0000 7f653bf16640 1 -- 172.21.15.38:0/33289530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65340ceed0 msgr2=0x7f653406dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.399+0000 7f653bf16640 1 --2- 172.21.15.38:0/33289530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65340ceed0 0x7f653406dca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f652c009870 tx=0x7f652c02b910 comp rx=0 tx=0).stop 2023-12-22T08:40:42.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.400+0000 7f653bf16640 1 -- 172.21.15.38:0/33289530 shutdown_connections 2023-12-22T08:40:42.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.400+0000 7f653bf16640 1 --2- 172.21.15.38:0/33289530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65340ceed0 0x7f653406dca0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.400+0000 7f653bf16640 1 --2- 172.21.15.38:0/33289530 >> v2:172.21.15.89:3300/0 conn(0x7f6534143600 0x7f653415e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.400+0000 7f653bf16640 1 -- 172.21.15.38:0/33289530 >> 172.21.15.38:0/33289530 conn(0x7f65340cfe70 msgr2=0x7f65340d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:42.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.400+0000 7f653bf16640 1 -- 172.21.15.38:0/33289530 shutdown_connections 2023-12-22T08:40:42.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.400+0000 7f653bf16640 1 -- 172.21.15.38:0/33289530 wait complete. 2023-12-22T08:40:42.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.401+0000 7f653bf16640 1 Processor -- start 2023-12-22T08:40:42.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.402+0000 7f653bf16640 1 -- start start 2023-12-22T08:40:42.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.402+0000 7f653bf16640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65340cea50 0x7f653409ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f653bf16640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65340ceed0 0x7f653413dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f653bf16640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6534143600 0x7f65340a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f653bf16640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653413e1a0 con 0x7f6534143600 2023-12-22T08:40:42.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f653bf16640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653409f8f0 con 0x7f65340ceed0 2023-12-22T08:40:42.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f653bf16640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653409f050 con 0x7f65340cea50 2023-12-22T08:40:42.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f653a4b3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6534143600 0x7f65340a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f653a4b3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6534143600 0x7f65340a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49804/0 (socket says 172.21.15.38:49804) 2023-12-22T08:40:42.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f653a4b3640 1 -- 172.21.15.38:0/3237845483 learned_addr learned my addr 172.21.15.38:0/3237845483 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:42.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f6539cb2640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65340cea50 0x7f653409ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f65394b1640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65340ceed0 0x7f653413dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f653a4b3640 1 -- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65340cea50 msgr2=0x7f653409ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f653a4b3640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65340cea50 0x7f653409ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f653a4b3640 1 -- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65340ceed0 msgr2=0x7f653413dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f653a4b3640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65340ceed0 0x7f653413dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f653a4b3640 1 -- 172.21.15.38:0/3237845483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c0094d0 con 0x7f6534143600 2023-12-22T08:40:42.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.403+0000 7f6539cb2640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65340cea50 0x7f653409ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:42.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.404+0000 7f653a4b3640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6534143600 0x7f65340a0460 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f652c02b950 tx=0x7f652c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:42.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.404+0000 7f652a7fc640 1 -- 172.21.15.38:0/3237845483 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c03ac60 con 0x7f6534143600 2023-12-22T08:40:42.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.404+0000 7f652a7fc640 1 -- 172.21.15.38:0/3237845483 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c03adc0 con 0x7f6534143600 2023-12-22T08:40:42.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.404+0000 7f652a7fc640 1 -- 172.21.15.38:0/3237845483 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c0445f0 con 0x7f6534143600 2023-12-22T08:40:42.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.404+0000 7f653bf16640 1 -- 172.21.15.38:0/3237845483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653409f330 con 0x7f6534143600 2023-12-22T08:40:42.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.404+0000 7f653bf16640 1 -- 172.21.15.38:0/3237845483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653406fcb0 con 0x7f6534143600 2023-12-22T08:40:42.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.405+0000 7f653bf16640 1 -- 172.21.15.38:0/3237845483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653406fea0 con 0x7f6534143600 2023-12-22T08:40:42.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.406+0000 7f652a7fc640 1 -- 172.21.15.38:0/3237845483 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f652c04d450 con 0x7f6534143600 2023-12-22T08:40:42.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.407+0000 7f652a7fc640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f651806a430 0x7f651806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.407+0000 7f652a7fc640 1 -- 172.21.15.38:0/3237845483 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f652c02d040 con 0x7f6534143600 2023-12-22T08:40:42.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.408+0000 7f6539cb2640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f651806a430 0x7f651806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.409+0000 7f6539cb2640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f651806a430 0x7f651806c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6530007330 tx=0x7f653000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:42.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.412+0000 7f652a7fc640 1 -- 172.21.15.38:0/3237845483 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f652c0764e0 con 0x7f6534143600 2023-12-22T08:40:42.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.605+0000 7f653bf16640 1 -- 172.21.15.38:0/3237845483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6534061910 con 0x7f6534143600 2023-12-22T08:40:42.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.606+0000 7f652a7fc640 1 -- 172.21.15.38:0/3237845483 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f652c0350a0 con 0x7f6534143600 2023-12-22T08:40:42.609 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:40:42.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.609+0000 7f653bf16640 1 -- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f651806a430 msgr2=0x7f651806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.609+0000 7f653bf16640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f651806a430 0x7f651806c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6530007330 tx=0x7f653000b040 comp rx=0 tx=0).stop 2023-12-22T08:40:42.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.609+0000 7f653bf16640 1 -- 172.21.15.38:0/3237845483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6534143600 msgr2=0x7f65340a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.609+0000 7f653bf16640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6534143600 0x7f65340a0460 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f652c02b950 tx=0x7f652c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.609+0000 7f653bf16640 1 -- 172.21.15.38:0/3237845483 shutdown_connections 2023-12-22T08:40:42.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.609+0000 7f653bf16640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f651806a430 0x7f651806c8f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.609+0000 7f653bf16640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6534143600 0x7f65340a0460 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.609+0000 7f653bf16640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65340ceed0 0x7f653413dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.609+0000 7f653bf16640 1 --2- 172.21.15.38:0/3237845483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65340cea50 0x7f653409ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.609+0000 7f653bf16640 1 -- 172.21.15.38:0/3237845483 >> 172.21.15.38:0/3237845483 conn(0x7f65340cfe70 msgr2=0x7f65340d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:42.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.609+0000 7f653bf16640 1 -- 172.21.15.38:0/3237845483 shutdown_connections 2023-12-22T08:40:42.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.609+0000 7f653bf16640 1 -- 172.21.15.38:0/3237845483 wait complete. 2023-12-22T08:40:42.641 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-12-22T08:40:42.641 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-12-22T08:40:42.642 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:42.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.872+0000 7f3e44017640 1 Processor -- start 2023-12-22T08:40:42.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.872+0000 7f3e44017640 1 -- start start 2023-12-22T08:40:42.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.874+0000 7f3e44017640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3e3c0b3f90 0x7f3e3c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.874+0000 7f3e44017640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c15eb20 con 0x7f3e3c06ca50 2023-12-22T08:40:42.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.874+0000 7f3e44017640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c070770 con 0x7f3e3c15e740 2023-12-22T08:40:42.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.874+0000 7f3e44017640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c06e650 con 0x7f3e3c0b3f90 2023-12-22T08:40:42.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.875+0000 7f3e415b2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3e3c0b3f90 0x7f3e3c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.875+0000 7f3e415b2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3e3c0b3f90 0x7f3e3c15db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49818/0 (socket says 172.21.15.38:49818) 2023-12-22T08:40:42.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.875+0000 7f3e415b2640 1 -- 172.21.15.38:0/1755789228 learned_addr learned my addr 172.21.15.38:0/1755789228 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:42.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.875+0000 7f3e415b2640 1 -- 172.21.15.38:0/1755789228 >> v1:172.21.15.89:6789/0 conn(0x7f3e3c15e740 legacy=0x7f3e3c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.875+0000 7f3e415b2640 1 -- 172.21.15.38:0/1755789228 >> v1:172.21.15.38:6789/0 conn(0x7f3e3c06ca50 legacy=0x7f3e3c070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.875+0000 7f3e415b2640 1 -- 172.21.15.38:0/1755789228 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c06d180 con 0x7f3e3c0b3f90 2023-12-22T08:40:42.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.875+0000 7f3e40db1640 1 -- 172.21.15.38:0/1755789228 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118980409 0 0) 0x7f3e3c15eb20 con 0x7f3e3c06ca50 2023-12-22T08:40:42.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.876+0000 7f3e415b2640 1 --2- 172.21.15.38:0/1755789228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e3c0b3f90 0x7f3e3c15db30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c009870 tx=0x7f3e2c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05f5e2f68c69c66 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:42.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.877+0000 7f3e40db1640 1 -- 172.21.15.38:0/1755789228 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c031870 con 0x7f3e3c0b3f90 2023-12-22T08:40:42.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.877+0000 7f3e40db1640 1 -- 172.21.15.38:0/1755789228 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c0319d0 con 0x7f3e3c0b3f90 2023-12-22T08:40:42.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.877+0000 7f3e40db1640 1 -- 172.21.15.38:0/1755789228 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c031d60 con 0x7f3e3c0b3f90 2023-12-22T08:40:42.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.877+0000 7f3e44017640 1 -- 172.21.15.38:0/1755789228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e3c0b3f90 msgr2=0x7f3e3c15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.877+0000 7f3e44017640 1 --2- 172.21.15.38:0/1755789228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e3c0b3f90 0x7f3e3c15db30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c009870 tx=0x7f3e2c02b910 comp rx=0 tx=0).stop 2023-12-22T08:40:42.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.877+0000 7f3e44017640 1 -- 172.21.15.38:0/1755789228 shutdown_connections 2023-12-22T08:40:42.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.877+0000 7f3e44017640 1 --2- 172.21.15.38:0/1755789228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e3c0b3f90 0x7f3e3c15db30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.877+0000 7f3e44017640 1 -- 172.21.15.38:0/1755789228 >> 172.21.15.38:0/1755789228 conn(0x7f3e3c0cfea0 msgr2=0x7f3e3c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:42.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.877+0000 7f3e44017640 1 -- 172.21.15.38:0/1755789228 shutdown_connections 2023-12-22T08:40:42.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.878+0000 7f3e44017640 1 -- 172.21.15.38:0/1755789228 wait complete. 2023-12-22T08:40:42.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.879+0000 7f3e44017640 1 Processor -- start 2023-12-22T08:40:42.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.879+0000 7f3e44017640 1 -- start start 2023-12-22T08:40:42.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.880+0000 7f3e44017640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e3c06ca50 0x7f3e3c149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.880+0000 7f3e44017640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e3c0b3f90 0x7f3e3c1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.880+0000 7f3e44017640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e3c15e740 0x7f3e3c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.880+0000 7f3e44017640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c158fd0 con 0x7f3e3c15e740 2023-12-22T08:40:42.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.880+0000 7f3e44017640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c158390 con 0x7f3e3c06ca50 2023-12-22T08:40:42.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.880+0000 7f3e44017640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c14a330 con 0x7f3e3c0b3f90 2023-12-22T08:40:42.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.881+0000 7f3e425b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e3c15e740 0x7f3e3c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.881+0000 7f3e425b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e3c15e740 0x7f3e3c15c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49826/0 (socket says 172.21.15.38:49826) 2023-12-22T08:40:42.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.881+0000 7f3e425b4640 1 -- 172.21.15.38:0/4285150769 learned_addr learned my addr 172.21.15.38:0/4285150769 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:42.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.881+0000 7f3e41db3640 1 --2- 172.21.15.38:0/4285150769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e3c06ca50 0x7f3e3c149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.881+0000 7f3e425b4640 1 -- 172.21.15.38:0/4285150769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e3c0b3f90 msgr2=0x7f3e3c1593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.881+0000 7f3e425b4640 1 --2- 172.21.15.38:0/4285150769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e3c0b3f90 0x7f3e3c1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.881+0000 7f3e425b4640 1 -- 172.21.15.38:0/4285150769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e3c06ca50 msgr2=0x7f3e3c149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.881+0000 7f3e425b4640 1 --2- 172.21.15.38:0/4285150769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e3c06ca50 0x7f3e3c149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.881+0000 7f3e425b4640 1 -- 172.21.15.38:0/4285150769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c0094d0 con 0x7f3e3c15e740 2023-12-22T08:40:42.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.882+0000 7f3e425b4640 1 --2- 172.21.15.38:0/4285150769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e3c15e740 0x7f3e3c15c8c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3e34001560 tx=0x7f3e3400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:42.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.882+0000 7f3e327fc640 1 -- 172.21.15.38:0/4285150769 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34003da0 con 0x7f3e3c15e740 2023-12-22T08:40:42.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.882+0000 7f3e327fc640 1 -- 172.21.15.38:0/4285150769 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e34005070 con 0x7f3e3c15e740 2023-12-22T08:40:42.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.882+0000 7f3e327fc640 1 -- 172.21.15.38:0/4285150769 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34005420 con 0x7f3e3c15e740 2023-12-22T08:40:42.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.882+0000 7f3e44017640 1 -- 172.21.15.38:0/4285150769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c158630 con 0x7f3e3c15e740 2023-12-22T08:40:42.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.882+0000 7f3e44017640 1 -- 172.21.15.38:0/4285150769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c158bf0 con 0x7f3e3c15e740 2023-12-22T08:40:42.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.883+0000 7f3e44017640 1 -- 172.21.15.38:0/4285150769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c159110 con 0x7f3e3c15e740 2023-12-22T08:40:42.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.884+0000 7f3e327fc640 1 -- 172.21.15.38:0/4285150769 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e34005580 con 0x7f3e3c15e740 2023-12-22T08:40:42.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.885+0000 7f3e327fc640 1 --2- 172.21.15.38:0/4285150769 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e2006a430 0x7f3e2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.885+0000 7f3e327fc640 1 -- 172.21.15.38:0/4285150769 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e340882a0 con 0x7f3e3c15e740 2023-12-22T08:40:42.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.886+0000 7f3e41db3640 1 --2- 172.21.15.38:0/4285150769 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e2006a430 0x7f3e2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.887+0000 7f3e41db3640 1 --2- 172.21.15.38:0/4285150769 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e2006a430 0x7f3e2006c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3e38000f60 tx=0x7f3e38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:42.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:42.890+0000 7f3e327fc640 1 -- 172.21.15.38:0/4285150769 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3e3c159110 con 0x7f3e3c15e740 2023-12-22T08:40:43.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.084+0000 7f3e44017640 1 -- 172.21.15.38:0/4285150769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e3c159110 con 0x7f3e3c15e740 2023-12-22T08:40:43.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.086+0000 7f3e327fc640 1 -- 172.21.15.38:0/4285150769 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f3e3c159110 con 0x7f3e3c15e740 2023-12-22T08:40:43.089 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:43.089 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:59.604518+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.088+0000 7f3e44017640 1 -- 172.21.15.38:0/4285150769 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e2006a430 msgr2=0x7f3e2006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.089+0000 7f3e44017640 1 --2- 172.21.15.38:0/4285150769 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e2006a430 0x7f3e2006c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3e38000f60 tx=0x7f3e38009040 comp rx=0 tx=0).stop 2023-12-22T08:40:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.089+0000 7f3e44017640 1 -- 172.21.15.38:0/4285150769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e3c15e740 msgr2=0x7f3e3c15c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.089+0000 7f3e44017640 1 --2- 172.21.15.38:0/4285150769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e3c15e740 0x7f3e3c15c8c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3e34001560 tx=0x7f3e3400cc70 comp rx=0 tx=0).stop 2023-12-22T08:40:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.089+0000 7f3e44017640 1 -- 172.21.15.38:0/4285150769 shutdown_connections 2023-12-22T08:40:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.089+0000 7f3e44017640 1 --2- 172.21.15.38:0/4285150769 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e2006a430 0x7f3e2006c8f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.089+0000 7f3e44017640 1 --2- 172.21.15.38:0/4285150769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e3c15e740 0x7f3e3c15c8c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.089+0000 7f3e44017640 1 --2- 172.21.15.38:0/4285150769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e3c0b3f90 0x7f3e3c1593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.089+0000 7f3e44017640 1 --2- 172.21.15.38:0/4285150769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e3c06ca50 0x7f3e3c149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.089+0000 7f3e44017640 1 -- 172.21.15.38:0/4285150769 >> 172.21.15.38:0/4285150769 conn(0x7f3e3c0cfea0 msgr2=0x7f3e3c160f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:43.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.089+0000 7f3e44017640 1 -- 172.21.15.38:0/4285150769 shutdown_connections 2023-12-22T08:40:43.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.089+0000 7f3e44017640 1 -- 172.21.15.38:0/4285150769 wait complete. 2023-12-22T08:40:43.111 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:39:56.873963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:39:57.616447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:43.112 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:43.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.337+0000 7f58a4e56640 1 Processor -- start 2023-12-22T08:40:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.337+0000 7f58a4e56640 1 -- start start 2023-12-22T08:40:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.339+0000 7f58a4e56640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f58a00ceed0 0x7f58a006dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.339+0000 7f58a4e56640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a0140f70 con 0x7f58a00cea50 2023-12-22T08:40:43.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.339+0000 7f58a4e56640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a00cf360 con 0x7f58a0143600 2023-12-22T08:40:43.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.339+0000 7f58a4e56640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a006c300 con 0x7f58a00ceed0 2023-12-22T08:40:43.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.339+0000 7f589ed9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f58a00ceed0 0x7f58a006dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.339+0000 7f5895d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f58a00cea50 0x7f58a006d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42886/0 (socket says 172.21.15.38:42886) 2023-12-22T08:40:43.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.339+0000 7f5895d9b640 1 -- 172.21.15.38:0/207796748 learned_addr learned my addr 172.21.15.38:0/207796748 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:43.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.340+0000 7f589ed9d640 1 -- 172.21.15.38:0/207796748 >> v1:172.21.15.89:6789/0 conn(0x7f58a0143600 legacy=0x7f58a015e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.340+0000 7f589ed9d640 1 -- 172.21.15.38:0/207796748 >> v1:172.21.15.38:6789/0 conn(0x7f58a00cea50 legacy=0x7f58a006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.340+0000 7f589ed9d640 1 -- 172.21.15.38:0/207796748 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a006c5e0 con 0x7f58a00ceed0 2023-12-22T08:40:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.341+0000 7f589ed9d640 1 --2- 172.21.15.38:0/207796748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58a00ceed0 0x7f58a006dca0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5898009d90 tx=0x7f589802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a285af4b637904 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.342+0000 7f589dd9b640 1 -- 172.21.15.38:0/207796748 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589802cc60 con 0x7f58a00ceed0 2023-12-22T08:40:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.342+0000 7f589dd9b640 1 -- 172.21.15.38:0/207796748 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589802cdc0 con 0x7f58a00ceed0 2023-12-22T08:40:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.342+0000 7f589dd9b640 1 -- 172.21.15.38:0/207796748 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898034660 con 0x7f58a00ceed0 2023-12-22T08:40:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.343+0000 7f58a4e56640 1 -- 172.21.15.38:0/207796748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58a00ceed0 msgr2=0x7f58a006dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.343+0000 7f58a4e56640 1 --2- 172.21.15.38:0/207796748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58a00ceed0 0x7f58a006dca0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5898009d90 tx=0x7f589802beb0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.343+0000 7f58a4e56640 1 -- 172.21.15.38:0/207796748 shutdown_connections 2023-12-22T08:40:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.343+0000 7f58a4e56640 1 --2- 172.21.15.38:0/207796748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58a00ceed0 0x7f58a006dca0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.343+0000 7f58a4e56640 1 -- 172.21.15.38:0/207796748 >> 172.21.15.38:0/207796748 conn(0x7f58a00cfe70 msgr2=0x7f58a00d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:43.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.343+0000 7f58a4e56640 1 -- 172.21.15.38:0/207796748 shutdown_connections 2023-12-22T08:40:43.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.343+0000 7f58a4e56640 1 -- 172.21.15.38:0/207796748 wait complete. 2023-12-22T08:40:43.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.345+0000 7f58a4e56640 1 Processor -- start 2023-12-22T08:40:43.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.345+0000 7f58a4e56640 1 -- start start 2023-12-22T08:40:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.346+0000 7f58a4e56640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a00cea50 0x7f58a0155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.346+0000 7f58a4e56640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58a00ceed0 0x7f58a0157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.346+0000 7f58a4e56640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a0143600 0x7f58a01f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.346+0000 7f58a4e56640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0154b30 con 0x7f58a00ceed0 2023-12-22T08:40:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.346+0000 7f58a4e56640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00a0e00 con 0x7f58a0143600 2023-12-22T08:40:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.346+0000 7f58a4e56640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0154d80 con 0x7f58a00cea50 2023-12-22T08:40:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.346+0000 7f5895d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58a00ceed0 0x7f58a0157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.346+0000 7f5895d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58a00ceed0 0x7f58a0157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49844/0 (socket says 172.21.15.38:49844) 2023-12-22T08:40:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.346+0000 7f5895d9b640 1 -- 172.21.15.38:0/1934347911 learned_addr learned my addr 172.21.15.38:0/1934347911 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:43.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.347+0000 7f589ed9d640 1 --2- 172.21.15.38:0/1934347911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a0143600 0x7f58a01f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.347+0000 7f5895d9b640 1 -- 172.21.15.38:0/1934347911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a00cea50 msgr2=0x7f58a0155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.347+0000 7f5895d9b640 1 --2- 172.21.15.38:0/1934347911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a00cea50 0x7f58a0155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.347+0000 7f5895d9b640 1 -- 172.21.15.38:0/1934347911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a0143600 msgr2=0x7f58a01f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.347+0000 7f5895d9b640 1 --2- 172.21.15.38:0/1934347911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a0143600 0x7f58a01f6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.347+0000 7f5895d9b640 1 -- 172.21.15.38:0/1934347911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898009a70 con 0x7f58a00ceed0 2023-12-22T08:40:43.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.347+0000 7f5895d9b640 1 --2- 172.21.15.38:0/1934347911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58a00ceed0 0x7f58a0157470 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f588800c480 tx=0x7f588800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.347+0000 7f58977fe640 1 -- 172.21.15.38:0/1934347911 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888005ce0 con 0x7f58a00ceed0 2023-12-22T08:40:43.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.347+0000 7f58977fe640 1 -- 172.21.15.38:0/1934347911 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5888005e40 con 0x7f58a00ceed0 2023-12-22T08:40:43.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.347+0000 7f58977fe640 1 -- 172.21.15.38:0/1934347911 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880072f0 con 0x7f58a00ceed0 2023-12-22T08:40:43.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.347+0000 7f58a4e56640 1 -- 172.21.15.38:0/1934347911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a00a0840 con 0x7f58a00ceed0 2023-12-22T08:40:43.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.347+0000 7f58a4e56640 1 -- 172.21.15.38:0/1934347911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a0155060 con 0x7f58a00ceed0 2023-12-22T08:40:43.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.349+0000 7f58a4e56640 1 -- 172.21.15.38:0/1934347911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a0155280 con 0x7f58a00ceed0 2023-12-22T08:40:43.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.349+0000 7f58977fe640 1 -- 172.21.15.38:0/1934347911 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5888007510 con 0x7f58a00ceed0 2023-12-22T08:40:43.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.350+0000 7f58977fe640 1 --2- 172.21.15.38:0/1934347911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f588006a430 0x7f588006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.350+0000 7f58977fe640 1 -- 172.21.15.38:0/1934347911 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5888087e10 con 0x7f58a00ceed0 2023-12-22T08:40:43.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.351+0000 7f589e59c640 1 --2- 172.21.15.38:0/1934347911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f588006a430 0x7f588006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.352+0000 7f589e59c640 1 --2- 172.21.15.38:0/1934347911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f588006a430 0x7f588006c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5890003cc0 tx=0x7f58900079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.355+0000 7f58977fe640 1 -- 172.21.15.38:0/1934347911 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f588808b030 con 0x7f58a00ceed0 2023-12-22T08:40:43.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.551+0000 7f58a4e56640 1 -- 172.21.15.38:0/1934347911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58a0061910 con 0x7f58a00ceed0 2023-12-22T08:40:43.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.552+0000 7f58977fe640 1 -- 172.21.15.38:0/1934347911 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58880170a0 con 0x7f58a00ceed0 2023-12-22T08:40:43.554 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:40:43.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.554+0000 7f58a4e56640 1 -- 172.21.15.38:0/1934347911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f588006a430 msgr2=0x7f588006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.554+0000 7f58a4e56640 1 --2- 172.21.15.38:0/1934347911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f588006a430 0x7f588006c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5890003cc0 tx=0x7f58900079b0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.554+0000 7f58a4e56640 1 -- 172.21.15.38:0/1934347911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58a00ceed0 msgr2=0x7f58a0157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.554+0000 7f58a4e56640 1 --2- 172.21.15.38:0/1934347911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58a00ceed0 0x7f58a0157470 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f588800c480 tx=0x7f588800c940 comp rx=0 tx=0).stop 2023-12-22T08:40:43.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.554+0000 7f58a4e56640 1 -- 172.21.15.38:0/1934347911 shutdown_connections 2023-12-22T08:40:43.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.554+0000 7f58a4e56640 1 --2- 172.21.15.38:0/1934347911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a0143600 0x7f58a01f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.554+0000 7f58a4e56640 1 --2- 172.21.15.38:0/1934347911 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f588006a430 0x7f588006c8f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.554+0000 7f58a4e56640 1 --2- 172.21.15.38:0/1934347911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58a00ceed0 0x7f58a0157470 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.554+0000 7f58a4e56640 1 --2- 172.21.15.38:0/1934347911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58a00cea50 0x7f58a0155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.554+0000 7f58a4e56640 1 -- 172.21.15.38:0/1934347911 >> 172.21.15.38:0/1934347911 conn(0x7f58a00cfe70 msgr2=0x7f58a00d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:43.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.554+0000 7f58a4e56640 1 -- 172.21.15.38:0/1934347911 shutdown_connections 2023-12-22T08:40:43.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.554+0000 7f58a4e56640 1 -- 172.21.15.38:0/1934347911 wait complete. 2023-12-22T08:40:43.577 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:43.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.798+0000 7f7740825640 1 Processor -- start 2023-12-22T08:40:43.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.799+0000 7f7740825640 1 -- start start 2023-12-22T08:40:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.800+0000 7f7740825640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f773c09c980 0x7f773c15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.800+0000 7f7740825640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f773c071460 0x7f773c071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.800+0000 7f7740825640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c15edf0 con 0x7f773c15b0e0 2023-12-22T08:40:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.800+0000 7f7740825640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c071db0 con 0x7f773c09c980 2023-12-22T08:40:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.800+0000 7f7740825640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c15bd90 con 0x7f773c071460 2023-12-22T08:40:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.800+0000 7f773b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f773c071460 0x7f773c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.801+0000 7f773a59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f773c09c980 0x7f773c15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.801+0000 7f773a59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f773c09c980 0x7f773c15c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:45208/0 (socket says 172.21.15.38:45208) 2023-12-22T08:40:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.801+0000 7f773b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f773c071460 0x7f773c071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:54366/0 (socket says 172.21.15.38:54366) 2023-12-22T08:40:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.801+0000 7f773a59c640 1 -- 172.21.15.38:0/3343277992 learned_addr learned my addr 172.21.15.38:0/3343277992 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.801+0000 7f773a59c640 1 -- 172.21.15.38:0/3343277992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f773c071460 msgr2=0x7f773c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:43.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.801+0000 7f773a59c640 1 --2- 172.21.15.38:0/3343277992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f773c071460 0x7f773c071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.801+0000 7f773a59c640 1 -- 172.21.15.38:0/3343277992 >> v1:172.21.15.89:6789/0 conn(0x7f773c15b0e0 legacy=0x7f773c15b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.801+0000 7f773a59c640 1 -- 172.21.15.38:0/3343277992 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c15c070 con 0x7f773c09c980 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.801+0000 7f773b59e640 1 --2- 172.21.15.38:0/3343277992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f773c071460 0x7f773c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.803+0000 7f773a59c640 1 --2- 172.21.15.38:0/3343277992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f773c09c980 0x7f773c15c9c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7730009870 tx=0x7f773002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ad320858aad7d52 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.803+0000 7f7739d9b640 1 -- 172.21.15.38:0/3343277992 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300317c0 con 0x7f773c09c980 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.803+0000 7f7739d9b640 1 -- 172.21.15.38:0/3343277992 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7730031920 con 0x7f773c09c980 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.803+0000 7f7739d9b640 1 -- 172.21.15.38:0/3343277992 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730031cb0 con 0x7f773c09c980 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.804+0000 7f7740825640 1 -- 172.21.15.38:0/3343277992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f773c09c980 msgr2=0x7f773c15c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.804+0000 7f7740825640 1 --2- 172.21.15.38:0/3343277992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f773c09c980 0x7f773c15c9c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7730009870 tx=0x7f773002b860 comp rx=0 tx=0).stop 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.804+0000 7f7740825640 1 -- 172.21.15.38:0/3343277992 shutdown_connections 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.804+0000 7f7740825640 1 --2- 172.21.15.38:0/3343277992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f773c09c980 0x7f773c15c9c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.804+0000 7f7740825640 1 --2- 172.21.15.38:0/3343277992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f773c071460 0x7f773c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.804+0000 7f7740825640 1 -- 172.21.15.38:0/3343277992 >> 172.21.15.38:0/3343277992 conn(0x7f773c0cf000 msgr2=0x7f773c0cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:43.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.804+0000 7f7740825640 1 -- 172.21.15.38:0/3343277992 shutdown_connections 2023-12-22T08:40:43.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.804+0000 7f7740825640 1 -- 172.21.15.38:0/3343277992 wait complete. 2023-12-22T08:40:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.806+0000 7f7740825640 1 Processor -- start 2023-12-22T08:40:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.806+0000 7f7740825640 1 -- start start 2023-12-22T08:40:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.807+0000 7f7740825640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f773c071460 0x7f773c1f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.807+0000 7f7740825640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f773c09c980 0x7f773c0b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.807+0000 7f7740825640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f773c15b0e0 0x7f773c0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.807+0000 7f7740825640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0a4690 con 0x7f773c071460 2023-12-22T08:40:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.807+0000 7f7740825640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0a3df0 con 0x7f773c09c980 2023-12-22T08:40:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.807+0000 7f7740825640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0a40d0 con 0x7f773c15b0e0 2023-12-22T08:40:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.808+0000 7f773ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f773c071460 0x7f773c1f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.808+0000 7f773ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f773c071460 0x7f773c1f2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49852/0 (socket says 172.21.15.38:49852) 2023-12-22T08:40:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.808+0000 7f773ad9d640 1 -- 172.21.15.38:0/1716036555 learned_addr learned my addr 172.21.15.38:0/1716036555 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.808+0000 7f773b59e640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f773c15b0e0 0x7f773c0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.808+0000 7f773a59c640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f773c09c980 0x7f773c0b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.808+0000 7f773ad9d640 1 -- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f773c15b0e0 msgr2=0x7f773c0b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.808+0000 7f773ad9d640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f773c15b0e0 0x7f773c0b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.808+0000 7f773ad9d640 1 -- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f773c09c980 msgr2=0x7f773c0b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.808+0000 7f773ad9d640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f773c09c980 0x7f773c0b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.808+0000 7f773ad9d640 1 -- 172.21.15.38:0/1716036555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7734009a70 con 0x7f773c071460 2023-12-22T08:40:43.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.809+0000 7f773ad9d640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f773c071460 0x7f773c1f2ee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f772c00c450 tx=0x7f772c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.809+0000 7f77237fe640 1 -- 172.21.15.38:0/1716036555 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0052d0 con 0x7f773c071460 2023-12-22T08:40:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.809+0000 7f77237fe640 1 -- 172.21.15.38:0/1716036555 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c005430 con 0x7f773c071460 2023-12-22T08:40:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.809+0000 7f77237fe640 1 -- 172.21.15.38:0/1716036555 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c012870 con 0x7f773c071460 2023-12-22T08:40:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.809+0000 7f7740825640 1 -- 172.21.15.38:0/1716036555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77300094d0 con 0x7f773c071460 2023-12-22T08:40:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.809+0000 7f7740825640 1 -- 172.21.15.38:0/1716036555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c1570d0 con 0x7f773c071460 2023-12-22T08:40:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.810+0000 7f7740825640 1 -- 172.21.15.38:0/1716036555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773c0cec20 con 0x7f773c071460 2023-12-22T08:40:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.811+0000 7f77237fe640 1 -- 172.21.15.38:0/1716036555 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f772c0129d0 con 0x7f773c071460 2023-12-22T08:40:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.812+0000 7f77237fe640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f772806a430 0x7f772806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.812+0000 7f77237fe640 1 -- 172.21.15.38:0/1716036555 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f772c0885c0 con 0x7f773c071460 2023-12-22T08:40:43.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.813+0000 7f773a59c640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f772806a430 0x7f772806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.814+0000 7f773a59c640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f772806a430 0x7f772806c8f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7730036000 tx=0x7f773003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:43.816+0000 7f77237fe640 1 -- 172.21.15.38:0/1716036555 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f772c053a80 con 0x7f773c071460 2023-12-22T08:40:44.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.014+0000 7f7740825640 1 -- 172.21.15.38:0/1716036555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f773c061910 con 0x7f773c071460 2023-12-22T08:40:44.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.016+0000 7f77237fe640 1 -- 172.21.15.38:0/1716036555 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f772c0570a0 con 0x7f773c071460 2023-12-22T08:40:44.018 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:40:44.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.018+0000 7f7740825640 1 -- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f772806a430 msgr2=0x7f772806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.018+0000 7f7740825640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f772806a430 0x7f772806c8f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7730036000 tx=0x7f773003d040 comp rx=0 tx=0).stop 2023-12-22T08:40:44.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.018+0000 7f7740825640 1 -- 172.21.15.38:0/1716036555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f773c071460 msgr2=0x7f773c1f2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.018+0000 7f7740825640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f773c071460 0x7f773c1f2ee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f772c00c450 tx=0x7f772c00c910 comp rx=0 tx=0).stop 2023-12-22T08:40:44.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.019+0000 7f7740825640 1 -- 172.21.15.38:0/1716036555 shutdown_connections 2023-12-22T08:40:44.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.019+0000 7f7740825640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f773c15b0e0 0x7f773c0b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.019+0000 7f7740825640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f773c09c980 0x7f773c0b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.019+0000 7f7740825640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f772806a430 0x7f772806c8f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.019+0000 7f7740825640 1 --2- 172.21.15.38:0/1716036555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f773c071460 0x7f773c1f2ee0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.019+0000 7f7740825640 1 -- 172.21.15.38:0/1716036555 >> 172.21.15.38:0/1716036555 conn(0x7f773c0cf000 msgr2=0x7f773c15d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:44.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.019+0000 7f7740825640 1 -- 172.21.15.38:0/1716036555 shutdown_connections 2023-12-22T08:40:44.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.019+0000 7f7740825640 1 -- 172.21.15.38:0/1716036555 wait complete. 2023-12-22T08:40:44.040 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.267+0000 7fada3fff640 1 Processor -- start 2023-12-22T08:40:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.267+0000 7fada3fff640 1 -- start start 2023-12-22T08:40:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.269+0000 7fada3fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fada4070b70 0x7fada406bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.269+0000 7fada3fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada406c4d0 0x7fada4070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.269+0000 7fada3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fada4071490 0x7fada40cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.269+0000 7fada3fff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada406d5f0 con 0x7fada4070b70 2023-12-22T08:40:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.269+0000 7fada3fff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada4144fa0 con 0x7fada4071490 2023-12-22T08:40:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.269+0000 7fada3fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada406da80 con 0x7fada406c4d0 2023-12-22T08:40:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.269+0000 7fada2ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fada4070b70 0x7fada406bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.269+0000 7fada2ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fada4070b70 0x7fada406bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49866/0 (socket says 172.21.15.38:49866) 2023-12-22T08:40:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.269+0000 7fada2ffd640 1 -- 172.21.15.38:0/3175066406 learned_addr learned my addr 172.21.15.38:0/3175066406 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.269+0000 7fada27fc640 1 --2- 172.21.15.38:0/3175066406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada406c4d0 0x7fada4070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.269+0000 7fada37fe640 1 --2- 172.21.15.38:0/3175066406 >> v2:172.21.15.89:3300/0 conn(0x7fada4071490 0x7fada40cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.270+0000 7fada2ffd640 1 -- 172.21.15.38:0/3175066406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada406c4d0 msgr2=0x7fada4070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.270+0000 7fada2ffd640 1 --2- 172.21.15.38:0/3175066406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada406c4d0 0x7fada4070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.270+0000 7fada2ffd640 1 -- 172.21.15.38:0/3175066406 >> v2:172.21.15.89:3300/0 conn(0x7fada4071490 msgr2=0x7fada40cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.270+0000 7fada2ffd640 1 --2- 172.21.15.38:0/3175066406 >> v2:172.21.15.89:3300/0 conn(0x7fada4071490 0x7fada40cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.270+0000 7fada2ffd640 1 -- 172.21.15.38:0/3175066406 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada406c9e0 con 0x7fada4070b70 2023-12-22T08:40:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.270+0000 7fada27fc640 1 --2- 172.21.15.38:0/3175066406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada406c4d0 0x7fada4070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.271+0000 7fada2ffd640 1 --2- 172.21.15.38:0/3175066406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fada4070b70 0x7fada406bf90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fada4070540 tx=0x7fad9402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69cf8b254a33dc79 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.271+0000 7fada1ffb640 1 -- 172.21.15.38:0/3175066406 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94031870 con 0x7fada4070b70 2023-12-22T08:40:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.271+0000 7fada1ffb640 1 -- 172.21.15.38:0/3175066406 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad940319d0 con 0x7fada4070b70 2023-12-22T08:40:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.271+0000 7fada1ffb640 1 -- 172.21.15.38:0/3175066406 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94031d60 con 0x7fada4070b70 2023-12-22T08:40:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.272+0000 7fada3fff640 1 -- 172.21.15.38:0/3175066406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fada4070b70 msgr2=0x7fada406bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.272+0000 7fada3fff640 1 --2- 172.21.15.38:0/3175066406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fada4070b70 0x7fada406bf90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fada4070540 tx=0x7fad9402b910 comp rx=0 tx=0).stop 2023-12-22T08:40:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.272+0000 7fada3fff640 1 -- 172.21.15.38:0/3175066406 shutdown_connections 2023-12-22T08:40:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.272+0000 7fada3fff640 1 --2- 172.21.15.38:0/3175066406 >> v2:172.21.15.89:3300/0 conn(0x7fada4071490 0x7fada40cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.272+0000 7fada3fff640 1 --2- 172.21.15.38:0/3175066406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada406c4d0 0x7fada4070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.272+0000 7fada3fff640 1 --2- 172.21.15.38:0/3175066406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fada4070b70 0x7fada406bf90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.272+0000 7fada3fff640 1 -- 172.21.15.38:0/3175066406 >> 172.21.15.38:0/3175066406 conn(0x7fada40b0b60 msgr2=0x7fada40b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.272+0000 7fada3fff640 1 -- 172.21.15.38:0/3175066406 shutdown_connections 2023-12-22T08:40:44.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.272+0000 7fada3fff640 1 -- 172.21.15.38:0/3175066406 wait complete. 2023-12-22T08:40:44.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.274+0000 7fada3fff640 1 Processor -- start 2023-12-22T08:40:44.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.274+0000 7fada3fff640 1 -- start start 2023-12-22T08:40:44.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.275+0000 7fada3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fada406c4d0 0x7fada415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.275+0000 7fada3fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada4070b70 0x7fada41f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.275+0000 7fada3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada4071490 0x7fada4140200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.275+0000 7fada3fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada415cb90 con 0x7fada406c4d0 2023-12-22T08:40:44.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.275+0000 7fada3fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada41f4a90 con 0x7fada4071490 2023-12-22T08:40:44.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.275+0000 7fada3fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada4140740 con 0x7fada4070b70 2023-12-22T08:40:44.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.275+0000 7fada2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fada406c4d0 0x7fada415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.275+0000 7fada2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fada406c4d0 0x7fada415b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49882/0 (socket says 172.21.15.38:49882) 2023-12-22T08:40:44.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.275+0000 7fada2ffd640 1 -- 172.21.15.38:0/2496716560 learned_addr learned my addr 172.21.15.38:0/2496716560 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:44.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.275+0000 7fada27fc640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada4070b70 0x7fada41f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.275+0000 7fada37fe640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada4071490 0x7fada4140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.276+0000 7fada2ffd640 1 -- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada4070b70 msgr2=0x7fada41f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.276+0000 7fada2ffd640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada4070b70 0x7fada41f4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.276+0000 7fada2ffd640 1 -- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada4071490 msgr2=0x7fada4140200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.276+0000 7fada2ffd640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada4071490 0x7fada4140200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.276+0000 7fada2ffd640 1 -- 172.21.15.38:0/2496716560 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad940094d0 con 0x7fada406c4d0 2023-12-22T08:40:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.276+0000 7fada37fe640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada4071490 0x7fada4140200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.276+0000 7fada2ffd640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fada406c4d0 0x7fada415b9a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fad9402b950 tx=0x7fad940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.276+0000 7fad8bfff640 1 -- 172.21.15.38:0/2496716560 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94031860 con 0x7fada406c4d0 2023-12-22T08:40:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.276+0000 7fad8bfff640 1 -- 172.21.15.38:0/2496716560 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad940443f0 con 0x7fada406c4d0 2023-12-22T08:40:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.276+0000 7fad8bfff640 1 -- 172.21.15.38:0/2496716560 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad940447a0 con 0x7fada406c4d0 2023-12-22T08:40:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.276+0000 7fada3fff640 1 -- 172.21.15.38:0/2496716560 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada415bf80 con 0x7fada406c4d0 2023-12-22T08:40:44.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.277+0000 7fada3fff640 1 -- 172.21.15.38:0/2496716560 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada415c540 con 0x7fada406c4d0 2023-12-22T08:40:44.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.278+0000 7fada3fff640 1 -- 172.21.15.38:0/2496716560 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada4061910 con 0x7fada406c4d0 2023-12-22T08:40:44.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.279+0000 7fad8bfff640 1 -- 172.21.15.38:0/2496716560 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fad9404d450 con 0x7fada406c4d0 2023-12-22T08:40:44.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.280+0000 7fad8bfff640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fad9006a430 0x7fad9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.280+0000 7fad8bfff640 1 -- 172.21.15.38:0/2496716560 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad9402d040 con 0x7fada406c4d0 2023-12-22T08:40:44.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.280+0000 7fada27fc640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fad9006a430 0x7fad9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.281+0000 7fada27fc640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fad9006a430 0x7fad9006c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fada409c600 tx=0x7fad98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:44.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.284+0000 7fad8bfff640 1 -- 172.21.15.38:0/2496716560 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fad940766f0 con 0x7fada406c4d0 2023-12-22T08:40:44.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.478+0000 7fada3fff640 1 -- 172.21.15.38:0/2496716560 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fada40701e0 con 0x7fada406c4d0 2023-12-22T08:40:44.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.479+0000 7fad8bfff640 1 -- 172.21.15.38:0/2496716560 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad940350a0 con 0x7fada406c4d0 2023-12-22T08:40:44.482 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:40:44.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.481+0000 7fada3fff640 1 -- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fad9006a430 msgr2=0x7fad9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.481+0000 7fada3fff640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fad9006a430 0x7fad9006c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fada409c600 tx=0x7fad98008040 comp rx=0 tx=0).stop 2023-12-22T08:40:44.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.482+0000 7fada3fff640 1 -- 172.21.15.38:0/2496716560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fada406c4d0 msgr2=0x7fada415b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.482+0000 7fada3fff640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fada406c4d0 0x7fada415b9a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fad9402b950 tx=0x7fad940046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.482+0000 7fada3fff640 1 -- 172.21.15.38:0/2496716560 shutdown_connections 2023-12-22T08:40:44.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.482+0000 7fada3fff640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada4071490 0x7fada4140200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.482+0000 7fada3fff640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada4070b70 0x7fada41f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.482+0000 7fada3fff640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fad9006a430 0x7fad9006c8f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.482+0000 7fada3fff640 1 --2- 172.21.15.38:0/2496716560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fada406c4d0 0x7fada415b9a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.482+0000 7fada3fff640 1 -- 172.21.15.38:0/2496716560 >> 172.21.15.38:0/2496716560 conn(0x7fada40b0b60 msgr2=0x7fada40af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:44.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.482+0000 7fada3fff640 1 -- 172.21.15.38:0/2496716560 shutdown_connections 2023-12-22T08:40:44.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.482+0000 7fada3fff640 1 -- 172.21.15.38:0/2496716560 wait complete. 2023-12-22T08:40:44.503 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-12-22T08:40:44.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.722+0000 7fd3cffff640 1 Processor -- start 2023-12-22T08:40:44.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.722+0000 7fd3cffff640 1 -- start start 2023-12-22T08:40:44.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.724+0000 7fd3cffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd3d00cb4c0 0x7fd3d015e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.724+0000 7fd3cffff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d00706d0 con 0x7fd3d006d210 2023-12-22T08:40:44.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.724+0000 7fd3cffff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d00cbf40 con 0x7fd3d006d5f0 2023-12-22T08:40:44.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.724+0000 7fd3cffff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d00ce840 con 0x7fd3d00cb4c0 2023-12-22T08:40:44.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.724+0000 7fd3ceffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd3d006d210 0x7fd3d0159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42898/0 (socket says 172.21.15.38:42898) 2023-12-22T08:40:44.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.724+0000 7fd3ceffd640 1 -- 172.21.15.38:0/1467881695 learned_addr learned my addr 172.21.15.38:0/1467881695 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:44.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.725+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528868772 0 0) 0x7fd3d00706d0 con 0x7fd3d006d210 2023-12-22T08:40:44.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.725+0000 7fd3c7fff640 1 --2- 172.21.15.38:0/1467881695 >> v2:172.21.15.89:3300/0 conn(0x7fd3d00cb4c0 0x7fd3d015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.725+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3bc003520 con 0x7fd3d006d210 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.725+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3710793351 0 0) 0x7fd3bc003520 con 0x7fd3d006d210 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.725+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 >> v2:172.21.15.89:3300/0 conn(0x7fd3d00cb4c0 msgr2=0x7fd3d015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.725+0000 7fd3ce7fc640 1 --2- 172.21.15.38:0/1467881695 >> v2:172.21.15.89:3300/0 conn(0x7fd3d00cb4c0 0x7fd3d015e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.725+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 >> v1:172.21.15.89:6789/0 conn(0x7fd3d006d5f0 legacy=0x7fd3d0070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.725+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d00ceb20 con 0x7fd3d006d210 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.725+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fd3c0001670 con 0x7fd3d006d210 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.726+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 >> v1:172.21.15.38:6789/0 conn(0x7fd3d006d210 legacy=0x7fd3d0159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.726+0000 7fd3ce7fc640 1 --2- 172.21.15.38:0/1467881695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3bc0039c0 0x7fd3bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.726+0000 7fd3ce7fc640 1 --2- 172.21.15.38:0/1467881695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3bc0047c0 0x7fd3bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.726+0000 7fd3ce7fc640 1 --2- 172.21.15.38:0/1467881695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3bc0051d0 0x7fd3bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.726+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d00ce840 con 0x7fd3bc0051d0 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.726+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc00c120 con 0x7fd3bc0039c0 2023-12-22T08:40:44.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.726+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc00c2e0 con 0x7fd3bc0047c0 2023-12-22T08:40:44.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.726+0000 7fd3cf7fe640 1 --2- 172.21.15.38:0/1467881695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3bc0051d0 0x7fd3bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.726+0000 7fd3ceffd640 1 --2- 172.21.15.38:0/1467881695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3bc0039c0 0x7fd3bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.726+0000 7fd3c7fff640 1 --2- 172.21.15.38:0/1467881695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3bc0047c0 0x7fd3bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.727+0000 7fd3cf7fe640 1 -- 172.21.15.38:0/1467881695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3bc0047c0 msgr2=0x7fd3bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:44.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.727+0000 7fd3cf7fe640 1 --2- 172.21.15.38:0/1467881695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3bc0047c0 0x7fd3bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.727+0000 7fd3cf7fe640 1 -- 172.21.15.38:0/1467881695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3bc0039c0 msgr2=0x7fd3bc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:44.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.727+0000 7fd3cf7fe640 1 --2- 172.21.15.38:0/1467881695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3bc0039c0 0x7fd3bc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.727+0000 7fd3cf7fe640 1 -- 172.21.15.38:0/1467881695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc003520 con 0x7fd3bc0051d0 2023-12-22T08:40:44.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.728+0000 7fd3cf7fe640 1 -- 172.21.15.38:0/1467881695 reap_dead start 2023-12-22T08:40:44.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.728+0000 7fd3cf7fe640 1 --2- 172.21.15.38:0/1467881695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3bc0051d0 0x7fd3bc00b980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8001e50 tx=0x7fd3bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec22fe142a3a37b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:44.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.728+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8003b70 con 0x7fd3bc0051d0 2023-12-22T08:40:44.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.728+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c8003d10 con 0x7fd3bc0051d0 2023-12-22T08:40:44.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.728+0000 7fd3ce7fc640 1 -- 172.21.15.38:0/1467881695 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8005310 con 0x7fd3bc0051d0 2023-12-22T08:40:44.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.729+0000 7fd3cffff640 1 -- 172.21.15.38:0/1467881695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3bc0051d0 msgr2=0x7fd3bc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.729+0000 7fd3cffff640 1 --2- 172.21.15.38:0/1467881695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3bc0051d0 0x7fd3bc00b980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8001e50 tx=0x7fd3bc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.729+0000 7fd3cffff640 1 -- 172.21.15.38:0/1467881695 shutdown_connections 2023-12-22T08:40:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.729+0000 7fd3cffff640 1 --2- 172.21.15.38:0/1467881695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3bc0051d0 0x7fd3bc00b980 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.729+0000 7fd3cffff640 1 -- 172.21.15.38:0/1467881695 >> 172.21.15.38:0/1467881695 conn(0x7fd3d00b1f70 msgr2=0x7fd3d00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.729+0000 7fd3cffff640 1 -- 172.21.15.38:0/1467881695 shutdown_connections 2023-12-22T08:40:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.729+0000 7fd3cffff640 1 -- 172.21.15.38:0/1467881695 wait complete. 2023-12-22T08:40:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.731+0000 7fd3cffff640 1 Processor -- start 2023-12-22T08:40:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.731+0000 7fd3cffff640 1 -- start start 2023-12-22T08:40:44.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.732+0000 7fd3cffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3bc0051d0 0x7fd3d0156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.732+0000 7fd3cffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3d0152180 0x7fd3d0159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.732+0000 7fd3cffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d0070b60 0x7fd3d0070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.732+0000 7fd3cffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d0071520 con 0x7fd3d0152180 2023-12-22T08:40:44.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.732+0000 7fd3cffff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d01570b0 con 0x7fd3d0070b60 2023-12-22T08:40:44.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.732+0000 7fd3cffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d0155ad0 con 0x7fd3bc0051d0 2023-12-22T08:40:44.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.733+0000 7fd3c7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3d0152180 0x7fd3d0159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.733+0000 7fd3c7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3d0152180 0x7fd3d0159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49904/0 (socket says 172.21.15.38:49904) 2023-12-22T08:40:44.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.733+0000 7fd3c7fff640 1 -- 172.21.15.38:0/3400445558 learned_addr learned my addr 172.21.15.38:0/3400445558 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:44.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.733+0000 7fd3ceffd640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3bc0051d0 0x7fd3d0156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.733+0000 7fd3cf7fe640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d0070b60 0x7fd3d0070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.733+0000 7fd3c7fff640 1 -- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3bc0051d0 msgr2=0x7fd3d0156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.733+0000 7fd3c7fff640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3bc0051d0 0x7fd3d0156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.733+0000 7fd3c7fff640 1 -- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d0070b60 msgr2=0x7fd3d0070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.733+0000 7fd3c7fff640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d0070b60 0x7fd3d0070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.733+0000 7fd3c7fff640 1 -- 172.21.15.38:0/3400445558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d0155db0 con 0x7fd3d0152180 2023-12-22T08:40:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.733+0000 7fd3ceffd640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3bc0051d0 0x7fd3d0156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.734+0000 7fd3c7fff640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3d0152180 0x7fd3d0159640 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800b7f0 tx=0x7fd3b800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.734+0000 7fd3c77fe640 1 -- 172.21.15.38:0/3400445558 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8010830 con 0x7fd3d0152180 2023-12-22T08:40:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.734+0000 7fd3c77fe640 1 -- 172.21.15.38:0/3400445558 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b8010990 con 0x7fd3d0152180 2023-12-22T08:40:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.734+0000 7fd3cffff640 1 -- 172.21.15.38:0/3400445558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d0156090 con 0x7fd3d0152180 2023-12-22T08:40:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.734+0000 7fd3c77fe640 1 -- 172.21.15.38:0/3400445558 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8010d60 con 0x7fd3d0152180 2023-12-22T08:40:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.734+0000 7fd3cffff640 1 -- 172.21.15.38:0/3400445558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d0156650 con 0x7fd3d0152180 2023-12-22T08:40:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.735+0000 7fd3cffff640 1 -- 172.21.15.38:0/3400445558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d0074740 con 0x7fd3d0152180 2023-12-22T08:40:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.736+0000 7fd3c77fe640 1 -- 172.21.15.38:0/3400445558 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd3b8014430 con 0x7fd3d0152180 2023-12-22T08:40:44.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.737+0000 7fd3c77fe640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd3b006a460 0x7fd3b006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.737+0000 7fd3c77fe640 1 -- 172.21.15.38:0/3400445558 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3b8088f20 con 0x7fd3d0152180 2023-12-22T08:40:44.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.738+0000 7fd3ceffd640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd3b006a460 0x7fd3b006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.739+0000 7fd3ceffd640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd3b006a460 0x7fd3b006c920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0000c00 tx=0x7fd3c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:44.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:44.742+0000 7fd3c77fe640 1 -- 172.21.15.38:0/3400445558 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd3b8054470 con 0x7fd3d0152180 2023-12-22T08:40:45.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.004+0000 7fd3cffff640 1 -- 172.21.15.38:0/3400445558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7fd3d0061910 con 0x7fd3d0152180 2023-12-22T08:40:45.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.355+0000 7fd3c77fe640 1 -- 172.21.15.38:0/3400445558 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v57) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd3b8057a90 con 0x7fd3d0152180 2023-12-22T08:40:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.359+0000 7fd3cffff640 1 -- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd3b006a460 msgr2=0x7fd3b006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.359+0000 7fd3cffff640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd3b006a460 0x7fd3b006c920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0000c00 tx=0x7fd3c0009040 comp rx=0 tx=0).stop 2023-12-22T08:40:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.359+0000 7fd3cffff640 1 -- 172.21.15.38:0/3400445558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3d0152180 msgr2=0x7fd3d0159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.359+0000 7fd3cffff640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3d0152180 0x7fd3d0159640 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800b7f0 tx=0x7fd3b800bcb0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.359+0000 7fd3cffff640 1 -- 172.21.15.38:0/3400445558 shutdown_connections 2023-12-22T08:40:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.359+0000 7fd3cffff640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3d0070b60 0x7fd3d0070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.359+0000 7fd3cffff640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd3b006a460 0x7fd3b006c920 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.359+0000 7fd3cffff640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3d0152180 0x7fd3d0159640 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.359+0000 7fd3cffff640 1 --2- 172.21.15.38:0/3400445558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3bc0051d0 0x7fd3d0156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.359+0000 7fd3cffff640 1 -- 172.21.15.38:0/3400445558 >> 172.21.15.38:0/3400445558 conn(0x7fd3d00b1f70 msgr2=0x7fd3d0154460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.359+0000 7fd3cffff640 1 -- 172.21.15.38:0/3400445558 shutdown_connections 2023-12-22T08:40:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.359+0000 7fd3cffff640 1 -- 172.21.15.38:0/3400445558 wait complete. 2023-12-22T08:40:45.385 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-22T08:40:45.629 INFO:teuthology.orchestra.run.smithi038.stdout:{"osd_objectstore":"memstore"} 2023-12-22T08:40:45.629 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-22T08:40:45.629 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T08:40:45.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.859+0000 7f3cb4f30640 1 Processor -- start 2023-12-22T08:40:45.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.859+0000 7f3cb4f30640 1 -- start start 2023-12-22T08:40:45.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.861+0000 7f3cb4f30640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cb015d3e0 0x7f3cb015b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:45.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.861+0000 7f3cb4f30640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3cb015a7b0 0x7f3cb006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:45.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.861+0000 7f3cb4f30640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb0070360 con 0x7f3cb015d7c0 2023-12-22T08:40:45.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.861+0000 7f3cb4f30640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb0070170 con 0x7f3cb015a7b0 2023-12-22T08:40:45.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.861+0000 7f3cb4f30640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb0070640 con 0x7f3cb015d3e0 2023-12-22T08:40:45.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.861+0000 7f3caffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3cb015a7b0 0x7f3cb006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:45.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.861+0000 7f3caf7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cb015d3e0 0x7f3cb015b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:45.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.862+0000 7f3caf7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cb015d3e0 0x7f3cb015b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:54398/0 (socket says 172.21.15.38:54398) 2023-12-22T08:40:45.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.862+0000 7f3caffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3cb015a7b0 0x7f3cb006d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:45250/0 (socket says 172.21.15.38:45250) 2023-12-22T08:40:45.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.862+0000 7f3caf7fe640 1 -- 172.21.15.38:0/3745813706 learned_addr learned my addr 172.21.15.38:0/3745813706 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:45.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.862+0000 7f3caf7fe640 1 -- 172.21.15.38:0/3745813706 >> v2:172.21.15.89:3300/0 conn(0x7f3cb015a7b0 msgr2=0x7f3cb006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:45.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.862+0000 7f3caf7fe640 1 --2- 172.21.15.38:0/3745813706 >> v2:172.21.15.89:3300/0 conn(0x7f3cb015a7b0 0x7f3cb006d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.862+0000 7f3caf7fe640 1 -- 172.21.15.38:0/3745813706 >> v1:172.21.15.89:6789/0 conn(0x7f3cb015d7c0 legacy=0x7f3cb006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:45.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.862+0000 7f3caf7fe640 1 -- 172.21.15.38:0/3745813706 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb0070920 con 0x7f3cb015d3e0 2023-12-22T08:40:45.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.864+0000 7f3caf7fe640 1 --2- 172.21.15.38:0/3745813706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cb015d3e0 0x7f3cb015b820 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009870 tx=0x7f3c9802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c1e22476c4c577 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:45.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.864+0000 7f3cae7fc640 1 -- 172.21.15.38:0/3745813706 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98030840 con 0x7f3cb015d3e0 2023-12-22T08:40:45.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.864+0000 7f3cae7fc640 1 -- 172.21.15.38:0/3745813706 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c980309a0 con 0x7f3cb015d3e0 2023-12-22T08:40:45.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.864+0000 7f3cae7fc640 1 -- 172.21.15.38:0/3745813706 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98030d30 con 0x7f3cb015d3e0 2023-12-22T08:40:45.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.865+0000 7f3cb4f30640 1 -- 172.21.15.38:0/3745813706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cb015d3e0 msgr2=0x7f3cb015b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:45.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.865+0000 7f3cb4f30640 1 --2- 172.21.15.38:0/3745813706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cb015d3e0 0x7f3cb015b820 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009870 tx=0x7f3c9802b980 comp rx=0 tx=0).stop 2023-12-22T08:40:45.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.865+0000 7f3cb4f30640 1 -- 172.21.15.38:0/3745813706 shutdown_connections 2023-12-22T08:40:45.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.865+0000 7f3cb4f30640 1 --2- 172.21.15.38:0/3745813706 >> v2:172.21.15.89:3300/0 conn(0x7f3cb015a7b0 0x7f3cb006d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.865+0000 7f3cb4f30640 1 --2- 172.21.15.38:0/3745813706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cb015d3e0 0x7f3cb015b820 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.865+0000 7f3cb4f30640 1 -- 172.21.15.38:0/3745813706 >> 172.21.15.38:0/3745813706 conn(0x7f3cb00b0b60 msgr2=0x7f3cb00b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:45.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.865+0000 7f3cb4f30640 1 -- 172.21.15.38:0/3745813706 shutdown_connections 2023-12-22T08:40:45.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.865+0000 7f3cb4f30640 1 -- 172.21.15.38:0/3745813706 wait complete. 2023-12-22T08:40:45.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.867+0000 7f3cb4f30640 1 Processor -- start 2023-12-22T08:40:45.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.867+0000 7f3cb4f30640 1 -- start start 2023-12-22T08:40:45.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.868+0000 7f3cb4f30640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cb015a7b0 0x7f3cb014d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:45.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.868+0000 7f3cb4f30640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cb015d3e0 0x7f3cb0146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:45.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.868+0000 7f3cb4f30640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cb015d7c0 0x7f3cb009b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:45.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.868+0000 7f3cb4f30640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb014dad0 con 0x7f3cb015d7c0 2023-12-22T08:40:45.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.868+0000 7f3cb4f30640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb0147aa0 con 0x7f3cb015a7b0 2023-12-22T08:40:45.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.868+0000 7f3cb4f30640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb014ca90 con 0x7f3cb015d3e0 2023-12-22T08:40:45.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.868+0000 7f3caffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cb015d7c0 0x7f3cb009b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:45.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.868+0000 7f3caffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cb015d7c0 0x7f3cb009b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49912/0 (socket says 172.21.15.38:49912) 2023-12-22T08:40:45.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.868+0000 7f3caffff640 1 -- 172.21.15.38:0/1917795077 learned_addr learned my addr 172.21.15.38:0/1917795077 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:45.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.869+0000 7f3caf7fe640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cb015a7b0 0x7f3cb014d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:45.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.869+0000 7f3caeffd640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cb015d3e0 0x7f3cb0146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.869+0000 7f3caffff640 1 -- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cb015d3e0 msgr2=0x7f3cb0146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.869+0000 7f3caffff640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cb015d3e0 0x7f3cb0146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.869+0000 7f3caffff640 1 -- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cb015a7b0 msgr2=0x7f3cb014d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.869+0000 7f3caffff640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cb015a7b0 0x7f3cb014d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.869+0000 7f3caffff640 1 -- 172.21.15.38:0/1917795077 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c980094d0 con 0x7f3cb015d7c0 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.869+0000 7f3caffff640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cb015d7c0 0x7f3cb009b090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800e860 tx=0x7f3ca800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.869+0000 7f3ca7fff640 1 -- 172.21.15.38:0/1917795077 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca800c6d0 con 0x7f3cb015d7c0 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.870+0000 7f3ca7fff640 1 -- 172.21.15.38:0/1917795077 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca800c830 con 0x7f3cb015d7c0 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.870+0000 7f3ca7fff640 1 -- 172.21.15.38:0/1917795077 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca800cbe0 con 0x7f3cb015d7c0 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.870+0000 7f3cb4f30640 1 -- 172.21.15.38:0/1917795077 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb014c7b0 con 0x7f3cb015d7c0 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.870+0000 7f3cb4f30640 1 -- 172.21.15.38:0/1917795077 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb009a890 con 0x7f3cb015d7c0 2023-12-22T08:40:45.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.871+0000 7f3cb4f30640 1 -- 172.21.15.38:0/1917795077 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb0061910 con 0x7f3cb015d7c0 2023-12-22T08:40:45.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.872+0000 7f3ca7fff640 1 -- 172.21.15.38:0/1917795077 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ca8013470 con 0x7f3cb015d7c0 2023-12-22T08:40:45.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.873+0000 7f3ca7fff640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3c9006a460 0x7f3c9006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:45.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.873+0000 7f3ca7fff640 1 -- 172.21.15.38:0/1917795077 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ca8088d10 con 0x7f3cb015d7c0 2023-12-22T08:40:45.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.874+0000 7f3caf7fe640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3c9006a460 0x7f3c9006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:45.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.875+0000 7f3caf7fe640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3c9006a460 0x7f3c9006c920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c98036000 tx=0x7f3c98008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:45.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:45.877+0000 7f3ca7fff640 1 -- 172.21.15.38:0/1917795077 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3ca8054390 con 0x7f3cb015d7c0 2023-12-22T08:40:46.036 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:40:46.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:40:46.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.072+0000 7f3cb4f30640 1 -- 172.21.15.38:0/1917795077 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3cb015c940 con 0x7f3cb015d7c0 2023-12-22T08:40:46.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.077+0000 7f3ca7fff640 1 -- 172.21.15.38:0/1917795077 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3ca80579b0 con 0x7f3cb015d7c0 2023-12-22T08:40:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.080+0000 7f3cb4f30640 1 -- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3c9006a460 msgr2=0x7f3c9006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.080+0000 7f3cb4f30640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3c9006a460 0x7f3c9006c920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c98036000 tx=0x7f3c98008030 comp rx=0 tx=0).stop 2023-12-22T08:40:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.080+0000 7f3cb4f30640 1 -- 172.21.15.38:0/1917795077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cb015d7c0 msgr2=0x7f3cb009b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.080+0000 7f3cb4f30640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cb015d7c0 0x7f3cb009b090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800e860 tx=0x7f3ca800ed20 comp rx=0 tx=0).stop 2023-12-22T08:40:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.080+0000 7f3cb4f30640 1 -- 172.21.15.38:0/1917795077 shutdown_connections 2023-12-22T08:40:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.080+0000 7f3cb4f30640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3c9006a460 0x7f3c9006c920 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.080+0000 7f3cb4f30640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cb015d7c0 0x7f3cb009b090 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.080+0000 7f3cb4f30640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cb015d3e0 0x7f3cb0146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.080+0000 7f3cb4f30640 1 --2- 172.21.15.38:0/1917795077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cb015a7b0 0x7f3cb014d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.080+0000 7f3cb4f30640 1 -- 172.21.15.38:0/1917795077 >> 172.21.15.38:0/1917795077 conn(0x7f3cb00b0b60 msgr2=0x7f3cb00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.080+0000 7f3cb4f30640 1 -- 172.21.15.38:0/1917795077 shutdown_connections 2023-12-22T08:40:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.080+0000 7f3cb4f30640 1 -- 172.21.15.38:0/1917795077 wait complete. 2023-12-22T08:40:46.101 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:40:46.102 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:40:46.254 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:40:46.379 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:40:46.379 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:40:46.380 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:46.444 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:40:46.444 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:46.503 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:40:46.503 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:46.560 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:46.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.795+0000 7f8a32d61640 1 Processor -- start 2023-12-22T08:40:46.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.795+0000 7f8a32d61640 1 -- start start 2023-12-22T08:40:46.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.797+0000 7f8a32d61640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8a2c157980 0x7f8a2c15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.797+0000 7f8a32d61640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a2c0b3ff0 0x7f8a2c06cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.797+0000 7f8a32d61640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c0d1520 con 0x7f8a2c0b4470 2023-12-22T08:40:46.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.797+0000 7f8a32d61640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c0d1800 con 0x7f8a2c157980 2023-12-22T08:40:46.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.797+0000 7f8a32d61640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0d1ae0 con 0x7f8a2c0b3ff0 2023-12-22T08:40:46.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.798+0000 7f8a3155e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a2c0b3ff0 0x7f8a2c06cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.798+0000 7f8a31d5f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8a2c157980 0x7f8a2c15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.798+0000 7f8a31d5f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8a2c157980 0x7f8a2c15eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:45268/0 (socket says 172.21.15.38:45268) 2023-12-22T08:40:46.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.798+0000 7f8a31d5f640 1 -- 172.21.15.38:0/1211090208 learned_addr learned my addr 172.21.15.38:0/1211090208 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:46.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.798+0000 7f8a3155e640 1 -- 172.21.15.38:0/1211090208 >> v2:172.21.15.89:3300/0 conn(0x7f8a2c157980 msgr2=0x7f8a2c15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:46.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.798+0000 7f8a3155e640 1 --2- 172.21.15.38:0/1211090208 >> v2:172.21.15.89:3300/0 conn(0x7f8a2c157980 0x7f8a2c15eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.798+0000 7f8a3155e640 1 -- 172.21.15.38:0/1211090208 >> v1:172.21.15.89:6789/0 conn(0x7f8a2c0b4470 legacy=0x7f8a2c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.798+0000 7f8a3155e640 1 -- 172.21.15.38:0/1211090208 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c0d1dc0 con 0x7f8a2c0b3ff0 2023-12-22T08:40:46.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.800+0000 7f8a3155e640 1 --2- 172.21.15.38:0/1211090208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a2c0b3ff0 0x7f8a2c06cf30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0097a0 tx=0x7f8a1c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25d51e12fdff1499 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:46.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.800+0000 7f8a30d5d640 1 -- 172.21.15.38:0/1211090208 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c031830 con 0x7f8a2c0b3ff0 2023-12-22T08:40:46.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.800+0000 7f8a30d5d640 1 -- 172.21.15.38:0/1211090208 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c031990 con 0x7f8a2c0b3ff0 2023-12-22T08:40:46.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.800+0000 7f8a30d5d640 1 -- 172.21.15.38:0/1211090208 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c031d20 con 0x7f8a2c0b3ff0 2023-12-22T08:40:46.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.801+0000 7f8a32d61640 1 -- 172.21.15.38:0/1211090208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a2c0b3ff0 msgr2=0x7f8a2c06cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.801+0000 7f8a32d61640 1 --2- 172.21.15.38:0/1211090208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a2c0b3ff0 0x7f8a2c06cf30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0097a0 tx=0x7f8a1c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.801+0000 7f8a32d61640 1 -- 172.21.15.38:0/1211090208 shutdown_connections 2023-12-22T08:40:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.801+0000 7f8a32d61640 1 --2- 172.21.15.38:0/1211090208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a2c0b3ff0 0x7f8a2c06cf30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.801+0000 7f8a32d61640 1 --2- 172.21.15.38:0/1211090208 >> v2:172.21.15.89:3300/0 conn(0x7f8a2c157980 0x7f8a2c15eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.801+0000 7f8a32d61640 1 -- 172.21.15.38:0/1211090208 >> 172.21.15.38:0/1211090208 conn(0x7f8a2c0d31f0 msgr2=0x7f8a2c0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.801+0000 7f8a32d61640 1 -- 172.21.15.38:0/1211090208 shutdown_connections 2023-12-22T08:40:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.801+0000 7f8a32d61640 1 -- 172.21.15.38:0/1211090208 wait complete. 2023-12-22T08:40:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.803+0000 7f8a32d61640 1 Processor -- start 2023-12-22T08:40:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.803+0000 7f8a32d61640 1 -- start start 2023-12-22T08:40:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.804+0000 7f8a32d61640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a2c0b3ff0 0x7f8a2c150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.804+0000 7f8a32d61640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a2c0b4470 0x7f8a2c154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.804+0000 7f8a32d61640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a2c157980 0x7f8a2c14aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.804+0000 7f8a32d61640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c15ed90 con 0x7f8a2c0b4470 2023-12-22T08:40:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.804+0000 7f8a32d61640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c155f80 con 0x7f8a2c0b3ff0 2023-12-22T08:40:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.804+0000 7f8a32d61640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c1554b0 con 0x7f8a2c157980 2023-12-22T08:40:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.804+0000 7f8a3155e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a2c0b4470 0x7f8a2c154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.804+0000 7f8a3155e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a2c0b4470 0x7f8a2c154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49926/0 (socket says 172.21.15.38:49926) 2023-12-22T08:40:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.804+0000 7f8a3155e640 1 -- 172.21.15.38:0/621606054 learned_addr learned my addr 172.21.15.38:0/621606054 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:46.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.805+0000 7f8a31d5f640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a2c0b3ff0 0x7f8a2c150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.805+0000 7f8a32560640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a2c157980 0x7f8a2c14aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.805+0000 7f8a3155e640 1 -- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a2c157980 msgr2=0x7f8a2c14aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.805+0000 7f8a3155e640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a2c157980 0x7f8a2c14aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.805+0000 7f8a3155e640 1 -- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a2c0b3ff0 msgr2=0x7f8a2c150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.805+0000 7f8a3155e640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a2c0b3ff0 0x7f8a2c150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.805+0000 7f8a3155e640 1 -- 172.21.15.38:0/621606054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c009400 con 0x7f8a2c0b4470 2023-12-22T08:40:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.805+0000 7f8a3155e640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a2c0b4470 0x7f8a2c154f70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c02bee0 tx=0x7f8a1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.806+0000 7f8a227fc640 1 -- 172.21.15.38:0/621606054 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c03a6f0 con 0x7f8a2c0b4470 2023-12-22T08:40:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.806+0000 7f8a227fc640 1 -- 172.21.15.38:0/621606054 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c03a870 con 0x7f8a2c0b4470 2023-12-22T08:40:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.806+0000 7f8a227fc640 1 -- 172.21.15.38:0/621606054 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c03ac20 con 0x7f8a2c0b4470 2023-12-22T08:40:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.806+0000 7f8a32d61640 1 -- 172.21.15.38:0/621606054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c14b3f0 con 0x7f8a2c0b4470 2023-12-22T08:40:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.806+0000 7f8a32d61640 1 -- 172.21.15.38:0/621606054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c1559c0 con 0x7f8a2c0b4470 2023-12-22T08:40:46.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.807+0000 7f8a32d61640 1 -- 172.21.15.38:0/621606054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c15eaf0 con 0x7f8a2c0b4470 2023-12-22T08:40:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.809+0000 7f8a227fc640 1 -- 172.21.15.38:0/621606054 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a1c04c3b0 con 0x7f8a2c0b4470 2023-12-22T08:40:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.810+0000 7f8a227fc640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a1006a430 0x7f8a1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.810+0000 7f8a227fc640 1 -- 172.21.15.38:0/621606054 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a1c0aa600 con 0x7f8a2c0b4470 2023-12-22T08:40:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.811+0000 7f8a31d5f640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a1006a430 0x7f8a1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.812+0000 7f8a31d5f640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a1006a430 0x7f8a1006c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009ac0 tx=0x7f8a28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:46.816+0000 7f8a227fc640 1 -- 172.21.15.38:0/621606054 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8a2c15eaf0 con 0x7f8a2c0b4470 2023-12-22T08:40:47.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.009+0000 7f8a32d61640 1 -- 172.21.15.38:0/621606054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a2c15eaf0 con 0x7f8a2c0b4470 2023-12-22T08:40:47.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.011+0000 7f8a227fc640 1 -- 172.21.15.38:0/621606054 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f8a2c15eaf0 con 0x7f8a2c0b4470 2023-12-22T08:40:47.014 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:47.014 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:39:59.604518+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:47.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.014+0000 7f8a32d61640 1 -- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a1006a430 msgr2=0x7f8a1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.014+0000 7f8a32d61640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a1006a430 0x7f8a1006c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009ac0 tx=0x7f8a28008040 comp rx=0 tx=0).stop 2023-12-22T08:40:47.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.014+0000 7f8a32d61640 1 -- 172.21.15.38:0/621606054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a2c0b4470 msgr2=0x7f8a2c154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.014+0000 7f8a32d61640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a2c0b4470 0x7f8a2c154f70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c02bee0 tx=0x7f8a1c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.014+0000 7f8a32d61640 1 -- 172.21.15.38:0/621606054 shutdown_connections 2023-12-22T08:40:47.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.014+0000 7f8a32d61640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a2c157980 0x7f8a2c14aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.014+0000 7f8a32d61640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a1006a430 0x7f8a1006c8f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.014+0000 7f8a32d61640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a2c0b4470 0x7f8a2c154f70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.014+0000 7f8a32d61640 1 --2- 172.21.15.38:0/621606054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a2c0b3ff0 0x7f8a2c150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.014+0000 7f8a32d61640 1 -- 172.21.15.38:0/621606054 >> 172.21.15.38:0/621606054 conn(0x7f8a2c0d31f0 msgr2=0x7f8a2c15b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:47.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.014+0000 7f8a32d61640 1 -- 172.21.15.38:0/621606054 shutdown_connections 2023-12-22T08:40:47.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.014+0000 7f8a32d61640 1 -- 172.21.15.38:0/621606054 wait complete. 2023-12-22T08:40:47.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:39:56.873963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:39:57.616447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:47.036 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.262+0000 7f6bd2329640 1 Processor -- start 2023-12-22T08:40:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.262+0000 7f6bd2329640 1 -- start start 2023-12-22T08:40:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.264+0000 7f6bd2329640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6bcc15d1c0 0x7f6bcc070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.264+0000 7f6bd2329640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc0d0770 0x7f6bcc070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.264+0000 7f6bd2329640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc15de50 con 0x7f6bcc15d5a0 2023-12-22T08:40:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.264+0000 7f6bd2329640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc0d0bc0 con 0x7f6bcc15d1c0 2023-12-22T08:40:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.264+0000 7f6bd2329640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0d0dd0 con 0x7f6bcc0d0770 2023-12-22T08:40:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.264+0000 7f6bd0b26640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6bcc15d5a0 0x7f6bcc0d0060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42902/0 (socket says 172.21.15.38:42902) 2023-12-22T08:40:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.264+0000 7f6bd0b26640 1 -- 172.21.15.38:0/1155400271 learned_addr learned my addr 172.21.15.38:0/1155400271 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bd1327640 1 --2- 172.21.15.38:0/1155400271 >> v2:172.21.15.89:3300/0 conn(0x7f6bcc15d1c0 0x7f6bcc070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633735174 0 0) 0x7f6bcc15de50 con 0x7f6bcc15d5a0 2023-12-22T08:40:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb8003520 con 0x7f6bcc15d5a0 2023-12-22T08:40:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bd1b28640 1 --2- 172.21.15.38:0/1155400271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc0d0770 0x7f6bcc070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3316110736 0 0) 0x7f6bb8003520 con 0x7f6bcc15d5a0 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc0d0770 msgr2=0x7f6bcc070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 --2- 172.21.15.38:0/1155400271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc0d0770 0x7f6bcc070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 >> v2:172.21.15.89:3300/0 conn(0x7f6bcc15d1c0 msgr2=0x7f6bcc070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 --2- 172.21.15.38:0/1155400271 >> v2:172.21.15.89:3300/0 conn(0x7f6bcc15d1c0 0x7f6bcc070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc0d10b0 con 0x7f6bcc15d5a0 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f6bbc001670 con 0x7f6bcc15d5a0 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 >> v1:172.21.15.38:6789/0 conn(0x7f6bcc15d5a0 legacy=0x7f6bcc0d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 --2- 172.21.15.38:0/1155400271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bb8003970 0x7f6bb8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 --2- 172.21.15.38:0/1155400271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc0d0770 0x7f6bb80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 --2- 172.21.15.38:0/1155400271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bb8004d00 0x7f6bb8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0d0bc0 con 0x7f6bb8004d00 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.265+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0d0dd0 con 0x7f6bb8003970 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.266+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb800ba00 con 0x7f6bcc0d0770 2023-12-22T08:40:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.266+0000 7f6bd1b28640 1 --2- 172.21.15.38:0/1155400271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bb8004d00 0x7f6bb8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.266+0000 7f6bd1327640 1 --2- 172.21.15.38:0/1155400271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bb8003970 0x7f6bb8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.266+0000 7f6bd0b26640 1 --2- 172.21.15.38:0/1155400271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc0d0770 0x7f6bb80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.266+0000 7f6bd1b28640 1 -- 172.21.15.38:0/1155400271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc0d0770 msgr2=0x7f6bb80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:47.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.266+0000 7f6bd1b28640 1 --2- 172.21.15.38:0/1155400271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc0d0770 0x7f6bb80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.266+0000 7f6bd1b28640 1 -- 172.21.15.38:0/1155400271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bb8003970 msgr2=0x7f6bb8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:47.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.266+0000 7f6bd1b28640 1 --2- 172.21.15.38:0/1155400271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bb8003970 0x7f6bb8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.266+0000 7f6bd1b28640 1 -- 172.21.15.38:0/1155400271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8003520 con 0x7f6bb8004d00 2023-12-22T08:40:47.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.266+0000 7f6bd0b26640 1 --2- 172.21.15.38:0/1155400271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc0d0770 0x7f6bb80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.267+0000 7f6bd1b28640 1 --2- 172.21.15.38:0/1155400271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bb8004d00 0x7f6bb8005180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4007360 tx=0x7f6bb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6bd3b5d883b23e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.268+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc402ccb0 con 0x7f6bb8004d00 2023-12-22T08:40:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.268+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc402ce10 con 0x7f6bb8004d00 2023-12-22T08:40:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.268+0000 7f6bc3fff640 1 -- 172.21.15.38:0/1155400271 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4034660 con 0x7f6bb8004d00 2023-12-22T08:40:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.268+0000 7f6bd2329640 1 -- 172.21.15.38:0/1155400271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bb8004d00 msgr2=0x7f6bb8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.268+0000 7f6bd2329640 1 --2- 172.21.15.38:0/1155400271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bb8004d00 0x7f6bb8005180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4007360 tx=0x7f6bb80057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.268+0000 7f6bd1b28640 1 -- 172.21.15.38:0/1155400271 reap_dead start 2023-12-22T08:40:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.268+0000 7f6bd2329640 1 -- 172.21.15.38:0/1155400271 shutdown_connections 2023-12-22T08:40:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.268+0000 7f6bd2329640 1 -- 172.21.15.38:0/1155400271 >> 172.21.15.38:0/1155400271 conn(0x7f6bcc06bf90 msgr2=0x7f6bcc06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.268+0000 7f6bd2329640 1 -- 172.21.15.38:0/1155400271 shutdown_connections 2023-12-22T08:40:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.268+0000 7f6bd2329640 1 -- 172.21.15.38:0/1155400271 wait complete. 2023-12-22T08:40:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.270+0000 7f6bd2329640 1 Processor -- start 2023-12-22T08:40:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.270+0000 7f6bd2329640 1 -- start start 2023-12-22T08:40:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.271+0000 7f6bd2329640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bb8004d00 0x7f6bcc1f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.271+0000 7f6bd2329640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bcc156b40 0x7f6bcc1f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.271+0000 7f6bd2329640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc151f10 0x7f6bcc158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.271+0000 7f6bd2329640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc157320 con 0x7f6bcc156b40 2023-12-22T08:40:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.271+0000 7f6bd2329640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc153d60 con 0x7f6bb8004d00 2023-12-22T08:40:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.271+0000 7f6bd2329640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc1f39d0 con 0x7f6bcc151f10 2023-12-22T08:40:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.272+0000 7f6bd0b26640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bcc156b40 0x7f6bcc1f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.272+0000 7f6bd0b26640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bcc156b40 0x7f6bcc1f3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49942/0 (socket says 172.21.15.38:49942) 2023-12-22T08:40:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.272+0000 7f6bd0b26640 1 -- 172.21.15.38:0/2647279995 learned_addr learned my addr 172.21.15.38:0/2647279995 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.272+0000 7f6bd1b28640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc151f10 0x7f6bcc158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.272+0000 7f6bd1327640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bb8004d00 0x7f6bcc1f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.272+0000 7f6bd0b26640 1 -- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc151f10 msgr2=0x7f6bcc158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.272+0000 7f6bd0b26640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc151f10 0x7f6bcc158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.272+0000 7f6bd0b26640 1 -- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bb8004d00 msgr2=0x7f6bcc1f3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.272+0000 7f6bd0b26640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bb8004d00 0x7f6bcc1f3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.272+0000 7f6bd0b26640 1 -- 172.21.15.38:0/2647279995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc156510 con 0x7f6bcc156b40 2023-12-22T08:40:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.272+0000 7f6bd0b26640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bcc156b40 0x7f6bcc1f3490 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00d860 tx=0x7f6bbc00dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.273+0000 7f6bc1ffb640 1 -- 172.21.15.38:0/2647279995 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0074e0 con 0x7f6bcc156b40 2023-12-22T08:40:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.273+0000 7f6bc1ffb640 1 -- 172.21.15.38:0/2647279995 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc007640 con 0x7f6bcc156b40 2023-12-22T08:40:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.273+0000 7f6bc1ffb640 1 -- 172.21.15.38:0/2647279995 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0049e0 con 0x7f6bcc156b40 2023-12-22T08:40:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.273+0000 7f6bd2329640 1 -- 172.21.15.38:0/2647279995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc157040 con 0x7f6bcc156b40 2023-12-22T08:40:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.273+0000 7f6bd2329640 1 -- 172.21.15.38:0/2647279995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc154290 con 0x7f6bcc156b40 2023-12-22T08:40:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.274+0000 7f6bd2329640 1 -- 172.21.15.38:0/2647279995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc0b5410 con 0x7f6bcc156b40 2023-12-22T08:40:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.275+0000 7f6bc1ffb640 1 -- 172.21.15.38:0/2647279995 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6bbc004b40 con 0x7f6bcc156b40 2023-12-22T08:40:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.276+0000 7f6bc1ffb640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6bb006a460 0x7f6bb006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.276+0000 7f6bc1ffb640 1 -- 172.21.15.38:0/2647279995 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bbc088210 con 0x7f6bcc156b40 2023-12-22T08:40:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.277+0000 7f6bd1327640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6bb006a460 0x7f6bb006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.278+0000 7f6bd1327640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6bb006a460 0x7f6bb006c920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009a10 tx=0x7f6bc8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.281+0000 7f6bc1ffb640 1 -- 172.21.15.38:0/2647279995 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6bbc053940 con 0x7f6bcc156b40 2023-12-22T08:40:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.480+0000 7f6bd2329640 1 -- 172.21.15.38:0/2647279995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6bcc06dd00 con 0x7f6bcc156b40 2023-12-22T08:40:47.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.481+0000 7f6bc1ffb640 1 -- 172.21.15.38:0/2647279995 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6bbc019020 con 0x7f6bcc156b40 2023-12-22T08:40:47.483 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:40:47.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.483+0000 7f6bd2329640 1 -- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6bb006a460 msgr2=0x7f6bb006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.483+0000 7f6bd2329640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6bb006a460 0x7f6bb006c920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009a10 tx=0x7f6bc8008040 comp rx=0 tx=0).stop 2023-12-22T08:40:47.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.483+0000 7f6bd2329640 1 -- 172.21.15.38:0/2647279995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bcc156b40 msgr2=0x7f6bcc1f3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.483+0000 7f6bd2329640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bcc156b40 0x7f6bcc1f3490 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00d860 tx=0x7f6bbc00dd20 comp rx=0 tx=0).stop 2023-12-22T08:40:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.483+0000 7f6bd2329640 1 -- 172.21.15.38:0/2647279995 shutdown_connections 2023-12-22T08:40:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.483+0000 7f6bd2329640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6bcc151f10 0x7f6bcc158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.483+0000 7f6bd2329640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6bb006a460 0x7f6bb006c920 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.483+0000 7f6bd2329640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bcc156b40 0x7f6bcc1f3490 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.483+0000 7f6bd2329640 1 --2- 172.21.15.38:0/2647279995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bb8004d00 0x7f6bcc1f3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.483+0000 7f6bd2329640 1 -- 172.21.15.38:0/2647279995 >> 172.21.15.38:0/2647279995 conn(0x7f6bcc06bf90 msgr2=0x7f6bcc06ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.484+0000 7f6bd2329640 1 -- 172.21.15.38:0/2647279995 shutdown_connections 2023-12-22T08:40:47.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.484+0000 7f6bd2329640 1 -- 172.21.15.38:0/2647279995 wait complete. 2023-12-22T08:40:47.506 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:47.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.732+0000 7f3248347640 1 Processor -- start 2023-12-22T08:40:47.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.733+0000 7f3248347640 1 -- start start 2023-12-22T08:40:47.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.734+0000 7f3248347640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400b3f90 0x7f324015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.734+0000 7f3248347640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f324006ca50 0x7f3240070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.734+0000 7f3248347640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324015eb20 con 0x7f324015e740 2023-12-22T08:40:47.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.734+0000 7f3248347640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324006e650 con 0x7f324006ca50 2023-12-22T08:40:47.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.734+0000 7f3248347640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3240070770 con 0x7f32400b3f90 2023-12-22T08:40:47.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.735+0000 7f32458e2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400b3f90 0x7f324015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.735+0000 7f32468e4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f324006ca50 0x7f3240070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.735+0000 7f32468e4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f324006ca50 0x7f3240070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:45326/0 (socket says 172.21.15.38:45326) 2023-12-22T08:40:47.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.735+0000 7f32468e4640 1 -- 172.21.15.38:0/1925151736 learned_addr learned my addr 172.21.15.38:0/1925151736 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:47.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.736+0000 7f32468e4640 1 -- 172.21.15.38:0/1925151736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400b3f90 msgr2=0x7f324015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:47.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.736+0000 7f32468e4640 1 --2- 172.21.15.38:0/1925151736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400b3f90 0x7f324015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.736+0000 7f32468e4640 1 -- 172.21.15.38:0/1925151736 >> v1:172.21.15.89:6789/0 conn(0x7f324015e740 legacy=0x7f32400b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.736+0000 7f32468e4640 1 -- 172.21.15.38:0/1925151736 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324006cec0 con 0x7f324006ca50 2023-12-22T08:40:47.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.736+0000 7f32458e2640 1 --2- 172.21.15.38:0/1925151736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400b3f90 0x7f324015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:47.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.737+0000 7f32468e4640 1 --2- 172.21.15.38:0/1925151736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324006ca50 0x7f3240070c00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3238009e50 tx=0x7f323802be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a8ec5abbc6d8b35 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:47.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.738+0000 7f32450e1640 1 -- 172.21.15.38:0/1925151736 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323802c9e0 con 0x7f324006ca50 2023-12-22T08:40:47.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.738+0000 7f32450e1640 1 -- 172.21.15.38:0/1925151736 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323802cb40 con 0x7f324006ca50 2023-12-22T08:40:47.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.738+0000 7f32450e1640 1 -- 172.21.15.38:0/1925151736 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32380343f0 con 0x7f324006ca50 2023-12-22T08:40:47.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.738+0000 7f3248347640 1 -- 172.21.15.38:0/1925151736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324006ca50 msgr2=0x7f3240070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.738+0000 7f3248347640 1 --2- 172.21.15.38:0/1925151736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324006ca50 0x7f3240070c00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3238009e50 tx=0x7f323802be40 comp rx=0 tx=0).stop 2023-12-22T08:40:47.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.739+0000 7f3248347640 1 -- 172.21.15.38:0/1925151736 shutdown_connections 2023-12-22T08:40:47.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.739+0000 7f3248347640 1 --2- 172.21.15.38:0/1925151736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324006ca50 0x7f3240070c00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.739+0000 7f3248347640 1 --2- 172.21.15.38:0/1925151736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400b3f90 0x7f324015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.739+0000 7f3248347640 1 -- 172.21.15.38:0/1925151736 >> 172.21.15.38:0/1925151736 conn(0x7f32400cfea0 msgr2=0x7f32400d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:47.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.739+0000 7f3248347640 1 -- 172.21.15.38:0/1925151736 shutdown_connections 2023-12-22T08:40:47.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.739+0000 7f3248347640 1 -- 172.21.15.38:0/1925151736 wait complete. 2023-12-22T08:40:47.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.740+0000 7f3248347640 1 Processor -- start 2023-12-22T08:40:47.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.741+0000 7f3248347640 1 -- start start 2023-12-22T08:40:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.742+0000 7f3248347640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324006ca50 0x7f32401562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.742+0000 7f3248347640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400b3f90 0x7f32400b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.742+0000 7f3248347640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f324015e740 0x7f32401f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.742+0000 7f3248347640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3240155280 con 0x7f324015e740 2023-12-22T08:40:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.742+0000 7f3248347640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3240155520 con 0x7f324006ca50 2023-12-22T08:40:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.742+0000 7f3248347640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3240155800 con 0x7f32400b3f90 2023-12-22T08:40:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.742+0000 7f32468e4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f324015e740 0x7f32401f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.742+0000 7f32468e4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f324015e740 0x7f32401f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49948/0 (socket says 172.21.15.38:49948) 2023-12-22T08:40:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.742+0000 7f32468e4640 1 -- 172.21.15.38:0/3098709403 learned_addr learned my addr 172.21.15.38:0/3098709403 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.742+0000 7f32460e3640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324006ca50 0x7f32401562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.742+0000 7f32458e2640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400b3f90 0x7f32400b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.743+0000 7f32468e4640 1 -- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400b3f90 msgr2=0x7f32400b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.743+0000 7f32468e4640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400b3f90 0x7f32400b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.743+0000 7f32468e4640 1 -- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324006ca50 msgr2=0x7f32401562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.743+0000 7f32468e4640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324006ca50 0x7f32401562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.743+0000 7f32468e4640 1 -- 172.21.15.38:0/3098709403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3230009400 con 0x7f324015e740 2023-12-22T08:40:47.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.743+0000 7f32468e4640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f324015e740 0x7f32401f2760 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3238009e50 tx=0x7f3238004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:47.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.744+0000 7f3236ffd640 1 -- 172.21.15.38:0/3098709403 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323803e450 con 0x7f324015e740 2023-12-22T08:40:47.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.744+0000 7f3236ffd640 1 -- 172.21.15.38:0/3098709403 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323803e5b0 con 0x7f324015e740 2023-12-22T08:40:47.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.744+0000 7f3236ffd640 1 -- 172.21.15.38:0/3098709403 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323803e960 con 0x7f324015e740 2023-12-22T08:40:47.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.744+0000 7f3248347640 1 -- 172.21.15.38:0/3098709403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3238009b30 con 0x7f324015e740 2023-12-22T08:40:47.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.744+0000 7f3248347640 1 -- 172.21.15.38:0/3098709403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3240155dc0 con 0x7f324015e740 2023-12-22T08:40:47.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.745+0000 7f3248347640 1 -- 172.21.15.38:0/3098709403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3240061910 con 0x7f324015e740 2023-12-22T08:40:47.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.747+0000 7f3236ffd640 1 -- 172.21.15.38:0/3098709403 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f323803eac0 con 0x7f324015e740 2023-12-22T08:40:47.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.747+0000 7f3236ffd640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f322406a430 0x7f322406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:47.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.748+0000 7f3236ffd640 1 -- 172.21.15.38:0/3098709403 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f32380ab590 con 0x7f324015e740 2023-12-22T08:40:47.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.748+0000 7f32460e3640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f322406a430 0x7f322406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:47.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.749+0000 7f32460e3640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f322406a430 0x7f322406c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f323c001780 tx=0x7f323c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:47.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.753+0000 7f3236ffd640 1 -- 172.21.15.38:0/3098709403 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3238076b40 con 0x7f324015e740 2023-12-22T08:40:47.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.949+0000 7f3248347640 1 -- 172.21.15.38:0/3098709403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f324015f290 con 0x7f324015e740 2023-12-22T08:40:47.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.950+0000 7f3236ffd640 1 -- 172.21.15.38:0/3098709403 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f323807a160 con 0x7f324015e740 2023-12-22T08:40:47.953 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:40:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.953+0000 7f3248347640 1 -- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f322406a430 msgr2=0x7f322406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.953+0000 7f3248347640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f322406a430 0x7f322406c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f323c001780 tx=0x7f323c009040 comp rx=0 tx=0).stop 2023-12-22T08:40:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.953+0000 7f3248347640 1 -- 172.21.15.38:0/3098709403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f324015e740 msgr2=0x7f32401f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.953+0000 7f3248347640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f324015e740 0x7f32401f2760 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3238009e50 tx=0x7f3238004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.953+0000 7f3248347640 1 -- 172.21.15.38:0/3098709403 shutdown_connections 2023-12-22T08:40:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.953+0000 7f3248347640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f322406a430 0x7f322406c8f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.953+0000 7f3248347640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f324015e740 0x7f32401f2760 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.953+0000 7f3248347640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32400b3f90 0x7f32400b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.953+0000 7f3248347640 1 --2- 172.21.15.38:0/3098709403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f324006ca50 0x7f32401562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.953+0000 7f3248347640 1 -- 172.21.15.38:0/3098709403 >> 172.21.15.38:0/3098709403 conn(0x7f32400cfea0 msgr2=0x7f324015ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.953+0000 7f3248347640 1 -- 172.21.15.38:0/3098709403 shutdown_connections 2023-12-22T08:40:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:47.953+0000 7f3248347640 1 -- 172.21.15.38:0/3098709403 wait complete. 2023-12-22T08:40:47.974 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:48.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.186+0000 7f343bb5c640 1 Processor -- start 2023-12-22T08:40:48.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.186+0000 7f343bb5c640 1 -- start start 2023-12-22T08:40:48.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.188+0000 7f343bb5c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f343415a370 0x7f3434071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.188+0000 7f343bb5c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343415b3c0 0x7f3434071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.188+0000 7f343bb5c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f343406c260 0x7f343406f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.188+0000 7f343bb5c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343415b940 con 0x7f343406c260 2023-12-22T08:40:48.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.188+0000 7f343bb5c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34340cd080 con 0x7f343415a370 2023-12-22T08:40:48.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.188+0000 7f343bb5c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34340cd320 con 0x7f343415b3c0 2023-12-22T08:40:48.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.188+0000 7f343a0f9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f343406c260 0x7f343406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.188+0000 7f343a0f9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f343406c260 0x7f343406f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49956/0 (socket says 172.21.15.38:49956) 2023-12-22T08:40:48.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.189+0000 7f343a0f9640 1 -- 172.21.15.38:0/3362699916 learned_addr learned my addr 172.21.15.38:0/3362699916 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:48.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.189+0000 7f34398f8640 1 --2- 172.21.15.38:0/3362699916 >> v2:172.21.15.89:3300/0 conn(0x7f343415a370 0x7f3434071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.189+0000 7f34390f7640 1 --2- 172.21.15.38:0/3362699916 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343415b3c0 0x7f3434071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.189+0000 7f343a0f9640 1 -- 172.21.15.38:0/3362699916 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343415b3c0 msgr2=0x7f3434071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:48.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.189+0000 7f343a0f9640 1 --2- 172.21.15.38:0/3362699916 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343415b3c0 0x7f3434071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.189+0000 7f343a0f9640 1 -- 172.21.15.38:0/3362699916 >> v2:172.21.15.89:3300/0 conn(0x7f343415a370 msgr2=0x7f3434071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:48.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.189+0000 7f343a0f9640 1 --2- 172.21.15.38:0/3362699916 >> v2:172.21.15.89:3300/0 conn(0x7f343415a370 0x7f3434071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.189+0000 7f343a0f9640 1 -- 172.21.15.38:0/3362699916 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34340cd600 con 0x7f343406c260 2023-12-22T08:40:48.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.189+0000 7f34398f8640 1 --2- 172.21.15.38:0/3362699916 >> v2:172.21.15.89:3300/0 conn(0x7f343415a370 0x7f3434071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:48.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.190+0000 7f343a0f9640 1 --2- 172.21.15.38:0/3362699916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343406c260 0x7f343406f250 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f34340703c0 tx=0x7f342c02db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b782c29cf56561cf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:48.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.191+0000 7f34388f6640 1 -- 172.21.15.38:0/3362699916 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c02f8e0 con 0x7f343406c260 2023-12-22T08:40:48.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.191+0000 7f34388f6640 1 -- 172.21.15.38:0/3362699916 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c02fa40 con 0x7f343406c260 2023-12-22T08:40:48.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.191+0000 7f34388f6640 1 -- 172.21.15.38:0/3362699916 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c02fdd0 con 0x7f343406c260 2023-12-22T08:40:48.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.191+0000 7f343bb5c640 1 -- 172.21.15.38:0/3362699916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343406c260 msgr2=0x7f343406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.191+0000 7f343bb5c640 1 --2- 172.21.15.38:0/3362699916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343406c260 0x7f343406f250 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f34340703c0 tx=0x7f342c02db20 comp rx=0 tx=0).stop 2023-12-22T08:40:48.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.192+0000 7f343bb5c640 1 -- 172.21.15.38:0/3362699916 shutdown_connections 2023-12-22T08:40:48.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.192+0000 7f343bb5c640 1 --2- 172.21.15.38:0/3362699916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343406c260 0x7f343406f250 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.192+0000 7f343bb5c640 1 --2- 172.21.15.38:0/3362699916 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343415b3c0 0x7f3434071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.192+0000 7f343bb5c640 1 --2- 172.21.15.38:0/3362699916 >> v2:172.21.15.89:3300/0 conn(0x7f343415a370 0x7f3434071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.192+0000 7f343bb5c640 1 -- 172.21.15.38:0/3362699916 >> 172.21.15.38:0/3362699916 conn(0x7f34340b20c0 msgr2=0x7f34340b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:48.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.192+0000 7f343bb5c640 1 -- 172.21.15.38:0/3362699916 shutdown_connections 2023-12-22T08:40:48.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.192+0000 7f343bb5c640 1 -- 172.21.15.38:0/3362699916 wait complete. 2023-12-22T08:40:48.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.193+0000 7f343bb5c640 1 Processor -- start 2023-12-22T08:40:48.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.194+0000 7f343bb5c640 1 -- start start 2023-12-22T08:40:48.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f343bb5c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343406c260 0x7f34341493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f343bb5c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343415a370 0x7f34340b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f343bb5c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f343415b3c0 0x7f34340b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f343bb5c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3434159580 con 0x7f343415a370 2023-12-22T08:40:48.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f343bb5c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343415bd20 con 0x7f343415b3c0 2023-12-22T08:40:48.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f343bb5c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3434149930 con 0x7f343406c260 2023-12-22T08:40:48.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f34390f7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343415a370 0x7f34340b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f34390f7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343415a370 0x7f34340b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49960/0 (socket says 172.21.15.38:49960) 2023-12-22T08:40:48.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f34390f7640 1 -- 172.21.15.38:0/3021782887 learned_addr learned my addr 172.21.15.38:0/3021782887 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:48.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f34398f8640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343406c260 0x7f34341493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f343a0f9640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f343415b3c0 0x7f34340b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f34390f7640 1 -- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343406c260 msgr2=0x7f34341493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f34390f7640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343406c260 0x7f34341493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f34390f7640 1 -- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f343415b3c0 msgr2=0x7f34340b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f34390f7640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f343415b3c0 0x7f34340b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f34390f7640 1 -- 172.21.15.38:0/3021782887 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c0094d0 con 0x7f343415a370 2023-12-22T08:40:48.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.195+0000 7f343a0f9640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f343415b3c0 0x7f34340b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:48.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.196+0000 7f34390f7640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343415a370 0x7f34340b24a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f342000d7d0 tx=0x7f342000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:48.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.196+0000 7f34327fc640 1 -- 172.21.15.38:0/3021782887 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420018070 con 0x7f343415a370 2023-12-22T08:40:48.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.196+0000 7f34327fc640 1 -- 172.21.15.38:0/3021782887 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420004020 con 0x7f343415a370 2023-12-22T08:40:48.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.196+0000 7f34327fc640 1 -- 172.21.15.38:0/3021782887 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34200041b0 con 0x7f343415a370 2023-12-22T08:40:48.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.196+0000 7f343bb5c640 1 -- 172.21.15.38:0/3021782887 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3434158ce0 con 0x7f343415a370 2023-12-22T08:40:48.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.196+0000 7f343bb5c640 1 -- 172.21.15.38:0/3021782887 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34341592a0 con 0x7f343415a370 2023-12-22T08:40:48.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.197+0000 7f343bb5c640 1 -- 172.21.15.38:0/3021782887 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343415ba80 con 0x7f343415a370 2023-12-22T08:40:48.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.198+0000 7f34327fc640 1 -- 172.21.15.38:0/3021782887 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3420004310 con 0x7f343415a370 2023-12-22T08:40:48.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.200+0000 7f34327fc640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f341806a430 0x7f341806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.200+0000 7f34327fc640 1 -- 172.21.15.38:0/3021782887 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3420088780 con 0x7f343415a370 2023-12-22T08:40:48.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.201+0000 7f34398f8640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f341806a430 0x7f341806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.202+0000 7f34398f8640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f341806a430 0x7f341806c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3428007130 tx=0x7f34280079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:48.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.205+0000 7f34327fc640 1 -- 172.21.15.38:0/3021782887 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f343415ba80 con 0x7f343415a370 2023-12-22T08:40:48.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.407+0000 7f343bb5c640 1 -- 172.21.15.38:0/3021782887 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f343415ba80 con 0x7f343415a370 2023-12-22T08:40:48.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.408+0000 7f34327fc640 1 -- 172.21.15.38:0/3021782887 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f343415ba80 con 0x7f343415a370 2023-12-22T08:40:48.411 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:40:48.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.411+0000 7f343bb5c640 1 -- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f341806a430 msgr2=0x7f341806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.411+0000 7f343bb5c640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f341806a430 0x7f341806c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3428007130 tx=0x7f34280079c0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.411+0000 7f343bb5c640 1 -- 172.21.15.38:0/3021782887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343415a370 msgr2=0x7f34340b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.411+0000 7f343bb5c640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343415a370 0x7f34340b24a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f342000d7d0 tx=0x7f342000dc90 comp rx=0 tx=0).stop 2023-12-22T08:40:48.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.411+0000 7f343bb5c640 1 -- 172.21.15.38:0/3021782887 shutdown_connections 2023-12-22T08:40:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.411+0000 7f343bb5c640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f343415b3c0 0x7f34340b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.411+0000 7f343bb5c640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f341806a430 0x7f341806c8f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.411+0000 7f343bb5c640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f343415a370 0x7f34340b24a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.411+0000 7f343bb5c640 1 --2- 172.21.15.38:0/3021782887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f343406c260 0x7f34341493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.411+0000 7f343bb5c640 1 -- 172.21.15.38:0/3021782887 >> 172.21.15.38:0/3021782887 conn(0x7f34340b20c0 msgr2=0x7f3434071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.412+0000 7f343bb5c640 1 -- 172.21.15.38:0/3021782887 shutdown_connections 2023-12-22T08:40:48.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.412+0000 7f343bb5c640 1 -- 172.21.15.38:0/3021782887 wait complete. 2023-12-22T08:40:48.432 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:40:48.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.649+0000 7fe9f883f640 1 Processor -- start 2023-12-22T08:40:48.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.650+0000 7fe9f883f640 1 -- start start 2023-12-22T08:40:48.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.651+0000 7fe9f883f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9f415ad90 0x7fe9f40caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.651+0000 7fe9f883f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe9f415e050 0x7fe9f40cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.651+0000 7fe9f883f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f415e630 con 0x7fe9f4161bb0 2023-12-22T08:40:48.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.651+0000 7fe9f883f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f40ce2c0 con 0x7fe9f415e050 2023-12-22T08:40:48.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.651+0000 7fe9f883f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f415e910 con 0x7fe9f415ad90 2023-12-22T08:40:48.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.651+0000 7fe9f2ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe9f4161bb0 0x7fe9f415d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42918/0 (socket says 172.21.15.38:42918) 2023-12-22T08:40:48.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.651+0000 7fe9f2ffd640 1 -- 172.21.15.38:0/3956735530 learned_addr learned my addr 172.21.15.38:0/3956735530 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.652+0000 7fe9f37fe640 1 --2- 172.21.15.38:0/3956735530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9f415ad90 0x7fe9f40caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.652+0000 7fe9f3fff640 1 --2- 172.21.15.38:0/3956735530 >> v2:172.21.15.89:3300/0 conn(0x7fe9f415e050 0x7fe9f40cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.652+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268872986 0 0) 0x7fe9f415e630 con 0x7fe9f4161bb0 2023-12-22T08:40:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.652+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e0003520 con 0x7fe9f4161bb0 2023-12-22T08:40:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.652+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1982399630 0 0) 0x7fe9e0003520 con 0x7fe9f4161bb0 2023-12-22T08:40:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.652+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9f415ad90 msgr2=0x7fe9f40caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.652+0000 7fe9f27fc640 1 --2- 172.21.15.38:0/3956735530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9f415ad90 0x7fe9f40caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.652+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 >> v2:172.21.15.89:3300/0 conn(0x7fe9f415e050 msgr2=0x7fe9f40cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.652+0000 7fe9f27fc640 1 --2- 172.21.15.38:0/3956735530 >> v2:172.21.15.89:3300/0 conn(0x7fe9f415e050 0x7fe9f40cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.652+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f41610d0 con 0x7fe9f4161bb0 2023-12-22T08:40:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.652+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fe9dc0019f0 con 0x7fe9f4161bb0 2023-12-22T08:40:48.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.652+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 >> v1:172.21.15.38:6789/0 conn(0x7fe9f4161bb0 legacy=0x7fe9f415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.652+0000 7fe9f27fc640 1 --2- 172.21.15.38:0/3956735530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9f415ad90 0x7fe9e0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.653+0000 7fe9f27fc640 1 --2- 172.21.15.38:0/3956735530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e0003ef0 0x7fe9e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.653+0000 7fe9f27fc640 1 --2- 172.21.15.38:0/3956735530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e0004d00 0x7fe9e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.653+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f415e910 con 0x7fe9e0004d00 2023-12-22T08:40:48.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.653+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e000b980 con 0x7fe9e0003ef0 2023-12-22T08:40:48.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.653+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e000bac0 con 0x7fe9f415ad90 2023-12-22T08:40:48.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.653+0000 7fe9f3fff640 1 --2- 172.21.15.38:0/3956735530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e0004d00 0x7fe9e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.653+0000 7fe9f37fe640 1 --2- 172.21.15.38:0/3956735530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9f415ad90 0x7fe9e0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.653+0000 7fe9f2ffd640 1 --2- 172.21.15.38:0/3956735530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e0003ef0 0x7fe9e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.653+0000 7fe9f3fff640 1 -- 172.21.15.38:0/3956735530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9f415ad90 msgr2=0x7fe9e0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:48.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.653+0000 7fe9f3fff640 1 --2- 172.21.15.38:0/3956735530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9f415ad90 0x7fe9e0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.654+0000 7fe9f3fff640 1 -- 172.21.15.38:0/3956735530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e0003ef0 msgr2=0x7fe9e00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:48.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.654+0000 7fe9f3fff640 1 --2- 172.21.15.38:0/3956735530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e0003ef0 0x7fe9e00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.654+0000 7fe9f3fff640 1 -- 172.21.15.38:0/3956735530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e0003520 con 0x7fe9e0004d00 2023-12-22T08:40:48.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.654+0000 7fe9f2ffd640 1 --2- 172.21.15.38:0/3956735530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e0003ef0 0x7fe9e00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:48.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.655+0000 7fe9f3fff640 1 --2- 172.21.15.38:0/3956735530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e0004d00 0x7fe9e0005180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009ac0 tx=0x7fe9e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06decbebfeeee60 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:48.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.655+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec02c6d0 con 0x7fe9e0004d00 2023-12-22T08:40:48.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.655+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec02c830 con 0x7fe9e0004d00 2023-12-22T08:40:48.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.655+0000 7fe9f27fc640 1 -- 172.21.15.38:0/3956735530 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec02cbc0 con 0x7fe9e0004d00 2023-12-22T08:40:48.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.656+0000 7fe9f883f640 1 -- 172.21.15.38:0/3956735530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e0004d00 msgr2=0x7fe9e0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.656+0000 7fe9f883f640 1 --2- 172.21.15.38:0/3956735530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e0004d00 0x7fe9e0005180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009ac0 tx=0x7fe9e00057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.656+0000 7fe9f3fff640 1 -- 172.21.15.38:0/3956735530 reap_dead start 2023-12-22T08:40:48.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.656+0000 7fe9f883f640 1 -- 172.21.15.38:0/3956735530 shutdown_connections 2023-12-22T08:40:48.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.656+0000 7fe9f883f640 1 -- 172.21.15.38:0/3956735530 >> 172.21.15.38:0/3956735530 conn(0x7fe9f40d31c0 msgr2=0x7fe9f40d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:48.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.656+0000 7fe9f883f640 1 -- 172.21.15.38:0/3956735530 shutdown_connections 2023-12-22T08:40:48.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.656+0000 7fe9f883f640 1 -- 172.21.15.38:0/3956735530 wait complete. 2023-12-22T08:40:48.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.658+0000 7fe9f883f640 1 Processor -- start 2023-12-22T08:40:48.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.659+0000 7fe9f883f640 1 -- start start 2023-12-22T08:40:48.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.659+0000 7fe9f883f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9f414e3c0 0x7fe9f4157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f883f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f414e7a0 0x7fe9f41575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f883f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9f4160790 0x7fe9f41f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f883f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f41f3a90 con 0x7fe9f414e7a0 2023-12-22T08:40:48.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f883f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f41f37b0 con 0x7fe9f414e3c0 2023-12-22T08:40:48.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f883f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f415fcb0 con 0x7fe9f4160790 2023-12-22T08:40:48.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f414e7a0 0x7fe9f41575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f414e7a0 0x7fe9f41575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49976/0 (socket says 172.21.15.38:49976) 2023-12-22T08:40:48.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f2ffd640 1 -- 172.21.15.38:0/3167484526 learned_addr learned my addr 172.21.15.38:0/3167484526 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:48.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f3fff640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9f4160790 0x7fe9f41f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f37fe640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9f414e3c0 0x7fe9f4157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f2ffd640 1 -- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9f4160790 msgr2=0x7fe9f41f2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f2ffd640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9f4160790 0x7fe9f41f2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f2ffd640 1 -- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9f414e3c0 msgr2=0x7fe9f4157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f2ffd640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9f414e3c0 0x7fe9f4157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.660+0000 7fe9f2ffd640 1 -- 172.21.15.38:0/3167484526 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f415ff90 con 0x7fe9f414e7a0 2023-12-22T08:40:48.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.661+0000 7fe9f2ffd640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f414e7a0 0x7fe9f41575c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc004bc0 tx=0x7fe9dc00e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.661+0000 7fe9ebfff640 1 -- 172.21.15.38:0/3167484526 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc013420 con 0x7fe9f414e7a0 2023-12-22T08:40:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.661+0000 7fe9ebfff640 1 -- 172.21.15.38:0/3167484526 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc013580 con 0x7fe9f414e7a0 2023-12-22T08:40:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.661+0000 7fe9ebfff640 1 -- 172.21.15.38:0/3167484526 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0138f0 con 0x7fe9f414e7a0 2023-12-22T08:40:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.661+0000 7fe9f883f640 1 -- 172.21.15.38:0/3167484526 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f4160270 con 0x7fe9f414e7a0 2023-12-22T08:40:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.661+0000 7fe9f883f640 1 -- 172.21.15.38:0/3167484526 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f41f3150 con 0x7fe9f414e7a0 2023-12-22T08:40:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.662+0000 7fe9f883f640 1 -- 172.21.15.38:0/3167484526 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f415fb10 con 0x7fe9f414e7a0 2023-12-22T08:40:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.663+0000 7fe9ebfff640 1 -- 172.21.15.38:0/3167484526 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe9dc013a50 con 0x7fe9f414e7a0 2023-12-22T08:40:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.665+0000 7fe9ebfff640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe9d406a430 0x7fe9d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.665+0000 7fe9ebfff640 1 -- 172.21.15.38:0/3167484526 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe9dc089250 con 0x7fe9f414e7a0 2023-12-22T08:40:48.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.665+0000 7fe9f37fe640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe9d406a430 0x7fe9d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.666+0000 7fe9f37fe640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe9d406a430 0x7fe9d406c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009950 tx=0x7fe9e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:48.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.669+0000 7fe9ebfff640 1 -- 172.21.15.38:0/3167484526 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe9f415fb10 con 0x7fe9f414e7a0 2023-12-22T08:40:48.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.877+0000 7fe9f883f640 1 -- 172.21.15.38:0/3167484526 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe9f415fb10 con 0x7fe9f414e7a0 2023-12-22T08:40:48.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.878+0000 7fe9ebfff640 1 -- 172.21.15.38:0/3167484526 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe9f415fb10 con 0x7fe9f414e7a0 2023-12-22T08:40:48.880 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:40:48.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.880+0000 7fe9f883f640 1 -- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe9d406a430 msgr2=0x7fe9d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.880+0000 7fe9f883f640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe9d406a430 0x7fe9d406c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009950 tx=0x7fe9e4008040 comp rx=0 tx=0).stop 2023-12-22T08:40:48.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.880+0000 7fe9f883f640 1 -- 172.21.15.38:0/3167484526 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f414e7a0 msgr2=0x7fe9f41575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.880+0000 7fe9f883f640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f414e7a0 0x7fe9f41575c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc004bc0 tx=0x7fe9dc00e4d0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.880+0000 7fe9f883f640 1 -- 172.21.15.38:0/3167484526 shutdown_connections 2023-12-22T08:40:48.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.880+0000 7fe9f883f640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9f4160790 0x7fe9f41f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.880+0000 7fe9f883f640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe9d406a430 0x7fe9d406c8f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.880+0000 7fe9f883f640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9f414e7a0 0x7fe9f41575c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.880+0000 7fe9f883f640 1 --2- 172.21.15.38:0/3167484526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9f414e3c0 0x7fe9f4157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.880+0000 7fe9f883f640 1 -- 172.21.15.38:0/3167484526 >> 172.21.15.38:0/3167484526 conn(0x7fe9f40d31c0 msgr2=0x7fe9f40d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:48.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.880+0000 7fe9f883f640 1 -- 172.21.15.38:0/3167484526 shutdown_connections 2023-12-22T08:40:48.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:48.880+0000 7fe9f883f640 1 -- 172.21.15.38:0/3167484526 wait complete. 2023-12-22T08:40:48.901 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T08:40:48.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:48.901 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-22T08:40:49.005 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:40:49.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:49.006 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T08:40:49.066 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:40:49.066 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:49.126 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:40:49.127 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:49.181 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:40:49.181 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:49.235 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.469+0000 7fe555054640 1 Processor -- start 2023-12-22T08:40:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.470+0000 7fe555054640 1 -- start start 2023-12-22T08:40:49.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.471+0000 7fe555054640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500a44a0 0x7fe5500708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.471+0000 7fe555054640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe550070e30 0x7fe55015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.471+0000 7fe555054640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5500cdae0 con 0x7fe55015b420 2023-12-22T08:40:49.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.471+0000 7fe555054640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe550071260 con 0x7fe550070e30 2023-12-22T08:40:49.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.471+0000 7fe555054640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55015b800 con 0x7fe5500a44a0 2023-12-22T08:40:49.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.471+0000 7fe54ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe55015b420 0x7fe55006d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42926/0 (socket says 172.21.15.38:42926) 2023-12-22T08:40:49.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.471+0000 7fe54ffff640 1 -- 172.21.15.38:0/1137090130 learned_addr learned my addr 172.21.15.38:0/1137090130 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:49.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.471+0000 7fe554853640 1 --2- 172.21.15.38:0/1137090130 >> v2:172.21.15.38:3300/0 conn(0x7fe550070e30 0x7fe55015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.472+0000 7fe547fff640 1 --2- 172.21.15.38:0/1137090130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500a44a0 0x7fe5500708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.472+0000 7fe554853640 1 -- 172.21.15.38:0/1137090130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500a44a0 msgr2=0x7fe5500708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:49.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.472+0000 7fe554853640 1 --2- 172.21.15.38:0/1137090130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500a44a0 0x7fe5500708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.472+0000 7fe554853640 1 -- 172.21.15.38:0/1137090130 >> v1:172.21.15.38:6789/0 conn(0x7fe55015b420 legacy=0x7fe55006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.472+0000 7fe554853640 1 -- 172.21.15.38:0/1137090130 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5500cdd30 con 0x7fe550070e30 2023-12-22T08:40:49.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.472+0000 7fe54f7fe640 1 -- 172.21.15.38:0/1137090130 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992355913 0 0) 0x7fe5500cdae0 con 0x7fe55015b420 2023-12-22T08:40:49.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.473+0000 7fe554853640 1 --2- 172.21.15.38:0/1137090130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe550070e30 0x7fe55015baa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe548009d90 tx=0x7fe54802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e06b2aa5b5eae4d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.473+0000 7fe54f7fe640 1 -- 172.21.15.38:0/1137090130 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54802cc50 con 0x7fe550070e30 2023-12-22T08:40:49.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.473+0000 7fe54f7fe640 1 -- 172.21.15.38:0/1137090130 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54802cdb0 con 0x7fe550070e30 2023-12-22T08:40:49.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.473+0000 7fe54f7fe640 1 -- 172.21.15.38:0/1137090130 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548034660 con 0x7fe550070e30 2023-12-22T08:40:49.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.474+0000 7fe555054640 1 -- 172.21.15.38:0/1137090130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe550070e30 msgr2=0x7fe55015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.474+0000 7fe555054640 1 --2- 172.21.15.38:0/1137090130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe550070e30 0x7fe55015baa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe548009d90 tx=0x7fe54802bea0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.474+0000 7fe555054640 1 -- 172.21.15.38:0/1137090130 shutdown_connections 2023-12-22T08:40:49.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.474+0000 7fe555054640 1 --2- 172.21.15.38:0/1137090130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe550070e30 0x7fe55015baa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.474+0000 7fe555054640 1 --2- 172.21.15.38:0/1137090130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500a44a0 0x7fe5500708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.474+0000 7fe555054640 1 -- 172.21.15.38:0/1137090130 >> 172.21.15.38:0/1137090130 conn(0x7fe5500b1f70 msgr2=0x7fe5500b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:49.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.474+0000 7fe555054640 1 -- 172.21.15.38:0/1137090130 shutdown_connections 2023-12-22T08:40:49.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.474+0000 7fe555054640 1 -- 172.21.15.38:0/1137090130 wait complete. 2023-12-22T08:40:49.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.476+0000 7fe555054640 1 Processor -- start 2023-12-22T08:40:49.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.476+0000 7fe555054640 1 -- start start 2023-12-22T08:40:49.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.477+0000 7fe555054640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe550070e30 0x7fe5500c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.477+0000 7fe555054640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500a44a0 0x7fe5500c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.477+0000 7fe555054640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55015b420 0x7fe5501f6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.477+0000 7fe555054640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5501f3be0 con 0x7fe55015b420 2023-12-22T08:40:49.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.477+0000 7fe555054640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5501f2fd0 con 0x7fe550070e30 2023-12-22T08:40:49.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.477+0000 7fe555054640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5501f32b0 con 0x7fe5500a44a0 2023-12-22T08:40:49.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.478+0000 7fe554853640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55015b420 0x7fe5501f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.478+0000 7fe554853640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55015b420 0x7fe5501f6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49994/0 (socket says 172.21.15.38:49994) 2023-12-22T08:40:49.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.478+0000 7fe554853640 1 -- 172.21.15.38:0/1046659905 learned_addr learned my addr 172.21.15.38:0/1046659905 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:49.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.478+0000 7fe547fff640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500a44a0 0x7fe5500c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.478+0000 7fe54ffff640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe550070e30 0x7fe5500c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.478+0000 7fe554853640 1 -- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500a44a0 msgr2=0x7fe5500c25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.478+0000 7fe554853640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500a44a0 0x7fe5500c25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.478+0000 7fe554853640 1 -- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe550070e30 msgr2=0x7fe5500c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.478+0000 7fe554853640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe550070e30 0x7fe5500c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.478+0000 7fe554853640 1 -- 172.21.15.38:0/1046659905 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548009a70 con 0x7fe55015b420 2023-12-22T08:40:49.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.478+0000 7fe54ffff640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe550070e30 0x7fe5500c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:49.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.478+0000 7fe554853640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55015b420 0x7fe5501f6420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe548009d90 tx=0x7fe548004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.479+0000 7fe54d7fa640 1 -- 172.21.15.38:0/1046659905 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548040650 con 0x7fe55015b420 2023-12-22T08:40:49.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.479+0000 7fe54d7fa640 1 -- 172.21.15.38:0/1046659905 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5480407d0 con 0x7fe55015b420 2023-12-22T08:40:49.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.479+0000 7fe54d7fa640 1 -- 172.21.15.38:0/1046659905 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548040b80 con 0x7fe55015b420 2023-12-22T08:40:49.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.479+0000 7fe555054640 1 -- 172.21.15.38:0/1046659905 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5501f3590 con 0x7fe55015b420 2023-12-22T08:40:49.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.479+0000 7fe555054640 1 -- 172.21.15.38:0/1046659905 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55015cc90 con 0x7fe55015b420 2023-12-22T08:40:49.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.480+0000 7fe555054640 1 -- 172.21.15.38:0/1046659905 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe550148e80 con 0x7fe55015b420 2023-12-22T08:40:49.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.481+0000 7fe54d7fa640 1 -- 172.21.15.38:0/1046659905 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe548040ce0 con 0x7fe55015b420 2023-12-22T08:40:49.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.482+0000 7fe54d7fa640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe53006a430 0x7fe53006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.482+0000 7fe54d7fa640 1 -- 172.21.15.38:0/1046659905 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe5480ab790 con 0x7fe55015b420 2023-12-22T08:40:49.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.483+0000 7fe54ffff640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe53006a430 0x7fe53006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.484+0000 7fe54ffff640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe53006a430 0x7fe53006c8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe540000f60 tx=0x7fe540009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.486+0000 7fe54d7fa640 1 -- 172.21.15.38:0/1046659905 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe550148e80 con 0x7fe55015b420 2023-12-22T08:40:49.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.685+0000 7fe555054640 1 -- 172.21.15.38:0/1046659905 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe550148e80 con 0x7fe55015b420 2023-12-22T08:40:49.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.688+0000 7fe54d7fa640 1 -- 172.21.15.38:0/1046659905 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16088 (secure 0 0 0) 0x7fe550148e80 con 0x7fe55015b420 2023-12-22T08:40:49.691 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:49.691 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":22,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:40:48.371962+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:49.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.691+0000 7fe555054640 1 -- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe53006a430 msgr2=0x7fe53006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.691+0000 7fe555054640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe53006a430 0x7fe53006c8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe540000f60 tx=0x7fe540009040 comp rx=0 tx=0).stop 2023-12-22T08:40:49.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.691+0000 7fe555054640 1 -- 172.21.15.38:0/1046659905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55015b420 msgr2=0x7fe5501f6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.691+0000 7fe555054640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55015b420 0x7fe5501f6420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe548009d90 tx=0x7fe548004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:49.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.691+0000 7fe555054640 1 -- 172.21.15.38:0/1046659905 shutdown_connections 2023-12-22T08:40:49.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.691+0000 7fe555054640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe53006a430 0x7fe53006c8f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.691+0000 7fe555054640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55015b420 0x7fe5501f6420 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.691+0000 7fe555054640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500a44a0 0x7fe5500c25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.691+0000 7fe555054640 1 --2- 172.21.15.38:0/1046659905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe550070e30 0x7fe5500c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.691+0000 7fe555054640 1 -- 172.21.15.38:0/1046659905 >> 172.21.15.38:0/1046659905 conn(0x7fe5500b1f70 msgr2=0x7fe55009de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:49.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.691+0000 7fe555054640 1 -- 172.21.15.38:0/1046659905 shutdown_connections 2023-12-22T08:40:49.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.692+0000 7fe555054640 1 -- 172.21.15.38:0/1046659905 wait complete. 2023-12-22T08:40:49.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:39:56.873963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:39:57.616447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:49.712 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:49.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.942+0000 7f8388a4d640 1 Processor -- start 2023-12-22T08:40:49.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.943+0000 7f8388a4d640 1 -- start start 2023-12-22T08:40:49.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.944+0000 7f8388a4d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f838415d1c0 0x7f8384070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.944+0000 7f8388a4d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f838415d5a0 0x7f8384070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.944+0000 7f8388a4d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838415de50 con 0x7f83840d0060 2023-12-22T08:40:49.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.944+0000 7f8388a4d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83840d0b80 con 0x7f838415d5a0 2023-12-22T08:40:49.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.944+0000 7f8388a4d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83840d0dd0 con 0x7f838415d1c0 2023-12-22T08:40:49.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.945+0000 7f837affd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f838415d5a0 0x7f8384070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.945+0000 7f837affd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f838415d5a0 0x7f8384070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50008/0 (socket says 172.21.15.38:50008) 2023-12-22T08:40:49.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.945+0000 7f837affd640 1 -- 172.21.15.38:0/3115468613 learned_addr learned my addr 172.21.15.38:0/3115468613 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:49.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.945+0000 7f83837fe640 1 --2- 172.21.15.38:0/3115468613 >> v2:172.21.15.89:3300/0 conn(0x7f838415d1c0 0x7f8384070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.945+0000 7f837affd640 1 -- 172.21.15.38:0/3115468613 >> v2:172.21.15.89:3300/0 conn(0x7f838415d1c0 msgr2=0x7f8384070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:49.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.945+0000 7f837affd640 1 --2- 172.21.15.38:0/3115468613 >> v2:172.21.15.89:3300/0 conn(0x7f838415d1c0 0x7f8384070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.945+0000 7f837affd640 1 -- 172.21.15.38:0/3115468613 >> v1:172.21.15.89:6789/0 conn(0x7f83840d0060 legacy=0x7f83840d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:49.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.946+0000 7f837affd640 1 -- 172.21.15.38:0/3115468613 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83840d10b0 con 0x7f838415d5a0 2023-12-22T08:40:49.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.947+0000 7f837affd640 1 --2- 172.21.15.38:0/3115468613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f838415d5a0 0x7f8384070eb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f838404e140 tx=0x7f836c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf61775bd243f9ce server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.947+0000 7f8382ffd640 1 -- 172.21.15.38:0/3115468613 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c030860 con 0x7f838415d5a0 2023-12-22T08:40:49.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.947+0000 7f8382ffd640 1 -- 172.21.15.38:0/3115468613 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c0309c0 con 0x7f838415d5a0 2023-12-22T08:40:49.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.947+0000 7f8382ffd640 1 -- 172.21.15.38:0/3115468613 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c030d50 con 0x7f838415d5a0 2023-12-22T08:40:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.948+0000 7f8388a4d640 1 -- 172.21.15.38:0/3115468613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f838415d5a0 msgr2=0x7f8384070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.948+0000 7f8388a4d640 1 --2- 172.21.15.38:0/3115468613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f838415d5a0 0x7f8384070eb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f838404e140 tx=0x7f836c02b9a0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.948+0000 7f8388a4d640 1 -- 172.21.15.38:0/3115468613 shutdown_connections 2023-12-22T08:40:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.948+0000 7f8388a4d640 1 --2- 172.21.15.38:0/3115468613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f838415d5a0 0x7f8384070eb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.948+0000 7f8388a4d640 1 --2- 172.21.15.38:0/3115468613 >> v2:172.21.15.89:3300/0 conn(0x7f838415d1c0 0x7f8384070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.948+0000 7f8388a4d640 1 -- 172.21.15.38:0/3115468613 >> 172.21.15.38:0/3115468613 conn(0x7f838406bf90 msgr2=0x7f838406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.948+0000 7f8388a4d640 1 -- 172.21.15.38:0/3115468613 shutdown_connections 2023-12-22T08:40:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.948+0000 7f8388a4d640 1 -- 172.21.15.38:0/3115468613 wait complete. 2023-12-22T08:40:49.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.950+0000 7f8388a4d640 1 Processor -- start 2023-12-22T08:40:49.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.950+0000 7f8388a4d640 1 -- start start 2023-12-22T08:40:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f8388a4d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83840d0060 0x7f8384144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f8388a4d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f838415d1c0 0x7f83840b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f8388a4d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f838415d5a0 0x7f838415f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f8388a4d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8384152eb0 con 0x7f83840d0060 2023-12-22T08:40:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f8388a4d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841454f0 con 0x7f838415d5a0 2023-12-22T08:40:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f8388a4d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83840b7c60 con 0x7f838415d1c0 2023-12-22T08:40:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f83837fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83840d0060 0x7f8384144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f83837fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83840d0060 0x7f8384144fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50014/0 (socket says 172.21.15.38:50014) 2023-12-22T08:40:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f83837fe640 1 -- 172.21.15.38:0/1820126222 learned_addr learned my addr 172.21.15.38:0/1820126222 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f83837fe640 1 -- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f838415d1c0 msgr2=0x7f83840b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f83837fe640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f838415d1c0 0x7f83840b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f83837fe640 1 -- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f838415d5a0 msgr2=0x7f838415f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f8383fff640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f838415d5a0 0x7f838415f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.951+0000 7f83837fe640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f838415d5a0 0x7f838415f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.952+0000 7f83837fe640 1 -- 172.21.15.38:0/1820126222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0094d0 con 0x7f83840d0060 2023-12-22T08:40:49.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.952+0000 7f8383fff640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f838415d5a0 0x7f838415f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:49.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.952+0000 7f83837fe640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83840d0060 0x7f8384144fb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f837400e9e0 tx=0x7f837400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.952+0000 7f8380ff9640 1 -- 172.21.15.38:0/1820126222 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374009670 con 0x7f83840d0060 2023-12-22T08:40:49.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.952+0000 7f8380ff9640 1 -- 172.21.15.38:0/1820126222 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837400c9d0 con 0x7f83840d0060 2023-12-22T08:40:49.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.952+0000 7f8380ff9640 1 -- 172.21.15.38:0/1820126222 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837400cd80 con 0x7f83840d0060 2023-12-22T08:40:49.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.952+0000 7f8388a4d640 1 -- 172.21.15.38:0/1820126222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83840b73c0 con 0x7f83840d0060 2023-12-22T08:40:49.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.952+0000 7f8388a4d640 1 -- 172.21.15.38:0/1820126222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83840b7980 con 0x7f83840d0060 2023-12-22T08:40:49.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.953+0000 7f8388a4d640 1 -- 172.21.15.38:0/1820126222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8384152c80 con 0x7f83840d0060 2023-12-22T08:40:49.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.954+0000 7f8380ff9640 1 -- 172.21.15.38:0/1820126222 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8374013470 con 0x7f83840d0060 2023-12-22T08:40:49.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.955+0000 7f8380ff9640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f836406a430 0x7f836406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.955+0000 7f8380ff9640 1 -- 172.21.15.38:0/1820126222 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8374088c00 con 0x7f83840d0060 2023-12-22T08:40:49.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.956+0000 7f837affd640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f836406a430 0x7f836406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.957+0000 7f837affd640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f836406a430 0x7f836406c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f836c036000 tx=0x7f836c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:49.960+0000 7f8380ff9640 1 -- 172.21.15.38:0/1820126222 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8384152c80 con 0x7f83840d0060 2023-12-22T08:40:50.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.153+0000 7f8388a4d640 1 -- 172.21.15.38:0/1820126222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8384152c80 con 0x7f83840d0060 2023-12-22T08:40:50.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.154+0000 7f8380ff9640 1 -- 172.21.15.38:0/1820126222 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8384152c80 con 0x7f83840d0060 2023-12-22T08:40:50.156 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:40:50.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.156+0000 7f8388a4d640 1 -- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f836406a430 msgr2=0x7f836406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.156+0000 7f8388a4d640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f836406a430 0x7f836406c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f836c036000 tx=0x7f836c03b040 comp rx=0 tx=0).stop 2023-12-22T08:40:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.156+0000 7f8388a4d640 1 -- 172.21.15.38:0/1820126222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83840d0060 msgr2=0x7f8384144fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.156+0000 7f8388a4d640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83840d0060 0x7f8384144fb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f837400e9e0 tx=0x7f837400eea0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.157+0000 7f8388a4d640 1 -- 172.21.15.38:0/1820126222 shutdown_connections 2023-12-22T08:40:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.157+0000 7f8388a4d640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f838415d5a0 0x7f838415f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.157+0000 7f8388a4d640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f838415d1c0 0x7f83840b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.157+0000 7f8388a4d640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f836406a430 0x7f836406c8f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.157+0000 7f8388a4d640 1 --2- 172.21.15.38:0/1820126222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83840d0060 0x7f8384144fb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.157+0000 7f8388a4d640 1 -- 172.21.15.38:0/1820126222 >> 172.21.15.38:0/1820126222 conn(0x7f838406bf90 msgr2=0x7f838415c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.157+0000 7f8388a4d640 1 -- 172.21.15.38:0/1820126222 shutdown_connections 2023-12-22T08:40:50.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.157+0000 7f8388a4d640 1 -- 172.21.15.38:0/1820126222 wait complete. 2023-12-22T08:40:50.177 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:50.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.408+0000 7f00ae79f640 1 Processor -- start 2023-12-22T08:40:50.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.409+0000 7f00ae79f640 1 -- start start 2023-12-22T08:40:50.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.410+0000 7f00ae79f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f00a80b3f90 0x7f00a815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.410+0000 7f00ae79f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a806ca50 0x7f00a8070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.410+0000 7f00ae79f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a815eb20 con 0x7f00a815e740 2023-12-22T08:40:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.410+0000 7f00ae79f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a806e650 con 0x7f00a80b3f90 2023-12-22T08:40:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.410+0000 7f00ae79f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a8070770 con 0x7f00a806ca50 2023-12-22T08:40:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.411+0000 7f009ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f00a80b3f90 0x7f00a815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.411+0000 7f009ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f00a80b3f90 0x7f00a815db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50024/0 (socket says 172.21.15.38:50024) 2023-12-22T08:40:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.411+0000 7f009ffff640 1 -- 172.21.15.38:0/156287541 learned_addr learned my addr 172.21.15.38:0/156287541 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.411+0000 7f00acd3c640 1 --2- 172.21.15.38:0/156287541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a806ca50 0x7f00a8070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.411+0000 7f009ffff640 1 -- 172.21.15.38:0/156287541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a806ca50 msgr2=0x7f00a8070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.411+0000 7f009ffff640 1 --2- 172.21.15.38:0/156287541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a806ca50 0x7f00a8070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.411+0000 7f009ffff640 1 -- 172.21.15.38:0/156287541 >> v1:172.21.15.89:6789/0 conn(0x7f00a815e740 legacy=0x7f00a80b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.411+0000 7f009ffff640 1 -- 172.21.15.38:0/156287541 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a806d180 con 0x7f00a80b3f90 2023-12-22T08:40:50.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.411+0000 7f00acd3c640 1 --2- 172.21.15.38:0/156287541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a806ca50 0x7f00a8070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:50.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.412+0000 7f009ffff640 1 --2- 172.21.15.38:0/156287541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00a80b3f90 0x7f00a815db30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0090009870 tx=0x7f009002b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1816c3809ccb374 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.413+0000 7f00a77fe640 1 -- 172.21.15.38:0/156287541 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0090033620 con 0x7f00a80b3f90 2023-12-22T08:40:50.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.413+0000 7f00a77fe640 1 -- 172.21.15.38:0/156287541 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0090033780 con 0x7f00a80b3f90 2023-12-22T08:40:50.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.413+0000 7f00a77fe640 1 -- 172.21.15.38:0/156287541 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0090033b10 con 0x7f00a80b3f90 2023-12-22T08:40:50.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.413+0000 7f00ae79f640 1 -- 172.21.15.38:0/156287541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00a80b3f90 msgr2=0x7f00a815db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.413+0000 7f00ae79f640 1 --2- 172.21.15.38:0/156287541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00a80b3f90 0x7f00a815db30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0090009870 tx=0x7f009002b7d0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.414+0000 7f00ae79f640 1 -- 172.21.15.38:0/156287541 shutdown_connections 2023-12-22T08:40:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.414+0000 7f00ae79f640 1 --2- 172.21.15.38:0/156287541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00a80b3f90 0x7f00a815db30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.414+0000 7f00ae79f640 1 --2- 172.21.15.38:0/156287541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a806ca50 0x7f00a8070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.414+0000 7f00ae79f640 1 -- 172.21.15.38:0/156287541 >> 172.21.15.38:0/156287541 conn(0x7f00a80cfea0 msgr2=0x7f00a80d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.414+0000 7f00ae79f640 1 -- 172.21.15.38:0/156287541 shutdown_connections 2023-12-22T08:40:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.414+0000 7f00ae79f640 1 -- 172.21.15.38:0/156287541 wait complete. 2023-12-22T08:40:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.415+0000 7f00ae79f640 1 Processor -- start 2023-12-22T08:40:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.416+0000 7f00ae79f640 1 -- start start 2023-12-22T08:40:50.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.417+0000 7f00ae79f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00a806ca50 0x7f00a8148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.417+0000 7f00ae79f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a80b3f90 0x7f00a81f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.417+0000 7f00ae79f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a815e740 0x7f00a81f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.417+0000 7f00ae79f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80b27c0 con 0x7f00a806ca50 2023-12-22T08:40:50.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.417+0000 7f00ae79f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a8157040 con 0x7f00a815e740 2023-12-22T08:40:50.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.417+0000 7f00ae79f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a8148390 con 0x7f00a80b3f90 2023-12-22T08:40:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.417+0000 7f00a7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00a806ca50 0x7f00a8148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.417+0000 7f00a7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00a806ca50 0x7f00a8148820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50034/0 (socket says 172.21.15.38:50034) 2023-12-22T08:40:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.417+0000 7f00a7fff640 1 -- 172.21.15.38:0/2708328697 learned_addr learned my addr 172.21.15.38:0/2708328697 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.417+0000 7f009ffff640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a80b3f90 0x7f00a81f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.417+0000 7f00acd3c640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a815e740 0x7f00a81f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.418+0000 7f00a7fff640 1 -- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a80b3f90 msgr2=0x7f00a81f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.418+0000 7f00a7fff640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a80b3f90 0x7f00a81f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.418+0000 7f00a7fff640 1 -- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a815e740 msgr2=0x7f00a81f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.418+0000 7f00a7fff640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a815e740 0x7f00a81f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.418+0000 7f00a7fff640 1 -- 172.21.15.38:0/2708328697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00900094d0 con 0x7f00a806ca50 2023-12-22T08:40:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.418+0000 7f00a7fff640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00a806ca50 0x7f00a8148820 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f009800c430 tx=0x7f009800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.418+0000 7f00a57fa640 1 -- 172.21.15.38:0/2708328697 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098011790 con 0x7f00a806ca50 2023-12-22T08:40:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.418+0000 7f00a57fa640 1 -- 172.21.15.38:0/2708328697 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00980118f0 con 0x7f00a806ca50 2023-12-22T08:40:50.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.418+0000 7f00a57fa640 1 -- 172.21.15.38:0/2708328697 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098011ca0 con 0x7f00a806ca50 2023-12-22T08:40:50.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.418+0000 7f00ae79f640 1 -- 172.21.15.38:0/2708328697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a81f68d0 con 0x7f00a806ca50 2023-12-22T08:40:50.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.418+0000 7f00ae79f640 1 -- 172.21.15.38:0/2708328697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a8147d40 con 0x7f00a806ca50 2023-12-22T08:40:50.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.420+0000 7f00ae79f640 1 -- 172.21.15.38:0/2708328697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a8061910 con 0x7f00a806ca50 2023-12-22T08:40:50.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.421+0000 7f00a57fa640 1 -- 172.21.15.38:0/2708328697 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f009801c460 con 0x7f00a806ca50 2023-12-22T08:40:50.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.422+0000 7f00a57fa640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f008806a460 0x7f008806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.422+0000 7f00a57fa640 1 -- 172.21.15.38:0/2708328697 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0098088900 con 0x7f00a806ca50 2023-12-22T08:40:50.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.422+0000 7f009ffff640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f008806a460 0x7f008806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.424+0000 7f009ffff640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f008806a460 0x7f008806c920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0090035000 tx=0x7f0090008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.426+0000 7f00a57fa640 1 -- 172.21.15.38:0/2708328697 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0098053eb0 con 0x7f00a806ca50 2023-12-22T08:40:50.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.624+0000 7f00ae79f640 1 -- 172.21.15.38:0/2708328697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00a806d710 con 0x7f00a806ca50 2023-12-22T08:40:50.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.625+0000 7f00a57fa640 1 -- 172.21.15.38:0/2708328697 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f00980574d0 con 0x7f00a806ca50 2023-12-22T08:40:50.627 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:40:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.627+0000 7f00ae79f640 1 -- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f008806a460 msgr2=0x7f008806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.628+0000 7f00ae79f640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f008806a460 0x7f008806c920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0090035000 tx=0x7f0090008030 comp rx=0 tx=0).stop 2023-12-22T08:40:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.628+0000 7f00ae79f640 1 -- 172.21.15.38:0/2708328697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00a806ca50 msgr2=0x7f00a8148820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.628+0000 7f00ae79f640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00a806ca50 0x7f00a8148820 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f009800c430 tx=0x7f009800c8f0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.628+0000 7f00ae79f640 1 -- 172.21.15.38:0/2708328697 shutdown_connections 2023-12-22T08:40:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.628+0000 7f00ae79f640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00a815e740 0x7f00a81f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.628+0000 7f00ae79f640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00a80b3f90 0x7f00a81f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.628+0000 7f00ae79f640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f008806a460 0x7f008806c920 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.628+0000 7f00ae79f640 1 --2- 172.21.15.38:0/2708328697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00a806ca50 0x7f00a8148820 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.628+0000 7f00ae79f640 1 -- 172.21.15.38:0/2708328697 >> 172.21.15.38:0/2708328697 conn(0x7f00a80cfea0 msgr2=0x7f00a815faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.628+0000 7f00ae79f640 1 -- 172.21.15.38:0/2708328697 shutdown_connections 2023-12-22T08:40:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.628+0000 7f00ae79f640 1 -- 172.21.15.38:0/2708328697 wait complete. 2023-12-22T08:40:50.650 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:50.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.871+0000 7f0aef59e640 1 Processor -- start 2023-12-22T08:40:50.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.871+0000 7f0aef59e640 1 -- start start 2023-12-22T08:40:50.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.872+0000 7f0aef59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0af0071080 0x7f0af00d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.872+0000 7f0aef59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0af015d5a0 0x7f0af00d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.872+0000 7f0aef59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af015de50 con 0x7f0af015d1c0 2023-12-22T08:40:50.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.872+0000 7f0aef59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af00d0dd0 con 0x7f0af015d5a0 2023-12-22T08:40:50.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.872+0000 7f0aef59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af00d10b0 con 0x7f0af0071080 2023-12-22T08:40:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.872+0000 7f0aee59c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0af015d1c0 0x7f0af0070970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42930/0 (socket says 172.21.15.38:42930) 2023-12-22T08:40:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.872+0000 7f0aee59c640 1 -- 172.21.15.38:0/1903875212 learned_addr learned my addr 172.21.15.38:0/1903875212 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.873+0000 7f0aeed9d640 1 --2- 172.21.15.38:0/1903875212 >> v2:172.21.15.38:3300/0 conn(0x7f0af015d5a0 0x7f0af00d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.873+0000 7f0aedd9b640 1 --2- 172.21.15.38:0/1903875212 >> v2:172.21.15.89:3300/0 conn(0x7f0af0071080 0x7f0af00d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.873+0000 7f0aed59a640 1 -- 172.21.15.38:0/1903875212 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619840704 0 0) 0x7f0af015de50 con 0x7f0af015d1c0 2023-12-22T08:40:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.873+0000 7f0aed59a640 1 -- 172.21.15.38:0/1903875212 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad8003520 con 0x7f0af015d1c0 2023-12-22T08:40:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.873+0000 7f0aeed9d640 1 -- 172.21.15.38:0/1903875212 >> v2:172.21.15.89:3300/0 conn(0x7f0af0071080 msgr2=0x7f0af00d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.873+0000 7f0aeed9d640 1 --2- 172.21.15.38:0/1903875212 >> v2:172.21.15.89:3300/0 conn(0x7f0af0071080 0x7f0af00d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.873+0000 7f0aeed9d640 1 -- 172.21.15.38:0/1903875212 >> v1:172.21.15.38:6789/0 conn(0x7f0af015d1c0 legacy=0x7f0af0070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.873+0000 7f0aeed9d640 1 -- 172.21.15.38:0/1903875212 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af015dae0 con 0x7f0af015d5a0 2023-12-22T08:40:50.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.873+0000 7f0aedd9b640 1 --2- 172.21.15.38:0/1903875212 >> v2:172.21.15.89:3300/0 conn(0x7f0af0071080 0x7f0af00d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:50.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.874+0000 7f0aeed9d640 1 --2- 172.21.15.38:0/1903875212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af015d5a0 0x7f0af00d05a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0af0160e20 tx=0x7f0ae802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1843c24e3004b0bc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.875+0000 7f0aed59a640 1 -- 172.21.15.38:0/1903875212 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae802cc80 con 0x7f0af015d5a0 2023-12-22T08:40:50.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.875+0000 7f0aed59a640 1 -- 172.21.15.38:0/1903875212 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae802cde0 con 0x7f0af015d5a0 2023-12-22T08:40:50.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.875+0000 7f0aed59a640 1 -- 172.21.15.38:0/1903875212 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8034660 con 0x7f0af015d5a0 2023-12-22T08:40:50.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.875+0000 7f0aef59e640 1 -- 172.21.15.38:0/1903875212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af015d5a0 msgr2=0x7f0af00d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.875+0000 7f0aef59e640 1 --2- 172.21.15.38:0/1903875212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af015d5a0 0x7f0af00d05a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0af0160e20 tx=0x7f0ae802bed0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.875+0000 7f0aef59e640 1 -- 172.21.15.38:0/1903875212 shutdown_connections 2023-12-22T08:40:50.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.875+0000 7f0aef59e640 1 --2- 172.21.15.38:0/1903875212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af015d5a0 0x7f0af00d05a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.875+0000 7f0aef59e640 1 --2- 172.21.15.38:0/1903875212 >> v2:172.21.15.89:3300/0 conn(0x7f0af0071080 0x7f0af00d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.875+0000 7f0aef59e640 1 -- 172.21.15.38:0/1903875212 >> 172.21.15.38:0/1903875212 conn(0x7f0af006bf90 msgr2=0x7f0af006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:50.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.875+0000 7f0aef59e640 1 -- 172.21.15.38:0/1903875212 shutdown_connections 2023-12-22T08:40:50.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.875+0000 7f0aef59e640 1 -- 172.21.15.38:0/1903875212 wait complete. 2023-12-22T08:40:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.877+0000 7f0aef59e640 1 Processor -- start 2023-12-22T08:40:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.877+0000 7f0aef59e640 1 -- start start 2023-12-22T08:40:50.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.878+0000 7f0aef59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af0071080 0x7f0af01f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.878+0000 7f0aef59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af015d1c0 0x7f0af01f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.878+0000 7f0aef59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af015d5a0 0x7f0af00d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.878+0000 7f0aef59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af01f36e0 con 0x7f0af0071080 2023-12-22T08:40:50.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.878+0000 7f0aef59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0149030 con 0x7f0af015d5a0 2023-12-22T08:40:50.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.878+0000 7f0aef59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af01535e0 con 0x7f0af015d1c0 2023-12-22T08:40:50.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.879+0000 7f0aee59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af0071080 0x7f0af01f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.879+0000 7f0aee59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af0071080 0x7f0af01f68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50044/0 (socket says 172.21.15.38:50044) 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.879+0000 7f0aee59c640 1 -- 172.21.15.38:0/3587883924 learned_addr learned my addr 172.21.15.38:0/3587883924 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.879+0000 7f0aedd9b640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af015d1c0 0x7f0af01f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.879+0000 7f0aee59c640 1 -- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af015d1c0 msgr2=0x7f0af01f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.879+0000 7f0aeed9d640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af015d5a0 0x7f0af00d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.879+0000 7f0aee59c640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af015d1c0 0x7f0af01f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.879+0000 7f0aee59c640 1 -- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af015d5a0 msgr2=0x7f0af00d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.879+0000 7f0aee59c640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af015d5a0 0x7f0af00d1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.879+0000 7f0aee59c640 1 -- 172.21.15.38:0/3587883924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8009a70 con 0x7f0af0071080 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.879+0000 7f0aedd9b640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af015d1c0 0x7f0af01f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.880+0000 7f0aee59c640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af0071080 0x7f0af01f68a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c430 tx=0x7f0ae000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.880+0000 7f0adeffd640 1 -- 172.21.15.38:0/3587883924 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0005ce0 con 0x7f0af0071080 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.880+0000 7f0adeffd640 1 -- 172.21.15.38:0/3587883924 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0005e40 con 0x7f0af0071080 2023-12-22T08:40:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.880+0000 7f0adeffd640 1 -- 172.21.15.38:0/3587883924 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00072f0 con 0x7f0af0071080 2023-12-22T08:40:50.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.880+0000 7f0aef59e640 1 -- 172.21.15.38:0/3587883924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af01f60a0 con 0x7f0af0071080 2023-12-22T08:40:50.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.880+0000 7f0aef59e640 1 -- 172.21.15.38:0/3587883924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af0153890 con 0x7f0af0071080 2023-12-22T08:40:50.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.881+0000 7f0aef59e640 1 -- 172.21.15.38:0/3587883924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af0061910 con 0x7f0af0071080 2023-12-22T08:40:50.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.882+0000 7f0adeffd640 1 -- 172.21.15.38:0/3587883924 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ae0007450 con 0x7f0af0071080 2023-12-22T08:40:50.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.883+0000 7f0adeffd640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0ad006a430 0x7f0ad006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.883+0000 7f0adeffd640 1 -- 172.21.15.38:0/3587883924 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0ae00880c0 con 0x7f0af0071080 2023-12-22T08:40:50.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.884+0000 7f0aedd9b640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0ad006a430 0x7f0ad006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.885+0000 7f0aedd9b640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0ad006a430 0x7f0ad006c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4006fd0 tx=0x7f0ae4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:50.888+0000 7f0adeffd640 1 -- 172.21.15.38:0/3587883924 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0ae00535d0 con 0x7f0af0071080 2023-12-22T08:40:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.081+0000 7f0aef59e640 1 -- 172.21.15.38:0/3587883924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0af00b2be0 con 0x7f0af0071080 2023-12-22T08:40:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.082+0000 7f0adeffd640 1 -- 172.21.15.38:0/3587883924 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ae0017020 con 0x7f0af0071080 2023-12-22T08:40:51.085 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:40:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.084+0000 7f0aef59e640 1 -- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0ad006a430 msgr2=0x7f0ad006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.084+0000 7f0aef59e640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0ad006a430 0x7f0ad006c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4006fd0 tx=0x7f0ae4008040 comp rx=0 tx=0).stop 2023-12-22T08:40:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.084+0000 7f0aef59e640 1 -- 172.21.15.38:0/3587883924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af0071080 msgr2=0x7f0af01f68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.084+0000 7f0aef59e640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af0071080 0x7f0af01f68a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c430 tx=0x7f0ae000c8f0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.085+0000 7f0aef59e640 1 -- 172.21.15.38:0/3587883924 shutdown_connections 2023-12-22T08:40:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.085+0000 7f0aef59e640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af015d5a0 0x7f0af00d1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.085+0000 7f0aef59e640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af015d1c0 0x7f0af01f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.085+0000 7f0aef59e640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0ad006a430 0x7f0ad006c8f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.085+0000 7f0aef59e640 1 --2- 172.21.15.38:0/3587883924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af0071080 0x7f0af01f68a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.085+0000 7f0aef59e640 1 -- 172.21.15.38:0/3587883924 >> 172.21.15.38:0/3587883924 conn(0x7f0af006bf90 msgr2=0x7f0af015c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.085+0000 7f0aef59e640 1 -- 172.21.15.38:0/3587883924 shutdown_connections 2023-12-22T08:40:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.085+0000 7f0aef59e640 1 -- 172.21.15.38:0/3587883924 wait complete. 2023-12-22T08:40:51.108 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:40:51.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.334+0000 7f3824b4e640 1 Processor -- start 2023-12-22T08:40:51.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.335+0000 7f3824b4e640 1 -- start start 2023-12-22T08:40:51.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.336+0000 7f3824b4e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f38200b3f90 0x7f382015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.336+0000 7f3824b4e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f382006ca50 0x7f3820070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.336+0000 7f3824b4e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382015eb20 con 0x7f382015e740 2023-12-22T08:40:51.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.336+0000 7f3824b4e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382006e650 con 0x7f38200b3f90 2023-12-22T08:40:51.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.336+0000 7f3824b4e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3820070770 con 0x7f382006ca50 2023-12-22T08:40:51.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.337+0000 7f381ed9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f382006ca50 0x7f3820070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.337+0000 7f381dd9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f38200b3f90 0x7f382015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.337+0000 7f381e59c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f382015e740 0x7f38200b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:37420/0 (socket says 172.21.15.38:37420) 2023-12-22T08:40:51.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.337+0000 7f381dd9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f38200b3f90 0x7f382015db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:40148/0 (socket says 172.21.15.38:40148) 2023-12-22T08:40:51.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.337+0000 7f381dd9b640 1 -- 172.21.15.38:0/2778345581 learned_addr learned my addr 172.21.15.38:0/2778345581 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:51.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.337+0000 7f381ed9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f382006ca50 0x7f3820070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:38302/0 (socket says 172.21.15.38:38302) 2023-12-22T08:40:51.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.338+0000 7f381dd9b640 1 -- 172.21.15.38:0/2778345581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f382006ca50 msgr2=0x7f3820070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.338+0000 7f381dd9b640 1 --2- 172.21.15.38:0/2778345581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f382006ca50 0x7f3820070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.338+0000 7f381dd9b640 1 -- 172.21.15.38:0/2778345581 >> v1:172.21.15.89:6789/0 conn(0x7f382015e740 legacy=0x7f38200b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.338+0000 7f381dd9b640 1 -- 172.21.15.38:0/2778345581 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382006d180 con 0x7f38200b3f90 2023-12-22T08:40:51.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.338+0000 7f381ed9d640 1 --2- 172.21.15.38:0/2778345581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f382006ca50 0x7f3820070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:51.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.339+0000 7f381dd9b640 1 --2- 172.21.15.38:0/2778345581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38200b3f90 0x7f382015db30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f380c009870 tx=0x7f380c02b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edf8b24e8d257c6d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.340+0000 7f381d59a640 1 -- 172.21.15.38:0/2778345581 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c0317c0 con 0x7f38200b3f90 2023-12-22T08:40:51.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.340+0000 7f381d59a640 1 -- 172.21.15.38:0/2778345581 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c031920 con 0x7f38200b3f90 2023-12-22T08:40:51.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.340+0000 7f381d59a640 1 -- 172.21.15.38:0/2778345581 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c031cb0 con 0x7f38200b3f90 2023-12-22T08:40:51.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.341+0000 7f3824b4e640 1 -- 172.21.15.38:0/2778345581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38200b3f90 msgr2=0x7f382015db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.341+0000 7f3824b4e640 1 --2- 172.21.15.38:0/2778345581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38200b3f90 0x7f382015db30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f380c009870 tx=0x7f380c02b860 comp rx=0 tx=0).stop 2023-12-22T08:40:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.341+0000 7f3824b4e640 1 -- 172.21.15.38:0/2778345581 shutdown_connections 2023-12-22T08:40:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.341+0000 7f3824b4e640 1 --2- 172.21.15.38:0/2778345581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38200b3f90 0x7f382015db30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.341+0000 7f3824b4e640 1 --2- 172.21.15.38:0/2778345581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f382006ca50 0x7f3820070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.341+0000 7f3824b4e640 1 -- 172.21.15.38:0/2778345581 >> 172.21.15.38:0/2778345581 conn(0x7f38200cfea0 msgr2=0x7f38200d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.341+0000 7f3824b4e640 1 -- 172.21.15.38:0/2778345581 shutdown_connections 2023-12-22T08:40:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.341+0000 7f3824b4e640 1 -- 172.21.15.38:0/2778345581 wait complete. 2023-12-22T08:40:51.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.344+0000 7f3824b4e640 1 Processor -- start 2023-12-22T08:40:51.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.344+0000 7f3824b4e640 1 -- start start 2023-12-22T08:40:51.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.345+0000 7f3824b4e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f382006ca50 0x7f38201f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.345+0000 7f3824b4e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38200b3f90 0x7f3820160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.345+0000 7f3824b4e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f382015e740 0x7f3820160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.345+0000 7f3824b4e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38201f2d20 con 0x7f382015e740 2023-12-22T08:40:51.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.345+0000 7f3824b4e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382015ae50 con 0x7f382006ca50 2023-12-22T08:40:51.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.345+0000 7f3824b4e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382015a240 con 0x7f38200b3f90 2023-12-22T08:40:51.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.346+0000 7f381ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f382015e740 0x7f3820160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.346+0000 7f381ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f382015e740 0x7f3820160780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46660/0 (socket says 172.21.15.38:46660) 2023-12-22T08:40:51.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.346+0000 7f381ed9d640 1 -- 172.21.15.38:0/359438347 learned_addr learned my addr 172.21.15.38:0/359438347 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:51.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.346+0000 7f381e59c640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f382006ca50 0x7f38201f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.346+0000 7f381dd9b640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38200b3f90 0x7f3820160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.346+0000 7f381ed9d640 1 -- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38200b3f90 msgr2=0x7f3820160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.346+0000 7f381ed9d640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38200b3f90 0x7f3820160240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.346+0000 7f381ed9d640 1 -- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f382006ca50 msgr2=0x7f38201f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.346+0000 7f381ed9d640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f382006ca50 0x7f38201f27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.346+0000 7f381ed9d640 1 -- 172.21.15.38:0/359438347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818009a70 con 0x7f382015e740 2023-12-22T08:40:51.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.347+0000 7f381ed9d640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f382015e740 0x7f3820160780 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f381800efc0 tx=0x7f381800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.347+0000 7f3816ffd640 1 -- 172.21.15.38:0/359438347 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818009cd0 con 0x7f382015e740 2023-12-22T08:40:51.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.347+0000 7f3816ffd640 1 -- 172.21.15.38:0/359438347 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381800f040 con 0x7f382015e740 2023-12-22T08:40:51.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.347+0000 7f3816ffd640 1 -- 172.21.15.38:0/359438347 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818003990 con 0x7f382015e740 2023-12-22T08:40:51.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.347+0000 7f3824b4e640 1 -- 172.21.15.38:0/359438347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c0094d0 con 0x7f382015e740 2023-12-22T08:40:51.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.347+0000 7f3824b4e640 1 -- 172.21.15.38:0/359438347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382015a800 con 0x7f382015e740 2023-12-22T08:40:51.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.348+0000 7f3824b4e640 1 -- 172.21.15.38:0/359438347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382015afe0 con 0x7f382015e740 2023-12-22T08:40:51.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.349+0000 7f3816ffd640 1 -- 172.21.15.38:0/359438347 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3818014480 con 0x7f382015e740 2023-12-22T08:40:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.350+0000 7f3816ffd640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f380806a430 0x7f380806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.350+0000 7f3816ffd640 1 -- 172.21.15.38:0/359438347 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f38180895c0 con 0x7f382015e740 2023-12-22T08:40:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.351+0000 7f381e59c640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f380806a430 0x7f380806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.352+0000 7f381e59c640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f380806a430 0x7f380806c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3810000f60 tx=0x7f3810007cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.355+0000 7f3816ffd640 1 -- 172.21.15.38:0/359438347 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3818054b70 con 0x7f382015e740 2023-12-22T08:40:51.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.566+0000 7f3824b4e640 1 -- 172.21.15.38:0/359438347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3820061910 con 0x7f382015e740 2023-12-22T08:40:51.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.566+0000 7f3816ffd640 1 -- 172.21.15.38:0/359438347 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3818058190 con 0x7f382015e740 2023-12-22T08:40:51.569 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:40:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.569+0000 7f3824b4e640 1 -- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f380806a430 msgr2=0x7f380806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.569+0000 7f3824b4e640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f380806a430 0x7f380806c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3810000f60 tx=0x7f3810007cc0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.569+0000 7f3824b4e640 1 -- 172.21.15.38:0/359438347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f382015e740 msgr2=0x7f3820160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.569+0000 7f3824b4e640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f382015e740 0x7f3820160780 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f381800efc0 tx=0x7f381800c490 comp rx=0 tx=0).stop 2023-12-22T08:40:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.569+0000 7f3824b4e640 1 -- 172.21.15.38:0/359438347 shutdown_connections 2023-12-22T08:40:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.569+0000 7f3824b4e640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f380806a430 0x7f380806c8f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.569+0000 7f3824b4e640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f382015e740 0x7f3820160780 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.569+0000 7f3824b4e640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38200b3f90 0x7f3820160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.569+0000 7f3824b4e640 1 --2- 172.21.15.38:0/359438347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f382006ca50 0x7f38201f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.569+0000 7f3824b4e640 1 -- 172.21.15.38:0/359438347 >> 172.21.15.38:0/359438347 conn(0x7f38200cfea0 msgr2=0x7f3820157820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.569+0000 7f3824b4e640 1 -- 172.21.15.38:0/359438347 shutdown_connections 2023-12-22T08:40:51.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:51.569+0000 7f3824b4e640 1 -- 172.21.15.38:0/359438347 wait complete. 2023-12-22T08:40:51.591 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T08:40:51.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:51.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-22T08:40:51.699 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:40:51.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:51.699 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T08:40:51.760 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:40:51.760 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:51.821 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:40:51.821 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:51.879 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:40:51.879 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:51.934 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:52.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.150+0000 7f4e4759e640 1 Processor -- start 2023-12-22T08:40:52.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.150+0000 7f4e4759e640 1 -- start start 2023-12-22T08:40:52.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.152+0000 7f4e4759e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4e4806d210 0x7f4e4815e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.152+0000 7f4e4759e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e480706d0 con 0x7f4e480cb4c0 2023-12-22T08:40:52.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.152+0000 7f4e4759e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e480cbf40 con 0x7f4e4806d5f0 2023-12-22T08:40:52.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.152+0000 7f4e4759e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e480ce840 con 0x7f4e4806d210 2023-12-22T08:40:52.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.152+0000 7f4e3ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4e480cb4c0 0x7f4e48159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51018/0 (socket says 172.21.15.38:51018) 2023-12-22T08:40:52.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.152+0000 7f4e3ffff640 1 -- 172.21.15.38:0/676742595 learned_addr learned my addr 172.21.15.38:0/676742595 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:52.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e4659c640 1 --2- 172.21.15.38:0/676742595 >> v2:172.21.15.89:3300/0 conn(0x7f4e4806d210 0x7f4e4815e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:52.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760831458 0 0) 0x7f4e480706d0 con 0x7f4e480cb4c0 2023-12-22T08:40:52.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e34003520 con 0x7f4e480cb4c0 2023-12-22T08:40:52.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1477823823 0 0) 0x7f4e34003520 con 0x7f4e480cb4c0 2023-12-22T08:40:52.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 >> v2:172.21.15.89:3300/0 conn(0x7f4e4806d210 msgr2=0x7f4e4815e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:52.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 --2- 172.21.15.38:0/676742595 >> v2:172.21.15.89:3300/0 conn(0x7f4e4806d210 0x7f4e4815e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 >> v1:172.21.15.89:6789/0 conn(0x7f4e4806d5f0 legacy=0x7f4e48070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e480ceb20 con 0x7f4e480cb4c0 2023-12-22T08:40:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f4e30001670 con 0x7f4e480cb4c0 2023-12-22T08:40:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 >> v1:172.21.15.38:6789/0 conn(0x7f4e480cb4c0 legacy=0x7f4e48159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 --2- 172.21.15.38:0/676742595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e34003970 0x7f4e34003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 --2- 172.21.15.38:0/676742595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e340047c0 0x7f4e34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 --2- 172.21.15.38:0/676742595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34005180 0x7f4e3400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480ce840 con 0x7f4e34005180 2023-12-22T08:40:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3400e2c0 con 0x7f4e34003970 2023-12-22T08:40:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.153+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3400e480 con 0x7f4e340047c0 2023-12-22T08:40:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.154+0000 7f4e46d9d640 1 --2- 172.21.15.38:0/676742595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34005180 0x7f4e3400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.154+0000 7f4e4659c640 1 --2- 172.21.15.38:0/676742595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e34003970 0x7f4e34003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.154+0000 7f4e46d9d640 1 -- 172.21.15.38:0/676742595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e340047c0 msgr2=0x7f4e34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.154+0000 7f4e46d9d640 1 --2- 172.21.15.38:0/676742595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e340047c0 0x7f4e34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.154+0000 7f4e46d9d640 1 -- 172.21.15.38:0/676742595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e34003970 msgr2=0x7f4e34003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:52.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.154+0000 7f4e46d9d640 1 --2- 172.21.15.38:0/676742595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e34003970 0x7f4e34003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.154+0000 7f4e46d9d640 1 -- 172.21.15.38:0/676742595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e34003520 con 0x7f4e34005180 2023-12-22T08:40:52.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.155+0000 7f4e46d9d640 1 -- 172.21.15.38:0/676742595 reap_dead start 2023-12-22T08:40:52.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.155+0000 7f4e46d9d640 1 --2- 172.21.15.38:0/676742595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34005180 0x7f4e3400db90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4e40004480 tx=0x7f4e340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1add0d0de1944d41 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:52.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.155+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40006b50 con 0x7f4e34005180 2023-12-22T08:40:52.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.156+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e40006cd0 con 0x7f4e34005180 2023-12-22T08:40:52.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.156+0000 7f4e45d9b640 1 -- 172.21.15.38:0/676742595 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40007260 con 0x7f4e34005180 2023-12-22T08:40:52.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.156+0000 7f4e4759e640 1 -- 172.21.15.38:0/676742595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34005180 msgr2=0x7f4e3400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.156+0000 7f4e4759e640 1 --2- 172.21.15.38:0/676742595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34005180 0x7f4e3400db90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4e40004480 tx=0x7f4e340057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.156+0000 7f4e4759e640 1 -- 172.21.15.38:0/676742595 shutdown_connections 2023-12-22T08:40:52.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.156+0000 7f4e4759e640 1 --2- 172.21.15.38:0/676742595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34005180 0x7f4e3400db90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.156+0000 7f4e4759e640 1 -- 172.21.15.38:0/676742595 >> 172.21.15.38:0/676742595 conn(0x7f4e480b1f70 msgr2=0x7f4e480b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:52.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.156+0000 7f4e4759e640 1 -- 172.21.15.38:0/676742595 shutdown_connections 2023-12-22T08:40:52.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.156+0000 7f4e4759e640 1 -- 172.21.15.38:0/676742595 wait complete. 2023-12-22T08:40:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.158+0000 7f4e4759e640 1 Processor -- start 2023-12-22T08:40:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.158+0000 7f4e4759e640 1 -- start start 2023-12-22T08:40:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.159+0000 7f4e4759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34005180 0x7f4e48157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.159+0000 7f4e4759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e48151f60 0x7f4e481551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.159+0000 7f4e4759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e481556f0 0x7f4e481f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.159+0000 7f4e4759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e48155f50 con 0x7f4e34005180 2023-12-22T08:40:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.159+0000 7f4e4759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e48153350 con 0x7f4e481556f0 2023-12-22T08:40:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.159+0000 7f4e4759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e48155c70 con 0x7f4e48151f60 2023-12-22T08:40:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.159+0000 7f4e4659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34005180 0x7f4e48157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.159+0000 7f4e4659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34005180 0x7f4e48157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46692/0 (socket says 172.21.15.38:46692) 2023-12-22T08:40:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.159+0000 7f4e4659c640 1 -- 172.21.15.38:0/4256365561 learned_addr learned my addr 172.21.15.38:0/4256365561 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.160+0000 7f4e4659c640 1 -- 172.21.15.38:0/4256365561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e48151f60 msgr2=0x7f4e481551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.160+0000 7f4e4659c640 1 --2- 172.21.15.38:0/4256365561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e48151f60 0x7f4e481551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.160+0000 7f4e4659c640 1 -- 172.21.15.38:0/4256365561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e481556f0 msgr2=0x7f4e481f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.160+0000 7f4e4659c640 1 --2- 172.21.15.38:0/4256365561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e481556f0 0x7f4e481f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.160+0000 7f4e4659c640 1 -- 172.21.15.38:0/4256365561 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48152d00 con 0x7f4e34005180 2023-12-22T08:40:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.160+0000 7f4e4659c640 1 --2- 172.21.15.38:0/4256365561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34005180 0x7f4e48157130 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800f580 tx=0x7f4e3800fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.160+0000 7f4e3effd640 1 -- 172.21.15.38:0/4256365561 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e38013810 con 0x7f4e34005180 2023-12-22T08:40:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.160+0000 7f4e3effd640 1 -- 172.21.15.38:0/4256365561 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e38013970 con 0x7f4e34005180 2023-12-22T08:40:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.160+0000 7f4e3effd640 1 -- 172.21.15.38:0/4256365561 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e38013ce0 con 0x7f4e34005180 2023-12-22T08:40:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.160+0000 7f4e4759e640 1 -- 172.21.15.38:0/4256365561 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e48152fe0 con 0x7f4e34005180 2023-12-22T08:40:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.160+0000 7f4e4759e640 1 -- 172.21.15.38:0/4256365561 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e48152600 con 0x7f4e34005180 2023-12-22T08:40:52.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.161+0000 7f4e4759e640 1 -- 172.21.15.38:0/4256365561 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e48152b60 con 0x7f4e34005180 2023-12-22T08:40:52.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.162+0000 7f4e3effd640 1 -- 172.21.15.38:0/4256365561 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4e3801f460 con 0x7f4e34005180 2023-12-22T08:40:52.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.163+0000 7f4e3effd640 1 --2- 172.21.15.38:0/4256365561 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4e2806a4b0 0x7f4e2806c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.163+0000 7f4e3effd640 1 -- 172.21.15.38:0/4256365561 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4e38088d60 con 0x7f4e34005180 2023-12-22T08:40:52.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.164+0000 7f4e3ffff640 1 --2- 172.21.15.38:0/4256365561 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4e2806a4b0 0x7f4e2806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:52.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.165+0000 7f4e3ffff640 1 --2- 172.21.15.38:0/4256365561 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4e2806a4b0 0x7f4e2806c970 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4e480b0a40 tx=0x7f4e30001500 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:52.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.168+0000 7f4e3effd640 1 -- 172.21.15.38:0/4256365561 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4e48152b60 con 0x7f4e34005180 2023-12-22T08:40:52.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.359+0000 7f4e4759e640 1 -- 172.21.15.38:0/4256365561 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e48152b60 con 0x7f4e34005180 2023-12-22T08:40:52.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.361+0000 7f4e3effd640 1 -- 172.21.15.38:0/4256365561 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16088 (secure 0 0 0) 0x7f4e48152b60 con 0x7f4e34005180 2023-12-22T08:40:52.364 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:52.364 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":22,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:40:48.371962+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:52.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.363+0000 7f4e4759e640 1 -- 172.21.15.38:0/4256365561 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4e2806a4b0 msgr2=0x7f4e2806c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.363+0000 7f4e4759e640 1 --2- 172.21.15.38:0/4256365561 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4e2806a4b0 0x7f4e2806c970 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4e480b0a40 tx=0x7f4e30001500 comp rx=0 tx=0).stop 2023-12-22T08:40:52.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.363+0000 7f4e4759e640 1 -- 172.21.15.38:0/4256365561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34005180 msgr2=0x7f4e48157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.363+0000 7f4e4759e640 1 --2- 172.21.15.38:0/4256365561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34005180 0x7f4e48157130 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800f580 tx=0x7f4e3800fa40 comp rx=0 tx=0).stop 2023-12-22T08:40:52.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.364+0000 7f4e4759e640 1 -- 172.21.15.38:0/4256365561 shutdown_connections 2023-12-22T08:40:52.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.364+0000 7f4e4759e640 1 --2- 172.21.15.38:0/4256365561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e481556f0 0x7f4e481f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.364+0000 7f4e4759e640 1 --2- 172.21.15.38:0/4256365561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e48151f60 0x7f4e481551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.364+0000 7f4e4759e640 1 --2- 172.21.15.38:0/4256365561 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4e2806a4b0 0x7f4e2806c970 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.364+0000 7f4e4759e640 1 --2- 172.21.15.38:0/4256365561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34005180 0x7f4e48157130 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.364+0000 7f4e4759e640 1 -- 172.21.15.38:0/4256365561 >> 172.21.15.38:0/4256365561 conn(0x7f4e480b1f70 msgr2=0x7f4e4815d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:52.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.364+0000 7f4e4759e640 1 -- 172.21.15.38:0/4256365561 shutdown_connections 2023-12-22T08:40:52.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.364+0000 7f4e4759e640 1 -- 172.21.15.38:0/4256365561 wait complete. 2023-12-22T08:40:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:39:56.873963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:39:57.616447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:52.386 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:52.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.607+0000 7fca8098f640 1 Processor -- start 2023-12-22T08:40:52.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.608+0000 7fca8098f640 1 -- start start 2023-12-22T08:40:52.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.609+0000 7fca8098f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca7c15d1c0 0x7fca7c070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.609+0000 7fca8098f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fca7c15d5a0 0x7fca7c070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.609+0000 7fca8098f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c15de50 con 0x7fca7c0d0060 2023-12-22T08:40:52.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.610+0000 7fca8098f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c0d0b80 con 0x7fca7c15d1c0 2023-12-22T08:40:52.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.610+0000 7fca8098f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c0d0dd0 con 0x7fca7c15d5a0 2023-12-22T08:40:52.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.610+0000 7fca7b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca7c15d1c0 0x7fca7c070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:52.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.610+0000 7fca7bfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fca7c0d0060 0x7fca7c0d0470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51026/0 (socket says 172.21.15.38:51026) 2023-12-22T08:40:52.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.610+0000 7fca7bfff640 1 -- 172.21.15.38:0/3454640116 learned_addr learned my addr 172.21.15.38:0/3454640116 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:52.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.610+0000 7fca7affd640 1 --2- 172.21.15.38:0/3454640116 >> v2:172.21.15.89:3300/0 conn(0x7fca7c15d5a0 0x7fca7c070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:52.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.611+0000 7fca7a7fc640 1 -- 172.21.15.38:0/3454640116 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882362971 0 0) 0x7fca7c15de50 con 0x7fca7c0d0060 2023-12-22T08:40:52.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.611+0000 7fca7a7fc640 1 -- 172.21.15.38:0/3454640116 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca64003520 con 0x7fca7c0d0060 2023-12-22T08:40:52.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.611+0000 7fca7b7fe640 1 -- 172.21.15.38:0/3454640116 >> v2:172.21.15.89:3300/0 conn(0x7fca7c15d5a0 msgr2=0x7fca7c070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:52.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.611+0000 7fca7b7fe640 1 --2- 172.21.15.38:0/3454640116 >> v2:172.21.15.89:3300/0 conn(0x7fca7c15d5a0 0x7fca7c070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.611+0000 7fca7b7fe640 1 -- 172.21.15.38:0/3454640116 >> v1:172.21.15.38:6789/0 conn(0x7fca7c0d0060 legacy=0x7fca7c0d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.611+0000 7fca7b7fe640 1 -- 172.21.15.38:0/3454640116 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0d10b0 con 0x7fca7c15d1c0 2023-12-22T08:40:52.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.612+0000 7fca7b7fe640 1 --2- 172.21.15.38:0/3454640116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca7c15d1c0 0x7fca7c070970 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca7c160e20 tx=0x7fca6c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41124f2d2dd0335a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:52.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.613+0000 7fca7a7fc640 1 -- 172.21.15.38:0/3454640116 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c02cc80 con 0x7fca7c15d1c0 2023-12-22T08:40:52.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.613+0000 7fca7a7fc640 1 -- 172.21.15.38:0/3454640116 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c02cde0 con 0x7fca7c15d1c0 2023-12-22T08:40:52.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.613+0000 7fca7a7fc640 1 -- 172.21.15.38:0/3454640116 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c034660 con 0x7fca7c15d1c0 2023-12-22T08:40:52.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.613+0000 7fca8098f640 1 -- 172.21.15.38:0/3454640116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca7c15d1c0 msgr2=0x7fca7c070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.613+0000 7fca8098f640 1 --2- 172.21.15.38:0/3454640116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca7c15d1c0 0x7fca7c070970 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca7c160e20 tx=0x7fca6c02bed0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.613+0000 7fca8098f640 1 -- 172.21.15.38:0/3454640116 shutdown_connections 2023-12-22T08:40:52.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.613+0000 7fca8098f640 1 --2- 172.21.15.38:0/3454640116 >> v2:172.21.15.89:3300/0 conn(0x7fca7c15d5a0 0x7fca7c070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.613+0000 7fca8098f640 1 --2- 172.21.15.38:0/3454640116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca7c15d1c0 0x7fca7c070970 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.613+0000 7fca8098f640 1 -- 172.21.15.38:0/3454640116 >> 172.21.15.38:0/3454640116 conn(0x7fca7c06bf90 msgr2=0x7fca7c06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:52.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.613+0000 7fca8098f640 1 -- 172.21.15.38:0/3454640116 shutdown_connections 2023-12-22T08:40:52.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.614+0000 7fca8098f640 1 -- 172.21.15.38:0/3454640116 wait complete. 2023-12-22T08:40:52.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.616+0000 7fca8098f640 1 Processor -- start 2023-12-22T08:40:52.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.616+0000 7fca8098f640 1 -- start start 2023-12-22T08:40:52.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.617+0000 7fca8098f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca7c0d0060 0x7fca7c142f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.617+0000 7fca8098f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca7c15d1c0 0x7fca7c1531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.617+0000 7fca8098f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca7c15d5a0 0x7fca7c0b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.617+0000 7fca8098f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c143440 con 0x7fca7c15d5a0 2023-12-22T08:40:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.617+0000 7fca8098f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c0b6650 con 0x7fca7c0d0060 2023-12-22T08:40:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.617+0000 7fca8098f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c0b68f0 con 0x7fca7c15d1c0 2023-12-22T08:40:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.618+0000 7fca7bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca7c15d5a0 0x7fca7c0b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.618+0000 7fca7bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca7c15d5a0 0x7fca7c0b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46704/0 (socket says 172.21.15.38:46704) 2023-12-22T08:40:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.618+0000 7fca7bfff640 1 -- 172.21.15.38:0/1778936391 learned_addr learned my addr 172.21.15.38:0/1778936391 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.618+0000 7fca7b7fe640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca7c0d0060 0x7fca7c142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.618+0000 7fca7affd640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca7c15d1c0 0x7fca7c1531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:52.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.618+0000 7fca7bfff640 1 -- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca7c15d1c0 msgr2=0x7fca7c1531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.618+0000 7fca7bfff640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca7c15d1c0 0x7fca7c1531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.618+0000 7fca7bfff640 1 -- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca7c0d0060 msgr2=0x7fca7c142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.618+0000 7fca7bfff640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca7c0d0060 0x7fca7c142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.618+0000 7fca7bfff640 1 -- 172.21.15.38:0/1778936391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c009a70 con 0x7fca7c15d5a0 2023-12-22T08:40:52.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.618+0000 7fca7b7fe640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca7c0d0060 0x7fca7c142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:52.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.619+0000 7fca7bfff640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca7c15d5a0 0x7fca7c0b3580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca7400c430 tx=0x7fca7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:52.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.619+0000 7fca63fff640 1 -- 172.21.15.38:0/1778936391 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74005ce0 con 0x7fca7c15d5a0 2023-12-22T08:40:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.619+0000 7fca63fff640 1 -- 172.21.15.38:0/1778936391 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca74005e40 con 0x7fca7c15d5a0 2023-12-22T08:40:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.619+0000 7fca63fff640 1 -- 172.21.15.38:0/1778936391 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74007310 con 0x7fca7c15d5a0 2023-12-22T08:40:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.619+0000 7fca8098f640 1 -- 172.21.15.38:0/1778936391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7c0b6bd0 con 0x7fca7c15d5a0 2023-12-22T08:40:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.619+0000 7fca8098f640 1 -- 172.21.15.38:0/1778936391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c0b7190 con 0x7fca7c15d5a0 2023-12-22T08:40:52.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.621+0000 7fca8098f640 1 -- 172.21.15.38:0/1778936391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c15dac0 con 0x7fca7c15d5a0 2023-12-22T08:40:52.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.621+0000 7fca63fff640 1 -- 172.21.15.38:0/1778936391 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca74007470 con 0x7fca7c15d5a0 2023-12-22T08:40:52.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.622+0000 7fca63fff640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca6806a430 0x7fca6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:52.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.622+0000 7fca63fff640 1 -- 172.21.15.38:0/1778936391 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fca74087f60 con 0x7fca7c15d5a0 2023-12-22T08:40:52.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.623+0000 7fca7b7fe640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca6806a430 0x7fca6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.624+0000 7fca7b7fe640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca6806a430 0x7fca6806c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fca6c036000 tx=0x7fca6c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.627+0000 7fca63fff640 1 -- 172.21.15.38:0/1778936391 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fca7c15dac0 con 0x7fca7c15d5a0 2023-12-22T08:40:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.819+0000 7fca8098f640 1 -- 172.21.15.38:0/1778936391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca7c15dac0 con 0x7fca7c15d5a0 2023-12-22T08:40:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.821+0000 7fca63fff640 1 -- 172.21.15.38:0/1778936391 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca74017020 con 0x7fca7c15d5a0 2023-12-22T08:40:52.823 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:40:52.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.823+0000 7fca8098f640 1 -- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca6806a430 msgr2=0x7fca6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.823+0000 7fca8098f640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca6806a430 0x7fca6806c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fca6c036000 tx=0x7fca6c030000 comp rx=0 tx=0).stop 2023-12-22T08:40:52.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.823+0000 7fca8098f640 1 -- 172.21.15.38:0/1778936391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca7c15d5a0 msgr2=0x7fca7c0b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.823+0000 7fca8098f640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca7c15d5a0 0x7fca7c0b3580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca7400c430 tx=0x7fca7400c8f0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.823+0000 7fca8098f640 1 -- 172.21.15.38:0/1778936391 shutdown_connections 2023-12-22T08:40:52.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.823+0000 7fca8098f640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca6806a430 0x7fca6806c8f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.823+0000 7fca8098f640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca7c15d5a0 0x7fca7c0b3580 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.823+0000 7fca8098f640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca7c15d1c0 0x7fca7c1531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.823+0000 7fca8098f640 1 --2- 172.21.15.38:0/1778936391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca7c0d0060 0x7fca7c142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.823+0000 7fca8098f640 1 -- 172.21.15.38:0/1778936391 >> 172.21.15.38:0/1778936391 conn(0x7fca7c06bf90 msgr2=0x7fca7c15e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:52.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.824+0000 7fca8098f640 1 -- 172.21.15.38:0/1778936391 shutdown_connections 2023-12-22T08:40:52.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:52.824+0000 7fca8098f640 1 -- 172.21.15.38:0/1778936391 wait complete. 2023-12-22T08:40:52.846 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:53.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.075+0000 7ff5f1283640 1 Processor -- start 2023-12-22T08:40:53.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.075+0000 7ff5f1283640 1 -- start start 2023-12-22T08:40:53.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.077+0000 7ff5f1283640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff5ec15f5e0 0x7ff5ec162f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.077+0000 7ff5f1283640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ec162da0 con 0x7ff5ec15f200 2023-12-22T08:40:53.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.077+0000 7ff5f1283640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ec162190 con 0x7ff5ec06dc90 2023-12-22T08:40:53.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.077+0000 7ff5f1283640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ec162470 con 0x7ff5ec15f5e0 2023-12-22T08:40:53.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.077+0000 7ff5ebfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff5ec15f200 0x7ff5ec070bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51042/0 (socket says 172.21.15.38:51042) 2023-12-22T08:40:53.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.077+0000 7ff5ebfff640 1 -- 172.21.15.38:0/4123745299 learned_addr learned my addr 172.21.15.38:0/4123745299 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:53.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.078+0000 7ff5eb7fe640 1 --2- 172.21.15.38:0/4123745299 >> v2:172.21.15.89:3300/0 conn(0x7ff5ec15f5e0 0x7ff5ec162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.078+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466561412 0 0) 0x7ff5ec162da0 con 0x7ff5ec15f200 2023-12-22T08:40:53.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.078+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d4003520 con 0x7ff5ec15f200 2023-12-22T08:40:53.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.078+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 426078514 0 0) 0x7ff5d4003520 con 0x7ff5ec15f200 2023-12-22T08:40:53.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.078+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 >> v2:172.21.15.89:3300/0 conn(0x7ff5ec15f5e0 msgr2=0x7ff5ec162f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:53.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.078+0000 7ff5eaffd640 1 --2- 172.21.15.38:0/4123745299 >> v2:172.21.15.89:3300/0 conn(0x7ff5ec15f5e0 0x7ff5ec162f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.078+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 >> v1:172.21.15.89:6789/0 conn(0x7ff5ec06dc90 legacy=0x7ff5ec0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.078+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec162750 con 0x7ff5ec15f200 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.078+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7ff5dc001670 con 0x7ff5ec15f200 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 >> v1:172.21.15.38:6789/0 conn(0x7ff5ec15f200 legacy=0x7ff5ec070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5eaffd640 1 --2- 172.21.15.38:0/4123745299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5d40039c0 0x7ff5d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5eaffd640 1 --2- 172.21.15.38:0/4123745299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5d40047c0 0x7ff5d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5eaffd640 1 --2- 172.21.15.38:0/4123745299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40051d0 0x7ff5d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec162470 con 0x7ff5d40039c0 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d400c120 con 0x7ff5d40051d0 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d400c2e0 con 0x7ff5d40047c0 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5ebfff640 1 --2- 172.21.15.38:0/4123745299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5d40039c0 0x7ff5d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5f0a82640 1 --2- 172.21.15.38:0/4123745299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40051d0 0x7ff5d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5eb7fe640 1 --2- 172.21.15.38:0/4123745299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5d40047c0 0x7ff5d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5ebfff640 1 -- 172.21.15.38:0/4123745299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5d40047c0 msgr2=0x7ff5d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5ebfff640 1 --2- 172.21.15.38:0/4123745299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5d40047c0 0x7ff5d4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5ebfff640 1 -- 172.21.15.38:0/4123745299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40051d0 msgr2=0x7ff5d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:53.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5ebfff640 1 --2- 172.21.15.38:0/4123745299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40051d0 0x7ff5d400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5ebfff640 1 -- 172.21.15.38:0/4123745299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d4003520 con 0x7ff5d40039c0 2023-12-22T08:40:53.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.079+0000 7ff5f0a82640 1 -- 172.21.15.38:0/4123745299 reap_dead start 2023-12-22T08:40:53.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.081+0000 7ff5ebfff640 1 --2- 172.21.15.38:0/4123745299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5d40039c0 0x7ff5d4003de0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc001eb0 tx=0x7ff5d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12aa1ea572dbe123 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.081+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc005ad0 con 0x7ff5d40039c0 2023-12-22T08:40:53.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.081+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc005c30 con 0x7ff5d40039c0 2023-12-22T08:40:53.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.081+0000 7ff5eaffd640 1 -- 172.21.15.38:0/4123745299 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc02ca00 con 0x7ff5d40039c0 2023-12-22T08:40:53.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.081+0000 7ff5f1283640 1 -- 172.21.15.38:0/4123745299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5d40039c0 msgr2=0x7ff5d4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.081+0000 7ff5f1283640 1 --2- 172.21.15.38:0/4123745299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5d40039c0 0x7ff5d4003de0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc001eb0 tx=0x7ff5d40057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.082+0000 7ff5f1283640 1 -- 172.21.15.38:0/4123745299 shutdown_connections 2023-12-22T08:40:53.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.082+0000 7ff5f1283640 1 --2- 172.21.15.38:0/4123745299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5d40039c0 0x7ff5d4003de0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.082+0000 7ff5f1283640 1 -- 172.21.15.38:0/4123745299 >> 172.21.15.38:0/4123745299 conn(0x7ff5ec0cf000 msgr2=0x7ff5ec0cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.082+0000 7ff5f1283640 1 -- 172.21.15.38:0/4123745299 shutdown_connections 2023-12-22T08:40:53.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.082+0000 7ff5f1283640 1 -- 172.21.15.38:0/4123745299 wait complete. 2023-12-22T08:40:53.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.083+0000 7ff5f1283640 1 Processor -- start 2023-12-22T08:40:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.084+0000 7ff5f1283640 1 -- start start 2023-12-22T08:40:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f1283640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40039c0 0x7ff5ec099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f1283640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5ec070630 0x7ff5ec152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f1283640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5ec15c810 0x7ff5ec15cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f1283640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec15d1d0 con 0x7ff5ec15c810 2023-12-22T08:40:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f1283640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec1529c0 con 0x7ff5d40039c0 2023-12-22T08:40:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f1283640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec09a050 con 0x7ff5ec070630 2023-12-22T08:40:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f0a82640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5ec15c810 0x7ff5ec15cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f0a82640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5ec15c810 0x7ff5ec15cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46712/0 (socket says 172.21.15.38:46712) 2023-12-22T08:40:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f0a82640 1 -- 172.21.15.38:0/1306917324 learned_addr learned my addr 172.21.15.38:0/1306917324 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5ebfff640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40039c0 0x7ff5ec099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5eb7fe640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5ec070630 0x7ff5ec152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f0a82640 1 -- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5ec070630 msgr2=0x7ff5ec152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f0a82640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5ec070630 0x7ff5ec152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f0a82640 1 -- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40039c0 msgr2=0x7ff5ec099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f0a82640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40039c0 0x7ff5ec099a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.085+0000 7ff5f0a82640 1 -- 172.21.15.38:0/1306917324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec09a330 con 0x7ff5ec15c810 2023-12-22T08:40:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.086+0000 7ff5f0a82640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5ec15c810 0x7ff5ec15cc90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4007fd0 tx=0x7ff5e400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.086+0000 7ff5e8ff9640 1 -- 172.21.15.38:0/1306917324 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4006d60 con 0x7ff5ec15c810 2023-12-22T08:40:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.086+0000 7ff5e8ff9640 1 -- 172.21.15.38:0/1306917324 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4003970 con 0x7ff5ec15c810 2023-12-22T08:40:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.086+0000 7ff5e8ff9640 1 -- 172.21.15.38:0/1306917324 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4003d20 con 0x7ff5ec15c810 2023-12-22T08:40:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.086+0000 7ff5f1283640 1 -- 172.21.15.38:0/1306917324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ec09a610 con 0x7ff5ec15c810 2023-12-22T08:40:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.086+0000 7ff5f1283640 1 -- 172.21.15.38:0/1306917324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ec09abd0 con 0x7ff5ec15c810 2023-12-22T08:40:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.087+0000 7ff5f1283640 1 -- 172.21.15.38:0/1306917324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ec061910 con 0x7ff5ec15c810 2023-12-22T08:40:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.088+0000 7ff5e8ff9640 1 -- 172.21.15.38:0/1306917324 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff5e4005070 con 0x7ff5ec15c810 2023-12-22T08:40:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.089+0000 7ff5e8ff9640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff5d806a460 0x7ff5d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.089+0000 7ff5e8ff9640 1 -- 172.21.15.38:0/1306917324 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff5e40881d0 con 0x7ff5ec15c810 2023-12-22T08:40:53.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.090+0000 7ff5ebfff640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff5d806a460 0x7ff5d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.091+0000 7ff5ebfff640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff5d806a460 0x7ff5d806c920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc034000 tx=0x7ff5dc009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.093+0000 7ff5e8ff9640 1 -- 172.21.15.38:0/1306917324 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff5e40536e0 con 0x7ff5ec15c810 2023-12-22T08:40:53.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.285+0000 7ff5f1283640 1 -- 172.21.15.38:0/1306917324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5ec15fd00 con 0x7ff5ec15c810 2023-12-22T08:40:53.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.286+0000 7ff5e8ff9640 1 -- 172.21.15.38:0/1306917324 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5e4056d00 con 0x7ff5ec15c810 2023-12-22T08:40:53.289 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:40:53.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.289+0000 7ff5f1283640 1 -- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff5d806a460 msgr2=0x7ff5d806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.289+0000 7ff5f1283640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff5d806a460 0x7ff5d806c920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc034000 tx=0x7ff5dc009030 comp rx=0 tx=0).stop 2023-12-22T08:40:53.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.289+0000 7ff5f1283640 1 -- 172.21.15.38:0/1306917324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5ec15c810 msgr2=0x7ff5ec15cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.289+0000 7ff5f1283640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5ec15c810 0x7ff5ec15cc90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4007fd0 tx=0x7ff5e400ea00 comp rx=0 tx=0).stop 2023-12-22T08:40:53.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.289+0000 7ff5f1283640 1 -- 172.21.15.38:0/1306917324 shutdown_connections 2023-12-22T08:40:53.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.289+0000 7ff5f1283640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff5d806a460 0x7ff5d806c920 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.289+0000 7ff5f1283640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5ec15c810 0x7ff5ec15cc90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.289+0000 7ff5f1283640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5ec070630 0x7ff5ec152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.289+0000 7ff5f1283640 1 --2- 172.21.15.38:0/1306917324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40039c0 0x7ff5ec099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.289+0000 7ff5f1283640 1 -- 172.21.15.38:0/1306917324 >> 172.21.15.38:0/1306917324 conn(0x7ff5ec0cf000 msgr2=0x7ff5ec160fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.289+0000 7ff5f1283640 1 -- 172.21.15.38:0/1306917324 shutdown_connections 2023-12-22T08:40:53.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.289+0000 7ff5f1283640 1 -- 172.21.15.38:0/1306917324 wait complete. 2023-12-22T08:40:53.312 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:53.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.544+0000 7f3889318640 1 Processor -- start 2023-12-22T08:40:53.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.545+0000 7f3889318640 1 -- start start 2023-12-22T08:40:53.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.546+0000 7f3889318640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3884143600 0x7f388415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.546+0000 7f3889318640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38840cea50 0x7f38840ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.546+0000 7f3889318640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f388406d590 0x7f388406d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.546+0000 7f3889318640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38840cf410 con 0x7f3884143600 2023-12-22T08:40:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.546+0000 7f3889318640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388415ea00 con 0x7f388406d590 2023-12-22T08:40:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.546+0000 7f3889318640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3884140f70 con 0x7f38840cea50 2023-12-22T08:40:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.547+0000 7f3882ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3884143600 0x7f388415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.547+0000 7f3882ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3884143600 0x7f388415e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46728/0 (socket says 172.21.15.38:46728) 2023-12-22T08:40:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.547+0000 7f3882ffd640 1 -- 172.21.15.38:0/3290571999 learned_addr learned my addr 172.21.15.38:0/3290571999 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.547+0000 7f38837fe640 1 --2- 172.21.15.38:0/3290571999 >> v2:172.21.15.89:3300/0 conn(0x7f388406d590 0x7f388406d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.547+0000 7f387bfff640 1 --2- 172.21.15.38:0/3290571999 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38840cea50 0x7f38840ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.547+0000 7f3882ffd640 1 -- 172.21.15.38:0/3290571999 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38840cea50 msgr2=0x7f38840ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.547+0000 7f3882ffd640 1 --2- 172.21.15.38:0/3290571999 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38840cea50 0x7f38840ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.547+0000 7f3882ffd640 1 -- 172.21.15.38:0/3290571999 >> v2:172.21.15.89:3300/0 conn(0x7f388406d590 msgr2=0x7f388406d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.547+0000 7f3882ffd640 1 --2- 172.21.15.38:0/3290571999 >> v2:172.21.15.89:3300/0 conn(0x7f388406d590 0x7f388406d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.547+0000 7f3882ffd640 1 -- 172.21.15.38:0/3290571999 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388406c300 con 0x7f3884143600 2023-12-22T08:40:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.547+0000 7f38837fe640 1 --2- 172.21.15.38:0/3290571999 >> v2:172.21.15.89:3300/0 conn(0x7f388406d590 0x7f388406d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.547+0000 7f387bfff640 1 --2- 172.21.15.38:0/3290571999 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38840cea50 0x7f38840ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:53.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.549+0000 7f3882ffd640 1 --2- 172.21.15.38:0/3290571999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3884143600 0x7f388415e4c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3884154b00 tx=0x7f387402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83644100c8405df6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.549+0000 7f38827fc640 1 -- 172.21.15.38:0/3290571999 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874031870 con 0x7f3884143600 2023-12-22T08:40:53.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.549+0000 7f38827fc640 1 -- 172.21.15.38:0/3290571999 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38740319d0 con 0x7f3884143600 2023-12-22T08:40:53.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.549+0000 7f38827fc640 1 -- 172.21.15.38:0/3290571999 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874031d60 con 0x7f3884143600 2023-12-22T08:40:53.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.550+0000 7f3889318640 1 -- 172.21.15.38:0/3290571999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3884143600 msgr2=0x7f388415e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.550+0000 7f3889318640 1 --2- 172.21.15.38:0/3290571999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3884143600 0x7f388415e4c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3884154b00 tx=0x7f387402b910 comp rx=0 tx=0).stop 2023-12-22T08:40:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.550+0000 7f3889318640 1 -- 172.21.15.38:0/3290571999 shutdown_connections 2023-12-22T08:40:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.550+0000 7f3889318640 1 --2- 172.21.15.38:0/3290571999 >> v2:172.21.15.89:3300/0 conn(0x7f388406d590 0x7f388406d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.550+0000 7f3889318640 1 --2- 172.21.15.38:0/3290571999 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38840cea50 0x7f38840ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.550+0000 7f3889318640 1 --2- 172.21.15.38:0/3290571999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3884143600 0x7f388415e4c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.550+0000 7f3889318640 1 -- 172.21.15.38:0/3290571999 >> 172.21.15.38:0/3290571999 conn(0x7f38840cfe70 msgr2=0x7f38840d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.550+0000 7f3889318640 1 -- 172.21.15.38:0/3290571999 shutdown_connections 2023-12-22T08:40:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.550+0000 7f3889318640 1 -- 172.21.15.38:0/3290571999 wait complete. 2023-12-22T08:40:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.552+0000 7f3889318640 1 Processor -- start 2023-12-22T08:40:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.552+0000 7f3889318640 1 -- start start 2023-12-22T08:40:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.553+0000 7f3889318640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f388406d590 0x7f388409e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.553+0000 7f3889318640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38840cea50 0x7f388413fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.553+0000 7f3889318640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3884143600 0x7f38841f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.553+0000 7f3889318640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3884140410 con 0x7f388406d590 2023-12-22T08:40:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.553+0000 7f3889318640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38841f7050 con 0x7f3884143600 2023-12-22T08:40:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.553+0000 7f3889318640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388409f680 con 0x7f38840cea50 2023-12-22T08:40:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.553+0000 7f3882ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f388406d590 0x7f388409e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.554+0000 7f3882ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f388406d590 0x7f388409e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46730/0 (socket says 172.21.15.38:46730) 2023-12-22T08:40:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.554+0000 7f3882ffd640 1 -- 172.21.15.38:0/522984403 learned_addr learned my addr 172.21.15.38:0/522984403 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.554+0000 7f38837fe640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3884143600 0x7f38841f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.554+0000 7f387bfff640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38840cea50 0x7f388413fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.554+0000 7f3882ffd640 1 -- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38840cea50 msgr2=0x7f388413fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.554+0000 7f3882ffd640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38840cea50 0x7f388413fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.554+0000 7f3882ffd640 1 -- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3884143600 msgr2=0x7f38841f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.554+0000 7f3882ffd640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3884143600 0x7f38841f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.554+0000 7f3882ffd640 1 -- 172.21.15.38:0/522984403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38740094d0 con 0x7f388406d590 2023-12-22T08:40:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.554+0000 7f38837fe640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3884143600 0x7f38841f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.554+0000 7f3882ffd640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f388406d590 0x7f388409e470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3874000c00 tx=0x7f38740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.555+0000 7f387b7fe640 1 -- 172.21.15.38:0/522984403 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874031860 con 0x7f388406d590 2023-12-22T08:40:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.555+0000 7f387b7fe640 1 -- 172.21.15.38:0/522984403 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38740443f0 con 0x7f388406d590 2023-12-22T08:40:53.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.555+0000 7f387b7fe640 1 -- 172.21.15.38:0/522984403 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38740447a0 con 0x7f388406d590 2023-12-22T08:40:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.555+0000 7f3889318640 1 -- 172.21.15.38:0/522984403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3884155b10 con 0x7f388406d590 2023-12-22T08:40:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.555+0000 7f3889318640 1 -- 172.21.15.38:0/522984403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388409eb00 con 0x7f388406d590 2023-12-22T08:40:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.556+0000 7f3889318640 1 -- 172.21.15.38:0/522984403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3884061910 con 0x7f388406d590 2023-12-22T08:40:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.557+0000 7f387b7fe640 1 -- 172.21.15.38:0/522984403 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3874044900 con 0x7f388406d590 2023-12-22T08:40:53.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.557+0000 7f387b7fe640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f386406a430 0x7f386406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.558+0000 7f387b7fe640 1 -- 172.21.15.38:0/522984403 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f387402d040 con 0x7f388406d590 2023-12-22T08:40:53.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.558+0000 7f387bfff640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f386406a430 0x7f386406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.559+0000 7f387bfff640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f386406a430 0x7f386406c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f386c008850 tx=0x7f386c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.562+0000 7f387b7fe640 1 -- 172.21.15.38:0/522984403 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3874076830 con 0x7f388406d590 2023-12-22T08:40:53.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.755+0000 7f3889318640 1 -- 172.21.15.38:0/522984403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f388415ff60 con 0x7f388406d590 2023-12-22T08:40:53.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.756+0000 7f387b7fe640 1 -- 172.21.15.38:0/522984403 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38740350a0 con 0x7f388406d590 2023-12-22T08:40:53.758 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:40:53.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.759+0000 7f3889318640 1 -- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f386406a430 msgr2=0x7f386406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.759+0000 7f3889318640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f386406a430 0x7f386406c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f386c008850 tx=0x7f386c008040 comp rx=0 tx=0).stop 2023-12-22T08:40:53.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.759+0000 7f3889318640 1 -- 172.21.15.38:0/522984403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f388406d590 msgr2=0x7f388409e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.759+0000 7f3889318640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f388406d590 0x7f388409e470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3874000c00 tx=0x7f38740046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.759+0000 7f3889318640 1 -- 172.21.15.38:0/522984403 shutdown_connections 2023-12-22T08:40:53.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.759+0000 7f3889318640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3884143600 0x7f38841f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.759+0000 7f3889318640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38840cea50 0x7f388413fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.759+0000 7f3889318640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f386406a430 0x7f386406c8f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.759+0000 7f3889318640 1 --2- 172.21.15.38:0/522984403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f388406d590 0x7f388409e470 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.759+0000 7f3889318640 1 -- 172.21.15.38:0/522984403 >> 172.21.15.38:0/522984403 conn(0x7f38840cfe70 msgr2=0x7f38841602d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.759+0000 7f3889318640 1 -- 172.21.15.38:0/522984403 shutdown_connections 2023-12-22T08:40:53.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:53.759+0000 7f3889318640 1 -- 172.21.15.38:0/522984403 wait complete. 2023-12-22T08:40:53.782 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:40:54.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.005+0000 7fbb19e38640 1 Processor -- start 2023-12-22T08:40:54.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.005+0000 7fbb19e38640 1 -- start start 2023-12-22T08:40:54.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.007+0000 7fbb19e38640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb141547a0 0x7fbb1415b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.007+0000 7fbb19e38640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb14071b90 0x7fbb14070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.007+0000 7fbb19e38640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb140716a0 con 0x7fbb14154b80 2023-12-22T08:40:54.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.007+0000 7fbb19e38640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb140710e0 con 0x7fbb14071b90 2023-12-22T08:40:54.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.007+0000 7fbb19e38640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb140713c0 con 0x7fbb141547a0 2023-12-22T08:40:54.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.008+0000 7fbb0bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb14071b90 0x7fbb14070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.008+0000 7fbb0bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb14071b90 0x7fbb14070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46746/0 (socket says 172.21.15.38:46746) 2023-12-22T08:40:54.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.008+0000 7fbb0bfff640 1 -- 172.21.15.38:0/3768823272 learned_addr learned my addr 172.21.15.38:0/3768823272 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:54.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.008+0000 7fbb137fe640 1 --2- 172.21.15.38:0/3768823272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb141547a0 0x7fbb1415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.008+0000 7fbb0bfff640 1 -- 172.21.15.38:0/3768823272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb141547a0 msgr2=0x7fbb1415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:54.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.008+0000 7fbb0bfff640 1 --2- 172.21.15.38:0/3768823272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb141547a0 0x7fbb1415b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.008+0000 7fbb0bfff640 1 -- 172.21.15.38:0/3768823272 >> v1:172.21.15.89:6789/0 conn(0x7fbb14154b80 legacy=0x7fbb140ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:54.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.008+0000 7fbb0bfff640 1 -- 172.21.15.38:0/3768823272 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1415ab00 con 0x7fbb14071b90 2023-12-22T08:40:54.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.008+0000 7fbb137fe640 1 --2- 172.21.15.38:0/3768823272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb141547a0 0x7fbb1415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:54.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.009+0000 7fbb0bfff640 1 --2- 172.21.15.38:0/3768823272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb14071b90 0x7fbb14070770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009870 tx=0x7fbafc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2f816aaaf58778 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.010+0000 7fbb12ffd640 1 -- 172.21.15.38:0/3768823272 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc031640 con 0x7fbb14071b90 2023-12-22T08:40:54.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.010+0000 7fbb12ffd640 1 -- 172.21.15.38:0/3768823272 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc0317a0 con 0x7fbb14071b90 2023-12-22T08:40:54.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.010+0000 7fbb12ffd640 1 -- 172.21.15.38:0/3768823272 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc031b30 con 0x7fbb14071b90 2023-12-22T08:40:54.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.010+0000 7fbb19e38640 1 -- 172.21.15.38:0/3768823272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb14071b90 msgr2=0x7fbb14070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.010+0000 7fbb19e38640 1 --2- 172.21.15.38:0/3768823272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb14071b90 0x7fbb14070770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009870 tx=0x7fbafc02b8f0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.011+0000 7fbb19e38640 1 -- 172.21.15.38:0/3768823272 shutdown_connections 2023-12-22T08:40:54.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.011+0000 7fbb19e38640 1 --2- 172.21.15.38:0/3768823272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb14071b90 0x7fbb14070770 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.011+0000 7fbb19e38640 1 --2- 172.21.15.38:0/3768823272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb141547a0 0x7fbb1415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.011+0000 7fbb19e38640 1 -- 172.21.15.38:0/3768823272 >> 172.21.15.38:0/3768823272 conn(0x7fbb140cf070 msgr2=0x7fbb140cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:54.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.011+0000 7fbb19e38640 1 -- 172.21.15.38:0/3768823272 shutdown_connections 2023-12-22T08:40:54.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.011+0000 7fbb19e38640 1 -- 172.21.15.38:0/3768823272 wait complete. 2023-12-22T08:40:54.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.012+0000 7fbb19e38640 1 Processor -- start 2023-12-22T08:40:54.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.013+0000 7fbb19e38640 1 -- start start 2023-12-22T08:40:54.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb19e38640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb14071b90 0x7fbb1415c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb19e38640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb141547a0 0x7fbb14158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb19e38640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb14154b80 0x7fbb14147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb19e38640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb141593b0 con 0x7fbb14071b90 2023-12-22T08:40:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb19e38640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14159690 con 0x7fbb14154b80 2023-12-22T08:40:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb19e38640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14159970 con 0x7fbb141547a0 2023-12-22T08:40:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb137fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb14071b90 0x7fbb1415c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb137fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb14071b90 0x7fbb1415c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46760/0 (socket says 172.21.15.38:46760) 2023-12-22T08:40:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb137fe640 1 -- 172.21.15.38:0/433936474 learned_addr learned my addr 172.21.15.38:0/433936474 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb0bfff640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb141547a0 0x7fbb14158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb13fff640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb14154b80 0x7fbb14147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb137fe640 1 -- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb141547a0 msgr2=0x7fbb14158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb137fe640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb141547a0 0x7fbb14158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb137fe640 1 -- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb14154b80 msgr2=0x7fbb14147b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.014+0000 7fbb137fe640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb14154b80 0x7fbb14147b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.015+0000 7fbb137fe640 1 -- 172.21.15.38:0/433936474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc0094d0 con 0x7fbb14071b90 2023-12-22T08:40:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.015+0000 7fbb137fe640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb14071b90 0x7fbb1415c790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c7f0 tx=0x7fbb0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.015+0000 7fbb10ff9640 1 -- 172.21.15.38:0/433936474 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb04007a30 con 0x7fbb14071b90 2023-12-22T08:40:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.015+0000 7fbb10ff9640 1 -- 172.21.15.38:0/433936474 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb04007b90 con 0x7fbb14071b90 2023-12-22T08:40:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.015+0000 7fbb10ff9640 1 -- 172.21.15.38:0/433936474 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400ce40 con 0x7fbb14071b90 2023-12-22T08:40:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.015+0000 7fbb19e38640 1 -- 172.21.15.38:0/433936474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb14148780 con 0x7fbb14071b90 2023-12-22T08:40:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.015+0000 7fbb19e38640 1 -- 172.21.15.38:0/433936474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1415ccd0 con 0x7fbb14071b90 2023-12-22T08:40:54.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.016+0000 7fbb19e38640 1 -- 172.21.15.38:0/433936474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb141489c0 con 0x7fbb14071b90 2023-12-22T08:40:54.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.017+0000 7fbb10ff9640 1 -- 172.21.15.38:0/433936474 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbb040113f0 con 0x7fbb14071b90 2023-12-22T08:40:54.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.018+0000 7fbb10ff9640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbaf406a460 0x7fbaf406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.018+0000 7fbb10ff9640 1 -- 172.21.15.38:0/433936474 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbb04088b00 con 0x7fbb14071b90 2023-12-22T08:40:54.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.019+0000 7fbb0bfff640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbaf406a460 0x7fbaf406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.020+0000 7fbb0bfff640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbaf406a460 0x7fbaf406c920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbafc036000 tx=0x7fbafc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.022+0000 7fbb10ff9640 1 -- 172.21.15.38:0/433936474 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbb141489c0 con 0x7fbb14071b90 2023-12-22T08:40:54.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.232+0000 7fbb19e38640 1 -- 172.21.15.38:0/433936474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbb141489c0 con 0x7fbb14071b90 2023-12-22T08:40:54.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.233+0000 7fbb10ff9640 1 -- 172.21.15.38:0/433936474 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbb0401f080 con 0x7fbb14071b90 2023-12-22T08:40:54.235 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:40:54.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.235+0000 7fbb19e38640 1 -- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbaf406a460 msgr2=0x7fbaf406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.235+0000 7fbb19e38640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbaf406a460 0x7fbaf406c920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbafc036000 tx=0x7fbafc03c040 comp rx=0 tx=0).stop 2023-12-22T08:40:54.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.235+0000 7fbb19e38640 1 -- 172.21.15.38:0/433936474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb14071b90 msgr2=0x7fbb1415c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.235+0000 7fbb19e38640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb14071b90 0x7fbb1415c790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c7f0 tx=0x7fbb0400cbf0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.236+0000 7fbb19e38640 1 -- 172.21.15.38:0/433936474 shutdown_connections 2023-12-22T08:40:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.236+0000 7fbb19e38640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb14154b80 0x7fbb14147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.236+0000 7fbb19e38640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb141547a0 0x7fbb14158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.236+0000 7fbb19e38640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbaf406a460 0x7fbaf406c920 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.236+0000 7fbb19e38640 1 --2- 172.21.15.38:0/433936474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb14071b90 0x7fbb1415c790 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.236+0000 7fbb19e38640 1 -- 172.21.15.38:0/433936474 >> 172.21.15.38:0/433936474 conn(0x7fbb140cf070 msgr2=0x7fbb140cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.236+0000 7fbb19e38640 1 -- 172.21.15.38:0/433936474 shutdown_connections 2023-12-22T08:40:54.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.236+0000 7fbb19e38640 1 -- 172.21.15.38:0/433936474 wait complete. 2023-12-22T08:40:54.258 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-12-22T08:40:54.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:54.258 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-12-22T08:40:54.354 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:40:54.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:54.354 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-22T08:40:54.411 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:40:54.411 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:54.469 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:40:54.470 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:54.521 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:40:54.521 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:40:54.575 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:54.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.810+0000 7fce8f821640 1 Processor -- start 2023-12-22T08:40:54.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.810+0000 7fce8f821640 1 -- start start 2023-12-22T08:40:54.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.812+0000 7fce8f821640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fce88071b90 0x7fce88070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.812+0000 7fce8f821640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce880716a0 con 0x7fce881547a0 2023-12-22T08:40:54.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.812+0000 7fce8f821640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce880710e0 con 0x7fce88154b80 2023-12-22T08:40:54.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.812+0000 7fce8f821640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce880713c0 con 0x7fce88071b90 2023-12-22T08:40:54.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.812+0000 7fce8d5bd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fce881547a0 0x7fce8815b300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51046/0 (socket says 172.21.15.38:51046) 2023-12-22T08:40:54.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.812+0000 7fce8d5bd640 1 -- 172.21.15.38:0/824373752 learned_addr learned my addr 172.21.15.38:0/824373752 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:54.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.813+0000 7fce8cdbc640 1 --2- 172.21.15.38:0/824373752 >> v2:172.21.15.89:3300/0 conn(0x7fce88071b90 0x7fce88070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.813+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825263200 0 0) 0x7fce880716a0 con 0x7fce881547a0 2023-12-22T08:40:54.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.813+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce74003520 con 0x7fce881547a0 2023-12-22T08:40:54.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.813+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1445762163 0 0) 0x7fce74003520 con 0x7fce881547a0 2023-12-22T08:40:54.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.813+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 >> v2:172.21.15.89:3300/0 conn(0x7fce88071b90 msgr2=0x7fce88070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:54.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.813+0000 7fce7ffff640 1 --2- 172.21.15.38:0/824373752 >> v2:172.21.15.89:3300/0 conn(0x7fce88071b90 0x7fce88070770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.813+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 >> v1:172.21.15.89:6789/0 conn(0x7fce88154b80 legacy=0x7fce880ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.813+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8815ab00 con 0x7fce881547a0 2023-12-22T08:40:54.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.813+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fce84001670 con 0x7fce881547a0 2023-12-22T08:40:54.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.813+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 >> v1:172.21.15.38:6789/0 conn(0x7fce881547a0 legacy=0x7fce8815b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.813+0000 7fce7ffff640 1 --2- 172.21.15.38:0/824373752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce74003970 0x7fce74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.813+0000 7fce7ffff640 1 --2- 172.21.15.38:0/824373752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce740047c0 0x7fce74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.813+0000 7fce7ffff640 1 --2- 172.21.15.38:0/824373752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce74005180 0x7fce7400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.814+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce880713c0 con 0x7fce74005180 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.814+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7400c0d0 con 0x7fce740047c0 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.814+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7400c290 con 0x7fce74003970 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.814+0000 7fce8ddbe640 1 --2- 172.21.15.38:0/824373752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce74005180 0x7fce7400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.814+0000 7fce8cdbc640 1 --2- 172.21.15.38:0/824373752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce740047c0 0x7fce74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.814+0000 7fce8d5bd640 1 --2- 172.21.15.38:0/824373752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce74003970 0x7fce74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.814+0000 7fce8ddbe640 1 -- 172.21.15.38:0/824373752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce74003970 msgr2=0x7fce74003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.814+0000 7fce8ddbe640 1 --2- 172.21.15.38:0/824373752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce74003970 0x7fce74003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.814+0000 7fce8ddbe640 1 -- 172.21.15.38:0/824373752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce740047c0 msgr2=0x7fce74004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.814+0000 7fce8ddbe640 1 --2- 172.21.15.38:0/824373752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce740047c0 0x7fce74004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.814+0000 7fce8ddbe640 1 -- 172.21.15.38:0/824373752 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce74003520 con 0x7fce74005180 2023-12-22T08:40:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.815+0000 7fce8ddbe640 1 -- 172.21.15.38:0/824373752 reap_dead start 2023-12-22T08:40:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.816+0000 7fce8ddbe640 1 --2- 172.21.15.38:0/824373752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce74005180 0x7fce7400b980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fce80001e20 tx=0x7fce740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1f8a58f0ec54d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.816+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80003b70 con 0x7fce74005180 2023-12-22T08:40:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.816+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80003cd0 con 0x7fce74005180 2023-12-22T08:40:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.816+0000 7fce7ffff640 1 -- 172.21.15.38:0/824373752 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce800052f0 con 0x7fce74005180 2023-12-22T08:40:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.816+0000 7fce8f821640 1 -- 172.21.15.38:0/824373752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce74005180 msgr2=0x7fce7400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.816+0000 7fce8f821640 1 --2- 172.21.15.38:0/824373752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce74005180 0x7fce7400b980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fce80001e20 tx=0x7fce740057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.817+0000 7fce8f821640 1 -- 172.21.15.38:0/824373752 shutdown_connections 2023-12-22T08:40:54.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.817+0000 7fce8f821640 1 --2- 172.21.15.38:0/824373752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce74005180 0x7fce7400b980 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.817+0000 7fce8f821640 1 -- 172.21.15.38:0/824373752 >> 172.21.15.38:0/824373752 conn(0x7fce880cf070 msgr2=0x7fce880cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:54.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.817+0000 7fce8f821640 1 -- 172.21.15.38:0/824373752 shutdown_connections 2023-12-22T08:40:54.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.817+0000 7fce8f821640 1 -- 172.21.15.38:0/824373752 wait complete. 2023-12-22T08:40:54.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.818+0000 7fce8f821640 1 Processor -- start 2023-12-22T08:40:54.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.819+0000 7fce8f821640 1 -- start start 2023-12-22T08:40:54.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.819+0000 7fce8f821640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce74005180 0x7fce88146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.819+0000 7fce8f821640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce881517e0 0x7fce88152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8f821640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce88151c60 0x7fce88152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8f821640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce881e48e0 con 0x7fce88151c60 2023-12-22T08:40:54.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8f821640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8814cb90 con 0x7fce881517e0 2023-12-22T08:40:54.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8f821640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8814c030 con 0x7fce74005180 2023-12-22T08:40:54.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8ddbe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce88151c60 0x7fce88152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8ddbe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce88151c60 0x7fce88152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46778/0 (socket says 172.21.15.38:46778) 2023-12-22T08:40:54.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8ddbe640 1 -- 172.21.15.38:0/260943612 learned_addr learned my addr 172.21.15.38:0/260943612 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8d5bd640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce74005180 0x7fce88146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8cdbc640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce881517e0 0x7fce88152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8ddbe640 1 -- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce74005180 msgr2=0x7fce88146b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8ddbe640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce74005180 0x7fce88146b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8ddbe640 1 -- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce881517e0 msgr2=0x7fce88152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8ddbe640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce881517e0 0x7fce88152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.820+0000 7fce8ddbe640 1 -- 172.21.15.38:0/260943612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8814c2f0 con 0x7fce88151c60 2023-12-22T08:40:54.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.821+0000 7fce8ddbe640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce88151c60 0x7fce88152f80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fce80001f40 tx=0x7fce800014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.821+0000 7fce7dffb640 1 -- 172.21.15.38:0/260943612 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80006d50 con 0x7fce88151c60 2023-12-22T08:40:54.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.821+0000 7fce7dffb640 1 -- 172.21.15.38:0/260943612 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80007020 con 0x7fce88151c60 2023-12-22T08:40:54.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.821+0000 7fce8f821640 1 -- 172.21.15.38:0/260943612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8814c5d0 con 0x7fce88151c60 2023-12-22T08:40:54.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.821+0000 7fce7dffb640 1 -- 172.21.15.38:0/260943612 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80007390 con 0x7fce88151c60 2023-12-22T08:40:54.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.821+0000 7fce8f821640 1 -- 172.21.15.38:0/260943612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce88147050 con 0x7fce88151c60 2023-12-22T08:40:54.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.822+0000 7fce8f821640 1 -- 172.21.15.38:0/260943612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce88061910 con 0x7fce88151c60 2023-12-22T08:40:54.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.823+0000 7fce7dffb640 1 -- 172.21.15.38:0/260943612 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fce8003f030 con 0x7fce88151c60 2023-12-22T08:40:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.824+0000 7fce7dffb640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fce6c06a430 0x7fce6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.825+0000 7fce7dffb640 1 -- 172.21.15.38:0/260943612 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fce80003e40 con 0x7fce88151c60 2023-12-22T08:40:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.825+0000 7fce8d5bd640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fce6c06a430 0x7fce6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.826+0000 7fce8d5bd640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fce6c06a430 0x7fce6c06c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fce84001050 tx=0x7fce84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:54.829+0000 7fce7dffb640 1 -- 172.21.15.38:0/260943612 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fce80075e60 con 0x7fce88151c60 2023-12-22T08:40:55.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.025+0000 7fce8f821640 1 -- 172.21.15.38:0/260943612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce880cb950 con 0x7fce88151c60 2023-12-22T08:40:55.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.027+0000 7fce7dffb640 1 -- 172.21.15.38:0/260943612 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16088 (secure 0 0 0) 0x7fce80047020 con 0x7fce88151c60 2023-12-22T08:40:55.030 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:55.031 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":22,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:40:48.371962+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:55.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.030+0000 7fce8f821640 1 -- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fce6c06a430 msgr2=0x7fce6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.030+0000 7fce8f821640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fce6c06a430 0x7fce6c06c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fce84001050 tx=0x7fce84009040 comp rx=0 tx=0).stop 2023-12-22T08:40:55.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.030+0000 7fce8f821640 1 -- 172.21.15.38:0/260943612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce88151c60 msgr2=0x7fce88152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.030+0000 7fce8f821640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce88151c60 0x7fce88152f80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fce80001f40 tx=0x7fce800014a0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.030+0000 7fce8f821640 1 -- 172.21.15.38:0/260943612 shutdown_connections 2023-12-22T08:40:55.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.030+0000 7fce8f821640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fce6c06a430 0x7fce6c06c8f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.030+0000 7fce8f821640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fce88151c60 0x7fce88152f80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.030+0000 7fce8f821640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce881517e0 0x7fce88152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.030+0000 7fce8f821640 1 --2- 172.21.15.38:0/260943612 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce74005180 0x7fce88146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.030+0000 7fce8f821640 1 -- 172.21.15.38:0/260943612 >> 172.21.15.38:0/260943612 conn(0x7fce880cf070 msgr2=0x7fce8815bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:55.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.030+0000 7fce8f821640 1 -- 172.21.15.38:0/260943612 shutdown_connections 2023-12-22T08:40:55.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.030+0000 7fce8f821640 1 -- 172.21.15.38:0/260943612 wait complete. 2023-12-22T08:40:55.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:39:56.873963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:39:57.616447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:55.052 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:55.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.276+0000 7f801de31640 1 Processor -- start 2023-12-22T08:40:55.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.277+0000 7f801de31640 1 -- start start 2023-12-22T08:40:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.278+0000 7f801de31640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80180b9110 0x7f80181685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.278+0000 7f801de31640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8018072190 con 0x7f801815d4b0 2023-12-22T08:40:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.279+0000 7f801de31640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801806d6c0 con 0x7f80180b4ab0 2023-12-22T08:40:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.279+0000 7f801de31640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801806d9a0 con 0x7f80180b9110 2023-12-22T08:40:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.279+0000 7f80177fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f801815d4b0 0x7f8018071780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51054/0 (socket says 172.21.15.38:51054) 2023-12-22T08:40:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.279+0000 7f80177fe640 1 -- 172.21.15.38:0/1407633377 learned_addr learned my addr 172.21.15.38:0/1407633377 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.279+0000 7f8017fff640 1 --2- 172.21.15.38:0/1407633377 >> v2:172.21.15.89:3300/0 conn(0x7f80180b9110 0x7f80181685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.279+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376832957 0 0) 0x7f8018072190 con 0x7f801815d4b0 2023-12-22T08:40:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.279+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8004003520 con 0x7f801815d4b0 2023-12-22T08:40:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2499566675 0 0) 0x7f8004003520 con 0x7f801815d4b0 2023-12-22T08:40:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 >> v2:172.21.15.89:3300/0 conn(0x7f80180b9110 msgr2=0x7f80181685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f80167fc640 1 --2- 172.21.15.38:0/1407633377 >> v2:172.21.15.89:3300/0 conn(0x7f80180b9110 0x7f80181685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 >> v1:172.21.15.89:6789/0 conn(0x7f80180b4ab0 legacy=0x7f80180b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801806dc80 con 0x7f801815d4b0 2023-12-22T08:40:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f8008001690 con 0x7f801815d4b0 2023-12-22T08:40:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 >> v1:172.21.15.38:6789/0 conn(0x7f801815d4b0 legacy=0x7f8018071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f80167fc640 1 --2- 172.21.15.38:0/1407633377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80040039c0 0x7f8004003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f80167fc640 1 --2- 172.21.15.38:0/1407633377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80040047c0 0x7f8004004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f80167fc640 1 --2- 172.21.15.38:0/1407633377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8004005180 0x7f800400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801806d9a0 con 0x7f80040047c0 2023-12-22T08:40:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800400c050 con 0x7f8004005180 2023-12-22T08:40:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800400c210 con 0x7f80040039c0 2023-12-22T08:40:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.280+0000 7f8016ffd640 1 --2- 172.21.15.38:0/1407633377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80040047c0 0x7f8004004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.281+0000 7f8016ffd640 1 -- 172.21.15.38:0/1407633377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80040039c0 msgr2=0x7f8004003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.281+0000 7f8016ffd640 1 --2- 172.21.15.38:0/1407633377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80040039c0 0x7f8004003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.281+0000 7f8016ffd640 1 -- 172.21.15.38:0/1407633377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8004005180 msgr2=0x7f800400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.281+0000 7f8016ffd640 1 --2- 172.21.15.38:0/1407633377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8004005180 0x7f800400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.281+0000 7f8016ffd640 1 -- 172.21.15.38:0/1407633377 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004003520 con 0x7f80040047c0 2023-12-22T08:40:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.281+0000 7f8017fff640 1 -- 172.21.15.38:0/1407633377 reap_dead start 2023-12-22T08:40:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.282+0000 7f8016ffd640 1 --2- 172.21.15.38:0/1407633377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80040047c0 0x7f8004004c40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8000003db0 tx=0x7f80040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bcdb5664d71bf3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.282+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8000032600 con 0x7f80040047c0 2023-12-22T08:40:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.282+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800002e050 con 0x7f80040047c0 2023-12-22T08:40:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.282+0000 7f80167fc640 1 -- 172.21.15.38:0/1407633377 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80000329e0 con 0x7f80040047c0 2023-12-22T08:40:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.283+0000 7f801de31640 1 -- 172.21.15.38:0/1407633377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80040047c0 msgr2=0x7f8004004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.283+0000 7f801de31640 1 --2- 172.21.15.38:0/1407633377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80040047c0 0x7f8004004c40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8000003db0 tx=0x7f80040057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.283+0000 7f801de31640 1 -- 172.21.15.38:0/1407633377 shutdown_connections 2023-12-22T08:40:55.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.283+0000 7f801de31640 1 --2- 172.21.15.38:0/1407633377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80040047c0 0x7f8004004c40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.283+0000 7f801de31640 1 -- 172.21.15.38:0/1407633377 >> 172.21.15.38:0/1407633377 conn(0x7f801806f250 msgr2=0x7f801806f630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:55.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.283+0000 7f801de31640 1 -- 172.21.15.38:0/1407633377 shutdown_connections 2023-12-22T08:40:55.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.283+0000 7f801de31640 1 -- 172.21.15.38:0/1407633377 wait complete. 2023-12-22T08:40:55.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.285+0000 7f801de31640 1 Processor -- start 2023-12-22T08:40:55.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.285+0000 7f801de31640 1 -- start start 2023-12-22T08:40:55.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.286+0000 7f801de31640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80040047c0 0x7f80180ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.286+0000 7f801de31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8018157fc0 0x7f8018158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.286+0000 7f801de31640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80180b13f0 0x7f80180b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.286+0000 7f801de31640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801815d930 con 0x7f80040047c0 2023-12-22T08:40:55.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.286+0000 7f801de31640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8018158980 con 0x7f8018157fc0 2023-12-22T08:40:55.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.286+0000 7f801de31640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80180b20e0 con 0x7f80180b13f0 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.286+0000 7f80177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80040047c0 0x7f80180ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.286+0000 7f80177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80040047c0 0x7f80180ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46790/0 (socket says 172.21.15.38:46790) 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.286+0000 7f80177fe640 1 -- 172.21.15.38:0/1727681645 learned_addr learned my addr 172.21.15.38:0/1727681645 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.287+0000 7f8016ffd640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8018157fc0 0x7f8018158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.287+0000 7f8017fff640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80180b13f0 0x7f80180b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.287+0000 7f80177fe640 1 -- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80180b13f0 msgr2=0x7f80180b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.287+0000 7f80177fe640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80180b13f0 0x7f80180b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.287+0000 7f80177fe640 1 -- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8018157fc0 msgr2=0x7f8018158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.287+0000 7f80177fe640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8018157fc0 0x7f8018158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.287+0000 7f80177fe640 1 -- 172.21.15.38:0/1727681645 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80180b23c0 con 0x7f80040047c0 2023-12-22T08:40:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.287+0000 7f80177fe640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80040047c0 0x7f80180ad540 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f800800c730 tx=0x7f800800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.287+0000 7f800ffff640 1 -- 172.21.15.38:0/1727681645 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80080072d0 con 0x7f80040047c0 2023-12-22T08:40:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.287+0000 7f800ffff640 1 -- 172.21.15.38:0/1727681645 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8008007430 con 0x7f80040047c0 2023-12-22T08:40:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.288+0000 7f800ffff640 1 -- 172.21.15.38:0/1727681645 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80080047e0 con 0x7f80040047c0 2023-12-22T08:40:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.288+0000 7f801de31640 1 -- 172.21.15.38:0/1727681645 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801815dbd0 con 0x7f80040047c0 2023-12-22T08:40:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.288+0000 7f801de31640 1 -- 172.21.15.38:0/1727681645 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80180b1db0 con 0x7f80040047c0 2023-12-22T08:40:55.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.289+0000 7f801de31640 1 -- 172.21.15.38:0/1727681645 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801815ddc0 con 0x7f80040047c0 2023-12-22T08:40:55.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.290+0000 7f800ffff640 1 -- 172.21.15.38:0/1727681645 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8008004b50 con 0x7f80040047c0 2023-12-22T08:40:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.291+0000 7f800ffff640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7ff806a430 0x7f7ff806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.291+0000 7f800ffff640 1 -- 172.21.15.38:0/1727681645 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8008087fc0 con 0x7f80040047c0 2023-12-22T08:40:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.291+0000 7f8016ffd640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7ff806a430 0x7f7ff806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.292+0000 7f8016ffd640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7ff806a430 0x7f7ff806c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8000034000 tx=0x7f8000009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.295+0000 7f800ffff640 1 -- 172.21.15.38:0/1727681645 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8008053580 con 0x7f80040047c0 2023-12-22T08:40:55.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.487+0000 7f801de31640 1 -- 172.21.15.38:0/1727681645 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8018061910 con 0x7f80040047c0 2023-12-22T08:40:55.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.487+0000 7f800ffff640 1 -- 172.21.15.38:0/1727681645 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80080180a0 con 0x7f80040047c0 2023-12-22T08:40:55.490 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:40:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.490+0000 7f801de31640 1 -- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7ff806a430 msgr2=0x7f7ff806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.490+0000 7f801de31640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7ff806a430 0x7f7ff806c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8000034000 tx=0x7f8000009030 comp rx=0 tx=0).stop 2023-12-22T08:40:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.490+0000 7f801de31640 1 -- 172.21.15.38:0/1727681645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80040047c0 msgr2=0x7f80180ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.490+0000 7f801de31640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80040047c0 0x7f80180ad540 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f800800c730 tx=0x7f800800cbf0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.490+0000 7f801de31640 1 -- 172.21.15.38:0/1727681645 shutdown_connections 2023-12-22T08:40:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.490+0000 7f801de31640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80180b13f0 0x7f80180b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.490+0000 7f801de31640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8018157fc0 0x7f8018158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.490+0000 7f801de31640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7ff806a430 0x7f7ff806c8f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.490+0000 7f801de31640 1 --2- 172.21.15.38:0/1727681645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80040047c0 0x7f80180ad540 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.490+0000 7f801de31640 1 -- 172.21.15.38:0/1727681645 >> 172.21.15.38:0/1727681645 conn(0x7f801806f250 msgr2=0x7f80180b8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.490+0000 7f801de31640 1 -- 172.21.15.38:0/1727681645 shutdown_connections 2023-12-22T08:40:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.490+0000 7f801de31640 1 -- 172.21.15.38:0/1727681645 wait complete. 2023-12-22T08:40:55.512 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.733+0000 7f405dea1640 1 Processor -- start 2023-12-22T08:40:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.733+0000 7f405dea1640 1 -- start start 2023-12-22T08:40:55.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.735+0000 7f405dea1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f405815e740 0x7f405815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.735+0000 7f405dea1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f40580b3f90 0x7f4058070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.735+0000 7f405dea1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405815eb20 con 0x7f405806ca50 2023-12-22T08:40:55.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.735+0000 7f405dea1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405806e650 con 0x7f40580b3f90 2023-12-22T08:40:55.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.735+0000 7f405dea1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4058070770 con 0x7f405815e740 2023-12-22T08:40:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.736+0000 7f4057fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f40580b3f90 0x7f4058070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.736+0000 7f4057fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f40580b3f90 0x7f4058070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:40312/0 (socket says 172.21.15.38:40312) 2023-12-22T08:40:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.736+0000 7f4057fff640 1 -- 172.21.15.38:0/562899065 learned_addr learned my addr 172.21.15.38:0/562899065 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.736+0000 7f40577fe640 1 --2- 172.21.15.38:0/562899065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f405815e740 0x7f405815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.737+0000 7f4057fff640 1 -- 172.21.15.38:0/562899065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f405815e740 msgr2=0x7f405815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.737+0000 7f4057fff640 1 --2- 172.21.15.38:0/562899065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f405815e740 0x7f405815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.737+0000 7f4057fff640 1 -- 172.21.15.38:0/562899065 >> v1:172.21.15.89:6789/0 conn(0x7f405806ca50 legacy=0x7f40580b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.737+0000 7f4057fff640 1 -- 172.21.15.38:0/562899065 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405806d180 con 0x7f40580b3f90 2023-12-22T08:40:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.738+0000 7f4057fff640 1 --2- 172.21.15.38:0/562899065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40580b3f90 0x7f4058070c00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4050009e50 tx=0x7f405002be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=198e771b4a21dc51 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.739+0000 7f4056ffd640 1 -- 172.21.15.38:0/562899065 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405002c9f0 con 0x7f40580b3f90 2023-12-22T08:40:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.739+0000 7f4056ffd640 1 -- 172.21.15.38:0/562899065 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405002cb50 con 0x7f40580b3f90 2023-12-22T08:40:55.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.739+0000 7f4056ffd640 1 -- 172.21.15.38:0/562899065 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40500343f0 con 0x7f40580b3f90 2023-12-22T08:40:55.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.739+0000 7f405dea1640 1 -- 172.21.15.38:0/562899065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40580b3f90 msgr2=0x7f4058070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.739+0000 7f405dea1640 1 --2- 172.21.15.38:0/562899065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40580b3f90 0x7f4058070c00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4050009e50 tx=0x7f405002be50 comp rx=0 tx=0).stop 2023-12-22T08:40:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.740+0000 7f405dea1640 1 -- 172.21.15.38:0/562899065 shutdown_connections 2023-12-22T08:40:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.740+0000 7f405dea1640 1 --2- 172.21.15.38:0/562899065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40580b3f90 0x7f4058070c00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.740+0000 7f405dea1640 1 --2- 172.21.15.38:0/562899065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f405815e740 0x7f405815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.740+0000 7f405dea1640 1 -- 172.21.15.38:0/562899065 >> 172.21.15.38:0/562899065 conn(0x7f40580cfea0 msgr2=0x7f40580d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.740+0000 7f405dea1640 1 -- 172.21.15.38:0/562899065 shutdown_connections 2023-12-22T08:40:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.740+0000 7f405dea1640 1 -- 172.21.15.38:0/562899065 wait complete. 2023-12-22T08:40:55.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.741+0000 7f405dea1640 1 Processor -- start 2023-12-22T08:40:55.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.742+0000 7f405dea1640 1 -- start start 2023-12-22T08:40:55.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.743+0000 7f405dea1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f405806ca50 0x7f4058147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.743+0000 7f405dea1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40580b3f90 0x7f40581566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.743+0000 7f405dea1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405815e740 0x7f4058156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.743+0000 7f405dea1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4058158a50 con 0x7f405815e740 2023-12-22T08:40:55.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.743+0000 7f405dea1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40580b68c0 con 0x7f40580b3f90 2023-12-22T08:40:55.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.743+0000 7f405dea1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40580b6ba0 con 0x7f405806ca50 2023-12-22T08:40:55.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.743+0000 7f4057fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405815e740 0x7f4058156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.743+0000 7f4057fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405815e740 0x7f4058156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46802/0 (socket says 172.21.15.38:46802) 2023-12-22T08:40:55.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.743+0000 7f4057fff640 1 -- 172.21.15.38:0/1753537934 learned_addr learned my addr 172.21.15.38:0/1753537934 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:55.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.743+0000 7f404ffff640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40580b3f90 0x7f40581566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.743+0000 7f40577fe640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f405806ca50 0x7f4058147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.744+0000 7f4057fff640 1 -- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f405806ca50 msgr2=0x7f4058147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.744+0000 7f4057fff640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f405806ca50 0x7f4058147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.744+0000 7f4057fff640 1 -- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40580b3f90 msgr2=0x7f40581566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.744+0000 7f4057fff640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40580b3f90 0x7f40581566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.744+0000 7f4057fff640 1 -- 172.21.15.38:0/1753537934 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4050009b30 con 0x7f405815e740 2023-12-22T08:40:55.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.744+0000 7f4057fff640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405815e740 0x7f4058156c20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4050009e50 tx=0x7f4050004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.744+0000 7f4054ff9640 1 -- 172.21.15.38:0/1753537934 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405003e450 con 0x7f405815e740 2023-12-22T08:40:55.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.745+0000 7f4054ff9640 1 -- 172.21.15.38:0/1753537934 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405003e5f0 con 0x7f405815e740 2023-12-22T08:40:55.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.745+0000 7f4054ff9640 1 -- 172.21.15.38:0/1753537934 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405003e9a0 con 0x7f405815e740 2023-12-22T08:40:55.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.745+0000 7f405dea1640 1 -- 172.21.15.38:0/1753537934 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40580b6e80 con 0x7f405815e740 2023-12-22T08:40:55.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.745+0000 7f405dea1640 1 -- 172.21.15.38:0/1753537934 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4058148410 con 0x7f405815e740 2023-12-22T08:40:55.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.746+0000 7f405dea1640 1 -- 172.21.15.38:0/1753537934 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4058158bc0 con 0x7f405815e740 2023-12-22T08:40:55.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.747+0000 7f4054ff9640 1 -- 172.21.15.38:0/1753537934 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f405003eb00 con 0x7f405815e740 2023-12-22T08:40:55.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.748+0000 7f4054ff9640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f403806a430 0x7f403806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.748+0000 7f4054ff9640 1 -- 172.21.15.38:0/1753537934 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f40500ab6b0 con 0x7f405815e740 2023-12-22T08:40:55.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.749+0000 7f40577fe640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f403806a430 0x7f403806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.750+0000 7f40577fe640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f403806a430 0x7f403806c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4048009aa0 tx=0x7f4048009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.752+0000 7f4054ff9640 1 -- 172.21.15.38:0/1753537934 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4050076c70 con 0x7f405815e740 2023-12-22T08:40:55.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.947+0000 7f405dea1640 1 -- 172.21.15.38:0/1753537934 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4058061910 con 0x7f405815e740 2023-12-22T08:40:55.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.948+0000 7f4054ff9640 1 -- 172.21.15.38:0/1753537934 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f405007a290 con 0x7f405815e740 2023-12-22T08:40:55.951 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:40:55.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.950+0000 7f405dea1640 1 -- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f403806a430 msgr2=0x7f403806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.950+0000 7f405dea1640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f403806a430 0x7f403806c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4048009aa0 tx=0x7f4048009190 comp rx=0 tx=0).stop 2023-12-22T08:40:55.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.950+0000 7f405dea1640 1 -- 172.21.15.38:0/1753537934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405815e740 msgr2=0x7f4058156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.950+0000 7f405dea1640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405815e740 0x7f4058156c20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4050009e50 tx=0x7f4050004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.950+0000 7f405dea1640 1 -- 172.21.15.38:0/1753537934 shutdown_connections 2023-12-22T08:40:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.950+0000 7f405dea1640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f403806a430 0x7f403806c8f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.950+0000 7f405dea1640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405815e740 0x7f4058156c20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.950+0000 7f405dea1640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40580b3f90 0x7f40581566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.950+0000 7f405dea1640 1 --2- 172.21.15.38:0/1753537934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f405806ca50 0x7f4058147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.950+0000 7f405dea1640 1 -- 172.21.15.38:0/1753537934 >> 172.21.15.38:0/1753537934 conn(0x7f40580cfea0 msgr2=0x7f4058153ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.951+0000 7f405dea1640 1 -- 172.21.15.38:0/1753537934 shutdown_connections 2023-12-22T08:40:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:55.951+0000 7f405dea1640 1 -- 172.21.15.38:0/1753537934 wait complete. 2023-12-22T08:40:55.971 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:56.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.187+0000 7f5b41695640 1 Processor -- start 2023-12-22T08:40:56.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.187+0000 7f5b41695640 1 -- start start 2023-12-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.188+0000 7f5b41695640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5b3c070b70 0x7f5b3c06bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.189+0000 7f5b41695640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c06d5f0 con 0x7f5b3c071660 2023-12-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.189+0000 7f5b41695640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c144fa0 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.189+0000 7f5b41695640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3c06da80 con 0x7f5b3c070b70 2023-12-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.189+0000 7f5b3bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5b3c070b70 0x7f5b3c06bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.189+0000 7f5b40e94640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5b3c071660 0x7f5b3c164d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51062/0 (socket says 172.21.15.38:51062) 2023-12-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.189+0000 7f5b40e94640 1 -- 172.21.15.38:0/3291243063 learned_addr learned my addr 172.21.15.38:0/3291243063 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.189+0000 7f5b3bfff640 1 -- 172.21.15.38:0/3291243063 >> v1:172.21.15.89:6789/0 conn(0x7f5b3c06c4d0 legacy=0x7f5b3c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.189+0000 7f5b3bfff640 1 -- 172.21.15.38:0/3291243063 >> v1:172.21.15.38:6789/0 conn(0x7f5b3c071660 legacy=0x7f5b3c164d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.189+0000 7f5b3bfff640 1 -- 172.21.15.38:0/3291243063 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c06c9e0 con 0x7f5b3c070b70 2023-12-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.191+0000 7f5b3bfff640 1 --2- 172.21.15.38:0/3291243063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b3c070b70 0x7f5b3c06bf90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009d90 tx=0x7f5b2c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528e78b6c4f97c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.191+0000 7f5b3affd640 1 -- 172.21.15.38:0/3291243063 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c02cc60 con 0x7f5b3c070b70 2023-12-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.191+0000 7f5b3affd640 1 -- 172.21.15.38:0/3291243063 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c02cdc0 con 0x7f5b3c070b70 2023-12-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.191+0000 7f5b3affd640 1 -- 172.21.15.38:0/3291243063 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c034660 con 0x7f5b3c070b70 2023-12-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.192+0000 7f5b41695640 1 -- 172.21.15.38:0/3291243063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b3c070b70 msgr2=0x7f5b3c06bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.192+0000 7f5b41695640 1 --2- 172.21.15.38:0/3291243063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b3c070b70 0x7f5b3c06bf90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009d90 tx=0x7f5b2c02beb0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.192+0000 7f5b41695640 1 -- 172.21.15.38:0/3291243063 shutdown_connections 2023-12-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.192+0000 7f5b41695640 1 --2- 172.21.15.38:0/3291243063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b3c070b70 0x7f5b3c06bf90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.192+0000 7f5b41695640 1 -- 172.21.15.38:0/3291243063 >> 172.21.15.38:0/3291243063 conn(0x7f5b3c0b0b60 msgr2=0x7f5b3c0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.192+0000 7f5b41695640 1 -- 172.21.15.38:0/3291243063 shutdown_connections 2023-12-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.192+0000 7f5b41695640 1 -- 172.21.15.38:0/3291243063 wait complete. 2023-12-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.194+0000 7f5b41695640 1 Processor -- start 2023-12-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.194+0000 7f5b41695640 1 -- start start 2023-12-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.195+0000 7f5b41695640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b3c06c4d0 0x7f5b3c13f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.195+0000 7f5b41695640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c070b70 0x7f5b3c0afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.195+0000 7f5b41695640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b3c071660 0x7f5b3c0b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.195+0000 7f5b41695640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c13f810 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.195+0000 7f5b41695640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0ca600 con 0x7f5b3c071660 2023-12-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.195+0000 7f5b41695640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0ca8e0 con 0x7f5b3c070b70 2023-12-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.195+0000 7f5b3bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b3c06c4d0 0x7f5b3c13f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.195+0000 7f5b3bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b3c06c4d0 0x7f5b3c13f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46820/0 (socket says 172.21.15.38:46820) 2023-12-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.195+0000 7f5b3bfff640 1 -- 172.21.15.38:0/4237026423 learned_addr learned my addr 172.21.15.38:0/4237026423 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.195+0000 7f5b3bfff640 1 -- 172.21.15.38:0/4237026423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c070b70 msgr2=0x7f5b3c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.195+0000 7f5b3bfff640 1 --2- 172.21.15.38:0/4237026423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c070b70 0x7f5b3c0afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.195+0000 7f5b40e94640 1 --2- 172.21.15.38:0/4237026423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b3c071660 0x7f5b3c0b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.195+0000 7f5b3bfff640 1 -- 172.21.15.38:0/4237026423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b3c071660 msgr2=0x7f5b3c0b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.196+0000 7f5b3bfff640 1 --2- 172.21.15.38:0/4237026423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b3c071660 0x7f5b3c0b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.196+0000 7f5b3bfff640 1 -- 172.21.15.38:0/4237026423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c009a70 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.196+0000 7f5b3bfff640 1 --2- 172.21.15.38:0/4237026423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b3c06c4d0 0x7f5b3c13f2d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c037040 tx=0x7f5b2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.196+0000 7f5b38ff9640 1 -- 172.21.15.38:0/4237026423 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c03e610 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.196+0000 7f5b38ff9640 1 -- 172.21.15.38:0/4237026423 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c03e770 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.196+0000 7f5b38ff9640 1 -- 172.21.15.38:0/4237026423 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c03eb20 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.196+0000 7f5b41695640 1 -- 172.21.15.38:0/4237026423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c0cabc0 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.196+0000 7f5b41695640 1 -- 172.21.15.38:0/4237026423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c0cb180 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.197+0000 7f5b41695640 1 -- 172.21.15.38:0/4237026423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c0c6480 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.198+0000 7f5b38ff9640 1 -- 172.21.15.38:0/4237026423 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5b2c03b050 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.199+0000 7f5b38ff9640 1 --2- 172.21.15.38:0/4237026423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b2806a430 0x7f5b2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.199+0000 7f5b38ff9640 1 -- 172.21.15.38:0/4237026423 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5b2c0ab400 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.200+0000 7f5b3b7fe640 1 --2- 172.21.15.38:0/4237026423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b2806a430 0x7f5b2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.201+0000 7f5b3b7fe640 1 --2- 172.21.15.38:0/4237026423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b2806a430 0x7f5b2806c8f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c144440 tx=0x7f5b300079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.204+0000 7f5b38ff9640 1 -- 172.21.15.38:0/4237026423 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5b3c0c6480 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.399+0000 7f5b41695640 1 -- 172.21.15.38:0/4237026423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b3c0c6480 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.400+0000 7f5b38ff9640 1 -- 172.21.15.38:0/4237026423 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b2c039020 con 0x7f5b3c06c4d0 2023-12-22T08:40:56.403 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:40:56.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.403+0000 7f5b41695640 1 -- 172.21.15.38:0/4237026423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b2806a430 msgr2=0x7f5b2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.403+0000 7f5b41695640 1 --2- 172.21.15.38:0/4237026423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b2806a430 0x7f5b2806c8f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c144440 tx=0x7f5b300079b0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.403+0000 7f5b41695640 1 -- 172.21.15.38:0/4237026423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b3c06c4d0 msgr2=0x7f5b3c13f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.403+0000 7f5b41695640 1 --2- 172.21.15.38:0/4237026423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b3c06c4d0 0x7f5b3c13f2d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c037040 tx=0x7f5b2c004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:56.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.403+0000 7f5b41695640 1 -- 172.21.15.38:0/4237026423 shutdown_connections 2023-12-22T08:40:56.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.403+0000 7f5b41695640 1 --2- 172.21.15.38:0/4237026423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b3c071660 0x7f5b3c0b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.403+0000 7f5b41695640 1 --2- 172.21.15.38:0/4237026423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b3c070b70 0x7f5b3c0afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.403+0000 7f5b41695640 1 --2- 172.21.15.38:0/4237026423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b2806a430 0x7f5b2806c8f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.403+0000 7f5b41695640 1 --2- 172.21.15.38:0/4237026423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b3c06c4d0 0x7f5b3c13f2d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.403+0000 7f5b41695640 1 -- 172.21.15.38:0/4237026423 >> 172.21.15.38:0/4237026423 conn(0x7f5b3c0b0b60 msgr2=0x7f5b3c0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.403+0000 7f5b41695640 1 -- 172.21.15.38:0/4237026423 shutdown_connections 2023-12-22T08:40:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.403+0000 7f5b41695640 1 -- 172.21.15.38:0/4237026423 wait complete. 2023-12-22T08:40:56.426 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:40:56.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.650+0000 7f80ee1ea640 1 Processor -- start 2023-12-22T08:40:56.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.650+0000 7f80ee1ea640 1 -- start start 2023-12-22T08:40:56.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.652+0000 7f80ee1ea640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80e80cb5e0 0x7f80e815d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.652+0000 7f80ee1ea640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e815e630 con 0x7f80e8161bb0 2023-12-22T08:40:56.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.652+0000 7f80ee1ea640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e81610d0 con 0x7f80e815ad90 2023-12-22T08:40:56.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.652+0000 7f80ee1ea640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e80ce2c0 con 0x7f80e80cb5e0 2023-12-22T08:40:56.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.652+0000 7f80ed9e9640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f80e8161bb0 0x7f80e815de80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51068/0 (socket says 172.21.15.38:51068) 2023-12-22T08:40:56.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.652+0000 7f80ed9e9640 1 -- 172.21.15.38:0/624268721 learned_addr learned my addr 172.21.15.38:0/624268721 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:56.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.652+0000 7f80ec9e7640 1 --2- 172.21.15.38:0/624268721 >> v2:172.21.15.89:3300/0 conn(0x7f80e80cb5e0 0x7f80e815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699637139 0 0) 0x7f80e815e630 con 0x7f80e8161bb0 2023-12-22T08:40:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80d0003520 con 0x7f80e8161bb0 2023-12-22T08:40:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2003348889 0 0) 0x7f80d0003520 con 0x7f80e8161bb0 2023-12-22T08:40:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 >> v2:172.21.15.89:3300/0 conn(0x7f80e80cb5e0 msgr2=0x7f80e815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 --2- 172.21.15.38:0/624268721 >> v2:172.21.15.89:3300/0 conn(0x7f80e80cb5e0 0x7f80e815d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 >> v1:172.21.15.89:6789/0 conn(0x7f80e815ad90 legacy=0x7f80e80caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e81613b0 con 0x7f80e8161bb0 2023-12-22T08:40:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f80e0001670 con 0x7f80e8161bb0 2023-12-22T08:40:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 >> v1:172.21.15.38:6789/0 conn(0x7f80e8161bb0 legacy=0x7f80e815de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 --2- 172.21.15.38:0/624268721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80d0003970 0x7f80d0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 --2- 172.21.15.38:0/624268721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80d0004370 0x7f80d0004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 --2- 172.21.15.38:0/624268721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80d0005040 0x7f80d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d000bf70 con 0x7f80d0004370 2023-12-22T08:40:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d000c0e0 con 0x7f80d0005040 2023-12-22T08:40:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.653+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d000c2a0 con 0x7f80d0003970 2023-12-22T08:40:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.654+0000 7f80ec9e7640 1 --2- 172.21.15.38:0/624268721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80d0004370 0x7f80d0004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.654+0000 7f80ed1e8640 1 --2- 172.21.15.38:0/624268721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80d0003970 0x7f80d0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.654+0000 7f80ec9e7640 1 -- 172.21.15.38:0/624268721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80d0003970 msgr2=0x7f80d0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:56.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.654+0000 7f80ed9e9640 1 --2- 172.21.15.38:0/624268721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80d0005040 0x7f80d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.654+0000 7f80ec9e7640 1 --2- 172.21.15.38:0/624268721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80d0003970 0x7f80d0003d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.654+0000 7f80ec9e7640 1 -- 172.21.15.38:0/624268721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80d0005040 msgr2=0x7f80d000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:56.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.654+0000 7f80ec9e7640 1 --2- 172.21.15.38:0/624268721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80d0005040 0x7f80d000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.654+0000 7f80ec9e7640 1 -- 172.21.15.38:0/624268721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0003520 con 0x7f80d0004370 2023-12-22T08:40:56.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.654+0000 7f80ed9e9640 1 --2- 172.21.15.38:0/624268721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80d0005040 0x7f80d000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:56.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.654+0000 7f80ed9e9640 1 -- 172.21.15.38:0/624268721 reap_dead start 2023-12-22T08:40:56.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.655+0000 7f80ec9e7640 1 --2- 172.21.15.38:0/624268721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80d0004370 0x7f80d0004840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009ac0 tx=0x7f80d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bbb529fdf83ec8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.656+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc02c6b0 con 0x7f80d0004370 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.656+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc02c810 con 0x7f80d0004370 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.656+0000 7f80e7fff640 1 -- 172.21.15.38:0/624268721 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc02cba0 con 0x7f80d0004370 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.656+0000 7f80ee1ea640 1 -- 172.21.15.38:0/624268721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80d0004370 msgr2=0x7f80d0004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.656+0000 7f80ee1ea640 1 --2- 172.21.15.38:0/624268721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80d0004370 0x7f80d0004840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009ac0 tx=0x7f80d00057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.656+0000 7f80ee1ea640 1 -- 172.21.15.38:0/624268721 shutdown_connections 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.656+0000 7f80ee1ea640 1 --2- 172.21.15.38:0/624268721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80d0004370 0x7f80d0004840 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.656+0000 7f80ee1ea640 1 -- 172.21.15.38:0/624268721 >> 172.21.15.38:0/624268721 conn(0x7f80e80d31c0 msgr2=0x7f80e80d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.656+0000 7f80ee1ea640 1 -- 172.21.15.38:0/624268721 shutdown_connections 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.656+0000 7f80ee1ea640 1 -- 172.21.15.38:0/624268721 wait complete. 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.658+0000 7f80ee1ea640 1 Processor -- start 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.658+0000 7f80ee1ea640 1 -- start start 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.659+0000 7f80ee1ea640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80d0004370 0x7f80e8156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.659+0000 7f80ee1ea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80e80c8a20 0x7f80e81573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.659+0000 7f80ee1ea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e80c8e80 0x7f80e81578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.659+0000 7f80ee1ea640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80c7fb0 con 0x7f80e80c8a20 2023-12-22T08:40:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.659+0000 7f80ee1ea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e81563c0 con 0x7f80e80c8e80 2023-12-22T08:40:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.659+0000 7f80ee1ea640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8157f10 con 0x7f80d0004370 2023-12-22T08:40:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.660+0000 7f80ec9e7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80e80c8a20 0x7f80e81573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.660+0000 7f80ec9e7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80e80c8a20 0x7f80e81573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46840/0 (socket says 172.21.15.38:46840) 2023-12-22T08:40:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.660+0000 7f80ec9e7640 1 -- 172.21.15.38:0/2769093615 learned_addr learned my addr 172.21.15.38:0/2769093615 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.660+0000 7f80ec9e7640 1 -- 172.21.15.38:0/2769093615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80d0004370 msgr2=0x7f80e8156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.660+0000 7f80ec9e7640 1 --2- 172.21.15.38:0/2769093615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80d0004370 0x7f80e8156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.660+0000 7f80ec9e7640 1 -- 172.21.15.38:0/2769093615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e80c8e80 msgr2=0x7f80e81578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.660+0000 7f80ec9e7640 1 --2- 172.21.15.38:0/2769093615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e80c8e80 0x7f80e81578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.660+0000 7f80ec9e7640 1 -- 172.21.15.38:0/2769093615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80c8220 con 0x7f80e80c8a20 2023-12-22T08:40:56.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.660+0000 7f80ec9e7640 1 --2- 172.21.15.38:0/2769093615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80e80c8a20 0x7f80e81573a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f80dc02c250 tx=0x7f80dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.661+0000 7f80e5ffb640 1 -- 172.21.15.38:0/2769093615 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc003810 con 0x7f80e80c8a20 2023-12-22T08:40:56.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.661+0000 7f80e5ffb640 1 -- 172.21.15.38:0/2769093615 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc003970 con 0x7f80e80c8a20 2023-12-22T08:40:56.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.661+0000 7f80ee1ea640 1 -- 172.21.15.38:0/2769093615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e80c8500 con 0x7f80e80c8a20 2023-12-22T08:40:56.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.661+0000 7f80e5ffb640 1 -- 172.21.15.38:0/2769093615 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc003d00 con 0x7f80e80c8a20 2023-12-22T08:40:56.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.661+0000 7f80ee1ea640 1 -- 172.21.15.38:0/2769093615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e81581f0 con 0x7f80e80c8a20 2023-12-22T08:40:56.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.662+0000 7f80ee1ea640 1 -- 172.21.15.38:0/2769093615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e80c7f10 con 0x7f80e80c8a20 2023-12-22T08:40:56.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.663+0000 7f80e5ffb640 1 -- 172.21.15.38:0/2769093615 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f80dc047450 con 0x7f80e80c8a20 2023-12-22T08:40:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.665+0000 7f80e5ffb640 1 --2- 172.21.15.38:0/2769093615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80d406a430 0x7f80d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.665+0000 7f80e5ffb640 1 -- 172.21.15.38:0/2769093615 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f80dc0aadc0 con 0x7f80e80c8a20 2023-12-22T08:40:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.665+0000 7f80ed1e8640 1 --2- 172.21.15.38:0/2769093615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80d406a430 0x7f80d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.666+0000 7f80ed1e8640 1 --2- 172.21.15.38:0/2769093615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80d406a430 0x7f80d406c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f80d8001d50 tx=0x7f80d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.669+0000 7f80e5ffb640 1 -- 172.21.15.38:0/2769093615 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f80dc0762f0 con 0x7f80e80c8a20 2023-12-22T08:40:56.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.865+0000 7f80ee1ea640 1 -- 172.21.15.38:0/2769093615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f80e8061910 con 0x7f80e80c8a20 2023-12-22T08:40:56.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.866+0000 7f80e5ffb640 1 -- 172.21.15.38:0/2769093615 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f80dc003e60 con 0x7f80e80c8a20 2023-12-22T08:40:56.869 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:40:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.868+0000 7f80ee1ea640 1 -- 172.21.15.38:0/2769093615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80d406a430 msgr2=0x7f80d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.868+0000 7f80ee1ea640 1 --2- 172.21.15.38:0/2769093615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80d406a430 0x7f80d406c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f80d8001d50 tx=0x7f80d8009040 comp rx=0 tx=0).stop 2023-12-22T08:40:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.868+0000 7f80ee1ea640 1 -- 172.21.15.38:0/2769093615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80e80c8a20 msgr2=0x7f80e81573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.868+0000 7f80ee1ea640 1 --2- 172.21.15.38:0/2769093615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80e80c8a20 0x7f80e81573a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f80dc02c250 tx=0x7f80dc004730 comp rx=0 tx=0).stop 2023-12-22T08:40:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.868+0000 7f80ee1ea640 1 -- 172.21.15.38:0/2769093615 shutdown_connections 2023-12-22T08:40:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.868+0000 7f80ee1ea640 1 --2- 172.21.15.38:0/2769093615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80e80c8e80 0x7f80e81578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.868+0000 7f80ee1ea640 1 --2- 172.21.15.38:0/2769093615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80d406a430 0x7f80d406c8f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.868+0000 7f80ee1ea640 1 --2- 172.21.15.38:0/2769093615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80e80c8a20 0x7f80e81573a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.868+0000 7f80ee1ea640 1 --2- 172.21.15.38:0/2769093615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80d0004370 0x7f80e8156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.868+0000 7f80ee1ea640 1 -- 172.21.15.38:0/2769093615 >> 172.21.15.38:0/2769093615 conn(0x7f80e80d31c0 msgr2=0x7f80e815d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.868+0000 7f80ee1ea640 1 -- 172.21.15.38:0/2769093615 shutdown_connections 2023-12-22T08:40:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:56.868+0000 7f80ee1ea640 1 -- 172.21.15.38:0/2769093615 wait complete. 2023-12-22T08:40:56.887 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-12-22T08:40:56.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:56.888 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-12-22T08:40:56.997 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:40:56.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:56.997 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-22T08:40:57.052 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-22T08:40:57.052 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:40:57.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.281+0000 7f42aed00640 1 Processor -- start 2023-12-22T08:40:57.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.281+0000 7f42aed00640 1 -- start start 2023-12-22T08:40:57.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.283+0000 7f42aed00640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42a80d1240 0x7f42a80b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.283+0000 7f42aed00640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a80b5c80 con 0x7f42a80d1620 2023-12-22T08:40:57.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.283+0000 7f42aed00640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a80d0760 con 0x7f42a80b3b40 2023-12-22T08:40:57.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.283+0000 7f42aed00640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80d01a0 con 0x7f42a80d1240 2023-12-22T08:40:57.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.283+0000 7f42ad29d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f42a80d1620 0x7f42a80b6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51072/0 (socket says 172.21.15.38:51072) 2023-12-22T08:40:57.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.283+0000 7f42ad29d640 1 -- 172.21.15.38:0/3870500564 learned_addr learned my addr 172.21.15.38:0/3870500564 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:57.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.283+0000 7f42aca9c640 1 --2- 172.21.15.38:0/3870500564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42a80d1240 0x7f42a80b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514481539 0 0) 0x7f42a80b5c80 con 0x7f42a80d1620 2023-12-22T08:40:57.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4290003520 con 0x7f42a80d1620 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2501235578 0 0) 0x7f4290003520 con 0x7f42a80d1620 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42a80d1240 msgr2=0x7f42a80b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 --2- 172.21.15.38:0/3870500564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42a80d1240 0x7f42a80b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 >> v1:172.21.15.89:6789/0 conn(0x7f42a80b3b40 legacy=0x7f42a80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a80d0480 con 0x7f42a80d1620 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f42a0001670 con 0x7f42a80d1620 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 >> v1:172.21.15.38:6789/0 conn(0x7f42a80d1620 legacy=0x7f42a80b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 --2- 172.21.15.38:0/3870500564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42a80d1240 0x7f42900039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 --2- 172.21.15.38:0/3870500564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4290003f20 0x7f42900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 --2- 172.21.15.38:0/3870500564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4290004d00 0x7f4290005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80d01a0 con 0x7f4290004d00 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429000ba60 con 0x7f4290003f20 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.284+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429000bc20 con 0x7f42a80d1240 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.285+0000 7f42ad29d640 1 --2- 172.21.15.38:0/3870500564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4290004d00 0x7f4290005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.285+0000 7f42aca9c640 1 --2- 172.21.15.38:0/3870500564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42a80d1240 0x7f42900039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.285+0000 7f42a7fff640 1 --2- 172.21.15.38:0/3870500564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4290003f20 0x7f42900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.285+0000 7f42ad29d640 1 -- 172.21.15.38:0/3870500564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42a80d1240 msgr2=0x7f42900039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:57.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.285+0000 7f42ad29d640 1 --2- 172.21.15.38:0/3870500564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42a80d1240 0x7f42900039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.285+0000 7f42ad29d640 1 -- 172.21.15.38:0/3870500564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4290003f20 msgr2=0x7f42900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:57.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.285+0000 7f42ad29d640 1 --2- 172.21.15.38:0/3870500564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4290003f20 0x7f42900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.285+0000 7f42ad29d640 1 -- 172.21.15.38:0/3870500564 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4290003520 con 0x7f4290004d00 2023-12-22T08:40:57.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.286+0000 7f42ad29d640 1 --2- 172.21.15.38:0/3870500564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4290004d00 0x7f4290005180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c240 tx=0x7f42900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26e2f0a75eebcc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.286+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a0005ad0 con 0x7f4290004d00 2023-12-22T08:40:57.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.287+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a0005c30 con 0x7f4290004d00 2023-12-22T08:40:57.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.287+0000 7f42a77fe640 1 -- 172.21.15.38:0/3870500564 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a002caf0 con 0x7f4290004d00 2023-12-22T08:40:57.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.287+0000 7f42aed00640 1 -- 172.21.15.38:0/3870500564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4290004d00 msgr2=0x7f4290005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.287+0000 7f42aed00640 1 --2- 172.21.15.38:0/3870500564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4290004d00 0x7f4290005180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c240 tx=0x7f42900057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.287+0000 7f42ad29d640 1 -- 172.21.15.38:0/3870500564 reap_dead start 2023-12-22T08:40:57.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.287+0000 7f42aed00640 1 -- 172.21.15.38:0/3870500564 shutdown_connections 2023-12-22T08:40:57.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.287+0000 7f42aed00640 1 -- 172.21.15.38:0/3870500564 >> 172.21.15.38:0/3870500564 conn(0x7f42a806c5e0 msgr2=0x7f42a806c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:57.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.287+0000 7f42aed00640 1 -- 172.21.15.38:0/3870500564 shutdown_connections 2023-12-22T08:40:57.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.287+0000 7f42aed00640 1 -- 172.21.15.38:0/3870500564 wait complete. 2023-12-22T08:40:57.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.289+0000 7f42aed00640 1 Processor -- start 2023-12-22T08:40:57.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.289+0000 7f42aed00640 1 -- start start 2023-12-22T08:40:57.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.290+0000 7f42aed00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4290004d00 0x7f42a815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.290+0000 7f42aed00640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42a81477a0 0x7f42a815b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.290+0000 7f42aed00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a8143a20 0x7f42a8143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.290+0000 7f42aed00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a81459a0 con 0x7f4290004d00 2023-12-22T08:40:57.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.290+0000 7f42aed00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a8144af0 con 0x7f42a8143a20 2023-12-22T08:40:57.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.290+0000 7f42aed00640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a8144d90 con 0x7f42a81477a0 2023-12-22T08:40:57.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.291+0000 7f42aca9c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4290004d00 0x7f42a815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.291+0000 7f42aca9c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4290004d00 0x7f42a815abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46862/0 (socket says 172.21.15.38:46862) 2023-12-22T08:40:57.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.291+0000 7f42aca9c640 1 -- 172.21.15.38:0/1347745007 learned_addr learned my addr 172.21.15.38:0/1347745007 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.291+0000 7f42ad29d640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a8143a20 0x7f42a8143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.291+0000 7f42a7fff640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42a81477a0 0x7f42a815b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.291+0000 7f42aca9c640 1 -- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42a81477a0 msgr2=0x7f42a815b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.291+0000 7f42aca9c640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42a81477a0 0x7f42a815b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.291+0000 7f42aca9c640 1 -- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a8143a20 msgr2=0x7f42a8143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.291+0000 7f42aca9c640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a8143a20 0x7f42a8143ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.291+0000 7f42aca9c640 1 -- 172.21.15.38:0/1347745007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a8145070 con 0x7f4290004d00 2023-12-22T08:40:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.291+0000 7f42aca9c640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4290004d00 0x7f42a815abf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4298007f30 tx=0x7f4298011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.292+0000 7f42a57fa640 1 -- 172.21.15.38:0/1347745007 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800e030 con 0x7f4290004d00 2023-12-22T08:40:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.292+0000 7f42a57fa640 1 -- 172.21.15.38:0/1347745007 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4298016470 con 0x7f4290004d00 2023-12-22T08:40:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.292+0000 7f42aed00640 1 -- 172.21.15.38:0/1347745007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a8145350 con 0x7f4290004d00 2023-12-22T08:40:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.292+0000 7f42a57fa640 1 -- 172.21.15.38:0/1347745007 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298016820 con 0x7f4290004d00 2023-12-22T08:40:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.292+0000 7f42aed00640 1 -- 172.21.15.38:0/1347745007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a8144410 con 0x7f4290004d00 2023-12-22T08:40:57.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.293+0000 7f42aed00640 1 -- 172.21.15.38:0/1347745007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a8144600 con 0x7f4290004d00 2023-12-22T08:40:57.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.294+0000 7f42a57fa640 1 -- 172.21.15.38:0/1347745007 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4298016980 con 0x7f4290004d00 2023-12-22T08:40:57.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.295+0000 7f42a57fa640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f429406a460 0x7f429406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.295+0000 7f42a57fa640 1 -- 172.21.15.38:0/1347745007 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f429800f070 con 0x7f4290004d00 2023-12-22T08:40:57.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.296+0000 7f42a7fff640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f429406a460 0x7f429406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.297+0000 7f42a7fff640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f429406a460 0x7f429406c920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f429c007fd0 tx=0x7f429c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.299+0000 7f42a57fa640 1 -- 172.21.15.38:0/1347745007 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4298054e40 con 0x7f4290004d00 2023-12-22T08:40:57.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.528+0000 7f42aed00640 1 -- 172.21.15.38:0/1347745007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42a8061910 con 0x7f4290004d00 2023-12-22T08:40:57.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.529+0000 7f42a57fa640 1 -- 172.21.15.38:0/1347745007 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4639 (secure 0 0 0) 0x7f4298058460 con 0x7f4290004d00 2023-12-22T08:40:57.532 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:57.532 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/444746330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":444746330},{"type":"v1","addr":"172.21.15.38:6833","nonce":444746330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/3918267418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":3918267418},{"type":"v1","addr":"172.21.15.38:6835","nonce":3918267418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2511997570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2511997570},{"type":"v1","addr":"172.21.15.89:6835","nonce":2511997570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:39:58.600709+0000","modified":"2023-12-22T08:40:02.076114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2902919630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2902919630},{"type":"v1","addr":"172.21.15.89:6837","nonce":2902919630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:40:57.532 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-12-22T08:40:57.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.532+0000 7f42aed00640 1 -- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f429406a460 msgr2=0x7f429406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.532+0000 7f42aed00640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f429406a460 0x7f429406c920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f429c007fd0 tx=0x7f429c009040 comp rx=0 tx=0).stop 2023-12-22T08:40:57.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.532+0000 7f42aed00640 1 -- 172.21.15.38:0/1347745007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4290004d00 msgr2=0x7f42a815abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.532+0000 7f42aed00640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4290004d00 0x7f42a815abf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4298007f30 tx=0x7f4298011660 comp rx=0 tx=0).stop 2023-12-22T08:40:57.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.532+0000 7f42aed00640 1 -- 172.21.15.38:0/1347745007 shutdown_connections 2023-12-22T08:40:57.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.532+0000 7f42aed00640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42a8143a20 0x7f42a8143ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.532+0000 7f42aed00640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42a81477a0 0x7f42a815b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.532+0000 7f42aed00640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f429406a460 0x7f429406c920 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.532+0000 7f42aed00640 1 --2- 172.21.15.38:0/1347745007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4290004d00 0x7f42a815abf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.532+0000 7f42aed00640 1 -- 172.21.15.38:0/1347745007 >> 172.21.15.38:0/1347745007 conn(0x7f42a806c5e0 msgr2=0x7f42a80ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:57.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.532+0000 7f42aed00640 1 -- 172.21.15.38:0/1347745007 shutdown_connections 2023-12-22T08:40:57.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.532+0000 7f42aed00640 1 -- 172.21.15.38:0/1347745007 wait complete. 2023-12-22T08:40:57.554 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:57.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.774+0000 7f2de9c4c640 1 Processor -- start 2023-12-22T08:40:57.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.774+0000 7f2de9c4c640 1 -- start start 2023-12-22T08:40:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.776+0000 7f2de9c4c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2de4071b90 0x7f2de4070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.776+0000 7f2de9c4c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2de4154b80 0x7f2de40ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.776+0000 7f2de9c4c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de40716a0 con 0x7f2de41547a0 2023-12-22T08:40:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.776+0000 7f2de9c4c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de40710e0 con 0x7f2de4154b80 2023-12-22T08:40:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.776+0000 7f2de9c4c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40713c0 con 0x7f2de4071b90 2023-12-22T08:40:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.776+0000 7f2de3fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2de4154b80 0x7f2de40ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.776+0000 7f2de3fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2de4154b80 0x7f2de40ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46868/0 (socket says 172.21.15.38:46868) 2023-12-22T08:40:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.776+0000 7f2de3fff640 1 -- 172.21.15.38:0/4270209836 learned_addr learned my addr 172.21.15.38:0/4270209836 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:57.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.776+0000 7f2de37fe640 1 --1- 172.21.15.38:0/4270209836 >> v1:172.21.15.89:6789/0 conn(0x7f2de41547a0 0x7f2de415b300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:37514/0 (socket says 172.21.15.38:37514) 2023-12-22T08:40:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.777+0000 7f2de2ffd640 1 --2- 172.21.15.38:0/4270209836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2de4071b90 0x7f2de4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.777+0000 7f2de3fff640 1 -- 172.21.15.38:0/4270209836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2de4071b90 msgr2=0x7f2de4070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.777+0000 7f2de3fff640 1 --2- 172.21.15.38:0/4270209836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2de4071b90 0x7f2de4070770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.777+0000 7f2de3fff640 1 -- 172.21.15.38:0/4270209836 >> v1:172.21.15.89:6789/0 conn(0x7f2de41547a0 legacy=0x7f2de415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.777+0000 7f2de3fff640 1 -- 172.21.15.38:0/4270209836 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de415ab00 con 0x7f2de4154b80 2023-12-22T08:40:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.777+0000 7f2de2ffd640 1 --2- 172.21.15.38:0/4270209836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2de4071b90 0x7f2de4070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.778+0000 7f2de3fff640 1 --2- 172.21.15.38:0/4270209836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2de4154b80 0x7f2de40ce390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009e50 tx=0x7f2ddc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7b6d6064a9720b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.779+0000 7f2de27fc640 1 -- 172.21.15.38:0/4270209836 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc02cb00 con 0x7f2de4154b80 2023-12-22T08:40:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.779+0000 7f2de27fc640 1 -- 172.21.15.38:0/4270209836 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc02cc60 con 0x7f2de4154b80 2023-12-22T08:40:57.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.779+0000 7f2de27fc640 1 -- 172.21.15.38:0/4270209836 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0343f0 con 0x7f2de4154b80 2023-12-22T08:40:57.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.779+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4270209836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2de4154b80 msgr2=0x7f2de40ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.779+0000 7f2de9c4c640 1 --2- 172.21.15.38:0/4270209836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2de4154b80 0x7f2de40ce390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009e50 tx=0x7f2ddc02bf60 comp rx=0 tx=0).stop 2023-12-22T08:40:57.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.779+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4270209836 shutdown_connections 2023-12-22T08:40:57.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.779+0000 7f2de9c4c640 1 --2- 172.21.15.38:0/4270209836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2de4154b80 0x7f2de40ce390 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.779+0000 7f2de9c4c640 1 --2- 172.21.15.38:0/4270209836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2de4071b90 0x7f2de4070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.779+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4270209836 >> 172.21.15.38:0/4270209836 conn(0x7f2de40cf070 msgr2=0x7f2de40cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:57.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.780+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4270209836 shutdown_connections 2023-12-22T08:40:57.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.780+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4270209836 wait complete. 2023-12-22T08:40:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.781+0000 7f2de9c4c640 1 Processor -- start 2023-12-22T08:40:57.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.781+0000 7f2de9c4c640 1 -- start start 2023-12-22T08:40:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.782+0000 7f2de9c4c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2de4071b90 0x7f2de414dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.782+0000 7f2de9c4c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2de41547a0 0x7f2de40b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.782+0000 7f2de9c4c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2de4154b80 0x7f2de414fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.782+0000 7f2de9c4c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4149210 con 0x7f2de4071b90 2023-12-22T08:40:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.782+0000 7f2de9c4c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4148600 con 0x7f2de41547a0 2023-12-22T08:40:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.782+0000 7f2de9c4c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de41488e0 con 0x7f2de4154b80 2023-12-22T08:40:57.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.783+0000 7f2de37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2de4071b90 0x7f2de414dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.783+0000 7f2de37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2de4071b90 0x7f2de414dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46884/0 (socket says 172.21.15.38:46884) 2023-12-22T08:40:57.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.783+0000 7f2de37fe640 1 -- 172.21.15.38:0/4088628772 learned_addr learned my addr 172.21.15.38:0/4088628772 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.783+0000 7f2de2ffd640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2de41547a0 0x7f2de40b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.783+0000 7f2de3fff640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2de4154b80 0x7f2de414fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.783+0000 7f2de37fe640 1 -- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2de4154b80 msgr2=0x7f2de414fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.783+0000 7f2de37fe640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2de4154b80 0x7f2de414fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.783+0000 7f2de37fe640 1 -- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2de41547a0 msgr2=0x7f2de40b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.783+0000 7f2de37fe640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2de41547a0 0x7f2de40b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.783+0000 7f2de37fe640 1 -- 172.21.15.38:0/4088628772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc009b30 con 0x7f2de4071b90 2023-12-22T08:40:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.783+0000 7f2de2ffd640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2de41547a0 0x7f2de40b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.783+0000 7f2de37fe640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2de4071b90 0x7f2de414dac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400c4d0 tx=0x7f2dd400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.784+0000 7f2dcbfff640 1 -- 172.21.15.38:0/4088628772 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4007480 con 0x7f2de4071b90 2023-12-22T08:40:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.784+0000 7f2dcbfff640 1 -- 172.21.15.38:0/4088628772 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd40075e0 con 0x7f2de4071b90 2023-12-22T08:40:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.784+0000 7f2dcbfff640 1 -- 172.21.15.38:0/4088628772 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40049e0 con 0x7f2de4071b90 2023-12-22T08:40:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.784+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4088628772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de4148bc0 con 0x7f2de4071b90 2023-12-22T08:40:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.784+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4088628772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de414e000 con 0x7f2de4071b90 2023-12-22T08:40:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.785+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4088628772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de414e220 con 0x7f2de4071b90 2023-12-22T08:40:57.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.786+0000 7f2dcbfff640 1 -- 172.21.15.38:0/4088628772 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2dd4004b40 con 0x7f2de4071b90 2023-12-22T08:40:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.787+0000 7f2dcbfff640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2dd006a460 0x7f2dd006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.787+0000 7f2dcbfff640 1 -- 172.21.15.38:0/4088628772 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2dd4087b10 con 0x7f2de4071b90 2023-12-22T08:40:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.788+0000 7f2de2ffd640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2dd006a460 0x7f2dd006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.788+0000 7f2de2ffd640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2dd006a460 0x7f2dd006c920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8006fd0 tx=0x7f2dd8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.791+0000 7f2dcbfff640 1 -- 172.21.15.38:0/4088628772 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2dd40530c0 con 0x7f2de4071b90 2023-12-22T08:40:57.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.984+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4088628772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2de4061910 con 0x7f2de4071b90 2023-12-22T08:40:57.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.987+0000 7f2dcbfff640 1 -- 172.21.15.38:0/4088628772 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16088 (secure 0 0 0) 0x7f2dd4018020 con 0x7f2de4071b90 2023-12-22T08:40:57.989 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:57.990 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":22,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:40:48.371962+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.989+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2dd006a460 msgr2=0x7f2dd006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.989+0000 7f2de9c4c640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2dd006a460 0x7f2dd006c920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8006fd0 tx=0x7f2dd8008040 comp rx=0 tx=0).stop 2023-12-22T08:40:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.989+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4088628772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2de4071b90 msgr2=0x7f2de414dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.989+0000 7f2de9c4c640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2de4071b90 0x7f2de414dac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400c4d0 tx=0x7f2dd400c990 comp rx=0 tx=0).stop 2023-12-22T08:40:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.989+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4088628772 shutdown_connections 2023-12-22T08:40:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.989+0000 7f2de9c4c640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2de4154b80 0x7f2de414fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.989+0000 7f2de9c4c640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2de41547a0 0x7f2de40b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.989+0000 7f2de9c4c640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2dd006a460 0x7f2dd006c920 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.989+0000 7f2de9c4c640 1 --2- 172.21.15.38:0/4088628772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2de4071b90 0x7f2de414dac0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.989+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4088628772 >> 172.21.15.38:0/4088628772 conn(0x7f2de40cf070 msgr2=0x7f2de406c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:57.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.989+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4088628772 shutdown_connections 2023-12-22T08:40:57.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:57.989+0000 7f2de9c4c640 1 -- 172.21.15.38:0/4088628772 wait complete. 2023-12-22T08:40:58.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:39:56.873963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:39:57.616447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:58.011 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:58.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.231+0000 7fd9abfff640 1 Processor -- start 2023-12-22T08:40:58.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.231+0000 7fd9abfff640 1 -- start start 2023-12-22T08:40:58.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.233+0000 7fd9abfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9ac15d3e0 0x7fd9ac15b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.233+0000 7fd9abfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9ac15d7c0 0x7fd9ac06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.233+0000 7fd9abfff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ac070360 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.233+0000 7fd9abfff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ac070640 con 0x7fd9ac15d3e0 2023-12-22T08:40:58.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.233+0000 7fd9abfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac070920 con 0x7fd9ac15d7c0 2023-12-22T08:40:58.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.233+0000 7fd9ab7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd9ac15a7b0 0x7fd9ac06d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:37526/0 (socket says 172.21.15.38:37526) 2023-12-22T08:40:58.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.233+0000 7fd9ab7fe640 1 -- 172.21.15.38:0/2886114158 learned_addr learned my addr 172.21.15.38:0/2886114158 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:58.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.234+0000 7fd9aa7fc640 1 --2- 172.21.15.38:0/2886114158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9ac15d7c0 0x7fd9ac06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.234+0000 7fd9aaffd640 1 --2- 172.21.15.38:0/2886114158 >> v2:172.21.15.89:3300/0 conn(0x7fd9ac15d3e0 0x7fd9ac15b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.234+0000 7fd9a9ffb640 1 -- 172.21.15.38:0/2886114158 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140223701 0 0) 0x7fd9ac070360 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.234+0000 7fd9a9ffb640 1 -- 172.21.15.38:0/2886114158 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd994003520 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.234+0000 7fd9aaffd640 1 -- 172.21.15.38:0/2886114158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9ac15d7c0 msgr2=0x7fd9ac06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:58.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.234+0000 7fd9aaffd640 1 --2- 172.21.15.38:0/2886114158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9ac15d7c0 0x7fd9ac06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.234+0000 7fd9aaffd640 1 -- 172.21.15.38:0/2886114158 >> v1:172.21.15.89:6789/0 conn(0x7fd9ac15a7b0 legacy=0x7fd9ac06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.234+0000 7fd9aaffd640 1 -- 172.21.15.38:0/2886114158 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac0abda0 con 0x7fd9ac15d3e0 2023-12-22T08:40:58.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.236+0000 7fd9aaffd640 1 --2- 172.21.15.38:0/2886114158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9ac15d3e0 0x7fd9ac15b820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0097a0 tx=0x7fd99c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28c53858b4d84033 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:58.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.236+0000 7fd9a9ffb640 1 -- 172.21.15.38:0/2886114158 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c02d040 con 0x7fd9ac15d3e0 2023-12-22T08:40:58.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.236+0000 7fd9a9ffb640 1 -- 172.21.15.38:0/2886114158 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c031810 con 0x7fd9ac15d3e0 2023-12-22T08:40:58.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.236+0000 7fd9a9ffb640 1 -- 172.21.15.38:0/2886114158 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c031ba0 con 0x7fd9ac15d3e0 2023-12-22T08:40:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.237+0000 7fd9abfff640 1 -- 172.21.15.38:0/2886114158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9ac15d3e0 msgr2=0x7fd9ac15b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.237+0000 7fd9abfff640 1 --2- 172.21.15.38:0/2886114158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9ac15d3e0 0x7fd9ac15b820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0097a0 tx=0x7fd99c02b8b0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.237+0000 7fd9abfff640 1 -- 172.21.15.38:0/2886114158 shutdown_connections 2023-12-22T08:40:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.237+0000 7fd9abfff640 1 --2- 172.21.15.38:0/2886114158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9ac15d7c0 0x7fd9ac06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.237+0000 7fd9abfff640 1 --2- 172.21.15.38:0/2886114158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9ac15d3e0 0x7fd9ac15b820 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.237+0000 7fd9abfff640 1 -- 172.21.15.38:0/2886114158 >> 172.21.15.38:0/2886114158 conn(0x7fd9ac0b0b60 msgr2=0x7fd9ac0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.237+0000 7fd9abfff640 1 -- 172.21.15.38:0/2886114158 shutdown_connections 2023-12-22T08:40:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.237+0000 7fd9abfff640 1 -- 172.21.15.38:0/2886114158 wait complete. 2023-12-22T08:40:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.239+0000 7fd9abfff640 1 Processor -- start 2023-12-22T08:40:58.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.239+0000 7fd9abfff640 1 -- start start 2023-12-22T08:40:58.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.240+0000 7fd9abfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ac15a7b0 0x7fd9ac146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.240+0000 7fd9abfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9ac15d3e0 0x7fd9ac099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.240+0000 7fd9abfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9ac15d7c0 0x7fd9ac099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.240+0000 7fd9abfff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac06dc70 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.240+0000 7fd9abfff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac1472d0 con 0x7fd9ac15d3e0 2023-12-22T08:40:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.240+0000 7fd9abfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac14b880 con 0x7fd9ac15d7c0 2023-12-22T08:40:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.240+0000 7fd9aaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ac15a7b0 0x7fd9ac146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.240+0000 7fd9aaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ac15a7b0 0x7fd9ac146d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46896/0 (socket says 172.21.15.38:46896) 2023-12-22T08:40:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.240+0000 7fd9aaffd640 1 -- 172.21.15.38:0/3613656462 learned_addr learned my addr 172.21.15.38:0/3613656462 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.241+0000 7fd9aa7fc640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9ac15d3e0 0x7fd9ac099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.241+0000 7fd9ab7fe640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9ac15d7c0 0x7fd9ac099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.241+0000 7fd9aaffd640 1 -- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9ac15d7c0 msgr2=0x7fd9ac099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.241+0000 7fd9aaffd640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9ac15d7c0 0x7fd9ac099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.241+0000 7fd9aaffd640 1 -- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9ac15d3e0 msgr2=0x7fd9ac099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.241+0000 7fd9aaffd640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9ac15d3e0 0x7fd9ac099a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.241+0000 7fd9aaffd640 1 -- 172.21.15.38:0/3613656462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99c009400 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.241+0000 7fd9aaffd640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ac15a7b0 0x7fd9ac146d90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0098c0 tx=0x7fd99c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:58.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.241+0000 7fd9937fe640 1 -- 172.21.15.38:0/3613656462 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c03ad60 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.241+0000 7fd9937fe640 1 -- 172.21.15.38:0/3613656462 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c044400 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.241+0000 7fd9937fe640 1 -- 172.21.15.38:0/3613656462 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0445b0 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.241+0000 7fd9abfff640 1 -- 172.21.15.38:0/3613656462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ac06d2d0 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.242+0000 7fd9abfff640 1 -- 172.21.15.38:0/3613656462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac06d890 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.243+0000 7fd9abfff640 1 -- 172.21.15.38:0/3613656462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ac061910 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.244+0000 7fd9937fe640 1 -- 172.21.15.38:0/3613656462 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd99c04d440 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.245+0000 7fd9937fe640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd99806a430 0x7fd99806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.245+0000 7fd9937fe640 1 -- 172.21.15.38:0/3613656462 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd99c0aabd0 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.246+0000 7fd9aa7fc640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd99806a430 0x7fd99806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.247+0000 7fd9aa7fc640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd99806a430 0x7fd99806c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac151030 tx=0x7fd9a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:58.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.250+0000 7fd9937fe640 1 -- 172.21.15.38:0/3613656462 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd99c0762a0 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.440+0000 7fd9abfff640 1 -- 172.21.15.38:0/3613656462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9ac0b29b0 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.447+0000 7fd9937fe640 1 -- 172.21.15.38:0/3613656462 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd99c0350a0 con 0x7fd9ac15a7b0 2023-12-22T08:40:58.450 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:40:58.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.450+0000 7fd9abfff640 1 -- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd99806a430 msgr2=0x7fd99806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.450+0000 7fd9abfff640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd99806a430 0x7fd99806c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac151030 tx=0x7fd9a0008040 comp rx=0 tx=0).stop 2023-12-22T08:40:58.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.450+0000 7fd9abfff640 1 -- 172.21.15.38:0/3613656462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ac15a7b0 msgr2=0x7fd9ac146d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.450+0000 7fd9abfff640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ac15a7b0 0x7fd9ac146d90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0098c0 tx=0x7fd99c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.451+0000 7fd9abfff640 1 -- 172.21.15.38:0/3613656462 shutdown_connections 2023-12-22T08:40:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.451+0000 7fd9abfff640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9ac15d7c0 0x7fd9ac099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.451+0000 7fd9abfff640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9ac15d3e0 0x7fd9ac099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.451+0000 7fd9abfff640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd99806a430 0x7fd99806c8f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.451+0000 7fd9abfff640 1 --2- 172.21.15.38:0/3613656462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9ac15a7b0 0x7fd9ac146d90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.451+0000 7fd9abfff640 1 -- 172.21.15.38:0/3613656462 >> 172.21.15.38:0/3613656462 conn(0x7fd9ac0b0b60 msgr2=0x7fd9ac14cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.451+0000 7fd9abfff640 1 -- 172.21.15.38:0/3613656462 shutdown_connections 2023-12-22T08:40:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.451+0000 7fd9abfff640 1 -- 172.21.15.38:0/3613656462 wait complete. 2023-12-22T08:40:58.472 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:58.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.698+0000 7fd40e5c9640 1 Processor -- start 2023-12-22T08:40:58.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.699+0000 7fd40e5c9640 1 -- start start 2023-12-22T08:40:58.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.700+0000 7fd40e5c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4080b3f90 0x7fd40815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.701+0000 7fd40e5c9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40815eb20 con 0x7fd40815e740 2023-12-22T08:40:58.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.701+0000 7fd40e5c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd408070770 con 0x7fd40806ca50 2023-12-22T08:40:58.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.701+0000 7fd40e5c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40806e650 con 0x7fd4080b3f90 2023-12-22T08:40:58.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.701+0000 7fd407fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd40815e740 0x7fd4080b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51080/0 (socket says 172.21.15.38:51080) 2023-12-22T08:40:58.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.701+0000 7fd407fff640 1 -- 172.21.15.38:0/473905046 learned_addr learned my addr 172.21.15.38:0/473905046 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.701+0000 7fd4077fe640 1 --2- 172.21.15.38:0/473905046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4080b3f90 0x7fd40815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.701+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038763450 0 0) 0x7fd40815eb20 con 0x7fd40815e740 2023-12-22T08:40:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.701+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3f4003520 con 0x7fd40815e740 2023-12-22T08:40:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.702+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 290221707 0 0) 0x7fd3f4003520 con 0x7fd40815e740 2023-12-22T08:40:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.702+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4080b3f90 msgr2=0x7fd40815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.702+0000 7fd406ffd640 1 --2- 172.21.15.38:0/473905046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4080b3f90 0x7fd40815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.702+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 >> v1:172.21.15.89:6789/0 conn(0x7fd40806ca50 legacy=0x7fd408070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.702+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40806cec0 con 0x7fd40815e740 2023-12-22T08:40:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.702+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fd3f80019f0 con 0x7fd40815e740 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.702+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 >> v1:172.21.15.38:6789/0 conn(0x7fd40815e740 legacy=0x7fd4080b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.702+0000 7fd406ffd640 1 --2- 172.21.15.38:0/473905046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f40039a0 0x7fd3f4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.702+0000 7fd406ffd640 1 --2- 172.21.15.38:0/473905046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4080b3f90 0x7fd3f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.702+0000 7fd406ffd640 1 --2- 172.21.15.38:0/473905046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3f4004d00 0x7fd3f4005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.702+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40806e650 con 0x7fd3f4004d00 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.702+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f400bb90 con 0x7fd3f40039a0 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.702+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f400bd50 con 0x7fd4080b3f90 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.703+0000 7fd40cb66640 1 --2- 172.21.15.38:0/473905046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3f4004d00 0x7fd3f4005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.703+0000 7fd407fff640 1 --2- 172.21.15.38:0/473905046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f40039a0 0x7fd3f4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.703+0000 7fd4077fe640 1 --2- 172.21.15.38:0/473905046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4080b3f90 0x7fd3f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.703+0000 7fd40cb66640 1 -- 172.21.15.38:0/473905046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4080b3f90 msgr2=0x7fd3f40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.703+0000 7fd40cb66640 1 --2- 172.21.15.38:0/473905046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4080b3f90 0x7fd3f40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.703+0000 7fd40cb66640 1 -- 172.21.15.38:0/473905046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f40039a0 msgr2=0x7fd3f4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.703+0000 7fd40cb66640 1 --2- 172.21.15.38:0/473905046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f40039a0 0x7fd3f4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.703+0000 7fd40cb66640 1 -- 172.21.15.38:0/473905046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f4003520 con 0x7fd3f4004d00 2023-12-22T08:40:58.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.705+0000 7fd40cb66640 1 --2- 172.21.15.38:0/473905046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3f4004d00 0x7fd3f4005160 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd400001750 tx=0x7fd3f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44ffef6ce9b82ab server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:58.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.705+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4000052d0 con 0x7fd3f4004d00 2023-12-22T08:40:58.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.705+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40002e050 con 0x7fd3f4004d00 2023-12-22T08:40:58.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.705+0000 7fd406ffd640 1 -- 172.21.15.38:0/473905046 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4000035f0 con 0x7fd3f4004d00 2023-12-22T08:40:58.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.706+0000 7fd40e5c9640 1 -- 172.21.15.38:0/473905046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3f4004d00 msgr2=0x7fd3f4005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.706+0000 7fd40e5c9640 1 --2- 172.21.15.38:0/473905046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3f4004d00 0x7fd3f4005160 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd400001750 tx=0x7fd3f40057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.706+0000 7fd40cb66640 1 -- 172.21.15.38:0/473905046 reap_dead start 2023-12-22T08:40:58.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.706+0000 7fd40e5c9640 1 -- 172.21.15.38:0/473905046 shutdown_connections 2023-12-22T08:40:58.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.706+0000 7fd40e5c9640 1 -- 172.21.15.38:0/473905046 >> 172.21.15.38:0/473905046 conn(0x7fd4080cfea0 msgr2=0x7fd4080d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:58.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.706+0000 7fd40e5c9640 1 -- 172.21.15.38:0/473905046 shutdown_connections 2023-12-22T08:40:58.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.706+0000 7fd40e5c9640 1 -- 172.21.15.38:0/473905046 wait complete. 2023-12-22T08:40:58.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.708+0000 7fd40e5c9640 1 Processor -- start 2023-12-22T08:40:58.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.708+0000 7fd40e5c9640 1 -- start start 2023-12-22T08:40:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.709+0000 7fd40e5c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3f4004d00 0x7fd4080aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.709+0000 7fd40e5c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40814ad90 0x7fd40815f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.709+0000 7fd40e5c9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd40815f840 0x7fd4080b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.709+0000 7fd40e5c9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40815fcc0 con 0x7fd40815f840 2023-12-22T08:40:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.709+0000 7fd40e5c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4080ac8e0 con 0x7fd40814ad90 2023-12-22T08:40:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.709+0000 7fd40e5c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4080acb30 con 0x7fd3f4004d00 2023-12-22T08:40:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.709+0000 7fd40cb66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd40815f840 0x7fd4080b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.709+0000 7fd40cb66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd40815f840 0x7fd4080b7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46920/0 (socket says 172.21.15.38:46920) 2023-12-22T08:40:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.709+0000 7fd40cb66640 1 -- 172.21.15.38:0/3663319510 learned_addr learned my addr 172.21.15.38:0/3663319510 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.710+0000 7fd407fff640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3f4004d00 0x7fd4080aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.710+0000 7fd4077fe640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40814ad90 0x7fd40815f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.710+0000 7fd40cb66640 1 -- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3f4004d00 msgr2=0x7fd4080aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.710+0000 7fd40cb66640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3f4004d00 0x7fd4080aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.710+0000 7fd40cb66640 1 -- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40814ad90 msgr2=0x7fd40815f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.710+0000 7fd40cb66640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40814ad90 0x7fd40815f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.710+0000 7fd40cb66640 1 -- 172.21.15.38:0/3663319510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4080ace10 con 0x7fd40815f840 2023-12-22T08:40:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.710+0000 7fd40cb66640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd40815f840 0x7fd4080b7e60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd400034040 tx=0x7fd400001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.710+0000 7fd404ff9640 1 -- 172.21.15.38:0/3663319510 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400007a30 con 0x7fd40815f840 2023-12-22T08:40:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.710+0000 7fd404ff9640 1 -- 172.21.15.38:0/3663319510 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4000067d0 con 0x7fd40815f840 2023-12-22T08:40:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.710+0000 7fd404ff9640 1 -- 172.21.15.38:0/3663319510 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400006b80 con 0x7fd40815f840 2023-12-22T08:40:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.710+0000 7fd40e5c9640 1 -- 172.21.15.38:0/3663319510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4080ad0f0 con 0x7fd40815f840 2023-12-22T08:40:58.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.711+0000 7fd40e5c9640 1 -- 172.21.15.38:0/3663319510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4080ad6b0 con 0x7fd40815f840 2023-12-22T08:40:58.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.712+0000 7fd40e5c9640 1 -- 172.21.15.38:0/3663319510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd408061910 con 0x7fd40815f840 2023-12-22T08:40:58.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.713+0000 7fd404ff9640 1 -- 172.21.15.38:0/3663319510 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd400006ce0 con 0x7fd40815f840 2023-12-22T08:40:58.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.714+0000 7fd404ff9640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd3e806a430 0x7fd3e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.714+0000 7fd404ff9640 1 -- 172.21.15.38:0/3663319510 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd4000a98e0 con 0x7fd40815f840 2023-12-22T08:40:58.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.715+0000 7fd407fff640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd3e806a430 0x7fd3e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.716+0000 7fd407fff640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd3e806a430 0x7fd3e806c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8002230 tx=0x7fd3f8006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:58.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.719+0000 7fd404ff9640 1 -- 172.21.15.38:0/3663319510 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd400074df0 con 0x7fd40815f840 2023-12-22T08:40:58.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.910+0000 7fd40e5c9640 1 -- 172.21.15.38:0/3663319510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd40815ede0 con 0x7fd40815f840 2023-12-22T08:40:58.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.911+0000 7fd404ff9640 1 -- 172.21.15.38:0/3663319510 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd400078410 con 0x7fd40815f840 2023-12-22T08:40:58.914 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:40:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.913+0000 7fd40e5c9640 1 -- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd3e806a430 msgr2=0x7fd3e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.913+0000 7fd40e5c9640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd3e806a430 0x7fd3e806c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8002230 tx=0x7fd3f8006040 comp rx=0 tx=0).stop 2023-12-22T08:40:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.913+0000 7fd40e5c9640 1 -- 172.21.15.38:0/3663319510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd40815f840 msgr2=0x7fd4080b7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.913+0000 7fd40e5c9640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd40815f840 0x7fd4080b7e60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd400034040 tx=0x7fd400001120 comp rx=0 tx=0).stop 2023-12-22T08:40:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.914+0000 7fd40e5c9640 1 -- 172.21.15.38:0/3663319510 shutdown_connections 2023-12-22T08:40:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.914+0000 7fd40e5c9640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd3e806a430 0x7fd3e806c8f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.914+0000 7fd40e5c9640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd40815f840 0x7fd4080b7e60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.914+0000 7fd40e5c9640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40814ad90 0x7fd40815f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.914+0000 7fd40e5c9640 1 --2- 172.21.15.38:0/3663319510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3f4004d00 0x7fd4080aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.914+0000 7fd40e5c9640 1 -- 172.21.15.38:0/3663319510 >> 172.21.15.38:0/3663319510 conn(0x7fd4080cfea0 msgr2=0x7fd408159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.914+0000 7fd40e5c9640 1 -- 172.21.15.38:0/3663319510 shutdown_connections 2023-12-22T08:40:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:58.914+0000 7fd40e5c9640 1 -- 172.21.15.38:0/3663319510 wait complete. 2023-12-22T08:40:58.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:59.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.167+0000 7f84cf079640 1 Processor -- start 2023-12-22T08:40:59.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.167+0000 7f84cf079640 1 -- start start 2023-12-22T08:40:59.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.169+0000 7f84cf079640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f84c8143fd0 0x7f84c81448a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.169+0000 7f84cf079640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f84c80cded0 0x7f84c815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.169+0000 7f84cf079640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c815b7e0 con 0x7f84c80cda40 2023-12-22T08:40:59.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.169+0000 7f84cf079640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c80ce340 con 0x7f84c80cded0 2023-12-22T08:40:59.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.169+0000 7f84cf079640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c80cf7d0 con 0x7f84c8143fd0 2023-12-22T08:40:59.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.169+0000 7f84ce878640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f84c80cded0 0x7f84c815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.169+0000 7f84ce878640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f84c80cded0 0x7f84c815f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46934/0 (socket says 172.21.15.38:46934) 2023-12-22T08:40:59.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.169+0000 7f84ce878640 1 -- 172.21.15.38:0/246545518 learned_addr learned my addr 172.21.15.38:0/246545518 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:59.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.170+0000 7f84ce878640 1 -- 172.21.15.38:0/246545518 >> v2:172.21.15.89:3300/0 conn(0x7f84c8143fd0 msgr2=0x7f84c81448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.170+0000 7f84ce077640 1 --2- 172.21.15.38:0/246545518 >> v2:172.21.15.89:3300/0 conn(0x7f84c8143fd0 0x7f84c81448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.170+0000 7f84ce878640 1 --2- 172.21.15.38:0/246545518 >> v2:172.21.15.89:3300/0 conn(0x7f84c8143fd0 0x7f84c81448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.170+0000 7f84ce878640 1 -- 172.21.15.38:0/246545518 >> v1:172.21.15.89:6789/0 conn(0x7f84c80cda40 legacy=0x7f84c815edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.170+0000 7f84ce878640 1 -- 172.21.15.38:0/246545518 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c80cfab0 con 0x7f84c80cded0 2023-12-22T08:40:59.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.170+0000 7f84ce077640 1 --2- 172.21.15.38:0/246545518 >> v2:172.21.15.89:3300/0 conn(0x7f84c8143fd0 0x7f84c81448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:59.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.171+0000 7f84ce878640 1 --2- 172.21.15.38:0/246545518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c80cded0 0x7f84c815f4e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f84c80ce670 tx=0x7f84c002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f37d44db7efbbd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.171+0000 7f84cd075640 1 -- 172.21.15.38:0/246545518 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c002c9f0 con 0x7f84c80cded0 2023-12-22T08:40:59.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.172+0000 7f84cd075640 1 -- 172.21.15.38:0/246545518 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c002cb50 con 0x7f84c80cded0 2023-12-22T08:40:59.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.172+0000 7f84cd075640 1 -- 172.21.15.38:0/246545518 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c00343f0 con 0x7f84c80cded0 2023-12-22T08:40:59.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.172+0000 7f84cf079640 1 -- 172.21.15.38:0/246545518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c80cded0 msgr2=0x7f84c815f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.172+0000 7f84cf079640 1 --2- 172.21.15.38:0/246545518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c80cded0 0x7f84c815f4e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f84c80ce670 tx=0x7f84c002be50 comp rx=0 tx=0).stop 2023-12-22T08:40:59.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.172+0000 7f84cf079640 1 -- 172.21.15.38:0/246545518 shutdown_connections 2023-12-22T08:40:59.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.172+0000 7f84cf079640 1 --2- 172.21.15.38:0/246545518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c80cded0 0x7f84c815f4e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.172+0000 7f84cf079640 1 --2- 172.21.15.38:0/246545518 >> v2:172.21.15.89:3300/0 conn(0x7f84c8143fd0 0x7f84c81448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.172+0000 7f84cf079640 1 -- 172.21.15.38:0/246545518 >> 172.21.15.38:0/246545518 conn(0x7f84c80d1200 msgr2=0x7f84c80d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:59.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.172+0000 7f84cf079640 1 -- 172.21.15.38:0/246545518 shutdown_connections 2023-12-22T08:40:59.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.172+0000 7f84cf079640 1 -- 172.21.15.38:0/246545518 wait complete. 2023-12-22T08:40:59.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.174+0000 7f84cf079640 1 Processor -- start 2023-12-22T08:40:59.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.174+0000 7f84cf079640 1 -- start start 2023-12-22T08:40:59.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.175+0000 7f84cf079640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84c80cda40 0x7f84c81f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.175+0000 7f84cf079640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84c80cded0 0x7f84c80b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.175+0000 7f84cf079640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c8143fd0 0x7f84c80cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.175+0000 7f84cf079640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c813f9d0 con 0x7f84c8143fd0 2023-12-22T08:40:59.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.175+0000 7f84cf079640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c81f6ae0 con 0x7f84c80cded0 2023-12-22T08:40:59.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.175+0000 7f84cf079640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c806c120 con 0x7f84c80cda40 2023-12-22T08:40:59.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.175+0000 7f84ce878640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c8143fd0 0x7f84c80cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.176+0000 7f84ce878640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c8143fd0 0x7f84c80cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46938/0 (socket says 172.21.15.38:46938) 2023-12-22T08:40:59.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.176+0000 7f84ce878640 1 -- 172.21.15.38:0/978560563 learned_addr learned my addr 172.21.15.38:0/978560563 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:59.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.176+0000 7f84cd876640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84c80cded0 0x7f84c80b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.176+0000 7f84ce077640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84c80cda40 0x7f84c81f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.176+0000 7f84ce878640 1 -- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84c80cda40 msgr2=0x7f84c81f65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.176+0000 7f84ce878640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84c80cda40 0x7f84c81f65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.176+0000 7f84ce878640 1 -- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84c80cded0 msgr2=0x7f84c80b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.176+0000 7f84ce878640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84c80cded0 0x7f84c80b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.176+0000 7f84ce878640 1 -- 172.21.15.38:0/978560563 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c0009b30 con 0x7f84c8143fd0 2023-12-22T08:40:59.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.176+0000 7f84ce077640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84c80cda40 0x7f84c81f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:59.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.176+0000 7f84cd876640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84c80cded0 0x7f84c80b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:59.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.176+0000 7f84ce878640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c8143fd0 0x7f84c80cc5b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f84c0036040 tx=0x7f84c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.177+0000 7f84beffd640 1 -- 172.21.15.38:0/978560563 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c003e450 con 0x7f84c8143fd0 2023-12-22T08:40:59.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.177+0000 7f84beffd640 1 -- 172.21.15.38:0/978560563 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c003e5d0 con 0x7f84c8143fd0 2023-12-22T08:40:59.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.177+0000 7f84beffd640 1 -- 172.21.15.38:0/978560563 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c003e9c0 con 0x7f84c8143fd0 2023-12-22T08:40:59.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.177+0000 7f84cf079640 1 -- 172.21.15.38:0/978560563 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c806c400 con 0x7f84c8143fd0 2023-12-22T08:40:59.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.177+0000 7f84cf079640 1 -- 172.21.15.38:0/978560563 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c806c9c0 con 0x7f84c8143fd0 2023-12-22T08:40:59.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.178+0000 7f84cf079640 1 -- 172.21.15.38:0/978560563 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c8061910 con 0x7f84c8143fd0 2023-12-22T08:40:59.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.179+0000 7f84beffd640 1 -- 172.21.15.38:0/978560563 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f84c003eb20 con 0x7f84c8143fd0 2023-12-22T08:40:59.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.180+0000 7f84beffd640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f84ac06a430 0x7f84ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.180+0000 7f84beffd640 1 -- 172.21.15.38:0/978560563 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f84c00abba0 con 0x7f84c8143fd0 2023-12-22T08:40:59.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.181+0000 7f84ce077640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f84ac06a430 0x7f84ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.182+0000 7f84ce077640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f84ac06a430 0x7f84ac06c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f84c4006fd0 tx=0x7f84c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.184+0000 7f84beffd640 1 -- 172.21.15.38:0/978560563 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f84c00771d0 con 0x7f84c8143fd0 2023-12-22T08:40:59.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.382+0000 7f84cf079640 1 -- 172.21.15.38:0/978560563 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84c815b050 con 0x7f84c8143fd0 2023-12-22T08:40:59.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.383+0000 7f84beffd640 1 -- 172.21.15.38:0/978560563 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84c00430a0 con 0x7f84c8143fd0 2023-12-22T08:40:59.385 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:40:59.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.385+0000 7f84cf079640 1 -- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f84ac06a430 msgr2=0x7f84ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.385+0000 7f84cf079640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f84ac06a430 0x7f84ac06c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f84c4006fd0 tx=0x7f84c4008040 comp rx=0 tx=0).stop 2023-12-22T08:40:59.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.385+0000 7f84cf079640 1 -- 172.21.15.38:0/978560563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c8143fd0 msgr2=0x7f84c80cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.385+0000 7f84cf079640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c8143fd0 0x7f84c80cc5b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f84c0036040 tx=0x7f84c0004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:59.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.386+0000 7f84cf079640 1 -- 172.21.15.38:0/978560563 shutdown_connections 2023-12-22T08:40:59.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.386+0000 7f84cf079640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f84ac06a430 0x7f84ac06c8f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.386+0000 7f84cf079640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c8143fd0 0x7f84c80cc5b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.386+0000 7f84cf079640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84c80cded0 0x7f84c80b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.386+0000 7f84cf079640 1 --2- 172.21.15.38:0/978560563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84c80cda40 0x7f84c81f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.386+0000 7f84cf079640 1 -- 172.21.15.38:0/978560563 >> 172.21.15.38:0/978560563 conn(0x7f84c80d1200 msgr2=0x7f84c81426b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:59.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.386+0000 7f84cf079640 1 -- 172.21.15.38:0/978560563 shutdown_connections 2023-12-22T08:40:59.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.386+0000 7f84cf079640 1 -- 172.21.15.38:0/978560563 wait complete. 2023-12-22T08:40:59.408 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:40:59.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.628+0000 7f03690d5640 1 Processor -- start 2023-12-22T08:40:59.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.628+0000 7f03690d5640 1 -- start start 2023-12-22T08:40:59.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.630+0000 7f03690d5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f03640cb830 0x7f03640cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.630+0000 7f03690d5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03640b3d10 con 0x7f03640b22c0 2023-12-22T08:40:59.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.630+0000 7f03690d5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03640cc200 con 0x7f03640b26a0 2023-12-22T08:40:59.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.630+0000 7f03690d5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036406c610 con 0x7f03640cb830 2023-12-22T08:40:59.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.631+0000 7f0362d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f03640b22c0 0x7f03640b3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51084/0 (socket says 172.21.15.38:51084) 2023-12-22T08:40:59.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.631+0000 7f0362d9d640 1 -- 172.21.15.38:0/2794909943 learned_addr learned my addr 172.21.15.38:0/2794909943 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:40:59.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.631+0000 7f036359e640 1 --2- 172.21.15.38:0/2794909943 >> v2:172.21.15.89:3300/0 conn(0x7f03640cb830 0x7f03640cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.631+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632832152 0 0) 0x7f0354001110 con 0x7f03640b22c0 2023-12-22T08:40:59.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.631+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0350003520 con 0x7f03640b22c0 2023-12-22T08:40:59.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1696314298 0 0) 0x7f0350003520 con 0x7f03640b22c0 2023-12-22T08:40:59.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 >> v2:172.21.15.89:3300/0 conn(0x7f03640cb830 msgr2=0x7f03640cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036259c640 1 --2- 172.21.15.38:0/2794909943 >> v2:172.21.15.89:3300/0 conn(0x7f03640cb830 0x7f03640cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 >> v1:172.21.15.89:6789/0 conn(0x7f03640b26a0 legacy=0x7f036406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03640b4510 con 0x7f03640b22c0 2023-12-22T08:40:59.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f0354001800 con 0x7f03640b22c0 2023-12-22T08:40:59.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 >> v1:172.21.15.38:6789/0 conn(0x7f03640b22c0 legacy=0x7f03640b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036259c640 1 --2- 172.21.15.38:0/2794909943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0350003970 0x7f0350003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036259c640 1 --2- 172.21.15.38:0/2794909943 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03500047c0 0x7f0350004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036259c640 1 --2- 172.21.15.38:0/2794909943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0350005180 0x7f035000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036406c610 con 0x7f03500047c0 2023-12-22T08:40:59.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035000c120 con 0x7f0350005180 2023-12-22T08:40:59.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035000c2e0 con 0x7f0350003970 2023-12-22T08:40:59.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f035bfff640 1 --2- 172.21.15.38:0/2794909943 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03500047c0 0x7f0350004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.632+0000 7f036359e640 1 --2- 172.21.15.38:0/2794909943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0350005180 0x7f035000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.633+0000 7f0362d9d640 1 --2- 172.21.15.38:0/2794909943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0350003970 0x7f0350003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.633+0000 7f035bfff640 1 -- 172.21.15.38:0/2794909943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0350003970 msgr2=0x7f0350003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.633+0000 7f035bfff640 1 --2- 172.21.15.38:0/2794909943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0350003970 0x7f0350003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.633+0000 7f035bfff640 1 -- 172.21.15.38:0/2794909943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0350005180 msgr2=0x7f035000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.633+0000 7f035bfff640 1 --2- 172.21.15.38:0/2794909943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0350005180 0x7f035000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.633+0000 7f036359e640 1 -- 172.21.15.38:0/2794909943 reap_dead start 2023-12-22T08:40:59.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.633+0000 7f035bfff640 1 -- 172.21.15.38:0/2794909943 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0350003520 con 0x7f03500047c0 2023-12-22T08:40:59.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.635+0000 7f035bfff640 1 --2- 172.21.15.38:0/2794909943 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03500047c0 0x7f0350004c40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f034c001750 tx=0x7f03500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13c86f254902ea7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.635+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c0052d0 con 0x7f03500047c0 2023-12-22T08:40:59.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.635+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c02e050 con 0x7f03500047c0 2023-12-22T08:40:59.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.635+0000 7f036259c640 1 -- 172.21.15.38:0/2794909943 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c003830 con 0x7f03500047c0 2023-12-22T08:40:59.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.636+0000 7f03690d5640 1 -- 172.21.15.38:0/2794909943 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03500047c0 msgr2=0x7f0350004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.636+0000 7f03690d5640 1 --2- 172.21.15.38:0/2794909943 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03500047c0 0x7f0350004c40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f034c001750 tx=0x7f03500057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.636+0000 7f03690d5640 1 -- 172.21.15.38:0/2794909943 shutdown_connections 2023-12-22T08:40:59.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.636+0000 7f03690d5640 1 --2- 172.21.15.38:0/2794909943 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03500047c0 0x7f0350004c40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.636+0000 7f03690d5640 1 -- 172.21.15.38:0/2794909943 >> 172.21.15.38:0/2794909943 conn(0x7f03640cf070 msgr2=0x7f03640cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:59.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.636+0000 7f03690d5640 1 -- 172.21.15.38:0/2794909943 shutdown_connections 2023-12-22T08:40:59.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.636+0000 7f03690d5640 1 -- 172.21.15.38:0/2794909943 wait complete. 2023-12-22T08:40:59.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.638+0000 7f03690d5640 1 Processor -- start 2023-12-22T08:40:59.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.638+0000 7f03690d5640 1 -- start start 2023-12-22T08:40:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.639+0000 7f03690d5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03500047c0 0x7f0364154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.639+0000 7f03690d5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036415fa60 0x7f03640abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.639+0000 7f03690d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03640aaf80 0x7f03640cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.639+0000 7f03690d5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03640aaaf0 con 0x7f03640aaf80 2023-12-22T08:40:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.639+0000 7f03690d5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03640ac6c0 con 0x7f03500047c0 2023-12-22T08:40:59.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.639+0000 7f03690d5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03640ac9a0 con 0x7f036415fa60 2023-12-22T08:40:59.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.640+0000 7f036359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03640aaf80 0x7f03640cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.640+0000 7f036359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03640aaf80 0x7f03640cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46962/0 (socket says 172.21.15.38:46962) 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.640+0000 7f036359e640 1 -- 172.21.15.38:0/1479985653 learned_addr learned my addr 172.21.15.38:0/1479985653 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.640+0000 7f035bfff640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036415fa60 0x7f03640abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.640+0000 7f0362d9d640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03500047c0 0x7f0364154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.640+0000 7f036359e640 1 -- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036415fa60 msgr2=0x7f03640abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.640+0000 7f036359e640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036415fa60 0x7f03640abdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.640+0000 7f036359e640 1 -- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03500047c0 msgr2=0x7f0364154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.640+0000 7f036359e640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03500047c0 0x7f0364154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.640+0000 7f036359e640 1 -- 172.21.15.38:0/1479985653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03640aa780 con 0x7f03640aaf80 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.640+0000 7f0362d9d640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03500047c0 0x7f0364154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.640+0000 7f036359e640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03640aaf80 0x7f03640cce70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f036406e250 tx=0x7f035c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.641+0000 7f035b7fe640 1 -- 172.21.15.38:0/1479985653 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c00e040 con 0x7f03640aaf80 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.641+0000 7f035b7fe640 1 -- 172.21.15.38:0/1479985653 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c00f040 con 0x7f03640aaf80 2023-12-22T08:40:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.641+0000 7f035b7fe640 1 -- 172.21.15.38:0/1479985653 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c015430 con 0x7f03640aaf80 2023-12-22T08:40:59.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.641+0000 7f03690d5640 1 -- 172.21.15.38:0/1479985653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0364154840 con 0x7f03640aaf80 2023-12-22T08:40:59.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.641+0000 7f03690d5640 1 -- 172.21.15.38:0/1479985653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03640ab400 con 0x7f03640aaf80 2023-12-22T08:40:59.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.642+0000 7f03690d5640 1 -- 172.21.15.38:0/1479985653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03640aa910 con 0x7f03640aaf80 2023-12-22T08:40:59.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.643+0000 7f035b7fe640 1 -- 172.21.15.38:0/1479985653 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f035c015590 con 0x7f03640aaf80 2023-12-22T08:40:59.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.644+0000 7f035b7fe640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f034406a430 0x7f034406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.644+0000 7f035b7fe640 1 -- 172.21.15.38:0/1479985653 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f035c089210 con 0x7f03640aaf80 2023-12-22T08:40:59.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.645+0000 7f0362d9d640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f034406a430 0x7f034406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.646+0000 7f0362d9d640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f034406a430 0x7f034406c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0354001390 tx=0x7f0354000fd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.648+0000 7f035b7fe640 1 -- 172.21.15.38:0/1479985653 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f035c054720 con 0x7f03640aaf80 2023-12-22T08:40:59.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.878+0000 7f03690d5640 1 -- 172.21.15.38:0/1479985653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0364061910 con 0x7f03640aaf80 2023-12-22T08:40:59.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.879+0000 7f035b7fe640 1 -- 172.21.15.38:0/1479985653 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4639 (secure 0 0 0) 0x7f035c057d40 con 0x7f03640aaf80 2023-12-22T08:40:59.882 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:40:59.882 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/444746330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":444746330},{"type":"v1","addr":"172.21.15.38:6833","nonce":444746330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/3918267418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":3918267418},{"type":"v1","addr":"172.21.15.38:6835","nonce":3918267418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2511997570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2511997570},{"type":"v1","addr":"172.21.15.89:6835","nonce":2511997570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:39:58.600709+0000","modified":"2023-12-22T08:40:02.076114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2902919630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2902919630},{"type":"v1","addr":"172.21.15.89:6837","nonce":2902919630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:40:59.882 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-12-22T08:40:59.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.882+0000 7f03690d5640 1 -- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f034406a430 msgr2=0x7f034406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.882+0000 7f03690d5640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f034406a430 0x7f034406c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0354001390 tx=0x7f0354000fd0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.882+0000 7f03690d5640 1 -- 172.21.15.38:0/1479985653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03640aaf80 msgr2=0x7f03640cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.882+0000 7f03690d5640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03640aaf80 0x7f03640cce70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f036406e250 tx=0x7f035c00f580 comp rx=0 tx=0).stop 2023-12-22T08:40:59.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.882+0000 7f03690d5640 1 -- 172.21.15.38:0/1479985653 shutdown_connections 2023-12-22T08:40:59.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.882+0000 7f03690d5640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f034406a430 0x7f034406c8f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.882+0000 7f03690d5640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03640aaf80 0x7f03640cce70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.882+0000 7f03690d5640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036415fa60 0x7f03640abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.882+0000 7f03690d5640 1 --2- 172.21.15.38:0/1479985653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03500047c0 0x7f0364154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.882+0000 7f03690d5640 1 -- 172.21.15.38:0/1479985653 >> 172.21.15.38:0/1479985653 conn(0x7f03640cf070 msgr2=0x7f03640b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:59.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.882+0000 7f03690d5640 1 -- 172.21.15.38:0/1479985653 shutdown_connections 2023-12-22T08:40:59.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:40:59.883+0000 7f03690d5640 1 -- 172.21.15.38:0/1479985653 wait complete. 2023-12-22T08:40:59.905 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:00.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.125+0000 7fe421cc7640 1 Processor -- start 2023-12-22T08:41:00.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.126+0000 7fe421cc7640 1 -- start start 2023-12-22T08:41:00.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.127+0000 7fe421cc7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe41c1547a0 0x7fe41c15b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:00.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.127+0000 7fe421cc7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe41c071b90 0x7fe41c070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:00.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.127+0000 7fe421cc7640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41c0716a0 con 0x7fe41c154b80 2023-12-22T08:41:00.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.127+0000 7fe421cc7640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c0710e0 con 0x7fe41c071b90 2023-12-22T08:41:00.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.127+0000 7fe421cc7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0713c0 con 0x7fe41c1547a0 2023-12-22T08:41:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.128+0000 7fe41affd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe41c071b90 0x7fe41c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.128+0000 7fe41affd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe41c071b90 0x7fe41c070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46978/0 (socket says 172.21.15.38:46978) 2023-12-22T08:41:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.128+0000 7fe41affd640 1 -- 172.21.15.38:0/434632755 learned_addr learned my addr 172.21.15.38:0/434632755 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.128+0000 7fe41bfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe41c154b80 0x7fe41c0ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51092/0 (socket says 172.21.15.38:51092) 2023-12-22T08:41:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.128+0000 7fe41b7fe640 1 --2- 172.21.15.38:0/434632755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe41c1547a0 0x7fe41c15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.128+0000 7fe41affd640 1 -- 172.21.15.38:0/434632755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe41c1547a0 msgr2=0x7fe41c15b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.128+0000 7fe41affd640 1 --2- 172.21.15.38:0/434632755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe41c1547a0 0x7fe41c15b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.128+0000 7fe41affd640 1 -- 172.21.15.38:0/434632755 >> v1:172.21.15.38:6789/0 conn(0x7fe41c154b80 legacy=0x7fe41c0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.128+0000 7fe41affd640 1 -- 172.21.15.38:0/434632755 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c15ab00 con 0x7fe41c071b90 2023-12-22T08:41:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.128+0000 7fe41a7fc640 1 -- 172.21.15.38:0/434632755 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408004315 0 0) 0x7fe41c0716a0 con 0x7fe41c154b80 2023-12-22T08:41:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.128+0000 7fe41b7fe640 1 --2- 172.21.15.38:0/434632755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe41c1547a0 0x7fe41c15b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.129+0000 7fe41affd640 1 --2- 172.21.15.38:0/434632755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41c071b90 0x7fe41c070770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe410009870 tx=0x7fe41002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af39222ce30325b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:00.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.130+0000 7fe41a7fc640 1 -- 172.21.15.38:0/434632755 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410030840 con 0x7fe41c071b90 2023-12-22T08:41:00.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.130+0000 7fe41a7fc640 1 -- 172.21.15.38:0/434632755 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4100309a0 con 0x7fe41c071b90 2023-12-22T08:41:00.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.130+0000 7fe41a7fc640 1 -- 172.21.15.38:0/434632755 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410030d30 con 0x7fe41c071b90 2023-12-22T08:41:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.130+0000 7fe421cc7640 1 -- 172.21.15.38:0/434632755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41c071b90 msgr2=0x7fe41c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.130+0000 7fe421cc7640 1 --2- 172.21.15.38:0/434632755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41c071b90 0x7fe41c070770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe410009870 tx=0x7fe41002b980 comp rx=0 tx=0).stop 2023-12-22T08:41:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.131+0000 7fe421cc7640 1 -- 172.21.15.38:0/434632755 shutdown_connections 2023-12-22T08:41:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.131+0000 7fe421cc7640 1 --2- 172.21.15.38:0/434632755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41c071b90 0x7fe41c070770 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.131+0000 7fe421cc7640 1 --2- 172.21.15.38:0/434632755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe41c1547a0 0x7fe41c15b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.131+0000 7fe421cc7640 1 -- 172.21.15.38:0/434632755 >> 172.21.15.38:0/434632755 conn(0x7fe41c0cf070 msgr2=0x7fe41c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.131+0000 7fe421cc7640 1 -- 172.21.15.38:0/434632755 shutdown_connections 2023-12-22T08:41:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.131+0000 7fe421cc7640 1 -- 172.21.15.38:0/434632755 wait complete. 2023-12-22T08:41:00.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.133+0000 7fe421cc7640 1 Processor -- start 2023-12-22T08:41:00.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.133+0000 7fe421cc7640 1 -- start start 2023-12-22T08:41:00.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe421cc7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe41c071b90 0x7fe41c0b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:00.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe421cc7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe41c1547a0 0x7fe41c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:00.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe421cc7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41c154b80 0x7fe41c0af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:00.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe421cc7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0b0590 con 0x7fe41c154b80 2023-12-22T08:41:00.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe421cc7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0b0870 con 0x7fe41c071b90 2023-12-22T08:41:00.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe421cc7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0b0b50 con 0x7fe41c1547a0 2023-12-22T08:41:00.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe41bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41c154b80 0x7fe41c0af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe41bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41c154b80 0x7fe41c0af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46980/0 (socket says 172.21.15.38:46980) 2023-12-22T08:41:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe41bfff640 1 -- 172.21.15.38:0/2791332391 learned_addr learned my addr 172.21.15.38:0/2791332391 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe41b7fe640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe41c071b90 0x7fe41c0b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe41affd640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe41c1547a0 0x7fe41c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe41bfff640 1 -- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe41c1547a0 msgr2=0x7fe41c06d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe41bfff640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe41c1547a0 0x7fe41c06d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe41bfff640 1 -- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe41c071b90 msgr2=0x7fe41c0b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe41bfff640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe41c071b90 0x7fe41c0b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe41bfff640 1 -- 172.21.15.38:0/2791332391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4100094d0 con 0x7fe41c154b80 2023-12-22T08:41:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.134+0000 7fe41b7fe640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe41c071b90 0x7fe41c0b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.135+0000 7fe41bfff640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41c154b80 0x7fe41c0af4d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe41400c7e0 tx=0x7fe41400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:00.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.135+0000 7fe403fff640 1 -- 172.21.15.38:0/2791332391 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41400a640 con 0x7fe41c154b80 2023-12-22T08:41:00.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.135+0000 7fe403fff640 1 -- 172.21.15.38:0/2791332391 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41400a7c0 con 0x7fe41c154b80 2023-12-22T08:41:00.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.135+0000 7fe421cc7640 1 -- 172.21.15.38:0/2791332391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c0aecd0 con 0x7fe41c154b80 2023-12-22T08:41:00.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.135+0000 7fe403fff640 1 -- 172.21.15.38:0/2791332391 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41400ab70 con 0x7fe41c154b80 2023-12-22T08:41:00.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.135+0000 7fe421cc7640 1 -- 172.21.15.38:0/2791332391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c0b1a60 con 0x7fe41c154b80 2023-12-22T08:41:00.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.136+0000 7fe421cc7640 1 -- 172.21.15.38:0/2791332391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c0af1f0 con 0x7fe41c154b80 2023-12-22T08:41:00.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.137+0000 7fe403fff640 1 -- 172.21.15.38:0/2791332391 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe41400acd0 con 0x7fe41c154b80 2023-12-22T08:41:00.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.138+0000 7fe403fff640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe40806a430 0x7fe40806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:00.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.138+0000 7fe403fff640 1 -- 172.21.15.38:0/2791332391 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe414087f20 con 0x7fe41c154b80 2023-12-22T08:41:00.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.139+0000 7fe41b7fe640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe40806a430 0x7fe40806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:00.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.140+0000 7fe41b7fe640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe40806a430 0x7fe40806c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe40c006fd0 tx=0x7fe40c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:00.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.142+0000 7fe403fff640 1 -- 172.21.15.38:0/2791332391 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe41c0af1f0 con 0x7fe41c154b80 2023-12-22T08:41:00.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.340+0000 7fe421cc7640 1 -- 172.21.15.38:0/2791332391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe41c0af1f0 con 0x7fe41c154b80 2023-12-22T08:41:00.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.343+0000 7fe403fff640 1 -- 172.21.15.38:0/2791332391 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16088 (secure 0 0 0) 0x7fe41c0af1f0 con 0x7fe41c154b80 2023-12-22T08:41:00.346 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:00.347 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":22,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:40:48.371962+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:00.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.346+0000 7fe421cc7640 1 -- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe40806a430 msgr2=0x7fe40806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:00.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.346+0000 7fe421cc7640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe40806a430 0x7fe40806c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe40c006fd0 tx=0x7fe40c008040 comp rx=0 tx=0).stop 2023-12-22T08:41:00.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.346+0000 7fe421cc7640 1 -- 172.21.15.38:0/2791332391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41c154b80 msgr2=0x7fe41c0af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:00.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.346+0000 7fe421cc7640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41c154b80 0x7fe41c0af4d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe41400c7e0 tx=0x7fe41400cca0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.346+0000 7fe421cc7640 1 -- 172.21.15.38:0/2791332391 shutdown_connections 2023-12-22T08:41:00.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.347+0000 7fe421cc7640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe40806a430 0x7fe40806c8f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.347+0000 7fe421cc7640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe41c154b80 0x7fe41c0af4d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.347+0000 7fe421cc7640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe41c1547a0 0x7fe41c06d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.347+0000 7fe421cc7640 1 --2- 172.21.15.38:0/2791332391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe41c071b90 0x7fe41c0b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.347+0000 7fe421cc7640 1 -- 172.21.15.38:0/2791332391 >> 172.21.15.38:0/2791332391 conn(0x7fe41c0cf070 msgr2=0x7fe41c14d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:00.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.347+0000 7fe421cc7640 1 -- 172.21.15.38:0/2791332391 shutdown_connections 2023-12-22T08:41:00.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.347+0000 7fe421cc7640 1 -- 172.21.15.38:0/2791332391 wait complete. 2023-12-22T08:41:00.370 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:41:00.371 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:00.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.594+0000 7f7fe5fa9640 1 Processor -- start 2023-12-22T08:41:00.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.594+0000 7f7fe5fa9640 1 -- start start 2023-12-22T08:41:00.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.596+0000 7f7fe5fa9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe006d210 0x7f7fe015e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:00.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.596+0000 7f7fe5fa9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7fe00cb4c0 0x7f7fe0159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:00.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.596+0000 7f7fe5fa9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7fe006d5f0 0x7f7fe015a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:00.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.596+0000 7f7fe5fa9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe00706d0 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.596+0000 7f7fe5fa9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe00cbf40 con 0x7f7fe006d5f0 2023-12-22T08:41:00.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.596+0000 7f7fe5fa9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe015a760 con 0x7f7fe006d210 2023-12-22T08:41:00.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.596+0000 7f7fdffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7fe00cb4c0 0x7f7fe0159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:00.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.596+0000 7f7fdffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7fe00cb4c0 0x7f7fe0159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46982/0 (socket says 172.21.15.38:46982) 2023-12-22T08:41:00.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.596+0000 7f7fdffff640 1 -- 172.21.15.38:0/2665817117 learned_addr learned my addr 172.21.15.38:0/2665817117 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:00.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.596+0000 7f7fe4fa7640 1 --2- 172.21.15.38:0/2665817117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe006d210 0x7f7fe015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:00.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.596+0000 7f7fdffff640 1 -- 172.21.15.38:0/2665817117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe006d210 msgr2=0x7f7fe015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:00.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.597+0000 7f7fdffff640 1 --2- 172.21.15.38:0/2665817117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe006d210 0x7f7fe015e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.597+0000 7f7fdffff640 1 -- 172.21.15.38:0/2665817117 >> v2:172.21.15.89:3300/0 conn(0x7f7fe006d5f0 msgr2=0x7f7fe015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:00.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.597+0000 7f7fe57a8640 1 --2- 172.21.15.38:0/2665817117 >> v2:172.21.15.89:3300/0 conn(0x7f7fe006d5f0 0x7f7fe015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:00.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.597+0000 7f7fdffff640 1 --2- 172.21.15.38:0/2665817117 >> v2:172.21.15.89:3300/0 conn(0x7f7fe006d5f0 0x7f7fe015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.597+0000 7f7fdffff640 1 -- 172.21.15.38:0/2665817117 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe00ce840 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.597+0000 7f7fe57a8640 1 --2- 172.21.15.38:0/2665817117 >> v2:172.21.15.89:3300/0 conn(0x7f7fe006d5f0 0x7f7fe015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:00.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.597+0000 7f7fe4fa7640 1 --2- 172.21.15.38:0/2665817117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe006d210 0x7f7fe015e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:00.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.598+0000 7f7fdffff640 1 --2- 172.21.15.38:0/2665817117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe00cb4c0 0x7f7fe0159ce0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7fe015dd80 tx=0x7f7fc802b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7f0dd64cd13def server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:00.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.598+0000 7f7fdf7fe640 1 -- 172.21.15.38:0/2665817117 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8031880 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.598+0000 7f7fdf7fe640 1 -- 172.21.15.38:0/2665817117 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc80319e0 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.598+0000 7f7fdf7fe640 1 -- 172.21.15.38:0/2665817117 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8031d70 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.599+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/2665817117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe00cb4c0 msgr2=0x7f7fe0159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:00.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.599+0000 7f7fe5fa9640 1 --2- 172.21.15.38:0/2665817117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe00cb4c0 0x7f7fe0159ce0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7fe015dd80 tx=0x7f7fc802b920 comp rx=0 tx=0).stop 2023-12-22T08:41:00.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.599+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/2665817117 shutdown_connections 2023-12-22T08:41:00.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.599+0000 7f7fe5fa9640 1 --2- 172.21.15.38:0/2665817117 >> v2:172.21.15.89:3300/0 conn(0x7f7fe006d5f0 0x7f7fe015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.599+0000 7f7fe5fa9640 1 --2- 172.21.15.38:0/2665817117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe00cb4c0 0x7f7fe0159ce0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.599+0000 7f7fe5fa9640 1 --2- 172.21.15.38:0/2665817117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe006d210 0x7f7fe015e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.599+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/2665817117 >> 172.21.15.38:0/2665817117 conn(0x7f7fe00b1f70 msgr2=0x7f7fe00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:00.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.599+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/2665817117 shutdown_connections 2023-12-22T08:41:00.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.599+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/2665817117 wait complete. 2023-12-22T08:41:00.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.601+0000 7f7fe5fa9640 1 Processor -- start 2023-12-22T08:41:00.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.601+0000 7f7fe5fa9640 1 -- start start 2023-12-22T08:41:00.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.602+0000 7f7fe5fa9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fe006d210 0x7f7fe0147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:00.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.602+0000 7f7fe5fa9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe006d5f0 0x7f7fe00a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:00.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.602+0000 7f7fe5fa9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe00cb4c0 0x7f7fe01f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:00.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.602+0000 7f7fe5fa9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00a2d60 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.602+0000 7f7fe5fa9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00a1e80 con 0x7f7fe006d210 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.602+0000 7f7fe5fa9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00a2150 con 0x7f7fe006d5f0 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.602+0000 7f7fe57a8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe00cb4c0 0x7f7fe01f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.602+0000 7f7fe57a8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe00cb4c0 0x7f7fe01f2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46984/0 (socket says 172.21.15.38:46984) 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.603+0000 7f7fe57a8640 1 -- 172.21.15.38:0/579261730 learned_addr learned my addr 172.21.15.38:0/579261730 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.602+0000 7f7fe4fa7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fe006d210 0x7f7fe0147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.603+0000 7f7fdffff640 1 --2- 172.21.15.38:0/579261730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe006d5f0 0x7f7fe00a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.603+0000 7f7fe57a8640 1 -- 172.21.15.38:0/579261730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe006d5f0 msgr2=0x7f7fe00a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.603+0000 7f7fe57a8640 1 --2- 172.21.15.38:0/579261730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe006d5f0 0x7f7fe00a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.603+0000 7f7fe57a8640 1 -- 172.21.15.38:0/579261730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fe006d210 msgr2=0x7f7fe0147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.603+0000 7f7fe57a8640 1 --2- 172.21.15.38:0/579261730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fe006d210 0x7f7fe0147950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.603+0000 7f7fe57a8640 1 -- 172.21.15.38:0/579261730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc80094d0 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.603+0000 7f7fe57a8640 1 --2- 172.21.15.38:0/579261730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe00cb4c0 0x7f7fe01f2560 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800c7f0 tx=0x7f7fd800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:00.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.604+0000 7f7fdd7fa640 1 -- 172.21.15.38:0/579261730 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8007820 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.604+0000 7f7fdd7fa640 1 -- 172.21.15.38:0/579261730 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd8007980 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.604+0000 7f7fdd7fa640 1 -- 172.21.15.38:0/579261730 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8007d70 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.604+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/579261730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe00a2430 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.604+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/579261730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe00a29f0 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.605+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/579261730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe006eaf0 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.606+0000 7f7fdd7fa640 1 -- 172.21.15.38:0/579261730 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7fd80113f0 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.607+0000 7f7fdd7fa640 1 --2- 172.21.15.38:0/579261730 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7fc006a430 0x7f7fc006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:00.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.607+0000 7f7fdd7fa640 1 -- 172.21.15.38:0/579261730 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7fd8088d20 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.608+0000 7f7fe4fa7640 1 --2- 172.21.15.38:0/579261730 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7fc006a430 0x7f7fc006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:00.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.609+0000 7f7fe4fa7640 1 --2- 172.21.15.38:0/579261730 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7fc006a430 0x7f7fc006c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0007130 tx=0x7f7fd00077c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:00.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.612+0000 7f7fdd7fa640 1 -- 172.21.15.38:0/579261730 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7fd80542e0 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.844+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/579261730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fe0061910 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.846+0000 7f7fdd7fa640 1 -- 172.21.15.38:0/579261730 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4639 (secure 0 0 0) 0x7f7fd801f090 con 0x7f7fe00cb4c0 2023-12-22T08:41:00.849 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:00.849 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/444746330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":444746330},{"type":"v1","addr":"172.21.15.38:6833","nonce":444746330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/3918267418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":3918267418},{"type":"v1","addr":"172.21.15.38:6835","nonce":3918267418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2511997570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2511997570},{"type":"v1","addr":"172.21.15.89:6835","nonce":2511997570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:39:58.600709+0000","modified":"2023-12-22T08:40:02.076114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2902919630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2902919630},{"type":"v1","addr":"172.21.15.89:6837","nonce":2902919630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:41:00.849 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-12-22T08:41:00.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.849+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/579261730 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7fc006a430 msgr2=0x7f7fc006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:00.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.849+0000 7f7fe5fa9640 1 --2- 172.21.15.38:0/579261730 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7fc006a430 0x7f7fc006c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0007130 tx=0x7f7fd00077c0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.849+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/579261730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe00cb4c0 msgr2=0x7f7fe01f2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:00.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.849+0000 7f7fe5fa9640 1 --2- 172.21.15.38:0/579261730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe00cb4c0 0x7f7fe01f2560 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800c7f0 tx=0x7f7fd800ccb0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.849+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/579261730 shutdown_connections 2023-12-22T08:41:00.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.849+0000 7f7fe5fa9640 1 --2- 172.21.15.38:0/579261730 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7fc006a430 0x7f7fc006c8f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.849+0000 7f7fe5fa9640 1 --2- 172.21.15.38:0/579261730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fe00cb4c0 0x7f7fe01f2560 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.849+0000 7f7fe5fa9640 1 --2- 172.21.15.38:0/579261730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe006d5f0 0x7f7fe00a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.849+0000 7f7fe5fa9640 1 --2- 172.21.15.38:0/579261730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fe006d210 0x7f7fe0147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:00.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.849+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/579261730 >> 172.21.15.38:0/579261730 conn(0x7f7fe00b1f70 msgr2=0x7f7fe0158060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:00.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.849+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/579261730 shutdown_connections 2023-12-22T08:41:00.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:00.849+0000 7f7fe5fa9640 1 -- 172.21.15.38:0/579261730 wait complete. 2023-12-22T08:41:00.870 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:01.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.094+0000 7f9b2359e640 1 Processor -- start 2023-12-22T08:41:01.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.094+0000 7f9b2359e640 1 -- start start 2023-12-22T08:41:01.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.097+0000 7f9b2359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b240d0ff0 0x7f9b240d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:01.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.097+0000 7f9b2359e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9b240cfa80 0x7f9b240cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:01.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.097+0000 7f9b2359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b240d1990 con 0x7f9b24144990 2023-12-22T08:41:01.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.097+0000 7f9b2359e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b240b6d90 con 0x7f9b240cfa80 2023-12-22T08:41:01.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.097+0000 7f9b2359e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2415bf50 con 0x7f9b240d0ff0 2023-12-22T08:41:01.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.097+0000 7f9b22d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9b240cfa80 0x7f9b240cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:01.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.097+0000 7f9b22d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9b240cfa80 0x7f9b240cfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38826/0 (socket says 172.21.15.38:38826) 2023-12-22T08:41:01.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.097+0000 7f9b22d9d640 1 -- 172.21.15.38:0/3890810245 learned_addr learned my addr 172.21.15.38:0/3890810245 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:01.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.097+0000 7f9b22d9d640 1 -- 172.21.15.38:0/3890810245 >> v2:172.21.15.89:3300/0 conn(0x7f9b240d0ff0 msgr2=0x7f9b240d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:01.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.097+0000 7f9b22d9d640 1 --2- 172.21.15.38:0/3890810245 >> v2:172.21.15.89:3300/0 conn(0x7f9b240d0ff0 0x7f9b240d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.097+0000 7f9b22d9d640 1 -- 172.21.15.38:0/3890810245 >> v1:172.21.15.89:6789/0 conn(0x7f9b24144990 legacy=0x7f9b2415b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:01.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.097+0000 7f9b22d9d640 1 -- 172.21.15.38:0/3890810245 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b240b67d0 con 0x7f9b240cfa80 2023-12-22T08:41:01.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.099+0000 7f9b22d9d640 1 --2- 172.21.15.38:0/3890810245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b240cfa80 0x7f9b240cfef0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9b240d2160 tx=0x7f9b1c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0e84189dce6e7e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:01.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.099+0000 7f9b2159a640 1 -- 172.21.15.38:0/3890810245 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c02c9f0 con 0x7f9b240cfa80 2023-12-22T08:41:01.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.099+0000 7f9b2159a640 1 -- 172.21.15.38:0/3890810245 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c02cb50 con 0x7f9b240cfa80 2023-12-22T08:41:01.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.099+0000 7f9b2159a640 1 -- 172.21.15.38:0/3890810245 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0343f0 con 0x7f9b240cfa80 2023-12-22T08:41:01.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.100+0000 7f9b2359e640 1 -- 172.21.15.38:0/3890810245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b240cfa80 msgr2=0x7f9b240cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:01.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.100+0000 7f9b2359e640 1 --2- 172.21.15.38:0/3890810245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b240cfa80 0x7f9b240cfef0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9b240d2160 tx=0x7f9b1c02be50 comp rx=0 tx=0).stop 2023-12-22T08:41:01.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.100+0000 7f9b2359e640 1 -- 172.21.15.38:0/3890810245 shutdown_connections 2023-12-22T08:41:01.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.100+0000 7f9b2359e640 1 --2- 172.21.15.38:0/3890810245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b240cfa80 0x7f9b240cfef0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.100+0000 7f9b2359e640 1 --2- 172.21.15.38:0/3890810245 >> v2:172.21.15.89:3300/0 conn(0x7f9b240d0ff0 0x7f9b240d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.100+0000 7f9b2359e640 1 -- 172.21.15.38:0/3890810245 >> 172.21.15.38:0/3890810245 conn(0x7f9b24060720 msgr2=0x7f9b24060b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:01.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.100+0000 7f9b2359e640 1 -- 172.21.15.38:0/3890810245 shutdown_connections 2023-12-22T08:41:01.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.100+0000 7f9b2359e640 1 -- 172.21.15.38:0/3890810245 wait complete. 2023-12-22T08:41:01.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.102+0000 7f9b2359e640 1 Processor -- start 2023-12-22T08:41:01.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.102+0000 7f9b2359e640 1 -- start start 2023-12-22T08:41:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.103+0000 7f9b2359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b240cfa80 0x7f9b2413e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.103+0000 7f9b2359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b240d0ff0 0x7f9b2415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.103+0000 7f9b2359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b24144990 0x7f9b2413cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.103+0000 7f9b2359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2415b2f0 con 0x7f9b240cfa80 2023-12-22T08:41:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.103+0000 7f9b2359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2413ecf0 con 0x7f9b24144990 2023-12-22T08:41:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.103+0000 7f9b2359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2413efd0 con 0x7f9b240d0ff0 2023-12-22T08:41:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.103+0000 7f9b2259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b240cfa80 0x7f9b2413e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.103+0000 7f9b2259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b240cfa80 0x7f9b2413e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38834/0 (socket says 172.21.15.38:38834) 2023-12-22T08:41:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.103+0000 7f9b2259c640 1 -- 172.21.15.38:0/990639851 learned_addr learned my addr 172.21.15.38:0/990639851 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.104+0000 7f9b21d9b640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b240d0ff0 0x7f9b2415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.104+0000 7f9b2259c640 1 -- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b240d0ff0 msgr2=0x7f9b2415adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.104+0000 7f9b2259c640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b240d0ff0 0x7f9b2415adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.104+0000 7f9b22d9d640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b24144990 0x7f9b2413cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.104+0000 7f9b2259c640 1 -- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b24144990 msgr2=0x7f9b2413cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.104+0000 7f9b2259c640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b24144990 0x7f9b2413cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.104+0000 7f9b2259c640 1 -- 172.21.15.38:0/990639851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c009b30 con 0x7f9b240cfa80 2023-12-22T08:41:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.104+0000 7f9b21d9b640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b240d0ff0 0x7f9b2415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.104+0000 7f9b2259c640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b240cfa80 0x7f9b2413e710 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400b3f0 tx=0x7f9b1400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.104+0000 7f9b12ffd640 1 -- 172.21.15.38:0/990639851 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14011830 con 0x7f9b240cfa80 2023-12-22T08:41:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.104+0000 7f9b12ffd640 1 -- 172.21.15.38:0/990639851 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b14011990 con 0x7f9b240cfa80 2023-12-22T08:41:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.104+0000 7f9b12ffd640 1 -- 172.21.15.38:0/990639851 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14011d40 con 0x7f9b240cfa80 2023-12-22T08:41:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.104+0000 7f9b2359e640 1 -- 172.21.15.38:0/990639851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2413f2b0 con 0x7f9b240cfa80 2023-12-22T08:41:01.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.105+0000 7f9b2359e640 1 -- 172.21.15.38:0/990639851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2413f870 con 0x7f9b240cfa80 2023-12-22T08:41:01.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.106+0000 7f9b2359e640 1 -- 172.21.15.38:0/990639851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b24061910 con 0x7f9b240cfa80 2023-12-22T08:41:01.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.107+0000 7f9b12ffd640 1 -- 172.21.15.38:0/990639851 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9b1401a400 con 0x7f9b240cfa80 2023-12-22T08:41:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.108+0000 7f9b12ffd640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9b0406a430 0x7f9b0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.108+0000 7f9b12ffd640 1 -- 172.21.15.38:0/990639851 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9b140888b0 con 0x7f9b240cfa80 2023-12-22T08:41:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.109+0000 7f9b21d9b640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9b0406a430 0x7f9b0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:01.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.110+0000 7f9b21d9b640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9b0406a430 0x7f9b0406c8f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9b18006fd0 tx=0x7f9b18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:01.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.113+0000 7f9b12ffd640 1 -- 172.21.15.38:0/990639851 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9b14053dc0 con 0x7f9b240cfa80 2023-12-22T08:41:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.344+0000 7f9b2359e640 1 -- 172.21.15.38:0/990639851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b240b19b0 con 0x7f9b240cfa80 2023-12-22T08:41:01.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.345+0000 7f9b12ffd640 1 -- 172.21.15.38:0/990639851 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4639 (secure 0 0 0) 0x7f9b14015090 con 0x7f9b240cfa80 2023-12-22T08:41:01.348 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:01.348 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/444746330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":444746330},{"type":"v1","addr":"172.21.15.38:6833","nonce":444746330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/3918267418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":3918267418},{"type":"v1","addr":"172.21.15.38:6835","nonce":3918267418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2511997570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2511997570},{"type":"v1","addr":"172.21.15.89:6835","nonce":2511997570}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:39:58.600709+0000","modified":"2023-12-22T08:40:02.076114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/2902919630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":2902919630},{"type":"v1","addr":"172.21.15.89:6837","nonce":2902919630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:41:01.348 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2023-12-22T08:41:01.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.347+0000 7f9b2359e640 1 -- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9b0406a430 msgr2=0x7f9b0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:01.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.347+0000 7f9b2359e640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9b0406a430 0x7f9b0406c8f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9b18006fd0 tx=0x7f9b18008040 comp rx=0 tx=0).stop 2023-12-22T08:41:01.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.347+0000 7f9b2359e640 1 -- 172.21.15.38:0/990639851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b240cfa80 msgr2=0x7f9b2413e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:01.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.347+0000 7f9b2359e640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b240cfa80 0x7f9b2413e710 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400b3f0 tx=0x7f9b1400b8b0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.348+0000 7f9b2359e640 1 -- 172.21.15.38:0/990639851 shutdown_connections 2023-12-22T08:41:01.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.348+0000 7f9b2359e640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b24144990 0x7f9b2413cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.348+0000 7f9b2359e640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b240d0ff0 0x7f9b2415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.348+0000 7f9b2359e640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9b0406a430 0x7f9b0406c8f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.348+0000 7f9b2359e640 1 --2- 172.21.15.38:0/990639851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b240cfa80 0x7f9b2413e710 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.348+0000 7f9b2359e640 1 -- 172.21.15.38:0/990639851 >> 172.21.15.38:0/990639851 conn(0x7f9b24060720 msgr2=0x7f9b2415c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:01.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.348+0000 7f9b2359e640 1 -- 172.21.15.38:0/990639851 shutdown_connections 2023-12-22T08:41:01.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.348+0000 7f9b2359e640 1 -- 172.21.15.38:0/990639851 wait complete. 2023-12-22T08:41:01.371 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:01.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.590+0000 7f0234d92640 1 Processor -- start 2023-12-22T08:41:01.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.590+0000 7f0234d92640 1 -- start start 2023-12-22T08:41:01.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.591+0000 7f0234d92640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f02300b2050 0x7f02300b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:01.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.591+0000 7f0234d92640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0230070800 0x7f0230070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:01.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.591+0000 7f0234d92640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02301450f0 con 0x7f0230144d10 2023-12-22T08:41:01.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.591+0000 7f0234d92640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02300cc840 con 0x7f0230070800 2023-12-22T08:41:01.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.591+0000 7f0234d92640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02300ce010 con 0x7f02300b2050 2023-12-22T08:41:01.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.592+0000 7f022e59c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0230144d10 0x7f02300cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38316/0 (socket says 172.21.15.38:38316) 2023-12-22T08:41:01.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.592+0000 7f022ed9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0230070800 0x7f0230070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:01.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.592+0000 7f022e59c640 1 -- 172.21.15.38:0/2847105702 learned_addr learned my addr 172.21.15.38:0/2847105702 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:01.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.592+0000 7f022ed9d640 1 -- 172.21.15.38:0/2847105702 >> v2:172.21.15.89:3300/0 conn(0x7f02300b2050 msgr2=0x7f02300b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:01.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.592+0000 7f022dd9b640 1 --2- 172.21.15.38:0/2847105702 >> v2:172.21.15.89:3300/0 conn(0x7f02300b2050 0x7f02300b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:01.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.592+0000 7f022ed9d640 1 --2- 172.21.15.38:0/2847105702 >> v2:172.21.15.89:3300/0 conn(0x7f02300b2050 0x7f02300b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.592+0000 7f022ed9d640 1 -- 172.21.15.38:0/2847105702 >> v1:172.21.15.38:6789/0 conn(0x7f0230144d10 legacy=0x7f02300cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:01.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.592+0000 7f022ed9d640 1 -- 172.21.15.38:0/2847105702 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300b29f0 con 0x7f0230070800 2023-12-22T08:41:01.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.592+0000 7f022d59a640 1 -- 172.21.15.38:0/2847105702 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526252712 0 0) 0x7f02301450f0 con 0x7f0230144d10 2023-12-22T08:41:01.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.592+0000 7f022dd9b640 1 --2- 172.21.15.38:0/2847105702 >> v2:172.21.15.89:3300/0 conn(0x7f02300b2050 0x7f02300b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:01.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.593+0000 7f022ed9d640 1 --2- 172.21.15.38:0/2847105702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0230070800 0x7f0230070be0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f02300b32f0 tx=0x7f022802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3b5145a1c0282d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:01.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.594+0000 7f022d59a640 1 -- 172.21.15.38:0/2847105702 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228031830 con 0x7f0230070800 2023-12-22T08:41:01.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.594+0000 7f022d59a640 1 -- 172.21.15.38:0/2847105702 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0228031990 con 0x7f0230070800 2023-12-22T08:41:01.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.594+0000 7f022d59a640 1 -- 172.21.15.38:0/2847105702 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228031d20 con 0x7f0230070800 2023-12-22T08:41:01.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.594+0000 7f0234d92640 1 -- 172.21.15.38:0/2847105702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0230070800 msgr2=0x7f0230070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:01.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.594+0000 7f0234d92640 1 --2- 172.21.15.38:0/2847105702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0230070800 0x7f0230070be0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f02300b32f0 tx=0x7f022802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.594+0000 7f0234d92640 1 -- 172.21.15.38:0/2847105702 shutdown_connections 2023-12-22T08:41:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.594+0000 7f0234d92640 1 --2- 172.21.15.38:0/2847105702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0230070800 0x7f0230070be0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.594+0000 7f0234d92640 1 --2- 172.21.15.38:0/2847105702 >> v2:172.21.15.89:3300/0 conn(0x7f02300b2050 0x7f02300b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.594+0000 7f0234d92640 1 -- 172.21.15.38:0/2847105702 >> 172.21.15.38:0/2847105702 conn(0x7f02300cf070 msgr2=0x7f02300cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.594+0000 7f0234d92640 1 -- 172.21.15.38:0/2847105702 shutdown_connections 2023-12-22T08:41:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.594+0000 7f0234d92640 1 -- 172.21.15.38:0/2847105702 wait complete. 2023-12-22T08:41:01.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.596+0000 7f0234d92640 1 Processor -- start 2023-12-22T08:41:01.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.596+0000 7f0234d92640 1 -- start start 2023-12-22T08:41:01.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.597+0000 7f0234d92640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0230070800 0x7f023015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:01.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.597+0000 7f0234d92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02300b2050 0x7f02300b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:01.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.597+0000 7f0234d92640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0230144d10 0x7f0230156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:01.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.597+0000 7f0234d92640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230159020 con 0x7f0230144d10 2023-12-22T08:41:01.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.597+0000 7f0234d92640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023015a700 con 0x7f02300b2050 2023-12-22T08:41:01.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.597+0000 7f0234d92640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02300b0ad0 con 0x7f0230070800 2023-12-22T08:41:01.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.598+0000 7f022ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0230144d10 0x7f0230156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:01.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.598+0000 7f022ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0230144d10 0x7f0230156080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38850/0 (socket says 172.21.15.38:38850) 2023-12-22T08:41:01.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.598+0000 7f022ed9d640 1 -- 172.21.15.38:0/1561162712 learned_addr learned my addr 172.21.15.38:0/1561162712 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:01.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.598+0000 7f022e59c640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0230070800 0x7f023015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:01.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.598+0000 7f022dd9b640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02300b2050 0x7f02300b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:01.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.598+0000 7f022ed9d640 1 -- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0230070800 msgr2=0x7f023015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:01.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.598+0000 7f022ed9d640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0230070800 0x7f023015a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.598+0000 7f022ed9d640 1 -- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02300b2050 msgr2=0x7f02300b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:01.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.598+0000 7f022ed9d640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02300b2050 0x7f02300b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.598+0000 7f022ed9d640 1 -- 172.21.15.38:0/1561162712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228009400 con 0x7f0230144d10 2023-12-22T08:41:01.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.599+0000 7f022ed9d640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0230144d10 0x7f0230156080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0228009860 tx=0x7f02280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:01.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.599+0000 7f0226ffd640 1 -- 172.21.15.38:0/1561162712 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022803ba20 con 0x7f0230144d10 2023-12-22T08:41:01.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.599+0000 7f0226ffd640 1 -- 172.21.15.38:0/1561162712 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022803bba0 con 0x7f0230144d10 2023-12-22T08:41:01.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.599+0000 7f0234d92640 1 -- 172.21.15.38:0/1561162712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02301583a0 con 0x7f0230144d10 2023-12-22T08:41:01.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.599+0000 7f0226ffd640 1 -- 172.21.15.38:0/1561162712 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280433f0 con 0x7f0230144d10 2023-12-22T08:41:01.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.599+0000 7f0234d92640 1 -- 172.21.15.38:0/1561162712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0230158960 con 0x7f0230144d10 2023-12-22T08:41:01.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.600+0000 7f0234d92640 1 -- 172.21.15.38:0/1561162712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0230159160 con 0x7f0230144d10 2023-12-22T08:41:01.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.601+0000 7f0226ffd640 1 -- 172.21.15.38:0/1561162712 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0228043550 con 0x7f0230144d10 2023-12-22T08:41:01.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.602+0000 7f0226ffd640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f021006a430 0x7f021006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:01.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.602+0000 7f0226ffd640 1 -- 172.21.15.38:0/1561162712 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f02280aa7c0 con 0x7f0230144d10 2023-12-22T08:41:01.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.603+0000 7f022e59c640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f021006a430 0x7f021006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:01.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.604+0000 7f022e59c640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f021006a430 0x7f021006c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0220000f60 tx=0x7f0220007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:01.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.606+0000 7f0226ffd640 1 -- 172.21.15.38:0/1561162712 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0230159160 con 0x7f0230144d10 2023-12-22T08:41:01.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.802+0000 7f0234d92640 1 -- 172.21.15.38:0/1561162712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0230159160 con 0x7f0230144d10 2023-12-22T08:41:01.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.804+0000 7f0226ffd640 1 -- 172.21.15.38:0/1561162712 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16088 (secure 0 0 0) 0x7f0230159160 con 0x7f0230144d10 2023-12-22T08:41:01.807 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:01.807 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":22,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:40:48.371962+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:39:56.873963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:39:57.616447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":0,"to":4}]},{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:01.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.807+0000 7f0234d92640 1 -- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f021006a430 msgr2=0x7f021006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:01.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.807+0000 7f0234d92640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f021006a430 0x7f021006c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0220000f60 tx=0x7f0220007c00 comp rx=0 tx=0).stop 2023-12-22T08:41:01.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.807+0000 7f0234d92640 1 -- 172.21.15.38:0/1561162712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0230144d10 msgr2=0x7f0230156080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:01.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.807+0000 7f0234d92640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0230144d10 0x7f0230156080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0228009860 tx=0x7f02280046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.807+0000 7f0234d92640 1 -- 172.21.15.38:0/1561162712 shutdown_connections 2023-12-22T08:41:01.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.807+0000 7f0234d92640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f021006a430 0x7f021006c8f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.807+0000 7f0234d92640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0230144d10 0x7f0230156080 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.807+0000 7f0234d92640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02300b2050 0x7f02300b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.807+0000 7f0234d92640 1 --2- 172.21.15.38:0/1561162712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0230070800 0x7f023015a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:01.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.807+0000 7f0234d92640 1 -- 172.21.15.38:0/1561162712 >> 172.21.15.38:0/1561162712 conn(0x7f02300cf070 msgr2=0x7f0230070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:01.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.807+0000 7f0234d92640 1 -- 172.21.15.38:0/1561162712 shutdown_connections 2023-12-22T08:41:01.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:01.807+0000 7f0234d92640 1 -- 172.21.15.38:0/1561162712 wait complete. 2023-12-22T08:41:01.829 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T08:41:02.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.027+0000 7fa2e3fff640 1 Processor -- start 2023-12-22T08:41:02.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.028+0000 7fa2e3fff640 1 -- start start 2023-12-22T08:41:02.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.029+0000 7fa2e3fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e40cb5e0 0x7fa2e415d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.029+0000 7fa2e3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa2e4161bb0 0x7fa2e415de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.029+0000 7fa2e3fff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e415e3c0 con 0x7fa2e415ad90 2023-12-22T08:41:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.029+0000 7fa2e3fff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e40ce2c0 con 0x7fa2e4161bb0 2023-12-22T08:41:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.029+0000 7fa2e3fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e415e910 con 0x7fa2e40cb5e0 2023-12-22T08:41:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.029+0000 7fa2e2ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa2e415ad90 0x7fa2e40caed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38328/0 (socket says 172.21.15.38:38328) 2023-12-22T08:41:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.029+0000 7fa2e2ffd640 1 -- 172.21.15.38:0/1482610538 learned_addr learned my addr 172.21.15.38:0/1482610538 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582850664 0 0) 0x7fa2e415e3c0 con 0x7fa2e415ad90 2023-12-22T08:41:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d0003520 con 0x7fa2e415ad90 2023-12-22T08:41:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e27fc640 1 --2- 172.21.15.38:0/1482610538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e40cb5e0 0x7fa2e415d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e37fe640 1 --2- 172.21.15.38:0/1482610538 >> v2:172.21.15.89:3300/0 conn(0x7fa2e4161bb0 0x7fa2e415de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3285561465 0 0) 0x7fa2d0003520 con 0x7fa2e415ad90 2023-12-22T08:41:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e40cb5e0 msgr2=0x7fa2e415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 --2- 172.21.15.38:0/1482610538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e40cb5e0 0x7fa2e415d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 >> v2:172.21.15.89:3300/0 conn(0x7fa2e4161bb0 msgr2=0x7fa2e415de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 --2- 172.21.15.38:0/1482610538 >> v2:172.21.15.89:3300/0 conn(0x7fa2e4161bb0 0x7fa2e415de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e415e630 con 0x7fa2e415ad90 2023-12-22T08:41:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fa2d4001670 con 0x7fa2e415ad90 2023-12-22T08:41:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 >> v1:172.21.15.38:6789/0 conn(0x7fa2e415ad90 legacy=0x7fa2e40caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 --2- 172.21.15.38:0/1482610538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d0003970 0x7fa2d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 --2- 172.21.15.38:0/1482610538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2d00047c0 0x7fa2d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 --2- 172.21.15.38:0/1482610538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e40cb5e0 0x7fa2d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e415e910 con 0x7fa2d0003970 2023-12-22T08:41:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d000ba30 con 0x7fa2d00047c0 2023-12-22T08:41:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d000bbc0 con 0x7fa2e40cb5e0 2023-12-22T08:41:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e37fe640 1 --2- 172.21.15.38:0/1482610538 >> v2:172.21.15.89:3300/0 conn(0x7fa2e4161bb0 0x7fa2e415de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.030+0000 7fa2e2ffd640 1 --2- 172.21.15.38:0/1482610538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d0003970 0x7fa2d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.031+0000 7fa2e27fc640 1 --2- 172.21.15.38:0/1482610538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2d00047c0 0x7fa2d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.031+0000 7fa2e2ffd640 1 -- 172.21.15.38:0/1482610538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e40cb5e0 msgr2=0x7fa2d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.031+0000 7fa2e2ffd640 1 --2- 172.21.15.38:0/1482610538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e40cb5e0 0x7fa2d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.031+0000 7fa2e2ffd640 1 -- 172.21.15.38:0/1482610538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2d00047c0 msgr2=0x7fa2d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:02.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.031+0000 7fa2e2ffd640 1 --2- 172.21.15.38:0/1482610538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2d00047c0 0x7fa2d0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.031+0000 7fa2e2ffd640 1 -- 172.21.15.38:0/1482610538 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d0003520 con 0x7fa2d0003970 2023-12-22T08:41:02.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.032+0000 7fa2e2ffd640 1 --2- 172.21.15.38:0/1482610538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d0003970 0x7fa2d0003d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400c0e0 tx=0x7fa2d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144a2fdfd3f5a60 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:02.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.032+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4005ad0 con 0x7fa2d0003970 2023-12-22T08:41:02.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.032+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4005c50 con 0x7fa2d0003970 2023-12-22T08:41:02.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.032+0000 7fa2e1ffb640 1 -- 172.21.15.38:0/1482610538 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d402c7d0 con 0x7fa2d0003970 2023-12-22T08:41:02.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.033+0000 7fa2e3fff640 1 -- 172.21.15.38:0/1482610538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d0003970 msgr2=0x7fa2d0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:02.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.033+0000 7fa2e3fff640 1 --2- 172.21.15.38:0/1482610538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d0003970 0x7fa2d0003d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400c0e0 tx=0x7fa2d00057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.033+0000 7fa2e37fe640 1 -- 172.21.15.38:0/1482610538 reap_dead start 2023-12-22T08:41:02.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.033+0000 7fa2e3fff640 1 -- 172.21.15.38:0/1482610538 shutdown_connections 2023-12-22T08:41:02.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.033+0000 7fa2e3fff640 1 -- 172.21.15.38:0/1482610538 >> 172.21.15.38:0/1482610538 conn(0x7fa2e40d31c0 msgr2=0x7fa2e40d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:02.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.033+0000 7fa2e3fff640 1 -- 172.21.15.38:0/1482610538 shutdown_connections 2023-12-22T08:41:02.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.033+0000 7fa2e3fff640 1 -- 172.21.15.38:0/1482610538 wait complete. 2023-12-22T08:41:02.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.035+0000 7fa2e3fff640 1 Processor -- start 2023-12-22T08:41:02.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.035+0000 7fa2e3fff640 1 -- start start 2023-12-22T08:41:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d0003970 0x7fa2e40c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e3fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e40c9d80 0x7fa2e40c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2e40c8730 0x7fa2e415faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e3fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40c68c0 con 0x7fa2d0003970 2023-12-22T08:41:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e3fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40c8ce0 con 0x7fa2e40c8730 2023-12-22T08:41:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e3fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40c8fc0 con 0x7fa2e40c9d80 2023-12-22T08:41:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d0003970 0x7fa2e40c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d0003970 0x7fa2e40c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38868/0 (socket says 172.21.15.38:38868) 2023-12-22T08:41:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e2ffd640 1 -- 172.21.15.38:0/3648979172 learned_addr learned my addr 172.21.15.38:0/3648979172 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e37fe640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2e40c8730 0x7fa2e415faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e27fc640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e40c9d80 0x7fa2e40c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e2ffd640 1 -- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e40c9d80 msgr2=0x7fa2e40c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e2ffd640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e40c9d80 0x7fa2e40c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e2ffd640 1 -- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2e40c8730 msgr2=0x7fa2e415faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e2ffd640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2e40c8730 0x7fa2e415faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e2ffd640 1 -- 172.21.15.38:0/3648979172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e40c92a0 con 0x7fa2d0003970 2023-12-22T08:41:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.036+0000 7fa2e37fe640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2e40c8730 0x7fa2e415faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.037+0000 7fa2e2ffd640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d0003970 0x7fa2e40c6380 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa2d402c370 tx=0x7fa2d4001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.037+0000 7fa2db7fe640 1 -- 172.21.15.38:0/3648979172 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d403c040 con 0x7fa2d0003970 2023-12-22T08:41:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.037+0000 7fa2db7fe640 1 -- 172.21.15.38:0/3648979172 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d402dcf0 con 0x7fa2d0003970 2023-12-22T08:41:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.037+0000 7fa2e3fff640 1 -- 172.21.15.38:0/3648979172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e40c9580 con 0x7fa2d0003970 2023-12-22T08:41:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.037+0000 7fa2db7fe640 1 -- 172.21.15.38:0/3648979172 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40072b0 con 0x7fa2d0003970 2023-12-22T08:41:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.037+0000 7fa2e3fff640 1 -- 172.21.15.38:0/3648979172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e40a9de0 con 0x7fa2d0003970 2023-12-22T08:41:02.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.038+0000 7fa2e3fff640 1 -- 172.21.15.38:0/3648979172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e4061910 con 0x7fa2d0003970 2023-12-22T08:41:02.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.039+0000 7fa2db7fe640 1 -- 172.21.15.38:0/3648979172 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa2d4032070 con 0x7fa2d0003970 2023-12-22T08:41:02.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.040+0000 7fa2db7fe640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2c406a430 0x7fa2c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.040+0000 7fa2db7fe640 1 -- 172.21.15.38:0/3648979172 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa2d40aa470 con 0x7fa2d0003970 2023-12-22T08:41:02.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.041+0000 7fa2e27fc640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2c406a430 0x7fa2c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:02.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.042+0000 7fa2e27fc640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2c406a430 0x7fa2c406c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa2e414cfe0 tx=0x7fa2cc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:02.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.044+0000 7fa2db7fe640 1 -- 172.21.15.38:0/3648979172 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa2d40758f0 con 0x7fa2d0003970 2023-12-22T08:41:02.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.280+0000 7fa2e3fff640 1 -- 172.21.15.38:0/3648979172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa2e40ccd00 con 0x7fa2d0003970 2023-12-22T08:41:02.284 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:41:02.281+0000 7f0a26ee3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T08:41:02.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.298+0000 7fa2db7fe640 1 -- 172.21.15.38:0/3648979172 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa2d402de60 con 0x7fa2d0003970 2023-12-22T08:41:02.301 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T08:41:02.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.301+0000 7fa2e3fff640 1 -- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2c406a430 msgr2=0x7fa2c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:02.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.301+0000 7fa2e3fff640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2c406a430 0x7fa2c406c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa2e414cfe0 tx=0x7fa2cc00b040 comp rx=0 tx=0).stop 2023-12-22T08:41:02.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.301+0000 7fa2e3fff640 1 -- 172.21.15.38:0/3648979172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d0003970 msgr2=0x7fa2e40c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:02.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.301+0000 7fa2e3fff640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d0003970 0x7fa2e40c6380 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa2d402c370 tx=0x7fa2d4001930 comp rx=0 tx=0).stop 2023-12-22T08:41:02.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.301+0000 7fa2e3fff640 1 -- 172.21.15.38:0/3648979172 shutdown_connections 2023-12-22T08:41:02.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.301+0000 7fa2e3fff640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2e40c8730 0x7fa2e415faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.301+0000 7fa2e3fff640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2e40c9d80 0x7fa2e40c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.301+0000 7fa2e3fff640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2c406a430 0x7fa2c406c8f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.301+0000 7fa2e3fff640 1 --2- 172.21.15.38:0/3648979172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d0003970 0x7fa2e40c6380 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.301+0000 7fa2e3fff640 1 -- 172.21.15.38:0/3648979172 >> 172.21.15.38:0/3648979172 conn(0x7fa2e40d31c0 msgr2=0x7fa2e415d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:02.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.301+0000 7fa2e3fff640 1 -- 172.21.15.38:0/3648979172 shutdown_connections 2023-12-22T08:41:02.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.301+0000 7fa2e3fff640 1 -- 172.21.15.38:0/3648979172 wait complete. 2023-12-22T08:41:02.324 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T08:41:02.335 INFO:tasks.ceph.mds.d.smithi089.stderr: -7656> 2023-12-22T08:39:59.752+0000 7f53f6930640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:41:02.428 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-12-22T08:41:02.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.548+0000 7f5125295640 1 Processor -- start 2023-12-22T08:41:02.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.548+0000 7f5125295640 1 -- start start 2023-12-22T08:41:02.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.550+0000 7f5125295640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f512015b0e0 0x7f512015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.550+0000 7f5125295640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f512009c980 0x7f512015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.550+0000 7f5125295640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5120071460 0x7f51200718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.550+0000 7f5125295640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5120071df0 con 0x7f5120071460 2023-12-22T08:41:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.550+0000 7f5125295640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512015edf0 con 0x7f512015b0e0 2023-12-22T08:41:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.550+0000 7f5125295640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512015bd90 con 0x7f512009c980 2023-12-22T08:41:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.550+0000 7f5124a94640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5120071460 0x7f51200718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.550+0000 7f5124a94640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5120071460 0x7f51200718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38882/0 (socket says 172.21.15.38:38882) 2023-12-22T08:41:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.550+0000 7f5124a94640 1 -- 172.21.15.38:0/1511600595 learned_addr learned my addr 172.21.15.38:0/1511600595 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.551+0000 7f51177fe640 1 --2- 172.21.15.38:0/1511600595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f512009c980 0x7f512015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.551+0000 7f511ffff640 1 --2- 172.21.15.38:0/1511600595 >> v2:172.21.15.89:3300/0 conn(0x7f512015b0e0 0x7f512015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.551+0000 7f5124a94640 1 -- 172.21.15.38:0/1511600595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f512009c980 msgr2=0x7f512015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.551+0000 7f5124a94640 1 --2- 172.21.15.38:0/1511600595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f512009c980 0x7f512015c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.551+0000 7f5124a94640 1 -- 172.21.15.38:0/1511600595 >> v2:172.21.15.89:3300/0 conn(0x7f512015b0e0 msgr2=0x7f512015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.551+0000 7f5124a94640 1 --2- 172.21.15.38:0/1511600595 >> v2:172.21.15.89:3300/0 conn(0x7f512015b0e0 0x7f512015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.551+0000 7f5124a94640 1 -- 172.21.15.38:0/1511600595 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512015c070 con 0x7f5120071460 2023-12-22T08:41:02.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.551+0000 7f51177fe640 1 --2- 172.21.15.38:0/1511600595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f512009c980 0x7f512015c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.552+0000 7f5124a94640 1 --2- 172.21.15.38:0/1511600595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5120071460 0x7f51200718b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f51200b1c60 tx=0x7f511802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c22fa8d2864f62 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.552+0000 7f511f7fe640 1 -- 172.21.15.38:0/1511600595 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511802c950 con 0x7f5120071460 2023-12-22T08:41:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.552+0000 7f511f7fe640 1 -- 172.21.15.38:0/1511600595 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511802cab0 con 0x7f5120071460 2023-12-22T08:41:02.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.552+0000 7f511f7fe640 1 -- 172.21.15.38:0/1511600595 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511802ce40 con 0x7f5120071460 2023-12-22T08:41:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.553+0000 7f5125295640 1 -- 172.21.15.38:0/1511600595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5120071460 msgr2=0x7f51200718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.553+0000 7f5125295640 1 --2- 172.21.15.38:0/1511600595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5120071460 0x7f51200718b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f51200b1c60 tx=0x7f511802bdb0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.553+0000 7f5125295640 1 -- 172.21.15.38:0/1511600595 shutdown_connections 2023-12-22T08:41:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.553+0000 7f5125295640 1 --2- 172.21.15.38:0/1511600595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5120071460 0x7f51200718b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.553+0000 7f5125295640 1 --2- 172.21.15.38:0/1511600595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f512009c980 0x7f512015c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.553+0000 7f5125295640 1 --2- 172.21.15.38:0/1511600595 >> v2:172.21.15.89:3300/0 conn(0x7f512015b0e0 0x7f512015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.553+0000 7f5125295640 1 -- 172.21.15.38:0/1511600595 >> 172.21.15.38:0/1511600595 conn(0x7f51200cf000 msgr2=0x7f51200cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.553+0000 7f5125295640 1 -- 172.21.15.38:0/1511600595 shutdown_connections 2023-12-22T08:41:02.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.553+0000 7f5125295640 1 -- 172.21.15.38:0/1511600595 wait complete. 2023-12-22T08:41:02.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.555+0000 7f5125295640 1 Processor -- start 2023-12-22T08:41:02.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.555+0000 7f5125295640 1 -- start start 2023-12-22T08:41:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.556+0000 7f5125295640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5120071460 0x7f512009b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.556+0000 7f5125295640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f512009c980 0x7f5120146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.556+0000 7f5125295640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f512015b0e0 0x7f5120147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.556+0000 7f5125295640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512014a8c0 con 0x7f5120071460 2023-12-22T08:41:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.556+0000 7f5125295640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51201479e0 con 0x7f512009c980 2023-12-22T08:41:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.556+0000 7f5125295640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5120147cc0 con 0x7f512015b0e0 2023-12-22T08:41:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.556+0000 7f511ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5120071460 0x7f512009b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.556+0000 7f511ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5120071460 0x7f512009b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38884/0 (socket says 172.21.15.38:38884) 2023-12-22T08:41:02.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.556+0000 7f511ffff640 1 -- 172.21.15.38:0/3848955868 learned_addr learned my addr 172.21.15.38:0/3848955868 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:02.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.557+0000 7f511ffff640 1 -- 172.21.15.38:0/3848955868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f512015b0e0 msgr2=0x7f5120147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:02.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.557+0000 7f511ffff640 1 --2- 172.21.15.38:0/3848955868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f512015b0e0 0x7f5120147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.557+0000 7f511ffff640 1 -- 172.21.15.38:0/3848955868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f512009c980 msgr2=0x7f5120146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:02.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.557+0000 7f511ffff640 1 --2- 172.21.15.38:0/3848955868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f512009c980 0x7f5120146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:02.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.557+0000 7f511ffff640 1 -- 172.21.15.38:0/3848955868 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5118009b30 con 0x7f5120071460 2023-12-22T08:41:02.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.557+0000 7f511ffff640 1 --2- 172.21.15.38:0/3848955868 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5120071460 0x7f512009b520 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f511000d800 tx=0x7f511000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:02.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.557+0000 7f511d7fa640 1 -- 172.21.15.38:0/3848955868 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000b6c0 con 0x7f5120071460 2023-12-22T08:41:02.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.557+0000 7f511d7fa640 1 -- 172.21.15.38:0/3848955868 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511000b820 con 0x7f5120071460 2023-12-22T08:41:02.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.557+0000 7f511d7fa640 1 -- 172.21.15.38:0/3848955868 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000bbb0 con 0x7f5120071460 2023-12-22T08:41:02.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.557+0000 7f5125295640 1 -- 172.21.15.38:0/3848955868 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5120147fa0 con 0x7f5120071460 2023-12-22T08:41:02.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.558+0000 7f5125295640 1 -- 172.21.15.38:0/3848955868 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512009ba60 con 0x7f5120071460 2023-12-22T08:41:02.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.559+0000 7f5125295640 1 -- 172.21.15.38:0/3848955868 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5120061910 con 0x7f5120071460 2023-12-22T08:41:02.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.560+0000 7f511d7fa640 1 -- 172.21.15.38:0/3848955868 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f511000bd10 con 0x7f5120071460 2023-12-22T08:41:02.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.561+0000 7f511d7fa640 1 --2- 172.21.15.38:0/3848955868 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f510006a460 0x7f510006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:02.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.561+0000 7f511d7fa640 1 -- 172.21.15.38:0/3848955868 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f5110088f50 con 0x7f5120071460 2023-12-22T08:41:02.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.561+0000 7f51177fe640 1 --2- 172.21.15.38:0/3848955868 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f510006a460 0x7f510006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:02.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.563+0000 7f51177fe640 1 --2- 172.21.15.38:0/3848955868 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f510006a460 0x7f510006c920 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5108006b10 tx=0x7f5108008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:02.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.565+0000 7f511d7fa640 1 -- 172.21.15.38:0/3848955868 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5110054410 con 0x7f5120071460 2023-12-22T08:41:02.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:02.805+0000 7f5125295640 1 -- 172.21.15.38:0/3848955868 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f512006d7d0 con 0x7f5120071460 2023-12-22T08:41:03.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.309+0000 7f511d7fa640 1 -- 172.21.15.38:0/3848955868 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5110057a30 con 0x7f5120071460 2023-12-22T08:41:03.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.312+0000 7f5125295640 1 -- 172.21.15.38:0/3848955868 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f510006a460 msgr2=0x7f510006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.312+0000 7f5125295640 1 --2- 172.21.15.38:0/3848955868 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f510006a460 0x7f510006c920 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5108006b10 tx=0x7f5108008040 comp rx=0 tx=0).stop 2023-12-22T08:41:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.312+0000 7f5125295640 1 -- 172.21.15.38:0/3848955868 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5120071460 msgr2=0x7f512009b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.312+0000 7f5125295640 1 --2- 172.21.15.38:0/3848955868 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5120071460 0x7f512009b520 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f511000d800 tx=0x7f511000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.313+0000 7f5125295640 1 -- 172.21.15.38:0/3848955868 shutdown_connections 2023-12-22T08:41:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.313+0000 7f5125295640 1 --2- 172.21.15.38:0/3848955868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f512015b0e0 0x7f5120147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.313+0000 7f5125295640 1 --2- 172.21.15.38:0/3848955868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f512009c980 0x7f5120146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.313+0000 7f5125295640 1 --2- 172.21.15.38:0/3848955868 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f510006a460 0x7f510006c920 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.313+0000 7f5125295640 1 --2- 172.21.15.38:0/3848955868 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5120071460 0x7f512009b520 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.313+0000 7f5125295640 1 -- 172.21.15.38:0/3848955868 >> 172.21.15.38:0/3848955868 conn(0x7f51200cf000 msgr2=0x7f5120159510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.313+0000 7f5125295640 1 -- 172.21.15.38:0/3848955868 shutdown_connections 2023-12-22T08:41:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.313+0000 7f5125295640 1 -- 172.21.15.38:0/3848955868 wait complete. 2023-12-22T08:41:03.336 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T08:41:03.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.558+0000 7fa401327640 1 Processor -- start 2023-12-22T08:41:03.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.559+0000 7fa401327640 1 -- start start 2023-12-22T08:41:03.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.561+0000 7fa401327640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa3fc15aee0 0x7fa3fc0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.561+0000 7fa401327640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa3fc15b2c0 0x7fa3fc0b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.561+0000 7fa401327640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3fc0b36a0 con 0x7fa3fc0b43a0 2023-12-22T08:41:03.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.561+0000 7fa401327640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3fc0b3a40 con 0x7fa3fc15b2c0 2023-12-22T08:41:03.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.561+0000 7fa401327640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3fc0b56e0 con 0x7fa3fc15aee0 2023-12-22T08:41:03.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.561+0000 7fa3f27fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa3fc15b2c0 0x7fa3fc0b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.561+0000 7fa3fb7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa3fc0b43a0 0x7fa3fc0b8a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38332/0 (socket says 172.21.15.38:38332) 2023-12-22T08:41:03.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.561+0000 7fa3f27fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa3fc15b2c0 0x7fa3fc0b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38894/0 (socket says 172.21.15.38:38894) 2023-12-22T08:41:03.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.561+0000 7fa3fb7fe640 1 -- 172.21.15.38:0/380596356 learned_addr learned my addr 172.21.15.38:0/380596356 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:03.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.561+0000 7fa3faffd640 1 --2- 172.21.15.38:0/380596356 >> v2:172.21.15.89:3300/0 conn(0x7fa3fc15aee0 0x7fa3fc0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.562+0000 7fa3f27fc640 1 -- 172.21.15.38:0/380596356 >> v2:172.21.15.89:3300/0 conn(0x7fa3fc15aee0 msgr2=0x7fa3fc0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:03.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.562+0000 7fa3f27fc640 1 --2- 172.21.15.38:0/380596356 >> v2:172.21.15.89:3300/0 conn(0x7fa3fc15aee0 0x7fa3fc0b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.562+0000 7fa3f27fc640 1 -- 172.21.15.38:0/380596356 >> v1:172.21.15.38:6789/0 conn(0x7fa3fc0b43a0 legacy=0x7fa3fc0b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.562+0000 7fa3f27fc640 1 -- 172.21.15.38:0/380596356 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc0b59c0 con 0x7fa3fc15b2c0 2023-12-22T08:41:03.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.563+0000 7fa3f27fc640 1 --2- 172.21.15.38:0/380596356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3fc15b2c0 0x7fa3fc0b3e60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0d2e10 tx=0x7fa3e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33456011d237b318 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:03.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.563+0000 7fa3fa7fc640 1 -- 172.21.15.38:0/380596356 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e402e070 con 0x7fa3fc15b2c0 2023-12-22T08:41:03.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.563+0000 7fa3fa7fc640 1 -- 172.21.15.38:0/380596356 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e40315a0 con 0x7fa3fc15b2c0 2023-12-22T08:41:03.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.563+0000 7fa3fa7fc640 1 -- 172.21.15.38:0/380596356 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4031930 con 0x7fa3fc15b2c0 2023-12-22T08:41:03.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.564+0000 7fa401327640 1 -- 172.21.15.38:0/380596356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3fc15b2c0 msgr2=0x7fa3fc0b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.564+0000 7fa401327640 1 --2- 172.21.15.38:0/380596356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3fc15b2c0 0x7fa3fc0b3e60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0d2e10 tx=0x7fa3e402b840 comp rx=0 tx=0).stop 2023-12-22T08:41:03.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.564+0000 7fa401327640 1 -- 172.21.15.38:0/380596356 shutdown_connections 2023-12-22T08:41:03.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.564+0000 7fa401327640 1 --2- 172.21.15.38:0/380596356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3fc15b2c0 0x7fa3fc0b3e60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.564+0000 7fa401327640 1 --2- 172.21.15.38:0/380596356 >> v2:172.21.15.89:3300/0 conn(0x7fa3fc15aee0 0x7fa3fc0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.564+0000 7fa401327640 1 -- 172.21.15.38:0/380596356 >> 172.21.15.38:0/380596356 conn(0x7fa3fc070770 msgr2=0x7fa3fc070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:03.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.564+0000 7fa401327640 1 -- 172.21.15.38:0/380596356 shutdown_connections 2023-12-22T08:41:03.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.564+0000 7fa401327640 1 -- 172.21.15.38:0/380596356 wait complete. 2023-12-22T08:41:03.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.566+0000 7fa401327640 1 Processor -- start 2023-12-22T08:41:03.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.566+0000 7fa401327640 1 -- start start 2023-12-22T08:41:03.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa401327640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3fc15aee0 0x7fa3fc15f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa401327640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3fc1603d0 0x7fa3fc156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa401327640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3fc0d0ef0 0x7fa3fc0d1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa401327640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc08b230 con 0x7fa3fc1603d0 2023-12-22T08:41:03.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa401327640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc0d18c0 con 0x7fa3fc0d0ef0 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa401327640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc08ee60 con 0x7fa3fc15aee0 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa3f27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3fc1603d0 0x7fa3fc156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa3f27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3fc1603d0 0x7fa3fc156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38904/0 (socket says 172.21.15.38:38904) 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa3f27fc640 1 -- 172.21.15.38:0/3630159893 learned_addr learned my addr 172.21.15.38:0/3630159893 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa3fb7fe640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3fc0d0ef0 0x7fa3fc0d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa3faffd640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3fc15aee0 0x7fa3fc15f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa3f27fc640 1 -- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3fc15aee0 msgr2=0x7fa3fc15f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa3f27fc640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3fc15aee0 0x7fa3fc15f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa3f27fc640 1 -- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3fc0d0ef0 msgr2=0x7fa3fc0d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa3f27fc640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3fc0d0ef0 0x7fa3fc0d1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.567+0000 7fa3f27fc640 1 -- 172.21.15.38:0/3630159893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e4009400 con 0x7fa3fc1603d0 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.568+0000 7fa3fb7fe640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3fc0d0ef0 0x7fa3fc0d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.568+0000 7fa3faffd640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3fc15aee0 0x7fa3fc15f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:03.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.568+0000 7fa3f27fc640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3fc1603d0 0x7fa3fc156840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009890 tx=0x7fa3e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:03.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.568+0000 7fa3f3fff640 1 -- 172.21.15.38:0/3630159893 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4032900 con 0x7fa3fc1603d0 2023-12-22T08:41:03.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.568+0000 7fa3f3fff640 1 -- 172.21.15.38:0/3630159893 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e4032a60 con 0x7fa3fc1603d0 2023-12-22T08:41:03.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.568+0000 7fa3f3fff640 1 -- 172.21.15.38:0/3630159893 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4032dd0 con 0x7fa3fc1603d0 2023-12-22T08:41:03.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.568+0000 7fa401327640 1 -- 172.21.15.38:0/3630159893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3fc1600d0 con 0x7fa3fc1603d0 2023-12-22T08:41:03.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.568+0000 7fa401327640 1 -- 172.21.15.38:0/3630159893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3fc08eb80 con 0x7fa3fc1603d0 2023-12-22T08:41:03.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.569+0000 7fa401327640 1 -- 172.21.15.38:0/3630159893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3fc08b370 con 0x7fa3fc1603d0 2023-12-22T08:41:03.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.570+0000 7fa3f3fff640 1 -- 172.21.15.38:0/3630159893 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa3e40453f0 con 0x7fa3fc1603d0 2023-12-22T08:41:03.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.571+0000 7fa3f3fff640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa3dc06a430 0x7fa3dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.571+0000 7fa3f3fff640 1 -- 172.21.15.38:0/3630159893 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fa3e40aacb0 con 0x7fa3fc1603d0 2023-12-22T08:41:03.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.572+0000 7fa3faffd640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa3dc06a430 0x7fa3dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.573+0000 7fa3faffd640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa3dc06a430 0x7fa3dc06c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0b38f0 tx=0x7fa3ec0074c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:03.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.576+0000 7fa3f3fff640 1 -- 172.21.15.38:0/3630159893 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa3fc08b370 con 0x7fa3fc1603d0 2023-12-22T08:41:03.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:03.767+0000 7fa401327640 1 -- 172.21.15.38:0/3630159893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa3fc08b370 con 0x7fa3fc1603d0 2023-12-22T08:41:04.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.481+0000 7fa3f3fff640 1 -- 172.21.15.38:0/3630159893 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa3fc08b370 con 0x7fa3fc1603d0 2023-12-22T08:41:04.484 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2023-12-22T08:41:04.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.484+0000 7fa401327640 1 -- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa3dc06a430 msgr2=0x7fa3dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.484+0000 7fa401327640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa3dc06a430 0x7fa3dc06c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0b38f0 tx=0x7fa3ec0074c0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.485+0000 7fa401327640 1 -- 172.21.15.38:0/3630159893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3fc1603d0 msgr2=0x7fa3fc156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.485+0000 7fa401327640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3fc1603d0 0x7fa3fc156840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009890 tx=0x7fa3e40046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.485+0000 7fa401327640 1 -- 172.21.15.38:0/3630159893 shutdown_connections 2023-12-22T08:41:04.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.485+0000 7fa401327640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3fc0d0ef0 0x7fa3fc0d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.485+0000 7fa401327640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa3dc06a430 0x7fa3dc06c8f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.485+0000 7fa401327640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3fc1603d0 0x7fa3fc156840 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.485+0000 7fa401327640 1 --2- 172.21.15.38:0/3630159893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3fc15aee0 0x7fa3fc15f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.485+0000 7fa401327640 1 -- 172.21.15.38:0/3630159893 >> 172.21.15.38:0/3630159893 conn(0x7fa3fc070770 msgr2=0x7fa3fc15cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:04.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.485+0000 7fa401327640 1 -- 172.21.15.38:0/3630159893 shutdown_connections 2023-12-22T08:41:04.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.485+0000 7fa401327640 1 -- 172.21.15.38:0/3630159893 wait complete. 2023-12-22T08:41:04.510 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T08:41:04.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.735+0000 7f488311c640 1 Processor -- start 2023-12-22T08:41:04.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.735+0000 7f488311c640 1 -- start start 2023-12-22T08:41:04.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.736+0000 7f488311c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f487c15d3b0 0x7f487c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.736+0000 7f488311c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c070d80 0x7f487c0b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.736+0000 7f488311c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c0b94d0 con 0x7f487c0cf110 2023-12-22T08:41:04.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.736+0000 7f488311c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c0b37a0 con 0x7f487c15d3b0 2023-12-22T08:41:04.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.736+0000 7f488311c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b3a80 con 0x7f487c070d80 2023-12-22T08:41:04.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.737+0000 7f488211a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f487c15d3b0 0x7f487c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.737+0000 7f488211a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f487c15d3b0 0x7f487c0b8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38914/0 (socket says 172.21.15.38:38914) 2023-12-22T08:41:04.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.737+0000 7f488211a640 1 -- 172.21.15.38:0/1553142775 learned_addr learned my addr 172.21.15.38:0/1553142775 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:04.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.737+0000 7f4881919640 1 --1- 172.21.15.38:0/1553142775 >> v1:172.21.15.38:6789/0 conn(0x7f487c0cf110 0x7f487c070670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38338/0 (socket says 172.21.15.38:38338) 2023-12-22T08:41:04.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.737+0000 7f488291b640 1 --2- 172.21.15.38:0/1553142775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c070d80 0x7f487c0b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.737+0000 7f488211a640 1 -- 172.21.15.38:0/1553142775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c070d80 msgr2=0x7f487c0b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:04.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.737+0000 7f488211a640 1 --2- 172.21.15.38:0/1553142775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c070d80 0x7f487c0b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.738+0000 7f488211a640 1 -- 172.21.15.38:0/1553142775 >> v1:172.21.15.38:6789/0 conn(0x7f487c0cf110 legacy=0x7f487c070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.738+0000 7f488211a640 1 -- 172.21.15.38:0/1553142775 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c0b3d60 con 0x7f487c15d3b0 2023-12-22T08:41:04.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.738+0000 7f4881118640 1 -- 172.21.15.38:0/1553142775 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361900542 0 0) 0x7f487c0b94d0 con 0x7f487c0cf110 2023-12-22T08:41:04.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.739+0000 7f488211a640 1 --2- 172.21.15.38:0/1553142775 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f487c15d3b0 0x7f487c0b8a60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4878009e50 tx=0x7f487802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb6e6f199101d4e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:04.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.739+0000 7f4881118640 1 -- 172.21.15.38:0/1553142775 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487802cb00 con 0x7f487c15d3b0 2023-12-22T08:41:04.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.739+0000 7f4881118640 1 -- 172.21.15.38:0/1553142775 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487802cc60 con 0x7f487c15d3b0 2023-12-22T08:41:04.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.739+0000 7f4881118640 1 -- 172.21.15.38:0/1553142775 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48780343f0 con 0x7f487c15d3b0 2023-12-22T08:41:04.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.740+0000 7f488311c640 1 -- 172.21.15.38:0/1553142775 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f487c15d3b0 msgr2=0x7f487c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.740+0000 7f488311c640 1 --2- 172.21.15.38:0/1553142775 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f487c15d3b0 0x7f487c0b8a60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4878009e50 tx=0x7f487802bf60 comp rx=0 tx=0).stop 2023-12-22T08:41:04.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.740+0000 7f488311c640 1 -- 172.21.15.38:0/1553142775 shutdown_connections 2023-12-22T08:41:04.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.740+0000 7f488311c640 1 --2- 172.21.15.38:0/1553142775 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c070d80 0x7f487c0b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.740+0000 7f488311c640 1 --2- 172.21.15.38:0/1553142775 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f487c15d3b0 0x7f487c0b8a60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.740+0000 7f488311c640 1 -- 172.21.15.38:0/1553142775 >> 172.21.15.38:0/1553142775 conn(0x7f487c06f250 msgr2=0x7f487c0d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:04.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.740+0000 7f488311c640 1 -- 172.21.15.38:0/1553142775 shutdown_connections 2023-12-22T08:41:04.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.740+0000 7f488311c640 1 -- 172.21.15.38:0/1553142775 wait complete. 2023-12-22T08:41:04.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.742+0000 7f488311c640 1 Processor -- start 2023-12-22T08:41:04.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.742+0000 7f488311c640 1 -- start start 2023-12-22T08:41:04.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.743+0000 7f488311c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c070d80 0x7f487c151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.743+0000 7f488311c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f487c0cf110 0x7f487c0d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.743+0000 7f488311c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f487c15d3b0 0x7f487c0d2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.743+0000 7f488311c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c157be0 con 0x7f487c0cf110 2023-12-22T08:41:04.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.743+0000 7f488311c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c151570 con 0x7f487c15d3b0 2023-12-22T08:41:04.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.743+0000 7f488311c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c155680 con 0x7f487c070d80 2023-12-22T08:41:04.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.743+0000 7f4881919640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f487c0cf110 0x7f487c0d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.743+0000 7f4881919640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f487c0cf110 0x7f487c0d1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38918/0 (socket says 172.21.15.38:38918) 2023-12-22T08:41:04.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.744+0000 7f4881919640 1 -- 172.21.15.38:0/827062673 learned_addr learned my addr 172.21.15.38:0/827062673 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:04.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.744+0000 7f488211a640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c070d80 0x7f487c151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.744+0000 7f488291b640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f487c15d3b0 0x7f487c0d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.744+0000 7f4881919640 1 -- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c070d80 msgr2=0x7f487c151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.744+0000 7f4881919640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c070d80 0x7f487c151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.744+0000 7f4881919640 1 -- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f487c15d3b0 msgr2=0x7f487c0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.744+0000 7f4881919640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f487c15d3b0 0x7f487c0d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.744+0000 7f4881919640 1 -- 172.21.15.38:0/827062673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878009b30 con 0x7f487c0cf110 2023-12-22T08:41:04.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.744+0000 7f4881919640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f487c0cf110 0x7f487c0d1df0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f486c00c4b0 tx=0x7f486c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:04.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.744+0000 7f4872ffd640 1 -- 172.21.15.38:0/827062673 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0074e0 con 0x7f487c0cf110 2023-12-22T08:41:04.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.745+0000 7f4872ffd640 1 -- 172.21.15.38:0/827062673 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c007660 con 0x7f487c0cf110 2023-12-22T08:41:04.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.745+0000 7f488311c640 1 -- 172.21.15.38:0/827062673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c1f27a0 con 0x7f487c0cf110 2023-12-22T08:41:04.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.745+0000 7f4872ffd640 1 -- 172.21.15.38:0/827062673 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c004a20 con 0x7f487c0cf110 2023-12-22T08:41:04.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.745+0000 7f488311c640 1 -- 172.21.15.38:0/827062673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c1f6510 con 0x7f487c0cf110 2023-12-22T08:41:04.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.746+0000 7f488311c640 1 -- 172.21.15.38:0/827062673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c061910 con 0x7f487c0cf110 2023-12-22T08:41:04.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.747+0000 7f4872ffd640 1 -- 172.21.15.38:0/827062673 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f486c004b80 con 0x7f487c0cf110 2023-12-22T08:41:04.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.748+0000 7f4872ffd640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f486006a430 0x7f486006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.748+0000 7f4872ffd640 1 -- 172.21.15.38:0/827062673 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f486c087d30 con 0x7f487c0cf110 2023-12-22T08:41:04.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.749+0000 7f488211a640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f486006a430 0x7f486006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.750+0000 7f488211a640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f486006a430 0x7f486006c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4878035000 tx=0x7f4878030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:04.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.753+0000 7f4872ffd640 1 -- 172.21.15.38:0/827062673 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f486c053460 con 0x7f487c0cf110 2023-12-22T08:41:04.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:04.950+0000 7f488311c640 1 -- 172.21.15.38:0/827062673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f487c0d2d80 con 0x7f487c0cf110 2023-12-22T08:41:05.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.494+0000 7f4872ffd640 1 -- 172.21.15.38:0/827062673 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f486c0180d0 con 0x7f487c0cf110 2023-12-22T08:41:05.498 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2023-12-22T08:41:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.498+0000 7f488311c640 1 -- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f486006a430 msgr2=0x7f486006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.498+0000 7f488311c640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f486006a430 0x7f486006c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4878035000 tx=0x7f4878030000 comp rx=0 tx=0).stop 2023-12-22T08:41:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.498+0000 7f488311c640 1 -- 172.21.15.38:0/827062673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f487c0cf110 msgr2=0x7f487c0d1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.498+0000 7f488311c640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f487c0cf110 0x7f487c0d1df0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f486c00c4b0 tx=0x7f486c00c970 comp rx=0 tx=0).stop 2023-12-22T08:41:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.498+0000 7f488311c640 1 -- 172.21.15.38:0/827062673 shutdown_connections 2023-12-22T08:41:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.498+0000 7f488311c640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f487c15d3b0 0x7f487c0d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.498+0000 7f488311c640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f486006a430 0x7f486006c8f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.498+0000 7f488311c640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f487c0cf110 0x7f487c0d1df0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.498+0000 7f488311c640 1 --2- 172.21.15.38:0/827062673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f487c070d80 0x7f487c151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.498+0000 7f488311c640 1 -- 172.21.15.38:0/827062673 >> 172.21.15.38:0/827062673 conn(0x7f487c06f250 msgr2=0x7f487c0b6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.498+0000 7f488311c640 1 -- 172.21.15.38:0/827062673 shutdown_connections 2023-12-22T08:41:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.498+0000 7f488311c640 1 -- 172.21.15.38:0/827062673 wait complete. 2023-12-22T08:41:05.522 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T08:41:05.523 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T08:41:05.523 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T08:41:05.523 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:41:05.524 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T08:41:05.524 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T08:41:05.524 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T08:41:05.524 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:41:05.524 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T08:41:05.525 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T08:41:05.525 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T08:41:05.525 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:41:05.525 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T08:41:05.525 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T08:41:05.526 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T08:41:05.526 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:41:05.545 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T08:41:05.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T08:41:05.547 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T08:41:05.547 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T08:41:05.548 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T08:41:05.548 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T08:41:05.550 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T08:41:05.550 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T08:41:05.597 INFO:tasks.ceph.mds.a:Started 2023-12-22T08:41:05.598 DEBUG:teuthology.parallel:result is None 2023-12-22T08:41:05.598 INFO:tasks.ceph.mds.d:Started 2023-12-22T08:41:05.599 DEBUG:teuthology.parallel:result is None 2023-12-22T08:41:05.604 INFO:tasks.ceph.mds.c:Started 2023-12-22T08:41:05.604 DEBUG:teuthology.parallel:result is None 2023-12-22T08:41:05.606 INFO:tasks.ceph.mds.b:Started 2023-12-22T08:41:05.606 DEBUG:teuthology.parallel:result is None 2023-12-22T08:41:05.606 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-22T08:41:05.763 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-12-22T08:41:05.763 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-22T08:41:05.774 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:41:05.781 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:41:05.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.820+0000 7f7b2aa30640 1 Processor -- start 2023-12-22T08:41:05.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.820+0000 7f7b2aa30640 1 -- start start 2023-12-22T08:41:05.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.821+0000 7f7b2aa30640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7b24144d10 0x7f7b240cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.821+0000 7f7b2aa30640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b241450f0 con 0x7f7b240cc670 2023-12-22T08:41:05.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.821+0000 7f7b2aa30640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b240ce010 con 0x7f7b240b2760 2023-12-22T08:41:05.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.821+0000 7f7b2aa30640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b240ce2f0 con 0x7f7b24144d10 2023-12-22T08:41:05.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.822+0000 7f7b1bfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7b240cc670 0x7f7b240b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38366/0 (socket says 172.21.15.38:38366) 2023-12-22T08:41:05.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.822+0000 7f7b1bfff640 1 -- 172.21.15.38:0/1196203057 learned_addr learned my addr 172.21.15.38:0/1196203057 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:05.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.822+0000 7f7b23fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7b24144d10 0x7f7b240cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.822+0000 7f7b23fff640 1 -- 172.21.15.38:0/1196203057 >> v1:172.21.15.89:6789/0 conn(0x7f7b240b2760 legacy=0x7f7b24070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.822+0000 7f7b23fff640 1 -- 172.21.15.38:0/1196203057 >> v1:172.21.15.38:6789/0 conn(0x7f7b240cc670 legacy=0x7f7b240b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.822+0000 7f7b23fff640 1 -- 172.21.15.38:0/1196203057 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b240ce5d0 con 0x7f7b24144d10 2023-12-22T08:41:05.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.822+0000 7f7b237fe640 1 -- 172.21.15.38:0/1196203057 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827781658 0 0) 0x7f7b241450f0 con 0x7f7b240cc670 2023-12-22T08:41:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.823+0000 7f7b23fff640 1 --2- 172.21.15.38:0/1196203057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b24144d10 0x7f7b240cc130 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7b140097a0 tx=0x7f7b1402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c971a264e0f5ff51 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.824+0000 7f7b237fe640 1 -- 172.21.15.38:0/1196203057 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14030610 con 0x7f7b24144d10 2023-12-22T08:41:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.824+0000 7f7b237fe640 1 -- 172.21.15.38:0/1196203057 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b14030770 con 0x7f7b24144d10 2023-12-22T08:41:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.824+0000 7f7b237fe640 1 -- 172.21.15.38:0/1196203057 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14030b00 con 0x7f7b24144d10 2023-12-22T08:41:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.824+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1196203057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b24144d10 msgr2=0x7f7b240cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.824+0000 7f7b2aa30640 1 --2- 172.21.15.38:0/1196203057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b24144d10 0x7f7b240cc130 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7b140097a0 tx=0x7f7b1402b960 comp rx=0 tx=0).stop 2023-12-22T08:41:05.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.824+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1196203057 shutdown_connections 2023-12-22T08:41:05.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.824+0000 7f7b2aa30640 1 --2- 172.21.15.38:0/1196203057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b24144d10 0x7f7b240cc130 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.824+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1196203057 >> 172.21.15.38:0/1196203057 conn(0x7f7b240cf070 msgr2=0x7f7b240cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:05.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.824+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1196203057 shutdown_connections 2023-12-22T08:41:05.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.825+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1196203057 wait complete. 2023-12-22T08:41:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.826+0000 7f7b2aa30640 1 Processor -- start 2023-12-22T08:41:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.826+0000 7f7b2aa30640 1 -- start start 2023-12-22T08:41:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.827+0000 7f7b2aa30640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b240b2760 0x7f7b240713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.827+0000 7f7b2aa30640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b24144d10 0x7f7b2415dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.827+0000 7f7b2aa30640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b241f6c70 0x7f7b241f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.827+0000 7f7b2aa30640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24071900 con 0x7f7b24144d10 2023-12-22T08:41:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.827+0000 7f7b2aa30640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240ae470 con 0x7f7b240b2760 2023-12-22T08:41:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.827+0000 7f7b2aa30640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24141ce0 con 0x7f7b241f6c70 2023-12-22T08:41:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.828+0000 7f7b1bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b24144d10 0x7f7b2415dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.828+0000 7f7b1bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b24144d10 0x7f7b2415dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38962/0 (socket says 172.21.15.38:38962) 2023-12-22T08:41:05.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.828+0000 7f7b1bfff640 1 -- 172.21.15.38:0/1587238404 learned_addr learned my addr 172.21.15.38:0/1587238404 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.828+0000 7f7b23fff640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b240b2760 0x7f7b240713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.828+0000 7f7b28fcd640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b241f6c70 0x7f7b241f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.828+0000 7f7b1bfff640 1 -- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b241f6c70 msgr2=0x7f7b241f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.828+0000 7f7b1bfff640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b241f6c70 0x7f7b241f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.828+0000 7f7b1bfff640 1 -- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b240b2760 msgr2=0x7f7b240713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.828+0000 7f7b1bfff640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b240b2760 0x7f7b240713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.828+0000 7f7b1bfff640 1 -- 172.21.15.38:0/1587238404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14009400 con 0x7f7b24144d10 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.829+0000 7f7b1bfff640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b24144d10 0x7f7b2415dbd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c460 tx=0x7f7b0c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.829+0000 7f7b217fa640 1 -- 172.21.15.38:0/1587238404 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c0074e0 con 0x7f7b24144d10 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.829+0000 7f7b217fa640 1 -- 172.21.15.38:0/1587238404 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c007680 con 0x7f7b24144d10 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.829+0000 7f7b217fa640 1 -- 172.21.15.38:0/1587238404 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c004a00 con 0x7f7b24144d10 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.829+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1587238404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b240a8ee0 con 0x7f7b24144d10 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.829+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1587238404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b240a94a0 con 0x7f7b24144d10 2023-12-22T08:41:05.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.830+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1587238404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b24061910 con 0x7f7b24144d10 2023-12-22T08:41:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.831+0000 7f7b217fa640 1 -- 172.21.15.38:0/1587238404 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7b0c004b60 con 0x7f7b24144d10 2023-12-22T08:41:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.832+0000 7f7b217fa640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b0406a430 0x7f7b0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.832+0000 7f7b217fa640 1 -- 172.21.15.38:0/1587238404 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7b0c0877a0 con 0x7f7b24144d10 2023-12-22T08:41:05.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.833+0000 7f7b23fff640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b0406a430 0x7f7b0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.834+0000 7f7b23fff640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b0406a430 0x7f7b0406c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7b14036000 tx=0x7f7b14008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:05.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:05.837+0000 7f7b217fa640 1 -- 172.21.15.38:0/1587238404 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7b0c053140 con 0x7f7b24144d10 2023-12-22T08:41:06.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.043+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1587238404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7b24144070 con 0x7f7b24144d10 2023-12-22T08:41:06.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.815+0000 7f7b217fa640 1 -- 172.21.15.38:0/1587238404 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7b0c018080 con 0x7f7b24144d10 2023-12-22T08:41:06.818 INFO:teuthology.orchestra.run.smithi038.stderr: removed all blocklist entries 2023-12-22T08:41:06.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.818+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b0406a430 msgr2=0x7f7b0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.818+0000 7f7b2aa30640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b0406a430 0x7f7b0406c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7b14036000 tx=0x7f7b14008030 comp rx=0 tx=0).stop 2023-12-22T08:41:06.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.818+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1587238404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b24144d10 msgr2=0x7f7b2415dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.818+0000 7f7b2aa30640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b24144d10 0x7f7b2415dbd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c460 tx=0x7f7b0c00c920 comp rx=0 tx=0).stop 2023-12-22T08:41:06.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.818+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1587238404 shutdown_connections 2023-12-22T08:41:06.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.818+0000 7f7b2aa30640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b241f6c70 0x7f7b241f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.818+0000 7f7b2aa30640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b0406a430 0x7f7b0406c8f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.818+0000 7f7b2aa30640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b24144d10 0x7f7b2415dbd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.818+0000 7f7b2aa30640 1 --2- 172.21.15.38:0/1587238404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b240b2760 0x7f7b240713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.818+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1587238404 >> 172.21.15.38:0/1587238404 conn(0x7f7b240cf070 msgr2=0x7f7b240b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:06.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.819+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1587238404 shutdown_connections 2023-12-22T08:41:06.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:06.819+0000 7f7b2aa30640 1 -- 172.21.15.38:0/1587238404 wait complete. 2023-12-22T08:41:06.842 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T08:41:07.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.047+0000 7f98fb626640 1 Processor -- start 2023-12-22T08:41:07.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.047+0000 7f98fb626640 1 -- start start 2023-12-22T08:41:07.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.049+0000 7f98fb626640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f40b3f90 0x7f98f415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.049+0000 7f98fb626640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f415eb20 con 0x7f98f406ca50 2023-12-22T08:41:07.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.049+0000 7f98fb626640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f4070770 con 0x7f98f415e740 2023-12-22T08:41:07.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.049+0000 7f98fb626640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f406e650 con 0x7f98f40b3f90 2023-12-22T08:41:07.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.049+0000 7f98f9bc3640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f98f406ca50 0x7f98f4070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38368/0 (socket says 172.21.15.38:38368) 2023-12-22T08:41:07.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.050+0000 7f98f9bc3640 1 -- 172.21.15.38:0/1032931413 learned_addr learned my addr 172.21.15.38:0/1032931413 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:07.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.050+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706190866 0 0) 0x7f98f415eb20 con 0x7f98f406ca50 2023-12-22T08:41:07.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.050+0000 7f98f8bc1640 1 --2- 172.21.15.38:0/1032931413 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f40b3f90 0x7f98f415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.050+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98e0003520 con 0x7f98f406ca50 2023-12-22T08:41:07.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.050+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3836120554 0 0) 0x7f98e0003520 con 0x7f98f406ca50 2023-12-22T08:41:07.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.050+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f40b3f90 msgr2=0x7f98f415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:07.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.050+0000 7f98ebfff640 1 --2- 172.21.15.38:0/1032931413 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f40b3f90 0x7f98f415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.050+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 >> v1:172.21.15.89:6789/0 conn(0x7f98f415e740 legacy=0x7f98f40b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.050+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f406cec0 con 0x7f98f406ca50 2023-12-22T08:41:07.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.050+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f98ec0019f0 con 0x7f98f406ca50 2023-12-22T08:41:07.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.050+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 >> v1:172.21.15.38:6789/0 conn(0x7f98f406ca50 legacy=0x7f98f4070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.051+0000 7f98ebfff640 1 --2- 172.21.15.38:0/1032931413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e00039a0 0x7f98e0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.051+0000 7f98ebfff640 1 --2- 172.21.15.38:0/1032931413 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98e00047c0 0x7f98e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.051+0000 7f98ebfff640 1 --2- 172.21.15.38:0/1032931413 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f40b3f90 0x7f98e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.051+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f406e650 con 0x7f98e00039a0 2023-12-22T08:41:07.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.051+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e00054e0 con 0x7f98e00047c0 2023-12-22T08:41:07.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.051+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e000bec0 con 0x7f98f40b3f90 2023-12-22T08:41:07.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.051+0000 7f98f93c2640 1 --2- 172.21.15.38:0/1032931413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e00039a0 0x7f98e0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.051+0000 7f98f93c2640 1 -- 172.21.15.38:0/1032931413 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f40b3f90 msgr2=0x7f98e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:07.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.051+0000 7f98f93c2640 1 --2- 172.21.15.38:0/1032931413 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f40b3f90 0x7f98e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.051+0000 7f98f93c2640 1 -- 172.21.15.38:0/1032931413 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98e00047c0 msgr2=0x7f98e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:07.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.051+0000 7f98f93c2640 1 --2- 172.21.15.38:0/1032931413 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98e00047c0 0x7f98e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.051+0000 7f98f93c2640 1 -- 172.21.15.38:0/1032931413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0003520 con 0x7f98e00039a0 2023-12-22T08:41:07.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.052+0000 7f98f93c2640 1 --2- 172.21.15.38:0/1032931413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e00039a0 0x7f98e0003dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f98f0001750 tx=0x7f98e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91566acbbba3a398 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.053+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f00052d0 con 0x7f98e00039a0 2023-12-22T08:41:07.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.053+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f002e050 con 0x7f98e00039a0 2023-12-22T08:41:07.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.053+0000 7f98ebfff640 1 -- 172.21.15.38:0/1032931413 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f00035f0 con 0x7f98e00039a0 2023-12-22T08:41:07.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.053+0000 7f98fb626640 1 -- 172.21.15.38:0/1032931413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e00039a0 msgr2=0x7f98e0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.053+0000 7f98fb626640 1 --2- 172.21.15.38:0/1032931413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e00039a0 0x7f98e0003dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f98f0001750 tx=0x7f98e00057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.053+0000 7f98f9bc3640 1 -- 172.21.15.38:0/1032931413 reap_dead start 2023-12-22T08:41:07.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.053+0000 7f98fb626640 1 -- 172.21.15.38:0/1032931413 shutdown_connections 2023-12-22T08:41:07.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.053+0000 7f98fb626640 1 -- 172.21.15.38:0/1032931413 >> 172.21.15.38:0/1032931413 conn(0x7f98f40cfea0 msgr2=0x7f98f40d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:07.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.053+0000 7f98fb626640 1 -- 172.21.15.38:0/1032931413 shutdown_connections 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.054+0000 7f98fb626640 1 -- 172.21.15.38:0/1032931413 wait complete. 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.055+0000 7f98fb626640 1 Processor -- start 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.055+0000 7f98fb626640 1 -- start start 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.056+0000 7f98fb626640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98e00039a0 0x7f98f40ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.056+0000 7f98fb626640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98f414d460 0x7f98f40b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.056+0000 7f98fb626640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f40b1fb0 0x7f98f41f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.056+0000 7f98fb626640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f4147950 con 0x7f98f414d460 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.056+0000 7f98fb626640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f414dfb0 con 0x7f98e00039a0 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.056+0000 7f98fb626640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f40ad8d0 con 0x7f98f40b1fb0 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.056+0000 7f98f8bc1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98f414d460 0x7f98f40b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.057+0000 7f98f8bc1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98f414d460 0x7f98f40b1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38966/0 (socket says 172.21.15.38:38966) 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.057+0000 7f98f8bc1640 1 -- 172.21.15.38:0/1747144140 learned_addr learned my addr 172.21.15.38:0/1747144140 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.057+0000 7f98f8bc1640 1 -- 172.21.15.38:0/1747144140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f40b1fb0 msgr2=0x7f98f41f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.057+0000 7f98f8bc1640 1 --2- 172.21.15.38:0/1747144140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f40b1fb0 0x7f98f41f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.057+0000 7f98f8bc1640 1 -- 172.21.15.38:0/1747144140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98e00039a0 msgr2=0x7f98f40ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.057+0000 7f98f8bc1640 1 --2- 172.21.15.38:0/1747144140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98e00039a0 0x7f98f40ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.057+0000 7f98f8bc1640 1 -- 172.21.15.38:0/1747144140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f40adbb0 con 0x7f98f414d460 2023-12-22T08:41:07.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.057+0000 7f98f8bc1640 1 --2- 172.21.15.38:0/1747144140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98f414d460 0x7f98f40b1a70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f98e400e7a0 tx=0x7f98e400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.057+0000 7f98e9ffb640 1 -- 172.21.15.38:0/1747144140 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400eeb0 con 0x7f98f414d460 2023-12-22T08:41:07.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.058+0000 7f98e9ffb640 1 -- 172.21.15.38:0/1747144140 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e400c940 con 0x7f98f414d460 2023-12-22T08:41:07.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.058+0000 7f98fb626640 1 -- 172.21.15.38:0/1747144140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f40ade90 con 0x7f98f414d460 2023-12-22T08:41:07.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.058+0000 7f98e9ffb640 1 -- 172.21.15.38:0/1747144140 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400cd10 con 0x7f98f414d460 2023-12-22T08:41:07.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.058+0000 7f98fb626640 1 -- 172.21.15.38:0/1747144140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f40ae450 con 0x7f98f414d460 2023-12-22T08:41:07.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.059+0000 7f98fb626640 1 -- 172.21.15.38:0/1747144140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f4061910 con 0x7f98f414d460 2023-12-22T08:41:07.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.060+0000 7f98e9ffb640 1 -- 172.21.15.38:0/1747144140 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f98e4013470 con 0x7f98f414d460 2023-12-22T08:41:07.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.061+0000 7f98e9ffb640 1 --2- 172.21.15.38:0/1747144140 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f98d806a430 0x7f98d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.061+0000 7f98e9ffb640 1 -- 172.21.15.38:0/1747144140 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98e40885d0 con 0x7f98f414d460 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.062+0000 7f98f93c2640 1 --2- 172.21.15.38:0/1747144140 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f98d806a430 0x7f98d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.063+0000 7f98f93c2640 1 --2- 172.21.15.38:0/1747144140 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f98d806a430 0x7f98d806c8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f98f0033000 tx=0x7f98f002f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.070+0000 7f98e9ffb640 1 -- 172.21.15.38:0/1747144140 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f98e4053f00 con 0x7f98f414d460 2023-12-22T08:41:07.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.336+0000 7f98fb626640 1 -- 172.21.15.38:0/1747144140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f98f406e130 con 0x7f98f414d460 2023-12-22T08:41:07.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.337+0000 7f98e9ffb640 1 -- 172.21.15.38:0/1747144140 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f98e4057520 con 0x7f98f414d460 2023-12-22T08:41:07.340 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:07.340 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:41:07.340 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_dump": [ 2023-12-22T08:41:07.340 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.340 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.a", 2023-12-22T08:41:07.340 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl57dkCBAAeliJIPc49iRBk2mp8WYv8A==", 2023-12-22T08:41:07.340 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.340 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:07.340 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:41:07.340 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:41:07.340 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.340 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.341 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.341 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.b", 2023-12-22T08:41:07.341 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl0C0+KhAAkCsjfyn19nOz1xTyhZkbPQ==", 2023-12-22T08:41:07.341 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.341 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:07.341 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:41:07.341 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:41:07.341 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.341 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.341 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.341 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.c", 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl7poXGhAA+ZSohyj4dAOs6B5dZKTLAg==", 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.d", 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4VlTBuoOhAArKX4AiOQRGawIyAnInIhCg==", 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:41:07.342 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.0", 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VlnVQaChAAxfWmPqwo5D4qBYkAP/6dHQ==", 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.1", 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4Vll2dlGxAAbqx4rxnz4FWIKl9OGqcwtw==", 2023-12-22T08:41:07.343 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.2", 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VljQ3HLRAAfyrtqD4n6Da8Rl/6UKmv7g==", 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.344 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.3", 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBCS4VlOat4AxAAIkAGRvGGWrrwx/ppMbexWQ==", 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.4", 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlwg7TDxAA+L504F+Hw/6FTJ63cV3ZXg==", 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:07.345 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:07.346 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.346 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.346 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.346 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.346 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.5", 2023-12-22T08:41:07.346 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx8zgHxAALBDm/sSYqw/fn4nLNQbu4A==", 2023-12-22T08:41:07.346 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.346 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:07.346 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:07.346 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.346 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.347 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.347 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.347 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.6", 2023-12-22T08:41:07.347 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx5OdLxAAaMP09nYI3HKiuhPARgnCOw==", 2023-12-22T08:41:07.347 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.347 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:07.347 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:07.347 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.347 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.347 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.347 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.347 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.7", 2023-12-22T08:41:07.347 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBHS4Vl/15bBBAA4maatkcgA0axcZY/L9r/IA==", 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.0", 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlgDspDhAA0TWGbk4AbuOhCNotPej29A==", 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:41:07.348 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.1", 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlwSk/JhAAM3faae43p4/gw9BmyxLpJA==", 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.2", 2023-12-22T08:41:07.349 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VliOHMGhAARaM8FC/0maNMToLGhBR4Tg==", 2023-12-22T08:41:07.350 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.350 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:07.350 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:41:07.350 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:41:07.350 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:41:07.350 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.350 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.350 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.351 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.3", 2023-12-22T08:41:07.351 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlV/MVMRAAyN1643IAOTLOLuz4DqMZ8A==", 2023-12-22T08:41:07.351 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.351 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:07.351 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:41:07.351 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:41:07.351 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:41:07.351 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.351 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.352 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.352 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.admin", 2023-12-22T08:41:07.352 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA2S4VlBhogNhAACBsSGP7kmhCSn+XAKkvgKQ==", 2023-12-22T08:41:07.352 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.352 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:41:07.352 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:41:07.352 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:41:07.352 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.352 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.353 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.353 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-mds", 2023-12-22T08:41:07.353 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBNS4VlpJ1QBRAAsWGLl+UpQoReFnbe5Dii6g==", 2023-12-22T08:41:07.353 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.353 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-mds" 2023-12-22T08:41:07.353 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.354 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.354 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-mgr", 2023-12-22T08:41:07.354 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBNS4VlXKdQBRAAyU65zjtEmkTBlQU4J8lgtw==", 2023-12-22T08:41:07.354 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.354 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-22T08:41:07.354 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.354 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.355 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.355 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-osd", 2023-12-22T08:41:07.355 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBNS4VlCbBQBRAAWG/4sIA6dKPKVDZiR0LUfA==", 2023-12-22T08:41:07.355 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.355 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-osd" 2023-12-22T08:41:07.355 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.356 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.356 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.356 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-rbd", 2023-12-22T08:41:07.356 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBNS4VlXLhQBRAAr5ibAO88g3xs15xPW3nvwQ==", 2023-12-22T08:41:07.356 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.356 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-22T08:41:07.356 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.356 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.356 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.357 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-22T08:41:07.357 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBNS4VlFcFQBRAA/4j7D41lFGSXdlZftSxZ4A==", 2023-12-22T08:41:07.357 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.357 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-22T08:41:07.357 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.357 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.357 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.357 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.bootstrap-rgw", 2023-12-22T08:41:07.358 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBNS4Vl7MlQBRAAz4ehhI1wzKgplPrr9eEH5Q==", 2023-12-22T08:41:07.358 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.358 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-22T08:41:07.358 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.358 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.358 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.358 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.x", 2023-12-22T08:41:07.358 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlTHG+NhAAUNkVtrDuoK2OEsy1HHkt2A==", 2023-12-22T08:41:07.358 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.358 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:41:07.358 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:41:07.358 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.359 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.359 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:07.359 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:07.359 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.y", 2023-12-22T08:41:07.359 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlED5ALBAAComDf9woKBt/IXcez+Udmg==", 2023-12-22T08:41:07.359 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:07.359 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:41:07.359 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:41:07.359 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:07.359 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.359 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:07.359 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:41:07.359 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:41:07.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.339+0000 7f98fb626640 1 -- 172.21.15.38:0/1747144140 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f98d806a430 msgr2=0x7f98d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.339+0000 7f98fb626640 1 --2- 172.21.15.38:0/1747144140 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f98d806a430 0x7f98d806c8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f98f0033000 tx=0x7f98f002f000 comp rx=0 tx=0).stop 2023-12-22T08:41:07.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.339+0000 7f98fb626640 1 -- 172.21.15.38:0/1747144140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98f414d460 msgr2=0x7f98f40b1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.339+0000 7f98fb626640 1 --2- 172.21.15.38:0/1747144140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98f414d460 0x7f98f40b1a70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f98e400e7a0 tx=0x7f98e400ec60 comp rx=0 tx=0).stop 2023-12-22T08:41:07.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.340+0000 7f98fb626640 1 -- 172.21.15.38:0/1747144140 shutdown_connections 2023-12-22T08:41:07.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.340+0000 7f98fb626640 1 --2- 172.21.15.38:0/1747144140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98f40b1fb0 0x7f98f41f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.340+0000 7f98fb626640 1 --2- 172.21.15.38:0/1747144140 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f98d806a430 0x7f98d806c8f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.340+0000 7f98fb626640 1 --2- 172.21.15.38:0/1747144140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98f414d460 0x7f98f40b1a70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.340+0000 7f98fb626640 1 --2- 172.21.15.38:0/1747144140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98e00039a0 0x7f98f40ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.340+0000 7f98fb626640 1 -- 172.21.15.38:0/1747144140 >> 172.21.15.38:0/1747144140 conn(0x7f98f40cfea0 msgr2=0x7f98f415d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:07.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.340+0000 7f98fb626640 1 -- 172.21.15.38:0/1747144140 shutdown_connections 2023-12-22T08:41:07.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.340+0000 7f98fb626640 1 -- 172.21.15.38:0/1747144140 wait complete. 2023-12-22T08:41:07.362 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-22T08:41:07.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.560+0000 7f7e8e04c640 1 Processor -- start 2023-12-22T08:41:07.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.560+0000 7f7e8e04c640 1 -- start start 2023-12-22T08:41:07.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.562+0000 7f7e8e04c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e880b3f90 0x7f7e8815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.562+0000 7f7e8e04c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8815eb20 con 0x7f7e8815e740 2023-12-22T08:41:07.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.562+0000 7f7e8e04c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e88070770 con 0x7f7e8806ca50 2023-12-22T08:41:07.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.562+0000 7f7e8e04c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8806e650 con 0x7f7e880b3f90 2023-12-22T08:41:07.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.562+0000 7f7e877fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7e8815e740 0x7f7e880b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38376/0 (socket says 172.21.15.38:38376) 2023-12-22T08:41:07.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.562+0000 7f7e877fe640 1 -- 172.21.15.38:0/1915950800 learned_addr learned my addr 172.21.15.38:0/1915950800 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:07.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.563+0000 7f7e7ffff640 1 --2- 172.21.15.38:0/1915950800 >> v2:172.21.15.89:3300/0 conn(0x7f7e880b3f90 0x7f7e8815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.563+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285505238 0 0) 0x7f7e8815eb20 con 0x7f7e8815e740 2023-12-22T08:41:07.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.563+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e74003520 con 0x7f7e8815e740 2023-12-22T08:41:07.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.563+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 718694360 0 0) 0x7f7e74003520 con 0x7f7e8815e740 2023-12-22T08:41:07.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.563+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 >> v2:172.21.15.89:3300/0 conn(0x7f7e880b3f90 msgr2=0x7f7e8815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.563+0000 7f7e86ffd640 1 --2- 172.21.15.38:0/1915950800 >> v2:172.21.15.89:3300/0 conn(0x7f7e880b3f90 0x7f7e8815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.563+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 >> v1:172.21.15.89:6789/0 conn(0x7f7e8806ca50 legacy=0x7f7e88070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.563+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8806d180 con 0x7f7e8815e740 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.563+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f7e78001670 con 0x7f7e8815e740 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.563+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 >> v1:172.21.15.38:6789/0 conn(0x7f7e8815e740 legacy=0x7f7e880b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.563+0000 7f7e86ffd640 1 --2- 172.21.15.38:0/1915950800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e74003970 0x7f7e74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.563+0000 7f7e86ffd640 1 --2- 172.21.15.38:0/1915950800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e740047c0 0x7f7e74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.564+0000 7f7e86ffd640 1 --2- 172.21.15.38:0/1915950800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e740052a0 0x7f7e7400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.564+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8806e650 con 0x7f7e740052a0 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.564+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7400c170 con 0x7f7e74003970 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.564+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7400c330 con 0x7f7e740047c0 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.564+0000 7f7e87fff640 1 --2- 172.21.15.38:0/1915950800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e740052a0 0x7f7e7400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.564+0000 7f7e877fe640 1 --2- 172.21.15.38:0/1915950800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e74003970 0x7f7e74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.564+0000 7f7e87fff640 1 -- 172.21.15.38:0/1915950800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e740047c0 msgr2=0x7f7e74004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:07.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.564+0000 7f7e87fff640 1 --2- 172.21.15.38:0/1915950800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e740047c0 0x7f7e74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.564+0000 7f7e87fff640 1 -- 172.21.15.38:0/1915950800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e74003970 msgr2=0x7f7e74003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:07.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.564+0000 7f7e87fff640 1 --2- 172.21.15.38:0/1915950800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e74003970 0x7f7e74003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.564+0000 7f7e87fff640 1 -- 172.21.15.38:0/1915950800 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e74003520 con 0x7f7e740052a0 2023-12-22T08:41:07.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.564+0000 7f7e877fe640 1 --2- 172.21.15.38:0/1915950800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e74003970 0x7f7e74003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:07.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.565+0000 7f7e87fff640 1 -- 172.21.15.38:0/1915950800 reap_dead start 2023-12-22T08:41:07.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.565+0000 7f7e87fff640 1 --2- 172.21.15.38:0/1915950800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e740052a0 0x7f7e7400b980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7e80001e20 tx=0x7f7e740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d982b5dac2f6c3f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.566+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80003b70 con 0x7f7e740052a0 2023-12-22T08:41:07.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.566+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e80003cd0 con 0x7f7e740052a0 2023-12-22T08:41:07.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.566+0000 7f7e86ffd640 1 -- 172.21.15.38:0/1915950800 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80005310 con 0x7f7e740052a0 2023-12-22T08:41:07.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.566+0000 7f7e8e04c640 1 -- 172.21.15.38:0/1915950800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e740052a0 msgr2=0x7f7e7400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.566+0000 7f7e8e04c640 1 --2- 172.21.15.38:0/1915950800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e740052a0 0x7f7e7400b980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7e80001e20 tx=0x7f7e740057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.566+0000 7f7e8e04c640 1 -- 172.21.15.38:0/1915950800 shutdown_connections 2023-12-22T08:41:07.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.566+0000 7f7e8e04c640 1 --2- 172.21.15.38:0/1915950800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e740052a0 0x7f7e7400b980 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.566+0000 7f7e8e04c640 1 -- 172.21.15.38:0/1915950800 >> 172.21.15.38:0/1915950800 conn(0x7f7e880cfea0 msgr2=0x7f7e880d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:07.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.566+0000 7f7e8e04c640 1 -- 172.21.15.38:0/1915950800 shutdown_connections 2023-12-22T08:41:07.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.566+0000 7f7e8e04c640 1 -- 172.21.15.38:0/1915950800 wait complete. 2023-12-22T08:41:07.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.568+0000 7f7e8e04c640 1 Processor -- start 2023-12-22T08:41:07.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.568+0000 7f7e8e04c640 1 -- start start 2023-12-22T08:41:07.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.569+0000 7f7e8e04c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e740052a0 0x7f7e880b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.569+0000 7f7e8e04c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e880ad470 0x7f7e8814fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.569+0000 7f7e8e04c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e880ad8f0 0x7f7e8814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.569+0000 7f7e8e04c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8815fb90 con 0x7f7e880ad8f0 2023-12-22T08:41:07.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.569+0000 7f7e8e04c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880b09d0 con 0x7f7e880ad470 2023-12-22T08:41:07.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.569+0000 7f7e8e04c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e881f6e70 con 0x7f7e740052a0 2023-12-22T08:41:07.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.569+0000 7f7e87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e880ad8f0 0x7f7e8814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.569+0000 7f7e87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e880ad8f0 0x7f7e8814ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38972/0 (socket says 172.21.15.38:38972) 2023-12-22T08:41:07.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.569+0000 7f7e87fff640 1 -- 172.21.15.38:0/2073088719 learned_addr learned my addr 172.21.15.38:0/2073088719 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:07.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.570+0000 7f7e87fff640 1 -- 172.21.15.38:0/2073088719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e740052a0 msgr2=0x7f7e880b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.570+0000 7f7e87fff640 1 --2- 172.21.15.38:0/2073088719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e740052a0 0x7f7e880b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.570+0000 7f7e87fff640 1 -- 172.21.15.38:0/2073088719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e880ad470 msgr2=0x7f7e8814fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.570+0000 7f7e7ffff640 1 --2- 172.21.15.38:0/2073088719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e880ad470 0x7f7e8814fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.570+0000 7f7e87fff640 1 --2- 172.21.15.38:0/2073088719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e880ad470 0x7f7e8814fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.570+0000 7f7e87fff640 1 -- 172.21.15.38:0/2073088719 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8815f1f0 con 0x7f7e880ad8f0 2023-12-22T08:41:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.570+0000 7f7e87fff640 1 --2- 172.21.15.38:0/2073088719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e880ad8f0 0x7f7e8814ff80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7e80001f40 tx=0x7f7e800014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.570+0000 7f7e84ff9640 1 -- 172.21.15.38:0/2073088719 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80043680 con 0x7f7e880ad8f0 2023-12-22T08:41:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.570+0000 7f7e84ff9640 1 -- 172.21.15.38:0/2073088719 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8003c070 con 0x7f7e880ad8f0 2023-12-22T08:41:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.570+0000 7f7e84ff9640 1 -- 172.21.15.38:0/2073088719 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80043a20 con 0x7f7e880ad8f0 2023-12-22T08:41:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.570+0000 7f7e8e04c640 1 -- 172.21.15.38:0/2073088719 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8815f4d0 con 0x7f7e880ad8f0 2023-12-22T08:41:07.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.571+0000 7f7e8e04c640 1 -- 172.21.15.38:0/2073088719 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e880b26a0 con 0x7f7e880ad8f0 2023-12-22T08:41:07.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.572+0000 7f7e8e04c640 1 -- 172.21.15.38:0/2073088719 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e880b2830 con 0x7f7e880ad8f0 2023-12-22T08:41:07.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.573+0000 7f7e84ff9640 1 -- 172.21.15.38:0/2073088719 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e80043b80 con 0x7f7e880ad8f0 2023-12-22T08:41:07.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.573+0000 7f7e84ff9640 1 --2- 172.21.15.38:0/2073088719 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e6806a430 0x7f7e6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.574+0000 7f7e84ff9640 1 -- 172.21.15.38:0/2073088719 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7e8003e070 con 0x7f7e880ad8f0 2023-12-22T08:41:07.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.574+0000 7f7e877fe640 1 --2- 172.21.15.38:0/2073088719 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e6806a430 0x7f7e6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.575+0000 7f7e877fe640 1 --2- 172.21.15.38:0/2073088719 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e6806a430 0x7f7e6806c8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7e78001200 tx=0x7f7e78009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.577+0000 7f7e84ff9640 1 -- 172.21.15.38:0/2073088719 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7e80075b80 con 0x7f7e880ad8f0 2023-12-22T08:41:07.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.843+0000 7f7e8e04c640 1 -- 172.21.15.38:0/2073088719 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7e88061910 con 0x7f7e880ad8f0 2023-12-22T08:41:07.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.851+0000 7f7e84ff9640 1 -- 172.21.15.38:0/2073088719 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7e800791a0 con 0x7f7e880ad8f0 2023-12-22T08:41:07.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.853+0000 7f7e8e04c640 1 -- 172.21.15.38:0/2073088719 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e6806a430 msgr2=0x7f7e6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.853+0000 7f7e8e04c640 1 --2- 172.21.15.38:0/2073088719 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e6806a430 0x7f7e6806c8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7e78001200 tx=0x7f7e78009040 comp rx=0 tx=0).stop 2023-12-22T08:41:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.853+0000 7f7e8e04c640 1 -- 172.21.15.38:0/2073088719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e880ad8f0 msgr2=0x7f7e8814ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.853+0000 7f7e8e04c640 1 --2- 172.21.15.38:0/2073088719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e880ad8f0 0x7f7e8814ff80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7e80001f40 tx=0x7f7e800014a0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.854+0000 7f7e8e04c640 1 -- 172.21.15.38:0/2073088719 shutdown_connections 2023-12-22T08:41:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.854+0000 7f7e8e04c640 1 --2- 172.21.15.38:0/2073088719 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e6806a430 0x7f7e6806c8f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.854+0000 7f7e8e04c640 1 --2- 172.21.15.38:0/2073088719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e880ad8f0 0x7f7e8814ff80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.854+0000 7f7e8e04c640 1 --2- 172.21.15.38:0/2073088719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e880ad470 0x7f7e8814fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.854+0000 7f7e8e04c640 1 --2- 172.21.15.38:0/2073088719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e740052a0 0x7f7e880b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.854+0000 7f7e8e04c640 1 -- 172.21.15.38:0/2073088719 >> 172.21.15.38:0/2073088719 conn(0x7f7e880cfea0 msgr2=0x7f7e8815b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.854+0000 7f7e8e04c640 1 -- 172.21.15.38:0/2073088719 shutdown_connections 2023-12-22T08:41:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:07.854+0000 7f7e8e04c640 1 -- 172.21.15.38:0/2073088719 wait complete. 2023-12-22T08:41:07.873 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-22T08:41:08.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.074+0000 7f62a1930640 1 Processor -- start 2023-12-22T08:41:08.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.074+0000 7f62a1930640 1 -- start start 2023-12-22T08:41:08.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.075+0000 7f62a1930640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f629c157980 0x7f629c15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.075+0000 7f62a1930640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f629c0b3ff0 0x7f629c06cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.076+0000 7f62a1930640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629c0d1520 con 0x7f629c0b4470 2023-12-22T08:41:08.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.076+0000 7f62a1930640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c0d1800 con 0x7f629c0b3ff0 2023-12-22T08:41:08.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.076+0000 7f62a1930640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0d1ae0 con 0x7f629c157980 2023-12-22T08:41:08.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.076+0000 7f62a092e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f629c157980 0x7f629c15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.076+0000 7f62a092e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f629c157980 0x7f629c15eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:55898/0 (socket says 172.21.15.38:55898) 2023-12-22T08:41:08.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.076+0000 7f62a092e640 1 -- 172.21.15.38:0/2538848840 learned_addr learned my addr 172.21.15.38:0/2538848840 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:08.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.076+0000 7f629bfff640 1 --2- 172.21.15.38:0/2538848840 >> v2:172.21.15.89:3300/0 conn(0x7f629c0b3ff0 0x7f629c06cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.077+0000 7f629bfff640 1 -- 172.21.15.38:0/2538848840 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f629c157980 msgr2=0x7f629c15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:08.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.077+0000 7f629bfff640 1 --2- 172.21.15.38:0/2538848840 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f629c157980 0x7f629c15eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.077+0000 7f629bfff640 1 -- 172.21.15.38:0/2538848840 >> v1:172.21.15.89:6789/0 conn(0x7f629c0b4470 legacy=0x7f629c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.077+0000 7f629bfff640 1 -- 172.21.15.38:0/2538848840 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c0d1dc0 con 0x7f629c0b3ff0 2023-12-22T08:41:08.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.079+0000 7f629bfff640 1 --2- 172.21.15.38:0/2538848840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f629c0b3ff0 0x7f629c06cf30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f62880097a0 tx=0x7f628802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9400f97647f2231d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.079+0000 7f629b7fe640 1 -- 172.21.15.38:0/2538848840 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288031830 con 0x7f629c0b3ff0 2023-12-22T08:41:08.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.079+0000 7f629b7fe640 1 -- 172.21.15.38:0/2538848840 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6288031990 con 0x7f629c0b3ff0 2023-12-22T08:41:08.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.079+0000 7f629b7fe640 1 -- 172.21.15.38:0/2538848840 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288031d20 con 0x7f629c0b3ff0 2023-12-22T08:41:08.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.080+0000 7f62a1930640 1 -- 172.21.15.38:0/2538848840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f629c0b3ff0 msgr2=0x7f629c06cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.080+0000 7f62a1930640 1 --2- 172.21.15.38:0/2538848840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f629c0b3ff0 0x7f629c06cf30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f62880097a0 tx=0x7f628802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.080+0000 7f62a1930640 1 -- 172.21.15.38:0/2538848840 shutdown_connections 2023-12-22T08:41:08.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.080+0000 7f62a1930640 1 --2- 172.21.15.38:0/2538848840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f629c0b3ff0 0x7f629c06cf30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.080+0000 7f62a1930640 1 --2- 172.21.15.38:0/2538848840 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f629c157980 0x7f629c15eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.080+0000 7f62a1930640 1 -- 172.21.15.38:0/2538848840 >> 172.21.15.38:0/2538848840 conn(0x7f629c0d31f0 msgr2=0x7f629c0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:08.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.080+0000 7f62a1930640 1 -- 172.21.15.38:0/2538848840 shutdown_connections 2023-12-22T08:41:08.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.080+0000 7f62a1930640 1 -- 172.21.15.38:0/2538848840 wait complete. 2023-12-22T08:41:08.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.083+0000 7f62a1930640 1 Processor -- start 2023-12-22T08:41:08.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.083+0000 7f62a1930640 1 -- start start 2023-12-22T08:41:08.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.084+0000 7f62a1930640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f629c0b3ff0 0x7f629c15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.084+0000 7f62a1930640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f629c0b4470 0x7f629c14f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.084+0000 7f62a1930640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f629c157980 0x7f629c14f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.084+0000 7f62a1930640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c14fdf0 con 0x7f629c0b4470 2023-12-22T08:41:08.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.084+0000 7f62a1930640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c1500d0 con 0x7f629c0b3ff0 2023-12-22T08:41:08.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.084+0000 7f62a1930640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c1503b0 con 0x7f629c157980 2023-12-22T08:41:08.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.084+0000 7f629bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f629c0b4470 0x7f629c14f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.084+0000 7f629bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f629c0b4470 0x7f629c14f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38988/0 (socket says 172.21.15.38:38988) 2023-12-22T08:41:08.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.084+0000 7f629bfff640 1 -- 172.21.15.38:0/422266464 learned_addr learned my addr 172.21.15.38:0/422266464 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:08.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.085+0000 7f62a092e640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f629c0b3ff0 0x7f629c15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.085+0000 7f62a112f640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f629c157980 0x7f629c14f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.085+0000 7f629bfff640 1 -- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f629c157980 msgr2=0x7f629c14f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.085+0000 7f629bfff640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f629c157980 0x7f629c14f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.085+0000 7f629bfff640 1 -- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f629c0b3ff0 msgr2=0x7f629c15ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.085+0000 7f629bfff640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f629c0b3ff0 0x7f629c15ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.085+0000 7f629bfff640 1 -- 172.21.15.38:0/422266464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6288009400 con 0x7f629c0b4470 2023-12-22T08:41:08.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.085+0000 7f62a112f640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f629c157980 0x7f629c14f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:08.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.085+0000 7f62a092e640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f629c0b3ff0 0x7f629c15ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:08.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.085+0000 7f629bfff640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f629c0b4470 0x7f629c14f080 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f628802bee0 tx=0x7f62880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.086+0000 7f62997fa640 1 -- 172.21.15.38:0/422266464 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628803a6f0 con 0x7f629c0b4470 2023-12-22T08:41:08.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.086+0000 7f62997fa640 1 -- 172.21.15.38:0/422266464 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628803a870 con 0x7f629c0b4470 2023-12-22T08:41:08.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.086+0000 7f62997fa640 1 -- 172.21.15.38:0/422266464 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628803ac20 con 0x7f629c0b4470 2023-12-22T08:41:08.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.086+0000 7f62a1930640 1 -- 172.21.15.38:0/422266464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629c150690 con 0x7f629c0b4470 2023-12-22T08:41:08.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.086+0000 7f62a1930640 1 -- 172.21.15.38:0/422266464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629c15f260 con 0x7f629c0b4470 2023-12-22T08:41:08.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.087+0000 7f62a1930640 1 -- 172.21.15.38:0/422266464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629c061910 con 0x7f629c0b4470 2023-12-22T08:41:08.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.088+0000 7f62997fa640 1 -- 172.21.15.38:0/422266464 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6288030380 con 0x7f629c0b4470 2023-12-22T08:41:08.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.089+0000 7f62997fa640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f628006a430 0x7f628006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.089+0000 7f62997fa640 1 -- 172.21.15.38:0/422266464 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f62880a9f90 con 0x7f629c0b4470 2023-12-22T08:41:08.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.090+0000 7f62a092e640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f628006a430 0x7f628006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.091+0000 7f62a092e640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f628006a430 0x7f628006c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f629c14edf0 tx=0x7f6290008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.094+0000 7f62997fa640 1 -- 172.21.15.38:0/422266464 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f62880758c0 con 0x7f629c0b4470 2023-12-22T08:41:08.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.346+0000 7f62a1930640 1 -- 172.21.15.38:0/422266464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f629c154cd0 con 0x7f629c0b4470 2023-12-22T08:41:08.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.353+0000 7f62997fa640 1 -- 172.21.15.38:0/422266464 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f62880350a0 con 0x7f629c0b4470 2023-12-22T08:41:08.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.355+0000 7f62a1930640 1 -- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f628006a430 msgr2=0x7f628006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.355+0000 7f62a1930640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f628006a430 0x7f628006c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f629c14edf0 tx=0x7f6290008040 comp rx=0 tx=0).stop 2023-12-22T08:41:08.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.355+0000 7f62a1930640 1 -- 172.21.15.38:0/422266464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f629c0b4470 msgr2=0x7f629c14f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.355+0000 7f62a1930640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f629c0b4470 0x7f629c14f080 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f628802bee0 tx=0x7f62880046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.355+0000 7f62a1930640 1 -- 172.21.15.38:0/422266464 shutdown_connections 2023-12-22T08:41:08.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.355+0000 7f62a1930640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f629c157980 0x7f629c14f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.355+0000 7f62a1930640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f628006a430 0x7f628006c8f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.355+0000 7f62a1930640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f629c0b4470 0x7f629c14f080 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.355+0000 7f62a1930640 1 --2- 172.21.15.38:0/422266464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f629c0b3ff0 0x7f629c15ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.355+0000 7f62a1930640 1 -- 172.21.15.38:0/422266464 >> 172.21.15.38:0/422266464 conn(0x7f629c0d31f0 msgr2=0x7f629c06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:08.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.356+0000 7f62a1930640 1 -- 172.21.15.38:0/422266464 shutdown_connections 2023-12-22T08:41:08.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.356+0000 7f62a1930640 1 -- 172.21.15.38:0/422266464 wait complete. 2023-12-22T08:41:08.375 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-22T08:41:08.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.579+0000 7f686c834640 1 Processor -- start 2023-12-22T08:41:08.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.579+0000 7f686c834640 1 -- start start 2023-12-22T08:41:08.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.580+0000 7f686c834640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f686806d640 0x7f68680d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.580+0000 7f686c834640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686815f220 con 0x7f68680b3ff0 2023-12-22T08:41:08.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.580+0000 7f686c834640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68680d1520 con 0x7f6868157980 2023-12-22T08:41:08.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.580+0000 7f686c834640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68680d1800 con 0x7f686806d640 2023-12-22T08:41:08.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.581+0000 7f6866ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f68680b3ff0 0x7f686806cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38386/0 (socket says 172.21.15.38:38386) 2023-12-22T08:41:08.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.581+0000 7f6866ffd640 1 -- 172.21.15.38:0/2576417621 learned_addr learned my addr 172.21.15.38:0/2576417621 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:08.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.581+0000 7f6867fff640 1 --2- 172.21.15.38:0/2576417621 >> v2:172.21.15.89:3300/0 conn(0x7f686806d640 0x7f68680d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.581+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018351630 0 0) 0x7f686815f220 con 0x7f68680b3ff0 2023-12-22T08:41:08.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.581+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6854003520 con 0x7f68680b3ff0 2023-12-22T08:41:08.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107598142 0 0) 0x7f68680d1520 con 0x7f6868157980 2023-12-22T08:41:08.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f686815f220 con 0x7f6868157980 2023-12-22T08:41:08.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2334883724 0 0) 0x7f6854003520 con 0x7f68680b3ff0 2023-12-22T08:41:08.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 >> v2:172.21.15.89:3300/0 conn(0x7f686806d640 msgr2=0x7f68680d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:08.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 --2- 172.21.15.38:0/2576417621 >> v2:172.21.15.89:3300/0 conn(0x7f686806d640 0x7f68680d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 >> v1:172.21.15.89:6789/0 conn(0x7f6868157980 legacy=0x7f686815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68680d1ae0 con 0x7f68680b3ff0 2023-12-22T08:41:08.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f6850001670 con 0x7f68680b3ff0 2023-12-22T08:41:08.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 >> v1:172.21.15.38:6789/0 conn(0x7f68680b3ff0 legacy=0x7f686806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 --2- 172.21.15.38:0/2576417621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6854003b50 0x7f6854003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 --2- 172.21.15.38:0/2576417621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68540047c0 0x7f6854004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 --2- 172.21.15.38:0/2576417621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6854005180 0x7f685400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68680d1800 con 0x7f6854005180 2023-12-22T08:41:08.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685400c050 con 0x7f6854003b50 2023-12-22T08:41:08.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685400c210 con 0x7f68540047c0 2023-12-22T08:41:08.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f6867fff640 1 --2- 172.21.15.38:0/2576417621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6854005180 0x7f685400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.582+0000 7f6866ffd640 1 --2- 172.21.15.38:0/2576417621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68540047c0 0x7f6854004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.583+0000 7f68677fe640 1 --2- 172.21.15.38:0/2576417621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6854003b50 0x7f6854003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.583+0000 7f6867fff640 1 -- 172.21.15.38:0/2576417621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68540047c0 msgr2=0x7f6854004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:08.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.583+0000 7f6867fff640 1 --2- 172.21.15.38:0/2576417621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68540047c0 0x7f6854004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.583+0000 7f6867fff640 1 -- 172.21.15.38:0/2576417621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6854003b50 msgr2=0x7f6854003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:08.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.583+0000 7f6867fff640 1 --2- 172.21.15.38:0/2576417621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6854003b50 0x7f6854003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.583+0000 7f6867fff640 1 -- 172.21.15.38:0/2576417621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854003520 con 0x7f6854005180 2023-12-22T08:41:08.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.583+0000 7f68677fe640 1 --2- 172.21.15.38:0/2576417621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6854003b50 0x7f6854003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:08.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.584+0000 7f6867fff640 1 -- 172.21.15.38:0/2576417621 reap_dead start 2023-12-22T08:41:08.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.584+0000 7f6867fff640 1 --2- 172.21.15.38:0/2576417621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6854005180 0x7f685400b980 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6860009a90 tx=0x7f68540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc94bb6ddf0512b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.584+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686002c6b0 con 0x7f6854005180 2023-12-22T08:41:08.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.584+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686002c830 con 0x7f6854005180 2023-12-22T08:41:08.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.584+0000 7f68667fc640 1 -- 172.21.15.38:0/2576417621 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686002cbe0 con 0x7f6854005180 2023-12-22T08:41:08.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.585+0000 7f686c834640 1 -- 172.21.15.38:0/2576417621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6854005180 msgr2=0x7f685400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.585+0000 7f686c834640 1 --2- 172.21.15.38:0/2576417621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6854005180 0x7f685400b980 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6860009a90 tx=0x7f68540057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.585+0000 7f686c834640 1 -- 172.21.15.38:0/2576417621 shutdown_connections 2023-12-22T08:41:08.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.585+0000 7f686c834640 1 --2- 172.21.15.38:0/2576417621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6854005180 0x7f685400b980 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.585+0000 7f686c834640 1 -- 172.21.15.38:0/2576417621 >> 172.21.15.38:0/2576417621 conn(0x7f68680d31f0 msgr2=0x7f68680d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:08.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.585+0000 7f686c834640 1 -- 172.21.15.38:0/2576417621 shutdown_connections 2023-12-22T08:41:08.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.585+0000 7f686c834640 1 -- 172.21.15.38:0/2576417621 wait complete. 2023-12-22T08:41:08.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.587+0000 7f686c834640 1 Processor -- start 2023-12-22T08:41:08.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.587+0000 7f686c834640 1 -- start start 2023-12-22T08:41:08.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.588+0000 7f686c834640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6854005180 0x7f68680ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.588+0000 7f686c834640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68680b8670 0x7f6868155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.588+0000 7f686c834640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f686815f3f0 0x7f686815f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.588+0000 7f686c834640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6868160b40 con 0x7f6854005180 2023-12-22T08:41:08.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.588+0000 7f686c834640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686815fdb0 con 0x7f68680b8670 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.588+0000 7f686c834640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68680b7fa0 con 0x7f686815f3f0 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.588+0000 7f68677fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6854005180 0x7f68680ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.588+0000 7f68677fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6854005180 0x7f68680ad2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39006/0 (socket says 172.21.15.38:39006) 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.588+0000 7f68677fe640 1 -- 172.21.15.38:0/243643535 learned_addr learned my addr 172.21.15.38:0/243643535 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.588+0000 7f6866ffd640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68680b8670 0x7f6868155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.588+0000 7f6867fff640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f686815f3f0 0x7f686815f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.589+0000 7f68677fe640 1 -- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f686815f3f0 msgr2=0x7f686815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.589+0000 7f68677fe640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f686815f3f0 0x7f686815f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.589+0000 7f68677fe640 1 -- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68680b8670 msgr2=0x7f6868155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.589+0000 7f68677fe640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68680b8670 0x7f6868155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.589+0000 7f68677fe640 1 -- 172.21.15.38:0/243643535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68680b6f00 con 0x7f6854005180 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.589+0000 7f68677fe640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6854005180 0x7f68680ad2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f685800db10 tx=0x7f685800df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.589+0000 7f685ffff640 1 -- 172.21.15.38:0/243643535 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858006d50 con 0x7f6854005180 2023-12-22T08:41:08.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.589+0000 7f685ffff640 1 -- 172.21.15.38:0/243643535 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685800b960 con 0x7f6854005180 2023-12-22T08:41:08.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.589+0000 7f685ffff640 1 -- 172.21.15.38:0/243643535 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685800bd10 con 0x7f6854005180 2023-12-22T08:41:08.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.589+0000 7f686c834640 1 -- 172.21.15.38:0/243643535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68680b71e0 con 0x7f6854005180 2023-12-22T08:41:08.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.589+0000 7f686c834640 1 -- 172.21.15.38:0/243643535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68680b77a0 con 0x7f6854005180 2023-12-22T08:41:08.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.590+0000 7f686c834640 1 -- 172.21.15.38:0/243643535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6868061910 con 0x7f6854005180 2023-12-22T08:41:08.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.591+0000 7f685ffff640 1 -- 172.21.15.38:0/243643535 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6858007030 con 0x7f6854005180 2023-12-22T08:41:08.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.592+0000 7f685ffff640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f684806a430 0x7f684806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.592+0000 7f685ffff640 1 -- 172.21.15.38:0/243643535 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68580889d0 con 0x7f6854005180 2023-12-22T08:41:08.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.593+0000 7f6866ffd640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f684806a430 0x7f684806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.594+0000 7f6866ffd640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f684806a430 0x7f684806c8f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f686806d100 tx=0x7f6850009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.597+0000 7f685ffff640 1 -- 172.21.15.38:0/243643535 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6858054270 con 0x7f6854005180 2023-12-22T08:41:08.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.864+0000 7f686c834640 1 -- 172.21.15.38:0/243643535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f68680d0f20 con 0x7f6854005180 2023-12-22T08:41:08.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.876+0000 7f685ffff640 1 -- 172.21.15.38:0/243643535 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f685801f020 con 0x7f6854005180 2023-12-22T08:41:08.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.879+0000 7f686c834640 1 -- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f684806a430 msgr2=0x7f684806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.879+0000 7f686c834640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f684806a430 0x7f684806c8f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f686806d100 tx=0x7f6850009040 comp rx=0 tx=0).stop 2023-12-22T08:41:08.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.879+0000 7f686c834640 1 -- 172.21.15.38:0/243643535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6854005180 msgr2=0x7f68680ad2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.879+0000 7f686c834640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6854005180 0x7f68680ad2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f685800db10 tx=0x7f685800df10 comp rx=0 tx=0).stop 2023-12-22T08:41:08.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.879+0000 7f686c834640 1 -- 172.21.15.38:0/243643535 shutdown_connections 2023-12-22T08:41:08.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.879+0000 7f686c834640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f686815f3f0 0x7f686815f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.879+0000 7f686c834640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68680b8670 0x7f6868155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.879+0000 7f686c834640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f684806a430 0x7f684806c8f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.879+0000 7f686c834640 1 --2- 172.21.15.38:0/243643535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6854005180 0x7f68680ad2f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.879+0000 7f686c834640 1 -- 172.21.15.38:0/243643535 >> 172.21.15.38:0/243643535 conn(0x7f68680d31f0 msgr2=0x7f68680d2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:08.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.879+0000 7f686c834640 1 -- 172.21.15.38:0/243643535 shutdown_connections 2023-12-22T08:41:08.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:08.879+0000 7f686c834640 1 -- 172.21.15.38:0/243643535 wait complete. 2023-12-22T08:41:08.900 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-22T08:41:09.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.119+0000 7f6688651640 1 Processor -- start 2023-12-22T08:41:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.120+0000 7f6688651640 1 -- start start 2023-12-22T08:41:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.121+0000 7f6688651640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66800b3600 0x7f66800b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.121+0000 7f6688651640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668006c5a0 con 0x7f6680071180 2023-12-22T08:41:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.121+0000 7f6688651640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668006d9e0 con 0x7f6680159a80 2023-12-22T08:41:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.121+0000 7f6688651640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66800b3fb0 con 0x7f66800b3600 2023-12-22T08:41:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.122+0000 7f6685bec640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6680071180 0x7f668006d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38398/0 (socket says 172.21.15.38:38398) 2023-12-22T08:41:09.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.122+0000 7f6685bec640 1 -- 172.21.15.38:0/90685111 learned_addr learned my addr 172.21.15.38:0/90685111 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.122+0000 7f6686bee640 1 --2- 172.21.15.38:0/90685111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66800b3600 0x7f66800b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.122+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278497563 0 0) 0x7f668006c5a0 con 0x7f6680071180 2023-12-22T08:41:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.122+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f666c005730 con 0x7f6680071180 2023-12-22T08:41:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1504638135 0 0) 0x7f666c005730 con 0x7f6680071180 2023-12-22T08:41:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66800b3600 msgr2=0x7f66800b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66853eb640 1 --2- 172.21.15.38:0/90685111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66800b3600 0x7f66800b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 >> v1:172.21.15.89:6789/0 conn(0x7f6680159a80 legacy=0x7f66800b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6680071760 con 0x7f6680071180 2023-12-22T08:41:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f6670001670 con 0x7f6680071180 2023-12-22T08:41:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 >> v1:172.21.15.38:6789/0 conn(0x7f6680071180 legacy=0x7f668006d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66853eb640 1 --2- 172.21.15.38:0/90685111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66800b3600 0x7f666c005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66853eb640 1 --2- 172.21.15.38:0/90685111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f666c006180 0x7f666c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66853eb640 1 --2- 172.21.15.38:0/90685111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c006f10 0x7f666c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66800b3fb0 con 0x7f666c006180 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c00dcd0 con 0x7f666c006f10 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c00de90 con 0x7f66800b3600 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f6685bec640 1 --2- 172.21.15.38:0/90685111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f666c006180 0x7f666c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.123+0000 7f66863ed640 1 --2- 172.21.15.38:0/90685111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66800b3600 0x7f666c005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.124+0000 7f6686bee640 1 --2- 172.21.15.38:0/90685111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c006f10 0x7f666c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.124+0000 7f6685bec640 1 -- 172.21.15.38:0/90685111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66800b3600 msgr2=0x7f666c005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.124+0000 7f6685bec640 1 --2- 172.21.15.38:0/90685111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66800b3600 0x7f666c005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.124+0000 7f6685bec640 1 -- 172.21.15.38:0/90685111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c006f10 msgr2=0x7f666c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.124+0000 7f6685bec640 1 --2- 172.21.15.38:0/90685111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c006f10 0x7f666c007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.124+0000 7f6685bec640 1 -- 172.21.15.38:0/90685111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c005730 con 0x7f666c006180 2023-12-22T08:41:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.125+0000 7f6685bec640 1 --2- 172.21.15.38:0/90685111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f666c006180 0x7f666c0069d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f667000c0e0 tx=0x7f666c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83389905e4e2387 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.125+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6670005ad0 con 0x7f666c006180 2023-12-22T08:41:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.125+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6670005c50 con 0x7f666c006180 2023-12-22T08:41:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.125+0000 7f66853eb640 1 -- 172.21.15.38:0/90685111 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6670007070 con 0x7f666c006180 2023-12-22T08:41:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.126+0000 7f6688651640 1 -- 172.21.15.38:0/90685111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f666c006180 msgr2=0x7f666c0069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.126+0000 7f6688651640 1 --2- 172.21.15.38:0/90685111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f666c006180 0x7f666c0069d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f667000c0e0 tx=0x7f666c007a00 comp rx=0 tx=0).stop 2023-12-22T08:41:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.126+0000 7f6686bee640 1 -- 172.21.15.38:0/90685111 reap_dead start 2023-12-22T08:41:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.126+0000 7f6688651640 1 -- 172.21.15.38:0/90685111 shutdown_connections 2023-12-22T08:41:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.126+0000 7f6688651640 1 -- 172.21.15.38:0/90685111 >> 172.21.15.38:0/90685111 conn(0x7f66800cf070 msgr2=0x7f66800cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.126+0000 7f6688651640 1 -- 172.21.15.38:0/90685111 shutdown_connections 2023-12-22T08:41:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.126+0000 7f6688651640 1 -- 172.21.15.38:0/90685111 wait complete. 2023-12-22T08:41:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.128+0000 7f6688651640 1 Processor -- start 2023-12-22T08:41:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.128+0000 7f6688651640 1 -- start start 2023-12-22T08:41:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f6688651640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f666c006180 0x7f6680147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f6688651640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6680155950 0x7f668015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f6688651640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f668015bf30 0x7f66801485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f6688651640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680154980 con 0x7f666c006180 2023-12-22T08:41:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f6688651640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668015c3b0 con 0x7f668015bf30 2023-12-22T08:41:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f6688651640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66801480d0 con 0x7f6680155950 2023-12-22T08:41:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f66863ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f666c006180 0x7f6680147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f66863ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f666c006180 0x7f6680147b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39020/0 (socket says 172.21.15.38:39020) 2023-12-22T08:41:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f66863ed640 1 -- 172.21.15.38:0/1487300294 learned_addr learned my addr 172.21.15.38:0/1487300294 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:09.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f66863ed640 1 -- 172.21.15.38:0/1487300294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6680155950 msgr2=0x7f668015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f66863ed640 1 --2- 172.21.15.38:0/1487300294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6680155950 0x7f668015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f6686bee640 1 --2- 172.21.15.38:0/1487300294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f668015bf30 0x7f66801485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f66863ed640 1 -- 172.21.15.38:0/1487300294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f668015bf30 msgr2=0x7f66801485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f66863ed640 1 --2- 172.21.15.38:0/1487300294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f668015bf30 0x7f66801485e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.129+0000 7f66863ed640 1 -- 172.21.15.38:0/1487300294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6680154b90 con 0x7f666c006180 2023-12-22T08:41:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.130+0000 7f66863ed640 1 --2- 172.21.15.38:0/1487300294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f666c006180 0x7f6680147b90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f667c00e550 tx=0x7f667c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.130+0000 7f6676ffd640 1 -- 172.21.15.38:0/1487300294 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c0052e0 con 0x7f666c006180 2023-12-22T08:41:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.130+0000 7f6676ffd640 1 -- 172.21.15.38:0/1487300294 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c005440 con 0x7f666c006180 2023-12-22T08:41:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.130+0000 7f6688651640 1 -- 172.21.15.38:0/1487300294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6680154e70 con 0x7f666c006180 2023-12-22T08:41:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.130+0000 7f6676ffd640 1 -- 172.21.15.38:0/1487300294 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c003810 con 0x7f666c006180 2023-12-22T08:41:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.130+0000 7f6688651640 1 -- 172.21.15.38:0/1487300294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6680155430 con 0x7f666c006180 2023-12-22T08:41:09.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.131+0000 7f6688651640 1 -- 172.21.15.38:0/1487300294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66801555f0 con 0x7f666c006180 2023-12-22T08:41:09.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.132+0000 7f6676ffd640 1 -- 172.21.15.38:0/1487300294 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f667c003970 con 0x7f666c006180 2023-12-22T08:41:09.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.134+0000 7f6676ffd640 1 --2- 172.21.15.38:0/1487300294 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f666406a460 0x7f666406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.134+0000 7f6676ffd640 1 -- 172.21.15.38:0/1487300294 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f667c0882f0 con 0x7f666c006180 2023-12-22T08:41:09.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.134+0000 7f6685bec640 1 --2- 172.21.15.38:0/1487300294 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f666406a460 0x7f666406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.135+0000 7f6685bec640 1 --2- 172.21.15.38:0/1487300294 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f666406a460 0x7f666406c920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6670034000 tx=0x7f6670007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:09.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.138+0000 7f6676ffd640 1 -- 172.21.15.38:0/1487300294 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f667c053c30 con 0x7f666c006180 2023-12-22T08:41:09.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.406+0000 7f6688651640 1 -- 172.21.15.38:0/1487300294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6680061910 con 0x7f666c006180 2023-12-22T08:41:09.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.415+0000 7f6676ffd640 1 -- 172.21.15.38:0/1487300294 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f667c057250 con 0x7f666c006180 2023-12-22T08:41:09.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.417+0000 7f6688651640 1 -- 172.21.15.38:0/1487300294 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f666406a460 msgr2=0x7f666406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.417+0000 7f6688651640 1 --2- 172.21.15.38:0/1487300294 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f666406a460 0x7f666406c920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6670034000 tx=0x7f6670007000 comp rx=0 tx=0).stop 2023-12-22T08:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.417+0000 7f6688651640 1 -- 172.21.15.38:0/1487300294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f666c006180 msgr2=0x7f6680147b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.418+0000 7f6688651640 1 --2- 172.21.15.38:0/1487300294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f666c006180 0x7f6680147b90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f667c00e550 tx=0x7f667c00ea10 comp rx=0 tx=0).stop 2023-12-22T08:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.418+0000 7f6688651640 1 -- 172.21.15.38:0/1487300294 shutdown_connections 2023-12-22T08:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.418+0000 7f6688651640 1 --2- 172.21.15.38:0/1487300294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f668015bf30 0x7f66801485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.418+0000 7f6688651640 1 --2- 172.21.15.38:0/1487300294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6680155950 0x7f668015b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.418+0000 7f6688651640 1 --2- 172.21.15.38:0/1487300294 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f666406a460 0x7f666406c920 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.418+0000 7f6688651640 1 --2- 172.21.15.38:0/1487300294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f666c006180 0x7f6680147b90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.418+0000 7f6688651640 1 -- 172.21.15.38:0/1487300294 >> 172.21.15.38:0/1487300294 conn(0x7f66800cf070 msgr2=0x7f66800ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.418+0000 7f6688651640 1 -- 172.21.15.38:0/1487300294 shutdown_connections 2023-12-22T08:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.418+0000 7f6688651640 1 -- 172.21.15.38:0/1487300294 wait complete. 2023-12-22T08:41:09.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-22T08:41:09.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.656+0000 7fdcdc251640 1 Processor -- start 2023-12-22T08:41:09.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.657+0000 7fdcdc251640 1 -- start start 2023-12-22T08:41:09.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.658+0000 7fdcdc251640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdcd40b3f90 0x7fdcd415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.658+0000 7fdcdc251640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd415eb20 con 0x7fdcd415e740 2023-12-22T08:41:09.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.658+0000 7fdcdc251640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd4070770 con 0x7fdcd406ca50 2023-12-22T08:41:09.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.658+0000 7fdcdc251640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd406e650 con 0x7fdcd40b3f90 2023-12-22T08:41:09.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.659+0000 7fdcd9fed640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdcd415e740 0x7fdcd40b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38400/0 (socket says 172.21.15.38:38400) 2023-12-22T08:41:09.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.659+0000 7fdcd9fed640 1 -- 172.21.15.38:0/3096694417 learned_addr learned my addr 172.21.15.38:0/3096694417 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:09.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.659+0000 7fdcd97ec640 1 --2- 172.21.15.38:0/3096694417 >> v2:172.21.15.89:3300/0 conn(0x7fdcd40b3f90 0x7fdcd415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.659+0000 7fdcd8feb640 1 -- 172.21.15.38:0/3096694417 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726331189 0 0) 0x7fdcd415eb20 con 0x7fdcd415e740 2023-12-22T08:41:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.659+0000 7fdcd8feb640 1 -- 172.21.15.38:0/3096694417 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc0003520 con 0x7fdcd415e740 2023-12-22T08:41:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.660+0000 7fdcd97ec640 1 -- 172.21.15.38:0/3096694417 >> v1:172.21.15.89:6789/0 conn(0x7fdcd406ca50 legacy=0x7fdcd4070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.660+0000 7fdcd97ec640 1 -- 172.21.15.38:0/3096694417 >> v1:172.21.15.38:6789/0 conn(0x7fdcd415e740 legacy=0x7fdcd40b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.660+0000 7fdcd8feb640 1 -- 172.21.15.38:0/3096694417 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3163868005 0 0) 0x7fdcc0003520 con 0x7fdcd415e740 2023-12-22T08:41:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.660+0000 7fdcd97ec640 1 -- 172.21.15.38:0/3096694417 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd406d180 con 0x7fdcd40b3f90 2023-12-22T08:41:09.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.662+0000 7fdcd97ec640 1 --2- 172.21.15.38:0/3096694417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcd40b3f90 0x7fdcd415db30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40097a0 tx=0x7fdcc402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=160e8ef3d35c86cf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:09.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.662+0000 7fdcd8feb640 1 -- 172.21.15.38:0/3096694417 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0001670 con 0x7fdcd40b3f90 2023-12-22T08:41:09.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.662+0000 7fdcd8feb640 1 -- 172.21.15.38:0/3096694417 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc402e050 con 0x7fdcd40b3f90 2023-12-22T08:41:09.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.662+0000 7fdcd8feb640 1 -- 172.21.15.38:0/3096694417 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4030730 con 0x7fdcd40b3f90 2023-12-22T08:41:09.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.663+0000 7fdcdc251640 1 -- 172.21.15.38:0/3096694417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcd40b3f90 msgr2=0x7fdcd415db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.663+0000 7fdcdc251640 1 --2- 172.21.15.38:0/3096694417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcd40b3f90 0x7fdcd415db30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40097a0 tx=0x7fdcc402b710 comp rx=0 tx=0).stop 2023-12-22T08:41:09.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.663+0000 7fdcdc251640 1 -- 172.21.15.38:0/3096694417 shutdown_connections 2023-12-22T08:41:09.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.663+0000 7fdcdc251640 1 --2- 172.21.15.38:0/3096694417 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcd40b3f90 0x7fdcd415db30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.663+0000 7fdcdc251640 1 -- 172.21.15.38:0/3096694417 >> 172.21.15.38:0/3096694417 conn(0x7fdcd40cfea0 msgr2=0x7fdcd40d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:09.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.663+0000 7fdcdc251640 1 -- 172.21.15.38:0/3096694417 shutdown_connections 2023-12-22T08:41:09.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.663+0000 7fdcdc251640 1 -- 172.21.15.38:0/3096694417 wait complete. 2023-12-22T08:41:09.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.665+0000 7fdcdc251640 1 Processor -- start 2023-12-22T08:41:09.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.665+0000 7fdcdc251640 1 -- start start 2023-12-22T08:41:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.666+0000 7fdcdc251640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcd406ca50 0x7fdcd4142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.666+0000 7fdcdc251640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcd40b3f90 0x7fdcd40b7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.666+0000 7fdcdc251640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd415e740 0x7fdcd415c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.666+0000 7fdcdc251640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40b8ca0 con 0x7fdcd415e740 2023-12-22T08:41:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.666+0000 7fdcdc251640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40b8120 con 0x7fdcd406ca50 2023-12-22T08:41:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.666+0000 7fdcdc251640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40b8400 con 0x7fdcd40b3f90 2023-12-22T08:41:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.666+0000 7fdcda7ee640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd415e740 0x7fdcd415c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.666+0000 7fdcda7ee640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd415e740 0x7fdcd415c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39036/0 (socket says 172.21.15.38:39036) 2023-12-22T08:41:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.666+0000 7fdcda7ee640 1 -- 172.21.15.38:0/3022815861 learned_addr learned my addr 172.21.15.38:0/3022815861 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.667+0000 7fdcd9fed640 1 --2- 172.21.15.38:0/3022815861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcd406ca50 0x7fdcd4142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.667+0000 7fdcda7ee640 1 -- 172.21.15.38:0/3022815861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcd40b3f90 msgr2=0x7fdcd40b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.667+0000 7fdcda7ee640 1 --2- 172.21.15.38:0/3022815861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcd40b3f90 0x7fdcd40b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.667+0000 7fdcda7ee640 1 -- 172.21.15.38:0/3022815861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcd406ca50 msgr2=0x7fdcd4142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.667+0000 7fdcda7ee640 1 --2- 172.21.15.38:0/3022815861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcd406ca50 0x7fdcd4142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.667+0000 7fdcda7ee640 1 -- 172.21.15.38:0/3022815861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc4009400 con 0x7fdcd415e740 2023-12-22T08:41:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.667+0000 7fdcda7ee640 1 --2- 172.21.15.38:0/3022815861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd415e740 0x7fdcd415c7a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00c7a0 tx=0x7fdccc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.667+0000 7fdcca7fc640 1 -- 172.21.15.38:0/3022815861 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc003b70 con 0x7fdcd415e740 2023-12-22T08:41:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.667+0000 7fdcca7fc640 1 -- 172.21.15.38:0/3022815861 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc003cf0 con 0x7fdcd415e740 2023-12-22T08:41:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.667+0000 7fdcca7fc640 1 -- 172.21.15.38:0/3022815861 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc003ea0 con 0x7fdcd415e740 2023-12-22T08:41:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.667+0000 7fdcdc251640 1 -- 172.21.15.38:0/3022815861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd40b86e0 con 0x7fdcd415e740 2023-12-22T08:41:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.668+0000 7fdcdc251640 1 -- 172.21.15.38:0/3022815861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd40b7c60 con 0x7fdcd415e740 2023-12-22T08:41:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.669+0000 7fdcdc251640 1 -- 172.21.15.38:0/3022815861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd4061910 con 0x7fdcd415e740 2023-12-22T08:41:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.670+0000 7fdcca7fc640 1 -- 172.21.15.38:0/3022815861 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdccc00aa90 con 0x7fdcd415e740 2023-12-22T08:41:09.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.671+0000 7fdcca7fc640 1 --2- 172.21.15.38:0/3022815861 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdcb806a460 0x7fdcb806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.671+0000 7fdcca7fc640 1 -- 172.21.15.38:0/3022815861 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdccc088420 con 0x7fdcd415e740 2023-12-22T08:41:09.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.672+0000 7fdcd9fed640 1 --2- 172.21.15.38:0/3022815861 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdcb806a460 0x7fdcb806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.673+0000 7fdcd9fed640 1 --2- 172.21.15.38:0/3022815861 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdcb806a460 0x7fdcb806c920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0000f60 tx=0x7fdcd0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:09.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.675+0000 7fdcca7fc640 1 -- 172.21.15.38:0/3022815861 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdccc053d60 con 0x7fdcd415e740 2023-12-22T08:41:09.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.937+0000 7fdcdc251640 1 -- 172.21.15.38:0/3022815861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fdcd406dfe0 con 0x7fdcd415e740 2023-12-22T08:41:09.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.945+0000 7fdcca7fc640 1 -- 172.21.15.38:0/3022815861 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdccc057380 con 0x7fdcd415e740 2023-12-22T08:41:09.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.947+0000 7fdcdc251640 1 -- 172.21.15.38:0/3022815861 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdcb806a460 msgr2=0x7fdcb806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.947+0000 7fdcdc251640 1 --2- 172.21.15.38:0/3022815861 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdcb806a460 0x7fdcb806c920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0000f60 tx=0x7fdcd0009040 comp rx=0 tx=0).stop 2023-12-22T08:41:09.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.947+0000 7fdcdc251640 1 -- 172.21.15.38:0/3022815861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd415e740 msgr2=0x7fdcd415c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.947+0000 7fdcdc251640 1 --2- 172.21.15.38:0/3022815861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd415e740 0x7fdcd415c7a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00c7a0 tx=0x7fdccc00cc60 comp rx=0 tx=0).stop 2023-12-22T08:41:09.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.947+0000 7fdcdc251640 1 -- 172.21.15.38:0/3022815861 shutdown_connections 2023-12-22T08:41:09.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.947+0000 7fdcdc251640 1 --2- 172.21.15.38:0/3022815861 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdcb806a460 0x7fdcb806c920 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.947+0000 7fdcdc251640 1 --2- 172.21.15.38:0/3022815861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdcd415e740 0x7fdcd415c7a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.947+0000 7fdcdc251640 1 --2- 172.21.15.38:0/3022815861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdcd40b3f90 0x7fdcd40b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.947+0000 7fdcdc251640 1 --2- 172.21.15.38:0/3022815861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdcd406ca50 0x7fdcd4142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.947+0000 7fdcdc251640 1 -- 172.21.15.38:0/3022815861 >> 172.21.15.38:0/3022815861 conn(0x7fdcd40cfea0 msgr2=0x7fdcd4070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:09.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.948+0000 7fdcdc251640 1 -- 172.21.15.38:0/3022815861 shutdown_connections 2023-12-22T08:41:09.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:09.948+0000 7fdcdc251640 1 -- 172.21.15.38:0/3022815861 wait complete. 2023-12-22T08:41:09.969 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-22T08:41:10.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.186+0000 7fecbf59e640 1 Processor -- start 2023-12-22T08:41:10.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.187+0000 7fecbf59e640 1 -- start start 2023-12-22T08:41:10.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.188+0000 7fecbf59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc00cb4c0 0x7fecc015e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.188+0000 7fecbf59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fecc006d5f0 0x7fecc0070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.188+0000 7fecbf59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc00706d0 con 0x7fecc006d210 2023-12-22T08:41:10.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.188+0000 7fecbf59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc00cbf40 con 0x7fecc006d5f0 2023-12-22T08:41:10.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.188+0000 7fecbf59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc00ce840 con 0x7fecc00cb4c0 2023-12-22T08:41:10.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.189+0000 7fecbe59c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fecc006d210 0x7fecc0159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38408/0 (socket says 172.21.15.38:38408) 2023-12-22T08:41:10.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.189+0000 7fecbe59c640 1 -- 172.21.15.38:0/1920611552 learned_addr learned my addr 172.21.15.38:0/1920611552 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:10.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.189+0000 7fecb7fff640 1 --2- 172.21.15.38:0/1920611552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc00cb4c0 0x7fecc015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.189+0000 7fecbed9d640 1 --2- 172.21.15.38:0/1920611552 >> v2:172.21.15.89:3300/0 conn(0x7fecc006d5f0 0x7fecc0070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.189+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509826942 0 0) 0x7fecc00706d0 con 0x7fecc006d210 2023-12-22T08:41:10.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.189+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecac003520 con 0x7fecc006d210 2023-12-22T08:41:10.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2951772215 0 0) 0x7fecac003520 con 0x7fecc006d210 2023-12-22T08:41:10.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc00cb4c0 msgr2=0x7fecc015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:10.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 --2- 172.21.15.38:0/1920611552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc00cb4c0 0x7fecc015e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 >> v2:172.21.15.89:3300/0 conn(0x7fecc006d5f0 msgr2=0x7fecc0070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:10.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 --2- 172.21.15.38:0/1920611552 >> v2:172.21.15.89:3300/0 conn(0x7fecc006d5f0 0x7fecc0070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc00ceb20 con 0x7fecc006d210 2023-12-22T08:41:10.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fecb0001670 con 0x7fecc006d210 2023-12-22T08:41:10.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 >> v1:172.21.15.38:6789/0 conn(0x7fecc006d210 legacy=0x7fecc0159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 --2- 172.21.15.38:0/1920611552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecac003970 0x7fecac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 --2- 172.21.15.38:0/1920611552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecac0047c0 0x7fecac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 --2- 172.21.15.38:0/1920611552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc00cb4c0 0x7fecac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc00cbf40 con 0x7fecac0047c0 2023-12-22T08:41:10.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc00ce840 con 0x7fecac003970 2023-12-22T08:41:10.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecac00db90 con 0x7fecc00cb4c0 2023-12-22T08:41:10.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.190+0000 7fecb7fff640 1 --2- 172.21.15.38:0/1920611552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecac0047c0 0x7fecac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.191+0000 7fecb7fff640 1 -- 172.21.15.38:0/1920611552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc00cb4c0 msgr2=0x7fecac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:10.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.191+0000 7fecb7fff640 1 --2- 172.21.15.38:0/1920611552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc00cb4c0 0x7fecac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.191+0000 7fecbe59c640 1 --2- 172.21.15.38:0/1920611552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecac003970 0x7fecac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.191+0000 7fecb7fff640 1 -- 172.21.15.38:0/1920611552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecac003970 msgr2=0x7fecac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:10.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.191+0000 7fecb7fff640 1 --2- 172.21.15.38:0/1920611552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecac003970 0x7fecac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.191+0000 7fecb7fff640 1 -- 172.21.15.38:0/1920611552 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac003520 con 0x7fecac0047c0 2023-12-22T08:41:10.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.191+0000 7fecbe59c640 1 --2- 172.21.15.38:0/1920611552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecac003970 0x7fecac003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:10.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.192+0000 7fecb7fff640 1 --2- 172.21.15.38:0/1920611552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecac0047c0 0x7fecac004c40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feca8009ac0 tx=0x7fecac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fd10aed2b0c41a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:10.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.192+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca802c710 con 0x7fecac0047c0 2023-12-22T08:41:10.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.192+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca802c870 con 0x7fecac0047c0 2023-12-22T08:41:10.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.192+0000 7fecbdd9b640 1 -- 172.21.15.38:0/1920611552 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca802cc00 con 0x7fecac0047c0 2023-12-22T08:41:10.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.193+0000 7fecbf59e640 1 -- 172.21.15.38:0/1920611552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecac0047c0 msgr2=0x7fecac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.193+0000 7fecbf59e640 1 --2- 172.21.15.38:0/1920611552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecac0047c0 0x7fecac004c40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feca8009ac0 tx=0x7fecac0057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.193+0000 7fecbed9d640 1 -- 172.21.15.38:0/1920611552 reap_dead start 2023-12-22T08:41:10.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.193+0000 7fecbf59e640 1 -- 172.21.15.38:0/1920611552 shutdown_connections 2023-12-22T08:41:10.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.193+0000 7fecbf59e640 1 -- 172.21.15.38:0/1920611552 >> 172.21.15.38:0/1920611552 conn(0x7fecc00b1f70 msgr2=0x7fecc00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:10.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.193+0000 7fecbf59e640 1 -- 172.21.15.38:0/1920611552 shutdown_connections 2023-12-22T08:41:10.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.193+0000 7fecbf59e640 1 -- 172.21.15.38:0/1920611552 wait complete. 2023-12-22T08:41:10.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.195+0000 7fecbf59e640 1 Processor -- start 2023-12-22T08:41:10.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.195+0000 7fecbf59e640 1 -- start start 2023-12-22T08:41:10.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.196+0000 7fecbf59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecac0047c0 0x7fecc01583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.196+0000 7fecbf59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc00cab70 0x7fecc0158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.196+0000 7fecbf59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc015a830 0x7fecc015acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.196+0000 7fecbf59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc015c150 con 0x7fecac0047c0 2023-12-22T08:41:10.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.196+0000 7fecbf59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc015b540 con 0x7fecc015a830 2023-12-22T08:41:10.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.196+0000 7fecbf59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc015b820 con 0x7fecc00cab70 2023-12-22T08:41:10.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.196+0000 7fecbe59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecac0047c0 0x7fecc01583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.196+0000 7fecbe59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecac0047c0 0x7fecc01583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39050/0 (socket says 172.21.15.38:39050) 2023-12-22T08:41:10.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.196+0000 7fecbe59c640 1 -- 172.21.15.38:0/2108803827 learned_addr learned my addr 172.21.15.38:0/2108803827 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:10.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.197+0000 7fecbed9d640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc015a830 0x7fecc015acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.197+0000 7fecbe59c640 1 -- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc00cab70 msgr2=0x7fecc0158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.197+0000 7fecbe59c640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc00cab70 0x7fecc0158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.197+0000 7fecbe59c640 1 -- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc015a830 msgr2=0x7fecc015acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.197+0000 7fecbe59c640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc015a830 0x7fecc015acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.197+0000 7fecbe59c640 1 -- 172.21.15.38:0/2108803827 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc015bb00 con 0x7fecac0047c0 2023-12-22T08:41:10.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.197+0000 7fecbed9d640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc015a830 0x7fecc015acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:10.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.197+0000 7fecbe59c640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecac0047c0 0x7fecc01583e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fecb000d8b0 tx=0x7fecb000dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:10.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.197+0000 7fecb6ffd640 1 -- 172.21.15.38:0/2108803827 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb00074e0 con 0x7fecac0047c0 2023-12-22T08:41:10.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.197+0000 7fecb6ffd640 1 -- 172.21.15.38:0/2108803827 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb0007640 con 0x7fecac0047c0 2023-12-22T08:41:10.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.197+0000 7fecb6ffd640 1 -- 172.21.15.38:0/2108803827 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb00049e0 con 0x7fecac0047c0 2023-12-22T08:41:10.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.197+0000 7fecbf59e640 1 -- 172.21.15.38:0/2108803827 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc015bde0 con 0x7fecac0047c0 2023-12-22T08:41:10.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.197+0000 7fecbf59e640 1 -- 172.21.15.38:0/2108803827 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc015c5e0 con 0x7fecac0047c0 2023-12-22T08:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.198+0000 7fecbf59e640 1 -- 172.21.15.38:0/2108803827 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc0061910 con 0x7fecac0047c0 2023-12-22T08:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.200+0000 7fecb6ffd640 1 -- 172.21.15.38:0/2108803827 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fecb0004b40 con 0x7fecac0047c0 2023-12-22T08:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.201+0000 7fecb6ffd640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feca006a460 0x7feca006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.201+0000 7fecb6ffd640 1 -- 172.21.15.38:0/2108803827 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fecb00880f0 con 0x7fecac0047c0 2023-12-22T08:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.201+0000 7fecb7fff640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feca006a460 0x7feca006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.202+0000 7fecb7fff640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feca006a460 0x7feca006c920 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7feca8036000 tx=0x7feca802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:10.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.205+0000 7fecb6ffd640 1 -- 172.21.15.38:0/2108803827 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fecb0053990 con 0x7fecac0047c0 2023-12-22T08:41:10.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.469+0000 7fecbf59e640 1 -- 172.21.15.38:0/2108803827 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fecc015bf70 con 0x7fecac0047c0 2023-12-22T08:41:10.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.480+0000 7fecb6ffd640 1 -- 172.21.15.38:0/2108803827 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fecb0056fb0 con 0x7fecac0047c0 2023-12-22T08:41:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.482+0000 7fecbf59e640 1 -- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feca006a460 msgr2=0x7feca006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.482+0000 7fecbf59e640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feca006a460 0x7feca006c920 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7feca8036000 tx=0x7feca802e000 comp rx=0 tx=0).stop 2023-12-22T08:41:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.482+0000 7fecbf59e640 1 -- 172.21.15.38:0/2108803827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecac0047c0 msgr2=0x7fecc01583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.482+0000 7fecbf59e640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecac0047c0 0x7fecc01583e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fecb000d8b0 tx=0x7fecb000dd70 comp rx=0 tx=0).stop 2023-12-22T08:41:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.482+0000 7fecbf59e640 1 -- 172.21.15.38:0/2108803827 shutdown_connections 2023-12-22T08:41:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.482+0000 7fecbf59e640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecc015a830 0x7fecc015acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.482+0000 7fecbf59e640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecc00cab70 0x7fecc0158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.482+0000 7fecbf59e640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feca006a460 0x7feca006c920 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.482+0000 7fecbf59e640 1 --2- 172.21.15.38:0/2108803827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecac0047c0 0x7fecc01583e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.482+0000 7fecbf59e640 1 -- 172.21.15.38:0/2108803827 >> 172.21.15.38:0/2108803827 conn(0x7fecc00b1f70 msgr2=0x7fecc0070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.483+0000 7fecbf59e640 1 -- 172.21.15.38:0/2108803827 shutdown_connections 2023-12-22T08:41:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.483+0000 7fecbf59e640 1 -- 172.21.15.38:0/2108803827 wait complete. 2023-12-22T08:41:10.506 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:10.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.711+0000 7fa3d58f7640 1 Processor -- start 2023-12-22T08:41:10.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.712+0000 7fa3d58f7640 1 -- start start 2023-12-22T08:41:10.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.714+0000 7fa3d58f7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa3d015d470 0x7fa3d00b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.714+0000 7fa3d58f7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3d015d850 0x7fa3d00ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.714+0000 7fa3d58f7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d00ac8e0 con 0x7fa3d0071ea0 2023-12-22T08:41:10.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.714+0000 7fa3d58f7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d00b4550 con 0x7fa3d015d470 2023-12-22T08:41:10.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.714+0000 7fa3d58f7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00b4940 con 0x7fa3d015d850 2023-12-22T08:41:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.715+0000 7fa3ceffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa3d015d470 0x7fa3d00b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.715+0000 7fa3ceffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa3d015d470 0x7fa3d00b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:60930/0 (socket says 172.21.15.38:60930) 2023-12-22T08:41:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.715+0000 7fa3ceffd640 1 -- 172.21.15.38:0/3049833838 learned_addr learned my addr 172.21.15.38:0/3049833838 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.715+0000 7fa3c7fff640 1 --2- 172.21.15.38:0/3049833838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3d015d850 0x7fa3d00ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.715+0000 7fa3ceffd640 1 -- 172.21.15.38:0/3049833838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3d015d850 msgr2=0x7fa3d00ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.715+0000 7fa3ceffd640 1 --2- 172.21.15.38:0/3049833838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3d015d850 0x7fa3d00ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.715+0000 7fa3ceffd640 1 -- 172.21.15.38:0/3049833838 >> v1:172.21.15.89:6789/0 conn(0x7fa3d0071ea0 legacy=0x7fa3d00b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.715+0000 7fa3ceffd640 1 -- 172.21.15.38:0/3049833838 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d00b4c20 con 0x7fa3d015d470 2023-12-22T08:41:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.715+0000 7fa3c7fff640 1 --2- 172.21.15.38:0/3049833838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3d015d850 0x7fa3d00ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:10.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.717+0000 7fa3ceffd640 1 --2- 172.21.15.38:0/3049833838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3d015d470 0x7fa3d00b4010 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009870 tx=0x7fa3c002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=865ad25acfe77304 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:10.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.717+0000 7fa3ce7fc640 1 -- 172.21.15.38:0/3049833838 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0030840 con 0x7fa3d015d470 2023-12-22T08:41:10.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.718+0000 7fa3ce7fc640 1 -- 172.21.15.38:0/3049833838 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c00309a0 con 0x7fa3d015d470 2023-12-22T08:41:10.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.718+0000 7fa3ce7fc640 1 -- 172.21.15.38:0/3049833838 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0030d30 con 0x7fa3d015d470 2023-12-22T08:41:10.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.718+0000 7fa3d58f7640 1 -- 172.21.15.38:0/3049833838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3d015d470 msgr2=0x7fa3d00b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.718+0000 7fa3d58f7640 1 --2- 172.21.15.38:0/3049833838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3d015d470 0x7fa3d00b4010 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009870 tx=0x7fa3c002b980 comp rx=0 tx=0).stop 2023-12-22T08:41:10.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.718+0000 7fa3d58f7640 1 -- 172.21.15.38:0/3049833838 shutdown_connections 2023-12-22T08:41:10.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.718+0000 7fa3d58f7640 1 --2- 172.21.15.38:0/3049833838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3d015d850 0x7fa3d00ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.718+0000 7fa3d58f7640 1 --2- 172.21.15.38:0/3049833838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3d015d470 0x7fa3d00b4010 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.718+0000 7fa3d58f7640 1 -- 172.21.15.38:0/3049833838 >> 172.21.15.38:0/3049833838 conn(0x7fa3d00cf070 msgr2=0x7fa3d00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:10.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.718+0000 7fa3d58f7640 1 -- 172.21.15.38:0/3049833838 shutdown_connections 2023-12-22T08:41:10.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.719+0000 7fa3d58f7640 1 -- 172.21.15.38:0/3049833838 wait complete. 2023-12-22T08:41:10.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.720+0000 7fa3d58f7640 1 Processor -- start 2023-12-22T08:41:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.720+0000 7fa3d58f7640 1 -- start start 2023-12-22T08:41:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.721+0000 7fa3d58f7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3d0071ea0 0x7fa3d00b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.721+0000 7fa3d58f7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3d015d470 0x7fa3d015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.721+0000 7fa3d58f7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3d015d850 0x7fa3d015fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.721+0000 7fa3d58f7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00b1750 con 0x7fa3d015d850 2023-12-22T08:41:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.721+0000 7fa3d58f7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d015bbc0 con 0x7fa3d0071ea0 2023-12-22T08:41:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.721+0000 7fa3d58f7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d01f3bd0 con 0x7fa3d015d470 2023-12-22T08:41:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.721+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3d015d850 0x7fa3d015fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.722+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3d015d850 0x7fa3d015fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39052/0 (socket says 172.21.15.38:39052) 2023-12-22T08:41:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.722+0000 7fa3cf7fe640 1 -- 172.21.15.38:0/376400947 learned_addr learned my addr 172.21.15.38:0/376400947 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.722+0000 7fa3ceffd640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3d0071ea0 0x7fa3d00b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.722+0000 7fa3c7fff640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3d015d470 0x7fa3d015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.722+0000 7fa3cf7fe640 1 -- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3d015d470 msgr2=0x7fa3d015b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.722+0000 7fa3cf7fe640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3d015d470 0x7fa3d015b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.722+0000 7fa3cf7fe640 1 -- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3d0071ea0 msgr2=0x7fa3d00b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.722+0000 7fa3cf7fe640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3d0071ea0 0x7fa3d00b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.722+0000 7fa3cf7fe640 1 -- 172.21.15.38:0/376400947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c00094d0 con 0x7fa3d015d850 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.722+0000 7fa3ceffd640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3d0071ea0 0x7fa3d00b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.722+0000 7fa3cf7fe640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3d015d850 0x7fa3d015fe10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c7d0 tx=0x7fa3c800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.722+0000 7fa3ccff9640 1 -- 172.21.15.38:0/376400947 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8003b70 con 0x7fa3d015d850 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.723+0000 7fa3ccff9640 1 -- 172.21.15.38:0/376400947 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c8003cf0 con 0x7fa3d015d850 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.723+0000 7fa3d58f7640 1 -- 172.21.15.38:0/376400947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d01f38f0 con 0x7fa3d015d850 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.723+0000 7fa3ccff9640 1 -- 172.21.15.38:0/376400947 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c800aa90 con 0x7fa3d015d850 2023-12-22T08:41:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.723+0000 7fa3d58f7640 1 -- 172.21.15.38:0/376400947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d00afe50 con 0x7fa3d015d850 2023-12-22T08:41:10.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.724+0000 7fa3d58f7640 1 -- 172.21.15.38:0/376400947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d0061910 con 0x7fa3d015d850 2023-12-22T08:41:10.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.725+0000 7fa3ccff9640 1 -- 172.21.15.38:0/376400947 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa3c800abf0 con 0x7fa3d015d850 2023-12-22T08:41:10.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.726+0000 7fa3ccff9640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa3b006a430 0x7fa3b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.726+0000 7fa3ccff9640 1 -- 172.21.15.38:0/376400947 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3c8088480 con 0x7fa3d015d850 2023-12-22T08:41:10.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.726+0000 7fa3ceffd640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa3b006a430 0x7fa3b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.727+0000 7fa3ceffd640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa3b006a430 0x7fa3b006c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0036000 tx=0x7fa3c003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:10.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.730+0000 7fa3ccff9640 1 -- 172.21.15.38:0/376400947 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa3c8053d40 con 0x7fa3d015d850 2023-12-22T08:41:10.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.927+0000 7fa3d58f7640 1 -- 172.21.15.38:0/376400947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3d006d220 con 0x7fa3d015d850 2023-12-22T08:41:10.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.929+0000 7fa3ccff9640 1 -- 172.21.15.38:0/376400947 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12341 (secure 0 0 0) 0x7fa3c8057360 con 0x7fa3d015d850 2023-12-22T08:41:10.932 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:10.932 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":30,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:41:06.806865+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:10.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.931+0000 7fa3d58f7640 1 -- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa3b006a430 msgr2=0x7fa3b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.931+0000 7fa3d58f7640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa3b006a430 0x7fa3b006c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0036000 tx=0x7fa3c003b040 comp rx=0 tx=0).stop 2023-12-22T08:41:10.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.931+0000 7fa3d58f7640 1 -- 172.21.15.38:0/376400947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3d015d850 msgr2=0x7fa3d015fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.931+0000 7fa3d58f7640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3d015d850 0x7fa3d015fe10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c7d0 tx=0x7fa3c800cc90 comp rx=0 tx=0).stop 2023-12-22T08:41:10.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.931+0000 7fa3d58f7640 1 -- 172.21.15.38:0/376400947 shutdown_connections 2023-12-22T08:41:10.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.931+0000 7fa3d58f7640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa3b006a430 0x7fa3b006c8f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.931+0000 7fa3d58f7640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3d015d850 0x7fa3d015fe10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.931+0000 7fa3d58f7640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3d015d470 0x7fa3d015b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.931+0000 7fa3d58f7640 1 --2- 172.21.15.38:0/376400947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3d0071ea0 0x7fa3d00b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.932+0000 7fa3d58f7640 1 -- 172.21.15.38:0/376400947 >> 172.21.15.38:0/376400947 conn(0x7fa3d00cf070 msgr2=0x7fa3d015e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:10.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.932+0000 7fa3d58f7640 1 -- 172.21.15.38:0/376400947 shutdown_connections 2023-12-22T08:41:10.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:10.932+0000 7fa3d58f7640 1 -- 172.21.15.38:0/376400947 wait complete. 2023-12-22T08:41:10.954 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:10.954 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:11.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.187+0000 7f530f7fd640 1 Processor -- start 2023-12-22T08:41:11.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.187+0000 7f530f7fd640 1 -- start start 2023-12-22T08:41:11.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.189+0000 7f530f7fd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f530815ec50 0x7f53080ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.189+0000 7f530f7fd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5308070e80 0x7f530806f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.189+0000 7f530f7fd640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53080ce4b0 con 0x7f530815e870 2023-12-22T08:41:11.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.189+0000 7f530f7fd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530815fea0 con 0x7f530815ec50 2023-12-22T08:41:11.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.189+0000 7f530f7fd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53080cdb80 con 0x7f5308070e80 2023-12-22T08:41:11.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.189+0000 7f530d599640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f530815e870 0x7f5308070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58620/0 (socket says 172.21.15.38:58620) 2023-12-22T08:41:11.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.189+0000 7f530d599640 1 -- 172.21.15.38:0/1507174778 learned_addr learned my addr 172.21.15.38:0/1507174778 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.189+0000 7f530dd9a640 1 --2- 172.21.15.38:0/1507174778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5308070e80 0x7f530806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.189+0000 7f530cd98640 1 --2- 172.21.15.38:0/1507174778 >> v2:172.21.15.89:3300/0 conn(0x7f530815ec50 0x7f53080ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.189+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720847514 0 0) 0x7f53080ce4b0 con 0x7f530815e870 2023-12-22T08:41:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.189+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f0003520 con 0x7f530815e870 2023-12-22T08:41:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3610356973 0 0) 0x7f52f0003520 con 0x7f530815e870 2023-12-22T08:41:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5308070e80 msgr2=0x7f530806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 --2- 172.21.15.38:0/1507174778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5308070e80 0x7f530806f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 >> v2:172.21.15.89:3300/0 conn(0x7f530815ec50 msgr2=0x7f53080ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 --2- 172.21.15.38:0/1507174778 >> v2:172.21.15.89:3300/0 conn(0x7f530815ec50 0x7f53080ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080cde60 con 0x7f530815e870 2023-12-22T08:41:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f52f8001670 con 0x7f530815e870 2023-12-22T08:41:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 >> v1:172.21.15.38:6789/0 conn(0x7f530815e870 legacy=0x7f5308070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 --2- 172.21.15.38:0/1507174778 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f0003970 0x7f52f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 --2- 172.21.15.38:0/1507174778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00047c0 0x7f52f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 --2- 172.21.15.38:0/1507174778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5308070e80 0x7f52f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530815fea0 con 0x7f52f00047c0 2023-12-22T08:41:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53080cdb80 con 0x7f52f0003970 2023-12-22T08:41:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f000bab0 con 0x7f5308070e80 2023-12-22T08:41:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f530cd98640 1 --2- 172.21.15.38:0/1507174778 >> v2:172.21.15.89:3300/0 conn(0x7f530815ec50 0x7f53080ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.190+0000 7f530cd98640 1 --2- 172.21.15.38:0/1507174778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00047c0 0x7f52f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.191+0000 7f530cd98640 1 -- 172.21.15.38:0/1507174778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5308070e80 msgr2=0x7f52f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.191+0000 7f530cd98640 1 --2- 172.21.15.38:0/1507174778 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5308070e80 0x7f52f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.191+0000 7f530cd98640 1 -- 172.21.15.38:0/1507174778 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f0003970 msgr2=0x7f52f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.191+0000 7f530cd98640 1 --2- 172.21.15.38:0/1507174778 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f0003970 0x7f52f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.191+0000 7f530cd98640 1 -- 172.21.15.38:0/1507174778 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f0003520 con 0x7f52f00047c0 2023-12-22T08:41:11.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.192+0000 7f530cd98640 1 --2- 172.21.15.38:0/1507174778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00047c0 0x7f52f0004c40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f52fc006fd0 tx=0x7f52f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e5269b4aff2606 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:11.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.192+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc030400 con 0x7f52f00047c0 2023-12-22T08:41:11.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.192+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc030560 con 0x7f52f00047c0 2023-12-22T08:41:11.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.192+0000 7f5307fff640 1 -- 172.21.15.38:0/1507174778 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0308d0 con 0x7f52f00047c0 2023-12-22T08:41:11.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.193+0000 7f530f7fd640 1 -- 172.21.15.38:0/1507174778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00047c0 msgr2=0x7f52f0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.193+0000 7f530f7fd640 1 --2- 172.21.15.38:0/1507174778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00047c0 0x7f52f0004c40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f52fc006fd0 tx=0x7f52f00057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.193+0000 7f530dd9a640 1 -- 172.21.15.38:0/1507174778 reap_dead start 2023-12-22T08:41:11.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.193+0000 7f530f7fd640 1 -- 172.21.15.38:0/1507174778 shutdown_connections 2023-12-22T08:41:11.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.193+0000 7f530f7fd640 1 -- 172.21.15.38:0/1507174778 >> 172.21.15.38:0/1507174778 conn(0x7f53080b20c0 msgr2=0x7f53080b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:11.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.193+0000 7f530f7fd640 1 -- 172.21.15.38:0/1507174778 shutdown_connections 2023-12-22T08:41:11.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.193+0000 7f530f7fd640 1 -- 172.21.15.38:0/1507174778 wait complete. 2023-12-22T08:41:11.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.195+0000 7f530f7fd640 1 Processor -- start 2023-12-22T08:41:11.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.195+0000 7f530f7fd640 1 -- start start 2023-12-22T08:41:11.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.196+0000 7f530f7fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f00047c0 0x7f5308158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.196+0000 7f530f7fd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f530814fc40 0x7f53081591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.196+0000 7f530f7fd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5308151860 0x7f5308151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.196+0000 7f530f7fd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53081525d0 con 0x7f530814fc40 2023-12-22T08:41:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.196+0000 7f530f7fd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53081532b0 con 0x7f52f00047c0 2023-12-22T08:41:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.196+0000 7f530f7fd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530806c2c0 con 0x7f5308151860 2023-12-22T08:41:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.196+0000 7f530cd98640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f530814fc40 0x7f53081591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.196+0000 7f530cd98640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f530814fc40 0x7f53081591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56068/0 (socket says 172.21.15.38:56068) 2023-12-22T08:41:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.196+0000 7f530cd98640 1 -- 172.21.15.38:0/3824348151 learned_addr learned my addr 172.21.15.38:0/3824348151 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.197+0000 7f530d599640 1 --2- 172.21.15.38:0/3824348151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f00047c0 0x7f5308158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.197+0000 7f530cd98640 1 -- 172.21.15.38:0/3824348151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5308151860 msgr2=0x7f5308151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.197+0000 7f530cd98640 1 --2- 172.21.15.38:0/3824348151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5308151860 0x7f5308151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.197+0000 7f530cd98640 1 -- 172.21.15.38:0/3824348151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f00047c0 msgr2=0x7f5308158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.197+0000 7f530cd98640 1 --2- 172.21.15.38:0/3824348151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f00047c0 0x7f5308158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.197+0000 7f530cd98640 1 -- 172.21.15.38:0/3824348151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530806c5a0 con 0x7f530814fc40 2023-12-22T08:41:11.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.197+0000 7f530cd98640 1 --2- 172.21.15.38:0/3824348151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f530814fc40 0x7f53081591c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009960 tx=0x7f52fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:11.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.197+0000 7f5305ffb640 1 -- 172.21.15.38:0/3824348151 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc03e040 con 0x7f530814fc40 2023-12-22T08:41:11.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.197+0000 7f5305ffb640 1 -- 172.21.15.38:0/3824348151 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc039880 con 0x7f530814fc40 2023-12-22T08:41:11.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.197+0000 7f5305ffb640 1 -- 172.21.15.38:0/3824348151 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc039c30 con 0x7f530814fc40 2023-12-22T08:41:11.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.197+0000 7f530f7fd640 1 -- 172.21.15.38:0/3824348151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530806c880 con 0x7f530814fc40 2023-12-22T08:41:11.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.198+0000 7f530f7fd640 1 -- 172.21.15.38:0/3824348151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5308152220 con 0x7f530814fc40 2023-12-22T08:41:11.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.199+0000 7f530f7fd640 1 -- 172.21.15.38:0/3824348151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5308061910 con 0x7f530814fc40 2023-12-22T08:41:11.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.200+0000 7f5305ffb640 1 -- 172.21.15.38:0/3824348151 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f52fc043440 con 0x7f530814fc40 2023-12-22T08:41:11.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.200+0000 7f5305ffb640 1 --2- 172.21.15.38:0/3824348151 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f52f406a460 0x7f52f406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.201+0000 7f5305ffb640 1 -- 172.21.15.38:0/3824348151 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f52fc0aa1e0 con 0x7f530814fc40 2023-12-22T08:41:11.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.201+0000 7f530d599640 1 --2- 172.21.15.38:0/3824348151 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f52f406a460 0x7f52f406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.202+0000 7f530d599640 1 --2- 172.21.15.38:0/3824348151 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f52f406a460 0x7f52f406c920 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f52f80079b0 tx=0x7f52f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:11.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.205+0000 7f5305ffb640 1 -- 172.21.15.38:0/3824348151 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f52fc075c60 con 0x7f530814fc40 2023-12-22T08:41:11.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.395+0000 7f530f7fd640 1 -- 172.21.15.38:0/3824348151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53081500d0 con 0x7f530814fc40 2023-12-22T08:41:11.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.396+0000 7f5305ffb640 1 -- 172.21.15.38:0/3824348151 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52fc02d030 con 0x7f530814fc40 2023-12-22T08:41:11.399 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:41:11.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.399+0000 7f530f7fd640 1 -- 172.21.15.38:0/3824348151 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f52f406a460 msgr2=0x7f52f406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.399+0000 7f530f7fd640 1 --2- 172.21.15.38:0/3824348151 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f52f406a460 0x7f52f406c920 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f52f80079b0 tx=0x7f52f8009040 comp rx=0 tx=0).stop 2023-12-22T08:41:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.399+0000 7f530f7fd640 1 -- 172.21.15.38:0/3824348151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f530814fc40 msgr2=0x7f53081591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.399+0000 7f530f7fd640 1 --2- 172.21.15.38:0/3824348151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f530814fc40 0x7f53081591c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009960 tx=0x7f52fc0046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.400+0000 7f530f7fd640 1 -- 172.21.15.38:0/3824348151 shutdown_connections 2023-12-22T08:41:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.400+0000 7f530f7fd640 1 --2- 172.21.15.38:0/3824348151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5308151860 0x7f5308151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.400+0000 7f530f7fd640 1 --2- 172.21.15.38:0/3824348151 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f52f406a460 0x7f52f406c920 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.400+0000 7f530f7fd640 1 --2- 172.21.15.38:0/3824348151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f530814fc40 0x7f53081591c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.400+0000 7f530f7fd640 1 --2- 172.21.15.38:0/3824348151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f00047c0 0x7f5308158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.400+0000 7f530f7fd640 1 -- 172.21.15.38:0/3824348151 >> 172.21.15.38:0/3824348151 conn(0x7f53080b20c0 msgr2=0x7f530815ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.400+0000 7f530f7fd640 1 -- 172.21.15.38:0/3824348151 shutdown_connections 2023-12-22T08:41:11.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.400+0000 7f530f7fd640 1 -- 172.21.15.38:0/3824348151 wait complete. 2023-12-22T08:41:11.422 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T08:41:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.620+0000 7f2a8bd1b640 1 Processor -- start 2023-12-22T08:41:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.620+0000 7f2a8bd1b640 1 -- start start 2023-12-22T08:41:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.621+0000 7f2a8bd1b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2a840b26a0 0x7f2a8406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.621+0000 7f2a8bd1b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2a8406cf50 0x7f2a840cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.621+0000 7f2a8bd1b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a840b3d10 con 0x7f2a840b22c0 2023-12-22T08:41:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.621+0000 7f2a8bd1b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8406c610 con 0x7f2a8406cf50 2023-12-22T08:41:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.621+0000 7f2a8bd1b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a840b4510 con 0x7f2a840b26a0 2023-12-22T08:41:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.622+0000 7f2a89ab7640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2a840b22c0 0x7f2a840b3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58636/0 (socket says 172.21.15.38:58636) 2023-12-22T08:41:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.622+0000 7f2a89ab7640 1 -- 172.21.15.38:0/2869568790 learned_addr learned my addr 172.21.15.38:0/2869568790 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.622+0000 7f2a8a2b8640 1 --2- 172.21.15.38:0/2869568790 >> v2:172.21.15.38:3300/0 conn(0x7f2a8406cf50 0x7f2a840cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.622+0000 7f2a88ab5640 1 -- 172.21.15.38:0/2869568790 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355472776 0 0) 0x7f2a80001110 con 0x7f2a840b22c0 2023-12-22T08:41:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.622+0000 7f2a88ab5640 1 -- 172.21.15.38:0/2869568790 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a70003520 con 0x7f2a840b22c0 2023-12-22T08:41:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.622+0000 7f2a892b6640 1 --2- 172.21.15.38:0/2869568790 >> v2:172.21.15.89:3300/0 conn(0x7f2a840b26a0 0x7f2a8406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.622+0000 7f2a8a2b8640 1 -- 172.21.15.38:0/2869568790 >> v2:172.21.15.89:3300/0 conn(0x7f2a840b26a0 msgr2=0x7f2a8406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.622+0000 7f2a8a2b8640 1 --2- 172.21.15.38:0/2869568790 >> v2:172.21.15.89:3300/0 conn(0x7f2a840b26a0 0x7f2a8406ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.622+0000 7f2a8a2b8640 1 -- 172.21.15.38:0/2869568790 >> v1:172.21.15.38:6789/0 conn(0x7f2a840b22c0 legacy=0x7f2a840b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.622+0000 7f2a8a2b8640 1 -- 172.21.15.38:0/2869568790 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a840b3f50 con 0x7f2a8406cf50 2023-12-22T08:41:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.623+0000 7f2a8a2b8640 1 --2- 172.21.15.38:0/2869568790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a8406cf50 0x7f2a840cb830 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2a840b2b10 tx=0x7f2a7c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da678be01e8e375 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.624+0000 7f2a88ab5640 1 -- 172.21.15.38:0/2869568790 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c02cbf0 con 0x7f2a8406cf50 2023-12-22T08:41:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.624+0000 7f2a88ab5640 1 -- 172.21.15.38:0/2869568790 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c02cd50 con 0x7f2a8406cf50 2023-12-22T08:41:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.624+0000 7f2a88ab5640 1 -- 172.21.15.38:0/2869568790 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c034660 con 0x7f2a8406cf50 2023-12-22T08:41:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.624+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/2869568790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a8406cf50 msgr2=0x7f2a840cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.624+0000 7f2a8bd1b640 1 --2- 172.21.15.38:0/2869568790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a8406cf50 0x7f2a840cb830 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2a840b2b10 tx=0x7f2a7c02be40 comp rx=0 tx=0).stop 2023-12-22T08:41:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.624+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/2869568790 shutdown_connections 2023-12-22T08:41:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.624+0000 7f2a8bd1b640 1 --2- 172.21.15.38:0/2869568790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a8406cf50 0x7f2a840cb830 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.624+0000 7f2a8bd1b640 1 --2- 172.21.15.38:0/2869568790 >> v2:172.21.15.89:3300/0 conn(0x7f2a840b26a0 0x7f2a8406ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.624+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/2869568790 >> 172.21.15.38:0/2869568790 conn(0x7f2a840cf070 msgr2=0x7f2a840cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.624+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/2869568790 shutdown_connections 2023-12-22T08:41:11.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.624+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/2869568790 wait complete. 2023-12-22T08:41:11.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.626+0000 7f2a8bd1b640 1 Processor -- start 2023-12-22T08:41:11.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.626+0000 7f2a8bd1b640 1 -- start start 2023-12-22T08:41:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.627+0000 7f2a8bd1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a8406cf50 0x7f2a84149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.627+0000 7f2a8bd1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a840b22c0 0x7f2a841ec540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.627+0000 7f2a8bd1b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a840b26a0 0x7f2a841eca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.627+0000 7f2a8bd1b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a84159450 con 0x7f2a840b26a0 2023-12-22T08:41:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.627+0000 7f2a8bd1b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a84156b40 con 0x7f2a8406cf50 2023-12-22T08:41:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.627+0000 7f2a8bd1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a841576c0 con 0x7f2a840b22c0 2023-12-22T08:41:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.627+0000 7f2a8a2b8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a840b26a0 0x7f2a841eca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.627+0000 7f2a8a2b8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a840b26a0 0x7f2a841eca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56074/0 (socket says 172.21.15.38:56074) 2023-12-22T08:41:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.627+0000 7f2a8a2b8640 1 -- 172.21.15.38:0/1851014251 learned_addr learned my addr 172.21.15.38:0/1851014251 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:11.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.628+0000 7f2a89ab7640 1 --2- 172.21.15.38:0/1851014251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a8406cf50 0x7f2a84149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.628+0000 7f2a8a2b8640 1 -- 172.21.15.38:0/1851014251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a840b22c0 msgr2=0x7f2a841ec540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.628+0000 7f2a8a2b8640 1 --2- 172.21.15.38:0/1851014251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a840b22c0 0x7f2a841ec540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.628+0000 7f2a8a2b8640 1 -- 172.21.15.38:0/1851014251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a8406cf50 msgr2=0x7f2a84149100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.628+0000 7f2a8a2b8640 1 --2- 172.21.15.38:0/1851014251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a8406cf50 0x7f2a84149100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.628+0000 7f2a8a2b8640 1 -- 172.21.15.38:0/1851014251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c009a70 con 0x7f2a840b26a0 2023-12-22T08:41:11.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.628+0000 7f2a8a2b8640 1 --2- 172.21.15.38:0/1851014251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a840b26a0 0x7f2a841eca80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c02c450 tx=0x7f2a7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:11.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.628+0000 7f2a7a7fc640 1 -- 172.21.15.38:0/1851014251 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c040650 con 0x7f2a840b26a0 2023-12-22T08:41:11.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.628+0000 7f2a7a7fc640 1 -- 172.21.15.38:0/1851014251 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c0407b0 con 0x7f2a840b26a0 2023-12-22T08:41:11.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.628+0000 7f2a7a7fc640 1 -- 172.21.15.38:0/1851014251 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c040b60 con 0x7f2a840b26a0 2023-12-22T08:41:11.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.628+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/1851014251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a84149640 con 0x7f2a840b26a0 2023-12-22T08:41:11.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.629+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/1851014251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a84157070 con 0x7f2a840b26a0 2023-12-22T08:41:11.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.630+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/1851014251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a84061910 con 0x7f2a840b26a0 2023-12-22T08:41:11.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.630+0000 7f2a7a7fc640 1 -- 172.21.15.38:0/1851014251 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2a7c040cc0 con 0x7f2a840b26a0 2023-12-22T08:41:11.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.631+0000 7f2a7a7fc640 1 --2- 172.21.15.38:0/1851014251 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a6806a460 0x7f2a6806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.631+0000 7f2a7a7fc640 1 -- 172.21.15.38:0/1851014251 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2a7c0ab0e0 con 0x7f2a840b26a0 2023-12-22T08:41:11.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.632+0000 7f2a89ab7640 1 --2- 172.21.15.38:0/1851014251 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a6806a460 0x7f2a6806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.633+0000 7f2a89ab7640 1 --2- 172.21.15.38:0/1851014251 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a6806a460 0x7f2a6806c920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2a80001370 tx=0x7f2a80009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:11.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.636+0000 7f2a7a7fc640 1 -- 172.21.15.38:0/1851014251 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2a7c076b30 con 0x7f2a840b26a0 2023-12-22T08:41:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.832+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/1851014251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2a84157800 con 0x7f2a840b26a0 2023-12-22T08:41:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.833+0000 7f2a7a7fc640 1 -- 172.21.15.38:0/1851014251 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2a7c009450 con 0x7f2a840b26a0 2023-12-22T08:41:11.836 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:11.836 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-12-22T08:41:11.836 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:11.836 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-12-22T08:41:11.836 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-12-22T08:41:11.836 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:11.836 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-12-22T08:41:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.836+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/1851014251 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a6806a460 msgr2=0x7f2a6806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.836+0000 7f2a8bd1b640 1 --2- 172.21.15.38:0/1851014251 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a6806a460 0x7f2a6806c920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2a80001370 tx=0x7f2a80009040 comp rx=0 tx=0).stop 2023-12-22T08:41:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.836+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/1851014251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a840b26a0 msgr2=0x7f2a841eca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.836+0000 7f2a8bd1b640 1 --2- 172.21.15.38:0/1851014251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a840b26a0 0x7f2a841eca80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c02c450 tx=0x7f2a7c004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.836+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/1851014251 shutdown_connections 2023-12-22T08:41:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.836+0000 7f2a8bd1b640 1 --2- 172.21.15.38:0/1851014251 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a6806a460 0x7f2a6806c920 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.836+0000 7f2a8bd1b640 1 --2- 172.21.15.38:0/1851014251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a840b26a0 0x7f2a841eca80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.836+0000 7f2a8bd1b640 1 --2- 172.21.15.38:0/1851014251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a840b22c0 0x7f2a841ec540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.836+0000 7f2a8bd1b640 1 --2- 172.21.15.38:0/1851014251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a8406cf50 0x7f2a84149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.836+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/1851014251 >> 172.21.15.38:0/1851014251 conn(0x7f2a840cf070 msgr2=0x7f2a840b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.836+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/1851014251 shutdown_connections 2023-12-22T08:41:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:11.836+0000 7f2a8bd1b640 1 -- 172.21.15.38:0/1851014251 wait complete. 2023-12-22T08:41:11.858 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T08:41:11.858 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T08:41:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.092+0000 7f2bd359e640 1 Processor -- start 2023-12-22T08:41:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.092+0000 7f2bd359e640 1 -- start start 2023-12-22T08:41:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.094+0000 7f2bd359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bd415b370 0x7f2bd406d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.094+0000 7f2bd359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2bd40ae6c0 0x7f2bd406fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.094+0000 7f2bd359e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd415ca20 con 0x7f2bd406d6a0 2023-12-22T08:41:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.094+0000 7f2bd359e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd415b750 con 0x7f2bd40ae6c0 2023-12-22T08:41:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.094+0000 7f2bd359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd406dc20 con 0x7f2bd415b370 2023-12-22T08:41:12.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.094+0000 7f2bd1d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2bd406d6a0 0x7f2bd40adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58648/0 (socket says 172.21.15.38:58648) 2023-12-22T08:41:12.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.094+0000 7f2bd1d9b640 1 -- 172.21.15.38:0/2918317886 learned_addr learned my addr 172.21.15.38:0/2918317886 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:12.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.094+0000 7f2bd2d9d640 1 --2- 172.21.15.38:0/2918317886 >> v2:172.21.15.89:3300/0 conn(0x7f2bd40ae6c0 0x7f2bd406fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.094+0000 7f2bd259c640 1 --2- 172.21.15.38:0/2918317886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bd415b370 0x7f2bd406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.095+0000 7f2bd159a640 1 -- 172.21.15.38:0/2918317886 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465256107 0 0) 0x7f2bd415ca20 con 0x7f2bd406d6a0 2023-12-22T08:41:12.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.095+0000 7f2bd159a640 1 -- 172.21.15.38:0/2918317886 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bbc003520 con 0x7f2bd406d6a0 2023-12-22T08:41:12.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.095+0000 7f2bd2d9d640 1 -- 172.21.15.38:0/2918317886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bd415b370 msgr2=0x7f2bd406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:12.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.095+0000 7f2bd2d9d640 1 --2- 172.21.15.38:0/2918317886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bd415b370 0x7f2bd406d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.095+0000 7f2bd2d9d640 1 -- 172.21.15.38:0/2918317886 >> v1:172.21.15.38:6789/0 conn(0x7f2bd406d6a0 legacy=0x7f2bd40adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.095+0000 7f2bd2d9d640 1 -- 172.21.15.38:0/2918317886 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd406df00 con 0x7f2bd40ae6c0 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.097+0000 7f2bd2d9d640 1 --2- 172.21.15.38:0/2918317886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bd40ae6c0 0x7f2bd406fcf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009d90 tx=0x7f2bcc02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85bfe6afdc86d1f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.097+0000 7f2bd159a640 1 -- 172.21.15.38:0/2918317886 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc02cc60 con 0x7f2bd40ae6c0 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.098+0000 7f2bd159a640 1 -- 172.21.15.38:0/2918317886 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc02cdc0 con 0x7f2bd40ae6c0 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.098+0000 7f2bd159a640 1 -- 172.21.15.38:0/2918317886 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc034660 con 0x7f2bd40ae6c0 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.098+0000 7f2bd359e640 1 -- 172.21.15.38:0/2918317886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bd40ae6c0 msgr2=0x7f2bd406fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.098+0000 7f2bd359e640 1 --2- 172.21.15.38:0/2918317886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bd40ae6c0 0x7f2bd406fcf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009d90 tx=0x7f2bcc02beb0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.098+0000 7f2bd359e640 1 -- 172.21.15.38:0/2918317886 shutdown_connections 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.098+0000 7f2bd359e640 1 --2- 172.21.15.38:0/2918317886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bd40ae6c0 0x7f2bd406fcf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.098+0000 7f2bd359e640 1 --2- 172.21.15.38:0/2918317886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bd415b370 0x7f2bd406d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.098+0000 7f2bd359e640 1 -- 172.21.15.38:0/2918317886 >> 172.21.15.38:0/2918317886 conn(0x7f2bd40b1110 msgr2=0x7f2bd40b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.099+0000 7f2bd359e640 1 -- 172.21.15.38:0/2918317886 shutdown_connections 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.099+0000 7f2bd359e640 1 -- 172.21.15.38:0/2918317886 wait complete. 2023-12-22T08:41:12.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.101+0000 7f2bd359e640 1 Processor -- start 2023-12-22T08:41:12.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.101+0000 7f2bd359e640 1 -- start start 2023-12-22T08:41:12.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.102+0000 7f2bd359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bd406d6a0 0x7f2bd4154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.102+0000 7f2bd359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bd40ae6c0 0x7f2bd415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.102+0000 7f2bd359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bd415b370 0x7f2bd415e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.102+0000 7f2bd359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd4155390 con 0x7f2bd415b370 2023-12-22T08:41:12.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.102+0000 7f2bd359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd41f35d0 con 0x7f2bd40ae6c0 2023-12-22T08:41:12.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.102+0000 7f2bd359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd40acc90 con 0x7f2bd406d6a0 2023-12-22T08:41:12.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.103+0000 7f2bd2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bd415b370 0x7f2bd415e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.103+0000 7f2bd2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bd415b370 0x7f2bd415e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56082/0 (socket says 172.21.15.38:56082) 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.103+0000 7f2bd2d9d640 1 -- 172.21.15.38:0/540612436 learned_addr learned my addr 172.21.15.38:0/540612436 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.103+0000 7f2bd1d9b640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bd40ae6c0 0x7f2bd415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.103+0000 7f2bd259c640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bd406d6a0 0x7f2bd4154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.103+0000 7f2bd2d9d640 1 -- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bd406d6a0 msgr2=0x7f2bd4154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.103+0000 7f2bd2d9d640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bd406d6a0 0x7f2bd4154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.103+0000 7f2bd2d9d640 1 -- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bd40ae6c0 msgr2=0x7f2bd415dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.103+0000 7f2bd2d9d640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bd40ae6c0 0x7f2bd415dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.103+0000 7f2bd2d9d640 1 -- 172.21.15.38:0/540612436 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc009a70 con 0x7f2bd415b370 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.104+0000 7f2bd2d9d640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bd415b370 0x7f2bd415e1d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009eb0 tx=0x7f2bcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.104+0000 7f2bc2ffd640 1 -- 172.21.15.38:0/540612436 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc03e610 con 0x7f2bd415b370 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.104+0000 7f2bc2ffd640 1 -- 172.21.15.38:0/540612436 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc03e770 con 0x7f2bd415b370 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.104+0000 7f2bc2ffd640 1 -- 172.21.15.38:0/540612436 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc03eb20 con 0x7f2bd415b370 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.104+0000 7f2bd359e640 1 -- 172.21.15.38:0/540612436 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd40abed0 con 0x7f2bd415b370 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.104+0000 7f2bd359e640 1 -- 172.21.15.38:0/540612436 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd40ac490 con 0x7f2bd415b370 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.105+0000 7f2bd359e640 1 -- 172.21.15.38:0/540612436 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd4061910 con 0x7f2bd415b370 2023-12-22T08:41:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.106+0000 7f2bc2ffd640 1 -- 172.21.15.38:0/540612436 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2bcc03b050 con 0x7f2bd415b370 2023-12-22T08:41:12.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.108+0000 7f2bc2ffd640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2bb406a430 0x7f2bb406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.108+0000 7f2bc2ffd640 1 -- 172.21.15.38:0/540612436 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2bcc0aafc0 con 0x7f2bd415b370 2023-12-22T08:41:12.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.108+0000 7f2bd259c640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2bb406a430 0x7f2bb406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.110+0000 7f2bd259c640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2bb406a430 0x7f2bb406c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2bd41588d0 tx=0x7f2bc4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.112+0000 7f2bc2ffd640 1 -- 172.21.15.38:0/540612436 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2bcc0ddc80 con 0x7f2bd415b370 2023-12-22T08:41:12.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.305+0000 7f2bd359e640 1 -- 172.21.15.38:0/540612436 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2bd406fd20 con 0x7f2bd415b370 2023-12-22T08:41:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.540+0000 7f2bc2ffd640 1 -- 172.21.15.38:0/540612436 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2bcc0390b0 con 0x7f2bd415b370 2023-12-22T08:41:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-12-22T08:41:12.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.546+0000 7f2bd359e640 1 -- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2bb406a430 msgr2=0x7f2bb406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.546+0000 7f2bd359e640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2bb406a430 0x7f2bb406c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2bd41588d0 tx=0x7f2bc4008040 comp rx=0 tx=0).stop 2023-12-22T08:41:12.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.546+0000 7f2bd359e640 1 -- 172.21.15.38:0/540612436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bd415b370 msgr2=0x7f2bd415e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.547+0000 7f2bd359e640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bd415b370 0x7f2bd415e1d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009eb0 tx=0x7f2bcc004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:12.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.547+0000 7f2bd359e640 1 -- 172.21.15.38:0/540612436 shutdown_connections 2023-12-22T08:41:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.547+0000 7f2bd359e640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2bb406a430 0x7f2bb406c8f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.547+0000 7f2bd359e640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bd415b370 0x7f2bd415e1d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.547+0000 7f2bd359e640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bd40ae6c0 0x7f2bd415dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.547+0000 7f2bd359e640 1 --2- 172.21.15.38:0/540612436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bd406d6a0 0x7f2bd4154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.547+0000 7f2bd359e640 1 -- 172.21.15.38:0/540612436 >> 172.21.15.38:0/540612436 conn(0x7f2bd40b1110 msgr2=0x7f2bd40706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.548+0000 7f2bd359e640 1 -- 172.21.15.38:0/540612436 shutdown_connections 2023-12-22T08:41:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.548+0000 7f2bd359e640 1 -- 172.21.15.38:0/540612436 wait complete. 2023-12-22T08:41:12.574 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T08:41:12.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.798+0000 7f49d359e640 1 Processor -- start 2023-12-22T08:41:12.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.798+0000 7f49d359e640 1 -- start start 2023-12-22T08:41:12.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.800+0000 7f49d359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d415b0e0 0x7f49d415b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.800+0000 7f49d359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49d4071460 0x7f49d4071890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.800+0000 7f49d359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d415edf0 con 0x7f49d409c980 2023-12-22T08:41:12.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.800+0000 7f49d359e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d415d0d0 con 0x7f49d4071460 2023-12-22T08:41:12.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.800+0000 7f49d359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d4071dd0 con 0x7f49d415b0e0 2023-12-22T08:41:12.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.801+0000 7f49d2d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49d4071460 0x7f49d4071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.801+0000 7f49d2d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49d4071460 0x7f49d4071890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:37218/0 (socket says 172.21.15.38:37218) 2023-12-22T08:41:12.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.801+0000 7f49d2d9d640 1 -- 172.21.15.38:0/1755209347 learned_addr learned my addr 172.21.15.38:0/1755209347 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:12.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.801+0000 7f49d259c640 1 --2- 172.21.15.38:0/1755209347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d415b0e0 0x7f49d415b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.802+0000 7f49d259c640 1 -- 172.21.15.38:0/1755209347 >> v2:172.21.15.89:3300/0 conn(0x7f49d4071460 msgr2=0x7f49d4071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:12.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.802+0000 7f49d259c640 1 --2- 172.21.15.38:0/1755209347 >> v2:172.21.15.89:3300/0 conn(0x7f49d4071460 0x7f49d4071890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.802+0000 7f49d259c640 1 -- 172.21.15.38:0/1755209347 >> v1:172.21.15.89:6789/0 conn(0x7f49d409c980 legacy=0x7f49d415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.802+0000 7f49d259c640 1 -- 172.21.15.38:0/1755209347 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d415bd90 con 0x7f49d415b0e0 2023-12-22T08:41:12.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.803+0000 7f49d259c640 1 --2- 172.21.15.38:0/1755209347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d415b0e0 0x7f49d415b4c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009d90 tx=0x7f49c402bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5157bd41696b257 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.804+0000 7f49d159a640 1 -- 172.21.15.38:0/1755209347 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c402cb30 con 0x7f49d415b0e0 2023-12-22T08:41:12.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.804+0000 7f49d159a640 1 -- 172.21.15.38:0/1755209347 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c402cc90 con 0x7f49d415b0e0 2023-12-22T08:41:12.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.804+0000 7f49d159a640 1 -- 172.21.15.38:0/1755209347 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4034440 con 0x7f49d415b0e0 2023-12-22T08:41:12.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.804+0000 7f49d359e640 1 -- 172.21.15.38:0/1755209347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d415b0e0 msgr2=0x7f49d415b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.804+0000 7f49d359e640 1 --2- 172.21.15.38:0/1755209347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d415b0e0 0x7f49d415b4c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009d90 tx=0x7f49c402bd80 comp rx=0 tx=0).stop 2023-12-22T08:41:12.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.805+0000 7f49d359e640 1 -- 172.21.15.38:0/1755209347 shutdown_connections 2023-12-22T08:41:12.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.805+0000 7f49d359e640 1 --2- 172.21.15.38:0/1755209347 >> v2:172.21.15.89:3300/0 conn(0x7f49d4071460 0x7f49d4071890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.805+0000 7f49d359e640 1 --2- 172.21.15.38:0/1755209347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d415b0e0 0x7f49d415b4c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.805+0000 7f49d359e640 1 -- 172.21.15.38:0/1755209347 >> 172.21.15.38:0/1755209347 conn(0x7f49d40cf000 msgr2=0x7f49d40cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:12.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.805+0000 7f49d359e640 1 -- 172.21.15.38:0/1755209347 shutdown_connections 2023-12-22T08:41:12.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.805+0000 7f49d359e640 1 -- 172.21.15.38:0/1755209347 wait complete. 2023-12-22T08:41:12.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.806+0000 7f49d359e640 1 Processor -- start 2023-12-22T08:41:12.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.807+0000 7f49d359e640 1 -- start start 2023-12-22T08:41:12.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.807+0000 7f49d359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49d4071460 0x7f49d4145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d409c980 0x7f49d41522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49d4144430 0x7f49d41473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d414d5f0 con 0x7f49d4071460 2023-12-22T08:41:12.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d41448c0 con 0x7f49d4144430 2023-12-22T08:41:12.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d4144ba0 con 0x7f49d409c980 2023-12-22T08:41:12.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49d4071460 0x7f49d4145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49d4071460 0x7f49d4145960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56084/0 (socket says 172.21.15.38:56084) 2023-12-22T08:41:12.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d259c640 1 -- 172.21.15.38:0/1821088326 learned_addr learned my addr 172.21.15.38:0/1821088326 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:12.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d2d9d640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49d4144430 0x7f49d41473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d1d9b640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d409c980 0x7f49d41522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d259c640 1 -- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d409c980 msgr2=0x7f49d41522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d259c640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d409c980 0x7f49d41522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d259c640 1 -- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49d4144430 msgr2=0x7f49d41473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d259c640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49d4144430 0x7f49d41473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.808+0000 7f49d259c640 1 -- 172.21.15.38:0/1821088326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c4009a70 con 0x7f49d4071460 2023-12-22T08:41:12.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.809+0000 7f49d1d9b640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d409c980 0x7f49d41522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:12.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.809+0000 7f49d259c640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49d4071460 0x7f49d4145960 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f49c4037040 tx=0x7f49c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.809+0000 7f49caffd640 1 -- 172.21.15.38:0/1821088326 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4040450 con 0x7f49d4071460 2023-12-22T08:41:12.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.809+0000 7f49caffd640 1 -- 172.21.15.38:0/1821088326 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c40405b0 con 0x7f49d4071460 2023-12-22T08:41:12.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.809+0000 7f49caffd640 1 -- 172.21.15.38:0/1821088326 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4040960 con 0x7f49d4071460 2023-12-22T08:41:12.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.809+0000 7f49d359e640 1 -- 172.21.15.38:0/1821088326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d4144e80 con 0x7f49d4071460 2023-12-22T08:41:12.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.809+0000 7f49d359e640 1 -- 172.21.15.38:0/1821088326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d4145440 con 0x7f49d4071460 2023-12-22T08:41:12.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.810+0000 7f49d359e640 1 -- 172.21.15.38:0/1821088326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d4061910 con 0x7f49d4071460 2023-12-22T08:41:12.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.812+0000 7f49caffd640 1 -- 172.21.15.38:0/1821088326 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f49c4040ac0 con 0x7f49d4071460 2023-12-22T08:41:12.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.813+0000 7f49caffd640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f49b406a430 0x7f49b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.813+0000 7f49caffd640 1 -- 172.21.15.38:0/1821088326 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f49c40ab7c0 con 0x7f49d4071460 2023-12-22T08:41:12.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.813+0000 7f49d1d9b640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f49b406a430 0x7f49b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.814+0000 7f49d1d9b640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f49b406a430 0x7f49b406c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49d4146d70 tx=0x7f49bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:12.817+0000 7f49caffd640 1 -- 172.21.15.38:0/1821088326 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f49c4076f70 con 0x7f49d4071460 2023-12-22T08:41:13.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.014+0000 7f49d359e640 1 -- 172.21.15.38:0/1821088326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f49d406d7d0 con 0x7f49d4071460 2023-12-22T08:41:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.564+0000 7f49caffd640 1 -- 172.21.15.38:0/1821088326 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f49c407a590 con 0x7f49d4071460 2023-12-22T08:41:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-12-22T08:41:13.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.569+0000 7f49d359e640 1 -- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f49b406a430 msgr2=0x7f49b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.569+0000 7f49d359e640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f49b406a430 0x7f49b406c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49d4146d70 tx=0x7f49bc009040 comp rx=0 tx=0).stop 2023-12-22T08:41:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.569+0000 7f49d359e640 1 -- 172.21.15.38:0/1821088326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49d4071460 msgr2=0x7f49d4145960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.569+0000 7f49d359e640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49d4071460 0x7f49d4145960 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f49c4037040 tx=0x7f49c4004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.569+0000 7f49d359e640 1 -- 172.21.15.38:0/1821088326 shutdown_connections 2023-12-22T08:41:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.569+0000 7f49d359e640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49d4144430 0x7f49d41473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.569+0000 7f49d359e640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49d409c980 0x7f49d41522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.569+0000 7f49d359e640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f49b406a430 0x7f49b406c8f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.569+0000 7f49d359e640 1 --2- 172.21.15.38:0/1821088326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49d4071460 0x7f49d4145960 secure :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f49c4037040 tx=0x7f49c4004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.569+0000 7f49d359e640 1 -- 172.21.15.38:0/1821088326 >> 172.21.15.38:0/1821088326 conn(0x7f49d40cf000 msgr2=0x7f49d415df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.572+0000 7f49d359e640 1 -- 172.21.15.38:0/1821088326 shutdown_connections 2023-12-22T08:41:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.574+0000 7f49d359e640 1 -- 172.21.15.38:0/1821088326 wait complete. 2023-12-22T08:41:13.604 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T08:41:13.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.803+0000 7f55326a1640 1 Processor -- start 2023-12-22T08:41:13.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.803+0000 7f55326a1640 1 -- start start 2023-12-22T08:41:13.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.805+0000 7f55326a1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f552c143600 0x7f552c15e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.805+0000 7f55326a1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c0cea50 0x7f552c0ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.805+0000 7f55326a1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c15ea00 con 0x7f552c06d590 2023-12-22T08:41:13.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.805+0000 7f55326a1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c0cf410 con 0x7f552c143600 2023-12-22T08:41:13.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.805+0000 7f55326a1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c140f70 con 0x7f552c0cea50 2023-12-22T08:41:13.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.805+0000 7f552bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f552c143600 0x7f552c15e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.806+0000 7f552bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f552c143600 0x7f552c15e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:37242/0 (socket says 172.21.15.38:37242) 2023-12-22T08:41:13.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.806+0000 7f552bfff640 1 -- 172.21.15.38:0/2836954256 learned_addr learned my addr 172.21.15.38:0/2836954256 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:13.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.806+0000 7f5530c3e640 1 --1- 172.21.15.38:0/2836954256 >> v1:172.21.15.89:6789/0 conn(0x7f552c06d590 0x7f552c06d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:60652/0 (socket says 172.21.15.38:60652) 2023-12-22T08:41:13.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.806+0000 7f552b7fe640 1 --2- 172.21.15.38:0/2836954256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c0cea50 0x7f552c0ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.806+0000 7f552b7fe640 1 -- 172.21.15.38:0/2836954256 >> v2:172.21.15.89:3300/0 conn(0x7f552c143600 msgr2=0x7f552c15e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:13.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.806+0000 7f552b7fe640 1 --2- 172.21.15.38:0/2836954256 >> v2:172.21.15.89:3300/0 conn(0x7f552c143600 0x7f552c15e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.806+0000 7f552b7fe640 1 -- 172.21.15.38:0/2836954256 >> v1:172.21.15.89:6789/0 conn(0x7f552c06d590 legacy=0x7f552c06d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.807+0000 7f552b7fe640 1 -- 172.21.15.38:0/2836954256 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c06c300 con 0x7f552c0cea50 2023-12-22T08:41:13.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.807+0000 7f552bfff640 1 --2- 172.21.15.38:0/2836954256 >> v2:172.21.15.89:3300/0 conn(0x7f552c143600 0x7f552c15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:13.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.808+0000 7f552b7fe640 1 --2- 172.21.15.38:0/2836954256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c0cea50 0x7f552c0ceed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f55200097a0 tx=0x7f552002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=699f4644890111e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:13.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.808+0000 7f552affd640 1 -- 172.21.15.38:0/2836954256 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552002d040 con 0x7f552c0cea50 2023-12-22T08:41:13.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.808+0000 7f552affd640 1 -- 172.21.15.38:0/2836954256 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5520031810 con 0x7f552c0cea50 2023-12-22T08:41:13.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.809+0000 7f552affd640 1 -- 172.21.15.38:0/2836954256 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520031ba0 con 0x7f552c0cea50 2023-12-22T08:41:13.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.809+0000 7f55326a1640 1 -- 172.21.15.38:0/2836954256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c0cea50 msgr2=0x7f552c0ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.809+0000 7f55326a1640 1 --2- 172.21.15.38:0/2836954256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c0cea50 0x7f552c0ceed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f55200097a0 tx=0x7f552002b8b0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.809+0000 7f55326a1640 1 -- 172.21.15.38:0/2836954256 shutdown_connections 2023-12-22T08:41:13.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.809+0000 7f55326a1640 1 --2- 172.21.15.38:0/2836954256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c0cea50 0x7f552c0ceed0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.809+0000 7f55326a1640 1 --2- 172.21.15.38:0/2836954256 >> v2:172.21.15.89:3300/0 conn(0x7f552c143600 0x7f552c15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.809+0000 7f55326a1640 1 -- 172.21.15.38:0/2836954256 >> 172.21.15.38:0/2836954256 conn(0x7f552c0cfe70 msgr2=0x7f552c0d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:13.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.809+0000 7f55326a1640 1 -- 172.21.15.38:0/2836954256 shutdown_connections 2023-12-22T08:41:13.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.809+0000 7f55326a1640 1 -- 172.21.15.38:0/2836954256 wait complete. 2023-12-22T08:41:13.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.811+0000 7f55326a1640 1 Processor -- start 2023-12-22T08:41:13.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.811+0000 7f55326a1640 1 -- start start 2023-12-22T08:41:13.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.812+0000 7f55326a1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c06d590 0x7f552c13fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.812+0000 7f55326a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f552c0cea50 0x7f552c09e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.812+0000 7f55326a1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f552c143600 0x7f552c142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.812+0000 7f55326a1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c156170 con 0x7f552c143600 2023-12-22T08:41:13.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.812+0000 7f55326a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c157be0 con 0x7f552c0cea50 2023-12-22T08:41:13.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.812+0000 7f55326a1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c1554f0 con 0x7f552c06d590 2023-12-22T08:41:13.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.813+0000 7f5530c3e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f552c143600 0x7f552c142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.813+0000 7f5530c3e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f552c143600 0x7f552c142190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56100/0 (socket says 172.21.15.38:56100) 2023-12-22T08:41:13.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.813+0000 7f5530c3e640 1 -- 172.21.15.38:0/2841917469 learned_addr learned my addr 172.21.15.38:0/2841917469 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:13.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.813+0000 7f552b7fe640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f552c0cea50 0x7f552c09e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.813+0000 7f552bfff640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c06d590 0x7f552c13fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.813+0000 7f5530c3e640 1 -- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c06d590 msgr2=0x7f552c13fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.813+0000 7f5530c3e640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c06d590 0x7f552c13fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.813+0000 7f5530c3e640 1 -- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f552c0cea50 msgr2=0x7f552c09e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.813+0000 7f5530c3e640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f552c0cea50 0x7f552c09e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.813+0000 7f5530c3e640 1 -- 172.21.15.38:0/2841917469 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c009b30 con 0x7f552c143600 2023-12-22T08:41:13.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.814+0000 7f5530c3e640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f552c143600 0x7f552c142190 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f552400c390 tx=0x7f552400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:13.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.814+0000 7f5528ff9640 1 -- 172.21.15.38:0/2841917469 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240074e0 con 0x7f552c143600 2023-12-22T08:41:13.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.814+0000 7f5528ff9640 1 -- 172.21.15.38:0/2841917469 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5524007640 con 0x7f552c143600 2023-12-22T08:41:13.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.814+0000 7f5528ff9640 1 -- 172.21.15.38:0/2841917469 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240049e0 con 0x7f552c143600 2023-12-22T08:41:13.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.814+0000 7f55326a1640 1 -- 172.21.15.38:0/2841917469 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5520009400 con 0x7f552c143600 2023-12-22T08:41:13.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.814+0000 7f55326a1640 1 -- 172.21.15.38:0/2841917469 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c155ab0 con 0x7f552c143600 2023-12-22T08:41:13.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.815+0000 7f55326a1640 1 -- 172.21.15.38:0/2841917469 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c061910 con 0x7f552c143600 2023-12-22T08:41:13.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.817+0000 7f5528ff9640 1 -- 172.21.15.38:0/2841917469 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5524004b40 con 0x7f552c143600 2023-12-22T08:41:13.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.818+0000 7f5528ff9640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f551806a460 0x7f551806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.818+0000 7f5528ff9640 1 -- 172.21.15.38:0/2841917469 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5524088930 con 0x7f552c143600 2023-12-22T08:41:13.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.818+0000 7f552bfff640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f551806a460 0x7f551806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.819+0000 7f552bfff640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f551806a460 0x7f551806c920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f551c0092a0 tx=0x7f551c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:13.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:13.822+0000 7f5528ff9640 1 -- 172.21.15.38:0/2841917469 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5524054060 con 0x7f552c143600 2023-12-22T08:41:14.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.059+0000 7f55326a1640 1 -- 172.21.15.38:0/2841917469 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f552c0b21d0 con 0x7f552c143600 2023-12-22T08:41:14.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.074+0000 7f5528ff9640 1 -- 172.21.15.38:0/2841917469 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5524057680 con 0x7f552c143600 2023-12-22T08:41:14.079 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 4 and data pool 5 2023-12-22T08:41:14.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.079+0000 7f55326a1640 1 -- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f551806a460 msgr2=0x7f551806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.079+0000 7f55326a1640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f551806a460 0x7f551806c920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f551c0092a0 tx=0x7f551c00b040 comp rx=0 tx=0).stop 2023-12-22T08:41:14.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.079+0000 7f55326a1640 1 -- 172.21.15.38:0/2841917469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f552c143600 msgr2=0x7f552c142190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.079+0000 7f55326a1640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f552c143600 0x7f552c142190 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f552400c390 tx=0x7f552400c850 comp rx=0 tx=0).stop 2023-12-22T08:41:14.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.079+0000 7f55326a1640 1 -- 172.21.15.38:0/2841917469 shutdown_connections 2023-12-22T08:41:14.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.079+0000 7f55326a1640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f551806a460 0x7f551806c920 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.079+0000 7f55326a1640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f552c143600 0x7f552c142190 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.079+0000 7f55326a1640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f552c0cea50 0x7f552c09e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.079+0000 7f55326a1640 1 --2- 172.21.15.38:0/2841917469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c06d590 0x7f552c13fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.079+0000 7f55326a1640 1 -- 172.21.15.38:0/2841917469 >> 172.21.15.38:0/2841917469 conn(0x7f552c0cfe70 msgr2=0x7f552c160530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:14.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.085+0000 7f55326a1640 1 -- 172.21.15.38:0/2841917469 shutdown_connections 2023-12-22T08:41:14.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.085+0000 7f55326a1640 1 -- 172.21.15.38:0/2841917469 wait complete. 2023-12-22T08:41:14.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.294+0000 7fd96b59e640 1 Processor -- start 2023-12-22T08:41:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.294+0000 7fd96b59e640 1 -- start start 2023-12-22T08:41:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.295+0000 7fd96b59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd96c15b420 0x7fd96c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.295+0000 7fd96b59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd96c071000 0x7fd96c15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.295+0000 7fd96b59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c0cdae0 con 0x7fd96c0a44a0 2023-12-22T08:41:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.295+0000 7fd96b59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c06dec0 con 0x7fd96c15b420 2023-12-22T08:41:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.295+0000 7fd96b59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c15b800 con 0x7fd96c071000 2023-12-22T08:41:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.295+0000 7fd969d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd96c0a44a0 0x7fd96c0708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58652/0 (socket says 172.21.15.38:58652) 2023-12-22T08:41:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.295+0000 7fd969d9b640 1 -- 172.21.15.38:0/1382850282 learned_addr learned my addr 172.21.15.38:0/1382850282 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.295+0000 7fd96a59c640 1 --2- 172.21.15.38:0/1382850282 >> v2:172.21.15.38:3300/0 conn(0x7fd96c15b420 0x7fd96c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.296+0000 7fd96ad9d640 1 --2- 172.21.15.38:0/1382850282 >> v2:172.21.15.89:3300/0 conn(0x7fd96c071000 0x7fd96c15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.296+0000 7fd96959a640 1 -- 172.21.15.38:0/1382850282 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171493738 0 0) 0x7fd96c0cdae0 con 0x7fd96c0a44a0 2023-12-22T08:41:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.296+0000 7fd96959a640 1 -- 172.21.15.38:0/1382850282 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd958003520 con 0x7fd96c0a44a0 2023-12-22T08:41:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.296+0000 7fd96a59c640 1 -- 172.21.15.38:0/1382850282 >> v2:172.21.15.89:3300/0 conn(0x7fd96c071000 msgr2=0x7fd96c15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.296+0000 7fd96a59c640 1 --2- 172.21.15.38:0/1382850282 >> v2:172.21.15.89:3300/0 conn(0x7fd96c071000 0x7fd96c15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.296+0000 7fd96a59c640 1 -- 172.21.15.38:0/1382850282 >> v1:172.21.15.38:6789/0 conn(0x7fd96c0a44a0 legacy=0x7fd96c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.296+0000 7fd96a59c640 1 -- 172.21.15.38:0/1382850282 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c0cdd30 con 0x7fd96c15b420 2023-12-22T08:41:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.297+0000 7fd96a59c640 1 --2- 172.21.15.38:0/1382850282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd96c15b420 0x7fd96c06d980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd96c070670 tx=0x7fd95c02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a273011e4ed3607e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.297+0000 7fd96959a640 1 -- 172.21.15.38:0/1382850282 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c02cc70 con 0x7fd96c15b420 2023-12-22T08:41:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.297+0000 7fd96959a640 1 -- 172.21.15.38:0/1382850282 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c02cdd0 con 0x7fd96c15b420 2023-12-22T08:41:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.298+0000 7fd96959a640 1 -- 172.21.15.38:0/1382850282 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c034660 con 0x7fd96c15b420 2023-12-22T08:41:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.298+0000 7fd96b59e640 1 -- 172.21.15.38:0/1382850282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd96c15b420 msgr2=0x7fd96c06d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.298+0000 7fd96b59e640 1 --2- 172.21.15.38:0/1382850282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd96c15b420 0x7fd96c06d980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd96c070670 tx=0x7fd95c02bec0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.298+0000 7fd96b59e640 1 -- 172.21.15.38:0/1382850282 shutdown_connections 2023-12-22T08:41:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.298+0000 7fd96b59e640 1 --2- 172.21.15.38:0/1382850282 >> v2:172.21.15.89:3300/0 conn(0x7fd96c071000 0x7fd96c15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.298+0000 7fd96b59e640 1 --2- 172.21.15.38:0/1382850282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd96c15b420 0x7fd96c06d980 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.298+0000 7fd96b59e640 1 -- 172.21.15.38:0/1382850282 >> 172.21.15.38:0/1382850282 conn(0x7fd96c0b1f70 msgr2=0x7fd96c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.298+0000 7fd96b59e640 1 -- 172.21.15.38:0/1382850282 shutdown_connections 2023-12-22T08:41:14.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.298+0000 7fd96b59e640 1 -- 172.21.15.38:0/1382850282 wait complete. 2023-12-22T08:41:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.300+0000 7fd96b59e640 1 Processor -- start 2023-12-22T08:41:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.300+0000 7fd96b59e640 1 -- start start 2023-12-22T08:41:14.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.301+0000 7fd96b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd96c071000 0x7fd96c06ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.301+0000 7fd96b59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd96c0a44a0 0x7fd96c152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.301+0000 7fd96b59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd96c15b420 0x7fd96c152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.301+0000 7fd96b59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c09f880 con 0x7fd96c15b420 2023-12-22T08:41:14.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.301+0000 7fd96b59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c06d350 con 0x7fd96c0a44a0 2023-12-22T08:41:14.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.301+0000 7fd96b59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c1f3080 con 0x7fd96c071000 2023-12-22T08:41:14.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.301+0000 7fd96ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd96c15b420 0x7fd96c152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.301+0000 7fd96ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd96c15b420 0x7fd96c152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56126/0 (socket says 172.21.15.38:56126) 2023-12-22T08:41:14.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.301+0000 7fd96ad9d640 1 -- 172.21.15.38:0/1216429256 learned_addr learned my addr 172.21.15.38:0/1216429256 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.302+0000 7fd96a59c640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd96c071000 0x7fd96c06ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.302+0000 7fd96ad9d640 1 -- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd96c071000 msgr2=0x7fd96c06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.302+0000 7fd96ad9d640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd96c071000 0x7fd96c06ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.302+0000 7fd96ad9d640 1 -- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd96c0a44a0 msgr2=0x7fd96c152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.302+0000 7fd969d9b640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd96c0a44a0 0x7fd96c152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.302+0000 7fd96ad9d640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd96c0a44a0 0x7fd96c152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.302+0000 7fd96ad9d640 1 -- 172.21.15.38:0/1216429256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c009a70 con 0x7fd96c15b420 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.302+0000 7fd96ad9d640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd96c15b420 0x7fd96c152690 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd96400e820 tx=0x7fd96400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.302+0000 7fd962ffd640 1 -- 172.21.15.38:0/1216429256 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964009510 con 0x7fd96c15b420 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.302+0000 7fd962ffd640 1 -- 172.21.15.38:0/1216429256 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96400ee70 con 0x7fd96c15b420 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.302+0000 7fd962ffd640 1 -- 172.21.15.38:0/1216429256 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96400cb20 con 0x7fd96c15b420 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.302+0000 7fd96b59e640 1 -- 172.21.15.38:0/1216429256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c09ed00 con 0x7fd96c15b420 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.303+0000 7fd96b59e640 1 -- 172.21.15.38:0/1216429256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c09f2c0 con 0x7fd96c15b420 2023-12-22T08:41:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.304+0000 7fd96b59e640 1 -- 172.21.15.38:0/1216429256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c061910 con 0x7fd96c15b420 2023-12-22T08:41:14.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.305+0000 7fd962ffd640 1 -- 172.21.15.38:0/1216429256 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd96400cc80 con 0x7fd96c15b420 2023-12-22T08:41:14.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.305+0000 7fd962ffd640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd94c06a430 0x7fd94c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.306+0000 7fd962ffd640 1 -- 172.21.15.38:0/1216429256 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd964088940 con 0x7fd96c15b420 2023-12-22T08:41:14.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.306+0000 7fd96a59c640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd94c06a430 0x7fd94c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.307+0000 7fd96a59c640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd94c06a430 0x7fd94c06c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd95c036000 tx=0x7fd95c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.310+0000 7fd962ffd640 1 -- 172.21.15.38:0/1216429256 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd964053f20 con 0x7fd96c15b420 2023-12-22T08:41:14.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.498+0000 7fd96b59e640 1 -- 172.21.15.38:0/1216429256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd96c15e700 con 0x7fd96c15b420 2023-12-22T08:41:14.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.501+0000 7fd962ffd640 1 -- 172.21.15.38:0/1216429256 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16006 (secure 0 0 0) 0x7fd964017090 con 0x7fd96c15b420 2023-12-22T08:41:14.504 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:14.504 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":33,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:41:14.061239+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:12.357679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:13.069596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:14.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.504+0000 7fd96b59e640 1 -- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd94c06a430 msgr2=0x7fd94c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.504+0000 7fd96b59e640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd94c06a430 0x7fd94c06c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd95c036000 tx=0x7fd95c030000 comp rx=0 tx=0).stop 2023-12-22T08:41:14.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.504+0000 7fd96b59e640 1 -- 172.21.15.38:0/1216429256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd96c15b420 msgr2=0x7fd96c152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.504+0000 7fd96b59e640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd96c15b420 0x7fd96c152690 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd96400e820 tx=0x7fd96400ec20 comp rx=0 tx=0).stop 2023-12-22T08:41:14.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.504+0000 7fd96b59e640 1 -- 172.21.15.38:0/1216429256 shutdown_connections 2023-12-22T08:41:14.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.504+0000 7fd96b59e640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd94c06a430 0x7fd94c06c8f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.504+0000 7fd96b59e640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd96c15b420 0x7fd96c152690 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.504+0000 7fd96b59e640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd96c0a44a0 0x7fd96c152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.504+0000 7fd96b59e640 1 --2- 172.21.15.38:0/1216429256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd96c071000 0x7fd96c06ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.504+0000 7fd96b59e640 1 -- 172.21.15.38:0/1216429256 >> 172.21.15.38:0/1216429256 conn(0x7fd96c0b1f70 msgr2=0x7fd96c15c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:14.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.504+0000 7fd96b59e640 1 -- 172.21.15.38:0/1216429256 shutdown_connections 2023-12-22T08:41:14.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.504+0000 7fd96b59e640 1 -- 172.21.15.38:0/1216429256 wait complete. 2023-12-22T08:41:14.523 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:14.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.739+0000 7f227ca65640 1 Processor -- start 2023-12-22T08:41:14.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.739+0000 7f227ca65640 1 -- start start 2023-12-22T08:41:14.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.740+0000 7f227ca65640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22780a44a0 0x7f22780708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.740+0000 7f227ca65640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2278070e30 0x7f227815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.741+0000 7f227ca65640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22780cdae0 con 0x7f227815b420 2023-12-22T08:41:14.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.741+0000 7f227ca65640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2278071260 con 0x7f2278070e30 2023-12-22T08:41:14.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.741+0000 7f227ca65640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227815b800 con 0x7f22780a44a0 2023-12-22T08:41:14.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.741+0000 7f22777fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f227815b420 0x7f227806d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58662/0 (socket says 172.21.15.38:58662) 2023-12-22T08:41:14.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.741+0000 7f22777fe640 1 -- 172.21.15.38:0/760112790 learned_addr learned my addr 172.21.15.38:0/760112790 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:14.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.741+0000 7f2277fff640 1 --2- 172.21.15.38:0/760112790 >> v2:172.21.15.38:3300/0 conn(0x7f2278070e30 0x7f227815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.741+0000 7f226effd640 1 --2- 172.21.15.38:0/760112790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22780a44a0 0x7f22780708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.741+0000 7f2276ffd640 1 -- 172.21.15.38:0/760112790 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825384699 0 0) 0x7f22780cdae0 con 0x7f227815b420 2023-12-22T08:41:14.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.741+0000 7f2276ffd640 1 -- 172.21.15.38:0/760112790 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2264003520 con 0x7f227815b420 2023-12-22T08:41:14.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.742+0000 7f2277fff640 1 -- 172.21.15.38:0/760112790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22780a44a0 msgr2=0x7f22780708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:14.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.742+0000 7f2277fff640 1 --2- 172.21.15.38:0/760112790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22780a44a0 0x7f22780708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.742+0000 7f2277fff640 1 -- 172.21.15.38:0/760112790 >> v1:172.21.15.38:6789/0 conn(0x7f227815b420 legacy=0x7f227806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.742+0000 7f2277fff640 1 -- 172.21.15.38:0/760112790 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780cdd30 con 0x7f2278070e30 2023-12-22T08:41:14.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.742+0000 7f226effd640 1 --2- 172.21.15.38:0/760112790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22780a44a0 0x7f22780708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:14.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.743+0000 7f2277fff640 1 --2- 172.21.15.38:0/760112790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2278070e30 0x7f227815baa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2270009d90 tx=0x7f227002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c46095a4309cb61 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.743+0000 7f2276ffd640 1 -- 172.21.15.38:0/760112790 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227002cc60 con 0x7f2278070e30 2023-12-22T08:41:14.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.743+0000 7f2276ffd640 1 -- 172.21.15.38:0/760112790 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227002cdc0 con 0x7f2278070e30 2023-12-22T08:41:14.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.743+0000 7f2276ffd640 1 -- 172.21.15.38:0/760112790 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270034660 con 0x7f2278070e30 2023-12-22T08:41:14.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.743+0000 7f227ca65640 1 -- 172.21.15.38:0/760112790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2278070e30 msgr2=0x7f227815baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.743+0000 7f227ca65640 1 --2- 172.21.15.38:0/760112790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2278070e30 0x7f227815baa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2270009d90 tx=0x7f227002beb0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.744+0000 7f227ca65640 1 -- 172.21.15.38:0/760112790 shutdown_connections 2023-12-22T08:41:14.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.744+0000 7f227ca65640 1 --2- 172.21.15.38:0/760112790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2278070e30 0x7f227815baa0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.744+0000 7f227ca65640 1 --2- 172.21.15.38:0/760112790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22780a44a0 0x7f22780708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.744+0000 7f227ca65640 1 -- 172.21.15.38:0/760112790 >> 172.21.15.38:0/760112790 conn(0x7f22780b1f70 msgr2=0x7f22780b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:14.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.744+0000 7f227ca65640 1 -- 172.21.15.38:0/760112790 shutdown_connections 2023-12-22T08:41:14.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.744+0000 7f227ca65640 1 -- 172.21.15.38:0/760112790 wait complete. 2023-12-22T08:41:14.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.746+0000 7f227ca65640 1 Processor -- start 2023-12-22T08:41:14.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.746+0000 7f227ca65640 1 -- start start 2023-12-22T08:41:14.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f227ca65640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2278070e30 0x7f2278159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f227ca65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22780a44a0 0x7f22780a2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f227ca65640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227815b420 0x7f22780a2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f227ca65640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2278159940 con 0x7f227815b420 2023-12-22T08:41:14.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f227ca65640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22780a1080 con 0x7f22780a44a0 2023-12-22T08:41:14.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f227ca65640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22780a1360 con 0x7f2278070e30 2023-12-22T08:41:14.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f2277fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227815b420 0x7f22780a2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f2277fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227815b420 0x7f22780a2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56144/0 (socket says 172.21.15.38:56144) 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f2277fff640 1 -- 172.21.15.38:0/1700952506 learned_addr learned my addr 172.21.15.38:0/1700952506 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f22777fe640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2278070e30 0x7f2278159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f226effd640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22780a44a0 0x7f22780a2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f2277fff640 1 -- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2278070e30 msgr2=0x7f2278159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f2277fff640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2278070e30 0x7f2278159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f2277fff640 1 -- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22780a44a0 msgr2=0x7f22780a2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f2277fff640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22780a44a0 0x7f22780a2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.747+0000 7f2277fff640 1 -- 172.21.15.38:0/1700952506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2270009a70 con 0x7f227815b420 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.748+0000 7f2277fff640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227815b420 0x7f22780a2660 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2270009d90 tx=0x7f2270004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.748+0000 7f2274ff9640 1 -- 172.21.15.38:0/1700952506 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270040650 con 0x7f227815b420 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.748+0000 7f2274ff9640 1 -- 172.21.15.38:0/1700952506 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22700407b0 con 0x7f227815b420 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.748+0000 7f2274ff9640 1 -- 172.21.15.38:0/1700952506 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270040b60 con 0x7f227815b420 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.748+0000 7f227ca65640 1 -- 172.21.15.38:0/1700952506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22780a1640 con 0x7f227815b420 2023-12-22T08:41:14.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.748+0000 7f227ca65640 1 -- 172.21.15.38:0/1700952506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22780a1c00 con 0x7f227815b420 2023-12-22T08:41:14.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.749+0000 7f227ca65640 1 -- 172.21.15.38:0/1700952506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2278061910 con 0x7f227815b420 2023-12-22T08:41:14.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.750+0000 7f2274ff9640 1 -- 172.21.15.38:0/1700952506 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2270040cc0 con 0x7f227815b420 2023-12-22T08:41:14.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.751+0000 7f2274ff9640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f225806a430 0x7f225806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.751+0000 7f2274ff9640 1 -- 172.21.15.38:0/1700952506 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22700ab680 con 0x7f227815b420 2023-12-22T08:41:14.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.752+0000 7f22777fe640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f225806a430 0x7f225806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.753+0000 7f22777fe640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f225806a430 0x7f225806c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f22680011e0 tx=0x7f2268009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.755+0000 7f2274ff9640 1 -- 172.21.15.38:0/1700952506 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2270076d00 con 0x7f227815b420 2023-12-22T08:41:14.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.949+0000 7f227ca65640 1 -- 172.21.15.38:0/1700952506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22780cb5c0 con 0x7f227815b420 2023-12-22T08:41:14.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.951+0000 7f2274ff9640 1 -- 172.21.15.38:0/1700952506 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16006 (secure 0 0 0) 0x7f2270009450 con 0x7f227815b420 2023-12-22T08:41:14.953 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:14.954 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":33,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:41:14.061239+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:12.357679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:13.069596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:14.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.953+0000 7f227ca65640 1 -- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f225806a430 msgr2=0x7f225806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.953+0000 7f227ca65640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f225806a430 0x7f225806c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f22680011e0 tx=0x7f2268009040 comp rx=0 tx=0).stop 2023-12-22T08:41:14.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.953+0000 7f227ca65640 1 -- 172.21.15.38:0/1700952506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227815b420 msgr2=0x7f22780a2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.953+0000 7f227ca65640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227815b420 0x7f22780a2660 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2270009d90 tx=0x7f2270004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:14.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.954+0000 7f227ca65640 1 -- 172.21.15.38:0/1700952506 shutdown_connections 2023-12-22T08:41:14.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.954+0000 7f227ca65640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f225806a430 0x7f225806c8f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.954+0000 7f227ca65640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227815b420 0x7f22780a2660 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.954+0000 7f227ca65640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22780a44a0 0x7f22780a2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.954+0000 7f227ca65640 1 --2- 172.21.15.38:0/1700952506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2278070e30 0x7f2278159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.954+0000 7f227ca65640 1 -- 172.21.15.38:0/1700952506 >> 172.21.15.38:0/1700952506 conn(0x7f22780b1f70 msgr2=0x7f227815db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:14.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.954+0000 7f227ca65640 1 -- 172.21.15.38:0/1700952506 shutdown_connections 2023-12-22T08:41:14.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:14.954+0000 7f227ca65640 1 -- 172.21.15.38:0/1700952506 wait complete. 2023-12-22T08:41:14.977 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T08:41:15.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.182+0000 7fd06759e640 1 Processor -- start 2023-12-22T08:41:15.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.183+0000 7fd06759e640 1 -- start start 2023-12-22T08:41:15.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.184+0000 7fd06759e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd068071d80 0x7fd0680a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.184+0000 7fd06759e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd0680a35a0 0x7fd068161040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.184+0000 7fd06759e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06806c2a0 con 0x7fd068161580 2023-12-22T08:41:15.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.184+0000 7fd06759e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0680a44a0 con 0x7fd068071d80 2023-12-22T08:41:15.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.184+0000 7fd06759e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0680a3a00 con 0x7fd0680a35a0 2023-12-22T08:41:15.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.185+0000 7fd06659c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd068071d80 0x7fd0680a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.185+0000 7fd066d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd068161580 0x7fd06815da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58668/0 (socket says 172.21.15.38:58668) 2023-12-22T08:41:15.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.185+0000 7fd066d9d640 1 -- 172.21.15.38:0/1599071337 learned_addr learned my addr 172.21.15.38:0/1599071337 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:15.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.185+0000 7fd065d9b640 1 --2- 172.21.15.38:0/1599071337 >> v2:172.21.15.89:3300/0 conn(0x7fd0680a35a0 0x7fd068161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.185+0000 7fd06659c640 1 -- 172.21.15.38:0/1599071337 >> v2:172.21.15.89:3300/0 conn(0x7fd0680a35a0 msgr2=0x7fd068161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:15.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.185+0000 7fd06659c640 1 --2- 172.21.15.38:0/1599071337 >> v2:172.21.15.89:3300/0 conn(0x7fd0680a35a0 0x7fd068161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.185+0000 7fd06659c640 1 -- 172.21.15.38:0/1599071337 >> v1:172.21.15.38:6789/0 conn(0x7fd068161580 legacy=0x7fd06815da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.185+0000 7fd06659c640 1 -- 172.21.15.38:0/1599071337 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd068072160 con 0x7fd068071d80 2023-12-22T08:41:15.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.185+0000 7fd06559a640 1 -- 172.21.15.38:0/1599071337 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985891048 0 0) 0x7fd06806c2a0 con 0x7fd068161580 2023-12-22T08:41:15.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.186+0000 7fd06659c640 1 --2- 172.21.15.38:0/1599071337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068071d80 0x7fd0680a3060 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd0680aeb50 tx=0x7fd05802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba29a0d31d5783c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:15.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.187+0000 7fd06559a640 1 -- 172.21.15.38:0/1599071337 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05802cc80 con 0x7fd068071d80 2023-12-22T08:41:15.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.187+0000 7fd06559a640 1 -- 172.21.15.38:0/1599071337 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05802cde0 con 0x7fd068071d80 2023-12-22T08:41:15.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.187+0000 7fd06559a640 1 -- 172.21.15.38:0/1599071337 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058034660 con 0x7fd068071d80 2023-12-22T08:41:15.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.187+0000 7fd06759e640 1 -- 172.21.15.38:0/1599071337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068071d80 msgr2=0x7fd0680a3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.187+0000 7fd06759e640 1 --2- 172.21.15.38:0/1599071337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068071d80 0x7fd0680a3060 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd0680aeb50 tx=0x7fd05802bed0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.187+0000 7fd06759e640 1 -- 172.21.15.38:0/1599071337 shutdown_connections 2023-12-22T08:41:15.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.187+0000 7fd06759e640 1 --2- 172.21.15.38:0/1599071337 >> v2:172.21.15.89:3300/0 conn(0x7fd0680a35a0 0x7fd068161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.187+0000 7fd06759e640 1 --2- 172.21.15.38:0/1599071337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068071d80 0x7fd0680a3060 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.187+0000 7fd06759e640 1 -- 172.21.15.38:0/1599071337 >> 172.21.15.38:0/1599071337 conn(0x7fd0680cf000 msgr2=0x7fd0680cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:15.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.187+0000 7fd06759e640 1 -- 172.21.15.38:0/1599071337 shutdown_connections 2023-12-22T08:41:15.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.187+0000 7fd06759e640 1 -- 172.21.15.38:0/1599071337 wait complete. 2023-12-22T08:41:15.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.189+0000 7fd06759e640 1 Processor -- start 2023-12-22T08:41:15.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.189+0000 7fd06759e640 1 -- start start 2023-12-22T08:41:15.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.190+0000 7fd06759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd068071d80 0x7fd0680cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.190+0000 7fd06759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0680a35a0 0x7fd0680afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.190+0000 7fd06759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068161580 0x7fd0680b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.190+0000 7fd06759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06809a660 con 0x7fd068161580 2023-12-22T08:41:15.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.190+0000 7fd06759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd068099a70 con 0x7fd0680a35a0 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.190+0000 7fd06759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd068099cc0 con 0x7fd068071d80 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.190+0000 7fd066d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068161580 0x7fd0680b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.190+0000 7fd066d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068161580 0x7fd0680b0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56160/0 (socket says 172.21.15.38:56160) 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.190+0000 7fd066d9d640 1 -- 172.21.15.38:0/1159451314 learned_addr learned my addr 172.21.15.38:0/1159451314 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.191+0000 7fd065d9b640 1 --2- 172.21.15.38:0/1159451314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0680a35a0 0x7fd0680afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.191+0000 7fd066d9d640 1 -- 172.21.15.38:0/1159451314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd068071d80 msgr2=0x7fd0680cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.191+0000 7fd066d9d640 1 --2- 172.21.15.38:0/1159451314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd068071d80 0x7fd0680cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.191+0000 7fd066d9d640 1 -- 172.21.15.38:0/1159451314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0680a35a0 msgr2=0x7fd0680afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.191+0000 7fd066d9d640 1 --2- 172.21.15.38:0/1159451314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0680a35a0 0x7fd0680afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.191+0000 7fd066d9d640 1 -- 172.21.15.38:0/1159451314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058009a70 con 0x7fd068161580 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.191+0000 7fd066d9d640 1 --2- 172.21.15.38:0/1159451314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068161580 0x7fd0680b0270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd060001eb0 tx=0x7fd06000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.191+0000 7fd056ffd640 1 -- 172.21.15.38:0/1159451314 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0600074e0 con 0x7fd068161580 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.191+0000 7fd056ffd640 1 -- 172.21.15.38:0/1159451314 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd060007640 con 0x7fd068161580 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.192+0000 7fd056ffd640 1 -- 172.21.15.38:0/1159451314 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060004a00 con 0x7fd068161580 2023-12-22T08:41:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.192+0000 7fd06759e640 1 -- 172.21.15.38:0/1159451314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd068099fa0 con 0x7fd068161580 2023-12-22T08:41:15.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.192+0000 7fd06759e640 1 -- 172.21.15.38:0/1159451314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0681506f0 con 0x7fd068161580 2023-12-22T08:41:15.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.193+0000 7fd06759e640 1 -- 172.21.15.38:0/1159451314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd068061910 con 0x7fd068161580 2023-12-22T08:41:15.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.194+0000 7fd056ffd640 1 -- 172.21.15.38:0/1159451314 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd060004b60 con 0x7fd068161580 2023-12-22T08:41:15.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.195+0000 7fd056ffd640 1 --2- 172.21.15.38:0/1159451314 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd04806a460 0x7fd04806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.195+0000 7fd056ffd640 1 -- 172.21.15.38:0/1159451314 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd060088790 con 0x7fd068161580 2023-12-22T08:41:15.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.195+0000 7fd06659c640 1 --2- 172.21.15.38:0/1159451314 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd04806a460 0x7fd04806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.196+0000 7fd06659c640 1 --2- 172.21.15.38:0/1159451314 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd04806a460 0x7fd04806c920 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd058036000 tx=0x7fd05802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:15.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.199+0000 7fd056ffd640 1 -- 172.21.15.38:0/1159451314 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd060053ce0 con 0x7fd068161580 2023-12-22T08:41:15.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:15.426+0000 7fd06759e640 1 -- 172.21.15.38:0/1159451314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd06809a7a0 con 0x7fd068161580 2023-12-22T08:41:16.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.084+0000 7fd056ffd640 1 -- 172.21.15.38:0/1159451314 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd06809a7a0 con 0x7fd068161580 2023-12-22T08:41:16.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.087+0000 7fd06759e640 1 -- 172.21.15.38:0/1159451314 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd04806a460 msgr2=0x7fd04806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.087+0000 7fd06759e640 1 --2- 172.21.15.38:0/1159451314 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd04806a460 0x7fd04806c920 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd058036000 tx=0x7fd05802e000 comp rx=0 tx=0).stop 2023-12-22T08:41:16.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.087+0000 7fd06759e640 1 -- 172.21.15.38:0/1159451314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068161580 msgr2=0x7fd0680b0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.087+0000 7fd06759e640 1 --2- 172.21.15.38:0/1159451314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068161580 0x7fd0680b0270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd060001eb0 tx=0x7fd06000c870 comp rx=0 tx=0).stop 2023-12-22T08:41:16.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.088+0000 7fd06759e640 1 -- 172.21.15.38:0/1159451314 shutdown_connections 2023-12-22T08:41:16.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.088+0000 7fd06759e640 1 --2- 172.21.15.38:0/1159451314 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd04806a460 0x7fd04806c920 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.088+0000 7fd06759e640 1 --2- 172.21.15.38:0/1159451314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd068161580 0x7fd0680b0270 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.088+0000 7fd06759e640 1 --2- 172.21.15.38:0/1159451314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0680a35a0 0x7fd0680afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.088+0000 7fd06759e640 1 --2- 172.21.15.38:0/1159451314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd068071d80 0x7fd0680cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.088+0000 7fd06759e640 1 -- 172.21.15.38:0/1159451314 >> 172.21.15.38:0/1159451314 conn(0x7fd0680cf000 msgr2=0x7fd068153540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:16.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.088+0000 7fd06759e640 1 -- 172.21.15.38:0/1159451314 shutdown_connections 2023-12-22T08:41:16.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.088+0000 7fd06759e640 1 -- 172.21.15.38:0/1159451314 wait complete. 2023-12-22T08:41:16.112 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T08:41:16.112 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T08:41:16.170 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:41:16.179 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:41:16.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.336+0000 7fd0b2748640 1 Processor -- start 2023-12-22T08:41:16.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.336+0000 7fd0b2748640 1 -- start start 2023-12-22T08:41:16.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.338+0000 7fd0b2748640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0ac0b3f90 0x7fd0ac15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.338+0000 7fd0b2748640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac15eb20 con 0x7fd0ac06ca50 2023-12-22T08:41:16.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.338+0000 7fd0b2748640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac070770 con 0x7fd0ac15e740 2023-12-22T08:41:16.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.338+0000 7fd0b2748640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac06e650 con 0x7fd0ac0b3f90 2023-12-22T08:41:16.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.338+0000 7fd0b0ce5640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd0ac06ca50 0x7fd0ac070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58672/0 (socket says 172.21.15.38:58672) 2023-12-22T08:41:16.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.338+0000 7fd0b0ce5640 1 -- 172.21.15.38:0/2518407253 learned_addr learned my addr 172.21.15.38:0/2518407253 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:16.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.339+0000 7fd0ab7fe640 1 --2- 172.21.15.38:0/2518407253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0ac0b3f90 0x7fd0ac15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.339+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319196262 0 0) 0x7fd0ac15eb20 con 0x7fd0ac06ca50 2023-12-22T08:41:16.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.339+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd094003520 con 0x7fd0ac06ca50 2023-12-22T08:41:16.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.339+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2344514858 0 0) 0x7fd094003520 con 0x7fd0ac06ca50 2023-12-22T08:41:16.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.339+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0ac0b3f90 msgr2=0x7fd0ac15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:16.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.339+0000 7fd0aaffd640 1 --2- 172.21.15.38:0/2518407253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0ac0b3f90 0x7fd0ac15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.339+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 >> v1:172.21.15.89:6789/0 conn(0x7fd0ac15e740 legacy=0x7fd0ac0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.339+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac06cec0 con 0x7fd0ac06ca50 2023-12-22T08:41:16.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.339+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fd0a40019f0 con 0x7fd0ac06ca50 2023-12-22T08:41:16.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.339+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 >> v1:172.21.15.38:6789/0 conn(0x7fd0ac06ca50 legacy=0x7fd0ac070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.339+0000 7fd0aaffd640 1 --2- 172.21.15.38:0/2518407253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0940039a0 0x7fd094003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.339+0000 7fd0aaffd640 1 --2- 172.21.15.38:0/2518407253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0940047c0 0x7fd094004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.339+0000 7fd0aaffd640 1 --2- 172.21.15.38:0/2518407253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0ac0b3f90 0x7fd094005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.340+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac06e650 con 0x7fd0940047c0 2023-12-22T08:41:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.340+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09400bb40 con 0x7fd0940039a0 2023-12-22T08:41:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.340+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09400bd00 con 0x7fd0ac0b3f90 2023-12-22T08:41:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.340+0000 7fd0ab7fe640 1 --2- 172.21.15.38:0/2518407253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0940047c0 0x7fd094004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.340+0000 7fd0abfff640 1 --2- 172.21.15.38:0/2518407253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0940039a0 0x7fd094003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.340+0000 7fd0ab7fe640 1 -- 172.21.15.38:0/2518407253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0ac0b3f90 msgr2=0x7fd094005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.340+0000 7fd0ab7fe640 1 --2- 172.21.15.38:0/2518407253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0ac0b3f90 0x7fd094005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.340+0000 7fd0ab7fe640 1 -- 172.21.15.38:0/2518407253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0940039a0 msgr2=0x7fd094003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.340+0000 7fd0ab7fe640 1 --2- 172.21.15.38:0/2518407253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0940039a0 0x7fd094003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.340+0000 7fd0ab7fe640 1 -- 172.21.15.38:0/2518407253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094003520 con 0x7fd0940047c0 2023-12-22T08:41:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.341+0000 7fd0ab7fe640 1 --2- 172.21.15.38:0/2518407253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0940047c0 0x7fd094004c40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009ac0 tx=0x7fd0940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858d810083ece02e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.341+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a002c710 con 0x7fd0940047c0 2023-12-22T08:41:16.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.341+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a002c870 con 0x7fd0940047c0 2023-12-22T08:41:16.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.342+0000 7fd0aaffd640 1 -- 172.21.15.38:0/2518407253 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a002cc00 con 0x7fd0940047c0 2023-12-22T08:41:16.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.342+0000 7fd0b2748640 1 -- 172.21.15.38:0/2518407253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0940047c0 msgr2=0x7fd094004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.342+0000 7fd0b2748640 1 --2- 172.21.15.38:0/2518407253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0940047c0 0x7fd094004c40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009ac0 tx=0x7fd0940057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.342+0000 7fd0b0ce5640 1 -- 172.21.15.38:0/2518407253 reap_dead start 2023-12-22T08:41:16.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.342+0000 7fd0b2748640 1 -- 172.21.15.38:0/2518407253 shutdown_connections 2023-12-22T08:41:16.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.342+0000 7fd0b2748640 1 -- 172.21.15.38:0/2518407253 >> 172.21.15.38:0/2518407253 conn(0x7fd0ac0cfea0 msgr2=0x7fd0ac0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:16.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.342+0000 7fd0b2748640 1 -- 172.21.15.38:0/2518407253 shutdown_connections 2023-12-22T08:41:16.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.342+0000 7fd0b2748640 1 -- 172.21.15.38:0/2518407253 wait complete. 2023-12-22T08:41:16.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.344+0000 7fd0b2748640 1 Processor -- start 2023-12-22T08:41:16.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.344+0000 7fd0b2748640 1 -- start start 2023-12-22T08:41:16.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.345+0000 7fd0b2748640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0940047c0 0x7fd0ac161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.345+0000 7fd0b2748640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0b0f20 0x7fd0ac148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.345+0000 7fd0b2748640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0ac1488a0 0x7fd0ac0aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.345+0000 7fd0b2748640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac148d30 con 0x7fd0940047c0 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.345+0000 7fd0b2748640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac14b060 con 0x7fd0ac0b0f20 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.345+0000 7fd0b2748640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac14b340 con 0x7fd0ac1488a0 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.345+0000 7fd0abfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0940047c0 0x7fd0ac161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.345+0000 7fd0abfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0940047c0 0x7fd0ac161190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56190/0 (socket says 172.21.15.38:56190) 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.346+0000 7fd0abfff640 1 -- 172.21.15.38:0/1190903377 learned_addr learned my addr 172.21.15.38:0/1190903377 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.346+0000 7fd0abfff640 1 -- 172.21.15.38:0/1190903377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0ac1488a0 msgr2=0x7fd0ac0aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.346+0000 7fd0abfff640 1 --2- 172.21.15.38:0/1190903377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0ac1488a0 0x7fd0ac0aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.346+0000 7fd0abfff640 1 -- 172.21.15.38:0/1190903377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0b0f20 msgr2=0x7fd0ac148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.346+0000 7fd0abfff640 1 --2- 172.21.15.38:0/1190903377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0b0f20 0x7fd0ac148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.346+0000 7fd0abfff640 1 -- 172.21.15.38:0/1190903377 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac14b620 con 0x7fd0940047c0 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.346+0000 7fd0abfff640 1 --2- 172.21.15.38:0/1190903377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0940047c0 0x7fd0ac161190 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00d570 tx=0x7fd09c00da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:16.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.346+0000 7fd0a8ff9640 1 -- 172.21.15.38:0/1190903377 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c005480 con 0x7fd0940047c0 2023-12-22T08:41:16.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.347+0000 7fd0a8ff9640 1 -- 172.21.15.38:0/1190903377 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c003610 con 0x7fd0940047c0 2023-12-22T08:41:16.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.347+0000 7fd0a8ff9640 1 -- 172.21.15.38:0/1190903377 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c003980 con 0x7fd0940047c0 2023-12-22T08:41:16.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.347+0000 7fd0b2748640 1 -- 172.21.15.38:0/1190903377 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ac14b900 con 0x7fd0940047c0 2023-12-22T08:41:16.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.347+0000 7fd0b2748640 1 -- 172.21.15.38:0/1190903377 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac1616d0 con 0x7fd0940047c0 2023-12-22T08:41:16.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.348+0000 7fd0b2748640 1 -- 172.21.15.38:0/1190903377 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ac161860 con 0x7fd0940047c0 2023-12-22T08:41:16.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.349+0000 7fd0a8ff9640 1 -- 172.21.15.38:0/1190903377 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd09c003ae0 con 0x7fd0940047c0 2023-12-22T08:41:16.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.350+0000 7fd0a8ff9640 1 --2- 172.21.15.38:0/1190903377 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd09806a430 0x7fd09806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.350+0000 7fd0a8ff9640 1 -- 172.21.15.38:0/1190903377 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd09c088850 con 0x7fd0940047c0 2023-12-22T08:41:16.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.351+0000 7fd0ab7fe640 1 --2- 172.21.15.38:0/1190903377 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd09806a430 0x7fd09806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.352+0000 7fd0ab7fe640 1 --2- 172.21.15.38:0/1190903377 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd09806a430 0x7fd09806c8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0036000 tx=0x7fd0a002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:16.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.355+0000 7fd0a8ff9640 1 -- 172.21.15.38:0/1190903377 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd09c053e30 con 0x7fd0940047c0 2023-12-22T08:41:16.513 INFO:tasks.ceph.mds.a.smithi038.stderr:2023-12-22T08:41:16.510+0000 7f6088755640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:41:16.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:16.588+0000 7fd0b2748640 1 -- 172.21.15.38:0/1190903377 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd0ac061910 con 0x7fd0940047c0 2023-12-22T08:41:17.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.110+0000 7fd0a8ff9640 1 -- 172.21.15.38:0/1190903377 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd09c001230 con 0x7fd0940047c0 2023-12-22T08:41:17.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.113+0000 7fd0b2748640 1 -- 172.21.15.38:0/1190903377 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd09806a430 msgr2=0x7fd09806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.113+0000 7fd0b2748640 1 --2- 172.21.15.38:0/1190903377 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd09806a430 0x7fd09806c8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0036000 tx=0x7fd0a002e000 comp rx=0 tx=0).stop 2023-12-22T08:41:17.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.113+0000 7fd0b2748640 1 -- 172.21.15.38:0/1190903377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0940047c0 msgr2=0x7fd0ac161190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.113+0000 7fd0b2748640 1 --2- 172.21.15.38:0/1190903377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0940047c0 0x7fd0ac161190 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00d570 tx=0x7fd09c00da30 comp rx=0 tx=0).stop 2023-12-22T08:41:17.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.114+0000 7fd0b2748640 1 -- 172.21.15.38:0/1190903377 shutdown_connections 2023-12-22T08:41:17.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.114+0000 7fd0b2748640 1 --2- 172.21.15.38:0/1190903377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0ac1488a0 0x7fd0ac0aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.114+0000 7fd0b2748640 1 --2- 172.21.15.38:0/1190903377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0b0f20 0x7fd0ac148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.114+0000 7fd0b2748640 1 --2- 172.21.15.38:0/1190903377 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd09806a430 0x7fd09806c8f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.114+0000 7fd0b2748640 1 --2- 172.21.15.38:0/1190903377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0940047c0 0x7fd0ac161190 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.114+0000 7fd0b2748640 1 -- 172.21.15.38:0/1190903377 >> 172.21.15.38:0/1190903377 conn(0x7fd0ac0cfea0 msgr2=0x7fd0ac0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:17.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.114+0000 7fd0b2748640 1 -- 172.21.15.38:0/1190903377 shutdown_connections 2023-12-22T08:41:17.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.114+0000 7fd0b2748640 1 -- 172.21.15.38:0/1190903377 wait complete. 2023-12-22T08:41:17.138 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T08:41:17.138 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:17.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.406+0000 7fdead3ae640 1 Processor -- start 2023-12-22T08:41:17.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.406+0000 7fdead3ae640 1 -- start start 2023-12-22T08:41:17.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.408+0000 7fdead3ae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea8161720 0x7fdea80adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.408+0000 7fdead3ae640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdea80ae1e0 0x7fdea806f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.408+0000 7fdead3ae640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea80ce950 con 0x7fdea8161340 2023-12-22T08:41:17.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.408+0000 7fdead3ae640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea8072170 con 0x7fdea80ae1e0 2023-12-22T08:41:17.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.408+0000 7fdead3ae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea80cdd40 con 0x7fdea8161720 2023-12-22T08:41:17.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.408+0000 7fdea7fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdea8161340 0x7fdea8071a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58680/0 (socket says 172.21.15.38:58680) 2023-12-22T08:41:17.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.408+0000 7fdea7fff640 1 -- 172.21.15.38:0/213625281 learned_addr learned my addr 172.21.15.38:0/213625281 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:17.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.408+0000 7fdeacbad640 1 --2- 172.21.15.38:0/213625281 >> v2:172.21.15.38:3300/0 conn(0x7fdea80ae1e0 0x7fdea806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.408+0000 7fdea77fe640 1 --2- 172.21.15.38:0/213625281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea8161720 0x7fdea80adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.409+0000 7fdea6ffd640 1 -- 172.21.15.38:0/213625281 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041800481 0 0) 0x7fdea80ce950 con 0x7fdea8161340 2023-12-22T08:41:17.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.409+0000 7fdea6ffd640 1 -- 172.21.15.38:0/213625281 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde90003520 con 0x7fdea8161340 2023-12-22T08:41:17.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.409+0000 7fdeacbad640 1 -- 172.21.15.38:0/213625281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea8161720 msgr2=0x7fdea80adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:17.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.409+0000 7fdeacbad640 1 --2- 172.21.15.38:0/213625281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea8161720 0x7fdea80adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.409+0000 7fdeacbad640 1 -- 172.21.15.38:0/213625281 >> v1:172.21.15.38:6789/0 conn(0x7fdea8161340 legacy=0x7fdea8071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.409+0000 7fdeacbad640 1 -- 172.21.15.38:0/213625281 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea80ce020 con 0x7fdea80ae1e0 2023-12-22T08:41:17.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.411+0000 7fdeacbad640 1 --2- 172.21.15.38:0/213625281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea80ae1e0 0x7fdea806f250 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009dc0 tx=0x7fdea002be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8063fa2645ea1039 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:17.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.411+0000 7fdea6ffd640 1 -- 172.21.15.38:0/213625281 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea002cbb0 con 0x7fdea80ae1e0 2023-12-22T08:41:17.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.411+0000 7fdea6ffd640 1 -- 172.21.15.38:0/213625281 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea002cd10 con 0x7fdea80ae1e0 2023-12-22T08:41:17.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.411+0000 7fdea6ffd640 1 -- 172.21.15.38:0/213625281 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0034640 con 0x7fdea80ae1e0 2023-12-22T08:41:17.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.412+0000 7fdead3ae640 1 -- 172.21.15.38:0/213625281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea80ae1e0 msgr2=0x7fdea806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.412+0000 7fdead3ae640 1 --2- 172.21.15.38:0/213625281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea80ae1e0 0x7fdea806f250 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009dc0 tx=0x7fdea002be00 comp rx=0 tx=0).stop 2023-12-22T08:41:17.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.412+0000 7fdead3ae640 1 -- 172.21.15.38:0/213625281 shutdown_connections 2023-12-22T08:41:17.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.412+0000 7fdead3ae640 1 --2- 172.21.15.38:0/213625281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea80ae1e0 0x7fdea806f250 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.412+0000 7fdead3ae640 1 --2- 172.21.15.38:0/213625281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea8161720 0x7fdea80adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.412+0000 7fdead3ae640 1 -- 172.21.15.38:0/213625281 >> 172.21.15.38:0/213625281 conn(0x7fdea80b1f70 msgr2=0x7fdea80b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:17.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.412+0000 7fdead3ae640 1 -- 172.21.15.38:0/213625281 shutdown_connections 2023-12-22T08:41:17.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.412+0000 7fdead3ae640 1 -- 172.21.15.38:0/213625281 wait complete. 2023-12-22T08:41:17.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.414+0000 7fdead3ae640 1 Processor -- start 2023-12-22T08:41:17.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.414+0000 7fdead3ae640 1 -- start start 2023-12-22T08:41:17.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.415+0000 7fdead3ae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdea80ae1e0 0x7fdea81f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.415+0000 7fdead3ae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea8161340 0x7fdea8160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.415+0000 7fdead3ae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea8161720 0x7fdea80aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.415+0000 7fdead3ae640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea81f36a0 con 0x7fdea8161340 2023-12-22T08:41:17.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.415+0000 7fdead3ae640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8157970 con 0x7fdea80ae1e0 2023-12-22T08:41:17.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.415+0000 7fdead3ae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8157f30 con 0x7fdea8161720 2023-12-22T08:41:17.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.415+0000 7fdea77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea8161340 0x7fdea8160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.415+0000 7fdea77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea8161340 0x7fdea8160400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56206/0 (socket says 172.21.15.38:56206) 2023-12-22T08:41:17.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.415+0000 7fdea77fe640 1 -- 172.21.15.38:0/1075852588 learned_addr learned my addr 172.21.15.38:0/1075852588 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:17.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.415+0000 7fdea7fff640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdea80ae1e0 0x7fdea81f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.415+0000 7fdea77fe640 1 -- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea8161720 msgr2=0x7fdea80aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.415+0000 7fdea77fe640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea8161720 0x7fdea80aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.415+0000 7fdea77fe640 1 -- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdea80ae1e0 msgr2=0x7fdea81f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.416+0000 7fdea77fe640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdea80ae1e0 0x7fdea81f3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.416+0000 7fdea77fe640 1 -- 172.21.15.38:0/1075852588 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea0009a70 con 0x7fdea8161340 2023-12-22T08:41:17.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.416+0000 7fdea7fff640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdea80ae1e0 0x7fdea81f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:17.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.416+0000 7fdea77fe640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea8161340 0x7fdea8160400 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00e840 tx=0x7fde9c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:17.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.416+0000 7fdea4ff9640 1 -- 172.21.15.38:0/1075852588 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0094f0 con 0x7fdea8161340 2023-12-22T08:41:17.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.416+0000 7fdea4ff9640 1 -- 172.21.15.38:0/1075852588 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c00c940 con 0x7fdea8161340 2023-12-22T08:41:17.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.416+0000 7fdea4ff9640 1 -- 172.21.15.38:0/1075852588 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00ccd0 con 0x7fdea8161340 2023-12-22T08:41:17.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.416+0000 7fdead3ae640 1 -- 172.21.15.38:0/1075852588 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea8099de0 con 0x7fdea8161340 2023-12-22T08:41:17.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.416+0000 7fdead3ae640 1 -- 172.21.15.38:0/1075852588 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea8157bc0 con 0x7fdea8161340 2023-12-22T08:41:17.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.418+0000 7fdead3ae640 1 -- 172.21.15.38:0/1075852588 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea81580e0 con 0x7fdea8161340 2023-12-22T08:41:17.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.419+0000 7fdea4ff9640 1 -- 172.21.15.38:0/1075852588 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fde9c013470 con 0x7fdea8161340 2023-12-22T08:41:17.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.420+0000 7fdea4ff9640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fde9406a460 0x7fde9406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.420+0000 7fdea4ff9640 1 -- 172.21.15.38:0/1075852588 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde9c0889f0 con 0x7fdea8161340 2023-12-22T08:41:17.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.420+0000 7fdea7fff640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fde9406a460 0x7fde9406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.421+0000 7fdea7fff640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fde9406a460 0x7fde9406c920 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde98005880 tx=0x7fde98009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:17.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.424+0000 7fdea4ff9640 1 -- 172.21.15.38:0/1075852588 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdea81580e0 con 0x7fdea8161340 2023-12-22T08:41:17.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.658+0000 7fdead3ae640 1 -- 172.21.15.38:0/1075852588 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdea809a300 con 0x7fdea8161340 2023-12-22T08:41:17.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.659+0000 7fdea4ff9640 1 -- 172.21.15.38:0/1075852588 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4642 (secure 0 0 0) 0x7fde9c017090 con 0x7fdea8161340 2023-12-22T08:41:17.662 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:17.662 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1244935716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1244935716},{"type":"v1","addr":"172.21.15.89:6837","nonce":1244935716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/23463229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":23463229},{"type":"v1","addr":"172.21.15.38:6833","nonce":23463229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3876693609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3876693609},{"type":"v1","addr":"172.21.15.89:6836","nonce":3876693609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:41:14.062124+0000","modified":"2023-12-22T08:41:17.103814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.38:6835/2926436383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2926436383},{"type":"v1","addr":"172.21.15.38:6835","nonce":2926436383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-22T08:41:17.662 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 16 2023-12-22T08:41:17.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.661+0000 7fdead3ae640 1 -- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fde9406a460 msgr2=0x7fde9406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.661+0000 7fdead3ae640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fde9406a460 0x7fde9406c920 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde98005880 tx=0x7fde98009040 comp rx=0 tx=0).stop 2023-12-22T08:41:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.661+0000 7fdead3ae640 1 -- 172.21.15.38:0/1075852588 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea8161340 msgr2=0x7fdea8160400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.661+0000 7fdead3ae640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea8161340 0x7fdea8160400 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00e840 tx=0x7fde9c00ed00 comp rx=0 tx=0).stop 2023-12-22T08:41:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.662+0000 7fdead3ae640 1 -- 172.21.15.38:0/1075852588 shutdown_connections 2023-12-22T08:41:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.662+0000 7fdead3ae640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdea8161720 0x7fdea80aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.662+0000 7fdead3ae640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fde9406a460 0x7fde9406c920 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.662+0000 7fdead3ae640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdea8161340 0x7fdea8160400 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.662+0000 7fdead3ae640 1 --2- 172.21.15.38:0/1075852588 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdea80ae1e0 0x7fdea81f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.662+0000 7fdead3ae640 1 -- 172.21.15.38:0/1075852588 >> 172.21.15.38:0/1075852588 conn(0x7fdea80b1f70 msgr2=0x7fdea806d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.662+0000 7fdead3ae640 1 -- 172.21.15.38:0/1075852588 shutdown_connections 2023-12-22T08:41:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.662+0000 7fdead3ae640 1 -- 172.21.15.38:0/1075852588 wait complete. 2023-12-22T08:41:17.682 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:17.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.909+0000 7fc8c0e95640 1 Processor -- start 2023-12-22T08:41:17.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.909+0000 7fc8c0e95640 1 -- start start 2023-12-22T08:41:17.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.911+0000 7fc8c0e95640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc8bc06d210 0x7fc8bc15e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.911+0000 7fc8c0e95640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc8bc0cb4c0 0x7fc8bc159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.911+0000 7fc8c0e95640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc0706d0 con 0x7fc8bc06d5f0 2023-12-22T08:41:17.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.911+0000 7fc8c0e95640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0cbf40 con 0x7fc8bc06d210 2023-12-22T08:41:17.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.911+0000 7fc8c0e95640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0ce840 con 0x7fc8bc0cb4c0 2023-12-22T08:41:17.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.911+0000 7fc8bb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc8bc06d210 0x7fc8bc15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.911+0000 7fc8bbfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc8bc06d5f0 0x7fc8bc0cc150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58688/0 (socket says 172.21.15.38:58688) 2023-12-22T08:41:17.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.911+0000 7fc8bbfff640 1 -- 172.21.15.38:0/3606489189 learned_addr learned my addr 172.21.15.38:0/3606489189 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:17.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.911+0000 7fc8b3fff640 1 --2- 172.21.15.38:0/3606489189 >> v2:172.21.15.89:3300/0 conn(0x7fc8bc0cb4c0 0x7fc8bc159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.912+0000 7fc8bb7fe640 1 -- 172.21.15.38:0/3606489189 >> v2:172.21.15.89:3300/0 conn(0x7fc8bc0cb4c0 msgr2=0x7fc8bc159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:17.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.912+0000 7fc8bb7fe640 1 --2- 172.21.15.38:0/3606489189 >> v2:172.21.15.89:3300/0 conn(0x7fc8bc0cb4c0 0x7fc8bc159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.912+0000 7fc8bb7fe640 1 -- 172.21.15.38:0/3606489189 >> v1:172.21.15.38:6789/0 conn(0x7fc8bc06d5f0 legacy=0x7fc8bc0cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.912+0000 7fc8bb7fe640 1 -- 172.21.15.38:0/3606489189 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0ceb20 con 0x7fc8bc06d210 2023-12-22T08:41:17.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.912+0000 7fc8baffd640 1 -- 172.21.15.38:0/3606489189 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942862302 0 0) 0x7fc8bc0706d0 con 0x7fc8bc06d5f0 2023-12-22T08:41:17.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.913+0000 7fc8bb7fe640 1 --2- 172.21.15.38:0/3606489189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8bc06d210 0x7fc8bc15e830 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0a4590 tx=0x7fc8ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9410dc376d9271f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:17.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.913+0000 7fc8baffd640 1 -- 172.21.15.38:0/3606489189 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac031830 con 0x7fc8bc06d210 2023-12-22T08:41:17.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.913+0000 7fc8baffd640 1 -- 172.21.15.38:0/3606489189 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac031990 con 0x7fc8bc06d210 2023-12-22T08:41:17.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.913+0000 7fc8baffd640 1 -- 172.21.15.38:0/3606489189 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac031d20 con 0x7fc8bc06d210 2023-12-22T08:41:17.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.914+0000 7fc8c0e95640 1 -- 172.21.15.38:0/3606489189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8bc06d210 msgr2=0x7fc8bc15e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.914+0000 7fc8c0e95640 1 --2- 172.21.15.38:0/3606489189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8bc06d210 0x7fc8bc15e830 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0a4590 tx=0x7fc8ac02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.914+0000 7fc8c0e95640 1 -- 172.21.15.38:0/3606489189 shutdown_connections 2023-12-22T08:41:17.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.914+0000 7fc8c0e95640 1 --2- 172.21.15.38:0/3606489189 >> v2:172.21.15.89:3300/0 conn(0x7fc8bc0cb4c0 0x7fc8bc159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.914+0000 7fc8c0e95640 1 --2- 172.21.15.38:0/3606489189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8bc06d210 0x7fc8bc15e830 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.914+0000 7fc8c0e95640 1 -- 172.21.15.38:0/3606489189 >> 172.21.15.38:0/3606489189 conn(0x7fc8bc0b1f70 msgr2=0x7fc8bc0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:17.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.914+0000 7fc8c0e95640 1 -- 172.21.15.38:0/3606489189 shutdown_connections 2023-12-22T08:41:17.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.914+0000 7fc8c0e95640 1 -- 172.21.15.38:0/3606489189 wait complete. 2023-12-22T08:41:17.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.916+0000 7fc8c0e95640 1 Processor -- start 2023-12-22T08:41:17.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.916+0000 7fc8c0e95640 1 -- start start 2023-12-22T08:41:17.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.917+0000 7fc8c0e95640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8bc06d210 0x7fc8bc15cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.917+0000 7fc8c0e95640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8bc06d5f0 0x7fc8bc14bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.917+0000 7fc8c0e95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc0cb4c0 0x7fc8bc152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.917+0000 7fc8c0e95640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc14d510 con 0x7fc8bc06d5f0 2023-12-22T08:41:17.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.917+0000 7fc8c0e95640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc157e00 con 0x7fc8bc0cb4c0 2023-12-22T08:41:17.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.917+0000 7fc8c0e95640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc14c240 con 0x7fc8bc06d210 2023-12-22T08:41:17.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.917+0000 7fc8b3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8bc06d5f0 0x7fc8bc14bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.917+0000 7fc8b3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8bc06d5f0 0x7fc8bc14bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56222/0 (socket says 172.21.15.38:56222) 2023-12-22T08:41:17.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.917+0000 7fc8b3fff640 1 -- 172.21.15.38:0/2439623973 learned_addr learned my addr 172.21.15.38:0/2439623973 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:17.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.918+0000 7fc8bb7fe640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8bc06d210 0x7fc8bc15cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.918+0000 7fc8bbfff640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc0cb4c0 0x7fc8bc152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.918+0000 7fc8b3fff640 1 -- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8bc06d210 msgr2=0x7fc8bc15cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.918+0000 7fc8b3fff640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8bc06d210 0x7fc8bc15cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.918+0000 7fc8b3fff640 1 -- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc0cb4c0 msgr2=0x7fc8bc152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.918+0000 7fc8b3fff640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc0cb4c0 0x7fc8bc152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.918+0000 7fc8b3fff640 1 -- 172.21.15.38:0/2439623973 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac009400 con 0x7fc8bc06d5f0 2023-12-22T08:41:17.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.918+0000 7fc8bb7fe640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8bc06d210 0x7fc8bc15cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:17.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.918+0000 7fc8b3fff640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8bc06d5f0 0x7fc8bc14bd00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400d5f0 tx=0x7fc8a400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:17.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.918+0000 7fc8b8ff9640 1 -- 172.21.15.38:0/2439623973 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40125f0 con 0x7fc8bc06d5f0 2023-12-22T08:41:17.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.918+0000 7fc8b8ff9640 1 -- 172.21.15.38:0/2439623973 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a4012750 con 0x7fc8bc06d5f0 2023-12-22T08:41:17.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.918+0000 7fc8c0e95640 1 -- 172.21.15.38:0/2439623973 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc14d080 con 0x7fc8bc06d5f0 2023-12-22T08:41:17.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.918+0000 7fc8b8ff9640 1 -- 172.21.15.38:0/2439623973 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4012b00 con 0x7fc8bc06d5f0 2023-12-22T08:41:17.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.919+0000 7fc8c0e95640 1 -- 172.21.15.38:0/2439623973 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc14c520 con 0x7fc8bc06d5f0 2023-12-22T08:41:17.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.920+0000 7fc8c0e95640 1 -- 172.21.15.38:0/2439623973 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc14d210 con 0x7fc8bc06d5f0 2023-12-22T08:41:17.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.921+0000 7fc8b8ff9640 1 -- 172.21.15.38:0/2439623973 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc8a4012c60 con 0x7fc8bc06d5f0 2023-12-22T08:41:17.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.922+0000 7fc8b8ff9640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc89c06a460 0x7fc89c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.922+0000 7fc8b8ff9640 1 -- 172.21.15.38:0/2439623973 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8a4088e80 con 0x7fc8bc06d5f0 2023-12-22T08:41:17.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.922+0000 7fc8bb7fe640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc89c06a460 0x7fc89c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.923+0000 7fc8bb7fe640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc89c06a460 0x7fc89c06c920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac036000 tx=0x7fc8ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:17.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:17.926+0000 7fc8b8ff9640 1 -- 172.21.15.38:0/2439623973 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc8a4054340 con 0x7fc8bc06d5f0 2023-12-22T08:41:18.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.122+0000 7fc8c0e95640 1 -- 172.21.15.38:0/2439623973 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8bc061910 con 0x7fc8bc06d5f0 2023-12-22T08:41:18.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.124+0000 7fc8b8ff9640 1 -- 172.21.15.38:0/2439623973 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15993 (secure 0 0 0) 0x7fc8a4057960 con 0x7fc8bc06d5f0 2023-12-22T08:41:18.127 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:18.127 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:41:15.066624+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:12.357679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:13.069596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:18.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.126+0000 7fc8c0e95640 1 -- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc89c06a460 msgr2=0x7fc89c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.126+0000 7fc8c0e95640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc89c06a460 0x7fc89c06c920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac036000 tx=0x7fc8ac008030 comp rx=0 tx=0).stop 2023-12-22T08:41:18.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.126+0000 7fc8c0e95640 1 -- 172.21.15.38:0/2439623973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8bc06d5f0 msgr2=0x7fc8bc14bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.126+0000 7fc8c0e95640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8bc06d5f0 0x7fc8bc14bd00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400d5f0 tx=0x7fc8a400dab0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.127+0000 7fc8c0e95640 1 -- 172.21.15.38:0/2439623973 shutdown_connections 2023-12-22T08:41:18.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.127+0000 7fc8c0e95640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8bc0cb4c0 0x7fc8bc152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.127+0000 7fc8c0e95640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc89c06a460 0x7fc89c06c920 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.127+0000 7fc8c0e95640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc8bc06d5f0 0x7fc8bc14bd00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.127+0000 7fc8c0e95640 1 --2- 172.21.15.38:0/2439623973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8bc06d210 0x7fc8bc15cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.127+0000 7fc8c0e95640 1 -- 172.21.15.38:0/2439623973 >> 172.21.15.38:0/2439623973 conn(0x7fc8bc0b1f70 msgr2=0x7fc8bc0a0350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:18.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.127+0000 7fc8c0e95640 1 -- 172.21.15.38:0/2439623973 shutdown_connections 2023-12-22T08:41:18.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.127+0000 7fc8c0e95640 1 -- 172.21.15.38:0/2439623973 wait complete. 2023-12-22T08:41:18.148 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T08:41:18.149 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:41:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.367+0000 7fa5c1b18640 1 Processor -- start 2023-12-22T08:41:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.367+0000 7fa5c1b18640 1 -- start start 2023-12-22T08:41:18.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.368+0000 7fa5c1b18640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5bc144d10 0x7fa5bc0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.368+0000 7fa5c1b18640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa5bc0cc670 0x7fa5bc0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.368+0000 7fa5c1b18640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa5bc0b2590 0x7fa5bc15f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.368+0000 7fa5c1b18640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc0b2a20 con 0x7fa5bc0b2590 2023-12-22T08:41:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.368+0000 7fa5c1b18640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc1450f0 con 0x7fa5bc0cc670 2023-12-22T08:41:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.368+0000 7fa5c1b18640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0ce010 con 0x7fa5bc144d10 2023-12-22T08:41:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.369+0000 7fa5bbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa5bc0b2590 0x7fa5bc15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.369+0000 7fa5bbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa5bc0b2590 0x7fa5bc15f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56238/0 (socket says 172.21.15.38:56238) 2023-12-22T08:41:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.369+0000 7fa5bbfff640 1 -- 172.21.15.38:0/1822762890 learned_addr learned my addr 172.21.15.38:0/1822762890 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.369+0000 7fa5baffd640 1 --2- 172.21.15.38:0/1822762890 >> v2:172.21.15.89:3300/0 conn(0x7fa5bc0cc670 0x7fa5bc0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.369+0000 7fa5bb7fe640 1 --2- 172.21.15.38:0/1822762890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5bc144d10 0x7fa5bc0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.369+0000 7fa5bbfff640 1 -- 172.21.15.38:0/1822762890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5bc144d10 msgr2=0x7fa5bc0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.369+0000 7fa5bbfff640 1 --2- 172.21.15.38:0/1822762890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5bc144d10 0x7fa5bc0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.369+0000 7fa5bbfff640 1 -- 172.21.15.38:0/1822762890 >> v2:172.21.15.89:3300/0 conn(0x7fa5bc0cc670 msgr2=0x7fa5bc0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.369+0000 7fa5bbfff640 1 --2- 172.21.15.38:0/1822762890 >> v2:172.21.15.89:3300/0 conn(0x7fa5bc0cc670 0x7fa5bc0b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.369+0000 7fa5bbfff640 1 -- 172.21.15.38:0/1822762890 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0ce2f0 con 0x7fa5bc0b2590 2023-12-22T08:41:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.369+0000 7fa5baffd640 1 --2- 172.21.15.38:0/1822762890 >> v2:172.21.15.89:3300/0 conn(0x7fa5bc0cc670 0x7fa5bc0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.371+0000 7fa5bbfff640 1 --2- 172.21.15.38:0/1822762890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5bc0b2590 0x7fa5bc15f040 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0cfe80 tx=0x7fa5b402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f87e02ec53b4ec server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.371+0000 7fa5ba7fc640 1 -- 172.21.15.38:0/1822762890 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b402ca70 con 0x7fa5bc0b2590 2023-12-22T08:41:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.371+0000 7fa5ba7fc640 1 -- 172.21.15.38:0/1822762890 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b402cbd0 con 0x7fa5bc0b2590 2023-12-22T08:41:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.371+0000 7fa5ba7fc640 1 -- 172.21.15.38:0/1822762890 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40343f0 con 0x7fa5bc0b2590 2023-12-22T08:41:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.372+0000 7fa5c1b18640 1 -- 172.21.15.38:0/1822762890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5bc0b2590 msgr2=0x7fa5bc15f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.372+0000 7fa5c1b18640 1 --2- 172.21.15.38:0/1822762890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5bc0b2590 0x7fa5bc15f040 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0cfe80 tx=0x7fa5b402bed0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.372+0000 7fa5c1b18640 1 -- 172.21.15.38:0/1822762890 shutdown_connections 2023-12-22T08:41:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.372+0000 7fa5c1b18640 1 --2- 172.21.15.38:0/1822762890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5bc0b2590 0x7fa5bc15f040 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.372+0000 7fa5c1b18640 1 --2- 172.21.15.38:0/1822762890 >> v2:172.21.15.89:3300/0 conn(0x7fa5bc0cc670 0x7fa5bc0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.372+0000 7fa5c1b18640 1 --2- 172.21.15.38:0/1822762890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5bc144d10 0x7fa5bc0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.372+0000 7fa5c1b18640 1 -- 172.21.15.38:0/1822762890 >> 172.21.15.38:0/1822762890 conn(0x7fa5bc0cf070 msgr2=0x7fa5bc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.372+0000 7fa5c1b18640 1 -- 172.21.15.38:0/1822762890 shutdown_connections 2023-12-22T08:41:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.372+0000 7fa5c1b18640 1 -- 172.21.15.38:0/1822762890 wait complete. 2023-12-22T08:41:18.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.374+0000 7fa5c1b18640 1 Processor -- start 2023-12-22T08:41:18.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.374+0000 7fa5c1b18640 1 -- start start 2023-12-22T08:41:18.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.375+0000 7fa5c1b18640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5bc0b2590 0x7fa5bc143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.375+0000 7fa5c1b18640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5bc144d10 0x7fa5bc154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.375+0000 7fa5c1b18640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5bc1425f0 0x7fa5bc1f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.375+0000 7fa5c1b18640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc1552c0 con 0x7fa5bc0b2590 2023-12-22T08:41:18.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.375+0000 7fa5c1b18640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc1f1d50 con 0x7fa5bc144d10 2023-12-22T08:41:18.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.375+0000 7fa5c1b18640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc15f870 con 0x7fa5bc1425f0 2023-12-22T08:41:18.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.375+0000 7fa5bb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5bc0b2590 0x7fa5bc143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.375+0000 7fa5bb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5bc0b2590 0x7fa5bc143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56254/0 (socket says 172.21.15.38:56254) 2023-12-22T08:41:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.375+0000 7fa5bb7fe640 1 -- 172.21.15.38:0/2732435149 learned_addr learned my addr 172.21.15.38:0/2732435149 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.376+0000 7fa5baffd640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5bc144d10 0x7fa5bc154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.376+0000 7fa5bb7fe640 1 -- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5bc1425f0 msgr2=0x7fa5bc1f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.376+0000 7fa5bbfff640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5bc1425f0 0x7fa5bc1f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.376+0000 7fa5bb7fe640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5bc1425f0 0x7fa5bc1f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.376+0000 7fa5bb7fe640 1 -- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5bc144d10 msgr2=0x7fa5bc154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.376+0000 7fa5bb7fe640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5bc144d10 0x7fa5bc154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.376+0000 7fa5bb7fe640 1 -- 172.21.15.38:0/2732435149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b4009b30 con 0x7fa5bc0b2590 2023-12-22T08:41:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.376+0000 7fa5baffd640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5bc144d10 0x7fa5bc154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.376+0000 7fa5bb7fe640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5bc0b2590 0x7fa5bc143be0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00d5f0 tx=0x7fa5ac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:18.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.376+0000 7fa5a3fff640 1 -- 172.21.15.38:0/2732435149 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0125f0 con 0x7fa5bc0b2590 2023-12-22T08:41:18.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.376+0000 7fa5a3fff640 1 -- 172.21.15.38:0/2732435149 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac012750 con 0x7fa5bc0b2590 2023-12-22T08:41:18.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.376+0000 7fa5a3fff640 1 -- 172.21.15.38:0/2732435149 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac012b00 con 0x7fa5bc0b2590 2023-12-22T08:41:18.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.376+0000 7fa5c1b18640 1 -- 172.21.15.38:0/2732435149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc142b40 con 0x7fa5bc0b2590 2023-12-22T08:41:18.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.377+0000 7fa5c1b18640 1 -- 172.21.15.38:0/2732435149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc143100 con 0x7fa5bc0b2590 2023-12-22T08:41:18.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.378+0000 7fa5c1b18640 1 -- 172.21.15.38:0/2732435149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc061910 con 0x7fa5bc0b2590 2023-12-22T08:41:18.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.379+0000 7fa5a3fff640 1 -- 172.21.15.38:0/2732435149 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa5ac012c60 con 0x7fa5bc0b2590 2023-12-22T08:41:18.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.380+0000 7fa5a3fff640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa5a806a430 0x7fa5a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.380+0000 7fa5a3fff640 1 -- 172.21.15.38:0/2732435149 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5ac088dc0 con 0x7fa5bc0b2590 2023-12-22T08:41:18.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.381+0000 7fa5baffd640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa5a806a430 0x7fa5a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.382+0000 7fa5baffd640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa5a806a430 0x7fa5a806c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc144400 tx=0x7fa5b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:18.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.385+0000 7fa5a3fff640 1 -- 172.21.15.38:0/2732435149 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa5ac054350 con 0x7fa5bc0b2590 2023-12-22T08:41:18.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.580+0000 7fa5c1b18640 1 -- 172.21.15.38:0/2732435149 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5bc0ce8b0 con 0x7fa5a806a430 2023-12-22T08:41:18.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.606+0000 7fa5a3fff640 1 -- 172.21.15.38:0/2732435149 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278729 (secure 0 0 0) 0x7fa5b000c040 con 0x7fa5a806a430 2023-12-22T08:41:18.614 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:18.615 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:41:18.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.612+0000 7fa5c1b18640 1 -- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa5a806a430 msgr2=0x7fa5a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.612+0000 7fa5c1b18640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa5a806a430 0x7fa5a806c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc144400 tx=0x7fa5b0008040 comp rx=0 tx=0).stop 2023-12-22T08:41:18.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.612+0000 7fa5c1b18640 1 -- 172.21.15.38:0/2732435149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5bc0b2590 msgr2=0x7fa5bc143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.612+0000 7fa5c1b18640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5bc0b2590 0x7fa5bc143be0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00d5f0 tx=0x7fa5ac00dab0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.612+0000 7fa5c1b18640 1 -- 172.21.15.38:0/2732435149 shutdown_connections 2023-12-22T08:41:18.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.612+0000 7fa5c1b18640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5bc1425f0 0x7fa5bc1f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.612+0000 7fa5c1b18640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5bc144d10 0x7fa5bc154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.612+0000 7fa5c1b18640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa5a806a430 0x7fa5a806c8f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.612+0000 7fa5c1b18640 1 --2- 172.21.15.38:0/2732435149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5bc0b2590 0x7fa5bc143be0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.612+0000 7fa5c1b18640 1 -- 172.21.15.38:0/2732435149 >> 172.21.15.38:0/2732435149 conn(0x7fa5bc0cf070 msgr2=0x7fa5bc155430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:18.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.612+0000 7fa5c1b18640 1 -- 172.21.15.38:0/2732435149 shutdown_connections 2023-12-22T08:41:18.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.612+0000 7fa5c1b18640 1 -- 172.21.15.38:0/2732435149 wait complete. 2023-12-22T08:41:18.637 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-12-22T08:41:18.383405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":180,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":136,"acting":136,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2263,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560236,"statfs":{"total":1600000000,"available":1597682379,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.845479"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220299+0000","last_change":"2023-12-22T08:41:14.087998+0000","last_active":"2023-12-22T08:41:15.220299+0000","last_peered":"2023-12-22T08:41:15.220299+0000","last_clean":"2023-12-22T08:41:15.220299+0000","last_became_active":"2023-12-22T08:41:14.087420+0000","last_became_peered":"2023-12-22T08:41:14.087420+0000","last_unstale":"2023-12-22T08:41:15.220299+0000","last_undegraded":"2023-12-22T08:41:15.220299+0000","last_fullsized":"2023-12-22T08:41:15.220299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:36:35.401856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219678+0000","last_change":"2023-12-22T08:41:14.099756+0000","last_active":"2023-12-22T08:41:15.219678+0000","last_peered":"2023-12-22T08:41:15.219678+0000","last_clean":"2023-12-22T08:41:15.219678+0000","last_became_active":"2023-12-22T08:41:14.099195+0000","last_became_peered":"2023-12-22T08:41:14.099195+0000","last_unstale":"2023-12-22T08:41:15.219678+0000","last_undegraded":"2023-12-22T08:41:15.219678+0000","last_fullsized":"2023-12-22T08:41:15.219678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:24.381088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080699+0000","last_change":"2023-12-22T08:41:14.089198+0000","last_active":"2023-12-22T08:41:15.080699+0000","last_peered":"2023-12-22T08:41:15.080699+0000","last_clean":"2023-12-22T08:41:15.080699+0000","last_became_active":"2023-12-22T08:41:14.088946+0000","last_became_peered":"2023-12-22T08:41:14.088946+0000","last_unstale":"2023-12-22T08:41:15.080699+0000","last_undegraded":"2023-12-22T08:41:15.080699+0000","last_fullsized":"2023-12-22T08:41:15.080699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:49.001260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.083920+0000","last_change":"2023-12-22T08:41:14.104339+0000","last_active":"2023-12-22T08:41:15.083920+0000","last_peered":"2023-12-22T08:41:15.083920+0000","last_clean":"2023-12-22T08:41:15.083920+0000","last_became_active":"2023-12-22T08:41:14.099264+0000","last_became_peered":"2023-12-22T08:41:14.099264+0000","last_unstale":"2023-12-22T08:41:15.083920+0000","last_undegraded":"2023-12-22T08:41:15.083920+0000","last_fullsized":"2023-12-22T08:41:15.083920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:29:58.437257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219819+0000","last_change":"2023-12-22T08:41:14.104174+0000","last_active":"2023-12-22T08:41:15.219819+0000","last_peered":"2023-12-22T08:41:15.219819+0000","last_clean":"2023-12-22T08:41:15.219819+0000","last_became_active":"2023-12-22T08:41:14.103253+0000","last_became_peered":"2023-12-22T08:41:14.103253+0000","last_unstale":"2023-12-22T08:41:15.219819+0000","last_undegraded":"2023-12-22T08:41:15.219819+0000","last_fullsized":"2023-12-22T08:41:15.219819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:52:53.231438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219813+0000","last_change":"2023-12-22T08:41:14.081479+0000","last_active":"2023-12-22T08:41:15.219813+0000","last_peered":"2023-12-22T08:41:15.219813+0000","last_clean":"2023-12-22T08:41:15.219813+0000","last_became_active":"2023-12-22T08:41:14.080980+0000","last_became_peered":"2023-12-22T08:41:14.080980+0000","last_unstale":"2023-12-22T08:41:15.219813+0000","last_undegraded":"2023-12-22T08:41:15.219813+0000","last_fullsized":"2023-12-22T08:41:15.219813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:50.601030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218634+0000","last_change":"2023-12-22T08:41:14.093504+0000","last_active":"2023-12-22T08:41:15.218634+0000","last_peered":"2023-12-22T08:41:15.218634+0000","last_clean":"2023-12-22T08:41:15.218634+0000","last_became_active":"2023-12-22T08:41:14.093196+0000","last_became_peered":"2023-12-22T08:41:14.093196+0000","last_unstale":"2023-12-22T08:41:15.218634+0000","last_undegraded":"2023-12-22T08:41:15.218634+0000","last_fullsized":"2023-12-22T08:41:15.218634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:37:59.695494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080552+0000","last_change":"2023-12-22T08:41:14.082409+0000","last_active":"2023-12-22T08:41:15.080552+0000","last_peered":"2023-12-22T08:41:15.080552+0000","last_clean":"2023-12-22T08:41:15.080552+0000","last_became_active":"2023-12-22T08:41:14.081886+0000","last_became_peered":"2023-12-22T08:41:14.081886+0000","last_unstale":"2023-12-22T08:41:15.080552+0000","last_undegraded":"2023-12-22T08:41:15.080552+0000","last_fullsized":"2023-12-22T08:41:15.080552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:21:20.048933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084232+0000","last_change":"2023-12-22T08:41:14.104833+0000","last_active":"2023-12-22T08:41:15.084232+0000","last_peered":"2023-12-22T08:41:15.084232+0000","last_clean":"2023-12-22T08:41:15.084232+0000","last_became_active":"2023-12-22T08:41:14.100564+0000","last_became_peered":"2023-12-22T08:41:14.100564+0000","last_unstale":"2023-12-22T08:41:15.084232+0000","last_undegraded":"2023-12-22T08:41:15.084232+0000","last_fullsized":"2023-12-22T08:41:15.084232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:35.662994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218768+0000","last_change":"2023-12-22T08:41:14.098408+0000","last_active":"2023-12-22T08:41:15.218768+0000","last_peered":"2023-12-22T08:41:15.218768+0000","last_clean":"2023-12-22T08:41:15.218768+0000","last_became_active":"2023-12-22T08:41:14.098202+0000","last_became_peered":"2023-12-22T08:41:14.098202+0000","last_unstale":"2023-12-22T08:41:15.218768+0000","last_undegraded":"2023-12-22T08:41:15.218768+0000","last_fullsized":"2023-12-22T08:41:15.218768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:40.377312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084177+0000","last_change":"2023-12-22T08:41:14.098092+0000","last_active":"2023-12-22T08:41:15.084177+0000","last_peered":"2023-12-22T08:41:15.084177+0000","last_clean":"2023-12-22T08:41:15.084177+0000","last_became_active":"2023-12-22T08:41:14.092294+0000","last_became_peered":"2023-12-22T08:41:14.092294+0000","last_unstale":"2023-12-22T08:41:15.084177+0000","last_undegraded":"2023-12-22T08:41:15.084177+0000","last_fullsized":"2023-12-22T08:41:15.084177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:22:24.029276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219910+0000","last_change":"2023-12-22T08:41:14.090355+0000","last_active":"2023-12-22T08:41:15.219910+0000","last_peered":"2023-12-22T08:41:15.219910+0000","last_clean":"2023-12-22T08:41:15.219910+0000","last_became_active":"2023-12-22T08:41:14.089908+0000","last_became_peered":"2023-12-22T08:41:14.089908+0000","last_unstale":"2023-12-22T08:41:15.219910+0000","last_undegraded":"2023-12-22T08:41:15.219910+0000","last_fullsized":"2023-12-22T08:41:15.219910+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:25:50.465640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219702+0000","last_change":"2023-12-22T08:41:14.097459+0000","last_active":"2023-12-22T08:41:15.219702+0000","last_peered":"2023-12-22T08:41:15.219702+0000","last_clean":"2023-12-22T08:41:15.219702+0000","last_became_active":"2023-12-22T08:41:14.093400+0000","last_became_peered":"2023-12-22T08:41:14.093400+0000","last_unstale":"2023-12-22T08:41:15.219702+0000","last_undegraded":"2023-12-22T08:41:15.219702+0000","last_fullsized":"2023-12-22T08:41:15.219702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:42.793364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217815+0000","last_change":"2023-12-22T08:41:14.088071+0000","last_active":"2023-12-22T08:41:15.217815+0000","last_peered":"2023-12-22T08:41:15.217815+0000","last_clean":"2023-12-22T08:41:15.217815+0000","last_became_active":"2023-12-22T08:41:14.087707+0000","last_became_peered":"2023-12-22T08:41:14.087707+0000","last_unstale":"2023-12-22T08:41:15.217815+0000","last_undegraded":"2023-12-22T08:41:15.217815+0000","last_fullsized":"2023-12-22T08:41:15.217815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219882+0000","last_change":"2023-12-22T08:41:14.076875+0000","last_active":"2023-12-22T08:41:15.219882+0000","last_peered":"2023-12-22T08:41:15.219882+0000","last_clean":"2023-12-22T08:41:15.219882+0000","last_became_active":"2023-12-22T08:41:14.076641+0000","last_became_peered":"2023-12-22T08:41:14.076641+0000","last_unstale":"2023-12-22T08:41:15.219882+0000","last_undegraded":"2023-12-22T08:41:15.219882+0000","last_fullsized":"2023-12-22T08:41:15.219882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080632+0000","last_change":"2023-12-22T08:41:14.082276+0000","last_active":"2023-12-22T08:41:15.080632+0000","last_peered":"2023-12-22T08:41:15.080632+0000","last_clean":"2023-12-22T08:41:15.080632+0000","last_became_active":"2023-12-22T08:41:14.081594+0000","last_became_peered":"2023-12-22T08:41:14.081594+0000","last_unstale":"2023-12-22T08:41:15.080632+0000","last_undegraded":"2023-12-22T08:41:15.080632+0000","last_fullsized":"2023-12-22T08:41:15.080632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:49.203160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.083113+0000","last_change":"2023-12-22T08:41:14.093264+0000","last_active":"2023-12-22T08:41:15.083113+0000","last_peered":"2023-12-22T08:41:15.083113+0000","last_clean":"2023-12-22T08:41:15.083113+0000","last_became_active":"2023-12-22T08:41:14.092862+0000","last_became_peered":"2023-12-22T08:41:14.092862+0000","last_unstale":"2023-12-22T08:41:15.083113+0000","last_undegraded":"2023-12-22T08:41:15.083113+0000","last_fullsized":"2023-12-22T08:41:15.083113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:15.989439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.098889+0000","last_change":"2023-12-22T08:41:13.584014+0000","last_active":"2023-12-22T08:41:14.098889+0000","last_peered":"2023-12-22T08:41:14.098889+0000","last_clean":"2023-12-22T08:41:14.098889+0000","last_became_active":"2023-12-22T08:41:13.583526+0000","last_became_peered":"2023-12-22T08:41:13.583526+0000","last_unstale":"2023-12-22T08:41:14.098889+0000","last_undegraded":"2023-12-22T08:41:14.098889+0000","last_fullsized":"2023-12-22T08:41:14.098889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:28.401635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.103708+0000","last_change":"2023-12-22T08:41:13.588809+0000","last_active":"2023-12-22T08:41:14.103708+0000","last_peered":"2023-12-22T08:41:14.103708+0000","last_clean":"2023-12-22T08:41:14.103708+0000","last_became_active":"2023-12-22T08:41:13.588188+0000","last_became_peered":"2023-12-22T08:41:13.588188+0000","last_unstale":"2023-12-22T08:41:14.103708+0000","last_undegraded":"2023-12-22T08:41:14.103708+0000","last_fullsized":"2023-12-22T08:41:14.103708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.549568+0000","last_change":"2023-12-22T08:41:12.549568+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.549568+0000","last_undegraded":"2023-12-22T08:41:12.549568+0000","last_fullsized":"2023-12-22T08:41:12.549568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:59:22.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220322+0000","last_change":"2023-12-22T08:41:14.099602+0000","last_active":"2023-12-22T08:41:15.220322+0000","last_peered":"2023-12-22T08:41:15.220322+0000","last_clean":"2023-12-22T08:41:15.220322+0000","last_became_active":"2023-12-22T08:41:14.098849+0000","last_became_peered":"2023-12-22T08:41:14.098849+0000","last_unstale":"2023-12-22T08:41:15.220322+0000","last_undegraded":"2023-12-22T08:41:15.220322+0000","last_fullsized":"2023-12-22T08:41:15.220322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.106506+0000","last_change":"2023-12-22T08:41:13.581861+0000","last_active":"2023-12-22T08:41:14.106506+0000","last_peered":"2023-12-22T08:41:14.106506+0000","last_clean":"2023-12-22T08:41:14.106506+0000","last_became_active":"2023-12-22T08:41:13.580825+0000","last_became_peered":"2023-12-22T08:41:13.580825+0000","last_unstale":"2023-12-22T08:41:14.106506+0000","last_undegraded":"2023-12-22T08:41:14.106506+0000","last_fullsized":"2023-12-22T08:41:14.106506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:12.338282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.542126+0000","last_change":"2023-12-22T08:41:12.542126+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.542126+0000","last_undegraded":"2023-12-22T08:41:12.542126+0000","last_fullsized":"2023-12-22T08:41:12.542126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:55.673926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.542099+0000","last_change":"2023-12-22T08:41:12.542099+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.542099+0000","last_undegraded":"2023-12-22T08:41:12.542099+0000","last_fullsized":"2023-12-22T08:41:12.542099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.547488+0000","last_change":"2023-12-22T08:41:12.547488+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.547488+0000","last_undegraded":"2023-12-22T08:41:12.547488+0000","last_fullsized":"2023-12-22T08:41:12.547488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220046+0000","last_change":"2023-12-22T08:41:14.087827+0000","last_active":"2023-12-22T08:41:15.220046+0000","last_peered":"2023-12-22T08:41:15.220046+0000","last_clean":"2023-12-22T08:41:15.220046+0000","last_became_active":"2023-12-22T08:41:14.087045+0000","last_became_peered":"2023-12-22T08:41:14.087045+0000","last_unstale":"2023-12-22T08:41:15.220046+0000","last_undegraded":"2023-12-22T08:41:15.220046+0000","last_fullsized":"2023-12-22T08:41:15.220046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:11.801978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.542848+0000","last_change":"2023-12-22T08:41:12.542848+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.542848+0000","last_undegraded":"2023-12-22T08:41:12.542848+0000","last_fullsized":"2023-12-22T08:41:12.542848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:06:57.933316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080734+0000","last_change":"2023-12-22T08:41:14.099246+0000","last_active":"2023-12-22T08:41:15.080734+0000","last_peered":"2023-12-22T08:41:15.080734+0000","last_clean":"2023-12-22T08:41:15.080734+0000","last_became_active":"2023-12-22T08:41:14.099015+0000","last_became_peered":"2023-12-22T08:41:14.099015+0000","last_unstale":"2023-12-22T08:41:15.080734+0000","last_undegraded":"2023-12-22T08:41:15.080734+0000","last_fullsized":"2023-12-22T08:41:15.080734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:37:03.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.543116+0000","last_change":"2023-12-22T08:41:12.543116+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.543116+0000","last_undegraded":"2023-12-22T08:41:12.543116+0000","last_fullsized":"2023-12-22T08:41:12.543116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:05:32.289529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219102+0000","last_change":"2023-12-22T08:41:14.101049+0000","last_active":"2023-12-22T08:41:15.219102+0000","last_peered":"2023-12-22T08:41:15.219102+0000","last_clean":"2023-12-22T08:41:15.219102+0000","last_became_active":"2023-12-22T08:41:14.100198+0000","last_became_peered":"2023-12-22T08:41:14.100198+0000","last_unstale":"2023-12-22T08:41:15.219102+0000","last_undegraded":"2023-12-22T08:41:15.219102+0000","last_fullsized":"2023-12-22T08:41:15.219102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:49:28.648602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.543149+0000","last_change":"2023-12-22T08:41:12.543149+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.543149+0000","last_undegraded":"2023-12-22T08:41:12.543149+0000","last_fullsized":"2023-12-22T08:41:12.543149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:56.873386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220681+0000","last_change":"2023-12-22T08:41:14.091150+0000","last_active":"2023-12-22T08:41:15.220681+0000","last_peered":"2023-12-22T08:41:15.220681+0000","last_clean":"2023-12-22T08:41:15.220681+0000","last_became_active":"2023-12-22T08:41:14.089208+0000","last_became_peered":"2023-12-22T08:41:14.089208+0000","last_unstale":"2023-12-22T08:41:15.220681+0000","last_undegraded":"2023-12-22T08:41:15.220681+0000","last_fullsized":"2023-12-22T08:41:15.220681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:03:04.272947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.086529+0000","last_change":"2023-12-22T08:41:13.581406+0000","last_active":"2023-12-22T08:41:14.086529+0000","last_peered":"2023-12-22T08:41:14.086529+0000","last_clean":"2023-12-22T08:41:14.086529+0000","last_became_active":"2023-12-22T08:41:13.581185+0000","last_became_peered":"2023-12-22T08:41:13.581185+0000","last_unstale":"2023-12-22T08:41:14.086529+0000","last_undegraded":"2023-12-22T08:41:14.086529+0000","last_fullsized":"2023-12-22T08:41:14.086529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:43.727970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080685+0000","last_change":"2023-12-22T08:41:14.088889+0000","last_active":"2023-12-22T08:41:15.080685+0000","last_peered":"2023-12-22T08:41:15.080685+0000","last_clean":"2023-12-22T08:41:15.080685+0000","last_became_active":"2023-12-22T08:41:14.088632+0000","last_became_peered":"2023-12-22T08:41:14.088632+0000","last_unstale":"2023-12-22T08:41:15.080685+0000","last_undegraded":"2023-12-22T08:41:15.080685+0000","last_fullsized":"2023-12-22T08:41:15.080685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:35.696117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.107527+0000","last_change":"2023-12-22T08:41:13.583907+0000","last_active":"2023-12-22T08:41:14.107527+0000","last_peered":"2023-12-22T08:41:14.107527+0000","last_clean":"2023-12-22T08:41:14.107527+0000","last_became_active":"2023-12-22T08:41:13.583541+0000","last_became_peered":"2023-12-22T08:41:13.583541+0000","last_unstale":"2023-12-22T08:41:14.107527+0000","last_undegraded":"2023-12-22T08:41:14.107527+0000","last_fullsized":"2023-12-22T08:41:14.107527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:55.673926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084469+0000","last_change":"2023-12-22T08:41:14.093509+0000","last_active":"2023-12-22T08:41:15.084469+0000","last_peered":"2023-12-22T08:41:15.084469+0000","last_clean":"2023-12-22T08:41:15.084469+0000","last_became_active":"2023-12-22T08:41:14.093237+0000","last_became_peered":"2023-12-22T08:41:14.093237+0000","last_unstale":"2023-12-22T08:41:15.084469+0000","last_undegraded":"2023-12-22T08:41:15.084469+0000","last_fullsized":"2023-12-22T08:41:15.084469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:34.649905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.541880+0000","last_change":"2023-12-22T08:41:12.541880+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.541880+0000","last_undegraded":"2023-12-22T08:41:12.541880+0000","last_fullsized":"2023-12-22T08:41:12.541880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:40:01.499763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220533+0000","last_change":"2023-12-22T08:41:14.099450+0000","last_active":"2023-12-22T08:41:15.220533+0000","last_peered":"2023-12-22T08:41:15.220533+0000","last_clean":"2023-12-22T08:41:15.220533+0000","last_became_active":"2023-12-22T08:41:14.098493+0000","last_became_peered":"2023-12-22T08:41:14.098493+0000","last_unstale":"2023-12-22T08:41:15.220533+0000","last_undegraded":"2023-12-22T08:41:15.220533+0000","last_fullsized":"2023-12-22T08:41:15.220533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.083278+0000","last_change":"2023-12-22T08:41:13.589524+0000","last_active":"2023-12-22T08:41:14.083278+0000","last_peered":"2023-12-22T08:41:14.083278+0000","last_clean":"2023-12-22T08:41:14.083278+0000","last_became_active":"2023-12-22T08:41:13.589280+0000","last_became_peered":"2023-12-22T08:41:13.589280+0000","last_unstale":"2023-12-22T08:41:14.083278+0000","last_undegraded":"2023-12-22T08:41:14.083278+0000","last_fullsized":"2023-12-22T08:41:14.083278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:15.540388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.080556+0000","last_change":"2023-12-22T08:41:13.583098+0000","last_active":"2023-12-22T08:41:14.080556+0000","last_peered":"2023-12-22T08:41:14.080556+0000","last_clean":"2023-12-22T08:41:14.080556+0000","last_became_active":"2023-12-22T08:41:13.582809+0000","last_became_peered":"2023-12-22T08:41:13.582809+0000","last_unstale":"2023-12-22T08:41:14.080556+0000","last_undegraded":"2023-12-22T08:41:14.080556+0000","last_fullsized":"2023-12-22T08:41:14.080556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:42:51.564771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080835+0000","last_change":"2023-12-22T08:41:14.082128+0000","last_active":"2023-12-22T08:41:15.080835+0000","last_peered":"2023-12-22T08:41:15.080835+0000","last_clean":"2023-12-22T08:41:15.080835+0000","last_became_active":"2023-12-22T08:41:14.081273+0000","last_became_peered":"2023-12-22T08:41:14.081273+0000","last_unstale":"2023-12-22T08:41:15.080835+0000","last_undegraded":"2023-12-22T08:41:15.080835+0000","last_fullsized":"2023-12-22T08:41:15.080835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:24.381088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.550521+0000","last_change":"2023-12-22T08:41:12.550521+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.550521+0000","last_undegraded":"2023-12-22T08:41:12.550521+0000","last_fullsized":"2023-12-22T08:41:12.550521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:11:05.047493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.081153+0000","last_change":"2023-12-22T08:41:14.095349+0000","last_active":"2023-12-22T08:41:15.081153+0000","last_peered":"2023-12-22T08:41:15.081153+0000","last_clean":"2023-12-22T08:41:15.081153+0000","last_became_active":"2023-12-22T08:41:14.094909+0000","last_became_peered":"2023-12-22T08:41:14.094909+0000","last_unstale":"2023-12-22T08:41:15.081153+0000","last_undegraded":"2023-12-22T08:41:15.081153+0000","last_fullsized":"2023-12-22T08:41:15.081153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:29.434181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.546449+0000","last_change":"2023-12-22T08:41:12.546449+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.546449+0000","last_undegraded":"2023-12-22T08:41:12.546449+0000","last_fullsized":"2023-12-22T08:41:12.546449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:36:20.680519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.540934+0000","last_change":"2023-12-22T08:41:12.540934+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.540934+0000","last_undegraded":"2023-12-22T08:41:12.540934+0000","last_fullsized":"2023-12-22T08:41:12.540934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.086429+0000","last_change":"2023-12-22T08:41:13.579166+0000","last_active":"2023-12-22T08:41:14.086429+0000","last_peered":"2023-12-22T08:41:14.086429+0000","last_clean":"2023-12-22T08:41:14.086429+0000","last_became_active":"2023-12-22T08:41:13.578664+0000","last_became_peered":"2023-12-22T08:41:13.578664+0000","last_unstale":"2023-12-22T08:41:14.086429+0000","last_undegraded":"2023-12-22T08:41:14.086429+0000","last_fullsized":"2023-12-22T08:41:14.086429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:14.972374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.070743+0000","last_change":"2023-12-22T08:41:13.584163+0000","last_active":"2023-12-22T08:41:14.070743+0000","last_peered":"2023-12-22T08:41:14.070743+0000","last_clean":"2023-12-22T08:41:14.070743+0000","last_became_active":"2023-12-22T08:41:13.583522+0000","last_became_peered":"2023-12-22T08:41:13.583522+0000","last_unstale":"2023-12-22T08:41:14.070743+0000","last_undegraded":"2023-12-22T08:41:14.070743+0000","last_fullsized":"2023-12-22T08:41:14.070743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:36:58.096521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.085500+0000","last_change":"2023-12-22T08:41:14.091567+0000","last_active":"2023-12-22T08:41:15.085500+0000","last_peered":"2023-12-22T08:41:15.085500+0000","last_clean":"2023-12-22T08:41:15.085500+0000","last_became_active":"2023-12-22T08:41:14.090447+0000","last_became_peered":"2023-12-22T08:41:14.090447+0000","last_unstale":"2023-12-22T08:41:15.085500+0000","last_undegraded":"2023-12-22T08:41:15.085500+0000","last_fullsized":"2023-12-22T08:41:15.085500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:52:26.794837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.544198+0000","last_change":"2023-12-22T08:41:12.544198+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.544198+0000","last_undegraded":"2023-12-22T08:41:12.544198+0000","last_fullsized":"2023-12-22T08:41:12.544198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:20.321086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.540934+0000","last_change":"2023-12-22T08:41:12.540934+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.540934+0000","last_undegraded":"2023-12-22T08:41:12.540934+0000","last_fullsized":"2023-12-22T08:41:12.540934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084701+0000","last_change":"2023-12-22T08:41:14.099157+0000","last_active":"2023-12-22T08:41:15.084701+0000","last_peered":"2023-12-22T08:41:15.084701+0000","last_clean":"2023-12-22T08:41:15.084701+0000","last_became_active":"2023-12-22T08:41:14.098888+0000","last_became_peered":"2023-12-22T08:41:14.098888+0000","last_unstale":"2023-12-22T08:41:15.084701+0000","last_undegraded":"2023-12-22T08:41:15.084701+0000","last_fullsized":"2023-12-22T08:41:15.084701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:50.601030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.540560+0000","last_change":"2023-12-22T08:41:12.540560+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.540560+0000","last_undegraded":"2023-12-22T08:41:12.540560+0000","last_fullsized":"2023-12-22T08:41:12.540560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:33:01.715152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.073264+0000","last_change":"2023-12-22T08:41:13.578977+0000","last_active":"2023-12-22T08:41:14.073264+0000","last_peered":"2023-12-22T08:41:14.073264+0000","last_clean":"2023-12-22T08:41:14.073264+0000","last_became_active":"2023-12-22T08:41:13.578156+0000","last_became_peered":"2023-12-22T08:41:13.578156+0000","last_unstale":"2023-12-22T08:41:14.073264+0000","last_undegraded":"2023-12-22T08:41:14.073264+0000","last_fullsized":"2023-12-22T08:41:14.073264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:22:23.012211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.100998+0000","last_change":"2023-12-22T08:41:13.579216+0000","last_active":"2023-12-22T08:41:14.100998+0000","last_peered":"2023-12-22T08:41:14.100998+0000","last_clean":"2023-12-22T08:41:14.100998+0000","last_became_active":"2023-12-22T08:41:13.578785+0000","last_became_peered":"2023-12-22T08:41:13.578785+0000","last_unstale":"2023-12-22T08:41:14.100998+0000","last_undegraded":"2023-12-22T08:41:14.100998+0000","last_fullsized":"2023-12-22T08:41:14.100998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:40:01.499763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080939+0000","last_change":"2023-12-22T08:41:14.096595+0000","last_active":"2023-12-22T08:41:15.080939+0000","last_peered":"2023-12-22T08:41:15.080939+0000","last_clean":"2023-12-22T08:41:15.080939+0000","last_became_active":"2023-12-22T08:41:14.096407+0000","last_became_peered":"2023-12-22T08:41:14.096407+0000","last_unstale":"2023-12-22T08:41:15.080939+0000","last_undegraded":"2023-12-22T08:41:15.080939+0000","last_fullsized":"2023-12-22T08:41:15.080939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:26.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.543202+0000","last_change":"2023-12-22T08:41:12.543202+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.543202+0000","last_undegraded":"2023-12-22T08:41:12.543202+0000","last_fullsized":"2023-12-22T08:41:12.543202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:29:57.420192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.088432+0000","last_change":"2023-12-22T08:41:13.588185+0000","last_active":"2023-12-22T08:41:14.088432+0000","last_peered":"2023-12-22T08:41:14.088432+0000","last_clean":"2023-12-22T08:41:14.088432+0000","last_became_active":"2023-12-22T08:41:13.586420+0000","last_became_peered":"2023-12-22T08:41:13.586420+0000","last_unstale":"2023-12-22T08:41:14.088432+0000","last_undegraded":"2023-12-22T08:41:14.088432+0000","last_fullsized":"2023-12-22T08:41:14.088432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218177+0000","last_change":"2023-12-22T08:41:14.100004+0000","last_active":"2023-12-22T08:41:15.218177+0000","last_peered":"2023-12-22T08:41:15.218177+0000","last_clean":"2023-12-22T08:41:15.218177+0000","last_became_active":"2023-12-22T08:41:14.099784+0000","last_became_peered":"2023-12-22T08:41:14.099784+0000","last_unstale":"2023-12-22T08:41:15.218177+0000","last_undegraded":"2023-12-22T08:41:15.218177+0000","last_fullsized":"2023-12-22T08:41:15.218177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:44.745035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.087240+0000","last_change":"2023-12-22T08:41:13.579677+0000","last_active":"2023-12-22T08:41:14.087240+0000","last_peered":"2023-12-22T08:41:14.087240+0000","last_clean":"2023-12-22T08:41:14.087240+0000","last_became_active":"2023-12-22T08:41:13.579158+0000","last_became_peered":"2023-12-22T08:41:13.579158+0000","last_unstale":"2023-12-22T08:41:14.087240+0000","last_undegraded":"2023-12-22T08:41:14.087240+0000","last_fullsized":"2023-12-22T08:41:14.087240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219340+0000","last_change":"2023-12-22T08:41:14.100463+0000","last_active":"2023-12-22T08:41:15.219340+0000","last_peered":"2023-12-22T08:41:15.219340+0000","last_clean":"2023-12-22T08:41:15.219340+0000","last_became_active":"2023-12-22T08:41:14.099886+0000","last_became_peered":"2023-12-22T08:41:14.099886+0000","last_unstale":"2023-12-22T08:41:15.219340+0000","last_undegraded":"2023-12-22T08:41:15.219340+0000","last_fullsized":"2023-12-22T08:41:15.219340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:56.112979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.092134+0000","last_change":"2023-12-22T08:41:13.585376+0000","last_active":"2023-12-22T08:41:14.092134+0000","last_peered":"2023-12-22T08:41:14.092134+0000","last_clean":"2023-12-22T08:41:14.092134+0000","last_became_active":"2023-12-22T08:41:13.585049+0000","last_became_peered":"2023-12-22T08:41:13.585049+0000","last_unstale":"2023-12-22T08:41:14.092134+0000","last_undegraded":"2023-12-22T08:41:14.092134+0000","last_fullsized":"2023-12-22T08:41:14.092134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220519+0000","last_change":"2023-12-22T08:41:14.089434+0000","last_active":"2023-12-22T08:41:15.220519+0000","last_peered":"2023-12-22T08:41:15.220519+0000","last_clean":"2023-12-22T08:41:15.220519+0000","last_became_active":"2023-12-22T08:41:14.088912+0000","last_became_peered":"2023-12-22T08:41:14.088912+0000","last_unstale":"2023-12-22T08:41:15.220519+0000","last_undegraded":"2023-12-22T08:41:15.220519+0000","last_fullsized":"2023-12-22T08:41:15.220519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:36.121680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.540762+0000","last_change":"2023-12-22T08:41:12.540762+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.540762+0000","last_undegraded":"2023-12-22T08:41:12.540762+0000","last_fullsized":"2023-12-22T08:41:12.540762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:59:22.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080914+0000","last_change":"2023-12-22T08:41:14.096153+0000","last_active":"2023-12-22T08:41:15.080914+0000","last_peered":"2023-12-22T08:41:15.080914+0000","last_clean":"2023-12-22T08:41:15.080914+0000","last_became_active":"2023-12-22T08:41:14.095780+0000","last_became_peered":"2023-12-22T08:41:14.095780+0000","last_unstale":"2023-12-22T08:41:15.080914+0000","last_undegraded":"2023-12-22T08:41:15.080914+0000","last_fullsized":"2023-12-22T08:41:15.080914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:35.878406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.085353+0000","last_change":"2023-12-22T08:41:13.588613+0000","last_active":"2023-12-22T08:41:14.085353+0000","last_peered":"2023-12-22T08:41:14.085353+0000","last_clean":"2023-12-22T08:41:14.085353+0000","last_became_active":"2023-12-22T08:41:13.587854+0000","last_became_peered":"2023-12-22T08:41:13.587854+0000","last_unstale":"2023-12-22T08:41:14.085353+0000","last_undegraded":"2023-12-22T08:41:14.085353+0000","last_fullsized":"2023-12-22T08:41:14.085353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219952+0000","last_change":"2023-12-22T08:41:14.099842+0000","last_active":"2023-12-22T08:41:15.219952+0000","last_peered":"2023-12-22T08:41:15.219952+0000","last_clean":"2023-12-22T08:41:15.219952+0000","last_became_active":"2023-12-22T08:41:14.099597+0000","last_became_peered":"2023-12-22T08:41:14.099597+0000","last_unstale":"2023-12-22T08:41:15.219952+0000","last_undegraded":"2023-12-22T08:41:15.219952+0000","last_fullsized":"2023-12-22T08:41:15.219952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:15.989439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.073490+0000","last_change":"2023-12-22T08:41:13.584466+0000","last_active":"2023-12-22T08:41:14.073490+0000","last_peered":"2023-12-22T08:41:14.073490+0000","last_clean":"2023-12-22T08:41:14.073490+0000","last_became_active":"2023-12-22T08:41:13.583979+0000","last_became_peered":"2023-12-22T08:41:13.583979+0000","last_unstale":"2023-12-22T08:41:14.073490+0000","last_undegraded":"2023-12-22T08:41:14.073490+0000","last_fullsized":"2023-12-22T08:41:14.073490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:49.583965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:07.198878+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:41:07.198878+0000","last_peered":"2023-12-22T08:41:07.198878+0000","last_clean":"2023-12-22T08:41:07.198878+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:41:07.198878+0000","last_undegraded":"2023-12-22T08:41:07.198878+0000","last_fullsized":"2023-12-22T08:41:07.198878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195183,"statfs":{"total":200000000,"available":199867939,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.21}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.355}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.3799999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1459999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.96999999999999997}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.4670000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":149,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847025,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.0489999999999999,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.84799999999999998}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.96599999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.083},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.02}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.1799999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.1180000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":704,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199278590,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.1659999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.79,"5min":2.79,"15min":2.79},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.98999999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.88200000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.107},{"interface":"front","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.73299999999999998}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2030000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.3149999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.498},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":4.7249999999999996,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":1.2649999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":149,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847003,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.89800000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.008},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.153}]},{"osd":2,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.1160000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.2290000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.2829999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.0740000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.375},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.409}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847813,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.008},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.77700000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.069},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1639999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.492}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.121},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.371}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.294}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.401},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.55}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195183,"statfs":{"total":200000000,"available":199867939,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":1.4319999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.92200000000000004}]},{"osd":1,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.05}]},{"osd":3,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.095},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.7649999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.667},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":5.4560000000000004,"5min":5.4560000000000004,"15min":5.4560000000000004},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":1.696}]},{"osd":6,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.873}]},{"osd":7,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.375},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.5880000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199277571,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.748},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.018}]},{"osd":5,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.0569999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.96399999999999997}]},{"osd":7,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.091},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":3.2959999999999998,"5min":3.2959999999999998,"15min":3.2959999999999998},"last":0.79500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195164,"statfs":{"total":200000000,"available":199848499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.127},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.0009999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.089},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.294}]},{"osd":7,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.105},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.177}]}]}],"pool_statfs":[]}} 2023-12-22T08:41:18.645 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:41:18.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.913+0000 7f136554e640 1 Processor -- start 2023-12-22T08:41:18.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.913+0000 7f136554e640 1 -- start start 2023-12-22T08:41:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.914+0000 7f136554e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1360144d10 0x7f13600cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.914+0000 7f136554e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f13600cc670 0x7f13600b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.914+0000 7f136554e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13601450f0 con 0x7f13600b2590 2023-12-22T08:41:18.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.914+0000 7f136554e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13600b2a00 con 0x7f1360144d10 2023-12-22T08:41:18.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.914+0000 7f136554e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13600ce010 con 0x7f13600cc670 2023-12-22T08:41:18.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.915+0000 7f135effd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1360144d10 0x7f13600cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.915+0000 7f135effd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1360144d10 0x7f13600cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56268/0 (socket says 172.21.15.38:56268) 2023-12-22T08:41:18.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.915+0000 7f135effd640 1 -- 172.21.15.38:0/3015669998 learned_addr learned my addr 172.21.15.38:0/3015669998 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:18.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.915+0000 7f135e7fc640 1 --2- 172.21.15.38:0/3015669998 >> v2:172.21.15.89:3300/0 conn(0x7f13600cc670 0x7f13600b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.915+0000 7f135effd640 1 -- 172.21.15.38:0/3015669998 >> v2:172.21.15.89:3300/0 conn(0x7f13600cc670 msgr2=0x7f13600b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:18.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.915+0000 7f135effd640 1 --2- 172.21.15.38:0/3015669998 >> v2:172.21.15.89:3300/0 conn(0x7f13600cc670 0x7f13600b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.915+0000 7f135effd640 1 -- 172.21.15.38:0/3015669998 >> v1:172.21.15.89:6789/0 conn(0x7f13600b2590 legacy=0x7f136015f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.916+0000 7f135effd640 1 -- 172.21.15.38:0/3015669998 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600ce2f0 con 0x7f1360144d10 2023-12-22T08:41:18.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.917+0000 7f135effd640 1 --2- 172.21.15.38:0/3015669998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1360144d10 0x7f13600cc130 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f13600b32f0 tx=0x7f135002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a742baa7fed0a552 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:18.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.917+0000 7f135dffb640 1 -- 172.21.15.38:0/3015669998 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350030860 con 0x7f1360144d10 2023-12-22T08:41:18.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.917+0000 7f135dffb640 1 -- 172.21.15.38:0/3015669998 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13500309c0 con 0x7f1360144d10 2023-12-22T08:41:18.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.917+0000 7f135dffb640 1 -- 172.21.15.38:0/3015669998 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350030d50 con 0x7f1360144d10 2023-12-22T08:41:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.918+0000 7f136554e640 1 -- 172.21.15.38:0/3015669998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1360144d10 msgr2=0x7f13600cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.918+0000 7f136554e640 1 --2- 172.21.15.38:0/3015669998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1360144d10 0x7f13600cc130 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f13600b32f0 tx=0x7f135002b9a0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.918+0000 7f136554e640 1 -- 172.21.15.38:0/3015669998 shutdown_connections 2023-12-22T08:41:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.918+0000 7f136554e640 1 --2- 172.21.15.38:0/3015669998 >> v2:172.21.15.89:3300/0 conn(0x7f13600cc670 0x7f13600b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.918+0000 7f136554e640 1 --2- 172.21.15.38:0/3015669998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1360144d10 0x7f13600cc130 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.918+0000 7f136554e640 1 -- 172.21.15.38:0/3015669998 >> 172.21.15.38:0/3015669998 conn(0x7f13600cf070 msgr2=0x7f13600cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.918+0000 7f136554e640 1 -- 172.21.15.38:0/3015669998 shutdown_connections 2023-12-22T08:41:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.918+0000 7f136554e640 1 -- 172.21.15.38:0/3015669998 wait complete. 2023-12-22T08:41:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.920+0000 7f136554e640 1 Processor -- start 2023-12-22T08:41:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.920+0000 7f136554e640 1 -- start start 2023-12-22T08:41:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.921+0000 7f136554e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13600b2590 0x7f136015b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.921+0000 7f136554e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1360144d10 0x7f13601f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.921+0000 7f136554e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13601f4aa0 0x7f136013aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.921+0000 7f136554e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13601f4f30 con 0x7f13601f4aa0 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.921+0000 7f136554e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136015bde0 con 0x7f1360144d10 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.921+0000 7f136554e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136013b760 con 0x7f13600b2590 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.922+0000 7f135f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13601f4aa0 0x7f136013aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.922+0000 7f135f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13601f4aa0 0x7f136013aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56274/0 (socket says 172.21.15.38:56274) 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.922+0000 7f135f7fe640 1 -- 172.21.15.38:0/4212234565 learned_addr learned my addr 172.21.15.38:0/4212234565 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.922+0000 7f135effd640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13600b2590 0x7f136015b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.922+0000 7f135e7fc640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1360144d10 0x7f13601f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.922+0000 7f135f7fe640 1 -- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13600b2590 msgr2=0x7f136015b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.922+0000 7f135f7fe640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13600b2590 0x7f136015b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.922+0000 7f135f7fe640 1 -- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1360144d10 msgr2=0x7f13601f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.922+0000 7f135f7fe640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1360144d10 0x7f13601f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.922+0000 7f135f7fe640 1 -- 172.21.15.38:0/4212234565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13500094d0 con 0x7f13601f4aa0 2023-12-22T08:41:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.922+0000 7f135f7fe640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13601f4aa0 0x7f136013aa00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f135800c7a0 tx=0x7f135800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:18.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.923+0000 7f13477fe640 1 -- 172.21.15.38:0/4212234565 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358003b70 con 0x7f13601f4aa0 2023-12-22T08:41:18.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.923+0000 7f13477fe640 1 -- 172.21.15.38:0/4212234565 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1358003cf0 con 0x7f13601f4aa0 2023-12-22T08:41:18.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.923+0000 7f136554e640 1 -- 172.21.15.38:0/4212234565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136013ba40 con 0x7f13601f4aa0 2023-12-22T08:41:18.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.923+0000 7f13477fe640 1 -- 172.21.15.38:0/4212234565 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358003ea0 con 0x7f13601f4aa0 2023-12-22T08:41:18.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.923+0000 7f136554e640 1 -- 172.21.15.38:0/4212234565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136013c000 con 0x7f13601f4aa0 2023-12-22T08:41:18.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.924+0000 7f136554e640 1 -- 172.21.15.38:0/4212234565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1360061910 con 0x7f13601f4aa0 2023-12-22T08:41:18.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.925+0000 7f13477fe640 1 -- 172.21.15.38:0/4212234565 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f135800aa90 con 0x7f13601f4aa0 2023-12-22T08:41:18.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.926+0000 7f13477fe640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f134c06a430 0x7f134c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.926+0000 7f13477fe640 1 -- 172.21.15.38:0/4212234565 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1358088800 con 0x7f13601f4aa0 2023-12-22T08:41:18.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.927+0000 7f135effd640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f134c06a430 0x7f134c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.928+0000 7f135effd640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f134c06a430 0x7f134c06c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1350036000 tx=0x7f135003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:18.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:18.931+0000 7f13477fe640 1 -- 172.21.15.38:0/4212234565 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1358053d50 con 0x7f13601f4aa0 2023-12-22T08:41:19.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.122+0000 7f136554e640 1 -- 172.21.15.38:0/4212234565 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13600ce8b0 con 0x7f134c06a430 2023-12-22T08:41:19.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.145+0000 7f13477fe640 1 -- 172.21.15.38:0/4212234565 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278729 (secure 0 0 0) 0x7f1350030bb0 con 0x7f134c06a430 2023-12-22T08:41:19.151 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:19.153 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:41:19.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.151+0000 7f136554e640 1 -- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f134c06a430 msgr2=0x7f134c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.151+0000 7f136554e640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f134c06a430 0x7f134c06c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1350036000 tx=0x7f135003b040 comp rx=0 tx=0).stop 2023-12-22T08:41:19.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.151+0000 7f136554e640 1 -- 172.21.15.38:0/4212234565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13601f4aa0 msgr2=0x7f136013aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.151+0000 7f136554e640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13601f4aa0 0x7f136013aa00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f135800c7a0 tx=0x7f135800cc60 comp rx=0 tx=0).stop 2023-12-22T08:41:19.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.152+0000 7f136554e640 1 -- 172.21.15.38:0/4212234565 shutdown_connections 2023-12-22T08:41:19.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.152+0000 7f136554e640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f134c06a430 0x7f134c06c8f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.152+0000 7f136554e640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13601f4aa0 0x7f136013aa00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.152+0000 7f136554e640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1360144d10 0x7f13601f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.152+0000 7f136554e640 1 --2- 172.21.15.38:0/4212234565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13600b2590 0x7f136015b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.152+0000 7f136554e640 1 -- 172.21.15.38:0/4212234565 >> 172.21.15.38:0/4212234565 conn(0x7f13600cf070 msgr2=0x7f13600cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:19.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.152+0000 7f136554e640 1 -- 172.21.15.38:0/4212234565 shutdown_connections 2023-12-22T08:41:19.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.152+0000 7f136554e640 1 -- 172.21.15.38:0/4212234565 wait complete. 2023-12-22T08:41:19.177 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-12-22T08:41:18.383405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":180,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":136,"acting":136,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2263,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560236,"statfs":{"total":1600000000,"available":1597682379,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.845479"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220299+0000","last_change":"2023-12-22T08:41:14.087998+0000","last_active":"2023-12-22T08:41:15.220299+0000","last_peered":"2023-12-22T08:41:15.220299+0000","last_clean":"2023-12-22T08:41:15.220299+0000","last_became_active":"2023-12-22T08:41:14.087420+0000","last_became_peered":"2023-12-22T08:41:14.087420+0000","last_unstale":"2023-12-22T08:41:15.220299+0000","last_undegraded":"2023-12-22T08:41:15.220299+0000","last_fullsized":"2023-12-22T08:41:15.220299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:36:35.401856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219678+0000","last_change":"2023-12-22T08:41:14.099756+0000","last_active":"2023-12-22T08:41:15.219678+0000","last_peered":"2023-12-22T08:41:15.219678+0000","last_clean":"2023-12-22T08:41:15.219678+0000","last_became_active":"2023-12-22T08:41:14.099195+0000","last_became_peered":"2023-12-22T08:41:14.099195+0000","last_unstale":"2023-12-22T08:41:15.219678+0000","last_undegraded":"2023-12-22T08:41:15.219678+0000","last_fullsized":"2023-12-22T08:41:15.219678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:24.381088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080699+0000","last_change":"2023-12-22T08:41:14.089198+0000","last_active":"2023-12-22T08:41:15.080699+0000","last_peered":"2023-12-22T08:41:15.080699+0000","last_clean":"2023-12-22T08:41:15.080699+0000","last_became_active":"2023-12-22T08:41:14.088946+0000","last_became_peered":"2023-12-22T08:41:14.088946+0000","last_unstale":"2023-12-22T08:41:15.080699+0000","last_undegraded":"2023-12-22T08:41:15.080699+0000","last_fullsized":"2023-12-22T08:41:15.080699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:49.001260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.083920+0000","last_change":"2023-12-22T08:41:14.104339+0000","last_active":"2023-12-22T08:41:15.083920+0000","last_peered":"2023-12-22T08:41:15.083920+0000","last_clean":"2023-12-22T08:41:15.083920+0000","last_became_active":"2023-12-22T08:41:14.099264+0000","last_became_peered":"2023-12-22T08:41:14.099264+0000","last_unstale":"2023-12-22T08:41:15.083920+0000","last_undegraded":"2023-12-22T08:41:15.083920+0000","last_fullsized":"2023-12-22T08:41:15.083920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:29:58.437257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219819+0000","last_change":"2023-12-22T08:41:14.104174+0000","last_active":"2023-12-22T08:41:15.219819+0000","last_peered":"2023-12-22T08:41:15.219819+0000","last_clean":"2023-12-22T08:41:15.219819+0000","last_became_active":"2023-12-22T08:41:14.103253+0000","last_became_peered":"2023-12-22T08:41:14.103253+0000","last_unstale":"2023-12-22T08:41:15.219819+0000","last_undegraded":"2023-12-22T08:41:15.219819+0000","last_fullsized":"2023-12-22T08:41:15.219819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:52:53.231438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219813+0000","last_change":"2023-12-22T08:41:14.081479+0000","last_active":"2023-12-22T08:41:15.219813+0000","last_peered":"2023-12-22T08:41:15.219813+0000","last_clean":"2023-12-22T08:41:15.219813+0000","last_became_active":"2023-12-22T08:41:14.080980+0000","last_became_peered":"2023-12-22T08:41:14.080980+0000","last_unstale":"2023-12-22T08:41:15.219813+0000","last_undegraded":"2023-12-22T08:41:15.219813+0000","last_fullsized":"2023-12-22T08:41:15.219813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:50.601030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218634+0000","last_change":"2023-12-22T08:41:14.093504+0000","last_active":"2023-12-22T08:41:15.218634+0000","last_peered":"2023-12-22T08:41:15.218634+0000","last_clean":"2023-12-22T08:41:15.218634+0000","last_became_active":"2023-12-22T08:41:14.093196+0000","last_became_peered":"2023-12-22T08:41:14.093196+0000","last_unstale":"2023-12-22T08:41:15.218634+0000","last_undegraded":"2023-12-22T08:41:15.218634+0000","last_fullsized":"2023-12-22T08:41:15.218634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:37:59.695494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080552+0000","last_change":"2023-12-22T08:41:14.082409+0000","last_active":"2023-12-22T08:41:15.080552+0000","last_peered":"2023-12-22T08:41:15.080552+0000","last_clean":"2023-12-22T08:41:15.080552+0000","last_became_active":"2023-12-22T08:41:14.081886+0000","last_became_peered":"2023-12-22T08:41:14.081886+0000","last_unstale":"2023-12-22T08:41:15.080552+0000","last_undegraded":"2023-12-22T08:41:15.080552+0000","last_fullsized":"2023-12-22T08:41:15.080552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:21:20.048933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084232+0000","last_change":"2023-12-22T08:41:14.104833+0000","last_active":"2023-12-22T08:41:15.084232+0000","last_peered":"2023-12-22T08:41:15.084232+0000","last_clean":"2023-12-22T08:41:15.084232+0000","last_became_active":"2023-12-22T08:41:14.100564+0000","last_became_peered":"2023-12-22T08:41:14.100564+0000","last_unstale":"2023-12-22T08:41:15.084232+0000","last_undegraded":"2023-12-22T08:41:15.084232+0000","last_fullsized":"2023-12-22T08:41:15.084232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:35.662994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218768+0000","last_change":"2023-12-22T08:41:14.098408+0000","last_active":"2023-12-22T08:41:15.218768+0000","last_peered":"2023-12-22T08:41:15.218768+0000","last_clean":"2023-12-22T08:41:15.218768+0000","last_became_active":"2023-12-22T08:41:14.098202+0000","last_became_peered":"2023-12-22T08:41:14.098202+0000","last_unstale":"2023-12-22T08:41:15.218768+0000","last_undegraded":"2023-12-22T08:41:15.218768+0000","last_fullsized":"2023-12-22T08:41:15.218768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:40.377312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084177+0000","last_change":"2023-12-22T08:41:14.098092+0000","last_active":"2023-12-22T08:41:15.084177+0000","last_peered":"2023-12-22T08:41:15.084177+0000","last_clean":"2023-12-22T08:41:15.084177+0000","last_became_active":"2023-12-22T08:41:14.092294+0000","last_became_peered":"2023-12-22T08:41:14.092294+0000","last_unstale":"2023-12-22T08:41:15.084177+0000","last_undegraded":"2023-12-22T08:41:15.084177+0000","last_fullsized":"2023-12-22T08:41:15.084177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:22:24.029276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219910+0000","last_change":"2023-12-22T08:41:14.090355+0000","last_active":"2023-12-22T08:41:15.219910+0000","last_peered":"2023-12-22T08:41:15.219910+0000","last_clean":"2023-12-22T08:41:15.219910+0000","last_became_active":"2023-12-22T08:41:14.089908+0000","last_became_peered":"2023-12-22T08:41:14.089908+0000","last_unstale":"2023-12-22T08:41:15.219910+0000","last_undegraded":"2023-12-22T08:41:15.219910+0000","last_fullsized":"2023-12-22T08:41:15.219910+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:25:50.465640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219702+0000","last_change":"2023-12-22T08:41:14.097459+0000","last_active":"2023-12-22T08:41:15.219702+0000","last_peered":"2023-12-22T08:41:15.219702+0000","last_clean":"2023-12-22T08:41:15.219702+0000","last_became_active":"2023-12-22T08:41:14.093400+0000","last_became_peered":"2023-12-22T08:41:14.093400+0000","last_unstale":"2023-12-22T08:41:15.219702+0000","last_undegraded":"2023-12-22T08:41:15.219702+0000","last_fullsized":"2023-12-22T08:41:15.219702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:42.793364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217815+0000","last_change":"2023-12-22T08:41:14.088071+0000","last_active":"2023-12-22T08:41:15.217815+0000","last_peered":"2023-12-22T08:41:15.217815+0000","last_clean":"2023-12-22T08:41:15.217815+0000","last_became_active":"2023-12-22T08:41:14.087707+0000","last_became_peered":"2023-12-22T08:41:14.087707+0000","last_unstale":"2023-12-22T08:41:15.217815+0000","last_undegraded":"2023-12-22T08:41:15.217815+0000","last_fullsized":"2023-12-22T08:41:15.217815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219882+0000","last_change":"2023-12-22T08:41:14.076875+0000","last_active":"2023-12-22T08:41:15.219882+0000","last_peered":"2023-12-22T08:41:15.219882+0000","last_clean":"2023-12-22T08:41:15.219882+0000","last_became_active":"2023-12-22T08:41:14.076641+0000","last_became_peered":"2023-12-22T08:41:14.076641+0000","last_unstale":"2023-12-22T08:41:15.219882+0000","last_undegraded":"2023-12-22T08:41:15.219882+0000","last_fullsized":"2023-12-22T08:41:15.219882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080632+0000","last_change":"2023-12-22T08:41:14.082276+0000","last_active":"2023-12-22T08:41:15.080632+0000","last_peered":"2023-12-22T08:41:15.080632+0000","last_clean":"2023-12-22T08:41:15.080632+0000","last_became_active":"2023-12-22T08:41:14.081594+0000","last_became_peered":"2023-12-22T08:41:14.081594+0000","last_unstale":"2023-12-22T08:41:15.080632+0000","last_undegraded":"2023-12-22T08:41:15.080632+0000","last_fullsized":"2023-12-22T08:41:15.080632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:49.203160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.083113+0000","last_change":"2023-12-22T08:41:14.093264+0000","last_active":"2023-12-22T08:41:15.083113+0000","last_peered":"2023-12-22T08:41:15.083113+0000","last_clean":"2023-12-22T08:41:15.083113+0000","last_became_active":"2023-12-22T08:41:14.092862+0000","last_became_peered":"2023-12-22T08:41:14.092862+0000","last_unstale":"2023-12-22T08:41:15.083113+0000","last_undegraded":"2023-12-22T08:41:15.083113+0000","last_fullsized":"2023-12-22T08:41:15.083113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:15.989439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.098889+0000","last_change":"2023-12-22T08:41:13.584014+0000","last_active":"2023-12-22T08:41:14.098889+0000","last_peered":"2023-12-22T08:41:14.098889+0000","last_clean":"2023-12-22T08:41:14.098889+0000","last_became_active":"2023-12-22T08:41:13.583526+0000","last_became_peered":"2023-12-22T08:41:13.583526+0000","last_unstale":"2023-12-22T08:41:14.098889+0000","last_undegraded":"2023-12-22T08:41:14.098889+0000","last_fullsized":"2023-12-22T08:41:14.098889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:28.401635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.103708+0000","last_change":"2023-12-22T08:41:13.588809+0000","last_active":"2023-12-22T08:41:14.103708+0000","last_peered":"2023-12-22T08:41:14.103708+0000","last_clean":"2023-12-22T08:41:14.103708+0000","last_became_active":"2023-12-22T08:41:13.588188+0000","last_became_peered":"2023-12-22T08:41:13.588188+0000","last_unstale":"2023-12-22T08:41:14.103708+0000","last_undegraded":"2023-12-22T08:41:14.103708+0000","last_fullsized":"2023-12-22T08:41:14.103708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.549568+0000","last_change":"2023-12-22T08:41:12.549568+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.549568+0000","last_undegraded":"2023-12-22T08:41:12.549568+0000","last_fullsized":"2023-12-22T08:41:12.549568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:59:22.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220322+0000","last_change":"2023-12-22T08:41:14.099602+0000","last_active":"2023-12-22T08:41:15.220322+0000","last_peered":"2023-12-22T08:41:15.220322+0000","last_clean":"2023-12-22T08:41:15.220322+0000","last_became_active":"2023-12-22T08:41:14.098849+0000","last_became_peered":"2023-12-22T08:41:14.098849+0000","last_unstale":"2023-12-22T08:41:15.220322+0000","last_undegraded":"2023-12-22T08:41:15.220322+0000","last_fullsized":"2023-12-22T08:41:15.220322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.106506+0000","last_change":"2023-12-22T08:41:13.581861+0000","last_active":"2023-12-22T08:41:14.106506+0000","last_peered":"2023-12-22T08:41:14.106506+0000","last_clean":"2023-12-22T08:41:14.106506+0000","last_became_active":"2023-12-22T08:41:13.580825+0000","last_became_peered":"2023-12-22T08:41:13.580825+0000","last_unstale":"2023-12-22T08:41:14.106506+0000","last_undegraded":"2023-12-22T08:41:14.106506+0000","last_fullsized":"2023-12-22T08:41:14.106506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:12.338282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.542126+0000","last_change":"2023-12-22T08:41:12.542126+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.542126+0000","last_undegraded":"2023-12-22T08:41:12.542126+0000","last_fullsized":"2023-12-22T08:41:12.542126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:55.673926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.542099+0000","last_change":"2023-12-22T08:41:12.542099+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.542099+0000","last_undegraded":"2023-12-22T08:41:12.542099+0000","last_fullsized":"2023-12-22T08:41:12.542099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.547488+0000","last_change":"2023-12-22T08:41:12.547488+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.547488+0000","last_undegraded":"2023-12-22T08:41:12.547488+0000","last_fullsized":"2023-12-22T08:41:12.547488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220046+0000","last_change":"2023-12-22T08:41:14.087827+0000","last_active":"2023-12-22T08:41:15.220046+0000","last_peered":"2023-12-22T08:41:15.220046+0000","last_clean":"2023-12-22T08:41:15.220046+0000","last_became_active":"2023-12-22T08:41:14.087045+0000","last_became_peered":"2023-12-22T08:41:14.087045+0000","last_unstale":"2023-12-22T08:41:15.220046+0000","last_undegraded":"2023-12-22T08:41:15.220046+0000","last_fullsized":"2023-12-22T08:41:15.220046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:11.801978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.542848+0000","last_change":"2023-12-22T08:41:12.542848+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.542848+0000","last_undegraded":"2023-12-22T08:41:12.542848+0000","last_fullsized":"2023-12-22T08:41:12.542848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:06:57.933316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080734+0000","last_change":"2023-12-22T08:41:14.099246+0000","last_active":"2023-12-22T08:41:15.080734+0000","last_peered":"2023-12-22T08:41:15.080734+0000","last_clean":"2023-12-22T08:41:15.080734+0000","last_became_active":"2023-12-22T08:41:14.099015+0000","last_became_peered":"2023-12-22T08:41:14.099015+0000","last_unstale":"2023-12-22T08:41:15.080734+0000","last_undegraded":"2023-12-22T08:41:15.080734+0000","last_fullsized":"2023-12-22T08:41:15.080734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:37:03.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.543116+0000","last_change":"2023-12-22T08:41:12.543116+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.543116+0000","last_undegraded":"2023-12-22T08:41:12.543116+0000","last_fullsized":"2023-12-22T08:41:12.543116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:05:32.289529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219102+0000","last_change":"2023-12-22T08:41:14.101049+0000","last_active":"2023-12-22T08:41:15.219102+0000","last_peered":"2023-12-22T08:41:15.219102+0000","last_clean":"2023-12-22T08:41:15.219102+0000","last_became_active":"2023-12-22T08:41:14.100198+0000","last_became_peered":"2023-12-22T08:41:14.100198+0000","last_unstale":"2023-12-22T08:41:15.219102+0000","last_undegraded":"2023-12-22T08:41:15.219102+0000","last_fullsized":"2023-12-22T08:41:15.219102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:49:28.648602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.543149+0000","last_change":"2023-12-22T08:41:12.543149+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.543149+0000","last_undegraded":"2023-12-22T08:41:12.543149+0000","last_fullsized":"2023-12-22T08:41:12.543149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:56.873386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220681+0000","last_change":"2023-12-22T08:41:14.091150+0000","last_active":"2023-12-22T08:41:15.220681+0000","last_peered":"2023-12-22T08:41:15.220681+0000","last_clean":"2023-12-22T08:41:15.220681+0000","last_became_active":"2023-12-22T08:41:14.089208+0000","last_became_peered":"2023-12-22T08:41:14.089208+0000","last_unstale":"2023-12-22T08:41:15.220681+0000","last_undegraded":"2023-12-22T08:41:15.220681+0000","last_fullsized":"2023-12-22T08:41:15.220681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:03:04.272947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.086529+0000","last_change":"2023-12-22T08:41:13.581406+0000","last_active":"2023-12-22T08:41:14.086529+0000","last_peered":"2023-12-22T08:41:14.086529+0000","last_clean":"2023-12-22T08:41:14.086529+0000","last_became_active":"2023-12-22T08:41:13.581185+0000","last_became_peered":"2023-12-22T08:41:13.581185+0000","last_unstale":"2023-12-22T08:41:14.086529+0000","last_undegraded":"2023-12-22T08:41:14.086529+0000","last_fullsized":"2023-12-22T08:41:14.086529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:43.727970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080685+0000","last_change":"2023-12-22T08:41:14.088889+0000","last_active":"2023-12-22T08:41:15.080685+0000","last_peered":"2023-12-22T08:41:15.080685+0000","last_clean":"2023-12-22T08:41:15.080685+0000","last_became_active":"2023-12-22T08:41:14.088632+0000","last_became_peered":"2023-12-22T08:41:14.088632+0000","last_unstale":"2023-12-22T08:41:15.080685+0000","last_undegraded":"2023-12-22T08:41:15.080685+0000","last_fullsized":"2023-12-22T08:41:15.080685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:35.696117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.107527+0000","last_change":"2023-12-22T08:41:13.583907+0000","last_active":"2023-12-22T08:41:14.107527+0000","last_peered":"2023-12-22T08:41:14.107527+0000","last_clean":"2023-12-22T08:41:14.107527+0000","last_became_active":"2023-12-22T08:41:13.583541+0000","last_became_peered":"2023-12-22T08:41:13.583541+0000","last_unstale":"2023-12-22T08:41:14.107527+0000","last_undegraded":"2023-12-22T08:41:14.107527+0000","last_fullsized":"2023-12-22T08:41:14.107527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:55.673926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084469+0000","last_change":"2023-12-22T08:41:14.093509+0000","last_active":"2023-12-22T08:41:15.084469+0000","last_peered":"2023-12-22T08:41:15.084469+0000","last_clean":"2023-12-22T08:41:15.084469+0000","last_became_active":"2023-12-22T08:41:14.093237+0000","last_became_peered":"2023-12-22T08:41:14.093237+0000","last_unstale":"2023-12-22T08:41:15.084469+0000","last_undegraded":"2023-12-22T08:41:15.084469+0000","last_fullsized":"2023-12-22T08:41:15.084469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:34.649905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.541880+0000","last_change":"2023-12-22T08:41:12.541880+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.541880+0000","last_undegraded":"2023-12-22T08:41:12.541880+0000","last_fullsized":"2023-12-22T08:41:12.541880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:40:01.499763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220533+0000","last_change":"2023-12-22T08:41:14.099450+0000","last_active":"2023-12-22T08:41:15.220533+0000","last_peered":"2023-12-22T08:41:15.220533+0000","last_clean":"2023-12-22T08:41:15.220533+0000","last_became_active":"2023-12-22T08:41:14.098493+0000","last_became_peered":"2023-12-22T08:41:14.098493+0000","last_unstale":"2023-12-22T08:41:15.220533+0000","last_undegraded":"2023-12-22T08:41:15.220533+0000","last_fullsized":"2023-12-22T08:41:15.220533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.083278+0000","last_change":"2023-12-22T08:41:13.589524+0000","last_active":"2023-12-22T08:41:14.083278+0000","last_peered":"2023-12-22T08:41:14.083278+0000","last_clean":"2023-12-22T08:41:14.083278+0000","last_became_active":"2023-12-22T08:41:13.589280+0000","last_became_peered":"2023-12-22T08:41:13.589280+0000","last_unstale":"2023-12-22T08:41:14.083278+0000","last_undegraded":"2023-12-22T08:41:14.083278+0000","last_fullsized":"2023-12-22T08:41:14.083278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:15.540388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.080556+0000","last_change":"2023-12-22T08:41:13.583098+0000","last_active":"2023-12-22T08:41:14.080556+0000","last_peered":"2023-12-22T08:41:14.080556+0000","last_clean":"2023-12-22T08:41:14.080556+0000","last_became_active":"2023-12-22T08:41:13.582809+0000","last_became_peered":"2023-12-22T08:41:13.582809+0000","last_unstale":"2023-12-22T08:41:14.080556+0000","last_undegraded":"2023-12-22T08:41:14.080556+0000","last_fullsized":"2023-12-22T08:41:14.080556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:42:51.564771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080835+0000","last_change":"2023-12-22T08:41:14.082128+0000","last_active":"2023-12-22T08:41:15.080835+0000","last_peered":"2023-12-22T08:41:15.080835+0000","last_clean":"2023-12-22T08:41:15.080835+0000","last_became_active":"2023-12-22T08:41:14.081273+0000","last_became_peered":"2023-12-22T08:41:14.081273+0000","last_unstale":"2023-12-22T08:41:15.080835+0000","last_undegraded":"2023-12-22T08:41:15.080835+0000","last_fullsized":"2023-12-22T08:41:15.080835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:24.381088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.550521+0000","last_change":"2023-12-22T08:41:12.550521+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.550521+0000","last_undegraded":"2023-12-22T08:41:12.550521+0000","last_fullsized":"2023-12-22T08:41:12.550521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:11:05.047493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.081153+0000","last_change":"2023-12-22T08:41:14.095349+0000","last_active":"2023-12-22T08:41:15.081153+0000","last_peered":"2023-12-22T08:41:15.081153+0000","last_clean":"2023-12-22T08:41:15.081153+0000","last_became_active":"2023-12-22T08:41:14.094909+0000","last_became_peered":"2023-12-22T08:41:14.094909+0000","last_unstale":"2023-12-22T08:41:15.081153+0000","last_undegraded":"2023-12-22T08:41:15.081153+0000","last_fullsized":"2023-12-22T08:41:15.081153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:29.434181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.546449+0000","last_change":"2023-12-22T08:41:12.546449+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.546449+0000","last_undegraded":"2023-12-22T08:41:12.546449+0000","last_fullsized":"2023-12-22T08:41:12.546449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:36:20.680519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.540934+0000","last_change":"2023-12-22T08:41:12.540934+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.540934+0000","last_undegraded":"2023-12-22T08:41:12.540934+0000","last_fullsized":"2023-12-22T08:41:12.540934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.086429+0000","last_change":"2023-12-22T08:41:13.579166+0000","last_active":"2023-12-22T08:41:14.086429+0000","last_peered":"2023-12-22T08:41:14.086429+0000","last_clean":"2023-12-22T08:41:14.086429+0000","last_became_active":"2023-12-22T08:41:13.578664+0000","last_became_peered":"2023-12-22T08:41:13.578664+0000","last_unstale":"2023-12-22T08:41:14.086429+0000","last_undegraded":"2023-12-22T08:41:14.086429+0000","last_fullsized":"2023-12-22T08:41:14.086429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:14.972374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.070743+0000","last_change":"2023-12-22T08:41:13.584163+0000","last_active":"2023-12-22T08:41:14.070743+0000","last_peered":"2023-12-22T08:41:14.070743+0000","last_clean":"2023-12-22T08:41:14.070743+0000","last_became_active":"2023-12-22T08:41:13.583522+0000","last_became_peered":"2023-12-22T08:41:13.583522+0000","last_unstale":"2023-12-22T08:41:14.070743+0000","last_undegraded":"2023-12-22T08:41:14.070743+0000","last_fullsized":"2023-12-22T08:41:14.070743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:36:58.096521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.085500+0000","last_change":"2023-12-22T08:41:14.091567+0000","last_active":"2023-12-22T08:41:15.085500+0000","last_peered":"2023-12-22T08:41:15.085500+0000","last_clean":"2023-12-22T08:41:15.085500+0000","last_became_active":"2023-12-22T08:41:14.090447+0000","last_became_peered":"2023-12-22T08:41:14.090447+0000","last_unstale":"2023-12-22T08:41:15.085500+0000","last_undegraded":"2023-12-22T08:41:15.085500+0000","last_fullsized":"2023-12-22T08:41:15.085500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:52:26.794837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.544198+0000","last_change":"2023-12-22T08:41:12.544198+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.544198+0000","last_undegraded":"2023-12-22T08:41:12.544198+0000","last_fullsized":"2023-12-22T08:41:12.544198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:20.321086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.540934+0000","last_change":"2023-12-22T08:41:12.540934+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.540934+0000","last_undegraded":"2023-12-22T08:41:12.540934+0000","last_fullsized":"2023-12-22T08:41:12.540934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084701+0000","last_change":"2023-12-22T08:41:14.099157+0000","last_active":"2023-12-22T08:41:15.084701+0000","last_peered":"2023-12-22T08:41:15.084701+0000","last_clean":"2023-12-22T08:41:15.084701+0000","last_became_active":"2023-12-22T08:41:14.098888+0000","last_became_peered":"2023-12-22T08:41:14.098888+0000","last_unstale":"2023-12-22T08:41:15.084701+0000","last_undegraded":"2023-12-22T08:41:15.084701+0000","last_fullsized":"2023-12-22T08:41:15.084701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:50.601030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.540560+0000","last_change":"2023-12-22T08:41:12.540560+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.540560+0000","last_undegraded":"2023-12-22T08:41:12.540560+0000","last_fullsized":"2023-12-22T08:41:12.540560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:33:01.715152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.073264+0000","last_change":"2023-12-22T08:41:13.578977+0000","last_active":"2023-12-22T08:41:14.073264+0000","last_peered":"2023-12-22T08:41:14.073264+0000","last_clean":"2023-12-22T08:41:14.073264+0000","last_became_active":"2023-12-22T08:41:13.578156+0000","last_became_peered":"2023-12-22T08:41:13.578156+0000","last_unstale":"2023-12-22T08:41:14.073264+0000","last_undegraded":"2023-12-22T08:41:14.073264+0000","last_fullsized":"2023-12-22T08:41:14.073264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:22:23.012211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.100998+0000","last_change":"2023-12-22T08:41:13.579216+0000","last_active":"2023-12-22T08:41:14.100998+0000","last_peered":"2023-12-22T08:41:14.100998+0000","last_clean":"2023-12-22T08:41:14.100998+0000","last_became_active":"2023-12-22T08:41:13.578785+0000","last_became_peered":"2023-12-22T08:41:13.578785+0000","last_unstale":"2023-12-22T08:41:14.100998+0000","last_undegraded":"2023-12-22T08:41:14.100998+0000","last_fullsized":"2023-12-22T08:41:14.100998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:40:01.499763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080939+0000","last_change":"2023-12-22T08:41:14.096595+0000","last_active":"2023-12-22T08:41:15.080939+0000","last_peered":"2023-12-22T08:41:15.080939+0000","last_clean":"2023-12-22T08:41:15.080939+0000","last_became_active":"2023-12-22T08:41:14.096407+0000","last_became_peered":"2023-12-22T08:41:14.096407+0000","last_unstale":"2023-12-22T08:41:15.080939+0000","last_undegraded":"2023-12-22T08:41:15.080939+0000","last_fullsized":"2023-12-22T08:41:15.080939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:26.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.543202+0000","last_change":"2023-12-22T08:41:12.543202+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.543202+0000","last_undegraded":"2023-12-22T08:41:12.543202+0000","last_fullsized":"2023-12-22T08:41:12.543202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:29:57.420192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.088432+0000","last_change":"2023-12-22T08:41:13.588185+0000","last_active":"2023-12-22T08:41:14.088432+0000","last_peered":"2023-12-22T08:41:14.088432+0000","last_clean":"2023-12-22T08:41:14.088432+0000","last_became_active":"2023-12-22T08:41:13.586420+0000","last_became_peered":"2023-12-22T08:41:13.586420+0000","last_unstale":"2023-12-22T08:41:14.088432+0000","last_undegraded":"2023-12-22T08:41:14.088432+0000","last_fullsized":"2023-12-22T08:41:14.088432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218177+0000","last_change":"2023-12-22T08:41:14.100004+0000","last_active":"2023-12-22T08:41:15.218177+0000","last_peered":"2023-12-22T08:41:15.218177+0000","last_clean":"2023-12-22T08:41:15.218177+0000","last_became_active":"2023-12-22T08:41:14.099784+0000","last_became_peered":"2023-12-22T08:41:14.099784+0000","last_unstale":"2023-12-22T08:41:15.218177+0000","last_undegraded":"2023-12-22T08:41:15.218177+0000","last_fullsized":"2023-12-22T08:41:15.218177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:44.745035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.087240+0000","last_change":"2023-12-22T08:41:13.579677+0000","last_active":"2023-12-22T08:41:14.087240+0000","last_peered":"2023-12-22T08:41:14.087240+0000","last_clean":"2023-12-22T08:41:14.087240+0000","last_became_active":"2023-12-22T08:41:13.579158+0000","last_became_peered":"2023-12-22T08:41:13.579158+0000","last_unstale":"2023-12-22T08:41:14.087240+0000","last_undegraded":"2023-12-22T08:41:14.087240+0000","last_fullsized":"2023-12-22T08:41:14.087240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219340+0000","last_change":"2023-12-22T08:41:14.100463+0000","last_active":"2023-12-22T08:41:15.219340+0000","last_peered":"2023-12-22T08:41:15.219340+0000","last_clean":"2023-12-22T08:41:15.219340+0000","last_became_active":"2023-12-22T08:41:14.099886+0000","last_became_peered":"2023-12-22T08:41:14.099886+0000","last_unstale":"2023-12-22T08:41:15.219340+0000","last_undegraded":"2023-12-22T08:41:15.219340+0000","last_fullsized":"2023-12-22T08:41:15.219340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:56.112979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.092134+0000","last_change":"2023-12-22T08:41:13.585376+0000","last_active":"2023-12-22T08:41:14.092134+0000","last_peered":"2023-12-22T08:41:14.092134+0000","last_clean":"2023-12-22T08:41:14.092134+0000","last_became_active":"2023-12-22T08:41:13.585049+0000","last_became_peered":"2023-12-22T08:41:13.585049+0000","last_unstale":"2023-12-22T08:41:14.092134+0000","last_undegraded":"2023-12-22T08:41:14.092134+0000","last_fullsized":"2023-12-22T08:41:14.092134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220519+0000","last_change":"2023-12-22T08:41:14.089434+0000","last_active":"2023-12-22T08:41:15.220519+0000","last_peered":"2023-12-22T08:41:15.220519+0000","last_clean":"2023-12-22T08:41:15.220519+0000","last_became_active":"2023-12-22T08:41:14.088912+0000","last_became_peered":"2023-12-22T08:41:14.088912+0000","last_unstale":"2023-12-22T08:41:15.220519+0000","last_undegraded":"2023-12-22T08:41:15.220519+0000","last_fullsized":"2023-12-22T08:41:15.220519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:36.121680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.540762+0000","last_change":"2023-12-22T08:41:12.540762+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.540762+0000","last_undegraded":"2023-12-22T08:41:12.540762+0000","last_fullsized":"2023-12-22T08:41:12.540762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:59:22.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080914+0000","last_change":"2023-12-22T08:41:14.096153+0000","last_active":"2023-12-22T08:41:15.080914+0000","last_peered":"2023-12-22T08:41:15.080914+0000","last_clean":"2023-12-22T08:41:15.080914+0000","last_became_active":"2023-12-22T08:41:14.095780+0000","last_became_peered":"2023-12-22T08:41:14.095780+0000","last_unstale":"2023-12-22T08:41:15.080914+0000","last_undegraded":"2023-12-22T08:41:15.080914+0000","last_fullsized":"2023-12-22T08:41:15.080914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:35.878406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.085353+0000","last_change":"2023-12-22T08:41:13.588613+0000","last_active":"2023-12-22T08:41:14.085353+0000","last_peered":"2023-12-22T08:41:14.085353+0000","last_clean":"2023-12-22T08:41:14.085353+0000","last_became_active":"2023-12-22T08:41:13.587854+0000","last_became_peered":"2023-12-22T08:41:13.587854+0000","last_unstale":"2023-12-22T08:41:14.085353+0000","last_undegraded":"2023-12-22T08:41:14.085353+0000","last_fullsized":"2023-12-22T08:41:14.085353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219952+0000","last_change":"2023-12-22T08:41:14.099842+0000","last_active":"2023-12-22T08:41:15.219952+0000","last_peered":"2023-12-22T08:41:15.219952+0000","last_clean":"2023-12-22T08:41:15.219952+0000","last_became_active":"2023-12-22T08:41:14.099597+0000","last_became_peered":"2023-12-22T08:41:14.099597+0000","last_unstale":"2023-12-22T08:41:15.219952+0000","last_undegraded":"2023-12-22T08:41:15.219952+0000","last_fullsized":"2023-12-22T08:41:15.219952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:15.989439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.073490+0000","last_change":"2023-12-22T08:41:13.584466+0000","last_active":"2023-12-22T08:41:14.073490+0000","last_peered":"2023-12-22T08:41:14.073490+0000","last_clean":"2023-12-22T08:41:14.073490+0000","last_became_active":"2023-12-22T08:41:13.583979+0000","last_became_peered":"2023-12-22T08:41:13.583979+0000","last_unstale":"2023-12-22T08:41:14.073490+0000","last_undegraded":"2023-12-22T08:41:14.073490+0000","last_fullsized":"2023-12-22T08:41:14.073490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:49.583965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:07.198878+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:41:07.198878+0000","last_peered":"2023-12-22T08:41:07.198878+0000","last_clean":"2023-12-22T08:41:07.198878+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:41:07.198878+0000","last_undegraded":"2023-12-22T08:41:07.198878+0000","last_fullsized":"2023-12-22T08:41:07.198878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195183,"statfs":{"total":200000000,"available":199867939,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.21}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.355}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.3799999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1459999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.96999999999999997}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.4670000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":149,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847025,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.0489999999999999,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.84799999999999998}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.96599999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.083},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.02}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.1799999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.1180000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":704,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199278590,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.1659999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.79,"5min":2.79,"15min":2.79},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.98999999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.88200000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.107},{"interface":"front","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.73299999999999998}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2030000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.3149999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.498},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":4.7249999999999996,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":1.2649999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":149,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847003,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.89800000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.008},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.153}]},{"osd":2,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.1160000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.2290000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.2829999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.0740000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.375},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.409}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847813,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.008},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.77700000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.069},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1639999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.492}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.121},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.371}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.294}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.401},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.55}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195183,"statfs":{"total":200000000,"available":199867939,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":1.4319999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.92200000000000004}]},{"osd":1,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.05}]},{"osd":3,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.095},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.7649999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.667},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":5.4560000000000004,"5min":5.4560000000000004,"15min":5.4560000000000004},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":1.696}]},{"osd":6,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.873}]},{"osd":7,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.375},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.5880000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199277571,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.748},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.018}]},{"osd":5,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.0569999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.96399999999999997}]},{"osd":7,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.091},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":3.2959999999999998,"5min":3.2959999999999998,"15min":3.2959999999999998},"last":0.79500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195164,"statfs":{"total":200000000,"available":199848499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.127},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.0009999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.089},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.294}]},{"osd":7,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.105},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.177}]}]}],"pool_statfs":[]}} 2023-12-22T08:41:19.182 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:41:19.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.450+0000 7f8f0ad15640 1 Processor -- start 2023-12-22T08:41:19.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.450+0000 7f8f0ad15640 1 -- start start 2023-12-22T08:41:19.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.452+0000 7f8f0ad15640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8f0406d210 0x7f8f0415e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.452+0000 7f8f0ad15640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f040706d0 con 0x7f8f0406d5f0 2023-12-22T08:41:19.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.452+0000 7f8f0ad15640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f040cbf40 con 0x7f8f040cb4c0 2023-12-22T08:41:19.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.452+0000 7f8f0ad15640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f040ce840 con 0x7f8f0406d210 2023-12-22T08:41:19.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.452+0000 7f8f0a514640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8f0406d5f0 0x7f8f04070b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58690/0 (socket says 172.21.15.38:58690) 2023-12-22T08:41:19.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.452+0000 7f8f0a514640 1 -- 172.21.15.38:0/2109475271 learned_addr learned my addr 172.21.15.38:0/2109475271 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:19.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.452+0000 7f8f09d13640 1 --2- 172.21.15.38:0/2109475271 >> v2:172.21.15.38:3300/0 conn(0x7f8f0406d210 0x7f8f0415e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.453+0000 7f8f09d13640 1 -- 172.21.15.38:0/2109475271 >> v1:172.21.15.89:6789/0 conn(0x7f8f040cb4c0 legacy=0x7f8f04159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:19.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.453+0000 7f8f09d13640 1 -- 172.21.15.38:0/2109475271 >> v1:172.21.15.38:6789/0 conn(0x7f8f0406d5f0 legacy=0x7f8f04070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.453+0000 7f8f09d13640 1 -- 172.21.15.38:0/2109475271 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f040ceb20 con 0x7f8f0406d210 2023-12-22T08:41:19.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.453+0000 7f8f08d11640 1 -- 172.21.15.38:0/2109475271 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502005430 0 0) 0x7f8f040706d0 con 0x7f8f0406d5f0 2023-12-22T08:41:19.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.454+0000 7f8f09d13640 1 --2- 172.21.15.38:0/2109475271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f0406d210 0x7f8f0415e830 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8f000097a0 tx=0x7f8f0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7c7fb82f596b51 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:19.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.454+0000 7f8f08d11640 1 -- 172.21.15.38:0/2109475271 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00031830 con 0x7f8f0406d210 2023-12-22T08:41:19.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.454+0000 7f8f08d11640 1 -- 172.21.15.38:0/2109475271 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f00031990 con 0x7f8f0406d210 2023-12-22T08:41:19.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.454+0000 7f8f08d11640 1 -- 172.21.15.38:0/2109475271 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00031d20 con 0x7f8f0406d210 2023-12-22T08:41:19.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.455+0000 7f8f0ad15640 1 -- 172.21.15.38:0/2109475271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f0406d210 msgr2=0x7f8f0415e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.455+0000 7f8f0ad15640 1 --2- 172.21.15.38:0/2109475271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f0406d210 0x7f8f0415e830 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8f000097a0 tx=0x7f8f0002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.455+0000 7f8f0ad15640 1 -- 172.21.15.38:0/2109475271 shutdown_connections 2023-12-22T08:41:19.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.455+0000 7f8f0ad15640 1 --2- 172.21.15.38:0/2109475271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f0406d210 0x7f8f0415e830 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.455+0000 7f8f0ad15640 1 -- 172.21.15.38:0/2109475271 >> 172.21.15.38:0/2109475271 conn(0x7f8f040b1f70 msgr2=0x7f8f040b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:19.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.455+0000 7f8f0ad15640 1 -- 172.21.15.38:0/2109475271 shutdown_connections 2023-12-22T08:41:19.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.455+0000 7f8f0ad15640 1 -- 172.21.15.38:0/2109475271 wait complete. 2023-12-22T08:41:19.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.457+0000 7f8f0ad15640 1 Processor -- start 2023-12-22T08:41:19.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.457+0000 7f8f0ad15640 1 -- start start 2023-12-22T08:41:19.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f0ad15640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f0406d210 0x7f8f0409de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f0ad15640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f0406d5f0 0x7f8f04155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f0ad15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040cb4c0 0x7f8f0409f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f0ad15640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f04155990 con 0x7f8f0406d5f0 2023-12-22T08:41:19.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f0ad15640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0409ed40 con 0x7f8f040cb4c0 2023-12-22T08:41:19.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f0ad15640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0409e4a0 con 0x7f8f0406d210 2023-12-22T08:41:19.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f09512640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f0406d5f0 0x7f8f04155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f09512640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f0406d5f0 0x7f8f04155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56296/0 (socket says 172.21.15.38:56296) 2023-12-22T08:41:19.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f09512640 1 -- 172.21.15.38:0/585786520 learned_addr learned my addr 172.21.15.38:0/585786520 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:19.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f09512640 1 -- 172.21.15.38:0/585786520 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f0406d210 msgr2=0x7f8f0409de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f09512640 1 --2- 172.21.15.38:0/585786520 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f0406d210 0x7f8f0409de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f09512640 1 -- 172.21.15.38:0/585786520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040cb4c0 msgr2=0x7f8f0409f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f09512640 1 --2- 172.21.15.38:0/585786520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040cb4c0 0x7f8f0409f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.458+0000 7f8f09512640 1 -- 172.21.15.38:0/585786520 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00009400 con 0x7f8f0406d5f0 2023-12-22T08:41:19.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.459+0000 7f8f09512640 1 --2- 172.21.15.38:0/585786520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f0406d5f0 0x7f8f04155450 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400b3f0 tx=0x7f8ef400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:19.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.459+0000 7f8efa7fc640 1 -- 172.21.15.38:0/585786520 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4011830 con 0x7f8f0406d5f0 2023-12-22T08:41:19.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.459+0000 7f8efa7fc640 1 -- 172.21.15.38:0/585786520 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef4011990 con 0x7f8f0406d5f0 2023-12-22T08:41:19.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.459+0000 7f8efa7fc640 1 -- 172.21.15.38:0/585786520 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4011d40 con 0x7f8f0406d5f0 2023-12-22T08:41:19.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.459+0000 7f8f0ad15640 1 -- 172.21.15.38:0/585786520 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0409e780 con 0x7f8f0406d5f0 2023-12-22T08:41:19.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.459+0000 7f8f0ad15640 1 -- 172.21.15.38:0/585786520 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f041f2cf0 con 0x7f8f0406d5f0 2023-12-22T08:41:19.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.460+0000 7f8f0ad15640 1 -- 172.21.15.38:0/585786520 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f041f2f10 con 0x7f8f0406d5f0 2023-12-22T08:41:19.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.462+0000 7f8efa7fc640 1 -- 172.21.15.38:0/585786520 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8ef401a400 con 0x7f8f0406d5f0 2023-12-22T08:41:19.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.462+0000 7f8efa7fc640 1 --2- 172.21.15.38:0/585786520 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8ee806a430 0x7f8ee806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.463+0000 7f8efa7fc640 1 -- 172.21.15.38:0/585786520 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ef40888c0 con 0x7f8f0406d5f0 2023-12-22T08:41:19.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.463+0000 7f8f09d13640 1 --2- 172.21.15.38:0/585786520 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8ee806a430 0x7f8ee806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.465+0000 7f8f09d13640 1 --2- 172.21.15.38:0/585786520 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8ee806a430 0x7f8ee806c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8f00036000 tx=0x7f8f00030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:19.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.467+0000 7f8efa7fc640 1 -- 172.21.15.38:0/585786520 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8ef4053e10 con 0x7f8f0406d5f0 2023-12-22T08:41:19.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.657+0000 7f8f0ad15640 1 -- 172.21.15.38:0/585786520 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8f04070360 con 0x7f8ee806a430 2023-12-22T08:41:19.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.680+0000 7f8efa7fc640 1 -- 172.21.15.38:0/585786520 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278729 (secure 0 0 0) 0x7f8f00031b80 con 0x7f8ee806a430 2023-12-22T08:41:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:41:19.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.687+0000 7f8f0ad15640 1 -- 172.21.15.38:0/585786520 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8ee806a430 msgr2=0x7f8ee806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.687+0000 7f8f0ad15640 1 --2- 172.21.15.38:0/585786520 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8ee806a430 0x7f8ee806c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8f00036000 tx=0x7f8f00030000 comp rx=0 tx=0).stop 2023-12-22T08:41:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.687+0000 7f8f0ad15640 1 -- 172.21.15.38:0/585786520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f0406d5f0 msgr2=0x7f8f04155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.687+0000 7f8f0ad15640 1 --2- 172.21.15.38:0/585786520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f0406d5f0 0x7f8f04155450 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400b3f0 tx=0x7f8ef400b8b0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.687+0000 7f8f0ad15640 1 -- 172.21.15.38:0/585786520 shutdown_connections 2023-12-22T08:41:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.687+0000 7f8f0ad15640 1 --2- 172.21.15.38:0/585786520 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f040cb4c0 0x7f8f0409f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.687+0000 7f8f0ad15640 1 --2- 172.21.15.38:0/585786520 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8ee806a430 0x7f8ee806c8f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.687+0000 7f8f0ad15640 1 --2- 172.21.15.38:0/585786520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f0406d5f0 0x7f8f04155450 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.687+0000 7f8f0ad15640 1 --2- 172.21.15.38:0/585786520 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f0406d210 0x7f8f0409de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.687+0000 7f8f0ad15640 1 -- 172.21.15.38:0/585786520 >> 172.21.15.38:0/585786520 conn(0x7f8f040b1f70 msgr2=0x7f8f040a18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.688+0000 7f8f0ad15640 1 -- 172.21.15.38:0/585786520 shutdown_connections 2023-12-22T08:41:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.688+0000 7f8f0ad15640 1 -- 172.21.15.38:0/585786520 wait complete. 2023-12-22T08:41:19.711 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-12-22T08:41:18.383405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":180,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":136,"acting":136,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2263,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560236,"statfs":{"total":1600000000,"available":1597682379,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.845479"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220299+0000","last_change":"2023-12-22T08:41:14.087998+0000","last_active":"2023-12-22T08:41:15.220299+0000","last_peered":"2023-12-22T08:41:15.220299+0000","last_clean":"2023-12-22T08:41:15.220299+0000","last_became_active":"2023-12-22T08:41:14.087420+0000","last_became_peered":"2023-12-22T08:41:14.087420+0000","last_unstale":"2023-12-22T08:41:15.220299+0000","last_undegraded":"2023-12-22T08:41:15.220299+0000","last_fullsized":"2023-12-22T08:41:15.220299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:36:35.401856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219678+0000","last_change":"2023-12-22T08:41:14.099756+0000","last_active":"2023-12-22T08:41:15.219678+0000","last_peered":"2023-12-22T08:41:15.219678+0000","last_clean":"2023-12-22T08:41:15.219678+0000","last_became_active":"2023-12-22T08:41:14.099195+0000","last_became_peered":"2023-12-22T08:41:14.099195+0000","last_unstale":"2023-12-22T08:41:15.219678+0000","last_undegraded":"2023-12-22T08:41:15.219678+0000","last_fullsized":"2023-12-22T08:41:15.219678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:24.381088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080699+0000","last_change":"2023-12-22T08:41:14.089198+0000","last_active":"2023-12-22T08:41:15.080699+0000","last_peered":"2023-12-22T08:41:15.080699+0000","last_clean":"2023-12-22T08:41:15.080699+0000","last_became_active":"2023-12-22T08:41:14.088946+0000","last_became_peered":"2023-12-22T08:41:14.088946+0000","last_unstale":"2023-12-22T08:41:15.080699+0000","last_undegraded":"2023-12-22T08:41:15.080699+0000","last_fullsized":"2023-12-22T08:41:15.080699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:49.001260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.083920+0000","last_change":"2023-12-22T08:41:14.104339+0000","last_active":"2023-12-22T08:41:15.083920+0000","last_peered":"2023-12-22T08:41:15.083920+0000","last_clean":"2023-12-22T08:41:15.083920+0000","last_became_active":"2023-12-22T08:41:14.099264+0000","last_became_peered":"2023-12-22T08:41:14.099264+0000","last_unstale":"2023-12-22T08:41:15.083920+0000","last_undegraded":"2023-12-22T08:41:15.083920+0000","last_fullsized":"2023-12-22T08:41:15.083920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:29:58.437257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219819+0000","last_change":"2023-12-22T08:41:14.104174+0000","last_active":"2023-12-22T08:41:15.219819+0000","last_peered":"2023-12-22T08:41:15.219819+0000","last_clean":"2023-12-22T08:41:15.219819+0000","last_became_active":"2023-12-22T08:41:14.103253+0000","last_became_peered":"2023-12-22T08:41:14.103253+0000","last_unstale":"2023-12-22T08:41:15.219819+0000","last_undegraded":"2023-12-22T08:41:15.219819+0000","last_fullsized":"2023-12-22T08:41:15.219819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:52:53.231438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219813+0000","last_change":"2023-12-22T08:41:14.081479+0000","last_active":"2023-12-22T08:41:15.219813+0000","last_peered":"2023-12-22T08:41:15.219813+0000","last_clean":"2023-12-22T08:41:15.219813+0000","last_became_active":"2023-12-22T08:41:14.080980+0000","last_became_peered":"2023-12-22T08:41:14.080980+0000","last_unstale":"2023-12-22T08:41:15.219813+0000","last_undegraded":"2023-12-22T08:41:15.219813+0000","last_fullsized":"2023-12-22T08:41:15.219813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:50.601030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218634+0000","last_change":"2023-12-22T08:41:14.093504+0000","last_active":"2023-12-22T08:41:15.218634+0000","last_peered":"2023-12-22T08:41:15.218634+0000","last_clean":"2023-12-22T08:41:15.218634+0000","last_became_active":"2023-12-22T08:41:14.093196+0000","last_became_peered":"2023-12-22T08:41:14.093196+0000","last_unstale":"2023-12-22T08:41:15.218634+0000","last_undegraded":"2023-12-22T08:41:15.218634+0000","last_fullsized":"2023-12-22T08:41:15.218634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:37:59.695494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080552+0000","last_change":"2023-12-22T08:41:14.082409+0000","last_active":"2023-12-22T08:41:15.080552+0000","last_peered":"2023-12-22T08:41:15.080552+0000","last_clean":"2023-12-22T08:41:15.080552+0000","last_became_active":"2023-12-22T08:41:14.081886+0000","last_became_peered":"2023-12-22T08:41:14.081886+0000","last_unstale":"2023-12-22T08:41:15.080552+0000","last_undegraded":"2023-12-22T08:41:15.080552+0000","last_fullsized":"2023-12-22T08:41:15.080552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:21:20.048933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084232+0000","last_change":"2023-12-22T08:41:14.104833+0000","last_active":"2023-12-22T08:41:15.084232+0000","last_peered":"2023-12-22T08:41:15.084232+0000","last_clean":"2023-12-22T08:41:15.084232+0000","last_became_active":"2023-12-22T08:41:14.100564+0000","last_became_peered":"2023-12-22T08:41:14.100564+0000","last_unstale":"2023-12-22T08:41:15.084232+0000","last_undegraded":"2023-12-22T08:41:15.084232+0000","last_fullsized":"2023-12-22T08:41:15.084232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:35.662994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218768+0000","last_change":"2023-12-22T08:41:14.098408+0000","last_active":"2023-12-22T08:41:15.218768+0000","last_peered":"2023-12-22T08:41:15.218768+0000","last_clean":"2023-12-22T08:41:15.218768+0000","last_became_active":"2023-12-22T08:41:14.098202+0000","last_became_peered":"2023-12-22T08:41:14.098202+0000","last_unstale":"2023-12-22T08:41:15.218768+0000","last_undegraded":"2023-12-22T08:41:15.218768+0000","last_fullsized":"2023-12-22T08:41:15.218768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:40.377312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084177+0000","last_change":"2023-12-22T08:41:14.098092+0000","last_active":"2023-12-22T08:41:15.084177+0000","last_peered":"2023-12-22T08:41:15.084177+0000","last_clean":"2023-12-22T08:41:15.084177+0000","last_became_active":"2023-12-22T08:41:14.092294+0000","last_became_peered":"2023-12-22T08:41:14.092294+0000","last_unstale":"2023-12-22T08:41:15.084177+0000","last_undegraded":"2023-12-22T08:41:15.084177+0000","last_fullsized":"2023-12-22T08:41:15.084177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:22:24.029276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219910+0000","last_change":"2023-12-22T08:41:14.090355+0000","last_active":"2023-12-22T08:41:15.219910+0000","last_peered":"2023-12-22T08:41:15.219910+0000","last_clean":"2023-12-22T08:41:15.219910+0000","last_became_active":"2023-12-22T08:41:14.089908+0000","last_became_peered":"2023-12-22T08:41:14.089908+0000","last_unstale":"2023-12-22T08:41:15.219910+0000","last_undegraded":"2023-12-22T08:41:15.219910+0000","last_fullsized":"2023-12-22T08:41:15.219910+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:25:50.465640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219702+0000","last_change":"2023-12-22T08:41:14.097459+0000","last_active":"2023-12-22T08:41:15.219702+0000","last_peered":"2023-12-22T08:41:15.219702+0000","last_clean":"2023-12-22T08:41:15.219702+0000","last_became_active":"2023-12-22T08:41:14.093400+0000","last_became_peered":"2023-12-22T08:41:14.093400+0000","last_unstale":"2023-12-22T08:41:15.219702+0000","last_undegraded":"2023-12-22T08:41:15.219702+0000","last_fullsized":"2023-12-22T08:41:15.219702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:42.793364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217815+0000","last_change":"2023-12-22T08:41:14.088071+0000","last_active":"2023-12-22T08:41:15.217815+0000","last_peered":"2023-12-22T08:41:15.217815+0000","last_clean":"2023-12-22T08:41:15.217815+0000","last_became_active":"2023-12-22T08:41:14.087707+0000","last_became_peered":"2023-12-22T08:41:14.087707+0000","last_unstale":"2023-12-22T08:41:15.217815+0000","last_undegraded":"2023-12-22T08:41:15.217815+0000","last_fullsized":"2023-12-22T08:41:15.217815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219882+0000","last_change":"2023-12-22T08:41:14.076875+0000","last_active":"2023-12-22T08:41:15.219882+0000","last_peered":"2023-12-22T08:41:15.219882+0000","last_clean":"2023-12-22T08:41:15.219882+0000","last_became_active":"2023-12-22T08:41:14.076641+0000","last_became_peered":"2023-12-22T08:41:14.076641+0000","last_unstale":"2023-12-22T08:41:15.219882+0000","last_undegraded":"2023-12-22T08:41:15.219882+0000","last_fullsized":"2023-12-22T08:41:15.219882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080632+0000","last_change":"2023-12-22T08:41:14.082276+0000","last_active":"2023-12-22T08:41:15.080632+0000","last_peered":"2023-12-22T08:41:15.080632+0000","last_clean":"2023-12-22T08:41:15.080632+0000","last_became_active":"2023-12-22T08:41:14.081594+0000","last_became_peered":"2023-12-22T08:41:14.081594+0000","last_unstale":"2023-12-22T08:41:15.080632+0000","last_undegraded":"2023-12-22T08:41:15.080632+0000","last_fullsized":"2023-12-22T08:41:15.080632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:49.203160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.083113+0000","last_change":"2023-12-22T08:41:14.093264+0000","last_active":"2023-12-22T08:41:15.083113+0000","last_peered":"2023-12-22T08:41:15.083113+0000","last_clean":"2023-12-22T08:41:15.083113+0000","last_became_active":"2023-12-22T08:41:14.092862+0000","last_became_peered":"2023-12-22T08:41:14.092862+0000","last_unstale":"2023-12-22T08:41:15.083113+0000","last_undegraded":"2023-12-22T08:41:15.083113+0000","last_fullsized":"2023-12-22T08:41:15.083113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:15.989439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.098889+0000","last_change":"2023-12-22T08:41:13.584014+0000","last_active":"2023-12-22T08:41:14.098889+0000","last_peered":"2023-12-22T08:41:14.098889+0000","last_clean":"2023-12-22T08:41:14.098889+0000","last_became_active":"2023-12-22T08:41:13.583526+0000","last_became_peered":"2023-12-22T08:41:13.583526+0000","last_unstale":"2023-12-22T08:41:14.098889+0000","last_undegraded":"2023-12-22T08:41:14.098889+0000","last_fullsized":"2023-12-22T08:41:14.098889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:28.401635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.103708+0000","last_change":"2023-12-22T08:41:13.588809+0000","last_active":"2023-12-22T08:41:14.103708+0000","last_peered":"2023-12-22T08:41:14.103708+0000","last_clean":"2023-12-22T08:41:14.103708+0000","last_became_active":"2023-12-22T08:41:13.588188+0000","last_became_peered":"2023-12-22T08:41:13.588188+0000","last_unstale":"2023-12-22T08:41:14.103708+0000","last_undegraded":"2023-12-22T08:41:14.103708+0000","last_fullsized":"2023-12-22T08:41:14.103708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.549568+0000","last_change":"2023-12-22T08:41:12.549568+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.549568+0000","last_undegraded":"2023-12-22T08:41:12.549568+0000","last_fullsized":"2023-12-22T08:41:12.549568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:59:22.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220322+0000","last_change":"2023-12-22T08:41:14.099602+0000","last_active":"2023-12-22T08:41:15.220322+0000","last_peered":"2023-12-22T08:41:15.220322+0000","last_clean":"2023-12-22T08:41:15.220322+0000","last_became_active":"2023-12-22T08:41:14.098849+0000","last_became_peered":"2023-12-22T08:41:14.098849+0000","last_unstale":"2023-12-22T08:41:15.220322+0000","last_undegraded":"2023-12-22T08:41:15.220322+0000","last_fullsized":"2023-12-22T08:41:15.220322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.106506+0000","last_change":"2023-12-22T08:41:13.581861+0000","last_active":"2023-12-22T08:41:14.106506+0000","last_peered":"2023-12-22T08:41:14.106506+0000","last_clean":"2023-12-22T08:41:14.106506+0000","last_became_active":"2023-12-22T08:41:13.580825+0000","last_became_peered":"2023-12-22T08:41:13.580825+0000","last_unstale":"2023-12-22T08:41:14.106506+0000","last_undegraded":"2023-12-22T08:41:14.106506+0000","last_fullsized":"2023-12-22T08:41:14.106506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:12.338282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.542126+0000","last_change":"2023-12-22T08:41:12.542126+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.542126+0000","last_undegraded":"2023-12-22T08:41:12.542126+0000","last_fullsized":"2023-12-22T08:41:12.542126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:55.673926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.542099+0000","last_change":"2023-12-22T08:41:12.542099+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.542099+0000","last_undegraded":"2023-12-22T08:41:12.542099+0000","last_fullsized":"2023-12-22T08:41:12.542099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.547488+0000","last_change":"2023-12-22T08:41:12.547488+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.547488+0000","last_undegraded":"2023-12-22T08:41:12.547488+0000","last_fullsized":"2023-12-22T08:41:12.547488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220046+0000","last_change":"2023-12-22T08:41:14.087827+0000","last_active":"2023-12-22T08:41:15.220046+0000","last_peered":"2023-12-22T08:41:15.220046+0000","last_clean":"2023-12-22T08:41:15.220046+0000","last_became_active":"2023-12-22T08:41:14.087045+0000","last_became_peered":"2023-12-22T08:41:14.087045+0000","last_unstale":"2023-12-22T08:41:15.220046+0000","last_undegraded":"2023-12-22T08:41:15.220046+0000","last_fullsized":"2023-12-22T08:41:15.220046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:11.801978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.542848+0000","last_change":"2023-12-22T08:41:12.542848+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.542848+0000","last_undegraded":"2023-12-22T08:41:12.542848+0000","last_fullsized":"2023-12-22T08:41:12.542848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:06:57.933316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080734+0000","last_change":"2023-12-22T08:41:14.099246+0000","last_active":"2023-12-22T08:41:15.080734+0000","last_peered":"2023-12-22T08:41:15.080734+0000","last_clean":"2023-12-22T08:41:15.080734+0000","last_became_active":"2023-12-22T08:41:14.099015+0000","last_became_peered":"2023-12-22T08:41:14.099015+0000","last_unstale":"2023-12-22T08:41:15.080734+0000","last_undegraded":"2023-12-22T08:41:15.080734+0000","last_fullsized":"2023-12-22T08:41:15.080734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:37:03.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.543116+0000","last_change":"2023-12-22T08:41:12.543116+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.543116+0000","last_undegraded":"2023-12-22T08:41:12.543116+0000","last_fullsized":"2023-12-22T08:41:12.543116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:05:32.289529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219102+0000","last_change":"2023-12-22T08:41:14.101049+0000","last_active":"2023-12-22T08:41:15.219102+0000","last_peered":"2023-12-22T08:41:15.219102+0000","last_clean":"2023-12-22T08:41:15.219102+0000","last_became_active":"2023-12-22T08:41:14.100198+0000","last_became_peered":"2023-12-22T08:41:14.100198+0000","last_unstale":"2023-12-22T08:41:15.219102+0000","last_undegraded":"2023-12-22T08:41:15.219102+0000","last_fullsized":"2023-12-22T08:41:15.219102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:49:28.648602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.543149+0000","last_change":"2023-12-22T08:41:12.543149+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.543149+0000","last_undegraded":"2023-12-22T08:41:12.543149+0000","last_fullsized":"2023-12-22T08:41:12.543149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:56.873386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220681+0000","last_change":"2023-12-22T08:41:14.091150+0000","last_active":"2023-12-22T08:41:15.220681+0000","last_peered":"2023-12-22T08:41:15.220681+0000","last_clean":"2023-12-22T08:41:15.220681+0000","last_became_active":"2023-12-22T08:41:14.089208+0000","last_became_peered":"2023-12-22T08:41:14.089208+0000","last_unstale":"2023-12-22T08:41:15.220681+0000","last_undegraded":"2023-12-22T08:41:15.220681+0000","last_fullsized":"2023-12-22T08:41:15.220681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:03:04.272947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.086529+0000","last_change":"2023-12-22T08:41:13.581406+0000","last_active":"2023-12-22T08:41:14.086529+0000","last_peered":"2023-12-22T08:41:14.086529+0000","last_clean":"2023-12-22T08:41:14.086529+0000","last_became_active":"2023-12-22T08:41:13.581185+0000","last_became_peered":"2023-12-22T08:41:13.581185+0000","last_unstale":"2023-12-22T08:41:14.086529+0000","last_undegraded":"2023-12-22T08:41:14.086529+0000","last_fullsized":"2023-12-22T08:41:14.086529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:43.727970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080685+0000","last_change":"2023-12-22T08:41:14.088889+0000","last_active":"2023-12-22T08:41:15.080685+0000","last_peered":"2023-12-22T08:41:15.080685+0000","last_clean":"2023-12-22T08:41:15.080685+0000","last_became_active":"2023-12-22T08:41:14.088632+0000","last_became_peered":"2023-12-22T08:41:14.088632+0000","last_unstale":"2023-12-22T08:41:15.080685+0000","last_undegraded":"2023-12-22T08:41:15.080685+0000","last_fullsized":"2023-12-22T08:41:15.080685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:35.696117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.107527+0000","last_change":"2023-12-22T08:41:13.583907+0000","last_active":"2023-12-22T08:41:14.107527+0000","last_peered":"2023-12-22T08:41:14.107527+0000","last_clean":"2023-12-22T08:41:14.107527+0000","last_became_active":"2023-12-22T08:41:13.583541+0000","last_became_peered":"2023-12-22T08:41:13.583541+0000","last_unstale":"2023-12-22T08:41:14.107527+0000","last_undegraded":"2023-12-22T08:41:14.107527+0000","last_fullsized":"2023-12-22T08:41:14.107527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:55.673926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084469+0000","last_change":"2023-12-22T08:41:14.093509+0000","last_active":"2023-12-22T08:41:15.084469+0000","last_peered":"2023-12-22T08:41:15.084469+0000","last_clean":"2023-12-22T08:41:15.084469+0000","last_became_active":"2023-12-22T08:41:14.093237+0000","last_became_peered":"2023-12-22T08:41:14.093237+0000","last_unstale":"2023-12-22T08:41:15.084469+0000","last_undegraded":"2023-12-22T08:41:15.084469+0000","last_fullsized":"2023-12-22T08:41:15.084469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:34.649905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.541880+0000","last_change":"2023-12-22T08:41:12.541880+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.541880+0000","last_undegraded":"2023-12-22T08:41:12.541880+0000","last_fullsized":"2023-12-22T08:41:12.541880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:40:01.499763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220533+0000","last_change":"2023-12-22T08:41:14.099450+0000","last_active":"2023-12-22T08:41:15.220533+0000","last_peered":"2023-12-22T08:41:15.220533+0000","last_clean":"2023-12-22T08:41:15.220533+0000","last_became_active":"2023-12-22T08:41:14.098493+0000","last_became_peered":"2023-12-22T08:41:14.098493+0000","last_unstale":"2023-12-22T08:41:15.220533+0000","last_undegraded":"2023-12-22T08:41:15.220533+0000","last_fullsized":"2023-12-22T08:41:15.220533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.083278+0000","last_change":"2023-12-22T08:41:13.589524+0000","last_active":"2023-12-22T08:41:14.083278+0000","last_peered":"2023-12-22T08:41:14.083278+0000","last_clean":"2023-12-22T08:41:14.083278+0000","last_became_active":"2023-12-22T08:41:13.589280+0000","last_became_peered":"2023-12-22T08:41:13.589280+0000","last_unstale":"2023-12-22T08:41:14.083278+0000","last_undegraded":"2023-12-22T08:41:14.083278+0000","last_fullsized":"2023-12-22T08:41:14.083278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:15.540388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.080556+0000","last_change":"2023-12-22T08:41:13.583098+0000","last_active":"2023-12-22T08:41:14.080556+0000","last_peered":"2023-12-22T08:41:14.080556+0000","last_clean":"2023-12-22T08:41:14.080556+0000","last_became_active":"2023-12-22T08:41:13.582809+0000","last_became_peered":"2023-12-22T08:41:13.582809+0000","last_unstale":"2023-12-22T08:41:14.080556+0000","last_undegraded":"2023-12-22T08:41:14.080556+0000","last_fullsized":"2023-12-22T08:41:14.080556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:42:51.564771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080835+0000","last_change":"2023-12-22T08:41:14.082128+0000","last_active":"2023-12-22T08:41:15.080835+0000","last_peered":"2023-12-22T08:41:15.080835+0000","last_clean":"2023-12-22T08:41:15.080835+0000","last_became_active":"2023-12-22T08:41:14.081273+0000","last_became_peered":"2023-12-22T08:41:14.081273+0000","last_unstale":"2023-12-22T08:41:15.080835+0000","last_undegraded":"2023-12-22T08:41:15.080835+0000","last_fullsized":"2023-12-22T08:41:15.080835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:24.381088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.550521+0000","last_change":"2023-12-22T08:41:12.550521+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.550521+0000","last_undegraded":"2023-12-22T08:41:12.550521+0000","last_fullsized":"2023-12-22T08:41:12.550521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:11:05.047493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.081153+0000","last_change":"2023-12-22T08:41:14.095349+0000","last_active":"2023-12-22T08:41:15.081153+0000","last_peered":"2023-12-22T08:41:15.081153+0000","last_clean":"2023-12-22T08:41:15.081153+0000","last_became_active":"2023-12-22T08:41:14.094909+0000","last_became_peered":"2023-12-22T08:41:14.094909+0000","last_unstale":"2023-12-22T08:41:15.081153+0000","last_undegraded":"2023-12-22T08:41:15.081153+0000","last_fullsized":"2023-12-22T08:41:15.081153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:29.434181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.546449+0000","last_change":"2023-12-22T08:41:12.546449+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.546449+0000","last_undegraded":"2023-12-22T08:41:12.546449+0000","last_fullsized":"2023-12-22T08:41:12.546449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:36:20.680519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.540934+0000","last_change":"2023-12-22T08:41:12.540934+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.540934+0000","last_undegraded":"2023-12-22T08:41:12.540934+0000","last_fullsized":"2023-12-22T08:41:12.540934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.086429+0000","last_change":"2023-12-22T08:41:13.579166+0000","last_active":"2023-12-22T08:41:14.086429+0000","last_peered":"2023-12-22T08:41:14.086429+0000","last_clean":"2023-12-22T08:41:14.086429+0000","last_became_active":"2023-12-22T08:41:13.578664+0000","last_became_peered":"2023-12-22T08:41:13.578664+0000","last_unstale":"2023-12-22T08:41:14.086429+0000","last_undegraded":"2023-12-22T08:41:14.086429+0000","last_fullsized":"2023-12-22T08:41:14.086429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:14.972374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.070743+0000","last_change":"2023-12-22T08:41:13.584163+0000","last_active":"2023-12-22T08:41:14.070743+0000","last_peered":"2023-12-22T08:41:14.070743+0000","last_clean":"2023-12-22T08:41:14.070743+0000","last_became_active":"2023-12-22T08:41:13.583522+0000","last_became_peered":"2023-12-22T08:41:13.583522+0000","last_unstale":"2023-12-22T08:41:14.070743+0000","last_undegraded":"2023-12-22T08:41:14.070743+0000","last_fullsized":"2023-12-22T08:41:14.070743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:36:58.096521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.085500+0000","last_change":"2023-12-22T08:41:14.091567+0000","last_active":"2023-12-22T08:41:15.085500+0000","last_peered":"2023-12-22T08:41:15.085500+0000","last_clean":"2023-12-22T08:41:15.085500+0000","last_became_active":"2023-12-22T08:41:14.090447+0000","last_became_peered":"2023-12-22T08:41:14.090447+0000","last_unstale":"2023-12-22T08:41:15.085500+0000","last_undegraded":"2023-12-22T08:41:15.085500+0000","last_fullsized":"2023-12-22T08:41:15.085500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:52:26.794837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.544198+0000","last_change":"2023-12-22T08:41:12.544198+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.544198+0000","last_undegraded":"2023-12-22T08:41:12.544198+0000","last_fullsized":"2023-12-22T08:41:12.544198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:20.321086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.540934+0000","last_change":"2023-12-22T08:41:12.540934+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.540934+0000","last_undegraded":"2023-12-22T08:41:12.540934+0000","last_fullsized":"2023-12-22T08:41:12.540934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084701+0000","last_change":"2023-12-22T08:41:14.099157+0000","last_active":"2023-12-22T08:41:15.084701+0000","last_peered":"2023-12-22T08:41:15.084701+0000","last_clean":"2023-12-22T08:41:15.084701+0000","last_became_active":"2023-12-22T08:41:14.098888+0000","last_became_peered":"2023-12-22T08:41:14.098888+0000","last_unstale":"2023-12-22T08:41:15.084701+0000","last_undegraded":"2023-12-22T08:41:15.084701+0000","last_fullsized":"2023-12-22T08:41:15.084701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:50.601030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.540560+0000","last_change":"2023-12-22T08:41:12.540560+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.540560+0000","last_undegraded":"2023-12-22T08:41:12.540560+0000","last_fullsized":"2023-12-22T08:41:12.540560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:33:01.715152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.073264+0000","last_change":"2023-12-22T08:41:13.578977+0000","last_active":"2023-12-22T08:41:14.073264+0000","last_peered":"2023-12-22T08:41:14.073264+0000","last_clean":"2023-12-22T08:41:14.073264+0000","last_became_active":"2023-12-22T08:41:13.578156+0000","last_became_peered":"2023-12-22T08:41:13.578156+0000","last_unstale":"2023-12-22T08:41:14.073264+0000","last_undegraded":"2023-12-22T08:41:14.073264+0000","last_fullsized":"2023-12-22T08:41:14.073264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:22:23.012211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.100998+0000","last_change":"2023-12-22T08:41:13.579216+0000","last_active":"2023-12-22T08:41:14.100998+0000","last_peered":"2023-12-22T08:41:14.100998+0000","last_clean":"2023-12-22T08:41:14.100998+0000","last_became_active":"2023-12-22T08:41:13.578785+0000","last_became_peered":"2023-12-22T08:41:13.578785+0000","last_unstale":"2023-12-22T08:41:14.100998+0000","last_undegraded":"2023-12-22T08:41:14.100998+0000","last_fullsized":"2023-12-22T08:41:14.100998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:40:01.499763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080939+0000","last_change":"2023-12-22T08:41:14.096595+0000","last_active":"2023-12-22T08:41:15.080939+0000","last_peered":"2023-12-22T08:41:15.080939+0000","last_clean":"2023-12-22T08:41:15.080939+0000","last_became_active":"2023-12-22T08:41:14.096407+0000","last_became_peered":"2023-12-22T08:41:14.096407+0000","last_unstale":"2023-12-22T08:41:15.080939+0000","last_undegraded":"2023-12-22T08:41:15.080939+0000","last_fullsized":"2023-12-22T08:41:15.080939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:26.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.543202+0000","last_change":"2023-12-22T08:41:12.543202+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.543202+0000","last_undegraded":"2023-12-22T08:41:12.543202+0000","last_fullsized":"2023-12-22T08:41:12.543202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:29:57.420192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T08:41:13.537615+0000","last_change":"2023-12-22T08:41:13.537615+0000","last_active":"2023-12-22T08:41:13.537615+0000","last_peered":"2023-12-22T08:41:13.537615+0000","last_clean":"2023-12-22T08:41:13.537615+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:13.537615+0000","last_undegraded":"2023-12-22T08:41:13.537615+0000","last_fullsized":"2023-12-22T08:41:13.537615+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.088432+0000","last_change":"2023-12-22T08:41:13.588185+0000","last_active":"2023-12-22T08:41:14.088432+0000","last_peered":"2023-12-22T08:41:14.088432+0000","last_clean":"2023-12-22T08:41:14.088432+0000","last_became_active":"2023-12-22T08:41:13.586420+0000","last_became_peered":"2023-12-22T08:41:13.586420+0000","last_unstale":"2023-12-22T08:41:14.088432+0000","last_undegraded":"2023-12-22T08:41:14.088432+0000","last_fullsized":"2023-12-22T08:41:14.088432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218177+0000","last_change":"2023-12-22T08:41:14.100004+0000","last_active":"2023-12-22T08:41:15.218177+0000","last_peered":"2023-12-22T08:41:15.218177+0000","last_clean":"2023-12-22T08:41:15.218177+0000","last_became_active":"2023-12-22T08:41:14.099784+0000","last_became_peered":"2023-12-22T08:41:14.099784+0000","last_unstale":"2023-12-22T08:41:15.218177+0000","last_undegraded":"2023-12-22T08:41:15.218177+0000","last_fullsized":"2023-12-22T08:41:15.218177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:44.745035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.087240+0000","last_change":"2023-12-22T08:41:13.579677+0000","last_active":"2023-12-22T08:41:14.087240+0000","last_peered":"2023-12-22T08:41:14.087240+0000","last_clean":"2023-12-22T08:41:14.087240+0000","last_became_active":"2023-12-22T08:41:13.579158+0000","last_became_peered":"2023-12-22T08:41:13.579158+0000","last_unstale":"2023-12-22T08:41:14.087240+0000","last_undegraded":"2023-12-22T08:41:14.087240+0000","last_fullsized":"2023-12-22T08:41:14.087240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219340+0000","last_change":"2023-12-22T08:41:14.100463+0000","last_active":"2023-12-22T08:41:15.219340+0000","last_peered":"2023-12-22T08:41:15.219340+0000","last_clean":"2023-12-22T08:41:15.219340+0000","last_became_active":"2023-12-22T08:41:14.099886+0000","last_became_peered":"2023-12-22T08:41:14.099886+0000","last_unstale":"2023-12-22T08:41:15.219340+0000","last_undegraded":"2023-12-22T08:41:15.219340+0000","last_fullsized":"2023-12-22T08:41:15.219340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:56.112979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.092134+0000","last_change":"2023-12-22T08:41:13.585376+0000","last_active":"2023-12-22T08:41:14.092134+0000","last_peered":"2023-12-22T08:41:14.092134+0000","last_clean":"2023-12-22T08:41:14.092134+0000","last_became_active":"2023-12-22T08:41:13.585049+0000","last_became_peered":"2023-12-22T08:41:13.585049+0000","last_unstale":"2023-12-22T08:41:14.092134+0000","last_undegraded":"2023-12-22T08:41:14.092134+0000","last_fullsized":"2023-12-22T08:41:14.092134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220519+0000","last_change":"2023-12-22T08:41:14.089434+0000","last_active":"2023-12-22T08:41:15.220519+0000","last_peered":"2023-12-22T08:41:15.220519+0000","last_clean":"2023-12-22T08:41:15.220519+0000","last_became_active":"2023-12-22T08:41:14.088912+0000","last_became_peered":"2023-12-22T08:41:14.088912+0000","last_unstale":"2023-12-22T08:41:15.220519+0000","last_undegraded":"2023-12-22T08:41:15.220519+0000","last_fullsized":"2023-12-22T08:41:15.220519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:36.121680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-12-22T08:41:12.540762+0000","last_change":"2023-12-22T08:41:12.540762+0000","last_active":"2023-12-22T08:41:12.520550+0000","last_peered":"2023-12-22T08:41:12.520550+0000","last_clean":"2023-12-22T08:41:12.520550+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:41:12.540762+0000","last_undegraded":"2023-12-22T08:41:12.540762+0000","last_fullsized":"2023-12-22T08:41:12.540762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:59:22.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080914+0000","last_change":"2023-12-22T08:41:14.096153+0000","last_active":"2023-12-22T08:41:15.080914+0000","last_peered":"2023-12-22T08:41:15.080914+0000","last_clean":"2023-12-22T08:41:15.080914+0000","last_became_active":"2023-12-22T08:41:14.095780+0000","last_became_peered":"2023-12-22T08:41:14.095780+0000","last_unstale":"2023-12-22T08:41:15.080914+0000","last_undegraded":"2023-12-22T08:41:15.080914+0000","last_fullsized":"2023-12-22T08:41:15.080914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:35.878406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.085353+0000","last_change":"2023-12-22T08:41:13.588613+0000","last_active":"2023-12-22T08:41:14.085353+0000","last_peered":"2023-12-22T08:41:14.085353+0000","last_clean":"2023-12-22T08:41:14.085353+0000","last_became_active":"2023-12-22T08:41:13.587854+0000","last_became_peered":"2023-12-22T08:41:13.587854+0000","last_unstale":"2023-12-22T08:41:14.085353+0000","last_undegraded":"2023-12-22T08:41:14.085353+0000","last_fullsized":"2023-12-22T08:41:14.085353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219952+0000","last_change":"2023-12-22T08:41:14.099842+0000","last_active":"2023-12-22T08:41:15.219952+0000","last_peered":"2023-12-22T08:41:15.219952+0000","last_clean":"2023-12-22T08:41:15.219952+0000","last_became_active":"2023-12-22T08:41:14.099597+0000","last_became_peered":"2023-12-22T08:41:14.099597+0000","last_unstale":"2023-12-22T08:41:15.219952+0000","last_undegraded":"2023-12-22T08:41:15.219952+0000","last_fullsized":"2023-12-22T08:41:15.219952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:15.989439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.073490+0000","last_change":"2023-12-22T08:41:13.584466+0000","last_active":"2023-12-22T08:41:14.073490+0000","last_peered":"2023-12-22T08:41:14.073490+0000","last_clean":"2023-12-22T08:41:14.073490+0000","last_became_active":"2023-12-22T08:41:13.583979+0000","last_became_peered":"2023-12-22T08:41:13.583979+0000","last_unstale":"2023-12-22T08:41:14.073490+0000","last_undegraded":"2023-12-22T08:41:14.073490+0000","last_fullsized":"2023-12-22T08:41:14.073490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:49.583965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:07.198878+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:41:07.198878+0000","last_peered":"2023-12-22T08:41:07.198878+0000","last_clean":"2023-12-22T08:41:07.198878+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:41:07.198878+0000","last_undegraded":"2023-12-22T08:41:07.198878+0000","last_fullsized":"2023-12-22T08:41:07.198878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195183,"statfs":{"total":200000000,"available":199867939,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.21}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.355}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.3799999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1459999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.96999999999999997}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.4670000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":149,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847025,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.0489999999999999,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.84799999999999998}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.96599999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.083},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.02}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.1799999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.1180000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":704,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199278590,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.1659999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.79,"5min":2.79,"15min":2.79},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.98999999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.88200000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.107},{"interface":"front","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.73299999999999998}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.2030000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.3149999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.498},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":4.7249999999999996,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":1.2649999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":149,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847003,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.89800000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.008},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.153}]},{"osd":2,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.1160000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.2290000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.2829999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.0740000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.375},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.409}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847813,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.008},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.77700000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.069},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1639999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.492}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.121},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.371}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.294}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.401},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.55}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195183,"statfs":{"total":200000000,"available":199867939,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":1.4319999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.92200000000000004}]},{"osd":1,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.05}]},{"osd":3,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.095},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.7649999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.667},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":5.4560000000000004,"5min":5.4560000000000004,"15min":5.4560000000000004},"last":1.0309999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":1.696}]},{"osd":6,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.873}]},{"osd":7,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.375},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.5880000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199277571,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.748},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.018}]},{"osd":5,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.0569999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.96399999999999997}]},{"osd":7,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.091},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":3.2959999999999998,"5min":3.2959999999999998,"15min":3.2959999999999998},"last":0.79500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195164,"statfs":{"total":200000000,"available":199848499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.127},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.0009999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.089},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.294}]},{"osd":7,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.105},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.177}]}]}],"pool_statfs":[]}} 2023-12-22T08:41:19.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-12-22T08:41:19.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-12-22T08:41:19.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-12-22T08:41:19.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-12-22T08:41:19.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-12-22T08:41:19.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-12-22T08:41:19.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-12-22T08:41:19.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-12-22T08:41:19.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-12-22T08:41:19.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-12-22T08:41:19.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-12-22T08:41:19.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-12-22T08:41:19.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-12-22T08:41:19.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-12-22T08:41:19.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-12-22T08:41:19.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-12-22T08:41:19.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-12-22T08:41:19.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-12-22T08:41:19.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-12-22T08:41:19.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.549568+0000', 'last_change': '2023-12-22T08:41:12.549568+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.549568+0000', 'last_undegraded': '2023-12-22T08:41:12.549568+0000', 'last_fullsized': '2023-12-22T08:41:12.549568+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T12:59:22.958625+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-22T08:41:19.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-12-22T08:41:19.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-12-22T08:41:19.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.542126+0000', 'last_change': '2023-12-22T08:41:12.542126+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.542126+0000', 'last_undegraded': '2023-12-22T08:41:12.542126+0000', 'last_fullsized': '2023-12-22T08:41:12.542126+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T09:21:55.673926+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-22T08:41:19.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-12-22T08:41:19.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-12-22T08:41:19.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.542099+0000', 'last_change': '2023-12-22T08:41:12.542099+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.542099+0000', 'last_undegraded': '2023-12-22T08:41:12.542099+0000', 'last_fullsized': '2023-12-22T08:41:12.542099+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-22T08:41:19.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-12-22T08:41:19.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-12-22T08:41:19.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.547488+0000', 'last_change': '2023-12-22T08:41:12.547488+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.547488+0000', 'last_undegraded': '2023-12-22T08:41:12.547488+0000', 'last_fullsized': '2023-12-22T08:41:12.547488+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-22T08:41:19.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-12-22T08:41:19.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.542848+0000', 'last_change': '2023-12-22T08:41:12.542848+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.542848+0000', 'last_undegraded': '2023-12-22T08:41:12.542848+0000', 'last_fullsized': '2023-12-22T08:41:12.542848+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T12:06:57.933316+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-22T08:41:19.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-12-22T08:41:19.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.543116+0000', 'last_change': '2023-12-22T08:41:12.543116+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.543116+0000', 'last_undegraded': '2023-12-22T08:41:12.543116+0000', 'last_fullsized': '2023-12-22T08:41:12.543116+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T15:05:32.289529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-22T08:41:19.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-12-22T08:41:19.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.543149+0000', 'last_change': '2023-12-22T08:41:12.543149+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.543149+0000', 'last_undegraded': '2023-12-22T08:41:12.543149+0000', 'last_fullsized': '2023-12-22T08:41:12.543149+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T20:16:56.873386+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-22T08:41:19.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-12-22T08:41:19.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.541880+0000', 'last_change': '2023-12-22T08:41:12.541880+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.541880+0000', 'last_undegraded': '2023-12-22T08:41:12.541880+0000', 'last_fullsized': '2023-12-22T08:41:12.541880+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T14:40:01.499763+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-22T08:41:19.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-12-22T08:41:19.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-12-22T08:41:19.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.550521+0000', 'last_change': '2023-12-22T08:41:12.550521+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.550521+0000', 'last_undegraded': '2023-12-22T08:41:12.550521+0000', 'last_fullsized': '2023-12-22T08:41:12.550521+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T20:11:05.047493+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-22T08:41:19.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-12-22T08:41:19.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.546449+0000', 'last_change': '2023-12-22T08:41:12.546449+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.546449+0000', 'last_undegraded': '2023-12-22T08:41:12.546449+0000', 'last_fullsized': '2023-12-22T08:41:12.546449+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T16:36:20.680519+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-22T08:41:19.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-12-22T08:41:19.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-12-22T08:41:19.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.540934+0000', 'last_change': '2023-12-22T08:41:12.540934+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.540934+0000', 'last_undegraded': '2023-12-22T08:41:12.540934+0000', 'last_fullsized': '2023-12-22T08:41:12.540934+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-22T08:41:19.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-12-22T08:41:19.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-12-22T08:41:19.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-12-22T08:41:19.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.544198+0000', 'last_change': '2023-12-22T08:41:12.544198+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.544198+0000', 'last_undegraded': '2023-12-22T08:41:12.544198+0000', 'last_fullsized': '2023-12-22T08:41:12.544198+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T15:08:20.321086+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-22T08:41:19.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-12-22T08:41:19.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-12-22T08:41:19.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.540934+0000', 'last_change': '2023-12-22T08:41:12.540934+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.540934+0000', 'last_undegraded': '2023-12-22T08:41:12.540934+0000', 'last_fullsized': '2023-12-22T08:41:12.540934+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-22T08:41:19.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-12-22T08:41:19.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.540560+0000', 'last_change': '2023-12-22T08:41:12.540560+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.540560+0000', 'last_undegraded': '2023-12-22T08:41:12.540560+0000', 'last_fullsized': '2023-12-22T08:41:12.540560+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T16:33:01.715152+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-22T08:41:19.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-12-22T08:41:19.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-12-22T08:41:19.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-12-22T08:41:19.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.543202+0000', 'last_change': '2023-12-22T08:41:12.543202+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.543202+0000', 'last_undegraded': '2023-12-22T08:41:12.543202+0000', 'last_fullsized': '2023-12-22T08:41:12.543202+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T18:29:57.420192+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-22T08:41:19.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-12-22T08:41:19.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-22T08:41:13.537615+0000', 'last_change': '2023-12-22T08:41:13.537615+0000', 'last_active': '2023-12-22T08:41:13.537615+0000', 'last_peered': '2023-12-22T08:41:13.537615+0000', 'last_clean': '2023-12-22T08:41:13.537615+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:13.537615+0000', 'last_undegraded': '2023-12-22T08:41:13.537615+0000', 'last_fullsized': '2023-12-22T08:41:13.537615+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:13.537615+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-22T08:41:19.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-12-22T08:41:19.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-12-22T08:41:12.540762+0000', 'last_change': '2023-12-22T08:41:12.540762+0000', 'last_active': '2023-12-22T08:41:12.520550+0000', 'last_peered': '2023-12-22T08:41:12.520550+0000', 'last_clean': '2023-12-22T08:41:12.520550+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-22T08:41:12.540762+0000', 'last_undegraded': '2023-12-22T08:41:12.540762+0000', 'last_fullsized': '2023-12-22T08:41:12.540762+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'last_clean_scrub_stamp': '2023-12-22T08:41:12.520550+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-23T12:59:22.958625+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-22T08:41:19.738 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-22T08:41:19.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.980+0000 7fad489c4640 1 Processor -- start 2023-12-22T08:41:19.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.980+0000 7fad489c4640 1 -- start start 2023-12-22T08:41:19.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.982+0000 7fad489c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44161720 0x7fad440adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.982+0000 7fad489c4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad440ce950 con 0x7fad44161340 2023-12-22T08:41:19.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.982+0000 7fad489c4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad44072170 con 0x7fad440ae1e0 2023-12-22T08:41:19.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.982+0000 7fad489c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad440cdd40 con 0x7fad44161720 2023-12-22T08:41:19.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.982+0000 7fad437fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fad44161340 0x7fad44071a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58704/0 (socket says 172.21.15.38:58704) 2023-12-22T08:41:19.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.982+0000 7fad437fe640 1 -- 172.21.15.38:0/1769008689 learned_addr learned my addr 172.21.15.38:0/1769008689 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:19.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.982+0000 7fad42ffd640 1 --2- 172.21.15.38:0/1769008689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44161720 0x7fad440adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.982+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902794449 0 0) 0x7fad440ce950 con 0x7fad44161340 2023-12-22T08:41:19.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad2c003520 con 0x7fad44161340 2023-12-22T08:41:19.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3872440677 0 0) 0x7fad2c003520 con 0x7fad44161340 2023-12-22T08:41:19.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44161720 msgr2=0x7fad440adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:19.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 --2- 172.21.15.38:0/1769008689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44161720 0x7fad440adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 >> v1:172.21.15.89:6789/0 conn(0x7fad440ae1e0 legacy=0x7fad4406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad440ce020 con 0x7fad44161340 2023-12-22T08:41:19.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fad34001670 con 0x7fad44161340 2023-12-22T08:41:19.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 >> v1:172.21.15.38:6789/0 conn(0x7fad44161340 legacy=0x7fad44071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 --2- 172.21.15.38:0/1769008689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad2c0039a0 0x7fad2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 --2- 172.21.15.38:0/1769008689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44161720 0x7fad2c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 --2- 172.21.15.38:0/1769008689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c004d00 0x7fad2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad440cdd40 con 0x7fad2c004d00 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c00bb10 con 0x7fad2c0039a0 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c00bcd0 con 0x7fad44161720 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.983+0000 7fad43fff640 1 --2- 172.21.15.38:0/1769008689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c004d00 0x7fad2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.984+0000 7fad437fe640 1 --2- 172.21.15.38:0/1769008689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad2c0039a0 0x7fad2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.984+0000 7fad42ffd640 1 --2- 172.21.15.38:0/1769008689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44161720 0x7fad2c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.984+0000 7fad43fff640 1 -- 172.21.15.38:0/1769008689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44161720 msgr2=0x7fad2c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.984+0000 7fad43fff640 1 --2- 172.21.15.38:0/1769008689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44161720 0x7fad2c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.984+0000 7fad43fff640 1 -- 172.21.15.38:0/1769008689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad2c0039a0 msgr2=0x7fad2c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.984+0000 7fad43fff640 1 --2- 172.21.15.38:0/1769008689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad2c0039a0 0x7fad2c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.984+0000 7fad43fff640 1 -- 172.21.15.38:0/1769008689 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c003520 con 0x7fad2c004d00 2023-12-22T08:41:19.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.984+0000 7fad42ffd640 1 --2- 172.21.15.38:0/1769008689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44161720 0x7fad2c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:19.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.985+0000 7fad43fff640 1 --2- 172.21.15.38:0/1769008689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c004d00 0x7fad2c005180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fad3c001e50 tx=0x7fad2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c7e8f98e04d1d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:19.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.985+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c003b70 con 0x7fad2c004d00 2023-12-22T08:41:19.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.985+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c003cd0 con 0x7fad2c004d00 2023-12-22T08:41:19.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.985+0000 7fad427fc640 1 -- 172.21.15.38:0/1769008689 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c005310 con 0x7fad2c004d00 2023-12-22T08:41:19.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.986+0000 7fad489c4640 1 -- 172.21.15.38:0/1769008689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c004d00 msgr2=0x7fad2c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.986+0000 7fad489c4640 1 --2- 172.21.15.38:0/1769008689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c004d00 0x7fad2c005180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fad3c001e50 tx=0x7fad2c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.986+0000 7fad43fff640 1 -- 172.21.15.38:0/1769008689 reap_dead start 2023-12-22T08:41:19.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.986+0000 7fad489c4640 1 -- 172.21.15.38:0/1769008689 shutdown_connections 2023-12-22T08:41:19.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.986+0000 7fad489c4640 1 -- 172.21.15.38:0/1769008689 >> 172.21.15.38:0/1769008689 conn(0x7fad440b1f70 msgr2=0x7fad440b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:19.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.986+0000 7fad489c4640 1 -- 172.21.15.38:0/1769008689 shutdown_connections 2023-12-22T08:41:19.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.986+0000 7fad489c4640 1 -- 172.21.15.38:0/1769008689 wait complete. 2023-12-22T08:41:19.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.988+0000 7fad489c4640 1 Processor -- start 2023-12-22T08:41:19.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.988+0000 7fad489c4640 1 -- start start 2023-12-22T08:41:19.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.989+0000 7fad489c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad44144960 0x7fad4415ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.989+0000 7fad489c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44144d40 0x7fad441604b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.989+0000 7fad489c4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad44157960 0x7fad44157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.989+0000 7fad489c4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad44145250 con 0x7fad44157960 2023-12-22T08:41:19.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.989+0000 7fad489c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad441586c0 con 0x7fad44144960 2023-12-22T08:41:19.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.989+0000 7fad489c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad441454f0 con 0x7fad44144d40 2023-12-22T08:41:19.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.989+0000 7fad43fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad44157960 0x7fad44157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.989+0000 7fad43fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad44157960 0x7fad44157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56320/0 (socket says 172.21.15.38:56320) 2023-12-22T08:41:19.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.989+0000 7fad43fff640 1 -- 172.21.15.38:0/3997766542 learned_addr learned my addr 172.21.15.38:0/3997766542 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:19.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.990+0000 7fad42ffd640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44144d40 0x7fad441604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.990+0000 7fad437fe640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad44144960 0x7fad4415ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.990+0000 7fad43fff640 1 -- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44144d40 msgr2=0x7fad441604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.990+0000 7fad43fff640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44144d40 0x7fad441604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.990+0000 7fad43fff640 1 -- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad44144960 msgr2=0x7fad4415ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.990+0000 7fad43fff640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad44144960 0x7fad4415ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.990+0000 7fad43fff640 1 -- 172.21.15.38:0/3997766542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad441457d0 con 0x7fad44157960 2023-12-22T08:41:19.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.990+0000 7fad437fe640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad44144960 0x7fad4415ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:19.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.990+0000 7fad43fff640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad44157960 0x7fad44157df0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fad3c02c060 tx=0x7fad3c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:19.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.990+0000 7fad2bfff640 1 -- 172.21.15.38:0/3997766542 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c03e070 con 0x7fad44157960 2023-12-22T08:41:19.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.991+0000 7fad2bfff640 1 -- 172.21.15.38:0/3997766542 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c007db0 con 0x7fad44157960 2023-12-22T08:41:19.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.991+0000 7fad2bfff640 1 -- 172.21.15.38:0/3997766542 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c006d50 con 0x7fad44157960 2023-12-22T08:41:19.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.991+0000 7fad489c4640 1 -- 172.21.15.38:0/3997766542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad44145ab0 con 0x7fad44157960 2023-12-22T08:41:19.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.991+0000 7fad489c4640 1 -- 172.21.15.38:0/3997766542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad44158330 con 0x7fad44157960 2023-12-22T08:41:19.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.992+0000 7fad489c4640 1 -- 172.21.15.38:0/3997766542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad44145ca0 con 0x7fad44157960 2023-12-22T08:41:19.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.993+0000 7fad2bfff640 1 -- 172.21.15.38:0/3997766542 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fad3c007030 con 0x7fad44157960 2023-12-22T08:41:19.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.994+0000 7fad2bfff640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fad3006a430 0x7fad3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.994+0000 7fad2bfff640 1 -- 172.21.15.38:0/3997766542 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad3c0a9be0 con 0x7fad44157960 2023-12-22T08:41:19.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.994+0000 7fad437fe640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fad3006a430 0x7fad3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.996+0000 7fad437fe640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fad3006a430 0x7fad3006c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad34001050 tx=0x7fad34001d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:20.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:19.998+0000 7fad2bfff640 1 -- 172.21.15.38:0/3997766542 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fad3c075130 con 0x7fad44157960 2023-12-22T08:41:20.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.264+0000 7fad489c4640 1 -- 172.21.15.38:0/3997766542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fad44061910 con 0x7fad44157960 2023-12-22T08:41:20.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.265+0000 7fad2bfff640 1 -- 172.21.15.38:0/3997766542 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1167 (secure 0 0 0) 0x7fad3c048080 con 0x7fad44157960 2023-12-22T08:41:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:20.268 INFO:teuthology.orchestra.run.smithi038.stdout:{"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":99,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1703234387,"num_in_osds":8,"osd_in_since":1703234384,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":52},{"state_name":"unknown","count":29},{"state_name":"creating+peering","count":16}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":592674,"bytes_used":2317621,"bytes_avail":1597682379,"bytes_total":1600000000,"unknown_pgs_ratio":0.29896906018257141,"inactive_pgs_ratio":0.16494844853878021,"write_bytes_sec":1051,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5052}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-12-22T08:41:02.378207+0000","services":{}},"progress_events":{}} 2023-12-22T08:41:20.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.268+0000 7fad489c4640 1 -- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fad3006a430 msgr2=0x7fad3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:20.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.268+0000 7fad489c4640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fad3006a430 0x7fad3006c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad34001050 tx=0x7fad34001d40 comp rx=0 tx=0).stop 2023-12-22T08:41:20.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.268+0000 7fad489c4640 1 -- 172.21.15.38:0/3997766542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad44157960 msgr2=0x7fad44157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:20.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.268+0000 7fad489c4640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad44157960 0x7fad44157df0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fad3c02c060 tx=0x7fad3c0014a0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.268+0000 7fad489c4640 1 -- 172.21.15.38:0/3997766542 shutdown_connections 2023-12-22T08:41:20.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.268+0000 7fad489c4640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fad3006a430 0x7fad3006c8f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.268+0000 7fad489c4640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad44157960 0x7fad44157df0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.268+0000 7fad489c4640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad44144d40 0x7fad441604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.268+0000 7fad489c4640 1 --2- 172.21.15.38:0/3997766542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad44144960 0x7fad4415ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.268+0000 7fad489c4640 1 -- 172.21.15.38:0/3997766542 >> 172.21.15.38:0/3997766542 conn(0x7fad440b1f70 msgr2=0x7fad4406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:20.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.269+0000 7fad489c4640 1 -- 172.21.15.38:0/3997766542 shutdown_connections 2023-12-22T08:41:20.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.269+0000 7fad489c4640 1 -- 172.21.15.38:0/3997766542 wait complete. 2023-12-22T08:41:20.292 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-22T08:41:20.292 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:41:20.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.513+0000 7fa65b257640 1 Processor -- start 2023-12-22T08:41:20.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.513+0000 7fa65b257640 1 -- start start 2023-12-22T08:41:20.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.515+0000 7fa65b257640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa654071ea0 0x7fa6540b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:20.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.515+0000 7fa65b257640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6540ac8e0 con 0x7fa65415d470 2023-12-22T08:41:20.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.515+0000 7fa65b257640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6540b4940 con 0x7fa65415d850 2023-12-22T08:41:20.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.515+0000 7fa65b257640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6540ada40 con 0x7fa654071ea0 2023-12-22T08:41:20.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.516+0000 7fa658ff3640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa65415d470 0x7fa6540b4010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58706/0 (socket says 172.21.15.38:58706) 2023-12-22T08:41:20.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.516+0000 7fa658ff3640 1 -- 172.21.15.38:0/2813956663 learned_addr learned my addr 172.21.15.38:0/2813956663 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:20.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.516+0000 7fa6597f4640 1 --2- 172.21.15.38:0/2813956663 >> v2:172.21.15.89:3300/0 conn(0x7fa654071ea0 0x7fa6540b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:20.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.516+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882414233 0 0) 0x7fa6540ac8e0 con 0x7fa65415d470 2023-12-22T08:41:20.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.516+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa644003520 con 0x7fa65415d470 2023-12-22T08:41:20.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.516+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4096333433 0 0) 0x7fa644003520 con 0x7fa65415d470 2023-12-22T08:41:20.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.516+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 >> v2:172.21.15.89:3300/0 conn(0x7fa654071ea0 msgr2=0x7fa6540b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:20.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.516+0000 7fa6537fe640 1 --2- 172.21.15.38:0/2813956663 >> v2:172.21.15.89:3300/0 conn(0x7fa654071ea0 0x7fa6540b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.516+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 >> v1:172.21.15.89:6789/0 conn(0x7fa65415d850 legacy=0x7fa6540ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:20.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6540b4c20 con 0x7fa65415d470 2023-12-22T08:41:20.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fa648001670 con 0x7fa65415d470 2023-12-22T08:41:20.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 >> v1:172.21.15.38:6789/0 conn(0x7fa65415d470 legacy=0x7fa6540b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:20.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa6537fe640 1 --2- 172.21.15.38:0/2813956663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa644003970 0x7fa644003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:20.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa6537fe640 1 --2- 172.21.15.38:0/2813956663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6440047c0 0x7fa644004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:20.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa6537fe640 1 --2- 172.21.15.38:0/2813956663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa644005180 0x7fa64400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:20.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6540ada40 con 0x7fa644005180 2023-12-22T08:41:20.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64400c020 con 0x7fa644003970 2023-12-22T08:41:20.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64400c1e0 con 0x7fa6440047c0 2023-12-22T08:41:20.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa6597f4640 1 --2- 172.21.15.38:0/2813956663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa644005180 0x7fa64400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:20.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa658ff3640 1 --2- 172.21.15.38:0/2813956663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa644003970 0x7fa644003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:20.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa653fff640 1 --2- 172.21.15.38:0/2813956663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6440047c0 0x7fa644004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:20.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa6597f4640 1 -- 172.21.15.38:0/2813956663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6440047c0 msgr2=0x7fa644004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:20.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.517+0000 7fa6597f4640 1 --2- 172.21.15.38:0/2813956663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6440047c0 0x7fa644004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.518+0000 7fa6597f4640 1 -- 172.21.15.38:0/2813956663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa644003970 msgr2=0x7fa644003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:20.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.518+0000 7fa6597f4640 1 --2- 172.21.15.38:0/2813956663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa644003970 0x7fa644003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.518+0000 7fa6597f4640 1 -- 172.21.15.38:0/2813956663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa644003520 con 0x7fa644005180 2023-12-22T08:41:20.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.518+0000 7fa6597f4640 1 -- 172.21.15.38:0/2813956663 reap_dead start 2023-12-22T08:41:20.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.519+0000 7fa6597f4640 1 --2- 172.21.15.38:0/2813956663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa644005180 0x7fa64400b980 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009fc0 tx=0x7fa6440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54d1fa01f7d6f88 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:20.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.519+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c02cc60 con 0x7fa644005180 2023-12-22T08:41:20.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.519+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c00f040 con 0x7fa644005180 2023-12-22T08:41:20.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.519+0000 7fa6537fe640 1 -- 172.21.15.38:0/2813956663 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c003990 con 0x7fa644005180 2023-12-22T08:41:20.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.519+0000 7fa65b257640 1 -- 172.21.15.38:0/2813956663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa644005180 msgr2=0x7fa64400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:20.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.519+0000 7fa65b257640 1 --2- 172.21.15.38:0/2813956663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa644005180 0x7fa64400b980 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009fc0 tx=0x7fa6440057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.520+0000 7fa65b257640 1 -- 172.21.15.38:0/2813956663 shutdown_connections 2023-12-22T08:41:20.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.520+0000 7fa65b257640 1 --2- 172.21.15.38:0/2813956663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa644005180 0x7fa64400b980 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.520+0000 7fa65b257640 1 -- 172.21.15.38:0/2813956663 >> 172.21.15.38:0/2813956663 conn(0x7fa6540cf070 msgr2=0x7fa6540cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:20.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.520+0000 7fa65b257640 1 -- 172.21.15.38:0/2813956663 shutdown_connections 2023-12-22T08:41:20.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.520+0000 7fa65b257640 1 -- 172.21.15.38:0/2813956663 wait complete. 2023-12-22T08:41:20.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.521+0000 7fa65b257640 1 Processor -- start 2023-12-22T08:41:20.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.522+0000 7fa65b257640 1 -- start start 2023-12-22T08:41:20.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa65b257640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa644005180 0x7fa654144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:20.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa65b257640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa65415f3c0 0x7fa65415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa65b257640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa65406c430 0x7fa65406c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa65b257640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65406cdf0 con 0x7fa644005180 2023-12-22T08:41:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa65b257640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654145330 con 0x7fa65406c430 2023-12-22T08:41:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa65b257640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65415bce0 con 0x7fa65415f3c0 2023-12-22T08:41:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa658ff3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa644005180 0x7fa654144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa658ff3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa644005180 0x7fa654144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56340/0 (socket says 172.21.15.38:56340) 2023-12-22T08:41:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa658ff3640 1 -- 172.21.15.38:0/3553861474 learned_addr learned my addr 172.21.15.38:0/3553861474 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa6597f4640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa65406c430 0x7fa65406c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa653fff640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa65415f3c0 0x7fa65415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa658ff3640 1 -- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa65415f3c0 msgr2=0x7fa65415a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa658ff3640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa65415f3c0 0x7fa65415a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa658ff3640 1 -- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa65406c430 msgr2=0x7fa65406c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:20.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa658ff3640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa65406c430 0x7fa65406c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa658ff3640 1 -- 172.21.15.38:0/3553861474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65415bf80 con 0x7fa644005180 2023-12-22T08:41:20.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa653fff640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa65415f3c0 0x7fa65415a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:20.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.523+0000 7fa6597f4640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa65406c430 0x7fa65406c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:20.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.524+0000 7fa658ff3640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa644005180 0x7fa654144df0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa64800e780 tx=0x7fa64800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:20.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.524+0000 7fa6517fa640 1 -- 172.21.15.38:0/3553861474 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64800ee90 con 0x7fa644005180 2023-12-22T08:41:20.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.524+0000 7fa6517fa640 1 -- 172.21.15.38:0/3553861474 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64800c8d0 con 0x7fa644005180 2023-12-22T08:41:20.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.524+0000 7fa6517fa640 1 -- 172.21.15.38:0/3553861474 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64800cc80 con 0x7fa644005180 2023-12-22T08:41:20.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.524+0000 7fa65b257640 1 -- 172.21.15.38:0/3553861474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65415c260 con 0x7fa644005180 2023-12-22T08:41:20.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.524+0000 7fa65b257640 1 -- 172.21.15.38:0/3553861474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65415c820 con 0x7fa644005180 2023-12-22T08:41:20.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.525+0000 7fa65b257640 1 -- 172.21.15.38:0/3553861474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa654061910 con 0x7fa644005180 2023-12-22T08:41:20.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.526+0000 7fa6517fa640 1 -- 172.21.15.38:0/3553861474 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa64801d460 con 0x7fa644005180 2023-12-22T08:41:20.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.527+0000 7fa6517fa640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa63806a430 0x7fa63806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:20.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.527+0000 7fa6517fa640 1 -- 172.21.15.38:0/3553861474 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6480889a0 con 0x7fa644005180 2023-12-22T08:41:20.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.528+0000 7fa653fff640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa63806a430 0x7fa63806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:20.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.529+0000 7fa653fff640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa63806a430 0x7fa63806c8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa640000c00 tx=0x7fa640009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:20.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.531+0000 7fa6517fa640 1 -- 172.21.15.38:0/3553861474 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa648053e60 con 0x7fa644005180 2023-12-22T08:41:20.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.724+0000 7fa65b257640 1 -- 172.21.15.38:0/3553861474 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6540ace10 con 0x7fa63806a430 2023-12-22T08:41:20.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.747+0000 7fa6517fa640 1 -- 172.21.15.38:0/3553861474 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282652 (secure 0 0 0) 0x7fa64000d050 con 0x7fa63806a430 2023-12-22T08:41:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:20.754 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:41:20.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.752+0000 7fa65b257640 1 -- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa63806a430 msgr2=0x7fa63806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:20.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.752+0000 7fa65b257640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa63806a430 0x7fa63806c8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa640000c00 tx=0x7fa640009040 comp rx=0 tx=0).stop 2023-12-22T08:41:20.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.752+0000 7fa65b257640 1 -- 172.21.15.38:0/3553861474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa644005180 msgr2=0x7fa654144df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:20.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.752+0000 7fa65b257640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa644005180 0x7fa654144df0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa64800e780 tx=0x7fa64800ec40 comp rx=0 tx=0).stop 2023-12-22T08:41:20.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.752+0000 7fa65b257640 1 -- 172.21.15.38:0/3553861474 shutdown_connections 2023-12-22T08:41:20.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.752+0000 7fa65b257640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa65406c430 0x7fa65406c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.752+0000 7fa65b257640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa65415f3c0 0x7fa65415a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.752+0000 7fa65b257640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa63806a430 0x7fa63806c8f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.752+0000 7fa65b257640 1 --2- 172.21.15.38:0/3553861474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa644005180 0x7fa654144df0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.752+0000 7fa65b257640 1 -- 172.21.15.38:0/3553861474 >> 172.21.15.38:0/3553861474 conn(0x7fa6540cf070 msgr2=0x7fa6540b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:20.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.752+0000 7fa65b257640 1 -- 172.21.15.38:0/3553861474 shutdown_connections 2023-12-22T08:41:20.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:20.753+0000 7fa65b257640 1 -- 172.21.15.38:0/3553861474 wait complete. 2023-12-22T08:41:20.775 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-12-22T08:41:20.384187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2339,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560160,"statfs":{"total":1600000000,"available":1597604271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.823884"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217895+0000","last_change":"2023-12-22T08:41:14.083773+0000","last_active":"2023-12-22T08:41:15.217895+0000","last_peered":"2023-12-22T08:41:15.217895+0000","last_clean":"2023-12-22T08:41:15.217895+0000","last_became_active":"2023-12-22T08:41:14.083518+0000","last_became_peered":"2023-12-22T08:41:14.083518+0000","last_unstale":"2023-12-22T08:41:15.217895+0000","last_undegraded":"2023-12-22T08:41:15.217895+0000","last_fullsized":"2023-12-22T08:41:15.217895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:22:24.029276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218618+0000","last_change":"2023-12-22T08:41:14.102941+0000","last_active":"2023-12-22T08:41:15.218618+0000","last_peered":"2023-12-22T08:41:15.218618+0000","last_clean":"2023-12-22T08:41:15.218618+0000","last_became_active":"2023-12-22T08:41:14.102694+0000","last_became_peered":"2023-12-22T08:41:14.102694+0000","last_unstale":"2023-12-22T08:41:15.218618+0000","last_undegraded":"2023-12-22T08:41:15.218618+0000","last_fullsized":"2023-12-22T08:41:15.218618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:56.112979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217450+0000","last_change":"2023-12-22T08:41:14.081864+0000","last_active":"2023-12-22T08:41:15.217450+0000","last_peered":"2023-12-22T08:41:15.217450+0000","last_clean":"2023-12-22T08:41:15.217450+0000","last_became_active":"2023-12-22T08:41:14.081577+0000","last_became_peered":"2023-12-22T08:41:14.081577+0000","last_unstale":"2023-12-22T08:41:15.217450+0000","last_undegraded":"2023-12-22T08:41:15.217450+0000","last_fullsized":"2023-12-22T08:41:15.217450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:56.690991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220299+0000","last_change":"2023-12-22T08:41:14.087998+0000","last_active":"2023-12-22T08:41:15.220299+0000","last_peered":"2023-12-22T08:41:15.220299+0000","last_clean":"2023-12-22T08:41:15.220299+0000","last_became_active":"2023-12-22T08:41:14.087420+0000","last_became_peered":"2023-12-22T08:41:14.087420+0000","last_unstale":"2023-12-22T08:41:15.220299+0000","last_undegraded":"2023-12-22T08:41:15.220299+0000","last_fullsized":"2023-12-22T08:41:15.220299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:36:35.401856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219482+0000","last_change":"2023-12-22T08:41:14.106005+0000","last_active":"2023-12-22T08:41:15.219482+0000","last_peered":"2023-12-22T08:41:15.219482+0000","last_clean":"2023-12-22T08:41:15.219482+0000","last_became_active":"2023-12-22T08:41:14.105751+0000","last_became_peered":"2023-12-22T08:41:14.105751+0000","last_unstale":"2023-12-22T08:41:15.219482+0000","last_undegraded":"2023-12-22T08:41:15.219482+0000","last_fullsized":"2023-12-22T08:41:15.219482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.086366+0000","last_change":"2023-12-22T08:41:14.096790+0000","last_active":"2023-12-22T08:41:15.086366+0000","last_peered":"2023-12-22T08:41:15.086366+0000","last_clean":"2023-12-22T08:41:15.086366+0000","last_became_active":"2023-12-22T08:41:14.095986+0000","last_became_peered":"2023-12-22T08:41:14.095986+0000","last_unstale":"2023-12-22T08:41:15.086366+0000","last_undegraded":"2023-12-22T08:41:15.086366+0000","last_fullsized":"2023-12-22T08:41:15.086366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:21.338151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217829+0000","last_change":"2023-12-22T08:41:14.086953+0000","last_active":"2023-12-22T08:41:15.217829+0000","last_peered":"2023-12-22T08:41:15.217829+0000","last_clean":"2023-12-22T08:41:15.217829+0000","last_became_active":"2023-12-22T08:41:14.086743+0000","last_became_peered":"2023-12-22T08:41:14.086743+0000","last_unstale":"2023-12-22T08:41:15.217829+0000","last_undegraded":"2023-12-22T08:41:15.217829+0000","last_fullsized":"2023-12-22T08:41:15.217829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:37:59.695494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219080+0000","last_change":"2023-12-22T08:41:14.095859+0000","last_active":"2023-12-22T08:41:15.219080+0000","last_peered":"2023-12-22T08:41:15.219080+0000","last_clean":"2023-12-22T08:41:15.219080+0000","last_became_active":"2023-12-22T08:41:14.094827+0000","last_became_peered":"2023-12-22T08:41:14.094827+0000","last_unstale":"2023-12-22T08:41:15.219080+0000","last_undegraded":"2023-12-22T08:41:15.219080+0000","last_fullsized":"2023-12-22T08:41:15.219080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217556+0000","last_change":"2023-12-22T08:41:14.090024+0000","last_active":"2023-12-22T08:41:15.217556+0000","last_peered":"2023-12-22T08:41:15.217556+0000","last_clean":"2023-12-22T08:41:15.217556+0000","last_became_active":"2023-12-22T08:41:14.089413+0000","last_became_peered":"2023-12-22T08:41:14.089413+0000","last_unstale":"2023-12-22T08:41:15.217556+0000","last_undegraded":"2023-12-22T08:41:15.217556+0000","last_fullsized":"2023-12-22T08:41:15.217556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:40:02.516827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219678+0000","last_change":"2023-12-22T08:41:14.099756+0000","last_active":"2023-12-22T08:41:15.219678+0000","last_peered":"2023-12-22T08:41:15.219678+0000","last_clean":"2023-12-22T08:41:15.219678+0000","last_became_active":"2023-12-22T08:41:14.099195+0000","last_became_peered":"2023-12-22T08:41:14.099195+0000","last_unstale":"2023-12-22T08:41:15.219678+0000","last_undegraded":"2023-12-22T08:41:15.219678+0000","last_fullsized":"2023-12-22T08:41:15.219678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:24.381088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080699+0000","last_change":"2023-12-22T08:41:14.089198+0000","last_active":"2023-12-22T08:41:15.080699+0000","last_peered":"2023-12-22T08:41:15.080699+0000","last_clean":"2023-12-22T08:41:15.080699+0000","last_became_active":"2023-12-22T08:41:14.088946+0000","last_became_peered":"2023-12-22T08:41:14.088946+0000","last_unstale":"2023-12-22T08:41:15.080699+0000","last_undegraded":"2023-12-22T08:41:15.080699+0000","last_fullsized":"2023-12-22T08:41:15.080699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:49.001260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218705+0000","last_change":"2023-12-22T08:41:14.100779+0000","last_active":"2023-12-22T08:41:15.218705+0000","last_peered":"2023-12-22T08:41:15.218705+0000","last_clean":"2023-12-22T08:41:15.218705+0000","last_became_active":"2023-12-22T08:41:14.100546+0000","last_became_peered":"2023-12-22T08:41:14.100546+0000","last_unstale":"2023-12-22T08:41:15.218705+0000","last_undegraded":"2023-12-22T08:41:15.218705+0000","last_fullsized":"2023-12-22T08:41:15.218705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:59:23.975689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.083920+0000","last_change":"2023-12-22T08:41:14.104339+0000","last_active":"2023-12-22T08:41:15.083920+0000","last_peered":"2023-12-22T08:41:15.083920+0000","last_clean":"2023-12-22T08:41:15.083920+0000","last_became_active":"2023-12-22T08:41:14.099264+0000","last_became_peered":"2023-12-22T08:41:14.099264+0000","last_unstale":"2023-12-22T08:41:15.083920+0000","last_undegraded":"2023-12-22T08:41:15.083920+0000","last_fullsized":"2023-12-22T08:41:15.083920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:29:58.437257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219819+0000","last_change":"2023-12-22T08:41:14.104174+0000","last_active":"2023-12-22T08:41:15.219819+0000","last_peered":"2023-12-22T08:41:15.219819+0000","last_clean":"2023-12-22T08:41:15.219819+0000","last_became_active":"2023-12-22T08:41:14.103253+0000","last_became_peered":"2023-12-22T08:41:14.103253+0000","last_unstale":"2023-12-22T08:41:15.219819+0000","last_undegraded":"2023-12-22T08:41:15.219819+0000","last_fullsized":"2023-12-22T08:41:15.219819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:52:53.231438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219813+0000","last_change":"2023-12-22T08:41:14.081479+0000","last_active":"2023-12-22T08:41:15.219813+0000","last_peered":"2023-12-22T08:41:15.219813+0000","last_clean":"2023-12-22T08:41:15.219813+0000","last_became_active":"2023-12-22T08:41:14.080980+0000","last_became_peered":"2023-12-22T08:41:14.080980+0000","last_unstale":"2023-12-22T08:41:15.219813+0000","last_undegraded":"2023-12-22T08:41:15.219813+0000","last_fullsized":"2023-12-22T08:41:15.219813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:50.601030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218634+0000","last_change":"2023-12-22T08:41:14.093504+0000","last_active":"2023-12-22T08:41:15.218634+0000","last_peered":"2023-12-22T08:41:15.218634+0000","last_clean":"2023-12-22T08:41:15.218634+0000","last_became_active":"2023-12-22T08:41:14.093196+0000","last_became_peered":"2023-12-22T08:41:14.093196+0000","last_unstale":"2023-12-22T08:41:15.218634+0000","last_undegraded":"2023-12-22T08:41:15.218634+0000","last_fullsized":"2023-12-22T08:41:15.218634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:37:59.695494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080552+0000","last_change":"2023-12-22T08:41:14.082409+0000","last_active":"2023-12-22T08:41:15.080552+0000","last_peered":"2023-12-22T08:41:15.080552+0000","last_clean":"2023-12-22T08:41:15.080552+0000","last_became_active":"2023-12-22T08:41:14.081886+0000","last_became_peered":"2023-12-22T08:41:14.081886+0000","last_unstale":"2023-12-22T08:41:15.080552+0000","last_undegraded":"2023-12-22T08:41:15.080552+0000","last_fullsized":"2023-12-22T08:41:15.080552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:21:20.048933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.085797+0000","last_change":"2023-12-22T08:41:14.105679+0000","last_active":"2023-12-22T08:41:15.085797+0000","last_peered":"2023-12-22T08:41:15.085797+0000","last_clean":"2023-12-22T08:41:15.085797+0000","last_became_active":"2023-12-22T08:41:14.105427+0000","last_became_peered":"2023-12-22T08:41:14.105427+0000","last_unstale":"2023-12-22T08:41:15.085797+0000","last_undegraded":"2023-12-22T08:41:15.085797+0000","last_fullsized":"2023-12-22T08:41:15.085797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:57.890451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084477+0000","last_change":"2023-12-22T08:41:14.094009+0000","last_active":"2023-12-22T08:41:15.084477+0000","last_peered":"2023-12-22T08:41:15.084477+0000","last_clean":"2023-12-22T08:41:15.084477+0000","last_became_active":"2023-12-22T08:41:14.093505+0000","last_became_peered":"2023-12-22T08:41:14.093505+0000","last_unstale":"2023-12-22T08:41:15.084477+0000","last_undegraded":"2023-12-22T08:41:15.084477+0000","last_fullsized":"2023-12-22T08:41:15.084477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:29:58.437257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084232+0000","last_change":"2023-12-22T08:41:14.104833+0000","last_active":"2023-12-22T08:41:15.084232+0000","last_peered":"2023-12-22T08:41:15.084232+0000","last_clean":"2023-12-22T08:41:15.084232+0000","last_became_active":"2023-12-22T08:41:14.100564+0000","last_became_peered":"2023-12-22T08:41:14.100564+0000","last_unstale":"2023-12-22T08:41:15.084232+0000","last_undegraded":"2023-12-22T08:41:15.084232+0000","last_fullsized":"2023-12-22T08:41:15.084232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:35.662994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218768+0000","last_change":"2023-12-22T08:41:14.098408+0000","last_active":"2023-12-22T08:41:15.218768+0000","last_peered":"2023-12-22T08:41:15.218768+0000","last_clean":"2023-12-22T08:41:15.218768+0000","last_became_active":"2023-12-22T08:41:14.098202+0000","last_became_peered":"2023-12-22T08:41:14.098202+0000","last_unstale":"2023-12-22T08:41:15.218768+0000","last_undegraded":"2023-12-22T08:41:15.218768+0000","last_fullsized":"2023-12-22T08:41:15.218768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:40.377312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217927+0000","last_change":"2023-12-22T08:41:14.088640+0000","last_active":"2023-12-22T08:41:15.217927+0000","last_peered":"2023-12-22T08:41:15.217927+0000","last_clean":"2023-12-22T08:41:15.217927+0000","last_became_active":"2023-12-22T08:41:14.088402+0000","last_became_peered":"2023-12-22T08:41:14.088402+0000","last_unstale":"2023-12-22T08:41:15.217927+0000","last_undegraded":"2023-12-22T08:41:15.217927+0000","last_fullsized":"2023-12-22T08:41:15.217927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:36.121680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084177+0000","last_change":"2023-12-22T08:41:14.098092+0000","last_active":"2023-12-22T08:41:15.084177+0000","last_peered":"2023-12-22T08:41:15.084177+0000","last_clean":"2023-12-22T08:41:15.084177+0000","last_became_active":"2023-12-22T08:41:14.092294+0000","last_became_peered":"2023-12-22T08:41:14.092294+0000","last_unstale":"2023-12-22T08:41:15.084177+0000","last_undegraded":"2023-12-22T08:41:15.084177+0000","last_fullsized":"2023-12-22T08:41:15.084177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:22:24.029276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218184+0000","last_change":"2023-12-22T08:41:14.088022+0000","last_active":"2023-12-22T08:41:15.218184+0000","last_peered":"2023-12-22T08:41:15.218184+0000","last_clean":"2023-12-22T08:41:15.218184+0000","last_became_active":"2023-12-22T08:41:14.087677+0000","last_became_peered":"2023-12-22T08:41:14.087677+0000","last_unstale":"2023-12-22T08:41:15.218184+0000","last_undegraded":"2023-12-22T08:41:15.218184+0000","last_fullsized":"2023-12-22T08:41:15.218184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:49:28.648602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219910+0000","last_change":"2023-12-22T08:41:14.090355+0000","last_active":"2023-12-22T08:41:15.219910+0000","last_peered":"2023-12-22T08:41:15.219910+0000","last_clean":"2023-12-22T08:41:15.219910+0000","last_became_active":"2023-12-22T08:41:14.089908+0000","last_became_peered":"2023-12-22T08:41:14.089908+0000","last_unstale":"2023-12-22T08:41:15.219910+0000","last_undegraded":"2023-12-22T08:41:15.219910+0000","last_fullsized":"2023-12-22T08:41:15.219910+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:25:50.465640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219702+0000","last_change":"2023-12-22T08:41:14.097459+0000","last_active":"2023-12-22T08:41:15.219702+0000","last_peered":"2023-12-22T08:41:15.219702+0000","last_clean":"2023-12-22T08:41:15.219702+0000","last_became_active":"2023-12-22T08:41:14.093400+0000","last_became_peered":"2023-12-22T08:41:14.093400+0000","last_unstale":"2023-12-22T08:41:15.219702+0000","last_undegraded":"2023-12-22T08:41:15.219702+0000","last_fullsized":"2023-12-22T08:41:15.219702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:42.793364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218867+0000","last_change":"2023-12-22T08:41:14.096429+0000","last_active":"2023-12-22T08:41:15.218867+0000","last_peered":"2023-12-22T08:41:15.218867+0000","last_clean":"2023-12-22T08:41:15.218867+0000","last_became_active":"2023-12-22T08:41:14.095805+0000","last_became_peered":"2023-12-22T08:41:14.095805+0000","last_unstale":"2023-12-22T08:41:15.218867+0000","last_undegraded":"2023-12-22T08:41:15.218867+0000","last_fullsized":"2023-12-22T08:41:15.218867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:44.745035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219220+0000","last_change":"2023-12-22T08:41:14.095717+0000","last_active":"2023-12-22T08:41:15.219220+0000","last_peered":"2023-12-22T08:41:15.219220+0000","last_clean":"2023-12-22T08:41:15.219220+0000","last_became_active":"2023-12-22T08:41:14.094456+0000","last_became_peered":"2023-12-22T08:41:14.094456+0000","last_unstale":"2023-12-22T08:41:15.219220+0000","last_undegraded":"2023-12-22T08:41:15.219220+0000","last_fullsized":"2023-12-22T08:41:15.219220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217815+0000","last_change":"2023-12-22T08:41:14.088071+0000","last_active":"2023-12-22T08:41:15.217815+0000","last_peered":"2023-12-22T08:41:15.217815+0000","last_clean":"2023-12-22T08:41:15.217815+0000","last_became_active":"2023-12-22T08:41:14.087707+0000","last_became_peered":"2023-12-22T08:41:14.087707+0000","last_unstale":"2023-12-22T08:41:15.217815+0000","last_undegraded":"2023-12-22T08:41:15.217815+0000","last_fullsized":"2023-12-22T08:41:15.217815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219882+0000","last_change":"2023-12-22T08:41:14.076875+0000","last_active":"2023-12-22T08:41:15.219882+0000","last_peered":"2023-12-22T08:41:15.219882+0000","last_clean":"2023-12-22T08:41:15.219882+0000","last_became_active":"2023-12-22T08:41:14.076641+0000","last_became_peered":"2023-12-22T08:41:14.076641+0000","last_unstale":"2023-12-22T08:41:15.219882+0000","last_undegraded":"2023-12-22T08:41:15.219882+0000","last_fullsized":"2023-12-22T08:41:15.219882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218058+0000","last_change":"2023-12-22T08:41:14.100889+0000","last_active":"2023-12-22T08:41:15.218058+0000","last_peered":"2023-12-22T08:41:15.218058+0000","last_clean":"2023-12-22T08:41:15.218058+0000","last_became_active":"2023-12-22T08:41:14.100503+0000","last_became_peered":"2023-12-22T08:41:14.100503+0000","last_unstale":"2023-12-22T08:41:15.218058+0000","last_undegraded":"2023-12-22T08:41:15.218058+0000","last_fullsized":"2023-12-22T08:41:15.218058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:03:04.272947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080632+0000","last_change":"2023-12-22T08:41:14.082276+0000","last_active":"2023-12-22T08:41:15.080632+0000","last_peered":"2023-12-22T08:41:15.080632+0000","last_clean":"2023-12-22T08:41:15.080632+0000","last_became_active":"2023-12-22T08:41:14.081594+0000","last_became_peered":"2023-12-22T08:41:14.081594+0000","last_unstale":"2023-12-22T08:41:15.080632+0000","last_undegraded":"2023-12-22T08:41:15.080632+0000","last_fullsized":"2023-12-22T08:41:15.080632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:49.203160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.083113+0000","last_change":"2023-12-22T08:41:14.093264+0000","last_active":"2023-12-22T08:41:15.083113+0000","last_peered":"2023-12-22T08:41:15.083113+0000","last_clean":"2023-12-22T08:41:15.083113+0000","last_became_active":"2023-12-22T08:41:14.092862+0000","last_became_peered":"2023-12-22T08:41:14.092862+0000","last_unstale":"2023-12-22T08:41:15.083113+0000","last_undegraded":"2023-12-22T08:41:15.083113+0000","last_fullsized":"2023-12-22T08:41:15.083113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:15.989439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.098889+0000","last_change":"2023-12-22T08:41:13.584014+0000","last_active":"2023-12-22T08:41:14.098889+0000","last_peered":"2023-12-22T08:41:14.098889+0000","last_clean":"2023-12-22T08:41:14.098889+0000","last_became_active":"2023-12-22T08:41:13.583526+0000","last_became_peered":"2023-12-22T08:41:13.583526+0000","last_unstale":"2023-12-22T08:41:14.098889+0000","last_undegraded":"2023-12-22T08:41:14.098889+0000","last_fullsized":"2023-12-22T08:41:14.098889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:28.401635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219355+0000","last_change":"2023-12-22T08:41:14.096810+0000","last_active":"2023-12-22T08:41:15.219355+0000","last_peered":"2023-12-22T08:41:15.219355+0000","last_clean":"2023-12-22T08:41:15.219355+0000","last_became_active":"2023-12-22T08:41:14.096572+0000","last_became_peered":"2023-12-22T08:41:14.096572+0000","last_unstale":"2023-12-22T08:41:15.219355+0000","last_undegraded":"2023-12-22T08:41:15.219355+0000","last_fullsized":"2023-12-22T08:41:15.219355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:40.377312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.103708+0000","last_change":"2023-12-22T08:41:13.588809+0000","last_active":"2023-12-22T08:41:14.103708+0000","last_peered":"2023-12-22T08:41:14.103708+0000","last_clean":"2023-12-22T08:41:14.103708+0000","last_became_active":"2023-12-22T08:41:13.588188+0000","last_became_peered":"2023-12-22T08:41:13.588188+0000","last_unstale":"2023-12-22T08:41:14.103708+0000","last_undegraded":"2023-12-22T08:41:14.103708+0000","last_fullsized":"2023-12-22T08:41:14.103708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218226+0000","last_change":"2023-12-22T08:41:14.089905+0000","last_active":"2023-12-22T08:41:15.218226+0000","last_peered":"2023-12-22T08:41:15.218226+0000","last_clean":"2023-12-22T08:41:15.218226+0000","last_became_active":"2023-12-22T08:41:14.089223+0000","last_became_peered":"2023-12-22T08:41:14.089223+0000","last_unstale":"2023-12-22T08:41:15.218226+0000","last_undegraded":"2023-12-22T08:41:15.218226+0000","last_fullsized":"2023-12-22T08:41:15.218226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:56.112979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.104190+0000","last_change":"2023-12-22T08:41:13.589272+0000","last_active":"2023-12-22T08:41:14.104190+0000","last_peered":"2023-12-22T08:41:14.104190+0000","last_clean":"2023-12-22T08:41:14.104190+0000","last_became_active":"2023-12-22T08:41:13.588959+0000","last_became_peered":"2023-12-22T08:41:13.588959+0000","last_unstale":"2023-12-22T08:41:14.104190+0000","last_undegraded":"2023-12-22T08:41:14.104190+0000","last_fullsized":"2023-12-22T08:41:14.104190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:59:22.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220322+0000","last_change":"2023-12-22T08:41:14.099602+0000","last_active":"2023-12-22T08:41:15.220322+0000","last_peered":"2023-12-22T08:41:15.220322+0000","last_clean":"2023-12-22T08:41:15.220322+0000","last_became_active":"2023-12-22T08:41:14.098849+0000","last_became_peered":"2023-12-22T08:41:14.098849+0000","last_unstale":"2023-12-22T08:41:15.220322+0000","last_undegraded":"2023-12-22T08:41:15.220322+0000","last_fullsized":"2023-12-22T08:41:15.220322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.106506+0000","last_change":"2023-12-22T08:41:13.581861+0000","last_active":"2023-12-22T08:41:14.106506+0000","last_peered":"2023-12-22T08:41:14.106506+0000","last_clean":"2023-12-22T08:41:14.106506+0000","last_became_active":"2023-12-22T08:41:13.580825+0000","last_became_peered":"2023-12-22T08:41:13.580825+0000","last_unstale":"2023-12-22T08:41:14.106506+0000","last_undegraded":"2023-12-22T08:41:14.106506+0000","last_fullsized":"2023-12-22T08:41:14.106506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:12.338282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218398+0000","last_change":"2023-12-22T08:41:14.090078+0000","last_active":"2023-12-22T08:41:15.218398+0000","last_peered":"2023-12-22T08:41:15.218398+0000","last_clean":"2023-12-22T08:41:15.218398+0000","last_became_active":"2023-12-22T08:41:14.089833+0000","last_became_peered":"2023-12-22T08:41:14.089833+0000","last_unstale":"2023-12-22T08:41:15.218398+0000","last_undegraded":"2023-12-22T08:41:15.218398+0000","last_fullsized":"2023-12-22T08:41:15.218398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:10.771817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.098282+0000","last_change":"2023-12-22T08:41:13.580635+0000","last_active":"2023-12-22T08:41:14.098282+0000","last_peered":"2023-12-22T08:41:14.098282+0000","last_clean":"2023-12-22T08:41:14.098282+0000","last_became_active":"2023-12-22T08:41:13.580315+0000","last_became_peered":"2023-12-22T08:41:13.580315+0000","last_unstale":"2023-12-22T08:41:14.098282+0000","last_undegraded":"2023-12-22T08:41:14.098282+0000","last_fullsized":"2023-12-22T08:41:14.098282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:55.673926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218027+0000","last_change":"2023-12-22T08:41:14.095668+0000","last_active":"2023-12-22T08:41:15.218027+0000","last_peered":"2023-12-22T08:41:15.218027+0000","last_clean":"2023-12-22T08:41:15.218027+0000","last_became_active":"2023-12-22T08:41:14.095439+0000","last_became_peered":"2023-12-22T08:41:14.095439+0000","last_unstale":"2023-12-22T08:41:15.218027+0000","last_undegraded":"2023-12-22T08:41:15.218027+0000","last_fullsized":"2023-12-22T08:41:15.218027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:42.793364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.094986+0000","last_change":"2023-12-22T08:41:13.579491+0000","last_active":"2023-12-22T08:41:14.094986+0000","last_peered":"2023-12-22T08:41:14.094986+0000","last_clean":"2023-12-22T08:41:14.094986+0000","last_became_active":"2023-12-22T08:41:13.579126+0000","last_became_peered":"2023-12-22T08:41:13.579126+0000","last_unstale":"2023-12-22T08:41:14.094986+0000","last_undegraded":"2023-12-22T08:41:14.094986+0000","last_fullsized":"2023-12-22T08:41:14.094986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219117+0000","last_change":"2023-12-22T08:41:14.079079+0000","last_active":"2023-12-22T08:41:15.219117+0000","last_peered":"2023-12-22T08:41:15.219117+0000","last_clean":"2023-12-22T08:41:15.219117+0000","last_became_active":"2023-12-22T08:41:14.078289+0000","last_became_peered":"2023-12-22T08:41:14.078289+0000","last_unstale":"2023-12-22T08:41:15.219117+0000","last_undegraded":"2023-12-22T08:41:15.219117+0000","last_fullsized":"2023-12-22T08:41:15.219117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:11:06.064557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.088639+0000","last_change":"2023-12-22T08:41:13.590636+0000","last_active":"2023-12-22T08:41:14.088639+0000","last_peered":"2023-12-22T08:41:14.088639+0000","last_clean":"2023-12-22T08:41:14.088639+0000","last_became_active":"2023-12-22T08:41:13.589949+0000","last_became_peered":"2023-12-22T08:41:13.589949+0000","last_unstale":"2023-12-22T08:41:14.088639+0000","last_undegraded":"2023-12-22T08:41:14.088639+0000","last_fullsized":"2023-12-22T08:41:14.088639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220046+0000","last_change":"2023-12-22T08:41:14.087827+0000","last_active":"2023-12-22T08:41:15.220046+0000","last_peered":"2023-12-22T08:41:15.220046+0000","last_clean":"2023-12-22T08:41:15.220046+0000","last_became_active":"2023-12-22T08:41:14.087045+0000","last_became_peered":"2023-12-22T08:41:14.087045+0000","last_unstale":"2023-12-22T08:41:15.220046+0000","last_undegraded":"2023-12-22T08:41:15.220046+0000","last_fullsized":"2023-12-22T08:41:15.220046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:11.801978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.077845+0000","last_change":"2023-12-22T08:41:13.586921+0000","last_active":"2023-12-22T08:41:14.077845+0000","last_peered":"2023-12-22T08:41:14.077845+0000","last_clean":"2023-12-22T08:41:14.077845+0000","last_became_active":"2023-12-22T08:41:13.586392+0000","last_became_peered":"2023-12-22T08:41:13.586392+0000","last_unstale":"2023-12-22T08:41:14.077845+0000","last_undegraded":"2023-12-22T08:41:14.077845+0000","last_fullsized":"2023-12-22T08:41:14.077845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:06:57.933316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080734+0000","last_change":"2023-12-22T08:41:14.099246+0000","last_active":"2023-12-22T08:41:15.080734+0000","last_peered":"2023-12-22T08:41:15.080734+0000","last_clean":"2023-12-22T08:41:15.080734+0000","last_became_active":"2023-12-22T08:41:14.099015+0000","last_became_peered":"2023-12-22T08:41:14.099015+0000","last_unstale":"2023-12-22T08:41:15.080734+0000","last_undegraded":"2023-12-22T08:41:15.080734+0000","last_fullsized":"2023-12-22T08:41:15.080734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:37:03.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.091162+0000","last_change":"2023-12-22T08:41:13.578368+0000","last_active":"2023-12-22T08:41:14.091162+0000","last_peered":"2023-12-22T08:41:14.091162+0000","last_clean":"2023-12-22T08:41:14.091162+0000","last_became_active":"2023-12-22T08:41:13.577907+0000","last_became_peered":"2023-12-22T08:41:13.577907+0000","last_unstale":"2023-12-22T08:41:14.091162+0000","last_undegraded":"2023-12-22T08:41:14.091162+0000","last_fullsized":"2023-12-22T08:41:14.091162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:05:32.289529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219102+0000","last_change":"2023-12-22T08:41:14.101049+0000","last_active":"2023-12-22T08:41:15.219102+0000","last_peered":"2023-12-22T08:41:15.219102+0000","last_clean":"2023-12-22T08:41:15.219102+0000","last_became_active":"2023-12-22T08:41:14.100198+0000","last_became_peered":"2023-12-22T08:41:14.100198+0000","last_unstale":"2023-12-22T08:41:15.219102+0000","last_undegraded":"2023-12-22T08:41:15.219102+0000","last_fullsized":"2023-12-22T08:41:15.219102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:49:28.648602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.095202+0000","last_change":"2023-12-22T08:41:13.585931+0000","last_active":"2023-12-22T08:41:14.095202+0000","last_peered":"2023-12-22T08:41:14.095202+0000","last_clean":"2023-12-22T08:41:14.095202+0000","last_became_active":"2023-12-22T08:41:13.585676+0000","last_became_peered":"2023-12-22T08:41:13.585676+0000","last_unstale":"2023-12-22T08:41:14.095202+0000","last_undegraded":"2023-12-22T08:41:14.095202+0000","last_fullsized":"2023-12-22T08:41:14.095202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:56.873386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220681+0000","last_change":"2023-12-22T08:41:14.091150+0000","last_active":"2023-12-22T08:41:15.220681+0000","last_peered":"2023-12-22T08:41:15.220681+0000","last_clean":"2023-12-22T08:41:15.220681+0000","last_became_active":"2023-12-22T08:41:14.089208+0000","last_became_peered":"2023-12-22T08:41:14.089208+0000","last_unstale":"2023-12-22T08:41:15.220681+0000","last_undegraded":"2023-12-22T08:41:15.220681+0000","last_fullsized":"2023-12-22T08:41:15.220681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:03:04.272947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.086529+0000","last_change":"2023-12-22T08:41:13.581406+0000","last_active":"2023-12-22T08:41:14.086529+0000","last_peered":"2023-12-22T08:41:14.086529+0000","last_clean":"2023-12-22T08:41:14.086529+0000","last_became_active":"2023-12-22T08:41:13.581185+0000","last_became_peered":"2023-12-22T08:41:13.581185+0000","last_unstale":"2023-12-22T08:41:14.086529+0000","last_undegraded":"2023-12-22T08:41:14.086529+0000","last_fullsized":"2023-12-22T08:41:14.086529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:43.727970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080685+0000","last_change":"2023-12-22T08:41:14.088889+0000","last_active":"2023-12-22T08:41:15.080685+0000","last_peered":"2023-12-22T08:41:15.080685+0000","last_clean":"2023-12-22T08:41:15.080685+0000","last_became_active":"2023-12-22T08:41:14.088632+0000","last_became_peered":"2023-12-22T08:41:14.088632+0000","last_unstale":"2023-12-22T08:41:15.080685+0000","last_undegraded":"2023-12-22T08:41:15.080685+0000","last_fullsized":"2023-12-22T08:41:15.080685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:35.696117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.107527+0000","last_change":"2023-12-22T08:41:13.583907+0000","last_active":"2023-12-22T08:41:14.107527+0000","last_peered":"2023-12-22T08:41:14.107527+0000","last_clean":"2023-12-22T08:41:14.107527+0000","last_became_active":"2023-12-22T08:41:13.583541+0000","last_became_peered":"2023-12-22T08:41:13.583541+0000","last_unstale":"2023-12-22T08:41:14.107527+0000","last_undegraded":"2023-12-22T08:41:14.107527+0000","last_fullsized":"2023-12-22T08:41:14.107527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:55.673926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084469+0000","last_change":"2023-12-22T08:41:14.093509+0000","last_active":"2023-12-22T08:41:15.084469+0000","last_peered":"2023-12-22T08:41:15.084469+0000","last_clean":"2023-12-22T08:41:15.084469+0000","last_became_active":"2023-12-22T08:41:14.093237+0000","last_became_peered":"2023-12-22T08:41:14.093237+0000","last_unstale":"2023-12-22T08:41:15.084469+0000","last_undegraded":"2023-12-22T08:41:15.084469+0000","last_fullsized":"2023-12-22T08:41:15.084469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:34.649905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.087086+0000","last_change":"2023-12-22T08:41:13.587326+0000","last_active":"2023-12-22T08:41:14.087086+0000","last_peered":"2023-12-22T08:41:14.087086+0000","last_clean":"2023-12-22T08:41:14.087086+0000","last_became_active":"2023-12-22T08:41:13.586696+0000","last_became_peered":"2023-12-22T08:41:13.586696+0000","last_unstale":"2023-12-22T08:41:14.087086+0000","last_undegraded":"2023-12-22T08:41:14.087086+0000","last_fullsized":"2023-12-22T08:41:14.087086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:40:01.499763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220533+0000","last_change":"2023-12-22T08:41:14.099450+0000","last_active":"2023-12-22T08:41:15.220533+0000","last_peered":"2023-12-22T08:41:15.220533+0000","last_clean":"2023-12-22T08:41:15.220533+0000","last_became_active":"2023-12-22T08:41:14.098493+0000","last_became_peered":"2023-12-22T08:41:14.098493+0000","last_unstale":"2023-12-22T08:41:15.220533+0000","last_undegraded":"2023-12-22T08:41:15.220533+0000","last_fullsized":"2023-12-22T08:41:15.220533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.083278+0000","last_change":"2023-12-22T08:41:13.589524+0000","last_active":"2023-12-22T08:41:14.083278+0000","last_peered":"2023-12-22T08:41:14.083278+0000","last_clean":"2023-12-22T08:41:14.083278+0000","last_became_active":"2023-12-22T08:41:13.589280+0000","last_became_peered":"2023-12-22T08:41:13.589280+0000","last_unstale":"2023-12-22T08:41:14.083278+0000","last_undegraded":"2023-12-22T08:41:14.083278+0000","last_fullsized":"2023-12-22T08:41:14.083278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:15.540388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219485+0000","last_change":"2023-12-22T08:41:14.085416+0000","last_active":"2023-12-22T08:41:15.219485+0000","last_peered":"2023-12-22T08:41:15.219485+0000","last_clean":"2023-12-22T08:41:15.219485+0000","last_became_active":"2023-12-22T08:41:14.085082+0000","last_became_peered":"2023-12-22T08:41:14.085082+0000","last_unstale":"2023-12-22T08:41:15.219485+0000","last_undegraded":"2023-12-22T08:41:15.219485+0000","last_fullsized":"2023-12-22T08:41:15.219485+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:44.745035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.080556+0000","last_change":"2023-12-22T08:41:13.583098+0000","last_active":"2023-12-22T08:41:14.080556+0000","last_peered":"2023-12-22T08:41:14.080556+0000","last_clean":"2023-12-22T08:41:14.080556+0000","last_became_active":"2023-12-22T08:41:13.582809+0000","last_became_peered":"2023-12-22T08:41:13.582809+0000","last_unstale":"2023-12-22T08:41:14.080556+0000","last_undegraded":"2023-12-22T08:41:14.080556+0000","last_fullsized":"2023-12-22T08:41:14.080556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:42:51.564771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080835+0000","last_change":"2023-12-22T08:41:14.082128+0000","last_active":"2023-12-22T08:41:15.080835+0000","last_peered":"2023-12-22T08:41:15.080835+0000","last_clean":"2023-12-22T08:41:15.080835+0000","last_became_active":"2023-12-22T08:41:14.081273+0000","last_became_peered":"2023-12-22T08:41:14.081273+0000","last_unstale":"2023-12-22T08:41:15.080835+0000","last_undegraded":"2023-12-22T08:41:15.080835+0000","last_fullsized":"2023-12-22T08:41:15.080835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:24.381088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.105144+0000","last_change":"2023-12-22T08:41:13.587615+0000","last_active":"2023-12-22T08:41:14.105144+0000","last_peered":"2023-12-22T08:41:14.105144+0000","last_clean":"2023-12-22T08:41:14.105144+0000","last_became_active":"2023-12-22T08:41:13.587387+0000","last_became_peered":"2023-12-22T08:41:13.587387+0000","last_unstale":"2023-12-22T08:41:14.105144+0000","last_undegraded":"2023-12-22T08:41:14.105144+0000","last_fullsized":"2023-12-22T08:41:14.105144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:11:05.047493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.081153+0000","last_change":"2023-12-22T08:41:14.095349+0000","last_active":"2023-12-22T08:41:15.081153+0000","last_peered":"2023-12-22T08:41:15.081153+0000","last_clean":"2023-12-22T08:41:15.081153+0000","last_became_active":"2023-12-22T08:41:14.094909+0000","last_became_peered":"2023-12-22T08:41:14.094909+0000","last_unstale":"2023-12-22T08:41:15.081153+0000","last_undegraded":"2023-12-22T08:41:15.081153+0000","last_fullsized":"2023-12-22T08:41:15.081153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:29.434181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.104459+0000","last_change":"2023-12-22T08:41:13.590820+0000","last_active":"2023-12-22T08:41:14.104459+0000","last_peered":"2023-12-22T08:41:14.104459+0000","last_clean":"2023-12-22T08:41:14.104459+0000","last_became_active":"2023-12-22T08:41:13.590381+0000","last_became_peered":"2023-12-22T08:41:13.590381+0000","last_unstale":"2023-12-22T08:41:14.104459+0000","last_undegraded":"2023-12-22T08:41:14.104459+0000","last_fullsized":"2023-12-22T08:41:14.104459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:36:20.680519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217710+0000","last_change":"2023-12-22T08:41:14.076288+0000","last_active":"2023-12-22T08:41:15.217710+0000","last_peered":"2023-12-22T08:41:15.217710+0000","last_clean":"2023-12-22T08:41:15.217710+0000","last_became_active":"2023-12-22T08:41:14.076010+0000","last_became_peered":"2023-12-22T08:41:14.076010+0000","last_unstale":"2023-12-22T08:41:15.217710+0000","last_undegraded":"2023-12-22T08:41:15.217710+0000","last_fullsized":"2023-12-22T08:41:15.217710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:44.666544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.086851+0000","last_change":"2023-12-22T08:41:13.581212+0000","last_active":"2023-12-22T08:41:14.086851+0000","last_peered":"2023-12-22T08:41:14.086851+0000","last_clean":"2023-12-22T08:41:14.086851+0000","last_became_active":"2023-12-22T08:41:13.580846+0000","last_became_peered":"2023-12-22T08:41:13.580846+0000","last_unstale":"2023-12-22T08:41:14.086851+0000","last_undegraded":"2023-12-22T08:41:14.086851+0000","last_fullsized":"2023-12-22T08:41:14.086851+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219148+0000","last_change":"2023-12-22T08:41:14.096279+0000","last_active":"2023-12-22T08:41:15.219148+0000","last_peered":"2023-12-22T08:41:15.219148+0000","last_clean":"2023-12-22T08:41:15.219148+0000","last_became_active":"2023-12-22T08:41:14.095433+0000","last_became_peered":"2023-12-22T08:41:14.095433+0000","last_unstale":"2023-12-22T08:41:15.219148+0000","last_undegraded":"2023-12-22T08:41:15.219148+0000","last_fullsized":"2023-12-22T08:41:15.219148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:37:59.695494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.086429+0000","last_change":"2023-12-22T08:41:13.579166+0000","last_active":"2023-12-22T08:41:14.086429+0000","last_peered":"2023-12-22T08:41:14.086429+0000","last_clean":"2023-12-22T08:41:14.086429+0000","last_became_active":"2023-12-22T08:41:13.578664+0000","last_became_peered":"2023-12-22T08:41:13.578664+0000","last_unstale":"2023-12-22T08:41:14.086429+0000","last_undegraded":"2023-12-22T08:41:14.086429+0000","last_fullsized":"2023-12-22T08:41:14.086429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:14.972374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.086691+0000","last_change":"2023-12-22T08:41:14.099010+0000","last_active":"2023-12-22T08:41:15.086691+0000","last_peered":"2023-12-22T08:41:15.086691+0000","last_clean":"2023-12-22T08:41:15.086691+0000","last_became_active":"2023-12-22T08:41:14.096516+0000","last_became_peered":"2023-12-22T08:41:14.096516+0000","last_unstale":"2023-12-22T08:41:15.086691+0000","last_undegraded":"2023-12-22T08:41:15.086691+0000","last_fullsized":"2023-12-22T08:41:15.086691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:16.557452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.070743+0000","last_change":"2023-12-22T08:41:13.584163+0000","last_active":"2023-12-22T08:41:14.070743+0000","last_peered":"2023-12-22T08:41:14.070743+0000","last_clean":"2023-12-22T08:41:14.070743+0000","last_became_active":"2023-12-22T08:41:13.583522+0000","last_became_peered":"2023-12-22T08:41:13.583522+0000","last_unstale":"2023-12-22T08:41:14.070743+0000","last_undegraded":"2023-12-22T08:41:14.070743+0000","last_fullsized":"2023-12-22T08:41:14.070743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:36:58.096521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.085500+0000","last_change":"2023-12-22T08:41:14.091567+0000","last_active":"2023-12-22T08:41:15.085500+0000","last_peered":"2023-12-22T08:41:15.085500+0000","last_clean":"2023-12-22T08:41:15.085500+0000","last_became_active":"2023-12-22T08:41:14.090447+0000","last_became_peered":"2023-12-22T08:41:14.090447+0000","last_unstale":"2023-12-22T08:41:15.085500+0000","last_undegraded":"2023-12-22T08:41:15.085500+0000","last_fullsized":"2023-12-22T08:41:15.085500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:52:26.794837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.102998+0000","last_change":"2023-12-22T08:41:13.587355+0000","last_active":"2023-12-22T08:41:14.102998+0000","last_peered":"2023-12-22T08:41:14.102998+0000","last_clean":"2023-12-22T08:41:14.102998+0000","last_became_active":"2023-12-22T08:41:13.587071+0000","last_became_peered":"2023-12-22T08:41:13.587071+0000","last_unstale":"2023-12-22T08:41:14.102998+0000","last_undegraded":"2023-12-22T08:41:14.102998+0000","last_fullsized":"2023-12-22T08:41:14.102998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:20.321086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218536+0000","last_change":"2023-12-22T08:41:14.103164+0000","last_active":"2023-12-22T08:41:15.218536+0000","last_peered":"2023-12-22T08:41:15.218536+0000","last_clean":"2023-12-22T08:41:15.218536+0000","last_became_active":"2023-12-22T08:41:14.102678+0000","last_became_peered":"2023-12-22T08:41:14.102678+0000","last_unstale":"2023-12-22T08:41:15.218536+0000","last_undegraded":"2023-12-22T08:41:15.218536+0000","last_fullsized":"2023-12-22T08:41:15.218536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.077136+0000","last_change":"2023-12-22T08:41:13.580840+0000","last_active":"2023-12-22T08:41:14.077136+0000","last_peered":"2023-12-22T08:41:14.077136+0000","last_clean":"2023-12-22T08:41:14.077136+0000","last_became_active":"2023-12-22T08:41:13.580330+0000","last_became_peered":"2023-12-22T08:41:13.580330+0000","last_unstale":"2023-12-22T08:41:14.077136+0000","last_undegraded":"2023-12-22T08:41:14.077136+0000","last_fullsized":"2023-12-22T08:41:14.077136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084701+0000","last_change":"2023-12-22T08:41:14.099157+0000","last_active":"2023-12-22T08:41:15.084701+0000","last_peered":"2023-12-22T08:41:15.084701+0000","last_clean":"2023-12-22T08:41:15.084701+0000","last_became_active":"2023-12-22T08:41:14.098888+0000","last_became_peered":"2023-12-22T08:41:14.098888+0000","last_unstale":"2023-12-22T08:41:15.084701+0000","last_undegraded":"2023-12-22T08:41:15.084701+0000","last_fullsized":"2023-12-22T08:41:15.084701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:50.601030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.073807+0000","last_change":"2023-12-22T08:41:13.587592+0000","last_active":"2023-12-22T08:41:14.073807+0000","last_peered":"2023-12-22T08:41:14.073807+0000","last_clean":"2023-12-22T08:41:14.073807+0000","last_became_active":"2023-12-22T08:41:13.587106+0000","last_became_peered":"2023-12-22T08:41:13.587106+0000","last_unstale":"2023-12-22T08:41:14.073807+0000","last_undegraded":"2023-12-22T08:41:14.073807+0000","last_fullsized":"2023-12-22T08:41:14.073807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:33:01.715152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219254+0000","last_change":"2023-12-22T08:41:14.078519+0000","last_active":"2023-12-22T08:41:15.219254+0000","last_peered":"2023-12-22T08:41:15.219254+0000","last_clean":"2023-12-22T08:41:15.219254+0000","last_became_active":"2023-12-22T08:41:14.077901+0000","last_became_peered":"2023-12-22T08:41:14.077901+0000","last_unstale":"2023-12-22T08:41:15.219254+0000","last_undegraded":"2023-12-22T08:41:15.219254+0000","last_fullsized":"2023-12-22T08:41:15.219254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:36:21.697583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.073264+0000","last_change":"2023-12-22T08:41:13.578977+0000","last_active":"2023-12-22T08:41:14.073264+0000","last_peered":"2023-12-22T08:41:14.073264+0000","last_clean":"2023-12-22T08:41:14.073264+0000","last_became_active":"2023-12-22T08:41:13.578156+0000","last_became_peered":"2023-12-22T08:41:13.578156+0000","last_unstale":"2023-12-22T08:41:14.073264+0000","last_undegraded":"2023-12-22T08:41:14.073264+0000","last_fullsized":"2023-12-22T08:41:14.073264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:22:23.012211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.086043+0000","last_change":"2023-12-22T08:41:14.099210+0000","last_active":"2023-12-22T08:41:15.086043+0000","last_peered":"2023-12-22T08:41:15.086043+0000","last_clean":"2023-12-22T08:41:15.086043+0000","last_became_active":"2023-12-22T08:41:14.094413+0000","last_became_peered":"2023-12-22T08:41:14.094413+0000","last_unstale":"2023-12-22T08:41:15.086043+0000","last_undegraded":"2023-12-22T08:41:15.086043+0000","last_fullsized":"2023-12-22T08:41:15.086043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:05:33.306594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.100998+0000","last_change":"2023-12-22T08:41:13.579216+0000","last_active":"2023-12-22T08:41:14.100998+0000","last_peered":"2023-12-22T08:41:14.100998+0000","last_clean":"2023-12-22T08:41:14.100998+0000","last_became_active":"2023-12-22T08:41:13.578785+0000","last_became_peered":"2023-12-22T08:41:13.578785+0000","last_unstale":"2023-12-22T08:41:14.100998+0000","last_undegraded":"2023-12-22T08:41:14.100998+0000","last_fullsized":"2023-12-22T08:41:14.100998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:40:01.499763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080939+0000","last_change":"2023-12-22T08:41:14.096595+0000","last_active":"2023-12-22T08:41:15.080939+0000","last_peered":"2023-12-22T08:41:15.080939+0000","last_clean":"2023-12-22T08:41:15.080939+0000","last_became_active":"2023-12-22T08:41:14.096407+0000","last_became_peered":"2023-12-22T08:41:14.096407+0000","last_unstale":"2023-12-22T08:41:15.080939+0000","last_undegraded":"2023-12-22T08:41:15.080939+0000","last_fullsized":"2023-12-22T08:41:15.080939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:26.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219218+0000","last_change":"2023-12-22T08:41:13.585503+0000","last_active":"2023-12-22T08:41:15.219218+0000","last_peered":"2023-12-22T08:41:15.219218+0000","last_clean":"2023-12-22T08:41:15.219218+0000","last_became_active":"2023-12-22T08:41:13.585048+0000","last_became_peered":"2023-12-22T08:41:13.585048+0000","last_unstale":"2023-12-22T08:41:15.219218+0000","last_undegraded":"2023-12-22T08:41:15.219218+0000","last_fullsized":"2023-12-22T08:41:15.219218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:29:57.420192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084694+0000","last_change":"2023-12-22T08:41:14.097967+0000","last_active":"2023-12-22T08:41:15.084694+0000","last_peered":"2023-12-22T08:41:15.084694+0000","last_clean":"2023-12-22T08:41:15.084694+0000","last_became_active":"2023-12-22T08:41:14.093760+0000","last_became_peered":"2023-12-22T08:41:14.093760+0000","last_unstale":"2023-12-22T08:41:15.084694+0000","last_undegraded":"2023-12-22T08:41:15.084694+0000","last_fullsized":"2023-12-22T08:41:15.084694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:34.649905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.088432+0000","last_change":"2023-12-22T08:41:13.588185+0000","last_active":"2023-12-22T08:41:14.088432+0000","last_peered":"2023-12-22T08:41:14.088432+0000","last_clean":"2023-12-22T08:41:14.088432+0000","last_became_active":"2023-12-22T08:41:13.586420+0000","last_became_peered":"2023-12-22T08:41:13.586420+0000","last_unstale":"2023-12-22T08:41:14.088432+0000","last_undegraded":"2023-12-22T08:41:14.088432+0000","last_fullsized":"2023-12-22T08:41:14.088432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218177+0000","last_change":"2023-12-22T08:41:14.100004+0000","last_active":"2023-12-22T08:41:15.218177+0000","last_peered":"2023-12-22T08:41:15.218177+0000","last_clean":"2023-12-22T08:41:15.218177+0000","last_became_active":"2023-12-22T08:41:14.099784+0000","last_became_peered":"2023-12-22T08:41:14.099784+0000","last_unstale":"2023-12-22T08:41:15.218177+0000","last_undegraded":"2023-12-22T08:41:15.218177+0000","last_fullsized":"2023-12-22T08:41:15.218177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:44.745035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.087240+0000","last_change":"2023-12-22T08:41:13.579677+0000","last_active":"2023-12-22T08:41:14.087240+0000","last_peered":"2023-12-22T08:41:14.087240+0000","last_clean":"2023-12-22T08:41:14.087240+0000","last_became_active":"2023-12-22T08:41:13.579158+0000","last_became_peered":"2023-12-22T08:41:13.579158+0000","last_unstale":"2023-12-22T08:41:14.087240+0000","last_undegraded":"2023-12-22T08:41:14.087240+0000","last_fullsized":"2023-12-22T08:41:14.087240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219340+0000","last_change":"2023-12-22T08:41:14.100463+0000","last_active":"2023-12-22T08:41:15.219340+0000","last_peered":"2023-12-22T08:41:15.219340+0000","last_clean":"2023-12-22T08:41:15.219340+0000","last_became_active":"2023-12-22T08:41:14.099886+0000","last_became_peered":"2023-12-22T08:41:14.099886+0000","last_unstale":"2023-12-22T08:41:15.219340+0000","last_undegraded":"2023-12-22T08:41:15.219340+0000","last_fullsized":"2023-12-22T08:41:15.219340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:56.112979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.092134+0000","last_change":"2023-12-22T08:41:13.585376+0000","last_active":"2023-12-22T08:41:14.092134+0000","last_peered":"2023-12-22T08:41:14.092134+0000","last_clean":"2023-12-22T08:41:14.092134+0000","last_became_active":"2023-12-22T08:41:13.585049+0000","last_became_peered":"2023-12-22T08:41:13.585049+0000","last_unstale":"2023-12-22T08:41:14.092134+0000","last_undegraded":"2023-12-22T08:41:14.092134+0000","last_fullsized":"2023-12-22T08:41:14.092134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220519+0000","last_change":"2023-12-22T08:41:14.089434+0000","last_active":"2023-12-22T08:41:15.220519+0000","last_peered":"2023-12-22T08:41:15.220519+0000","last_clean":"2023-12-22T08:41:15.220519+0000","last_became_active":"2023-12-22T08:41:14.088912+0000","last_became_peered":"2023-12-22T08:41:14.088912+0000","last_unstale":"2023-12-22T08:41:15.220519+0000","last_undegraded":"2023-12-22T08:41:15.220519+0000","last_fullsized":"2023-12-22T08:41:15.220519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:36.121680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.078117+0000","last_change":"2023-12-22T08:41:13.586539+0000","last_active":"2023-12-22T08:41:14.078117+0000","last_peered":"2023-12-22T08:41:14.078117+0000","last_clean":"2023-12-22T08:41:14.078117+0000","last_became_active":"2023-12-22T08:41:13.586297+0000","last_became_peered":"2023-12-22T08:41:13.586297+0000","last_unstale":"2023-12-22T08:41:14.078117+0000","last_undegraded":"2023-12-22T08:41:14.078117+0000","last_fullsized":"2023-12-22T08:41:14.078117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:59:22.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080914+0000","last_change":"2023-12-22T08:41:14.096153+0000","last_active":"2023-12-22T08:41:15.080914+0000","last_peered":"2023-12-22T08:41:15.080914+0000","last_clean":"2023-12-22T08:41:15.080914+0000","last_became_active":"2023-12-22T08:41:14.095780+0000","last_became_peered":"2023-12-22T08:41:14.095780+0000","last_unstale":"2023-12-22T08:41:15.080914+0000","last_undegraded":"2023-12-22T08:41:15.080914+0000","last_fullsized":"2023-12-22T08:41:15.080914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:35.878406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.085353+0000","last_change":"2023-12-22T08:41:13.588613+0000","last_active":"2023-12-22T08:41:14.085353+0000","last_peered":"2023-12-22T08:41:14.085353+0000","last_clean":"2023-12-22T08:41:14.085353+0000","last_became_active":"2023-12-22T08:41:13.587854+0000","last_became_peered":"2023-12-22T08:41:13.587854+0000","last_unstale":"2023-12-22T08:41:14.085353+0000","last_undegraded":"2023-12-22T08:41:14.085353+0000","last_fullsized":"2023-12-22T08:41:14.085353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219952+0000","last_change":"2023-12-22T08:41:14.099842+0000","last_active":"2023-12-22T08:41:15.219952+0000","last_peered":"2023-12-22T08:41:15.219952+0000","last_clean":"2023-12-22T08:41:15.219952+0000","last_became_active":"2023-12-22T08:41:14.099597+0000","last_became_peered":"2023-12-22T08:41:14.099597+0000","last_unstale":"2023-12-22T08:41:15.219952+0000","last_undegraded":"2023-12-22T08:41:15.219952+0000","last_fullsized":"2023-12-22T08:41:15.219952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:15.989439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.073490+0000","last_change":"2023-12-22T08:41:13.584466+0000","last_active":"2023-12-22T08:41:14.073490+0000","last_peered":"2023-12-22T08:41:14.073490+0000","last_clean":"2023-12-22T08:41:14.073490+0000","last_became_active":"2023-12-22T08:41:13.583979+0000","last_became_peered":"2023-12-22T08:41:13.583979+0000","last_unstale":"2023-12-22T08:41:14.073490+0000","last_undegraded":"2023-12-22T08:41:14.073490+0000","last_fullsized":"2023-12-22T08:41:14.073490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:49.583965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.071097+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:41:14.071097+0000","last_peered":"2023-12-22T08:41:14.071097+0000","last_clean":"2023-12-22T08:41:14.071097+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:41:14.071097+0000","last_undegraded":"2023-12-22T08:41:14.071097+0000","last_fullsized":"2023-12-22T08:41:14.071097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195164,"statfs":{"total":200000000,"available":199848567,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.88200000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.202}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":1.038},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.272}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.98899999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.331},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.649}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.474},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.528}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.706}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":149,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847025,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.0489999999999999,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.84799999999999998}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.96599999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.083},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.02}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.1799999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.1180000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":723,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194588,"statfs":{"total":200000000,"available":199258658,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.1559999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.79,"5min":2.79,"15min":2.79},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.2070000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.248}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.024},{"interface":"front","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.3660000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.87}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.333}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.109},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":4.7249999999999996,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":1.2809999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":149,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847003,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.89800000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.008},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.153}]},{"osd":2,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.1160000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.2290000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.2829999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.0740000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.375},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.409}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847813,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.008},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.77700000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.069},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1639999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.492}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.121},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.371}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.294}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.401},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.55}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195164,"statfs":{"total":200000000,"available":199848555,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.83999999999999997}]},{"osd":1,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.238},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.90800000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.5249999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":5.4560000000000004,"5min":5.4560000000000004,"15min":5.4560000000000004},"last":1.573}]},{"osd":5,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":1.7},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":1.3240000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.361}]},{"osd":7,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.802},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.403}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":724,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194588,"statfs":{"total":200000000,"available":199258151,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.071},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.105}]},{"osd":2,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.02}]},{"osd":3,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.90300000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.347},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.29}]},{"osd":5,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.998}]},{"osd":6,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.1359999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.375},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":3.2959999999999998,"5min":3.2959999999999998,"15min":3.2959999999999998},"last":1.2629999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195164,"statfs":{"total":200000000,"available":199848499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.127},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.0009999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.089},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.294}]},{"osd":7,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.105},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.177}]}]}],"pool_statfs":[]}} 2023-12-22T08:41:23.781 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:41:24.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.019+0000 7f1d385dc640 1 Processor -- start 2023-12-22T08:41:24.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.019+0000 7f1d385dc640 1 -- start start 2023-12-22T08:41:24.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.021+0000 7f1d385dc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d300b2050 0x7f1d300b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.021+0000 7f1d385dc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1d30070800 0x7f1d30070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.021+0000 7f1d385dc640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d301450f0 con 0x7f1d30144d10 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.021+0000 7f1d385dc640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300cc840 con 0x7f1d30070800 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.021+0000 7f1d385dc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300ce010 con 0x7f1d300b2050 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.021+0000 7f1d36b79640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1d30070800 0x7f1d30070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.021+0000 7f1d36378640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1d30144d10 0x7f1d300cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53492/0 (socket says 172.21.15.38:53492) 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.021+0000 7f1d36378640 1 -- 172.21.15.38:0/317862908 learned_addr learned my addr 172.21.15.38:0/317862908 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.022+0000 7f1d35b77640 1 --2- 172.21.15.38:0/317862908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d300b2050 0x7f1d300b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.022+0000 7f1d36b79640 1 -- 172.21.15.38:0/317862908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d300b2050 msgr2=0x7f1d300b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.022+0000 7f1d36b79640 1 --2- 172.21.15.38:0/317862908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d300b2050 0x7f1d300b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.022+0000 7f1d36b79640 1 -- 172.21.15.38:0/317862908 >> v1:172.21.15.38:6789/0 conn(0x7f1d30144d10 legacy=0x7f1d300cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.022+0000 7f1d36b79640 1 -- 172.21.15.38:0/317862908 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d300b29f0 con 0x7f1d30070800 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.022+0000 7f1d35376640 1 -- 172.21.15.38:0/317862908 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47157249 0 0) 0x7f1d301450f0 con 0x7f1d30144d10 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.022+0000 7f1d35b77640 1 --2- 172.21.15.38:0/317862908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d300b2050 0x7f1d300b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.023+0000 7f1d36b79640 1 --2- 172.21.15.38:0/317862908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d30070800 0x7f1d30070c50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009d90 tx=0x7f1d2802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b189b65cca32f77 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.023+0000 7f1d35376640 1 -- 172.21.15.38:0/317862908 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2802cc50 con 0x7f1d30070800 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.023+0000 7f1d35376640 1 -- 172.21.15.38:0/317862908 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2802cdb0 con 0x7f1d30070800 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.023+0000 7f1d35376640 1 -- 172.21.15.38:0/317862908 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28034660 con 0x7f1d30070800 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.024+0000 7f1d385dc640 1 -- 172.21.15.38:0/317862908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d30070800 msgr2=0x7f1d30070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.024+0000 7f1d385dc640 1 --2- 172.21.15.38:0/317862908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d30070800 0x7f1d30070c50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009d90 tx=0x7f1d2802bea0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.024+0000 7f1d385dc640 1 -- 172.21.15.38:0/317862908 shutdown_connections 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.024+0000 7f1d385dc640 1 --2- 172.21.15.38:0/317862908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d30070800 0x7f1d30070c50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.024+0000 7f1d385dc640 1 --2- 172.21.15.38:0/317862908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d300b2050 0x7f1d300b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.024+0000 7f1d385dc640 1 -- 172.21.15.38:0/317862908 >> 172.21.15.38:0/317862908 conn(0x7f1d300cf070 msgr2=0x7f1d300cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.024+0000 7f1d385dc640 1 -- 172.21.15.38:0/317862908 shutdown_connections 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.024+0000 7f1d385dc640 1 -- 172.21.15.38:0/317862908 wait complete. 2023-12-22T08:41:24.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.026+0000 7f1d385dc640 1 Processor -- start 2023-12-22T08:41:24.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.026+0000 7f1d385dc640 1 -- start start 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.027+0000 7f1d385dc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d30070800 0x7f1d3015f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.027+0000 7f1d385dc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d300b2050 0x7f1d30155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.027+0000 7f1d385dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d30144d10 0x7f1d30154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.027+0000 7f1d385dc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d301593c0 con 0x7f1d30070800 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.027+0000 7f1d385dc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30158a20 con 0x7f1d30144d10 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.027+0000 7f1d385dc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30158d00 con 0x7f1d300b2050 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.027+0000 7f1d36378640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d30070800 0x7f1d3015f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.027+0000 7f1d36378640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d30070800 0x7f1d3015f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51076/0 (socket says 172.21.15.38:51076) 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.027+0000 7f1d36378640 1 -- 172.21.15.38:0/2700642981 learned_addr learned my addr 172.21.15.38:0/2700642981 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.028+0000 7f1d35b77640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d300b2050 0x7f1d30155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.028+0000 7f1d36b79640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d30144d10 0x7f1d30154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.028+0000 7f1d36378640 1 -- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d300b2050 msgr2=0x7f1d30155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.028+0000 7f1d36378640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d300b2050 0x7f1d30155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.028+0000 7f1d36378640 1 -- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d30144d10 msgr2=0x7f1d30154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.028+0000 7f1d36378640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d30144d10 0x7f1d30154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.028+0000 7f1d36378640 1 -- 172.21.15.38:0/2700642981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d28009a70 con 0x7f1d30070800 2023-12-22T08:41:24.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.028+0000 7f1d36378640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d30070800 0x7f1d3015f660 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c430 tx=0x7f1d2c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.028+0000 7f1d26ffd640 1 -- 172.21.15.38:0/2700642981 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c0074e0 con 0x7f1d30070800 2023-12-22T08:41:24.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.028+0000 7f1d26ffd640 1 -- 172.21.15.38:0/2700642981 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c007660 con 0x7f1d30070800 2023-12-22T08:41:24.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.028+0000 7f1d26ffd640 1 -- 172.21.15.38:0/2700642981 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c004a20 con 0x7f1d30070800 2023-12-22T08:41:24.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.029+0000 7f1d385dc640 1 -- 172.21.15.38:0/2700642981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d30158fe0 con 0x7f1d30070800 2023-12-22T08:41:24.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.029+0000 7f1d385dc640 1 -- 172.21.15.38:0/2700642981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d30154f80 con 0x7f1d30070800 2023-12-22T08:41:24.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.030+0000 7f1d385dc640 1 -- 172.21.15.38:0/2700642981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d300ccac0 con 0x7f1d30070800 2023-12-22T08:41:24.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.031+0000 7f1d26ffd640 1 -- 172.21.15.38:0/2700642981 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1d2c004b80 con 0x7f1d30070800 2023-12-22T08:41:24.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.032+0000 7f1d26ffd640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d1406a430 0x7f1d1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.032+0000 7f1d26ffd640 1 -- 172.21.15.38:0/2700642981 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d2c0887d0 con 0x7f1d30070800 2023-12-22T08:41:24.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.033+0000 7f1d35b77640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d1406a430 0x7f1d1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.034+0000 7f1d35b77640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d1406a430 0x7f1d1406c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1d300cb440 tx=0x7f1d20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.036+0000 7f1d26ffd640 1 -- 172.21.15.38:0/2700642981 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1d2c053db0 con 0x7f1d30070800 2023-12-22T08:41:24.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.229+0000 7f1d385dc640 1 -- 172.21.15.38:0/2700642981 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d300ce5d0 con 0x7f1d1406a430 2023-12-22T08:41:24.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.254+0000 7f1d26ffd640 1 -- 172.21.15.38:0/2700642981 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282652 (secure 0 0 0) 0x7f1d2000a660 con 0x7f1d1406a430 2023-12-22T08:41:24.260 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:24.261 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:41:24.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.260+0000 7f1d385dc640 1 -- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d1406a430 msgr2=0x7f1d1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.260+0000 7f1d385dc640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d1406a430 0x7f1d1406c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1d300cb440 tx=0x7f1d20008040 comp rx=0 tx=0).stop 2023-12-22T08:41:24.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.260+0000 7f1d385dc640 1 -- 172.21.15.38:0/2700642981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d30070800 msgr2=0x7f1d3015f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.260+0000 7f1d385dc640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d30070800 0x7f1d3015f660 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00c430 tx=0x7f1d2c00c8f0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.260+0000 7f1d385dc640 1 -- 172.21.15.38:0/2700642981 shutdown_connections 2023-12-22T08:41:24.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.260+0000 7f1d385dc640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d30144d10 0x7f1d30154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.260+0000 7f1d385dc640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d300b2050 0x7f1d30155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.260+0000 7f1d385dc640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d1406a430 0x7f1d1406c8f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.260+0000 7f1d385dc640 1 --2- 172.21.15.38:0/2700642981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d30070800 0x7f1d3015f660 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.260+0000 7f1d385dc640 1 -- 172.21.15.38:0/2700642981 >> 172.21.15.38:0/2700642981 conn(0x7f1d300cf070 msgr2=0x7f1d300cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:24.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.260+0000 7f1d385dc640 1 -- 172.21.15.38:0/2700642981 shutdown_connections 2023-12-22T08:41:24.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.260+0000 7f1d385dc640 1 -- 172.21.15.38:0/2700642981 wait complete. 2023-12-22T08:41:24.282 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-12-22T08:41:22.384919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2339,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560160,"statfs":{"total":1600000000,"available":1597604271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.313264"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217895+0000","last_change":"2023-12-22T08:41:14.083773+0000","last_active":"2023-12-22T08:41:15.217895+0000","last_peered":"2023-12-22T08:41:15.217895+0000","last_clean":"2023-12-22T08:41:15.217895+0000","last_became_active":"2023-12-22T08:41:14.083518+0000","last_became_peered":"2023-12-22T08:41:14.083518+0000","last_unstale":"2023-12-22T08:41:15.217895+0000","last_undegraded":"2023-12-22T08:41:15.217895+0000","last_fullsized":"2023-12-22T08:41:15.217895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:22:24.029276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218618+0000","last_change":"2023-12-22T08:41:14.102941+0000","last_active":"2023-12-22T08:41:15.218618+0000","last_peered":"2023-12-22T08:41:15.218618+0000","last_clean":"2023-12-22T08:41:15.218618+0000","last_became_active":"2023-12-22T08:41:14.102694+0000","last_became_peered":"2023-12-22T08:41:14.102694+0000","last_unstale":"2023-12-22T08:41:15.218618+0000","last_undegraded":"2023-12-22T08:41:15.218618+0000","last_fullsized":"2023-12-22T08:41:15.218618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:56.112979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217450+0000","last_change":"2023-12-22T08:41:14.081864+0000","last_active":"2023-12-22T08:41:15.217450+0000","last_peered":"2023-12-22T08:41:15.217450+0000","last_clean":"2023-12-22T08:41:15.217450+0000","last_became_active":"2023-12-22T08:41:14.081577+0000","last_became_peered":"2023-12-22T08:41:14.081577+0000","last_unstale":"2023-12-22T08:41:15.217450+0000","last_undegraded":"2023-12-22T08:41:15.217450+0000","last_fullsized":"2023-12-22T08:41:15.217450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:56.690991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220299+0000","last_change":"2023-12-22T08:41:14.087998+0000","last_active":"2023-12-22T08:41:15.220299+0000","last_peered":"2023-12-22T08:41:15.220299+0000","last_clean":"2023-12-22T08:41:15.220299+0000","last_became_active":"2023-12-22T08:41:14.087420+0000","last_became_peered":"2023-12-22T08:41:14.087420+0000","last_unstale":"2023-12-22T08:41:15.220299+0000","last_undegraded":"2023-12-22T08:41:15.220299+0000","last_fullsized":"2023-12-22T08:41:15.220299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:36:35.401856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219482+0000","last_change":"2023-12-22T08:41:14.106005+0000","last_active":"2023-12-22T08:41:15.219482+0000","last_peered":"2023-12-22T08:41:15.219482+0000","last_clean":"2023-12-22T08:41:15.219482+0000","last_became_active":"2023-12-22T08:41:14.105751+0000","last_became_peered":"2023-12-22T08:41:14.105751+0000","last_unstale":"2023-12-22T08:41:15.219482+0000","last_undegraded":"2023-12-22T08:41:15.219482+0000","last_fullsized":"2023-12-22T08:41:15.219482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.086366+0000","last_change":"2023-12-22T08:41:14.096790+0000","last_active":"2023-12-22T08:41:15.086366+0000","last_peered":"2023-12-22T08:41:15.086366+0000","last_clean":"2023-12-22T08:41:15.086366+0000","last_became_active":"2023-12-22T08:41:14.095986+0000","last_became_peered":"2023-12-22T08:41:14.095986+0000","last_unstale":"2023-12-22T08:41:15.086366+0000","last_undegraded":"2023-12-22T08:41:15.086366+0000","last_fullsized":"2023-12-22T08:41:15.086366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:21.338151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217829+0000","last_change":"2023-12-22T08:41:14.086953+0000","last_active":"2023-12-22T08:41:15.217829+0000","last_peered":"2023-12-22T08:41:15.217829+0000","last_clean":"2023-12-22T08:41:15.217829+0000","last_became_active":"2023-12-22T08:41:14.086743+0000","last_became_peered":"2023-12-22T08:41:14.086743+0000","last_unstale":"2023-12-22T08:41:15.217829+0000","last_undegraded":"2023-12-22T08:41:15.217829+0000","last_fullsized":"2023-12-22T08:41:15.217829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:37:59.695494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219080+0000","last_change":"2023-12-22T08:41:14.095859+0000","last_active":"2023-12-22T08:41:15.219080+0000","last_peered":"2023-12-22T08:41:15.219080+0000","last_clean":"2023-12-22T08:41:15.219080+0000","last_became_active":"2023-12-22T08:41:14.094827+0000","last_became_peered":"2023-12-22T08:41:14.094827+0000","last_unstale":"2023-12-22T08:41:15.219080+0000","last_undegraded":"2023-12-22T08:41:15.219080+0000","last_fullsized":"2023-12-22T08:41:15.219080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217556+0000","last_change":"2023-12-22T08:41:14.090024+0000","last_active":"2023-12-22T08:41:15.217556+0000","last_peered":"2023-12-22T08:41:15.217556+0000","last_clean":"2023-12-22T08:41:15.217556+0000","last_became_active":"2023-12-22T08:41:14.089413+0000","last_became_peered":"2023-12-22T08:41:14.089413+0000","last_unstale":"2023-12-22T08:41:15.217556+0000","last_undegraded":"2023-12-22T08:41:15.217556+0000","last_fullsized":"2023-12-22T08:41:15.217556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:40:02.516827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219678+0000","last_change":"2023-12-22T08:41:14.099756+0000","last_active":"2023-12-22T08:41:15.219678+0000","last_peered":"2023-12-22T08:41:15.219678+0000","last_clean":"2023-12-22T08:41:15.219678+0000","last_became_active":"2023-12-22T08:41:14.099195+0000","last_became_peered":"2023-12-22T08:41:14.099195+0000","last_unstale":"2023-12-22T08:41:15.219678+0000","last_undegraded":"2023-12-22T08:41:15.219678+0000","last_fullsized":"2023-12-22T08:41:15.219678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:24.381088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080699+0000","last_change":"2023-12-22T08:41:14.089198+0000","last_active":"2023-12-22T08:41:15.080699+0000","last_peered":"2023-12-22T08:41:15.080699+0000","last_clean":"2023-12-22T08:41:15.080699+0000","last_became_active":"2023-12-22T08:41:14.088946+0000","last_became_peered":"2023-12-22T08:41:14.088946+0000","last_unstale":"2023-12-22T08:41:15.080699+0000","last_undegraded":"2023-12-22T08:41:15.080699+0000","last_fullsized":"2023-12-22T08:41:15.080699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:49.001260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218705+0000","last_change":"2023-12-22T08:41:14.100779+0000","last_active":"2023-12-22T08:41:15.218705+0000","last_peered":"2023-12-22T08:41:15.218705+0000","last_clean":"2023-12-22T08:41:15.218705+0000","last_became_active":"2023-12-22T08:41:14.100546+0000","last_became_peered":"2023-12-22T08:41:14.100546+0000","last_unstale":"2023-12-22T08:41:15.218705+0000","last_undegraded":"2023-12-22T08:41:15.218705+0000","last_fullsized":"2023-12-22T08:41:15.218705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:59:23.975689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.083920+0000","last_change":"2023-12-22T08:41:14.104339+0000","last_active":"2023-12-22T08:41:15.083920+0000","last_peered":"2023-12-22T08:41:15.083920+0000","last_clean":"2023-12-22T08:41:15.083920+0000","last_became_active":"2023-12-22T08:41:14.099264+0000","last_became_peered":"2023-12-22T08:41:14.099264+0000","last_unstale":"2023-12-22T08:41:15.083920+0000","last_undegraded":"2023-12-22T08:41:15.083920+0000","last_fullsized":"2023-12-22T08:41:15.083920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:29:58.437257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219819+0000","last_change":"2023-12-22T08:41:14.104174+0000","last_active":"2023-12-22T08:41:15.219819+0000","last_peered":"2023-12-22T08:41:15.219819+0000","last_clean":"2023-12-22T08:41:15.219819+0000","last_became_active":"2023-12-22T08:41:14.103253+0000","last_became_peered":"2023-12-22T08:41:14.103253+0000","last_unstale":"2023-12-22T08:41:15.219819+0000","last_undegraded":"2023-12-22T08:41:15.219819+0000","last_fullsized":"2023-12-22T08:41:15.219819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:52:53.231438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219813+0000","last_change":"2023-12-22T08:41:14.081479+0000","last_active":"2023-12-22T08:41:15.219813+0000","last_peered":"2023-12-22T08:41:15.219813+0000","last_clean":"2023-12-22T08:41:15.219813+0000","last_became_active":"2023-12-22T08:41:14.080980+0000","last_became_peered":"2023-12-22T08:41:14.080980+0000","last_unstale":"2023-12-22T08:41:15.219813+0000","last_undegraded":"2023-12-22T08:41:15.219813+0000","last_fullsized":"2023-12-22T08:41:15.219813+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:50.601030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218634+0000","last_change":"2023-12-22T08:41:14.093504+0000","last_active":"2023-12-22T08:41:15.218634+0000","last_peered":"2023-12-22T08:41:15.218634+0000","last_clean":"2023-12-22T08:41:15.218634+0000","last_became_active":"2023-12-22T08:41:14.093196+0000","last_became_peered":"2023-12-22T08:41:14.093196+0000","last_unstale":"2023-12-22T08:41:15.218634+0000","last_undegraded":"2023-12-22T08:41:15.218634+0000","last_fullsized":"2023-12-22T08:41:15.218634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:37:59.695494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080552+0000","last_change":"2023-12-22T08:41:14.082409+0000","last_active":"2023-12-22T08:41:15.080552+0000","last_peered":"2023-12-22T08:41:15.080552+0000","last_clean":"2023-12-22T08:41:15.080552+0000","last_became_active":"2023-12-22T08:41:14.081886+0000","last_became_peered":"2023-12-22T08:41:14.081886+0000","last_unstale":"2023-12-22T08:41:15.080552+0000","last_undegraded":"2023-12-22T08:41:15.080552+0000","last_fullsized":"2023-12-22T08:41:15.080552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:21:20.048933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.085797+0000","last_change":"2023-12-22T08:41:14.105679+0000","last_active":"2023-12-22T08:41:15.085797+0000","last_peered":"2023-12-22T08:41:15.085797+0000","last_clean":"2023-12-22T08:41:15.085797+0000","last_became_active":"2023-12-22T08:41:14.105427+0000","last_became_peered":"2023-12-22T08:41:14.105427+0000","last_unstale":"2023-12-22T08:41:15.085797+0000","last_undegraded":"2023-12-22T08:41:15.085797+0000","last_fullsized":"2023-12-22T08:41:15.085797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:57.890451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084477+0000","last_change":"2023-12-22T08:41:14.094009+0000","last_active":"2023-12-22T08:41:15.084477+0000","last_peered":"2023-12-22T08:41:15.084477+0000","last_clean":"2023-12-22T08:41:15.084477+0000","last_became_active":"2023-12-22T08:41:14.093505+0000","last_became_peered":"2023-12-22T08:41:14.093505+0000","last_unstale":"2023-12-22T08:41:15.084477+0000","last_undegraded":"2023-12-22T08:41:15.084477+0000","last_fullsized":"2023-12-22T08:41:15.084477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:29:58.437257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084232+0000","last_change":"2023-12-22T08:41:14.104833+0000","last_active":"2023-12-22T08:41:15.084232+0000","last_peered":"2023-12-22T08:41:15.084232+0000","last_clean":"2023-12-22T08:41:15.084232+0000","last_became_active":"2023-12-22T08:41:14.100564+0000","last_became_peered":"2023-12-22T08:41:14.100564+0000","last_unstale":"2023-12-22T08:41:15.084232+0000","last_undegraded":"2023-12-22T08:41:15.084232+0000","last_fullsized":"2023-12-22T08:41:15.084232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:35.662994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218768+0000","last_change":"2023-12-22T08:41:14.098408+0000","last_active":"2023-12-22T08:41:15.218768+0000","last_peered":"2023-12-22T08:41:15.218768+0000","last_clean":"2023-12-22T08:41:15.218768+0000","last_became_active":"2023-12-22T08:41:14.098202+0000","last_became_peered":"2023-12-22T08:41:14.098202+0000","last_unstale":"2023-12-22T08:41:15.218768+0000","last_undegraded":"2023-12-22T08:41:15.218768+0000","last_fullsized":"2023-12-22T08:41:15.218768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:40.377312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217927+0000","last_change":"2023-12-22T08:41:14.088640+0000","last_active":"2023-12-22T08:41:15.217927+0000","last_peered":"2023-12-22T08:41:15.217927+0000","last_clean":"2023-12-22T08:41:15.217927+0000","last_became_active":"2023-12-22T08:41:14.088402+0000","last_became_peered":"2023-12-22T08:41:14.088402+0000","last_unstale":"2023-12-22T08:41:15.217927+0000","last_undegraded":"2023-12-22T08:41:15.217927+0000","last_fullsized":"2023-12-22T08:41:15.217927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:36.121680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084177+0000","last_change":"2023-12-22T08:41:14.098092+0000","last_active":"2023-12-22T08:41:15.084177+0000","last_peered":"2023-12-22T08:41:15.084177+0000","last_clean":"2023-12-22T08:41:15.084177+0000","last_became_active":"2023-12-22T08:41:14.092294+0000","last_became_peered":"2023-12-22T08:41:14.092294+0000","last_unstale":"2023-12-22T08:41:15.084177+0000","last_undegraded":"2023-12-22T08:41:15.084177+0000","last_fullsized":"2023-12-22T08:41:15.084177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:22:24.029276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218184+0000","last_change":"2023-12-22T08:41:14.088022+0000","last_active":"2023-12-22T08:41:15.218184+0000","last_peered":"2023-12-22T08:41:15.218184+0000","last_clean":"2023-12-22T08:41:15.218184+0000","last_became_active":"2023-12-22T08:41:14.087677+0000","last_became_peered":"2023-12-22T08:41:14.087677+0000","last_unstale":"2023-12-22T08:41:15.218184+0000","last_undegraded":"2023-12-22T08:41:15.218184+0000","last_fullsized":"2023-12-22T08:41:15.218184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:49:28.648602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219910+0000","last_change":"2023-12-22T08:41:14.090355+0000","last_active":"2023-12-22T08:41:15.219910+0000","last_peered":"2023-12-22T08:41:15.219910+0000","last_clean":"2023-12-22T08:41:15.219910+0000","last_became_active":"2023-12-22T08:41:14.089908+0000","last_became_peered":"2023-12-22T08:41:14.089908+0000","last_unstale":"2023-12-22T08:41:15.219910+0000","last_undegraded":"2023-12-22T08:41:15.219910+0000","last_fullsized":"2023-12-22T08:41:15.219910+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:25:50.465640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219702+0000","last_change":"2023-12-22T08:41:14.097459+0000","last_active":"2023-12-22T08:41:15.219702+0000","last_peered":"2023-12-22T08:41:15.219702+0000","last_clean":"2023-12-22T08:41:15.219702+0000","last_became_active":"2023-12-22T08:41:14.093400+0000","last_became_peered":"2023-12-22T08:41:14.093400+0000","last_unstale":"2023-12-22T08:41:15.219702+0000","last_undegraded":"2023-12-22T08:41:15.219702+0000","last_fullsized":"2023-12-22T08:41:15.219702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:42.793364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218867+0000","last_change":"2023-12-22T08:41:14.096429+0000","last_active":"2023-12-22T08:41:15.218867+0000","last_peered":"2023-12-22T08:41:15.218867+0000","last_clean":"2023-12-22T08:41:15.218867+0000","last_became_active":"2023-12-22T08:41:14.095805+0000","last_became_peered":"2023-12-22T08:41:14.095805+0000","last_unstale":"2023-12-22T08:41:15.218867+0000","last_undegraded":"2023-12-22T08:41:15.218867+0000","last_fullsized":"2023-12-22T08:41:15.218867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:44.745035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219220+0000","last_change":"2023-12-22T08:41:14.095717+0000","last_active":"2023-12-22T08:41:15.219220+0000","last_peered":"2023-12-22T08:41:15.219220+0000","last_clean":"2023-12-22T08:41:15.219220+0000","last_became_active":"2023-12-22T08:41:14.094456+0000","last_became_peered":"2023-12-22T08:41:14.094456+0000","last_unstale":"2023-12-22T08:41:15.219220+0000","last_undegraded":"2023-12-22T08:41:15.219220+0000","last_fullsized":"2023-12-22T08:41:15.219220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217815+0000","last_change":"2023-12-22T08:41:14.088071+0000","last_active":"2023-12-22T08:41:15.217815+0000","last_peered":"2023-12-22T08:41:15.217815+0000","last_clean":"2023-12-22T08:41:15.217815+0000","last_became_active":"2023-12-22T08:41:14.087707+0000","last_became_peered":"2023-12-22T08:41:14.087707+0000","last_unstale":"2023-12-22T08:41:15.217815+0000","last_undegraded":"2023-12-22T08:41:15.217815+0000","last_fullsized":"2023-12-22T08:41:15.217815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219882+0000","last_change":"2023-12-22T08:41:14.076875+0000","last_active":"2023-12-22T08:41:15.219882+0000","last_peered":"2023-12-22T08:41:15.219882+0000","last_clean":"2023-12-22T08:41:15.219882+0000","last_became_active":"2023-12-22T08:41:14.076641+0000","last_became_peered":"2023-12-22T08:41:14.076641+0000","last_unstale":"2023-12-22T08:41:15.219882+0000","last_undegraded":"2023-12-22T08:41:15.219882+0000","last_fullsized":"2023-12-22T08:41:15.219882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218058+0000","last_change":"2023-12-22T08:41:14.100889+0000","last_active":"2023-12-22T08:41:15.218058+0000","last_peered":"2023-12-22T08:41:15.218058+0000","last_clean":"2023-12-22T08:41:15.218058+0000","last_became_active":"2023-12-22T08:41:14.100503+0000","last_became_peered":"2023-12-22T08:41:14.100503+0000","last_unstale":"2023-12-22T08:41:15.218058+0000","last_undegraded":"2023-12-22T08:41:15.218058+0000","last_fullsized":"2023-12-22T08:41:15.218058+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:03:04.272947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080632+0000","last_change":"2023-12-22T08:41:14.082276+0000","last_active":"2023-12-22T08:41:15.080632+0000","last_peered":"2023-12-22T08:41:15.080632+0000","last_clean":"2023-12-22T08:41:15.080632+0000","last_became_active":"2023-12-22T08:41:14.081594+0000","last_became_peered":"2023-12-22T08:41:14.081594+0000","last_unstale":"2023-12-22T08:41:15.080632+0000","last_undegraded":"2023-12-22T08:41:15.080632+0000","last_fullsized":"2023-12-22T08:41:15.080632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:49.203160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.083113+0000","last_change":"2023-12-22T08:41:14.093264+0000","last_active":"2023-12-22T08:41:15.083113+0000","last_peered":"2023-12-22T08:41:15.083113+0000","last_clean":"2023-12-22T08:41:15.083113+0000","last_became_active":"2023-12-22T08:41:14.092862+0000","last_became_peered":"2023-12-22T08:41:14.092862+0000","last_unstale":"2023-12-22T08:41:15.083113+0000","last_undegraded":"2023-12-22T08:41:15.083113+0000","last_fullsized":"2023-12-22T08:41:15.083113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:15.989439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.098889+0000","last_change":"2023-12-22T08:41:13.584014+0000","last_active":"2023-12-22T08:41:14.098889+0000","last_peered":"2023-12-22T08:41:14.098889+0000","last_clean":"2023-12-22T08:41:14.098889+0000","last_became_active":"2023-12-22T08:41:13.583526+0000","last_became_peered":"2023-12-22T08:41:13.583526+0000","last_unstale":"2023-12-22T08:41:14.098889+0000","last_undegraded":"2023-12-22T08:41:14.098889+0000","last_fullsized":"2023-12-22T08:41:14.098889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:28.401635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219355+0000","last_change":"2023-12-22T08:41:14.096810+0000","last_active":"2023-12-22T08:41:15.219355+0000","last_peered":"2023-12-22T08:41:15.219355+0000","last_clean":"2023-12-22T08:41:15.219355+0000","last_became_active":"2023-12-22T08:41:14.096572+0000","last_became_peered":"2023-12-22T08:41:14.096572+0000","last_unstale":"2023-12-22T08:41:15.219355+0000","last_undegraded":"2023-12-22T08:41:15.219355+0000","last_fullsized":"2023-12-22T08:41:15.219355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:40.377312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.103708+0000","last_change":"2023-12-22T08:41:13.588809+0000","last_active":"2023-12-22T08:41:14.103708+0000","last_peered":"2023-12-22T08:41:14.103708+0000","last_clean":"2023-12-22T08:41:14.103708+0000","last_became_active":"2023-12-22T08:41:13.588188+0000","last_became_peered":"2023-12-22T08:41:13.588188+0000","last_unstale":"2023-12-22T08:41:14.103708+0000","last_undegraded":"2023-12-22T08:41:14.103708+0000","last_fullsized":"2023-12-22T08:41:14.103708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218226+0000","last_change":"2023-12-22T08:41:14.089905+0000","last_active":"2023-12-22T08:41:15.218226+0000","last_peered":"2023-12-22T08:41:15.218226+0000","last_clean":"2023-12-22T08:41:15.218226+0000","last_became_active":"2023-12-22T08:41:14.089223+0000","last_became_peered":"2023-12-22T08:41:14.089223+0000","last_unstale":"2023-12-22T08:41:15.218226+0000","last_undegraded":"2023-12-22T08:41:15.218226+0000","last_fullsized":"2023-12-22T08:41:15.218226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:56.112979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.104190+0000","last_change":"2023-12-22T08:41:13.589272+0000","last_active":"2023-12-22T08:41:14.104190+0000","last_peered":"2023-12-22T08:41:14.104190+0000","last_clean":"2023-12-22T08:41:14.104190+0000","last_became_active":"2023-12-22T08:41:13.588959+0000","last_became_peered":"2023-12-22T08:41:13.588959+0000","last_unstale":"2023-12-22T08:41:14.104190+0000","last_undegraded":"2023-12-22T08:41:14.104190+0000","last_fullsized":"2023-12-22T08:41:14.104190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:59:22.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220322+0000","last_change":"2023-12-22T08:41:14.099602+0000","last_active":"2023-12-22T08:41:15.220322+0000","last_peered":"2023-12-22T08:41:15.220322+0000","last_clean":"2023-12-22T08:41:15.220322+0000","last_became_active":"2023-12-22T08:41:14.098849+0000","last_became_peered":"2023-12-22T08:41:14.098849+0000","last_unstale":"2023-12-22T08:41:15.220322+0000","last_undegraded":"2023-12-22T08:41:15.220322+0000","last_fullsized":"2023-12-22T08:41:15.220322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.106506+0000","last_change":"2023-12-22T08:41:13.581861+0000","last_active":"2023-12-22T08:41:14.106506+0000","last_peered":"2023-12-22T08:41:14.106506+0000","last_clean":"2023-12-22T08:41:14.106506+0000","last_became_active":"2023-12-22T08:41:13.580825+0000","last_became_peered":"2023-12-22T08:41:13.580825+0000","last_unstale":"2023-12-22T08:41:14.106506+0000","last_undegraded":"2023-12-22T08:41:14.106506+0000","last_fullsized":"2023-12-22T08:41:14.106506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:12.338282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218398+0000","last_change":"2023-12-22T08:41:14.090078+0000","last_active":"2023-12-22T08:41:15.218398+0000","last_peered":"2023-12-22T08:41:15.218398+0000","last_clean":"2023-12-22T08:41:15.218398+0000","last_became_active":"2023-12-22T08:41:14.089833+0000","last_became_peered":"2023-12-22T08:41:14.089833+0000","last_unstale":"2023-12-22T08:41:15.218398+0000","last_undegraded":"2023-12-22T08:41:15.218398+0000","last_fullsized":"2023-12-22T08:41:15.218398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:10.771817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.098282+0000","last_change":"2023-12-22T08:41:13.580635+0000","last_active":"2023-12-22T08:41:14.098282+0000","last_peered":"2023-12-22T08:41:14.098282+0000","last_clean":"2023-12-22T08:41:14.098282+0000","last_became_active":"2023-12-22T08:41:13.580315+0000","last_became_peered":"2023-12-22T08:41:13.580315+0000","last_unstale":"2023-12-22T08:41:14.098282+0000","last_undegraded":"2023-12-22T08:41:14.098282+0000","last_fullsized":"2023-12-22T08:41:14.098282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:55.673926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218027+0000","last_change":"2023-12-22T08:41:14.095668+0000","last_active":"2023-12-22T08:41:15.218027+0000","last_peered":"2023-12-22T08:41:15.218027+0000","last_clean":"2023-12-22T08:41:15.218027+0000","last_became_active":"2023-12-22T08:41:14.095439+0000","last_became_peered":"2023-12-22T08:41:14.095439+0000","last_unstale":"2023-12-22T08:41:15.218027+0000","last_undegraded":"2023-12-22T08:41:15.218027+0000","last_fullsized":"2023-12-22T08:41:15.218027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:42.793364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.094986+0000","last_change":"2023-12-22T08:41:13.579491+0000","last_active":"2023-12-22T08:41:14.094986+0000","last_peered":"2023-12-22T08:41:14.094986+0000","last_clean":"2023-12-22T08:41:14.094986+0000","last_became_active":"2023-12-22T08:41:13.579126+0000","last_became_peered":"2023-12-22T08:41:13.579126+0000","last_unstale":"2023-12-22T08:41:14.094986+0000","last_undegraded":"2023-12-22T08:41:14.094986+0000","last_fullsized":"2023-12-22T08:41:14.094986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219117+0000","last_change":"2023-12-22T08:41:14.079079+0000","last_active":"2023-12-22T08:41:15.219117+0000","last_peered":"2023-12-22T08:41:15.219117+0000","last_clean":"2023-12-22T08:41:15.219117+0000","last_became_active":"2023-12-22T08:41:14.078289+0000","last_became_peered":"2023-12-22T08:41:14.078289+0000","last_unstale":"2023-12-22T08:41:15.219117+0000","last_undegraded":"2023-12-22T08:41:15.219117+0000","last_fullsized":"2023-12-22T08:41:15.219117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:11:06.064557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.088639+0000","last_change":"2023-12-22T08:41:13.590636+0000","last_active":"2023-12-22T08:41:14.088639+0000","last_peered":"2023-12-22T08:41:14.088639+0000","last_clean":"2023-12-22T08:41:14.088639+0000","last_became_active":"2023-12-22T08:41:13.589949+0000","last_became_peered":"2023-12-22T08:41:13.589949+0000","last_unstale":"2023-12-22T08:41:14.088639+0000","last_undegraded":"2023-12-22T08:41:14.088639+0000","last_fullsized":"2023-12-22T08:41:14.088639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220046+0000","last_change":"2023-12-22T08:41:14.087827+0000","last_active":"2023-12-22T08:41:15.220046+0000","last_peered":"2023-12-22T08:41:15.220046+0000","last_clean":"2023-12-22T08:41:15.220046+0000","last_became_active":"2023-12-22T08:41:14.087045+0000","last_became_peered":"2023-12-22T08:41:14.087045+0000","last_unstale":"2023-12-22T08:41:15.220046+0000","last_undegraded":"2023-12-22T08:41:15.220046+0000","last_fullsized":"2023-12-22T08:41:15.220046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:30:11.801978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.077845+0000","last_change":"2023-12-22T08:41:13.586921+0000","last_active":"2023-12-22T08:41:14.077845+0000","last_peered":"2023-12-22T08:41:14.077845+0000","last_clean":"2023-12-22T08:41:14.077845+0000","last_became_active":"2023-12-22T08:41:13.586392+0000","last_became_peered":"2023-12-22T08:41:13.586392+0000","last_unstale":"2023-12-22T08:41:14.077845+0000","last_undegraded":"2023-12-22T08:41:14.077845+0000","last_fullsized":"2023-12-22T08:41:14.077845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:06:57.933316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080734+0000","last_change":"2023-12-22T08:41:14.099246+0000","last_active":"2023-12-22T08:41:15.080734+0000","last_peered":"2023-12-22T08:41:15.080734+0000","last_clean":"2023-12-22T08:41:15.080734+0000","last_became_active":"2023-12-22T08:41:14.099015+0000","last_became_peered":"2023-12-22T08:41:14.099015+0000","last_unstale":"2023-12-22T08:41:15.080734+0000","last_undegraded":"2023-12-22T08:41:15.080734+0000","last_fullsized":"2023-12-22T08:41:15.080734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:37:03.425289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.091162+0000","last_change":"2023-12-22T08:41:13.578368+0000","last_active":"2023-12-22T08:41:14.091162+0000","last_peered":"2023-12-22T08:41:14.091162+0000","last_clean":"2023-12-22T08:41:14.091162+0000","last_became_active":"2023-12-22T08:41:13.577907+0000","last_became_peered":"2023-12-22T08:41:13.577907+0000","last_unstale":"2023-12-22T08:41:14.091162+0000","last_undegraded":"2023-12-22T08:41:14.091162+0000","last_fullsized":"2023-12-22T08:41:14.091162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:05:32.289529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219102+0000","last_change":"2023-12-22T08:41:14.101049+0000","last_active":"2023-12-22T08:41:15.219102+0000","last_peered":"2023-12-22T08:41:15.219102+0000","last_clean":"2023-12-22T08:41:15.219102+0000","last_became_active":"2023-12-22T08:41:14.100198+0000","last_became_peered":"2023-12-22T08:41:14.100198+0000","last_unstale":"2023-12-22T08:41:15.219102+0000","last_undegraded":"2023-12-22T08:41:15.219102+0000","last_fullsized":"2023-12-22T08:41:15.219102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:49:28.648602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.095202+0000","last_change":"2023-12-22T08:41:13.585931+0000","last_active":"2023-12-22T08:41:14.095202+0000","last_peered":"2023-12-22T08:41:14.095202+0000","last_clean":"2023-12-22T08:41:14.095202+0000","last_became_active":"2023-12-22T08:41:13.585676+0000","last_became_peered":"2023-12-22T08:41:13.585676+0000","last_unstale":"2023-12-22T08:41:14.095202+0000","last_undegraded":"2023-12-22T08:41:14.095202+0000","last_fullsized":"2023-12-22T08:41:14.095202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:56.873386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220681+0000","last_change":"2023-12-22T08:41:14.091150+0000","last_active":"2023-12-22T08:41:15.220681+0000","last_peered":"2023-12-22T08:41:15.220681+0000","last_clean":"2023-12-22T08:41:15.220681+0000","last_became_active":"2023-12-22T08:41:14.089208+0000","last_became_peered":"2023-12-22T08:41:14.089208+0000","last_unstale":"2023-12-22T08:41:15.220681+0000","last_undegraded":"2023-12-22T08:41:15.220681+0000","last_fullsized":"2023-12-22T08:41:15.220681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:03:04.272947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.086529+0000","last_change":"2023-12-22T08:41:13.581406+0000","last_active":"2023-12-22T08:41:14.086529+0000","last_peered":"2023-12-22T08:41:14.086529+0000","last_clean":"2023-12-22T08:41:14.086529+0000","last_became_active":"2023-12-22T08:41:13.581185+0000","last_became_peered":"2023-12-22T08:41:13.581185+0000","last_unstale":"2023-12-22T08:41:14.086529+0000","last_undegraded":"2023-12-22T08:41:14.086529+0000","last_fullsized":"2023-12-22T08:41:14.086529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:43.727970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080685+0000","last_change":"2023-12-22T08:41:14.088889+0000","last_active":"2023-12-22T08:41:15.080685+0000","last_peered":"2023-12-22T08:41:15.080685+0000","last_clean":"2023-12-22T08:41:15.080685+0000","last_became_active":"2023-12-22T08:41:14.088632+0000","last_became_peered":"2023-12-22T08:41:14.088632+0000","last_unstale":"2023-12-22T08:41:15.080685+0000","last_undegraded":"2023-12-22T08:41:15.080685+0000","last_fullsized":"2023-12-22T08:41:15.080685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:35.696117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.107527+0000","last_change":"2023-12-22T08:41:13.583907+0000","last_active":"2023-12-22T08:41:14.107527+0000","last_peered":"2023-12-22T08:41:14.107527+0000","last_clean":"2023-12-22T08:41:14.107527+0000","last_became_active":"2023-12-22T08:41:13.583541+0000","last_became_peered":"2023-12-22T08:41:13.583541+0000","last_unstale":"2023-12-22T08:41:14.107527+0000","last_undegraded":"2023-12-22T08:41:14.107527+0000","last_fullsized":"2023-12-22T08:41:14.107527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:55.673926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084469+0000","last_change":"2023-12-22T08:41:14.093509+0000","last_active":"2023-12-22T08:41:15.084469+0000","last_peered":"2023-12-22T08:41:15.084469+0000","last_clean":"2023-12-22T08:41:15.084469+0000","last_became_active":"2023-12-22T08:41:14.093237+0000","last_became_peered":"2023-12-22T08:41:14.093237+0000","last_unstale":"2023-12-22T08:41:15.084469+0000","last_undegraded":"2023-12-22T08:41:15.084469+0000","last_fullsized":"2023-12-22T08:41:15.084469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:34.649905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.087086+0000","last_change":"2023-12-22T08:41:13.587326+0000","last_active":"2023-12-22T08:41:14.087086+0000","last_peered":"2023-12-22T08:41:14.087086+0000","last_clean":"2023-12-22T08:41:14.087086+0000","last_became_active":"2023-12-22T08:41:13.586696+0000","last_became_peered":"2023-12-22T08:41:13.586696+0000","last_unstale":"2023-12-22T08:41:14.087086+0000","last_undegraded":"2023-12-22T08:41:14.087086+0000","last_fullsized":"2023-12-22T08:41:14.087086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:40:01.499763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220533+0000","last_change":"2023-12-22T08:41:14.099450+0000","last_active":"2023-12-22T08:41:15.220533+0000","last_peered":"2023-12-22T08:41:15.220533+0000","last_clean":"2023-12-22T08:41:15.220533+0000","last_became_active":"2023-12-22T08:41:14.098493+0000","last_became_peered":"2023-12-22T08:41:14.098493+0000","last_unstale":"2023-12-22T08:41:15.220533+0000","last_undegraded":"2023-12-22T08:41:15.220533+0000","last_fullsized":"2023-12-22T08:41:15.220533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:17:29.418699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.083278+0000","last_change":"2023-12-22T08:41:13.589524+0000","last_active":"2023-12-22T08:41:14.083278+0000","last_peered":"2023-12-22T08:41:14.083278+0000","last_clean":"2023-12-22T08:41:14.083278+0000","last_became_active":"2023-12-22T08:41:13.589280+0000","last_became_peered":"2023-12-22T08:41:13.589280+0000","last_unstale":"2023-12-22T08:41:14.083278+0000","last_undegraded":"2023-12-22T08:41:14.083278+0000","last_fullsized":"2023-12-22T08:41:14.083278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:15.540388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219485+0000","last_change":"2023-12-22T08:41:14.085416+0000","last_active":"2023-12-22T08:41:15.219485+0000","last_peered":"2023-12-22T08:41:15.219485+0000","last_clean":"2023-12-22T08:41:15.219485+0000","last_became_active":"2023-12-22T08:41:14.085082+0000","last_became_peered":"2023-12-22T08:41:14.085082+0000","last_unstale":"2023-12-22T08:41:15.219485+0000","last_undegraded":"2023-12-22T08:41:15.219485+0000","last_fullsized":"2023-12-22T08:41:15.219485+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:44.745035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.080556+0000","last_change":"2023-12-22T08:41:13.583098+0000","last_active":"2023-12-22T08:41:14.080556+0000","last_peered":"2023-12-22T08:41:14.080556+0000","last_clean":"2023-12-22T08:41:14.080556+0000","last_became_active":"2023-12-22T08:41:13.582809+0000","last_became_peered":"2023-12-22T08:41:13.582809+0000","last_unstale":"2023-12-22T08:41:14.080556+0000","last_undegraded":"2023-12-22T08:41:14.080556+0000","last_fullsized":"2023-12-22T08:41:14.080556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:42:51.564771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080835+0000","last_change":"2023-12-22T08:41:14.082128+0000","last_active":"2023-12-22T08:41:15.080835+0000","last_peered":"2023-12-22T08:41:15.080835+0000","last_clean":"2023-12-22T08:41:15.080835+0000","last_became_active":"2023-12-22T08:41:14.081273+0000","last_became_peered":"2023-12-22T08:41:14.081273+0000","last_unstale":"2023-12-22T08:41:15.080835+0000","last_undegraded":"2023-12-22T08:41:15.080835+0000","last_fullsized":"2023-12-22T08:41:15.080835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:24.381088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.105144+0000","last_change":"2023-12-22T08:41:13.587615+0000","last_active":"2023-12-22T08:41:14.105144+0000","last_peered":"2023-12-22T08:41:14.105144+0000","last_clean":"2023-12-22T08:41:14.105144+0000","last_became_active":"2023-12-22T08:41:13.587387+0000","last_became_peered":"2023-12-22T08:41:13.587387+0000","last_unstale":"2023-12-22T08:41:14.105144+0000","last_undegraded":"2023-12-22T08:41:14.105144+0000","last_fullsized":"2023-12-22T08:41:14.105144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:11:05.047493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.081153+0000","last_change":"2023-12-22T08:41:14.095349+0000","last_active":"2023-12-22T08:41:15.081153+0000","last_peered":"2023-12-22T08:41:15.081153+0000","last_clean":"2023-12-22T08:41:15.081153+0000","last_became_active":"2023-12-22T08:41:14.094909+0000","last_became_peered":"2023-12-22T08:41:14.094909+0000","last_unstale":"2023-12-22T08:41:15.081153+0000","last_undegraded":"2023-12-22T08:41:15.081153+0000","last_fullsized":"2023-12-22T08:41:15.081153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:29.434181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.104459+0000","last_change":"2023-12-22T08:41:13.590820+0000","last_active":"2023-12-22T08:41:14.104459+0000","last_peered":"2023-12-22T08:41:14.104459+0000","last_clean":"2023-12-22T08:41:14.104459+0000","last_became_active":"2023-12-22T08:41:13.590381+0000","last_became_peered":"2023-12-22T08:41:13.590381+0000","last_unstale":"2023-12-22T08:41:14.104459+0000","last_undegraded":"2023-12-22T08:41:14.104459+0000","last_fullsized":"2023-12-22T08:41:14.104459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:36:20.680519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.217710+0000","last_change":"2023-12-22T08:41:14.076288+0000","last_active":"2023-12-22T08:41:15.217710+0000","last_peered":"2023-12-22T08:41:15.217710+0000","last_clean":"2023-12-22T08:41:15.217710+0000","last_became_active":"2023-12-22T08:41:14.076010+0000","last_became_peered":"2023-12-22T08:41:14.076010+0000","last_unstale":"2023-12-22T08:41:15.217710+0000","last_undegraded":"2023-12-22T08:41:15.217710+0000","last_fullsized":"2023-12-22T08:41:15.217710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:44.666544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.086851+0000","last_change":"2023-12-22T08:41:13.581212+0000","last_active":"2023-12-22T08:41:14.086851+0000","last_peered":"2023-12-22T08:41:14.086851+0000","last_clean":"2023-12-22T08:41:14.086851+0000","last_became_active":"2023-12-22T08:41:13.580846+0000","last_became_peered":"2023-12-22T08:41:13.580846+0000","last_unstale":"2023-12-22T08:41:14.086851+0000","last_undegraded":"2023-12-22T08:41:14.086851+0000","last_fullsized":"2023-12-22T08:41:14.086851+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219148+0000","last_change":"2023-12-22T08:41:14.096279+0000","last_active":"2023-12-22T08:41:15.219148+0000","last_peered":"2023-12-22T08:41:15.219148+0000","last_clean":"2023-12-22T08:41:15.219148+0000","last_became_active":"2023-12-22T08:41:14.095433+0000","last_became_peered":"2023-12-22T08:41:14.095433+0000","last_unstale":"2023-12-22T08:41:15.219148+0000","last_undegraded":"2023-12-22T08:41:15.219148+0000","last_fullsized":"2023-12-22T08:41:15.219148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:37:59.695494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.086429+0000","last_change":"2023-12-22T08:41:13.579166+0000","last_active":"2023-12-22T08:41:14.086429+0000","last_peered":"2023-12-22T08:41:14.086429+0000","last_clean":"2023-12-22T08:41:14.086429+0000","last_became_active":"2023-12-22T08:41:13.578664+0000","last_became_peered":"2023-12-22T08:41:13.578664+0000","last_unstale":"2023-12-22T08:41:14.086429+0000","last_undegraded":"2023-12-22T08:41:14.086429+0000","last_fullsized":"2023-12-22T08:41:14.086429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:14.972374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.086691+0000","last_change":"2023-12-22T08:41:14.099010+0000","last_active":"2023-12-22T08:41:15.086691+0000","last_peered":"2023-12-22T08:41:15.086691+0000","last_clean":"2023-12-22T08:41:15.086691+0000","last_became_active":"2023-12-22T08:41:14.096516+0000","last_became_peered":"2023-12-22T08:41:14.096516+0000","last_unstale":"2023-12-22T08:41:15.086691+0000","last_undegraded":"2023-12-22T08:41:15.086691+0000","last_fullsized":"2023-12-22T08:41:15.086691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:40:16.557452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.070743+0000","last_change":"2023-12-22T08:41:13.584163+0000","last_active":"2023-12-22T08:41:14.070743+0000","last_peered":"2023-12-22T08:41:14.070743+0000","last_clean":"2023-12-22T08:41:14.070743+0000","last_became_active":"2023-12-22T08:41:13.583522+0000","last_became_peered":"2023-12-22T08:41:13.583522+0000","last_unstale":"2023-12-22T08:41:14.070743+0000","last_undegraded":"2023-12-22T08:41:14.070743+0000","last_fullsized":"2023-12-22T08:41:14.070743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:36:58.096521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.085500+0000","last_change":"2023-12-22T08:41:14.091567+0000","last_active":"2023-12-22T08:41:15.085500+0000","last_peered":"2023-12-22T08:41:15.085500+0000","last_clean":"2023-12-22T08:41:15.085500+0000","last_became_active":"2023-12-22T08:41:14.090447+0000","last_became_peered":"2023-12-22T08:41:14.090447+0000","last_unstale":"2023-12-22T08:41:15.085500+0000","last_undegraded":"2023-12-22T08:41:15.085500+0000","last_fullsized":"2023-12-22T08:41:15.085500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:52:26.794837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.102998+0000","last_change":"2023-12-22T08:41:13.587355+0000","last_active":"2023-12-22T08:41:14.102998+0000","last_peered":"2023-12-22T08:41:14.102998+0000","last_clean":"2023-12-22T08:41:14.102998+0000","last_became_active":"2023-12-22T08:41:13.587071+0000","last_became_peered":"2023-12-22T08:41:13.587071+0000","last_unstale":"2023-12-22T08:41:14.102998+0000","last_undegraded":"2023-12-22T08:41:14.102998+0000","last_fullsized":"2023-12-22T08:41:14.102998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:20.321086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218536+0000","last_change":"2023-12-22T08:41:14.103164+0000","last_active":"2023-12-22T08:41:15.218536+0000","last_peered":"2023-12-22T08:41:15.218536+0000","last_clean":"2023-12-22T08:41:15.218536+0000","last_became_active":"2023-12-22T08:41:14.102678+0000","last_became_peered":"2023-12-22T08:41:14.102678+0000","last_unstale":"2023-12-22T08:41:15.218536+0000","last_undegraded":"2023-12-22T08:41:15.218536+0000","last_fullsized":"2023-12-22T08:41:15.218536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:36.381094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.077136+0000","last_change":"2023-12-22T08:41:13.580840+0000","last_active":"2023-12-22T08:41:14.077136+0000","last_peered":"2023-12-22T08:41:14.077136+0000","last_clean":"2023-12-22T08:41:14.077136+0000","last_became_active":"2023-12-22T08:41:13.580330+0000","last_became_peered":"2023-12-22T08:41:13.580330+0000","last_unstale":"2023-12-22T08:41:14.077136+0000","last_undegraded":"2023-12-22T08:41:14.077136+0000","last_fullsized":"2023-12-22T08:41:14.077136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084701+0000","last_change":"2023-12-22T08:41:14.099157+0000","last_active":"2023-12-22T08:41:15.084701+0000","last_peered":"2023-12-22T08:41:15.084701+0000","last_clean":"2023-12-22T08:41:15.084701+0000","last_became_active":"2023-12-22T08:41:14.098888+0000","last_became_peered":"2023-12-22T08:41:14.098888+0000","last_unstale":"2023-12-22T08:41:15.084701+0000","last_undegraded":"2023-12-22T08:41:15.084701+0000","last_fullsized":"2023-12-22T08:41:15.084701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:50.601030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.073807+0000","last_change":"2023-12-22T08:41:13.587592+0000","last_active":"2023-12-22T08:41:14.073807+0000","last_peered":"2023-12-22T08:41:14.073807+0000","last_clean":"2023-12-22T08:41:14.073807+0000","last_became_active":"2023-12-22T08:41:13.587106+0000","last_became_peered":"2023-12-22T08:41:13.587106+0000","last_unstale":"2023-12-22T08:41:14.073807+0000","last_undegraded":"2023-12-22T08:41:14.073807+0000","last_fullsized":"2023-12-22T08:41:14.073807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:33:01.715152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219254+0000","last_change":"2023-12-22T08:41:14.078519+0000","last_active":"2023-12-22T08:41:15.219254+0000","last_peered":"2023-12-22T08:41:15.219254+0000","last_clean":"2023-12-22T08:41:15.219254+0000","last_became_active":"2023-12-22T08:41:14.077901+0000","last_became_peered":"2023-12-22T08:41:14.077901+0000","last_unstale":"2023-12-22T08:41:15.219254+0000","last_undegraded":"2023-12-22T08:41:15.219254+0000","last_fullsized":"2023-12-22T08:41:15.219254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:36:21.697583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.073264+0000","last_change":"2023-12-22T08:41:13.578977+0000","last_active":"2023-12-22T08:41:14.073264+0000","last_peered":"2023-12-22T08:41:14.073264+0000","last_clean":"2023-12-22T08:41:14.073264+0000","last_became_active":"2023-12-22T08:41:13.578156+0000","last_became_peered":"2023-12-22T08:41:13.578156+0000","last_unstale":"2023-12-22T08:41:14.073264+0000","last_undegraded":"2023-12-22T08:41:14.073264+0000","last_fullsized":"2023-12-22T08:41:14.073264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:22:23.012211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.086043+0000","last_change":"2023-12-22T08:41:14.099210+0000","last_active":"2023-12-22T08:41:15.086043+0000","last_peered":"2023-12-22T08:41:15.086043+0000","last_clean":"2023-12-22T08:41:15.086043+0000","last_became_active":"2023-12-22T08:41:14.094413+0000","last_became_peered":"2023-12-22T08:41:14.094413+0000","last_unstale":"2023-12-22T08:41:15.086043+0000","last_undegraded":"2023-12-22T08:41:15.086043+0000","last_fullsized":"2023-12-22T08:41:15.086043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:05:33.306594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.100998+0000","last_change":"2023-12-22T08:41:13.579216+0000","last_active":"2023-12-22T08:41:14.100998+0000","last_peered":"2023-12-22T08:41:14.100998+0000","last_clean":"2023-12-22T08:41:14.100998+0000","last_became_active":"2023-12-22T08:41:13.578785+0000","last_became_peered":"2023-12-22T08:41:13.578785+0000","last_unstale":"2023-12-22T08:41:14.100998+0000","last_undegraded":"2023-12-22T08:41:14.100998+0000","last_fullsized":"2023-12-22T08:41:14.100998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:40:01.499763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080939+0000","last_change":"2023-12-22T08:41:14.096595+0000","last_active":"2023-12-22T08:41:15.080939+0000","last_peered":"2023-12-22T08:41:15.080939+0000","last_clean":"2023-12-22T08:41:15.080939+0000","last_became_active":"2023-12-22T08:41:14.096407+0000","last_became_peered":"2023-12-22T08:41:14.096407+0000","last_unstale":"2023-12-22T08:41:15.080939+0000","last_undegraded":"2023-12-22T08:41:15.080939+0000","last_fullsized":"2023-12-22T08:41:15.080939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:49:26.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219218+0000","last_change":"2023-12-22T08:41:13.585503+0000","last_active":"2023-12-22T08:41:15.219218+0000","last_peered":"2023-12-22T08:41:15.219218+0000","last_clean":"2023-12-22T08:41:15.219218+0000","last_became_active":"2023-12-22T08:41:13.585048+0000","last_became_peered":"2023-12-22T08:41:13.585048+0000","last_unstale":"2023-12-22T08:41:15.219218+0000","last_undegraded":"2023-12-22T08:41:15.219218+0000","last_fullsized":"2023-12-22T08:41:15.219218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:29:57.420192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.084694+0000","last_change":"2023-12-22T08:41:14.097967+0000","last_active":"2023-12-22T08:41:15.084694+0000","last_peered":"2023-12-22T08:41:15.084694+0000","last_clean":"2023-12-22T08:41:15.084694+0000","last_became_active":"2023-12-22T08:41:14.093760+0000","last_became_peered":"2023-12-22T08:41:14.093760+0000","last_unstale":"2023-12-22T08:41:15.084694+0000","last_undegraded":"2023-12-22T08:41:15.084694+0000","last_fullsized":"2023-12-22T08:41:15.084694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:30:34.649905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.088432+0000","last_change":"2023-12-22T08:41:13.588185+0000","last_active":"2023-12-22T08:41:14.088432+0000","last_peered":"2023-12-22T08:41:14.088432+0000","last_clean":"2023-12-22T08:41:14.088432+0000","last_became_active":"2023-12-22T08:41:13.586420+0000","last_became_peered":"2023-12-22T08:41:13.586420+0000","last_unstale":"2023-12-22T08:41:14.088432+0000","last_undegraded":"2023-12-22T08:41:14.088432+0000","last_fullsized":"2023-12-22T08:41:14.088432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.218177+0000","last_change":"2023-12-22T08:41:14.100004+0000","last_active":"2023-12-22T08:41:15.218177+0000","last_peered":"2023-12-22T08:41:15.218177+0000","last_clean":"2023-12-22T08:41:15.218177+0000","last_became_active":"2023-12-22T08:41:14.099784+0000","last_became_peered":"2023-12-22T08:41:14.099784+0000","last_unstale":"2023-12-22T08:41:15.218177+0000","last_undegraded":"2023-12-22T08:41:15.218177+0000","last_fullsized":"2023-12-22T08:41:15.218177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:44.745035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.087240+0000","last_change":"2023-12-22T08:41:13.579677+0000","last_active":"2023-12-22T08:41:14.087240+0000","last_peered":"2023-12-22T08:41:14.087240+0000","last_clean":"2023-12-22T08:41:14.087240+0000","last_became_active":"2023-12-22T08:41:13.579158+0000","last_became_peered":"2023-12-22T08:41:13.579158+0000","last_unstale":"2023-12-22T08:41:14.087240+0000","last_undegraded":"2023-12-22T08:41:14.087240+0000","last_fullsized":"2023-12-22T08:41:14.087240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:09.754752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219340+0000","last_change":"2023-12-22T08:41:14.100463+0000","last_active":"2023-12-22T08:41:15.219340+0000","last_peered":"2023-12-22T08:41:15.219340+0000","last_clean":"2023-12-22T08:41:15.219340+0000","last_became_active":"2023-12-22T08:41:14.099886+0000","last_became_peered":"2023-12-22T08:41:14.099886+0000","last_unstale":"2023-12-22T08:41:15.219340+0000","last_undegraded":"2023-12-22T08:41:15.219340+0000","last_fullsized":"2023-12-22T08:41:15.219340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:56.112979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.092134+0000","last_change":"2023-12-22T08:41:13.585376+0000","last_active":"2023-12-22T08:41:14.092134+0000","last_peered":"2023-12-22T08:41:14.092134+0000","last_clean":"2023-12-22T08:41:14.092134+0000","last_became_active":"2023-12-22T08:41:13.585049+0000","last_became_peered":"2023-12-22T08:41:13.585049+0000","last_unstale":"2023-12-22T08:41:14.092134+0000","last_undegraded":"2023-12-22T08:41:14.092134+0000","last_fullsized":"2023-12-22T08:41:14.092134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:14:43.649479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.220519+0000","last_change":"2023-12-22T08:41:14.089434+0000","last_active":"2023-12-22T08:41:15.220519+0000","last_peered":"2023-12-22T08:41:15.220519+0000","last_clean":"2023-12-22T08:41:15.220519+0000","last_became_active":"2023-12-22T08:41:14.088912+0000","last_became_peered":"2023-12-22T08:41:14.088912+0000","last_unstale":"2023-12-22T08:41:15.220519+0000","last_undegraded":"2023-12-22T08:41:15.220519+0000","last_fullsized":"2023-12-22T08:41:15.220519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:19:36.121680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.078117+0000","last_change":"2023-12-22T08:41:13.586539+0000","last_active":"2023-12-22T08:41:14.078117+0000","last_peered":"2023-12-22T08:41:14.078117+0000","last_clean":"2023-12-22T08:41:14.078117+0000","last_became_active":"2023-12-22T08:41:13.586297+0000","last_became_peered":"2023-12-22T08:41:13.586297+0000","last_unstale":"2023-12-22T08:41:14.078117+0000","last_undegraded":"2023-12-22T08:41:14.078117+0000","last_fullsized":"2023-12-22T08:41:14.078117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:59:22.958625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.080914+0000","last_change":"2023-12-22T08:41:14.096153+0000","last_active":"2023-12-22T08:41:15.080914+0000","last_peered":"2023-12-22T08:41:15.080914+0000","last_clean":"2023-12-22T08:41:15.080914+0000","last_became_active":"2023-12-22T08:41:14.095780+0000","last_became_peered":"2023-12-22T08:41:14.095780+0000","last_unstale":"2023-12-22T08:41:15.080914+0000","last_undegraded":"2023-12-22T08:41:15.080914+0000","last_fullsized":"2023-12-22T08:41:15.080914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:35.878406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.085353+0000","last_change":"2023-12-22T08:41:13.588613+0000","last_active":"2023-12-22T08:41:14.085353+0000","last_peered":"2023-12-22T08:41:14.085353+0000","last_clean":"2023-12-22T08:41:14.085353+0000","last_became_active":"2023-12-22T08:41:13.587854+0000","last_became_peered":"2023-12-22T08:41:13.587854+0000","last_unstale":"2023-12-22T08:41:14.085353+0000","last_undegraded":"2023-12-22T08:41:14.085353+0000","last_fullsized":"2023-12-22T08:41:14.085353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:27.132916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T08:41:15.219952+0000","last_change":"2023-12-22T08:41:14.099842+0000","last_active":"2023-12-22T08:41:15.219952+0000","last_peered":"2023-12-22T08:41:15.219952+0000","last_clean":"2023-12-22T08:41:15.219952+0000","last_became_active":"2023-12-22T08:41:14.099597+0000","last_became_peered":"2023-12-22T08:41:14.099597+0000","last_unstale":"2023-12-22T08:41:15.219952+0000","last_undegraded":"2023-12-22T08:41:15.219952+0000","last_fullsized":"2023-12-22T08:41:15.219952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:13.537615+0000","last_clean_scrub_stamp":"2023-12-22T08:41:13.537615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:15.989439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.073490+0000","last_change":"2023-12-22T08:41:13.584466+0000","last_active":"2023-12-22T08:41:14.073490+0000","last_peered":"2023-12-22T08:41:14.073490+0000","last_clean":"2023-12-22T08:41:14.073490+0000","last_became_active":"2023-12-22T08:41:13.583979+0000","last_became_peered":"2023-12-22T08:41:13.583979+0000","last_unstale":"2023-12-22T08:41:14.073490+0000","last_undegraded":"2023-12-22T08:41:14.073490+0000","last_fullsized":"2023-12-22T08:41:14.073490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:12.520550+0000","last_clean_scrub_stamp":"2023-12-22T08:41:12.520550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:48:49.583965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-22T08:41:14.071097+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:41:14.071097+0000","last_peered":"2023-12-22T08:41:14.071097+0000","last_clean":"2023-12-22T08:41:14.071097+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:41:14.071097+0000","last_undegraded":"2023-12-22T08:41:14.071097+0000","last_fullsized":"2023-12-22T08:41:14.071097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195164,"statfs":{"total":200000000,"available":199848567,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.88200000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.202}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":1.038},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.272}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.98899999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.331},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.649}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.474},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.528}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.706}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":149,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847025,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.0489999999999999,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.84799999999999998}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.96599999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.083},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.02}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.1799999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.1180000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":723,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194588,"statfs":{"total":200000000,"available":199258658,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":3.1379999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.1559999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.79,"5min":2.79,"15min":2.79},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.2070000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.248}]},{"osd":3,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.024},{"interface":"front","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.3660000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.87}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.333}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.109},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":4.7249999999999996,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":1.2809999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":149,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847003,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.89800000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.008},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.153}]},{"osd":2,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.1160000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.2290000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.2829999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.0740000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:40:48 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.375},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.409}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":148,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195163,"statfs":{"total":200000000,"available":199847813,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.008},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.77700000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.069},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1639999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.492}]},{"osd":4,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.121},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.371}]},{"osd":5,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.294}]},{"osd":6,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.401},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Dec 22 08:40:49 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.55}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195164,"statfs":{"total":200000000,"available":199848555,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.83999999999999997}]},{"osd":1,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.238},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.90800000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.5249999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":5.4560000000000004,"5min":5.4560000000000004,"15min":5.4560000000000004},"last":1.573}]},{"osd":5,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":1.7},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":1.3240000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.361}]},{"osd":7,"last update":"Fri Dec 22 08:40:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.802},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.403}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":724,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194588,"statfs":{"total":200000000,"available":199258151,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.071},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.105}]},{"osd":2,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":1.02}]},{"osd":3,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.90300000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.347},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.29}]},{"osd":5,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.998}]},{"osd":6,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.1359999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:40:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.375},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":3.2959999999999998,"5min":3.2959999999999998,"15min":3.2959999999999998},"last":1.2629999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":147,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195164,"statfs":{"total":200000000,"available":199848499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.83199999999999996}]},{"osd":4,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.127},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.0009999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.089},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.294}]},{"osd":7,"last update":"Fri Dec 22 08:40:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.105},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.177}]}]}],"pool_statfs":[]}} 2023-12-22T08:41:24.288 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T08:41:24.288 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T08:41:24.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.565+0000 7f12e6604640 1 Processor -- start 2023-12-22T08:41:24.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.565+0000 7f12e6604640 1 -- start start 2023-12-22T08:41:24.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.566+0000 7f12e6604640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f12e0145fb0 0x7f12e00d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.566+0000 7f12e6604640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12e0146390 0x7f12e00b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.566+0000 7f12e6604640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e00b3b40 con 0x7f12e00b4eb0 2023-12-22T08:41:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.566+0000 7f12e6604640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e00b3d70 con 0x7f12e0145fb0 2023-12-22T08:41:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.566+0000 7f12e6604640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00b4050 con 0x7f12e0146390 2023-12-22T08:41:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.567+0000 7f12e4ba1640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f12e00b4eb0 0x7f12e01610e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53502/0 (socket says 172.21.15.38:53502) 2023-12-22T08:41:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.567+0000 7f12e4ba1640 1 -- 172.21.15.38:0/2106930902 learned_addr learned my addr 172.21.15.38:0/2106930902 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.567+0000 7f12dffff640 1 --2- 172.21.15.38:0/2106930902 >> v2:172.21.15.89:3300/0 conn(0x7f12e0145fb0 0x7f12e00d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.567+0000 7f12df7fe640 1 --2- 172.21.15.38:0/2106930902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12e0146390 0x7f12e00b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.567+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29334986 0 0) 0x7f12e00b3b40 con 0x7f12e00b4eb0 2023-12-22T08:41:24.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.567+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12cc003520 con 0x7f12e00b4eb0 2023-12-22T08:41:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1845911476 0 0) 0x7f12cc003520 con 0x7f12e00b4eb0 2023-12-22T08:41:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12e0146390 msgr2=0x7f12e00b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 --2- 172.21.15.38:0/2106930902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12e0146390 0x7f12e00b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 >> v2:172.21.15.89:3300/0 conn(0x7f12e0145fb0 msgr2=0x7f12e00d2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 --2- 172.21.15.38:0/2106930902 >> v2:172.21.15.89:3300/0 conn(0x7f12e0145fb0 0x7f12e00d2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e00b4330 con 0x7f12e00b4eb0 2023-12-22T08:41:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f12d80019f0 con 0x7f12e00b4eb0 2023-12-22T08:41:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 >> v1:172.21.15.38:6789/0 conn(0x7f12e00b4eb0 legacy=0x7f12e01610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 --2- 172.21.15.38:0/2106930902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12e0146390 0x7f12cc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 --2- 172.21.15.38:0/2106930902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12cc003ef0 0x7f12cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 --2- 172.21.15.38:0/2106930902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12cc004d00 0x7f12cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00b3d70 con 0x7f12cc003ef0 2023-12-22T08:41:24.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00b4050 con 0x7f12cc004d00 2023-12-22T08:41:24.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc00b980 con 0x7f12e0146390 2023-12-22T08:41:24.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12df7fe640 1 --2- 172.21.15.38:0/2106930902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12cc003ef0 0x7f12cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12e4ba1640 1 --2- 172.21.15.38:0/2106930902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12cc004d00 0x7f12cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12df7fe640 1 -- 172.21.15.38:0/2106930902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12e0146390 msgr2=0x7f12cc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12df7fe640 1 --2- 172.21.15.38:0/2106930902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12e0146390 0x7f12cc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12df7fe640 1 -- 172.21.15.38:0/2106930902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12cc004d00 msgr2=0x7f12cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12df7fe640 1 --2- 172.21.15.38:0/2106930902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12cc004d00 0x7f12cc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.568+0000 7f12df7fe640 1 -- 172.21.15.38:0/2106930902 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc003520 con 0x7f12cc003ef0 2023-12-22T08:41:24.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.570+0000 7f12df7fe640 1 --2- 172.21.15.38:0/2106930902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12cc003ef0 0x7f12cc0047c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009ac0 tx=0x7f12cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2eb29bc91911 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.570+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c802c6d0 con 0x7f12cc003ef0 2023-12-22T08:41:24.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.570+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c802c830 con 0x7f12cc003ef0 2023-12-22T08:41:24.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.570+0000 7f12deffd640 1 -- 172.21.15.38:0/2106930902 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c802cbc0 con 0x7f12cc003ef0 2023-12-22T08:41:24.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.571+0000 7f12e6604640 1 -- 172.21.15.38:0/2106930902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12cc003ef0 msgr2=0x7f12cc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.571+0000 7f12e6604640 1 --2- 172.21.15.38:0/2106930902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12cc003ef0 0x7f12cc0047c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009ac0 tx=0x7f12cc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.571+0000 7f12e4ba1640 1 -- 172.21.15.38:0/2106930902 reap_dead start 2023-12-22T08:41:24.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.571+0000 7f12e6604640 1 -- 172.21.15.38:0/2106930902 shutdown_connections 2023-12-22T08:41:24.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.571+0000 7f12e6604640 1 -- 172.21.15.38:0/2106930902 >> 172.21.15.38:0/2106930902 conn(0x7f12e0070770 msgr2=0x7f12e006e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:24.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.571+0000 7f12e6604640 1 -- 172.21.15.38:0/2106930902 shutdown_connections 2023-12-22T08:41:24.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.571+0000 7f12e6604640 1 -- 172.21.15.38:0/2106930902 wait complete. 2023-12-22T08:41:24.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.573+0000 7f12e6604640 1 Processor -- start 2023-12-22T08:41:24.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.573+0000 7f12e6604640 1 -- start start 2023-12-22T08:41:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.574+0000 7f12e6604640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12cc003ef0 0x7f12e01555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.574+0000 7f12e6604640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12e013cca0 0x7f12e00b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.574+0000 7f12e6604640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12e013d1f0 0x7f12e00b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.574+0000 7f12e6604640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0156540 con 0x7f12e013d1f0 2023-12-22T08:41:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.574+0000 7f12e6604640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0158c70 con 0x7f12cc003ef0 2023-12-22T08:41:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.574+0000 7f12e6604640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0158f50 con 0x7f12e013cca0 2023-12-22T08:41:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.574+0000 7f12e4ba1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12e013d1f0 0x7f12e00b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.574+0000 7f12e4ba1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12e013d1f0 0x7f12e00b74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51084/0 (socket says 172.21.15.38:51084) 2023-12-22T08:41:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.574+0000 7f12e4ba1640 1 -- 172.21.15.38:0/1009118601 learned_addr learned my addr 172.21.15.38:0/1009118601 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:24.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.574+0000 7f12dffff640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12cc003ef0 0x7f12e01555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.574+0000 7f12df7fe640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12e013cca0 0x7f12e00b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.575+0000 7f12e4ba1640 1 -- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12e013cca0 msgr2=0x7f12e00b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.575+0000 7f12e4ba1640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12e013cca0 0x7f12e00b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.575+0000 7f12e4ba1640 1 -- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12cc003ef0 msgr2=0x7f12e01555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.575+0000 7f12e4ba1640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12cc003ef0 0x7f12e01555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.575+0000 7f12e4ba1640 1 -- 172.21.15.38:0/1009118601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e0156750 con 0x7f12e013d1f0 2023-12-22T08:41:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.575+0000 7f12e4ba1640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12e013d1f0 0x7f12e00b74e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f12d8002230 tx=0x7f12d800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.575+0000 7f12dcff9640 1 -- 172.21.15.38:0/1009118601 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8007aa0 con 0x7f12e013d1f0 2023-12-22T08:41:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.575+0000 7f12dcff9640 1 -- 172.21.15.38:0/1009118601 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d800ee20 con 0x7f12e013d1f0 2023-12-22T08:41:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.575+0000 7f12dcff9640 1 -- 172.21.15.38:0/1009118601 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8013660 con 0x7f12e013d1f0 2023-12-22T08:41:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.575+0000 7f12e6604640 1 -- 172.21.15.38:0/1009118601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e0156a30 con 0x7f12e013d1f0 2023-12-22T08:41:24.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.575+0000 7f12e6604640 1 -- 172.21.15.38:0/1009118601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e006cec0 con 0x7f12e013d1f0 2023-12-22T08:41:24.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.577+0000 7f12e6604640 1 -- 172.21.15.38:0/1009118601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e0061910 con 0x7f12e013d1f0 2023-12-22T08:41:24.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.577+0000 7f12dcff9640 1 -- 172.21.15.38:0/1009118601 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f12d80137c0 con 0x7f12e013d1f0 2023-12-22T08:41:24.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.579+0000 7f12dcff9640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12c006a430 0x7f12c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.579+0000 7f12dcff9640 1 -- 172.21.15.38:0/1009118601 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12d8088e40 con 0x7f12e013d1f0 2023-12-22T08:41:24.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.580+0000 7f12dffff640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12c006a430 0x7f12c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.581+0000 7f12dffff640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12c006a430 0x7f12c006c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f12d00047b0 tx=0x7f12d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.584+0000 7f12dcff9640 1 -- 172.21.15.38:0/1009118601 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f12d8054420 con 0x7f12e013d1f0 2023-12-22T08:41:24.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.846+0000 7f12e6604640 1 -- 172.21.15.38:0/1009118601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f12e0161e00 con 0x7f12e013d1f0 2023-12-22T08:41:24.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.854+0000 7f12dcff9640 1 -- 172.21.15.38:0/1009118601 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7f12d8057a40 con 0x7f12e013d1f0 2023-12-22T08:41:24.856 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.0 2023-12-22T08:41:24.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.857+0000 7f12e6604640 1 -- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12c006a430 msgr2=0x7f12c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.857+0000 7f12e6604640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12c006a430 0x7f12c006c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f12d00047b0 tx=0x7f12d0008040 comp rx=0 tx=0).stop 2023-12-22T08:41:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.857+0000 7f12e6604640 1 -- 172.21.15.38:0/1009118601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12e013d1f0 msgr2=0x7f12e00b74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.857+0000 7f12e6604640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12e013d1f0 0x7f12e00b74e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f12d8002230 tx=0x7f12d800e530 comp rx=0 tx=0).stop 2023-12-22T08:41:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.858+0000 7f12e6604640 1 -- 172.21.15.38:0/1009118601 shutdown_connections 2023-12-22T08:41:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.858+0000 7f12e6604640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12c006a430 0x7f12c006c8f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.858+0000 7f12e6604640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12e013d1f0 0x7f12e00b74e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.858+0000 7f12e6604640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12e013cca0 0x7f12e00b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.858+0000 7f12e6604640 1 --2- 172.21.15.38:0/1009118601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12cc003ef0 0x7f12e01555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.858+0000 7f12e6604640 1 -- 172.21.15.38:0/1009118601 >> 172.21.15.38:0/1009118601 conn(0x7f12e0070770 msgr2=0x7f12e015cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.858+0000 7f12e6604640 1 -- 172.21.15.38:0/1009118601 shutdown_connections 2023-12-22T08:41:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:24.858+0000 7f12e6604640 1 -- 172.21.15.38:0/1009118601 wait complete. 2023-12-22T08:41:24.880 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:25.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.100+0000 7f8de9850640 1 Processor -- start 2023-12-22T08:41:25.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.100+0000 7f8de9850640 1 -- start start 2023-12-22T08:41:25.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.102+0000 7f8de9850640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8de415ef60 0x7f8de4071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:25.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.102+0000 7f8de9850640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de40718a0 con 0x7f8de40cca90 2023-12-22T08:41:25.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.102+0000 7f8de9850640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de4071b80 con 0x7f8de415f340 2023-12-22T08:41:25.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.102+0000 7f8de9850640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de406f3f0 con 0x7f8de415ef60 2023-12-22T08:41:25.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.103+0000 7f8de904f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8de40cca90 0x7f8de406f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53510/0 (socket says 172.21.15.38:53510) 2023-12-22T08:41:25.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.103+0000 7f8de904f640 1 -- 172.21.15.38:0/2057734700 learned_addr learned my addr 172.21.15.38:0/2057734700 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:25.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.103+0000 7f8de884e640 1 --2- 172.21.15.38:0/2057734700 >> v2:172.21.15.89:3300/0 conn(0x7f8de415ef60 0x7f8de4071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:25.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.103+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247894165 0 0) 0x7f8de40718a0 con 0x7f8de40cca90 2023-12-22T08:41:25.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.103+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dd4003520 con 0x7f8de40cca90 2023-12-22T08:41:25.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3591459814 0 0) 0x7f8dd4003520 con 0x7f8de40cca90 2023-12-22T08:41:25.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 >> v2:172.21.15.89:3300/0 conn(0x7f8de415ef60 msgr2=0x7f8de4071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:25.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de37fe640 1 --2- 172.21.15.38:0/2057734700 >> v2:172.21.15.89:3300/0 conn(0x7f8de415ef60 0x7f8de4071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 >> v1:172.21.15.89:6789/0 conn(0x7f8de415f340 legacy=0x7f8de40cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:25.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4071e60 con 0x7f8de40cca90 2023-12-22T08:41:25.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f8ddc0019f0 con 0x7f8de40cca90 2023-12-22T08:41:25.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 >> v1:172.21.15.38:6789/0 conn(0x7f8de40cca90 legacy=0x7f8de406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:25.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de37fe640 1 --2- 172.21.15.38:0/2057734700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8dd4003970 0x7f8dd4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:25.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de37fe640 1 --2- 172.21.15.38:0/2057734700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dd40047c0 0x7f8dd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:25.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de37fe640 1 --2- 172.21.15.38:0/2057734700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8dd4005180 0x7f8dd400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:25.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de406f3f0 con 0x7f8dd4003970 2023-12-22T08:41:25.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd400c120 con 0x7f8dd4005180 2023-12-22T08:41:25.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd400c2e0 con 0x7f8dd40047c0 2023-12-22T08:41:25.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.104+0000 7f8de884e640 1 --2- 172.21.15.38:0/2057734700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8dd4003970 0x7f8dd4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:25.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.105+0000 7f8de884e640 1 -- 172.21.15.38:0/2057734700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dd40047c0 msgr2=0x7f8dd4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:25.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.105+0000 7f8de884e640 1 --2- 172.21.15.38:0/2057734700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dd40047c0 0x7f8dd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.105+0000 7f8de884e640 1 -- 172.21.15.38:0/2057734700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8dd4005180 msgr2=0x7f8dd400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:25.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.105+0000 7f8de904f640 1 --2- 172.21.15.38:0/2057734700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8dd4005180 0x7f8dd400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:25.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.105+0000 7f8de884e640 1 --2- 172.21.15.38:0/2057734700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8dd4005180 0x7f8dd400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.105+0000 7f8de904f640 1 -- 172.21.15.38:0/2057734700 reap_dead start 2023-12-22T08:41:25.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.105+0000 7f8de884e640 1 -- 172.21.15.38:0/2057734700 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd4003520 con 0x7f8dd4003970 2023-12-22T08:41:25.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.106+0000 7f8de884e640 1 --2- 172.21.15.38:0/2057734700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8dd4003970 0x7f8dd4003d90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009ac0 tx=0x7f8dd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7111f1aade11b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:25.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.106+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd802c6b0 con 0x7f8dd4003970 2023-12-22T08:41:25.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.106+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd802c810 con 0x7f8dd4003970 2023-12-22T08:41:25.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.106+0000 7f8de37fe640 1 -- 172.21.15.38:0/2057734700 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd802cba0 con 0x7f8dd4003970 2023-12-22T08:41:25.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.107+0000 7f8de9850640 1 -- 172.21.15.38:0/2057734700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8dd4003970 msgr2=0x7f8dd4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:25.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.107+0000 7f8de9850640 1 --2- 172.21.15.38:0/2057734700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8dd4003970 0x7f8dd4003d90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009ac0 tx=0x7f8dd40057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.107+0000 7f8de9850640 1 -- 172.21.15.38:0/2057734700 shutdown_connections 2023-12-22T08:41:25.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.107+0000 7f8de9850640 1 --2- 172.21.15.38:0/2057734700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8dd4003970 0x7f8dd4003d90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.107+0000 7f8de9850640 1 -- 172.21.15.38:0/2057734700 >> 172.21.15.38:0/2057734700 conn(0x7f8de40b1c70 msgr2=0x7f8de40b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:25.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.107+0000 7f8de9850640 1 -- 172.21.15.38:0/2057734700 shutdown_connections 2023-12-22T08:41:25.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.107+0000 7f8de9850640 1 -- 172.21.15.38:0/2057734700 wait complete. 2023-12-22T08:41:25.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.109+0000 7f8de9850640 1 Processor -- start 2023-12-22T08:41:25.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.109+0000 7f8de9850640 1 -- start start 2023-12-22T08:41:25.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.110+0000 7f8de9850640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dd4003970 0x7f8de4155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:25.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.110+0000 7f8de9850640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8de41459a0 0x7f8de4147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:25.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.110+0000 7f8de9850640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de4148230 0x7f8de41508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:25.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.110+0000 7f8de9850640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de4146410 con 0x7f8de41459a0 2023-12-22T08:41:25.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.110+0000 7f8de9850640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de40b4b30 con 0x7f8de4148230 2023-12-22T08:41:25.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.110+0000 7f8de9850640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de40b4e10 con 0x7f8dd4003970 2023-12-22T08:41:25.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.110+0000 7f8de3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8de41459a0 0x7f8de4147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:25.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.110+0000 7f8de3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8de41459a0 0x7f8de4147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51096/0 (socket says 172.21.15.38:51096) 2023-12-22T08:41:25.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.110+0000 7f8de3fff640 1 -- 172.21.15.38:0/1494998195 learned_addr learned my addr 172.21.15.38:0/1494998195 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:25.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.111+0000 7f8de904f640 1 --2- 172.21.15.38:0/1494998195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de4148230 0x7f8de41508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:25.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.111+0000 7f8de3fff640 1 -- 172.21.15.38:0/1494998195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dd4003970 msgr2=0x7f8de4155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:25.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.111+0000 7f8de3fff640 1 --2- 172.21.15.38:0/1494998195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dd4003970 0x7f8de4155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.111+0000 7f8de3fff640 1 -- 172.21.15.38:0/1494998195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de4148230 msgr2=0x7f8de41508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:25.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.111+0000 7f8de3fff640 1 --2- 172.21.15.38:0/1494998195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de4148230 0x7f8de41508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.111+0000 7f8de3fff640 1 -- 172.21.15.38:0/1494998195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de40b50f0 con 0x7f8de41459a0 2023-12-22T08:41:25.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.111+0000 7f8de3fff640 1 --2- 172.21.15.38:0/1494998195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8de41459a0 0x7f8de4147cf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000c500 tx=0x7f8dd000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:25.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.111+0000 7f8de17fa640 1 -- 172.21.15.38:0/1494998195 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00052d0 con 0x7f8de41459a0 2023-12-22T08:41:25.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.111+0000 7f8de17fa640 1 -- 172.21.15.38:0/1494998195 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd0005430 con 0x7f8de41459a0 2023-12-22T08:41:25.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.111+0000 7f8de17fa640 1 -- 172.21.15.38:0/1494998195 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0012870 con 0x7f8de41459a0 2023-12-22T08:41:25.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.111+0000 7f8de9850640 1 -- 172.21.15.38:0/1494998195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de40b53d0 con 0x7f8de41459a0 2023-12-22T08:41:25.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.111+0000 7f8de9850640 1 -- 172.21.15.38:0/1494998195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de4145e20 con 0x7f8de41459a0 2023-12-22T08:41:25.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.112+0000 7f8de9850640 1 -- 172.21.15.38:0/1494998195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de4061910 con 0x7f8de41459a0 2023-12-22T08:41:25.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.113+0000 7f8de17fa640 1 -- 172.21.15.38:0/1494998195 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8dd00129d0 con 0x7f8de41459a0 2023-12-22T08:41:25.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.114+0000 7f8de17fa640 1 --2- 172.21.15.38:0/1494998195 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8dc806a430 0x7f8dc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:25.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.115+0000 7f8de17fa640 1 -- 172.21.15.38:0/1494998195 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8dd00884e0 con 0x7f8de41459a0 2023-12-22T08:41:25.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.115+0000 7f8de884e640 1 --2- 172.21.15.38:0/1494998195 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8dc806a430 0x7f8dc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:25.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.116+0000 7f8de884e640 1 --2- 172.21.15.38:0/1494998195 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8dc806a430 0x7f8dc806c8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8036000 tx=0x7f8dd802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:25.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.119+0000 7f8de17fa640 1 -- 172.21.15.38:0/1494998195 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8dd00575f0 con 0x7f8de41459a0 2023-12-22T08:41:25.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.347+0000 7f8de9850640 1 -- 172.21.15.38:0/1494998195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8de40b5c20 con 0x7f8de41459a0 2023-12-22T08:41:25.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.348+0000 7f8de17fa640 1 -- 172.21.15.38:0/1494998195 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f8dd0057180 con 0x7f8de41459a0 2023-12-22T08:41:25.349 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:25.349 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1244935716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1244935716},{"type":"v1","addr":"172.21.15.89:6837","nonce":1244935716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/23463229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":23463229},{"type":"v1","addr":"172.21.15.38:6833","nonce":23463229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3876693609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3876693609},{"type":"v1","addr":"172.21.15.89:6836","nonce":3876693609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:41:14.062124+0000","modified":"2023-12-22T08:41:17.103814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.38:6835/2926436383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2926436383},{"type":"v1","addr":"172.21.15.38:6835","nonce":2926436383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-22T08:41:25.350 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 16 2023-12-22T08:41:25.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.350+0000 7f8de9850640 1 -- 172.21.15.38:0/1494998195 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8dc806a430 msgr2=0x7f8dc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:25.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.350+0000 7f8de9850640 1 --2- 172.21.15.38:0/1494998195 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8dc806a430 0x7f8dc806c8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8036000 tx=0x7f8dd802e000 comp rx=0 tx=0).stop 2023-12-22T08:41:25.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.350+0000 7f8de9850640 1 -- 172.21.15.38:0/1494998195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8de41459a0 msgr2=0x7f8de4147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:25.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.350+0000 7f8de9850640 1 --2- 172.21.15.38:0/1494998195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8de41459a0 0x7f8de4147cf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000c500 tx=0x7f8dd000c9c0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.350+0000 7f8de9850640 1 -- 172.21.15.38:0/1494998195 shutdown_connections 2023-12-22T08:41:25.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.350+0000 7f8de9850640 1 --2- 172.21.15.38:0/1494998195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de4148230 0x7f8de41508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.350+0000 7f8de9850640 1 --2- 172.21.15.38:0/1494998195 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8dc806a430 0x7f8dc806c8f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.350+0000 7f8de9850640 1 --2- 172.21.15.38:0/1494998195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8de41459a0 0x7f8de4147cf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.350+0000 7f8de9850640 1 --2- 172.21.15.38:0/1494998195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8dd4003970 0x7f8de4155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.350+0000 7f8de9850640 1 -- 172.21.15.38:0/1494998195 >> 172.21.15.38:0/1494998195 conn(0x7f8de40b1c70 msgr2=0x7f8de415a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:25.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.351+0000 7f8de9850640 1 -- 172.21.15.38:0/1494998195 shutdown_connections 2023-12-22T08:41:25.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:25.351+0000 7f8de9850640 1 -- 172.21.15.38:0/1494998195 wait complete. 2023-12-22T08:41:25.771 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T08:41:14.062124+0000', 'modified': '2023-12-22T08:41:17.103814+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5052': {'gid': 5052, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.38:6835/2926436383', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6834', 'nonce': 2926436383}, {'type': 'v1', 'addr': '172.21.15.38:6835', 'nonce': 2926436383}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T08:41:25.771 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T08:41:25.771 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-22T08:41:26.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.001+0000 7f2383630640 1 Processor -- start 2023-12-22T08:41:26.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.001+0000 7f2383630640 1 -- start start 2023-12-22T08:41:26.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.003+0000 7f2383630640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f237c1547a0 0x7f237c15b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.003+0000 7f2383630640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c0716a0 con 0x7f237c154b80 2023-12-22T08:41:26.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.003+0000 7f2383630640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c070e80 con 0x7f237c071b90 2023-12-22T08:41:26.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.003+0000 7f2383630640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c0710e0 con 0x7f237c1547a0 2023-12-22T08:41:26.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.003+0000 7f23813cc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f237c1547a0 0x7f237c15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.003+0000 7f2381bcd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f237c154b80 0x7f237c0ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53522/0 (socket says 172.21.15.38:53522) 2023-12-22T08:41:26.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.003+0000 7f2381bcd640 1 -- 172.21.15.38:0/1829068016 learned_addr learned my addr 172.21.15.38:0/1829068016 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:26.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.004+0000 7f23813cc640 1 -- 172.21.15.38:0/1829068016 >> v1:172.21.15.89:6789/0 conn(0x7f237c071b90 legacy=0x7f237c070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.004+0000 7f23813cc640 1 -- 172.21.15.38:0/1829068016 >> v1:172.21.15.38:6789/0 conn(0x7f237c154b80 legacy=0x7f237c0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.004+0000 7f23813cc640 1 -- 172.21.15.38:0/1829068016 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c0713c0 con 0x7f237c1547a0 2023-12-22T08:41:26.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.005+0000 7f23813cc640 1 --2- 172.21.15.38:0/1829068016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c1547a0 0x7f237c15b300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2378009d90 tx=0x7f237802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbce89e83a51bf1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:26.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.005+0000 7f2373fff640 1 -- 172.21.15.38:0/1829068016 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237802cc60 con 0x7f237c1547a0 2023-12-22T08:41:26.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.005+0000 7f2373fff640 1 -- 172.21.15.38:0/1829068016 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237802cdc0 con 0x7f237c1547a0 2023-12-22T08:41:26.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.005+0000 7f2373fff640 1 -- 172.21.15.38:0/1829068016 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378034660 con 0x7f237c1547a0 2023-12-22T08:41:26.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.006+0000 7f2383630640 1 -- 172.21.15.38:0/1829068016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c1547a0 msgr2=0x7f237c15b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.006+0000 7f2383630640 1 --2- 172.21.15.38:0/1829068016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c1547a0 0x7f237c15b300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2378009d90 tx=0x7f237802beb0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.006+0000 7f2383630640 1 -- 172.21.15.38:0/1829068016 shutdown_connections 2023-12-22T08:41:26.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.006+0000 7f2383630640 1 --2- 172.21.15.38:0/1829068016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c1547a0 0x7f237c15b300 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.006+0000 7f2383630640 1 -- 172.21.15.38:0/1829068016 >> 172.21.15.38:0/1829068016 conn(0x7f237c0cf070 msgr2=0x7f237c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:26.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.006+0000 7f2383630640 1 -- 172.21.15.38:0/1829068016 shutdown_connections 2023-12-22T08:41:26.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.006+0000 7f2383630640 1 -- 172.21.15.38:0/1829068016 wait complete. 2023-12-22T08:41:26.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.008+0000 7f2383630640 1 Processor -- start 2023-12-22T08:41:26.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.008+0000 7f2383630640 1 -- start start 2023-12-22T08:41:26.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f2383630640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c071b90 0x7f237c1504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f2383630640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f237c1547a0 0x7f237c149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f2383630640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f237c154b80 0x7f237c1f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f2383630640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c1f7080 con 0x7f237c071b90 2023-12-22T08:41:26.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f2383630640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c1518e0 con 0x7f237c154b80 2023-12-22T08:41:26.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f2383630640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c1f6ac0 con 0x7f237c1547a0 2023-12-22T08:41:26.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f23813cc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c071b90 0x7f237c1504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f23813cc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c071b90 0x7f237c1504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51112/0 (socket says 172.21.15.38:51112) 2023-12-22T08:41:26.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f23813cc640 1 -- 172.21.15.38:0/4289176062 learned_addr learned my addr 172.21.15.38:0/4289176062 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:26.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f2381bcd640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f237c154b80 0x7f237c1f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f23813cc640 1 -- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f237c1547a0 msgr2=0x7f237c149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f23813cc640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f237c1547a0 0x7f237c149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f23813cc640 1 -- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f237c154b80 msgr2=0x7f237c1f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f23813cc640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f237c154b80 0x7f237c1f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f23813cc640 1 -- 172.21.15.38:0/4289176062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2378009a70 con 0x7f237c071b90 2023-12-22T08:41:26.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.009+0000 7f2381bcd640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f237c154b80 0x7f237c1f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:26.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.010+0000 7f23813cc640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c071b90 0x7f237c1504b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2378037040 tx=0x7f2378004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:26.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.010+0000 7f2371ffb640 1 -- 172.21.15.38:0/4289176062 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237803e610 con 0x7f237c071b90 2023-12-22T08:41:26.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.010+0000 7f2371ffb640 1 -- 172.21.15.38:0/4289176062 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237803e770 con 0x7f237c071b90 2023-12-22T08:41:26.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.010+0000 7f2371ffb640 1 -- 172.21.15.38:0/4289176062 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237803eb20 con 0x7f237c071b90 2023-12-22T08:41:26.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.010+0000 7f2383630640 1 -- 172.21.15.38:0/4289176062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c1f6da0 con 0x7f237c071b90 2023-12-22T08:41:26.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.010+0000 7f2383630640 1 -- 172.21.15.38:0/4289176062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c14a0f0 con 0x7f237c071b90 2023-12-22T08:41:26.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.013+0000 7f2371ffb640 1 -- 172.21.15.38:0/4289176062 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f237803b050 con 0x7f237c071b90 2023-12-22T08:41:26.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.014+0000 7f2371ffb640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f236006a460 0x7f236006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.014+0000 7f2371ffb640 1 -- 172.21.15.38:0/4289176062 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23780ab0f0 con 0x7f237c071b90 2023-12-22T08:41:26.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.015+0000 7f2386195740 1 Processor -- start 2023-12-22T08:41:26.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.015+0000 7f2386195740 1 -- start start 2023-12-22T08:41:26.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.015+0000 7f2380bcb640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f236006a460 0x7f236006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.016+0000 7f2386195740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 0x55ce2b756110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.016+0000 7f2386195740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b725cb0 0x55ce2b752fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.016+0000 7f2386195740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b7298b0 0x55ce2b7534e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.016+0000 7f2386195740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2b695f80 con 0x55ce2b7298b0 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.016+0000 7f2386195740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2b693710 con 0x55ce2b755d30 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.016+0000 7f2386195740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce2b68f000 con 0x55ce2b725cb0 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.016+0000 7f2381bcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b7298b0 0x55ce2b7534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.016+0000 7f2380bcb640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f236006a460 0x7f236006c920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f237c0cb740 tx=0x7f236c0079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.016+0000 7f2381bcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b7298b0 0x55ce2b7534e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51124/0 (socket says 172.21.15.38:51124) 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.016+0000 7f2381bcd640 1 -- 172.21.15.38:0/1277874059 learned_addr learned my addr 172.21.15.38:0/1277874059 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.016+0000 7f23813cc640 1 --2- 172.21.15.38:0/1277874059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 0x55ce2b756110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.016+0000 7f2380bcb640 1 --2- 172.21.15.38:0/1277874059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b725cb0 0x55ce2b752fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.017+0000 7f2381bcd640 1 -- 172.21.15.38:0/1277874059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b725cb0 msgr2=0x55ce2b752fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.017+0000 7f2381bcd640 1 --2- 172.21.15.38:0/1277874059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b725cb0 0x55ce2b752fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.017+0000 7f2381bcd640 1 -- 172.21.15.38:0/1277874059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 msgr2=0x55ce2b756110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.017+0000 7f2381bcd640 1 --2- 172.21.15.38:0/1277874059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 0x55ce2b756110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.017+0000 7f2381bcd640 1 -- 172.21.15.38:0/1277874059 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce2b656690 con 0x55ce2b7298b0 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.017+0000 7f2381bcd640 1 --2- 172.21.15.38:0/1277874059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b7298b0 0x55ce2b7534e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f23740014e0 tx=0x7f23740019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec93d41e085e2e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:26.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.017+0000 7f235effd640 1 -- 172.21.15.38:0/1277874059 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237400b070 con 0x55ce2b7298b0 2023-12-22T08:41:26.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.017+0000 7f235effd640 1 -- 172.21.15.38:0/1277874059 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2374005cc0 con 0x55ce2b7298b0 2023-12-22T08:41:26.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.017+0000 7f235effd640 1 -- 172.21.15.38:0/1277874059 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23740072f0 con 0x55ce2b7298b0 2023-12-22T08:41:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.018+0000 7f2386195740 1 -- 172.21.15.38:0/1277874059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b7298b0 msgr2=0x55ce2b7534e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.018+0000 7f2386195740 1 --2- 172.21.15.38:0/1277874059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b7298b0 0x55ce2b7534e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f23740014e0 tx=0x7f23740019a0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.018+0000 7f2386195740 1 -- 172.21.15.38:0/1277874059 shutdown_connections 2023-12-22T08:41:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.018+0000 7f2386195740 1 --2- 172.21.15.38:0/1277874059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b7298b0 0x55ce2b7534e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.018+0000 7f2386195740 1 --2- 172.21.15.38:0/1277874059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b725cb0 0x55ce2b752fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.018+0000 7f2386195740 1 --2- 172.21.15.38:0/1277874059 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 0x55ce2b756110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.018+0000 7f2386195740 1 -- 172.21.15.38:0/1277874059 >> 172.21.15.38:0/1277874059 conn(0x55ce2b727fc0 msgr2=0x55ce2b770b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.018+0000 7f2386195740 1 -- 172.21.15.38:0/1277874059 shutdown_connections 2023-12-22T08:41:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.018+0000 7f2386195740 1 -- 172.21.15.38:0/1277874059 wait complete. 2023-12-22T08:41:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.019+0000 7f2386195740 1 -- start start 2023-12-22T08:41:26.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.019+0000 7f2386195740 1 Processor -- start 2023-12-22T08:41:26.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.020+0000 7f2386195740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b7298b0 0x55ce2b756110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.020+0000 7f2386195740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b755d30 0x55ce2b73bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.020+0000 7f2386195740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b73c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.020+0000 7f2386195740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2b6307d0 con 0x55ce2b73c200 2023-12-22T08:41:26.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.020+0000 7f2386195740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2b630470 con 0x55ce2b7298b0 2023-12-22T08:41:26.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.020+0000 7f2386195740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce2b3f6f20 con 0x55ce2b755d30 2023-12-22T08:41:26.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.020+0000 7f2386195740 10 client.0 _ll_register_callbacks cb 0x55ce2b67f1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:41:26.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.020+0000 7f2381bcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b73c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.020+0000 7f2381bcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b73c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51126/0 (socket says 172.21.15.38:51126) 2023-12-22T08:41:26.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.020+0000 7f2381bcd640 1 -- 172.21.15.38:0/3262707727 learned_addr learned my addr 172.21.15.38:0/3262707727 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:26.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.021+0000 7f2381bcd640 1 -- 172.21.15.38:0/3262707727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b755d30 msgr2=0x55ce2b73bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.021+0000 7f2381bcd640 1 --2- 172.21.15.38:0/3262707727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b755d30 0x55ce2b73bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.021+0000 7f2381bcd640 1 -- 172.21.15.38:0/3262707727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b7298b0 msgr2=0x55ce2b756110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.021+0000 7f2381bcd640 1 --2- 172.21.15.38:0/3262707727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b7298b0 0x55ce2b756110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.021+0000 7f2381bcd640 1 -- 172.21.15.38:0/3262707727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c0716a0 con 0x55ce2b73c200 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.021+0000 7f2381bcd640 1 --2- 172.21.15.38:0/3262707727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b73c680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2374016040 tx=0x7f2374000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4fefe096db7a5ce server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.021+0000 7f2357fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.021+0000 7f2357fff640 1 -- 172.21.15.38:0/3262707727 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374013680 con 0x55ce2b73c200 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.021+0000 7f2386195740 1 -- 172.21.15.38:0/3262707727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce2b6b9550 con 0x55ce2b73c200 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.021+0000 7f2357fff640 1 -- 172.21.15.38:0/3262707727 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23740137e0 con 0x55ce2b73c200 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.022+0000 7f2357fff640 1 -- 172.21.15.38:0/3262707727 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23740139a0 con 0x55ce2b73c200 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.022+0000 7f2386195740 10 client.5250 fetch_fsmap learned FSMap version 16 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.022+0000 7f2386195740 1 -- 172.21.15.38:0/3262707727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ce2b68d680 con 0x55ce2b73c200 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.022+0000 7f2357fff640 1 -- 172.21.15.38:0/3262707727 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce2b6b9550 con 0x55ce2b73c200 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.022+0000 7f2357fff640 1 -- 172.21.15.38:0/3262707727 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2374013b00 con 0x55ce2b73c200 2023-12-22T08:41:26.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.022+0000 7f2386195740 10 client.5250 fetch_fsmap finished waiting for FSMap version 16 2023-12-22T08:41:26.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.022+0000 7f2386195740 10 client.5250 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:41:26.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.022+0000 7f2386195740 20 client.5250 populate_metadata read hostname 'smithi038' 2023-12-22T08:41:26.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.022+0000 7f2386195740 1 --2- 172.21.15.38:0/3262707727 >> [v2:172.21.15.38:6834/2926436383,v1:172.21.15.38:6835/2926436383] conn(0x55ce2b758e40 0x55ce2b77fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.022+0000 7f2386195740 4 client.5250 mds_command: new command op to 5052 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T08:41:26.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.022+0000 7f2386195740 1 -- 172.21.15.38:0/3262707727 --> [v2:172.21.15.38:6834/2926436383,v1:172.21.15.38:6835/2926436383] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce2b681b50 con 0x55ce2b758e40 2023-12-22T08:41:26.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.022+0000 7f23813cc640 1 --2- 172.21.15.38:0/3262707727 >> [v2:172.21.15.38:6834/2926436383,v1:172.21.15.38:6835/2926436383] conn(0x55ce2b758e40 0x55ce2b77fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.023+0000 7f23813cc640 1 --2- 172.21.15.38:0/3262707727 >> [v2:172.21.15.38:6834/2926436383,v1:172.21.15.38:6835/2926436383] conn(0x55ce2b758e40 0x55ce2b77fb90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccef30d9a326ce12 server_cookie=2b831fcfad2f1069 in_seq=0 out_seq=0 2023-12-22T08:41:26.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.023+0000 7f2357fff640 10 client.5250 ms_handle_connect on v2:172.21.15.38:6834/2926436383 2023-12-22T08:41:26.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2357fff640 1 -- 172.21.15.38:0/3262707727 <== mds.0 v2:172.21.15.38:6834/2926436383 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55ce2b681b50 con 0x55ce2b758e40 2023-12-22T08:41:26.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2357fff640 10 client.5250 handle_command_reply: tid=0 2023-12-22T08:41:26.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2386195740 1 client.5250 shutdown 2023-12-22T08:41:26.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2386195740 1 -- 172.21.15.38:0/3262707727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 msgr2=0x55ce2b73c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2386195740 1 --2- 172.21.15.38:0/3262707727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b73c680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2374016040 tx=0x7f2374000ed0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2386195740 1 -- 172.21.15.38:0/3262707727 shutdown_connections 2023-12-22T08:41:26.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2386195740 1 --2- 172.21.15.38:0/3262707727 >> [v2:172.21.15.38:6834/2926436383,v1:172.21.15.38:6835/2926436383] conn(0x55ce2b758e40 0x55ce2b77fb90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2386195740 1 --2- 172.21.15.38:0/3262707727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b73c680 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2386195740 1 --2- 172.21.15.38:0/3262707727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b755d30 0x55ce2b73bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2386195740 1 --2- 172.21.15.38:0/3262707727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b7298b0 0x55ce2b756110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2357fff640 0 client.5250 ms_handle_reset on v2:172.21.15.38:6834/2926436383 2023-12-22T08:41:26.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2386195740 1 -- 172.21.15.38:0/3262707727 >> 172.21.15.38:0/3262707727 conn(0x55ce2b725cb0 msgr2=0x55ce2b72a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:26.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2386195740 1 -- 172.21.15.38:0/3262707727 shutdown_connections 2023-12-22T08:41:26.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2386195740 1 -- 172.21.15.38:0/3262707727 wait complete. 2023-12-22T08:41:26.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.024+0000 7f2386195740 20 client.5250 trim_cache size 0 max 16384 2023-12-22T08:41:26.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.041+0000 7f2386195740 1 Processor -- start 2023-12-22T08:41:26.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.041+0000 7f2386195740 1 -- start start 2023-12-22T08:41:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2386195740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b7298b0 0x55ce2b72bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2386195740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b752ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2386195740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 0x55ce2b724e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2386195740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2b7587f0 con 0x55ce2b73c200 2023-12-22T08:41:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2386195740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2b757560 con 0x55ce2b755d30 2023-12-22T08:41:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2386195740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce2b77f250 con 0x55ce2b7298b0 2023-12-22T08:41:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2380bcb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b752ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2380bcb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b752ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51136/0 (socket says 172.21.15.38:51136) 2023-12-22T08:41:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2380bcb640 1 -- 172.21.15.38:0/2144954472 learned_addr learned my addr 172.21.15.38:0/2144954472 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f23813cc640 1 --2- 172.21.15.38:0/2144954472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b7298b0 0x55ce2b72bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2381bcd640 1 --2- 172.21.15.38:0/2144954472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 0x55ce2b724e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2380bcb640 1 -- 172.21.15.38:0/2144954472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b7298b0 msgr2=0x55ce2b72bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2380bcb640 1 --2- 172.21.15.38:0/2144954472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b7298b0 0x55ce2b72bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2380bcb640 1 -- 172.21.15.38:0/2144954472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 msgr2=0x55ce2b724e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2380bcb640 1 --2- 172.21.15.38:0/2144954472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 0x55ce2b724e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.042+0000 7f2380bcb640 1 -- 172.21.15.38:0/2144954472 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce2b62f9e0 con 0x55ce2b73c200 2023-12-22T08:41:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.043+0000 7f2380bcb640 1 --2- 172.21.15.38:0/2144954472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b752ec0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f237c0ce150 tx=0x7f236c0037d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6185863d8482501 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.043+0000 7f235f7fe640 1 -- 172.21.15.38:0/2144954472 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c013a30 con 0x55ce2b73c200 2023-12-22T08:41:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.043+0000 7f235f7fe640 1 -- 172.21.15.38:0/2144954472 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c01c040 con 0x55ce2b73c200 2023-12-22T08:41:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.043+0000 7f235f7fe640 1 -- 172.21.15.38:0/2144954472 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c013dd0 con 0x55ce2b73c200 2023-12-22T08:41:26.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.044+0000 7f2386195740 1 -- 172.21.15.38:0/2144954472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 msgr2=0x55ce2b752ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.044+0000 7f2386195740 1 --2- 172.21.15.38:0/2144954472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b752ec0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f237c0ce150 tx=0x7f236c0037d0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.044+0000 7f2386195740 1 -- 172.21.15.38:0/2144954472 shutdown_connections 2023-12-22T08:41:26.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.044+0000 7f2386195740 1 --2- 172.21.15.38:0/2144954472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 0x55ce2b724e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.044+0000 7f2386195740 1 --2- 172.21.15.38:0/2144954472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b752ec0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.044+0000 7f2386195740 1 --2- 172.21.15.38:0/2144954472 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b7298b0 0x55ce2b72bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.044+0000 7f2386195740 1 -- 172.21.15.38:0/2144954472 >> 172.21.15.38:0/2144954472 conn(0x55ce2b725cb0 msgr2=0x55ce2b721550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.044+0000 7f2386195740 1 -- 172.21.15.38:0/2144954472 shutdown_connections 2023-12-22T08:41:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.044+0000 7f2386195740 1 -- 172.21.15.38:0/2144954472 wait complete. 2023-12-22T08:41:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.044+0000 7f2386195740 1 -- start start 2023-12-22T08:41:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.045+0000 7f2386195740 1 Processor -- start 2023-12-22T08:41:26.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2386195740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b7298b0 0x55ce2b74a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2386195740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b72b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2386195740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 0x55ce2b72b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2386195740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2b7823d0 con 0x55ce2b73c200 2023-12-22T08:41:26.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2386195740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2b771610 con 0x55ce2b755d30 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2386195740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce2b771860 con 0x55ce2b7298b0 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2386195740 10 client.0 _ll_register_callbacks cb 0x7f2374007e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2380bcb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b72b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2380bcb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b72b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51144/0 (socket says 172.21.15.38:51144) 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2380bcb640 1 -- 172.21.15.38:0/1283290773 learned_addr learned my addr 172.21.15.38:0/1283290773 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f23813cc640 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b7298b0 0x55ce2b74a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2380bcb640 1 -- 172.21.15.38:0/1283290773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b7298b0 msgr2=0x55ce2b74a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2380bcb640 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b7298b0 0x55ce2b74a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2381bcd640 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 0x55ce2b72b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2380bcb640 1 -- 172.21.15.38:0/1283290773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 msgr2=0x55ce2b72b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2380bcb640 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 0x55ce2b72b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f2380bcb640 1 -- 172.21.15.38:0/1283290773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236c0144c0 con 0x55ce2b73c200 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.046+0000 7f23813cc640 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b7298b0 0x55ce2b74a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.047+0000 7f2380bcb640 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b72b210 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f236c01f000 tx=0x7f236c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba5466dd0d37377 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:26.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.047+0000 7f2357fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.047+0000 7f2357fff640 1 -- 172.21.15.38:0/1283290773 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c006be0 con 0x55ce2b73c200 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.047+0000 7f2357fff640 1 -- 172.21.15.38:0/1283290773 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f236c006d40 con 0x55ce2b73c200 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.047+0000 7f2386195740 1 -- 172.21.15.38:0/1283290773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2374005cc0 con 0x55ce2b73c200 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.047+0000 7f2357fff640 1 -- 172.21.15.38:0/1283290773 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f236c006f40 con 0x55ce2b73c200 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.047+0000 7f2386195740 10 client.5256 fetch_fsmap learned FSMap version 16 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.047+0000 7f2386195740 1 -- 172.21.15.38:0/1283290773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ce2b654ef0 con 0x55ce2b73c200 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.047+0000 7f2357fff640 1 -- 172.21.15.38:0/1283290773 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2374005cc0 con 0x55ce2b73c200 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.047+0000 7f2357fff640 1 -- 172.21.15.38:0/1283290773 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f236c0070a0 con 0x55ce2b73c200 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.047+0000 7f2386195740 10 client.5256 fetch_fsmap finished waiting for FSMap version 16 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.048+0000 7f2386195740 10 client.5256 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.048+0000 7f2386195740 20 client.5256 populate_metadata read hostname 'smithi038' 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.048+0000 7f2386195740 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.38:6834/2926436383,v1:172.21.15.38:6835/2926436383] conn(0x55ce2b7d6a60 0x55ce2b74e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.048+0000 7f2386195740 4 client.5256 mds_command: new command op to 5052 tid=0[{"prefix": "status"}] 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.048+0000 7f2386195740 1 -- 172.21.15.38:0/1283290773 --> [v2:172.21.15.38:6834/2926436383,v1:172.21.15.38:6835/2926436383] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ce2b688080 con 0x55ce2b7d6a60 2023-12-22T08:41:26.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.048+0000 7f23813cc640 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.38:6834/2926436383,v1:172.21.15.38:6835/2926436383] conn(0x55ce2b7d6a60 0x55ce2b74e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.048+0000 7f23813cc640 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.38:6834/2926436383,v1:172.21.15.38:6835/2926436383] conn(0x55ce2b7d6a60 0x55ce2b74e070 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef2b09cba877bec9 server_cookie=4a7255d006f79116 in_seq=0 out_seq=0 2023-12-22T08:41:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.048+0000 7f2357fff640 10 client.5256 ms_handle_connect on v2:172.21.15.38:6834/2926436383 2023-12-22T08:41:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2357fff640 1 -- 172.21.15.38:0/1283290773 <== mds.0 v2:172.21.15.38:6834/2926436383 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55ce2b688080 con 0x55ce2b7d6a60 2023-12-22T08:41:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2357fff640 10 client.5256 handle_command_reply: tid=0 2023-12-22T08:41:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2386195740 1 client.5256 shutdown 2023-12-22T08:41:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2386195740 1 -- 172.21.15.38:0/1283290773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 msgr2=0x55ce2b72b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2386195740 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b72b210 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f236c01f000 tx=0x7f236c013000 comp rx=0 tx=0).stop 2023-12-22T08:41:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2386195740 1 -- 172.21.15.38:0/1283290773 shutdown_connections 2023-12-22T08:41:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2386195740 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.38:6834/2926436383,v1:172.21.15.38:6835/2926436383] conn(0x55ce2b7d6a60 0x55ce2b74e070 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2386195740 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ce2b755d30 0x55ce2b72b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2386195740 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce2b73c200 0x55ce2b72b210 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2357fff640 0 client.5256 ms_handle_reset on v2:172.21.15.38:6834/2926436383 2023-12-22T08:41:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2386195740 1 --2- 172.21.15.38:0/1283290773 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55ce2b7298b0 0x55ce2b74a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2386195740 1 -- 172.21.15.38:0/1283290773 >> 172.21.15.38:0/1283290773 conn(0x55ce2b725cb0 msgr2=0x55ce2b759300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2386195740 1 -- 172.21.15.38:0/1283290773 shutdown_connections 2023-12-22T08:41:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2386195740 1 -- 172.21.15.38:0/1283290773 wait complete. 2023-12-22T08:41:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.049+0000 7f2386195740 20 client.5256 trim_cache size 0 max 16384 2023-12-22T08:41:26.055 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:41:26.055 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:41:26.055 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-12-22T08:41:26.055 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 5052, 2023-12-22T08:41:26.055 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-12-22T08:41:26.055 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-12-22T08:41:26.055 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-12-22T08:41:26.056 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 11.982041335, 2023-12-22T08:41:26.056 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 16, 2023-12-22T08:41:26.056 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 34, 2023-12-22T08:41:26.056 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 34, 2023-12-22T08:41:26.056 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 20.265242766 2023-12-22T08:41:26.056 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:41:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.050+0000 7f2383630640 1 -- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f236006a460 msgr2=0x7f236006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.050+0000 7f2383630640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f236006a460 0x7f236006c920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f237c0cb740 tx=0x7f236c0079b0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.050+0000 7f2383630640 1 -- 172.21.15.38:0/4289176062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c071b90 msgr2=0x7f237c1504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.050+0000 7f2383630640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c071b90 0x7f237c1504b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2378037040 tx=0x7f2378004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.050+0000 7f2383630640 1 -- 172.21.15.38:0/4289176062 shutdown_connections 2023-12-22T08:41:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.050+0000 7f2383630640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f237c154b80 0x7f237c1f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.050+0000 7f2383630640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f237c1547a0 0x7f237c149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.050+0000 7f2383630640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f236006a460 0x7f236006c920 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.050+0000 7f2383630640 1 --2- 172.21.15.38:0/4289176062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c071b90 0x7f237c1504b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.050+0000 7f2383630640 1 -- 172.21.15.38:0/4289176062 >> 172.21.15.38:0/4289176062 conn(0x7f237c0cf070 msgr2=0x7f237c06c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.050+0000 7f2383630640 1 -- 172.21.15.38:0/4289176062 shutdown_connections 2023-12-22T08:41:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.050+0000 7f2383630640 1 -- 172.21.15.38:0/4289176062 wait complete. 2023-12-22T08:41:26.071 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:41:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.287+0000 7f177759e640 1 Processor -- start 2023-12-22T08:41:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.287+0000 7f177759e640 1 -- start start 2023-12-22T08:41:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.289+0000 7f177759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1778157980 0x7f177815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.289+0000 7f177759e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f17780b3ff0 0x7f177806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.289+0000 7f177759e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17780d1520 con 0x7f17780b4470 2023-12-22T08:41:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.289+0000 7f177759e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17780d1800 con 0x7f17780b3ff0 2023-12-22T08:41:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.289+0000 7f177759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17780d1ae0 con 0x7f1778157980 2023-12-22T08:41:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.289+0000 7f1776d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f17780b4470 0x7f17780d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53532/0 (socket says 172.21.15.38:53532) 2023-12-22T08:41:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.289+0000 7f1776d9d640 1 -- 172.21.15.38:0/2536770725 learned_addr learned my addr 172.21.15.38:0/2536770725 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.290+0000 7f176ffff640 1 --2- 172.21.15.38:0/2536770725 >> v2:172.21.15.38:3300/0 conn(0x7f17780b3ff0 0x7f177806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.290+0000 7f177659c640 1 --2- 172.21.15.38:0/2536770725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1778157980 0x7f177815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.290+0000 7f1775d9b640 1 -- 172.21.15.38:0/2536770725 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454571223 0 0) 0x7f17780d1520 con 0x7f17780b4470 2023-12-22T08:41:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.290+0000 7f1775d9b640 1 -- 172.21.15.38:0/2536770725 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1764003520 con 0x7f17780b4470 2023-12-22T08:41:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.290+0000 7f176ffff640 1 -- 172.21.15.38:0/2536770725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1778157980 msgr2=0x7f177815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.290+0000 7f176ffff640 1 --2- 172.21.15.38:0/2536770725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1778157980 0x7f177815eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.290+0000 7f1775d9b640 1 -- 172.21.15.38:0/2536770725 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3646879710 0 0) 0x7f1764003520 con 0x7f17780b4470 2023-12-22T08:41:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.290+0000 7f176ffff640 1 -- 172.21.15.38:0/2536770725 >> v1:172.21.15.38:6789/0 conn(0x7f17780b4470 legacy=0x7f17780d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.290+0000 7f176ffff640 1 -- 172.21.15.38:0/2536770725 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17780d1dc0 con 0x7f17780b3ff0 2023-12-22T08:41:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.291+0000 7f176ffff640 1 --2- 172.21.15.38:0/2536770725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17780b3ff0 0x7f177806cf30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f17600097a0 tx=0x7f176002b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b0ff3acdc5b167 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.292+0000 7f1775d9b640 1 -- 172.21.15.38:0/2536770725 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17700019f0 con 0x7f17780b3ff0 2023-12-22T08:41:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.292+0000 7f1775d9b640 1 -- 172.21.15.38:0/2536770725 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176002e050 con 0x7f17780b3ff0 2023-12-22T08:41:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.292+0000 7f1775d9b640 1 -- 172.21.15.38:0/2536770725 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760030710 con 0x7f17780b3ff0 2023-12-22T08:41:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.292+0000 7f177759e640 1 -- 172.21.15.38:0/2536770725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17780b3ff0 msgr2=0x7f177806cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.292+0000 7f177759e640 1 --2- 172.21.15.38:0/2536770725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17780b3ff0 0x7f177806cf30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f17600097a0 tx=0x7f176002b790 comp rx=0 tx=0).stop 2023-12-22T08:41:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.292+0000 7f177759e640 1 -- 172.21.15.38:0/2536770725 shutdown_connections 2023-12-22T08:41:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.292+0000 7f177759e640 1 --2- 172.21.15.38:0/2536770725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17780b3ff0 0x7f177806cf30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.292+0000 7f177759e640 1 --2- 172.21.15.38:0/2536770725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1778157980 0x7f177815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.293+0000 7f177759e640 1 -- 172.21.15.38:0/2536770725 >> 172.21.15.38:0/2536770725 conn(0x7f17780d31f0 msgr2=0x7f17780d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.293+0000 7f177759e640 1 -- 172.21.15.38:0/2536770725 shutdown_connections 2023-12-22T08:41:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.293+0000 7f177759e640 1 -- 172.21.15.38:0/2536770725 wait complete. 2023-12-22T08:41:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.294+0000 7f177759e640 1 Processor -- start 2023-12-22T08:41:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.295+0000 7f177759e640 1 -- start start 2023-12-22T08:41:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f177759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17780b3ff0 0x7f17780b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f177759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17780b4470 0x7f177814ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f177759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1778157980 0x7f177814c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f177759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1778161e90 con 0x7f17780b4470 2023-12-22T08:41:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f177759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1778150210 con 0x7f1778157980 2023-12-22T08:41:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f177759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177814f3c0 con 0x7f17780b3ff0 2023-12-22T08:41:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f176ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17780b4470 0x7f177814ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f176ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17780b4470 0x7f177814ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51164/0 (socket says 172.21.15.38:51164) 2023-12-22T08:41:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f176ffff640 1 -- 172.21.15.38:0/3097744763 learned_addr learned my addr 172.21.15.38:0/3097744763 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f177659c640 1 --2- 172.21.15.38:0/3097744763 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17780b3ff0 0x7f17780b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f176ffff640 1 -- 172.21.15.38:0/3097744763 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17780b3ff0 msgr2=0x7f17780b7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f176ffff640 1 --2- 172.21.15.38:0/3097744763 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17780b3ff0 0x7f17780b7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f176ffff640 1 -- 172.21.15.38:0/3097744763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1778157980 msgr2=0x7f177814c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f176ffff640 1 --2- 172.21.15.38:0/3097744763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1778157980 0x7f177814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.296+0000 7f176ffff640 1 -- 172.21.15.38:0/3097744763 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760009400 con 0x7f17780b4470 2023-12-22T08:41:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.297+0000 7f176ffff640 1 --2- 172.21.15.38:0/3097744763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17780b4470 0x7f177814ee80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1760000c00 tx=0x7f17600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:26.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.297+0000 7f176effd640 1 -- 172.21.15.38:0/3097744763 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176003c620 con 0x7f17780b4470 2023-12-22T08:41:26.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.297+0000 7f176effd640 1 -- 172.21.15.38:0/3097744763 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176003c7a0 con 0x7f17780b4470 2023-12-22T08:41:26.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.297+0000 7f176effd640 1 -- 172.21.15.38:0/3097744763 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176003cb50 con 0x7f17780b4470 2023-12-22T08:41:26.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.297+0000 7f177759e640 1 -- 172.21.15.38:0/3097744763 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177814f690 con 0x7f17780b4470 2023-12-22T08:41:26.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.297+0000 7f177759e640 1 -- 172.21.15.38:0/3097744763 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177814fc50 con 0x7f17780b4470 2023-12-22T08:41:26.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.298+0000 7f177759e640 1 -- 172.21.15.38:0/3097744763 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177815ecc0 con 0x7f17780b4470 2023-12-22T08:41:26.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.299+0000 7f176effd640 1 -- 172.21.15.38:0/3097744763 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1760039070 con 0x7f17780b4470 2023-12-22T08:41:26.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.300+0000 7f176effd640 1 --2- 172.21.15.38:0/3097744763 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f175806a430 0x7f175806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.300+0000 7f176effd640 1 -- 172.21.15.38:0/3097744763 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17600aa0e0 con 0x7f17780b4470 2023-12-22T08:41:26.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.301+0000 7f177659c640 1 --2- 172.21.15.38:0/3097744763 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f175806a430 0x7f175806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.302+0000 7f177659c640 1 --2- 172.21.15.38:0/3097744763 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f175806a430 0x7f175806c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1768009a30 tx=0x7f1768008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:26.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.305+0000 7f176effd640 1 -- 172.21.15.38:0/3097744763 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f177815ecc0 con 0x7f17780b4470 2023-12-22T08:41:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.541+0000 7f177759e640 1 -- 172.21.15.38:0/3097744763 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f177815eca0 con 0x7f17780b4470 2023-12-22T08:41:26.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.542+0000 7f176effd640 1 -- 172.21.15.38:0/3097744763 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1760037060 con 0x7f17780b4470 2023-12-22T08:41:26.545 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:41:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.545+0000 7f177759e640 1 -- 172.21.15.38:0/3097744763 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f175806a430 msgr2=0x7f175806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.545+0000 7f177759e640 1 --2- 172.21.15.38:0/3097744763 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f175806a430 0x7f175806c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1768009a30 tx=0x7f1768008040 comp rx=0 tx=0).stop 2023-12-22T08:41:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.545+0000 7f177759e640 1 -- 172.21.15.38:0/3097744763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17780b4470 msgr2=0x7f177814ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.545+0000 7f177759e640 1 --2- 172.21.15.38:0/3097744763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17780b4470 0x7f177814ee80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1760000c00 tx=0x7f17600046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.545+0000 7f177759e640 1 -- 172.21.15.38:0/3097744763 shutdown_connections 2023-12-22T08:41:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.545+0000 7f177759e640 1 --2- 172.21.15.38:0/3097744763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1778157980 0x7f177814c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.545+0000 7f177759e640 1 --2- 172.21.15.38:0/3097744763 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f175806a430 0x7f175806c8f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.545+0000 7f177759e640 1 --2- 172.21.15.38:0/3097744763 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17780b4470 0x7f177814ee80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.545+0000 7f177759e640 1 --2- 172.21.15.38:0/3097744763 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17780b3ff0 0x7f17780b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.545+0000 7f177759e640 1 -- 172.21.15.38:0/3097744763 >> 172.21.15.38:0/3097744763 conn(0x7f17780d31f0 msgr2=0x7f177814d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:26.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.545+0000 7f177759e640 1 -- 172.21.15.38:0/3097744763 shutdown_connections 2023-12-22T08:41:26.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:26.545+0000 7f177759e640 1 -- 172.21.15.38:0/3097744763 wait complete. 2023-12-22T08:41:26.567 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:41:26.568 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:41:26.568 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-12-22T08:41:26.568 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T08:41:26.568 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:41:26.568 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:41:26.568 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:41:26.568 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:41:26.568 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:41:26.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:26.568 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-12-22T08:41:26.622 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:41:26.623 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:41:26.623 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:41:26.623 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:26.623 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:41:26.623 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:26.623 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:41:26.623 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:26.623 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-12-22T08:41:26.623 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:41:26.623 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:26.623 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-12-22T08:41:26.623 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42280sec preferred_lft 42280sec 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:26.624 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::5440:f6ff:fe40:85a/64 scope link 2023-12-22T08:41:26.625 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:26.625 INFO:teuthology.orchestra.run.smithi038.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:41:26.625 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:c3:65:6c:32:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:41:26.625 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::e4c3:65ff:fe6c:322e/64 scope link 2023-12-22T08:41:26.625 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:26.625 INFO:teuthology.orchestra.run.smithi038.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:41:26.625 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T08:41:26.625 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::34bf:8aff:fe68:3bf6/64 scope link 2023-12-22T08:41:26.625 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:26.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:26.626 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:41:26.718 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-12-22T08:41:26.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:26.722 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-12-22T08:41:26.780 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-12-22T08:41:26.781 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:41:26.781 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-22T08:41:26.781 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-22T08:41:26.781 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:41:26.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:26.781 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:41:26.781 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:41:26.781 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T08:41:26.781 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T08:41:26.782 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T08:41:26.782 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:41:26.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:26.986 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:41:27.046 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:41:27.046 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-22T08:41:27.047 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:41:27.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:27.047 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-12-22T08:41:27.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:41:27.152 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T08:41:27.208 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:41:27.208 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:41:27.208 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:41:27.260 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-22T08:41:27.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:27.260 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:41:27.393 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:41:27.393 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:41:27.429 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:41:27.429 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:41:27.430 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:41:27.430 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with new device syntax: 0@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:41:27.430 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:41:27.431 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T08:41:27.432 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:41:27.432 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:41:27.432 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:41:27.432 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:41:27.435 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:41:27.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:27.435 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:41:27.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:27.520 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:41:27.589 INFO:teuthology.orchestra.run.smithi038.stdout:client5023 2023-12-22T08:41:27.589 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:41:27.589 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:27.648 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:41:27.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.873+0000 7f7789c1b640 1 Processor -- start 2023-12-22T08:41:27.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.874+0000 7f7789c1b640 1 -- start start 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.875+0000 7f7789c1b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f77840d2c30 0x7f778415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.875+0000 7f7789c1b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77840d30b0 con 0x7f778415d480 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.875+0000 7f7789c1b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77840d1eb0 con 0x7f778415dda0 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.875+0000 7f7789c1b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77840d2150 con 0x7f77840d2c30 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.876+0000 7f7783fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f77840d2c30 0x7f778415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.876+0000 7f7788c19640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f778415d480 0x7f77840a5140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53546/0 (socket says 172.21.15.38:53546) 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.876+0000 7f7788c19640 1 -- 172.21.15.38:0/2230934638 learned_addr learned my addr 172.21.15.38:0/2230934638 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:27.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.876+0000 7f7783fff640 1 -- 172.21.15.38:0/2230934638 >> v1:172.21.15.89:6789/0 conn(0x7f778415dda0 legacy=0x7f778415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:27.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.876+0000 7f7783fff640 1 -- 172.21.15.38:0/2230934638 >> v1:172.21.15.38:6789/0 conn(0x7f778415d480 legacy=0x7f77840a5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.876+0000 7f7783fff640 1 -- 172.21.15.38:0/2230934638 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77840d2430 con 0x7f77840d2c30 2023-12-22T08:41:27.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.876+0000 7f77837fe640 1 -- 172.21.15.38:0/2230934638 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975118637 0 0) 0x7f77840d30b0 con 0x7f778415d480 2023-12-22T08:41:27.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.877+0000 7f7783fff640 1 --2- 172.21.15.38:0/2230934638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77840d2c30 0x7f778415d860 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f77700097a0 tx=0x7f777002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943a64103a17c1dc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:27.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.878+0000 7f77837fe640 1 -- 172.21.15.38:0/2230934638 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777002e070 con 0x7f77840d2c30 2023-12-22T08:41:27.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.878+0000 7f77837fe640 1 -- 172.21.15.38:0/2230934638 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77700315a0 con 0x7f77840d2c30 2023-12-22T08:41:27.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.878+0000 7f77837fe640 1 -- 172.21.15.38:0/2230934638 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7770031930 con 0x7f77840d2c30 2023-12-22T08:41:27.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.878+0000 7f7789c1b640 1 -- 172.21.15.38:0/2230934638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77840d2c30 msgr2=0x7f778415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.878+0000 7f7789c1b640 1 --2- 172.21.15.38:0/2230934638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77840d2c30 0x7f778415d860 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f77700097a0 tx=0x7f777002b840 comp rx=0 tx=0).stop 2023-12-22T08:41:27.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.878+0000 7f7789c1b640 1 -- 172.21.15.38:0/2230934638 shutdown_connections 2023-12-22T08:41:27.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.878+0000 7f7789c1b640 1 --2- 172.21.15.38:0/2230934638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77840d2c30 0x7f778415d860 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.878+0000 7f7789c1b640 1 -- 172.21.15.38:0/2230934638 >> 172.21.15.38:0/2230934638 conn(0x7f778406ced0 msgr2=0x7f7784071260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:27.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.879+0000 7f7789c1b640 1 -- 172.21.15.38:0/2230934638 shutdown_connections 2023-12-22T08:41:27.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.879+0000 7f7789c1b640 1 -- 172.21.15.38:0/2230934638 wait complete. 2023-12-22T08:41:27.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.880+0000 7f7789c1b640 1 Processor -- start 2023-12-22T08:41:27.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.880+0000 7f7789c1b640 1 -- start start 2023-12-22T08:41:27.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.881+0000 7f7789c1b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77840d2c30 0x7f7784150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.881+0000 7f7789c1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778415d480 0x7f77841612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.881+0000 7f7789c1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f778415dda0 0x7f7784161800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.881+0000 7f7789c1b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77841e8ab0 con 0x7f77840d2c30 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.881+0000 7f7789c1b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77841e7cf0 con 0x7f778415d480 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.881+0000 7f7789c1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77841e7fd0 con 0x7f778415dda0 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.882+0000 7f7788c19640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77840d2c30 0x7f7784150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.882+0000 7f7788c19640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77840d2c30 0x7f7784150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51172/0 (socket says 172.21.15.38:51172) 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.882+0000 7f7788c19640 1 -- 172.21.15.38:0/2976405033 learned_addr learned my addr 172.21.15.38:0/2976405033 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.882+0000 7f7783fff640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778415d480 0x7f77841612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.882+0000 7f778941a640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f778415dda0 0x7f7784161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.882+0000 7f7788c19640 1 -- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f778415dda0 msgr2=0x7f7784161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.882+0000 7f7788c19640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f778415dda0 0x7f7784161800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.882+0000 7f7788c19640 1 -- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778415d480 msgr2=0x7f77841612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.882+0000 7f7788c19640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778415d480 0x7f77841612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.882+0000 7f7788c19640 1 -- 172.21.15.38:0/2976405033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7770009400 con 0x7f77840d2c30 2023-12-22T08:41:27.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.882+0000 7f778941a640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f778415dda0 0x7f7784161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:27.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.883+0000 7f7788c19640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77840d2c30 0x7f7784150900 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f777800c4d0 tx=0x7f777800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:27.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.883+0000 7f77817fa640 1 -- 172.21.15.38:0/2976405033 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77780074e0 con 0x7f77840d2c30 2023-12-22T08:41:27.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.883+0000 7f77817fa640 1 -- 172.21.15.38:0/2976405033 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7778007660 con 0x7f77840d2c30 2023-12-22T08:41:27.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.883+0000 7f77817fa640 1 -- 172.21.15.38:0/2976405033 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778004a20 con 0x7f77840d2c30 2023-12-22T08:41:27.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.883+0000 7f7789c1b640 1 -- 172.21.15.38:0/2976405033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77841e82b0 con 0x7f77840d2c30 2023-12-22T08:41:27.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.883+0000 7f7789c1b640 1 -- 172.21.15.38:0/2976405033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77841e79c0 con 0x7f77840d2c30 2023-12-22T08:41:27.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.884+0000 7f7789c1b640 1 -- 172.21.15.38:0/2976405033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77841e87d0 con 0x7f77840d2c30 2023-12-22T08:41:27.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.885+0000 7f77817fa640 1 -- 172.21.15.38:0/2976405033 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7778004b80 con 0x7f77840d2c30 2023-12-22T08:41:27.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.886+0000 7f77817fa640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f776806a430 0x7f776806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.886+0000 7f77817fa640 1 -- 172.21.15.38:0/2976405033 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7778087ad0 con 0x7f77840d2c30 2023-12-22T08:41:27.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.887+0000 7f7783fff640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f776806a430 0x7f776806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.888+0000 7f7783fff640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f776806a430 0x7f776806c8f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7770036000 tx=0x7f777003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:27.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:27.890+0000 7f77817fa640 1 -- 172.21.15.38:0/2976405033 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f77841e87d0 con 0x7f77840d2c30 2023-12-22T08:41:28.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.122+0000 7f7789c1b640 1 -- 172.21.15.38:0/2976405033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f778406eaf0 con 0x7f77840d2c30 2023-12-22T08:41:28.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.123+0000 7f77817fa640 1 -- 172.21.15.38:0/2976405033 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7778018020 con 0x7f77840d2c30 2023-12-22T08:41:28.126 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:41:28.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.126+0000 7f7789c1b640 1 -- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f776806a430 msgr2=0x7f776806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:28.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.126+0000 7f7789c1b640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f776806a430 0x7f776806c8f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7770036000 tx=0x7f777003d040 comp rx=0 tx=0).stop 2023-12-22T08:41:28.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.126+0000 7f7789c1b640 1 -- 172.21.15.38:0/2976405033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77840d2c30 msgr2=0x7f7784150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:28.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.126+0000 7f7789c1b640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77840d2c30 0x7f7784150900 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f777800c4d0 tx=0x7f777800c990 comp rx=0 tx=0).stop 2023-12-22T08:41:28.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.126+0000 7f7789c1b640 1 -- 172.21.15.38:0/2976405033 shutdown_connections 2023-12-22T08:41:28.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.126+0000 7f7789c1b640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f778415dda0 0x7f7784161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.126+0000 7f7789c1b640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f778415d480 0x7f77841612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.126+0000 7f7789c1b640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f776806a430 0x7f776806c8f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.126+0000 7f7789c1b640 1 --2- 172.21.15.38:0/2976405033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f77840d2c30 0x7f7784150900 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.126+0000 7f7789c1b640 1 -- 172.21.15.38:0/2976405033 >> 172.21.15.38:0/2976405033 conn(0x7f778406ced0 msgr2=0x7f778406f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:28.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.126+0000 7f7789c1b640 1 -- 172.21.15.38:0/2976405033 shutdown_connections 2023-12-22T08:41:28.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:28.126+0000 7f7789c1b640 1 -- 172.21.15.38:0/2976405033 wait complete. 2023-12-22T08:41:28.149 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:41:28.149 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:41:28.149 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-22T08:41:28.149 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T08:41:28.149 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T08:41:28.149 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:41:28.149 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:41:28.150 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:41:28.150 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:41:28.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:28.150 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-22T08:41:28.207 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:41:28.207 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:41:28.208 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42273sec preferred_lft 42273sec 2023-12-22T08:41:28.209 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-22T08:41:28.209 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:28.209 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:41:28.209 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:28.209 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:41:28.209 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:28.209 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::9cc2:a9ff:fe75:e812/64 scope link 2023-12-22T08:41:28.209 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:28.210 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:41:28.210 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8e:46:07:65:e3:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T08:41:28.210 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::8c46:7ff:fe65:e31f/64 scope link 2023-12-22T08:41:28.210 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:28.210 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:41:28.210 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T08:41:28.210 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2cc2:baff:fe6f:ea22/64 scope link 2023-12-22T08:41:28.211 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:28.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:28.211 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:41:28.297 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-22T08:41:28.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:28.301 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-22T08:41:28.352 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-22T08:41:28.352 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:41:28.352 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:41:28.352 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:41:28.352 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:41:28.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:28.353 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:41:28.353 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:41:28.353 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:41:28.353 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:41:28.353 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:41:28.353 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:41:28.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:28.535 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:41:28.585 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T08:41:28.585 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-22T08:41:28.586 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:41:28.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:28.586 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-22T08:41:28.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:41:28.676 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T08:41:28.731 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:41:28.731 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:41:28.731 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:41:28.782 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-22T08:41:28.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:28.782 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:41:28.921 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:41:28.953 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:41:28.953 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:41:28.954 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:41:28.954 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 1@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:41:28.954 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:41:28.955 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T08:41:28.955 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:41:28.955 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:41:28.956 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:41:28.956 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:41:28.961 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:41:28.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:28.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:41:29.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:29.034 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:41:29.079 INFO:teuthology.orchestra.run.smithi089.stdout:client4769 2023-12-22T08:41:29.079 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:41:29.079 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:29.170 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.409+0000 7f0906df0640 1 Processor -- start 2023-12-22T08:41:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.410+0000 7f0906df0640 1 -- start start 2023-12-22T08:41:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.411+0000 7f0906df0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f090015e740 0x7f090015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.411+0000 7f0906df0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f090006ca50 0x7f09000b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.411+0000 7f0906df0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09000b3dc0 0x7f0900161120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.411+0000 7f0906df0640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090006e650 con 0x7f090015e740 2023-12-22T08:41:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.411+0000 7f0906df0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09000b4210 con 0x7f090006ca50 2023-12-22T08:41:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.411+0000 7f0906df0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090015eb20 con 0x7f09000b3dc0 2023-12-22T08:41:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.412+0000 7f0904b8c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f090015e740 0x7f090015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.412+0000 7f0904b8c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f090015e740 0x7f090015db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51182/0 (socket says 172.21.15.38:51182) 2023-12-22T08:41:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.412+0000 7f0904b8c640 1 -- 172.21.15.38:0/1055288131 learned_addr learned my addr 172.21.15.38:0/1055288131 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.412+0000 7f08fffff640 1 --2- 172.21.15.38:0/1055288131 >> v2:172.21.15.89:3300/0 conn(0x7f090006ca50 0x7f09000b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.412+0000 7f090538d640 1 --2- 172.21.15.38:0/1055288131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09000b3dc0 0x7f0900161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.412+0000 7f0904b8c640 1 -- 172.21.15.38:0/1055288131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09000b3dc0 msgr2=0x7f0900161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.412+0000 7f0904b8c640 1 --2- 172.21.15.38:0/1055288131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09000b3dc0 0x7f0900161120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.412+0000 7f0904b8c640 1 -- 172.21.15.38:0/1055288131 >> v2:172.21.15.89:3300/0 conn(0x7f090006ca50 msgr2=0x7f09000b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.412+0000 7f0904b8c640 1 --2- 172.21.15.38:0/1055288131 >> v2:172.21.15.89:3300/0 conn(0x7f090006ca50 0x7f09000b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.412+0000 7f0904b8c640 1 -- 172.21.15.38:0/1055288131 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900070770 con 0x7f090015e740 2023-12-22T08:41:29.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.413+0000 7f0904b8c640 1 --2- 172.21.15.38:0/1055288131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f090015e740 0x7f090015db30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f09000d32d0 tx=0x7f08f002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c5ef552ab0fab6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:29.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.414+0000 7f08ff7fe640 1 -- 172.21.15.38:0/1055288131 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f002c960 con 0x7f090015e740 2023-12-22T08:41:29.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.414+0000 7f08ff7fe640 1 -- 172.21.15.38:0/1055288131 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f002cac0 con 0x7f090015e740 2023-12-22T08:41:29.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.414+0000 7f08ff7fe640 1 -- 172.21.15.38:0/1055288131 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f002ce50 con 0x7f090015e740 2023-12-22T08:41:29.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.414+0000 7f0906df0640 1 -- 172.21.15.38:0/1055288131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f090015e740 msgr2=0x7f090015db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.414+0000 7f0906df0640 1 --2- 172.21.15.38:0/1055288131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f090015e740 0x7f090015db30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f09000d32d0 tx=0x7f08f002bdc0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.414+0000 7f0906df0640 1 -- 172.21.15.38:0/1055288131 shutdown_connections 2023-12-22T08:41:29.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.414+0000 7f0906df0640 1 --2- 172.21.15.38:0/1055288131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09000b3dc0 0x7f0900161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.414+0000 7f0906df0640 1 --2- 172.21.15.38:0/1055288131 >> v2:172.21.15.89:3300/0 conn(0x7f090006ca50 0x7f09000b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.414+0000 7f0906df0640 1 --2- 172.21.15.38:0/1055288131 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f090015e740 0x7f090015db30 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.414+0000 7f0906df0640 1 -- 172.21.15.38:0/1055288131 >> 172.21.15.38:0/1055288131 conn(0x7f09000cfea0 msgr2=0x7f09000d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:29.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.415+0000 7f0906df0640 1 -- 172.21.15.38:0/1055288131 shutdown_connections 2023-12-22T08:41:29.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.415+0000 7f0906df0640 1 -- 172.21.15.38:0/1055288131 wait complete. 2023-12-22T08:41:29.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.416+0000 7f0906df0640 1 Processor -- start 2023-12-22T08:41:29.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.417+0000 7f0906df0640 1 -- start start 2023-12-22T08:41:29.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f0906df0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f090006ca50 0x7f0900154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f0906df0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09000b3dc0 0x7f0900155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f0906df0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f090015e740 0x7f09001f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f0906df0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09001398f0 con 0x7f090015e740 2023-12-22T08:41:29.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f0906df0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0900152550 con 0x7f090006ca50 2023-12-22T08:41:29.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f0906df0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0900152830 con 0x7f09000b3dc0 2023-12-22T08:41:29.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f090538d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f090015e740 0x7f09001f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f090538d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f090015e740 0x7f09001f2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51184/0 (socket says 172.21.15.38:51184) 2023-12-22T08:41:29.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f090538d640 1 -- 172.21.15.38:0/4173875380 learned_addr learned my addr 172.21.15.38:0/4173875380 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:29.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f0904b8c640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f090006ca50 0x7f0900154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f08fffff640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09000b3dc0 0x7f0900155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f090538d640 1 -- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09000b3dc0 msgr2=0x7f0900155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f090538d640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09000b3dc0 0x7f0900155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f090538d640 1 -- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f090006ca50 msgr2=0x7f0900154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f090538d640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f090006ca50 0x7f0900154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.418+0000 7f090538d640 1 -- 172.21.15.38:0/4173875380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0009b30 con 0x7f090015e740 2023-12-22T08:41:29.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.419+0000 7f090538d640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f090015e740 0x7f09001f2010 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f08f800d5d0 tx=0x7f08f800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:29.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.419+0000 7f08fd7fa640 1 -- 172.21.15.38:0/4173875380 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f80125f0 con 0x7f090015e740 2023-12-22T08:41:29.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.419+0000 7f08fd7fa640 1 -- 172.21.15.38:0/4173875380 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f8012770 con 0x7f090015e740 2023-12-22T08:41:29.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.419+0000 7f0906df0640 1 -- 172.21.15.38:0/4173875380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0900152b10 con 0x7f090015e740 2023-12-22T08:41:29.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.419+0000 7f08fd7fa640 1 -- 172.21.15.38:0/4173875380 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8012b20 con 0x7f090015e740 2023-12-22T08:41:29.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.419+0000 7f0906df0640 1 -- 172.21.15.38:0/4173875380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09001f2550 con 0x7f090015e740 2023-12-22T08:41:29.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.421+0000 7f0906df0640 1 -- 172.21.15.38:0/4173875380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0900139a30 con 0x7f090015e740 2023-12-22T08:41:29.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.421+0000 7f08fd7fa640 1 -- 172.21.15.38:0/4173875380 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f08f8012c80 con 0x7f090015e740 2023-12-22T08:41:29.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.422+0000 7f08fd7fa640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f08e006a430 0x7f08e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.422+0000 7f08fd7fa640 1 -- 172.21.15.38:0/4173875380 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08f8088cd0 con 0x7f090015e740 2023-12-22T08:41:29.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.423+0000 7f0904b8c640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f08e006a430 0x7f08e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.424+0000 7f0904b8c640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f08e006a430 0x7f08e006c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f08f0035000 tx=0x7f08f0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:29.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.427+0000 7f08fd7fa640 1 -- 172.21.15.38:0/4173875380 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f08f80542d0 con 0x7f090015e740 2023-12-22T08:41:29.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.662+0000 7f0906df0640 1 -- 172.21.15.38:0/4173875380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0900061910 con 0x7f090015e740 2023-12-22T08:41:29.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.663+0000 7f08fd7fa640 1 -- 172.21.15.38:0/4173875380 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f08f80578f0 con 0x7f090015e740 2023-12-22T08:41:29.666 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:29.666 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1244935716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1244935716},{"type":"v1","addr":"172.21.15.89:6837","nonce":1244935716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/23463229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":23463229},{"type":"v1","addr":"172.21.15.38:6833","nonce":23463229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3876693609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3876693609},{"type":"v1","addr":"172.21.15.89:6836","nonce":3876693609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:41:14.062124+0000","modified":"2023-12-22T08:41:17.103814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.38:6835/2926436383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2926436383},{"type":"v1","addr":"172.21.15.38:6835","nonce":2926436383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-22T08:41:29.666 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 16 2023-12-22T08:41:29.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.666+0000 7f0906df0640 1 -- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f08e006a430 msgr2=0x7f08e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.666+0000 7f0906df0640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f08e006a430 0x7f08e006c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f08f0035000 tx=0x7f08f0030000 comp rx=0 tx=0).stop 2023-12-22T08:41:29.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.666+0000 7f0906df0640 1 -- 172.21.15.38:0/4173875380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f090015e740 msgr2=0x7f09001f2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.666+0000 7f0906df0640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f090015e740 0x7f09001f2010 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f08f800d5d0 tx=0x7f08f800da90 comp rx=0 tx=0).stop 2023-12-22T08:41:29.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.666+0000 7f0906df0640 1 -- 172.21.15.38:0/4173875380 shutdown_connections 2023-12-22T08:41:29.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.666+0000 7f0906df0640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f08e006a430 0x7f08e006c8f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.666+0000 7f0906df0640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f090015e740 0x7f09001f2010 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.666+0000 7f0906df0640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09000b3dc0 0x7f0900155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.666+0000 7f0906df0640 1 --2- 172.21.15.38:0/4173875380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f090006ca50 0x7f0900154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.666+0000 7f0906df0640 1 -- 172.21.15.38:0/4173875380 >> 172.21.15.38:0/4173875380 conn(0x7f09000cfea0 msgr2=0x7f09001617b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:29.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.667+0000 7f0906df0640 1 -- 172.21.15.38:0/4173875380 shutdown_connections 2023-12-22T08:41:29.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:29.667+0000 7f0906df0640 1 -- 172.21.15.38:0/4173875380 wait complete. 2023-12-22T08:41:29.687 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-22T08:41:29.908 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":5052,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":15.822218020999999,"mdsmap_epoch":16,"osdmap_epoch":34,"osdmap_epoch_barrier":34,"uptime":24.105421493000001} 2023-12-22T08:41:29.908 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 5052, "mdsmap_epoch": 16, "osdmap_epoch": 34, "osdmap_epoch_barrier": 34, "rank_uptime": 15.822218021, "state": "up:active", "uptime": 24.105421493, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:41:29.908 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-12-22T08:41:30.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.133+0000 7fb452b18640 1 Processor -- start 2023-12-22T08:41:30.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.133+0000 7fb452b18640 1 -- start start 2023-12-22T08:41:30.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.135+0000 7fb452b18640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb44c0ce600 0x7fb44c070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.135+0000 7fb452b18640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb44c071b20 0x7fb44c15b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.135+0000 7fb452b18640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb44c15b680 0x7fb44c154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.135+0000 7fb452b18640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44c15a960 con 0x7fb44c0ce600 2023-12-22T08:41:30.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.135+0000 7fb452b18640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44c070cb0 con 0x7fb44c15b680 2023-12-22T08:41:30.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.135+0000 7fb452b18640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c070f80 con 0x7fb44c071b20 2023-12-22T08:41:30.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.136+0000 7fb4508b4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb44c0ce600 0x7fb44c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.136+0000 7fb4508b4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb44c0ce600 0x7fb44c070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51196/0 (socket says 172.21.15.38:51196) 2023-12-22T08:41:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.136+0000 7fb4508b4640 1 -- 172.21.15.38:0/3707482490 learned_addr learned my addr 172.21.15.38:0/3707482490 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.136+0000 7fb44bfff640 1 --2- 172.21.15.38:0/3707482490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb44c071b20 0x7fb44c15b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.136+0000 7fb4508b4640 1 -- 172.21.15.38:0/3707482490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb44c071b20 msgr2=0x7fb44c15b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.136+0000 7fb4508b4640 1 --2- 172.21.15.38:0/3707482490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb44c071b20 0x7fb44c15b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.136+0000 7fb4508b4640 1 -- 172.21.15.38:0/3707482490 >> v2:172.21.15.89:3300/0 conn(0x7fb44c15b680 msgr2=0x7fb44c154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.136+0000 7fb4508b4640 1 --2- 172.21.15.38:0/3707482490 >> v2:172.21.15.89:3300/0 conn(0x7fb44c15b680 0x7fb44c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.136+0000 7fb4508b4640 1 -- 172.21.15.38:0/3707482490 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c071260 con 0x7fb44c0ce600 2023-12-22T08:41:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.137+0000 7fb4508b4640 1 --2- 172.21.15.38:0/3707482490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44c0ce600 0x7fb44c070770 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0b4a60 tx=0x7fb44002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5396c3da4ff78f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.138+0000 7fb44b7fe640 1 -- 172.21.15.38:0/3707482490 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440031870 con 0x7fb44c0ce600 2023-12-22T08:41:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.138+0000 7fb44b7fe640 1 -- 172.21.15.38:0/3707482490 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4400319d0 con 0x7fb44c0ce600 2023-12-22T08:41:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.138+0000 7fb44b7fe640 1 -- 172.21.15.38:0/3707482490 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440031d60 con 0x7fb44c0ce600 2023-12-22T08:41:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.138+0000 7fb452b18640 1 -- 172.21.15.38:0/3707482490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44c0ce600 msgr2=0x7fb44c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.138+0000 7fb452b18640 1 --2- 172.21.15.38:0/3707482490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44c0ce600 0x7fb44c070770 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0b4a60 tx=0x7fb44002b910 comp rx=0 tx=0).stop 2023-12-22T08:41:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.139+0000 7fb452b18640 1 -- 172.21.15.38:0/3707482490 shutdown_connections 2023-12-22T08:41:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.139+0000 7fb452b18640 1 --2- 172.21.15.38:0/3707482490 >> v2:172.21.15.89:3300/0 conn(0x7fb44c15b680 0x7fb44c154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.139+0000 7fb452b18640 1 --2- 172.21.15.38:0/3707482490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb44c071b20 0x7fb44c15b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.139+0000 7fb452b18640 1 --2- 172.21.15.38:0/3707482490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44c0ce600 0x7fb44c070770 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.139+0000 7fb452b18640 1 -- 172.21.15.38:0/3707482490 >> 172.21.15.38:0/3707482490 conn(0x7fb44c0cf070 msgr2=0x7fb44c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.139+0000 7fb452b18640 1 -- 172.21.15.38:0/3707482490 shutdown_connections 2023-12-22T08:41:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.139+0000 7fb452b18640 1 -- 172.21.15.38:0/3707482490 wait complete. 2023-12-22T08:41:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.140+0000 7fb452b18640 1 Processor -- start 2023-12-22T08:41:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.141+0000 7fb452b18640 1 -- start start 2023-12-22T08:41:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb452b18640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44c071b20 0x7fb44c1f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb452b18640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb44c0ada50 0x7fb44c0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb452b18640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb44c0b05a0 0x7fb44c0b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb452b18640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c1f63d0 con 0x7fb44c071b20 2023-12-22T08:41:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb452b18640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0ae410 con 0x7fb44c0ada50 2023-12-22T08:41:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb452b18640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c1f6f10 con 0x7fb44c0b05a0 2023-12-22T08:41:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb4508b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44c071b20 0x7fb44c1f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb4508b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44c071b20 0x7fb44c1f2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51206/0 (socket says 172.21.15.38:51206) 2023-12-22T08:41:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb4508b4640 1 -- 172.21.15.38:0/214011352 learned_addr learned my addr 172.21.15.38:0/214011352 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb4510b5640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb44c0b05a0 0x7fb44c0b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb44bfff640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb44c0ada50 0x7fb44c0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb4508b4640 1 -- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb44c0b05a0 msgr2=0x7fb44c0b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb4508b4640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb44c0b05a0 0x7fb44c0b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb4508b4640 1 -- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb44c0ada50 msgr2=0x7fb44c0aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb4508b4640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb44c0ada50 0x7fb44c0aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.142+0000 7fb4508b4640 1 -- 172.21.15.38:0/214011352 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4400094d0 con 0x7fb44c071b20 2023-12-22T08:41:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.143+0000 7fb4508b4640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44c071b20 0x7fb44c1f2690 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb440000c00 tx=0x7fb4400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.143+0000 7fb4497fa640 1 -- 172.21.15.38:0/214011352 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44003ad30 con 0x7fb44c071b20 2023-12-22T08:41:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.143+0000 7fb4497fa640 1 -- 172.21.15.38:0/214011352 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44003ae90 con 0x7fb44c071b20 2023-12-22T08:41:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.143+0000 7fb4497fa640 1 -- 172.21.15.38:0/214011352 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440044610 con 0x7fb44c071b20 2023-12-22T08:41:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.143+0000 7fb452b18640 1 -- 172.21.15.38:0/214011352 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c1f65e0 con 0x7fb44c071b20 2023-12-22T08:41:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.143+0000 7fb452b18640 1 -- 172.21.15.38:0/214011352 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c1f6ba0 con 0x7fb44c071b20 2023-12-22T08:41:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.145+0000 7fb452b18640 1 -- 172.21.15.38:0/214011352 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c061910 con 0x7fb44c071b20 2023-12-22T08:41:30.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.146+0000 7fb4497fa640 1 -- 172.21.15.38:0/214011352 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb44004d450 con 0x7fb44c071b20 2023-12-22T08:41:30.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.147+0000 7fb4497fa640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb43006a460 0x7fb43006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.147+0000 7fb4497fa640 1 -- 172.21.15.38:0/214011352 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb44002d040 con 0x7fb44c071b20 2023-12-22T08:41:30.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.147+0000 7fb44bfff640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb43006a460 0x7fb43006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.148+0000 7fb44bfff640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb43006a460 0x7fb43006c920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb438006fd0 tx=0x7fb438008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:30.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.151+0000 7fb4497fa640 1 -- 172.21.15.38:0/214011352 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb440076460 con 0x7fb44c071b20 2023-12-22T08:41:30.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.420+0000 7fb452b18640 1 -- 172.21.15.38:0/214011352 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fb44c06d4e0 con 0x7fb44c071b20 2023-12-22T08:41:30.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.421+0000 7fb4497fa640 1 -- 172.21.15.38:0/214011352 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1619 (secure 0 0 0) 0x7fb440035090 con 0x7fb44c071b20 2023-12-22T08:41:30.423 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:30.423 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:41:30.423 INFO:teuthology.orchestra.run.smithi038.stdout: "stats": { 2023-12-22T08:41:30.423 INFO:teuthology.orchestra.run.smithi038.stdout: "total_bytes": 1600000000, 2023-12-22T08:41:30.423 INFO:teuthology.orchestra.run.smithi038.stdout: "total_avail_bytes": 1597603763, 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: "total_used_bytes": 2396237, 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: "total_used_raw_bytes": 2396237, 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: "total_used_raw_ratio": 0.0014976480742916465, 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: "num_osds": 8, 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: "num_per_pool_osds": 0, 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: "num_per_pool_omap_osds": 0 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: "stats_by_class": { 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: "hdd": { 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: "total_bytes": 1600000000, 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: "total_avail_bytes": 1597603763, 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: "total_used_bytes": 2396237, 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: "total_used_raw_bytes": 2396237, 2023-12-22T08:41:30.424 INFO:teuthology.orchestra.run.smithi038.stdout: "total_used_raw_ratio": 0.0014976480742916465 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: "name": ".mgr", 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 1, 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: "stats": { 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: "stored": 590368, 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: "objects": 2, 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: "kb_used": 577, 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: "bytes_used": 590368, 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: "percent_used": 0.00052964122733101249, 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: "max_avail": 557033024 2023-12-22T08:41:30.425 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephfs_metadata", 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4, 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: "stats": { 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: "stored": 2616, 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: "objects": 22, 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: "kb_used": 3, 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: "bytes_used": 2616, 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: "percent_used": 2.348149791941978e-06, 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: "max_avail": 557033024 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:30.426 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephfs_data", 2023-12-22T08:41:30.427 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 5, 2023-12-22T08:41:30.427 INFO:teuthology.orchestra.run.smithi038.stdout: "stats": { 2023-12-22T08:41:30.427 INFO:teuthology.orchestra.run.smithi038.stdout: "stored": 0, 2023-12-22T08:41:30.427 INFO:teuthology.orchestra.run.smithi038.stdout: "objects": 0, 2023-12-22T08:41:30.427 INFO:teuthology.orchestra.run.smithi038.stdout: "kb_used": 0, 2023-12-22T08:41:30.427 INFO:teuthology.orchestra.run.smithi038.stdout: "bytes_used": 0, 2023-12-22T08:41:30.427 INFO:teuthology.orchestra.run.smithi038.stdout: "percent_used": 0, 2023-12-22T08:41:30.427 INFO:teuthology.orchestra.run.smithi038.stdout: "max_avail": 557033024 2023-12-22T08:41:30.427 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:30.427 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:30.427 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:41:30.427 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:41:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.423+0000 7fb452b18640 1 -- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb43006a460 msgr2=0x7fb43006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.423+0000 7fb452b18640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb43006a460 0x7fb43006c920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb438006fd0 tx=0x7fb438008040 comp rx=0 tx=0).stop 2023-12-22T08:41:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.423+0000 7fb452b18640 1 -- 172.21.15.38:0/214011352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44c071b20 msgr2=0x7fb44c1f2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.423+0000 7fb452b18640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44c071b20 0x7fb44c1f2690 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb440000c00 tx=0x7fb4400046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.424+0000 7fb452b18640 1 -- 172.21.15.38:0/214011352 shutdown_connections 2023-12-22T08:41:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.424+0000 7fb452b18640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb44c0b05a0 0x7fb44c0b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.424+0000 7fb452b18640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb44c0ada50 0x7fb44c0aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.424+0000 7fb452b18640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb43006a460 0x7fb43006c920 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.424+0000 7fb452b18640 1 --2- 172.21.15.38:0/214011352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb44c071b20 0x7fb44c1f2690 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.424+0000 7fb452b18640 1 -- 172.21.15.38:0/214011352 >> 172.21.15.38:0/214011352 conn(0x7fb44c0cf070 msgr2=0x7fb44c06d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:30.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.424+0000 7fb452b18640 1 -- 172.21.15.38:0/214011352 shutdown_connections 2023-12-22T08:41:30.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:30.424+0000 7fb452b18640 1 -- 172.21.15.38:0/214011352 wait complete. 2023-12-22T08:41:30.447 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T08:41:30.447 DEBUG:teuthology.orchestra.run.smithi038:> import os 2023-12-22T08:41:30.448 DEBUG:teuthology.orchestra.run.smithi038:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-22T08:41:30.448 DEBUG:teuthology.orchestra.run.smithi038:> os.fchmod(fd, 0O666) 2023-12-22T08:41:30.448 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(fd) 2023-12-22T08:41:30.448 DEBUG:teuthology.orchestra.run.smithi038:> os.close(fd) 2023-12-22T08:41:30.448 DEBUG:teuthology.orchestra.run.smithi038:> ' 2023-12-22T08:41:30.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:30.776 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:41:30.886 INFO:teuthology.orchestra.run.smithi038.stdout:client5023 2023-12-22T08:41:30.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:30.886 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/893856d7-5d01-4896-9127-f971dbad2b97.client5023/osdmap') 2023-12-22T08:41:30.992 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 34 barrier 34 flags 0x588000 2023-12-22T08:41:30.992 INFO:teuthology.orchestra.run.smithi038.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:41:30.992 INFO:teuthology.orchestra.run.smithi038.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:41:30.993 INFO:teuthology.orchestra.run.smithi038.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:41:30.993 INFO:teuthology.orchestra.run.smithi038.stdout:osd0 (2)172.21.15.38:6800 100% (exists, up) 100% -1 2023-12-22T08:41:30.993 INFO:teuthology.orchestra.run.smithi038.stdout:osd1 (2)172.21.15.38:6808 100% (exists, up) 100% -1 2023-12-22T08:41:30.993 INFO:teuthology.orchestra.run.smithi038.stdout:osd2 (2)172.21.15.38:6824 100% (exists, up) 100% -1 2023-12-22T08:41:30.993 INFO:teuthology.orchestra.run.smithi038.stdout:osd3 (2)172.21.15.38:6816 100% (exists, up) 100% -1 2023-12-22T08:41:30.993 INFO:teuthology.orchestra.run.smithi038.stdout:osd4 (2)172.21.15.89:6800 100% (exists, up) 100% -1 2023-12-22T08:41:30.993 INFO:teuthology.orchestra.run.smithi038.stdout:osd5 (2)172.21.15.89:6816 100% (exists, up) 100% -1 2023-12-22T08:41:30.993 INFO:teuthology.orchestra.run.smithi038.stdout:osd6 (2)172.21.15.89:6808 100% (exists, up) 100% -1 2023-12-22T08:41:30.993 INFO:teuthology.orchestra.run.smithi038.stdout:osd7 (2)172.21.15.89:6821 100% (exists, up) 100% -1 2023-12-22T08:41:30.993 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records in 2023-12-22T08:41:30.994 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records out 2023-12-22T08:41:30.994 INFO:teuthology.orchestra.run.smithi038.stderr:791 bytes copied, 0.000174961 s, 4.5 MB/s 2023-12-22T08:41:30.997 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-12-22T08:41:31.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.229+0000 7f91c359e640 1 Processor -- start 2023-12-22T08:41:31.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.229+0000 7f91c359e640 1 -- start start 2023-12-22T08:41:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.231+0000 7f91c359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91c4071460 0x7f91c4071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.231+0000 7f91c359e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c415edf0 con 0x7f91c415b0e0 2023-12-22T08:41:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.231+0000 7f91c359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c4071db0 con 0x7f91c409c980 2023-12-22T08:41:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.231+0000 7f91c359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c415d0d0 con 0x7f91c4071460 2023-12-22T08:41:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.231+0000 7f91c259c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f91c415b0e0 0x7f91c415b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:48390/0 (socket says 172.21.15.38:48390) 2023-12-22T08:41:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.231+0000 7f91c259c640 1 -- 172.21.15.38:0/2423398102 learned_addr learned my addr 172.21.15.38:0/2423398102 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:31.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.231+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365609965 0 0) 0x7f91c415edf0 con 0x7f91c415b0e0 2023-12-22T08:41:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91ac003520 con 0x7f91c415b0e0 2023-12-22T08:41:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c2d9d640 1 --2- 172.21.15.38:0/2423398102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91c4071460 0x7f91c4071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3648461864 0 0) 0x7f91ac003520 con 0x7f91c415b0e0 2023-12-22T08:41:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91c4071460 msgr2=0x7f91c4071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 --2- 172.21.15.38:0/2423398102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91c4071460 0x7f91c4071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 >> v1:172.21.15.89:6789/0 conn(0x7f91c409c980 legacy=0x7f91c415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c415bd90 con 0x7f91c415b0e0 2023-12-22T08:41:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f91b4001670 con 0x7f91c415b0e0 2023-12-22T08:41:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 >> v1:172.21.15.38:6789/0 conn(0x7f91c415b0e0 legacy=0x7f91c415b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 --2- 172.21.15.38:0/2423398102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91ac0039a0 0x7f91ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 --2- 172.21.15.38:0/2423398102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0047c0 0x7f91ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 --2- 172.21.15.38:0/2423398102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91c4071460 0x7f91ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c415d0d0 con 0x7f91ac0047c0 2023-12-22T08:41:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0055c0 con 0x7f91ac0039a0 2023-12-22T08:41:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.232+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac00bec0 con 0x7f91c4071460 2023-12-22T08:41:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.233+0000 7f91c1d9b640 1 --2- 172.21.15.38:0/2423398102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0047c0 0x7f91ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.233+0000 7f91c259c640 1 --2- 172.21.15.38:0/2423398102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91ac0039a0 0x7f91ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.233+0000 7f91c2d9d640 1 --2- 172.21.15.38:0/2423398102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91c4071460 0x7f91ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.233+0000 7f91c1d9b640 1 -- 172.21.15.38:0/2423398102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91c4071460 msgr2=0x7f91ac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.233+0000 7f91c1d9b640 1 --2- 172.21.15.38:0/2423398102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91c4071460 0x7f91ac00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.233+0000 7f91c1d9b640 1 -- 172.21.15.38:0/2423398102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91ac0039a0 msgr2=0x7f91ac003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.233+0000 7f91c1d9b640 1 --2- 172.21.15.38:0/2423398102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91ac0039a0 0x7f91ac003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.233+0000 7f91c1d9b640 1 -- 172.21.15.38:0/2423398102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac003520 con 0x7f91ac0047c0 2023-12-22T08:41:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.234+0000 7f91c1d9b640 1 --2- 172.21.15.38:0/2423398102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0047c0 0x7f91ac004c40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f91b8001750 tx=0x7f91ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386c4117b49e6d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.235+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80052d0 con 0x7f91ac0047c0 2023-12-22T08:41:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.235+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b802e050 con 0x7f91ac0047c0 2023-12-22T08:41:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.235+0000 7f91c159a640 1 -- 172.21.15.38:0/2423398102 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80035f0 con 0x7f91ac0047c0 2023-12-22T08:41:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.235+0000 7f91c359e640 1 -- 172.21.15.38:0/2423398102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0047c0 msgr2=0x7f91ac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.235+0000 7f91c359e640 1 --2- 172.21.15.38:0/2423398102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0047c0 0x7f91ac004c40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f91b8001750 tx=0x7f91ac0057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.235+0000 7f91c2d9d640 1 -- 172.21.15.38:0/2423398102 reap_dead start 2023-12-22T08:41:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.235+0000 7f91c359e640 1 -- 172.21.15.38:0/2423398102 shutdown_connections 2023-12-22T08:41:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.235+0000 7f91c359e640 1 -- 172.21.15.38:0/2423398102 >> 172.21.15.38:0/2423398102 conn(0x7f91c40cf000 msgr2=0x7f91c40cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.235+0000 7f91c359e640 1 -- 172.21.15.38:0/2423398102 shutdown_connections 2023-12-22T08:41:31.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.235+0000 7f91c359e640 1 -- 172.21.15.38:0/2423398102 wait complete. 2023-12-22T08:41:31.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.237+0000 7f91c359e640 1 Processor -- start 2023-12-22T08:41:31.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.237+0000 7f91c359e640 1 -- start start 2023-12-22T08:41:31.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.238+0000 7f91c359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0047c0 0x7f91c40cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.238+0000 7f91c359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91c414f5d0 0x7f91c40c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.238+0000 7f91c359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91c40a3a00 0x7f91c414e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.238+0000 7f91c359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40a35e0 con 0x7f91ac0047c0 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.238+0000 7f91c359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40a3240 con 0x7f91c414f5d0 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.238+0000 7f91c359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c409b7b0 con 0x7f91c40a3a00 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.239+0000 7f91c259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0047c0 0x7f91c40cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.239+0000 7f91c259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0047c0 0x7f91c40cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43298/0 (socket says 172.21.15.38:43298) 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.239+0000 7f91c259c640 1 -- 172.21.15.38:0/718252028 learned_addr learned my addr 172.21.15.38:0/718252028 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.239+0000 7f91c1d9b640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91c414f5d0 0x7f91c40c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.239+0000 7f91c2d9d640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91c40a3a00 0x7f91c414e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.239+0000 7f91c259c640 1 -- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91c40a3a00 msgr2=0x7f91c414e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.239+0000 7f91c259c640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91c40a3a00 0x7f91c414e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.239+0000 7f91c259c640 1 -- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91c414f5d0 msgr2=0x7f91c40c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.239+0000 7f91c259c640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91c414f5d0 0x7f91c40c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.239+0000 7f91c259c640 1 -- 172.21.15.38:0/718252028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c415f7c0 con 0x7f91ac0047c0 2023-12-22T08:41:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.239+0000 7f91c1d9b640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91c414f5d0 0x7f91c40c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.240+0000 7f91c259c640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0047c0 0x7f91c40cc5f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f91b4007290 tx=0x7f91b4007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.240+0000 7f91b2ffd640 1 -- 172.21.15.38:0/718252028 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4001650 con 0x7f91ac0047c0 2023-12-22T08:41:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.240+0000 7f91b2ffd640 1 -- 172.21.15.38:0/718252028 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b400f9c0 con 0x7f91ac0047c0 2023-12-22T08:41:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.240+0000 7f91b2ffd640 1 -- 172.21.15.38:0/718252028 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b400fd70 con 0x7f91ac0047c0 2023-12-22T08:41:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.240+0000 7f91c359e640 1 -- 172.21.15.38:0/718252028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c415faa0 con 0x7f91ac0047c0 2023-12-22T08:41:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.240+0000 7f91c359e640 1 -- 172.21.15.38:0/718252028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c40c4040 con 0x7f91ac0047c0 2023-12-22T08:41:31.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.241+0000 7f91c359e640 1 -- 172.21.15.38:0/718252028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c40c4230 con 0x7f91ac0047c0 2023-12-22T08:41:31.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.242+0000 7f91b2ffd640 1 -- 172.21.15.38:0/718252028 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f91b401d460 con 0x7f91ac0047c0 2023-12-22T08:41:31.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.243+0000 7f91b2ffd640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91a406a430 0x7f91a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.243+0000 7f91b2ffd640 1 -- 172.21.15.38:0/718252028 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91b4088c00 con 0x7f91ac0047c0 2023-12-22T08:41:31.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.244+0000 7f91c1d9b640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91a406a430 0x7f91a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.245+0000 7f91c1d9b640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91a406a430 0x7f91a406c8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f91b8033000 tx=0x7f91b8009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.248+0000 7f91b2ffd640 1 -- 172.21.15.38:0/718252028 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f91b40540c0 con 0x7f91ac0047c0 2023-12-22T08:41:31.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:31.453+0000 7f91c359e640 1 -- 172.21.15.38:0/718252028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f91c40a3850 con 0x7f91ac0047c0 2023-12-22T08:41:32.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.200+0000 7f91b2ffd640 1 -- 172.21.15.38:0/718252028 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v35) v1 ==== 93+0+0 (secure 0 0 0) 0x7f91b40576e0 con 0x7f91ac0047c0 2023-12-22T08:41:32.203 INFO:teuthology.orchestra.run.smithi038.stderr:pauserd,pausewr is set 2023-12-22T08:41:32.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.205+0000 7f91c359e640 1 -- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91a406a430 msgr2=0x7f91a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:32.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.205+0000 7f91c359e640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91a406a430 0x7f91a406c8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f91b8033000 tx=0x7f91b8009030 comp rx=0 tx=0).stop 2023-12-22T08:41:32.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.205+0000 7f91c359e640 1 -- 172.21.15.38:0/718252028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0047c0 msgr2=0x7f91c40cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:32.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.205+0000 7f91c359e640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0047c0 0x7f91c40cc5f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f91b4007290 tx=0x7f91b4007690 comp rx=0 tx=0).stop 2023-12-22T08:41:32.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.205+0000 7f91c359e640 1 -- 172.21.15.38:0/718252028 shutdown_connections 2023-12-22T08:41:32.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.205+0000 7f91c359e640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91c40a3a00 0x7f91c414e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:32.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.205+0000 7f91c359e640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91c414f5d0 0x7f91c40c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:32.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.205+0000 7f91c359e640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91a406a430 0x7f91a406c8f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:32.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.205+0000 7f91c359e640 1 --2- 172.21.15.38:0/718252028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91ac0047c0 0x7f91c40cc5f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:32.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.205+0000 7f91c359e640 1 -- 172.21.15.38:0/718252028 >> 172.21.15.38:0/718252028 conn(0x7f91c40cf000 msgr2=0x7f91c4159450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:32.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.206+0000 7f91c359e640 1 -- 172.21.15.38:0/718252028 shutdown_connections 2023-12-22T08:41:32.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.206+0000 7f91c359e640 1 -- 172.21.15.38:0/718252028 wait complete. 2023-12-22T08:41:32.228 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-12-22T08:41:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.449+0000 7f4d01cdb640 1 Processor -- start 2023-12-22T08:41:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.450+0000 7f4d01cdb640 1 -- start start 2023-12-22T08:41:32.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.451+0000 7f4d01cdb640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4cfc144d10 0x7f4cfc0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:32.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.451+0000 7f4d01cdb640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc1450f0 con 0x7f4cfc0cc670 2023-12-22T08:41:32.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.451+0000 7f4d01cdb640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc0ce010 con 0x7f4cfc0b2760 2023-12-22T08:41:32.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.451+0000 7f4d01cdb640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc0ce2f0 con 0x7f4cfc144d10 2023-12-22T08:41:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.452+0000 7f4cfaffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4cfc0cc670 0x7f4cfc0b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:48402/0 (socket says 172.21.15.38:48402) 2023-12-22T08:41:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.452+0000 7f4cfaffd640 1 -- 172.21.15.38:0/2569217196 learned_addr learned my addr 172.21.15.38:0/2569217196 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.452+0000 7f4cfb7fe640 1 --2- 172.21.15.38:0/2569217196 >> v2:172.21.15.38:3300/0 conn(0x7f4cfc144d10 0x7f4cfc0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.452+0000 7f4cfa7fc640 1 -- 172.21.15.38:0/2569217196 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725262778 0 0) 0x7f4cfc1450f0 con 0x7f4cfc0cc670 2023-12-22T08:41:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.452+0000 7f4cfa7fc640 1 -- 172.21.15.38:0/2569217196 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ce4003520 con 0x7f4cfc0cc670 2023-12-22T08:41:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.452+0000 7f4cfb7fe640 1 -- 172.21.15.38:0/2569217196 >> v1:172.21.15.89:6789/0 conn(0x7f4cfc0b2760 legacy=0x7f4cfc070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.452+0000 7f4cfb7fe640 1 -- 172.21.15.38:0/2569217196 >> v1:172.21.15.38:6789/0 conn(0x7f4cfc0cc670 legacy=0x7f4cfc0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.452+0000 7f4cfb7fe640 1 -- 172.21.15.38:0/2569217196 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc0ce5d0 con 0x7f4cfc144d10 2023-12-22T08:41:32.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.454+0000 7f4cfb7fe640 1 --2- 172.21.15.38:0/2569217196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cfc144d10 0x7f4cfc0cc130 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009d90 tx=0x7f4cec02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22923e56d464950 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:32.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.454+0000 7f4cfa7fc640 1 -- 172.21.15.38:0/2569217196 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec02cd00 con 0x7f4cfc144d10 2023-12-22T08:41:32.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.454+0000 7f4cfa7fc640 1 -- 172.21.15.38:0/2569217196 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec02ce60 con 0x7f4cfc144d10 2023-12-22T08:41:32.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.454+0000 7f4cfa7fc640 1 -- 172.21.15.38:0/2569217196 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec034660 con 0x7f4cfc144d10 2023-12-22T08:41:32.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.455+0000 7f4d01cdb640 1 -- 172.21.15.38:0/2569217196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cfc144d10 msgr2=0x7f4cfc0cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:32.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.455+0000 7f4d01cdb640 1 --2- 172.21.15.38:0/2569217196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cfc144d10 0x7f4cfc0cc130 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009d90 tx=0x7f4cec02bf50 comp rx=0 tx=0).stop 2023-12-22T08:41:32.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.455+0000 7f4d01cdb640 1 -- 172.21.15.38:0/2569217196 shutdown_connections 2023-12-22T08:41:32.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.455+0000 7f4d01cdb640 1 --2- 172.21.15.38:0/2569217196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cfc144d10 0x7f4cfc0cc130 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:32.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.455+0000 7f4d01cdb640 1 -- 172.21.15.38:0/2569217196 >> 172.21.15.38:0/2569217196 conn(0x7f4cfc0cf070 msgr2=0x7f4cfc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:32.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.455+0000 7f4d01cdb640 1 -- 172.21.15.38:0/2569217196 shutdown_connections 2023-12-22T08:41:32.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.455+0000 7f4d01cdb640 1 -- 172.21.15.38:0/2569217196 wait complete. 2023-12-22T08:41:32.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.457+0000 7f4d01cdb640 1 Processor -- start 2023-12-22T08:41:32.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.457+0000 7f4d01cdb640 1 -- start start 2023-12-22T08:41:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.458+0000 7f4d01cdb640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cfc0b2760 0x7f4cfc15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.458+0000 7f4d01cdb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc144d10 0x7f4cfc140a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.458+0000 7f4d01cdb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cfc0a9000 0x7f4cfc15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.458+0000 7f4d01cdb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc1f3b30 con 0x7f4cfc0a9000 2023-12-22T08:41:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.458+0000 7f4d01cdb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc15b420 con 0x7f4cfc144d10 2023-12-22T08:41:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.458+0000 7f4d01cdb640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc1f3d90 con 0x7f4cfc0b2760 2023-12-22T08:41:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.458+0000 7f4cfbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cfc0a9000 0x7f4cfc15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.458+0000 7f4cfbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cfc0a9000 0x7f4cfc15bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43310/0 (socket says 172.21.15.38:43310) 2023-12-22T08:41:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.458+0000 7f4cfbfff640 1 -- 172.21.15.38:0/1800708003 learned_addr learned my addr 172.21.15.38:0/1800708003 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.459+0000 7f4cfb7fe640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cfc0b2760 0x7f4cfc15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.459+0000 7f4cfaffd640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc144d10 0x7f4cfc140a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:32.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.459+0000 7f4cfbfff640 1 -- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cfc0b2760 msgr2=0x7f4cfc15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:32.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.459+0000 7f4cfbfff640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cfc0b2760 0x7f4cfc15aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:32.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.459+0000 7f4cfbfff640 1 -- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc144d10 msgr2=0x7f4cfc140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:32.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.459+0000 7f4cfbfff640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc144d10 0x7f4cfc140a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:32.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.459+0000 7f4cfbfff640 1 -- 172.21.15.38:0/1800708003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec009a70 con 0x7f4cfc0a9000 2023-12-22T08:41:32.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.459+0000 7f4cfaffd640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc144d10 0x7f4cfc140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:32.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.459+0000 7f4cfbfff640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cfc0a9000 0x7f4cfc15bac0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4001eb0 tx=0x7f4cf400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:32.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.459+0000 7f4ce3fff640 1 -- 172.21.15.38:0/1800708003 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40052d0 con 0x7f4cfc0a9000 2023-12-22T08:41:32.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.459+0000 7f4ce3fff640 1 -- 172.21.15.38:0/1800708003 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4005430 con 0x7f4cfc0a9000 2023-12-22T08:41:32.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.459+0000 7f4d01cdb640 1 -- 172.21.15.38:0/1800708003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cfc1f4070 con 0x7f4cfc0a9000 2023-12-22T08:41:32.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.459+0000 7f4ce3fff640 1 -- 172.21.15.38:0/1800708003 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4003810 con 0x7f4cfc0a9000 2023-12-22T08:41:32.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.460+0000 7f4d01cdb640 1 -- 172.21.15.38:0/1800708003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc1f4630 con 0x7f4cfc0a9000 2023-12-22T08:41:32.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.461+0000 7f4d01cdb640 1 -- 172.21.15.38:0/1800708003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cfc061910 con 0x7f4cfc0a9000 2023-12-22T08:41:32.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.462+0000 7f4ce3fff640 1 -- 172.21.15.38:0/1800708003 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4cf4003970 con 0x7f4cfc0a9000 2023-12-22T08:41:32.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.463+0000 7f4ce3fff640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ce806a430 0x7f4ce806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:32.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.463+0000 7f4ce3fff640 1 -- 172.21.15.38:0/1800708003 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cf4087ec0 con 0x7f4cfc0a9000 2023-12-22T08:41:32.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.463+0000 7f4ce3fff640 1 -- 172.21.15.38:0/1800708003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=36+}) v3 -- 0x7f4ce8071f60 con 0x7f4cfc0a9000 2023-12-22T08:41:32.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.463+0000 7f4cfb7fe640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ce806a430 0x7f4ce806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:32.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.464+0000 7f4cfb7fe640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ce806a430 0x7f4ce806c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4cec036000 tx=0x7f4cec030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:32.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.467+0000 7f4ce3fff640 1 -- 172.21.15.38:0/1800708003 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4cf40534b0 con 0x7f4cfc0a9000 2023-12-22T08:41:32.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:32.674+0000 7f4d01cdb640 1 -- 172.21.15.38:0/1800708003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f4cfc0cb8e0 con 0x7f4cfc0a9000 2023-12-22T08:41:33.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.221+0000 7f4ce3fff640 1 -- 172.21.15.38:0/1800708003 <== mon.0 v2:172.21.15.38:3300/0 7 ==== osd_map(36..36 src has 1..36) v4 ==== 288+0+0 (secure 0 0 0) 0x7f4cf4057870 con 0x7f4cfc0a9000 2023-12-22T08:41:33.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.221+0000 7f4ce3fff640 1 -- 172.21.15.38:0/1800708003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=37}) v3 -- 0x7f4ce8072810 con 0x7f4cfc0a9000 2023-12-22T08:41:33.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.227+0000 7f4ce3fff640 1 -- 172.21.15.38:0/1800708003 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4cf4017020 con 0x7f4cfc0a9000 2023-12-22T08:41:33.230 INFO:teuthology.orchestra.run.smithi038.stderr:pauserd,pausewr is unset 2023-12-22T08:41:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.231+0000 7f4d01cdb640 1 -- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ce806a430 msgr2=0x7f4ce806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.231+0000 7f4d01cdb640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ce806a430 0x7f4ce806c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4cec036000 tx=0x7f4cec030000 comp rx=0 tx=0).stop 2023-12-22T08:41:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.231+0000 7f4d01cdb640 1 -- 172.21.15.38:0/1800708003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cfc0a9000 msgr2=0x7f4cfc15bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.231+0000 7f4d01cdb640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cfc0a9000 0x7f4cfc15bac0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4001eb0 tx=0x7f4cf400c890 comp rx=0 tx=0).stop 2023-12-22T08:41:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.231+0000 7f4d01cdb640 1 -- 172.21.15.38:0/1800708003 shutdown_connections 2023-12-22T08:41:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.231+0000 7f4d01cdb640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ce806a430 0x7f4ce806c8f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.231+0000 7f4d01cdb640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cfc0a9000 0x7f4cfc15bac0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.231+0000 7f4d01cdb640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc144d10 0x7f4cfc140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:33.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.231+0000 7f4d01cdb640 1 --2- 172.21.15.38:0/1800708003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cfc0b2760 0x7f4cfc15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:33.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.231+0000 7f4d01cdb640 1 -- 172.21.15.38:0/1800708003 >> 172.21.15.38:0/1800708003 conn(0x7f4cfc0cf070 msgr2=0x7f4cfc071870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:33.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.232+0000 7f4d01cdb640 1 -- 172.21.15.38:0/1800708003 shutdown_connections 2023-12-22T08:41:33.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.232+0000 7f4d01cdb640 1 -- 172.21.15.38:0/1800708003 wait complete. 2023-12-22T08:41:33.256 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:33.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.471+0000 7fb84e4fa640 1 Processor -- start 2023-12-22T08:41:33.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.471+0000 7fb84e4fa640 1 -- start start 2023-12-22T08:41:33.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.473+0000 7fb84e4fa640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb848157980 0x7fb84815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:33.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.473+0000 7fb84e4fa640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8480d1520 con 0x7fb8480b3ff0 2023-12-22T08:41:33.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.473+0000 7fb84e4fa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8480d1800 con 0x7fb84806d640 2023-12-22T08:41:33.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.473+0000 7fb84e4fa640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480d1ae0 con 0x7fb848157980 2023-12-22T08:41:33.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.473+0000 7fb84ccf7640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb8480b3ff0 0x7fb84806cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:48416/0 (socket says 172.21.15.38:48416) 2023-12-22T08:41:33.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.473+0000 7fb84ccf7640 1 -- 172.21.15.38:0/2944739397 learned_addr learned my addr 172.21.15.38:0/2944739397 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.473+0000 7fb84d4f8640 1 --2- 172.21.15.38:0/2944739397 >> v2:172.21.15.38:3300/0 conn(0x7fb848157980 0x7fb84815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.474+0000 7fb83ffff640 1 -- 172.21.15.38:0/2944739397 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196517559 0 0) 0x7fb8480d1520 con 0x7fb8480b3ff0 2023-12-22T08:41:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.474+0000 7fb83ffff640 1 -- 172.21.15.38:0/2944739397 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb834003520 con 0x7fb8480b3ff0 2023-12-22T08:41:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.474+0000 7fb84d4f8640 1 -- 172.21.15.38:0/2944739397 >> v1:172.21.15.89:6789/0 conn(0x7fb84806d640 legacy=0x7fb8480d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.474+0000 7fb84d4f8640 1 -- 172.21.15.38:0/2944739397 >> v1:172.21.15.38:6789/0 conn(0x7fb8480b3ff0 legacy=0x7fb84806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.474+0000 7fb84d4f8640 1 -- 172.21.15.38:0/2944739397 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8480d1dc0 con 0x7fb848157980 2023-12-22T08:41:33.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.476+0000 7fb84d4f8640 1 --2- 172.21.15.38:0/2944739397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb848157980 0x7fb84815eb10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb8440097a0 tx=0x7fb84402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ba2545c0e4adcb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:33.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.476+0000 7fb83ffff640 1 -- 172.21.15.38:0/2944739397 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844030610 con 0x7fb848157980 2023-12-22T08:41:33.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.476+0000 7fb83ffff640 1 -- 172.21.15.38:0/2944739397 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb844030770 con 0x7fb848157980 2023-12-22T08:41:33.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.476+0000 7fb83ffff640 1 -- 172.21.15.38:0/2944739397 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844030b00 con 0x7fb848157980 2023-12-22T08:41:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.477+0000 7fb84e4fa640 1 -- 172.21.15.38:0/2944739397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb848157980 msgr2=0x7fb84815eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.477+0000 7fb84e4fa640 1 --2- 172.21.15.38:0/2944739397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb848157980 0x7fb84815eb10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb8440097a0 tx=0x7fb84402b960 comp rx=0 tx=0).stop 2023-12-22T08:41:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.477+0000 7fb84e4fa640 1 -- 172.21.15.38:0/2944739397 shutdown_connections 2023-12-22T08:41:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.477+0000 7fb84e4fa640 1 --2- 172.21.15.38:0/2944739397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb848157980 0x7fb84815eb10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.477+0000 7fb84e4fa640 1 -- 172.21.15.38:0/2944739397 >> 172.21.15.38:0/2944739397 conn(0x7fb8480d31f0 msgr2=0x7fb8480d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.477+0000 7fb84e4fa640 1 -- 172.21.15.38:0/2944739397 shutdown_connections 2023-12-22T08:41:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.477+0000 7fb84e4fa640 1 -- 172.21.15.38:0/2944739397 wait complete. 2023-12-22T08:41:33.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.480+0000 7fb84e4fa640 1 Processor -- start 2023-12-22T08:41:33.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.480+0000 7fb84e4fa640 1 -- start start 2023-12-22T08:41:33.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.481+0000 7fb84e4fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb84806d640 0x7fb84814c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:33.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.481+0000 7fb84e4fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8480b3ff0 0x7fb8481562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:33.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.481+0000 7fb84e4fa640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb848157980 0x7fb848156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:33.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.481+0000 7fb84e4fa640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84814c600 con 0x7fb84806d640 2023-12-22T08:41:33.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.481+0000 7fb84e4fa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8481556c0 con 0x7fb8480b3ff0 2023-12-22T08:41:33.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.481+0000 7fb84e4fa640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8481553e0 con 0x7fb848157980 2023-12-22T08:41:33.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.482+0000 7fb84d4f8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb84806d640 0x7fb84814c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:33.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.482+0000 7fb84d4f8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb84806d640 0x7fb84814c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43322/0 (socket says 172.21.15.38:43322) 2023-12-22T08:41:33.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.482+0000 7fb84d4f8640 1 -- 172.21.15.38:0/3352985634 learned_addr learned my addr 172.21.15.38:0/3352985634 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:33.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.482+0000 7fb84ccf7640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8480b3ff0 0x7fb8481562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:33.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.482+0000 7fb84dcf9640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb848157980 0x7fb848156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:33.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.482+0000 7fb84d4f8640 1 -- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb848157980 msgr2=0x7fb848156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:33.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.482+0000 7fb84d4f8640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb848157980 0x7fb848156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:33.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.482+0000 7fb84d4f8640 1 -- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8480b3ff0 msgr2=0x7fb8481562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:33.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.482+0000 7fb84d4f8640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8480b3ff0 0x7fb8481562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:33.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.482+0000 7fb84d4f8640 1 -- 172.21.15.38:0/3352985634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb844009400 con 0x7fb84806d640 2023-12-22T08:41:33.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.483+0000 7fb84d4f8640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb84806d640 0x7fb84814c0c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb84402bf70 tx=0x7fb844004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:33.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.483+0000 7fb83dffb640 1 -- 172.21.15.38:0/3352985634 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84403e040 con 0x7fb84806d640 2023-12-22T08:41:33.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.483+0000 7fb83dffb640 1 -- 172.21.15.38:0/3352985634 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb844039cb0 con 0x7fb84806d640 2023-12-22T08:41:33.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.483+0000 7fb84e4fa640 1 -- 172.21.15.38:0/3352985634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb848158fd0 con 0x7fb84806d640 2023-12-22T08:41:33.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.483+0000 7fb83dffb640 1 -- 172.21.15.38:0/3352985634 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844044630 con 0x7fb84806d640 2023-12-22T08:41:33.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.483+0000 7fb84e4fa640 1 -- 172.21.15.38:0/3352985634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb848159590 con 0x7fb84806d640 2023-12-22T08:41:33.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.485+0000 7fb84e4fa640 1 -- 172.21.15.38:0/3352985634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb848061910 con 0x7fb84806d640 2023-12-22T08:41:33.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.486+0000 7fb83dffb640 1 -- 172.21.15.38:0/3352985634 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb84404d3b0 con 0x7fb84806d640 2023-12-22T08:41:33.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.487+0000 7fb83dffb640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb82c06a480 0x7fb82c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:33.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.487+0000 7fb83dffb640 1 -- 172.21.15.38:0/3352985634 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8440aaee0 con 0x7fb84806d640 2023-12-22T08:41:33.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.488+0000 7fb84ccf7640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb82c06a480 0x7fb82c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:33.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.489+0000 7fb84ccf7640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb82c06a480 0x7fb82c06c940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb8481619d0 tx=0x7fb838009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:33.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.492+0000 7fb83dffb640 1 -- 172.21.15.38:0/3352985634 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb8440764b0 con 0x7fb84806d640 2023-12-22T08:41:33.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.687+0000 7fb84e4fa640 1 -- 172.21.15.38:0/3352985634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb848067040 con 0x7fb84806d640 2023-12-22T08:41:33.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.689+0000 7fb83dffb640 1 -- 172.21.15.38:0/3352985634 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+15993 (secure 0 0 0) 0x7fb844079ad0 con 0x7fb84806d640 2023-12-22T08:41:33.692 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:33.692 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":36,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:41:33.206742+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:12.357679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:13.069596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:33.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.693+0000 7fb84e4fa640 1 -- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb82c06a480 msgr2=0x7fb82c06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:33.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.693+0000 7fb84e4fa640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb82c06a480 0x7fb82c06c940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb8481619d0 tx=0x7fb838009040 comp rx=0 tx=0).stop 2023-12-22T08:41:33.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.693+0000 7fb84e4fa640 1 -- 172.21.15.38:0/3352985634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb84806d640 msgr2=0x7fb84814c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:33.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.693+0000 7fb84e4fa640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb84806d640 0x7fb84814c0c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb84402bf70 tx=0x7fb844004730 comp rx=0 tx=0).stop 2023-12-22T08:41:33.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.693+0000 7fb84e4fa640 1 -- 172.21.15.38:0/3352985634 shutdown_connections 2023-12-22T08:41:33.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.693+0000 7fb84e4fa640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb848157980 0x7fb848156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:33.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.693+0000 7fb84e4fa640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8480b3ff0 0x7fb8481562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:33.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.693+0000 7fb84e4fa640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb82c06a480 0x7fb82c06c940 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:33.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.693+0000 7fb84e4fa640 1 --2- 172.21.15.38:0/3352985634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb84806d640 0x7fb84814c0c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:33.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.693+0000 7fb84e4fa640 1 -- 172.21.15.38:0/3352985634 >> 172.21.15.38:0/3352985634 conn(0x7fb8480d31f0 msgr2=0x7fb84814d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:33.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.693+0000 7fb84e4fa640 1 -- 172.21.15.38:0/3352985634 shutdown_connections 2023-12-22T08:41:33.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:33.693+0000 7fb84e4fa640 1 -- 172.21.15.38:0/3352985634 wait complete. 2023-12-22T08:41:33.714 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T08:41:33.714 DEBUG:teuthology.orchestra.run.smithi038:> import os 2023-12-22T08:41:33.714 DEBUG:teuthology.orchestra.run.smithi038:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-22T08:41:33.714 DEBUG:teuthology.orchestra.run.smithi038:> os.fchmod(fd, 0O666) 2023-12-22T08:41:33.714 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(fd) 2023-12-22T08:41:33.715 DEBUG:teuthology.orchestra.run.smithi038:> os.close(fd) 2023-12-22T08:41:33.715 DEBUG:teuthology.orchestra.run.smithi038:> ' 2023-12-22T08:41:34.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:34.051 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:41:34.158 INFO:teuthology.orchestra.run.smithi038.stdout:client5023 2023-12-22T08:41:34.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:34.158 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/893856d7-5d01-4896-9127-f971dbad2b97.client5023/osdmap') 2023-12-22T08:41:34.260 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 34 barrier 34 flags 0x588000 2023-12-22T08:41:34.261 INFO:teuthology.orchestra.run.smithi038.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:41:34.261 INFO:teuthology.orchestra.run.smithi038.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:41:34.261 INFO:teuthology.orchestra.run.smithi038.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:41:34.261 INFO:teuthology.orchestra.run.smithi038.stdout:osd0 (2)172.21.15.38:6800 100% (exists, up) 100% -1 2023-12-22T08:41:34.261 INFO:teuthology.orchestra.run.smithi038.stdout:osd1 (2)172.21.15.38:6808 100% (exists, up) 100% -1 2023-12-22T08:41:34.261 INFO:teuthology.orchestra.run.smithi038.stdout:osd2 (2)172.21.15.38:6824 100% (exists, up) 100% -1 2023-12-22T08:41:34.261 INFO:teuthology.orchestra.run.smithi038.stdout:osd3 (2)172.21.15.38:6816 100% (exists, up) 100% -1 2023-12-22T08:41:34.261 INFO:teuthology.orchestra.run.smithi038.stdout:osd4 (2)172.21.15.89:6800 100% (exists, up) 100% -1 2023-12-22T08:41:34.261 INFO:teuthology.orchestra.run.smithi038.stdout:osd5 (2)172.21.15.89:6816 100% (exists, up) 100% -1 2023-12-22T08:41:34.261 INFO:teuthology.orchestra.run.smithi038.stdout:osd6 (2)172.21.15.89:6808 100% (exists, up) 100% -1 2023-12-22T08:41:34.261 INFO:teuthology.orchestra.run.smithi038.stdout:osd7 (2)172.21.15.89:6821 100% (exists, up) 100% -1 2023-12-22T08:41:34.262 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records in 2023-12-22T08:41:34.262 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records out 2023-12-22T08:41:34.262 INFO:teuthology.orchestra.run.smithi038.stderr:791 bytes copied, 9.3704e-05 s, 8.4 MB/s 2023-12-22T08:41:34.264 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:34.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.493+0000 7f0892417640 1 Processor -- start 2023-12-22T08:41:34.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.494+0000 7f0892417640 1 -- start start 2023-12-22T08:41:34.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.495+0000 7f0892417640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f088c146be0 0x7f088c0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:34.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.495+0000 7f0892417640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c15e6c0 0x7f088c0d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:34.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.495+0000 7f0892417640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c15eac0 con 0x7f088c146fc0 2023-12-22T08:41:34.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.495+0000 7f0892417640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088c0d1b70 con 0x7f088c146be0 2023-12-22T08:41:34.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.495+0000 7f0892417640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c15ed10 con 0x7f088c15e6c0 2023-12-22T08:41:34.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.496+0000 7f088bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f088c146be0 0x7f088c0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:34.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.496+0000 7f088bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f088c146be0 0x7f088c0d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43326/0 (socket says 172.21.15.38:43326) 2023-12-22T08:41:34.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.496+0000 7f088bfff640 1 -- 172.21.15.38:0/2381609269 learned_addr learned my addr 172.21.15.38:0/2381609269 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:34.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.496+0000 7f08909b4640 1 --2- 172.21.15.38:0/2381609269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c15e6c0 0x7f088c0d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:34.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.496+0000 7f088bfff640 1 -- 172.21.15.38:0/2381609269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c15e6c0 msgr2=0x7f088c0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:34.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.496+0000 7f088bfff640 1 --2- 172.21.15.38:0/2381609269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c15e6c0 0x7f088c0d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:34.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.496+0000 7f088bfff640 1 -- 172.21.15.38:0/2381609269 >> v1:172.21.15.89:6789/0 conn(0x7f088c146fc0 legacy=0x7f088c15dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:34.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.496+0000 7f088bfff640 1 -- 172.21.15.38:0/2381609269 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c162200 con 0x7f088c146be0 2023-12-22T08:41:34.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.496+0000 7f08909b4640 1 --2- 172.21.15.38:0/2381609269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c15e6c0 0x7f088c0d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:34.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.497+0000 7f088bfff640 1 --2- 172.21.15.38:0/2381609269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f088c146be0 0x7f088c0d10f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f087c009870 tx=0x7f087c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c98e572e19d8169 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:34.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.498+0000 7f088b7fe640 1 -- 172.21.15.38:0/2381609269 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c031640 con 0x7f088c146be0 2023-12-22T08:41:34.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.498+0000 7f088b7fe640 1 -- 172.21.15.38:0/2381609269 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c0317a0 con 0x7f088c146be0 2023-12-22T08:41:34.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.498+0000 7f088b7fe640 1 -- 172.21.15.38:0/2381609269 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c031b30 con 0x7f088c146be0 2023-12-22T08:41:34.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.498+0000 7f0892417640 1 -- 172.21.15.38:0/2381609269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f088c146be0 msgr2=0x7f088c0d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:34.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.498+0000 7f0892417640 1 --2- 172.21.15.38:0/2381609269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f088c146be0 0x7f088c0d10f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f087c009870 tx=0x7f087c02b8f0 comp rx=0 tx=0).stop 2023-12-22T08:41:34.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.498+0000 7f0892417640 1 -- 172.21.15.38:0/2381609269 shutdown_connections 2023-12-22T08:41:34.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.498+0000 7f0892417640 1 --2- 172.21.15.38:0/2381609269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c15e6c0 0x7f088c0d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:34.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.498+0000 7f0892417640 1 --2- 172.21.15.38:0/2381609269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f088c146be0 0x7f088c0d10f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:34.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.498+0000 7f0892417640 1 -- 172.21.15.38:0/2381609269 >> 172.21.15.38:0/2381609269 conn(0x7f088c06c5e0 msgr2=0x7f088c06c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:34.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.498+0000 7f0892417640 1 -- 172.21.15.38:0/2381609269 shutdown_connections 2023-12-22T08:41:34.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.499+0000 7f0892417640 1 -- 172.21.15.38:0/2381609269 wait complete. 2023-12-22T08:41:34.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.500+0000 7f0892417640 1 Processor -- start 2023-12-22T08:41:34.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.500+0000 7f0892417640 1 -- start start 2023-12-22T08:41:34.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.501+0000 7f0892417640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f088c146be0 0x7f088c13eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:34.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.501+0000 7f0892417640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c146fc0 0x7f088c1f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:34.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.501+0000 7f0892417640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f088c15e6c0 0x7f088c145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:34.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.501+0000 7f0892417640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c13f180 con 0x7f088c146be0 2023-12-22T08:41:34.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.501+0000 7f0892417640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c13f460 con 0x7f088c15e6c0 2023-12-22T08:41:34.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.501+0000 7f0892417640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c13f740 con 0x7f088c146fc0 2023-12-22T08:41:34.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.502+0000 7f088bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f088c146be0 0x7f088c13eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:34.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.502+0000 7f088bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f088c146be0 0x7f088c13eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43330/0 (socket says 172.21.15.38:43330) 2023-12-22T08:41:34.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.502+0000 7f088bfff640 1 -- 172.21.15.38:0/1672044937 learned_addr learned my addr 172.21.15.38:0/1672044937 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:34.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.502+0000 7f08909b4640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f088c15e6c0 0x7f088c145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:34.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.502+0000 7f0883fff640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c146fc0 0x7f088c1f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:34.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.502+0000 7f088bfff640 1 -- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c146fc0 msgr2=0x7f088c1f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:34.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.502+0000 7f088bfff640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c146fc0 0x7f088c1f39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:34.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.502+0000 7f088bfff640 1 -- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f088c15e6c0 msgr2=0x7f088c145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:34.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.502+0000 7f088bfff640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f088c15e6c0 0x7f088c145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:34.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.502+0000 7f088bfff640 1 -- 172.21.15.38:0/1672044937 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c0094d0 con 0x7f088c146be0 2023-12-22T08:41:34.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.502+0000 7f088bfff640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f088c146be0 0x7f088c13eaa0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f087c009870 tx=0x7f087c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:34.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.503+0000 7f08897fa640 1 -- 172.21.15.38:0/1672044937 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c03ac60 con 0x7f088c146be0 2023-12-22T08:41:34.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.503+0000 7f08897fa640 1 -- 172.21.15.38:0/1672044937 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c03ade0 con 0x7f088c146be0 2023-12-22T08:41:34.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.503+0000 7f08897fa640 1 -- 172.21.15.38:0/1672044937 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c044630 con 0x7f088c146be0 2023-12-22T08:41:34.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.503+0000 7f0892417640 1 -- 172.21.15.38:0/1672044937 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088c13b6a0 con 0x7f088c146be0 2023-12-22T08:41:34.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.503+0000 7f0892417640 1 -- 172.21.15.38:0/1672044937 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088c1462a0 con 0x7f088c146be0 2023-12-22T08:41:34.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.504+0000 7f0892417640 1 -- 172.21.15.38:0/1672044937 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088c146490 con 0x7f088c146be0 2023-12-22T08:41:34.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.505+0000 7f08897fa640 1 -- 172.21.15.38:0/1672044937 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f087c02f050 con 0x7f088c146be0 2023-12-22T08:41:34.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.506+0000 7f08897fa640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f086c06a430 0x7f086c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:34.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.506+0000 7f08897fa640 1 -- 172.21.15.38:0/1672044937 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f087c0aab50 con 0x7f088c146be0 2023-12-22T08:41:34.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.507+0000 7f0883fff640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f086c06a430 0x7f086c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:34.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.508+0000 7f0883fff640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f086c06a430 0x7f086c06c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f088c06b640 tx=0x7f0874009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:34.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.510+0000 7f08897fa640 1 -- 172.21.15.38:0/1672044937 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f087c076170 con 0x7f088c146be0 2023-12-22T08:41:34.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.740+0000 7f0892417640 1 -- 172.21.15.38:0/1672044937 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f088c13f960 con 0x7f088c146be0 2023-12-22T08:41:34.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.742+0000 7f08897fa640 1 -- 172.21.15.38:0/1672044937 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f087c035020 con 0x7f088c146be0 2023-12-22T08:41:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:34.745 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1244935716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1244935716},{"type":"v1","addr":"172.21.15.89:6837","nonce":1244935716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/23463229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":23463229},{"type":"v1","addr":"172.21.15.38:6833","nonce":23463229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3876693609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3876693609},{"type":"v1","addr":"172.21.15.89:6836","nonce":3876693609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:41:14.062124+0000","modified":"2023-12-22T08:41:17.103814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.38:6835/2926436383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2926436383},{"type":"v1","addr":"172.21.15.38:6835","nonce":2926436383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-22T08:41:34.745 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 16 2023-12-22T08:41:34.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.744+0000 7f0892417640 1 -- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f086c06a430 msgr2=0x7f086c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:34.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.744+0000 7f0892417640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f086c06a430 0x7f086c06c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f088c06b640 tx=0x7f0874009040 comp rx=0 tx=0).stop 2023-12-22T08:41:34.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.744+0000 7f0892417640 1 -- 172.21.15.38:0/1672044937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f088c146be0 msgr2=0x7f088c13eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:34.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.744+0000 7f0892417640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f088c146be0 0x7f088c13eaa0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f087c009870 tx=0x7f087c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:34.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.744+0000 7f0892417640 1 -- 172.21.15.38:0/1672044937 shutdown_connections 2023-12-22T08:41:34.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.744+0000 7f0892417640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f088c15e6c0 0x7f088c145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:34.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.745+0000 7f0892417640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f088c146fc0 0x7f088c1f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:34.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.745+0000 7f0892417640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f086c06a430 0x7f086c06c8f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:34.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.745+0000 7f0892417640 1 --2- 172.21.15.38:0/1672044937 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f088c146be0 0x7f088c13eaa0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:34.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.745+0000 7f0892417640 1 -- 172.21.15.38:0/1672044937 >> 172.21.15.38:0/1672044937 conn(0x7f088c06c5e0 msgr2=0x7f088c157b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:34.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.745+0000 7f0892417640 1 -- 172.21.15.38:0/1672044937 shutdown_connections 2023-12-22T08:41:34.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:34.745+0000 7f0892417640 1 -- 172.21.15.38:0/1672044937 wait complete. 2023-12-22T08:41:34.768 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json osdmap barrier 36 2023-12-22T08:41:35.004 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-12-22T08:41:35.005 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T08:41:35.005 DEBUG:teuthology.orchestra.run.smithi038:> import os 2023-12-22T08:41:35.005 DEBUG:teuthology.orchestra.run.smithi038:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-22T08:41:35.005 DEBUG:teuthology.orchestra.run.smithi038:> os.fchmod(fd, 0O666) 2023-12-22T08:41:35.005 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(fd) 2023-12-22T08:41:35.005 DEBUG:teuthology.orchestra.run.smithi038:> os.close(fd) 2023-12-22T08:41:35.005 DEBUG:teuthology.orchestra.run.smithi038:> ' 2023-12-22T08:41:35.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:35.333 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:41:35.442 INFO:teuthology.orchestra.run.smithi038.stdout:client5023 2023-12-22T08:41:35.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:35.443 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/893856d7-5d01-4896-9127-f971dbad2b97.client5023/osdmap') 2023-12-22T08:41:35.544 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 36 barrier 36 flags 0x588000 2023-12-22T08:41:35.545 INFO:teuthology.orchestra.run.smithi038.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:41:35.545 INFO:teuthology.orchestra.run.smithi038.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:41:35.545 INFO:teuthology.orchestra.run.smithi038.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:41:35.545 INFO:teuthology.orchestra.run.smithi038.stdout:osd0 (2)172.21.15.38:6800 100% (exists, up) 100% -1 2023-12-22T08:41:35.545 INFO:teuthology.orchestra.run.smithi038.stdout:osd1 (2)172.21.15.38:6808 100% (exists, up) 100% -1 2023-12-22T08:41:35.545 INFO:teuthology.orchestra.run.smithi038.stdout:osd2 (2)172.21.15.38:6824 100% (exists, up) 100% -1 2023-12-22T08:41:35.545 INFO:teuthology.orchestra.run.smithi038.stdout:osd3 (2)172.21.15.38:6816 100% (exists, up) 100% -1 2023-12-22T08:41:35.545 INFO:teuthology.orchestra.run.smithi038.stdout:osd4 (2)172.21.15.89:6800 100% (exists, up) 100% -1 2023-12-22T08:41:35.545 INFO:teuthology.orchestra.run.smithi038.stdout:osd5 (2)172.21.15.89:6816 100% (exists, up) 100% -1 2023-12-22T08:41:35.545 INFO:teuthology.orchestra.run.smithi038.stdout:osd6 (2)172.21.15.89:6808 100% (exists, up) 100% -1 2023-12-22T08:41:35.545 INFO:teuthology.orchestra.run.smithi038.stdout:osd7 (2)172.21.15.89:6821 100% (exists, up) 100% -1 2023-12-22T08:41:35.546 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records in 2023-12-22T08:41:35.546 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records out 2023-12-22T08:41:35.546 INFO:teuthology.orchestra.run.smithi038.stderr:791 bytes copied, 9.3182e-05 s, 8.5 MB/s 2023-12-22T08:41:35.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:35.549 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:41:35.612 INFO:teuthology.orchestra.run.smithi038.stdout:client5023 2023-12-22T08:41:35.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:35.612 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/893856d7-5d01-4896-9127-f971dbad2b97.client5023/osdmap') 2023-12-22T08:41:35.712 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 36 barrier 36 flags 0x588000 2023-12-22T08:41:35.712 INFO:teuthology.orchestra.run.smithi038.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:41:35.712 INFO:teuthology.orchestra.run.smithi038.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:41:35.712 INFO:teuthology.orchestra.run.smithi038.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:41:35.712 INFO:teuthology.orchestra.run.smithi038.stdout:osd0 (2)172.21.15.38:6800 100% (exists, up) 100% -1 2023-12-22T08:41:35.712 INFO:teuthology.orchestra.run.smithi038.stdout:osd1 (2)172.21.15.38:6808 100% (exists, up) 100% -1 2023-12-22T08:41:35.712 INFO:teuthology.orchestra.run.smithi038.stdout:osd2 (2)172.21.15.38:6824 100% (exists, up) 100% -1 2023-12-22T08:41:35.712 INFO:teuthology.orchestra.run.smithi038.stdout:osd3 (2)172.21.15.38:6816 100% (exists, up) 100% -1 2023-12-22T08:41:35.712 INFO:teuthology.orchestra.run.smithi038.stdout:osd4 (2)172.21.15.89:6800 100% (exists, up) 100% -1 2023-12-22T08:41:35.712 INFO:teuthology.orchestra.run.smithi038.stdout:osd5 (2)172.21.15.89:6816 100% (exists, up) 100% -1 2023-12-22T08:41:35.712 INFO:teuthology.orchestra.run.smithi038.stdout:osd6 (2)172.21.15.89:6808 100% (exists, up) 100% -1 2023-12-22T08:41:35.713 INFO:teuthology.orchestra.run.smithi038.stdout:osd7 (2)172.21.15.89:6821 100% (exists, up) 100% -1 2023-12-22T08:41:35.713 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records in 2023-12-22T08:41:35.713 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records out 2023-12-22T08:41:35.713 INFO:teuthology.orchestra.run.smithi038.stderr:791 bytes copied, 9.048e-05 s, 8.7 MB/s 2023-12-22T08:41:35.716 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-22T08:41:35.716 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:41:35.716 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:41:35.839 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:41:35.964 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:41:35.964 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:41:35.964 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:36.028 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:41:36.050 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:36.114 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:36.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.343+0000 7fdc819c9640 1 Processor -- start 2023-12-22T08:41:36.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.344+0000 7fdc819c9640 1 -- start start 2023-12-22T08:41:36.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.345+0000 7fdc819c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc7c0d1240 0x7fdc7c0b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.345+0000 7fdc819c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc7c0b3b40 0x7fdc7c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.345+0000 7fdc819c9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7c0b5c80 con 0x7fdc7c0cfc60 2023-12-22T08:41:36.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.345+0000 7fdc819c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7c0d0760 con 0x7fdc7c0d1240 2023-12-22T08:41:36.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.345+0000 7fdc819c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c0d01a0 con 0x7fdc7c0b3b40 2023-12-22T08:41:36.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.345+0000 7fdc7b7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdc7c0cfc60 0x7fdc7c0b6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:48420/0 (socket says 172.21.15.38:48420) 2023-12-22T08:41:36.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.345+0000 7fdc7b7fe640 1 -- 172.21.15.38:0/760089751 learned_addr learned my addr 172.21.15.38:0/760089751 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:36.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.346+0000 7fdc7a7fc640 1 --2- 172.21.15.38:0/760089751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc7c0b3b40 0x7fdc7c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.346+0000 7fdc7affd640 1 --2- 172.21.15.38:0/760089751 >> v2:172.21.15.89:3300/0 conn(0x7fdc7c0d1240 0x7fdc7c0b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.346+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2599220391 0 0) 0x7fdc7c0b5c80 con 0x7fdc7c0cfc60 2023-12-22T08:41:36.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.346+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc68003520 con 0x7fdc7c0cfc60 2023-12-22T08:41:36.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.346+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1261374903 0 0) 0x7fdc68003520 con 0x7fdc7c0cfc60 2023-12-22T08:41:36.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.346+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc7c0b3b40 msgr2=0x7fdc7c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:36.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.346+0000 7fdc79ffb640 1 --2- 172.21.15.38:0/760089751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc7c0b3b40 0x7fdc7c0cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.346+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 >> v2:172.21.15.89:3300/0 conn(0x7fdc7c0d1240 msgr2=0x7fdc7c0b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:36.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.346+0000 7fdc79ffb640 1 --2- 172.21.15.38:0/760089751 >> v2:172.21.15.89:3300/0 conn(0x7fdc7c0d1240 0x7fdc7c0b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.346+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c0d0480 con 0x7fdc7c0cfc60 2023-12-22T08:41:36.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.346+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fdc74001670 con 0x7fdc7c0cfc60 2023-12-22T08:41:36.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.346+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 >> v1:172.21.15.38:6789/0 conn(0x7fdc7c0cfc60 legacy=0x7fdc7c0b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.346+0000 7fdc79ffb640 1 --2- 172.21.15.38:0/760089751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc68003970 0x7fdc68003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc79ffb640 1 --2- 172.21.15.38:0/760089751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc680047c0 0x7fdc68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc79ffb640 1 --2- 172.21.15.38:0/760089751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc7c0b3b40 0x7fdc68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c0d0760 con 0x7fdc680047c0 2023-12-22T08:41:36.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c0d01a0 con 0x7fdc68003970 2023-12-22T08:41:36.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6800b980 con 0x7fdc7c0b3b40 2023-12-22T08:41:36.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc7a7fc640 1 --2- 172.21.15.38:0/760089751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc680047c0 0x7fdc68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc7affd640 1 --2- 172.21.15.38:0/760089751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc68003970 0x7fdc68003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc7b7fe640 1 --2- 172.21.15.38:0/760089751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc7c0b3b40 0x7fdc68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc7a7fc640 1 -- 172.21.15.38:0/760089751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc7c0b3b40 msgr2=0x7fdc68005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:36.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc7a7fc640 1 --2- 172.21.15.38:0/760089751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc7c0b3b40 0x7fdc68005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc7a7fc640 1 -- 172.21.15.38:0/760089751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc68003970 msgr2=0x7fdc68003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:36.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc7a7fc640 1 --2- 172.21.15.38:0/760089751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc68003970 0x7fdc68003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc7a7fc640 1 -- 172.21.15.38:0/760089751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc68003520 con 0x7fdc680047c0 2023-12-22T08:41:36.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.347+0000 7fdc7affd640 1 --2- 172.21.15.38:0/760089751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc68003970 0x7fdc68003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:36.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.348+0000 7fdc7a7fc640 1 --2- 172.21.15.38:0/760089751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc680047c0 0x7fdc68004c40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009a90 tx=0x7fdc680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc15b43979aa961 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:36.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.349+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6402c6b0 con 0x7fdc680047c0 2023-12-22T08:41:36.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.349+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6402c810 con 0x7fdc680047c0 2023-12-22T08:41:36.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.349+0000 7fdc79ffb640 1 -- 172.21.15.38:0/760089751 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6402cba0 con 0x7fdc680047c0 2023-12-22T08:41:36.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.349+0000 7fdc819c9640 1 -- 172.21.15.38:0/760089751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc680047c0 msgr2=0x7fdc68004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.349+0000 7fdc819c9640 1 --2- 172.21.15.38:0/760089751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc680047c0 0x7fdc68004c40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009a90 tx=0x7fdc680057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.349+0000 7fdc7b7fe640 1 -- 172.21.15.38:0/760089751 reap_dead start 2023-12-22T08:41:36.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.349+0000 7fdc819c9640 1 -- 172.21.15.38:0/760089751 shutdown_connections 2023-12-22T08:41:36.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.349+0000 7fdc819c9640 1 -- 172.21.15.38:0/760089751 >> 172.21.15.38:0/760089751 conn(0x7fdc7c06c5e0 msgr2=0x7fdc7c06c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:36.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.349+0000 7fdc819c9640 1 -- 172.21.15.38:0/760089751 shutdown_connections 2023-12-22T08:41:36.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.350+0000 7fdc819c9640 1 -- 172.21.15.38:0/760089751 wait complete. 2023-12-22T08:41:36.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.351+0000 7fdc819c9640 1 Processor -- start 2023-12-22T08:41:36.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.352+0000 7fdc819c9640 1 -- start start 2023-12-22T08:41:36.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.352+0000 7fdc819c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc680047c0 0x7fdc7c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.352+0000 7fdc819c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc7c14b530 0x7fdc7c0c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc819c9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc7c14d700 0x7fdc7c14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc819c9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c14b9b0 con 0x7fdc7c14d700 2023-12-22T08:41:36.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc819c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c14e0c0 con 0x7fdc680047c0 2023-12-22T08:41:36.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc819c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c0c71f0 con 0x7fdc7c14b530 2023-12-22T08:41:36.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc7b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc7c14d700 0x7fdc7c14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc7b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc7c14d700 0x7fdc7c14db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43350/0 (socket says 172.21.15.38:43350) 2023-12-22T08:41:36.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc7b7fe640 1 -- 172.21.15.38:0/65859998 learned_addr learned my addr 172.21.15.38:0/65859998 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:36.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc7affd640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc680047c0 0x7fdc7c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc7a7fc640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc7c14b530 0x7fdc7c0c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc7b7fe640 1 -- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc7c14b530 msgr2=0x7fdc7c0c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc7b7fe640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc7c14b530 0x7fdc7c0c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc7b7fe640 1 -- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc680047c0 msgr2=0x7fdc7c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc7b7fe640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc680047c0 0x7fdc7c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.353+0000 7fdc7b7fe640 1 -- 172.21.15.38:0/65859998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c15f340 con 0x7fdc7c14d700 2023-12-22T08:41:36.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.354+0000 7fdc7b7fe640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc7c14d700 0x7fdc7c14db80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdc74001930 tx=0x7fdc7400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:36.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.354+0000 7fdc73fff640 1 -- 172.21.15.38:0/65859998 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc740074e0 con 0x7fdc7c14d700 2023-12-22T08:41:36.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.354+0000 7fdc73fff640 1 -- 172.21.15.38:0/65859998 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc74007640 con 0x7fdc7c14d700 2023-12-22T08:41:36.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.354+0000 7fdc819c9640 1 -- 172.21.15.38:0/65859998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7c15dbb0 con 0x7fdc7c14d700 2023-12-22T08:41:36.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.354+0000 7fdc73fff640 1 -- 172.21.15.38:0/65859998 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74004a00 con 0x7fdc7c14d700 2023-12-22T08:41:36.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.354+0000 7fdc819c9640 1 -- 172.21.15.38:0/65859998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c15ecf0 con 0x7fdc7c14d700 2023-12-22T08:41:36.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.355+0000 7fdc819c9640 1 -- 172.21.15.38:0/65859998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7c15f4d0 con 0x7fdc7c14d700 2023-12-22T08:41:36.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.356+0000 7fdc73fff640 1 -- 172.21.15.38:0/65859998 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc74004b60 con 0x7fdc7c14d700 2023-12-22T08:41:36.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.357+0000 7fdc73fff640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc5c06a3c0 0x7fdc5c06c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.357+0000 7fdc73fff640 1 -- 172.21.15.38:0/65859998 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc74088380 con 0x7fdc7c14d700 2023-12-22T08:41:36.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.358+0000 7fdc7affd640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc5c06a3c0 0x7fdc5c06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.359+0000 7fdc7affd640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc5c06a3c0 0x7fdc5c06c880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c003be0 tx=0x7fdc6c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:36.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.362+0000 7fdc73fff640 1 -- 172.21.15.38:0/65859998 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdc74057490 con 0x7fdc7c14d700 2023-12-22T08:41:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.558+0000 7fdc819c9640 1 -- 172.21.15.38:0/65859998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc7c061910 con 0x7fdc7c14d700 2023-12-22T08:41:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.560+0000 7fdc73fff640 1 -- 172.21.15.38:0/65859998 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+15993 (secure 0 0 0) 0x7fdc74057020 con 0x7fdc7c14d700 2023-12-22T08:41:36.563 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:36.563 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":36,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:41:33.206742+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:12.357679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:13.069596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:36.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.563+0000 7fdc819c9640 1 -- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc5c06a3c0 msgr2=0x7fdc5c06c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.563+0000 7fdc819c9640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc5c06a3c0 0x7fdc5c06c880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c003be0 tx=0x7fdc6c00b040 comp rx=0 tx=0).stop 2023-12-22T08:41:36.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.563+0000 7fdc819c9640 1 -- 172.21.15.38:0/65859998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc7c14d700 msgr2=0x7fdc7c14db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.563+0000 7fdc819c9640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc7c14d700 0x7fdc7c14db80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdc74001930 tx=0x7fdc7400d9d0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.563+0000 7fdc819c9640 1 -- 172.21.15.38:0/65859998 shutdown_connections 2023-12-22T08:41:36.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.563+0000 7fdc819c9640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc5c06a3c0 0x7fdc5c06c880 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.563+0000 7fdc819c9640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc7c14d700 0x7fdc7c14db80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.563+0000 7fdc819c9640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc7c14b530 0x7fdc7c0c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.563+0000 7fdc819c9640 1 --2- 172.21.15.38:0/65859998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc680047c0 0x7fdc7c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.563+0000 7fdc819c9640 1 -- 172.21.15.38:0/65859998 >> 172.21.15.38:0/65859998 conn(0x7fdc7c06c5e0 msgr2=0x7fdc7c14ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:36.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.563+0000 7fdc819c9640 1 -- 172.21.15.38:0/65859998 shutdown_connections 2023-12-22T08:41:36.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.563+0000 7fdc819c9640 1 -- 172.21.15.38:0/65859998 wait complete. 2023-12-22T08:41:36.586 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:41:12.357679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:41:13.069596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:36.586 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:36.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.812+0000 7f8fb854e640 1 Processor -- start 2023-12-22T08:41:36.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.812+0000 7f8fb854e640 1 -- start start 2023-12-22T08:41:36.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.814+0000 7f8fb854e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb015ec50 0x7f8fb00ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.814+0000 7f8fb854e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8fb0070e80 0x7f8fb006f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.814+0000 7f8fb854e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb00ce4b0 con 0x7f8fb015e870 2023-12-22T08:41:36.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.814+0000 7f8fb854e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb015fea0 con 0x7f8fb0070e80 2023-12-22T08:41:36.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.814+0000 7f8fb854e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00cdb80 con 0x7f8fb015ec50 2023-12-22T08:41:36.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.814+0000 7f8fb62ea640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8fb015e870 0x7f8fb0070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:48434/0 (socket says 172.21.15.38:48434) 2023-12-22T08:41:36.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.814+0000 7f8fb62ea640 1 -- 172.21.15.38:0/124210592 learned_addr learned my addr 172.21.15.38:0/124210592 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:36.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.814+0000 7f8fb6aeb640 1 --2- 172.21.15.38:0/124210592 >> v2:172.21.15.89:3300/0 conn(0x7f8fb0070e80 0x7f8fb006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.814+0000 7f8fb5ae9640 1 --2- 172.21.15.38:0/124210592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb015ec50 0x7f8fb00ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.814+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224295989 0 0) 0x7f8fb00ce4b0 con 0x7f8fb015e870 2023-12-22T08:41:36.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.814+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f9c003520 con 0x7f8fb015e870 2023-12-22T08:41:36.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3730683804 0 0) 0x7f8f9c003520 con 0x7f8fb015e870 2023-12-22T08:41:36.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb015ec50 msgr2=0x7f8fb00ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:36.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 --2- 172.21.15.38:0/124210592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb015ec50 0x7f8fb00ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 >> v2:172.21.15.89:3300/0 conn(0x7f8fb0070e80 msgr2=0x7f8fb006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:36.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 --2- 172.21.15.38:0/124210592 >> v2:172.21.15.89:3300/0 conn(0x7f8fb0070e80 0x7f8fb006f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb00cde60 con 0x7f8fb015e870 2023-12-22T08:41:36.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f8fac001670 con 0x7f8fb015e870 2023-12-22T08:41:36.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 >> v1:172.21.15.38:6789/0 conn(0x7f8fb015e870 legacy=0x7f8fb0070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 --2- 172.21.15.38:0/124210592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb015ec50 0x7f8f9c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 --2- 172.21.15.38:0/124210592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f9c003ef0 0x7f8f9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 --2- 172.21.15.38:0/124210592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f9c004d00 0x7f8f9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb015fea0 con 0x7f8f9c004d00 2023-12-22T08:41:36.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00cdb80 con 0x7f8f9c003ef0 2023-12-22T08:41:36.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c00fe90 con 0x7f8fb015ec50 2023-12-22T08:41:36.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.815+0000 7f8fb6aeb640 1 --2- 172.21.15.38:0/124210592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f9c004d00 0x7f8f9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.816+0000 7f8fb6aeb640 1 -- 172.21.15.38:0/124210592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb015ec50 msgr2=0x7f8f9c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:36.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.816+0000 7f8fb6aeb640 1 --2- 172.21.15.38:0/124210592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb015ec50 0x7f8f9c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.816+0000 7f8fb6aeb640 1 -- 172.21.15.38:0/124210592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f9c003ef0 msgr2=0x7f8f9c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:36.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.816+0000 7f8fb6aeb640 1 --2- 172.21.15.38:0/124210592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f9c003ef0 0x7f8f9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.816+0000 7f8fb6aeb640 1 -- 172.21.15.38:0/124210592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c003520 con 0x7f8f9c004d00 2023-12-22T08:41:36.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.817+0000 7f8fb6aeb640 1 --2- 172.21.15.38:0/124210592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f9c004d00 0x7f8f9c005180 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009f90 tx=0x7f8f9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb525f3f4cba25 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:36.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.817+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa802cbd0 con 0x7f8f9c004d00 2023-12-22T08:41:36.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.817+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa800f040 con 0x7f8f9c004d00 2023-12-22T08:41:36.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.817+0000 7f8fb52e8640 1 -- 172.21.15.38:0/124210592 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8034440 con 0x7f8f9c004d00 2023-12-22T08:41:36.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.818+0000 7f8fb854e640 1 -- 172.21.15.38:0/124210592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f9c004d00 msgr2=0x7f8f9c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.818+0000 7f8fb854e640 1 --2- 172.21.15.38:0/124210592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f9c004d00 0x7f8f9c005180 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009f90 tx=0x7f8f9c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.818+0000 7f8fb6aeb640 1 -- 172.21.15.38:0/124210592 reap_dead start 2023-12-22T08:41:36.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.818+0000 7f8fb854e640 1 -- 172.21.15.38:0/124210592 shutdown_connections 2023-12-22T08:41:36.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.818+0000 7f8fb854e640 1 -- 172.21.15.38:0/124210592 >> 172.21.15.38:0/124210592 conn(0x7f8fb00b20c0 msgr2=0x7f8fb00b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:36.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.818+0000 7f8fb854e640 1 -- 172.21.15.38:0/124210592 shutdown_connections 2023-12-22T08:41:36.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.818+0000 7f8fb854e640 1 -- 172.21.15.38:0/124210592 wait complete. 2023-12-22T08:41:36.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.820+0000 7f8fb854e640 1 Processor -- start 2023-12-22T08:41:36.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.820+0000 7f8fb854e640 1 -- start start 2023-12-22T08:41:36.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.821+0000 7f8fb854e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f9c004d00 0x7f8fb01ee340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.821+0000 7f8fb854e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb0152210 0x7f8fb00b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.821+0000 7f8fb854e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb00b3d50 0x7f8fb0153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.821+0000 7f8fb854e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb015c700 con 0x7f8f9c004d00 2023-12-22T08:41:36.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.821+0000 7f8fb854e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00b41d0 con 0x7f8fb0152210 2023-12-22T08:41:36.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.821+0000 7f8fb854e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0154530 con 0x7f8fb00b3d50 2023-12-22T08:41:36.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.821+0000 7f8fb62ea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f9c004d00 0x7f8fb01ee340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.821+0000 7f8fb62ea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f9c004d00 0x7f8fb01ee340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43374/0 (socket says 172.21.15.38:43374) 2023-12-22T08:41:36.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.821+0000 7f8fb62ea640 1 -- 172.21.15.38:0/1214029698 learned_addr learned my addr 172.21.15.38:0/1214029698 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:36.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.822+0000 7f8fb6aeb640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb00b3d50 0x7f8fb0153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.822+0000 7f8fb5ae9640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb0152210 0x7f8fb00b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.822+0000 7f8fb62ea640 1 -- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb00b3d50 msgr2=0x7f8fb0153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.822+0000 7f8fb62ea640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb00b3d50 0x7f8fb0153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.822+0000 7f8fb62ea640 1 -- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb0152210 msgr2=0x7f8fb00b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.822+0000 7f8fb62ea640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb0152210 0x7f8fb00b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.822+0000 7f8fb62ea640 1 -- 172.21.15.38:0/1214029698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb015c080 con 0x7f8f9c004d00 2023-12-22T08:41:36.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.822+0000 7f8fb62ea640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f9c004d00 0x7f8fb01ee340 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00c840 tx=0x7f8fac00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:36.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.823+0000 7f8fa6ffd640 1 -- 172.21.15.38:0/1214029698 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0074e0 con 0x7f8f9c004d00 2023-12-22T08:41:36.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.823+0000 7f8fa6ffd640 1 -- 172.21.15.38:0/1214029698 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac007660 con 0x7f8f9c004d00 2023-12-22T08:41:36.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.823+0000 7f8fa6ffd640 1 -- 172.21.15.38:0/1214029698 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac004a20 con 0x7f8f9c004d00 2023-12-22T08:41:36.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.823+0000 7f8fb854e640 1 -- 172.21.15.38:0/1214029698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb0154250 con 0x7f8f9c004d00 2023-12-22T08:41:36.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.823+0000 7f8fb854e640 1 -- 172.21.15.38:0/1214029698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb01ee880 con 0x7f8f9c004d00 2023-12-22T08:41:36.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.824+0000 7f8fb854e640 1 -- 172.21.15.38:0/1214029698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb015bee0 con 0x7f8f9c004d00 2023-12-22T08:41:36.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.825+0000 7f8fa6ffd640 1 -- 172.21.15.38:0/1214029698 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8fac004b80 con 0x7f8f9c004d00 2023-12-22T08:41:36.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.826+0000 7f8fa6ffd640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f9406a430 0x7f8f9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.826+0000 7f8fa6ffd640 1 -- 172.21.15.38:0/1214029698 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fac087e60 con 0x7f8f9c004d00 2023-12-22T08:41:36.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.827+0000 7f8fb5ae9640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f9406a430 0x7f8f9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.828+0000 7f8fb5ae9640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f9406a430 0x7f8f9406c8f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00047b0 tx=0x7f8fa0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:36.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:36.830+0000 7f8fa6ffd640 1 -- 172.21.15.38:0/1214029698 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8fb015bee0 con 0x7f8f9c004d00 2023-12-22T08:41:37.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.025+0000 7f8fb854e640 1 -- 172.21.15.38:0/1214029698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fb015bee0 con 0x7f8f9c004d00 2023-12-22T08:41:37.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.026+0000 7f8fa6ffd640 1 -- 172.21.15.38:0/1214029698 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fb015bee0 con 0x7f8f9c004d00 2023-12-22T08:41:37.029 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:41:37.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.029+0000 7f8fb854e640 1 -- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f9406a430 msgr2=0x7f8f9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.029+0000 7f8fb854e640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f9406a430 0x7f8f9406c8f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00047b0 tx=0x7f8fa0008040 comp rx=0 tx=0).stop 2023-12-22T08:41:37.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.029+0000 7f8fb854e640 1 -- 172.21.15.38:0/1214029698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f9c004d00 msgr2=0x7f8fb01ee340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.029+0000 7f8fb854e640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f9c004d00 0x7f8fb01ee340 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00c840 tx=0x7f8fac00cd00 comp rx=0 tx=0).stop 2023-12-22T08:41:37.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.029+0000 7f8fb854e640 1 -- 172.21.15.38:0/1214029698 shutdown_connections 2023-12-22T08:41:37.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.029+0000 7f8fb854e640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb00b3d50 0x7f8fb0153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.029+0000 7f8fb854e640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb0152210 0x7f8fb00b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.029+0000 7f8fb854e640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f9406a430 0x7f8f9406c8f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.029+0000 7f8fb854e640 1 --2- 172.21.15.38:0/1214029698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f9c004d00 0x7f8fb01ee340 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.029+0000 7f8fb854e640 1 -- 172.21.15.38:0/1214029698 >> 172.21.15.38:0/1214029698 conn(0x7f8fb00b20c0 msgr2=0x7f8fb0155c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:37.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.029+0000 7f8fb854e640 1 -- 172.21.15.38:0/1214029698 shutdown_connections 2023-12-22T08:41:37.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.029+0000 7f8fb854e640 1 -- 172.21.15.38:0/1214029698 wait complete. 2023-12-22T08:41:37.052 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:41:37.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.277+0000 7ff20b59e640 1 Processor -- start 2023-12-22T08:41:37.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.277+0000 7ff20b59e640 1 -- start start 2023-12-22T08:41:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.279+0000 7ff20b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff20c15b0e0 0x7ff20c15b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.279+0000 7ff20b59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff20c09c980 0x7ff20c15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.279+0000 7ff20b59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c15edf0 con 0x7ff20c071460 2023-12-22T08:41:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.279+0000 7ff20b59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff20c15bd90 con 0x7ff20c09c980 2023-12-22T08:41:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.279+0000 7ff20b59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c15c070 con 0x7ff20c15b0e0 2023-12-22T08:41:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.280+0000 7ff201d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff20c09c980 0x7ff20c15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.280+0000 7ff20a59c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff20c15b0e0 0x7ff20c15b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.280+0000 7ff201d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff20c09c980 0x7ff20c15c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:46418/0 (socket says 172.21.15.38:46418) 2023-12-22T08:41:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.280+0000 7ff201d9b640 1 -- 172.21.15.38:0/3759477906 learned_addr learned my addr 172.21.15.38:0/3759477906 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.281+0000 7ff201d9b640 1 -- 172.21.15.38:0/3759477906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff20c15b0e0 msgr2=0x7ff20c15b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.281+0000 7ff201d9b640 1 --2- 172.21.15.38:0/3759477906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff20c15b0e0 0x7ff20c15b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.281+0000 7ff201d9b640 1 -- 172.21.15.38:0/3759477906 >> v1:172.21.15.89:6789/0 conn(0x7ff20c071460 legacy=0x7ff20c15f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.281+0000 7ff201d9b640 1 -- 172.21.15.38:0/3759477906 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c15c350 con 0x7ff20c09c980 2023-12-22T08:41:37.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.282+0000 7ff201d9b640 1 --2- 172.21.15.38:0/3759477906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff20c09c980 0x7ff20c15c9c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4009870 tx=0x7ff1f402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54b8acfe7de99a91 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.282+0000 7ff209d9b640 1 -- 172.21.15.38:0/3759477906 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f40317c0 con 0x7ff20c09c980 2023-12-22T08:41:37.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.283+0000 7ff209d9b640 1 -- 172.21.15.38:0/3759477906 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f4031920 con 0x7ff20c09c980 2023-12-22T08:41:37.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.283+0000 7ff209d9b640 1 -- 172.21.15.38:0/3759477906 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4031cb0 con 0x7ff20c09c980 2023-12-22T08:41:37.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.283+0000 7ff20b59e640 1 -- 172.21.15.38:0/3759477906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff20c09c980 msgr2=0x7ff20c15c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.283+0000 7ff20b59e640 1 --2- 172.21.15.38:0/3759477906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff20c09c980 0x7ff20c15c9c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4009870 tx=0x7ff1f402b860 comp rx=0 tx=0).stop 2023-12-22T08:41:37.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.283+0000 7ff20b59e640 1 -- 172.21.15.38:0/3759477906 shutdown_connections 2023-12-22T08:41:37.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.283+0000 7ff20b59e640 1 --2- 172.21.15.38:0/3759477906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff20c09c980 0x7ff20c15c9c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.283+0000 7ff20b59e640 1 --2- 172.21.15.38:0/3759477906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff20c15b0e0 0x7ff20c15b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.283+0000 7ff20b59e640 1 -- 172.21.15.38:0/3759477906 >> 172.21.15.38:0/3759477906 conn(0x7ff20c0cf000 msgr2=0x7ff20c0cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:37.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.284+0000 7ff20b59e640 1 -- 172.21.15.38:0/3759477906 shutdown_connections 2023-12-22T08:41:37.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.284+0000 7ff20b59e640 1 -- 172.21.15.38:0/3759477906 wait complete. 2023-12-22T08:41:37.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.285+0000 7ff20b59e640 1 Processor -- start 2023-12-22T08:41:37.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.285+0000 7ff20b59e640 1 -- start start 2023-12-22T08:41:37.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.286+0000 7ff20b59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff20c071460 0x7ff20c0a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.286+0000 7ff20b59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff20c09c980 0x7ff20c09a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.286+0000 7ff20b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff20c15b0e0 0x7ff20c09ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.286+0000 7ff20b59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0a41d0 con 0x7ff20c071460 2023-12-22T08:41:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.286+0000 7ff20b59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c15b790 con 0x7ff20c09c980 2023-12-22T08:41:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.286+0000 7ff20b59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c14ba10 con 0x7ff20c15b0e0 2023-12-22T08:41:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.287+0000 7ff20a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff20c071460 0x7ff20c0a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.287+0000 7ff20a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff20c071460 0x7ff20c0a3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43378/0 (socket says 172.21.15.38:43378) 2023-12-22T08:41:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.287+0000 7ff20a59c640 1 -- 172.21.15.38:0/2392638256 learned_addr learned my addr 172.21.15.38:0/2392638256 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.287+0000 7ff201d9b640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff20c09c980 0x7ff20c09a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.287+0000 7ff20ad9d640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff20c15b0e0 0x7ff20c09ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.287+0000 7ff20a59c640 1 -- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff20c15b0e0 msgr2=0x7ff20c09ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.287+0000 7ff20a59c640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff20c15b0e0 0x7ff20c09ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.287+0000 7ff20a59c640 1 -- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff20c09c980 msgr2=0x7ff20c09a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.287+0000 7ff20a59c640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff20c09c980 0x7ff20c09a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.287+0000 7ff20a59c640 1 -- 172.21.15.38:0/2392638256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f40094d0 con 0x7ff20c071460 2023-12-22T08:41:37.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.287+0000 7ff20ad9d640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff20c15b0e0 0x7ff20c09ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:37.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.288+0000 7ff20a59c640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff20c071460 0x7ff20c0a3c90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00e870 tx=0x7ff1fc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.288+0000 7ff2037fe640 1 -- 172.21.15.38:0/2392638256 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc0094f0 con 0x7ff20c071460 2023-12-22T08:41:37.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.288+0000 7ff2037fe640 1 -- 172.21.15.38:0/2392638256 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc00c940 con 0x7ff20c071460 2023-12-22T08:41:37.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.288+0000 7ff20b59e640 1 -- 172.21.15.38:0/2392638256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20c0cf480 con 0x7ff20c071460 2023-12-22T08:41:37.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.288+0000 7ff2037fe640 1 -- 172.21.15.38:0/2392638256 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00ccf0 con 0x7ff20c071460 2023-12-22T08:41:37.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.288+0000 7ff20b59e640 1 -- 172.21.15.38:0/2392638256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c14bcf0 con 0x7ff20c071460 2023-12-22T08:41:37.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.289+0000 7ff20b59e640 1 -- 172.21.15.38:0/2392638256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20c061910 con 0x7ff20c071460 2023-12-22T08:41:37.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.290+0000 7ff2037fe640 1 -- 172.21.15.38:0/2392638256 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff1fc013470 con 0x7ff20c071460 2023-12-22T08:41:37.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.291+0000 7ff2037fe640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff1ec06a430 0x7ff1ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.291+0000 7ff2037fe640 1 -- 172.21.15.38:0/2392638256 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1fc088a50 con 0x7ff20c071460 2023-12-22T08:41:37.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.292+0000 7ff201d9b640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff1ec06a430 0x7ff1ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.293+0000 7ff201d9b640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff1ec06a430 0x7ff1ec06c8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4036000 tx=0x7ff1f403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.295+0000 7ff2037fe640 1 -- 172.21.15.38:0/2392638256 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff1fc054030 con 0x7ff20c071460 2023-12-22T08:41:37.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.491+0000 7ff20b59e640 1 -- 172.21.15.38:0/2392638256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff20c06d7d0 con 0x7ff20c071460 2023-12-22T08:41:37.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.492+0000 7ff2037fe640 1 -- 172.21.15.38:0/2392638256 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1fc021020 con 0x7ff20c071460 2023-12-22T08:41:37.494 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:41:37.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.494+0000 7ff20b59e640 1 -- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff1ec06a430 msgr2=0x7ff1ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.494+0000 7ff20b59e640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff1ec06a430 0x7ff1ec06c8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4036000 tx=0x7ff1f403d040 comp rx=0 tx=0).stop 2023-12-22T08:41:37.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.494+0000 7ff20b59e640 1 -- 172.21.15.38:0/2392638256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff20c071460 msgr2=0x7ff20c0a3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.494+0000 7ff20b59e640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff20c071460 0x7ff20c0a3c90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00e870 tx=0x7ff1fc00ed30 comp rx=0 tx=0).stop 2023-12-22T08:41:37.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.495+0000 7ff20b59e640 1 -- 172.21.15.38:0/2392638256 shutdown_connections 2023-12-22T08:41:37.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.495+0000 7ff20b59e640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff20c15b0e0 0x7ff20c09ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.495+0000 7ff20b59e640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff20c09c980 0x7ff20c09a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.495+0000 7ff20b59e640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff1ec06a430 0x7ff1ec06c8f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.495+0000 7ff20b59e640 1 --2- 172.21.15.38:0/2392638256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff20c071460 0x7ff20c0a3c90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.495+0000 7ff20b59e640 1 -- 172.21.15.38:0/2392638256 >> 172.21.15.38:0/2392638256 conn(0x7ff20c0cf000 msgr2=0x7ff20c0b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:37.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.495+0000 7ff20b59e640 1 -- 172.21.15.38:0/2392638256 shutdown_connections 2023-12-22T08:41:37.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.495+0000 7ff20b59e640 1 -- 172.21.15.38:0/2392638256 wait complete. 2023-12-22T08:41:37.516 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:41:37.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.738+0000 7fcd27450640 1 Processor -- start 2023-12-22T08:41:37.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.738+0000 7fcd27450640 1 -- start start 2023-12-22T08:41:37.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.740+0000 7fcd27450640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd20146c00 0x7fcd2006f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.740+0000 7fcd27450640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcd20160f60 0x7fcd201613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.740+0000 7fcd27450640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd200abda0 con 0x7fcd2015d920 2023-12-22T08:41:37.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.740+0000 7fcd27450640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd201618e0 con 0x7fcd20160f60 2023-12-22T08:41:37.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.740+0000 7fcd27450640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20161db0 con 0x7fcd20146c00 2023-12-22T08:41:37.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.741+0000 7fcd26c4f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcd2015d920 0x7fcd2015ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:48448/0 (socket says 172.21.15.38:48448) 2023-12-22T08:41:37.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.741+0000 7fcd26c4f640 1 -- 172.21.15.38:0/3053749249 learned_addr learned my addr 172.21.15.38:0/3053749249 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:37.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.741+0000 7fcd25c4d640 1 --2- 172.21.15.38:0/3053749249 >> v2:172.21.15.89:3300/0 conn(0x7fcd20160f60 0x7fcd201613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.741+0000 7fcd2644e640 1 --2- 172.21.15.38:0/3053749249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd20146c00 0x7fcd2006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.741+0000 7fcd2544c640 1 -- 172.21.15.38:0/3053749249 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020979987 0 0) 0x7fcd200abda0 con 0x7fcd2015d920 2023-12-22T08:41:37.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.741+0000 7fcd2544c640 1 -- 172.21.15.38:0/3053749249 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd0c003520 con 0x7fcd2015d920 2023-12-22T08:41:37.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.742+0000 7fcd25c4d640 1 -- 172.21.15.38:0/3053749249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd20146c00 msgr2=0x7fcd2006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:37.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.742+0000 7fcd25c4d640 1 --2- 172.21.15.38:0/3053749249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd20146c00 0x7fcd2006f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.742+0000 7fcd25c4d640 1 -- 172.21.15.38:0/3053749249 >> v1:172.21.15.38:6789/0 conn(0x7fcd2015d920 legacy=0x7fcd2015ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.742+0000 7fcd25c4d640 1 -- 172.21.15.38:0/3053749249 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20146fe0 con 0x7fcd20160f60 2023-12-22T08:41:37.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.743+0000 7fcd25c4d640 1 --2- 172.21.15.38:0/3053749249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd20160f60 0x7fcd201613a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcd100097a0 tx=0x7fcd1002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a0516519fe4c60c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.743+0000 7fcd2544c640 1 -- 172.21.15.38:0/3053749249 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1002d040 con 0x7fcd20160f60 2023-12-22T08:41:37.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.743+0000 7fcd2544c640 1 -- 172.21.15.38:0/3053749249 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd10031810 con 0x7fcd20160f60 2023-12-22T08:41:37.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.743+0000 7fcd2544c640 1 -- 172.21.15.38:0/3053749249 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10031b80 con 0x7fcd20160f60 2023-12-22T08:41:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.744+0000 7fcd27450640 1 -- 172.21.15.38:0/3053749249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd20160f60 msgr2=0x7fcd201613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.744+0000 7fcd27450640 1 --2- 172.21.15.38:0/3053749249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd20160f60 0x7fcd201613a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcd100097a0 tx=0x7fcd1002b8b0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.744+0000 7fcd27450640 1 -- 172.21.15.38:0/3053749249 shutdown_connections 2023-12-22T08:41:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.744+0000 7fcd27450640 1 --2- 172.21.15.38:0/3053749249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd20160f60 0x7fcd201613a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.744+0000 7fcd27450640 1 --2- 172.21.15.38:0/3053749249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd20146c00 0x7fcd2006f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.744+0000 7fcd27450640 1 -- 172.21.15.38:0/3053749249 >> 172.21.15.38:0/3053749249 conn(0x7fcd200b0b60 msgr2=0x7fcd200b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.744+0000 7fcd27450640 1 -- 172.21.15.38:0/3053749249 shutdown_connections 2023-12-22T08:41:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.744+0000 7fcd27450640 1 -- 172.21.15.38:0/3053749249 wait complete. 2023-12-22T08:41:37.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.746+0000 7fcd27450640 1 Processor -- start 2023-12-22T08:41:37.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.746+0000 7fcd27450640 1 -- start start 2023-12-22T08:41:37.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.747+0000 7fcd27450640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd20146c00 0x7fcd20143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.747+0000 7fcd27450640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd2015d920 0x7fcd200cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd27450640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd20160f60 0x7fcd2006c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd27450640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20143310 con 0x7fcd20160f60 2023-12-22T08:41:37.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd27450640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20143c70 con 0x7fcd2015d920 2023-12-22T08:41:37.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd27450640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2009b7a0 con 0x7fcd20146c00 2023-12-22T08:41:37.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd26c4f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd20160f60 0x7fcd2006c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd26c4f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd20160f60 0x7fcd2006c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43392/0 (socket says 172.21.15.38:43392) 2023-12-22T08:41:37.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd26c4f640 1 -- 172.21.15.38:0/1845560157 learned_addr learned my addr 172.21.15.38:0/1845560157 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:37.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd2644e640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd20146c00 0x7fcd20143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd26c4f640 1 -- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd20146c00 msgr2=0x7fcd20143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd26c4f640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd20146c00 0x7fcd20143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd26c4f640 1 -- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd2015d920 msgr2=0x7fcd200cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd26c4f640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd2015d920 0x7fcd200cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd26c4f640 1 -- 172.21.15.38:0/1845560157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd10009400 con 0x7fcd20160f60 2023-12-22T08:41:37.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.748+0000 7fcd2644e640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd20146c00 0x7fcd20143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:37.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.749+0000 7fcd26c4f640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd20160f60 0x7fcd2006c790 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800caa0 tx=0x7fcd1800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.749+0000 7fcd16ffd640 1 -- 172.21.15.38:0/1845560157 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1800aba0 con 0x7fcd20160f60 2023-12-22T08:41:37.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.749+0000 7fcd16ffd640 1 -- 172.21.15.38:0/1845560157 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1800ad00 con 0x7fcd20160f60 2023-12-22T08:41:37.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.749+0000 7fcd16ffd640 1 -- 172.21.15.38:0/1845560157 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18012620 con 0x7fcd20160f60 2023-12-22T08:41:37.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.749+0000 7fcd27450640 1 -- 172.21.15.38:0/1845560157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2006d460 con 0x7fcd20160f60 2023-12-22T08:41:37.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.749+0000 7fcd27450640 1 -- 172.21.15.38:0/1845560157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2009bfb0 con 0x7fcd20160f60 2023-12-22T08:41:37.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.750+0000 7fcd27450640 1 -- 172.21.15.38:0/1845560157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd20143450 con 0x7fcd20160f60 2023-12-22T08:41:37.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.751+0000 7fcd16ffd640 1 -- 172.21.15.38:0/1845560157 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcd18007070 con 0x7fcd20160f60 2023-12-22T08:41:37.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.752+0000 7fcd16ffd640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcd0406a430 0x7fcd0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.752+0000 7fcd16ffd640 1 -- 172.21.15.38:0/1845560157 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd18088880 con 0x7fcd20160f60 2023-12-22T08:41:37.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.753+0000 7fcd2644e640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcd0406a430 0x7fcd0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.754+0000 7fcd2644e640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcd0406a430 0x7fcd0406c8f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009a20 tx=0x7fcd1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.757+0000 7fcd16ffd640 1 -- 172.21.15.38:0/1845560157 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcd20143450 con 0x7fcd20160f60 2023-12-22T08:41:37.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.952+0000 7fcd27450640 1 -- 172.21.15.38:0/1845560157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd20143450 con 0x7fcd20160f60 2023-12-22T08:41:37.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.953+0000 7fcd16ffd640 1 -- 172.21.15.38:0/1845560157 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd20143450 con 0x7fcd20160f60 2023-12-22T08:41:37.956 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:41:37.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.956+0000 7fcd27450640 1 -- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcd0406a430 msgr2=0x7fcd0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.956+0000 7fcd27450640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcd0406a430 0x7fcd0406c8f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009a20 tx=0x7fcd1c008040 comp rx=0 tx=0).stop 2023-12-22T08:41:37.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.956+0000 7fcd27450640 1 -- 172.21.15.38:0/1845560157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd20160f60 msgr2=0x7fcd2006c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.956+0000 7fcd27450640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd20160f60 0x7fcd2006c790 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800caa0 tx=0x7fcd1800cf60 comp rx=0 tx=0).stop 2023-12-22T08:41:37.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.956+0000 7fcd27450640 1 -- 172.21.15.38:0/1845560157 shutdown_connections 2023-12-22T08:41:37.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.956+0000 7fcd27450640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcd0406a430 0x7fcd0406c8f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.956+0000 7fcd27450640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd20160f60 0x7fcd2006c790 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.956+0000 7fcd27450640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd2015d920 0x7fcd200cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.956+0000 7fcd27450640 1 --2- 172.21.15.38:0/1845560157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd20146c00 0x7fcd20143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.956+0000 7fcd27450640 1 -- 172.21.15.38:0/1845560157 >> 172.21.15.38:0/1845560157 conn(0x7fcd200b0b60 msgr2=0x7fcd200712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:37.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.956+0000 7fcd27450640 1 -- 172.21.15.38:0/1845560157 shutdown_connections 2023-12-22T08:41:37.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:37.956+0000 7fcd27450640 1 -- 172.21.15.38:0/1845560157 wait complete. 2023-12-22T08:41:37.979 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:41:38.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.207+0000 7f676ffff640 1 Processor -- start 2023-12-22T08:41:38.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.207+0000 7f676ffff640 1 -- start start 2023-12-22T08:41:38.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.208+0000 7f676ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f677015ad90 0x7f67700caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:38.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.208+0000 7f676ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6770161bb0 0x7f67700cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.208+0000 7f676ffff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677015e630 con 0x7f677015d940 2023-12-22T08:41:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.208+0000 7f676ffff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67700ce2c0 con 0x7f677015ad90 2023-12-22T08:41:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.208+0000 7f676ffff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677015e910 con 0x7f6770161bb0 2023-12-22T08:41:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.208+0000 7f676effd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f677015ad90 0x7f67700caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.209+0000 7f676effd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f677015ad90 0x7f67700caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43408/0 (socket says 172.21.15.38:43408) 2023-12-22T08:41:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.209+0000 7f676effd640 1 -- 172.21.15.38:0/1740936032 learned_addr learned my addr 172.21.15.38:0/1740936032 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.209+0000 7f676e7fc640 1 --2- 172.21.15.38:0/1740936032 >> v2:172.21.15.89:3300/0 conn(0x7f6770161bb0 0x7f67700cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.209+0000 7f676effd640 1 -- 172.21.15.38:0/1740936032 >> v2:172.21.15.89:3300/0 conn(0x7f6770161bb0 msgr2=0x7f67700cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.209+0000 7f676effd640 1 --2- 172.21.15.38:0/1740936032 >> v2:172.21.15.89:3300/0 conn(0x7f6770161bb0 0x7f67700cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.209+0000 7f676effd640 1 -- 172.21.15.38:0/1740936032 >> v1:172.21.15.89:6789/0 conn(0x7f677015d940 legacy=0x7f677015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:38.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.209+0000 7f676effd640 1 -- 172.21.15.38:0/1740936032 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67701610d0 con 0x7f677015ad90 2023-12-22T08:41:38.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.210+0000 7f676effd640 1 --2- 172.21.15.38:0/1740936032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f677015ad90 0x7f67700caed0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f67700d0d40 tx=0x7f676002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19226d4f61e3a2ea server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:38.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.211+0000 7f676dffb640 1 -- 172.21.15.38:0/1740936032 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760031870 con 0x7f677015ad90 2023-12-22T08:41:38.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.211+0000 7f676dffb640 1 -- 172.21.15.38:0/1740936032 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67600319d0 con 0x7f677015ad90 2023-12-22T08:41:38.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.211+0000 7f676dffb640 1 -- 172.21.15.38:0/1740936032 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760031d60 con 0x7f677015ad90 2023-12-22T08:41:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.211+0000 7f676ffff640 1 -- 172.21.15.38:0/1740936032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f677015ad90 msgr2=0x7f67700caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.211+0000 7f676ffff640 1 --2- 172.21.15.38:0/1740936032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f677015ad90 0x7f67700caed0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f67700d0d40 tx=0x7f676002b910 comp rx=0 tx=0).stop 2023-12-22T08:41:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.211+0000 7f676ffff640 1 -- 172.21.15.38:0/1740936032 shutdown_connections 2023-12-22T08:41:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.211+0000 7f676ffff640 1 --2- 172.21.15.38:0/1740936032 >> v2:172.21.15.89:3300/0 conn(0x7f6770161bb0 0x7f67700cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.211+0000 7f676ffff640 1 --2- 172.21.15.38:0/1740936032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f677015ad90 0x7f67700caed0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.211+0000 7f676ffff640 1 -- 172.21.15.38:0/1740936032 >> 172.21.15.38:0/1740936032 conn(0x7f67700d31c0 msgr2=0x7f67700d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.211+0000 7f676ffff640 1 -- 172.21.15.38:0/1740936032 shutdown_connections 2023-12-22T08:41:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.212+0000 7f676ffff640 1 -- 172.21.15.38:0/1740936032 wait complete. 2023-12-22T08:41:38.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.213+0000 7f676ffff640 1 Processor -- start 2023-12-22T08:41:38.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.213+0000 7f676ffff640 1 -- start start 2023-12-22T08:41:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.214+0000 7f676ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f677015ad90 0x7f67700c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.214+0000 7f676ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f677015d940 0x7f677014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.214+0000 7f676ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6770161bb0 0x7f677015faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.214+0000 7f676ffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67700c9890 con 0x7f677015ad90 2023-12-22T08:41:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.214+0000 7f676ffff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677014e990 con 0x7f6770161bb0 2023-12-22T08:41:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.214+0000 7f676ffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67700c7140 con 0x7f677015d940 2023-12-22T08:41:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.215+0000 7f676effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f677015ad90 0x7f67700c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.215+0000 7f676effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f677015ad90 0x7f67700c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43414/0 (socket says 172.21.15.38:43414) 2023-12-22T08:41:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.215+0000 7f676effd640 1 -- 172.21.15.38:0/3869396524 learned_addr learned my addr 172.21.15.38:0/3869396524 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.215+0000 7f676e7fc640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f677015d940 0x7f677014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.215+0000 7f676f7fe640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6770161bb0 0x7f677015faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.215+0000 7f676effd640 1 -- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f677015d940 msgr2=0x7f677014e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.215+0000 7f676effd640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f677015d940 0x7f677014e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.215+0000 7f676effd640 1 -- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6770161bb0 msgr2=0x7f677015faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.215+0000 7f676effd640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6770161bb0 0x7f677015faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.215+0000 7f676effd640 1 -- 172.21.15.38:0/3869396524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67600094d0 con 0x7f677015ad90 2023-12-22T08:41:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.215+0000 7f676f7fe640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6770161bb0 0x7f677015faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.216+0000 7f676effd640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f677015ad90 0x7f67700c9350 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f67600097f0 tx=0x7f67600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:38.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.216+0000 7f6767fff640 1 -- 172.21.15.38:0/3869396524 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676003ac60 con 0x7f677015ad90 2023-12-22T08:41:38.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.216+0000 7f6767fff640 1 -- 172.21.15.38:0/3869396524 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676003adc0 con 0x7f677015ad90 2023-12-22T08:41:38.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.216+0000 7f6767fff640 1 -- 172.21.15.38:0/3869396524 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760044610 con 0x7f677015ad90 2023-12-22T08:41:38.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.216+0000 7f676ffff640 1 -- 172.21.15.38:0/3869396524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67700c7420 con 0x7f677015ad90 2023-12-22T08:41:38.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.216+0000 7f676ffff640 1 -- 172.21.15.38:0/3869396524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67700c79e0 con 0x7f677015ad90 2023-12-22T08:41:38.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.217+0000 7f676ffff640 1 -- 172.21.15.38:0/3869396524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6770061910 con 0x7f677015ad90 2023-12-22T08:41:38.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.218+0000 7f6767fff640 1 -- 172.21.15.38:0/3869396524 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f676004d450 con 0x7f677015ad90 2023-12-22T08:41:38.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.219+0000 7f6767fff640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f675006a430 0x7f675006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:38.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.219+0000 7f6767fff640 1 -- 172.21.15.38:0/3869396524 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f676002d040 con 0x7f677015ad90 2023-12-22T08:41:38.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.220+0000 7f676e7fc640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f675006a430 0x7f675006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:38.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.221+0000 7f676e7fc640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f675006a430 0x7f675006c8f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f67701587e0 tx=0x7f6758003990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:38.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.224+0000 7f6767fff640 1 -- 172.21.15.38:0/3869396524 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f67600765a0 con 0x7f677015ad90 2023-12-22T08:41:38.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.424+0000 7f676ffff640 1 -- 172.21.15.38:0/3869396524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f677015b820 con 0x7f677015ad90 2023-12-22T08:41:38.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.425+0000 7f6767fff640 1 -- 172.21.15.38:0/3869396524 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6760035020 con 0x7f677015ad90 2023-12-22T08:41:38.427 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:41:38.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.427+0000 7f676ffff640 1 -- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f675006a430 msgr2=0x7f675006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:38.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.427+0000 7f676ffff640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f675006a430 0x7f675006c8f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f67701587e0 tx=0x7f6758003990 comp rx=0 tx=0).stop 2023-12-22T08:41:38.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.427+0000 7f676ffff640 1 -- 172.21.15.38:0/3869396524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f677015ad90 msgr2=0x7f67700c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:38.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.427+0000 7f676ffff640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f677015ad90 0x7f67700c9350 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f67600097f0 tx=0x7f67600046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.427+0000 7f676ffff640 1 -- 172.21.15.38:0/3869396524 shutdown_connections 2023-12-22T08:41:38.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.427+0000 7f676ffff640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6770161bb0 0x7f677015faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.427+0000 7f676ffff640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f677015d940 0x7f677014e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.427+0000 7f676ffff640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f675006a430 0x7f675006c8f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.427+0000 7f676ffff640 1 --2- 172.21.15.38:0/3869396524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f677015ad90 0x7f67700c9350 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.427+0000 7f676ffff640 1 -- 172.21.15.38:0/3869396524 >> 172.21.15.38:0/3869396524 conn(0x7f67700d31c0 msgr2=0x7f67700cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:38.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.427+0000 7f676ffff640 1 -- 172.21.15.38:0/3869396524 shutdown_connections 2023-12-22T08:41:38.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:38.427+0000 7f676ffff640 1 -- 172.21.15.38:0/3869396524 wait complete. 2023-12-22T08:41:38.447 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T08:41:38.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:38.447 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-22T08:41:38.572 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:41:38.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:38.572 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T08:41:38.627 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:41:38.627 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:38.673 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:41:38.673 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:38.768 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:39.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.002+0000 7f9b06d22640 1 Processor -- start 2023-12-22T08:41:39.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.002+0000 7f9b06d22640 1 -- start start 2023-12-22T08:41:39.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.004+0000 7f9b06d22640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b22c0 0x7f9b000b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.004+0000 7f9b06d22640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b000b26a0 0x7f9b0006ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.004+0000 7f9b06d22640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b000b4510 con 0x7f9b0006cf50 2023-12-22T08:41:39.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.004+0000 7f9b06d22640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0006c610 con 0x7f9b000b26a0 2023-12-22T08:41:39.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.004+0000 7f9b06d22640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000b3f50 con 0x7f9b000b22c0 2023-12-22T08:41:39.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.005+0000 7f9b04abe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b22c0 0x7f9b000b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.005+0000 7f9b052bf640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9b0006cf50 0x7f9b000cb830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:58540/0 (socket says 172.21.15.38:58540) 2023-12-22T08:41:39.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.005+0000 7f9b052bf640 1 -- 172.21.15.38:0/1205657670 learned_addr learned my addr 172.21.15.38:0/1205657670 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:39.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.005+0000 7f9afffff640 1 --2- 172.21.15.38:0/1205657670 >> v2:172.21.15.89:3300/0 conn(0x7f9b000b26a0 0x7f9b0006ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.006+0000 7f9b04abe640 1 -- 172.21.15.38:0/1205657670 >> v2:172.21.15.89:3300/0 conn(0x7f9b000b26a0 msgr2=0x7f9b0006ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:39.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.006+0000 7f9b04abe640 1 --2- 172.21.15.38:0/1205657670 >> v2:172.21.15.89:3300/0 conn(0x7f9b000b26a0 0x7f9b0006ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.006+0000 7f9b04abe640 1 -- 172.21.15.38:0/1205657670 >> v1:172.21.15.89:6789/0 conn(0x7f9b0006cf50 legacy=0x7f9b000cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.006+0000 7f9b04abe640 1 -- 172.21.15.38:0/1205657670 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b000b4230 con 0x7f9b000b22c0 2023-12-22T08:41:39.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.007+0000 7f9b04abe640 1 --2- 172.21.15.38:0/1205657670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b22c0 0x7f9b000b3600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9af40097a0 tx=0x7f9af402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23630d886a8f28e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.008+0000 7f9aff7fe640 1 -- 172.21.15.38:0/1205657670 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4031780 con 0x7f9b000b22c0 2023-12-22T08:41:39.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.008+0000 7f9aff7fe640 1 -- 172.21.15.38:0/1205657670 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af40318e0 con 0x7f9b000b22c0 2023-12-22T08:41:39.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.008+0000 7f9aff7fe640 1 -- 172.21.15.38:0/1205657670 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4031c70 con 0x7f9b000b22c0 2023-12-22T08:41:39.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.008+0000 7f9b06d22640 1 -- 172.21.15.38:0/1205657670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b22c0 msgr2=0x7f9b000b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.008+0000 7f9b06d22640 1 --2- 172.21.15.38:0/1205657670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b22c0 0x7f9b000b3600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9af40097a0 tx=0x7f9af402b820 comp rx=0 tx=0).stop 2023-12-22T08:41:39.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.009+0000 7f9b06d22640 1 -- 172.21.15.38:0/1205657670 shutdown_connections 2023-12-22T08:41:39.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.009+0000 7f9b06d22640 1 --2- 172.21.15.38:0/1205657670 >> v2:172.21.15.89:3300/0 conn(0x7f9b000b26a0 0x7f9b0006ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.009+0000 7f9b06d22640 1 --2- 172.21.15.38:0/1205657670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b22c0 0x7f9b000b3600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.009+0000 7f9b06d22640 1 -- 172.21.15.38:0/1205657670 >> 172.21.15.38:0/1205657670 conn(0x7f9b000cf070 msgr2=0x7f9b000cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:39.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.009+0000 7f9b06d22640 1 -- 172.21.15.38:0/1205657670 shutdown_connections 2023-12-22T08:41:39.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.009+0000 7f9b06d22640 1 -- 172.21.15.38:0/1205657670 wait complete. 2023-12-22T08:41:39.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.010+0000 7f9b06d22640 1 Processor -- start 2023-12-22T08:41:39.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.011+0000 7f9b06d22640 1 -- start start 2023-12-22T08:41:39.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.011+0000 7f9b06d22640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b0006cf50 0x7f9b001f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.011+0000 7f9b06d22640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b22c0 0x7f9b00151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b06d22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b000b26a0 0x7f9b001f9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b06d22640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b00151de0 con 0x7f9b0006cf50 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b06d22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b001520c0 con 0x7f9b000b26a0 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b06d22640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b001523a0 con 0x7f9b000b22c0 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b04abe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b0006cf50 0x7f9b001f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b04abe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b0006cf50 0x7f9b001f6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43430/0 (socket says 172.21.15.38:43430) 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b04abe640 1 -- 172.21.15.38:0/2622180259 learned_addr learned my addr 172.21.15.38:0/2622180259 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9afffff640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b22c0 0x7f9b00151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b052bf640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b000b26a0 0x7f9b001f9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b04abe640 1 -- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b22c0 msgr2=0x7f9b00151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b04abe640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b22c0 0x7f9b00151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b04abe640 1 -- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b000b26a0 msgr2=0x7f9b001f9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b04abe640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b000b26a0 0x7f9b001f9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b04abe640 1 -- 172.21.15.38:0/2622180259 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4009400 con 0x7f9b0006cf50 2023-12-22T08:41:39.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9afffff640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b22c0 0x7f9b00151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:39.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.012+0000 7f9b052bf640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b000b26a0 0x7f9b001f9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:39.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.013+0000 7f9b04abe640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b0006cf50 0x7f9b001f6f80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9af4034040 tx=0x7f9af40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.013+0000 7f9afd7fa640 1 -- 172.21.15.38:0/2622180259 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4032820 con 0x7f9b0006cf50 2023-12-22T08:41:39.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.013+0000 7f9afd7fa640 1 -- 172.21.15.38:0/2622180259 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af40329a0 con 0x7f9b0006cf50 2023-12-22T08:41:39.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.013+0000 7f9afd7fa640 1 -- 172.21.15.38:0/2622180259 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4032d50 con 0x7f9b0006cf50 2023-12-22T08:41:39.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.013+0000 7f9b06d22640 1 -- 172.21.15.38:0/2622180259 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b00152680 con 0x7f9b0006cf50 2023-12-22T08:41:39.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.013+0000 7f9b06d22640 1 -- 172.21.15.38:0/2622180259 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b001fa200 con 0x7f9b0006cf50 2023-12-22T08:41:39.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.015+0000 7f9b06d22640 1 -- 172.21.15.38:0/2622180259 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b00061910 con 0x7f9b0006cf50 2023-12-22T08:41:39.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.015+0000 7f9afd7fa640 1 -- 172.21.15.38:0/2622180259 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9af404e440 con 0x7f9b0006cf50 2023-12-22T08:41:39.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.016+0000 7f9afd7fa640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9ae406a430 0x7f9ae406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.017+0000 7f9afd7fa640 1 -- 172.21.15.38:0/2622180259 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9af40aaa30 con 0x7f9b0006cf50 2023-12-22T08:41:39.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.017+0000 7f9afffff640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9ae406a430 0x7f9ae406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.018+0000 7f9afffff640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9ae406a430 0x7f9ae406c8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9b00153fa0 tx=0x7f9aec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.020+0000 7f9afd7fa640 1 -- 172.21.15.38:0/2622180259 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9af40760c0 con 0x7f9b0006cf50 2023-12-22T08:41:39.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.217+0000 7f9b06d22640 1 -- 172.21.15.38:0/2622180259 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b0006c930 con 0x7f9b0006cf50 2023-12-22T08:41:39.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.220+0000 7f9afd7fa640 1 -- 172.21.15.38:0/2622180259 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f9af40796e0 con 0x7f9b0006cf50 2023-12-22T08:41:39.222 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:39.223 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":36,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:41:33.206742+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:12.357679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:13.069596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:39.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.223+0000 7f9b06d22640 1 -- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9ae406a430 msgr2=0x7f9ae406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.223+0000 7f9b06d22640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9ae406a430 0x7f9ae406c8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9b00153fa0 tx=0x7f9aec008040 comp rx=0 tx=0).stop 2023-12-22T08:41:39.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.223+0000 7f9b06d22640 1 -- 172.21.15.38:0/2622180259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b0006cf50 msgr2=0x7f9b001f6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.223+0000 7f9b06d22640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b0006cf50 0x7f9b001f6f80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9af4034040 tx=0x7f9af40046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.223+0000 7f9b06d22640 1 -- 172.21.15.38:0/2622180259 shutdown_connections 2023-12-22T08:41:39.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.223+0000 7f9b06d22640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b000b26a0 0x7f9b001f9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.223+0000 7f9b06d22640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b22c0 0x7f9b00151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.223+0000 7f9b06d22640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9ae406a430 0x7f9ae406c8f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.223+0000 7f9b06d22640 1 --2- 172.21.15.38:0/2622180259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b0006cf50 0x7f9b001f6f80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.223+0000 7f9b06d22640 1 -- 172.21.15.38:0/2622180259 >> 172.21.15.38:0/2622180259 conn(0x7f9b000cf070 msgr2=0x7f9b0015f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:39.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.223+0000 7f9b06d22640 1 -- 172.21.15.38:0/2622180259 shutdown_connections 2023-12-22T08:41:39.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.223+0000 7f9b06d22640 1 -- 172.21.15.38:0/2622180259 wait complete. 2023-12-22T08:41:39.246 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:41:12.357679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:41:13.069596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:39.246 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:39.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.473+0000 7f4dfcdc3640 1 Processor -- start 2023-12-22T08:41:39.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.473+0000 7f4dfcdc3640 1 -- start start 2023-12-22T08:41:39.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.475+0000 7f4dfcdc3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4df815e870 0x7f4df80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.475+0000 7f4dfcdc3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4df8070e80 0x7f4df806f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.475+0000 7f4dfcdc3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df80ce4b0 con 0x7f4df815ec50 2023-12-22T08:41:39.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.475+0000 7f4dfcdc3640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df815fea0 con 0x7f4df8070e80 2023-12-22T08:41:39.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.475+0000 7f4dfcdc3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df80cdb80 con 0x7f4df815e870 2023-12-22T08:41:39.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.476+0000 7f4df6d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4df8070e80 0x7f4df806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.476+0000 7f4df6d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4df8070e80 0x7f4df806f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43432/0 (socket says 172.21.15.38:43432) 2023-12-22T08:41:39.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.476+0000 7f4df6d9d640 1 -- 172.21.15.38:0/3379964197 learned_addr learned my addr 172.21.15.38:0/3379964197 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.476+0000 7f4df659c640 1 --2- 172.21.15.38:0/3379964197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4df815e870 0x7f4df80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.476+0000 7f4df6d9d640 1 -- 172.21.15.38:0/3379964197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4df815e870 msgr2=0x7f4df80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.476+0000 7f4df6d9d640 1 --2- 172.21.15.38:0/3379964197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4df815e870 0x7f4df80ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.476+0000 7f4df6d9d640 1 -- 172.21.15.38:0/3379964197 >> v1:172.21.15.89:6789/0 conn(0x7f4df815ec50 legacy=0x7f4df8070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.476+0000 7f4df6d9d640 1 -- 172.21.15.38:0/3379964197 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df80cde60 con 0x7f4df8070e80 2023-12-22T08:41:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.478+0000 7f4df6d9d640 1 --2- 172.21.15.38:0/3379964197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df8070e80 0x7f4df806f250 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009e50 tx=0x7f4df002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46714ae45613a0c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.478+0000 7f4df559a640 1 -- 172.21.15.38:0/3379964197 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df002c9e0 con 0x7f4df8070e80 2023-12-22T08:41:39.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.478+0000 7f4df559a640 1 -- 172.21.15.38:0/3379964197 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df002cb40 con 0x7f4df8070e80 2023-12-22T08:41:39.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.478+0000 7f4df559a640 1 -- 172.21.15.38:0/3379964197 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df00343f0 con 0x7f4df8070e80 2023-12-22T08:41:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.479+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/3379964197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df8070e80 msgr2=0x7f4df806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.479+0000 7f4dfcdc3640 1 --2- 172.21.15.38:0/3379964197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df8070e80 0x7f4df806f250 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009e50 tx=0x7f4df002be40 comp rx=0 tx=0).stop 2023-12-22T08:41:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.479+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/3379964197 shutdown_connections 2023-12-22T08:41:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.479+0000 7f4dfcdc3640 1 --2- 172.21.15.38:0/3379964197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df8070e80 0x7f4df806f250 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.479+0000 7f4dfcdc3640 1 --2- 172.21.15.38:0/3379964197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4df815e870 0x7f4df80ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.479+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/3379964197 >> 172.21.15.38:0/3379964197 conn(0x7f4df80b20c0 msgr2=0x7f4df80b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.479+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/3379964197 shutdown_connections 2023-12-22T08:41:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.479+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/3379964197 wait complete. 2023-12-22T08:41:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.481+0000 7f4dfcdc3640 1 Processor -- start 2023-12-22T08:41:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.481+0000 7f4dfcdc3640 1 -- start start 2023-12-22T08:41:39.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.482+0000 7f4dfcdc3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4df8070e80 0x7f4df815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.482+0000 7f4dfcdc3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df815e870 0x7f4df815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.482+0000 7f4dfcdc3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4df815ec50 0x7f4df815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.482+0000 7f4dfcdc3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df815b780 con 0x7f4df815e870 2023-12-22T08:41:39.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.482+0000 7f4dfcdc3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df814a5e0 con 0x7f4df815ec50 2023-12-22T08:41:39.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.482+0000 7f4dfcdc3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df815c290 con 0x7f4df8070e80 2023-12-22T08:41:39.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.482+0000 7f4df5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df815e870 0x7f4df815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.482+0000 7f4df5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df815e870 0x7f4df815cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43440/0 (socket says 172.21.15.38:43440) 2023-12-22T08:41:39.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.482+0000 7f4df5d9b640 1 -- 172.21.15.38:0/1653998820 learned_addr learned my addr 172.21.15.38:0/1653998820 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:39.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.483+0000 7f4df659c640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4df8070e80 0x7f4df815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.483+0000 7f4df6d9d640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4df815ec50 0x7f4df815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.483+0000 7f4df5d9b640 1 -- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4df8070e80 msgr2=0x7f4df815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.483+0000 7f4df5d9b640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4df8070e80 0x7f4df815c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.483+0000 7f4df5d9b640 1 -- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4df815ec50 msgr2=0x7f4df815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.483+0000 7f4df5d9b640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4df815ec50 0x7f4df815d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.483+0000 7f4df5d9b640 1 -- 172.21.15.38:0/1653998820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df0009b30 con 0x7f4df815e870 2023-12-22T08:41:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.483+0000 7f4df659c640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4df8070e80 0x7f4df815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.483+0000 7f4df5d9b640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df815e870 0x7f4df815cc60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00b3f0 tx=0x7f4dec00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.483+0000 7f4de6ffd640 1 -- 172.21.15.38:0/1653998820 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec011830 con 0x7f4df815e870 2023-12-22T08:41:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.484+0000 7f4de6ffd640 1 -- 172.21.15.38:0/1653998820 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dec011990 con 0x7f4df815e870 2023-12-22T08:41:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.484+0000 7f4de6ffd640 1 -- 172.21.15.38:0/1653998820 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec011d40 con 0x7f4df815e870 2023-12-22T08:41:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.484+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/1653998820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df81f2a60 con 0x7f4df815e870 2023-12-22T08:41:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.484+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/1653998820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df815bc40 con 0x7f4df815e870 2023-12-22T08:41:39.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.485+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/1653998820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df8061910 con 0x7f4df815e870 2023-12-22T08:41:39.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.486+0000 7f4de6ffd640 1 -- 172.21.15.38:0/1653998820 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4dec01a400 con 0x7f4df815e870 2023-12-22T08:41:39.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.487+0000 7f4de6ffd640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4dd806a430 0x7f4dd806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.487+0000 7f4de6ffd640 1 -- 172.21.15.38:0/1653998820 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4dec088860 con 0x7f4df815e870 2023-12-22T08:41:39.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.487+0000 7f4df659c640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4dd806a430 0x7f4dd806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.488+0000 7f4df659c640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4dd806a430 0x7f4dd806c8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4de8006fd0 tx=0x7f4de8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.491+0000 7f4de6ffd640 1 -- 172.21.15.38:0/1653998820 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4dec053db0 con 0x7f4df815e870 2023-12-22T08:41:39.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.684+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/1653998820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4df80b2ce0 con 0x7f4df815e870 2023-12-22T08:41:39.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.685+0000 7f4de6ffd640 1 -- 172.21.15.38:0/1653998820 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4dec0573d0 con 0x7f4df815e870 2023-12-22T08:41:39.688 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:41:39.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.688+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4dd806a430 msgr2=0x7f4dd806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.688+0000 7f4dfcdc3640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4dd806a430 0x7f4dd806c8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4de8006fd0 tx=0x7f4de8008040 comp rx=0 tx=0).stop 2023-12-22T08:41:39.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.688+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/1653998820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df815e870 msgr2=0x7f4df815cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.688+0000 7f4dfcdc3640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df815e870 0x7f4df815cc60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00b3f0 tx=0x7f4dec00b8b0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.689+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/1653998820 shutdown_connections 2023-12-22T08:41:39.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.689+0000 7f4dfcdc3640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4df815ec50 0x7f4df815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.689+0000 7f4dfcdc3640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4dd806a430 0x7f4dd806c8f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.689+0000 7f4dfcdc3640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df815e870 0x7f4df815cc60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.689+0000 7f4dfcdc3640 1 --2- 172.21.15.38:0/1653998820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4df8070e80 0x7f4df815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.689+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/1653998820 >> 172.21.15.38:0/1653998820 conn(0x7f4df80b20c0 msgr2=0x7f4df8070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:39.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.689+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/1653998820 shutdown_connections 2023-12-22T08:41:39.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.689+0000 7f4dfcdc3640 1 -- 172.21.15.38:0/1653998820 wait complete. 2023-12-22T08:41:39.710 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:41:39.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.941+0000 7f9d2f59e640 1 Processor -- start 2023-12-22T08:41:39.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.941+0000 7f9d2f59e640 1 -- start start 2023-12-22T08:41:39.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.942+0000 7f9d2f59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9d3015b0e0 0x7f9d3015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.942+0000 7f9d2f59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9d3009c980 0x7f9d3015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.943+0000 7f9d2f59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d3015edf0 con 0x7f9d30071460 2023-12-22T08:41:39.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.943+0000 7f9d2f59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3015bd90 con 0x7f9d3009c980 2023-12-22T08:41:39.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.943+0000 7f9d2f59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3015c070 con 0x7f9d3015b0e0 2023-12-22T08:41:39.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.943+0000 7f9d27fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9d3009c980 0x7f9d3015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.943+0000 7f9d2e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9d3015b0e0 0x7f9d3015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.943+0000 7f9d27fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9d3009c980 0x7f9d3015c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43448/0 (socket says 172.21.15.38:43448) 2023-12-22T08:41:39.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.943+0000 7f9d27fff640 1 -- 172.21.15.38:0/2726203748 learned_addr learned my addr 172.21.15.38:0/2726203748 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:39.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.944+0000 7f9d27fff640 1 -- 172.21.15.38:0/2726203748 >> v2:172.21.15.89:3300/0 conn(0x7f9d3015b0e0 msgr2=0x7f9d3015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:39.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.944+0000 7f9d27fff640 1 --2- 172.21.15.38:0/2726203748 >> v2:172.21.15.89:3300/0 conn(0x7f9d3015b0e0 0x7f9d3015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.944+0000 7f9d27fff640 1 -- 172.21.15.38:0/2726203748 >> v1:172.21.15.89:6789/0 conn(0x7f9d30071460 legacy=0x7f9d30071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.944+0000 7f9d27fff640 1 -- 172.21.15.38:0/2726203748 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3015c350 con 0x7f9d3009c980 2023-12-22T08:41:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.945+0000 7f9d27fff640 1 --2- 172.21.15.38:0/2726203748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d3009c980 0x7f9d3015c9c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9d300b1c60 tx=0x7f9d1802b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221291ced9fb7770 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.945+0000 7f9d2dd9b640 1 -- 172.21.15.38:0/2726203748 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d180317f0 con 0x7f9d3009c980 2023-12-22T08:41:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.945+0000 7f9d2dd9b640 1 -- 172.21.15.38:0/2726203748 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18031950 con 0x7f9d3009c980 2023-12-22T08:41:39.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.945+0000 7f9d2dd9b640 1 -- 172.21.15.38:0/2726203748 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18031ce0 con 0x7f9d3009c980 2023-12-22T08:41:39.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.946+0000 7f9d2f59e640 1 -- 172.21.15.38:0/2726203748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d3009c980 msgr2=0x7f9d3015c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.946+0000 7f9d2f59e640 1 --2- 172.21.15.38:0/2726203748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d3009c980 0x7f9d3015c9c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9d300b1c60 tx=0x7f9d1802b890 comp rx=0 tx=0).stop 2023-12-22T08:41:39.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.946+0000 7f9d2f59e640 1 -- 172.21.15.38:0/2726203748 shutdown_connections 2023-12-22T08:41:39.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.946+0000 7f9d2f59e640 1 --2- 172.21.15.38:0/2726203748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d3009c980 0x7f9d3015c9c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.946+0000 7f9d2f59e640 1 --2- 172.21.15.38:0/2726203748 >> v2:172.21.15.89:3300/0 conn(0x7f9d3015b0e0 0x7f9d3015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.946+0000 7f9d2f59e640 1 -- 172.21.15.38:0/2726203748 >> 172.21.15.38:0/2726203748 conn(0x7f9d300cf000 msgr2=0x7f9d300cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:39.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.946+0000 7f9d2f59e640 1 -- 172.21.15.38:0/2726203748 shutdown_connections 2023-12-22T08:41:39.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.946+0000 7f9d2f59e640 1 -- 172.21.15.38:0/2726203748 wait complete. 2023-12-22T08:41:39.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.948+0000 7f9d2f59e640 1 Processor -- start 2023-12-22T08:41:39.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.948+0000 7f9d2f59e640 1 -- start start 2023-12-22T08:41:39.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.949+0000 7f9d2f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d30071460 0x7f9d30155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.949+0000 7f9d2f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d3009c980 0x7f9d300cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.949+0000 7f9d2f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d3015b0e0 0x7f9d300cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.949+0000 7f9d2f59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300cb610 con 0x7f9d3009c980 2023-12-22T08:41:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.949+0000 7f9d2f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300cad70 con 0x7f9d30071460 2023-12-22T08:41:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.949+0000 7f9d2f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300cb050 con 0x7f9d3015b0e0 2023-12-22T08:41:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.949+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d3009c980 0x7f9d300cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.949+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d3009c980 0x7f9d300cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43464/0 (socket says 172.21.15.38:43464) 2023-12-22T08:41:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.949+0000 7f9d27fff640 1 -- 172.21.15.38:0/91842165 learned_addr learned my addr 172.21.15.38:0/91842165 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.950+0000 7f9d2e59c640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d30071460 0x7f9d30155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.950+0000 7f9d27fff640 1 -- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d3015b0e0 msgr2=0x7f9d300cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.950+0000 7f9d27fff640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d3015b0e0 0x7f9d300cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.950+0000 7f9d27fff640 1 -- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d30071460 msgr2=0x7f9d30155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.950+0000 7f9d27fff640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d30071460 0x7f9d30155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.950+0000 7f9d27fff640 1 -- 172.21.15.38:0/91842165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d180094d0 con 0x7f9d3009c980 2023-12-22T08:41:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.950+0000 7f9d2e59c640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d30071460 0x7f9d30155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:39.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.950+0000 7f9d27fff640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d3009c980 0x7f9d300cb9b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9d18000c00 tx=0x7f9d180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.950+0000 7f9d26ffd640 1 -- 172.21.15.38:0/91842165 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18032950 con 0x7f9d3009c980 2023-12-22T08:41:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.950+0000 7f9d26ffd640 1 -- 172.21.15.38:0/91842165 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18032ab0 con 0x7f9d3009c980 2023-12-22T08:41:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.950+0000 7f9d2f59e640 1 -- 172.21.15.38:0/91842165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d300cb330 con 0x7f9d3009c980 2023-12-22T08:41:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.950+0000 7f9d26ffd640 1 -- 172.21.15.38:0/91842165 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18032e60 con 0x7f9d3009c980 2023-12-22T08:41:39.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.951+0000 7f9d2f59e640 1 -- 172.21.15.38:0/91842165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d301558d0 con 0x7f9d3009c980 2023-12-22T08:41:39.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.952+0000 7f9d2f59e640 1 -- 172.21.15.38:0/91842165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d300c7840 con 0x7f9d3009c980 2023-12-22T08:41:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.952+0000 7f9d26ffd640 1 -- 172.21.15.38:0/91842165 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9d1804e450 con 0x7f9d3009c980 2023-12-22T08:41:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.953+0000 7f9d26ffd640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9d1006a430 0x7f9d1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.953+0000 7f9d26ffd640 1 -- 172.21.15.38:0/91842165 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d180aac80 con 0x7f9d3009c980 2023-12-22T08:41:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.954+0000 7f9d2e59c640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9d1006a430 0x7f9d1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.955+0000 7f9d2e59c640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9d1006a430 0x7f9d1006c8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9d300c7c20 tx=0x7f9d20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:39.957+0000 7f9d26ffd640 1 -- 172.21.15.38:0/91842165 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9d18076260 con 0x7f9d3009c980 2023-12-22T08:41:40.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.154+0000 7f9d2f59e640 1 -- 172.21.15.38:0/91842165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d30156c40 con 0x7f9d3009c980 2023-12-22T08:41:40.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.155+0000 7f9d26ffd640 1 -- 172.21.15.38:0/91842165 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d30156c40 con 0x7f9d3009c980 2023-12-22T08:41:40.157 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:41:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.157+0000 7f9d2f59e640 1 -- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9d1006a430 msgr2=0x7f9d1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.157+0000 7f9d2f59e640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9d1006a430 0x7f9d1006c8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9d300c7c20 tx=0x7f9d20008040 comp rx=0 tx=0).stop 2023-12-22T08:41:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.157+0000 7f9d2f59e640 1 -- 172.21.15.38:0/91842165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d3009c980 msgr2=0x7f9d300cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.157+0000 7f9d2f59e640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d3009c980 0x7f9d300cb9b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9d18000c00 tx=0x7f9d180046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.158+0000 7f9d2f59e640 1 -- 172.21.15.38:0/91842165 shutdown_connections 2023-12-22T08:41:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.158+0000 7f9d2f59e640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d3015b0e0 0x7f9d300cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.158+0000 7f9d2f59e640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9d1006a430 0x7f9d1006c8f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.158+0000 7f9d2f59e640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d3009c980 0x7f9d300cb9b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.158+0000 7f9d2f59e640 1 --2- 172.21.15.38:0/91842165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d30071460 0x7f9d30155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.158+0000 7f9d2f59e640 1 -- 172.21.15.38:0/91842165 >> 172.21.15.38:0/91842165 conn(0x7f9d300cf000 msgr2=0x7f9d300cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.158+0000 7f9d2f59e640 1 -- 172.21.15.38:0/91842165 shutdown_connections 2023-12-22T08:41:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.158+0000 7f9d2f59e640 1 -- 172.21.15.38:0/91842165 wait complete. 2023-12-22T08:41:40.180 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:41:40.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.396+0000 7f9978837640 1 Processor -- start 2023-12-22T08:41:40.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.396+0000 7f9978837640 1 -- start start 2023-12-22T08:41:40.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.398+0000 7f9978837640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99741508e0 0x7f9974071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:40.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.398+0000 7f9978837640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997415ac10 con 0x7f997406c820 2023-12-22T08:41:40.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.398+0000 7f9978837640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997415a000 con 0x7f99740ae600 2023-12-22T08:41:40.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.398+0000 7f9978837640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997415a2e0 con 0x7f99741508e0 2023-12-22T08:41:40.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.398+0000 7f997259c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f997406c820 0x7f99740adef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:48450/0 (socket says 172.21.15.38:48450) 2023-12-22T08:41:40.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.398+0000 7f9972d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99741508e0 0x7f9974071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:40.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.398+0000 7f997259c640 1 -- 172.21.15.38:0/765980293 learned_addr learned my addr 172.21.15.38:0/765980293 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:40.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.399+0000 7f9972d9d640 1 -- 172.21.15.38:0/765980293 >> v1:172.21.15.89:6789/0 conn(0x7f99740ae600 legacy=0x7f997406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:40.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.399+0000 7f9972d9d640 1 -- 172.21.15.38:0/765980293 >> v1:172.21.15.38:6789/0 conn(0x7f997406c820 legacy=0x7f99740adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:40.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.399+0000 7f9972d9d640 1 -- 172.21.15.38:0/765980293 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997415a5c0 con 0x7f99741508e0 2023-12-22T08:41:40.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.400+0000 7f9972d9d640 1 --2- 172.21.15.38:0/765980293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99741508e0 0x7f9974071a20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f99640097a0 tx=0x7f996402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62112776a028b897 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:40.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.400+0000 7f9971d9b640 1 -- 172.21.15.38:0/765980293 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996402e070 con 0x7f99741508e0 2023-12-22T08:41:40.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.400+0000 7f9971d9b640 1 -- 172.21.15.38:0/765980293 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99640315a0 con 0x7f99741508e0 2023-12-22T08:41:40.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.400+0000 7f9971d9b640 1 -- 172.21.15.38:0/765980293 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964031930 con 0x7f99741508e0 2023-12-22T08:41:40.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.401+0000 7f9978837640 1 -- 172.21.15.38:0/765980293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99741508e0 msgr2=0x7f9974071a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:40.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.401+0000 7f9978837640 1 --2- 172.21.15.38:0/765980293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99741508e0 0x7f9974071a20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f99640097a0 tx=0x7f996402b840 comp rx=0 tx=0).stop 2023-12-22T08:41:40.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.401+0000 7f9978837640 1 -- 172.21.15.38:0/765980293 shutdown_connections 2023-12-22T08:41:40.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.401+0000 7f9978837640 1 --2- 172.21.15.38:0/765980293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99741508e0 0x7f9974071a20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.401+0000 7f9978837640 1 -- 172.21.15.38:0/765980293 >> 172.21.15.38:0/765980293 conn(0x7f99740b0b60 msgr2=0x7f99740b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:40.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.401+0000 7f9978837640 1 -- 172.21.15.38:0/765980293 shutdown_connections 2023-12-22T08:41:40.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.401+0000 7f9978837640 1 -- 172.21.15.38:0/765980293 wait complete. 2023-12-22T08:41:40.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.403+0000 7f9978837640 1 Processor -- start 2023-12-22T08:41:40.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.403+0000 7f9978837640 1 -- start start 2023-12-22T08:41:40.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.404+0000 7f9978837640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f997406c820 0x7f99740cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:40.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.404+0000 7f9978837640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99740ae600 0x7f9974157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:40.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.404+0000 7f9978837640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99741508e0 0x7f9974158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:40.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.404+0000 7f9978837640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974137fd0 con 0x7f99741508e0 2023-12-22T08:41:40.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.404+0000 7f9978837640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974159740 con 0x7f99740ae600 2023-12-22T08:41:40.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.404+0000 7f9978837640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99741586a0 con 0x7f997406c820 2023-12-22T08:41:40.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.405+0000 7f997359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99741508e0 0x7f9974158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:40.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.405+0000 7f997359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99741508e0 0x7f9974158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43496/0 (socket says 172.21.15.38:43496) 2023-12-22T08:41:40.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.405+0000 7f997359e640 1 -- 172.21.15.38:0/3336500306 learned_addr learned my addr 172.21.15.38:0/3336500306 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:40.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.405+0000 7f997259c640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99740ae600 0x7f9974157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:40.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.405+0000 7f997359e640 1 -- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f997406c820 msgr2=0x7f99740cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:40.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.405+0000 7f997359e640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f997406c820 0x7f99740cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.405+0000 7f997359e640 1 -- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99740ae600 msgr2=0x7f9974157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:40.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.405+0000 7f997359e640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99740ae600 0x7f9974157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.405+0000 7f997359e640 1 -- 172.21.15.38:0/3336500306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9964009400 con 0x7f99741508e0 2023-12-22T08:41:40.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.405+0000 7f997259c640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99740ae600 0x7f9974157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:40.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.405+0000 7f997359e640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99741508e0 0x7f9974158040 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c780 tx=0x7f996c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:40.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.406+0000 7f995b7fe640 1 -- 172.21.15.38:0/3336500306 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c004b10 con 0x7f99741508e0 2023-12-22T08:41:40.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.406+0000 7f995b7fe640 1 -- 172.21.15.38:0/3336500306 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c004c70 con 0x7f99741508e0 2023-12-22T08:41:40.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.406+0000 7f995b7fe640 1 -- 172.21.15.38:0/3336500306 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c00aa90 con 0x7f99741508e0 2023-12-22T08:41:40.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.406+0000 7f9978837640 1 -- 172.21.15.38:0/3336500306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9974158980 con 0x7f99741508e0 2023-12-22T08:41:40.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.406+0000 7f9978837640 1 -- 172.21.15.38:0/3336500306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9974158f40 con 0x7f99741508e0 2023-12-22T08:41:40.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.407+0000 7f9978837640 1 -- 172.21.15.38:0/3336500306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9974061910 con 0x7f99741508e0 2023-12-22T08:41:40.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.408+0000 7f995b7fe640 1 -- 172.21.15.38:0/3336500306 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f996c00abf0 con 0x7f99741508e0 2023-12-22T08:41:40.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.409+0000 7f995b7fe640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f996006a430 0x7f996006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:40.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.409+0000 7f995b7fe640 1 -- 172.21.15.38:0/3336500306 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f996c088b10 con 0x7f99741508e0 2023-12-22T08:41:40.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.410+0000 7f9972d9d640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f996006a430 0x7f996006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:40.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.411+0000 7f9972d9d640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f996006a430 0x7f996006c8f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9964036000 tx=0x7f9964030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:40.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.413+0000 7f995b7fe640 1 -- 172.21.15.38:0/3336500306 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f996c054060 con 0x7f99741508e0 2023-12-22T08:41:40.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.609+0000 7f9978837640 1 -- 172.21.15.38:0/3336500306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99740cb5e0 con 0x7f99741508e0 2023-12-22T08:41:40.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.610+0000 7f995b7fe640 1 -- 172.21.15.38:0/3336500306 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f996c057680 con 0x7f99741508e0 2023-12-22T08:41:40.613 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:41:40.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.613+0000 7f9978837640 1 -- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f996006a430 msgr2=0x7f996006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:40.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.613+0000 7f9978837640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f996006a430 0x7f996006c8f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9964036000 tx=0x7f9964030000 comp rx=0 tx=0).stop 2023-12-22T08:41:40.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.613+0000 7f9978837640 1 -- 172.21.15.38:0/3336500306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99741508e0 msgr2=0x7f9974158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:40.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.613+0000 7f9978837640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99741508e0 0x7f9974158040 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c780 tx=0x7f996c00cc40 comp rx=0 tx=0).stop 2023-12-22T08:41:40.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.613+0000 7f9978837640 1 -- 172.21.15.38:0/3336500306 shutdown_connections 2023-12-22T08:41:40.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.613+0000 7f9978837640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f996006a430 0x7f996006c8f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.613+0000 7f9978837640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99741508e0 0x7f9974158040 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.613+0000 7f9978837640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99740ae600 0x7f9974157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.613+0000 7f9978837640 1 --2- 172.21.15.38:0/3336500306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f997406c820 0x7f99740cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.613+0000 7f9978837640 1 -- 172.21.15.38:0/3336500306 >> 172.21.15.38:0/3336500306 conn(0x7f99740b0b60 msgr2=0x7f997415c440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:40.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.613+0000 7f9978837640 1 -- 172.21.15.38:0/3336500306 shutdown_connections 2023-12-22T08:41:40.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.613+0000 7f9978837640 1 -- 172.21.15.38:0/3336500306 wait complete. 2023-12-22T08:41:40.635 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:41:40.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.854+0000 7fdbf81e0640 1 Processor -- start 2023-12-22T08:41:40.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.855+0000 7fdbf81e0640 1 -- start start 2023-12-22T08:41:40.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.856+0000 7fdbf81e0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdbf00b26a0 0x7fdbf006ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:40.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.857+0000 7fdbf81e0640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf00b3d10 con 0x7fdbf006cf50 2023-12-22T08:41:40.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.857+0000 7fdbf81e0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf00b4510 con 0x7fdbf00b22c0 2023-12-22T08:41:40.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.857+0000 7fdbf81e0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf006c610 con 0x7fdbf00b26a0 2023-12-22T08:41:40.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.857+0000 7fdbf677d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdbf006cf50 0x7fdbf00cb830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:48460/0 (socket says 172.21.15.38:48460) 2023-12-22T08:41:40.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.857+0000 7fdbf677d640 1 -- 172.21.15.38:0/3363109047 learned_addr learned my addr 172.21.15.38:0/3363109047 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:40.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.857+0000 7fdbf577b640 1 --2- 172.21.15.38:0/3363109047 >> v2:172.21.15.89:3300/0 conn(0x7fdbf00b26a0 0x7fdbf006ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:40.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173077726 0 0) 0x7fdbe8001110 con 0x7fdbf006cf50 2023-12-22T08:41:40.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd8003520 con 0x7fdbf006cf50 2023-12-22T08:41:40.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3436801218 0 0) 0x7fdbd8003520 con 0x7fdbf006cf50 2023-12-22T08:41:40.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 >> v2:172.21.15.89:3300/0 conn(0x7fdbf00b26a0 msgr2=0x7fdbf006ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:40.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 --2- 172.21.15.38:0/3363109047 >> v2:172.21.15.89:3300/0 conn(0x7fdbf00b26a0 0x7fdbf006ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 >> v1:172.21.15.89:6789/0 conn(0x7fdbf00b22c0 legacy=0x7fdbf00b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:40.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf00b3f50 con 0x7fdbf006cf50 2023-12-22T08:41:40.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fdbe8001800 con 0x7fdbf006cf50 2023-12-22T08:41:40.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 >> v1:172.21.15.38:6789/0 conn(0x7fdbf006cf50 legacy=0x7fdbf00cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:40.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 --2- 172.21.15.38:0/3363109047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbd8003970 0x7fdbd8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:40.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 --2- 172.21.15.38:0/3363109047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbd80047c0 0x7fdbd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:40.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 --2- 172.21.15.38:0/3363109047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbd8005180 0x7fdbd800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:40.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf006c610 con 0x7fdbd8005180 2023-12-22T08:41:40.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd800c120 con 0x7fdbd8003970 2023-12-22T08:41:40.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.858+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd800c2e0 con 0x7fdbd80047c0 2023-12-22T08:41:40.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.859+0000 7fdbf677d640 1 --2- 172.21.15.38:0/3363109047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbd8005180 0x7fdbd800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:40.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.859+0000 7fdbf5f7c640 1 --2- 172.21.15.38:0/3363109047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbd8003970 0x7fdbd8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:40.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.859+0000 7fdbf577b640 1 --2- 172.21.15.38:0/3363109047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbd80047c0 0x7fdbd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:40.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.859+0000 7fdbf677d640 1 -- 172.21.15.38:0/3363109047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbd80047c0 msgr2=0x7fdbd8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:40.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.859+0000 7fdbf677d640 1 --2- 172.21.15.38:0/3363109047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbd80047c0 0x7fdbd8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.859+0000 7fdbf677d640 1 -- 172.21.15.38:0/3363109047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbd8003970 msgr2=0x7fdbd8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:40.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.859+0000 7fdbf677d640 1 --2- 172.21.15.38:0/3363109047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbd8003970 0x7fdbd8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.859+0000 7fdbf677d640 1 -- 172.21.15.38:0/3363109047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd8003520 con 0x7fdbd8005180 2023-12-22T08:41:40.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.860+0000 7fdbf677d640 1 -- 172.21.15.38:0/3363109047 reap_dead start 2023-12-22T08:41:40.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.860+0000 7fdbf677d640 1 --2- 172.21.15.38:0/3363109047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbd8005180 0x7fdbd800b980 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800c210 tx=0x7fdbd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2faeb0b3aceba298 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:40.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.860+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8005ad0 con 0x7fdbd8005180 2023-12-22T08:41:40.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.860+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe8005c50 con 0x7fdbd8005180 2023-12-22T08:41:40.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.860+0000 7fdbf4f7a640 1 -- 172.21.15.38:0/3363109047 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe802c890 con 0x7fdbd8005180 2023-12-22T08:41:40.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.861+0000 7fdbf81e0640 1 -- 172.21.15.38:0/3363109047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbd8005180 msgr2=0x7fdbd800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:40.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.861+0000 7fdbf81e0640 1 --2- 172.21.15.38:0/3363109047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbd8005180 0x7fdbd800b980 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800c210 tx=0x7fdbd80057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.861+0000 7fdbf81e0640 1 -- 172.21.15.38:0/3363109047 shutdown_connections 2023-12-22T08:41:40.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.861+0000 7fdbf81e0640 1 --2- 172.21.15.38:0/3363109047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbd8005180 0x7fdbd800b980 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.861+0000 7fdbf81e0640 1 -- 172.21.15.38:0/3363109047 >> 172.21.15.38:0/3363109047 conn(0x7fdbf00cf070 msgr2=0x7fdbf00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:40.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.861+0000 7fdbf81e0640 1 -- 172.21.15.38:0/3363109047 shutdown_connections 2023-12-22T08:41:40.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.861+0000 7fdbf81e0640 1 -- 172.21.15.38:0/3363109047 wait complete. 2023-12-22T08:41:40.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.863+0000 7fdbf81e0640 1 Processor -- start 2023-12-22T08:41:40.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.863+0000 7fdbf81e0640 1 -- start start 2023-12-22T08:41:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.864+0000 7fdbf81e0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbd8005180 0x7fdbf01faf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.864+0000 7fdbf81e0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf0148880 0x7fdbf0158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.864+0000 7fdbf81e0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf015a3a0 0x7fdbf015a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.864+0000 7fdbf81e0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf015b3d0 con 0x7fdbd8005180 2023-12-22T08:41:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.864+0000 7fdbf81e0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf01faa70 con 0x7fdbf015a3a0 2023-12-22T08:41:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.864+0000 7fdbf81e0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf015ae10 con 0x7fdbf0148880 2023-12-22T08:41:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.865+0000 7fdbf5f7c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbd8005180 0x7fdbf01faf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.865+0000 7fdbf5f7c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbd8005180 0x7fdbf01faf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43512/0 (socket says 172.21.15.38:43512) 2023-12-22T08:41:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.865+0000 7fdbf5f7c640 1 -- 172.21.15.38:0/1769366055 learned_addr learned my addr 172.21.15.38:0/1769366055 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.865+0000 7fdbf677d640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf015a3a0 0x7fdbf015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.865+0000 7fdbf577b640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf0148880 0x7fdbf0158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.865+0000 7fdbf5f7c640 1 -- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf0148880 msgr2=0x7fdbf0158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.865+0000 7fdbf5f7c640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf0148880 0x7fdbf0158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.865+0000 7fdbf5f7c640 1 -- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf015a3a0 msgr2=0x7fdbf015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.865+0000 7fdbf5f7c640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf015a3a0 0x7fdbf015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.865+0000 7fdbf5f7c640 1 -- 172.21.15.38:0/1769366055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf015b0f0 con 0x7fdbd8005180 2023-12-22T08:41:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.866+0000 7fdbf5f7c640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbd8005180 0x7fdbf01faf00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000e920 tx=0x7fdbe000ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.866+0000 7fdbee7fc640 1 -- 172.21.15.38:0/1769366055 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0003b80 con 0x7fdbd8005180 2023-12-22T08:41:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.866+0000 7fdbee7fc640 1 -- 172.21.15.38:0/1769366055 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe0003ce0 con 0x7fdbd8005180 2023-12-22T08:41:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.866+0000 7fdbee7fc640 1 -- 172.21.15.38:0/1769366055 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00052f0 con 0x7fdbd8005180 2023-12-22T08:41:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.866+0000 7fdbf81e0640 1 -- 172.21.15.38:0/1769366055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf01fa700 con 0x7fdbd8005180 2023-12-22T08:41:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.866+0000 7fdbf81e0640 1 -- 172.21.15.38:0/1769366055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf0158e40 con 0x7fdbd8005180 2023-12-22T08:41:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.867+0000 7fdbf81e0640 1 -- 172.21.15.38:0/1769366055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf0061910 con 0x7fdbd8005180 2023-12-22T08:41:40.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.868+0000 7fdbee7fc640 1 -- 172.21.15.38:0/1769366055 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdbe0005450 con 0x7fdbd8005180 2023-12-22T08:41:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.870+0000 7fdbee7fc640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdbdc06a460 0x7fdbdc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.870+0000 7fdbee7fc640 1 -- 172.21.15.38:0/1769366055 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbe0088910 con 0x7fdbd8005180 2023-12-22T08:41:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.870+0000 7fdbf577b640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdbdc06a460 0x7fdbdc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:40.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.871+0000 7fdbf577b640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdbdc06a460 0x7fdbdc06c920 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0148c60 tx=0x7fdbe4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:40.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:40.874+0000 7fdbee7fc640 1 -- 172.21.15.38:0/1769366055 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdbe0053f90 con 0x7fdbd8005180 2023-12-22T08:41:41.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.081+0000 7fdbf81e0640 1 -- 172.21.15.38:0/1769366055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdbf00b32f0 con 0x7fdbd8005180 2023-12-22T08:41:41.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.082+0000 7fdbee7fc640 1 -- 172.21.15.38:0/1769366055 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdbe00575b0 con 0x7fdbd8005180 2023-12-22T08:41:41.084 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:41:41.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.084+0000 7fdbf81e0640 1 -- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdbdc06a460 msgr2=0x7fdbdc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.084+0000 7fdbf81e0640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdbdc06a460 0x7fdbdc06c920 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0148c60 tx=0x7fdbe4008040 comp rx=0 tx=0).stop 2023-12-22T08:41:41.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.084+0000 7fdbf81e0640 1 -- 172.21.15.38:0/1769366055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbd8005180 msgr2=0x7fdbf01faf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.084+0000 7fdbf81e0640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbd8005180 0x7fdbf01faf00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000e920 tx=0x7fdbe000ede0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.084+0000 7fdbf81e0640 1 -- 172.21.15.38:0/1769366055 shutdown_connections 2023-12-22T08:41:41.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.084+0000 7fdbf81e0640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbf015a3a0 0x7fdbf015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.084+0000 7fdbf81e0640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbf0148880 0x7fdbf0158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.084+0000 7fdbf81e0640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdbdc06a460 0x7fdbdc06c920 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.084+0000 7fdbf81e0640 1 --2- 172.21.15.38:0/1769366055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbd8005180 0x7fdbf01faf00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.085+0000 7fdbf81e0640 1 -- 172.21.15.38:0/1769366055 >> 172.21.15.38:0/1769366055 conn(0x7fdbf00cf070 msgr2=0x7fdbf01eb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.085+0000 7fdbf81e0640 1 -- 172.21.15.38:0/1769366055 shutdown_connections 2023-12-22T08:41:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.085+0000 7fdbf81e0640 1 -- 172.21.15.38:0/1769366055 wait complete. 2023-12-22T08:41:41.107 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T08:41:41.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:41.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-22T08:41:41.219 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:41:41.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:41.219 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T08:41:41.272 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:41:41.272 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:41.333 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:41:41.334 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:41:41.334 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:41.393 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:41:41.393 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:41.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.620+0000 7f4921f92640 1 Processor -- start 2023-12-22T08:41:41.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.620+0000 7f4921f92640 1 -- start start 2023-12-22T08:41:41.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.621+0000 7f4921f92640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491c144d10 0x7f491c0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.621+0000 7f4921f92640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f491c0cc670 0x7f491c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.621+0000 7f4921f92640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f491c0b2590 0x7f491c15f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.621+0000 7f4921f92640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c0b2a20 con 0x7f491c0b2590 2023-12-22T08:41:41.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.621+0000 7f4921f92640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c1450f0 con 0x7f491c0cc670 2023-12-22T08:41:41.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.621+0000 7f4921f92640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0ce010 con 0x7f491c144d10 2023-12-22T08:41:41.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.622+0000 7f491bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f491c0b2590 0x7f491c15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.622+0000 7f491bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f491c0b2590 0x7f491c15f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50130/0 (socket says 172.21.15.38:50130) 2023-12-22T08:41:41.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.622+0000 7f491bfff640 1 -- 172.21.15.38:0/2690628244 learned_addr learned my addr 172.21.15.38:0/2690628244 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:41.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.622+0000 7f491b7fe640 1 --2- 172.21.15.38:0/2690628244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491c144d10 0x7f491c0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.622+0000 7f491bfff640 1 -- 172.21.15.38:0/2690628244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491c144d10 msgr2=0x7f491c0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:41.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.622+0000 7f491affd640 1 --2- 172.21.15.38:0/2690628244 >> v2:172.21.15.89:3300/0 conn(0x7f491c0cc670 0x7f491c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.622+0000 7f491bfff640 1 --2- 172.21.15.38:0/2690628244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491c144d10 0x7f491c0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.622+0000 7f491bfff640 1 -- 172.21.15.38:0/2690628244 >> v2:172.21.15.89:3300/0 conn(0x7f491c0cc670 msgr2=0x7f491c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:41.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.622+0000 7f491bfff640 1 --2- 172.21.15.38:0/2690628244 >> v2:172.21.15.89:3300/0 conn(0x7f491c0cc670 0x7f491c0b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.622+0000 7f491bfff640 1 -- 172.21.15.38:0/2690628244 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0ce2f0 con 0x7f491c0b2590 2023-12-22T08:41:41.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.622+0000 7f491b7fe640 1 --2- 172.21.15.38:0/2690628244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491c144d10 0x7f491c0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:41.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.622+0000 7f491affd640 1 --2- 172.21.15.38:0/2690628244 >> v2:172.21.15.89:3300/0 conn(0x7f491c0cc670 0x7f491c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:41.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.623+0000 7f491bfff640 1 --2- 172.21.15.38:0/2690628244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f491c0b2590 0x7f491c15f040 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f491c0cfe80 tx=0x7f491402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40941460f13c8e3b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.624+0000 7f491a7fc640 1 -- 172.21.15.38:0/2690628244 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491402ca80 con 0x7f491c0b2590 2023-12-22T08:41:41.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.624+0000 7f491a7fc640 1 -- 172.21.15.38:0/2690628244 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491402cbe0 con 0x7f491c0b2590 2023-12-22T08:41:41.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.624+0000 7f491a7fc640 1 -- 172.21.15.38:0/2690628244 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49140343f0 con 0x7f491c0b2590 2023-12-22T08:41:41.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.624+0000 7f4921f92640 1 -- 172.21.15.38:0/2690628244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f491c0b2590 msgr2=0x7f491c15f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.624+0000 7f4921f92640 1 --2- 172.21.15.38:0/2690628244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f491c0b2590 0x7f491c15f040 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f491c0cfe80 tx=0x7f491402bee0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.624+0000 7f4921f92640 1 -- 172.21.15.38:0/2690628244 shutdown_connections 2023-12-22T08:41:41.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.624+0000 7f4921f92640 1 --2- 172.21.15.38:0/2690628244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f491c0b2590 0x7f491c15f040 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.624+0000 7f4921f92640 1 --2- 172.21.15.38:0/2690628244 >> v2:172.21.15.89:3300/0 conn(0x7f491c0cc670 0x7f491c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.624+0000 7f4921f92640 1 --2- 172.21.15.38:0/2690628244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491c144d10 0x7f491c0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.624+0000 7f4921f92640 1 -- 172.21.15.38:0/2690628244 >> 172.21.15.38:0/2690628244 conn(0x7f491c0cf070 msgr2=0x7f491c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:41.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.624+0000 7f4921f92640 1 -- 172.21.15.38:0/2690628244 shutdown_connections 2023-12-22T08:41:41.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.624+0000 7f4921f92640 1 -- 172.21.15.38:0/2690628244 wait complete. 2023-12-22T08:41:41.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.626+0000 7f4921f92640 1 Processor -- start 2023-12-22T08:41:41.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.626+0000 7f4921f92640 1 -- start start 2023-12-22T08:41:41.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.627+0000 7f4921f92640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491c0b2590 0x7f491c1377e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.627+0000 7f4921f92640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f491c144d10 0x7f491c1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.627+0000 7f4921f92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f491c158a30 0x7f491c1f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.627+0000 7f4921f92640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c06d9c0 con 0x7f491c144d10 2023-12-22T08:41:41.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.627+0000 7f4921f92640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c158ee0 con 0x7f491c158a30 2023-12-22T08:41:41.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.627+0000 7f4921f92640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c06cd40 con 0x7f491c0b2590 2023-12-22T08:41:41.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.627+0000 7f491affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f491c144d10 0x7f491c1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.628+0000 7f491affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f491c144d10 0x7f491c1584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50132/0 (socket says 172.21.15.38:50132) 2023-12-22T08:41:41.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.628+0000 7f491affd640 1 -- 172.21.15.38:0/3995896411 learned_addr learned my addr 172.21.15.38:0/3995896411 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:41.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.628+0000 7f491b7fe640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491c0b2590 0x7f491c1377e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.628+0000 7f491affd640 1 -- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491c0b2590 msgr2=0x7f491c1377e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.628+0000 7f491bfff640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f491c158a30 0x7f491c1f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.628+0000 7f491affd640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491c0b2590 0x7f491c1377e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.628+0000 7f491affd640 1 -- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f491c158a30 msgr2=0x7f491c1f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.628+0000 7f491affd640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f491c158a30 0x7f491c1f59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.628+0000 7f491affd640 1 -- 172.21.15.38:0/3995896411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4914009b30 con 0x7f491c144d10 2023-12-22T08:41:41.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.628+0000 7f491b7fe640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491c0b2590 0x7f491c1377e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:41.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.628+0000 7f491affd640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f491c144d10 0x7f491c1584f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f491000c7c0 tx=0x7f491000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.629+0000 7f4903fff640 1 -- 172.21.15.38:0/3995896411 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910007820 con 0x7f491c144d10 2023-12-22T08:41:41.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.629+0000 7f4903fff640 1 -- 172.21.15.38:0/3995896411 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4910007980 con 0x7f491c144d10 2023-12-22T08:41:41.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.629+0000 7f4903fff640 1 -- 172.21.15.38:0/3995896411 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910007d10 con 0x7f491c144d10 2023-12-22T08:41:41.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.629+0000 7f4921f92640 1 -- 172.21.15.38:0/3995896411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c06d020 con 0x7f491c144d10 2023-12-22T08:41:41.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.629+0000 7f4921f92640 1 -- 172.21.15.38:0/3995896411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c06d5e0 con 0x7f491c144d10 2023-12-22T08:41:41.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.630+0000 7f4921f92640 1 -- 172.21.15.38:0/3995896411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c06db00 con 0x7f491c144d10 2023-12-22T08:41:41.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.631+0000 7f4903fff640 1 -- 172.21.15.38:0/3995896411 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f49100113f0 con 0x7f491c144d10 2023-12-22T08:41:41.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.632+0000 7f4903fff640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f490806a430 0x7f490806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.632+0000 7f4903fff640 1 -- 172.21.15.38:0/3995896411 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4910088af0 con 0x7f491c144d10 2023-12-22T08:41:41.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.632+0000 7f491b7fe640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f490806a430 0x7f490806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.633+0000 7f491b7fe640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f490806a430 0x7f490806c8f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f490c006fd0 tx=0x7f490c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.636+0000 7f4903fff640 1 -- 172.21.15.38:0/3995896411 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f491c06db00 con 0x7f491c144d10 2023-12-22T08:41:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.867+0000 7f4921f92640 1 -- 172.21.15.38:0/3995896411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f491c06db00 con 0x7f491c144d10 2023-12-22T08:41:41.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.868+0000 7f4903fff640 1 -- 172.21.15.38:0/3995896411 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f491c06db00 con 0x7f491c144d10 2023-12-22T08:41:41.871 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:41.871 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1244935716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1244935716},{"type":"v1","addr":"172.21.15.89:6837","nonce":1244935716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/23463229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":23463229},{"type":"v1","addr":"172.21.15.38:6833","nonce":23463229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3876693609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3876693609},{"type":"v1","addr":"172.21.15.89:6836","nonce":3876693609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:41:14.062124+0000","modified":"2023-12-22T08:41:17.103814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.38:6835/2926436383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2926436383},{"type":"v1","addr":"172.21.15.38:6835","nonce":2926436383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-22T08:41:41.871 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 16 2023-12-22T08:41:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.870+0000 7f4921f92640 1 -- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f490806a430 msgr2=0x7f490806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.871+0000 7f4921f92640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f490806a430 0x7f490806c8f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f490c006fd0 tx=0x7f490c008040 comp rx=0 tx=0).stop 2023-12-22T08:41:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.871+0000 7f4921f92640 1 -- 172.21.15.38:0/3995896411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f491c144d10 msgr2=0x7f491c1584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.871+0000 7f4921f92640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f491c144d10 0x7f491c1584f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f491000c7c0 tx=0x7f491000cc80 comp rx=0 tx=0).stop 2023-12-22T08:41:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.871+0000 7f4921f92640 1 -- 172.21.15.38:0/3995896411 shutdown_connections 2023-12-22T08:41:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.871+0000 7f4921f92640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f491c158a30 0x7f491c1f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.871+0000 7f4921f92640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f490806a430 0x7f490806c8f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.871+0000 7f4921f92640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f491c144d10 0x7f491c1584f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.871+0000 7f4921f92640 1 --2- 172.21.15.38:0/3995896411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f491c0b2590 0x7f491c1377e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.871+0000 7f4921f92640 1 -- 172.21.15.38:0/3995896411 >> 172.21.15.38:0/3995896411 conn(0x7f491c0cf070 msgr2=0x7f491c0cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.871+0000 7f4921f92640 1 -- 172.21.15.38:0/3995896411 shutdown_connections 2023-12-22T08:41:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:41.871+0000 7f4921f92640 1 -- 172.21.15.38:0/3995896411 wait complete. 2023-12-22T08:41:41.893 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:42.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.114+0000 7f2a223c3640 1 Processor -- start 2023-12-22T08:41:42.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.115+0000 7f2a223c3640 1 -- start start 2023-12-22T08:41:42.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.118+0000 7f2a223c3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2a1c15d470 0x7f2a1c0b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.118+0000 7f2a223c3640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a1c0ac8e0 con 0x7f2a1c15d850 2023-12-22T08:41:42.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.118+0000 7f2a223c3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a1c0b4550 con 0x7f2a1c071ea0 2023-12-22T08:41:42.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.118+0000 7f2a223c3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a1c0ada40 con 0x7f2a1c15d470 2023-12-22T08:41:42.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.118+0000 7f2a1b7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2a1c15d850 0x7f2a1c0ad330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43650/0 (socket says 172.21.15.38:43650) 2023-12-22T08:41:42.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.118+0000 7f2a1b7fe640 1 -- 172.21.15.38:0/1385707542 learned_addr learned my addr 172.21.15.38:0/1385707542 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:42.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.118+0000 7f2a1bfff640 1 --2- 172.21.15.38:0/1385707542 >> v2:172.21.15.89:3300/0 conn(0x7f2a1c15d470 0x7f2a1c0b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.119+0000 7f2a1affd640 1 -- 172.21.15.38:0/1385707542 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828765491 0 0) 0x7f2a1c0ac8e0 con 0x7f2a1c15d850 2023-12-22T08:41:42.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.119+0000 7f2a1affd640 1 -- 172.21.15.38:0/1385707542 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a04003520 con 0x7f2a1c15d850 2023-12-22T08:41:42.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.119+0000 7f2a1bfff640 1 -- 172.21.15.38:0/1385707542 >> v1:172.21.15.89:6789/0 conn(0x7f2a1c071ea0 legacy=0x7f2a1c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.119+0000 7f2a1bfff640 1 -- 172.21.15.38:0/1385707542 >> v1:172.21.15.38:6789/0 conn(0x7f2a1c15d850 legacy=0x7f2a1c0ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.119+0000 7f2a1bfff640 1 -- 172.21.15.38:0/1385707542 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c0b4940 con 0x7f2a1c15d470 2023-12-22T08:41:42.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.121+0000 7f2a1bfff640 1 --2- 172.21.15.38:0/1385707542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a1c15d470 0x7f2a1c0b4010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0097a0 tx=0x7f2a0c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d75a208a5eb7b4ec server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.121+0000 7f2a1affd640 1 -- 172.21.15.38:0/1385707542 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c030610 con 0x7f2a1c15d470 2023-12-22T08:41:42.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.121+0000 7f2a1affd640 1 -- 172.21.15.38:0/1385707542 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c030770 con 0x7f2a1c15d470 2023-12-22T08:41:42.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.121+0000 7f2a1affd640 1 -- 172.21.15.38:0/1385707542 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c030b00 con 0x7f2a1c15d470 2023-12-22T08:41:42.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.122+0000 7f2a223c3640 1 -- 172.21.15.38:0/1385707542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a1c15d470 msgr2=0x7f2a1c0b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.122+0000 7f2a223c3640 1 --2- 172.21.15.38:0/1385707542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a1c15d470 0x7f2a1c0b4010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0097a0 tx=0x7f2a0c02b960 comp rx=0 tx=0).stop 2023-12-22T08:41:42.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.122+0000 7f2a223c3640 1 -- 172.21.15.38:0/1385707542 shutdown_connections 2023-12-22T08:41:42.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.122+0000 7f2a223c3640 1 --2- 172.21.15.38:0/1385707542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a1c15d470 0x7f2a1c0b4010 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.122+0000 7f2a223c3640 1 -- 172.21.15.38:0/1385707542 >> 172.21.15.38:0/1385707542 conn(0x7f2a1c0cf070 msgr2=0x7f2a1c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:42.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.122+0000 7f2a223c3640 1 -- 172.21.15.38:0/1385707542 shutdown_connections 2023-12-22T08:41:42.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.122+0000 7f2a223c3640 1 -- 172.21.15.38:0/1385707542 wait complete. 2023-12-22T08:41:42.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.124+0000 7f2a223c3640 1 Processor -- start 2023-12-22T08:41:42.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.124+0000 7f2a223c3640 1 -- start start 2023-12-22T08:41:42.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.125+0000 7f2a223c3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a1c071ea0 0x7f2a1c0cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.125+0000 7f2a223c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a1c15d470 0x7f2a1c0cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.125+0000 7f2a223c3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c15d850 0x7f2a1c159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.125+0000 7f2a223c3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c14bfa0 con 0x7f2a1c15d470 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.125+0000 7f2a223c3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c15c820 con 0x7f2a1c071ea0 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.125+0000 7f2a223c3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c15ddd0 con 0x7f2a1c15d850 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.125+0000 7f2a1b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a1c15d470 0x7f2a1c0cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.125+0000 7f2a1b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a1c15d470 0x7f2a1c0cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50146/0 (socket says 172.21.15.38:50146) 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.125+0000 7f2a1b7fe640 1 -- 172.21.15.38:0/2592797907 learned_addr learned my addr 172.21.15.38:0/2592797907 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.125+0000 7f2a1bfff640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a1c071ea0 0x7f2a1c0cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.126+0000 7f2a20960640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c15d850 0x7f2a1c159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.126+0000 7f2a1b7fe640 1 -- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c15d850 msgr2=0x7f2a1c159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.126+0000 7f2a1b7fe640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c15d850 0x7f2a1c159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.126+0000 7f2a1b7fe640 1 -- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a1c071ea0 msgr2=0x7f2a1c0cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.126+0000 7f2a1b7fe640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a1c071ea0 0x7f2a1c0cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.126+0000 7f2a1b7fe640 1 -- 172.21.15.38:0/2592797907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c009400 con 0x7f2a1c15d470 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.126+0000 7f2a1bfff640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a1c071ea0 0x7f2a1c0cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.126+0000 7f2a20960640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c15d850 0x7f2a1c159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.126+0000 7f2a1b7fe640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a1c15d470 0x7f2a1c0cdd30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000c410 tx=0x7f2a1000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.126+0000 7f2a18ff9640 1 -- 172.21.15.38:0/2592797907 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10005ce0 con 0x7f2a1c15d470 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.126+0000 7f2a18ff9640 1 -- 172.21.15.38:0/2592797907 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a10005e40 con 0x7f2a1c15d470 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.126+0000 7f2a18ff9640 1 -- 172.21.15.38:0/2592797907 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a100072f0 con 0x7f2a1c15d470 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.126+0000 7f2a223c3640 1 -- 172.21.15.38:0/2592797907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1c15e0b0 con 0x7f2a1c15d470 2023-12-22T08:41:42.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.127+0000 7f2a223c3640 1 -- 172.21.15.38:0/2592797907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1c15e670 con 0x7f2a1c15d470 2023-12-22T08:41:42.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.128+0000 7f2a223c3640 1 -- 172.21.15.38:0/2592797907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a1c061910 con 0x7f2a1c15d470 2023-12-22T08:41:42.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.129+0000 7f2a18ff9640 1 -- 172.21.15.38:0/2592797907 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2a10007510 con 0x7f2a1c15d470 2023-12-22T08:41:42.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.129+0000 7f2a18ff9640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a0806a430 0x7f2a0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.130+0000 7f2a18ff9640 1 -- 172.21.15.38:0/2592797907 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a10087f80 con 0x7f2a1c15d470 2023-12-22T08:41:42.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.130+0000 7f2a1bfff640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a0806a430 0x7f2a0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.131+0000 7f2a1bfff640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a0806a430 0x7f2a0806c8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c036000 tx=0x7f2a0c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.134+0000 7f2a18ff9640 1 -- 172.21.15.38:0/2592797907 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2a10053620 con 0x7f2a1c15d470 2023-12-22T08:41:42.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.328+0000 7f2a223c3640 1 -- 172.21.15.38:0/2592797907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a1c160f20 con 0x7f2a1c15d470 2023-12-22T08:41:42.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.331+0000 7f2a18ff9640 1 -- 172.21.15.38:0/2592797907 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f2a10056c40 con 0x7f2a1c15d470 2023-12-22T08:41:42.334 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:42.334 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":36,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:41:33.206742+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:12.357679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:13.069596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.334+0000 7f2a223c3640 1 -- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a0806a430 msgr2=0x7f2a0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.334+0000 7f2a223c3640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a0806a430 0x7f2a0806c8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c036000 tx=0x7f2a0c03b040 comp rx=0 tx=0).stop 2023-12-22T08:41:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.334+0000 7f2a223c3640 1 -- 172.21.15.38:0/2592797907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a1c15d470 msgr2=0x7f2a1c0cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.334+0000 7f2a223c3640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a1c15d470 0x7f2a1c0cdd30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000c410 tx=0x7f2a1000c8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.334+0000 7f2a223c3640 1 -- 172.21.15.38:0/2592797907 shutdown_connections 2023-12-22T08:41:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.334+0000 7f2a223c3640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a1c15d850 0x7f2a1c159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.334+0000 7f2a223c3640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a0806a430 0x7f2a0806c8f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.334+0000 7f2a223c3640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a1c15d470 0x7f2a1c0cdd30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.334+0000 7f2a223c3640 1 --2- 172.21.15.38:0/2592797907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a1c071ea0 0x7f2a1c0cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.334+0000 7f2a223c3640 1 -- 172.21.15.38:0/2592797907 >> 172.21.15.38:0/2592797907 conn(0x7f2a1c0cf070 msgr2=0x7f2a1c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.334+0000 7f2a223c3640 1 -- 172.21.15.38:0/2592797907 shutdown_connections 2023-12-22T08:41:42.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.334+0000 7f2a223c3640 1 -- 172.21.15.38:0/2592797907 wait complete. 2023-12-22T08:41:42.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:41:12.357679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:41:13.069596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:42.358 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:42.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.582+0000 7f2c2688a640 1 Processor -- start 2023-12-22T08:41:42.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.582+0000 7f2c2688a640 1 -- start start 2023-12-22T08:41:42.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.584+0000 7f2c2688a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2c20163d50 0x7f2c20166140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.584+0000 7f2c2688a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2006d5f0 con 0x7f2c20070b70 2023-12-22T08:41:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.584+0000 7f2c2688a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c20144fa0 con 0x7f2c20070f50 2023-12-22T08:41:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.584+0000 7f2c2688a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2006da80 con 0x7f2c20163d50 2023-12-22T08:41:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.585+0000 7f2c25888640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2c20070b70 0x7f2c2006bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43664/0 (socket says 172.21.15.38:43664) 2023-12-22T08:41:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.585+0000 7f2c25888640 1 -- 172.21.15.38:0/1545271018 learned_addr learned my addr 172.21.15.38:0/1545271018 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.585+0000 7f2c26089640 1 --2- 172.21.15.38:0/1545271018 >> v2:172.21.15.38:3300/0 conn(0x7f2c20163d50 0x7f2c20166140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.585+0000 7f2c24886640 1 -- 172.21.15.38:0/1545271018 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420478365 0 0) 0x7f2c2006d5f0 con 0x7f2c20070b70 2023-12-22T08:41:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.585+0000 7f2c24886640 1 -- 172.21.15.38:0/1545271018 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c0c003520 con 0x7f2c20070b70 2023-12-22T08:41:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.585+0000 7f2c24886640 1 -- 172.21.15.38:0/1545271018 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611732197 0 0) 0x7f2c20144fa0 con 0x7f2c20070f50 2023-12-22T08:41:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.585+0000 7f2c24886640 1 -- 172.21.15.38:0/1545271018 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c2006d5f0 con 0x7f2c20070f50 2023-12-22T08:41:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.586+0000 7f2c26089640 1 -- 172.21.15.38:0/1545271018 >> v1:172.21.15.89:6789/0 conn(0x7f2c20070f50 legacy=0x7f2c200713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.586+0000 7f2c26089640 1 -- 172.21.15.38:0/1545271018 >> v1:172.21.15.38:6789/0 conn(0x7f2c20070b70 legacy=0x7f2c2006bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.586+0000 7f2c26089640 1 -- 172.21.15.38:0/1545271018 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2006c9e0 con 0x7f2c20163d50 2023-12-22T08:41:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.587+0000 7f2c26089640 1 --2- 172.21.15.38:0/1545271018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c20163d50 0x7f2c20166140 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009d90 tx=0x7f2c1802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e320df037b5d9a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.587+0000 7f2c24886640 1 -- 172.21.15.38:0/1545271018 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1802cd00 con 0x7f2c20163d50 2023-12-22T08:41:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.587+0000 7f2c24886640 1 -- 172.21.15.38:0/1545271018 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1802ce60 con 0x7f2c20163d50 2023-12-22T08:41:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.587+0000 7f2c24886640 1 -- 172.21.15.38:0/1545271018 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18034660 con 0x7f2c20163d50 2023-12-22T08:41:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.588+0000 7f2c2688a640 1 -- 172.21.15.38:0/1545271018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c20163d50 msgr2=0x7f2c20166140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.588+0000 7f2c2688a640 1 --2- 172.21.15.38:0/1545271018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c20163d50 0x7f2c20166140 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009d90 tx=0x7f2c1802bf50 comp rx=0 tx=0).stop 2023-12-22T08:41:42.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.588+0000 7f2c2688a640 1 -- 172.21.15.38:0/1545271018 shutdown_connections 2023-12-22T08:41:42.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.588+0000 7f2c2688a640 1 --2- 172.21.15.38:0/1545271018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c20163d50 0x7f2c20166140 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.588+0000 7f2c2688a640 1 -- 172.21.15.38:0/1545271018 >> 172.21.15.38:0/1545271018 conn(0x7f2c200b0b60 msgr2=0x7f2c200b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:42.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.588+0000 7f2c2688a640 1 -- 172.21.15.38:0/1545271018 shutdown_connections 2023-12-22T08:41:42.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.588+0000 7f2c2688a640 1 -- 172.21.15.38:0/1545271018 wait complete. 2023-12-22T08:41:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.590+0000 7f2c2688a640 1 Processor -- start 2023-12-22T08:41:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.590+0000 7f2c2688a640 1 -- start start 2023-12-22T08:41:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.591+0000 7f2c2688a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c20070b70 0x7f2c201405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.591+0000 7f2c2688a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c20070f50 0x7f2c20143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.591+0000 7f2c2688a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c20163d50 0x7f2c201f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.591+0000 7f2c2688a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c201424f0 con 0x7f2c20163d50 2023-12-22T08:41:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.591+0000 7f2c2688a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c20140bc0 con 0x7f2c20070f50 2023-12-22T08:41:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.591+0000 7f2c2688a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c20140ea0 con 0x7f2c20070b70 2023-12-22T08:41:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.591+0000 7f2c26089640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c20163d50 0x7f2c201f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.591+0000 7f2c26089640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c20163d50 0x7f2c201f56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50166/0 (socket says 172.21.15.38:50166) 2023-12-22T08:41:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.591+0000 7f2c26089640 1 -- 172.21.15.38:0/531321697 learned_addr learned my addr 172.21.15.38:0/531321697 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:42.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.592+0000 7f2c25888640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c20070b70 0x7f2c201405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.592+0000 7f2c25087640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c20070f50 0x7f2c20143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.592+0000 7f2c26089640 1 -- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c20070b70 msgr2=0x7f2c201405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.592+0000 7f2c26089640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c20070b70 0x7f2c201405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.592+0000 7f2c26089640 1 -- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c20070f50 msgr2=0x7f2c20143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.592+0000 7f2c26089640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c20070f50 0x7f2c20143110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.592+0000 7f2c26089640 1 -- 172.21.15.38:0/531321697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c18009a70 con 0x7f2c20163d50 2023-12-22T08:41:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.592+0000 7f2c25888640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c20070b70 0x7f2c201405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.592+0000 7f2c26089640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c20163d50 0x7f2c201f56b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009d90 tx=0x7f2c18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.593+0000 7f2c167fc640 1 -- 172.21.15.38:0/531321697 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1803d600 con 0x7f2c20163d50 2023-12-22T08:41:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.593+0000 7f2c167fc640 1 -- 172.21.15.38:0/531321697 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1803d780 con 0x7f2c20163d50 2023-12-22T08:41:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.593+0000 7f2c167fc640 1 -- 172.21.15.38:0/531321697 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1803db30 con 0x7f2c20163d50 2023-12-22T08:41:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.593+0000 7f2c2688a640 1 -- 172.21.15.38:0/531321697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c20141180 con 0x7f2c20163d50 2023-12-22T08:41:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.593+0000 7f2c2688a640 1 -- 172.21.15.38:0/531321697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c20141740 con 0x7f2c20163d50 2023-12-22T08:41:42.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.594+0000 7f2c2688a640 1 -- 172.21.15.38:0/531321697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c20061910 con 0x7f2c20163d50 2023-12-22T08:41:42.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.595+0000 7f2c167fc640 1 -- 172.21.15.38:0/531321697 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2c1803b040 con 0x7f2c20163d50 2023-12-22T08:41:42.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.596+0000 7f2c167fc640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2c0406a480 0x7f2c0406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.596+0000 7f2c167fc640 1 -- 172.21.15.38:0/531321697 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c180aad30 con 0x7f2c20163d50 2023-12-22T08:41:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.597+0000 7f2c25888640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2c0406a480 0x7f2c0406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.598+0000 7f2c25888640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2c0406a480 0x7f2c0406c940 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c007fd0 tx=0x7f2c1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.600+0000 7f2c167fc640 1 -- 172.21.15.38:0/531321697 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2c180763b0 con 0x7f2c20163d50 2023-12-22T08:41:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.795+0000 7f2c2688a640 1 -- 172.21.15.38:0/531321697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c200ad3d0 con 0x7f2c20163d50 2023-12-22T08:41:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.796+0000 7f2c167fc640 1 -- 172.21.15.38:0/531321697 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c1804e020 con 0x7f2c20163d50 2023-12-22T08:41:42.798 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:41:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.798+0000 7f2c2688a640 1 -- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2c0406a480 msgr2=0x7f2c0406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.798+0000 7f2c2688a640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2c0406a480 0x7f2c0406c940 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c007fd0 tx=0x7f2c1c009040 comp rx=0 tx=0).stop 2023-12-22T08:41:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.798+0000 7f2c2688a640 1 -- 172.21.15.38:0/531321697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c20163d50 msgr2=0x7f2c201f56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.798+0000 7f2c2688a640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c20163d50 0x7f2c201f56b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009d90 tx=0x7f2c18004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.799+0000 7f2c2688a640 1 -- 172.21.15.38:0/531321697 shutdown_connections 2023-12-22T08:41:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.799+0000 7f2c2688a640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2c0406a480 0x7f2c0406c940 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.799+0000 7f2c2688a640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c20163d50 0x7f2c201f56b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.799+0000 7f2c2688a640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c20070f50 0x7f2c20143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.799+0000 7f2c2688a640 1 --2- 172.21.15.38:0/531321697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c20070b70 0x7f2c201405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.799+0000 7f2c2688a640 1 -- 172.21.15.38:0/531321697 >> 172.21.15.38:0/531321697 conn(0x7f2c200b0b60 msgr2=0x7f2c2013fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.799+0000 7f2c2688a640 1 -- 172.21.15.38:0/531321697 shutdown_connections 2023-12-22T08:41:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:42.799+0000 7f2c2688a640 1 -- 172.21.15.38:0/531321697 wait complete. 2023-12-22T08:41:42.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:41:43.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.051+0000 7f45a9a38640 1 Processor -- start 2023-12-22T08:41:43.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.051+0000 7f45a9a38640 1 -- start start 2023-12-22T08:41:43.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.053+0000 7f45a9a38640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f45a40b3f90 0x7f45a415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.053+0000 7f45a9a38640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45a406ca50 0x7f45a4070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.053+0000 7f45a9a38640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a415eb20 con 0x7f45a415e740 2023-12-22T08:41:43.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.053+0000 7f45a9a38640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a406e650 con 0x7f45a40b3f90 2023-12-22T08:41:43.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.053+0000 7f45a9a38640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4070770 con 0x7f45a406ca50 2023-12-22T08:41:43.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.053+0000 7f45a2ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f45a415e740 0x7f45a40b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43672/0 (socket says 172.21.15.38:43672) 2023-12-22T08:41:43.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.053+0000 7f45a2ffd640 1 -- 172.21.15.38:0/608187451 learned_addr learned my addr 172.21.15.38:0/608187451 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.054+0000 7f45a27fc640 1 --2- 172.21.15.38:0/608187451 >> v2:172.21.15.89:3300/0 conn(0x7f45a40b3f90 0x7f45a415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.054+0000 7f45a37fe640 1 --2- 172.21.15.38:0/608187451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45a406ca50 0x7f45a4070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.054+0000 7f45a1ffb640 1 -- 172.21.15.38:0/608187451 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644556503 0 0) 0x7f45a415eb20 con 0x7f45a415e740 2023-12-22T08:41:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.054+0000 7f45a1ffb640 1 -- 172.21.15.38:0/608187451 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4590003520 con 0x7f45a415e740 2023-12-22T08:41:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.055+0000 7f45a1ffb640 1 -- 172.21.15.38:0/608187451 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 962983382 0 0) 0x7f4590003520 con 0x7f45a415e740 2023-12-22T08:41:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.055+0000 7f45a27fc640 1 -- 172.21.15.38:0/608187451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45a406ca50 msgr2=0x7f45a4070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.055+0000 7f45a27fc640 1 --2- 172.21.15.38:0/608187451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45a406ca50 0x7f45a4070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.055+0000 7f45a27fc640 1 -- 172.21.15.38:0/608187451 >> v1:172.21.15.38:6789/0 conn(0x7f45a415e740 legacy=0x7f45a40b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.055+0000 7f45a27fc640 1 -- 172.21.15.38:0/608187451 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a406d180 con 0x7f45a40b3f90 2023-12-22T08:41:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.056+0000 7f45a27fc640 1 --2- 172.21.15.38:0/608187451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45a40b3f90 0x7f45a415db30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f458c009d90 tx=0x7f458c02bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1ade3c8d7d6768c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.057+0000 7f45a1ffb640 1 -- 172.21.15.38:0/608187451 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594001670 con 0x7f45a40b3f90 2023-12-22T08:41:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.057+0000 7f45a1ffb640 1 -- 172.21.15.38:0/608187451 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c02c780 con 0x7f45a40b3f90 2023-12-22T08:41:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.057+0000 7f45a1ffb640 1 -- 172.21.15.38:0/608187451 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c02caf0 con 0x7f45a40b3f90 2023-12-22T08:41:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.057+0000 7f45a9a38640 1 -- 172.21.15.38:0/608187451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45a40b3f90 msgr2=0x7f45a415db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.057+0000 7f45a9a38640 1 --2- 172.21.15.38:0/608187451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45a40b3f90 0x7f45a415db30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f458c009d90 tx=0x7f458c02bc50 comp rx=0 tx=0).stop 2023-12-22T08:41:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.058+0000 7f45a9a38640 1 -- 172.21.15.38:0/608187451 shutdown_connections 2023-12-22T08:41:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.058+0000 7f45a9a38640 1 --2- 172.21.15.38:0/608187451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45a406ca50 0x7f45a4070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.058+0000 7f45a9a38640 1 --2- 172.21.15.38:0/608187451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45a40b3f90 0x7f45a415db30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.058+0000 7f45a9a38640 1 -- 172.21.15.38:0/608187451 >> 172.21.15.38:0/608187451 conn(0x7f45a40cfea0 msgr2=0x7f45a40d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.058+0000 7f45a9a38640 1 -- 172.21.15.38:0/608187451 shutdown_connections 2023-12-22T08:41:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.058+0000 7f45a9a38640 1 -- 172.21.15.38:0/608187451 wait complete. 2023-12-22T08:41:43.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.059+0000 7f45a9a38640 1 Processor -- start 2023-12-22T08:41:43.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.060+0000 7f45a9a38640 1 -- start start 2023-12-22T08:41:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.060+0000 7f45a9a38640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45a406ca50 0x7f45a4149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.060+0000 7f45a9a38640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45a40b3f90 0x7f45a41f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a9a38640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45a415e740 0x7f45a40ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a9a38640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a414a3e0 con 0x7f45a406ca50 2023-12-22T08:41:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a9a38640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a40d22f0 con 0x7f45a415e740 2023-12-22T08:41:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a9a38640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a41f6c60 con 0x7f45a40b3f90 2023-12-22T08:41:43.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45a406ca50 0x7f45a4149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45a406ca50 0x7f45a4149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50178/0 (socket says 172.21.15.38:50178) 2023-12-22T08:41:43.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a2ffd640 1 -- 172.21.15.38:0/2768871947 learned_addr learned my addr 172.21.15.38:0/2768871947 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:43.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a37fe640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45a415e740 0x7f45a40ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a27fc640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45a40b3f90 0x7f45a41f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a2ffd640 1 -- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45a40b3f90 msgr2=0x7f45a41f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a2ffd640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45a40b3f90 0x7f45a41f6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a2ffd640 1 -- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45a415e740 msgr2=0x7f45a40ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a2ffd640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45a415e740 0x7f45a40ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.061+0000 7f45a2ffd640 1 -- 172.21.15.38:0/2768871947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c009a70 con 0x7f45a406ca50 2023-12-22T08:41:43.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.062+0000 7f45a2ffd640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45a406ca50 0x7f45a4149ea0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f459400c750 tx=0x7f459400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.062+0000 7f459bfff640 1 -- 172.21.15.38:0/2768871947 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594005ad0 con 0x7f45a406ca50 2023-12-22T08:41:43.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.062+0000 7f459bfff640 1 -- 172.21.15.38:0/2768871947 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4594005c50 con 0x7f45a406ca50 2023-12-22T08:41:43.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.062+0000 7f45a9a38640 1 -- 172.21.15.38:0/2768871947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a40d2500 con 0x7f45a406ca50 2023-12-22T08:41:43.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.062+0000 7f459bfff640 1 -- 172.21.15.38:0/2768871947 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594007070 con 0x7f45a406ca50 2023-12-22T08:41:43.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.062+0000 7f45a9a38640 1 -- 172.21.15.38:0/2768871947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a41f3c60 con 0x7f45a406ca50 2023-12-22T08:41:43.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.063+0000 7f45a9a38640 1 -- 172.21.15.38:0/2768871947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a406d720 con 0x7f45a406ca50 2023-12-22T08:41:43.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.064+0000 7f459bfff640 1 -- 172.21.15.38:0/2768871947 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f45940071d0 con 0x7f45a406ca50 2023-12-22T08:41:43.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.066+0000 7f459bfff640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f458406a460 0x7f458406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.066+0000 7f459bfff640 1 -- 172.21.15.38:0/2768871947 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45940886c0 con 0x7f45a406ca50 2023-12-22T08:41:43.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.066+0000 7f45a27fc640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f458406a460 0x7f458406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.067+0000 7f45a27fc640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f458406a460 0x7f458406c920 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f458c036000 tx=0x7f458c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.070+0000 7f459bfff640 1 -- 172.21.15.38:0/2768871947 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f45a406d720 con 0x7f45a406ca50 2023-12-22T08:41:43.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.266+0000 7f45a9a38640 1 -- 172.21.15.38:0/2768871947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45a406d720 con 0x7f45a406ca50 2023-12-22T08:41:43.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.267+0000 7f459bfff640 1 -- 172.21.15.38:0/2768871947 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45a406d720 con 0x7f45a406ca50 2023-12-22T08:41:43.273 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:41:43.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.270+0000 7f45a9a38640 1 -- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f458406a460 msgr2=0x7f458406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.270+0000 7f45a9a38640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f458406a460 0x7f458406c920 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f458c036000 tx=0x7f458c030000 comp rx=0 tx=0).stop 2023-12-22T08:41:43.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.270+0000 7f45a9a38640 1 -- 172.21.15.38:0/2768871947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45a406ca50 msgr2=0x7f45a4149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.270+0000 7f45a9a38640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45a406ca50 0x7f45a4149ea0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f459400c750 tx=0x7f459400cc10 comp rx=0 tx=0).stop 2023-12-22T08:41:43.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.270+0000 7f45a9a38640 1 -- 172.21.15.38:0/2768871947 shutdown_connections 2023-12-22T08:41:43.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.270+0000 7f45a9a38640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45a415e740 0x7f45a40ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.270+0000 7f45a9a38640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45a40b3f90 0x7f45a41f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.270+0000 7f45a9a38640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f458406a460 0x7f458406c920 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.270+0000 7f45a9a38640 1 --2- 172.21.15.38:0/2768871947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45a406ca50 0x7f45a4149ea0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.270+0000 7f45a9a38640 1 -- 172.21.15.38:0/2768871947 >> 172.21.15.38:0/2768871947 conn(0x7f45a40cfea0 msgr2=0x7f45a4159040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.270+0000 7f45a9a38640 1 -- 172.21.15.38:0/2768871947 shutdown_connections 2023-12-22T08:41:43.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.270+0000 7f45a9a38640 1 -- 172.21.15.38:0/2768871947 wait complete. 2023-12-22T08:41:43.295 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:41:43.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.525+0000 7f4dba9c1640 1 Processor -- start 2023-12-22T08:41:43.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.525+0000 7f4dba9c1640 1 -- start start 2023-12-22T08:41:43.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.527+0000 7f4dba9c1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4db4163d50 0x7f4db4166140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.527+0000 7f4dba9c1640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db406d5f0 con 0x7f4db4070b70 2023-12-22T08:41:43.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.527+0000 7f4dba9c1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db4144fa0 con 0x7f4db4070f50 2023-12-22T08:41:43.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.527+0000 7f4dba9c1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db406da80 con 0x7f4db4163d50 2023-12-22T08:41:43.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.527+0000 7f4db99bf640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4db4070b70 0x7f4db406bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43686/0 (socket says 172.21.15.38:43686) 2023-12-22T08:41:43.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.527+0000 7f4db99bf640 1 -- 172.21.15.38:0/3948785238 learned_addr learned my addr 172.21.15.38:0/3948785238 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:43.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.528+0000 7f4dba1c0640 1 --2- 172.21.15.38:0/3948785238 >> v2:172.21.15.89:3300/0 conn(0x7f4db4163d50 0x7f4db4166140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.528+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803204107 0 0) 0x7f4db406d5f0 con 0x7f4db4070b70 2023-12-22T08:41:43.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.528+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4da0003520 con 0x7f4db4070b70 2023-12-22T08:41:43.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.528+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3462717238 0 0) 0x7f4da0003520 con 0x7f4db4070b70 2023-12-22T08:41:43.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.528+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 >> v2:172.21.15.89:3300/0 conn(0x7f4db4163d50 msgr2=0x7f4db4166140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:43.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.528+0000 7f4db89bd640 1 --2- 172.21.15.38:0/3948785238 >> v2:172.21.15.89:3300/0 conn(0x7f4db4163d50 0x7f4db4166140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.528+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 >> v1:172.21.15.89:6789/0 conn(0x7f4db4070f50 legacy=0x7f4db40713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.528+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db406c9e0 con 0x7f4db4070b70 2023-12-22T08:41:43.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.528+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f4db0001670 con 0x7f4db4070b70 2023-12-22T08:41:43.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.528+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 >> v1:172.21.15.38:6789/0 conn(0x7f4db4070b70 legacy=0x7f4db406bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.528+0000 7f4db89bd640 1 --2- 172.21.15.38:0/3948785238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4da00039c0 0x7f4da0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.528+0000 7f4db89bd640 1 --2- 172.21.15.38:0/3948785238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da00047c0 0x7f4da0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.529+0000 7f4db89bd640 1 --2- 172.21.15.38:0/3948785238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da0005180 0x7f4da000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.529+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db406da80 con 0x7f4da00039c0 2023-12-22T08:41:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.529+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da000c080 con 0x7f4da0005180 2023-12-22T08:41:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.529+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da000c240 con 0x7f4da00047c0 2023-12-22T08:41:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.529+0000 7f4db99bf640 1 --2- 172.21.15.38:0/3948785238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4da00039c0 0x7f4da0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.529+0000 7f4dba1c0640 1 --2- 172.21.15.38:0/3948785238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da0005180 0x7f4da000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.529+0000 7f4db91be640 1 --2- 172.21.15.38:0/3948785238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da00047c0 0x7f4da0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.529+0000 7f4db99bf640 1 -- 172.21.15.38:0/3948785238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da00047c0 msgr2=0x7f4da0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.529+0000 7f4db99bf640 1 --2- 172.21.15.38:0/3948785238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da00047c0 0x7f4da0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.529+0000 7f4db99bf640 1 -- 172.21.15.38:0/3948785238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da0005180 msgr2=0x7f4da000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.529+0000 7f4db99bf640 1 --2- 172.21.15.38:0/3948785238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da0005180 0x7f4da000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.529+0000 7f4db99bf640 1 -- 172.21.15.38:0/3948785238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da0003520 con 0x7f4da00039c0 2023-12-22T08:41:43.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.529+0000 7f4dba1c0640 1 -- 172.21.15.38:0/3948785238 reap_dead start 2023-12-22T08:41:43.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.530+0000 7f4db99bf640 1 --2- 172.21.15.38:0/3948785238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4da00039c0 0x7f4da0003de0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4db000c0e0 tx=0x7f4da00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffccf6385341ee5b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.531+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0005ad0 con 0x7f4da00039c0 2023-12-22T08:41:43.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.531+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db0005c30 con 0x7f4da00039c0 2023-12-22T08:41:43.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.531+0000 7f4db89bd640 1 -- 172.21.15.38:0/3948785238 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db002ca50 con 0x7f4da00039c0 2023-12-22T08:41:43.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.531+0000 7f4dba9c1640 1 -- 172.21.15.38:0/3948785238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4da00039c0 msgr2=0x7f4da0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.531+0000 7f4dba9c1640 1 --2- 172.21.15.38:0/3948785238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4da00039c0 0x7f4da0003de0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4db000c0e0 tx=0x7f4da00057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.531+0000 7f4dba9c1640 1 -- 172.21.15.38:0/3948785238 shutdown_connections 2023-12-22T08:41:43.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.531+0000 7f4dba9c1640 1 --2- 172.21.15.38:0/3948785238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4da00039c0 0x7f4da0003de0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.531+0000 7f4dba9c1640 1 -- 172.21.15.38:0/3948785238 >> 172.21.15.38:0/3948785238 conn(0x7f4db40b0b60 msgr2=0x7f4db40b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.531+0000 7f4dba9c1640 1 -- 172.21.15.38:0/3948785238 shutdown_connections 2023-12-22T08:41:43.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.531+0000 7f4dba9c1640 1 -- 172.21.15.38:0/3948785238 wait complete. 2023-12-22T08:41:43.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.533+0000 7f4dba9c1640 1 Processor -- start 2023-12-22T08:41:43.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.533+0000 7f4dba9c1640 1 -- start start 2023-12-22T08:41:43.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.534+0000 7f4dba9c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da00039c0 0x7f4db4154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.534+0000 7f4dba9c1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4158620 0x7f4db4158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.534+0000 7f4dba9c1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4db41564d0 0x7f4db4156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.534+0000 7f4dba9c1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db4156e90 con 0x7f4db4158620 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.534+0000 7f4dba9c1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db413bfc0 con 0x7f4da00039c0 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.534+0000 7f4dba9c1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db413cb40 con 0x7f4db41564d0 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.535+0000 7f4db91be640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4158620 0x7f4db4158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.535+0000 7f4db91be640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4158620 0x7f4db4158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50202/0 (socket says 172.21.15.38:50202) 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.535+0000 7f4db91be640 1 -- 172.21.15.38:0/1122651905 learned_addr learned my addr 172.21.15.38:0/1122651905 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.535+0000 7f4db99bf640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da00039c0 0x7f4db4154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.535+0000 7f4db91be640 1 -- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4db41564d0 msgr2=0x7f4db4156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.535+0000 7f4dba1c0640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4db41564d0 0x7f4db4156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.535+0000 7f4db91be640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4db41564d0 0x7f4db4156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.535+0000 7f4db91be640 1 -- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da00039c0 msgr2=0x7f4db4154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.535+0000 7f4db91be640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da00039c0 0x7f4db4154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.535+0000 7f4db91be640 1 -- 172.21.15.38:0/1122651905 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db415c0b0 con 0x7f4db4158620 2023-12-22T08:41:43.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.535+0000 7f4db99bf640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da00039c0 0x7f4db4154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:43.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.535+0000 7f4db91be640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4158620 0x7f4db4158aa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4da400d4d0 tx=0x7f4da400d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.536+0000 7f4daa7fc640 1 -- 172.21.15.38:0/1122651905 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4005480 con 0x7f4db4158620 2023-12-22T08:41:43.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.536+0000 7f4daa7fc640 1 -- 172.21.15.38:0/1122651905 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da4003610 con 0x7f4db4158620 2023-12-22T08:41:43.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.536+0000 7f4daa7fc640 1 -- 172.21.15.38:0/1122651905 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40039a0 con 0x7f4db4158620 2023-12-22T08:41:43.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.536+0000 7f4dba9c1640 1 -- 172.21.15.38:0/1122651905 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db4154d40 con 0x7f4db4158620 2023-12-22T08:41:43.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.536+0000 7f4dba9c1640 1 -- 172.21.15.38:0/1122651905 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db413c4f0 con 0x7f4db4158620 2023-12-22T08:41:43.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.537+0000 7f4dba9c1640 1 -- 172.21.15.38:0/1122651905 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db4061910 con 0x7f4db4158620 2023-12-22T08:41:43.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.538+0000 7f4daa7fc640 1 -- 172.21.15.38:0/1122651905 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4da4003b00 con 0x7f4db4158620 2023-12-22T08:41:43.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.539+0000 7f4daa7fc640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d9806a460 0x7f4d9806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.539+0000 7f4daa7fc640 1 -- 172.21.15.38:0/1122651905 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4da4088320 con 0x7f4db4158620 2023-12-22T08:41:43.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.540+0000 7f4db99bf640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d9806a460 0x7f4d9806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.541+0000 7f4db99bf640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d9806a460 0x7f4d9806c920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4db0034000 tx=0x7f4db0009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.543+0000 7f4daa7fc640 1 -- 172.21.15.38:0/1122651905 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4da40539b0 con 0x7f4db4158620 2023-12-22T08:41:43.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.738+0000 7f4dba9c1640 1 -- 172.21.15.38:0/1122651905 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4db413cc80 con 0x7f4db4158620 2023-12-22T08:41:43.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.739+0000 7f4daa7fc640 1 -- 172.21.15.38:0/1122651905 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4da4003db0 con 0x7f4db4158620 2023-12-22T08:41:43.742 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:41:43.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.741+0000 7f4dba9c1640 1 -- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d9806a460 msgr2=0x7f4d9806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.741+0000 7f4dba9c1640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d9806a460 0x7f4d9806c920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4db0034000 tx=0x7f4db0009030 comp rx=0 tx=0).stop 2023-12-22T08:41:43.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.741+0000 7f4dba9c1640 1 -- 172.21.15.38:0/1122651905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4158620 msgr2=0x7f4db4158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.741+0000 7f4dba9c1640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4158620 0x7f4db4158aa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4da400d4d0 tx=0x7f4da400d990 comp rx=0 tx=0).stop 2023-12-22T08:41:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.741+0000 7f4dba9c1640 1 -- 172.21.15.38:0/1122651905 shutdown_connections 2023-12-22T08:41:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.741+0000 7f4dba9c1640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4db41564d0 0x7f4db4156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.741+0000 7f4dba9c1640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d9806a460 0x7f4d9806c920 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.741+0000 7f4dba9c1640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db4158620 0x7f4db4158aa0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.741+0000 7f4dba9c1640 1 --2- 172.21.15.38:0/1122651905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da00039c0 0x7f4db4154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.742+0000 7f4dba9c1640 1 -- 172.21.15.38:0/1122651905 >> 172.21.15.38:0/1122651905 conn(0x7f4db40b0b60 msgr2=0x7f4db415acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.742+0000 7f4dba9c1640 1 -- 172.21.15.38:0/1122651905 shutdown_connections 2023-12-22T08:41:43.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.742+0000 7f4dba9c1640 1 -- 172.21.15.38:0/1122651905 wait complete. 2023-12-22T08:41:43.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:43.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.991+0000 7fe085e15640 1 Processor -- start 2023-12-22T08:41:43.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.991+0000 7fe085e15640 1 -- start start 2023-12-22T08:41:43.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.992+0000 7fe085e15640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe08015b420 0x7fe08006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.992+0000 7fe085e15640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe0800a44a0 0x7fe0800708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.992+0000 7fe085e15640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0800cdae0 con 0x7fe080070e30 2023-12-22T08:41:43.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.992+0000 7fe085e15640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08006dec0 con 0x7fe0800a44a0 2023-12-22T08:41:43.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.992+0000 7fe085e15640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe080071250 con 0x7fe08015b420 2023-12-22T08:41:43.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.993+0000 7fe07ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe0800a44a0 0x7fe0800708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.993+0000 7fe085614640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe080070e30 0x7fe08006f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43700/0 (socket says 172.21.15.38:43700) 2023-12-22T08:41:43.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.993+0000 7fe085614640 1 -- 172.21.15.38:0/687700735 learned_addr learned my addr 172.21.15.38:0/687700735 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:43.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.993+0000 7fe084e13640 1 --2- 172.21.15.38:0/687700735 >> v2:172.21.15.89:3300/0 conn(0x7fe08015b420 0x7fe08006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.993+0000 7fe07ffff640 1 -- 172.21.15.38:0/687700735 >> v2:172.21.15.89:3300/0 conn(0x7fe08015b420 msgr2=0x7fe08006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:43.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.993+0000 7fe07ffff640 1 --2- 172.21.15.38:0/687700735 >> v2:172.21.15.89:3300/0 conn(0x7fe08015b420 0x7fe08006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.993+0000 7fe07ffff640 1 -- 172.21.15.38:0/687700735 >> v1:172.21.15.38:6789/0 conn(0x7fe080070e30 legacy=0x7fe08006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.993+0000 7fe07f7fe640 1 -- 172.21.15.38:0/687700735 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82824053 0 0) 0x7fe0800cdae0 con 0x7fe080070e30 2023-12-22T08:41:43.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.993+0000 7fe07ffff640 1 -- 172.21.15.38:0/687700735 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08015b800 con 0x7fe0800a44a0 2023-12-22T08:41:43.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.995+0000 7fe07ffff640 1 --2- 172.21.15.38:0/687700735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0800a44a0 0x7fe0800708f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe0800613e0 tx=0x7fe06c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325f11cd3598c9e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.995+0000 7fe07f7fe640 1 -- 172.21.15.38:0/687700735 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c031830 con 0x7fe0800a44a0 2023-12-22T08:41:43.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.995+0000 7fe07f7fe640 1 -- 172.21.15.38:0/687700735 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c031990 con 0x7fe0800a44a0 2023-12-22T08:41:43.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.995+0000 7fe07f7fe640 1 -- 172.21.15.38:0/687700735 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c031d20 con 0x7fe0800a44a0 2023-12-22T08:41:43.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.995+0000 7fe085e15640 1 -- 172.21.15.38:0/687700735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0800a44a0 msgr2=0x7fe0800708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.995+0000 7fe085e15640 1 --2- 172.21.15.38:0/687700735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0800a44a0 0x7fe0800708f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe0800613e0 tx=0x7fe06c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.996+0000 7fe085e15640 1 -- 172.21.15.38:0/687700735 shutdown_connections 2023-12-22T08:41:43.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.996+0000 7fe085e15640 1 --2- 172.21.15.38:0/687700735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0800a44a0 0x7fe0800708f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.996+0000 7fe085e15640 1 --2- 172.21.15.38:0/687700735 >> v2:172.21.15.89:3300/0 conn(0x7fe08015b420 0x7fe08006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.996+0000 7fe085e15640 1 -- 172.21.15.38:0/687700735 >> 172.21.15.38:0/687700735 conn(0x7fe0800b1f70 msgr2=0x7fe0800b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.996+0000 7fe085e15640 1 -- 172.21.15.38:0/687700735 shutdown_connections 2023-12-22T08:41:43.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.996+0000 7fe085e15640 1 -- 172.21.15.38:0/687700735 wait complete. 2023-12-22T08:41:44.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.997+0000 7fe085e15640 1 Processor -- start 2023-12-22T08:41:44.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.998+0000 7fe085e15640 1 -- start start 2023-12-22T08:41:44.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe085e15640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe080070e30 0x7fe08009df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe085e15640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0800a44a0 0x7fe0801591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe085e15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe08015b420 0x7fe0800c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe085e15640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08009e4a0 con 0x7fe0800a44a0 2023-12-22T08:41:44.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe085e15640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08009b0d0 con 0x7fe08015b420 2023-12-22T08:41:44.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe085e15640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08009b3b0 con 0x7fe080070e30 2023-12-22T08:41:44.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe07ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0800a44a0 0x7fe0801591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe07ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0800a44a0 0x7fe0801591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50226/0 (socket says 172.21.15.38:50226) 2023-12-22T08:41:44.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe07ffff640 1 -- 172.21.15.38:0/1905640366 learned_addr learned my addr 172.21.15.38:0/1905640366 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:44.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe084e13640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe080070e30 0x7fe08009df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe07ffff640 1 -- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe080070e30 msgr2=0x7fe08009df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe07ffff640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe080070e30 0x7fe08009df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe07ffff640 1 -- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe08015b420 msgr2=0x7fe0800c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe085614640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe08015b420 0x7fe0800c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe07ffff640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe08015b420 0x7fe0800c2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:43.999+0000 7fe07ffff640 1 -- 172.21.15.38:0/1905640366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c009400 con 0x7fe0800a44a0 2023-12-22T08:41:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.000+0000 7fe07ffff640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0800a44a0 0x7fe0801591f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009890 tx=0x7fe06c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.000+0000 7fe07d7fa640 1 -- 172.21.15.38:0/1905640366 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c03ba70 con 0x7fe0800a44a0 2023-12-22T08:41:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.000+0000 7fe07d7fa640 1 -- 172.21.15.38:0/1905640366 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c03bbf0 con 0x7fe0800a44a0 2023-12-22T08:41:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.000+0000 7fe07d7fa640 1 -- 172.21.15.38:0/1905640366 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c045400 con 0x7fe0800a44a0 2023-12-22T08:41:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.000+0000 7fe085e15640 1 -- 172.21.15.38:0/1905640366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08009b690 con 0x7fe0800a44a0 2023-12-22T08:41:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.000+0000 7fe085e15640 1 -- 172.21.15.38:0/1905640366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe080159730 con 0x7fe0800a44a0 2023-12-22T08:41:44.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.001+0000 7fe085e15640 1 -- 172.21.15.38:0/1905640366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe080061910 con 0x7fe0800a44a0 2023-12-22T08:41:44.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.002+0000 7fe07d7fa640 1 -- 172.21.15.38:0/1905640366 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe06c04e440 con 0x7fe0800a44a0 2023-12-22T08:41:44.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.004+0000 7fe07d7fa640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe06406a430 0x7fe06406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.004+0000 7fe07d7fa640 1 -- 172.21.15.38:0/1905640366 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe06c0aace0 con 0x7fe0800a44a0 2023-12-22T08:41:44.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.004+0000 7fe084e13640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe06406a430 0x7fe06406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.005+0000 7fe084e13640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe06406a430 0x7fe06406c8f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe074006fd0 tx=0x7fe074008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.008+0000 7fe07d7fa640 1 -- 172.21.15.38:0/1905640366 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe06c0763e0 con 0x7fe0800a44a0 2023-12-22T08:41:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.246+0000 7fe085e15640 1 -- 172.21.15.38:0/1905640366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0800cb5c0 con 0x7fe0800a44a0 2023-12-22T08:41:44.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.248+0000 7fe07d7fa640 1 -- 172.21.15.38:0/1905640366 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4642 (secure 0 0 0) 0x7fe06c079a00 con 0x7fe0800a44a0 2023-12-22T08:41:44.250 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:44.251 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1244935716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1244935716},{"type":"v1","addr":"172.21.15.89:6837","nonce":1244935716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/23463229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":23463229},{"type":"v1","addr":"172.21.15.38:6833","nonce":23463229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3876693609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3876693609},{"type":"v1","addr":"172.21.15.89:6836","nonce":3876693609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:41:14.062124+0000","modified":"2023-12-22T08:41:17.103814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.38:6835/2926436383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2926436383},{"type":"v1","addr":"172.21.15.38:6835","nonce":2926436383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-22T08:41:44.251 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 16 2023-12-22T08:41:44.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.251+0000 7fe085e15640 1 -- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe06406a430 msgr2=0x7fe06406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.251+0000 7fe085e15640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe06406a430 0x7fe06406c8f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe074006fd0 tx=0x7fe074008040 comp rx=0 tx=0).stop 2023-12-22T08:41:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.251+0000 7fe085e15640 1 -- 172.21.15.38:0/1905640366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0800a44a0 msgr2=0x7fe0801591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.251+0000 7fe085e15640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0800a44a0 0x7fe0801591f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009890 tx=0x7fe06c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.251+0000 7fe085e15640 1 -- 172.21.15.38:0/1905640366 shutdown_connections 2023-12-22T08:41:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.251+0000 7fe085e15640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe08015b420 0x7fe0800c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.251+0000 7fe085e15640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe06406a430 0x7fe06406c8f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.251+0000 7fe085e15640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0800a44a0 0x7fe0801591f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.251+0000 7fe085e15640 1 --2- 172.21.15.38:0/1905640366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe080070e30 0x7fe08009df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.251+0000 7fe085e15640 1 -- 172.21.15.38:0/1905640366 >> 172.21.15.38:0/1905640366 conn(0x7fe0800b1f70 msgr2=0x7fe08006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.251+0000 7fe085e15640 1 -- 172.21.15.38:0/1905640366 shutdown_connections 2023-12-22T08:41:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.251+0000 7fe085e15640 1 -- 172.21.15.38:0/1905640366 wait complete. 2023-12-22T08:41:44.272 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:44.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.493+0000 7f58e8807640 1 Processor -- start 2023-12-22T08:41:44.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.493+0000 7f58e8807640 1 -- start start 2023-12-22T08:41:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.494+0000 7f58e8807640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58e40a44a0 0x7f58e40708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.495+0000 7f58e8807640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e40cdae0 con 0x7f58e4070e30 2023-12-22T08:41:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.495+0000 7f58e8807640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e4071260 con 0x7f58e415b420 2023-12-22T08:41:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.495+0000 7f58e8807640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e415b800 con 0x7f58e40a44a0 2023-12-22T08:41:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.495+0000 7f58e3fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f58e4070e30 0x7f58e415baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43714/0 (socket says 172.21.15.38:43714) 2023-12-22T08:41:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.495+0000 7f58e3fff640 1 -- 172.21.15.38:0/84378121 learned_addr learned my addr 172.21.15.38:0/84378121 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.495+0000 7f58e2ffd640 1 --2- 172.21.15.38:0/84378121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58e40a44a0 0x7f58e40708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.495+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342447340 0 0) 0x7f58e40cdae0 con 0x7f58e4070e30 2023-12-22T08:41:44.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58cc003520 con 0x7f58e4070e30 2023-12-22T08:41:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 206327420 0 0) 0x7f58cc003520 con 0x7f58e4070e30 2023-12-22T08:41:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58e40a44a0 msgr2=0x7f58e40708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 --2- 172.21.15.38:0/84378121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58e40a44a0 0x7f58e40708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 >> v1:172.21.15.89:6789/0 conn(0x7f58e415b420 legacy=0x7f58e406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e40cdd30 con 0x7f58e4070e30 2023-12-22T08:41:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f58dc0019f0 con 0x7f58e4070e30 2023-12-22T08:41:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 >> v1:172.21.15.38:6789/0 conn(0x7f58e4070e30 legacy=0x7f58e415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 --2- 172.21.15.38:0/84378121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58e40a44a0 0x7f58cc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 --2- 172.21.15.38:0/84378121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58cc003f70 0x7f58cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 --2- 172.21.15.38:0/84378121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc004d00 0x7f58cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e415b800 con 0x7f58cc003f70 2023-12-22T08:41:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc00bac0 con 0x7f58cc004d00 2023-12-22T08:41:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc00bc80 con 0x7f58e40a44a0 2023-12-22T08:41:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.496+0000 7f58e2ffd640 1 --2- 172.21.15.38:0/84378121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58cc003f70 0x7f58cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.497+0000 7f58e37fe640 1 --2- 172.21.15.38:0/84378121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58e40a44a0 0x7f58cc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.497+0000 7f58e3fff640 1 --2- 172.21.15.38:0/84378121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc004d00 0x7f58cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.497+0000 7f58e2ffd640 1 -- 172.21.15.38:0/84378121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58e40a44a0 msgr2=0x7f58cc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.497+0000 7f58e2ffd640 1 --2- 172.21.15.38:0/84378121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58e40a44a0 0x7f58cc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.497+0000 7f58e2ffd640 1 -- 172.21.15.38:0/84378121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc004d00 msgr2=0x7f58cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.497+0000 7f58e2ffd640 1 --2- 172.21.15.38:0/84378121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58cc004d00 0x7f58cc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.497+0000 7f58e2ffd640 1 -- 172.21.15.38:0/84378121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc003520 con 0x7f58cc003f70 2023-12-22T08:41:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.498+0000 7f58e2ffd640 1 --2- 172.21.15.38:0/84378121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58cc003f70 0x7f58cc0047c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009ac0 tx=0x7f58cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2aa69e8198491 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.498+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d802c600 con 0x7f58cc003f70 2023-12-22T08:41:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.498+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d802c760 con 0x7f58cc003f70 2023-12-22T08:41:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.498+0000 7f58e27fc640 1 -- 172.21.15.38:0/84378121 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d802caf0 con 0x7f58cc003f70 2023-12-22T08:41:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.499+0000 7f58e8807640 1 -- 172.21.15.38:0/84378121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58cc003f70 msgr2=0x7f58cc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.499+0000 7f58e8807640 1 --2- 172.21.15.38:0/84378121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58cc003f70 0x7f58cc0047c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009ac0 tx=0x7f58cc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.499+0000 7f58e3fff640 1 -- 172.21.15.38:0/84378121 reap_dead start 2023-12-22T08:41:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.499+0000 7f58e8807640 1 -- 172.21.15.38:0/84378121 shutdown_connections 2023-12-22T08:41:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.499+0000 7f58e8807640 1 -- 172.21.15.38:0/84378121 >> 172.21.15.38:0/84378121 conn(0x7f58e40b1f70 msgr2=0x7f58e40b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.499+0000 7f58e8807640 1 -- 172.21.15.38:0/84378121 shutdown_connections 2023-12-22T08:41:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.499+0000 7f58e8807640 1 -- 172.21.15.38:0/84378121 wait complete. 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.501+0000 7f58e8807640 1 Processor -- start 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.501+0000 7f58e8807640 1 -- start start 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.502+0000 7f58e8807640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58cc003f70 0x7f58e4157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.502+0000 7f58e8807640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58e4150660 0x7f58e40a2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.502+0000 7f58e8807640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58e4153ec0 0x7f58e415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.502+0000 7f58e8807640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e41f6e90 con 0x7f58e4153ec0 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.502+0000 7f58e8807640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e41f5fc0 con 0x7f58e4150660 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.502+0000 7f58e8807640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e41f6280 con 0x7f58cc003f70 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.502+0000 7f58e3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58e4153ec0 0x7f58e415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.502+0000 7f58e3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58e4153ec0 0x7f58e415b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50242/0 (socket says 172.21.15.38:50242) 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.502+0000 7f58e3fff640 1 -- 172.21.15.38:0/3496736051 learned_addr learned my addr 172.21.15.38:0/3496736051 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.502+0000 7f58e37fe640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58cc003f70 0x7f58e4157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.502+0000 7f58e2ffd640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58e4150660 0x7f58e40a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.503+0000 7f58e3fff640 1 -- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58cc003f70 msgr2=0x7f58e4157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.503+0000 7f58e3fff640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58cc003f70 0x7f58e4157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.503+0000 7f58e3fff640 1 -- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58e4150660 msgr2=0x7f58e40a2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.503+0000 7f58e3fff640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58e4150660 0x7f58e40a2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.503+0000 7f58e3fff640 1 -- 172.21.15.38:0/3496736051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e41f6560 con 0x7f58e4153ec0 2023-12-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.503+0000 7f58e37fe640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58cc003f70 0x7f58e4157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.503+0000 7f58e3fff640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58e4153ec0 0x7f58e415b9d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f58e415ee70 tx=0x7f58dc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.503+0000 7f58cbfff640 1 -- 172.21.15.38:0/3496736051 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc007ae0 con 0x7f58e4153ec0 2023-12-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.503+0000 7f58cbfff640 1 -- 172.21.15.38:0/3496736051 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc00ee20 con 0x7f58e4153ec0 2023-12-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.503+0000 7f58cbfff640 1 -- 172.21.15.38:0/3496736051 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc013680 con 0x7f58e4153ec0 2023-12-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.503+0000 7f58e8807640 1 -- 172.21.15.38:0/3496736051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e41f6840 con 0x7f58e4153ec0 2023-12-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.503+0000 7f58e8807640 1 -- 172.21.15.38:0/3496736051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e4154340 con 0x7f58e4153ec0 2023-12-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.505+0000 7f58e8807640 1 -- 172.21.15.38:0/3496736051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e40ce2d0 con 0x7f58e4153ec0 2023-12-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.506+0000 7f58cbfff640 1 -- 172.21.15.38:0/3496736051 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f58dc0137e0 con 0x7f58e4153ec0 2023-12-22T08:41:44.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.507+0000 7f58cbfff640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f58d006a430 0x7f58d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.507+0000 7f58cbfff640 1 -- 172.21.15.38:0/3496736051 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58dc088db0 con 0x7f58e4153ec0 2023-12-22T08:41:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.507+0000 7f58e37fe640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f58d006a430 0x7f58d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.509+0000 7f58e37fe640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f58d006a430 0x7f58d006c8f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58d40016b0 tx=0x7f58d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.511+0000 7f58cbfff640 1 -- 172.21.15.38:0/3496736051 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f58e40ce2d0 con 0x7f58e4153ec0 2023-12-22T08:41:44.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.709+0000 7f58e8807640 1 -- 172.21.15.38:0/3496736051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58e40ce2d0 con 0x7f58e4153ec0 2023-12-22T08:41:44.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.712+0000 7f58cbfff640 1 -- 172.21.15.38:0/3496736051 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f58e40ce2d0 con 0x7f58e4153ec0 2023-12-22T08:41:44.715 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:44.715 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":36,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:41:33.206742+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:12.357679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:13.069596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.715+0000 7f58e8807640 1 -- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f58d006a430 msgr2=0x7f58d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.715+0000 7f58e8807640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f58d006a430 0x7f58d006c8f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58d40016b0 tx=0x7f58d4009040 comp rx=0 tx=0).stop 2023-12-22T08:41:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.715+0000 7f58e8807640 1 -- 172.21.15.38:0/3496736051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58e4153ec0 msgr2=0x7f58e415b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.715+0000 7f58e8807640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58e4153ec0 0x7f58e415b9d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f58e415ee70 tx=0x7f58dc00e530 comp rx=0 tx=0).stop 2023-12-22T08:41:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.715+0000 7f58e8807640 1 -- 172.21.15.38:0/3496736051 shutdown_connections 2023-12-22T08:41:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.715+0000 7f58e8807640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f58d006a430 0x7f58d006c8f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.715+0000 7f58e8807640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58e4153ec0 0x7f58e415b9d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.715+0000 7f58e8807640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58e4150660 0x7f58e40a2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.715+0000 7f58e8807640 1 --2- 172.21.15.38:0/3496736051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58cc003f70 0x7f58e4157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.715+0000 7f58e8807640 1 -- 172.21.15.38:0/3496736051 >> 172.21.15.38:0/3496736051 conn(0x7f58e40b1f70 msgr2=0x7f58e409f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.716+0000 7f58e8807640 1 -- 172.21.15.38:0/3496736051 shutdown_connections 2023-12-22T08:41:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.716+0000 7f58e8807640 1 -- 172.21.15.38:0/3496736051 wait complete. 2023-12-22T08:41:44.738 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:41:44.739 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:44.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.964+0000 7f169f59e640 1 Processor -- start 2023-12-22T08:41:44.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.964+0000 7f169f59e640 1 -- start start 2023-12-22T08:41:44.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.966+0000 7f169f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16a0157980 0x7f16a015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.966+0000 7f169f59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a00d1520 con 0x7f16a00b3ff0 2023-12-22T08:41:44.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.966+0000 7f169f59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a00d1800 con 0x7f16a006d640 2023-12-22T08:41:44.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.966+0000 7f169f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00d1ae0 con 0x7f16a0157980 2023-12-22T08:41:44.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.966+0000 7f1697fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f16a00b3ff0 0x7f16a006cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43722/0 (socket says 172.21.15.38:43722) 2023-12-22T08:41:44.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.966+0000 7f1697fff640 1 -- 172.21.15.38:0/1426208326 learned_addr learned my addr 172.21.15.38:0/1426208326 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:44.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169e59c640 1 --2- 172.21.15.38:0/1426208326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16a0157980 0x7f16a015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107411153 0 0) 0x7f16a00d1520 con 0x7f16a00b3ff0 2023-12-22T08:41:44.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f168c003520 con 0x7f16a00b3ff0 2023-12-22T08:41:44.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 669227933 0 0) 0x7f168c003520 con 0x7f16a00b3ff0 2023-12-22T08:41:44.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16a0157980 msgr2=0x7f16a015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:44.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 --2- 172.21.15.38:0/1426208326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16a0157980 0x7f16a015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 >> v1:172.21.15.89:6789/0 conn(0x7f16a006d640 legacy=0x7f16a00d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a00d1dc0 con 0x7f16a00b3ff0 2023-12-22T08:41:44.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f1688001670 con 0x7f16a00b3ff0 2023-12-22T08:41:44.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 >> v1:172.21.15.38:6789/0 conn(0x7f16a00b3ff0 legacy=0x7f16a006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 --2- 172.21.15.38:0/1426208326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f168c0039a0 0x7f168c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 --2- 172.21.15.38:0/1426208326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c0047c0 0x7f168c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 --2- 172.21.15.38:0/1426208326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16a0157980 0x7f168c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00d1ae0 con 0x7f168c0047c0 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c00ba60 con 0x7f168c0039a0 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c00bc20 con 0x7f16a0157980 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.967+0000 7f1697fff640 1 --2- 172.21.15.38:0/1426208326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c0047c0 0x7f168c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.968+0000 7f1697fff640 1 -- 172.21.15.38:0/1426208326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16a0157980 msgr2=0x7f168c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.968+0000 7f169e59c640 1 --2- 172.21.15.38:0/1426208326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f168c0039a0 0x7f168c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.968+0000 7f169ed9d640 1 --2- 172.21.15.38:0/1426208326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16a0157980 0x7f168c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.968+0000 7f1697fff640 1 --2- 172.21.15.38:0/1426208326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16a0157980 0x7f168c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.968+0000 7f1697fff640 1 -- 172.21.15.38:0/1426208326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f168c0039a0 msgr2=0x7f168c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.968+0000 7f1697fff640 1 --2- 172.21.15.38:0/1426208326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f168c0039a0 0x7f168c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.968+0000 7f1697fff640 1 -- 172.21.15.38:0/1426208326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c003520 con 0x7f168c0047c0 2023-12-22T08:41:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.968+0000 7f169e59c640 1 --2- 172.21.15.38:0/1426208326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f168c0039a0 0x7f168c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:44.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.969+0000 7f1697fff640 1 --2- 172.21.15.38:0/1426208326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c0047c0 0x7f168c004c40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1688001eb0 tx=0x7f168c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c6b612849ddaed server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.969+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1688005ad0 con 0x7f168c0047c0 2023-12-22T08:41:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.969+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1688005c30 con 0x7f168c0047c0 2023-12-22T08:41:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.969+0000 7f169dd9b640 1 -- 172.21.15.38:0/1426208326 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168802c7a0 con 0x7f168c0047c0 2023-12-22T08:41:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.970+0000 7f169f59e640 1 -- 172.21.15.38:0/1426208326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c0047c0 msgr2=0x7f168c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.970+0000 7f169f59e640 1 --2- 172.21.15.38:0/1426208326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c0047c0 0x7f168c004c40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1688001eb0 tx=0x7f168c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.970+0000 7f169ed9d640 1 -- 172.21.15.38:0/1426208326 reap_dead start 2023-12-22T08:41:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.970+0000 7f169f59e640 1 -- 172.21.15.38:0/1426208326 shutdown_connections 2023-12-22T08:41:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.970+0000 7f169f59e640 1 -- 172.21.15.38:0/1426208326 >> 172.21.15.38:0/1426208326 conn(0x7f16a00d31f0 msgr2=0x7f16a00d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.970+0000 7f169f59e640 1 -- 172.21.15.38:0/1426208326 shutdown_connections 2023-12-22T08:41:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.970+0000 7f169f59e640 1 -- 172.21.15.38:0/1426208326 wait complete. 2023-12-22T08:41:44.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.972+0000 7f169f59e640 1 Processor -- start 2023-12-22T08:41:44.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.972+0000 7f169f59e640 1 -- start start 2023-12-22T08:41:44.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.973+0000 7f169f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c0047c0 0x7f16a014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.973+0000 7f169f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a014b850 0x7f16a015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.973+0000 7f169f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16a014d580 0x7f16a015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.973+0000 7f169f59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a014d160 con 0x7f168c0047c0 2023-12-22T08:41:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.973+0000 7f169f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a014f4f0 con 0x7f16a014b850 2023-12-22T08:41:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.973+0000 7f169f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a0157450 con 0x7f16a014d580 2023-12-22T08:41:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.973+0000 7f169e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c0047c0 0x7f16a014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.974+0000 7f169e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c0047c0 0x7f16a014efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50254/0 (socket says 172.21.15.38:50254) 2023-12-22T08:41:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.974+0000 7f169e59c640 1 -- 172.21.15.38:0/323920114 learned_addr learned my addr 172.21.15.38:0/323920114 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.974+0000 7f1697fff640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a014b850 0x7f16a015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.974+0000 7f169e59c640 1 -- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16a014d580 msgr2=0x7f16a015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.974+0000 7f169e59c640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16a014d580 0x7f16a015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.974+0000 7f169e59c640 1 -- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a014b850 msgr2=0x7f16a015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.974+0000 7f169e59c640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a014b850 0x7f16a015a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.974+0000 7f169e59c640 1 -- 172.21.15.38:0/323920114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a014c570 con 0x7f168c0047c0 2023-12-22T08:41:44.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.974+0000 7f1697fff640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a014b850 0x7f16a015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:44.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.974+0000 7f169e59c640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c0047c0 0x7f16a014efb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1690010850 tx=0x7f1690010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.975+0000 7f1696ffd640 1 -- 172.21.15.38:0/323920114 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000eb60 con 0x7f168c0047c0 2023-12-22T08:41:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.975+0000 7f1696ffd640 1 -- 172.21.15.38:0/323920114 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169000ecc0 con 0x7f168c0047c0 2023-12-22T08:41:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.975+0000 7f1696ffd640 1 -- 172.21.15.38:0/323920114 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169001c400 con 0x7f168c0047c0 2023-12-22T08:41:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.975+0000 7f169f59e640 1 -- 172.21.15.38:0/323920114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a015abe0 con 0x7f168c0047c0 2023-12-22T08:41:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.975+0000 7f169f59e640 1 -- 172.21.15.38:0/323920114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a014caa0 con 0x7f168c0047c0 2023-12-22T08:41:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.976+0000 7f169f59e640 1 -- 172.21.15.38:0/323920114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a0061910 con 0x7f168c0047c0 2023-12-22T08:41:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.977+0000 7f1696ffd640 1 -- 172.21.15.38:0/323920114 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f169001c560 con 0x7f168c0047c0 2023-12-22T08:41:44.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.978+0000 7f1696ffd640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f168006a460 0x7f168006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.978+0000 7f1696ffd640 1 -- 172.21.15.38:0/323920114 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1690088da0 con 0x7f168c0047c0 2023-12-22T08:41:44.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.979+0000 7f1697fff640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f168006a460 0x7f168006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.980+0000 7f1697fff640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f168006a460 0x7f168006c920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1688034000 tx=0x7f1688009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:44.982+0000 7f1696ffd640 1 -- 172.21.15.38:0/323920114 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1690054430 con 0x7f168c0047c0 2023-12-22T08:41:45.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.216+0000 7f169f59e640 1 -- 172.21.15.38:0/323920114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16a015c090 con 0x7f168c0047c0 2023-12-22T08:41:45.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.217+0000 7f1696ffd640 1 -- 172.21.15.38:0/323920114 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f1690057a50 con 0x7f168c0047c0 2023-12-22T08:41:45.220 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:45.220 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1244935716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1244935716},{"type":"v1","addr":"172.21.15.89:6837","nonce":1244935716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/23463229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":23463229},{"type":"v1","addr":"172.21.15.38:6833","nonce":23463229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3876693609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3876693609},{"type":"v1","addr":"172.21.15.89:6836","nonce":3876693609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:41:14.062124+0000","modified":"2023-12-22T08:41:17.103814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.38:6835/2926436383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2926436383},{"type":"v1","addr":"172.21.15.38:6835","nonce":2926436383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-22T08:41:45.220 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 16 2023-12-22T08:41:45.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.220+0000 7f169f59e640 1 -- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f168006a460 msgr2=0x7f168006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:45.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.220+0000 7f169f59e640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f168006a460 0x7f168006c920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1688034000 tx=0x7f1688009030 comp rx=0 tx=0).stop 2023-12-22T08:41:45.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.220+0000 7f169f59e640 1 -- 172.21.15.38:0/323920114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c0047c0 msgr2=0x7f16a014efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:45.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.220+0000 7f169f59e640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c0047c0 0x7f16a014efb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1690010850 tx=0x7f1690010d10 comp rx=0 tx=0).stop 2023-12-22T08:41:45.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.220+0000 7f169f59e640 1 -- 172.21.15.38:0/323920114 shutdown_connections 2023-12-22T08:41:45.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.220+0000 7f169f59e640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16a014d580 0x7f16a015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.220+0000 7f169f59e640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16a014b850 0x7f16a015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.220+0000 7f169f59e640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f168006a460 0x7f168006c920 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.220+0000 7f169f59e640 1 --2- 172.21.15.38:0/323920114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f168c0047c0 0x7f16a014efb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.220+0000 7f169f59e640 1 -- 172.21.15.38:0/323920114 >> 172.21.15.38:0/323920114 conn(0x7f16a00d31f0 msgr2=0x7f16a0070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:45.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.220+0000 7f169f59e640 1 -- 172.21.15.38:0/323920114 shutdown_connections 2023-12-22T08:41:45.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.220+0000 7f169f59e640 1 -- 172.21.15.38:0/323920114 wait complete. 2023-12-22T08:41:45.242 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:45.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.464+0000 7f93512c5640 1 Processor -- start 2023-12-22T08:41:45.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.464+0000 7f93512c5640 1 -- start start 2023-12-22T08:41:45.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.466+0000 7f93512c5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f934c071000 0x7f934c165f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.466+0000 7f93512c5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c0cdae0 con 0x7f934c15b420 2023-12-22T08:41:45.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.466+0000 7f93512c5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c15b800 con 0x7f934c0a44a0 2023-12-22T08:41:45.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.466+0000 7f93512c5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c0cdd30 con 0x7f934c071000 2023-12-22T08:41:45.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.466+0000 7f934bfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f934c15b420 0x7f934c06d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43738/0 (socket says 172.21.15.38:43738) 2023-12-22T08:41:45.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.466+0000 7f934bfff640 1 -- 172.21.15.38:0/3093558556 learned_addr learned my addr 172.21.15.38:0/3093558556 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f9350ac4640 1 --2- 172.21.15.38:0/3093558556 >> v2:172.21.15.89:3300/0 conn(0x7f934c071000 0x7f934c165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073772782 0 0) 0x7f934c0cdae0 con 0x7f934c15b420 2023-12-22T08:41:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9338003520 con 0x7f934c15b420 2023-12-22T08:41:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3460569814 0 0) 0x7f9338003520 con 0x7f934c15b420 2023-12-22T08:41:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 >> v2:172.21.15.89:3300/0 conn(0x7f934c071000 msgr2=0x7f934c165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 --2- 172.21.15.38:0/3093558556 >> v2:172.21.15.89:3300/0 conn(0x7f934c071000 0x7f934c165f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 >> v1:172.21.15.89:6789/0 conn(0x7f934c0a44a0 legacy=0x7f934c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0ce010 con 0x7f934c15b420 2023-12-22T08:41:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f933c001670 con 0x7f934c15b420 2023-12-22T08:41:45.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 >> v1:172.21.15.38:6789/0 conn(0x7f934c15b420 legacy=0x7f934c06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:45.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 --2- 172.21.15.38:0/3093558556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93380039c0 0x7f9338003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 --2- 172.21.15.38:0/3093558556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93380047c0 0x7f9338004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 --2- 172.21.15.38:0/3093558556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9338005180 0x7f933800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0cdd30 con 0x7f93380047c0 2023-12-22T08:41:45.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933800c080 con 0x7f93380039c0 2023-12-22T08:41:45.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.467+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933800c240 con 0x7f9338005180 2023-12-22T08:41:45.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.468+0000 7f9343fff640 1 --2- 172.21.15.38:0/3093558556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93380047c0 0x7f9338004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:45.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.468+0000 7f934bfff640 1 --2- 172.21.15.38:0/3093558556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93380039c0 0x7f9338003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:45.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.468+0000 7f9350ac4640 1 --2- 172.21.15.38:0/3093558556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9338005180 0x7f933800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:45.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.468+0000 7f9343fff640 1 -- 172.21.15.38:0/3093558556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9338005180 msgr2=0x7f933800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:45.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.468+0000 7f9343fff640 1 --2- 172.21.15.38:0/3093558556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9338005180 0x7f933800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.468+0000 7f9343fff640 1 -- 172.21.15.38:0/3093558556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93380039c0 msgr2=0x7f9338003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:45.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.468+0000 7f9343fff640 1 --2- 172.21.15.38:0/3093558556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93380039c0 0x7f9338003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.468+0000 7f9343fff640 1 -- 172.21.15.38:0/3093558556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9338003520 con 0x7f93380047c0 2023-12-22T08:41:45.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.468+0000 7f9350ac4640 1 -- 172.21.15.38:0/3093558556 reap_dead start 2023-12-22T08:41:45.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.469+0000 7f9343fff640 1 --2- 172.21.15.38:0/3093558556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93380047c0 0x7f9338004c40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f934c0b1f40 tx=0x7f93380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620ad3d5e1892906 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:45.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.470+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93340052d0 con 0x7f93380047c0 2023-12-22T08:41:45.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.470+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933402e050 con 0x7f93380047c0 2023-12-22T08:41:45.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.470+0000 7f934b7fe640 1 -- 172.21.15.38:0/3093558556 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334003830 con 0x7f93380047c0 2023-12-22T08:41:45.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.470+0000 7f93512c5640 1 -- 172.21.15.38:0/3093558556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93380047c0 msgr2=0x7f9338004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:45.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.470+0000 7f93512c5640 1 --2- 172.21.15.38:0/3093558556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93380047c0 0x7f9338004c40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f934c0b1f40 tx=0x7f93380057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.470+0000 7f93512c5640 1 -- 172.21.15.38:0/3093558556 shutdown_connections 2023-12-22T08:41:45.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.470+0000 7f93512c5640 1 --2- 172.21.15.38:0/3093558556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93380047c0 0x7f9338004c40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.470+0000 7f93512c5640 1 -- 172.21.15.38:0/3093558556 >> 172.21.15.38:0/3093558556 conn(0x7f934c0b1f70 msgr2=0x7f934c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:45.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.470+0000 7f93512c5640 1 -- 172.21.15.38:0/3093558556 shutdown_connections 2023-12-22T08:41:45.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.471+0000 7f93512c5640 1 -- 172.21.15.38:0/3093558556 wait complete. 2023-12-22T08:41:45.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.472+0000 7f93512c5640 1 Processor -- start 2023-12-22T08:41:45.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.472+0000 7f93512c5640 1 -- start start 2023-12-22T08:41:45.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.473+0000 7f93512c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93380047c0 0x7f934c152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.473+0000 7f93512c5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c0a3090 0x7f934c0a3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.473+0000 7f93512c5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c151960 0x7f934c151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.473+0000 7f93512c5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0a3a50 con 0x7f934c0a3090 2023-12-22T08:41:45.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.473+0000 7f93512c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c143ae0 con 0x7f93380047c0 2023-12-22T08:41:45.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.473+0000 7f93512c5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c1535b0 con 0x7f934c151960 2023-12-22T08:41:45.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.474+0000 7f9343fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c0a3090 0x7f934c0a3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:45.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.474+0000 7f9343fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c0a3090 0x7f934c0a3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50260/0 (socket says 172.21.15.38:50260) 2023-12-22T08:41:45.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.474+0000 7f9343fff640 1 -- 172.21.15.38:0/3988107415 learned_addr learned my addr 172.21.15.38:0/3988107415 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:45.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.474+0000 7f934bfff640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93380047c0 0x7f934c152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:45.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.474+0000 7f9350ac4640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c151960 0x7f934c151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:45.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.474+0000 7f9343fff640 1 -- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c151960 msgr2=0x7f934c151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:45.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.474+0000 7f9343fff640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c151960 0x7f934c151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.474+0000 7f9343fff640 1 -- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93380047c0 msgr2=0x7f934c152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:45.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.474+0000 7f9343fff640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93380047c0 0x7f934c152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.474+0000 7f9343fff640 1 -- 172.21.15.38:0/3988107415 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c153890 con 0x7f934c0a3090 2023-12-22T08:41:45.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.474+0000 7f934bfff640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93380047c0 0x7f934c152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:45.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.475+0000 7f9343fff640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c0a3090 0x7f934c0a3510 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f933402bb30 tx=0x7f9334001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:45.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.475+0000 7f93497fa640 1 -- 172.21.15.38:0/3988107415 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93340076c0 con 0x7f934c0a3090 2023-12-22T08:41:45.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.475+0000 7f93497fa640 1 -- 172.21.15.38:0/3988107415 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93340069e0 con 0x7f934c0a3090 2023-12-22T08:41:45.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.475+0000 7f93497fa640 1 -- 172.21.15.38:0/3988107415 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334006d90 con 0x7f934c0a3090 2023-12-22T08:41:45.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.475+0000 7f93512c5640 1 -- 172.21.15.38:0/3988107415 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c153b70 con 0x7f934c0a3090 2023-12-22T08:41:45.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.475+0000 7f93512c5640 1 -- 172.21.15.38:0/3988107415 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c154130 con 0x7f934c0a3090 2023-12-22T08:41:45.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.476+0000 7f93512c5640 1 -- 172.21.15.38:0/3988107415 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c1542c0 con 0x7f934c0a3090 2023-12-22T08:41:45.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.477+0000 7f93497fa640 1 -- 172.21.15.38:0/3988107415 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f93340035f0 con 0x7f934c0a3090 2023-12-22T08:41:45.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.478+0000 7f93497fa640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f932c06a430 0x7f932c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.478+0000 7f93497fa640 1 -- 172.21.15.38:0/3988107415 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93340aa6a0 con 0x7f934c0a3090 2023-12-22T08:41:45.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.479+0000 7f934bfff640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f932c06a430 0x7f932c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:45.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.480+0000 7f934bfff640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f932c06a430 0x7f932c06c8f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f933c005a30 tx=0x7f933c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:45.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.482+0000 7f93497fa640 1 -- 172.21.15.38:0/3988107415 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9334075db0 con 0x7f934c0a3090 2023-12-22T08:41:45.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.719+0000 7f93512c5640 1 -- 172.21.15.38:0/3988107415 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f934c074740 con 0x7f934c0a3090 2023-12-22T08:41:45.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.721+0000 7f93497fa640 1 -- 172.21.15.38:0/3988107415 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f93340793d0 con 0x7f934c0a3090 2023-12-22T08:41:45.723 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:45.723 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1244935716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1244935716},{"type":"v1","addr":"172.21.15.89:6837","nonce":1244935716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/23463229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":23463229},{"type":"v1","addr":"172.21.15.38:6833","nonce":23463229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3876693609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3876693609},{"type":"v1","addr":"172.21.15.89:6836","nonce":3876693609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:41:14.062124+0000","modified":"2023-12-22T08:41:17.103814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5052":{"gid":5052,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.38:6835/2926436383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2926436383},{"type":"v1","addr":"172.21.15.38:6835","nonce":2926436383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-22T08:41:45.724 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 16 2023-12-22T08:41:45.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.723+0000 7f93512c5640 1 -- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f932c06a430 msgr2=0x7f932c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:45.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.723+0000 7f93512c5640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f932c06a430 0x7f932c06c8f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f933c005a30 tx=0x7f933c009040 comp rx=0 tx=0).stop 2023-12-22T08:41:45.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.723+0000 7f93512c5640 1 -- 172.21.15.38:0/3988107415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c0a3090 msgr2=0x7f934c0a3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:45.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.723+0000 7f93512c5640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c0a3090 0x7f934c0a3510 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f933402bb30 tx=0x7f9334001120 comp rx=0 tx=0).stop 2023-12-22T08:41:45.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.724+0000 7f93512c5640 1 -- 172.21.15.38:0/3988107415 shutdown_connections 2023-12-22T08:41:45.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.724+0000 7f93512c5640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f934c151960 0x7f934c151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.724+0000 7f93512c5640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f932c06a430 0x7f932c06c8f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.724+0000 7f93512c5640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c0a3090 0x7f934c0a3510 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.724+0000 7f93512c5640 1 --2- 172.21.15.38:0/3988107415 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93380047c0 0x7f934c152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.724+0000 7f93512c5640 1 -- 172.21.15.38:0/3988107415 >> 172.21.15.38:0/3988107415 conn(0x7f934c0b1f70 msgr2=0x7f934c15d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:45.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.724+0000 7f93512c5640 1 -- 172.21.15.38:0/3988107415 shutdown_connections 2023-12-22T08:41:45.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.724+0000 7f93512c5640 1 -- 172.21.15.38:0/3988107415 wait complete. 2023-12-22T08:41:45.747 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:45.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.966+0000 7efd8d129640 1 Processor -- start 2023-12-22T08:41:45.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.966+0000 7efd8d129640 1 -- start start 2023-12-22T08:41:45.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.968+0000 7efd8d129640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd880a44a0 0x7efd880708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.968+0000 7efd8d129640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efd88070e30 0x7efd8815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.968+0000 7efd8d129640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd880cdae0 con 0x7efd8815b420 2023-12-22T08:41:45.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.968+0000 7efd8d129640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd88071250 con 0x7efd880a44a0 2023-12-22T08:41:45.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.968+0000 7efd8d129640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8815b800 con 0x7efd88070e30 2023-12-22T08:41:45.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.968+0000 7efd877fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd880a44a0 0x7efd880708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:45.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.968+0000 7efd877fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd880a44a0 0x7efd880708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50270/0 (socket says 172.21.15.38:50270) 2023-12-22T08:41:45.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.968+0000 7efd877fe640 1 -- 172.21.15.38:0/1851351413 learned_addr learned my addr 172.21.15.38:0/1851351413 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:45.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.968+0000 7efd8c928640 1 --2- 172.21.15.38:0/1851351413 >> v2:172.21.15.89:3300/0 conn(0x7efd88070e30 0x7efd8815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:45.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.969+0000 7efd877fe640 1 -- 172.21.15.38:0/1851351413 >> v2:172.21.15.89:3300/0 conn(0x7efd88070e30 msgr2=0x7efd8815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:45.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.969+0000 7efd877fe640 1 --2- 172.21.15.38:0/1851351413 >> v2:172.21.15.89:3300/0 conn(0x7efd88070e30 0x7efd8815baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.969+0000 7efd877fe640 1 -- 172.21.15.38:0/1851351413 >> v1:172.21.15.89:6789/0 conn(0x7efd8815b420 legacy=0x7efd8806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:45.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.969+0000 7efd877fe640 1 -- 172.21.15.38:0/1851351413 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd880cdd30 con 0x7efd880a44a0 2023-12-22T08:41:45.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.970+0000 7efd877fe640 1 --2- 172.21.15.38:0/1851351413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd880a44a0 0x7efd880708f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efd88070670 tx=0x7efd7c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f097badf3098470 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:45.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.970+0000 7efd86ffd640 1 -- 172.21.15.38:0/1851351413 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c031870 con 0x7efd880a44a0 2023-12-22T08:41:45.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.970+0000 7efd86ffd640 1 -- 172.21.15.38:0/1851351413 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c0319d0 con 0x7efd880a44a0 2023-12-22T08:41:45.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.970+0000 7efd86ffd640 1 -- 172.21.15.38:0/1851351413 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c031d60 con 0x7efd880a44a0 2023-12-22T08:41:45.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.971+0000 7efd8d129640 1 -- 172.21.15.38:0/1851351413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd880a44a0 msgr2=0x7efd880708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:45.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.971+0000 7efd8d129640 1 --2- 172.21.15.38:0/1851351413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd880a44a0 0x7efd880708f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efd88070670 tx=0x7efd7c02b910 comp rx=0 tx=0).stop 2023-12-22T08:41:45.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.971+0000 7efd8d129640 1 -- 172.21.15.38:0/1851351413 shutdown_connections 2023-12-22T08:41:45.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.971+0000 7efd8d129640 1 --2- 172.21.15.38:0/1851351413 >> v2:172.21.15.89:3300/0 conn(0x7efd88070e30 0x7efd8815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.971+0000 7efd8d129640 1 --2- 172.21.15.38:0/1851351413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd880a44a0 0x7efd880708f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.971+0000 7efd8d129640 1 -- 172.21.15.38:0/1851351413 >> 172.21.15.38:0/1851351413 conn(0x7efd880b1f70 msgr2=0x7efd880b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:45.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.971+0000 7efd8d129640 1 -- 172.21.15.38:0/1851351413 shutdown_connections 2023-12-22T08:41:45.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.971+0000 7efd8d129640 1 -- 172.21.15.38:0/1851351413 wait complete. 2023-12-22T08:41:45.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.973+0000 7efd8d129640 1 Processor -- start 2023-12-22T08:41:45.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.973+0000 7efd8d129640 1 -- start start 2023-12-22T08:41:45.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.974+0000 7efd8d129640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd88070e30 0x7efd88159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.974+0000 7efd8d129640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd880a44a0 0x7efd88155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.974+0000 7efd8d129640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd8815b420 0x7efd880c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.974+0000 7efd8d129640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd880c2310 con 0x7efd880a44a0 2023-12-22T08:41:45.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.974+0000 7efd8d129640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd88155bb0 con 0x7efd8815b420 2023-12-22T08:41:45.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.974+0000 7efd8d129640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd880a2a60 con 0x7efd88070e30 2023-12-22T08:41:45.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.974+0000 7efd877fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd880a44a0 0x7efd88155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:45.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.974+0000 7efd877fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd880a44a0 0x7efd88155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50274/0 (socket says 172.21.15.38:50274) 2023-12-22T08:41:45.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.974+0000 7efd877fe640 1 -- 172.21.15.38:0/1259547542 learned_addr learned my addr 172.21.15.38:0/1259547542 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:45.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.975+0000 7efd877fe640 1 -- 172.21.15.38:0/1259547542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd88070e30 msgr2=0x7efd88159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:45.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.975+0000 7efd877fe640 1 --2- 172.21.15.38:0/1259547542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd88070e30 0x7efd88159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.975+0000 7efd877fe640 1 -- 172.21.15.38:0/1259547542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd8815b420 msgr2=0x7efd880c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:45.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.975+0000 7efd877fe640 1 --2- 172.21.15.38:0/1259547542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd8815b420 0x7efd880c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:45.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.975+0000 7efd877fe640 1 -- 172.21.15.38:0/1259547542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c0094d0 con 0x7efd880a44a0 2023-12-22T08:41:45.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.975+0000 7efd877fe640 1 --2- 172.21.15.38:0/1259547542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd880a44a0 0x7efd88155670 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efd7c000c00 tx=0x7efd7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:45.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.975+0000 7efd84ff9640 1 -- 172.21.15.38:0/1259547542 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c031840 con 0x7efd880a44a0 2023-12-22T08:41:45.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.975+0000 7efd84ff9640 1 -- 172.21.15.38:0/1259547542 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c0443f0 con 0x7efd880a44a0 2023-12-22T08:41:45.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.975+0000 7efd84ff9640 1 -- 172.21.15.38:0/1259547542 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c0447a0 con 0x7efd880a44a0 2023-12-22T08:41:45.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.975+0000 7efd8d129640 1 -- 172.21.15.38:0/1259547542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd880a2d40 con 0x7efd880a44a0 2023-12-22T08:41:45.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.976+0000 7efd8d129640 1 -- 172.21.15.38:0/1259547542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd880a3300 con 0x7efd880a44a0 2023-12-22T08:41:45.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.977+0000 7efd8d129640 1 -- 172.21.15.38:0/1259547542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8806eaf0 con 0x7efd880a44a0 2023-12-22T08:41:45.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.978+0000 7efd84ff9640 1 -- 172.21.15.38:0/1259547542 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd7c04d450 con 0x7efd880a44a0 2023-12-22T08:41:45.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.979+0000 7efd84ff9640 1 --2- 172.21.15.38:0/1259547542 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd7406a430 0x7efd7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:45.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.979+0000 7efd84ff9640 1 -- 172.21.15.38:0/1259547542 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd7c02d040 con 0x7efd880a44a0 2023-12-22T08:41:45.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.980+0000 7efd87fff640 1 --2- 172.21.15.38:0/1259547542 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd7406a430 0x7efd7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:45.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.981+0000 7efd87fff640 1 --2- 172.21.15.38:0/1259547542 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd7406a430 0x7efd7406c8f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efd78003cc0 tx=0x7efd780079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:45.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:45.984+0000 7efd84ff9640 1 -- 172.21.15.38:0/1259547542 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd7c076690 con 0x7efd880a44a0 2023-12-22T08:41:46.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.185+0000 7efd8d129640 1 -- 172.21.15.38:0/1259547542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd880a34f0 con 0x7efd880a44a0 2023-12-22T08:41:46.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.188+0000 7efd84ff9640 1 -- 172.21.15.38:0/1259547542 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+15993 (secure 0 0 0) 0x7efd7c035090 con 0x7efd880a44a0 2023-12-22T08:41:46.191 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:46.191 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":36,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:41:33.206742+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:12.357679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:13.069596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:46.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.191+0000 7efd8d129640 1 -- 172.21.15.38:0/1259547542 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd7406a430 msgr2=0x7efd7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:46.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.191+0000 7efd8d129640 1 --2- 172.21.15.38:0/1259547542 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd7406a430 0x7efd7406c8f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efd78003cc0 tx=0x7efd780079b0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.191+0000 7efd8d129640 1 -- 172.21.15.38:0/1259547542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd880a44a0 msgr2=0x7efd88155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:46.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.191+0000 7efd8d129640 1 --2- 172.21.15.38:0/1259547542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd880a44a0 0x7efd88155670 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efd7c000c00 tx=0x7efd7c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.191+0000 7efd8d129640 1 -- 172.21.15.38:0/1259547542 shutdown_connections 2023-12-22T08:41:46.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.191+0000 7efd8d129640 1 --2- 172.21.15.38:0/1259547542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd8815b420 0x7efd880c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.191+0000 7efd8d129640 1 --2- 172.21.15.38:0/1259547542 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd7406a430 0x7efd7406c8f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.191+0000 7efd8d129640 1 --2- 172.21.15.38:0/1259547542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd880a44a0 0x7efd88155670 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.191+0000 7efd8d129640 1 --2- 172.21.15.38:0/1259547542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd88070e30 0x7efd88159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.191+0000 7efd8d129640 1 -- 172.21.15.38:0/1259547542 >> 172.21.15.38:0/1259547542 conn(0x7efd880b1f70 msgr2=0x7efd880ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:46.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.191+0000 7efd8d129640 1 -- 172.21.15.38:0/1259547542 shutdown_connections 2023-12-22T08:41:46.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.191+0000 7efd8d129640 1 -- 172.21.15.38:0/1259547542 wait complete. 2023-12-22T08:41:46.215 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T08:41:46.326 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:41:46.335 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:41:46.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.437+0000 7f35ddb00640 1 Processor -- start 2023-12-22T08:41:46.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.437+0000 7f35ddb00640 1 -- start start 2023-12-22T08:41:46.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.439+0000 7f35ddb00640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d80b3f90 0x7f35d815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:46.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.439+0000 7f35ddb00640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f35d806ca50 0x7f35d8070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:46.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.439+0000 7f35ddb00640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d815eb20 con 0x7f35d815e740 2023-12-22T08:41:46.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.439+0000 7f35ddb00640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d806e650 con 0x7f35d806ca50 2023-12-22T08:41:46.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.439+0000 7f35ddb00640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d8070770 con 0x7f35d80b3f90 2023-12-22T08:41:46.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.439+0000 7f35d77fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f35d815e740 0x7f35d80b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43752/0 (socket says 172.21.15.38:43752) 2023-12-22T08:41:46.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.439+0000 7f35d77fe640 1 -- 172.21.15.38:0/95000053 learned_addr learned my addr 172.21.15.38:0/95000053 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:46.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.439+0000 7f35d7fff640 1 --2- 172.21.15.38:0/95000053 >> v2:172.21.15.38:3300/0 conn(0x7f35d806ca50 0x7f35d8070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:46.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.440+0000 7f35d6ffd640 1 --2- 172.21.15.38:0/95000053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d80b3f90 0x7f35d815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:46.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.440+0000 7f35d67fc640 1 -- 172.21.15.38:0/95000053 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797849662 0 0) 0x7f35d815eb20 con 0x7f35d815e740 2023-12-22T08:41:46.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.440+0000 7f35d67fc640 1 -- 172.21.15.38:0/95000053 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35c0003520 con 0x7f35d815e740 2023-12-22T08:41:46.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.440+0000 7f35d7fff640 1 -- 172.21.15.38:0/95000053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d80b3f90 msgr2=0x7f35d815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:46.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.440+0000 7f35d7fff640 1 --2- 172.21.15.38:0/95000053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d80b3f90 0x7f35d815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.440+0000 7f35d7fff640 1 -- 172.21.15.38:0/95000053 >> v1:172.21.15.38:6789/0 conn(0x7f35d815e740 legacy=0x7f35d80b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:46.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.440+0000 7f35d7fff640 1 -- 172.21.15.38:0/95000053 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d806cec0 con 0x7f35d806ca50 2023-12-22T08:41:46.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.441+0000 7f35d7fff640 1 --2- 172.21.15.38:0/95000053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35d806ca50 0x7f35d8070c00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009d90 tx=0x7f35d002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9220f5301b00d14f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:46.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.441+0000 7f35d67fc640 1 -- 172.21.15.38:0/95000053 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d002cb30 con 0x7f35d806ca50 2023-12-22T08:41:46.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.441+0000 7f35d67fc640 1 -- 172.21.15.38:0/95000053 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d002cc90 con 0x7f35d806ca50 2023-12-22T08:41:46.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.441+0000 7f35d67fc640 1 -- 172.21.15.38:0/95000053 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0034440 con 0x7f35d806ca50 2023-12-22T08:41:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.442+0000 7f35ddb00640 1 -- 172.21.15.38:0/95000053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35d806ca50 msgr2=0x7f35d8070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.442+0000 7f35ddb00640 1 --2- 172.21.15.38:0/95000053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35d806ca50 0x7f35d8070c00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009d90 tx=0x7f35d002bd80 comp rx=0 tx=0).stop 2023-12-22T08:41:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.442+0000 7f35ddb00640 1 -- 172.21.15.38:0/95000053 shutdown_connections 2023-12-22T08:41:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.442+0000 7f35ddb00640 1 --2- 172.21.15.38:0/95000053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35d806ca50 0x7f35d8070c00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.442+0000 7f35ddb00640 1 --2- 172.21.15.38:0/95000053 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d80b3f90 0x7f35d815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.442+0000 7f35ddb00640 1 -- 172.21.15.38:0/95000053 >> 172.21.15.38:0/95000053 conn(0x7f35d80cfea0 msgr2=0x7f35d80d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.442+0000 7f35ddb00640 1 -- 172.21.15.38:0/95000053 shutdown_connections 2023-12-22T08:41:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.442+0000 7f35ddb00640 1 -- 172.21.15.38:0/95000053 wait complete. 2023-12-22T08:41:46.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.444+0000 7f35ddb00640 1 Processor -- start 2023-12-22T08:41:46.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.444+0000 7f35ddb00640 1 -- start start 2023-12-22T08:41:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.445+0000 7f35ddb00640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d806ca50 0x7f35d815d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.445+0000 7f35ddb00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d80b3f90 0x7f35d81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.445+0000 7f35ddb00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35d815e740 0x7f35d8161730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.445+0000 7f35ddb00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d81571a0 con 0x7f35d815e740 2023-12-22T08:41:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.445+0000 7f35ddb00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d8157480 con 0x7f35d80b3f90 2023-12-22T08:41:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.445+0000 7f35ddb00640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d8157760 con 0x7f35d806ca50 2023-12-22T08:41:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.445+0000 7f35d7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35d815e740 0x7f35d8161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.445+0000 7f35d7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35d815e740 0x7f35d8161730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50286/0 (socket says 172.21.15.38:50286) 2023-12-22T08:41:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.445+0000 7f35d7fff640 1 -- 172.21.15.38:0/310095765 learned_addr learned my addr 172.21.15.38:0/310095765 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.446+0000 7f35d6ffd640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d80b3f90 0x7f35d81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.446+0000 7f35d77fe640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d806ca50 0x7f35d815d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.446+0000 7f35d7fff640 1 -- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d806ca50 msgr2=0x7f35d815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.446+0000 7f35d7fff640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d806ca50 0x7f35d815d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.446+0000 7f35d7fff640 1 -- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d80b3f90 msgr2=0x7f35d81568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.446+0000 7f35d7fff640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d80b3f90 0x7f35d81568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.446+0000 7f35d7fff640 1 -- 172.21.15.38:0/310095765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d0009a70 con 0x7f35d815e740 2023-12-22T08:41:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.446+0000 7f35d77fe640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d806ca50 0x7f35d815d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.446+0000 7f35d6ffd640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d80b3f90 0x7f35d81568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.446+0000 7f35d7fff640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35d815e740 0x7f35d8161730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009d90 tx=0x7f35d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.447+0000 7f35bffff640 1 -- 172.21.15.38:0/310095765 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0009450 con 0x7f35d815e740 2023-12-22T08:41:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.447+0000 7f35bffff640 1 -- 172.21.15.38:0/310095765 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d0040450 con 0x7f35d815e740 2023-12-22T08:41:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.447+0000 7f35bffff640 1 -- 172.21.15.38:0/310095765 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0040800 con 0x7f35d815e740 2023-12-22T08:41:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.447+0000 7f35ddb00640 1 -- 172.21.15.38:0/310095765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d8157a40 con 0x7f35d815e740 2023-12-22T08:41:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.447+0000 7f35ddb00640 1 -- 172.21.15.38:0/310095765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d8156e00 con 0x7f35d815e740 2023-12-22T08:41:46.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.448+0000 7f35ddb00640 1 -- 172.21.15.38:0/310095765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d81402f0 con 0x7f35d815e740 2023-12-22T08:41:46.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.449+0000 7f35bffff640 1 -- 172.21.15.38:0/310095765 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f35d0040960 con 0x7f35d815e740 2023-12-22T08:41:46.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.450+0000 7f35bffff640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f35c406a430 0x7f35c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:46.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.450+0000 7f35bffff640 1 -- 172.21.15.38:0/310095765 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35d00ab4c0 con 0x7f35d815e740 2023-12-22T08:41:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.450+0000 7f35d77fe640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f35c406a430 0x7f35c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.452+0000 7f35d77fe640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f35c406a430 0x7f35c406c8f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f35c80011e0 tx=0x7f35c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.454+0000 7f35bffff640 1 -- 172.21.15.38:0/310095765 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f35d81402f0 con 0x7f35d815e740 2023-12-22T08:41:46.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.686+0000 7f35ddb00640 1 -- 172.21.15.38:0/310095765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f35d81402f0 con 0x7f35d815e740 2023-12-22T08:41:46.691 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:41:46.688+0000 7f0a26ee3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T08:41:46.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.706+0000 7f35bffff640 1 -- 172.21.15.38:0/310095765 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f35d81402f0 con 0x7f35d815e740 2023-12-22T08:41:46.709 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T08:41:46.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.709+0000 7f35ddb00640 1 -- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f35c406a430 msgr2=0x7f35c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:46.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.709+0000 7f35ddb00640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f35c406a430 0x7f35c406c8f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f35c80011e0 tx=0x7f35c8009040 comp rx=0 tx=0).stop 2023-12-22T08:41:46.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.709+0000 7f35ddb00640 1 -- 172.21.15.38:0/310095765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35d815e740 msgr2=0x7f35d8161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:46.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.709+0000 7f35ddb00640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35d815e740 0x7f35d8161730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009d90 tx=0x7f35d0004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:46.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.710+0000 7f35ddb00640 1 -- 172.21.15.38:0/310095765 shutdown_connections 2023-12-22T08:41:46.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.710+0000 7f35ddb00640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f35c406a430 0x7f35c406c8f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.710+0000 7f35ddb00640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35d815e740 0x7f35d8161730 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.710+0000 7f35ddb00640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d80b3f90 0x7f35d81568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.710+0000 7f35ddb00640 1 --2- 172.21.15.38:0/310095765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d806ca50 0x7f35d815d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.710+0000 7f35ddb00640 1 -- 172.21.15.38:0/310095765 >> 172.21.15.38:0/310095765 conn(0x7f35d80cfea0 msgr2=0x7f35d80d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:46.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.710+0000 7f35ddb00640 1 -- 172.21.15.38:0/310095765 shutdown_connections 2023-12-22T08:41:46.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.710+0000 7f35ddb00640 1 -- 172.21.15.38:0/310095765 wait complete. 2023-12-22T08:41:46.731 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T08:41:46.735 INFO:tasks.ceph.mds.a.smithi038.stderr: -5085> 2023-12-22T08:41:16.510+0000 7f6088755640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:41:46.824 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:41:46.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.939+0000 7f4bb3fff640 1 Processor -- start 2023-12-22T08:41:46.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.940+0000 7f4bb3fff640 1 -- start start 2023-12-22T08:41:46.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.941+0000 7f4bb3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4bb409c980 0x7f4bb415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:46.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.941+0000 7f4bb3fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4bb4071460 0x7f4bb4071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:46.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.941+0000 7f4bb3fff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb415edf0 con 0x7f4bb415b0e0 2023-12-22T08:41:46.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.941+0000 7f4bb3fff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb4071db0 con 0x7f4bb4071460 2023-12-22T08:41:46.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.941+0000 7f4bb3fff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb415bd90 con 0x7f4bb409c980 2023-12-22T08:41:46.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.942+0000 7f4bb37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4bb4071460 0x7f4bb4071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:46.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.942+0000 7f4bb37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4bb4071460 0x7f4bb4071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50310/0 (socket says 172.21.15.38:50310) 2023-12-22T08:41:46.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.942+0000 7f4bb37fe640 1 -- 172.21.15.38:0/786328393 learned_addr learned my addr 172.21.15.38:0/786328393 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:46.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.942+0000 7f4bb27fc640 1 --2- 172.21.15.38:0/786328393 >> v2:172.21.15.89:3300/0 conn(0x7f4bb409c980 0x7f4bb415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:46.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.942+0000 7f4bb37fe640 1 -- 172.21.15.38:0/786328393 >> v2:172.21.15.89:3300/0 conn(0x7f4bb409c980 msgr2=0x7f4bb415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:46.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.942+0000 7f4bb37fe640 1 --2- 172.21.15.38:0/786328393 >> v2:172.21.15.89:3300/0 conn(0x7f4bb409c980 0x7f4bb415c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.942+0000 7f4bb37fe640 1 -- 172.21.15.38:0/786328393 >> v1:172.21.15.89:6789/0 conn(0x7f4bb415b0e0 legacy=0x7f4bb415b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:46.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.942+0000 7f4bb37fe640 1 -- 172.21.15.38:0/786328393 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb415c070 con 0x7f4bb4071460 2023-12-22T08:41:46.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.943+0000 7f4bb37fe640 1 --2- 172.21.15.38:0/786328393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bb4071460 0x7f4bb4071870 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4bb406a580 tx=0x7f4bac02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2715fdc38fd18d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:46.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.944+0000 7f4bb1ffb640 1 -- 172.21.15.38:0/786328393 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac02c960 con 0x7f4bb4071460 2023-12-22T08:41:46.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.944+0000 7f4bb1ffb640 1 -- 172.21.15.38:0/786328393 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac02cac0 con 0x7f4bb4071460 2023-12-22T08:41:46.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.944+0000 7f4bb1ffb640 1 -- 172.21.15.38:0/786328393 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac02ce50 con 0x7f4bb4071460 2023-12-22T08:41:46.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.944+0000 7f4bb3fff640 1 -- 172.21.15.38:0/786328393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bb4071460 msgr2=0x7f4bb4071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:46.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.944+0000 7f4bb3fff640 1 --2- 172.21.15.38:0/786328393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bb4071460 0x7f4bb4071870 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4bb406a580 tx=0x7f4bac02bdc0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.944+0000 7f4bb3fff640 1 -- 172.21.15.38:0/786328393 shutdown_connections 2023-12-22T08:41:46.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.944+0000 7f4bb3fff640 1 --2- 172.21.15.38:0/786328393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bb4071460 0x7f4bb4071870 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.944+0000 7f4bb3fff640 1 --2- 172.21.15.38:0/786328393 >> v2:172.21.15.89:3300/0 conn(0x7f4bb409c980 0x7f4bb415c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.944+0000 7f4bb3fff640 1 -- 172.21.15.38:0/786328393 >> 172.21.15.38:0/786328393 conn(0x7f4bb40cf000 msgr2=0x7f4bb40cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:46.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.945+0000 7f4bb3fff640 1 -- 172.21.15.38:0/786328393 shutdown_connections 2023-12-22T08:41:46.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.945+0000 7f4bb3fff640 1 -- 172.21.15.38:0/786328393 wait complete. 2023-12-22T08:41:46.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.946+0000 7f4bb3fff640 1 Processor -- start 2023-12-22T08:41:46.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.946+0000 7f4bb3fff640 1 -- start start 2023-12-22T08:41:46.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.947+0000 7f4bb3fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bb4071460 0x7f4bb4159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:46.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.947+0000 7f4bb3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bb409c980 0x7f4bb40c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:46.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.947+0000 7f4bb3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bb415b0e0 0x7f4bb40ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:46.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.947+0000 7f4bb3fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb415ddd0 con 0x7f4bb409c980 2023-12-22T08:41:46.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.947+0000 7f4bb3fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40704b0 con 0x7f4bb415b0e0 2023-12-22T08:41:46.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.948+0000 7f4bb3fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb4070790 con 0x7f4bb4071460 2023-12-22T08:41:46.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.948+0000 7f4bb27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bb409c980 0x7f4bb40c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:46.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.948+0000 7f4bb27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bb409c980 0x7f4bb40c8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50322/0 (socket says 172.21.15.38:50322) 2023-12-22T08:41:46.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.948+0000 7f4bb27fc640 1 -- 172.21.15.38:0/499627250 learned_addr learned my addr 172.21.15.38:0/499627250 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:46.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.948+0000 7f4bb37fe640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bb415b0e0 0x7f4bb40ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:46.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.948+0000 7f4bb2ffd640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bb4071460 0x7f4bb4159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:46.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.948+0000 7f4bb27fc640 1 -- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bb4071460 msgr2=0x7f4bb4159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:46.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.948+0000 7f4bb27fc640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bb4071460 0x7f4bb4159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.948+0000 7f4bb27fc640 1 -- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bb415b0e0 msgr2=0x7f4bb40ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:46.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.948+0000 7f4bb27fc640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bb415b0e0 0x7f4bb40ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:46.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.948+0000 7f4bb27fc640 1 -- 172.21.15.38:0/499627250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac009b30 con 0x7f4bb409c980 2023-12-22T08:41:46.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.948+0000 7f4bb2ffd640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bb4071460 0x7f4bb4159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:46.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.948+0000 7f4bb37fe640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bb415b0e0 0x7f4bb40ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:46.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.949+0000 7f4bb27fc640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bb409c980 0x7f4bb40c8e60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00d800 tx=0x7f4b9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:46.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.949+0000 7f4bab7fe640 1 -- 172.21.15.38:0/499627250 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00b6c0 con 0x7f4bb409c980 2023-12-22T08:41:46.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.949+0000 7f4bab7fe640 1 -- 172.21.15.38:0/499627250 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c00b820 con 0x7f4bb409c980 2023-12-22T08:41:46.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.949+0000 7f4bb3fff640 1 -- 172.21.15.38:0/499627250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb4070a70 con 0x7f4bb409c980 2023-12-22T08:41:46.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.949+0000 7f4bab7fe640 1 -- 172.21.15.38:0/499627250 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00bbb0 con 0x7f4bb409c980 2023-12-22T08:41:46.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.949+0000 7f4bb3fff640 1 -- 172.21.15.38:0/499627250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb4070f90 con 0x7f4bb409c980 2023-12-22T08:41:46.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.950+0000 7f4bb3fff640 1 -- 172.21.15.38:0/499627250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb4061910 con 0x7f4bb409c980 2023-12-22T08:41:46.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.951+0000 7f4bab7fe640 1 -- 172.21.15.38:0/499627250 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b9c00bd10 con 0x7f4bb409c980 2023-12-22T08:41:46.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.953+0000 7f4bab7fe640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b9406a430 0x7f4b9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:46.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.953+0000 7f4bab7fe640 1 -- 172.21.15.38:0/499627250 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4b9c088ec0 con 0x7f4bb409c980 2023-12-22T08:41:46.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.954+0000 7f4bb2ffd640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b9406a430 0x7f4b9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:46.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.955+0000 7f4bb2ffd640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b9406a430 0x7f4b9406c8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400a830 tx=0x7f4ba4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:46.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:46.957+0000 7f4bab7fe640 1 -- 172.21.15.38:0/499627250 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4b9c054450 con 0x7f4bb409c980 2023-12-22T08:41:47.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.194+0000 7f4bb3fff640 1 -- 172.21.15.38:0/499627250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4bb406d7d0 con 0x7f4bb409c980 2023-12-22T08:41:47.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.711+0000 7f4bab7fe640 1 -- 172.21.15.38:0/499627250 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4b9c057a70 con 0x7f4bb409c980 2023-12-22T08:41:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.714+0000 7f4bb3fff640 1 -- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b9406a430 msgr2=0x7f4b9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.714+0000 7f4bb3fff640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b9406a430 0x7f4b9406c8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400a830 tx=0x7f4ba4008040 comp rx=0 tx=0).stop 2023-12-22T08:41:47.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.714+0000 7f4bb3fff640 1 -- 172.21.15.38:0/499627250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bb409c980 msgr2=0x7f4bb40c8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:47.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.714+0000 7f4bb3fff640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bb409c980 0x7f4bb40c8e60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00d800 tx=0x7f4b9c00dcc0 comp rx=0 tx=0).stop 2023-12-22T08:41:47.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.715+0000 7f4bb3fff640 1 -- 172.21.15.38:0/499627250 shutdown_connections 2023-12-22T08:41:47.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.715+0000 7f4bb3fff640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bb415b0e0 0x7f4bb40ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:47.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.715+0000 7f4bb3fff640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b9406a430 0x7f4b9406c8f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:47.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.715+0000 7f4bb3fff640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4bb409c980 0x7f4bb40c8e60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:47.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.715+0000 7f4bb3fff640 1 --2- 172.21.15.38:0/499627250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bb4071460 0x7f4bb4159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:47.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.715+0000 7f4bb3fff640 1 -- 172.21.15.38:0/499627250 >> 172.21.15.38:0/499627250 conn(0x7f4bb40cf000 msgr2=0x7f4bb415f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:47.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.715+0000 7f4bb3fff640 1 -- 172.21.15.38:0/499627250 shutdown_connections 2023-12-22T08:41:47.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.715+0000 7f4bb3fff640 1 -- 172.21.15.38:0/499627250 wait complete. 2023-12-22T08:41:47.737 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T08:41:47.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.967+0000 7f1e42b9e640 1 Processor -- start 2023-12-22T08:41:47.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.968+0000 7f1e42b9e640 1 -- start start 2023-12-22T08:41:47.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.969+0000 7f1e42b9e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1e3c15b370 0x7f1e3c06d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:47.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.969+0000 7f1e42b9e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e3c06d6a0 0x7f1e3c0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:47.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.969+0000 7f1e42b9e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c15ca20 con 0x7f1e3c0ae4f0 2023-12-22T08:41:47.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.969+0000 7f1e42b9e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c0ae980 con 0x7f1e3c15b370 2023-12-22T08:41:47.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.969+0000 7f1e42b9e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c15b750 con 0x7f1e3c06d6a0 2023-12-22T08:41:47.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.970+0000 7f1e41b9c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1e3c15b370 0x7f1e3c06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:47.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.970+0000 7f1e41b9c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1e3c15b370 0x7f1e3c06d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:58642/0 (socket says 172.21.15.38:58642) 2023-12-22T08:41:47.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.970+0000 7f1e41b9c640 1 -- 172.21.15.38:0/2967433592 learned_addr learned my addr 172.21.15.38:0/2967433592 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:47.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.970+0000 7f1e4139b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e3c06d6a0 0x7f1e3c0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:47.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.971+0000 7f1e41b9c640 1 -- 172.21.15.38:0/2967433592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e3c06d6a0 msgr2=0x7f1e3c0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:47.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.971+0000 7f1e41b9c640 1 --2- 172.21.15.38:0/2967433592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e3c06d6a0 0x7f1e3c0adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:47.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.971+0000 7f1e41b9c640 1 -- 172.21.15.38:0/2967433592 >> v1:172.21.15.89:6789/0 conn(0x7f1e3c0ae4f0 legacy=0x7f1e3c0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:47.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.971+0000 7f1e41b9c640 1 -- 172.21.15.38:0/2967433592 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c06dc20 con 0x7f1e3c15b370 2023-12-22T08:41:47.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.973+0000 7f1e41b9c640 1 --2- 172.21.15.38:0/2967433592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e3c15b370 0x7f1e3c06d160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1e380098a0 tx=0x7f1e3802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5518c5d8466857f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:47.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.973+0000 7f1e40b9a640 1 -- 172.21.15.38:0/2967433592 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38030840 con 0x7f1e3c15b370 2023-12-22T08:41:47.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.973+0000 7f1e40b9a640 1 -- 172.21.15.38:0/2967433592 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e380309a0 con 0x7f1e3c15b370 2023-12-22T08:41:47.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.973+0000 7f1e40b9a640 1 -- 172.21.15.38:0/2967433592 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38030d30 con 0x7f1e3c15b370 2023-12-22T08:41:47.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.974+0000 7f1e42b9e640 1 -- 172.21.15.38:0/2967433592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e3c15b370 msgr2=0x7f1e3c06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:47.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.974+0000 7f1e42b9e640 1 --2- 172.21.15.38:0/2967433592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e3c15b370 0x7f1e3c06d160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1e380098a0 tx=0x7f1e3802b980 comp rx=0 tx=0).stop 2023-12-22T08:41:47.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.974+0000 7f1e42b9e640 1 -- 172.21.15.38:0/2967433592 shutdown_connections 2023-12-22T08:41:47.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.974+0000 7f1e42b9e640 1 --2- 172.21.15.38:0/2967433592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e3c06d6a0 0x7f1e3c0adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:47.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.974+0000 7f1e42b9e640 1 --2- 172.21.15.38:0/2967433592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e3c15b370 0x7f1e3c06d160 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:47.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.974+0000 7f1e42b9e640 1 -- 172.21.15.38:0/2967433592 >> 172.21.15.38:0/2967433592 conn(0x7f1e3c0b1110 msgr2=0x7f1e3c0b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:47.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.974+0000 7f1e42b9e640 1 -- 172.21.15.38:0/2967433592 shutdown_connections 2023-12-22T08:41:47.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.974+0000 7f1e42b9e640 1 -- 172.21.15.38:0/2967433592 wait complete. 2023-12-22T08:41:47.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.977+0000 7f1e42b9e640 1 Processor -- start 2023-12-22T08:41:47.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.977+0000 7f1e42b9e640 1 -- start start 2023-12-22T08:41:47.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.978+0000 7f1e42b9e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e3c06d6a0 0x7f1e3c1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:47.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.978+0000 7f1e42b9e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e3c0ae4f0 0x7f1e3c15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:47.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.978+0000 7f1e42b9e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e3c15b370 0x7f1e3c159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:47.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.978+0000 7f1e42b9e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c1f3730 con 0x7f1e3c0ae4f0 2023-12-22T08:41:47.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.978+0000 7f1e42b9e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c1f2b20 con 0x7f1e3c06d6a0 2023-12-22T08:41:47.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.978+0000 7f1e42b9e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c1f2e00 con 0x7f1e3c15b370 2023-12-22T08:41:47.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.979+0000 7f1e4139b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e3c0ae4f0 0x7f1e3c15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:47.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.979+0000 7f1e4139b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e3c0ae4f0 0x7f1e3c15d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50330/0 (socket says 172.21.15.38:50330) 2023-12-22T08:41:47.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.979+0000 7f1e4139b640 1 -- 172.21.15.38:0/89002339 learned_addr learned my addr 172.21.15.38:0/89002339 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:47.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.979+0000 7f1e41b9c640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e3c06d6a0 0x7f1e3c1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:47.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.979+0000 7f1e4239d640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e3c15b370 0x7f1e3c159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.979+0000 7f1e4139b640 1 -- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e3c15b370 msgr2=0x7f1e3c159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.979+0000 7f1e4139b640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e3c15b370 0x7f1e3c159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.979+0000 7f1e4139b640 1 -- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e3c06d6a0 msgr2=0x7f1e3c1579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.979+0000 7f1e4139b640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e3c06d6a0 0x7f1e3c1579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.979+0000 7f1e4139b640 1 -- 172.21.15.38:0/89002339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e380094d0 con 0x7f1e3c0ae4f0 2023-12-22T08:41:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.980+0000 7f1e4139b640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e3c0ae4f0 0x7f1e3c15d3f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00e9b0 tx=0x7f1e2c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.980+0000 7f1e327fc640 1 -- 172.21.15.38:0/89002339 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c009670 con 0x7f1e3c0ae4f0 2023-12-22T08:41:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.980+0000 7f1e327fc640 1 -- 172.21.15.38:0/89002339 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c00c9a0 con 0x7f1e3c0ae4f0 2023-12-22T08:41:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.980+0000 7f1e42b9e640 1 -- 172.21.15.38:0/89002339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c1f30e0 con 0x7f1e3c0ae4f0 2023-12-22T08:41:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.980+0000 7f1e327fc640 1 -- 172.21.15.38:0/89002339 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c00cd50 con 0x7f1e3c0ae4f0 2023-12-22T08:41:47.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.980+0000 7f1e42b9e640 1 -- 172.21.15.38:0/89002339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c157ee0 con 0x7f1e3c0ae4f0 2023-12-22T08:41:47.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.981+0000 7f1e42b9e640 1 -- 172.21.15.38:0/89002339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c061910 con 0x7f1e3c0ae4f0 2023-12-22T08:41:47.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.982+0000 7f1e327fc640 1 -- 172.21.15.38:0/89002339 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1e2c013470 con 0x7f1e3c0ae4f0 2023-12-22T08:41:47.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.984+0000 7f1e327fc640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e2006a460 0x7f1e2006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:47.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.984+0000 7f1e327fc640 1 -- 172.21.15.38:0/89002339 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1e2c088b50 con 0x7f1e3c0ae4f0 2023-12-22T08:41:47.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.984+0000 7f1e41b9c640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e2006a460 0x7f1e2006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:47.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.985+0000 7f1e41b9c640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e2006a460 0x7f1e2006c920 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1e38036000 tx=0x7f1e38008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:47.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:47.988+0000 7f1e327fc640 1 -- 172.21.15.38:0/89002339 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1e2c054190 con 0x7f1e3c0ae4f0 2023-12-22T08:41:48.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.186+0000 7f1e42b9e640 1 -- 172.21.15.38:0/89002339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e3c06fe40 con 0x7f1e3c0ae4f0 2023-12-22T08:41:48.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.336+0000 7f1e327fc640 1 -- 172.21.15.38:0/89002339 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1e2c0170d0 con 0x7f1e3c0ae4f0 2023-12-22T08:41:48.339 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2023-12-22T08:41:48.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.339+0000 7f1e42b9e640 1 -- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e2006a460 msgr2=0x7f1e2006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.340+0000 7f1e42b9e640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e2006a460 0x7f1e2006c920 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1e38036000 tx=0x7f1e38008030 comp rx=0 tx=0).stop 2023-12-22T08:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.340+0000 7f1e42b9e640 1 -- 172.21.15.38:0/89002339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e3c0ae4f0 msgr2=0x7f1e3c15d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.340+0000 7f1e42b9e640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e3c0ae4f0 0x7f1e3c15d3f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00e9b0 tx=0x7f1e2c00ee70 comp rx=0 tx=0).stop 2023-12-22T08:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.340+0000 7f1e42b9e640 1 -- 172.21.15.38:0/89002339 shutdown_connections 2023-12-22T08:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.340+0000 7f1e42b9e640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1e3c15b370 0x7f1e3c159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.340+0000 7f1e42b9e640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e2006a460 0x7f1e2006c920 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.340+0000 7f1e42b9e640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e3c0ae4f0 0x7f1e3c15d3f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.340+0000 7f1e42b9e640 1 --2- 172.21.15.38:0/89002339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e3c06d6a0 0x7f1e3c1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.340+0000 7f1e42b9e640 1 -- 172.21.15.38:0/89002339 >> 172.21.15.38:0/89002339 conn(0x7f1e3c0b1110 msgr2=0x7f1e3c070640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.340+0000 7f1e42b9e640 1 -- 172.21.15.38:0/89002339 shutdown_connections 2023-12-22T08:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.340+0000 7f1e42b9e640 1 -- 172.21.15.38:0/89002339 wait complete. 2023-12-22T08:41:48.367 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T08:41:48.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.585+0000 7ff5b9eca640 1 Processor -- start 2023-12-22T08:41:48.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.586+0000 7ff5b9eca640 1 -- start start 2023-12-22T08:41:48.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.587+0000 7ff5b9eca640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff5b4146e40 0x7ff5b40cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.587+0000 7ff5b9eca640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5b41618d0 0x7ff5b4070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.587+0000 7ff5b9eca640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b40b4120 con 0x7ff5b4161df0 2023-12-22T08:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.587+0000 7ff5b9eca640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b40b4da0 con 0x7ff5b4146e40 2023-12-22T08:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.587+0000 7ff5b9eca640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b40b4400 con 0x7ff5b41618d0 2023-12-22T08:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.588+0000 7ff5b37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff5b4146e40 0x7ff5b40cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.588+0000 7ff5b37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff5b4146e40 0x7ff5b40cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50342/0 (socket says 172.21.15.38:50342) 2023-12-22T08:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.588+0000 7ff5b37fe640 1 -- 172.21.15.38:0/1523495746 learned_addr learned my addr 172.21.15.38:0/1523495746 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.588+0000 7ff5b3fff640 1 --2- 172.21.15.38:0/1523495746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5b41618d0 0x7ff5b4070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.588+0000 7ff5b37fe640 1 -- 172.21.15.38:0/1523495746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5b41618d0 msgr2=0x7ff5b4070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.588+0000 7ff5b37fe640 1 --2- 172.21.15.38:0/1523495746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5b41618d0 0x7ff5b4070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.588+0000 7ff5b37fe640 1 -- 172.21.15.38:0/1523495746 >> v1:172.21.15.89:6789/0 conn(0x7ff5b4161df0 legacy=0x7ff5b41611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.588+0000 7ff5b37fe640 1 -- 172.21.15.38:0/1523495746 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b40b46e0 con 0x7ff5b4146e40 2023-12-22T08:41:48.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.588+0000 7ff5b3fff640 1 --2- 172.21.15.38:0/1523495746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5b41618d0 0x7ff5b4070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:48.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.589+0000 7ff5b37fe640 1 --2- 172.21.15.38:0/1523495746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5b4146e40 0x7ff5b40cf6b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009870 tx=0x7ff5a402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c517c9c828a714 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:48.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.590+0000 7ff5b27fc640 1 -- 172.21.15.38:0/1523495746 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4031740 con 0x7ff5b4146e40 2023-12-22T08:41:48.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.590+0000 7ff5b27fc640 1 -- 172.21.15.38:0/1523495746 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a40318a0 con 0x7ff5b4146e40 2023-12-22T08:41:48.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.590+0000 7ff5b27fc640 1 -- 172.21.15.38:0/1523495746 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4031c30 con 0x7ff5b4146e40 2023-12-22T08:41:48.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.590+0000 7ff5b9eca640 1 -- 172.21.15.38:0/1523495746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5b4146e40 msgr2=0x7ff5b40cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:48.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.590+0000 7ff5b9eca640 1 --2- 172.21.15.38:0/1523495746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5b4146e40 0x7ff5b40cf6b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009870 tx=0x7ff5a402b7e0 comp rx=0 tx=0).stop 2023-12-22T08:41:48.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.590+0000 7ff5b9eca640 1 -- 172.21.15.38:0/1523495746 shutdown_connections 2023-12-22T08:41:48.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.590+0000 7ff5b9eca640 1 --2- 172.21.15.38:0/1523495746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5b41618d0 0x7ff5b4070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:48.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.590+0000 7ff5b9eca640 1 --2- 172.21.15.38:0/1523495746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5b4146e40 0x7ff5b40cf6b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:48.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.590+0000 7ff5b9eca640 1 -- 172.21.15.38:0/1523495746 >> 172.21.15.38:0/1523495746 conn(0x7ff5b40cff10 msgr2=0x7ff5b40d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:48.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.591+0000 7ff5b9eca640 1 -- 172.21.15.38:0/1523495746 shutdown_connections 2023-12-22T08:41:48.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.591+0000 7ff5b9eca640 1 -- 172.21.15.38:0/1523495746 wait complete. 2023-12-22T08:41:48.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.592+0000 7ff5b9eca640 1 Processor -- start 2023-12-22T08:41:48.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.592+0000 7ff5b9eca640 1 -- start start 2023-12-22T08:41:48.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.593+0000 7ff5b9eca640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5b4146e40 0x7ff5b40b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:48.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.593+0000 7ff5b9eca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5b41618d0 0x7ff5b41f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:48.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.593+0000 7ff5b9eca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5b4161df0 0x7ff5b40d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:48.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b9eca640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41f76c0 con 0x7ff5b41618d0 2023-12-22T08:41:48.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b9eca640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b4157440 con 0x7ff5b4161df0 2023-12-22T08:41:48.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b9eca640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b41f3660 con 0x7ff5b4146e40 2023-12-22T08:41:48.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5b41618d0 0x7ff5b41f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:48.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5b41618d0 0x7ff5b41f7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50358/0 (socket says 172.21.15.38:50358) 2023-12-22T08:41:48.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b2ffd640 1 -- 172.21.15.38:0/3666686518 learned_addr learned my addr 172.21.15.38:0/3666686518 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:48.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b37fe640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5b4146e40 0x7ff5b40b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:48.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b3fff640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5b4161df0 0x7ff5b40d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:48.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b2ffd640 1 -- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5b4146e40 msgr2=0x7ff5b40b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:48.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b2ffd640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5b4146e40 0x7ff5b40b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:48.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b2ffd640 1 -- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5b4161df0 msgr2=0x7ff5b40d1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:48.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b2ffd640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5b4161df0 0x7ff5b40d1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:48.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b2ffd640 1 -- 172.21.15.38:0/3666686518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40094d0 con 0x7ff5b41618d0 2023-12-22T08:41:48.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.594+0000 7ff5b3fff640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5b4161df0 0x7ff5b40d1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:48.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.595+0000 7ff5b2ffd640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5b41618d0 0x7ff5b41f7180 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800b3e0 tx=0x7ff5a800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:48.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.595+0000 7ff59bfff640 1 -- 172.21.15.38:0/3666686518 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8011830 con 0x7ff5b41618d0 2023-12-22T08:41:48.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.595+0000 7ff59bfff640 1 -- 172.21.15.38:0/3666686518 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a80119b0 con 0x7ff5b41618d0 2023-12-22T08:41:48.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.595+0000 7ff59bfff640 1 -- 172.21.15.38:0/3666686518 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8011da0 con 0x7ff5b41618d0 2023-12-22T08:41:48.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.595+0000 7ff5b9eca640 1 -- 172.21.15.38:0/3666686518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b41f3940 con 0x7ff5b41618d0 2023-12-22T08:41:48.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.595+0000 7ff5b9eca640 1 -- 172.21.15.38:0/3666686518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b41f3f00 con 0x7ff5b41618d0 2023-12-22T08:41:48.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.596+0000 7ff5b9eca640 1 -- 172.21.15.38:0/3666686518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b41575b0 con 0x7ff5b41618d0 2023-12-22T08:41:48.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.597+0000 7ff59bfff640 1 -- 172.21.15.38:0/3666686518 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff5a801a410 con 0x7ff5b41618d0 2023-12-22T08:41:48.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.598+0000 7ff59bfff640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff5a006a430 0x7ff5a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:48.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.598+0000 7ff59bfff640 1 -- 172.21.15.38:0/3666686518 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5473+0+0 (secure 0 0 0) 0x7ff5a80888c0 con 0x7ff5b41618d0 2023-12-22T08:41:48.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.599+0000 7ff5b37fe640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff5a006a430 0x7ff5a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:48.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.600+0000 7ff5b37fe640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff5a006a430 0x7ff5a006c8f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4035000 tx=0x7ff5a4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:48.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.602+0000 7ff59bfff640 1 -- 172.21.15.38:0/3666686518 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff5b41575b0 con 0x7ff5b41618d0 2023-12-22T08:41:48.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:48.796+0000 7ff5b9eca640 1 -- 172.21.15.38:0/3666686518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff5b41575b0 con 0x7ff5b41618d0 2023-12-22T08:41:49.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.352+0000 7ff59bfff640 1 -- 172.21.15.38:0/3666686518 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff5b41575b0 con 0x7ff5b41618d0 2023-12-22T08:41:49.355 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2023-12-22T08:41:49.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.358+0000 7ff5b9eca640 1 -- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff5a006a430 msgr2=0x7ff5a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:49.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.358+0000 7ff5b9eca640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff5a006a430 0x7ff5a006c8f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4035000 tx=0x7ff5a4008030 comp rx=0 tx=0).stop 2023-12-22T08:41:49.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.358+0000 7ff5b9eca640 1 -- 172.21.15.38:0/3666686518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5b41618d0 msgr2=0x7ff5b41f7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:49.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.358+0000 7ff5b9eca640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5b41618d0 0x7ff5b41f7180 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800b3e0 tx=0x7ff5a800b8a0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.360+0000 7ff5b9eca640 1 -- 172.21.15.38:0/3666686518 shutdown_connections 2023-12-22T08:41:49.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.360+0000 7ff5b9eca640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5b4161df0 0x7ff5b40d1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.360+0000 7ff5b9eca640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff5a006a430 0x7ff5a006c8f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.360+0000 7ff5b9eca640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5b41618d0 0x7ff5b41f7180 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.360+0000 7ff5b9eca640 1 --2- 172.21.15.38:0/3666686518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5b4146e40 0x7ff5b40b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.360+0000 7ff5b9eca640 1 -- 172.21.15.38:0/3666686518 >> 172.21.15.38:0/3666686518 conn(0x7ff5b40cff10 msgr2=0x7ff5b40b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:49.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.361+0000 7ff5b9eca640 1 -- 172.21.15.38:0/3666686518 shutdown_connections 2023-12-22T08:41:49.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.361+0000 7ff5b9eca640 1 -- 172.21.15.38:0/3666686518 wait complete. 2023-12-22T08:41:49.384 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-22T08:41:49.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.595+0000 7fb5b3fff640 1 Processor -- start 2023-12-22T08:41:49.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.595+0000 7fb5b3fff640 1 -- start start 2023-12-22T08:41:49.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.597+0000 7fb5b3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5b40b6620 0x7fb5b40b8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:49.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.597+0000 7fb5b3fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4146f00 0x7fb5b40d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:49.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.597+0000 7fb5b3fff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b40b4430 con 0x7fb5b40b3b20 2023-12-22T08:41:49.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.597+0000 7fb5b3fff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b40b4710 con 0x7fb5b40b6620 2023-12-22T08:41:49.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.597+0000 7fb5b3fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b40b49f0 con 0x7fb5b4146f00 2023-12-22T08:41:49.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.597+0000 7fb5b27fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb5b40b3b20 0x7fb5b41467f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43770/0 (socket says 172.21.15.38:43770) 2023-12-22T08:41:49.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.597+0000 7fb5b27fc640 1 -- 172.21.15.38:0/1947755660 learned_addr learned my addr 172.21.15.38:0/1947755660 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:49.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.598+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153013790 0 0) 0x7fb5b40b4430 con 0x7fb5b40b3b20 2023-12-22T08:41:49.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.598+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb59c003520 con 0x7fb5b40b3b20 2023-12-22T08:41:49.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.598+0000 7fb5b37fe640 1 --2- 172.21.15.38:0/1947755660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4146f00 0x7fb5b40d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:49.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.598+0000 7fb5b2ffd640 1 --2- 172.21.15.38:0/1947755660 >> v2:172.21.15.89:3300/0 conn(0x7fb5b40b6620 0x7fb5b40b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:49.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.598+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 544308425 0 0) 0x7fb59c003520 con 0x7fb5b40b3b20 2023-12-22T08:41:49.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.598+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4146f00 msgr2=0x7fb5b40d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:49.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.598+0000 7fb5b1ffb640 1 --2- 172.21.15.38:0/1947755660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4146f00 0x7fb5b40d0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.598+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 >> v2:172.21.15.89:3300/0 conn(0x7fb5b40b6620 msgr2=0x7fb5b40b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.598+0000 7fb5b1ffb640 1 --2- 172.21.15.38:0/1947755660 >> v2:172.21.15.89:3300/0 conn(0x7fb5b40b6620 0x7fb5b40b8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.598+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b40b4cd0 con 0x7fb5b40b3b20 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.598+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fb5a8001670 con 0x7fb5b40b3b20 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.598+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 >> v1:172.21.15.38:6789/0 conn(0x7fb5b40b3b20 legacy=0x7fb5b41467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.598+0000 7fb5b1ffb640 1 --2- 172.21.15.38:0/1947755660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4146f00 0x7fb59c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.599+0000 7fb5b1ffb640 1 --2- 172.21.15.38:0/1947755660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb59c003ff0 0x7fb59c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.599+0000 7fb5b1ffb640 1 --2- 172.21.15.38:0/1947755660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb59c004d00 0x7fb59c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.599+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b40b4710 con 0x7fb59c004d00 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.599+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b40b49f0 con 0x7fb59c003ff0 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.599+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c00bb90 con 0x7fb5b4146f00 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.599+0000 7fb5b37fe640 1 --2- 172.21.15.38:0/1947755660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb59c004d00 0x7fb59c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.599+0000 7fb5b2ffd640 1 --2- 172.21.15.38:0/1947755660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4146f00 0x7fb59c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.599+0000 7fb5b27fc640 1 --2- 172.21.15.38:0/1947755660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb59c003ff0 0x7fb59c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:49.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.599+0000 7fb5b37fe640 1 -- 172.21.15.38:0/1947755660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4146f00 msgr2=0x7fb59c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:49.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.599+0000 7fb5b37fe640 1 --2- 172.21.15.38:0/1947755660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4146f00 0x7fb59c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.599+0000 7fb5b37fe640 1 -- 172.21.15.38:0/1947755660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb59c003ff0 msgr2=0x7fb59c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:49.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.599+0000 7fb5b37fe640 1 --2- 172.21.15.38:0/1947755660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb59c003ff0 0x7fb59c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.599+0000 7fb5b37fe640 1 -- 172.21.15.38:0/1947755660 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c003520 con 0x7fb59c004d00 2023-12-22T08:41:49.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.600+0000 7fb5b37fe640 1 --2- 172.21.15.38:0/1947755660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb59c004d00 0x7fb59c005180 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00ba00 tx=0x7fb59c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7affd3ea78c768 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:49.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.601+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac032620 con 0x7fb59c004d00 2023-12-22T08:41:49.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.601+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac032780 con 0x7fb59c004d00 2023-12-22T08:41:49.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.601+0000 7fb5b1ffb640 1 -- 172.21.15.38:0/1947755660 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac032b10 con 0x7fb59c004d00 2023-12-22T08:41:49.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.601+0000 7fb5b3fff640 1 -- 172.21.15.38:0/1947755660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb59c004d00 msgr2=0x7fb59c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:49.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.601+0000 7fb5b3fff640 1 --2- 172.21.15.38:0/1947755660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb59c004d00 0x7fb59c005180 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00ba00 tx=0x7fb59c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.601+0000 7fb5b37fe640 1 -- 172.21.15.38:0/1947755660 reap_dead start 2023-12-22T08:41:49.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.601+0000 7fb5b3fff640 1 -- 172.21.15.38:0/1947755660 shutdown_connections 2023-12-22T08:41:49.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.601+0000 7fb5b3fff640 1 -- 172.21.15.38:0/1947755660 >> 172.21.15.38:0/1947755660 conn(0x7fb5b40d32c0 msgr2=0x7fb5b40d36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:49.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.602+0000 7fb5b3fff640 1 -- 172.21.15.38:0/1947755660 shutdown_connections 2023-12-22T08:41:49.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.602+0000 7fb5b3fff640 1 -- 172.21.15.38:0/1947755660 wait complete. 2023-12-22T08:41:49.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.603+0000 7fb5b3fff640 1 Processor -- start 2023-12-22T08:41:49.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.604+0000 7fb5b3fff640 1 -- start start 2023-12-22T08:41:49.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb59c004d00 0x7fb5b41569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:49.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b413f7d0 0x7fb5b413fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:49.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b3fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4143390 0x7fb5b4143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:49.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b3fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4143d50 con 0x7fb5b413f7d0 2023-12-22T08:41:49.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b3fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4158480 con 0x7fb59c004d00 2023-12-22T08:41:49.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b3fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4158760 con 0x7fb5b4143390 2023-12-22T08:41:49.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b413f7d0 0x7fb5b413fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:49.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b413f7d0 0x7fb5b413fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50382/0 (socket says 172.21.15.38:50382) 2023-12-22T08:41:49.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b27fc640 1 -- 172.21.15.38:0/3012373438 learned_addr learned my addr 172.21.15.38:0/3012373438 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:49.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b2ffd640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb59c004d00 0x7fb5b41569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:49.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b37fe640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4143390 0x7fb5b4143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:49.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b27fc640 1 -- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4143390 msgr2=0x7fb5b4143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:49.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b27fc640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4143390 0x7fb5b4143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b27fc640 1 -- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb59c004d00 msgr2=0x7fb5b41569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:49.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b27fc640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb59c004d00 0x7fb5b41569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.605+0000 7fb5b27fc640 1 -- 172.21.15.38:0/3012373438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4158a40 con 0x7fb5b413f7d0 2023-12-22T08:41:49.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.606+0000 7fb5b27fc640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b413f7d0 0x7fb5b413fc50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800e7f0 tx=0x7fb5a800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:49.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.606+0000 7fb59b7fe640 1 -- 172.21.15.38:0/3012373438 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a800c870 con 0x7fb5b413f7d0 2023-12-22T08:41:49.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.606+0000 7fb59b7fe640 1 -- 172.21.15.38:0/3012373438 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a800c9f0 con 0x7fb5b413f7d0 2023-12-22T08:41:49.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.606+0000 7fb59b7fe640 1 -- 172.21.15.38:0/3012373438 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a800cda0 con 0x7fb5b413f7d0 2023-12-22T08:41:49.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.606+0000 7fb5b3fff640 1 -- 172.21.15.38:0/3012373438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b4158d20 con 0x7fb5b413f7d0 2023-12-22T08:41:49.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.606+0000 7fb5b3fff640 1 -- 172.21.15.38:0/3012373438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b41580a0 con 0x7fb5b413f7d0 2023-12-22T08:41:49.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.608+0000 7fb5b3fff640 1 -- 172.21.15.38:0/3012373438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b41588a0 con 0x7fb5b413f7d0 2023-12-22T08:41:49.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.608+0000 7fb59b7fe640 1 -- 172.21.15.38:0/3012373438 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb5a801d460 con 0x7fb5b413f7d0 2023-12-22T08:41:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.609+0000 7fb59b7fe640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5a006a430 0x7fb5a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.609+0000 7fb59b7fe640 1 -- 172.21.15.38:0/3012373438 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb5a80886b0 con 0x7fb5b413f7d0 2023-12-22T08:41:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.610+0000 7fb5b2ffd640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5a006a430 0x7fb5a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:49.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.611+0000 7fb5b2ffd640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5a006a430 0x7fb5a006c8f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4003fd0 tx=0x7fb5a400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.614+0000 7fb59b7fe640 1 -- 172.21.15.38:0/3012373438 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb5b41588a0 con 0x7fb5b413f7d0 2023-12-22T08:41:49.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.810+0000 7fb5b3fff640 1 -- 172.21.15.38:0/3012373438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb5b41588a0 con 0x7fb5b413f7d0 2023-12-22T08:41:49.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.819+0000 7fb59b7fe640 1 -- 172.21.15.38:0/3012373438 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb5b41588a0 con 0x7fb5b413f7d0 2023-12-22T08:41:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.821+0000 7fb5b3fff640 1 -- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5a006a430 msgr2=0x7fb5a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.821+0000 7fb5b3fff640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5a006a430 0x7fb5a006c8f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4003fd0 tx=0x7fb5a400b040 comp rx=0 tx=0).stop 2023-12-22T08:41:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.821+0000 7fb5b3fff640 1 -- 172.21.15.38:0/3012373438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b413f7d0 msgr2=0x7fb5b413fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.821+0000 7fb5b3fff640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b413f7d0 0x7fb5b413fc50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800e7f0 tx=0x7fb5a800ecb0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.821+0000 7fb5b3fff640 1 -- 172.21.15.38:0/3012373438 shutdown_connections 2023-12-22T08:41:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.822+0000 7fb5b3fff640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b4143390 0x7fb5b4143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.822+0000 7fb5b3fff640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5a006a430 0x7fb5a006c8f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.822+0000 7fb5b3fff640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b413f7d0 0x7fb5b413fc50 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.822+0000 7fb5b3fff640 1 --2- 172.21.15.38:0/3012373438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb59c004d00 0x7fb5b41569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:49.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.822+0000 7fb5b3fff640 1 -- 172.21.15.38:0/3012373438 >> 172.21.15.38:0/3012373438 conn(0x7fb5b40d32c0 msgr2=0x7fb5b4144e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:49.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.822+0000 7fb5b3fff640 1 -- 172.21.15.38:0/3012373438 shutdown_connections 2023-12-22T08:41:49.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:49.822+0000 7fb5b3fff640 1 -- 172.21.15.38:0/3012373438 wait complete. 2023-12-22T08:41:49.844 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-12-22T08:41:50.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.068+0000 7f3ebffff640 1 Processor -- start 2023-12-22T08:41:50.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.068+0000 7f3ebffff640 1 -- start start 2023-12-22T08:41:50.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.070+0000 7f3ebffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ec015b420 0x7f3ec006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:50.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.070+0000 7f3ebffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ec00a44a0 0x7f3ec00708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:50.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.070+0000 7f3ebffff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec00cdae0 con 0x7f3ec0070e30 2023-12-22T08:41:50.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.070+0000 7f3ebffff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec0071260 con 0x7f3ec015b420 2023-12-22T08:41:50.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.070+0000 7f3ebffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec006dec0 con 0x7f3ec00a44a0 2023-12-22T08:41:50.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.070+0000 7f3ebeffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ec015b420 0x7f3ec006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:50.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.070+0000 7f3ebeffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ec015b420 0x7f3ec006d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50388/0 (socket says 172.21.15.38:50388) 2023-12-22T08:41:50.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.070+0000 7f3ebeffd640 1 -- 172.21.15.38:0/3970132234 learned_addr learned my addr 172.21.15.38:0/3970132234 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:50.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.071+0000 7f3eb7fff640 1 --2- 172.21.15.38:0/3970132234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ec00a44a0 0x7f3ec00708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:50.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.071+0000 7f3ebeffd640 1 -- 172.21.15.38:0/3970132234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ec00a44a0 msgr2=0x7f3ec00708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:50.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.071+0000 7f3ebeffd640 1 --2- 172.21.15.38:0/3970132234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ec00a44a0 0x7f3ec00708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:50.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.071+0000 7f3ebeffd640 1 -- 172.21.15.38:0/3970132234 >> v1:172.21.15.89:6789/0 conn(0x7f3ec0070e30 legacy=0x7f3ec006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:50.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.071+0000 7f3ebeffd640 1 -- 172.21.15.38:0/3970132234 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec015b800 con 0x7f3ec015b420 2023-12-22T08:41:50.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.072+0000 7f3ebeffd640 1 --2- 172.21.15.38:0/3970132234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec015b420 0x7f3ec006d980 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009870 tx=0x7f3eb002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d265b0f3daf56ad6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:50.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.072+0000 7f3ebe7fc640 1 -- 172.21.15.38:0/3970132234 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0031640 con 0x7f3ec015b420 2023-12-22T08:41:50.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.072+0000 7f3ebe7fc640 1 -- 172.21.15.38:0/3970132234 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb00317a0 con 0x7f3ec015b420 2023-12-22T08:41:50.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.072+0000 7f3ebe7fc640 1 -- 172.21.15.38:0/3970132234 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0031b30 con 0x7f3ec015b420 2023-12-22T08:41:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.073+0000 7f3ebffff640 1 -- 172.21.15.38:0/3970132234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec015b420 msgr2=0x7f3ec006d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.073+0000 7f3ebffff640 1 --2- 172.21.15.38:0/3970132234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec015b420 0x7f3ec006d980 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009870 tx=0x7f3eb002b8f0 comp rx=0 tx=0).stop 2023-12-22T08:41:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.073+0000 7f3ebffff640 1 -- 172.21.15.38:0/3970132234 shutdown_connections 2023-12-22T08:41:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.073+0000 7f3ebffff640 1 --2- 172.21.15.38:0/3970132234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ec00a44a0 0x7f3ec00708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.073+0000 7f3ebffff640 1 --2- 172.21.15.38:0/3970132234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec015b420 0x7f3ec006d980 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.073+0000 7f3ebffff640 1 -- 172.21.15.38:0/3970132234 >> 172.21.15.38:0/3970132234 conn(0x7f3ec00b1f70 msgr2=0x7f3ec00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.073+0000 7f3ebffff640 1 -- 172.21.15.38:0/3970132234 shutdown_connections 2023-12-22T08:41:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.073+0000 7f3ebffff640 1 -- 172.21.15.38:0/3970132234 wait complete. 2023-12-22T08:41:50.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.075+0000 7f3ebffff640 1 Processor -- start 2023-12-22T08:41:50.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.075+0000 7f3ebffff640 1 -- start start 2023-12-22T08:41:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.076+0000 7f3ebffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec0070e30 0x7f3ec0151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.076+0000 7f3ebffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ec00a44a0 0x7f3ec014d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.076+0000 7f3ebffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ec015b420 0x7f3ec01f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.076+0000 7f3ebffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0152040 con 0x7f3ec0070e30 2023-12-22T08:41:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.076+0000 7f3ebffff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec009fa90 con 0x7f3ec00a44a0 2023-12-22T08:41:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.076+0000 7f3ebffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0152ad0 con 0x7f3ec015b420 2023-12-22T08:41:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.076+0000 7f3ebeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec0070e30 0x7f3ec0151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.077+0000 7f3ebeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec0070e30 0x7f3ec0151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50394/0 (socket says 172.21.15.38:50394) 2023-12-22T08:41:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.077+0000 7f3ebeffd640 1 -- 172.21.15.38:0/1025799705 learned_addr learned my addr 172.21.15.38:0/1025799705 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:50.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.077+0000 7f3eb7fff640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ec00a44a0 0x7f3ec014d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:50.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.077+0000 7f3ebeffd640 1 -- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ec015b420 msgr2=0x7f3ec01f40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:50.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.077+0000 7f3ebf7fe640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ec015b420 0x7f3ec01f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:50.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.077+0000 7f3ebeffd640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ec015b420 0x7f3ec01f40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:50.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.077+0000 7f3ebeffd640 1 -- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ec00a44a0 msgr2=0x7f3ec014d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:50.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.077+0000 7f3ebeffd640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ec00a44a0 0x7f3ec014d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:50.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.077+0000 7f3ebeffd640 1 -- 172.21.15.38:0/1025799705 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb00094d0 con 0x7f3ec0070e30 2023-12-22T08:41:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.077+0000 7f3ebf7fe640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ec015b420 0x7f3ec01f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.077+0000 7f3ebeffd640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec0070e30 0x7f3ec0151b00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0000c00 tx=0x7f3eb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.078+0000 7f3eb77fe640 1 -- 172.21.15.38:0/1025799705 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb003ac60 con 0x7f3ec0070e30 2023-12-22T08:41:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.078+0000 7f3eb77fe640 1 -- 172.21.15.38:0/1025799705 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb003adc0 con 0x7f3ec0070e30 2023-12-22T08:41:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.078+0000 7f3eb77fe640 1 -- 172.21.15.38:0/1025799705 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0044630 con 0x7f3ec0070e30 2023-12-22T08:41:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.078+0000 7f3ebffff640 1 -- 172.21.15.38:0/1025799705 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec0154860 con 0x7f3ec0070e30 2023-12-22T08:41:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.078+0000 7f3ebffff640 1 -- 172.21.15.38:0/1025799705 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec0152510 con 0x7f3ec0070e30 2023-12-22T08:41:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.079+0000 7f3ebffff640 1 -- 172.21.15.38:0/1025799705 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec00a0610 con 0x7f3ec0070e30 2023-12-22T08:41:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.080+0000 7f3eb77fe640 1 -- 172.21.15.38:0/1025799705 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3eb002f050 con 0x7f3ec0070e30 2023-12-22T08:41:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.081+0000 7f3eb77fe640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3ea006a430 0x7f3ea006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:50.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.081+0000 7f3eb77fe640 1 -- 172.21.15.38:0/1025799705 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3eb00aa540 con 0x7f3ec0070e30 2023-12-22T08:41:50.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.082+0000 7f3eb7fff640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3ea006a430 0x7f3ea006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:50.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.083+0000 7f3eb7fff640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3ea006a430 0x7f3ea006c8f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0154440 tx=0x7f3ea8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:50.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.085+0000 7f3eb77fe640 1 -- 172.21.15.38:0/1025799705 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3eb0075e20 con 0x7f3ec0070e30 2023-12-22T08:41:50.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:50.351+0000 7f3ebffff640 1 -- 172.21.15.38:0/1025799705 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f3ec0061910 con 0x7f3ec0070e30 2023-12-22T08:41:51.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.359+0000 7f3eb77fe640 1 -- 172.21.15.38:0/1025799705 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v120) v1 ==== 130+0+0 (secure 0 0 0) 0x7f3eb0079440 con 0x7f3ec0070e30 2023-12-22T08:41:51.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.362+0000 7f3ebffff640 1 -- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3ea006a430 msgr2=0x7f3ea006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:51.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.362+0000 7f3ebffff640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3ea006a430 0x7f3ea006c8f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0154440 tx=0x7f3ea8008040 comp rx=0 tx=0).stop 2023-12-22T08:41:51.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.362+0000 7f3ebffff640 1 -- 172.21.15.38:0/1025799705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec0070e30 msgr2=0x7f3ec0151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:51.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.362+0000 7f3ebffff640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec0070e30 0x7f3ec0151b00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0000c00 tx=0x7f3eb00046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.362+0000 7f3ebffff640 1 -- 172.21.15.38:0/1025799705 shutdown_connections 2023-12-22T08:41:51.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.362+0000 7f3ebffff640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ec015b420 0x7f3ec01f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.363+0000 7f3ebffff640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ec00a44a0 0x7f3ec014d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.363+0000 7f3ebffff640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3ea006a430 0x7f3ea006c8f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.363+0000 7f3ebffff640 1 --2- 172.21.15.38:0/1025799705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ec0070e30 0x7f3ec0151b00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.363+0000 7f3ebffff640 1 -- 172.21.15.38:0/1025799705 >> 172.21.15.38:0/1025799705 conn(0x7f3ec00b1f70 msgr2=0x7f3ec015c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:51.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.363+0000 7f3ebffff640 1 -- 172.21.15.38:0/1025799705 shutdown_connections 2023-12-22T08:41:51.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.363+0000 7f3ebffff640 1 -- 172.21.15.38:0/1025799705 wait complete. 2023-12-22T08:41:51.386 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-12-22T08:41:51.387 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-12-22T08:41:51.387 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:51.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.616+0000 7f3edd029640 1 Processor -- start 2023-12-22T08:41:51.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.616+0000 7f3edd029640 1 -- start start 2023-12-22T08:41:51.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.617+0000 7f3edd029640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ed8157980 0x7f3ed815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:51.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.618+0000 7f3edd029640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ed80b3ff0 0x7f3ed806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:51.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.618+0000 7f3edd029640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed80d1520 con 0x7f3ed80b4470 2023-12-22T08:41:51.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.618+0000 7f3edd029640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed80d1800 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.618+0000 7f3edd029640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80d1ae0 con 0x7f3ed8157980 2023-12-22T08:41:51.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.618+0000 7f3ecf7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ed80b3ff0 0x7f3ed806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:51.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.618+0000 7f3ecf7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ed80b3ff0 0x7f3ed806cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58382/0 (socket says 172.21.15.38:58382) 2023-12-22T08:41:51.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.618+0000 7f3ecf7fe640 1 -- 172.21.15.38:0/1735500300 learned_addr learned my addr 172.21.15.38:0/1735500300 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:51.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.618+0000 7f3ed7fff640 1 --2- 172.21.15.38:0/1735500300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ed8157980 0x7f3ed815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:51.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.619+0000 7f3ecf7fe640 1 -- 172.21.15.38:0/1735500300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ed8157980 msgr2=0x7f3ed815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:51.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.619+0000 7f3ecf7fe640 1 --2- 172.21.15.38:0/1735500300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ed8157980 0x7f3ed815eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.619+0000 7f3ecf7fe640 1 -- 172.21.15.38:0/1735500300 >> v1:172.21.15.89:6789/0 conn(0x7f3ed80b4470 legacy=0x7f3ed80d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:51.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.619+0000 7f3ecf7fe640 1 -- 172.21.15.38:0/1735500300 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed80d1dc0 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.619+0000 7f3ed7fff640 1 --2- 172.21.15.38:0/1735500300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ed8157980 0x7f3ed815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:51.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.620+0000 7f3ecf7fe640 1 --2- 172.21.15.38:0/1735500300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed80b3ff0 0x7f3ed806cf30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009e50 tx=0x7f3ec002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173aacdcbd6b685d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:51.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.620+0000 7f3ed77fe640 1 -- 172.21.15.38:0/1735500300 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec002cb00 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.620+0000 7f3ed77fe640 1 -- 172.21.15.38:0/1735500300 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec002cc60 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.620+0000 7f3ed77fe640 1 -- 172.21.15.38:0/1735500300 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00343f0 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.621+0000 7f3edd029640 1 -- 172.21.15.38:0/1735500300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed80b3ff0 msgr2=0x7f3ed806cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:51.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.621+0000 7f3edd029640 1 --2- 172.21.15.38:0/1735500300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed80b3ff0 0x7f3ed806cf30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009e50 tx=0x7f3ec002bf60 comp rx=0 tx=0).stop 2023-12-22T08:41:51.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.621+0000 7f3edd029640 1 -- 172.21.15.38:0/1735500300 shutdown_connections 2023-12-22T08:41:51.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.621+0000 7f3edd029640 1 --2- 172.21.15.38:0/1735500300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed80b3ff0 0x7f3ed806cf30 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.621+0000 7f3edd029640 1 --2- 172.21.15.38:0/1735500300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ed8157980 0x7f3ed815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.621+0000 7f3edd029640 1 -- 172.21.15.38:0/1735500300 >> 172.21.15.38:0/1735500300 conn(0x7f3ed80d31f0 msgr2=0x7f3ed80d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:51.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.621+0000 7f3edd029640 1 -- 172.21.15.38:0/1735500300 shutdown_connections 2023-12-22T08:41:51.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.621+0000 7f3edd029640 1 -- 172.21.15.38:0/1735500300 wait complete. 2023-12-22T08:41:51.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.623+0000 7f3edd029640 1 Processor -- start 2023-12-22T08:41:51.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.623+0000 7f3edd029640 1 -- start start 2023-12-22T08:41:51.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.624+0000 7f3edd029640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed80b3ff0 0x7f3ed80b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:51.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.624+0000 7f3edd029640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ed80b4470 0x7f3ed81519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:51.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.624+0000 7f3edd029640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ed8157980 0x7f3ed8151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:51.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.624+0000 7f3edd029640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80b71d0 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.624+0000 7f3edd029640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80b7470 con 0x7f3ed8157980 2023-12-22T08:41:51.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.624+0000 7f3edd029640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80b7750 con 0x7f3ed80b4470 2023-12-22T08:41:51.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.624+0000 7f3ed7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed80b3ff0 0x7f3ed80b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:51.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.624+0000 7f3ed7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed80b3ff0 0x7f3ed80b8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58390/0 (socket says 172.21.15.38:58390) 2023-12-22T08:41:51.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.624+0000 7f3ed7fff640 1 -- 172.21.15.38:0/36500771 learned_addr learned my addr 172.21.15.38:0/36500771 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:51.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.625+0000 7f3ed7fff640 1 -- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ed80b4470 msgr2=0x7f3ed81519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:51.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.625+0000 7f3ecf7fe640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ed80b4470 0x7f3ed81519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:51.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.625+0000 7f3edc828640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ed8157980 0x7f3ed8151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:51.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.625+0000 7f3ed7fff640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ed80b4470 0x7f3ed81519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.625+0000 7f3ed7fff640 1 -- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ed8157980 msgr2=0x7f3ed8151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:51.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.625+0000 7f3ed7fff640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ed8157980 0x7f3ed8151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.625+0000 7f3ed7fff640 1 -- 172.21.15.38:0/36500771 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0009b30 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.625+0000 7f3edc828640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ed8157980 0x7f3ed8151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:51.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.625+0000 7f3ed7fff640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed80b3ff0 0x7f3ed80b8230 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800c7f0 tx=0x7f3ec800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:51.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.625+0000 7f3ed57fa640 1 -- 172.21.15.38:0/36500771 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8007820 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.626+0000 7f3ed57fa640 1 -- 172.21.15.38:0/36500771 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec8007980 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.626+0000 7f3ed57fa640 1 -- 172.21.15.38:0/36500771 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8007cf0 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.626+0000 7f3edd029640 1 -- 172.21.15.38:0/36500771 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed80b7a30 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.626+0000 7f3edd029640 1 -- 172.21.15.38:0/36500771 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed8153a70 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.627+0000 7f3edd029640 1 -- 172.21.15.38:0/36500771 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed8061910 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.628+0000 7f3ed57fa640 1 -- 172.21.15.38:0/36500771 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ec80113f0 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.629+0000 7f3ed57fa640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3eb806a480 0x7f3eb806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:51.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.629+0000 7f3ed57fa640 1 -- 172.21.15.38:0/36500771 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3ec8088960 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.630+0000 7f3ecf7fe640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3eb806a480 0x7f3eb806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:51.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.631+0000 7f3ecf7fe640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3eb806a480 0x7f3eb806c940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0035000 tx=0x7f3ec0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:51.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.635+0000 7f3ed57fa640 1 -- 172.21.15.38:0/36500771 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3ec8054230 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.829+0000 7f3edd029640 1 -- 172.21.15.38:0/36500771 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ed815c0e0 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.831+0000 7f3ed57fa640 1 -- 172.21.15.38:0/36500771 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12470 (secure 0 0 0) 0x7f3ec801f090 con 0x7f3ed80b3ff0 2023-12-22T08:41:51.834 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:51.834 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":39,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:41:49.332008+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6835/2926436383":"2023-12-23T08:41:46.688479+0000","172.21.15.38:6834/2926436383":"2023-12-23T08:41:46.688479+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:51.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.833+0000 7f3edd029640 1 -- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3eb806a480 msgr2=0x7f3eb806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:51.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.833+0000 7f3edd029640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3eb806a480 0x7f3eb806c940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0035000 tx=0x7f3ec0030000 comp rx=0 tx=0).stop 2023-12-22T08:41:51.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.834+0000 7f3edd029640 1 -- 172.21.15.38:0/36500771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed80b3ff0 msgr2=0x7f3ed80b8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:51.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.834+0000 7f3edd029640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed80b3ff0 0x7f3ed80b8230 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800c7f0 tx=0x7f3ec800ccb0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.834+0000 7f3edd029640 1 -- 172.21.15.38:0/36500771 shutdown_connections 2023-12-22T08:41:51.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.834+0000 7f3edd029640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ed8157980 0x7f3ed8151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.834+0000 7f3edd029640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ed80b4470 0x7f3ed81519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.834+0000 7f3edd029640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3eb806a480 0x7f3eb806c940 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.834+0000 7f3edd029640 1 --2- 172.21.15.38:0/36500771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ed80b3ff0 0x7f3ed80b8230 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:51.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.834+0000 7f3edd029640 1 -- 172.21.15.38:0/36500771 >> 172.21.15.38:0/36500771 conn(0x7f3ed80d31f0 msgr2=0x7f3ed8070300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:51.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.834+0000 7f3edd029640 1 -- 172.21.15.38:0/36500771 shutdown_connections 2023-12-22T08:41:51.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:51.834+0000 7f3edd029640 1 -- 172.21.15.38:0/36500771 wait complete. 2023-12-22T08:41:51.857 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:51.858 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:52.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.084+0000 7fd6ce9f1640 1 Processor -- start 2023-12-22T08:41:52.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.084+0000 7fd6ce9f1640 1 -- start start 2023-12-22T08:41:52.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.086+0000 7fd6ce9f1640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6c81619c0 0x7fd6c80b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:52.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.086+0000 7fd6ce9f1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd6c80ceb70 0x7fd6c806f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:52.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.086+0000 7fd6ce9f1640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c80ce6e0 con 0x7fd6c8070000 2023-12-22T08:41:52.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.086+0000 7fd6ce9f1640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c80b4db0 con 0x7fd6c81619c0 2023-12-22T08:41:52.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.086+0000 7fd6ce9f1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c80b5090 con 0x7fd6c80ceb70 2023-12-22T08:41:52.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.087+0000 7fd6c7fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6c81619c0 0x7fd6c80b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:52.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.087+0000 7fd6ccf8e640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd6c8070000 0x7fd6c8165630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38022/0 (socket says 172.21.15.38:38022) 2023-12-22T08:41:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.087+0000 7fd6ccf8e640 1 -- 172.21.15.38:0/1010965654 learned_addr learned my addr 172.21.15.38:0/1010965654 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.087+0000 7fd6bffff640 1 --2- 172.21.15.38:0/1010965654 >> v2:172.21.15.89:3300/0 conn(0x7fd6c80ceb70 0x7fd6c806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.087+0000 7fd6c7fff640 1 -- 172.21.15.38:0/1010965654 >> v2:172.21.15.89:3300/0 conn(0x7fd6c80ceb70 msgr2=0x7fd6c806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.087+0000 7fd6c7fff640 1 --2- 172.21.15.38:0/1010965654 >> v2:172.21.15.89:3300/0 conn(0x7fd6c80ceb70 0x7fd6c806f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.087+0000 7fd6c7fff640 1 -- 172.21.15.38:0/1010965654 >> v1:172.21.15.38:6789/0 conn(0x7fd6c8070000 legacy=0x7fd6c8165630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.087+0000 7fd6c7fff640 1 -- 172.21.15.38:0/1010965654 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c80ce370 con 0x7fd6c81619c0 2023-12-22T08:41:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.087+0000 7fd6bffff640 1 --2- 172.21.15.38:0/1010965654 >> v2:172.21.15.89:3300/0 conn(0x7fd6c80ceb70 0x7fd6c806f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.088+0000 7fd6c7fff640 1 --2- 172.21.15.38:0/1010965654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6c81619c0 0x7fd6c80b4560 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80706c0 tx=0x7fd6b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24c1db55d37ef94 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.089+0000 7fd6c77fe640 1 -- 172.21.15.38:0/1010965654 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8031830 con 0x7fd6c81619c0 2023-12-22T08:41:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.089+0000 7fd6c77fe640 1 -- 172.21.15.38:0/1010965654 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b8031990 con 0x7fd6c81619c0 2023-12-22T08:41:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.089+0000 7fd6c77fe640 1 -- 172.21.15.38:0/1010965654 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8031d20 con 0x7fd6c81619c0 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.089+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/1010965654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6c81619c0 msgr2=0x7fd6c80b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.089+0000 7fd6ce9f1640 1 --2- 172.21.15.38:0/1010965654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6c81619c0 0x7fd6c80b4560 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80706c0 tx=0x7fd6b802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.089+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/1010965654 shutdown_connections 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.089+0000 7fd6ce9f1640 1 --2- 172.21.15.38:0/1010965654 >> v2:172.21.15.89:3300/0 conn(0x7fd6c80ceb70 0x7fd6c806f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.089+0000 7fd6ce9f1640 1 --2- 172.21.15.38:0/1010965654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6c81619c0 0x7fd6c80b4560 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.089+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/1010965654 >> 172.21.15.38:0/1010965654 conn(0x7fd6c80b20c0 msgr2=0x7fd6c80b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.090+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/1010965654 shutdown_connections 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.090+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/1010965654 wait complete. 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.091+0000 7fd6ce9f1640 1 Processor -- start 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.091+0000 7fd6ce9f1640 1 -- start start 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.092+0000 7fd6ce9f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6c8070000 0x7fd6c814d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.092+0000 7fd6ce9f1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6c80ceb70 0x7fd6c8152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.092+0000 7fd6ce9f1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c81619c0 0x7fd6c806c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.092+0000 7fd6ce9f1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c806d180 con 0x7fd6c80ceb70 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.092+0000 7fd6ce9f1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c806cbc0 con 0x7fd6c8070000 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.092+0000 7fd6ce9f1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c806cea0 con 0x7fd6c81619c0 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.093+0000 7fd6bffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6c80ceb70 0x7fd6c8152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.093+0000 7fd6bffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6c80ceb70 0x7fd6c8152f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58400/0 (socket says 172.21.15.38:58400) 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.093+0000 7fd6bffff640 1 -- 172.21.15.38:0/397607783 learned_addr learned my addr 172.21.15.38:0/397607783 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.093+0000 7fd6c7fff640 1 --2- 172.21.15.38:0/397607783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6c8070000 0x7fd6c814d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.093+0000 7fd6bffff640 1 -- 172.21.15.38:0/397607783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c81619c0 msgr2=0x7fd6c806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.093+0000 7fd6bffff640 1 --2- 172.21.15.38:0/397607783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c81619c0 0x7fd6c806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.093+0000 7fd6bffff640 1 -- 172.21.15.38:0/397607783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6c8070000 msgr2=0x7fd6c814d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.093+0000 7fd6bffff640 1 --2- 172.21.15.38:0/397607783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6c8070000 0x7fd6c814d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.093+0000 7fd6bffff640 1 -- 172.21.15.38:0/397607783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b8009400 con 0x7fd6c80ceb70 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.093+0000 7fd6bffff640 1 --2- 172.21.15.38:0/397607783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6c80ceb70 0x7fd6c8152f10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000c7f0 tx=0x7fd6b000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.094+0000 7fd6c57fa640 1 -- 172.21.15.38:0/397607783 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0007a30 con 0x7fd6c80ceb70 2023-12-22T08:41:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.094+0000 7fd6c57fa640 1 -- 172.21.15.38:0/397607783 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b0007b90 con 0x7fd6c80ceb70 2023-12-22T08:41:52.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.094+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/397607783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c81563c0 con 0x7fd6c80ceb70 2023-12-22T08:41:52.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.094+0000 7fd6c57fa640 1 -- 172.21.15.38:0/397607783 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b000ce40 con 0x7fd6c80ceb70 2023-12-22T08:41:52.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.094+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/397607783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c814de90 con 0x7fd6c80ceb70 2023-12-22T08:41:52.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.095+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/397607783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c8156220 con 0x7fd6c80ceb70 2023-12-22T08:41:52.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.096+0000 7fd6c57fa640 1 -- 172.21.15.38:0/397607783 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6b00113f0 con 0x7fd6c80ceb70 2023-12-22T08:41:52.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.097+0000 7fd6c57fa640 1 --2- 172.21.15.38:0/397607783 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6a806a460 0x7fd6a806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:52.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.097+0000 7fd6c57fa640 1 -- 172.21.15.38:0/397607783 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd6b0088800 con 0x7fd6c80ceb70 2023-12-22T08:41:52.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.098+0000 7fd6c7fff640 1 --2- 172.21.15.38:0/397607783 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6a806a460 0x7fd6a806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:52.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.099+0000 7fd6c7fff640 1 --2- 172.21.15.38:0/397607783 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6a806a460 0x7fd6a806c920 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8036000 tx=0x7fd6b803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:52.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.101+0000 7fd6c57fa640 1 -- 172.21.15.38:0/397607783 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd6c8156220 con 0x7fd6c80ceb70 2023-12-22T08:41:52.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.298+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/397607783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6c8156220 con 0x7fd6c80ceb70 2023-12-22T08:41:52.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.300+0000 7fd6c57fa640 1 -- 172.21.15.38:0/397607783 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6c8156220 con 0x7fd6c80ceb70 2023-12-22T08:41:52.302 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:41:52.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.302+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/397607783 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6a806a460 msgr2=0x7fd6a806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:52.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.302+0000 7fd6ce9f1640 1 --2- 172.21.15.38:0/397607783 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6a806a460 0x7fd6a806c920 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8036000 tx=0x7fd6b803c040 comp rx=0 tx=0).stop 2023-12-22T08:41:52.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.302+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/397607783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6c80ceb70 msgr2=0x7fd6c8152f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:52.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.302+0000 7fd6ce9f1640 1 --2- 172.21.15.38:0/397607783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6c80ceb70 0x7fd6c8152f10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000c7f0 tx=0x7fd6b000cbf0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.303+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/397607783 shutdown_connections 2023-12-22T08:41:52.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.303+0000 7fd6ce9f1640 1 --2- 172.21.15.38:0/397607783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6c81619c0 0x7fd6c806c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.303+0000 7fd6ce9f1640 1 --2- 172.21.15.38:0/397607783 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6a806a460 0x7fd6a806c920 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.303+0000 7fd6ce9f1640 1 --2- 172.21.15.38:0/397607783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6c80ceb70 0x7fd6c8152f10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.303+0000 7fd6ce9f1640 1 --2- 172.21.15.38:0/397607783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6c8070000 0x7fd6c814d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.303+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/397607783 >> 172.21.15.38:0/397607783 conn(0x7fd6c80b20c0 msgr2=0x7fd6c81523c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:52.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.303+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/397607783 shutdown_connections 2023-12-22T08:41:52.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.303+0000 7fd6ce9f1640 1 -- 172.21.15.38:0/397607783 wait complete. 2023-12-22T08:41:52.322 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-12-22T08:41:52.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.534+0000 7f8e50ddf640 1 Processor -- start 2023-12-22T08:41:52.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.534+0000 7f8e50ddf640 1 -- start start 2023-12-22T08:41:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.536+0000 7f8e50ddf640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8e4c161340 0x7f8e4c071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.536+0000 7f8e50ddf640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e4c161720 0x7f8e4c0ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.536+0000 7f8e50ddf640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c0ce950 con 0x7f8e4c071fa0 2023-12-22T08:41:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.536+0000 7f8e50ddf640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c0cdd40 con 0x7f8e4c161340 2023-12-22T08:41:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.536+0000 7f8e50ddf640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0ce020 con 0x7f8e4c161720 2023-12-22T08:41:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.537+0000 7f8e43fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8e4c071fa0 0x7f8e4c0adca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38038/0 (socket says 172.21.15.38:38038) 2023-12-22T08:41:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.537+0000 7f8e43fff640 1 -- 172.21.15.38:0/3889526148 learned_addr learned my addr 172.21.15.38:0/3889526148 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.537+0000 7f8e4b7fe640 1 --2- 172.21.15.38:0/3889526148 >> v2:172.21.15.38:3300/0 conn(0x7f8e4c161340 0x7f8e4c071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:52.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.537+0000 7f8e4bfff640 1 --2- 172.21.15.38:0/3889526148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e4c161720 0x7f8e4c0ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:52.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.537+0000 7f8e4affd640 1 -- 172.21.15.38:0/3889526148 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706592214 0 0) 0x7f8e4c0ce950 con 0x7f8e4c071fa0 2023-12-22T08:41:52.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.537+0000 7f8e4affd640 1 -- 172.21.15.38:0/3889526148 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e38003520 con 0x7f8e4c071fa0 2023-12-22T08:41:52.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.537+0000 7f8e4b7fe640 1 -- 172.21.15.38:0/3889526148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e4c161720 msgr2=0x7f8e4c0ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:52.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.537+0000 7f8e4b7fe640 1 --2- 172.21.15.38:0/3889526148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e4c161720 0x7f8e4c0ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.537+0000 7f8e4b7fe640 1 -- 172.21.15.38:0/3889526148 >> v1:172.21.15.38:6789/0 conn(0x7f8e4c071fa0 legacy=0x7f8e4c0adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:52.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.537+0000 7f8e4b7fe640 1 -- 172.21.15.38:0/3889526148 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c0ce300 con 0x7f8e4c161340 2023-12-22T08:41:52.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.537+0000 7f8e4bfff640 1 --2- 172.21.15.38:0/3889526148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e4c161720 0x7f8e4c0ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:52.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.538+0000 7f8e4b7fe640 1 --2- 172.21.15.38:0/3889526148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c161340 0x7f8e4c071a60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0097a0 tx=0x7f8e3c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2ce702bd331a90 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:52.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.539+0000 7f8e4affd640 1 -- 172.21.15.38:0/3889526148 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c02e070 con 0x7f8e4c161340 2023-12-22T08:41:52.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.539+0000 7f8e4affd640 1 -- 172.21.15.38:0/3889526148 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c0315a0 con 0x7f8e4c161340 2023-12-22T08:41:52.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.539+0000 7f8e4affd640 1 -- 172.21.15.38:0/3889526148 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c031910 con 0x7f8e4c161340 2023-12-22T08:41:52.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.539+0000 7f8e50ddf640 1 -- 172.21.15.38:0/3889526148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c161340 msgr2=0x7f8e4c071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:52.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.539+0000 7f8e50ddf640 1 --2- 172.21.15.38:0/3889526148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c161340 0x7f8e4c071a60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0097a0 tx=0x7f8e3c02b840 comp rx=0 tx=0).stop 2023-12-22T08:41:52.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.539+0000 7f8e50ddf640 1 -- 172.21.15.38:0/3889526148 shutdown_connections 2023-12-22T08:41:52.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.539+0000 7f8e50ddf640 1 --2- 172.21.15.38:0/3889526148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e4c161720 0x7f8e4c0ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.539+0000 7f8e50ddf640 1 --2- 172.21.15.38:0/3889526148 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c161340 0x7f8e4c071a60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.540+0000 7f8e50ddf640 1 -- 172.21.15.38:0/3889526148 >> 172.21.15.38:0/3889526148 conn(0x7f8e4c0b1f70 msgr2=0x7f8e4c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:52.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.540+0000 7f8e50ddf640 1 -- 172.21.15.38:0/3889526148 shutdown_connections 2023-12-22T08:41:52.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.540+0000 7f8e50ddf640 1 -- 172.21.15.38:0/3889526148 wait complete. 2023-12-22T08:41:52.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.541+0000 7f8e50ddf640 1 Processor -- start 2023-12-22T08:41:52.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.542+0000 7f8e50ddf640 1 -- start start 2023-12-22T08:41:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.542+0000 7f8e50ddf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c071fa0 0x7f8e4c09f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.542+0000 7f8e50ddf640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e4c161340 0x7f8e4c159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.542+0000 7f8e50ddf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e4c161720 0x7f8e4c0af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.542+0000 7f8e50ddf640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c158c00 con 0x7f8e4c071fa0 2023-12-22T08:41:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.542+0000 7f8e50ddf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c158330 con 0x7f8e4c161720 2023-12-22T08:41:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.542+0000 7f8e50ddf640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0ae4f0 con 0x7f8e4c161340 2023-12-22T08:41:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.543+0000 7f8e4b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c071fa0 0x7f8e4c09f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.543+0000 7f8e4b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c071fa0 0x7f8e4c09f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58418/0 (socket says 172.21.15.38:58418) 2023-12-22T08:41:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.543+0000 7f8e4b7fe640 1 -- 172.21.15.38:0/2053658464 learned_addr learned my addr 172.21.15.38:0/2053658464 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.543+0000 7f8e43fff640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e4c161340 0x7f8e4c159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.543+0000 7f8e4bfff640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e4c161720 0x7f8e4c0af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:52.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.543+0000 7f8e4b7fe640 1 -- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e4c161340 msgr2=0x7f8e4c159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.543+0000 7f8e4b7fe640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e4c161340 0x7f8e4c159090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.543+0000 7f8e4b7fe640 1 -- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e4c161720 msgr2=0x7f8e4c0af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.543+0000 7f8e4b7fe640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e4c161720 0x7f8e4c0af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.543+0000 7f8e4b7fe640 1 -- 172.21.15.38:0/2053658464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c009400 con 0x7f8e4c071fa0 2023-12-22T08:41:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.543+0000 7f8e4bfff640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e4c161720 0x7f8e4c0af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:52.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.544+0000 7f8e4b7fe640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c071fa0 0x7f8e4c09f220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c034040 tx=0x7f8e3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:52.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.544+0000 7f8e48ff9640 1 -- 172.21.15.38:0/2053658464 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c032840 con 0x7f8e4c071fa0 2023-12-22T08:41:52.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.544+0000 7f8e48ff9640 1 -- 172.21.15.38:0/2053658464 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c0329c0 con 0x7f8e4c071fa0 2023-12-22T08:41:52.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.544+0000 7f8e48ff9640 1 -- 172.21.15.38:0/2053658464 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c032d70 con 0x7f8e4c071fa0 2023-12-22T08:41:52.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.544+0000 7f8e50ddf640 1 -- 172.21.15.38:0/2053658464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c1585b0 con 0x7f8e4c071fa0 2023-12-22T08:41:52.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.544+0000 7f8e50ddf640 1 -- 172.21.15.38:0/2053658464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c1595d0 con 0x7f8e4c071fa0 2023-12-22T08:41:52.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.545+0000 7f8e50ddf640 1 -- 172.21.15.38:0/2053658464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c061910 con 0x7f8e4c071fa0 2023-12-22T08:41:52.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.546+0000 7f8e48ff9640 1 -- 172.21.15.38:0/2053658464 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8e3c03b3f0 con 0x7f8e4c071fa0 2023-12-22T08:41:52.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.547+0000 7f8e48ff9640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e2c06a430 0x7f8e2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:52.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.547+0000 7f8e48ff9640 1 -- 172.21.15.38:0/2053658464 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8e3c0aa510 con 0x7f8e4c071fa0 2023-12-22T08:41:52.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.548+0000 7f8e43fff640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e2c06a430 0x7f8e2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.549+0000 7f8e43fff640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e2c06a430 0x7f8e2c06c8f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c1600e0 tx=0x7f8e34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.551+0000 7f8e48ff9640 1 -- 172.21.15.38:0/2053658464 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8e3c075df0 con 0x7f8e4c071fa0 2023-12-22T08:41:52.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:52.814+0000 7f8e50ddf640 1 -- 172.21.15.38:0/2053658464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f8e4c0a0130 con 0x7f8e4c071fa0 2023-12-22T08:41:53.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.372+0000 7f8e48ff9640 1 -- 172.21.15.38:0/2053658464 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v122) v1 ==== 145+0+0 (secure 0 0 0) 0x7f8e3c079410 con 0x7f8e4c071fa0 2023-12-22T08:41:53.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.376+0000 7f8e50ddf640 1 -- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e2c06a430 msgr2=0x7f8e2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:53.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.376+0000 7f8e50ddf640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e2c06a430 0x7f8e2c06c8f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c1600e0 tx=0x7f8e34009040 comp rx=0 tx=0).stop 2023-12-22T08:41:53.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.376+0000 7f8e50ddf640 1 -- 172.21.15.38:0/2053658464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c071fa0 msgr2=0x7f8e4c09f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:53.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.376+0000 7f8e50ddf640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c071fa0 0x7f8e4c09f220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c034040 tx=0x7f8e3c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:53.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.376+0000 7f8e50ddf640 1 -- 172.21.15.38:0/2053658464 shutdown_connections 2023-12-22T08:41:53.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.376+0000 7f8e50ddf640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e4c161720 0x7f8e4c0af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:53.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.376+0000 7f8e50ddf640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e4c161340 0x7f8e4c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:53.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.376+0000 7f8e50ddf640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e2c06a430 0x7f8e2c06c8f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:53.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.376+0000 7f8e50ddf640 1 --2- 172.21.15.38:0/2053658464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c071fa0 0x7f8e4c09f220 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:53.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.376+0000 7f8e50ddf640 1 -- 172.21.15.38:0/2053658464 >> 172.21.15.38:0/2053658464 conn(0x7f8e4c0b1f70 msgr2=0x7f8e4c15bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:53.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.376+0000 7f8e50ddf640 1 -- 172.21.15.38:0/2053658464 shutdown_connections 2023-12-22T08:41:53.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.376+0000 7f8e50ddf640 1 -- 172.21.15.38:0/2053658464 wait complete. 2023-12-22T08:41:53.400 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-22T08:41:53.637 INFO:teuthology.orchestra.run.smithi038.stdout:{"osd_objectstore":"memstore"} 2023-12-22T08:41:53.638 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-22T08:41:53.638 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T08:41:53.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.859+0000 7f8aaa962640 1 Processor -- start 2023-12-22T08:41:53.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.860+0000 7f8aaa962640 1 -- start start 2023-12-22T08:41:53.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.861+0000 7f8aaa962640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8aa4071080 0x7f8aa40d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:53.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.861+0000 7f8aaa962640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8aa415d5a0 0x7f8aa40d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:53.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.861+0000 7f8aaa962640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa415de50 con 0x7f8aa415d1c0 2023-12-22T08:41:53.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.861+0000 7f8aaa962640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa40d0dd0 con 0x7f8aa4071080 2023-12-22T08:41:53.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.861+0000 7f8aaa962640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa40d10b0 con 0x7f8aa415d5a0 2023-12-22T08:41:53.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.862+0000 7f8aa915f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8aa4071080 0x7f8aa40d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:53.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.862+0000 7f8aa9960640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8aa415d1c0 0x7f8aa4070970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38050/0 (socket says 172.21.15.38:38050) 2023-12-22T08:41:53.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.862+0000 7f8aa9960640 1 -- 172.21.15.38:0/3731904293 learned_addr learned my addr 172.21.15.38:0/3731904293 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:53.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.862+0000 7f8aa915f640 1 -- 172.21.15.38:0/3731904293 >> v2:172.21.15.89:3300/0 conn(0x7f8aa415d5a0 msgr2=0x7f8aa40d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:53.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.862+0000 7f8aa915f640 1 --2- 172.21.15.38:0/3731904293 >> v2:172.21.15.89:3300/0 conn(0x7f8aa415d5a0 0x7f8aa40d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:53.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.862+0000 7f8aa915f640 1 -- 172.21.15.38:0/3731904293 >> v1:172.21.15.38:6789/0 conn(0x7f8aa415d1c0 legacy=0x7f8aa4070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:53.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.862+0000 7f8aa915f640 1 -- 172.21.15.38:0/3731904293 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa415dae0 con 0x7f8aa4071080 2023-12-22T08:41:53.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.863+0000 7f8aa915f640 1 --2- 172.21.15.38:0/3731904293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8aa4071080 0x7f8aa40d0060 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4072200 tx=0x7f8a9002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fc65b08f006553 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.864+0000 7f8aa895e640 1 -- 172.21.15.38:0/3731904293 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90031830 con 0x7f8aa4071080 2023-12-22T08:41:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.864+0000 7f8aa895e640 1 -- 172.21.15.38:0/3731904293 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a90031990 con 0x7f8aa4071080 2023-12-22T08:41:53.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.864+0000 7f8aa895e640 1 -- 172.21.15.38:0/3731904293 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90031d20 con 0x7f8aa4071080 2023-12-22T08:41:53.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.864+0000 7f8aaa962640 1 -- 172.21.15.38:0/3731904293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8aa4071080 msgr2=0x7f8aa40d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:53.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.864+0000 7f8aaa962640 1 --2- 172.21.15.38:0/3731904293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8aa4071080 0x7f8aa40d0060 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4072200 tx=0x7f8a9002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:53.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.864+0000 7f8aaa962640 1 -- 172.21.15.38:0/3731904293 shutdown_connections 2023-12-22T08:41:53.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.864+0000 7f8aaa962640 1 --2- 172.21.15.38:0/3731904293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8aa4071080 0x7f8aa40d0060 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:53.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.864+0000 7f8aaa962640 1 --2- 172.21.15.38:0/3731904293 >> v2:172.21.15.89:3300/0 conn(0x7f8aa415d5a0 0x7f8aa40d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:53.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.864+0000 7f8aaa962640 1 -- 172.21.15.38:0/3731904293 >> 172.21.15.38:0/3731904293 conn(0x7f8aa406bf90 msgr2=0x7f8aa406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:53.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.865+0000 7f8aaa962640 1 -- 172.21.15.38:0/3731904293 shutdown_connections 2023-12-22T08:41:53.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.865+0000 7f8aaa962640 1 -- 172.21.15.38:0/3731904293 wait complete. 2023-12-22T08:41:53.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.866+0000 7f8aaa962640 1 Processor -- start 2023-12-22T08:41:53.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.866+0000 7f8aaa962640 1 -- start start 2023-12-22T08:41:53.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.867+0000 7f8aaa962640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8aa4071080 0x7f8aa4157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.867+0000 7f8aaa962640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8aa415d1c0 0x7f8aa4154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.867+0000 7f8aaa962640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa415d5a0 0x7f8aa41547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.868+0000 7f8aaa962640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa41429f0 con 0x7f8aa4071080 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.868+0000 7f8aaa962640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa41592e0 con 0x7f8aa415d5a0 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.868+0000 7f8aaa962640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa41586d0 con 0x7f8aa415d1c0 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.868+0000 7f8aa9960640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8aa4071080 0x7f8aa4157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.868+0000 7f8aa9960640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8aa4071080 0x7f8aa4157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58430/0 (socket says 172.21.15.38:58430) 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.868+0000 7f8aa9960640 1 -- 172.21.15.38:0/910652108 learned_addr learned my addr 172.21.15.38:0/910652108 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.868+0000 7f8aa9960640 1 -- 172.21.15.38:0/910652108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8aa415d1c0 msgr2=0x7f8aa4154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.868+0000 7f8aa9960640 1 --2- 172.21.15.38:0/910652108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8aa415d1c0 0x7f8aa4154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.868+0000 7f8aa9960640 1 -- 172.21.15.38:0/910652108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa415d5a0 msgr2=0x7f8aa41547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.868+0000 7f8aa9960640 1 --2- 172.21.15.38:0/910652108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa415d5a0 0x7f8aa41547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.868+0000 7f8aa9960640 1 -- 172.21.15.38:0/910652108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a90009400 con 0x7f8aa4071080 2023-12-22T08:41:53.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.869+0000 7f8aa9960640 1 --2- 172.21.15.38:0/910652108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8aa4071080 0x7f8aa4157c80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800cba0 tx=0x7f8a9800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:53.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.869+0000 7f8aa27fc640 1 -- 172.21.15.38:0/910652108 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9800ad40 con 0x7f8aa4071080 2023-12-22T08:41:53.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.869+0000 7f8aa27fc640 1 -- 172.21.15.38:0/910652108 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a98012400 con 0x7f8aa4071080 2023-12-22T08:41:53.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.869+0000 7f8aa27fc640 1 -- 172.21.15.38:0/910652108 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9800aea0 con 0x7f8aa4071080 2023-12-22T08:41:53.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.869+0000 7f8aaa962640 1 -- 172.21.15.38:0/910652108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa41589b0 con 0x7f8aa4071080 2023-12-22T08:41:53.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.869+0000 7f8aaa962640 1 -- 172.21.15.38:0/910652108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa4158f70 con 0x7f8aa4071080 2023-12-22T08:41:53.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.870+0000 7f8aaa962640 1 -- 172.21.15.38:0/910652108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa4061910 con 0x7f8aa4071080 2023-12-22T08:41:53.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.871+0000 7f8aa27fc640 1 -- 172.21.15.38:0/910652108 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a98007070 con 0x7f8aa4071080 2023-12-22T08:41:53.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.872+0000 7f8aa27fc640 1 --2- 172.21.15.38:0/910652108 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a8806a480 0x7f8a8806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:53.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.872+0000 7f8aa27fc640 1 -- 172.21.15.38:0/910652108 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8a980884f0 con 0x7f8aa4071080 2023-12-22T08:41:53.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.873+0000 7f8aa915f640 1 --2- 172.21.15.38:0/910652108 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a8806a480 0x7f8a8806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:53.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.874+0000 7f8aa915f640 1 --2- 172.21.15.38:0/910652108 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a8806a480 0x7f8a8806c940 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8a90036000 tx=0x7f8a90030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:53.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:53.876+0000 7f8aa27fc640 1 -- 172.21.15.38:0/910652108 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8a98053e70 con 0x7f8aa4071080 2023-12-22T08:41:54.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.063+0000 7f8aaa962640 1 -- 172.21.15.38:0/910652108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8aa406c930 con 0x7f8aa4071080 2023-12-22T08:41:54.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.069+0000 7f8aa27fc640 1 -- 172.21.15.38:0/910652108 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8a98057490 con 0x7f8aa4071080 2023-12-22T08:41:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.071+0000 7f8aaa962640 1 -- 172.21.15.38:0/910652108 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a8806a480 msgr2=0x7f8a8806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.071+0000 7f8aaa962640 1 --2- 172.21.15.38:0/910652108 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a8806a480 0x7f8a8806c940 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8a90036000 tx=0x7f8a90030000 comp rx=0 tx=0).stop 2023-12-22T08:41:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.071+0000 7f8aaa962640 1 -- 172.21.15.38:0/910652108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8aa4071080 msgr2=0x7f8aa4157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.071+0000 7f8aaa962640 1 --2- 172.21.15.38:0/910652108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8aa4071080 0x7f8aa4157c80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800cba0 tx=0x7f8a9800a430 comp rx=0 tx=0).stop 2023-12-22T08:41:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.071+0000 7f8aaa962640 1 -- 172.21.15.38:0/910652108 shutdown_connections 2023-12-22T08:41:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.071+0000 7f8aaa962640 1 --2- 172.21.15.38:0/910652108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa415d5a0 0x7f8aa41547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.071+0000 7f8aaa962640 1 --2- 172.21.15.38:0/910652108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8aa415d1c0 0x7f8aa4154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.071+0000 7f8aaa962640 1 --2- 172.21.15.38:0/910652108 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8a8806a480 0x7f8a8806c940 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.071+0000 7f8aaa962640 1 --2- 172.21.15.38:0/910652108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8aa4071080 0x7f8aa4157c80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.071+0000 7f8aaa962640 1 -- 172.21.15.38:0/910652108 >> 172.21.15.38:0/910652108 conn(0x7f8aa406bf90 msgr2=0x7f8aa406f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.071+0000 7f8aaa962640 1 -- 172.21.15.38:0/910652108 shutdown_connections 2023-12-22T08:41:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.071+0000 7f8aaa962640 1 -- 172.21.15.38:0/910652108 wait complete. 2023-12-22T08:41:54.092 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:41:54.092 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:41:54.212 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:41:54.338 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:41:54.338 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:41:54.338 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:54.400 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:41:54.401 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:41:54.401 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:54.460 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:41:54.460 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:41:54.460 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:54.524 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:41:54.524 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:41:54.524 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:54.584 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:41:54.584 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-22T08:41:54.584 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.815+0000 7f82a3fab640 1 Processor -- start 2023-12-22T08:41:54.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.816+0000 7f82a3fab640 1 -- start start 2023-12-22T08:41:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.817+0000 7f82a3fab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829c15e740 0x7f829c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.817+0000 7f82a3fab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f829c06ca50 0x7f829c0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:54.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.817+0000 7f82a3fab640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f829c0b3dc0 0x7f829c161120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:54.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.817+0000 7f82a3fab640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c06e650 con 0x7f829c0b3dc0 2023-12-22T08:41:54.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.817+0000 7f82a3fab640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c0b4210 con 0x7f829c06ca50 2023-12-22T08:41:54.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.817+0000 7f82a3fab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c15eb20 con 0x7f829c15e740 2023-12-22T08:41:54.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.817+0000 7f82a2548640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f829c0b3dc0 0x7f829c161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:54.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.817+0000 7f82a2548640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f829c0b3dc0 0x7f829c161120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58440/0 (socket says 172.21.15.38:58440) 2023-12-22T08:41:54.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.817+0000 7f82a2548640 1 -- 172.21.15.38:0/1388293270 learned_addr learned my addr 172.21.15.38:0/1388293270 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:54.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.818+0000 7f82a1546640 1 --2- 172.21.15.38:0/1388293270 >> v2:172.21.15.89:3300/0 conn(0x7f829c06ca50 0x7f829c0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:54.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.818+0000 7f82a1d47640 1 --2- 172.21.15.38:0/1388293270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829c15e740 0x7f829c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:54.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.818+0000 7f82a2548640 1 -- 172.21.15.38:0/1388293270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829c15e740 msgr2=0x7f829c15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:54.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.818+0000 7f82a2548640 1 --2- 172.21.15.38:0/1388293270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829c15e740 0x7f829c15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:54.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.818+0000 7f82a2548640 1 -- 172.21.15.38:0/1388293270 >> v2:172.21.15.89:3300/0 conn(0x7f829c06ca50 msgr2=0x7f829c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:54.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.818+0000 7f82a2548640 1 --2- 172.21.15.38:0/1388293270 >> v2:172.21.15.89:3300/0 conn(0x7f829c06ca50 0x7f829c0b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:54.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.818+0000 7f82a2548640 1 -- 172.21.15.38:0/1388293270 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c070770 con 0x7f829c0b3dc0 2023-12-22T08:41:54.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.819+0000 7f82a2548640 1 --2- 172.21.15.38:0/1388293270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f829c0b3dc0 0x7f829c161120 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f829c0d3300 tx=0x7f829402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5f33ba0affdfc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:54.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.819+0000 7f82a0d45640 1 -- 172.21.15.38:0/1388293270 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294031750 con 0x7f829c0b3dc0 2023-12-22T08:41:54.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.820+0000 7f82a0d45640 1 -- 172.21.15.38:0/1388293270 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82940318b0 con 0x7f829c0b3dc0 2023-12-22T08:41:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.820+0000 7f82a0d45640 1 -- 172.21.15.38:0/1388293270 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294031c40 con 0x7f829c0b3dc0 2023-12-22T08:41:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.820+0000 7f82a3fab640 1 -- 172.21.15.38:0/1388293270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f829c0b3dc0 msgr2=0x7f829c161120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.820+0000 7f82a3fab640 1 --2- 172.21.15.38:0/1388293270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f829c0b3dc0 0x7f829c161120 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f829c0d3300 tx=0x7f829402b7f0 comp rx=0 tx=0).stop 2023-12-22T08:41:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.820+0000 7f82a3fab640 1 -- 172.21.15.38:0/1388293270 shutdown_connections 2023-12-22T08:41:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.820+0000 7f82a3fab640 1 --2- 172.21.15.38:0/1388293270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f829c0b3dc0 0x7f829c161120 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.820+0000 7f82a3fab640 1 --2- 172.21.15.38:0/1388293270 >> v2:172.21.15.89:3300/0 conn(0x7f829c06ca50 0x7f829c0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.820+0000 7f82a3fab640 1 --2- 172.21.15.38:0/1388293270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829c15e740 0x7f829c15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.820+0000 7f82a3fab640 1 -- 172.21.15.38:0/1388293270 >> 172.21.15.38:0/1388293270 conn(0x7f829c0cfea0 msgr2=0x7f829c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.820+0000 7f82a3fab640 1 -- 172.21.15.38:0/1388293270 shutdown_connections 2023-12-22T08:41:54.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.820+0000 7f82a3fab640 1 -- 172.21.15.38:0/1388293270 wait complete. 2023-12-22T08:41:54.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.822+0000 7f82a3fab640 1 Processor -- start 2023-12-22T08:41:54.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.822+0000 7f82a3fab640 1 -- start start 2023-12-22T08:41:54.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.823+0000 7f82a3fab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829c06ca50 0x7f829c15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:54.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.823+0000 7f82a3fab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f829c0b3dc0 0x7f829c151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:54.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.823+0000 7f82a3fab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f829c15e740 0x7f829c0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:54.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.823+0000 7f82a3fab640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c15d440 con 0x7f829c0b3dc0 2023-12-22T08:41:54.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.823+0000 7f82a3fab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c151dd0 con 0x7f829c15e740 2023-12-22T08:41:54.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.823+0000 7f82a3fab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c1f43e0 con 0x7f829c06ca50 2023-12-22T08:41:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.823+0000 7f82a1546640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f829c0b3dc0 0x7f829c151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.824+0000 7f82a1546640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f829c0b3dc0 0x7f829c151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58446/0 (socket says 172.21.15.38:58446) 2023-12-22T08:41:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.824+0000 7f82a1546640 1 -- 172.21.15.38:0/395777341 learned_addr learned my addr 172.21.15.38:0/395777341 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.824+0000 7f82a2548640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f829c15e740 0x7f829c0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.824+0000 7f82a1d47640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829c06ca50 0x7f829c15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.824+0000 7f82a1546640 1 -- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829c06ca50 msgr2=0x7f829c15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.824+0000 7f82a1546640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829c06ca50 0x7f829c15cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.824+0000 7f82a1546640 1 -- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f829c15e740 msgr2=0x7f829c0b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.824+0000 7f82a1546640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f829c15e740 0x7f829c0b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.824+0000 7f82a1546640 1 -- 172.21.15.38:0/395777341 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940094d0 con 0x7f829c0b3dc0 2023-12-22T08:41:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.824+0000 7f82a2548640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f829c15e740 0x7f829c0b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:54.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.824+0000 7f82a1546640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f829c0b3dc0 0x7f829c151890 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f828c00d800 tx=0x7f828c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:54.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.825+0000 7f82927fc640 1 -- 172.21.15.38:0/395777341 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0096a0 con 0x7f829c0b3dc0 2023-12-22T08:41:54.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.825+0000 7f82927fc640 1 -- 172.21.15.38:0/395777341 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c009800 con 0x7f829c0b3dc0 2023-12-22T08:41:54.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.825+0000 7f82927fc640 1 -- 172.21.15.38:0/395777341 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c009b90 con 0x7f829c0b3dc0 2023-12-22T08:41:54.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.825+0000 7f82a3fab640 1 -- 172.21.15.38:0/395777341 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c1f46c0 con 0x7f829c0b3dc0 2023-12-22T08:41:54.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.825+0000 7f82a3fab640 1 -- 172.21.15.38:0/395777341 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c1f4c80 con 0x7f829c0b3dc0 2023-12-22T08:41:54.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.826+0000 7f82a3fab640 1 -- 172.21.15.38:0/395777341 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c061910 con 0x7f829c0b3dc0 2023-12-22T08:41:54.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.827+0000 7f82927fc640 1 -- 172.21.15.38:0/395777341 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f828c009cf0 con 0x7f829c0b3dc0 2023-12-22T08:41:54.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.828+0000 7f82927fc640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f828006a460 0x7f828006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:54.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.829+0000 7f82927fc640 1 -- 172.21.15.38:0/395777341 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f828c088df0 con 0x7f829c0b3dc0 2023-12-22T08:41:54.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.829+0000 7f82a1d47640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f828006a460 0x7f828006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:54.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.830+0000 7f82a1d47640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f828006a460 0x7f828006c920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8298009e90 tx=0x7f829800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:54.833+0000 7f82927fc640 1 -- 172.21.15.38:0/395777341 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f828c054640 con 0x7f829c0b3dc0 2023-12-22T08:41:55.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.073+0000 7f82a3fab640 1 -- 172.21.15.38:0/395777341 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f829c161fa0 con 0x7f829c0b3dc0 2023-12-22T08:41:55.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.074+0000 7f82927fc640 1 -- 172.21.15.38:0/395777341 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f828c00b440 con 0x7f829c0b3dc0 2023-12-22T08:41:55.076 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:55.076 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1244935716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1244935716},{"type":"v1","addr":"172.21.15.89:6837","nonce":1244935716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/23463229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":23463229},{"type":"v1","addr":"172.21.15.38:6833","nonce":23463229}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3876693609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3876693609},{"type":"v1","addr":"172.21.15.89:6836","nonce":3876693609}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5454,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2620901175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2620901175},{"type":"v1","addr":"172.21.15.38:6835","nonce":2620901175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-12-22T08:41:55.077 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2023-12-22T08:41:55.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.076+0000 7f82a3fab640 1 -- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f828006a460 msgr2=0x7f828006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:55.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.076+0000 7f82a3fab640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f828006a460 0x7f828006c920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8298009e90 tx=0x7f829800b040 comp rx=0 tx=0).stop 2023-12-22T08:41:55.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.076+0000 7f82a3fab640 1 -- 172.21.15.38:0/395777341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f829c0b3dc0 msgr2=0x7f829c151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:55.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.076+0000 7f82a3fab640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f829c0b3dc0 0x7f829c151890 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f828c00d800 tx=0x7f828c00dcc0 comp rx=0 tx=0).stop 2023-12-22T08:41:55.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.076+0000 7f82a3fab640 1 -- 172.21.15.38:0/395777341 shutdown_connections 2023-12-22T08:41:55.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.076+0000 7f82a3fab640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f829c15e740 0x7f829c0b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:55.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.076+0000 7f82a3fab640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f828006a460 0x7f828006c920 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:55.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.076+0000 7f82a3fab640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f829c0b3dc0 0x7f829c151890 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:55.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.076+0000 7f82a3fab640 1 --2- 172.21.15.38:0/395777341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829c06ca50 0x7f829c15cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:55.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.076+0000 7f82a3fab640 1 -- 172.21.15.38:0/395777341 >> 172.21.15.38:0/395777341 conn(0x7f829c0cfea0 msgr2=0x7f829c0659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:55.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.077+0000 7f82a3fab640 1 -- 172.21.15.38:0/395777341 shutdown_connections 2023-12-22T08:41:55.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.077+0000 7f82a3fab640 1 -- 172.21.15.38:0/395777341 wait complete. 2023-12-22T08:41:55.099 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T08:41:55.100 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T08:41:55.100 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T08:41:55.100 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:41:55.100 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T08:41:55.100 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T08:41:55.100 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T08:41:55.100 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:41:55.101 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T08:41:55.101 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T08:41:55.101 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T08:41:55.101 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:41:55.101 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T08:41:55.101 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T08:41:55.101 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T08:41:55.102 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:41:55.115 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T08:41:55.115 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T08:41:55.123 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T08:41:55.123 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T08:41:55.130 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T08:41:55.130 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T08:41:55.132 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T08:41:55.132 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T08:41:55.171 INFO:tasks.ceph.mds.a:Started 2023-12-22T08:41:55.172 DEBUG:teuthology.parallel:result is None 2023-12-22T08:41:55.179 INFO:tasks.ceph.mds.c:Started 2023-12-22T08:41:55.179 DEBUG:teuthology.parallel:result is None 2023-12-22T08:41:55.182 INFO:tasks.ceph.mds.d:Started 2023-12-22T08:41:55.182 DEBUG:teuthology.parallel:result is None 2023-12-22T08:41:55.189 INFO:tasks.ceph.mds.b:Started 2023-12-22T08:41:55.189 DEBUG:teuthology.parallel:result is None 2023-12-22T08:41:55.190 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-22T08:41:55.334 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:41:55.336 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:41:55.345 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-12-22T08:41:55.345 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-22T08:41:55.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.388+0000 7f31c7192640 1 Processor -- start 2023-12-22T08:41:55.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.388+0000 7f31c7192640 1 -- start start 2023-12-22T08:41:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.389+0000 7f31c7192640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f31c00b3f90 0x7f31c015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.389+0000 7f31c7192640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c015eb20 con 0x7f31c006ca50 2023-12-22T08:41:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.390+0000 7f31c7192640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c0070770 con 0x7f31c015e740 2023-12-22T08:41:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.390+0000 7f31c7192640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c006e650 con 0x7f31c00b3f90 2023-12-22T08:41:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.390+0000 7f31c4f2e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f31c015e740 0x7f31c00b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:49442/0 (socket says 172.21.15.38:49442) 2023-12-22T08:41:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.390+0000 7f31c4f2e640 1 -- 172.21.15.38:0/284076915 learned_addr learned my addr 172.21.15.38:0/284076915 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.390+0000 7f31c572f640 1 --1- 172.21.15.38:0/284076915 >> v1:172.21.15.38:6789/0 conn(0x7f31c006ca50 0x7f31c0070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38072/0 (socket says 172.21.15.38:38072) 2023-12-22T08:41:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.390+0000 7f31bffff640 1 --2- 172.21.15.38:0/284076915 >> v2:172.21.15.38:3300/0 conn(0x7f31c00b3f90 0x7f31c015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.390+0000 7f31bf7fe640 1 -- 172.21.15.38:0/284076915 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191054548 0 0) 0x7f31c0070770 con 0x7f31c015e740 2023-12-22T08:41:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.390+0000 7f31bf7fe640 1 -- 172.21.15.38:0/284076915 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b0003520 con 0x7f31c015e740 2023-12-22T08:41:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.390+0000 7f31bffff640 1 -- 172.21.15.38:0/284076915 >> v1:172.21.15.89:6789/0 conn(0x7f31c015e740 legacy=0x7f31c00b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.390+0000 7f31bffff640 1 -- 172.21.15.38:0/284076915 >> v1:172.21.15.38:6789/0 conn(0x7f31c006ca50 legacy=0x7f31c0070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.390+0000 7f31bffff640 1 -- 172.21.15.38:0/284076915 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c006d180 con 0x7f31c00b3f90 2023-12-22T08:41:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.392+0000 7f31bffff640 1 --2- 172.21.15.38:0/284076915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c00b3f90 0x7f31c015db30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0097a0 tx=0x7f31ac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47af5b9bf4929f39 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.392+0000 7f31bf7fe640 1 -- 172.21.15.38:0/284076915 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac02e070 con 0x7f31c00b3f90 2023-12-22T08:41:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.392+0000 7f31bf7fe640 1 -- 172.21.15.38:0/284076915 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac0315a0 con 0x7f31c00b3f90 2023-12-22T08:41:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.392+0000 7f31bf7fe640 1 -- 172.21.15.38:0/284076915 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac031930 con 0x7f31c00b3f90 2023-12-22T08:41:55.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.393+0000 7f31c7192640 1 -- 172.21.15.38:0/284076915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c00b3f90 msgr2=0x7f31c015db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:55.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.393+0000 7f31c7192640 1 --2- 172.21.15.38:0/284076915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c00b3f90 0x7f31c015db30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0097a0 tx=0x7f31ac02b840 comp rx=0 tx=0).stop 2023-12-22T08:41:55.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.393+0000 7f31c7192640 1 -- 172.21.15.38:0/284076915 shutdown_connections 2023-12-22T08:41:55.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.393+0000 7f31c7192640 1 --2- 172.21.15.38:0/284076915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c00b3f90 0x7f31c015db30 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:55.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.393+0000 7f31c7192640 1 -- 172.21.15.38:0/284076915 >> 172.21.15.38:0/284076915 conn(0x7f31c00cfea0 msgr2=0x7f31c00d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:55.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.393+0000 7f31c7192640 1 -- 172.21.15.38:0/284076915 shutdown_connections 2023-12-22T08:41:55.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.393+0000 7f31c7192640 1 -- 172.21.15.38:0/284076915 wait complete. 2023-12-22T08:41:55.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.395+0000 7f31c7192640 1 Processor -- start 2023-12-22T08:41:55.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.395+0000 7f31c7192640 1 -- start start 2023-12-22T08:41:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.396+0000 7f31c7192640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c006ca50 0x7f31c015d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.396+0000 7f31c7192640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31c00b3f90 0x7f31c015c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.396+0000 7f31c7192640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31c015e740 0x7f31c015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.396+0000 7f31c7192640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00b7700 con 0x7f31c006ca50 2023-12-22T08:41:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.396+0000 7f31c7192640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0158f80 con 0x7f31c00b3f90 2023-12-22T08:41:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.396+0000 7f31c7192640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c015de70 con 0x7f31c015e740 2023-12-22T08:41:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.396+0000 7f31c4f2e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c006ca50 0x7f31c015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.396+0000 7f31c4f2e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c006ca50 0x7f31c015d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58494/0 (socket says 172.21.15.38:58494) 2023-12-22T08:41:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.396+0000 7f31c4f2e640 1 -- 172.21.15.38:0/4057561363 learned_addr learned my addr 172.21.15.38:0/4057561363 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.396+0000 7f31bffff640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31c00b3f90 0x7f31c015c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.396+0000 7f31c572f640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31c015e740 0x7f31c015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.397+0000 7f31c4f2e640 1 -- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31c015e740 msgr2=0x7f31c015cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.397+0000 7f31c4f2e640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31c015e740 0x7f31c015cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.397+0000 7f31c4f2e640 1 -- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31c00b3f90 msgr2=0x7f31c015c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.397+0000 7f31c4f2e640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31c00b3f90 0x7f31c015c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.397+0000 7f31c4f2e640 1 -- 172.21.15.38:0/4057561363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac009400 con 0x7f31c006ca50 2023-12-22T08:41:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.397+0000 7f31bffff640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31c00b3f90 0x7f31c015c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.397+0000 7f31c572f640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31c015e740 0x7f31c015cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.397+0000 7f31c4f2e640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c006ca50 0x7f31c015d930 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f31b400c410 tx=0x7f31b400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.397+0000 7f31bd7fa640 1 -- 172.21.15.38:0/4057561363 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4005ce0 con 0x7f31c006ca50 2023-12-22T08:41:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.397+0000 7f31bd7fa640 1 -- 172.21.15.38:0/4057561363 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b4005e40 con 0x7f31c006ca50 2023-12-22T08:41:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.397+0000 7f31c7192640 1 -- 172.21.15.38:0/4057561363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c0158370 con 0x7f31c006ca50 2023-12-22T08:41:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.397+0000 7f31bd7fa640 1 -- 172.21.15.38:0/4057561363 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b40072f0 con 0x7f31c006ca50 2023-12-22T08:41:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.397+0000 7f31c7192640 1 -- 172.21.15.38:0/4057561363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c0158930 con 0x7f31c006ca50 2023-12-22T08:41:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.399+0000 7f31c7192640 1 -- 172.21.15.38:0/4057561363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c015dfe0 con 0x7f31c006ca50 2023-12-22T08:41:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.400+0000 7f31bd7fa640 1 -- 172.21.15.38:0/4057561363 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f31b4007510 con 0x7f31c006ca50 2023-12-22T08:41:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.400+0000 7f31bd7fa640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f31a406a430 0x7f31a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.401+0000 7f31bd7fa640 1 -- 172.21.15.38:0/4057561363 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f31b4087d20 con 0x7f31c006ca50 2023-12-22T08:41:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.401+0000 7f31bffff640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f31a406a430 0x7f31a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:55.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.402+0000 7f31bffff640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f31a406a430 0x7f31a406c8f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f31ac036000 tx=0x7f31ac03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:55.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.405+0000 7f31bd7fa640 1 -- 172.21.15.38:0/4057561363 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f31c015dfe0 con 0x7f31c006ca50 2023-12-22T08:41:55.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:55.612+0000 7f31c7192640 1 -- 172.21.15.38:0/4057561363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f31c015dfe0 con 0x7f31c006ca50 2023-12-22T08:41:56.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.388+0000 7f31bd7fa640 1 -- 172.21.15.38:0/4057561363 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) v1 ==== 97+0+0 (secure 0 0 0) 0x7f31c015dfe0 con 0x7f31c006ca50 2023-12-22T08:41:56.390 INFO:teuthology.orchestra.run.smithi038.stderr: removed all blocklist entries 2023-12-22T08:41:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.391+0000 7f31c7192640 1 -- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f31a406a430 msgr2=0x7f31a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.391+0000 7f31c7192640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f31a406a430 0x7f31a406c8f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f31ac036000 tx=0x7f31ac03d040 comp rx=0 tx=0).stop 2023-12-22T08:41:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.391+0000 7f31c7192640 1 -- 172.21.15.38:0/4057561363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c006ca50 msgr2=0x7f31c015d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.391+0000 7f31c7192640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c006ca50 0x7f31c015d930 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f31b400c410 tx=0x7f31b400c8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.391+0000 7f31c7192640 1 -- 172.21.15.38:0/4057561363 shutdown_connections 2023-12-22T08:41:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.391+0000 7f31c7192640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31c015e740 0x7f31c015cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.391+0000 7f31c7192640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31c00b3f90 0x7f31c015c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.391+0000 7f31c7192640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f31a406a430 0x7f31a406c8f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.391+0000 7f31c7192640 1 --2- 172.21.15.38:0/4057561363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31c006ca50 0x7f31c015d930 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.391+0000 7f31c7192640 1 -- 172.21.15.38:0/4057561363 >> 172.21.15.38:0/4057561363 conn(0x7f31c00cfea0 msgr2=0x7f31c0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:56.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.392+0000 7f31c7192640 1 -- 172.21.15.38:0/4057561363 shutdown_connections 2023-12-22T08:41:56.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.392+0000 7f31c7192640 1 -- 172.21.15.38:0/4057561363 wait complete. 2023-12-22T08:41:56.415 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T08:41:56.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.636+0000 7f96a6130640 1 Processor -- start 2023-12-22T08:41:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.636+0000 7f96a6130640 1 -- start start 2023-12-22T08:41:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.638+0000 7f96a6130640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96a0157980 0x7f96a015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.638+0000 7f96a6130640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96a006d640 0x7f96a00d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.638+0000 7f96a6130640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a00d1520 con 0x7f96a00b3ff0 2023-12-22T08:41:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.638+0000 7f96a6130640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a00d1800 con 0x7f96a006d640 2023-12-22T08:41:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.638+0000 7f96a6130640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a00d1ae0 con 0x7f96a0157980 2023-12-22T08:41:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.638+0000 7f96a592f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96a006d640 0x7f96a00d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.638+0000 7f96a592f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96a006d640 0x7f96a00d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58496/0 (socket says 172.21.15.38:58496) 2023-12-22T08:41:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.638+0000 7f96a592f640 1 -- 172.21.15.38:0/1024205021 learned_addr learned my addr 172.21.15.38:0/1024205021 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.639+0000 7f96a512e640 1 --2- 172.21.15.38:0/1024205021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96a0157980 0x7f96a015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.639+0000 7f96a592f640 1 -- 172.21.15.38:0/1024205021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96a0157980 msgr2=0x7f96a015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.639+0000 7f96a592f640 1 --2- 172.21.15.38:0/1024205021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96a0157980 0x7f96a015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.639+0000 7f96a592f640 1 -- 172.21.15.38:0/1024205021 >> v1:172.21.15.89:6789/0 conn(0x7f96a00b3ff0 legacy=0x7f96a006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.639+0000 7f96a592f640 1 -- 172.21.15.38:0/1024205021 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a00d1dc0 con 0x7f96a006d640 2023-12-22T08:41:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.639+0000 7f96a512e640 1 --2- 172.21.15.38:0/1024205021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96a0157980 0x7f96a015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.640+0000 7f96a592f640 1 --2- 172.21.15.38:0/1024205021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96a006d640 0x7f96a00d25c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9698009e50 tx=0x7f969802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a3712ac42ad100 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.641+0000 7f9697fff640 1 -- 172.21.15.38:0/1024205021 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969802cb00 con 0x7f96a006d640 2023-12-22T08:41:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.641+0000 7f9697fff640 1 -- 172.21.15.38:0/1024205021 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969802cc60 con 0x7f96a006d640 2023-12-22T08:41:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.641+0000 7f9697fff640 1 -- 172.21.15.38:0/1024205021 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980343f0 con 0x7f96a006d640 2023-12-22T08:41:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.641+0000 7f96a6130640 1 -- 172.21.15.38:0/1024205021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96a006d640 msgr2=0x7f96a00d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.641+0000 7f96a6130640 1 --2- 172.21.15.38:0/1024205021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96a006d640 0x7f96a00d25c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9698009e50 tx=0x7f969802bf60 comp rx=0 tx=0).stop 2023-12-22T08:41:56.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.642+0000 7f96a6130640 1 -- 172.21.15.38:0/1024205021 shutdown_connections 2023-12-22T08:41:56.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.642+0000 7f96a6130640 1 --2- 172.21.15.38:0/1024205021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96a006d640 0x7f96a00d25c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.642+0000 7f96a6130640 1 --2- 172.21.15.38:0/1024205021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96a0157980 0x7f96a015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.642+0000 7f96a6130640 1 -- 172.21.15.38:0/1024205021 >> 172.21.15.38:0/1024205021 conn(0x7f96a00d31f0 msgr2=0x7f96a00d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:56.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.642+0000 7f96a6130640 1 -- 172.21.15.38:0/1024205021 shutdown_connections 2023-12-22T08:41:56.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.642+0000 7f96a6130640 1 -- 172.21.15.38:0/1024205021 wait complete. 2023-12-22T08:41:56.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.644+0000 7f96a6130640 1 Processor -- start 2023-12-22T08:41:56.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.644+0000 7f96a6130640 1 -- start start 2023-12-22T08:41:56.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.645+0000 7f96a6130640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96a006d640 0x7f96a01f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:56.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.645+0000 7f96a6130640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a00b3ff0 0x7f96a014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:56.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.645+0000 7f96a6130640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96a0157980 0x7f96a01564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:56.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.645+0000 7f96a6130640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a01f2d60 con 0x7f96a0157980 2023-12-22T08:41:56.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.645+0000 7f96a6130640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a01f3b80 con 0x7f96a00b3ff0 2023-12-22T08:41:56.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.645+0000 7f96a6130640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a01f72a0 con 0x7f96a006d640 2023-12-22T08:41:56.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.645+0000 7f96a592f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96a0157980 0x7f96a01564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:56.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.645+0000 7f96a592f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96a0157980 0x7f96a01564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58504/0 (socket says 172.21.15.38:58504) 2023-12-22T08:41:56.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.645+0000 7f96a592f640 1 -- 172.21.15.38:0/184743456 learned_addr learned my addr 172.21.15.38:0/184743456 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:56.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.646+0000 7f96a512e640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96a006d640 0x7f96a01f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:56.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.646+0000 7f96a492d640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a00b3ff0 0x7f96a014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:56.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.646+0000 7f96a592f640 1 -- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96a006d640 msgr2=0x7f96a01f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:56.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.646+0000 7f96a592f640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96a006d640 0x7f96a01f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.646+0000 7f96a592f640 1 -- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a00b3ff0 msgr2=0x7f96a014c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:56.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.646+0000 7f96a592f640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a00b3ff0 0x7f96a014c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.646+0000 7f96a592f640 1 -- 172.21.15.38:0/184743456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9698009b30 con 0x7f96a0157980 2023-12-22T08:41:56.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.646+0000 7f96a592f640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96a0157980 0x7f96a01564d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9698036040 tx=0x7f9698004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:56.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.646+0000 7f9695ffb640 1 -- 172.21.15.38:0/184743456 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698009510 con 0x7f96a0157980 2023-12-22T08:41:56.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.646+0000 7f9695ffb640 1 -- 172.21.15.38:0/184743456 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969803e450 con 0x7f96a0157980 2023-12-22T08:41:56.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.646+0000 7f9695ffb640 1 -- 172.21.15.38:0/184743456 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969803e800 con 0x7f96a0157980 2023-12-22T08:41:56.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.646+0000 7f96a6130640 1 -- 172.21.15.38:0/184743456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a014cb30 con 0x7f96a0157980 2023-12-22T08:41:56.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.647+0000 7f96a6130640 1 -- 172.21.15.38:0/184743456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a01f3250 con 0x7f96a0157980 2023-12-22T08:41:56.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.648+0000 7f96a6130640 1 -- 172.21.15.38:0/184743456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a0061910 con 0x7f96a0157980 2023-12-22T08:41:56.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.649+0000 7f9695ffb640 1 -- 172.21.15.38:0/184743456 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f969803e960 con 0x7f96a0157980 2023-12-22T08:41:56.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.650+0000 7f9695ffb640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f968406a430 0x7f968406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:56.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.650+0000 7f9695ffb640 1 -- 172.21.15.38:0/184743456 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f96980ab3d0 con 0x7f96a0157980 2023-12-22T08:41:56.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.650+0000 7f96a512e640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f968406a430 0x7f968406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:56.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.651+0000 7f96a512e640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f968406a430 0x7f968406c8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f969c0096d0 tx=0x7f969c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:56.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.655+0000 7f9695ffb640 1 -- 172.21.15.38:0/184743456 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9698076c70 con 0x7f96a0157980 2023-12-22T08:41:56.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.918+0000 7f96a6130640 1 -- 172.21.15.38:0/184743456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f96a01f3cc0 con 0x7f96a0157980 2023-12-22T08:41:56.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.919+0000 7f9695ffb640 1 -- 172.21.15.38:0/184743456 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f969807a290 con 0x7f96a0157980 2023-12-22T08:41:56.922 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:56.922 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:41:56.922 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_dump": [ 2023-12-22T08:41:56.923 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.923 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.a", 2023-12-22T08:41:56.923 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl57dkCBAAeliJIPc49iRBk2mp8WYv8A==", 2023-12-22T08:41:56.923 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.923 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:56.923 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:41:56.924 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:41:56.924 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.924 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.924 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.924 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.924 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.b", 2023-12-22T08:41:56.924 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl0C0+KhAAkCsjfyn19nOz1xTyhZkbPQ==", 2023-12-22T08:41:56.925 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.925 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:56.925 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:41:56.925 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:41:56.925 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.925 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.926 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.926 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.926 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.c", 2023-12-22T08:41:56.926 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl7poXGhAA+ZSohyj4dAOs6B5dZKTLAg==", 2023-12-22T08:41:56.926 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.926 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:56.927 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:41:56.927 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:41:56.927 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.927 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.927 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.927 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.927 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.d", 2023-12-22T08:41:56.928 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4VlTBuoOhAArKX4AiOQRGawIyAnInIhCg==", 2023-12-22T08:41:56.928 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.928 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:56.928 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:41:56.928 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:41:56.928 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.928 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.929 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.929 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.929 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.0", 2023-12-22T08:41:56.929 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VlnVQaChAAxfWmPqwo5D4qBYkAP/6dHQ==", 2023-12-22T08:41:56.929 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.929 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:56.930 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:56.930 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.930 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.930 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.930 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.930 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.1", 2023-12-22T08:41:56.930 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4Vll2dlGxAAbqx4rxnz4FWIKl9OGqcwtw==", 2023-12-22T08:41:56.931 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.931 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:56.931 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:56.931 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.931 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.931 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.932 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.932 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.2", 2023-12-22T08:41:56.932 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VljQ3HLRAAfyrtqD4n6Da8Rl/6UKmv7g==", 2023-12-22T08:41:56.932 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.932 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:56.932 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:56.933 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.933 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.933 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.933 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.933 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.3", 2023-12-22T08:41:56.933 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBCS4VlOat4AxAAIkAGRvGGWrrwx/ppMbexWQ==", 2023-12-22T08:41:56.934 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.934 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:56.934 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:56.934 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.934 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.934 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.4", 2023-12-22T08:41:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlwg7TDxAA+L504F+Hw/6FTJ63cV3ZXg==", 2023-12-22T08:41:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.935 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.5", 2023-12-22T08:41:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx8zgHxAALBDm/sSYqw/fn4nLNQbu4A==", 2023-12-22T08:41:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.936 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.6", 2023-12-22T08:41:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx5OdLxAAaMP09nYI3HKiuhPARgnCOw==", 2023-12-22T08:41:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.937 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.7", 2023-12-22T08:41:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBHS4Vl/15bBBAA4maatkcgA0axcZY/L9r/IA==", 2023-12-22T08:41:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:41:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.938 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.939 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.0", 2023-12-22T08:41:56.939 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlgDspDhAA0TWGbk4AbuOhCNotPej29A==", 2023-12-22T08:41:56.939 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.939 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:56.939 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow r", 2023-12-22T08:41:56.939 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-22T08:41:56.939 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.1", 2023-12-22T08:41:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlwSk/JhAAM3faae43p4/gw9BmyxLpJA==", 2023-12-22T08:41:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:41:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:41:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:41:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.940 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.2", 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VliOHMGhAARaM8FC/0maNMToLGhBR4Tg==", 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.3", 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlV/MVMRAAyN1643IAOTLOLuz4DqMZ8A==", 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.941 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.admin", 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA2S4VlBhogNhAACBsSGP7kmhCSn+XAKkvgKQ==", 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.942 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.x", 2023-12-22T08:41:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlTHG+NhAAUNkVtrDuoK2OEsy1HHkt2A==", 2023-12-22T08:41:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:41:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:41:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:41:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.y", 2023-12-22T08:41:56.943 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlED5ALBAAComDf9woKBt/IXcez+Udmg==", 2023-12-22T08:41:56.944 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:41:56.944 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:41:56.944 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:41:56.944 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:41:56.944 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.944 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:56.944 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:41:56.945 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:41:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.921+0000 7f96a6130640 1 -- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f968406a430 msgr2=0x7f968406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.921+0000 7f96a6130640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f968406a430 0x7f968406c8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f969c0096d0 tx=0x7f969c008040 comp rx=0 tx=0).stop 2023-12-22T08:41:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.921+0000 7f96a6130640 1 -- 172.21.15.38:0/184743456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96a0157980 msgr2=0x7f96a01564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.921+0000 7f96a6130640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96a0157980 0x7f96a01564d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9698036040 tx=0x7f9698004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.921+0000 7f96a6130640 1 -- 172.21.15.38:0/184743456 shutdown_connections 2023-12-22T08:41:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.921+0000 7f96a6130640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f968406a430 0x7f968406c8f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.921+0000 7f96a6130640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96a0157980 0x7f96a01564d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.921+0000 7f96a6130640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96a00b3ff0 0x7f96a014c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.921+0000 7f96a6130640 1 --2- 172.21.15.38:0/184743456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96a006d640 0x7f96a01f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:56.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.921+0000 7f96a6130640 1 -- 172.21.15.38:0/184743456 >> 172.21.15.38:0/184743456 conn(0x7f96a00d31f0 msgr2=0x7f96a015b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:56.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.922+0000 7f96a6130640 1 -- 172.21.15.38:0/184743456 shutdown_connections 2023-12-22T08:41:56.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:56.922+0000 7f96a6130640 1 -- 172.21.15.38:0/184743456 wait complete. 2023-12-22T08:41:56.949 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:57.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.170+0000 7fab05e68640 1 Processor -- start 2023-12-22T08:41:57.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.171+0000 7fab05e68640 1 -- start start 2023-12-22T08:41:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.172+0000 7fab05e68640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fab00157980 0x7fab0015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.172+0000 7fab05e68640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab000b3ff0 0x7fab0006cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.172+0000 7fab05e68640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fab000b4470 0x7fab0006d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.172+0000 7fab05e68640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab000d1520 con 0x7fab000b4470 2023-12-22T08:41:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.172+0000 7fab05e68640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab000d1800 con 0x7fab00157980 2023-12-22T08:41:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.172+0000 7fab05e68640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab000d1ae0 con 0x7fab000b3ff0 2023-12-22T08:41:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.173+0000 7fab05667640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fab000b4470 0x7fab0006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.173+0000 7fab05667640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fab000b4470 0x7fab0006d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58508/0 (socket says 172.21.15.38:58508) 2023-12-22T08:41:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.173+0000 7fab05667640 1 -- 172.21.15.38:0/433843028 learned_addr learned my addr 172.21.15.38:0/433843028 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.173+0000 7faafffff640 1 --2- 172.21.15.38:0/433843028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab000b3ff0 0x7fab0006cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.173+0000 7fab04e66640 1 --2- 172.21.15.38:0/433843028 >> v2:172.21.15.89:3300/0 conn(0x7fab00157980 0x7fab0015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.173+0000 7fab05667640 1 -- 172.21.15.38:0/433843028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab000b3ff0 msgr2=0x7fab0006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.173+0000 7fab05667640 1 --2- 172.21.15.38:0/433843028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab000b3ff0 0x7fab0006cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.173+0000 7fab05667640 1 -- 172.21.15.38:0/433843028 >> v2:172.21.15.89:3300/0 conn(0x7fab00157980 msgr2=0x7fab0015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.173+0000 7fab05667640 1 --2- 172.21.15.38:0/433843028 >> v2:172.21.15.89:3300/0 conn(0x7fab00157980 0x7fab0015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.173+0000 7fab05667640 1 -- 172.21.15.38:0/433843028 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab000d1dc0 con 0x7fab000b4470 2023-12-22T08:41:57.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.173+0000 7faafffff640 1 --2- 172.21.15.38:0/433843028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab000b3ff0 0x7fab0006cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:57.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.173+0000 7fab04e66640 1 --2- 172.21.15.38:0/433843028 >> v2:172.21.15.89:3300/0 conn(0x7fab00157980 0x7fab0015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:57.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.175+0000 7fab05667640 1 --2- 172.21.15.38:0/433843028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab000b4470 0x7fab0006d470 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fab000d3df0 tx=0x7faaf802b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d461dc21f7f2722b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:57.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.175+0000 7faaff7fe640 1 -- 172.21.15.38:0/433843028 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8031880 con 0x7fab000b4470 2023-12-22T08:41:57.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.175+0000 7faaff7fe640 1 -- 172.21.15.38:0/433843028 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf80319e0 con 0x7fab000b4470 2023-12-22T08:41:57.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.175+0000 7faaff7fe640 1 -- 172.21.15.38:0/433843028 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8031d70 con 0x7fab000b4470 2023-12-22T08:41:57.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.175+0000 7fab05e68640 1 -- 172.21.15.38:0/433843028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab000b4470 msgr2=0x7fab0006d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:57.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.175+0000 7fab05e68640 1 --2- 172.21.15.38:0/433843028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab000b4470 0x7fab0006d470 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fab000d3df0 tx=0x7faaf802b920 comp rx=0 tx=0).stop 2023-12-22T08:41:57.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.176+0000 7fab05e68640 1 -- 172.21.15.38:0/433843028 shutdown_connections 2023-12-22T08:41:57.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.176+0000 7fab05e68640 1 --2- 172.21.15.38:0/433843028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab000b4470 0x7fab0006d470 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.176+0000 7fab05e68640 1 --2- 172.21.15.38:0/433843028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab000b3ff0 0x7fab0006cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.176+0000 7fab05e68640 1 --2- 172.21.15.38:0/433843028 >> v2:172.21.15.89:3300/0 conn(0x7fab00157980 0x7fab0015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.176+0000 7fab05e68640 1 -- 172.21.15.38:0/433843028 >> 172.21.15.38:0/433843028 conn(0x7fab000d31f0 msgr2=0x7fab000d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:57.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.176+0000 7fab05e68640 1 -- 172.21.15.38:0/433843028 shutdown_connections 2023-12-22T08:41:57.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.176+0000 7fab05e68640 1 -- 172.21.15.38:0/433843028 wait complete. 2023-12-22T08:41:57.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.178+0000 7fab05e68640 1 Processor -- start 2023-12-22T08:41:57.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.178+0000 7fab05e68640 1 -- start start 2023-12-22T08:41:57.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab05e68640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab000b3ff0 0x7fab001f32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:57.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab05e68640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab000b4470 0x7fab001f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:57.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab05e68640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab00157980 0x7fab001f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:57.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab05e68640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab000d0c00 con 0x7fab000b3ff0 2023-12-22T08:41:57.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab05e68640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0006fc60 con 0x7fab00157980 2023-12-22T08:41:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab05e68640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab001f3ab0 con 0x7fab000b4470 2023-12-22T08:41:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab04e66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab000b3ff0 0x7fab001f32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab04e66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab000b3ff0 0x7fab001f32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58522/0 (socket says 172.21.15.38:58522) 2023-12-22T08:41:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab04e66640 1 -- 172.21.15.38:0/3050236157 learned_addr learned my addr 172.21.15.38:0/3050236157 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7faafffff640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab000b4470 0x7fab001f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab05667640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab00157980 0x7fab001f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab04e66640 1 -- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab000b4470 msgr2=0x7fab001f3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab04e66640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab000b4470 0x7fab001f3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab04e66640 1 -- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab00157980 msgr2=0x7fab001f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab04e66640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab00157980 0x7fab001f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.179+0000 7fab04e66640 1 -- 172.21.15.38:0/3050236157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf80094d0 con 0x7fab000b3ff0 2023-12-22T08:41:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.180+0000 7fab04e66640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab000b3ff0 0x7fab001f32b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c7f0 tx=0x7faaf000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.180+0000 7faafd7fa640 1 -- 172.21.15.38:0/3050236157 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0007820 con 0x7fab000b3ff0 2023-12-22T08:41:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.180+0000 7faafd7fa640 1 -- 172.21.15.38:0/3050236157 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf0007980 con 0x7fab000b3ff0 2023-12-22T08:41:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.180+0000 7faafd7fa640 1 -- 172.21.15.38:0/3050236157 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0007cf0 con 0x7fab000b3ff0 2023-12-22T08:41:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.180+0000 7fab05e68640 1 -- 172.21.15.38:0/3050236157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0006f300 con 0x7fab000b3ff0 2023-12-22T08:41:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.180+0000 7fab05e68640 1 -- 172.21.15.38:0/3050236157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0006f5a0 con 0x7fab000b3ff0 2023-12-22T08:41:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.181+0000 7fab05e68640 1 -- 172.21.15.38:0/3050236157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0006fed0 con 0x7fab000b3ff0 2023-12-22T08:41:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.182+0000 7faafd7fa640 1 -- 172.21.15.38:0/3050236157 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faaf00113f0 con 0x7fab000b3ff0 2023-12-22T08:41:57.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.183+0000 7faafd7fa640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faae006a430 0x7faae006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:57.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.183+0000 7faafd7fa640 1 -- 172.21.15.38:0/3050236157 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faaf0088930 con 0x7fab000b3ff0 2023-12-22T08:41:57.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.184+0000 7faafffff640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faae006a430 0x7faae006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:57.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.185+0000 7faafffff640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faae006a430 0x7faae006c8f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fab00158b30 tx=0x7faae8008460 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:57.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.187+0000 7faafd7fa640 1 -- 172.21.15.38:0/3050236157 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faaf0054260 con 0x7fab000b3ff0 2023-12-22T08:41:57.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.382+0000 7fab05e68640 1 -- 172.21.15.38:0/3050236157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab00061910 con 0x7fab000b3ff0 2023-12-22T08:41:57.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.384+0000 7faafd7fa640 1 -- 172.21.15.38:0/3050236157 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12341 (secure 0 0 0) 0x7faaf001f090 con 0x7fab000b3ff0 2023-12-22T08:41:57.386 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:57.387 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":44,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:41:56.379300+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:57.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.387+0000 7fab05e68640 1 -- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faae006a430 msgr2=0x7faae006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:57.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.387+0000 7fab05e68640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faae006a430 0x7faae006c8f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fab00158b30 tx=0x7faae8008460 comp rx=0 tx=0).stop 2023-12-22T08:41:57.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.387+0000 7fab05e68640 1 -- 172.21.15.38:0/3050236157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab000b3ff0 msgr2=0x7fab001f32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:57.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.387+0000 7fab05e68640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab000b3ff0 0x7fab001f32b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c7f0 tx=0x7faaf000ccb0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.387+0000 7fab05e68640 1 -- 172.21.15.38:0/3050236157 shutdown_connections 2023-12-22T08:41:57.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.387+0000 7fab05e68640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab00157980 0x7fab001f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.387+0000 7fab05e68640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab000b4470 0x7fab001f3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.387+0000 7fab05e68640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faae006a430 0x7faae006c8f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.387+0000 7fab05e68640 1 --2- 172.21.15.38:0/3050236157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fab000b3ff0 0x7fab001f32b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.387+0000 7fab05e68640 1 -- 172.21.15.38:0/3050236157 >> 172.21.15.38:0/3050236157 conn(0x7fab000d31f0 msgr2=0x7fab0014f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:57.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.387+0000 7fab05e68640 1 -- 172.21.15.38:0/3050236157 shutdown_connections 2023-12-22T08:41:57.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.387+0000 7fab05e68640 1 -- 172.21.15.38:0/3050236157 wait complete. 2023-12-22T08:41:57.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:57.409 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:57.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.634+0000 7f041636c640 1 Processor -- start 2023-12-22T08:41:57.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.634+0000 7f041636c640 1 -- start start 2023-12-22T08:41:57.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.635+0000 7f041636c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0410070f50 0x7f04100713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:57.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.635+0000 7f041636c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0410162d40 0x7f0410165130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:57.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.635+0000 7f041636c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041006d5f0 con 0x7f0410070b70 2023-12-22T08:41:57.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.635+0000 7f041636c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0410144fa0 con 0x7f0410070f50 2023-12-22T08:41:57.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.635+0000 7f041636c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041006da80 con 0x7f0410162d40 2023-12-22T08:41:57.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.636+0000 7f0414b69640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0410070f50 0x7f04100713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:57.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.636+0000 7f0414b69640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0410070f50 0x7f04100713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58524/0 (socket says 172.21.15.38:58524) 2023-12-22T08:41:57.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.636+0000 7f0414b69640 1 -- 172.21.15.38:0/2059061337 learned_addr learned my addr 172.21.15.38:0/2059061337 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:57.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.636+0000 7f0415b6b640 1 --2- 172.21.15.38:0/2059061337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0410162d40 0x7f0410165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:57.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.636+0000 7f0414b69640 1 -- 172.21.15.38:0/2059061337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0410162d40 msgr2=0x7f0410165130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:57.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.636+0000 7f0414b69640 1 --2- 172.21.15.38:0/2059061337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0410162d40 0x7f0410165130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.636+0000 7f0414b69640 1 -- 172.21.15.38:0/2059061337 >> v1:172.21.15.89:6789/0 conn(0x7f0410070b70 legacy=0x7f041006bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:57.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.636+0000 7f0414b69640 1 -- 172.21.15.38:0/2059061337 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041006c9e0 con 0x7f0410070f50 2023-12-22T08:41:57.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.637+0000 7f0414b69640 1 --2- 172.21.15.38:0/2059061337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0410070f50 0x7f04100713b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0404009870 tx=0x7f040402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74c25ebd36e37f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:57.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.638+0000 7f0403fff640 1 -- 172.21.15.38:0/2059061337 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404031640 con 0x7f0410070f50 2023-12-22T08:41:57.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.638+0000 7f0403fff640 1 -- 172.21.15.38:0/2059061337 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04040317a0 con 0x7f0410070f50 2023-12-22T08:41:57.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.638+0000 7f0403fff640 1 -- 172.21.15.38:0/2059061337 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404031b30 con 0x7f0410070f50 2023-12-22T08:41:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.638+0000 7f041636c640 1 -- 172.21.15.38:0/2059061337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0410070f50 msgr2=0x7f04100713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.638+0000 7f041636c640 1 --2- 172.21.15.38:0/2059061337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0410070f50 0x7f04100713b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0404009870 tx=0x7f040402b8f0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.639+0000 7f041636c640 1 -- 172.21.15.38:0/2059061337 shutdown_connections 2023-12-22T08:41:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.639+0000 7f041636c640 1 --2- 172.21.15.38:0/2059061337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0410070f50 0x7f04100713b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.639+0000 7f041636c640 1 --2- 172.21.15.38:0/2059061337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0410162d40 0x7f0410165130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.639+0000 7f041636c640 1 -- 172.21.15.38:0/2059061337 >> 172.21.15.38:0/2059061337 conn(0x7f04100b0b60 msgr2=0x7f04100b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:57.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.639+0000 7f041636c640 1 -- 172.21.15.38:0/2059061337 shutdown_connections 2023-12-22T08:41:57.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.639+0000 7f041636c640 1 -- 172.21.15.38:0/2059061337 wait complete. 2023-12-22T08:41:57.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.640+0000 7f041636c640 1 Processor -- start 2023-12-22T08:41:57.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.641+0000 7f041636c640 1 -- start start 2023-12-22T08:41:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.641+0000 7f041636c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0410070b70 0x7f0410134d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.641+0000 7f041636c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0410070f50 0x7f0410135290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.641+0000 7f041636c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0410162d40 0x7f04101357d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.642+0000 7f041636c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04101f0780 con 0x7f0410070b70 2023-12-22T08:41:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.642+0000 7f041636c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0410099ed0 con 0x7f0410070f50 2023-12-22T08:41:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.642+0000 7f041636c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041009a770 con 0x7f0410162d40 2023-12-22T08:41:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.642+0000 7f041536a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0410070b70 0x7f0410134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.642+0000 7f041536a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0410070b70 0x7f0410134d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58536/0 (socket says 172.21.15.38:58536) 2023-12-22T08:41:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.642+0000 7f041536a640 1 -- 172.21.15.38:0/236573471 learned_addr learned my addr 172.21.15.38:0/236573471 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.642+0000 7f0414b69640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0410070f50 0x7f0410135290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.642+0000 7f041536a640 1 -- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0410162d40 msgr2=0x7f04101357d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.642+0000 7f041536a640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0410162d40 0x7f04101357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.642+0000 7f041536a640 1 -- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0410070f50 msgr2=0x7f0410135290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:57.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.642+0000 7f041536a640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0410070f50 0x7f0410135290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.642+0000 7f041536a640 1 -- 172.21.15.38:0/236573471 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04040094d0 con 0x7f0410070b70 2023-12-22T08:41:57.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.642+0000 7f0414b69640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0410070f50 0x7f0410135290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:57.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.643+0000 7f041536a640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0410070b70 0x7f0410134d50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c460 tx=0x7f040c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.643+0000 7f0401ffb640 1 -- 172.21.15.38:0/236573471 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c012830 con 0x7f0410070b70 2023-12-22T08:41:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.643+0000 7f0401ffb640 1 -- 172.21.15.38:0/236573471 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c0129d0 con 0x7f0410070b70 2023-12-22T08:41:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.643+0000 7f041636c640 1 -- 172.21.15.38:0/236573471 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041013eca0 con 0x7f0410070b70 2023-12-22T08:41:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.643+0000 7f0401ffb640 1 -- 172.21.15.38:0/236573471 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c012d80 con 0x7f0410070b70 2023-12-22T08:41:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.643+0000 7f041636c640 1 -- 172.21.15.38:0/236573471 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041009a400 con 0x7f0410070b70 2023-12-22T08:41:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.644+0000 7f041636c640 1 -- 172.21.15.38:0/236573471 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0410061910 con 0x7f0410070b70 2023-12-22T08:41:57.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.645+0000 7f0401ffb640 1 -- 172.21.15.38:0/236573471 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f040c01a3b0 con 0x7f0410070b70 2023-12-22T08:41:57.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.646+0000 7f0401ffb640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f03f406a460 0x7f03f406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:57.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.646+0000 7f0401ffb640 1 -- 172.21.15.38:0/236573471 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f040c0884c0 con 0x7f0410070b70 2023-12-22T08:41:57.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.647+0000 7f0414b69640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f03f406a460 0x7f03f406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:57.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.648+0000 7f0414b69640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f03f406a460 0x7f03f406c920 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0404036000 tx=0x7f040403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.651+0000 7f0401ffb640 1 -- 172.21.15.38:0/236573471 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f040c053e00 con 0x7f0410070b70 2023-12-22T08:41:57.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.843+0000 7f041636c640 1 -- 172.21.15.38:0/236573471 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f041013c590 con 0x7f0410070b70 2023-12-22T08:41:57.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.844+0000 7f0401ffb640 1 -- 172.21.15.38:0/236573471 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f040c057420 con 0x7f0410070b70 2023-12-22T08:41:57.846 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:41:57.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.846+0000 7f041636c640 1 -- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f03f406a460 msgr2=0x7f03f406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:57.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.846+0000 7f041636c640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f03f406a460 0x7f03f406c920 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0404036000 tx=0x7f040403c040 comp rx=0 tx=0).stop 2023-12-22T08:41:57.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.847+0000 7f041636c640 1 -- 172.21.15.38:0/236573471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0410070b70 msgr2=0x7f0410134d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:57.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.847+0000 7f041636c640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0410070b70 0x7f0410134d50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c460 tx=0x7f040c00c920 comp rx=0 tx=0).stop 2023-12-22T08:41:57.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.847+0000 7f041636c640 1 -- 172.21.15.38:0/236573471 shutdown_connections 2023-12-22T08:41:57.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.847+0000 7f041636c640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0410162d40 0x7f04101357d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.847+0000 7f041636c640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0410070f50 0x7f0410135290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.847+0000 7f041636c640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f03f406a460 0x7f03f406c920 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.847+0000 7f041636c640 1 --2- 172.21.15.38:0/236573471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0410070b70 0x7f0410134d50 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:57.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.847+0000 7f041636c640 1 -- 172.21.15.38:0/236573471 >> 172.21.15.38:0/236573471 conn(0x7f04100b0b60 msgr2=0x7f041013fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:57.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.847+0000 7f041636c640 1 -- 172.21.15.38:0/236573471 shutdown_connections 2023-12-22T08:41:57.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:57.847+0000 7f041636c640 1 -- 172.21.15.38:0/236573471 wait complete. 2023-12-22T08:41:57.870 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T08:41:58.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.097+0000 7efd25a41640 1 Processor -- start 2023-12-22T08:41:58.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.098+0000 7efd25a41640 1 -- start start 2023-12-22T08:41:58.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.099+0000 7efd25a41640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efd2015db30 0x7efd2006ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.099+0000 7efd25a41640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2015eb20 con 0x7efd200b3f90 2023-12-22T08:41:58.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.099+0000 7efd25a41640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd20070770 con 0x7efd2015e740 2023-12-22T08:41:58.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.099+0000 7efd25a41640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2015df40 con 0x7efd2015db30 2023-12-22T08:41:58.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.100+0000 7efd1e7fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efd200b3f90 0x7efd20070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38084/0 (socket says 172.21.15.38:38084) 2023-12-22T08:41:58.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.100+0000 7efd1e7fc640 1 -- 172.21.15.38:0/1477827610 learned_addr learned my addr 172.21.15.38:0/1477827610 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:58.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.100+0000 7efd1f7fe640 1 --2- 172.21.15.38:0/1477827610 >> v2:172.21.15.89:3300/0 conn(0x7efd2015db30 0x7efd2006ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.100+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632325488 0 0) 0x7efd2015eb20 con 0x7efd200b3f90 2023-12-22T08:41:58.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd0c003520 con 0x7efd200b3f90 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2837194499 0 0) 0x7efd0c003520 con 0x7efd200b3f90 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 >> v2:172.21.15.89:3300/0 conn(0x7efd2015db30 msgr2=0x7efd2006ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 --2- 172.21.15.38:0/1477827610 >> v2:172.21.15.89:3300/0 conn(0x7efd2015db30 0x7efd2006ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 >> v1:172.21.15.89:6789/0 conn(0x7efd2015e740 legacy=0x7efd200b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2006d180 con 0x7efd200b3f90 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7efd080019f0 con 0x7efd200b3f90 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1f7fe640 1 --2- 172.21.15.38:0/1477827610 >> v2:172.21.15.89:3300/0 conn(0x7efd2015db30 0x7efd2006ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 >> v1:172.21.15.38:6789/0 conn(0x7efd200b3f90 legacy=0x7efd20070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 --2- 172.21.15.38:0/1477827610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd0c0039c0 0x7efd0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 --2- 172.21.15.38:0/1477827610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd0c0047c0 0x7efd0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 --2- 172.21.15.38:0/1477827610 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd0c0052a0 0x7efd0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2015df40 con 0x7efd0c0047c0 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c00c1a0 con 0x7efd0c0039c0 2023-12-22T08:41:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.101+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c00c360 con 0x7efd0c0052a0 2023-12-22T08:41:58.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.102+0000 7efd1e7fc640 1 --2- 172.21.15.38:0/1477827610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd0c0047c0 0x7efd0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.102+0000 7efd1effd640 1 --2- 172.21.15.38:0/1477827610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd0c0039c0 0x7efd0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.102+0000 7efd1f7fe640 1 --2- 172.21.15.38:0/1477827610 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd0c0052a0 0x7efd0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.102+0000 7efd1e7fc640 1 -- 172.21.15.38:0/1477827610 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd0c0052a0 msgr2=0x7efd0c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:58.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.102+0000 7efd1e7fc640 1 --2- 172.21.15.38:0/1477827610 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd0c0052a0 0x7efd0c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.102+0000 7efd1e7fc640 1 -- 172.21.15.38:0/1477827610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd0c0039c0 msgr2=0x7efd0c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:58.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.102+0000 7efd1e7fc640 1 --2- 172.21.15.38:0/1477827610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd0c0039c0 0x7efd0c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.102+0000 7efd1e7fc640 1 -- 172.21.15.38:0/1477827610 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c003520 con 0x7efd0c0047c0 2023-12-22T08:41:58.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.102+0000 7efd1f7fe640 1 -- 172.21.15.38:0/1477827610 reap_dead start 2023-12-22T08:41:58.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.104+0000 7efd1e7fc640 1 --2- 172.21.15.38:0/1477827610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd0c0047c0 0x7efd0c004c40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7efd0800a760 tx=0x7efd0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313dd242de77c62d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:58.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.104+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08034630 con 0x7efd0c0047c0 2023-12-22T08:41:58.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.104+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0802f070 con 0x7efd0c0047c0 2023-12-22T08:41:58.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.104+0000 7efd1dffb640 1 -- 172.21.15.38:0/1477827610 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08034a50 con 0x7efd0c0047c0 2023-12-22T08:41:58.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.104+0000 7efd25a41640 1 -- 172.21.15.38:0/1477827610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd0c0047c0 msgr2=0x7efd0c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:58.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.104+0000 7efd25a41640 1 --2- 172.21.15.38:0/1477827610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd0c0047c0 0x7efd0c004c40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7efd0800a760 tx=0x7efd0c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.105+0000 7efd25a41640 1 -- 172.21.15.38:0/1477827610 shutdown_connections 2023-12-22T08:41:58.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.105+0000 7efd25a41640 1 --2- 172.21.15.38:0/1477827610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd0c0047c0 0x7efd0c004c40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.105+0000 7efd25a41640 1 -- 172.21.15.38:0/1477827610 >> 172.21.15.38:0/1477827610 conn(0x7efd200cfea0 msgr2=0x7efd200d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:58.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.105+0000 7efd25a41640 1 -- 172.21.15.38:0/1477827610 shutdown_connections 2023-12-22T08:41:58.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.105+0000 7efd25a41640 1 -- 172.21.15.38:0/1477827610 wait complete. 2023-12-22T08:41:58.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.106+0000 7efd25a41640 1 Processor -- start 2023-12-22T08:41:58.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.107+0000 7efd25a41640 1 -- start start 2023-12-22T08:41:58.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd25a41640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd0c0047c0 0x7efd20146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd25a41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd201f3250 0x7efd2015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd25a41640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd200710a0 0x7efd20071530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd25a41640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd20071a70 con 0x7efd0c0047c0 2023-12-22T08:41:58.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd25a41640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd201568b0 con 0x7efd201f3250 2023-12-22T08:41:58.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd25a41640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd20155a00 con 0x7efd200710a0 2023-12-22T08:41:58.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd1effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd0c0047c0 0x7efd20146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd1effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd0c0047c0 0x7efd20146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58552/0 (socket says 172.21.15.38:58552) 2023-12-22T08:41:58.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd1effd640 1 -- 172.21.15.38:0/2439433929 learned_addr learned my addr 172.21.15.38:0/2439433929 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd1f7fe640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd200710a0 0x7efd20071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd1e7fc640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd201f3250 0x7efd2015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd1effd640 1 -- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd200710a0 msgr2=0x7efd20071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd1effd640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd200710a0 0x7efd20071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd1effd640 1 -- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd201f3250 msgr2=0x7efd2015aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd1effd640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd201f3250 0x7efd2015aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.108+0000 7efd1effd640 1 -- 172.21.15.38:0/2439433929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd20155ca0 con 0x7efd0c0047c0 2023-12-22T08:41:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.109+0000 7efd1effd640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd0c0047c0 0x7efd20146ee0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efd1000e480 tx=0x7efd1000e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.109+0000 7efd17fff640 1 -- 172.21.15.38:0/2439433929 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd100052e0 con 0x7efd0c0047c0 2023-12-22T08:41:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.109+0000 7efd17fff640 1 -- 172.21.15.38:0/2439433929 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd10005440 con 0x7efd0c0047c0 2023-12-22T08:41:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.109+0000 7efd17fff640 1 -- 172.21.15.38:0/2439433929 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd10003830 con 0x7efd0c0047c0 2023-12-22T08:41:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.109+0000 7efd25a41640 1 -- 172.21.15.38:0/2439433929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd20155f80 con 0x7efd0c0047c0 2023-12-22T08:41:58.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.109+0000 7efd25a41640 1 -- 172.21.15.38:0/2439433929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd20156540 con 0x7efd0c0047c0 2023-12-22T08:41:58.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.110+0000 7efd25a41640 1 -- 172.21.15.38:0/2439433929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd20061910 con 0x7efd0c0047c0 2023-12-22T08:41:58.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.111+0000 7efd17fff640 1 -- 172.21.15.38:0/2439433929 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd10003990 con 0x7efd0c0047c0 2023-12-22T08:41:58.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.112+0000 7efd17fff640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd0006a430 0x7efd0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.112+0000 7efd17fff640 1 -- 172.21.15.38:0/2439433929 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efd100882b0 con 0x7efd0c0047c0 2023-12-22T08:41:58.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.113+0000 7efd1e7fc640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd0006a430 0x7efd0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.114+0000 7efd1e7fc640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd0006a430 0x7efd0006c8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efd08034000 tx=0x7efd0802f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:58.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.117+0000 7efd17fff640 1 -- 172.21.15.38:0/2439433929 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd10053c80 con 0x7efd0c0047c0 2023-12-22T08:41:58.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.311+0000 7efd25a41640 1 -- 172.21.15.38:0/2439433929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efd2015b4c0 con 0x7efd0c0047c0 2023-12-22T08:41:58.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.312+0000 7efd17fff640 1 -- 172.21.15.38:0/2439433929 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) v1 ==== 84+0+65 (secure 0 0 0) 0x7efd100572a0 con 0x7efd0c0047c0 2023-12-22T08:41:58.314 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:41:58.314 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-12-22T08:41:58.315 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:41:58.315 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-12-22T08:41:58.315 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-12-22T08:41:58.315 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:41:58.315 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-12-22T08:41:58.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.314+0000 7efd25a41640 1 -- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd0006a430 msgr2=0x7efd0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:58.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.314+0000 7efd25a41640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd0006a430 0x7efd0006c8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efd08034000 tx=0x7efd0802f000 comp rx=0 tx=0).stop 2023-12-22T08:41:58.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.314+0000 7efd25a41640 1 -- 172.21.15.38:0/2439433929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd0c0047c0 msgr2=0x7efd20146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:58.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.314+0000 7efd25a41640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd0c0047c0 0x7efd20146ee0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efd1000e480 tx=0x7efd1000e940 comp rx=0 tx=0).stop 2023-12-22T08:41:58.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.315+0000 7efd25a41640 1 -- 172.21.15.38:0/2439433929 shutdown_connections 2023-12-22T08:41:58.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.315+0000 7efd25a41640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd200710a0 0x7efd20071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.315+0000 7efd25a41640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd201f3250 0x7efd2015aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.315+0000 7efd25a41640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd0006a430 0x7efd0006c8f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.315+0000 7efd25a41640 1 --2- 172.21.15.38:0/2439433929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd0c0047c0 0x7efd20146ee0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.315+0000 7efd25a41640 1 -- 172.21.15.38:0/2439433929 >> 172.21.15.38:0/2439433929 conn(0x7efd200cfea0 msgr2=0x7efd200d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:58.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.315+0000 7efd25a41640 1 -- 172.21.15.38:0/2439433929 shutdown_connections 2023-12-22T08:41:58.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.315+0000 7efd25a41640 1 -- 172.21.15.38:0/2439433929 wait complete. 2023-12-22T08:41:58.336 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T08:41:58.336 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T08:41:58.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.562+0000 7fe1948da640 1 Processor -- start 2023-12-22T08:41:58.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.563+0000 7fe1948da640 1 -- start start 2023-12-22T08:41:58.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.564+0000 7fe1948da640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe190146eb0 0x7fe1900d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.564+0000 7fe1948da640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe19006f2c0 0x7fe1900d2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.564+0000 7fe1948da640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe190070a70 con 0x7fe190146ad0 2023-12-22T08:41:58.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.564+0000 7fe1948da640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe190070850 con 0x7fe190146eb0 2023-12-22T08:41:58.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.564+0000 7fe1948da640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19009ed10 con 0x7fe19006f2c0 2023-12-22T08:41:58.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.565+0000 7fe18ed9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe190146ad0 0x7fe190070140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38096/0 (socket says 172.21.15.38:38096) 2023-12-22T08:41:58.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.565+0000 7fe18ed9d640 1 -- 172.21.15.38:0/1578395554 learned_addr learned my addr 172.21.15.38:0/1578395554 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:41:58.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.565+0000 7fe18e59c640 1 --2- 172.21.15.38:0/1578395554 >> v2:172.21.15.89:3300/0 conn(0x7fe190146eb0 0x7fe1900d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.565+0000 7fe18f59e640 1 --2- 172.21.15.38:0/1578395554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe19006f2c0 0x7fe1900d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.565+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746292664 0 0) 0x7fe190070a70 con 0x7fe190146ad0 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.565+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe178003520 con 0x7fe190146ad0 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 832905083 0 0) 0x7fe178003520 con 0x7fe190146ad0 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe19006f2c0 msgr2=0x7fe1900d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 --2- 172.21.15.38:0/1578395554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe19006f2c0 0x7fe1900d2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 >> v2:172.21.15.89:3300/0 conn(0x7fe190146eb0 msgr2=0x7fe1900d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 --2- 172.21.15.38:0/1578395554 >> v2:172.21.15.89:3300/0 conn(0x7fe190146eb0 0x7fe1900d1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19009eff0 con 0x7fe190146ad0 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fe180001670 con 0x7fe190146ad0 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 >> v1:172.21.15.38:6789/0 conn(0x7fe190146ad0 legacy=0x7fe190070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 --2- 172.21.15.38:0/1578395554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe178003970 0x7fe178003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 --2- 172.21.15.38:0/1578395554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1780047c0 0x7fe178004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 --2- 172.21.15.38:0/1578395554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe19006f2c0 0x7fe178005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe190070850 con 0x7fe1780047c0 2023-12-22T08:41:58.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19009ed10 con 0x7fe178003970 2023-12-22T08:41:58.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17800b980 con 0x7fe19006f2c0 2023-12-22T08:41:58.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18e59c640 1 --2- 172.21.15.38:0/1578395554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1780047c0 0x7fe178004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.566+0000 7fe18ed9d640 1 --2- 172.21.15.38:0/1578395554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe178003970 0x7fe178003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.567+0000 7fe18f59e640 1 --2- 172.21.15.38:0/1578395554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe19006f2c0 0x7fe178005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.567+0000 7fe18e59c640 1 -- 172.21.15.38:0/1578395554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe19006f2c0 msgr2=0x7fe178005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:58.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.567+0000 7fe18e59c640 1 --2- 172.21.15.38:0/1578395554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe19006f2c0 0x7fe178005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.567+0000 7fe18e59c640 1 -- 172.21.15.38:0/1578395554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe178003970 msgr2=0x7fe178003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:58.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.567+0000 7fe18e59c640 1 --2- 172.21.15.38:0/1578395554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe178003970 0x7fe178003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.567+0000 7fe18e59c640 1 -- 172.21.15.38:0/1578395554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178003520 con 0x7fe1780047c0 2023-12-22T08:41:58.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.568+0000 7fe18e59c640 1 --2- 172.21.15.38:0/1578395554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1780047c0 0x7fe178004c40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe184009ac0 tx=0x7fe1780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1547eecaf5fd3f29 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:58.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.568+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18402c710 con 0x7fe1780047c0 2023-12-22T08:41:58.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.568+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18402c870 con 0x7fe1780047c0 2023-12-22T08:41:58.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.568+0000 7fe18dd9b640 1 -- 172.21.15.38:0/1578395554 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18402cc00 con 0x7fe1780047c0 2023-12-22T08:41:58.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.569+0000 7fe1948da640 1 -- 172.21.15.38:0/1578395554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1780047c0 msgr2=0x7fe178004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:58.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.569+0000 7fe1948da640 1 --2- 172.21.15.38:0/1578395554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1780047c0 0x7fe178004c40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe184009ac0 tx=0x7fe1780057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.569+0000 7fe18f59e640 1 -- 172.21.15.38:0/1578395554 reap_dead start 2023-12-22T08:41:58.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.569+0000 7fe1948da640 1 -- 172.21.15.38:0/1578395554 shutdown_connections 2023-12-22T08:41:58.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.569+0000 7fe1948da640 1 -- 172.21.15.38:0/1578395554 >> 172.21.15.38:0/1578395554 conn(0x7fe19006cf30 msgr2=0x7fe1900b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:58.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.569+0000 7fe1948da640 1 -- 172.21.15.38:0/1578395554 shutdown_connections 2023-12-22T08:41:58.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.569+0000 7fe1948da640 1 -- 172.21.15.38:0/1578395554 wait complete. 2023-12-22T08:41:58.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.571+0000 7fe1948da640 1 Processor -- start 2023-12-22T08:41:58.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.571+0000 7fe1948da640 1 -- start start 2023-12-22T08:41:58.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.572+0000 7fe1948da640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1780047c0 0x7fe19013c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.572+0000 7fe1948da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe19015bc10 0x7fe1901e7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.572+0000 7fe1948da640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe190157a60 0x7fe190142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.572+0000 7fe1948da640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19015c090 con 0x7fe190157a60 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.572+0000 7fe1948da640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe190158ea0 con 0x7fe19015bc10 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.572+0000 7fe1948da640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1901e7ac0 con 0x7fe1780047c0 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.572+0000 7fe18f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe190157a60 0x7fe190142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.572+0000 7fe18f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe190157a60 0x7fe190142b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58560/0 (socket says 172.21.15.38:58560) 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.572+0000 7fe18f59e640 1 -- 172.21.15.38:0/3479282845 learned_addr learned my addr 172.21.15.38:0/3479282845 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.573+0000 7fe18ed9d640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1780047c0 0x7fe19013c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.573+0000 7fe18e59c640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe19015bc10 0x7fe1901e7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.573+0000 7fe18f59e640 1 -- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1780047c0 msgr2=0x7fe19013c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.573+0000 7fe18f59e640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1780047c0 0x7fe19013c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.573+0000 7fe18f59e640 1 -- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe19015bc10 msgr2=0x7fe1901e7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.573+0000 7fe18f59e640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe19015bc10 0x7fe1901e7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.573+0000 7fe18f59e640 1 -- 172.21.15.38:0/3479282845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19015c2a0 con 0x7fe190157a60 2023-12-22T08:41:58.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.573+0000 7fe18e59c640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe19015bc10 0x7fe1901e7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:58.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.573+0000 7fe18f59e640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe190157a60 0x7fe190142b50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe1900b9760 tx=0x7fe18800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:58.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.574+0000 7fe1777fe640 1 -- 172.21.15.38:0/3479282845 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188017400 con 0x7fe190157a60 2023-12-22T08:41:58.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.574+0000 7fe1777fe640 1 -- 172.21.15.38:0/3479282845 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188011040 con 0x7fe190157a60 2023-12-22T08:41:58.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.574+0000 7fe1777fe640 1 -- 172.21.15.38:0/3479282845 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1880177c0 con 0x7fe190157a60 2023-12-22T08:41:58.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.574+0000 7fe1948da640 1 -- 172.21.15.38:0/3479282845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19015c580 con 0x7fe190157a60 2023-12-22T08:41:58.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.574+0000 7fe1948da640 1 -- 172.21.15.38:0/3479282845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19015a3b0 con 0x7fe190157a60 2023-12-22T08:41:58.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.575+0000 7fe1948da640 1 -- 172.21.15.38:0/3479282845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19015a5a0 con 0x7fe190157a60 2023-12-22T08:41:58.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.576+0000 7fe1777fe640 1 -- 172.21.15.38:0/3479282845 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe188017920 con 0x7fe190157a60 2023-12-22T08:41:58.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.577+0000 7fe1777fe640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe17c06a430 0x7fe17c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:58.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.577+0000 7fe1777fe640 1 -- 172.21.15.38:0/3479282845 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe188088a40 con 0x7fe190157a60 2023-12-22T08:41:58.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.578+0000 7fe18ed9d640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe17c06a430 0x7fe17c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:58.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.579+0000 7fe18ed9d640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe17c06a430 0x7fe17c06c8f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe180000fb0 tx=0x7fe180009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.581+0000 7fe1777fe640 1 -- 172.21.15.38:0/3479282845 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe188054370 con 0x7fe190157a60 2023-12-22T08:41:58.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:58.783+0000 7fe1948da640 1 -- 172.21.15.38:0/3479282845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe190061910 con 0x7fe190157a60 2023-12-22T08:41:59.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.430+0000 7fe1777fe640 1 -- 172.21.15.38:0/3479282845 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe188057990 con 0x7fe190157a60 2023-12-22T08:41:59.434 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-12-22T08:41:59.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.439+0000 7fe1948da640 1 -- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe17c06a430 msgr2=0x7fe17c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:59.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.439+0000 7fe1948da640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe17c06a430 0x7fe17c06c8f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe180000fb0 tx=0x7fe180009040 comp rx=0 tx=0).stop 2023-12-22T08:41:59.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.439+0000 7fe1948da640 1 -- 172.21.15.38:0/3479282845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe190157a60 msgr2=0x7fe190142b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:59.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.439+0000 7fe1948da640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe190157a60 0x7fe190142b50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe1900b9760 tx=0x7fe18800f4a0 comp rx=0 tx=0).stop 2023-12-22T08:41:59.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.440+0000 7fe1948da640 1 -- 172.21.15.38:0/3479282845 shutdown_connections 2023-12-22T08:41:59.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.440+0000 7fe1948da640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe17c06a430 0x7fe17c06c8f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:59.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.440+0000 7fe1948da640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe190157a60 0x7fe190142b50 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:59.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.440+0000 7fe1948da640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe19015bc10 0x7fe1901e7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:59.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.440+0000 7fe1948da640 1 --2- 172.21.15.38:0/3479282845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1780047c0 0x7fe19013c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:59.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.440+0000 7fe1948da640 1 -- 172.21.15.38:0/3479282845 >> 172.21.15.38:0/3479282845 conn(0x7fe19006cf30 msgr2=0x7fe1900d1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:59.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.441+0000 7fe1948da640 1 -- 172.21.15.38:0/3479282845 shutdown_connections 2023-12-22T08:41:59.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.441+0000 7fe1948da640 1 -- 172.21.15.38:0/3479282845 wait complete. 2023-12-22T08:41:59.464 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T08:41:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.689+0000 7f10dd5c9640 1 Processor -- start 2023-12-22T08:41:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.689+0000 7f10dd5c9640 1 -- start start 2023-12-22T08:41:59.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.691+0000 7f10dd5c9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f10d80b22c0 0x7f10d80b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:59.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.691+0000 7f10dd5c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f10d80b26a0 0x7f10d806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:59.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.692+0000 7f10dd5c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d80b4510 con 0x7f10d806cf50 2023-12-22T08:41:59.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.692+0000 7f10dd5c9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d806c610 con 0x7f10d80b22c0 2023-12-22T08:41:59.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.692+0000 7f10dd5c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d80b3f50 con 0x7f10d80b26a0 2023-12-22T08:41:59.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.692+0000 7f10d6ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f10d80b22c0 0x7f10d80b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:59.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.692+0000 7f10d6ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f10d80b22c0 0x7f10d80b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58576/0 (socket says 172.21.15.38:58576) 2023-12-22T08:41:59.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.692+0000 7f10d6ffd640 1 -- 172.21.15.38:0/3415357886 learned_addr learned my addr 172.21.15.38:0/3415357886 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.692+0000 7f10ce7fc640 1 --2- 172.21.15.38:0/3415357886 >> v2:172.21.15.89:3300/0 conn(0x7f10d80b26a0 0x7f10d806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.692+0000 7f10d6ffd640 1 -- 172.21.15.38:0/3415357886 >> v2:172.21.15.89:3300/0 conn(0x7f10d80b26a0 msgr2=0x7f10d806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.692+0000 7f10d6ffd640 1 --2- 172.21.15.38:0/3415357886 >> v2:172.21.15.89:3300/0 conn(0x7f10d80b26a0 0x7f10d806ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.692+0000 7f10d6ffd640 1 -- 172.21.15.38:0/3415357886 >> v1:172.21.15.89:6789/0 conn(0x7f10d806cf50 legacy=0x7f10d80cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.692+0000 7f10d6ffd640 1 -- 172.21.15.38:0/3415357886 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d80b4230 con 0x7f10d80b22c0 2023-12-22T08:41:59.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.694+0000 7f10d6ffd640 1 --2- 172.21.15.38:0/3415357886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d80b22c0 0x7f10d80b3600 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f10d80b2b10 tx=0x7f10c802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e15eb2f49dbb5e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.694+0000 7f10d67fc640 1 -- 172.21.15.38:0/3415357886 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c80317e0 con 0x7f10d80b22c0 2023-12-22T08:41:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.694+0000 7f10d67fc640 1 -- 172.21.15.38:0/3415357886 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c8031940 con 0x7f10d80b22c0 2023-12-22T08:41:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.694+0000 7f10d67fc640 1 -- 172.21.15.38:0/3415357886 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8031cd0 con 0x7f10d80b22c0 2023-12-22T08:41:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.694+0000 7f10dd5c9640 1 -- 172.21.15.38:0/3415357886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d80b22c0 msgr2=0x7f10d80b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.694+0000 7f10dd5c9640 1 --2- 172.21.15.38:0/3415357886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d80b22c0 0x7f10d80b3600 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f10d80b2b10 tx=0x7f10c802b880 comp rx=0 tx=0).stop 2023-12-22T08:41:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.695+0000 7f10dd5c9640 1 -- 172.21.15.38:0/3415357886 shutdown_connections 2023-12-22T08:41:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.695+0000 7f10dd5c9640 1 --2- 172.21.15.38:0/3415357886 >> v2:172.21.15.89:3300/0 conn(0x7f10d80b26a0 0x7f10d806ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.695+0000 7f10dd5c9640 1 --2- 172.21.15.38:0/3415357886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d80b22c0 0x7f10d80b3600 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:59.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.695+0000 7f10dd5c9640 1 -- 172.21.15.38:0/3415357886 >> 172.21.15.38:0/3415357886 conn(0x7f10d80cf070 msgr2=0x7f10d80cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:59.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.695+0000 7f10dd5c9640 1 -- 172.21.15.38:0/3415357886 shutdown_connections 2023-12-22T08:41:59.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.695+0000 7f10dd5c9640 1 -- 172.21.15.38:0/3415357886 wait complete. 2023-12-22T08:41:59.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.697+0000 7f10dd5c9640 1 Processor -- start 2023-12-22T08:41:59.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.697+0000 7f10dd5c9640 1 -- start start 2023-12-22T08:41:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.698+0000 7f10dd5c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d806cf50 0x7f10d8159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.698+0000 7f10dd5c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10d80b22c0 0x7f10d8144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.698+0000 7f10dd5c9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d80b26a0 0x7f10d8157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.698+0000 7f10dd5c9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8159b10 con 0x7f10d80b26a0 2023-12-22T08:41:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.698+0000 7f10dd5c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8158f40 con 0x7f10d80b22c0 2023-12-22T08:41:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.698+0000 7f10dd5c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8148760 con 0x7f10d806cf50 2023-12-22T08:41:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.698+0000 7f10d77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d80b26a0 0x7f10d8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.698+0000 7f10d77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d80b26a0 0x7f10d8157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58582/0 (socket says 172.21.15.38:58582) 2023-12-22T08:41:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.698+0000 7f10d77fe640 1 -- 172.21.15.38:0/1803792372 learned_addr learned my addr 172.21.15.38:0/1803792372 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:41:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.698+0000 7f10ce7fc640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10d80b22c0 0x7f10d8144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.698+0000 7f10d6ffd640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d806cf50 0x7f10d8159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.699+0000 7f10d77fe640 1 -- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d806cf50 msgr2=0x7f10d8159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.699+0000 7f10d77fe640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d806cf50 0x7f10d8159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.699+0000 7f10d77fe640 1 -- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10d80b22c0 msgr2=0x7f10d8144ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.699+0000 7f10d77fe640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10d80b22c0 0x7f10d8144ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.699+0000 7f10d77fe640 1 -- 172.21.15.38:0/1803792372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c80094d0 con 0x7f10d80b26a0 2023-12-22T08:41:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.699+0000 7f10d6ffd640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d806cf50 0x7f10d8159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.699+0000 7f10d77fe640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d80b26a0 0x7f10d8157000 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f10d000c780 tx=0x7f10d000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.699+0000 7f10cffff640 1 -- 172.21.15.38:0/1803792372 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0003d80 con 0x7f10d80b26a0 2023-12-22T08:41:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.699+0000 7f10cffff640 1 -- 172.21.15.38:0/1803792372 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d000ce30 con 0x7f10d80b26a0 2023-12-22T08:41:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.699+0000 7f10cffff640 1 -- 172.21.15.38:0/1803792372 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d00052b0 con 0x7f10d80b26a0 2023-12-22T08:41:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.699+0000 7f10dd5c9640 1 -- 172.21.15.38:0/1803792372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d8159170 con 0x7f10d80b26a0 2023-12-22T08:41:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.699+0000 7f10dd5c9640 1 -- 172.21.15.38:0/1803792372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d8159730 con 0x7f10d80b26a0 2023-12-22T08:41:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.700+0000 7f10dd5c9640 1 -- 172.21.15.38:0/1803792372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d8159c50 con 0x7f10d80b26a0 2023-12-22T08:41:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.702+0000 7f10cffff640 1 -- 172.21.15.38:0/1803792372 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f10d0006b10 con 0x7f10d80b26a0 2023-12-22T08:41:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.703+0000 7f10cffff640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f10b806a430 0x7f10b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.703+0000 7f10cffff640 1 -- 172.21.15.38:0/1803792372 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f10d0087ec0 con 0x7f10d80b26a0 2023-12-22T08:41:59.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.704+0000 7f10d6ffd640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f10b806a430 0x7f10b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:59.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.705+0000 7f10d6ffd640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f10b806a430 0x7f10b806c8f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f10c8036000 tx=0x7f10c803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:59.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.706+0000 7f10cffff640 1 -- 172.21.15.38:0/1803792372 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f10d0053690 con 0x7f10d80b26a0 2023-12-22T08:41:59.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:41:59.898+0000 7f10dd5c9640 1 -- 172.21.15.38:0/1803792372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f10d8159c50 con 0x7f10d80b26a0 2023-12-22T08:42:00.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.440+0000 7f10cffff640 1 -- 172.21.15.38:0/1803792372 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) v1 ==== 170+0+0 (secure 0 0 0) 0x7f10d8159c50 con 0x7f10d80b26a0 2023-12-22T08:42:00.446 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-12-22T08:42:00.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.453+0000 7f10dd5c9640 1 -- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f10b806a430 msgr2=0x7f10b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:00.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.453+0000 7f10dd5c9640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f10b806a430 0x7f10b806c8f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f10c8036000 tx=0x7f10c803d040 comp rx=0 tx=0).stop 2023-12-22T08:42:00.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.453+0000 7f10dd5c9640 1 -- 172.21.15.38:0/1803792372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d80b26a0 msgr2=0x7f10d8157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:00.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.453+0000 7f10dd5c9640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d80b26a0 0x7f10d8157000 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f10d000c780 tx=0x7f10d000cc40 comp rx=0 tx=0).stop 2023-12-22T08:42:00.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.454+0000 7f10dd5c9640 1 -- 172.21.15.38:0/1803792372 shutdown_connections 2023-12-22T08:42:00.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.454+0000 7f10dd5c9640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f10b806a430 0x7f10b806c8f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.454+0000 7f10dd5c9640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d80b26a0 0x7f10d8157000 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.454+0000 7f10dd5c9640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10d80b22c0 0x7f10d8144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.454+0000 7f10dd5c9640 1 --2- 172.21.15.38:0/1803792372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10d806cf50 0x7f10d8159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.454+0000 7f10dd5c9640 1 -- 172.21.15.38:0/1803792372 >> 172.21.15.38:0/1803792372 conn(0x7f10d80cf070 msgr2=0x7f10d81605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:00.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.458+0000 7f10dd5c9640 1 -- 172.21.15.38:0/1803792372 shutdown_connections 2023-12-22T08:42:00.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.459+0000 7f10dd5c9640 1 -- 172.21.15.38:0/1803792372 wait complete. 2023-12-22T08:42:00.483 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T08:42:00.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.676+0000 7f48950d7640 1 Processor -- start 2023-12-22T08:42:00.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.677+0000 7f48950d7640 1 -- start start 2023-12-22T08:42:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.678+0000 7f48950d7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4890146c00 0x7f489006f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.678+0000 7f48950d7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4890160f60 0x7f48901613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.679+0000 7f48950d7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f489015d920 0x7f489015ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.679+0000 7f48950d7640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48900abda0 con 0x7f4890160f60 2023-12-22T08:42:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.679+0000 7f48950d7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48901618e0 con 0x7f489015d920 2023-12-22T08:42:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.679+0000 7f48950d7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4890161db0 con 0x7f4890146c00 2023-12-22T08:42:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.679+0000 7f4887fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4890160f60 0x7f48901613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.679+0000 7f4887fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4890160f60 0x7f48901613a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58592/0 (socket says 172.21.15.38:58592) 2023-12-22T08:42:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.679+0000 7f4887fff640 1 -- 172.21.15.38:0/75430231 learned_addr learned my addr 172.21.15.38:0/75430231 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.679+0000 7f48948d6640 1 --2- 172.21.15.38:0/75430231 >> v2:172.21.15.89:3300/0 conn(0x7f489015d920 0x7f489015ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.679+0000 7f488ffff640 1 --2- 172.21.15.38:0/75430231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4890146c00 0x7f489006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.680+0000 7f4887fff640 1 -- 172.21.15.38:0/75430231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4890146c00 msgr2=0x7f489006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.680+0000 7f4887fff640 1 --2- 172.21.15.38:0/75430231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4890146c00 0x7f489006f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.680+0000 7f4887fff640 1 -- 172.21.15.38:0/75430231 >> v2:172.21.15.89:3300/0 conn(0x7f489015d920 msgr2=0x7f489015ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.680+0000 7f4887fff640 1 --2- 172.21.15.38:0/75430231 >> v2:172.21.15.89:3300/0 conn(0x7f489015d920 0x7f489015ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.680+0000 7f4887fff640 1 -- 172.21.15.38:0/75430231 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4890146fe0 con 0x7f4890160f60 2023-12-22T08:42:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.681+0000 7f4887fff640 1 --2- 172.21.15.38:0/75430231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4890160f60 0x7f48901613a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f489015ea80 tx=0x7f487802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e4a74c55b7ed81 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:00.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.681+0000 7f488f7fe640 1 -- 172.21.15.38:0/75430231 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878031860 con 0x7f4890160f60 2023-12-22T08:42:00.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.682+0000 7f488f7fe640 1 -- 172.21.15.38:0/75430231 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48780319c0 con 0x7f4890160f60 2023-12-22T08:42:00.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.682+0000 7f488f7fe640 1 -- 172.21.15.38:0/75430231 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878031d50 con 0x7f4890160f60 2023-12-22T08:42:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.682+0000 7f48950d7640 1 -- 172.21.15.38:0/75430231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4890160f60 msgr2=0x7f48901613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.682+0000 7f48950d7640 1 --2- 172.21.15.38:0/75430231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4890160f60 0x7f48901613a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f489015ea80 tx=0x7f487802b900 comp rx=0 tx=0).stop 2023-12-22T08:42:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.682+0000 7f48950d7640 1 -- 172.21.15.38:0/75430231 shutdown_connections 2023-12-22T08:42:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.682+0000 7f48950d7640 1 --2- 172.21.15.38:0/75430231 >> v2:172.21.15.89:3300/0 conn(0x7f489015d920 0x7f489015ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.682+0000 7f48950d7640 1 --2- 172.21.15.38:0/75430231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4890160f60 0x7f48901613a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.682+0000 7f48950d7640 1 --2- 172.21.15.38:0/75430231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4890146c00 0x7f489006f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.682+0000 7f48950d7640 1 -- 172.21.15.38:0/75430231 >> 172.21.15.38:0/75430231 conn(0x7f48900b0b60 msgr2=0x7f48900b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:00.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.682+0000 7f48950d7640 1 -- 172.21.15.38:0/75430231 shutdown_connections 2023-12-22T08:42:00.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.683+0000 7f48950d7640 1 -- 172.21.15.38:0/75430231 wait complete. 2023-12-22T08:42:00.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.684+0000 7f48950d7640 1 Processor -- start 2023-12-22T08:42:00.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.684+0000 7f48950d7640 1 -- start start 2023-12-22T08:42:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.685+0000 7f48950d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4890146c00 0x7f489015aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.685+0000 7f48950d7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f489015d920 0x7f48900ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.685+0000 7f48950d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4890160f60 0x7f48900ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f48950d7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4890143580 con 0x7f4890146c00 2023-12-22T08:42:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f48950d7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4890142cd0 con 0x7f4890160f60 2023-12-22T08:42:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f48950d7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48900ce730 con 0x7f489015d920 2023-12-22T08:42:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f488ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4890146c00 0x7f489015aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f488ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4890146c00 0x7f489015aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58606/0 (socket says 172.21.15.38:58606) 2023-12-22T08:42:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f488ffff640 1 -- 172.21.15.38:0/2619874592 learned_addr learned my addr 172.21.15.38:0/2619874592 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f48948d6640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4890160f60 0x7f48900ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f4887fff640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f489015d920 0x7f48900ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f488ffff640 1 -- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f489015d920 msgr2=0x7f48900ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f488ffff640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f489015d920 0x7f48900ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f488ffff640 1 -- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4890160f60 msgr2=0x7f48900ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:00.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f488ffff640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4890160f60 0x7f48900ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f488ffff640 1 -- 172.21.15.38:0/2619874592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48780094d0 con 0x7f4890146c00 2023-12-22T08:42:00.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f48948d6640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4890160f60 0x7f48900ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:00.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.686+0000 7f4887fff640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f489015d920 0x7f48900ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:00.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.687+0000 7f488ffff640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4890146c00 0x7f489015aff0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f488000d800 tx=0x7f488000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:00.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.687+0000 7f488d7fa640 1 -- 172.21.15.38:0/2619874592 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800096a0 con 0x7f4890146c00 2023-12-22T08:42:00.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.687+0000 7f488d7fa640 1 -- 172.21.15.38:0/2619874592 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4880009800 con 0x7f4890146c00 2023-12-22T08:42:00.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.687+0000 7f488d7fa640 1 -- 172.21.15.38:0/2619874592 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880009990 con 0x7f4890146c00 2023-12-22T08:42:00.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.687+0000 7f48950d7640 1 -- 172.21.15.38:0/2619874592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48901432a0 con 0x7f4890146c00 2023-12-22T08:42:00.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.687+0000 7f48950d7640 1 -- 172.21.15.38:0/2619874592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4890142960 con 0x7f4890146c00 2023-12-22T08:42:00.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.688+0000 7f48950d7640 1 -- 172.21.15.38:0/2619874592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48901424e0 con 0x7f4890146c00 2023-12-22T08:42:00.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.689+0000 7f488d7fa640 1 -- 172.21.15.38:0/2619874592 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4880009af0 con 0x7f4890146c00 2023-12-22T08:42:00.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.690+0000 7f488d7fa640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f487006a430 0x7f487006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:00.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.690+0000 7f488d7fa640 1 -- 172.21.15.38:0/2619874592 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4880088e30 con 0x7f4890146c00 2023-12-22T08:42:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.691+0000 7f4887fff640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f487006a430 0x7f487006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.692+0000 7f4887fff640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f487006a430 0x7f487006c8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4878036000 tx=0x7f487803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.695+0000 7f488d7fa640 1 -- 172.21.15.38:0/2619874592 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f48901424e0 con 0x7f4890146c00 2023-12-22T08:42:00.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.931+0000 7f48950d7640 1 -- 172.21.15.38:0/2619874592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f48901424e0 con 0x7f4890146c00 2023-12-22T08:42:00.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.942+0000 7f488d7fa640 1 -- 172.21.15.38:0/2619874592 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f48901424e0 con 0x7f4890146c00 2023-12-22T08:42:00.944 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 6 and data pool 7 2023-12-22T08:42:00.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.945+0000 7f48950d7640 1 -- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f487006a430 msgr2=0x7f487006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:00.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.945+0000 7f48950d7640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f487006a430 0x7f487006c8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4878036000 tx=0x7f487803c040 comp rx=0 tx=0).stop 2023-12-22T08:42:00.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.945+0000 7f48950d7640 1 -- 172.21.15.38:0/2619874592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4890146c00 msgr2=0x7f489015aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:00.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.945+0000 7f48950d7640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4890146c00 0x7f489015aff0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f488000d800 tx=0x7f488000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.947+0000 7f48950d7640 1 -- 172.21.15.38:0/2619874592 shutdown_connections 2023-12-22T08:42:00.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.947+0000 7f48950d7640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4890160f60 0x7f48900ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.947+0000 7f48950d7640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f489015d920 0x7f48900ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.947+0000 7f48950d7640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f487006a430 0x7f487006c8f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.947+0000 7f48950d7640 1 --2- 172.21.15.38:0/2619874592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4890146c00 0x7f489015aff0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:00.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.947+0000 7f48950d7640 1 -- 172.21.15.38:0/2619874592 >> 172.21.15.38:0/2619874592 conn(0x7f48900b0b60 msgr2=0x7f4890143d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:00.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.947+0000 7f48950d7640 1 -- 172.21.15.38:0/2619874592 shutdown_connections 2023-12-22T08:42:00.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:00.947+0000 7f48950d7640 1 -- 172.21.15.38:0/2619874592 wait complete. 2023-12-22T08:42:00.981 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:42:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.162+0000 7ffba2ca1640 1 Processor -- start 2023-12-22T08:42:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.162+0000 7ffba2ca1640 1 -- start start 2023-12-22T08:42:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffba2ca1640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb9c144d10 0x7ffb9c0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffba2ca1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffb9c0cc670 0x7ffb9c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffba2ca1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0b2590 0x7ffb9c15f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffba2ca1640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9c0b2a00 con 0x7ffb9c144d10 2023-12-22T08:42:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffba2ca1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9c1450f0 con 0x7ffb9c0cc670 2023-12-22T08:42:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffba2ca1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c0ce010 con 0x7ffb9c0b2590 2023-12-22T08:42:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffba0a3d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb9c144d10 0x7ffb9c0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffba0a3d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb9c144d10 0x7ffb9c0cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57686/0 (socket says 172.21.15.38:57686) 2023-12-22T08:42:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffba0a3d640 1 -- 172.21.15.38:0/2375470084 learned_addr learned my addr 172.21.15.38:0/2375470084 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffba0a3d640 1 -- 172.21.15.38:0/2375470084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0b2590 msgr2=0x7ffb9c15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffba0a3d640 1 --2- 172.21.15.38:0/2375470084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0b2590 0x7ffb9c15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffb9bfff640 1 --2- 172.21.15.38:0/2375470084 >> v2:172.21.15.89:3300/0 conn(0x7ffb9c0cc670 0x7ffb9c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffba0a3d640 1 -- 172.21.15.38:0/2375470084 >> v2:172.21.15.89:3300/0 conn(0x7ffb9c0cc670 msgr2=0x7ffb9c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.164+0000 7ffba0a3d640 1 --2- 172.21.15.38:0/2375470084 >> v2:172.21.15.89:3300/0 conn(0x7ffb9c0cc670 0x7ffb9c0b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.165+0000 7ffba0a3d640 1 -- 172.21.15.38:0/2375470084 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c0ce2f0 con 0x7ffb9c144d10 2023-12-22T08:42:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.166+0000 7ffba0a3d640 1 --2- 172.21.15.38:0/2375470084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb9c144d10 0x7ffb9c0cc130 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0b32f0 tx=0x7ffb9002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a338d2cd424e8adf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.166+0000 7ffb9b7fe640 1 -- 172.21.15.38:0/2375470084 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb90031870 con 0x7ffb9c144d10 2023-12-22T08:42:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.166+0000 7ffb9b7fe640 1 -- 172.21.15.38:0/2375470084 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb900319d0 con 0x7ffb9c144d10 2023-12-22T08:42:01.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.166+0000 7ffb9b7fe640 1 -- 172.21.15.38:0/2375470084 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb90031d60 con 0x7ffb9c144d10 2023-12-22T08:42:01.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.167+0000 7ffba2ca1640 1 -- 172.21.15.38:0/2375470084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb9c144d10 msgr2=0x7ffb9c0cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:01.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.167+0000 7ffba2ca1640 1 --2- 172.21.15.38:0/2375470084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb9c144d10 0x7ffb9c0cc130 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0b32f0 tx=0x7ffb9002b910 comp rx=0 tx=0).stop 2023-12-22T08:42:01.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.167+0000 7ffba2ca1640 1 -- 172.21.15.38:0/2375470084 shutdown_connections 2023-12-22T08:42:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.167+0000 7ffba2ca1640 1 --2- 172.21.15.38:0/2375470084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0b2590 0x7ffb9c15f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.167+0000 7ffba2ca1640 1 --2- 172.21.15.38:0/2375470084 >> v2:172.21.15.89:3300/0 conn(0x7ffb9c0cc670 0x7ffb9c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.167+0000 7ffba2ca1640 1 --2- 172.21.15.38:0/2375470084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb9c144d10 0x7ffb9c0cc130 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.167+0000 7ffba2ca1640 1 -- 172.21.15.38:0/2375470084 >> 172.21.15.38:0/2375470084 conn(0x7ffb9c0cf070 msgr2=0x7ffb9c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.167+0000 7ffba2ca1640 1 -- 172.21.15.38:0/2375470084 shutdown_connections 2023-12-22T08:42:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.167+0000 7ffba2ca1640 1 -- 172.21.15.38:0/2375470084 wait complete. 2023-12-22T08:42:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.168+0000 7ffba2ca1640 1 Processor -- start 2023-12-22T08:42:01.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.169+0000 7ffba2ca1640 1 -- start start 2023-12-22T08:42:01.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba2ca1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb9c0b2590 0x7ffb9c0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba2ca1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9c144d10 0x7ffb9c15f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba2ca1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0adff0 0x7ffb9c1f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba2ca1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c15f6c0 con 0x7ffb9c0b2590 2023-12-22T08:42:01.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba2ca1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c0acf50 con 0x7ffb9c144d10 2023-12-22T08:42:01.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba2ca1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c0ad230 con 0x7ffb9c0adff0 2023-12-22T08:42:01.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba0a3d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb9c0b2590 0x7ffb9c0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba0a3d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb9c0b2590 0x7ffb9c0ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57692/0 (socket says 172.21.15.38:57692) 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba0a3d640 1 -- 172.21.15.38:0/4072155971 learned_addr learned my addr 172.21.15.38:0/4072155971 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffb9bfff640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9c144d10 0x7ffb9c15f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba123e640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0adff0 0x7ffb9c1f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba0a3d640 1 -- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0adff0 msgr2=0x7ffb9c1f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba0a3d640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0adff0 0x7ffb9c1f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba0a3d640 1 -- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9c144d10 msgr2=0x7ffb9c15f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba0a3d640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9c144d10 0x7ffb9c15f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba0a3d640 1 -- 172.21.15.38:0/4072155971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb900094d0 con 0x7ffb9c0b2590 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.170+0000 7ffba123e640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0adff0 0x7ffb9c1f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.171+0000 7ffba0a3d640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb9c0b2590 0x7ffb9c0ac8e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ffb90000c00 tx=0x7ffb900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.171+0000 7ffb997fa640 1 -- 172.21.15.38:0/4072155971 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb90031840 con 0x7ffb9c0b2590 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.171+0000 7ffb997fa640 1 -- 172.21.15.38:0/4072155971 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb900443f0 con 0x7ffb9c0b2590 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.171+0000 7ffba2ca1640 1 -- 172.21.15.38:0/4072155971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9c0ad510 con 0x7ffb9c0b2590 2023-12-22T08:42:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.171+0000 7ffb997fa640 1 -- 172.21.15.38:0/4072155971 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb900447a0 con 0x7ffb9c0b2590 2023-12-22T08:42:01.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.171+0000 7ffba2ca1640 1 -- 172.21.15.38:0/4072155971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9c0adad0 con 0x7ffb9c0b2590 2023-12-22T08:42:01.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.172+0000 7ffba2ca1640 1 -- 172.21.15.38:0/4072155971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9c061910 con 0x7ffb9c0b2590 2023-12-22T08:42:01.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.173+0000 7ffb997fa640 1 -- 172.21.15.38:0/4072155971 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffb9004d450 con 0x7ffb9c0b2590 2023-12-22T08:42:01.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.174+0000 7ffb997fa640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb8006a430 0x7ffb8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.174+0000 7ffb997fa640 1 -- 172.21.15.38:0/4072155971 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb9002d040 con 0x7ffb9c0b2590 2023-12-22T08:42:01.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.175+0000 7ffb9bfff640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb8006a430 0x7ffb8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:01.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.176+0000 7ffb9bfff640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb8006a430 0x7ffb8006c8f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c13a440 tx=0x7ffb88008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:01.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.179+0000 7ffb997fa640 1 -- 172.21.15.38:0/4072155971 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffb90076680 con 0x7ffb9c0b2590 2023-12-22T08:42:01.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.373+0000 7ffba2ca1640 1 -- 172.21.15.38:0/4072155971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb9c0cb8e0 con 0x7ffb9c0b2590 2023-12-22T08:42:01.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.375+0000 7ffb997fa640 1 -- 172.21.15.38:0/4072155971 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16006 (secure 0 0 0) 0x7ffb90035090 con 0x7ffb9c0b2590 2023-12-22T08:42:01.378 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:01.378 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":47,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:42:00.933105+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:58.840533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:59.953505+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:42:01.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.378+0000 7ffba2ca1640 1 -- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb8006a430 msgr2=0x7ffb8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:01.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.378+0000 7ffba2ca1640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb8006a430 0x7ffb8006c8f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c13a440 tx=0x7ffb88008040 comp rx=0 tx=0).stop 2023-12-22T08:42:01.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.378+0000 7ffba2ca1640 1 -- 172.21.15.38:0/4072155971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb9c0b2590 msgr2=0x7ffb9c0ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:01.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.378+0000 7ffba2ca1640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb9c0b2590 0x7ffb9c0ac8e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ffb90000c00 tx=0x7ffb900046c0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.378+0000 7ffba2ca1640 1 -- 172.21.15.38:0/4072155971 shutdown_connections 2023-12-22T08:42:01.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.378+0000 7ffba2ca1640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb9c0adff0 0x7ffb9c1f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.378+0000 7ffba2ca1640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb9c144d10 0x7ffb9c15f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.378+0000 7ffba2ca1640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb8006a430 0x7ffb8006c8f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.378+0000 7ffba2ca1640 1 --2- 172.21.15.38:0/4072155971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb9c0b2590 0x7ffb9c0ac8e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.378+0000 7ffba2ca1640 1 -- 172.21.15.38:0/4072155971 >> 172.21.15.38:0/4072155971 conn(0x7ffb9c0cf070 msgr2=0x7ffb9c143200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:01.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.378+0000 7ffba2ca1640 1 -- 172.21.15.38:0/4072155971 shutdown_connections 2023-12-22T08:42:01.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.378+0000 7ffba2ca1640 1 -- 172.21.15.38:0/4072155971 wait complete. 2023-12-22T08:42:01.399 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:42:01.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.613+0000 7fc12759e640 1 Processor -- start 2023-12-22T08:42:01.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.613+0000 7fc12759e640 1 -- start start 2023-12-22T08:42:01.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.614+0000 7fc12759e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc12806d210 0x7fc12815e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.614+0000 7fc12759e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc1280cb4c0 0x7fc128159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc12759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc12806d5f0 0x7fc12815a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc12759e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1280706d0 con 0x7fc1280cb4c0 2023-12-22T08:42:01.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc12759e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1280cbf40 con 0x7fc12806d210 2023-12-22T08:42:01.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc12759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12815a760 con 0x7fc12806d5f0 2023-12-22T08:42:01.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc11ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc1280cb4c0 0x7fc128159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:01.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc11ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc1280cb4c0 0x7fc128159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57698/0 (socket says 172.21.15.38:57698) 2023-12-22T08:42:01.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc11ffff640 1 -- 172.21.15.38:0/658665548 learned_addr learned my addr 172.21.15.38:0/658665548 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:01.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc126d9d640 1 --2- 172.21.15.38:0/658665548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc12806d5f0 0x7fc12815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:01.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc12659c640 1 --2- 172.21.15.38:0/658665548 >> v2:172.21.15.89:3300/0 conn(0x7fc12806d210 0x7fc12815e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:01.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc11ffff640 1 -- 172.21.15.38:0/658665548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc12806d5f0 msgr2=0x7fc12815a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:01.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc11ffff640 1 --2- 172.21.15.38:0/658665548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc12806d5f0 0x7fc12815a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc11ffff640 1 -- 172.21.15.38:0/658665548 >> v2:172.21.15.89:3300/0 conn(0x7fc12806d210 msgr2=0x7fc12815e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:01.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc11ffff640 1 --2- 172.21.15.38:0/658665548 >> v2:172.21.15.89:3300/0 conn(0x7fc12806d210 0x7fc12815e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc11ffff640 1 -- 172.21.15.38:0/658665548 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1280ce840 con 0x7fc1280cb4c0 2023-12-22T08:42:01.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.615+0000 7fc12659c640 1 --2- 172.21.15.38:0/658665548 >> v2:172.21.15.89:3300/0 conn(0x7fc12806d210 0x7fc12815e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:01.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.617+0000 7fc11ffff640 1 --2- 172.21.15.38:0/658665548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1280cb4c0 0x7fc128159ce0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc12806a7f0 tx=0x7fc11002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feeea61a4fff6acb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:01.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.617+0000 7fc125d9b640 1 -- 172.21.15.38:0/658665548 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110031870 con 0x7fc1280cb4c0 2023-12-22T08:42:01.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.617+0000 7fc125d9b640 1 -- 172.21.15.38:0/658665548 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1100319d0 con 0x7fc1280cb4c0 2023-12-22T08:42:01.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.617+0000 7fc125d9b640 1 -- 172.21.15.38:0/658665548 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110031d60 con 0x7fc1280cb4c0 2023-12-22T08:42:01.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.618+0000 7fc12759e640 1 -- 172.21.15.38:0/658665548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1280cb4c0 msgr2=0x7fc128159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:01.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.618+0000 7fc12759e640 1 --2- 172.21.15.38:0/658665548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1280cb4c0 0x7fc128159ce0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc12806a7f0 tx=0x7fc11002b910 comp rx=0 tx=0).stop 2023-12-22T08:42:01.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.618+0000 7fc12759e640 1 -- 172.21.15.38:0/658665548 shutdown_connections 2023-12-22T08:42:01.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.618+0000 7fc12759e640 1 --2- 172.21.15.38:0/658665548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc12806d5f0 0x7fc12815a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.618+0000 7fc12759e640 1 --2- 172.21.15.38:0/658665548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1280cb4c0 0x7fc128159ce0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.618+0000 7fc12759e640 1 --2- 172.21.15.38:0/658665548 >> v2:172.21.15.89:3300/0 conn(0x7fc12806d210 0x7fc12815e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.618+0000 7fc12759e640 1 -- 172.21.15.38:0/658665548 >> 172.21.15.38:0/658665548 conn(0x7fc1280b1f70 msgr2=0x7fc1280b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:01.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.618+0000 7fc12759e640 1 -- 172.21.15.38:0/658665548 shutdown_connections 2023-12-22T08:42:01.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.618+0000 7fc12759e640 1 -- 172.21.15.38:0/658665548 wait complete. 2023-12-22T08:42:01.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.620+0000 7fc12759e640 1 Processor -- start 2023-12-22T08:42:01.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.620+0000 7fc12759e640 1 -- start start 2023-12-22T08:42:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc12806d210 0x7fc12815b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc12806d5f0 0x7fc12815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1280cb4c0 0x7fc128147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1280a2920 con 0x7fc12806d210 2023-12-22T08:42:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1280a2c00 con 0x7fc1280cb4c0 2023-12-22T08:42:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1280a2ee0 con 0x7fc12806d5f0 2023-12-22T08:42:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc12806d210 0x7fc12815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc12806d210 0x7fc12815b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57712/0 (socket says 172.21.15.38:57712) 2023-12-22T08:42:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12659c640 1 -- 172.21.15.38:0/1846197709 learned_addr learned my addr 172.21.15.38:0/1846197709 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12659c640 1 -- 172.21.15.38:0/1846197709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc12806d5f0 msgr2=0x7fc12815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12659c640 1 --2- 172.21.15.38:0/1846197709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc12806d5f0 0x7fc12815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12659c640 1 -- 172.21.15.38:0/1846197709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1280cb4c0 msgr2=0x7fc128147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:01.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12659c640 1 --2- 172.21.15.38:0/1846197709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1280cb4c0 0x7fc128147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.621+0000 7fc12659c640 1 -- 172.21.15.38:0/1846197709 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1100094d0 con 0x7fc12806d210 2023-12-22T08:42:01.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.622+0000 7fc12659c640 1 --2- 172.21.15.38:0/1846197709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc12806d210 0x7fc12815b570 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc11800c7c0 tx=0x7fc11800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:01.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.622+0000 7fc11effd640 1 -- 172.21.15.38:0/1846197709 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118007a30 con 0x7fc12806d210 2023-12-22T08:42:01.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.622+0000 7fc11effd640 1 -- 172.21.15.38:0/1846197709 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc118007b90 con 0x7fc12806d210 2023-12-22T08:42:01.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.622+0000 7fc12759e640 1 -- 172.21.15.38:0/1846197709 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1280a31c0 con 0x7fc12806d210 2023-12-22T08:42:01.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.622+0000 7fc11effd640 1 -- 172.21.15.38:0/1846197709 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11800ce70 con 0x7fc12806d210 2023-12-22T08:42:01.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.622+0000 7fc12759e640 1 -- 172.21.15.38:0/1846197709 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc128099b20 con 0x7fc12806d210 2023-12-22T08:42:01.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.623+0000 7fc12759e640 1 -- 172.21.15.38:0/1846197709 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc128061910 con 0x7fc12806d210 2023-12-22T08:42:01.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.624+0000 7fc11effd640 1 -- 172.21.15.38:0/1846197709 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc1180113f0 con 0x7fc12806d210 2023-12-22T08:42:01.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.625+0000 7fc11effd640 1 --2- 172.21.15.38:0/1846197709 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc10806a430 0x7fc10806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:01.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.625+0000 7fc11effd640 1 -- 172.21.15.38:0/1846197709 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc118088a90 con 0x7fc12806d210 2023-12-22T08:42:01.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.626+0000 7fc11ffff640 1 --2- 172.21.15.38:0/1846197709 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc10806a430 0x7fc10806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:01.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.627+0000 7fc11ffff640 1 --2- 172.21.15.38:0/1846197709 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc10806a430 0x7fc10806c8f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc110036000 tx=0x7fc110030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:01.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.629+0000 7fc11effd640 1 -- 172.21.15.38:0/1846197709 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc118054080 con 0x7fc12806d210 2023-12-22T08:42:01.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.818+0000 7fc12759e640 1 -- 172.21.15.38:0/1846197709 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1280cd210 con 0x7fc12806d210 2023-12-22T08:42:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.821+0000 7fc11effd640 1 -- 172.21.15.38:0/1846197709 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16006 (secure 0 0 0) 0x7fc11801f090 con 0x7fc12806d210 2023-12-22T08:42:01.824 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:01.824 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":47,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:42:00.933105+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:58.840533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:59.953505+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:42:01.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.824+0000 7fc12759e640 1 -- 172.21.15.38:0/1846197709 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc10806a430 msgr2=0x7fc10806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:01.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.824+0000 7fc12759e640 1 --2- 172.21.15.38:0/1846197709 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc10806a430 0x7fc10806c8f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc110036000 tx=0x7fc110030000 comp rx=0 tx=0).stop 2023-12-22T08:42:01.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.824+0000 7fc12759e640 1 -- 172.21.15.38:0/1846197709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc12806d210 msgr2=0x7fc12815b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:01.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.824+0000 7fc12759e640 1 --2- 172.21.15.38:0/1846197709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc12806d210 0x7fc12815b570 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc11800c7c0 tx=0x7fc11800cc80 comp rx=0 tx=0).stop 2023-12-22T08:42:01.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.824+0000 7fc12759e640 1 -- 172.21.15.38:0/1846197709 shutdown_connections 2023-12-22T08:42:01.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.824+0000 7fc12759e640 1 --2- 172.21.15.38:0/1846197709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1280cb4c0 0x7fc128147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.824+0000 7fc12759e640 1 --2- 172.21.15.38:0/1846197709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc12806d5f0 0x7fc12815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.824+0000 7fc12759e640 1 --2- 172.21.15.38:0/1846197709 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc10806a430 0x7fc10806c8f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.824+0000 7fc12759e640 1 --2- 172.21.15.38:0/1846197709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc12806d210 0x7fc12815b570 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:01.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.824+0000 7fc12759e640 1 -- 172.21.15.38:0/1846197709 >> 172.21.15.38:0/1846197709 conn(0x7fc1280b1f70 msgr2=0x7fc128159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:01.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.824+0000 7fc12759e640 1 -- 172.21.15.38:0/1846197709 shutdown_connections 2023-12-22T08:42:01.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:01.824+0000 7fc12759e640 1 -- 172.21.15.38:0/1846197709 wait complete. 2023-12-22T08:42:01.845 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T08:42:02.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.071+0000 7f4460ae1640 1 Processor -- start 2023-12-22T08:42:02.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.071+0000 7f4460ae1640 1 -- start start 2023-12-22T08:42:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.072+0000 7f4460ae1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f445c144a20 0x7f445c0b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.072+0000 7f4460ae1640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f445c0b3cf0 0x7f445c0b4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.072+0000 7f4460ae1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f445c0cf290 0x7f445c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.072+0000 7f4460ae1640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c0b65a0 con 0x7f445c0b3cf0 2023-12-22T08:42:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.072+0000 7f4460ae1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c0b4690 con 0x7f445c0cf290 2023-12-22T08:42:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.072+0000 7f4460ae1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0b5c80 con 0x7f445c144a20 2023-12-22T08:42:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.072+0000 7f4452ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f445c0b3cf0 0x7f445c0b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.073+0000 7f4452ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f445c0b3cf0 0x7f445c0b4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57728/0 (socket says 172.21.15.38:57728) 2023-12-22T08:42:02.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.073+0000 7f4452ffd640 1 -- 172.21.15.38:0/3996233466 learned_addr learned my addr 172.21.15.38:0/3996233466 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.073+0000 7f4452ffd640 1 -- 172.21.15.38:0/3996233466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f445c144a20 msgr2=0x7f445c0b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.073+0000 7f4452ffd640 1 --2- 172.21.15.38:0/3996233466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f445c144a20 0x7f445c0b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.073+0000 7f4452ffd640 1 -- 172.21.15.38:0/3996233466 >> v2:172.21.15.89:3300/0 conn(0x7f445c0cf290 msgr2=0x7f445c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.073+0000 7f4452ffd640 1 --2- 172.21.15.38:0/3996233466 >> v2:172.21.15.89:3300/0 conn(0x7f445c0cf290 0x7f445c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:02.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.073+0000 7f4452ffd640 1 -- 172.21.15.38:0/3996233466 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c0b5f00 con 0x7f445c0b3cf0 2023-12-22T08:42:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.074+0000 7f4452ffd640 1 --2- 172.21.15.38:0/3996233466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c0b3cf0 0x7f445c0b4150 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f445c06e170 tx=0x7f444402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b825efc0a4bbce5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.074+0000 7f445affd640 1 -- 172.21.15.38:0/3996233466 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44440317e0 con 0x7f445c0b3cf0 2023-12-22T08:42:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.074+0000 7f445affd640 1 -- 172.21.15.38:0/3996233466 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4444031940 con 0x7f445c0b3cf0 2023-12-22T08:42:02.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.074+0000 7f445affd640 1 -- 172.21.15.38:0/3996233466 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444031cd0 con 0x7f445c0b3cf0 2023-12-22T08:42:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.075+0000 7f4460ae1640 1 -- 172.21.15.38:0/3996233466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c0b3cf0 msgr2=0x7f445c0b4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.075+0000 7f4460ae1640 1 --2- 172.21.15.38:0/3996233466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c0b3cf0 0x7f445c0b4150 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f445c06e170 tx=0x7f444402b880 comp rx=0 tx=0).stop 2023-12-22T08:42:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.075+0000 7f4460ae1640 1 -- 172.21.15.38:0/3996233466 shutdown_connections 2023-12-22T08:42:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.075+0000 7f4460ae1640 1 --2- 172.21.15.38:0/3996233466 >> v2:172.21.15.89:3300/0 conn(0x7f445c0cf290 0x7f445c0cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.075+0000 7f4460ae1640 1 --2- 172.21.15.38:0/3996233466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c0b3cf0 0x7f445c0b4150 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.075+0000 7f4460ae1640 1 --2- 172.21.15.38:0/3996233466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f445c144a20 0x7f445c0b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.075+0000 7f4460ae1640 1 -- 172.21.15.38:0/3996233466 >> 172.21.15.38:0/3996233466 conn(0x7f445c060720 msgr2=0x7f445c060b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.075+0000 7f4460ae1640 1 -- 172.21.15.38:0/3996233466 shutdown_connections 2023-12-22T08:42:02.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.075+0000 7f4460ae1640 1 -- 172.21.15.38:0/3996233466 wait complete. 2023-12-22T08:42:02.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.077+0000 7f4460ae1640 1 Processor -- start 2023-12-22T08:42:02.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.077+0000 7f4460ae1640 1 -- start start 2023-12-22T08:42:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.078+0000 7f4460ae1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f445c0b3cf0 0x7f445c1f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.078+0000 7f4460ae1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f445c0cf290 0x7f445c1f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.078+0000 7f4460ae1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c144a20 0x7f445c1f3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.078+0000 7f4460ae1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c1f3490 con 0x7f445c144a20 2023-12-22T08:42:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.078+0000 7f4460ae1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c1f3bb0 con 0x7f445c0cf290 2023-12-22T08:42:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.078+0000 7f4460ae1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c06f5a0 con 0x7f445c0b3cf0 2023-12-22T08:42:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.078+0000 7f445bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c144a20 0x7f445c1f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:02.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.078+0000 7f445bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c144a20 0x7f445c1f3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57738/0 (socket says 172.21.15.38:57738) 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.078+0000 7f445bfff640 1 -- 172.21.15.38:0/719619114 learned_addr learned my addr 172.21.15.38:0/719619114 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.079+0000 7f445b7fe640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f445c0b3cf0 0x7f445c1f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.079+0000 7f4452ffd640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f445c0cf290 0x7f445c1f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.079+0000 7f445bfff640 1 -- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f445c0b3cf0 msgr2=0x7f445c1f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.079+0000 7f445bfff640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f445c0b3cf0 0x7f445c1f53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.079+0000 7f445bfff640 1 -- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f445c0cf290 msgr2=0x7f445c1f2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.079+0000 7f445bfff640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f445c0cf290 0x7f445c1f2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.079+0000 7f445bfff640 1 -- 172.21.15.38:0/719619114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44440094d0 con 0x7f445c144a20 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.079+0000 7f4452ffd640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f445c0cf290 0x7f445c1f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.079+0000 7f445bfff640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c144a20 0x7f445c1f3670 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f445400b970 tx=0x7f445400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.080+0000 7f4458ff9640 1 -- 172.21.15.38:0/719619114 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445400cb40 con 0x7f445c144a20 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.080+0000 7f4458ff9640 1 -- 172.21.15.38:0/719619114 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445400ccc0 con 0x7f445c144a20 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.080+0000 7f4458ff9640 1 -- 172.21.15.38:0/719619114 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4454014680 con 0x7f445c144a20 2023-12-22T08:42:02.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.080+0000 7f4460ae1640 1 -- 172.21.15.38:0/719619114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445c06f880 con 0x7f445c144a20 2023-12-22T08:42:02.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.080+0000 7f4460ae1640 1 -- 172.21.15.38:0/719619114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c06fe40 con 0x7f445c144a20 2023-12-22T08:42:02.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.081+0000 7f4460ae1640 1 -- 172.21.15.38:0/719619114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445c061910 con 0x7f445c144a20 2023-12-22T08:42:02.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.082+0000 7f4458ff9640 1 -- 172.21.15.38:0/719619114 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f445401d3b0 con 0x7f445c144a20 2023-12-22T08:42:02.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.083+0000 7f4458ff9640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f443c06a460 0x7f443c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:02.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.083+0000 7f4458ff9640 1 -- 172.21.15.38:0/719619114 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44540888c0 con 0x7f445c144a20 2023-12-22T08:42:02.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.084+0000 7f445b7fe640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f443c06a460 0x7f443c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:02.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.085+0000 7f445b7fe640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f443c06a460 0x7f443c06c920 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f445c13da00 tx=0x7f444c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:02.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.087+0000 7f4458ff9640 1 -- 172.21.15.38:0/719619114 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4454053e50 con 0x7f445c144a20 2023-12-22T08:42:02.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.325+0000 7f4460ae1640 1 -- 172.21.15.38:0/719619114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f445c0b1000 con 0x7f445c144a20 2023-12-22T08:42:02.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.954+0000 7f4458ff9640 1 -- 172.21.15.38:0/719619114 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4454019020 con 0x7f445c144a20 2023-12-22T08:42:02.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.958+0000 7f4460ae1640 1 -- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f443c06a460 msgr2=0x7f443c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:02.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.958+0000 7f4460ae1640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f443c06a460 0x7f443c06c920 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f445c13da00 tx=0x7f444c008040 comp rx=0 tx=0).stop 2023-12-22T08:42:02.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.958+0000 7f4460ae1640 1 -- 172.21.15.38:0/719619114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c144a20 msgr2=0x7f445c1f3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:02.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.958+0000 7f4460ae1640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c144a20 0x7f445c1f3670 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f445400b970 tx=0x7f445400be30 comp rx=0 tx=0).stop 2023-12-22T08:42:02.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.958+0000 7f4460ae1640 1 -- 172.21.15.38:0/719619114 shutdown_connections 2023-12-22T08:42:02.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.958+0000 7f4460ae1640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f443c06a460 0x7f443c06c920 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:02.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.958+0000 7f4460ae1640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c144a20 0x7f445c1f3670 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:02.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.958+0000 7f4460ae1640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f445c0cf290 0x7f445c1f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:02.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.958+0000 7f4460ae1640 1 --2- 172.21.15.38:0/719619114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f445c0b3cf0 0x7f445c1f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:02.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.958+0000 7f4460ae1640 1 -- 172.21.15.38:0/719619114 >> 172.21.15.38:0/719619114 conn(0x7f445c060720 msgr2=0x7f445c0b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:02.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.958+0000 7f4460ae1640 1 -- 172.21.15.38:0/719619114 shutdown_connections 2023-12-22T08:42:02.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:02.958+0000 7f4460ae1640 1 -- 172.21.15.38:0/719619114 wait complete. 2023-12-22T08:42:02.982 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T08:42:02.982 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T08:42:03.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.205+0000 7f59cef95640 1 Processor -- start 2023-12-22T08:42:03.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.206+0000 7f59cef95640 1 -- start start 2023-12-22T08:42:03.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.207+0000 7f59cef95640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c815e740 0x7f59c815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:03.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.207+0000 7f59cef95640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f59c80b3f90 0x7f59c8070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:03.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.207+0000 7f59cef95640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c815eb20 con 0x7f59c806ca50 2023-12-22T08:42:03.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.207+0000 7f59cef95640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c806e650 con 0x7f59c80b3f90 2023-12-22T08:42:03.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.207+0000 7f59cef95640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8070770 con 0x7f59c815e740 2023-12-22T08:42:03.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.208+0000 7f59bffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f59c806ca50 0x7f59c80b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45838/0 (socket says 172.21.15.38:45838) 2023-12-22T08:42:03.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.208+0000 7f59bffff640 1 -- 172.21.15.38:0/1290234912 learned_addr learned my addr 172.21.15.38:0/1290234912 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:03.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.208+0000 7f59ccd31640 1 --2- 172.21.15.38:0/1290234912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c815e740 0x7f59c815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:03.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.208+0000 7f59cd532640 1 --2- 172.21.15.38:0/1290234912 >> v2:172.21.15.89:3300/0 conn(0x7f59c80b3f90 0x7f59c8070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:03.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.208+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965260943 0 0) 0x7f59c815eb20 con 0x7f59c806ca50 2023-12-22T08:42:03.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.208+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b0003520 con 0x7f59c806ca50 2023-12-22T08:42:03.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2703814200 0 0) 0x7f59b0003520 con 0x7f59c806ca50 2023-12-22T08:42:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c815e740 msgr2=0x7f59c815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 --2- 172.21.15.38:0/1290234912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c815e740 0x7f59c815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 >> v2:172.21.15.89:3300/0 conn(0x7f59c80b3f90 msgr2=0x7f59c8070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 --2- 172.21.15.38:0/1290234912 >> v2:172.21.15.89:3300/0 conn(0x7f59c80b3f90 0x7f59c8070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c806d180 con 0x7f59c806ca50 2023-12-22T08:42:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f59b8001670 con 0x7f59c806ca50 2023-12-22T08:42:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 >> v1:172.21.15.38:6789/0 conn(0x7f59c806ca50 legacy=0x7f59c80b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 --2- 172.21.15.38:0/1290234912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59b0003970 0x7f59b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 --2- 172.21.15.38:0/1290234912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59b00047c0 0x7f59b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 --2- 172.21.15.38:0/1290234912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c815e740 0x7f59b00051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c806e650 con 0x7f59b0003970 2023-12-22T08:42:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8070770 con 0x7f59b00047c0 2023-12-22T08:42:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b000bb10 con 0x7f59c815e740 2023-12-22T08:42:03.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59ccd31640 1 --2- 172.21.15.38:0/1290234912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59b0003970 0x7f59b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:03.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.209+0000 7f59bffff640 1 --2- 172.21.15.38:0/1290234912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59b00047c0 0x7f59b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:03.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.210+0000 7f59ccd31640 1 -- 172.21.15.38:0/1290234912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c815e740 msgr2=0x7f59b00051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:03.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.210+0000 7f59ccd31640 1 --2- 172.21.15.38:0/1290234912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c815e740 0x7f59b00051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:03.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.210+0000 7f59ccd31640 1 -- 172.21.15.38:0/1290234912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59b00047c0 msgr2=0x7f59b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:03.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.210+0000 7f59ccd31640 1 --2- 172.21.15.38:0/1290234912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59b00047c0 0x7f59b0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:03.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.210+0000 7f59ccd31640 1 -- 172.21.15.38:0/1290234912 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0003520 con 0x7f59b0003970 2023-12-22T08:42:03.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.211+0000 7f59ccd31640 1 --2- 172.21.15.38:0/1290234912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59b0003970 0x7f59b0003d90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009fc0 tx=0x7f59b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fea6c3c2f43dd5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:03.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.211+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c402cc60 con 0x7f59b0003970 2023-12-22T08:42:03.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.211+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c400f040 con 0x7f59b0003970 2023-12-22T08:42:03.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.211+0000 7f59bf7fe640 1 -- 172.21.15.38:0/1290234912 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4034440 con 0x7f59b0003970 2023-12-22T08:42:03.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.212+0000 7f59cef95640 1 -- 172.21.15.38:0/1290234912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59b0003970 msgr2=0x7f59b0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:03.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.212+0000 7f59cef95640 1 --2- 172.21.15.38:0/1290234912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59b0003970 0x7f59b0003d90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009fc0 tx=0x7f59b00057f0 comp rx=0 tx=0).stop 2023-12-22T08:42:03.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.212+0000 7f59cd532640 1 -- 172.21.15.38:0/1290234912 reap_dead start 2023-12-22T08:42:03.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.212+0000 7f59cef95640 1 -- 172.21.15.38:0/1290234912 shutdown_connections 2023-12-22T08:42:03.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.212+0000 7f59cef95640 1 -- 172.21.15.38:0/1290234912 >> 172.21.15.38:0/1290234912 conn(0x7f59c80cfea0 msgr2=0x7f59c80d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:03.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.212+0000 7f59cef95640 1 -- 172.21.15.38:0/1290234912 shutdown_connections 2023-12-22T08:42:03.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.212+0000 7f59cef95640 1 -- 172.21.15.38:0/1290234912 wait complete. 2023-12-22T08:42:03.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.214+0000 7f59cef95640 1 Processor -- start 2023-12-22T08:42:03.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.214+0000 7f59cef95640 1 -- start start 2023-12-22T08:42:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59cef95640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59b0003970 0x7f59c8154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59cef95640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59c81532c0 0x7f59c8156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59cef95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c8157140 0x7f59c81581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59cef95640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c815b560 con 0x7f59c81532c0 2023-12-22T08:42:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59cef95640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c815af00 con 0x7f59c8157140 2023-12-22T08:42:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59cef95640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c81575e0 con 0x7f59b0003970 2023-12-22T08:42:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59bffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59c81532c0 0x7f59c8156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59bffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59c81532c0 0x7f59c8156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57768/0 (socket says 172.21.15.38:57768) 2023-12-22T08:42:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59bffff640 1 -- 172.21.15.38:0/1885124924 learned_addr learned my addr 172.21.15.38:0/1885124924 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59ccd31640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59b0003970 0x7f59c8154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59cd532640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c8157140 0x7f59c81581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59bffff640 1 -- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59b0003970 msgr2=0x7f59c8154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59bffff640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59b0003970 0x7f59c8154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59bffff640 1 -- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c8157140 msgr2=0x7f59c81581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59bffff640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c8157140 0x7f59c81581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.215+0000 7f59bffff640 1 -- 172.21.15.38:0/1885124924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c81578c0 con 0x7f59c81532c0 2023-12-22T08:42:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.216+0000 7f59bffff640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59c81532c0 0x7f59c8156c00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f59b800d700 tx=0x7f59b800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.216+0000 7f59bd7fa640 1 -- 172.21.15.38:0/1885124924 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80074e0 con 0x7f59c81532c0 2023-12-22T08:42:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.216+0000 7f59bd7fa640 1 -- 172.21.15.38:0/1885124924 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b8007640 con 0x7f59c81532c0 2023-12-22T08:42:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.216+0000 7f59bd7fa640 1 -- 172.21.15.38:0/1885124924 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8004a00 con 0x7f59c81532c0 2023-12-22T08:42:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.216+0000 7f59cef95640 1 -- 172.21.15.38:0/1885124924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c815b180 con 0x7f59c81532c0 2023-12-22T08:42:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.216+0000 7f59cef95640 1 -- 172.21.15.38:0/1885124924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c80b8460 con 0x7f59c81532c0 2023-12-22T08:42:03.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.218+0000 7f59cef95640 1 -- 172.21.15.38:0/1885124924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c815b6a0 con 0x7f59c81532c0 2023-12-22T08:42:03.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.219+0000 7f59bd7fa640 1 -- 172.21.15.38:0/1885124924 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f59b8004b60 con 0x7f59c81532c0 2023-12-22T08:42:03.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.220+0000 7f59bd7fa640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f59b406a460 0x7f59b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:03.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.220+0000 7f59bd7fa640 1 -- 172.21.15.38:0/1885124924 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59b80881a0 con 0x7f59c81532c0 2023-12-22T08:42:03.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.221+0000 7f59ccd31640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f59b406a460 0x7f59b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:03.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.222+0000 7f59ccd31640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f59b406a460 0x7f59b406c920 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f59c4036000 tx=0x7f59c402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:03.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.224+0000 7f59bd7fa640 1 -- 172.21.15.38:0/1885124924 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f59c815b6a0 con 0x7f59c81532c0 2023-12-22T08:42:03.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.458+0000 7f59cef95640 1 -- 172.21.15.38:0/1885124924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f59c815b6a0 con 0x7f59c81532c0 2023-12-22T08:42:03.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.959+0000 7f59bd7fa640 1 -- 172.21.15.38:0/1885124924 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7f59c815b6a0 con 0x7f59c81532c0 2023-12-22T08:42:03.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.962+0000 7f59cef95640 1 -- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f59b406a460 msgr2=0x7f59b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:03.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.962+0000 7f59cef95640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f59b406a460 0x7f59b406c920 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f59c4036000 tx=0x7f59c402e000 comp rx=0 tx=0).stop 2023-12-22T08:42:03.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.962+0000 7f59cef95640 1 -- 172.21.15.38:0/1885124924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59c81532c0 msgr2=0x7f59c8156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:03.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.962+0000 7f59cef95640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59c81532c0 0x7f59c8156c00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f59b800d700 tx=0x7f59b800dbc0 comp rx=0 tx=0).stop 2023-12-22T08:42:03.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.962+0000 7f59cef95640 1 -- 172.21.15.38:0/1885124924 shutdown_connections 2023-12-22T08:42:03.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.962+0000 7f59cef95640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c8157140 0x7f59c81581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:03.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.962+0000 7f59cef95640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f59b406a460 0x7f59b406c920 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:03.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.962+0000 7f59cef95640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59c81532c0 0x7f59c8156c00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:03.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.962+0000 7f59cef95640 1 --2- 172.21.15.38:0/1885124924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59b0003970 0x7f59c8154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:03.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.962+0000 7f59cef95640 1 -- 172.21.15.38:0/1885124924 >> 172.21.15.38:0/1885124924 conn(0x7f59c80cfea0 msgr2=0x7f59c81602b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:03.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.963+0000 7f59cef95640 1 -- 172.21.15.38:0/1885124924 shutdown_connections 2023-12-22T08:42:03.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:03.963+0000 7f59cef95640 1 -- 172.21.15.38:0/1885124924 wait complete. 2023-12-22T08:42:03.987 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T08:42:03.987 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:42:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.214+0000 7fedb9f37640 1 Processor -- start 2023-12-22T08:42:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.214+0000 7fedb9f37640 1 -- start start 2023-12-22T08:42:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.216+0000 7fedb9f37640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedb40a44a0 0x7fedb40708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.216+0000 7fedb9f37640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb40cdae0 con 0x7fedb415b420 2023-12-22T08:42:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.216+0000 7fedb9f37640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb4071260 con 0x7fedb4070e30 2023-12-22T08:42:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.216+0000 7fedb9f37640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb415b800 con 0x7fedb40a44a0 2023-12-22T08:42:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.216+0000 7fedb8f35640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fedb415b420 0x7fedb406d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45854/0 (socket says 172.21.15.38:45854) 2023-12-22T08:42:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.216+0000 7fedb8f35640 1 -- 172.21.15.38:0/2724911251 learned_addr learned my addr 172.21.15.38:0/2724911251 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724910423 0 0) 0x7fedb40cdae0 con 0x7fedb415b420 2023-12-22T08:42:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed9c003520 con 0x7fedb415b420 2023-12-22T08:42:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedabfff640 1 --2- 172.21.15.38:0/2724911251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedb40a44a0 0x7fedb40708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 641684268 0 0) 0x7fed9c003520 con 0x7fedb415b420 2023-12-22T08:42:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedb40a44a0 msgr2=0x7fedb40708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 --2- 172.21.15.38:0/2724911251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedb40a44a0 0x7fedb40708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 >> v1:172.21.15.89:6789/0 conn(0x7fedb4070e30 legacy=0x7fedb415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb40cdd30 con 0x7fedb415b420 2023-12-22T08:42:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fedb00019f0 con 0x7fedb415b420 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 >> v1:172.21.15.38:6789/0 conn(0x7fedb415b420 legacy=0x7fedb406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 --2- 172.21.15.38:0/2724911251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed9c0039a0 0x7fed9c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 --2- 172.21.15.38:0/2724911251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedb40a44a0 0x7fed9c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 --2- 172.21.15.38:0/2724911251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed9c004d00 0x7fed9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb415b800 con 0x7fed9c0039a0 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c00bb10 con 0x7fed9c004d00 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.217+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c00bca0 con 0x7fedb40a44a0 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.218+0000 7fedb8f35640 1 --2- 172.21.15.38:0/2724911251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed9c0039a0 0x7fed9c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.218+0000 7fedabfff640 1 --2- 172.21.15.38:0/2724911251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedb40a44a0 0x7fed9c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.218+0000 7fedb8f35640 1 -- 172.21.15.38:0/2724911251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedb40a44a0 msgr2=0x7fed9c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.218+0000 7fedb8f35640 1 --2- 172.21.15.38:0/2724911251 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedb40a44a0 0x7fed9c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.218+0000 7fedb8f35640 1 -- 172.21.15.38:0/2724911251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed9c004d00 msgr2=0x7fed9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.218+0000 7fedb9736640 1 --2- 172.21.15.38:0/2724911251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed9c004d00 0x7fed9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.218+0000 7fedb8f35640 1 --2- 172.21.15.38:0/2724911251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed9c004d00 0x7fed9c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.218+0000 7fedb8f35640 1 -- 172.21.15.38:0/2724911251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c003520 con 0x7fed9c0039a0 2023-12-22T08:42:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.219+0000 7fedb8f35640 1 --2- 172.21.15.38:0/2724911251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed9c0039a0 0x7fed9c003dc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fedb000a860 tx=0x7fed9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9413a912df348e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.220+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb00072d0 con 0x7fed9c0039a0 2023-12-22T08:42:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.220+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb002f070 con 0x7fed9c0039a0 2023-12-22T08:42:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.220+0000 7fedab7fe640 1 -- 172.21.15.38:0/2724911251 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb00076b0 con 0x7fed9c0039a0 2023-12-22T08:42:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.220+0000 7fedb9f37640 1 -- 172.21.15.38:0/2724911251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed9c0039a0 msgr2=0x7fed9c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.220+0000 7fedb9f37640 1 --2- 172.21.15.38:0/2724911251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed9c0039a0 0x7fed9c003dc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fedb000a860 tx=0x7fed9c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.220+0000 7fedb9736640 1 -- 172.21.15.38:0/2724911251 reap_dead start 2023-12-22T08:42:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.220+0000 7fedb9f37640 1 -- 172.21.15.38:0/2724911251 shutdown_connections 2023-12-22T08:42:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.220+0000 7fedb9f37640 1 -- 172.21.15.38:0/2724911251 >> 172.21.15.38:0/2724911251 conn(0x7fedb40b1f70 msgr2=0x7fedb40b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.220+0000 7fedb9f37640 1 -- 172.21.15.38:0/2724911251 shutdown_connections 2023-12-22T08:42:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.220+0000 7fedb9f37640 1 -- 172.21.15.38:0/2724911251 wait complete. 2023-12-22T08:42:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.222+0000 7fedb9f37640 1 Processor -- start 2023-12-22T08:42:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.222+0000 7fedb9f37640 1 -- start start 2023-12-22T08:42:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.223+0000 7fedb9f37640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed9c0039a0 0x7fedb4145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.223+0000 7fedb9f37640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fedb41e5e60 0x7fedb409ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.223+0000 7fedb9f37640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedb409f3d0 0x7fedb4145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.223+0000 7fedb9f37640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb409f850 con 0x7fedb41e5e60 2023-12-22T08:42:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.223+0000 7fedb9f37640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb41e59d0 con 0x7fed9c0039a0 2023-12-22T08:42:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.223+0000 7fedb9f37640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb41e4dc0 con 0x7fedb409f3d0 2023-12-22T08:42:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.224+0000 7fedabfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fedb41e5e60 0x7fedb409ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.224+0000 7fedabfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fedb41e5e60 0x7fedb409ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57794/0 (socket says 172.21.15.38:57794) 2023-12-22T08:42:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.224+0000 7fedabfff640 1 -- 172.21.15.38:0/448121506 learned_addr learned my addr 172.21.15.38:0/448121506 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.224+0000 7fedb8f35640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed9c0039a0 0x7fedb4145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.224+0000 7fedb9736640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedb409f3d0 0x7fedb4145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.224+0000 7fedabfff640 1 -- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedb409f3d0 msgr2=0x7fedb4145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.224+0000 7fedabfff640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedb409f3d0 0x7fedb4145a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.224+0000 7fedabfff640 1 -- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed9c0039a0 msgr2=0x7fedb4145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.224+0000 7fedabfff640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed9c0039a0 0x7fedb4145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.224+0000 7fedabfff640 1 -- 172.21.15.38:0/448121506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb41e50a0 con 0x7fedb41e5e60 2023-12-22T08:42:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.224+0000 7fedabfff640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fedb41e5e60 0x7fedb409ee90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7feda400e7e0 tx=0x7feda400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.225+0000 7feda97fa640 1 -- 172.21.15.38:0/448121506 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda400c670 con 0x7fedb41e5e60 2023-12-22T08:42:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.225+0000 7feda97fa640 1 -- 172.21.15.38:0/448121506 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda400c7d0 con 0x7fedb41e5e60 2023-12-22T08:42:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.225+0000 7fedb9f37640 1 -- 172.21.15.38:0/448121506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb41e5380 con 0x7fedb41e5e60 2023-12-22T08:42:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.225+0000 7feda97fa640 1 -- 172.21.15.38:0/448121506 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda400cb80 con 0x7fedb41e5e60 2023-12-22T08:42:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.225+0000 7fedb9f37640 1 -- 172.21.15.38:0/448121506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb41e62e0 con 0x7fedb41e5e60 2023-12-22T08:42:04.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.226+0000 7fedb9f37640 1 -- 172.21.15.38:0/448121506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb4061910 con 0x7fedb41e5e60 2023-12-22T08:42:04.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.227+0000 7feda97fa640 1 -- 172.21.15.38:0/448121506 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feda400cce0 con 0x7fedb41e5e60 2023-12-22T08:42:04.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.228+0000 7feda97fa640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feda006a460 0x7feda006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.228+0000 7feda97fa640 1 -- 172.21.15.38:0/448121506 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feda4088670 con 0x7fedb41e5e60 2023-12-22T08:42:04.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.229+0000 7fedb8f35640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feda006a460 0x7feda006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:04.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.230+0000 7fedb8f35640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feda006a460 0x7feda006c920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fedb0034000 tx=0x7fedb0007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:04.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.232+0000 7feda97fa640 1 -- 172.21.15.38:0/448121506 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feda4053bc0 con 0x7fedb41e5e60 2023-12-22T08:42:04.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.464+0000 7fedb9f37640 1 -- 172.21.15.38:0/448121506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedb40ce2c0 con 0x7fedb41e5e60 2023-12-22T08:42:04.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.466+0000 7feda97fa640 1 -- 172.21.15.38:0/448121506 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4648 (secure 0 0 0) 0x7feda4009380 con 0x7fedb41e5e60 2023-12-22T08:42:04.468 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:04.468 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2078860804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2078860804},{"type":"v1","addr":"172.21.15.38:6835","nonce":2078860804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4244510882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4244510882},{"type":"v1","addr":"172.21.15.89:6837","nonce":4244510882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3227878158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3227878158},{"type":"v1","addr":"172.21.15.38:6834","nonce":3227878158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:42:00.933947+0000","modified":"2023-12-22T08:42:03.951929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5538":{"gid":5538,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2131151279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2131151279},{"type":"v1","addr":"172.21.15.89:6836","nonce":2131151279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T08:42:04.469 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2023-12-22T08:42:04.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.468+0000 7fedb9f37640 1 -- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feda006a460 msgr2=0x7feda006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.468+0000 7fedb9f37640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feda006a460 0x7feda006c920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fedb0034000 tx=0x7fedb0007000 comp rx=0 tx=0).stop 2023-12-22T08:42:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.468+0000 7fedb9f37640 1 -- 172.21.15.38:0/448121506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fedb41e5e60 msgr2=0x7fedb409ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.468+0000 7fedb9f37640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fedb41e5e60 0x7fedb409ee90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7feda400e7e0 tx=0x7feda400eca0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.468+0000 7fedb9f37640 1 -- 172.21.15.38:0/448121506 shutdown_connections 2023-12-22T08:42:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.468+0000 7fedb9f37640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fedb409f3d0 0x7fedb4145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.468+0000 7fedb9f37640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feda006a460 0x7feda006c920 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.468+0000 7fedb9f37640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fedb41e5e60 0x7fedb409ee90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.468+0000 7fedb9f37640 1 --2- 172.21.15.38:0/448121506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed9c0039a0 0x7fedb4145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.468+0000 7fedb9f37640 1 -- 172.21.15.38:0/448121506 >> 172.21.15.38:0/448121506 conn(0x7fedb40b1f70 msgr2=0x7fedb40cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:04.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.469+0000 7fedb9f37640 1 -- 172.21.15.38:0/448121506 shutdown_connections 2023-12-22T08:42:04.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.469+0000 7fedb9f37640 1 -- 172.21.15.38:0/448121506 wait complete. 2023-12-22T08:42:04.491 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:42:04.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.713+0000 7f8177034640 1 Processor -- start 2023-12-22T08:42:04.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.713+0000 7f8177034640 1 -- start start 2023-12-22T08:42:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.715+0000 7f8177034640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f81700b3ff0 0x7f817006cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.715+0000 7f8177034640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81700b44a0 0x7f817006d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.715+0000 7f8177034640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817015f220 con 0x7f8170157980 2023-12-22T08:42:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.715+0000 7f8177034640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81700d1520 con 0x7f81700b3ff0 2023-12-22T08:42:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.715+0000 7f8177034640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81700d1800 con 0x7f81700b44a0 2023-12-22T08:42:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.715+0000 7f8175831640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f81700b3ff0 0x7f817006cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.715+0000 7f8176032640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8170157980 0x7f817015eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45866/0 (socket says 172.21.15.38:45866) 2023-12-22T08:42:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.715+0000 7f8176032640 1 -- 172.21.15.38:0/2927178234 learned_addr learned my addr 172.21.15.38:0/2927178234 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.715+0000 7f8176833640 1 --2- 172.21.15.38:0/2927178234 >> v2:172.21.15.89:3300/0 conn(0x7f81700b44a0 0x7f817006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.716+0000 7f8175831640 1 -- 172.21.15.38:0/2927178234 >> v2:172.21.15.89:3300/0 conn(0x7f81700b44a0 msgr2=0x7f817006d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.716+0000 7f8175831640 1 --2- 172.21.15.38:0/2927178234 >> v2:172.21.15.89:3300/0 conn(0x7f81700b44a0 0x7f817006d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.716+0000 7f8175831640 1 -- 172.21.15.38:0/2927178234 >> v1:172.21.15.38:6789/0 conn(0x7f8170157980 legacy=0x7f817015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.716+0000 7f8175030640 1 -- 172.21.15.38:0/2927178234 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166129597 0 0) 0x7f817015f220 con 0x7f8170157980 2023-12-22T08:42:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.716+0000 7f8175831640 1 -- 172.21.15.38:0/2927178234 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81700d1ae0 con 0x7f81700b3ff0 2023-12-22T08:42:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.717+0000 7f8175831640 1 --2- 172.21.15.38:0/2927178234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81700b3ff0 0x7f817006cf30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f817006e5f0 tx=0x7f816002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41364cc1a2fa7dec server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.717+0000 7f8175030640 1 -- 172.21.15.38:0/2927178234 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160031830 con 0x7f81700b3ff0 2023-12-22T08:42:04.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.717+0000 7f8175030640 1 -- 172.21.15.38:0/2927178234 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8160031990 con 0x7f81700b3ff0 2023-12-22T08:42:04.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.717+0000 7f8175030640 1 -- 172.21.15.38:0/2927178234 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160031d20 con 0x7f81700b3ff0 2023-12-22T08:42:04.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.718+0000 7f8177034640 1 -- 172.21.15.38:0/2927178234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81700b3ff0 msgr2=0x7f817006cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:04.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.718+0000 7f8177034640 1 --2- 172.21.15.38:0/2927178234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81700b3ff0 0x7f817006cf30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f817006e5f0 tx=0x7f816002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.718+0000 7f8177034640 1 -- 172.21.15.38:0/2927178234 shutdown_connections 2023-12-22T08:42:04.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.718+0000 7f8177034640 1 --2- 172.21.15.38:0/2927178234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81700b3ff0 0x7f817006cf30 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.718+0000 7f8177034640 1 --2- 172.21.15.38:0/2927178234 >> v2:172.21.15.89:3300/0 conn(0x7f81700b44a0 0x7f817006d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.718+0000 7f8177034640 1 -- 172.21.15.38:0/2927178234 >> 172.21.15.38:0/2927178234 conn(0x7f81700d31f0 msgr2=0x7f81700d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:04.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.718+0000 7f8177034640 1 -- 172.21.15.38:0/2927178234 shutdown_connections 2023-12-22T08:42:04.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.718+0000 7f8177034640 1 -- 172.21.15.38:0/2927178234 wait complete. 2023-12-22T08:42:04.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.720+0000 7f8177034640 1 Processor -- start 2023-12-22T08:42:04.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.720+0000 7f8177034640 1 -- start start 2023-12-22T08:42:04.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.721+0000 7f8177034640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81700b3ff0 0x7f817014bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.721+0000 7f8177034640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81700b44a0 0x7f817014f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.721+0000 7f8177034640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8170157980 0x7f817014a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.721+0000 7f8177034640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817014ba40 con 0x7f81700b44a0 2023-12-22T08:42:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.721+0000 7f8177034640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817014ab90 con 0x7f81700b3ff0 2023-12-22T08:42:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.721+0000 7f8177034640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817014ae30 con 0x7f8170157980 2023-12-22T08:42:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.721+0000 7f8175831640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81700b44a0 0x7f817014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.721+0000 7f8175831640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81700b44a0 0x7f817014f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57812/0 (socket says 172.21.15.38:57812) 2023-12-22T08:42:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.721+0000 7f8175831640 1 -- 172.21.15.38:0/766742727 learned_addr learned my addr 172.21.15.38:0/766742727 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.722+0000 7f8175831640 1 -- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8170157980 msgr2=0x7f817014a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.722+0000 7f8175831640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8170157980 0x7f817014a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.722+0000 7f8175831640 1 -- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81700b3ff0 msgr2=0x7f817014bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.722+0000 7f8176032640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81700b3ff0 0x7f817014bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.722+0000 7f8175831640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81700b3ff0 0x7f817014bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.722+0000 7f8175831640 1 -- 172.21.15.38:0/766742727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8160009400 con 0x7f81700b44a0 2023-12-22T08:42:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.722+0000 7f8176032640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81700b3ff0 0x7f817014bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.722+0000 7f8175831640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81700b44a0 0x7f817014f570 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8160000c00 tx=0x7f81600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.722+0000 7f8166ffd640 1 -- 172.21.15.38:0/766742727 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160004230 con 0x7f81700b44a0 2023-12-22T08:42:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.722+0000 7f8166ffd640 1 -- 172.21.15.38:0/766742727 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81600043b0 con 0x7f81700b44a0 2023-12-22T08:42:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.722+0000 7f8166ffd640 1 -- 172.21.15.38:0/766742727 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160004520 con 0x7f81700b44a0 2023-12-22T08:42:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.723+0000 7f8177034640 1 -- 172.21.15.38:0/766742727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817014b110 con 0x7f81700b44a0 2023-12-22T08:42:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.723+0000 7f8177034640 1 -- 172.21.15.38:0/766742727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817014b6d0 con 0x7f81700b44a0 2023-12-22T08:42:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.724+0000 7f8177034640 1 -- 172.21.15.38:0/766742727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817014b890 con 0x7f81700b44a0 2023-12-22T08:42:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.725+0000 7f8166ffd640 1 -- 172.21.15.38:0/766742727 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f816003a8a0 con 0x7f81700b44a0 2023-12-22T08:42:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.726+0000 7f8166ffd640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f815406a460 0x7f815406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:04.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.726+0000 7f8166ffd640 1 -- 172.21.15.38:0/766742727 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81600ab070 con 0x7f81700b44a0 2023-12-22T08:42:04.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.727+0000 7f8176032640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f815406a460 0x7f815406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:04.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.728+0000 7f8176032640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f815406a460 0x7f815406c920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f816c000f60 tx=0x7f816c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:04.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.731+0000 7f8166ffd640 1 -- 172.21.15.38:0/766742727 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f81600ddc80 con 0x7f81700b44a0 2023-12-22T08:42:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.919+0000 7f8177034640 1 -- 172.21.15.38:0/766742727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8170061910 con 0x7f81700b44a0 2023-12-22T08:42:04.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.922+0000 7f8166ffd640 1 -- 172.21.15.38:0/766742727 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f8160076770 con 0x7f81700b44a0 2023-12-22T08:42:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:04.925 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":48,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:42:01.938335+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:58.840533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:59.953505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:42:04.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.924+0000 7f8177034640 1 -- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f815406a460 msgr2=0x7f815406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:04.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.924+0000 7f8177034640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f815406a460 0x7f815406c920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f816c000f60 tx=0x7f816c009040 comp rx=0 tx=0).stop 2023-12-22T08:42:04.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.924+0000 7f8177034640 1 -- 172.21.15.38:0/766742727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81700b44a0 msgr2=0x7f817014f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:04.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.924+0000 7f8177034640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81700b44a0 0x7f817014f570 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8160000c00 tx=0x7f81600046c0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.925+0000 7f8177034640 1 -- 172.21.15.38:0/766742727 shutdown_connections 2023-12-22T08:42:04.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.925+0000 7f8177034640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8170157980 0x7f817014a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.925+0000 7f8177034640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f815406a460 0x7f815406c920 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.925+0000 7f8177034640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81700b44a0 0x7f817014f570 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.925+0000 7f8177034640 1 --2- 172.21.15.38:0/766742727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81700b3ff0 0x7f817014bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.925+0000 7f8177034640 1 -- 172.21.15.38:0/766742727 >> 172.21.15.38:0/766742727 conn(0x7f81700d31f0 msgr2=0x7f81700d24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.925+0000 7f8177034640 1 -- 172.21.15.38:0/766742727 shutdown_connections 2023-12-22T08:42:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:04.925+0000 7f8177034640 1 -- 172.21.15.38:0/766742727 wait complete. 2023-12-22T08:42:04.945 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T08:42:04.945 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:42:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.166+0000 7fe0e2bd9640 1 Processor -- start 2023-12-22T08:42:05.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.166+0000 7fe0e2bd9640 1 -- start start 2023-12-22T08:42:05.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.167+0000 7fe0e2bd9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe0dc144d10 0x7fe0dc0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.168+0000 7fe0e2bd9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0dc1450f0 con 0x7fe0dc0b2760 2023-12-22T08:42:05.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.168+0000 7fe0e2bd9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0dc0ce010 con 0x7fe0dc0cc670 2023-12-22T08:42:05.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.168+0000 7fe0e2bd9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0dc0ce2f0 con 0x7fe0dc144d10 2023-12-22T08:42:05.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.168+0000 7fe0e0975640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe0dc144d10 0x7fe0dc0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.168+0000 7fe0e0975640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe0dc144d10 0x7fe0dc0cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57816/0 (socket says 172.21.15.38:57816) 2023-12-22T08:42:05.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.168+0000 7fe0e0975640 1 -- 172.21.15.38:0/2401024797 learned_addr learned my addr 172.21.15.38:0/2401024797 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:05.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.169+0000 7fe0e0975640 1 -- 172.21.15.38:0/2401024797 >> v1:172.21.15.89:6789/0 conn(0x7fe0dc0cc670 legacy=0x7fe0dc0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:05.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.169+0000 7fe0e0975640 1 -- 172.21.15.38:0/2401024797 >> v1:172.21.15.38:6789/0 conn(0x7fe0dc0b2760 legacy=0x7fe0dc070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.169+0000 7fe0e0975640 1 -- 172.21.15.38:0/2401024797 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc0ce5d0 con 0x7fe0dc144d10 2023-12-22T08:42:05.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.170+0000 7fe0e0975640 1 --2- 172.21.15.38:0/2401024797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0dc144d10 0x7fe0dc0cc130 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009e50 tx=0x7fe0d802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea9bda8991f637e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:05.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.170+0000 7fe0d37fe640 1 -- 172.21.15.38:0/2401024797 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d802cb10 con 0x7fe0dc144d10 2023-12-22T08:42:05.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.170+0000 7fe0d37fe640 1 -- 172.21.15.38:0/2401024797 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d802cc70 con 0x7fe0dc144d10 2023-12-22T08:42:05.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.170+0000 7fe0d37fe640 1 -- 172.21.15.38:0/2401024797 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d80343f0 con 0x7fe0dc144d10 2023-12-22T08:42:05.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.171+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/2401024797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0dc144d10 msgr2=0x7fe0dc0cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.171+0000 7fe0e2bd9640 1 --2- 172.21.15.38:0/2401024797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0dc144d10 0x7fe0dc0cc130 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009e50 tx=0x7fe0d802bf70 comp rx=0 tx=0).stop 2023-12-22T08:42:05.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.171+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/2401024797 shutdown_connections 2023-12-22T08:42:05.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.171+0000 7fe0e2bd9640 1 --2- 172.21.15.38:0/2401024797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0dc144d10 0x7fe0dc0cc130 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.171+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/2401024797 >> 172.21.15.38:0/2401024797 conn(0x7fe0dc0cf070 msgr2=0x7fe0dc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:05.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.171+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/2401024797 shutdown_connections 2023-12-22T08:42:05.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.171+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/2401024797 wait complete. 2023-12-22T08:42:05.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.172+0000 7fe0e2bd9640 1 Processor -- start 2023-12-22T08:42:05.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.173+0000 7fe0e2bd9640 1 -- start start 2023-12-22T08:42:05.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0e2bd9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0dc0b2760 0x7fe0dc156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0e2bd9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0dc144d10 0x7fe0dc13f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0e2bd9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0dc1580f0 0x7fe0dc15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0e2bd9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc1576a0 con 0x7fe0dc144d10 2023-12-22T08:42:05.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0e2bd9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc156a90 con 0x7fe0dc0b2760 2023-12-22T08:42:05.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0e2bd9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc156d70 con 0x7fe0dc1580f0 2023-12-22T08:42:05.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0d3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0dc144d10 0x7fe0dc13f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0d3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0dc144d10 0x7fe0dc13f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57824/0 (socket says 172.21.15.38:57824) 2023-12-22T08:42:05.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0d3fff640 1 -- 172.21.15.38:0/3917522583 learned_addr learned my addr 172.21.15.38:0/3917522583 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:05.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0e0975640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0dc0b2760 0x7fe0dc156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0e1176640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0dc1580f0 0x7fe0dc15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0d3fff640 1 -- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0dc1580f0 msgr2=0x7fe0dc15a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0d3fff640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0dc1580f0 0x7fe0dc15a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0d3fff640 1 -- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0dc0b2760 msgr2=0x7fe0dc156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0d3fff640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0dc0b2760 0x7fe0dc156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0d3fff640 1 -- 172.21.15.38:0/3917522583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8009b30 con 0x7fe0dc144d10 2023-12-22T08:42:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.174+0000 7fe0e0975640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0dc0b2760 0x7fe0dc156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.175+0000 7fe0e1176640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0dc1580f0 0x7fe0dc15a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.175+0000 7fe0d3fff640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0dc144d10 0x7fe0dc13f970 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00c400 tx=0x7fe0cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.175+0000 7fe0d17fa640 1 -- 172.21.15.38:0/3917522583 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc011790 con 0x7fe0dc144d10 2023-12-22T08:42:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.175+0000 7fe0d17fa640 1 -- 172.21.15.38:0/3917522583 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc011930 con 0x7fe0dc144d10 2023-12-22T08:42:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.175+0000 7fe0d17fa640 1 -- 172.21.15.38:0/3917522583 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc011ce0 con 0x7fe0dc144d10 2023-12-22T08:42:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.175+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/3917522583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0dc157050 con 0x7fe0dc144d10 2023-12-22T08:42:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.175+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/3917522583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0dc156780 con 0x7fe0dc144d10 2023-12-22T08:42:05.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.176+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/3917522583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0dc0ceb70 con 0x7fe0dc144d10 2023-12-22T08:42:05.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.177+0000 7fe0d17fa640 1 -- 172.21.15.38:0/3917522583 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe0cc01c460 con 0x7fe0dc144d10 2023-12-22T08:42:05.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.178+0000 7fe0d17fa640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0c806a460 0x7fe0c806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.178+0000 7fe0d17fa640 1 -- 172.21.15.38:0/3917522583 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0cc088860 con 0x7fe0dc144d10 2023-12-22T08:42:05.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.179+0000 7fe0e0975640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0c806a460 0x7fe0c806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.180+0000 7fe0e0975640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0c806a460 0x7fe0c806c920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8035000 tx=0x7fe0d8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:05.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.183+0000 7fe0d17fa640 1 -- 172.21.15.38:0/3917522583 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe0dc0ceb70 con 0x7fe0dc144d10 2023-12-22T08:42:05.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.373+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/3917522583 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0dc0ce8b0 con 0x7fe0c806a460 2023-12-22T08:42:05.390 INFO:tasks.ceph.mds.d.smithi089.stderr:2023-12-22T08:42:05.387+0000 7fcc7ef7d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:42:05.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.400+0000 7fe0d17fa640 1 -- 172.21.15.38:0/3917522583 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282557 (secure 0 0 0) 0x7fe0d8009510 con 0x7fe0c806a460 2023-12-22T08:42:05.406 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:05.408 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:42:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.405+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0c806a460 msgr2=0x7fe0c806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.405+0000 7fe0e2bd9640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0c806a460 0x7fe0c806c920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8035000 tx=0x7fe0d8030000 comp rx=0 tx=0).stop 2023-12-22T08:42:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.405+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/3917522583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0dc144d10 msgr2=0x7fe0dc13f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.405+0000 7fe0e2bd9640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0dc144d10 0x7fe0dc13f970 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00c400 tx=0x7fe0cc00c8c0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.406+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/3917522583 shutdown_connections 2023-12-22T08:42:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.406+0000 7fe0e2bd9640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0dc1580f0 0x7fe0dc15a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.406+0000 7fe0e2bd9640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0c806a460 0x7fe0c806c920 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.406+0000 7fe0e2bd9640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0dc144d10 0x7fe0dc13f970 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.406+0000 7fe0e2bd9640 1 --2- 172.21.15.38:0/3917522583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0dc0b2760 0x7fe0dc156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.406+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/3917522583 >> 172.21.15.38:0/3917522583 conn(0x7fe0dc0cf070 msgr2=0x7fe0dc0cbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.406+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/3917522583 shutdown_connections 2023-12-22T08:42:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.406+0000 7fe0e2bd9640 1 -- 172.21.15.38:0/3917522583 wait complete. 2023-12-22T08:42:05.429 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-12-22T08:42:04.398732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2963,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559536,"statfs":{"total":1600000000,"available":1596965251,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.970601"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030322+0000","last_change":"2023-12-22T08:42:00.969971+0000","last_active":"2023-12-22T08:42:03.030322+0000","last_peered":"2023-12-22T08:42:03.030322+0000","last_clean":"2023-12-22T08:42:03.030322+0000","last_became_active":"2023-12-22T08:42:00.969755+0000","last_became_peered":"2023-12-22T08:42:00.969755+0000","last_unstale":"2023-12-22T08:42:03.030322+0000","last_undegraded":"2023-12-22T08:42:03.030322+0000","last_fullsized":"2023-12-22T08:42:03.030322+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:16:18.741591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946132+0000","last_change":"2023-12-22T08:42:00.955355+0000","last_active":"2023-12-22T08:42:01.946132+0000","last_peered":"2023-12-22T08:42:01.946132+0000","last_clean":"2023-12-22T08:42:01.946132+0000","last_became_active":"2023-12-22T08:42:00.955138+0000","last_became_peered":"2023-12-22T08:42:00.955138+0000","last_unstale":"2023-12-22T08:42:01.946132+0000","last_undegraded":"2023-12-22T08:42:01.946132+0000","last_fullsized":"2023-12-22T08:42:01.946132+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:17.219524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.944935+0000","last_change":"2023-12-22T08:42:00.956820+0000","last_active":"2023-12-22T08:42:01.944935+0000","last_peered":"2023-12-22T08:42:01.944935+0000","last_clean":"2023-12-22T08:42:01.944935+0000","last_became_active":"2023-12-22T08:42:00.956252+0000","last_became_peered":"2023-12-22T08:42:00.956252+0000","last_unstale":"2023-12-22T08:42:01.944935+0000","last_undegraded":"2023-12-22T08:42:01.944935+0000","last_fullsized":"2023-12-22T08:42:01.944935+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:51.159616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031541+0000","last_change":"2023-12-22T08:42:00.964031+0000","last_active":"2023-12-22T08:42:03.031541+0000","last_peered":"2023-12-22T08:42:03.031541+0000","last_clean":"2023-12-22T08:42:03.031541+0000","last_became_active":"2023-12-22T08:42:00.963802+0000","last_became_peered":"2023-12-22T08:42:00.963802+0000","last_unstale":"2023-12-22T08:42:03.031541+0000","last_undegraded":"2023-12-22T08:42:03.031541+0000","last_fullsized":"2023-12-22T08:42:03.031541+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:31:07.952665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030224+0000","last_change":"2023-12-22T08:42:00.966136+0000","last_active":"2023-12-22T08:42:03.030224+0000","last_peered":"2023-12-22T08:42:03.030224+0000","last_clean":"2023-12-22T08:42:03.030224+0000","last_became_active":"2023-12-22T08:42:00.965892+0000","last_became_peered":"2023-12-22T08:42:00.965892+0000","last_unstale":"2023-12-22T08:42:03.030224+0000","last_undegraded":"2023-12-22T08:42:03.030224+0000","last_fullsized":"2023-12-22T08:42:03.030224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:32.942053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858047+0000","last_change":"2023-12-22T08:42:00.969775+0000","last_active":"2023-12-22T08:42:02.858047+0000","last_peered":"2023-12-22T08:42:02.858047+0000","last_clean":"2023-12-22T08:42:02.858047+0000","last_became_active":"2023-12-22T08:42:00.969121+0000","last_became_peered":"2023-12-22T08:42:00.969121+0000","last_unstale":"2023-12-22T08:42:02.858047+0000","last_undegraded":"2023-12-22T08:42:02.858047+0000","last_fullsized":"2023-12-22T08:42:02.858047+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:14.286497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945775+0000","last_change":"2023-12-22T08:42:00.954963+0000","last_active":"2023-12-22T08:42:01.945775+0000","last_peered":"2023-12-22T08:42:01.945775+0000","last_clean":"2023-12-22T08:42:01.945775+0000","last_became_active":"2023-12-22T08:42:00.954574+0000","last_became_peered":"2023-12-22T08:42:00.954574+0000","last_unstale":"2023-12-22T08:42:01.945775+0000","last_undegraded":"2023-12-22T08:42:01.945775+0000","last_fullsized":"2023-12-22T08:42:01.945775+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:43:18.268811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031321+0000","last_change":"2023-12-22T08:42:00.972523+0000","last_active":"2023-12-22T08:42:03.031321+0000","last_peered":"2023-12-22T08:42:03.031321+0000","last_clean":"2023-12-22T08:42:03.031321+0000","last_became_active":"2023-12-22T08:42:00.970871+0000","last_became_peered":"2023-12-22T08:42:00.970871+0000","last_unstale":"2023-12-22T08:42:03.031321+0000","last_undegraded":"2023-12-22T08:42:03.031321+0000","last_fullsized":"2023-12-22T08:42:03.031321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:08.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858253+0000","last_change":"2023-12-22T08:42:00.972822+0000","last_active":"2023-12-22T08:42:02.858253+0000","last_peered":"2023-12-22T08:42:02.858253+0000","last_clean":"2023-12-22T08:42:02.858253+0000","last_became_active":"2023-12-22T08:42:00.972606+0000","last_became_peered":"2023-12-22T08:42:00.972606+0000","last_unstale":"2023-12-22T08:42:02.858253+0000","last_undegraded":"2023-12-22T08:42:02.858253+0000","last_fullsized":"2023-12-22T08:42:02.858253+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:01:28.567989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317263+0000","last_change":"2023-12-22T08:42:00.969617+0000","last_active":"2023-12-22T08:42:02.317263+0000","last_peered":"2023-12-22T08:42:02.317263+0000","last_clean":"2023-12-22T08:42:02.317263+0000","last_became_active":"2023-12-22T08:42:00.969344+0000","last_became_peered":"2023-12-22T08:42:00.969344+0000","last_unstale":"2023-12-22T08:42:02.317263+0000","last_undegraded":"2023-12-22T08:42:02.317263+0000","last_fullsized":"2023-12-22T08:42:02.317263+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:02:36.760841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031677+0000","last_change":"2023-12-22T08:42:00.968601+0000","last_active":"2023-12-22T08:42:03.031677+0000","last_peered":"2023-12-22T08:42:03.031677+0000","last_clean":"2023-12-22T08:42:03.031677+0000","last_became_active":"2023-12-22T08:42:00.967706+0000","last_became_peered":"2023-12-22T08:42:00.967706+0000","last_unstale":"2023-12-22T08:42:03.031677+0000","last_undegraded":"2023-12-22T08:42:03.031677+0000","last_fullsized":"2023-12-22T08:42:03.031677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:58:27.825373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946386+0000","last_change":"2023-12-22T08:42:00.960913+0000","last_active":"2023-12-22T08:42:01.946386+0000","last_peered":"2023-12-22T08:42:01.946386+0000","last_clean":"2023-12-22T08:42:01.946386+0000","last_became_active":"2023-12-22T08:42:00.960556+0000","last_became_peered":"2023-12-22T08:42:00.960556+0000","last_unstale":"2023-12-22T08:42:01.946386+0000","last_undegraded":"2023-12-22T08:42:01.946386+0000","last_fullsized":"2023-12-22T08:42:01.946386+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:30:44.215726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857828+0000","last_change":"2023-12-22T08:42:00.968404+0000","last_active":"2023-12-22T08:42:02.857828+0000","last_peered":"2023-12-22T08:42:02.857828+0000","last_clean":"2023-12-22T08:42:02.857828+0000","last_became_active":"2023-12-22T08:42:00.967626+0000","last_became_peered":"2023-12-22T08:42:00.967626+0000","last_unstale":"2023-12-22T08:42:02.857828+0000","last_undegraded":"2023-12-22T08:42:02.857828+0000","last_fullsized":"2023-12-22T08:42:02.857828+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:30.197765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.032180+0000","last_change":"2023-12-22T08:42:00.958943+0000","last_active":"2023-12-22T08:42:03.032180+0000","last_peered":"2023-12-22T08:42:03.032180+0000","last_clean":"2023-12-22T08:42:03.032180+0000","last_became_active":"2023-12-22T08:42:00.958413+0000","last_became_peered":"2023-12-22T08:42:00.958413+0000","last_unstale":"2023-12-22T08:42:03.032180+0000","last_undegraded":"2023-12-22T08:42:03.032180+0000","last_fullsized":"2023-12-22T08:42:03.032180+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:32:52.813808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031302+0000","last_change":"2023-12-22T08:42:00.960854+0000","last_active":"2023-12-22T08:42:03.031302+0000","last_peered":"2023-12-22T08:42:03.031302+0000","last_clean":"2023-12-22T08:42:03.031302+0000","last_became_active":"2023-12-22T08:42:00.960602+0000","last_became_peered":"2023-12-22T08:42:00.960602+0000","last_unstale":"2023-12-22T08:42:03.031302+0000","last_undegraded":"2023-12-22T08:42:03.031302+0000","last_fullsized":"2023-12-22T08:42:03.031302+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:27.697741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030601+0000","last_change":"2023-12-22T08:42:00.966498+0000","last_active":"2023-12-22T08:42:03.030601+0000","last_peered":"2023-12-22T08:42:03.030601+0000","last_clean":"2023-12-22T08:42:03.030601+0000","last_became_active":"2023-12-22T08:42:00.966250+0000","last_became_peered":"2023-12-22T08:42:00.966250+0000","last_unstale":"2023-12-22T08:42:03.030601+0000","last_undegraded":"2023-12-22T08:42:03.030601+0000","last_fullsized":"2023-12-22T08:42:03.030601+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:31.164625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946982+0000","last_change":"2023-12-22T08:42:00.969675+0000","last_active":"2023-12-22T08:42:01.946982+0000","last_peered":"2023-12-22T08:42:01.946982+0000","last_clean":"2023-12-22T08:42:01.946982+0000","last_became_active":"2023-12-22T08:42:00.967757+0000","last_became_peered":"2023-12-22T08:42:00.967757+0000","last_unstale":"2023-12-22T08:42:01.946982+0000","last_undegraded":"2023-12-22T08:42:01.946982+0000","last_fullsized":"2023-12-22T08:42:01.946982+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:08.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945224+0000","last_change":"2023-12-22T08:42:00.967521+0000","last_active":"2023-12-22T08:42:01.945224+0000","last_peered":"2023-12-22T08:42:01.945224+0000","last_clean":"2023-12-22T08:42:01.945224+0000","last_became_active":"2023-12-22T08:42:00.966572+0000","last_became_peered":"2023-12-22T08:42:00.966572+0000","last_unstale":"2023-12-22T08:42:01.945224+0000","last_undegraded":"2023-12-22T08:42:01.945224+0000","last_fullsized":"2023-12-22T08:42:01.945224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:19:39.462835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030495+0000","last_change":"2023-12-22T08:42:00.973720+0000","last_active":"2023-12-22T08:42:03.030495+0000","last_peered":"2023-12-22T08:42:03.030495+0000","last_clean":"2023-12-22T08:42:03.030495+0000","last_became_active":"2023-12-22T08:42:00.972646+0000","last_became_peered":"2023-12-22T08:42:00.972646+0000","last_unstale":"2023-12-22T08:42:03.030495+0000","last_undegraded":"2023-12-22T08:42:03.030495+0000","last_fullsized":"2023-12-22T08:42:03.030495+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:17:58.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317746+0000","last_change":"2023-12-22T08:42:00.965928+0000","last_active":"2023-12-22T08:42:02.317746+0000","last_peered":"2023-12-22T08:42:02.317746+0000","last_clean":"2023-12-22T08:42:02.317746+0000","last_became_active":"2023-12-22T08:42:00.962390+0000","last_became_peered":"2023-12-22T08:42:00.962390+0000","last_unstale":"2023-12-22T08:42:02.317746+0000","last_undegraded":"2023-12-22T08:42:02.317746+0000","last_fullsized":"2023-12-22T08:42:02.317746+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:11:27.558443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.032041+0000","last_change":"2023-12-22T08:42:00.967947+0000","last_active":"2023-12-22T08:42:03.032041+0000","last_peered":"2023-12-22T08:42:03.032041+0000","last_clean":"2023-12-22T08:42:03.032041+0000","last_became_active":"2023-12-22T08:42:00.966987+0000","last_became_peered":"2023-12-22T08:42:00.966987+0000","last_unstale":"2023-12-22T08:42:03.032041+0000","last_undegraded":"2023-12-22T08:42:03.032041+0000","last_fullsized":"2023-12-22T08:42:03.032041+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:30:44.215726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857269+0000","last_change":"2023-12-22T08:42:00.960777+0000","last_active":"2023-12-22T08:42:02.857269+0000","last_peered":"2023-12-22T08:42:02.857269+0000","last_clean":"2023-12-22T08:42:02.857269+0000","last_became_active":"2023-12-22T08:42:00.960335+0000","last_became_peered":"2023-12-22T08:42:00.960335+0000","last_unstale":"2023-12-22T08:42:02.857269+0000","last_undegraded":"2023-12-22T08:42:02.857269+0000","last_fullsized":"2023-12-22T08:42:02.857269+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:51.563460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946001+0000","last_change":"2023-12-22T08:42:00.971226+0000","last_active":"2023-12-22T08:42:01.946001+0000","last_peered":"2023-12-22T08:42:01.946001+0000","last_clean":"2023-12-22T08:42:01.946001+0000","last_became_active":"2023-12-22T08:42:00.970822+0000","last_became_peered":"2023-12-22T08:42:00.970822+0000","last_unstale":"2023-12-22T08:42:01.946001+0000","last_undegraded":"2023-12-22T08:42:01.946001+0000","last_fullsized":"2023-12-22T08:42:01.946001+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:22:06.631349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.944831+0000","last_change":"2023-12-22T08:42:00.967600+0000","last_active":"2023-12-22T08:42:01.944831+0000","last_peered":"2023-12-22T08:42:01.944831+0000","last_clean":"2023-12-22T08:42:01.944831+0000","last_became_active":"2023-12-22T08:42:00.967316+0000","last_became_peered":"2023-12-22T08:42:00.967316+0000","last_unstale":"2023-12-22T08:42:01.944831+0000","last_undegraded":"2023-12-22T08:42:01.944831+0000","last_fullsized":"2023-12-22T08:42:01.944831+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:58:27.825373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030309+0000","last_change":"2023-12-22T08:42:00.970541+0000","last_active":"2023-12-22T08:42:03.030309+0000","last_peered":"2023-12-22T08:42:03.030309+0000","last_clean":"2023-12-22T08:42:03.030309+0000","last_became_active":"2023-12-22T08:42:00.970061+0000","last_became_peered":"2023-12-22T08:42:00.970061+0000","last_unstale":"2023-12-22T08:42:03.030309+0000","last_undegraded":"2023-12-22T08:42:03.030309+0000","last_fullsized":"2023-12-22T08:42:03.030309+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:51:37.320233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.032186+0000","last_change":"2023-12-22T08:42:00.968408+0000","last_active":"2023-12-22T08:42:03.032186+0000","last_peered":"2023-12-22T08:42:03.032186+0000","last_clean":"2023-12-22T08:42:03.032186+0000","last_became_active":"2023-12-22T08:42:00.967406+0000","last_became_peered":"2023-12-22T08:42:00.967406+0000","last_unstale":"2023-12-22T08:42:03.032186+0000","last_undegraded":"2023-12-22T08:42:03.032186+0000","last_fullsized":"2023-12-22T08:42:03.032186+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:08:04.838063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945908+0000","last_change":"2023-12-22T08:42:00.955772+0000","last_active":"2023-12-22T08:42:01.945908+0000","last_peered":"2023-12-22T08:42:01.945908+0000","last_clean":"2023-12-22T08:42:01.945908+0000","last_became_active":"2023-12-22T08:42:00.955359+0000","last_became_peered":"2023-12-22T08:42:00.955359+0000","last_unstale":"2023-12-22T08:42:01.945908+0000","last_undegraded":"2023-12-22T08:42:01.945908+0000","last_fullsized":"2023-12-22T08:42:01.945908+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:33.584100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.944827+0000","last_change":"2023-12-22T08:42:00.956085+0000","last_active":"2023-12-22T08:42:01.944827+0000","last_peered":"2023-12-22T08:42:01.944827+0000","last_clean":"2023-12-22T08:42:01.944827+0000","last_became_active":"2023-12-22T08:42:00.955523+0000","last_became_peered":"2023-12-22T08:42:00.955523+0000","last_unstale":"2023-12-22T08:42:01.944827+0000","last_undegraded":"2023-12-22T08:42:01.944827+0000","last_fullsized":"2023-12-22T08:42:01.944827+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:12:03.987628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030098+0000","last_change":"2023-12-22T08:42:00.964172+0000","last_active":"2023-12-22T08:42:03.030098+0000","last_peered":"2023-12-22T08:42:03.030098+0000","last_clean":"2023-12-22T08:42:03.030098+0000","last_became_active":"2023-12-22T08:42:00.963932+0000","last_became_peered":"2023-12-22T08:42:00.963932+0000","last_unstale":"2023-12-22T08:42:03.030098+0000","last_undegraded":"2023-12-22T08:42:03.030098+0000","last_fullsized":"2023-12-22T08:42:03.030098+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:48.789053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946627+0000","last_change":"2023-12-22T08:42:00.950551+0000","last_active":"2023-12-22T08:42:01.946627+0000","last_peered":"2023-12-22T08:42:01.946627+0000","last_clean":"2023-12-22T08:42:01.946627+0000","last_became_active":"2023-12-22T08:42:00.949921+0000","last_became_peered":"2023-12-22T08:42:00.949921+0000","last_unstale":"2023-12-22T08:42:01.946627+0000","last_undegraded":"2023-12-22T08:42:01.946627+0000","last_fullsized":"2023-12-22T08:42:01.946627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:32.942053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858294+0000","last_change":"2023-12-22T08:42:00.966233+0000","last_active":"2023-12-22T08:42:02.858294+0000","last_peered":"2023-12-22T08:42:02.858294+0000","last_clean":"2023-12-22T08:42:02.858294+0000","last_became_active":"2023-12-22T08:42:00.965622+0000","last_became_peered":"2023-12-22T08:42:00.965622+0000","last_unstale":"2023-12-22T08:42:02.858294+0000","last_undegraded":"2023-12-22T08:42:02.858294+0000","last_fullsized":"2023-12-22T08:42:02.858294+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:09.049105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031508+0000","last_change":"2023-12-22T08:42:00.962526+0000","last_active":"2023-12-22T08:42:03.031508+0000","last_peered":"2023-12-22T08:42:03.031508+0000","last_clean":"2023-12-22T08:42:03.031508+0000","last_became_active":"2023-12-22T08:42:00.962292+0000","last_became_peered":"2023-12-22T08:42:00.962292+0000","last_unstale":"2023-12-22T08:42:03.031508+0000","last_undegraded":"2023-12-22T08:42:03.031508+0000","last_fullsized":"2023-12-22T08:42:03.031508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:11:10.990224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.856624+0000","last_change":"2023-12-22T08:42:00.954940+0000","last_active":"2023-12-22T08:42:02.856624+0000","last_peered":"2023-12-22T08:42:02.856624+0000","last_clean":"2023-12-22T08:42:02.856624+0000","last_became_active":"2023-12-22T08:42:00.954321+0000","last_became_peered":"2023-12-22T08:42:00.954321+0000","last_unstale":"2023-12-22T08:42:02.856624+0000","last_undegraded":"2023-12-22T08:42:02.856624+0000","last_fullsized":"2023-12-22T08:42:02.856624+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:51.159616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858334+0000","last_change":"2023-12-22T08:42:00.462663+0000","last_active":"2023-12-22T08:42:02.858334+0000","last_peered":"2023-12-22T08:42:02.858334+0000","last_clean":"2023-12-22T08:42:02.858334+0000","last_became_active":"2023-12-22T08:42:00.460798+0000","last_became_peered":"2023-12-22T08:42:00.460798+0000","last_unstale":"2023-12-22T08:42:02.858334+0000","last_undegraded":"2023-12-22T08:42:02.858334+0000","last_fullsized":"2023-12-22T08:42:02.858334+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:28.846648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030664+0000","last_change":"2023-12-22T08:42:00.967264+0000","last_active":"2023-12-22T08:42:03.030664+0000","last_peered":"2023-12-22T08:42:03.030664+0000","last_clean":"2023-12-22T08:42:03.030664+0000","last_became_active":"2023-12-22T08:42:00.966980+0000","last_became_peered":"2023-12-22T08:42:00.966980+0000","last_unstale":"2023-12-22T08:42:03.030664+0000","last_undegraded":"2023-12-22T08:42:03.030664+0000","last_fullsized":"2023-12-22T08:42:03.030664+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:14.707678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945737+0000","last_change":"2023-12-22T08:42:00.451324+0000","last_active":"2023-12-22T08:42:01.945737+0000","last_peered":"2023-12-22T08:42:01.945737+0000","last_clean":"2023-12-22T08:42:01.945737+0000","last_became_active":"2023-12-22T08:42:00.451093+0000","last_became_peered":"2023-12-22T08:42:00.451093+0000","last_unstale":"2023-12-22T08:42:01.945737+0000","last_undegraded":"2023-12-22T08:42:01.945737+0000","last_fullsized":"2023-12-22T08:42:01.945737+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:32:51.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.947517+0000","last_change":"2023-12-22T08:42:00.955641+0000","last_active":"2023-12-22T08:42:01.947517+0000","last_peered":"2023-12-22T08:42:01.947517+0000","last_clean":"2023-12-22T08:42:01.947517+0000","last_became_active":"2023-12-22T08:42:00.955292+0000","last_became_peered":"2023-12-22T08:42:00.955292+0000","last_unstale":"2023-12-22T08:42:01.947517+0000","last_undegraded":"2023-12-22T08:42:01.947517+0000","last_fullsized":"2023-12-22T08:42:01.947517+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:08:04.838063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858391+0000","last_change":"2023-12-22T08:42:00.455930+0000","last_active":"2023-12-22T08:42:02.858391+0000","last_peered":"2023-12-22T08:42:02.858391+0000","last_clean":"2023-12-22T08:42:02.858391+0000","last_became_active":"2023-12-22T08:42:00.455591+0000","last_became_peered":"2023-12-22T08:42:00.455591+0000","last_unstale":"2023-12-22T08:42:02.858391+0000","last_undegraded":"2023-12-22T08:42:02.858391+0000","last_fullsized":"2023-12-22T08:42:02.858391+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:10:42.704473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031543+0000","last_change":"2023-12-22T08:42:00.975004+0000","last_active":"2023-12-22T08:42:03.031543+0000","last_peered":"2023-12-22T08:42:03.031543+0000","last_clean":"2023-12-22T08:42:03.031543+0000","last_became_active":"2023-12-22T08:42:00.974714+0000","last_became_peered":"2023-12-22T08:42:00.974714+0000","last_unstale":"2023-12-22T08:42:03.031543+0000","last_undegraded":"2023-12-22T08:42:03.031543+0000","last_fullsized":"2023-12-22T08:42:03.031543+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:17.219524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946840+0000","last_change":"2023-12-22T08:42:00.451330+0000","last_active":"2023-12-22T08:42:01.946840+0000","last_peered":"2023-12-22T08:42:01.946840+0000","last_clean":"2023-12-22T08:42:01.946840+0000","last_became_active":"2023-12-22T08:42:00.451131+0000","last_became_peered":"2023-12-22T08:42:00.451131+0000","last_unstale":"2023-12-22T08:42:01.946840+0000","last_undegraded":"2023-12-22T08:42:01.946840+0000","last_fullsized":"2023-12-22T08:42:01.946840+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:34:58.075105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.944995+0000","last_change":"2023-12-22T08:42:00.956574+0000","last_active":"2023-12-22T08:42:01.944995+0000","last_peered":"2023-12-22T08:42:01.944995+0000","last_clean":"2023-12-22T08:42:01.944995+0000","last_became_active":"2023-12-22T08:42:00.955822+0000","last_became_peered":"2023-12-22T08:42:00.955822+0000","last_unstale":"2023-12-22T08:42:01.944995+0000","last_undegraded":"2023-12-22T08:42:01.944995+0000","last_fullsized":"2023-12-22T08:42:01.944995+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:58.087661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858114+0000","last_change":"2023-12-22T08:42:00.452895+0000","last_active":"2023-12-22T08:42:02.858114+0000","last_peered":"2023-12-22T08:42:02.858114+0000","last_clean":"2023-12-22T08:42:02.858114+0000","last_became_active":"2023-12-22T08:42:00.452227+0000","last_became_peered":"2023-12-22T08:42:00.452227+0000","last_unstale":"2023-12-22T08:42:02.858114+0000","last_undegraded":"2023-12-22T08:42:02.858114+0000","last_fullsized":"2023-12-22T08:42:02.858114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:41.235574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.316863+0000","last_change":"2023-12-22T08:42:00.954886+0000","last_active":"2023-12-22T08:42:02.316863+0000","last_peered":"2023-12-22T08:42:02.316863+0000","last_clean":"2023-12-22T08:42:02.316863+0000","last_became_active":"2023-12-22T08:42:00.954262+0000","last_became_peered":"2023-12-22T08:42:00.954262+0000","last_unstale":"2023-12-22T08:42:02.316863+0000","last_undegraded":"2023-12-22T08:42:02.316863+0000","last_fullsized":"2023-12-22T08:42:02.316863+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:36:31.432856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945876+0000","last_change":"2023-12-22T08:42:00.457163+0000","last_active":"2023-12-22T08:42:01.945876+0000","last_peered":"2023-12-22T08:42:01.945876+0000","last_clean":"2023-12-22T08:42:01.945876+0000","last_became_active":"2023-12-22T08:42:00.456680+0000","last_became_peered":"2023-12-22T08:42:00.456680+0000","last_unstale":"2023-12-22T08:42:01.945876+0000","last_undegraded":"2023-12-22T08:42:01.945876+0000","last_fullsized":"2023-12-22T08:42:01.945876+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:19:22.862823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317494+0000","last_change":"2023-12-22T08:42:00.966493+0000","last_active":"2023-12-22T08:42:02.317494+0000","last_peered":"2023-12-22T08:42:02.317494+0000","last_clean":"2023-12-22T08:42:02.317494+0000","last_became_active":"2023-12-22T08:42:00.965708+0000","last_became_peered":"2023-12-22T08:42:00.965708+0000","last_unstale":"2023-12-22T08:42:02.317494+0000","last_undegraded":"2023-12-22T08:42:02.317494+0000","last_fullsized":"2023-12-22T08:42:02.317494+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:32:52.813808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030227+0000","last_change":"2023-12-22T08:42:00.458273+0000","last_active":"2023-12-22T08:42:03.030227+0000","last_peered":"2023-12-22T08:42:03.030227+0000","last_clean":"2023-12-22T08:42:03.030227+0000","last_became_active":"2023-12-22T08:42:00.458022+0000","last_became_peered":"2023-12-22T08:42:00.458022+0000","last_unstale":"2023-12-22T08:42:03.030227+0000","last_undegraded":"2023-12-22T08:42:03.030227+0000","last_fullsized":"2023-12-22T08:42:03.030227+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:41.235574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945116+0000","last_change":"2023-12-22T08:42:00.972825+0000","last_active":"2023-12-22T08:42:01.945116+0000","last_peered":"2023-12-22T08:42:01.945116+0000","last_clean":"2023-12-22T08:42:01.945116+0000","last_became_active":"2023-12-22T08:42:00.972619+0000","last_became_peered":"2023-12-22T08:42:00.972619+0000","last_unstale":"2023-12-22T08:42:01.945116+0000","last_undegraded":"2023-12-22T08:42:01.945116+0000","last_fullsized":"2023-12-22T08:42:01.945116+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:52:10.519575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317851+0000","last_change":"2023-12-22T08:42:00.446893+0000","last_active":"2023-12-22T08:42:02.317851+0000","last_peered":"2023-12-22T08:42:02.317851+0000","last_clean":"2023-12-22T08:42:02.317851+0000","last_became_active":"2023-12-22T08:42:00.446419+0000","last_became_peered":"2023-12-22T08:42:00.446419+0000","last_unstale":"2023-12-22T08:42:02.317851+0000","last_undegraded":"2023-12-22T08:42:02.317851+0000","last_fullsized":"2023-12-22T08:42:02.317851+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:51:36.305728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.944748+0000","last_change":"2023-12-22T08:42:00.963942+0000","last_active":"2023-12-22T08:42:01.944748+0000","last_peered":"2023-12-22T08:42:01.944748+0000","last_clean":"2023-12-22T08:42:01.944748+0000","last_became_active":"2023-12-22T08:42:00.963234+0000","last_became_peered":"2023-12-22T08:42:00.963234+0000","last_unstale":"2023-12-22T08:42:01.944748+0000","last_undegraded":"2023-12-22T08:42:01.944748+0000","last_fullsized":"2023-12-22T08:42:01.944748+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:38:38.995302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945437+0000","last_change":"2023-12-22T08:42:00.465441+0000","last_active":"2023-12-22T08:42:01.945437+0000","last_peered":"2023-12-22T08:42:01.945437+0000","last_clean":"2023-12-22T08:42:01.945437+0000","last_became_active":"2023-12-22T08:42:00.465286+0000","last_became_peered":"2023-12-22T08:42:00.465286+0000","last_unstale":"2023-12-22T08:42:01.945437+0000","last_undegraded":"2023-12-22T08:42:01.945437+0000","last_fullsized":"2023-12-22T08:42:01.945437+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:53:21.527490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945094+0000","last_change":"2023-12-22T08:42:00.966626+0000","last_active":"2023-12-22T08:42:01.945094+0000","last_peered":"2023-12-22T08:42:01.945094+0000","last_clean":"2023-12-22T08:42:01.945094+0000","last_became_active":"2023-12-22T08:42:00.966351+0000","last_became_peered":"2023-12-22T08:42:00.966351+0000","last_unstale":"2023-12-22T08:42:01.945094+0000","last_undegraded":"2023-12-22T08:42:01.945094+0000","last_fullsized":"2023-12-22T08:42:01.945094+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:10.653460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317624+0000","last_change":"2023-12-22T08:42:00.463431+0000","last_active":"2023-12-22T08:42:02.317624+0000","last_peered":"2023-12-22T08:42:02.317624+0000","last_clean":"2023-12-22T08:42:02.317624+0000","last_became_active":"2023-12-22T08:42:00.463135+0000","last_became_peered":"2023-12-22T08:42:00.463135+0000","last_unstale":"2023-12-22T08:42:02.317624+0000","last_undegraded":"2023-12-22T08:42:02.317624+0000","last_fullsized":"2023-12-22T08:42:02.317624+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:17:57.655160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031762+0000","last_change":"2023-12-22T08:42:00.959405+0000","last_active":"2023-12-22T08:42:03.031762+0000","last_peered":"2023-12-22T08:42:03.031762+0000","last_clean":"2023-12-22T08:42:03.031762+0000","last_became_active":"2023-12-22T08:42:00.958719+0000","last_became_peered":"2023-12-22T08:42:00.958719+0000","last_unstale":"2023-12-22T08:42:03.031762+0000","last_undegraded":"2023-12-22T08:42:03.031762+0000","last_fullsized":"2023-12-22T08:42:03.031762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:19:23.877328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945352+0000","last_change":"2023-12-22T08:42:00.454165+0000","last_active":"2023-12-22T08:42:01.945352+0000","last_peered":"2023-12-22T08:42:01.945352+0000","last_clean":"2023-12-22T08:42:01.945352+0000","last_became_active":"2023-12-22T08:42:00.453877+0000","last_became_peered":"2023-12-22T08:42:00.453877+0000","last_unstale":"2023-12-22T08:42:01.945352+0000","last_undegraded":"2023-12-22T08:42:01.945352+0000","last_fullsized":"2023-12-22T08:42:01.945352+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:35:47.703232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945750+0000","last_change":"2023-12-22T08:42:00.971066+0000","last_active":"2023-12-22T08:42:01.945750+0000","last_peered":"2023-12-22T08:42:01.945750+0000","last_clean":"2023-12-22T08:42:01.945750+0000","last_became_active":"2023-12-22T08:42:00.970493+0000","last_became_peered":"2023-12-22T08:42:00.970493+0000","last_unstale":"2023-12-22T08:42:01.945750+0000","last_undegraded":"2023-12-22T08:42:01.945750+0000","last_fullsized":"2023-12-22T08:42:01.945750+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:49:18.720718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317592+0000","last_change":"2023-12-22T08:42:00.460739+0000","last_active":"2023-12-22T08:42:02.317592+0000","last_peered":"2023-12-22T08:42:02.317592+0000","last_clean":"2023-12-22T08:42:02.317592+0000","last_became_active":"2023-12-22T08:42:00.452569+0000","last_became_peered":"2023-12-22T08:42:00.452569+0000","last_unstale":"2023-12-22T08:42:02.317592+0000","last_undegraded":"2023-12-22T08:42:02.317592+0000","last_fullsized":"2023-12-22T08:42:02.317592+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:07.613153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945211+0000","last_change":"2023-12-22T08:42:00.963722+0000","last_active":"2023-12-22T08:42:01.945211+0000","last_peered":"2023-12-22T08:42:01.945211+0000","last_clean":"2023-12-22T08:42:01.945211+0000","last_became_active":"2023-12-22T08:42:00.963347+0000","last_became_peered":"2023-12-22T08:42:00.963347+0000","last_unstale":"2023-12-22T08:42:01.945211+0000","last_undegraded":"2023-12-22T08:42:01.945211+0000","last_fullsized":"2023-12-22T08:42:01.945211+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:10:43.718978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857729+0000","last_change":"2023-12-22T08:42:00.467893+0000","last_active":"2023-12-22T08:42:02.857729+0000","last_peered":"2023-12-22T08:42:02.857729+0000","last_clean":"2023-12-22T08:42:02.857729+0000","last_became_active":"2023-12-22T08:42:00.467650+0000","last_became_peered":"2023-12-22T08:42:00.467650+0000","last_unstale":"2023-12-22T08:42:02.857729+0000","last_undegraded":"2023-12-22T08:42:02.857729+0000","last_fullsized":"2023-12-22T08:42:02.857729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:49:33.493365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857281+0000","last_change":"2023-12-22T08:42:00.952079+0000","last_active":"2023-12-22T08:42:02.857281+0000","last_peered":"2023-12-22T08:42:02.857281+0000","last_clean":"2023-12-22T08:42:02.857281+0000","last_became_active":"2023-12-22T08:42:00.951832+0000","last_became_peered":"2023-12-22T08:42:00.951832+0000","last_unstale":"2023-12-22T08:42:02.857281+0000","last_undegraded":"2023-12-22T08:42:02.857281+0000","last_fullsized":"2023-12-22T08:42:02.857281+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:29.861153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030731+0000","last_change":"2023-12-22T08:42:00.461731+0000","last_active":"2023-12-22T08:42:03.030731+0000","last_peered":"2023-12-22T08:42:03.030731+0000","last_clean":"2023-12-22T08:42:03.030731+0000","last_became_active":"2023-12-22T08:42:00.461358+0000","last_became_peered":"2023-12-22T08:42:00.461358+0000","last_unstale":"2023-12-22T08:42:03.030731+0000","last_undegraded":"2023-12-22T08:42:03.030731+0000","last_fullsized":"2023-12-22T08:42:03.030731+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:38.031039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.856722+0000","last_change":"2023-12-22T08:42:00.955473+0000","last_active":"2023-12-22T08:42:02.856722+0000","last_peered":"2023-12-22T08:42:02.856722+0000","last_clean":"2023-12-22T08:42:02.856722+0000","last_became_active":"2023-12-22T08:42:00.954809+0000","last_became_peered":"2023-12-22T08:42:00.954809+0000","last_unstale":"2023-12-22T08:42:02.856722+0000","last_undegraded":"2023-12-22T08:42:02.856722+0000","last_fullsized":"2023-12-22T08:42:02.856722+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:42.250079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858329+0000","last_change":"2023-12-22T08:42:00.457019+0000","last_active":"2023-12-22T08:42:02.858329+0000","last_peered":"2023-12-22T08:42:02.858329+0000","last_clean":"2023-12-22T08:42:02.858329+0000","last_became_active":"2023-12-22T08:42:00.456611+0000","last_became_peered":"2023-12-22T08:42:00.456611+0000","last_unstale":"2023-12-22T08:42:02.858329+0000","last_undegraded":"2023-12-22T08:42:02.858329+0000","last_fullsized":"2023-12-22T08:42:02.858329+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:09.638955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.947289+0000","last_change":"2023-12-22T08:42:00.969539+0000","last_active":"2023-12-22T08:42:01.947289+0000","last_peered":"2023-12-22T08:42:01.947289+0000","last_clean":"2023-12-22T08:42:01.947289+0000","last_became_active":"2023-12-22T08:42:00.967430+0000","last_became_peered":"2023-12-22T08:42:00.967430+0000","last_unstale":"2023-12-22T08:42:01.947289+0000","last_undegraded":"2023-12-22T08:42:01.947289+0000","last_fullsized":"2023-12-22T08:42:01.947289+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:48.789053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":19,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317178+0000","last_change":"2023-12-22T08:42:00.462811+0000","last_active":"2023-12-22T08:42:02.317178+0000","last_peered":"2023-12-22T08:42:02.317178+0000","last_clean":"2023-12-22T08:42:02.317178+0000","last_became_active":"2023-12-22T08:42:00.461934+0000","last_became_peered":"2023-12-22T08:42:00.461934+0000","last_unstale":"2023-12-22T08:42:02.317178+0000","last_undegraded":"2023-12-22T08:42:02.317178+0000","last_fullsized":"2023-12-22T08:42:02.317178+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:47.774548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857513+0000","last_change":"2023-12-22T08:42:00.957685+0000","last_active":"2023-12-22T08:42:02.857513+0000","last_peered":"2023-12-22T08:42:02.857513+0000","last_clean":"2023-12-22T08:42:02.857513+0000","last_became_active":"2023-12-22T08:42:00.957456+0000","last_became_peered":"2023-12-22T08:42:00.957456+0000","last_unstale":"2023-12-22T08:42:02.857513+0000","last_undegraded":"2023-12-22T08:42:02.857513+0000","last_fullsized":"2023-12-22T08:42:02.857513+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:10.653460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031994+0000","last_change":"2023-12-22T08:42:00.453359+0000","last_active":"2023-12-22T08:42:03.031994+0000","last_peered":"2023-12-22T08:42:03.031994+0000","last_clean":"2023-12-22T08:42:03.031994+0000","last_became_active":"2023-12-22T08:42:00.452634+0000","last_became_peered":"2023-12-22T08:42:00.452634+0000","last_unstale":"2023-12-22T08:42:03.031994+0000","last_undegraded":"2023-12-22T08:42:03.031994+0000","last_fullsized":"2023-12-22T08:42:03.031994+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:25:12.295524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.856877+0000","last_change":"2023-12-22T08:42:00.955109+0000","last_active":"2023-12-22T08:42:02.856877+0000","last_peered":"2023-12-22T08:42:02.856877+0000","last_clean":"2023-12-22T08:42:02.856877+0000","last_became_active":"2023-12-22T08:42:00.954638+0000","last_became_peered":"2023-12-22T08:42:00.954638+0000","last_unstale":"2023-12-22T08:42:02.856877+0000","last_undegraded":"2023-12-22T08:42:02.856877+0000","last_fullsized":"2023-12-22T08:42:02.856877+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:10:43.718978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945536+0000","last_change":"2023-12-22T08:42:00.467620+0000","last_active":"2023-12-22T08:42:01.945536+0000","last_peered":"2023-12-22T08:42:01.945536+0000","last_clean":"2023-12-22T08:42:01.945536+0000","last_became_active":"2023-12-22T08:42:00.467426+0000","last_became_peered":"2023-12-22T08:42:00.467426+0000","last_unstale":"2023-12-22T08:42:01.945536+0000","last_undegraded":"2023-12-22T08:42:01.945536+0000","last_fullsized":"2023-12-22T08:42:01.945536+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:31:21.211442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.947538+0000","last_change":"2023-12-22T08:42:00.969869+0000","last_active":"2023-12-22T08:42:01.947538+0000","last_peered":"2023-12-22T08:42:01.947538+0000","last_clean":"2023-12-22T08:42:01.947538+0000","last_became_active":"2023-12-22T08:42:00.969277+0000","last_became_peered":"2023-12-22T08:42:00.969277+0000","last_unstale":"2023-12-22T08:42:01.947538+0000","last_undegraded":"2023-12-22T08:42:01.947538+0000","last_fullsized":"2023-12-22T08:42:01.947538+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:27.697741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945549+0000","last_change":"2023-12-22T08:42:00.465923+0000","last_active":"2023-12-22T08:42:01.945549+0000","last_peered":"2023-12-22T08:42:01.945549+0000","last_clean":"2023-12-22T08:42:01.945549+0000","last_became_active":"2023-12-22T08:42:00.465755+0000","last_became_peered":"2023-12-22T08:42:00.465755+0000","last_unstale":"2023-12-22T08:42:01.945549+0000","last_undegraded":"2023-12-22T08:42:01.945549+0000","last_fullsized":"2023-12-22T08:42:01.945549+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:09:27.754470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945324+0000","last_change":"2023-12-22T08:42:00.959846+0000","last_active":"2023-12-22T08:42:01.945324+0000","last_peered":"2023-12-22T08:42:01.945324+0000","last_clean":"2023-12-22T08:42:01.945324+0000","last_became_active":"2023-12-22T08:42:00.959105+0000","last_became_peered":"2023-12-22T08:42:00.959105+0000","last_unstale":"2023-12-22T08:42:01.945324+0000","last_undegraded":"2023-12-22T08:42:01.945324+0000","last_fullsized":"2023-12-22T08:42:01.945324+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:42.250079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858518+0000","last_change":"2023-12-22T08:42:00.456873+0000","last_active":"2023-12-22T08:42:02.858518+0000","last_peered":"2023-12-22T08:42:02.858518+0000","last_clean":"2023-12-22T08:42:02.858518+0000","last_became_active":"2023-12-22T08:42:00.456242+0000","last_became_peered":"2023-12-22T08:42:00.456242+0000","last_unstale":"2023-12-22T08:42:02.858518+0000","last_undegraded":"2023-12-22T08:42:02.858518+0000","last_fullsized":"2023-12-22T08:42:02.858518+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:50.145111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317258+0000","last_change":"2023-12-22T08:42:00.972487+0000","last_active":"2023-12-22T08:42:02.317258+0000","last_peered":"2023-12-22T08:42:02.317258+0000","last_clean":"2023-12-22T08:42:02.317258+0000","last_became_active":"2023-12-22T08:42:00.972259+0000","last_became_peered":"2023-12-22T08:42:00.972259+0000","last_unstale":"2023-12-22T08:42:02.317258+0000","last_undegraded":"2023-12-22T08:42:02.317258+0000","last_fullsized":"2023-12-22T08:42:02.317258+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:34:59.089610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317444+0000","last_change":"2023-12-22T08:42:00.463010+0000","last_active":"2023-12-22T08:42:02.317444+0000","last_peered":"2023-12-22T08:42:02.317444+0000","last_clean":"2023-12-22T08:42:02.317444+0000","last_became_active":"2023-12-22T08:42:00.462514+0000","last_became_peered":"2023-12-22T08:42:00.462514+0000","last_unstale":"2023-12-22T08:42:02.317444+0000","last_undegraded":"2023-12-22T08:42:02.317444+0000","last_fullsized":"2023-12-22T08:42:02.317444+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:31.927548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858094+0000","last_change":"2023-12-22T08:42:00.973668+0000","last_active":"2023-12-22T08:42:02.858094+0000","last_peered":"2023-12-22T08:42:02.858094+0000","last_clean":"2023-12-22T08:42:02.858094+0000","last_became_active":"2023-12-22T08:42:00.970441+0000","last_became_peered":"2023-12-22T08:42:00.970441+0000","last_unstale":"2023-12-22T08:42:02.858094+0000","last_undegraded":"2023-12-22T08:42:02.858094+0000","last_fullsized":"2023-12-22T08:42:02.858094+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:50.399111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030363+0000","last_change":"2023-12-22T08:42:00.460226+0000","last_active":"2023-12-22T08:42:03.030363+0000","last_peered":"2023-12-22T08:42:03.030363+0000","last_clean":"2023-12-22T08:42:03.030363+0000","last_became_active":"2023-12-22T08:42:00.459621+0000","last_became_peered":"2023-12-22T08:42:00.459621+0000","last_unstale":"2023-12-22T08:42:03.030363+0000","last_undegraded":"2023-12-22T08:42:03.030363+0000","last_fullsized":"2023-12-22T08:42:03.030363+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:18:27.880824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.032303+0000","last_change":"2023-12-22T08:42:00.960870+0000","last_active":"2023-12-22T08:42:03.032303+0000","last_peered":"2023-12-22T08:42:03.032303+0000","last_clean":"2023-12-22T08:42:03.032303+0000","last_became_active":"2023-12-22T08:42:00.960617+0000","last_became_peered":"2023-12-22T08:42:00.960617+0000","last_unstale":"2023-12-22T08:42:03.032303+0000","last_undegraded":"2023-12-22T08:42:03.032303+0000","last_fullsized":"2023-12-22T08:42:03.032303+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:13.650363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317951+0000","last_change":"2023-12-22T08:42:00.469175+0000","last_active":"2023-12-22T08:42:02.317951+0000","last_peered":"2023-12-22T08:42:02.317951+0000","last_clean":"2023-12-22T08:42:02.317951+0000","last_became_active":"2023-12-22T08:42:00.465274+0000","last_became_peered":"2023-12-22T08:42:00.465274+0000","last_unstale":"2023-12-22T08:42:02.317951+0000","last_undegraded":"2023-12-22T08:42:02.317951+0000","last_fullsized":"2023-12-22T08:42:02.317951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:13.693173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031774+0000","last_change":"2023-12-22T08:42:00.971776+0000","last_active":"2023-12-22T08:42:03.031774+0000","last_peered":"2023-12-22T08:42:03.031774+0000","last_clean":"2023-12-22T08:42:03.031774+0000","last_became_active":"2023-12-22T08:42:00.971550+0000","last_became_peered":"2023-12-22T08:42:00.971550+0000","last_unstale":"2023-12-22T08:42:03.031774+0000","last_undegraded":"2023-12-22T08:42:03.031774+0000","last_fullsized":"2023-12-22T08:42:03.031774+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:34:59.089610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946962+0000","last_change":"2023-12-22T08:42:00.462513+0000","last_active":"2023-12-22T08:42:01.946962+0000","last_peered":"2023-12-22T08:42:01.946962+0000","last_clean":"2023-12-22T08:42:01.946962+0000","last_became_active":"2023-12-22T08:42:00.462281+0000","last_became_peered":"2023-12-22T08:42:00.462281+0000","last_unstale":"2023-12-22T08:42:01.946962+0000","last_undegraded":"2023-12-22T08:42:01.946962+0000","last_fullsized":"2023-12-22T08:42:01.946962+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:12.635858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946059+0000","last_change":"2023-12-22T08:42:00.968564+0000","last_active":"2023-12-22T08:42:01.946059+0000","last_peered":"2023-12-22T08:42:01.946059+0000","last_clean":"2023-12-22T08:42:01.946059+0000","last_became_active":"2023-12-22T08:42:00.968310+0000","last_became_peered":"2023-12-22T08:42:00.968310+0000","last_unstale":"2023-12-22T08:42:01.946059+0000","last_undegraded":"2023-12-22T08:42:01.946059+0000","last_fullsized":"2023-12-22T08:42:01.946059+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:16:12.276406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031965+0000","last_change":"2023-12-22T08:42:00.466452+0000","last_active":"2023-12-22T08:42:03.031965+0000","last_peered":"2023-12-22T08:42:03.031965+0000","last_clean":"2023-12-22T08:42:03.031965+0000","last_became_active":"2023-12-22T08:42:00.466247+0000","last_became_peered":"2023-12-22T08:42:00.466247+0000","last_unstale":"2023-12-22T08:42:03.031965+0000","last_undegraded":"2023-12-22T08:42:03.031965+0000","last_fullsized":"2023-12-22T08:42:03.031965+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:38.031039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317632+0000","last_change":"2023-12-22T08:42:00.961864+0000","last_active":"2023-12-22T08:42:02.317632+0000","last_peered":"2023-12-22T08:42:02.317632+0000","last_clean":"2023-12-22T08:42:02.317632+0000","last_became_active":"2023-12-22T08:42:00.960926+0000","last_became_peered":"2023-12-22T08:42:00.960926+0000","last_unstale":"2023-12-22T08:42:02.317632+0000","last_undegraded":"2023-12-22T08:42:02.317632+0000","last_fullsized":"2023-12-22T08:42:02.317632+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:19:23.877328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030613+0000","last_change":"2023-12-22T08:42:00.459898+0000","last_active":"2023-12-22T08:42:03.030613+0000","last_peered":"2023-12-22T08:42:03.030613+0000","last_clean":"2023-12-22T08:42:03.030613+0000","last_became_active":"2023-12-22T08:42:00.459266+0000","last_became_peered":"2023-12-22T08:42:00.459266+0000","last_unstale":"2023-12-22T08:42:03.030613+0000","last_undegraded":"2023-12-22T08:42:03.030613+0000","last_fullsized":"2023-12-22T08:42:03.030613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:25:12.295524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945349+0000","last_change":"2023-12-22T08:42:00.969733+0000","last_active":"2023-12-22T08:42:01.945349+0000","last_peered":"2023-12-22T08:42:01.945349+0000","last_clean":"2023-12-22T08:42:01.945349+0000","last_became_active":"2023-12-22T08:42:00.969302+0000","last_became_peered":"2023-12-22T08:42:00.969302+0000","last_unstale":"2023-12-22T08:42:01.945349+0000","last_undegraded":"2023-12-22T08:42:01.945349+0000","last_fullsized":"2023-12-22T08:42:01.945349+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:51:25.572124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857926+0000","last_change":"2023-12-22T08:42:00.466131+0000","last_active":"2023-12-22T08:42:02.857926+0000","last_peered":"2023-12-22T08:42:02.857926+0000","last_clean":"2023-12-22T08:42:02.857926+0000","last_became_active":"2023-12-22T08:42:00.465733+0000","last_became_peered":"2023-12-22T08:42:00.465733+0000","last_unstale":"2023-12-22T08:42:02.857926+0000","last_undegraded":"2023-12-22T08:42:02.857926+0000","last_fullsized":"2023-12-22T08:42:02.857926+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:02:55.033830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317314+0000","last_change":"2023-12-22T08:42:00.970683+0000","last_active":"2023-12-22T08:42:02.317314+0000","last_peered":"2023-12-22T08:42:02.317314+0000","last_clean":"2023-12-22T08:42:02.317314+0000","last_became_active":"2023-12-22T08:42:00.969879+0000","last_became_peered":"2023-12-22T08:42:00.969879+0000","last_unstale":"2023-12-22T08:42:02.317314+0000","last_undegraded":"2023-12-22T08:42:02.317314+0000","last_fullsized":"2023-12-22T08:42:02.317314+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:13.650363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030863+0000","last_change":"2023-12-22T08:42:00.457271+0000","last_active":"2023-12-22T08:42:03.030863+0000","last_peered":"2023-12-22T08:42:03.030863+0000","last_clean":"2023-12-22T08:42:03.030863+0000","last_became_active":"2023-12-22T08:42:00.457022+0000","last_became_peered":"2023-12-22T08:42:00.457022+0000","last_unstale":"2023-12-22T08:42:03.030863+0000","last_undegraded":"2023-12-22T08:42:03.030863+0000","last_fullsized":"2023-12-22T08:42:03.030863+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:50.548955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.032417+0000","last_change":"2023-12-22T08:42:00.962279+0000","last_active":"2023-12-22T08:42:03.032417+0000","last_peered":"2023-12-22T08:42:03.032417+0000","last_clean":"2023-12-22T08:42:03.032417+0000","last_became_active":"2023-12-22T08:42:00.962035+0000","last_became_peered":"2023-12-22T08:42:00.962035+0000","last_unstale":"2023-12-22T08:42:03.032417+0000","last_undegraded":"2023-12-22T08:42:03.032417+0000","last_fullsized":"2023-12-22T08:42:03.032417+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:35:47.196465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.947535+0000","last_change":"2023-12-22T08:42:00.464884+0000","last_active":"2023-12-22T08:42:01.947535+0000","last_peered":"2023-12-22T08:42:01.947535+0000","last_clean":"2023-12-22T08:42:01.947535+0000","last_became_active":"2023-12-22T08:42:00.464662+0000","last_became_peered":"2023-12-22T08:42:00.464662+0000","last_unstale":"2023-12-22T08:42:01.947535+0000","last_undegraded":"2023-12-22T08:42:01.947535+0000","last_fullsized":"2023-12-22T08:42:01.947535+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:11:09.975719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945861+0000","last_change":"2023-12-22T08:42:00.961166+0000","last_active":"2023-12-22T08:42:01.945861+0000","last_peered":"2023-12-22T08:42:01.945861+0000","last_clean":"2023-12-22T08:42:01.945861+0000","last_became_active":"2023-12-22T08:42:00.960854+0000","last_became_peered":"2023-12-22T08:42:00.960854+0000","last_unstale":"2023-12-22T08:42:01.945861+0000","last_undegraded":"2023-12-22T08:42:01.945861+0000","last_fullsized":"2023-12-22T08:42:01.945861+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:26:00.298884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858523+0000","last_change":"2023-12-22T08:42:00.460482+0000","last_active":"2023-12-22T08:42:02.858523+0000","last_peered":"2023-12-22T08:42:02.858523+0000","last_clean":"2023-12-22T08:42:02.858523+0000","last_became_active":"2023-12-22T08:42:00.459346+0000","last_became_peered":"2023-12-22T08:42:00.459346+0000","last_unstale":"2023-12-22T08:42:02.858523+0000","last_undegraded":"2023-12-22T08:42:02.858523+0000","last_fullsized":"2023-12-22T08:42:02.858523+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:25:59.284379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945237+0000","last_change":"2023-12-22T08:42:00.956873+0000","last_active":"2023-12-22T08:42:01.945237+0000","last_peered":"2023-12-22T08:42:01.945237+0000","last_clean":"2023-12-22T08:42:01.945237+0000","last_became_active":"2023-12-22T08:42:00.956517+0000","last_became_peered":"2023-12-22T08:42:00.956517+0000","last_unstale":"2023-12-22T08:42:01.945237+0000","last_undegraded":"2023-12-22T08:42:01.945237+0000","last_fullsized":"2023-12-22T08:42:01.945237+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:35:47.196465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857110+0000","last_change":"2023-12-22T08:42:00.469313+0000","last_active":"2023-12-22T08:42:02.857110+0000","last_peered":"2023-12-22T08:42:02.857110+0000","last_clean":"2023-12-22T08:42:02.857110+0000","last_became_active":"2023-12-22T08:42:00.469106+0000","last_became_peered":"2023-12-22T08:42:00.469106+0000","last_unstale":"2023-12-22T08:42:02.857110+0000","last_undegraded":"2023-12-22T08:42:02.857110+0000","last_fullsized":"2023-12-22T08:42:02.857110+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:24:26.917050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031601+0000","last_change":"2023-12-22T08:42:00.968645+0000","last_active":"2023-12-22T08:42:03.031601+0000","last_peered":"2023-12-22T08:42:03.031601+0000","last_clean":"2023-12-22T08:42:03.031601+0000","last_became_active":"2023-12-22T08:42:00.968397+0000","last_became_peered":"2023-12-22T08:42:00.968397+0000","last_unstale":"2023-12-22T08:42:03.031601+0000","last_undegraded":"2023-12-22T08:42:03.031601+0000","last_fullsized":"2023-12-22T08:42:03.031601+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:48.789053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.947414+0000","last_change":"2023-12-22T08:42:00.460810+0000","last_active":"2023-12-22T08:42:01.947414+0000","last_peered":"2023-12-22T08:42:01.947414+0000","last_clean":"2023-12-22T08:42:01.947414+0000","last_became_active":"2023-12-22T08:42:00.460559+0000","last_became_peered":"2023-12-22T08:42:00.460559+0000","last_unstale":"2023-12-22T08:42:01.947414+0000","last_undegraded":"2023-12-22T08:42:01.947414+0000","last_fullsized":"2023-12-22T08:42:01.947414+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:31:06.938160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T08:42:00.949892+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:42:00.949892+0000","last_peered":"2023-12-22T08:42:00.949892+0000","last_clean":"2023-12-22T08:42:00.949892+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:42:00.949892+0000","last_undegraded":"2023-12-22T08:42:00.949892+0000","last_fullsized":"2023-12-22T08:42:00.949892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0780000000000001,"15min":1.079},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.466,"5min":1.506,"15min":1.506},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.127,"5min":1.0660000000000001,"15min":1.056},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.51,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.92400000000000004}]},{"osd":1,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.165,"15min":1.155},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.905},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1319999999999999,"15min":1.1220000000000001},"min":{"1min":0.86499999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.472,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.865}]},{"osd":2,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0620000000000001,"15min":1.048},"min":{"1min":0.745,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5629999999999999,"5min":1.716,"15min":1.716},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.232,"15min":1.23},"min":{"1min":0.89800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.677,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.742}]},{"osd":3,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.0960000000000001,"15min":1.0800000000000001},"min":{"1min":0.81100000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.2729999999999999,"15min":1.2709999999999999},"min":{"1min":0.874,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6839999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.8240000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.198,"15min":1.196},"min":{"1min":0.86599999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5569999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.48},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2669999999999999,"15min":1.2629999999999999},"min":{"1min":0.90200000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.649,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.5780000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.3819999999999999,"15min":1.3700000000000001},"min":{"1min":1.2030000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.835,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.411},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3740000000000001,"15min":1.3720000000000001},"min":{"1min":0.80800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.635,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.645}]},{"osd":6,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.4930000000000001,"15min":1.4870000000000001},"min":{"1min":1.2390000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7450000000000001,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":2.1259999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.488,"15min":1.484},"min":{"1min":1.0069999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.893,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.7849999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767308,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.1040000000000001,"15min":1.127},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2649999999999999,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.996,"5min":1.0640000000000001,"15min":1.075},"min":{"1min":0.73899999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.1719999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0209999999999999,"15min":1.0129999999999999},"min":{"1min":0.72899999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.4830000000000001,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1539999999999999,"15min":1.1579999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.1160000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.26,"15min":1.274},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5449999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.258},{"interface":"front","average":{"1min":1.202,"5min":1.147,"15min":1.1379999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.5089999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2929999999999999,"15min":1.2909999999999999},"min":{"1min":1.0669999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.6379999999999999,"5min":1.847,"15min":1.847},"last":1.645},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.228,"15min":1.226},"min":{"1min":0.84899999999999998,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.077}]},{"osd":4,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3919999999999999,"15min":1.4079999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.8600000000000001,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.421},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3959999999999999,"15min":1.401},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.744,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.7430000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.353,"15min":1.361},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.302},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.5740000000000001,"15min":1.599},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.0030000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.6890000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.587,"15min":1.593},"min":{"1min":1.2869999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":1.9870000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.8660000000000001},{"interface":"front","average":{"1min":1.492,"5min":1.5509999999999999,"15min":1.5609999999999999},"min":{"1min":1.101,"5min":1.101,"15min":1.101},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.589}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194516,"statfs":{"total":200000000,"available":199184853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0629999999999999,"15min":1.071},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.135},{"interface":"front","average":{"1min":1.113,"5min":1.1359999999999999,"15min":1.1399999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.2690000000000001,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.1799999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.72499999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.3129999999999999,"5min":2.79,"15min":2.79},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.006,"15min":1.004},"min":{"1min":0.69099999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.379,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.97699999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.1299999999999999,"15min":1.1259999999999999},"min":{"1min":0.84499999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.6279999999999999,"5min":1.72,"15min":1.72},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.151,"15min":1.155},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5269999999999999,"5min":1.978,"15min":1.978},"last":0.78200000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1599999999999999,"15min":1.155},"min":{"1min":0.85099999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2270000000000001,"15min":1.2310000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.0329999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2430000000000001,"15min":1.2470000000000001},"min":{"1min":0.90600000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.262,"15min":1.2549999999999999},"min":{"1min":0.87,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5229999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.095}]},{"osd":6,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3120000000000001,"15min":1.3109999999999999},"min":{"1min":0.92200000000000004,"5min":0.749,"15min":0.749},"max":{"1min":1.5369999999999999,"5min":1.821,"15min":1.821},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.411,"5min":1.4259999999999999,"15min":1.4279999999999999},"min":{"1min":1.1319999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.7609999999999999,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.5629999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3660000000000001,"15min":1.365},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.671,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.506},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.577,"15min":1.587},"min":{"1min":1.2649999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.3610000000000002,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":1.405}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":228,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766268,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.002,"15min":1.0049999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.284,"5min":1.552,"15min":1.552},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.0980000000000001,"15min":1.091},"min":{"1min":0.69099999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.72499999999999998}]},{"osd":1,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0289999999999999,"15min":1.0249999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5149999999999999,"5min":1.669,"15min":1.669},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.107,"15min":1.1080000000000001},"min":{"1min":0.74099999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4179999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.794}]},{"osd":2,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1399999999999999,"15min":1.1379999999999999},"min":{"1min":0.82899999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5700000000000001,"5min":1.625,"15min":1.625},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.1870000000000001,"15min":1.1899999999999999},"min":{"1min":0.86199999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.528,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.236}]},{"osd":3,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.196,"15min":1.1899999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5669999999999999,"5min":1.774,"15min":1.774},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.1919999999999999,"15min":1.1839999999999999},"min":{"1min":0.88200000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.587,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.8280000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1319999999999999,"15min":1.121},"min":{"1min":0.82599999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.3},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.375,"15min":1.367},"min":{"1min":1.133,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7849999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.3620000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2250000000000001,"15min":1.218},"min":{"1min":1.0229999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.498,"5min":1.798,"15min":1.798},"last":1.131},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.1910000000000001,"15min":1.1739999999999999},"min":{"1min":0.96899999999999997,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.4339999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.333,"15min":1.3120000000000001},"min":{"1min":1.0720000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.675,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.593},{"interface":"front","average":{"1min":1.454,"5min":1.4019999999999999,"15min":1.3939999999999999},"min":{"1min":1.2030000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.7829999999999999,"5min":1.923,"15min":1.923},"last":1.9199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":228,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766360,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.93600000000000005,"15min":0.96699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.90700000000000003,"15min":0.92800000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.294,"5min":1.429,"15min":1.429},"last":1.355}]},{"osd":1,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.84199999999999997,"15min":0.85299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.109,"5min":1.29,"15min":1.29},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0820000000000001,"15min":1.1020000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.091}]},{"osd":2,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.022,"15min":1.032},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5289999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.107,"15min":1.115},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.997}]},{"osd":4,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1859999999999999,"15min":1.1919999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7470000000000001,"5min":1.895,"15min":1.895},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.204,"15min":1.212},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.97199999999999998}]},{"osd":5,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.242,"15min":1.25},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.621,"5min":1.804,"15min":1.804},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.234,"5min":1.413,"15min":1.4430000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6599999999999999,"5min":1.966,"15min":1.966},"last":1.1479999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.417,"15min":1.4370000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7310000000000001,"5min":1.925,"15min":1.925},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.365,"15min":1.3819999999999999},"min":{"1min":0.94899999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.665,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.4179999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.339,"15min":1.357},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.47},{"interface":"front","average":{"1min":1.302,"5min":1.3680000000000001,"15min":1.379},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.6060000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.0349999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767834,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.73099999999999998,"15min":0.70599999999999996},"min":{"1min":0.64100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":6.8879999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.91600000000000004,"15min":0.93000000000000005},"min":{"1min":0.46000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.1619999999999999,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":4.5510000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.90400000000000003,"15min":0.89900000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.504,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":11.308999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89900000000000002,"15min":0.88800000000000001},"min":{"1min":0.58099999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.4650000000000001,"5min":2.226,"15min":2.226},"last":2.4910000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":0.97199999999999998,"15min":0.95899999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.633,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":13.087999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.0349999999999999,"15min":1.008},"min":{"1min":0.754,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.7649999999999999,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":12.289999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.226,"15min":1.204},"min":{"1min":0.91900000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.667,"5min":1.919,"15min":1.919},"last":3.5089999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.3100000000000001,"15min":1.3260000000000001},"min":{"1min":0.623,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5840000000000001,"5min":5.4560000000000004,"15min":5.4560000000000004},"last":13.927}]},{"osd":5,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.78600000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7,"5min":5.569,"15min":5.569},"last":11.003},{"interface":"front","average":{"1min":1.252,"5min":1.21,"15min":1.2030000000000001},"min":{"1min":0.83699999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.7170000000000001,"5min":3.04,"15min":3.04},"last":13.129}]},{"osd":6,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.24,"15min":1.22},"min":{"1min":0.86599999999999999,"5min":0.751,"15min":0.751},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":8.1609999999999996},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3320000000000001,"15min":1.321},"min":{"1min":1.046,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.873,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":6.8150000000000004}]},{"osd":7,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3520000000000001,"15min":1.3480000000000001},"min":{"1min":0.91500000000000004,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.802,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":10.948},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3029999999999999,"15min":1.29},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7789999999999999,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":8.0980000000000008}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":803,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177486,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.88500000000000001,"15min":0.89500000000000002},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.143,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.034},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.98599999999999999,"15min":0.997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.4259999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.2330000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.93300000000000005,"15min":0.94299999999999995},"min":{"1min":0.55900000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.298,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.93400000000000005,"15min":0.93700000000000006},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.5580000000000001,"5min":2.254,"15min":2.254},"last":0.91900000000000004}]},{"osd":3,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6120000000000001,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.3100000000000001},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.94399999999999995,"15min":0.95799999999999996},"min":{"1min":0.51900000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3460000000000001,"5min":1.766,"15min":1.766},"last":0.85099999999999998}]},{"osd":4,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.2549999999999999,"15min":1.268},"min":{"1min":0.878,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.589,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.395},{"interface":"front","average":{"1min":1.351,"5min":1.3109999999999999,"15min":1.3049999999999999},"min":{"1min":0.91800000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.9019999999999999,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.3640000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.71599999999999997,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.645,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.302,"15min":1.3120000000000001},"min":{"1min":0.873,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4650000000000001,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.5920000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2390000000000001,"15min":1.24},"min":{"1min":0.84499999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.853,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.171},{"interface":"front","average":{"1min":1.306,"5min":1.3460000000000001,"15min":1.353},"min":{"1min":0.72299999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.746,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.502}]},{"osd":7,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.353,"15min":1.339},"min":{"1min":0.76900000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.02,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.371,"15min":1.397},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.974,"5min":3.2959999999999998,"15min":3.2959999999999998},"last":1.343}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70899999999999996},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.95299999999999996,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.435},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.878,"15min":0.89000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.367,"5min":1.391,"15min":1.391},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.998,"15min":0.998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0329999999999999,"15min":1.0229999999999999},"min":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.72599999999999998}]},{"osd":4,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.2490000000000001,"15min":1.25},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6379999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.024},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2,"15min":1.1899999999999999},"min":{"1min":0.98499999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.593,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.01}]},{"osd":5,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.246,"15min":1.2470000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.90600000000000003}]},{"osd":6,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2609999999999999,"15min":1.2589999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.76,"5min":1.863,"15min":1.863},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.7230000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.0409999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3400000000000001,"15min":1.3480000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.673,"5min":1.79,"15min":1.79},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3580000000000001,"15min":1.3600000000000001},"min":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.9850000000000001,"5min":2.214,"15min":2.214},"last":0.749}]}]}],"pool_statfs":[]}} 2023-12-22T08:42:05.435 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:42:05.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.701+0000 7f0a5dd0c640 1 Processor -- start 2023-12-22T08:42:05.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.701+0000 7f0a5dd0c640 1 -- start start 2023-12-22T08:42:05.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.703+0000 7f0a5dd0c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0a580b3ff0 0x7f0a5806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.703+0000 7f0a5dd0c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a580b44a0 0x7f0a5806d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.703+0000 7f0a5dd0c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5815f220 con 0x7f0a58157980 2023-12-22T08:42:05.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.703+0000 7f0a5dd0c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a580d1520 con 0x7f0a580b3ff0 2023-12-22T08:42:05.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.703+0000 7f0a5dd0c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580d1800 con 0x7f0a580b44a0 2023-12-22T08:42:05.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.703+0000 7f0a57fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0a580b3ff0 0x7f0a5806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.704+0000 7f0a5d50b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a580b44a0 0x7f0a5806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.704+0000 7f0a57fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0a580b3ff0 0x7f0a5806cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:41926/0 (socket says 172.21.15.38:41926) 2023-12-22T08:42:05.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.704+0000 7f0a57fff640 1 -- 172.21.15.38:0/1995176255 learned_addr learned my addr 172.21.15.38:0/1995176255 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:05.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.704+0000 7f0a5d50b640 1 -- 172.21.15.38:0/1995176255 >> v2:172.21.15.89:3300/0 conn(0x7f0a580b3ff0 msgr2=0x7f0a5806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:05.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.704+0000 7f0a5d50b640 1 --2- 172.21.15.38:0/1995176255 >> v2:172.21.15.89:3300/0 conn(0x7f0a580b3ff0 0x7f0a5806cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.704+0000 7f0a5d50b640 1 -- 172.21.15.38:0/1995176255 >> v1:172.21.15.89:6789/0 conn(0x7f0a58157980 legacy=0x7f0a5815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.704+0000 7f0a5d50b640 1 -- 172.21.15.38:0/1995176255 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a580d1ae0 con 0x7f0a580b44a0 2023-12-22T08:42:05.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.706+0000 7f0a5d50b640 1 --2- 172.21.15.38:0/1995176255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a580b44a0 0x7f0a5806d470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009d90 tx=0x7f0a5002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cea93e9a5814805 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:05.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.706+0000 7f0a577fe640 1 -- 172.21.15.38:0/1995176255 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5002cc50 con 0x7f0a580b44a0 2023-12-22T08:42:05.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.706+0000 7f0a577fe640 1 -- 172.21.15.38:0/1995176255 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5002cdb0 con 0x7f0a580b44a0 2023-12-22T08:42:05.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.706+0000 7f0a577fe640 1 -- 172.21.15.38:0/1995176255 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50034660 con 0x7f0a580b44a0 2023-12-22T08:42:05.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.707+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1995176255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a580b44a0 msgr2=0x7f0a5806d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.707+0000 7f0a5dd0c640 1 --2- 172.21.15.38:0/1995176255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a580b44a0 0x7f0a5806d470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009d90 tx=0x7f0a5002bea0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.707+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1995176255 shutdown_connections 2023-12-22T08:42:05.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.707+0000 7f0a5dd0c640 1 --2- 172.21.15.38:0/1995176255 >> v2:172.21.15.89:3300/0 conn(0x7f0a580b3ff0 0x7f0a5806cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.707+0000 7f0a5dd0c640 1 --2- 172.21.15.38:0/1995176255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a580b44a0 0x7f0a5806d470 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.707+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1995176255 >> 172.21.15.38:0/1995176255 conn(0x7f0a580d31f0 msgr2=0x7f0a580d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:05.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.707+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1995176255 shutdown_connections 2023-12-22T08:42:05.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.707+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1995176255 wait complete. 2023-12-22T08:42:05.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.710+0000 7f0a5dd0c640 1 Processor -- start 2023-12-22T08:42:05.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.710+0000 7f0a5dd0c640 1 -- start start 2023-12-22T08:42:05.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.711+0000 7f0a5dd0c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a580b3ff0 0x7f0a5814aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.711+0000 7f0a5dd0c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a580b44a0 0x7f0a5814e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.711+0000 7f0a5dd0c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a58157980 0x7f0a5814be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.711+0000 7f0a5dd0c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5814ba30 con 0x7f0a580b3ff0 2023-12-22T08:42:05.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.711+0000 7f0a5dd0c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5814b3f0 con 0x7f0a580b44a0 2023-12-22T08:42:05.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.711+0000 7f0a5dd0c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5814f460 con 0x7f0a58157980 2023-12-22T08:42:05.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.712+0000 7f0a5cd0a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a580b3ff0 0x7f0a5814aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.712+0000 7f0a5cd0a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a580b3ff0 0x7f0a5814aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57838/0 (socket says 172.21.15.38:57838) 2023-12-22T08:42:05.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.712+0000 7f0a5cd0a640 1 -- 172.21.15.38:0/1419647635 learned_addr learned my addr 172.21.15.38:0/1419647635 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:05.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.712+0000 7f0a57fff640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a580b44a0 0x7f0a5814e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.712+0000 7f0a5d50b640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a58157980 0x7f0a5814be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.712+0000 7f0a5cd0a640 1 -- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a58157980 msgr2=0x7f0a5814be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.712+0000 7f0a5cd0a640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a58157980 0x7f0a5814be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.712+0000 7f0a5cd0a640 1 -- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a580b44a0 msgr2=0x7f0a5814e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.712+0000 7f0a5cd0a640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a580b44a0 0x7f0a5814e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.712+0000 7f0a5cd0a640 1 -- 172.21.15.38:0/1419647635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a50009a70 con 0x7f0a580b3ff0 2023-12-22T08:42:05.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.712+0000 7f0a5d50b640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a58157980 0x7f0a5814be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:42:05.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.713+0000 7f0a5cd0a640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a580b3ff0 0x7f0a5814aeb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00c450 tx=0x7f0a4c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:05.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.713+0000 7f0a557fa640 1 -- 172.21.15.38:0/1419647635 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c0052d0 con 0x7f0a580b3ff0 2023-12-22T08:42:05.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.713+0000 7f0a557fa640 1 -- 172.21.15.38:0/1419647635 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c005430 con 0x7f0a580b3ff0 2023-12-22T08:42:05.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.713+0000 7f0a557fa640 1 -- 172.21.15.38:0/1419647635 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c012870 con 0x7f0a580b3ff0 2023-12-22T08:42:05.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.713+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1419647635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5814eea0 con 0x7f0a580b3ff0 2023-12-22T08:42:05.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.713+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1419647635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5814b650 con 0x7f0a580b3ff0 2023-12-22T08:42:05.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.715+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1419647635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a58061910 con 0x7f0a580b3ff0 2023-12-22T08:42:05.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.715+0000 7f0a557fa640 1 -- 172.21.15.38:0/1419647635 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0a4c0129d0 con 0x7f0a580b3ff0 2023-12-22T08:42:05.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.716+0000 7f0a557fa640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a3c06a460 0x7f0a3c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.717+0000 7f0a557fa640 1 -- 172.21.15.38:0/1419647635 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a4c0883b0 con 0x7f0a580b3ff0 2023-12-22T08:42:05.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.717+0000 7f0a57fff640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a3c06a460 0x7f0a3c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.718+0000 7f0a57fff640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a3c06a460 0x7f0a3c06c920 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0a58157390 tx=0x7f0a44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:05.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.721+0000 7f0a557fa640 1 -- 172.21.15.38:0/1419647635 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0a4c0539a0 con 0x7f0a580b3ff0 2023-12-22T08:42:05.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.908+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1419647635 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a580d20a0 con 0x7f0a3c06a460 2023-12-22T08:42:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.931+0000 7f0a557fa640 1 -- 172.21.15.38:0/1419647635 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282557 (secure 0 0 0) 0x7f0a44011970 con 0x7f0a3c06a460 2023-12-22T08:42:05.936 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:05.940 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:42:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.938+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a3c06a460 msgr2=0x7f0a3c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.938+0000 7f0a5dd0c640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a3c06a460 0x7f0a3c06c920 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0a58157390 tx=0x7f0a44008040 comp rx=0 tx=0).stop 2023-12-22T08:42:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.938+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1419647635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a580b3ff0 msgr2=0x7f0a5814aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.938+0000 7f0a5dd0c640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a580b3ff0 0x7f0a5814aeb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00c450 tx=0x7f0a4c00c910 comp rx=0 tx=0).stop 2023-12-22T08:42:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.938+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1419647635 shutdown_connections 2023-12-22T08:42:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.938+0000 7f0a5dd0c640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a58157980 0x7f0a5814be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.938+0000 7f0a5dd0c640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a580b44a0 0x7f0a5814e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.938+0000 7f0a5dd0c640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a3c06a460 0x7f0a3c06c920 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.938+0000 7f0a5dd0c640 1 --2- 172.21.15.38:0/1419647635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a580b3ff0 0x7f0a5814aeb0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.938+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1419647635 >> 172.21.15.38:0/1419647635 conn(0x7f0a580d31f0 msgr2=0x7f0a580d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:05.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.938+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1419647635 shutdown_connections 2023-12-22T08:42:05.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:05.938+0000 7f0a5dd0c640 1 -- 172.21.15.38:0/1419647635 wait complete. 2023-12-22T08:42:05.962 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-12-22T08:42:04.398732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2963,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559536,"statfs":{"total":1600000000,"available":1596965251,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.970601"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030322+0000","last_change":"2023-12-22T08:42:00.969971+0000","last_active":"2023-12-22T08:42:03.030322+0000","last_peered":"2023-12-22T08:42:03.030322+0000","last_clean":"2023-12-22T08:42:03.030322+0000","last_became_active":"2023-12-22T08:42:00.969755+0000","last_became_peered":"2023-12-22T08:42:00.969755+0000","last_unstale":"2023-12-22T08:42:03.030322+0000","last_undegraded":"2023-12-22T08:42:03.030322+0000","last_fullsized":"2023-12-22T08:42:03.030322+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:16:18.741591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946132+0000","last_change":"2023-12-22T08:42:00.955355+0000","last_active":"2023-12-22T08:42:01.946132+0000","last_peered":"2023-12-22T08:42:01.946132+0000","last_clean":"2023-12-22T08:42:01.946132+0000","last_became_active":"2023-12-22T08:42:00.955138+0000","last_became_peered":"2023-12-22T08:42:00.955138+0000","last_unstale":"2023-12-22T08:42:01.946132+0000","last_undegraded":"2023-12-22T08:42:01.946132+0000","last_fullsized":"2023-12-22T08:42:01.946132+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:17.219524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.944935+0000","last_change":"2023-12-22T08:42:00.956820+0000","last_active":"2023-12-22T08:42:01.944935+0000","last_peered":"2023-12-22T08:42:01.944935+0000","last_clean":"2023-12-22T08:42:01.944935+0000","last_became_active":"2023-12-22T08:42:00.956252+0000","last_became_peered":"2023-12-22T08:42:00.956252+0000","last_unstale":"2023-12-22T08:42:01.944935+0000","last_undegraded":"2023-12-22T08:42:01.944935+0000","last_fullsized":"2023-12-22T08:42:01.944935+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:51.159616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031541+0000","last_change":"2023-12-22T08:42:00.964031+0000","last_active":"2023-12-22T08:42:03.031541+0000","last_peered":"2023-12-22T08:42:03.031541+0000","last_clean":"2023-12-22T08:42:03.031541+0000","last_became_active":"2023-12-22T08:42:00.963802+0000","last_became_peered":"2023-12-22T08:42:00.963802+0000","last_unstale":"2023-12-22T08:42:03.031541+0000","last_undegraded":"2023-12-22T08:42:03.031541+0000","last_fullsized":"2023-12-22T08:42:03.031541+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:31:07.952665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030224+0000","last_change":"2023-12-22T08:42:00.966136+0000","last_active":"2023-12-22T08:42:03.030224+0000","last_peered":"2023-12-22T08:42:03.030224+0000","last_clean":"2023-12-22T08:42:03.030224+0000","last_became_active":"2023-12-22T08:42:00.965892+0000","last_became_peered":"2023-12-22T08:42:00.965892+0000","last_unstale":"2023-12-22T08:42:03.030224+0000","last_undegraded":"2023-12-22T08:42:03.030224+0000","last_fullsized":"2023-12-22T08:42:03.030224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:32.942053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858047+0000","last_change":"2023-12-22T08:42:00.969775+0000","last_active":"2023-12-22T08:42:02.858047+0000","last_peered":"2023-12-22T08:42:02.858047+0000","last_clean":"2023-12-22T08:42:02.858047+0000","last_became_active":"2023-12-22T08:42:00.969121+0000","last_became_peered":"2023-12-22T08:42:00.969121+0000","last_unstale":"2023-12-22T08:42:02.858047+0000","last_undegraded":"2023-12-22T08:42:02.858047+0000","last_fullsized":"2023-12-22T08:42:02.858047+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:14.286497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945775+0000","last_change":"2023-12-22T08:42:00.954963+0000","last_active":"2023-12-22T08:42:01.945775+0000","last_peered":"2023-12-22T08:42:01.945775+0000","last_clean":"2023-12-22T08:42:01.945775+0000","last_became_active":"2023-12-22T08:42:00.954574+0000","last_became_peered":"2023-12-22T08:42:00.954574+0000","last_unstale":"2023-12-22T08:42:01.945775+0000","last_undegraded":"2023-12-22T08:42:01.945775+0000","last_fullsized":"2023-12-22T08:42:01.945775+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:43:18.268811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031321+0000","last_change":"2023-12-22T08:42:00.972523+0000","last_active":"2023-12-22T08:42:03.031321+0000","last_peered":"2023-12-22T08:42:03.031321+0000","last_clean":"2023-12-22T08:42:03.031321+0000","last_became_active":"2023-12-22T08:42:00.970871+0000","last_became_peered":"2023-12-22T08:42:00.970871+0000","last_unstale":"2023-12-22T08:42:03.031321+0000","last_undegraded":"2023-12-22T08:42:03.031321+0000","last_fullsized":"2023-12-22T08:42:03.031321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:08.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858253+0000","last_change":"2023-12-22T08:42:00.972822+0000","last_active":"2023-12-22T08:42:02.858253+0000","last_peered":"2023-12-22T08:42:02.858253+0000","last_clean":"2023-12-22T08:42:02.858253+0000","last_became_active":"2023-12-22T08:42:00.972606+0000","last_became_peered":"2023-12-22T08:42:00.972606+0000","last_unstale":"2023-12-22T08:42:02.858253+0000","last_undegraded":"2023-12-22T08:42:02.858253+0000","last_fullsized":"2023-12-22T08:42:02.858253+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:01:28.567989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317263+0000","last_change":"2023-12-22T08:42:00.969617+0000","last_active":"2023-12-22T08:42:02.317263+0000","last_peered":"2023-12-22T08:42:02.317263+0000","last_clean":"2023-12-22T08:42:02.317263+0000","last_became_active":"2023-12-22T08:42:00.969344+0000","last_became_peered":"2023-12-22T08:42:00.969344+0000","last_unstale":"2023-12-22T08:42:02.317263+0000","last_undegraded":"2023-12-22T08:42:02.317263+0000","last_fullsized":"2023-12-22T08:42:02.317263+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:02:36.760841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031677+0000","last_change":"2023-12-22T08:42:00.968601+0000","last_active":"2023-12-22T08:42:03.031677+0000","last_peered":"2023-12-22T08:42:03.031677+0000","last_clean":"2023-12-22T08:42:03.031677+0000","last_became_active":"2023-12-22T08:42:00.967706+0000","last_became_peered":"2023-12-22T08:42:00.967706+0000","last_unstale":"2023-12-22T08:42:03.031677+0000","last_undegraded":"2023-12-22T08:42:03.031677+0000","last_fullsized":"2023-12-22T08:42:03.031677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:58:27.825373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946386+0000","last_change":"2023-12-22T08:42:00.960913+0000","last_active":"2023-12-22T08:42:01.946386+0000","last_peered":"2023-12-22T08:42:01.946386+0000","last_clean":"2023-12-22T08:42:01.946386+0000","last_became_active":"2023-12-22T08:42:00.960556+0000","last_became_peered":"2023-12-22T08:42:00.960556+0000","last_unstale":"2023-12-22T08:42:01.946386+0000","last_undegraded":"2023-12-22T08:42:01.946386+0000","last_fullsized":"2023-12-22T08:42:01.946386+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:30:44.215726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857828+0000","last_change":"2023-12-22T08:42:00.968404+0000","last_active":"2023-12-22T08:42:02.857828+0000","last_peered":"2023-12-22T08:42:02.857828+0000","last_clean":"2023-12-22T08:42:02.857828+0000","last_became_active":"2023-12-22T08:42:00.967626+0000","last_became_peered":"2023-12-22T08:42:00.967626+0000","last_unstale":"2023-12-22T08:42:02.857828+0000","last_undegraded":"2023-12-22T08:42:02.857828+0000","last_fullsized":"2023-12-22T08:42:02.857828+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:30.197765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.032180+0000","last_change":"2023-12-22T08:42:00.958943+0000","last_active":"2023-12-22T08:42:03.032180+0000","last_peered":"2023-12-22T08:42:03.032180+0000","last_clean":"2023-12-22T08:42:03.032180+0000","last_became_active":"2023-12-22T08:42:00.958413+0000","last_became_peered":"2023-12-22T08:42:00.958413+0000","last_unstale":"2023-12-22T08:42:03.032180+0000","last_undegraded":"2023-12-22T08:42:03.032180+0000","last_fullsized":"2023-12-22T08:42:03.032180+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:32:52.813808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031302+0000","last_change":"2023-12-22T08:42:00.960854+0000","last_active":"2023-12-22T08:42:03.031302+0000","last_peered":"2023-12-22T08:42:03.031302+0000","last_clean":"2023-12-22T08:42:03.031302+0000","last_became_active":"2023-12-22T08:42:00.960602+0000","last_became_peered":"2023-12-22T08:42:00.960602+0000","last_unstale":"2023-12-22T08:42:03.031302+0000","last_undegraded":"2023-12-22T08:42:03.031302+0000","last_fullsized":"2023-12-22T08:42:03.031302+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:27.697741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030601+0000","last_change":"2023-12-22T08:42:00.966498+0000","last_active":"2023-12-22T08:42:03.030601+0000","last_peered":"2023-12-22T08:42:03.030601+0000","last_clean":"2023-12-22T08:42:03.030601+0000","last_became_active":"2023-12-22T08:42:00.966250+0000","last_became_peered":"2023-12-22T08:42:00.966250+0000","last_unstale":"2023-12-22T08:42:03.030601+0000","last_undegraded":"2023-12-22T08:42:03.030601+0000","last_fullsized":"2023-12-22T08:42:03.030601+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:31.164625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946982+0000","last_change":"2023-12-22T08:42:00.969675+0000","last_active":"2023-12-22T08:42:01.946982+0000","last_peered":"2023-12-22T08:42:01.946982+0000","last_clean":"2023-12-22T08:42:01.946982+0000","last_became_active":"2023-12-22T08:42:00.967757+0000","last_became_peered":"2023-12-22T08:42:00.967757+0000","last_unstale":"2023-12-22T08:42:01.946982+0000","last_undegraded":"2023-12-22T08:42:01.946982+0000","last_fullsized":"2023-12-22T08:42:01.946982+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:08.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945224+0000","last_change":"2023-12-22T08:42:00.967521+0000","last_active":"2023-12-22T08:42:01.945224+0000","last_peered":"2023-12-22T08:42:01.945224+0000","last_clean":"2023-12-22T08:42:01.945224+0000","last_became_active":"2023-12-22T08:42:00.966572+0000","last_became_peered":"2023-12-22T08:42:00.966572+0000","last_unstale":"2023-12-22T08:42:01.945224+0000","last_undegraded":"2023-12-22T08:42:01.945224+0000","last_fullsized":"2023-12-22T08:42:01.945224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:19:39.462835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030495+0000","last_change":"2023-12-22T08:42:00.973720+0000","last_active":"2023-12-22T08:42:03.030495+0000","last_peered":"2023-12-22T08:42:03.030495+0000","last_clean":"2023-12-22T08:42:03.030495+0000","last_became_active":"2023-12-22T08:42:00.972646+0000","last_became_peered":"2023-12-22T08:42:00.972646+0000","last_unstale":"2023-12-22T08:42:03.030495+0000","last_undegraded":"2023-12-22T08:42:03.030495+0000","last_fullsized":"2023-12-22T08:42:03.030495+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:17:58.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317746+0000","last_change":"2023-12-22T08:42:00.965928+0000","last_active":"2023-12-22T08:42:02.317746+0000","last_peered":"2023-12-22T08:42:02.317746+0000","last_clean":"2023-12-22T08:42:02.317746+0000","last_became_active":"2023-12-22T08:42:00.962390+0000","last_became_peered":"2023-12-22T08:42:00.962390+0000","last_unstale":"2023-12-22T08:42:02.317746+0000","last_undegraded":"2023-12-22T08:42:02.317746+0000","last_fullsized":"2023-12-22T08:42:02.317746+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:11:27.558443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.032041+0000","last_change":"2023-12-22T08:42:00.967947+0000","last_active":"2023-12-22T08:42:03.032041+0000","last_peered":"2023-12-22T08:42:03.032041+0000","last_clean":"2023-12-22T08:42:03.032041+0000","last_became_active":"2023-12-22T08:42:00.966987+0000","last_became_peered":"2023-12-22T08:42:00.966987+0000","last_unstale":"2023-12-22T08:42:03.032041+0000","last_undegraded":"2023-12-22T08:42:03.032041+0000","last_fullsized":"2023-12-22T08:42:03.032041+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:30:44.215726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857269+0000","last_change":"2023-12-22T08:42:00.960777+0000","last_active":"2023-12-22T08:42:02.857269+0000","last_peered":"2023-12-22T08:42:02.857269+0000","last_clean":"2023-12-22T08:42:02.857269+0000","last_became_active":"2023-12-22T08:42:00.960335+0000","last_became_peered":"2023-12-22T08:42:00.960335+0000","last_unstale":"2023-12-22T08:42:02.857269+0000","last_undegraded":"2023-12-22T08:42:02.857269+0000","last_fullsized":"2023-12-22T08:42:02.857269+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:51.563460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946001+0000","last_change":"2023-12-22T08:42:00.971226+0000","last_active":"2023-12-22T08:42:01.946001+0000","last_peered":"2023-12-22T08:42:01.946001+0000","last_clean":"2023-12-22T08:42:01.946001+0000","last_became_active":"2023-12-22T08:42:00.970822+0000","last_became_peered":"2023-12-22T08:42:00.970822+0000","last_unstale":"2023-12-22T08:42:01.946001+0000","last_undegraded":"2023-12-22T08:42:01.946001+0000","last_fullsized":"2023-12-22T08:42:01.946001+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:22:06.631349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.944831+0000","last_change":"2023-12-22T08:42:00.967600+0000","last_active":"2023-12-22T08:42:01.944831+0000","last_peered":"2023-12-22T08:42:01.944831+0000","last_clean":"2023-12-22T08:42:01.944831+0000","last_became_active":"2023-12-22T08:42:00.967316+0000","last_became_peered":"2023-12-22T08:42:00.967316+0000","last_unstale":"2023-12-22T08:42:01.944831+0000","last_undegraded":"2023-12-22T08:42:01.944831+0000","last_fullsized":"2023-12-22T08:42:01.944831+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:58:27.825373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030309+0000","last_change":"2023-12-22T08:42:00.970541+0000","last_active":"2023-12-22T08:42:03.030309+0000","last_peered":"2023-12-22T08:42:03.030309+0000","last_clean":"2023-12-22T08:42:03.030309+0000","last_became_active":"2023-12-22T08:42:00.970061+0000","last_became_peered":"2023-12-22T08:42:00.970061+0000","last_unstale":"2023-12-22T08:42:03.030309+0000","last_undegraded":"2023-12-22T08:42:03.030309+0000","last_fullsized":"2023-12-22T08:42:03.030309+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:51:37.320233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.032186+0000","last_change":"2023-12-22T08:42:00.968408+0000","last_active":"2023-12-22T08:42:03.032186+0000","last_peered":"2023-12-22T08:42:03.032186+0000","last_clean":"2023-12-22T08:42:03.032186+0000","last_became_active":"2023-12-22T08:42:00.967406+0000","last_became_peered":"2023-12-22T08:42:00.967406+0000","last_unstale":"2023-12-22T08:42:03.032186+0000","last_undegraded":"2023-12-22T08:42:03.032186+0000","last_fullsized":"2023-12-22T08:42:03.032186+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:08:04.838063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945908+0000","last_change":"2023-12-22T08:42:00.955772+0000","last_active":"2023-12-22T08:42:01.945908+0000","last_peered":"2023-12-22T08:42:01.945908+0000","last_clean":"2023-12-22T08:42:01.945908+0000","last_became_active":"2023-12-22T08:42:00.955359+0000","last_became_peered":"2023-12-22T08:42:00.955359+0000","last_unstale":"2023-12-22T08:42:01.945908+0000","last_undegraded":"2023-12-22T08:42:01.945908+0000","last_fullsized":"2023-12-22T08:42:01.945908+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:33.584100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.944827+0000","last_change":"2023-12-22T08:42:00.956085+0000","last_active":"2023-12-22T08:42:01.944827+0000","last_peered":"2023-12-22T08:42:01.944827+0000","last_clean":"2023-12-22T08:42:01.944827+0000","last_became_active":"2023-12-22T08:42:00.955523+0000","last_became_peered":"2023-12-22T08:42:00.955523+0000","last_unstale":"2023-12-22T08:42:01.944827+0000","last_undegraded":"2023-12-22T08:42:01.944827+0000","last_fullsized":"2023-12-22T08:42:01.944827+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:12:03.987628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030098+0000","last_change":"2023-12-22T08:42:00.964172+0000","last_active":"2023-12-22T08:42:03.030098+0000","last_peered":"2023-12-22T08:42:03.030098+0000","last_clean":"2023-12-22T08:42:03.030098+0000","last_became_active":"2023-12-22T08:42:00.963932+0000","last_became_peered":"2023-12-22T08:42:00.963932+0000","last_unstale":"2023-12-22T08:42:03.030098+0000","last_undegraded":"2023-12-22T08:42:03.030098+0000","last_fullsized":"2023-12-22T08:42:03.030098+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:48.789053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946627+0000","last_change":"2023-12-22T08:42:00.950551+0000","last_active":"2023-12-22T08:42:01.946627+0000","last_peered":"2023-12-22T08:42:01.946627+0000","last_clean":"2023-12-22T08:42:01.946627+0000","last_became_active":"2023-12-22T08:42:00.949921+0000","last_became_peered":"2023-12-22T08:42:00.949921+0000","last_unstale":"2023-12-22T08:42:01.946627+0000","last_undegraded":"2023-12-22T08:42:01.946627+0000","last_fullsized":"2023-12-22T08:42:01.946627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:32.942053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858294+0000","last_change":"2023-12-22T08:42:00.966233+0000","last_active":"2023-12-22T08:42:02.858294+0000","last_peered":"2023-12-22T08:42:02.858294+0000","last_clean":"2023-12-22T08:42:02.858294+0000","last_became_active":"2023-12-22T08:42:00.965622+0000","last_became_peered":"2023-12-22T08:42:00.965622+0000","last_unstale":"2023-12-22T08:42:02.858294+0000","last_undegraded":"2023-12-22T08:42:02.858294+0000","last_fullsized":"2023-12-22T08:42:02.858294+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:09.049105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031508+0000","last_change":"2023-12-22T08:42:00.962526+0000","last_active":"2023-12-22T08:42:03.031508+0000","last_peered":"2023-12-22T08:42:03.031508+0000","last_clean":"2023-12-22T08:42:03.031508+0000","last_became_active":"2023-12-22T08:42:00.962292+0000","last_became_peered":"2023-12-22T08:42:00.962292+0000","last_unstale":"2023-12-22T08:42:03.031508+0000","last_undegraded":"2023-12-22T08:42:03.031508+0000","last_fullsized":"2023-12-22T08:42:03.031508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:11:10.990224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.856624+0000","last_change":"2023-12-22T08:42:00.954940+0000","last_active":"2023-12-22T08:42:02.856624+0000","last_peered":"2023-12-22T08:42:02.856624+0000","last_clean":"2023-12-22T08:42:02.856624+0000","last_became_active":"2023-12-22T08:42:00.954321+0000","last_became_peered":"2023-12-22T08:42:00.954321+0000","last_unstale":"2023-12-22T08:42:02.856624+0000","last_undegraded":"2023-12-22T08:42:02.856624+0000","last_fullsized":"2023-12-22T08:42:02.856624+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:51.159616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858334+0000","last_change":"2023-12-22T08:42:00.462663+0000","last_active":"2023-12-22T08:42:02.858334+0000","last_peered":"2023-12-22T08:42:02.858334+0000","last_clean":"2023-12-22T08:42:02.858334+0000","last_became_active":"2023-12-22T08:42:00.460798+0000","last_became_peered":"2023-12-22T08:42:00.460798+0000","last_unstale":"2023-12-22T08:42:02.858334+0000","last_undegraded":"2023-12-22T08:42:02.858334+0000","last_fullsized":"2023-12-22T08:42:02.858334+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:28.846648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030664+0000","last_change":"2023-12-22T08:42:00.967264+0000","last_active":"2023-12-22T08:42:03.030664+0000","last_peered":"2023-12-22T08:42:03.030664+0000","last_clean":"2023-12-22T08:42:03.030664+0000","last_became_active":"2023-12-22T08:42:00.966980+0000","last_became_peered":"2023-12-22T08:42:00.966980+0000","last_unstale":"2023-12-22T08:42:03.030664+0000","last_undegraded":"2023-12-22T08:42:03.030664+0000","last_fullsized":"2023-12-22T08:42:03.030664+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:14.707678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945737+0000","last_change":"2023-12-22T08:42:00.451324+0000","last_active":"2023-12-22T08:42:01.945737+0000","last_peered":"2023-12-22T08:42:01.945737+0000","last_clean":"2023-12-22T08:42:01.945737+0000","last_became_active":"2023-12-22T08:42:00.451093+0000","last_became_peered":"2023-12-22T08:42:00.451093+0000","last_unstale":"2023-12-22T08:42:01.945737+0000","last_undegraded":"2023-12-22T08:42:01.945737+0000","last_fullsized":"2023-12-22T08:42:01.945737+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:32:51.799303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.947517+0000","last_change":"2023-12-22T08:42:00.955641+0000","last_active":"2023-12-22T08:42:01.947517+0000","last_peered":"2023-12-22T08:42:01.947517+0000","last_clean":"2023-12-22T08:42:01.947517+0000","last_became_active":"2023-12-22T08:42:00.955292+0000","last_became_peered":"2023-12-22T08:42:00.955292+0000","last_unstale":"2023-12-22T08:42:01.947517+0000","last_undegraded":"2023-12-22T08:42:01.947517+0000","last_fullsized":"2023-12-22T08:42:01.947517+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:08:04.838063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858391+0000","last_change":"2023-12-22T08:42:00.455930+0000","last_active":"2023-12-22T08:42:02.858391+0000","last_peered":"2023-12-22T08:42:02.858391+0000","last_clean":"2023-12-22T08:42:02.858391+0000","last_became_active":"2023-12-22T08:42:00.455591+0000","last_became_peered":"2023-12-22T08:42:00.455591+0000","last_unstale":"2023-12-22T08:42:02.858391+0000","last_undegraded":"2023-12-22T08:42:02.858391+0000","last_fullsized":"2023-12-22T08:42:02.858391+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:10:42.704473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031543+0000","last_change":"2023-12-22T08:42:00.975004+0000","last_active":"2023-12-22T08:42:03.031543+0000","last_peered":"2023-12-22T08:42:03.031543+0000","last_clean":"2023-12-22T08:42:03.031543+0000","last_became_active":"2023-12-22T08:42:00.974714+0000","last_became_peered":"2023-12-22T08:42:00.974714+0000","last_unstale":"2023-12-22T08:42:03.031543+0000","last_undegraded":"2023-12-22T08:42:03.031543+0000","last_fullsized":"2023-12-22T08:42:03.031543+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:17.219524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946840+0000","last_change":"2023-12-22T08:42:00.451330+0000","last_active":"2023-12-22T08:42:01.946840+0000","last_peered":"2023-12-22T08:42:01.946840+0000","last_clean":"2023-12-22T08:42:01.946840+0000","last_became_active":"2023-12-22T08:42:00.451131+0000","last_became_peered":"2023-12-22T08:42:00.451131+0000","last_unstale":"2023-12-22T08:42:01.946840+0000","last_undegraded":"2023-12-22T08:42:01.946840+0000","last_fullsized":"2023-12-22T08:42:01.946840+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:34:58.075105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.944995+0000","last_change":"2023-12-22T08:42:00.956574+0000","last_active":"2023-12-22T08:42:01.944995+0000","last_peered":"2023-12-22T08:42:01.944995+0000","last_clean":"2023-12-22T08:42:01.944995+0000","last_became_active":"2023-12-22T08:42:00.955822+0000","last_became_peered":"2023-12-22T08:42:00.955822+0000","last_unstale":"2023-12-22T08:42:01.944995+0000","last_undegraded":"2023-12-22T08:42:01.944995+0000","last_fullsized":"2023-12-22T08:42:01.944995+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:58.087661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858114+0000","last_change":"2023-12-22T08:42:00.452895+0000","last_active":"2023-12-22T08:42:02.858114+0000","last_peered":"2023-12-22T08:42:02.858114+0000","last_clean":"2023-12-22T08:42:02.858114+0000","last_became_active":"2023-12-22T08:42:00.452227+0000","last_became_peered":"2023-12-22T08:42:00.452227+0000","last_unstale":"2023-12-22T08:42:02.858114+0000","last_undegraded":"2023-12-22T08:42:02.858114+0000","last_fullsized":"2023-12-22T08:42:02.858114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:41.235574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.316863+0000","last_change":"2023-12-22T08:42:00.954886+0000","last_active":"2023-12-22T08:42:02.316863+0000","last_peered":"2023-12-22T08:42:02.316863+0000","last_clean":"2023-12-22T08:42:02.316863+0000","last_became_active":"2023-12-22T08:42:00.954262+0000","last_became_peered":"2023-12-22T08:42:00.954262+0000","last_unstale":"2023-12-22T08:42:02.316863+0000","last_undegraded":"2023-12-22T08:42:02.316863+0000","last_fullsized":"2023-12-22T08:42:02.316863+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:36:31.432856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945876+0000","last_change":"2023-12-22T08:42:00.457163+0000","last_active":"2023-12-22T08:42:01.945876+0000","last_peered":"2023-12-22T08:42:01.945876+0000","last_clean":"2023-12-22T08:42:01.945876+0000","last_became_active":"2023-12-22T08:42:00.456680+0000","last_became_peered":"2023-12-22T08:42:00.456680+0000","last_unstale":"2023-12-22T08:42:01.945876+0000","last_undegraded":"2023-12-22T08:42:01.945876+0000","last_fullsized":"2023-12-22T08:42:01.945876+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:19:22.862823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317494+0000","last_change":"2023-12-22T08:42:00.966493+0000","last_active":"2023-12-22T08:42:02.317494+0000","last_peered":"2023-12-22T08:42:02.317494+0000","last_clean":"2023-12-22T08:42:02.317494+0000","last_became_active":"2023-12-22T08:42:00.965708+0000","last_became_peered":"2023-12-22T08:42:00.965708+0000","last_unstale":"2023-12-22T08:42:02.317494+0000","last_undegraded":"2023-12-22T08:42:02.317494+0000","last_fullsized":"2023-12-22T08:42:02.317494+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:32:52.813808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030227+0000","last_change":"2023-12-22T08:42:00.458273+0000","last_active":"2023-12-22T08:42:03.030227+0000","last_peered":"2023-12-22T08:42:03.030227+0000","last_clean":"2023-12-22T08:42:03.030227+0000","last_became_active":"2023-12-22T08:42:00.458022+0000","last_became_peered":"2023-12-22T08:42:00.458022+0000","last_unstale":"2023-12-22T08:42:03.030227+0000","last_undegraded":"2023-12-22T08:42:03.030227+0000","last_fullsized":"2023-12-22T08:42:03.030227+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:41.235574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945116+0000","last_change":"2023-12-22T08:42:00.972825+0000","last_active":"2023-12-22T08:42:01.945116+0000","last_peered":"2023-12-22T08:42:01.945116+0000","last_clean":"2023-12-22T08:42:01.945116+0000","last_became_active":"2023-12-22T08:42:00.972619+0000","last_became_peered":"2023-12-22T08:42:00.972619+0000","last_unstale":"2023-12-22T08:42:01.945116+0000","last_undegraded":"2023-12-22T08:42:01.945116+0000","last_fullsized":"2023-12-22T08:42:01.945116+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:52:10.519575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317851+0000","last_change":"2023-12-22T08:42:00.446893+0000","last_active":"2023-12-22T08:42:02.317851+0000","last_peered":"2023-12-22T08:42:02.317851+0000","last_clean":"2023-12-22T08:42:02.317851+0000","last_became_active":"2023-12-22T08:42:00.446419+0000","last_became_peered":"2023-12-22T08:42:00.446419+0000","last_unstale":"2023-12-22T08:42:02.317851+0000","last_undegraded":"2023-12-22T08:42:02.317851+0000","last_fullsized":"2023-12-22T08:42:02.317851+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:51:36.305728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.944748+0000","last_change":"2023-12-22T08:42:00.963942+0000","last_active":"2023-12-22T08:42:01.944748+0000","last_peered":"2023-12-22T08:42:01.944748+0000","last_clean":"2023-12-22T08:42:01.944748+0000","last_became_active":"2023-12-22T08:42:00.963234+0000","last_became_peered":"2023-12-22T08:42:00.963234+0000","last_unstale":"2023-12-22T08:42:01.944748+0000","last_undegraded":"2023-12-22T08:42:01.944748+0000","last_fullsized":"2023-12-22T08:42:01.944748+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:38:38.995302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945437+0000","last_change":"2023-12-22T08:42:00.465441+0000","last_active":"2023-12-22T08:42:01.945437+0000","last_peered":"2023-12-22T08:42:01.945437+0000","last_clean":"2023-12-22T08:42:01.945437+0000","last_became_active":"2023-12-22T08:42:00.465286+0000","last_became_peered":"2023-12-22T08:42:00.465286+0000","last_unstale":"2023-12-22T08:42:01.945437+0000","last_undegraded":"2023-12-22T08:42:01.945437+0000","last_fullsized":"2023-12-22T08:42:01.945437+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:53:21.527490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945094+0000","last_change":"2023-12-22T08:42:00.966626+0000","last_active":"2023-12-22T08:42:01.945094+0000","last_peered":"2023-12-22T08:42:01.945094+0000","last_clean":"2023-12-22T08:42:01.945094+0000","last_became_active":"2023-12-22T08:42:00.966351+0000","last_became_peered":"2023-12-22T08:42:00.966351+0000","last_unstale":"2023-12-22T08:42:01.945094+0000","last_undegraded":"2023-12-22T08:42:01.945094+0000","last_fullsized":"2023-12-22T08:42:01.945094+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:10.653460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317624+0000","last_change":"2023-12-22T08:42:00.463431+0000","last_active":"2023-12-22T08:42:02.317624+0000","last_peered":"2023-12-22T08:42:02.317624+0000","last_clean":"2023-12-22T08:42:02.317624+0000","last_became_active":"2023-12-22T08:42:00.463135+0000","last_became_peered":"2023-12-22T08:42:00.463135+0000","last_unstale":"2023-12-22T08:42:02.317624+0000","last_undegraded":"2023-12-22T08:42:02.317624+0000","last_fullsized":"2023-12-22T08:42:02.317624+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:17:57.655160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031762+0000","last_change":"2023-12-22T08:42:00.959405+0000","last_active":"2023-12-22T08:42:03.031762+0000","last_peered":"2023-12-22T08:42:03.031762+0000","last_clean":"2023-12-22T08:42:03.031762+0000","last_became_active":"2023-12-22T08:42:00.958719+0000","last_became_peered":"2023-12-22T08:42:00.958719+0000","last_unstale":"2023-12-22T08:42:03.031762+0000","last_undegraded":"2023-12-22T08:42:03.031762+0000","last_fullsized":"2023-12-22T08:42:03.031762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:19:23.877328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945352+0000","last_change":"2023-12-22T08:42:00.454165+0000","last_active":"2023-12-22T08:42:01.945352+0000","last_peered":"2023-12-22T08:42:01.945352+0000","last_clean":"2023-12-22T08:42:01.945352+0000","last_became_active":"2023-12-22T08:42:00.453877+0000","last_became_peered":"2023-12-22T08:42:00.453877+0000","last_unstale":"2023-12-22T08:42:01.945352+0000","last_undegraded":"2023-12-22T08:42:01.945352+0000","last_fullsized":"2023-12-22T08:42:01.945352+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:35:47.703232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945750+0000","last_change":"2023-12-22T08:42:00.971066+0000","last_active":"2023-12-22T08:42:01.945750+0000","last_peered":"2023-12-22T08:42:01.945750+0000","last_clean":"2023-12-22T08:42:01.945750+0000","last_became_active":"2023-12-22T08:42:00.970493+0000","last_became_peered":"2023-12-22T08:42:00.970493+0000","last_unstale":"2023-12-22T08:42:01.945750+0000","last_undegraded":"2023-12-22T08:42:01.945750+0000","last_fullsized":"2023-12-22T08:42:01.945750+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:49:18.720718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317592+0000","last_change":"2023-12-22T08:42:00.460739+0000","last_active":"2023-12-22T08:42:02.317592+0000","last_peered":"2023-12-22T08:42:02.317592+0000","last_clean":"2023-12-22T08:42:02.317592+0000","last_became_active":"2023-12-22T08:42:00.452569+0000","last_became_peered":"2023-12-22T08:42:00.452569+0000","last_unstale":"2023-12-22T08:42:02.317592+0000","last_undegraded":"2023-12-22T08:42:02.317592+0000","last_fullsized":"2023-12-22T08:42:02.317592+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:07.613153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945211+0000","last_change":"2023-12-22T08:42:00.963722+0000","last_active":"2023-12-22T08:42:01.945211+0000","last_peered":"2023-12-22T08:42:01.945211+0000","last_clean":"2023-12-22T08:42:01.945211+0000","last_became_active":"2023-12-22T08:42:00.963347+0000","last_became_peered":"2023-12-22T08:42:00.963347+0000","last_unstale":"2023-12-22T08:42:01.945211+0000","last_undegraded":"2023-12-22T08:42:01.945211+0000","last_fullsized":"2023-12-22T08:42:01.945211+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:10:43.718978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857729+0000","last_change":"2023-12-22T08:42:00.467893+0000","last_active":"2023-12-22T08:42:02.857729+0000","last_peered":"2023-12-22T08:42:02.857729+0000","last_clean":"2023-12-22T08:42:02.857729+0000","last_became_active":"2023-12-22T08:42:00.467650+0000","last_became_peered":"2023-12-22T08:42:00.467650+0000","last_unstale":"2023-12-22T08:42:02.857729+0000","last_undegraded":"2023-12-22T08:42:02.857729+0000","last_fullsized":"2023-12-22T08:42:02.857729+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:49:33.493365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857281+0000","last_change":"2023-12-22T08:42:00.952079+0000","last_active":"2023-12-22T08:42:02.857281+0000","last_peered":"2023-12-22T08:42:02.857281+0000","last_clean":"2023-12-22T08:42:02.857281+0000","last_became_active":"2023-12-22T08:42:00.951832+0000","last_became_peered":"2023-12-22T08:42:00.951832+0000","last_unstale":"2023-12-22T08:42:02.857281+0000","last_undegraded":"2023-12-22T08:42:02.857281+0000","last_fullsized":"2023-12-22T08:42:02.857281+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:29.861153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030731+0000","last_change":"2023-12-22T08:42:00.461731+0000","last_active":"2023-12-22T08:42:03.030731+0000","last_peered":"2023-12-22T08:42:03.030731+0000","last_clean":"2023-12-22T08:42:03.030731+0000","last_became_active":"2023-12-22T08:42:00.461358+0000","last_became_peered":"2023-12-22T08:42:00.461358+0000","last_unstale":"2023-12-22T08:42:03.030731+0000","last_undegraded":"2023-12-22T08:42:03.030731+0000","last_fullsized":"2023-12-22T08:42:03.030731+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:38.031039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.856722+0000","last_change":"2023-12-22T08:42:00.955473+0000","last_active":"2023-12-22T08:42:02.856722+0000","last_peered":"2023-12-22T08:42:02.856722+0000","last_clean":"2023-12-22T08:42:02.856722+0000","last_became_active":"2023-12-22T08:42:00.954809+0000","last_became_peered":"2023-12-22T08:42:00.954809+0000","last_unstale":"2023-12-22T08:42:02.856722+0000","last_undegraded":"2023-12-22T08:42:02.856722+0000","last_fullsized":"2023-12-22T08:42:02.856722+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:42.250079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858329+0000","last_change":"2023-12-22T08:42:00.457019+0000","last_active":"2023-12-22T08:42:02.858329+0000","last_peered":"2023-12-22T08:42:02.858329+0000","last_clean":"2023-12-22T08:42:02.858329+0000","last_became_active":"2023-12-22T08:42:00.456611+0000","last_became_peered":"2023-12-22T08:42:00.456611+0000","last_unstale":"2023-12-22T08:42:02.858329+0000","last_undegraded":"2023-12-22T08:42:02.858329+0000","last_fullsized":"2023-12-22T08:42:02.858329+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:09.638955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.947289+0000","last_change":"2023-12-22T08:42:00.969539+0000","last_active":"2023-12-22T08:42:01.947289+0000","last_peered":"2023-12-22T08:42:01.947289+0000","last_clean":"2023-12-22T08:42:01.947289+0000","last_became_active":"2023-12-22T08:42:00.967430+0000","last_became_peered":"2023-12-22T08:42:00.967430+0000","last_unstale":"2023-12-22T08:42:01.947289+0000","last_undegraded":"2023-12-22T08:42:01.947289+0000","last_fullsized":"2023-12-22T08:42:01.947289+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:48.789053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":19,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317178+0000","last_change":"2023-12-22T08:42:00.462811+0000","last_active":"2023-12-22T08:42:02.317178+0000","last_peered":"2023-12-22T08:42:02.317178+0000","last_clean":"2023-12-22T08:42:02.317178+0000","last_became_active":"2023-12-22T08:42:00.461934+0000","last_became_peered":"2023-12-22T08:42:00.461934+0000","last_unstale":"2023-12-22T08:42:02.317178+0000","last_undegraded":"2023-12-22T08:42:02.317178+0000","last_fullsized":"2023-12-22T08:42:02.317178+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:47.774548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857513+0000","last_change":"2023-12-22T08:42:00.957685+0000","last_active":"2023-12-22T08:42:02.857513+0000","last_peered":"2023-12-22T08:42:02.857513+0000","last_clean":"2023-12-22T08:42:02.857513+0000","last_became_active":"2023-12-22T08:42:00.957456+0000","last_became_peered":"2023-12-22T08:42:00.957456+0000","last_unstale":"2023-12-22T08:42:02.857513+0000","last_undegraded":"2023-12-22T08:42:02.857513+0000","last_fullsized":"2023-12-22T08:42:02.857513+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:14:10.653460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031994+0000","last_change":"2023-12-22T08:42:00.453359+0000","last_active":"2023-12-22T08:42:03.031994+0000","last_peered":"2023-12-22T08:42:03.031994+0000","last_clean":"2023-12-22T08:42:03.031994+0000","last_became_active":"2023-12-22T08:42:00.452634+0000","last_became_peered":"2023-12-22T08:42:00.452634+0000","last_unstale":"2023-12-22T08:42:03.031994+0000","last_undegraded":"2023-12-22T08:42:03.031994+0000","last_fullsized":"2023-12-22T08:42:03.031994+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:25:12.295524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.856877+0000","last_change":"2023-12-22T08:42:00.955109+0000","last_active":"2023-12-22T08:42:02.856877+0000","last_peered":"2023-12-22T08:42:02.856877+0000","last_clean":"2023-12-22T08:42:02.856877+0000","last_became_active":"2023-12-22T08:42:00.954638+0000","last_became_peered":"2023-12-22T08:42:00.954638+0000","last_unstale":"2023-12-22T08:42:02.856877+0000","last_undegraded":"2023-12-22T08:42:02.856877+0000","last_fullsized":"2023-12-22T08:42:02.856877+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:10:43.718978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945536+0000","last_change":"2023-12-22T08:42:00.467620+0000","last_active":"2023-12-22T08:42:01.945536+0000","last_peered":"2023-12-22T08:42:01.945536+0000","last_clean":"2023-12-22T08:42:01.945536+0000","last_became_active":"2023-12-22T08:42:00.467426+0000","last_became_peered":"2023-12-22T08:42:00.467426+0000","last_unstale":"2023-12-22T08:42:01.945536+0000","last_undegraded":"2023-12-22T08:42:01.945536+0000","last_fullsized":"2023-12-22T08:42:01.945536+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:31:21.211442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.947538+0000","last_change":"2023-12-22T08:42:00.969869+0000","last_active":"2023-12-22T08:42:01.947538+0000","last_peered":"2023-12-22T08:42:01.947538+0000","last_clean":"2023-12-22T08:42:01.947538+0000","last_became_active":"2023-12-22T08:42:00.969277+0000","last_became_peered":"2023-12-22T08:42:00.969277+0000","last_unstale":"2023-12-22T08:42:01.947538+0000","last_undegraded":"2023-12-22T08:42:01.947538+0000","last_fullsized":"2023-12-22T08:42:01.947538+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:27.697741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945549+0000","last_change":"2023-12-22T08:42:00.465923+0000","last_active":"2023-12-22T08:42:01.945549+0000","last_peered":"2023-12-22T08:42:01.945549+0000","last_clean":"2023-12-22T08:42:01.945549+0000","last_became_active":"2023-12-22T08:42:00.465755+0000","last_became_peered":"2023-12-22T08:42:00.465755+0000","last_unstale":"2023-12-22T08:42:01.945549+0000","last_undegraded":"2023-12-22T08:42:01.945549+0000","last_fullsized":"2023-12-22T08:42:01.945549+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:09:27.754470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945324+0000","last_change":"2023-12-22T08:42:00.959846+0000","last_active":"2023-12-22T08:42:01.945324+0000","last_peered":"2023-12-22T08:42:01.945324+0000","last_clean":"2023-12-22T08:42:01.945324+0000","last_became_active":"2023-12-22T08:42:00.959105+0000","last_became_peered":"2023-12-22T08:42:00.959105+0000","last_unstale":"2023-12-22T08:42:01.945324+0000","last_undegraded":"2023-12-22T08:42:01.945324+0000","last_fullsized":"2023-12-22T08:42:01.945324+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:03:42.250079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858518+0000","last_change":"2023-12-22T08:42:00.456873+0000","last_active":"2023-12-22T08:42:02.858518+0000","last_peered":"2023-12-22T08:42:02.858518+0000","last_clean":"2023-12-22T08:42:02.858518+0000","last_became_active":"2023-12-22T08:42:00.456242+0000","last_became_peered":"2023-12-22T08:42:00.456242+0000","last_unstale":"2023-12-22T08:42:02.858518+0000","last_undegraded":"2023-12-22T08:42:02.858518+0000","last_fullsized":"2023-12-22T08:42:02.858518+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:50.145111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317258+0000","last_change":"2023-12-22T08:42:00.972487+0000","last_active":"2023-12-22T08:42:02.317258+0000","last_peered":"2023-12-22T08:42:02.317258+0000","last_clean":"2023-12-22T08:42:02.317258+0000","last_became_active":"2023-12-22T08:42:00.972259+0000","last_became_peered":"2023-12-22T08:42:00.972259+0000","last_unstale":"2023-12-22T08:42:02.317258+0000","last_undegraded":"2023-12-22T08:42:02.317258+0000","last_fullsized":"2023-12-22T08:42:02.317258+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:34:59.089610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317444+0000","last_change":"2023-12-22T08:42:00.463010+0000","last_active":"2023-12-22T08:42:02.317444+0000","last_peered":"2023-12-22T08:42:02.317444+0000","last_clean":"2023-12-22T08:42:02.317444+0000","last_became_active":"2023-12-22T08:42:00.462514+0000","last_became_peered":"2023-12-22T08:42:00.462514+0000","last_unstale":"2023-12-22T08:42:02.317444+0000","last_undegraded":"2023-12-22T08:42:02.317444+0000","last_fullsized":"2023-12-22T08:42:02.317444+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:31.927548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858094+0000","last_change":"2023-12-22T08:42:00.973668+0000","last_active":"2023-12-22T08:42:02.858094+0000","last_peered":"2023-12-22T08:42:02.858094+0000","last_clean":"2023-12-22T08:42:02.858094+0000","last_became_active":"2023-12-22T08:42:00.970441+0000","last_became_peered":"2023-12-22T08:42:00.970441+0000","last_unstale":"2023-12-22T08:42:02.858094+0000","last_undegraded":"2023-12-22T08:42:02.858094+0000","last_fullsized":"2023-12-22T08:42:02.858094+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:50.399111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030363+0000","last_change":"2023-12-22T08:42:00.460226+0000","last_active":"2023-12-22T08:42:03.030363+0000","last_peered":"2023-12-22T08:42:03.030363+0000","last_clean":"2023-12-22T08:42:03.030363+0000","last_became_active":"2023-12-22T08:42:00.459621+0000","last_became_peered":"2023-12-22T08:42:00.459621+0000","last_unstale":"2023-12-22T08:42:03.030363+0000","last_undegraded":"2023-12-22T08:42:03.030363+0000","last_fullsized":"2023-12-22T08:42:03.030363+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:18:27.880824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.032303+0000","last_change":"2023-12-22T08:42:00.960870+0000","last_active":"2023-12-22T08:42:03.032303+0000","last_peered":"2023-12-22T08:42:03.032303+0000","last_clean":"2023-12-22T08:42:03.032303+0000","last_became_active":"2023-12-22T08:42:00.960617+0000","last_became_peered":"2023-12-22T08:42:00.960617+0000","last_unstale":"2023-12-22T08:42:03.032303+0000","last_undegraded":"2023-12-22T08:42:03.032303+0000","last_fullsized":"2023-12-22T08:42:03.032303+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:13.650363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317951+0000","last_change":"2023-12-22T08:42:00.469175+0000","last_active":"2023-12-22T08:42:02.317951+0000","last_peered":"2023-12-22T08:42:02.317951+0000","last_clean":"2023-12-22T08:42:02.317951+0000","last_became_active":"2023-12-22T08:42:00.465274+0000","last_became_peered":"2023-12-22T08:42:00.465274+0000","last_unstale":"2023-12-22T08:42:02.317951+0000","last_undegraded":"2023-12-22T08:42:02.317951+0000","last_fullsized":"2023-12-22T08:42:02.317951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:13.693173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031774+0000","last_change":"2023-12-22T08:42:00.971776+0000","last_active":"2023-12-22T08:42:03.031774+0000","last_peered":"2023-12-22T08:42:03.031774+0000","last_clean":"2023-12-22T08:42:03.031774+0000","last_became_active":"2023-12-22T08:42:00.971550+0000","last_became_peered":"2023-12-22T08:42:00.971550+0000","last_unstale":"2023-12-22T08:42:03.031774+0000","last_undegraded":"2023-12-22T08:42:03.031774+0000","last_fullsized":"2023-12-22T08:42:03.031774+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:34:59.089610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946962+0000","last_change":"2023-12-22T08:42:00.462513+0000","last_active":"2023-12-22T08:42:01.946962+0000","last_peered":"2023-12-22T08:42:01.946962+0000","last_clean":"2023-12-22T08:42:01.946962+0000","last_became_active":"2023-12-22T08:42:00.462281+0000","last_became_peered":"2023-12-22T08:42:00.462281+0000","last_unstale":"2023-12-22T08:42:01.946962+0000","last_undegraded":"2023-12-22T08:42:01.946962+0000","last_fullsized":"2023-12-22T08:42:01.946962+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:12.635858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.946059+0000","last_change":"2023-12-22T08:42:00.968564+0000","last_active":"2023-12-22T08:42:01.946059+0000","last_peered":"2023-12-22T08:42:01.946059+0000","last_clean":"2023-12-22T08:42:01.946059+0000","last_became_active":"2023-12-22T08:42:00.968310+0000","last_became_peered":"2023-12-22T08:42:00.968310+0000","last_unstale":"2023-12-22T08:42:01.946059+0000","last_undegraded":"2023-12-22T08:42:01.946059+0000","last_fullsized":"2023-12-22T08:42:01.946059+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:16:12.276406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031965+0000","last_change":"2023-12-22T08:42:00.466452+0000","last_active":"2023-12-22T08:42:03.031965+0000","last_peered":"2023-12-22T08:42:03.031965+0000","last_clean":"2023-12-22T08:42:03.031965+0000","last_became_active":"2023-12-22T08:42:00.466247+0000","last_became_peered":"2023-12-22T08:42:00.466247+0000","last_unstale":"2023-12-22T08:42:03.031965+0000","last_undegraded":"2023-12-22T08:42:03.031965+0000","last_fullsized":"2023-12-22T08:42:03.031965+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:38.031039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317632+0000","last_change":"2023-12-22T08:42:00.961864+0000","last_active":"2023-12-22T08:42:02.317632+0000","last_peered":"2023-12-22T08:42:02.317632+0000","last_clean":"2023-12-22T08:42:02.317632+0000","last_became_active":"2023-12-22T08:42:00.960926+0000","last_became_peered":"2023-12-22T08:42:00.960926+0000","last_unstale":"2023-12-22T08:42:02.317632+0000","last_undegraded":"2023-12-22T08:42:02.317632+0000","last_fullsized":"2023-12-22T08:42:02.317632+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:19:23.877328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030613+0000","last_change":"2023-12-22T08:42:00.459898+0000","last_active":"2023-12-22T08:42:03.030613+0000","last_peered":"2023-12-22T08:42:03.030613+0000","last_clean":"2023-12-22T08:42:03.030613+0000","last_became_active":"2023-12-22T08:42:00.459266+0000","last_became_peered":"2023-12-22T08:42:00.459266+0000","last_unstale":"2023-12-22T08:42:03.030613+0000","last_undegraded":"2023-12-22T08:42:03.030613+0000","last_fullsized":"2023-12-22T08:42:03.030613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:25:12.295524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945349+0000","last_change":"2023-12-22T08:42:00.969733+0000","last_active":"2023-12-22T08:42:01.945349+0000","last_peered":"2023-12-22T08:42:01.945349+0000","last_clean":"2023-12-22T08:42:01.945349+0000","last_became_active":"2023-12-22T08:42:00.969302+0000","last_became_peered":"2023-12-22T08:42:00.969302+0000","last_unstale":"2023-12-22T08:42:01.945349+0000","last_undegraded":"2023-12-22T08:42:01.945349+0000","last_fullsized":"2023-12-22T08:42:01.945349+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:51:25.572124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857926+0000","last_change":"2023-12-22T08:42:00.466131+0000","last_active":"2023-12-22T08:42:02.857926+0000","last_peered":"2023-12-22T08:42:02.857926+0000","last_clean":"2023-12-22T08:42:02.857926+0000","last_became_active":"2023-12-22T08:42:00.465733+0000","last_became_peered":"2023-12-22T08:42:00.465733+0000","last_unstale":"2023-12-22T08:42:02.857926+0000","last_undegraded":"2023-12-22T08:42:02.857926+0000","last_fullsized":"2023-12-22T08:42:02.857926+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:02:55.033830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.317314+0000","last_change":"2023-12-22T08:42:00.970683+0000","last_active":"2023-12-22T08:42:02.317314+0000","last_peered":"2023-12-22T08:42:02.317314+0000","last_clean":"2023-12-22T08:42:02.317314+0000","last_became_active":"2023-12-22T08:42:00.969879+0000","last_became_peered":"2023-12-22T08:42:00.969879+0000","last_unstale":"2023-12-22T08:42:02.317314+0000","last_undegraded":"2023-12-22T08:42:02.317314+0000","last_fullsized":"2023-12-22T08:42:02.317314+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:13.650363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.030863+0000","last_change":"2023-12-22T08:42:00.457271+0000","last_active":"2023-12-22T08:42:03.030863+0000","last_peered":"2023-12-22T08:42:03.030863+0000","last_clean":"2023-12-22T08:42:03.030863+0000","last_became_active":"2023-12-22T08:42:00.457022+0000","last_became_peered":"2023-12-22T08:42:00.457022+0000","last_unstale":"2023-12-22T08:42:03.030863+0000","last_undegraded":"2023-12-22T08:42:03.030863+0000","last_fullsized":"2023-12-22T08:42:03.030863+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:50.548955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.032417+0000","last_change":"2023-12-22T08:42:00.962279+0000","last_active":"2023-12-22T08:42:03.032417+0000","last_peered":"2023-12-22T08:42:03.032417+0000","last_clean":"2023-12-22T08:42:03.032417+0000","last_became_active":"2023-12-22T08:42:00.962035+0000","last_became_peered":"2023-12-22T08:42:00.962035+0000","last_unstale":"2023-12-22T08:42:03.032417+0000","last_undegraded":"2023-12-22T08:42:03.032417+0000","last_fullsized":"2023-12-22T08:42:03.032417+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:35:47.196465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.947535+0000","last_change":"2023-12-22T08:42:00.464884+0000","last_active":"2023-12-22T08:42:01.947535+0000","last_peered":"2023-12-22T08:42:01.947535+0000","last_clean":"2023-12-22T08:42:01.947535+0000","last_became_active":"2023-12-22T08:42:00.464662+0000","last_became_peered":"2023-12-22T08:42:00.464662+0000","last_unstale":"2023-12-22T08:42:01.947535+0000","last_undegraded":"2023-12-22T08:42:01.947535+0000","last_fullsized":"2023-12-22T08:42:01.947535+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:11:09.975719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945861+0000","last_change":"2023-12-22T08:42:00.961166+0000","last_active":"2023-12-22T08:42:01.945861+0000","last_peered":"2023-12-22T08:42:01.945861+0000","last_clean":"2023-12-22T08:42:01.945861+0000","last_became_active":"2023-12-22T08:42:00.960854+0000","last_became_peered":"2023-12-22T08:42:00.960854+0000","last_unstale":"2023-12-22T08:42:01.945861+0000","last_undegraded":"2023-12-22T08:42:01.945861+0000","last_fullsized":"2023-12-22T08:42:01.945861+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:26:00.298884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.858523+0000","last_change":"2023-12-22T08:42:00.460482+0000","last_active":"2023-12-22T08:42:02.858523+0000","last_peered":"2023-12-22T08:42:02.858523+0000","last_clean":"2023-12-22T08:42:02.858523+0000","last_became_active":"2023-12-22T08:42:00.459346+0000","last_became_peered":"2023-12-22T08:42:00.459346+0000","last_unstale":"2023-12-22T08:42:02.858523+0000","last_undegraded":"2023-12-22T08:42:02.858523+0000","last_fullsized":"2023-12-22T08:42:02.858523+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:25:59.284379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.945237+0000","last_change":"2023-12-22T08:42:00.956873+0000","last_active":"2023-12-22T08:42:01.945237+0000","last_peered":"2023-12-22T08:42:01.945237+0000","last_clean":"2023-12-22T08:42:01.945237+0000","last_became_active":"2023-12-22T08:42:00.956517+0000","last_became_peered":"2023-12-22T08:42:00.956517+0000","last_unstale":"2023-12-22T08:42:01.945237+0000","last_undegraded":"2023-12-22T08:42:01.945237+0000","last_fullsized":"2023-12-22T08:42:01.945237+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:35:47.196465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.857110+0000","last_change":"2023-12-22T08:42:00.469313+0000","last_active":"2023-12-22T08:42:02.857110+0000","last_peered":"2023-12-22T08:42:02.857110+0000","last_clean":"2023-12-22T08:42:02.857110+0000","last_became_active":"2023-12-22T08:42:00.469106+0000","last_became_peered":"2023-12-22T08:42:00.469106+0000","last_unstale":"2023-12-22T08:42:02.857110+0000","last_undegraded":"2023-12-22T08:42:02.857110+0000","last_fullsized":"2023-12-22T08:42:02.857110+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:24:26.917050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:03.031601+0000","last_change":"2023-12-22T08:42:00.968645+0000","last_active":"2023-12-22T08:42:03.031601+0000","last_peered":"2023-12-22T08:42:03.031601+0000","last_clean":"2023-12-22T08:42:03.031601+0000","last_became_active":"2023-12-22T08:42:00.968397+0000","last_became_peered":"2023-12-22T08:42:00.968397+0000","last_unstale":"2023-12-22T08:42:03.031601+0000","last_undegraded":"2023-12-22T08:42:03.031601+0000","last_fullsized":"2023-12-22T08:42:03.031601+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.426495+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.426495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:48.789053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.947414+0000","last_change":"2023-12-22T08:42:00.460810+0000","last_active":"2023-12-22T08:42:01.947414+0000","last_peered":"2023-12-22T08:42:01.947414+0000","last_clean":"2023-12-22T08:42:01.947414+0000","last_became_active":"2023-12-22T08:42:00.460559+0000","last_became_peered":"2023-12-22T08:42:00.460559+0000","last_unstale":"2023-12-22T08:42:01.947414+0000","last_undegraded":"2023-12-22T08:42:01.947414+0000","last_fullsized":"2023-12-22T08:42:01.947414+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.411990+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.411990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:31:06.938160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T08:42:00.949892+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:42:00.949892+0000","last_peered":"2023-12-22T08:42:00.949892+0000","last_clean":"2023-12-22T08:42:00.949892+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:42:00.949892+0000","last_undegraded":"2023-12-22T08:42:00.949892+0000","last_fullsized":"2023-12-22T08:42:00.949892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0780000000000001,"15min":1.079},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.466,"5min":1.506,"15min":1.506},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.127,"5min":1.0660000000000001,"15min":1.056},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.51,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.92400000000000004}]},{"osd":1,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.165,"15min":1.155},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.905},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1319999999999999,"15min":1.1220000000000001},"min":{"1min":0.86499999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.472,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.865}]},{"osd":2,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.0620000000000001,"15min":1.048},"min":{"1min":0.745,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.5629999999999999,"5min":1.716,"15min":1.716},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.232,"15min":1.23},"min":{"1min":0.89800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.677,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.742}]},{"osd":3,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.0960000000000001,"15min":1.0800000000000001},"min":{"1min":0.81100000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.2729999999999999,"15min":1.2709999999999999},"min":{"1min":0.874,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6839999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.8240000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.198,"15min":1.196},"min":{"1min":0.86599999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5569999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.48},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2669999999999999,"15min":1.2629999999999999},"min":{"1min":0.90200000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.649,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.5780000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.3819999999999999,"15min":1.3700000000000001},"min":{"1min":1.2030000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.835,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.411},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3740000000000001,"15min":1.3720000000000001},"min":{"1min":0.80800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.635,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.645}]},{"osd":6,"last update":"Fri Dec 22 08:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.4930000000000001,"15min":1.4870000000000001},"min":{"1min":1.2390000000000001,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7450000000000001,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":2.1259999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.488,"15min":1.484},"min":{"1min":1.0069999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.893,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.7849999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767308,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.1040000000000001,"15min":1.127},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2649999999999999,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.996,"5min":1.0640000000000001,"15min":1.075},"min":{"1min":0.73899999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.1719999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0209999999999999,"15min":1.0129999999999999},"min":{"1min":0.72899999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.4830000000000001,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1539999999999999,"15min":1.1579999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.1160000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.26,"15min":1.274},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5449999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.258},{"interface":"front","average":{"1min":1.202,"5min":1.147,"15min":1.1379999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.5089999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.2929999999999999,"15min":1.2909999999999999},"min":{"1min":1.0669999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.6379999999999999,"5min":1.847,"15min":1.847},"last":1.645},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.228,"15min":1.226},"min":{"1min":0.84899999999999998,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.077}]},{"osd":4,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3919999999999999,"15min":1.4079999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.8600000000000001,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.421},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3959999999999999,"15min":1.401},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.744,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.7430000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.353,"15min":1.361},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.302},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.5740000000000001,"15min":1.599},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.0030000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.6890000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.587,"15min":1.593},"min":{"1min":1.2869999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":1.9870000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.8660000000000001},{"interface":"front","average":{"1min":1.492,"5min":1.5509999999999999,"15min":1.5609999999999999},"min":{"1min":1.101,"5min":1.101,"15min":1.101},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.589}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194516,"statfs":{"total":200000000,"available":199184853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0629999999999999,"15min":1.071},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.135},{"interface":"front","average":{"1min":1.113,"5min":1.1359999999999999,"15min":1.1399999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.2690000000000001,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.1799999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.72499999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.3129999999999999,"5min":2.79,"15min":2.79},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.006,"15min":1.004},"min":{"1min":0.69099999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.379,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.97699999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.1299999999999999,"15min":1.1259999999999999},"min":{"1min":0.84499999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.6279999999999999,"5min":1.72,"15min":1.72},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.151,"15min":1.155},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5269999999999999,"5min":1.978,"15min":1.978},"last":0.78200000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1599999999999999,"15min":1.155},"min":{"1min":0.85099999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2270000000000001,"15min":1.2310000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.0329999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2430000000000001,"15min":1.2470000000000001},"min":{"1min":0.90600000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.262,"15min":1.2549999999999999},"min":{"1min":0.87,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5229999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.095}]},{"osd":6,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3120000000000001,"15min":1.3109999999999999},"min":{"1min":0.92200000000000004,"5min":0.749,"15min":0.749},"max":{"1min":1.5369999999999999,"5min":1.821,"15min":1.821},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.411,"5min":1.4259999999999999,"15min":1.4279999999999999},"min":{"1min":1.1319999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.7609999999999999,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.5629999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:41:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3660000000000001,"15min":1.365},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.671,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.506},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.577,"15min":1.587},"min":{"1min":1.2649999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.3610000000000002,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":1.405}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":228,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766268,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":1.002,"15min":1.0049999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.284,"5min":1.552,"15min":1.552},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.0980000000000001,"15min":1.091},"min":{"1min":0.69099999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.72499999999999998}]},{"osd":1,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0289999999999999,"15min":1.0249999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5149999999999999,"5min":1.669,"15min":1.669},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.107,"15min":1.1080000000000001},"min":{"1min":0.74099999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4179999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.794}]},{"osd":2,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1399999999999999,"15min":1.1379999999999999},"min":{"1min":0.82899999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.5700000000000001,"5min":1.625,"15min":1.625},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.1870000000000001,"15min":1.1899999999999999},"min":{"1min":0.86199999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.528,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.236}]},{"osd":3,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.196,"15min":1.1899999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5669999999999999,"5min":1.774,"15min":1.774},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.1919999999999999,"15min":1.1839999999999999},"min":{"1min":0.88200000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.587,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.8280000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1319999999999999,"15min":1.121},"min":{"1min":0.82599999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.3},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.375,"15min":1.367},"min":{"1min":1.133,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7849999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.3620000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2250000000000001,"15min":1.218},"min":{"1min":1.0229999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.498,"5min":1.798,"15min":1.798},"last":1.131},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.1910000000000001,"15min":1.1739999999999999},"min":{"1min":0.96899999999999997,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.4339999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.333,"15min":1.3120000000000001},"min":{"1min":1.0720000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.675,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.593},{"interface":"front","average":{"1min":1.454,"5min":1.4019999999999999,"15min":1.3939999999999999},"min":{"1min":1.2030000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.7829999999999999,"5min":1.923,"15min":1.923},"last":1.9199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":228,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766360,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.93600000000000005,"15min":0.96699999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.90700000000000003,"15min":0.92800000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.294,"5min":1.429,"15min":1.429},"last":1.355}]},{"osd":1,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.84199999999999997,"15min":0.85299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.109,"5min":1.29,"15min":1.29},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0820000000000001,"15min":1.1020000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.091}]},{"osd":2,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.022,"15min":1.032},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5289999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.107,"15min":1.115},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.997}]},{"osd":4,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1859999999999999,"15min":1.1919999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7470000000000001,"5min":1.895,"15min":1.895},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.204,"15min":1.212},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.97199999999999998}]},{"osd":5,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.242,"15min":1.25},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.621,"5min":1.804,"15min":1.804},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.234,"5min":1.413,"15min":1.4430000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6599999999999999,"5min":1.966,"15min":1.966},"last":1.1479999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.417,"15min":1.4370000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7310000000000001,"5min":1.925,"15min":1.925},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.365,"15min":1.3819999999999999},"min":{"1min":0.94899999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.665,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.4179999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:41:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.339,"15min":1.357},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.47},{"interface":"front","average":{"1min":1.302,"5min":1.3680000000000001,"15min":1.379},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.6060000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.0349999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767834,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.73099999999999998,"15min":0.70599999999999996},"min":{"1min":0.64100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":6.8879999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.91600000000000004,"15min":0.93000000000000005},"min":{"1min":0.46000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.1619999999999999,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":4.5510000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.90400000000000003,"15min":0.89900000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.504,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":11.308999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89900000000000002,"15min":0.88800000000000001},"min":{"1min":0.58099999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.4650000000000001,"5min":2.226,"15min":2.226},"last":2.4910000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":0.97199999999999998,"15min":0.95899999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.633,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":13.087999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.0349999999999999,"15min":1.008},"min":{"1min":0.754,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.7649999999999999,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":12.289999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.226,"15min":1.204},"min":{"1min":0.91900000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.667,"5min":1.919,"15min":1.919},"last":3.5089999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.3100000000000001,"15min":1.3260000000000001},"min":{"1min":0.623,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5840000000000001,"5min":5.4560000000000004,"15min":5.4560000000000004},"last":13.927}]},{"osd":5,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.3420000000000001,"15min":1.3560000000000001},"min":{"1min":0.78600000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7,"5min":5.569,"15min":5.569},"last":11.003},{"interface":"front","average":{"1min":1.252,"5min":1.21,"15min":1.2030000000000001},"min":{"1min":0.83699999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.7170000000000001,"5min":3.04,"15min":3.04},"last":13.129}]},{"osd":6,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.24,"15min":1.22},"min":{"1min":0.86599999999999999,"5min":0.751,"15min":0.751},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":8.1609999999999996},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3320000000000001,"15min":1.321},"min":{"1min":1.046,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.873,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":6.8150000000000004}]},{"osd":7,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3520000000000001,"15min":1.3480000000000001},"min":{"1min":0.91500000000000004,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.802,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":10.948},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3029999999999999,"15min":1.29},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.7789999999999999,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":8.0980000000000008}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":803,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177486,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.88500000000000001,"15min":0.89500000000000002},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.143,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.034},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.98599999999999999,"15min":0.997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.4259999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.2330000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.93300000000000005,"15min":0.94299999999999995},"min":{"1min":0.55900000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.298,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.93400000000000005,"15min":0.93700000000000006},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.5580000000000001,"5min":2.254,"15min":2.254},"last":0.91900000000000004}]},{"osd":3,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.135,"15min":1.145},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6120000000000001,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.3100000000000001},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.94399999999999995,"15min":0.95799999999999996},"min":{"1min":0.51900000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3460000000000001,"5min":1.766,"15min":1.766},"last":0.85099999999999998}]},{"osd":4,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.2549999999999999,"15min":1.268},"min":{"1min":0.878,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.589,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.395},{"interface":"front","average":{"1min":1.351,"5min":1.3109999999999999,"15min":1.3049999999999999},"min":{"1min":0.91800000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.9019999999999999,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.3640000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.71599999999999997,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.645,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.302,"15min":1.3120000000000001},"min":{"1min":0.873,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4650000000000001,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.5920000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2390000000000001,"15min":1.24},"min":{"1min":0.84499999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.853,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.171},{"interface":"front","average":{"1min":1.306,"5min":1.3460000000000001,"15min":1.353},"min":{"1min":0.72299999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.746,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.502}]},{"osd":7,"last update":"Fri Dec 22 08:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.353,"15min":1.339},"min":{"1min":0.76900000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.02,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.371,"15min":1.397},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.974,"5min":3.2959999999999998,"15min":3.2959999999999998},"last":1.343}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70899999999999996},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.95299999999999996,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.435},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.878,"15min":0.89000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.367,"5min":1.391,"15min":1.391},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.998,"15min":0.998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.6319999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0329999999999999,"15min":1.0229999999999999},"min":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.72599999999999998}]},{"osd":4,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.2490000000000001,"15min":1.25},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.6379999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.024},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2,"15min":1.1899999999999999},"min":{"1min":0.98499999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.593,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.01}]},{"osd":5,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.246,"15min":1.2470000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.90600000000000003}]},{"osd":6,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.2609999999999999,"15min":1.2589999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.76,"5min":1.863,"15min":1.863},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3660000000000001,"15min":1.3720000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.7230000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.0409999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:41:53 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3400000000000001,"15min":1.3480000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.673,"5min":1.79,"15min":1.79},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3580000000000001,"15min":1.3600000000000001},"min":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.9850000000000001,"5min":2.214,"15min":2.214},"last":0.749}]}]}],"pool_statfs":[]}} 2023-12-22T08:42:05.966 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T08:42:05.967 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T08:42:06.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.247+0000 7f9d91eca640 1 Processor -- start 2023-12-22T08:42:06.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.247+0000 7f9d91eca640 1 -- start start 2023-12-22T08:42:06.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.249+0000 7f9d91eca640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9d8c15b2f0 0x7f9d8c071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:06.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.249+0000 7f9d91eca640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d8c0b3600 0x7f9d8c0b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:06.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.249+0000 7f9d91eca640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c070770 con 0x7f9d8c0b4340 2023-12-22T08:42:06.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.249+0000 7f9d91eca640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8c071360 con 0x7f9d8c15b2f0 2023-12-22T08:42:06.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.249+0000 7f9d91eca640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0b3fd0 con 0x7f9d8c0b3600 2023-12-22T08:42:06.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.250+0000 7f9d8b7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9d8c15b2f0 0x7f9d8c071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:06.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.250+0000 7f9d8bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d8c0b3600 0x7f9d8c0b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:06.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.250+0000 7f9d82ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9d8c0b4340 0x7f9d8c0cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:44994/0 (socket says 172.21.15.38:44994) 2023-12-22T08:42:06.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.250+0000 7f9d82ffd640 1 -- 172.21.15.38:0/3680702855 learned_addr learned my addr 172.21.15.38:0/3680702855 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:06.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.251+0000 7f9d8b7fe640 1 -- 172.21.15.38:0/3680702855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d8c0b3600 msgr2=0x7f9d8c0b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:06.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.251+0000 7f9d8b7fe640 1 --2- 172.21.15.38:0/3680702855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d8c0b3600 0x7f9d8c0b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.251+0000 7f9d8b7fe640 1 -- 172.21.15.38:0/3680702855 >> v1:172.21.15.89:6789/0 conn(0x7f9d8c0b4340 legacy=0x7f9d8c0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:06.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.251+0000 7f9d8b7fe640 1 -- 172.21.15.38:0/3680702855 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c0709c0 con 0x7f9d8c15b2f0 2023-12-22T08:42:06.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.252+0000 7f9d8b7fe640 1 --2- 172.21.15.38:0/3680702855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d8c15b2f0 0x7f9d8c071780 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009d90 tx=0x7f9d7c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6fbf8ed3539f3fb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:06.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.253+0000 7f9d8affd640 1 -- 172.21.15.38:0/3680702855 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c02cbc0 con 0x7f9d8c15b2f0 2023-12-22T08:42:06.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.253+0000 7f9d8affd640 1 -- 172.21.15.38:0/3680702855 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c02cd20 con 0x7f9d8c15b2f0 2023-12-22T08:42:06.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.253+0000 7f9d8affd640 1 -- 172.21.15.38:0/3680702855 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c034660 con 0x7f9d8c15b2f0 2023-12-22T08:42:06.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.254+0000 7f9d91eca640 1 -- 172.21.15.38:0/3680702855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d8c15b2f0 msgr2=0x7f9d8c071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:06.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.254+0000 7f9d91eca640 1 --2- 172.21.15.38:0/3680702855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d8c15b2f0 0x7f9d8c071780 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009d90 tx=0x7f9d7c02be10 comp rx=0 tx=0).stop 2023-12-22T08:42:06.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.254+0000 7f9d91eca640 1 -- 172.21.15.38:0/3680702855 shutdown_connections 2023-12-22T08:42:06.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.254+0000 7f9d91eca640 1 --2- 172.21.15.38:0/3680702855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d8c0b3600 0x7f9d8c0b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.254+0000 7f9d91eca640 1 --2- 172.21.15.38:0/3680702855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d8c15b2f0 0x7f9d8c071780 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.254+0000 7f9d91eca640 1 -- 172.21.15.38:0/3680702855 >> 172.21.15.38:0/3680702855 conn(0x7f9d8c06f880 msgr2=0x7f9d8c0b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:06.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.254+0000 7f9d91eca640 1 -- 172.21.15.38:0/3680702855 shutdown_connections 2023-12-22T08:42:06.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.254+0000 7f9d91eca640 1 -- 172.21.15.38:0/3680702855 wait complete. 2023-12-22T08:42:06.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.256+0000 7f9d91eca640 1 Processor -- start 2023-12-22T08:42:06.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.256+0000 7f9d91eca640 1 -- start start 2023-12-22T08:42:06.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.257+0000 7f9d91eca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d8c0b3600 0x7f9d8c155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:06.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.257+0000 7f9d91eca640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d8c0b4340 0x7f9d8c1e03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:06.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.257+0000 7f9d91eca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d8c15b2f0 0x7f9d8c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:06.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.257+0000 7f9d91eca640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1e0d30 con 0x7f9d8c0b3600 2023-12-22T08:42:06.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.257+0000 7f9d91eca640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1e1010 con 0x7f9d8c15b2f0 2023-12-22T08:42:06.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.257+0000 7f9d91eca640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1e12f0 con 0x7f9d8c0b4340 2023-12-22T08:42:06.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.257+0000 7f9d8b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d8c0b3600 0x7f9d8c155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:06.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.257+0000 7f9d8b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d8c0b3600 0x7f9d8c155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57854/0 (socket says 172.21.15.38:57854) 2023-12-22T08:42:06.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.257+0000 7f9d8b7fe640 1 -- 172.21.15.38:0/692292537 learned_addr learned my addr 172.21.15.38:0/692292537 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:06.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.258+0000 7f9d8bfff640 1 --2- 172.21.15.38:0/692292537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d8c15b2f0 0x7f9d8c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:06.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.258+0000 7f9d8b7fe640 1 -- 172.21.15.38:0/692292537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d8c0b4340 msgr2=0x7f9d8c1e03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:06.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.258+0000 7f9d8b7fe640 1 --2- 172.21.15.38:0/692292537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d8c0b4340 0x7f9d8c1e03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.258+0000 7f9d8b7fe640 1 -- 172.21.15.38:0/692292537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d8c15b2f0 msgr2=0x7f9d8c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:06.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.258+0000 7f9d8b7fe640 1 --2- 172.21.15.38:0/692292537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d8c15b2f0 0x7f9d8c0ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.258+0000 7f9d8b7fe640 1 -- 172.21.15.38:0/692292537 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c009a70 con 0x7f9d8c0b3600 2023-12-22T08:42:06.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.258+0000 7f9d8b7fe640 1 --2- 172.21.15.38:0/692292537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d8c0b3600 0x7f9d8c155ff0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009d90 tx=0x7f9d7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:06.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.258+0000 7f9d88ff9640 1 -- 172.21.15.38:0/692292537 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c040650 con 0x7f9d8c0b3600 2023-12-22T08:42:06.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.258+0000 7f9d88ff9640 1 -- 172.21.15.38:0/692292537 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c02ce90 con 0x7f9d8c0b3600 2023-12-22T08:42:06.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.259+0000 7f9d88ff9640 1 -- 172.21.15.38:0/692292537 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0409f0 con 0x7f9d8c0b3600 2023-12-22T08:42:06.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.259+0000 7f9d91eca640 1 -- 172.21.15.38:0/692292537 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c1e15d0 con 0x7f9d8c0b3600 2023-12-22T08:42:06.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.259+0000 7f9d91eca640 1 -- 172.21.15.38:0/692292537 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c156530 con 0x7f9d8c0b3600 2023-12-22T08:42:06.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.260+0000 7f9d91eca640 1 -- 172.21.15.38:0/692292537 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c1e4300 con 0x7f9d8c0b3600 2023-12-22T08:42:06.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.261+0000 7f9d88ff9640 1 -- 172.21.15.38:0/692292537 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9d7c040b50 con 0x7f9d8c0b3600 2023-12-22T08:42:06.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.262+0000 7f9d88ff9640 1 --2- 172.21.15.38:0/692292537 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9d6c06a430 0x7f9d6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:06.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.262+0000 7f9d88ff9640 1 -- 172.21.15.38:0/692292537 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d7c0ab6c0 con 0x7f9d8c0b3600 2023-12-22T08:42:06.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.262+0000 7f9d82ffd640 1 --2- 172.21.15.38:0/692292537 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9d6c06a430 0x7f9d6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:06.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.263+0000 7f9d82ffd640 1 --2- 172.21.15.38:0/692292537 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9d6c06a430 0x7f9d6c06c8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c15a3d0 tx=0x7f9d74007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:06.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.266+0000 7f9d88ff9640 1 -- 172.21.15.38:0/692292537 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9d8c1e4300 con 0x7f9d8c0b3600 2023-12-22T08:42:06.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.536+0000 7f9d91eca640 1 -- 172.21.15.38:0/692292537 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9d8c1e46e0 con 0x7f9d8c0b3600 2023-12-22T08:42:06.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.545+0000 7f9d88ff9640 1 -- 172.21.15.38:0/692292537 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9d8c1e46e0 con 0x7f9d8c0b3600 2023-12-22T08:42:06.547 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.0 2023-12-22T08:42:06.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.548+0000 7f9d91eca640 1 -- 172.21.15.38:0/692292537 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9d6c06a430 msgr2=0x7f9d6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:06.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.548+0000 7f9d91eca640 1 --2- 172.21.15.38:0/692292537 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9d6c06a430 0x7f9d6c06c8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c15a3d0 tx=0x7f9d74007a40 comp rx=0 tx=0).stop 2023-12-22T08:42:06.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.548+0000 7f9d91eca640 1 -- 172.21.15.38:0/692292537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d8c0b3600 msgr2=0x7f9d8c155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:06.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.548+0000 7f9d91eca640 1 --2- 172.21.15.38:0/692292537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d8c0b3600 0x7f9d8c155ff0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009d90 tx=0x7f9d7c004a40 comp rx=0 tx=0).stop 2023-12-22T08:42:06.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.548+0000 7f9d91eca640 1 -- 172.21.15.38:0/692292537 shutdown_connections 2023-12-22T08:42:06.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.548+0000 7f9d91eca640 1 --2- 172.21.15.38:0/692292537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d8c15b2f0 0x7f9d8c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.548+0000 7f9d91eca640 1 --2- 172.21.15.38:0/692292537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d8c0b4340 0x7f9d8c1e03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.548+0000 7f9d91eca640 1 --2- 172.21.15.38:0/692292537 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9d6c06a430 0x7f9d6c06c8f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.548+0000 7f9d91eca640 1 --2- 172.21.15.38:0/692292537 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d8c0b3600 0x7f9d8c155ff0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.548+0000 7f9d91eca640 1 -- 172.21.15.38:0/692292537 >> 172.21.15.38:0/692292537 conn(0x7f9d8c06f880 msgr2=0x7f9d8c0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:06.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.548+0000 7f9d91eca640 1 -- 172.21.15.38:0/692292537 shutdown_connections 2023-12-22T08:42:06.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.548+0000 7f9d91eca640 1 -- 172.21.15.38:0/692292537 wait complete. 2023-12-22T08:42:06.569 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:42:06.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.786+0000 7f95b1879640 1 Processor -- start 2023-12-22T08:42:06.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.786+0000 7f95b1879640 1 -- start start 2023-12-22T08:42:06.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.788+0000 7f95b1879640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95ac15b420 0x7f95ac06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:06.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.788+0000 7f95b1879640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f95ac071000 0x7f95ac15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:06.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.788+0000 7f95b1879640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ac0cdae0 con 0x7f95ac0a44a0 2023-12-22T08:42:06.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.788+0000 7f95b1879640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ac06dec0 con 0x7f95ac071000 2023-12-22T08:42:06.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.788+0000 7f95b1879640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ac15b800 con 0x7f95ac15b420 2023-12-22T08:42:06.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.788+0000 7f95b1078640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f95ac071000 0x7f95ac15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:06.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.788+0000 7f95b1078640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f95ac071000 0x7f95ac15baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57860/0 (socket says 172.21.15.38:57860) 2023-12-22T08:42:06.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.788+0000 7f95b1078640 1 -- 172.21.15.38:0/3215151120 learned_addr learned my addr 172.21.15.38:0/3215151120 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:06.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.788+0000 7f95b0877640 1 --2- 172.21.15.38:0/3215151120 >> v2:172.21.15.89:3300/0 conn(0x7f95ac15b420 0x7f95ac06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:06.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.789+0000 7f95b1078640 1 -- 172.21.15.38:0/3215151120 >> v2:172.21.15.89:3300/0 conn(0x7f95ac15b420 msgr2=0x7f95ac06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.789+0000 7f95b1078640 1 --2- 172.21.15.38:0/3215151120 >> v2:172.21.15.89:3300/0 conn(0x7f95ac15b420 0x7f95ac06d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.789+0000 7f95b1078640 1 -- 172.21.15.38:0/3215151120 >> v1:172.21.15.89:6789/0 conn(0x7f95ac0a44a0 legacy=0x7f95ac0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.789+0000 7f95b1078640 1 -- 172.21.15.38:0/3215151120 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac0cdd30 con 0x7f95ac071000 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.789+0000 7f95b0877640 1 --2- 172.21.15.38:0/3215151120 >> v2:172.21.15.89:3300/0 conn(0x7f95ac15b420 0x7f95ac06d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.790+0000 7f95b1078640 1 --2- 172.21.15.38:0/3215151120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac071000 0x7f95ac15baa0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0613e0 tx=0x7f95a402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbf0a585b87bb07 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.790+0000 7f95ab7fe640 1 -- 172.21.15.38:0/3215151120 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a402ca80 con 0x7f95ac071000 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.790+0000 7f95ab7fe640 1 -- 172.21.15.38:0/3215151120 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a402cbe0 con 0x7f95ac071000 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.790+0000 7f95ab7fe640 1 -- 172.21.15.38:0/3215151120 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40343f0 con 0x7f95ac071000 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.791+0000 7f95b1879640 1 -- 172.21.15.38:0/3215151120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac071000 msgr2=0x7f95ac15baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.791+0000 7f95b1879640 1 --2- 172.21.15.38:0/3215151120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac071000 0x7f95ac15baa0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0613e0 tx=0x7f95a402bee0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.791+0000 7f95b1879640 1 -- 172.21.15.38:0/3215151120 shutdown_connections 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.791+0000 7f95b1879640 1 --2- 172.21.15.38:0/3215151120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac071000 0x7f95ac15baa0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.791+0000 7f95b1879640 1 --2- 172.21.15.38:0/3215151120 >> v2:172.21.15.89:3300/0 conn(0x7f95ac15b420 0x7f95ac06d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.791+0000 7f95b1879640 1 -- 172.21.15.38:0/3215151120 >> 172.21.15.38:0/3215151120 conn(0x7f95ac0b1f70 msgr2=0x7f95ac0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:06.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.791+0000 7f95b1879640 1 -- 172.21.15.38:0/3215151120 shutdown_connections 2023-12-22T08:42:06.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.791+0000 7f95b1879640 1 -- 172.21.15.38:0/3215151120 wait complete. 2023-12-22T08:42:06.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.793+0000 7f95b1879640 1 Processor -- start 2023-12-22T08:42:06.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.794+0000 7f95b1879640 1 -- start start 2023-12-22T08:42:06.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.795+0000 7f95b1879640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac071000 0x7f95ac15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:06.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.795+0000 7f95b1879640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95ac0a44a0 0x7f95ac1f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:06.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.795+0000 7f95b1879640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95ac15b420 0x7f95ac1f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:06.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.795+0000 7f95b1879640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac1f6ea0 con 0x7f95ac071000 2023-12-22T08:42:06.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.795+0000 7f95b1879640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac1f3250 con 0x7f95ac0a44a0 2023-12-22T08:42:06.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.795+0000 7f95b1879640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac1f6bc0 con 0x7f95ac15b420 2023-12-22T08:42:06.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.795+0000 7f95b0877640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac071000 0x7f95ac15dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:06.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.795+0000 7f95b0877640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac071000 0x7f95ac15dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57864/0 (socket says 172.21.15.38:57864) 2023-12-22T08:42:06.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.795+0000 7f95b0877640 1 -- 172.21.15.38:0/1431310686 learned_addr learned my addr 172.21.15.38:0/1431310686 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:06.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.796+0000 7f95abfff640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95ac0a44a0 0x7f95ac1f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:06.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.796+0000 7f95b1078640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95ac15b420 0x7f95ac1f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:06.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.796+0000 7f95b0877640 1 -- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95ac15b420 msgr2=0x7f95ac1f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:06.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.796+0000 7f95b0877640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95ac15b420 0x7f95ac1f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.796+0000 7f95b0877640 1 -- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95ac0a44a0 msgr2=0x7f95ac1f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:06.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.796+0000 7f95b0877640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95ac0a44a0 0x7f95ac1f5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:06.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.796+0000 7f95b0877640 1 -- 172.21.15.38:0/1431310686 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a4009b30 con 0x7f95ac071000 2023-12-22T08:42:06.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.796+0000 7f95abfff640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95ac0a44a0 0x7f95ac1f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:06.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.796+0000 7f95b0877640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac071000 0x7f95ac15dd20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f95a000c7f0 tx=0x7f95a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:06.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.796+0000 7f95a97fa640 1 -- 172.21.15.38:0/1431310686 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0007a30 con 0x7f95ac071000 2023-12-22T08:42:06.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.796+0000 7f95a97fa640 1 -- 172.21.15.38:0/1431310686 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a0007b90 con 0x7f95ac071000 2023-12-22T08:42:06.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.796+0000 7f95a97fa640 1 -- 172.21.15.38:0/1431310686 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a000ce40 con 0x7f95ac071000 2023-12-22T08:42:06.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.797+0000 7f95b1879640 1 -- 172.21.15.38:0/1431310686 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ac1f2b90 con 0x7f95ac071000 2023-12-22T08:42:06.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.797+0000 7f95b1879640 1 -- 172.21.15.38:0/1431310686 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ac15e260 con 0x7f95ac071000 2023-12-22T08:42:06.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.798+0000 7f95b1879640 1 -- 172.21.15.38:0/1431310686 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ac1f29f0 con 0x7f95ac071000 2023-12-22T08:42:06.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.799+0000 7f95a97fa640 1 -- 172.21.15.38:0/1431310686 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f95a00113f0 con 0x7f95ac071000 2023-12-22T08:42:06.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.800+0000 7f95a97fa640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959006a430 0x7f959006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:06.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.800+0000 7f95a97fa640 1 -- 172.21.15.38:0/1431310686 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95a0088bb0 con 0x7f95ac071000 2023-12-22T08:42:06.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.801+0000 7f95abfff640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959006a430 0x7f959006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:06.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.802+0000 7f95abfff640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959006a430 0x7f959006c8f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f95ac1553f0 tx=0x7f9598008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:06.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:06.804+0000 7f95a97fa640 1 -- 172.21.15.38:0/1431310686 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f95ac1f29f0 con 0x7f95ac071000 2023-12-22T08:42:07.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.035+0000 7f95b1879640 1 -- 172.21.15.38:0/1431310686 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95ac1f29f0 con 0x7f95ac071000 2023-12-22T08:42:07.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.036+0000 7f95a97fa640 1 -- 172.21.15.38:0/1431310686 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f95ac1f29f0 con 0x7f95ac071000 2023-12-22T08:42:07.038 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:07.039 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2078860804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2078860804},{"type":"v1","addr":"172.21.15.38:6835","nonce":2078860804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4244510882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4244510882},{"type":"v1","addr":"172.21.15.89:6837","nonce":4244510882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3227878158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3227878158},{"type":"v1","addr":"172.21.15.38:6834","nonce":3227878158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:42:00.933947+0000","modified":"2023-12-22T08:42:03.951929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5538":{"gid":5538,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2131151279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2131151279},{"type":"v1","addr":"172.21.15.89:6836","nonce":2131151279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T08:42:07.039 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2023-12-22T08:42:07.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.038+0000 7f95b1879640 1 -- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959006a430 msgr2=0x7f959006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.038+0000 7f95b1879640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959006a430 0x7f959006c8f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f95ac1553f0 tx=0x7f9598008040 comp rx=0 tx=0).stop 2023-12-22T08:42:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.038+0000 7f95b1879640 1 -- 172.21.15.38:0/1431310686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac071000 msgr2=0x7f95ac15dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.038+0000 7f95b1879640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac071000 0x7f95ac15dd20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f95a000c7f0 tx=0x7f95a000cbf0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.039+0000 7f95b1879640 1 -- 172.21.15.38:0/1431310686 shutdown_connections 2023-12-22T08:42:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.039+0000 7f95b1879640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95ac15b420 0x7f95ac1f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.039+0000 7f95b1879640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95ac0a44a0 0x7f95ac1f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.039+0000 7f95b1879640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959006a430 0x7f959006c8f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.039+0000 7f95b1879640 1 --2- 172.21.15.38:0/1431310686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac071000 0x7f95ac15dd20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.039+0000 7f95b1879640 1 -- 172.21.15.38:0/1431310686 >> 172.21.15.38:0/1431310686 conn(0x7f95ac0b1f70 msgr2=0x7f95ac0cbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.039+0000 7f95b1879640 1 -- 172.21.15.38:0/1431310686 shutdown_connections 2023-12-22T08:42:07.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.039+0000 7f95b1879640 1 -- 172.21.15.38:0/1431310686 wait complete. 2023-12-22T08:42:07.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T08:42:00.933947+0000', 'modified': '2023-12-22T08:42:03.951929+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5538}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5538': {'gid': 5538, 'name': 'd', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6836/2131151279', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 2131151279}, {'type': 'v1', 'addr': '172.21.15.89:6836', 'nonce': 2131151279}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T08:42:07.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T08:42:07.462 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-22T08:42:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.699+0000 7fa4c359e640 1 Processor -- start 2023-12-22T08:42:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.699+0000 7fa4c359e640 1 -- start start 2023-12-22T08:42:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.701+0000 7fa4c359e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa4c4071460 0x7fa4c4071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.701+0000 7fa4c359e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c415edf0 con 0x7fa4c415b0e0 2023-12-22T08:42:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.701+0000 7fa4c359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c4071db0 con 0x7fa4c409c980 2023-12-22T08:42:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.701+0000 7fa4c359e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c415d0d0 con 0x7fa4c4071460 2023-12-22T08:42:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.701+0000 7fa4c259c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa4c415b0e0 0x7fa4c415b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45890/0 (socket says 172.21.15.38:45890) 2023-12-22T08:42:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.701+0000 7fa4c259c640 1 -- 172.21.15.38:0/1270503122 learned_addr learned my addr 172.21.15.38:0/1270503122 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.701+0000 7fa4c2d9d640 1 --2- 172.21.15.38:0/1270503122 >> v2:172.21.15.38:3300/0 conn(0x7fa4c4071460 0x7fa4c4071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.701+0000 7fa4c1d9b640 1 -- 172.21.15.38:0/1270503122 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512133442 0 0) 0x7fa4c415edf0 con 0x7fa4c415b0e0 2023-12-22T08:42:07.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.702+0000 7fa4c1d9b640 1 -- 172.21.15.38:0/1270503122 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4b0003520 con 0x7fa4c415b0e0 2023-12-22T08:42:07.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.702+0000 7fa4c2d9d640 1 -- 172.21.15.38:0/1270503122 >> v1:172.21.15.89:6789/0 conn(0x7fa4c409c980 legacy=0x7fa4c415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:07.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.702+0000 7fa4c2d9d640 1 -- 172.21.15.38:0/1270503122 >> v1:172.21.15.38:6789/0 conn(0x7fa4c415b0e0 legacy=0x7fa4c415b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.702+0000 7fa4c2d9d640 1 -- 172.21.15.38:0/1270503122 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c415bd90 con 0x7fa4c4071460 2023-12-22T08:42:07.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.703+0000 7fa4c2d9d640 1 --2- 172.21.15.38:0/1270503122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c4071460 0x7fa4c4071870 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009d90 tx=0x7fa4bc02bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16031087ee58b78b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:07.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.703+0000 7fa4c1d9b640 1 -- 172.21.15.38:0/1270503122 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc02cb40 con 0x7fa4c4071460 2023-12-22T08:42:07.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.703+0000 7fa4c1d9b640 1 -- 172.21.15.38:0/1270503122 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc02cca0 con 0x7fa4c4071460 2023-12-22T08:42:07.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.703+0000 7fa4c1d9b640 1 -- 172.21.15.38:0/1270503122 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc034660 con 0x7fa4c4071460 2023-12-22T08:42:07.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.704+0000 7fa4c359e640 1 -- 172.21.15.38:0/1270503122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c4071460 msgr2=0x7fa4c4071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.704+0000 7fa4c359e640 1 --2- 172.21.15.38:0/1270503122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c4071460 0x7fa4c4071870 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009d90 tx=0x7fa4bc02bd90 comp rx=0 tx=0).stop 2023-12-22T08:42:07.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.704+0000 7fa4c359e640 1 -- 172.21.15.38:0/1270503122 shutdown_connections 2023-12-22T08:42:07.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.704+0000 7fa4c359e640 1 --2- 172.21.15.38:0/1270503122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c4071460 0x7fa4c4071870 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.704+0000 7fa4c359e640 1 -- 172.21.15.38:0/1270503122 >> 172.21.15.38:0/1270503122 conn(0x7fa4c40cf000 msgr2=0x7fa4c40cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:07.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.704+0000 7fa4c359e640 1 -- 172.21.15.38:0/1270503122 shutdown_connections 2023-12-22T08:42:07.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.704+0000 7fa4c359e640 1 -- 172.21.15.38:0/1270503122 wait complete. 2023-12-22T08:42:07.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.706+0000 7fa4c359e640 1 Processor -- start 2023-12-22T08:42:07.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.706+0000 7fa4c359e640 1 -- start start 2023-12-22T08:42:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.707+0000 7fa4c359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c4071460 0x7fa4c4158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.707+0000 7fa4c359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c409c980 0x7fa4c409b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.707+0000 7fa4c359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c415b0e0 0x7fa4c41f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.707+0000 7fa4c359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4158760 con 0x7fa4c415b0e0 2023-12-22T08:42:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.707+0000 7fa4c359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c40ca690 con 0x7fa4c4071460 2023-12-22T08:42:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.707+0000 7fa4c359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c40ca970 con 0x7fa4c409c980 2023-12-22T08:42:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.707+0000 7fa4c2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c415b0e0 0x7fa4c41f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.707+0000 7fa4c2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c415b0e0 0x7fa4c41f6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57878/0 (socket says 172.21.15.38:57878) 2023-12-22T08:42:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.707+0000 7fa4c2d9d640 1 -- 172.21.15.38:0/724550172 learned_addr learned my addr 172.21.15.38:0/724550172 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.708+0000 7fa4c2d9d640 1 -- 172.21.15.38:0/724550172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c409c980 msgr2=0x7fa4c409b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.708+0000 7fa4c2d9d640 1 --2- 172.21.15.38:0/724550172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c409c980 0x7fa4c409b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.708+0000 7fa4c2d9d640 1 -- 172.21.15.38:0/724550172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c4071460 msgr2=0x7fa4c4158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.708+0000 7fa4c2d9d640 1 --2- 172.21.15.38:0/724550172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c4071460 0x7fa4c4158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.708+0000 7fa4c2d9d640 1 -- 172.21.15.38:0/724550172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc009a70 con 0x7fa4c415b0e0 2023-12-22T08:42:07.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.708+0000 7fa4c2d9d640 1 --2- 172.21.15.38:0/724550172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c415b0e0 0x7fa4c41f6a30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009d90 tx=0x7fa4bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:07.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.709+0000 7fa4baffd640 1 -- 172.21.15.38:0/724550172 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc040650 con 0x7fa4c415b0e0 2023-12-22T08:42:07.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.709+0000 7fa4baffd640 1 -- 172.21.15.38:0/724550172 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc0407d0 con 0x7fa4c415b0e0 2023-12-22T08:42:07.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.709+0000 7fa4baffd640 1 -- 172.21.15.38:0/724550172 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc040b80 con 0x7fa4c415b0e0 2023-12-22T08:42:07.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.709+0000 7fa4c359e640 1 -- 172.21.15.38:0/724550172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c40cac50 con 0x7fa4c415b0e0 2023-12-22T08:42:07.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.709+0000 7fa4c359e640 1 -- 172.21.15.38:0/724550172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c40cb210 con 0x7fa4c415b0e0 2023-12-22T08:42:07.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.711+0000 7fa4baffd640 1 -- 172.21.15.38:0/724550172 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa4bc040ce0 con 0x7fa4c415b0e0 2023-12-22T08:42:07.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.712+0000 7fa4baffd640 1 --2- 172.21.15.38:0/724550172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa4a406a430 0x7fa4a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.712+0000 7fa4baffd640 1 -- 172.21.15.38:0/724550172 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4bc0ab7d0 con 0x7fa4c415b0e0 2023-12-22T08:42:07.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.713+0000 7fa4c259c640 1 --2- 172.21.15.38:0/724550172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa4a406a430 0x7fa4a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.713+0000 7fa4cb86f740 1 Processor -- start 2023-12-22T08:42:07.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.713+0000 7fa4cb86f740 1 -- start start 2023-12-22T08:42:07.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.714+0000 7fa4c259c640 1 --2- 172.21.15.38:0/724550172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa4a406a430 0x7fa4a406c8f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4001570 tx=0x7fa4b4007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:07.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.714+0000 7fa4cb86f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 0x560f7ef8d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.714+0000 7fa4cb86f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef5ce90 0x560f7ef8a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.714+0000 7fa4cb86f740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 0x560f7ef8a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.714+0000 7fa4cb86f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f7eeccf80 con 0x560f7ef8cf10 2023-12-22T08:42:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.714+0000 7fa4cb86f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f7eeca710 con 0x560f7ef5ce90 2023-12-22T08:42:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.714+0000 7fa4cb86f740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f7eec6000 con 0x560f7ef60a90 2023-12-22T08:42:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.715+0000 7fa4c259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 0x560f7ef8d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.715+0000 7fa4c259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 0x560f7ef8d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57888/0 (socket says 172.21.15.38:57888) 2023-12-22T08:42:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.715+0000 7fa4c259c640 1 -- 172.21.15.38:0/1171860863 learned_addr learned my addr 172.21.15.38:0/1171860863 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.715+0000 7fa4bbfff640 1 --2- 172.21.15.38:0/1171860863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef5ce90 0x560f7ef8a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.715+0000 7fa4c259c640 1 -- 172.21.15.38:0/1171860863 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 msgr2=0x560f7ef8a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.715+0000 7fa4c259c640 1 --2- 172.21.15.38:0/1171860863 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 0x560f7ef8a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.715+0000 7fa4c259c640 1 -- 172.21.15.38:0/1171860863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef5ce90 msgr2=0x560f7ef8a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.715+0000 7fa4c259c640 1 --2- 172.21.15.38:0/1171860863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef5ce90 0x560f7ef8a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.715+0000 7fa4c259c640 1 -- 172.21.15.38:0/1171860863 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f7ee8d690 con 0x560f7ef8cf10 2023-12-22T08:42:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.715+0000 7fa4c259c640 1 --2- 172.21.15.38:0/1171860863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 0x560f7ef8d2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4005bd0 tx=0x7fa4b400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b5336981b33135 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.716+0000 7fa4a3fff640 1 -- 172.21.15.38:0/1171860863 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b401b070 con 0x560f7ef8cf10 2023-12-22T08:42:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.716+0000 7fa4a3fff640 1 -- 172.21.15.38:0/1171860863 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4007720 con 0x560f7ef8cf10 2023-12-22T08:42:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.716+0000 7fa4a3fff640 1 -- 172.21.15.38:0/1171860863 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4012870 con 0x560f7ef8cf10 2023-12-22T08:42:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.716+0000 7fa4cb86f740 1 -- 172.21.15.38:0/1171860863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 msgr2=0x560f7ef8d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.716+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/1171860863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 0x560f7ef8d2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4005bd0 tx=0x7fa4b400f000 comp rx=0 tx=0).stop 2023-12-22T08:42:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.716+0000 7fa4cb86f740 1 -- 172.21.15.38:0/1171860863 shutdown_connections 2023-12-22T08:42:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.716+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/1171860863 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 0x560f7ef8a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.716+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/1171860863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef5ce90 0x560f7ef8a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.716+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/1171860863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 0x560f7ef8d2f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.716+0000 7fa4cb86f740 1 -- 172.21.15.38:0/1171860863 >> 172.21.15.38:0/1171860863 conn(0x560f7ef5f1a0 msgr2=0x560f7efa7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:07.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.717+0000 7fa4cb86f740 1 -- 172.21.15.38:0/1171860863 shutdown_connections 2023-12-22T08:42:07.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.717+0000 7fa4cb86f740 1 -- 172.21.15.38:0/1171860863 wait complete. 2023-12-22T08:42:07.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.717+0000 7fa4cb86f740 1 -- start start 2023-12-22T08:42:07.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.718+0000 7fa4cb86f740 1 Processor -- start 2023-12-22T08:42:07.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4cb86f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef60a90 0x560f7efb71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4cb86f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef8cf10 0x560f7ef84040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4cb86f740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef87e90 0x560f7ef86a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4cb86f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f7ee677d0 con 0x560f7ef60a90 2023-12-22T08:42:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4cb86f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f7ee67470 con 0x560f7ef8cf10 2023-12-22T08:42:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4cb86f740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f7ec2df20 con 0x560f7ef87e90 2023-12-22T08:42:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4cb86f740 10 client.0 _ll_register_callbacks cb 0x560f7eeb61b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:42:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4c259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef60a90 0x560f7efb71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4c259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef60a90 0x560f7efb71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57904/0 (socket says 172.21.15.38:57904) 2023-12-22T08:42:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4c259c640 1 -- 172.21.15.38:0/3052074110 learned_addr learned my addr 172.21.15.38:0/3052074110 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4bbfff640 1 --2- 172.21.15.38:0/3052074110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef8cf10 0x560f7ef84040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4c259c640 1 -- 172.21.15.38:0/3052074110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef87e90 msgr2=0x560f7ef86a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4c259c640 1 --2- 172.21.15.38:0/3052074110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef87e90 0x560f7ef86a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4c259c640 1 -- 172.21.15.38:0/3052074110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef8cf10 msgr2=0x560f7ef84040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4c259c640 1 --2- 172.21.15.38:0/3052074110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef8cf10 0x560f7ef84040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.719+0000 7fa4c259c640 1 -- 172.21.15.38:0/3052074110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b0003520 con 0x560f7ef60a90 2023-12-22T08:42:07.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.720+0000 7fa4c259c640 1 --2- 172.21.15.38:0/3052074110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef60a90 0x560f7efb71f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4001200 tx=0x7fa4b4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209557ded722e689 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:07.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.720+0000 7fa4a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:42:07.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.720+0000 7fa4a17fa640 1 -- 172.21.15.38:0/3052074110 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4014840 con 0x560f7ef60a90 2023-12-22T08:42:07.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.720+0000 7fa4a17fa640 1 -- 172.21.15.38:0/3052074110 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4b40149a0 con 0x560f7ef60a90 2023-12-22T08:42:07.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.720+0000 7fa4cb86f740 1 -- 172.21.15.38:0/3052074110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f7eef0550 con 0x560f7ef60a90 2023-12-22T08:42:07.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.720+0000 7fa4a17fa640 1 -- 172.21.15.38:0/3052074110 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4b4014b60 con 0x560f7ef60a90 2023-12-22T08:42:07.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.720+0000 7fa4cb86f740 10 client.5667 fetch_fsmap learned FSMap version 23 2023-12-22T08:42:07.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.720+0000 7fa4cb86f740 1 -- 172.21.15.38:0/3052074110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x560f7eec4680 con 0x560f7ef60a90 2023-12-22T08:42:07.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.720+0000 7fa4a17fa640 1 -- 172.21.15.38:0/3052074110 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560f7eef0550 con 0x560f7ef60a90 2023-12-22T08:42:07.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.721+0000 7fa4a17fa640 1 -- 172.21.15.38:0/3052074110 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 23) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fa4b4014cc0 con 0x560f7ef60a90 2023-12-22T08:42:07.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.721+0000 7fa4cb86f740 10 client.5667 fetch_fsmap finished waiting for FSMap version 23 2023-12-22T08:42:07.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.721+0000 7fa4cb86f740 10 client.5667 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-22T08:42:07.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.721+0000 7fa4cb86f740 20 client.5667 populate_metadata read hostname 'smithi038' 2023-12-22T08:42:07.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.721+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/3052074110 >> [v2:172.21.15.89:6834/2131151279,v1:172.21.15.89:6836/2131151279] conn(0x560f7efaa3a0 0x560f7efba8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.721+0000 7fa4cb86f740 4 client.5667 mds_command: new command op to 5538 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T08:42:07.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.721+0000 7fa4cb86f740 1 -- 172.21.15.38:0/3052074110 --> [v2:172.21.15.89:6834/2131151279,v1:172.21.15.89:6836/2131151279] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560f7eeb8b50 con 0x560f7efaa3a0 2023-12-22T08:42:07.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.721+0000 7fa4bbfff640 1 --2- 172.21.15.38:0/3052074110 >> [v2:172.21.15.89:6834/2131151279,v1:172.21.15.89:6836/2131151279] conn(0x560f7efaa3a0 0x560f7efba8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.722+0000 7fa4bbfff640 1 --2- 172.21.15.38:0/3052074110 >> [v2:172.21.15.89:6834/2131151279,v1:172.21.15.89:6836/2131151279] conn(0x560f7efaa3a0 0x560f7efba8b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c7ffc067af6eebc server_cookie=5c1189f896adb204 in_seq=0 out_seq=0 2023-12-22T08:42:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.722+0000 7fa4a17fa640 10 client.5667 ms_handle_connect on v2:172.21.15.89:6834/2131151279 2023-12-22T08:42:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.724+0000 7fa4a17fa640 1 -- 172.21.15.38:0/3052074110 <== mds.0 v2:172.21.15.89:6834/2131151279 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x560f7eeb8b50 con 0x560f7efaa3a0 2023-12-22T08:42:07.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.724+0000 7fa4a17fa640 10 client.5667 handle_command_reply: tid=0 2023-12-22T08:42:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.724+0000 7fa4cb86f740 1 client.5667 shutdown 2023-12-22T08:42:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.725+0000 7fa4cb86f740 1 -- 172.21.15.38:0/3052074110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef60a90 msgr2=0x560f7efb71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.725+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/3052074110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef60a90 0x560f7efb71f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4001200 tx=0x7fa4b4011000 comp rx=0 tx=0).stop 2023-12-22T08:42:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.725+0000 7fa4cb86f740 1 -- 172.21.15.38:0/3052074110 shutdown_connections 2023-12-22T08:42:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.725+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/3052074110 >> [v2:172.21.15.89:6834/2131151279,v1:172.21.15.89:6836/2131151279] conn(0x560f7efaa3a0 0x560f7efba8b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.725+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/3052074110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef87e90 0x560f7ef86a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.725+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/3052074110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef8cf10 0x560f7ef84040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.725+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/3052074110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef60a90 0x560f7efb71f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.725+0000 7fa4a17fa640 0 client.5667 ms_handle_reset on v2:172.21.15.89:6834/2131151279 2023-12-22T08:42:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.725+0000 7fa4cb86f740 1 -- 172.21.15.38:0/3052074110 >> 172.21.15.38:0/3052074110 conn(0x560f7ef5ce90 msgr2=0x560f7ef90a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.725+0000 7fa4cb86f740 1 -- 172.21.15.38:0/3052074110 shutdown_connections 2023-12-22T08:42:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.725+0000 7fa4cb86f740 1 -- 172.21.15.38:0/3052074110 wait complete. 2023-12-22T08:42:07.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.725+0000 7fa4cb86f740 20 client.5667 trim_cache size 0 max 16384 2023-12-22T08:42:07.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.742+0000 7fa4cb86f740 1 Processor -- start 2023-12-22T08:42:07.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.742+0000 7fa4cb86f740 1 -- start start 2023-12-22T08:42:07.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.742+0000 7fa4cb86f740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 0x560f7ef63a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4cb86f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef87e90 0x560f7ef5d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4cb86f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 0x560f7efa8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4cb86f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f7efb6e10 con 0x560f7ef8cf10 2023-12-22T08:42:07.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4cb86f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f7ef833b0 con 0x560f7ef87e90 2023-12-22T08:42:07.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4cb86f740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f7ef61ac0 con 0x560f7ef60a90 2023-12-22T08:42:07.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4c2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 0x560f7efa8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4c2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 0x560f7efa8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57910/0 (socket says 172.21.15.38:57910) 2023-12-22T08:42:07.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4c2d9d640 1 -- 172.21.15.38:0/3733311514 learned_addr learned my addr 172.21.15.38:0/3733311514 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:07.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4c259c640 1 --2- 172.21.15.38:0/3733311514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 0x560f7ef63a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4bbfff640 1 --2- 172.21.15.38:0/3733311514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef87e90 0x560f7ef5d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4c2d9d640 1 -- 172.21.15.38:0/3733311514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 msgr2=0x560f7ef63a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:07.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4c2d9d640 1 --2- 172.21.15.38:0/3733311514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 0x560f7ef63a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4c2d9d640 1 -- 172.21.15.38:0/3733311514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef87e90 msgr2=0x560f7ef5d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:07.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4c2d9d640 1 --2- 172.21.15.38:0/3733311514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef87e90 0x560f7ef5d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.743+0000 7fa4c2d9d640 1 -- 172.21.15.38:0/3733311514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c40c6280 con 0x560f7ef8cf10 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.744+0000 7fa4c2d9d640 1 --2- 172.21.15.38:0/3733311514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 0x560f7efa8b10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0825e0 tx=0x7fa4bc07b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5bc43fdbf74122 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.744+0000 7fa4b8ff9640 1 -- 172.21.15.38:0/3733311514 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc082b10 con 0x560f7ef8cf10 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.744+0000 7fa4b8ff9640 1 -- 172.21.15.38:0/3733311514 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc078ed0 con 0x560f7ef8cf10 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.744+0000 7fa4b8ff9640 1 -- 172.21.15.38:0/3733311514 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc07ad90 con 0x560f7ef8cf10 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.745+0000 7fa4cb86f740 1 -- 172.21.15.38:0/3733311514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 msgr2=0x560f7efa8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.745+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/3733311514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 0x560f7efa8b10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0825e0 tx=0x7fa4bc07b230 comp rx=0 tx=0).stop 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.745+0000 7fa4cb86f740 1 -- 172.21.15.38:0/3733311514 shutdown_connections 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.745+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/3733311514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef8cf10 0x560f7efa8b10 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.745+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/3733311514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef87e90 0x560f7ef5d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.745+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/3733311514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 0x560f7ef63a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.745+0000 7fa4cb86f740 1 -- 172.21.15.38:0/3733311514 >> 172.21.15.38:0/3733311514 conn(0x560f7ef5ce90 msgr2=0x560f7ef61230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.745+0000 7fa4cb86f740 1 -- 172.21.15.38:0/3733311514 shutdown_connections 2023-12-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.745+0000 7fa4cb86f740 1 -- 172.21.15.38:0/3733311514 wait complete. 2023-12-22T08:42:07.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.745+0000 7fa4cb86f740 1 -- start start 2023-12-22T08:42:07.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.746+0000 7fa4cb86f740 1 Processor -- start 2023-12-22T08:42:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4cb86f740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 0x560f7efa7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4cb86f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef87e90 0x560f7ef90b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4cb86f740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef8cf10 0x560f7efa8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4cb86f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f7f002f30 con 0x560f7ef87e90 2023-12-22T08:42:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4cb86f740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f7efa7d00 con 0x560f7ef8cf10 2023-12-22T08:42:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4cb86f740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f7ef91040 con 0x560f7ef60a90 2023-12-22T08:42:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4cb86f740 10 client.0 _ll_register_callbacks cb 0x7fa4b4005ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:42:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef87e90 0x560f7ef90b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef87e90 0x560f7ef90b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57926/0 (socket says 172.21.15.38:57926) 2023-12-22T08:42:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4bbfff640 1 -- 172.21.15.38:0/2793258076 learned_addr learned my addr 172.21.15.38:0/2793258076 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4c259c640 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 0x560f7efa7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4bbfff640 1 -- 172.21.15.38:0/2793258076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 msgr2=0x560f7efa7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4c2d9d640 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef8cf10 0x560f7efa8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4bbfff640 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 0x560f7efa7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4bbfff640 1 -- 172.21.15.38:0/2793258076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef8cf10 msgr2=0x560f7efa8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4bbfff640 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef8cf10 0x560f7efa8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4bbfff640 1 -- 172.21.15.38:0/2793258076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c40cb210 con 0x560f7ef87e90 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.747+0000 7fa4c2d9d640 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef8cf10 0x560f7efa8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.748+0000 7fa4bbfff640 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef87e90 0x560f7ef90b00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac004c10 tx=0x7fa4ac019db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48078563ab6fc9be server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.748+0000 7fa4a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.748+0000 7fa4a17fa640 1 -- 172.21.15.38:0/2793258076 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac007700 con 0x560f7ef87e90 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.748+0000 7fa4a17fa640 1 -- 172.21.15.38:0/2793258076 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4ac0069d0 con 0x560f7ef87e90 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.748+0000 7fa4cb86f740 1 -- 172.21.15.38:0/2793258076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4b4007720 con 0x560f7ef87e90 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.748+0000 7fa4a17fa640 1 -- 172.21.15.38:0/2793258076 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4ac006b90 con 0x560f7ef87e90 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.748+0000 7fa4cb86f740 10 client.5673 fetch_fsmap learned FSMap version 23 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.748+0000 7fa4cb86f740 1 -- 172.21.15.38:0/2793258076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x560f7ee669e0 con 0x560f7ef87e90 2023-12-22T08:42:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.749+0000 7fa4a17fa640 1 -- 172.21.15.38:0/2793258076 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4007720 con 0x560f7ef87e90 2023-12-22T08:42:07.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.749+0000 7fa4a17fa640 1 -- 172.21.15.38:0/2793258076 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 23) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fa4ac006cf0 con 0x560f7ef87e90 2023-12-22T08:42:07.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.749+0000 7fa4cb86f740 10 client.5673 fetch_fsmap finished waiting for FSMap version 23 2023-12-22T08:42:07.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.749+0000 7fa4cb86f740 10 client.5673 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-22T08:42:07.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.749+0000 7fa4cb86f740 20 client.5673 populate_metadata read hostname 'smithi038' 2023-12-22T08:42:07.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.749+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.89:6834/2131151279,v1:172.21.15.89:6836/2131151279] conn(0x560f7eff3ee0 0x560f7eff42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.749+0000 7fa4cb86f740 4 client.5673 mds_command: new command op to 5538 tid=0[{"prefix": "status"}] 2023-12-22T08:42:07.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.749+0000 7fa4cb86f740 1 -- 172.21.15.38:0/2793258076 --> [v2:172.21.15.89:6834/2131151279,v1:172.21.15.89:6836/2131151279] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560f7eebf080 con 0x560f7eff3ee0 2023-12-22T08:42:07.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.749+0000 7fa4c259c640 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.89:6834/2131151279,v1:172.21.15.89:6836/2131151279] conn(0x560f7eff3ee0 0x560f7eff42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.750+0000 7fa4c259c640 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.89:6834/2131151279,v1:172.21.15.89:6836/2131151279] conn(0x560f7eff3ee0 0x560f7eff42c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cecae28998953cda server_cookie=10a292787ff2530c in_seq=0 out_seq=0 2023-12-22T08:42:07.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.750+0000 7fa4a17fa640 10 client.5673 ms_handle_connect on v2:172.21.15.89:6834/2131151279 2023-12-22T08:42:07.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4a17fa640 1 -- 172.21.15.38:0/2793258076 <== mds.0 v2:172.21.15.89:6834/2131151279 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x560f7eebf080 con 0x560f7eff3ee0 2023-12-22T08:42:07.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4a17fa640 10 client.5673 handle_command_reply: tid=0 2023-12-22T08:42:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4cb86f740 1 client.5673 shutdown 2023-12-22T08:42:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4cb86f740 1 -- 172.21.15.38:0/2793258076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef87e90 msgr2=0x560f7ef90b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef87e90 0x560f7ef90b00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac004c10 tx=0x7fa4ac019db0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4cb86f740 1 -- 172.21.15.38:0/2793258076 shutdown_connections 2023-12-22T08:42:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.89:6834/2131151279,v1:172.21.15.89:6836/2131151279] conn(0x560f7eff3ee0 0x560f7eff42c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560f7ef8cf10 0x560f7efa8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f7ef87e90 0x560f7ef90b00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4cb86f740 1 --2- 172.21.15.38:0/2793258076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x560f7ef60a90 0x560f7efa7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4cb86f740 1 -- 172.21.15.38:0/2793258076 >> 172.21.15.38:0/2793258076 conn(0x560f7ef5ce90 msgr2=0x560f7ef866a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4a17fa640 0 client.5673 ms_handle_reset on v2:172.21.15.89:6834/2131151279 2023-12-22T08:42:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4cb86f740 1 -- 172.21.15.38:0/2793258076 shutdown_connections 2023-12-22T08:42:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4cb86f740 1 -- 172.21.15.38:0/2793258076 wait complete. 2023-12-22T08:42:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.751+0000 7fa4cb86f740 20 client.5673 trim_cache size 0 max 16384 2023-12-22T08:42:07.757 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:42:07.757 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:42:07.757 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-12-22T08:42:07.757 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 5538, 2023-12-22T08:42:07.757 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-12-22T08:42:07.757 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-12-22T08:42:07.757 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-12-22T08:42:07.757 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 6.8117605609999998, 2023-12-22T08:42:07.757 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 23, 2023-12-22T08:42:07.757 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 48, 2023-12-22T08:42:07.758 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 48, 2023-12-22T08:42:07.758 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 12.403497792 2023-12-22T08:42:07.758 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:42:07.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.752+0000 7fa4c359e640 1 -- 172.21.15.38:0/724550172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa4a406a430 msgr2=0x7fa4a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.752+0000 7fa4c359e640 1 --2- 172.21.15.38:0/724550172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa4a406a430 0x7fa4a406c8f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4001570 tx=0x7fa4b4007930 comp rx=0 tx=0).stop 2023-12-22T08:42:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.752+0000 7fa4c359e640 1 -- 172.21.15.38:0/724550172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c415b0e0 msgr2=0x7fa4c41f6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.752+0000 7fa4c359e640 1 --2- 172.21.15.38:0/724550172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c415b0e0 0x7fa4c41f6a30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009d90 tx=0x7fa4bc004a40 comp rx=0 tx=0).stop 2023-12-22T08:42:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.752+0000 7fa4c359e640 1 -- 172.21.15.38:0/724550172 shutdown_connections 2023-12-22T08:42:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.752+0000 7fa4c359e640 1 --2- 172.21.15.38:0/724550172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa4a406a430 0x7fa4a406c8f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.752+0000 7fa4c359e640 1 --2- 172.21.15.38:0/724550172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c415b0e0 0x7fa4c41f6a30 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.752+0000 7fa4c359e640 1 --2- 172.21.15.38:0/724550172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4c409c980 0x7fa4c409b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.752+0000 7fa4c359e640 1 --2- 172.21.15.38:0/724550172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c4071460 0x7fa4c4158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.752+0000 7fa4c359e640 1 -- 172.21.15.38:0/724550172 >> 172.21.15.38:0/724550172 conn(0x7fa4c40cf000 msgr2=0x7fa4c415de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.752+0000 7fa4c359e640 1 -- 172.21.15.38:0/724550172 shutdown_connections 2023-12-22T08:42:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.752+0000 7fa4c359e640 1 -- 172.21.15.38:0/724550172 wait complete. 2023-12-22T08:42:07.772 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:42:07.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.987+0000 7fbdd81a4640 1 Processor -- start 2023-12-22T08:42:07.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.988+0000 7fbdd81a4640 1 -- start start 2023-12-22T08:42:07.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.989+0000 7fbdd81a4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdd00b22c0 0x7fbdd00b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.989+0000 7fbdd81a4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbdd00cb830 0x7fbdd00cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:07.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.989+0000 7fbdd81a4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd00cc200 con 0x7fbdd00b26a0 2023-12-22T08:42:07.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.989+0000 7fbdd81a4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd006c610 con 0x7fbdd00cb830 2023-12-22T08:42:07.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.989+0000 7fbdd81a4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00b4510 con 0x7fbdd00b22c0 2023-12-22T08:42:07.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.990+0000 7fbdd6741640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbdd00cb830 0x7fbdd00cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.990+0000 7fbdd5f40640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdd00b22c0 0x7fbdd00b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:07.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.990+0000 7fbdd6741640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbdd00cb830 0x7fbdd00cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:42014/0 (socket says 172.21.15.38:42014) 2023-12-22T08:42:07.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.990+0000 7fbdd6741640 1 -- 172.21.15.38:0/850572934 learned_addr learned my addr 172.21.15.38:0/850572934 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:07.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.991+0000 7fbdd5f40640 1 -- 172.21.15.38:0/850572934 >> v2:172.21.15.89:3300/0 conn(0x7fbdd00cb830 msgr2=0x7fbdd00cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:07.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.991+0000 7fbdd5f40640 1 --2- 172.21.15.38:0/850572934 >> v2:172.21.15.89:3300/0 conn(0x7fbdd00cb830 0x7fbdd00cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.991+0000 7fbdd5f40640 1 -- 172.21.15.38:0/850572934 >> v1:172.21.15.89:6789/0 conn(0x7fbdd00b26a0 legacy=0x7fbdd006ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.991+0000 7fbdd5f40640 1 -- 172.21.15.38:0/850572934 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00b3f50 con 0x7fbdd00b22c0 2023-12-22T08:42:07.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.991+0000 7fbdd6741640 1 --2- 172.21.15.38:0/850572934 >> v2:172.21.15.89:3300/0 conn(0x7fbdd00cb830 0x7fbdd00cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:42:07.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.991+0000 7fbdd4f3e640 1 -- 172.21.15.38:0/850572934 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573112353 0 0) 0x7fbdd00cc200 con 0x7fbdd00b26a0 2023-12-22T08:42:07.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.992+0000 7fbdd5f40640 1 --2- 172.21.15.38:0/850572934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdd00b22c0 0x7fbdd00b3600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009d90 tx=0x7fbdcc02be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=304acd81bcc960c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:07.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.993+0000 7fbdd4f3e640 1 -- 172.21.15.38:0/850572934 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc02cbd0 con 0x7fbdd00b22c0 2023-12-22T08:42:07.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.993+0000 7fbdd4f3e640 1 -- 172.21.15.38:0/850572934 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc02cd30 con 0x7fbdd00b22c0 2023-12-22T08:42:07.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.993+0000 7fbdd4f3e640 1 -- 172.21.15.38:0/850572934 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc02cea0 con 0x7fbdd00b22c0 2023-12-22T08:42:07.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.994+0000 7fbdd81a4640 1 -- 172.21.15.38:0/850572934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdd00b22c0 msgr2=0x7fbdd00b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:07.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.994+0000 7fbdd81a4640 1 --2- 172.21.15.38:0/850572934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdd00b22c0 0x7fbdd00b3600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009d90 tx=0x7fbdcc02be20 comp rx=0 tx=0).stop 2023-12-22T08:42:07.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.994+0000 7fbdd81a4640 1 -- 172.21.15.38:0/850572934 shutdown_connections 2023-12-22T08:42:07.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.994+0000 7fbdd81a4640 1 --2- 172.21.15.38:0/850572934 >> v2:172.21.15.89:3300/0 conn(0x7fbdd00cb830 0x7fbdd00cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.994+0000 7fbdd81a4640 1 --2- 172.21.15.38:0/850572934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdd00b22c0 0x7fbdd00b3600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:07.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.994+0000 7fbdd81a4640 1 -- 172.21.15.38:0/850572934 >> 172.21.15.38:0/850572934 conn(0x7fbdd00cf070 msgr2=0x7fbdd00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:07.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.994+0000 7fbdd81a4640 1 -- 172.21.15.38:0/850572934 shutdown_connections 2023-12-22T08:42:07.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.994+0000 7fbdd81a4640 1 -- 172.21.15.38:0/850572934 wait complete. 2023-12-22T08:42:07.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.996+0000 7fbdd81a4640 1 Processor -- start 2023-12-22T08:42:07.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.996+0000 7fbdd81a4640 1 -- start start 2023-12-22T08:42:08.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.997+0000 7fbdd81a4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd00b26a0 0x7fbdd014a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:08.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.997+0000 7fbdd81a4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdd00cb830 0x7fbdd00a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:08.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.997+0000 7fbdd81a4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd014df70 0x7fbdd014e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:08.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.997+0000 7fbdd81a4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd015e510 con 0x7fbdd00b26a0 2023-12-22T08:42:08.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.997+0000 7fbdd81a4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd014a880 con 0x7fbdd014df70 2023-12-22T08:42:08.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.997+0000 7fbdd81a4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd015beb0 con 0x7fbdd00cb830 2023-12-22T08:42:08.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.997+0000 7fbdd5f40640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd00b26a0 0x7fbdd014a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:08.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.997+0000 7fbdd5f40640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd00b26a0 0x7fbdd014a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57936/0 (socket says 172.21.15.38:57936) 2023-12-22T08:42:08.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.997+0000 7fbdd5f40640 1 -- 172.21.15.38:0/1354803263 learned_addr learned my addr 172.21.15.38:0/1354803263 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:08.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.998+0000 7fbdd6741640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd014df70 0x7fbdd014e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:08.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.998+0000 7fbdd573f640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdd00cb830 0x7fbdd00a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.998+0000 7fbdd5f40640 1 -- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdd00cb830 msgr2=0x7fbdd00a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.998+0000 7fbdd5f40640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdd00cb830 0x7fbdd00a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.998+0000 7fbdd5f40640 1 -- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd014df70 msgr2=0x7fbdd014e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.998+0000 7fbdd5f40640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd014df70 0x7fbdd014e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.998+0000 7fbdd5f40640 1 -- 172.21.15.38:0/1354803263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc80094d0 con 0x7fbdd00b26a0 2023-12-22T08:42:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.998+0000 7fbdd6741640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd014df70 0x7fbdd014e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.998+0000 7fbdd573f640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdd00cb830 0x7fbdd00a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.998+0000 7fbdd5f40640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd00b26a0 0x7fbdd014a340 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc02c3b0 tx=0x7fbdcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.999+0000 7fbdc67fc640 1 -- 172.21.15.38:0/1354803263 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc02cea0 con 0x7fbdd00b26a0 2023-12-22T08:42:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.999+0000 7fbdc67fc640 1 -- 172.21.15.38:0/1354803263 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc040670 con 0x7fbdd00b26a0 2023-12-22T08:42:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.999+0000 7fbdd81a4640 1 -- 172.21.15.38:0/1354803263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdcc009a70 con 0x7fbdd00b26a0 2023-12-22T08:42:08.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.999+0000 7fbdc67fc640 1 -- 172.21.15.38:0/1354803263 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc040a20 con 0x7fbdd00b26a0 2023-12-22T08:42:08.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:07.999+0000 7fbdd81a4640 1 -- 172.21.15.38:0/1354803263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd015db70 con 0x7fbdd00b26a0 2023-12-22T08:42:08.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.000+0000 7fbdd81a4640 1 -- 172.21.15.38:0/1354803263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd0061910 con 0x7fbdd00b26a0 2023-12-22T08:42:08.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.001+0000 7fbdc67fc640 1 -- 172.21.15.38:0/1354803263 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbdcc040b80 con 0x7fbdd00b26a0 2023-12-22T08:42:08.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.002+0000 7fbdc67fc640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbdb406a460 0x7fbdb406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:08.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.002+0000 7fbdc67fc640 1 -- 172.21.15.38:0/1354803263 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdcc0ab520 con 0x7fbdd00b26a0 2023-12-22T08:42:08.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.002+0000 7fbdd573f640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbdb406a460 0x7fbdb406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:08.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.004+0000 7fbdd573f640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbdb406a460 0x7fbdb406c920 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0151020 tx=0x7fbdc0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:08.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.007+0000 7fbdc67fc640 1 -- 172.21.15.38:0/1354803263 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbdcc076b90 con 0x7fbdd00b26a0 2023-12-22T08:42:08.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.243+0000 7fbdd81a4640 1 -- 172.21.15.38:0/1354803263 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbdd00cca10 con 0x7fbdd00b26a0 2023-12-22T08:42:08.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.243+0000 7fbdc67fc640 1 -- 172.21.15.38:0/1354803263 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbdcc07a1b0 con 0x7fbdd00b26a0 2023-12-22T08:42:08.246 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:42:08.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.246+0000 7fbdd81a4640 1 -- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbdb406a460 msgr2=0x7fbdb406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:08.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.246+0000 7fbdd81a4640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbdb406a460 0x7fbdb406c920 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0151020 tx=0x7fbdc0009040 comp rx=0 tx=0).stop 2023-12-22T08:42:08.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.246+0000 7fbdd81a4640 1 -- 172.21.15.38:0/1354803263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd00b26a0 msgr2=0x7fbdd014a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:08.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.246+0000 7fbdd81a4640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd00b26a0 0x7fbdd014a340 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc02c3b0 tx=0x7fbdcc004a40 comp rx=0 tx=0).stop 2023-12-22T08:42:08.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.246+0000 7fbdd81a4640 1 -- 172.21.15.38:0/1354803263 shutdown_connections 2023-12-22T08:42:08.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.246+0000 7fbdd81a4640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbdd014df70 0x7fbdd014e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:08.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.246+0000 7fbdd81a4640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbdd00cb830 0x7fbdd00a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:08.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.246+0000 7fbdd81a4640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbdb406a460 0x7fbdb406c920 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:08.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.246+0000 7fbdd81a4640 1 --2- 172.21.15.38:0/1354803263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd00b26a0 0x7fbdd014a340 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:08.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.246+0000 7fbdd81a4640 1 -- 172.21.15.38:0/1354803263 >> 172.21.15.38:0/1354803263 conn(0x7fbdd00cf070 msgr2=0x7fbdd0162430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:08.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.246+0000 7fbdd81a4640 1 -- 172.21.15.38:0/1354803263 shutdown_connections 2023-12-22T08:42:08.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:08.246+0000 7fbdd81a4640 1 -- 172.21.15.38:0/1354803263 wait complete. 2023-12-22T08:42:08.266 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:42:08.266 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:42:08.266 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-12-22T08:42:08.266 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T08:42:08.266 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:42:08.266 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:42:08.266 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:42:08.266 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:42:08.266 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:42:08.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:08.267 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-12-22T08:42:08.322 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:42:08.322 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:42:08.322 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:42:08.322 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:08.322 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:42:08.322 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:08.322 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42238sec preferred_lft 42238sec 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-12-22T08:42:08.323 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::5440:f6ff:fe40:85a/64 scope link 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:c3:65:6c:32:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::e4c3:65ff:fe6c:322e/64 scope link 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::34bf:8aff:fe68:3bf6/64 scope link 2023-12-22T08:42:08.324 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:08.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:08.326 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:42:08.422 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-12-22T08:42:08.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:08.427 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-12-22T08:42:08.488 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-12-22T08:42:08.488 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:42:08.488 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-22T08:42:08.488 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-22T08:42:08.488 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:42:08.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:08.489 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:42:08.489 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:42:08.489 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T08:42:08.489 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T08:42:08.489 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T08:42:08.489 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:42:08.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:08.682 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:42:08.737 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:42:08.737 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-22T08:42:08.738 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:42:08.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:08.738 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-12-22T08:42:08.839 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:42:08.839 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T08:42:08.896 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:42:08.897 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:42:08.897 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:42:08.955 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-22T08:42:08.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:08.955 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:42:09.105 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:42:09.105 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:42:09.140 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:42:09.140 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:42:09.140 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:42:09.140 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with new device syntax: 0@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:42:09.140 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:42:09.143 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T08:42:09.143 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:42:09.143 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:42:09.143 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:42:09.143 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:42:09.148 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:42:09.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:09.148 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:42:09.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:09.245 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:42:09.330 INFO:teuthology.orchestra.run.smithi038.stdout:client4922 2023-12-22T08:42:09.331 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:42:09.331 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:09.392 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:42:09.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.613+0000 7fa963fff640 1 Processor -- start 2023-12-22T08:42:09.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.613+0000 7fa963fff640 1 -- start start 2023-12-22T08:42:09.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.614+0000 7fa963fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa964161720 0x7fa9640adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:09.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.615+0000 7fa963fff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9640ce950 con 0x7fa964161340 2023-12-22T08:42:09.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.615+0000 7fa963fff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa964072170 con 0x7fa9640ae1e0 2023-12-22T08:42:09.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.615+0000 7fa963fff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9640cdd40 con 0x7fa964161720 2023-12-22T08:42:09.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.615+0000 7fa962ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa964161340 0x7fa964071a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45898/0 (socket says 172.21.15.38:45898) 2023-12-22T08:42:09.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.615+0000 7fa962ffd640 1 -- 172.21.15.38:0/2103883008 learned_addr learned my addr 172.21.15.38:0/2103883008 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:09.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.615+0000 7fa95bfff640 1 --2- 172.21.15.38:0/2103883008 >> v2:172.21.15.38:3300/0 conn(0x7fa964161720 0x7fa9640adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:09.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.615+0000 7fa9627fc640 1 -- 172.21.15.38:0/2103883008 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939749277 0 0) 0x7fa9640ce950 con 0x7fa964161340 2023-12-22T08:42:09.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.615+0000 7fa9627fc640 1 -- 172.21.15.38:0/2103883008 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa950003520 con 0x7fa964161340 2023-12-22T08:42:09.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.615+0000 7fa95bfff640 1 -- 172.21.15.38:0/2103883008 >> v1:172.21.15.89:6789/0 conn(0x7fa9640ae1e0 legacy=0x7fa96406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:09.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.615+0000 7fa95bfff640 1 -- 172.21.15.38:0/2103883008 >> v1:172.21.15.38:6789/0 conn(0x7fa964161340 legacy=0x7fa964071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:09.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.616+0000 7fa95bfff640 1 -- 172.21.15.38:0/2103883008 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9640ce020 con 0x7fa964161720 2023-12-22T08:42:09.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.617+0000 7fa95bfff640 1 --2- 172.21.15.38:0/2103883008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa964161720 0x7fa9640adca0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0097d0 tx=0x7fa94c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3bf8d76faf95c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:09.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.617+0000 7fa9627fc640 1 -- 172.21.15.38:0/2103883008 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c031780 con 0x7fa964161720 2023-12-22T08:42:09.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.617+0000 7fa9627fc640 1 -- 172.21.15.38:0/2103883008 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c0318e0 con 0x7fa964161720 2023-12-22T08:42:09.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.617+0000 7fa9627fc640 1 -- 172.21.15.38:0/2103883008 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c031c70 con 0x7fa964161720 2023-12-22T08:42:09.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.617+0000 7fa963fff640 1 -- 172.21.15.38:0/2103883008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa964161720 msgr2=0x7fa9640adca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:09.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.617+0000 7fa963fff640 1 --2- 172.21.15.38:0/2103883008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa964161720 0x7fa9640adca0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0097d0 tx=0x7fa94c02b820 comp rx=0 tx=0).stop 2023-12-22T08:42:09.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.618+0000 7fa963fff640 1 -- 172.21.15.38:0/2103883008 shutdown_connections 2023-12-22T08:42:09.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.618+0000 7fa963fff640 1 --2- 172.21.15.38:0/2103883008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa964161720 0x7fa9640adca0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:09.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.618+0000 7fa963fff640 1 -- 172.21.15.38:0/2103883008 >> 172.21.15.38:0/2103883008 conn(0x7fa9640b1f70 msgr2=0x7fa9640b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:09.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.618+0000 7fa963fff640 1 -- 172.21.15.38:0/2103883008 shutdown_connections 2023-12-22T08:42:09.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.618+0000 7fa963fff640 1 -- 172.21.15.38:0/2103883008 wait complete. 2023-12-22T08:42:09.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.620+0000 7fa963fff640 1 Processor -- start 2023-12-22T08:42:09.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.620+0000 7fa963fff640 1 -- start start 2023-12-22T08:42:09.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.621+0000 7fa963fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9640ae1e0 0x7fa964099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:09.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.621+0000 7fa963fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa964161340 0x7fa96414b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:09.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.621+0000 7fa963fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa964161720 0x7fa9641f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:09.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.621+0000 7fa963fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96409b1e0 con 0x7fa964161340 2023-12-22T08:42:09.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.621+0000 7fa963fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9641f3d80 con 0x7fa964161720 2023-12-22T08:42:09.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.621+0000 7fa963fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96415fcd0 con 0x7fa9640ae1e0 2023-12-22T08:42:09.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.621+0000 7fa95bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa964161340 0x7fa96414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:09.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.621+0000 7fa95bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa964161340 0x7fa96414b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57952/0 (socket says 172.21.15.38:57952) 2023-12-22T08:42:09.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.621+0000 7fa95bfff640 1 -- 172.21.15.38:0/1308429627 learned_addr learned my addr 172.21.15.38:0/1308429627 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:09.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.622+0000 7fa962ffd640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9640ae1e0 0x7fa964099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:09.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.622+0000 7fa9637fe640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa964161720 0x7fa9641f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:09.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.622+0000 7fa95bfff640 1 -- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9640ae1e0 msgr2=0x7fa964099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:09.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.622+0000 7fa95bfff640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9640ae1e0 0x7fa964099a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:09.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.622+0000 7fa95bfff640 1 -- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa964161720 msgr2=0x7fa9641f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:09.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.622+0000 7fa95bfff640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa964161720 0x7fa9641f3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:09.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.622+0000 7fa95bfff640 1 -- 172.21.15.38:0/1308429627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c009400 con 0x7fa964161340 2023-12-22T08:42:09.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.622+0000 7fa95bfff640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa964161340 0x7fa96414b320 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa94c034040 tx=0x7fa94c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:09.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.622+0000 7fa960ff9640 1 -- 172.21.15.38:0/1308429627 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c032620 con 0x7fa964161340 2023-12-22T08:42:09.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.622+0000 7fa960ff9640 1 -- 172.21.15.38:0/1308429627 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c0327a0 con 0x7fa964161340 2023-12-22T08:42:09.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.622+0000 7fa960ff9640 1 -- 172.21.15.38:0/1308429627 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c032b50 con 0x7fa964161340 2023-12-22T08:42:09.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.622+0000 7fa963fff640 1 -- 172.21.15.38:0/1308429627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96415ffb0 con 0x7fa964161340 2023-12-22T08:42:09.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.623+0000 7fa963fff640 1 -- 172.21.15.38:0/1308429627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa964160570 con 0x7fa964161340 2023-12-22T08:42:09.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.624+0000 7fa963fff640 1 -- 172.21.15.38:0/1308429627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa964061910 con 0x7fa964161340 2023-12-22T08:42:09.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.624+0000 7fa960ff9640 1 -- 172.21.15.38:0/1308429627 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa94c032cb0 con 0x7fa964161340 2023-12-22T08:42:09.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.625+0000 7fa960ff9640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa94406a430 0x7fa94406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:09.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.625+0000 7fa960ff9640 1 -- 172.21.15.38:0/1308429627 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa94c0aa340 con 0x7fa964161340 2023-12-22T08:42:09.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.626+0000 7fa962ffd640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa94406a430 0x7fa94406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:09.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.627+0000 7fa962ffd640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa94406a430 0x7fa94406c8f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa954000f60 tx=0x7fa954009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:09.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.631+0000 7fa960ff9640 1 -- 172.21.15.38:0/1308429627 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa94c075890 con 0x7fa964161340 2023-12-22T08:42:09.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.862+0000 7fa963fff640 1 -- 172.21.15.38:0/1308429627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa9640a0130 con 0x7fa964161340 2023-12-22T08:42:09.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.862+0000 7fa960ff9640 1 -- 172.21.15.38:0/1308429627 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa94c078eb0 con 0x7fa964161340 2023-12-22T08:42:09.865 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:42:09.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.865+0000 7fa963fff640 1 -- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa94406a430 msgr2=0x7fa94406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:09.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.865+0000 7fa963fff640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa94406a430 0x7fa94406c8f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa954000f60 tx=0x7fa954009040 comp rx=0 tx=0).stop 2023-12-22T08:42:09.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.865+0000 7fa963fff640 1 -- 172.21.15.38:0/1308429627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa964161340 msgr2=0x7fa96414b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:09.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.865+0000 7fa963fff640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa964161340 0x7fa96414b320 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa94c034040 tx=0x7fa94c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:42:09.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.865+0000 7fa963fff640 1 -- 172.21.15.38:0/1308429627 shutdown_connections 2023-12-22T08:42:09.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.865+0000 7fa963fff640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa964161720 0x7fa9641f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:09.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.865+0000 7fa963fff640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa94406a430 0x7fa94406c8f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:09.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.865+0000 7fa963fff640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa964161340 0x7fa96414b320 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:09.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.865+0000 7fa963fff640 1 --2- 172.21.15.38:0/1308429627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9640ae1e0 0x7fa964099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:09.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.865+0000 7fa963fff640 1 -- 172.21.15.38:0/1308429627 >> 172.21.15.38:0/1308429627 conn(0x7fa9640b1f70 msgr2=0x7fa9640cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:09.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.866+0000 7fa963fff640 1 -- 172.21.15.38:0/1308429627 shutdown_connections 2023-12-22T08:42:09.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:09.866+0000 7fa963fff640 1 -- 172.21.15.38:0/1308429627 wait complete. 2023-12-22T08:42:09.886 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:42:09.886 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:42:09.886 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-22T08:42:09.886 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T08:42:09.886 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T08:42:09.886 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:42:09.886 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:42:09.886 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:42:09.886 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:42:09.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:09.887 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-22T08:42:09.948 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:42:09.948 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:42:09.948 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:42:09.948 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:09.948 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:42:09.948 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:09.948 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:42:09.948 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:42:09.948 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-22T08:42:09.948 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:42:09.949 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:42:09.949 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-22T08:42:09.949 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:42:09.949 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:42:09.949 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:42:09.949 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:42:09.949 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:42:09.949 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42232sec preferred_lft 42232sec 2023-12-22T08:42:09.949 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-22T08:42:09.949 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:09.949 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:42:09.950 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:42:09.950 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:42:09.950 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:09.950 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::9cc2:a9ff:fe75:e812/64 scope link 2023-12-22T08:42:09.950 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:09.950 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:42:09.950 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8e:46:07:65:e3:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T08:42:09.951 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::8c46:7ff:fe65:e31f/64 scope link 2023-12-22T08:42:09.951 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:09.951 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:42:09.951 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T08:42:09.951 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2cc2:baff:fe6f:ea22/64 scope link 2023-12-22T08:42:09.951 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:42:09.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:09.953 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:42:10.046 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-22T08:42:10.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:10.051 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-22T08:42:10.109 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-22T08:42:10.109 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:42:10.109 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:42:10.109 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:42:10.109 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:42:10.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:10.110 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:42:10.110 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:42:10.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:42:10.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:42:10.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:42:10.110 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:42:10.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:10.282 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:42:10.333 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T08:42:10.333 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-22T08:42:10.334 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:42:10.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:10.334 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-22T08:42:10.427 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:42:10.427 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T08:42:10.481 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:42:10.482 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:42:10.482 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:42:10.533 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-22T08:42:10.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:10.533 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:42:10.670 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:42:10.670 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:42:10.702 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:42:10.702 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:42:10.703 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:42:10.703 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 1@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:42:10.703 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:42:10.705 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T08:42:10.705 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:42:10.705 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:42:10.705 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:42:10.705 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:42:10.708 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:42:10.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:10.709 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:42:10.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:10.786 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:42:10.842 INFO:teuthology.orchestra.run.smithi089.stdout:client5688 2023-12-22T08:42:10.842 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:42:10.842 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:10.895 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:42:11.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.128+0000 7f7d7e8ee640 1 Processor -- start 2023-12-22T08:42:11.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.128+0000 7f7d7e8ee640 1 -- start start 2023-12-22T08:42:11.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.130+0000 7f7d7e8ee640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d7815e740 0x7f7d7815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:11.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.130+0000 7f7d7e8ee640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d780b3f90 0x7f7d78070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:11.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.130+0000 7f7d7e8ee640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7815eb20 con 0x7f7d7806ca50 2023-12-22T08:42:11.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.130+0000 7f7d7e8ee640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7806e650 con 0x7f7d780b3f90 2023-12-22T08:42:11.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.130+0000 7f7d7e8ee640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78070770 con 0x7f7d7815e740 2023-12-22T08:42:11.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.130+0000 7f7d777fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7d7806ca50 0x7f7d780b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34670/0 (socket says 172.21.15.38:34670) 2023-12-22T08:42:11.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.131+0000 7f7d777fe640 1 -- 172.21.15.38:0/2990337675 learned_addr learned my addr 172.21.15.38:0/2990337675 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:11.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.131+0000 7f7d7ce8b640 1 --2- 172.21.15.38:0/2990337675 >> v2:172.21.15.89:3300/0 conn(0x7f7d780b3f90 0x7f7d78070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:11.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.131+0000 7f7d77fff640 1 --2- 172.21.15.38:0/2990337675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d7815e740 0x7f7d7815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.131+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473616310 0 0) 0x7f7d7815eb20 con 0x7f7d7806ca50 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.131+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d60003520 con 0x7f7d7806ca50 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3496513764 0 0) 0x7f7d60003520 con 0x7f7d7806ca50 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d7815e740 msgr2=0x7f7d7815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 --2- 172.21.15.38:0/2990337675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d7815e740 0x7f7d7815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 >> v2:172.21.15.89:3300/0 conn(0x7f7d780b3f90 msgr2=0x7f7d78070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 --2- 172.21.15.38:0/2990337675 >> v2:172.21.15.89:3300/0 conn(0x7f7d780b3f90 0x7f7d78070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7806d180 con 0x7f7d7806ca50 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f7d6c001670 con 0x7f7d7806ca50 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 >> v1:172.21.15.38:6789/0 conn(0x7f7d7806ca50 legacy=0x7f7d780b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 --2- 172.21.15.38:0/2990337675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d60003970 0x7f7d60003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 --2- 172.21.15.38:0/2990337675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d600047c0 0x7f7d60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 --2- 172.21.15.38:0/2990337675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d7815e740 0x7f7d60005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7806e650 con 0x7f7d60003970 2023-12-22T08:42:11.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78070770 con 0x7f7d600047c0 2023-12-22T08:42:11.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6000ba60 con 0x7f7d7815e740 2023-12-22T08:42:11.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d77fff640 1 --2- 172.21.15.38:0/2990337675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d60003970 0x7f7d60003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:11.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d777fe640 1 --2- 172.21.15.38:0/2990337675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d600047c0 0x7f7d60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:11.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.132+0000 7f7d7ce8b640 1 --2- 172.21.15.38:0/2990337675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d7815e740 0x7f7d60005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:11.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.133+0000 7f7d77fff640 1 -- 172.21.15.38:0/2990337675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d7815e740 msgr2=0x7f7d60005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:11.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.133+0000 7f7d77fff640 1 --2- 172.21.15.38:0/2990337675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d7815e740 0x7f7d60005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:11.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.133+0000 7f7d77fff640 1 -- 172.21.15.38:0/2990337675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d600047c0 msgr2=0x7f7d60004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:11.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.133+0000 7f7d77fff640 1 --2- 172.21.15.38:0/2990337675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d600047c0 0x7f7d60004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:11.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.133+0000 7f7d77fff640 1 -- 172.21.15.38:0/2990337675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60003520 con 0x7f7d60003970 2023-12-22T08:42:11.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.133+0000 7f7d777fe640 1 --2- 172.21.15.38:0/2990337675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d600047c0 0x7f7d60004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:11.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.134+0000 7f7d77fff640 1 --2- 172.21.15.38:0/2990337675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d60003970 0x7f7d60003d90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009a90 tx=0x7f7d600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfa1584af4fc365 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:11.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.134+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6802c680 con 0x7f7d60003970 2023-12-22T08:42:11.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.134+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6802c7e0 con 0x7f7d60003970 2023-12-22T08:42:11.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.134+0000 7f7d76ffd640 1 -- 172.21.15.38:0/2990337675 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6802cb70 con 0x7f7d60003970 2023-12-22T08:42:11.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.135+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2990337675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d60003970 msgr2=0x7f7d60003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:11.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.135+0000 7f7d7e8ee640 1 --2- 172.21.15.38:0/2990337675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d60003970 0x7f7d60003d90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009a90 tx=0x7f7d600057f0 comp rx=0 tx=0).stop 2023-12-22T08:42:11.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.135+0000 7f7d7ce8b640 1 -- 172.21.15.38:0/2990337675 reap_dead start 2023-12-22T08:42:11.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.135+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2990337675 shutdown_connections 2023-12-22T08:42:11.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.135+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2990337675 >> 172.21.15.38:0/2990337675 conn(0x7f7d780cfea0 msgr2=0x7f7d780d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:11.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.135+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2990337675 shutdown_connections 2023-12-22T08:42:11.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.135+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2990337675 wait complete. 2023-12-22T08:42:11.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.137+0000 7f7d7e8ee640 1 Processor -- start 2023-12-22T08:42:11.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.137+0000 7f7d7e8ee640 1 -- start start 2023-12-22T08:42:11.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.138+0000 7f7d7e8ee640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d60003970 0x7f7d78153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:11.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.138+0000 7f7d7e8ee640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d7815a370 0x7f7d780b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:11.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.138+0000 7f7d7e8ee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d780b8650 0x7f7d780d26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:11.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.138+0000 7f7d7e8ee640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d781538c0 con 0x7f7d7815a370 2023-12-22T08:42:11.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.138+0000 7f7d7e8ee640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7815b0d0 con 0x7f7d780b8650 2023-12-22T08:42:11.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.138+0000 7f7d7e8ee640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7815a830 con 0x7f7d60003970 2023-12-22T08:42:11.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.138+0000 7f7d777fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d7815a370 0x7f7d780b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:11.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.138+0000 7f7d777fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d7815a370 0x7f7d780b8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52352/0 (socket says 172.21.15.38:52352) 2023-12-22T08:42:11.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.138+0000 7f7d777fe640 1 -- 172.21.15.38:0/2793095412 learned_addr learned my addr 172.21.15.38:0/2793095412 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:11.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.139+0000 7f7d77fff640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d60003970 0x7f7d78153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:11.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.139+0000 7f7d7ce8b640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d780b8650 0x7f7d780d26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:11.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.139+0000 7f7d777fe640 1 -- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d60003970 msgr2=0x7f7d78153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:11.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.139+0000 7f7d777fe640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d60003970 0x7f7d78153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:11.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.139+0000 7f7d777fe640 1 -- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d780b8650 msgr2=0x7f7d780d26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:11.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.139+0000 7f7d777fe640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d780b8650 0x7f7d780d26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:11.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.139+0000 7f7d777fe640 1 -- 172.21.15.38:0/2793095412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7815ab10 con 0x7f7d7815a370 2023-12-22T08:42:11.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.139+0000 7f7d777fe640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d7815a370 0x7f7d780b8110 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00d770 tx=0x7f7d6c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:11.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.139+0000 7f7d74ff9640 1 -- 172.21.15.38:0/2793095412 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0074e0 con 0x7f7d7815a370 2023-12-22T08:42:11.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.139+0000 7f7d74ff9640 1 -- 172.21.15.38:0/2793095412 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c007640 con 0x7f7d7815a370 2023-12-22T08:42:11.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.139+0000 7f7d74ff9640 1 -- 172.21.15.38:0/2793095412 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c004a20 con 0x7f7d7815a370 2023-12-22T08:42:11.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.140+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2793095412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7815adf0 con 0x7f7d7815a370 2023-12-22T08:42:11.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.140+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2793095412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d780d2c30 con 0x7f7d7815a370 2023-12-22T08:42:11.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.141+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2793095412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d780b5ce0 con 0x7f7d7815a370 2023-12-22T08:42:11.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.142+0000 7f7d74ff9640 1 -- 172.21.15.38:0/2793095412 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7d6c004b80 con 0x7f7d7815a370 2023-12-22T08:42:11.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.143+0000 7f7d74ff9640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d6406a480 0x7f7d6406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:11.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.143+0000 7f7d74ff9640 1 -- 172.21.15.38:0/2793095412 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d6c0883d0 con 0x7f7d7815a370 2023-12-22T08:42:11.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.143+0000 7f7d77fff640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d6406a480 0x7f7d6406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:11.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.144+0000 7f7d77fff640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d6406a480 0x7f7d6406c940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7d68036000 tx=0x7f7d68030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:11.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.147+0000 7f7d74ff9640 1 -- 172.21.15.38:0/2793095412 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7d780b5ce0 con 0x7f7d7815a370 2023-12-22T08:42:11.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.378+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2793095412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d780b5ce0 con 0x7f7d7815a370 2023-12-22T08:42:11.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.379+0000 7f7d74ff9640 1 -- 172.21.15.38:0/2793095412 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f7d780b5ce0 con 0x7f7d7815a370 2023-12-22T08:42:11.382 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:11.382 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2078860804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2078860804},{"type":"v1","addr":"172.21.15.38:6835","nonce":2078860804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4244510882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4244510882},{"type":"v1","addr":"172.21.15.89:6837","nonce":4244510882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3227878158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3227878158},{"type":"v1","addr":"172.21.15.38:6834","nonce":3227878158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:42:00.933947+0000","modified":"2023-12-22T08:42:03.951929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5538":{"gid":5538,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2131151279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2131151279},{"type":"v1","addr":"172.21.15.89:6836","nonce":2131151279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T08:42:11.382 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2023-12-22T08:42:11.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.382+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d6406a480 msgr2=0x7f7d6406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:11.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.382+0000 7f7d7e8ee640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d6406a480 0x7f7d6406c940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7d68036000 tx=0x7f7d68030000 comp rx=0 tx=0).stop 2023-12-22T08:42:11.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.382+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2793095412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d7815a370 msgr2=0x7f7d780b8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:11.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.382+0000 7f7d7e8ee640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d7815a370 0x7f7d780b8110 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00d770 tx=0x7f7d6c00dc30 comp rx=0 tx=0).stop 2023-12-22T08:42:11.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.382+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2793095412 shutdown_connections 2023-12-22T08:42:11.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.382+0000 7f7d7e8ee640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d780b8650 0x7f7d780d26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:11.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.382+0000 7f7d7e8ee640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d6406a480 0x7f7d6406c940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:11.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.382+0000 7f7d7e8ee640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d7815a370 0x7f7d780b8110 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:11.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.382+0000 7f7d7e8ee640 1 --2- 172.21.15.38:0/2793095412 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d60003970 0x7f7d78153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:11.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.382+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2793095412 >> 172.21.15.38:0/2793095412 conn(0x7f7d780cfea0 msgr2=0x7f7d7815d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:11.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.382+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2793095412 shutdown_connections 2023-12-22T08:42:11.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:11.382+0000 7f7d7e8ee640 1 -- 172.21.15.38:0/2793095412 wait complete. 2023-12-22T08:42:11.402 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-22T08:42:11.645 INFO:teuthology.orchestra.run.smithi089.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":5538,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.688184289000001,"mdsmap_epoch":23,"osdmap_epoch":48,"osdmap_epoch_barrier":48,"uptime":16.279926529000001} 2023-12-22T08:42:11.645 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 5538, "mdsmap_epoch": 23, "osdmap_epoch": 48, "osdmap_epoch_barrier": 48, "rank_uptime": 10.688184289, "state": "up:active", "uptime": 16.279926529, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:42:11.645 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-22T08:42:11.894 INFO:teuthology.orchestra.run.smithi038.stdout:{"osd_mon_report_interval":"5"} 2023-12-22T08:42:11.894 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-22T08:42:11.896 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-12-22T08:42:11.896 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:42:11.896 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:11.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:11.954 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-12-22T08:42:14.050 INFO:teuthology.orchestra.run.smithi038.stderr:265+0 records in 2023-12-22T08:42:14.050 INFO:teuthology.orchestra.run.smithi038.stderr:265+0 records out 2023-12-22T08:42:14.050 INFO:teuthology.orchestra.run.smithi038.stderr:277872640 bytes (278 MB, 265 MiB) copied, 2.03278 s, 137 MB/s 2023-12-22T08:42:14.052 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:42:14.052 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:14.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:14.099 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-12-22T08:42:16.215 INFO:teuthology.orchestra.run.smithi038.stderr:292+0 records in 2023-12-22T08:42:16.215 INFO:teuthology.orchestra.run.smithi038.stderr:292+0 records out 2023-12-22T08:42:16.216 INFO:teuthology.orchestra.run.smithi038.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.01171 s, 152 MB/s 2023-12-22T08:42:16.216 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-22T08:42:16.217 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:42:16.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.403+0000 7f09bafdf640 1 Processor -- start 2023-12-22T08:42:16.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.404+0000 7f09bafdf640 1 -- start start 2023-12-22T08:42:16.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.405+0000 7f09bafdf640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f09b415d340 0x7f09b4071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:16.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.405+0000 7f09bafdf640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09b4071610 0x7f09b4160f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.405+0000 7f09bafdf640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b4161900 con 0x7f09b41614b0 2023-12-22T08:42:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.405+0000 7f09bafdf640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b4071a50 con 0x7f09b415d340 2023-12-22T08:42:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.405+0000 7f09bafdf640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b40721d0 con 0x7f09b4071610 2023-12-22T08:42:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.406+0000 7f09b9fdd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f09b415d340 0x7f09b4071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.406+0000 7f09b9fdd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f09b415d340 0x7f09b4071bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52354/0 (socket says 172.21.15.38:52354) 2023-12-22T08:42:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.406+0000 7f09b9fdd640 1 -- 172.21.15.38:0/2761229724 learned_addr learned my addr 172.21.15.38:0/2761229724 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.406+0000 7f09ba7de640 1 --1- 172.21.15.38:0/2761229724 >> v1:172.21.15.38:6789/0 conn(0x7f09b41614b0 0x7f09b415d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34680/0 (socket says 172.21.15.38:34680) 2023-12-22T08:42:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.406+0000 7f09b97dc640 1 --2- 172.21.15.38:0/2761229724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09b4071610 0x7f09b4160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.406+0000 7f09b9fdd640 1 -- 172.21.15.38:0/2761229724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09b4071610 msgr2=0x7f09b4160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.406+0000 7f09b9fdd640 1 --2- 172.21.15.38:0/2761229724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09b4071610 0x7f09b4160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.406+0000 7f09b9fdd640 1 -- 172.21.15.38:0/2761229724 >> v1:172.21.15.38:6789/0 conn(0x7f09b41614b0 legacy=0x7f09b415d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:16.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.406+0000 7f09b9fdd640 1 -- 172.21.15.38:0/2761229724 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b40cd090 con 0x7f09b415d340 2023-12-22T08:42:16.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.406+0000 7f09b97dc640 1 --2- 172.21.15.38:0/2761229724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09b4071610 0x7f09b4160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:16.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.407+0000 7f09b9fdd640 1 --2- 172.21.15.38:0/2761229724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b415d340 0x7f09b4071bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009870 tx=0x7f09a802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19d2b19447f4540 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:16.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.407+0000 7f09b8fdb640 1 -- 172.21.15.38:0/2761229724 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8031640 con 0x7f09b415d340 2023-12-22T08:42:16.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.407+0000 7f09b8fdb640 1 -- 172.21.15.38:0/2761229724 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a80317a0 con 0x7f09b415d340 2023-12-22T08:42:16.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.407+0000 7f09b8fdb640 1 -- 172.21.15.38:0/2761229724 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8031b30 con 0x7f09b415d340 2023-12-22T08:42:16.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.408+0000 7f09bafdf640 1 -- 172.21.15.38:0/2761229724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b415d340 msgr2=0x7f09b4071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:16.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.408+0000 7f09bafdf640 1 --2- 172.21.15.38:0/2761229724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b415d340 0x7f09b4071bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009870 tx=0x7f09a802b8f0 comp rx=0 tx=0).stop 2023-12-22T08:42:16.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.408+0000 7f09bafdf640 1 -- 172.21.15.38:0/2761229724 shutdown_connections 2023-12-22T08:42:16.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.408+0000 7f09bafdf640 1 --2- 172.21.15.38:0/2761229724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09b4071610 0x7f09b4160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:16.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.408+0000 7f09bafdf640 1 --2- 172.21.15.38:0/2761229724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b415d340 0x7f09b4071bf0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:16.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.408+0000 7f09bafdf640 1 -- 172.21.15.38:0/2761229724 >> 172.21.15.38:0/2761229724 conn(0x7f09b40b1f70 msgr2=0x7f09b40b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:16.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.408+0000 7f09bafdf640 1 -- 172.21.15.38:0/2761229724 shutdown_connections 2023-12-22T08:42:16.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.408+0000 7f09bafdf640 1 -- 172.21.15.38:0/2761229724 wait complete. 2023-12-22T08:42:16.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.410+0000 7f09bafdf640 1 Processor -- start 2023-12-22T08:42:16.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.410+0000 7f09bafdf640 1 -- start start 2023-12-22T08:42:16.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.411+0000 7f09bafdf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b4071610 0x7f09b41486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:16.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.411+0000 7f09bafdf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09b415d340 0x7f09b4156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:16.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.411+0000 7f09bafdf640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09b41614b0 0x7f09b41569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:16.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.411+0000 7f09bafdf640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b4154b50 con 0x7f09b4071610 2023-12-22T08:42:16.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.411+0000 7f09bafdf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b4153ed0 con 0x7f09b415d340 2023-12-22T08:42:16.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.411+0000 7f09bafdf640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b41541b0 con 0x7f09b41614b0 2023-12-22T08:42:16.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.412+0000 7f09b9fdd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b4071610 0x7f09b41486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:16.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.412+0000 7f09b9fdd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b4071610 0x7f09b41486d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52360/0 (socket says 172.21.15.38:52360) 2023-12-22T08:42:16.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.412+0000 7f09b9fdd640 1 -- 172.21.15.38:0/2419445691 learned_addr learned my addr 172.21.15.38:0/2419445691 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:16.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.412+0000 7f09ba7de640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09b41614b0 0x7f09b41569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:16.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.412+0000 7f09b97dc640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09b415d340 0x7f09b4156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:16.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.412+0000 7f09b9fdd640 1 -- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09b41614b0 msgr2=0x7f09b41569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:16.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.412+0000 7f09b9fdd640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09b41614b0 0x7f09b41569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:16.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.412+0000 7f09b9fdd640 1 -- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09b415d340 msgr2=0x7f09b4156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:16.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.412+0000 7f09b9fdd640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09b415d340 0x7f09b4156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:16.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.412+0000 7f09b9fdd640 1 -- 172.21.15.38:0/2419445691 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80094d0 con 0x7f09b4071610 2023-12-22T08:42:16.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.412+0000 7f09b9fdd640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b4071610 0x7f09b41486d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f09a8000c00 tx=0x7f09a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:16.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.413+0000 7f09a67fc640 1 -- 172.21.15.38:0/2419445691 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a803ac60 con 0x7f09b4071610 2023-12-22T08:42:16.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.413+0000 7f09a67fc640 1 -- 172.21.15.38:0/2419445691 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a803ade0 con 0x7f09b4071610 2023-12-22T08:42:16.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.413+0000 7f09a67fc640 1 -- 172.21.15.38:0/2419445691 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8044630 con 0x7f09b4071610 2023-12-22T08:42:16.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.413+0000 7f09bafdf640 1 -- 172.21.15.38:0/2419445691 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b4154490 con 0x7f09b4071610 2023-12-22T08:42:16.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.413+0000 7f09bafdf640 1 -- 172.21.15.38:0/2419445691 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b4145ca0 con 0x7f09b4071610 2023-12-22T08:42:16.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.414+0000 7f09bafdf640 1 -- 172.21.15.38:0/2419445691 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b4061910 con 0x7f09b4071610 2023-12-22T08:42:16.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.415+0000 7f09a67fc640 1 -- 172.21.15.38:0/2419445691 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f09a802f050 con 0x7f09b4071610 2023-12-22T08:42:16.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.416+0000 7f09a67fc640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f099806a430 0x7f099806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:16.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.416+0000 7f09a67fc640 1 -- 172.21.15.38:0/2419445691 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09a80aab30 con 0x7f09b4071610 2023-12-22T08:42:16.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.417+0000 7f09b97dc640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f099806a430 0x7f099806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:16.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.418+0000 7f09b97dc640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f099806a430 0x7f099806c8f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f09b41f5f30 tx=0x7f09b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:16.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.420+0000 7f09a67fc640 1 -- 172.21.15.38:0/2419445691 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f09a8076080 con 0x7f09b4071610 2023-12-22T08:42:16.467 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:16.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.612+0000 7f09bafdf640 1 -- 172.21.15.38:0/2419445691 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f09b4160fa0 con 0x7f09b4071610 2023-12-22T08:42:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.616+0000 7f09a67fc640 1 -- 172.21.15.38:0/2419445691 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+33428 (secure 0 0 0) 0x7f09a80796a0 con 0x7f09b4071610 2023-12-22T08:42:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:16.618 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:42:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 48, 2023-12-22T08:42:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:42:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:42:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:42:01.938335+0000", 2023-12-22T08:42:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:42:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:42:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:42:16.618 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:42:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:42:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:42:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:42:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:42:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:42:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:42:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:42:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:42:16.619 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 7, 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:42:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:42:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:42:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:42:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "16", 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:16.624 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:42:16.625 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 6, 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:58.840533+0000", 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:16.626 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:42:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:42:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:42:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:42:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:42:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:16.627 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "47", 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:16.628 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:16.629 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:16.630 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:42:16.631 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 7, 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:59.953505+0000", 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:16.632 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:16.633 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "48", 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:16.634 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:16.635 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:16.636 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:42:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:42:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:42:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:16.637 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.75, 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.75, 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.75, 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.75, 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:16.638 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.639 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:42:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:42:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.640 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.641 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.642 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:16.643 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:16.644 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:16.645 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:42:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.646 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:42:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:42:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:16.647 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:42:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:42:16.648 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:16.649 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:16.650 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:16.651 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:42:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:42:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.652 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:42:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:42:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.653 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:42:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:42:16.654 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:42:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:42:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:42:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:42:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.655 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.656 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.657 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:16.658 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.659 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.660 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.661 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:42:16.662 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.663 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.664 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.665 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.666 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.667 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:16.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:16.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:42:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:42:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:42:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:42:16.670 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:16.671 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:16.672 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:16.673 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.674 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.675 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:16.676 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:42:16.677 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:42:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.678 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.679 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:16.680 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:42:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:16.682 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:16.683 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:16.684 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:16.685 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:16.686 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:42:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:42:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.687 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:42:16.688 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:42:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:16.689 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:42:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:42:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:42:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:42:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:42:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:42:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:42:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:42:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:42:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:42:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:42:16.690 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:16.690 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:42:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.618+0000 7f09bafdf640 1 -- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f099806a430 msgr2=0x7f099806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.618+0000 7f09bafdf640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f099806a430 0x7f099806c8f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f09b41f5f30 tx=0x7f09b0008040 comp rx=0 tx=0).stop 2023-12-22T08:42:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.618+0000 7f09bafdf640 1 -- 172.21.15.38:0/2419445691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b4071610 msgr2=0x7f09b41486d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.618+0000 7f09bafdf640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b4071610 0x7f09b41486d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f09a8000c00 tx=0x7f09a80046c0 comp rx=0 tx=0).stop 2023-12-22T08:42:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.618+0000 7f09bafdf640 1 -- 172.21.15.38:0/2419445691 shutdown_connections 2023-12-22T08:42:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.618+0000 7f09bafdf640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09b41614b0 0x7f09b41569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.618+0000 7f09bafdf640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09b415d340 0x7f09b4156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.618+0000 7f09bafdf640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f099806a430 0x7f099806c8f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:16.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.618+0000 7f09bafdf640 1 --2- 172.21.15.38:0/2419445691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09b4071610 0x7f09b41486d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:16.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.619+0000 7f09bafdf640 1 -- 172.21.15.38:0/2419445691 >> 172.21.15.38:0/2419445691 conn(0x7f09b40b1f70 msgr2=0x7f09b415dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:16.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.619+0000 7f09bafdf640 1 -- 172.21.15.38:0/2419445691 shutdown_connections 2023-12-22T08:42:16.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:16.619+0000 7f09bafdf640 1 -- 172.21.15.38:0/2419445691 wait complete. 2023-12-22T08:42:16.693 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-22T08:42:17.172 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:42:17.170+0000 7f0a296e8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-12-22T08:42:21.695 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:42:21.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.927+0000 7f5957e38640 1 Processor -- start 2023-12-22T08:42:21.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.927+0000 7f5957e38640 1 -- start start 2023-12-22T08:42:21.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.929+0000 7f5957e38640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5950144d10 0x7f59500cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:21.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.929+0000 7f5957e38640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59500cc670 0x7f59500b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:21.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.929+0000 7f5957e38640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f59500b2590 0x7f595015f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:21.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.929+0000 7f5957e38640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59500b2a20 con 0x7f59500b2590 2023-12-22T08:42:21.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.929+0000 7f5957e38640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59501450f0 con 0x7f5950144d10 2023-12-22T08:42:21.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.929+0000 7f5957e38640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59500ce010 con 0x7f59500cc670 2023-12-22T08:42:21.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.929+0000 7f59563d5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f59500b2590 0x7f595015f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:21.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.930+0000 7f59563d5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f59500b2590 0x7f595015f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39146/0 (socket says 172.21.15.38:39146) 2023-12-22T08:42:21.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.930+0000 7f59563d5640 1 -- 172.21.15.38:0/2065429216 learned_addr learned my addr 172.21.15.38:0/2065429216 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:21.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.930+0000 7f59553d3640 1 --2- 172.21.15.38:0/2065429216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59500cc670 0x7f59500b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:21.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.930+0000 7f5955bd4640 1 --2- 172.21.15.38:0/2065429216 >> v2:172.21.15.89:3300/0 conn(0x7f5950144d10 0x7f59500cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:21.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.930+0000 7f59563d5640 1 -- 172.21.15.38:0/2065429216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59500cc670 msgr2=0x7f59500b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:21.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.930+0000 7f59563d5640 1 --2- 172.21.15.38:0/2065429216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59500cc670 0x7f59500b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:21.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.930+0000 7f59563d5640 1 -- 172.21.15.38:0/2065429216 >> v2:172.21.15.89:3300/0 conn(0x7f5950144d10 msgr2=0x7f59500cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:21.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.930+0000 7f59563d5640 1 --2- 172.21.15.38:0/2065429216 >> v2:172.21.15.89:3300/0 conn(0x7f5950144d10 0x7f59500cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:21.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.930+0000 7f59563d5640 1 -- 172.21.15.38:0/2065429216 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59500ce2f0 con 0x7f59500b2590 2023-12-22T08:42:21.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.930+0000 7f5955bd4640 1 --2- 172.21.15.38:0/2065429216 >> v2:172.21.15.89:3300/0 conn(0x7f5950144d10 0x7f59500cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:21.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.931+0000 7f59563d5640 1 --2- 172.21.15.38:0/2065429216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59500b2590 0x7f595015f040 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f59500cfe00 tx=0x7f594802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bd6afa0c8089d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:21.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.932+0000 7f5954bd2640 1 -- 172.21.15.38:0/2065429216 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948031860 con 0x7f59500b2590 2023-12-22T08:42:21.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.932+0000 7f5954bd2640 1 -- 172.21.15.38:0/2065429216 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59480319c0 con 0x7f59500b2590 2023-12-22T08:42:21.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.932+0000 7f5954bd2640 1 -- 172.21.15.38:0/2065429216 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5948031d50 con 0x7f59500b2590 2023-12-22T08:42:21.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.932+0000 7f5957e38640 1 -- 172.21.15.38:0/2065429216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59500b2590 msgr2=0x7f595015f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:21.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.932+0000 7f5957e38640 1 --2- 172.21.15.38:0/2065429216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59500b2590 0x7f595015f040 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f59500cfe00 tx=0x7f594802b900 comp rx=0 tx=0).stop 2023-12-22T08:42:21.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.933+0000 7f5957e38640 1 -- 172.21.15.38:0/2065429216 shutdown_connections 2023-12-22T08:42:21.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.933+0000 7f5957e38640 1 --2- 172.21.15.38:0/2065429216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59500b2590 0x7f595015f040 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:21.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.933+0000 7f5957e38640 1 --2- 172.21.15.38:0/2065429216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59500cc670 0x7f59500b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:21.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.933+0000 7f5957e38640 1 --2- 172.21.15.38:0/2065429216 >> v2:172.21.15.89:3300/0 conn(0x7f5950144d10 0x7f59500cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:21.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.933+0000 7f5957e38640 1 -- 172.21.15.38:0/2065429216 >> 172.21.15.38:0/2065429216 conn(0x7f59500cf070 msgr2=0x7f59500cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:21.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.933+0000 7f5957e38640 1 -- 172.21.15.38:0/2065429216 shutdown_connections 2023-12-22T08:42:21.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.933+0000 7f5957e38640 1 -- 172.21.15.38:0/2065429216 wait complete. 2023-12-22T08:42:21.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.934+0000 7f5957e38640 1 Processor -- start 2023-12-22T08:42:21.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.935+0000 7f5957e38640 1 -- start start 2023-12-22T08:42:21.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.935+0000 7f5957e38640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59500b2590 0x7f595013ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:21.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.935+0000 7f5957e38640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5950144d10 0x7f59500afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:21.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.935+0000 7f5957e38640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f595013d2b0 0x7f59501f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:21.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.936+0000 7f5957e38640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5950157bf0 con 0x7f5950144d10 2023-12-22T08:42:21.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.936+0000 7f5957e38640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595013d850 con 0x7f595013d2b0 2023-12-22T08:42:21.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.936+0000 7f5957e38640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595013db30 con 0x7f59500b2590 2023-12-22T08:42:21.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.936+0000 7f59553d3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5950144d10 0x7f59500afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:21.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.936+0000 7f59553d3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5950144d10 0x7f59500afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39148/0 (socket says 172.21.15.38:39148) 2023-12-22T08:42:21.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.936+0000 7f59553d3640 1 -- 172.21.15.38:0/3539569241 learned_addr learned my addr 172.21.15.38:0/3539569241 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:21.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.936+0000 7f59553d3640 1 -- 172.21.15.38:0/3539569241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59500b2590 msgr2=0x7f595013ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:21.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.936+0000 7f59553d3640 1 --2- 172.21.15.38:0/3539569241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59500b2590 0x7f595013ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:21.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.936+0000 7f59553d3640 1 -- 172.21.15.38:0/3539569241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f595013d2b0 msgr2=0x7f59501f3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:21.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.936+0000 7f59553d3640 1 --2- 172.21.15.38:0/3539569241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f595013d2b0 0x7f59501f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:21.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.936+0000 7f59553d3640 1 -- 172.21.15.38:0/3539569241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59480094d0 con 0x7f5950144d10 2023-12-22T08:42:21.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.937+0000 7f59553d3640 1 --2- 172.21.15.38:0/3539569241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5950144d10 0x7f59500afde0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f594000d7d0 tx=0x7f594000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:21.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.937+0000 7f59467fc640 1 -- 172.21.15.38:0/3539569241 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59400096a0 con 0x7f5950144d10 2023-12-22T08:42:21.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.937+0000 7f59467fc640 1 -- 172.21.15.38:0/3539569241 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5940009800 con 0x7f5950144d10 2023-12-22T08:42:21.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.937+0000 7f59467fc640 1 -- 172.21.15.38:0/3539569241 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940009b90 con 0x7f5950144d10 2023-12-22T08:42:21.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.937+0000 7f5957e38640 1 -- 172.21.15.38:0/3539569241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595013de10 con 0x7f5950144d10 2023-12-22T08:42:21.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.937+0000 7f5957e38640 1 -- 172.21.15.38:0/3539569241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595013e3d0 con 0x7f5950144d10 2023-12-22T08:42:21.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.938+0000 7f5957e38640 1 -- 172.21.15.38:0/3539569241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595013e590 con 0x7f5950144d10 2023-12-22T08:42:21.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.939+0000 7f59467fc640 1 -- 172.21.15.38:0/3539569241 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5940009cf0 con 0x7f5950144d10 2023-12-22T08:42:21.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.940+0000 7f59467fc640 1 --2- 172.21.15.38:0/3539569241 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f593406a430 0x7f593406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:21.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.940+0000 7f59467fc640 1 -- 172.21.15.38:0/3539569241 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5940088f70 con 0x7f5950144d10 2023-12-22T08:42:21.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.941+0000 7f59467fc640 1 -- 172.21.15.38:0/3539569241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=53}) v3 -- 0x7f5934071f60 con 0x7f5950144d10 2023-12-22T08:42:21.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.941+0000 7f5955bd4640 1 --2- 172.21.15.38:0/3539569241 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f593406a430 0x7f593406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:21.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.942+0000 7f5955bd4640 1 --2- 172.21.15.38:0/3539569241 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f593406a430 0x7f593406c8f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f594c008e00 tx=0x7f594c008330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:21.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:21.945+0000 7f59467fc640 1 -- 172.21.15.38:0/3539569241 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5940054430 con 0x7f5950144d10 2023-12-22T08:42:22.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.143+0000 7f5957e38640 1 -- 172.21.15.38:0/3539569241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5950061910 con 0x7f5950144d10 2023-12-22T08:42:22.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.147+0000 7f59467fc640 1 -- 172.21.15.38:0/3539569241 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) v1 ==== 81+0+33643 (secure 0 0 0) 0x7f5940057a50 con 0x7f5950144d10 2023-12-22T08:42:22.150 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:22.150 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:42:22.150 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 52, 2023-12-22T08:42:22.150 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:42:22.150 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:42:22.150 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:42:21.220769+0000", 2023-12-22T08:42:22.150 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:42:22.150 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:42:22.150 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:42:22.150 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:42:22.150 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:42:22.150 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 7, 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:42:22.151 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:22.152 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:22.153 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:22.153 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:22.153 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:22.153 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:42:22.153 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:42:22.153 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:42:22.153 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:42:22.153 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:42:22.153 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "49", 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:22.155 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:22.156 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:42:22.157 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 6, 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:58.840533+0000", 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:22.158 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:22.159 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "49", 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:22.160 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:22.161 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:22.161 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:22.161 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:22.161 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:22.161 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:22.161 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:22.161 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:22.161 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:22.161 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:22.161 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:22.161 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:22.161 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:22.161 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:22.162 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:42:22.163 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 7, 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:59.953505+0000", 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:22.164 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:42:22.165 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "49", 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:22.166 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:22.167 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:22.168 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.75, 2023-12-22T08:42:22.169 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.75, 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.75, 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.75, 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:22.170 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:42:22.171 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:22.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:22.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.174 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:22.175 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:22.176 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:22.177 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.178 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.179 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.179 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:42:22.179 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:22.179 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.179 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.179 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.179 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:42:22.179 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:22.179 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.179 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.179 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.179 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.180 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:22.181 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.182 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.183 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.184 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.185 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:22.186 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:22.187 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:22.188 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:22.190 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:42:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:42:22.192 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:42:22.192 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:22.192 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:42:22.192 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:22.192 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:22.192 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.192 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.192 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.192 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:22.192 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:22.192 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:22.192 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:22.193 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.194 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.196 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:22.197 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:22.198 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.199 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:22.200 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.200 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.200 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.200 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:42:22.200 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:22.200 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.200 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.200 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.200 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:42:22.200 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:22.200 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.200 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.200 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.201 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:22.202 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.202 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.202 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.202 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:42:22.202 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:22.202 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.202 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.202 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.202 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:42:22.202 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:22.202 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.202 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.202 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:22.203 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:42:22.204 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:22.205 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.205 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.205 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.205 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:42:22.205 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:22.205 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.205 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.205 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.205 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:22.206 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.206 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.206 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.206 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:42:22.206 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:22.206 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.206 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.206 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.206 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:42:22.206 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:22.206 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.206 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:42:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:42:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:22.212 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:22.213 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:22.214 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.215 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:22.216 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:22.217 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:22.217 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:42:22.217 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:22.217 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.217 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.217 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:22.217 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:22.217 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:22.217 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:22.217 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:22.217 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:22.217 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:42:22.217 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:22.218 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:42:22.219 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:22.220 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.220 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:22.220 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:22.220 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:22.220 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:22.220 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:22.220 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:22.220 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:22.220 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:42:22.220 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:22.220 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.220 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:22.220 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.221 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:22.222 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:42:22.222 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:42:22.222 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:42:22.222 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:42:22.222 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:42:22.222 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:42:22.222 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:42:22.222 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:42:22.222 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:42:22.222 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:42:22.222 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:42:22.222 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:22.222 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:42:22.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.149+0000 7f5957e38640 1 -- 172.21.15.38:0/3539569241 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f593406a430 msgr2=0x7f593406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:22.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.149+0000 7f5957e38640 1 --2- 172.21.15.38:0/3539569241 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f593406a430 0x7f593406c8f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f594c008e00 tx=0x7f594c008330 comp rx=0 tx=0).stop 2023-12-22T08:42:22.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.150+0000 7f5957e38640 1 -- 172.21.15.38:0/3539569241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5950144d10 msgr2=0x7f59500afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:22.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.150+0000 7f5957e38640 1 --2- 172.21.15.38:0/3539569241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5950144d10 0x7f59500afde0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f594000d7d0 tx=0x7f594000dc90 comp rx=0 tx=0).stop 2023-12-22T08:42:22.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.150+0000 7f5957e38640 1 -- 172.21.15.38:0/3539569241 shutdown_connections 2023-12-22T08:42:22.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.150+0000 7f5957e38640 1 --2- 172.21.15.38:0/3539569241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f595013d2b0 0x7f59501f3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:22.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.150+0000 7f5957e38640 1 --2- 172.21.15.38:0/3539569241 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f593406a430 0x7f593406c8f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:22.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.150+0000 7f5957e38640 1 --2- 172.21.15.38:0/3539569241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5950144d10 0x7f59500afde0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:22.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.150+0000 7f5957e38640 1 --2- 172.21.15.38:0/3539569241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59500b2590 0x7f595013ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:22.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.150+0000 7f5957e38640 1 -- 172.21.15.38:0/3539569241 >> 172.21.15.38:0/3539569241 conn(0x7f59500cf070 msgr2=0x7f59500cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:22.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.150+0000 7f5957e38640 1 -- 172.21.15.38:0/3539569241 shutdown_connections 2023-12-22T08:42:22.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.150+0000 7f5957e38640 1 -- 172.21.15.38:0/3539569241 wait complete. 2023-12-22T08:42:22.225 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-22T08:42:22.225 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:42:22.226 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:22.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:22.285 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-12-22T08:42:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-12-22T08:42:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records in 2023-12-22T08:42:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records out 2023-12-22T08:42:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.351632 s, 149 MB/s 2023-12-22T08:42:22.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:42:22.714 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:42:22.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.925+0000 7fc33d177640 1 Processor -- start 2023-12-22T08:42:22.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.926+0000 7fc33d177640 1 -- start start 2023-12-22T08:42:22.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.927+0000 7fc33d177640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc3380b3f90 0x7fc33815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:22.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.927+0000 7fc33d177640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc33806ca50 0x7fc338070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:22.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.927+0000 7fc33d177640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33815eb20 con 0x7fc33815e740 2023-12-22T08:42:22.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.927+0000 7fc33d177640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33806e650 con 0x7fc33806ca50 2023-12-22T08:42:22.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.927+0000 7fc33d177640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc338070770 con 0x7fc3380b3f90 2023-12-22T08:42:22.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.928+0000 7fc336d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc33815e740 0x7fc3380b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57294/0 (socket says 172.21.15.38:57294) 2023-12-22T08:42:22.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.928+0000 7fc336d9d640 1 -- 172.21.15.38:0/2551046896 learned_addr learned my addr 172.21.15.38:0/2551046896 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:22.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.928+0000 7fc33759e640 1 --2- 172.21.15.38:0/2551046896 >> v2:172.21.15.38:3300/0 conn(0x7fc33806ca50 0x7fc338070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:22.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.928+0000 7fc32ffff640 1 --2- 172.21.15.38:0/2551046896 >> v2:172.21.15.89:3300/0 conn(0x7fc3380b3f90 0x7fc33815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:22.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.928+0000 7fc33659c640 1 -- 172.21.15.38:0/2551046896 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987414442 0 0) 0x7fc33815eb20 con 0x7fc33815e740 2023-12-22T08:42:22.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.928+0000 7fc33759e640 1 -- 172.21.15.38:0/2551046896 >> v2:172.21.15.89:3300/0 conn(0x7fc3380b3f90 msgr2=0x7fc33815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:22.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.928+0000 7fc33759e640 1 --2- 172.21.15.38:0/2551046896 >> v2:172.21.15.89:3300/0 conn(0x7fc3380b3f90 0x7fc33815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:22.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.928+0000 7fc33759e640 1 -- 172.21.15.38:0/2551046896 >> v1:172.21.15.38:6789/0 conn(0x7fc33815e740 legacy=0x7fc3380b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:22.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.928+0000 7fc33759e640 1 -- 172.21.15.38:0/2551046896 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33806d180 con 0x7fc33806ca50 2023-12-22T08:42:22.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.928+0000 7fc32ffff640 1 --2- 172.21.15.38:0/2551046896 >> v2:172.21.15.89:3300/0 conn(0x7fc3380b3f90 0x7fc33815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:22.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.929+0000 7fc33759e640 1 --2- 172.21.15.38:0/2551046896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33806ca50 0x7fc338070c00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc3380d32d0 tx=0x7fc33002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1876cf02de46ba9d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:22.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.930+0000 7fc33659c640 1 -- 172.21.15.38:0/2551046896 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33002cb60 con 0x7fc33806ca50 2023-12-22T08:42:22.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.930+0000 7fc33659c640 1 -- 172.21.15.38:0/2551046896 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33002ccc0 con 0x7fc33806ca50 2023-12-22T08:42:22.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.930+0000 7fc33659c640 1 -- 172.21.15.38:0/2551046896 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc330034660 con 0x7fc33806ca50 2023-12-22T08:42:22.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.930+0000 7fc33d177640 1 -- 172.21.15.38:0/2551046896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33806ca50 msgr2=0x7fc338070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:22.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.930+0000 7fc33d177640 1 --2- 172.21.15.38:0/2551046896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33806ca50 0x7fc338070c00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc3380d32d0 tx=0x7fc33002bdb0 comp rx=0 tx=0).stop 2023-12-22T08:42:22.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.930+0000 7fc33d177640 1 -- 172.21.15.38:0/2551046896 shutdown_connections 2023-12-22T08:42:22.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.931+0000 7fc33d177640 1 --2- 172.21.15.38:0/2551046896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33806ca50 0x7fc338070c00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:22.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.931+0000 7fc33d177640 1 --2- 172.21.15.38:0/2551046896 >> v2:172.21.15.89:3300/0 conn(0x7fc3380b3f90 0x7fc33815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:22.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.931+0000 7fc33d177640 1 -- 172.21.15.38:0/2551046896 >> 172.21.15.38:0/2551046896 conn(0x7fc3380cfea0 msgr2=0x7fc3380d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:22.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.931+0000 7fc33d177640 1 -- 172.21.15.38:0/2551046896 shutdown_connections 2023-12-22T08:42:22.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.931+0000 7fc33d177640 1 -- 172.21.15.38:0/2551046896 wait complete. 2023-12-22T08:42:22.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.932+0000 7fc33d177640 1 Processor -- start 2023-12-22T08:42:22.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.933+0000 7fc33d177640 1 -- start start 2023-12-22T08:42:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.934+0000 7fc33d177640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc33806ca50 0x7fc338156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.934+0000 7fc33d177640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3380b3f90 0x7fc33815a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.934+0000 7fc33d177640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33815e740 0x7fc338160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.934+0000 7fc33d177640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3381565a0 con 0x7fc33815e740 2023-12-22T08:42:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.934+0000 7fc33d177640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380b67b0 con 0x7fc3380b3f90 2023-12-22T08:42:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.934+0000 7fc33d177640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380b5ba0 con 0x7fc33806ca50 2023-12-22T08:42:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.934+0000 7fc33759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33815e740 0x7fc338160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.934+0000 7fc33759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33815e740 0x7fc338160f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39160/0 (socket says 172.21.15.38:39160) 2023-12-22T08:42:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.934+0000 7fc33759e640 1 -- 172.21.15.38:0/3644353349 learned_addr learned my addr 172.21.15.38:0/3644353349 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.934+0000 7fc336d9d640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc33806ca50 0x7fc338156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.934+0000 7fc32ffff640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3380b3f90 0x7fc33815a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.935+0000 7fc33759e640 1 -- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc33806ca50 msgr2=0x7fc338156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:22.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.935+0000 7fc33759e640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc33806ca50 0x7fc338156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.935+0000 7fc33759e640 1 -- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3380b3f90 msgr2=0x7fc33815a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.935+0000 7fc33759e640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3380b3f90 0x7fc33815a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.935+0000 7fc33759e640 1 -- 172.21.15.38:0/3644353349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc330009a70 con 0x7fc33815e740 2023-12-22T08:42:22.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.935+0000 7fc33759e640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33815e740 0x7fc338160f20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc33002c3c0 tx=0x7fc330004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:22.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.935+0000 7fc32f7fe640 1 -- 172.21.15.38:0/3644353349 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33003e610 con 0x7fc33815e740 2023-12-22T08:42:22.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.935+0000 7fc32f7fe640 1 -- 172.21.15.38:0/3644353349 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33003e770 con 0x7fc33815e740 2023-12-22T08:42:22.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.935+0000 7fc32f7fe640 1 -- 172.21.15.38:0/3644353349 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33003eb20 con 0x7fc33815e740 2023-12-22T08:42:22.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.935+0000 7fc33d177640 1 -- 172.21.15.38:0/3644353349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3380b5e80 con 0x7fc33815e740 2023-12-22T08:42:22.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.936+0000 7fc33d177640 1 -- 172.21.15.38:0/3644353349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3380b6440 con 0x7fc33815e740 2023-12-22T08:42:22.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.937+0000 7fc33d177640 1 -- 172.21.15.38:0/3644353349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc338061910 con 0x7fc33815e740 2023-12-22T08:42:22.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.938+0000 7fc32f7fe640 1 -- 172.21.15.38:0/3644353349 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc33003b050 con 0x7fc33815e740 2023-12-22T08:42:22.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.939+0000 7fc32f7fe640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc31806a430 0x7fc31806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:22.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.939+0000 7fc32f7fe640 1 -- 172.21.15.38:0/3644353349 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3300ab100 con 0x7fc33815e740 2023-12-22T08:42:22.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.939+0000 7fc32f7fe640 1 -- 172.21.15.38:0/3644353349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=53}) v3 -- 0x7fc318071f60 con 0x7fc33815e740 2023-12-22T08:42:22.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.939+0000 7fc336d9d640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc31806a430 0x7fc31806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:22.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.940+0000 7fc336d9d640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc31806a430 0x7fc31806c8f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc328000f60 tx=0x7fc328007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:22.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:22.943+0000 7fc32f7fe640 1 -- 172.21.15.38:0/3644353349 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc3300766e0 con 0x7fc33815e740 2023-12-22T08:42:23.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.140+0000 7fc33d177640 1 -- 172.21.15.38:0/3644353349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc3380b6600 con 0x7fc33815e740 2023-12-22T08:42:23.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.142+0000 7fc32f7fe640 1 -- 172.21.15.38:0/3644353349 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) v1 ==== 81+0+33643 (secure 0 0 0) 0x7fc330039090 con 0x7fc33815e740 2023-12-22T08:42:23.145 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:23.145 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:42:23.145 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 52, 2023-12-22T08:42:23.145 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:42:23.145 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:42:23.145 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:42:21.220769+0000", 2023-12-22T08:42:23.145 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:42:23.145 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 7, 2023-12-22T08:42:23.146 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:23.147 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:23.148 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "49", 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:23.149 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:23.150 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:42:23.151 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.152 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 6, 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:58.840533+0000", 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:23.153 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "49", 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:23.154 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:23.155 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:23.156 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.157 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 7, 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:59.953505+0000", 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:42:23.158 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:42:23.159 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "49", 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:23.160 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:23.161 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:23.162 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.75, 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.75, 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.75, 2023-12-22T08:42:23.163 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.75, 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:23.164 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:42:23.165 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.166 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.167 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:23.168 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.168 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.168 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.168 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:42:23.168 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:23.168 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.168 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.168 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.169 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:42:23.169 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:23.169 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.169 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.169 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.169 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:42:23.169 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:42:23.169 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:42:23.169 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:42:23.169 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:23.169 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:23.170 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.171 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.172 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:23.173 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:42:23.174 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:23.175 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.176 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:23.178 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.179 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.179 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.179 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:23.179 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.179 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.179 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.179 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:42:23.179 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:23.179 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.179 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.179 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.179 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:42:23.179 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:23.180 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.180 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.180 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.180 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:42:23.180 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:42:23.180 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:42:23.180 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:42:23.180 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:23.180 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:23.181 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:42:23.181 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:23.181 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.181 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.181 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.182 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.183 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:42:23.184 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:23.185 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:23.186 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:23.187 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.188 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:23.189 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:42:23.191 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:23.192 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:42:23.193 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:23.194 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.195 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.196 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:23.197 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.198 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.199 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:23.200 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.201 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:23.202 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:23.203 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.204 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.205 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:42:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:23.207 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:23.208 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.209 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:23.210 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:23.211 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:23.212 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:42:23.213 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:42:23.214 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:23.215 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:42:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.145+0000 7fc33d177640 1 -- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc31806a430 msgr2=0x7fc31806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.145+0000 7fc33d177640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc31806a430 0x7fc31806c8f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc328000f60 tx=0x7fc328007c00 comp rx=0 tx=0).stop 2023-12-22T08:42:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.145+0000 7fc33d177640 1 -- 172.21.15.38:0/3644353349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33815e740 msgr2=0x7fc338160f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.145+0000 7fc33d177640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33815e740 0x7fc338160f20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc33002c3c0 tx=0x7fc330004a40 comp rx=0 tx=0).stop 2023-12-22T08:42:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.145+0000 7fc33d177640 1 -- 172.21.15.38:0/3644353349 shutdown_connections 2023-12-22T08:42:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.145+0000 7fc33d177640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc31806a430 0x7fc31806c8f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.145+0000 7fc33d177640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33815e740 0x7fc338160f20 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.145+0000 7fc33d177640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3380b3f90 0x7fc33815a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.145+0000 7fc33d177640 1 --2- 172.21.15.38:0/3644353349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc33806ca50 0x7fc338156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.145+0000 7fc33d177640 1 -- 172.21.15.38:0/3644353349 >> 172.21.15.38:0/3644353349 conn(0x7fc3380cfea0 msgr2=0x7fc3380b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:23.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.145+0000 7fc33d177640 1 -- 172.21.15.38:0/3644353349 shutdown_connections 2023-12-22T08:42:23.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.145+0000 7fc33d177640 1 -- 172.21.15.38:0/3644353349 wait complete. 2023-12-22T08:42:23.217 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:42:23.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.450+0000 7f99d3333640 1 Processor -- start 2023-12-22T08:42:23.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.450+0000 7f99d3333640 1 -- start start 2023-12-22T08:42:23.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.452+0000 7f99d3333640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99cc157980 0x7f99cc15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:23.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.452+0000 7f99d3333640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99cc0b3ff0 0x7f99cc06cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:23.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.452+0000 7f99d3333640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc0d1520 con 0x7f99cc0b4470 2023-12-22T08:42:23.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.452+0000 7f99d3333640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99cc0d1800 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.452+0000 7f99d3333640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0d1ae0 con 0x7f99cc157980 2023-12-22T08:42:23.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.452+0000 7f99d1b30640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99cc0b3ff0 0x7f99cc06cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:23.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.452+0000 7f99d1b30640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f99cc0b3ff0 0x7f99cc06cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39164/0 (socket says 172.21.15.38:39164) 2023-12-22T08:42:23.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.452+0000 7f99d1b30640 1 -- 172.21.15.38:0/3562644222 learned_addr learned my addr 172.21.15.38:0/3562644222 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:23.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.452+0000 7f99d2331640 1 --2- 172.21.15.38:0/3562644222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99cc157980 0x7f99cc15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:23.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.453+0000 7f99d1b30640 1 -- 172.21.15.38:0/3562644222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99cc157980 msgr2=0x7f99cc15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:23.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.453+0000 7f99d1b30640 1 --2- 172.21.15.38:0/3562644222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99cc157980 0x7f99cc15eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.453+0000 7f99d1b30640 1 -- 172.21.15.38:0/3562644222 >> v1:172.21.15.89:6789/0 conn(0x7f99cc0b4470 legacy=0x7f99cc0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:23.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.453+0000 7f99d1b30640 1 -- 172.21.15.38:0/3562644222 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc0d1dc0 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.454+0000 7f99d1b30640 1 --2- 172.21.15.38:0/3562644222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99cc0b3ff0 0x7f99cc06cf30 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009870 tx=0x7f99bc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cd27a47e96fa0a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:23.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.454+0000 7f99d132f640 1 -- 172.21.15.38:0/3562644222 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc030840 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.454+0000 7f99d132f640 1 -- 172.21.15.38:0/3562644222 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc0309a0 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.454+0000 7f99d132f640 1 -- 172.21.15.38:0/3562644222 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc030d30 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.455+0000 7f99d3333640 1 -- 172.21.15.38:0/3562644222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99cc0b3ff0 msgr2=0x7f99cc06cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:23.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.455+0000 7f99d3333640 1 --2- 172.21.15.38:0/3562644222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99cc0b3ff0 0x7f99cc06cf30 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009870 tx=0x7f99bc02b980 comp rx=0 tx=0).stop 2023-12-22T08:42:23.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.455+0000 7f99d3333640 1 -- 172.21.15.38:0/3562644222 shutdown_connections 2023-12-22T08:42:23.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.455+0000 7f99d3333640 1 --2- 172.21.15.38:0/3562644222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99cc0b3ff0 0x7f99cc06cf30 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.455+0000 7f99d3333640 1 --2- 172.21.15.38:0/3562644222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99cc157980 0x7f99cc15eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.455+0000 7f99d3333640 1 -- 172.21.15.38:0/3562644222 >> 172.21.15.38:0/3562644222 conn(0x7f99cc0d31f0 msgr2=0x7f99cc0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:23.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.455+0000 7f99d3333640 1 -- 172.21.15.38:0/3562644222 shutdown_connections 2023-12-22T08:42:23.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.455+0000 7f99d3333640 1 -- 172.21.15.38:0/3562644222 wait complete. 2023-12-22T08:42:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.457+0000 7f99d3333640 1 Processor -- start 2023-12-22T08:42:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.457+0000 7f99d3333640 1 -- start start 2023-12-22T08:42:23.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.458+0000 7f99d3333640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99cc0b3ff0 0x7f99cc15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.458+0000 7f99d3333640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99cc0b4470 0x7f99cc14f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.458+0000 7f99d3333640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99cc157980 0x7f99cc14f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.458+0000 7f99d3333640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc14fdf0 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.458+0000 7f99d3333640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc1500d0 con 0x7f99cc0b4470 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.458+0000 7f99d3333640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc1503b0 con 0x7f99cc157980 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.458+0000 7f99d2331640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99cc0b3ff0 0x7f99cc15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.458+0000 7f99d2331640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99cc0b3ff0 0x7f99cc15ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39180/0 (socket says 172.21.15.38:39180) 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.458+0000 7f99d2331640 1 -- 172.21.15.38:0/4217158642 learned_addr learned my addr 172.21.15.38:0/4217158642 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.458+0000 7f99d2331640 1 -- 172.21.15.38:0/4217158642 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99cc157980 msgr2=0x7f99cc14f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.459+0000 7f99d2331640 1 --2- 172.21.15.38:0/4217158642 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99cc157980 0x7f99cc14f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.459+0000 7f99d2331640 1 -- 172.21.15.38:0/4217158642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99cc0b4470 msgr2=0x7f99cc14f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.459+0000 7f99d2331640 1 --2- 172.21.15.38:0/4217158642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99cc0b4470 0x7f99cc14f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.459+0000 7f99d2331640 1 -- 172.21.15.38:0/4217158642 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0094d0 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.459+0000 7f99d2331640 1 --2- 172.21.15.38:0/4217158642 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99cc0b3ff0 0x7f99cc15ed20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f99c800d5f0 tx=0x7f99c800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.459+0000 7f99c2ffd640 1 -- 172.21.15.38:0/4217158642 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c80125f0 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.459+0000 7f99c2ffd640 1 -- 172.21.15.38:0/4217158642 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c8012750 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.459+0000 7f99c2ffd640 1 -- 172.21.15.38:0/4217158642 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8012b00 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.459+0000 7f99d3333640 1 -- 172.21.15.38:0/4217158642 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc150690 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.459+0000 7f99d3333640 1 -- 172.21.15.38:0/4217158642 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc15f260 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.461+0000 7f99d3333640 1 -- 172.21.15.38:0/4217158642 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc15f450 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.461+0000 7f99c2ffd640 1 -- 172.21.15.38:0/4217158642 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f99c8012c60 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.462+0000 7f99c2ffd640 1 --2- 172.21.15.38:0/4217158642 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f99b006a430 0x7f99b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.462+0000 7f99c2ffd640 1 -- 172.21.15.38:0/4217158642 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99c8088df0 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.463+0000 7f99c2ffd640 1 -- 172.21.15.38:0/4217158642 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=53}) v3 -- 0x7f99b0071f60 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.463+0000 7f99d1b30640 1 --2- 172.21.15.38:0/4217158642 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f99b006a430 0x7f99b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:23.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.464+0000 7f99d1b30640 1 --2- 172.21.15.38:0/4217158642 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f99b006a430 0x7f99b006c8f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f99bc036000 tx=0x7f99bc03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:23.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.467+0000 7f99c2ffd640 1 -- 172.21.15.38:0/4217158642 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f99c80543d0 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.694+0000 7f99d3333640 1 -- 172.21.15.38:0/4217158642 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99cc061910 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.695+0000 7f99c2ffd640 1 -- 172.21.15.38:0/4217158642 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f99c80579f0 con 0x7f99cc0b3ff0 2023-12-22T08:42:23.698 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:23.698 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2078860804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2078860804},{"type":"v1","addr":"172.21.15.38:6835","nonce":2078860804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4244510882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4244510882},{"type":"v1","addr":"172.21.15.89:6837","nonce":4244510882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3227878158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3227878158},{"type":"v1","addr":"172.21.15.38:6834","nonce":3227878158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:42:00.933947+0000","modified":"2023-12-22T08:42:03.951929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5538":{"gid":5538,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2131151279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2131151279},{"type":"v1","addr":"172.21.15.89:6836","nonce":2131151279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T08:42:23.698 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2023-12-22T08:42:23.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.697+0000 7f99d3333640 1 -- 172.21.15.38:0/4217158642 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f99b006a430 msgr2=0x7f99b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:23.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.697+0000 7f99d3333640 1 --2- 172.21.15.38:0/4217158642 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f99b006a430 0x7f99b006c8f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f99bc036000 tx=0x7f99bc03b040 comp rx=0 tx=0).stop 2023-12-22T08:42:23.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.698+0000 7f99d3333640 1 -- 172.21.15.38:0/4217158642 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99cc0b3ff0 msgr2=0x7f99cc15ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:23.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.698+0000 7f99d3333640 1 --2- 172.21.15.38:0/4217158642 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99cc0b3ff0 0x7f99cc15ed20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f99c800d5f0 tx=0x7f99c800dab0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.698+0000 7f99d3333640 1 -- 172.21.15.38:0/4217158642 shutdown_connections 2023-12-22T08:42:23.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.698+0000 7f99d3333640 1 --2- 172.21.15.38:0/4217158642 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99cc157980 0x7f99cc14f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.698+0000 7f99d3333640 1 --2- 172.21.15.38:0/4217158642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99cc0b4470 0x7f99cc14f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.698+0000 7f99d3333640 1 --2- 172.21.15.38:0/4217158642 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f99b006a430 0x7f99b006c8f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.698+0000 7f99d3333640 1 --2- 172.21.15.38:0/4217158642 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99cc0b3ff0 0x7f99cc15ed20 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:23.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.698+0000 7f99d3333640 1 -- 172.21.15.38:0/4217158642 >> 172.21.15.38:0/4217158642 conn(0x7f99cc0d31f0 msgr2=0x7f99cc06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:23.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.698+0000 7f99d3333640 1 -- 172.21.15.38:0/4217158642 shutdown_connections 2023-12-22T08:42:23.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:23.698+0000 7f99d3333640 1 -- 172.21.15.38:0/4217158642 wait complete. 2023-12-22T08:42:23.720 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-22T08:42:23.962 INFO:teuthology.orchestra.run.smithi089.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":5538,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":23.005296503,"mdsmap_epoch":23,"osdmap_epoch":52,"osdmap_epoch_barrier":52,"uptime":28.597038297000001} 2023-12-22T08:42:23.963 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 5538, "mdsmap_epoch": 23, "osdmap_epoch": 52, "osdmap_epoch_barrier": 52, "rank_uptime": 23.005296503, "state": "up:active", "uptime": 28.597038297, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:42:23.963 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-22T08:42:23.963 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:42:23.963 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:24.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:24.025 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-12-22T08:42:24.082 INFO:teuthology.orchestra.run.smithi038.stderr:dd: failed to open 'small_file_1': Permission denied 2023-12-22T08:42:24.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:42:24.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:24.084 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-22T08:42:24.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:24.152 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-22T08:42:24.283 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:42:24.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.507+0000 7fefe6fab640 1 Processor -- start 2023-12-22T08:42:24.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.507+0000 7fefe6fab640 1 -- start start 2023-12-22T08:42:24.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.509+0000 7fefe6fab640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fefe015d470 0x7fefe00b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.509+0000 7fefe6fab640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe00ac8e0 con 0x7fefe015d850 2023-12-22T08:42:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.509+0000 7fefe6fab640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe00b4550 con 0x7fefe0071ea0 2023-12-22T08:42:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.509+0000 7fefe6fab640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe00ada40 con 0x7fefe015d470 2023-12-22T08:42:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.509+0000 7fefe4d47640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fefe015d470 0x7fefe00b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.509+0000 7fefdffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fefe015d850 0x7fefe00ad330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57306/0 (socket says 172.21.15.38:57306) 2023-12-22T08:42:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.509+0000 7fefdffff640 1 -- 172.21.15.38:0/1235093609 learned_addr learned my addr 172.21.15.38:0/1235093609 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.510+0000 7fefe4d47640 1 -- 172.21.15.38:0/1235093609 >> v1:172.21.15.89:6789/0 conn(0x7fefe0071ea0 legacy=0x7fefe00b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.510+0000 7fefe4d47640 1 -- 172.21.15.38:0/1235093609 >> v1:172.21.15.38:6789/0 conn(0x7fefe015d850 legacy=0x7fefe00ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.510+0000 7fefdf7fe640 1 -- 172.21.15.38:0/1235093609 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339214099 0 0) 0x7fefe00ac8e0 con 0x7fefe015d850 2023-12-22T08:42:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.510+0000 7fefe4d47640 1 -- 172.21.15.38:0/1235093609 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe00b4940 con 0x7fefe015d470 2023-12-22T08:42:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.511+0000 7fefe4d47640 1 --2- 172.21.15.38:0/1235093609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefe015d470 0x7fefe00b4010 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fefd40097a0 tx=0x7fefd402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=affe458efd1b0a0d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.511+0000 7fefdf7fe640 1 -- 172.21.15.38:0/1235093609 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4030610 con 0x7fefe015d470 2023-12-22T08:42:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.512+0000 7fefdf7fe640 1 -- 172.21.15.38:0/1235093609 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd4030770 con 0x7fefe015d470 2023-12-22T08:42:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.512+0000 7fefdf7fe640 1 -- 172.21.15.38:0/1235093609 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4030b00 con 0x7fefe015d470 2023-12-22T08:42:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.512+0000 7fefe6fab640 1 -- 172.21.15.38:0/1235093609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefe015d470 msgr2=0x7fefe00b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.512+0000 7fefe6fab640 1 --2- 172.21.15.38:0/1235093609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefe015d470 0x7fefe00b4010 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fefd40097a0 tx=0x7fefd402b960 comp rx=0 tx=0).stop 2023-12-22T08:42:24.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.512+0000 7fefe6fab640 1 -- 172.21.15.38:0/1235093609 shutdown_connections 2023-12-22T08:42:24.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.512+0000 7fefe6fab640 1 --2- 172.21.15.38:0/1235093609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefe015d470 0x7fefe00b4010 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:24.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.512+0000 7fefe6fab640 1 -- 172.21.15.38:0/1235093609 >> 172.21.15.38:0/1235093609 conn(0x7fefe00cf070 msgr2=0x7fefe00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:24.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.512+0000 7fefe6fab640 1 -- 172.21.15.38:0/1235093609 shutdown_connections 2023-12-22T08:42:24.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.512+0000 7fefe6fab640 1 -- 172.21.15.38:0/1235093609 wait complete. 2023-12-22T08:42:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.514+0000 7fefe6fab640 1 Processor -- start 2023-12-22T08:42:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.514+0000 7fefe6fab640 1 -- start start 2023-12-22T08:42:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.515+0000 7fefe6fab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefe0071ea0 0x7fefe0155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.515+0000 7fefe6fab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefe015d470 0x7fefe0159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.515+0000 7fefe6fab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefe015d850 0x7fefe006cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.515+0000 7fefe6fab640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe01f68c0 con 0x7fefe015d470 2023-12-22T08:42:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.515+0000 7fefe6fab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe015a7a0 con 0x7fefe015d850 2023-12-22T08:42:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.515+0000 7fefe6fab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe015a4c0 con 0x7fefe0071ea0 2023-12-22T08:42:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.515+0000 7fefdffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefe015d470 0x7fefe0159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.516+0000 7fefdffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefe015d470 0x7fefe0159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39200/0 (socket says 172.21.15.38:39200) 2023-12-22T08:42:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.516+0000 7fefdffff640 1 -- 172.21.15.38:0/3990584568 learned_addr learned my addr 172.21.15.38:0/3990584568 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.516+0000 7fefe5548640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefe015d850 0x7fefe006cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.516+0000 7fefe4d47640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefe0071ea0 0x7fefe0155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.516+0000 7fefdffff640 1 -- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefe0071ea0 msgr2=0x7fefe0155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.516+0000 7fefdffff640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefe0071ea0 0x7fefe0155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.516+0000 7fefdffff640 1 -- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefe015d850 msgr2=0x7fefe006cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.516+0000 7fefdffff640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefe015d850 0x7fefe006cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.516+0000 7fefdffff640 1 -- 172.21.15.38:0/3990584568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd4009400 con 0x7fefe015d470 2023-12-22T08:42:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.516+0000 7fefdffff640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefe015d470 0x7fefe0159a00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00c3f0 tx=0x7fefcc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.517+0000 7fefdd7fa640 1 -- 172.21.15.38:0/3990584568 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0074e0 con 0x7fefe015d470 2023-12-22T08:42:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.517+0000 7fefdd7fa640 1 -- 172.21.15.38:0/3990584568 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc007640 con 0x7fefe015d470 2023-12-22T08:42:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.517+0000 7fefdd7fa640 1 -- 172.21.15.38:0/3990584568 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc004a00 con 0x7fefe015d470 2023-12-22T08:42:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.517+0000 7fefe6fab640 1 -- 172.21.15.38:0/3990584568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe01f6200 con 0x7fefe015d470 2023-12-22T08:42:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.517+0000 7fefe6fab640 1 -- 172.21.15.38:0/3990584568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe01564d0 con 0x7fefe015d470 2023-12-22T08:42:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.518+0000 7fefe6fab640 1 -- 172.21.15.38:0/3990584568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe01f6060 con 0x7fefe015d470 2023-12-22T08:42:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.519+0000 7fefdd7fa640 1 -- 172.21.15.38:0/3990584568 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fefcc004b60 con 0x7fefe015d470 2023-12-22T08:42:24.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.520+0000 7fefdd7fa640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fefc406a430 0x7fefc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:24.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.521+0000 7fefdd7fa640 1 -- 172.21.15.38:0/3990584568 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefcc088770 con 0x7fefe015d470 2023-12-22T08:42:24.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.521+0000 7fefdd7fa640 1 -- 172.21.15.38:0/3990584568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7fefc4071f60 con 0x7fefe015d470 2023-12-22T08:42:24.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.521+0000 7fefe4d47640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fefc406a430 0x7fefc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:24.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.522+0000 7fefe4d47640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fefc406a430 0x7fefc406c8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fefd4036000 tx=0x7fefd403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:24.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.525+0000 7fefdd7fa640 1 -- 172.21.15.38:0/3990584568 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fefe01f6060 con 0x7fefe015d470 2023-12-22T08:42:24.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.719+0000 7fefe6fab640 1 -- 172.21.15.38:0/3990584568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fefe01f6060 con 0x7fefe015d470 2023-12-22T08:42:24.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.722+0000 7fefdd7fa640 1 -- 172.21.15.38:0/3990584568 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+33611 (secure 0 0 0) 0x7fefe01f6060 con 0x7fefe015d470 2023-12-22T08:42:24.724 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:24.725 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:42:24.725 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 53, 2023-12-22T08:42:24.725 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:42:24.725 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:42:24.725 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:42:24.248030+0000", 2023-12-22T08:42:24.725 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:42:24.725 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:42:24.725 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:42:24.725 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:42:24.725 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:42:24.725 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:42:24.725 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:42:24.726 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:42:24.726 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:42:24.726 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:24.726 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:42:24.726 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:42:24.726 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:42:24.726 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:42:24.726 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:42:24.726 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 7, 2023-12-22T08:42:24.726 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:42:24.727 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:42:24.727 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:42:24.727 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:42:24.727 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:42:24.727 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:42:24.727 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.727 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:42:24.727 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:42:24.727 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:42:24.727 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:42:24.727 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:42:24.727 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:24.728 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:24.728 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:24.728 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:24.728 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:24.728 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:24.728 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:24.728 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:24.728 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:24.728 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:24.728 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:42:24.728 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:42:24.728 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:42:24.728 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:42:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:42:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "49", 2023-12-22T08:42:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:42:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:42:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:42:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:42:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:42:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:42:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:42:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:42:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 6, 2023-12-22T08:42:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:42:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:58.840533+0000", 2023-12-22T08:42:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:42:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:42:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:42:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:42:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:42:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:42:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:42:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "49", 2023-12-22T08:42:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:24.740 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:24.740 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:24.740 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:24.740 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:42:24.740 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:42:24.740 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:42:24.740 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.740 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:24.740 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:24.740 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:42:24.740 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.740 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.741 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:24.741 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:42:24.741 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:42:24.741 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:24.741 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:42:24.741 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:42:24.741 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:24.741 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:24.741 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:24.741 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.741 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.741 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.742 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 7, 2023-12-22T08:42:24.742 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:42:24.742 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:59.953505+0000", 2023-12-22T08:42:24.742 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:42:24.742 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:42:24.742 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:24.742 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:24.742 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:24.742 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:24.742 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:24.742 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:24.742 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:24.742 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:24.743 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:24.743 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:24.743 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:42:24.743 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:42:24.743 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:42:24.743 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:42:24.743 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:42:24.743 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:24.744 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:24.744 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:24.744 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:24.744 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:24.744 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:24.744 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:24.744 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.744 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "49", 2023-12-22T08:42:24.744 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:24.744 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:24.745 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:24.745 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:24.745 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:24.745 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:24.745 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:24.745 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:24.745 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:24.745 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:24.745 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:24.745 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:24.745 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:24.746 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:24.746 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:24.746 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:24.746 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:24.746 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:24.746 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:24.746 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:24.746 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:24.746 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:24.746 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:24.746 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:24.746 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:24.746 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:24.747 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.747 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:24.747 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:24.747 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:24.747 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:24.747 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:24.747 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:24.747 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:24.747 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:24.747 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:24.747 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:24.747 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:24.748 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:24.748 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:42:24.748 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:42:24.748 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.748 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:24.748 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:24.748 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:42:24.748 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.748 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.748 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:24.748 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.75, 2023-12-22T08:42:24.748 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.75, 2023-12-22T08:42:24.748 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:24.749 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.75, 2023-12-22T08:42:24.749 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.75, 2023-12-22T08:42:24.749 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:24.749 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:24.749 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:24.749 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.749 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.749 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:24.749 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:42:24.749 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.749 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:24.749 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:24.750 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:24.750 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:24.750 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:24.750 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:24.750 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:24.750 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:24.750 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:24.750 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:24.750 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:24.750 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:24.750 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:24.750 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.751 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.751 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.751 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:42:24.751 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:24.751 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.751 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.751 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.751 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:42:24.751 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:24.751 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.751 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.751 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.751 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:24.752 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.752 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.752 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.752 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:42:24.752 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:24.752 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.752 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.752 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.752 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:42:24.752 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:24.752 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.752 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.752 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.753 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:24.753 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.753 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.753 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.753 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:42:24.753 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:24.753 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.753 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.753 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.753 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:42:24.753 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:24.753 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.754 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.754 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.754 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:24.754 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.754 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.754 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.754 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:42:24.754 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:24.754 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.755 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.755 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.755 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:42:24.755 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:24.755 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.755 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.755 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.755 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:42:24.755 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:42:24.755 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:42:24.755 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:42:24.755 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:24.757 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:24.757 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:24.757 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:24.757 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:24.757 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:24.757 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:24.757 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.757 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.757 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.757 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:42:24.757 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:24.757 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.758 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.758 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.758 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:42:24.758 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:24.758 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.758 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.758 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.758 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:24.758 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.758 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.758 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.758 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:42:24.758 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:24.759 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.759 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.759 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.759 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:42:24.759 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:24.759 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.759 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.759 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.759 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:24.759 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.759 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.759 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.759 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:42:24.760 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:24.760 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.760 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.760 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.760 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:42:24.760 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:24.760 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.760 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.760 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.760 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:24.760 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.760 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.761 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.761 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:42:24.761 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:24.761 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.761 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.761 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.761 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:42:24.761 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:24.761 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.761 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.761 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.761 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:42:24.762 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:42:24.762 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:42:24.762 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:42:24.762 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:24.762 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:42:24.762 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:24.762 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:24.762 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.762 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.762 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.762 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:24.762 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:24.762 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.763 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:42:24.764 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:24.764 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.764 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.764 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.764 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:42:24.764 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:24.764 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.764 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.765 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.765 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:24.765 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.765 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.765 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.765 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:42:24.765 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:24.765 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.765 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.765 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.765 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:42:24.766 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:24.766 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.766 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.766 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.766 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:24.766 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.766 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.766 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.766 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:42:24.766 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:24.766 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.766 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.767 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.767 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:42:24.767 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:24.767 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.767 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.767 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:24.767 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.767 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.767 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.767 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:42:24.767 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:24.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.768 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.768 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.768 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:42:24.768 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:24.768 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.768 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.768 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.768 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:42:24.768 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:42:24.768 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:42:24.768 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:42:24.768 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:24.769 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:24.769 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:42:24.769 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:24.769 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.769 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.769 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.769 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:24.769 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:24.769 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:24.769 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:24.769 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:24.769 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:24.770 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:24.770 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:24.770 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:24.770 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:24.770 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:24.770 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:24.770 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:24.770 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.770 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.770 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.770 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:42:24.770 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:24.771 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.771 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.771 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.771 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:42:24.771 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:24.771 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.771 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.771 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.771 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:24.771 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.771 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.771 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.771 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:42:24.772 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:24.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.772 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.772 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.772 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:42:24.772 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:24.772 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.772 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.772 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:24.772 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.772 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.773 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.773 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:42:24.773 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:24.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.773 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.773 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.773 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:42:24.773 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:24.773 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.773 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.773 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:24.773 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.774 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.774 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.774 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:42:24.774 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:24.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.774 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.774 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.774 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:42:24.774 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:24.774 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.774 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.775 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:42:24.775 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:42:24.775 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:42:24.775 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:42:24.775 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:24.775 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:24.775 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:24.775 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.775 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.776 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.776 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:24.776 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:24.776 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:24.776 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:24.776 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:24.776 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:24.776 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:24.776 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:24.776 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:24.776 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:24.776 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:24.776 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:24.777 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:24.777 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.777 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.777 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.777 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:42:24.777 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:24.777 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.777 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.777 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.777 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:42:24.777 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:24.777 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:24.778 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.779 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.779 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.779 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:24.779 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.779 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.779 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.779 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:42:24.779 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:24.779 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.779 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.779 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.779 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:42:24.779 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:24.780 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.780 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.780 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.780 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:24.780 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.780 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.780 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.780 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:42:24.780 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:24.780 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.780 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.780 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.781 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:42:24.781 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:24.781 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.781 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.781 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.781 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:42:24.781 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:42:24.781 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:42:24.781 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:42:24.781 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:24.781 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:24.781 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:24.782 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:24.783 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:24.783 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:24.783 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:24.783 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.783 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.783 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.783 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:42:24.783 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:24.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.783 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.783 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.783 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.784 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:42:24.785 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:24.785 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.785 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.785 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.785 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:24.785 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.785 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.785 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.786 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:42:24.786 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:24.786 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.786 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.786 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.786 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:42:24.786 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:24.786 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.786 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.786 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.786 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:24.786 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.786 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.787 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.787 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:42:24.787 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:24.787 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.787 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.787 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.787 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:42:24.787 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:24.787 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.787 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.787 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.787 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:42:24.787 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:42:24.788 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:42:24.788 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:42:24.788 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:24.788 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:24.788 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:42:24.788 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:24.788 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.788 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.788 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:24.788 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:24.788 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:24.788 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:24.789 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:24.789 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:24.789 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:24.789 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:24.789 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:24.789 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:24.789 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:24.789 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:24.789 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:24.789 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.789 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.789 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.790 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:42:24.790 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:24.790 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.790 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.790 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.790 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:42:24.790 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:24.790 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.790 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.790 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.790 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:24.790 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.790 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.791 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.792 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.792 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:42:24.792 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:24.792 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.792 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.792 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.792 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:42:24.792 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:24.792 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.792 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.792 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.792 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:24.793 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.793 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.793 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.793 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:42:24.793 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:24.793 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.793 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.793 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.793 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:42:24.793 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:24.793 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.793 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.796 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.796 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:42:24.796 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:24.796 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.796 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.796 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:42:24.796 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:24.796 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.796 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.796 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.797 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:24.797 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.797 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.797 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.797 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:42:24.797 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:24.797 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.797 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.797 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.797 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:42:24.797 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:24.797 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.798 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.798 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.798 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:24.798 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.798 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.798 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.798 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:42:24.798 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:24.798 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.798 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.798 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.798 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:42:24.798 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:24.799 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.799 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.799 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.799 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:24.799 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:24.799 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.799 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:24.799 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:42:24.799 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:24.799 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.799 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.799 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:24.799 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:42:24.800 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:24.800 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.800 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.800 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.800 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:42:24.800 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:42:24.800 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:42:24.800 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:42:24.800 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:24.800 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:42:24.800 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:24.801 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:24.801 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:24.801 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.801 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:24.801 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:42:24.801 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.801 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:24.801 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:24.801 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:24.801 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:24.802 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:24.802 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:24.802 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:42:24.802 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:24.802 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.802 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.802 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:24.802 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:24.802 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:24.802 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:24.802 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:24.802 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:24.802 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:42:24.803 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:24.803 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.803 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.803 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:24.803 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:24.803 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:24.803 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:24.803 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:24.803 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:24.803 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:42:24.803 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:24.803 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.804 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.804 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:24.804 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:24.804 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:24.804 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:24.804 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:24.804 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:24.804 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:42:24.804 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:24.804 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.804 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.804 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:24.805 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:24.805 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:24.805 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:24.805 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:24.805 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:24.805 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:42:24.805 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:24.805 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.805 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.805 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:24.805 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:24.805 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:24.806 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:24.806 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:24.806 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:24.806 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:42:24.806 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:24.806 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.806 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.806 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:24.806 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:24.806 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:24.806 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:24.806 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:24.807 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:24.807 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:42:24.807 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:24.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.807 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:24.807 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:24.807 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:24.807 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:24.807 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:24.807 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:24.807 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:24.807 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:42:24.808 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:42:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:42:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:42:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:42:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:42:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:42:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:42:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:42:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:42:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:42:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:42:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:42:24.810 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:42:24.810 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:42:24.810 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:42:24.810 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:24.810 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:42:24.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.724+0000 7fefe6fab640 1 -- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fefc406a430 msgr2=0x7fefc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:24.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.724+0000 7fefe6fab640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fefc406a430 0x7fefc406c8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fefd4036000 tx=0x7fefd403b040 comp rx=0 tx=0).stop 2023-12-22T08:42:24.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.725+0000 7fefe6fab640 1 -- 172.21.15.38:0/3990584568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefe015d470 msgr2=0x7fefe0159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:24.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.725+0000 7fefe6fab640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefe015d470 0x7fefe0159a00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00c3f0 tx=0x7fefcc00c8b0 comp rx=0 tx=0).stop 2023-12-22T08:42:24.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.725+0000 7fefe6fab640 1 -- 172.21.15.38:0/3990584568 shutdown_connections 2023-12-22T08:42:24.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.725+0000 7fefe6fab640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefe015d850 0x7fefe006cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:24.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.725+0000 7fefe6fab640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fefc406a430 0x7fefc406c8f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:24.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.725+0000 7fefe6fab640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefe015d470 0x7fefe0159a00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:24.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.725+0000 7fefe6fab640 1 --2- 172.21.15.38:0/3990584568 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefe0071ea0 0x7fefe0155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:24.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.725+0000 7fefe6fab640 1 -- 172.21.15.38:0/3990584568 >> 172.21.15.38:0/3990584568 conn(0x7fefe00cf070 msgr2=0x7fefe00b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:24.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.725+0000 7fefe6fab640 1 -- 172.21.15.38:0/3990584568 shutdown_connections 2023-12-22T08:42:24.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:24.725+0000 7fefe6fab640 1 -- 172.21.15.38:0/3990584568 wait complete. 2023-12-22T08:42:24.814 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-22T08:42:26.125 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:42:26.123+0000 7f0a296e8640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-12-22T08:42:29.815 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:42:30.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.050+0000 7fa6be91c640 1 Processor -- start 2023-12-22T08:42:30.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.050+0000 7fa6be91c640 1 -- start start 2023-12-22T08:42:30.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.052+0000 7fa6be91c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b8071000 0x7fa6b8165f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:30.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.052+0000 7fa6be91c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b80cdae0 con 0x7fa6b80a44a0 2023-12-22T08:42:30.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.052+0000 7fa6be91c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b815b800 con 0x7fa6b815b420 2023-12-22T08:42:30.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.052+0000 7fa6be91c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b80cdd30 con 0x7fa6b8071000 2023-12-22T08:42:30.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.052+0000 7fa6bd119640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa6b80a44a0 0x7fa6b80708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57314/0 (socket says 172.21.15.38:57314) 2023-12-22T08:42:30.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.052+0000 7fa6bd119640 1 -- 172.21.15.38:0/115570433 learned_addr learned my addr 172.21.15.38:0/115570433 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:30.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6be11b640 1 --2- 172.21.15.38:0/115570433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b8071000 0x7fa6b8165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:30.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955774244 0 0) 0x7fa6b80cdae0 con 0x7fa6b80a44a0 2023-12-22T08:42:30.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6a4003520 con 0x7fa6b80a44a0 2023-12-22T08:42:30.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3454805343 0 0) 0x7fa6a4003520 con 0x7fa6b80a44a0 2023-12-22T08:42:30.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b8071000 msgr2=0x7fa6b8165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:30.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 --2- 172.21.15.38:0/115570433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b8071000 0x7fa6b8165f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:30.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 >> v1:172.21.15.89:6789/0 conn(0x7fa6b815b420 legacy=0x7fa6b806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:30.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b80ce010 con 0x7fa6b80a44a0 2023-12-22T08:42:30.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fa6a8001670 con 0x7fa6b80a44a0 2023-12-22T08:42:30.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 >> v1:172.21.15.38:6789/0 conn(0x7fa6b80a44a0 legacy=0x7fa6b80708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:30.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 --2- 172.21.15.38:0/115570433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6a40039a0 0x7fa6a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:30.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 --2- 172.21.15.38:0/115570433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6a40047c0 0x7fa6a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:30.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 --2- 172.21.15.38:0/115570433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b8071000 0x7fa6a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:30.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b80cdd30 con 0x7fa6a40047c0 2023-12-22T08:42:30.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a400bae0 con 0x7fa6a40039a0 2023-12-22T08:42:30.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.053+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a400bca0 con 0x7fa6b8071000 2023-12-22T08:42:30.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.054+0000 7fa6bd119640 1 --2- 172.21.15.38:0/115570433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6a40047c0 0x7fa6a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:30.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.054+0000 7fa6bd119640 1 -- 172.21.15.38:0/115570433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b8071000 msgr2=0x7fa6a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:30.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.054+0000 7fa6bd119640 1 --2- 172.21.15.38:0/115570433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b8071000 0x7fa6a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:30.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.054+0000 7fa6bd91a640 1 --2- 172.21.15.38:0/115570433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6a40039a0 0x7fa6a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:30.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.054+0000 7fa6bd119640 1 -- 172.21.15.38:0/115570433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6a40039a0 msgr2=0x7fa6a4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:30.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.054+0000 7fa6bd119640 1 --2- 172.21.15.38:0/115570433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6a40039a0 0x7fa6a4003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:30.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.054+0000 7fa6bd119640 1 -- 172.21.15.38:0/115570433 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a4003520 con 0x7fa6a40047c0 2023-12-22T08:42:30.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.055+0000 7fa6bd119640 1 --2- 172.21.15.38:0/115570433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6a40047c0 0x7fa6a4004c40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80b1f40 tx=0x7fa6a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc635af34c61a70 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:30.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.055+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8005ad0 con 0x7fa6a40047c0 2023-12-22T08:42:30.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.055+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a8005c30 con 0x7fa6a40047c0 2023-12-22T08:42:30.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.055+0000 7fa6bc918640 1 -- 172.21.15.38:0/115570433 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a802c850 con 0x7fa6a40047c0 2023-12-22T08:42:30.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.056+0000 7fa6be91c640 1 -- 172.21.15.38:0/115570433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6a40047c0 msgr2=0x7fa6a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:30.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.056+0000 7fa6be91c640 1 --2- 172.21.15.38:0/115570433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6a40047c0 0x7fa6a4004c40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80b1f40 tx=0x7fa6a40057f0 comp rx=0 tx=0).stop 2023-12-22T08:42:30.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.056+0000 7fa6be11b640 1 -- 172.21.15.38:0/115570433 reap_dead start 2023-12-22T08:42:30.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.056+0000 7fa6be91c640 1 -- 172.21.15.38:0/115570433 shutdown_connections 2023-12-22T08:42:30.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.056+0000 7fa6be91c640 1 -- 172.21.15.38:0/115570433 >> 172.21.15.38:0/115570433 conn(0x7fa6b80b1f70 msgr2=0x7fa6b80b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:30.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.056+0000 7fa6be91c640 1 -- 172.21.15.38:0/115570433 shutdown_connections 2023-12-22T08:42:30.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.056+0000 7fa6be91c640 1 -- 172.21.15.38:0/115570433 wait complete. 2023-12-22T08:42:30.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.058+0000 7fa6be91c640 1 Processor -- start 2023-12-22T08:42:30.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.058+0000 7fa6be91c640 1 -- start start 2023-12-22T08:42:30.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.059+0000 7fa6be91c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6a40047c0 0x7fa6b80a23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:30.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.059+0000 7fa6be91c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b81545f0 0x7fa6b809a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:30.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.059+0000 7fa6be91c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806cfe0 0x7fa6b806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:30.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.059+0000 7fa6be91c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b806d9a0 con 0x7fa6a40047c0 2023-12-22T08:42:30.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.059+0000 7fa6be91c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b80a2a80 con 0x7fa6b81545f0 2023-12-22T08:42:30.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.059+0000 7fa6be91c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b80a2d60 con 0x7fa6b806cfe0 2023-12-22T08:42:30.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.060+0000 7fa6bd91a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6a40047c0 0x7fa6b80a23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:30.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.060+0000 7fa6bd91a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6a40047c0 0x7fa6b80a23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39226/0 (socket says 172.21.15.38:39226) 2023-12-22T08:42:30.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.060+0000 7fa6bd91a640 1 -- 172.21.15.38:0/993719289 learned_addr learned my addr 172.21.15.38:0/993719289 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:30.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.060+0000 7fa6be11b640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806cfe0 0x7fa6b806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:30.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.060+0000 7fa6bd119640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b81545f0 0x7fa6b809a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:30.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.060+0000 7fa6bd91a640 1 -- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806cfe0 msgr2=0x7fa6b806d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:30.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.060+0000 7fa6bd91a640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806cfe0 0x7fa6b806d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:30.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.060+0000 7fa6bd91a640 1 -- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b81545f0 msgr2=0x7fa6b809a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:30.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.060+0000 7fa6bd91a640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b81545f0 0x7fa6b809a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:30.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.060+0000 7fa6bd91a640 1 -- 172.21.15.38:0/993719289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b80a3040 con 0x7fa6a40047c0 2023-12-22T08:42:30.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.060+0000 7fa6be11b640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806cfe0 0x7fa6b806d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:30.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.060+0000 7fa6bd119640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b81545f0 0x7fa6b809a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:30.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.061+0000 7fa6bd91a640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6a40047c0 0x7fa6b80a23d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400d570 tx=0x7fa6b400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:30.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.061+0000 7fa6ae7fc640 1 -- 172.21.15.38:0/993719289 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4005480 con 0x7fa6a40047c0 2023-12-22T08:42:30.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.061+0000 7fa6ae7fc640 1 -- 172.21.15.38:0/993719289 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b4003610 con 0x7fa6a40047c0 2023-12-22T08:42:30.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.061+0000 7fa6ae7fc640 1 -- 172.21.15.38:0/993719289 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4003980 con 0x7fa6a40047c0 2023-12-22T08:42:30.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.061+0000 7fa6be91c640 1 -- 172.21.15.38:0/993719289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b80a3320 con 0x7fa6a40047c0 2023-12-22T08:42:30.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.061+0000 7fa6be91c640 1 -- 172.21.15.38:0/993719289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b809ab60 con 0x7fa6a40047c0 2023-12-22T08:42:30.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.062+0000 7fa6be91c640 1 -- 172.21.15.38:0/993719289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b8061910 con 0x7fa6a40047c0 2023-12-22T08:42:30.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.063+0000 7fa6ae7fc640 1 -- 172.21.15.38:0/993719289 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa6b4003ae0 con 0x7fa6a40047c0 2023-12-22T08:42:30.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.064+0000 7fa6ae7fc640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa69c06a460 0x7fa69c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:30.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.064+0000 7fa6ae7fc640 1 -- 172.21.15.38:0/993719289 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6b4088970 con 0x7fa6a40047c0 2023-12-22T08:42:30.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.064+0000 7fa6ae7fc640 1 -- 172.21.15.38:0/993719289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=57}) v3 -- 0x7fa69c071f90 con 0x7fa6a40047c0 2023-12-22T08:42:30.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.065+0000 7fa6bd119640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa69c06a460 0x7fa69c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:30.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.066+0000 7fa6bd119640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa69c06a460 0x7fa69c06c920 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8034000 tx=0x7fa6a8009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:30.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.069+0000 7fa6ae7fc640 1 -- 172.21.15.38:0/993719289 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa6b4053e30 con 0x7fa6a40047c0 2023-12-22T08:42:30.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.262+0000 7fa6be91c640 1 -- 172.21.15.38:0/993719289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa6b80706d0 con 0x7fa6a40047c0 2023-12-22T08:42:30.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.266+0000 7fa6ae7fc640 1 -- 172.21.15.38:0/993719289 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v56) v1 ==== 81+0+33515 (secure 0 0 0) 0x7fa6b4001230 con 0x7fa6a40047c0 2023-12-22T08:42:30.269 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:30.269 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:42:30.269 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 56, 2023-12-22T08:42:30.269 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:42:30.269 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:42:30.269 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:42:28.289518+0000", 2023-12-22T08:42:30.269 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:42:30.269 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:42:30.269 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:42:30.269 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:42:30.269 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:42:30.269 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:42:30.270 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:42:30.270 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:42:30.270 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:42:30.270 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:30.270 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:42:30.270 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:42:30.270 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:42:30.270 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:42:30.270 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:42:30.270 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 7, 2023-12-22T08:42:30.270 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:42:30.271 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:42:30.271 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:42:30.271 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:42:30.271 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:42:30.271 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:42:30.271 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.271 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:42:30.271 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:42:30.271 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:42:30.271 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:42:30.271 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:42:30.272 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:30.272 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:30.272 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:30.272 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:30.272 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:30.272 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:30.272 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:30.273 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:30.273 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:30.273 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:30.273 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:42:30.274 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:42:30.274 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:42:30.274 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:42:30.274 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:42:30.274 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:30.274 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:30.275 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:30.275 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:30.275 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:30.275 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:30.275 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:30.275 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.275 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "49", 2023-12-22T08:42:30.276 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:30.276 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:30.276 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:30.276 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:30.276 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:30.276 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:30.276 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:30.277 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:30.277 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:30.277 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:30.277 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:30.277 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:30.277 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:30.277 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:30.278 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:30.278 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:30.278 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:30.278 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:30.278 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:30.278 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:30.278 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:30.278 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:30.278 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:30.279 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:30.280 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 6, 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:58.840533+0000", 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:30.281 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:30.282 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "49", 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:30.283 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.284 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:42:30.285 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.286 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:30.286 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:30.286 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:42:30.286 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.286 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.286 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:30.286 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:42:30.286 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:42:30.286 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:30.286 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:42:30.286 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:42:30.287 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:30.287 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:30.287 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:30.287 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.287 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.287 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.287 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 7, 2023-12-22T08:42:30.287 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:42:30.287 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:59.953505+0000", 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:42:30.288 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "49", 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:30.289 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:30.290 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:30.291 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.292 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.75, 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.75, 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.75, 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.75, 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:30.293 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:42:30.295 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:30.296 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.297 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:30.298 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:30.299 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:30.300 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:30.300 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.300 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.300 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.300 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:42:30.300 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:30.300 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.300 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.300 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.300 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:42:30.300 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:30.300 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:30.301 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:30.302 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.303 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:30.304 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.306 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.307 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.308 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:30.309 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:30.310 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:30.311 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.312 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.313 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:42:30.313 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:30.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.313 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.313 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.313 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:42:30.313 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:30.313 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.313 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.313 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:30.313 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.313 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:42:30.314 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:30.315 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:42:30.316 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:42:30.317 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:30.318 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:30.319 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:30.320 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.321 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.322 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:30.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.324 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.324 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.324 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:42:30.324 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:30.324 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.324 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.324 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.324 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:30.324 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.324 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:42:30.325 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:30.326 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.327 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.328 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.329 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:42:30.329 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:30.329 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.329 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.329 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.329 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:30.329 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.329 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.329 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.329 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:42:30.329 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:30.329 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:30.330 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:30.332 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:30.333 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.334 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.335 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:42:30.336 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:42:30.337 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:30.338 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:30.339 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:30.340 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:30.341 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:42:30.342 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:30.343 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:42:30.344 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:42:30.344 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:42:30.344 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:42:30.344 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:42:30.344 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:42:30.344 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:42:30.344 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:42:30.344 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:42:30.344 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:42:30.344 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:42:30.344 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:30.344 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:42:30.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.268+0000 7fa6be91c640 1 -- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa69c06a460 msgr2=0x7fa69c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:30.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.268+0000 7fa6be91c640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa69c06a460 0x7fa69c06c920 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8034000 tx=0x7fa6a8009030 comp rx=0 tx=0).stop 2023-12-22T08:42:30.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.268+0000 7fa6be91c640 1 -- 172.21.15.38:0/993719289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6a40047c0 msgr2=0x7fa6b80a23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:30.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.268+0000 7fa6be91c640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6a40047c0 0x7fa6b80a23d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400d570 tx=0x7fa6b400da30 comp rx=0 tx=0).stop 2023-12-22T08:42:30.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.268+0000 7fa6be91c640 1 -- 172.21.15.38:0/993719289 shutdown_connections 2023-12-22T08:42:30.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.268+0000 7fa6be91c640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806cfe0 0x7fa6b806d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:30.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.268+0000 7fa6be91c640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b81545f0 0x7fa6b809a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:30.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.268+0000 7fa6be91c640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa69c06a460 0x7fa69c06c920 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:30.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.268+0000 7fa6be91c640 1 --2- 172.21.15.38:0/993719289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6a40047c0 0x7fa6b80a23d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:30.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.268+0000 7fa6be91c640 1 -- 172.21.15.38:0/993719289 >> 172.21.15.38:0/993719289 conn(0x7fa6b80b1f70 msgr2=0x7fa6b8154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:30.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.269+0000 7fa6be91c640 1 -- 172.21.15.38:0/993719289 shutdown_connections 2023-12-22T08:42:30.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:30.269+0000 7fa6be91c640 1 -- 172.21.15.38:0/993719289 wait complete. 2023-12-22T08:42:30.347 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-22T08:42:31.127 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:42:31.125+0000 7f0a296e8640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-12-22T08:42:35.349 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:42:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.586+0000 7f07d359e640 1 Processor -- start 2023-12-22T08:42:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.587+0000 7f07d359e640 1 -- start start 2023-12-22T08:42:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.588+0000 7f07d359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f07d415d480 0x7f07d40d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.588+0000 7f07d359e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f07d40a5140 0x7f07d4160f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.588+0000 7f07d359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d40d1eb0 con 0x7f07d4161480 2023-12-22T08:42:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.588+0000 7f07d359e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d40d2150 con 0x7f07d40a5140 2023-12-22T08:42:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.588+0000 7f07d359e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d40d2430 con 0x7f07d415d480 2023-12-22T08:42:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.589+0000 7f07cbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f07d40a5140 0x7f07d4160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.589+0000 7f07cbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f07d40a5140 0x7f07d4160f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34114/0 (socket says 172.21.15.38:34114) 2023-12-22T08:42:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.589+0000 7f07cbfff640 1 -- 172.21.15.38:0/147310264 learned_addr learned my addr 172.21.15.38:0/147310264 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:35.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.589+0000 7f07d259c640 1 --2- 172.21.15.38:0/147310264 >> v2:172.21.15.89:3300/0 conn(0x7f07d415d480 0x7f07d40d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:35.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.589+0000 7f07cbfff640 1 -- 172.21.15.38:0/147310264 >> v2:172.21.15.89:3300/0 conn(0x7f07d415d480 msgr2=0x7f07d40d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:35.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.589+0000 7f07cbfff640 1 --2- 172.21.15.38:0/147310264 >> v2:172.21.15.89:3300/0 conn(0x7f07d415d480 0x7f07d40d2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:35.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.589+0000 7f07cbfff640 1 -- 172.21.15.38:0/147310264 >> v1:172.21.15.89:6789/0 conn(0x7f07d4161480 legacy=0x7f07d415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:35.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.589+0000 7f07cbfff640 1 -- 172.21.15.38:0/147310264 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d40d2710 con 0x7f07d40a5140 2023-12-22T08:42:35.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.589+0000 7f07d259c640 1 --2- 172.21.15.38:0/147310264 >> v2:172.21.15.89:3300/0 conn(0x7f07d415d480 0x7f07d40d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:35.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.590+0000 7f07cbfff640 1 --2- 172.21.15.38:0/147310264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07d40a5140 0x7f07d4160f40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f07d404e350 tx=0x7f07bc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53af214ccee2448 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.591+0000 7f07d1d9b640 1 -- 172.21.15.38:0/147310264 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0317e0 con 0x7f07d40a5140 2023-12-22T08:42:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.591+0000 7f07d1d9b640 1 -- 172.21.15.38:0/147310264 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc031940 con 0x7f07d40a5140 2023-12-22T08:42:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.591+0000 7f07d1d9b640 1 -- 172.21.15.38:0/147310264 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc031cd0 con 0x7f07d40a5140 2023-12-22T08:42:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.591+0000 7f07d359e640 1 -- 172.21.15.38:0/147310264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07d40a5140 msgr2=0x7f07d4160f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.591+0000 7f07d359e640 1 --2- 172.21.15.38:0/147310264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07d40a5140 0x7f07d4160f40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f07d404e350 tx=0x7f07bc02b880 comp rx=0 tx=0).stop 2023-12-22T08:42:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.591+0000 7f07d359e640 1 -- 172.21.15.38:0/147310264 shutdown_connections 2023-12-22T08:42:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.591+0000 7f07d359e640 1 --2- 172.21.15.38:0/147310264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07d40a5140 0x7f07d4160f40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.591+0000 7f07d359e640 1 --2- 172.21.15.38:0/147310264 >> v2:172.21.15.89:3300/0 conn(0x7f07d415d480 0x7f07d40d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.591+0000 7f07d359e640 1 -- 172.21.15.38:0/147310264 >> 172.21.15.38:0/147310264 conn(0x7f07d406ced0 msgr2=0x7f07d4071260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.591+0000 7f07d359e640 1 -- 172.21.15.38:0/147310264 shutdown_connections 2023-12-22T08:42:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.592+0000 7f07d359e640 1 -- 172.21.15.38:0/147310264 wait complete. 2023-12-22T08:42:35.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.593+0000 7f07d359e640 1 Processor -- start 2023-12-22T08:42:35.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.593+0000 7f07d359e640 1 -- start start 2023-12-22T08:42:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.594+0000 7f07d359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07d40a5140 0x7f07d415dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.594+0000 7f07d359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07d415d480 0x7f07d40b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.594+0000 7f07d359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07d4161480 0x7f07d40b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.594+0000 7f07d359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40b50b0 con 0x7f07d415d480 2023-12-22T08:42:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.594+0000 7f07d359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40b55e0 con 0x7f07d4161480 2023-12-22T08:42:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.594+0000 7f07d359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d40b5300 con 0x7f07d40a5140 2023-12-22T08:42:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.595+0000 7f07cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07d415d480 0x7f07d40b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.595+0000 7f07cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07d415d480 0x7f07d40b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34126/0 (socket says 172.21.15.38:34126) 2023-12-22T08:42:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.595+0000 7f07cbfff640 1 -- 172.21.15.38:0/1962544289 learned_addr learned my addr 172.21.15.38:0/1962544289 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.595+0000 7f07cbfff640 1 -- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07d40a5140 msgr2=0x7f07d415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.595+0000 7f07d259c640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07d40a5140 0x7f07d415dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.595+0000 7f07d2d9d640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07d4161480 0x7f07d40b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.595+0000 7f07cbfff640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07d40a5140 0x7f07d415dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.595+0000 7f07cbfff640 1 -- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07d4161480 msgr2=0x7f07d40b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.595+0000 7f07cbfff640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07d4161480 0x7f07d40b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.595+0000 7f07cbfff640 1 -- 172.21.15.38:0/1962544289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc0094d0 con 0x7f07d415d480 2023-12-22T08:42:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.595+0000 7f07d2d9d640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07d4161480 0x7f07d40b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.596+0000 7f07cbfff640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07d415d480 0x7f07d40b4630 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f07bc02b8c0 tx=0x7f07bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.596+0000 7f07caffd640 1 -- 172.21.15.38:0/1962544289 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc032940 con 0x7f07d415d480 2023-12-22T08:42:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.596+0000 7f07caffd640 1 -- 172.21.15.38:0/1962544289 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc032aa0 con 0x7f07d415d480 2023-12-22T08:42:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.596+0000 7f07caffd640 1 -- 172.21.15.38:0/1962544289 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc032e50 con 0x7f07d415d480 2023-12-22T08:42:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.596+0000 7f07d359e640 1 -- 172.21.15.38:0/1962544289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d414ad40 con 0x7f07d415d480 2023-12-22T08:42:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.596+0000 7f07d359e640 1 -- 172.21.15.38:0/1962544289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d414b300 con 0x7f07d415d480 2023-12-22T08:42:35.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.597+0000 7f07d359e640 1 -- 172.21.15.38:0/1962544289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d4061910 con 0x7f07d415d480 2023-12-22T08:42:35.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.598+0000 7f07caffd640 1 -- 172.21.15.38:0/1962544289 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f07bc04e450 con 0x7f07d415d480 2023-12-22T08:42:35.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.600+0000 7f07caffd640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f07b406a430 0x7f07b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:35.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.600+0000 7f07caffd640 1 -- 172.21.15.38:0/1962544289 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07bc0aaba0 con 0x7f07d415d480 2023-12-22T08:42:35.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.600+0000 7f07d259c640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f07b406a430 0x7f07b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:35.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.601+0000 7f07d259c640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f07b406a430 0x7f07b406c8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f07c4008850 tx=0x7f07c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.605+0000 7f07caffd640 1 -- 172.21.15.38:0/1962544289 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f07bc076180 con 0x7f07d415d480 2023-12-22T08:42:35.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.799+0000 7f07d359e640 1 -- 172.21.15.38:0/1962544289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f07d4071e30 con 0x7f07d415d480 2023-12-22T08:42:35.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.802+0000 7f07caffd640 1 -- 172.21.15.38:0/1962544289 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v59) v1 ==== 81+0+33428 (secure 0 0 0) 0x7f07bc0797a0 con 0x7f07d415d480 2023-12-22T08:42:35.805 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:35.805 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 59, 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:42:33.327912+0000", 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:42:35.806 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:35.807 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:42:35.807 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:42:35.807 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:42:35.807 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:42:35.807 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:42:35.807 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 7, 2023-12-22T08:42:35.807 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:42:35.807 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:42:35.807 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:42:35.808 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:42:35.808 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:42:35.808 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:42:35.808 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.808 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:42:35.808 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:42:35.808 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:42:35.808 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:42:35.809 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:42:35.809 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:35.809 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:35.809 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:35.809 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:35.809 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:35.809 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:35.809 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:35.809 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:35.809 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:35.810 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:35.810 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:42:35.810 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:42:35.810 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:42:35.810 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:42:35.810 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:42:35.810 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:35.810 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:35.810 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:35.810 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:35.810 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:35.810 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:35.811 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:35.811 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.811 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "59", 2023-12-22T08:42:35.811 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:35.811 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:35.811 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:35.811 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:35.811 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:35.811 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:35.811 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:35.811 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:35.811 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:35.811 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:35.812 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:35.813 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:35.813 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:35.813 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.813 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:35.813 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:35.813 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:35.813 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:35.813 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:35.813 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:35.813 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:35.813 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:35.813 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:35.813 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:42:35.814 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 6, 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:58.840533+0000", 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:35.815 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:35.816 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "59", 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:35.817 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:35.818 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:35.818 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:35.818 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:35.818 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:35.818 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:35.818 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:35.819 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:35.819 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:35.819 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:35.819 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:35.819 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:35.819 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:35.819 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:35.819 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:35.819 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:35.819 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:35.819 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:35.820 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:35.821 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 7, 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:59.953505+0000", 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:35.822 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:35.823 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "59", 2023-12-22T08:42:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:35.826 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.75, 2023-12-22T08:42:35.827 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.75, 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.75, 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.75, 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:35.829 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:35.829 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:35.829 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:35.829 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:35.829 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:35.829 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:35.829 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:35.829 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:35.829 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:35.830 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.830 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.830 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.830 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:42:35.830 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:35.830 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.830 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.830 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.830 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:42:35.830 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:35.831 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.832 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.833 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:35.833 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.833 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.833 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.833 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:42:35.833 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:35.833 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.833 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.833 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.833 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:42:35.833 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:35.834 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.834 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.834 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.834 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:42:35.834 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:42:35.834 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:42:35.834 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:42:35.834 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:35.834 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:35.834 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:35.834 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.834 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.835 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.836 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:35.837 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.838 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:42:35.839 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:35.839 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.839 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.839 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.839 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:42:35.839 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:42:35.839 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:42:35.839 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:42:35.839 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:35.839 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:35.840 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:35.840 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.840 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.840 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.840 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:35.840 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:35.840 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:35.840 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:35.840 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:35.840 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:35.840 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:35.841 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:35.841 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:35.841 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:35.841 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:35.841 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:35.841 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:35.841 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.841 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.841 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.841 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:42:35.842 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:35.842 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.842 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.842 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.842 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:42:35.842 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:35.842 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.842 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.842 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.842 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:35.842 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.843 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.843 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.843 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:42:35.843 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:35.843 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.843 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.843 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.843 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:42:35.843 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:35.843 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.843 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.843 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.844 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:42:35.845 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:35.846 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.847 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.848 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:42:35.849 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:35.849 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.849 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.849 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.849 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:35.849 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.849 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.849 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.849 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:42:35.849 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:35.849 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.849 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.849 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.850 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.851 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.852 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.853 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.854 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:42:35.855 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.856 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:35.857 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.858 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:42:35.859 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.860 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.861 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:35.862 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:35.863 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.864 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.865 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:42:35.865 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:35.865 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.865 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.865 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.865 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:42:35.865 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:35.865 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.865 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.865 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.865 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:35.865 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:42:35.866 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:35.867 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.868 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.869 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.870 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:42:35.870 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:35.870 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.870 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.870 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.870 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:35.870 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.870 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.870 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.870 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:42:35.870 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:35.870 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.870 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.871 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.872 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:35.872 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:42:35.872 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:35.872 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.872 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.872 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.872 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:42:35.872 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:42:35.872 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:42:35.872 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:42:35.872 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:35.872 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:35.873 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:35.873 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:35.873 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.873 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:35.873 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:42:35.873 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.873 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:35.873 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:35.873 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:35.873 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:35.873 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:35.873 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:35.874 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:42:35.874 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:35.874 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.874 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.874 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:35.874 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:35.874 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:35.874 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:35.874 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:35.874 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:35.874 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.875 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:35.876 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:42:35.877 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:35.877 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.877 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.877 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:35.877 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:35.877 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:35.877 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:35.877 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:35.877 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:35.877 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:42:35.877 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:35.878 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:42:35.879 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:42:35.880 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:42:35.881 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:42:35.881 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:42:35.881 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:42:35.881 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:42:35.881 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:42:35.881 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:35.881 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:42:35.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.805+0000 7f07d359e640 1 -- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f07b406a430 msgr2=0x7f07b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.805+0000 7f07d359e640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f07b406a430 0x7f07b406c8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f07c4008850 tx=0x7f07c4008040 comp rx=0 tx=0).stop 2023-12-22T08:42:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.805+0000 7f07d359e640 1 -- 172.21.15.38:0/1962544289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07d415d480 msgr2=0x7f07d40b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.805+0000 7f07d359e640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07d415d480 0x7f07d40b4630 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f07bc02b8c0 tx=0x7f07bc0046c0 comp rx=0 tx=0).stop 2023-12-22T08:42:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.805+0000 7f07d359e640 1 -- 172.21.15.38:0/1962544289 shutdown_connections 2023-12-22T08:42:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.805+0000 7f07d359e640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07d4161480 0x7f07d40b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.805+0000 7f07d359e640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f07b406a430 0x7f07b406c8f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.805+0000 7f07d359e640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07d415d480 0x7f07d40b4630 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.805+0000 7f07d359e640 1 --2- 172.21.15.38:0/1962544289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07d40a5140 0x7f07d415dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.805+0000 7f07d359e640 1 -- 172.21.15.38:0/1962544289 >> 172.21.15.38:0/1962544289 conn(0x7f07d406ced0 msgr2=0x7f07d40d0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.806+0000 7f07d359e640 1 -- 172.21.15.38:0/1962544289 shutdown_connections 2023-12-22T08:42:35.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:35.806+0000 7f07d359e640 1 -- 172.21.15.38:0/1962544289 wait complete. 2023-12-22T08:42:35.884 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-22T08:42:35.884 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:42:36.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.114+0000 7fcbdcf70640 1 Processor -- start 2023-12-22T08:42:36.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.115+0000 7fcbdcf70640 1 -- start start 2023-12-22T08:42:36.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.116+0000 7fcbdcf70640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcbd8157980 0x7fcbd815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:36.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.116+0000 7fcbdcf70640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbd80b3ff0 0x7fcbd806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:36.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.117+0000 7fcbdcf70640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcbd80b4470 0x7fcbd806d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:36.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.117+0000 7fcbdcf70640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd80d1520 con 0x7fcbd8157980 2023-12-22T08:42:36.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.117+0000 7fcbdcf70640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd80d1800 con 0x7fcbd80b4470 2023-12-22T08:42:36.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.117+0000 7fcbdcf70640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd80d1ae0 con 0x7fcbd80b3ff0 2023-12-22T08:42:36.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.117+0000 7fcbd77fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcbd8157980 0x7fcbd815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:36.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.117+0000 7fcbd77fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcbd8157980 0x7fcbd815eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34138/0 (socket says 172.21.15.38:34138) 2023-12-22T08:42:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.117+0000 7fcbd77fe640 1 -- 172.21.15.38:0/2862180780 learned_addr learned my addr 172.21.15.38:0/2862180780 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.117+0000 7fcbd7fff640 1 --2- 172.21.15.38:0/2862180780 >> v2:172.21.15.89:3300/0 conn(0x7fcbd80b4470 0x7fcbd806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.117+0000 7fcbd6ffd640 1 --2- 172.21.15.38:0/2862180780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbd80b3ff0 0x7fcbd806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.117+0000 7fcbd77fe640 1 -- 172.21.15.38:0/2862180780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbd80b3ff0 msgr2=0x7fcbd806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.118+0000 7fcbd77fe640 1 --2- 172.21.15.38:0/2862180780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbd80b3ff0 0x7fcbd806cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.118+0000 7fcbd77fe640 1 -- 172.21.15.38:0/2862180780 >> v2:172.21.15.89:3300/0 conn(0x7fcbd80b4470 msgr2=0x7fcbd806d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.118+0000 7fcbd77fe640 1 --2- 172.21.15.38:0/2862180780 >> v2:172.21.15.89:3300/0 conn(0x7fcbd80b4470 0x7fcbd806d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.118+0000 7fcbd77fe640 1 -- 172.21.15.38:0/2862180780 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd80d1dc0 con 0x7fcbd8157980 2023-12-22T08:42:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.119+0000 7fcbd77fe640 1 --2- 172.21.15.38:0/2862180780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbd8157980 0x7fcbd815eb10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8161fe0 tx=0x7fcbc802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99dfea518fa3d970 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.119+0000 7fcbd67fc640 1 -- 172.21.15.38:0/2862180780 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc802ca80 con 0x7fcbd8157980 2023-12-22T08:42:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.119+0000 7fcbd67fc640 1 -- 172.21.15.38:0/2862180780 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc802cbe0 con 0x7fcbd8157980 2023-12-22T08:42:36.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.119+0000 7fcbd67fc640 1 -- 172.21.15.38:0/2862180780 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80343f0 con 0x7fcbd8157980 2023-12-22T08:42:36.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.119+0000 7fcbdcf70640 1 -- 172.21.15.38:0/2862180780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbd8157980 msgr2=0x7fcbd815eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:36.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.119+0000 7fcbdcf70640 1 --2- 172.21.15.38:0/2862180780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbd8157980 0x7fcbd815eb10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8161fe0 tx=0x7fcbc802bee0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.120+0000 7fcbdcf70640 1 -- 172.21.15.38:0/2862180780 shutdown_connections 2023-12-22T08:42:36.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.120+0000 7fcbdcf70640 1 --2- 172.21.15.38:0/2862180780 >> v2:172.21.15.89:3300/0 conn(0x7fcbd80b4470 0x7fcbd806d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.120+0000 7fcbdcf70640 1 --2- 172.21.15.38:0/2862180780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbd80b3ff0 0x7fcbd806cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.120+0000 7fcbdcf70640 1 --2- 172.21.15.38:0/2862180780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbd8157980 0x7fcbd815eb10 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.120+0000 7fcbdcf70640 1 -- 172.21.15.38:0/2862180780 >> 172.21.15.38:0/2862180780 conn(0x7fcbd80d31f0 msgr2=0x7fcbd80d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:36.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.120+0000 7fcbdcf70640 1 -- 172.21.15.38:0/2862180780 shutdown_connections 2023-12-22T08:42:36.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.120+0000 7fcbdcf70640 1 -- 172.21.15.38:0/2862180780 wait complete. 2023-12-22T08:42:36.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.122+0000 7fcbdcf70640 1 Processor -- start 2023-12-22T08:42:36.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.122+0000 7fcbdcf70640 1 -- start start 2023-12-22T08:42:36.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbdcf70640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbd80b3ff0 0x7fcbd8159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:36.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbdcf70640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbd80b4470 0x7fcbd814cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:36.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbdcf70640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbd8157980 0x7fcbd815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:36.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbdcf70640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd814d2d0 con 0x7fcbd8157980 2023-12-22T08:42:36.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbdcf70640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd815aaf0 con 0x7fcbd80b4470 2023-12-22T08:42:36.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbdcf70640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd8159ee0 con 0x7fcbd80b3ff0 2023-12-22T08:42:36.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbd7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbd8157980 0x7fcbd815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:36.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbd7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbd8157980 0x7fcbd815c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34144/0 (socket says 172.21.15.38:34144) 2023-12-22T08:42:36.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbd7fff640 1 -- 172.21.15.38:0/350242255 learned_addr learned my addr 172.21.15.38:0/350242255 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:36.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbd6ffd640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbd80b4470 0x7fcbd814cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:36.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbd77fe640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbd80b3ff0 0x7fcbd8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:36.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbd7fff640 1 -- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbd80b3ff0 msgr2=0x7fcbd8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:36.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbd7fff640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbd80b3ff0 0x7fcbd8159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbd7fff640 1 -- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbd80b4470 msgr2=0x7fcbd814cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:36.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbd7fff640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbd80b4470 0x7fcbd814cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbd7fff640 1 -- 172.21.15.38:0/350242255 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc8009b30 con 0x7fcbd8157980 2023-12-22T08:42:36.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.123+0000 7fcbd6ffd640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbd80b4470 0x7fcbd814cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:36.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.124+0000 7fcbd7fff640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbd8157980 0x7fcbd815c580 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000d830 tx=0x7fcbd000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:36.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.124+0000 7fcbcffff640 1 -- 172.21.15.38:0/350242255 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000b6c0 con 0x7fcbd8157980 2023-12-22T08:42:36.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.124+0000 7fcbcffff640 1 -- 172.21.15.38:0/350242255 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd000b840 con 0x7fcbd8157980 2023-12-22T08:42:36.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.124+0000 7fcbdcf70640 1 -- 172.21.15.38:0/350242255 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd815a1c0 con 0x7fcbd8157980 2023-12-22T08:42:36.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.124+0000 7fcbcffff640 1 -- 172.21.15.38:0/350242255 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000bbf0 con 0x7fcbd8157980 2023-12-22T08:42:36.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.124+0000 7fcbdcf70640 1 -- 172.21.15.38:0/350242255 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd815a780 con 0x7fcbd8157980 2023-12-22T08:42:36.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.125+0000 7fcbdcf70640 1 -- 172.21.15.38:0/350242255 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd815af60 con 0x7fcbd8157980 2023-12-22T08:42:36.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.126+0000 7fcbcffff640 1 -- 172.21.15.38:0/350242255 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcbd001e460 con 0x7fcbd8157980 2023-12-22T08:42:36.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.127+0000 7fcbcffff640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcbb806a430 0x7fcbb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:36.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.127+0000 7fcbcffff640 1 -- 172.21.15.38:0/350242255 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbd0089160 con 0x7fcbd8157980 2023-12-22T08:42:36.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.128+0000 7fcbd77fe640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcbb806a430 0x7fcbb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:36.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.129+0000 7fcbd77fe640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcbb806a430 0x7fcbb806c8f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8035000 tx=0x7fcbc8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:36.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.131+0000 7fcbcffff640 1 -- 172.21.15.38:0/350242255 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcbd00546b0 con 0x7fcbd8157980 2023-12-22T08:42:36.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.328+0000 7fcbdcf70640 1 -- 172.21.15.38:0/350242255 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcbd8061910 con 0x7fcbd8157980 2023-12-22T08:42:36.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.332+0000 7fcbcffff640 1 -- 172.21.15.38:0/350242255 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v59) v1 ==== 81+0+33428 (secure 0 0 0) 0x7fcbd0057cd0 con 0x7fcbd8157980 2023-12-22T08:42:36.335 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:36.335 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:42:36.335 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 59, 2023-12-22T08:42:36.335 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:42:36.335 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:42:36.335 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:42:33.327912+0000", 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:42:36.336 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 7, 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:36.337 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:36.338 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:36.339 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:36.339 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:36.339 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:36.339 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:36.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.339 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "59", 2023-12-22T08:42:36.339 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:36.339 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:36.339 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:36.339 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:36.339 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:36.339 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:36.339 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:36.340 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:36.341 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:36.342 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:36.342 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:36.342 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:42:36.342 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:42:36.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.342 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:36.342 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:42:36.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 6, 2023-12-22T08:42:36.343 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:42:36.344 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:58.840533+0000", 2023-12-22T08:42:36.344 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:42:36.344 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:42:36.344 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:36.344 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:36.344 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:36.344 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:36.344 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:36.344 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:36.344 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:36.344 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:36.344 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:36.345 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:36.345 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:42:36.345 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:42:36.345 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:42:36.345 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:42:36.345 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:42:36.345 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:36.345 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:36.345 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:36.345 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:36.345 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:36.345 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:36.346 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:36.346 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.346 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "59", 2023-12-22T08:42:36.346 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:36.346 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:36.346 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:36.346 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:36.346 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:36.346 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:36.346 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:36.346 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:36.347 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:36.347 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:36.347 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:36.347 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:36.347 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:36.347 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:36.347 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:36.347 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:36.347 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:36.347 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:36.348 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:36.348 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:36.348 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:36.348 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:36.348 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:36.348 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:36.348 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:36.348 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:36.348 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.348 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:36.348 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:36.349 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:36.349 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:36.349 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:36.349 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:36.349 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:36.349 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:36.349 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:36.349 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:36.349 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:36.349 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:36.349 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:42:36.349 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:42:36.349 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:36.350 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 7, 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:41:59.953505+0000", 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:42:36.351 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:42:36.352 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:42:36.352 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:42:36.352 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:42:36.352 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:42:36.352 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:42:36.352 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:42:36.352 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:42:36.352 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:42:36.352 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:42:36.352 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:42:36.352 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:42:36.352 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:42:36.353 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:42:36.353 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:42:36.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.353 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "59", 2023-12-22T08:42:36.353 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:42:36.353 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:42:36.353 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:42:36.353 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:42:36.353 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:42:36.353 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:42:36.354 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:42:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.75, 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.75, 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:42:36.356 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.75, 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.75, 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:36.357 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.358 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.359 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:42:36.360 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:42:36.361 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:36.362 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:36.363 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:36.363 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:36.363 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:36.363 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:36.363 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:36.363 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:36.363 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:36.363 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:36.363 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.364 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.365 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:36.368 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.368 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.368 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.368 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.369 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:36.370 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:36.371 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.372 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:36.373 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.373 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.373 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.373 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:42:36.373 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:36.373 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.373 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.373 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.373 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:42:36.374 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:36.374 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.374 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.374 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.374 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:36.374 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.374 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.374 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.374 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:42:36.374 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:36.374 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.374 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.374 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.375 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.376 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.377 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.378 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:42:36.379 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:36.380 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:36.381 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:36.382 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.383 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.384 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:42:36.384 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:36.384 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:36.385 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.386 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.386 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.386 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:42:36.386 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:36.386 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.386 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.386 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.386 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:36.386 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.386 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.386 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.386 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:36.387 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:36.388 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.389 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.390 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.391 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:42:36.392 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:36.393 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:36.394 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:36.394 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:36.394 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:36.394 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:36.394 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:36.394 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.394 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.394 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.395 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:42:36.396 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:36.397 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:36.398 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 46, 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:42:36.399 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:42:36.400 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.401 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.402 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:42:36.403 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:36.404 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.405 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.405 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:42:36.405 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:36.405 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:36.405 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:36.405 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:36.405 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:36.405 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:42:36.406 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:36.407 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:42:36.408 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:42:36.409 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:42:36.410 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:42:36.411 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:42:36.412 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:42:36.412 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:42:36.412 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:42:36.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.335+0000 7fcbdcf70640 1 -- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcbb806a430 msgr2=0x7fcbb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:36.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.335+0000 7fcbdcf70640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcbb806a430 0x7fcbb806c8f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8035000 tx=0x7fcbc8030000 comp rx=0 tx=0).stop 2023-12-22T08:42:36.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.335+0000 7fcbdcf70640 1 -- 172.21.15.38:0/350242255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbd8157980 msgr2=0x7fcbd815c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:36.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.335+0000 7fcbdcf70640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbd8157980 0x7fcbd815c580 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000d830 tx=0x7fcbd000dcf0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.335+0000 7fcbdcf70640 1 -- 172.21.15.38:0/350242255 shutdown_connections 2023-12-22T08:42:36.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.335+0000 7fcbdcf70640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcbb806a430 0x7fcbb806c8f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.335+0000 7fcbdcf70640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcbd8157980 0x7fcbd815c580 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.335+0000 7fcbdcf70640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcbd80b4470 0x7fcbd814cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.335+0000 7fcbdcf70640 1 --2- 172.21.15.38:0/350242255 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcbd80b3ff0 0x7fcbd8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.335+0000 7fcbdcf70640 1 -- 172.21.15.38:0/350242255 >> 172.21.15.38:0/350242255 conn(0x7fcbd80d31f0 msgr2=0x7fcbd80b7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:36.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.335+0000 7fcbdcf70640 1 -- 172.21.15.38:0/350242255 shutdown_connections 2023-12-22T08:42:36.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.335+0000 7fcbdcf70640 1 -- 172.21.15.38:0/350242255 wait complete. 2023-12-22T08:42:36.415 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:42:36.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.643+0000 7f21a4739640 1 Processor -- start 2023-12-22T08:42:36.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.643+0000 7f21a4739640 1 -- start start 2023-12-22T08:42:36.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.645+0000 7f21a4739640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f219c071ea0 0x7f219c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:36.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.645+0000 7f21a4739640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219c0ac8e0 con 0x7f219c15d470 2023-12-22T08:42:36.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.645+0000 7f21a4739640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219c0b4940 con 0x7f219c15d850 2023-12-22T08:42:36.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.645+0000 7f21a4739640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0ada40 con 0x7f219c071ea0 2023-12-22T08:42:36.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.645+0000 7f21a24d5640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f219c15d470 0x7f219c0b4010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49780/0 (socket says 172.21.15.38:49780) 2023-12-22T08:42:36.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.645+0000 7f21a24d5640 1 -- 172.21.15.38:0/3566794675 learned_addr learned my addr 172.21.15.38:0/3566794675 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:36.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.646+0000 7f21a2cd6640 1 --2- 172.21.15.38:0/3566794675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f219c071ea0 0x7f219c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:36.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.646+0000 7f21a14d3640 1 -- 172.21.15.38:0/3566794675 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805879162 0 0) 0x7f219c0ac8e0 con 0x7f219c15d470 2023-12-22T08:42:36.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.646+0000 7f21a14d3640 1 -- 172.21.15.38:0/3566794675 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2188003520 con 0x7f219c15d470 2023-12-22T08:42:36.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.646+0000 7f21a14d3640 1 -- 172.21.15.38:0/3566794675 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4177743514 0 0) 0x7f2188003520 con 0x7f219c15d470 2023-12-22T08:42:36.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.646+0000 7f21a2cd6640 1 -- 172.21.15.38:0/3566794675 >> v1:172.21.15.89:6789/0 conn(0x7f219c15d850 legacy=0x7f219c0ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:36.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.646+0000 7f21a2cd6640 1 -- 172.21.15.38:0/3566794675 >> v1:172.21.15.38:6789/0 conn(0x7f219c15d470 legacy=0x7f219c0b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:36.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.646+0000 7f21a2cd6640 1 -- 172.21.15.38:0/3566794675 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c0b4c20 con 0x7f219c071ea0 2023-12-22T08:42:36.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.648+0000 7f21a2cd6640 1 --2- 172.21.15.38:0/3566794675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f219c071ea0 0x7f219c0b2050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2194009dc0 tx=0x7f219402bc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5871c0f9c6a31796 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:36.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.648+0000 7f21a14d3640 1 -- 172.21.15.38:0/3566794675 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198001670 con 0x7f219c071ea0 2023-12-22T08:42:36.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.648+0000 7f21a14d3640 1 -- 172.21.15.38:0/3566794675 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219402c770 con 0x7f219c071ea0 2023-12-22T08:42:36.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.648+0000 7f21a14d3640 1 -- 172.21.15.38:0/3566794675 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219402cb00 con 0x7f219c071ea0 2023-12-22T08:42:36.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.649+0000 7f21a4739640 1 -- 172.21.15.38:0/3566794675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f219c071ea0 msgr2=0x7f219c0b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:36.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.649+0000 7f21a4739640 1 --2- 172.21.15.38:0/3566794675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f219c071ea0 0x7f219c0b2050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2194009dc0 tx=0x7f219402bc40 comp rx=0 tx=0).stop 2023-12-22T08:42:36.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.649+0000 7f21a4739640 1 -- 172.21.15.38:0/3566794675 shutdown_connections 2023-12-22T08:42:36.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.649+0000 7f21a4739640 1 --2- 172.21.15.38:0/3566794675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f219c071ea0 0x7f219c0b2050 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.649+0000 7f21a4739640 1 -- 172.21.15.38:0/3566794675 >> 172.21.15.38:0/3566794675 conn(0x7f219c0cf070 msgr2=0x7f219c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:36.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.649+0000 7f21a4739640 1 -- 172.21.15.38:0/3566794675 shutdown_connections 2023-12-22T08:42:36.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.649+0000 7f21a4739640 1 -- 172.21.15.38:0/3566794675 wait complete. 2023-12-22T08:42:36.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.651+0000 7f21a4739640 1 Processor -- start 2023-12-22T08:42:36.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.651+0000 7f21a4739640 1 -- start start 2023-12-22T08:42:36.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.652+0000 7f21a4739640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f219c071ea0 0x7f219c15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:36.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.652+0000 7f21a4739640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c15d470 0x7f219c15c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:36.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.652+0000 7f21a4739640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f219c15d850 0x7f219c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:36.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.652+0000 7f21a4739640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c15b680 con 0x7f219c071ea0 2023-12-22T08:42:36.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.652+0000 7f21a4739640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c15dc30 con 0x7f219c15d470 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.652+0000 7f21a4739640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0ce340 con 0x7f219c15d850 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.652+0000 7f21a24d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f219c071ea0 0x7f219c15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.652+0000 7f21a24d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f219c071ea0 0x7f219c15baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34160/0 (socket says 172.21.15.38:34160) 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.652+0000 7f21a24d5640 1 -- 172.21.15.38:0/1110718652 learned_addr learned my addr 172.21.15.38:0/1110718652 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.653+0000 7f21a1cd4640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c15d470 0x7f219c15c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.653+0000 7f21a2cd6640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f219c15d850 0x7f219c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.653+0000 7f21a24d5640 1 -- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f219c15d850 msgr2=0x7f219c0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.653+0000 7f21a24d5640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f219c15d850 0x7f219c0cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.653+0000 7f21a24d5640 1 -- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c15d470 msgr2=0x7f219c15c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.653+0000 7f21a24d5640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c15d470 0x7f219c15c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.653+0000 7f21a24d5640 1 -- 172.21.15.38:0/1110718652 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2194009a70 con 0x7f219c071ea0 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.653+0000 7f21a1cd4640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c15d470 0x7f219c15c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.653+0000 7f21a24d5640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f219c071ea0 0x7f219c15baa0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f219800c750 tx=0x7f219800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.653+0000 7f2192ffd640 1 -- 172.21.15.38:0/1110718652 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21980072d0 con 0x7f219c071ea0 2023-12-22T08:42:36.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.653+0000 7f2192ffd640 1 -- 172.21.15.38:0/1110718652 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2198007430 con 0x7f219c071ea0 2023-12-22T08:42:36.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.654+0000 7f2192ffd640 1 -- 172.21.15.38:0/1110718652 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21980047e0 con 0x7f219c071ea0 2023-12-22T08:42:36.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.654+0000 7f21a4739640 1 -- 172.21.15.38:0/1110718652 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219c15de80 con 0x7f219c071ea0 2023-12-22T08:42:36.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.654+0000 7f21a4739640 1 -- 172.21.15.38:0/1110718652 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219c15e440 con 0x7f219c071ea0 2023-12-22T08:42:36.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.655+0000 7f21a4739640 1 -- 172.21.15.38:0/1110718652 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219c061910 con 0x7f219c071ea0 2023-12-22T08:42:36.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.656+0000 7f2192ffd640 1 -- 172.21.15.38:0/1110718652 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2198004940 con 0x7f219c071ea0 2023-12-22T08:42:36.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.657+0000 7f2192ffd640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f218006a430 0x7f218006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:36.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.657+0000 7f2192ffd640 1 -- 172.21.15.38:0/1110718652 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2198087d40 con 0x7f219c071ea0 2023-12-22T08:42:36.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.657+0000 7f21a1cd4640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f218006a430 0x7f218006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:36.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.658+0000 7f21a1cd4640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f218006a430 0x7f218006c8f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f218c007fd0 tx=0x7f218c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:36.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.661+0000 7f2192ffd640 1 -- 172.21.15.38:0/1110718652 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2198053290 con 0x7f219c071ea0 2023-12-22T08:42:36.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.891+0000 7f21a4739640 1 -- 172.21.15.38:0/1110718652 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f219c0b4210 con 0x7f219c071ea0 2023-12-22T08:42:36.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.892+0000 7f2192ffd640 1 -- 172.21.15.38:0/1110718652 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f2198018020 con 0x7f219c071ea0 2023-12-22T08:42:36.895 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:36.895 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2078860804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2078860804},{"type":"v1","addr":"172.21.15.38:6835","nonce":2078860804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4244510882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4244510882},{"type":"v1","addr":"172.21.15.89:6837","nonce":4244510882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3227878158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3227878158},{"type":"v1","addr":"172.21.15.38:6834","nonce":3227878158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:42:00.933947+0000","modified":"2023-12-22T08:42:03.951929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5538":{"gid":5538,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2131151279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2131151279},{"type":"v1","addr":"172.21.15.89:6836","nonce":2131151279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T08:42:36.895 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2023-12-22T08:42:36.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.895+0000 7f21a4739640 1 -- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f218006a430 msgr2=0x7f218006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:36.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.895+0000 7f21a4739640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f218006a430 0x7f218006c8f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f218c007fd0 tx=0x7f218c009040 comp rx=0 tx=0).stop 2023-12-22T08:42:36.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.895+0000 7f21a4739640 1 -- 172.21.15.38:0/1110718652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f219c071ea0 msgr2=0x7f219c15baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:36.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.895+0000 7f21a4739640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f219c071ea0 0x7f219c15baa0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f219800c750 tx=0x7f219800cc10 comp rx=0 tx=0).stop 2023-12-22T08:42:36.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.895+0000 7f21a4739640 1 -- 172.21.15.38:0/1110718652 shutdown_connections 2023-12-22T08:42:36.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.895+0000 7f21a4739640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f219c15d850 0x7f219c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.895+0000 7f21a4739640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f219c15d470 0x7f219c15c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.895+0000 7f21a4739640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f218006a430 0x7f218006c8f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.895+0000 7f21a4739640 1 --2- 172.21.15.38:0/1110718652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f219c071ea0 0x7f219c15baa0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:36.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.895+0000 7f21a4739640 1 -- 172.21.15.38:0/1110718652 >> 172.21.15.38:0/1110718652 conn(0x7f219c0cf070 msgr2=0x7f219c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:36.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.895+0000 7f21a4739640 1 -- 172.21.15.38:0/1110718652 shutdown_connections 2023-12-22T08:42:36.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:36.895+0000 7f21a4739640 1 -- 172.21.15.38:0/1110718652 wait complete. 2023-12-22T08:42:36.916 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-22T08:42:37.156 INFO:teuthology.orchestra.run.smithi089.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":5538,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":36.198792730999998,"mdsmap_epoch":23,"osdmap_epoch":59,"osdmap_epoch_barrier":52,"uptime":41.790585108000002} 2023-12-22T08:42:37.156 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 5538, "mdsmap_epoch": 23, "osdmap_epoch": 59, "osdmap_epoch_barrier": 52, "rank_uptime": 36.198792731, "state": "up:active", "uptime": 41.790585108, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:42:37.156 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-22T08:42:37.156 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:42:37.156 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:37.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:37.222 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-22T08:42:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records in 2023-12-22T08:42:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records out 2023-12-22T08:42:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.418057 s, 125 MB/s 2023-12-22T08:42:37.702 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:42:37.703 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:42:37.801 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:42:37.924 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:42:37.924 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:42:37.924 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:37.988 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:42:37.988 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:38.047 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:42:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.272+0000 7fad0c8da640 1 Processor -- start 2023-12-22T08:42:38.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.272+0000 7fad0c8da640 1 -- start start 2023-12-22T08:42:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.274+0000 7fad0c8da640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fad08071680 0x7fad08162f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.274+0000 7fad0c8da640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fad080b2a90 0x7fad080ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.274+0000 7fad0c8da640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad080cb1d0 con 0x7fad080cadc0 2023-12-22T08:42:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.274+0000 7fad0c8da640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad08162ce0 con 0x7fad08071680 2023-12-22T08:42:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.274+0000 7fad0c8da640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad080b2f40 con 0x7fad080b2a90 2023-12-22T08:42:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.274+0000 7fad06d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fad08071680 0x7fad08162f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.274+0000 7fad06d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fad08071680 0x7fad08162f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34172/0 (socket says 172.21.15.38:34172) 2023-12-22T08:42:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.274+0000 7fad06d9d640 1 -- 172.21.15.38:0/1523544761 learned_addr learned my addr 172.21.15.38:0/1523544761 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.275+0000 7fad0659c640 1 --2- 172.21.15.38:0/1523544761 >> v2:172.21.15.89:3300/0 conn(0x7fad080b2a90 0x7fad080ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.275+0000 7fad06d9d640 1 -- 172.21.15.38:0/1523544761 >> v2:172.21.15.89:3300/0 conn(0x7fad080b2a90 msgr2=0x7fad080ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.275+0000 7fad06d9d640 1 --2- 172.21.15.38:0/1523544761 >> v2:172.21.15.89:3300/0 conn(0x7fad080b2a90 0x7fad080ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.275+0000 7fad06d9d640 1 -- 172.21.15.38:0/1523544761 >> v1:172.21.15.38:6789/0 conn(0x7fad080cadc0 legacy=0x7fad0806d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.275+0000 7fad06d9d640 1 -- 172.21.15.38:0/1523544761 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad08162160 con 0x7fad08071680 2023-12-22T08:42:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.275+0000 7fad05d9b640 1 -- 172.21.15.38:0/1523544761 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410334450 0 0) 0x7fad080cb1d0 con 0x7fad080cadc0 2023-12-22T08:42:38.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.277+0000 7fad06d9d640 1 --2- 172.21.15.38:0/1523544761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad08071680 0x7fad08162f20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fad0804e330 tx=0x7facf802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d92e28f1690d3d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:38.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.277+0000 7fad05d9b640 1 -- 172.21.15.38:0/1523544761 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8030860 con 0x7fad08071680 2023-12-22T08:42:38.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.277+0000 7fad05d9b640 1 -- 172.21.15.38:0/1523544761 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf80309c0 con 0x7fad08071680 2023-12-22T08:42:38.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.277+0000 7fad05d9b640 1 -- 172.21.15.38:0/1523544761 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8030d50 con 0x7fad08071680 2023-12-22T08:42:38.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.278+0000 7fad0c8da640 1 -- 172.21.15.38:0/1523544761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad08071680 msgr2=0x7fad08162f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:38.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.278+0000 7fad0c8da640 1 --2- 172.21.15.38:0/1523544761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad08071680 0x7fad08162f20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fad0804e330 tx=0x7facf802b9a0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.278+0000 7fad0c8da640 1 -- 172.21.15.38:0/1523544761 shutdown_connections 2023-12-22T08:42:38.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.278+0000 7fad0c8da640 1 --2- 172.21.15.38:0/1523544761 >> v2:172.21.15.89:3300/0 conn(0x7fad080b2a90 0x7fad080ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.278+0000 7fad0c8da640 1 --2- 172.21.15.38:0/1523544761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad08071680 0x7fad08162f20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.278+0000 7fad0c8da640 1 -- 172.21.15.38:0/1523544761 >> 172.21.15.38:0/1523544761 conn(0x7fad080b1f70 msgr2=0x7fad080b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:38.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.278+0000 7fad0c8da640 1 -- 172.21.15.38:0/1523544761 shutdown_connections 2023-12-22T08:42:38.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.278+0000 7fad0c8da640 1 -- 172.21.15.38:0/1523544761 wait complete. 2023-12-22T08:42:38.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.280+0000 7fad0c8da640 1 Processor -- start 2023-12-22T08:42:38.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.281+0000 7fad0c8da640 1 -- start start 2023-12-22T08:42:38.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.282+0000 7fad0c8da640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad08071680 0x7fad08158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.282+0000 7fad0c8da640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad080b2a90 0x7fad080cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.282+0000 7fad0c8da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad080cadc0 0x7fad080af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.282+0000 7fad0c8da640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad08099ae0 con 0x7fad08071680 2023-12-22T08:42:38.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.282+0000 7fad0c8da640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad081598e0 con 0x7fad080cadc0 2023-12-22T08:42:38.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.282+0000 7fad0c8da640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad08159b30 con 0x7fad080b2a90 2023-12-22T08:42:38.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.282+0000 7fad06d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad08071680 0x7fad08158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.282+0000 7fad06d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad08071680 0x7fad08158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34174/0 (socket says 172.21.15.38:34174) 2023-12-22T08:42:38.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.282+0000 7fad06d9d640 1 -- 172.21.15.38:0/3227129452 learned_addr learned my addr 172.21.15.38:0/3227129452 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:38.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.283+0000 7fad0659c640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad080b2a90 0x7fad080cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.283+0000 7fad0759e640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad080cadc0 0x7fad080af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.283+0000 7fad06d9d640 1 -- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad080b2a90 msgr2=0x7fad080cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:38.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.283+0000 7fad06d9d640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad080b2a90 0x7fad080cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.283+0000 7fad06d9d640 1 -- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad080cadc0 msgr2=0x7fad080af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:38.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.283+0000 7fad06d9d640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad080cadc0 0x7fad080af6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.283+0000 7fad06d9d640 1 -- 172.21.15.38:0/3227129452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf80094d0 con 0x7fad08071680 2023-12-22T08:42:38.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.283+0000 7fad0659c640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad080b2a90 0x7fad080cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:38.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.283+0000 7fad06d9d640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad08071680 0x7fad08158650 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7facf802b9e0 tx=0x7facf8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:38.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.284+0000 7facef7fe640 1 -- 172.21.15.38:0/3227129452 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8039d60 con 0x7fad08071680 2023-12-22T08:42:38.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.284+0000 7facef7fe640 1 -- 172.21.15.38:0/3227129452 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf8043400 con 0x7fad08071680 2023-12-22T08:42:38.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.284+0000 7facef7fe640 1 -- 172.21.15.38:0/3227129452 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf80437b0 con 0x7fad08071680 2023-12-22T08:42:38.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.284+0000 7fad0c8da640 1 -- 172.21.15.38:0/3227129452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad08159e10 con 0x7fad08071680 2023-12-22T08:42:38.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.284+0000 7fad0c8da640 1 -- 172.21.15.38:0/3227129452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0815a3d0 con 0x7fad08071680 2023-12-22T08:42:38.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.285+0000 7fad0c8da640 1 -- 172.21.15.38:0/3227129452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad08061910 con 0x7fad08071680 2023-12-22T08:42:38.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.287+0000 7facef7fe640 1 -- 172.21.15.38:0/3227129452 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7facf8043910 con 0x7fad08071680 2023-12-22T08:42:38.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.288+0000 7facef7fe640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7facf406a430 0x7facf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.288+0000 7facef7fe640 1 -- 172.21.15.38:0/3227129452 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facf803e070 con 0x7fad08071680 2023-12-22T08:42:38.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.288+0000 7fad0659c640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7facf406a430 0x7facf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.289+0000 7fad0659c640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7facf406a430 0x7facf406c8f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fad080cd170 tx=0x7facfc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:38.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.293+0000 7facef7fe640 1 -- 172.21.15.38:0/3227129452 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7facf8077080 con 0x7fad08071680 2023-12-22T08:42:38.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.489+0000 7fad0c8da640 1 -- 172.21.15.38:0/3227129452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad08070a70 con 0x7fad08071680 2023-12-22T08:42:38.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.492+0000 7facef7fe640 1 -- 172.21.15.38:0/3227129452 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+15993 (secure 0 0 0) 0x7facf8034090 con 0x7fad08071680 2023-12-22T08:42:38.494 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:38.494 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":59,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:42:33.327912+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:58.840533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:59.953505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:42:38.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.495+0000 7fad0c8da640 1 -- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7facf406a430 msgr2=0x7facf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:38.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.495+0000 7fad0c8da640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7facf406a430 0x7facf406c8f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fad080cd170 tx=0x7facfc008040 comp rx=0 tx=0).stop 2023-12-22T08:42:38.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.495+0000 7fad0c8da640 1 -- 172.21.15.38:0/3227129452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad08071680 msgr2=0x7fad08158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:38.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.495+0000 7fad0c8da640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad08071680 0x7fad08158650 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7facf802b9e0 tx=0x7facf8004730 comp rx=0 tx=0).stop 2023-12-22T08:42:38.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.495+0000 7fad0c8da640 1 -- 172.21.15.38:0/3227129452 shutdown_connections 2023-12-22T08:42:38.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.495+0000 7fad0c8da640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad080cadc0 0x7fad080af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.495+0000 7fad0c8da640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad080b2a90 0x7fad080cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.495+0000 7fad0c8da640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7facf406a430 0x7facf406c8f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.495+0000 7fad0c8da640 1 --2- 172.21.15.38:0/3227129452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad08071680 0x7fad08158650 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.495+0000 7fad0c8da640 1 -- 172.21.15.38:0/3227129452 >> 172.21.15.38:0/3227129452 conn(0x7fad080b1f70 msgr2=0x7fad08164200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:38.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.495+0000 7fad0c8da640 1 -- 172.21.15.38:0/3227129452 shutdown_connections 2023-12-22T08:42:38.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.496+0000 7fad0c8da640 1 -- 172.21.15.38:0/3227129452 wait complete. 2023-12-22T08:42:38.518 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:41:58.840533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:41:59.953505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:42:38.518 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:42:38.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.747+0000 7f7339249640 1 Processor -- start 2023-12-22T08:42:38.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.747+0000 7f7339249640 1 -- start start 2023-12-22T08:42:38.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.749+0000 7f7339249640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7334163d50 0x7f7334166140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.749+0000 7f7339249640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f733406d5f0 con 0x7f7334070f50 2023-12-22T08:42:38.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.749+0000 7f7339249640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7334144fa0 con 0x7f7334070b70 2023-12-22T08:42:38.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.749+0000 7f7339249640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733406da80 con 0x7f7334163d50 2023-12-22T08:42:38.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.749+0000 7f732b7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7334070f50 0x7f73340713b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49802/0 (socket says 172.21.15.38:49802) 2023-12-22T08:42:38.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.749+0000 7f732b7fe640 1 -- 172.21.15.38:0/1384387779 learned_addr learned my addr 172.21.15.38:0/1384387779 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:38.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.750+0000 7f7338a48640 1 --2- 172.21.15.38:0/1384387779 >> v2:172.21.15.89:3300/0 conn(0x7f7334163d50 0x7f7334166140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.750+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399599796 0 0) 0x7f733406d5f0 con 0x7f7334070f50 2023-12-22T08:42:38.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.750+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7320003520 con 0x7f7334070f50 2023-12-22T08:42:38.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.750+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2423537421 0 0) 0x7f7320003520 con 0x7f7334070f50 2023-12-22T08:42:38.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.750+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 >> v2:172.21.15.89:3300/0 conn(0x7f7334163d50 msgr2=0x7f7334166140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:38.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.750+0000 7f73337fe640 1 --2- 172.21.15.38:0/1384387779 >> v2:172.21.15.89:3300/0 conn(0x7f7334163d50 0x7f7334166140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.750+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 >> v1:172.21.15.89:6789/0 conn(0x7f7334070b70 legacy=0x7f733406bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:38.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.750+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733406c9e0 con 0x7f7334070f50 2023-12-22T08:42:38.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.750+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f731c001670 con 0x7f7334070f50 2023-12-22T08:42:38.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.750+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 >> v1:172.21.15.38:6789/0 conn(0x7f7334070f50 legacy=0x7f73340713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:38.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.750+0000 7f73337fe640 1 --2- 172.21.15.38:0/1384387779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73200039c0 0x7f7320003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.750+0000 7f73337fe640 1 --2- 172.21.15.38:0/1384387779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73200047c0 0x7f7320004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.751+0000 7f73337fe640 1 --2- 172.21.15.38:0/1384387779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7320005180 0x7f732000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.751+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733406da80 con 0x7f7320005180 2023-12-22T08:42:38.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.751+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732000c080 con 0x7f73200047c0 2023-12-22T08:42:38.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.751+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732000c240 con 0x7f73200039c0 2023-12-22T08:42:38.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.751+0000 7f7338a48640 1 --2- 172.21.15.38:0/1384387779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7320005180 0x7f732000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.751+0000 7f732b7fe640 1 --2- 172.21.15.38:0/1384387779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73200047c0 0x7f7320004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.751+0000 7f7333fff640 1 --2- 172.21.15.38:0/1384387779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73200039c0 0x7f7320003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.751+0000 7f7338a48640 1 -- 172.21.15.38:0/1384387779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73200039c0 msgr2=0x7f7320003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:38.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.751+0000 7f7338a48640 1 --2- 172.21.15.38:0/1384387779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73200039c0 0x7f7320003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.751+0000 7f7338a48640 1 -- 172.21.15.38:0/1384387779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73200047c0 msgr2=0x7f7320004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:38.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.751+0000 7f7338a48640 1 --2- 172.21.15.38:0/1384387779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73200047c0 0x7f7320004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.751+0000 7f7338a48640 1 -- 172.21.15.38:0/1384387779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320003520 con 0x7f7320005180 2023-12-22T08:42:38.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.752+0000 7f7338a48640 1 -- 172.21.15.38:0/1384387779 reap_dead start 2023-12-22T08:42:38.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.753+0000 7f7338a48640 1 --2- 172.21.15.38:0/1384387779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7320005180 0x7f732000b980 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f732c009a90 tx=0x7f73200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef45cecde304f91e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:38.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.753+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c02c6b0 con 0x7f7320005180 2023-12-22T08:42:38.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.753+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c02c810 con 0x7f7320005180 2023-12-22T08:42:38.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.753+0000 7f73337fe640 1 -- 172.21.15.38:0/1384387779 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c02cbc0 con 0x7f7320005180 2023-12-22T08:42:38.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.753+0000 7f7339249640 1 -- 172.21.15.38:0/1384387779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7320005180 msgr2=0x7f732000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:38.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.753+0000 7f7339249640 1 --2- 172.21.15.38:0/1384387779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7320005180 0x7f732000b980 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f732c009a90 tx=0x7f73200057f0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.754+0000 7f7339249640 1 -- 172.21.15.38:0/1384387779 shutdown_connections 2023-12-22T08:42:38.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.754+0000 7f7339249640 1 --2- 172.21.15.38:0/1384387779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7320005180 0x7f732000b980 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.754+0000 7f7339249640 1 -- 172.21.15.38:0/1384387779 >> 172.21.15.38:0/1384387779 conn(0x7f73340b0b60 msgr2=0x7f73340b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:38.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.754+0000 7f7339249640 1 -- 172.21.15.38:0/1384387779 shutdown_connections 2023-12-22T08:42:38.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.754+0000 7f7339249640 1 -- 172.21.15.38:0/1384387779 wait complete. 2023-12-22T08:42:38.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.756+0000 7f7339249640 1 Processor -- start 2023-12-22T08:42:38.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.756+0000 7f7339249640 1 -- start start 2023-12-22T08:42:38.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7339249640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7320005180 0x7f73340cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7339249640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73341594c0 0x7f7334159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7339249640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73340aeb20 0x7f73340aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7339249640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7334159e80 con 0x7f73340aeb20 2023-12-22T08:42:38.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7339249640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73340af850 con 0x7f73341594c0 2023-12-22T08:42:38.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7339249640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73340afb30 con 0x7f7320005180 2023-12-22T08:42:38.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7338a48640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73340aeb20 0x7f73340aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7338a48640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73340aeb20 0x7f73340aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34188/0 (socket says 172.21.15.38:34188) 2023-12-22T08:42:38.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7338a48640 1 -- 172.21.15.38:0/2610667837 learned_addr learned my addr 172.21.15.38:0/2610667837 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:38.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7333fff640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7320005180 0x7f73340cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f732b7fe640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73341594c0 0x7f7334159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7338a48640 1 -- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7320005180 msgr2=0x7f73340cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:38.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7338a48640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7320005180 0x7f73340cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7338a48640 1 -- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73341594c0 msgr2=0x7f7334159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:38.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7338a48640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73341594c0 0x7f7334159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f7338a48640 1 -- 172.21.15.38:0/2610667837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73340afe10 con 0x7f73340aeb20 2023-12-22T08:42:38.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.757+0000 7f732b7fe640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73341594c0 0x7f7334159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:38.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.758+0000 7f7338a48640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73340aeb20 0x7f73340aef80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f732c009a90 tx=0x7f732c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:38.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.758+0000 7f73317fa640 1 -- 172.21.15.38:0/2610667837 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c035b10 con 0x7f73340aeb20 2023-12-22T08:42:38.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.758+0000 7f73317fa640 1 -- 172.21.15.38:0/2610667837 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c035c70 con 0x7f73340aeb20 2023-12-22T08:42:38.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.758+0000 7f73317fa640 1 -- 172.21.15.38:0/2610667837 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c02ce20 con 0x7f73340aeb20 2023-12-22T08:42:38.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.758+0000 7f7339249640 1 -- 172.21.15.38:0/2610667837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733415a770 con 0x7f73340aeb20 2023-12-22T08:42:38.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.758+0000 7f7339249640 1 -- 172.21.15.38:0/2610667837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73340af4c0 con 0x7f73340aeb20 2023-12-22T08:42:38.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.760+0000 7f7339249640 1 -- 172.21.15.38:0/2610667837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733415ac90 con 0x7f73340aeb20 2023-12-22T08:42:38.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.760+0000 7f73317fa640 1 -- 172.21.15.38:0/2610667837 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f732c03b040 con 0x7f73340aeb20 2023-12-22T08:42:38.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.761+0000 7f73317fa640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f731406a460 0x7f731406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:38.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.761+0000 7f73317fa640 1 -- 172.21.15.38:0/2610667837 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f732c0aa320 con 0x7f73340aeb20 2023-12-22T08:42:38.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.762+0000 7f7333fff640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f731406a460 0x7f731406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:38.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.763+0000 7f7333fff640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f731406a460 0x7f731406c920 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7324007fd0 tx=0x7f7324009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:38.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.766+0000 7f73317fa640 1 -- 172.21.15.38:0/2610667837 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f733415ac90 con 0x7f73340aeb20 2023-12-22T08:42:38.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.960+0000 7f7339249640 1 -- 172.21.15.38:0/2610667837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f733415ac90 con 0x7f73340aeb20 2023-12-22T08:42:38.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.960+0000 7f73317fa640 1 -- 172.21.15.38:0/2610667837 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f733415ac90 con 0x7f73340aeb20 2023-12-22T08:42:38.963 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:42:38.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.963+0000 7f7339249640 1 -- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f731406a460 msgr2=0x7f731406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:38.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.963+0000 7f7339249640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f731406a460 0x7f731406c920 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7324007fd0 tx=0x7f7324009040 comp rx=0 tx=0).stop 2023-12-22T08:42:38.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.963+0000 7f7339249640 1 -- 172.21.15.38:0/2610667837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73340aeb20 msgr2=0x7f73340aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:38.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.963+0000 7f7339249640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73340aeb20 0x7f73340aef80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f732c009a90 tx=0x7f732c004730 comp rx=0 tx=0).stop 2023-12-22T08:42:38.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.963+0000 7f7339249640 1 -- 172.21.15.38:0/2610667837 shutdown_connections 2023-12-22T08:42:38.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.963+0000 7f7339249640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f731406a460 0x7f731406c920 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.963+0000 7f7339249640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73340aeb20 0x7f73340aef80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.963+0000 7f7339249640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73341594c0 0x7f7334159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.963+0000 7f7339249640 1 --2- 172.21.15.38:0/2610667837 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7320005180 0x7f73340cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:38.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.963+0000 7f7339249640 1 -- 172.21.15.38:0/2610667837 >> 172.21.15.38:0/2610667837 conn(0x7f73340b0b60 msgr2=0x7f7334144140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:38.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.963+0000 7f7339249640 1 -- 172.21.15.38:0/2610667837 shutdown_connections 2023-12-22T08:42:38.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:38.964+0000 7f7339249640 1 -- 172.21.15.38:0/2610667837 wait complete. 2023-12-22T08:42:38.986 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:42:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.209+0000 7f30f8ae6640 1 Processor -- start 2023-12-22T08:42:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.210+0000 7f30f8ae6640 1 -- start start 2023-12-22T08:42:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.211+0000 7f30f8ae6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f30f406dc80 0x7f30f4071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.211+0000 7f30f8ae6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30f406e060 0x7f30f40cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.211+0000 7f30f8ae6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f40ccc50 con 0x7f30f40cc6f0 2023-12-22T08:42:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.211+0000 7f30f8ae6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f4070980 con 0x7f30f406dc80 2023-12-22T08:42:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.211+0000 7f30f8ae6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f4070b90 con 0x7f30f406e060 2023-12-22T08:42:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.211+0000 7f30f37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f30f406dc80 0x7f30f4071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.211+0000 7f30f3fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f30f40cc6f0 0x7f30f409ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49808/0 (socket says 172.21.15.38:49808) 2023-12-22T08:42:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.211+0000 7f30f3fff640 1 -- 172.21.15.38:0/511393983 learned_addr learned my addr 172.21.15.38:0/511393983 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.212+0000 7f30f37fe640 1 -- 172.21.15.38:0/511393983 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30f406e060 msgr2=0x7f30f40cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.212+0000 7f30f37fe640 1 --2- 172.21.15.38:0/511393983 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30f406e060 0x7f30f40cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.212+0000 7f30f37fe640 1 -- 172.21.15.38:0/511393983 >> v1:172.21.15.38:6789/0 conn(0x7f30f40cc6f0 legacy=0x7f30f409ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.212+0000 7f30f37fe640 1 -- 172.21.15.38:0/511393983 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4070e70 con 0x7f30f406dc80 2023-12-22T08:42:39.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.213+0000 7f30f37fe640 1 --2- 172.21.15.38:0/511393983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30f406dc80 0x7f30f4071670 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f30e40097a0 tx=0x7f30e402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562374558ac8c02b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:39.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.213+0000 7f30f27fc640 1 -- 172.21.15.38:0/511393983 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e402d040 con 0x7f30f406dc80 2023-12-22T08:42:39.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.213+0000 7f30f27fc640 1 -- 172.21.15.38:0/511393983 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e4031810 con 0x7f30f406dc80 2023-12-22T08:42:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.213+0000 7f30f27fc640 1 -- 172.21.15.38:0/511393983 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4031ba0 con 0x7f30f406dc80 2023-12-22T08:42:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.214+0000 7f30f8ae6640 1 -- 172.21.15.38:0/511393983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30f406dc80 msgr2=0x7f30f4071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.214+0000 7f30f8ae6640 1 --2- 172.21.15.38:0/511393983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30f406dc80 0x7f30f4071670 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f30e40097a0 tx=0x7f30e402b8b0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.214+0000 7f30f8ae6640 1 -- 172.21.15.38:0/511393983 shutdown_connections 2023-12-22T08:42:39.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.214+0000 7f30f8ae6640 1 --2- 172.21.15.38:0/511393983 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30f406e060 0x7f30f40cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.214+0000 7f30f8ae6640 1 --2- 172.21.15.38:0/511393983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30f406dc80 0x7f30f4071670 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.214+0000 7f30f8ae6640 1 -- 172.21.15.38:0/511393983 >> 172.21.15.38:0/511393983 conn(0x7f30f40cf000 msgr2=0x7f30f40cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:39.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.214+0000 7f30f8ae6640 1 -- 172.21.15.38:0/511393983 shutdown_connections 2023-12-22T08:42:39.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.214+0000 7f30f8ae6640 1 -- 172.21.15.38:0/511393983 wait complete. 2023-12-22T08:42:39.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.216+0000 7f30f8ae6640 1 Processor -- start 2023-12-22T08:42:39.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.216+0000 7f30f8ae6640 1 -- start start 2023-12-22T08:42:39.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.217+0000 7f30f8ae6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30f406dc80 0x7f30f4150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:39.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.217+0000 7f30f8ae6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30f406e060 0x7f30f409c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:39.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.217+0000 7f30f8ae6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30f40cc6f0 0x7f30f414cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:39.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.217+0000 7f30f8ae6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f409bec0 con 0x7f30f406e060 2023-12-22T08:42:39.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.217+0000 7f30f8ae6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f409b240 con 0x7f30f40cc6f0 2023-12-22T08:42:39.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.217+0000 7f30f8ae6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f409b520 con 0x7f30f406dc80 2023-12-22T08:42:39.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.217+0000 7f30f2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30f406e060 0x7f30f409c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:39.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.217+0000 7f30f2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30f406e060 0x7f30f409c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34210/0 (socket says 172.21.15.38:34210) 2023-12-22T08:42:39.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.217+0000 7f30f2ffd640 1 -- 172.21.15.38:0/1679559204 learned_addr learned my addr 172.21.15.38:0/1679559204 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:39.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.218+0000 7f30f3fff640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30f40cc6f0 0x7f30f414cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:39.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.218+0000 7f30f37fe640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30f406dc80 0x7f30f4150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:39.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.218+0000 7f30f2ffd640 1 -- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30f406dc80 msgr2=0x7f30f4150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:39.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.218+0000 7f30f2ffd640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30f406dc80 0x7f30f4150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.218+0000 7f30f2ffd640 1 -- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30f40cc6f0 msgr2=0x7f30f414cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:39.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.218+0000 7f30f2ffd640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30f40cc6f0 0x7f30f414cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.218+0000 7f30f2ffd640 1 -- 172.21.15.38:0/1679559204 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e4009400 con 0x7f30f406e060 2023-12-22T08:42:39.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.218+0000 7f30f2ffd640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30f406e060 0x7f30f409c2e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f30e800b4a0 tx=0x7f30e800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:39.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.218+0000 7f30dbfff640 1 -- 172.21.15.38:0/1679559204 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8010610 con 0x7f30f406e060 2023-12-22T08:42:39.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.219+0000 7f30dbfff640 1 -- 172.21.15.38:0/1679559204 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8010770 con 0x7f30f406e060 2023-12-22T08:42:39.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.219+0000 7f30dbfff640 1 -- 172.21.15.38:0/1679559204 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8010b20 con 0x7f30f406e060 2023-12-22T08:42:39.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.219+0000 7f30f8ae6640 1 -- 172.21.15.38:0/1679559204 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f409b800 con 0x7f30f406e060 2023-12-22T08:42:39.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.219+0000 7f30f8ae6640 1 -- 172.21.15.38:0/1679559204 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f4154950 con 0x7f30f406e060 2023-12-22T08:42:39.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.220+0000 7f30f8ae6640 1 -- 172.21.15.38:0/1679559204 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f409c000 con 0x7f30f406e060 2023-12-22T08:42:39.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.221+0000 7f30dbfff640 1 -- 172.21.15.38:0/1679559204 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f30e8010c80 con 0x7f30f406e060 2023-12-22T08:42:39.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.222+0000 7f30dbfff640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f30e006a430 0x7f30e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:39.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.222+0000 7f30dbfff640 1 -- 172.21.15.38:0/1679559204 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30e8088480 con 0x7f30f406e060 2023-12-22T08:42:39.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.222+0000 7f30f37fe640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f30e006a430 0x7f30e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:39.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.223+0000 7f30f37fe640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f30e006a430 0x7f30e006c8f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f30e4036000 tx=0x7f30e403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:39.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.226+0000 7f30dbfff640 1 -- 172.21.15.38:0/1679559204 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f30f409c000 con 0x7f30f406e060 2023-12-22T08:42:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.419+0000 7f30f8ae6640 1 -- 172.21.15.38:0/1679559204 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30f409c000 con 0x7f30f406e060 2023-12-22T08:42:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.420+0000 7f30dbfff640 1 -- 172.21.15.38:0/1679559204 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f30f409c000 con 0x7f30f406e060 2023-12-22T08:42:39.422 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:42:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.422+0000 7f30f8ae6640 1 -- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f30e006a430 msgr2=0x7f30e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.422+0000 7f30f8ae6640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f30e006a430 0x7f30e006c8f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f30e4036000 tx=0x7f30e403c040 comp rx=0 tx=0).stop 2023-12-22T08:42:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.422+0000 7f30f8ae6640 1 -- 172.21.15.38:0/1679559204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30f406e060 msgr2=0x7f30f409c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.422+0000 7f30f8ae6640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30f406e060 0x7f30f409c2e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f30e800b4a0 tx=0x7f30e800b960 comp rx=0 tx=0).stop 2023-12-22T08:42:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.423+0000 7f30f8ae6640 1 -- 172.21.15.38:0/1679559204 shutdown_connections 2023-12-22T08:42:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.423+0000 7f30f8ae6640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30f40cc6f0 0x7f30f414cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.423+0000 7f30f8ae6640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f30e006a430 0x7f30e006c8f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.423+0000 7f30f8ae6640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30f406e060 0x7f30f409c2e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.423+0000 7f30f8ae6640 1 --2- 172.21.15.38:0/1679559204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30f406dc80 0x7f30f4150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.423+0000 7f30f8ae6640 1 -- 172.21.15.38:0/1679559204 >> 172.21.15.38:0/1679559204 conn(0x7f30f40cf000 msgr2=0x7f30f40b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:39.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.423+0000 7f30f8ae6640 1 -- 172.21.15.38:0/1679559204 shutdown_connections 2023-12-22T08:42:39.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.423+0000 7f30f8ae6640 1 -- 172.21.15.38:0/1679559204 wait complete. 2023-12-22T08:42:39.446 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:42:39.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.665+0000 7f5a6eb1c640 1 Processor -- start 2023-12-22T08:42:39.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.665+0000 7f5a6eb1c640 1 -- start start 2023-12-22T08:42:39.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.667+0000 7f5a6eb1c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5a681571a0 0x7f5a680a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:39.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.667+0000 7f5a6eb1c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a680cc0d0 0x7f5a680cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:39.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.668+0000 7f5a6eb1c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a680ccb50 con 0x7f5a68070260 2023-12-22T08:42:39.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.668+0000 7f5a6eb1c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a680cce30 con 0x7f5a681571a0 2023-12-22T08:42:39.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.668+0000 7f5a6eb1c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680cd9a0 con 0x7f5a680cc0d0 2023-12-22T08:42:39.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.668+0000 7f5a6db1a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5a681571a0 0x7f5a680a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:39.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.668+0000 7f5a6db1a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5a681571a0 0x7f5a680a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34226/0 (socket says 172.21.15.38:34226) 2023-12-22T08:42:39.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.668+0000 7f5a6db1a640 1 -- 172.21.15.38:0/1459299014 learned_addr learned my addr 172.21.15.38:0/1459299014 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:39.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.668+0000 7f5a6d319640 1 --2- 172.21.15.38:0/1459299014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a680cc0d0 0x7f5a680cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:39.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.668+0000 7f5a6db1a640 1 -- 172.21.15.38:0/1459299014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a680cc0d0 msgr2=0x7f5a680cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:39.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.668+0000 7f5a6db1a640 1 --2- 172.21.15.38:0/1459299014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a680cc0d0 0x7f5a680cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.668+0000 7f5a6db1a640 1 -- 172.21.15.38:0/1459299014 >> v1:172.21.15.38:6789/0 conn(0x7f5a68070260 legacy=0x7f5a680ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:39.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.668+0000 7f5a6db1a640 1 -- 172.21.15.38:0/1459299014 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680cdc80 con 0x7f5a681571a0 2023-12-22T08:42:39.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.668+0000 7f5a6d319640 1 --2- 172.21.15.38:0/1459299014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a680cc0d0 0x7f5a680cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:39.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.670+0000 7f5a6db1a640 1 --2- 172.21.15.38:0/1459299014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a681571a0 0x7f5a680a84d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009870 tx=0x7f5a6402db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89cd5eaeecd3447b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:39.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.670+0000 7f5a6cb18640 1 -- 172.21.15.38:0/1459299014 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6402e940 con 0x7f5a681571a0 2023-12-22T08:42:39.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.670+0000 7f5a6cb18640 1 -- 172.21.15.38:0/1459299014 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6402eaa0 con 0x7f5a681571a0 2023-12-22T08:42:39.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.670+0000 7f5a6cb18640 1 -- 172.21.15.38:0/1459299014 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6402ee30 con 0x7f5a681571a0 2023-12-22T08:42:39.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.670+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/1459299014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a681571a0 msgr2=0x7f5a680a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:39.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.670+0000 7f5a6eb1c640 1 --2- 172.21.15.38:0/1459299014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a681571a0 0x7f5a680a84d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009870 tx=0x7f5a6402db90 comp rx=0 tx=0).stop 2023-12-22T08:42:39.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.671+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/1459299014 shutdown_connections 2023-12-22T08:42:39.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.671+0000 7f5a6eb1c640 1 --2- 172.21.15.38:0/1459299014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a680cc0d0 0x7f5a680cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.671+0000 7f5a6eb1c640 1 --2- 172.21.15.38:0/1459299014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a681571a0 0x7f5a680a84d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.671+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/1459299014 >> 172.21.15.38:0/1459299014 conn(0x7f5a680cf840 msgr2=0x7f5a680cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:39.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.671+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/1459299014 shutdown_connections 2023-12-22T08:42:39.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.671+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/1459299014 wait complete. 2023-12-22T08:42:39.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.673+0000 7f5a6eb1c640 1 Processor -- start 2023-12-22T08:42:39.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.673+0000 7f5a6eb1c640 1 -- start start 2023-12-22T08:42:39.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6eb1c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a68070260 0x7f5a6815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:39.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6eb1c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a680cc0d0 0x7f5a6815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:39.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6eb1c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a681571a0 0x7f5a6814a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:39.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6eb1c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a681f70c0 con 0x7f5a680cc0d0 2023-12-22T08:42:39.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6eb1c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6815a350 con 0x7f5a68070260 2023-12-22T08:42:39.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6eb1c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6815a630 con 0x7f5a681571a0 2023-12-22T08:42:39.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6d319640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a680cc0d0 0x7f5a6815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:39.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6d319640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a680cc0d0 0x7f5a6815c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34238/0 (socket says 172.21.15.38:34238) 2023-12-22T08:42:39.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6d319640 1 -- 172.21.15.38:0/2830994347 learned_addr learned my addr 172.21.15.38:0/2830994347 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:39.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6d319640 1 -- 172.21.15.38:0/2830994347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a681571a0 msgr2=0x7f5a6814a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:39.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6d319640 1 --2- 172.21.15.38:0/2830994347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a681571a0 0x7f5a6814a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6d319640 1 -- 172.21.15.38:0/2830994347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a68070260 msgr2=0x7f5a6815b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:39.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6d319640 1 --2- 172.21.15.38:0/2830994347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a68070260 0x7f5a6815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.674+0000 7f5a6d319640 1 -- 172.21.15.38:0/2830994347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a640094d0 con 0x7f5a680cc0d0 2023-12-22T08:42:39.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.675+0000 7f5a6d319640 1 --2- 172.21.15.38:0/2830994347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a680cc0d0 0x7f5a6815c240 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800c7f0 tx=0x7f5a5800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:39.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.675+0000 7f5a5e7fc640 1 -- 172.21.15.38:0/2830994347 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58007a30 con 0x7f5a680cc0d0 2023-12-22T08:42:39.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.675+0000 7f5a5e7fc640 1 -- 172.21.15.38:0/2830994347 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a58007b90 con 0x7f5a680cc0d0 2023-12-22T08:42:39.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.675+0000 7f5a5e7fc640 1 -- 172.21.15.38:0/2830994347 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800ce40 con 0x7f5a680cc0d0 2023-12-22T08:42:39.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.675+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/2830994347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6815a910 con 0x7f5a680cc0d0 2023-12-22T08:42:39.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.675+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/2830994347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6815b650 con 0x7f5a680cc0d0 2023-12-22T08:42:39.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.676+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/2830994347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a68061910 con 0x7f5a680cc0d0 2023-12-22T08:42:39.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.678+0000 7f5a5e7fc640 1 -- 172.21.15.38:0/2830994347 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5a580113f0 con 0x7f5a680cc0d0 2023-12-22T08:42:39.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.679+0000 7f5a5e7fc640 1 --2- 172.21.15.38:0/2830994347 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5a4c06a430 0x7f5a4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:39.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.679+0000 7f5a5e7fc640 1 -- 172.21.15.38:0/2830994347 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a58088ac0 con 0x7f5a680cc0d0 2023-12-22T08:42:39.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.680+0000 7f5a6db1a640 1 --2- 172.21.15.38:0/2830994347 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5a4c06a430 0x7f5a4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:39.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.681+0000 7f5a6db1a640 1 --2- 172.21.15.38:0/2830994347 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5a4c06a430 0x7f5a4c06c8f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5a64038000 tx=0x7f5a64030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:39.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.683+0000 7f5a5e7fc640 1 -- 172.21.15.38:0/2830994347 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5a580540a0 con 0x7f5a680cc0d0 2023-12-22T08:42:39.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.879+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/2830994347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a68060720 con 0x7f5a680cc0d0 2023-12-22T08:42:39.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.880+0000 7f5a5e7fc640 1 -- 172.21.15.38:0/2830994347 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a5801f0a0 con 0x7f5a680cc0d0 2023-12-22T08:42:39.883 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:42:39.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.882+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/2830994347 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5a4c06a430 msgr2=0x7f5a4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:39.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.882+0000 7f5a6eb1c640 1 --2- 172.21.15.38:0/2830994347 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5a4c06a430 0x7f5a4c06c8f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5a64038000 tx=0x7f5a64030000 comp rx=0 tx=0).stop 2023-12-22T08:42:39.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.882+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/2830994347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a680cc0d0 msgr2=0x7f5a6815c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:39.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.882+0000 7f5a6eb1c640 1 --2- 172.21.15.38:0/2830994347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a680cc0d0 0x7f5a6815c240 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800c7f0 tx=0x7f5a5800cbf0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.883+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/2830994347 shutdown_connections 2023-12-22T08:42:39.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.883+0000 7f5a6eb1c640 1 --2- 172.21.15.38:0/2830994347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a681571a0 0x7f5a6814a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.883+0000 7f5a6eb1c640 1 --2- 172.21.15.38:0/2830994347 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5a4c06a430 0x7f5a4c06c8f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.883+0000 7f5a6eb1c640 1 --2- 172.21.15.38:0/2830994347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a680cc0d0 0x7f5a6815c240 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.883+0000 7f5a6eb1c640 1 --2- 172.21.15.38:0/2830994347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a68070260 0x7f5a6815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:39.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.883+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/2830994347 >> 172.21.15.38:0/2830994347 conn(0x7f5a680cf840 msgr2=0x7f5a6814d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:39.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.883+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/2830994347 shutdown_connections 2023-12-22T08:42:39.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:39.883+0000 7f5a6eb1c640 1 -- 172.21.15.38:0/2830994347 wait complete. 2023-12-22T08:42:39.904 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:42:40.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.128+0000 7f24a52a1640 1 Processor -- start 2023-12-22T08:42:40.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.128+0000 7f24a52a1640 1 -- start start 2023-12-22T08:42:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.130+0000 7f24a52a1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f24a00b24b0 0x7f24a0070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.130+0000 7f24a52a1640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a01450f0 con 0x7f24a00b2050 2023-12-22T08:42:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.130+0000 7f24a52a1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a00cc840 con 0x7f24a0144d10 2023-12-22T08:42:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.130+0000 7f24a52a1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a00ce010 con 0x7f24a00b24b0 2023-12-22T08:42:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.130+0000 7f24967fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f24a00b2050 0x7f24a0070800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49832/0 (socket says 172.21.15.38:49832) 2023-12-22T08:42:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.130+0000 7f24967fc640 1 -- 172.21.15.38:0/2440084196 learned_addr learned my addr 172.21.15.38:0/2440084196 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.131+0000 7f249f7fe640 1 --2- 172.21.15.38:0/2440084196 >> v2:172.21.15.89:3300/0 conn(0x7f24a00b24b0 0x7f24a0070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.131+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556652446 0 0) 0x7f24a01450f0 con 0x7f24a00b2050 2023-12-22T08:42:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.131+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f248c003520 con 0x7f24a00b2050 2023-12-22T08:42:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.131+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 188220166 0 0) 0x7f248c003520 con 0x7f24a00b2050 2023-12-22T08:42:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.131+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 >> v2:172.21.15.89:3300/0 conn(0x7f24a00b24b0 msgr2=0x7f24a0070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.131+0000 7f249e7fc640 1 --2- 172.21.15.38:0/2440084196 >> v2:172.21.15.89:3300/0 conn(0x7f24a00b24b0 0x7f24a0070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.131+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 >> v1:172.21.15.89:6789/0 conn(0x7f24a0144d10 legacy=0x7f24a00cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.131+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a00ce2f0 con 0x7f24a00b2050 2023-12-22T08:42:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.131+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f2488001670 con 0x7f24a00b2050 2023-12-22T08:42:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 >> v1:172.21.15.38:6789/0 conn(0x7f24a00b2050 legacy=0x7f24a0070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249e7fc640 1 --2- 172.21.15.38:0/2440084196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f248c0039c0 0x7f248c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249e7fc640 1 --2- 172.21.15.38:0/2440084196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f248c0047c0 0x7f248c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249e7fc640 1 --2- 172.21.15.38:0/2440084196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f248c005180 0x7f248c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00ce010 con 0x7f248c0039c0 2023-12-22T08:42:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c00c080 con 0x7f248c005180 2023-12-22T08:42:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248c00c240 con 0x7f248c0047c0 2023-12-22T08:42:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249effd640 1 --2- 172.21.15.38:0/2440084196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f248c0039c0 0x7f248c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249effd640 1 -- 172.21.15.38:0/2440084196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f248c0047c0 msgr2=0x7f248c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249effd640 1 --2- 172.21.15.38:0/2440084196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f248c0047c0 0x7f248c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249effd640 1 -- 172.21.15.38:0/2440084196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f248c005180 msgr2=0x7f248c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249effd640 1 --2- 172.21.15.38:0/2440084196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f248c005180 0x7f248c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249effd640 1 -- 172.21.15.38:0/2440084196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c003520 con 0x7f248c0039c0 2023-12-22T08:42:40.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.132+0000 7f249f7fe640 1 -- 172.21.15.38:0/2440084196 reap_dead start 2023-12-22T08:42:40.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.133+0000 7f249effd640 1 --2- 172.21.15.38:0/2440084196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f248c0039c0 0x7f248c003de0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2490001750 tx=0x7f248c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105fdf454af76d0a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:40.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.134+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24900052d0 con 0x7f248c0039c0 2023-12-22T08:42:40.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.134+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249002e050 con 0x7f248c0039c0 2023-12-22T08:42:40.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.134+0000 7f249e7fc640 1 -- 172.21.15.38:0/2440084196 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490003830 con 0x7f248c0039c0 2023-12-22T08:42:40.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.134+0000 7f24a52a1640 1 -- 172.21.15.38:0/2440084196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f248c0039c0 msgr2=0x7f248c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:40.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.134+0000 7f24a52a1640 1 --2- 172.21.15.38:0/2440084196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f248c0039c0 0x7f248c003de0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2490001750 tx=0x7f248c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.134+0000 7f24a52a1640 1 -- 172.21.15.38:0/2440084196 shutdown_connections 2023-12-22T08:42:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.134+0000 7f24a52a1640 1 --2- 172.21.15.38:0/2440084196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f248c0039c0 0x7f248c003de0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.135+0000 7f24a52a1640 1 -- 172.21.15.38:0/2440084196 >> 172.21.15.38:0/2440084196 conn(0x7f24a00cf070 msgr2=0x7f24a00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.135+0000 7f24a52a1640 1 -- 172.21.15.38:0/2440084196 shutdown_connections 2023-12-22T08:42:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.135+0000 7f24a52a1640 1 -- 172.21.15.38:0/2440084196 wait complete. 2023-12-22T08:42:40.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.137+0000 7f24a52a1640 1 Processor -- start 2023-12-22T08:42:40.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.137+0000 7f24a52a1640 1 -- start start 2023-12-22T08:42:40.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.139+0000 7f24a52a1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f248c0039c0 0x7f24a0158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.139+0000 7f24a52a1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a00adc50 0x7f24a00ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.139+0000 7f24a52a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a00a8f90 0x7f24a00a9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.139+0000 7f24a52a1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00a9df0 con 0x7f24a00adc50 2023-12-22T08:42:40.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.139+0000 7f24a52a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00aa0d0 con 0x7f24a00a8f90 2023-12-22T08:42:40.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.139+0000 7f24a52a1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a015dc70 con 0x7f248c0039c0 2023-12-22T08:42:40.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.139+0000 7f24967fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a00adc50 0x7f24a00ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:40.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.139+0000 7f24967fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a00adc50 0x7f24a00ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34262/0 (socket says 172.21.15.38:34262) 2023-12-22T08:42:40.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.139+0000 7f24967fc640 1 -- 172.21.15.38:0/3843845556 learned_addr learned my addr 172.21.15.38:0/3843845556 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:40.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.139+0000 7f249effd640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f248c0039c0 0x7f24a0158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:40.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.140+0000 7f249f7fe640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a00a8f90 0x7f24a00a9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:40.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.140+0000 7f24967fc640 1 -- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f248c0039c0 msgr2=0x7f24a0158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:40.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.140+0000 7f24967fc640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f248c0039c0 0x7f24a0158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.140+0000 7f24967fc640 1 -- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a00a8f90 msgr2=0x7f24a00a9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:40.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.140+0000 7f24967fc640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a00a8f90 0x7f24a00a9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.140+0000 7f24967fc640 1 -- 172.21.15.38:0/3843845556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a015df50 con 0x7f24a00adc50 2023-12-22T08:42:40.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.140+0000 7f249f7fe640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a00a8f90 0x7f24a00a9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:40.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.140+0000 7f24967fc640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a00adc50 0x7f24a00ae0b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f248800c730 tx=0x7f248800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:40.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.140+0000 7f2497fff640 1 -- 172.21.15.38:0/3843845556 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24880072d0 con 0x7f24a00adc50 2023-12-22T08:42:40.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.140+0000 7f2497fff640 1 -- 172.21.15.38:0/3843845556 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2488007450 con 0x7f24a00adc50 2023-12-22T08:42:40.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.140+0000 7f2497fff640 1 -- 172.21.15.38:0/3843845556 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24880047e0 con 0x7f24a00adc50 2023-12-22T08:42:40.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.140+0000 7f24a52a1640 1 -- 172.21.15.38:0/3843845556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a00ae5f0 con 0x7f24a00adc50 2023-12-22T08:42:40.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.141+0000 7f24a52a1640 1 -- 172.21.15.38:0/3843845556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a0158840 con 0x7f24a00adc50 2023-12-22T08:42:40.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.142+0000 7f24a52a1640 1 -- 172.21.15.38:0/3843845556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a00b2b10 con 0x7f24a00adc50 2023-12-22T08:42:40.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.143+0000 7f2497fff640 1 -- 172.21.15.38:0/3843845556 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2488004940 con 0x7f24a00adc50 2023-12-22T08:42:40.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.143+0000 7f2497fff640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f248006a460 0x7f248006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.144+0000 7f2497fff640 1 -- 172.21.15.38:0/3843845556 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2488087c20 con 0x7f24a00adc50 2023-12-22T08:42:40.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.144+0000 7f249effd640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f248006a460 0x7f248006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:40.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.145+0000 7f249effd640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f248006a460 0x7f248006c920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2490033000 tx=0x7f2490009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:40.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.148+0000 7f2497fff640 1 -- 172.21.15.38:0/3843845556 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2488053170 con 0x7f24a00adc50 2023-12-22T08:42:40.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.358+0000 7f24a52a1640 1 -- 172.21.15.38:0/3843845556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f24a0061910 con 0x7f24a00adc50 2023-12-22T08:42:40.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.359+0000 7f2497fff640 1 -- 172.21.15.38:0/3843845556 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2488018020 con 0x7f24a00adc50 2023-12-22T08:42:40.362 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:42:40.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.362+0000 7f24a52a1640 1 -- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f248006a460 msgr2=0x7f248006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.362+0000 7f24a52a1640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f248006a460 0x7f248006c920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2490033000 tx=0x7f2490009030 comp rx=0 tx=0).stop 2023-12-22T08:42:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.362+0000 7f24a52a1640 1 -- 172.21.15.38:0/3843845556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a00adc50 msgr2=0x7f24a00ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.362+0000 7f24a52a1640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a00adc50 0x7f24a00ae0b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f248800c730 tx=0x7f248800cbf0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.362+0000 7f24a52a1640 1 -- 172.21.15.38:0/3843845556 shutdown_connections 2023-12-22T08:42:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.362+0000 7f24a52a1640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a00a8f90 0x7f24a00a9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.362+0000 7f24a52a1640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f248006a460 0x7f248006c920 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.362+0000 7f24a52a1640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24a00adc50 0x7f24a00ae0b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.362+0000 7f24a52a1640 1 --2- 172.21.15.38:0/3843845556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f248c0039c0 0x7f24a0158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.362+0000 7f24a52a1640 1 -- 172.21.15.38:0/3843845556 >> 172.21.15.38:0/3843845556 conn(0x7f24a00cf070 msgr2=0x7f24a01595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.362+0000 7f24a52a1640 1 -- 172.21.15.38:0/3843845556 shutdown_connections 2023-12-22T08:42:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.363+0000 7f24a52a1640 1 -- 172.21.15.38:0/3843845556 wait complete. 2023-12-22T08:42:40.385 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T08:42:40.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:40.385 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-22T08:42:40.554 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:42:40.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:40.554 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T08:42:40.600 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:42:40.600 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:40.643 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:42:40.643 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:40.738 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:42:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.968+0000 7fd2b38b9640 1 Processor -- start 2023-12-22T08:42:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.968+0000 7fd2b38b9640 1 -- start start 2023-12-22T08:42:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.969+0000 7fd2b38b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac15d850 0x7fd2ac0ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.969+0000 7fd2b38b9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd2ac071ea0 0x7fd2ac0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.969+0000 7fd2b38b9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ac0ac8e0 con 0x7fd2ac15d470 2023-12-22T08:42:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.969+0000 7fd2b38b9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ac0b4940 con 0x7fd2ac071ea0 2023-12-22T08:42:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.969+0000 7fd2b38b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac0b4c20 con 0x7fd2ac15d850 2023-12-22T08:42:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.970+0000 7fd2b1655640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd2ac15d470 0x7fd2ac0b4010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49844/0 (socket says 172.21.15.38:49844) 2023-12-22T08:42:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.970+0000 7fd2b1655640 1 -- 172.21.15.38:0/4156998885 learned_addr learned my addr 172.21.15.38:0/4156998885 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.970+0000 7fd2b1e56640 1 --2- 172.21.15.38:0/4156998885 >> v2:172.21.15.38:3300/0 conn(0x7fd2ac071ea0 0x7fd2ac0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.970+0000 7fd2b0e54640 1 --2- 172.21.15.38:0/4156998885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac15d850 0x7fd2ac0ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.971+0000 7fd2b1e56640 1 -- 172.21.15.38:0/4156998885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac15d850 msgr2=0x7fd2ac0ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.971+0000 7fd2b1e56640 1 --2- 172.21.15.38:0/4156998885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac15d850 0x7fd2ac0ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.971+0000 7fd2b1e56640 1 -- 172.21.15.38:0/4156998885 >> v1:172.21.15.38:6789/0 conn(0x7fd2ac15d470 legacy=0x7fd2ac0b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.971+0000 7fd2b1e56640 1 -- 172.21.15.38:0/4156998885 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac0acb30 con 0x7fd2ac071ea0 2023-12-22T08:42:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.972+0000 7fd2b1e56640 1 --2- 172.21.15.38:0/4156998885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac071ea0 0x7fd2ac0b2050 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009d90 tx=0x7fd2a402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f403f1e18dee1c1e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.972+0000 7fd2a3fff640 1 -- 172.21.15.38:0/4156998885 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a402cc60 con 0x7fd2ac071ea0 2023-12-22T08:42:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.972+0000 7fd2a3fff640 1 -- 172.21.15.38:0/4156998885 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a402cdc0 con 0x7fd2ac071ea0 2023-12-22T08:42:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.972+0000 7fd2a3fff640 1 -- 172.21.15.38:0/4156998885 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4034660 con 0x7fd2ac071ea0 2023-12-22T08:42:40.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.973+0000 7fd2b38b9640 1 -- 172.21.15.38:0/4156998885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac071ea0 msgr2=0x7fd2ac0b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:40.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.973+0000 7fd2b38b9640 1 --2- 172.21.15.38:0/4156998885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac071ea0 0x7fd2ac0b2050 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009d90 tx=0x7fd2a402beb0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.973+0000 7fd2b38b9640 1 -- 172.21.15.38:0/4156998885 shutdown_connections 2023-12-22T08:42:40.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.973+0000 7fd2b38b9640 1 --2- 172.21.15.38:0/4156998885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac071ea0 0x7fd2ac0b2050 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.973+0000 7fd2b38b9640 1 --2- 172.21.15.38:0/4156998885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac15d850 0x7fd2ac0ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.973+0000 7fd2b38b9640 1 -- 172.21.15.38:0/4156998885 >> 172.21.15.38:0/4156998885 conn(0x7fd2ac0cf070 msgr2=0x7fd2ac0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:40.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.973+0000 7fd2b38b9640 1 -- 172.21.15.38:0/4156998885 shutdown_connections 2023-12-22T08:42:40.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.973+0000 7fd2b38b9640 1 -- 172.21.15.38:0/4156998885 wait complete. 2023-12-22T08:42:40.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.975+0000 7fd2b38b9640 1 Processor -- start 2023-12-22T08:42:40.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.975+0000 7fd2b38b9640 1 -- start start 2023-12-22T08:42:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.976+0000 7fd2b38b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac071ea0 0x7fd2ac06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.976+0000 7fd2b38b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac15d470 0x7fd2ac160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.976+0000 7fd2b38b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2ac15d850 0x7fd2ac15e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.976+0000 7fd2b38b9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac06d910 con 0x7fd2ac071ea0 2023-12-22T08:42:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.976+0000 7fd2b38b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac155010 con 0x7fd2ac15d850 2023-12-22T08:42:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.976+0000 7fd2b38b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac1586d0 con 0x7fd2ac15d470 2023-12-22T08:42:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.976+0000 7fd2b1655640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac071ea0 0x7fd2ac06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.976+0000 7fd2b1655640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac071ea0 0x7fd2ac06d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34284/0 (socket says 172.21.15.38:34284) 2023-12-22T08:42:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.976+0000 7fd2b1655640 1 -- 172.21.15.38:0/1187902785 learned_addr learned my addr 172.21.15.38:0/1187902785 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.977+0000 7fd2b0e54640 1 --2- 172.21.15.38:0/1187902785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac15d470 0x7fd2ac160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.977+0000 7fd2b1655640 1 -- 172.21.15.38:0/1187902785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac15d470 msgr2=0x7fd2ac160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.977+0000 7fd2b1655640 1 --2- 172.21.15.38:0/1187902785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac15d470 0x7fd2ac160570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.977+0000 7fd2b1655640 1 -- 172.21.15.38:0/1187902785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2ac15d850 msgr2=0x7fd2ac15e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.977+0000 7fd2b1655640 1 --2- 172.21.15.38:0/1187902785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2ac15d850 0x7fd2ac15e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.977+0000 7fd2b1655640 1 -- 172.21.15.38:0/1187902785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a4009a70 con 0x7fd2ac071ea0 2023-12-22T08:42:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.977+0000 7fd2b1655640 1 --2- 172.21.15.38:0/1187902785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac071ea0 0x7fd2ac06d3d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800c400 tx=0x7fd2a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:40.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.977+0000 7fd2a1ffb640 1 -- 172.21.15.38:0/1187902785 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8005ce0 con 0x7fd2ac071ea0 2023-12-22T08:42:40.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.977+0000 7fd2a1ffb640 1 -- 172.21.15.38:0/1187902785 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a8005e40 con 0x7fd2ac071ea0 2023-12-22T08:42:40.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.977+0000 7fd2a1ffb640 1 -- 172.21.15.38:0/1187902785 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80072f0 con 0x7fd2ac071ea0 2023-12-22T08:42:40.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.977+0000 7fd2b38b9640 1 -- 172.21.15.38:0/1187902785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ac160ab0 con 0x7fd2ac071ea0 2023-12-22T08:42:40.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.978+0000 7fd2b38b9640 1 -- 172.21.15.38:0/1187902785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ac0cd520 con 0x7fd2ac071ea0 2023-12-22T08:42:40.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.979+0000 7fd2b38b9640 1 -- 172.21.15.38:0/1187902785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ac158890 con 0x7fd2ac071ea0 2023-12-22T08:42:40.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.980+0000 7fd2a1ffb640 1 -- 172.21.15.38:0/1187902785 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd2a8007510 con 0x7fd2ac071ea0 2023-12-22T08:42:40.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.981+0000 7fd2a1ffb640 1 --2- 172.21.15.38:0/1187902785 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd29006a430 0x7fd29006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:40.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.981+0000 7fd2a1ffb640 1 -- 172.21.15.38:0/1187902785 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2a8087f00 con 0x7fd2ac071ea0 2023-12-22T08:42:40.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.982+0000 7fd2b0e54640 1 --2- 172.21.15.38:0/1187902785 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd29006a430 0x7fd29006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:40.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.983+0000 7fd2b0e54640 1 --2- 172.21.15.38:0/1187902785 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd29006a430 0x7fd29006c8f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd29c006fd0 tx=0x7fd29c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:40.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:40.985+0000 7fd2a1ffb640 1 -- 172.21.15.38:0/1187902785 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd2a80534e0 con 0x7fd2ac071ea0 2023-12-22T08:42:41.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.183+0000 7fd2b38b9640 1 -- 172.21.15.38:0/1187902785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2ac061910 con 0x7fd2ac071ea0 2023-12-22T08:42:41.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.186+0000 7fd2a1ffb640 1 -- 172.21.15.38:0/1187902785 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+15993 (secure 0 0 0) 0x7fd2a8017090 con 0x7fd2ac071ea0 2023-12-22T08:42:41.188 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:41.189 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":59,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:42:33.327912+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:58.840533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:59.953505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:42:41.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.188+0000 7fd2b38b9640 1 -- 172.21.15.38:0/1187902785 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd29006a430 msgr2=0x7fd29006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:41.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.188+0000 7fd2b38b9640 1 --2- 172.21.15.38:0/1187902785 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd29006a430 0x7fd29006c8f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd29c006fd0 tx=0x7fd29c008040 comp rx=0 tx=0).stop 2023-12-22T08:42:41.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.189+0000 7fd2b38b9640 1 -- 172.21.15.38:0/1187902785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac071ea0 msgr2=0x7fd2ac06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:41.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.189+0000 7fd2b38b9640 1 --2- 172.21.15.38:0/1187902785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac071ea0 0x7fd2ac06d3d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800c400 tx=0x7fd2a800c8c0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.189+0000 7fd2b38b9640 1 -- 172.21.15.38:0/1187902785 shutdown_connections 2023-12-22T08:42:41.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.189+0000 7fd2b38b9640 1 --2- 172.21.15.38:0/1187902785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2ac15d850 0x7fd2ac15e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.189+0000 7fd2b38b9640 1 --2- 172.21.15.38:0/1187902785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac15d470 0x7fd2ac160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.189+0000 7fd2b38b9640 1 --2- 172.21.15.38:0/1187902785 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd29006a430 0x7fd29006c8f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.189+0000 7fd2b38b9640 1 --2- 172.21.15.38:0/1187902785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac071ea0 0x7fd2ac06d3d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.189+0000 7fd2b38b9640 1 -- 172.21.15.38:0/1187902785 >> 172.21.15.38:0/1187902785 conn(0x7fd2ac0cf070 msgr2=0x7fd2ac159a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:41.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.189+0000 7fd2b38b9640 1 -- 172.21.15.38:0/1187902785 shutdown_connections 2023-12-22T08:42:41.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.189+0000 7fd2b38b9640 1 -- 172.21.15.38:0/1187902785 wait complete. 2023-12-22T08:42:41.212 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:41:58.840533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:41:59.953505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:42:41.212 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:42:41.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.441+0000 7f718b3b5640 1 Processor -- start 2023-12-22T08:42:41.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.442+0000 7f718b3b5640 1 -- start start 2023-12-22T08:42:41.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.443+0000 7f718b3b5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f718415d1c0 0x7f7184070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:41.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.444+0000 7f718b3b5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718415de50 con 0x7f71840d0770 2023-12-22T08:42:41.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.444+0000 7f718b3b5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71840d0b80 con 0x7f718415d5a0 2023-12-22T08:42:41.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.444+0000 7f718b3b5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71840d0dd0 con 0x7f718415d1c0 2023-12-22T08:42:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.444+0000 7f718abb4640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f71840d0770 0x7f718415e2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49608/0 (socket says 172.21.15.38:49608) 2023-12-22T08:42:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.444+0000 7f718abb4640 1 -- 172.21.15.38:0/3721335992 learned_addr learned my addr 172.21.15.38:0/3721335992 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.444+0000 7f718a3b3640 1 --2- 172.21.15.38:0/3721335992 >> v2:172.21.15.89:3300/0 conn(0x7f718415d1c0 0x7f7184070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.444+0000 7f71893b1640 1 -- 172.21.15.38:0/3721335992 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156497686 0 0) 0x7f718415de50 con 0x7f71840d0770 2023-12-22T08:42:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.444+0000 7f71893b1640 1 -- 172.21.15.38:0/3721335992 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7170003520 con 0x7f71840d0770 2023-12-22T08:42:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.445+0000 7f71893b1640 1 -- 172.21.15.38:0/3721335992 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1398425562 0 0) 0x7f7170003520 con 0x7f71840d0770 2023-12-22T08:42:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.445+0000 7f718a3b3640 1 -- 172.21.15.38:0/3721335992 >> v1:172.21.15.89:6789/0 conn(0x7f718415d5a0 legacy=0x7f71840d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.445+0000 7f718a3b3640 1 -- 172.21.15.38:0/3721335992 >> v1:172.21.15.38:6789/0 conn(0x7f71840d0770 legacy=0x7f718415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.445+0000 7f718a3b3640 1 -- 172.21.15.38:0/3721335992 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71840d10b0 con 0x7f718415d1c0 2023-12-22T08:42:41.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.446+0000 7f718a3b3640 1 --2- 172.21.15.38:0/3721335992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f718415d1c0 0x7f7184070970 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f71800097a0 tx=0x7f718002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4251a53b73283ead server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:41.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.447+0000 7f71893b1640 1 -- 172.21.15.38:0/3721335992 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718002f050 con 0x7f718415d1c0 2023-12-22T08:42:41.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.447+0000 7f71893b1640 1 -- 172.21.15.38:0/3721335992 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7180031500 con 0x7f718415d1c0 2023-12-22T08:42:41.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.447+0000 7f71893b1640 1 -- 172.21.15.38:0/3721335992 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c0019f0 con 0x7f718415d1c0 2023-12-22T08:42:41.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.447+0000 7f718b3b5640 1 -- 172.21.15.38:0/3721335992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f718415d1c0 msgr2=0x7f7184070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:41.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.447+0000 7f718b3b5640 1 --2- 172.21.15.38:0/3721335992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f718415d1c0 0x7f7184070970 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f71800097a0 tx=0x7f718002b820 comp rx=0 tx=0).stop 2023-12-22T08:42:41.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.448+0000 7f718b3b5640 1 -- 172.21.15.38:0/3721335992 shutdown_connections 2023-12-22T08:42:41.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.448+0000 7f718b3b5640 1 --2- 172.21.15.38:0/3721335992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f718415d1c0 0x7f7184070970 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.448+0000 7f718b3b5640 1 -- 172.21.15.38:0/3721335992 >> 172.21.15.38:0/3721335992 conn(0x7f718406bf90 msgr2=0x7f718406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:41.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.448+0000 7f718b3b5640 1 -- 172.21.15.38:0/3721335992 shutdown_connections 2023-12-22T08:42:41.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.448+0000 7f718b3b5640 1 -- 172.21.15.38:0/3721335992 wait complete. 2023-12-22T08:42:41.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.449+0000 7f718b3b5640 1 Processor -- start 2023-12-22T08:42:41.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.450+0000 7f718b3b5640 1 -- start start 2023-12-22T08:42:41.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f718b3b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71840d0770 0x7f7184152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:41.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f718b3b5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f718415d1c0 0x7f71840b7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:41.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f718b3b5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f718415d5a0 0x7f7184154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:41.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f718b3b5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7184153340 con 0x7f718415d1c0 2023-12-22T08:42:41.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f718b3b5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71841541a0 con 0x7f71840d0770 2023-12-22T08:42:41.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f718b3b5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71841530f0 con 0x7f718415d5a0 2023-12-22T08:42:41.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f7189bb2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f718415d1c0 0x7f71840b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:41.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f7189bb2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f718415d1c0 0x7f71840b7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40732/0 (socket says 172.21.15.38:40732) 2023-12-22T08:42:41.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f7189bb2640 1 -- 172.21.15.38:0/3885324731 learned_addr learned my addr 172.21.15.38:0/3885324731 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f7189bb2640 1 -- 172.21.15.38:0/3885324731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f718415d5a0 msgr2=0x7f7184154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f7189bb2640 1 --2- 172.21.15.38:0/3885324731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f718415d5a0 0x7f7184154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f7189bb2640 1 -- 172.21.15.38:0/3885324731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71840d0770 msgr2=0x7f7184152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f7189bb2640 1 --2- 172.21.15.38:0/3885324731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71840d0770 0x7f7184152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.451+0000 7f7189bb2640 1 -- 172.21.15.38:0/3885324731 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180009400 con 0x7f718415d1c0 2023-12-22T08:42:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.452+0000 7f7189bb2640 1 --2- 172.21.15.38:0/3885324731 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f718415d1c0 0x7f71840b7500 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f717400c3c0 tx=0x7f717400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.452+0000 7f717affd640 1 -- 172.21.15.38:0/3885324731 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71740052d0 con 0x7f718415d1c0 2023-12-22T08:42:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.452+0000 7f717affd640 1 -- 172.21.15.38:0/3885324731 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7174005450 con 0x7f718415d1c0 2023-12-22T08:42:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.452+0000 7f718b3b5640 1 -- 172.21.15.38:0/3885324731 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7184153590 con 0x7f718415d1c0 2023-12-22T08:42:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.452+0000 7f717affd640 1 -- 172.21.15.38:0/3885324731 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174003830 con 0x7f718415d1c0 2023-12-22T08:42:41.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.452+0000 7f718b3b5640 1 -- 172.21.15.38:0/3885324731 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7184153b50 con 0x7f718415d1c0 2023-12-22T08:42:41.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.454+0000 7f718b3b5640 1 -- 172.21.15.38:0/3885324731 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71840b3020 con 0x7f718415d1c0 2023-12-22T08:42:41.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.455+0000 7f717affd640 1 -- 172.21.15.38:0/3885324731 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7174003990 con 0x7f718415d1c0 2023-12-22T08:42:41.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.456+0000 7f717affd640 1 --2- 172.21.15.38:0/3885324731 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f716806a460 0x7f716806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:41.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.456+0000 7f717affd640 1 -- 172.21.15.38:0/3885324731 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7174087d50 con 0x7f718415d1c0 2023-12-22T08:42:41.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.456+0000 7f718a3b3640 1 --2- 172.21.15.38:0/3885324731 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f716806a460 0x7f716806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:41.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.457+0000 7f718a3b3640 1 --2- 172.21.15.38:0/3885324731 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f716806a460 0x7f716806c920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7180035000 tx=0x7f7180030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:41.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.460+0000 7f717affd640 1 -- 172.21.15.38:0/3885324731 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f717408b030 con 0x7f718415d1c0 2023-12-22T08:42:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.654+0000 7f718b3b5640 1 -- 172.21.15.38:0/3885324731 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7184154310 con 0x7f718415d1c0 2023-12-22T08:42:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.655+0000 7f717affd640 1 -- 172.21.15.38:0/3885324731 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71740533d0 con 0x7f718415d1c0 2023-12-22T08:42:41.657 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:42:41.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.657+0000 7f718b3b5640 1 -- 172.21.15.38:0/3885324731 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f716806a460 msgr2=0x7f716806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:41.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.657+0000 7f718b3b5640 1 --2- 172.21.15.38:0/3885324731 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f716806a460 0x7f716806c920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7180035000 tx=0x7f7180030000 comp rx=0 tx=0).stop 2023-12-22T08:42:41.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.658+0000 7f718b3b5640 1 -- 172.21.15.38:0/3885324731 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f718415d1c0 msgr2=0x7f71840b7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:41.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.658+0000 7f718b3b5640 1 --2- 172.21.15.38:0/3885324731 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f718415d1c0 0x7f71840b7500 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f717400c3c0 tx=0x7f717400c880 comp rx=0 tx=0).stop 2023-12-22T08:42:41.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.658+0000 7f718b3b5640 1 -- 172.21.15.38:0/3885324731 shutdown_connections 2023-12-22T08:42:41.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.658+0000 7f718b3b5640 1 --2- 172.21.15.38:0/3885324731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f718415d5a0 0x7f7184154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.658+0000 7f718b3b5640 1 --2- 172.21.15.38:0/3885324731 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f716806a460 0x7f716806c920 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.658+0000 7f718b3b5640 1 --2- 172.21.15.38:0/3885324731 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f718415d1c0 0x7f71840b7500 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.658+0000 7f718b3b5640 1 --2- 172.21.15.38:0/3885324731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71840d0770 0x7f7184152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.658+0000 7f718b3b5640 1 -- 172.21.15.38:0/3885324731 >> 172.21.15.38:0/3885324731 conn(0x7f718406bf90 msgr2=0x7f718406f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:41.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.658+0000 7f718b3b5640 1 -- 172.21.15.38:0/3885324731 shutdown_connections 2023-12-22T08:42:41.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.658+0000 7f718b3b5640 1 -- 172.21.15.38:0/3885324731 wait complete. 2023-12-22T08:42:41.680 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:42:41.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.900+0000 7fb938c50640 1 Processor -- start 2023-12-22T08:42:41.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.900+0000 7fb938c50640 1 -- start start 2023-12-22T08:42:41.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.902+0000 7fb938c50640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb934144a20 0x7fb9340b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:41.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.902+0000 7fb938c50640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9340b5c80 con 0x7fb9340b3cf0 2023-12-22T08:42:41.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.902+0000 7fb938c50640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9340b5f00 con 0x7fb9340cf9a0 2023-12-22T08:42:41.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.902+0000 7fb938c50640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9340b65a0 con 0x7fb934144a20 2023-12-22T08:42:41.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.902+0000 7fb9337fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb934144a20 0x7fb9340b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:41.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.902+0000 7fb9337fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb934144a20 0x7fb9340b69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40744/0 (socket says 172.21.15.38:40744) 2023-12-22T08:42:41.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.902+0000 7fb9337fe640 1 -- 172.21.15.38:0/2316909407 learned_addr learned my addr 172.21.15.38:0/2316909407 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:41.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.902+0000 7fb932ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb9340b3cf0 0x7fb9340cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49624/0 (socket says 172.21.15.38:49624) 2023-12-22T08:42:41.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.903+0000 7fb9337fe640 1 -- 172.21.15.38:0/2316909407 >> v1:172.21.15.89:6789/0 conn(0x7fb9340cf9a0 legacy=0x7fb93415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:41.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.903+0000 7fb9337fe640 1 -- 172.21.15.38:0/2316909407 >> v1:172.21.15.38:6789/0 conn(0x7fb9340b3cf0 legacy=0x7fb9340cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:41.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.903+0000 7fb9337fe640 1 -- 172.21.15.38:0/2316909407 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93415fa40 con 0x7fb934144a20 2023-12-22T08:42:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.904+0000 7fb9337fe640 1 --2- 172.21.15.38:0/2316909407 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb934144a20 0x7fb9340b69c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb924009e50 tx=0x7fb92402bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2984ec7906c58f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.904+0000 7fb9327fc640 1 -- 172.21.15.38:0/2316909407 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92402c840 con 0x7fb934144a20 2023-12-22T08:42:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.904+0000 7fb9327fc640 1 -- 172.21.15.38:0/2316909407 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92402c9a0 con 0x7fb934144a20 2023-12-22T08:42:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.904+0000 7fb9327fc640 1 -- 172.21.15.38:0/2316909407 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92402cd30 con 0x7fb934144a20 2023-12-22T08:42:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.905+0000 7fb938c50640 1 -- 172.21.15.38:0/2316909407 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb934144a20 msgr2=0x7fb9340b69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.905+0000 7fb938c50640 1 --2- 172.21.15.38:0/2316909407 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb934144a20 0x7fb9340b69c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb924009e50 tx=0x7fb92402bd20 comp rx=0 tx=0).stop 2023-12-22T08:42:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.905+0000 7fb938c50640 1 -- 172.21.15.38:0/2316909407 shutdown_connections 2023-12-22T08:42:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.905+0000 7fb938c50640 1 --2- 172.21.15.38:0/2316909407 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb934144a20 0x7fb9340b69c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.905+0000 7fb938c50640 1 -- 172.21.15.38:0/2316909407 >> 172.21.15.38:0/2316909407 conn(0x7fb934060720 msgr2=0x7fb934060b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.905+0000 7fb938c50640 1 -- 172.21.15.38:0/2316909407 shutdown_connections 2023-12-22T08:42:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.905+0000 7fb938c50640 1 -- 172.21.15.38:0/2316909407 wait complete. 2023-12-22T08:42:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.907+0000 7fb938c50640 1 Processor -- start 2023-12-22T08:42:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.907+0000 7fb938c50640 1 -- start start 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.908+0000 7fb938c50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9340b3cf0 0x7fb93413abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.908+0000 7fb938c50640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9340cf9a0 0x7fb9340af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.908+0000 7fb938c50640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb934144a20 0x7fb93415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.908+0000 7fb938c50640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340aa7c0 con 0x7fb934144a20 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.908+0000 7fb938c50640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340aff20 con 0x7fb9340b3cf0 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.908+0000 7fb938c50640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340b0200 con 0x7fb9340cf9a0 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.908+0000 7fb933fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb934144a20 0x7fb93415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.908+0000 7fb933fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb934144a20 0x7fb93415a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40754/0 (socket says 172.21.15.38:40754) 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.908+0000 7fb933fff640 1 -- 172.21.15.38:0/895254046 learned_addr learned my addr 172.21.15.38:0/895254046 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.909+0000 7fb932ffd640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9340cf9a0 0x7fb9340af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.909+0000 7fb933fff640 1 -- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9340cf9a0 msgr2=0x7fb9340af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.909+0000 7fb9337fe640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9340b3cf0 0x7fb93413abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.909+0000 7fb933fff640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9340cf9a0 0x7fb9340af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.909+0000 7fb933fff640 1 -- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9340b3cf0 msgr2=0x7fb93413abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.909+0000 7fb933fff640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9340b3cf0 0x7fb93413abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:41.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.909+0000 7fb933fff640 1 -- 172.21.15.38:0/895254046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb924009b30 con 0x7fb934144a20 2023-12-22T08:42:41.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.909+0000 7fb933fff640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb934144a20 0x7fb93415a4a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00c410 tx=0x7fb92c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:41.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.909+0000 7fb92bfff640 1 -- 172.21.15.38:0/895254046 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c011790 con 0x7fb934144a20 2023-12-22T08:42:41.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.909+0000 7fb92bfff640 1 -- 172.21.15.38:0/895254046 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c0118f0 con 0x7fb934144a20 2023-12-22T08:42:41.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.909+0000 7fb92bfff640 1 -- 172.21.15.38:0/895254046 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c011ce0 con 0x7fb934144a20 2023-12-22T08:42:41.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.910+0000 7fb938c50640 1 -- 172.21.15.38:0/895254046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9340aa170 con 0x7fb934144a20 2023-12-22T08:42:41.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.910+0000 7fb938c50640 1 -- 172.21.15.38:0/895254046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93413b100 con 0x7fb934144a20 2023-12-22T08:42:41.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.911+0000 7fb938c50640 1 -- 172.21.15.38:0/895254046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9340aa970 con 0x7fb934144a20 2023-12-22T08:42:41.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.912+0000 7fb92bfff640 1 -- 172.21.15.38:0/895254046 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb92c01c460 con 0x7fb934144a20 2023-12-22T08:42:41.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.913+0000 7fb92bfff640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb91406a460 0x7fb91406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:41.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.913+0000 7fb92bfff640 1 -- 172.21.15.38:0/895254046 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb92c088610 con 0x7fb934144a20 2023-12-22T08:42:41.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.914+0000 7fb9337fe640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb91406a460 0x7fb91406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:41.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.915+0000 7fb9337fe640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb91406a460 0x7fb91406c920 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb924035000 tx=0x7fb924030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:41.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:41.917+0000 7fb92bfff640 1 -- 172.21.15.38:0/895254046 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb9340aa970 con 0x7fb934144a20 2023-12-22T08:42:42.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.113+0000 7fb938c50640 1 -- 172.21.15.38:0/895254046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9340b73a0 con 0x7fb934144a20 2023-12-22T08:42:42.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.114+0000 7fb92bfff640 1 -- 172.21.15.38:0/895254046 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb92c053b60 con 0x7fb934144a20 2023-12-22T08:42:42.116 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:42:42.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.117+0000 7fb938c50640 1 -- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb91406a460 msgr2=0x7fb91406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:42.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.117+0000 7fb938c50640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb91406a460 0x7fb91406c920 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb924035000 tx=0x7fb924030000 comp rx=0 tx=0).stop 2023-12-22T08:42:42.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.117+0000 7fb938c50640 1 -- 172.21.15.38:0/895254046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb934144a20 msgr2=0x7fb93415a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:42.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.117+0000 7fb938c50640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb934144a20 0x7fb93415a4a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00c410 tx=0x7fb92c00c8d0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.117+0000 7fb938c50640 1 -- 172.21.15.38:0/895254046 shutdown_connections 2023-12-22T08:42:42.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.117+0000 7fb938c50640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb91406a460 0x7fb91406c920 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.117+0000 7fb938c50640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb934144a20 0x7fb93415a4a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.117+0000 7fb938c50640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9340cf9a0 0x7fb9340af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.117+0000 7fb938c50640 1 --2- 172.21.15.38:0/895254046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9340b3cf0 0x7fb93413abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.117+0000 7fb938c50640 1 -- 172.21.15.38:0/895254046 >> 172.21.15.38:0/895254046 conn(0x7fb934060720 msgr2=0x7fb9340cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:42.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.117+0000 7fb938c50640 1 -- 172.21.15.38:0/895254046 shutdown_connections 2023-12-22T08:42:42.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.117+0000 7fb938c50640 1 -- 172.21.15.38:0/895254046 wait complete. 2023-12-22T08:42:42.139 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:42:42.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.363+0000 7f3dc56f7640 1 Processor -- start 2023-12-22T08:42:42.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.364+0000 7f3dc56f7640 1 -- start start 2023-12-22T08:42:42.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.365+0000 7f3dc56f7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dc015af70 0x7f3dc0140de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:42.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.365+0000 7f3dc56f7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3dc015b350 0x7f3dc0071660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:42.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.365+0000 7f3dc56f7640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc015e000 con 0x7f3dc006c930 2023-12-22T08:42:42.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.365+0000 7f3dc56f7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc0140b80 con 0x7f3dc015b350 2023-12-22T08:42:42.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.365+0000 7f3dc56f7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc015eb80 con 0x7f3dc015af70 2023-12-22T08:42:42.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.366+0000 7f3dbe7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3dc015b350 0x7f3dc0071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:42.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.366+0000 7f3dbe7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3dc015b350 0x7f3dc0071660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:45456/0 (socket says 172.21.15.38:45456) 2023-12-22T08:42:42.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.366+0000 7f3dbf7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3dc006c930 0x7f3dc0143230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49630/0 (socket says 172.21.15.38:49630) 2023-12-22T08:42:42.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.366+0000 7f3dbe7fc640 1 -- 172.21.15.38:0/3374696465 learned_addr learned my addr 172.21.15.38:0/3374696465 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:42.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.366+0000 7f3dbeffd640 1 --2- 172.21.15.38:0/3374696465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dc015af70 0x7f3dc0140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.366+0000 7f3dbdffb640 1 -- 172.21.15.38:0/3374696465 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242886750 0 0) 0x7f3dc015e000 con 0x7f3dc006c930 2023-12-22T08:42:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.366+0000 7f3dbdffb640 1 -- 172.21.15.38:0/3374696465 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dac003520 con 0x7f3dc006c930 2023-12-22T08:42:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.366+0000 7f3dbe7fc640 1 -- 172.21.15.38:0/3374696465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dc015af70 msgr2=0x7f3dc0140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.366+0000 7f3dbe7fc640 1 --2- 172.21.15.38:0/3374696465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dc015af70 0x7f3dc0140de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.367+0000 7f3dbe7fc640 1 -- 172.21.15.38:0/3374696465 >> v1:172.21.15.38:6789/0 conn(0x7f3dc006c930 legacy=0x7f3dc0143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.367+0000 7f3dbe7fc640 1 -- 172.21.15.38:0/3374696465 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc015e2e0 con 0x7f3dc015b350 2023-12-22T08:42:42.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.368+0000 7f3dbe7fc640 1 --2- 172.21.15.38:0/3374696465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc015b350 0x7f3dc0071660 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3da80098a0 tx=0x7f3da802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b75fcfd3090e58a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:42.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.369+0000 7f3dbdffb640 1 -- 172.21.15.38:0/3374696465 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8030840 con 0x7f3dc015b350 2023-12-22T08:42:42.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.369+0000 7f3dbdffb640 1 -- 172.21.15.38:0/3374696465 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da80309a0 con 0x7f3dc015b350 2023-12-22T08:42:42.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.369+0000 7f3dbdffb640 1 -- 172.21.15.38:0/3374696465 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8030d30 con 0x7f3dc015b350 2023-12-22T08:42:42.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.370+0000 7f3dc56f7640 1 -- 172.21.15.38:0/3374696465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc015b350 msgr2=0x7f3dc0071660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:42.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.370+0000 7f3dc56f7640 1 --2- 172.21.15.38:0/3374696465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc015b350 0x7f3dc0071660 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3da80098a0 tx=0x7f3da802b980 comp rx=0 tx=0).stop 2023-12-22T08:42:42.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.370+0000 7f3dc56f7640 1 -- 172.21.15.38:0/3374696465 shutdown_connections 2023-12-22T08:42:42.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.370+0000 7f3dc56f7640 1 --2- 172.21.15.38:0/3374696465 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc015b350 0x7f3dc0071660 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.370+0000 7f3dc56f7640 1 --2- 172.21.15.38:0/3374696465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dc015af70 0x7f3dc0140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.370+0000 7f3dc56f7640 1 -- 172.21.15.38:0/3374696465 >> 172.21.15.38:0/3374696465 conn(0x7f3dc00cf8a0 msgr2=0x7f3dc00cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:42.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.370+0000 7f3dc56f7640 1 -- 172.21.15.38:0/3374696465 shutdown_connections 2023-12-22T08:42:42.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.370+0000 7f3dc56f7640 1 -- 172.21.15.38:0/3374696465 wait complete. 2023-12-22T08:42:42.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.372+0000 7f3dc56f7640 1 Processor -- start 2023-12-22T08:42:42.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.372+0000 7f3dc56f7640 1 -- start start 2023-12-22T08:42:42.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.373+0000 7f3dc56f7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dc006c930 0x7f3dc00aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:42.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.373+0000 7f3dc56f7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc015af70 0x7f3dc01f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:42.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.373+0000 7f3dc56f7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc015b350 0x7f3dc014c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:42.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.373+0000 7f3dc56f7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00c26a0 con 0x7f3dc015af70 2023-12-22T08:42:42.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.373+0000 7f3dc56f7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00c2070 con 0x7f3dc015b350 2023-12-22T08:42:42.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.373+0000 7f3dc56f7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc01f59e0 con 0x7f3dc006c930 2023-12-22T08:42:42.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.373+0000 7f3dbe7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc015af70 0x7f3dc01f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:42.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.373+0000 7f3dbe7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc015af70 0x7f3dc01f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40764/0 (socket says 172.21.15.38:40764) 2023-12-22T08:42:42.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.373+0000 7f3dbe7fc640 1 -- 172.21.15.38:0/511933096 learned_addr learned my addr 172.21.15.38:0/511933096 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:42.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.374+0000 7f3dbf7fe640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc015b350 0x7f3dc014c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:42.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.374+0000 7f3dbeffd640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dc006c930 0x7f3dc00aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:42.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.374+0000 7f3dbe7fc640 1 -- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dc006c930 msgr2=0x7f3dc00aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:42.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.374+0000 7f3dbe7fc640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dc006c930 0x7f3dc00aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.374+0000 7f3dbe7fc640 1 -- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc015b350 msgr2=0x7f3dc014c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:42.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.374+0000 7f3dbe7fc640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc015b350 0x7f3dc014c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.374+0000 7f3dbe7fc640 1 -- 172.21.15.38:0/511933096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80094d0 con 0x7f3dc015af70 2023-12-22T08:42:42.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.374+0000 7f3dbe7fc640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc015af70 0x7f3dc01f54a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3da80098a0 tx=0x7f3da8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:42.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.375+0000 7f3db77fe640 1 -- 172.21.15.38:0/511933096 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8039a90 con 0x7f3dc015af70 2023-12-22T08:42:42.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.375+0000 7f3db77fe640 1 -- 172.21.15.38:0/511933096 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da8039bf0 con 0x7f3dc015af70 2023-12-22T08:42:42.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.375+0000 7f3dc56f7640 1 -- 172.21.15.38:0/511933096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc014ccb0 con 0x7f3dc015af70 2023-12-22T08:42:42.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.375+0000 7f3db77fe640 1 -- 172.21.15.38:0/511933096 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8043410 con 0x7f3dc015af70 2023-12-22T08:42:42.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.375+0000 7f3dc56f7640 1 -- 172.21.15.38:0/511933096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc00c22c0 con 0x7f3dc015af70 2023-12-22T08:42:42.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.376+0000 7f3dc56f7640 1 -- 172.21.15.38:0/511933096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc014d1d0 con 0x7f3dc015af70 2023-12-22T08:42:42.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.377+0000 7f3db77fe640 1 -- 172.21.15.38:0/511933096 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3da802f390 con 0x7f3dc015af70 2023-12-22T08:42:42.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.378+0000 7f3db77fe640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3da006a430 0x7f3da006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:42.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.378+0000 7f3db77fe640 1 -- 172.21.15.38:0/511933096 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3da80aaa90 con 0x7f3dc015af70 2023-12-22T08:42:42.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.379+0000 7f3dbeffd640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3da006a430 0x7f3da006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:42.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.380+0000 7f3dbeffd640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3da006a430 0x7f3da006c8f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3db00074a0 tx=0x7f3db000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:42.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.382+0000 7f3db77fe640 1 -- 172.21.15.38:0/511933096 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3da8076100 con 0x7f3dc015af70 2023-12-22T08:42:42.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.576+0000 7f3dc56f7640 1 -- 172.21.15.38:0/511933096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3dc00c27e0 con 0x7f3dc015af70 2023-12-22T08:42:42.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.577+0000 7f3db77fe640 1 -- 172.21.15.38:0/511933096 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3dc00c27e0 con 0x7f3dc015af70 2023-12-22T08:42:42.579 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:42:42.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.580+0000 7f3dc56f7640 1 -- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3da006a430 msgr2=0x7f3da006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:42.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.580+0000 7f3dc56f7640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3da006a430 0x7f3da006c8f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3db00074a0 tx=0x7f3db000b040 comp rx=0 tx=0).stop 2023-12-22T08:42:42.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.580+0000 7f3dc56f7640 1 -- 172.21.15.38:0/511933096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc015af70 msgr2=0x7f3dc01f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:42.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.580+0000 7f3dc56f7640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc015af70 0x7f3dc01f54a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3da80098a0 tx=0x7f3da8004730 comp rx=0 tx=0).stop 2023-12-22T08:42:42.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.580+0000 7f3dc56f7640 1 -- 172.21.15.38:0/511933096 shutdown_connections 2023-12-22T08:42:42.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.580+0000 7f3dc56f7640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dc015b350 0x7f3dc014c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.580+0000 7f3dc56f7640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3da006a430 0x7f3da006c8f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.580+0000 7f3dc56f7640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc015af70 0x7f3dc01f54a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.580+0000 7f3dc56f7640 1 --2- 172.21.15.38:0/511933096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dc006c930 0x7f3dc00aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.580+0000 7f3dc56f7640 1 -- 172.21.15.38:0/511933096 >> 172.21.15.38:0/511933096 conn(0x7f3dc00cf8a0 msgr2=0x7f3dc00cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:42.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.580+0000 7f3dc56f7640 1 -- 172.21.15.38:0/511933096 shutdown_connections 2023-12-22T08:42:42.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.580+0000 7f3dc56f7640 1 -- 172.21.15.38:0/511933096 wait complete. 2023-12-22T08:42:42.601 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:42:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.822+0000 7f02da511640 1 Processor -- start 2023-12-22T08:42:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.823+0000 7f02da511640 1 -- start start 2023-12-22T08:42:42.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.824+0000 7f02da511640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d41425f0 0x7f02d4070840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:42.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.824+0000 7f02da511640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f02d41430e0 0x7f02d40cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:42.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.824+0000 7f02da511640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d40b1d30 con 0x7f02d4070d80 2023-12-22T08:42:42.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.824+0000 7f02da511640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d40711a0 con 0x7f02d41430e0 2023-12-22T08:42:42.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.824+0000 7f02da511640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d41438c0 con 0x7f02d41425f0 2023-12-22T08:42:42.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.825+0000 7f02d9d10640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f02d41430e0 0x7f02d40cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:42.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.825+0000 7f02d9d10640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f02d41430e0 0x7f02d40cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40780/0 (socket says 172.21.15.38:40780) 2023-12-22T08:42:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.825+0000 7f02d9d10640 1 -- 172.21.15.38:0/463914909 learned_addr learned my addr 172.21.15.38:0/463914909 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.825+0000 7f02d950f640 1 --2- 172.21.15.38:0/463914909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d41425f0 0x7f02d4070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.825+0000 7f02d9d10640 1 -- 172.21.15.38:0/463914909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d41425f0 msgr2=0x7f02d4070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.825+0000 7f02d9d10640 1 --2- 172.21.15.38:0/463914909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d41425f0 0x7f02d4070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.825+0000 7f02d9d10640 1 -- 172.21.15.38:0/463914909 >> v1:172.21.15.38:6789/0 conn(0x7f02d4070d80 legacy=0x7f02d41429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:42.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.826+0000 7f02d9d10640 1 -- 172.21.15.38:0/463914909 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d40b1400 con 0x7f02d41430e0 2023-12-22T08:42:42.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.825+0000 7f02cbfff640 1 -- 172.21.15.38:0/463914909 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750440909 0 0) 0x7f02d40b1d30 con 0x7f02d4070d80 2023-12-22T08:42:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.827+0000 7f02d9d10640 1 --2- 172.21.15.38:0/463914909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02d41430e0 0x7f02d40cf340 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009e50 tx=0x7f02cc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a5dfe0e5854c6b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.827+0000 7f02cbfff640 1 -- 172.21.15.38:0/463914909 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc02cb00 con 0x7f02d41430e0 2023-12-22T08:42:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.827+0000 7f02cbfff640 1 -- 172.21.15.38:0/463914909 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc02cc60 con 0x7f02d41430e0 2023-12-22T08:42:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.827+0000 7f02cbfff640 1 -- 172.21.15.38:0/463914909 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc0343f0 con 0x7f02d41430e0 2023-12-22T08:42:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.827+0000 7f02da511640 1 -- 172.21.15.38:0/463914909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02d41430e0 msgr2=0x7f02d40cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.828+0000 7f02da511640 1 --2- 172.21.15.38:0/463914909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02d41430e0 0x7f02d40cf340 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009e50 tx=0x7f02cc02bf60 comp rx=0 tx=0).stop 2023-12-22T08:42:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.828+0000 7f02da511640 1 -- 172.21.15.38:0/463914909 shutdown_connections 2023-12-22T08:42:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.828+0000 7f02da511640 1 --2- 172.21.15.38:0/463914909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02d41430e0 0x7f02d40cf340 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.828+0000 7f02da511640 1 --2- 172.21.15.38:0/463914909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d41425f0 0x7f02d4070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.828+0000 7f02da511640 1 -- 172.21.15.38:0/463914909 >> 172.21.15.38:0/463914909 conn(0x7f02d4060b40 msgr2=0x7f02d406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.828+0000 7f02da511640 1 -- 172.21.15.38:0/463914909 shutdown_connections 2023-12-22T08:42:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.828+0000 7f02da511640 1 -- 172.21.15.38:0/463914909 wait complete. 2023-12-22T08:42:42.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.829+0000 7f02da511640 1 Processor -- start 2023-12-22T08:42:42.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.830+0000 7f02da511640 1 -- start start 2023-12-22T08:42:42.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.830+0000 7f02da511640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02d4070d80 0x7f02d415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:42.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02da511640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02d41425f0 0x7f02d412f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02da511640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d41430e0 0x7f02d40cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02da511640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d412bb30 con 0x7f02d41425f0 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02da511640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d412be10 con 0x7f02d4070d80 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02da511640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d412c0f0 con 0x7f02d41430e0 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02d8d0e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02d41425f0 0x7f02d412f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02d8d0e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02d41425f0 0x7f02d412f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40790/0 (socket says 172.21.15.38:40790) 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02d8d0e640 1 -- 172.21.15.38:0/1567601440 learned_addr learned my addr 172.21.15.38:0/1567601440 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02d950f640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02d4070d80 0x7f02d415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02d9d10640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d41430e0 0x7f02d40cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02d8d0e640 1 -- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d41430e0 msgr2=0x7f02d40cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02d8d0e640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d41430e0 0x7f02d40cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02d8d0e640 1 -- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02d4070d80 msgr2=0x7f02d415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02d8d0e640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02d4070d80 0x7f02d415dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.831+0000 7f02d8d0e640 1 -- 172.21.15.38:0/1567601440 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc009b30 con 0x7f02d41425f0 2023-12-22T08:42:42.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.832+0000 7f02d8d0e640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02d41425f0 0x7f02d412f020 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c410 tx=0x7f02c400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:42.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.832+0000 7f02c9ffb640 1 -- 172.21.15.38:0/1567601440 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40035f0 con 0x7f02d41425f0 2023-12-22T08:42:42.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.832+0000 7f02c9ffb640 1 -- 172.21.15.38:0/1567601440 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4003770 con 0x7f02d41425f0 2023-12-22T08:42:42.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.832+0000 7f02da511640 1 -- 172.21.15.38:0/1567601440 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d412c3d0 con 0x7f02d41425f0 2023-12-22T08:42:42.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.832+0000 7f02c9ffb640 1 -- 172.21.15.38:0/1567601440 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4003b20 con 0x7f02d41425f0 2023-12-22T08:42:42.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.832+0000 7f02da511640 1 -- 172.21.15.38:0/1567601440 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d412c990 con 0x7f02d41425f0 2023-12-22T08:42:42.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.833+0000 7f02da511640 1 -- 172.21.15.38:0/1567601440 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d412cbb0 con 0x7f02d41425f0 2023-12-22T08:42:42.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.834+0000 7f02c9ffb640 1 -- 172.21.15.38:0/1567601440 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f02c4003c80 con 0x7f02d41425f0 2023-12-22T08:42:42.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.835+0000 7f02c9ffb640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02b806a430 0x7f02b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:42.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.835+0000 7f02c9ffb640 1 -- 172.21.15.38:0/1567601440 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02c4087f60 con 0x7f02d41425f0 2023-12-22T08:42:42.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.836+0000 7f02d950f640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02b806a430 0x7f02b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:42.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.837+0000 7f02d950f640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02b806a430 0x7f02b806c8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009a30 tx=0x7f02d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:42.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:42.840+0000 7f02c9ffb640 1 -- 172.21.15.38:0/1567601440 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f02c4053540 con 0x7f02d41425f0 2023-12-22T08:42:43.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.043+0000 7f02da511640 1 -- 172.21.15.38:0/1567601440 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f02d4061910 con 0x7f02d41425f0 2023-12-22T08:42:43.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.044+0000 7f02c9ffb640 1 -- 172.21.15.38:0/1567601440 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f02c4017080 con 0x7f02d41425f0 2023-12-22T08:42:43.046 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:42:43.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.047+0000 7f02da511640 1 -- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02b806a430 msgr2=0x7f02b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:43.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.047+0000 7f02da511640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02b806a430 0x7f02b806c8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009a30 tx=0x7f02d0008040 comp rx=0 tx=0).stop 2023-12-22T08:42:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.047+0000 7f02da511640 1 -- 172.21.15.38:0/1567601440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02d41425f0 msgr2=0x7f02d412f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.047+0000 7f02da511640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02d41425f0 0x7f02d412f020 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c410 tx=0x7f02c400c8d0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.047+0000 7f02da511640 1 -- 172.21.15.38:0/1567601440 shutdown_connections 2023-12-22T08:42:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.047+0000 7f02da511640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02d41430e0 0x7f02d40cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.047+0000 7f02da511640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02b806a430 0x7f02b806c8f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.047+0000 7f02da511640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02d41425f0 0x7f02d412f020 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.047+0000 7f02da511640 1 --2- 172.21.15.38:0/1567601440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02d4070d80 0x7f02d415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.047+0000 7f02da511640 1 -- 172.21.15.38:0/1567601440 >> 172.21.15.38:0/1567601440 conn(0x7f02d4060b40 msgr2=0x7f02d4141700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.047+0000 7f02da511640 1 -- 172.21.15.38:0/1567601440 shutdown_connections 2023-12-22T08:42:43.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.047+0000 7f02da511640 1 -- 172.21.15.38:0/1567601440 wait complete. 2023-12-22T08:42:43.069 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T08:42:43.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:43.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-22T08:42:43.177 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:42:43.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:42:43.177 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T08:42:43.227 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:42:43.227 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:43.293 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:42:43.293 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:42:43.293 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:43.355 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:42:43.355 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:42:43.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.580+0000 7ff748826640 1 Processor -- start 2023-12-22T08:42:43.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.581+0000 7ff748826640 1 -- start start 2023-12-22T08:42:43.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.583+0000 7ff748826640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff744146fc0 0x7ff74415e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:43.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.583+0000 7ff748826640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff744162200 con 0x7ff744146be0 2023-12-22T08:42:43.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.583+0000 7ff748826640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff744161440 con 0x7ff7440d1800 2023-12-22T08:42:43.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.583+0000 7ff748826640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74415ed10 con 0x7ff744146fc0 2023-12-22T08:42:43.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.583+0000 7ff74259c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff744146be0 0x7ff7440d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49658/0 (socket says 172.21.15.38:49658) 2023-12-22T08:42:43.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.583+0000 7ff74259c640 1 -- 172.21.15.38:0/3806600075 learned_addr learned my addr 172.21.15.38:0/3806600075 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:43.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.583+0000 7ff742d9d640 1 --2- 172.21.15.38:0/3806600075 >> v2:172.21.15.38:3300/0 conn(0x7ff744146fc0 0x7ff74415e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:43.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.584+0000 7ff74159a640 1 -- 172.21.15.38:0/3806600075 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770004040 0 0) 0x7ff744162200 con 0x7ff744146be0 2023-12-22T08:42:43.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.584+0000 7ff74159a640 1 -- 172.21.15.38:0/3806600075 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff730003520 con 0x7ff744146be0 2023-12-22T08:42:43.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.584+0000 7ff742d9d640 1 -- 172.21.15.38:0/3806600075 >> v1:172.21.15.89:6789/0 conn(0x7ff7440d1800 legacy=0x7ff74415dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:43.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.584+0000 7ff742d9d640 1 -- 172.21.15.38:0/3806600075 >> v1:172.21.15.38:6789/0 conn(0x7ff744146be0 legacy=0x7ff7440d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:43.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.584+0000 7ff742d9d640 1 -- 172.21.15.38:0/3806600075 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff744161720 con 0x7ff744146fc0 2023-12-22T08:42:43.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.585+0000 7ff742d9d640 1 --2- 172.21.15.38:0/3806600075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff744146fc0 0x7ff74415e6c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0097a0 tx=0x7ff73c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42c25d6cc230d37 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:43.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.585+0000 7ff74159a640 1 -- 172.21.15.38:0/3806600075 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c031830 con 0x7ff744146fc0 2023-12-22T08:42:43.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.586+0000 7ff74159a640 1 -- 172.21.15.38:0/3806600075 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c031990 con 0x7ff744146fc0 2023-12-22T08:42:43.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.586+0000 7ff74159a640 1 -- 172.21.15.38:0/3806600075 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c031d00 con 0x7ff744146fc0 2023-12-22T08:42:43.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.586+0000 7ff748826640 1 -- 172.21.15.38:0/3806600075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff744146fc0 msgr2=0x7ff74415e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:43.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.586+0000 7ff748826640 1 --2- 172.21.15.38:0/3806600075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff744146fc0 0x7ff74415e6c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0097a0 tx=0x7ff73c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.586+0000 7ff748826640 1 -- 172.21.15.38:0/3806600075 shutdown_connections 2023-12-22T08:42:43.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.586+0000 7ff748826640 1 --2- 172.21.15.38:0/3806600075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff744146fc0 0x7ff74415e6c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.586+0000 7ff748826640 1 -- 172.21.15.38:0/3806600075 >> 172.21.15.38:0/3806600075 conn(0x7ff74406c5e0 msgr2=0x7ff74406c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:43.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.586+0000 7ff748826640 1 -- 172.21.15.38:0/3806600075 shutdown_connections 2023-12-22T08:42:43.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.586+0000 7ff748826640 1 -- 172.21.15.38:0/3806600075 wait complete. 2023-12-22T08:42:43.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.588+0000 7ff748826640 1 Processor -- start 2023-12-22T08:42:43.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.588+0000 7ff748826640 1 -- start start 2023-12-22T08:42:43.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.589+0000 7ff748826640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7440d1800 0x7ff7440ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:43.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.589+0000 7ff748826640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff744146be0 0x7ff7440cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:43.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.589+0000 7ff748826640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff744146fc0 0x7ff744145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:43.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.589+0000 7ff748826640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74415af50 con 0x7ff7440d1800 2023-12-22T08:42:43.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.589+0000 7ff748826640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7440cc920 con 0x7ff744146be0 2023-12-22T08:42:43.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.589+0000 7ff748826640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7440cf920 con 0x7ff744146fc0 2023-12-22T08:42:43.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.589+0000 7ff74259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7440d1800 0x7ff7440ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:43.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.590+0000 7ff74259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7440d1800 0x7ff7440ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40802/0 (socket says 172.21.15.38:40802) 2023-12-22T08:42:43.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.590+0000 7ff74259c640 1 -- 172.21.15.38:0/3873916230 learned_addr learned my addr 172.21.15.38:0/3873916230 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:43.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.590+0000 7ff741d9b640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff744146be0 0x7ff7440cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.590+0000 7ff742d9d640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff744146fc0 0x7ff744145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.590+0000 7ff74259c640 1 -- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff744146fc0 msgr2=0x7ff744145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.590+0000 7ff74259c640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff744146fc0 0x7ff744145410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.590+0000 7ff74259c640 1 -- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff744146be0 msgr2=0x7ff7440cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.590+0000 7ff74259c640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff744146be0 0x7ff7440cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.590+0000 7ff74259c640 1 -- 172.21.15.38:0/3873916230 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c009400 con 0x7ff7440d1800 2023-12-22T08:42:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.590+0000 7ff741d9b640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff744146be0 0x7ff7440cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.590+0000 7ff74259c640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7440d1800 0x7ff7440ce710 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff73400c430 tx=0x7ff73400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.591+0000 7ff73affd640 1 -- 172.21.15.38:0/3873916230 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734005ce0 con 0x7ff7440d1800 2023-12-22T08:42:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.591+0000 7ff73affd640 1 -- 172.21.15.38:0/3873916230 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff734005e40 con 0x7ff7440d1800 2023-12-22T08:42:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.591+0000 7ff748826640 1 -- 172.21.15.38:0/3873916230 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7440ceda0 con 0x7ff7440d1800 2023-12-22T08:42:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.591+0000 7ff73affd640 1 -- 172.21.15.38:0/3873916230 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7340072f0 con 0x7ff7440d1800 2023-12-22T08:42:43.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.591+0000 7ff748826640 1 -- 172.21.15.38:0/3873916230 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7440cf360 con 0x7ff7440d1800 2023-12-22T08:42:43.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.592+0000 7ff748826640 1 -- 172.21.15.38:0/3873916230 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74415b090 con 0x7ff7440d1800 2023-12-22T08:42:43.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.593+0000 7ff73affd640 1 -- 172.21.15.38:0/3873916230 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff734007450 con 0x7ff7440d1800 2023-12-22T08:42:43.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.594+0000 7ff73affd640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff72406a430 0x7ff72406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:43.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.594+0000 7ff73affd640 1 -- 172.21.15.38:0/3873916230 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff734087ff0 con 0x7ff7440d1800 2023-12-22T08:42:43.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.595+0000 7ff741d9b640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff72406a430 0x7ff72406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:43.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.596+0000 7ff741d9b640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff72406a430 0x7ff72406c8f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff7440cdc90 tx=0x7ff72c0073a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:43.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.599+0000 7ff73affd640 1 -- 172.21.15.38:0/3873916230 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff7340535d0 con 0x7ff7440d1800 2023-12-22T08:42:43.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.831+0000 7ff748826640 1 -- 172.21.15.38:0/3873916230 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff744061910 con 0x7ff7440d1800 2023-12-22T08:42:43.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.832+0000 7ff73affd640 1 -- 172.21.15.38:0/3873916230 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4648 (secure 0 0 0) 0x7ff734017090 con 0x7ff7440d1800 2023-12-22T08:42:43.834 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:43.834 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2078860804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2078860804},{"type":"v1","addr":"172.21.15.38:6835","nonce":2078860804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4244510882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4244510882},{"type":"v1","addr":"172.21.15.89:6837","nonce":4244510882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3227878158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3227878158},{"type":"v1","addr":"172.21.15.38:6834","nonce":3227878158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:42:00.933947+0000","modified":"2023-12-22T08:42:03.951929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5538":{"gid":5538,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2131151279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2131151279},{"type":"v1","addr":"172.21.15.89:6836","nonce":2131151279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T08:42:43.834 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2023-12-22T08:42:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.834+0000 7ff748826640 1 -- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff72406a430 msgr2=0x7ff72406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.834+0000 7ff748826640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff72406a430 0x7ff72406c8f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff7440cdc90 tx=0x7ff72c0073a0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.834+0000 7ff748826640 1 -- 172.21.15.38:0/3873916230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7440d1800 msgr2=0x7ff7440ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.834+0000 7ff748826640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7440d1800 0x7ff7440ce710 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff73400c430 tx=0x7ff73400c8f0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.834+0000 7ff748826640 1 -- 172.21.15.38:0/3873916230 shutdown_connections 2023-12-22T08:42:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.834+0000 7ff748826640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff744146fc0 0x7ff744145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.834+0000 7ff748826640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff744146be0 0x7ff7440cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.834+0000 7ff748826640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff72406a430 0x7ff72406c8f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.834+0000 7ff748826640 1 --2- 172.21.15.38:0/3873916230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff7440d1800 0x7ff7440ce710 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.834+0000 7ff748826640 1 -- 172.21.15.38:0/3873916230 >> 172.21.15.38:0/3873916230 conn(0x7ff74406c5e0 msgr2=0x7ff7440b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.835+0000 7ff748826640 1 -- 172.21.15.38:0/3873916230 shutdown_connections 2023-12-22T08:42:43.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:43.835+0000 7ff748826640 1 -- 172.21.15.38:0/3873916230 wait complete. 2023-12-22T08:42:43.856 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:42:44.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.077+0000 7fe6d759e640 1 Processor -- start 2023-12-22T08:42:44.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.078+0000 7fe6d759e640 1 -- start start 2023-12-22T08:42:44.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.079+0000 7fe6d759e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe6d80a44a0 0x7fe6d80708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.079+0000 7fe6d759e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe6d8070e30 0x7fe6d815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.079+0000 7fe6d759e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d80cdae0 con 0x7fe6d815b420 2023-12-22T08:42:44.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.079+0000 7fe6d759e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d8071250 con 0x7fe6d80a44a0 2023-12-22T08:42:44.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.079+0000 7fe6d759e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d815b800 con 0x7fe6d8070e30 2023-12-22T08:42:44.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.080+0000 7fe6cffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe6d80a44a0 0x7fe6d80708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.080+0000 7fe6d659c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe6d815b420 0x7fe6d806d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49664/0 (socket says 172.21.15.38:49664) 2023-12-22T08:42:44.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.080+0000 7fe6d659c640 1 -- 172.21.15.38:0/3102758115 learned_addr learned my addr 172.21.15.38:0/3102758115 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:44.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.080+0000 7fe6d6d9d640 1 --2- 172.21.15.38:0/3102758115 >> v2:172.21.15.89:3300/0 conn(0x7fe6d8070e30 0x7fe6d815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.080+0000 7fe6cffff640 1 -- 172.21.15.38:0/3102758115 >> v2:172.21.15.89:3300/0 conn(0x7fe6d8070e30 msgr2=0x7fe6d815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:44.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.080+0000 7fe6cffff640 1 --2- 172.21.15.38:0/3102758115 >> v2:172.21.15.89:3300/0 conn(0x7fe6d8070e30 0x7fe6d815baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.080+0000 7fe6cffff640 1 -- 172.21.15.38:0/3102758115 >> v1:172.21.15.38:6789/0 conn(0x7fe6d815b420 legacy=0x7fe6d806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:44.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.080+0000 7fe6cffff640 1 -- 172.21.15.38:0/3102758115 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d80cdd30 con 0x7fe6d80a44a0 2023-12-22T08:42:44.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.080+0000 7fe6d5d9b640 1 -- 172.21.15.38:0/3102758115 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560667981 0 0) 0x7fe6d80cdae0 con 0x7fe6d815b420 2023-12-22T08:42:44.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.082+0000 7fe6cffff640 1 --2- 172.21.15.38:0/3102758115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6d80a44a0 0x7fe6d80708f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8070670 tx=0x7fe6c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac8633308b08556 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:44.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.082+0000 7fe6d5d9b640 1 -- 172.21.15.38:0/3102758115 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0031830 con 0x7fe6d80a44a0 2023-12-22T08:42:44.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.082+0000 7fe6d5d9b640 1 -- 172.21.15.38:0/3102758115 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c0031990 con 0x7fe6d80a44a0 2023-12-22T08:42:44.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.082+0000 7fe6d5d9b640 1 -- 172.21.15.38:0/3102758115 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0031d20 con 0x7fe6d80a44a0 2023-12-22T08:42:44.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.083+0000 7fe6d759e640 1 -- 172.21.15.38:0/3102758115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6d80a44a0 msgr2=0x7fe6d80708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:44.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.083+0000 7fe6d759e640 1 --2- 172.21.15.38:0/3102758115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6d80a44a0 0x7fe6d80708f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8070670 tx=0x7fe6c002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.083+0000 7fe6d759e640 1 -- 172.21.15.38:0/3102758115 shutdown_connections 2023-12-22T08:42:44.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.083+0000 7fe6d759e640 1 --2- 172.21.15.38:0/3102758115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6d80a44a0 0x7fe6d80708f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.083+0000 7fe6d759e640 1 --2- 172.21.15.38:0/3102758115 >> v2:172.21.15.89:3300/0 conn(0x7fe6d8070e30 0x7fe6d815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.083+0000 7fe6d759e640 1 -- 172.21.15.38:0/3102758115 >> 172.21.15.38:0/3102758115 conn(0x7fe6d80b1f70 msgr2=0x7fe6d80b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:44.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.083+0000 7fe6d759e640 1 -- 172.21.15.38:0/3102758115 shutdown_connections 2023-12-22T08:42:44.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.083+0000 7fe6d759e640 1 -- 172.21.15.38:0/3102758115 wait complete. 2023-12-22T08:42:44.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.085+0000 7fe6d759e640 1 Processor -- start 2023-12-22T08:42:44.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.085+0000 7fe6d759e640 1 -- start start 2023-12-22T08:42:44.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6d8070e30 0x7fe6d814b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6d80a44a0 0x7fe6d81484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6d815b420 0x7fe6d80c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d814bdd0 con 0x7fe6d815b420 2023-12-22T08:42:44.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d81f3970 con 0x7fe6d80a44a0 2023-12-22T08:42:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d81f2df0 con 0x7fe6d8070e30 2023-12-22T08:42:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6d815b420 0x7fe6d80c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6d815b420 0x7fe6d80c2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40824/0 (socket says 172.21.15.38:40824) 2023-12-22T08:42:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d6d9d640 1 -- 172.21.15.38:0/4007570462 learned_addr learned my addr 172.21.15.38:0/4007570462 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6cffff640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6d80a44a0 0x7fe6d81484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d659c640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6d8070e30 0x7fe6d814b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d6d9d640 1 -- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6d8070e30 msgr2=0x7fe6d814b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:44.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d6d9d640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6d8070e30 0x7fe6d814b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d6d9d640 1 -- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6d80a44a0 msgr2=0x7fe6d81484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:44.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d6d9d640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6d80a44a0 0x7fe6d81484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6d6d9d640 1 -- 172.21.15.38:0/4007570462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c0009400 con 0x7fe6d815b420 2023-12-22T08:42:44.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.086+0000 7fe6cffff640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6d80a44a0 0x7fe6d81484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:44.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.087+0000 7fe6d6d9d640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6d815b420 0x7fe6d80c2070 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0007e60 tx=0x7fe6d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:44.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.087+0000 7fe6ceffd640 1 -- 172.21.15.38:0/4007570462 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0014420 con 0x7fe6d815b420 2023-12-22T08:42:44.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.087+0000 7fe6ceffd640 1 -- 172.21.15.38:0/4007570462 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d00145a0 con 0x7fe6d815b420 2023-12-22T08:42:44.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.087+0000 7fe6d759e640 1 -- 172.21.15.38:0/4007570462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d81f30d0 con 0x7fe6d815b420 2023-12-22T08:42:44.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.087+0000 7fe6ceffd640 1 -- 172.21.15.38:0/4007570462 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0014950 con 0x7fe6d815b420 2023-12-22T08:42:44.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.087+0000 7fe6d759e640 1 -- 172.21.15.38:0/4007570462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d81f3690 con 0x7fe6d815b420 2023-12-22T08:42:44.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.088+0000 7fe6d759e640 1 -- 172.21.15.38:0/4007570462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d8061910 con 0x7fe6d815b420 2023-12-22T08:42:44.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.089+0000 7fe6ceffd640 1 -- 172.21.15.38:0/4007570462 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe6d0014ab0 con 0x7fe6d815b420 2023-12-22T08:42:44.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.091+0000 7fe6ceffd640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe6b806a430 0x7fe6b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.091+0000 7fe6ceffd640 1 -- 172.21.15.38:0/4007570462 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6d0089240 con 0x7fe6d815b420 2023-12-22T08:42:44.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.091+0000 7fe6d659c640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe6b806a430 0x7fe6b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.092+0000 7fe6d659c640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe6b806a430 0x7fe6b806c8f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8007fd0 tx=0x7fe6c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:44.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.095+0000 7fe6ceffd640 1 -- 172.21.15.38:0/4007570462 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe6d0054820 con 0x7fe6d815b420 2023-12-22T08:42:44.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.293+0000 7fe6d759e640 1 -- 172.21.15.38:0/4007570462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6d8148e80 con 0x7fe6d815b420 2023-12-22T08:42:44.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.296+0000 7fe6ceffd640 1 -- 172.21.15.38:0/4007570462 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+15993 (secure 0 0 0) 0x7fe6d0057e40 con 0x7fe6d815b420 2023-12-22T08:42:44.298 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:44.298 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":59,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:42:33.327912+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:58.840533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:59.953505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:42:44.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.298+0000 7fe6d759e640 1 -- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe6b806a430 msgr2=0x7fe6b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:44.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.298+0000 7fe6d759e640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe6b806a430 0x7fe6b806c8f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8007fd0 tx=0x7fe6c8009040 comp rx=0 tx=0).stop 2023-12-22T08:42:44.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.298+0000 7fe6d759e640 1 -- 172.21.15.38:0/4007570462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6d815b420 msgr2=0x7fe6d80c2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:44.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.298+0000 7fe6d759e640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6d815b420 0x7fe6d80c2070 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0007e60 tx=0x7fe6d000e4b0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.298+0000 7fe6d759e640 1 -- 172.21.15.38:0/4007570462 shutdown_connections 2023-12-22T08:42:44.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.298+0000 7fe6d759e640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe6b806a430 0x7fe6b806c8f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.298+0000 7fe6d759e640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6d815b420 0x7fe6d80c2070 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.298+0000 7fe6d759e640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6d80a44a0 0x7fe6d81484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.298+0000 7fe6d759e640 1 --2- 172.21.15.38:0/4007570462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6d8070e30 0x7fe6d814b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.298+0000 7fe6d759e640 1 -- 172.21.15.38:0/4007570462 >> 172.21.15.38:0/4007570462 conn(0x7fe6d80b1f70 msgr2=0x7fe6d80cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:44.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.298+0000 7fe6d759e640 1 -- 172.21.15.38:0/4007570462 shutdown_connections 2023-12-22T08:42:44.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.299+0000 7fe6d759e640 1 -- 172.21.15.38:0/4007570462 wait complete. 2023-12-22T08:42:44.319 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:41:58.840533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:41:59.953505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:42:44.320 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:42:44.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.542+0000 7f25d0c80640 1 Processor -- start 2023-12-22T08:42:44.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.543+0000 7f25d0c80640 1 -- start start 2023-12-22T08:42:44.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.544+0000 7f25d0c80640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f25cc163d50 0x7f25cc166140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.544+0000 7f25d0c80640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc06d5f0 con 0x7f25cc070f50 2023-12-22T08:42:44.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.544+0000 7f25d0c80640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc144fa0 con 0x7f25cc070b70 2023-12-22T08:42:44.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.544+0000 7f25d0c80640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc06da80 con 0x7f25cc163d50 2023-12-22T08:42:44.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.545+0000 7f25c3fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f25cc070f50 0x7f25cc0713b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49678/0 (socket says 172.21.15.38:49678) 2023-12-22T08:42:44.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.545+0000 7f25c3fff640 1 -- 172.21.15.38:0/2621351497 learned_addr learned my addr 172.21.15.38:0/2621351497 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:44.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.545+0000 7f25cbfff640 1 --2- 172.21.15.38:0/2621351497 >> v2:172.21.15.89:3300/0 conn(0x7f25cc163d50 0x7f25cc166140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.545+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296926605 0 0) 0x7f25cc06d5f0 con 0x7f25cc070f50 2023-12-22T08:42:44.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.545+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25b8003520 con 0x7f25cc070f50 2023-12-22T08:42:44.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 766830274 0 0) 0x7f25b8003520 con 0x7f25cc070f50 2023-12-22T08:42:44.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 >> v2:172.21.15.89:3300/0 conn(0x7f25cc163d50 msgr2=0x7f25cc166140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:44.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25caffd640 1 --2- 172.21.15.38:0/2621351497 >> v2:172.21.15.89:3300/0 conn(0x7f25cc163d50 0x7f25cc166140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 >> v1:172.21.15.89:6789/0 conn(0x7f25cc070b70 legacy=0x7f25cc06bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc06c9e0 con 0x7f25cc070f50 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f25b4001670 con 0x7f25cc070f50 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 >> v1:172.21.15.38:6789/0 conn(0x7f25cc070f50 legacy=0x7f25cc0713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25caffd640 1 --2- 172.21.15.38:0/2621351497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b8003970 0x7f25b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25caffd640 1 --2- 172.21.15.38:0/2621351497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25b80047c0 0x7f25b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25caffd640 1 --2- 172.21.15.38:0/2621351497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25b8005180 0x7f25b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc06da80 con 0x7f25b80047c0 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b800c020 con 0x7f25b8005180 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b800c1e0 con 0x7f25b8003970 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25c3fff640 1 --2- 172.21.15.38:0/2621351497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25b80047c0 0x7f25b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25cbfff640 1 --2- 172.21.15.38:0/2621351497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25b8005180 0x7f25b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.546+0000 7f25cb7fe640 1 --2- 172.21.15.38:0/2621351497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b8003970 0x7f25b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.547+0000 7f25c3fff640 1 -- 172.21.15.38:0/2621351497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b8003970 msgr2=0x7f25b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:44.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.547+0000 7f25c3fff640 1 --2- 172.21.15.38:0/2621351497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b8003970 0x7f25b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.547+0000 7f25c3fff640 1 -- 172.21.15.38:0/2621351497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25b8005180 msgr2=0x7f25b800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:44.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.547+0000 7f25c3fff640 1 --2- 172.21.15.38:0/2621351497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25b8005180 0x7f25b800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.547+0000 7f25c3fff640 1 -- 172.21.15.38:0/2621351497 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b8003520 con 0x7f25b80047c0 2023-12-22T08:42:44.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.547+0000 7f25cbfff640 1 -- 172.21.15.38:0/2621351497 reap_dead start 2023-12-22T08:42:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.548+0000 7f25c3fff640 1 --2- 172.21.15.38:0/2621351497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25b80047c0 0x7f25b8004c40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c240 tx=0x7f25b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e5944b2f429a29 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.548+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4005ad0 con 0x7f25b80047c0 2023-12-22T08:42:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.548+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4005c50 con 0x7f25b80047c0 2023-12-22T08:42:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.548+0000 7f25caffd640 1 -- 172.21.15.38:0/2621351497 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b402c870 con 0x7f25b80047c0 2023-12-22T08:42:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.549+0000 7f25d0c80640 1 -- 172.21.15.38:0/2621351497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25b80047c0 msgr2=0x7f25b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.549+0000 7f25d0c80640 1 --2- 172.21.15.38:0/2621351497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25b80047c0 0x7f25b8004c40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c240 tx=0x7f25b80057f0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.549+0000 7f25d0c80640 1 -- 172.21.15.38:0/2621351497 shutdown_connections 2023-12-22T08:42:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.549+0000 7f25d0c80640 1 --2- 172.21.15.38:0/2621351497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25b80047c0 0x7f25b8004c40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.549+0000 7f25d0c80640 1 -- 172.21.15.38:0/2621351497 >> 172.21.15.38:0/2621351497 conn(0x7f25cc0b0b60 msgr2=0x7f25cc0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:44.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.549+0000 7f25d0c80640 1 -- 172.21.15.38:0/2621351497 shutdown_connections 2023-12-22T08:42:44.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.549+0000 7f25d0c80640 1 -- 172.21.15.38:0/2621351497 wait complete. 2023-12-22T08:42:44.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.551+0000 7f25d0c80640 1 Processor -- start 2023-12-22T08:42:44.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.551+0000 7f25d0c80640 1 -- start start 2023-12-22T08:42:44.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.552+0000 7f25d0c80640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b80047c0 0x7f25cc0ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.552+0000 7f25d0c80640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25cc13d5a0 0x7f25cc13da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.552+0000 7f25d0c80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25cc071330 0x7f25cc0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.552+0000 7f25d0c80640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc071cf0 con 0x7f25cc13d5a0 2023-12-22T08:42:44.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.552+0000 7f25d0c80640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1f28b0 con 0x7f25cc071330 2023-12-22T08:42:44.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.552+0000 7f25d0c80640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1f3700 con 0x7f25b80047c0 2023-12-22T08:42:44.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.552+0000 7f25c3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25cc13d5a0 0x7f25cc13da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.552+0000 7f25c3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25cc13d5a0 0x7f25cc13da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40836/0 (socket says 172.21.15.38:40836) 2023-12-22T08:42:44.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.552+0000 7f25c3fff640 1 -- 172.21.15.38:0/2502804438 learned_addr learned my addr 172.21.15.38:0/2502804438 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:44.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.553+0000 7f25cbfff640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25cc071330 0x7f25cc0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.553+0000 7f25cb7fe640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b80047c0 0x7f25cc0ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.553+0000 7f25c3fff640 1 -- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b80047c0 msgr2=0x7f25cc0ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:44.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.553+0000 7f25c3fff640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b80047c0 0x7f25cc0ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.553+0000 7f25c3fff640 1 -- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25cc071330 msgr2=0x7f25cc0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:44.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.553+0000 7f25c3fff640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25cc071330 0x7f25cc0717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.553+0000 7f25c3fff640 1 -- 172.21.15.38:0/2502804438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc163ad0 con 0x7f25cc13d5a0 2023-12-22T08:42:44.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.553+0000 7f25cbfff640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25cc071330 0x7f25cc0717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:44.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.553+0000 7f25c3fff640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25cc13d5a0 0x7f25cc13da00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f25b4001930 tx=0x7f25b402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:44.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.553+0000 7f25c8ff9640 1 -- 172.21.15.38:0/2502804438 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b403c040 con 0x7f25cc13d5a0 2023-12-22T08:42:44.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.553+0000 7f25c8ff9640 1 -- 172.21.15.38:0/2502804438 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b402cd40 con 0x7f25cc13d5a0 2023-12-22T08:42:44.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.553+0000 7f25c8ff9640 1 -- 172.21.15.38:0/2502804438 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4007270 con 0x7f25cc13d5a0 2023-12-22T08:42:44.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.553+0000 7f25d0c80640 1 -- 172.21.15.38:0/2502804438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc1f2af0 con 0x7f25cc13d5a0 2023-12-22T08:42:44.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.554+0000 7f25d0c80640 1 -- 172.21.15.38:0/2502804438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc1f30b0 con 0x7f25cc13d5a0 2023-12-22T08:42:44.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.555+0000 7f25d0c80640 1 -- 172.21.15.38:0/2502804438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc061910 con 0x7f25cc13d5a0 2023-12-22T08:42:44.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.556+0000 7f25c8ff9640 1 -- 172.21.15.38:0/2502804438 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f25b4032070 con 0x7f25cc13d5a0 2023-12-22T08:42:44.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.556+0000 7f25c8ff9640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25ac06a430 0x7f25ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:44.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.557+0000 7f25c8ff9640 1 -- 172.21.15.38:0/2502804438 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25b40a9db0 con 0x7f25cc13d5a0 2023-12-22T08:42:44.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.557+0000 7f25cb7fe640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25ac06a430 0x7f25ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:44.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.558+0000 7f25cb7fe640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25ac06a430 0x7f25ac06c8f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f25bc007fd0 tx=0x7f25bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:44.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.561+0000 7f25c8ff9640 1 -- 172.21.15.38:0/2502804438 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f25b40753a0 con 0x7f25cc13d5a0 2023-12-22T08:42:44.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.752+0000 7f25d0c80640 1 -- 172.21.15.38:0/2502804438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25cc0b2410 con 0x7f25cc13d5a0 2023-12-22T08:42:44.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.752+0000 7f25c8ff9640 1 -- 172.21.15.38:0/2502804438 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25b40789c0 con 0x7f25cc13d5a0 2023-12-22T08:42:44.755 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:42:44.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.755+0000 7f25d0c80640 1 -- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25ac06a430 msgr2=0x7f25ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:44.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.755+0000 7f25d0c80640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25ac06a430 0x7f25ac06c8f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f25bc007fd0 tx=0x7f25bc009040 comp rx=0 tx=0).stop 2023-12-22T08:42:44.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.755+0000 7f25d0c80640 1 -- 172.21.15.38:0/2502804438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25cc13d5a0 msgr2=0x7f25cc13da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:44.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.755+0000 7f25d0c80640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25cc13d5a0 0x7f25cc13da00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f25b4001930 tx=0x7f25b402e070 comp rx=0 tx=0).stop 2023-12-22T08:42:44.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.755+0000 7f25d0c80640 1 -- 172.21.15.38:0/2502804438 shutdown_connections 2023-12-22T08:42:44.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.755+0000 7f25d0c80640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25cc071330 0x7f25cc0717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.755+0000 7f25d0c80640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25ac06a430 0x7f25ac06c8f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.755+0000 7f25d0c80640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25cc13d5a0 0x7f25cc13da00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.755+0000 7f25d0c80640 1 --2- 172.21.15.38:0/2502804438 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25b80047c0 0x7f25cc0ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:44.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.755+0000 7f25d0c80640 1 -- 172.21.15.38:0/2502804438 >> 172.21.15.38:0/2502804438 conn(0x7f25cc0b0b60 msgr2=0x7f25cc06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:44.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.756+0000 7f25d0c80640 1 -- 172.21.15.38:0/2502804438 shutdown_connections 2023-12-22T08:42:44.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:44.756+0000 7f25d0c80640 1 -- 172.21.15.38:0/2502804438 wait complete. 2023-12-22T08:42:44.778 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:42:45.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.008+0000 7f0bec97d640 1 Processor -- start 2023-12-22T08:42:45.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.008+0000 7f0bec97d640 1 -- start start 2023-12-22T08:42:45.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.010+0000 7f0bec97d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0be815b0e0 0x7f0be815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.010+0000 7f0bec97d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0be8071460 0x7f0be8071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.010+0000 7f0bec97d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be815edf0 con 0x7f0be809c980 2023-12-22T08:42:45.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.010+0000 7f0bec97d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be815d0d0 con 0x7f0be815b0e0 2023-12-22T08:42:45.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.010+0000 7f0bec97d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be8071db0 con 0x7f0be8071460 2023-12-22T08:42:45.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.010+0000 7f0be659c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0be809c980 0x7f0be815c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49684/0 (socket says 172.21.15.38:49684) 2023-12-22T08:42:45.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.010+0000 7f0be659c640 1 -- 172.21.15.38:0/4162158766 learned_addr learned my addr 172.21.15.38:0/4162158766 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:45.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.010+0000 7f0be6d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0be815b0e0 0x7f0be815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.011+0000 7f0be5d9b640 1 -- 172.21.15.38:0/4162158766 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294471774 0 0) 0x7f0be815edf0 con 0x7f0be809c980 2023-12-22T08:42:45.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.011+0000 7f0be759e640 1 --2- 172.21.15.38:0/4162158766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0be8071460 0x7f0be8071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.011+0000 7f0be5d9b640 1 -- 172.21.15.38:0/4162158766 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bd0003520 con 0x7f0be809c980 2023-12-22T08:42:45.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.011+0000 7f0be6d9d640 1 -- 172.21.15.38:0/4162158766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0be8071460 msgr2=0x7f0be8071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:45.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.011+0000 7f0be6d9d640 1 --2- 172.21.15.38:0/4162158766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0be8071460 0x7f0be8071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.011+0000 7f0be6d9d640 1 -- 172.21.15.38:0/4162158766 >> v1:172.21.15.38:6789/0 conn(0x7f0be809c980 legacy=0x7f0be815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.011+0000 7f0be6d9d640 1 -- 172.21.15.38:0/4162158766 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be815bd90 con 0x7f0be815b0e0 2023-12-22T08:42:45.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.011+0000 7f0be759e640 1 --2- 172.21.15.38:0/4162158766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0be8071460 0x7f0be8071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:45.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.012+0000 7f0be6d9d640 1 --2- 172.21.15.38:0/4162158766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0be815b0e0 0x7f0be815b4c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80097a0 tx=0x7f0bd802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e5990479adf234 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:45.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.013+0000 7f0be5d9b640 1 -- 172.21.15.38:0/4162158766 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80316f0 con 0x7f0be815b0e0 2023-12-22T08:42:45.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.013+0000 7f0be5d9b640 1 -- 172.21.15.38:0/4162158766 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd8031850 con 0x7f0be815b0e0 2023-12-22T08:42:45.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.013+0000 7f0be5d9b640 1 -- 172.21.15.38:0/4162158766 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8031be0 con 0x7f0be815b0e0 2023-12-22T08:42:45.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.013+0000 7f0bec97d640 1 -- 172.21.15.38:0/4162158766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0be815b0e0 msgr2=0x7f0be815b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.013+0000 7f0bec97d640 1 --2- 172.21.15.38:0/4162158766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0be815b0e0 0x7f0be815b4c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80097a0 tx=0x7f0bd802b790 comp rx=0 tx=0).stop 2023-12-22T08:42:45.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.014+0000 7f0bec97d640 1 -- 172.21.15.38:0/4162158766 shutdown_connections 2023-12-22T08:42:45.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.014+0000 7f0bec97d640 1 --2- 172.21.15.38:0/4162158766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0be8071460 0x7f0be8071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.014+0000 7f0bec97d640 1 --2- 172.21.15.38:0/4162158766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0be815b0e0 0x7f0be815b4c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.014+0000 7f0bec97d640 1 -- 172.21.15.38:0/4162158766 >> 172.21.15.38:0/4162158766 conn(0x7f0be80cf000 msgr2=0x7f0be80cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:45.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.014+0000 7f0bec97d640 1 -- 172.21.15.38:0/4162158766 shutdown_connections 2023-12-22T08:42:45.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.014+0000 7f0bec97d640 1 -- 172.21.15.38:0/4162158766 wait complete. 2023-12-22T08:42:45.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.016+0000 7f0bec97d640 1 Processor -- start 2023-12-22T08:42:45.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.016+0000 7f0bec97d640 1 -- start start 2023-12-22T08:42:45.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.017+0000 7f0bec97d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0be8071460 0x7f0be80c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.017+0000 7f0bec97d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be809c980 0x7f0be80a2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.017+0000 7f0bec97d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0be815b0e0 0x7f0be80a2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.017+0000 7f0bec97d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be80a4140 con 0x7f0be8071460 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.017+0000 7f0bec97d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be80c2760 con 0x7f0be809c980 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.017+0000 7f0bec97d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be80c21a0 con 0x7f0be815b0e0 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.017+0000 7f0be6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0be8071460 0x7f0be80c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.017+0000 7f0be6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0be8071460 0x7f0be80c2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40844/0 (socket says 172.21.15.38:40844) 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.017+0000 7f0be6d9d640 1 -- 172.21.15.38:0/3939261464 learned_addr learned my addr 172.21.15.38:0/3939261464 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.018+0000 7f0be759e640 1 --2- 172.21.15.38:0/3939261464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0be815b0e0 0x7f0be80a2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.018+0000 7f0be6d9d640 1 -- 172.21.15.38:0/3939261464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0be815b0e0 msgr2=0x7f0be80a2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.018+0000 7f0be6d9d640 1 --2- 172.21.15.38:0/3939261464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0be815b0e0 0x7f0be80a2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.018+0000 7f0be6d9d640 1 -- 172.21.15.38:0/3939261464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be809c980 msgr2=0x7f0be80a2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.018+0000 7f0be6d9d640 1 --2- 172.21.15.38:0/3939261464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be809c980 0x7f0be80a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.018+0000 7f0be6d9d640 1 -- 172.21.15.38:0/3939261464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd8009400 con 0x7f0be8071460 2023-12-22T08:42:45.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.018+0000 7f0be6d9d640 1 --2- 172.21.15.38:0/3939261464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0be8071460 0x7f0be80c2a00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8000c00 tx=0x7f0bd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:45.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.018+0000 7f0bcf7fe640 1 -- 172.21.15.38:0/3939261464 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8034680 con 0x7f0be8071460 2023-12-22T08:42:45.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.018+0000 7f0bcf7fe640 1 -- 172.21.15.38:0/3939261464 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd80347e0 con 0x7f0be8071460 2023-12-22T08:42:45.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.018+0000 7f0bcf7fe640 1 -- 172.21.15.38:0/3939261464 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8034b90 con 0x7f0be8071460 2023-12-22T08:42:45.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.018+0000 7f0bec97d640 1 -- 172.21.15.38:0/3939261464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be80c2480 con 0x7f0be8071460 2023-12-22T08:42:45.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.019+0000 7f0bec97d640 1 -- 172.21.15.38:0/3939261464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be80a3c20 con 0x7f0be8071460 2023-12-22T08:42:45.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.020+0000 7f0bec97d640 1 -- 172.21.15.38:0/3939261464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be8061910 con 0x7f0be8071460 2023-12-22T08:42:45.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.021+0000 7f0bcf7fe640 1 -- 172.21.15.38:0/3939261464 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0bd803b040 con 0x7f0be8071460 2023-12-22T08:42:45.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.022+0000 7f0bcf7fe640 1 --2- 172.21.15.38:0/3939261464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0bd406a430 0x7f0bd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.022+0000 7f0bcf7fe640 1 -- 172.21.15.38:0/3939261464 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bd80aa540 con 0x7f0be8071460 2023-12-22T08:42:45.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.022+0000 7f0be659c640 1 --2- 172.21.15.38:0/3939261464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0bd406a430 0x7f0bd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.023+0000 7f0be659c640 1 --2- 172.21.15.38:0/3939261464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0bd406a430 0x7f0bd406c8f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0be815d0a0 tx=0x7f0bdc007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:45.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.026+0000 7f0bcf7fe640 1 -- 172.21.15.38:0/3939261464 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0bd8075c40 con 0x7f0be8071460 2023-12-22T08:42:45.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.221+0000 7f0bec97d640 1 -- 172.21.15.38:0/3939261464 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0be80a3e10 con 0x7f0be8071460 2023-12-22T08:42:45.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.222+0000 7f0bcf7fe640 1 -- 172.21.15.38:0/3939261464 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0bd804e020 con 0x7f0be8071460 2023-12-22T08:42:45.224 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:42:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.224+0000 7f0bec97d640 1 -- 172.21.15.38:0/3939261464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0bd406a430 msgr2=0x7f0bd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.224+0000 7f0bec97d640 1 --2- 172.21.15.38:0/3939261464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0bd406a430 0x7f0bd406c8f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0be815d0a0 tx=0x7f0bdc007930 comp rx=0 tx=0).stop 2023-12-22T08:42:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.224+0000 7f0bec97d640 1 -- 172.21.15.38:0/3939261464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0be8071460 msgr2=0x7f0be80c2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.224+0000 7f0bec97d640 1 --2- 172.21.15.38:0/3939261464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0be8071460 0x7f0be80c2a00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8000c00 tx=0x7f0bd80046c0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.225+0000 7f0bec97d640 1 -- 172.21.15.38:0/3939261464 shutdown_connections 2023-12-22T08:42:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.225+0000 7f0bec97d640 1 --2- 172.21.15.38:0/3939261464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0be815b0e0 0x7f0be80a2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.225+0000 7f0bec97d640 1 --2- 172.21.15.38:0/3939261464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be809c980 0x7f0be80a2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.225+0000 7f0bec97d640 1 --2- 172.21.15.38:0/3939261464 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0bd406a430 0x7f0bd406c8f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.225+0000 7f0bec97d640 1 --2- 172.21.15.38:0/3939261464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0be8071460 0x7f0be80c2a00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.225+0000 7f0bec97d640 1 -- 172.21.15.38:0/3939261464 >> 172.21.15.38:0/3939261464 conn(0x7f0be80cf000 msgr2=0x7f0be815f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:45.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.225+0000 7f0bec97d640 1 -- 172.21.15.38:0/3939261464 shutdown_connections 2023-12-22T08:42:45.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.225+0000 7f0bec97d640 1 -- 172.21.15.38:0/3939261464 wait complete. 2023-12-22T08:42:45.246 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:42:45.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.457+0000 7f5008e23640 1 Processor -- start 2023-12-22T08:42:45.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.457+0000 7f5008e23640 1 -- start start 2023-12-22T08:42:45.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.459+0000 7f5008e23640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f50041619c0 0x7f50040b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.459+0000 7f5008e23640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50040ceb70 0x7f500406f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.459+0000 7f5008e23640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50040ce6e0 con 0x7f5004070000 2023-12-22T08:42:45.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.459+0000 7f5008e23640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50040b4db0 con 0x7f50041619c0 2023-12-22T08:42:45.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.459+0000 7f5008e23640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50040b5090 con 0x7f50040ceb70 2023-12-22T08:42:45.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.459+0000 7f500259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f50041619c0 0x7f50040b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.459+0000 7f500259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f50041619c0 0x7f50040b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40846/0 (socket says 172.21.15.38:40846) 2023-12-22T08:42:45.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.459+0000 7f500259c640 1 -- 172.21.15.38:0/2000117427 learned_addr learned my addr 172.21.15.38:0/2000117427 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:45.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.460+0000 7f5001d9b640 1 --2- 172.21.15.38:0/2000117427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50040ceb70 0x7f500406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.460+0000 7f500259c640 1 -- 172.21.15.38:0/2000117427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50040ceb70 msgr2=0x7f500406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:45.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.460+0000 7f500259c640 1 --2- 172.21.15.38:0/2000117427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50040ceb70 0x7f500406f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.460+0000 7f500259c640 1 -- 172.21.15.38:0/2000117427 >> v1:172.21.15.89:6789/0 conn(0x7f5004070000 legacy=0x7f5004165630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.460+0000 7f500259c640 1 -- 172.21.15.38:0/2000117427 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50040ce370 con 0x7f50041619c0 2023-12-22T08:42:45.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.461+0000 7f500259c640 1 --2- 172.21.15.38:0/2000117427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50041619c0 0x7f50040b4560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009870 tx=0x7f4ff402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fa49b144108ffc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:45.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.461+0000 7f500159a640 1 -- 172.21.15.38:0/2000117427 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4030840 con 0x7f50041619c0 2023-12-22T08:42:45.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.462+0000 7f500159a640 1 -- 172.21.15.38:0/2000117427 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff40309a0 con 0x7f50041619c0 2023-12-22T08:42:45.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.462+0000 7f500159a640 1 -- 172.21.15.38:0/2000117427 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4030d30 con 0x7f50041619c0 2023-12-22T08:42:45.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.462+0000 7f5008e23640 1 -- 172.21.15.38:0/2000117427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50041619c0 msgr2=0x7f50040b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.462+0000 7f5008e23640 1 --2- 172.21.15.38:0/2000117427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50041619c0 0x7f50040b4560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009870 tx=0x7f4ff402b980 comp rx=0 tx=0).stop 2023-12-22T08:42:45.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.462+0000 7f5008e23640 1 -- 172.21.15.38:0/2000117427 shutdown_connections 2023-12-22T08:42:45.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.462+0000 7f5008e23640 1 --2- 172.21.15.38:0/2000117427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50040ceb70 0x7f500406f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.462+0000 7f5008e23640 1 --2- 172.21.15.38:0/2000117427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50041619c0 0x7f50040b4560 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.462+0000 7f5008e23640 1 -- 172.21.15.38:0/2000117427 >> 172.21.15.38:0/2000117427 conn(0x7f50040b20c0 msgr2=0x7f50040b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:45.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.462+0000 7f5008e23640 1 -- 172.21.15.38:0/2000117427 shutdown_connections 2023-12-22T08:42:45.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.462+0000 7f5008e23640 1 -- 172.21.15.38:0/2000117427 wait complete. 2023-12-22T08:42:45.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.464+0000 7f5008e23640 1 Processor -- start 2023-12-22T08:42:45.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.464+0000 7f5008e23640 1 -- start start 2023-12-22T08:42:45.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.465+0000 7f5008e23640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5004070000 0x7f500415a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.465+0000 7f5008e23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50040ceb70 0x7f5004164500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f5008e23640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50041619c0 0x7f5004158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f5008e23640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5004159880 con 0x7f5004070000 2023-12-22T08:42:45.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f5008e23640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5004159b20 con 0x7f50040ceb70 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f5008e23640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5004159e00 con 0x7f50041619c0 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f500259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5004070000 0x7f500415a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f500259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5004070000 0x7f500415a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40858/0 (socket says 172.21.15.38:40858) 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f500259c640 1 -- 172.21.15.38:0/3487480637 learned_addr learned my addr 172.21.15.38:0/3487480637 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f5001d9b640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50040ceb70 0x7f5004164500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f5002d9d640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50041619c0 0x7f5004158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f500259c640 1 -- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50041619c0 msgr2=0x7f5004158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f500259c640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50041619c0 0x7f5004158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f500259c640 1 -- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50040ceb70 msgr2=0x7f5004164500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f500259c640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50040ceb70 0x7f5004164500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.466+0000 7f500259c640 1 -- 172.21.15.38:0/3487480637 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff40094d0 con 0x7f5004070000 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.467+0000 7f500259c640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5004070000 0x7f500415a8e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40097c0 tx=0x7f4ff4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.467+0000 7f4ff2ffd640 1 -- 172.21.15.38:0/3487480637 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4039b50 con 0x7f5004070000 2023-12-22T08:42:45.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.467+0000 7f4ff2ffd640 1 -- 172.21.15.38:0/3487480637 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff4039cb0 con 0x7f5004070000 2023-12-22T08:42:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.467+0000 7f4ff2ffd640 1 -- 172.21.15.38:0/3487480637 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4043630 con 0x7f5004070000 2023-12-22T08:42:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.467+0000 7f5008e23640 1 -- 172.21.15.38:0/3487480637 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500415a0e0 con 0x7f5004070000 2023-12-22T08:42:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.467+0000 7f5008e23640 1 -- 172.21.15.38:0/3487480637 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5004164a40 con 0x7f5004070000 2023-12-22T08:42:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.468+0000 7f5008e23640 1 -- 172.21.15.38:0/3487480637 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500415a600 con 0x7f5004070000 2023-12-22T08:42:45.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.469+0000 7f4ff2ffd640 1 -- 172.21.15.38:0/3487480637 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4ff4042390 con 0x7f5004070000 2023-12-22T08:42:45.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.470+0000 7f4ff2ffd640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4fe406a430 0x7f4fe406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.471+0000 7f4ff2ffd640 1 -- 172.21.15.38:0/3487480637 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ff40aab40 con 0x7f5004070000 2023-12-22T08:42:45.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.471+0000 7f5001d9b640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4fe406a430 0x7f4fe406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.472+0000 7f5001d9b640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4fe406a430 0x7f4fe406c8f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5004155530 tx=0x7f4ff8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:45.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.475+0000 7f4ff2ffd640 1 -- 172.21.15.38:0/3487480637 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f500415a600 con 0x7f5004070000 2023-12-22T08:42:45.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.665+0000 7f5008e23640 1 -- 172.21.15.38:0/3487480637 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f500415a600 con 0x7f5004070000 2023-12-22T08:42:45.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.666+0000 7f4ff2ffd640 1 -- 172.21.15.38:0/3487480637 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ff4048020 con 0x7f5004070000 2023-12-22T08:42:45.669 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:42:45.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.669+0000 7f5008e23640 1 -- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4fe406a430 msgr2=0x7f4fe406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.669+0000 7f5008e23640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4fe406a430 0x7f4fe406c8f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5004155530 tx=0x7f4ff8008040 comp rx=0 tx=0).stop 2023-12-22T08:42:45.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.669+0000 7f5008e23640 1 -- 172.21.15.38:0/3487480637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5004070000 msgr2=0x7f500415a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.669+0000 7f5008e23640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5004070000 0x7f500415a8e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40097c0 tx=0x7f4ff4004730 comp rx=0 tx=0).stop 2023-12-22T08:42:45.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.669+0000 7f5008e23640 1 -- 172.21.15.38:0/3487480637 shutdown_connections 2023-12-22T08:42:45.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.669+0000 7f5008e23640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50041619c0 0x7f5004158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.669+0000 7f5008e23640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50040ceb70 0x7f5004164500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.669+0000 7f5008e23640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4fe406a430 0x7f4fe406c8f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.669+0000 7f5008e23640 1 --2- 172.21.15.38:0/3487480637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5004070000 0x7f500415a8e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.669+0000 7f5008e23640 1 -- 172.21.15.38:0/3487480637 >> 172.21.15.38:0/3487480637 conn(0x7f50040b20c0 msgr2=0x7f50040cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:45.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.669+0000 7f5008e23640 1 -- 172.21.15.38:0/3487480637 shutdown_connections 2023-12-22T08:42:45.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.669+0000 7f5008e23640 1 -- 172.21.15.38:0/3487480637 wait complete. 2023-12-22T08:42:45.690 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:42:45.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.905+0000 7f6143217640 1 Processor -- start 2023-12-22T08:42:45.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.906+0000 7f6143217640 1 -- start start 2023-12-22T08:42:45.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.907+0000 7f6143217640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f613c15e740 0x7f613c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.908+0000 7f6143217640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613c15eb20 con 0x7f613c0b3f90 2023-12-22T08:42:45.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.908+0000 7f6143217640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613c070770 con 0x7f613c06ca50 2023-12-22T08:42:45.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.908+0000 7f6143217640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f613c06e650 con 0x7f613c15e740 2023-12-22T08:42:45.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.908+0000 7f6140fb3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f613c15e740 0x7f613c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.908+0000 7f61417b4640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f613c0b3f90 0x7f613c070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49696/0 (socket says 172.21.15.38:49696) 2023-12-22T08:42:45.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.908+0000 7f61417b4640 1 -- 172.21.15.38:0/3933316220 learned_addr learned my addr 172.21.15.38:0/3933316220 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:45.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.909+0000 7f6140fb3640 1 -- 172.21.15.38:0/3933316220 >> v1:172.21.15.89:6789/0 conn(0x7f613c06ca50 legacy=0x7f613c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:45.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.909+0000 7f6140fb3640 1 -- 172.21.15.38:0/3933316220 >> v1:172.21.15.38:6789/0 conn(0x7f613c0b3f90 legacy=0x7f613c070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.909+0000 7f613b7fe640 1 -- 172.21.15.38:0/3933316220 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182957525 0 0) 0x7f613c15eb20 con 0x7f613c0b3f90 2023-12-22T08:42:45.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.909+0000 7f6140fb3640 1 -- 172.21.15.38:0/3933316220 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c06cec0 con 0x7f613c15e740 2023-12-22T08:42:45.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.910+0000 7f6140fb3640 1 --2- 172.21.15.38:0/3933316220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f613c15e740 0x7f613c15db30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f612c009d90 tx=0x7f612c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580f2783b59b5915 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:45.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.910+0000 7f613b7fe640 1 -- 172.21.15.38:0/3933316220 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c02cbd0 con 0x7f613c15e740 2023-12-22T08:42:45.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.910+0000 7f613b7fe640 1 -- 172.21.15.38:0/3933316220 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c02cd30 con 0x7f613c15e740 2023-12-22T08:42:45.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.910+0000 7f613b7fe640 1 -- 172.21.15.38:0/3933316220 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c02cea0 con 0x7f613c15e740 2023-12-22T08:42:45.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.911+0000 7f6143217640 1 -- 172.21.15.38:0/3933316220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f613c15e740 msgr2=0x7f613c15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.911+0000 7f6143217640 1 --2- 172.21.15.38:0/3933316220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f613c15e740 0x7f613c15db30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f612c009d90 tx=0x7f612c02be20 comp rx=0 tx=0).stop 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.911+0000 7f6143217640 1 -- 172.21.15.38:0/3933316220 shutdown_connections 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.911+0000 7f6143217640 1 --2- 172.21.15.38:0/3933316220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f613c15e740 0x7f613c15db30 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.911+0000 7f6143217640 1 -- 172.21.15.38:0/3933316220 >> 172.21.15.38:0/3933316220 conn(0x7f613c0cfea0 msgr2=0x7f613c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.911+0000 7f6143217640 1 -- 172.21.15.38:0/3933316220 shutdown_connections 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.911+0000 7f6143217640 1 -- 172.21.15.38:0/3933316220 wait complete. 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.913+0000 7f6143217640 1 Processor -- start 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.913+0000 7f6143217640 1 -- start start 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.914+0000 7f6143217640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f613c06ca50 0x7f613c144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.914+0000 7f6143217640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f613c0b3f90 0x7f613c145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.914+0000 7f6143217640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f613c15e740 0x7f613c142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.914+0000 7f6143217640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0b8520 con 0x7f613c15e740 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.914+0000 7f6143217640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c142900 con 0x7f613c06ca50 2023-12-22T08:42:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.914+0000 7f6143217640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0b79a0 con 0x7f613c0b3f90 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.914+0000 7f61417b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f613c15e740 0x7f613c142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.914+0000 7f61417b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f613c15e740 0x7f613c142f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40882/0 (socket says 172.21.15.38:40882) 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.914+0000 7f61417b4640 1 -- 172.21.15.38:0/3571711176 learned_addr learned my addr 172.21.15.38:0/3571711176 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.914+0000 7f6140fb3640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f613c06ca50 0x7f613c144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.914+0000 7f613bfff640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f613c0b3f90 0x7f613c145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.914+0000 7f61417b4640 1 -- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f613c0b3f90 msgr2=0x7f613c145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.914+0000 7f61417b4640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f613c0b3f90 0x7f613c145160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.915+0000 7f61417b4640 1 -- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f613c06ca50 msgr2=0x7f613c144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.915+0000 7f61417b4640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f613c06ca50 0x7f613c144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.915+0000 7f61417b4640 1 -- 172.21.15.38:0/3571711176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c009a70 con 0x7f613c15e740 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.915+0000 7f61417b4640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f613c15e740 0x7f613c142f70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f613400c450 tx=0x7f613400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.915+0000 7f61397fa640 1 -- 172.21.15.38:0/3571711176 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340074e0 con 0x7f613c15e740 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.915+0000 7f61397fa640 1 -- 172.21.15.38:0/3571711176 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6134007660 con 0x7f613c15e740 2023-12-22T08:42:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.915+0000 7f61397fa640 1 -- 172.21.15.38:0/3571711176 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134004a20 con 0x7f613c15e740 2023-12-22T08:42:45.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.915+0000 7f6143217640 1 -- 172.21.15.38:0/3571711176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613c0b7c80 con 0x7f613c15e740 2023-12-22T08:42:45.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.915+0000 7f6143217640 1 -- 172.21.15.38:0/3571711176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c0b8240 con 0x7f613c15e740 2023-12-22T08:42:45.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.917+0000 7f6143217640 1 -- 172.21.15.38:0/3571711176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613c061910 con 0x7f613c15e740 2023-12-22T08:42:45.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.917+0000 7f61397fa640 1 -- 172.21.15.38:0/3571711176 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6134004b80 con 0x7f613c15e740 2023-12-22T08:42:45.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.919+0000 7f61397fa640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f612806a460 0x7f612806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.919+0000 7f61397fa640 1 -- 172.21.15.38:0/3571711176 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6134087b60 con 0x7f613c15e740 2023-12-22T08:42:45.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.920+0000 7f6140fb3640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f612806a460 0x7f612806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.921+0000 7f6140fb3640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f612806a460 0x7f612806c920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f612c036000 tx=0x7f612c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:45.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:45.923+0000 7f61397fa640 1 -- 172.21.15.38:0/3571711176 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6134053180 con 0x7f613c15e740 2023-12-22T08:42:46.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.153+0000 7f6143217640 1 -- 172.21.15.38:0/3571711176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f613c06da10 con 0x7f613c15e740 2023-12-22T08:42:46.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.154+0000 7f61397fa640 1 -- 172.21.15.38:0/3571711176 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f6134018070 con 0x7f613c15e740 2023-12-22T08:42:46.156 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:46.157 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2078860804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2078860804},{"type":"v1","addr":"172.21.15.38:6835","nonce":2078860804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4244510882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4244510882},{"type":"v1","addr":"172.21.15.89:6837","nonce":4244510882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3227878158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3227878158},{"type":"v1","addr":"172.21.15.38:6834","nonce":3227878158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:42:00.933947+0000","modified":"2023-12-22T08:42:03.951929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5538":{"gid":5538,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2131151279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2131151279},{"type":"v1","addr":"172.21.15.89:6836","nonce":2131151279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T08:42:46.157 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2023-12-22T08:42:46.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.157+0000 7f6143217640 1 -- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f612806a460 msgr2=0x7f612806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.157+0000 7f6143217640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f612806a460 0x7f612806c920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f612c036000 tx=0x7f612c030000 comp rx=0 tx=0).stop 2023-12-22T08:42:46.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.157+0000 7f6143217640 1 -- 172.21.15.38:0/3571711176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f613c15e740 msgr2=0x7f613c142f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.157+0000 7f6143217640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f613c15e740 0x7f613c142f70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f613400c450 tx=0x7f613400c910 comp rx=0 tx=0).stop 2023-12-22T08:42:46.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.157+0000 7f6143217640 1 -- 172.21.15.38:0/3571711176 shutdown_connections 2023-12-22T08:42:46.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.157+0000 7f6143217640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f612806a460 0x7f612806c920 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.157+0000 7f6143217640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f613c15e740 0x7f613c142f70 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.157+0000 7f6143217640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f613c0b3f90 0x7f613c145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.157+0000 7f6143217640 1 --2- 172.21.15.38:0/3571711176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f613c06ca50 0x7f613c144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.157+0000 7f6143217640 1 -- 172.21.15.38:0/3571711176 >> 172.21.15.38:0/3571711176 conn(0x7f613c0cfea0 msgr2=0x7f613c160f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:46.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.157+0000 7f6143217640 1 -- 172.21.15.38:0/3571711176 shutdown_connections 2023-12-22T08:42:46.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.157+0000 7f6143217640 1 -- 172.21.15.38:0/3571711176 wait complete. 2023-12-22T08:42:46.178 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:42:46.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.393+0000 7fc09b92e640 1 Processor -- start 2023-12-22T08:42:46.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.393+0000 7fc09b92e640 1 -- start start 2023-12-22T08:42:46.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.395+0000 7fc09b92e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc0940b22c0 0x7fc0940b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.395+0000 7fc09b92e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc0940b26a0 0x7fc09406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.395+0000 7fc09b92e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0940b4510 con 0x7fc09406cf50 2023-12-22T08:42:46.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.395+0000 7fc09b92e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09406c610 con 0x7fc0940b22c0 2023-12-22T08:42:46.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.395+0000 7fc09b92e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0940b3f50 con 0x7fc0940b26a0 2023-12-22T08:42:46.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.396+0000 7fc0996ca640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc0940b22c0 0x7fc0940b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.396+0000 7fc0996ca640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc0940b22c0 0x7fc0940b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40888/0 (socket says 172.21.15.38:40888) 2023-12-22T08:42:46.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.396+0000 7fc0996ca640 1 -- 172.21.15.38:0/2882455154 learned_addr learned my addr 172.21.15.38:0/2882455154 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:46.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.396+0000 7fc098ec9640 1 --2- 172.21.15.38:0/2882455154 >> v2:172.21.15.89:3300/0 conn(0x7fc0940b26a0 0x7fc09406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.396+0000 7fc0996ca640 1 -- 172.21.15.38:0/2882455154 >> v2:172.21.15.89:3300/0 conn(0x7fc0940b26a0 msgr2=0x7fc09406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:46.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.396+0000 7fc0996ca640 1 --2- 172.21.15.38:0/2882455154 >> v2:172.21.15.89:3300/0 conn(0x7fc0940b26a0 0x7fc09406ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.396+0000 7fc0996ca640 1 -- 172.21.15.38:0/2882455154 >> v1:172.21.15.89:6789/0 conn(0x7fc09406cf50 legacy=0x7fc0940cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.396+0000 7fc0996ca640 1 -- 172.21.15.38:0/2882455154 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940b4230 con 0x7fc0940b22c0 2023-12-22T08:42:46.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.398+0000 7fc0996ca640 1 --2- 172.21.15.38:0/2882455154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0940b22c0 0x7fc0940b3600 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc0940b2b10 tx=0x7fc09002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41713c32dc8a87d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:46.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.399+0000 7fc08bfff640 1 -- 172.21.15.38:0/2882455154 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090031870 con 0x7fc0940b22c0 2023-12-22T08:42:46.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.399+0000 7fc08bfff640 1 -- 172.21.15.38:0/2882455154 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0900319d0 con 0x7fc0940b22c0 2023-12-22T08:42:46.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.399+0000 7fc08bfff640 1 -- 172.21.15.38:0/2882455154 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090031d60 con 0x7fc0940b22c0 2023-12-22T08:42:46.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.399+0000 7fc09b92e640 1 -- 172.21.15.38:0/2882455154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0940b22c0 msgr2=0x7fc0940b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.399+0000 7fc09b92e640 1 --2- 172.21.15.38:0/2882455154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0940b22c0 0x7fc0940b3600 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc0940b2b10 tx=0x7fc09002b910 comp rx=0 tx=0).stop 2023-12-22T08:42:46.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.399+0000 7fc09b92e640 1 -- 172.21.15.38:0/2882455154 shutdown_connections 2023-12-22T08:42:46.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.399+0000 7fc09b92e640 1 --2- 172.21.15.38:0/2882455154 >> v2:172.21.15.89:3300/0 conn(0x7fc0940b26a0 0x7fc09406ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.399+0000 7fc09b92e640 1 --2- 172.21.15.38:0/2882455154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0940b22c0 0x7fc0940b3600 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.399+0000 7fc09b92e640 1 -- 172.21.15.38:0/2882455154 >> 172.21.15.38:0/2882455154 conn(0x7fc0940cf070 msgr2=0x7fc0940cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:46.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.400+0000 7fc09b92e640 1 -- 172.21.15.38:0/2882455154 shutdown_connections 2023-12-22T08:42:46.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.400+0000 7fc09b92e640 1 -- 172.21.15.38:0/2882455154 wait complete. 2023-12-22T08:42:46.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.401+0000 7fc09b92e640 1 Processor -- start 2023-12-22T08:42:46.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.401+0000 7fc09b92e640 1 -- start start 2023-12-22T08:42:46.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.402+0000 7fc09b92e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc09406cf50 0x7fc09414f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.402+0000 7fc09b92e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0940b22c0 0x7fc0940ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.402+0000 7fc09b92e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0940b26a0 0x7fc094164580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.402+0000 7fc09b92e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940aa700 con 0x7fc0940b26a0 2023-12-22T08:42:46.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.402+0000 7fc09b92e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940aa9e0 con 0x7fc0940b22c0 2023-12-22T08:42:46.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.402+0000 7fc09b92e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940aacc0 con 0x7fc09406cf50 2023-12-22T08:42:46.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.403+0000 7fc099ecb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0940b26a0 0x7fc094164580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.403+0000 7fc099ecb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0940b26a0 0x7fc094164580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40894/0 (socket says 172.21.15.38:40894) 2023-12-22T08:42:46.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.403+0000 7fc099ecb640 1 -- 172.21.15.38:0/2756596457 learned_addr learned my addr 172.21.15.38:0/2756596457 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:46.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.403+0000 7fc098ec9640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0940b22c0 0x7fc0940ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.403+0000 7fc0996ca640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc09406cf50 0x7fc09414f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.403+0000 7fc099ecb640 1 -- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc09406cf50 msgr2=0x7fc09414f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.403+0000 7fc099ecb640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc09406cf50 0x7fc09414f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.403+0000 7fc099ecb640 1 -- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0940b22c0 msgr2=0x7fc0940ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.403+0000 7fc099ecb640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0940b22c0 0x7fc0940ab7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.403+0000 7fc099ecb640 1 -- 172.21.15.38:0/2756596457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0900094d0 con 0x7fc0940b26a0 2023-12-22T08:42:46.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.403+0000 7fc098ec9640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0940b22c0 0x7fc0940ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:42:46.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.404+0000 7fc099ecb640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0940b26a0 0x7fc094164580 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00c730 tx=0x7fc08c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:46.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.404+0000 7fc089ffb640 1 -- 172.21.15.38:0/2756596457 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c003b70 con 0x7fc0940b26a0 2023-12-22T08:42:46.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.404+0000 7fc089ffb640 1 -- 172.21.15.38:0/2756596457 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c003cd0 con 0x7fc0940b26a0 2023-12-22T08:42:46.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.404+0000 7fc09b92e640 1 -- 172.21.15.38:0/2756596457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0940aafa0 con 0x7fc0940b26a0 2023-12-22T08:42:46.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.404+0000 7fc089ffb640 1 -- 172.21.15.38:0/2756596457 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00aa90 con 0x7fc0940b26a0 2023-12-22T08:42:46.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.404+0000 7fc09b92e640 1 -- 172.21.15.38:0/2756596457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09414f860 con 0x7fc0940b26a0 2023-12-22T08:42:46.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.405+0000 7fc09b92e640 1 -- 172.21.15.38:0/2756596457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0940ab4c0 con 0x7fc0940b26a0 2023-12-22T08:42:46.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.406+0000 7fc089ffb640 1 -- 172.21.15.38:0/2756596457 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc08c00abf0 con 0x7fc0940b26a0 2023-12-22T08:42:46.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.408+0000 7fc089ffb640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc07806a430 0x7fc07806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.408+0000 7fc089ffb640 1 -- 172.21.15.38:0/2756596457 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc08c088880 con 0x7fc0940b26a0 2023-12-22T08:42:46.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.408+0000 7fc0996ca640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc07806a430 0x7fc07806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.409+0000 7fc0996ca640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc07806a430 0x7fc07806c8f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc090036000 tx=0x7fc09003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:46.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.412+0000 7fc089ffb640 1 -- 172.21.15.38:0/2756596457 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc0940ab4c0 con 0x7fc0940b26a0 2023-12-22T08:42:46.608 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:46.616 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:46.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.611+0000 7fc09b92e640 1 -- 172.21.15.38:0/2756596457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0940ab4c0 con 0x7fc0940b26a0 2023-12-22T08:42:46.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.614+0000 7fc089ffb640 1 -- 172.21.15.38:0/2756596457 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+15993 (secure 0 0 0) 0x7fc0940ab4c0 con 0x7fc0940b26a0 2023-12-22T08:42:46.620 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:46.621 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":59,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:42:33.327912+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:58.840533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:59.953505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:42:46.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.617+0000 7fc09b92e640 1 -- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc07806a430 msgr2=0x7fc07806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.617+0000 7fc09b92e640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc07806a430 0x7fc07806c8f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc090036000 tx=0x7fc09003c040 comp rx=0 tx=0).stop 2023-12-22T08:42:46.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.617+0000 7fc09b92e640 1 -- 172.21.15.38:0/2756596457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0940b26a0 msgr2=0x7fc094164580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.617+0000 7fc09b92e640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0940b26a0 0x7fc094164580 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00c730 tx=0x7fc08c00cbf0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.617+0000 7fc09b92e640 1 -- 172.21.15.38:0/2756596457 shutdown_connections 2023-12-22T08:42:46.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.617+0000 7fc09b92e640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc07806a430 0x7fc07806c8f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.617+0000 7fc09b92e640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0940b26a0 0x7fc094164580 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.617+0000 7fc09b92e640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0940b22c0 0x7fc0940ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.617+0000 7fc09b92e640 1 --2- 172.21.15.38:0/2756596457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc09406cf50 0x7fc09414f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.617+0000 7fc09b92e640 1 -- 172.21.15.38:0/2756596457 >> 172.21.15.38:0/2756596457 conn(0x7fc0940cf070 msgr2=0x7fc09415f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:46.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.618+0000 7fc09b92e640 1 -- 172.21.15.38:0/2756596457 shutdown_connections 2023-12-22T08:42:46.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.618+0000 7fc09b92e640 1 -- 172.21.15.38:0/2756596457 wait complete. 2023-12-22T08:42:46.638 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:42:46.638 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:42:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.885+0000 7fcda27c4640 1 Processor -- start 2023-12-22T08:42:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.886+0000 7fcda27c4640 1 -- start start 2023-12-22T08:42:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.887+0000 7fcda27c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd9c15e740 0x7fcd9c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.887+0000 7fcda27c4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c15eb20 con 0x7fcd9c06ca50 2023-12-22T08:42:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.887+0000 7fcda27c4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c070770 con 0x7fcd9c0b3f90 2023-12-22T08:42:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.887+0000 7fcda27c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c06e650 con 0x7fcd9c15e740 2023-12-22T08:42:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.888+0000 7fcd9b7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcd9c06ca50 0x7fcd9c0b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49710/0 (socket says 172.21.15.38:49710) 2023-12-22T08:42:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.888+0000 7fcd9b7fe640 1 -- 172.21.15.38:0/195788985 learned_addr learned my addr 172.21.15.38:0/195788985 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.888+0000 7fcd9bfff640 1 --2- 172.21.15.38:0/195788985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd9c15e740 0x7fcd9c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.888+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377512501 0 0) 0x7fcd9c15eb20 con 0x7fcd9c06ca50 2023-12-22T08:42:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.888+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd84003520 con 0x7fcd9c06ca50 2023-12-22T08:42:46.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.888+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1104883456 0 0) 0x7fcd84003520 con 0x7fcd9c06ca50 2023-12-22T08:42:46.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.888+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd9c15e740 msgr2=0x7fcd9c15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:46.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.888+0000 7fcd9affd640 1 --2- 172.21.15.38:0/195788985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd9c15e740 0x7fcd9c15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 >> v1:172.21.15.89:6789/0 conn(0x7fcd9c0b3f90 legacy=0x7fcd9c070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c06d180 con 0x7fcd9c06ca50 2023-12-22T08:42:46.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fcd90001670 con 0x7fcd9c06ca50 2023-12-22T08:42:46.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 >> v1:172.21.15.38:6789/0 conn(0x7fcd9c06ca50 legacy=0x7fcd9c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9affd640 1 --2- 172.21.15.38:0/195788985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd840039a0 0x7fcd84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9affd640 1 --2- 172.21.15.38:0/195788985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840047c0 0x7fcd84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9affd640 1 --2- 172.21.15.38:0/195788985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd840052a0 0x7fcd8400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c06e650 con 0x7fcd840047c0 2023-12-22T08:42:46.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8400c1c0 con 0x7fcd840052a0 2023-12-22T08:42:46.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8400c380 con 0x7fcd840039a0 2023-12-22T08:42:46.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9bfff640 1 --2- 172.21.15.38:0/195788985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd9c15e740 0x7fcd9c15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:42:46.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9b7fe640 1 --2- 172.21.15.38:0/195788985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840047c0 0x7fcd84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9b7fe640 1 -- 172.21.15.38:0/195788985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd840039a0 msgr2=0x7fcd84003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:46.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9b7fe640 1 --2- 172.21.15.38:0/195788985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd840039a0 0x7fcd84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9b7fe640 1 -- 172.21.15.38:0/195788985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd840052a0 msgr2=0x7fcd8400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:46.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9b7fe640 1 --2- 172.21.15.38:0/195788985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd840052a0 0x7fcd8400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.889+0000 7fcd9b7fe640 1 -- 172.21.15.38:0/195788985 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd84003520 con 0x7fcd840047c0 2023-12-22T08:42:46.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.890+0000 7fcd9b7fe640 1 --2- 172.21.15.38:0/195788985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840047c0 0x7fcd84004c40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000c0e0 tx=0x7fcd840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05efe4c179a2eaa server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:46.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.891+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90005ad0 con 0x7fcd840047c0 2023-12-22T08:42:46.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.891+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd90005c30 con 0x7fcd840047c0 2023-12-22T08:42:46.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.891+0000 7fcd9affd640 1 -- 172.21.15.38:0/195788985 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9002ca30 con 0x7fcd840047c0 2023-12-22T08:42:46.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.891+0000 7fcda27c4640 1 -- 172.21.15.38:0/195788985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840047c0 msgr2=0x7fcd84004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.891+0000 7fcda27c4640 1 --2- 172.21.15.38:0/195788985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd840047c0 0x7fcd84004c40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000c0e0 tx=0x7fcd840057f0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.891+0000 7fcda0d61640 1 -- 172.21.15.38:0/195788985 reap_dead start 2023-12-22T08:42:46.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.891+0000 7fcda27c4640 1 -- 172.21.15.38:0/195788985 shutdown_connections 2023-12-22T08:42:46.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.891+0000 7fcda27c4640 1 -- 172.21.15.38:0/195788985 >> 172.21.15.38:0/195788985 conn(0x7fcd9c0cfea0 msgr2=0x7fcd9c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:46.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.891+0000 7fcda27c4640 1 -- 172.21.15.38:0/195788985 shutdown_connections 2023-12-22T08:42:46.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.892+0000 7fcda27c4640 1 -- 172.21.15.38:0/195788985 wait complete. 2023-12-22T08:42:46.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.893+0000 7fcda27c4640 1 Processor -- start 2023-12-22T08:42:46.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.894+0000 7fcda27c4640 1 -- start start 2023-12-22T08:42:46.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.894+0000 7fcda27c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd840047c0 0x7fcd9c0b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcda27c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd9c0b2ab0 0x7fcd9c070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcda27c4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd9c155ca0 0x7fcd9c153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcda27c4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c1583c0 con 0x7fcd9c155ca0 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcda27c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c156610 con 0x7fcd840047c0 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcda27c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c1568f0 con 0x7fcd9c0b2ab0 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcda0d61640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd9c155ca0 0x7fcd9c153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcda0d61640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd9c155ca0 0x7fcd9c153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40910/0 (socket says 172.21.15.38:40910) 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcda0d61640 1 -- 172.21.15.38:0/2824235025 learned_addr learned my addr 172.21.15.38:0/2824235025 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcd9bfff640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd840047c0 0x7fcd9c0b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcd9b7fe640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd9c0b2ab0 0x7fcd9c070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcda0d61640 1 -- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd9c0b2ab0 msgr2=0x7fcd9c070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcda0d61640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd9c0b2ab0 0x7fcd9c070d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcda0d61640 1 -- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd840047c0 msgr2=0x7fcd9c0b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcda0d61640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd840047c0 0x7fcd9c0b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcda0d61640 1 -- 172.21.15.38:0/2824235025 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c156bd0 con 0x7fcd9c155ca0 2023-12-22T08:42:46.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.895+0000 7fcd9b7fe640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd9c0b2ab0 0x7fcd9c070d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:46.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.896+0000 7fcda0d61640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd9c155ca0 0x7fcd9c153180 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0cfe40 tx=0x7fcd9400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:46.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.896+0000 7fcd98ff9640 1 -- 172.21.15.38:0/2824235025 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94007070 con 0x7fcd9c155ca0 2023-12-22T08:42:46.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.896+0000 7fcd98ff9640 1 -- 172.21.15.38:0/2824235025 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd94007210 con 0x7fcd9c155ca0 2023-12-22T08:42:46.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.896+0000 7fcd98ff9640 1 -- 172.21.15.38:0/2824235025 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd940075c0 con 0x7fcd9c155ca0 2023-12-22T08:42:46.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.896+0000 7fcda27c4640 1 -- 172.21.15.38:0/2824235025 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9c158610 con 0x7fcd9c155ca0 2023-12-22T08:42:46.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.896+0000 7fcda27c4640 1 -- 172.21.15.38:0/2824235025 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c071490 con 0x7fcd9c155ca0 2023-12-22T08:42:46.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.897+0000 7fcda27c4640 1 -- 172.21.15.38:0/2824235025 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9c158800 con 0x7fcd9c155ca0 2023-12-22T08:42:46.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.898+0000 7fcd98ff9640 1 -- 172.21.15.38:0/2824235025 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcd94007720 con 0x7fcd9c155ca0 2023-12-22T08:42:46.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.899+0000 7fcd98ff9640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcd8806a430 0x7fcd8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.899+0000 7fcd98ff9640 1 -- 172.21.15.38:0/2824235025 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd94087890 con 0x7fcd9c155ca0 2023-12-22T08:42:46.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.900+0000 7fcd9bfff640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcd8806a430 0x7fcd8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.901+0000 7fcd9bfff640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcd8806a430 0x7fcd8806c8f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c006a90 tx=0x7fcd8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:46.904+0000 7fcd98ff9640 1 -- 172.21.15.38:0/2824235025 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcd94052e70 con 0x7fcd9c155ca0 2023-12-22T08:42:47.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.133+0000 7fcda27c4640 1 -- 172.21.15.38:0/2824235025 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd9c071490 con 0x7fcd9c155ca0 2023-12-22T08:42:47.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.134+0000 7fcd98ff9640 1 -- 172.21.15.38:0/2824235025 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4648 (secure 0 0 0) 0x7fcd9c071490 con 0x7fcd9c155ca0 2023-12-22T08:42:47.136 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:47.136 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2078860804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2078860804},{"type":"v1","addr":"172.21.15.38:6835","nonce":2078860804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4244510882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4244510882},{"type":"v1","addr":"172.21.15.89:6837","nonce":4244510882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3227878158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3227878158},{"type":"v1","addr":"172.21.15.38:6834","nonce":3227878158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:42:00.933947+0000","modified":"2023-12-22T08:42:03.951929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5538":{"gid":5538,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2131151279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2131151279},{"type":"v1","addr":"172.21.15.89:6836","nonce":2131151279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T08:42:47.137 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2023-12-22T08:42:47.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.136+0000 7fcda27c4640 1 -- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcd8806a430 msgr2=0x7fcd8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:47.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.136+0000 7fcda27c4640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcd8806a430 0x7fcd8806c8f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c006a90 tx=0x7fcd8c008040 comp rx=0 tx=0).stop 2023-12-22T08:42:47.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.137+0000 7fcda27c4640 1 -- 172.21.15.38:0/2824235025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd9c155ca0 msgr2=0x7fcd9c153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:47.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.137+0000 7fcda27c4640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd9c155ca0 0x7fcd9c153180 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0cfe40 tx=0x7fcd9400c960 comp rx=0 tx=0).stop 2023-12-22T08:42:47.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.137+0000 7fcda27c4640 1 -- 172.21.15.38:0/2824235025 shutdown_connections 2023-12-22T08:42:47.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.137+0000 7fcda27c4640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcd8806a430 0x7fcd8806c8f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.137+0000 7fcda27c4640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd9c155ca0 0x7fcd9c153180 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.137+0000 7fcda27c4640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd9c0b2ab0 0x7fcd9c070d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.137+0000 7fcda27c4640 1 --2- 172.21.15.38:0/2824235025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd840047c0 0x7fcd9c0b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.137+0000 7fcda27c4640 1 -- 172.21.15.38:0/2824235025 >> 172.21.15.38:0/2824235025 conn(0x7fcd9c0cfea0 msgr2=0x7fcd9c071850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:47.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.137+0000 7fcda27c4640 1 -- 172.21.15.38:0/2824235025 shutdown_connections 2023-12-22T08:42:47.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.137+0000 7fcda27c4640 1 -- 172.21.15.38:0/2824235025 wait complete. 2023-12-22T08:42:47.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:42:47.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.375+0000 7f3fe483f640 1 Processor -- start 2023-12-22T08:42:47.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.375+0000 7f3fe483f640 1 -- start start 2023-12-22T08:42:47.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.376+0000 7f3fe483f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe0157980 0x7f3fe015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.377+0000 7f3fe483f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3fe00b3ff0 0x7f3fe006cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.377+0000 7f3fe483f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe00d1520 con 0x7f3fe00b4470 2023-12-22T08:42:47.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.377+0000 7f3fe483f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe00d1800 con 0x7f3fe00b3ff0 2023-12-22T08:42:47.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.377+0000 7f3fe483f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00d1ae0 con 0x7f3fe0157980 2023-12-22T08:42:47.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.377+0000 7f3fdffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3fe00b4470 0x7f3fe00d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49726/0 (socket says 172.21.15.38:49726) 2023-12-22T08:42:47.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.377+0000 7f3fdffff640 1 -- 172.21.15.38:0/3824717151 learned_addr learned my addr 172.21.15.38:0/3824717151 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:47.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.377+0000 7f3fdf7fe640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe0157980 0x7f3fe015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:47.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.377+0000 7f3fdeffd640 1 --2- 172.21.15.38:0/3824717151 >> v2:172.21.15.89:3300/0 conn(0x7f3fe00b3ff0 0x7f3fe006cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:47.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.377+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889912510 0 0) 0x7f3fe00d1520 con 0x7f3fe00b4470 2023-12-22T08:42:47.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc8003520 con 0x7f3fe00b4470 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2535902807 0 0) 0x7f3fc8003520 con 0x7f3fe00b4470 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe0157980 msgr2=0x7f3fe015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe0157980 0x7f3fe015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 >> v2:172.21.15.89:3300/0 conn(0x7f3fe00b3ff0 msgr2=0x7f3fe006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 --2- 172.21.15.38:0/3824717151 >> v2:172.21.15.89:3300/0 conn(0x7f3fe00b3ff0 0x7f3fe006cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe00d1dc0 con 0x7f3fe00b4470 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f3fd80019f0 con 0x7f3fe00b4470 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 >> v1:172.21.15.38:6789/0 conn(0x7f3fe00b4470 legacy=0x7f3fe00d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fc8003970 0x7f3fc8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc80047c0 0x7f3fc8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe0157980 0x7f3fc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00d1800 con 0x7f3fc8003970 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00d1ae0 con 0x7f3fc80047c0 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc800b980 con 0x7f3fe0157980 2023-12-22T08:42:47.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.378+0000 7f3fdf7fe640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fc8003970 0x7f3fc8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:47.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.379+0000 7f3fdeffd640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc80047c0 0x7f3fc8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:47.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.379+0000 7f3fdf7fe640 1 -- 172.21.15.38:0/3824717151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe0157980 msgr2=0x7f3fc8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:47.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.379+0000 7f3fdffff640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe0157980 0x7f3fc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:47.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.379+0000 7f3fdf7fe640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe0157980 0x7f3fc8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.379+0000 7f3fdf7fe640 1 -- 172.21.15.38:0/3824717151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc80047c0 msgr2=0x7f3fc8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:47.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.379+0000 7f3fdf7fe640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc80047c0 0x7f3fc8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.379+0000 7f3fdf7fe640 1 -- 172.21.15.38:0/3824717151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc8003520 con 0x7f3fc8003970 2023-12-22T08:42:47.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.379+0000 7f3fdeffd640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc80047c0 0x7f3fc8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:42:47.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.379+0000 7f3fdffff640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe0157980 0x7f3fc8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:47.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.380+0000 7f3fdf7fe640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fc8003970 0x7f3fc8003d90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009ac0 tx=0x7f3fc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4af52e87236558 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:47.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.381+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd002c6b0 con 0x7f3fc8003970 2023-12-22T08:42:47.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.381+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd002c810 con 0x7f3fc8003970 2023-12-22T08:42:47.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.381+0000 7f3fde7fc640 1 -- 172.21.15.38:0/3824717151 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd002cba0 con 0x7f3fc8003970 2023-12-22T08:42:47.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.381+0000 7f3fe483f640 1 -- 172.21.15.38:0/3824717151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fc8003970 msgr2=0x7f3fc8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:47.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.381+0000 7f3fe483f640 1 --2- 172.21.15.38:0/3824717151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fc8003970 0x7f3fc8003d90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009ac0 tx=0x7f3fc80057f0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.381+0000 7f3fdffff640 1 -- 172.21.15.38:0/3824717151 reap_dead start 2023-12-22T08:42:47.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.381+0000 7f3fe483f640 1 -- 172.21.15.38:0/3824717151 shutdown_connections 2023-12-22T08:42:47.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.381+0000 7f3fe483f640 1 -- 172.21.15.38:0/3824717151 >> 172.21.15.38:0/3824717151 conn(0x7f3fe00d31f0 msgr2=0x7f3fe00d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:47.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.381+0000 7f3fe483f640 1 -- 172.21.15.38:0/3824717151 shutdown_connections 2023-12-22T08:42:47.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.381+0000 7f3fe483f640 1 -- 172.21.15.38:0/3824717151 wait complete. 2023-12-22T08:42:47.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.383+0000 7f3fe483f640 1 Processor -- start 2023-12-22T08:42:47.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.383+0000 7f3fe483f640 1 -- start start 2023-12-22T08:42:47.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.384+0000 7f3fe483f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc8003970 0x7f3fe00acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.384+0000 7f3fe483f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe01f7050 0x7f3fe0154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.384+0000 7f3fe483f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe0149ae0 0x7f3fe00b80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.384+0000 7f3fe483f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00b5bd0 con 0x7f3fe0149ae0 2023-12-22T08:42:47.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.384+0000 7f3fe483f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00ad290 con 0x7f3fc8003970 2023-12-22T08:42:47.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.384+0000 7f3fe483f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00b5e20 con 0x7f3fe01f7050 2023-12-22T08:42:47.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.385+0000 7f3fdffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe0149ae0 0x7f3fe00b80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:47.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.385+0000 7f3fdffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe0149ae0 0x7f3fe00b80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40928/0 (socket says 172.21.15.38:40928) 2023-12-22T08:42:47.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.385+0000 7f3fdffff640 1 -- 172.21.15.38:0/1204250553 learned_addr learned my addr 172.21.15.38:0/1204250553 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:47.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.385+0000 7f3fdeffd640 1 --2- 172.21.15.38:0/1204250553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe01f7050 0x7f3fe0154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:47.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.385+0000 7f3fdffff640 1 -- 172.21.15.38:0/1204250553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe01f7050 msgr2=0x7f3fe0154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:47.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.385+0000 7f3fdffff640 1 --2- 172.21.15.38:0/1204250553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe01f7050 0x7f3fe0154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.385+0000 7f3fdffff640 1 -- 172.21.15.38:0/1204250553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc8003970 msgr2=0x7f3fe00acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:47.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.385+0000 7f3fdffff640 1 --2- 172.21.15.38:0/1204250553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc8003970 0x7f3fe00acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.385+0000 7f3fdffff640 1 -- 172.21.15.38:0/1204250553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe00b6100 con 0x7f3fe0149ae0 2023-12-22T08:42:47.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.385+0000 7f3fdffff640 1 --2- 172.21.15.38:0/1204250553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe0149ae0 0x7f3fe00b80c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0071760 tx=0x7f3fd800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:47.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.386+0000 7f3fc7fff640 1 -- 172.21.15.38:0/1204250553 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8001990 con 0x7f3fe0149ae0 2023-12-22T08:42:47.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.386+0000 7f3fc7fff640 1 -- 172.21.15.38:0/1204250553 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd800bb80 con 0x7f3fe0149ae0 2023-12-22T08:42:47.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.386+0000 7f3fc7fff640 1 -- 172.21.15.38:0/1204250553 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8007110 con 0x7f3fe0149ae0 2023-12-22T08:42:47.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.386+0000 7f3fe483f640 1 -- 172.21.15.38:0/1204250553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe00b63e0 con 0x7f3fe0149ae0 2023-12-22T08:42:47.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.386+0000 7f3fe483f640 1 -- 172.21.15.38:0/1204250553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe01548a0 con 0x7f3fe0149ae0 2023-12-22T08:42:47.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.387+0000 7f3fe483f640 1 -- 172.21.15.38:0/1204250553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe00b6900 con 0x7f3fe0149ae0 2023-12-22T08:42:47.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.388+0000 7f3fc7fff640 1 -- 172.21.15.38:0/1204250553 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3fd8007270 con 0x7f3fe0149ae0 2023-12-22T08:42:47.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.389+0000 7f3fc7fff640 1 --2- 172.21.15.38:0/1204250553 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fcc06a460 0x7f3fcc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.389+0000 7f3fc7fff640 1 -- 172.21.15.38:0/1204250553 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fd8088da0 con 0x7f3fe0149ae0 2023-12-22T08:42:47.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.389+0000 7f3fdf7fe640 1 --2- 172.21.15.38:0/1204250553 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fcc06a460 0x7f3fcc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:47.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.390+0000 7f3fdf7fe640 1 --2- 172.21.15.38:0/1204250553 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fcc06a460 0x7f3fcc06c920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0036000 tx=0x7f3fd002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:47.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.393+0000 7f3fc7fff640 1 -- 172.21.15.38:0/1204250553 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3fe00b6900 con 0x7f3fe0149ae0 2023-12-22T08:42:47.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.622+0000 7f3fe483f640 1 -- 172.21.15.38:0/1204250553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fe00b6900 con 0x7f3fe0149ae0 2023-12-22T08:42:47.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.624+0000 7f3fc7fff640 1 -- 172.21.15.38:0/1204250553 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f3fe00b6900 con 0x7f3fe0149ae0 2023-12-22T08:42:47.626 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:47.626 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2078860804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2078860804},{"type":"v1","addr":"172.21.15.38:6835","nonce":2078860804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4244510882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4244510882},{"type":"v1","addr":"172.21.15.89:6837","nonce":4244510882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3227878158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3227878158},{"type":"v1","addr":"172.21.15.38:6834","nonce":3227878158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:42:00.933947+0000","modified":"2023-12-22T08:42:03.951929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5538":{"gid":5538,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2131151279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2131151279},{"type":"v1","addr":"172.21.15.89:6836","nonce":2131151279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-22T08:42:47.626 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2023-12-22T08:42:47.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.626+0000 7f3fe483f640 1 -- 172.21.15.38:0/1204250553 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fcc06a460 msgr2=0x7f3fcc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:47.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.626+0000 7f3fe483f640 1 --2- 172.21.15.38:0/1204250553 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fcc06a460 0x7f3fcc06c920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0036000 tx=0x7f3fd002e000 comp rx=0 tx=0).stop 2023-12-22T08:42:47.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.626+0000 7f3fe483f640 1 -- 172.21.15.38:0/1204250553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe0149ae0 msgr2=0x7f3fe00b80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:47.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.626+0000 7f3fe483f640 1 --2- 172.21.15.38:0/1204250553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe0149ae0 0x7f3fe00b80c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0071760 tx=0x7f3fd800b4a0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.626+0000 7f3fe483f640 1 -- 172.21.15.38:0/1204250553 shutdown_connections 2023-12-22T08:42:47.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.626+0000 7f3fe483f640 1 --2- 172.21.15.38:0/1204250553 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fcc06a460 0x7f3fcc06c920 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.626+0000 7f3fe483f640 1 --2- 172.21.15.38:0/1204250553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe0149ae0 0x7f3fe00b80c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.626+0000 7f3fe483f640 1 --2- 172.21.15.38:0/1204250553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe01f7050 0x7f3fe0154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.626+0000 7f3fe483f640 1 --2- 172.21.15.38:0/1204250553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc8003970 0x7f3fe00acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.626+0000 7f3fe483f640 1 -- 172.21.15.38:0/1204250553 >> 172.21.15.38:0/1204250553 conn(0x7f3fe00d31f0 msgr2=0x7f3fe006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:47.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.627+0000 7f3fe483f640 1 -- 172.21.15.38:0/1204250553 shutdown_connections 2023-12-22T08:42:47.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.627+0000 7f3fe483f640 1 -- 172.21.15.38:0/1204250553 wait complete. 2023-12-22T08:42:47.650 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:42:47.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.874+0000 7f4abffff640 1 Processor -- start 2023-12-22T08:42:47.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.874+0000 7f4abffff640 1 -- start start 2023-12-22T08:42:47.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.876+0000 7f4abffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4ac015b420 0x7f4ac006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.876+0000 7f4abffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4ac00a44a0 0x7f4ac00708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.876+0000 7f4abffff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac00cdae0 con 0x7f4ac0070e30 2023-12-22T08:42:47.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.876+0000 7f4abffff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac006dec0 con 0x7f4ac00a44a0 2023-12-22T08:42:47.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.876+0000 7f4abffff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac0071250 con 0x7f4ac015b420 2023-12-22T08:42:47.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.877+0000 7f4abf7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4ac0070e30 0x7f4ac006f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49728/0 (socket says 172.21.15.38:49728) 2023-12-22T08:42:47.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.877+0000 7f4abf7fe640 1 -- 172.21.15.38:0/2891828908 learned_addr learned my addr 172.21.15.38:0/2891828908 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:47.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.877+0000 7f4ab7fff640 1 --2- 172.21.15.38:0/2891828908 >> v2:172.21.15.38:3300/0 conn(0x7f4ac00a44a0 0x7f4ac00708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:47.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.877+0000 7f4abeffd640 1 --2- 172.21.15.38:0/2891828908 >> v2:172.21.15.89:3300/0 conn(0x7f4ac015b420 0x7f4ac006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:47.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.877+0000 7f4abe7fc640 1 -- 172.21.15.38:0/2891828908 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642911696 0 0) 0x7f4ac00cdae0 con 0x7f4ac0070e30 2023-12-22T08:42:47.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.877+0000 7f4abe7fc640 1 -- 172.21.15.38:0/2891828908 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aac003520 con 0x7f4ac0070e30 2023-12-22T08:42:47.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.878+0000 7f4ab7fff640 1 -- 172.21.15.38:0/2891828908 >> v2:172.21.15.89:3300/0 conn(0x7f4ac015b420 msgr2=0x7f4ac006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:47.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.878+0000 7f4ab7fff640 1 --2- 172.21.15.38:0/2891828908 >> v2:172.21.15.89:3300/0 conn(0x7f4ac015b420 0x7f4ac006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.878+0000 7f4ab7fff640 1 -- 172.21.15.38:0/2891828908 >> v1:172.21.15.38:6789/0 conn(0x7f4ac0070e30 legacy=0x7f4ac006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:47.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.878+0000 7f4ab7fff640 1 -- 172.21.15.38:0/2891828908 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac015b800 con 0x7f4ac00a44a0 2023-12-22T08:42:47.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.879+0000 7f4ab7fff640 1 --2- 172.21.15.38:0/2891828908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ac00a44a0 0x7f4ac00708f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00613e0 tx=0x7f4aa802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d806613db88153 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:47.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.879+0000 7f4abe7fc640 1 -- 172.21.15.38:0/2891828908 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8031640 con 0x7f4ac00a44a0 2023-12-22T08:42:47.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.879+0000 7f4abe7fc640 1 -- 172.21.15.38:0/2891828908 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa80317a0 con 0x7f4ac00a44a0 2023-12-22T08:42:47.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.879+0000 7f4abe7fc640 1 -- 172.21.15.38:0/2891828908 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8031b70 con 0x7f4ac00a44a0 2023-12-22T08:42:47.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.880+0000 7f4abffff640 1 -- 172.21.15.38:0/2891828908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ac00a44a0 msgr2=0x7f4ac00708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:47.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.880+0000 7f4abffff640 1 --2- 172.21.15.38:0/2891828908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ac00a44a0 0x7f4ac00708f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00613e0 tx=0x7f4aa802b8f0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.880+0000 7f4abffff640 1 -- 172.21.15.38:0/2891828908 shutdown_connections 2023-12-22T08:42:47.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.880+0000 7f4abffff640 1 --2- 172.21.15.38:0/2891828908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ac00a44a0 0x7f4ac00708f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.880+0000 7f4abffff640 1 --2- 172.21.15.38:0/2891828908 >> v2:172.21.15.89:3300/0 conn(0x7f4ac015b420 0x7f4ac006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.880+0000 7f4abffff640 1 -- 172.21.15.38:0/2891828908 >> 172.21.15.38:0/2891828908 conn(0x7f4ac00b1f70 msgr2=0x7f4ac00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:47.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.880+0000 7f4abffff640 1 -- 172.21.15.38:0/2891828908 shutdown_connections 2023-12-22T08:42:47.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.880+0000 7f4abffff640 1 -- 172.21.15.38:0/2891828908 wait complete. 2023-12-22T08:42:47.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.882+0000 7f4abffff640 1 Processor -- start 2023-12-22T08:42:47.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.882+0000 7f4abffff640 1 -- start start 2023-12-22T08:42:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ac0070e30 0x7f4ac014ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ac00a44a0 0x7f4ac009eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ac015b420 0x7f4ac009f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac014e520 con 0x7f4ac0070e30 2023-12-22T08:42:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abffff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac01f2880 con 0x7f4ac00a44a0 2023-12-22T08:42:47.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac01f2af0 con 0x7f4ac015b420 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ac0070e30 0x7f4ac014ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ac0070e30 0x7f4ac014ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40950/0 (socket says 172.21.15.38:40950) 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abeffd640 1 -- 172.21.15.38:0/394657227 learned_addr learned my addr 172.21.15.38:0/394657227 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abeffd640 1 -- 172.21.15.38:0/394657227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ac015b420 msgr2=0x7f4ac009f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abeffd640 1 --2- 172.21.15.38:0/394657227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ac015b420 0x7f4ac009f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4ab7fff640 1 --2- 172.21.15.38:0/394657227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ac00a44a0 0x7f4ac009eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abeffd640 1 -- 172.21.15.38:0/394657227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ac00a44a0 msgr2=0x7f4ac009eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abeffd640 1 --2- 172.21.15.38:0/394657227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ac00a44a0 0x7f4ac009eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.883+0000 7f4abeffd640 1 -- 172.21.15.38:0/394657227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa8009400 con 0x7f4ac0070e30 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.884+0000 7f4abeffd640 1 --2- 172.21.15.38:0/394657227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ac0070e30 0x7f4ac014ae60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000d830 tx=0x7f4ab000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.884+0000 7f4ab77fe640 1 -- 172.21.15.38:0/394657227 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000b6c0 con 0x7f4ac0070e30 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.884+0000 7f4ab77fe640 1 -- 172.21.15.38:0/394657227 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab000b820 con 0x7f4ac0070e30 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.884+0000 7f4ab77fe640 1 -- 172.21.15.38:0/394657227 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000bbb0 con 0x7f4ac0070e30 2023-12-22T08:42:47.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.884+0000 7f4abffff640 1 -- 172.21.15.38:0/394657227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac01f2dd0 con 0x7f4ac0070e30 2023-12-22T08:42:47.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.884+0000 7f4abffff640 1 -- 172.21.15.38:0/394657227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac01f3390 con 0x7f4ac0070e30 2023-12-22T08:42:47.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.885+0000 7f4abffff640 1 -- 172.21.15.38:0/394657227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac0061910 con 0x7f4ac0070e30 2023-12-22T08:42:47.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.886+0000 7f4ab77fe640 1 -- 172.21.15.38:0/394657227 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4ab001e460 con 0x7f4ac0070e30 2023-12-22T08:42:47.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.887+0000 7f4ab77fe640 1 --2- 172.21.15.38:0/394657227 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4aa006a430 0x7f4aa006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:47.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.887+0000 7f4ab77fe640 1 -- 172.21.15.38:0/394657227 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ab0089130 con 0x7f4ac0070e30 2023-12-22T08:42:47.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.888+0000 7f4ab7fff640 1 --2- 172.21.15.38:0/394657227 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4aa006a430 0x7f4aa006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:47.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.889+0000 7f4ab7fff640 1 --2- 172.21.15.38:0/394657227 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4aa006a430 0x7f4aa006c8f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8036000 tx=0x7f4aa8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:47.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:47.892+0000 7f4ab77fe640 1 -- 172.21.15.38:0/394657227 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4ab0054680 con 0x7f4ac0070e30 2023-12-22T08:42:48.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.085+0000 7f4abffff640 1 -- 172.21.15.38:0/394657227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ac00cb5c0 con 0x7f4ac0070e30 2023-12-22T08:42:48.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.087+0000 7f4ab77fe640 1 -- 172.21.15.38:0/394657227 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f4ab0057ca0 con 0x7f4ac0070e30 2023-12-22T08:42:48.090 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:48.090 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":59,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:42:33.327912+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:58.840533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:59.953505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:42:48.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.090+0000 7f4abffff640 1 -- 172.21.15.38:0/394657227 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4aa006a430 msgr2=0x7f4aa006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:48.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.090+0000 7f4abffff640 1 --2- 172.21.15.38:0/394657227 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4aa006a430 0x7f4aa006c8f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8036000 tx=0x7f4aa8008030 comp rx=0 tx=0).stop 2023-12-22T08:42:48.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.090+0000 7f4abffff640 1 -- 172.21.15.38:0/394657227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ac0070e30 msgr2=0x7f4ac014ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:48.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.090+0000 7f4abffff640 1 --2- 172.21.15.38:0/394657227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ac0070e30 0x7f4ac014ae60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000d830 tx=0x7f4ab000dcf0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.090+0000 7f4abffff640 1 -- 172.21.15.38:0/394657227 shutdown_connections 2023-12-22T08:42:48.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.090+0000 7f4abffff640 1 --2- 172.21.15.38:0/394657227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ac015b420 0x7f4ac009f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.090+0000 7f4abffff640 1 --2- 172.21.15.38:0/394657227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ac00a44a0 0x7f4ac009eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.090+0000 7f4abffff640 1 --2- 172.21.15.38:0/394657227 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4aa006a430 0x7f4aa006c8f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.090+0000 7f4abffff640 1 --2- 172.21.15.38:0/394657227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ac0070e30 0x7f4ac014ae60 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.090+0000 7f4abffff640 1 -- 172.21.15.38:0/394657227 >> 172.21.15.38:0/394657227 conn(0x7f4ac00b1f70 msgr2=0x7f4ac006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:48.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.090+0000 7f4abffff640 1 -- 172.21.15.38:0/394657227 shutdown_connections 2023-12-22T08:42:48.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.090+0000 7f4abffff640 1 -- 172.21.15.38:0/394657227 wait complete. 2023-12-22T08:42:48.114 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T08:42:48.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.341+0000 7fd5d2c95640 1 Processor -- start 2023-12-22T08:42:48.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.342+0000 7fd5d2c95640 1 -- start start 2023-12-22T08:42:48.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.343+0000 7fd5d2c95640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd5cc0b6620 0x7fd5cc0b8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:48.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.343+0000 7fd5d2c95640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5cc0b4430 con 0x7fd5cc146f00 2023-12-22T08:42:48.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.344+0000 7fd5d2c95640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5cc0b4710 con 0x7fd5cc0b3b20 2023-12-22T08:42:48.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.344+0000 7fd5d2c95640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5cc0b49f0 con 0x7fd5cc0b6620 2023-12-22T08:42:48.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.344+0000 7fd5d2494640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd5cc146f00 0x7fd5cc0d0dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49730/0 (socket says 172.21.15.38:49730) 2023-12-22T08:42:48.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.344+0000 7fd5d2494640 1 -- 172.21.15.38:0/2714908342 learned_addr learned my addr 172.21.15.38:0/2714908342 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:48.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.344+0000 7fd5d1c93640 1 --2- 172.21.15.38:0/2714908342 >> v2:172.21.15.89:3300/0 conn(0x7fd5cc0b6620 0x7fd5cc0b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:48.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.345+0000 7fd5d0c91640 1 -- 172.21.15.38:0/2714908342 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952954322 0 0) 0x7fd5cc0b4430 con 0x7fd5cc146f00 2023-12-22T08:42:48.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.345+0000 7fd5d0c91640 1 -- 172.21.15.38:0/2714908342 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b8003520 con 0x7fd5cc146f00 2023-12-22T08:42:48.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.345+0000 7fd5d1c93640 1 -- 172.21.15.38:0/2714908342 >> v1:172.21.15.89:6789/0 conn(0x7fd5cc0b3b20 legacy=0x7fd5cc1467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:48.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.345+0000 7fd5d1c93640 1 -- 172.21.15.38:0/2714908342 >> v1:172.21.15.38:6789/0 conn(0x7fd5cc146f00 legacy=0x7fd5cc0d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:48.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.345+0000 7fd5d1c93640 1 -- 172.21.15.38:0/2714908342 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc0b4cd0 con 0x7fd5cc0b6620 2023-12-22T08:42:48.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.347+0000 7fd5d1c93640 1 --2- 172.21.15.38:0/2714908342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5cc0b6620 0x7fd5cc0b8750 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80097a0 tx=0x7fd5c802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5d1c1da44d854f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:48.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.347+0000 7fd5d0c91640 1 -- 172.21.15.38:0/2714908342 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8031830 con 0x7fd5cc0b6620 2023-12-22T08:42:48.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.347+0000 7fd5d0c91640 1 -- 172.21.15.38:0/2714908342 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c8031990 con 0x7fd5cc0b6620 2023-12-22T08:42:48.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.347+0000 7fd5d0c91640 1 -- 172.21.15.38:0/2714908342 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8031d00 con 0x7fd5cc0b6620 2023-12-22T08:42:48.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.348+0000 7fd5d2c95640 1 -- 172.21.15.38:0/2714908342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5cc0b6620 msgr2=0x7fd5cc0b8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:48.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.348+0000 7fd5d2c95640 1 --2- 172.21.15.38:0/2714908342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5cc0b6620 0x7fd5cc0b8750 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80097a0 tx=0x7fd5c802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.348+0000 7fd5d2c95640 1 -- 172.21.15.38:0/2714908342 shutdown_connections 2023-12-22T08:42:48.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.348+0000 7fd5d2c95640 1 --2- 172.21.15.38:0/2714908342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5cc0b6620 0x7fd5cc0b8750 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.348+0000 7fd5d2c95640 1 -- 172.21.15.38:0/2714908342 >> 172.21.15.38:0/2714908342 conn(0x7fd5cc0d32c0 msgr2=0x7fd5cc0d36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:48.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.348+0000 7fd5d2c95640 1 -- 172.21.15.38:0/2714908342 shutdown_connections 2023-12-22T08:42:48.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.348+0000 7fd5d2c95640 1 -- 172.21.15.38:0/2714908342 wait complete. 2023-12-22T08:42:48.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.350+0000 7fd5d2c95640 1 Processor -- start 2023-12-22T08:42:48.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.350+0000 7fd5d2c95640 1 -- start start 2023-12-22T08:42:48.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.351+0000 7fd5d2c95640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5cc0b6620 0x7fd5cc1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:48.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.351+0000 7fd5d2c95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5cc146f00 0x7fd5cc13ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:48.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.351+0000 7fd5d2c95640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5cc1f5fc0 0x7fd5cc070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:48.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.351+0000 7fd5d2c95640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc13b3b0 con 0x7fd5cc1f5fc0 2023-12-22T08:42:48.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.351+0000 7fd5d2c95640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc1572a0 con 0x7fd5cc146f00 2023-12-22T08:42:48.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.351+0000 7fd5d2c95640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc1f6530 con 0x7fd5cc0b6620 2023-12-22T08:42:48.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.352+0000 7fd5d2494640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5cc1f5fc0 0x7fd5cc070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:48.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.352+0000 7fd5d2494640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5cc1f5fc0 0x7fd5cc070130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40958/0 (socket says 172.21.15.38:40958) 2023-12-22T08:42:48.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.352+0000 7fd5d2494640 1 -- 172.21.15.38:0/376314125 learned_addr learned my addr 172.21.15.38:0/376314125 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:48.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.352+0000 7fd5d1c93640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5cc0b6620 0x7fd5cc1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:48.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.352+0000 7fd5d1492640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5cc146f00 0x7fd5cc13ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:48.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.352+0000 7fd5d2494640 1 -- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5cc0b6620 msgr2=0x7fd5cc1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:48.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.352+0000 7fd5d2494640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5cc0b6620 0x7fd5cc1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.352+0000 7fd5d2494640 1 -- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5cc146f00 msgr2=0x7fd5cc13ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:48.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.352+0000 7fd5d2494640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5cc146f00 0x7fd5cc13ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.352+0000 7fd5d2494640 1 -- 172.21.15.38:0/376314125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c8009400 con 0x7fd5cc1f5fc0 2023-12-22T08:42:48.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.352+0000 7fd5d2494640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5cc1f5fc0 0x7fd5cc070130 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400cad0 tx=0x7fd5c400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:48.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.353+0000 7fd5c27fc640 1 -- 172.21.15.38:0/376314125 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400abd0 con 0x7fd5cc1f5fc0 2023-12-22T08:42:48.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.353+0000 7fd5c27fc640 1 -- 172.21.15.38:0/376314125 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c400ad30 con 0x7fd5cc1f5fc0 2023-12-22T08:42:48.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.353+0000 7fd5d2c95640 1 -- 172.21.15.38:0/376314125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5cc1f6810 con 0x7fd5cc1f5fc0 2023-12-22T08:42:48.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.353+0000 7fd5c27fc640 1 -- 172.21.15.38:0/376314125 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400aea0 con 0x7fd5cc1f5fc0 2023-12-22T08:42:48.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.353+0000 7fd5d2c95640 1 -- 172.21.15.38:0/376314125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc1f6dd0 con 0x7fd5cc1f5fc0 2023-12-22T08:42:48.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.354+0000 7fd5d2c95640 1 -- 172.21.15.38:0/376314125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5cc061910 con 0x7fd5cc1f5fc0 2023-12-22T08:42:48.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.355+0000 7fd5c27fc640 1 -- 172.21.15.38:0/376314125 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd5c4007070 con 0x7fd5cc1f5fc0 2023-12-22T08:42:48.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.356+0000 7fd5c27fc640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd5b006a460 0x7fd5b006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:48.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.357+0000 7fd5c27fc640 1 -- 172.21.15.38:0/376314125 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5c40888d0 con 0x7fd5cc1f5fc0 2023-12-22T08:42:48.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.357+0000 7fd5d1c93640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd5b006a460 0x7fd5b006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:48.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.358+0000 7fd5d1c93640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd5b006a460 0x7fd5b006c920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8036000 tx=0x7fd5c803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:48.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.361+0000 7fd5c27fc640 1 -- 172.21.15.38:0/376314125 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd5c4053e20 con 0x7fd5cc1f5fc0 2023-12-22T08:42:48.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.598+0000 7fd5d2c95640 1 -- 172.21.15.38:0/376314125 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd5cc157920 con 0x7fd5cc1f5fc0 2023-12-22T08:42:48.603 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:42:48.601+0000 7f0a26ee3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T08:42:48.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.623+0000 7fd5c27fc640 1 -- 172.21.15.38:0/376314125 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd5c4017020 con 0x7fd5cc1f5fc0 2023-12-22T08:42:48.625 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T08:42:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.626+0000 7fd5d2c95640 1 -- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd5b006a460 msgr2=0x7fd5b006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.626+0000 7fd5d2c95640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd5b006a460 0x7fd5b006c920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8036000 tx=0x7fd5c803c040 comp rx=0 tx=0).stop 2023-12-22T08:42:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.626+0000 7fd5d2c95640 1 -- 172.21.15.38:0/376314125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5cc1f5fc0 msgr2=0x7fd5cc070130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.626+0000 7fd5d2c95640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5cc1f5fc0 0x7fd5cc070130 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400cad0 tx=0x7fd5c400cf90 comp rx=0 tx=0).stop 2023-12-22T08:42:48.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.626+0000 7fd5d2c95640 1 -- 172.21.15.38:0/376314125 shutdown_connections 2023-12-22T08:42:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.626+0000 7fd5d2c95640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd5b006a460 0x7fd5b006c920 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.626+0000 7fd5d2c95640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5cc1f5fc0 0x7fd5cc070130 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.626+0000 7fd5d2c95640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5cc146f00 0x7fd5cc13ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.626+0000 7fd5d2c95640 1 --2- 172.21.15.38:0/376314125 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5cc0b6620 0x7fd5cc1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.626+0000 7fd5d2c95640 1 -- 172.21.15.38:0/376314125 >> 172.21.15.38:0/376314125 conn(0x7fd5cc0d32c0 msgr2=0x7fd5cc145d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.626+0000 7fd5d2c95640 1 -- 172.21.15.38:0/376314125 shutdown_connections 2023-12-22T08:42:48.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.626+0000 7fd5d2c95640 1 -- 172.21.15.38:0/376314125 wait complete. 2023-12-22T08:42:48.647 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T08:42:48.712 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-12-22T08:42:48.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.864+0000 7fc89103f640 1 Processor -- start 2023-12-22T08:42:48.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.864+0000 7fc89103f640 1 -- start start 2023-12-22T08:42:48.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.866+0000 7fc89103f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc88c0b3b20 0x7fc88c1467f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:48.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.866+0000 7fc89103f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc88c0b6a00 0x7fc88c146d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:48.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.866+0000 7fc89103f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88c0b8e60 con 0x7fc88c0b6620 2023-12-22T08:42:48.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.866+0000 7fc89103f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88c0b4430 con 0x7fc88c0b3b20 2023-12-22T08:42:48.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.866+0000 7fc89103f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88c0b4710 con 0x7fc88c0b6a00 2023-12-22T08:42:48.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.866+0000 7fc88b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc88c0b3b20 0x7fc88c1467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:48.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.866+0000 7fc88b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc88c0b3b20 0x7fc88c1467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40974/0 (socket says 172.21.15.38:40974) 2023-12-22T08:42:48.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.866+0000 7fc88b7fe640 1 -- 172.21.15.38:0/927149940 learned_addr learned my addr 172.21.15.38:0/927149940 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:48.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.867+0000 7fc89083e640 1 --2- 172.21.15.38:0/927149940 >> v2:172.21.15.89:3300/0 conn(0x7fc88c0b6a00 0x7fc88c146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:48.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.867+0000 7fc88b7fe640 1 -- 172.21.15.38:0/927149940 >> v2:172.21.15.89:3300/0 conn(0x7fc88c0b6a00 msgr2=0x7fc88c146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:48.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.867+0000 7fc88b7fe640 1 --2- 172.21.15.38:0/927149940 >> v2:172.21.15.89:3300/0 conn(0x7fc88c0b6a00 0x7fc88c146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.867+0000 7fc88b7fe640 1 -- 172.21.15.38:0/927149940 >> v1:172.21.15.89:6789/0 conn(0x7fc88c0b6620 legacy=0x7fc88c0b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:48.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.867+0000 7fc88b7fe640 1 -- 172.21.15.38:0/927149940 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c0b49f0 con 0x7fc88c0b3b20 2023-12-22T08:42:48.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.867+0000 7fc89083e640 1 --2- 172.21.15.38:0/927149940 >> v2:172.21.15.89:3300/0 conn(0x7fc88c0b6a00 0x7fc88c146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:48.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.868+0000 7fc88b7fe640 1 --2- 172.21.15.38:0/927149940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc88c0b3b20 0x7fc88c1467f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0b8020 tx=0x7fc87402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d29a907dfd64d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:48.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.868+0000 7fc88affd640 1 -- 172.21.15.38:0/927149940 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740317c0 con 0x7fc88c0b3b20 2023-12-22T08:42:48.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.868+0000 7fc88affd640 1 -- 172.21.15.38:0/927149940 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc874031920 con 0x7fc88c0b3b20 2023-12-22T08:42:48.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.868+0000 7fc88affd640 1 -- 172.21.15.38:0/927149940 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874031cb0 con 0x7fc88c0b3b20 2023-12-22T08:42:48.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.869+0000 7fc89103f640 1 -- 172.21.15.38:0/927149940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc88c0b3b20 msgr2=0x7fc88c1467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:48.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.869+0000 7fc89103f640 1 --2- 172.21.15.38:0/927149940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc88c0b3b20 0x7fc88c1467f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0b8020 tx=0x7fc87402b860 comp rx=0 tx=0).stop 2023-12-22T08:42:48.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.869+0000 7fc89103f640 1 -- 172.21.15.38:0/927149940 shutdown_connections 2023-12-22T08:42:48.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.869+0000 7fc89103f640 1 --2- 172.21.15.38:0/927149940 >> v2:172.21.15.89:3300/0 conn(0x7fc88c0b6a00 0x7fc88c146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.869+0000 7fc89103f640 1 --2- 172.21.15.38:0/927149940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc88c0b3b20 0x7fc88c1467f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.869+0000 7fc89103f640 1 -- 172.21.15.38:0/927149940 >> 172.21.15.38:0/927149940 conn(0x7fc88c0d32c0 msgr2=0x7fc88c0d36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:48.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.869+0000 7fc89103f640 1 -- 172.21.15.38:0/927149940 shutdown_connections 2023-12-22T08:42:48.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.869+0000 7fc89103f640 1 -- 172.21.15.38:0/927149940 wait complete. 2023-12-22T08:42:48.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.871+0000 7fc89103f640 1 Processor -- start 2023-12-22T08:42:48.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.871+0000 7fc89103f640 1 -- start start 2023-12-22T08:42:48.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.872+0000 7fc89103f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc88c0b6620 0x7fc88c143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.872+0000 7fc89103f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc88c0b6a00 0x7fc88c0ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.872+0000 7fc89103f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc88c1f26c0 0x7fc88c0b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.872+0000 7fc89103f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c0ac260 con 0x7fc88c0b6a00 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.872+0000 7fc89103f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c0a9bb0 con 0x7fc88c0b6620 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.872+0000 7fc89103f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c0aa170 con 0x7fc88c1f26c0 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.872+0000 7fc88b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc88c0b6a00 0x7fc88c0ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.872+0000 7fc88b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc88c0b6a00 0x7fc88c0ab610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40976/0 (socket says 172.21.15.38:40976) 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.872+0000 7fc88b7fe640 1 -- 172.21.15.38:0/1820139443 learned_addr learned my addr 172.21.15.38:0/1820139443 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.873+0000 7fc88bfff640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc88c0b6620 0x7fc88c143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.873+0000 7fc88b7fe640 1 -- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc88c1f26c0 msgr2=0x7fc88c0b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.873+0000 7fc89083e640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc88c1f26c0 0x7fc88c0b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.873+0000 7fc88b7fe640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc88c1f26c0 0x7fc88c0b2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.873+0000 7fc88b7fe640 1 -- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc88c0b6620 msgr2=0x7fc88c143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:48.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.873+0000 7fc88b7fe640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc88c0b6620 0x7fc88c143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:48.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.873+0000 7fc88b7fe640 1 -- 172.21.15.38:0/1820139443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8740094d0 con 0x7fc88c0b6a00 2023-12-22T08:42:48.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.873+0000 7fc88bfff640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc88c0b6620 0x7fc88c143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:48.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.873+0000 7fc88b7fe640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc88c0b6a00 0x7fc88c0ab610 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc874000c00 tx=0x7fc8740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:48.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.874+0000 7fc888ff9640 1 -- 172.21.15.38:0/1820139443 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740329a0 con 0x7fc88c0b6a00 2023-12-22T08:42:48.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.874+0000 7fc888ff9640 1 -- 172.21.15.38:0/1820139443 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc874032b20 con 0x7fc88c0b6a00 2023-12-22T08:42:48.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.874+0000 7fc888ff9640 1 -- 172.21.15.38:0/1820139443 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740453f0 con 0x7fc88c0b6a00 2023-12-22T08:42:48.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.874+0000 7fc89103f640 1 -- 172.21.15.38:0/1820139443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88c0b2b90 con 0x7fc88c0b6a00 2023-12-22T08:42:48.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.874+0000 7fc89103f640 1 -- 172.21.15.38:0/1820139443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88c0abf80 con 0x7fc88c0b6a00 2023-12-22T08:42:48.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.875+0000 7fc89103f640 1 -- 172.21.15.38:0/1820139443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88c0aa300 con 0x7fc88c0b6a00 2023-12-22T08:42:48.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.876+0000 7fc888ff9640 1 -- 172.21.15.38:0/1820139443 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc874045550 con 0x7fc88c0b6a00 2023-12-22T08:42:48.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.877+0000 7fc888ff9640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc86c06a430 0x7fc86c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:48.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.877+0000 7fc888ff9640 1 -- 172.21.15.38:0/1820139443 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fc8740aae00 con 0x7fc88c0b6a00 2023-12-22T08:42:48.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.877+0000 7fc88bfff640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc86c06a430 0x7fc86c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:48.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.878+0000 7fc88bfff640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc86c06a430 0x7fc86c06c8f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc87c004520 tx=0x7fc87c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:48.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:48.881+0000 7fc888ff9640 1 -- 172.21.15.38:0/1820139443 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc874076260 con 0x7fc88c0b6a00 2023-12-22T08:42:49.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.116+0000 7fc89103f640 1 -- 172.21.15.38:0/1820139443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc88c0aa2b0 con 0x7fc88c0b6a00 2023-12-22T08:42:49.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.631+0000 7fc888ff9640 1 -- 172.21.15.38:0/1820139443 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc874079880 con 0x7fc88c0b6a00 2023-12-22T08:42:49.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.635+0000 7fc89103f640 1 -- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc86c06a430 msgr2=0x7fc86c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:49.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.635+0000 7fc89103f640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc86c06a430 0x7fc86c06c8f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc87c004520 tx=0x7fc87c009040 comp rx=0 tx=0).stop 2023-12-22T08:42:49.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.635+0000 7fc89103f640 1 -- 172.21.15.38:0/1820139443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc88c0b6a00 msgr2=0x7fc88c0ab610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:49.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.635+0000 7fc89103f640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc88c0b6a00 0x7fc88c0ab610 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc874000c00 tx=0x7fc8740046c0 comp rx=0 tx=0).stop 2023-12-22T08:42:49.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.635+0000 7fc89103f640 1 -- 172.21.15.38:0/1820139443 shutdown_connections 2023-12-22T08:42:49.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.635+0000 7fc89103f640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc88c1f26c0 0x7fc88c0b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:49.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.635+0000 7fc89103f640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc86c06a430 0x7fc86c06c8f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:49.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.635+0000 7fc89103f640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc88c0b6a00 0x7fc88c0ab610 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:49.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.635+0000 7fc89103f640 1 --2- 172.21.15.38:0/1820139443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc88c0b6620 0x7fc88c143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:49.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.635+0000 7fc89103f640 1 -- 172.21.15.38:0/1820139443 >> 172.21.15.38:0/1820139443 conn(0x7fc88c0d32c0 msgr2=0x7fc88c0d36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:49.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.635+0000 7fc89103f640 1 -- 172.21.15.38:0/1820139443 shutdown_connections 2023-12-22T08:42:49.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.635+0000 7fc89103f640 1 -- 172.21.15.38:0/1820139443 wait complete. 2023-12-22T08:42:49.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T08:42:49.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.893+0000 7f749d549640 1 Processor -- start 2023-12-22T08:42:49.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.893+0000 7f749d549640 1 -- start start 2023-12-22T08:42:49.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.895+0000 7f749d549640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f749815b370 0x7f749806d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:49.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.895+0000 7f749d549640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74980ae6c0 0x7f749806fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:49.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.895+0000 7f749d549640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f749815ca20 con 0x7f749806d6a0 2023-12-22T08:42:49.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.895+0000 7f749d549640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749815b750 con 0x7f749815b370 2023-12-22T08:42:49.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.895+0000 7f749d549640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749806dc20 con 0x7f74980ae6c0 2023-12-22T08:42:49.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.895+0000 7f7497fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f749815b370 0x7f749806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:49.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.895+0000 7f7497fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f749815b370 0x7f749806d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40984/0 (socket says 172.21.15.38:40984) 2023-12-22T08:42:49.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.895+0000 7f7497fff640 1 -- 172.21.15.38:0/1375360026 learned_addr learned my addr 172.21.15.38:0/1375360026 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:49.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.896+0000 7f749cd48640 1 --2- 172.21.15.38:0/1375360026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74980ae6c0 0x7f749806fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:49.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.896+0000 7f7497fff640 1 -- 172.21.15.38:0/1375360026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74980ae6c0 msgr2=0x7f749806fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:49.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.896+0000 7f7497fff640 1 --2- 172.21.15.38:0/1375360026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74980ae6c0 0x7f749806fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:49.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.896+0000 7f7497fff640 1 -- 172.21.15.38:0/1375360026 >> v1:172.21.15.89:6789/0 conn(0x7f749806d6a0 legacy=0x7f74980adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:49.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.896+0000 7f7497fff640 1 -- 172.21.15.38:0/1375360026 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749806df00 con 0x7f749815b370 2023-12-22T08:42:49.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.897+0000 7f7497fff640 1 --2- 172.21.15.38:0/1375360026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749815b370 0x7f749806d160 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7488009870 tx=0x7f748802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821f25258d053e5b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:49.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.897+0000 7f7496ffd640 1 -- 172.21.15.38:0/1375360026 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488031640 con 0x7f749815b370 2023-12-22T08:42:49.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.897+0000 7f7496ffd640 1 -- 172.21.15.38:0/1375360026 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74880317a0 con 0x7f749815b370 2023-12-22T08:42:49.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.897+0000 7f7496ffd640 1 -- 172.21.15.38:0/1375360026 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488031b30 con 0x7f749815b370 2023-12-22T08:42:49.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.898+0000 7f749d549640 1 -- 172.21.15.38:0/1375360026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749815b370 msgr2=0x7f749806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:49.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.898+0000 7f749d549640 1 --2- 172.21.15.38:0/1375360026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749815b370 0x7f749806d160 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7488009870 tx=0x7f748802b8f0 comp rx=0 tx=0).stop 2023-12-22T08:42:49.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.898+0000 7f749d549640 1 -- 172.21.15.38:0/1375360026 shutdown_connections 2023-12-22T08:42:49.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.898+0000 7f749d549640 1 --2- 172.21.15.38:0/1375360026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74980ae6c0 0x7f749806fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:49.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.898+0000 7f749d549640 1 --2- 172.21.15.38:0/1375360026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749815b370 0x7f749806d160 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:49.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.898+0000 7f749d549640 1 -- 172.21.15.38:0/1375360026 >> 172.21.15.38:0/1375360026 conn(0x7f74980b1110 msgr2=0x7f74980b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:49.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.898+0000 7f749d549640 1 -- 172.21.15.38:0/1375360026 shutdown_connections 2023-12-22T08:42:49.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.898+0000 7f749d549640 1 -- 172.21.15.38:0/1375360026 wait complete. 2023-12-22T08:42:49.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.900+0000 7f749d549640 1 Processor -- start 2023-12-22T08:42:49.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.900+0000 7f749d549640 1 -- start start 2023-12-22T08:42:49.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f749d549640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749806d6a0 0x7f7498099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:49.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f749d549640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74980ae6c0 0x7f74981f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:49.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f749d549640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749815b370 0x7f7498159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:49.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f749d549640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749809b090 con 0x7f749806d6a0 2023-12-22T08:42:49.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f749d549640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7498099fb0 con 0x7f749815b370 2023-12-22T08:42:49.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f749d549640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74981f5920 con 0x7f74980ae6c0 2023-12-22T08:42:49.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f7497fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749806d6a0 0x7f7498099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:49.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f7497fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749806d6a0 0x7f7498099a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40990/0 (socket says 172.21.15.38:40990) 2023-12-22T08:42:49.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f7497fff640 1 -- 172.21.15.38:0/649712179 learned_addr learned my addr 172.21.15.38:0/649712179 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f74977fe640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74980ae6c0 0x7f74981f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f749cd48640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749815b370 0x7f7498159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f7497fff640 1 -- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74980ae6c0 msgr2=0x7f74981f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f7497fff640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74980ae6c0 0x7f74981f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f7497fff640 1 -- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749815b370 msgr2=0x7f7498159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.901+0000 7f7497fff640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749815b370 0x7f7498159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.902+0000 7f7497fff640 1 -- 172.21.15.38:0/649712179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74880094d0 con 0x7f749806d6a0 2023-12-22T08:42:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.902+0000 7f74977fe640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74980ae6c0 0x7f74981f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.902+0000 7f749cd48640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749815b370 0x7f7498159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.902+0000 7f7497fff640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749806d6a0 0x7f7498099a70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7488009870 tx=0x7f74880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.902+0000 7f7494ff9640 1 -- 172.21.15.38:0/649712179 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748803ac60 con 0x7f749806d6a0 2023-12-22T08:42:49.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.902+0000 7f7494ff9640 1 -- 172.21.15.38:0/649712179 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748803ade0 con 0x7f749806d6a0 2023-12-22T08:42:49.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.902+0000 7f749d549640 1 -- 172.21.15.38:0/649712179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74981f2570 con 0x7f749806d6a0 2023-12-22T08:42:49.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.902+0000 7f7494ff9640 1 -- 172.21.15.38:0/649712179 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488044630 con 0x7f749806d6a0 2023-12-22T08:42:49.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.902+0000 7f749d549640 1 -- 172.21.15.38:0/649712179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74981f2b10 con 0x7f749806d6a0 2023-12-22T08:42:49.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.903+0000 7f749d549640 1 -- 172.21.15.38:0/649712179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7498061910 con 0x7f749806d6a0 2023-12-22T08:42:49.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.905+0000 7f7494ff9640 1 -- 172.21.15.38:0/649712179 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f748802f050 con 0x7f749806d6a0 2023-12-22T08:42:49.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.905+0000 7f7494ff9640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f748406a480 0x7f748406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:49.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.906+0000 7f7494ff9640 1 -- 172.21.15.38:0/649712179 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f74880aaa90 con 0x7f749806d6a0 2023-12-22T08:42:49.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.906+0000 7f74977fe640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f748406a480 0x7f748406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:49.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.907+0000 7f74977fe640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f748406a480 0x7f748406c940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7498156f60 tx=0x7f748c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:49.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:49.910+0000 7f7494ff9640 1 -- 172.21.15.38:0/649712179 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f74880760c0 con 0x7f749806d6a0 2023-12-22T08:42:50.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.103+0000 7f749d549640 1 -- 172.21.15.38:0/649712179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f74980cab10 con 0x7f749806d6a0 2023-12-22T08:42:50.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.634+0000 7f7494ff9640 1 -- 172.21.15.38:0/649712179 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v62) v1 ==== 181+0+0 (secure 0 0 0) 0x7f74880796e0 con 0x7f749806d6a0 2023-12-22T08:42:50.636 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2023-12-22T08:42:50.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.637+0000 7f749d549640 1 -- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f748406a480 msgr2=0x7f748406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:50.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.637+0000 7f749d549640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f748406a480 0x7f748406c940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7498156f60 tx=0x7f748c009040 comp rx=0 tx=0).stop 2023-12-22T08:42:50.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.637+0000 7f749d549640 1 -- 172.21.15.38:0/649712179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749806d6a0 msgr2=0x7f7498099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:50.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.637+0000 7f749d549640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749806d6a0 0x7f7498099a70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7488009870 tx=0x7f74880046c0 comp rx=0 tx=0).stop 2023-12-22T08:42:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.638+0000 7f749d549640 1 -- 172.21.15.38:0/649712179 shutdown_connections 2023-12-22T08:42:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.638+0000 7f749d549640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f749815b370 0x7f7498159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.638+0000 7f749d549640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74980ae6c0 0x7f74981f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.638+0000 7f749d549640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f748406a480 0x7f748406c940 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.638+0000 7f749d549640 1 --2- 172.21.15.38:0/649712179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749806d6a0 0x7f7498099a70 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.638+0000 7f749d549640 1 -- 172.21.15.38:0/649712179 >> 172.21.15.38:0/649712179 conn(0x7f74980b1110 msgr2=0x7f74980b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.638+0000 7f749d549640 1 -- 172.21.15.38:0/649712179 shutdown_connections 2023-12-22T08:42:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.638+0000 7f749d549640 1 -- 172.21.15.38:0/649712179 wait complete. 2023-12-22T08:42:50.663 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T08:42:50.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.896+0000 7fc336b11640 1 Processor -- start 2023-12-22T08:42:50.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.896+0000 7fc336b11640 1 -- start start 2023-12-22T08:42:50.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.898+0000 7fc336b11640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc33015b0e0 0x7fc33015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:50.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.898+0000 7fc336b11640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc33009c980 0x7fc33015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:50.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.898+0000 7fc336b11640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33015edf0 con 0x7fc330071460 2023-12-22T08:42:50.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.898+0000 7fc336b11640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33015bd90 con 0x7fc33009c980 2023-12-22T08:42:50.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.898+0000 7fc336b11640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33015c070 con 0x7fc33015b0e0 2023-12-22T08:42:50.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.899+0000 7fc336310640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc330071460 0x7fc33015f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49734/0 (socket says 172.21.15.38:49734) 2023-12-22T08:42:50.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.899+0000 7fc336310640 1 -- 172.21.15.38:0/675127882 learned_addr learned my addr 172.21.15.38:0/675127882 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:50.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.899+0000 7fc33530e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc33009c980 0x7fc33015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:50.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.899+0000 7fc335b0f640 1 --2- 172.21.15.38:0/675127882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc33015b0e0 0x7fc33015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:50.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.899+0000 7fc334b0d640 1 -- 172.21.15.38:0/675127882 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155044734 0 0) 0x7fc33015edf0 con 0x7fc330071460 2023-12-22T08:42:50.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.899+0000 7fc334b0d640 1 -- 172.21.15.38:0/675127882 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc31c003520 con 0x7fc330071460 2023-12-22T08:42:50.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.899+0000 7fc33530e640 1 -- 172.21.15.38:0/675127882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc33015b0e0 msgr2=0x7fc33015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:50.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.899+0000 7fc33530e640 1 --2- 172.21.15.38:0/675127882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc33015b0e0 0x7fc33015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:50.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.899+0000 7fc33530e640 1 -- 172.21.15.38:0/675127882 >> v1:172.21.15.38:6789/0 conn(0x7fc330071460 legacy=0x7fc33015f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:50.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.899+0000 7fc33530e640 1 -- 172.21.15.38:0/675127882 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33015c350 con 0x7fc33009c980 2023-12-22T08:42:50.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.899+0000 7fc335b0f640 1 --2- 172.21.15.38:0/675127882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc33015b0e0 0x7fc33015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:42:50.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.901+0000 7fc33530e640 1 --2- 172.21.15.38:0/675127882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33009c980 0x7fc33015c9c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc3200097a0 tx=0x7fc32002b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45aacfcc8bee272 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:50.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.901+0000 7fc334b0d640 1 -- 172.21.15.38:0/675127882 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3200316f0 con 0x7fc33009c980 2023-12-22T08:42:50.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.901+0000 7fc334b0d640 1 -- 172.21.15.38:0/675127882 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320031850 con 0x7fc33009c980 2023-12-22T08:42:50.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.901+0000 7fc334b0d640 1 -- 172.21.15.38:0/675127882 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320031bc0 con 0x7fc33009c980 2023-12-22T08:42:50.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.902+0000 7fc336b11640 1 -- 172.21.15.38:0/675127882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33009c980 msgr2=0x7fc33015c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:50.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.902+0000 7fc336b11640 1 --2- 172.21.15.38:0/675127882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33009c980 0x7fc33015c9c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc3200097a0 tx=0x7fc32002b790 comp rx=0 tx=0).stop 2023-12-22T08:42:50.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.902+0000 7fc336b11640 1 -- 172.21.15.38:0/675127882 shutdown_connections 2023-12-22T08:42:50.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.902+0000 7fc336b11640 1 --2- 172.21.15.38:0/675127882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33009c980 0x7fc33015c9c0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:50.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.902+0000 7fc336b11640 1 --2- 172.21.15.38:0/675127882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc33015b0e0 0x7fc33015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:50.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.902+0000 7fc336b11640 1 -- 172.21.15.38:0/675127882 >> 172.21.15.38:0/675127882 conn(0x7fc3300cf000 msgr2=0x7fc3300cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:50.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.902+0000 7fc336b11640 1 -- 172.21.15.38:0/675127882 shutdown_connections 2023-12-22T08:42:50.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.902+0000 7fc336b11640 1 -- 172.21.15.38:0/675127882 wait complete. 2023-12-22T08:42:50.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.904+0000 7fc336b11640 1 Processor -- start 2023-12-22T08:42:50.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.904+0000 7fc336b11640 1 -- start start 2023-12-22T08:42:50.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.905+0000 7fc336b11640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc330071460 0x7fc3301563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:50.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.905+0000 7fc336b11640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33009c980 0x7fc3300a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:50.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.905+0000 7fc336b11640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc33015b0e0 0x7fc3300a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:50.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.905+0000 7fc336b11640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc330071de0 con 0x7fc33009c980 2023-12-22T08:42:50.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.905+0000 7fc336b11640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300a0070 con 0x7fc33015b0e0 2023-12-22T08:42:50.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.905+0000 7fc336b11640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300a0350 con 0x7fc330071460 2023-12-22T08:42:50.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.905+0000 7fc33530e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33009c980 0x7fc3300a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:50.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.905+0000 7fc33530e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33009c980 0x7fc3300a1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41016/0 (socket says 172.21.15.38:41016) 2023-12-22T08:42:50.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.905+0000 7fc33530e640 1 -- 172.21.15.38:0/3151175721 learned_addr learned my addr 172.21.15.38:0/3151175721 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:50.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.906+0000 7fc335b0f640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc330071460 0x7fc3301563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:50.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.906+0000 7fc336310640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc33015b0e0 0x7fc3300a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:50.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.906+0000 7fc33530e640 1 -- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc330071460 msgr2=0x7fc3301563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:50.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.906+0000 7fc33530e640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc330071460 0x7fc3301563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:50.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.906+0000 7fc33530e640 1 -- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc33015b0e0 msgr2=0x7fc3300a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:50.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.906+0000 7fc33530e640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc33015b0e0 0x7fc3300a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:50.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.906+0000 7fc33530e640 1 -- 172.21.15.38:0/3151175721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc320009400 con 0x7fc33009c980 2023-12-22T08:42:50.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.906+0000 7fc336310640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc33015b0e0 0x7fc3300a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:50.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.906+0000 7fc33530e640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33009c980 0x7fc3300a1fd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc32002b7d0 tx=0x7fc3200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:50.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.907+0000 7fc3267fc640 1 -- 172.21.15.38:0/3151175721 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3200319c0 con 0x7fc33009c980 2023-12-22T08:42:50.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.907+0000 7fc3267fc640 1 -- 172.21.15.38:0/3151175721 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320031b20 con 0x7fc33009c980 2023-12-22T08:42:50.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.907+0000 7fc3267fc640 1 -- 172.21.15.38:0/3151175721 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320031e90 con 0x7fc33009c980 2023-12-22T08:42:50.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.907+0000 7fc336b11640 1 -- 172.21.15.38:0/3151175721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3300a0630 con 0x7fc33009c980 2023-12-22T08:42:50.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.907+0000 7fc336b11640 1 -- 172.21.15.38:0/3151175721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33015b690 con 0x7fc33009c980 2023-12-22T08:42:50.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.908+0000 7fc336b11640 1 -- 172.21.15.38:0/3151175721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3300a0b50 con 0x7fc33009c980 2023-12-22T08:42:50.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.909+0000 7fc3267fc640 1 -- 172.21.15.38:0/3151175721 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc32003b070 con 0x7fc33009c980 2023-12-22T08:42:50.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.910+0000 7fc3267fc640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc31406a430 0x7fc31406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:50.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.910+0000 7fc3267fc640 1 -- 172.21.15.38:0/3151175721 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5502+0+0 (secure 0 0 0) 0x7fc3200aa1e0 con 0x7fc33009c980 2023-12-22T08:42:50.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.911+0000 7fc335b0f640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc31406a430 0x7fc31406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:50.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.912+0000 7fc335b0f640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc31406a430 0x7fc31406c8f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc3300a4370 tx=0x7fc32c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:50.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:50.914+0000 7fc3267fc640 1 -- 172.21.15.38:0/3151175721 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc3300a0b50 con 0x7fc33009c980 2023-12-22T08:42:51.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.107+0000 7fc336b11640 1 -- 172.21.15.38:0/3151175721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc3300a0b50 con 0x7fc33009c980 2023-12-22T08:42:51.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.645+0000 7fc3267fc640 1 -- 172.21.15.38:0/3151175721 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v63) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc3300a0b50 con 0x7fc33009c980 2023-12-22T08:42:51.648 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2023-12-22T08:42:51.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.649+0000 7fc336b11640 1 -- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc31406a430 msgr2=0x7fc31406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:51.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.649+0000 7fc336b11640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc31406a430 0x7fc31406c8f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc3300a4370 tx=0x7fc32c008040 comp rx=0 tx=0).stop 2023-12-22T08:42:51.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.649+0000 7fc336b11640 1 -- 172.21.15.38:0/3151175721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33009c980 msgr2=0x7fc3300a1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:51.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.649+0000 7fc336b11640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33009c980 0x7fc3300a1fd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc32002b7d0 tx=0x7fc3200046c0 comp rx=0 tx=0).stop 2023-12-22T08:42:51.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.649+0000 7fc336b11640 1 -- 172.21.15.38:0/3151175721 shutdown_connections 2023-12-22T08:42:51.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.649+0000 7fc336b11640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc33015b0e0 0x7fc3300a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:51.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.649+0000 7fc336b11640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc31406a430 0x7fc31406c8f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:51.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.649+0000 7fc336b11640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc33009c980 0x7fc3300a1fd0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:51.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.649+0000 7fc336b11640 1 --2- 172.21.15.38:0/3151175721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc330071460 0x7fc3301563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:51.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.650+0000 7fc336b11640 1 -- 172.21.15.38:0/3151175721 >> 172.21.15.38:0/3151175721 conn(0x7fc3300cf000 msgr2=0x7fc3300b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:51.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.650+0000 7fc336b11640 1 -- 172.21.15.38:0/3151175721 shutdown_connections 2023-12-22T08:42:51.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.650+0000 7fc336b11640 1 -- 172.21.15.38:0/3151175721 wait complete. 2023-12-22T08:42:51.675 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-22T08:42:51.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.898+0000 7f8f5df2e640 1 Processor -- start 2023-12-22T08:42:51.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.898+0000 7f8f5df2e640 1 -- start start 2023-12-22T08:42:51.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.900+0000 7f8f5df2e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f5815b3d0 0x7f8f580ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:51.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.900+0000 7f8f5df2e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8f5815b7b0 0x7f8f580cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:51.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.900+0000 7f8f5df2e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5806c1e0 con 0x7f8f580ce200 2023-12-22T08:42:51.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.900+0000 7f8f5df2e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f58070100 con 0x7f8f5815b7b0 2023-12-22T08:42:51.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.900+0000 7f8f5df2e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f580cd620 con 0x7f8f5815b3d0 2023-12-22T08:42:51.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.900+0000 7f8f4ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8f5815b7b0 0x7f8f580cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:51.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.900+0000 7f8f4ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8f5815b7b0 0x7f8f580cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59472/0 (socket says 172.21.15.38:59472) 2023-12-22T08:42:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.900+0000 7f8f4ffff640 1 -- 172.21.15.38:0/3657859894 learned_addr learned my addr 172.21.15.38:0/3657859894 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.900+0000 7f8f577fe640 1 --2- 172.21.15.38:0/3657859894 >> v2:172.21.15.89:3300/0 conn(0x7f8f5815b3d0 0x7f8f580ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.901+0000 7f8f4ffff640 1 -- 172.21.15.38:0/3657859894 >> v2:172.21.15.89:3300/0 conn(0x7f8f5815b3d0 msgr2=0x7f8f580ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.901+0000 7f8f4ffff640 1 --2- 172.21.15.38:0/3657859894 >> v2:172.21.15.89:3300/0 conn(0x7f8f5815b3d0 0x7f8f580ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.901+0000 7f8f4ffff640 1 -- 172.21.15.38:0/3657859894 >> v1:172.21.15.89:6789/0 conn(0x7f8f580ce200 legacy=0x7f8f5806cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:51.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.901+0000 7f8f4ffff640 1 -- 172.21.15.38:0/3657859894 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f580cd900 con 0x7f8f5815b7b0 2023-12-22T08:42:51.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.901+0000 7f8f577fe640 1 --2- 172.21.15.38:0/3657859894 >> v2:172.21.15.89:3300/0 conn(0x7f8f5815b3d0 0x7f8f580ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:42:51.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.902+0000 7f8f4ffff640 1 --2- 172.21.15.38:0/3657859894 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f5815b7b0 0x7f8f580cd010 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8f580c9500 tx=0x7f8f4002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5feccb1f66653e99 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:51.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.903+0000 7f8f56ffd640 1 -- 172.21.15.38:0/3657859894 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40004230 con 0x7f8f5815b7b0 2023-12-22T08:42:51.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.903+0000 7f8f56ffd640 1 -- 172.21.15.38:0/3657859894 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f40004390 con 0x7f8f5815b7b0 2023-12-22T08:42:51.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.903+0000 7f8f56ffd640 1 -- 172.21.15.38:0/3657859894 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40003810 con 0x7f8f5815b7b0 2023-12-22T08:42:51.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.903+0000 7f8f5df2e640 1 -- 172.21.15.38:0/3657859894 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f5815b7b0 msgr2=0x7f8f580cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:51.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.903+0000 7f8f5df2e640 1 --2- 172.21.15.38:0/3657859894 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f5815b7b0 0x7f8f580cd010 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8f580c9500 tx=0x7f8f4002b7e0 comp rx=0 tx=0).stop 2023-12-22T08:42:51.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.903+0000 7f8f5df2e640 1 -- 172.21.15.38:0/3657859894 shutdown_connections 2023-12-22T08:42:51.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.903+0000 7f8f5df2e640 1 --2- 172.21.15.38:0/3657859894 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f5815b7b0 0x7f8f580cd010 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:51.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.903+0000 7f8f5df2e640 1 --2- 172.21.15.38:0/3657859894 >> v2:172.21.15.89:3300/0 conn(0x7f8f5815b3d0 0x7f8f580ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:51.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.904+0000 7f8f5df2e640 1 -- 172.21.15.38:0/3657859894 >> 172.21.15.38:0/3657859894 conn(0x7f8f580cba10 msgr2=0x7f8f580cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:51.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.904+0000 7f8f5df2e640 1 -- 172.21.15.38:0/3657859894 shutdown_connections 2023-12-22T08:42:51.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.904+0000 7f8f5df2e640 1 -- 172.21.15.38:0/3657859894 wait complete. 2023-12-22T08:42:51.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.905+0000 7f8f5df2e640 1 Processor -- start 2023-12-22T08:42:51.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.906+0000 7f8f5df2e640 1 -- start start 2023-12-22T08:42:51.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f5df2e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f580ce200 0x7f8f58151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f5df2e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5815b3d0 0x7f8f5815d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f5df2e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f5815b7b0 0x7f8f5815de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f5df2e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f58151940 con 0x7f8f5815b7b0 2023-12-22T08:42:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f5df2e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580aeb40 con 0x7f8f5815b3d0 2023-12-22T08:42:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f5df2e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580aee20 con 0x7f8f580ce200 2023-12-22T08:42:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f57fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f5815b7b0 0x7f8f5815de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f57fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f5815b7b0 0x7f8f5815de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59480/0 (socket says 172.21.15.38:59480) 2023-12-22T08:42:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f57fff640 1 -- 172.21.15.38:0/1037973601 learned_addr learned my addr 172.21.15.38:0/1037973601 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f577fe640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f580ce200 0x7f8f58151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f4ffff640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5815b3d0 0x7f8f5815d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f57fff640 1 -- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f580ce200 msgr2=0x7f8f58151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f57fff640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f580ce200 0x7f8f58151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f57fff640 1 -- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5815b3d0 msgr2=0x7f8f5815d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f57fff640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5815b3d0 0x7f8f5815d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.907+0000 7f8f57fff640 1 -- 172.21.15.38:0/1037973601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f40009460 con 0x7f8f5815b7b0 2023-12-22T08:42:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.908+0000 7f8f57fff640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f5815b7b0 0x7f8f5815de00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000c780 tx=0x7f8f5000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.908+0000 7f8f54ff9640 1 -- 172.21.15.38:0/1037973601 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50004b60 con 0x7f8f5815b7b0 2023-12-22T08:42:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.908+0000 7f8f54ff9640 1 -- 172.21.15.38:0/1037973601 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5000ce90 con 0x7f8f5815b7b0 2023-12-22T08:42:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.908+0000 7f8f54ff9640 1 -- 172.21.15.38:0/1037973601 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5000a850 con 0x7f8f5815b7b0 2023-12-22T08:42:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.908+0000 7f8f5df2e640 1 -- 172.21.15.38:0/1037973601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f580af100 con 0x7f8f5815b7b0 2023-12-22T08:42:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.908+0000 7f8f5df2e640 1 -- 172.21.15.38:0/1037973601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f580af6c0 con 0x7f8f5815b7b0 2023-12-22T08:42:51.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.909+0000 7f8f5df2e640 1 -- 172.21.15.38:0/1037973601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f580af8b0 con 0x7f8f5815b7b0 2023-12-22T08:42:51.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.910+0000 7f8f54ff9640 1 -- 172.21.15.38:0/1037973601 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f5000a9b0 con 0x7f8f5815b7b0 2023-12-22T08:42:51.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.912+0000 7f8f54ff9640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f3806a430 0x7f8f3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:51.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.912+0000 7f8f54ff9640 1 -- 172.21.15.38:0/1037973601 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8f500888b0 con 0x7f8f5815b7b0 2023-12-22T08:42:51.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.913+0000 7f8f577fe640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f3806a430 0x7f8f3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.914+0000 7f8f577fe640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f3806a430 0x7f8f3806c8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8f48006fd0 tx=0x7f8f48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:51.917+0000 7f8f54ff9640 1 -- 172.21.15.38:0/1037973601 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8f50054100 con 0x7f8f5815b7b0 2023-12-22T08:42:52.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.111+0000 7f8f5df2e640 1 -- 172.21.15.38:0/1037973601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8f58061910 con 0x7f8f5815b7b0 2023-12-22T08:42:52.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.124+0000 7f8f54ff9640 1 -- 172.21.15.38:0/1037973601 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8f50057720 con 0x7f8f5815b7b0 2023-12-22T08:42:52.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.126+0000 7f8f5df2e640 1 -- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f3806a430 msgr2=0x7f8f3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:52.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.126+0000 7f8f5df2e640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f3806a430 0x7f8f3806c8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8f48006fd0 tx=0x7f8f48008040 comp rx=0 tx=0).stop 2023-12-22T08:42:52.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.126+0000 7f8f5df2e640 1 -- 172.21.15.38:0/1037973601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f5815b7b0 msgr2=0x7f8f5815de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:52.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.126+0000 7f8f5df2e640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f5815b7b0 0x7f8f5815de00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000c780 tx=0x7f8f5000cc40 comp rx=0 tx=0).stop 2023-12-22T08:42:52.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.126+0000 7f8f5df2e640 1 -- 172.21.15.38:0/1037973601 shutdown_connections 2023-12-22T08:42:52.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.126+0000 7f8f5df2e640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f3806a430 0x7f8f3806c8f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:52.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.126+0000 7f8f5df2e640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f5815b7b0 0x7f8f5815de00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:52.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.126+0000 7f8f5df2e640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5815b3d0 0x7f8f5815d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:52.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.126+0000 7f8f5df2e640 1 --2- 172.21.15.38:0/1037973601 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f580ce200 0x7f8f58151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:52.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.126+0000 7f8f5df2e640 1 -- 172.21.15.38:0/1037973601 >> 172.21.15.38:0/1037973601 conn(0x7f8f580cba10 msgr2=0x7f8f581599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:52.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.127+0000 7f8f5df2e640 1 -- 172.21.15.38:0/1037973601 shutdown_connections 2023-12-22T08:42:52.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.127+0000 7f8f5df2e640 1 -- 172.21.15.38:0/1037973601 wait complete. 2023-12-22T08:42:52.149 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-12-22T08:42:52.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.373+0000 7f5bc69c1640 1 Processor -- start 2023-12-22T08:42:52.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.373+0000 7f5bc69c1640 1 -- start start 2023-12-22T08:42:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.375+0000 7f5bc69c1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5bc00b3ff0 0x7f5bc006cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.375+0000 7f5bc69c1640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5bc00b44a0 0x7f5bc006d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.375+0000 7f5bc69c1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc015f220 con 0x7f5bc0157980 2023-12-22T08:42:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.375+0000 7f5bc69c1640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc00d1520 con 0x7f5bc00b44a0 2023-12-22T08:42:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.375+0000 7f5bc69c1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc00d1800 con 0x7f5bc00b3ff0 2023-12-22T08:42:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.375+0000 7f5bc61c0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5bc00b44a0 0x7f5bc006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.375+0000 7f5bc61c0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5bc00b44a0 0x7f5bc006d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59482/0 (socket says 172.21.15.38:59482) 2023-12-22T08:42:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.375+0000 7f5bc61c0640 1 -- 172.21.15.38:0/2578243725 learned_addr learned my addr 172.21.15.38:0/2578243725 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.376+0000 7f5bc51be640 1 --2- 172.21.15.38:0/2578243725 >> v2:172.21.15.89:3300/0 conn(0x7f5bc00b3ff0 0x7f5bc006cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:52.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.376+0000 7f5bc61c0640 1 -- 172.21.15.38:0/2578243725 >> v2:172.21.15.89:3300/0 conn(0x7f5bc00b3ff0 msgr2=0x7f5bc006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:52.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.376+0000 7f5bc61c0640 1 --2- 172.21.15.38:0/2578243725 >> v2:172.21.15.89:3300/0 conn(0x7f5bc00b3ff0 0x7f5bc006cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:52.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.376+0000 7f5bc61c0640 1 -- 172.21.15.38:0/2578243725 >> v1:172.21.15.89:6789/0 conn(0x7f5bc0157980 legacy=0x7f5bc015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:52.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.376+0000 7f5bc61c0640 1 -- 172.21.15.38:0/2578243725 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc00d1ae0 con 0x7f5bc00b44a0 2023-12-22T08:42:52.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.377+0000 7f5bc61c0640 1 --2- 172.21.15.38:0/2578243725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc00b44a0 0x7f5bc006d470 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00d3f10 tx=0x7f5bb802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ffa2f6fa4d49bd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:52.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.377+0000 7f5bc49bd640 1 -- 172.21.15.38:0/2578243725 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb802ca80 con 0x7f5bc00b44a0 2023-12-22T08:42:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.377+0000 7f5bc49bd640 1 -- 172.21.15.38:0/2578243725 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb802cbe0 con 0x7f5bc00b44a0 2023-12-22T08:42:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.377+0000 7f5bc49bd640 1 -- 172.21.15.38:0/2578243725 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb80343f0 con 0x7f5bc00b44a0 2023-12-22T08:42:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.378+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2578243725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc00b44a0 msgr2=0x7f5bc006d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.378+0000 7f5bc69c1640 1 --2- 172.21.15.38:0/2578243725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc00b44a0 0x7f5bc006d470 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00d3f10 tx=0x7f5bb802bee0 comp rx=0 tx=0).stop 2023-12-22T08:42:52.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.378+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2578243725 shutdown_connections 2023-12-22T08:42:52.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.378+0000 7f5bc69c1640 1 --2- 172.21.15.38:0/2578243725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc00b44a0 0x7f5bc006d470 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:52.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.378+0000 7f5bc69c1640 1 --2- 172.21.15.38:0/2578243725 >> v2:172.21.15.89:3300/0 conn(0x7f5bc00b3ff0 0x7f5bc006cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:52.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.378+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2578243725 >> 172.21.15.38:0/2578243725 conn(0x7f5bc00d31f0 msgr2=0x7f5bc00d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:52.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.378+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2578243725 shutdown_connections 2023-12-22T08:42:52.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.378+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2578243725 wait complete. 2023-12-22T08:42:52.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.380+0000 7f5bc69c1640 1 Processor -- start 2023-12-22T08:42:52.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.380+0000 7f5bc69c1640 1 -- start start 2023-12-22T08:42:52.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.381+0000 7f5bc69c1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bc00b3ff0 0x7f5bc015e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:52.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.381+0000 7f5bc69c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00b44a0 0x7f5bc0159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:52.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.381+0000 7f5bc69c1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc0157980 0x7f5bc014d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.381+0000 7f5bc69c1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00b65b0 con 0x7f5bc0157980 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.381+0000 7f5bc69c1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00b63b0 con 0x7f5bc00b44a0 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.381+0000 7f5bc69c1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc0151ef0 con 0x7f5bc00b3ff0 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.382+0000 7f5bc61c0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc0157980 0x7f5bc014d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.382+0000 7f5bc61c0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc0157980 0x7f5bc014d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59488/0 (socket says 172.21.15.38:59488) 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.382+0000 7f5bc61c0640 1 -- 172.21.15.38:0/2082832425 learned_addr learned my addr 172.21.15.38:0/2082832425 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.382+0000 7f5bc51be640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00b44a0 0x7f5bc0159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.382+0000 7f5bc59bf640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bc00b3ff0 0x7f5bc015e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.382+0000 7f5bc61c0640 1 -- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bc00b3ff0 msgr2=0x7f5bc015e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.382+0000 7f5bc61c0640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bc00b3ff0 0x7f5bc015e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.382+0000 7f5bc61c0640 1 -- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00b44a0 msgr2=0x7f5bc0159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.382+0000 7f5bc61c0640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00b44a0 0x7f5bc0159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.382+0000 7f5bc61c0640 1 -- 172.21.15.38:0/2082832425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb8009b30 con 0x7f5bc0157980 2023-12-22T08:42:52.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.382+0000 7f5bc51be640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00b44a0 0x7f5bc0159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:52.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.382+0000 7f5bc59bf640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bc00b3ff0 0x7f5bc015e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:52.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.383+0000 7f5bc61c0640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc0157980 0x7f5bc014d890 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8009f40 tx=0x7f5bb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:52.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.383+0000 7f5bb67fc640 1 -- 172.21.15.38:0/2082832425 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8009510 con 0x7f5bc0157980 2023-12-22T08:42:52.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.383+0000 7f5bb67fc640 1 -- 172.21.15.38:0/2082832425 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb803e450 con 0x7f5bc0157980 2023-12-22T08:42:52.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.383+0000 7f5bb67fc640 1 -- 172.21.15.38:0/2082832425 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb803e7e0 con 0x7f5bc0157980 2023-12-22T08:42:52.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.383+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2082832425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc01521d0 con 0x7f5bc0157980 2023-12-22T08:42:52.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.383+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2082832425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc0152560 con 0x7f5bc0157980 2023-12-22T08:42:52.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.384+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2082832425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc00b66f0 con 0x7f5bc0157980 2023-12-22T08:42:52.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.386+0000 7f5bb67fc640 1 -- 172.21.15.38:0/2082832425 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5bb802cd50 con 0x7f5bc0157980 2023-12-22T08:42:52.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.386+0000 7f5bb67fc640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5ba406a480 0x7f5ba406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:52.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.387+0000 7f5bb67fc640 1 -- 172.21.15.38:0/2082832425 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5bb80ab4a0 con 0x7f5bc0157980 2023-12-22T08:42:52.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.387+0000 7f5bc59bf640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5ba406a480 0x7f5ba406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:52.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.388+0000 7f5bc59bf640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5ba406a480 0x7f5ba406c940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc003eb0 tx=0x7f5bbc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:52.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.391+0000 7f5bb67fc640 1 -- 172.21.15.38:0/2082832425 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5bc00b66f0 con 0x7f5bc0157980 2023-12-22T08:42:52.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:52.662+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2082832425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f5bc00b66f0 con 0x7f5bc0157980 2023-12-22T08:42:53.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.655+0000 7f5bb67fc640 1 -- 172.21.15.38:0/2082832425 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v174) v1 ==== 142+0+0 (secure 0 0 0) 0x7f5bc00b66f0 con 0x7f5bc0157980 2023-12-22T08:42:53.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.659+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5ba406a480 msgr2=0x7f5ba406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:53.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.659+0000 7f5bc69c1640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5ba406a480 0x7f5ba406c940 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc003eb0 tx=0x7f5bbc009040 comp rx=0 tx=0).stop 2023-12-22T08:42:53.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.659+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2082832425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc0157980 msgr2=0x7f5bc014d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:53.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.659+0000 7f5bc69c1640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc0157980 0x7f5bc014d890 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8009f40 tx=0x7f5bb8004a40 comp rx=0 tx=0).stop 2023-12-22T08:42:53.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.659+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2082832425 shutdown_connections 2023-12-22T08:42:53.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.659+0000 7f5bc69c1640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5ba406a480 0x7f5ba406c940 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:53.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.659+0000 7f5bc69c1640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bc0157980 0x7f5bc014d890 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:53.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.659+0000 7f5bc69c1640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00b44a0 0x7f5bc0159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:53.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.659+0000 7f5bc69c1640 1 --2- 172.21.15.38:0/2082832425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bc00b3ff0 0x7f5bc015e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:53.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.659+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2082832425 >> 172.21.15.38:0/2082832425 conn(0x7f5bc00d31f0 msgr2=0x7f5bc015f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:53.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.659+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2082832425 shutdown_connections 2023-12-22T08:42:53.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.659+0000 7f5bc69c1640 1 -- 172.21.15.38:0/2082832425 wait complete. 2023-12-22T08:42:53.683 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-22T08:42:53.684 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-12-22T08:42:53.684 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:42:53.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.903+0000 7fac1b59e640 1 Processor -- start 2023-12-22T08:42:53.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.904+0000 7fac1b59e640 1 -- start start 2023-12-22T08:42:53.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.906+0000 7fac1b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac1c13ff40 0x7fac1c164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:53.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.906+0000 7fac1b59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1c0cf270 con 0x7fac1c15b330 2023-12-22T08:42:53.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.906+0000 7fac1b59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1c0cf550 con 0x7fac1c13cfc0 2023-12-22T08:42:53.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.906+0000 7fac1b59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c0cdb50 con 0x7fac1c13ff40 2023-12-22T08:42:53.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.906+0000 7fac13fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fac1c15b330 0x7fac1c13f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53874/0 (socket says 172.21.15.38:53874) 2023-12-22T08:42:53.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.906+0000 7fac13fff640 1 -- 172.21.15.38:0/2845038884 learned_addr learned my addr 172.21.15.38:0/2845038884 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:42:53.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.906+0000 7fac1ad9d640 1 --2- 172.21.15.38:0/2845038884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac1c13ff40 0x7fac1c164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:53.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.906+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018864707 0 0) 0x7fac1c0cf270 con 0x7fac1c15b330 2023-12-22T08:42:53.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac08003520 con 0x7fac1c15b330 2023-12-22T08:42:53.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1471327286 0 0) 0x7fac08003520 con 0x7fac1c15b330 2023-12-22T08:42:53.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac1c13ff40 msgr2=0x7fac1c164e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:53.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 --2- 172.21.15.38:0/2845038884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac1c13ff40 0x7fac1c164e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:53.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 >> v1:172.21.15.89:6789/0 conn(0x7fac1c13cfc0 legacy=0x7fac1c0ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:53.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c0cf830 con 0x7fac1c15b330 2023-12-22T08:42:53.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fac04001670 con 0x7fac1c15b330 2023-12-22T08:42:53.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 >> v1:172.21.15.38:6789/0 conn(0x7fac1c15b330 legacy=0x7fac1c13f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 --2- 172.21.15.38:0/2845038884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac080039a0 0x7fac08003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 --2- 172.21.15.38:0/2845038884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac1c13ff40 0x7fac080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 --2- 172.21.15.38:0/2845038884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac08004d00 0x7fac08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0800bab0 con 0x7fac08004d00 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0800bc20 con 0x7fac080039a0 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0800bde0 con 0x7fac1c13ff40 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.907+0000 7fac1ad9d640 1 --2- 172.21.15.38:0/2845038884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac08004d00 0x7fac08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.908+0000 7fac1a59c640 1 --2- 172.21.15.38:0/2845038884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac080039a0 0x7fac08003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.908+0000 7fac13fff640 1 --2- 172.21.15.38:0/2845038884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac1c13ff40 0x7fac080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.908+0000 7fac1ad9d640 1 -- 172.21.15.38:0/2845038884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac1c13ff40 msgr2=0x7fac080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.908+0000 7fac1ad9d640 1 --2- 172.21.15.38:0/2845038884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac1c13ff40 0x7fac080047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.908+0000 7fac1ad9d640 1 -- 172.21.15.38:0/2845038884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac080039a0 msgr2=0x7fac08003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.908+0000 7fac1ad9d640 1 --2- 172.21.15.38:0/2845038884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac080039a0 0x7fac08003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:53.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.908+0000 7fac1ad9d640 1 -- 172.21.15.38:0/2845038884 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08003520 con 0x7fac08004d00 2023-12-22T08:42:53.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.909+0000 7fac1ad9d640 1 --2- 172.21.15.38:0/2845038884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac08004d00 0x7fac08005180 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fac14009f90 tx=0x7fac080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e9fec78107128a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:53.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.909+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1402cbd0 con 0x7fac08004d00 2023-12-22T08:42:53.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.909+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1400f040 con 0x7fac08004d00 2023-12-22T08:42:53.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.909+0000 7fac19d9b640 1 -- 172.21.15.38:0/2845038884 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14034440 con 0x7fac08004d00 2023-12-22T08:42:53.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.910+0000 7fac1b59e640 1 -- 172.21.15.38:0/2845038884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac08004d00 msgr2=0x7fac08005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:53.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.910+0000 7fac1b59e640 1 --2- 172.21.15.38:0/2845038884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac08004d00 0x7fac08005180 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fac14009f90 tx=0x7fac080057f0 comp rx=0 tx=0).stop 2023-12-22T08:42:53.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.910+0000 7fac1ad9d640 1 -- 172.21.15.38:0/2845038884 reap_dead start 2023-12-22T08:42:53.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.910+0000 7fac1b59e640 1 -- 172.21.15.38:0/2845038884 shutdown_connections 2023-12-22T08:42:53.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.910+0000 7fac1b59e640 1 -- 172.21.15.38:0/2845038884 >> 172.21.15.38:0/2845038884 conn(0x7fac1c0b1c70 msgr2=0x7fac1c0b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:53.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.910+0000 7fac1b59e640 1 -- 172.21.15.38:0/2845038884 shutdown_connections 2023-12-22T08:42:53.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.910+0000 7fac1b59e640 1 -- 172.21.15.38:0/2845038884 wait complete. 2023-12-22T08:42:53.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.912+0000 7fac1b59e640 1 Processor -- start 2023-12-22T08:42:53.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.912+0000 7fac1b59e640 1 -- start start 2023-12-22T08:42:53.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.913+0000 7fac1b59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac08004d00 0x7fac1c0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:53.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.913+0000 7fac1b59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac1c13b990 0x7fac1c0b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:53.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.913+0000 7fac1b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac1c13bdf0 0x7fac1c0b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:53.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.913+0000 7fac1b59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c151880 con 0x7fac1c13b990 2023-12-22T08:42:53.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.913+0000 7fac1b59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c1f62e0 con 0x7fac08004d00 2023-12-22T08:42:53.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.913+0000 7fac1b59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c1f6580 con 0x7fac1c13bdf0 2023-12-22T08:42:53.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.913+0000 7fac13fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac1c13b990 0x7fac1c0b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:53.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.913+0000 7fac13fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac1c13b990 0x7fac1c0b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59502/0 (socket says 172.21.15.38:59502) 2023-12-22T08:42:53.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.914+0000 7fac13fff640 1 -- 172.21.15.38:0/1245103457 learned_addr learned my addr 172.21.15.38:0/1245103457 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:53.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.914+0000 7fac1a59c640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac08004d00 0x7fac1c0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:53.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.914+0000 7fac1ad9d640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac1c13bdf0 0x7fac1c0b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:53.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.914+0000 7fac13fff640 1 -- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac1c13bdf0 msgr2=0x7fac1c0b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:53.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.914+0000 7fac13fff640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac1c13bdf0 0x7fac1c0b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:53.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.914+0000 7fac13fff640 1 -- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac08004d00 msgr2=0x7fac1c0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:53.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.914+0000 7fac13fff640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac08004d00 0x7fac1c0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:53.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.914+0000 7fac13fff640 1 -- 172.21.15.38:0/1245103457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c1f6860 con 0x7fac1c13b990 2023-12-22T08:42:53.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.914+0000 7fac13fff640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac1c13b990 0x7fac1c0b02a0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fac0400d7f0 tx=0x7fac0400dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:53.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.915+0000 7fac12ffd640 1 -- 172.21.15.38:0/1245103457 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040074e0 con 0x7fac1c13b990 2023-12-22T08:42:53.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.915+0000 7fac12ffd640 1 -- 172.21.15.38:0/1245103457 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac04007640 con 0x7fac1c13b990 2023-12-22T08:42:53.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.915+0000 7fac12ffd640 1 -- 172.21.15.38:0/1245103457 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040049e0 con 0x7fac1c13b990 2023-12-22T08:42:53.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.915+0000 7fac1b59e640 1 -- 172.21.15.38:0/1245103457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1c1f6b40 con 0x7fac1c13b990 2023-12-22T08:42:53.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.915+0000 7fac1b59e640 1 -- 172.21.15.38:0/1245103457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1c0ace20 con 0x7fac1c13b990 2023-12-22T08:42:53.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.916+0000 7fac1b59e640 1 -- 172.21.15.38:0/1245103457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1c1f7060 con 0x7fac1c13b990 2023-12-22T08:42:53.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.917+0000 7fac12ffd640 1 -- 172.21.15.38:0/1245103457 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fac04004b40 con 0x7fac1c13b990 2023-12-22T08:42:53.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.918+0000 7fac12ffd640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fabfc06a430 0x7fabfc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:53.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.918+0000 7fac12ffd640 1 -- 172.21.15.38:0/1245103457 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fac04087ff0 con 0x7fac1c13b990 2023-12-22T08:42:53.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.918+0000 7fac1a59c640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fabfc06a430 0x7fabfc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:53.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.920+0000 7fac1a59c640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fabfc06a430 0x7fabfc06c8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fac0c007fd0 tx=0x7fac0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:53.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:53.922+0000 7fac12ffd640 1 -- 172.21.15.38:0/1245103457 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fac040bac80 con 0x7fac1c13b990 2023-12-22T08:42:54.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.116+0000 7fac1b59e640 1 -- 172.21.15.38:0/1245103457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac1c0cfae0 con 0x7fac1c13b990 2023-12-22T08:42:54.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.118+0000 7fac12ffd640 1 -- 172.21.15.38:0/1245103457 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+12470 (secure 0 0 0) 0x7fac04019070 con 0x7fac1c13b990 2023-12-22T08:42:54.120 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:54.121 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":63,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:42:51.630432+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6836/2131151279":"2023-12-23T08:42:48.600334+0000","172.21.15.89:6834/2131151279":"2023-12-23T08:42:48.600334+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:42:54.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.121+0000 7fac1b59e640 1 -- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fabfc06a430 msgr2=0x7fabfc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:54.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.121+0000 7fac1b59e640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fabfc06a430 0x7fabfc06c8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fac0c007fd0 tx=0x7fac0c009040 comp rx=0 tx=0).stop 2023-12-22T08:42:54.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.121+0000 7fac1b59e640 1 -- 172.21.15.38:0/1245103457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac1c13b990 msgr2=0x7fac1c0b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:54.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.121+0000 7fac1b59e640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac1c13b990 0x7fac1c0b02a0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fac0400d7f0 tx=0x7fac0400dcb0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.121+0000 7fac1b59e640 1 -- 172.21.15.38:0/1245103457 shutdown_connections 2023-12-22T08:42:54.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.121+0000 7fac1b59e640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac1c13bdf0 0x7fac1c0b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.121+0000 7fac1b59e640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fabfc06a430 0x7fabfc06c8f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.121+0000 7fac1b59e640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac1c13b990 0x7fac1c0b02a0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.121+0000 7fac1b59e640 1 --2- 172.21.15.38:0/1245103457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac08004d00 0x7fac1c0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.121+0000 7fac1b59e640 1 -- 172.21.15.38:0/1245103457 >> 172.21.15.38:0/1245103457 conn(0x7fac1c0b1c70 msgr2=0x7fac1c0b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:54.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.121+0000 7fac1b59e640 1 -- 172.21.15.38:0/1245103457 shutdown_connections 2023-12-22T08:42:54.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.121+0000 7fac1b59e640 1 -- 172.21.15.38:0/1245103457 wait complete. 2023-12-22T08:42:54.144 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:42:54.145 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:42:54.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.374+0000 7f558759e640 1 Processor -- start 2023-12-22T08:42:54.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.374+0000 7f558759e640 1 -- start start 2023-12-22T08:42:54.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.376+0000 7f558759e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f558815d1c0 0x7f5588070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:54.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.376+0000 7f558759e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f55880d0770 0x7f5588070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:54.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.376+0000 7f558759e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558815de50 con 0x7f558815d5a0 2023-12-22T08:42:54.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.376+0000 7f558759e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55880d0b80 con 0x7f55880d0770 2023-12-22T08:42:54.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.376+0000 7f558759e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55880d0dd0 con 0x7f558815d1c0 2023-12-22T08:42:54.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.376+0000 7f5586d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f55880d0770 0x7f5588070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:54.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.376+0000 7f5586d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f55880d0770 0x7f5588070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59516/0 (socket says 172.21.15.38:59516) 2023-12-22T08:42:54.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.376+0000 7f5586d9d640 1 -- 172.21.15.38:0/107036880 learned_addr learned my addr 172.21.15.38:0/107036880 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:54.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.376+0000 7f558659c640 1 --2- 172.21.15.38:0/107036880 >> v2:172.21.15.89:3300/0 conn(0x7f558815d1c0 0x7f5588070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:54.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.377+0000 7f5586d9d640 1 -- 172.21.15.38:0/107036880 >> v2:172.21.15.89:3300/0 conn(0x7f558815d1c0 msgr2=0x7f5588070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:54.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.377+0000 7f5586d9d640 1 --2- 172.21.15.38:0/107036880 >> v2:172.21.15.89:3300/0 conn(0x7f558815d1c0 0x7f5588070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.377+0000 7f5586d9d640 1 -- 172.21.15.38:0/107036880 >> v1:172.21.15.89:6789/0 conn(0x7f558815d5a0 legacy=0x7f55880d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:54.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.377+0000 7f5586d9d640 1 -- 172.21.15.38:0/107036880 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55880d10b0 con 0x7f55880d0770 2023-12-22T08:42:54.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.377+0000 7f558659c640 1 --2- 172.21.15.38:0/107036880 >> v2:172.21.15.89:3300/0 conn(0x7f558815d1c0 0x7f5588070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:42:54.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.378+0000 7f5586d9d640 1 --2- 172.21.15.38:0/107036880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55880d0770 0x7f5588070eb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f558804e140 tx=0x7f558002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6945f71f3be598c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:54.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.378+0000 7f558559a640 1 -- 172.21.15.38:0/107036880 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558002ca80 con 0x7f55880d0770 2023-12-22T08:42:54.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.378+0000 7f558559a640 1 -- 172.21.15.38:0/107036880 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558002cbe0 con 0x7f55880d0770 2023-12-22T08:42:54.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.378+0000 7f558559a640 1 -- 172.21.15.38:0/107036880 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55800343f0 con 0x7f55880d0770 2023-12-22T08:42:54.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.379+0000 7f558759e640 1 -- 172.21.15.38:0/107036880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55880d0770 msgr2=0x7f5588070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:54.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.379+0000 7f558759e640 1 --2- 172.21.15.38:0/107036880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55880d0770 0x7f5588070eb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f558804e140 tx=0x7f558002bee0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.379+0000 7f558759e640 1 -- 172.21.15.38:0/107036880 shutdown_connections 2023-12-22T08:42:54.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.379+0000 7f558759e640 1 --2- 172.21.15.38:0/107036880 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55880d0770 0x7f5588070eb0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.379+0000 7f558759e640 1 --2- 172.21.15.38:0/107036880 >> v2:172.21.15.89:3300/0 conn(0x7f558815d1c0 0x7f5588070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.379+0000 7f558759e640 1 -- 172.21.15.38:0/107036880 >> 172.21.15.38:0/107036880 conn(0x7f558806bf90 msgr2=0x7f558806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.379+0000 7f558759e640 1 -- 172.21.15.38:0/107036880 shutdown_connections 2023-12-22T08:42:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.379+0000 7f558759e640 1 -- 172.21.15.38:0/107036880 wait complete. 2023-12-22T08:42:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.381+0000 7f558759e640 1 Processor -- start 2023-12-22T08:42:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.381+0000 7f558759e640 1 -- start start 2023-12-22T08:42:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.382+0000 7f558759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55880d0770 0x7f55881569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.382+0000 7f558759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f558815d1c0 0x7f55881560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.382+0000 7f558759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f558815d5a0 0x7f558815ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.382+0000 7f558759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5588157590 con 0x7f558815d1c0 2023-12-22T08:42:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.382+0000 7f558759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5588156620 con 0x7f558815d5a0 2023-12-22T08:42:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.382+0000 7f558759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5588156fd0 con 0x7f55880d0770 2023-12-22T08:42:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.382+0000 7f5585d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f558815d1c0 0x7f55881560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.382+0000 7f5585d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f558815d1c0 0x7f55881560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59518/0 (socket says 172.21.15.38:59518) 2023-12-22T08:42:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.382+0000 7f5585d9b640 1 -- 172.21.15.38:0/3528525848 learned_addr learned my addr 172.21.15.38:0/3528525848 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.383+0000 7f5586d9d640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f558815d5a0 0x7f558815ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.383+0000 7f558659c640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55880d0770 0x7f55881569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.383+0000 7f5585d9b640 1 -- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55880d0770 msgr2=0x7f55881569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:54.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.383+0000 7f5585d9b640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55880d0770 0x7f55881569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.383+0000 7f5585d9b640 1 -- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f558815d5a0 msgr2=0x7f558815ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:54.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.383+0000 7f5585d9b640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f558815d5a0 0x7f558815ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.383+0000 7f5585d9b640 1 -- 172.21.15.38:0/3528525848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5580009b30 con 0x7f558815d1c0 2023-12-22T08:42:54.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.383+0000 7f5585d9b640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f558815d1c0 0x7f55881560e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f557c00b3c0 tx=0x7f557c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.383+0000 7f5576ffd640 1 -- 172.21.15.38:0/3528525848 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c011830 con 0x7f558815d1c0 2023-12-22T08:42:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.384+0000 7f5576ffd640 1 -- 172.21.15.38:0/3528525848 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c011990 con 0x7f558815d1c0 2023-12-22T08:42:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.384+0000 7f5576ffd640 1 -- 172.21.15.38:0/3528525848 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c011d80 con 0x7f558815d1c0 2023-12-22T08:42:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.384+0000 7f558759e640 1 -- 172.21.15.38:0/3528525848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55881572b0 con 0x7f558815d1c0 2023-12-22T08:42:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.384+0000 7f558759e640 1 -- 172.21.15.38:0/3528525848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55880b71d0 con 0x7f558815d1c0 2023-12-22T08:42:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.385+0000 7f558759e640 1 -- 172.21.15.38:0/3528525848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55880b6d50 con 0x7f558815d1c0 2023-12-22T08:42:54.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.386+0000 7f5576ffd640 1 -- 172.21.15.38:0/3528525848 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f557c01b460 con 0x7f558815d1c0 2023-12-22T08:42:54.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.387+0000 7f5576ffd640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f556806a430 0x7f556806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:54.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.387+0000 7f5576ffd640 1 -- 172.21.15.38:0/3528525848 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f557c0881a0 con 0x7f558815d1c0 2023-12-22T08:42:54.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.388+0000 7f558659c640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f556806a430 0x7f556806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:54.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.389+0000 7f558659c640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f556806a430 0x7f556806c8f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f558815c090 tx=0x7f5578008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:54.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.392+0000 7f5576ffd640 1 -- 172.21.15.38:0/3528525848 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f55880b6d50 con 0x7f558815d1c0 2023-12-22T08:42:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.591+0000 7f558759e640 1 -- 172.21.15.38:0/3528525848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55880b6d50 con 0x7f558815d1c0 2023-12-22T08:42:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.591+0000 7f5576ffd640 1 -- 172.21.15.38:0/3528525848 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55880b6d50 con 0x7f558815d1c0 2023-12-22T08:42:54.593 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:42:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.594+0000 7f558759e640 1 -- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f556806a430 msgr2=0x7f556806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.594+0000 7f558759e640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f556806a430 0x7f556806c8f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f558815c090 tx=0x7f5578008040 comp rx=0 tx=0).stop 2023-12-22T08:42:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.594+0000 7f558759e640 1 -- 172.21.15.38:0/3528525848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f558815d1c0 msgr2=0x7f55881560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.594+0000 7f558759e640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f558815d1c0 0x7f55881560e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f557c00b3c0 tx=0x7f557c00b880 comp rx=0 tx=0).stop 2023-12-22T08:42:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.594+0000 7f558759e640 1 -- 172.21.15.38:0/3528525848 shutdown_connections 2023-12-22T08:42:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.594+0000 7f558759e640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f558815d5a0 0x7f558815ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.594+0000 7f558759e640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f556806a430 0x7f556806c8f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.594+0000 7f558759e640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f558815d1c0 0x7f55881560e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.594+0000 7f558759e640 1 --2- 172.21.15.38:0/3528525848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55880d0770 0x7f55881569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.594+0000 7f558759e640 1 -- 172.21.15.38:0/3528525848 >> 172.21.15.38:0/3528525848 conn(0x7f558806bf90 msgr2=0x7f558806d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.594+0000 7f558759e640 1 -- 172.21.15.38:0/3528525848 shutdown_connections 2023-12-22T08:42:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.595+0000 7f558759e640 1 -- 172.21.15.38:0/3528525848 wait complete. 2023-12-22T08:42:54.615 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-12-22T08:42:54.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.829+0000 7f204a2a8640 1 Processor -- start 2023-12-22T08:42:54.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.829+0000 7f204a2a8640 1 -- start start 2023-12-22T08:42:54.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.830+0000 7f204a2a8640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2044161340 0x7f2044071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:54.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.830+0000 7f204a2a8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2044071fa0 0x7f20440adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:54.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.830+0000 7f204a2a8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20440ce950 con 0x7f2044161720 2023-12-22T08:42:54.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.830+0000 7f204a2a8640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20440cdd40 con 0x7f2044161340 2023-12-22T08:42:54.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.830+0000 7f204a2a8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20440ce020 con 0x7f2044071fa0 2023-12-22T08:42:54.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.831+0000 7f20492a6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2044161340 0x7f2044071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:54.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.831+0000 7f20492a6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2044161340 0x7f2044071a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59534/0 (socket says 172.21.15.38:59534) 2023-12-22T08:42:54.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.831+0000 7f20492a6640 1 -- 172.21.15.38:0/727210667 learned_addr learned my addr 172.21.15.38:0/727210667 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:54.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.831+0000 7f2049aa7640 1 --1- 172.21.15.38:0/727210667 >> v1:172.21.15.38:6789/0 conn(0x7f2044161720 0x7f20440ae1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:53890/0 (socket says 172.21.15.38:53890) 2023-12-22T08:42:54.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.831+0000 7f2048aa5640 1 --2- 172.21.15.38:0/727210667 >> v2:172.21.15.89:3300/0 conn(0x7f2044071fa0 0x7f20440adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:54.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.831+0000 7f20492a6640 1 -- 172.21.15.38:0/727210667 >> v2:172.21.15.89:3300/0 conn(0x7f2044071fa0 msgr2=0x7f20440adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.831+0000 7f20492a6640 1 --2- 172.21.15.38:0/727210667 >> v2:172.21.15.89:3300/0 conn(0x7f2044071fa0 0x7f20440adca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.831+0000 7f20492a6640 1 -- 172.21.15.38:0/727210667 >> v1:172.21.15.38:6789/0 conn(0x7f2044161720 legacy=0x7f20440ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.831+0000 7f20492a6640 1 -- 172.21.15.38:0/727210667 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20440ce300 con 0x7f2044161340 2023-12-22T08:42:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.833+0000 7f20492a6640 1 --2- 172.21.15.38:0/727210667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2044161340 0x7f2044071a60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f20440ce8c0 tx=0x7f204002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69f29de9c71adeb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.833+0000 7f203bfff640 1 -- 172.21.15.38:0/727210667 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20400317e0 con 0x7f2044161340 2023-12-22T08:42:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.833+0000 7f203bfff640 1 -- 172.21.15.38:0/727210667 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2040031940 con 0x7f2044161340 2023-12-22T08:42:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.833+0000 7f203bfff640 1 -- 172.21.15.38:0/727210667 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040031cd0 con 0x7f2044161340 2023-12-22T08:42:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.833+0000 7f204a2a8640 1 -- 172.21.15.38:0/727210667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2044161340 msgr2=0x7f2044071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.833+0000 7f204a2a8640 1 --2- 172.21.15.38:0/727210667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2044161340 0x7f2044071a60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f20440ce8c0 tx=0x7f204002b880 comp rx=0 tx=0).stop 2023-12-22T08:42:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.834+0000 7f204a2a8640 1 -- 172.21.15.38:0/727210667 shutdown_connections 2023-12-22T08:42:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.834+0000 7f204a2a8640 1 --2- 172.21.15.38:0/727210667 >> v2:172.21.15.89:3300/0 conn(0x7f2044071fa0 0x7f20440adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.834+0000 7f204a2a8640 1 --2- 172.21.15.38:0/727210667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2044161340 0x7f2044071a60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.834+0000 7f204a2a8640 1 -- 172.21.15.38:0/727210667 >> 172.21.15.38:0/727210667 conn(0x7f20440b1f70 msgr2=0x7f20440b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.834+0000 7f204a2a8640 1 -- 172.21.15.38:0/727210667 shutdown_connections 2023-12-22T08:42:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.834+0000 7f204a2a8640 1 -- 172.21.15.38:0/727210667 wait complete. 2023-12-22T08:42:54.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.836+0000 7f204a2a8640 1 Processor -- start 2023-12-22T08:42:54.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.836+0000 7f204a2a8640 1 -- start start 2023-12-22T08:42:54.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f204a2a8640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2044071fa0 0x7f204413bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:54.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f204a2a8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2044161340 0x7f2044158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:54.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f204a2a8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2044161720 0x7f20441f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:54.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f204a2a8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2044159770 con 0x7f2044161340 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f204a2a8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2044159490 con 0x7f2044161720 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f204a2a8640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204415aac0 con 0x7f2044071fa0 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f2048aa5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2044161340 0x7f2044158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f2048aa5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2044161340 0x7f2044158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59536/0 (socket says 172.21.15.38:59536) 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f2048aa5640 1 -- 172.21.15.38:0/1479725455 learned_addr learned my addr 172.21.15.38:0/1479725455 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f2049aa7640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2044161720 0x7f20441f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f20492a6640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2044071fa0 0x7f204413bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f2048aa5640 1 -- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2044071fa0 msgr2=0x7f204413bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f2048aa5640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2044071fa0 0x7f204413bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f2048aa5640 1 -- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2044161720 msgr2=0x7f20441f6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.837+0000 7f2048aa5640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2044161720 0x7f20441f6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.838+0000 7f2048aa5640 1 -- 172.21.15.38:0/1479725455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20400094d0 con 0x7f2044161340 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.838+0000 7f20492a6640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2044071fa0 0x7f204413bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:54.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.838+0000 7f2049aa7640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2044161720 0x7f20441f6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:54.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.838+0000 7f2048aa5640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2044161340 0x7f2044158b40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f203400c7f0 tx=0x7f203400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:54.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.838+0000 7f2039ffb640 1 -- 172.21.15.38:0/1479725455 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034004220 con 0x7f2044161340 2023-12-22T08:42:54.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.838+0000 7f2039ffb640 1 -- 172.21.15.38:0/1479725455 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20340043a0 con 0x7f2044161340 2023-12-22T08:42:54.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.838+0000 7f204a2a8640 1 -- 172.21.15.38:0/1479725455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204415ada0 con 0x7f2044161340 2023-12-22T08:42:54.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.838+0000 7f2039ffb640 1 -- 172.21.15.38:0/1479725455 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034007860 con 0x7f2044161340 2023-12-22T08:42:54.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.838+0000 7f204a2a8640 1 -- 172.21.15.38:0/1479725455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2044159080 con 0x7f2044161340 2023-12-22T08:42:54.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.840+0000 7f204a2a8640 1 -- 172.21.15.38:0/1479725455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204415b2c0 con 0x7f2044161340 2023-12-22T08:42:54.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.840+0000 7f2039ffb640 1 -- 172.21.15.38:0/1479725455 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2034007bd0 con 0x7f2044161340 2023-12-22T08:42:54.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.841+0000 7f2039ffb640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f202806a430 0x7f202806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:54.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.841+0000 7f2039ffb640 1 -- 172.21.15.38:0/1479725455 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2034088600 con 0x7f2044161340 2023-12-22T08:42:54.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.842+0000 7f20492a6640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f202806a430 0x7f202806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:54.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.843+0000 7f20492a6640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f202806a430 0x7f202806c8f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2040036000 tx=0x7f204003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:54.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:54.845+0000 7f2039ffb640 1 -- 172.21.15.38:0/1479725455 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f204415b2c0 con 0x7f2044161340 2023-12-22T08:42:55.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.107+0000 7f204a2a8640 1 -- 172.21.15.38:0/1479725455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f204415b2c0 con 0x7f2044161340 2023-12-22T08:42:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.675+0000 7f2039ffb640 1 -- 172.21.15.38:0/1479725455 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v176) v1 ==== 137+0+0 (secure 0 0 0) 0x7f204415b2c0 con 0x7f2044161340 2023-12-22T08:42:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.678+0000 7f204a2a8640 1 -- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f202806a430 msgr2=0x7f202806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.678+0000 7f204a2a8640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f202806a430 0x7f202806c8f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2040036000 tx=0x7f204003d040 comp rx=0 tx=0).stop 2023-12-22T08:42:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.678+0000 7f204a2a8640 1 -- 172.21.15.38:0/1479725455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2044161340 msgr2=0x7f2044158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.678+0000 7f204a2a8640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2044161340 0x7f2044158b40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f203400c7f0 tx=0x7f203400ccb0 comp rx=0 tx=0).stop 2023-12-22T08:42:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.679+0000 7f204a2a8640 1 -- 172.21.15.38:0/1479725455 shutdown_connections 2023-12-22T08:42:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.679+0000 7f204a2a8640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2044161720 0x7f20441f6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.679+0000 7f204a2a8640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f202806a430 0x7f202806c8f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.679+0000 7f204a2a8640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2044161340 0x7f2044158b40 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.679+0000 7f204a2a8640 1 --2- 172.21.15.38:0/1479725455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2044071fa0 0x7f204413bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.679+0000 7f204a2a8640 1 -- 172.21.15.38:0/1479725455 >> 172.21.15.38:0/1479725455 conn(0x7f20440b1f70 msgr2=0x7f204415d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.679+0000 7f204a2a8640 1 -- 172.21.15.38:0/1479725455 shutdown_connections 2023-12-22T08:42:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:55.679+0000 7f204a2a8640 1 -- 172.21.15.38:0/1479725455 wait complete. 2023-12-22T08:42:55.701 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-22T08:42:55.941 INFO:teuthology.orchestra.run.smithi038.stdout:{"osd_objectstore":"memstore"} 2023-12-22T08:42:55.941 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-22T08:42:55.941 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T08:42:56.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.175+0000 7f083745f640 1 Processor -- start 2023-12-22T08:42:56.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.175+0000 7f083745f640 1 -- start start 2023-12-22T08:42:56.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.176+0000 7f083745f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083015e320 0x7f0830161e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:56.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.176+0000 7f083745f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f083015e700 0x7f083006ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:56.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.177+0000 7f083745f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083006b630 con 0x7f083006d800 2023-12-22T08:42:56.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.177+0000 7f083745f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0830161380 con 0x7f083015e700 2023-12-22T08:42:56.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.177+0000 7f083745f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0830161660 con 0x7f083015e320 2023-12-22T08:42:56.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.177+0000 7f08349fa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f083015e700 0x7f083006ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:56.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.177+0000 7f08351fb640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083015e320 0x7f0830161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:56.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.177+0000 7f08349fa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f083015e700 0x7f083006ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:51576/0 (socket says 172.21.15.38:51576) 2023-12-22T08:42:56.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.177+0000 7f08349fa640 1 -- 172.21.15.38:0/971433381 learned_addr learned my addr 172.21.15.38:0/971433381 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:56.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.178+0000 7f08349fa640 1 -- 172.21.15.38:0/971433381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083015e320 msgr2=0x7f0830161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:56.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.178+0000 7f08349fa640 1 --2- 172.21.15.38:0/971433381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083015e320 0x7f0830161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:56.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.178+0000 7f08349fa640 1 -- 172.21.15.38:0/971433381 >> v1:172.21.15.89:6789/0 conn(0x7f083006d800 legacy=0x7f08300cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:56.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.178+0000 7f08349fa640 1 -- 172.21.15.38:0/971433381 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0830161940 con 0x7f083015e700 2023-12-22T08:42:56.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.178+0000 7f08351fb640 1 --2- 172.21.15.38:0/971433381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083015e320 0x7f0830161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:42:56.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.180+0000 7f08349fa640 1 --2- 172.21.15.38:0/971433381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083015e700 0x7f083006ad50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0824009870 tx=0x7f082402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98c7a6fb542b5f75 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:56.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.180+0000 7f082ffff640 1 -- 172.21.15.38:0/971433381 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0824030840 con 0x7f083015e700 2023-12-22T08:42:56.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.181+0000 7f082ffff640 1 -- 172.21.15.38:0/971433381 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08240309a0 con 0x7f083015e700 2023-12-22T08:42:56.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.181+0000 7f082ffff640 1 -- 172.21.15.38:0/971433381 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0824030d30 con 0x7f083015e700 2023-12-22T08:42:56.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.181+0000 7f083745f640 1 -- 172.21.15.38:0/971433381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083015e700 msgr2=0x7f083006ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:56.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.181+0000 7f083745f640 1 --2- 172.21.15.38:0/971433381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083015e700 0x7f083006ad50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0824009870 tx=0x7f082402b980 comp rx=0 tx=0).stop 2023-12-22T08:42:56.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.182+0000 7f083745f640 1 -- 172.21.15.38:0/971433381 shutdown_connections 2023-12-22T08:42:56.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.182+0000 7f083745f640 1 --2- 172.21.15.38:0/971433381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083015e700 0x7f083006ad50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:56.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.182+0000 7f083745f640 1 --2- 172.21.15.38:0/971433381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083015e320 0x7f0830161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:56.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.182+0000 7f083745f640 1 -- 172.21.15.38:0/971433381 >> 172.21.15.38:0/971433381 conn(0x7f083006c5e0 msgr2=0x7f083006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:56.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.182+0000 7f083745f640 1 -- 172.21.15.38:0/971433381 shutdown_connections 2023-12-22T08:42:56.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.182+0000 7f083745f640 1 -- 172.21.15.38:0/971433381 wait complete. 2023-12-22T08:42:56.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.184+0000 7f083745f640 1 Processor -- start 2023-12-22T08:42:56.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.184+0000 7f083745f640 1 -- start start 2023-12-22T08:42:56.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.185+0000 7f083745f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083006d800 0x7f08301568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:56.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.185+0000 7f083745f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083015e320 0x7f0830154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:56.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.185+0000 7f083745f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083015e700 0x7f083015fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:56.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.185+0000 7f083745f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0830155840 con 0x7f083015e320 2023-12-22T08:42:56.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.185+0000 7f083745f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0830155b20 con 0x7f083015e700 2023-12-22T08:42:56.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.185+0000 7f083745f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0830155e00 con 0x7f083006d800 2023-12-22T08:42:56.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.186+0000 7f08349fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083015e320 0x7f0830154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:56.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.186+0000 7f08349fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083015e320 0x7f0830154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59544/0 (socket says 172.21.15.38:59544) 2023-12-22T08:42:56.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.186+0000 7f08349fa640 1 -- 172.21.15.38:0/2296937565 learned_addr learned my addr 172.21.15.38:0/2296937565 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:56.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.186+0000 7f08351fb640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083006d800 0x7f08301568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:56.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.186+0000 7f08359fc640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083015e700 0x7f083015fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:56.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.186+0000 7f08349fa640 1 -- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083006d800 msgr2=0x7f08301568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:56.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.186+0000 7f08349fa640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083006d800 0x7f08301568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:56.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.186+0000 7f08349fa640 1 -- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083015e700 msgr2=0x7f083015fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:56.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.186+0000 7f08349fa640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083015e700 0x7f083015fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:56.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.186+0000 7f08349fa640 1 -- 172.21.15.38:0/2296937565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0820009a70 con 0x7f083015e320 2023-12-22T08:42:56.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.187+0000 7f08349fa640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083015e320 0x7f0830154d80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0824009870 tx=0x7f0824004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:56.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.187+0000 7f082dffb640 1 -- 172.21.15.38:0/2296937565 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0824039a90 con 0x7f083015e320 2023-12-22T08:42:56.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.187+0000 7f082dffb640 1 -- 172.21.15.38:0/2296937565 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0824039bf0 con 0x7f083015e320 2023-12-22T08:42:56.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.187+0000 7f082dffb640 1 -- 172.21.15.38:0/2296937565 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08240433f0 con 0x7f083015e320 2023-12-22T08:42:56.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.187+0000 7f083745f640 1 -- 172.21.15.38:0/2296937565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08240094d0 con 0x7f083015e320 2023-12-22T08:42:56.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.187+0000 7f083745f640 1 -- 172.21.15.38:0/2296937565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08301563c0 con 0x7f083015e320 2023-12-22T08:42:56.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.188+0000 7f083745f640 1 -- 172.21.15.38:0/2296937565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08300b0b40 con 0x7f083015e320 2023-12-22T08:42:56.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.189+0000 7f082dffb640 1 -- 172.21.15.38:0/2296937565 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0824042390 con 0x7f083015e320 2023-12-22T08:42:56.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.190+0000 7f082dffb640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f081c06a430 0x7f081c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:56.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.190+0000 7f082dffb640 1 -- 172.21.15.38:0/2296937565 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f08240aa860 con 0x7f083015e320 2023-12-22T08:42:56.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.191+0000 7f08351fb640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f081c06a430 0x7f081c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:56.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.192+0000 7f08351fb640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f081c06a430 0x7f081c06c8f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f083015b740 tx=0x7f082000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:56.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.195+0000 7f082dffb640 1 -- 172.21.15.38:0/2296937565 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0824076030 con 0x7f083015e320 2023-12-22T08:42:56.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.389+0000 7f083745f640 1 -- 172.21.15.38:0/2296937565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0830061910 con 0x7f083015e320 2023-12-22T08:42:56.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.397+0000 7f082dffb640 1 -- 172.21.15.38:0/2296937565 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0824079650 con 0x7f083015e320 2023-12-22T08:42:56.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.400+0000 7f083745f640 1 -- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f081c06a430 msgr2=0x7f081c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.400+0000 7f083745f640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f081c06a430 0x7f081c06c8f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f083015b740 tx=0x7f082000b040 comp rx=0 tx=0).stop 2023-12-22T08:42:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.400+0000 7f083745f640 1 -- 172.21.15.38:0/2296937565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083015e320 msgr2=0x7f0830154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.400+0000 7f083745f640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083015e320 0x7f0830154d80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0824009870 tx=0x7f0824004730 comp rx=0 tx=0).stop 2023-12-22T08:42:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.400+0000 7f083745f640 1 -- 172.21.15.38:0/2296937565 shutdown_connections 2023-12-22T08:42:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.400+0000 7f083745f640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083015e700 0x7f083015fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.400+0000 7f083745f640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f081c06a430 0x7f081c06c8f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.400+0000 7f083745f640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083015e320 0x7f0830154d80 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.400+0000 7f083745f640 1 --2- 172.21.15.38:0/2296937565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083006d800 0x7f08301568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.400+0000 7f083745f640 1 -- 172.21.15.38:0/2296937565 >> 172.21.15.38:0/2296937565 conn(0x7f083006c5e0 msgr2=0x7f083006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.400+0000 7f083745f640 1 -- 172.21.15.38:0/2296937565 shutdown_connections 2023-12-22T08:42:56.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:56.400+0000 7f083745f640 1 -- 172.21.15.38:0/2296937565 wait complete. 2023-12-22T08:42:56.420 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:42:56.421 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:42:56.536 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:42:56.652 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:42:56.652 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:42:56.652 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:56.716 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:42:56.716 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:42:56.716 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:56.777 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:42:56.778 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:42:56.778 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:56.842 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:42:56.842 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:42:56.842 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:42:56.902 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:42:56.902 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-22T08:42:56.902 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:42:57.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.137+0000 7f58968e5640 1 Processor -- start 2023-12-22T08:42:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.137+0000 7f58968e5640 1 -- start start 2023-12-22T08:42:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.139+0000 7f58968e5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5890161720 0x7f58900adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.139+0000 7f58968e5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58900ce950 con 0x7f58900ae1e0 2023-12-22T08:42:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.139+0000 7f58968e5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5890072170 con 0x7f5890161340 2023-12-22T08:42:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.139+0000 7f58968e5640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58900cdd40 con 0x7f5890161720 2023-12-22T08:42:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.139+0000 7f58950e2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5890161720 0x7f58900adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.139+0000 7f58950e2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5890161720 0x7f58900adca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59556/0 (socket says 172.21.15.38:59556) 2023-12-22T08:42:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.140+0000 7f58950e2640 1 -- 172.21.15.38:0/1080423684 learned_addr learned my addr 172.21.15.38:0/1080423684 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.140+0000 7f58950e2640 1 -- 172.21.15.38:0/1080423684 >> v1:172.21.15.89:6789/0 conn(0x7f5890161340 legacy=0x7f5890071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.140+0000 7f58950e2640 1 -- 172.21.15.38:0/1080423684 >> v1:172.21.15.38:6789/0 conn(0x7f58900ae1e0 legacy=0x7f589006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.140+0000 7f58950e2640 1 -- 172.21.15.38:0/1080423684 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58900ce020 con 0x7f5890161720 2023-12-22T08:42:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.140+0000 7f58948e1640 1 -- 172.21.15.38:0/1080423684 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308033001 0 0) 0x7f58900ce950 con 0x7f58900ae1e0 2023-12-22T08:42:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.141+0000 7f58950e2640 1 --2- 172.21.15.38:0/1080423684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890161720 0x7f58900adca0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f58800098a0 tx=0x7f588002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ff2bbfad26f554 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.142+0000 7f58948e1640 1 -- 172.21.15.38:0/1080423684 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880030840 con 0x7f5890161720 2023-12-22T08:42:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.142+0000 7f58948e1640 1 -- 172.21.15.38:0/1080423684 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58800309a0 con 0x7f5890161720 2023-12-22T08:42:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.142+0000 7f58948e1640 1 -- 172.21.15.38:0/1080423684 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880030d30 con 0x7f5890161720 2023-12-22T08:42:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.142+0000 7f58968e5640 1 -- 172.21.15.38:0/1080423684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890161720 msgr2=0x7f58900adca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.142+0000 7f58968e5640 1 --2- 172.21.15.38:0/1080423684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890161720 0x7f58900adca0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f58800098a0 tx=0x7f588002b980 comp rx=0 tx=0).stop 2023-12-22T08:42:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.142+0000 7f58968e5640 1 -- 172.21.15.38:0/1080423684 shutdown_connections 2023-12-22T08:42:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.142+0000 7f58968e5640 1 --2- 172.21.15.38:0/1080423684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890161720 0x7f58900adca0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.142+0000 7f58968e5640 1 -- 172.21.15.38:0/1080423684 >> 172.21.15.38:0/1080423684 conn(0x7f58900b1f70 msgr2=0x7f58900b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.143+0000 7f58968e5640 1 -- 172.21.15.38:0/1080423684 shutdown_connections 2023-12-22T08:42:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.143+0000 7f58968e5640 1 -- 172.21.15.38:0/1080423684 wait complete. 2023-12-22T08:42:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.144+0000 7f58968e5640 1 Processor -- start 2023-12-22T08:42:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.145+0000 7f58968e5640 1 -- start start 2023-12-22T08:42:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.146+0000 7f58968e5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58900ae1e0 0x7f5890144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.146+0000 7f58968e5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5890161340 0x7f589015d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.146+0000 7f58968e5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5890161720 0x7f5890147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.146+0000 7f58968e5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589009f970 con 0x7f58900ae1e0 2023-12-22T08:42:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.146+0000 7f58968e5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589015e730 con 0x7f5890161340 2023-12-22T08:42:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.146+0000 7f58968e5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589015db20 con 0x7f5890161720 2023-12-22T08:42:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.146+0000 7f58958e3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58900ae1e0 0x7f5890144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.146+0000 7f58958e3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58900ae1e0 0x7f5890144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59570/0 (socket says 172.21.15.38:59570) 2023-12-22T08:42:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.146+0000 7f58958e3640 1 -- 172.21.15.38:0/644055138 learned_addr learned my addr 172.21.15.38:0/644055138 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:42:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.146+0000 7f58950e2640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5890161340 0x7f589015d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.146+0000 7f58960e4640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5890161720 0x7f5890147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.147+0000 7f58958e3640 1 -- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5890161720 msgr2=0x7f5890147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.147+0000 7f58958e3640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5890161720 0x7f5890147310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.147+0000 7f58958e3640 1 -- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5890161340 msgr2=0x7f589015d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.147+0000 7f58958e3640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5890161340 0x7f589015d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.147+0000 7f58958e3640 1 -- 172.21.15.38:0/644055138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800094d0 con 0x7f58900ae1e0 2023-12-22T08:42:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.147+0000 7f58950e2640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5890161340 0x7f589015d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.147+0000 7f58958e3640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58900ae1e0 0x7f5890144bd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f588c00c480 tx=0x7f588c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.147+0000 7f58867fc640 1 -- 172.21.15.38:0/644055138 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c0052d0 con 0x7f58900ae1e0 2023-12-22T08:42:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.147+0000 7f58867fc640 1 -- 172.21.15.38:0/644055138 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c005430 con 0x7f58900ae1e0 2023-12-22T08:42:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.147+0000 7f58867fc640 1 -- 172.21.15.38:0/644055138 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c012870 con 0x7f58900ae1e0 2023-12-22T08:42:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.147+0000 7f58968e5640 1 -- 172.21.15.38:0/644055138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589015de00 con 0x7f58900ae1e0 2023-12-22T08:42:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.147+0000 7f58968e5640 1 -- 172.21.15.38:0/644055138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589015e3c0 con 0x7f58900ae1e0 2023-12-22T08:42:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.149+0000 7f58968e5640 1 -- 172.21.15.38:0/644055138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5890061910 con 0x7f58900ae1e0 2023-12-22T08:42:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.149+0000 7f58867fc640 1 -- 172.21.15.38:0/644055138 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f588c0129d0 con 0x7f58900ae1e0 2023-12-22T08:42:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.150+0000 7f58867fc640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f587406a430 0x7f587406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.151+0000 7f58867fc640 1 -- 172.21.15.38:0/644055138 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f588c0881c0 con 0x7f58900ae1e0 2023-12-22T08:42:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.151+0000 7f58950e2640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f587406a430 0x7f587406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:57.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.152+0000 7f58950e2640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f587406a430 0x7f587406c8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5880036000 tx=0x7f588003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:57.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.155+0000 7f58867fc640 1 -- 172.21.15.38:0/644055138 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f588c053aa0 con 0x7f58900ae1e0 2023-12-22T08:42:57.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.387+0000 7f58968e5640 1 -- 172.21.15.38:0/644055138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58900a0130 con 0x7f58900ae1e0 2023-12-22T08:42:57.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.388+0000 7f58867fc640 1 -- 172.21.15.38:0/644055138 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f588c0570c0 con 0x7f58900ae1e0 2023-12-22T08:42:57.390 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:42:57.390 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2078860804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2078860804},{"type":"v1","addr":"172.21.15.38:6835","nonce":2078860804}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4244510882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4244510882},{"type":"v1","addr":"172.21.15.89:6837","nonce":4244510882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3227878158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3227878158},{"type":"v1","addr":"172.21.15.38:6834","nonce":3227878158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5365,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/43985019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":43985019},{"type":"v1","addr":"172.21.15.89:6836","nonce":43985019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2023-12-22T08:42:57.391 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 25 2023-12-22T08:42:57.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.390+0000 7f58968e5640 1 -- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f587406a430 msgr2=0x7f587406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:57.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.390+0000 7f58968e5640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f587406a430 0x7f587406c8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5880036000 tx=0x7f588003b040 comp rx=0 tx=0).stop 2023-12-22T08:42:57.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.391+0000 7f58968e5640 1 -- 172.21.15.38:0/644055138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58900ae1e0 msgr2=0x7f5890144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:57.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.391+0000 7f58968e5640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58900ae1e0 0x7f5890144bd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f588c00c480 tx=0x7f588c00c940 comp rx=0 tx=0).stop 2023-12-22T08:42:57.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.391+0000 7f58968e5640 1 -- 172.21.15.38:0/644055138 shutdown_connections 2023-12-22T08:42:57.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.391+0000 7f58968e5640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5890161720 0x7f5890147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:57.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.391+0000 7f58968e5640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5890161340 0x7f589015d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:57.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.391+0000 7f58968e5640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f587406a430 0x7f587406c8f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:57.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.391+0000 7f58968e5640 1 --2- 172.21.15.38:0/644055138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58900ae1e0 0x7f5890144bd0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:57.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.391+0000 7f58968e5640 1 -- 172.21.15.38:0/644055138 >> 172.21.15.38:0/644055138 conn(0x7f58900b1f70 msgr2=0x7f58900afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:57.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.391+0000 7f58968e5640 1 -- 172.21.15.38:0/644055138 shutdown_connections 2023-12-22T08:42:57.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:42:57.391+0000 7f58968e5640 1 -- 172.21.15.38:0/644055138 wait complete. 2023-12-22T08:42:57.415 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T08:42:57.415 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T08:42:57.415 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T08:42:57.415 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:57.416 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T08:42:57.417 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T08:42:57.417 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T08:42:57.417 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:57.418 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T08:42:57.418 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T08:42:57.418 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T08:42:57.418 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:57.418 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T08:42:57.419 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T08:42:57.420 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T08:42:57.420 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:57.438 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T08:42:57.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T08:42:57.440 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T08:42:57.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T08:42:57.444 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T08:42:57.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T08:42:57.489 INFO:tasks.ceph.mds.c:Started 2023-12-22T08:42:57.490 DEBUG:teuthology.parallel:result is None 2023-12-22T08:42:57.493 INFO:tasks.ceph.mds.b:Started 2023-12-22T08:42:57.493 DEBUG:teuthology.parallel:result is None 2023-12-22T08:42:57.500 INFO:tasks.ceph.mds.d:Started 2023-12-22T08:42:57.500 DEBUG:teuthology.parallel:result is None 2023-12-22T08:42:57.654 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-22T08:42:57.654 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-12-22T08:42:57.695 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:42:58.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-12-22T08:43:03.438 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T08:43:03.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T08:43:03.448 INFO:tasks.ceph.mds.a:Started 2023-12-22T08:43:03.449 DEBUG:teuthology.parallel:result is None 2023-12-22T08:43:03.449 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-22T08:43:03.617 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:43:03.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.642+0000 7f1eaca41640 1 Processor -- start 2023-12-22T08:43:03.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.642+0000 7f1eaca41640 1 -- start start 2023-12-22T08:43:03.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.643+0000 7f1eaca41640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1ea815d470 0x7f1ea80b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:03.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1eaca41640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea815d850 0x7f1ea80ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:03.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1eaca41640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ea8071ea0 0x7f1ea80b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:03.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1eaca41640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea80ac8e0 con 0x7f1ea815d470 2023-12-22T08:43:03.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1eaca41640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea80b4550 con 0x7f1ea8071ea0 2023-12-22T08:43:03.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1eaca41640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80b4940 con 0x7f1ea815d850 2023-12-22T08:43:03.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1ea659c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1ea815d470 0x7f1ea80b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:03.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1ea659c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1ea815d470 0x7f1ea80b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36368/0 (socket says 172.21.15.38:36368) 2023-12-22T08:43:03.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1ea659c640 1 -- 172.21.15.38:0/3387588751 learned_addr learned my addr 172.21.15.38:0/3387588751 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:03.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1ea659c640 1 -- 172.21.15.38:0/3387588751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea815d850 msgr2=0x7f1ea80ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:03.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1ea659c640 1 --2- 172.21.15.38:0/3387588751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea815d850 0x7f1ea80ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:03.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1ea6d9d640 1 --2- 172.21.15.38:0/3387588751 >> v2:172.21.15.89:3300/0 conn(0x7f1ea8071ea0 0x7f1ea80b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:03.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1ea659c640 1 -- 172.21.15.38:0/3387588751 >> v2:172.21.15.89:3300/0 conn(0x7f1ea8071ea0 msgr2=0x7f1ea80b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:03.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1ea659c640 1 --2- 172.21.15.38:0/3387588751 >> v2:172.21.15.89:3300/0 conn(0x7f1ea8071ea0 0x7f1ea80b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:03.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.644+0000 7f1ea659c640 1 -- 172.21.15.38:0/3387588751 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea80b4c20 con 0x7f1ea815d470 2023-12-22T08:43:03.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.646+0000 7f1ea659c640 1 --2- 172.21.15.38:0/3387588751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea815d470 0x7f1ea80b4010 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1ea806e7f0 tx=0x7f1e9802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cee91b0319f5f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:03.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.646+0000 7f1ea5d9b640 1 -- 172.21.15.38:0/3387588751 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98031860 con 0x7f1ea815d470 2023-12-22T08:43:03.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.646+0000 7f1ea5d9b640 1 -- 172.21.15.38:0/3387588751 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e980319c0 con 0x7f1ea815d470 2023-12-22T08:43:03.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.646+0000 7f1ea5d9b640 1 -- 172.21.15.38:0/3387588751 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98031d50 con 0x7f1ea815d470 2023-12-22T08:43:03.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.646+0000 7f1eaca41640 1 -- 172.21.15.38:0/3387588751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea815d470 msgr2=0x7f1ea80b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:03.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.646+0000 7f1eaca41640 1 --2- 172.21.15.38:0/3387588751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea815d470 0x7f1ea80b4010 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1ea806e7f0 tx=0x7f1e9802b900 comp rx=0 tx=0).stop 2023-12-22T08:43:03.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.647+0000 7f1eaca41640 1 -- 172.21.15.38:0/3387588751 shutdown_connections 2023-12-22T08:43:03.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.647+0000 7f1eaca41640 1 --2- 172.21.15.38:0/3387588751 >> v2:172.21.15.89:3300/0 conn(0x7f1ea8071ea0 0x7f1ea80b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:03.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.647+0000 7f1eaca41640 1 --2- 172.21.15.38:0/3387588751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea815d850 0x7f1ea80ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:03.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.647+0000 7f1eaca41640 1 --2- 172.21.15.38:0/3387588751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea815d470 0x7f1ea80b4010 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:03.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.647+0000 7f1eaca41640 1 -- 172.21.15.38:0/3387588751 >> 172.21.15.38:0/3387588751 conn(0x7f1ea80cf070 msgr2=0x7f1ea80cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:03.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.647+0000 7f1eaca41640 1 -- 172.21.15.38:0/3387588751 shutdown_connections 2023-12-22T08:43:03.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.647+0000 7f1eaca41640 1 -- 172.21.15.38:0/3387588751 wait complete. 2023-12-22T08:43:03.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.648+0000 7f1eaca41640 1 Processor -- start 2023-12-22T08:43:03.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.648+0000 7f1eaca41640 1 -- start start 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.649+0000 7f1eaca41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea8071ea0 0x7f1ea81500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.649+0000 7f1eaca41640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea815d470 0x7f1ea80cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.649+0000 7f1eaca41640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea815d850 0x7f1ea80cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.649+0000 7f1eaca41640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80cd6e0 con 0x7f1ea815d470 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.649+0000 7f1eaca41640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea8159050 con 0x7f1ea8071ea0 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.649+0000 7f1eaca41640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea80cd400 con 0x7f1ea815d850 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.650+0000 7f1e9ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea815d470 0x7f1ea80cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.650+0000 7f1e9ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea815d470 0x7f1ea80cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36382/0 (socket says 172.21.15.38:36382) 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.650+0000 7f1e9ffff640 1 -- 172.21.15.38:0/2855176915 learned_addr learned my addr 172.21.15.38:0/2855176915 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.650+0000 7f1ea659c640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea8071ea0 0x7f1ea81500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.650+0000 7f1ea6d9d640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea815d850 0x7f1ea80cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.650+0000 7f1e9ffff640 1 -- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea815d850 msgr2=0x7f1ea80cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.650+0000 7f1e9ffff640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea815d850 0x7f1ea80cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:03.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.650+0000 7f1e9ffff640 1 -- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea8071ea0 msgr2=0x7f1ea81500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:03.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.650+0000 7f1e9ffff640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea8071ea0 0x7f1ea81500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:03.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.650+0000 7f1e9ffff640 1 -- 172.21.15.38:0/2855176915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e980094d0 con 0x7f1ea815d470 2023-12-22T08:43:03.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.650+0000 7f1ea659c640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea8071ea0 0x7f1ea81500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:03.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.651+0000 7f1e9ffff640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea815d470 0x7f1ea80cb620 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000b4a0 tx=0x7f1e9000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:03.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.651+0000 7f1e9effd640 1 -- 172.21.15.38:0/2855176915 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90010610 con 0x7f1ea815d470 2023-12-22T08:43:03.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.651+0000 7f1e9effd640 1 -- 172.21.15.38:0/2855176915 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e90010770 con 0x7f1ea815d470 2023-12-22T08:43:03.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.651+0000 7f1e9effd640 1 -- 172.21.15.38:0/2855176915 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90010b20 con 0x7f1ea815d470 2023-12-22T08:43:03.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.651+0000 7f1eaca41640 1 -- 172.21.15.38:0/2855176915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea81592d0 con 0x7f1ea815d470 2023-12-22T08:43:03.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.651+0000 7f1eaca41640 1 -- 172.21.15.38:0/2855176915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea8159890 con 0x7f1ea815d470 2023-12-22T08:43:03.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.652+0000 7f1eaca41640 1 -- 172.21.15.38:0/2855176915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea8159ab0 con 0x7f1ea815d470 2023-12-22T08:43:03.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.653+0000 7f1e9effd640 1 -- 172.21.15.38:0/2855176915 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1e90010c80 con 0x7f1ea815d470 2023-12-22T08:43:03.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.654+0000 7f1e9effd640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8806a430 0x7f1e8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:03.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.654+0000 7f1e9effd640 1 -- 172.21.15.38:0/2855176915 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1e90088340 con 0x7f1ea815d470 2023-12-22T08:43:03.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.655+0000 7f1ea659c640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8806a430 0x7f1e8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:03.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.656+0000 7f1ea659c640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8806a430 0x7f1e8806c8f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1e98036000 tx=0x7f1e9803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:03.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.659+0000 7f1e9effd640 1 -- 172.21.15.38:0/2855176915 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1e90053b90 con 0x7f1ea815d470 2023-12-22T08:43:03.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:03.866+0000 7f1eaca41640 1 -- 172.21.15.38:0/2855176915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1ea80b3010 con 0x7f1ea815d470 2023-12-22T08:43:04.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.643+0000 7f1e9effd640 1 -- 172.21.15.38:0/2855176915 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v68) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1e900571b0 con 0x7f1ea815d470 2023-12-22T08:43:04.646 INFO:teuthology.orchestra.run.smithi038.stderr: removed all blocklist entries 2023-12-22T08:43:04.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.647+0000 7f1eaca41640 1 -- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8806a430 msgr2=0x7f1e8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:04.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.647+0000 7f1eaca41640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8806a430 0x7f1e8806c8f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1e98036000 tx=0x7f1e9803c040 comp rx=0 tx=0).stop 2023-12-22T08:43:04.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.647+0000 7f1eaca41640 1 -- 172.21.15.38:0/2855176915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea815d470 msgr2=0x7f1ea80cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:04.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.647+0000 7f1eaca41640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea815d470 0x7f1ea80cb620 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000b4a0 tx=0x7f1e9000b960 comp rx=0 tx=0).stop 2023-12-22T08:43:04.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.647+0000 7f1eaca41640 1 -- 172.21.15.38:0/2855176915 shutdown_connections 2023-12-22T08:43:04.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.647+0000 7f1eaca41640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea815d850 0x7f1ea80cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:04.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.647+0000 7f1eaca41640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8806a430 0x7f1e8806c8f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:04.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.647+0000 7f1eaca41640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea815d470 0x7f1ea80cb620 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:04.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.647+0000 7f1eaca41640 1 --2- 172.21.15.38:0/2855176915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea8071ea0 0x7f1ea81500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:04.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.647+0000 7f1eaca41640 1 -- 172.21.15.38:0/2855176915 >> 172.21.15.38:0/2855176915 conn(0x7f1ea80cf070 msgr2=0x7f1ea8161140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:04.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.647+0000 7f1eaca41640 1 -- 172.21.15.38:0/2855176915 shutdown_connections 2023-12-22T08:43:04.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.647+0000 7f1eaca41640 1 -- 172.21.15.38:0/2855176915 wait complete. 2023-12-22T08:43:04.669 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T08:43:04.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.892+0000 7f236b8d4640 1 Processor -- start 2023-12-22T08:43:04.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.892+0000 7f236b8d4640 1 -- start start 2023-12-22T08:43:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.894+0000 7f236b8d4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f236415d470 0x7f23640b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.894+0000 7f236b8d4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f236415d850 0x7f23640ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.894+0000 7f236b8d4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23640ac8e0 con 0x7f2364071ea0 2023-12-22T08:43:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.894+0000 7f236b8d4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23640b4550 con 0x7f236415d850 2023-12-22T08:43:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.894+0000 7f236b8d4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23640b4940 con 0x7f236415d470 2023-12-22T08:43:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.894+0000 7f2369e71640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2364071ea0 0x7f23640b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42446/0 (socket says 172.21.15.38:42446) 2023-12-22T08:43:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.895+0000 7f2369e71640 1 -- 172.21.15.38:0/3253047539 learned_addr learned my addr 172.21.15.38:0/3253047539 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:43:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.895+0000 7f2368e6f640 1 --2- 172.21.15.38:0/3253047539 >> v2:172.21.15.89:3300/0 conn(0x7f236415d850 0x7f23640ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.895+0000 7f2369670640 1 --2- 172.21.15.38:0/3253047539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f236415d470 0x7f23640b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.895+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78356943 0 0) 0x7f23640ac8e0 con 0x7f2364071ea0 2023-12-22T08:43:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.895+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2350003520 con 0x7f2364071ea0 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.895+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 934746898 0 0) 0x7f2350003520 con 0x7f2364071ea0 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.895+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f236415d470 msgr2=0x7f23640b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.895+0000 7f235bfff640 1 --2- 172.21.15.38:0/3253047539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f236415d470 0x7f23640b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.895+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 >> v2:172.21.15.89:3300/0 conn(0x7f236415d850 msgr2=0x7f23640ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.895+0000 7f235bfff640 1 --2- 172.21.15.38:0/3253047539 >> v2:172.21.15.89:3300/0 conn(0x7f236415d850 0x7f23640ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.895+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640b4c20 con 0x7f2364071ea0 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.895+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f235c0019f0 con 0x7f2364071ea0 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.895+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 >> v1:172.21.15.38:6789/0 conn(0x7f2364071ea0 legacy=0x7f23640b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.896+0000 7f235bfff640 1 --2- 172.21.15.38:0/3253047539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2350003970 0x7f2350003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.896+0000 7f235bfff640 1 --2- 172.21.15.38:0/3253047539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f236415d470 0x7f23500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.896+0000 7f235bfff640 1 --2- 172.21.15.38:0/3253047539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2350004d00 0x7f2350005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.896+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23640b4550 con 0x7f2350003970 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.896+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23640b4940 con 0x7f2350004d00 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.896+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235000b980 con 0x7f236415d470 2023-12-22T08:43:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.896+0000 7f2369670640 1 --2- 172.21.15.38:0/3253047539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2350003970 0x7f2350003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:04.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.896+0000 7f2369670640 1 -- 172.21.15.38:0/3253047539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f236415d470 msgr2=0x7f23500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:04.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.896+0000 7f2369670640 1 --2- 172.21.15.38:0/3253047539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f236415d470 0x7f23500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:04.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.896+0000 7f2369670640 1 -- 172.21.15.38:0/3253047539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2350004d00 msgr2=0x7f2350005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:04.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.896+0000 7f2369670640 1 --2- 172.21.15.38:0/3253047539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2350004d00 0x7f2350005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:04.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.896+0000 7f2369670640 1 -- 172.21.15.38:0/3253047539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2350003520 con 0x7f2350003970 2023-12-22T08:43:04.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.898+0000 7f2369670640 1 --2- 172.21.15.38:0/3253047539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2350003970 0x7f2350003d90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2360009ac0 tx=0x7f23500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84171f3403e5bac server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:04.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.898+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236002c710 con 0x7f2350003970 2023-12-22T08:43:04.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.898+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236002c870 con 0x7f2350003970 2023-12-22T08:43:04.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.898+0000 7f235bfff640 1 -- 172.21.15.38:0/3253047539 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236002cc00 con 0x7f2350003970 2023-12-22T08:43:04.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.898+0000 7f236b8d4640 1 -- 172.21.15.38:0/3253047539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2350003970 msgr2=0x7f2350003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:04.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.898+0000 7f236b8d4640 1 --2- 172.21.15.38:0/3253047539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2350003970 0x7f2350003d90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2360009ac0 tx=0x7f23500057f0 comp rx=0 tx=0).stop 2023-12-22T08:43:04.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.898+0000 7f2369e71640 1 -- 172.21.15.38:0/3253047539 reap_dead start 2023-12-22T08:43:04.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.898+0000 7f236b8d4640 1 -- 172.21.15.38:0/3253047539 shutdown_connections 2023-12-22T08:43:04.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.898+0000 7f236b8d4640 1 -- 172.21.15.38:0/3253047539 >> 172.21.15.38:0/3253047539 conn(0x7f23640cf070 msgr2=0x7f23640cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:04.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.899+0000 7f236b8d4640 1 -- 172.21.15.38:0/3253047539 shutdown_connections 2023-12-22T08:43:04.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.899+0000 7f236b8d4640 1 -- 172.21.15.38:0/3253047539 wait complete. 2023-12-22T08:43:04.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.900+0000 7f236b8d4640 1 Processor -- start 2023-12-22T08:43:04.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.900+0000 7f236b8d4640 1 -- start start 2023-12-22T08:43:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.901+0000 7f236b8d4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2350003970 0x7f236415fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.901+0000 7f236b8d4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f236414d400 0x7f236414cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.901+0000 7f236b8d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f236414dd50 0x7f236414e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.901+0000 7f236b8d4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23641513c0 con 0x7f236414dd50 2023-12-22T08:43:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.901+0000 7f236b8d4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23641604f0 con 0x7f236414d400 2023-12-22T08:43:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.901+0000 7f236b8d4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23641607d0 con 0x7f2350003970 2023-12-22T08:43:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.902+0000 7f2369e71640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f236414dd50 0x7f236414e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.902+0000 7f2369e71640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f236414dd50 0x7f236414e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36386/0 (socket says 172.21.15.38:36386) 2023-12-22T08:43:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.902+0000 7f2369e71640 1 -- 172.21.15.38:0/1095638371 learned_addr learned my addr 172.21.15.38:0/1095638371 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.902+0000 7f2368e6f640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f236414d400 0x7f236414cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.902+0000 7f2369670640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2350003970 0x7f236415fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.902+0000 7f2369e71640 1 -- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2350003970 msgr2=0x7f236415fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.902+0000 7f2369e71640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2350003970 0x7f236415fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.902+0000 7f2369e71640 1 -- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f236414d400 msgr2=0x7f236414cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.902+0000 7f2369e71640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f236414d400 0x7f236414cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.902+0000 7f2369e71640 1 -- 172.21.15.38:0/1095638371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2364160ab0 con 0x7f236414dd50 2023-12-22T08:43:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.902+0000 7f2368e6f640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f236414d400 0x7f236414cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.902+0000 7f2369e71640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f236414dd50 0x7f236414e200 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f23640cb360 tx=0x7f235c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.903+0000 7f2359ffb640 1 -- 172.21.15.38:0/1095638371 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00a610 con 0x7f236414dd50 2023-12-22T08:43:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.903+0000 7f2359ffb640 1 -- 172.21.15.38:0/1095638371 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c00a770 con 0x7f236414dd50 2023-12-22T08:43:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.903+0000 7f2359ffb640 1 -- 172.21.15.38:0/1095638371 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00aae0 con 0x7f236414dd50 2023-12-22T08:43:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.903+0000 7f236b8d4640 1 -- 172.21.15.38:0/1095638371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2364150fe0 con 0x7f236414dd50 2023-12-22T08:43:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.903+0000 7f236b8d4640 1 -- 172.21.15.38:0/1095638371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236414d040 con 0x7f236414dd50 2023-12-22T08:43:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.904+0000 7f236b8d4640 1 -- 172.21.15.38:0/1095638371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2364151500 con 0x7f236414dd50 2023-12-22T08:43:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.905+0000 7f2359ffb640 1 -- 172.21.15.38:0/1095638371 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f235c00ac40 con 0x7f236414dd50 2023-12-22T08:43:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.906+0000 7f2359ffb640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f234806a430 0x7f234806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.906+0000 7f2359ffb640 1 -- 172.21.15.38:0/1095638371 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f235c087be0 con 0x7f236414dd50 2023-12-22T08:43:04.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.907+0000 7f2369670640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f234806a430 0x7f234806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:04.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.908+0000 7f2369670640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f234806a430 0x7f234806c8f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2360036000 tx=0x7f2360030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:04.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:04.910+0000 7f2359ffb640 1 -- 172.21.15.38:0/1095638371 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2364151500 con 0x7f236414dd50 2023-12-22T08:43:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.176+0000 7f236b8d4640 1 -- 172.21.15.38:0/1095638371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2364151500 con 0x7f236414dd50 2023-12-22T08:43:05.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.177+0000 7f2359ffb640 1 -- 172.21.15.38:0/1095638371 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2364151500 con 0x7f236414dd50 2023-12-22T08:43:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:05.180 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:43:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_dump": [ 2023-12-22T08:43:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.a", 2023-12-22T08:43:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl57dkCBAAeliJIPc49iRBk2mp8WYv8A==", 2023-12-22T08:43:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:43:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:43:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:43:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.b", 2023-12-22T08:43:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl0C0+KhAAkCsjfyn19nOz1xTyhZkbPQ==", 2023-12-22T08:43:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:43:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:43:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:43:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.c", 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl7poXGhAA+ZSohyj4dAOs6B5dZKTLAg==", 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.d", 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4VlTBuoOhAArKX4AiOQRGawIyAnInIhCg==", 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:43:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.0", 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VlnVQaChAAxfWmPqwo5D4qBYkAP/6dHQ==", 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.1", 2023-12-22T08:43:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4Vll2dlGxAAbqx4rxnz4FWIKl9OGqcwtw==", 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.2", 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VljQ3HLRAAfyrtqD4n6Da8Rl/6UKmv7g==", 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.3", 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBCS4VlOat4AxAAIkAGRvGGWrrwx/ppMbexWQ==", 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.4", 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlwg7TDxAA+L504F+Hw/6FTJ63cV3ZXg==", 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.5", 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx8zgHxAALBDm/sSYqw/fn4nLNQbu4A==", 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.6", 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx5OdLxAAaMP09nYI3HKiuhPARgnCOw==", 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.7", 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBHS4Vl/15bBBAA4maatkcgA0axcZY/L9r/IA==", 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.0", 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlgDspDhAA0TWGbk4AbuOhCNotPej29A==", 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow r", 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.1", 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlwSk/JhAAM3faae43p4/gw9BmyxLpJA==", 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.2", 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VliOHMGhAARaM8FC/0maNMToLGhBR4Tg==", 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.3", 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlV/MVMRAAyN1643IAOTLOLuz4DqMZ8A==", 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.admin", 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA2S4VlBhogNhAACBsSGP7kmhCSn+XAKkvgKQ==", 2023-12-22T08:43:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.x", 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlTHG+NhAAUNkVtrDuoK2OEsy1HHkt2A==", 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:43:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.y", 2023-12-22T08:43:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlED5ALBAAComDf9woKBt/IXcez+Udmg==", 2023-12-22T08:43:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:43:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:43:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:43:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:43:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:43:05.192 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:43:05.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.180+0000 7f236b8d4640 1 -- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f234806a430 msgr2=0x7f234806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:05.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.180+0000 7f236b8d4640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f234806a430 0x7f234806c8f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2360036000 tx=0x7f2360030000 comp rx=0 tx=0).stop 2023-12-22T08:43:05.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.180+0000 7f236b8d4640 1 -- 172.21.15.38:0/1095638371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f236414dd50 msgr2=0x7f236414e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:05.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.180+0000 7f236b8d4640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f236414dd50 0x7f236414e200 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f23640cb360 tx=0x7f235c00ccd0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.180+0000 7f236b8d4640 1 -- 172.21.15.38:0/1095638371 shutdown_connections 2023-12-22T08:43:05.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.180+0000 7f236b8d4640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f234806a430 0x7f234806c8f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.180+0000 7f236b8d4640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f236414dd50 0x7f236414e200 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.180+0000 7f236b8d4640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f236414d400 0x7f236414cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.180+0000 7f236b8d4640 1 --2- 172.21.15.38:0/1095638371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2350003970 0x7f236415fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.180+0000 7f236b8d4640 1 -- 172.21.15.38:0/1095638371 >> 172.21.15.38:0/1095638371 conn(0x7f23640cf070 msgr2=0x7f236406d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:05.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.180+0000 7f236b8d4640 1 -- 172.21.15.38:0/1095638371 shutdown_connections 2023-12-22T08:43:05.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.180+0000 7f236b8d4640 1 -- 172.21.15.38:0/1095638371 wait complete. 2023-12-22T08:43:05.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:43:05.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-12-22T08:43:05.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.426+0000 7f01a5371640 1 Processor -- start 2023-12-22T08:43:05.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.426+0000 7f01a5371640 1 -- start start 2023-12-22T08:43:05.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.428+0000 7f01a5371640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a0071000 0x7f01a0165f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.428+0000 7f01a5371640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a00cdae0 con 0x7f01a015b420 2023-12-22T08:43:05.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.428+0000 7f01a5371640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a015b800 con 0x7f01a00a44a0 2023-12-22T08:43:05.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.428+0000 7f01a5371640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00cdd30 con 0x7f01a0071000 2023-12-22T08:43:05.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.428+0000 7f019ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f01a015b420 0x7f01a006d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42448/0 (socket says 172.21.15.38:42448) 2023-12-22T08:43:05.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.428+0000 7f019ffff640 1 -- 172.21.15.38:0/2974564940 learned_addr learned my addr 172.21.15.38:0/2974564940 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:43:05.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.429+0000 7f01a4b70640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a0071000 0x7f01a0165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.429+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763565936 0 0) 0x7f01a00cdae0 con 0x7f01a015b420 2023-12-22T08:43:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.429+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0188003520 con 0x7f01a015b420 2023-12-22T08:43:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.429+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3537458463 0 0) 0x7f0188003520 con 0x7f01a015b420 2023-12-22T08:43:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.429+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a0071000 msgr2=0x7f01a0165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.429+0000 7f019effd640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a0071000 0x7f01a0165f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.429+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 >> v1:172.21.15.89:6789/0 conn(0x7f01a00a44a0 legacy=0x7f01a00708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.429+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a00ce010 con 0x7f01a015b420 2023-12-22T08:43:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.429+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f0190001670 con 0x7f01a015b420 2023-12-22T08:43:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.429+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 >> v1:172.21.15.38:6789/0 conn(0x7f01a015b420 legacy=0x7f01a006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.429+0000 7f019effd640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01880039a0 0x7f0188003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f019effd640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0188004350 0x7f0188004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f019effd640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a0071000 0x7f0188005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00cdd30 con 0x7f0188004350 2023-12-22T08:43:05.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018800fdc0 con 0x7f01880039a0 2023-12-22T08:43:05.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018800ff80 con 0x7f01a0071000 2023-12-22T08:43:05.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f019f7fe640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0188004350 0x7f0188004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f019ffff640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01880039a0 0x7f0188003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f01a4b70640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a0071000 0x7f0188005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f019f7fe640 1 -- 172.21.15.38:0/2974564940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a0071000 msgr2=0x7f0188005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:05.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f019f7fe640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a0071000 0x7f0188005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f019f7fe640 1 -- 172.21.15.38:0/2974564940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01880039a0 msgr2=0x7f0188003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:05.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f019f7fe640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01880039a0 0x7f0188003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f019f7fe640 1 -- 172.21.15.38:0/2974564940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0188003520 con 0x7f0188004350 2023-12-22T08:43:05.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f019ffff640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01880039a0 0x7f0188003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:05.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.430+0000 7f01a4b70640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a0071000 0x7f0188005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:05.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.431+0000 7f019f7fe640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0188004350 0x7f0188004820 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f01a00b1f40 tx=0x7f01880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b435a4758ab0cc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:05.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.432+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194032600 con 0x7f0188004350 2023-12-22T08:43:05.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.432+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019402e050 con 0x7f0188004350 2023-12-22T08:43:05.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.432+0000 7f019effd640 1 -- 172.21.15.38:0/2974564940 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940329c0 con 0x7f0188004350 2023-12-22T08:43:05.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.432+0000 7f01a5371640 1 -- 172.21.15.38:0/2974564940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0188004350 msgr2=0x7f0188004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:05.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.432+0000 7f01a5371640 1 --2- 172.21.15.38:0/2974564940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0188004350 0x7f0188004820 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f01a00b1f40 tx=0x7f01880057f0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.432+0000 7f01a4b70640 1 -- 172.21.15.38:0/2974564940 reap_dead start 2023-12-22T08:43:05.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.432+0000 7f01a5371640 1 -- 172.21.15.38:0/2974564940 shutdown_connections 2023-12-22T08:43:05.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.432+0000 7f01a5371640 1 -- 172.21.15.38:0/2974564940 >> 172.21.15.38:0/2974564940 conn(0x7f01a00b1f70 msgr2=0x7f01a00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:05.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.433+0000 7f01a5371640 1 -- 172.21.15.38:0/2974564940 shutdown_connections 2023-12-22T08:43:05.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.433+0000 7f01a5371640 1 -- 172.21.15.38:0/2974564940 wait complete. 2023-12-22T08:43:05.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.434+0000 7f01a5371640 1 Processor -- start 2023-12-22T08:43:05.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.435+0000 7f01a5371640 1 -- start start 2023-12-22T08:43:05.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.435+0000 7f01a5371640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0188004350 0x7f01a0151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.435+0000 7f01a5371640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a014dbb0 0x7f01a014f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.435+0000 7f01a5371640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a015cf40 0x7f01a015d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.435+0000 7f01a5371640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a015d930 con 0x7f01a014dbb0 2023-12-22T08:43:05.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.435+0000 7f01a5371640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a014e600 con 0x7f0188004350 2023-12-22T08:43:05.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.435+0000 7f01a5371640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a0150b50 con 0x7f01a015cf40 2023-12-22T08:43:05.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.436+0000 7f019f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a014dbb0 0x7f01a014f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.436+0000 7f019f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a014dbb0 0x7f01a014f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36394/0 (socket says 172.21.15.38:36394) 2023-12-22T08:43:05.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.436+0000 7f019f7fe640 1 -- 172.21.15.38:0/1841519270 learned_addr learned my addr 172.21.15.38:0/1841519270 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.436+0000 7f019ffff640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0188004350 0x7f01a0151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.436+0000 7f01a4b70640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a015cf40 0x7f01a015d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.436+0000 7f019f7fe640 1 -- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a015cf40 msgr2=0x7f01a015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.436+0000 7f019f7fe640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a015cf40 0x7f01a015d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.436+0000 7f019f7fe640 1 -- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0188004350 msgr2=0x7f01a0151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.436+0000 7f019f7fe640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0188004350 0x7f01a0151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.436+0000 7f019f7fe640 1 -- 172.21.15.38:0/1841519270 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a0150e30 con 0x7f01a014dbb0 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.436+0000 7f019ffff640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0188004350 0x7f01a0151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.437+0000 7f019f7fe640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a014dbb0 0x7f01a014f630 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0194001920 tx=0x7f0194001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.437+0000 7f019cff9640 1 -- 172.21.15.38:0/1841519270 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940035f0 con 0x7f01a014dbb0 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.437+0000 7f019cff9640 1 -- 172.21.15.38:0/1841519270 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0194003750 con 0x7f01a014dbb0 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.437+0000 7f019cff9640 1 -- 172.21.15.38:0/1841519270 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194003ae0 con 0x7f01a014dbb0 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.437+0000 7f01a5371640 1 -- 172.21.15.38:0/1841519270 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a0151110 con 0x7f01a014dbb0 2023-12-22T08:43:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.437+0000 7f01a5371640 1 -- 172.21.15.38:0/1841519270 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a01516d0 con 0x7f01a014dbb0 2023-12-22T08:43:05.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.438+0000 7f01a5371640 1 -- 172.21.15.38:0/1841519270 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a0151860 con 0x7f01a014dbb0 2023-12-22T08:43:05.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.439+0000 7f019cff9640 1 -- 172.21.15.38:0/1841519270 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0194003c40 con 0x7f01a014dbb0 2023-12-22T08:43:05.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.440+0000 7f019cff9640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f018c06a460 0x7f018c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.440+0000 7f019cff9640 1 -- 172.21.15.38:0/1841519270 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f01940aa6d0 con 0x7f01a014dbb0 2023-12-22T08:43:05.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.441+0000 7f019ffff640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f018c06a460 0x7f018c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.442+0000 7f019ffff640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f018c06a460 0x7f018c06c920 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f01a015e2f0 tx=0x7f0190009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:05.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.445+0000 7f019cff9640 1 -- 172.21.15.38:0/1841519270 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0194076000 con 0x7f01a014dbb0 2023-12-22T08:43:05.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.638+0000 7f01a5371640 1 -- 172.21.15.38:0/1841519270 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01a00ce2c0 con 0x7f01a014dbb0 2023-12-22T08:43:05.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.640+0000 7f019cff9640 1 -- 172.21.15.38:0/1841519270 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+12341 (secure 0 0 0) 0x7f0194079620 con 0x7f01a014dbb0 2023-12-22T08:43:05.642 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:05.642 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":68,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:43:04.634727+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:43:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.643+0000 7f01a5371640 1 -- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f018c06a460 msgr2=0x7f018c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.643+0000 7f01a5371640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f018c06a460 0x7f018c06c920 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f01a015e2f0 tx=0x7f0190009040 comp rx=0 tx=0).stop 2023-12-22T08:43:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.643+0000 7f01a5371640 1 -- 172.21.15.38:0/1841519270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a014dbb0 msgr2=0x7f01a014f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.643+0000 7f01a5371640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a014dbb0 0x7f01a014f630 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0194001920 tx=0x7f0194001230 comp rx=0 tx=0).stop 2023-12-22T08:43:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.643+0000 7f01a5371640 1 -- 172.21.15.38:0/1841519270 shutdown_connections 2023-12-22T08:43:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.643+0000 7f01a5371640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a015cf40 0x7f01a015d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.643+0000 7f01a5371640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f018c06a460 0x7f018c06c920 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.643+0000 7f01a5371640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a014dbb0 0x7f01a014f630 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.643+0000 7f01a5371640 1 --2- 172.21.15.38:0/1841519270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0188004350 0x7f01a0151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.643+0000 7f01a5371640 1 -- 172.21.15.38:0/1841519270 >> 172.21.15.38:0/1841519270 conn(0x7f01a00b1f70 msgr2=0x7f01a006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.643+0000 7f01a5371640 1 -- 172.21.15.38:0/1841519270 shutdown_connections 2023-12-22T08:43:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.643+0000 7f01a5371640 1 -- 172.21.15.38:0/1841519270 wait complete. 2023-12-22T08:43:05.664 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:43:05.665 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:43:05.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.898+0000 7ff08c1b9640 1 Processor -- start 2023-12-22T08:43:05.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.899+0000 7ff08c1b9640 1 -- start start 2023-12-22T08:43:05.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.900+0000 7ff08c1b9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0840cea50 0x7ff0840ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.900+0000 7ff08c1b9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff084140f70 con 0x7ff084143600 2023-12-22T08:43:05.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.901+0000 7ff08c1b9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08406c300 con 0x7ff08406d590 2023-12-22T08:43:05.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.901+0000 7ff08c1b9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0840cf410 con 0x7ff0840cea50 2023-12-22T08:43:05.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.901+0000 7ff089f55640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff084143600 0x7ff08415e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42464/0 (socket says 172.21.15.38:42464) 2023-12-22T08:43:05.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.901+0000 7ff089f55640 1 -- 172.21.15.38:0/313445598 learned_addr learned my addr 172.21.15.38:0/313445598 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:43:05.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.901+0000 7ff089754640 1 --2- 172.21.15.38:0/313445598 >> v2:172.21.15.89:3300/0 conn(0x7ff0840cea50 0x7ff0840ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.901+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329295099 0 0) 0x7ff084140f70 con 0x7ff084143600 2023-12-22T08:43:05.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.901+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff070003520 con 0x7ff084143600 2023-12-22T08:43:05.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1862265457 0 0) 0x7ff070003520 con 0x7ff084143600 2023-12-22T08:43:05.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 >> v2:172.21.15.89:3300/0 conn(0x7ff0840cea50 msgr2=0x7ff0840ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:05.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff088f53640 1 --2- 172.21.15.38:0/313445598 >> v2:172.21.15.89:3300/0 conn(0x7ff0840cea50 0x7ff0840ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 >> v1:172.21.15.89:6789/0 conn(0x7ff08406d590 legacy=0x7ff08406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08406c5e0 con 0x7ff084143600 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7ff080001670 con 0x7ff084143600 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 >> v1:172.21.15.38:6789/0 conn(0x7ff084143600 legacy=0x7ff08415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff088f53640 1 --2- 172.21.15.38:0/313445598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff070003970 0x7ff070003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff088f53640 1 --2- 172.21.15.38:0/313445598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0700047c0 0x7ff070004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff088f53640 1 --2- 172.21.15.38:0/313445598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff070005180 0x7ff07000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0840cf410 con 0x7ff070005180 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07000c020 con 0x7ff070003970 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07000c1e0 con 0x7ff0700047c0 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.902+0000 7ff08a756640 1 --2- 172.21.15.38:0/313445598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff070005180 0x7ff07000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.903+0000 7ff089f55640 1 --2- 172.21.15.38:0/313445598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff070003970 0x7ff070003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.903+0000 7ff089754640 1 --2- 172.21.15.38:0/313445598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0700047c0 0x7ff070004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.903+0000 7ff08a756640 1 -- 172.21.15.38:0/313445598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0700047c0 msgr2=0x7ff070004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:05.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.903+0000 7ff08a756640 1 --2- 172.21.15.38:0/313445598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0700047c0 0x7ff070004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.903+0000 7ff08a756640 1 -- 172.21.15.38:0/313445598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff070003970 msgr2=0x7ff070003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:05.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.903+0000 7ff08a756640 1 --2- 172.21.15.38:0/313445598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff070003970 0x7ff070003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.903+0000 7ff08a756640 1 -- 172.21.15.38:0/313445598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070003520 con 0x7ff070005180 2023-12-22T08:43:05.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.904+0000 7ff08a756640 1 -- 172.21.15.38:0/313445598 reap_dead start 2023-12-22T08:43:05.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.904+0000 7ff08a756640 1 --2- 172.21.15.38:0/313445598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff070005180 0x7ff07000b980 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff07c001e50 tx=0x7ff0700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d48d86cbde0680 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:05.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.904+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c003b70 con 0x7ff070005180 2023-12-22T08:43:05.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.904+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c003d10 con 0x7ff070005180 2023-12-22T08:43:05.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.904+0000 7ff088f53640 1 -- 172.21.15.38:0/313445598 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c005310 con 0x7ff070005180 2023-12-22T08:43:05.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.905+0000 7ff08c1b9640 1 -- 172.21.15.38:0/313445598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff070005180 msgr2=0x7ff07000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:05.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.905+0000 7ff08c1b9640 1 --2- 172.21.15.38:0/313445598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff070005180 0x7ff07000b980 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff07c001e50 tx=0x7ff0700057f0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.905+0000 7ff08c1b9640 1 -- 172.21.15.38:0/313445598 shutdown_connections 2023-12-22T08:43:05.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.905+0000 7ff08c1b9640 1 --2- 172.21.15.38:0/313445598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff070005180 0x7ff07000b980 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.905+0000 7ff08c1b9640 1 -- 172.21.15.38:0/313445598 >> 172.21.15.38:0/313445598 conn(0x7ff0840cfe70 msgr2=0x7ff0840d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:05.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.905+0000 7ff08c1b9640 1 -- 172.21.15.38:0/313445598 shutdown_connections 2023-12-22T08:43:05.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.905+0000 7ff08c1b9640 1 -- 172.21.15.38:0/313445598 wait complete. 2023-12-22T08:43:05.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.907+0000 7ff08c1b9640 1 Processor -- start 2023-12-22T08:43:05.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.907+0000 7ff08c1b9640 1 -- start start 2023-12-22T08:43:05.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.908+0000 7ff08c1b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff070005180 0x7ff0840a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.908+0000 7ff08c1b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0841574f0 0x7ff08415f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.908+0000 7ff08c1b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff08415fce0 0x7ff084070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.908+0000 7ff08c1b9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff084160160 con 0x7ff08415fce0 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.908+0000 7ff08c1b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0840a0d20 con 0x7ff070005180 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.908+0000 7ff08c1b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff084154fd0 con 0x7ff0841574f0 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.909+0000 7ff08a756640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff08415fce0 0x7ff084070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.909+0000 7ff08a756640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff08415fce0 0x7ff084070b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36410/0 (socket says 172.21.15.38:36410) 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.909+0000 7ff08a756640 1 -- 172.21.15.38:0/621435074 learned_addr learned my addr 172.21.15.38:0/621435074 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.909+0000 7ff089f55640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff070005180 0x7ff0840a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.909+0000 7ff089754640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0841574f0 0x7ff08415f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.909+0000 7ff08a756640 1 -- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0841574f0 msgr2=0x7ff08415f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.909+0000 7ff08a756640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0841574f0 0x7ff08415f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.909+0000 7ff08a756640 1 -- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff070005180 msgr2=0x7ff0840a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.909+0000 7ff08a756640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff070005180 0x7ff0840a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:05.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.909+0000 7ff08a756640 1 -- 172.21.15.38:0/621435074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff084157970 con 0x7ff08415fce0 2023-12-22T08:43:05.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.910+0000 7ff08a756640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff08415fce0 0x7ff084070b40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff07c001f40 tx=0x7ff07c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:05.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.910+0000 7ff07a7fc640 1 -- 172.21.15.38:0/621435074 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c006d60 con 0x7ff08415fce0 2023-12-22T08:43:05.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.910+0000 7ff07a7fc640 1 -- 172.21.15.38:0/621435074 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c039480 con 0x7ff08415fce0 2023-12-22T08:43:05.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.910+0000 7ff07a7fc640 1 -- 172.21.15.38:0/621435074 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c0397f0 con 0x7ff08415fce0 2023-12-22T08:43:05.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.910+0000 7ff08c1b9640 1 -- 172.21.15.38:0/621435074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0840a0760 con 0x7ff08415fce0 2023-12-22T08:43:05.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.910+0000 7ff08c1b9640 1 -- 172.21.15.38:0/621435074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff084154c60 con 0x7ff08415fce0 2023-12-22T08:43:05.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.911+0000 7ff08c1b9640 1 -- 172.21.15.38:0/621435074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff084061910 con 0x7ff08415fce0 2023-12-22T08:43:05.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.912+0000 7ff07a7fc640 1 -- 172.21.15.38:0/621435074 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff07c039950 con 0x7ff08415fce0 2023-12-22T08:43:05.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.913+0000 7ff07a7fc640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff06806a460 0x7ff06806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:05.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.913+0000 7ff07a7fc640 1 -- 172.21.15.38:0/621435074 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff07c0aa6c0 con 0x7ff08415fce0 2023-12-22T08:43:05.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.914+0000 7ff089f55640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff06806a460 0x7ff06806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:05.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.915+0000 7ff089f55640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff06806a460 0x7ff06806c920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff080001050 tx=0x7ff080009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:05.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:05.918+0000 7ff07a7fc640 1 -- 172.21.15.38:0/621435074 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff07c0760a0 con 0x7ff08415fce0 2023-12-22T08:43:06.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.109+0000 7ff08c1b9640 1 -- 172.21.15.38:0/621435074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0840cd780 con 0x7ff08415fce0 2023-12-22T08:43:06.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.110+0000 7ff07a7fc640 1 -- 172.21.15.38:0/621435074 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff07c047020 con 0x7ff08415fce0 2023-12-22T08:43:06.112 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:43:06.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.113+0000 7ff08c1b9640 1 -- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff06806a460 msgr2=0x7ff06806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:06.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.113+0000 7ff08c1b9640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff06806a460 0x7ff06806c920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff080001050 tx=0x7ff080009040 comp rx=0 tx=0).stop 2023-12-22T08:43:06.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.113+0000 7ff08c1b9640 1 -- 172.21.15.38:0/621435074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff08415fce0 msgr2=0x7ff084070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:06.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.113+0000 7ff08c1b9640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff08415fce0 0x7ff084070b40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff07c001f40 tx=0x7ff07c0014a0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.113+0000 7ff08c1b9640 1 -- 172.21.15.38:0/621435074 shutdown_connections 2023-12-22T08:43:06.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.113+0000 7ff08c1b9640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff06806a460 0x7ff06806c920 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.113+0000 7ff08c1b9640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff08415fce0 0x7ff084070b40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.113+0000 7ff08c1b9640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0841574f0 0x7ff08415f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.113+0000 7ff08c1b9640 1 --2- 172.21.15.38:0/621435074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff070005180 0x7ff0840a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.113+0000 7ff08c1b9640 1 -- 172.21.15.38:0/621435074 >> 172.21.15.38:0/621435074 conn(0x7ff0840cfe70 msgr2=0x7ff0840cda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:06.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.113+0000 7ff08c1b9640 1 -- 172.21.15.38:0/621435074 shutdown_connections 2023-12-22T08:43:06.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.113+0000 7ff08c1b9640 1 -- 172.21.15.38:0/621435074 wait complete. 2023-12-22T08:43:06.134 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T08:43:06.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.353+0000 7f37250d7640 1 Processor -- start 2023-12-22T08:43:06.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.354+0000 7f37250d7640 1 -- start start 2023-12-22T08:43:06.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.355+0000 7f37250d7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f372006dc80 0x7f3720071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:06.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.355+0000 7f37250d7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f372006e060 0x7f37200cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:06.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.355+0000 7f37250d7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37200ccc50 con 0x7f37200cc6f0 2023-12-22T08:43:06.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.355+0000 7f37250d7640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3720070980 con 0x7f372006dc80 2023-12-22T08:43:06.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.355+0000 7f37250d7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3720070b90 con 0x7f372006e060 2023-12-22T08:43:06.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.355+0000 7f371ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f372006dc80 0x7f3720071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:06.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.356+0000 7f371ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f372006dc80 0x7f3720071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36426/0 (socket says 172.21.15.38:36426) 2023-12-22T08:43:06.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.356+0000 7f371ffff640 1 -- 172.21.15.38:0/3185794306 learned_addr learned my addr 172.21.15.38:0/3185794306 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:06.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.356+0000 7f371f7fe640 1 --2- 172.21.15.38:0/3185794306 >> v2:172.21.15.89:3300/0 conn(0x7f372006e060 0x7f37200cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:06.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.356+0000 7f371ffff640 1 -- 172.21.15.38:0/3185794306 >> v2:172.21.15.89:3300/0 conn(0x7f372006e060 msgr2=0x7f37200cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:06.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.356+0000 7f371ffff640 1 --2- 172.21.15.38:0/3185794306 >> v2:172.21.15.89:3300/0 conn(0x7f372006e060 0x7f37200cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.356+0000 7f371ffff640 1 -- 172.21.15.38:0/3185794306 >> v1:172.21.15.89:6789/0 conn(0x7f37200cc6f0 legacy=0x7f372009ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:06.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.356+0000 7f371ffff640 1 -- 172.21.15.38:0/3185794306 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3720070e70 con 0x7f372006dc80 2023-12-22T08:43:06.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.356+0000 7f371f7fe640 1 --2- 172.21.15.38:0/3185794306 >> v2:172.21.15.89:3300/0 conn(0x7f372006e060 0x7f37200cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:06.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.357+0000 7f371ffff640 1 --2- 172.21.15.38:0/3185794306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372006dc80 0x7f3720071670 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f37200cfda0 tx=0x7f371002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa64c7507323a1bf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:06.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.358+0000 7f371effd640 1 -- 172.21.15.38:0/3185794306 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710031870 con 0x7f372006dc80 2023-12-22T08:43:06.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.358+0000 7f371effd640 1 -- 172.21.15.38:0/3185794306 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37100319d0 con 0x7f372006dc80 2023-12-22T08:43:06.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.358+0000 7f371effd640 1 -- 172.21.15.38:0/3185794306 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710031d60 con 0x7f372006dc80 2023-12-22T08:43:06.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.358+0000 7f37250d7640 1 -- 172.21.15.38:0/3185794306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372006dc80 msgr2=0x7f3720071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:06.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.358+0000 7f37250d7640 1 --2- 172.21.15.38:0/3185794306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372006dc80 0x7f3720071670 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f37200cfda0 tx=0x7f371002b910 comp rx=0 tx=0).stop 2023-12-22T08:43:06.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.358+0000 7f37250d7640 1 -- 172.21.15.38:0/3185794306 shutdown_connections 2023-12-22T08:43:06.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.358+0000 7f37250d7640 1 --2- 172.21.15.38:0/3185794306 >> v2:172.21.15.89:3300/0 conn(0x7f372006e060 0x7f37200cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.358+0000 7f37250d7640 1 --2- 172.21.15.38:0/3185794306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372006dc80 0x7f3720071670 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.358+0000 7f37250d7640 1 -- 172.21.15.38:0/3185794306 >> 172.21.15.38:0/3185794306 conn(0x7f37200cf000 msgr2=0x7f37200cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:06.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.359+0000 7f37250d7640 1 -- 172.21.15.38:0/3185794306 shutdown_connections 2023-12-22T08:43:06.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.359+0000 7f37250d7640 1 -- 172.21.15.38:0/3185794306 wait complete. 2023-12-22T08:43:06.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.361+0000 7f37250d7640 1 Processor -- start 2023-12-22T08:43:06.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.361+0000 7f37250d7640 1 -- start start 2023-12-22T08:43:06.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.362+0000 7f37250d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372006dc80 0x7f372009ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:06.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.362+0000 7f37250d7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372006e060 0x7f37200afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:06.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.362+0000 7f37250d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37200cc6f0 0x7f372009d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:06.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.362+0000 7f37250d7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37200a22a0 con 0x7f372006dc80 2023-12-22T08:43:06.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.362+0000 7f37250d7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372009f5f0 con 0x7f37200cc6f0 2023-12-22T08:43:06.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.362+0000 7f37250d7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372009f1a0 con 0x7f372006e060 2023-12-22T08:43:06.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.362+0000 7f371ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372006dc80 0x7f372009ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:06.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.362+0000 7f371ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372006dc80 0x7f372009ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36438/0 (socket says 172.21.15.38:36438) 2023-12-22T08:43:06.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.362+0000 7f371ffff640 1 -- 172.21.15.38:0/1595569669 learned_addr learned my addr 172.21.15.38:0/1595569669 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:06.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.363+0000 7f371f7fe640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372006e060 0x7f37200afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:06.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.363+0000 7f371ffff640 1 -- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372006e060 msgr2=0x7f37200afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:06.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.363+0000 7f37248d6640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37200cc6f0 0x7f372009d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:06.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.363+0000 7f371ffff640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372006e060 0x7f37200afe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.363+0000 7f371ffff640 1 -- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37200cc6f0 msgr2=0x7f372009d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:06.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.363+0000 7f371ffff640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37200cc6f0 0x7f372009d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.363+0000 7f371ffff640 1 -- 172.21.15.38:0/1595569669 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37100094d0 con 0x7f372006dc80 2023-12-22T08:43:06.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.363+0000 7f37248d6640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37200cc6f0 0x7f372009d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:06.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.363+0000 7f371ffff640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372006dc80 0x7f372009ec60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3710000c00 tx=0x7f37100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:06.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.364+0000 7f371cff9640 1 -- 172.21.15.38:0/1595569669 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710031840 con 0x7f372006dc80 2023-12-22T08:43:06.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.364+0000 7f371cff9640 1 -- 172.21.15.38:0/1595569669 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37100443f0 con 0x7f372006dc80 2023-12-22T08:43:06.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.364+0000 7f371cff9640 1 -- 172.21.15.38:0/1595569669 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37100447a0 con 0x7f372006dc80 2023-12-22T08:43:06.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.364+0000 7f37250d7640 1 -- 172.21.15.38:0/1595569669 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37200a1720 con 0x7f372006dc80 2023-12-22T08:43:06.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.364+0000 7f37250d7640 1 -- 172.21.15.38:0/1595569669 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37200a1ce0 con 0x7f372006dc80 2023-12-22T08:43:06.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.365+0000 7f37250d7640 1 -- 172.21.15.38:0/1595569669 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372009f760 con 0x7f372006dc80 2023-12-22T08:43:06.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.366+0000 7f371cff9640 1 -- 172.21.15.38:0/1595569669 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3710044900 con 0x7f372006dc80 2023-12-22T08:43:06.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.367+0000 7f371cff9640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f370c06a430 0x7f370c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:06.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.367+0000 7f371cff9640 1 -- 172.21.15.38:0/1595569669 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f371002d040 con 0x7f372006dc80 2023-12-22T08:43:06.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.368+0000 7f371f7fe640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f370c06a430 0x7f370c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:06.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.369+0000 7f371f7fe640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f370c06a430 0x7f370c06c8f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f37201566c0 tx=0x7f3714008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:06.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.372+0000 7f371cff9640 1 -- 172.21.15.38:0/1595569669 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f372009f760 con 0x7f372006dc80 2023-12-22T08:43:06.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.567+0000 7f37250d7640 1 -- 172.21.15.38:0/1595569669 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f372009f760 con 0x7f372006dc80 2023-12-22T08:43:06.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.568+0000 7f371cff9640 1 -- 172.21.15.38:0/1595569669 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+65 (secure 0 0 0) 0x7f372009f760 con 0x7f372006dc80 2023-12-22T08:43:06.570 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:06.570 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-12-22T08:43:06.570 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:43:06.570 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-12-22T08:43:06.570 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-12-22T08:43:06.570 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:43:06.571 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-12-22T08:43:06.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.570+0000 7f37250d7640 1 -- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f370c06a430 msgr2=0x7f370c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:06.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.570+0000 7f37250d7640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f370c06a430 0x7f370c06c8f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f37201566c0 tx=0x7f3714008040 comp rx=0 tx=0).stop 2023-12-22T08:43:06.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.570+0000 7f37250d7640 1 -- 172.21.15.38:0/1595569669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372006dc80 msgr2=0x7f372009ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:06.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.570+0000 7f37250d7640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372006dc80 0x7f372009ec60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3710000c00 tx=0x7f37100046c0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.571+0000 7f37250d7640 1 -- 172.21.15.38:0/1595569669 shutdown_connections 2023-12-22T08:43:06.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.571+0000 7f37250d7640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37200cc6f0 0x7f372009d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.571+0000 7f37250d7640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f372006e060 0x7f37200afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.571+0000 7f37250d7640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f370c06a430 0x7f370c06c8f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.571+0000 7f37250d7640 1 --2- 172.21.15.38:0/1595569669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372006dc80 0x7f372009ec60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.571+0000 7f37250d7640 1 -- 172.21.15.38:0/1595569669 >> 172.21.15.38:0/1595569669 conn(0x7f37200cf000 msgr2=0x7f3720071570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:06.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.571+0000 7f37250d7640 1 -- 172.21.15.38:0/1595569669 shutdown_connections 2023-12-22T08:43:06.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.571+0000 7f37250d7640 1 -- 172.21.15.38:0/1595569669 wait complete. 2023-12-22T08:43:06.593 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T08:43:06.593 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T08:43:06.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.821+0000 7f9a66977640 1 Processor -- start 2023-12-22T08:43:06.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.821+0000 7f9a66977640 1 -- start start 2023-12-22T08:43:06.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.823+0000 7f9a66977640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9a60146ad0 0x7f9a60070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:06.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.823+0000 7f9a66977640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9a600d24e0 0x7f9a6009f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:06.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.823+0000 7f9a66977640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a60070a70 con 0x7f9a60146eb0 2023-12-22T08:43:06.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.823+0000 7f9a66977640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6009ed10 con 0x7f9a60146ad0 2023-12-22T08:43:06.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.823+0000 7f9a66977640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6009eff0 con 0x7f9a600d24e0 2023-12-22T08:43:06.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.823+0000 7f9a65975640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9a60146ad0 0x7f9a60070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:06.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.823+0000 7f9a65975640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9a60146ad0 0x7f9a60070140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36444/0 (socket says 172.21.15.38:36444) 2023-12-22T08:43:06.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.823+0000 7f9a65975640 1 -- 172.21.15.38:0/1956231795 learned_addr learned my addr 172.21.15.38:0/1956231795 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:06.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.823+0000 7f9a65975640 1 -- 172.21.15.38:0/1956231795 >> v2:172.21.15.89:3300/0 conn(0x7f9a600d24e0 msgr2=0x7f9a6009f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:06.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.823+0000 7f9a66176640 1 --2- 172.21.15.38:0/1956231795 >> v2:172.21.15.89:3300/0 conn(0x7f9a600d24e0 0x7f9a6009f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:06.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.823+0000 7f9a65975640 1 --2- 172.21.15.38:0/1956231795 >> v2:172.21.15.89:3300/0 conn(0x7f9a600d24e0 0x7f9a6009f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.823+0000 7f9a65975640 1 -- 172.21.15.38:0/1956231795 >> v1:172.21.15.38:6789/0 conn(0x7f9a60146eb0 legacy=0x7f9a600d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:06.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.823+0000 7f9a65975640 1 -- 172.21.15.38:0/1956231795 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6009f2d0 con 0x7f9a60146ad0 2023-12-22T08:43:06.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.824+0000 7f9a65975640 1 --2- 172.21.15.38:0/1956231795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a60146ad0 0x7f9a60070140 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9a600a1500 tx=0x7f9a5c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8a8ba35182cdb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:06.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.824+0000 7f9a64973640 1 -- 172.21.15.38:0/1956231795 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c031870 con 0x7f9a60146ad0 2023-12-22T08:43:06.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.824+0000 7f9a64973640 1 -- 172.21.15.38:0/1956231795 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0319d0 con 0x7f9a60146ad0 2023-12-22T08:43:06.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.824+0000 7f9a64973640 1 -- 172.21.15.38:0/1956231795 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c031d60 con 0x7f9a60146ad0 2023-12-22T08:43:06.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.825+0000 7f9a66977640 1 -- 172.21.15.38:0/1956231795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a60146ad0 msgr2=0x7f9a60070140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:06.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.825+0000 7f9a66977640 1 --2- 172.21.15.38:0/1956231795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a60146ad0 0x7f9a60070140 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9a600a1500 tx=0x7f9a5c02b910 comp rx=0 tx=0).stop 2023-12-22T08:43:06.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.825+0000 7f9a66977640 1 -- 172.21.15.38:0/1956231795 shutdown_connections 2023-12-22T08:43:06.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.825+0000 7f9a66977640 1 --2- 172.21.15.38:0/1956231795 >> v2:172.21.15.89:3300/0 conn(0x7f9a600d24e0 0x7f9a6009f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.825+0000 7f9a66977640 1 --2- 172.21.15.38:0/1956231795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a60146ad0 0x7f9a60070140 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.825+0000 7f9a66977640 1 -- 172.21.15.38:0/1956231795 >> 172.21.15.38:0/1956231795 conn(0x7f9a6006cf30 msgr2=0x7f9a600b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:06.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.825+0000 7f9a66977640 1 -- 172.21.15.38:0/1956231795 shutdown_connections 2023-12-22T08:43:06.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.825+0000 7f9a66977640 1 -- 172.21.15.38:0/1956231795 wait complete. 2023-12-22T08:43:06.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.827+0000 7f9a66977640 1 Processor -- start 2023-12-22T08:43:06.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.827+0000 7f9a66977640 1 -- start start 2023-12-22T08:43:06.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a66977640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a600d24e0 0x7f9a60157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a66977640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a60146ad0 0x7f9a60155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a66977640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a60146eb0 0x7f9a60153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a66977640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a60142e10 con 0x7f9a600d24e0 2023-12-22T08:43:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a66977640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a60155ff0 con 0x7f9a60146ad0 2023-12-22T08:43:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a66977640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a601430b0 con 0x7f9a60146eb0 2023-12-22T08:43:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a65975640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a600d24e0 0x7f9a60157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a65975640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a600d24e0 0x7f9a60157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36454/0 (socket says 172.21.15.38:36454) 2023-12-22T08:43:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a65975640 1 -- 172.21.15.38:0/891341786 learned_addr learned my addr 172.21.15.38:0/891341786 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:06.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a66176640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a60146eb0 0x7f9a60153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:06.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a65174640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a60146ad0 0x7f9a60155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:06.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a65975640 1 -- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a60146eb0 msgr2=0x7f9a60153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:06.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a65975640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a60146eb0 0x7f9a60153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a65975640 1 -- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a60146ad0 msgr2=0x7f9a60155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:06.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a65975640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a60146ad0 0x7f9a60155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:06.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a65975640 1 -- 172.21.15.38:0/891341786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c0094d0 con 0x7f9a600d24e0 2023-12-22T08:43:06.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.829+0000 7f9a65975640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a600d24e0 0x7f9a60157590 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0097c0 tx=0x7f9a5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:06.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.830+0000 7f9a567fc640 1 -- 172.21.15.38:0/891341786 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c031820 con 0x7f9a600d24e0 2023-12-22T08:43:06.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.830+0000 7f9a567fc640 1 -- 172.21.15.38:0/891341786 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0443f0 con 0x7f9a600d24e0 2023-12-22T08:43:06.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.830+0000 7f9a66977640 1 -- 172.21.15.38:0/891341786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a60143390 con 0x7f9a600d24e0 2023-12-22T08:43:06.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.830+0000 7f9a567fc640 1 -- 172.21.15.38:0/891341786 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0447a0 con 0x7f9a600d24e0 2023-12-22T08:43:06.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.830+0000 7f9a66977640 1 -- 172.21.15.38:0/891341786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a60145fe0 con 0x7f9a600d24e0 2023-12-22T08:43:06.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.831+0000 7f9a66977640 1 -- 172.21.15.38:0/891341786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a601438b0 con 0x7f9a600d24e0 2023-12-22T08:43:06.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.832+0000 7f9a567fc640 1 -- 172.21.15.38:0/891341786 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9a5c04d450 con 0x7f9a600d24e0 2023-12-22T08:43:06.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.833+0000 7f9a567fc640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9a4406a460 0x7f9a4406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:06.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.833+0000 7f9a567fc640 1 -- 172.21.15.38:0/891341786 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9a5c02d040 con 0x7f9a600d24e0 2023-12-22T08:43:06.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.835+0000 7f9a65174640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9a4406a460 0x7f9a4406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:06.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.835+0000 7f9a65174640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9a4406a460 0x7f9a4406c920 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9a6015e2a0 tx=0x7f9a50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:06.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:06.838+0000 7f9a567fc640 1 -- 172.21.15.38:0/891341786 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9a601438b0 con 0x7f9a600d24e0 2023-12-22T08:43:07.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.036+0000 7f9a66977640 1 -- 172.21.15.38:0/891341786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9a601438b0 con 0x7f9a600d24e0 2023-12-22T08:43:07.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.202+0000 7f9a567fc640 1 -- 172.21.15.38:0/891341786 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9a601438b0 con 0x7f9a600d24e0 2023-12-22T08:43:07.205 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-12-22T08:43:07.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.207+0000 7f9a66977640 1 -- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9a4406a460 msgr2=0x7f9a4406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:07.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.207+0000 7f9a66977640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9a4406a460 0x7f9a4406c920 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9a6015e2a0 tx=0x7f9a50009040 comp rx=0 tx=0).stop 2023-12-22T08:43:07.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.207+0000 7f9a66977640 1 -- 172.21.15.38:0/891341786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a600d24e0 msgr2=0x7f9a60157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:07.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.207+0000 7f9a66977640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a600d24e0 0x7f9a60157590 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0097c0 tx=0x7f9a5c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:43:07.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.208+0000 7f9a66977640 1 -- 172.21.15.38:0/891341786 shutdown_connections 2023-12-22T08:43:07.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.208+0000 7f9a66977640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a60146eb0 0x7f9a60153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:07.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.208+0000 7f9a66977640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a60146ad0 0x7f9a60155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:07.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.208+0000 7f9a66977640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9a4406a460 0x7f9a4406c920 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:07.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.208+0000 7f9a66977640 1 --2- 172.21.15.38:0/891341786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a600d24e0 0x7f9a60157590 secure :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0097c0 tx=0x7f9a5c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:43:07.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.208+0000 7f9a66977640 1 -- 172.21.15.38:0/891341786 >> 172.21.15.38:0/891341786 conn(0x7f9a6006cf30 msgr2=0x7f9a600b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:07.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.211+0000 7f9a66977640 1 -- 172.21.15.38:0/891341786 shutdown_connections 2023-12-22T08:43:07.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.211+0000 7f9a66977640 1 -- 172.21.15.38:0/891341786 wait complete. 2023-12-22T08:43:07.232 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T08:43:07.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.454+0000 7f285759e640 1 Processor -- start 2023-12-22T08:43:07.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.454+0000 7f285759e640 1 -- start start 2023-12-22T08:43:07.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.455+0000 7f285759e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f285815ad90 0x7f28580caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:07.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.455+0000 7f285759e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f285815e050 0x7f28580cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:07.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.455+0000 7f285759e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285815e630 con 0x7f2858161bb0 2023-12-22T08:43:07.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.455+0000 7f285759e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28580ce2c0 con 0x7f285815e050 2023-12-22T08:43:07.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.455+0000 7f285759e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285815e910 con 0x7f285815ad90 2023-12-22T08:43:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.456+0000 7f2856d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f285815e050 0x7f28580cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.456+0000 7f2856d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f285815e050 0x7f28580cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36466/0 (socket says 172.21.15.38:36466) 2023-12-22T08:43:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.456+0000 7f2856d9d640 1 -- 172.21.15.38:0/2468221716 learned_addr learned my addr 172.21.15.38:0/2468221716 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.456+0000 7f2855d9b640 1 --1- 172.21.15.38:0/2468221716 >> v1:172.21.15.38:6789/0 conn(0x7f2858161bb0 0x7f285815d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42482/0 (socket says 172.21.15.38:42482) 2023-12-22T08:43:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.456+0000 7f285659c640 1 --2- 172.21.15.38:0/2468221716 >> v2:172.21.15.89:3300/0 conn(0x7f285815ad90 0x7f28580caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.456+0000 7f2856d9d640 1 -- 172.21.15.38:0/2468221716 >> v2:172.21.15.89:3300/0 conn(0x7f285815ad90 msgr2=0x7f28580caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.456+0000 7f2856d9d640 1 --2- 172.21.15.38:0/2468221716 >> v2:172.21.15.89:3300/0 conn(0x7f285815ad90 0x7f28580caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.456+0000 7f2856d9d640 1 -- 172.21.15.38:0/2468221716 >> v1:172.21.15.38:6789/0 conn(0x7f2858161bb0 legacy=0x7f285815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.457+0000 7f2856d9d640 1 -- 172.21.15.38:0/2468221716 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28581610d0 con 0x7f285815e050 2023-12-22T08:43:07.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.457+0000 7f285559a640 1 -- 172.21.15.38:0/2468221716 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933964035 0 0) 0x7f285815e630 con 0x7f2858161bb0 2023-12-22T08:43:07.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.458+0000 7f2856d9d640 1 --2- 172.21.15.38:0/2468221716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f285815e050 0x7f28580cb410 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f28580d28f0 tx=0x7f285002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9342f6f5d5bda7b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:07.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.458+0000 7f285559a640 1 -- 172.21.15.38:0/2468221716 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850030860 con 0x7f285815e050 2023-12-22T08:43:07.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.458+0000 7f285559a640 1 -- 172.21.15.38:0/2468221716 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28500309c0 con 0x7f285815e050 2023-12-22T08:43:07.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.458+0000 7f285559a640 1 -- 172.21.15.38:0/2468221716 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850030d50 con 0x7f285815e050 2023-12-22T08:43:07.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.459+0000 7f285759e640 1 -- 172.21.15.38:0/2468221716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f285815e050 msgr2=0x7f28580cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:07.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.459+0000 7f285759e640 1 --2- 172.21.15.38:0/2468221716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f285815e050 0x7f28580cb410 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f28580d28f0 tx=0x7f285002b9a0 comp rx=0 tx=0).stop 2023-12-22T08:43:07.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.459+0000 7f285759e640 1 -- 172.21.15.38:0/2468221716 shutdown_connections 2023-12-22T08:43:07.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.459+0000 7f285759e640 1 --2- 172.21.15.38:0/2468221716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f285815e050 0x7f28580cb410 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:07.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.459+0000 7f285759e640 1 --2- 172.21.15.38:0/2468221716 >> v2:172.21.15.89:3300/0 conn(0x7f285815ad90 0x7f28580caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:07.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.459+0000 7f285759e640 1 -- 172.21.15.38:0/2468221716 >> 172.21.15.38:0/2468221716 conn(0x7f28580d31c0 msgr2=0x7f28580d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:07.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.459+0000 7f285759e640 1 -- 172.21.15.38:0/2468221716 shutdown_connections 2023-12-22T08:43:07.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.459+0000 7f285759e640 1 -- 172.21.15.38:0/2468221716 wait complete. 2023-12-22T08:43:07.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.461+0000 7f285759e640 1 Processor -- start 2023-12-22T08:43:07.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.461+0000 7f285759e640 1 -- start start 2023-12-22T08:43:07.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.461+0000 7f285759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815ad90 0x7f2858152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:07.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.461+0000 7f285759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f285815e050 0x7f28581517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:07.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.461+0000 7f285759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2858161bb0 0x7f28580c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:07.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.461+0000 7f285759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285815fd00 con 0x7f2858161bb0 2023-12-22T08:43:07.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.461+0000 7f285759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2858151d10 con 0x7f285815e050 2023-12-22T08:43:07.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.461+0000 7f285759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2858158ba0 con 0x7f285815ad90 2023-12-22T08:43:07.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.461+0000 7f2856d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2858161bb0 0x7f28580c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:07.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.461+0000 7f2856d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2858161bb0 0x7f28580c9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36480/0 (socket says 172.21.15.38:36480) 2023-12-22T08:43:07.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.461+0000 7f2856d9d640 1 -- 172.21.15.38:0/3029894508 learned_addr learned my addr 172.21.15.38:0/3029894508 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:07.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.463+0000 7f285659c640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815ad90 0x7f2858152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:07.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.463+0000 7f2855d9b640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f285815e050 0x7f28581517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.463+0000 7f2856d9d640 1 -- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815ad90 msgr2=0x7f2858152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.463+0000 7f2856d9d640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815ad90 0x7f2858152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.463+0000 7f2856d9d640 1 -- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f285815e050 msgr2=0x7f28581517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.463+0000 7f2856d9d640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f285815e050 0x7f28581517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.463+0000 7f2856d9d640 1 -- 172.21.15.38:0/3029894508 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500094d0 con 0x7f2858161bb0 2023-12-22T08:43:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.463+0000 7f2855d9b640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f285815e050 0x7f28581517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.463+0000 7f2856d9d640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2858161bb0 0x7f28580c9370 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f28500097f0 tx=0x7f2850004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.464+0000 7f284effd640 1 -- 172.21.15.38:0/3029894508 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850039c90 con 0x7f2858161bb0 2023-12-22T08:43:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.464+0000 7f285759e640 1 -- 172.21.15.38:0/3029894508 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2858158e40 con 0x7f2858161bb0 2023-12-22T08:43:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.464+0000 7f284effd640 1 -- 172.21.15.38:0/3029894508 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2850039e10 con 0x7f2858161bb0 2023-12-22T08:43:07.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.464+0000 7f284effd640 1 -- 172.21.15.38:0/3029894508 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850043640 con 0x7f2858161bb0 2023-12-22T08:43:07.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.464+0000 7f285759e640 1 -- 172.21.15.38:0/3029894508 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2858155f80 con 0x7f2858161bb0 2023-12-22T08:43:07.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.465+0000 7f285759e640 1 -- 172.21.15.38:0/3029894508 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285815fe40 con 0x7f2858161bb0 2023-12-22T08:43:07.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.467+0000 7f284effd640 1 -- 172.21.15.38:0/3029894508 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f28500437a0 con 0x7f2858161bb0 2023-12-22T08:43:07.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.468+0000 7f284effd640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f283806a430 0x7f283806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:07.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.468+0000 7f284effd640 1 -- 172.21.15.38:0/3029894508 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f285003e070 con 0x7f2858161bb0 2023-12-22T08:43:07.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.468+0000 7f285659c640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f283806a430 0x7f283806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.469+0000 7f285659c640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f283806a430 0x7f283806c8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f28580b2db0 tx=0x7f28480039b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:07.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.471+0000 7f284effd640 1 -- 172.21.15.38:0/3029894508 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f28500779f0 con 0x7f2858161bb0 2023-12-22T08:43:07.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:07.665+0000 7f285759e640 1 -- 172.21.15.38:0/3029894508 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f285815fe40 con 0x7f2858161bb0 2023-12-22T08:43:08.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.221+0000 7f284effd640 1 -- 172.21.15.38:0/3029894508 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) v1 ==== 170+0+0 (secure 0 0 0) 0x7f285815fe40 con 0x7f2858161bb0 2023-12-22T08:43:08.276 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-12-22T08:43:08.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.229+0000 7f285759e640 1 -- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f283806a430 msgr2=0x7f283806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:08.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.229+0000 7f285759e640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f283806a430 0x7f283806c8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f28580b2db0 tx=0x7f28480039b0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.229+0000 7f285759e640 1 -- 172.21.15.38:0/3029894508 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2858161bb0 msgr2=0x7f28580c9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:08.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.229+0000 7f285759e640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2858161bb0 0x7f28580c9370 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f28500097f0 tx=0x7f2850004730 comp rx=0 tx=0).stop 2023-12-22T08:43:08.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.229+0000 7f285759e640 1 -- 172.21.15.38:0/3029894508 shutdown_connections 2023-12-22T08:43:08.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.230+0000 7f285759e640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f283806a430 0x7f283806c8f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.230+0000 7f285759e640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2858161bb0 0x7f28580c9370 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.230+0000 7f285759e640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f285815e050 0x7f28581517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.230+0000 7f285759e640 1 --2- 172.21.15.38:0/3029894508 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815ad90 0x7f2858152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.230+0000 7f285759e640 1 -- 172.21.15.38:0/3029894508 >> 172.21.15.38:0/3029894508 conn(0x7f28580d31c0 msgr2=0x7f285815c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:08.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.230+0000 7f285759e640 1 -- 172.21.15.38:0/3029894508 shutdown_connections 2023-12-22T08:43:08.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.230+0000 7f285759e640 1 -- 172.21.15.38:0/3029894508 wait complete. 2023-12-22T08:43:08.278 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T08:43:08.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.484+0000 7fbc1f59e640 1 Processor -- start 2023-12-22T08:43:08.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.484+0000 7fbc1f59e640 1 -- start start 2023-12-22T08:43:08.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.486+0000 7fbc1f59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc2015d320 0x7fbc2015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:08.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.486+0000 7fbc1f59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc200b0bc0 0x7fbc200ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:08.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.486+0000 7fbc1f59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc200b1c20 con 0x7fbc2006a5e0 2023-12-22T08:43:08.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.486+0000 7fbc1f59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc200b1380 con 0x7fbc2015d320 2023-12-22T08:43:08.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.486+0000 7fbc1f59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc200b1660 con 0x7fbc200b0bc0 2023-12-22T08:43:08.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.487+0000 7fbc1e59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc2015d320 0x7fbc2015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:08.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.487+0000 7fbc1e59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc2015d320 0x7fbc2015e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36490/0 (socket says 172.21.15.38:36490) 2023-12-22T08:43:08.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.487+0000 7fbc1e59c640 1 -- 172.21.15.38:0/3660652669 learned_addr learned my addr 172.21.15.38:0/3660652669 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:08.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.487+0000 7fbc1dd9b640 1 --2- 172.21.15.38:0/3660652669 >> v2:172.21.15.89:3300/0 conn(0x7fbc200b0bc0 0x7fbc200ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:08.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.488+0000 7fbc1e59c640 1 -- 172.21.15.38:0/3660652669 >> v2:172.21.15.89:3300/0 conn(0x7fbc200b0bc0 msgr2=0x7fbc200ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:08.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.488+0000 7fbc1e59c640 1 --2- 172.21.15.38:0/3660652669 >> v2:172.21.15.89:3300/0 conn(0x7fbc200b0bc0 0x7fbc200ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.488+0000 7fbc1e59c640 1 -- 172.21.15.38:0/3660652669 >> v1:172.21.15.89:6789/0 conn(0x7fbc2006a5e0 legacy=0x7fbc200cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:08.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.488+0000 7fbc1e59c640 1 -- 172.21.15.38:0/3660652669 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200b1940 con 0x7fbc2015d320 2023-12-22T08:43:08.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.489+0000 7fbc1e59c640 1 --2- 172.21.15.38:0/3660652669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc2015d320 0x7fbc2015e5d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fbc200b1e60 tx=0x7fbc1002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5645cdbea87b2c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:08.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.490+0000 7fbc1d59a640 1 -- 172.21.15.38:0/3660652669 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10030860 con 0x7fbc2015d320 2023-12-22T08:43:08.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.490+0000 7fbc1d59a640 1 -- 172.21.15.38:0/3660652669 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc100309c0 con 0x7fbc2015d320 2023-12-22T08:43:08.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.490+0000 7fbc1d59a640 1 -- 172.21.15.38:0/3660652669 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10030d50 con 0x7fbc2015d320 2023-12-22T08:43:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.491+0000 7fbc1f59e640 1 -- 172.21.15.38:0/3660652669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc2015d320 msgr2=0x7fbc2015e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.491+0000 7fbc1f59e640 1 --2- 172.21.15.38:0/3660652669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc2015d320 0x7fbc2015e5d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fbc200b1e60 tx=0x7fbc1002b9a0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.491+0000 7fbc1f59e640 1 -- 172.21.15.38:0/3660652669 shutdown_connections 2023-12-22T08:43:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.491+0000 7fbc1f59e640 1 --2- 172.21.15.38:0/3660652669 >> v2:172.21.15.89:3300/0 conn(0x7fbc200b0bc0 0x7fbc200ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.491+0000 7fbc1f59e640 1 --2- 172.21.15.38:0/3660652669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc2015d320 0x7fbc2015e5d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.491+0000 7fbc1f59e640 1 -- 172.21.15.38:0/3660652669 >> 172.21.15.38:0/3660652669 conn(0x7fbc200d1200 msgr2=0x7fbc200d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.491+0000 7fbc1f59e640 1 -- 172.21.15.38:0/3660652669 shutdown_connections 2023-12-22T08:43:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.491+0000 7fbc1f59e640 1 -- 172.21.15.38:0/3660652669 wait complete. 2023-12-22T08:43:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.493+0000 7fbc1f59e640 1 Processor -- start 2023-12-22T08:43:08.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.493+0000 7fbc1f59e640 1 -- start start 2023-12-22T08:43:08.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.494+0000 7fbc1f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc2006a5e0 0x7fbc2014ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:08.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.494+0000 7fbc1f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc200b0bc0 0x7fbc200b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:08.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.494+0000 7fbc1f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc2015d320 0x7fbc200b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:08.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.494+0000 7fbc1f59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2006d480 con 0x7fbc2006a5e0 2023-12-22T08:43:08.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.494+0000 7fbc1f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2006d760 con 0x7fbc2015d320 2023-12-22T08:43:08.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.494+0000 7fbc1f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2006da40 con 0x7fbc200b0bc0 2023-12-22T08:43:08.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.494+0000 7fbc1e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc2006a5e0 0x7fbc2014ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:08.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.494+0000 7fbc1e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc2006a5e0 0x7fbc2014ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36504/0 (socket says 172.21.15.38:36504) 2023-12-22T08:43:08.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.494+0000 7fbc1e59c640 1 -- 172.21.15.38:0/1868786207 learned_addr learned my addr 172.21.15.38:0/1868786207 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:08.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.495+0000 7fbc1e59c640 1 -- 172.21.15.38:0/1868786207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc200b0bc0 msgr2=0x7fbc200b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:08.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.495+0000 7fbc1dd9b640 1 --2- 172.21.15.38:0/1868786207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc200b0bc0 0x7fbc200b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:08.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.495+0000 7fbc1e59c640 1 --2- 172.21.15.38:0/1868786207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc200b0bc0 0x7fbc200b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.495+0000 7fbc1e59c640 1 -- 172.21.15.38:0/1868786207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc2015d320 msgr2=0x7fbc200b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:08.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.495+0000 7fbc1e59c640 1 --2- 172.21.15.38:0/1868786207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc2015d320 0x7fbc200b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.495+0000 7fbc1e59c640 1 -- 172.21.15.38:0/1868786207 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc100094d0 con 0x7fbc2006a5e0 2023-12-22T08:43:08.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.495+0000 7fbc1e59c640 1 --2- 172.21.15.38:0/1868786207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc2006a5e0 0x7fbc2014ddc0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbc1002b9e0 tx=0x7fbc10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:08.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.495+0000 7fbc0effd640 1 -- 172.21.15.38:0/1868786207 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10039c90 con 0x7fbc2006a5e0 2023-12-22T08:43:08.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.495+0000 7fbc0effd640 1 -- 172.21.15.38:0/1868786207 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc10039e10 con 0x7fbc2006a5e0 2023-12-22T08:43:08.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.495+0000 7fbc0effd640 1 -- 172.21.15.38:0/1868786207 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10043640 con 0x7fbc2006a5e0 2023-12-22T08:43:08.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.495+0000 7fbc1f59e640 1 -- 172.21.15.38:0/1868786207 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2006dd20 con 0x7fbc2006a5e0 2023-12-22T08:43:08.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.496+0000 7fbc1f59e640 1 -- 172.21.15.38:0/1868786207 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2006d110 con 0x7fbc2006a5e0 2023-12-22T08:43:08.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.497+0000 7fbc1f59e640 1 -- 172.21.15.38:0/1868786207 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc200d2130 con 0x7fbc2006a5e0 2023-12-22T08:43:08.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.498+0000 7fbc0effd640 1 -- 172.21.15.38:0/1868786207 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbc100437a0 con 0x7fbc2006a5e0 2023-12-22T08:43:08.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.499+0000 7fbc0effd640 1 --2- 172.21.15.38:0/1868786207 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbc0006a460 0x7fbc0006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:08.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.499+0000 7fbc0effd640 1 -- 172.21.15.38:0/1868786207 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbc1003e070 con 0x7fbc2006a5e0 2023-12-22T08:43:08.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.499+0000 7fbc1dd9b640 1 --2- 172.21.15.38:0/1868786207 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbc0006a460 0x7fbc0006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:08.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.501+0000 7fbc1dd9b640 1 --2- 172.21.15.38:0/1868786207 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbc0006a460 0x7fbc0006c920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbc200d0280 tx=0x7fbc14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:08.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.504+0000 7fbc0effd640 1 -- 172.21.15.38:0/1868786207 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbc10077030 con 0x7fbc2006a5e0 2023-12-22T08:43:08.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.735+0000 7fbc1f59e640 1 -- 172.21.15.38:0/1868786207 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbc20061910 con 0x7fbc2006a5e0 2023-12-22T08:43:08.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.748+0000 7fbc0effd640 1 -- 172.21.15.38:0/1868786207 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbc1007a650 con 0x7fbc2006a5e0 2023-12-22T08:43:08.749 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 8 and data pool 9 2023-12-22T08:43:08.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.753+0000 7fbc1f59e640 1 -- 172.21.15.38:0/1868786207 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbc0006a460 msgr2=0x7fbc0006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:08.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.753+0000 7fbc1f59e640 1 --2- 172.21.15.38:0/1868786207 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbc0006a460 0x7fbc0006c920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbc200d0280 tx=0x7fbc14008040 comp rx=0 tx=0).stop 2023-12-22T08:43:08.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.753+0000 7fbc1f59e640 1 -- 172.21.15.38:0/1868786207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc2006a5e0 msgr2=0x7fbc2014ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:08.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.753+0000 7fbc1f59e640 1 --2- 172.21.15.38:0/1868786207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc2006a5e0 0x7fbc2014ddc0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbc1002b9e0 tx=0x7fbc10004730 comp rx=0 tx=0).stop 2023-12-22T08:43:08.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.753+0000 7fbc1f59e640 1 -- 172.21.15.38:0/1868786207 shutdown_connections 2023-12-22T08:43:08.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.753+0000 7fbc1f59e640 1 --2- 172.21.15.38:0/1868786207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc2015d320 0x7fbc200b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.753+0000 7fbc1f59e640 1 --2- 172.21.15.38:0/1868786207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc200b0bc0 0x7fbc200b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.753+0000 7fbc1f59e640 1 --2- 172.21.15.38:0/1868786207 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbc0006a460 0x7fbc0006c920 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.754+0000 7fbc1f59e640 1 --2- 172.21.15.38:0/1868786207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc2006a5e0 0x7fbc2014ddc0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.754+0000 7fbc1f59e640 1 -- 172.21.15.38:0/1868786207 >> 172.21.15.38:0/1868786207 conn(0x7fbc200d1200 msgr2=0x7fbc200b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:08.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.754+0000 7fbc1f59e640 1 -- 172.21.15.38:0/1868786207 shutdown_connections 2023-12-22T08:43:08.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.754+0000 7fbc1f59e640 1 -- 172.21.15.38:0/1868786207 wait complete. 2023-12-22T08:43:08.784 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:43:08.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.970+0000 7fc00d8bd640 1 Processor -- start 2023-12-22T08:43:08.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.970+0000 7fc00d8bd640 1 -- start start 2023-12-22T08:43:08.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.972+0000 7fc00d8bd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc0081547a0 0x7fc00815b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:08.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.972+0000 7fc00d8bd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc008071b90 0x7fc008070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:08.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.972+0000 7fc00d8bd640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0080716a0 con 0x7fc008154b80 2023-12-22T08:43:08.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.972+0000 7fc00d8bd640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0080710e0 con 0x7fc0081547a0 2023-12-22T08:43:08.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.972+0000 7fc00d8bd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0080713c0 con 0x7fc008071b90 2023-12-22T08:43:08.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.973+0000 7fc006ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc0081547a0 0x7fc00815b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:08.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.973+0000 7fc006ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc0081547a0 0x7fc00815b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36510/0 (socket says 172.21.15.38:36510) 2023-12-22T08:43:08.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.973+0000 7fc006ffd640 1 -- 172.21.15.38:0/3044282890 learned_addr learned my addr 172.21.15.38:0/3044282890 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:08.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.973+0000 7fbffe7fc640 1 --2- 172.21.15.38:0/3044282890 >> v2:172.21.15.89:3300/0 conn(0x7fc008071b90 0x7fc008070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:08.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.973+0000 7fc006ffd640 1 -- 172.21.15.38:0/3044282890 >> v2:172.21.15.89:3300/0 conn(0x7fc008071b90 msgr2=0x7fc008070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:08.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.973+0000 7fc006ffd640 1 --2- 172.21.15.38:0/3044282890 >> v2:172.21.15.89:3300/0 conn(0x7fc008071b90 0x7fc008070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.973+0000 7fc006ffd640 1 -- 172.21.15.38:0/3044282890 >> v1:172.21.15.89:6789/0 conn(0x7fc008154b80 legacy=0x7fc0080ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:08.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.973+0000 7fc006ffd640 1 -- 172.21.15.38:0/3044282890 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00815ab00 con 0x7fc0081547a0 2023-12-22T08:43:08.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.974+0000 7fc006ffd640 1 --2- 172.21.15.38:0/3044282890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0081547a0 0x7fc00815b300 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc0080722d0 tx=0x7fbff802e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9d4ff6e5653376 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:08.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.975+0000 7fc0067fc640 1 -- 172.21.15.38:0/3044282890 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff802ea90 con 0x7fc0081547a0 2023-12-22T08:43:08.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.975+0000 7fc0067fc640 1 -- 172.21.15.38:0/3044282890 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff802ebf0 con 0x7fc0081547a0 2023-12-22T08:43:08.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.975+0000 7fc0067fc640 1 -- 172.21.15.38:0/3044282890 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8009600 con 0x7fc0081547a0 2023-12-22T08:43:08.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.975+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3044282890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0081547a0 msgr2=0x7fc00815b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:08.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.975+0000 7fc00d8bd640 1 --2- 172.21.15.38:0/3044282890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0081547a0 0x7fc00815b300 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc0080722d0 tx=0x7fbff802e0f0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.975+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3044282890 shutdown_connections 2023-12-22T08:43:08.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.975+0000 7fc00d8bd640 1 --2- 172.21.15.38:0/3044282890 >> v2:172.21.15.89:3300/0 conn(0x7fc008071b90 0x7fc008070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.975+0000 7fc00d8bd640 1 --2- 172.21.15.38:0/3044282890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0081547a0 0x7fc00815b300 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.975+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3044282890 >> 172.21.15.38:0/3044282890 conn(0x7fc0080cf070 msgr2=0x7fc0080cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:08.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.976+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3044282890 shutdown_connections 2023-12-22T08:43:08.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.976+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3044282890 wait complete. 2023-12-22T08:43:08.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.977+0000 7fc00d8bd640 1 Processor -- start 2023-12-22T08:43:08.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.977+0000 7fc00d8bd640 1 -- start start 2023-12-22T08:43:08.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.978+0000 7fc00d8bd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc008071b90 0x7fc0081ef140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:08.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.978+0000 7fc00d8bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0081547a0 0x7fc0081f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:08.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.978+0000 7fc00d8bd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc008154b80 0x7fc0081596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:08.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.978+0000 7fc00d8bd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080aec60 con 0x7fc008154b80 2023-12-22T08:43:08.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.978+0000 7fc00d8bd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0081ef680 con 0x7fc0081547a0 2023-12-22T08:43:08.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.978+0000 7fc00d8bd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080aef00 con 0x7fc008071b90 2023-12-22T08:43:08.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.979+0000 7fc0077fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc008154b80 0x7fc0081596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:08.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.979+0000 7fc0077fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc008154b80 0x7fc0081596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36526/0 (socket says 172.21.15.38:36526) 2023-12-22T08:43:08.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.979+0000 7fc0077fe640 1 -- 172.21.15.38:0/3521053615 learned_addr learned my addr 172.21.15.38:0/3521053615 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:08.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.979+0000 7fc006ffd640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc008071b90 0x7fc0081ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:08.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.979+0000 7fbffe7fc640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0081547a0 0x7fc0081f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:08.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.979+0000 7fc0077fe640 1 -- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc008071b90 msgr2=0x7fc0081ef140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:08.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.979+0000 7fc0077fe640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc008071b90 0x7fc0081ef140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.979+0000 7fc0077fe640 1 -- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0081547a0 msgr2=0x7fc0081f1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:08.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.979+0000 7fc0077fe640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0081547a0 0x7fc0081f1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:08.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.979+0000 7fc0077fe640 1 -- 172.21.15.38:0/3521053615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff800bd40 con 0x7fc008154b80 2023-12-22T08:43:08.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.979+0000 7fbffe7fc640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0081547a0 0x7fc0081f1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:08.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.980+0000 7fc0077fe640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc008154b80 0x7fc0081596e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc00000b410 tx=0x7fc00000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:08.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.980+0000 7fc004ff9640 1 -- 172.21.15.38:0/3521053615 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000004020 con 0x7fc008154b80 2023-12-22T08:43:08.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.980+0000 7fc004ff9640 1 -- 172.21.15.38:0/3521053615 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc000004180 con 0x7fc008154b80 2023-12-22T08:43:08.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.980+0000 7fc004ff9640 1 -- 172.21.15.38:0/3521053615 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000011630 con 0x7fc008154b80 2023-12-22T08:43:08.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.980+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3521053615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0080af1e0 con 0x7fc008154b80 2023-12-22T08:43:08.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.980+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3521053615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0080af7a0 con 0x7fc008154b80 2023-12-22T08:43:08.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.981+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3521053615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc008061910 con 0x7fc008154b80 2023-12-22T08:43:08.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.982+0000 7fc004ff9640 1 -- 172.21.15.38:0/3521053615 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc000011790 con 0x7fc008154b80 2023-12-22T08:43:08.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.983+0000 7fc004ff9640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbfe806a430 0x7fbfe806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:08.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.983+0000 7fc004ff9640 1 -- 172.21.15.38:0/3521053615 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc000088690 con 0x7fc008154b80 2023-12-22T08:43:08.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.984+0000 7fc006ffd640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbfe806a430 0x7fbfe806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:08.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.985+0000 7fc006ffd640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbfe806a430 0x7fbfe806c8f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbff8037000 tx=0x7fbff8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:08.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:08.988+0000 7fc004ff9640 1 -- 172.21.15.38:0/3521053615 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc000053be0 con 0x7fc008154b80 2023-12-22T08:43:09.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.187+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3521053615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0080cb950 con 0x7fc008154b80 2023-12-22T08:43:09.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.189+0000 7fc004ff9640 1 -- 172.21.15.38:0/3521053615 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16062 (secure 0 0 0) 0x7fc000057200 con 0x7fc008154b80 2023-12-22T08:43:09.190 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:09.191 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":71,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:43:08.735999+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:43:07.088485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-22T08:43:07.718532+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:43:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.192+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbfe806a430 msgr2=0x7fbfe806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.192+0000 7fc00d8bd640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbfe806a430 0x7fbfe806c8f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbff8037000 tx=0x7fbff8032000 comp rx=0 tx=0).stop 2023-12-22T08:43:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.192+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3521053615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc008154b80 msgr2=0x7fc0081596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.192+0000 7fc00d8bd640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc008154b80 0x7fc0081596e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc00000b410 tx=0x7fc00000b8d0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.192+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3521053615 shutdown_connections 2023-12-22T08:43:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.192+0000 7fc00d8bd640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbfe806a430 0x7fbfe806c8f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.192+0000 7fc00d8bd640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc008154b80 0x7fc0081596e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.192+0000 7fc00d8bd640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0081547a0 0x7fc0081f1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.192+0000 7fc00d8bd640 1 --2- 172.21.15.38:0/3521053615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc008071b90 0x7fc0081ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.192+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3521053615 >> 172.21.15.38:0/3521053615 conn(0x7fc0080cf070 msgr2=0x7fc0080ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:09.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.193+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3521053615 shutdown_connections 2023-12-22T08:43:09.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.193+0000 7fc00d8bd640 1 -- 172.21.15.38:0/3521053615 wait complete. 2023-12-22T08:43:09.213 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:43:09.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.422+0000 7fa8cffff640 1 Processor -- start 2023-12-22T08:43:09.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.422+0000 7fa8cffff640 1 -- start start 2023-12-22T08:43:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.423+0000 7fa8cffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa8d0157980 0x7fa8d015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.424+0000 7fa8cffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa8d006d640 0x7fa8d00d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.424+0000 7fa8cffff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d00d1520 con 0x7fa8d00b3ff0 2023-12-22T08:43:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.424+0000 7fa8cffff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d00d1800 con 0x7fa8d006d640 2023-12-22T08:43:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.424+0000 7fa8cffff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d00d1ae0 con 0x7fa8d0157980 2023-12-22T08:43:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.424+0000 7fa8cf7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa8d006d640 0x7fa8d00d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.424+0000 7fa8cf7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa8d006d640 0x7fa8d00d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36542/0 (socket says 172.21.15.38:36542) 2023-12-22T08:43:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.424+0000 7fa8cf7fe640 1 -- 172.21.15.38:0/1884434548 learned_addr learned my addr 172.21.15.38:0/1884434548 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:09.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.424+0000 7fa8ceffd640 1 --2- 172.21.15.38:0/1884434548 >> v2:172.21.15.89:3300/0 conn(0x7fa8d0157980 0x7fa8d015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:09.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.425+0000 7fa8cf7fe640 1 -- 172.21.15.38:0/1884434548 >> v2:172.21.15.89:3300/0 conn(0x7fa8d0157980 msgr2=0x7fa8d015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:09.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.425+0000 7fa8cf7fe640 1 --2- 172.21.15.38:0/1884434548 >> v2:172.21.15.89:3300/0 conn(0x7fa8d0157980 0x7fa8d015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.425+0000 7fa8cf7fe640 1 -- 172.21.15.38:0/1884434548 >> v1:172.21.15.38:6789/0 conn(0x7fa8d00b3ff0 legacy=0x7fa8d006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:09.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.425+0000 7fa8cf7fe640 1 -- 172.21.15.38:0/1884434548 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00d1dc0 con 0x7fa8d006d640 2023-12-22T08:43:09.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.425+0000 7fa8cdffb640 1 -- 172.21.15.38:0/1884434548 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088744171 0 0) 0x7fa8d00d1520 con 0x7fa8d00b3ff0 2023-12-22T08:43:09.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.426+0000 7fa8cf7fe640 1 --2- 172.21.15.38:0/1884434548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8d006d640 0x7fa8d00d25c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00d3df0 tx=0x7fa8c802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b54dc03b31fbdf9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:09.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.426+0000 7fa8cdffb640 1 -- 172.21.15.38:0/1884434548 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8030860 con 0x7fa8d006d640 2023-12-22T08:43:09.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.426+0000 7fa8cdffb640 1 -- 172.21.15.38:0/1884434548 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c80309c0 con 0x7fa8d006d640 2023-12-22T08:43:09.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.426+0000 7fa8cdffb640 1 -- 172.21.15.38:0/1884434548 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8030d50 con 0x7fa8d006d640 2023-12-22T08:43:09.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.427+0000 7fa8cffff640 1 -- 172.21.15.38:0/1884434548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8d006d640 msgr2=0x7fa8d00d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:09.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.427+0000 7fa8cffff640 1 --2- 172.21.15.38:0/1884434548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8d006d640 0x7fa8d00d25c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00d3df0 tx=0x7fa8c802b9a0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.427+0000 7fa8cffff640 1 -- 172.21.15.38:0/1884434548 shutdown_connections 2023-12-22T08:43:09.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.427+0000 7fa8cffff640 1 --2- 172.21.15.38:0/1884434548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8d006d640 0x7fa8d00d25c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.427+0000 7fa8cffff640 1 --2- 172.21.15.38:0/1884434548 >> v2:172.21.15.89:3300/0 conn(0x7fa8d0157980 0x7fa8d015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.427+0000 7fa8cffff640 1 -- 172.21.15.38:0/1884434548 >> 172.21.15.38:0/1884434548 conn(0x7fa8d00d31f0 msgr2=0x7fa8d00d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:09.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.427+0000 7fa8cffff640 1 -- 172.21.15.38:0/1884434548 shutdown_connections 2023-12-22T08:43:09.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.427+0000 7fa8cffff640 1 -- 172.21.15.38:0/1884434548 wait complete. 2023-12-22T08:43:09.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.429+0000 7fa8cffff640 1 Processor -- start 2023-12-22T08:43:09.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.429+0000 7fa8cffff640 1 -- start start 2023-12-22T08:43:09.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.430+0000 7fa8cffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8d006d640 0x7fa8d01f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:09.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.430+0000 7fa8cffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8d00b3ff0 0x7fa8d0158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:09.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.430+0000 7fa8cffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8d0157980 0x7fa8d01590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:09.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.430+0000 7fa8cffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d01f2c00 con 0x7fa8d0157980 2023-12-22T08:43:09.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.430+0000 7fa8cffff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0155b20 con 0x7fa8d00b3ff0 2023-12-22T08:43:09.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.430+0000 7fa8cffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0155e00 con 0x7fa8d006d640 2023-12-22T08:43:09.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.430+0000 7fa8cf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8d0157980 0x7fa8d01590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:09.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.431+0000 7fa8cf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8d0157980 0x7fa8d01590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36556/0 (socket says 172.21.15.38:36556) 2023-12-22T08:43:09.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.431+0000 7fa8cf7fe640 1 -- 172.21.15.38:0/2761194036 learned_addr learned my addr 172.21.15.38:0/2761194036 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:09.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.431+0000 7fa8ceffd640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8d006d640 0x7fa8d01f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:09.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.431+0000 7fa8ce7fc640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8d00b3ff0 0x7fa8d0158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:09.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.431+0000 7fa8cf7fe640 1 -- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8d006d640 msgr2=0x7fa8d01f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:09.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.431+0000 7fa8cf7fe640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8d006d640 0x7fa8d01f26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.431+0000 7fa8cf7fe640 1 -- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8d00b3ff0 msgr2=0x7fa8d0158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.431+0000 7fa8cf7fe640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8d00b3ff0 0x7fa8d0158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.431+0000 7fa8cf7fe640 1 -- 172.21.15.38:0/2761194036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c80094d0 con 0x7fa8d0157980 2023-12-22T08:43:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.431+0000 7fa8ceffd640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8d006d640 0x7fa8d01f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.431+0000 7fa8ce7fc640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8d00b3ff0 0x7fa8d0158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.431+0000 7fa8cf7fe640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8d0157980 0x7fa8d01590d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80090b0 tx=0x7fa8c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.432+0000 7fa8c77fe640 1 -- 172.21.15.38:0/2761194036 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c803e070 con 0x7fa8d0157980 2023-12-22T08:43:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.432+0000 7fa8c77fe640 1 -- 172.21.15.38:0/2761194036 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c8004030 con 0x7fa8d0157980 2023-12-22T08:43:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.432+0000 7fa8cffff640 1 -- 172.21.15.38:0/2761194036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d01560e0 con 0x7fa8d0157980 2023-12-22T08:43:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.432+0000 7fa8c77fe640 1 -- 172.21.15.38:0/2761194036 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80043a0 con 0x7fa8d0157980 2023-12-22T08:43:09.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.432+0000 7fa8cffff640 1 -- 172.21.15.38:0/2761194036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d01566a0 con 0x7fa8d0157980 2023-12-22T08:43:09.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.433+0000 7fa8cffff640 1 -- 172.21.15.38:0/2761194036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d0156890 con 0x7fa8d0157980 2023-12-22T08:43:09.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.434+0000 7fa8c77fe640 1 -- 172.21.15.38:0/2761194036 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa8c8042070 con 0x7fa8d0157980 2023-12-22T08:43:09.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.435+0000 7fa8c77fe640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa8b006a430 0x7fa8b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:09.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.435+0000 7fa8c77fe640 1 -- 172.21.15.38:0/2761194036 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8c80aaba0 con 0x7fa8d0157980 2023-12-22T08:43:09.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.436+0000 7fa8ceffd640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa8b006a430 0x7fa8b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:09.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.437+0000 7fa8ceffd640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa8b006a430 0x7fa8b006c8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0007330 tx=0x7fa8c000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:09.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.441+0000 7fa8c77fe640 1 -- 172.21.15.38:0/2761194036 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa8c80762a0 con 0x7fa8d0157980 2023-12-22T08:43:09.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.634+0000 7fa8cffff640 1 -- 172.21.15.38:0/2761194036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8d0061910 con 0x7fa8d0157980 2023-12-22T08:43:09.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.636+0000 7fa8c77fe640 1 -- 172.21.15.38:0/2761194036 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16062 (secure 0 0 0) 0x7fa8c8034020 con 0x7fa8d0157980 2023-12-22T08:43:09.638 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:09.638 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":71,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:43:08.735999+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:43:07.088485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-22T08:43:07.718532+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:43:09.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.638+0000 7fa8cffff640 1 -- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa8b006a430 msgr2=0x7fa8b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:09.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.638+0000 7fa8cffff640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa8b006a430 0x7fa8b006c8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0007330 tx=0x7fa8c000b040 comp rx=0 tx=0).stop 2023-12-22T08:43:09.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.638+0000 7fa8cffff640 1 -- 172.21.15.38:0/2761194036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8d0157980 msgr2=0x7fa8d01590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:09.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.638+0000 7fa8cffff640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8d0157980 0x7fa8d01590d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80090b0 tx=0x7fa8c80046c0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.639+0000 7fa8cffff640 1 -- 172.21.15.38:0/2761194036 shutdown_connections 2023-12-22T08:43:09.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.639+0000 7fa8cffff640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa8b006a430 0x7fa8b006c8f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.639+0000 7fa8cffff640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8d0157980 0x7fa8d01590d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.639+0000 7fa8cffff640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8d00b3ff0 0x7fa8d0158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.639+0000 7fa8cffff640 1 --2- 172.21.15.38:0/2761194036 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8d006d640 0x7fa8d01f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.639+0000 7fa8cffff640 1 -- 172.21.15.38:0/2761194036 >> 172.21.15.38:0/2761194036 conn(0x7fa8d00d31f0 msgr2=0x7fa8d015c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:09.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.639+0000 7fa8cffff640 1 -- 172.21.15.38:0/2761194036 shutdown_connections 2023-12-22T08:43:09.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.639+0000 7fa8cffff640 1 -- 172.21.15.38:0/2761194036 wait complete. 2023-12-22T08:43:09.660 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T08:43:09.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.887+0000 7fc08cf61640 1 Processor -- start 2023-12-22T08:43:09.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.887+0000 7fc08cf61640 1 -- start start 2023-12-22T08:43:09.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.888+0000 7fc08cf61640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc08815ad90 0x7fc0880caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:09.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.888+0000 7fc08cf61640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc088161bb0 0x7fc0880cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:09.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.888+0000 7fc08cf61640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08815e630 con 0x7fc08815d940 2023-12-22T08:43:09.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.888+0000 7fc08cf61640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0880ce2c0 con 0x7fc088161bb0 2023-12-22T08:43:09.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.888+0000 7fc08cf61640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08815e910 con 0x7fc08815ad90 2023-12-22T08:43:09.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.889+0000 7fc086ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc088161bb0 0x7fc0880cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:09.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.889+0000 7fc086ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc088161bb0 0x7fc0880cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36566/0 (socket says 172.21.15.38:36566) 2023-12-22T08:43:09.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.889+0000 7fc086ffd640 1 -- 172.21.15.38:0/1630324074 learned_addr learned my addr 172.21.15.38:0/1630324074 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:09.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.889+0000 7fc0877fe640 1 --2- 172.21.15.38:0/1630324074 >> v2:172.21.15.89:3300/0 conn(0x7fc08815ad90 0x7fc0880caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:09.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.889+0000 7fc086ffd640 1 -- 172.21.15.38:0/1630324074 >> v2:172.21.15.89:3300/0 conn(0x7fc08815ad90 msgr2=0x7fc0880caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:09.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.889+0000 7fc086ffd640 1 --2- 172.21.15.38:0/1630324074 >> v2:172.21.15.89:3300/0 conn(0x7fc08815ad90 0x7fc0880caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.889+0000 7fc086ffd640 1 -- 172.21.15.38:0/1630324074 >> v1:172.21.15.38:6789/0 conn(0x7fc08815d940 legacy=0x7fc08815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:09.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.889+0000 7fc086ffd640 1 -- 172.21.15.38:0/1630324074 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0881610d0 con 0x7fc088161bb0 2023-12-22T08:43:09.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.889+0000 7fc0877fe640 1 --2- 172.21.15.38:0/1630324074 >> v2:172.21.15.89:3300/0 conn(0x7fc08815ad90 0x7fc0880caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:09.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.890+0000 7fc086ffd640 1 --2- 172.21.15.38:0/1630324074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc088161bb0 0x7fc0880cb410 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc0880d28f0 tx=0x7fc07c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855c5073c9dcb039 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:09.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.891+0000 7fc0867fc640 1 -- 172.21.15.38:0/1630324074 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c030860 con 0x7fc088161bb0 2023-12-22T08:43:09.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.891+0000 7fc0867fc640 1 -- 172.21.15.38:0/1630324074 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c0309c0 con 0x7fc088161bb0 2023-12-22T08:43:09.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.891+0000 7fc0867fc640 1 -- 172.21.15.38:0/1630324074 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c030d50 con 0x7fc088161bb0 2023-12-22T08:43:09.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.891+0000 7fc08cf61640 1 -- 172.21.15.38:0/1630324074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc088161bb0 msgr2=0x7fc0880cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.891+0000 7fc08cf61640 1 --2- 172.21.15.38:0/1630324074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc088161bb0 0x7fc0880cb410 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc0880d28f0 tx=0x7fc07c02b9a0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.891+0000 7fc08cf61640 1 -- 172.21.15.38:0/1630324074 shutdown_connections 2023-12-22T08:43:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.891+0000 7fc08cf61640 1 --2- 172.21.15.38:0/1630324074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc088161bb0 0x7fc0880cb410 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.891+0000 7fc08cf61640 1 --2- 172.21.15.38:0/1630324074 >> v2:172.21.15.89:3300/0 conn(0x7fc08815ad90 0x7fc0880caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.891+0000 7fc08cf61640 1 -- 172.21.15.38:0/1630324074 >> 172.21.15.38:0/1630324074 conn(0x7fc0880d31c0 msgr2=0x7fc0880d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.891+0000 7fc08cf61640 1 -- 172.21.15.38:0/1630324074 shutdown_connections 2023-12-22T08:43:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.891+0000 7fc08cf61640 1 -- 172.21.15.38:0/1630324074 wait complete. 2023-12-22T08:43:09.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.893+0000 7fc08cf61640 1 Processor -- start 2023-12-22T08:43:09.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.893+0000 7fc08cf61640 1 -- start start 2023-12-22T08:43:09.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.894+0000 7fc08cf61640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc08815ad90 0x7fc08815f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.894+0000 7fc08cf61640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc08815d940 0x7fc0880c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.894+0000 7fc08cf61640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc088161bb0 0x7fc0880c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.894+0000 7fc08cf61640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0881f2b50 con 0x7fc08815ad90 2023-12-22T08:43:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.894+0000 7fc08cf61640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08815fd60 con 0x7fc088161bb0 2023-12-22T08:43:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.894+0000 7fc08cf61640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc088160040 con 0x7fc08815d940 2023-12-22T08:43:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.895+0000 7fc0877fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc08815ad90 0x7fc08815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.895+0000 7fc0877fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc08815ad90 0x7fc08815f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36582/0 (socket says 172.21.15.38:36582) 2023-12-22T08:43:09.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.895+0000 7fc0877fe640 1 -- 172.21.15.38:0/1467713296 learned_addr learned my addr 172.21.15.38:0/1467713296 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.895+0000 7fc086ffd640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc08815d940 0x7fc0880c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.895+0000 7fc0877fe640 1 -- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc08815d940 msgr2=0x7fc0880c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.895+0000 7fc0877fe640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc08815d940 0x7fc0880c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.895+0000 7fc087fff640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc088161bb0 0x7fc0880c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.895+0000 7fc0877fe640 1 -- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc088161bb0 msgr2=0x7fc0880c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.895+0000 7fc0877fe640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc088161bb0 0x7fc0880c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:09.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.895+0000 7fc0877fe640 1 -- 172.21.15.38:0/1467713296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c0094d0 con 0x7fc08815ad90 2023-12-22T08:43:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.896+0000 7fc0877fe640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc08815ad90 0x7fc08815f460 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc07800cf60 tx=0x7fc07800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.896+0000 7fc06ffff640 1 -- 172.21.15.38:0/1467713296 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800d840 con 0x7fc08815ad90 2023-12-22T08:43:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.896+0000 7fc06ffff640 1 -- 172.21.15.38:0/1467713296 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07800d9a0 con 0x7fc08815ad90 2023-12-22T08:43:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.896+0000 7fc06ffff640 1 -- 172.21.15.38:0/1467713296 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800dd30 con 0x7fc08815ad90 2023-12-22T08:43:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.896+0000 7fc08cf61640 1 -- 172.21.15.38:0/1467713296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc088160320 con 0x7fc08815ad90 2023-12-22T08:43:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.896+0000 7fc08cf61640 1 -- 172.21.15.38:0/1467713296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08815f9a0 con 0x7fc08815ad90 2023-12-22T08:43:09.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.897+0000 7fc08cf61640 1 -- 172.21.15.38:0/1467713296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc088061910 con 0x7fc08815ad90 2023-12-22T08:43:09.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.898+0000 7fc06ffff640 1 -- 172.21.15.38:0/1467713296 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc078015440 con 0x7fc08815ad90 2023-12-22T08:43:09.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.899+0000 7fc06ffff640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc07406a430 0x7fc07406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:09.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.899+0000 7fc06ffff640 1 -- 172.21.15.38:0/1467713296 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0780893b0 con 0x7fc08815ad90 2023-12-22T08:43:09.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.900+0000 7fc086ffd640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc07406a430 0x7fc07406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:09.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.901+0000 7fc086ffd640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc07406a430 0x7fc07406c8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc07c036000 tx=0x7fc07c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:09.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:09.904+0000 7fc06ffff640 1 -- 172.21.15.38:0/1467713296 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc0780549b0 con 0x7fc08815ad90 2023-12-22T08:43:10.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.137+0000 7fc08cf61640 1 -- 172.21.15.38:0/1467713296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc0881595d0 con 0x7fc08815ad90 2023-12-22T08:43:10.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.759+0000 7fc06ffff640 1 -- 172.21.15.38:0/1467713296 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc078057fd0 con 0x7fc08815ad90 2023-12-22T08:43:10.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.763+0000 7fc08cf61640 1 -- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc07406a430 msgr2=0x7fc07406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:10.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.763+0000 7fc08cf61640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc07406a430 0x7fc07406c8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc07c036000 tx=0x7fc07c03b040 comp rx=0 tx=0).stop 2023-12-22T08:43:10.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.763+0000 7fc08cf61640 1 -- 172.21.15.38:0/1467713296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc08815ad90 msgr2=0x7fc08815f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:10.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.763+0000 7fc08cf61640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc08815ad90 0x7fc08815f460 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc07800cf60 tx=0x7fc07800cf90 comp rx=0 tx=0).stop 2023-12-22T08:43:10.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.763+0000 7fc08cf61640 1 -- 172.21.15.38:0/1467713296 shutdown_connections 2023-12-22T08:43:10.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.763+0000 7fc08cf61640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc088161bb0 0x7fc0880c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:10.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.763+0000 7fc08cf61640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc08815d940 0x7fc0880c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:10.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.763+0000 7fc08cf61640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc07406a430 0x7fc07406c8f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:10.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.763+0000 7fc08cf61640 1 --2- 172.21.15.38:0/1467713296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc08815ad90 0x7fc08815f460 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:10.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.763+0000 7fc08cf61640 1 -- 172.21.15.38:0/1467713296 >> 172.21.15.38:0/1467713296 conn(0x7fc0880d31c0 msgr2=0x7fc088158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:10.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.764+0000 7fc08cf61640 1 -- 172.21.15.38:0/1467713296 shutdown_connections 2023-12-22T08:43:10.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:10.764+0000 7fc08cf61640 1 -- 172.21.15.38:0/1467713296 wait complete. 2023-12-22T08:43:10.788 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T08:43:10.788 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T08:43:11.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.021+0000 7f95b2f30640 1 Processor -- start 2023-12-22T08:43:11.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.021+0000 7f95b2f30640 1 -- start start 2023-12-22T08:43:11.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.023+0000 7f95b2f30640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f95ac160fa0 0x7f95ac0c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:11.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.023+0000 7f95b2f30640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ac161480 con 0x7f95ac06ced0 2023-12-22T08:43:11.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.023+0000 7f95b2f30640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ac161760 con 0x7f95ac146d40 2023-12-22T08:43:11.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.023+0000 7f95b2f30640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ac0ce3f0 con 0x7f95ac160fa0 2023-12-22T08:43:11.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.023+0000 7f95b172d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f95ac160fa0 0x7f95ac0c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:11.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.023+0000 7f95b272f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f95ac06ced0 0x7f95ac0ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34668/0 (socket says 172.21.15.38:34668) 2023-12-22T08:43:11.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.023+0000 7f95b172d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f95ac160fa0 0x7f95ac0c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33842/0 (socket says 172.21.15.38:33842) 2023-12-22T08:43:11.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.023+0000 7f95b272f640 1 -- 172.21.15.38:0/558718319 learned_addr learned my addr 172.21.15.38:0/558718319 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:43:11.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.024+0000 7f95b172d640 1 -- 172.21.15.38:0/558718319 >> v1:172.21.15.89:6789/0 conn(0x7f95ac146d40 legacy=0x7f95ac0b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:11.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.024+0000 7f95b172d640 1 -- 172.21.15.38:0/558718319 >> v1:172.21.15.38:6789/0 conn(0x7f95ac06ced0 legacy=0x7f95ac0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:11.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.024+0000 7f95b172d640 1 -- 172.21.15.38:0/558718319 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac161a40 con 0x7f95ac160fa0 2023-12-22T08:43:11.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.024+0000 7f95b0f2c640 1 -- 172.21.15.38:0/558718319 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609803628 0 0) 0x7f95ac161480 con 0x7f95ac06ced0 2023-12-22T08:43:11.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.025+0000 7f95b172d640 1 --2- 172.21.15.38:0/558718319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac160fa0 0x7f95ac0c96c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0ce530 tx=0x7f959c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13bdccabd4d2b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:11.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.025+0000 7f95b0f2c640 1 -- 172.21.15.38:0/558718319 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c030800 con 0x7f95ac160fa0 2023-12-22T08:43:11.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.025+0000 7f95b0f2c640 1 -- 172.21.15.38:0/558718319 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c030960 con 0x7f95ac160fa0 2023-12-22T08:43:11.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.025+0000 7f95b0f2c640 1 -- 172.21.15.38:0/558718319 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c030cf0 con 0x7f95ac160fa0 2023-12-22T08:43:11.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.026+0000 7f95b2f30640 1 -- 172.21.15.38:0/558718319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac160fa0 msgr2=0x7f95ac0c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:11.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.026+0000 7f95b2f30640 1 --2- 172.21.15.38:0/558718319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac160fa0 0x7f95ac0c96c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0ce530 tx=0x7f959c02b940 comp rx=0 tx=0).stop 2023-12-22T08:43:11.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.026+0000 7f95b2f30640 1 -- 172.21.15.38:0/558718319 shutdown_connections 2023-12-22T08:43:11.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.026+0000 7f95b2f30640 1 --2- 172.21.15.38:0/558718319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac160fa0 0x7f95ac0c96c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:11.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.026+0000 7f95b2f30640 1 -- 172.21.15.38:0/558718319 >> 172.21.15.38:0/558718319 conn(0x7f95ac0d0050 msgr2=0x7f95ac0d0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:11.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.026+0000 7f95b2f30640 1 -- 172.21.15.38:0/558718319 shutdown_connections 2023-12-22T08:43:11.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.026+0000 7f95b2f30640 1 -- 172.21.15.38:0/558718319 wait complete. 2023-12-22T08:43:11.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.028+0000 7f95b2f30640 1 Processor -- start 2023-12-22T08:43:11.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.028+0000 7f95b2f30640 1 -- start start 2023-12-22T08:43:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.029+0000 7f95b2f30640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95ac06ced0 0x7f95ac137ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.029+0000 7f95b2f30640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac146d40 0x7f95ac06f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.029+0000 7f95b2f30640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95ac160fa0 0x7f95ac06f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.029+0000 7f95b2f30640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac138020 con 0x7f95ac146d40 2023-12-22T08:43:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.029+0000 7f95b2f30640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac15b6c0 con 0x7f95ac06ced0 2023-12-22T08:43:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.029+0000 7f95b2f30640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac144420 con 0x7f95ac160fa0 2023-12-22T08:43:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.029+0000 7f95b172d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac146d40 0x7f95ac06f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.029+0000 7f95b172d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac146d40 0x7f95ac06f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33854/0 (socket says 172.21.15.38:33854) 2023-12-22T08:43:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.029+0000 7f95b172d640 1 -- 172.21.15.38:0/1859265247 learned_addr learned my addr 172.21.15.38:0/1859265247 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.030+0000 7f95b1f2e640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95ac06ced0 0x7f95ac137ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.030+0000 7f95b172d640 1 -- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95ac160fa0 msgr2=0x7f95ac06f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:11.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.030+0000 7f95b172d640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95ac160fa0 0x7f95ac06f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:11.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.030+0000 7f95b172d640 1 -- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95ac06ced0 msgr2=0x7f95ac137ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:11.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.030+0000 7f95b172d640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95ac06ced0 0x7f95ac137ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:11.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.030+0000 7f95b172d640 1 -- 172.21.15.38:0/1859265247 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c009400 con 0x7f95ac146d40 2023-12-22T08:43:11.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.030+0000 7f95b1f2e640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95ac06ced0 0x7f95ac137ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:11.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.030+0000 7f95b172d640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac146d40 0x7f95ac06f1d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f959c009890 tx=0x7f959c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.031+0000 7f95a27fc640 1 -- 172.21.15.38:0/1859265247 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c03e070 con 0x7f95ac146d40 2023-12-22T08:43:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.031+0000 7f95a27fc640 1 -- 172.21.15.38:0/1859265247 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c039a60 con 0x7f95ac146d40 2023-12-22T08:43:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.031+0000 7f95a27fc640 1 -- 172.21.15.38:0/1859265247 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c039e10 con 0x7f95ac146d40 2023-12-22T08:43:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.031+0000 7f95b2f30640 1 -- 172.21.15.38:0/1859265247 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ac1428c0 con 0x7f95ac146d40 2023-12-22T08:43:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.031+0000 7f95b2f30640 1 -- 172.21.15.38:0/1859265247 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ac142e80 con 0x7f95ac146d40 2023-12-22T08:43:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.032+0000 7f95b2f30640 1 -- 172.21.15.38:0/1859265247 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ac061910 con 0x7f95ac146d40 2023-12-22T08:43:11.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.033+0000 7f95a27fc640 1 -- 172.21.15.38:0/1859265247 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f959c04b400 con 0x7f95ac146d40 2023-12-22T08:43:11.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.034+0000 7f95a27fc640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959006a460 0x7f959006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:11.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.034+0000 7f95a27fc640 1 -- 172.21.15.38:0/1859265247 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f959c0aaff0 con 0x7f95ac146d40 2023-12-22T08:43:11.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.034+0000 7f95b1f2e640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959006a460 0x7f959006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:11.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.035+0000 7f95b1f2e640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959006a460 0x7f959006c920 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f95a80012e0 tx=0x7f95a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:11.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.038+0000 7f95a27fc640 1 -- 172.21.15.38:0/1859265247 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f959c076670 con 0x7f95ac146d40 2023-12-22T08:43:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:11.271+0000 7f95b2f30640 1 -- 172.21.15.38:0/1859265247 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f95ac13eaa0 con 0x7f95ac146d40 2023-12-22T08:43:12.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.238+0000 7f95a27fc640 1 -- 172.21.15.38:0/1859265247 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f959c079c90 con 0x7f95ac146d40 2023-12-22T08:43:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.241+0000 7f95b2f30640 1 -- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959006a460 msgr2=0x7f959006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.241+0000 7f95b2f30640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959006a460 0x7f959006c920 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f95a80012e0 tx=0x7f95a8009040 comp rx=0 tx=0).stop 2023-12-22T08:43:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.241+0000 7f95b2f30640 1 -- 172.21.15.38:0/1859265247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac146d40 msgr2=0x7f95ac06f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.241+0000 7f95b2f30640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac146d40 0x7f95ac06f1d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f959c009890 tx=0x7f959c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.241+0000 7f95b2f30640 1 -- 172.21.15.38:0/1859265247 shutdown_connections 2023-12-22T08:43:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.241+0000 7f95b2f30640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95ac160fa0 0x7f95ac06f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.241+0000 7f95b2f30640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959006a460 0x7f959006c920 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.242+0000 7f95b2f30640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95ac146d40 0x7f95ac06f1d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.242+0000 7f95b2f30640 1 --2- 172.21.15.38:0/1859265247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95ac06ced0 0x7f95ac137ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.242+0000 7f95b2f30640 1 -- 172.21.15.38:0/1859265247 >> 172.21.15.38:0/1859265247 conn(0x7f95ac0d0050 msgr2=0x7f95ac141a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.242+0000 7f95b2f30640 1 -- 172.21.15.38:0/1859265247 shutdown_connections 2023-12-22T08:43:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.242+0000 7f95b2f30640 1 -- 172.21.15.38:0/1859265247 wait complete. 2023-12-22T08:43:12.266 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T08:43:12.266 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:43:12.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.492+0000 7f4fe2147640 1 Processor -- start 2023-12-22T08:43:12.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.493+0000 7f4fe2147640 1 -- start start 2023-12-22T08:43:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.494+0000 7f4fe2147640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fdc146be0 0x7f4fdc0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.494+0000 7f4fe2147640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4fdc15e6c0 0x7f4fdc0d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.494+0000 7f4fe2147640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fdc15eac0 con 0x7f4fdc146fc0 2023-12-22T08:43:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.494+0000 7f4fe2147640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fdc0d1b70 con 0x7f4fdc146be0 2023-12-22T08:43:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.494+0000 7f4fe2147640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fdc15ed10 con 0x7f4fdc15e6c0 2023-12-22T08:43:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.495+0000 7f4fdb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fdc146be0 0x7f4fdc0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.495+0000 7f4fdb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fdc146be0 0x7f4fdc0d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33868/0 (socket says 172.21.15.38:33868) 2023-12-22T08:43:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.495+0000 7f4fdb7fe640 1 -- 172.21.15.38:0/3969855856 learned_addr learned my addr 172.21.15.38:0/3969855856 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:12.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.495+0000 7f4fdb7fe640 1 -- 172.21.15.38:0/3969855856 >> v2:172.21.15.89:3300/0 conn(0x7f4fdc15e6c0 msgr2=0x7f4fdc0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:12.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.495+0000 7f4fdb7fe640 1 --2- 172.21.15.38:0/3969855856 >> v2:172.21.15.89:3300/0 conn(0x7f4fdc15e6c0 0x7f4fdc0d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.495+0000 7f4fdb7fe640 1 -- 172.21.15.38:0/3969855856 >> v1:172.21.15.38:6789/0 conn(0x7f4fdc146fc0 legacy=0x7f4fdc15dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:12.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.495+0000 7f4fdb7fe640 1 -- 172.21.15.38:0/3969855856 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc162200 con 0x7f4fdc146be0 2023-12-22T08:43:12.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.496+0000 7f4fdb7fe640 1 --2- 172.21.15.38:0/3969855856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fdc146be0 0x7f4fdc0d10f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc06bec0 tx=0x7f4fcc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43111d3b24e8ef72 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:12.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.497+0000 7f4fda7fc640 1 -- 172.21.15.38:0/3969855856 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc030860 con 0x7f4fdc146be0 2023-12-22T08:43:12.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.497+0000 7f4fda7fc640 1 -- 172.21.15.38:0/3969855856 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc0309c0 con 0x7f4fdc146be0 2023-12-22T08:43:12.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.497+0000 7f4fda7fc640 1 -- 172.21.15.38:0/3969855856 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc030d50 con 0x7f4fdc146be0 2023-12-22T08:43:12.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.497+0000 7f4fe2147640 1 -- 172.21.15.38:0/3969855856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fdc146be0 msgr2=0x7f4fdc0d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:12.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.497+0000 7f4fe2147640 1 --2- 172.21.15.38:0/3969855856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fdc146be0 0x7f4fdc0d10f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc06bec0 tx=0x7f4fcc02b9a0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.498+0000 7f4fe2147640 1 -- 172.21.15.38:0/3969855856 shutdown_connections 2023-12-22T08:43:12.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.498+0000 7f4fe2147640 1 --2- 172.21.15.38:0/3969855856 >> v2:172.21.15.89:3300/0 conn(0x7f4fdc15e6c0 0x7f4fdc0d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.498+0000 7f4fe2147640 1 --2- 172.21.15.38:0/3969855856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fdc146be0 0x7f4fdc0d10f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.498+0000 7f4fe2147640 1 -- 172.21.15.38:0/3969855856 >> 172.21.15.38:0/3969855856 conn(0x7f4fdc06c5e0 msgr2=0x7f4fdc06c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:12.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.498+0000 7f4fe2147640 1 -- 172.21.15.38:0/3969855856 shutdown_connections 2023-12-22T08:43:12.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.498+0000 7f4fe2147640 1 -- 172.21.15.38:0/3969855856 wait complete. 2023-12-22T08:43:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.499+0000 7f4fe2147640 1 Processor -- start 2023-12-22T08:43:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.500+0000 7f4fe2147640 1 -- start start 2023-12-22T08:43:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.500+0000 7f4fe2147640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fdc146be0 0x7f4fdc0cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fe2147640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fdc146fc0 0x7f4fdc157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fe2147640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fdc15e6c0 0x7f4fdc0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fe2147640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc1445b0 con 0x7f4fdc146fc0 2023-12-22T08:43:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fe2147640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc0cdc30 con 0x7f4fdc15e6c0 2023-12-22T08:43:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fe2147640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc0cee00 con 0x7f4fdc146be0 2023-12-22T08:43:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fdaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fdc146fc0 0x7f4fdc157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fdaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fdc146fc0 0x7f4fdc157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33880/0 (socket says 172.21.15.38:33880) 2023-12-22T08:43:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fdaffd640 1 -- 172.21.15.38:0/157744625 learned_addr learned my addr 172.21.15.38:0/157744625 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fdb7fe640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fdc146be0 0x7f4fdc0cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fdbfff640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fdc15e6c0 0x7f4fdc0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fdaffd640 1 -- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fdc146be0 msgr2=0x7f4fdc0cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fdaffd640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fdc146be0 0x7f4fdc0cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fdaffd640 1 -- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fdc15e6c0 msgr2=0x7f4fdc0ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fdaffd640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fdc15e6c0 0x7f4fdc0ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fdaffd640 1 -- 172.21.15.38:0/157744625 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc0094d0 con 0x7f4fdc146fc0 2023-12-22T08:43:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.501+0000 7f4fdbfff640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fdc15e6c0 0x7f4fdc0ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.502+0000 7f4fdaffd640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fdc146fc0 0x7f4fdc157d20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000c480 tx=0x7f4fd000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.502+0000 7f4fc3fff640 1 -- 172.21.15.38:0/157744625 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00052d0 con 0x7f4fdc146fc0 2023-12-22T08:43:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.502+0000 7f4fc3fff640 1 -- 172.21.15.38:0/157744625 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd0005430 con 0x7f4fdc146fc0 2023-12-22T08:43:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.502+0000 7f4fc3fff640 1 -- 172.21.15.38:0/157744625 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0012870 con 0x7f4fdc146fc0 2023-12-22T08:43:12.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.502+0000 7f4fe2147640 1 -- 172.21.15.38:0/157744625 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fdc0cd020 con 0x7f4fdc146fc0 2023-12-22T08:43:12.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.502+0000 7f4fe2147640 1 -- 172.21.15.38:0/157744625 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fdc0cd5e0 con 0x7f4fdc146fc0 2023-12-22T08:43:12.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.503+0000 7f4fe2147640 1 -- 172.21.15.38:0/157744625 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fdc158390 con 0x7f4fdc146fc0 2023-12-22T08:43:12.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.504+0000 7f4fc3fff640 1 -- 172.21.15.38:0/157744625 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4fd00129d0 con 0x7f4fdc146fc0 2023-12-22T08:43:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.505+0000 7f4fc3fff640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4fc806a430 0x7f4fc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.505+0000 7f4fc3fff640 1 -- 172.21.15.38:0/157744625 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fd00884c0 con 0x7f4fdc146fc0 2023-12-22T08:43:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.506+0000 7f4fdb7fe640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4fc806a430 0x7f4fc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:12.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.507+0000 7f4fdb7fe640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4fc806a430 0x7f4fc806c8f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc036000 tx=0x7f4fcc03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:12.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.510+0000 7f4fc3fff640 1 -- 172.21.15.38:0/157744625 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4fdc158390 con 0x7f4fdc146fc0 2023-12-22T08:43:12.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.739+0000 7f4fe2147640 1 -- 172.21.15.38:0/157744625 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fdc158390 con 0x7f4fdc146fc0 2023-12-22T08:43:12.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.740+0000 7f4fc3fff640 1 -- 172.21.15.38:0/157744625 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4645 (secure 0 0 0) 0x7f4fdc158390 con 0x7f4fdc146fc0 2023-12-22T08:43:12.742 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:12.742 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3287488986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3287488986},{"type":"v1","addr":"172.21.15.89:6836","nonce":3287488986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2154639115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2154639115},{"type":"v1","addr":"172.21.15.89:6837","nonce":2154639115}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/807798598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":807798598},{"type":"v1","addr":"172.21.15.38:6833","nonce":807798598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:43:08.736828+0000","modified":"2023-12-22T08:43:12.231629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1778808252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1778808252},{"type":"v1","addr":"172.21.15.38:6835","nonce":1778808252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-22T08:43:12.742 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 32 2023-12-22T08:43:12.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.742+0000 7f4fe2147640 1 -- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4fc806a430 msgr2=0x7f4fc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:12.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.742+0000 7f4fe2147640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4fc806a430 0x7f4fc806c8f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc036000 tx=0x7f4fcc03b040 comp rx=0 tx=0).stop 2023-12-22T08:43:12.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.742+0000 7f4fe2147640 1 -- 172.21.15.38:0/157744625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fdc146fc0 msgr2=0x7f4fdc157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:12.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.742+0000 7f4fe2147640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fdc146fc0 0x7f4fdc157d20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000c480 tx=0x7f4fd000c940 comp rx=0 tx=0).stop 2023-12-22T08:43:12.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.743+0000 7f4fe2147640 1 -- 172.21.15.38:0/157744625 shutdown_connections 2023-12-22T08:43:12.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.743+0000 7f4fe2147640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fdc15e6c0 0x7f4fdc0ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.743+0000 7f4fe2147640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4fc806a430 0x7f4fc806c8f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.743+0000 7f4fe2147640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fdc146fc0 0x7f4fdc157d20 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.743+0000 7f4fe2147640 1 --2- 172.21.15.38:0/157744625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fdc146be0 0x7f4fdc0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.743+0000 7f4fe2147640 1 -- 172.21.15.38:0/157744625 >> 172.21.15.38:0/157744625 conn(0x7f4fdc06c5e0 msgr2=0x7f4fdc0b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:12.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.743+0000 7f4fe2147640 1 -- 172.21.15.38:0/157744625 shutdown_connections 2023-12-22T08:43:12.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.743+0000 7f4fe2147640 1 -- 172.21.15.38:0/157744625 wait complete. 2023-12-22T08:43:12.765 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:43:12.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.988+0000 7fd0298fa640 1 Processor -- start 2023-12-22T08:43:12.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.989+0000 7fd0298fa640 1 -- start start 2023-12-22T08:43:12.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.990+0000 7fd0298fa640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0240b3ff0 0x7fd02406cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:12.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.990+0000 7fd0298fa640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd02415f220 con 0x7fd024157980 2023-12-22T08:43:12.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.991+0000 7fd0298fa640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0240d1520 con 0x7fd0240b4470 2023-12-22T08:43:12.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.991+0000 7fd0298fa640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240d1800 con 0x7fd0240b3ff0 2023-12-22T08:43:12.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.991+0000 7fd0288f8640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd024157980 0x7fd02415eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34694/0 (socket says 172.21.15.38:34694) 2023-12-22T08:43:12.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.991+0000 7fd0288f8640 1 -- 172.21.15.38:0/1804677701 learned_addr learned my addr 172.21.15.38:0/1804677701 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:43:12.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.991+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714985948 0 0) 0x7fd02415f220 con 0x7fd024157980 2023-12-22T08:43:12.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.991+0000 7fd01bfff640 1 --2- 172.21.15.38:0/1804677701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0240b3ff0 0x7fd02406cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:12.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.991+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd00c003520 con 0x7fd024157980 2023-12-22T08:43:12.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 291093262 0 0) 0x7fd00c003520 con 0x7fd024157980 2023-12-22T08:43:12.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0240b3ff0 msgr2=0x7fd02406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:12.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01b7fe640 1 --2- 172.21.15.38:0/1804677701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0240b3ff0 0x7fd02406cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 >> v1:172.21.15.89:6789/0 conn(0x7fd0240b4470 legacy=0x7fd0240d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:12.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0240d1ae0 con 0x7fd024157980 2023-12-22T08:43:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fd0200019f0 con 0x7fd024157980 2023-12-22T08:43:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 >> v1:172.21.15.38:6789/0 conn(0x7fd024157980 legacy=0x7fd02415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01b7fe640 1 --2- 172.21.15.38:0/1804677701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0240b3ff0 0x7fd00c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01b7fe640 1 --2- 172.21.15.38:0/1804677701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00c004020 0x7fd00c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01b7fe640 1 --2- 172.21.15.38:0/1804677701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd00c004d00 0x7fd00c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240d1800 con 0x7fd00c004020 2023-12-22T08:43:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c00bbc0 con 0x7fd00c004d00 2023-12-22T08:43:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c00bd80 con 0x7fd0240b3ff0 2023-12-22T08:43:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd01bfff640 1 --2- 172.21.15.38:0/1804677701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00c004020 0x7fd00c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd0288f8640 1 --2- 172.21.15.38:0/1804677701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0240b3ff0 0x7fd00c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.992+0000 7fd0290f9640 1 --2- 172.21.15.38:0/1804677701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd00c004d00 0x7fd00c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.993+0000 7fd01bfff640 1 -- 172.21.15.38:0/1804677701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0240b3ff0 msgr2=0x7fd00c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.993+0000 7fd01bfff640 1 --2- 172.21.15.38:0/1804677701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0240b3ff0 0x7fd00c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.993+0000 7fd01bfff640 1 -- 172.21.15.38:0/1804677701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd00c004d00 msgr2=0x7fd00c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:12.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.993+0000 7fd01bfff640 1 --2- 172.21.15.38:0/1804677701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd00c004d00 0x7fd00c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.993+0000 7fd01bfff640 1 -- 172.21.15.38:0/1804677701 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c003520 con 0x7fd00c004020 2023-12-22T08:43:12.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.993+0000 7fd0290f9640 1 --2- 172.21.15.38:0/1804677701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd00c004d00 0x7fd00c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:12.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.994+0000 7fd01bfff640 1 --2- 172.21.15.38:0/1804677701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00c004020 0x7fd00c0047c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd01400ba30 tx=0x7fd00c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce65a793ae5c6b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:12.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.994+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014032640 con 0x7fd00c004020 2023-12-22T08:43:12.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.994+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0140327a0 con 0x7fd00c004020 2023-12-22T08:43:12.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.994+0000 7fd01b7fe640 1 -- 172.21.15.38:0/1804677701 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014032b30 con 0x7fd00c004020 2023-12-22T08:43:12.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.995+0000 7fd0298fa640 1 -- 172.21.15.38:0/1804677701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00c004020 msgr2=0x7fd00c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:12.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.995+0000 7fd0298fa640 1 --2- 172.21.15.38:0/1804677701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00c004020 0x7fd00c0047c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd01400ba30 tx=0x7fd00c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:43:12.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.995+0000 7fd0290f9640 1 -- 172.21.15.38:0/1804677701 reap_dead start 2023-12-22T08:43:12.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.995+0000 7fd0298fa640 1 -- 172.21.15.38:0/1804677701 shutdown_connections 2023-12-22T08:43:12.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.995+0000 7fd0298fa640 1 -- 172.21.15.38:0/1804677701 >> 172.21.15.38:0/1804677701 conn(0x7fd0240d31f0 msgr2=0x7fd0240d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:12.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.995+0000 7fd0298fa640 1 -- 172.21.15.38:0/1804677701 shutdown_connections 2023-12-22T08:43:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.995+0000 7fd0298fa640 1 -- 172.21.15.38:0/1804677701 wait complete. 2023-12-22T08:43:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.997+0000 7fd0298fa640 1 Processor -- start 2023-12-22T08:43:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.997+0000 7fd0298fa640 1 -- start start 2023-12-22T08:43:13.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.998+0000 7fd0298fa640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd024156230 0x7fd0240b7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.998+0000 7fd0298fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0240b7980 0x7fd024143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.998+0000 7fd0298fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024156610 0x7fd024143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.998+0000 7fd0298fa640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240b8170 con 0x7fd0240b7980 2023-12-22T08:43:13.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.998+0000 7fd0298fa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd024158110 con 0x7fd024156610 2023-12-22T08:43:13.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.998+0000 7fd0298fa640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240b7e90 con 0x7fd024156230 2023-12-22T08:43:13.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.998+0000 7fd01bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0240b7980 0x7fd024143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.998+0000 7fd01bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0240b7980 0x7fd024143810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33904/0 (socket says 172.21.15.38:33904) 2023-12-22T08:43:13.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.998+0000 7fd01bfff640 1 -- 172.21.15.38:0/3117596675 learned_addr learned my addr 172.21.15.38:0/3117596675 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:13.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd0290f9640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024156610 0x7fd024143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd0288f8640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd024156230 0x7fd0240b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd01bfff640 1 -- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd024156230 msgr2=0x7fd0240b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd01bfff640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd024156230 0x7fd0240b7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd01bfff640 1 -- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024156610 msgr2=0x7fd024143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd01bfff640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024156610 0x7fd024143d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd01bfff640 1 -- 172.21.15.38:0/3117596675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0241583b0 con 0x7fd0240b7980 2023-12-22T08:43:13.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd0290f9640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024156610 0x7fd024143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:13.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd01bfff640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0240b7980 0x7fd024143810 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd01400bb50 tx=0x7fd014004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:13.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd0197fa640 1 -- 172.21.15.38:0/3117596675 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01403c9c0 con 0x7fd0240b7980 2023-12-22T08:43:13.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd0197fa640 1 -- 172.21.15.38:0/3117596675 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01403cb20 con 0x7fd0240b7980 2023-12-22T08:43:13.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd0197fa640 1 -- 172.21.15.38:0/3117596675 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01403ce90 con 0x7fd0240b7980 2023-12-22T08:43:13.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd0298fa640 1 -- 172.21.15.38:0/3117596675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd024158690 con 0x7fd0240b7980 2023-12-22T08:43:13.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:12.999+0000 7fd0298fa640 1 -- 172.21.15.38:0/3117596675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0240b69a0 con 0x7fd0240b7980 2023-12-22T08:43:13.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.001+0000 7fd0298fa640 1 -- 172.21.15.38:0/3117596675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd024157f70 con 0x7fd0240b7980 2023-12-22T08:43:13.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.002+0000 7fd0197fa640 1 -- 172.21.15.38:0/3117596675 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd014030410 con 0x7fd0240b7980 2023-12-22T08:43:13.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.003+0000 7fd0197fa640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd01006a460 0x7fd01006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.003+0000 7fd0197fa640 1 -- 172.21.15.38:0/3117596675 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0140ab370 con 0x7fd0240b7980 2023-12-22T08:43:13.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.003+0000 7fd0288f8640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd01006a460 0x7fd01006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.004+0000 7fd0288f8640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd01006a460 0x7fd01006c920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd020001ad0 tx=0x7fd020001250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:13.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.008+0000 7fd0197fa640 1 -- 172.21.15.38:0/3117596675 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd024157f70 con 0x7fd0240b7980 2023-12-22T08:43:13.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.200+0000 7fd0298fa640 1 -- 172.21.15.38:0/3117596675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd024157f70 con 0x7fd0240b7980 2023-12-22T08:43:13.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.203+0000 7fd0197fa640 1 -- 172.21.15.38:0/3117596675 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16049 (secure 0 0 0) 0x7fd024157f70 con 0x7fd0240b7980 2023-12-22T08:43:13.205 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:13.205 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":72,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:43:09.742880+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:43:07.088485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-22T08:43:07.718532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:43:13.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.205+0000 7fd0298fa640 1 -- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd01006a460 msgr2=0x7fd01006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.205+0000 7fd0298fa640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd01006a460 0x7fd01006c920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd020001ad0 tx=0x7fd020001250 comp rx=0 tx=0).stop 2023-12-22T08:43:13.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.205+0000 7fd0298fa640 1 -- 172.21.15.38:0/3117596675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0240b7980 msgr2=0x7fd024143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.205+0000 7fd0298fa640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0240b7980 0x7fd024143810 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd01400bb50 tx=0x7fd014004730 comp rx=0 tx=0).stop 2023-12-22T08:43:13.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.205+0000 7fd0298fa640 1 -- 172.21.15.38:0/3117596675 shutdown_connections 2023-12-22T08:43:13.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.205+0000 7fd0298fa640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd024156610 0x7fd024143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.205+0000 7fd0298fa640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd01006a460 0x7fd01006c920 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.205+0000 7fd0298fa640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0240b7980 0x7fd024143810 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.205+0000 7fd0298fa640 1 --2- 172.21.15.38:0/3117596675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd024156230 0x7fd0240b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.205+0000 7fd0298fa640 1 -- 172.21.15.38:0/3117596675 >> 172.21.15.38:0/3117596675 conn(0x7fd0240d31f0 msgr2=0x7fd02406ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:13.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.205+0000 7fd0298fa640 1 -- 172.21.15.38:0/3117596675 shutdown_connections 2023-12-22T08:43:13.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.205+0000 7fd0298fa640 1 -- 172.21.15.38:0/3117596675 wait complete. 2023-12-22T08:43:13.225 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T08:43:13.225 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:43:13.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.433+0000 7f52a3500640 1 Processor -- start 2023-12-22T08:43:13.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.434+0000 7f52a3500640 1 -- start start 2023-12-22T08:43:13.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.435+0000 7f52a3500640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f529c15d500 0x7f529c0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.435+0000 7f52a3500640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f529c0b44e0 0x7f529c0b8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.435+0000 7f52a3500640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529c071640 con 0x7f529c071130 2023-12-22T08:43:13.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.435+0000 7f52a3500640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529c06c8f0 con 0x7f529c15d500 2023-12-22T08:43:13.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.435+0000 7f52a3500640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529c071920 con 0x7f529c0b44e0 2023-12-22T08:43:13.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.436+0000 7f52a129c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f529c15d500 0x7f529c0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.436+0000 7f52a129c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f529c15d500 0x7f529c0b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33906/0 (socket says 172.21.15.38:33906) 2023-12-22T08:43:13.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.436+0000 7f52a129c640 1 -- 172.21.15.38:0/1626963174 learned_addr learned my addr 172.21.15.38:0/1626963174 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:13.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.436+0000 7f52a1a9d640 1 --1- 172.21.15.38:0/1626963174 >> v1:172.21.15.38:6789/0 conn(0x7f529c071130 0x7f529c1611d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34708/0 (socket says 172.21.15.38:34708) 2023-12-22T08:43:13.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.436+0000 7f52a0a9b640 1 --2- 172.21.15.38:0/1626963174 >> v2:172.21.15.89:3300/0 conn(0x7f529c0b44e0 0x7f529c0b8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.436+0000 7f52a129c640 1 -- 172.21.15.38:0/1626963174 >> v2:172.21.15.89:3300/0 conn(0x7f529c0b44e0 msgr2=0x7f529c0b8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:13.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.436+0000 7f52a129c640 1 --2- 172.21.15.38:0/1626963174 >> v2:172.21.15.89:3300/0 conn(0x7f529c0b44e0 0x7f529c0b8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.436+0000 7f52a129c640 1 -- 172.21.15.38:0/1626963174 >> v1:172.21.15.38:6789/0 conn(0x7f529c071130 legacy=0x7f529c1611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.436+0000 7f52a129c640 1 -- 172.21.15.38:0/1626963174 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c071c00 con 0x7f529c15d500 2023-12-22T08:43:13.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.436+0000 7f529bfff640 1 -- 172.21.15.38:0/1626963174 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217780452 0 0) 0x7f529c071640 con 0x7f529c071130 2023-12-22T08:43:13.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.438+0000 7f52a129c640 1 --2- 172.21.15.38:0/1626963174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f529c15d500 0x7f529c0b3fa0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f529c0b3450 tx=0x7f529002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfb950887fe2704 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:13.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.438+0000 7f529bfff640 1 -- 172.21.15.38:0/1626963174 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529002ca80 con 0x7f529c15d500 2023-12-22T08:43:13.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.438+0000 7f529bfff640 1 -- 172.21.15.38:0/1626963174 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529002cbe0 con 0x7f529c15d500 2023-12-22T08:43:13.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.438+0000 7f529bfff640 1 -- 172.21.15.38:0/1626963174 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900343f0 con 0x7f529c15d500 2023-12-22T08:43:13.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.438+0000 7f52a3500640 1 -- 172.21.15.38:0/1626963174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f529c15d500 msgr2=0x7f529c0b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.438+0000 7f52a3500640 1 --2- 172.21.15.38:0/1626963174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f529c15d500 0x7f529c0b3fa0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f529c0b3450 tx=0x7f529002bee0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.439+0000 7f52a3500640 1 -- 172.21.15.38:0/1626963174 shutdown_connections 2023-12-22T08:43:13.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.439+0000 7f52a3500640 1 --2- 172.21.15.38:0/1626963174 >> v2:172.21.15.89:3300/0 conn(0x7f529c0b44e0 0x7f529c0b8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.439+0000 7f52a3500640 1 --2- 172.21.15.38:0/1626963174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f529c15d500 0x7f529c0b3fa0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.439+0000 7f52a3500640 1 -- 172.21.15.38:0/1626963174 >> 172.21.15.38:0/1626963174 conn(0x7f529c0cfea0 msgr2=0x7f529c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:13.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.439+0000 7f52a3500640 1 -- 172.21.15.38:0/1626963174 shutdown_connections 2023-12-22T08:43:13.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.439+0000 7f52a3500640 1 -- 172.21.15.38:0/1626963174 wait complete. 2023-12-22T08:43:13.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.440+0000 7f52a3500640 1 Processor -- start 2023-12-22T08:43:13.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.441+0000 7f52a3500640 1 -- start start 2023-12-22T08:43:13.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.441+0000 7f52a3500640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f529c071130 0x7f529c1f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.441+0000 7f52a3500640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f529c0b44e0 0x7f529c15eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a3500640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f529c15d500 0x7f529c0d1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a3500640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c1f47d0 con 0x7f529c15d500 2023-12-22T08:43:13.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a3500640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c1f4ab0 con 0x7f529c0b44e0 2023-12-22T08:43:13.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a3500640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529c1f4d90 con 0x7f529c071130 2023-12-22T08:43:13.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a1a9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f529c15d500 0x7f529c0d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a1a9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f529c15d500 0x7f529c0d1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33914/0 (socket says 172.21.15.38:33914) 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a1a9d640 1 -- 172.21.15.38:0/1575545803 learned_addr learned my addr 172.21.15.38:0/1575545803 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a129c640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f529c071130 0x7f529c1f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a0a9b640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f529c0b44e0 0x7f529c15eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a1a9d640 1 -- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f529c071130 msgr2=0x7f529c1f6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a1a9d640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f529c071130 0x7f529c1f6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a1a9d640 1 -- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f529c0b44e0 msgr2=0x7f529c15eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a1a9d640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f529c0b44e0 0x7f529c15eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a1a9d640 1 -- 172.21.15.38:0/1575545803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5290009b30 con 0x7f529c15d500 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.442+0000 7f52a0a9b640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f529c0b44e0 0x7f529c15eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.443+0000 7f52a1a9d640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f529c15d500 0x7f529c0d1860 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5294001eb0 tx=0x7f529400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.443+0000 7f5299ffb640 1 -- 172.21.15.38:0/1575545803 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52940074e0 con 0x7f529c15d500 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.443+0000 7f5299ffb640 1 -- 172.21.15.38:0/1575545803 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5294007640 con 0x7f529c15d500 2023-12-22T08:43:13.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.443+0000 7f5299ffb640 1 -- 172.21.15.38:0/1575545803 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5294004a00 con 0x7f529c15d500 2023-12-22T08:43:13.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.443+0000 7f52a3500640 1 -- 172.21.15.38:0/1575545803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c1f5070 con 0x7f529c15d500 2023-12-22T08:43:13.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.443+0000 7f52a3500640 1 -- 172.21.15.38:0/1575545803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c15f040 con 0x7f529c15d500 2023-12-22T08:43:13.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.444+0000 7f52a3500640 1 -- 172.21.15.38:0/1575545803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529c061910 con 0x7f529c15d500 2023-12-22T08:43:13.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.446+0000 7f5299ffb640 1 -- 172.21.15.38:0/1575545803 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5294004b60 con 0x7f529c15d500 2023-12-22T08:43:13.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.446+0000 7f5299ffb640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f528006a430 0x7f528006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.447+0000 7f5299ffb640 1 -- 172.21.15.38:0/1575545803 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5294088760 con 0x7f529c15d500 2023-12-22T08:43:13.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.447+0000 7f52a129c640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f528006a430 0x7f528006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.448+0000 7f52a129c640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f528006a430 0x7f528006c8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5290035000 tx=0x7f5290030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:13.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.451+0000 7f5299ffb640 1 -- 172.21.15.38:0/1575545803 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5294057740 con 0x7f529c15d500 2023-12-22T08:43:13.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.639+0000 7f52a3500640 1 -- 172.21.15.38:0/1575545803 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f529c071ee0 con 0x7f528006a430 2023-12-22T08:43:13.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.664+0000 7f5299ffb640 1 -- 172.21.15.38:0/1575545803 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279302 (secure 0 0 0) 0x7f5290044090 con 0x7f528006a430 2023-12-22T08:43:13.670 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:13.672 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:43:13.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.670+0000 7f52a3500640 1 -- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f528006a430 msgr2=0x7f528006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.670+0000 7f52a3500640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f528006a430 0x7f528006c8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5290035000 tx=0x7f5290030000 comp rx=0 tx=0).stop 2023-12-22T08:43:13.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.670+0000 7f52a3500640 1 -- 172.21.15.38:0/1575545803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f529c15d500 msgr2=0x7f529c0d1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.670+0000 7f52a3500640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f529c15d500 0x7f529c0d1860 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5294001eb0 tx=0x7f529400c870 comp rx=0 tx=0).stop 2023-12-22T08:43:13.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.671+0000 7f52a3500640 1 -- 172.21.15.38:0/1575545803 shutdown_connections 2023-12-22T08:43:13.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.671+0000 7f52a3500640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f528006a430 0x7f528006c8f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.671+0000 7f52a3500640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f529c15d500 0x7f529c0d1860 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.671+0000 7f52a3500640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f529c0b44e0 0x7f529c15eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.671+0000 7f52a3500640 1 --2- 172.21.15.38:0/1575545803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f529c071130 0x7f529c1f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.671+0000 7f52a3500640 1 -- 172.21.15.38:0/1575545803 >> 172.21.15.38:0/1575545803 conn(0x7f529c0cfea0 msgr2=0x7f529c06df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:13.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.671+0000 7f52a3500640 1 -- 172.21.15.38:0/1575545803 shutdown_connections 2023-12-22T08:43:13.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.671+0000 7f52a3500640 1 -- 172.21.15.38:0/1575545803 wait complete. 2023-12-22T08:43:13.693 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2023-12-22T08:43:12.421961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3940,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558559,"statfs":{"total":1600000000,"available":1595964629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.224016"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.232117+0000","last_change":"2023-12-22T08:43:08.232117+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.232117+0000","last_undegraded":"2023-12-22T08:43:08.232117+0000","last_fullsized":"2023-12-22T08:43:08.232117+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:19.778557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.227171+0000","last_change":"2023-12-22T08:43:08.227171+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.227171+0000","last_undegraded":"2023-12-22T08:43:08.227171+0000","last_fullsized":"2023-12-22T08:43:08.227171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:38.767539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.225229+0000","last_change":"2023-12-22T08:43:08.225229+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.225229+0000","last_undegraded":"2023-12-22T08:43:08.225229+0000","last_fullsized":"2023-12-22T08:43:08.225229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:16:21.250428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.235639+0000","last_change":"2023-12-22T08:43:08.235639+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.235639+0000","last_undegraded":"2023-12-22T08:43:08.235639+0000","last_fullsized":"2023-12-22T08:43:08.235639+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:39:28.695272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.242787+0000","last_change":"2023-12-22T08:43:08.242787+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.242787+0000","last_undegraded":"2023-12-22T08:43:08.242787+0000","last_fullsized":"2023-12-22T08:43:08.242787+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:53.820355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.231250+0000","last_change":"2023-12-22T08:43:08.231250+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.231250+0000","last_undegraded":"2023-12-22T08:43:08.231250+0000","last_fullsized":"2023-12-22T08:43:08.231250+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:08.268339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.235566+0000","last_change":"2023-12-22T08:43:08.235566+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.235566+0000","last_undegraded":"2023-12-22T08:43:08.235566+0000","last_fullsized":"2023-12-22T08:43:08.235566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:41:04.613813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.223909+0000","last_change":"2023-12-22T08:43:08.223909+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.223909+0000","last_undegraded":"2023-12-22T08:43:08.223909+0000","last_fullsized":"2023-12-22T08:43:08.223909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:17.538382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.234212+0000","last_change":"2023-12-22T08:43:08.234212+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.234212+0000","last_undegraded":"2023-12-22T08:43:08.234212+0000","last_fullsized":"2023-12-22T08:43:08.234212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:50.001477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.242266+0000","last_change":"2023-12-22T08:43:08.242266+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.242266+0000","last_undegraded":"2023-12-22T08:43:08.242266+0000","last_fullsized":"2023-12-22T08:43:08.242266+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:25.938446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.227157+0000","last_change":"2023-12-22T08:43:08.227157+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.227157+0000","last_undegraded":"2023-12-22T08:43:08.227157+0000","last_fullsized":"2023-12-22T08:43:08.227157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:59.082663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.232729+0000","last_change":"2023-12-22T08:43:08.232729+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.232729+0000","last_undegraded":"2023-12-22T08:43:08.232729+0000","last_fullsized":"2023-12-22T08:43:08.232729+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:28.563154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.223306+0000","last_change":"2023-12-22T08:43:08.223306+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.223306+0000","last_undegraded":"2023-12-22T08:43:08.223306+0000","last_fullsized":"2023-12-22T08:43:08.223306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:04.134244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.221182+0000","last_change":"2023-12-22T08:43:08.221182+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.221182+0000","last_undegraded":"2023-12-22T08:43:08.221182+0000","last_fullsized":"2023-12-22T08:43:08.221182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:31.918421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.231446+0000","last_change":"2023-12-22T08:43:08.231446+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.231446+0000","last_undegraded":"2023-12-22T08:43:08.231446+0000","last_fullsized":"2023-12-22T08:43:08.231446+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:53.820355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.230463+0000","last_change":"2023-12-22T08:43:08.230463+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.230463+0000","last_undegraded":"2023-12-22T08:43:08.230463+0000","last_fullsized":"2023-12-22T08:43:08.230463+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:43.665325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.234439+0000","last_change":"2023-12-22T08:43:08.234439+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.234439+0000","last_undegraded":"2023-12-22T08:43:08.234439+0000","last_fullsized":"2023-12-22T08:43:08.234439+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:38.811875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.220567+0000","last_change":"2023-12-22T08:43:08.220567+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.220567+0000","last_undegraded":"2023-12-22T08:43:08.220567+0000","last_fullsized":"2023-12-22T08:43:08.220567+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:05.131643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.224491+0000","last_change":"2023-12-22T08:43:08.224491+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.224491+0000","last_undegraded":"2023-12-22T08:43:08.224491+0000","last_fullsized":"2023-12-22T08:43:08.224491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:45.919846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.225996+0000","last_change":"2023-12-22T08:43:08.225996+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.225996+0000","last_undegraded":"2023-12-22T08:43:08.225996+0000","last_fullsized":"2023-12-22T08:43:08.225996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:13.722210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.236598+0000","last_change":"2023-12-22T08:43:08.236598+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.236598+0000","last_undegraded":"2023-12-22T08:43:08.236598+0000","last_fullsized":"2023-12-22T08:43:08.236598+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:38.811875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.227658+0000","last_change":"2023-12-22T08:43:08.227658+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.227658+0000","last_undegraded":"2023-12-22T08:43:08.227658+0000","last_fullsized":"2023-12-22T08:43:08.227658+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:24:55.494298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.233725+0000","last_change":"2023-12-22T08:43:08.233725+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.233725+0000","last_undegraded":"2023-12-22T08:43:08.233725+0000","last_fullsized":"2023-12-22T08:43:08.233725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:59:35.438006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.233842+0000","last_change":"2023-12-22T08:43:08.233842+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.233842+0000","last_undegraded":"2023-12-22T08:43:08.233842+0000","last_fullsized":"2023-12-22T08:43:08.233842+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:30:25.664436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.226405+0000","last_change":"2023-12-22T08:43:08.226405+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.226405+0000","last_undegraded":"2023-12-22T08:43:08.226405+0000","last_fullsized":"2023-12-22T08:43:08.226405+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:43.665325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.235253+0000","last_change":"2023-12-22T08:43:08.235253+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.235253+0000","last_undegraded":"2023-12-22T08:43:08.235253+0000","last_fullsized":"2023-12-22T08:43:08.235253+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:25.938446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.226261+0000","last_change":"2023-12-22T08:43:08.226261+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.226261+0000","last_undegraded":"2023-12-22T08:43:08.226261+0000","last_fullsized":"2023-12-22T08:43:08.226261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:28.970593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.222925+0000","last_change":"2023-12-22T08:43:08.222925+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.222925+0000","last_undegraded":"2023-12-22T08:43:08.222925+0000","last_fullsized":"2023-12-22T08:43:08.222925+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:59.082663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.230308+0000","last_change":"2023-12-22T08:43:08.230308+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.230308+0000","last_undegraded":"2023-12-22T08:43:08.230308+0000","last_fullsized":"2023-12-22T08:43:08.230308+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:22:54.223163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.227167+0000","last_change":"2023-12-22T08:43:08.227167+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.227167+0000","last_undegraded":"2023-12-22T08:43:08.227167+0000","last_fullsized":"2023-12-22T08:43:08.227167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:21.060714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.228283+0000","last_change":"2023-12-22T08:43:08.228283+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.228283+0000","last_undegraded":"2023-12-22T08:43:08.228283+0000","last_fullsized":"2023-12-22T08:43:08.228283+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:24:12.486647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.226882+0000","last_change":"2023-12-22T08:43:08.226882+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.226882+0000","last_undegraded":"2023-12-22T08:43:08.226882+0000","last_fullsized":"2023-12-22T08:43:08.226882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:31.918421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.230746+0000","last_change":"2023-12-22T08:43:08.230746+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.230746+0000","last_undegraded":"2023-12-22T08:43:08.230746+0000","last_fullsized":"2023-12-22T08:43:08.230746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:45:00.000204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.241413+0000","last_change":"2023-12-22T08:43:08.241094+0000","last_active":"2023-12-22T08:43:08.241413+0000","last_peered":"2023-12-22T08:43:08.241413+0000","last_clean":"2023-12-22T08:43:08.241413+0000","last_became_active":"2023-12-22T08:43:08.240506+0000","last_became_peered":"2023-12-22T08:43:08.240506+0000","last_unstale":"2023-12-22T08:43:08.241413+0000","last_undegraded":"2023-12-22T08:43:08.241413+0000","last_fullsized":"2023-12-22T08:43:08.241413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:26.160091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.234714+0000","last_change":"2023-12-22T08:43:08.234714+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.234714+0000","last_undegraded":"2023-12-22T08:43:08.234714+0000","last_fullsized":"2023-12-22T08:43:08.234714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:38.767539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.241677+0000","last_change":"2023-12-22T08:43:08.241565+0000","last_active":"2023-12-22T08:43:08.241677+0000","last_peered":"2023-12-22T08:43:08.241677+0000","last_clean":"2023-12-22T08:43:08.241677+0000","last_became_active":"2023-12-22T08:43:08.241298+0000","last_became_peered":"2023-12-22T08:43:08.241298+0000","last_unstale":"2023-12-22T08:43:08.241677+0000","last_undegraded":"2023-12-22T08:43:08.241677+0000","last_fullsized":"2023-12-22T08:43:08.241677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:57:12.591295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.220440+0000","last_change":"2023-12-22T08:43:08.220440+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.220440+0000","last_undegraded":"2023-12-22T08:43:08.220440+0000","last_fullsized":"2023-12-22T08:43:08.220440+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:37:20.548483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.247069+0000","last_change":"2023-12-22T08:43:08.245896+0000","last_active":"2023-12-22T08:43:08.247069+0000","last_peered":"2023-12-22T08:43:08.247069+0000","last_clean":"2023-12-22T08:43:08.247069+0000","last_became_active":"2023-12-22T08:43:08.245372+0000","last_became_peered":"2023-12-22T08:43:08.245372+0000","last_unstale":"2023-12-22T08:43:08.247069+0000","last_undegraded":"2023-12-22T08:43:08.247069+0000","last_fullsized":"2023-12-22T08:43:08.247069+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:29.623967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.237956+0000","last_change":"2023-12-22T08:43:08.237956+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.237956+0000","last_undegraded":"2023-12-22T08:43:08.237956+0000","last_fullsized":"2023-12-22T08:43:08.237956+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:34.735345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.229850+0000","last_change":"2023-12-22T08:43:08.229587+0000","last_active":"2023-12-22T08:43:08.229850+0000","last_peered":"2023-12-22T08:43:08.229850+0000","last_clean":"2023-12-22T08:43:08.229850+0000","last_became_active":"2023-12-22T08:43:08.228337+0000","last_became_peered":"2023-12-22T08:43:08.228337+0000","last_unstale":"2023-12-22T08:43:08.229850+0000","last_undegraded":"2023-12-22T08:43:08.229850+0000","last_fullsized":"2023-12-22T08:43:08.229850+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:49.938120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.222102+0000","last_change":"2023-12-22T08:43:08.222102+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.222102+0000","last_undegraded":"2023-12-22T08:43:08.222102+0000","last_fullsized":"2023-12-22T08:43:08.222102+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:09:53.006039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.233018+0000","last_change":"2023-12-22T08:43:08.230735+0000","last_active":"2023-12-22T08:43:08.233018+0000","last_peered":"2023-12-22T08:43:08.233018+0000","last_clean":"2023-12-22T08:43:08.233018+0000","last_became_active":"2023-12-22T08:43:08.227246+0000","last_became_peered":"2023-12-22T08:43:08.227246+0000","last_unstale":"2023-12-22T08:43:08.233018+0000","last_undegraded":"2023-12-22T08:43:08.233018+0000","last_fullsized":"2023-12-22T08:43:08.233018+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:44.904868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.225918+0000","last_change":"2023-12-22T08:43:08.225918+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.225918+0000","last_undegraded":"2023-12-22T08:43:08.225918+0000","last_fullsized":"2023-12-22T08:43:08.225918+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:41.615895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.247855+0000","last_change":"2023-12-22T08:43:08.247775+0000","last_active":"2023-12-22T08:43:08.247855+0000","last_peered":"2023-12-22T08:43:08.247855+0000","last_clean":"2023-12-22T08:43:08.247855+0000","last_became_active":"2023-12-22T08:43:08.247512+0000","last_became_peered":"2023-12-22T08:43:08.247512+0000","last_unstale":"2023-12-22T08:43:08.247855+0000","last_undegraded":"2023-12-22T08:43:08.247855+0000","last_fullsized":"2023-12-22T08:43:08.247855+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:46:44.813831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.222563+0000","last_change":"2023-12-22T08:43:08.222563+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.222563+0000","last_undegraded":"2023-12-22T08:43:08.222563+0000","last_fullsized":"2023-12-22T08:43:08.222563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:31:40.143949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.242989+0000","last_change":"2023-12-22T08:43:08.242191+0000","last_active":"2023-12-22T08:43:08.242989+0000","last_peered":"2023-12-22T08:43:08.242989+0000","last_clean":"2023-12-22T08:43:08.242989+0000","last_became_active":"2023-12-22T08:43:08.241783+0000","last_became_peered":"2023-12-22T08:43:08.241783+0000","last_unstale":"2023-12-22T08:43:08.242989+0000","last_undegraded":"2023-12-22T08:43:08.242989+0000","last_fullsized":"2023-12-22T08:43:08.242989+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:53.956992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.229724+0000","last_change":"2023-12-22T08:43:08.229724+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.229724+0000","last_undegraded":"2023-12-22T08:43:08.229724+0000","last_fullsized":"2023-12-22T08:43:08.229724+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:45.919846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.241154+0000","last_change":"2023-12-22T08:43:08.240904+0000","last_active":"2023-12-22T08:43:08.241154+0000","last_peered":"2023-12-22T08:43:08.241154+0000","last_clean":"2023-12-22T08:43:08.241154+0000","last_became_active":"2023-12-22T08:43:08.240539+0000","last_became_peered":"2023-12-22T08:43:08.240539+0000","last_unstale":"2023-12-22T08:43:08.241154+0000","last_undegraded":"2023-12-22T08:43:08.241154+0000","last_fullsized":"2023-12-22T08:43:08.241154+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:44.413577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.224324+0000","last_change":"2023-12-22T08:43:08.224324+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.224324+0000","last_undegraded":"2023-12-22T08:43:08.224324+0000","last_fullsized":"2023-12-22T08:43:08.224324+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:28:32.888896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.243008+0000","last_change":"2023-12-22T08:43:08.242221+0000","last_active":"2023-12-22T08:43:08.243008+0000","last_peered":"2023-12-22T08:43:08.243008+0000","last_clean":"2023-12-22T08:43:08.243008+0000","last_became_active":"2023-12-22T08:43:08.241895+0000","last_became_peered":"2023-12-22T08:43:08.241895+0000","last_unstale":"2023-12-22T08:43:08.243008+0000","last_undegraded":"2023-12-22T08:43:08.243008+0000","last_fullsized":"2023-12-22T08:43:08.243008+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:36:26.961063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.223014+0000","last_change":"2023-12-22T08:43:08.223014+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.223014+0000","last_undegraded":"2023-12-22T08:43:08.223014+0000","last_fullsized":"2023-12-22T08:43:08.223014+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:09.970458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.240937+0000","last_change":"2023-12-22T08:43:08.239881+0000","last_active":"2023-12-22T08:43:08.240937+0000","last_peered":"2023-12-22T08:43:08.240937+0000","last_clean":"2023-12-22T08:43:08.240937+0000","last_became_active":"2023-12-22T08:43:08.238285+0000","last_became_peered":"2023-12-22T08:43:08.238285+0000","last_unstale":"2023-12-22T08:43:08.240937+0000","last_undegraded":"2023-12-22T08:43:08.240937+0000","last_fullsized":"2023-12-22T08:43:08.240937+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:33.720367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.229035+0000","last_change":"2023-12-22T08:43:08.229035+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.229035+0000","last_undegraded":"2023-12-22T08:43:08.229035+0000","last_fullsized":"2023-12-22T08:43:08.229035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:17.697248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.235133+0000","last_change":"2023-12-22T08:43:08.234204+0000","last_active":"2023-12-22T08:43:08.235133+0000","last_peered":"2023-12-22T08:43:08.235133+0000","last_clean":"2023-12-22T08:43:08.235133+0000","last_became_active":"2023-12-22T08:43:08.228159+0000","last_became_peered":"2023-12-22T08:43:08.228159+0000","last_unstale":"2023-12-22T08:43:08.235133+0000","last_undegraded":"2023-12-22T08:43:08.235133+0000","last_fullsized":"2023-12-22T08:43:08.235133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:18.349374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.229291+0000","last_change":"2023-12-22T08:43:08.229291+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.229291+0000","last_undegraded":"2023-12-22T08:43:08.229291+0000","last_fullsized":"2023-12-22T08:43:08.229291+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:58.667030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.239022+0000","last_change":"2023-12-22T08:43:08.237347+0000","last_active":"2023-12-22T08:43:08.239022+0000","last_peered":"2023-12-22T08:43:08.239022+0000","last_clean":"2023-12-22T08:43:08.239022+0000","last_became_active":"2023-12-22T08:43:08.235741+0000","last_became_peered":"2023-12-22T08:43:08.235741+0000","last_unstale":"2023-12-22T08:43:08.239022+0000","last_undegraded":"2023-12-22T08:43:08.239022+0000","last_fullsized":"2023-12-22T08:43:08.239022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:27.955616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.232674+0000","last_change":"2023-12-22T08:43:08.232674+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.232674+0000","last_undegraded":"2023-12-22T08:43:08.232674+0000","last_fullsized":"2023-12-22T08:43:08.232674+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:07:12.868602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.243387+0000","last_change":"2023-12-22T08:43:08.243194+0000","last_active":"2023-12-22T08:43:08.243387+0000","last_peered":"2023-12-22T08:43:08.243387+0000","last_clean":"2023-12-22T08:43:08.243387+0000","last_became_active":"2023-12-22T08:43:08.242449+0000","last_became_peered":"2023-12-22T08:43:08.242449+0000","last_unstale":"2023-12-22T08:43:08.243387+0000","last_undegraded":"2023-12-22T08:43:08.243387+0000","last_fullsized":"2023-12-22T08:43:08.243387+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:14.817249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.221399+0000","last_change":"2023-12-22T08:43:08.221399+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.221399+0000","last_undegraded":"2023-12-22T08:43:08.221399+0000","last_fullsized":"2023-12-22T08:43:08.221399+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:07:27.247486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.238653+0000","last_change":"2023-12-22T08:43:08.238556+0000","last_active":"2023-12-22T08:43:08.238653+0000","last_peered":"2023-12-22T08:43:08.238653+0000","last_clean":"2023-12-22T08:43:08.238653+0000","last_became_active":"2023-12-22T08:43:08.238261+0000","last_became_peered":"2023-12-22T08:43:08.238261+0000","last_unstale":"2023-12-22T08:43:08.238653+0000","last_undegraded":"2023-12-22T08:43:08.238653+0000","last_fullsized":"2023-12-22T08:43:08.238653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:22.638334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.225798+0000","last_change":"2023-12-22T08:43:08.225798+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.225798+0000","last_undegraded":"2023-12-22T08:43:08.225798+0000","last_fullsized":"2023-12-22T08:43:08.225798+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:32:13.036482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.239429+0000","last_change":"2023-12-22T08:43:08.239352+0000","last_active":"2023-12-22T08:43:08.239429+0000","last_peered":"2023-12-22T08:43:08.239429+0000","last_clean":"2023-12-22T08:43:08.239429+0000","last_became_active":"2023-12-22T08:43:08.238848+0000","last_became_peered":"2023-12-22T08:43:08.238848+0000","last_unstale":"2023-12-22T08:43:08.239429+0000","last_undegraded":"2023-12-22T08:43:08.239429+0000","last_fullsized":"2023-12-22T08:43:08.239429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:12.707233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.235080+0000","last_change":"2023-12-22T08:43:08.235080+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.235080+0000","last_undegraded":"2023-12-22T08:43:08.235080+0000","last_fullsized":"2023-12-22T08:43:08.235080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:32:32.129373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.235113+0000","last_change":"2023-12-22T08:43:08.233994+0000","last_active":"2023-12-22T08:43:08.235113+0000","last_peered":"2023-12-22T08:43:08.235113+0000","last_clean":"2023-12-22T08:43:08.235113+0000","last_became_active":"2023-12-22T08:43:08.227292+0000","last_became_peered":"2023-12-22T08:43:08.227292+0000","last_unstale":"2023-12-22T08:43:08.235113+0000","last_undegraded":"2023-12-22T08:43:08.235113+0000","last_fullsized":"2023-12-22T08:43:08.235113+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:18:18.840612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.220469+0000","last_change":"2023-12-22T08:43:08.220469+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.220469+0000","last_undegraded":"2023-12-22T08:43:08.220469+0000","last_fullsized":"2023-12-22T08:43:08.220469+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:15.832226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.245808+0000","last_change":"2023-12-22T08:43:08.245684+0000","last_active":"2023-12-22T08:43:08.245808+0000","last_peered":"2023-12-22T08:43:08.245808+0000","last_clean":"2023-12-22T08:43:08.245808+0000","last_became_active":"2023-12-22T08:43:08.245434+0000","last_became_peered":"2023-12-22T08:43:08.245434+0000","last_unstale":"2023-12-22T08:43:08.245808+0000","last_undegraded":"2023-12-22T08:43:08.245808+0000","last_fullsized":"2023-12-22T08:43:08.245808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:29.623967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.219390+0000","last_change":"2023-12-22T08:43:08.219390+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.219390+0000","last_undegraded":"2023-12-22T08:43:08.219390+0000","last_fullsized":"2023-12-22T08:43:08.219390+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:41.615895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.243509+0000","last_change":"2023-12-22T08:43:08.243395+0000","last_active":"2023-12-22T08:43:08.243509+0000","last_peered":"2023-12-22T08:43:08.243509+0000","last_clean":"2023-12-22T08:43:08.243509+0000","last_became_active":"2023-12-22T08:43:08.242880+0000","last_became_peered":"2023-12-22T08:43:08.242880+0000","last_unstale":"2023-12-22T08:43:08.243509+0000","last_undegraded":"2023-12-22T08:43:08.243509+0000","last_fullsized":"2023-12-22T08:43:08.243509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:26.160091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.225411+0000","last_change":"2023-12-22T08:43:08.225411+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.225411+0000","last_undegraded":"2023-12-22T08:43:08.225411+0000","last_fullsized":"2023-12-22T08:43:08.225411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:45.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.242213+0000","last_change":"2023-12-22T08:43:08.241351+0000","last_active":"2023-12-22T08:43:08.242213+0000","last_peered":"2023-12-22T08:43:08.242213+0000","last_clean":"2023-12-22T08:43:08.242213+0000","last_became_active":"2023-12-22T08:43:08.236119+0000","last_became_peered":"2023-12-22T08:43:08.236119+0000","last_unstale":"2023-12-22T08:43:08.242213+0000","last_undegraded":"2023-12-22T08:43:08.242213+0000","last_fullsized":"2023-12-22T08:43:08.242213+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:24:11.471670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.229276+0000","last_change":"2023-12-22T08:43:08.229276+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.229276+0000","last_undegraded":"2023-12-22T08:43:08.229276+0000","last_fullsized":"2023-12-22T08:43:08.229276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:23.591214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.247098+0000","last_change":"2023-12-22T08:43:08.246777+0000","last_active":"2023-12-22T08:43:08.247098+0000","last_peered":"2023-12-22T08:43:08.247098+0000","last_clean":"2023-12-22T08:43:08.247098+0000","last_became_active":"2023-12-22T08:43:08.246524+0000","last_became_peered":"2023-12-22T08:43:08.246524+0000","last_unstale":"2023-12-22T08:43:08.247098+0000","last_undegraded":"2023-12-22T08:43:08.247098+0000","last_fullsized":"2023-12-22T08:43:08.247098+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:52.805378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.232486+0000","last_change":"2023-12-22T08:43:08.232486+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.232486+0000","last_undegraded":"2023-12-22T08:43:08.232486+0000","last_fullsized":"2023-12-22T08:43:08.232486+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:53.721528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.241033+0000","last_change":"2023-12-22T08:43:08.240892+0000","last_active":"2023-12-22T08:43:08.241033+0000","last_peered":"2023-12-22T08:43:08.241033+0000","last_clean":"2023-12-22T08:43:08.241033+0000","last_became_active":"2023-12-22T08:43:08.240027+0000","last_became_peered":"2023-12-22T08:43:08.240027+0000","last_unstale":"2023-12-22T08:43:08.241033+0000","last_undegraded":"2023-12-22T08:43:08.241033+0000","last_fullsized":"2023-12-22T08:43:08.241033+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:14.817249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.220765+0000","last_change":"2023-12-22T08:43:08.220765+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.220765+0000","last_undegraded":"2023-12-22T08:43:08.220765+0000","last_fullsized":"2023-12-22T08:43:08.220765+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:02:50.159719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.242694+0000","last_change":"2023-12-22T08:43:08.242318+0000","last_active":"2023-12-22T08:43:08.242694+0000","last_peered":"2023-12-22T08:43:08.242694+0000","last_clean":"2023-12-22T08:43:08.242694+0000","last_became_active":"2023-12-22T08:43:08.240707+0000","last_became_peered":"2023-12-22T08:43:08.240707+0000","last_unstale":"2023-12-22T08:43:08.242694+0000","last_undegraded":"2023-12-22T08:43:08.242694+0000","last_fullsized":"2023-12-22T08:43:08.242694+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:37.796898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.224109+0000","last_change":"2023-12-22T08:43:08.224109+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.224109+0000","last_undegraded":"2023-12-22T08:43:08.224109+0000","last_fullsized":"2023-12-22T08:43:08.224109+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:23.653311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.245954+0000","last_change":"2023-12-22T08:43:08.245828+0000","last_active":"2023-12-22T08:43:08.245954+0000","last_peered":"2023-12-22T08:43:08.245954+0000","last_clean":"2023-12-22T08:43:08.245954+0000","last_became_active":"2023-12-22T08:43:08.245624+0000","last_became_peered":"2023-12-22T08:43:08.245624+0000","last_unstale":"2023-12-22T08:43:08.245954+0000","last_undegraded":"2023-12-22T08:43:08.245954+0000","last_fullsized":"2023-12-22T08:43:08.245954+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:02:00.232260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.219651+0000","last_change":"2023-12-22T08:43:08.219651+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.219651+0000","last_undegraded":"2023-12-22T08:43:08.219651+0000","last_fullsized":"2023-12-22T08:43:08.219651+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:03:49.616345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.243329+0000","last_change":"2023-12-22T08:43:08.243237+0000","last_active":"2023-12-22T08:43:08.243329+0000","last_peered":"2023-12-22T08:43:08.243329+0000","last_clean":"2023-12-22T08:43:08.243329+0000","last_became_active":"2023-12-22T08:43:08.242927+0000","last_became_peered":"2023-12-22T08:43:08.242927+0000","last_unstale":"2023-12-22T08:43:08.243329+0000","last_undegraded":"2023-12-22T08:43:08.243329+0000","last_fullsized":"2023-12-22T08:43:08.243329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:13:29.194561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.220796+0000","last_change":"2023-12-22T08:43:08.220796+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.220796+0000","last_undegraded":"2023-12-22T08:43:08.220796+0000","last_fullsized":"2023-12-22T08:43:08.220796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:27.175068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.247026+0000","last_change":"2023-12-22T08:43:08.245846+0000","last_active":"2023-12-22T08:43:08.247026+0000","last_peered":"2023-12-22T08:43:08.247026+0000","last_clean":"2023-12-22T08:43:08.247026+0000","last_became_active":"2023-12-22T08:43:08.245404+0000","last_became_peered":"2023-12-22T08:43:08.245404+0000","last_unstale":"2023-12-22T08:43:08.247026+0000","last_undegraded":"2023-12-22T08:43:08.247026+0000","last_fullsized":"2023-12-22T08:43:08.247026+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:27:48.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.225493+0000","last_change":"2023-12-22T08:43:08.225493+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.225493+0000","last_undegraded":"2023-12-22T08:43:08.225493+0000","last_fullsized":"2023-12-22T08:43:08.225493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:32.067700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.238158+0000","last_change":"2023-12-22T08:43:08.238015+0000","last_active":"2023-12-22T08:43:08.238158+0000","last_peered":"2023-12-22T08:43:08.238158+0000","last_clean":"2023-12-22T08:43:08.238158+0000","last_became_active":"2023-12-22T08:43:08.237691+0000","last_became_peered":"2023-12-22T08:43:08.237691+0000","last_unstale":"2023-12-22T08:43:08.238158+0000","last_undegraded":"2023-12-22T08:43:08.238158+0000","last_fullsized":"2023-12-22T08:43:08.238158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:13:35.064619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.228188+0000","last_change":"2023-12-22T08:43:08.228188+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.228188+0000","last_undegraded":"2023-12-22T08:43:08.228188+0000","last_fullsized":"2023-12-22T08:43:08.228188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:50.953097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.228896+0000","last_change":"2023-12-22T08:43:08.228782+0000","last_active":"2023-12-22T08:43:08.228896+0000","last_peered":"2023-12-22T08:43:08.228896+0000","last_clean":"2023-12-22T08:43:08.228896+0000","last_became_active":"2023-12-22T08:43:08.228538+0000","last_became_peered":"2023-12-22T08:43:08.228538+0000","last_unstale":"2023-12-22T08:43:08.228896+0000","last_undegraded":"2023-12-22T08:43:08.228896+0000","last_fullsized":"2023-12-22T08:43:08.228896+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:44.413577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.233603+0000","last_change":"2023-12-22T08:43:08.233603+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.233603+0000","last_undegraded":"2023-12-22T08:43:08.233603+0000","last_fullsized":"2023-12-22T08:43:08.233603+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:52.037553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.246728+0000","last_change":"2023-12-22T08:43:08.246580+0000","last_active":"2023-12-22T08:43:08.246728+0000","last_peered":"2023-12-22T08:43:08.246728+0000","last_clean":"2023-12-22T08:43:08.246728+0000","last_became_active":"2023-12-22T08:43:08.246138+0000","last_became_peered":"2023-12-22T08:43:08.246138+0000","last_unstale":"2023-12-22T08:43:08.246728+0000","last_undegraded":"2023-12-22T08:43:08.246728+0000","last_fullsized":"2023-12-22T08:43:08.246728+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:54:55.545904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.226506+0000","last_change":"2023-12-22T08:43:08.226506+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.226506+0000","last_undegraded":"2023-12-22T08:43:08.226506+0000","last_fullsized":"2023-12-22T08:43:08.226506+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:19.778557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.235409+0000","last_change":"2023-12-22T08:43:08.235236+0000","last_active":"2023-12-22T08:43:08.235409+0000","last_peered":"2023-12-22T08:43:08.235409+0000","last_clean":"2023-12-22T08:43:08.235409+0000","last_became_active":"2023-12-22T08:43:08.234988+0000","last_became_peered":"2023-12-22T08:43:08.234988+0000","last_unstale":"2023-12-22T08:43:08.235409+0000","last_undegraded":"2023-12-22T08:43:08.235409+0000","last_fullsized":"2023-12-22T08:43:08.235409+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:04.865483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.227218+0000","last_change":"2023-12-22T08:43:08.227218+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.227218+0000","last_undegraded":"2023-12-22T08:43:08.227218+0000","last_fullsized":"2023-12-22T08:43:08.227218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:10:28.675275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.245764+0000","last_change":"2023-12-22T08:43:08.245686+0000","last_active":"2023-12-22T08:43:08.245764+0000","last_peered":"2023-12-22T08:43:08.245764+0000","last_clean":"2023-12-22T08:43:08.245764+0000","last_became_active":"2023-12-22T08:43:08.245056+0000","last_became_peered":"2023-12-22T08:43:08.245056+0000","last_unstale":"2023-12-22T08:43:08.245764+0000","last_undegraded":"2023-12-22T08:43:08.245764+0000","last_fullsized":"2023-12-22T08:43:08.245764+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:52:56.482108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.227978+0000","last_change":"2023-12-22T08:43:08.227978+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.227978+0000","last_undegraded":"2023-12-22T08:43:08.227978+0000","last_fullsized":"2023-12-22T08:43:08.227978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:05.880460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.243006+0000","last_change":"2023-12-22T08:43:08.242877+0000","last_active":"2023-12-22T08:43:08.243006+0000","last_peered":"2023-12-22T08:43:08.243006+0000","last_clean":"2023-12-22T08:43:08.243006+0000","last_became_active":"2023-12-22T08:43:08.241588+0000","last_became_peered":"2023-12-22T08:43:08.241588+0000","last_unstale":"2023-12-22T08:43:08.243006+0000","last_undegraded":"2023-12-22T08:43:08.243006+0000","last_fullsized":"2023-12-22T08:43:08.243006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:18.763580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.219456+0000","last_change":"2023-12-22T08:43:08.219456+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.219456+0000","last_undegraded":"2023-12-22T08:43:08.219456+0000","last_fullsized":"2023-12-22T08:43:08.219456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:28.745926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.238997+0000","last_change":"2023-12-22T08:43:08.236569+0000","last_active":"2023-12-22T08:43:08.238997+0000","last_peered":"2023-12-22T08:43:08.238997+0000","last_clean":"2023-12-22T08:43:08.238997+0000","last_became_active":"2023-12-22T08:43:08.236102+0000","last_became_peered":"2023-12-22T08:43:08.236102+0000","last_unstale":"2023-12-22T08:43:08.238997+0000","last_undegraded":"2023-12-22T08:43:08.238997+0000","last_fullsized":"2023-12-22T08:43:08.238997+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:31.052723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-22T08:43:07.210223+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:43:07.210223+0000","last_peered":"2023-12-22T08:43:07.210223+0000","last_clean":"2023-12-22T08:43:07.210223+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:43:07.210223+0000","last_undegraded":"2023-12-22T08:43:07.210223+0000","last_fullsized":"2023-12-22T08:43:07.210223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194959,"statfs":{"total":200000000,"available":199638337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0780000000000001,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.075,"15min":1.0589999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.92100000000000004}]},{"osd":1,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.173,"15min":1.1579999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.872},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.1619999999999999,"15min":1.1319999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.014}]},{"osd":2,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.0860000000000001,"15min":1.056},"min":{"1min":0.78600000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.2310000000000001,"15min":1.23},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.742,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.98099999999999998}]},{"osd":3,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1240000000000001,"15min":1.0900000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.292,"15min":1.2769999999999999},"min":{"1min":0.80500000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.952,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.4370000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1899999999999999,"15min":1.194},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.764,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.117},{"interface":"front","average":{"1min":1.266,"5min":1.268,"15min":1.2629999999999999},"min":{"1min":0.64100000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.48}]},{"osd":5,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.371,"15min":1.367},"min":{"1min":0.74299999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.8120000000000001,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3660000000000001,"15min":1.3700000000000001},"min":{"1min":0.76300000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.645,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.5129999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4870000000000001,"15min":1.4850000000000001},"min":{"1min":0.83499999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.1259999999999999,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4870000000000001,"15min":1.484},"min":{"1min":0.82299999999999995,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.986}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194965,"statfs":{"total":200000000,"available":199644612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1140000000000001,"15min":1.1299999999999999},"min":{"1min":0.80500000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9350000000000001,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.0820000000000001,"15min":1.081},"min":{"1min":0.77500000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.482}]},{"osd":1,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0389999999999999,"15min":1.0189999999999999},"min":{"1min":0.79000000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.448,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.1919999999999999,"15min":1.171},"min":{"1min":1.0129999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.1679999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2529999999999999,"15min":1.272},"min":{"1min":0.82799999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7969999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.411},{"interface":"front","average":{"1min":1.268,"5min":1.1739999999999999,"15min":1.147},"min":{"1min":0.81599999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.321}]},{"osd":3,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.3160000000000001,"15min":1.298},"min":{"1min":0.94099999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.738,"5min":1.847,"15min":1.847},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.248,"15min":1.2330000000000001},"min":{"1min":0.96799999999999997,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.645,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.5389999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.403,"15min":1.411},"min":{"1min":1.0169999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.9139999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.276},{"interface":"front","average":{"1min":1.508,"5min":1.417,"15min":1.4079999999999999},"min":{"1min":1.21,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.101}]},{"osd":5,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.361,"15min":1.3640000000000001},"min":{"1min":0.92100000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.45},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.5740000000000001,"15min":1.599},"min":{"1min":1.0960000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.1030000000000002,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.5049999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.5900000000000001,"15min":1.5940000000000001},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":1.9790000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.538,"5min":1.5449999999999999,"15min":1.5589999999999999},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":1.964,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.6399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194389,"statfs":{"total":200000000,"available":199055263,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.0740000000000001,"15min":1.075},"min":{"1min":0.72999999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.637,"5min":1.944,"15min":1.944},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.123,"15min":1.135},"min":{"1min":0.68899999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.514,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.1220000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.093,"15min":1.1080000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.409,"5min":2.79,"15min":2.79},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.0289999999999999,"15min":1.012},"min":{"1min":0.78200000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.1120000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.119,"15min":1.1220000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.456,"5min":1.72,"15min":1.72},"last":1.196},{"interface":"front","average":{"1min":1.22,"5min":1.163,"15min":1.159},"min":{"1min":0.78200000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5489999999999999,"5min":1.978,"15min":1.978},"last":1.0629999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1619999999999999,"15min":1.1559999999999999},"min":{"1min":0.83399999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.506,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.083},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.226,"15min":1.2310000000000001},"min":{"1min":1.0329999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5800000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.2629999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.24,"15min":1.246},"min":{"1min":0.95499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7070000000000001,"5min":1.853,"15min":1.853},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.159,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.88100000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3069999999999999,"15min":1.3089999999999999},"min":{"1min":0.88100000000000001,"5min":0.749,"15min":0.749},"max":{"1min":1.581,"5min":1.821,"15min":1.821},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.401,"5min":1.4199999999999999,"15min":1.4259999999999999},"min":{"1min":0.89900000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.7529999999999999,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.097}]},{"osd":7,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3580000000000001,"15min":1.3620000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6359999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.038},{"interface":"front","average":{"1min":1.411,"5min":1.5409999999999999,"15min":1.575},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.788,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":0.97899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194965,"statfs":{"total":200000000,"available":199644612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.99299999999999999,"15min":1.002},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5309999999999999,"5min":1.552,"15min":1.552},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.097,"15min":1.091},"min":{"1min":0.72499999999999998,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6100000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.2689999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.042,"15min":1.0289999999999999},"min":{"1min":0.72399999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6279999999999999,"5min":1.669,"15min":1.669},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0900000000000001,"15min":1.1020000000000001},"min":{"1min":0.70499999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.794,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.157}]},{"osd":2,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1379999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5009999999999999,"5min":1.625,"15min":1.625},"last":1.008},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1850000000000001,"15min":1.1890000000000001},"min":{"1min":0.92200000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.5640000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.95999999999999996}]},{"osd":3,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2090000000000001,"15min":1.1950000000000001},"min":{"1min":0.93700000000000006,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5049999999999999,"5min":1.774,"15min":1.774},"last":1.355},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.222,"15min":1.194},"min":{"1min":1.012,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.3300000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1579999999999999,"15min":1.1299999999999999},"min":{"1min":1.016,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.3819999999999999,"15min":1.3700000000000001},"min":{"1min":1.0800000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7050000000000001,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.115}]},{"osd":6,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.248,"15min":1.226},"min":{"1min":1.0469999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.621,"5min":1.798,"15min":1.798},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.2130000000000001,"15min":1.181},"min":{"1min":1.0049999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.3009999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.367,"15min":1.323},"min":{"1min":0.97799999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.8879999999999999,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.4259999999999999,"15min":1.4019999999999999},"min":{"1min":1.2470000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.9199999999999999,"5min":1.923,"15min":1.923},"last":1.3839999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194959,"statfs":{"total":200000000,"available":199638337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.93899999999999995,"15min":0.96799999999999997},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90900000000000003,"15min":0.92900000000000005},"min":{"1min":0.5,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.85099999999999998}]},{"osd":1,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.85299999999999998,"15min":0.85699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.1020000000000001,"15min":1.1080000000000001},"min":{"1min":0.63100000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.081}]},{"osd":2,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.024,"15min":1.032},"min":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.591,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.272,"5min":1.137,"15min":1.125},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.026}]},{"osd":4,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.202,"15min":1.198},"min":{"1min":0.89900000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":1.7230000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.2350000000000001,"15min":1.222},"min":{"1min":0.77300000000000002,"5min":0.745,"15min":0.745},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.617}]},{"osd":5,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.2769999999999999,"15min":1.262},"min":{"1min":0.84599999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.532},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.413,"15min":1.4430000000000001},"min":{"1min":0.96999999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.3109999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.4330000000000001,"15min":1.4419999999999999},"min":{"1min":0.93000000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.512},{"interface":"front","average":{"1min":1.454,"5min":1.3779999999999999,"15min":1.3859999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.786}]},{"osd":7,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.361,"15min":1.365},"min":{"1min":0.85599999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.393,"15min":1.387},"min":{"1min":0.97399999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.8220000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194965,"statfs":{"total":200000000,"available":199644612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":0.83699999999999997,"15min":0.74099999999999999},"min":{"1min":0.56299999999999994,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.8879999999999999,"5min":6.8879999999999999,"15min":6.8879999999999999},"last":0.628},{"interface":"front","average":{"1min":1.246,"5min":0.97799999999999998,"15min":0.95099999999999996},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":4.5510000000000002,"5min":4.5510000000000002,"15min":4.5510000000000002},"last":0.495}]},{"osd":1,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.042,"15min":0.94499999999999995},"min":{"1min":0.59699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":11.308999999999999,"5min":11.308999999999999,"15min":11.308999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.149,"5min":0.95199999999999996,"15min":0.90600000000000003},"min":{"1min":0.70099999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.163,"15min":1.0229999999999999},"min":{"1min":0.55400000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":13.087999999999999,"5min":13.087999999999999,"15min":13.087999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.232,"15min":1.0740000000000001},"min":{"1min":0.79200000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":12.289999999999999,"5min":12.289999999999999,"15min":12.289999999999999},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.2749999999999999,"15min":1.22},"min":{"1min":1.048,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":2.1030000000000002,"5min":1.464,"15min":1.377},"min":{"1min":0.76500000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":13.927,"5min":13.927,"15min":13.927},"last":1.0920000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.9199999999999999,"5min":1.4530000000000001,"15min":1.393},"min":{"1min":0.72399999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":11.003,"5min":11.003,"15min":11.003},"last":1.0229999999999999},{"interface":"front","average":{"1min":2.0960000000000001,"5min":1.389,"15min":1.2629999999999999},"min":{"1min":0.90800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":13.129,"5min":13.129,"15min":13.129},"last":1.3160000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.3480000000000001,"15min":1.256},"min":{"1min":0.77200000000000002,"5min":0.751,"15min":0.751},"max":{"1min":8.1609999999999996,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":1.377},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.4199999999999999,"15min":1.3500000000000001},"min":{"1min":0.873,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":6.8150000000000004,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":0.94599999999999995}]},{"osd":7,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":2.0179999999999998,"5min":1.4870000000000001,"15min":1.393},"min":{"1min":0.85499999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":10.948,"5min":10.948,"15min":10.948},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.8799999999999999,"5min":1.4219999999999999,"15min":1.3300000000000001},"min":{"1min":1.0820000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":8.0980000000000008,"5min":8.0980000000000008,"15min":8.0980000000000008},"last":1.4370000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":923,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194388,"statfs":{"total":200000000,"available":199054244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.88700000000000001,"15min":0.89500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.339,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.474},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.01,"15min":1.0049999999999999},"min":{"1min":0.625,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.399,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.284,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.93999999999999995,"15min":0.93899999999999995},"min":{"1min":0.60599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.417,"5min":2.254,"15min":2.254},"last":1.077}]},{"osd":3,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.155,"15min":1.1519999999999999},"min":{"1min":0.68799999999999994,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.673,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.3420000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93500000000000005,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.94099999999999995}]},{"osd":4,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.244,"15min":1.264},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.8049999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.669},{"interface":"front","average":{"1min":1.389,"5min":1.329,"15min":1.3109999999999999},"min":{"1min":0.876,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.962,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.597}]},{"osd":5,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.93300000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":1.252},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.3560000000000001,"15min":1.3300000000000001},"min":{"1min":0.88200000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.5649999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2430000000000001,"15min":1.2410000000000001},"min":{"1min":0.81100000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.524},{"interface":"front","average":{"1min":1.359,"5min":1.347,"15min":1.353},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.9730000000000001,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.756}]},{"osd":7,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.367,"15min":1.343},"min":{"1min":1.0269999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0369999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.724},{"interface":"front","average":{"1min":1.393,"5min":1.367,"15min":1.395},"min":{"1min":0.86599999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.3079999999999998,"5min":3.2959999999999998,"15min":3.2959999999999998},"last":1.637}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194965,"statfs":{"total":200000000,"available":199644612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.88500000000000001,"15min":0.89300000000000002},"min":{"1min":0.53800000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.4259999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.1950000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.79000000000000004,"15min":0.78200000000000003},"min":{"1min":0.442,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.93400000000000005,"15min":0.91900000000000004},"min":{"1min":0.45900000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.429}]},{"osd":3,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0149999999999999,"15min":1.0029999999999999},"min":{"1min":0.58499999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.744,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.071,"15min":1.0349999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.2509999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.27,"15min":1.2569999999999999},"min":{"1min":1.024,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.671,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.2270000000000001,"15min":1.1990000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.651,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.468}]},{"osd":5,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.242,"15min":1.24},"min":{"1min":0.80600000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.671},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.258,"15min":1.2509999999999999},"min":{"1min":0.90600000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.839,"5min":1.885,"15min":1.885},"last":1.383}]},{"osd":6,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.288,"15min":1.268},"min":{"1min":0.78600000000000003,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.175},{"interface":"front","average":{"1min":1.383,"5min":1.367,"15min":1.373},"min":{"1min":1.008,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.0649999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.8340000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3400000000000001,"15min":1.3480000000000001},"min":{"1min":0.97099999999999997,"5min":0.755,"15min":0.755},"max":{"1min":1.768,"5min":1.79,"15min":1.79},"last":1.887},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3700000000000001,"15min":1.3640000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.9510000000000001,"5min":2.214,"15min":2.214},"last":1.6240000000000001}]}]}],"pool_statfs":[]}} 2023-12-22T08:43:13.699 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:43:13.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.962+0000 7fd243fff640 1 Processor -- start 2023-12-22T08:43:13.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.963+0000 7fd243fff640 1 -- start start 2023-12-22T08:43:13.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.965+0000 7fd243fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd244071000 0x7fd244165f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.965+0000 7fd243fff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2440cdae0 con 0x7fd2440a44a0 2023-12-22T08:43:13.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.965+0000 7fd243fff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24415b800 con 0x7fd24415b420 2023-12-22T08:43:13.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.965+0000 7fd243fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440cdd30 con 0x7fd244071000 2023-12-22T08:43:13.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.965+0000 7fd2427fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd2440a44a0 0x7fd2440708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34710/0 (socket says 172.21.15.38:34710) 2023-12-22T08:43:13.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.965+0000 7fd2427fc640 1 -- 172.21.15.38:0/1656408001 learned_addr learned my addr 172.21.15.38:0/1656408001 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:43:13.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd2437fe640 1 --2- 172.21.15.38:0/1656408001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd244071000 0x7fd244165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619816723 0 0) 0x7fd2440cdae0 con 0x7fd2440a44a0 2023-12-22T08:43:13.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd230003520 con 0x7fd2440a44a0 2023-12-22T08:43:13.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 933053504 0 0) 0x7fd230003520 con 0x7fd2440a44a0 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd244071000 msgr2=0x7fd244165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 --2- 172.21.15.38:0/1656408001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd244071000 0x7fd244165f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 >> v1:172.21.15.89:6789/0 conn(0x7fd24415b420 legacy=0x7fd24406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2440ce010 con 0x7fd2440a44a0 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fd22c0019f0 con 0x7fd2440a44a0 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 >> v1:172.21.15.38:6789/0 conn(0x7fd2440a44a0 legacy=0x7fd2440708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 --2- 172.21.15.38:0/1656408001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2300039a0 0x7fd230003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 --2- 172.21.15.38:0/1656408001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2300047c0 0x7fd230004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 --2- 172.21.15.38:0/1656408001 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd230005180 0x7fd23000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440cdd30 con 0x7fd230005180 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23000c080 con 0x7fd2300047c0 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23000c240 con 0x7fd2300039a0 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.966+0000 7fd2437fe640 1 --2- 172.21.15.38:0/1656408001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd244071000 0x7fd244165f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.967+0000 7fd2437fe640 1 --2- 172.21.15.38:0/1656408001 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd230005180 0x7fd23000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.967+0000 7fd2427fc640 1 --2- 172.21.15.38:0/1656408001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2300047c0 0x7fd230004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.967+0000 7fd242ffd640 1 --2- 172.21.15.38:0/1656408001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2300039a0 0x7fd230003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.967+0000 7fd2437fe640 1 -- 172.21.15.38:0/1656408001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2300039a0 msgr2=0x7fd230003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:13.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.967+0000 7fd2437fe640 1 --2- 172.21.15.38:0/1656408001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2300039a0 0x7fd230003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.967+0000 7fd2437fe640 1 -- 172.21.15.38:0/1656408001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2300047c0 msgr2=0x7fd230004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:13.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.967+0000 7fd2437fe640 1 --2- 172.21.15.38:0/1656408001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2300047c0 0x7fd230004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.967+0000 7fd2437fe640 1 -- 172.21.15.38:0/1656408001 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd230003520 con 0x7fd230005180 2023-12-22T08:43:13.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.968+0000 7fd2437fe640 1 --2- 172.21.15.38:0/1656408001 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd230005180 0x7fd23000b980 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd23c006fd0 tx=0x7fd2300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56107547ccc71db1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:13.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.968+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c033600 con 0x7fd230005180 2023-12-22T08:43:13.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.968+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c02f050 con 0x7fd230005180 2023-12-22T08:43:13.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.968+0000 7fd241ffb640 1 -- 172.21.15.38:0/1656408001 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c033980 con 0x7fd230005180 2023-12-22T08:43:13.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.969+0000 7fd243fff640 1 -- 172.21.15.38:0/1656408001 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd230005180 msgr2=0x7fd23000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.969+0000 7fd243fff640 1 --2- 172.21.15.38:0/1656408001 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd230005180 0x7fd23000b980 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd23c006fd0 tx=0x7fd2300057f0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.969+0000 7fd2437fe640 1 -- 172.21.15.38:0/1656408001 reap_dead start 2023-12-22T08:43:13.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.969+0000 7fd243fff640 1 -- 172.21.15.38:0/1656408001 shutdown_connections 2023-12-22T08:43:13.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.969+0000 7fd243fff640 1 -- 172.21.15.38:0/1656408001 >> 172.21.15.38:0/1656408001 conn(0x7fd2440b1f70 msgr2=0x7fd2440b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:13.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.969+0000 7fd243fff640 1 -- 172.21.15.38:0/1656408001 shutdown_connections 2023-12-22T08:43:13.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.969+0000 7fd243fff640 1 -- 172.21.15.38:0/1656408001 wait complete. 2023-12-22T08:43:13.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.971+0000 7fd243fff640 1 Processor -- start 2023-12-22T08:43:13.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.971+0000 7fd243fff640 1 -- start start 2023-12-22T08:43:13.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.972+0000 7fd243fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2441f2d30 0x7fd2440a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.972+0000 7fd243fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2440a3fc0 0x7fd24413f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.972+0000 7fd243fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24413f970 0x7fd24406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.972+0000 7fd243fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440a3660 con 0x7fd2440a3fc0 2023-12-22T08:43:13.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.972+0000 7fd243fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24413fdf0 con 0x7fd2441f2d30 2023-12-22T08:43:13.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.972+0000 7fd243fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd244142490 con 0x7fd24413f970 2023-12-22T08:43:13.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.972+0000 7fd2427fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2440a3fc0 0x7fd24413f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.972+0000 7fd2427fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2440a3fc0 0x7fd24413f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33930/0 (socket says 172.21.15.38:33930) 2023-12-22T08:43:13.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.972+0000 7fd2427fc640 1 -- 172.21.15.38:0/2083869549 learned_addr learned my addr 172.21.15.38:0/2083869549 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:13.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.973+0000 7fd2437fe640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24413f970 0x7fd24406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.973+0000 7fd242ffd640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2441f2d30 0x7fd2440a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.973+0000 7fd2427fc640 1 -- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24413f970 msgr2=0x7fd24406d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.973+0000 7fd2427fc640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24413f970 0x7fd24406d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.973+0000 7fd2427fc640 1 -- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2441f2d30 msgr2=0x7fd2440a3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:13.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.973+0000 7fd2427fc640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2441f2d30 0x7fd2440a3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:13.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.973+0000 7fd2427fc640 1 -- 172.21.15.38:0/2083869549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2440a1600 con 0x7fd2440a3fc0 2023-12-22T08:43:13.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.973+0000 7fd2427fc640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2440a3fc0 0x7fd24413f430 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00e4a0 tx=0x7fd22c00e590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:13.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.973+0000 7fd23b7fe640 1 -- 172.21.15.38:0/2083869549 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c013420 con 0x7fd2440a3fc0 2023-12-22T08:43:13.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.974+0000 7fd23b7fe640 1 -- 172.21.15.38:0/2083869549 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c013580 con 0x7fd2440a3fc0 2023-12-22T08:43:13.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.974+0000 7fd23b7fe640 1 -- 172.21.15.38:0/2083869549 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c013910 con 0x7fd2440a3fc0 2023-12-22T08:43:13.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.974+0000 7fd243fff640 1 -- 172.21.15.38:0/2083869549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2440a2a40 con 0x7fd2440a3fc0 2023-12-22T08:43:13.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.974+0000 7fd243fff640 1 -- 172.21.15.38:0/2083869549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2440a2fa0 con 0x7fd2440a3fc0 2023-12-22T08:43:13.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.975+0000 7fd243fff640 1 -- 172.21.15.38:0/2083869549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2440a37a0 con 0x7fd2440a3fc0 2023-12-22T08:43:13.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.976+0000 7fd23b7fe640 1 -- 172.21.15.38:0/2083869549 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd22c013a70 con 0x7fd2440a3fc0 2023-12-22T08:43:13.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.977+0000 7fd23b7fe640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd22406a430 0x7fd22406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:13.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.977+0000 7fd23b7fe640 1 -- 172.21.15.38:0/2083869549 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd22c0891f0 con 0x7fd2440a3fc0 2023-12-22T08:43:13.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.977+0000 7fd242ffd640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd22406a430 0x7fd22406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:13.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.979+0000 7fd242ffd640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd22406a430 0x7fd22406c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd234005490 tx=0x7fd234009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:13.981+0000 7fd23b7fe640 1 -- 172.21.15.38:0/2083869549 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd2440a37a0 con 0x7fd2440a3fc0 2023-12-22T08:43:14.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.173+0000 7fd243fff640 1 -- 172.21.15.38:0/2083869549 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2440ce5d0 con 0x7fd22406a430 2023-12-22T08:43:14.176 INFO:tasks.ceph.mds.a.smithi038.stderr:2023-12-22T08:43:14.174+0000 7fd1719bd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:43:14.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.196+0000 7fd23b7fe640 1 -- 172.21.15.38:0/2083869549 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279302 (secure 0 0 0) 0x7fd234001350 con 0x7fd22406a430 2023-12-22T08:43:14.203 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:14.205 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:43:14.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.204+0000 7fd243fff640 1 -- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd22406a430 msgr2=0x7fd22406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:14.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.204+0000 7fd243fff640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd22406a430 0x7fd22406c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd234005490 tx=0x7fd234009040 comp rx=0 tx=0).stop 2023-12-22T08:43:14.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.204+0000 7fd243fff640 1 -- 172.21.15.38:0/2083869549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2440a3fc0 msgr2=0x7fd24413f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:14.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.204+0000 7fd243fff640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2440a3fc0 0x7fd24413f430 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00e4a0 tx=0x7fd22c00e590 comp rx=0 tx=0).stop 2023-12-22T08:43:14.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.204+0000 7fd243fff640 1 -- 172.21.15.38:0/2083869549 shutdown_connections 2023-12-22T08:43:14.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.204+0000 7fd243fff640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24413f970 0x7fd24406d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.204+0000 7fd243fff640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd22406a430 0x7fd22406c8f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.204+0000 7fd243fff640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2440a3fc0 0x7fd24413f430 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.204+0000 7fd243fff640 1 --2- 172.21.15.38:0/2083869549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2441f2d30 0x7fd2440a3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.204+0000 7fd243fff640 1 -- 172.21.15.38:0/2083869549 >> 172.21.15.38:0/2083869549 conn(0x7fd2440b1f70 msgr2=0x7fd2440cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:14.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.204+0000 7fd243fff640 1 -- 172.21.15.38:0/2083869549 shutdown_connections 2023-12-22T08:43:14.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.204+0000 7fd243fff640 1 -- 172.21.15.38:0/2083869549 wait complete. 2023-12-22T08:43:14.225 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2023-12-22T08:43:12.421961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3940,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558559,"statfs":{"total":1600000000,"available":1595964629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.224016"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.232117+0000","last_change":"2023-12-22T08:43:08.232117+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.232117+0000","last_undegraded":"2023-12-22T08:43:08.232117+0000","last_fullsized":"2023-12-22T08:43:08.232117+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:19.778557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.227171+0000","last_change":"2023-12-22T08:43:08.227171+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.227171+0000","last_undegraded":"2023-12-22T08:43:08.227171+0000","last_fullsized":"2023-12-22T08:43:08.227171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:38.767539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.225229+0000","last_change":"2023-12-22T08:43:08.225229+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.225229+0000","last_undegraded":"2023-12-22T08:43:08.225229+0000","last_fullsized":"2023-12-22T08:43:08.225229+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:16:21.250428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.235639+0000","last_change":"2023-12-22T08:43:08.235639+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.235639+0000","last_undegraded":"2023-12-22T08:43:08.235639+0000","last_fullsized":"2023-12-22T08:43:08.235639+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:39:28.695272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.242787+0000","last_change":"2023-12-22T08:43:08.242787+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.242787+0000","last_undegraded":"2023-12-22T08:43:08.242787+0000","last_fullsized":"2023-12-22T08:43:08.242787+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:53.820355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.231250+0000","last_change":"2023-12-22T08:43:08.231250+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.231250+0000","last_undegraded":"2023-12-22T08:43:08.231250+0000","last_fullsized":"2023-12-22T08:43:08.231250+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:08.268339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.235566+0000","last_change":"2023-12-22T08:43:08.235566+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.235566+0000","last_undegraded":"2023-12-22T08:43:08.235566+0000","last_fullsized":"2023-12-22T08:43:08.235566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:41:04.613813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.223909+0000","last_change":"2023-12-22T08:43:08.223909+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.223909+0000","last_undegraded":"2023-12-22T08:43:08.223909+0000","last_fullsized":"2023-12-22T08:43:08.223909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:17.538382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.234212+0000","last_change":"2023-12-22T08:43:08.234212+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.234212+0000","last_undegraded":"2023-12-22T08:43:08.234212+0000","last_fullsized":"2023-12-22T08:43:08.234212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:50.001477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.242266+0000","last_change":"2023-12-22T08:43:08.242266+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.242266+0000","last_undegraded":"2023-12-22T08:43:08.242266+0000","last_fullsized":"2023-12-22T08:43:08.242266+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:25.938446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.227157+0000","last_change":"2023-12-22T08:43:08.227157+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.227157+0000","last_undegraded":"2023-12-22T08:43:08.227157+0000","last_fullsized":"2023-12-22T08:43:08.227157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:59.082663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.232729+0000","last_change":"2023-12-22T08:43:08.232729+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.232729+0000","last_undegraded":"2023-12-22T08:43:08.232729+0000","last_fullsized":"2023-12-22T08:43:08.232729+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:28.563154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.223306+0000","last_change":"2023-12-22T08:43:08.223306+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.223306+0000","last_undegraded":"2023-12-22T08:43:08.223306+0000","last_fullsized":"2023-12-22T08:43:08.223306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:04.134244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.221182+0000","last_change":"2023-12-22T08:43:08.221182+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.221182+0000","last_undegraded":"2023-12-22T08:43:08.221182+0000","last_fullsized":"2023-12-22T08:43:08.221182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:31.918421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.231446+0000","last_change":"2023-12-22T08:43:08.231446+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.231446+0000","last_undegraded":"2023-12-22T08:43:08.231446+0000","last_fullsized":"2023-12-22T08:43:08.231446+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:53.820355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.230463+0000","last_change":"2023-12-22T08:43:08.230463+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.230463+0000","last_undegraded":"2023-12-22T08:43:08.230463+0000","last_fullsized":"2023-12-22T08:43:08.230463+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:43.665325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.234439+0000","last_change":"2023-12-22T08:43:08.234439+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.234439+0000","last_undegraded":"2023-12-22T08:43:08.234439+0000","last_fullsized":"2023-12-22T08:43:08.234439+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:38.811875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.220567+0000","last_change":"2023-12-22T08:43:08.220567+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.220567+0000","last_undegraded":"2023-12-22T08:43:08.220567+0000","last_fullsized":"2023-12-22T08:43:08.220567+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:05.131643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.224491+0000","last_change":"2023-12-22T08:43:08.224491+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.224491+0000","last_undegraded":"2023-12-22T08:43:08.224491+0000","last_fullsized":"2023-12-22T08:43:08.224491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:45.919846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.225996+0000","last_change":"2023-12-22T08:43:08.225996+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.225996+0000","last_undegraded":"2023-12-22T08:43:08.225996+0000","last_fullsized":"2023-12-22T08:43:08.225996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:13.722210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.236598+0000","last_change":"2023-12-22T08:43:08.236598+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.236598+0000","last_undegraded":"2023-12-22T08:43:08.236598+0000","last_fullsized":"2023-12-22T08:43:08.236598+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:38.811875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.227658+0000","last_change":"2023-12-22T08:43:08.227658+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.227658+0000","last_undegraded":"2023-12-22T08:43:08.227658+0000","last_fullsized":"2023-12-22T08:43:08.227658+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:24:55.494298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.233725+0000","last_change":"2023-12-22T08:43:08.233725+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.233725+0000","last_undegraded":"2023-12-22T08:43:08.233725+0000","last_fullsized":"2023-12-22T08:43:08.233725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:59:35.438006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.233842+0000","last_change":"2023-12-22T08:43:08.233842+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.233842+0000","last_undegraded":"2023-12-22T08:43:08.233842+0000","last_fullsized":"2023-12-22T08:43:08.233842+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:30:25.664436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.226405+0000","last_change":"2023-12-22T08:43:08.226405+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.226405+0000","last_undegraded":"2023-12-22T08:43:08.226405+0000","last_fullsized":"2023-12-22T08:43:08.226405+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:43.665325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.235253+0000","last_change":"2023-12-22T08:43:08.235253+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.235253+0000","last_undegraded":"2023-12-22T08:43:08.235253+0000","last_fullsized":"2023-12-22T08:43:08.235253+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:25.938446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.226261+0000","last_change":"2023-12-22T08:43:08.226261+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.226261+0000","last_undegraded":"2023-12-22T08:43:08.226261+0000","last_fullsized":"2023-12-22T08:43:08.226261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:28.970593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.222925+0000","last_change":"2023-12-22T08:43:08.222925+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.222925+0000","last_undegraded":"2023-12-22T08:43:08.222925+0000","last_fullsized":"2023-12-22T08:43:08.222925+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:59.082663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.230308+0000","last_change":"2023-12-22T08:43:08.230308+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.230308+0000","last_undegraded":"2023-12-22T08:43:08.230308+0000","last_fullsized":"2023-12-22T08:43:08.230308+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:22:54.223163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.227167+0000","last_change":"2023-12-22T08:43:08.227167+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.227167+0000","last_undegraded":"2023-12-22T08:43:08.227167+0000","last_fullsized":"2023-12-22T08:43:08.227167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:21.060714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.228283+0000","last_change":"2023-12-22T08:43:08.228283+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.228283+0000","last_undegraded":"2023-12-22T08:43:08.228283+0000","last_fullsized":"2023-12-22T08:43:08.228283+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:24:12.486647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.226882+0000","last_change":"2023-12-22T08:43:08.226882+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.226882+0000","last_undegraded":"2023-12-22T08:43:08.226882+0000","last_fullsized":"2023-12-22T08:43:08.226882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:31.918421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.230746+0000","last_change":"2023-12-22T08:43:08.230746+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.230746+0000","last_undegraded":"2023-12-22T08:43:08.230746+0000","last_fullsized":"2023-12-22T08:43:08.230746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:45:00.000204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.241413+0000","last_change":"2023-12-22T08:43:08.241094+0000","last_active":"2023-12-22T08:43:08.241413+0000","last_peered":"2023-12-22T08:43:08.241413+0000","last_clean":"2023-12-22T08:43:08.241413+0000","last_became_active":"2023-12-22T08:43:08.240506+0000","last_became_peered":"2023-12-22T08:43:08.240506+0000","last_unstale":"2023-12-22T08:43:08.241413+0000","last_undegraded":"2023-12-22T08:43:08.241413+0000","last_fullsized":"2023-12-22T08:43:08.241413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:26.160091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.234714+0000","last_change":"2023-12-22T08:43:08.234714+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.234714+0000","last_undegraded":"2023-12-22T08:43:08.234714+0000","last_fullsized":"2023-12-22T08:43:08.234714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:38.767539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.241677+0000","last_change":"2023-12-22T08:43:08.241565+0000","last_active":"2023-12-22T08:43:08.241677+0000","last_peered":"2023-12-22T08:43:08.241677+0000","last_clean":"2023-12-22T08:43:08.241677+0000","last_became_active":"2023-12-22T08:43:08.241298+0000","last_became_peered":"2023-12-22T08:43:08.241298+0000","last_unstale":"2023-12-22T08:43:08.241677+0000","last_undegraded":"2023-12-22T08:43:08.241677+0000","last_fullsized":"2023-12-22T08:43:08.241677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:57:12.591295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.220440+0000","last_change":"2023-12-22T08:43:08.220440+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.220440+0000","last_undegraded":"2023-12-22T08:43:08.220440+0000","last_fullsized":"2023-12-22T08:43:08.220440+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:37:20.548483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.247069+0000","last_change":"2023-12-22T08:43:08.245896+0000","last_active":"2023-12-22T08:43:08.247069+0000","last_peered":"2023-12-22T08:43:08.247069+0000","last_clean":"2023-12-22T08:43:08.247069+0000","last_became_active":"2023-12-22T08:43:08.245372+0000","last_became_peered":"2023-12-22T08:43:08.245372+0000","last_unstale":"2023-12-22T08:43:08.247069+0000","last_undegraded":"2023-12-22T08:43:08.247069+0000","last_fullsized":"2023-12-22T08:43:08.247069+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:29.623967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.237956+0000","last_change":"2023-12-22T08:43:08.237956+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.237956+0000","last_undegraded":"2023-12-22T08:43:08.237956+0000","last_fullsized":"2023-12-22T08:43:08.237956+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:34.735345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.229850+0000","last_change":"2023-12-22T08:43:08.229587+0000","last_active":"2023-12-22T08:43:08.229850+0000","last_peered":"2023-12-22T08:43:08.229850+0000","last_clean":"2023-12-22T08:43:08.229850+0000","last_became_active":"2023-12-22T08:43:08.228337+0000","last_became_peered":"2023-12-22T08:43:08.228337+0000","last_unstale":"2023-12-22T08:43:08.229850+0000","last_undegraded":"2023-12-22T08:43:08.229850+0000","last_fullsized":"2023-12-22T08:43:08.229850+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:49.938120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.222102+0000","last_change":"2023-12-22T08:43:08.222102+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.222102+0000","last_undegraded":"2023-12-22T08:43:08.222102+0000","last_fullsized":"2023-12-22T08:43:08.222102+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:09:53.006039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.233018+0000","last_change":"2023-12-22T08:43:08.230735+0000","last_active":"2023-12-22T08:43:08.233018+0000","last_peered":"2023-12-22T08:43:08.233018+0000","last_clean":"2023-12-22T08:43:08.233018+0000","last_became_active":"2023-12-22T08:43:08.227246+0000","last_became_peered":"2023-12-22T08:43:08.227246+0000","last_unstale":"2023-12-22T08:43:08.233018+0000","last_undegraded":"2023-12-22T08:43:08.233018+0000","last_fullsized":"2023-12-22T08:43:08.233018+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:44.904868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.225918+0000","last_change":"2023-12-22T08:43:08.225918+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.225918+0000","last_undegraded":"2023-12-22T08:43:08.225918+0000","last_fullsized":"2023-12-22T08:43:08.225918+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:41.615895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.247855+0000","last_change":"2023-12-22T08:43:08.247775+0000","last_active":"2023-12-22T08:43:08.247855+0000","last_peered":"2023-12-22T08:43:08.247855+0000","last_clean":"2023-12-22T08:43:08.247855+0000","last_became_active":"2023-12-22T08:43:08.247512+0000","last_became_peered":"2023-12-22T08:43:08.247512+0000","last_unstale":"2023-12-22T08:43:08.247855+0000","last_undegraded":"2023-12-22T08:43:08.247855+0000","last_fullsized":"2023-12-22T08:43:08.247855+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:46:44.813831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.222563+0000","last_change":"2023-12-22T08:43:08.222563+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.222563+0000","last_undegraded":"2023-12-22T08:43:08.222563+0000","last_fullsized":"2023-12-22T08:43:08.222563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:31:40.143949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.242989+0000","last_change":"2023-12-22T08:43:08.242191+0000","last_active":"2023-12-22T08:43:08.242989+0000","last_peered":"2023-12-22T08:43:08.242989+0000","last_clean":"2023-12-22T08:43:08.242989+0000","last_became_active":"2023-12-22T08:43:08.241783+0000","last_became_peered":"2023-12-22T08:43:08.241783+0000","last_unstale":"2023-12-22T08:43:08.242989+0000","last_undegraded":"2023-12-22T08:43:08.242989+0000","last_fullsized":"2023-12-22T08:43:08.242989+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:53.956992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.229724+0000","last_change":"2023-12-22T08:43:08.229724+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.229724+0000","last_undegraded":"2023-12-22T08:43:08.229724+0000","last_fullsized":"2023-12-22T08:43:08.229724+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:45.919846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.241154+0000","last_change":"2023-12-22T08:43:08.240904+0000","last_active":"2023-12-22T08:43:08.241154+0000","last_peered":"2023-12-22T08:43:08.241154+0000","last_clean":"2023-12-22T08:43:08.241154+0000","last_became_active":"2023-12-22T08:43:08.240539+0000","last_became_peered":"2023-12-22T08:43:08.240539+0000","last_unstale":"2023-12-22T08:43:08.241154+0000","last_undegraded":"2023-12-22T08:43:08.241154+0000","last_fullsized":"2023-12-22T08:43:08.241154+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:44.413577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.224324+0000","last_change":"2023-12-22T08:43:08.224324+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.224324+0000","last_undegraded":"2023-12-22T08:43:08.224324+0000","last_fullsized":"2023-12-22T08:43:08.224324+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:28:32.888896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.243008+0000","last_change":"2023-12-22T08:43:08.242221+0000","last_active":"2023-12-22T08:43:08.243008+0000","last_peered":"2023-12-22T08:43:08.243008+0000","last_clean":"2023-12-22T08:43:08.243008+0000","last_became_active":"2023-12-22T08:43:08.241895+0000","last_became_peered":"2023-12-22T08:43:08.241895+0000","last_unstale":"2023-12-22T08:43:08.243008+0000","last_undegraded":"2023-12-22T08:43:08.243008+0000","last_fullsized":"2023-12-22T08:43:08.243008+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:36:26.961063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.223014+0000","last_change":"2023-12-22T08:43:08.223014+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.223014+0000","last_undegraded":"2023-12-22T08:43:08.223014+0000","last_fullsized":"2023-12-22T08:43:08.223014+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:09.970458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.240937+0000","last_change":"2023-12-22T08:43:08.239881+0000","last_active":"2023-12-22T08:43:08.240937+0000","last_peered":"2023-12-22T08:43:08.240937+0000","last_clean":"2023-12-22T08:43:08.240937+0000","last_became_active":"2023-12-22T08:43:08.238285+0000","last_became_peered":"2023-12-22T08:43:08.238285+0000","last_unstale":"2023-12-22T08:43:08.240937+0000","last_undegraded":"2023-12-22T08:43:08.240937+0000","last_fullsized":"2023-12-22T08:43:08.240937+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:33.720367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.229035+0000","last_change":"2023-12-22T08:43:08.229035+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.229035+0000","last_undegraded":"2023-12-22T08:43:08.229035+0000","last_fullsized":"2023-12-22T08:43:08.229035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:17.697248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.235133+0000","last_change":"2023-12-22T08:43:08.234204+0000","last_active":"2023-12-22T08:43:08.235133+0000","last_peered":"2023-12-22T08:43:08.235133+0000","last_clean":"2023-12-22T08:43:08.235133+0000","last_became_active":"2023-12-22T08:43:08.228159+0000","last_became_peered":"2023-12-22T08:43:08.228159+0000","last_unstale":"2023-12-22T08:43:08.235133+0000","last_undegraded":"2023-12-22T08:43:08.235133+0000","last_fullsized":"2023-12-22T08:43:08.235133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:18.349374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.229291+0000","last_change":"2023-12-22T08:43:08.229291+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.229291+0000","last_undegraded":"2023-12-22T08:43:08.229291+0000","last_fullsized":"2023-12-22T08:43:08.229291+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:58.667030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.239022+0000","last_change":"2023-12-22T08:43:08.237347+0000","last_active":"2023-12-22T08:43:08.239022+0000","last_peered":"2023-12-22T08:43:08.239022+0000","last_clean":"2023-12-22T08:43:08.239022+0000","last_became_active":"2023-12-22T08:43:08.235741+0000","last_became_peered":"2023-12-22T08:43:08.235741+0000","last_unstale":"2023-12-22T08:43:08.239022+0000","last_undegraded":"2023-12-22T08:43:08.239022+0000","last_fullsized":"2023-12-22T08:43:08.239022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:27.955616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.232674+0000","last_change":"2023-12-22T08:43:08.232674+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.232674+0000","last_undegraded":"2023-12-22T08:43:08.232674+0000","last_fullsized":"2023-12-22T08:43:08.232674+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:07:12.868602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.243387+0000","last_change":"2023-12-22T08:43:08.243194+0000","last_active":"2023-12-22T08:43:08.243387+0000","last_peered":"2023-12-22T08:43:08.243387+0000","last_clean":"2023-12-22T08:43:08.243387+0000","last_became_active":"2023-12-22T08:43:08.242449+0000","last_became_peered":"2023-12-22T08:43:08.242449+0000","last_unstale":"2023-12-22T08:43:08.243387+0000","last_undegraded":"2023-12-22T08:43:08.243387+0000","last_fullsized":"2023-12-22T08:43:08.243387+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:14.817249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.221399+0000","last_change":"2023-12-22T08:43:08.221399+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.221399+0000","last_undegraded":"2023-12-22T08:43:08.221399+0000","last_fullsized":"2023-12-22T08:43:08.221399+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:07:27.247486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.238653+0000","last_change":"2023-12-22T08:43:08.238556+0000","last_active":"2023-12-22T08:43:08.238653+0000","last_peered":"2023-12-22T08:43:08.238653+0000","last_clean":"2023-12-22T08:43:08.238653+0000","last_became_active":"2023-12-22T08:43:08.238261+0000","last_became_peered":"2023-12-22T08:43:08.238261+0000","last_unstale":"2023-12-22T08:43:08.238653+0000","last_undegraded":"2023-12-22T08:43:08.238653+0000","last_fullsized":"2023-12-22T08:43:08.238653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:22.638334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.225798+0000","last_change":"2023-12-22T08:43:08.225798+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.225798+0000","last_undegraded":"2023-12-22T08:43:08.225798+0000","last_fullsized":"2023-12-22T08:43:08.225798+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:32:13.036482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.239429+0000","last_change":"2023-12-22T08:43:08.239352+0000","last_active":"2023-12-22T08:43:08.239429+0000","last_peered":"2023-12-22T08:43:08.239429+0000","last_clean":"2023-12-22T08:43:08.239429+0000","last_became_active":"2023-12-22T08:43:08.238848+0000","last_became_peered":"2023-12-22T08:43:08.238848+0000","last_unstale":"2023-12-22T08:43:08.239429+0000","last_undegraded":"2023-12-22T08:43:08.239429+0000","last_fullsized":"2023-12-22T08:43:08.239429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:12.707233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.235080+0000","last_change":"2023-12-22T08:43:08.235080+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.235080+0000","last_undegraded":"2023-12-22T08:43:08.235080+0000","last_fullsized":"2023-12-22T08:43:08.235080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:32:32.129373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.235113+0000","last_change":"2023-12-22T08:43:08.233994+0000","last_active":"2023-12-22T08:43:08.235113+0000","last_peered":"2023-12-22T08:43:08.235113+0000","last_clean":"2023-12-22T08:43:08.235113+0000","last_became_active":"2023-12-22T08:43:08.227292+0000","last_became_peered":"2023-12-22T08:43:08.227292+0000","last_unstale":"2023-12-22T08:43:08.235113+0000","last_undegraded":"2023-12-22T08:43:08.235113+0000","last_fullsized":"2023-12-22T08:43:08.235113+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:18:18.840612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.220469+0000","last_change":"2023-12-22T08:43:08.220469+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.220469+0000","last_undegraded":"2023-12-22T08:43:08.220469+0000","last_fullsized":"2023-12-22T08:43:08.220469+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:15.832226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.245808+0000","last_change":"2023-12-22T08:43:08.245684+0000","last_active":"2023-12-22T08:43:08.245808+0000","last_peered":"2023-12-22T08:43:08.245808+0000","last_clean":"2023-12-22T08:43:08.245808+0000","last_became_active":"2023-12-22T08:43:08.245434+0000","last_became_peered":"2023-12-22T08:43:08.245434+0000","last_unstale":"2023-12-22T08:43:08.245808+0000","last_undegraded":"2023-12-22T08:43:08.245808+0000","last_fullsized":"2023-12-22T08:43:08.245808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:29.623967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.219390+0000","last_change":"2023-12-22T08:43:08.219390+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.219390+0000","last_undegraded":"2023-12-22T08:43:08.219390+0000","last_fullsized":"2023-12-22T08:43:08.219390+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:41.615895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.243509+0000","last_change":"2023-12-22T08:43:08.243395+0000","last_active":"2023-12-22T08:43:08.243509+0000","last_peered":"2023-12-22T08:43:08.243509+0000","last_clean":"2023-12-22T08:43:08.243509+0000","last_became_active":"2023-12-22T08:43:08.242880+0000","last_became_peered":"2023-12-22T08:43:08.242880+0000","last_unstale":"2023-12-22T08:43:08.243509+0000","last_undegraded":"2023-12-22T08:43:08.243509+0000","last_fullsized":"2023-12-22T08:43:08.243509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:26.160091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.225411+0000","last_change":"2023-12-22T08:43:08.225411+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.225411+0000","last_undegraded":"2023-12-22T08:43:08.225411+0000","last_fullsized":"2023-12-22T08:43:08.225411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:45.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.242213+0000","last_change":"2023-12-22T08:43:08.241351+0000","last_active":"2023-12-22T08:43:08.242213+0000","last_peered":"2023-12-22T08:43:08.242213+0000","last_clean":"2023-12-22T08:43:08.242213+0000","last_became_active":"2023-12-22T08:43:08.236119+0000","last_became_peered":"2023-12-22T08:43:08.236119+0000","last_unstale":"2023-12-22T08:43:08.242213+0000","last_undegraded":"2023-12-22T08:43:08.242213+0000","last_fullsized":"2023-12-22T08:43:08.242213+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:24:11.471670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.229276+0000","last_change":"2023-12-22T08:43:08.229276+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.229276+0000","last_undegraded":"2023-12-22T08:43:08.229276+0000","last_fullsized":"2023-12-22T08:43:08.229276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:23.591214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.247098+0000","last_change":"2023-12-22T08:43:08.246777+0000","last_active":"2023-12-22T08:43:08.247098+0000","last_peered":"2023-12-22T08:43:08.247098+0000","last_clean":"2023-12-22T08:43:08.247098+0000","last_became_active":"2023-12-22T08:43:08.246524+0000","last_became_peered":"2023-12-22T08:43:08.246524+0000","last_unstale":"2023-12-22T08:43:08.247098+0000","last_undegraded":"2023-12-22T08:43:08.247098+0000","last_fullsized":"2023-12-22T08:43:08.247098+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:52.805378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.232486+0000","last_change":"2023-12-22T08:43:08.232486+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.232486+0000","last_undegraded":"2023-12-22T08:43:08.232486+0000","last_fullsized":"2023-12-22T08:43:08.232486+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:53.721528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.241033+0000","last_change":"2023-12-22T08:43:08.240892+0000","last_active":"2023-12-22T08:43:08.241033+0000","last_peered":"2023-12-22T08:43:08.241033+0000","last_clean":"2023-12-22T08:43:08.241033+0000","last_became_active":"2023-12-22T08:43:08.240027+0000","last_became_peered":"2023-12-22T08:43:08.240027+0000","last_unstale":"2023-12-22T08:43:08.241033+0000","last_undegraded":"2023-12-22T08:43:08.241033+0000","last_fullsized":"2023-12-22T08:43:08.241033+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:14.817249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.220765+0000","last_change":"2023-12-22T08:43:08.220765+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.220765+0000","last_undegraded":"2023-12-22T08:43:08.220765+0000","last_fullsized":"2023-12-22T08:43:08.220765+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:02:50.159719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.242694+0000","last_change":"2023-12-22T08:43:08.242318+0000","last_active":"2023-12-22T08:43:08.242694+0000","last_peered":"2023-12-22T08:43:08.242694+0000","last_clean":"2023-12-22T08:43:08.242694+0000","last_became_active":"2023-12-22T08:43:08.240707+0000","last_became_peered":"2023-12-22T08:43:08.240707+0000","last_unstale":"2023-12-22T08:43:08.242694+0000","last_undegraded":"2023-12-22T08:43:08.242694+0000","last_fullsized":"2023-12-22T08:43:08.242694+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:37.796898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.224109+0000","last_change":"2023-12-22T08:43:08.224109+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.224109+0000","last_undegraded":"2023-12-22T08:43:08.224109+0000","last_fullsized":"2023-12-22T08:43:08.224109+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:23.653311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.245954+0000","last_change":"2023-12-22T08:43:08.245828+0000","last_active":"2023-12-22T08:43:08.245954+0000","last_peered":"2023-12-22T08:43:08.245954+0000","last_clean":"2023-12-22T08:43:08.245954+0000","last_became_active":"2023-12-22T08:43:08.245624+0000","last_became_peered":"2023-12-22T08:43:08.245624+0000","last_unstale":"2023-12-22T08:43:08.245954+0000","last_undegraded":"2023-12-22T08:43:08.245954+0000","last_fullsized":"2023-12-22T08:43:08.245954+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:02:00.232260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.219651+0000","last_change":"2023-12-22T08:43:08.219651+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.219651+0000","last_undegraded":"2023-12-22T08:43:08.219651+0000","last_fullsized":"2023-12-22T08:43:08.219651+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:03:49.616345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.243329+0000","last_change":"2023-12-22T08:43:08.243237+0000","last_active":"2023-12-22T08:43:08.243329+0000","last_peered":"2023-12-22T08:43:08.243329+0000","last_clean":"2023-12-22T08:43:08.243329+0000","last_became_active":"2023-12-22T08:43:08.242927+0000","last_became_peered":"2023-12-22T08:43:08.242927+0000","last_unstale":"2023-12-22T08:43:08.243329+0000","last_undegraded":"2023-12-22T08:43:08.243329+0000","last_fullsized":"2023-12-22T08:43:08.243329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:13:29.194561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.220796+0000","last_change":"2023-12-22T08:43:08.220796+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.220796+0000","last_undegraded":"2023-12-22T08:43:08.220796+0000","last_fullsized":"2023-12-22T08:43:08.220796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:27.175068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.247026+0000","last_change":"2023-12-22T08:43:08.245846+0000","last_active":"2023-12-22T08:43:08.247026+0000","last_peered":"2023-12-22T08:43:08.247026+0000","last_clean":"2023-12-22T08:43:08.247026+0000","last_became_active":"2023-12-22T08:43:08.245404+0000","last_became_peered":"2023-12-22T08:43:08.245404+0000","last_unstale":"2023-12-22T08:43:08.247026+0000","last_undegraded":"2023-12-22T08:43:08.247026+0000","last_fullsized":"2023-12-22T08:43:08.247026+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:27:48.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.225493+0000","last_change":"2023-12-22T08:43:08.225493+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.225493+0000","last_undegraded":"2023-12-22T08:43:08.225493+0000","last_fullsized":"2023-12-22T08:43:08.225493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:32.067700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.238158+0000","last_change":"2023-12-22T08:43:08.238015+0000","last_active":"2023-12-22T08:43:08.238158+0000","last_peered":"2023-12-22T08:43:08.238158+0000","last_clean":"2023-12-22T08:43:08.238158+0000","last_became_active":"2023-12-22T08:43:08.237691+0000","last_became_peered":"2023-12-22T08:43:08.237691+0000","last_unstale":"2023-12-22T08:43:08.238158+0000","last_undegraded":"2023-12-22T08:43:08.238158+0000","last_fullsized":"2023-12-22T08:43:08.238158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:13:35.064619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.228188+0000","last_change":"2023-12-22T08:43:08.228188+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.228188+0000","last_undegraded":"2023-12-22T08:43:08.228188+0000","last_fullsized":"2023-12-22T08:43:08.228188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:50.953097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.228896+0000","last_change":"2023-12-22T08:43:08.228782+0000","last_active":"2023-12-22T08:43:08.228896+0000","last_peered":"2023-12-22T08:43:08.228896+0000","last_clean":"2023-12-22T08:43:08.228896+0000","last_became_active":"2023-12-22T08:43:08.228538+0000","last_became_peered":"2023-12-22T08:43:08.228538+0000","last_unstale":"2023-12-22T08:43:08.228896+0000","last_undegraded":"2023-12-22T08:43:08.228896+0000","last_fullsized":"2023-12-22T08:43:08.228896+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:44.413577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.233603+0000","last_change":"2023-12-22T08:43:08.233603+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.233603+0000","last_undegraded":"2023-12-22T08:43:08.233603+0000","last_fullsized":"2023-12-22T08:43:08.233603+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:52.037553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.246728+0000","last_change":"2023-12-22T08:43:08.246580+0000","last_active":"2023-12-22T08:43:08.246728+0000","last_peered":"2023-12-22T08:43:08.246728+0000","last_clean":"2023-12-22T08:43:08.246728+0000","last_became_active":"2023-12-22T08:43:08.246138+0000","last_became_peered":"2023-12-22T08:43:08.246138+0000","last_unstale":"2023-12-22T08:43:08.246728+0000","last_undegraded":"2023-12-22T08:43:08.246728+0000","last_fullsized":"2023-12-22T08:43:08.246728+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:54:55.545904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.226506+0000","last_change":"2023-12-22T08:43:08.226506+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.226506+0000","last_undegraded":"2023-12-22T08:43:08.226506+0000","last_fullsized":"2023-12-22T08:43:08.226506+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:19.778557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.235409+0000","last_change":"2023-12-22T08:43:08.235236+0000","last_active":"2023-12-22T08:43:08.235409+0000","last_peered":"2023-12-22T08:43:08.235409+0000","last_clean":"2023-12-22T08:43:08.235409+0000","last_became_active":"2023-12-22T08:43:08.234988+0000","last_became_peered":"2023-12-22T08:43:08.234988+0000","last_unstale":"2023-12-22T08:43:08.235409+0000","last_undegraded":"2023-12-22T08:43:08.235409+0000","last_fullsized":"2023-12-22T08:43:08.235409+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:04.865483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.227218+0000","last_change":"2023-12-22T08:43:08.227218+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.227218+0000","last_undegraded":"2023-12-22T08:43:08.227218+0000","last_fullsized":"2023-12-22T08:43:08.227218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:10:28.675275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.245764+0000","last_change":"2023-12-22T08:43:08.245686+0000","last_active":"2023-12-22T08:43:08.245764+0000","last_peered":"2023-12-22T08:43:08.245764+0000","last_clean":"2023-12-22T08:43:08.245764+0000","last_became_active":"2023-12-22T08:43:08.245056+0000","last_became_peered":"2023-12-22T08:43:08.245056+0000","last_unstale":"2023-12-22T08:43:08.245764+0000","last_undegraded":"2023-12-22T08:43:08.245764+0000","last_fullsized":"2023-12-22T08:43:08.245764+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:52:56.482108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.227978+0000","last_change":"2023-12-22T08:43:08.227978+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.227978+0000","last_undegraded":"2023-12-22T08:43:08.227978+0000","last_fullsized":"2023-12-22T08:43:08.227978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:05.880460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.243006+0000","last_change":"2023-12-22T08:43:08.242877+0000","last_active":"2023-12-22T08:43:08.243006+0000","last_peered":"2023-12-22T08:43:08.243006+0000","last_clean":"2023-12-22T08:43:08.243006+0000","last_became_active":"2023-12-22T08:43:08.241588+0000","last_became_peered":"2023-12-22T08:43:08.241588+0000","last_unstale":"2023-12-22T08:43:08.243006+0000","last_undegraded":"2023-12-22T08:43:08.243006+0000","last_fullsized":"2023-12-22T08:43:08.243006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:18.763580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2023-12-22T08:43:08.219456+0000","last_change":"2023-12-22T08:43:08.219456+0000","last_active":"2023-12-22T08:43:08.197667+0000","last_peered":"2023-12-22T08:43:08.197667+0000","last_clean":"2023-12-22T08:43:08.197667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T08:43:08.219456+0000","last_undegraded":"2023-12-22T08:43:08.219456+0000","last_fullsized":"2023-12-22T08:43:08.219456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:28.745926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.238997+0000","last_change":"2023-12-22T08:43:08.236569+0000","last_active":"2023-12-22T08:43:08.238997+0000","last_peered":"2023-12-22T08:43:08.238997+0000","last_clean":"2023-12-22T08:43:08.238997+0000","last_became_active":"2023-12-22T08:43:08.236102+0000","last_became_peered":"2023-12-22T08:43:08.236102+0000","last_unstale":"2023-12-22T08:43:08.238997+0000","last_undegraded":"2023-12-22T08:43:08.238997+0000","last_fullsized":"2023-12-22T08:43:08.238997+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:31.052723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-22T08:43:07.210223+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:43:07.210223+0000","last_peered":"2023-12-22T08:43:07.210223+0000","last_clean":"2023-12-22T08:43:07.210223+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:43:07.210223+0000","last_undegraded":"2023-12-22T08:43:07.210223+0000","last_fullsized":"2023-12-22T08:43:07.210223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194959,"statfs":{"total":200000000,"available":199638337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0780000000000001,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.075,"15min":1.0589999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.92100000000000004}]},{"osd":1,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.173,"15min":1.1579999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.872},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.1619999999999999,"15min":1.1319999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.014}]},{"osd":2,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.0860000000000001,"15min":1.056},"min":{"1min":0.78600000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.2310000000000001,"15min":1.23},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.742,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.98099999999999998}]},{"osd":3,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1240000000000001,"15min":1.0900000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.292,"15min":1.2769999999999999},"min":{"1min":0.80500000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.952,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.4370000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1899999999999999,"15min":1.194},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.764,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.117},{"interface":"front","average":{"1min":1.266,"5min":1.268,"15min":1.2629999999999999},"min":{"1min":0.64100000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.48}]},{"osd":5,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.371,"15min":1.367},"min":{"1min":0.74299999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.8120000000000001,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3660000000000001,"15min":1.3700000000000001},"min":{"1min":0.76300000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.645,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.5129999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4870000000000001,"15min":1.4850000000000001},"min":{"1min":0.83499999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.1259999999999999,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4870000000000001,"15min":1.484},"min":{"1min":0.82299999999999995,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.986}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194965,"statfs":{"total":200000000,"available":199644612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1140000000000001,"15min":1.1299999999999999},"min":{"1min":0.80500000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9350000000000001,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.0820000000000001,"15min":1.081},"min":{"1min":0.77500000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.482}]},{"osd":1,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0389999999999999,"15min":1.0189999999999999},"min":{"1min":0.79000000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.448,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.1919999999999999,"15min":1.171},"min":{"1min":1.0129999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.1679999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2529999999999999,"15min":1.272},"min":{"1min":0.82799999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7969999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.411},{"interface":"front","average":{"1min":1.268,"5min":1.1739999999999999,"15min":1.147},"min":{"1min":0.81599999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.321}]},{"osd":3,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.3160000000000001,"15min":1.298},"min":{"1min":0.94099999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.738,"5min":1.847,"15min":1.847},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.248,"15min":1.2330000000000001},"min":{"1min":0.96799999999999997,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.645,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.5389999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.403,"15min":1.411},"min":{"1min":1.0169999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.9139999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.276},{"interface":"front","average":{"1min":1.508,"5min":1.417,"15min":1.4079999999999999},"min":{"1min":1.21,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.101}]},{"osd":5,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.361,"15min":1.3640000000000001},"min":{"1min":0.92100000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.45},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.5740000000000001,"15min":1.599},"min":{"1min":1.0960000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.1030000000000002,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.5049999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.5900000000000001,"15min":1.5940000000000001},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":1.9790000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.538,"5min":1.5449999999999999,"15min":1.5589999999999999},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":1.964,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.6399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194389,"statfs":{"total":200000000,"available":199055263,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.0740000000000001,"15min":1.075},"min":{"1min":0.72999999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.637,"5min":1.944,"15min":1.944},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.123,"15min":1.135},"min":{"1min":0.68899999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.514,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.1220000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.093,"15min":1.1080000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.409,"5min":2.79,"15min":2.79},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.0289999999999999,"15min":1.012},"min":{"1min":0.78200000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.1120000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.119,"15min":1.1220000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.456,"5min":1.72,"15min":1.72},"last":1.196},{"interface":"front","average":{"1min":1.22,"5min":1.163,"15min":1.159},"min":{"1min":0.78200000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5489999999999999,"5min":1.978,"15min":1.978},"last":1.0629999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1619999999999999,"15min":1.1559999999999999},"min":{"1min":0.83399999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.506,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.083},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.226,"15min":1.2310000000000001},"min":{"1min":1.0329999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5800000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.2629999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.24,"15min":1.246},"min":{"1min":0.95499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7070000000000001,"5min":1.853,"15min":1.853},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.159,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.88100000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3069999999999999,"15min":1.3089999999999999},"min":{"1min":0.88100000000000001,"5min":0.749,"15min":0.749},"max":{"1min":1.581,"5min":1.821,"15min":1.821},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.401,"5min":1.4199999999999999,"15min":1.4259999999999999},"min":{"1min":0.89900000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.7529999999999999,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.097}]},{"osd":7,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3580000000000001,"15min":1.3620000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6359999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.038},{"interface":"front","average":{"1min":1.411,"5min":1.5409999999999999,"15min":1.575},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.788,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":0.97899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194965,"statfs":{"total":200000000,"available":199644612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.99299999999999999,"15min":1.002},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5309999999999999,"5min":1.552,"15min":1.552},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.097,"15min":1.091},"min":{"1min":0.72499999999999998,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6100000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.2689999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.042,"15min":1.0289999999999999},"min":{"1min":0.72399999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6279999999999999,"5min":1.669,"15min":1.669},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0900000000000001,"15min":1.1020000000000001},"min":{"1min":0.70499999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.794,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.157}]},{"osd":2,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1379999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5009999999999999,"5min":1.625,"15min":1.625},"last":1.008},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1850000000000001,"15min":1.1890000000000001},"min":{"1min":0.92200000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.5640000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.95999999999999996}]},{"osd":3,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2090000000000001,"15min":1.1950000000000001},"min":{"1min":0.93700000000000006,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5049999999999999,"5min":1.774,"15min":1.774},"last":1.355},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.222,"15min":1.194},"min":{"1min":1.012,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.3300000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1579999999999999,"15min":1.1299999999999999},"min":{"1min":1.016,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.3819999999999999,"15min":1.3700000000000001},"min":{"1min":1.0800000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7050000000000001,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.115}]},{"osd":6,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.248,"15min":1.226},"min":{"1min":1.0469999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.621,"5min":1.798,"15min":1.798},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.2130000000000001,"15min":1.181},"min":{"1min":1.0049999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.3009999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.367,"15min":1.323},"min":{"1min":0.97799999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.8879999999999999,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.4259999999999999,"15min":1.4019999999999999},"min":{"1min":1.2470000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.9199999999999999,"5min":1.923,"15min":1.923},"last":1.3839999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194959,"statfs":{"total":200000000,"available":199638337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.93899999999999995,"15min":0.96799999999999997},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90900000000000003,"15min":0.92900000000000005},"min":{"1min":0.5,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.85099999999999998}]},{"osd":1,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.85299999999999998,"15min":0.85699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.1020000000000001,"15min":1.1080000000000001},"min":{"1min":0.63100000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.081}]},{"osd":2,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.024,"15min":1.032},"min":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.591,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.272,"5min":1.137,"15min":1.125},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.026}]},{"osd":4,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.202,"15min":1.198},"min":{"1min":0.89900000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":1.7230000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.2350000000000001,"15min":1.222},"min":{"1min":0.77300000000000002,"5min":0.745,"15min":0.745},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.617}]},{"osd":5,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.2769999999999999,"15min":1.262},"min":{"1min":0.84599999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.532},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.413,"15min":1.4430000000000001},"min":{"1min":0.96999999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.3109999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.4330000000000001,"15min":1.4419999999999999},"min":{"1min":0.93000000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.512},{"interface":"front","average":{"1min":1.454,"5min":1.3779999999999999,"15min":1.3859999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.786}]},{"osd":7,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.361,"15min":1.365},"min":{"1min":0.85599999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.393,"15min":1.387},"min":{"1min":0.97399999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.8220000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194965,"statfs":{"total":200000000,"available":199644612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":0.83699999999999997,"15min":0.74099999999999999},"min":{"1min":0.56299999999999994,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.8879999999999999,"5min":6.8879999999999999,"15min":6.8879999999999999},"last":0.628},{"interface":"front","average":{"1min":1.246,"5min":0.97799999999999998,"15min":0.95099999999999996},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":4.5510000000000002,"5min":4.5510000000000002,"15min":4.5510000000000002},"last":0.495}]},{"osd":1,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.042,"15min":0.94499999999999995},"min":{"1min":0.59699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":11.308999999999999,"5min":11.308999999999999,"15min":11.308999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.149,"5min":0.95199999999999996,"15min":0.90600000000000003},"min":{"1min":0.70099999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.163,"15min":1.0229999999999999},"min":{"1min":0.55400000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":13.087999999999999,"5min":13.087999999999999,"15min":13.087999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.232,"15min":1.0740000000000001},"min":{"1min":0.79200000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":12.289999999999999,"5min":12.289999999999999,"15min":12.289999999999999},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.2749999999999999,"15min":1.22},"min":{"1min":1.048,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":2.1030000000000002,"5min":1.464,"15min":1.377},"min":{"1min":0.76500000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":13.927,"5min":13.927,"15min":13.927},"last":1.0920000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.9199999999999999,"5min":1.4530000000000001,"15min":1.393},"min":{"1min":0.72399999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":11.003,"5min":11.003,"15min":11.003},"last":1.0229999999999999},{"interface":"front","average":{"1min":2.0960000000000001,"5min":1.389,"15min":1.2629999999999999},"min":{"1min":0.90800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":13.129,"5min":13.129,"15min":13.129},"last":1.3160000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.3480000000000001,"15min":1.256},"min":{"1min":0.77200000000000002,"5min":0.751,"15min":0.751},"max":{"1min":8.1609999999999996,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":1.377},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.4199999999999999,"15min":1.3500000000000001},"min":{"1min":0.873,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":6.8150000000000004,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":0.94599999999999995}]},{"osd":7,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":2.0179999999999998,"5min":1.4870000000000001,"15min":1.393},"min":{"1min":0.85499999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":10.948,"5min":10.948,"15min":10.948},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.8799999999999999,"5min":1.4219999999999999,"15min":1.3300000000000001},"min":{"1min":1.0820000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":8.0980000000000008,"5min":8.0980000000000008,"15min":8.0980000000000008},"last":1.4370000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":923,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194388,"statfs":{"total":200000000,"available":199054244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.88700000000000001,"15min":0.89500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.339,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.474},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.01,"15min":1.0049999999999999},"min":{"1min":0.625,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.399,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.284,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.93999999999999995,"15min":0.93899999999999995},"min":{"1min":0.60599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.417,"5min":2.254,"15min":2.254},"last":1.077}]},{"osd":3,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.155,"15min":1.1519999999999999},"min":{"1min":0.68799999999999994,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.673,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.3420000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93500000000000005,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.94099999999999995}]},{"osd":4,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.244,"15min":1.264},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.8049999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.669},{"interface":"front","average":{"1min":1.389,"5min":1.329,"15min":1.3109999999999999},"min":{"1min":0.876,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.962,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.597}]},{"osd":5,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.93300000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":1.252},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.3560000000000001,"15min":1.3300000000000001},"min":{"1min":0.88200000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.5649999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2430000000000001,"15min":1.2410000000000001},"min":{"1min":0.81100000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.524},{"interface":"front","average":{"1min":1.359,"5min":1.347,"15min":1.353},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.9730000000000001,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.756}]},{"osd":7,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.367,"15min":1.343},"min":{"1min":1.0269999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0369999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.724},{"interface":"front","average":{"1min":1.393,"5min":1.367,"15min":1.395},"min":{"1min":0.86599999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.3079999999999998,"5min":3.2959999999999998,"15min":3.2959999999999998},"last":1.637}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":347,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194965,"statfs":{"total":200000000,"available":199644612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.88500000000000001,"15min":0.89300000000000002},"min":{"1min":0.53800000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.4259999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.1950000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.79000000000000004,"15min":0.78200000000000003},"min":{"1min":0.442,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.93400000000000005,"15min":0.91900000000000004},"min":{"1min":0.45900000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.429}]},{"osd":3,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0149999999999999,"15min":1.0029999999999999},"min":{"1min":0.58499999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.744,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.071,"15min":1.0349999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.2509999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.27,"15min":1.2569999999999999},"min":{"1min":1.024,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.671,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.2270000000000001,"15min":1.1990000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.651,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.468}]},{"osd":5,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.242,"15min":1.24},"min":{"1min":0.80600000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.671},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.258,"15min":1.2509999999999999},"min":{"1min":0.90600000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.839,"5min":1.885,"15min":1.885},"last":1.383}]},{"osd":6,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.288,"15min":1.268},"min":{"1min":0.78600000000000003,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.175},{"interface":"front","average":{"1min":1.383,"5min":1.367,"15min":1.373},"min":{"1min":1.008,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.0649999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.8340000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3400000000000001,"15min":1.3480000000000001},"min":{"1min":0.97099999999999997,"5min":0.755,"15min":0.755},"max":{"1min":1.768,"5min":1.79,"15min":1.79},"last":1.887},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3700000000000001,"15min":1.3640000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.9510000000000001,"5min":2.214,"15min":2.214},"last":1.6240000000000001}]}]}],"pool_statfs":[]}} 2023-12-22T08:43:14.230 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:43:14.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.492+0000 7f188d680640 1 Processor -- start 2023-12-22T08:43:14.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.492+0000 7f188d680640 1 -- start start 2023-12-22T08:43:14.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.494+0000 7f188d680640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18880b3ff0 0x7f188806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:14.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.494+0000 7f188d680640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f18880b44a0 0x7f188806d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:14.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.494+0000 7f188d680640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188815f220 con 0x7f1888157980 2023-12-22T08:43:14.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.494+0000 7f188d680640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18880d1520 con 0x7f18880b3ff0 2023-12-22T08:43:14.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.494+0000 7f188d680640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18880d1800 con 0x7f18880b44a0 2023-12-22T08:43:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.494+0000 7f187ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18880b3ff0 0x7f188806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.494+0000 7f187ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18880b3ff0 0x7f188806cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33936/0 (socket says 172.21.15.38:33936) 2023-12-22T08:43:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.494+0000 7f187ffff640 1 -- 172.21.15.38:0/1748716246 learned_addr learned my addr 172.21.15.38:0/1748716246 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.495+0000 7f188ce7f640 1 --2- 172.21.15.38:0/1748716246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f18880b44a0 0x7f188806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.495+0000 7f187ffff640 1 -- 172.21.15.38:0/1748716246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f18880b44a0 msgr2=0x7f188806d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.495+0000 7f187ffff640 1 --2- 172.21.15.38:0/1748716246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f18880b44a0 0x7f188806d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.495+0000 7f187ffff640 1 -- 172.21.15.38:0/1748716246 >> v1:172.21.15.89:6789/0 conn(0x7f1888157980 legacy=0x7f188815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:14.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.495+0000 7f187ffff640 1 -- 172.21.15.38:0/1748716246 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18880d1ae0 con 0x7f18880b3ff0 2023-12-22T08:43:14.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.496+0000 7f187ffff640 1 --2- 172.21.15.38:0/1748716246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18880b3ff0 0x7f188806cf30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1870009870 tx=0x7f187002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b813a017445d82 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:14.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.496+0000 7f18877fe640 1 -- 172.21.15.38:0/1748716246 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870031640 con 0x7f18880b3ff0 2023-12-22T08:43:14.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.496+0000 7f18877fe640 1 -- 172.21.15.38:0/1748716246 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18700317a0 con 0x7f18880b3ff0 2023-12-22T08:43:14.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.496+0000 7f18877fe640 1 -- 172.21.15.38:0/1748716246 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870031b30 con 0x7f18880b3ff0 2023-12-22T08:43:14.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.497+0000 7f188d680640 1 -- 172.21.15.38:0/1748716246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18880b3ff0 msgr2=0x7f188806cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:14.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.497+0000 7f188d680640 1 --2- 172.21.15.38:0/1748716246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18880b3ff0 0x7f188806cf30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1870009870 tx=0x7f187002b8f0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.497+0000 7f188d680640 1 -- 172.21.15.38:0/1748716246 shutdown_connections 2023-12-22T08:43:14.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.497+0000 7f188d680640 1 --2- 172.21.15.38:0/1748716246 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18880b3ff0 0x7f188806cf30 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.497+0000 7f188d680640 1 --2- 172.21.15.38:0/1748716246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f18880b44a0 0x7f188806d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.497+0000 7f188d680640 1 -- 172.21.15.38:0/1748716246 >> 172.21.15.38:0/1748716246 conn(0x7f18880d31f0 msgr2=0x7f18880d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:14.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.497+0000 7f188d680640 1 -- 172.21.15.38:0/1748716246 shutdown_connections 2023-12-22T08:43:14.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.497+0000 7f188d680640 1 -- 172.21.15.38:0/1748716246 wait complete. 2023-12-22T08:43:14.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.499+0000 7f188d680640 1 Processor -- start 2023-12-22T08:43:14.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.499+0000 7f188d680640 1 -- start start 2023-12-22T08:43:14.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.500+0000 7f188d680640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18880b3ff0 0x7f188814d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:14.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.500+0000 7f188d680640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f18880b44a0 0x7f1888152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:14.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.500+0000 7f188d680640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888157980 0x7f188806f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:14.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.500+0000 7f188d680640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1888150cf0 con 0x7f1888157980 2023-12-22T08:43:14.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.500+0000 7f188d680640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1888150170 con 0x7f18880b3ff0 2023-12-22T08:43:14.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.500+0000 7f188d680640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18881503c0 con 0x7f18880b44a0 2023-12-22T08:43:14.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.500+0000 7f188ce7f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888157980 0x7f188806f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:14.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.500+0000 7f188ce7f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888157980 0x7f188806f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33942/0 (socket says 172.21.15.38:33942) 2023-12-22T08:43:14.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.500+0000 7f188ce7f640 1 -- 172.21.15.38:0/1473326437 learned_addr learned my addr 172.21.15.38:0/1473326437 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:14.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.501+0000 7f1887fff640 1 --2- 172.21.15.38:0/1473326437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18880b3ff0 0x7f188814d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:14.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.501+0000 7f188ce7f640 1 -- 172.21.15.38:0/1473326437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f18880b44a0 msgr2=0x7f1888152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:14.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.501+0000 7f188ce7f640 1 --2- 172.21.15.38:0/1473326437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f18880b44a0 0x7f1888152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.501+0000 7f188ce7f640 1 -- 172.21.15.38:0/1473326437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18880b3ff0 msgr2=0x7f188814d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:14.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.501+0000 7f188ce7f640 1 --2- 172.21.15.38:0/1473326437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18880b3ff0 0x7f188814d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.501+0000 7f188ce7f640 1 -- 172.21.15.38:0/1473326437 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700094d0 con 0x7f1888157980 2023-12-22T08:43:14.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.501+0000 7f188ce7f640 1 --2- 172.21.15.38:0/1473326437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888157980 0x7f188806f650 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1880007e40 tx=0x7f188000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:14.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.501+0000 7f18857fa640 1 -- 172.21.15.38:0/1473326437 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880014620 con 0x7f1888157980 2023-12-22T08:43:14.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.501+0000 7f18857fa640 1 -- 172.21.15.38:0/1473326437 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188000ee90 con 0x7f1888157980 2023-12-22T08:43:14.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.501+0000 7f18857fa640 1 -- 172.21.15.38:0/1473326437 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18800149e0 con 0x7f1888157980 2023-12-22T08:43:14.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.501+0000 7f188d680640 1 -- 172.21.15.38:0/1473326437 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18881506a0 con 0x7f1888157980 2023-12-22T08:43:14.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.501+0000 7f188d680640 1 -- 172.21.15.38:0/1473326437 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188814d950 con 0x7f1888157980 2023-12-22T08:43:14.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.503+0000 7f188d680640 1 -- 172.21.15.38:0/1473326437 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1888150ea0 con 0x7f1888157980 2023-12-22T08:43:14.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.503+0000 7f18857fa640 1 -- 172.21.15.38:0/1473326437 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1880014b40 con 0x7f1888157980 2023-12-22T08:43:14.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.504+0000 7f18857fa640 1 --2- 172.21.15.38:0/1473326437 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f186806a430 0x7f186806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:14.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.504+0000 7f18857fa640 1 -- 172.21.15.38:0/1473326437 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18800892c0 con 0x7f1888157980 2023-12-22T08:43:14.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.505+0000 7f1887fff640 1 --2- 172.21.15.38:0/1473326437 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f186806a430 0x7f186806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:14.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.506+0000 7f1887fff640 1 --2- 172.21.15.38:0/1473326437 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f186806a430 0x7f186806c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1878003d90 tx=0x7f1878009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:14.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.508+0000 7f18857fa640 1 -- 172.21.15.38:0/1473326437 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1888150ea0 con 0x7f1888157980 2023-12-22T08:43:14.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.698+0000 7f188d680640 1 -- 172.21.15.38:0/1473326437 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18880d20a0 con 0x7f186806a430 2023-12-22T08:43:14.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.720+0000 7f18857fa640 1 -- 172.21.15.38:0/1473326437 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282283 (secure 0 0 0) 0x7f1878003a30 con 0x7f186806a430 2023-12-22T08:43:14.728 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:14.730 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:43:14.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.725+0000 7f188d680640 1 -- 172.21.15.38:0/1473326437 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f186806a430 msgr2=0x7f186806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:14.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.725+0000 7f188d680640 1 --2- 172.21.15.38:0/1473326437 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f186806a430 0x7f186806c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1878003d90 tx=0x7f1878009040 comp rx=0 tx=0).stop 2023-12-22T08:43:14.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.725+0000 7f188d680640 1 -- 172.21.15.38:0/1473326437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888157980 msgr2=0x7f188806f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:14.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.725+0000 7f188d680640 1 --2- 172.21.15.38:0/1473326437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888157980 0x7f188806f650 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1880007e40 tx=0x7f188000e4b0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.726+0000 7f188d680640 1 -- 172.21.15.38:0/1473326437 shutdown_connections 2023-12-22T08:43:14.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.726+0000 7f188d680640 1 --2- 172.21.15.38:0/1473326437 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f186806a430 0x7f186806c8f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.726+0000 7f188d680640 1 --2- 172.21.15.38:0/1473326437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888157980 0x7f188806f650 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.726+0000 7f188d680640 1 --2- 172.21.15.38:0/1473326437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f18880b44a0 0x7f1888152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.726+0000 7f188d680640 1 --2- 172.21.15.38:0/1473326437 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18880b3ff0 0x7f188814d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:14.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.726+0000 7f188d680640 1 -- 172.21.15.38:0/1473326437 >> 172.21.15.38:0/1473326437 conn(0x7f18880d31f0 msgr2=0x7f188815f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:14.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.726+0000 7f188d680640 1 -- 172.21.15.38:0/1473326437 shutdown_connections 2023-12-22T08:43:14.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:14.726+0000 7f188d680640 1 -- 172.21.15.38:0/1473326437 wait complete. 2023-12-22T08:43:14.746 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2023-12-22T08:43:14.422606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4084,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558415,"statfs":{"total":1600000000,"available":1595817655,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.207446"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.769139+0000","last_change":"2023-12-22T08:43:08.768994+0000","last_active":"2023-12-22T08:43:08.769139+0000","last_peered":"2023-12-22T08:43:08.769139+0000","last_clean":"2023-12-22T08:43:08.769139+0000","last_became_active":"2023-12-22T08:43:08.767875+0000","last_became_peered":"2023-12-22T08:43:08.767875+0000","last_unstale":"2023-12-22T08:43:08.769139+0000","last_undegraded":"2023-12-22T08:43:08.769139+0000","last_fullsized":"2023-12-22T08:43:08.769139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:19.778557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780504+0000","last_change":"2023-12-22T08:43:08.780418+0000","last_active":"2023-12-22T08:43:08.780504+0000","last_peered":"2023-12-22T08:43:08.780504+0000","last_clean":"2023-12-22T08:43:08.780504+0000","last_became_active":"2023-12-22T08:43:08.779658+0000","last_became_peered":"2023-12-22T08:43:08.779658+0000","last_unstale":"2023-12-22T08:43:08.780504+0000","last_undegraded":"2023-12-22T08:43:08.780504+0000","last_fullsized":"2023-12-22T08:43:08.780504+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:38.767539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760810+0000","last_change":"2023-12-22T08:43:08.760735+0000","last_active":"2023-12-22T08:43:08.760810+0000","last_peered":"2023-12-22T08:43:08.760810+0000","last_clean":"2023-12-22T08:43:08.760810+0000","last_became_active":"2023-12-22T08:43:08.760505+0000","last_became_peered":"2023-12-22T08:43:08.760505+0000","last_unstale":"2023-12-22T08:43:08.760810+0000","last_undegraded":"2023-12-22T08:43:08.760810+0000","last_fullsized":"2023-12-22T08:43:08.760810+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:16:21.250428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.766653+0000","last_change":"2023-12-22T08:43:08.766231+0000","last_active":"2023-12-22T08:43:08.766653+0000","last_peered":"2023-12-22T08:43:08.766653+0000","last_clean":"2023-12-22T08:43:08.766653+0000","last_became_active":"2023-12-22T08:43:08.765962+0000","last_became_peered":"2023-12-22T08:43:08.765962+0000","last_unstale":"2023-12-22T08:43:08.766653+0000","last_undegraded":"2023-12-22T08:43:08.766653+0000","last_fullsized":"2023-12-22T08:43:08.766653+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:39:28.695272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765417+0000","last_change":"2023-12-22T08:43:08.764141+0000","last_active":"2023-12-22T08:43:08.765417+0000","last_peered":"2023-12-22T08:43:08.765417+0000","last_clean":"2023-12-22T08:43:08.765417+0000","last_became_active":"2023-12-22T08:43:08.760446+0000","last_became_peered":"2023-12-22T08:43:08.760446+0000","last_unstale":"2023-12-22T08:43:08.765417+0000","last_undegraded":"2023-12-22T08:43:08.765417+0000","last_fullsized":"2023-12-22T08:43:08.765417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:53.820355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765491+0000","last_change":"2023-12-22T08:43:08.765266+0000","last_active":"2023-12-22T08:43:08.765491+0000","last_peered":"2023-12-22T08:43:08.765491+0000","last_clean":"2023-12-22T08:43:08.765491+0000","last_became_active":"2023-12-22T08:43:08.764819+0000","last_became_peered":"2023-12-22T08:43:08.764819+0000","last_unstale":"2023-12-22T08:43:08.765491+0000","last_undegraded":"2023-12-22T08:43:08.765491+0000","last_fullsized":"2023-12-22T08:43:08.765491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:08.268339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.761773+0000","last_change":"2023-12-22T08:43:08.761706+0000","last_active":"2023-12-22T08:43:08.761773+0000","last_peered":"2023-12-22T08:43:08.761773+0000","last_clean":"2023-12-22T08:43:08.761773+0000","last_became_active":"2023-12-22T08:43:08.761392+0000","last_became_peered":"2023-12-22T08:43:08.761392+0000","last_unstale":"2023-12-22T08:43:08.761773+0000","last_undegraded":"2023-12-22T08:43:08.761773+0000","last_fullsized":"2023-12-22T08:43:08.761773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:41:04.613813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780490+0000","last_change":"2023-12-22T08:43:08.780082+0000","last_active":"2023-12-22T08:43:08.780490+0000","last_peered":"2023-12-22T08:43:08.780490+0000","last_clean":"2023-12-22T08:43:08.780490+0000","last_became_active":"2023-12-22T08:43:08.775897+0000","last_became_peered":"2023-12-22T08:43:08.775897+0000","last_unstale":"2023-12-22T08:43:08.780490+0000","last_undegraded":"2023-12-22T08:43:08.780490+0000","last_fullsized":"2023-12-22T08:43:08.780490+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:17.538382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.770465+0000","last_change":"2023-12-22T08:43:08.768897+0000","last_active":"2023-12-22T08:43:08.770465+0000","last_peered":"2023-12-22T08:43:08.770465+0000","last_clean":"2023-12-22T08:43:08.770465+0000","last_became_active":"2023-12-22T08:43:08.768331+0000","last_became_peered":"2023-12-22T08:43:08.768331+0000","last_unstale":"2023-12-22T08:43:08.770465+0000","last_undegraded":"2023-12-22T08:43:08.770465+0000","last_fullsized":"2023-12-22T08:43:08.770465+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:50.001477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765434+0000","last_change":"2023-12-22T08:43:08.764540+0000","last_active":"2023-12-22T08:43:08.765434+0000","last_peered":"2023-12-22T08:43:08.765434+0000","last_clean":"2023-12-22T08:43:08.765434+0000","last_became_active":"2023-12-22T08:43:08.763549+0000","last_became_peered":"2023-12-22T08:43:08.763549+0000","last_unstale":"2023-12-22T08:43:08.765434+0000","last_undegraded":"2023-12-22T08:43:08.765434+0000","last_fullsized":"2023-12-22T08:43:08.765434+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:25.938446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765998+0000","last_change":"2023-12-22T08:43:08.763811+0000","last_active":"2023-12-22T08:43:08.765998+0000","last_peered":"2023-12-22T08:43:08.765998+0000","last_clean":"2023-12-22T08:43:08.765998+0000","last_became_active":"2023-12-22T08:43:08.763370+0000","last_became_peered":"2023-12-22T08:43:08.763370+0000","last_unstale":"2023-12-22T08:43:08.765998+0000","last_undegraded":"2023-12-22T08:43:08.765998+0000","last_fullsized":"2023-12-22T08:43:08.765998+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:59.082663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.758061+0000","last_change":"2023-12-22T08:43:08.757253+0000","last_active":"2023-12-22T08:43:08.758061+0000","last_peered":"2023-12-22T08:43:08.758061+0000","last_clean":"2023-12-22T08:43:08.758061+0000","last_became_active":"2023-12-22T08:43:08.756898+0000","last_became_peered":"2023-12-22T08:43:08.756898+0000","last_unstale":"2023-12-22T08:43:08.758061+0000","last_undegraded":"2023-12-22T08:43:08.758061+0000","last_fullsized":"2023-12-22T08:43:08.758061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:28.563154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774725+0000","last_change":"2023-12-22T08:43:08.774645+0000","last_active":"2023-12-22T08:43:08.774725+0000","last_peered":"2023-12-22T08:43:08.774725+0000","last_clean":"2023-12-22T08:43:08.774725+0000","last_became_active":"2023-12-22T08:43:08.774481+0000","last_became_peered":"2023-12-22T08:43:08.774481+0000","last_unstale":"2023-12-22T08:43:08.774725+0000","last_undegraded":"2023-12-22T08:43:08.774725+0000","last_fullsized":"2023-12-22T08:43:08.774725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:04.134244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775790+0000","last_change":"2023-12-22T08:43:08.775710+0000","last_active":"2023-12-22T08:43:08.775790+0000","last_peered":"2023-12-22T08:43:08.775790+0000","last_clean":"2023-12-22T08:43:08.775790+0000","last_became_active":"2023-12-22T08:43:08.775344+0000","last_became_peered":"2023-12-22T08:43:08.775344+0000","last_unstale":"2023-12-22T08:43:08.775790+0000","last_undegraded":"2023-12-22T08:43:08.775790+0000","last_fullsized":"2023-12-22T08:43:08.775790+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:31.918421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768154+0000","last_change":"2023-12-22T08:43:08.768085+0000","last_active":"2023-12-22T08:43:08.768154+0000","last_peered":"2023-12-22T08:43:08.768154+0000","last_clean":"2023-12-22T08:43:08.768154+0000","last_became_active":"2023-12-22T08:43:08.767893+0000","last_became_peered":"2023-12-22T08:43:08.767893+0000","last_unstale":"2023-12-22T08:43:08.768154+0000","last_undegraded":"2023-12-22T08:43:08.768154+0000","last_fullsized":"2023-12-22T08:43:08.768154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:53.820355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765401+0000","last_change":"2023-12-22T08:43:08.764151+0000","last_active":"2023-12-22T08:43:08.765401+0000","last_peered":"2023-12-22T08:43:08.765401+0000","last_clean":"2023-12-22T08:43:08.765401+0000","last_became_active":"2023-12-22T08:43:08.763651+0000","last_became_peered":"2023-12-22T08:43:08.763651+0000","last_unstale":"2023-12-22T08:43:08.765401+0000","last_undegraded":"2023-12-22T08:43:08.765401+0000","last_fullsized":"2023-12-22T08:43:08.765401+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:43.665325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765450+0000","last_change":"2023-12-22T08:43:08.764908+0000","last_active":"2023-12-22T08:43:08.765450+0000","last_peered":"2023-12-22T08:43:08.765450+0000","last_clean":"2023-12-22T08:43:08.765450+0000","last_became_active":"2023-12-22T08:43:08.761599+0000","last_became_peered":"2023-12-22T08:43:08.761599+0000","last_unstale":"2023-12-22T08:43:08.765450+0000","last_undegraded":"2023-12-22T08:43:08.765450+0000","last_fullsized":"2023-12-22T08:43:08.765450+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:38.811875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774213+0000","last_change":"2023-12-22T08:43:08.774063+0000","last_active":"2023-12-22T08:43:08.774213+0000","last_peered":"2023-12-22T08:43:08.774213+0000","last_clean":"2023-12-22T08:43:08.774213+0000","last_became_active":"2023-12-22T08:43:08.773691+0000","last_became_peered":"2023-12-22T08:43:08.773691+0000","last_unstale":"2023-12-22T08:43:08.774213+0000","last_undegraded":"2023-12-22T08:43:08.774213+0000","last_fullsized":"2023-12-22T08:43:08.774213+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:05.131643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778977+0000","last_change":"2023-12-22T08:43:08.778665+0000","last_active":"2023-12-22T08:43:08.778977+0000","last_peered":"2023-12-22T08:43:08.778977+0000","last_clean":"2023-12-22T08:43:08.778977+0000","last_became_active":"2023-12-22T08:43:08.778435+0000","last_became_peered":"2023-12-22T08:43:08.778435+0000","last_unstale":"2023-12-22T08:43:08.778977+0000","last_undegraded":"2023-12-22T08:43:08.778977+0000","last_fullsized":"2023-12-22T08:43:08.778977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:45.919846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.767546+0000","last_change":"2023-12-22T08:43:08.767403+0000","last_active":"2023-12-22T08:43:08.767546+0000","last_peered":"2023-12-22T08:43:08.767546+0000","last_clean":"2023-12-22T08:43:08.767546+0000","last_became_active":"2023-12-22T08:43:08.766987+0000","last_became_peered":"2023-12-22T08:43:08.766987+0000","last_unstale":"2023-12-22T08:43:08.767546+0000","last_undegraded":"2023-12-22T08:43:08.767546+0000","last_fullsized":"2023-12-22T08:43:08.767546+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:13.722210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760231+0000","last_change":"2023-12-22T08:43:08.759198+0000","last_active":"2023-12-22T08:43:08.760231+0000","last_peered":"2023-12-22T08:43:08.760231+0000","last_clean":"2023-12-22T08:43:08.760231+0000","last_became_active":"2023-12-22T08:43:08.758223+0000","last_became_peered":"2023-12-22T08:43:08.758223+0000","last_unstale":"2023-12-22T08:43:08.760231+0000","last_undegraded":"2023-12-22T08:43:08.760231+0000","last_fullsized":"2023-12-22T08:43:08.760231+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:38.811875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.781265+0000","last_change":"2023-12-22T08:43:08.781203+0000","last_active":"2023-12-22T08:43:08.781265+0000","last_peered":"2023-12-22T08:43:08.781265+0000","last_clean":"2023-12-22T08:43:08.781265+0000","last_became_active":"2023-12-22T08:43:08.780644+0000","last_became_peered":"2023-12-22T08:43:08.780644+0000","last_unstale":"2023-12-22T08:43:08.781265+0000","last_undegraded":"2023-12-22T08:43:08.781265+0000","last_fullsized":"2023-12-22T08:43:08.781265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:24:55.494298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774057+0000","last_change":"2023-12-22T08:43:08.773780+0000","last_active":"2023-12-22T08:43:08.774057+0000","last_peered":"2023-12-22T08:43:08.774057+0000","last_clean":"2023-12-22T08:43:08.774057+0000","last_became_active":"2023-12-22T08:43:08.773551+0000","last_became_peered":"2023-12-22T08:43:08.773551+0000","last_unstale":"2023-12-22T08:43:08.774057+0000","last_undegraded":"2023-12-22T08:43:08.774057+0000","last_fullsized":"2023-12-22T08:43:08.774057+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:59:35.438006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.770483+0000","last_change":"2023-12-22T08:43:08.769139+0000","last_active":"2023-12-22T08:43:08.770483+0000","last_peered":"2023-12-22T08:43:08.770483+0000","last_clean":"2023-12-22T08:43:08.770483+0000","last_became_active":"2023-12-22T08:43:08.768657+0000","last_became_peered":"2023-12-22T08:43:08.768657+0000","last_unstale":"2023-12-22T08:43:08.770483+0000","last_undegraded":"2023-12-22T08:43:08.770483+0000","last_fullsized":"2023-12-22T08:43:08.770483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:30:25.664436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.782335+0000","last_change":"2023-12-22T08:43:08.782157+0000","last_active":"2023-12-22T08:43:08.782335+0000","last_peered":"2023-12-22T08:43:08.782335+0000","last_clean":"2023-12-22T08:43:08.782335+0000","last_became_active":"2023-12-22T08:43:08.781718+0000","last_became_peered":"2023-12-22T08:43:08.781718+0000","last_unstale":"2023-12-22T08:43:08.782335+0000","last_undegraded":"2023-12-22T08:43:08.782335+0000","last_fullsized":"2023-12-22T08:43:08.782335+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:43.665325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760265+0000","last_change":"2023-12-22T08:43:08.759714+0000","last_active":"2023-12-22T08:43:08.760265+0000","last_peered":"2023-12-22T08:43:08.760265+0000","last_clean":"2023-12-22T08:43:08.760265+0000","last_became_active":"2023-12-22T08:43:08.759458+0000","last_became_peered":"2023-12-22T08:43:08.759458+0000","last_unstale":"2023-12-22T08:43:08.760265+0000","last_undegraded":"2023-12-22T08:43:08.760265+0000","last_fullsized":"2023-12-22T08:43:08.760265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:25.938446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778850+0000","last_change":"2023-12-22T08:43:08.778079+0000","last_active":"2023-12-22T08:43:08.778850+0000","last_peered":"2023-12-22T08:43:08.778850+0000","last_clean":"2023-12-22T08:43:08.778850+0000","last_became_active":"2023-12-22T08:43:08.777828+0000","last_became_peered":"2023-12-22T08:43:08.777828+0000","last_unstale":"2023-12-22T08:43:08.778850+0000","last_undegraded":"2023-12-22T08:43:08.778850+0000","last_fullsized":"2023-12-22T08:43:08.778850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:28.970593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.776001+0000","last_change":"2023-12-22T08:43:08.775431+0000","last_active":"2023-12-22T08:43:08.776001+0000","last_peered":"2023-12-22T08:43:08.776001+0000","last_clean":"2023-12-22T08:43:08.776001+0000","last_became_active":"2023-12-22T08:43:08.770714+0000","last_became_peered":"2023-12-22T08:43:08.770714+0000","last_unstale":"2023-12-22T08:43:08.776001+0000","last_undegraded":"2023-12-22T08:43:08.776001+0000","last_fullsized":"2023-12-22T08:43:08.776001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:59.082663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778321+0000","last_change":"2023-12-22T08:43:08.777124+0000","last_active":"2023-12-22T08:43:08.778321+0000","last_peered":"2023-12-22T08:43:08.778321+0000","last_clean":"2023-12-22T08:43:08.778321+0000","last_became_active":"2023-12-22T08:43:08.776768+0000","last_became_peered":"2023-12-22T08:43:08.776768+0000","last_unstale":"2023-12-22T08:43:08.778321+0000","last_undegraded":"2023-12-22T08:43:08.778321+0000","last_fullsized":"2023-12-22T08:43:08.778321+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:22:54.223163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.759180+0000","last_change":"2023-12-22T08:43:08.759112+0000","last_active":"2023-12-22T08:43:08.759180+0000","last_peered":"2023-12-22T08:43:08.759180+0000","last_clean":"2023-12-22T08:43:08.759180+0000","last_became_active":"2023-12-22T08:43:08.758739+0000","last_became_peered":"2023-12-22T08:43:08.758739+0000","last_unstale":"2023-12-22T08:43:08.759180+0000","last_undegraded":"2023-12-22T08:43:08.759180+0000","last_fullsized":"2023-12-22T08:43:08.759180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:21.060714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.776206+0000","last_change":"2023-12-22T08:43:08.775929+0000","last_active":"2023-12-22T08:43:08.776206+0000","last_peered":"2023-12-22T08:43:08.776206+0000","last_clean":"2023-12-22T08:43:08.776206+0000","last_became_active":"2023-12-22T08:43:08.775705+0000","last_became_peered":"2023-12-22T08:43:08.775705+0000","last_unstale":"2023-12-22T08:43:08.776206+0000","last_undegraded":"2023-12-22T08:43:08.776206+0000","last_fullsized":"2023-12-22T08:43:08.776206+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:24:12.486647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780952+0000","last_change":"2023-12-22T08:43:08.780870+0000","last_active":"2023-12-22T08:43:08.780952+0000","last_peered":"2023-12-22T08:43:08.780952+0000","last_clean":"2023-12-22T08:43:08.780952+0000","last_became_active":"2023-12-22T08:43:08.779502+0000","last_became_peered":"2023-12-22T08:43:08.779502+0000","last_unstale":"2023-12-22T08:43:08.780952+0000","last_undegraded":"2023-12-22T08:43:08.780952+0000","last_fullsized":"2023-12-22T08:43:08.780952+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:31.918421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768828+0000","last_change":"2023-12-22T08:43:08.768756+0000","last_active":"2023-12-22T08:43:08.768828+0000","last_peered":"2023-12-22T08:43:08.768828+0000","last_clean":"2023-12-22T08:43:08.768828+0000","last_became_active":"2023-12-22T08:43:08.767824+0000","last_became_peered":"2023-12-22T08:43:08.767824+0000","last_unstale":"2023-12-22T08:43:08.768828+0000","last_undegraded":"2023-12-22T08:43:08.768828+0000","last_fullsized":"2023-12-22T08:43:08.768828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:45:00.000204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"71'4","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778049+0000","last_change":"2023-12-22T08:43:08.241094+0000","last_active":"2023-12-22T08:43:08.778049+0000","last_peered":"2023-12-22T08:43:08.778049+0000","last_clean":"2023-12-22T08:43:08.778049+0000","last_became_active":"2023-12-22T08:43:08.240506+0000","last_became_peered":"2023-12-22T08:43:08.240506+0000","last_unstale":"2023-12-22T08:43:08.778049+0000","last_undegraded":"2023-12-22T08:43:08.778049+0000","last_fullsized":"2023-12-22T08:43:08.778049+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:26.160091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765315+0000","last_change":"2023-12-22T08:43:08.759468+0000","last_active":"2023-12-22T08:43:08.765315+0000","last_peered":"2023-12-22T08:43:08.765315+0000","last_clean":"2023-12-22T08:43:08.765315+0000","last_became_active":"2023-12-22T08:43:08.758667+0000","last_became_peered":"2023-12-22T08:43:08.758667+0000","last_unstale":"2023-12-22T08:43:08.765315+0000","last_undegraded":"2023-12-22T08:43:08.765315+0000","last_fullsized":"2023-12-22T08:43:08.765315+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:38.767539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778760+0000","last_change":"2023-12-22T08:43:08.241565+0000","last_active":"2023-12-22T08:43:08.778760+0000","last_peered":"2023-12-22T08:43:08.778760+0000","last_clean":"2023-12-22T08:43:08.778760+0000","last_became_active":"2023-12-22T08:43:08.241298+0000","last_became_peered":"2023-12-22T08:43:08.241298+0000","last_unstale":"2023-12-22T08:43:08.778760+0000","last_undegraded":"2023-12-22T08:43:08.778760+0000","last_fullsized":"2023-12-22T08:43:08.778760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:57:12.591295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772898+0000","last_change":"2023-12-22T08:43:08.770501+0000","last_active":"2023-12-22T08:43:08.772898+0000","last_peered":"2023-12-22T08:43:08.772898+0000","last_clean":"2023-12-22T08:43:08.772898+0000","last_became_active":"2023-12-22T08:43:08.770276+0000","last_became_peered":"2023-12-22T08:43:08.770276+0000","last_unstale":"2023-12-22T08:43:08.772898+0000","last_undegraded":"2023-12-22T08:43:08.772898+0000","last_fullsized":"2023-12-22T08:43:08.772898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:37:20.548483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.777583+0000","last_change":"2023-12-22T08:43:08.245896+0000","last_active":"2023-12-22T08:43:08.777583+0000","last_peered":"2023-12-22T08:43:08.777583+0000","last_clean":"2023-12-22T08:43:08.777583+0000","last_became_active":"2023-12-22T08:43:08.245372+0000","last_became_peered":"2023-12-22T08:43:08.245372+0000","last_unstale":"2023-12-22T08:43:08.777583+0000","last_undegraded":"2023-12-22T08:43:08.777583+0000","last_fullsized":"2023-12-22T08:43:08.777583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:29.623967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780030+0000","last_change":"2023-12-22T08:43:08.779587+0000","last_active":"2023-12-22T08:43:08.780030+0000","last_peered":"2023-12-22T08:43:08.780030+0000","last_clean":"2023-12-22T08:43:08.780030+0000","last_became_active":"2023-12-22T08:43:08.779329+0000","last_became_peered":"2023-12-22T08:43:08.779329+0000","last_unstale":"2023-12-22T08:43:08.780030+0000","last_undegraded":"2023-12-22T08:43:08.780030+0000","last_fullsized":"2023-12-22T08:43:08.780030+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:34.735345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.766614+0000","last_change":"2023-12-22T08:43:08.229587+0000","last_active":"2023-12-22T08:43:08.766614+0000","last_peered":"2023-12-22T08:43:08.766614+0000","last_clean":"2023-12-22T08:43:08.766614+0000","last_became_active":"2023-12-22T08:43:08.228337+0000","last_became_peered":"2023-12-22T08:43:08.228337+0000","last_unstale":"2023-12-22T08:43:08.766614+0000","last_undegraded":"2023-12-22T08:43:08.766614+0000","last_fullsized":"2023-12-22T08:43:08.766614+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:49.938120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780723+0000","last_change":"2023-12-22T08:43:08.780604+0000","last_active":"2023-12-22T08:43:08.780723+0000","last_peered":"2023-12-22T08:43:08.780723+0000","last_clean":"2023-12-22T08:43:08.780723+0000","last_became_active":"2023-12-22T08:43:08.780385+0000","last_became_peered":"2023-12-22T08:43:08.780385+0000","last_unstale":"2023-12-22T08:43:08.780723+0000","last_undegraded":"2023-12-22T08:43:08.780723+0000","last_fullsized":"2023-12-22T08:43:08.780723+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:09:53.006039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768236+0000","last_change":"2023-12-22T08:43:08.230735+0000","last_active":"2023-12-22T08:43:08.768236+0000","last_peered":"2023-12-22T08:43:08.768236+0000","last_clean":"2023-12-22T08:43:08.768236+0000","last_became_active":"2023-12-22T08:43:08.227246+0000","last_became_peered":"2023-12-22T08:43:08.227246+0000","last_unstale":"2023-12-22T08:43:08.768236+0000","last_undegraded":"2023-12-22T08:43:08.768236+0000","last_fullsized":"2023-12-22T08:43:08.768236+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:44.904868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.781137+0000","last_change":"2023-12-22T08:43:08.781029+0000","last_active":"2023-12-22T08:43:08.781137+0000","last_peered":"2023-12-22T08:43:08.781137+0000","last_clean":"2023-12-22T08:43:08.781137+0000","last_became_active":"2023-12-22T08:43:08.780332+0000","last_became_peered":"2023-12-22T08:43:08.780332+0000","last_unstale":"2023-12-22T08:43:08.781137+0000","last_undegraded":"2023-12-22T08:43:08.781137+0000","last_fullsized":"2023-12-22T08:43:08.781137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:41.615895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774363+0000","last_change":"2023-12-22T08:43:08.247775+0000","last_active":"2023-12-22T08:43:08.774363+0000","last_peered":"2023-12-22T08:43:08.774363+0000","last_clean":"2023-12-22T08:43:08.774363+0000","last_became_active":"2023-12-22T08:43:08.247512+0000","last_became_peered":"2023-12-22T08:43:08.247512+0000","last_unstale":"2023-12-22T08:43:08.774363+0000","last_undegraded":"2023-12-22T08:43:08.774363+0000","last_fullsized":"2023-12-22T08:43:08.774363+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:46:44.813831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.759227+0000","last_change":"2023-12-22T08:43:08.759113+0000","last_active":"2023-12-22T08:43:08.759227+0000","last_peered":"2023-12-22T08:43:08.759227+0000","last_clean":"2023-12-22T08:43:08.759227+0000","last_became_active":"2023-12-22T08:43:08.758547+0000","last_became_peered":"2023-12-22T08:43:08.758547+0000","last_unstale":"2023-12-22T08:43:08.759227+0000","last_undegraded":"2023-12-22T08:43:08.759227+0000","last_fullsized":"2023-12-22T08:43:08.759227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:31:40.143949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747531+0000","last_change":"2023-12-22T08:43:08.242191+0000","last_active":"2023-12-22T08:43:08.747531+0000","last_peered":"2023-12-22T08:43:08.747531+0000","last_clean":"2023-12-22T08:43:08.747531+0000","last_became_active":"2023-12-22T08:43:08.241783+0000","last_became_peered":"2023-12-22T08:43:08.241783+0000","last_unstale":"2023-12-22T08:43:08.747531+0000","last_undegraded":"2023-12-22T08:43:08.747531+0000","last_fullsized":"2023-12-22T08:43:08.747531+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:53.956992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768715+0000","last_change":"2023-12-22T08:43:08.768597+0000","last_active":"2023-12-22T08:43:08.768715+0000","last_peered":"2023-12-22T08:43:08.768715+0000","last_clean":"2023-12-22T08:43:08.768715+0000","last_became_active":"2023-12-22T08:43:08.767435+0000","last_became_peered":"2023-12-22T08:43:08.767435+0000","last_unstale":"2023-12-22T08:43:08.768715+0000","last_undegraded":"2023-12-22T08:43:08.768715+0000","last_fullsized":"2023-12-22T08:43:08.768715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:45.919846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.757846+0000","last_change":"2023-12-22T08:43:08.240904+0000","last_active":"2023-12-22T08:43:08.757846+0000","last_peered":"2023-12-22T08:43:08.757846+0000","last_clean":"2023-12-22T08:43:08.757846+0000","last_became_active":"2023-12-22T08:43:08.240539+0000","last_became_peered":"2023-12-22T08:43:08.240539+0000","last_unstale":"2023-12-22T08:43:08.757846+0000","last_undegraded":"2023-12-22T08:43:08.757846+0000","last_fullsized":"2023-12-22T08:43:08.757846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:44.413577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760250+0000","last_change":"2023-12-22T08:43:08.759588+0000","last_active":"2023-12-22T08:43:08.760250+0000","last_peered":"2023-12-22T08:43:08.760250+0000","last_clean":"2023-12-22T08:43:08.760250+0000","last_became_active":"2023-12-22T08:43:08.759370+0000","last_became_peered":"2023-12-22T08:43:08.759370+0000","last_unstale":"2023-12-22T08:43:08.760250+0000","last_undegraded":"2023-12-22T08:43:08.760250+0000","last_fullsized":"2023-12-22T08:43:08.760250+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:28:32.888896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747148+0000","last_change":"2023-12-22T08:43:08.242221+0000","last_active":"2023-12-22T08:43:08.747148+0000","last_peered":"2023-12-22T08:43:08.747148+0000","last_clean":"2023-12-22T08:43:08.747148+0000","last_became_active":"2023-12-22T08:43:08.241895+0000","last_became_peered":"2023-12-22T08:43:08.241895+0000","last_unstale":"2023-12-22T08:43:08.747148+0000","last_undegraded":"2023-12-22T08:43:08.747148+0000","last_fullsized":"2023-12-22T08:43:08.747148+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:36:26.961063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768352+0000","last_change":"2023-12-22T08:43:08.767781+0000","last_active":"2023-12-22T08:43:08.768352+0000","last_peered":"2023-12-22T08:43:08.768352+0000","last_clean":"2023-12-22T08:43:08.768352+0000","last_became_active":"2023-12-22T08:43:08.767545+0000","last_became_peered":"2023-12-22T08:43:08.767545+0000","last_unstale":"2023-12-22T08:43:08.768352+0000","last_undegraded":"2023-12-22T08:43:08.768352+0000","last_fullsized":"2023-12-22T08:43:08.768352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:09.970458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765721+0000","last_change":"2023-12-22T08:43:08.239881+0000","last_active":"2023-12-22T08:43:08.765721+0000","last_peered":"2023-12-22T08:43:08.765721+0000","last_clean":"2023-12-22T08:43:08.765721+0000","last_became_active":"2023-12-22T08:43:08.238285+0000","last_became_peered":"2023-12-22T08:43:08.238285+0000","last_unstale":"2023-12-22T08:43:08.765721+0000","last_undegraded":"2023-12-22T08:43:08.765721+0000","last_fullsized":"2023-12-22T08:43:08.765721+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:33.720367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775166+0000","last_change":"2023-12-22T08:43:08.773721+0000","last_active":"2023-12-22T08:43:08.775166+0000","last_peered":"2023-12-22T08:43:08.775166+0000","last_clean":"2023-12-22T08:43:08.775166+0000","last_became_active":"2023-12-22T08:43:08.773417+0000","last_became_peered":"2023-12-22T08:43:08.773417+0000","last_unstale":"2023-12-22T08:43:08.775166+0000","last_undegraded":"2023-12-22T08:43:08.775166+0000","last_fullsized":"2023-12-22T08:43:08.775166+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:17.697248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"71'3","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772252+0000","last_change":"2023-12-22T08:43:08.234204+0000","last_active":"2023-12-22T08:43:08.772252+0000","last_peered":"2023-12-22T08:43:08.772252+0000","last_clean":"2023-12-22T08:43:08.772252+0000","last_became_active":"2023-12-22T08:43:08.228159+0000","last_became_peered":"2023-12-22T08:43:08.228159+0000","last_unstale":"2023-12-22T08:43:08.772252+0000","last_undegraded":"2023-12-22T08:43:08.772252+0000","last_fullsized":"2023-12-22T08:43:08.772252+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:18.349374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775948+0000","last_change":"2023-12-22T08:43:08.775186+0000","last_active":"2023-12-22T08:43:08.775948+0000","last_peered":"2023-12-22T08:43:08.775948+0000","last_clean":"2023-12-22T08:43:08.775948+0000","last_became_active":"2023-12-22T08:43:08.774876+0000","last_became_peered":"2023-12-22T08:43:08.774876+0000","last_unstale":"2023-12-22T08:43:08.775948+0000","last_undegraded":"2023-12-22T08:43:08.775948+0000","last_fullsized":"2023-12-22T08:43:08.775948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:58.667030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"71'6","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772747+0000","last_change":"2023-12-22T08:43:08.237347+0000","last_active":"2023-12-22T08:43:08.772747+0000","last_peered":"2023-12-22T08:43:08.772747+0000","last_clean":"2023-12-22T08:43:08.772747+0000","last_became_active":"2023-12-22T08:43:08.235741+0000","last_became_peered":"2023-12-22T08:43:08.235741+0000","last_unstale":"2023-12-22T08:43:08.772747+0000","last_undegraded":"2023-12-22T08:43:08.772747+0000","last_fullsized":"2023-12-22T08:43:08.772747+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:27.955616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775999+0000","last_change":"2023-12-22T08:43:08.775807+0000","last_active":"2023-12-22T08:43:08.775999+0000","last_peered":"2023-12-22T08:43:08.775999+0000","last_clean":"2023-12-22T08:43:08.775999+0000","last_became_active":"2023-12-22T08:43:08.775655+0000","last_became_peered":"2023-12-22T08:43:08.775655+0000","last_unstale":"2023-12-22T08:43:08.775999+0000","last_undegraded":"2023-12-22T08:43:08.775999+0000","last_fullsized":"2023-12-22T08:43:08.775999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:07:12.868602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.781210+0000","last_change":"2023-12-22T08:43:08.243194+0000","last_active":"2023-12-22T08:43:08.781210+0000","last_peered":"2023-12-22T08:43:08.781210+0000","last_clean":"2023-12-22T08:43:08.781210+0000","last_became_active":"2023-12-22T08:43:08.242449+0000","last_became_peered":"2023-12-22T08:43:08.242449+0000","last_unstale":"2023-12-22T08:43:08.781210+0000","last_undegraded":"2023-12-22T08:43:08.781210+0000","last_fullsized":"2023-12-22T08:43:08.781210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:14.817249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760965+0000","last_change":"2023-12-22T08:43:08.760898+0000","last_active":"2023-12-22T08:43:08.760965+0000","last_peered":"2023-12-22T08:43:08.760965+0000","last_clean":"2023-12-22T08:43:08.760965+0000","last_became_active":"2023-12-22T08:43:08.760680+0000","last_became_peered":"2023-12-22T08:43:08.760680+0000","last_unstale":"2023-12-22T08:43:08.760965+0000","last_undegraded":"2023-12-22T08:43:08.760965+0000","last_fullsized":"2023-12-22T08:43:08.760965+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:07:27.247486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.745591+0000","last_change":"2023-12-22T08:43:08.238556+0000","last_active":"2023-12-22T08:43:08.745591+0000","last_peered":"2023-12-22T08:43:08.745591+0000","last_clean":"2023-12-22T08:43:08.745591+0000","last_became_active":"2023-12-22T08:43:08.238261+0000","last_became_peered":"2023-12-22T08:43:08.238261+0000","last_unstale":"2023-12-22T08:43:08.745591+0000","last_undegraded":"2023-12-22T08:43:08.745591+0000","last_fullsized":"2023-12-22T08:43:08.745591+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:22.638334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760326+0000","last_change":"2023-12-22T08:43:08.759063+0000","last_active":"2023-12-22T08:43:08.760326+0000","last_peered":"2023-12-22T08:43:08.760326+0000","last_clean":"2023-12-22T08:43:08.760326+0000","last_became_active":"2023-12-22T08:43:08.758683+0000","last_became_peered":"2023-12-22T08:43:08.758683+0000","last_unstale":"2023-12-22T08:43:08.760326+0000","last_undegraded":"2023-12-22T08:43:08.760326+0000","last_fullsized":"2023-12-22T08:43:08.760326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:32:13.036482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.746130+0000","last_change":"2023-12-22T08:43:08.239352+0000","last_active":"2023-12-22T08:43:08.746130+0000","last_peered":"2023-12-22T08:43:08.746130+0000","last_clean":"2023-12-22T08:43:08.746130+0000","last_became_active":"2023-12-22T08:43:08.238848+0000","last_became_peered":"2023-12-22T08:43:08.238848+0000","last_unstale":"2023-12-22T08:43:08.746130+0000","last_undegraded":"2023-12-22T08:43:08.746130+0000","last_fullsized":"2023-12-22T08:43:08.746130+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:12.707233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778947+0000","last_change":"2023-12-22T08:43:08.778851+0000","last_active":"2023-12-22T08:43:08.778947+0000","last_peered":"2023-12-22T08:43:08.778947+0000","last_clean":"2023-12-22T08:43:08.778947+0000","last_became_active":"2023-12-22T08:43:08.778568+0000","last_became_peered":"2023-12-22T08:43:08.778568+0000","last_unstale":"2023-12-22T08:43:08.778947+0000","last_undegraded":"2023-12-22T08:43:08.778947+0000","last_fullsized":"2023-12-22T08:43:08.778947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:32:32.129373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"71'8","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772847+0000","last_change":"2023-12-22T08:43:08.233994+0000","last_active":"2023-12-22T08:43:08.772847+0000","last_peered":"2023-12-22T08:43:08.772847+0000","last_clean":"2023-12-22T08:43:08.772847+0000","last_became_active":"2023-12-22T08:43:08.227292+0000","last_became_peered":"2023-12-22T08:43:08.227292+0000","last_unstale":"2023-12-22T08:43:08.772847+0000","last_undegraded":"2023-12-22T08:43:08.772847+0000","last_fullsized":"2023-12-22T08:43:08.772847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:18:18.840612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.759409+0000","last_change":"2023-12-22T08:43:08.759314+0000","last_active":"2023-12-22T08:43:08.759409+0000","last_peered":"2023-12-22T08:43:08.759409+0000","last_clean":"2023-12-22T08:43:08.759409+0000","last_became_active":"2023-12-22T08:43:08.758870+0000","last_became_peered":"2023-12-22T08:43:08.758870+0000","last_unstale":"2023-12-22T08:43:08.759409+0000","last_undegraded":"2023-12-22T08:43:08.759409+0000","last_fullsized":"2023-12-22T08:43:08.759409+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:15.832226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778189+0000","last_change":"2023-12-22T08:43:08.245684+0000","last_active":"2023-12-22T08:43:08.778189+0000","last_peered":"2023-12-22T08:43:08.778189+0000","last_clean":"2023-12-22T08:43:08.778189+0000","last_became_active":"2023-12-22T08:43:08.245434+0000","last_became_peered":"2023-12-22T08:43:08.245434+0000","last_unstale":"2023-12-22T08:43:08.778189+0000","last_undegraded":"2023-12-22T08:43:08.778189+0000","last_fullsized":"2023-12-22T08:43:08.778189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:29.623967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775773+0000","last_change":"2023-12-22T08:43:08.775570+0000","last_active":"2023-12-22T08:43:08.775773+0000","last_peered":"2023-12-22T08:43:08.775773+0000","last_clean":"2023-12-22T08:43:08.775773+0000","last_became_active":"2023-12-22T08:43:08.775017+0000","last_became_peered":"2023-12-22T08:43:08.775017+0000","last_unstale":"2023-12-22T08:43:08.775773+0000","last_undegraded":"2023-12-22T08:43:08.775773+0000","last_fullsized":"2023-12-22T08:43:08.775773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:41.615895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.779090+0000","last_change":"2023-12-22T08:43:08.243395+0000","last_active":"2023-12-22T08:43:08.779090+0000","last_peered":"2023-12-22T08:43:08.779090+0000","last_clean":"2023-12-22T08:43:08.779090+0000","last_became_active":"2023-12-22T08:43:08.242880+0000","last_became_peered":"2023-12-22T08:43:08.242880+0000","last_unstale":"2023-12-22T08:43:08.779090+0000","last_undegraded":"2023-12-22T08:43:08.779090+0000","last_fullsized":"2023-12-22T08:43:08.779090+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:26.160091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780266+0000","last_change":"2023-12-22T08:43:08.779922+0000","last_active":"2023-12-22T08:43:08.780266+0000","last_peered":"2023-12-22T08:43:08.780266+0000","last_clean":"2023-12-22T08:43:08.780266+0000","last_became_active":"2023-12-22T08:43:08.779234+0000","last_became_peered":"2023-12-22T08:43:08.779234+0000","last_unstale":"2023-12-22T08:43:08.780266+0000","last_undegraded":"2023-12-22T08:43:08.780266+0000","last_fullsized":"2023-12-22T08:43:08.780266+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:45.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772747+0000","last_change":"2023-12-22T08:43:08.241351+0000","last_active":"2023-12-22T08:43:08.772747+0000","last_peered":"2023-12-22T08:43:08.772747+0000","last_clean":"2023-12-22T08:43:08.772747+0000","last_became_active":"2023-12-22T08:43:08.236119+0000","last_became_peered":"2023-12-22T08:43:08.236119+0000","last_unstale":"2023-12-22T08:43:08.772747+0000","last_undegraded":"2023-12-22T08:43:08.772747+0000","last_fullsized":"2023-12-22T08:43:08.772747+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:24:11.471670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.762969+0000","last_change":"2023-12-22T08:43:08.762279+0000","last_active":"2023-12-22T08:43:08.762969+0000","last_peered":"2023-12-22T08:43:08.762969+0000","last_clean":"2023-12-22T08:43:08.762969+0000","last_became_active":"2023-12-22T08:43:08.760935+0000","last_became_peered":"2023-12-22T08:43:08.760935+0000","last_unstale":"2023-12-22T08:43:08.762969+0000","last_undegraded":"2023-12-22T08:43:08.762969+0000","last_fullsized":"2023-12-22T08:43:08.762969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:23.591214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765888+0000","last_change":"2023-12-22T08:43:08.246777+0000","last_active":"2023-12-22T08:43:08.765888+0000","last_peered":"2023-12-22T08:43:08.765888+0000","last_clean":"2023-12-22T08:43:08.765888+0000","last_became_active":"2023-12-22T08:43:08.246524+0000","last_became_peered":"2023-12-22T08:43:08.246524+0000","last_unstale":"2023-12-22T08:43:08.765888+0000","last_undegraded":"2023-12-22T08:43:08.765888+0000","last_fullsized":"2023-12-22T08:43:08.765888+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:52.805378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774730+0000","last_change":"2023-12-22T08:43:08.774162+0000","last_active":"2023-12-22T08:43:08.774730+0000","last_peered":"2023-12-22T08:43:08.774730+0000","last_clean":"2023-12-22T08:43:08.774730+0000","last_became_active":"2023-12-22T08:43:08.771427+0000","last_became_peered":"2023-12-22T08:43:08.771427+0000","last_unstale":"2023-12-22T08:43:08.774730+0000","last_undegraded":"2023-12-22T08:43:08.774730+0000","last_fullsized":"2023-12-22T08:43:08.774730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:53.721528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778158+0000","last_change":"2023-12-22T08:43:08.240892+0000","last_active":"2023-12-22T08:43:08.778158+0000","last_peered":"2023-12-22T08:43:08.778158+0000","last_clean":"2023-12-22T08:43:08.778158+0000","last_became_active":"2023-12-22T08:43:08.240027+0000","last_became_peered":"2023-12-22T08:43:08.240027+0000","last_unstale":"2023-12-22T08:43:08.778158+0000","last_undegraded":"2023-12-22T08:43:08.778158+0000","last_fullsized":"2023-12-22T08:43:08.778158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:14.817249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.776656+0000","last_change":"2023-12-22T08:43:08.776331+0000","last_active":"2023-12-22T08:43:08.776656+0000","last_peered":"2023-12-22T08:43:08.776656+0000","last_clean":"2023-12-22T08:43:08.776656+0000","last_became_active":"2023-12-22T08:43:08.771399+0000","last_became_peered":"2023-12-22T08:43:08.771399+0000","last_unstale":"2023-12-22T08:43:08.776656+0000","last_undegraded":"2023-12-22T08:43:08.776656+0000","last_fullsized":"2023-12-22T08:43:08.776656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:02:50.159719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.767667+0000","last_change":"2023-12-22T08:43:08.242318+0000","last_active":"2023-12-22T08:43:08.767667+0000","last_peered":"2023-12-22T08:43:08.767667+0000","last_clean":"2023-12-22T08:43:08.767667+0000","last_became_active":"2023-12-22T08:43:08.240707+0000","last_became_peered":"2023-12-22T08:43:08.240707+0000","last_unstale":"2023-12-22T08:43:08.767667+0000","last_undegraded":"2023-12-22T08:43:08.767667+0000","last_fullsized":"2023-12-22T08:43:08.767667+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:37.796898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772917+0000","last_change":"2023-12-22T08:43:08.770953+0000","last_active":"2023-12-22T08:43:08.772917+0000","last_peered":"2023-12-22T08:43:08.772917+0000","last_clean":"2023-12-22T08:43:08.772917+0000","last_became_active":"2023-12-22T08:43:08.770635+0000","last_became_peered":"2023-12-22T08:43:08.770635+0000","last_unstale":"2023-12-22T08:43:08.772917+0000","last_undegraded":"2023-12-22T08:43:08.772917+0000","last_fullsized":"2023-12-22T08:43:08.772917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:23.653311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747239+0000","last_change":"2023-12-22T08:43:08.245828+0000","last_active":"2023-12-22T08:43:08.747239+0000","last_peered":"2023-12-22T08:43:08.747239+0000","last_clean":"2023-12-22T08:43:08.747239+0000","last_became_active":"2023-12-22T08:43:08.245624+0000","last_became_peered":"2023-12-22T08:43:08.245624+0000","last_unstale":"2023-12-22T08:43:08.747239+0000","last_undegraded":"2023-12-22T08:43:08.747239+0000","last_fullsized":"2023-12-22T08:43:08.747239+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:02:00.232260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.773984+0000","last_change":"2023-12-22T08:43:08.773913+0000","last_active":"2023-12-22T08:43:08.773984+0000","last_peered":"2023-12-22T08:43:08.773984+0000","last_clean":"2023-12-22T08:43:08.773984+0000","last_became_active":"2023-12-22T08:43:08.773342+0000","last_became_peered":"2023-12-22T08:43:08.773342+0000","last_unstale":"2023-12-22T08:43:08.773984+0000","last_undegraded":"2023-12-22T08:43:08.773984+0000","last_fullsized":"2023-12-22T08:43:08.773984+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:03:49.616345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.781950+0000","last_change":"2023-12-22T08:43:08.243237+0000","last_active":"2023-12-22T08:43:08.781950+0000","last_peered":"2023-12-22T08:43:08.781950+0000","last_clean":"2023-12-22T08:43:08.781950+0000","last_became_active":"2023-12-22T08:43:08.242927+0000","last_became_peered":"2023-12-22T08:43:08.242927+0000","last_unstale":"2023-12-22T08:43:08.781950+0000","last_undegraded":"2023-12-22T08:43:08.781950+0000","last_fullsized":"2023-12-22T08:43:08.781950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:13:29.194561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.759826+0000","last_change":"2023-12-22T08:43:08.759746+0000","last_active":"2023-12-22T08:43:08.759826+0000","last_peered":"2023-12-22T08:43:08.759826+0000","last_clean":"2023-12-22T08:43:08.759826+0000","last_became_active":"2023-12-22T08:43:08.759482+0000","last_became_peered":"2023-12-22T08:43:08.759482+0000","last_unstale":"2023-12-22T08:43:08.759826+0000","last_undegraded":"2023-12-22T08:43:08.759826+0000","last_fullsized":"2023-12-22T08:43:08.759826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:27.175068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.749602+0000","last_change":"2023-12-22T08:43:08.245846+0000","last_active":"2023-12-22T08:43:08.749602+0000","last_peered":"2023-12-22T08:43:08.749602+0000","last_clean":"2023-12-22T08:43:08.749602+0000","last_became_active":"2023-12-22T08:43:08.245404+0000","last_became_peered":"2023-12-22T08:43:08.245404+0000","last_unstale":"2023-12-22T08:43:08.749602+0000","last_undegraded":"2023-12-22T08:43:08.749602+0000","last_fullsized":"2023-12-22T08:43:08.749602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:27:48.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.777551+0000","last_change":"2023-12-22T08:43:08.777481+0000","last_active":"2023-12-22T08:43:08.777551+0000","last_peered":"2023-12-22T08:43:08.777551+0000","last_clean":"2023-12-22T08:43:08.777551+0000","last_became_active":"2023-12-22T08:43:08.777206+0000","last_became_peered":"2023-12-22T08:43:08.777206+0000","last_unstale":"2023-12-22T08:43:08.777551+0000","last_undegraded":"2023-12-22T08:43:08.777551+0000","last_fullsized":"2023-12-22T08:43:08.777551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:32.067700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747622+0000","last_change":"2023-12-22T08:43:08.238015+0000","last_active":"2023-12-22T08:43:08.747622+0000","last_peered":"2023-12-22T08:43:08.747622+0000","last_clean":"2023-12-22T08:43:08.747622+0000","last_became_active":"2023-12-22T08:43:08.237691+0000","last_became_peered":"2023-12-22T08:43:08.237691+0000","last_unstale":"2023-12-22T08:43:08.747622+0000","last_undegraded":"2023-12-22T08:43:08.747622+0000","last_fullsized":"2023-12-22T08:43:08.747622+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:13:35.064619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.769045+0000","last_change":"2023-12-22T08:43:08.768873+0000","last_active":"2023-12-22T08:43:08.769045+0000","last_peered":"2023-12-22T08:43:08.769045+0000","last_clean":"2023-12-22T08:43:08.769045+0000","last_became_active":"2023-12-22T08:43:08.768418+0000","last_became_peered":"2023-12-22T08:43:08.768418+0000","last_unstale":"2023-12-22T08:43:08.769045+0000","last_undegraded":"2023-12-22T08:43:08.769045+0000","last_fullsized":"2023-12-22T08:43:08.769045+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:50.953097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.754103+0000","last_change":"2023-12-22T08:43:08.228782+0000","last_active":"2023-12-22T08:43:08.754103+0000","last_peered":"2023-12-22T08:43:08.754103+0000","last_clean":"2023-12-22T08:43:08.754103+0000","last_became_active":"2023-12-22T08:43:08.228538+0000","last_became_peered":"2023-12-22T08:43:08.228538+0000","last_unstale":"2023-12-22T08:43:08.754103+0000","last_undegraded":"2023-12-22T08:43:08.754103+0000","last_fullsized":"2023-12-22T08:43:08.754103+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:44.413577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765472+0000","last_change":"2023-12-22T08:43:08.765243+0000","last_active":"2023-12-22T08:43:08.765472+0000","last_peered":"2023-12-22T08:43:08.765472+0000","last_clean":"2023-12-22T08:43:08.765472+0000","last_became_active":"2023-12-22T08:43:08.764495+0000","last_became_peered":"2023-12-22T08:43:08.764495+0000","last_unstale":"2023-12-22T08:43:08.765472+0000","last_undegraded":"2023-12-22T08:43:08.765472+0000","last_fullsized":"2023-12-22T08:43:08.765472+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:52.037553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774052+0000","last_change":"2023-12-22T08:43:08.246580+0000","last_active":"2023-12-22T08:43:08.774052+0000","last_peered":"2023-12-22T08:43:08.774052+0000","last_clean":"2023-12-22T08:43:08.774052+0000","last_became_active":"2023-12-22T08:43:08.246138+0000","last_became_peered":"2023-12-22T08:43:08.246138+0000","last_unstale":"2023-12-22T08:43:08.774052+0000","last_undegraded":"2023-12-22T08:43:08.774052+0000","last_fullsized":"2023-12-22T08:43:08.774052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:54:55.545904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.769795+0000","last_change":"2023-12-22T08:43:08.769599+0000","last_active":"2023-12-22T08:43:08.769795+0000","last_peered":"2023-12-22T08:43:08.769795+0000","last_clean":"2023-12-22T08:43:08.769795+0000","last_became_active":"2023-12-22T08:43:08.769363+0000","last_became_peered":"2023-12-22T08:43:08.769363+0000","last_unstale":"2023-12-22T08:43:08.769795+0000","last_undegraded":"2023-12-22T08:43:08.769795+0000","last_fullsized":"2023-12-22T08:43:08.769795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:19.778557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.757872+0000","last_change":"2023-12-22T08:43:08.235236+0000","last_active":"2023-12-22T08:43:08.757872+0000","last_peered":"2023-12-22T08:43:08.757872+0000","last_clean":"2023-12-22T08:43:08.757872+0000","last_became_active":"2023-12-22T08:43:08.234988+0000","last_became_peered":"2023-12-22T08:43:08.234988+0000","last_unstale":"2023-12-22T08:43:08.757872+0000","last_undegraded":"2023-12-22T08:43:08.757872+0000","last_fullsized":"2023-12-22T08:43:08.757872+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:04.865483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.769027+0000","last_change":"2023-12-22T08:43:08.768678+0000","last_active":"2023-12-22T08:43:08.769027+0000","last_peered":"2023-12-22T08:43:08.769027+0000","last_clean":"2023-12-22T08:43:08.769027+0000","last_became_active":"2023-12-22T08:43:08.768174+0000","last_became_peered":"2023-12-22T08:43:08.768174+0000","last_unstale":"2023-12-22T08:43:08.769027+0000","last_undegraded":"2023-12-22T08:43:08.769027+0000","last_fullsized":"2023-12-22T08:43:08.769027+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:10:28.675275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.751188+0000","last_change":"2023-12-22T08:43:08.245686+0000","last_active":"2023-12-22T08:43:08.751188+0000","last_peered":"2023-12-22T08:43:08.751188+0000","last_clean":"2023-12-22T08:43:08.751188+0000","last_became_active":"2023-12-22T08:43:08.245056+0000","last_became_peered":"2023-12-22T08:43:08.245056+0000","last_unstale":"2023-12-22T08:43:08.751188+0000","last_undegraded":"2023-12-22T08:43:08.751188+0000","last_fullsized":"2023-12-22T08:43:08.751188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:52:56.482108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.782588+0000","last_change":"2023-12-22T08:43:08.782519+0000","last_active":"2023-12-22T08:43:08.782588+0000","last_peered":"2023-12-22T08:43:08.782588+0000","last_clean":"2023-12-22T08:43:08.782588+0000","last_became_active":"2023-12-22T08:43:08.782288+0000","last_became_peered":"2023-12-22T08:43:08.782288+0000","last_unstale":"2023-12-22T08:43:08.782588+0000","last_undegraded":"2023-12-22T08:43:08.782588+0000","last_fullsized":"2023-12-22T08:43:08.782588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:05.880460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.767765+0000","last_change":"2023-12-22T08:43:08.242877+0000","last_active":"2023-12-22T08:43:08.767765+0000","last_peered":"2023-12-22T08:43:08.767765+0000","last_clean":"2023-12-22T08:43:08.767765+0000","last_became_active":"2023-12-22T08:43:08.241588+0000","last_became_peered":"2023-12-22T08:43:08.241588+0000","last_unstale":"2023-12-22T08:43:08.767765+0000","last_undegraded":"2023-12-22T08:43:08.767765+0000","last_fullsized":"2023-12-22T08:43:08.767765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:18.763580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.777718+0000","last_change":"2023-12-22T08:43:08.776165+0000","last_active":"2023-12-22T08:43:08.777718+0000","last_peered":"2023-12-22T08:43:08.777718+0000","last_clean":"2023-12-22T08:43:08.777718+0000","last_became_active":"2023-12-22T08:43:08.775908+0000","last_became_peered":"2023-12-22T08:43:08.775908+0000","last_unstale":"2023-12-22T08:43:08.777718+0000","last_undegraded":"2023-12-22T08:43:08.777718+0000","last_fullsized":"2023-12-22T08:43:08.777718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:28.745926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.757931+0000","last_change":"2023-12-22T08:43:08.236569+0000","last_active":"2023-12-22T08:43:08.757931+0000","last_peered":"2023-12-22T08:43:08.757931+0000","last_clean":"2023-12-22T08:43:08.757931+0000","last_became_active":"2023-12-22T08:43:08.236102+0000","last_became_peered":"2023-12-22T08:43:08.236102+0000","last_unstale":"2023-12-22T08:43:08.757931+0000","last_undegraded":"2023-12-22T08:43:08.757931+0000","last_fullsized":"2023-12-22T08:43:08.757931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:31.052723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":209,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747702+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:43:08.747702+0000","last_peered":"2023-12-22T08:43:08.747702+0000","last_clean":"2023-12-22T08:43:08.747702+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:43:08.747702+0000","last_undegraded":"2023-12-22T08:43:08.747702+0000","last_fullsized":"2023-12-22T08:43:08.747702+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194946,"statfs":{"total":200000000,"available":199625170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0780000000000001,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.075,"15min":1.0589999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.85899999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.173,"15min":1.1579999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.2},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.1619999999999999,"15min":1.1319999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.173}]},{"osd":2,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.0860000000000001,"15min":1.056},"min":{"1min":0.78600000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.226,"5min":1.2310000000000001,"15min":1.23},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.742,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.82399999999999995}]},{"osd":3,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1240000000000001,"15min":1.0900000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.292,"15min":1.2769999999999999},"min":{"1min":0.80500000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.952,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1899999999999999,"15min":1.194},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.764,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.266,"5min":1.268,"15min":1.2629999999999999},"min":{"1min":0.64100000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.137}]},{"osd":5,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.371,"15min":1.367},"min":{"1min":0.74299999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.8120000000000001,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.099},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3660000000000001,"15min":1.3700000000000001},"min":{"1min":0.76300000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.645,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.2729999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4870000000000001,"15min":1.4850000000000001},"min":{"1min":0.83499999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.1259999999999999,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.383},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4870000000000001,"15min":1.484},"min":{"1min":0.82299999999999995,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.55}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":365,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194946,"statfs":{"total":200000000,"available":199625240,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1140000000000001,"15min":1.1299999999999999},"min":{"1min":0.80500000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9350000000000001,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.0820000000000001,"15min":1.081},"min":{"1min":0.77500000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.4450000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0389999999999999,"15min":1.0189999999999999},"min":{"1min":0.79000000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.448,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.747},{"interface":"front","average":{"1min":1.349,"5min":1.1919999999999999,"15min":1.171},"min":{"1min":1.0129999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.1200000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2529999999999999,"15min":1.272},"min":{"1min":0.82799999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7969999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.268,"5min":1.1739999999999999,"15min":1.147},"min":{"1min":0.81599999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.3220000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.3160000000000001,"15min":1.298},"min":{"1min":0.94099999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.738,"5min":1.847,"15min":1.847},"last":1.208},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.248,"15min":1.2330000000000001},"min":{"1min":0.96799999999999997,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.645,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.1539999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.403,"15min":1.411},"min":{"1min":1.0169999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.9139999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.417,"15min":1.4079999999999999},"min":{"1min":1.21,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.5429999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.361,"15min":1.3640000000000001},"min":{"1min":0.92100000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.5740000000000001,"15min":1.599},"min":{"1min":1.0960000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.1030000000000002,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.3660000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.5900000000000001,"15min":1.5940000000000001},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":1.9790000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.538,"5min":1.5449999999999999,"15min":1.5589999999999999},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":1.964,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.4059999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":941,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194370,"statfs":{"total":200000000,"available":199035879,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.0740000000000001,"15min":1.075},"min":{"1min":0.72999999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.637,"5min":1.944,"15min":1.944},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.123,"15min":1.135},"min":{"1min":0.68899999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.514,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.02}]},{"osd":1,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.093,"15min":1.1080000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.409,"5min":2.79,"15min":2.79},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.121,"5min":1.0289999999999999,"15min":1.012},"min":{"1min":0.78200000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.4590000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.119,"15min":1.1220000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.456,"5min":1.72,"15min":1.72},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.22,"5min":1.163,"15min":1.159},"min":{"1min":0.78200000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5489999999999999,"5min":1.978,"15min":1.978},"last":0.96399999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1619999999999999,"15min":1.1559999999999999},"min":{"1min":0.83399999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.506,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.226,"15min":1.2310000000000001},"min":{"1min":1.0329999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5800000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1399999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.24,"15min":1.246},"min":{"1min":0.95499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7070000000000001,"5min":1.853,"15min":1.853},"last":1.05},{"interface":"front","average":{"1min":1.159,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.3740000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3069999999999999,"15min":1.3089999999999999},"min":{"1min":0.88100000000000001,"5min":0.749,"15min":0.749},"max":{"1min":1.581,"5min":1.821,"15min":1.821},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.4199999999999999,"15min":1.4259999999999999},"min":{"1min":0.89900000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.7529999999999999,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3580000000000001,"15min":1.3620000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6359999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.411,"5min":1.5409999999999999,"15min":1.575},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.788,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":1.23}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194945,"statfs":{"total":200000000,"available":199624646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.99299999999999999,"15min":1.002},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5309999999999999,"5min":1.552,"15min":1.552},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.097,"15min":1.091},"min":{"1min":0.72499999999999998,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6100000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.042,"15min":1.0289999999999999},"min":{"1min":0.72399999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6279999999999999,"5min":1.669,"15min":1.669},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0900000000000001,"15min":1.1020000000000001},"min":{"1min":0.70499999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.794,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.069}]},{"osd":2,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1379999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5009999999999999,"5min":1.625,"15min":1.625},"last":1.234},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1850000000000001,"15min":1.1890000000000001},"min":{"1min":0.92200000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.5640000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.86199999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2090000000000001,"15min":1.1950000000000001},"min":{"1min":0.93700000000000006,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5049999999999999,"5min":1.774,"15min":1.774},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.222,"15min":1.194},"min":{"1min":1.012,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1870000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1579999999999999,"15min":1.1299999999999999},"min":{"1min":1.016,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.3819999999999999,"15min":1.3700000000000001},"min":{"1min":1.0800000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7050000000000001,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.425}]},{"osd":6,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.248,"15min":1.226},"min":{"1min":1.0469999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.621,"5min":1.798,"15min":1.798},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.2130000000000001,"15min":1.181},"min":{"1min":1.0049999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.365}]},{"osd":7,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.367,"15min":1.323},"min":{"1min":0.97799999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.8879999999999999,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.4259999999999999,"15min":1.4019999999999999},"min":{"1min":1.2470000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.9199999999999999,"5min":1.923,"15min":1.923},"last":1.77}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194946,"statfs":{"total":200000000,"available":199625172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.93899999999999995,"15min":0.96799999999999997},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90900000000000003,"15min":0.92900000000000005},"min":{"1min":0.5,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.1519999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.85299999999999998,"15min":0.85699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.754},{"interface":"front","average":{"1min":1.214,"5min":1.1020000000000001,"15min":1.1080000000000001},"min":{"1min":0.63100000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.79400000000000004}]},{"osd":2,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.024,"15min":1.032},"min":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.591,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.137,"15min":1.125},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.397}]},{"osd":4,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.202,"15min":1.198},"min":{"1min":0.89900000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":2.048},{"interface":"front","average":{"1min":1.373,"5min":1.2350000000000001,"15min":1.222},"min":{"1min":0.77300000000000002,"5min":0.745,"15min":0.745},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":2.242}]},{"osd":5,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.2769999999999999,"15min":1.262},"min":{"1min":0.84599999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.9510000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.413,"15min":1.4430000000000001},"min":{"1min":0.96999999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.5549999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.4330000000000001,"15min":1.4419999999999999},"min":{"1min":0.93000000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.804},{"interface":"front","average":{"1min":1.454,"5min":1.3779999999999999,"15min":1.3859999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.6519999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.361,"15min":1.365},"min":{"1min":0.85599999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":2.302},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.393,"15min":1.387},"min":{"1min":0.97399999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.4490000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":367,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194944,"statfs":{"total":200000000,"available":199623538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":0.83699999999999997,"15min":0.74099999999999999},"min":{"1min":0.56299999999999994,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.8879999999999999,"5min":6.8879999999999999,"15min":6.8879999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.246,"5min":0.97799999999999998,"15min":0.95099999999999996},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":4.5510000000000002,"5min":4.5510000000000002,"15min":4.5510000000000002},"last":1.125}]},{"osd":1,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.042,"15min":0.94499999999999995},"min":{"1min":0.59699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":11.308999999999999,"5min":11.308999999999999,"15min":11.308999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.149,"5min":0.95199999999999996,"15min":0.90600000000000003},"min":{"1min":0.70099999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.94099999999999995}]},{"osd":3,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.163,"15min":1.0229999999999999},"min":{"1min":0.55400000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":13.087999999999999,"5min":13.087999999999999,"15min":13.087999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.232,"15min":1.0740000000000001},"min":{"1min":0.79200000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":12.289999999999999,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.2390000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.2749999999999999,"15min":1.22},"min":{"1min":1.048,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":1.341},{"interface":"front","average":{"1min":2.1030000000000002,"5min":1.464,"15min":1.377},"min":{"1min":0.76500000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":13.927,"5min":13.927,"15min":13.927},"last":1.0409999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.9199999999999999,"5min":1.4530000000000001,"15min":1.393},"min":{"1min":0.72399999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":11.003,"5min":11.003,"15min":11.003},"last":1.381},{"interface":"front","average":{"1min":2.0960000000000001,"5min":1.389,"15min":1.2629999999999999},"min":{"1min":0.90800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":13.129,"5min":13.129,"15min":13.129},"last":1.518}]},{"osd":6,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.3480000000000001,"15min":1.256},"min":{"1min":0.77200000000000002,"5min":0.751,"15min":0.751},"max":{"1min":8.1609999999999996,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.4199999999999999,"15min":1.3500000000000001},"min":{"1min":0.873,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":6.8150000000000004,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":1.4470000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":2.0179999999999998,"5min":1.4870000000000001,"15min":1.393},"min":{"1min":0.85499999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":10.948,"5min":10.948,"15min":10.948},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.8799999999999999,"5min":1.4219999999999999,"15min":1.3300000000000001},"min":{"1min":1.0820000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":8.0980000000000008,"5min":8.0980000000000008,"15min":8.0980000000000008},"last":1.6160000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":943,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194369,"statfs":{"total":200000000,"available":199034312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.88700000000000001,"15min":0.89500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.339,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.01,"15min":1.0049999999999999},"min":{"1min":0.625,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.399,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.363}]},{"osd":2,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.284,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.93999999999999995,"15min":0.93899999999999995},"min":{"1min":0.60599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.417,"5min":2.254,"15min":2.254},"last":1.0669999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.155,"15min":1.1519999999999999},"min":{"1min":0.68799999999999994,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.673,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93500000000000005,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.85999999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.244,"15min":1.264},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.8049999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.329,"15min":1.3109999999999999},"min":{"1min":0.876,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.962,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.5409999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.93300000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":1.181},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.3560000000000001,"15min":1.3300000000000001},"min":{"1min":0.88200000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.5129999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2430000000000001,"15min":1.2410000000000001},"min":{"1min":0.81100000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.347,"15min":1.353},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.9730000000000001,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.6160000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.367,"15min":1.343},"min":{"1min":1.0269999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0369999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.647},{"interface":"front","average":{"1min":1.393,"5min":1.367,"15min":1.395},"min":{"1min":0.86599999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.3079999999999998,"5min":3.2959999999999998,"15min":3.2959999999999998},"last":1.581}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":367,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194945,"statfs":{"total":200000000,"available":199623698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.88500000000000001,"15min":0.89300000000000002},"min":{"1min":0.53800000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.4259999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.79000000000000004,"15min":0.78200000000000003},"min":{"1min":0.442,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.008},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.93400000000000005,"15min":0.91900000000000004},"min":{"1min":0.45900000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0149999999999999,"15min":1.0029999999999999},"min":{"1min":0.58499999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.744,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.071,"15min":1.0349999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.254}]},{"osd":4,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.27,"15min":1.2569999999999999},"min":{"1min":1.024,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.671,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.2270000000000001,"15min":1.1990000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.651,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.357}]},{"osd":5,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.242,"15min":1.24},"min":{"1min":0.80600000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.258,"15min":1.2509999999999999},"min":{"1min":0.90600000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.839,"5min":1.885,"15min":1.885},"last":1.0900000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.288,"15min":1.268},"min":{"1min":0.78600000000000003,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.452},{"interface":"front","average":{"1min":1.383,"5min":1.367,"15min":1.373},"min":{"1min":1.008,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.0649999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.304}]},{"osd":7,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3400000000000001,"15min":1.3480000000000001},"min":{"1min":0.97099999999999997,"5min":0.755,"15min":0.755},"max":{"1min":1.768,"5min":1.79,"15min":1.79},"last":1.159},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3700000000000001,"15min":1.3640000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.9510000000000001,"5min":2.214,"15min":2.214},"last":1.145}]}]}],"pool_statfs":[]}} 2023-12-22T08:43:14.752 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-22T08:43:15.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.007+0000 7f56fb454640 1 Processor -- start 2023-12-22T08:43:15.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.007+0000 7f56fb454640 1 -- start start 2023-12-22T08:43:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.009+0000 7f56fb454640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f56f40a44a0 0x7f56f40708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.009+0000 7f56fb454640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f40cdae0 con 0x7f56f415b420 2023-12-22T08:43:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.009+0000 7f56fb454640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f4071250 con 0x7f56f4070e30 2023-12-22T08:43:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.009+0000 7f56fb454640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f415b800 con 0x7f56f40a44a0 2023-12-22T08:43:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.009+0000 7f56f9c51640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f56f40a44a0 0x7f56f40708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.009+0000 7f56fa452640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f56f415b420 0x7f56f406d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34722/0 (socket says 172.21.15.38:34722) 2023-12-22T08:43:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.009+0000 7f56fa452640 1 -- 172.21.15.38:0/2993537701 learned_addr learned my addr 172.21.15.38:0/2993537701 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:43:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.010+0000 7f56f9c51640 1 -- 172.21.15.38:0/2993537701 >> v1:172.21.15.89:6789/0 conn(0x7f56f4070e30 legacy=0x7f56f415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.010+0000 7f56f9c51640 1 -- 172.21.15.38:0/2993537701 >> v1:172.21.15.38:6789/0 conn(0x7f56f415b420 legacy=0x7f56f406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.010+0000 7f56f9c51640 1 -- 172.21.15.38:0/2993537701 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f40cdd30 con 0x7f56f40a44a0 2023-12-22T08:43:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.011+0000 7f56f9c51640 1 --2- 172.21.15.38:0/2993537701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56f40a44a0 0x7f56f40708f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f56e40097a0 tx=0x7f56e402b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1baccded6d7c6e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.011+0000 7f56f9450640 1 -- 172.21.15.38:0/2993537701 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4030710 con 0x7f56f40a44a0 2023-12-22T08:43:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.011+0000 7f56f9450640 1 -- 172.21.15.38:0/2993537701 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e402e050 con 0x7f56f40a44a0 2023-12-22T08:43:15.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.011+0000 7f56f9450640 1 -- 172.21.15.38:0/2993537701 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4030a90 con 0x7f56f40a44a0 2023-12-22T08:43:15.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.012+0000 7f56fb454640 1 -- 172.21.15.38:0/2993537701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56f40a44a0 msgr2=0x7f56f40708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.012+0000 7f56fb454640 1 --2- 172.21.15.38:0/2993537701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56f40a44a0 0x7f56f40708f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f56e40097a0 tx=0x7f56e402b710 comp rx=0 tx=0).stop 2023-12-22T08:43:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.012+0000 7f56fb454640 1 -- 172.21.15.38:0/2993537701 shutdown_connections 2023-12-22T08:43:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.012+0000 7f56fb454640 1 --2- 172.21.15.38:0/2993537701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56f40a44a0 0x7f56f40708f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.012+0000 7f56fb454640 1 -- 172.21.15.38:0/2993537701 >> 172.21.15.38:0/2993537701 conn(0x7f56f40b1f70 msgr2=0x7f56f40b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.012+0000 7f56fb454640 1 -- 172.21.15.38:0/2993537701 shutdown_connections 2023-12-22T08:43:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.012+0000 7f56fb454640 1 -- 172.21.15.38:0/2993537701 wait complete. 2023-12-22T08:43:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.014+0000 7f56fb454640 1 Processor -- start 2023-12-22T08:43:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.014+0000 7f56fb454640 1 -- start start 2023-12-22T08:43:15.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.015+0000 7f56fb454640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56f4070e30 0x7f56f414a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.015+0000 7f56fb454640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56f40a44a0 0x7f56f40cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.015+0000 7f56fb454640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56f415b420 0x7f56f4159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.015+0000 7f56fb454640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f40cc780 con 0x7f56f4070e30 2023-12-22T08:43:15.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.015+0000 7f56fb454640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f40cca60 con 0x7f56f415b420 2023-12-22T08:43:15.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.015+0000 7f56fb454640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f40ccd40 con 0x7f56f40a44a0 2023-12-22T08:43:15.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.015+0000 7f56fa452640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56f4070e30 0x7f56f414a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:15.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.015+0000 7f56fa452640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56f4070e30 0x7f56f414a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33950/0 (socket says 172.21.15.38:33950) 2023-12-22T08:43:15.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.015+0000 7f56fa452640 1 -- 172.21.15.38:0/1193729029 learned_addr learned my addr 172.21.15.38:0/1193729029 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:15.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.016+0000 7f56fa452640 1 -- 172.21.15.38:0/1193729029 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56f40a44a0 msgr2=0x7f56f40cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:15.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.016+0000 7f56fa452640 1 --2- 172.21.15.38:0/1193729029 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56f40a44a0 0x7f56f40cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.016+0000 7f56fa452640 1 -- 172.21.15.38:0/1193729029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56f415b420 msgr2=0x7f56f4159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:15.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.016+0000 7f56fa452640 1 --2- 172.21.15.38:0/1193729029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56f415b420 0x7f56f4159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.016+0000 7f56fa452640 1 -- 172.21.15.38:0/1193729029 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e4009400 con 0x7f56f4070e30 2023-12-22T08:43:15.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.016+0000 7f56fa452640 1 --2- 172.21.15.38:0/1193729029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56f4070e30 0x7f56f414a230 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f56f000c800 tx=0x7f56f000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:15.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.016+0000 7f56eaffd640 1 -- 172.21.15.38:0/1193729029 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f00072d0 con 0x7f56f4070e30 2023-12-22T08:43:15.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.016+0000 7f56eaffd640 1 -- 172.21.15.38:0/1193729029 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f0007430 con 0x7f56f4070e30 2023-12-22T08:43:15.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.016+0000 7f56eaffd640 1 -- 172.21.15.38:0/1193729029 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f00047e0 con 0x7f56f4070e30 2023-12-22T08:43:15.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.016+0000 7f56fb454640 1 -- 172.21.15.38:0/1193729029 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f40cd020 con 0x7f56f4070e30 2023-12-22T08:43:15.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.016+0000 7f56fb454640 1 -- 172.21.15.38:0/1193729029 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f40cd820 con 0x7f56f4070e30 2023-12-22T08:43:15.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.017+0000 7f56fb454640 1 -- 172.21.15.38:0/1193729029 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f40cd540 con 0x7f56f4070e30 2023-12-22T08:43:15.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.018+0000 7f56eaffd640 1 -- 172.21.15.38:0/1193729029 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f56f0004960 con 0x7f56f4070e30 2023-12-22T08:43:15.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.019+0000 7f56eaffd640 1 --2- 172.21.15.38:0/1193729029 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f56d806a430 0x7f56d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.019+0000 7f56eaffd640 1 -- 172.21.15.38:0/1193729029 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56f0087e40 con 0x7f56f4070e30 2023-12-22T08:43:15.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.020+0000 7f56f9c51640 1 --2- 172.21.15.38:0/1193729029 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f56d806a430 0x7f56d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:15.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.021+0000 7f56f9c51640 1 --2- 172.21.15.38:0/1193729029 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f56d806a430 0x7f56d806c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f56e4034000 tx=0x7f56e402f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:15.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.024+0000 7f56eaffd640 1 -- 172.21.15.38:0/1193729029 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f56f0053390 con 0x7f56f4070e30 2023-12-22T08:43:15.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.292+0000 7f56fb454640 1 -- 172.21.15.38:0/1193729029 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f56f4061910 con 0x7f56f4070e30 2023-12-22T08:43:15.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.292+0000 7f56eaffd640 1 -- 172.21.15.38:0/1193729029 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1167 (secure 0 0 0) 0x7f56f0018080 con 0x7f56f4070e30 2023-12-22T08:43:15.294 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:15.295 INFO:teuthology.orchestra.run.smithi038.stdout:{"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":214,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":72,"num_osds":8,"num_up_osds":8,"osd_up_since":1703234387,"num_in_osds":8,"osd_in_since":1703234384,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":4182345,"bytes_avail":1595817655,"bytes_total":1600000000,"write_bytes_sec":2309,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6012}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-12-22T08:42:56.417504+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-22T08:43:15.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.295+0000 7f56fb454640 1 -- 172.21.15.38:0/1193729029 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f56d806a430 msgr2=0x7f56d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:15.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.295+0000 7f56fb454640 1 --2- 172.21.15.38:0/1193729029 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f56d806a430 0x7f56d806c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f56e4034000 tx=0x7f56e402f000 comp rx=0 tx=0).stop 2023-12-22T08:43:15.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.295+0000 7f56fb454640 1 -- 172.21.15.38:0/1193729029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56f4070e30 msgr2=0x7f56f414a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:15.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.295+0000 7f56fb454640 1 --2- 172.21.15.38:0/1193729029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56f4070e30 0x7f56f414a230 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f56f000c800 tx=0x7f56f000ccc0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.295+0000 7f56fb454640 1 -- 172.21.15.38:0/1193729029 shutdown_connections 2023-12-22T08:43:15.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.295+0000 7f56fb454640 1 --2- 172.21.15.38:0/1193729029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56f415b420 0x7f56f4159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.295+0000 7f56fb454640 1 --2- 172.21.15.38:0/1193729029 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56f40a44a0 0x7f56f40cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.295+0000 7f56fb454640 1 --2- 172.21.15.38:0/1193729029 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f56d806a430 0x7f56d806c8f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.295+0000 7f56fb454640 1 --2- 172.21.15.38:0/1193729029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56f4070e30 0x7f56f414a230 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.295+0000 7f56fb454640 1 -- 172.21.15.38:0/1193729029 >> 172.21.15.38:0/1193729029 conn(0x7f56f40b1f70 msgr2=0x7f56f415d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:15.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.295+0000 7f56fb454640 1 -- 172.21.15.38:0/1193729029 shutdown_connections 2023-12-22T08:43:15.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.295+0000 7f56fb454640 1 -- 172.21.15.38:0/1193729029 wait complete. 2023-12-22T08:43:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-22T08:43:15.315 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:43:15.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.531+0000 7fe5fafc6640 1 Processor -- start 2023-12-22T08:43:15.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.531+0000 7fe5fafc6640 1 -- start start 2023-12-22T08:43:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.533+0000 7fe5fafc6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f40d1240 0x7fe5f40b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.533+0000 7fe5fafc6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe5f40b3b40 0x7fe5f40cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.533+0000 7fe5fafc6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f40b5c80 con 0x7fe5f40cfc60 2023-12-22T08:43:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.533+0000 7fe5fafc6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f40d0760 con 0x7fe5f40b3b40 2023-12-22T08:43:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.533+0000 7fe5fafc6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40d01a0 con 0x7fe5f40d1240 2023-12-22T08:43:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.533+0000 7fe5f9563640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe5f40cfc60 0x7fe5f40b6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34730/0 (socket says 172.21.15.38:34730) 2023-12-22T08:43:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.533+0000 7fe5f9563640 1 -- 172.21.15.38:0/3554625979 learned_addr learned my addr 172.21.15.38:0/3554625979 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:43:15.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.533+0000 7fe5f8d62640 1 --2- 172.21.15.38:0/3554625979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f40d1240 0x7fe5f40b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:15.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.533+0000 7fe5f3fff640 1 --2- 172.21.15.38:0/3554625979 >> v2:172.21.15.89:3300/0 conn(0x7fe5f40b3b40 0x7fe5f40cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:15.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.533+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551312831 0 0) 0x7fe5f40b5c80 con 0x7fe5f40cfc60 2023-12-22T08:43:15.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5dc003520 con 0x7fe5f40cfc60 2023-12-22T08:43:15.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1946908303 0 0) 0x7fe5dc003520 con 0x7fe5f40cfc60 2023-12-22T08:43:15.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f40d1240 msgr2=0x7fe5f40b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:15.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 --2- 172.21.15.38:0/3554625979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f40d1240 0x7fe5f40b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 >> v2:172.21.15.89:3300/0 conn(0x7fe5f40b3b40 msgr2=0x7fe5f40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 --2- 172.21.15.38:0/3554625979 >> v2:172.21.15.89:3300/0 conn(0x7fe5f40b3b40 0x7fe5f40cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f40d0480 con 0x7fe5f40cfc60 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fe5ec001670 con 0x7fe5f40cfc60 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f3fff640 1 --2- 172.21.15.38:0/3554625979 >> v2:172.21.15.89:3300/0 conn(0x7fe5f40b3b40 0x7fe5f40cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 >> v1:172.21.15.38:6789/0 conn(0x7fe5f40cfc60 legacy=0x7fe5f40b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 --2- 172.21.15.38:0/3554625979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5dc003970 0x7fe5dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 --2- 172.21.15.38:0/3554625979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f40d1240 0x7fe5dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 --2- 172.21.15.38:0/3554625979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5dc004d00 0x7fe5dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40d0760 con 0x7fe5dc004d00 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40d01a0 con 0x7fe5dc003970 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc00ba00 con 0x7fe5f40d1240 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.534+0000 7fe5f9563640 1 --2- 172.21.15.38:0/3554625979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5dc004d00 0x7fe5dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.535+0000 7fe5f8d62640 1 --2- 172.21.15.38:0/3554625979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5dc003970 0x7fe5dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.535+0000 7fe5f3fff640 1 --2- 172.21.15.38:0/3554625979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f40d1240 0x7fe5dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.535+0000 7fe5f9563640 1 -- 172.21.15.38:0/3554625979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f40d1240 msgr2=0x7fe5dc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.535+0000 7fe5f9563640 1 --2- 172.21.15.38:0/3554625979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f40d1240 0x7fe5dc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.535+0000 7fe5f9563640 1 -- 172.21.15.38:0/3554625979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5dc003970 msgr2=0x7fe5dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.535+0000 7fe5f9563640 1 --2- 172.21.15.38:0/3554625979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5dc003970 0x7fe5dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.535+0000 7fe5f9563640 1 -- 172.21.15.38:0/3554625979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc003520 con 0x7fe5dc004d00 2023-12-22T08:43:15.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.536+0000 7fe5f9563640 1 --2- 172.21.15.38:0/3554625979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5dc004d00 0x7fe5dc005180 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40d00d0 tx=0x7fe5dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5f7b7625c96c9d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.536+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec005ad0 con 0x7fe5dc004d00 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.537+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec005c30 con 0x7fe5dc004d00 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.537+0000 7fe5f37fe640 1 -- 172.21.15.38:0/3554625979 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec02c7c0 con 0x7fe5dc004d00 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.537+0000 7fe5fafc6640 1 -- 172.21.15.38:0/3554625979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5dc004d00 msgr2=0x7fe5dc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.537+0000 7fe5fafc6640 1 --2- 172.21.15.38:0/3554625979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5dc004d00 0x7fe5dc005180 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40d00d0 tx=0x7fe5dc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.537+0000 7fe5f9563640 1 -- 172.21.15.38:0/3554625979 reap_dead start 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.537+0000 7fe5fafc6640 1 -- 172.21.15.38:0/3554625979 shutdown_connections 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.537+0000 7fe5fafc6640 1 -- 172.21.15.38:0/3554625979 >> 172.21.15.38:0/3554625979 conn(0x7fe5f406c5e0 msgr2=0x7fe5f406c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.537+0000 7fe5fafc6640 1 -- 172.21.15.38:0/3554625979 shutdown_connections 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.537+0000 7fe5fafc6640 1 -- 172.21.15.38:0/3554625979 wait complete. 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.539+0000 7fe5fafc6640 1 Processor -- start 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.539+0000 7fe5fafc6640 1 -- start start 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.540+0000 7fe5fafc6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5dc004d00 0x7fe5f415e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.540+0000 7fe5fafc6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5f413cd00 0x7fe5f406da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.540+0000 7fe5fafc6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f406df80 0x7fe5f4149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.540+0000 7fe5fafc6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f406e430 con 0x7fe5dc004d00 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.540+0000 7fe5fafc6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f415d960 con 0x7fe5f413cd00 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.540+0000 7fe5fafc6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f415e200 con 0x7fe5f406df80 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.540+0000 7fe5f8d62640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5dc004d00 0x7fe5f415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.540+0000 7fe5f8d62640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5dc004d00 0x7fe5f415e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33966/0 (socket says 172.21.15.38:33966) 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.540+0000 7fe5f8d62640 1 -- 172.21.15.38:0/2314700787 learned_addr learned my addr 172.21.15.38:0/2314700787 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.541+0000 7fe5f8d62640 1 -- 172.21.15.38:0/2314700787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f406df80 msgr2=0x7fe5f4149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.541+0000 7fe5f8d62640 1 --2- 172.21.15.38:0/2314700787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f406df80 0x7fe5f4149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.541+0000 7fe5f8d62640 1 -- 172.21.15.38:0/2314700787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5f413cd00 msgr2=0x7fe5f406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.541+0000 7fe5f8d62640 1 --2- 172.21.15.38:0/2314700787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5f413cd00 0x7fe5f406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.541+0000 7fe5f8d62640 1 -- 172.21.15.38:0/2314700787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f414a620 con 0x7fe5dc004d00 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.541+0000 7fe5f8d62640 1 --2- 172.21.15.38:0/2314700787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5dc004d00 0x7fe5f415e690 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4007ed0 tx=0x7fe5e40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.541+0000 7fe5f17fa640 1 -- 172.21.15.38:0/2314700787 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400e030 con 0x7fe5dc004d00 2023-12-22T08:43:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.541+0000 7fe5f17fa640 1 -- 172.21.15.38:0/2314700787 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e4016470 con 0x7fe5dc004d00 2023-12-22T08:43:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.541+0000 7fe5f17fa640 1 -- 172.21.15.38:0/2314700787 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4016820 con 0x7fe5dc004d00 2023-12-22T08:43:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.541+0000 7fe5fafc6640 1 -- 172.21.15.38:0/2314700787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f415dbb0 con 0x7fe5dc004d00 2023-12-22T08:43:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.542+0000 7fe5fafc6640 1 -- 172.21.15.38:0/2314700787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f413d160 con 0x7fe5dc004d00 2023-12-22T08:43:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.543+0000 7fe5fafc6640 1 -- 172.21.15.38:0/2314700787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f4061910 con 0x7fe5dc004d00 2023-12-22T08:43:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.544+0000 7fe5f17fa640 1 -- 172.21.15.38:0/2314700787 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe5e4016980 con 0x7fe5dc004d00 2023-12-22T08:43:15.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.545+0000 7fe5f17fa640 1 --2- 172.21.15.38:0/2314700787 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5e006a430 0x7fe5e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:15.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.545+0000 7fe5f17fa640 1 -- 172.21.15.38:0/2314700787 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5e400f070 con 0x7fe5dc004d00 2023-12-22T08:43:15.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.546+0000 7fe5f3fff640 1 --2- 172.21.15.38:0/2314700787 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5e006a430 0x7fe5e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:15.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.547+0000 7fe5f3fff640 1 --2- 172.21.15.38:0/2314700787 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5e006a430 0x7fe5e006c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8006f00 tx=0x7fe5e8006e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:15.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.549+0000 7fe5f17fa640 1 -- 172.21.15.38:0/2314700787 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe5e4054da0 con 0x7fe5dc004d00 2023-12-22T08:43:15.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.739+0000 7fe5fafc6640 1 -- 172.21.15.38:0/2314700787 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5f40b6600 con 0x7fe5e006a430 2023-12-22T08:43:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.762+0000 7fe5f17fa640 1 -- 172.21.15.38:0/2314700787 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282283 (secure 0 0 0) 0x7fe5e800cdb0 con 0x7fe5e006a430 2023-12-22T08:43:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:15.769 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:43:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.767+0000 7fe5fafc6640 1 -- 172.21.15.38:0/2314700787 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5e006a430 msgr2=0x7fe5e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.767+0000 7fe5fafc6640 1 --2- 172.21.15.38:0/2314700787 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5e006a430 0x7fe5e006c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8006f00 tx=0x7fe5e8006e30 comp rx=0 tx=0).stop 2023-12-22T08:43:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.767+0000 7fe5fafc6640 1 -- 172.21.15.38:0/2314700787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5dc004d00 msgr2=0x7fe5f415e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.767+0000 7fe5fafc6640 1 --2- 172.21.15.38:0/2314700787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5dc004d00 0x7fe5f415e690 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4007ed0 tx=0x7fe5e40115a0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.767+0000 7fe5fafc6640 1 -- 172.21.15.38:0/2314700787 shutdown_connections 2023-12-22T08:43:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.767+0000 7fe5fafc6640 1 --2- 172.21.15.38:0/2314700787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5f406df80 0x7fe5f4149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.767+0000 7fe5fafc6640 1 --2- 172.21.15.38:0/2314700787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5f413cd00 0x7fe5f406da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.767+0000 7fe5fafc6640 1 --2- 172.21.15.38:0/2314700787 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5e006a430 0x7fe5e006c8f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.767+0000 7fe5fafc6640 1 --2- 172.21.15.38:0/2314700787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5dc004d00 0x7fe5f415e690 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.767+0000 7fe5fafc6640 1 -- 172.21.15.38:0/2314700787 >> 172.21.15.38:0/2314700787 conn(0x7fe5f406c5e0 msgr2=0x7fe5f40b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.767+0000 7fe5fafc6640 1 -- 172.21.15.38:0/2314700787 shutdown_connections 2023-12-22T08:43:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:15.767+0000 7fe5fafc6640 1 -- 172.21.15.38:0/2314700787 wait complete. 2023-12-22T08:43:15.789 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2023-12-22T08:43:14.422606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4084,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558415,"statfs":{"total":1600000000,"available":1595817655,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.207446"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.769139+0000","last_change":"2023-12-22T08:43:08.768994+0000","last_active":"2023-12-22T08:43:08.769139+0000","last_peered":"2023-12-22T08:43:08.769139+0000","last_clean":"2023-12-22T08:43:08.769139+0000","last_became_active":"2023-12-22T08:43:08.767875+0000","last_became_peered":"2023-12-22T08:43:08.767875+0000","last_unstale":"2023-12-22T08:43:08.769139+0000","last_undegraded":"2023-12-22T08:43:08.769139+0000","last_fullsized":"2023-12-22T08:43:08.769139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:19.778557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780504+0000","last_change":"2023-12-22T08:43:08.780418+0000","last_active":"2023-12-22T08:43:08.780504+0000","last_peered":"2023-12-22T08:43:08.780504+0000","last_clean":"2023-12-22T08:43:08.780504+0000","last_became_active":"2023-12-22T08:43:08.779658+0000","last_became_peered":"2023-12-22T08:43:08.779658+0000","last_unstale":"2023-12-22T08:43:08.780504+0000","last_undegraded":"2023-12-22T08:43:08.780504+0000","last_fullsized":"2023-12-22T08:43:08.780504+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:38.767539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760810+0000","last_change":"2023-12-22T08:43:08.760735+0000","last_active":"2023-12-22T08:43:08.760810+0000","last_peered":"2023-12-22T08:43:08.760810+0000","last_clean":"2023-12-22T08:43:08.760810+0000","last_became_active":"2023-12-22T08:43:08.760505+0000","last_became_peered":"2023-12-22T08:43:08.760505+0000","last_unstale":"2023-12-22T08:43:08.760810+0000","last_undegraded":"2023-12-22T08:43:08.760810+0000","last_fullsized":"2023-12-22T08:43:08.760810+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:16:21.250428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.766653+0000","last_change":"2023-12-22T08:43:08.766231+0000","last_active":"2023-12-22T08:43:08.766653+0000","last_peered":"2023-12-22T08:43:08.766653+0000","last_clean":"2023-12-22T08:43:08.766653+0000","last_became_active":"2023-12-22T08:43:08.765962+0000","last_became_peered":"2023-12-22T08:43:08.765962+0000","last_unstale":"2023-12-22T08:43:08.766653+0000","last_undegraded":"2023-12-22T08:43:08.766653+0000","last_fullsized":"2023-12-22T08:43:08.766653+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:39:28.695272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765417+0000","last_change":"2023-12-22T08:43:08.764141+0000","last_active":"2023-12-22T08:43:08.765417+0000","last_peered":"2023-12-22T08:43:08.765417+0000","last_clean":"2023-12-22T08:43:08.765417+0000","last_became_active":"2023-12-22T08:43:08.760446+0000","last_became_peered":"2023-12-22T08:43:08.760446+0000","last_unstale":"2023-12-22T08:43:08.765417+0000","last_undegraded":"2023-12-22T08:43:08.765417+0000","last_fullsized":"2023-12-22T08:43:08.765417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:53.820355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765491+0000","last_change":"2023-12-22T08:43:08.765266+0000","last_active":"2023-12-22T08:43:08.765491+0000","last_peered":"2023-12-22T08:43:08.765491+0000","last_clean":"2023-12-22T08:43:08.765491+0000","last_became_active":"2023-12-22T08:43:08.764819+0000","last_became_peered":"2023-12-22T08:43:08.764819+0000","last_unstale":"2023-12-22T08:43:08.765491+0000","last_undegraded":"2023-12-22T08:43:08.765491+0000","last_fullsized":"2023-12-22T08:43:08.765491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:08.268339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.761773+0000","last_change":"2023-12-22T08:43:08.761706+0000","last_active":"2023-12-22T08:43:08.761773+0000","last_peered":"2023-12-22T08:43:08.761773+0000","last_clean":"2023-12-22T08:43:08.761773+0000","last_became_active":"2023-12-22T08:43:08.761392+0000","last_became_peered":"2023-12-22T08:43:08.761392+0000","last_unstale":"2023-12-22T08:43:08.761773+0000","last_undegraded":"2023-12-22T08:43:08.761773+0000","last_fullsized":"2023-12-22T08:43:08.761773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:41:04.613813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780490+0000","last_change":"2023-12-22T08:43:08.780082+0000","last_active":"2023-12-22T08:43:08.780490+0000","last_peered":"2023-12-22T08:43:08.780490+0000","last_clean":"2023-12-22T08:43:08.780490+0000","last_became_active":"2023-12-22T08:43:08.775897+0000","last_became_peered":"2023-12-22T08:43:08.775897+0000","last_unstale":"2023-12-22T08:43:08.780490+0000","last_undegraded":"2023-12-22T08:43:08.780490+0000","last_fullsized":"2023-12-22T08:43:08.780490+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:17.538382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.770465+0000","last_change":"2023-12-22T08:43:08.768897+0000","last_active":"2023-12-22T08:43:08.770465+0000","last_peered":"2023-12-22T08:43:08.770465+0000","last_clean":"2023-12-22T08:43:08.770465+0000","last_became_active":"2023-12-22T08:43:08.768331+0000","last_became_peered":"2023-12-22T08:43:08.768331+0000","last_unstale":"2023-12-22T08:43:08.770465+0000","last_undegraded":"2023-12-22T08:43:08.770465+0000","last_fullsized":"2023-12-22T08:43:08.770465+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:50.001477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765434+0000","last_change":"2023-12-22T08:43:08.764540+0000","last_active":"2023-12-22T08:43:08.765434+0000","last_peered":"2023-12-22T08:43:08.765434+0000","last_clean":"2023-12-22T08:43:08.765434+0000","last_became_active":"2023-12-22T08:43:08.763549+0000","last_became_peered":"2023-12-22T08:43:08.763549+0000","last_unstale":"2023-12-22T08:43:08.765434+0000","last_undegraded":"2023-12-22T08:43:08.765434+0000","last_fullsized":"2023-12-22T08:43:08.765434+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:25.938446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765998+0000","last_change":"2023-12-22T08:43:08.763811+0000","last_active":"2023-12-22T08:43:08.765998+0000","last_peered":"2023-12-22T08:43:08.765998+0000","last_clean":"2023-12-22T08:43:08.765998+0000","last_became_active":"2023-12-22T08:43:08.763370+0000","last_became_peered":"2023-12-22T08:43:08.763370+0000","last_unstale":"2023-12-22T08:43:08.765998+0000","last_undegraded":"2023-12-22T08:43:08.765998+0000","last_fullsized":"2023-12-22T08:43:08.765998+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:59.082663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.758061+0000","last_change":"2023-12-22T08:43:08.757253+0000","last_active":"2023-12-22T08:43:08.758061+0000","last_peered":"2023-12-22T08:43:08.758061+0000","last_clean":"2023-12-22T08:43:08.758061+0000","last_became_active":"2023-12-22T08:43:08.756898+0000","last_became_peered":"2023-12-22T08:43:08.756898+0000","last_unstale":"2023-12-22T08:43:08.758061+0000","last_undegraded":"2023-12-22T08:43:08.758061+0000","last_fullsized":"2023-12-22T08:43:08.758061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:28.563154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774725+0000","last_change":"2023-12-22T08:43:08.774645+0000","last_active":"2023-12-22T08:43:08.774725+0000","last_peered":"2023-12-22T08:43:08.774725+0000","last_clean":"2023-12-22T08:43:08.774725+0000","last_became_active":"2023-12-22T08:43:08.774481+0000","last_became_peered":"2023-12-22T08:43:08.774481+0000","last_unstale":"2023-12-22T08:43:08.774725+0000","last_undegraded":"2023-12-22T08:43:08.774725+0000","last_fullsized":"2023-12-22T08:43:08.774725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:04.134244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775790+0000","last_change":"2023-12-22T08:43:08.775710+0000","last_active":"2023-12-22T08:43:08.775790+0000","last_peered":"2023-12-22T08:43:08.775790+0000","last_clean":"2023-12-22T08:43:08.775790+0000","last_became_active":"2023-12-22T08:43:08.775344+0000","last_became_peered":"2023-12-22T08:43:08.775344+0000","last_unstale":"2023-12-22T08:43:08.775790+0000","last_undegraded":"2023-12-22T08:43:08.775790+0000","last_fullsized":"2023-12-22T08:43:08.775790+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:31.918421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768154+0000","last_change":"2023-12-22T08:43:08.768085+0000","last_active":"2023-12-22T08:43:08.768154+0000","last_peered":"2023-12-22T08:43:08.768154+0000","last_clean":"2023-12-22T08:43:08.768154+0000","last_became_active":"2023-12-22T08:43:08.767893+0000","last_became_peered":"2023-12-22T08:43:08.767893+0000","last_unstale":"2023-12-22T08:43:08.768154+0000","last_undegraded":"2023-12-22T08:43:08.768154+0000","last_fullsized":"2023-12-22T08:43:08.768154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:53.820355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765401+0000","last_change":"2023-12-22T08:43:08.764151+0000","last_active":"2023-12-22T08:43:08.765401+0000","last_peered":"2023-12-22T08:43:08.765401+0000","last_clean":"2023-12-22T08:43:08.765401+0000","last_became_active":"2023-12-22T08:43:08.763651+0000","last_became_peered":"2023-12-22T08:43:08.763651+0000","last_unstale":"2023-12-22T08:43:08.765401+0000","last_undegraded":"2023-12-22T08:43:08.765401+0000","last_fullsized":"2023-12-22T08:43:08.765401+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:43.665325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765450+0000","last_change":"2023-12-22T08:43:08.764908+0000","last_active":"2023-12-22T08:43:08.765450+0000","last_peered":"2023-12-22T08:43:08.765450+0000","last_clean":"2023-12-22T08:43:08.765450+0000","last_became_active":"2023-12-22T08:43:08.761599+0000","last_became_peered":"2023-12-22T08:43:08.761599+0000","last_unstale":"2023-12-22T08:43:08.765450+0000","last_undegraded":"2023-12-22T08:43:08.765450+0000","last_fullsized":"2023-12-22T08:43:08.765450+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:38.811875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774213+0000","last_change":"2023-12-22T08:43:08.774063+0000","last_active":"2023-12-22T08:43:08.774213+0000","last_peered":"2023-12-22T08:43:08.774213+0000","last_clean":"2023-12-22T08:43:08.774213+0000","last_became_active":"2023-12-22T08:43:08.773691+0000","last_became_peered":"2023-12-22T08:43:08.773691+0000","last_unstale":"2023-12-22T08:43:08.774213+0000","last_undegraded":"2023-12-22T08:43:08.774213+0000","last_fullsized":"2023-12-22T08:43:08.774213+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:05.131643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778977+0000","last_change":"2023-12-22T08:43:08.778665+0000","last_active":"2023-12-22T08:43:08.778977+0000","last_peered":"2023-12-22T08:43:08.778977+0000","last_clean":"2023-12-22T08:43:08.778977+0000","last_became_active":"2023-12-22T08:43:08.778435+0000","last_became_peered":"2023-12-22T08:43:08.778435+0000","last_unstale":"2023-12-22T08:43:08.778977+0000","last_undegraded":"2023-12-22T08:43:08.778977+0000","last_fullsized":"2023-12-22T08:43:08.778977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:45.919846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.767546+0000","last_change":"2023-12-22T08:43:08.767403+0000","last_active":"2023-12-22T08:43:08.767546+0000","last_peered":"2023-12-22T08:43:08.767546+0000","last_clean":"2023-12-22T08:43:08.767546+0000","last_became_active":"2023-12-22T08:43:08.766987+0000","last_became_peered":"2023-12-22T08:43:08.766987+0000","last_unstale":"2023-12-22T08:43:08.767546+0000","last_undegraded":"2023-12-22T08:43:08.767546+0000","last_fullsized":"2023-12-22T08:43:08.767546+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:13.722210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760231+0000","last_change":"2023-12-22T08:43:08.759198+0000","last_active":"2023-12-22T08:43:08.760231+0000","last_peered":"2023-12-22T08:43:08.760231+0000","last_clean":"2023-12-22T08:43:08.760231+0000","last_became_active":"2023-12-22T08:43:08.758223+0000","last_became_peered":"2023-12-22T08:43:08.758223+0000","last_unstale":"2023-12-22T08:43:08.760231+0000","last_undegraded":"2023-12-22T08:43:08.760231+0000","last_fullsized":"2023-12-22T08:43:08.760231+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:38.811875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.781265+0000","last_change":"2023-12-22T08:43:08.781203+0000","last_active":"2023-12-22T08:43:08.781265+0000","last_peered":"2023-12-22T08:43:08.781265+0000","last_clean":"2023-12-22T08:43:08.781265+0000","last_became_active":"2023-12-22T08:43:08.780644+0000","last_became_peered":"2023-12-22T08:43:08.780644+0000","last_unstale":"2023-12-22T08:43:08.781265+0000","last_undegraded":"2023-12-22T08:43:08.781265+0000","last_fullsized":"2023-12-22T08:43:08.781265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:24:55.494298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774057+0000","last_change":"2023-12-22T08:43:08.773780+0000","last_active":"2023-12-22T08:43:08.774057+0000","last_peered":"2023-12-22T08:43:08.774057+0000","last_clean":"2023-12-22T08:43:08.774057+0000","last_became_active":"2023-12-22T08:43:08.773551+0000","last_became_peered":"2023-12-22T08:43:08.773551+0000","last_unstale":"2023-12-22T08:43:08.774057+0000","last_undegraded":"2023-12-22T08:43:08.774057+0000","last_fullsized":"2023-12-22T08:43:08.774057+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:59:35.438006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.770483+0000","last_change":"2023-12-22T08:43:08.769139+0000","last_active":"2023-12-22T08:43:08.770483+0000","last_peered":"2023-12-22T08:43:08.770483+0000","last_clean":"2023-12-22T08:43:08.770483+0000","last_became_active":"2023-12-22T08:43:08.768657+0000","last_became_peered":"2023-12-22T08:43:08.768657+0000","last_unstale":"2023-12-22T08:43:08.770483+0000","last_undegraded":"2023-12-22T08:43:08.770483+0000","last_fullsized":"2023-12-22T08:43:08.770483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:30:25.664436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.782335+0000","last_change":"2023-12-22T08:43:08.782157+0000","last_active":"2023-12-22T08:43:08.782335+0000","last_peered":"2023-12-22T08:43:08.782335+0000","last_clean":"2023-12-22T08:43:08.782335+0000","last_became_active":"2023-12-22T08:43:08.781718+0000","last_became_peered":"2023-12-22T08:43:08.781718+0000","last_unstale":"2023-12-22T08:43:08.782335+0000","last_undegraded":"2023-12-22T08:43:08.782335+0000","last_fullsized":"2023-12-22T08:43:08.782335+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:43.665325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760265+0000","last_change":"2023-12-22T08:43:08.759714+0000","last_active":"2023-12-22T08:43:08.760265+0000","last_peered":"2023-12-22T08:43:08.760265+0000","last_clean":"2023-12-22T08:43:08.760265+0000","last_became_active":"2023-12-22T08:43:08.759458+0000","last_became_peered":"2023-12-22T08:43:08.759458+0000","last_unstale":"2023-12-22T08:43:08.760265+0000","last_undegraded":"2023-12-22T08:43:08.760265+0000","last_fullsized":"2023-12-22T08:43:08.760265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:25.938446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778850+0000","last_change":"2023-12-22T08:43:08.778079+0000","last_active":"2023-12-22T08:43:08.778850+0000","last_peered":"2023-12-22T08:43:08.778850+0000","last_clean":"2023-12-22T08:43:08.778850+0000","last_became_active":"2023-12-22T08:43:08.777828+0000","last_became_peered":"2023-12-22T08:43:08.777828+0000","last_unstale":"2023-12-22T08:43:08.778850+0000","last_undegraded":"2023-12-22T08:43:08.778850+0000","last_fullsized":"2023-12-22T08:43:08.778850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:28.970593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.776001+0000","last_change":"2023-12-22T08:43:08.775431+0000","last_active":"2023-12-22T08:43:08.776001+0000","last_peered":"2023-12-22T08:43:08.776001+0000","last_clean":"2023-12-22T08:43:08.776001+0000","last_became_active":"2023-12-22T08:43:08.770714+0000","last_became_peered":"2023-12-22T08:43:08.770714+0000","last_unstale":"2023-12-22T08:43:08.776001+0000","last_undegraded":"2023-12-22T08:43:08.776001+0000","last_fullsized":"2023-12-22T08:43:08.776001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:59.082663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778321+0000","last_change":"2023-12-22T08:43:08.777124+0000","last_active":"2023-12-22T08:43:08.778321+0000","last_peered":"2023-12-22T08:43:08.778321+0000","last_clean":"2023-12-22T08:43:08.778321+0000","last_became_active":"2023-12-22T08:43:08.776768+0000","last_became_peered":"2023-12-22T08:43:08.776768+0000","last_unstale":"2023-12-22T08:43:08.778321+0000","last_undegraded":"2023-12-22T08:43:08.778321+0000","last_fullsized":"2023-12-22T08:43:08.778321+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:22:54.223163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.759180+0000","last_change":"2023-12-22T08:43:08.759112+0000","last_active":"2023-12-22T08:43:08.759180+0000","last_peered":"2023-12-22T08:43:08.759180+0000","last_clean":"2023-12-22T08:43:08.759180+0000","last_became_active":"2023-12-22T08:43:08.758739+0000","last_became_peered":"2023-12-22T08:43:08.758739+0000","last_unstale":"2023-12-22T08:43:08.759180+0000","last_undegraded":"2023-12-22T08:43:08.759180+0000","last_fullsized":"2023-12-22T08:43:08.759180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:21.060714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.776206+0000","last_change":"2023-12-22T08:43:08.775929+0000","last_active":"2023-12-22T08:43:08.776206+0000","last_peered":"2023-12-22T08:43:08.776206+0000","last_clean":"2023-12-22T08:43:08.776206+0000","last_became_active":"2023-12-22T08:43:08.775705+0000","last_became_peered":"2023-12-22T08:43:08.775705+0000","last_unstale":"2023-12-22T08:43:08.776206+0000","last_undegraded":"2023-12-22T08:43:08.776206+0000","last_fullsized":"2023-12-22T08:43:08.776206+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:24:12.486647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780952+0000","last_change":"2023-12-22T08:43:08.780870+0000","last_active":"2023-12-22T08:43:08.780952+0000","last_peered":"2023-12-22T08:43:08.780952+0000","last_clean":"2023-12-22T08:43:08.780952+0000","last_became_active":"2023-12-22T08:43:08.779502+0000","last_became_peered":"2023-12-22T08:43:08.779502+0000","last_unstale":"2023-12-22T08:43:08.780952+0000","last_undegraded":"2023-12-22T08:43:08.780952+0000","last_fullsized":"2023-12-22T08:43:08.780952+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:31.918421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768828+0000","last_change":"2023-12-22T08:43:08.768756+0000","last_active":"2023-12-22T08:43:08.768828+0000","last_peered":"2023-12-22T08:43:08.768828+0000","last_clean":"2023-12-22T08:43:08.768828+0000","last_became_active":"2023-12-22T08:43:08.767824+0000","last_became_peered":"2023-12-22T08:43:08.767824+0000","last_unstale":"2023-12-22T08:43:08.768828+0000","last_undegraded":"2023-12-22T08:43:08.768828+0000","last_fullsized":"2023-12-22T08:43:08.768828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:45:00.000204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"71'4","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778049+0000","last_change":"2023-12-22T08:43:08.241094+0000","last_active":"2023-12-22T08:43:08.778049+0000","last_peered":"2023-12-22T08:43:08.778049+0000","last_clean":"2023-12-22T08:43:08.778049+0000","last_became_active":"2023-12-22T08:43:08.240506+0000","last_became_peered":"2023-12-22T08:43:08.240506+0000","last_unstale":"2023-12-22T08:43:08.778049+0000","last_undegraded":"2023-12-22T08:43:08.778049+0000","last_fullsized":"2023-12-22T08:43:08.778049+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:26.160091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765315+0000","last_change":"2023-12-22T08:43:08.759468+0000","last_active":"2023-12-22T08:43:08.765315+0000","last_peered":"2023-12-22T08:43:08.765315+0000","last_clean":"2023-12-22T08:43:08.765315+0000","last_became_active":"2023-12-22T08:43:08.758667+0000","last_became_peered":"2023-12-22T08:43:08.758667+0000","last_unstale":"2023-12-22T08:43:08.765315+0000","last_undegraded":"2023-12-22T08:43:08.765315+0000","last_fullsized":"2023-12-22T08:43:08.765315+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:38.767539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778760+0000","last_change":"2023-12-22T08:43:08.241565+0000","last_active":"2023-12-22T08:43:08.778760+0000","last_peered":"2023-12-22T08:43:08.778760+0000","last_clean":"2023-12-22T08:43:08.778760+0000","last_became_active":"2023-12-22T08:43:08.241298+0000","last_became_peered":"2023-12-22T08:43:08.241298+0000","last_unstale":"2023-12-22T08:43:08.778760+0000","last_undegraded":"2023-12-22T08:43:08.778760+0000","last_fullsized":"2023-12-22T08:43:08.778760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:57:12.591295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772898+0000","last_change":"2023-12-22T08:43:08.770501+0000","last_active":"2023-12-22T08:43:08.772898+0000","last_peered":"2023-12-22T08:43:08.772898+0000","last_clean":"2023-12-22T08:43:08.772898+0000","last_became_active":"2023-12-22T08:43:08.770276+0000","last_became_peered":"2023-12-22T08:43:08.770276+0000","last_unstale":"2023-12-22T08:43:08.772898+0000","last_undegraded":"2023-12-22T08:43:08.772898+0000","last_fullsized":"2023-12-22T08:43:08.772898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:37:20.548483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.777583+0000","last_change":"2023-12-22T08:43:08.245896+0000","last_active":"2023-12-22T08:43:08.777583+0000","last_peered":"2023-12-22T08:43:08.777583+0000","last_clean":"2023-12-22T08:43:08.777583+0000","last_became_active":"2023-12-22T08:43:08.245372+0000","last_became_peered":"2023-12-22T08:43:08.245372+0000","last_unstale":"2023-12-22T08:43:08.777583+0000","last_undegraded":"2023-12-22T08:43:08.777583+0000","last_fullsized":"2023-12-22T08:43:08.777583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:29.623967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780030+0000","last_change":"2023-12-22T08:43:08.779587+0000","last_active":"2023-12-22T08:43:08.780030+0000","last_peered":"2023-12-22T08:43:08.780030+0000","last_clean":"2023-12-22T08:43:08.780030+0000","last_became_active":"2023-12-22T08:43:08.779329+0000","last_became_peered":"2023-12-22T08:43:08.779329+0000","last_unstale":"2023-12-22T08:43:08.780030+0000","last_undegraded":"2023-12-22T08:43:08.780030+0000","last_fullsized":"2023-12-22T08:43:08.780030+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:34.735345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.766614+0000","last_change":"2023-12-22T08:43:08.229587+0000","last_active":"2023-12-22T08:43:08.766614+0000","last_peered":"2023-12-22T08:43:08.766614+0000","last_clean":"2023-12-22T08:43:08.766614+0000","last_became_active":"2023-12-22T08:43:08.228337+0000","last_became_peered":"2023-12-22T08:43:08.228337+0000","last_unstale":"2023-12-22T08:43:08.766614+0000","last_undegraded":"2023-12-22T08:43:08.766614+0000","last_fullsized":"2023-12-22T08:43:08.766614+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:49.938120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780723+0000","last_change":"2023-12-22T08:43:08.780604+0000","last_active":"2023-12-22T08:43:08.780723+0000","last_peered":"2023-12-22T08:43:08.780723+0000","last_clean":"2023-12-22T08:43:08.780723+0000","last_became_active":"2023-12-22T08:43:08.780385+0000","last_became_peered":"2023-12-22T08:43:08.780385+0000","last_unstale":"2023-12-22T08:43:08.780723+0000","last_undegraded":"2023-12-22T08:43:08.780723+0000","last_fullsized":"2023-12-22T08:43:08.780723+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:09:53.006039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768236+0000","last_change":"2023-12-22T08:43:08.230735+0000","last_active":"2023-12-22T08:43:08.768236+0000","last_peered":"2023-12-22T08:43:08.768236+0000","last_clean":"2023-12-22T08:43:08.768236+0000","last_became_active":"2023-12-22T08:43:08.227246+0000","last_became_peered":"2023-12-22T08:43:08.227246+0000","last_unstale":"2023-12-22T08:43:08.768236+0000","last_undegraded":"2023-12-22T08:43:08.768236+0000","last_fullsized":"2023-12-22T08:43:08.768236+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:44.904868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.781137+0000","last_change":"2023-12-22T08:43:08.781029+0000","last_active":"2023-12-22T08:43:08.781137+0000","last_peered":"2023-12-22T08:43:08.781137+0000","last_clean":"2023-12-22T08:43:08.781137+0000","last_became_active":"2023-12-22T08:43:08.780332+0000","last_became_peered":"2023-12-22T08:43:08.780332+0000","last_unstale":"2023-12-22T08:43:08.781137+0000","last_undegraded":"2023-12-22T08:43:08.781137+0000","last_fullsized":"2023-12-22T08:43:08.781137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:41.615895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774363+0000","last_change":"2023-12-22T08:43:08.247775+0000","last_active":"2023-12-22T08:43:08.774363+0000","last_peered":"2023-12-22T08:43:08.774363+0000","last_clean":"2023-12-22T08:43:08.774363+0000","last_became_active":"2023-12-22T08:43:08.247512+0000","last_became_peered":"2023-12-22T08:43:08.247512+0000","last_unstale":"2023-12-22T08:43:08.774363+0000","last_undegraded":"2023-12-22T08:43:08.774363+0000","last_fullsized":"2023-12-22T08:43:08.774363+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:46:44.813831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.759227+0000","last_change":"2023-12-22T08:43:08.759113+0000","last_active":"2023-12-22T08:43:08.759227+0000","last_peered":"2023-12-22T08:43:08.759227+0000","last_clean":"2023-12-22T08:43:08.759227+0000","last_became_active":"2023-12-22T08:43:08.758547+0000","last_became_peered":"2023-12-22T08:43:08.758547+0000","last_unstale":"2023-12-22T08:43:08.759227+0000","last_undegraded":"2023-12-22T08:43:08.759227+0000","last_fullsized":"2023-12-22T08:43:08.759227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:31:40.143949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747531+0000","last_change":"2023-12-22T08:43:08.242191+0000","last_active":"2023-12-22T08:43:08.747531+0000","last_peered":"2023-12-22T08:43:08.747531+0000","last_clean":"2023-12-22T08:43:08.747531+0000","last_became_active":"2023-12-22T08:43:08.241783+0000","last_became_peered":"2023-12-22T08:43:08.241783+0000","last_unstale":"2023-12-22T08:43:08.747531+0000","last_undegraded":"2023-12-22T08:43:08.747531+0000","last_fullsized":"2023-12-22T08:43:08.747531+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:53.956992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768715+0000","last_change":"2023-12-22T08:43:08.768597+0000","last_active":"2023-12-22T08:43:08.768715+0000","last_peered":"2023-12-22T08:43:08.768715+0000","last_clean":"2023-12-22T08:43:08.768715+0000","last_became_active":"2023-12-22T08:43:08.767435+0000","last_became_peered":"2023-12-22T08:43:08.767435+0000","last_unstale":"2023-12-22T08:43:08.768715+0000","last_undegraded":"2023-12-22T08:43:08.768715+0000","last_fullsized":"2023-12-22T08:43:08.768715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:45.919846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.757846+0000","last_change":"2023-12-22T08:43:08.240904+0000","last_active":"2023-12-22T08:43:08.757846+0000","last_peered":"2023-12-22T08:43:08.757846+0000","last_clean":"2023-12-22T08:43:08.757846+0000","last_became_active":"2023-12-22T08:43:08.240539+0000","last_became_peered":"2023-12-22T08:43:08.240539+0000","last_unstale":"2023-12-22T08:43:08.757846+0000","last_undegraded":"2023-12-22T08:43:08.757846+0000","last_fullsized":"2023-12-22T08:43:08.757846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:44.413577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760250+0000","last_change":"2023-12-22T08:43:08.759588+0000","last_active":"2023-12-22T08:43:08.760250+0000","last_peered":"2023-12-22T08:43:08.760250+0000","last_clean":"2023-12-22T08:43:08.760250+0000","last_became_active":"2023-12-22T08:43:08.759370+0000","last_became_peered":"2023-12-22T08:43:08.759370+0000","last_unstale":"2023-12-22T08:43:08.760250+0000","last_undegraded":"2023-12-22T08:43:08.760250+0000","last_fullsized":"2023-12-22T08:43:08.760250+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:28:32.888896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747148+0000","last_change":"2023-12-22T08:43:08.242221+0000","last_active":"2023-12-22T08:43:08.747148+0000","last_peered":"2023-12-22T08:43:08.747148+0000","last_clean":"2023-12-22T08:43:08.747148+0000","last_became_active":"2023-12-22T08:43:08.241895+0000","last_became_peered":"2023-12-22T08:43:08.241895+0000","last_unstale":"2023-12-22T08:43:08.747148+0000","last_undegraded":"2023-12-22T08:43:08.747148+0000","last_fullsized":"2023-12-22T08:43:08.747148+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:36:26.961063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768352+0000","last_change":"2023-12-22T08:43:08.767781+0000","last_active":"2023-12-22T08:43:08.768352+0000","last_peered":"2023-12-22T08:43:08.768352+0000","last_clean":"2023-12-22T08:43:08.768352+0000","last_became_active":"2023-12-22T08:43:08.767545+0000","last_became_peered":"2023-12-22T08:43:08.767545+0000","last_unstale":"2023-12-22T08:43:08.768352+0000","last_undegraded":"2023-12-22T08:43:08.768352+0000","last_fullsized":"2023-12-22T08:43:08.768352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:09.970458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765721+0000","last_change":"2023-12-22T08:43:08.239881+0000","last_active":"2023-12-22T08:43:08.765721+0000","last_peered":"2023-12-22T08:43:08.765721+0000","last_clean":"2023-12-22T08:43:08.765721+0000","last_became_active":"2023-12-22T08:43:08.238285+0000","last_became_peered":"2023-12-22T08:43:08.238285+0000","last_unstale":"2023-12-22T08:43:08.765721+0000","last_undegraded":"2023-12-22T08:43:08.765721+0000","last_fullsized":"2023-12-22T08:43:08.765721+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:33.720367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775166+0000","last_change":"2023-12-22T08:43:08.773721+0000","last_active":"2023-12-22T08:43:08.775166+0000","last_peered":"2023-12-22T08:43:08.775166+0000","last_clean":"2023-12-22T08:43:08.775166+0000","last_became_active":"2023-12-22T08:43:08.773417+0000","last_became_peered":"2023-12-22T08:43:08.773417+0000","last_unstale":"2023-12-22T08:43:08.775166+0000","last_undegraded":"2023-12-22T08:43:08.775166+0000","last_fullsized":"2023-12-22T08:43:08.775166+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:17.697248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"71'3","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772252+0000","last_change":"2023-12-22T08:43:08.234204+0000","last_active":"2023-12-22T08:43:08.772252+0000","last_peered":"2023-12-22T08:43:08.772252+0000","last_clean":"2023-12-22T08:43:08.772252+0000","last_became_active":"2023-12-22T08:43:08.228159+0000","last_became_peered":"2023-12-22T08:43:08.228159+0000","last_unstale":"2023-12-22T08:43:08.772252+0000","last_undegraded":"2023-12-22T08:43:08.772252+0000","last_fullsized":"2023-12-22T08:43:08.772252+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:18.349374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775948+0000","last_change":"2023-12-22T08:43:08.775186+0000","last_active":"2023-12-22T08:43:08.775948+0000","last_peered":"2023-12-22T08:43:08.775948+0000","last_clean":"2023-12-22T08:43:08.775948+0000","last_became_active":"2023-12-22T08:43:08.774876+0000","last_became_peered":"2023-12-22T08:43:08.774876+0000","last_unstale":"2023-12-22T08:43:08.775948+0000","last_undegraded":"2023-12-22T08:43:08.775948+0000","last_fullsized":"2023-12-22T08:43:08.775948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:58.667030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"71'6","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772747+0000","last_change":"2023-12-22T08:43:08.237347+0000","last_active":"2023-12-22T08:43:08.772747+0000","last_peered":"2023-12-22T08:43:08.772747+0000","last_clean":"2023-12-22T08:43:08.772747+0000","last_became_active":"2023-12-22T08:43:08.235741+0000","last_became_peered":"2023-12-22T08:43:08.235741+0000","last_unstale":"2023-12-22T08:43:08.772747+0000","last_undegraded":"2023-12-22T08:43:08.772747+0000","last_fullsized":"2023-12-22T08:43:08.772747+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:27.955616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775999+0000","last_change":"2023-12-22T08:43:08.775807+0000","last_active":"2023-12-22T08:43:08.775999+0000","last_peered":"2023-12-22T08:43:08.775999+0000","last_clean":"2023-12-22T08:43:08.775999+0000","last_became_active":"2023-12-22T08:43:08.775655+0000","last_became_peered":"2023-12-22T08:43:08.775655+0000","last_unstale":"2023-12-22T08:43:08.775999+0000","last_undegraded":"2023-12-22T08:43:08.775999+0000","last_fullsized":"2023-12-22T08:43:08.775999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:07:12.868602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.781210+0000","last_change":"2023-12-22T08:43:08.243194+0000","last_active":"2023-12-22T08:43:08.781210+0000","last_peered":"2023-12-22T08:43:08.781210+0000","last_clean":"2023-12-22T08:43:08.781210+0000","last_became_active":"2023-12-22T08:43:08.242449+0000","last_became_peered":"2023-12-22T08:43:08.242449+0000","last_unstale":"2023-12-22T08:43:08.781210+0000","last_undegraded":"2023-12-22T08:43:08.781210+0000","last_fullsized":"2023-12-22T08:43:08.781210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:14.817249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760965+0000","last_change":"2023-12-22T08:43:08.760898+0000","last_active":"2023-12-22T08:43:08.760965+0000","last_peered":"2023-12-22T08:43:08.760965+0000","last_clean":"2023-12-22T08:43:08.760965+0000","last_became_active":"2023-12-22T08:43:08.760680+0000","last_became_peered":"2023-12-22T08:43:08.760680+0000","last_unstale":"2023-12-22T08:43:08.760965+0000","last_undegraded":"2023-12-22T08:43:08.760965+0000","last_fullsized":"2023-12-22T08:43:08.760965+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:07:27.247486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.745591+0000","last_change":"2023-12-22T08:43:08.238556+0000","last_active":"2023-12-22T08:43:08.745591+0000","last_peered":"2023-12-22T08:43:08.745591+0000","last_clean":"2023-12-22T08:43:08.745591+0000","last_became_active":"2023-12-22T08:43:08.238261+0000","last_became_peered":"2023-12-22T08:43:08.238261+0000","last_unstale":"2023-12-22T08:43:08.745591+0000","last_undegraded":"2023-12-22T08:43:08.745591+0000","last_fullsized":"2023-12-22T08:43:08.745591+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:22.638334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760326+0000","last_change":"2023-12-22T08:43:08.759063+0000","last_active":"2023-12-22T08:43:08.760326+0000","last_peered":"2023-12-22T08:43:08.760326+0000","last_clean":"2023-12-22T08:43:08.760326+0000","last_became_active":"2023-12-22T08:43:08.758683+0000","last_became_peered":"2023-12-22T08:43:08.758683+0000","last_unstale":"2023-12-22T08:43:08.760326+0000","last_undegraded":"2023-12-22T08:43:08.760326+0000","last_fullsized":"2023-12-22T08:43:08.760326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:32:13.036482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.746130+0000","last_change":"2023-12-22T08:43:08.239352+0000","last_active":"2023-12-22T08:43:08.746130+0000","last_peered":"2023-12-22T08:43:08.746130+0000","last_clean":"2023-12-22T08:43:08.746130+0000","last_became_active":"2023-12-22T08:43:08.238848+0000","last_became_peered":"2023-12-22T08:43:08.238848+0000","last_unstale":"2023-12-22T08:43:08.746130+0000","last_undegraded":"2023-12-22T08:43:08.746130+0000","last_fullsized":"2023-12-22T08:43:08.746130+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:12.707233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778947+0000","last_change":"2023-12-22T08:43:08.778851+0000","last_active":"2023-12-22T08:43:08.778947+0000","last_peered":"2023-12-22T08:43:08.778947+0000","last_clean":"2023-12-22T08:43:08.778947+0000","last_became_active":"2023-12-22T08:43:08.778568+0000","last_became_peered":"2023-12-22T08:43:08.778568+0000","last_unstale":"2023-12-22T08:43:08.778947+0000","last_undegraded":"2023-12-22T08:43:08.778947+0000","last_fullsized":"2023-12-22T08:43:08.778947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:32:32.129373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"71'8","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772847+0000","last_change":"2023-12-22T08:43:08.233994+0000","last_active":"2023-12-22T08:43:08.772847+0000","last_peered":"2023-12-22T08:43:08.772847+0000","last_clean":"2023-12-22T08:43:08.772847+0000","last_became_active":"2023-12-22T08:43:08.227292+0000","last_became_peered":"2023-12-22T08:43:08.227292+0000","last_unstale":"2023-12-22T08:43:08.772847+0000","last_undegraded":"2023-12-22T08:43:08.772847+0000","last_fullsized":"2023-12-22T08:43:08.772847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:18:18.840612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.759409+0000","last_change":"2023-12-22T08:43:08.759314+0000","last_active":"2023-12-22T08:43:08.759409+0000","last_peered":"2023-12-22T08:43:08.759409+0000","last_clean":"2023-12-22T08:43:08.759409+0000","last_became_active":"2023-12-22T08:43:08.758870+0000","last_became_peered":"2023-12-22T08:43:08.758870+0000","last_unstale":"2023-12-22T08:43:08.759409+0000","last_undegraded":"2023-12-22T08:43:08.759409+0000","last_fullsized":"2023-12-22T08:43:08.759409+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:15.832226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778189+0000","last_change":"2023-12-22T08:43:08.245684+0000","last_active":"2023-12-22T08:43:08.778189+0000","last_peered":"2023-12-22T08:43:08.778189+0000","last_clean":"2023-12-22T08:43:08.778189+0000","last_became_active":"2023-12-22T08:43:08.245434+0000","last_became_peered":"2023-12-22T08:43:08.245434+0000","last_unstale":"2023-12-22T08:43:08.778189+0000","last_undegraded":"2023-12-22T08:43:08.778189+0000","last_fullsized":"2023-12-22T08:43:08.778189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:29.623967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775773+0000","last_change":"2023-12-22T08:43:08.775570+0000","last_active":"2023-12-22T08:43:08.775773+0000","last_peered":"2023-12-22T08:43:08.775773+0000","last_clean":"2023-12-22T08:43:08.775773+0000","last_became_active":"2023-12-22T08:43:08.775017+0000","last_became_peered":"2023-12-22T08:43:08.775017+0000","last_unstale":"2023-12-22T08:43:08.775773+0000","last_undegraded":"2023-12-22T08:43:08.775773+0000","last_fullsized":"2023-12-22T08:43:08.775773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:41.615895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.779090+0000","last_change":"2023-12-22T08:43:08.243395+0000","last_active":"2023-12-22T08:43:08.779090+0000","last_peered":"2023-12-22T08:43:08.779090+0000","last_clean":"2023-12-22T08:43:08.779090+0000","last_became_active":"2023-12-22T08:43:08.242880+0000","last_became_peered":"2023-12-22T08:43:08.242880+0000","last_unstale":"2023-12-22T08:43:08.779090+0000","last_undegraded":"2023-12-22T08:43:08.779090+0000","last_fullsized":"2023-12-22T08:43:08.779090+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:26.160091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780266+0000","last_change":"2023-12-22T08:43:08.779922+0000","last_active":"2023-12-22T08:43:08.780266+0000","last_peered":"2023-12-22T08:43:08.780266+0000","last_clean":"2023-12-22T08:43:08.780266+0000","last_became_active":"2023-12-22T08:43:08.779234+0000","last_became_peered":"2023-12-22T08:43:08.779234+0000","last_unstale":"2023-12-22T08:43:08.780266+0000","last_undegraded":"2023-12-22T08:43:08.780266+0000","last_fullsized":"2023-12-22T08:43:08.780266+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:45.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772747+0000","last_change":"2023-12-22T08:43:08.241351+0000","last_active":"2023-12-22T08:43:08.772747+0000","last_peered":"2023-12-22T08:43:08.772747+0000","last_clean":"2023-12-22T08:43:08.772747+0000","last_became_active":"2023-12-22T08:43:08.236119+0000","last_became_peered":"2023-12-22T08:43:08.236119+0000","last_unstale":"2023-12-22T08:43:08.772747+0000","last_undegraded":"2023-12-22T08:43:08.772747+0000","last_fullsized":"2023-12-22T08:43:08.772747+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:24:11.471670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.762969+0000","last_change":"2023-12-22T08:43:08.762279+0000","last_active":"2023-12-22T08:43:08.762969+0000","last_peered":"2023-12-22T08:43:08.762969+0000","last_clean":"2023-12-22T08:43:08.762969+0000","last_became_active":"2023-12-22T08:43:08.760935+0000","last_became_peered":"2023-12-22T08:43:08.760935+0000","last_unstale":"2023-12-22T08:43:08.762969+0000","last_undegraded":"2023-12-22T08:43:08.762969+0000","last_fullsized":"2023-12-22T08:43:08.762969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:23.591214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765888+0000","last_change":"2023-12-22T08:43:08.246777+0000","last_active":"2023-12-22T08:43:08.765888+0000","last_peered":"2023-12-22T08:43:08.765888+0000","last_clean":"2023-12-22T08:43:08.765888+0000","last_became_active":"2023-12-22T08:43:08.246524+0000","last_became_peered":"2023-12-22T08:43:08.246524+0000","last_unstale":"2023-12-22T08:43:08.765888+0000","last_undegraded":"2023-12-22T08:43:08.765888+0000","last_fullsized":"2023-12-22T08:43:08.765888+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:52.805378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774730+0000","last_change":"2023-12-22T08:43:08.774162+0000","last_active":"2023-12-22T08:43:08.774730+0000","last_peered":"2023-12-22T08:43:08.774730+0000","last_clean":"2023-12-22T08:43:08.774730+0000","last_became_active":"2023-12-22T08:43:08.771427+0000","last_became_peered":"2023-12-22T08:43:08.771427+0000","last_unstale":"2023-12-22T08:43:08.774730+0000","last_undegraded":"2023-12-22T08:43:08.774730+0000","last_fullsized":"2023-12-22T08:43:08.774730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:53.721528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778158+0000","last_change":"2023-12-22T08:43:08.240892+0000","last_active":"2023-12-22T08:43:08.778158+0000","last_peered":"2023-12-22T08:43:08.778158+0000","last_clean":"2023-12-22T08:43:08.778158+0000","last_became_active":"2023-12-22T08:43:08.240027+0000","last_became_peered":"2023-12-22T08:43:08.240027+0000","last_unstale":"2023-12-22T08:43:08.778158+0000","last_undegraded":"2023-12-22T08:43:08.778158+0000","last_fullsized":"2023-12-22T08:43:08.778158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:14.817249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.776656+0000","last_change":"2023-12-22T08:43:08.776331+0000","last_active":"2023-12-22T08:43:08.776656+0000","last_peered":"2023-12-22T08:43:08.776656+0000","last_clean":"2023-12-22T08:43:08.776656+0000","last_became_active":"2023-12-22T08:43:08.771399+0000","last_became_peered":"2023-12-22T08:43:08.771399+0000","last_unstale":"2023-12-22T08:43:08.776656+0000","last_undegraded":"2023-12-22T08:43:08.776656+0000","last_fullsized":"2023-12-22T08:43:08.776656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:02:50.159719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.767667+0000","last_change":"2023-12-22T08:43:08.242318+0000","last_active":"2023-12-22T08:43:08.767667+0000","last_peered":"2023-12-22T08:43:08.767667+0000","last_clean":"2023-12-22T08:43:08.767667+0000","last_became_active":"2023-12-22T08:43:08.240707+0000","last_became_peered":"2023-12-22T08:43:08.240707+0000","last_unstale":"2023-12-22T08:43:08.767667+0000","last_undegraded":"2023-12-22T08:43:08.767667+0000","last_fullsized":"2023-12-22T08:43:08.767667+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:37.796898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772917+0000","last_change":"2023-12-22T08:43:08.770953+0000","last_active":"2023-12-22T08:43:08.772917+0000","last_peered":"2023-12-22T08:43:08.772917+0000","last_clean":"2023-12-22T08:43:08.772917+0000","last_became_active":"2023-12-22T08:43:08.770635+0000","last_became_peered":"2023-12-22T08:43:08.770635+0000","last_unstale":"2023-12-22T08:43:08.772917+0000","last_undegraded":"2023-12-22T08:43:08.772917+0000","last_fullsized":"2023-12-22T08:43:08.772917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:23.653311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747239+0000","last_change":"2023-12-22T08:43:08.245828+0000","last_active":"2023-12-22T08:43:08.747239+0000","last_peered":"2023-12-22T08:43:08.747239+0000","last_clean":"2023-12-22T08:43:08.747239+0000","last_became_active":"2023-12-22T08:43:08.245624+0000","last_became_peered":"2023-12-22T08:43:08.245624+0000","last_unstale":"2023-12-22T08:43:08.747239+0000","last_undegraded":"2023-12-22T08:43:08.747239+0000","last_fullsized":"2023-12-22T08:43:08.747239+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:02:00.232260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.773984+0000","last_change":"2023-12-22T08:43:08.773913+0000","last_active":"2023-12-22T08:43:08.773984+0000","last_peered":"2023-12-22T08:43:08.773984+0000","last_clean":"2023-12-22T08:43:08.773984+0000","last_became_active":"2023-12-22T08:43:08.773342+0000","last_became_peered":"2023-12-22T08:43:08.773342+0000","last_unstale":"2023-12-22T08:43:08.773984+0000","last_undegraded":"2023-12-22T08:43:08.773984+0000","last_fullsized":"2023-12-22T08:43:08.773984+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:03:49.616345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.781950+0000","last_change":"2023-12-22T08:43:08.243237+0000","last_active":"2023-12-22T08:43:08.781950+0000","last_peered":"2023-12-22T08:43:08.781950+0000","last_clean":"2023-12-22T08:43:08.781950+0000","last_became_active":"2023-12-22T08:43:08.242927+0000","last_became_peered":"2023-12-22T08:43:08.242927+0000","last_unstale":"2023-12-22T08:43:08.781950+0000","last_undegraded":"2023-12-22T08:43:08.781950+0000","last_fullsized":"2023-12-22T08:43:08.781950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:13:29.194561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.759826+0000","last_change":"2023-12-22T08:43:08.759746+0000","last_active":"2023-12-22T08:43:08.759826+0000","last_peered":"2023-12-22T08:43:08.759826+0000","last_clean":"2023-12-22T08:43:08.759826+0000","last_became_active":"2023-12-22T08:43:08.759482+0000","last_became_peered":"2023-12-22T08:43:08.759482+0000","last_unstale":"2023-12-22T08:43:08.759826+0000","last_undegraded":"2023-12-22T08:43:08.759826+0000","last_fullsized":"2023-12-22T08:43:08.759826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:27.175068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.749602+0000","last_change":"2023-12-22T08:43:08.245846+0000","last_active":"2023-12-22T08:43:08.749602+0000","last_peered":"2023-12-22T08:43:08.749602+0000","last_clean":"2023-12-22T08:43:08.749602+0000","last_became_active":"2023-12-22T08:43:08.245404+0000","last_became_peered":"2023-12-22T08:43:08.245404+0000","last_unstale":"2023-12-22T08:43:08.749602+0000","last_undegraded":"2023-12-22T08:43:08.749602+0000","last_fullsized":"2023-12-22T08:43:08.749602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:27:48.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.777551+0000","last_change":"2023-12-22T08:43:08.777481+0000","last_active":"2023-12-22T08:43:08.777551+0000","last_peered":"2023-12-22T08:43:08.777551+0000","last_clean":"2023-12-22T08:43:08.777551+0000","last_became_active":"2023-12-22T08:43:08.777206+0000","last_became_peered":"2023-12-22T08:43:08.777206+0000","last_unstale":"2023-12-22T08:43:08.777551+0000","last_undegraded":"2023-12-22T08:43:08.777551+0000","last_fullsized":"2023-12-22T08:43:08.777551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:32.067700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747622+0000","last_change":"2023-12-22T08:43:08.238015+0000","last_active":"2023-12-22T08:43:08.747622+0000","last_peered":"2023-12-22T08:43:08.747622+0000","last_clean":"2023-12-22T08:43:08.747622+0000","last_became_active":"2023-12-22T08:43:08.237691+0000","last_became_peered":"2023-12-22T08:43:08.237691+0000","last_unstale":"2023-12-22T08:43:08.747622+0000","last_undegraded":"2023-12-22T08:43:08.747622+0000","last_fullsized":"2023-12-22T08:43:08.747622+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:13:35.064619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.769045+0000","last_change":"2023-12-22T08:43:08.768873+0000","last_active":"2023-12-22T08:43:08.769045+0000","last_peered":"2023-12-22T08:43:08.769045+0000","last_clean":"2023-12-22T08:43:08.769045+0000","last_became_active":"2023-12-22T08:43:08.768418+0000","last_became_peered":"2023-12-22T08:43:08.768418+0000","last_unstale":"2023-12-22T08:43:08.769045+0000","last_undegraded":"2023-12-22T08:43:08.769045+0000","last_fullsized":"2023-12-22T08:43:08.769045+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:50.953097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.754103+0000","last_change":"2023-12-22T08:43:08.228782+0000","last_active":"2023-12-22T08:43:08.754103+0000","last_peered":"2023-12-22T08:43:08.754103+0000","last_clean":"2023-12-22T08:43:08.754103+0000","last_became_active":"2023-12-22T08:43:08.228538+0000","last_became_peered":"2023-12-22T08:43:08.228538+0000","last_unstale":"2023-12-22T08:43:08.754103+0000","last_undegraded":"2023-12-22T08:43:08.754103+0000","last_fullsized":"2023-12-22T08:43:08.754103+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:44.413577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765472+0000","last_change":"2023-12-22T08:43:08.765243+0000","last_active":"2023-12-22T08:43:08.765472+0000","last_peered":"2023-12-22T08:43:08.765472+0000","last_clean":"2023-12-22T08:43:08.765472+0000","last_became_active":"2023-12-22T08:43:08.764495+0000","last_became_peered":"2023-12-22T08:43:08.764495+0000","last_unstale":"2023-12-22T08:43:08.765472+0000","last_undegraded":"2023-12-22T08:43:08.765472+0000","last_fullsized":"2023-12-22T08:43:08.765472+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:52.037553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774052+0000","last_change":"2023-12-22T08:43:08.246580+0000","last_active":"2023-12-22T08:43:08.774052+0000","last_peered":"2023-12-22T08:43:08.774052+0000","last_clean":"2023-12-22T08:43:08.774052+0000","last_became_active":"2023-12-22T08:43:08.246138+0000","last_became_peered":"2023-12-22T08:43:08.246138+0000","last_unstale":"2023-12-22T08:43:08.774052+0000","last_undegraded":"2023-12-22T08:43:08.774052+0000","last_fullsized":"2023-12-22T08:43:08.774052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:54:55.545904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.769795+0000","last_change":"2023-12-22T08:43:08.769599+0000","last_active":"2023-12-22T08:43:08.769795+0000","last_peered":"2023-12-22T08:43:08.769795+0000","last_clean":"2023-12-22T08:43:08.769795+0000","last_became_active":"2023-12-22T08:43:08.769363+0000","last_became_peered":"2023-12-22T08:43:08.769363+0000","last_unstale":"2023-12-22T08:43:08.769795+0000","last_undegraded":"2023-12-22T08:43:08.769795+0000","last_fullsized":"2023-12-22T08:43:08.769795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:19.778557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.757872+0000","last_change":"2023-12-22T08:43:08.235236+0000","last_active":"2023-12-22T08:43:08.757872+0000","last_peered":"2023-12-22T08:43:08.757872+0000","last_clean":"2023-12-22T08:43:08.757872+0000","last_became_active":"2023-12-22T08:43:08.234988+0000","last_became_peered":"2023-12-22T08:43:08.234988+0000","last_unstale":"2023-12-22T08:43:08.757872+0000","last_undegraded":"2023-12-22T08:43:08.757872+0000","last_fullsized":"2023-12-22T08:43:08.757872+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:04.865483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.769027+0000","last_change":"2023-12-22T08:43:08.768678+0000","last_active":"2023-12-22T08:43:08.769027+0000","last_peered":"2023-12-22T08:43:08.769027+0000","last_clean":"2023-12-22T08:43:08.769027+0000","last_became_active":"2023-12-22T08:43:08.768174+0000","last_became_peered":"2023-12-22T08:43:08.768174+0000","last_unstale":"2023-12-22T08:43:08.769027+0000","last_undegraded":"2023-12-22T08:43:08.769027+0000","last_fullsized":"2023-12-22T08:43:08.769027+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:10:28.675275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.751188+0000","last_change":"2023-12-22T08:43:08.245686+0000","last_active":"2023-12-22T08:43:08.751188+0000","last_peered":"2023-12-22T08:43:08.751188+0000","last_clean":"2023-12-22T08:43:08.751188+0000","last_became_active":"2023-12-22T08:43:08.245056+0000","last_became_peered":"2023-12-22T08:43:08.245056+0000","last_unstale":"2023-12-22T08:43:08.751188+0000","last_undegraded":"2023-12-22T08:43:08.751188+0000","last_fullsized":"2023-12-22T08:43:08.751188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:52:56.482108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.782588+0000","last_change":"2023-12-22T08:43:08.782519+0000","last_active":"2023-12-22T08:43:08.782588+0000","last_peered":"2023-12-22T08:43:08.782588+0000","last_clean":"2023-12-22T08:43:08.782588+0000","last_became_active":"2023-12-22T08:43:08.782288+0000","last_became_peered":"2023-12-22T08:43:08.782288+0000","last_unstale":"2023-12-22T08:43:08.782588+0000","last_undegraded":"2023-12-22T08:43:08.782588+0000","last_fullsized":"2023-12-22T08:43:08.782588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:05.880460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.767765+0000","last_change":"2023-12-22T08:43:08.242877+0000","last_active":"2023-12-22T08:43:08.767765+0000","last_peered":"2023-12-22T08:43:08.767765+0000","last_clean":"2023-12-22T08:43:08.767765+0000","last_became_active":"2023-12-22T08:43:08.241588+0000","last_became_peered":"2023-12-22T08:43:08.241588+0000","last_unstale":"2023-12-22T08:43:08.767765+0000","last_undegraded":"2023-12-22T08:43:08.767765+0000","last_fullsized":"2023-12-22T08:43:08.767765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:18.763580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.777718+0000","last_change":"2023-12-22T08:43:08.776165+0000","last_active":"2023-12-22T08:43:08.777718+0000","last_peered":"2023-12-22T08:43:08.777718+0000","last_clean":"2023-12-22T08:43:08.777718+0000","last_became_active":"2023-12-22T08:43:08.775908+0000","last_became_peered":"2023-12-22T08:43:08.775908+0000","last_unstale":"2023-12-22T08:43:08.777718+0000","last_undegraded":"2023-12-22T08:43:08.777718+0000","last_fullsized":"2023-12-22T08:43:08.777718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:28.745926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.757931+0000","last_change":"2023-12-22T08:43:08.236569+0000","last_active":"2023-12-22T08:43:08.757931+0000","last_peered":"2023-12-22T08:43:08.757931+0000","last_clean":"2023-12-22T08:43:08.757931+0000","last_became_active":"2023-12-22T08:43:08.236102+0000","last_became_peered":"2023-12-22T08:43:08.236102+0000","last_unstale":"2023-12-22T08:43:08.757931+0000","last_undegraded":"2023-12-22T08:43:08.757931+0000","last_fullsized":"2023-12-22T08:43:08.757931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:31.052723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":209,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747702+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:43:08.747702+0000","last_peered":"2023-12-22T08:43:08.747702+0000","last_clean":"2023-12-22T08:43:08.747702+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:43:08.747702+0000","last_undegraded":"2023-12-22T08:43:08.747702+0000","last_fullsized":"2023-12-22T08:43:08.747702+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194946,"statfs":{"total":200000000,"available":199625170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0780000000000001,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.075,"15min":1.0589999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.85899999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.173,"15min":1.1579999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.2},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.1619999999999999,"15min":1.1319999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.173}]},{"osd":2,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.0860000000000001,"15min":1.056},"min":{"1min":0.78600000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.226,"5min":1.2310000000000001,"15min":1.23},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.742,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.82399999999999995}]},{"osd":3,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1240000000000001,"15min":1.0900000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.292,"15min":1.2769999999999999},"min":{"1min":0.80500000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.952,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1899999999999999,"15min":1.194},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.764,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.266,"5min":1.268,"15min":1.2629999999999999},"min":{"1min":0.64100000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.137}]},{"osd":5,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.371,"15min":1.367},"min":{"1min":0.74299999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.8120000000000001,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.099},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3660000000000001,"15min":1.3700000000000001},"min":{"1min":0.76300000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.645,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.2729999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4870000000000001,"15min":1.4850000000000001},"min":{"1min":0.83499999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.1259999999999999,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.383},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4870000000000001,"15min":1.484},"min":{"1min":0.82299999999999995,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.55}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":365,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194946,"statfs":{"total":200000000,"available":199625240,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1140000000000001,"15min":1.1299999999999999},"min":{"1min":0.80500000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9350000000000001,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.0820000000000001,"15min":1.081},"min":{"1min":0.77500000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.4450000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0389999999999999,"15min":1.0189999999999999},"min":{"1min":0.79000000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.448,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.747},{"interface":"front","average":{"1min":1.349,"5min":1.1919999999999999,"15min":1.171},"min":{"1min":1.0129999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.1200000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2529999999999999,"15min":1.272},"min":{"1min":0.82799999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7969999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.268,"5min":1.1739999999999999,"15min":1.147},"min":{"1min":0.81599999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.3220000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.3160000000000001,"15min":1.298},"min":{"1min":0.94099999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.738,"5min":1.847,"15min":1.847},"last":1.208},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.248,"15min":1.2330000000000001},"min":{"1min":0.96799999999999997,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.645,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.1539999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.403,"15min":1.411},"min":{"1min":1.0169999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.9139999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.417,"15min":1.4079999999999999},"min":{"1min":1.21,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.5429999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.361,"15min":1.3640000000000001},"min":{"1min":0.92100000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.5740000000000001,"15min":1.599},"min":{"1min":1.0960000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.1030000000000002,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.3660000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.5900000000000001,"15min":1.5940000000000001},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":1.9790000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.538,"5min":1.5449999999999999,"15min":1.5589999999999999},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":1.964,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.4059999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":941,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194370,"statfs":{"total":200000000,"available":199035879,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.0740000000000001,"15min":1.075},"min":{"1min":0.72999999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.637,"5min":1.944,"15min":1.944},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.123,"15min":1.135},"min":{"1min":0.68899999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.514,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.02}]},{"osd":1,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.093,"15min":1.1080000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.409,"5min":2.79,"15min":2.79},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.121,"5min":1.0289999999999999,"15min":1.012},"min":{"1min":0.78200000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.4590000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.119,"15min":1.1220000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.456,"5min":1.72,"15min":1.72},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.22,"5min":1.163,"15min":1.159},"min":{"1min":0.78200000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5489999999999999,"5min":1.978,"15min":1.978},"last":0.96399999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1619999999999999,"15min":1.1559999999999999},"min":{"1min":0.83399999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.506,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.226,"15min":1.2310000000000001},"min":{"1min":1.0329999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5800000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1399999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.24,"15min":1.246},"min":{"1min":0.95499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7070000000000001,"5min":1.853,"15min":1.853},"last":1.05},{"interface":"front","average":{"1min":1.159,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.3740000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3069999999999999,"15min":1.3089999999999999},"min":{"1min":0.88100000000000001,"5min":0.749,"15min":0.749},"max":{"1min":1.581,"5min":1.821,"15min":1.821},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.4199999999999999,"15min":1.4259999999999999},"min":{"1min":0.89900000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.7529999999999999,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3580000000000001,"15min":1.3620000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6359999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.411,"5min":1.5409999999999999,"15min":1.575},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.788,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":1.23}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194945,"statfs":{"total":200000000,"available":199624646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.99299999999999999,"15min":1.002},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5309999999999999,"5min":1.552,"15min":1.552},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.097,"15min":1.091},"min":{"1min":0.72499999999999998,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6100000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.042,"15min":1.0289999999999999},"min":{"1min":0.72399999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6279999999999999,"5min":1.669,"15min":1.669},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0900000000000001,"15min":1.1020000000000001},"min":{"1min":0.70499999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.794,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.069}]},{"osd":2,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1379999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5009999999999999,"5min":1.625,"15min":1.625},"last":1.234},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1850000000000001,"15min":1.1890000000000001},"min":{"1min":0.92200000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.5640000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.86199999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2090000000000001,"15min":1.1950000000000001},"min":{"1min":0.93700000000000006,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5049999999999999,"5min":1.774,"15min":1.774},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.222,"15min":1.194},"min":{"1min":1.012,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.1870000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1579999999999999,"15min":1.1299999999999999},"min":{"1min":1.016,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.3819999999999999,"15min":1.3700000000000001},"min":{"1min":1.0800000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7050000000000001,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.425}]},{"osd":6,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.248,"15min":1.226},"min":{"1min":1.0469999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.621,"5min":1.798,"15min":1.798},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.2130000000000001,"15min":1.181},"min":{"1min":1.0049999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.365}]},{"osd":7,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.367,"15min":1.323},"min":{"1min":0.97799999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.8879999999999999,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.4259999999999999,"15min":1.4019999999999999},"min":{"1min":1.2470000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.9199999999999999,"5min":1.923,"15min":1.923},"last":1.77}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194946,"statfs":{"total":200000000,"available":199625172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.93899999999999995,"15min":0.96799999999999997},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90900000000000003,"15min":0.92900000000000005},"min":{"1min":0.5,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.1519999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.85299999999999998,"15min":0.85699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.754},{"interface":"front","average":{"1min":1.214,"5min":1.1020000000000001,"15min":1.1080000000000001},"min":{"1min":0.63100000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.79400000000000004}]},{"osd":2,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.024,"15min":1.032},"min":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.591,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.137,"15min":1.125},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.397}]},{"osd":4,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.202,"15min":1.198},"min":{"1min":0.89900000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":2.048},{"interface":"front","average":{"1min":1.373,"5min":1.2350000000000001,"15min":1.222},"min":{"1min":0.77300000000000002,"5min":0.745,"15min":0.745},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":2.242}]},{"osd":5,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.2769999999999999,"15min":1.262},"min":{"1min":0.84599999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.9510000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.413,"15min":1.4430000000000001},"min":{"1min":0.96999999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.5549999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.4330000000000001,"15min":1.4419999999999999},"min":{"1min":0.93000000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.804},{"interface":"front","average":{"1min":1.454,"5min":1.3779999999999999,"15min":1.3859999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.6519999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.361,"15min":1.365},"min":{"1min":0.85599999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":2.302},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.393,"15min":1.387},"min":{"1min":0.97399999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.4490000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":367,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194944,"statfs":{"total":200000000,"available":199623538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":0.83699999999999997,"15min":0.74099999999999999},"min":{"1min":0.56299999999999994,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.8879999999999999,"5min":6.8879999999999999,"15min":6.8879999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.246,"5min":0.97799999999999998,"15min":0.95099999999999996},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":4.5510000000000002,"5min":4.5510000000000002,"15min":4.5510000000000002},"last":1.125}]},{"osd":1,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.042,"15min":0.94499999999999995},"min":{"1min":0.59699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":11.308999999999999,"5min":11.308999999999999,"15min":11.308999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.149,"5min":0.95199999999999996,"15min":0.90600000000000003},"min":{"1min":0.70099999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.94099999999999995}]},{"osd":3,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.163,"15min":1.0229999999999999},"min":{"1min":0.55400000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":13.087999999999999,"5min":13.087999999999999,"15min":13.087999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.232,"15min":1.0740000000000001},"min":{"1min":0.79200000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":12.289999999999999,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.2390000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.2749999999999999,"15min":1.22},"min":{"1min":1.048,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":1.341},{"interface":"front","average":{"1min":2.1030000000000002,"5min":1.464,"15min":1.377},"min":{"1min":0.76500000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":13.927,"5min":13.927,"15min":13.927},"last":1.0409999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.9199999999999999,"5min":1.4530000000000001,"15min":1.393},"min":{"1min":0.72399999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":11.003,"5min":11.003,"15min":11.003},"last":1.381},{"interface":"front","average":{"1min":2.0960000000000001,"5min":1.389,"15min":1.2629999999999999},"min":{"1min":0.90800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":13.129,"5min":13.129,"15min":13.129},"last":1.518}]},{"osd":6,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.3480000000000001,"15min":1.256},"min":{"1min":0.77200000000000002,"5min":0.751,"15min":0.751},"max":{"1min":8.1609999999999996,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.4199999999999999,"15min":1.3500000000000001},"min":{"1min":0.873,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":6.8150000000000004,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":1.4470000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":2.0179999999999998,"5min":1.4870000000000001,"15min":1.393},"min":{"1min":0.85499999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":10.948,"5min":10.948,"15min":10.948},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.8799999999999999,"5min":1.4219999999999999,"15min":1.3300000000000001},"min":{"1min":1.0820000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":8.0980000000000008,"5min":8.0980000000000008,"15min":8.0980000000000008},"last":1.6160000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":943,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194369,"statfs":{"total":200000000,"available":199034312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.88700000000000001,"15min":0.89500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.339,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.01,"15min":1.0049999999999999},"min":{"1min":0.625,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.399,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.363}]},{"osd":2,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.284,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.93999999999999995,"15min":0.93899999999999995},"min":{"1min":0.60599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.417,"5min":2.254,"15min":2.254},"last":1.0669999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.155,"15min":1.1519999999999999},"min":{"1min":0.68799999999999994,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.673,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93500000000000005,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.85999999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.244,"15min":1.264},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.8049999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.329,"15min":1.3109999999999999},"min":{"1min":0.876,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.962,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.5409999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.93300000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":1.181},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.3560000000000001,"15min":1.3300000000000001},"min":{"1min":0.88200000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.5129999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2430000000000001,"15min":1.2410000000000001},"min":{"1min":0.81100000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.347,"15min":1.353},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.9730000000000001,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.6160000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.367,"15min":1.343},"min":{"1min":1.0269999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0369999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.647},{"interface":"front","average":{"1min":1.393,"5min":1.367,"15min":1.395},"min":{"1min":0.86599999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.3079999999999998,"5min":3.2959999999999998,"15min":3.2959999999999998},"last":1.581}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":367,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194945,"statfs":{"total":200000000,"available":199623698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.88500000000000001,"15min":0.89300000000000002},"min":{"1min":0.53800000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.4259999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.79000000000000004,"15min":0.78200000000000003},"min":{"1min":0.442,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.008},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.93400000000000005,"15min":0.91900000000000004},"min":{"1min":0.45900000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0149999999999999,"15min":1.0029999999999999},"min":{"1min":0.58499999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.744,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.071,"15min":1.0349999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.254}]},{"osd":4,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.27,"15min":1.2569999999999999},"min":{"1min":1.024,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.671,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.2270000000000001,"15min":1.1990000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.651,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.357}]},{"osd":5,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.242,"15min":1.24},"min":{"1min":0.80600000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.258,"15min":1.2509999999999999},"min":{"1min":0.90600000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.839,"5min":1.885,"15min":1.885},"last":1.0900000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.288,"15min":1.268},"min":{"1min":0.78600000000000003,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.452},{"interface":"front","average":{"1min":1.383,"5min":1.367,"15min":1.373},"min":{"1min":1.008,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.0649999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.304}]},{"osd":7,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3400000000000001,"15min":1.3480000000000001},"min":{"1min":0.97099999999999997,"5min":0.755,"15min":0.755},"max":{"1min":1.768,"5min":1.79,"15min":1.79},"last":1.159},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3700000000000001,"15min":1.3640000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.9510000000000001,"5min":2.214,"15min":2.214},"last":1.145}]}]}],"pool_statfs":[]}} 2023-12-22T08:43:16.756 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:43:16.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:43:18.795 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:43:19.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.028+0000 7ff9617d6640 1 Processor -- start 2023-12-22T08:43:19.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.029+0000 7ff9617d6640 1 -- start start 2023-12-22T08:43:19.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.030+0000 7ff9617d6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff95c161340 0x7ff95c071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:19.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.030+0000 7ff9617d6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff95c071fa0 0x7ff95c0adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:19.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.030+0000 7ff9617d6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95c0ce950 con 0x7ff95c161720 2023-12-22T08:43:19.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.030+0000 7ff9617d6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95c0cdd40 con 0x7ff95c161340 2023-12-22T08:43:19.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.030+0000 7ff9617d6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95c0ce020 con 0x7ff95c071fa0 2023-12-22T08:43:19.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.031+0000 7ff960fd5640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff95c161720 0x7ff95c0ae1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34746/0 (socket says 172.21.15.38:34746) 2023-12-22T08:43:19.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.031+0000 7ff960fd5640 1 -- 172.21.15.38:0/188412255 learned_addr learned my addr 172.21.15.38:0/188412255 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:43:19.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.031+0000 7ff95bfff640 1 --2- 172.21.15.38:0/188412255 >> v2:172.21.15.38:3300/0 conn(0x7ff95c161340 0x7ff95c071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:19.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.031+0000 7ff95b7fe640 1 -- 172.21.15.38:0/188412255 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433686977 0 0) 0x7ff95c0ce950 con 0x7ff95c161720 2023-12-22T08:43:19.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.031+0000 7ff95b7fe640 1 -- 172.21.15.38:0/188412255 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff948003520 con 0x7ff95c161720 2023-12-22T08:43:19.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.031+0000 7ff953fff640 1 --2- 172.21.15.38:0/188412255 >> v2:172.21.15.89:3300/0 conn(0x7ff95c071fa0 0x7ff95c0adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:19.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.031+0000 7ff95bfff640 1 -- 172.21.15.38:0/188412255 >> v2:172.21.15.89:3300/0 conn(0x7ff95c071fa0 msgr2=0x7ff95c0adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:19.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.031+0000 7ff95bfff640 1 --2- 172.21.15.38:0/188412255 >> v2:172.21.15.89:3300/0 conn(0x7ff95c071fa0 0x7ff95c0adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.031+0000 7ff95bfff640 1 -- 172.21.15.38:0/188412255 >> v1:172.21.15.38:6789/0 conn(0x7ff95c161720 legacy=0x7ff95c0ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:19.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.031+0000 7ff95bfff640 1 -- 172.21.15.38:0/188412255 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c0ce300 con 0x7ff95c161340 2023-12-22T08:43:19.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.031+0000 7ff953fff640 1 --2- 172.21.15.38:0/188412255 >> v2:172.21.15.89:3300/0 conn(0x7ff95c071fa0 0x7ff95c0adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.033+0000 7ff95bfff640 1 --2- 172.21.15.38:0/188412255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff95c161340 0x7ff95c071a60 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0ce8c0 tx=0x7ff94c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd62a8d0bb03f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.033+0000 7ff95b7fe640 1 -- 172.21.15.38:0/188412255 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c031710 con 0x7ff95c161340 2023-12-22T08:43:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.033+0000 7ff95b7fe640 1 -- 172.21.15.38:0/188412255 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c02f050 con 0x7ff95c161340 2023-12-22T08:43:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.033+0000 7ff95b7fe640 1 -- 172.21.15.38:0/188412255 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c031a90 con 0x7ff95c161340 2023-12-22T08:43:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.034+0000 7ff9617d6640 1 -- 172.21.15.38:0/188412255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff95c161340 msgr2=0x7ff95c071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.034+0000 7ff9617d6640 1 --2- 172.21.15.38:0/188412255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff95c161340 0x7ff95c071a60 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0ce8c0 tx=0x7ff94c02b7b0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.034+0000 7ff9617d6640 1 -- 172.21.15.38:0/188412255 shutdown_connections 2023-12-22T08:43:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.034+0000 7ff9617d6640 1 --2- 172.21.15.38:0/188412255 >> v2:172.21.15.89:3300/0 conn(0x7ff95c071fa0 0x7ff95c0adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.034+0000 7ff9617d6640 1 --2- 172.21.15.38:0/188412255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff95c161340 0x7ff95c071a60 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.034+0000 7ff9617d6640 1 -- 172.21.15.38:0/188412255 >> 172.21.15.38:0/188412255 conn(0x7ff95c0b1f70 msgr2=0x7ff95c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:19.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.034+0000 7ff9617d6640 1 -- 172.21.15.38:0/188412255 shutdown_connections 2023-12-22T08:43:19.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.034+0000 7ff9617d6640 1 -- 172.21.15.38:0/188412255 wait complete. 2023-12-22T08:43:19.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.036+0000 7ff9617d6640 1 Processor -- start 2023-12-22T08:43:19.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.036+0000 7ff9617d6640 1 -- start start 2023-12-22T08:43:19.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.037+0000 7ff9617d6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff95c071fa0 0x7ff95c09f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:19.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.037+0000 7ff9617d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff95c161340 0x7ff95c156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:19.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.037+0000 7ff9617d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff95c161720 0x7ff95c154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:19.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.037+0000 7ff9617d6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c157500 con 0x7ff95c161720 2023-12-22T08:43:19.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.037+0000 7ff9617d6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c1577e0 con 0x7ff95c161340 2023-12-22T08:43:19.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.037+0000 7ff9617d6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c157ac0 con 0x7ff95c071fa0 2023-12-22T08:43:19.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.037+0000 7ff960fd5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff95c161720 0x7ff95c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:19.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.037+0000 7ff960fd5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff95c161720 0x7ff95c154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33980/0 (socket says 172.21.15.38:33980) 2023-12-22T08:43:19.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.037+0000 7ff960fd5640 1 -- 172.21.15.38:0/286811728 learned_addr learned my addr 172.21.15.38:0/286811728 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:19.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.038+0000 7ff953fff640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff95c161340 0x7ff95c156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:19.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.038+0000 7ff95bfff640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff95c071fa0 0x7ff95c09f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:19.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.038+0000 7ff960fd5640 1 -- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff95c071fa0 msgr2=0x7ff95c09f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:19.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.038+0000 7ff960fd5640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff95c071fa0 0x7ff95c09f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.038+0000 7ff960fd5640 1 -- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff95c161340 msgr2=0x7ff95c156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:19.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.038+0000 7ff960fd5640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff95c161340 0x7ff95c156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.038+0000 7ff960fd5640 1 -- 172.21.15.38:0/286811728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c009400 con 0x7ff95c161720 2023-12-22T08:43:19.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.038+0000 7ff960fd5640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff95c161720 0x7ff95c154da0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff95400caa0 tx=0x7ff95400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:19.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.038+0000 7ff9597fa640 1 -- 172.21.15.38:0/286811728 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95400ac00 con 0x7ff95c161720 2023-12-22T08:43:19.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.039+0000 7ff9597fa640 1 -- 172.21.15.38:0/286811728 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95400ad60 con 0x7ff95c161720 2023-12-22T08:43:19.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.039+0000 7ff9597fa640 1 -- 172.21.15.38:0/286811728 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954012620 con 0x7ff95c161720 2023-12-22T08:43:19.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.039+0000 7ff9617d6640 1 -- 172.21.15.38:0/286811728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95c157da0 con 0x7ff95c161720 2023-12-22T08:43:19.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.039+0000 7ff9617d6640 1 -- 172.21.15.38:0/286811728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95c157200 con 0x7ff95c161720 2023-12-22T08:43:19.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.040+0000 7ff9617d6640 1 -- 172.21.15.38:0/286811728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95c1582c0 con 0x7ff95c161720 2023-12-22T08:43:19.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.041+0000 7ff9597fa640 1 -- 172.21.15.38:0/286811728 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff954007070 con 0x7ff95c161720 2023-12-22T08:43:19.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.042+0000 7ff9597fa640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff93c06a430 0x7ff93c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:19.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.042+0000 7ff9597fa640 1 -- 172.21.15.38:0/286811728 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff954088920 con 0x7ff95c161720 2023-12-22T08:43:19.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.042+0000 7ff95bfff640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff93c06a430 0x7ff93c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:19.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.043+0000 7ff95bfff640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff93c06a430 0x7ff93c06c8f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff94c035000 tx=0x7ff94c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:19.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.046+0000 7ff9597fa640 1 -- 172.21.15.38:0/286811728 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff954053f00 con 0x7ff95c161720 2023-12-22T08:43:19.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.235+0000 7ff9617d6640 1 -- 172.21.15.38:0/286811728 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff95c157950 con 0x7ff93c06a430 2023-12-22T08:43:19.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.257+0000 7ff9597fa640 1 -- 172.21.15.38:0/286811728 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282281 (secure 0 0 0) 0x7ff95c157950 con 0x7ff93c06a430 2023-12-22T08:43:19.264 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:19.266 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:43:19.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.263+0000 7ff9617d6640 1 -- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff93c06a430 msgr2=0x7ff93c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.263+0000 7ff9617d6640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff93c06a430 0x7ff93c06c8f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff94c035000 tx=0x7ff94c008030 comp rx=0 tx=0).stop 2023-12-22T08:43:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.263+0000 7ff9617d6640 1 -- 172.21.15.38:0/286811728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff95c161720 msgr2=0x7ff95c154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.263+0000 7ff9617d6640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff95c161720 0x7ff95c154da0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff95400caa0 tx=0x7ff95400cf60 comp rx=0 tx=0).stop 2023-12-22T08:43:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.264+0000 7ff9617d6640 1 -- 172.21.15.38:0/286811728 shutdown_connections 2023-12-22T08:43:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.264+0000 7ff9617d6640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff93c06a430 0x7ff93c06c8f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.264+0000 7ff9617d6640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff95c161720 0x7ff95c154da0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.264+0000 7ff9617d6640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff95c161340 0x7ff95c156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.264+0000 7ff9617d6640 1 --2- 172.21.15.38:0/286811728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff95c071fa0 0x7ff95c09f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.264+0000 7ff9617d6640 1 -- 172.21.15.38:0/286811728 >> 172.21.15.38:0/286811728 conn(0x7ff95c0b1f70 msgr2=0x7ff95c15f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.264+0000 7ff9617d6640 1 -- 172.21.15.38:0/286811728 shutdown_connections 2023-12-22T08:43:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.264+0000 7ff9617d6640 1 -- 172.21.15.38:0/286811728 wait complete. 2023-12-22T08:43:19.287 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-12-22T08:43:18.424410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4084,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558415,"statfs":{"total":1600000000,"available":1595817655,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.680134"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.769139+0000","last_change":"2023-12-22T08:43:08.768994+0000","last_active":"2023-12-22T08:43:08.769139+0000","last_peered":"2023-12-22T08:43:08.769139+0000","last_clean":"2023-12-22T08:43:08.769139+0000","last_became_active":"2023-12-22T08:43:08.767875+0000","last_became_peered":"2023-12-22T08:43:08.767875+0000","last_unstale":"2023-12-22T08:43:08.769139+0000","last_undegraded":"2023-12-22T08:43:08.769139+0000","last_fullsized":"2023-12-22T08:43:08.769139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:19.778557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780504+0000","last_change":"2023-12-22T08:43:08.780418+0000","last_active":"2023-12-22T08:43:08.780504+0000","last_peered":"2023-12-22T08:43:08.780504+0000","last_clean":"2023-12-22T08:43:08.780504+0000","last_became_active":"2023-12-22T08:43:08.779658+0000","last_became_peered":"2023-12-22T08:43:08.779658+0000","last_unstale":"2023-12-22T08:43:08.780504+0000","last_undegraded":"2023-12-22T08:43:08.780504+0000","last_fullsized":"2023-12-22T08:43:08.780504+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:38.767539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760810+0000","last_change":"2023-12-22T08:43:08.760735+0000","last_active":"2023-12-22T08:43:08.760810+0000","last_peered":"2023-12-22T08:43:08.760810+0000","last_clean":"2023-12-22T08:43:08.760810+0000","last_became_active":"2023-12-22T08:43:08.760505+0000","last_became_peered":"2023-12-22T08:43:08.760505+0000","last_unstale":"2023-12-22T08:43:08.760810+0000","last_undegraded":"2023-12-22T08:43:08.760810+0000","last_fullsized":"2023-12-22T08:43:08.760810+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:16:21.250428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.766653+0000","last_change":"2023-12-22T08:43:08.766231+0000","last_active":"2023-12-22T08:43:08.766653+0000","last_peered":"2023-12-22T08:43:08.766653+0000","last_clean":"2023-12-22T08:43:08.766653+0000","last_became_active":"2023-12-22T08:43:08.765962+0000","last_became_peered":"2023-12-22T08:43:08.765962+0000","last_unstale":"2023-12-22T08:43:08.766653+0000","last_undegraded":"2023-12-22T08:43:08.766653+0000","last_fullsized":"2023-12-22T08:43:08.766653+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:39:28.695272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765417+0000","last_change":"2023-12-22T08:43:08.764141+0000","last_active":"2023-12-22T08:43:08.765417+0000","last_peered":"2023-12-22T08:43:08.765417+0000","last_clean":"2023-12-22T08:43:08.765417+0000","last_became_active":"2023-12-22T08:43:08.760446+0000","last_became_peered":"2023-12-22T08:43:08.760446+0000","last_unstale":"2023-12-22T08:43:08.765417+0000","last_undegraded":"2023-12-22T08:43:08.765417+0000","last_fullsized":"2023-12-22T08:43:08.765417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:53.820355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765491+0000","last_change":"2023-12-22T08:43:08.765266+0000","last_active":"2023-12-22T08:43:08.765491+0000","last_peered":"2023-12-22T08:43:08.765491+0000","last_clean":"2023-12-22T08:43:08.765491+0000","last_became_active":"2023-12-22T08:43:08.764819+0000","last_became_peered":"2023-12-22T08:43:08.764819+0000","last_unstale":"2023-12-22T08:43:08.765491+0000","last_undegraded":"2023-12-22T08:43:08.765491+0000","last_fullsized":"2023-12-22T08:43:08.765491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:08.268339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.761773+0000","last_change":"2023-12-22T08:43:08.761706+0000","last_active":"2023-12-22T08:43:08.761773+0000","last_peered":"2023-12-22T08:43:08.761773+0000","last_clean":"2023-12-22T08:43:08.761773+0000","last_became_active":"2023-12-22T08:43:08.761392+0000","last_became_peered":"2023-12-22T08:43:08.761392+0000","last_unstale":"2023-12-22T08:43:08.761773+0000","last_undegraded":"2023-12-22T08:43:08.761773+0000","last_fullsized":"2023-12-22T08:43:08.761773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:41:04.613813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780490+0000","last_change":"2023-12-22T08:43:08.780082+0000","last_active":"2023-12-22T08:43:08.780490+0000","last_peered":"2023-12-22T08:43:08.780490+0000","last_clean":"2023-12-22T08:43:08.780490+0000","last_became_active":"2023-12-22T08:43:08.775897+0000","last_became_peered":"2023-12-22T08:43:08.775897+0000","last_unstale":"2023-12-22T08:43:08.780490+0000","last_undegraded":"2023-12-22T08:43:08.780490+0000","last_fullsized":"2023-12-22T08:43:08.780490+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:17.538382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.770465+0000","last_change":"2023-12-22T08:43:08.768897+0000","last_active":"2023-12-22T08:43:08.770465+0000","last_peered":"2023-12-22T08:43:08.770465+0000","last_clean":"2023-12-22T08:43:08.770465+0000","last_became_active":"2023-12-22T08:43:08.768331+0000","last_became_peered":"2023-12-22T08:43:08.768331+0000","last_unstale":"2023-12-22T08:43:08.770465+0000","last_undegraded":"2023-12-22T08:43:08.770465+0000","last_fullsized":"2023-12-22T08:43:08.770465+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:50.001477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765434+0000","last_change":"2023-12-22T08:43:08.764540+0000","last_active":"2023-12-22T08:43:08.765434+0000","last_peered":"2023-12-22T08:43:08.765434+0000","last_clean":"2023-12-22T08:43:08.765434+0000","last_became_active":"2023-12-22T08:43:08.763549+0000","last_became_peered":"2023-12-22T08:43:08.763549+0000","last_unstale":"2023-12-22T08:43:08.765434+0000","last_undegraded":"2023-12-22T08:43:08.765434+0000","last_fullsized":"2023-12-22T08:43:08.765434+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:25.938446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765998+0000","last_change":"2023-12-22T08:43:08.763811+0000","last_active":"2023-12-22T08:43:08.765998+0000","last_peered":"2023-12-22T08:43:08.765998+0000","last_clean":"2023-12-22T08:43:08.765998+0000","last_became_active":"2023-12-22T08:43:08.763370+0000","last_became_peered":"2023-12-22T08:43:08.763370+0000","last_unstale":"2023-12-22T08:43:08.765998+0000","last_undegraded":"2023-12-22T08:43:08.765998+0000","last_fullsized":"2023-12-22T08:43:08.765998+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:59.082663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.758061+0000","last_change":"2023-12-22T08:43:08.757253+0000","last_active":"2023-12-22T08:43:08.758061+0000","last_peered":"2023-12-22T08:43:08.758061+0000","last_clean":"2023-12-22T08:43:08.758061+0000","last_became_active":"2023-12-22T08:43:08.756898+0000","last_became_peered":"2023-12-22T08:43:08.756898+0000","last_unstale":"2023-12-22T08:43:08.758061+0000","last_undegraded":"2023-12-22T08:43:08.758061+0000","last_fullsized":"2023-12-22T08:43:08.758061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:28.563154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774725+0000","last_change":"2023-12-22T08:43:08.774645+0000","last_active":"2023-12-22T08:43:08.774725+0000","last_peered":"2023-12-22T08:43:08.774725+0000","last_clean":"2023-12-22T08:43:08.774725+0000","last_became_active":"2023-12-22T08:43:08.774481+0000","last_became_peered":"2023-12-22T08:43:08.774481+0000","last_unstale":"2023-12-22T08:43:08.774725+0000","last_undegraded":"2023-12-22T08:43:08.774725+0000","last_fullsized":"2023-12-22T08:43:08.774725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:23:04.134244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775790+0000","last_change":"2023-12-22T08:43:08.775710+0000","last_active":"2023-12-22T08:43:08.775790+0000","last_peered":"2023-12-22T08:43:08.775790+0000","last_clean":"2023-12-22T08:43:08.775790+0000","last_became_active":"2023-12-22T08:43:08.775344+0000","last_became_peered":"2023-12-22T08:43:08.775344+0000","last_unstale":"2023-12-22T08:43:08.775790+0000","last_undegraded":"2023-12-22T08:43:08.775790+0000","last_fullsized":"2023-12-22T08:43:08.775790+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:31.918421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768154+0000","last_change":"2023-12-22T08:43:08.768085+0000","last_active":"2023-12-22T08:43:08.768154+0000","last_peered":"2023-12-22T08:43:08.768154+0000","last_clean":"2023-12-22T08:43:08.768154+0000","last_became_active":"2023-12-22T08:43:08.767893+0000","last_became_peered":"2023-12-22T08:43:08.767893+0000","last_unstale":"2023-12-22T08:43:08.768154+0000","last_undegraded":"2023-12-22T08:43:08.768154+0000","last_fullsized":"2023-12-22T08:43:08.768154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:53.820355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765401+0000","last_change":"2023-12-22T08:43:08.764151+0000","last_active":"2023-12-22T08:43:08.765401+0000","last_peered":"2023-12-22T08:43:08.765401+0000","last_clean":"2023-12-22T08:43:08.765401+0000","last_became_active":"2023-12-22T08:43:08.763651+0000","last_became_peered":"2023-12-22T08:43:08.763651+0000","last_unstale":"2023-12-22T08:43:08.765401+0000","last_undegraded":"2023-12-22T08:43:08.765401+0000","last_fullsized":"2023-12-22T08:43:08.765401+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:43.665325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765450+0000","last_change":"2023-12-22T08:43:08.764908+0000","last_active":"2023-12-22T08:43:08.765450+0000","last_peered":"2023-12-22T08:43:08.765450+0000","last_clean":"2023-12-22T08:43:08.765450+0000","last_became_active":"2023-12-22T08:43:08.761599+0000","last_became_peered":"2023-12-22T08:43:08.761599+0000","last_unstale":"2023-12-22T08:43:08.765450+0000","last_undegraded":"2023-12-22T08:43:08.765450+0000","last_fullsized":"2023-12-22T08:43:08.765450+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:38.811875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774213+0000","last_change":"2023-12-22T08:43:08.774063+0000","last_active":"2023-12-22T08:43:08.774213+0000","last_peered":"2023-12-22T08:43:08.774213+0000","last_clean":"2023-12-22T08:43:08.774213+0000","last_became_active":"2023-12-22T08:43:08.773691+0000","last_became_peered":"2023-12-22T08:43:08.773691+0000","last_unstale":"2023-12-22T08:43:08.774213+0000","last_undegraded":"2023-12-22T08:43:08.774213+0000","last_fullsized":"2023-12-22T08:43:08.774213+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:05.131643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778977+0000","last_change":"2023-12-22T08:43:08.778665+0000","last_active":"2023-12-22T08:43:08.778977+0000","last_peered":"2023-12-22T08:43:08.778977+0000","last_clean":"2023-12-22T08:43:08.778977+0000","last_became_active":"2023-12-22T08:43:08.778435+0000","last_became_peered":"2023-12-22T08:43:08.778435+0000","last_unstale":"2023-12-22T08:43:08.778977+0000","last_undegraded":"2023-12-22T08:43:08.778977+0000","last_fullsized":"2023-12-22T08:43:08.778977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:45.919846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.767546+0000","last_change":"2023-12-22T08:43:08.767403+0000","last_active":"2023-12-22T08:43:08.767546+0000","last_peered":"2023-12-22T08:43:08.767546+0000","last_clean":"2023-12-22T08:43:08.767546+0000","last_became_active":"2023-12-22T08:43:08.766987+0000","last_became_peered":"2023-12-22T08:43:08.766987+0000","last_unstale":"2023-12-22T08:43:08.767546+0000","last_undegraded":"2023-12-22T08:43:08.767546+0000","last_fullsized":"2023-12-22T08:43:08.767546+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:13.722210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760231+0000","last_change":"2023-12-22T08:43:08.759198+0000","last_active":"2023-12-22T08:43:08.760231+0000","last_peered":"2023-12-22T08:43:08.760231+0000","last_clean":"2023-12-22T08:43:08.760231+0000","last_became_active":"2023-12-22T08:43:08.758223+0000","last_became_peered":"2023-12-22T08:43:08.758223+0000","last_unstale":"2023-12-22T08:43:08.760231+0000","last_undegraded":"2023-12-22T08:43:08.760231+0000","last_fullsized":"2023-12-22T08:43:08.760231+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:38.811875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.781265+0000","last_change":"2023-12-22T08:43:08.781203+0000","last_active":"2023-12-22T08:43:08.781265+0000","last_peered":"2023-12-22T08:43:08.781265+0000","last_clean":"2023-12-22T08:43:08.781265+0000","last_became_active":"2023-12-22T08:43:08.780644+0000","last_became_peered":"2023-12-22T08:43:08.780644+0000","last_unstale":"2023-12-22T08:43:08.781265+0000","last_undegraded":"2023-12-22T08:43:08.781265+0000","last_fullsized":"2023-12-22T08:43:08.781265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:24:55.494298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774057+0000","last_change":"2023-12-22T08:43:08.773780+0000","last_active":"2023-12-22T08:43:08.774057+0000","last_peered":"2023-12-22T08:43:08.774057+0000","last_clean":"2023-12-22T08:43:08.774057+0000","last_became_active":"2023-12-22T08:43:08.773551+0000","last_became_peered":"2023-12-22T08:43:08.773551+0000","last_unstale":"2023-12-22T08:43:08.774057+0000","last_undegraded":"2023-12-22T08:43:08.774057+0000","last_fullsized":"2023-12-22T08:43:08.774057+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:59:35.438006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.770483+0000","last_change":"2023-12-22T08:43:08.769139+0000","last_active":"2023-12-22T08:43:08.770483+0000","last_peered":"2023-12-22T08:43:08.770483+0000","last_clean":"2023-12-22T08:43:08.770483+0000","last_became_active":"2023-12-22T08:43:08.768657+0000","last_became_peered":"2023-12-22T08:43:08.768657+0000","last_unstale":"2023-12-22T08:43:08.770483+0000","last_undegraded":"2023-12-22T08:43:08.770483+0000","last_fullsized":"2023-12-22T08:43:08.770483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:30:25.664436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.782335+0000","last_change":"2023-12-22T08:43:08.782157+0000","last_active":"2023-12-22T08:43:08.782335+0000","last_peered":"2023-12-22T08:43:08.782335+0000","last_clean":"2023-12-22T08:43:08.782335+0000","last_became_active":"2023-12-22T08:43:08.781718+0000","last_became_peered":"2023-12-22T08:43:08.781718+0000","last_unstale":"2023-12-22T08:43:08.782335+0000","last_undegraded":"2023-12-22T08:43:08.782335+0000","last_fullsized":"2023-12-22T08:43:08.782335+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:43.665325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760265+0000","last_change":"2023-12-22T08:43:08.759714+0000","last_active":"2023-12-22T08:43:08.760265+0000","last_peered":"2023-12-22T08:43:08.760265+0000","last_clean":"2023-12-22T08:43:08.760265+0000","last_became_active":"2023-12-22T08:43:08.759458+0000","last_became_peered":"2023-12-22T08:43:08.759458+0000","last_unstale":"2023-12-22T08:43:08.760265+0000","last_undegraded":"2023-12-22T08:43:08.760265+0000","last_fullsized":"2023-12-22T08:43:08.760265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:25.938446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778850+0000","last_change":"2023-12-22T08:43:08.778079+0000","last_active":"2023-12-22T08:43:08.778850+0000","last_peered":"2023-12-22T08:43:08.778850+0000","last_clean":"2023-12-22T08:43:08.778850+0000","last_became_active":"2023-12-22T08:43:08.777828+0000","last_became_peered":"2023-12-22T08:43:08.777828+0000","last_unstale":"2023-12-22T08:43:08.778850+0000","last_undegraded":"2023-12-22T08:43:08.778850+0000","last_fullsized":"2023-12-22T08:43:08.778850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:28.970593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.776001+0000","last_change":"2023-12-22T08:43:08.775431+0000","last_active":"2023-12-22T08:43:08.776001+0000","last_peered":"2023-12-22T08:43:08.776001+0000","last_clean":"2023-12-22T08:43:08.776001+0000","last_became_active":"2023-12-22T08:43:08.770714+0000","last_became_peered":"2023-12-22T08:43:08.770714+0000","last_unstale":"2023-12-22T08:43:08.776001+0000","last_undegraded":"2023-12-22T08:43:08.776001+0000","last_fullsized":"2023-12-22T08:43:08.776001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:59.082663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778321+0000","last_change":"2023-12-22T08:43:08.777124+0000","last_active":"2023-12-22T08:43:08.778321+0000","last_peered":"2023-12-22T08:43:08.778321+0000","last_clean":"2023-12-22T08:43:08.778321+0000","last_became_active":"2023-12-22T08:43:08.776768+0000","last_became_peered":"2023-12-22T08:43:08.776768+0000","last_unstale":"2023-12-22T08:43:08.778321+0000","last_undegraded":"2023-12-22T08:43:08.778321+0000","last_fullsized":"2023-12-22T08:43:08.778321+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:22:54.223163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.759180+0000","last_change":"2023-12-22T08:43:08.759112+0000","last_active":"2023-12-22T08:43:08.759180+0000","last_peered":"2023-12-22T08:43:08.759180+0000","last_clean":"2023-12-22T08:43:08.759180+0000","last_became_active":"2023-12-22T08:43:08.758739+0000","last_became_peered":"2023-12-22T08:43:08.758739+0000","last_unstale":"2023-12-22T08:43:08.759180+0000","last_undegraded":"2023-12-22T08:43:08.759180+0000","last_fullsized":"2023-12-22T08:43:08.759180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:21.060714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.776206+0000","last_change":"2023-12-22T08:43:08.775929+0000","last_active":"2023-12-22T08:43:08.776206+0000","last_peered":"2023-12-22T08:43:08.776206+0000","last_clean":"2023-12-22T08:43:08.776206+0000","last_became_active":"2023-12-22T08:43:08.775705+0000","last_became_peered":"2023-12-22T08:43:08.775705+0000","last_unstale":"2023-12-22T08:43:08.776206+0000","last_undegraded":"2023-12-22T08:43:08.776206+0000","last_fullsized":"2023-12-22T08:43:08.776206+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:24:12.486647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780952+0000","last_change":"2023-12-22T08:43:08.780870+0000","last_active":"2023-12-22T08:43:08.780952+0000","last_peered":"2023-12-22T08:43:08.780952+0000","last_clean":"2023-12-22T08:43:08.780952+0000","last_became_active":"2023-12-22T08:43:08.779502+0000","last_became_peered":"2023-12-22T08:43:08.779502+0000","last_unstale":"2023-12-22T08:43:08.780952+0000","last_undegraded":"2023-12-22T08:43:08.780952+0000","last_fullsized":"2023-12-22T08:43:08.780952+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:31.918421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768828+0000","last_change":"2023-12-22T08:43:08.768756+0000","last_active":"2023-12-22T08:43:08.768828+0000","last_peered":"2023-12-22T08:43:08.768828+0000","last_clean":"2023-12-22T08:43:08.768828+0000","last_became_active":"2023-12-22T08:43:08.767824+0000","last_became_peered":"2023-12-22T08:43:08.767824+0000","last_unstale":"2023-12-22T08:43:08.768828+0000","last_undegraded":"2023-12-22T08:43:08.768828+0000","last_fullsized":"2023-12-22T08:43:08.768828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:45:00.000204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"71'4","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778049+0000","last_change":"2023-12-22T08:43:08.241094+0000","last_active":"2023-12-22T08:43:08.778049+0000","last_peered":"2023-12-22T08:43:08.778049+0000","last_clean":"2023-12-22T08:43:08.778049+0000","last_became_active":"2023-12-22T08:43:08.240506+0000","last_became_peered":"2023-12-22T08:43:08.240506+0000","last_unstale":"2023-12-22T08:43:08.778049+0000","last_undegraded":"2023-12-22T08:43:08.778049+0000","last_fullsized":"2023-12-22T08:43:08.778049+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:26.160091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765315+0000","last_change":"2023-12-22T08:43:08.759468+0000","last_active":"2023-12-22T08:43:08.765315+0000","last_peered":"2023-12-22T08:43:08.765315+0000","last_clean":"2023-12-22T08:43:08.765315+0000","last_became_active":"2023-12-22T08:43:08.758667+0000","last_became_peered":"2023-12-22T08:43:08.758667+0000","last_unstale":"2023-12-22T08:43:08.765315+0000","last_undegraded":"2023-12-22T08:43:08.765315+0000","last_fullsized":"2023-12-22T08:43:08.765315+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:38.767539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778760+0000","last_change":"2023-12-22T08:43:08.241565+0000","last_active":"2023-12-22T08:43:08.778760+0000","last_peered":"2023-12-22T08:43:08.778760+0000","last_clean":"2023-12-22T08:43:08.778760+0000","last_became_active":"2023-12-22T08:43:08.241298+0000","last_became_peered":"2023-12-22T08:43:08.241298+0000","last_unstale":"2023-12-22T08:43:08.778760+0000","last_undegraded":"2023-12-22T08:43:08.778760+0000","last_fullsized":"2023-12-22T08:43:08.778760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:57:12.591295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772898+0000","last_change":"2023-12-22T08:43:08.770501+0000","last_active":"2023-12-22T08:43:08.772898+0000","last_peered":"2023-12-22T08:43:08.772898+0000","last_clean":"2023-12-22T08:43:08.772898+0000","last_became_active":"2023-12-22T08:43:08.770276+0000","last_became_peered":"2023-12-22T08:43:08.770276+0000","last_unstale":"2023-12-22T08:43:08.772898+0000","last_undegraded":"2023-12-22T08:43:08.772898+0000","last_fullsized":"2023-12-22T08:43:08.772898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:37:20.548483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.777583+0000","last_change":"2023-12-22T08:43:08.245896+0000","last_active":"2023-12-22T08:43:08.777583+0000","last_peered":"2023-12-22T08:43:08.777583+0000","last_clean":"2023-12-22T08:43:08.777583+0000","last_became_active":"2023-12-22T08:43:08.245372+0000","last_became_peered":"2023-12-22T08:43:08.245372+0000","last_unstale":"2023-12-22T08:43:08.777583+0000","last_undegraded":"2023-12-22T08:43:08.777583+0000","last_fullsized":"2023-12-22T08:43:08.777583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:29.623967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780030+0000","last_change":"2023-12-22T08:43:08.779587+0000","last_active":"2023-12-22T08:43:08.780030+0000","last_peered":"2023-12-22T08:43:08.780030+0000","last_clean":"2023-12-22T08:43:08.780030+0000","last_became_active":"2023-12-22T08:43:08.779329+0000","last_became_peered":"2023-12-22T08:43:08.779329+0000","last_unstale":"2023-12-22T08:43:08.780030+0000","last_undegraded":"2023-12-22T08:43:08.780030+0000","last_fullsized":"2023-12-22T08:43:08.780030+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:34.735345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.766614+0000","last_change":"2023-12-22T08:43:08.229587+0000","last_active":"2023-12-22T08:43:08.766614+0000","last_peered":"2023-12-22T08:43:08.766614+0000","last_clean":"2023-12-22T08:43:08.766614+0000","last_became_active":"2023-12-22T08:43:08.228337+0000","last_became_peered":"2023-12-22T08:43:08.228337+0000","last_unstale":"2023-12-22T08:43:08.766614+0000","last_undegraded":"2023-12-22T08:43:08.766614+0000","last_fullsized":"2023-12-22T08:43:08.766614+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:49.938120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780723+0000","last_change":"2023-12-22T08:43:08.780604+0000","last_active":"2023-12-22T08:43:08.780723+0000","last_peered":"2023-12-22T08:43:08.780723+0000","last_clean":"2023-12-22T08:43:08.780723+0000","last_became_active":"2023-12-22T08:43:08.780385+0000","last_became_peered":"2023-12-22T08:43:08.780385+0000","last_unstale":"2023-12-22T08:43:08.780723+0000","last_undegraded":"2023-12-22T08:43:08.780723+0000","last_fullsized":"2023-12-22T08:43:08.780723+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:09:53.006039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768236+0000","last_change":"2023-12-22T08:43:08.230735+0000","last_active":"2023-12-22T08:43:08.768236+0000","last_peered":"2023-12-22T08:43:08.768236+0000","last_clean":"2023-12-22T08:43:08.768236+0000","last_became_active":"2023-12-22T08:43:08.227246+0000","last_became_peered":"2023-12-22T08:43:08.227246+0000","last_unstale":"2023-12-22T08:43:08.768236+0000","last_undegraded":"2023-12-22T08:43:08.768236+0000","last_fullsized":"2023-12-22T08:43:08.768236+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:44.904868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.781137+0000","last_change":"2023-12-22T08:43:08.781029+0000","last_active":"2023-12-22T08:43:08.781137+0000","last_peered":"2023-12-22T08:43:08.781137+0000","last_clean":"2023-12-22T08:43:08.781137+0000","last_became_active":"2023-12-22T08:43:08.780332+0000","last_became_peered":"2023-12-22T08:43:08.780332+0000","last_unstale":"2023-12-22T08:43:08.781137+0000","last_undegraded":"2023-12-22T08:43:08.781137+0000","last_fullsized":"2023-12-22T08:43:08.781137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:41.615895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774363+0000","last_change":"2023-12-22T08:43:08.247775+0000","last_active":"2023-12-22T08:43:08.774363+0000","last_peered":"2023-12-22T08:43:08.774363+0000","last_clean":"2023-12-22T08:43:08.774363+0000","last_became_active":"2023-12-22T08:43:08.247512+0000","last_became_peered":"2023-12-22T08:43:08.247512+0000","last_unstale":"2023-12-22T08:43:08.774363+0000","last_undegraded":"2023-12-22T08:43:08.774363+0000","last_fullsized":"2023-12-22T08:43:08.774363+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:46:44.813831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.759227+0000","last_change":"2023-12-22T08:43:08.759113+0000","last_active":"2023-12-22T08:43:08.759227+0000","last_peered":"2023-12-22T08:43:08.759227+0000","last_clean":"2023-12-22T08:43:08.759227+0000","last_became_active":"2023-12-22T08:43:08.758547+0000","last_became_peered":"2023-12-22T08:43:08.758547+0000","last_unstale":"2023-12-22T08:43:08.759227+0000","last_undegraded":"2023-12-22T08:43:08.759227+0000","last_fullsized":"2023-12-22T08:43:08.759227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:31:40.143949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747531+0000","last_change":"2023-12-22T08:43:08.242191+0000","last_active":"2023-12-22T08:43:08.747531+0000","last_peered":"2023-12-22T08:43:08.747531+0000","last_clean":"2023-12-22T08:43:08.747531+0000","last_became_active":"2023-12-22T08:43:08.241783+0000","last_became_peered":"2023-12-22T08:43:08.241783+0000","last_unstale":"2023-12-22T08:43:08.747531+0000","last_undegraded":"2023-12-22T08:43:08.747531+0000","last_fullsized":"2023-12-22T08:43:08.747531+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:53.956992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768715+0000","last_change":"2023-12-22T08:43:08.768597+0000","last_active":"2023-12-22T08:43:08.768715+0000","last_peered":"2023-12-22T08:43:08.768715+0000","last_clean":"2023-12-22T08:43:08.768715+0000","last_became_active":"2023-12-22T08:43:08.767435+0000","last_became_peered":"2023-12-22T08:43:08.767435+0000","last_unstale":"2023-12-22T08:43:08.768715+0000","last_undegraded":"2023-12-22T08:43:08.768715+0000","last_fullsized":"2023-12-22T08:43:08.768715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:45.919846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.757846+0000","last_change":"2023-12-22T08:43:08.240904+0000","last_active":"2023-12-22T08:43:08.757846+0000","last_peered":"2023-12-22T08:43:08.757846+0000","last_clean":"2023-12-22T08:43:08.757846+0000","last_became_active":"2023-12-22T08:43:08.240539+0000","last_became_peered":"2023-12-22T08:43:08.240539+0000","last_unstale":"2023-12-22T08:43:08.757846+0000","last_undegraded":"2023-12-22T08:43:08.757846+0000","last_fullsized":"2023-12-22T08:43:08.757846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:44.413577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760250+0000","last_change":"2023-12-22T08:43:08.759588+0000","last_active":"2023-12-22T08:43:08.760250+0000","last_peered":"2023-12-22T08:43:08.760250+0000","last_clean":"2023-12-22T08:43:08.760250+0000","last_became_active":"2023-12-22T08:43:08.759370+0000","last_became_peered":"2023-12-22T08:43:08.759370+0000","last_unstale":"2023-12-22T08:43:08.760250+0000","last_undegraded":"2023-12-22T08:43:08.760250+0000","last_fullsized":"2023-12-22T08:43:08.760250+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:28:32.888896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747148+0000","last_change":"2023-12-22T08:43:08.242221+0000","last_active":"2023-12-22T08:43:08.747148+0000","last_peered":"2023-12-22T08:43:08.747148+0000","last_clean":"2023-12-22T08:43:08.747148+0000","last_became_active":"2023-12-22T08:43:08.241895+0000","last_became_peered":"2023-12-22T08:43:08.241895+0000","last_unstale":"2023-12-22T08:43:08.747148+0000","last_undegraded":"2023-12-22T08:43:08.747148+0000","last_fullsized":"2023-12-22T08:43:08.747148+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:36:26.961063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.768352+0000","last_change":"2023-12-22T08:43:08.767781+0000","last_active":"2023-12-22T08:43:08.768352+0000","last_peered":"2023-12-22T08:43:08.768352+0000","last_clean":"2023-12-22T08:43:08.768352+0000","last_became_active":"2023-12-22T08:43:08.767545+0000","last_became_peered":"2023-12-22T08:43:08.767545+0000","last_unstale":"2023-12-22T08:43:08.768352+0000","last_undegraded":"2023-12-22T08:43:08.768352+0000","last_fullsized":"2023-12-22T08:43:08.768352+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:47:09.970458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765721+0000","last_change":"2023-12-22T08:43:08.239881+0000","last_active":"2023-12-22T08:43:08.765721+0000","last_peered":"2023-12-22T08:43:08.765721+0000","last_clean":"2023-12-22T08:43:08.765721+0000","last_became_active":"2023-12-22T08:43:08.238285+0000","last_became_peered":"2023-12-22T08:43:08.238285+0000","last_unstale":"2023-12-22T08:43:08.765721+0000","last_undegraded":"2023-12-22T08:43:08.765721+0000","last_fullsized":"2023-12-22T08:43:08.765721+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:33.720367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775166+0000","last_change":"2023-12-22T08:43:08.773721+0000","last_active":"2023-12-22T08:43:08.775166+0000","last_peered":"2023-12-22T08:43:08.775166+0000","last_clean":"2023-12-22T08:43:08.775166+0000","last_became_active":"2023-12-22T08:43:08.773417+0000","last_became_peered":"2023-12-22T08:43:08.773417+0000","last_unstale":"2023-12-22T08:43:08.775166+0000","last_undegraded":"2023-12-22T08:43:08.775166+0000","last_fullsized":"2023-12-22T08:43:08.775166+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:17.697248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"71'3","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772252+0000","last_change":"2023-12-22T08:43:08.234204+0000","last_active":"2023-12-22T08:43:08.772252+0000","last_peered":"2023-12-22T08:43:08.772252+0000","last_clean":"2023-12-22T08:43:08.772252+0000","last_became_active":"2023-12-22T08:43:08.228159+0000","last_became_peered":"2023-12-22T08:43:08.228159+0000","last_unstale":"2023-12-22T08:43:08.772252+0000","last_undegraded":"2023-12-22T08:43:08.772252+0000","last_fullsized":"2023-12-22T08:43:08.772252+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:18.349374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775948+0000","last_change":"2023-12-22T08:43:08.775186+0000","last_active":"2023-12-22T08:43:08.775948+0000","last_peered":"2023-12-22T08:43:08.775948+0000","last_clean":"2023-12-22T08:43:08.775948+0000","last_became_active":"2023-12-22T08:43:08.774876+0000","last_became_peered":"2023-12-22T08:43:08.774876+0000","last_unstale":"2023-12-22T08:43:08.775948+0000","last_undegraded":"2023-12-22T08:43:08.775948+0000","last_fullsized":"2023-12-22T08:43:08.775948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:58.667030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"71'6","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772747+0000","last_change":"2023-12-22T08:43:08.237347+0000","last_active":"2023-12-22T08:43:08.772747+0000","last_peered":"2023-12-22T08:43:08.772747+0000","last_clean":"2023-12-22T08:43:08.772747+0000","last_became_active":"2023-12-22T08:43:08.235741+0000","last_became_peered":"2023-12-22T08:43:08.235741+0000","last_unstale":"2023-12-22T08:43:08.772747+0000","last_undegraded":"2023-12-22T08:43:08.772747+0000","last_fullsized":"2023-12-22T08:43:08.772747+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:27.955616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775999+0000","last_change":"2023-12-22T08:43:08.775807+0000","last_active":"2023-12-22T08:43:08.775999+0000","last_peered":"2023-12-22T08:43:08.775999+0000","last_clean":"2023-12-22T08:43:08.775999+0000","last_became_active":"2023-12-22T08:43:08.775655+0000","last_became_peered":"2023-12-22T08:43:08.775655+0000","last_unstale":"2023-12-22T08:43:08.775999+0000","last_undegraded":"2023-12-22T08:43:08.775999+0000","last_fullsized":"2023-12-22T08:43:08.775999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:07:12.868602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.781210+0000","last_change":"2023-12-22T08:43:08.243194+0000","last_active":"2023-12-22T08:43:08.781210+0000","last_peered":"2023-12-22T08:43:08.781210+0000","last_clean":"2023-12-22T08:43:08.781210+0000","last_became_active":"2023-12-22T08:43:08.242449+0000","last_became_peered":"2023-12-22T08:43:08.242449+0000","last_unstale":"2023-12-22T08:43:08.781210+0000","last_undegraded":"2023-12-22T08:43:08.781210+0000","last_fullsized":"2023-12-22T08:43:08.781210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:14.817249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760965+0000","last_change":"2023-12-22T08:43:08.760898+0000","last_active":"2023-12-22T08:43:08.760965+0000","last_peered":"2023-12-22T08:43:08.760965+0000","last_clean":"2023-12-22T08:43:08.760965+0000","last_became_active":"2023-12-22T08:43:08.760680+0000","last_became_peered":"2023-12-22T08:43:08.760680+0000","last_unstale":"2023-12-22T08:43:08.760965+0000","last_undegraded":"2023-12-22T08:43:08.760965+0000","last_fullsized":"2023-12-22T08:43:08.760965+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:07:27.247486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.745591+0000","last_change":"2023-12-22T08:43:08.238556+0000","last_active":"2023-12-22T08:43:08.745591+0000","last_peered":"2023-12-22T08:43:08.745591+0000","last_clean":"2023-12-22T08:43:08.745591+0000","last_became_active":"2023-12-22T08:43:08.238261+0000","last_became_peered":"2023-12-22T08:43:08.238261+0000","last_unstale":"2023-12-22T08:43:08.745591+0000","last_undegraded":"2023-12-22T08:43:08.745591+0000","last_fullsized":"2023-12-22T08:43:08.745591+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:22.638334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.760326+0000","last_change":"2023-12-22T08:43:08.759063+0000","last_active":"2023-12-22T08:43:08.760326+0000","last_peered":"2023-12-22T08:43:08.760326+0000","last_clean":"2023-12-22T08:43:08.760326+0000","last_became_active":"2023-12-22T08:43:08.758683+0000","last_became_peered":"2023-12-22T08:43:08.758683+0000","last_unstale":"2023-12-22T08:43:08.760326+0000","last_undegraded":"2023-12-22T08:43:08.760326+0000","last_fullsized":"2023-12-22T08:43:08.760326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:32:13.036482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.746130+0000","last_change":"2023-12-22T08:43:08.239352+0000","last_active":"2023-12-22T08:43:08.746130+0000","last_peered":"2023-12-22T08:43:08.746130+0000","last_clean":"2023-12-22T08:43:08.746130+0000","last_became_active":"2023-12-22T08:43:08.238848+0000","last_became_peered":"2023-12-22T08:43:08.238848+0000","last_unstale":"2023-12-22T08:43:08.746130+0000","last_undegraded":"2023-12-22T08:43:08.746130+0000","last_fullsized":"2023-12-22T08:43:08.746130+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:26:12.707233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778947+0000","last_change":"2023-12-22T08:43:08.778851+0000","last_active":"2023-12-22T08:43:08.778947+0000","last_peered":"2023-12-22T08:43:08.778947+0000","last_clean":"2023-12-22T08:43:08.778947+0000","last_became_active":"2023-12-22T08:43:08.778568+0000","last_became_peered":"2023-12-22T08:43:08.778568+0000","last_unstale":"2023-12-22T08:43:08.778947+0000","last_undegraded":"2023-12-22T08:43:08.778947+0000","last_fullsized":"2023-12-22T08:43:08.778947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:32:32.129373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"71'8","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772847+0000","last_change":"2023-12-22T08:43:08.233994+0000","last_active":"2023-12-22T08:43:08.772847+0000","last_peered":"2023-12-22T08:43:08.772847+0000","last_clean":"2023-12-22T08:43:08.772847+0000","last_became_active":"2023-12-22T08:43:08.227292+0000","last_became_peered":"2023-12-22T08:43:08.227292+0000","last_unstale":"2023-12-22T08:43:08.772847+0000","last_undegraded":"2023-12-22T08:43:08.772847+0000","last_fullsized":"2023-12-22T08:43:08.772847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:18:18.840612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.759409+0000","last_change":"2023-12-22T08:43:08.759314+0000","last_active":"2023-12-22T08:43:08.759409+0000","last_peered":"2023-12-22T08:43:08.759409+0000","last_clean":"2023-12-22T08:43:08.759409+0000","last_became_active":"2023-12-22T08:43:08.758870+0000","last_became_peered":"2023-12-22T08:43:08.758870+0000","last_unstale":"2023-12-22T08:43:08.759409+0000","last_undegraded":"2023-12-22T08:43:08.759409+0000","last_fullsized":"2023-12-22T08:43:08.759409+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:15.832226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778189+0000","last_change":"2023-12-22T08:43:08.245684+0000","last_active":"2023-12-22T08:43:08.778189+0000","last_peered":"2023-12-22T08:43:08.778189+0000","last_clean":"2023-12-22T08:43:08.778189+0000","last_became_active":"2023-12-22T08:43:08.245434+0000","last_became_peered":"2023-12-22T08:43:08.245434+0000","last_unstale":"2023-12-22T08:43:08.778189+0000","last_undegraded":"2023-12-22T08:43:08.778189+0000","last_fullsized":"2023-12-22T08:43:08.778189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:00:29.623967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.775773+0000","last_change":"2023-12-22T08:43:08.775570+0000","last_active":"2023-12-22T08:43:08.775773+0000","last_peered":"2023-12-22T08:43:08.775773+0000","last_clean":"2023-12-22T08:43:08.775773+0000","last_became_active":"2023-12-22T08:43:08.775017+0000","last_became_peered":"2023-12-22T08:43:08.775017+0000","last_unstale":"2023-12-22T08:43:08.775773+0000","last_undegraded":"2023-12-22T08:43:08.775773+0000","last_fullsized":"2023-12-22T08:43:08.775773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:41.615895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.779090+0000","last_change":"2023-12-22T08:43:08.243395+0000","last_active":"2023-12-22T08:43:08.779090+0000","last_peered":"2023-12-22T08:43:08.779090+0000","last_clean":"2023-12-22T08:43:08.779090+0000","last_became_active":"2023-12-22T08:43:08.242880+0000","last_became_peered":"2023-12-22T08:43:08.242880+0000","last_unstale":"2023-12-22T08:43:08.779090+0000","last_undegraded":"2023-12-22T08:43:08.779090+0000","last_fullsized":"2023-12-22T08:43:08.779090+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:26.160091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.780266+0000","last_change":"2023-12-22T08:43:08.779922+0000","last_active":"2023-12-22T08:43:08.780266+0000","last_peered":"2023-12-22T08:43:08.780266+0000","last_clean":"2023-12-22T08:43:08.780266+0000","last_became_active":"2023-12-22T08:43:08.779234+0000","last_became_peered":"2023-12-22T08:43:08.779234+0000","last_unstale":"2023-12-22T08:43:08.780266+0000","last_undegraded":"2023-12-22T08:43:08.780266+0000","last_fullsized":"2023-12-22T08:43:08.780266+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:45.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"71'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772747+0000","last_change":"2023-12-22T08:43:08.241351+0000","last_active":"2023-12-22T08:43:08.772747+0000","last_peered":"2023-12-22T08:43:08.772747+0000","last_clean":"2023-12-22T08:43:08.772747+0000","last_became_active":"2023-12-22T08:43:08.236119+0000","last_became_peered":"2023-12-22T08:43:08.236119+0000","last_unstale":"2023-12-22T08:43:08.772747+0000","last_undegraded":"2023-12-22T08:43:08.772747+0000","last_fullsized":"2023-12-22T08:43:08.772747+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:24:11.471670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.762969+0000","last_change":"2023-12-22T08:43:08.762279+0000","last_active":"2023-12-22T08:43:08.762969+0000","last_peered":"2023-12-22T08:43:08.762969+0000","last_clean":"2023-12-22T08:43:08.762969+0000","last_became_active":"2023-12-22T08:43:08.760935+0000","last_became_peered":"2023-12-22T08:43:08.760935+0000","last_unstale":"2023-12-22T08:43:08.762969+0000","last_undegraded":"2023-12-22T08:43:08.762969+0000","last_fullsized":"2023-12-22T08:43:08.762969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:23.591214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765888+0000","last_change":"2023-12-22T08:43:08.246777+0000","last_active":"2023-12-22T08:43:08.765888+0000","last_peered":"2023-12-22T08:43:08.765888+0000","last_clean":"2023-12-22T08:43:08.765888+0000","last_became_active":"2023-12-22T08:43:08.246524+0000","last_became_peered":"2023-12-22T08:43:08.246524+0000","last_unstale":"2023-12-22T08:43:08.765888+0000","last_undegraded":"2023-12-22T08:43:08.765888+0000","last_fullsized":"2023-12-22T08:43:08.765888+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:17:52.805378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774730+0000","last_change":"2023-12-22T08:43:08.774162+0000","last_active":"2023-12-22T08:43:08.774730+0000","last_peered":"2023-12-22T08:43:08.774730+0000","last_clean":"2023-12-22T08:43:08.774730+0000","last_became_active":"2023-12-22T08:43:08.771427+0000","last_became_peered":"2023-12-22T08:43:08.771427+0000","last_unstale":"2023-12-22T08:43:08.774730+0000","last_undegraded":"2023-12-22T08:43:08.774730+0000","last_fullsized":"2023-12-22T08:43:08.774730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:53.721528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.778158+0000","last_change":"2023-12-22T08:43:08.240892+0000","last_active":"2023-12-22T08:43:08.778158+0000","last_peered":"2023-12-22T08:43:08.778158+0000","last_clean":"2023-12-22T08:43:08.778158+0000","last_became_active":"2023-12-22T08:43:08.240027+0000","last_became_peered":"2023-12-22T08:43:08.240027+0000","last_unstale":"2023-12-22T08:43:08.778158+0000","last_undegraded":"2023-12-22T08:43:08.778158+0000","last_fullsized":"2023-12-22T08:43:08.778158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:48:14.817249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.776656+0000","last_change":"2023-12-22T08:43:08.776331+0000","last_active":"2023-12-22T08:43:08.776656+0000","last_peered":"2023-12-22T08:43:08.776656+0000","last_clean":"2023-12-22T08:43:08.776656+0000","last_became_active":"2023-12-22T08:43:08.771399+0000","last_became_peered":"2023-12-22T08:43:08.771399+0000","last_unstale":"2023-12-22T08:43:08.776656+0000","last_undegraded":"2023-12-22T08:43:08.776656+0000","last_fullsized":"2023-12-22T08:43:08.776656+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:02:50.159719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.767667+0000","last_change":"2023-12-22T08:43:08.242318+0000","last_active":"2023-12-22T08:43:08.767667+0000","last_peered":"2023-12-22T08:43:08.767667+0000","last_clean":"2023-12-22T08:43:08.767667+0000","last_became_active":"2023-12-22T08:43:08.240707+0000","last_became_peered":"2023-12-22T08:43:08.240707+0000","last_unstale":"2023-12-22T08:43:08.767667+0000","last_undegraded":"2023-12-22T08:43:08.767667+0000","last_fullsized":"2023-12-22T08:43:08.767667+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:37.796898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.772917+0000","last_change":"2023-12-22T08:43:08.770953+0000","last_active":"2023-12-22T08:43:08.772917+0000","last_peered":"2023-12-22T08:43:08.772917+0000","last_clean":"2023-12-22T08:43:08.772917+0000","last_became_active":"2023-12-22T08:43:08.770635+0000","last_became_peered":"2023-12-22T08:43:08.770635+0000","last_unstale":"2023-12-22T08:43:08.772917+0000","last_undegraded":"2023-12-22T08:43:08.772917+0000","last_fullsized":"2023-12-22T08:43:08.772917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:23.653311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747239+0000","last_change":"2023-12-22T08:43:08.245828+0000","last_active":"2023-12-22T08:43:08.747239+0000","last_peered":"2023-12-22T08:43:08.747239+0000","last_clean":"2023-12-22T08:43:08.747239+0000","last_became_active":"2023-12-22T08:43:08.245624+0000","last_became_peered":"2023-12-22T08:43:08.245624+0000","last_unstale":"2023-12-22T08:43:08.747239+0000","last_undegraded":"2023-12-22T08:43:08.747239+0000","last_fullsized":"2023-12-22T08:43:08.747239+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:02:00.232260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.773984+0000","last_change":"2023-12-22T08:43:08.773913+0000","last_active":"2023-12-22T08:43:08.773984+0000","last_peered":"2023-12-22T08:43:08.773984+0000","last_clean":"2023-12-22T08:43:08.773984+0000","last_became_active":"2023-12-22T08:43:08.773342+0000","last_became_peered":"2023-12-22T08:43:08.773342+0000","last_unstale":"2023-12-22T08:43:08.773984+0000","last_undegraded":"2023-12-22T08:43:08.773984+0000","last_fullsized":"2023-12-22T08:43:08.773984+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:03:49.616345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"71'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.781950+0000","last_change":"2023-12-22T08:43:08.243237+0000","last_active":"2023-12-22T08:43:08.781950+0000","last_peered":"2023-12-22T08:43:08.781950+0000","last_clean":"2023-12-22T08:43:08.781950+0000","last_became_active":"2023-12-22T08:43:08.242927+0000","last_became_peered":"2023-12-22T08:43:08.242927+0000","last_unstale":"2023-12-22T08:43:08.781950+0000","last_undegraded":"2023-12-22T08:43:08.781950+0000","last_fullsized":"2023-12-22T08:43:08.781950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:13:29.194561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.759826+0000","last_change":"2023-12-22T08:43:08.759746+0000","last_active":"2023-12-22T08:43:08.759826+0000","last_peered":"2023-12-22T08:43:08.759826+0000","last_clean":"2023-12-22T08:43:08.759826+0000","last_became_active":"2023-12-22T08:43:08.759482+0000","last_became_peered":"2023-12-22T08:43:08.759482+0000","last_unstale":"2023-12-22T08:43:08.759826+0000","last_undegraded":"2023-12-22T08:43:08.759826+0000","last_fullsized":"2023-12-22T08:43:08.759826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:46:27.175068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"72'1","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-22T08:43:10.054566+0000","last_change":"2023-12-22T08:43:08.245846+0000","last_active":"2023-12-22T08:43:10.054566+0000","last_peered":"2023-12-22T08:43:10.054566+0000","last_clean":"2023-12-22T08:43:10.054566+0000","last_became_active":"2023-12-22T08:43:08.245404+0000","last_became_peered":"2023-12-22T08:43:08.245404+0000","last_unstale":"2023-12-22T08:43:10.054566+0000","last_undegraded":"2023-12-22T08:43:10.054566+0000","last_fullsized":"2023-12-22T08:43:10.054566+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:27:48.289169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.777551+0000","last_change":"2023-12-22T08:43:08.777481+0000","last_active":"2023-12-22T08:43:08.777551+0000","last_peered":"2023-12-22T08:43:08.777551+0000","last_clean":"2023-12-22T08:43:08.777551+0000","last_became_active":"2023-12-22T08:43:08.777206+0000","last_became_peered":"2023-12-22T08:43:08.777206+0000","last_unstale":"2023-12-22T08:43:08.777551+0000","last_undegraded":"2023-12-22T08:43:08.777551+0000","last_fullsized":"2023-12-22T08:43:08.777551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:32.067700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747622+0000","last_change":"2023-12-22T08:43:08.238015+0000","last_active":"2023-12-22T08:43:08.747622+0000","last_peered":"2023-12-22T08:43:08.747622+0000","last_clean":"2023-12-22T08:43:08.747622+0000","last_became_active":"2023-12-22T08:43:08.237691+0000","last_became_peered":"2023-12-22T08:43:08.237691+0000","last_unstale":"2023-12-22T08:43:08.747622+0000","last_undegraded":"2023-12-22T08:43:08.747622+0000","last_fullsized":"2023-12-22T08:43:08.747622+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:13:35.064619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.769045+0000","last_change":"2023-12-22T08:43:08.768873+0000","last_active":"2023-12-22T08:43:08.769045+0000","last_peered":"2023-12-22T08:43:08.769045+0000","last_clean":"2023-12-22T08:43:08.769045+0000","last_became_active":"2023-12-22T08:43:08.768418+0000","last_became_peered":"2023-12-22T08:43:08.768418+0000","last_unstale":"2023-12-22T08:43:08.769045+0000","last_undegraded":"2023-12-22T08:43:08.769045+0000","last_fullsized":"2023-12-22T08:43:08.769045+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:58:50.953097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.754103+0000","last_change":"2023-12-22T08:43:08.228782+0000","last_active":"2023-12-22T08:43:08.754103+0000","last_peered":"2023-12-22T08:43:08.754103+0000","last_clean":"2023-12-22T08:43:08.754103+0000","last_became_active":"2023-12-22T08:43:08.228538+0000","last_became_peered":"2023-12-22T08:43:08.228538+0000","last_unstale":"2023-12-22T08:43:08.754103+0000","last_undegraded":"2023-12-22T08:43:08.754103+0000","last_fullsized":"2023-12-22T08:43:08.754103+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:15:44.413577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.765472+0000","last_change":"2023-12-22T08:43:08.765243+0000","last_active":"2023-12-22T08:43:08.765472+0000","last_peered":"2023-12-22T08:43:08.765472+0000","last_clean":"2023-12-22T08:43:08.765472+0000","last_became_active":"2023-12-22T08:43:08.764495+0000","last_became_peered":"2023-12-22T08:43:08.764495+0000","last_unstale":"2023-12-22T08:43:08.765472+0000","last_undegraded":"2023-12-22T08:43:08.765472+0000","last_fullsized":"2023-12-22T08:43:08.765472+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:52.037553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.774052+0000","last_change":"2023-12-22T08:43:08.246580+0000","last_active":"2023-12-22T08:43:08.774052+0000","last_peered":"2023-12-22T08:43:08.774052+0000","last_clean":"2023-12-22T08:43:08.774052+0000","last_became_active":"2023-12-22T08:43:08.246138+0000","last_became_peered":"2023-12-22T08:43:08.246138+0000","last_unstale":"2023-12-22T08:43:08.774052+0000","last_undegraded":"2023-12-22T08:43:08.774052+0000","last_fullsized":"2023-12-22T08:43:08.774052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:54:55.545904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.769795+0000","last_change":"2023-12-22T08:43:08.769599+0000","last_active":"2023-12-22T08:43:08.769795+0000","last_peered":"2023-12-22T08:43:08.769795+0000","last_clean":"2023-12-22T08:43:08.769795+0000","last_became_active":"2023-12-22T08:43:08.769363+0000","last_became_peered":"2023-12-22T08:43:08.769363+0000","last_unstale":"2023-12-22T08:43:08.769795+0000","last_undegraded":"2023-12-22T08:43:08.769795+0000","last_fullsized":"2023-12-22T08:43:08.769795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:19.778557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.757872+0000","last_change":"2023-12-22T08:43:08.235236+0000","last_active":"2023-12-22T08:43:08.757872+0000","last_peered":"2023-12-22T08:43:08.757872+0000","last_clean":"2023-12-22T08:43:08.757872+0000","last_became_active":"2023-12-22T08:43:08.234988+0000","last_became_peered":"2023-12-22T08:43:08.234988+0000","last_unstale":"2023-12-22T08:43:08.757872+0000","last_undegraded":"2023-12-22T08:43:08.757872+0000","last_fullsized":"2023-12-22T08:43:08.757872+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:04.865483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.769027+0000","last_change":"2023-12-22T08:43:08.768678+0000","last_active":"2023-12-22T08:43:08.769027+0000","last_peered":"2023-12-22T08:43:08.769027+0000","last_clean":"2023-12-22T08:43:08.769027+0000","last_became_active":"2023-12-22T08:43:08.768174+0000","last_became_peered":"2023-12-22T08:43:08.768174+0000","last_unstale":"2023-12-22T08:43:08.769027+0000","last_undegraded":"2023-12-22T08:43:08.769027+0000","last_fullsized":"2023-12-22T08:43:08.769027+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:10:28.675275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.751188+0000","last_change":"2023-12-22T08:43:08.245686+0000","last_active":"2023-12-22T08:43:08.751188+0000","last_peered":"2023-12-22T08:43:08.751188+0000","last_clean":"2023-12-22T08:43:08.751188+0000","last_became_active":"2023-12-22T08:43:08.245056+0000","last_became_peered":"2023-12-22T08:43:08.245056+0000","last_unstale":"2023-12-22T08:43:08.751188+0000","last_undegraded":"2023-12-22T08:43:08.751188+0000","last_fullsized":"2023-12-22T08:43:08.751188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:52:56.482108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.782588+0000","last_change":"2023-12-22T08:43:08.782519+0000","last_active":"2023-12-22T08:43:08.782588+0000","last_peered":"2023-12-22T08:43:08.782588+0000","last_clean":"2023-12-22T08:43:08.782588+0000","last_became_active":"2023-12-22T08:43:08.782288+0000","last_became_peered":"2023-12-22T08:43:08.782288+0000","last_unstale":"2023-12-22T08:43:08.782588+0000","last_undegraded":"2023-12-22T08:43:08.782588+0000","last_fullsized":"2023-12-22T08:43:08.782588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:05.880460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.767765+0000","last_change":"2023-12-22T08:43:08.242877+0000","last_active":"2023-12-22T08:43:08.767765+0000","last_peered":"2023-12-22T08:43:08.767765+0000","last_clean":"2023-12-22T08:43:08.767765+0000","last_became_active":"2023-12-22T08:43:08.241588+0000","last_became_peered":"2023-12-22T08:43:08.241588+0000","last_unstale":"2023-12-22T08:43:08.767765+0000","last_undegraded":"2023-12-22T08:43:08.767765+0000","last_fullsized":"2023-12-22T08:43:08.767765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:18.763580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.777718+0000","last_change":"2023-12-22T08:43:08.776165+0000","last_active":"2023-12-22T08:43:08.777718+0000","last_peered":"2023-12-22T08:43:08.777718+0000","last_clean":"2023-12-22T08:43:08.777718+0000","last_became_active":"2023-12-22T08:43:08.775908+0000","last_became_peered":"2023-12-22T08:43:08.775908+0000","last_unstale":"2023-12-22T08:43:08.777718+0000","last_undegraded":"2023-12-22T08:43:08.777718+0000","last_fullsized":"2023-12-22T08:43:08.777718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:08.197667+0000","last_clean_scrub_stamp":"2023-12-22T08:43:08.197667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:28.745926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.757931+0000","last_change":"2023-12-22T08:43:08.236569+0000","last_active":"2023-12-22T08:43:08.757931+0000","last_peered":"2023-12-22T08:43:08.757931+0000","last_clean":"2023-12-22T08:43:08.757931+0000","last_became_active":"2023-12-22T08:43:08.236102+0000","last_became_peered":"2023-12-22T08:43:08.236102+0000","last_unstale":"2023-12-22T08:43:08.757931+0000","last_undegraded":"2023-12-22T08:43:08.757931+0000","last_fullsized":"2023-12-22T08:43:08.757931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:43:07.182690+0000","last_clean_scrub_stamp":"2023-12-22T08:43:07.182690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:31.052723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":209,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-22T08:43:08.747702+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:43:08.747702+0000","last_peered":"2023-12-22T08:43:08.747702+0000","last_clean":"2023-12-22T08:43:08.747702+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:43:08.747702+0000","last_undegraded":"2023-12-22T08:43:08.747702+0000","last_fullsized":"2023-12-22T08:43:08.747702+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194946,"statfs":{"total":200000000,"available":199625170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0780000000000001,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.075,"15min":1.0589999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.85899999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.173,"15min":1.1579999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.2},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.1619999999999999,"15min":1.1319999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.173}]},{"osd":2,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.0860000000000001,"15min":1.056},"min":{"1min":0.78600000000000003,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.226,"5min":1.2310000000000001,"15min":1.23},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.742,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.82399999999999995}]},{"osd":3,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.1240000000000001,"15min":1.0900000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.292,"15min":1.2769999999999999},"min":{"1min":0.80500000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.952,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1899999999999999,"15min":1.194},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.764,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.266,"5min":1.268,"15min":1.2629999999999999},"min":{"1min":0.64100000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.137}]},{"osd":5,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.371,"15min":1.367},"min":{"1min":0.74299999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.8120000000000001,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.099},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3660000000000001,"15min":1.3700000000000001},"min":{"1min":0.76300000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.645,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.2729999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4870000000000001,"15min":1.4850000000000001},"min":{"1min":0.83499999999999996,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.1259999999999999,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.383},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4870000000000001,"15min":1.484},"min":{"1min":0.82299999999999995,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.55}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":365,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194946,"statfs":{"total":200000000,"available":199625240,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1140000000000001,"15min":1.1299999999999999},"min":{"1min":0.80500000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9350000000000001,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.171,"5min":1.0820000000000001,"15min":1.081},"min":{"1min":0.77500000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.91800000000000004}]},{"osd":1,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0389999999999999,"15min":1.0189999999999999},"min":{"1min":0.79000000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.448,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.349,"5min":1.1919999999999999,"15min":1.171},"min":{"1min":1.0129999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.76200000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2529999999999999,"15min":1.272},"min":{"1min":0.82799999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7969999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.1739999999999999,"15min":1.147},"min":{"1min":0.81599999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.3240000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.3160000000000001,"15min":1.298},"min":{"1min":0.94099999999999995,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.738,"5min":1.847,"15min":1.847},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.248,"15min":1.2330000000000001},"min":{"1min":0.96799999999999997,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.645,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.96699999999999997}]},{"osd":4,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.403,"15min":1.411},"min":{"1min":1.0169999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.9139999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.123},{"interface":"front","average":{"1min":1.508,"5min":1.417,"15min":1.4079999999999999},"min":{"1min":1.21,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.581}]},{"osd":5,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.361,"15min":1.3640000000000001},"min":{"1min":0.92100000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.5740000000000001,"15min":1.599},"min":{"1min":1.0960000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.1030000000000002,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.2130000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:42:53 2023","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.5900000000000001,"15min":1.5940000000000001},"min":{"1min":1.159,"5min":1.159,"15min":1.159},"max":{"1min":1.9790000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.538,"5min":1.5449999999999999,"15min":1.5589999999999999},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":1.964,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.24}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":941,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194370,"statfs":{"total":200000000,"available":199035879,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.0740000000000001,"15min":1.075},"min":{"1min":0.72999999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.637,"5min":1.944,"15min":1.944},"last":1.304},{"interface":"front","average":{"1min":1.079,"5min":1.123,"15min":1.135},"min":{"1min":0.68899999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.514,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.383}]},{"osd":1,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.093,"15min":1.1080000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.409,"5min":2.79,"15min":2.79},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.0289999999999999,"15min":1.012},"min":{"1min":0.78200000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.266}]},{"osd":2,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.119,"15min":1.1220000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.456,"5min":1.72,"15min":1.72},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.163,"15min":1.159},"min":{"1min":0.78200000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5489999999999999,"5min":1.978,"15min":1.978},"last":1.131}]},{"osd":3,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1619999999999999,"15min":1.1559999999999999},"min":{"1min":0.83399999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.506,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.226,"15min":1.2310000000000001},"min":{"1min":1.0329999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5800000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1679999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.24,"15min":1.246},"min":{"1min":0.95499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7070000000000001,"5min":1.853,"15min":1.853},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.159,"5min":1.2430000000000001,"15min":1.2490000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.94599999999999995}]},{"osd":6,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3069999999999999,"15min":1.3089999999999999},"min":{"1min":0.88100000000000001,"5min":0.749,"15min":0.749},"max":{"1min":1.581,"5min":1.821,"15min":1.821},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.4199999999999999,"15min":1.4259999999999999},"min":{"1min":0.89900000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.7529999999999999,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":0.999}]},{"osd":7,"last update":"Fri Dec 22 08:42:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3580000000000001,"15min":1.3620000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6359999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.411,"5min":1.5409999999999999,"15min":1.575},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.788,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":1.339}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194945,"statfs":{"total":200000000,"available":199624646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.99299999999999999,"15min":1.002},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5309999999999999,"5min":1.552,"15min":1.552},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.097,"15min":1.091},"min":{"1min":0.72499999999999998,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6100000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.0149999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.042,"15min":1.0289999999999999},"min":{"1min":0.72399999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6279999999999999,"5min":1.669,"15min":1.669},"last":1.365},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0900000000000001,"15min":1.1020000000000001},"min":{"1min":0.70499999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.794,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.92900000000000005}]},{"osd":2,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1379999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5009999999999999,"5min":1.625,"15min":1.625},"last":1.119},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1850000000000001,"15min":1.1890000000000001},"min":{"1min":0.92200000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.5640000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.0660000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2090000000000001,"15min":1.1950000000000001},"min":{"1min":0.93700000000000006,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.5049999999999999,"5min":1.774,"15min":1.774},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.222,"15min":1.194},"min":{"1min":1.012,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.5029999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1579999999999999,"15min":1.1299999999999999},"min":{"1min":1.016,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.401,"5min":1.3819999999999999,"15min":1.3700000000000001},"min":{"1min":1.0800000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7050000000000001,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.454}]},{"osd":6,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.248,"15min":1.226},"min":{"1min":1.0469999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.621,"5min":1.798,"15min":1.798},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.2130000000000001,"15min":1.181},"min":{"1min":1.0049999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.1679999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:42:54 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.367,"15min":1.323},"min":{"1min":0.97799999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.8879999999999999,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.4259999999999999,"15min":1.4019999999999999},"min":{"1min":1.2470000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.9199999999999999,"5min":1.923,"15min":1.923},"last":1.651}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":366,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194946,"statfs":{"total":200000000,"available":199625172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.93899999999999995,"15min":0.96799999999999997},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90900000000000003,"15min":0.92900000000000005},"min":{"1min":0.5,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.81499999999999995}]},{"osd":1,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.85299999999999998,"15min":0.85699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.1020000000000001,"15min":1.1080000000000001},"min":{"1min":0.63100000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.2809999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.024,"15min":1.032},"min":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.591,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.137,"15min":1.125},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":0.96799999999999997}]},{"osd":4,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.202,"15min":1.198},"min":{"1min":0.89900000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.016,"5min":2.016,"15min":2.016},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.2350000000000001,"15min":1.222},"min":{"1min":0.77300000000000002,"5min":0.745,"15min":0.745},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.6870000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.2769999999999999,"15min":1.262},"min":{"1min":0.84599999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.413,"15min":1.4430000000000001},"min":{"1min":0.96999999999999997,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.101}]},{"osd":6,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.4330000000000001,"15min":1.4419999999999999},"min":{"1min":0.93000000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.516},{"interface":"front","average":{"1min":1.454,"5min":1.3779999999999999,"15min":1.3859999999999999},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.6459999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.361,"15min":1.365},"min":{"1min":0.85599999999999998,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":1.55},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.393,"15min":1.387},"min":{"1min":0.97399999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.9550000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":367,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194944,"statfs":{"total":200000000,"available":199623538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":0.83699999999999997,"15min":0.74099999999999999},"min":{"1min":0.56299999999999994,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.8879999999999999,"5min":6.8879999999999999,"15min":6.8879999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.246,"5min":0.97799999999999998,"15min":0.95099999999999996},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":4.5510000000000002,"5min":4.5510000000000002,"15min":4.5510000000000002},"last":1.167}]},{"osd":1,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.042,"15min":0.94499999999999995},"min":{"1min":0.59699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":11.308999999999999,"5min":11.308999999999999,"15min":11.308999999999999},"last":1.099},{"interface":"front","average":{"1min":1.149,"5min":0.95199999999999996,"15min":0.90600000000000003},"min":{"1min":0.70099999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.98199999999999998}]},{"osd":3,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":1.163,"15min":1.0229999999999999},"min":{"1min":0.55400000000000005,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":13.087999999999999,"5min":13.087999999999999,"15min":13.087999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.232,"15min":1.0740000000000001},"min":{"1min":0.79200000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":12.289999999999999,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.2270000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.2749999999999999,"15min":1.22},"min":{"1min":1.048,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":2.1030000000000002,"5min":1.464,"15min":1.377},"min":{"1min":0.76500000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":13.927,"5min":13.927,"15min":13.927},"last":1.02}]},{"osd":5,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.9199999999999999,"5min":1.4530000000000001,"15min":1.393},"min":{"1min":0.72399999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":11.003,"5min":11.003,"15min":11.003},"last":1.4199999999999999},{"interface":"front","average":{"1min":2.0960000000000001,"5min":1.389,"15min":1.2629999999999999},"min":{"1min":0.90800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":13.129,"5min":13.129,"15min":13.129},"last":1.45}]},{"osd":6,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.3480000000000001,"15min":1.256},"min":{"1min":0.77200000000000002,"5min":0.751,"15min":0.751},"max":{"1min":8.1609999999999996,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.4199999999999999,"15min":1.3500000000000001},"min":{"1min":0.873,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":6.8150000000000004,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":1.335}]},{"osd":7,"last update":"Fri Dec 22 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":2.0179999999999998,"5min":1.4870000000000001,"15min":1.393},"min":{"1min":0.85499999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":10.948,"5min":10.948,"15min":10.948},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.8799999999999999,"5min":1.4219999999999999,"15min":1.3300000000000001},"min":{"1min":1.0820000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":8.0980000000000008,"5min":8.0980000000000008,"15min":8.0980000000000008},"last":1.375}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":943,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194369,"statfs":{"total":200000000,"available":199034312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.88700000000000001,"15min":0.89500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.339,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.01,"15min":1.0049999999999999},"min":{"1min":0.625,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.399,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.1100000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.284,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.93999999999999995,"15min":0.93899999999999995},"min":{"1min":0.60599999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.417,"5min":2.254,"15min":2.254},"last":1.2050000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.155,"15min":1.1519999999999999},"min":{"1min":0.68799999999999994,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.673,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.4710000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93500000000000005,"15min":0.95499999999999996},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.401}]},{"osd":4,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.244,"15min":1.264},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.8049999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.329,"15min":1.3109999999999999},"min":{"1min":0.876,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.962,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.3640000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.93300000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.3560000000000001,"15min":1.3300000000000001},"min":{"1min":0.88200000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.415}]},{"osd":6,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2430000000000001,"15min":1.2410000000000001},"min":{"1min":0.81100000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.25},{"interface":"front","average":{"1min":1.359,"5min":1.347,"15min":1.353},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.9730000000000001,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.554}]},{"osd":7,"last update":"Fri Dec 22 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.367,"15min":1.343},"min":{"1min":1.0269999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0369999999999999,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.367,"15min":1.395},"min":{"1min":0.86599999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.3079999999999998,"5min":3.2959999999999998,"15min":3.2959999999999998},"last":1.45}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":367,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194945,"statfs":{"total":200000000,"available":199623698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.73299999999999998,"15min":0.71699999999999997},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.88500000000000001,"15min":0.89300000000000002},"min":{"1min":0.53800000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.4259999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.79000000000000004,"15min":0.78200000000000003},"min":{"1min":0.442,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.93400000000000005,"15min":0.91900000000000004},"min":{"1min":0.45900000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.1559999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0149999999999999,"15min":1.0029999999999999},"min":{"1min":0.58499999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.744,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.071,"15min":1.0349999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.091}]},{"osd":4,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.27,"15min":1.2569999999999999},"min":{"1min":1.024,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.671,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.2270000000000001,"15min":1.1990000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.651,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.4910000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.242,"15min":1.24},"min":{"1min":0.80600000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.298},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.258,"15min":1.2509999999999999},"min":{"1min":0.90600000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.839,"5min":1.885,"15min":1.885},"last":1.383}]},{"osd":6,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.288,"15min":1.268},"min":{"1min":0.78600000000000003,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.367,"15min":1.373},"min":{"1min":1.008,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.0649999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.5780000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:42:59 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.3400000000000001,"15min":1.3480000000000001},"min":{"1min":0.97099999999999997,"5min":0.755,"15min":0.755},"max":{"1min":1.768,"5min":1.79,"15min":1.79},"last":1.351},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3700000000000001,"15min":1.3640000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.9510000000000001,"5min":2.214,"15min":2.214},"last":1.1160000000000001}]}]}],"pool_statfs":[]}} 2023-12-22T08:43:19.295 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T08:43:19.295 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T08:43:19.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.579+0000 7fdfe0173640 1 Processor -- start 2023-12-22T08:43:19.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.579+0000 7fdfe0173640 1 -- start start 2023-12-22T08:43:19.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.581+0000 7fdfe0173640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfd815b2f0 0x7fdfd8071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:19.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.581+0000 7fdfe0173640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd8070770 con 0x7fdfd80b3600 2023-12-22T08:43:19.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.581+0000 7fdfe0173640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd80709c0 con 0x7fdfd80b4340 2023-12-22T08:43:19.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.581+0000 7fdfe0173640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd8071360 con 0x7fdfd815b2f0 2023-12-22T08:43:19.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.582+0000 7fdfde710640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdfd80b3600 0x7fdfd815b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34756/0 (socket says 172.21.15.38:34756) 2023-12-22T08:43:19.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.582+0000 7fdfde710640 1 -- 172.21.15.38:0/883000177 learned_addr learned my addr 172.21.15.38:0/883000177 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:43:19.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.582+0000 7fdfddf0f640 1 --2- 172.21.15.38:0/883000177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfd815b2f0 0x7fdfd8071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:19.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.583+0000 7fdfdcf0d640 1 -- 172.21.15.38:0/883000177 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080794796 0 0) 0x7fdfd8070770 con 0x7fdfd80b3600 2023-12-22T08:43:19.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.583+0000 7fdfdcf0d640 1 -- 172.21.15.38:0/883000177 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc4003520 con 0x7fdfd80b3600 2023-12-22T08:43:19.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.583+0000 7fdfddf0f640 1 -- 172.21.15.38:0/883000177 >> v1:172.21.15.89:6789/0 conn(0x7fdfd80b4340 legacy=0x7fdfd80cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:19.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.583+0000 7fdfdcf0d640 1 -- 172.21.15.38:0/883000177 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789084355 0 0) 0x7fdfd80709c0 con 0x7fdfd80b4340 2023-12-22T08:43:19.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.583+0000 7fdfddf0f640 1 -- 172.21.15.38:0/883000177 >> v1:172.21.15.38:6789/0 conn(0x7fdfd80b3600 legacy=0x7fdfd815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:19.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.583+0000 7fdfddf0f640 1 -- 172.21.15.38:0/883000177 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd8070ca0 con 0x7fdfd815b2f0 2023-12-22T08:43:19.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.584+0000 7fdfddf0f640 1 --2- 172.21.15.38:0/883000177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfd815b2f0 0x7fdfd8071780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009dc0 tx=0x7fdfd402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d264fb567dd152ce server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:19.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.585+0000 7fdfdcf0d640 1 -- 172.21.15.38:0/883000177 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd402cc40 con 0x7fdfd815b2f0 2023-12-22T08:43:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.585+0000 7fdfdcf0d640 1 -- 172.21.15.38:0/883000177 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd402cda0 con 0x7fdfd815b2f0 2023-12-22T08:43:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.585+0000 7fdfdcf0d640 1 -- 172.21.15.38:0/883000177 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4034660 con 0x7fdfd815b2f0 2023-12-22T08:43:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.585+0000 7fdfe0173640 1 -- 172.21.15.38:0/883000177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfd815b2f0 msgr2=0x7fdfd8071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:19.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.585+0000 7fdfe0173640 1 --2- 172.21.15.38:0/883000177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfd815b2f0 0x7fdfd8071780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009dc0 tx=0x7fdfd402be90 comp rx=0 tx=0).stop 2023-12-22T08:43:19.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.585+0000 7fdfe0173640 1 -- 172.21.15.38:0/883000177 shutdown_connections 2023-12-22T08:43:19.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.585+0000 7fdfe0173640 1 --2- 172.21.15.38:0/883000177 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfd815b2f0 0x7fdfd8071780 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.585+0000 7fdfe0173640 1 -- 172.21.15.38:0/883000177 >> 172.21.15.38:0/883000177 conn(0x7fdfd806f880 msgr2=0x7fdfd80b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:19.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.586+0000 7fdfe0173640 1 -- 172.21.15.38:0/883000177 shutdown_connections 2023-12-22T08:43:19.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.586+0000 7fdfe0173640 1 -- 172.21.15.38:0/883000177 wait complete. 2023-12-22T08:43:19.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.587+0000 7fdfe0173640 1 Processor -- start 2023-12-22T08:43:19.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.588+0000 7fdfe0173640 1 -- start start 2023-12-22T08:43:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.588+0000 7fdfe0173640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfd80b3600 0x7fdfd806c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.588+0000 7fdfe0173640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfd80b4340 0x7fdfd8151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfe0173640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfd8141960 0x7fdfd8141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfe0173640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd8142330 con 0x7fdfd8141960 2023-12-22T08:43:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfe0173640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd806c780 con 0x7fdfd80b4340 2023-12-22T08:43:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfe0173640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd81f2e90 con 0x7fdfd80b3600 2023-12-22T08:43:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfde710640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfd8141960 0x7fdfd8141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfde710640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfd8141960 0x7fdfd8141df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33990/0 (socket says 172.21.15.38:33990) 2023-12-22T08:43:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfde710640 1 -- 172.21.15.38:0/1469529819 learned_addr learned my addr 172.21.15.38:0/1469529819 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfdd70e640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfd80b4340 0x7fdfd8151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfddf0f640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfd80b3600 0x7fdfd806c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfde710640 1 -- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfd80b3600 msgr2=0x7fdfd806c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfde710640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfd80b3600 0x7fdfd806c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfde710640 1 -- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfd80b4340 msgr2=0x7fdfd8151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfde710640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfd80b4340 0x7fdfd8151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.589+0000 7fdfde710640 1 -- 172.21.15.38:0/1469529819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd4009a70 con 0x7fdfd8141960 2023-12-22T08:43:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.590+0000 7fdfde710640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfd8141960 0x7fdfd8141df0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000c430 tx=0x7fdfd000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.590+0000 7fdfce7fc640 1 -- 172.21.15.38:0/1469529819 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0005ce0 con 0x7fdfd8141960 2023-12-22T08:43:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.590+0000 7fdfce7fc640 1 -- 172.21.15.38:0/1469529819 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd0005e40 con 0x7fdfd8141960 2023-12-22T08:43:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.590+0000 7fdfce7fc640 1 -- 172.21.15.38:0/1469529819 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00072f0 con 0x7fdfd8141960 2023-12-22T08:43:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.590+0000 7fdfe0173640 1 -- 172.21.15.38:0/1469529819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd81f3170 con 0x7fdfd8141960 2023-12-22T08:43:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.590+0000 7fdfe0173640 1 -- 172.21.15.38:0/1469529819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd81f3730 con 0x7fdfd8141960 2023-12-22T08:43:19.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.592+0000 7fdfe0173640 1 -- 172.21.15.38:0/1469529819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd8061910 con 0x7fdfd8141960 2023-12-22T08:43:19.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.593+0000 7fdfce7fc640 1 -- 172.21.15.38:0/1469529819 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdfd0007450 con 0x7fdfd8141960 2023-12-22T08:43:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.594+0000 7fdfce7fc640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdfbc06a430 0x7fdfbc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.594+0000 7fdfce7fc640 1 -- 172.21.15.38:0/1469529819 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfd0087f20 con 0x7fdfd8141960 2023-12-22T08:43:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.595+0000 7fdfddf0f640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdfbc06a430 0x7fdfbc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:19.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.596+0000 7fdfddf0f640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdfbc06a430 0x7fdfbc06c8f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4036000 tx=0x7fdfd4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:19.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.599+0000 7fdfce7fc640 1 -- 172.21.15.38:0/1469529819 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdfd0053510 con 0x7fdfd8141960 2023-12-22T08:43:19.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.868+0000 7fdfe0173640 1 -- 172.21.15.38:0/1469529819 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fdfd81e5040 con 0x7fdfd8141960 2023-12-22T08:43:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.877+0000 7fdfce7fc640 1 -- 172.21.15.38:0/1469529819 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7fdfd00170e0 con 0x7fdfd8141960 2023-12-22T08:43:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.0 2023-12-22T08:43:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.880+0000 7fdfe0173640 1 -- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdfbc06a430 msgr2=0x7fdfbc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.880+0000 7fdfe0173640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdfbc06a430 0x7fdfbc06c8f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4036000 tx=0x7fdfd4030000 comp rx=0 tx=0).stop 2023-12-22T08:43:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.880+0000 7fdfe0173640 1 -- 172.21.15.38:0/1469529819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfd8141960 msgr2=0x7fdfd8141df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.880+0000 7fdfe0173640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfd8141960 0x7fdfd8141df0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000c430 tx=0x7fdfd000c8f0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.880+0000 7fdfe0173640 1 -- 172.21.15.38:0/1469529819 shutdown_connections 2023-12-22T08:43:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.880+0000 7fdfe0173640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdfbc06a430 0x7fdfbc06c8f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.880+0000 7fdfe0173640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfd8141960 0x7fdfd8141df0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.880+0000 7fdfe0173640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfd80b4340 0x7fdfd8151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.880+0000 7fdfe0173640 1 --2- 172.21.15.38:0/1469529819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdfd80b3600 0x7fdfd806c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.880+0000 7fdfe0173640 1 -- 172.21.15.38:0/1469529819 >> 172.21.15.38:0/1469529819 conn(0x7fdfd806f880 msgr2=0x7fdfd80ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.880+0000 7fdfe0173640 1 -- 172.21.15.38:0/1469529819 shutdown_connections 2023-12-22T08:43:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:19.880+0000 7fdfe0173640 1 -- 172.21.15.38:0/1469529819 wait complete. 2023-12-22T08:43:19.899 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:43:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.104+0000 7f3cae7b5640 1 Processor -- start 2023-12-22T08:43:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.104+0000 7f3cae7b5640 1 -- start start 2023-12-22T08:43:20.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.106+0000 7f3cae7b5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ca80b3ff0 0x7f3ca806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:20.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.106+0000 7f3cae7b5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca815f220 con 0x7f3ca8157980 2023-12-22T08:43:20.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.106+0000 7f3cae7b5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca80d1520 con 0x7f3ca80b44a0 2023-12-22T08:43:20.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.106+0000 7f3cae7b5640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca80d1800 con 0x7f3ca80b3ff0 2023-12-22T08:43:20.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.106+0000 7f3cacfb2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ca80b3ff0 0x7f3ca806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:20.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.106+0000 7f3cacfb2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ca80b3ff0 0x7f3ca806cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33996/0 (socket says 172.21.15.38:33996) 2023-12-22T08:43:20.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.106+0000 7f3cacfb2640 1 -- 172.21.15.38:0/3527123723 learned_addr learned my addr 172.21.15.38:0/3527123723 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:20.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.107+0000 7f3cacfb2640 1 -- 172.21.15.38:0/3527123723 >> v1:172.21.15.89:6789/0 conn(0x7f3ca80b44a0 legacy=0x7f3ca80d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:20.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.107+0000 7f3cacfb2640 1 -- 172.21.15.38:0/3527123723 >> v1:172.21.15.38:6789/0 conn(0x7f3ca8157980 legacy=0x7f3ca815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:20.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.107+0000 7f3cacfb2640 1 -- 172.21.15.38:0/3527123723 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca80d1ae0 con 0x7f3ca80b3ff0 2023-12-22T08:43:20.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.107+0000 7f3c9ffff640 1 -- 172.21.15.38:0/3527123723 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330596882 0 0) 0x7f3ca815f220 con 0x7f3ca8157980 2023-12-22T08:43:20.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.108+0000 7f3cacfb2640 1 --2- 172.21.15.38:0/3527123723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ca80b3ff0 0x7f3ca806cf30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009870 tx=0x7f3c9802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab135caa5c06c575 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:20.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.108+0000 7f3c9ffff640 1 -- 172.21.15.38:0/3527123723 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98030860 con 0x7f3ca80b3ff0 2023-12-22T08:43:20.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.108+0000 7f3c9ffff640 1 -- 172.21.15.38:0/3527123723 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c980309c0 con 0x7f3ca80b3ff0 2023-12-22T08:43:20.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.108+0000 7f3c9ffff640 1 -- 172.21.15.38:0/3527123723 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98030d50 con 0x7f3ca80b3ff0 2023-12-22T08:43:20.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.109+0000 7f3cae7b5640 1 -- 172.21.15.38:0/3527123723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ca80b3ff0 msgr2=0x7f3ca806cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:20.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.109+0000 7f3cae7b5640 1 --2- 172.21.15.38:0/3527123723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ca80b3ff0 0x7f3ca806cf30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009870 tx=0x7f3c9802b9a0 comp rx=0 tx=0).stop 2023-12-22T08:43:20.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.109+0000 7f3cae7b5640 1 -- 172.21.15.38:0/3527123723 shutdown_connections 2023-12-22T08:43:20.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.109+0000 7f3cae7b5640 1 --2- 172.21.15.38:0/3527123723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ca80b3ff0 0x7f3ca806cf30 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:20.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.109+0000 7f3cae7b5640 1 -- 172.21.15.38:0/3527123723 >> 172.21.15.38:0/3527123723 conn(0x7f3ca80d31f0 msgr2=0x7f3ca80d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:20.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.109+0000 7f3cae7b5640 1 -- 172.21.15.38:0/3527123723 shutdown_connections 2023-12-22T08:43:20.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.109+0000 7f3cae7b5640 1 -- 172.21.15.38:0/3527123723 wait complete. 2023-12-22T08:43:20.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.111+0000 7f3cae7b5640 1 Processor -- start 2023-12-22T08:43:20.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.111+0000 7f3cae7b5640 1 -- start start 2023-12-22T08:43:20.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cae7b5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ca80b3ff0 0x7f3ca81519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:20.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cae7b5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ca80b44a0 0x7f3ca8155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:20.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cae7b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ca8157980 0x7f3ca8156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:20.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cae7b5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8152240 con 0x7f3ca80b44a0 2023-12-22T08:43:20.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cae7b5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8152520 con 0x7f3ca8157980 2023-12-22T08:43:20.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cae7b5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8152800 con 0x7f3ca80b3ff0 2023-12-22T08:43:20.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cacfb2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ca80b44a0 0x7f3ca8155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:20.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cacfb2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ca80b44a0 0x7f3ca8155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34006/0 (socket says 172.21.15.38:34006) 2023-12-22T08:43:20.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cacfb2640 1 -- 172.21.15.38:0/1204063201 learned_addr learned my addr 172.21.15.38:0/1204063201 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:20.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cacfb2640 1 -- 172.21.15.38:0/1204063201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ca80b3ff0 msgr2=0x7f3ca81519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:20.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cacfb2640 1 --2- 172.21.15.38:0/1204063201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ca80b3ff0 0x7f3ca81519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:20.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cacfb2640 1 -- 172.21.15.38:0/1204063201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ca8157980 msgr2=0x7f3ca8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:20.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cadfb4640 1 --2- 172.21.15.38:0/1204063201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ca8157980 0x7f3ca8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:20.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cacfb2640 1 --2- 172.21.15.38:0/1204063201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ca8157980 0x7f3ca8156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:20.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.112+0000 7f3cacfb2640 1 -- 172.21.15.38:0/1204063201 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c980094d0 con 0x7f3ca80b44a0 2023-12-22T08:43:20.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.113+0000 7f3cacfb2640 1 --2- 172.21.15.38:0/1204063201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ca80b44a0 0x7f3ca8155fc0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009870 tx=0x7f3c98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:20.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.113+0000 7f3c9dffb640 1 -- 172.21.15.38:0/1204063201 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98039d60 con 0x7f3ca80b44a0 2023-12-22T08:43:20.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.113+0000 7f3c9dffb640 1 -- 172.21.15.38:0/1204063201 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c98043400 con 0x7f3ca80b44a0 2023-12-22T08:43:20.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.113+0000 7f3c9dffb640 1 -- 172.21.15.38:0/1204063201 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c980437b0 con 0x7f3ca80b44a0 2023-12-22T08:43:20.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.113+0000 7f3cae7b5640 1 -- 172.21.15.38:0/1204063201 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca8152ae0 con 0x7f3ca80b44a0 2023-12-22T08:43:20.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.113+0000 7f3cae7b5640 1 -- 172.21.15.38:0/1204063201 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca814d390 con 0x7f3ca80b44a0 2023-12-22T08:43:20.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.114+0000 7f3cae7b5640 1 -- 172.21.15.38:0/1204063201 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca8061910 con 0x7f3ca80b44a0 2023-12-22T08:43:20.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.115+0000 7f3c9dffb640 1 -- 172.21.15.38:0/1204063201 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3c98043910 con 0x7f3ca80b44a0 2023-12-22T08:43:20.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.116+0000 7f3c9dffb640 1 --2- 172.21.15.38:0/1204063201 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3c8c06a480 0x7f3c8c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:20.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.116+0000 7f3c9dffb640 1 -- 172.21.15.38:0/1204063201 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c9803e070 con 0x7f3ca80b44a0 2023-12-22T08:43:20.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.117+0000 7f3cad7b3640 1 --2- 172.21.15.38:0/1204063201 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3c8c06a480 0x7f3c8c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:20.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.118+0000 7f3cad7b3640 1 --2- 172.21.15.38:0/1204063201 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3c8c06a480 0x7f3c8c06c940 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4001560 tx=0x7f3ca4007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:20.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.120+0000 7f3c9dffb640 1 -- 172.21.15.38:0/1204063201 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3c98077150 con 0x7f3ca80b44a0 2023-12-22T08:43:20.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.351+0000 7f3cae7b5640 1 -- 172.21.15.38:0/1204063201 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ca8152ca0 con 0x7f3ca80b44a0 2023-12-22T08:43:20.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.352+0000 7f3c9dffb640 1 -- 172.21.15.38:0/1204063201 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4645 (secure 0 0 0) 0x7f3c98034090 con 0x7f3ca80b44a0 2023-12-22T08:43:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:20.355 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3287488986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3287488986},{"type":"v1","addr":"172.21.15.89:6836","nonce":3287488986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2154639115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2154639115},{"type":"v1","addr":"172.21.15.89:6837","nonce":2154639115}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/807798598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":807798598},{"type":"v1","addr":"172.21.15.38:6833","nonce":807798598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:43:08.736828+0000","modified":"2023-12-22T08:43:12.231629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1778808252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1778808252},{"type":"v1","addr":"172.21.15.38:6835","nonce":1778808252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-22T08:43:20.355 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 32 2023-12-22T08:43:20.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.355+0000 7f3cae7b5640 1 -- 172.21.15.38:0/1204063201 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3c8c06a480 msgr2=0x7f3c8c06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:20.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.355+0000 7f3cae7b5640 1 --2- 172.21.15.38:0/1204063201 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3c8c06a480 0x7f3c8c06c940 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4001560 tx=0x7f3ca4007930 comp rx=0 tx=0).stop 2023-12-22T08:43:20.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.355+0000 7f3cae7b5640 1 -- 172.21.15.38:0/1204063201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ca80b44a0 msgr2=0x7f3ca8155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:20.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.355+0000 7f3cae7b5640 1 --2- 172.21.15.38:0/1204063201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ca80b44a0 0x7f3ca8155fc0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009870 tx=0x7f3c98004730 comp rx=0 tx=0).stop 2023-12-22T08:43:20.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.355+0000 7f3cae7b5640 1 -- 172.21.15.38:0/1204063201 shutdown_connections 2023-12-22T08:43:20.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.355+0000 7f3cae7b5640 1 --2- 172.21.15.38:0/1204063201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ca8157980 0x7f3ca8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:20.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.355+0000 7f3cae7b5640 1 --2- 172.21.15.38:0/1204063201 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3c8c06a480 0x7f3c8c06c940 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:20.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.355+0000 7f3cae7b5640 1 --2- 172.21.15.38:0/1204063201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ca80b44a0 0x7f3ca8155fc0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:20.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.355+0000 7f3cae7b5640 1 --2- 172.21.15.38:0/1204063201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ca80b3ff0 0x7f3ca81519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:20.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.355+0000 7f3cae7b5640 1 -- 172.21.15.38:0/1204063201 >> 172.21.15.38:0/1204063201 conn(0x7f3ca80d31f0 msgr2=0x7f3ca815f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:20.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.355+0000 7f3cae7b5640 1 -- 172.21.15.38:0/1204063201 shutdown_connections 2023-12-22T08:43:20.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:20.355+0000 7f3cae7b5640 1 -- 172.21.15.38:0/1204063201 wait complete. 2023-12-22T08:43:20.780 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T08:43:08.736828+0000', 'modified': '2023-12-22T08:43:12.231629+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6012}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6012': {'gid': 6012, 'name': 'a', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.38:6835/1778808252', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6834', 'nonce': 1778808252}, {'type': 'v1', 'addr': '172.21.15.38:6835', 'nonce': 1778808252}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T08:43:20.780 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T08:43:20.780 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-22T08:43:21.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.013+0000 7f9a4f47d640 1 Processor -- start 2023-12-22T08:43:21.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.014+0000 7f9a4f47d640 1 -- start start 2023-12-22T08:43:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.015+0000 7f9a4f47d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a4815e740 0x7f9a4815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.015+0000 7f9a4f47d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9a480b3f90 0x7f9a48070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.015+0000 7f9a4f47d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4815eb20 con 0x7f9a4806ca50 2023-12-22T08:43:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.015+0000 7f9a4f47d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4806e650 con 0x7f9a480b3f90 2023-12-22T08:43:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.015+0000 7f9a4f47d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a48070770 con 0x7f9a4815e740 2023-12-22T08:43:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.015+0000 7f9a4da1a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9a480b3f90 0x7f9a48070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.015+0000 7f9a4da1a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9a480b3f90 0x7f9a48070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51084/0 (socket says 172.21.15.38:51084) 2023-12-22T08:43:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.015+0000 7f9a4da1a640 1 -- 172.21.15.38:0/2146065149 learned_addr learned my addr 172.21.15.38:0/2146065149 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.016+0000 7f9a4d219640 1 --2- 172.21.15.38:0/2146065149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a4815e740 0x7f9a4815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.016+0000 7f9a4da1a640 1 -- 172.21.15.38:0/2146065149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a4815e740 msgr2=0x7f9a4815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.016+0000 7f9a4da1a640 1 --2- 172.21.15.38:0/2146065149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a4815e740 0x7f9a4815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.016+0000 7f9a4da1a640 1 -- 172.21.15.38:0/2146065149 >> v1:172.21.15.38:6789/0 conn(0x7f9a4806ca50 legacy=0x7f9a480b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.016+0000 7f9a4da1a640 1 -- 172.21.15.38:0/2146065149 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4806d180 con 0x7f9a480b3f90 2023-12-22T08:43:21.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.016+0000 7f9a47fff640 1 -- 172.21.15.38:0/2146065149 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683906807 0 0) 0x7f9a4815eb20 con 0x7f9a4806ca50 2023-12-22T08:43:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.017+0000 7f9a4da1a640 1 --2- 172.21.15.38:0/2146065149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a480b3f90 0x7f9a48070c00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009870 tx=0x7f9a4002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ccb5f7624afc94 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.017+0000 7f9a47fff640 1 -- 172.21.15.38:0/2146065149 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a400317c0 con 0x7f9a480b3f90 2023-12-22T08:43:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.017+0000 7f9a47fff640 1 -- 172.21.15.38:0/2146065149 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a40031920 con 0x7f9a480b3f90 2023-12-22T08:43:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.017+0000 7f9a47fff640 1 -- 172.21.15.38:0/2146065149 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40031cb0 con 0x7f9a480b3f90 2023-12-22T08:43:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.018+0000 7f9a4f47d640 1 -- 172.21.15.38:0/2146065149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a480b3f90 msgr2=0x7f9a48070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.018+0000 7f9a4f47d640 1 --2- 172.21.15.38:0/2146065149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a480b3f90 0x7f9a48070c00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009870 tx=0x7f9a4002b860 comp rx=0 tx=0).stop 2023-12-22T08:43:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.018+0000 7f9a4f47d640 1 -- 172.21.15.38:0/2146065149 shutdown_connections 2023-12-22T08:43:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.018+0000 7f9a4f47d640 1 --2- 172.21.15.38:0/2146065149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a480b3f90 0x7f9a48070c00 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.018+0000 7f9a4f47d640 1 --2- 172.21.15.38:0/2146065149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a4815e740 0x7f9a4815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.018+0000 7f9a4f47d640 1 -- 172.21.15.38:0/2146065149 >> 172.21.15.38:0/2146065149 conn(0x7f9a480cfea0 msgr2=0x7f9a480d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:21.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.018+0000 7f9a4f47d640 1 -- 172.21.15.38:0/2146065149 shutdown_connections 2023-12-22T08:43:21.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.018+0000 7f9a4f47d640 1 -- 172.21.15.38:0/2146065149 wait complete. 2023-12-22T08:43:21.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.020+0000 7f9a4f47d640 1 Processor -- start 2023-12-22T08:43:21.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.020+0000 7f9a4f47d640 1 -- start start 2023-12-22T08:43:21.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.021+0000 7f9a4f47d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a4806ca50 0x7f9a48071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.021+0000 7f9a4f47d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a480b3f90 0x7f9a48152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.021+0000 7f9a4f47d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a4815e740 0x7f9a481f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.021+0000 7f9a4f47d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a48153020 con 0x7f9a480b3f90 2023-12-22T08:43:21.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.021+0000 7f9a4f47d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a481570a0 con 0x7f9a4806ca50 2023-12-22T08:43:21.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.021+0000 7f9a4f47d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a48157380 con 0x7f9a4815e740 2023-12-22T08:43:21.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.021+0000 7f9a4ca18640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a480b3f90 0x7f9a48152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.021+0000 7f9a4ca18640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a480b3f90 0x7f9a48152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51088/0 (socket says 172.21.15.38:51088) 2023-12-22T08:43:21.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.021+0000 7f9a4ca18640 1 -- 172.21.15.38:0/1693287017 learned_addr learned my addr 172.21.15.38:0/1693287017 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:21.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.021+0000 7f9a4da1a640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a4815e740 0x7f9a481f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.021+0000 7f9a4d219640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a4806ca50 0x7f9a48071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.022+0000 7f9a4ca18640 1 -- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a4815e740 msgr2=0x7f9a481f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.022+0000 7f9a4ca18640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a4815e740 0x7f9a481f5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.022+0000 7f9a4ca18640 1 -- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a4806ca50 msgr2=0x7f9a48071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.022+0000 7f9a4ca18640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a4806ca50 0x7f9a48071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.022+0000 7f9a4ca18640 1 -- 172.21.15.38:0/1693287017 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400094d0 con 0x7f9a480b3f90 2023-12-22T08:43:21.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.022+0000 7f9a4ca18640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a480b3f90 0x7f9a48152ae0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00c4b0 tx=0x7f9a3c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:21.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.022+0000 7f9a45ffb640 1 -- 172.21.15.38:0/1693287017 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c005480 con 0x7f9a480b3f90 2023-12-22T08:43:21.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.022+0000 7f9a45ffb640 1 -- 172.21.15.38:0/1693287017 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c0035f0 con 0x7f9a480b3f90 2023-12-22T08:43:21.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.022+0000 7f9a45ffb640 1 -- 172.21.15.38:0/1693287017 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0039e0 con 0x7f9a480b3f90 2023-12-22T08:43:21.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.022+0000 7f9a4f47d640 1 -- 172.21.15.38:0/1693287017 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a48157660 con 0x7f9a480b3f90 2023-12-22T08:43:21.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.022+0000 7f9a4f47d640 1 -- 172.21.15.38:0/1693287017 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a481593e0 con 0x7f9a480b3f90 2023-12-22T08:43:21.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.025+0000 7f9a45ffb640 1 -- 172.21.15.38:0/1693287017 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9a3c003b40 con 0x7f9a480b3f90 2023-12-22T08:43:21.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.026+0000 7f9a45ffb640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9a3406a430 0x7f9a3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.026+0000 7f9a45ffb640 1 -- 172.21.15.38:0/1693287017 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a3c087fe0 con 0x7f9a480b3f90 2023-12-22T08:43:21.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.026+0000 7f9a4d219640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9a3406a430 0x7f9a3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.026+0000 7f9a51fed740 1 Processor -- start 2023-12-22T08:43:21.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.027+0000 7f9a51fed740 1 -- start start 2023-12-22T08:43:21.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.027+0000 7f9a51fed740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 0x55b062c05110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.027+0000 7f9a4d219640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9a3406a430 0x7f9a3406c8f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9a380099c0 tx=0x7f9a38003990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:21.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.027+0000 7f9a51fed740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd4cb0 0x55b062c01fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.027+0000 7f9a51fed740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bd88b0 0x55b062c024e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.028+0000 7f9a51fed740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b062b44f80 con 0x55b062c04d30 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.028+0000 7f9a51fed740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b062b42710 con 0x55b062bd4cb0 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.028+0000 7f9a51fed740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b062b3e000 con 0x55b062bd88b0 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.028+0000 7f9a4d219640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 0x55b062c05110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.028+0000 7f9a4d219640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 0x55b062c05110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51090/0 (socket says 172.21.15.38:51090) 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.028+0000 7f9a4d219640 1 -- 172.21.15.38:0/3517552057 learned_addr learned my addr 172.21.15.38:0/3517552057 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.028+0000 7f9a4da1a640 1 --2- 172.21.15.38:0/3517552057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bd88b0 0x55b062c024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.028+0000 7f9a4ca18640 1 --2- 172.21.15.38:0/3517552057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd4cb0 0x55b062c01fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.028+0000 7f9a4d219640 1 -- 172.21.15.38:0/3517552057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bd88b0 msgr2=0x55b062c024e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.028+0000 7f9a4d219640 1 --2- 172.21.15.38:0/3517552057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bd88b0 0x55b062c024e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.028+0000 7f9a4d219640 1 -- 172.21.15.38:0/3517552057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd4cb0 msgr2=0x55b062c01fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.028+0000 7f9a4d219640 1 --2- 172.21.15.38:0/3517552057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd4cb0 0x55b062c01fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.028+0000 7f9a4d219640 1 -- 172.21.15.38:0/3517552057 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b062b05690 con 0x55b062c04d30 2023-12-22T08:43:21.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.029+0000 7f9a4d219640 1 --2- 172.21.15.38:0/3517552057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 0x55b062c05110 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9a38003bb0 tx=0x7f9a38012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cff01741f75cb0b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:21.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.029+0000 7f9a2effd640 1 -- 172.21.15.38:0/3517552057 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380147e0 con 0x55b062c04d30 2023-12-22T08:43:21.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.029+0000 7f9a2effd640 1 -- 172.21.15.38:0/3517552057 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a38014940 con 0x55b062c04d30 2023-12-22T08:43:21.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.029+0000 7f9a2effd640 1 -- 172.21.15.38:0/3517552057 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a38014cb0 con 0x55b062c04d30 2023-12-22T08:43:21.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.030+0000 7f9a51fed740 1 -- 172.21.15.38:0/3517552057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 msgr2=0x55b062c05110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.030+0000 7f9a51fed740 1 --2- 172.21.15.38:0/3517552057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 0x55b062c05110 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9a38003bb0 tx=0x7f9a38012000 comp rx=0 tx=0).stop 2023-12-22T08:43:21.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.030+0000 7f9a51fed740 1 -- 172.21.15.38:0/3517552057 shutdown_connections 2023-12-22T08:43:21.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.030+0000 7f9a51fed740 1 --2- 172.21.15.38:0/3517552057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bd88b0 0x55b062c024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.030+0000 7f9a51fed740 1 --2- 172.21.15.38:0/3517552057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd4cb0 0x55b062c01fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.030+0000 7f9a51fed740 1 --2- 172.21.15.38:0/3517552057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 0x55b062c05110 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.030+0000 7f9a51fed740 1 -- 172.21.15.38:0/3517552057 >> 172.21.15.38:0/3517552057 conn(0x55b062bd6fc0 msgr2=0x55b062c1fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:21.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.030+0000 7f9a51fed740 1 -- 172.21.15.38:0/3517552057 shutdown_connections 2023-12-22T08:43:21.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.030+0000 7f9a51fed740 1 -- 172.21.15.38:0/3517552057 wait complete. 2023-12-22T08:43:21.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.031+0000 7f9a51fed740 1 -- start start 2023-12-22T08:43:21.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.031+0000 7f9a51fed740 1 Processor -- start 2023-12-22T08:43:21.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.032+0000 7f9a51fed740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bd88b0 0x55b062bfa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.032+0000 7f9a51fed740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062c04d30 0x55b062bfbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.032+0000 7f9a51fed740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 0x55b062bfd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.032+0000 7f9a51fed740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b062adf7d0 con 0x55b062bfc340 2023-12-22T08:43:21.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.032+0000 7f9a51fed740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b062adf470 con 0x55b062c04d30 2023-12-22T08:43:21.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.032+0000 7f9a51fed740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0628a5f20 con 0x55b062bd88b0 2023-12-22T08:43:21.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.032+0000 7f9a51fed740 10 client.0 _ll_register_callbacks cb 0x55b062b2e1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.032+0000 7f9a4da1a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 0x55b062bfd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.033+0000 7f9a4da1a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 0x55b062bfd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51102/0 (socket says 172.21.15.38:51102) 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.033+0000 7f9a4da1a640 1 -- 172.21.15.38:0/2743628834 learned_addr learned my addr 172.21.15.38:0/2743628834 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.033+0000 7f9a4d219640 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bd88b0 0x55b062bfa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.033+0000 7f9a4ca18640 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062c04d30 0x55b062bfbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.033+0000 7f9a4da1a640 1 -- 172.21.15.38:0/2743628834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bd88b0 msgr2=0x55b062bfa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.033+0000 7f9a4da1a640 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bd88b0 0x55b062bfa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.033+0000 7f9a4da1a640 1 -- 172.21.15.38:0/2743628834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062c04d30 msgr2=0x55b062bfbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.033+0000 7f9a4da1a640 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062c04d30 0x55b062bfbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.033+0000 7f9a4da1a640 1 -- 172.21.15.38:0/2743628834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a38004700 con 0x55b062bfc340 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.033+0000 7f9a4ca18640 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062c04d30 0x55b062bfbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.033+0000 7f9a4da1a640 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 0x55b062bfd310 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009870 tx=0x7f9a40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ee8be5668d9b50 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.033+0000 7f9a23fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a23fff640 1 -- 172.21.15.38:0/2743628834 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40032860 con 0x55b062bfc340 2023-12-22T08:43:21.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a23fff640 1 -- 172.21.15.38:0/2743628834 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a40040040 con 0x55b062bfc340 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a51fed740 1 -- 172.21.15.38:0/2743628834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b062b68550 con 0x55b062bfc340 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a23fff640 1 -- 172.21.15.38:0/2743628834 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a400329c0 con 0x55b062bfc340 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a51fed740 10 client.6189 fetch_fsmap learned FSMap version 32 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a51fed740 1 -- 172.21.15.38:0/2743628834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55b062b3c680 con 0x55b062bfc340 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a23fff640 1 -- 172.21.15.38:0/2743628834 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b062b68550 con 0x55b062bfc340 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a23fff640 1 -- 172.21.15.38:0/2743628834 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f9a4004d060 con 0x55b062bfc340 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a51fed740 10 client.6189 fetch_fsmap finished waiting for FSMap version 32 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a51fed740 10 client.6189 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a51fed740 20 client.6189 populate_metadata read hostname 'smithi038' 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a51fed740 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.38:6834/1778808252,v1:172.21.15.38:6835/1778808252] conn(0x55b062c32660 0x55b062c32a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a51fed740 4 client.6189 mds_command: new command op to 6012 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.034+0000 7f9a51fed740 1 -- 172.21.15.38:0/2743628834 --> [v2:172.21.15.38:6834/1778808252,v1:172.21.15.38:6835/1778808252] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b062b30b50 con 0x55b062c32660 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.035+0000 7f9a4d219640 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.38:6834/1778808252,v1:172.21.15.38:6835/1778808252] conn(0x55b062c32660 0x55b062c32a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.035+0000 7f9a4d219640 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.38:6834/1778808252,v1:172.21.15.38:6835/1778808252] conn(0x55b062c32660 0x55b062c32a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=123876a3a9084a1a server_cookie=47b8ae4b3c9412d8 in_seq=0 out_seq=0 2023-12-22T08:43:21.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.035+0000 7f9a23fff640 10 client.6189 ms_handle_connect on v2:172.21.15.38:6834/1778808252 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.036+0000 7f9a23fff640 1 -- 172.21.15.38:0/2743628834 <== mds.0 v2:172.21.15.38:6834/1778808252 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55b062b30b50 con 0x55b062c32660 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.036+0000 7f9a23fff640 10 client.6189 handle_command_reply: tid=0 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.036+0000 7f9a51fed740 1 client.6189 shutdown 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.036+0000 7f9a51fed740 1 -- 172.21.15.38:0/2743628834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 msgr2=0x55b062bfd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.036+0000 7f9a51fed740 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 0x55b062bfd310 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009870 tx=0x7f9a40004730 comp rx=0 tx=0).stop 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.036+0000 7f9a51fed740 1 -- 172.21.15.38:0/2743628834 shutdown_connections 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.036+0000 7f9a51fed740 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.38:6834/1778808252,v1:172.21.15.38:6835/1778808252] conn(0x55b062c32660 0x55b062c32a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.036+0000 7f9a51fed740 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 0x55b062bfd310 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.036+0000 7f9a51fed740 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062c04d30 0x55b062bfbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.036+0000 7f9a51fed740 1 --2- 172.21.15.38:0/2743628834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bd88b0 0x55b062bfa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.036+0000 7f9a23fff640 0 client.6189 ms_handle_reset on v2:172.21.15.38:6834/1778808252 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.036+0000 7f9a51fed740 1 -- 172.21.15.38:0/2743628834 >> 172.21.15.38:0/2743628834 conn(0x55b062bd4cb0 msgr2=0x55b062c23050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.037+0000 7f9a51fed740 1 -- 172.21.15.38:0/2743628834 shutdown_connections 2023-12-22T08:43:21.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.037+0000 7f9a51fed740 1 -- 172.21.15.38:0/2743628834 wait complete. 2023-12-22T08:43:21.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.037+0000 7f9a51fed740 20 client.6189 trim_cache size 0 max 16384 2023-12-22T08:43:21.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.053+0000 7f9a51fed740 1 Processor -- start 2023-12-22T08:43:21.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.053+0000 7f9a51fed740 1 -- start start 2023-12-22T08:43:21.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.054+0000 7f9a51fed740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd88b0 0x55b062c019e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.054+0000 7f9a51fed740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bfc340 0x55b062bfcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.054+0000 7f9a51fed740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 0x55b062c38b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.054+0000 7f9a51fed740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b062c32510 con 0x55b062c04d30 2023-12-22T08:43:21.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.054+0000 7f9a51fed740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b062c20f00 con 0x55b062bd88b0 2023-12-22T08:43:21.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.054+0000 7f9a51fed740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b062bf77f0 con 0x55b062bfc340 2023-12-22T08:43:21.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.054+0000 7f9a4da1a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 0x55b062c38b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.054+0000 7f9a4da1a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 0x55b062c38b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51104/0 (socket says 172.21.15.38:51104) 2023-12-22T08:43:21.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.055+0000 7f9a4da1a640 1 -- 172.21.15.38:0/1640835358 learned_addr learned my addr 172.21.15.38:0/1640835358 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:21.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.055+0000 7f9a4ca18640 1 --2- 172.21.15.38:0/1640835358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bfc340 0x55b062bfcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.055+0000 7f9a4d219640 1 --2- 172.21.15.38:0/1640835358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd88b0 0x55b062c019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.055+0000 7f9a4da1a640 1 -- 172.21.15.38:0/1640835358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bfc340 msgr2=0x55b062bfcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:21.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.055+0000 7f9a4da1a640 1 --2- 172.21.15.38:0/1640835358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bfc340 0x55b062bfcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.055+0000 7f9a4da1a640 1 -- 172.21.15.38:0/1640835358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd88b0 msgr2=0x55b062c019e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:21.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.055+0000 7f9a4da1a640 1 --2- 172.21.15.38:0/1640835358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd88b0 0x55b062c019e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.055+0000 7f9a4da1a640 1 -- 172.21.15.38:0/1640835358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b062ade9e0 con 0x55b062c04d30 2023-12-22T08:43:21.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.055+0000 7f9a4da1a640 1 --2- 172.21.15.38:0/1640835358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 0x55b062c38b90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9a40001eb0 tx=0x7f9a40042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b281522bc681729 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:21.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.056+0000 7f9a2f7fe640 1 -- 172.21.15.38:0/1640835358 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40032660 con 0x55b062c04d30 2023-12-22T08:43:21.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.056+0000 7f9a2f7fe640 1 -- 172.21.15.38:0/1640835358 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a400327c0 con 0x55b062c04d30 2023-12-22T08:43:21.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.056+0000 7f9a2f7fe640 1 -- 172.21.15.38:0/1640835358 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a40004030 con 0x55b062c04d30 2023-12-22T08:43:21.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.056+0000 7f9a51fed740 1 -- 172.21.15.38:0/1640835358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 msgr2=0x55b062c38b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.056+0000 7f9a51fed740 1 --2- 172.21.15.38:0/1640835358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 0x55b062c38b90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9a40001eb0 tx=0x7f9a40042000 comp rx=0 tx=0).stop 2023-12-22T08:43:21.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.056+0000 7f9a51fed740 1 -- 172.21.15.38:0/1640835358 shutdown_connections 2023-12-22T08:43:21.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.056+0000 7f9a51fed740 1 --2- 172.21.15.38:0/1640835358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062c04d30 0x55b062c38b90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.056+0000 7f9a51fed740 1 --2- 172.21.15.38:0/1640835358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062bfc340 0x55b062bfcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.056+0000 7f9a51fed740 1 --2- 172.21.15.38:0/1640835358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd88b0 0x55b062c019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.056+0000 7f9a51fed740 1 -- 172.21.15.38:0/1640835358 >> 172.21.15.38:0/1640835358 conn(0x55b062bd4cb0 msgr2=0x55b062c22720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:21.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.056+0000 7f9a51fed740 1 -- 172.21.15.38:0/1640835358 shutdown_connections 2023-12-22T08:43:21.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.056+0000 7f9a51fed740 1 -- 172.21.15.38:0/1640835358 wait complete. 2023-12-22T08:43:21.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.057+0000 7f9a51fed740 1 -- start start 2023-12-22T08:43:21.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.057+0000 7f9a51fed740 1 Processor -- start 2023-12-22T08:43:21.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.058+0000 7f9a51fed740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd88b0 0x55b062bda5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a51fed740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 0x55b062c00450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a51fed740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062c04d30 0x55b062c21550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a51fed740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b062bd9800 con 0x55b062bfc340 2023-12-22T08:43:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a51fed740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b062c21e50 con 0x55b062bd88b0 2023-12-22T08:43:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a51fed740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b062bd8f60 con 0x55b062c04d30 2023-12-22T08:43:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a51fed740 10 client.0 _ll_register_callbacks cb 0x7f9a38009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:43:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a4ca18640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 0x55b062c00450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a4ca18640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 0x55b062c00450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51110/0 (socket says 172.21.15.38:51110) 2023-12-22T08:43:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a4ca18640 1 -- 172.21.15.38:0/3853744168 learned_addr learned my addr 172.21.15.38:0/3853744168 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a4d219640 1 --2- 172.21.15.38:0/3853744168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd88b0 0x55b062bda5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a4da1a640 1 --2- 172.21.15.38:0/3853744168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062c04d30 0x55b062c21550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a4ca18640 1 -- 172.21.15.38:0/3853744168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062c04d30 msgr2=0x55b062c21550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a4ca18640 1 --2- 172.21.15.38:0/3853744168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062c04d30 0x55b062c21550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a4ca18640 1 -- 172.21.15.38:0/3853744168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd88b0 msgr2=0x55b062bda5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a4ca18640 1 --2- 172.21.15.38:0/3853744168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd88b0 0x55b062bda5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.059+0000 7f9a4ca18640 1 -- 172.21.15.38:0/3853744168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b062b3c680 con 0x55b062bfc340 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a4ca18640 1 --2- 172.21.15.38:0/3853744168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 0x55b062c00450 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00ce70 tx=0x7f9a3c05b0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704c22b4ebc662c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a23fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a23fff640 1 -- 172.21.15.38:0/3853744168 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c055590 con 0x55b062bfc340 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a23fff640 1 -- 172.21.15.38:0/3853744168 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a3c081c60 con 0x55b062bfc340 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a51fed740 1 -- 172.21.15.38:0/3853744168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a38014940 con 0x55b062bfc340 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a23fff640 1 -- 172.21.15.38:0/3853744168 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a3c081e20 con 0x55b062bfc340 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a51fed740 10 client.6195 fetch_fsmap learned FSMap version 32 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a51fed740 1 -- 172.21.15.38:0/3853744168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55b062b03ef0 con 0x55b062bfc340 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a23fff640 1 -- 172.21.15.38:0/3853744168 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a38014940 con 0x55b062bfc340 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a23fff640 1 -- 172.21.15.38:0/3853744168 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f9a3c05ed40 con 0x55b062bfc340 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a51fed740 10 client.6195 fetch_fsmap finished waiting for FSMap version 32 2023-12-22T08:43:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a51fed740 10 client.6195 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:43:21.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a51fed740 20 client.6195 populate_metadata read hostname 'smithi038' 2023-12-22T08:43:21.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a51fed740 1 --2- 172.21.15.38:0/3853744168 >> [v2:172.21.15.38:6834/1778808252,v1:172.21.15.38:6835/1778808252] conn(0x55b062c38a70 0x55b062c38e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a51fed740 4 client.6195 mds_command: new command op to 6012 tid=0[{"prefix": "status"}] 2023-12-22T08:43:21.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.060+0000 7f9a51fed740 1 -- 172.21.15.38:0/3853744168 --> [v2:172.21.15.38:6834/1778808252,v1:172.21.15.38:6835/1778808252] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b062b37080 con 0x55b062c38a70 2023-12-22T08:43:21.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.061+0000 7f9a4d219640 1 --2- 172.21.15.38:0/3853744168 >> [v2:172.21.15.38:6834/1778808252,v1:172.21.15.38:6835/1778808252] conn(0x55b062c38a70 0x55b062c38e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.061+0000 7f9a4d219640 1 --2- 172.21.15.38:0/3853744168 >> [v2:172.21.15.38:6834/1778808252,v1:172.21.15.38:6835/1778808252] conn(0x55b062c38a70 0x55b062c38e50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be933f4deff80738 server_cookie=cfe3e8dbb80d07ae in_seq=0 out_seq=0 2023-12-22T08:43:21.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.061+0000 7f9a23fff640 10 client.6195 ms_handle_connect on v2:172.21.15.38:6834/1778808252 2023-12-22T08:43:21.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.061+0000 7f9a23fff640 1 -- 172.21.15.38:0/3853744168 <== mds.0 v2:172.21.15.38:6834/1778808252 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55b062b37080 con 0x55b062c38a70 2023-12-22T08:43:21.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.061+0000 7f9a23fff640 10 client.6195 handle_command_reply: tid=0 2023-12-22T08:43:21.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.061+0000 7f9a51fed740 1 client.6195 shutdown 2023-12-22T08:43:21.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.062+0000 7f9a51fed740 1 -- 172.21.15.38:0/3853744168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 msgr2=0x55b062c00450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.062+0000 7f9a51fed740 1 --2- 172.21.15.38:0/3853744168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 0x55b062c00450 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00ce70 tx=0x7f9a3c05b0e0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.062+0000 7f9a51fed740 1 -- 172.21.15.38:0/3853744168 shutdown_connections 2023-12-22T08:43:21.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.062+0000 7f9a51fed740 1 --2- 172.21.15.38:0/3853744168 >> [v2:172.21.15.38:6834/1778808252,v1:172.21.15.38:6835/1778808252] conn(0x55b062c38a70 0x55b062c38e50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.062+0000 7f9a51fed740 1 --2- 172.21.15.38:0/3853744168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55b062c04d30 0x55b062c21550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.062+0000 7f9a51fed740 1 --2- 172.21.15.38:0/3853744168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b062bfc340 0x55b062c00450 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.062+0000 7f9a51fed740 1 --2- 172.21.15.38:0/3853744168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b062bd88b0 0x55b062bda5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.062+0000 7f9a23fff640 0 client.6195 ms_handle_reset on v2:172.21.15.38:6834/1778808252 2023-12-22T08:43:21.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.062+0000 7f9a51fed740 1 -- 172.21.15.38:0/3853744168 >> 172.21.15.38:0/3853744168 conn(0x55b062bd4cb0 msgr2=0x55b062bfcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:21.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.062+0000 7f9a51fed740 1 -- 172.21.15.38:0/3853744168 shutdown_connections 2023-12-22T08:43:21.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.062+0000 7f9a51fed740 1 -- 172.21.15.38:0/3853744168 wait complete. 2023-12-22T08:43:21.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.062+0000 7f9a51fed740 20 client.6195 trim_cache size 0 max 16384 2023-12-22T08:43:21.067 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:43:21.067 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:43:21.067 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-12-22T08:43:21.067 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 6012, 2023-12-22T08:43:21.068 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-12-22T08:43:21.068 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-12-22T08:43:21.068 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-12-22T08:43:21.068 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 12.318521483, 2023-12-22T08:43:21.068 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 32, 2023-12-22T08:43:21.068 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 72, 2023-12-22T08:43:21.068 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 72, 2023-12-22T08:43:21.068 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 17.443119982999999 2023-12-22T08:43:21.068 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:43:21.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.063+0000 7f9a4f47d640 1 -- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9a3406a430 msgr2=0x7f9a3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.063+0000 7f9a4f47d640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9a3406a430 0x7f9a3406c8f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9a380099c0 tx=0x7f9a38003990 comp rx=0 tx=0).stop 2023-12-22T08:43:21.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.063+0000 7f9a4f47d640 1 -- 172.21.15.38:0/1693287017 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a480b3f90 msgr2=0x7f9a48152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.063+0000 7f9a4f47d640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a480b3f90 0x7f9a48152ae0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00c4b0 tx=0x7f9a3c00c970 comp rx=0 tx=0).stop 2023-12-22T08:43:21.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.063+0000 7f9a4f47d640 1 -- 172.21.15.38:0/1693287017 shutdown_connections 2023-12-22T08:43:21.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.063+0000 7f9a4f47d640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a4815e740 0x7f9a481f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.063+0000 7f9a4f47d640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9a3406a430 0x7f9a3406c8f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.063+0000 7f9a4f47d640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a480b3f90 0x7f9a48152ae0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.063+0000 7f9a4f47d640 1 --2- 172.21.15.38:0/1693287017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a4806ca50 0x7f9a48071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.063+0000 7f9a4f47d640 1 -- 172.21.15.38:0/1693287017 >> 172.21.15.38:0/1693287017 conn(0x7f9a480cfea0 msgr2=0x7f9a48070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:21.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.063+0000 7f9a4f47d640 1 -- 172.21.15.38:0/1693287017 shutdown_connections 2023-12-22T08:43:21.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.063+0000 7f9a4f47d640 1 -- 172.21.15.38:0/1693287017 wait complete. 2023-12-22T08:43:21.081 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:43:21.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.278+0000 7f63349c8640 1 Processor -- start 2023-12-22T08:43:21.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.278+0000 7f63349c8640 1 -- start start 2023-12-22T08:43:21.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.280+0000 7f63349c8640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6330071680 0x7f6330162f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.280+0000 7f63349c8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6330162ce0 con 0x7f63300caf90 2023-12-22T08:43:21.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.280+0000 7f63349c8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6330162160 con 0x7f63300b2a90 2023-12-22T08:43:21.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.280+0000 7f63349c8640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6330162440 con 0x7f6330071680 2023-12-22T08:43:21.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.280+0000 7f632f59e640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f63300caf90 0x7f633006d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49724/0 (socket says 172.21.15.38:49724) 2023-12-22T08:43:21.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.280+0000 7f632f59e640 1 -- 172.21.15.38:0/3620459491 learned_addr learned my addr 172.21.15.38:0/3620459491 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:43:21.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.281+0000 7f632ed9d640 1 --2- 172.21.15.38:0/3620459491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6330071680 0x7f6330162f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.281+0000 7f632dd9b640 1 -- 172.21.15.38:0/3620459491 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221024046 0 0) 0x7f6330162ce0 con 0x7f63300caf90 2023-12-22T08:43:21.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.281+0000 7f632dd9b640 1 -- 172.21.15.38:0/3620459491 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6318003520 con 0x7f63300caf90 2023-12-22T08:43:21.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.282+0000 7f632dd9b640 1 -- 172.21.15.38:0/3620459491 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877794537 0 0) 0x7f6330162160 con 0x7f63300b2a90 2023-12-22T08:43:21.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.282+0000 7f632dd9b640 1 -- 172.21.15.38:0/3620459491 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6330162ce0 con 0x7f63300b2a90 2023-12-22T08:43:21.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.282+0000 7f632dd9b640 1 -- 172.21.15.38:0/3620459491 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1827253661 0 0) 0x7f6318003520 con 0x7f63300caf90 2023-12-22T08:43:21.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.282+0000 7f632ed9d640 1 -- 172.21.15.38:0/3620459491 >> v1:172.21.15.89:6789/0 conn(0x7f63300b2a90 legacy=0x7f63300ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.282+0000 7f632ed9d640 1 -- 172.21.15.38:0/3620459491 >> v1:172.21.15.38:6789/0 conn(0x7f63300caf90 legacy=0x7f633006d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.282+0000 7f632ed9d640 1 -- 172.21.15.38:0/3620459491 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6330162720 con 0x7f6330071680 2023-12-22T08:43:21.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.284+0000 7f632ed9d640 1 --2- 172.21.15.38:0/3620459491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6330071680 0x7f6330162f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f63200097d0 tx=0x7f632002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67d917c21bead6d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:21.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.284+0000 7f632dd9b640 1 -- 172.21.15.38:0/3620459491 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63280019f0 con 0x7f6330071680 2023-12-22T08:43:21.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.284+0000 7f632dd9b640 1 -- 172.21.15.38:0/3620459491 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632002e050 con 0x7f6330071680 2023-12-22T08:43:21.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.284+0000 7f632dd9b640 1 -- 172.21.15.38:0/3620459491 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320030730 con 0x7f6330071680 2023-12-22T08:43:21.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.285+0000 7f63349c8640 1 -- 172.21.15.38:0/3620459491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6330071680 msgr2=0x7f6330162f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.285+0000 7f63349c8640 1 --2- 172.21.15.38:0/3620459491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6330071680 0x7f6330162f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f63200097d0 tx=0x7f632002b800 comp rx=0 tx=0).stop 2023-12-22T08:43:21.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.285+0000 7f63349c8640 1 -- 172.21.15.38:0/3620459491 shutdown_connections 2023-12-22T08:43:21.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.285+0000 7f63349c8640 1 --2- 172.21.15.38:0/3620459491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6330071680 0x7f6330162f20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.285+0000 7f63349c8640 1 -- 172.21.15.38:0/3620459491 >> 172.21.15.38:0/3620459491 conn(0x7f63300b1f70 msgr2=0x7f63300b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:21.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.286+0000 7f63349c8640 1 -- 172.21.15.38:0/3620459491 shutdown_connections 2023-12-22T08:43:21.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.286+0000 7f63349c8640 1 -- 172.21.15.38:0/3620459491 wait complete. 2023-12-22T08:43:21.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.288+0000 7f63349c8640 1 Processor -- start 2023-12-22T08:43:21.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.288+0000 7f63349c8640 1 -- start start 2023-12-22T08:43:21.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.289+0000 7f63349c8640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6330071680 0x7f6330151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.289+0000 7f63349c8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63300b2a90 0x7f633015e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.289+0000 7f63349c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63300caf90 0x7f633006f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.289+0000 7f63349c8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6330152910 con 0x7f63300b2a90 2023-12-22T08:43:21.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.289+0000 7f63349c8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633015b960 con 0x7f63300caf90 2023-12-22T08:43:21.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.289+0000 7f63349c8640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633015bc40 con 0x7f6330071680 2023-12-22T08:43:21.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.290+0000 7f632e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63300b2a90 0x7f633015e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.290+0000 7f632e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63300b2a90 0x7f633015e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51112/0 (socket says 172.21.15.38:51112) 2023-12-22T08:43:21.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.290+0000 7f632e59c640 1 -- 172.21.15.38:0/3842989611 learned_addr learned my addr 172.21.15.38:0/3842989611 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:21.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.290+0000 7f632ed9d640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6330071680 0x7f6330151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.290+0000 7f632f59e640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63300caf90 0x7f633006f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.290+0000 7f632e59c640 1 -- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6330071680 msgr2=0x7f6330151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.290+0000 7f632e59c640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6330071680 0x7f6330151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.290+0000 7f632e59c640 1 -- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63300caf90 msgr2=0x7f633006f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.290+0000 7f632e59c640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63300caf90 0x7f633006f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.290+0000 7f632e59c640 1 -- 172.21.15.38:0/3842989611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6320009400 con 0x7f63300b2a90 2023-12-22T08:43:21.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.291+0000 7f632e59c640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63300b2a90 0x7f633015e2b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f632400c490 tx=0x7f632400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:21.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.291+0000 7f63177fe640 1 -- 172.21.15.38:0/3842989611 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240052d0 con 0x7f63300b2a90 2023-12-22T08:43:21.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.291+0000 7f63177fe640 1 -- 172.21.15.38:0/3842989611 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6324005430 con 0x7f63300b2a90 2023-12-22T08:43:21.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.291+0000 7f63177fe640 1 -- 172.21.15.38:0/3842989611 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324012870 con 0x7f63300b2a90 2023-12-22T08:43:21.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.291+0000 7f63349c8640 1 -- 172.21.15.38:0/3842989611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633015bf20 con 0x7f63300b2a90 2023-12-22T08:43:21.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.291+0000 7f63349c8640 1 -- 172.21.15.38:0/3842989611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633015c4e0 con 0x7f63300b2a90 2023-12-22T08:43:21.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.293+0000 7f63349c8640 1 -- 172.21.15.38:0/3842989611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6330061910 con 0x7f63300b2a90 2023-12-22T08:43:21.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.294+0000 7f63177fe640 1 -- 172.21.15.38:0/3842989611 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f63240129d0 con 0x7f63300b2a90 2023-12-22T08:43:21.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.295+0000 7f63177fe640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f631c06a460 0x7f631c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:21.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.295+0000 7f63177fe640 1 -- 172.21.15.38:0/3842989611 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63240884c0 con 0x7f63300b2a90 2023-12-22T08:43:21.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.295+0000 7f632ed9d640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f631c06a460 0x7f631c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:21.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.296+0000 7f632ed9d640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f631c06a460 0x7f631c06c920 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6320034000 tx=0x7f6320008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:21.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.299+0000 7f63177fe640 1 -- 172.21.15.38:0/3842989611 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6324053ab0 con 0x7f63300b2a90 2023-12-22T08:43:21.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.530+0000 7f63349c8640 1 -- 172.21.15.38:0/3842989611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f633015c670 con 0x7f63300b2a90 2023-12-22T08:43:21.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.531+0000 7f63177fe640 1 -- 172.21.15.38:0/3842989611 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f63240570d0 con 0x7f63300b2a90 2023-12-22T08:43:21.533 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:43:21.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.534+0000 7f63349c8640 1 -- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f631c06a460 msgr2=0x7f631c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.534+0000 7f63349c8640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f631c06a460 0x7f631c06c920 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6320034000 tx=0x7f6320008030 comp rx=0 tx=0).stop 2023-12-22T08:43:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.534+0000 7f63349c8640 1 -- 172.21.15.38:0/3842989611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63300b2a90 msgr2=0x7f633015e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.534+0000 7f63349c8640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63300b2a90 0x7f633015e2b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f632400c490 tx=0x7f632400c950 comp rx=0 tx=0).stop 2023-12-22T08:43:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.534+0000 7f63349c8640 1 -- 172.21.15.38:0/3842989611 shutdown_connections 2023-12-22T08:43:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.534+0000 7f63349c8640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63300caf90 0x7f633006f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.534+0000 7f63349c8640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f631c06a460 0x7f631c06c920 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.534+0000 7f63349c8640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63300b2a90 0x7f633015e2b0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.534+0000 7f63349c8640 1 --2- 172.21.15.38:0/3842989611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6330071680 0x7f6330151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.534+0000 7f63349c8640 1 -- 172.21.15.38:0/3842989611 >> 172.21.15.38:0/3842989611 conn(0x7f63300b1f70 msgr2=0x7f63300ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.534+0000 7f63349c8640 1 -- 172.21.15.38:0/3842989611 shutdown_connections 2023-12-22T08:43:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:21.534+0000 7f63349c8640 1 -- 172.21.15.38:0/3842989611 wait complete. 2023-12-22T08:43:21.555 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:43:21.555 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:43:21.555 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-12-22T08:43:21.555 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T08:43:21.555 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:43:21.555 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:43:21.555 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:43:21.556 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:43:21.556 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:43:21.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:21.556 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-12-22T08:43:21.610 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:43:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:43:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:43:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:21.610 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:43:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:21.611 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:43:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:43:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-12-22T08:43:21.611 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:43:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:43:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-12-22T08:43:21.611 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:43:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-12-22T08:43:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-12-22T08:43:21.611 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42165sec preferred_lft 42165sec 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::5440:f6ff:fe40:85a/64 scope link 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:43:21.612 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:c3:65:6c:32:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:43:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::e4c3:65ff:fe6c:322e/64 scope link 2023-12-22T08:43:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:21.613 INFO:teuthology.orchestra.run.smithi038.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:43:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T08:43:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::34bf:8aff:fe68:3bf6/64 scope link 2023-12-22T08:43:21.613 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:21.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:21.614 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:43:21.705 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-12-22T08:43:21.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:21.710 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-12-22T08:43:21.767 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-12-22T08:43:21.767 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:43:21.767 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-22T08:43:21.767 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-22T08:43:21.767 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:43:21.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:21.767 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:43:21.767 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:43:21.768 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T08:43:21.768 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T08:43:21.768 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T08:43:21.768 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:43:21.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:21.961 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:43:22.016 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:43:22.016 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-22T08:43:22.017 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:43:22.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:22.018 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-12-22T08:43:22.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:43:22.120 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T08:43:22.179 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:43:22.179 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:43:22.179 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:43:22.233 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-22T08:43:22.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:22.233 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:43:22.385 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:43:22.385 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:43:22.417 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:43:22.417 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:43:22.417 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:43:22.417 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with new device syntax: 0@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:43:22.417 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:43:22.419 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T08:43:22.419 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:43:22.419 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:43:22.419 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:43:22.419 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:43:22.423 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:43:22.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:22.423 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:43:22.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:22.505 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:43:22.575 INFO:teuthology.orchestra.run.smithi038.stdout:client5099 2023-12-22T08:43:22.575 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:43:22.575 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:43:22.625 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:43:22.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.898+0000 7f199690a640 1 Processor -- start 2023-12-22T08:43:22.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.899+0000 7f199690a640 1 -- start start 2023-12-22T08:43:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.900+0000 7f199690a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1990144d10 0x7f19900cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.900+0000 7f199690a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19901450f0 con 0x7f19900cc670 2023-12-22T08:43:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.900+0000 7f199690a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19900ce010 con 0x7f19900b2760 2023-12-22T08:43:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.900+0000 7f199690a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19900ce2f0 con 0x7f1990144d10 2023-12-22T08:43:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.900+0000 7f198ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1990144d10 0x7f19900cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.900+0000 7f198ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1990144d10 0x7f19900cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51118/0 (socket says 172.21.15.38:51118) 2023-12-22T08:43:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.900+0000 7f198ffff640 1 -- 172.21.15.38:0/1119960909 learned_addr learned my addr 172.21.15.38:0/1119960909 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:22.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.900+0000 7f1987fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f19900cc670 0x7f19900b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49738/0 (socket says 172.21.15.38:49738) 2023-12-22T08:43:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.901+0000 7f198ffff640 1 -- 172.21.15.38:0/1119960909 >> v1:172.21.15.89:6789/0 conn(0x7f19900b2760 legacy=0x7f1990070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.901+0000 7f198ffff640 1 -- 172.21.15.38:0/1119960909 >> v1:172.21.15.38:6789/0 conn(0x7f19900cc670 legacy=0x7f19900b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.901+0000 7f198ffff640 1 -- 172.21.15.38:0/1119960909 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19900ce5d0 con 0x7f1990144d10 2023-12-22T08:43:22.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.901+0000 7f198f7fe640 1 -- 172.21.15.38:0/1119960909 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232154694 0 0) 0x7f19901450f0 con 0x7f19900cc670 2023-12-22T08:43:22.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.902+0000 7f198ffff640 1 --2- 172.21.15.38:0/1119960909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1990144d10 0x7f19900cc130 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1980009870 tx=0x7f198002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ff846906a1c06f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:22.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.902+0000 7f198f7fe640 1 -- 172.21.15.38:0/1119960909 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980030850 con 0x7f1990144d10 2023-12-22T08:43:22.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.902+0000 7f198f7fe640 1 -- 172.21.15.38:0/1119960909 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19800309b0 con 0x7f1990144d10 2023-12-22T08:43:22.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.902+0000 7f198f7fe640 1 -- 172.21.15.38:0/1119960909 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980030d40 con 0x7f1990144d10 2023-12-22T08:43:22.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.903+0000 7f199690a640 1 -- 172.21.15.38:0/1119960909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1990144d10 msgr2=0x7f19900cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:22.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.903+0000 7f199690a640 1 --2- 172.21.15.38:0/1119960909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1990144d10 0x7f19900cc130 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1980009870 tx=0x7f198002b990 comp rx=0 tx=0).stop 2023-12-22T08:43:22.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.903+0000 7f199690a640 1 -- 172.21.15.38:0/1119960909 shutdown_connections 2023-12-22T08:43:22.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.903+0000 7f199690a640 1 --2- 172.21.15.38:0/1119960909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1990144d10 0x7f19900cc130 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:22.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.903+0000 7f199690a640 1 -- 172.21.15.38:0/1119960909 >> 172.21.15.38:0/1119960909 conn(0x7f19900cf070 msgr2=0x7f19900cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:22.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.903+0000 7f199690a640 1 -- 172.21.15.38:0/1119960909 shutdown_connections 2023-12-22T08:43:22.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.903+0000 7f199690a640 1 -- 172.21.15.38:0/1119960909 wait complete. 2023-12-22T08:43:22.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.905+0000 7f199690a640 1 Processor -- start 2023-12-22T08:43:22.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.905+0000 7f199690a640 1 -- start start 2023-12-22T08:43:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.906+0000 7f199690a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19900b2760 0x7f1990158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.906+0000 7f199690a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f199015f7a0 0x7f19900711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.906+0000 7f199690a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f199015fc20 0x7f19900716e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.906+0000 7f199690a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19901374f0 con 0x7f199015f7a0 2023-12-22T08:43:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.906+0000 7f199690a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199015e9e0 con 0x7f199015fc20 2023-12-22T08:43:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.906+0000 7f199690a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199015ecc0 con 0x7f19900b2760 2023-12-22T08:43:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.906+0000 7f1987fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f199015f7a0 0x7f19900711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.906+0000 7f1987fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f199015f7a0 0x7f19900711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51134/0 (socket says 172.21.15.38:51134) 2023-12-22T08:43:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.906+0000 7f1987fff640 1 -- 172.21.15.38:0/384676063 learned_addr learned my addr 172.21.15.38:0/384676063 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.907+0000 7f198ffff640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19900b2760 0x7f1990158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.907+0000 7f1994ea7640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f199015fc20 0x7f19900716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:22.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.907+0000 7f1987fff640 1 -- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19900b2760 msgr2=0x7f1990158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.907+0000 7f1987fff640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19900b2760 0x7f1990158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.907+0000 7f1987fff640 1 -- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f199015fc20 msgr2=0x7f19900716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.907+0000 7f1987fff640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f199015fc20 0x7f19900716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.907+0000 7f1987fff640 1 -- 172.21.15.38:0/384676063 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19800094d0 con 0x7f199015f7a0 2023-12-22T08:43:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.907+0000 7f198ffff640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19900b2760 0x7f1990158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.907+0000 7f1994ea7640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f199015fc20 0x7f19900716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:43:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.907+0000 7f1987fff640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f199015f7a0 0x7f19900711a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f197800c410 tx=0x7f197800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.907+0000 7f198d7fa640 1 -- 172.21.15.38:0/384676063 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19780074e0 con 0x7f199015f7a0 2023-12-22T08:43:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.907+0000 7f198d7fa640 1 -- 172.21.15.38:0/384676063 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978007660 con 0x7f199015f7a0 2023-12-22T08:43:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.907+0000 7f198d7fa640 1 -- 172.21.15.38:0/384676063 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978004a20 con 0x7f199015f7a0 2023-12-22T08:43:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.908+0000 7f199690a640 1 -- 172.21.15.38:0/384676063 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199015efa0 con 0x7f199015f7a0 2023-12-22T08:43:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.908+0000 7f199690a640 1 -- 172.21.15.38:0/384676063 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1990159270 con 0x7f199015f7a0 2023-12-22T08:43:22.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.909+0000 7f199690a640 1 -- 172.21.15.38:0/384676063 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199015eb20 con 0x7f199015f7a0 2023-12-22T08:43:22.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.910+0000 7f198d7fa640 1 -- 172.21.15.38:0/384676063 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1978004b80 con 0x7f199015f7a0 2023-12-22T08:43:22.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.911+0000 7f198d7fa640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f197006a430 0x7f197006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:22.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.911+0000 7f198d7fa640 1 -- 172.21.15.38:0/384676063 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1978088790 con 0x7f199015f7a0 2023-12-22T08:43:22.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.911+0000 7f198ffff640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f197006a430 0x7f197006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:22.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.912+0000 7f198ffff640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f197006a430 0x7f197006c8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1980036000 tx=0x7f198003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:22.915+0000 7f198d7fa640 1 -- 172.21.15.38:0/384676063 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f199015eb20 con 0x7f199015f7a0 2023-12-22T08:43:23.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.147+0000 7f199690a640 1 -- 172.21.15.38:0/384676063 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f199015eb20 con 0x7f199015f7a0 2023-12-22T08:43:23.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.148+0000 7f198d7fa640 1 -- 172.21.15.38:0/384676063 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f199015eb20 con 0x7f199015f7a0 2023-12-22T08:43:23.150 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:43:23.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.150+0000 7f199690a640 1 -- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f197006a430 msgr2=0x7f197006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:23.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.150+0000 7f199690a640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f197006a430 0x7f197006c8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1980036000 tx=0x7f198003b040 comp rx=0 tx=0).stop 2023-12-22T08:43:23.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.150+0000 7f199690a640 1 -- 172.21.15.38:0/384676063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f199015f7a0 msgr2=0x7f19900711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:23.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.150+0000 7f199690a640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f199015f7a0 0x7f19900711a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f197800c410 tx=0x7f197800c8d0 comp rx=0 tx=0).stop 2023-12-22T08:43:23.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.150+0000 7f199690a640 1 -- 172.21.15.38:0/384676063 shutdown_connections 2023-12-22T08:43:23.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.150+0000 7f199690a640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f199015fc20 0x7f19900716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:23.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.150+0000 7f199690a640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f197006a430 0x7f197006c8f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:23.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.150+0000 7f199690a640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f199015f7a0 0x7f19900711a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:23.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.150+0000 7f199690a640 1 --2- 172.21.15.38:0/384676063 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f19900b2760 0x7f1990158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:23.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.151+0000 7f199690a640 1 -- 172.21.15.38:0/384676063 >> 172.21.15.38:0/384676063 conn(0x7f19900cf070 msgr2=0x7f199015bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:23.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.151+0000 7f199690a640 1 -- 172.21.15.38:0/384676063 shutdown_connections 2023-12-22T08:43:23.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:23.151+0000 7f199690a640 1 -- 172.21.15.38:0/384676063 wait complete. 2023-12-22T08:43:23.173 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:43:23.173 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:43:23.173 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-22T08:43:23.173 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T08:43:23.173 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T08:43:23.173 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:43:23.174 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:43:23.174 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:43:23.174 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:43:23.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:23.174 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-22T08:43:23.231 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:43:23.231 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:43:23.231 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:43:23.231 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:43:23.232 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42158sec preferred_lft 42158sec 2023-12-22T08:43:23.233 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-22T08:43:23.233 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:23.233 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:43:23.233 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:43:23.233 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:43:23.233 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:23.233 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::9cc2:a9ff:fe75:e812/64 scope link 2023-12-22T08:43:23.233 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:23.233 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:43:23.233 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8e:46:07:65:e3:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T08:43:23.233 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::8c46:7ff:fe65:e31f/64 scope link 2023-12-22T08:43:23.233 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:23.233 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:43:23.234 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T08:43:23.234 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2cc2:baff:fe6f:ea22/64 scope link 2023-12-22T08:43:23.234 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:43:23.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:23.235 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:43:23.318 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-22T08:43:23.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:23.322 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-22T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-22T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:43:23.379 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:43:23.380 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:43:23.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:23.380 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:43:23.380 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:43:23.380 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:43:23.380 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:43:23.380 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:43:23.380 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:43:23.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:23.559 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:43:23.609 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T08:43:23.610 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-22T08:43:23.610 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:43:23.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:23.610 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-22T08:43:23.697 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:43:23.697 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T08:43:23.752 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:43:23.752 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:43:23.752 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:43:23.802 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-22T08:43:23.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:23.802 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:43:23.944 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:43:23.976 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:43:23.976 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:43:23.976 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:43:23.976 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 1@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:43:23.977 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:43:23.978 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T08:43:23.978 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:43:23.978 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:43:23.978 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:43:23.978 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:43:23.982 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:43:23.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:23.982 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:43:24.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:43:24.058 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:43:24.114 INFO:teuthology.orchestra.run.smithi089.stdout:client5102 2023-12-22T08:43:24.114 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:43:24.114 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:43:24.162 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:43:24.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.398+0000 7f430536e640 1 Processor -- start 2023-12-22T08:43:24.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.398+0000 7f430536e640 1 -- start start 2023-12-22T08:43:24.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.399+0000 7f430536e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f430015b420 0x7f430006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:24.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.399+0000 7f430536e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4300071000 0x7f430015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:24.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.399+0000 7f430536e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43000cdae0 con 0x7f43000a44a0 2023-12-22T08:43:24.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.399+0000 7f430536e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430006dec0 con 0x7f4300071000 2023-12-22T08:43:24.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.399+0000 7f430536e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430015b800 con 0x7f430015b420 2023-12-22T08:43:24.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.400+0000 7f4304b6d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4300071000 0x7f430015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:24.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.400+0000 7f4304b6d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4300071000 0x7f430015baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51144/0 (socket says 172.21.15.38:51144) 2023-12-22T08:43:24.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.400+0000 7f4304b6d640 1 -- 172.21.15.38:0/3070639263 learned_addr learned my addr 172.21.15.38:0/3070639263 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:24.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.400+0000 7f42fffff640 1 --2- 172.21.15.38:0/3070639263 >> v2:172.21.15.89:3300/0 conn(0x7f430015b420 0x7f430006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:24.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.400+0000 7f4304b6d640 1 -- 172.21.15.38:0/3070639263 >> v2:172.21.15.89:3300/0 conn(0x7f430015b420 msgr2=0x7f430006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:24.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.400+0000 7f4304b6d640 1 --2- 172.21.15.38:0/3070639263 >> v2:172.21.15.89:3300/0 conn(0x7f430015b420 0x7f430006d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:24.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.400+0000 7f4304b6d640 1 -- 172.21.15.38:0/3070639263 >> v1:172.21.15.89:6789/0 conn(0x7f43000a44a0 legacy=0x7f43000708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:43:24.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.400+0000 7f4304b6d640 1 -- 172.21.15.38:0/3070639263 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43000cdd30 con 0x7f4300071000 2023-12-22T08:43:24.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.401+0000 7f4304b6d640 1 --2- 172.21.15.38:0/3070639263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4300071000 0x7f430015baa0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f43000613e0 tx=0x7f42f802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d022d2a3ffda53 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:24.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.402+0000 7f42feffd640 1 -- 172.21.15.38:0/3070639263 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f802ca80 con 0x7f4300071000 2023-12-22T08:43:24.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.402+0000 7f42feffd640 1 -- 172.21.15.38:0/3070639263 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f802cbe0 con 0x7f4300071000 2023-12-22T08:43:24.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.402+0000 7f42feffd640 1 -- 172.21.15.38:0/3070639263 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f80343f0 con 0x7f4300071000 2023-12-22T08:43:24.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.402+0000 7f430536e640 1 -- 172.21.15.38:0/3070639263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4300071000 msgr2=0x7f430015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:24.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.402+0000 7f430536e640 1 --2- 172.21.15.38:0/3070639263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4300071000 0x7f430015baa0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f43000613e0 tx=0x7f42f802bee0 comp rx=0 tx=0).stop 2023-12-22T08:43:24.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.402+0000 7f430536e640 1 -- 172.21.15.38:0/3070639263 shutdown_connections 2023-12-22T08:43:24.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.402+0000 7f430536e640 1 --2- 172.21.15.38:0/3070639263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4300071000 0x7f430015baa0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:24.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.402+0000 7f430536e640 1 --2- 172.21.15.38:0/3070639263 >> v2:172.21.15.89:3300/0 conn(0x7f430015b420 0x7f430006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:24.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.402+0000 7f430536e640 1 -- 172.21.15.38:0/3070639263 >> 172.21.15.38:0/3070639263 conn(0x7f43000b1f70 msgr2=0x7f43000b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:24.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.403+0000 7f430536e640 1 -- 172.21.15.38:0/3070639263 shutdown_connections 2023-12-22T08:43:24.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.403+0000 7f430536e640 1 -- 172.21.15.38:0/3070639263 wait complete. 2023-12-22T08:43:24.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.404+0000 7f430536e640 1 Processor -- start 2023-12-22T08:43:24.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.404+0000 7f430536e640 1 -- start start 2023-12-22T08:43:24.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.405+0000 7f430536e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4300071000 0x7f43000a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:24.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.405+0000 7f430536e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43000a44a0 0x7f430014d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:24.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.405+0000 7f430536e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f430015b420 0x7f43000b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:24.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.405+0000 7f430536e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430014e190 con 0x7f43000a44a0 2023-12-22T08:43:24.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.405+0000 7f430536e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43000a1fb0 con 0x7f4300071000 2023-12-22T08:43:24.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.405+0000 7f430536e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43000a2290 con 0x7f430015b420 2023-12-22T08:43:24.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.406+0000 7f42ff7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43000a44a0 0x7f430014d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:24.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.406+0000 7f42ff7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43000a44a0 0x7f430014d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51148/0 (socket says 172.21.15.38:51148) 2023-12-22T08:43:24.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.406+0000 7f42ff7fe640 1 -- 172.21.15.38:0/3820605348 learned_addr learned my addr 172.21.15.38:0/3820605348 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:43:24.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.406+0000 7f42fffff640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4300071000 0x7f43000a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:24.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.406+0000 7f4304b6d640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f430015b420 0x7f43000b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:24.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.406+0000 7f42ff7fe640 1 -- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f430015b420 msgr2=0x7f43000b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:24.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.406+0000 7f42ff7fe640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f430015b420 0x7f43000b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:24.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.406+0000 7f42ff7fe640 1 -- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4300071000 msgr2=0x7f43000a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:24.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.406+0000 7f42ff7fe640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4300071000 0x7f43000a2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:24.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.406+0000 7f42ff7fe640 1 -- 172.21.15.38:0/3820605348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8009b30 con 0x7f43000a44a0 2023-12-22T08:43:24.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.407+0000 7f42ff7fe640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43000a44a0 0x7f430014d730 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009fd0 tx=0x7f42f400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:24.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.407+0000 7f42fcff9640 1 -- 172.21.15.38:0/3820605348 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4011830 con 0x7f43000a44a0 2023-12-22T08:43:24.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.407+0000 7f42fcff9640 1 -- 172.21.15.38:0/3820605348 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f4011990 con 0x7f43000a44a0 2023-12-22T08:43:24.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.407+0000 7f42fcff9640 1 -- 172.21.15.38:0/3820605348 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4011d20 con 0x7f43000a44a0 2023-12-22T08:43:24.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.407+0000 7f430536e640 1 -- 172.21.15.38:0/3820605348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43000a2570 con 0x7f43000a44a0 2023-12-22T08:43:24.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.407+0000 7f430536e640 1 -- 172.21.15.38:0/3820605348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430014dc70 con 0x7f43000a44a0 2023-12-22T08:43:24.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.408+0000 7f430536e640 1 -- 172.21.15.38:0/3820605348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43000a2a90 con 0x7f43000a44a0 2023-12-22T08:43:24.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.409+0000 7f42fcff9640 1 -- 172.21.15.38:0/3820605348 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f42f401a400 con 0x7f43000a44a0 2023-12-22T08:43:24.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.410+0000 7f42fcff9640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f42ec06a430 0x7f42ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:43:24.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.410+0000 7f42fcff9640 1 -- 172.21.15.38:0/3820605348 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42f4088af0 con 0x7f43000a44a0 2023-12-22T08:43:24.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.411+0000 7f42fffff640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f42ec06a430 0x7f42ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:43:24.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.412+0000 7f42fffff640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f42ec06a430 0x7f42ec06c8f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f430015d030 tx=0x7f42f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:43:24.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.415+0000 7f42fcff9640 1 -- 172.21.15.38:0/3820605348 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f43000a2a90 con 0x7f43000a44a0 2023-12-22T08:43:24.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.647+0000 7f430536e640 1 -- 172.21.15.38:0/3820605348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43000a2a90 con 0x7f43000a44a0 2023-12-22T08:43:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.648+0000 7f42fcff9640 1 -- 172.21.15.38:0/3820605348 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4645 (secure 0 0 0) 0x7f43000a2a90 con 0x7f43000a44a0 2023-12-22T08:43:24.650 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:43:24.650 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3287488986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3287488986},{"type":"v1","addr":"172.21.15.89:6836","nonce":3287488986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2154639115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2154639115},{"type":"v1","addr":"172.21.15.89:6837","nonce":2154639115}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/807798598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":807798598},{"type":"v1","addr":"172.21.15.38:6833","nonce":807798598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:43:08.736828+0000","modified":"2023-12-22T08:43:12.231629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1778808252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1778808252},{"type":"v1","addr":"172.21.15.38:6835","nonce":1778808252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-22T08:43:24.651 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 32 2023-12-22T08:43:24.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.651+0000 7f430536e640 1 -- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f42ec06a430 msgr2=0x7f42ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:24.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.651+0000 7f430536e640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f42ec06a430 0x7f42ec06c8f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f430015d030 tx=0x7f42f0008040 comp rx=0 tx=0).stop 2023-12-22T08:43:24.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.651+0000 7f430536e640 1 -- 172.21.15.38:0/3820605348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43000a44a0 msgr2=0x7f430014d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:43:24.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.651+0000 7f430536e640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43000a44a0 0x7f430014d730 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009fd0 tx=0x7f42f400b870 comp rx=0 tx=0).stop 2023-12-22T08:43:24.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.651+0000 7f430536e640 1 -- 172.21.15.38:0/3820605348 shutdown_connections 2023-12-22T08:43:24.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.651+0000 7f430536e640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f430015b420 0x7f43000b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:24.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.651+0000 7f430536e640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f42ec06a430 0x7f42ec06c8f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:24.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.651+0000 7f430536e640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43000a44a0 0x7f430014d730 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:24.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.651+0000 7f430536e640 1 --2- 172.21.15.38:0/3820605348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4300071000 0x7f43000a2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:43:24.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.651+0000 7f430536e640 1 -- 172.21.15.38:0/3820605348 >> 172.21.15.38:0/3820605348 conn(0x7f43000b1f70 msgr2=0x7f43000a3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:43:24.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.651+0000 7f430536e640 1 -- 172.21.15.38:0/3820605348 shutdown_connections 2023-12-22T08:43:24.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:43:24.651+0000 7f430536e640 1 -- 172.21.15.38:0/3820605348 wait complete. 2023-12-22T08:43:24.673 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-22T08:43:24.918 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":6012,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":16.157416504,"mdsmap_epoch":32,"osdmap_epoch":72,"osdmap_epoch_barrier":72,"uptime":21.282026298000002} 2023-12-22T08:43:24.919 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 6012, "mdsmap_epoch": 32, "osdmap_epoch": 72, "osdmap_epoch_barrier": 72, "rank_uptime": 16.157416504, "state": "up:active", "uptime": 21.282026298, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:43:24.919 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-22T08:43:25.162 INFO:teuthology.orchestra.run.smithi038.stdout:{"osd_mon_report_interval":"5"} 2023-12-22T08:43:25.163 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-22T08:43:25.163 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-22T08:43:25.398 INFO:teuthology.orchestra.run.smithi038.stdout:{"mon_tick_interval":"5"} 2023-12-22T08:43:25.398 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-22T08:43:25.398 INFO:tasks.cephfs.test_full:pool capacity 557033024, 531MB should be enough to fill it 2023-12-22T08:43:25.398 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T08:43:25.398 DEBUG:teuthology.orchestra.run.smithi038:> import time 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> import datetime 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> import subprocess 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> import os 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> # Write some buffered data through before going full, all should be well 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> print("writing some data through which we expect to succeed") 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> bytes = 0 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(f) 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:43:25.399 DEBUG:teuthology.orchestra.run.smithi038:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> # buffered IO, the error should always only appear from fsync and not 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> # from write 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> full = False 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> for n in range(0, int(531 * 0.9)): 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> print("done writing {0} bytes".format(bytes)) 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> # OK, now we should sneak in under the full condition 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> # due to the time it takes the OSDs to report to the 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> # mons, and get a successful fsync on our full-making data 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(f) 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-12-22T08:43:25.400 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> # buffered write, add more dirty data to the buffer 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> print("starting buffered write") 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> try: 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> for n in range(0, int(531 * 0.2)): 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> time.sleep(15.0) 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> except OSError: 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> pass; 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> # Wait long enough for a background flush that should fail 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> time.sleep(30) 2023-12-22T08:43:25.401 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> if False: 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> # ...and check that the failed background flush is reflected in fclose 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> try: 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> os.close(f) 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> except OSError: 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> print("close() returned an error as expected") 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> else: 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> raise RuntimeError("close() failed to raise error") 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> else: 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> # The kernel cephfs client does not raise errors on fclose 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> os.close(f) 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-22T08:43:25.402 DEBUG:teuthology.orchestra.run.smithi038:> ' 2023-12-22T08:43:28.868 INFO:teuthology.orchestra.run.smithi038.stdout:writing some data through which we expect to succeed 2023-12-22T08:43:28.868 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-22T08:43:28.868 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-12-22T08:43:28.868 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-12-22T08:43:28.868 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-12-22T08:43:28.868 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-12-22T08:43:28.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-12-22T08:43:28.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-12-22T08:43:28.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-12-22T08:43:28.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-12-22T08:43:28.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-12-22T08:43:28.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-12-22T08:43:28.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-12-22T08:43:28.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-12-22T08:43:28.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-12-22T08:43:28.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-12-22T08:43:28.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-12-22T08:43:28.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-12-22T08:43:28.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-12-22T08:43:28.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-12-22T08:43:28.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-12-22T08:43:28.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-12-22T08:43:28.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-12-22T08:43:28.874 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-12-22T08:43:28.875 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-12-22T08:43:28.876 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-12-22T08:43:28.876 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-12-22T08:43:28.876 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-12-22T08:43:28.876 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-12-22T08:43:28.876 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-12-22T08:43:28.876 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-12-22T08:43:28.876 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-12-22T08:43:28.876 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-12-22T08:43:28.877 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-12-22T08:43:28.878 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-12-22T08:43:28.881 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-12-22T08:43:28.881 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-12-22T08:43:28.881 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-12-22T08:43:28.881 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-12-22T08:43:28.881 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-12-22T08:43:28.881 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-12-22T08:43:28.881 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-12-22T08:43:28.881 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-12-22T08:43:28.882 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-12-22T08:43:28.883 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-12-22T08:43:28.883 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-12-22T08:43:28.883 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-12-22T08:43:28.883 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-12-22T08:43:28.883 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-12-22T08:43:29.049 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-12-22T08:43:29.049 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-12-22T08:43:29.049 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-12-22T08:43:29.049 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-12-22T08:43:29.049 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-12-22T08:43:29.050 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-12-22T08:43:29.050 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-12-22T08:43:29.050 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-12-22T08:43:29.050 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-12-22T08:43:29.050 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-12-22T08:43:29.050 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-12-22T08:43:29.050 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-12-22T08:43:29.050 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-12-22T08:43:29.050 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-12-22T08:43:29.050 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-12-22T08:43:29.050 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-12-22T08:43:29.050 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-12-22T08:43:29.051 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-12-22T08:43:29.052 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-12-22T08:43:29.053 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-12-22T08:43:29.054 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-12-22T08:43:29.054 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-12-22T08:43:29.054 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-12-22T08:43:29.054 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-12-22T08:43:29.054 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-12-22T08:43:29.054 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-12-22T08:43:29.054 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-12-22T08:43:29.055 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-12-22T08:43:29.055 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-12-22T08:43:29.055 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-12-22T08:43:29.055 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-12-22T08:43:29.055 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-12-22T08:43:29.055 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-12-22T08:43:29.055 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-12-22T08:43:29.055 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-12-22T08:43:29.055 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-12-22T08:43:29.055 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-12-22T08:43:29.055 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-12-22T08:43:29.056 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-12-22T08:43:29.057 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-12-22T08:43:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-12-22T08:43:29.059 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-12-22T08:43:29.059 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-12-22T08:43:29.059 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-12-22T08:43:29.059 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-12-22T08:43:29.059 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-12-22T08:43:29.059 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-12-22T08:43:29.059 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-12-22T08:43:29.059 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-12-22T08:43:29.059 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-12-22T08:43:29.059 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-12-22T08:43:29.059 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-12-22T08:43:29.060 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-12-22T08:43:29.061 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-12-22T08:43:29.061 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-12-22T08:43:29.061 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-12-22T08:43:29.061 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-12-22T08:43:29.061 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-12-22T08:43:29.061 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-12-22T08:43:29.061 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-12-22T08:43:29.231 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-12-22T08:43:29.231 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-12-22T08:43:29.231 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-12-22T08:43:29.231 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-12-22T08:43:29.231 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-12-22T08:43:29.231 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-12-22T08:43:29.231 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-12-22T08:43:29.231 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-12-22T08:43:29.232 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-12-22T08:43:29.233 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-12-22T08:43:29.234 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-12-22T08:43:29.235 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-12-22T08:43:29.236 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-12-22T08:43:29.237 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-12-22T08:43:29.237 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-12-22T08:43:29.237 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-12-22T08:43:29.237 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-12-22T08:43:29.237 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-12-22T08:43:29.237 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-12-22T08:43:29.237 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-12-22T08:43:29.237 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-12-22T08:43:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-12-22T08:43:29.239 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-12-22T08:43:29.240 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-12-22T08:43:29.241 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-12-22T08:43:29.242 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-12-22T08:43:29.242 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-12-22T08:43:29.242 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-12-22T08:43:29.242 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-12-22T08:43:29.242 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-12-22T08:43:29.242 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-12-22T08:43:29.242 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-12-22T08:43:29.242 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-12-22T08:43:29.242 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-12-22T08:43:29.242 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-12-22T08:43:32.182 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:43:32.180+0000 7f0a296e8640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-12-22T08:43:41.158 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:43:41.157+0000 7f0a296e8640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-12-22T08:43:46.902 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:43:46.912 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:43:55.321 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:43:55.319+0000 7f0a296e8640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL) 2023-12-22T08:44:17.049 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:44:17.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:44:30.307 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-12-22T08:44:30.308 INFO:teuthology.orchestra.run.smithi038.stdout:done writing 500695040 bytes 2023-12-22T08:44:30.309 INFO:teuthology.orchestra.run.smithi038.stdout:successfully fsync'ed prior to getting full state reported 2023-12-22T08:44:30.309 INFO:teuthology.orchestra.run.smithi038.stdout:starting buffered write 2023-12-22T08:44:30.309 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:44:30.309 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:44:30.309 INFO:teuthology.orchestra.run.smithi038.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-12-22T08:44:30.449 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:44:30.449 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:44:30.577 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:44:30.700 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:44:30.701 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:44:30.701 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:44:30.765 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:44:30.766 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:44:30.823 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:44:31.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.050+0000 7f4235a4c640 1 Processor -- start 2023-12-22T08:44:31.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.050+0000 7f4235a4c640 1 -- start start 2023-12-22T08:44:31.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.052+0000 7f4235a4c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f42300b24b0 0x7f4230070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.053+0000 7f4235a4c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42301450f0 con 0x7f42300b2050 2023-12-22T08:44:31.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.053+0000 7f4235a4c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42300cc840 con 0x7f4230144d10 2023-12-22T08:44:31.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.053+0000 7f4235a4c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42300ce010 con 0x7f42300b24b0 2023-12-22T08:44:31.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.053+0000 7f42267fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f42300b2050 0x7f4230070800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34170/0 (socket says 172.21.15.38:34170) 2023-12-22T08:44:31.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.053+0000 7f42267fc640 1 -- 172.21.15.38:0/88066318 learned_addr learned my addr 172.21.15.38:0/88066318 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:31.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.053+0000 7f422f7fe640 1 --2- 172.21.15.38:0/88066318 >> v2:172.21.15.89:3300/0 conn(0x7f42300b24b0 0x7f4230070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.053+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62568612 0 0) 0x7f42301450f0 con 0x7f42300b2050 2023-12-22T08:44:31.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f421c003520 con 0x7f42300b2050 2023-12-22T08:44:31.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3346822812 0 0) 0x7f421c003520 con 0x7f42300b2050 2023-12-22T08:44:31.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 >> v2:172.21.15.89:3300/0 conn(0x7f42300b24b0 msgr2=0x7f4230070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:31.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 --2- 172.21.15.38:0/88066318 >> v2:172.21.15.89:3300/0 conn(0x7f42300b24b0 0x7f4230070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 >> v1:172.21.15.89:6789/0 conn(0x7f4230144d10 legacy=0x7f42300cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42300ce2f0 con 0x7f42300b2050 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f42180019f0 con 0x7f42300b2050 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 >> v1:172.21.15.38:6789/0 conn(0x7f42300b2050 legacy=0x7f4230070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 --2- 172.21.15.38:0/88066318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f421c003970 0x7f421c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 --2- 172.21.15.38:0/88066318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f421c0047c0 0x7f421c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 --2- 172.21.15.38:0/88066318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f421c005180 0x7f421c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42300ce010 con 0x7f421c005180 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c00c020 con 0x7f421c003970 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.054+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c00c1e0 con 0x7f421c0047c0 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.055+0000 7f422f7fe640 1 --2- 172.21.15.38:0/88066318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f421c005180 0x7f421c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.055+0000 7f422effd640 1 --2- 172.21.15.38:0/88066318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f421c003970 0x7f421c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.055+0000 7f422f7fe640 1 -- 172.21.15.38:0/88066318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f421c0047c0 msgr2=0x7f421c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.055+0000 7f42267fc640 1 --2- 172.21.15.38:0/88066318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f421c0047c0 0x7f421c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.055+0000 7f422f7fe640 1 --2- 172.21.15.38:0/88066318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f421c0047c0 0x7f421c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.055+0000 7f422f7fe640 1 -- 172.21.15.38:0/88066318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f421c003970 msgr2=0x7f421c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:31.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.055+0000 7f422f7fe640 1 --2- 172.21.15.38:0/88066318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f421c003970 0x7f421c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.055+0000 7f422f7fe640 1 -- 172.21.15.38:0/88066318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c003520 con 0x7f421c005180 2023-12-22T08:44:31.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.055+0000 7f422effd640 1 --2- 172.21.15.38:0/88066318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f421c003970 0x7f421c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:44:31.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.056+0000 7f422f7fe640 1 -- 172.21.15.38:0/88066318 reap_dead start 2023-12-22T08:44:31.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.056+0000 7f422f7fe640 1 --2- 172.21.15.38:0/88066318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f421c005180 0x7f421c00b980 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4228009ac0 tx=0x7f421c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861cb8c776f905 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:31.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.056+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228004020 con 0x7f421c005180 2023-12-22T08:44:31.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.056+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4228004180 con 0x7f421c005180 2023-12-22T08:44:31.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.056+0000 7f422e7fc640 1 -- 172.21.15.38:0/88066318 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422802c710 con 0x7f421c005180 2023-12-22T08:44:31.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.057+0000 7f4235a4c640 1 -- 172.21.15.38:0/88066318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f421c005180 msgr2=0x7f421c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.057+0000 7f4235a4c640 1 --2- 172.21.15.38:0/88066318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f421c005180 0x7f421c00b980 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4228009ac0 tx=0x7f421c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.057+0000 7f4235a4c640 1 -- 172.21.15.38:0/88066318 shutdown_connections 2023-12-22T08:44:31.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.057+0000 7f4235a4c640 1 --2- 172.21.15.38:0/88066318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f421c005180 0x7f421c00b980 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.057+0000 7f4235a4c640 1 -- 172.21.15.38:0/88066318 >> 172.21.15.38:0/88066318 conn(0x7f42300cf070 msgr2=0x7f42300cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:31.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.057+0000 7f4235a4c640 1 -- 172.21.15.38:0/88066318 shutdown_connections 2023-12-22T08:44:31.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.057+0000 7f4235a4c640 1 -- 172.21.15.38:0/88066318 wait complete. 2023-12-22T08:44:31.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.059+0000 7f4235a4c640 1 Processor -- start 2023-12-22T08:44:31.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.059+0000 7f4235a4c640 1 -- start start 2023-12-22T08:44:31.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.060+0000 7f4235a4c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f421c005180 0x7f4230142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.060+0000 7f4235a4c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42300a84d0 0x7f423015ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.060+0000 7f4235a4c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f423015f350 0x7f423015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.060+0000 7f4235a4c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423015dd70 con 0x7f423015f350 2023-12-22T08:44:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.060+0000 7f4235a4c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423015e050 con 0x7f421c005180 2023-12-22T08:44:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.060+0000 7f4235a4c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423015e330 con 0x7f42300a84d0 2023-12-22T08:44:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.060+0000 7f422f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f423015f350 0x7f423015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.060+0000 7f422f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f423015f350 0x7f423015a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47078/0 (socket says 172.21.15.38:47078) 2023-12-22T08:44:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.060+0000 7f422f7fe640 1 -- 172.21.15.38:0/162585158 learned_addr learned my addr 172.21.15.38:0/162585158 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.061+0000 7f422effd640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f421c005180 0x7f4230142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.061+0000 7f422f7fe640 1 -- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42300a84d0 msgr2=0x7f423015ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.061+0000 7f422f7fe640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42300a84d0 0x7f423015ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.061+0000 7f422f7fe640 1 -- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f421c005180 msgr2=0x7f4230142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.061+0000 7f422f7fe640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f421c005180 0x7f4230142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.061+0000 7f422f7fe640 1 -- 172.21.15.38:0/162585158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423015e610 con 0x7f423015f350 2023-12-22T08:44:31.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.061+0000 7f422effd640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f421c005180 0x7f4230142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:31.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.061+0000 7f422f7fe640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f423015f350 0x7f423015a8b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f422802c380 tx=0x7f4228004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:31.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.061+0000 7f422cff9640 1 -- 172.21.15.38:0/162585158 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422803a070 con 0x7f423015f350 2023-12-22T08:44:31.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.061+0000 7f422cff9640 1 -- 172.21.15.38:0/162585158 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4228004500 con 0x7f423015f350 2023-12-22T08:44:31.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.061+0000 7f422cff9640 1 -- 172.21.15.38:0/162585158 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228003830 con 0x7f423015f350 2023-12-22T08:44:31.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.061+0000 7f4235a4c640 1 -- 172.21.15.38:0/162585158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423015e8f0 con 0x7f423015f350 2023-12-22T08:44:31.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.062+0000 7f4235a4c640 1 -- 172.21.15.38:0/162585158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42300b0460 con 0x7f423015f350 2023-12-22T08:44:31.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.063+0000 7f4235a4c640 1 -- 172.21.15.38:0/162585158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423015eb30 con 0x7f423015f350 2023-12-22T08:44:31.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.064+0000 7f422cff9640 1 -- 172.21.15.38:0/162585158 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4228003990 con 0x7f423015f350 2023-12-22T08:44:31.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.064+0000 7f422cff9640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f421006a430 0x7f421006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.065+0000 7f422cff9640 1 -- 172.21.15.38:0/162585158 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f42280a92a0 con 0x7f423015f350 2023-12-22T08:44:31.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.065+0000 7f422cff9640 1 -- 172.21.15.38:0/162585158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f4210072020 con 0x7f423015f350 2023-12-22T08:44:31.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.065+0000 7f422effd640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f421006a430 0x7f421006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.066+0000 7f422effd640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f421006a430 0x7f421006c8f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4220000c00 tx=0x7f4220009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:31.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.069+0000 7f422cff9640 1 -- 172.21.15.38:0/162585158 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4228045020 con 0x7f423015f350 2023-12-22T08:44:31.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.272+0000 7f4235a4c640 1 -- 172.21.15.38:0/162585158 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4230061910 con 0x7f423015f350 2023-12-22T08:44:31.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.274+0000 7f422cff9640 1 -- 172.21.15.38:0/162585158 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16196 (secure 0 0 0) 0x7f423015eb30 con 0x7f423015f350 2023-12-22T08:44:31.276 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:31.276 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":76,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:43:50.280215+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:43:07.088485+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-22T08:43:07.718532+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","full","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.19","mappings":[{"from":6,"to":1}]},{"pgid":"9.3f","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:44:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.277+0000 7f4235a4c640 1 -- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f421006a430 msgr2=0x7f421006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.277+0000 7f4235a4c640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f421006a430 0x7f421006c8f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4220000c00 tx=0x7f4220009040 comp rx=0 tx=0).stop 2023-12-22T08:44:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.277+0000 7f4235a4c640 1 -- 172.21.15.38:0/162585158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f423015f350 msgr2=0x7f423015a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.277+0000 7f4235a4c640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f423015f350 0x7f423015a8b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f422802c380 tx=0x7f4228004730 comp rx=0 tx=0).stop 2023-12-22T08:44:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.277+0000 7f4235a4c640 1 -- 172.21.15.38:0/162585158 shutdown_connections 2023-12-22T08:44:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.277+0000 7f4235a4c640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f421006a430 0x7f421006c8f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.277+0000 7f4235a4c640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f423015f350 0x7f423015a8b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.277+0000 7f4235a4c640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42300a84d0 0x7f423015ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.277+0000 7f4235a4c640 1 --2- 172.21.15.38:0/162585158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f421c005180 0x7f4230142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.277+0000 7f4235a4c640 1 -- 172.21.15.38:0/162585158 >> 172.21.15.38:0/162585158 conn(0x7f42300cf070 msgr2=0x7f4230159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.277+0000 7f4235a4c640 1 -- 172.21.15.38:0/162585158 shutdown_connections 2023-12-22T08:44:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.278+0000 7f4235a4c640 1 -- 172.21.15.38:0/162585158 wait complete. 2023-12-22T08:44:31.300 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:43:07.088485+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:43:07.718532+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:44:31.300 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:44:31.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.528+0000 7feb6ffff640 1 Processor -- start 2023-12-22T08:44:31.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.528+0000 7feb6ffff640 1 -- start start 2023-12-22T08:44:31.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.529+0000 7feb6ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feb70071080 0x7feb700d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.529+0000 7feb6ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb7015d5a0 0x7feb700d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.529+0000 7feb6ffff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7015de50 con 0x7feb7015d1c0 2023-12-22T08:44:31.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.530+0000 7feb6ffff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb700d0dd0 con 0x7feb70071080 2023-12-22T08:44:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.530+0000 7feb6ffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb700d10b0 con 0x7feb7015d5a0 2023-12-22T08:44:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.530+0000 7feb6e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feb70071080 0x7feb700d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.530+0000 7feb6f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb7015d5a0 0x7feb700d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.530+0000 7feb6f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb7015d5a0 0x7feb700d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:51366/0 (socket says 172.21.15.38:51366) 2023-12-22T08:44:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.530+0000 7feb6f7fe640 1 -- 172.21.15.38:0/3735503993 learned_addr learned my addr 172.21.15.38:0/3735503993 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:31.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.531+0000 7feb6f7fe640 1 -- 172.21.15.38:0/3735503993 >> v2:172.21.15.89:3300/0 conn(0x7feb70071080 msgr2=0x7feb700d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:31.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.531+0000 7feb6f7fe640 1 --2- 172.21.15.38:0/3735503993 >> v2:172.21.15.89:3300/0 conn(0x7feb70071080 0x7feb700d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.531+0000 7feb6f7fe640 1 -- 172.21.15.38:0/3735503993 >> v1:172.21.15.89:6789/0 conn(0x7feb7015d1c0 legacy=0x7feb70070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.531+0000 7feb6f7fe640 1 -- 172.21.15.38:0/3735503993 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7015dae0 con 0x7feb7015d5a0 2023-12-22T08:44:31.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.533+0000 7feb6f7fe640 1 --2- 172.21.15.38:0/3735503993 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb7015d5a0 0x7feb700d05a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feb68009870 tx=0x7feb6802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=665d249740a789e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:31.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.533+0000 7feb6dffb640 1 -- 172.21.15.38:0/3735503993 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68030840 con 0x7feb7015d5a0 2023-12-22T08:44:31.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.533+0000 7feb6dffb640 1 -- 172.21.15.38:0/3735503993 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb680309a0 con 0x7feb7015d5a0 2023-12-22T08:44:31.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.533+0000 7feb6dffb640 1 -- 172.21.15.38:0/3735503993 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68030d30 con 0x7feb7015d5a0 2023-12-22T08:44:31.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.534+0000 7feb6ffff640 1 -- 172.21.15.38:0/3735503993 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb7015d5a0 msgr2=0x7feb700d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.534+0000 7feb6ffff640 1 --2- 172.21.15.38:0/3735503993 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb7015d5a0 0x7feb700d05a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feb68009870 tx=0x7feb6802b980 comp rx=0 tx=0).stop 2023-12-22T08:44:31.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.534+0000 7feb6ffff640 1 -- 172.21.15.38:0/3735503993 shutdown_connections 2023-12-22T08:44:31.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.534+0000 7feb6ffff640 1 --2- 172.21.15.38:0/3735503993 >> v2:172.21.15.89:3300/0 conn(0x7feb70071080 0x7feb700d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.534+0000 7feb6ffff640 1 --2- 172.21.15.38:0/3735503993 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb7015d5a0 0x7feb700d05a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.534+0000 7feb6ffff640 1 -- 172.21.15.38:0/3735503993 >> 172.21.15.38:0/3735503993 conn(0x7feb7006bf90 msgr2=0x7feb7006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:31.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.534+0000 7feb6ffff640 1 -- 172.21.15.38:0/3735503993 shutdown_connections 2023-12-22T08:44:31.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.534+0000 7feb6ffff640 1 -- 172.21.15.38:0/3735503993 wait complete. 2023-12-22T08:44:31.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.536+0000 7feb6ffff640 1 Processor -- start 2023-12-22T08:44:31.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.536+0000 7feb6ffff640 1 -- start start 2023-12-22T08:44:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.537+0000 7feb6ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb70071080 0x7feb70151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.537+0000 7feb6ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb7015d1c0 0x7feb70157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.537+0000 7feb6ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb7015d5a0 0x7feb70155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.537+0000 7feb6ffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb70153d50 con 0x7feb70071080 2023-12-22T08:44:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.537+0000 7feb6ffff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb70152ec0 con 0x7feb7015d1c0 2023-12-22T08:44:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.537+0000 7feb6ffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb701530d0 con 0x7feb7015d5a0 2023-12-22T08:44:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.537+0000 7feb6effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb70071080 0x7feb70151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.537+0000 7feb6effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb70071080 0x7feb70151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47082/0 (socket says 172.21.15.38:47082) 2023-12-22T08:44:31.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.538+0000 7feb6effd640 1 -- 172.21.15.38:0/1889655906 learned_addr learned my addr 172.21.15.38:0/1889655906 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.538+0000 7feb6f7fe640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb7015d5a0 0x7feb70155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.538+0000 7feb6e7fc640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb7015d1c0 0x7feb70157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.538+0000 7feb6effd640 1 -- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb7015d5a0 msgr2=0x7feb70155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.538+0000 7feb6effd640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb7015d5a0 0x7feb70155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.538+0000 7feb6effd640 1 -- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb7015d1c0 msgr2=0x7feb70157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.538+0000 7feb6effd640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb7015d1c0 0x7feb70157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.538+0000 7feb6effd640 1 -- 172.21.15.38:0/1889655906 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680094d0 con 0x7feb70071080 2023-12-22T08:44:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.538+0000 7feb6effd640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb70071080 0x7feb70151f60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7feb6000c790 tx=0x7feb6000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.539+0000 7feb677fe640 1 -- 172.21.15.38:0/1889655906 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000cea0 con 0x7feb70071080 2023-12-22T08:44:31.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.539+0000 7feb677fe640 1 -- 172.21.15.38:0/1889655906 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb60006d50 con 0x7feb70071080 2023-12-22T08:44:31.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.539+0000 7feb6ffff640 1 -- 172.21.15.38:0/1889655906 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb701533b0 con 0x7feb70071080 2023-12-22T08:44:31.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.539+0000 7feb677fe640 1 -- 172.21.15.38:0/1889655906 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb60003bb0 con 0x7feb70071080 2023-12-22T08:44:31.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.539+0000 7feb6ffff640 1 -- 172.21.15.38:0/1889655906 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb70153970 con 0x7feb70071080 2023-12-22T08:44:31.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.540+0000 7feb6ffff640 1 -- 172.21.15.38:0/1889655906 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb70153e90 con 0x7feb70071080 2023-12-22T08:44:31.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.541+0000 7feb677fe640 1 -- 172.21.15.38:0/1889655906 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feb60003d10 con 0x7feb70071080 2023-12-22T08:44:31.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.542+0000 7feb677fe640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb5006a430 0x7feb5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.542+0000 7feb677fe640 1 -- 172.21.15.38:0/1889655906 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7feb600885b0 con 0x7feb70071080 2023-12-22T08:44:31.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.542+0000 7feb677fe640 1 -- 172.21.15.38:0/1889655906 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7feb50072020 con 0x7feb70071080 2023-12-22T08:44:31.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.543+0000 7feb6e7fc640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb5006a430 0x7feb5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.544+0000 7feb6e7fc640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb5006a430 0x7feb5006c8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feb700b45f0 tx=0x7feb58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:31.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.547+0000 7feb677fe640 1 -- 172.21.15.38:0/1889655906 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feb70153e90 con 0x7feb70071080 2023-12-22T08:44:31.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.739+0000 7feb6ffff640 1 -- 172.21.15.38:0/1889655906 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb70153e90 con 0x7feb70071080 2023-12-22T08:44:31.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.739+0000 7feb677fe640 1 -- 172.21.15.38:0/1889655906 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb70153e90 con 0x7feb70071080 2023-12-22T08:44:31.741 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:44:31.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.742+0000 7feb6ffff640 1 -- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb5006a430 msgr2=0x7feb5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.742+0000 7feb6ffff640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb5006a430 0x7feb5006c8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feb700b45f0 tx=0x7feb58008040 comp rx=0 tx=0).stop 2023-12-22T08:44:31.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.742+0000 7feb6ffff640 1 -- 172.21.15.38:0/1889655906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb70071080 msgr2=0x7feb70151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.742+0000 7feb6ffff640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb70071080 0x7feb70151f60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7feb6000c790 tx=0x7feb6000cc50 comp rx=0 tx=0).stop 2023-12-22T08:44:31.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.742+0000 7feb6ffff640 1 -- 172.21.15.38:0/1889655906 shutdown_connections 2023-12-22T08:44:31.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.742+0000 7feb6ffff640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb7015d5a0 0x7feb70155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.742+0000 7feb6ffff640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb7015d1c0 0x7feb70157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.742+0000 7feb6ffff640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb5006a430 0x7feb5006c8f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.742+0000 7feb6ffff640 1 --2- 172.21.15.38:0/1889655906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb70071080 0x7feb70151f60 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.742+0000 7feb6ffff640 1 -- 172.21.15.38:0/1889655906 >> 172.21.15.38:0/1889655906 conn(0x7feb7006bf90 msgr2=0x7feb7006d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:31.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.742+0000 7feb6ffff640 1 -- 172.21.15.38:0/1889655906 shutdown_connections 2023-12-22T08:44:31.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.742+0000 7feb6ffff640 1 -- 172.21.15.38:0/1889655906 wait complete. 2023-12-22T08:44:31.760 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:44:31.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.967+0000 7fe102a84640 1 Processor -- start 2023-12-22T08:44:31.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.967+0000 7fe102a84640 1 -- start start 2023-12-22T08:44:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.969+0000 7fe102a84640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe0fc15e740 0x7fe0fc15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.969+0000 7fe102a84640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0fc06ca50 0x7fe0fc0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.969+0000 7fe102a84640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc0b4210 con 0x7fe0fc0b3dc0 2023-12-22T08:44:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.969+0000 7fe102a84640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc06e650 con 0x7fe0fc15e740 2023-12-22T08:44:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.969+0000 7fe102a84640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc15eb20 con 0x7fe0fc06ca50 2023-12-22T08:44:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.969+0000 7fe100820640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe0fc15e740 0x7fe0fc15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.969+0000 7fe101021640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe0fc0b3dc0 0x7fe0fc161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34178/0 (socket says 172.21.15.38:34178) 2023-12-22T08:44:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.969+0000 7fe101021640 1 -- 172.21.15.38:0/263219066 learned_addr learned my addr 172.21.15.38:0/263219066 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.969+0000 7fe0f3fff640 1 --2- 172.21.15.38:0/263219066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0fc06ca50 0x7fe0fc0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.970+0000 7fe100820640 1 -- 172.21.15.38:0/263219066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0fc06ca50 msgr2=0x7fe0fc0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.970+0000 7fe100820640 1 --2- 172.21.15.38:0/263219066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0fc06ca50 0x7fe0fc0b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.970+0000 7fe100820640 1 -- 172.21.15.38:0/263219066 >> v1:172.21.15.38:6789/0 conn(0x7fe0fc0b3dc0 legacy=0x7fe0fc161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.970+0000 7fe100820640 1 -- 172.21.15.38:0/263219066 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc070770 con 0x7fe0fc15e740 2023-12-22T08:44:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.970+0000 7fe0f37fe640 1 -- 172.21.15.38:0/263219066 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086160820 0 0) 0x7fe0f4001490 con 0x7fe0fc0b3dc0 2023-12-22T08:44:31.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.971+0000 7fe100820640 1 --2- 172.21.15.38:0/263219066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0fc15e740 0x7fe0fc15db30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80097a0 tx=0x7fe0f802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a2a840cb21aec2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:31.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.971+0000 7fe0f37fe640 1 -- 172.21.15.38:0/263219066 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80316f0 con 0x7fe0fc15e740 2023-12-22T08:44:31.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.971+0000 7fe0f37fe640 1 -- 172.21.15.38:0/263219066 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f8031850 con 0x7fe0fc15e740 2023-12-22T08:44:31.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.971+0000 7fe0f37fe640 1 -- 172.21.15.38:0/263219066 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8031be0 con 0x7fe0fc15e740 2023-12-22T08:44:31.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.972+0000 7fe102a84640 1 -- 172.21.15.38:0/263219066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0fc15e740 msgr2=0x7fe0fc15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.972+0000 7fe102a84640 1 --2- 172.21.15.38:0/263219066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0fc15e740 0x7fe0fc15db30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80097a0 tx=0x7fe0f802b790 comp rx=0 tx=0).stop 2023-12-22T08:44:31.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.972+0000 7fe102a84640 1 -- 172.21.15.38:0/263219066 shutdown_connections 2023-12-22T08:44:31.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.972+0000 7fe102a84640 1 --2- 172.21.15.38:0/263219066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0fc06ca50 0x7fe0fc0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.972+0000 7fe102a84640 1 --2- 172.21.15.38:0/263219066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0fc15e740 0x7fe0fc15db30 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.972+0000 7fe102a84640 1 -- 172.21.15.38:0/263219066 >> 172.21.15.38:0/263219066 conn(0x7fe0fc0cfea0 msgr2=0x7fe0fc0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:31.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.972+0000 7fe102a84640 1 -- 172.21.15.38:0/263219066 shutdown_connections 2023-12-22T08:44:31.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.972+0000 7fe102a84640 1 -- 172.21.15.38:0/263219066 wait complete. 2023-12-22T08:44:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.974+0000 7fe102a84640 1 Processor -- start 2023-12-22T08:44:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.974+0000 7fe102a84640 1 -- start start 2023-12-22T08:44:31.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.975+0000 7fe102a84640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0fc06ca50 0x7fe0fc0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.975+0000 7fe102a84640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0fc0b3dc0 0x7fe0fc152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.975+0000 7fe102a84640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0fc15e740 0x7fe0fc153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.975+0000 7fe102a84640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b7050 con 0x7fe0fc0b3dc0 2023-12-22T08:44:31.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.975+0000 7fe102a84640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b64b0 con 0x7fe0fc15e740 2023-12-22T08:44:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.975+0000 7fe102a84640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b6720 con 0x7fe0fc06ca50 2023-12-22T08:44:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.975+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0fc0b3dc0 0x7fe0fc152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.975+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0fc0b3dc0 0x7fe0fc152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47102/0 (socket says 172.21.15.38:47102) 2023-12-22T08:44:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.975+0000 7fe0f3fff640 1 -- 172.21.15.38:0/3043414677 learned_addr learned my addr 172.21.15.38:0/3043414677 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.976+0000 7fe100820640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0fc06ca50 0x7fe0fc0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.976+0000 7fe101021640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0fc15e740 0x7fe0fc153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.976+0000 7fe0f3fff640 1 -- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0fc06ca50 msgr2=0x7fe0fc0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.976+0000 7fe0f3fff640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0fc06ca50 0x7fe0fc0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.976+0000 7fe0f3fff640 1 -- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0fc15e740 msgr2=0x7fe0fc153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.976+0000 7fe0f3fff640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0fc15e740 0x7fe0fc153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.976+0000 7fe0f3fff640 1 -- 172.21.15.38:0/3043414677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f8009400 con 0x7fe0fc0b3dc0 2023-12-22T08:44:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.976+0000 7fe0f3fff640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0fc0b3dc0 0x7fe0fc152af0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00d800 tx=0x7fe0ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.977+0000 7fe0f17fa640 1 -- 172.21.15.38:0/3043414677 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00b6c0 con 0x7fe0fc0b3dc0 2023-12-22T08:44:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.977+0000 7fe0f17fa640 1 -- 172.21.15.38:0/3043414677 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec00b820 con 0x7fe0fc0b3dc0 2023-12-22T08:44:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.977+0000 7fe0f17fa640 1 -- 172.21.15.38:0/3043414677 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00bbb0 con 0x7fe0fc0b3dc0 2023-12-22T08:44:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.977+0000 7fe102a84640 1 -- 172.21.15.38:0/3043414677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc0b6a00 con 0x7fe0fc0b3dc0 2023-12-22T08:44:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.977+0000 7fe102a84640 1 -- 172.21.15.38:0/3043414677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc0ace20 con 0x7fe0fc0b3dc0 2023-12-22T08:44:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.978+0000 7fe102a84640 1 -- 172.21.15.38:0/3043414677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0fc061910 con 0x7fe0fc0b3dc0 2023-12-22T08:44:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.979+0000 7fe0f17fa640 1 -- 172.21.15.38:0/3043414677 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe0ec00bd10 con 0x7fe0fc0b3dc0 2023-12-22T08:44:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.980+0000 7fe0f17fa640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0e806a430 0x7fe0e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.980+0000 7fe0f17fa640 1 -- 172.21.15.38:0/3043414677 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe0ec088f00 con 0x7fe0fc0b3dc0 2023-12-22T08:44:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.980+0000 7fe0f17fa640 1 -- 172.21.15.38:0/3043414677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7fe0e8072020 con 0x7fe0fc0b3dc0 2023-12-22T08:44:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.981+0000 7fe100820640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0e806a430 0x7fe0e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.982+0000 7fe100820640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0e806a430 0x7fe0e806c8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8036000 tx=0x7fe0f8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:31.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:31.984+0000 7fe0f17fa640 1 -- 172.21.15.38:0/3043414677 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe0ec054410 con 0x7fe0fc0b3dc0 2023-12-22T08:44:32.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.177+0000 7fe102a84640 1 -- 172.21.15.38:0/3043414677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0fc161fa0 con 0x7fe0fc0b3dc0 2023-12-22T08:44:32.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.178+0000 7fe0f17fa640 1 -- 172.21.15.38:0/3043414677 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0ec057a30 con 0x7fe0fc0b3dc0 2023-12-22T08:44:32.180 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:44:32.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.181+0000 7fe102a84640 1 -- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0e806a430 msgr2=0x7fe0e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:32.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.181+0000 7fe102a84640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0e806a430 0x7fe0e806c8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8036000 tx=0x7fe0f8008030 comp rx=0 tx=0).stop 2023-12-22T08:44:32.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.181+0000 7fe102a84640 1 -- 172.21.15.38:0/3043414677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0fc0b3dc0 msgr2=0x7fe0fc152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:32.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.181+0000 7fe102a84640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0fc0b3dc0 0x7fe0fc152af0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00d800 tx=0x7fe0ec00dcc0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.181+0000 7fe102a84640 1 -- 172.21.15.38:0/3043414677 shutdown_connections 2023-12-22T08:44:32.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.181+0000 7fe102a84640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0fc15e740 0x7fe0fc153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.181+0000 7fe102a84640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0e806a430 0x7fe0e806c8f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.181+0000 7fe102a84640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0fc0b3dc0 0x7fe0fc152af0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.181+0000 7fe102a84640 1 --2- 172.21.15.38:0/3043414677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0fc06ca50 0x7fe0fc0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.181+0000 7fe102a84640 1 -- 172.21.15.38:0/3043414677 >> 172.21.15.38:0/3043414677 conn(0x7fe0fc0cfea0 msgr2=0x7fe0fc160f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:32.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.181+0000 7fe102a84640 1 -- 172.21.15.38:0/3043414677 shutdown_connections 2023-12-22T08:44:32.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.181+0000 7fe102a84640 1 -- 172.21.15.38:0/3043414677 wait complete. 2023-12-22T08:44:32.203 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:44:32.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.428+0000 7fa924e04640 1 Processor -- start 2023-12-22T08:44:32.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.428+0000 7fa924e04640 1 -- start start 2023-12-22T08:44:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.430+0000 7fa924e04640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa92015a370 0x7fa920071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.430+0000 7fa924e04640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa92015b3c0 0x7fa920071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.430+0000 7fa924e04640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa92006c260 0x7fa92006f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.430+0000 7fa924e04640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92015b940 con 0x7fa92006c260 2023-12-22T08:44:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.430+0000 7fa924e04640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9200cd080 con 0x7fa92015b3c0 2023-12-22T08:44:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.430+0000 7fa924e04640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200cd320 con 0x7fa92015a370 2023-12-22T08:44:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.431+0000 7fa91ed9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa92006c260 0x7fa92006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:32.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.431+0000 7fa91ed9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa92006c260 0x7fa92006f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47112/0 (socket says 172.21.15.38:47112) 2023-12-22T08:44:32.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.431+0000 7fa91ed9d640 1 -- 172.21.15.38:0/280746465 learned_addr learned my addr 172.21.15.38:0/280746465 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:32.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.431+0000 7fa91dd9b640 1 --2- 172.21.15.38:0/280746465 >> v2:172.21.15.89:3300/0 conn(0x7fa92015b3c0 0x7fa920071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:32.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.431+0000 7fa91e59c640 1 --2- 172.21.15.38:0/280746465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa92015a370 0x7fa920071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:32.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.431+0000 7fa91ed9d640 1 -- 172.21.15.38:0/280746465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa92015a370 msgr2=0x7fa920071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:32.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.431+0000 7fa91ed9d640 1 --2- 172.21.15.38:0/280746465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa92015a370 0x7fa920071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.431+0000 7fa91ed9d640 1 -- 172.21.15.38:0/280746465 >> v2:172.21.15.89:3300/0 conn(0x7fa92015b3c0 msgr2=0x7fa920071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:32.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.431+0000 7fa91ed9d640 1 --2- 172.21.15.38:0/280746465 >> v2:172.21.15.89:3300/0 conn(0x7fa92015b3c0 0x7fa920071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.431+0000 7fa91ed9d640 1 -- 172.21.15.38:0/280746465 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9200cd600 con 0x7fa92006c260 2023-12-22T08:44:32.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.432+0000 7fa91ed9d640 1 --2- 172.21.15.38:0/280746465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa92006c260 0x7fa92006f250 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa920066a80 tx=0x7fa91802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac7ac032abe431b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:32.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.433+0000 7fa91d59a640 1 -- 172.21.15.38:0/280746465 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91802ca70 con 0x7fa92006c260 2023-12-22T08:44:32.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.433+0000 7fa91d59a640 1 -- 172.21.15.38:0/280746465 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91802cbd0 con 0x7fa92006c260 2023-12-22T08:44:32.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.433+0000 7fa91d59a640 1 -- 172.21.15.38:0/280746465 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9180343f0 con 0x7fa92006c260 2023-12-22T08:44:32.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.434+0000 7fa924e04640 1 -- 172.21.15.38:0/280746465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa92006c260 msgr2=0x7fa92006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:32.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.434+0000 7fa924e04640 1 --2- 172.21.15.38:0/280746465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa92006c260 0x7fa92006f250 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa920066a80 tx=0x7fa91802bed0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.434+0000 7fa924e04640 1 -- 172.21.15.38:0/280746465 shutdown_connections 2023-12-22T08:44:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.434+0000 7fa924e04640 1 --2- 172.21.15.38:0/280746465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa92006c260 0x7fa92006f250 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.434+0000 7fa924e04640 1 --2- 172.21.15.38:0/280746465 >> v2:172.21.15.89:3300/0 conn(0x7fa92015b3c0 0x7fa920071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.434+0000 7fa924e04640 1 --2- 172.21.15.38:0/280746465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa92015a370 0x7fa920071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.434+0000 7fa924e04640 1 -- 172.21.15.38:0/280746465 >> 172.21.15.38:0/280746465 conn(0x7fa9200b20c0 msgr2=0x7fa9200b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.434+0000 7fa924e04640 1 -- 172.21.15.38:0/280746465 shutdown_connections 2023-12-22T08:44:32.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.434+0000 7fa924e04640 1 -- 172.21.15.38:0/280746465 wait complete. 2023-12-22T08:44:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.436+0000 7fa924e04640 1 Processor -- start 2023-12-22T08:44:32.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.437+0000 7fa924e04640 1 -- start start 2023-12-22T08:44:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.438+0000 7fa924e04640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa92006c260 0x7fa92014b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.438+0000 7fa924e04640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa92015a370 0x7fa92014bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.438+0000 7fa924e04640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa92015b3c0 0x7fa92015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.438+0000 7fa924e04640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92015d4d0 con 0x7fa92015a370 2023-12-22T08:44:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.438+0000 7fa924e04640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9201e3570 con 0x7fa92006c260 2023-12-22T08:44:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.438+0000 7fa924e04640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa920154920 con 0x7fa92015b3c0 2023-12-22T08:44:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.438+0000 7fa91dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa92015a370 0x7fa92014bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.438+0000 7fa91dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa92015a370 0x7fa92014bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47118/0 (socket says 172.21.15.38:47118) 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.438+0000 7fa91dd9b640 1 -- 172.21.15.38:0/4025727940 learned_addr learned my addr 172.21.15.38:0/4025727940 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.439+0000 7fa91e59c640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa92006c260 0x7fa92014b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.439+0000 7fa91dd9b640 1 -- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa92015b3c0 msgr2=0x7fa92015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.439+0000 7fa91dd9b640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa92015b3c0 0x7fa92015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.439+0000 7fa91dd9b640 1 -- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa92006c260 msgr2=0x7fa92014b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.439+0000 7fa91dd9b640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa92006c260 0x7fa92014b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.439+0000 7fa91dd9b640 1 -- 172.21.15.38:0/4025727940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa918009b30 con 0x7fa92015a370 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.439+0000 7fa91e59c640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa92006c260 0x7fa92014b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.439+0000 7fa91dd9b640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa92015a370 0x7fa92014bbc0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa91400d800 tx=0x7fa91400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.439+0000 7fa90effd640 1 -- 172.21.15.38:0/4025727940 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400b6c0 con 0x7fa92015a370 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.439+0000 7fa90effd640 1 -- 172.21.15.38:0/4025727940 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91400b820 con 0x7fa92015a370 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.439+0000 7fa924e04640 1 -- 172.21.15.38:0/4025727940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa920153da0 con 0x7fa92015a370 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.439+0000 7fa90effd640 1 -- 172.21.15.38:0/4025727940 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400bbb0 con 0x7fa92015a370 2023-12-22T08:44:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.440+0000 7fa924e04640 1 -- 172.21.15.38:0/4025727940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa920154360 con 0x7fa92015a370 2023-12-22T08:44:32.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.441+0000 7fa924e04640 1 -- 172.21.15.38:0/4025727940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa920061910 con 0x7fa92015a370 2023-12-22T08:44:32.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.442+0000 7fa90effd640 1 -- 172.21.15.38:0/4025727940 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa91400bd10 con 0x7fa92015a370 2023-12-22T08:44:32.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.443+0000 7fa90effd640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa90006a460 0x7fa90006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:32.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.443+0000 7fa90effd640 1 -- 172.21.15.38:0/4025727940 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa914088f00 con 0x7fa92015a370 2023-12-22T08:44:32.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.443+0000 7fa90effd640 1 -- 172.21.15.38:0/4025727940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7fa900072050 con 0x7fa92015a370 2023-12-22T08:44:32.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.443+0000 7fa91e59c640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa90006a460 0x7fa90006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:32.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.444+0000 7fa91e59c640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa90006a460 0x7fa90006c920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa910006fd0 tx=0x7fa910008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.447+0000 7fa90effd640 1 -- 172.21.15.38:0/4025727940 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa914054410 con 0x7fa92015a370 2023-12-22T08:44:32.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.640+0000 7fa924e04640 1 -- 172.21.15.38:0/4025727940 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9200720e0 con 0x7fa92015a370 2023-12-22T08:44:32.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.640+0000 7fa90effd640 1 -- 172.21.15.38:0/4025727940 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa914057a30 con 0x7fa92015a370 2023-12-22T08:44:32.642 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:44:32.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.643+0000 7fa924e04640 1 -- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa90006a460 msgr2=0x7fa90006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:32.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.643+0000 7fa924e04640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa90006a460 0x7fa90006c920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa910006fd0 tx=0x7fa910008040 comp rx=0 tx=0).stop 2023-12-22T08:44:32.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.643+0000 7fa924e04640 1 -- 172.21.15.38:0/4025727940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa92015a370 msgr2=0x7fa92014bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:32.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.643+0000 7fa924e04640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa92015a370 0x7fa92014bbc0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa91400d800 tx=0x7fa91400dcc0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.643+0000 7fa924e04640 1 -- 172.21.15.38:0/4025727940 shutdown_connections 2023-12-22T08:44:32.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.643+0000 7fa924e04640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa92015b3c0 0x7fa92015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.643+0000 7fa924e04640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa90006a460 0x7fa90006c920 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.643+0000 7fa924e04640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa92015a370 0x7fa92014bbc0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.643+0000 7fa924e04640 1 --2- 172.21.15.38:0/4025727940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa92006c260 0x7fa92014b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.643+0000 7fa924e04640 1 -- 172.21.15.38:0/4025727940 >> 172.21.15.38:0/4025727940 conn(0x7fa9200b20c0 msgr2=0x7fa9200adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:32.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.643+0000 7fa924e04640 1 -- 172.21.15.38:0/4025727940 shutdown_connections 2023-12-22T08:44:32.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.643+0000 7fa924e04640 1 -- 172.21.15.38:0/4025727940 wait complete. 2023-12-22T08:44:32.663 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:44:32.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.887+0000 7f0d732f6640 1 Processor -- start 2023-12-22T08:44:32.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.887+0000 7f0d732f6640 1 -- start start 2023-12-22T08:44:32.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.888+0000 7f0d732f6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0d6c15ad90 0x7f0d6c0caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:32.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.888+0000 7f0d732f6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0d6c161bb0 0x7f0d6c0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:32.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.888+0000 7f0d732f6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6c15e630 con 0x7f0d6c15d940 2023-12-22T08:44:32.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.888+0000 7f0d732f6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6c0ce2c0 con 0x7f0d6c15ad90 2023-12-22T08:44:32.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.888+0000 7f0d732f6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6c15e910 con 0x7f0d6c161bb0 2023-12-22T08:44:32.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.889+0000 7f0d722f4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0d6c15ad90 0x7f0d6c0caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:32.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.889+0000 7f0d722f4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0d6c15ad90 0x7f0d6c0caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47130/0 (socket says 172.21.15.38:47130) 2023-12-22T08:44:32.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.889+0000 7f0d722f4640 1 -- 172.21.15.38:0/3462214723 learned_addr learned my addr 172.21.15.38:0/3462214723 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:32.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.889+0000 7f0d71af3640 1 --2- 172.21.15.38:0/3462214723 >> v2:172.21.15.89:3300/0 conn(0x7f0d6c161bb0 0x7f0d6c0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:32.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.889+0000 7f0d722f4640 1 -- 172.21.15.38:0/3462214723 >> v2:172.21.15.89:3300/0 conn(0x7f0d6c161bb0 msgr2=0x7f0d6c0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:32.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.889+0000 7f0d722f4640 1 --2- 172.21.15.38:0/3462214723 >> v2:172.21.15.89:3300/0 conn(0x7f0d6c161bb0 0x7f0d6c0cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.889+0000 7f0d722f4640 1 -- 172.21.15.38:0/3462214723 >> v1:172.21.15.89:6789/0 conn(0x7f0d6c15d940 legacy=0x7f0d6c15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:32.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.889+0000 7f0d722f4640 1 -- 172.21.15.38:0/3462214723 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c1610d0 con 0x7f0d6c15ad90 2023-12-22T08:44:32.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.891+0000 7f0d722f4640 1 --2- 172.21.15.38:0/3462214723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c15ad90 0x7f0d6c0caed0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0d0d40 tx=0x7f0d6802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53b09d1791ac854 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:32.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.891+0000 7f0d712f2640 1 -- 172.21.15.38:0/3462214723 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6802ca80 con 0x7f0d6c15ad90 2023-12-22T08:44:32.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.891+0000 7f0d712f2640 1 -- 172.21.15.38:0/3462214723 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6802cbe0 con 0x7f0d6c15ad90 2023-12-22T08:44:32.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.891+0000 7f0d712f2640 1 -- 172.21.15.38:0/3462214723 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d680343f0 con 0x7f0d6c15ad90 2023-12-22T08:44:32.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.892+0000 7f0d732f6640 1 -- 172.21.15.38:0/3462214723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c15ad90 msgr2=0x7f0d6c0caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:32.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.892+0000 7f0d732f6640 1 --2- 172.21.15.38:0/3462214723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c15ad90 0x7f0d6c0caed0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0d0d40 tx=0x7f0d6802bee0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.892+0000 7f0d732f6640 1 -- 172.21.15.38:0/3462214723 shutdown_connections 2023-12-22T08:44:32.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.892+0000 7f0d732f6640 1 --2- 172.21.15.38:0/3462214723 >> v2:172.21.15.89:3300/0 conn(0x7f0d6c161bb0 0x7f0d6c0cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.892+0000 7f0d732f6640 1 --2- 172.21.15.38:0/3462214723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c15ad90 0x7f0d6c0caed0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.892+0000 7f0d732f6640 1 -- 172.21.15.38:0/3462214723 >> 172.21.15.38:0/3462214723 conn(0x7f0d6c0d31c0 msgr2=0x7f0d6c0d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:32.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.892+0000 7f0d732f6640 1 -- 172.21.15.38:0/3462214723 shutdown_connections 2023-12-22T08:44:32.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.892+0000 7f0d732f6640 1 -- 172.21.15.38:0/3462214723 wait complete. 2023-12-22T08:44:32.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.894+0000 7f0d732f6640 1 Processor -- start 2023-12-22T08:44:32.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.894+0000 7f0d732f6640 1 -- start start 2023-12-22T08:44:32.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.895+0000 7f0d732f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d6c15ad90 0x7f0d6c14eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:32.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.895+0000 7f0d732f6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c15d940 0x7f0d6c070220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:32.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.895+0000 7f0d732f6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d6c161bb0 0x7f0d6c070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:32.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.895+0000 7f0d732f6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c0cea70 con 0x7f0d6c15d940 2023-12-22T08:44:32.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.895+0000 7f0d732f6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c0ced50 con 0x7f0d6c15ad90 2023-12-22T08:44:32.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.895+0000 7f0d732f6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c0cf030 con 0x7f0d6c161bb0 2023-12-22T08:44:32.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.895+0000 7f0d71af3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c15d940 0x7f0d6c070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:32.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.895+0000 7f0d71af3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c15d940 0x7f0d6c070220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47136/0 (socket says 172.21.15.38:47136) 2023-12-22T08:44:32.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.895+0000 7f0d71af3640 1 -- 172.21.15.38:0/2081221265 learned_addr learned my addr 172.21.15.38:0/2081221265 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:32.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.896+0000 7f0d722f4640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d6c15ad90 0x7f0d6c14eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:32.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.896+0000 7f0d72af5640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d6c161bb0 0x7f0d6c070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:32.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.896+0000 7f0d71af3640 1 -- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d6c161bb0 msgr2=0x7f0d6c070760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:32.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.896+0000 7f0d71af3640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d6c161bb0 0x7f0d6c070760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.896+0000 7f0d71af3640 1 -- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d6c15ad90 msgr2=0x7f0d6c14eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:32.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.896+0000 7f0d71af3640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d6c15ad90 0x7f0d6c14eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:32.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.896+0000 7f0d71af3640 1 -- 172.21.15.38:0/2081221265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d68009b30 con 0x7f0d6c15d940 2023-12-22T08:44:32.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.896+0000 7f0d71af3640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c15d940 0x7f0d6c070220 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00d5f0 tx=0x7f0d5c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:32.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.897+0000 7f0d62ffd640 1 -- 172.21.15.38:0/2081221265 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c0125f0 con 0x7f0d6c15d940 2023-12-22T08:44:32.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.897+0000 7f0d62ffd640 1 -- 172.21.15.38:0/2081221265 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c012750 con 0x7f0d6c15d940 2023-12-22T08:44:32.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.897+0000 7f0d732f6640 1 -- 172.21.15.38:0/2081221265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6c0cf310 con 0x7f0d6c15d940 2023-12-22T08:44:32.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.897+0000 7f0d62ffd640 1 -- 172.21.15.38:0/2081221265 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c012b00 con 0x7f0d6c15d940 2023-12-22T08:44:32.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.897+0000 7f0d732f6640 1 -- 172.21.15.38:0/2081221265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6c14fd00 con 0x7f0d6c15d940 2023-12-22T08:44:32.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.898+0000 7f0d732f6640 1 -- 172.21.15.38:0/2081221265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6c061910 con 0x7f0d6c15d940 2023-12-22T08:44:32.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.899+0000 7f0d62ffd640 1 -- 172.21.15.38:0/2081221265 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0d5c012c60 con 0x7f0d6c15d940 2023-12-22T08:44:32.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.900+0000 7f0d62ffd640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d5006a480 0x7f0d5006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:32.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.900+0000 7f0d62ffd640 1 -- 172.21.15.38:0/2081221265 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0d5c088d90 con 0x7f0d6c15d940 2023-12-22T08:44:32.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.900+0000 7f0d62ffd640 1 -- 172.21.15.38:0/2081221265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f0d50072070 con 0x7f0d6c15d940 2023-12-22T08:44:32.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.901+0000 7f0d722f4640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d5006a480 0x7f0d5006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:32.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.902+0000 7f0d722f4640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d5006a480 0x7f0d5006c940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0d68035000 tx=0x7f0d68030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:32.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:32.904+0000 7f0d62ffd640 1 -- 172.21.15.38:0/2081221265 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0d5c0543b0 con 0x7f0d6c15d940 2023-12-22T08:44:33.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.114+0000 7f0d732f6640 1 -- 172.21.15.38:0/2081221265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0d6c15b920 con 0x7f0d6c15d940 2023-12-22T08:44:33.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.114+0000 7f0d62ffd640 1 -- 172.21.15.38:0/2081221265 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0d5c0579d0 con 0x7f0d6c15d940 2023-12-22T08:44:33.116 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:44:33.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.117+0000 7f0d732f6640 1 -- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d5006a480 msgr2=0x7f0d5006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:33.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.117+0000 7f0d732f6640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d5006a480 0x7f0d5006c940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0d68035000 tx=0x7f0d68030000 comp rx=0 tx=0).stop 2023-12-22T08:44:33.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.117+0000 7f0d732f6640 1 -- 172.21.15.38:0/2081221265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c15d940 msgr2=0x7f0d6c070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:33.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.117+0000 7f0d732f6640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c15d940 0x7f0d6c070220 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00d5f0 tx=0x7f0d5c00dab0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.117+0000 7f0d732f6640 1 -- 172.21.15.38:0/2081221265 shutdown_connections 2023-12-22T08:44:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.117+0000 7f0d732f6640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d6c161bb0 0x7f0d6c070760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.117+0000 7f0d732f6640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d5006a480 0x7f0d5006c940 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.117+0000 7f0d732f6640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c15d940 0x7f0d6c070220 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.117+0000 7f0d732f6640 1 --2- 172.21.15.38:0/2081221265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d6c15ad90 0x7f0d6c14eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.117+0000 7f0d732f6640 1 -- 172.21.15.38:0/2081221265 >> 172.21.15.38:0/2081221265 conn(0x7f0d6c0d31c0 msgr2=0x7f0d6c0cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.117+0000 7f0d732f6640 1 -- 172.21.15.38:0/2081221265 shutdown_connections 2023-12-22T08:44:33.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.117+0000 7f0d732f6640 1 -- 172.21.15.38:0/2081221265 wait complete. 2023-12-22T08:44:33.138 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T08:44:33.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:44:33.138 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-22T08:44:33.251 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:44:33.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:44:33.252 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T08:44:33.308 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:44:33.309 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:44:33.370 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:44:33.370 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:44:33.423 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:44:33.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.646+0000 7f65b2efa640 1 Processor -- start 2023-12-22T08:44:33.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.646+0000 7f65b2efa640 1 -- start start 2023-12-22T08:44:33.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.648+0000 7f65b2efa640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65ac157980 0x7f65ac15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:33.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.648+0000 7f65b2efa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f65ac0b3ff0 0x7f65ac06cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:33.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.648+0000 7f65b2efa640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac0d1520 con 0x7f65ac0b44a0 2023-12-22T08:44:33.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.648+0000 7f65b2efa640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac0d1800 con 0x7f65ac157980 2023-12-22T08:44:33.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.648+0000 7f65b2efa640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac0d1ae0 con 0x7f65ac0b3ff0 2023-12-22T08:44:33.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.648+0000 7f65b1ef8640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65ac157980 0x7f65ac15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:33.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.648+0000 7f65b26f9640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f65ac0b44a0 0x7f65ac0d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34190/0 (socket says 172.21.15.38:34190) 2023-12-22T08:44:33.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.648+0000 7f65b26f9640 1 -- 172.21.15.38:0/1451207595 learned_addr learned my addr 172.21.15.38:0/1451207595 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:33.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.649+0000 7f65b16f7640 1 --2- 172.21.15.38:0/1451207595 >> v2:172.21.15.89:3300/0 conn(0x7f65ac0b3ff0 0x7f65ac06cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:33.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.649+0000 7f65b1ef8640 1 -- 172.21.15.38:0/1451207595 >> v2:172.21.15.89:3300/0 conn(0x7f65ac0b3ff0 msgr2=0x7f65ac06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:33.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.649+0000 7f65b1ef8640 1 --2- 172.21.15.38:0/1451207595 >> v2:172.21.15.89:3300/0 conn(0x7f65ac0b3ff0 0x7f65ac06cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.649+0000 7f65b1ef8640 1 -- 172.21.15.38:0/1451207595 >> v1:172.21.15.38:6789/0 conn(0x7f65ac0b44a0 legacy=0x7f65ac0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:33.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.649+0000 7f65b0ef6640 1 -- 172.21.15.38:0/1451207595 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049461897 0 0) 0x7f65ac0d1520 con 0x7f65ac0b44a0 2023-12-22T08:44:33.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.649+0000 7f65b1ef8640 1 -- 172.21.15.38:0/1451207595 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac0d1dc0 con 0x7f65ac157980 2023-12-22T08:44:33.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.650+0000 7f65b1ef8640 1 --2- 172.21.15.38:0/1451207595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac157980 0x7f65ac15eb10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0d3f10 tx=0x7f65a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d850a997ce3f994 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:33.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.650+0000 7f65b0ef6640 1 -- 172.21.15.38:0/1451207595 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a8031830 con 0x7f65ac157980 2023-12-22T08:44:33.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.650+0000 7f65b0ef6640 1 -- 172.21.15.38:0/1451207595 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a8031990 con 0x7f65ac157980 2023-12-22T08:44:33.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.650+0000 7f65b0ef6640 1 -- 172.21.15.38:0/1451207595 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a8031d20 con 0x7f65ac157980 2023-12-22T08:44:33.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.651+0000 7f65b2efa640 1 -- 172.21.15.38:0/1451207595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac157980 msgr2=0x7f65ac15eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:33.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.651+0000 7f65b2efa640 1 --2- 172.21.15.38:0/1451207595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac157980 0x7f65ac15eb10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0d3f10 tx=0x7f65a802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.651+0000 7f65b2efa640 1 -- 172.21.15.38:0/1451207595 shutdown_connections 2023-12-22T08:44:33.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.651+0000 7f65b2efa640 1 --2- 172.21.15.38:0/1451207595 >> v2:172.21.15.89:3300/0 conn(0x7f65ac0b3ff0 0x7f65ac06cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.651+0000 7f65b2efa640 1 --2- 172.21.15.38:0/1451207595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac157980 0x7f65ac15eb10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.651+0000 7f65b2efa640 1 -- 172.21.15.38:0/1451207595 >> 172.21.15.38:0/1451207595 conn(0x7f65ac0d31f0 msgr2=0x7f65ac0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:33.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.651+0000 7f65b2efa640 1 -- 172.21.15.38:0/1451207595 shutdown_connections 2023-12-22T08:44:33.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.651+0000 7f65b2efa640 1 -- 172.21.15.38:0/1451207595 wait complete. 2023-12-22T08:44:33.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.653+0000 7f65b2efa640 1 Processor -- start 2023-12-22T08:44:33.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.653+0000 7f65b2efa640 1 -- start start 2023-12-22T08:44:33.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.654+0000 7f65b2efa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65ac0b3ff0 0x7f65ac1f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:33.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.654+0000 7f65b2efa640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac0b44a0 0x7f65ac1f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:33.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.654+0000 7f65b2efa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac157980 0x7f65ac15cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:33.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.654+0000 7f65b2efa640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac15fed0 con 0x7f65ac157980 2023-12-22T08:44:33.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.654+0000 7f65b2efa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac1601b0 con 0x7f65ac0b3ff0 2023-12-22T08:44:33.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.654+0000 7f65b2efa640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac1590d0 con 0x7f65ac0b44a0 2023-12-22T08:44:33.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.654+0000 7f65b26f9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac157980 0x7f65ac15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:33.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.654+0000 7f65b26f9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac157980 0x7f65ac15cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47154/0 (socket says 172.21.15.38:47154) 2023-12-22T08:44:33.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.654+0000 7f65b26f9640 1 -- 172.21.15.38:0/2367852067 learned_addr learned my addr 172.21.15.38:0/2367852067 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:33.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.655+0000 7f65b1ef8640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65ac0b3ff0 0x7f65ac1f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:33.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.655+0000 7f65b26f9640 1 -- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac0b44a0 msgr2=0x7f65ac1f5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:33.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.655+0000 7f65b16f7640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac0b44a0 0x7f65ac1f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:33.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.655+0000 7f65b26f9640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac0b44a0 0x7f65ac1f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.655+0000 7f65b26f9640 1 -- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65ac0b3ff0 msgr2=0x7f65ac1f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:33.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.655+0000 7f65b26f9640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65ac0b3ff0 0x7f65ac1f29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.655+0000 7f65b26f9640 1 -- 172.21.15.38:0/2367852067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a8009400 con 0x7f65ac157980 2023-12-22T08:44:33.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.655+0000 7f65b26f9640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac157980 0x7f65ac15cc40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c7e0 tx=0x7f65a400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:33.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.655+0000 7f65a27fc640 1 -- 172.21.15.38:0/2367852067 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a400a640 con 0x7f65ac157980 2023-12-22T08:44:33.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.655+0000 7f65a27fc640 1 -- 172.21.15.38:0/2367852067 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a400a7c0 con 0x7f65ac157980 2023-12-22T08:44:33.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.655+0000 7f65a27fc640 1 -- 172.21.15.38:0/2367852067 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a400ab70 con 0x7f65ac157980 2023-12-22T08:44:33.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.656+0000 7f65b2efa640 1 -- 172.21.15.38:0/2367852067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac1593b0 con 0x7f65ac157980 2023-12-22T08:44:33.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.656+0000 7f65b2efa640 1 -- 172.21.15.38:0/2367852067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac15faf0 con 0x7f65ac157980 2023-12-22T08:44:33.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.657+0000 7f65b2efa640 1 -- 172.21.15.38:0/2367852067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ac158f30 con 0x7f65ac157980 2023-12-22T08:44:33.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.658+0000 7f65a27fc640 1 -- 172.21.15.38:0/2367852067 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f65a400acd0 con 0x7f65ac157980 2023-12-22T08:44:33.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.659+0000 7f65a27fc640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f659006a460 0x7f659006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:33.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.659+0000 7f65a27fc640 1 -- 172.21.15.38:0/2367852067 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f65a4087e20 con 0x7f65ac157980 2023-12-22T08:44:33.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.659+0000 7f65a27fc640 1 -- 172.21.15.38:0/2367852067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f6590072050 con 0x7f65ac157980 2023-12-22T08:44:33.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.659+0000 7f65b1ef8640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f659006a460 0x7f659006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:33.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.661+0000 7f65b1ef8640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f659006a460 0x7f659006c920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f65a8036000 tx=0x7f65a8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:33.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.663+0000 7f65a27fc640 1 -- 172.21.15.38:0/2367852067 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f65a4018060 con 0x7f65ac157980 2023-12-22T08:44:33.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.858+0000 7f65b2efa640 1 -- 172.21.15.38:0/2367852067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65ac1595a0 con 0x7f65ac157980 2023-12-22T08:44:33.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.860+0000 7f65a27fc640 1 -- 172.21.15.38:0/2367852067 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16196 (secure 0 0 0) 0x7f65ac158f30 con 0x7f65ac157980 2023-12-22T08:44:33.862 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:33.862 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":76,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:43:50.280215+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:43:07.088485+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-22T08:43:07.718532+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","full","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.19","mappings":[{"from":6,"to":1}]},{"pgid":"9.3f","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:44:33.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.862+0000 7f65b2efa640 1 -- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f659006a460 msgr2=0x7f659006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:33.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.862+0000 7f65b2efa640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f659006a460 0x7f659006c920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f65a8036000 tx=0x7f65a8008030 comp rx=0 tx=0).stop 2023-12-22T08:44:33.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.862+0000 7f65b2efa640 1 -- 172.21.15.38:0/2367852067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac157980 msgr2=0x7f65ac15cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:33.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.862+0000 7f65b2efa640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac157980 0x7f65ac15cc40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c7e0 tx=0x7f65a400cca0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.862+0000 7f65b2efa640 1 -- 172.21.15.38:0/2367852067 shutdown_connections 2023-12-22T08:44:33.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.862+0000 7f65b2efa640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f659006a460 0x7f659006c920 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.862+0000 7f65b2efa640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac157980 0x7f65ac15cc40 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.862+0000 7f65b2efa640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac0b44a0 0x7f65ac1f5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.862+0000 7f65b2efa640 1 --2- 172.21.15.38:0/2367852067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65ac0b3ff0 0x7f65ac1f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:33.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.863+0000 7f65b2efa640 1 -- 172.21.15.38:0/2367852067 >> 172.21.15.38:0/2367852067 conn(0x7f65ac0d31f0 msgr2=0x7f65ac156b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:33.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.863+0000 7f65b2efa640 1 -- 172.21.15.38:0/2367852067 shutdown_connections 2023-12-22T08:44:33.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:33.863+0000 7f65b2efa640 1 -- 172.21.15.38:0/2367852067 wait complete. 2023-12-22T08:44:33.885 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:43:07.088485+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:43:07.718532+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:44:33.885 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:44:34.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.147+0000 7fc882bb9640 1 Processor -- start 2023-12-22T08:44:34.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.147+0000 7fc882bb9640 1 -- start start 2023-12-22T08:44:34.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.148+0000 7fc882bb9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc87c144b80 0x7fc87c0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.148+0000 7fc882bb9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87c0d0920 con 0x7fc87c06d800 2023-12-22T08:44:34.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.148+0000 7fc882bb9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87c0b48d0 con 0x7fc87c144f60 2023-12-22T08:44:34.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.148+0000 7fc882bb9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87c0cf900 con 0x7fc87c144b80 2023-12-22T08:44:34.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.149+0000 7fc881156640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc87c06d800 0x7fc87c0b60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34204/0 (socket says 172.21.15.38:34204) 2023-12-22T08:44:34.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.149+0000 7fc881156640 1 -- 172.21.15.38:0/3640571156 learned_addr learned my addr 172.21.15.38:0/3640571156 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:34.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.149+0000 7fc880955640 1 --2- 172.21.15.38:0/3640571156 >> v2:172.21.15.89:3300/0 conn(0x7fc87c144b80 0x7fc87c0d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.149+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653899538 0 0) 0x7fc87c0d0920 con 0x7fc87c06d800 2023-12-22T08:44:34.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.149+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc86c003520 con 0x7fc87c06d800 2023-12-22T08:44:34.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3607076165 0 0) 0x7fc86c003520 con 0x7fc87c06d800 2023-12-22T08:44:34.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 >> v2:172.21.15.89:3300/0 conn(0x7fc87c144b80 msgr2=0x7fc87c0d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:34.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87b7fe640 1 --2- 172.21.15.38:0/3640571156 >> v2:172.21.15.89:3300/0 conn(0x7fc87c144b80 0x7fc87c0d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 >> v1:172.21.15.89:6789/0 conn(0x7fc87c144f60 legacy=0x7fc87c0b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c0cfbe0 con 0x7fc87c06d800 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fc8740019f0 con 0x7fc87c06d800 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 >> v1:172.21.15.38:6789/0 conn(0x7fc87c06d800 legacy=0x7fc87c0b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87b7fe640 1 --2- 172.21.15.38:0/3640571156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc86c0039c0 0x7fc86c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87b7fe640 1 --2- 172.21.15.38:0/3640571156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc86c0047c0 0x7fc86c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87b7fe640 1 --2- 172.21.15.38:0/3640571156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc86c0051d0 0x7fc86c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0cf900 con 0x7fc86c0051d0 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c00c120 con 0x7fc86c0047c0 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c00c2e0 con 0x7fc86c0039c0 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc881156640 1 --2- 172.21.15.38:0/3640571156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc86c0051d0 0x7fc86c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.150+0000 7fc87bfff640 1 --2- 172.21.15.38:0/3640571156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc86c0047c0 0x7fc86c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.151+0000 7fc880955640 1 --2- 172.21.15.38:0/3640571156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc86c0039c0 0x7fc86c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.151+0000 7fc881156640 1 -- 172.21.15.38:0/3640571156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc86c0039c0 msgr2=0x7fc86c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.151+0000 7fc881156640 1 --2- 172.21.15.38:0/3640571156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc86c0039c0 0x7fc86c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.151+0000 7fc881156640 1 -- 172.21.15.38:0/3640571156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc86c0047c0 msgr2=0x7fc86c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:34.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.151+0000 7fc881156640 1 --2- 172.21.15.38:0/3640571156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc86c0047c0 0x7fc86c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.151+0000 7fc881156640 1 -- 172.21.15.38:0/3640571156 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c003520 con 0x7fc86c0051d0 2023-12-22T08:44:34.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.152+0000 7fc881156640 1 -- 172.21.15.38:0/3640571156 reap_dead start 2023-12-22T08:44:34.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.152+0000 7fc881156640 1 --2- 172.21.15.38:0/3640571156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc86c0051d0 0x7fc86c00b980 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fc87400a760 tx=0x7fc86c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e2afca677cd0c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:34.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.152+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874034630 con 0x7fc86c0051d0 2023-12-22T08:44:34.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.152+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87402f070 con 0x7fc86c0051d0 2023-12-22T08:44:34.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.152+0000 7fc87b7fe640 1 -- 172.21.15.38:0/3640571156 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874034a10 con 0x7fc86c0051d0 2023-12-22T08:44:34.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.153+0000 7fc882bb9640 1 -- 172.21.15.38:0/3640571156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc86c0051d0 msgr2=0x7fc86c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:34.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.153+0000 7fc882bb9640 1 --2- 172.21.15.38:0/3640571156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc86c0051d0 0x7fc86c00b980 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fc87400a760 tx=0x7fc86c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.153+0000 7fc882bb9640 1 -- 172.21.15.38:0/3640571156 shutdown_connections 2023-12-22T08:44:34.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.153+0000 7fc882bb9640 1 --2- 172.21.15.38:0/3640571156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc86c0051d0 0x7fc86c00b980 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.153+0000 7fc882bb9640 1 -- 172.21.15.38:0/3640571156 >> 172.21.15.38:0/3640571156 conn(0x7fc87c06c5e0 msgr2=0x7fc87c06c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:34.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.153+0000 7fc882bb9640 1 -- 172.21.15.38:0/3640571156 shutdown_connections 2023-12-22T08:44:34.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.153+0000 7fc882bb9640 1 -- 172.21.15.38:0/3640571156 wait complete. 2023-12-22T08:44:34.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.155+0000 7fc882bb9640 1 Processor -- start 2023-12-22T08:44:34.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.155+0000 7fc882bb9640 1 -- start start 2023-12-22T08:44:34.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.156+0000 7fc882bb9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc86c0051d0 0x7fc87c141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.156+0000 7fc882bb9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc87c135c10 0x7fc87c0b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.156+0000 7fc882bb9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87c1e7250 0x7fc87c15dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.156+0000 7fc882bb9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c1e6e30 con 0x7fc87c1e7250 2023-12-22T08:44:34.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.156+0000 7fc882bb9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0b0770 con 0x7fc87c135c10 2023-12-22T08:44:34.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.156+0000 7fc882bb9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0ad2f0 con 0x7fc86c0051d0 2023-12-22T08:44:34.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.156+0000 7fc881156640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87c1e7250 0x7fc87c15dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.156+0000 7fc881156640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87c1e7250 0x7fc87c15dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47176/0 (socket says 172.21.15.38:47176) 2023-12-22T08:44:34.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.156+0000 7fc881156640 1 -- 172.21.15.38:0/2081437245 learned_addr learned my addr 172.21.15.38:0/2081437245 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:34.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.157+0000 7fc880955640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc86c0051d0 0x7fc87c141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.157+0000 7fc87bfff640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc87c135c10 0x7fc87c0b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.157+0000 7fc881156640 1 -- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc86c0051d0 msgr2=0x7fc87c141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.157+0000 7fc881156640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc86c0051d0 0x7fc87c141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.157+0000 7fc881156640 1 -- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc87c135c10 msgr2=0x7fc87c0b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.157+0000 7fc881156640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc87c135c10 0x7fc87c0b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.157+0000 7fc881156640 1 -- 172.21.15.38:0/2081437245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c0ad5d0 con 0x7fc87c1e7250 2023-12-22T08:44:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.157+0000 7fc880955640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc86c0051d0 0x7fc87c141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:44:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.157+0000 7fc881156640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87c1e7250 0x7fc87c15dc10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc87400a760 tx=0x7fc874001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.158+0000 7fc8797fa640 1 -- 172.21.15.38:0/2081437245 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874001930 con 0x7fc87c1e7250 2023-12-22T08:44:34.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.158+0000 7fc8797fa640 1 -- 172.21.15.38:0/2081437245 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc874004b60 con 0x7fc87c1e7250 2023-12-22T08:44:34.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.158+0000 7fc8797fa640 1 -- 172.21.15.38:0/2081437245 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740347b0 con 0x7fc87c1e7250 2023-12-22T08:44:34.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.158+0000 7fc882bb9640 1 -- 172.21.15.38:0/2081437245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87c1e6490 con 0x7fc87c1e7250 2023-12-22T08:44:34.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.158+0000 7fc882bb9640 1 -- 172.21.15.38:0/2081437245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87c1e6a50 con 0x7fc87c1e7250 2023-12-22T08:44:34.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.159+0000 7fc882bb9640 1 -- 172.21.15.38:0/2081437245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87c1e6f70 con 0x7fc87c1e7250 2023-12-22T08:44:34.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.160+0000 7fc8797fa640 1 -- 172.21.15.38:0/2081437245 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc874031030 con 0x7fc87c1e7250 2023-12-22T08:44:34.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.161+0000 7fc8797fa640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc86006a430 0x7fc86006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.161+0000 7fc8797fa640 1 -- 172.21.15.38:0/2081437245 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc8740a9e00 con 0x7fc87c1e7250 2023-12-22T08:44:34.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.161+0000 7fc8797fa640 1 -- 172.21.15.38:0/2081437245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7fc860072020 con 0x7fc87c1e7250 2023-12-22T08:44:34.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.162+0000 7fc880955640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc86006a430 0x7fc86006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.163+0000 7fc880955640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc86006a430 0x7fc86006c8f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc870006fd0 tx=0x7fc870008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:34.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.165+0000 7fc8797fa640 1 -- 172.21.15.38:0/2081437245 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc87c1e6f70 con 0x7fc87c1e7250 2023-12-22T08:44:34.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.358+0000 7fc882bb9640 1 -- 172.21.15.38:0/2081437245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc87c1e62e0 con 0x7fc87c1e7250 2023-12-22T08:44:34.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.359+0000 7fc8797fa640 1 -- 172.21.15.38:0/2081437245 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc874075310 con 0x7fc87c1e7250 2023-12-22T08:44:34.361 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:44:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.361+0000 7fc882bb9640 1 -- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc86006a430 msgr2=0x7fc86006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.361+0000 7fc882bb9640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc86006a430 0x7fc86006c8f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc870006fd0 tx=0x7fc870008040 comp rx=0 tx=0).stop 2023-12-22T08:44:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.361+0000 7fc882bb9640 1 -- 172.21.15.38:0/2081437245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87c1e7250 msgr2=0x7fc87c15dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.361+0000 7fc882bb9640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87c1e7250 0x7fc87c15dc10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc87400a760 tx=0x7fc874001cb0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.362+0000 7fc882bb9640 1 -- 172.21.15.38:0/2081437245 shutdown_connections 2023-12-22T08:44:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.362+0000 7fc882bb9640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc86006a430 0x7fc86006c8f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.362+0000 7fc882bb9640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87c1e7250 0x7fc87c15dc10 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.362+0000 7fc882bb9640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc87c135c10 0x7fc87c0b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.362+0000 7fc882bb9640 1 --2- 172.21.15.38:0/2081437245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc86c0051d0 0x7fc87c141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.362+0000 7fc882bb9640 1 -- 172.21.15.38:0/2081437245 >> 172.21.15.38:0/2081437245 conn(0x7fc87c06c5e0 msgr2=0x7fc87c0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.362+0000 7fc882bb9640 1 -- 172.21.15.38:0/2081437245 shutdown_connections 2023-12-22T08:44:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.362+0000 7fc882bb9640 1 -- 172.21.15.38:0/2081437245 wait complete. 2023-12-22T08:44:34.381 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:44:34.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.602+0000 7f7c0268a640 1 Processor -- start 2023-12-22T08:44:34.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.602+0000 7f7c0268a640 1 -- start start 2023-12-22T08:44:34.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.604+0000 7f7c0268a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7bfc161bb0 0x7f7bfc15e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.604+0000 7f7c0268a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bfc15e630 con 0x7f7bfc15ad90 2023-12-22T08:44:34.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.604+0000 7f7c0268a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bfc1610d0 con 0x7f7bfc0cb5e0 2023-12-22T08:44:34.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.604+0000 7f7c0268a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bfc0ce2c0 con 0x7f7bfc161bb0 2023-12-22T08:44:34.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.604+0000 7f7c01688640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7bfc15ad90 0x7f7bfc0caed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34206/0 (socket says 172.21.15.38:34206) 2023-12-22T08:44:34.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.604+0000 7f7c01688640 1 -- 172.21.15.38:0/1228052491 learned_addr learned my addr 172.21.15.38:0/1228052491 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:34.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.604+0000 7f7c01e89640 1 --2- 172.21.15.38:0/1228052491 >> v2:172.21.15.89:3300/0 conn(0x7f7bfc161bb0 0x7f7bfc15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.604+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643085746 0 0) 0x7f7bfc15e630 con 0x7f7bfc15ad90 2023-12-22T08:44:34.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7be8003520 con 0x7f7bfc15ad90 2023-12-22T08:44:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 284340939 0 0) 0x7f7be8003520 con 0x7f7bfc15ad90 2023-12-22T08:44:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 >> v2:172.21.15.89:3300/0 conn(0x7f7bfc161bb0 msgr2=0x7f7bfc15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 --2- 172.21.15.38:0/1228052491 >> v2:172.21.15.89:3300/0 conn(0x7f7bfc161bb0 0x7f7bfc15e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 >> v1:172.21.15.89:6789/0 conn(0x7f7bfc0cb5e0 legacy=0x7f7bfc15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc1613b0 con 0x7f7bfc15ad90 2023-12-22T08:44:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f7bf8001670 con 0x7f7bfc15ad90 2023-12-22T08:44:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 >> v1:172.21.15.38:6789/0 conn(0x7f7bfc15ad90 legacy=0x7f7bfc0caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:34.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 --2- 172.21.15.38:0/1228052491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7be8003970 0x7f7be8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 --2- 172.21.15.38:0/1228052491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be80047c0 0x7f7be8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 --2- 172.21.15.38:0/1228052491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7be8005180 0x7f7be800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be800bfd0 con 0x7f7be8003970 2023-12-22T08:44:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be800c140 con 0x7f7be80047c0 2023-12-22T08:44:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be800c300 con 0x7f7be8005180 2023-12-22T08:44:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.605+0000 7f7c01688640 1 --2- 172.21.15.38:0/1228052491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7be8003970 0x7f7be8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.606+0000 7f7c00e87640 1 --2- 172.21.15.38:0/1228052491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be80047c0 0x7f7be8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.606+0000 7f7c01688640 1 -- 172.21.15.38:0/1228052491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7be8005180 msgr2=0x7f7be800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.606+0000 7f7c01688640 1 --2- 172.21.15.38:0/1228052491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7be8005180 0x7f7be800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.606+0000 7f7c01688640 1 -- 172.21.15.38:0/1228052491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be80047c0 msgr2=0x7f7be8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.606+0000 7f7c01688640 1 --2- 172.21.15.38:0/1228052491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be80047c0 0x7f7be8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.606+0000 7f7c01688640 1 -- 172.21.15.38:0/1228052491 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be8003520 con 0x7f7be8003970 2023-12-22T08:44:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.606+0000 7f7c00e87640 1 --2- 172.21.15.38:0/1228052491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be80047c0 0x7f7be8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.606+0000 7f7c01e89640 1 -- 172.21.15.38:0/1228052491 reap_dead start 2023-12-22T08:44:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.607+0000 7f7c01688640 1 --2- 172.21.15.38:0/1228052491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7be8003970 0x7f7be8003d70 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800c210 tx=0x7f7be80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76efba578da86609 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.607+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8005ad0 con 0x7f7be8003970 2023-12-22T08:44:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.607+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf8005c50 con 0x7f7be8003970 2023-12-22T08:44:34.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.607+0000 7f7bf3fff640 1 -- 172.21.15.38:0/1228052491 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf802c8a0 con 0x7f7be8003970 2023-12-22T08:44:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.608+0000 7f7c0268a640 1 -- 172.21.15.38:0/1228052491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7be8003970 msgr2=0x7f7be8003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.608+0000 7f7c0268a640 1 --2- 172.21.15.38:0/1228052491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7be8003970 0x7f7be8003d70 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800c210 tx=0x7f7be80057f0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.608+0000 7f7c0268a640 1 -- 172.21.15.38:0/1228052491 shutdown_connections 2023-12-22T08:44:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.608+0000 7f7c0268a640 1 --2- 172.21.15.38:0/1228052491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7be8003970 0x7f7be8003d70 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.608+0000 7f7c0268a640 1 -- 172.21.15.38:0/1228052491 >> 172.21.15.38:0/1228052491 conn(0x7f7bfc0d31c0 msgr2=0x7f7bfc0d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.608+0000 7f7c0268a640 1 -- 172.21.15.38:0/1228052491 shutdown_connections 2023-12-22T08:44:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.608+0000 7f7c0268a640 1 -- 172.21.15.38:0/1228052491 wait complete. 2023-12-22T08:44:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.610+0000 7f7c0268a640 1 Processor -- start 2023-12-22T08:44:34.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.610+0000 7f7c0268a640 1 -- start start 2023-12-22T08:44:34.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c0268a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be8003970 0x7f7bfc0c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c0268a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bfc0b2580 0x7f7bfc0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c0268a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bfc0c5b80 0x7f7bfc0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c0268a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc0a9bc0 con 0x7f7bfc0b2580 2023-12-22T08:44:34.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c0268a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc1f1fb0 con 0x7f7be8003970 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c0268a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc0b2a10 con 0x7f7bfc0c5b80 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c00e87640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bfc0b2580 0x7f7bfc0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c00e87640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bfc0b2580 0x7f7bfc0c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47184/0 (socket says 172.21.15.38:47184) 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c00e87640 1 -- 172.21.15.38:0/2864786666 learned_addr learned my addr 172.21.15.38:0/2864786666 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c01688640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be8003970 0x7f7bfc0c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c01e89640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bfc0c5b80 0x7f7bfc0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c00e87640 1 -- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bfc0c5b80 msgr2=0x7f7bfc0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c00e87640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bfc0c5b80 0x7f7bfc0cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c00e87640 1 -- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be8003970 msgr2=0x7f7bfc0c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c00e87640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be8003970 0x7f7bfc0c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.611+0000 7f7c00e87640 1 -- 172.21.15.38:0/2864786666 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc0a9e10 con 0x7f7bfc0b2580 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.612+0000 7f7c00e87640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bfc0b2580 0x7f7bfc0c8520 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00d430 tx=0x7f7bec00d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.612+0000 7f7bf1ffb640 1 -- 172.21.15.38:0/2864786666 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec007020 con 0x7f7bfc0b2580 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.612+0000 7f7bf1ffb640 1 -- 172.21.15.38:0/2864786666 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec007180 con 0x7f7bfc0b2580 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.612+0000 7f7bf1ffb640 1 -- 172.21.15.38:0/2864786666 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec007530 con 0x7f7bfc0b2580 2023-12-22T08:44:34.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.612+0000 7f7c0268a640 1 -- 172.21.15.38:0/2864786666 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bfc0aa0f0 con 0x7f7bfc0b2580 2023-12-22T08:44:34.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.612+0000 7f7c0268a640 1 -- 172.21.15.38:0/2864786666 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bfc0cfde0 con 0x7f7bfc0b2580 2023-12-22T08:44:34.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.613+0000 7f7c0268a640 1 -- 172.21.15.38:0/2864786666 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bfc061910 con 0x7f7bfc0b2580 2023-12-22T08:44:34.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.614+0000 7f7bf1ffb640 1 -- 172.21.15.38:0/2864786666 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7bec0067d0 con 0x7f7bfc0b2580 2023-12-22T08:44:34.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.615+0000 7f7bf1ffb640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7be006a430 0x7f7be006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:34.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.615+0000 7f7bf1ffb640 1 -- 172.21.15.38:0/2864786666 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7bec088790 con 0x7f7bfc0b2580 2023-12-22T08:44:34.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.615+0000 7f7bf1ffb640 1 -- 172.21.15.38:0/2864786666 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f7be0072020 con 0x7f7bfc0b2580 2023-12-22T08:44:34.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.616+0000 7f7c01688640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7be006a430 0x7f7be006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:34.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.617+0000 7f7c01688640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7be006a430 0x7f7be006c8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8034000 tx=0x7f7bf8009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:34.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.620+0000 7f7bf1ffb640 1 -- 172.21.15.38:0/2864786666 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7bec053d40 con 0x7f7bfc0b2580 2023-12-22T08:44:34.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.803+0000 7f7c0268a640 1 -- 172.21.15.38:0/2864786666 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7bfc066dd0 con 0x7f7bfc0b2580 2023-12-22T08:44:34.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.804+0000 7f7bf1ffb640 1 -- 172.21.15.38:0/2864786666 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7bec0160a0 con 0x7f7bfc0b2580 2023-12-22T08:44:34.806 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:44:34.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.807+0000 7f7c0268a640 1 -- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7be006a430 msgr2=0x7f7be006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:34.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.807+0000 7f7c0268a640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7be006a430 0x7f7be006c8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8034000 tx=0x7f7bf8009030 comp rx=0 tx=0).stop 2023-12-22T08:44:34.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.807+0000 7f7c0268a640 1 -- 172.21.15.38:0/2864786666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bfc0b2580 msgr2=0x7f7bfc0c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:34.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.807+0000 7f7c0268a640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bfc0b2580 0x7f7bfc0c8520 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00d430 tx=0x7f7bec00d8f0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.807+0000 7f7c0268a640 1 -- 172.21.15.38:0/2864786666 shutdown_connections 2023-12-22T08:44:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.807+0000 7f7c0268a640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bfc0c5b80 0x7f7bfc0cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.807+0000 7f7c0268a640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7be006a430 0x7f7be006c8f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.807+0000 7f7c0268a640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7bfc0b2580 0x7f7bfc0c8520 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.807+0000 7f7c0268a640 1 --2- 172.21.15.38:0/2864786666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be8003970 0x7f7bfc0c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.807+0000 7f7c0268a640 1 -- 172.21.15.38:0/2864786666 >> 172.21.15.38:0/2864786666 conn(0x7f7bfc0d31c0 msgr2=0x7f7bfc0c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.807+0000 7f7c0268a640 1 -- 172.21.15.38:0/2864786666 shutdown_connections 2023-12-22T08:44:34.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:34.808+0000 7f7c0268a640 1 -- 172.21.15.38:0/2864786666 wait complete. 2023-12-22T08:44:34.828 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:44:35.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.040+0000 7f2d36c62640 1 Processor -- start 2023-12-22T08:44:35.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.041+0000 7f2d36c62640 1 -- start start 2023-12-22T08:44:35.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.042+0000 7f2d36c62640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2d30071080 0x7f2d300d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.042+0000 7f2d36c62640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2d3015d5a0 0x7f2d300d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.042+0000 7f2d36c62640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3015de50 con 0x7f2d3015d1c0 2023-12-22T08:44:35.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.042+0000 7f2d36c62640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d300d0dd0 con 0x7f2d3015d5a0 2023-12-22T08:44:35.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.042+0000 7f2d36c62640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d300d10b0 con 0x7f2d30071080 2023-12-22T08:44:35.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.042+0000 7f2d35c60640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2d3015d1c0 0x7f2d30070970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34210/0 (socket says 172.21.15.38:34210) 2023-12-22T08:44:35.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.042+0000 7f2d35c60640 1 -- 172.21.15.38:0/856690431 learned_addr learned my addr 172.21.15.38:0/856690431 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:35.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.042+0000 7f2d36461640 1 --2- 172.21.15.38:0/856690431 >> v2:172.21.15.38:3300/0 conn(0x7f2d3015d5a0 0x7f2d300d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.043+0000 7f2d3545f640 1 --2- 172.21.15.38:0/856690431 >> v2:172.21.15.89:3300/0 conn(0x7f2d30071080 0x7f2d300d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.043+0000 7f2d36461640 1 -- 172.21.15.38:0/856690431 >> v2:172.21.15.89:3300/0 conn(0x7f2d30071080 msgr2=0x7f2d300d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:35.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.043+0000 7f2d36461640 1 --2- 172.21.15.38:0/856690431 >> v2:172.21.15.89:3300/0 conn(0x7f2d30071080 0x7f2d300d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.043+0000 7f2d36461640 1 -- 172.21.15.38:0/856690431 >> v1:172.21.15.38:6789/0 conn(0x7f2d3015d1c0 legacy=0x7f2d30070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:35.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.043+0000 7f2d36461640 1 -- 172.21.15.38:0/856690431 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3015dae0 con 0x7f2d3015d5a0 2023-12-22T08:44:35.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.043+0000 7f2d34c5e640 1 -- 172.21.15.38:0/856690431 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824107105 0 0) 0x7f2d3015de50 con 0x7f2d3015d1c0 2023-12-22T08:44:35.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.043+0000 7f2d3545f640 1 --2- 172.21.15.38:0/856690431 >> v2:172.21.15.89:3300/0 conn(0x7f2d30071080 0x7f2d300d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:35.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.044+0000 7f2d36461640 1 --2- 172.21.15.38:0/856690431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d3015d5a0 0x7f2d300d05a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f2d30160e20 tx=0x7f2d2802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b08fab4891232 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:35.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.044+0000 7f2d34c5e640 1 -- 172.21.15.38:0/856690431 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2802cc80 con 0x7f2d3015d5a0 2023-12-22T08:44:35.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.045+0000 7f2d34c5e640 1 -- 172.21.15.38:0/856690431 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2802cde0 con 0x7f2d3015d5a0 2023-12-22T08:44:35.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.045+0000 7f2d34c5e640 1 -- 172.21.15.38:0/856690431 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28034660 con 0x7f2d3015d5a0 2023-12-22T08:44:35.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.045+0000 7f2d36c62640 1 -- 172.21.15.38:0/856690431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d3015d5a0 msgr2=0x7f2d300d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:35.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.045+0000 7f2d36c62640 1 --2- 172.21.15.38:0/856690431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d3015d5a0 0x7f2d300d05a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f2d30160e20 tx=0x7f2d2802bed0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.045+0000 7f2d36c62640 1 -- 172.21.15.38:0/856690431 shutdown_connections 2023-12-22T08:44:35.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.045+0000 7f2d36c62640 1 --2- 172.21.15.38:0/856690431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d3015d5a0 0x7f2d300d05a0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.045+0000 7f2d36c62640 1 --2- 172.21.15.38:0/856690431 >> v2:172.21.15.89:3300/0 conn(0x7f2d30071080 0x7f2d300d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.045+0000 7f2d36c62640 1 -- 172.21.15.38:0/856690431 >> 172.21.15.38:0/856690431 conn(0x7f2d3006bf90 msgr2=0x7f2d3006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:35.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.046+0000 7f2d36c62640 1 -- 172.21.15.38:0/856690431 shutdown_connections 2023-12-22T08:44:35.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.046+0000 7f2d36c62640 1 -- 172.21.15.38:0/856690431 wait complete. 2023-12-22T08:44:35.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.047+0000 7f2d36c62640 1 Processor -- start 2023-12-22T08:44:35.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.047+0000 7f2d36c62640 1 -- start start 2023-12-22T08:44:35.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.048+0000 7f2d36c62640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d30071080 0x7f2d300cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.048+0000 7f2d36c62640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d3015d1c0 0x7f2d3015fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.048+0000 7f2d36c62640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d3015d5a0 0x7f2d30160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.048+0000 7f2d36c62640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3014bcf0 con 0x7f2d3015d5a0 2023-12-22T08:44:35.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.048+0000 7f2d36c62640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3014bfd0 con 0x7f2d3015d1c0 2023-12-22T08:44:35.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.048+0000 7f2d36c62640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3014c2b0 con 0x7f2d30071080 2023-12-22T08:44:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.049+0000 7f2d36461640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d3015d5a0 0x7f2d30160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.049+0000 7f2d36461640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d3015d5a0 0x7f2d30160330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47206/0 (socket says 172.21.15.38:47206) 2023-12-22T08:44:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.049+0000 7f2d36461640 1 -- 172.21.15.38:0/2918710033 learned_addr learned my addr 172.21.15.38:0/2918710033 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.049+0000 7f2d35c60640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d30071080 0x7f2d300cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.049+0000 7f2d3545f640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d3015d1c0 0x7f2d3015fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.049+0000 7f2d36461640 1 -- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d30071080 msgr2=0x7f2d300cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.049+0000 7f2d36461640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d30071080 0x7f2d300cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.049+0000 7f2d36461640 1 -- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d3015d1c0 msgr2=0x7f2d3015fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:35.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.049+0000 7f2d36461640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d3015d1c0 0x7f2d3015fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.049+0000 7f2d36461640 1 -- 172.21.15.38:0/2918710033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28009a70 con 0x7f2d3015d5a0 2023-12-22T08:44:35.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.050+0000 7f2d36461640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d3015d5a0 0x7f2d30160330 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f2d2802c4e0 tx=0x7f2d28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:35.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.050+0000 7f2d267fc640 1 -- 172.21.15.38:0/2918710033 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2803e610 con 0x7f2d3015d5a0 2023-12-22T08:44:35.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.050+0000 7f2d267fc640 1 -- 172.21.15.38:0/2918710033 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2803e770 con 0x7f2d3015d5a0 2023-12-22T08:44:35.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.050+0000 7f2d267fc640 1 -- 172.21.15.38:0/2918710033 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2803eb20 con 0x7f2d3015d5a0 2023-12-22T08:44:35.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.050+0000 7f2d36c62640 1 -- 172.21.15.38:0/2918710033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3014c590 con 0x7f2d3015d5a0 2023-12-22T08:44:35.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.050+0000 7f2d36c62640 1 -- 172.21.15.38:0/2918710033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d300cf300 con 0x7f2d3015d5a0 2023-12-22T08:44:35.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.051+0000 7f2d36c62640 1 -- 172.21.15.38:0/2918710033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3014ca50 con 0x7f2d3015d5a0 2023-12-22T08:44:35.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.052+0000 7f2d267fc640 1 -- 172.21.15.38:0/2918710033 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2d2803b050 con 0x7f2d3015d5a0 2023-12-22T08:44:35.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.053+0000 7f2d267fc640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2d1406a430 0x7f2d1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.053+0000 7f2d267fc640 1 -- 172.21.15.38:0/2918710033 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2d280ab210 con 0x7f2d3015d5a0 2023-12-22T08:44:35.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.053+0000 7f2d267fc640 1 -- 172.21.15.38:0/2918710033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f2d14072020 con 0x7f2d3015d5a0 2023-12-22T08:44:35.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.054+0000 7f2d35c60640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2d1406a430 0x7f2d1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.055+0000 7f2d35c60640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2d1406a430 0x7f2d1406c8f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c007fd0 tx=0x7f2d2c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:35.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.057+0000 7f2d267fc640 1 -- 172.21.15.38:0/2918710033 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2d28076840 con 0x7f2d3015d5a0 2023-12-22T08:44:35.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.255+0000 7f2d36c62640 1 -- 172.21.15.38:0/2918710033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d30061910 con 0x7f2d3015d5a0 2023-12-22T08:44:35.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.256+0000 7f2d267fc640 1 -- 172.21.15.38:0/2918710033 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d28039070 con 0x7f2d3015d5a0 2023-12-22T08:44:35.276 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:44:35.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.258+0000 7f2d36c62640 1 -- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2d1406a430 msgr2=0x7f2d1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:35.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.258+0000 7f2d36c62640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2d1406a430 0x7f2d1406c8f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c007fd0 tx=0x7f2d2c009040 comp rx=0 tx=0).stop 2023-12-22T08:44:35.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.258+0000 7f2d36c62640 1 -- 172.21.15.38:0/2918710033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d3015d5a0 msgr2=0x7f2d30160330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:35.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.258+0000 7f2d36c62640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d3015d5a0 0x7f2d30160330 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f2d2802c4e0 tx=0x7f2d28004a40 comp rx=0 tx=0).stop 2023-12-22T08:44:35.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.259+0000 7f2d36c62640 1 -- 172.21.15.38:0/2918710033 shutdown_connections 2023-12-22T08:44:35.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.259+0000 7f2d36c62640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2d1406a430 0x7f2d1406c8f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.259+0000 7f2d36c62640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d3015d5a0 0x7f2d30160330 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.259+0000 7f2d36c62640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d3015d1c0 0x7f2d3015fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.259+0000 7f2d36c62640 1 --2- 172.21.15.38:0/2918710033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d30071080 0x7f2d300cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.259+0000 7f2d36c62640 1 -- 172.21.15.38:0/2918710033 >> 172.21.15.38:0/2918710033 conn(0x7f2d3006bf90 msgr2=0x7f2d3006d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:35.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.259+0000 7f2d36c62640 1 -- 172.21.15.38:0/2918710033 shutdown_connections 2023-12-22T08:44:35.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.259+0000 7f2d36c62640 1 -- 172.21.15.38:0/2918710033 wait complete. 2023-12-22T08:44:35.279 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:44:35.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.502+0000 7fc8434ec640 1 Processor -- start 2023-12-22T08:44:35.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.502+0000 7fc8434ec640 1 -- start start 2023-12-22T08:44:35.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.504+0000 7fc8434ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c144d10 0x7fc83c0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.504+0000 7fc8434ec640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c1450f0 con 0x7fc83c0b2760 2023-12-22T08:44:35.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.504+0000 7fc8434ec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c0ce010 con 0x7fc83c0cc670 2023-12-22T08:44:35.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.504+0000 7fc8434ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0ce2f0 con 0x7fc83c144d10 2023-12-22T08:44:35.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.504+0000 7fc841a89640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc83c0b2760 0x7fc83c070800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34222/0 (socket says 172.21.15.38:34222) 2023-12-22T08:44:35.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.504+0000 7fc841a89640 1 -- 172.21.15.38:0/1697275796 learned_addr learned my addr 172.21.15.38:0/1697275796 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:35.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc841288640 1 --2- 172.21.15.38:0/1697275796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c144d10 0x7fc83c0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084144917 0 0) 0x7fc83c1450f0 con 0x7fc83c0b2760 2023-12-22T08:44:35.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc82c003520 con 0x7fc83c0b2760 2023-12-22T08:44:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 608334975 0 0) 0x7fc82c003520 con 0x7fc83c0b2760 2023-12-22T08:44:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c144d10 msgr2=0x7fc83c0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 --2- 172.21.15.38:0/1697275796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c144d10 0x7fc83c0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 >> v1:172.21.15.89:6789/0 conn(0x7fc83c0cc670 legacy=0x7fc83c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c0ce5d0 con 0x7fc83c0b2760 2023-12-22T08:44:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fc834001670 con 0x7fc83c0b2760 2023-12-22T08:44:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 >> v1:172.21.15.38:6789/0 conn(0x7fc83c0b2760 legacy=0x7fc83c070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 --2- 172.21.15.38:0/1697275796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82c0039a0 0x7fc82c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 --2- 172.21.15.38:0/1697275796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc82c0047c0 0x7fc82c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 --2- 172.21.15.38:0/1697275796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c144d10 0x7fc82c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0ce2f0 con 0x7fc82c0039a0 2023-12-22T08:44:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c00ba60 con 0x7fc82c0047c0 2023-12-22T08:44:35.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.505+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c00bc20 con 0x7fc83c144d10 2023-12-22T08:44:35.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.506+0000 7fc841288640 1 --2- 172.21.15.38:0/1697275796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82c0039a0 0x7fc82c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.506+0000 7fc841a89640 1 --2- 172.21.15.38:0/1697275796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c144d10 0x7fc82c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.506+0000 7fc840a87640 1 --2- 172.21.15.38:0/1697275796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc82c0047c0 0x7fc82c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.506+0000 7fc841288640 1 -- 172.21.15.38:0/1697275796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c144d10 msgr2=0x7fc82c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:35.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.506+0000 7fc841288640 1 --2- 172.21.15.38:0/1697275796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c144d10 0x7fc82c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.506+0000 7fc841288640 1 -- 172.21.15.38:0/1697275796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc82c0047c0 msgr2=0x7fc82c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:35.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.506+0000 7fc841288640 1 --2- 172.21.15.38:0/1697275796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc82c0047c0 0x7fc82c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.506+0000 7fc841288640 1 -- 172.21.15.38:0/1697275796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c003520 con 0x7fc82c0039a0 2023-12-22T08:44:35.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.508+0000 7fc841288640 1 --2- 172.21.15.38:0/1697275796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82c0039a0 0x7fc82c003dc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc830009f90 tx=0x7fc82c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8f61f5de9591e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:35.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.508+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83002cbd0 con 0x7fc82c0039a0 2023-12-22T08:44:35.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.508+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83000f040 con 0x7fc82c0039a0 2023-12-22T08:44:35.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.508+0000 7fc83bfff640 1 -- 172.21.15.38:0/1697275796 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830034440 con 0x7fc82c0039a0 2023-12-22T08:44:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.508+0000 7fc8434ec640 1 -- 172.21.15.38:0/1697275796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82c0039a0 msgr2=0x7fc82c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.508+0000 7fc8434ec640 1 --2- 172.21.15.38:0/1697275796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82c0039a0 0x7fc82c003dc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc830009f90 tx=0x7fc82c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.508+0000 7fc841a89640 1 -- 172.21.15.38:0/1697275796 reap_dead start 2023-12-22T08:44:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.509+0000 7fc8434ec640 1 -- 172.21.15.38:0/1697275796 shutdown_connections 2023-12-22T08:44:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.509+0000 7fc8434ec640 1 -- 172.21.15.38:0/1697275796 >> 172.21.15.38:0/1697275796 conn(0x7fc83c0cf070 msgr2=0x7fc83c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.509+0000 7fc8434ec640 1 -- 172.21.15.38:0/1697275796 shutdown_connections 2023-12-22T08:44:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.509+0000 7fc8434ec640 1 -- 172.21.15.38:0/1697275796 wait complete. 2023-12-22T08:44:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.510+0000 7fc8434ec640 1 Processor -- start 2023-12-22T08:44:35.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.511+0000 7fc8434ec640 1 -- start start 2023-12-22T08:44:35.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc8434ec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82c0039a0 0x7fc83c0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc8434ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c15eee0 0x7fc83c15f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc8434ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c15ccd0 0x7fc83c15d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc8434ec640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c15f880 con 0x7fc82c0039a0 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc8434ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c15e610 con 0x7fc83c15eee0 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc8434ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c15da00 con 0x7fc83c15ccd0 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc841288640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82c0039a0 0x7fc83c0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc841288640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82c0039a0 0x7fc83c0afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47228/0 (socket says 172.21.15.38:47228) 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc841288640 1 -- 172.21.15.38:0/336681531 learned_addr learned my addr 172.21.15.38:0/336681531 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc841a89640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c15ccd0 0x7fc83c15d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc840a87640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c15eee0 0x7fc83c15f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc841288640 1 -- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c15ccd0 msgr2=0x7fc83c15d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc841288640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c15ccd0 0x7fc83c15d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc841288640 1 -- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c15eee0 msgr2=0x7fc83c15f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc841288640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c15eee0 0x7fc83c15f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc841288640 1 -- 172.21.15.38:0/336681531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c15dce0 con 0x7fc82c0039a0 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc841a89640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c15ccd0 0x7fc83c15d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:35.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.512+0000 7fc840a87640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c15eee0 0x7fc83c15f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:35.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.513+0000 7fc841288640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82c0039a0 0x7fc83c0afac0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc83002c570 tx=0x7fc830009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:35.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.513+0000 7fc839ffb640 1 -- 172.21.15.38:0/336681531 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830034d60 con 0x7fc82c0039a0 2023-12-22T08:44:35.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.513+0000 7fc839ffb640 1 -- 172.21.15.38:0/336681531 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830040450 con 0x7fc82c0039a0 2023-12-22T08:44:35.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.513+0000 7fc839ffb640 1 -- 172.21.15.38:0/336681531 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830040800 con 0x7fc82c0039a0 2023-12-22T08:44:35.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.513+0000 7fc8434ec640 1 -- 172.21.15.38:0/336681531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c15dfc0 con 0x7fc82c0039a0 2023-12-22T08:44:35.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.513+0000 7fc8434ec640 1 -- 172.21.15.38:0/336681531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c15d690 con 0x7fc82c0039a0 2023-12-22T08:44:35.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.514+0000 7fc8434ec640 1 -- 172.21.15.38:0/336681531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c061910 con 0x7fc82c0039a0 2023-12-22T08:44:35.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.515+0000 7fc839ffb640 1 -- 172.21.15.38:0/336681531 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc830040960 con 0x7fc82c0039a0 2023-12-22T08:44:35.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.516+0000 7fc839ffb640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc82006a430 0x7fc82006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:35.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.516+0000 7fc839ffb640 1 -- 172.21.15.38:0/336681531 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc8300ab1b0 con 0x7fc82c0039a0 2023-12-22T08:44:35.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.516+0000 7fc839ffb640 1 -- 172.21.15.38:0/336681531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7fc820072020 con 0x7fc82c0039a0 2023-12-22T08:44:35.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.517+0000 7fc840a87640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc82006a430 0x7fc82006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.518+0000 7fc840a87640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc82006a430 0x7fc82006c8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc83c137850 tx=0x7fc828009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:35.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.521+0000 7fc839ffb640 1 -- 172.21.15.38:0/336681531 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc8300767e0 con 0x7fc82c0039a0 2023-12-22T08:44:35.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.727+0000 7fc8434ec640 1 -- 172.21.15.38:0/336681531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc83c0ce880 con 0x7fc82c0039a0 2023-12-22T08:44:35.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.728+0000 7fc839ffb640 1 -- 172.21.15.38:0/336681531 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc830044080 con 0x7fc82c0039a0 2023-12-22T08:44:35.733 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:44:35.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.731+0000 7fc8434ec640 1 -- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc82006a430 msgr2=0x7fc82006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:35.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.731+0000 7fc8434ec640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc82006a430 0x7fc82006c8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc83c137850 tx=0x7fc828009040 comp rx=0 tx=0).stop 2023-12-22T08:44:35.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.731+0000 7fc8434ec640 1 -- 172.21.15.38:0/336681531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82c0039a0 msgr2=0x7fc83c0afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:35.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.731+0000 7fc8434ec640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82c0039a0 0x7fc83c0afac0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc83002c570 tx=0x7fc830009750 comp rx=0 tx=0).stop 2023-12-22T08:44:35.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.731+0000 7fc8434ec640 1 -- 172.21.15.38:0/336681531 shutdown_connections 2023-12-22T08:44:35.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.731+0000 7fc8434ec640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc83c15ccd0 0x7fc83c15d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.731+0000 7fc8434ec640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc83c15eee0 0x7fc83c15f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.731+0000 7fc8434ec640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc82006a430 0x7fc82006c8f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.731+0000 7fc8434ec640 1 --2- 172.21.15.38:0/336681531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82c0039a0 0x7fc83c0afac0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:35.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.731+0000 7fc8434ec640 1 -- 172.21.15.38:0/336681531 >> 172.21.15.38:0/336681531 conn(0x7fc83c0cf070 msgr2=0x7fc83c0af000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:35.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.731+0000 7fc8434ec640 1 -- 172.21.15.38:0/336681531 shutdown_connections 2023-12-22T08:44:35.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:35.731+0000 7fc8434ec640 1 -- 172.21.15.38:0/336681531 wait complete. 2023-12-22T08:44:35.752 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T08:44:35.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:44:35.752 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-22T08:44:35.866 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:44:35.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:44:35.866 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T08:44:35.919 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:44:35.919 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:44:35.982 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:44:35.982 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:44:35.982 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:44:36.041 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:44:36.041 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:44:36.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.276+0000 7ff3ee3c4640 1 Processor -- start 2023-12-22T08:44:36.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.276+0000 7ff3ee3c4640 1 -- start start 2023-12-22T08:44:36.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.277+0000 7ff3ee3c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e815e740 0x7ff3e815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.278+0000 7ff3ee3c4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff3e80b3f90 0x7ff3e8070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.278+0000 7ff3ee3c4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e815eb20 con 0x7ff3e806ca50 2023-12-22T08:44:36.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.278+0000 7ff3ee3c4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e806e650 con 0x7ff3e80b3f90 2023-12-22T08:44:36.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.278+0000 7ff3ee3c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e8070770 con 0x7ff3e815e740 2023-12-22T08:44:36.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.278+0000 7ff3e77fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff3e806ca50 0x7ff3e80b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:59022/0 (socket says 172.21.15.38:59022) 2023-12-22T08:44:36.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.278+0000 7ff3e77fe640 1 -- 172.21.15.38:0/571223452 learned_addr learned my addr 172.21.15.38:0/571223452 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:36.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.278+0000 7ff3e7fff640 1 --2- 172.21.15.38:0/571223452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e815e740 0x7ff3e815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.278+0000 7ff3ec961640 1 --2- 172.21.15.38:0/571223452 >> v2:172.21.15.89:3300/0 conn(0x7ff3e80b3f90 0x7ff3e8070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.279+0000 7ff3e6ffd640 1 -- 172.21.15.38:0/571223452 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017327644 0 0) 0x7ff3e815eb20 con 0x7ff3e806ca50 2023-12-22T08:44:36.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.279+0000 7ff3e6ffd640 1 -- 172.21.15.38:0/571223452 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3d0003520 con 0x7ff3e806ca50 2023-12-22T08:44:36.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.279+0000 7ff3ec961640 1 -- 172.21.15.38:0/571223452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e815e740 msgr2=0x7ff3e815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:36.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.279+0000 7ff3ec961640 1 --2- 172.21.15.38:0/571223452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e815e740 0x7ff3e815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.279+0000 7ff3ec961640 1 -- 172.21.15.38:0/571223452 >> v1:172.21.15.89:6789/0 conn(0x7ff3e806ca50 legacy=0x7ff3e80b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:36.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.279+0000 7ff3ec961640 1 -- 172.21.15.38:0/571223452 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e806d180 con 0x7ff3e80b3f90 2023-12-22T08:44:36.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.280+0000 7ff3e7fff640 1 --2- 172.21.15.38:0/571223452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e815e740 0x7ff3e815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:44:36.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.281+0000 7ff3ec961640 1 --2- 172.21.15.38:0/571223452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e80b3f90 0x7ff3e8070c00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009d90 tx=0x7ff3e002bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=780fcdf9cafa3baa server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:36.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.281+0000 7ff3e6ffd640 1 -- 172.21.15.38:0/571223452 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e002cb30 con 0x7ff3e80b3f90 2023-12-22T08:44:36.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.281+0000 7ff3e6ffd640 1 -- 172.21.15.38:0/571223452 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e002cc90 con 0x7ff3e80b3f90 2023-12-22T08:44:36.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.281+0000 7ff3e6ffd640 1 -- 172.21.15.38:0/571223452 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0034440 con 0x7ff3e80b3f90 2023-12-22T08:44:36.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.282+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/571223452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e80b3f90 msgr2=0x7ff3e8070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:36.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.282+0000 7ff3ee3c4640 1 --2- 172.21.15.38:0/571223452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e80b3f90 0x7ff3e8070c00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009d90 tx=0x7ff3e002bd80 comp rx=0 tx=0).stop 2023-12-22T08:44:36.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.282+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/571223452 shutdown_connections 2023-12-22T08:44:36.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.282+0000 7ff3ee3c4640 1 --2- 172.21.15.38:0/571223452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e80b3f90 0x7ff3e8070c00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.282+0000 7ff3ee3c4640 1 --2- 172.21.15.38:0/571223452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e815e740 0x7ff3e815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.282+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/571223452 >> 172.21.15.38:0/571223452 conn(0x7ff3e80cfea0 msgr2=0x7ff3e80d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:36.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.282+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/571223452 shutdown_connections 2023-12-22T08:44:36.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.282+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/571223452 wait complete. 2023-12-22T08:44:36.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.284+0000 7ff3ee3c4640 1 Processor -- start 2023-12-22T08:44:36.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.284+0000 7ff3ee3c4640 1 -- start start 2023-12-22T08:44:36.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.285+0000 7ff3ee3c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e806ca50 0x7ff3e8157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.285+0000 7ff3ee3c4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3e80b3f90 0x7ff3e813f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.285+0000 7ff3ee3c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e815e740 0x7ff3e81f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.285+0000 7ff3ee3c4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e8151f40 con 0x7ff3e80b3f90 2023-12-22T08:44:36.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.285+0000 7ff3ee3c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e81554d0 con 0x7ff3e806ca50 2023-12-22T08:44:36.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.285+0000 7ff3ee3c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e8157b60 con 0x7ff3e815e740 2023-12-22T08:44:36.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.285+0000 7ff3e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3e80b3f90 0x7ff3e813f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.285+0000 7ff3e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3e80b3f90 0x7ff3e813f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47232/0 (socket says 172.21.15.38:47232) 2023-12-22T08:44:36.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.286+0000 7ff3e77fe640 1 -- 172.21.15.38:0/4257619234 learned_addr learned my addr 172.21.15.38:0/4257619234 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:36.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.286+0000 7ff3e7fff640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e806ca50 0x7ff3e8157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.286+0000 7ff3ec961640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e815e740 0x7ff3e81f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.286+0000 7ff3e77fe640 1 -- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e815e740 msgr2=0x7ff3e81f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:36.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.286+0000 7ff3e77fe640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e815e740 0x7ff3e81f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.286+0000 7ff3e77fe640 1 -- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e806ca50 msgr2=0x7ff3e8157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:36.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.286+0000 7ff3e77fe640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e806ca50 0x7ff3e8157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.286+0000 7ff3e77fe640 1 -- 172.21.15.38:0/4257619234 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d8009400 con 0x7ff3e80b3f90 2023-12-22T08:44:36.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.286+0000 7ff3e7fff640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e806ca50 0x7ff3e8157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:44:36.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.286+0000 7ff3e77fe640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3e80b3f90 0x7ff3e813f480 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c500 tx=0x7ff3dc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.287+0000 7ff3e4ff9640 1 -- 172.21.15.38:0/4257619234 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc005ce0 con 0x7ff3e80b3f90 2023-12-22T08:44:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.287+0000 7ff3e4ff9640 1 -- 172.21.15.38:0/4257619234 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc005e40 con 0x7ff3e80b3f90 2023-12-22T08:44:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.287+0000 7ff3e4ff9640 1 -- 172.21.15.38:0/4257619234 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc007330 con 0x7ff3e80b3f90 2023-12-22T08:44:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.287+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/4257619234 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e0009a70 con 0x7ff3e80b3f90 2023-12-22T08:44:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.287+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/4257619234 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e8151880 con 0x7ff3e80b3f90 2023-12-22T08:44:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.288+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/4257619234 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e8152080 con 0x7ff3e80b3f90 2023-12-22T08:44:36.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.289+0000 7ff3e4ff9640 1 -- 172.21.15.38:0/4257619234 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff3dc007490 con 0x7ff3e80b3f90 2023-12-22T08:44:36.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.290+0000 7ff3e4ff9640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3d406a460 0x7ff3d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.290+0000 7ff3e4ff9640 1 -- 172.21.15.38:0/4257619234 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff3dc087fb0 con 0x7ff3e80b3f90 2023-12-22T08:44:36.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.290+0000 7ff3e4ff9640 1 -- 172.21.15.38:0/4257619234 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7ff3d4072050 con 0x7ff3e80b3f90 2023-12-22T08:44:36.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.291+0000 7ff3e7fff640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3d406a460 0x7ff3d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.292+0000 7ff3e7fff640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3d406a460 0x7ff3d406c920 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009c80 tx=0x7ff3d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:36.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.295+0000 7ff3e4ff9640 1 -- 172.21.15.38:0/4257619234 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff3dc017060 con 0x7ff3e80b3f90 2023-12-22T08:44:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.533+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/4257619234 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3e81516c0 con 0x7ff3e80b3f90 2023-12-22T08:44:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.534+0000 7ff3e4ff9640 1 -- 172.21.15.38:0/4257619234 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4645 (secure 0 0 0) 0x7ff3e8152080 con 0x7ff3e80b3f90 2023-12-22T08:44:36.536 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:36.536 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3287488986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3287488986},{"type":"v1","addr":"172.21.15.89:6836","nonce":3287488986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2154639115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2154639115},{"type":"v1","addr":"172.21.15.89:6837","nonce":2154639115}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/807798598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":807798598},{"type":"v1","addr":"172.21.15.38:6833","nonce":807798598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:43:08.736828+0000","modified":"2023-12-22T08:43:12.231629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1778808252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1778808252},{"type":"v1","addr":"172.21.15.38:6835","nonce":1778808252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-22T08:44:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 32 2023-12-22T08:44:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.536+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3d406a460 msgr2=0x7ff3d406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.536+0000 7ff3ee3c4640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3d406a460 0x7ff3d406c920 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009c80 tx=0x7ff3d8008040 comp rx=0 tx=0).stop 2023-12-22T08:44:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.536+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/4257619234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3e80b3f90 msgr2=0x7ff3e813f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.537+0000 7ff3ee3c4640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3e80b3f90 0x7ff3e813f480 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00c500 tx=0x7ff3dc00c9c0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.537+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/4257619234 shutdown_connections 2023-12-22T08:44:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.537+0000 7ff3ee3c4640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e815e740 0x7ff3e81f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.537+0000 7ff3ee3c4640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3d406a460 0x7ff3d406c920 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.537+0000 7ff3ee3c4640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3e80b3f90 0x7ff3e813f480 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.537+0000 7ff3ee3c4640 1 --2- 172.21.15.38:0/4257619234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e806ca50 0x7ff3e8157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.537+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/4257619234 >> 172.21.15.38:0/4257619234 conn(0x7ff3e80cfea0 msgr2=0x7ff3e8154180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:36.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.537+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/4257619234 shutdown_connections 2023-12-22T08:44:36.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.537+0000 7ff3ee3c4640 1 -- 172.21.15.38:0/4257619234 wait complete. 2023-12-22T08:44:36.560 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:44:36.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.785+0000 7fd7070cc640 1 Processor -- start 2023-12-22T08:44:36.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.786+0000 7fd7070cc640 1 -- start start 2023-12-22T08:44:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.787+0000 7fd7070cc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7000cb4c0 0x7fd70015e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.787+0000 7fd7070cc640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7000706d0 con 0x7fd70006d5f0 2023-12-22T08:44:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.787+0000 7fd7070cc640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7000cbf40 con 0x7fd70006d210 2023-12-22T08:44:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.787+0000 7fd7070cc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000ce840 con 0x7fd7000cb4c0 2023-12-22T08:44:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.787+0000 7fd7068cb640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd70006d5f0 0x7fd700070b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34224/0 (socket says 172.21.15.38:34224) 2023-12-22T08:44:36.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.788+0000 7fd7068cb640 1 -- 172.21.15.38:0/705360146 learned_addr learned my addr 172.21.15.38:0/705360146 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:36.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.788+0000 7fd7058c9640 1 --2- 172.21.15.38:0/705360146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7000cb4c0 0x7fd70015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.788+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053279653 0 0) 0x7fd7000706d0 con 0x7fd70006d5f0 2023-12-22T08:44:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.788+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6ec005730 con 0x7fd70006d5f0 2023-12-22T08:44:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.788+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2035706060 0 0) 0x7fd6ec005730 con 0x7fd70006d5f0 2023-12-22T08:44:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.788+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7000cb4c0 msgr2=0x7fd70015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.788+0000 7fd7050c8640 1 --2- 172.21.15.38:0/705360146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7000cb4c0 0x7fd70015e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.788+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 >> v1:172.21.15.89:6789/0 conn(0x7fd70006d210 legacy=0x7fd700159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.788+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000ceb20 con 0x7fd70006d5f0 2023-12-22T08:44:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.788+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fd6f80019f0 con 0x7fd70006d5f0 2023-12-22T08:44:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.788+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 >> v1:172.21.15.38:6789/0 conn(0x7fd70006d5f0 legacy=0x7fd700070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7050c8640 1 --2- 172.21.15.38:0/705360146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6ec005bb0 0x7fd6ec005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7050c8640 1 --2- 172.21.15.38:0/705360146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6ec0069d0 0x7fd6ec006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7050c8640 1 --2- 172.21.15.38:0/705360146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7000cb4c0 0x7fd6ec007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000ce840 con 0x7fd6ec005bb0 2023-12-22T08:44:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec00dc40 con 0x7fd6ec0069d0 2023-12-22T08:44:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec00de00 con 0x7fd7000cb4c0 2023-12-22T08:44:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7060ca640 1 --2- 172.21.15.38:0/705360146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6ec005bb0 0x7fd6ec005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7058c9640 1 --2- 172.21.15.38:0/705360146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6ec0069d0 0x7fd6ec006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7068cb640 1 --2- 172.21.15.38:0/705360146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7000cb4c0 0x7fd6ec007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7060ca640 1 -- 172.21.15.38:0/705360146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7000cb4c0 msgr2=0x7fd6ec007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7060ca640 1 --2- 172.21.15.38:0/705360146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7000cb4c0 0x7fd6ec007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7060ca640 1 -- 172.21.15.38:0/705360146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6ec0069d0 msgr2=0x7fd6ec006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7060ca640 1 --2- 172.21.15.38:0/705360146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6ec0069d0 0x7fd6ec006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7060ca640 1 -- 172.21.15.38:0/705360146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec005730 con 0x7fd6ec005bb0 2023-12-22T08:44:36.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.789+0000 7fd7068cb640 1 --2- 172.21.15.38:0/705360146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7000cb4c0 0x7fd6ec007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:36.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.791+0000 7fd7060ca640 1 --2- 172.21.15.38:0/705360146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6ec005bb0 0x7fd6ec005fd0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc001720 tx=0x7fd6ec007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa60b958bef337a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:36.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.791+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc0052d0 con 0x7fd6ec005bb0 2023-12-22T08:44:36.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.791+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc02e050 con 0x7fd6ec005bb0 2023-12-22T08:44:36.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.791+0000 7fd7050c8640 1 -- 172.21.15.38:0/705360146 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc0035f0 con 0x7fd6ec005bb0 2023-12-22T08:44:36.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.791+0000 7fd7070cc640 1 -- 172.21.15.38:0/705360146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6ec005bb0 msgr2=0x7fd6ec005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:36.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.791+0000 7fd7070cc640 1 --2- 172.21.15.38:0/705360146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6ec005bb0 0x7fd6ec005fd0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc001720 tx=0x7fd6ec007a00 comp rx=0 tx=0).stop 2023-12-22T08:44:36.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.792+0000 7fd7068cb640 1 -- 172.21.15.38:0/705360146 reap_dead start 2023-12-22T08:44:36.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.792+0000 7fd7070cc640 1 -- 172.21.15.38:0/705360146 shutdown_connections 2023-12-22T08:44:36.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.792+0000 7fd7070cc640 1 -- 172.21.15.38:0/705360146 >> 172.21.15.38:0/705360146 conn(0x7fd7000b1f70 msgr2=0x7fd7000b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:36.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.792+0000 7fd7070cc640 1 -- 172.21.15.38:0/705360146 shutdown_connections 2023-12-22T08:44:36.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.792+0000 7fd7070cc640 1 -- 172.21.15.38:0/705360146 wait complete. 2023-12-22T08:44:36.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.794+0000 7fd7070cc640 1 Processor -- start 2023-12-22T08:44:36.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.794+0000 7fd7070cc640 1 -- start start 2023-12-22T08:44:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.795+0000 7fd7070cc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6ec005bb0 0x7fd70015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.795+0000 7fd7070cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd70015ac50 0x7fd700158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.795+0000 7fd7070cc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd700152a00 0x7fd70015cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.795+0000 7fd7070cc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000a3e80 con 0x7fd6ec005bb0 2023-12-22T08:44:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.795+0000 7fd7070cc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd700157270 con 0x7fd70015ac50 2023-12-22T08:44:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.795+0000 7fd7070cc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd700157550 con 0x7fd700152a00 2023-12-22T08:44:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.795+0000 7fd7060ca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6ec005bb0 0x7fd70015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.795+0000 7fd7060ca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6ec005bb0 0x7fd70015bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47252/0 (socket says 172.21.15.38:47252) 2023-12-22T08:44:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.795+0000 7fd7060ca640 1 -- 172.21.15.38:0/150768685 learned_addr learned my addr 172.21.15.38:0/150768685 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.796+0000 7fd7058c9640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd70015ac50 0x7fd700158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.796+0000 7fd7068cb640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd700152a00 0x7fd70015cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.796+0000 7fd7060ca640 1 -- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd700152a00 msgr2=0x7fd70015cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.796+0000 7fd7060ca640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd700152a00 0x7fd70015cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.796+0000 7fd7060ca640 1 -- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd70015ac50 msgr2=0x7fd700158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:36.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.796+0000 7fd7060ca640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd70015ac50 0x7fd700158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:36.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.796+0000 7fd7060ca640 1 -- 172.21.15.38:0/150768685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd700157830 con 0x7fd6ec005bb0 2023-12-22T08:44:36.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.796+0000 7fd7058c9640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd70015ac50 0x7fd700158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:36.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.796+0000 7fd7060ca640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6ec005bb0 0x7fd70015bb40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc008fd0 tx=0x7fd6fc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:36.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.796+0000 7fd6f2ffd640 1 -- 172.21.15.38:0/150768685 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc0076c0 con 0x7fd6ec005bb0 2023-12-22T08:44:36.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.796+0000 7fd6f2ffd640 1 -- 172.21.15.38:0/150768685 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc007a30 con 0x7fd6ec005bb0 2023-12-22T08:44:36.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.796+0000 7fd6f2ffd640 1 -- 172.21.15.38:0/150768685 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc006be0 con 0x7fd6ec005bb0 2023-12-22T08:44:36.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.796+0000 7fd7070cc640 1 -- 172.21.15.38:0/150768685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd700157b10 con 0x7fd6ec005bb0 2023-12-22T08:44:36.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.797+0000 7fd7070cc640 1 -- 172.21.15.38:0/150768685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd700158850 con 0x7fd6ec005bb0 2023-12-22T08:44:36.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.798+0000 7fd7070cc640 1 -- 172.21.15.38:0/150768685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd700061910 con 0x7fd6ec005bb0 2023-12-22T08:44:36.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.799+0000 7fd6f2ffd640 1 -- 172.21.15.38:0/150768685 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6fc006d40 con 0x7fd6ec005bb0 2023-12-22T08:44:36.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.800+0000 7fd6f2ffd640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6e406a460 0x7fd6e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:36.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.800+0000 7fd6f2ffd640 1 -- 172.21.15.38:0/150768685 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd6fc0aaa50 con 0x7fd6ec005bb0 2023-12-22T08:44:36.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.800+0000 7fd6f2ffd640 1 -- 172.21.15.38:0/150768685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7fd6e4072050 con 0x7fd6ec005bb0 2023-12-22T08:44:36.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.800+0000 7fd7058c9640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6e406a460 0x7fd6e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:36.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.801+0000 7fd7058c9640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6e406a460 0x7fd6e406c920 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4006ce0 tx=0x7fd6f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:36.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:36.804+0000 7fd6f2ffd640 1 -- 172.21.15.38:0/150768685 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd6fc04b070 con 0x7fd6ec005bb0 2023-12-22T08:44:37.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.003+0000 7fd7070cc640 1 -- 172.21.15.38:0/150768685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd70015aa30 con 0x7fd6ec005bb0 2023-12-22T08:44:37.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.005+0000 7fd6f2ffd640 1 -- 172.21.15.38:0/150768685 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16196 (secure 0 0 0) 0x7fd6fc079ba0 con 0x7fd6ec005bb0 2023-12-22T08:44:37.007 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:37.007 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":76,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:43:50.280215+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:43:07.088485+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-22T08:43:07.718532+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","full","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.19","mappings":[{"from":6,"to":1}]},{"pgid":"9.3f","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:44:37.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.008+0000 7fd7070cc640 1 -- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6e406a460 msgr2=0x7fd6e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.008+0000 7fd7070cc640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6e406a460 0x7fd6e406c920 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4006ce0 tx=0x7fd6f4008040 comp rx=0 tx=0).stop 2023-12-22T08:44:37.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.008+0000 7fd7070cc640 1 -- 172.21.15.38:0/150768685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6ec005bb0 msgr2=0x7fd70015bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.008+0000 7fd7070cc640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6ec005bb0 0x7fd70015bb40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc008fd0 tx=0x7fd6fc001120 comp rx=0 tx=0).stop 2023-12-22T08:44:37.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.008+0000 7fd7070cc640 1 -- 172.21.15.38:0/150768685 shutdown_connections 2023-12-22T08:44:37.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.008+0000 7fd7070cc640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd700152a00 0x7fd70015cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.008+0000 7fd7070cc640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd70015ac50 0x7fd700158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.008+0000 7fd7070cc640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6e406a460 0x7fd6e406c920 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.008+0000 7fd7070cc640 1 --2- 172.21.15.38:0/150768685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6ec005bb0 0x7fd70015bb40 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.008+0000 7fd7070cc640 1 -- 172.21.15.38:0/150768685 >> 172.21.15.38:0/150768685 conn(0x7fd7000b1f70 msgr2=0x7fd7000a0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:37.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.009+0000 7fd7070cc640 1 -- 172.21.15.38:0/150768685 shutdown_connections 2023-12-22T08:44:37.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.009+0000 7fd7070cc640 1 -- 172.21.15.38:0/150768685 wait complete. 2023-12-22T08:44:37.030 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:43:07.088485+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:43:07.718532+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:44:37.030 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:44:37.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.249+0000 7f4cebb0a640 1 Processor -- start 2023-12-22T08:44:37.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.249+0000 7f4cebb0a640 1 -- start start 2023-12-22T08:44:37.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.250+0000 7f4cebb0a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4ce4160c50 0x7f4ce40b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.251+0000 7f4cebb0a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4ce406f960 0x7f4ce40ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.251+0000 7f4cebb0a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce40ceb70 con 0x7f4ce40ce020 2023-12-22T08:44:37.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.251+0000 7f4cebb0a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce40cee50 con 0x7f4ce4160c50 2023-12-22T08:44:37.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.251+0000 7f4cebb0a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce40ad140 con 0x7f4ce406f960 2023-12-22T08:44:37.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.251+0000 7f4ce98a6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4ce4160c50 0x7f4ce40b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:37.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.251+0000 7f4ce98a6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4ce4160c50 0x7f4ce40b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47260/0 (socket says 172.21.15.38:47260) 2023-12-22T08:44:37.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.251+0000 7f4ce90a5640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4ce40ce020 0x7f4ce406f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34234/0 (socket says 172.21.15.38:34234) 2023-12-22T08:44:37.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.251+0000 7f4ce98a6640 1 -- 172.21.15.38:0/1327677308 learned_addr learned my addr 172.21.15.38:0/1327677308 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:37.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.251+0000 7f4cea0a7640 1 --2- 172.21.15.38:0/1327677308 >> v2:172.21.15.89:3300/0 conn(0x7f4ce406f960 0x7f4ce40ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:37.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.251+0000 7f4ce98a6640 1 -- 172.21.15.38:0/1327677308 >> v2:172.21.15.89:3300/0 conn(0x7f4ce406f960 msgr2=0x7f4ce40ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:37.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.251+0000 7f4ce98a6640 1 --2- 172.21.15.38:0/1327677308 >> v2:172.21.15.89:3300/0 conn(0x7f4ce406f960 0x7f4ce40ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.252+0000 7f4ce98a6640 1 -- 172.21.15.38:0/1327677308 >> v1:172.21.15.38:6789/0 conn(0x7f4ce40ce020 legacy=0x7f4ce406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.252+0000 7f4ce98a6640 1 -- 172.21.15.38:0/1327677308 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce40aca80 con 0x7f4ce4160c50 2023-12-22T08:44:37.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.252+0000 7f4ce88a4640 1 -- 172.21.15.38:0/1327677308 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035499966 0 0) 0x7f4ce40ceb70 con 0x7f4ce40ce020 2023-12-22T08:44:37.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.253+0000 7f4ce98a6640 1 --2- 172.21.15.38:0/1327677308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce4160c50 0x7f4ce40b3600 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4ce406a7f0 tx=0x7f4ce002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9608f219f27baef5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:37.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.253+0000 7f4ce88a4640 1 -- 172.21.15.38:0/1327677308 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce002ca80 con 0x7f4ce4160c50 2023-12-22T08:44:37.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.253+0000 7f4ce88a4640 1 -- 172.21.15.38:0/1327677308 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce002cbe0 con 0x7f4ce4160c50 2023-12-22T08:44:37.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.253+0000 7f4ce88a4640 1 -- 172.21.15.38:0/1327677308 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00343f0 con 0x7f4ce4160c50 2023-12-22T08:44:37.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.253+0000 7f4cebb0a640 1 -- 172.21.15.38:0/1327677308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce4160c50 msgr2=0x7f4ce40b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.253+0000 7f4cebb0a640 1 --2- 172.21.15.38:0/1327677308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce4160c50 0x7f4ce40b3600 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4ce406a7f0 tx=0x7f4ce002bee0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.254+0000 7f4cebb0a640 1 -- 172.21.15.38:0/1327677308 shutdown_connections 2023-12-22T08:44:37.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.254+0000 7f4cebb0a640 1 --2- 172.21.15.38:0/1327677308 >> v2:172.21.15.89:3300/0 conn(0x7f4ce406f960 0x7f4ce40ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.254+0000 7f4cebb0a640 1 --2- 172.21.15.38:0/1327677308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce4160c50 0x7f4ce40b3600 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.254+0000 7f4cebb0a640 1 -- 172.21.15.38:0/1327677308 >> 172.21.15.38:0/1327677308 conn(0x7f4ce40b20c0 msgr2=0x7f4ce40b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:37.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.254+0000 7f4cebb0a640 1 -- 172.21.15.38:0/1327677308 shutdown_connections 2023-12-22T08:44:37.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.254+0000 7f4cebb0a640 1 -- 172.21.15.38:0/1327677308 wait complete. 2023-12-22T08:44:37.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.256+0000 7f4cebb0a640 1 Processor -- start 2023-12-22T08:44:37.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.256+0000 7f4cebb0a640 1 -- start start 2023-12-22T08:44:37.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.257+0000 7f4cebb0a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ce406f960 0x7f4ce4158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.257+0000 7f4cebb0a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce40ce020 0x7f4ce4147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.257+0000 7f4cebb0a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ce4160c50 0x7f4ce415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.257+0000 7f4cebb0a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce4159e20 con 0x7f4ce40ce020 2023-12-22T08:44:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.257+0000 7f4cebb0a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce4148000 con 0x7f4ce406f960 2023-12-22T08:44:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.257+0000 7f4cebb0a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce415a050 con 0x7f4ce4160c50 2023-12-22T08:44:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.257+0000 7f4ce90a5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce40ce020 0x7f4ce4147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.257+0000 7f4ce90a5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce40ce020 0x7f4ce4147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47270/0 (socket says 172.21.15.38:47270) 2023-12-22T08:44:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.257+0000 7f4ce90a5640 1 -- 172.21.15.38:0/653581832 learned_addr learned my addr 172.21.15.38:0/653581832 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:37.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.257+0000 7f4ce98a6640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ce406f960 0x7f4ce4158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.257+0000 7f4ce90a5640 1 -- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ce4160c50 msgr2=0x7f4ce415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.257+0000 7f4cea0a7640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ce4160c50 0x7f4ce415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.258+0000 7f4ce90a5640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ce4160c50 0x7f4ce415d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.258+0000 7f4ce90a5640 1 -- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ce406f960 msgr2=0x7f4ce4158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.258+0000 7f4ce90a5640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ce406f960 0x7f4ce4158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.258+0000 7f4ce90a5640 1 -- 172.21.15.38:0/653581832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce0009b30 con 0x7f4ce40ce020 2023-12-22T08:44:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.258+0000 7f4ce98a6640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ce406f960 0x7f4ce4158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.258+0000 7f4ce90a5640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce40ce020 0x7f4ce4147ac0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400c470 tx=0x7f4cd400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.258+0000 7f4cda7fc640 1 -- 172.21.15.38:0/653581832 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4007480 con 0x7f4ce40ce020 2023-12-22T08:44:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.258+0000 7f4cda7fc640 1 -- 172.21.15.38:0/653581832 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd4007600 con 0x7f4ce40ce020 2023-12-22T08:44:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.258+0000 7f4cebb0a640 1 -- 172.21.15.38:0/653581832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce415a330 con 0x7f4ce40ce020 2023-12-22T08:44:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.258+0000 7f4cda7fc640 1 -- 172.21.15.38:0/653581832 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4004a20 con 0x7f4ce40ce020 2023-12-22T08:44:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.258+0000 7f4cebb0a640 1 -- 172.21.15.38:0/653581832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce415a8f0 con 0x7f4ce40ce020 2023-12-22T08:44:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.259+0000 7f4cebb0a640 1 -- 172.21.15.38:0/653581832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce4061910 con 0x7f4ce40ce020 2023-12-22T08:44:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.260+0000 7f4cda7fc640 1 -- 172.21.15.38:0/653581832 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4cd4004b80 con 0x7f4ce40ce020 2023-12-22T08:44:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.261+0000 7f4cda7fc640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4cc806a430 0x7f4cc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.261+0000 7f4cda7fc640 1 -- 172.21.15.38:0/653581832 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4cd4087bf0 con 0x7f4ce40ce020 2023-12-22T08:44:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.262+0000 7f4cda7fc640 1 -- 172.21.15.38:0/653581832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f4cc8072020 con 0x7f4ce40ce020 2023-12-22T08:44:37.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.262+0000 7f4ce98a6640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4cc806a430 0x7f4cc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:37.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.263+0000 7f4ce98a6640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4cc806a430 0x7f4cc806c8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0035000 tx=0x7f4ce0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:37.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.266+0000 7f4cda7fc640 1 -- 172.21.15.38:0/653581832 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4cd4018020 con 0x7f4ce40ce020 2023-12-22T08:44:37.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.456+0000 7f4cebb0a640 1 -- 172.21.15.38:0/653581832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ce40cd260 con 0x7f4ce40ce020 2023-12-22T08:44:37.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.457+0000 7f4cda7fc640 1 -- 172.21.15.38:0/653581832 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4cd4053100 con 0x7f4ce40ce020 2023-12-22T08:44:37.459 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:44:37.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.459+0000 7f4cebb0a640 1 -- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4cc806a430 msgr2=0x7f4cc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.459+0000 7f4cebb0a640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4cc806a430 0x7f4cc806c8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0035000 tx=0x7f4ce0030000 comp rx=0 tx=0).stop 2023-12-22T08:44:37.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.459+0000 7f4cebb0a640 1 -- 172.21.15.38:0/653581832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce40ce020 msgr2=0x7f4ce4147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.459+0000 7f4cebb0a640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce40ce020 0x7f4ce4147ac0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400c470 tx=0x7f4cd400c930 comp rx=0 tx=0).stop 2023-12-22T08:44:37.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.460+0000 7f4cebb0a640 1 -- 172.21.15.38:0/653581832 shutdown_connections 2023-12-22T08:44:37.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.460+0000 7f4cebb0a640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ce4160c50 0x7f4ce415d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.460+0000 7f4cebb0a640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4cc806a430 0x7f4cc806c8f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.460+0000 7f4cebb0a640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce40ce020 0x7f4ce4147ac0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.460+0000 7f4cebb0a640 1 --2- 172.21.15.38:0/653581832 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ce406f960 0x7f4ce4158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.460+0000 7f4cebb0a640 1 -- 172.21.15.38:0/653581832 >> 172.21.15.38:0/653581832 conn(0x7f4ce40b20c0 msgr2=0x7f4ce40cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:37.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.460+0000 7f4cebb0a640 1 -- 172.21.15.38:0/653581832 shutdown_connections 2023-12-22T08:44:37.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.460+0000 7f4cebb0a640 1 -- 172.21.15.38:0/653581832 wait complete. 2023-12-22T08:44:37.478 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:44:37.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.694+0000 7fd304238640 1 Processor -- start 2023-12-22T08:44:37.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.695+0000 7fd304238640 1 -- start start 2023-12-22T08:44:37.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.697+0000 7fd304238640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2fc161e10 0x7fd2fc08b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.697+0000 7fd304238640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd2fc08b750 0x7fd2fc08d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.697+0000 7fd304238640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2fc06e5e0 con 0x7fd2fc161a30 2023-12-22T08:44:37.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.697+0000 7fd304238640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc08bbe0 con 0x7fd2fc08b750 2023-12-22T08:44:37.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.697+0000 7fd304238640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0712b0 con 0x7fd2fc161e10 2023-12-22T08:44:37.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.697+0000 7fd301fd4640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd2fc161a30 0x7fd2fc06ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34240/0 (socket says 172.21.15.38:34240) 2023-12-22T08:44:37.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.697+0000 7fd301fd4640 1 -- 172.21.15.38:0/3869400332 learned_addr learned my addr 172.21.15.38:0/3869400332 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.697+0000 7fd3017d3640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2fc161e10 0x7fd2fc08b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.697+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473280750 0 0) 0x7fd2ec001490 con 0x7fd2fc161a30 2023-12-22T08:44:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.697+0000 7fd3027d5640 1 --2- 172.21.15.38:0/3869400332 >> v2:172.21.15.89:3300/0 conn(0x7fd2fc08b750 0x7fd2fc08d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.697+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2e4003520 con 0x7fd2fc161a30 2023-12-22T08:44:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1791185300 0 0) 0x7fd2e4003520 con 0x7fd2fc161a30 2023-12-22T08:44:37.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2fc161e10 msgr2=0x7fd2fc08b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2fc161e10 0x7fd2fc08b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 >> v2:172.21.15.89:3300/0 conn(0x7fd2fc08b750 msgr2=0x7fd2fc08d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 --2- 172.21.15.38:0/3869400332 >> v2:172.21.15.89:3300/0 conn(0x7fd2fc08b750 0x7fd2fc08d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc071590 con 0x7fd2fc161a30 2023-12-22T08:44:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fd2ec001b80 con 0x7fd2fc161a30 2023-12-22T08:44:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd3027d5640 1 --2- 172.21.15.38:0/3869400332 >> v2:172.21.15.89:3300/0 conn(0x7fd2fc08b750 0x7fd2fc08d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:44:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd3017d3640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2fc161e10 0x7fd2fc08b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:44:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 >> v1:172.21.15.38:6789/0 conn(0x7fd2fc161a30 legacy=0x7fd2fc06ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2fc161e10 0x7fd2e4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2e4003fb0 0x7fd2e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e4004d00 0x7fd2e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc08bbe0 con 0x7fd2e4004d00 2023-12-22T08:44:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0712b0 con 0x7fd2e4003fb0 2023-12-22T08:44:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e400bb40 con 0x7fd2fc161e10 2023-12-22T08:44:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.698+0000 7fd3027d5640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e4004d00 0x7fd2e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.699+0000 7fd301fd4640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2fc161e10 0x7fd2e4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.699+0000 7fd3017d3640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2e4003fb0 0x7fd2e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.699+0000 7fd3027d5640 1 -- 172.21.15.38:0/3869400332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2fc161e10 msgr2=0x7fd2e4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.699+0000 7fd3027d5640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2fc161e10 0x7fd2e4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.699+0000 7fd3027d5640 1 -- 172.21.15.38:0/3869400332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2e4003fb0 msgr2=0x7fd2e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.699+0000 7fd3027d5640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2e4003fb0 0x7fd2e40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.699+0000 7fd3027d5640 1 -- 172.21.15.38:0/3869400332 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4003520 con 0x7fd2e4004d00 2023-12-22T08:44:37.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.699+0000 7fd3017d3640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2e4003fb0 0x7fd2e40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:37.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.700+0000 7fd3027d5640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e4004d00 0x7fd2e4005180 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40098a0 tx=0x7fd2e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6472f23bdb626a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:37.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.700+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4004230 con 0x7fd2e4004d00 2023-12-22T08:44:37.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.700+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f4004390 con 0x7fd2e4004d00 2023-12-22T08:44:37.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.700+0000 7fd300fd2640 1 -- 172.21.15.38:0/3869400332 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4003830 con 0x7fd2e4004d00 2023-12-22T08:44:37.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.701+0000 7fd304238640 1 -- 172.21.15.38:0/3869400332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e4004d00 msgr2=0x7fd2e4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.701+0000 7fd304238640 1 --2- 172.21.15.38:0/3869400332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e4004d00 0x7fd2e4005180 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40098a0 tx=0x7fd2e40057f0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.701+0000 7fd3027d5640 1 -- 172.21.15.38:0/3869400332 reap_dead start 2023-12-22T08:44:37.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.701+0000 7fd304238640 1 -- 172.21.15.38:0/3869400332 shutdown_connections 2023-12-22T08:44:37.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.701+0000 7fd304238640 1 -- 172.21.15.38:0/3869400332 >> 172.21.15.38:0/3869400332 conn(0x7fd2fc0cfea0 msgr2=0x7fd2fc0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:37.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.701+0000 7fd304238640 1 -- 172.21.15.38:0/3869400332 shutdown_connections 2023-12-22T08:44:37.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.701+0000 7fd304238640 1 -- 172.21.15.38:0/3869400332 wait complete. 2023-12-22T08:44:37.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.703+0000 7fd304238640 1 Processor -- start 2023-12-22T08:44:37.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.703+0000 7fd304238640 1 -- start start 2023-12-22T08:44:37.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.704+0000 7fd304238640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e4004d00 0x7fd2fc0b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.704+0000 7fd304238640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2fc0b6960 0x7fd2fc0b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.704+0000 7fd304238640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2fc14e5b0 0x7fd2fc14ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.704+0000 7fd304238640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0b7320 con 0x7fd2e4004d00 2023-12-22T08:44:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.704+0000 7fd304238640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc14d2c0 con 0x7fd2fc0b6960 2023-12-22T08:44:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.704+0000 7fd304238640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc14d510 con 0x7fd2fc14e5b0 2023-12-22T08:44:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.704+0000 7fd301fd4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e4004d00 0x7fd2fc0b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.704+0000 7fd301fd4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e4004d00 0x7fd2fc0b4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47288/0 (socket says 172.21.15.38:47288) 2023-12-22T08:44:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.704+0000 7fd301fd4640 1 -- 172.21.15.38:0/2274684491 learned_addr learned my addr 172.21.15.38:0/2274684491 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.705+0000 7fd301fd4640 1 -- 172.21.15.38:0/2274684491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2fc14e5b0 msgr2=0x7fd2fc14ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.705+0000 7fd301fd4640 1 --2- 172.21.15.38:0/2274684491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2fc14e5b0 0x7fd2fc14ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.705+0000 7fd301fd4640 1 -- 172.21.15.38:0/2274684491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2fc0b6960 msgr2=0x7fd2fc0b6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.705+0000 7fd301fd4640 1 --2- 172.21.15.38:0/2274684491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2fc0b6960 0x7fd2fc0b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.705+0000 7fd301fd4640 1 -- 172.21.15.38:0/2274684491 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc14d7f0 con 0x7fd2e4004d00 2023-12-22T08:44:37.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.705+0000 7fd301fd4640 1 --2- 172.21.15.38:0/2274684491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e4004d00 0x7fd2fc0b4020 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec007a00 tx=0x7fd2ec00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:37.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.705+0000 7fd2fa7fc640 1 -- 172.21.15.38:0/2274684491 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec00edd0 con 0x7fd2e4004d00 2023-12-22T08:44:37.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.705+0000 7fd2fa7fc640 1 -- 172.21.15.38:0/2274684491 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec013420 con 0x7fd2e4004d00 2023-12-22T08:44:37.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.705+0000 7fd2fa7fc640 1 -- 172.21.15.38:0/2274684491 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec0137d0 con 0x7fd2e4004d00 2023-12-22T08:44:37.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.705+0000 7fd304238640 1 -- 172.21.15.38:0/2274684491 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc14dad0 con 0x7fd2e4004d00 2023-12-22T08:44:37.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.705+0000 7fd304238640 1 -- 172.21.15.38:0/2274684491 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc14e090 con 0x7fd2e4004d00 2023-12-22T08:44:37.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.706+0000 7fd304238640 1 -- 172.21.15.38:0/2274684491 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc061910 con 0x7fd2e4004d00 2023-12-22T08:44:37.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.707+0000 7fd2fa7fc640 1 -- 172.21.15.38:0/2274684491 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd2ec013930 con 0x7fd2e4004d00 2023-12-22T08:44:37.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.708+0000 7fd2fa7fc640 1 --2- 172.21.15.38:0/2274684491 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd2e806a430 0x7fd2e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:37.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.708+0000 7fd2fa7fc640 1 -- 172.21.15.38:0/2274684491 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd2ec088fc0 con 0x7fd2e4004d00 2023-12-22T08:44:37.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.709+0000 7fd2fa7fc640 1 -- 172.21.15.38:0/2274684491 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7fd2e8072020 con 0x7fd2e4004d00 2023-12-22T08:44:37.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.709+0000 7fd3017d3640 1 --2- 172.21.15.38:0/2274684491 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd2e806a430 0x7fd2e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:37.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.710+0000 7fd3017d3640 1 --2- 172.21.15.38:0/2274684491 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd2e806a430 0x7fd2e806c8f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc15d950 tx=0x7fd2f0006df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:37.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.712+0000 7fd2fa7fc640 1 -- 172.21.15.38:0/2274684491 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd2ec0544d0 con 0x7fd2e4004d00 2023-12-22T08:44:37.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.898+0000 7fd304238640 1 -- 172.21.15.38:0/2274684491 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2fc06e5e0 con 0x7fd2e4004d00 2023-12-22T08:44:37.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.899+0000 7fd2fa7fc640 1 -- 172.21.15.38:0/2274684491 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd2fc06e5e0 con 0x7fd2e4004d00 2023-12-22T08:44:37.901 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:44:37.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.902+0000 7fd304238640 1 -- 172.21.15.38:0/2274684491 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd2e806a430 msgr2=0x7fd2e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.902+0000 7fd304238640 1 --2- 172.21.15.38:0/2274684491 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd2e806a430 0x7fd2e806c8f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc15d950 tx=0x7fd2f0006df0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.902+0000 7fd304238640 1 -- 172.21.15.38:0/2274684491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e4004d00 msgr2=0x7fd2fc0b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:37.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.902+0000 7fd304238640 1 --2- 172.21.15.38:0/2274684491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e4004d00 0x7fd2fc0b4020 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec007a00 tx=0x7fd2ec00e530 comp rx=0 tx=0).stop 2023-12-22T08:44:37.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.902+0000 7fd304238640 1 -- 172.21.15.38:0/2274684491 shutdown_connections 2023-12-22T08:44:37.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.902+0000 7fd304238640 1 --2- 172.21.15.38:0/2274684491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2fc14e5b0 0x7fd2fc14ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.902+0000 7fd304238640 1 --2- 172.21.15.38:0/2274684491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2fc0b6960 0x7fd2fc0b6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.902+0000 7fd304238640 1 --2- 172.21.15.38:0/2274684491 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd2e806a430 0x7fd2e806c8f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.902+0000 7fd304238640 1 --2- 172.21.15.38:0/2274684491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e4004d00 0x7fd2fc0b4020 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:37.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.902+0000 7fd304238640 1 -- 172.21.15.38:0/2274684491 >> 172.21.15.38:0/2274684491 conn(0x7fd2fc0cfea0 msgr2=0x7fd2fc0d2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:37.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.902+0000 7fd304238640 1 -- 172.21.15.38:0/2274684491 shutdown_connections 2023-12-22T08:44:37.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:37.902+0000 7fd304238640 1 -- 172.21.15.38:0/2274684491 wait complete. 2023-12-22T08:44:37.921 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:44:38.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.142+0000 7f6ce08b6640 1 Processor -- start 2023-12-22T08:44:38.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.142+0000 7f6ce08b6640 1 -- start start 2023-12-22T08:44:38.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.143+0000 7f6ce08b6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6cdc15e870 0x7f6cdc0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:38.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.143+0000 7f6ce08b6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6cdc070e80 0x7f6cdc06f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:38.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.143+0000 7f6ce08b6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cdc0ce4b0 con 0x7f6cdc15ec50 2023-12-22T08:44:38.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.143+0000 7f6ce08b6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cdc15fea0 con 0x7f6cdc15e870 2023-12-22T08:44:38.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.143+0000 7f6ce08b6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cdc0cdb80 con 0x7f6cdc070e80 2023-12-22T08:44:38.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.144+0000 7f6cda59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6cdc15e870 0x7f6cdc0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:38.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.144+0000 7f6cda59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6cdc15e870 0x7f6cdc0ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47302/0 (socket says 172.21.15.38:47302) 2023-12-22T08:44:38.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.144+0000 7f6cda59c640 1 -- 172.21.15.38:0/3779035264 learned_addr learned my addr 172.21.15.38:0/3779035264 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:38.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.144+0000 7f6cda59c640 1 -- 172.21.15.38:0/3779035264 >> v2:172.21.15.89:3300/0 conn(0x7f6cdc070e80 msgr2=0x7f6cdc06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:38.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.144+0000 7f6cda59c640 1 --2- 172.21.15.38:0/3779035264 >> v2:172.21.15.89:3300/0 conn(0x7f6cdc070e80 0x7f6cdc06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.144+0000 7f6cda59c640 1 -- 172.21.15.38:0/3779035264 >> v1:172.21.15.89:6789/0 conn(0x7f6cdc15ec50 legacy=0x7f6cdc070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:38.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.144+0000 7f6cda59c640 1 -- 172.21.15.38:0/3779035264 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc0cde60 con 0x7f6cdc15e870 2023-12-22T08:44:38.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.145+0000 7f6cda59c640 1 --2- 172.21.15.38:0/3779035264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6cdc15e870 0x7f6cdc0ce940 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc06c0b0 tx=0x7f6ccc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35dd2c3e3f93801e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:38.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.146+0000 7f6cd959a640 1 -- 172.21.15.38:0/3779035264 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0317e0 con 0x7f6cdc15e870 2023-12-22T08:44:38.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.146+0000 7f6cd959a640 1 -- 172.21.15.38:0/3779035264 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc031940 con 0x7f6cdc15e870 2023-12-22T08:44:38.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.146+0000 7f6cd959a640 1 -- 172.21.15.38:0/3779035264 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc031cd0 con 0x7f6cdc15e870 2023-12-22T08:44:38.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.146+0000 7f6ce08b6640 1 -- 172.21.15.38:0/3779035264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6cdc15e870 msgr2=0x7f6cdc0ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:38.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.146+0000 7f6ce08b6640 1 --2- 172.21.15.38:0/3779035264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6cdc15e870 0x7f6cdc0ce940 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc06c0b0 tx=0x7f6ccc02b880 comp rx=0 tx=0).stop 2023-12-22T08:44:38.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.147+0000 7f6ce08b6640 1 -- 172.21.15.38:0/3779035264 shutdown_connections 2023-12-22T08:44:38.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.147+0000 7f6ce08b6640 1 --2- 172.21.15.38:0/3779035264 >> v2:172.21.15.89:3300/0 conn(0x7f6cdc070e80 0x7f6cdc06f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.147+0000 7f6ce08b6640 1 --2- 172.21.15.38:0/3779035264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6cdc15e870 0x7f6cdc0ce940 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.147+0000 7f6ce08b6640 1 -- 172.21.15.38:0/3779035264 >> 172.21.15.38:0/3779035264 conn(0x7f6cdc0b20c0 msgr2=0x7f6cdc0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:38.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.147+0000 7f6ce08b6640 1 -- 172.21.15.38:0/3779035264 shutdown_connections 2023-12-22T08:44:38.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.147+0000 7f6ce08b6640 1 -- 172.21.15.38:0/3779035264 wait complete. 2023-12-22T08:44:38.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.148+0000 7f6ce08b6640 1 Processor -- start 2023-12-22T08:44:38.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.149+0000 7f6ce08b6640 1 -- start start 2023-12-22T08:44:38.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6ce08b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cdc070e80 0x7f6cdc1531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:38.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6ce08b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cdc15e870 0x7f6cdc15d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:38.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6ce08b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6cdc15ec50 0x7f6cdc1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:38.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6ce08b6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc0ac8e0 con 0x7f6cdc15ec50 2023-12-22T08:44:38.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6ce08b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc15d960 con 0x7f6cdc15e870 2023-12-22T08:44:38.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6ce08b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc0acac0 con 0x7f6cdc070e80 2023-12-22T08:44:38.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6cdad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6cdc15ec50 0x7f6cdc1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:38.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6cdad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6cdc15ec50 0x7f6cdc1547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47314/0 (socket says 172.21.15.38:47314) 2023-12-22T08:44:38.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6cdad9d640 1 -- 172.21.15.38:0/2568969995 learned_addr learned my addr 172.21.15.38:0/2568969995 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:38.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6cda59c640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cdc070e80 0x7f6cdc1531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:38.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6cd9d9b640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cdc15e870 0x7f6cdc15d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:38.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6cdad9d640 1 -- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cdc070e80 msgr2=0x7f6cdc1531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:38.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6cdad9d640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cdc070e80 0x7f6cdc1531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6cdad9d640 1 -- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cdc15e870 msgr2=0x7f6cdc15d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:38.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6cdad9d640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cdc15e870 0x7f6cdc15d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.150+0000 7f6cdad9d640 1 -- 172.21.15.38:0/2568969995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc0094d0 con 0x7f6cdc15ec50 2023-12-22T08:44:38.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.151+0000 7f6cdad9d640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6cdc15ec50 0x7f6cdc1547c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400b9e0 tx=0x7f6cd400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:38.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.151+0000 7f6ccaffd640 1 -- 172.21.15.38:0/2568969995 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400cb20 con 0x7f6cdc15ec50 2023-12-22T08:44:38.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.151+0000 7f6ccaffd640 1 -- 172.21.15.38:0/2568969995 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd400cc80 con 0x7f6cdc15ec50 2023-12-22T08:44:38.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.151+0000 7f6ccaffd640 1 -- 172.21.15.38:0/2568969995 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4014680 con 0x7f6cdc15ec50 2023-12-22T08:44:38.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.151+0000 7f6ce08b6640 1 -- 172.21.15.38:0/2568969995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cdc0acda0 con 0x7f6cdc15ec50 2023-12-22T08:44:38.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.151+0000 7f6ce08b6640 1 -- 172.21.15.38:0/2568969995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cdc15d550 con 0x7f6cdc15ec50 2023-12-22T08:44:38.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.152+0000 7f6ce08b6640 1 -- 172.21.15.38:0/2568969995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cdc0ad2c0 con 0x7f6cdc15ec50 2023-12-22T08:44:38.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.153+0000 7f6ccaffd640 1 -- 172.21.15.38:0/2568969995 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6cd401d3b0 con 0x7f6cdc15ec50 2023-12-22T08:44:38.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.154+0000 7f6ccaffd640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6cbc06a430 0x7f6cbc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:38.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.155+0000 7f6ccaffd640 1 -- 172.21.15.38:0/2568969995 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6cd40888d0 con 0x7f6cdc15ec50 2023-12-22T08:44:38.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.155+0000 7f6ccaffd640 1 -- 172.21.15.38:0/2568969995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f6cbc072020 con 0x7f6cdc15ec50 2023-12-22T08:44:38.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.155+0000 7f6cda59c640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6cbc06a430 0x7f6cbc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:38.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.156+0000 7f6cda59c640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6cbc06a430 0x7f6cbc06c8f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc036000 tx=0x7f6ccc03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:38.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.158+0000 7f6ccaffd640 1 -- 172.21.15.38:0/2568969995 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6cd4019020 con 0x7f6cdc15ec50 2023-12-22T08:44:38.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.356+0000 7f6ce08b6640 1 -- 172.21.15.38:0/2568969995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6cdc061910 con 0x7f6cdc15ec50 2023-12-22T08:44:38.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.357+0000 7f6ccaffd640 1 -- 172.21.15.38:0/2568969995 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6cdc0ad2c0 con 0x7f6cdc15ec50 2023-12-22T08:44:38.359 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:44:38.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.359+0000 7f6ce08b6640 1 -- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6cbc06a430 msgr2=0x7f6cbc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:38.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.359+0000 7f6ce08b6640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6cbc06a430 0x7f6cbc06c8f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc036000 tx=0x7f6ccc03d040 comp rx=0 tx=0).stop 2023-12-22T08:44:38.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.359+0000 7f6ce08b6640 1 -- 172.21.15.38:0/2568969995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6cdc15ec50 msgr2=0x7f6cdc1547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:38.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.359+0000 7f6ce08b6640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6cdc15ec50 0x7f6cdc1547c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400b9e0 tx=0x7f6cd400bea0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.359+0000 7f6ce08b6640 1 -- 172.21.15.38:0/2568969995 shutdown_connections 2023-12-22T08:44:38.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.360+0000 7f6ce08b6640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6cbc06a430 0x7f6cbc06c8f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.360+0000 7f6ce08b6640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6cdc15ec50 0x7f6cdc1547c0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.360+0000 7f6ce08b6640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cdc15e870 0x7f6cdc15d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.360+0000 7f6ce08b6640 1 --2- 172.21.15.38:0/2568969995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cdc070e80 0x7f6cdc1531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.360+0000 7f6ce08b6640 1 -- 172.21.15.38:0/2568969995 >> 172.21.15.38:0/2568969995 conn(0x7f6cdc0b20c0 msgr2=0x7f6cdc0b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:38.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.360+0000 7f6ce08b6640 1 -- 172.21.15.38:0/2568969995 shutdown_connections 2023-12-22T08:44:38.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.360+0000 7f6ce08b6640 1 -- 172.21.15.38:0/2568969995 wait complete. 2023-12-22T08:44:38.381 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:44:38.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.588+0000 7f2b2207d640 1 Processor -- start 2023-12-22T08:44:38.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.588+0000 7f2b2207d640 1 -- start start 2023-12-22T08:44:38.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.590+0000 7f2b2207d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c1547a0 0x7f2b1c15b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:38.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.590+0000 7f2b2207d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2b1c071b90 0x7f2b1c070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:38.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.590+0000 7f2b2207d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1c0716a0 con 0x7f2b1c154b80 2023-12-22T08:44:38.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.590+0000 7f2b2207d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1c0710e0 con 0x7f2b1c071b90 2023-12-22T08:44:38.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.590+0000 7f2b2207d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0713c0 con 0x7f2b1c1547a0 2023-12-22T08:44:38.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.591+0000 7f2b1affd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2b1c071b90 0x7f2b1c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:38.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.591+0000 7f2b1affd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2b1c071b90 0x7f2b1c070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47328/0 (socket says 172.21.15.38:47328) 2023-12-22T08:44:38.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.591+0000 7f2b1affd640 1 -- 172.21.15.38:0/1747277929 learned_addr learned my addr 172.21.15.38:0/1747277929 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:38.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.591+0000 7f2b1b7fe640 1 --2- 172.21.15.38:0/1747277929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c1547a0 0x7f2b1c15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:38.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.591+0000 7f2b1affd640 1 -- 172.21.15.38:0/1747277929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c1547a0 msgr2=0x7f2b1c15b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:38.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.591+0000 7f2b1affd640 1 --2- 172.21.15.38:0/1747277929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c1547a0 0x7f2b1c15b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.591+0000 7f2b1affd640 1 -- 172.21.15.38:0/1747277929 >> v1:172.21.15.89:6789/0 conn(0x7f2b1c154b80 legacy=0x7f2b1c0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:38.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.591+0000 7f2b1affd640 1 -- 172.21.15.38:0/1747277929 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c15ab00 con 0x7f2b1c071b90 2023-12-22T08:44:38.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.593+0000 7f2b1affd640 1 --2- 172.21.15.38:0/1747277929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c071b90 0x7f2b1c070770 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000bb10 tx=0x7f2b1002e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2de9e223f6eeb8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:38.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.593+0000 7f2b1a7fc640 1 -- 172.21.15.38:0/1747277929 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10036440 con 0x7f2b1c071b90 2023-12-22T08:44:38.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.593+0000 7f2b1a7fc640 1 -- 172.21.15.38:0/1747277929 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b100365a0 con 0x7f2b1c071b90 2023-12-22T08:44:38.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.593+0000 7f2b1a7fc640 1 -- 172.21.15.38:0/1747277929 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10036930 con 0x7f2b1c071b90 2023-12-22T08:44:38.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.594+0000 7f2b2207d640 1 -- 172.21.15.38:0/1747277929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c071b90 msgr2=0x7f2b1c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:38.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.594+0000 7f2b2207d640 1 --2- 172.21.15.38:0/1747277929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c071b90 0x7f2b1c070770 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000bb10 tx=0x7f2b1002e150 comp rx=0 tx=0).stop 2023-12-22T08:44:38.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.594+0000 7f2b2207d640 1 -- 172.21.15.38:0/1747277929 shutdown_connections 2023-12-22T08:44:38.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.594+0000 7f2b2207d640 1 --2- 172.21.15.38:0/1747277929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c071b90 0x7f2b1c070770 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.594+0000 7f2b2207d640 1 --2- 172.21.15.38:0/1747277929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c1547a0 0x7f2b1c15b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.594+0000 7f2b2207d640 1 -- 172.21.15.38:0/1747277929 >> 172.21.15.38:0/1747277929 conn(0x7f2b1c0cf070 msgr2=0x7f2b1c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:38.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.594+0000 7f2b2207d640 1 -- 172.21.15.38:0/1747277929 shutdown_connections 2023-12-22T08:44:38.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.594+0000 7f2b2207d640 1 -- 172.21.15.38:0/1747277929 wait complete. 2023-12-22T08:44:38.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.597+0000 7f2b2207d640 1 Processor -- start 2023-12-22T08:44:38.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.597+0000 7f2b2207d640 1 -- start start 2023-12-22T08:44:38.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.598+0000 7f2b2207d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c071b90 0x7f2b1c1e7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:38.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.598+0000 7f2b2207d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c1547a0 0x7f2b1c14e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:38.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.598+0000 7f2b2207d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1c154b80 0x7f2b1c1e7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:38.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.598+0000 7f2b2207d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c1e6ea0 con 0x7f2b1c1547a0 2023-12-22T08:44:38.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.598+0000 7f2b2207d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c1e6290 con 0x7f2b1c154b80 2023-12-22T08:44:38.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.598+0000 7f2b2207d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c1e6570 con 0x7f2b1c071b90 2023-12-22T08:44:38.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.598+0000 7f2b1affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c1547a0 0x7f2b1c14e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:38.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.598+0000 7f2b1affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c1547a0 0x7f2b1c14e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47332/0 (socket says 172.21.15.38:47332) 2023-12-22T08:44:38.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.598+0000 7f2b1affd640 1 -- 172.21.15.38:0/2517356694 learned_addr learned my addr 172.21.15.38:0/2517356694 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:38.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.599+0000 7f2b1b7fe640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c071b90 0x7f2b1c1e7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:38.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.599+0000 7f2b1bfff640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1c154b80 0x7f2b1c1e7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:38.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.599+0000 7f2b1affd640 1 -- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c071b90 msgr2=0x7f2b1c1e7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:38.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.599+0000 7f2b1affd640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c071b90 0x7f2b1c1e7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.599+0000 7f2b1affd640 1 -- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1c154b80 msgr2=0x7f2b1c1e7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:38.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.599+0000 7f2b1affd640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1c154b80 0x7f2b1c1e7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.599+0000 7f2b1affd640 1 -- 172.21.15.38:0/2517356694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1000b770 con 0x7f2b1c1547a0 2023-12-22T08:44:38.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.599+0000 7f2b1bfff640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1c154b80 0x7f2b1c1e7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:38.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.599+0000 7f2b1affd640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c1547a0 0x7f2b1c14e510 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2b1002e190 tx=0x7f2b100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:38.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.599+0000 7f2b03fff640 1 -- 172.21.15.38:0/2517356694 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10036440 con 0x7f2b1c1547a0 2023-12-22T08:44:38.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.600+0000 7f2b03fff640 1 -- 172.21.15.38:0/2517356694 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b10034ba0 con 0x7f2b1c1547a0 2023-12-22T08:44:38.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.600+0000 7f2b03fff640 1 -- 172.21.15.38:0/2517356694 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10041460 con 0x7f2b1c1547a0 2023-12-22T08:44:38.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.600+0000 7f2b2207d640 1 -- 172.21.15.38:0/2517356694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1c1e6850 con 0x7f2b1c1547a0 2023-12-22T08:44:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.600+0000 7f2b2207d640 1 -- 172.21.15.38:0/2517356694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c1e8030 con 0x7f2b1c1547a0 2023-12-22T08:44:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.601+0000 7f2b2207d640 1 -- 172.21.15.38:0/2517356694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1c1e7010 con 0x7f2b1c1547a0 2023-12-22T08:44:38.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.602+0000 7f2b03fff640 1 -- 172.21.15.38:0/2517356694 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2b10049360 con 0x7f2b1c1547a0 2023-12-22T08:44:38.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.603+0000 7f2b03fff640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2b0806a460 0x7f2b0806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:38.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.603+0000 7f2b03fff640 1 -- 172.21.15.38:0/2517356694 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2b100aaec0 con 0x7f2b1c1547a0 2023-12-22T08:44:38.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.603+0000 7f2b03fff640 1 -- 172.21.15.38:0/2517356694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f2b08072050 con 0x7f2b1c1547a0 2023-12-22T08:44:38.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.604+0000 7f2b1b7fe640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2b0806a460 0x7f2b0806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:38.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.605+0000 7f2b1b7fe640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2b0806a460 0x7f2b0806c920 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009f30 tx=0x7f2b0c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:38.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.607+0000 7f2b03fff640 1 -- 172.21.15.38:0/2517356694 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2b1003b020 con 0x7f2b1c1547a0 2023-12-22T08:44:38.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.839+0000 7f2b2207d640 1 -- 172.21.15.38:0/2517356694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b1c061910 con 0x7f2b1c1547a0 2023-12-22T08:44:38.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.840+0000 7f2b03fff640 1 -- 172.21.15.38:0/2517356694 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4645 (secure 0 0 0) 0x7f2b10046070 con 0x7f2b1c1547a0 2023-12-22T08:44:38.842 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:38.842 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3287488986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3287488986},{"type":"v1","addr":"172.21.15.89:6836","nonce":3287488986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2154639115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2154639115},{"type":"v1","addr":"172.21.15.89:6837","nonce":2154639115}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/807798598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":807798598},{"type":"v1","addr":"172.21.15.38:6833","nonce":807798598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:43:08.736828+0000","modified":"2023-12-22T08:43:12.231629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1778808252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1778808252},{"type":"v1","addr":"172.21.15.38:6835","nonce":1778808252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-22T08:44:38.843 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 32 2023-12-22T08:44:38.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.843+0000 7f2b2207d640 1 -- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2b0806a460 msgr2=0x7f2b0806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:38.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.843+0000 7f2b2207d640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2b0806a460 0x7f2b0806c920 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009f30 tx=0x7f2b0c00b040 comp rx=0 tx=0).stop 2023-12-22T08:44:38.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.843+0000 7f2b2207d640 1 -- 172.21.15.38:0/2517356694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c1547a0 msgr2=0x7f2b1c14e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:38.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.843+0000 7f2b2207d640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c1547a0 0x7f2b1c14e510 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2b1002e190 tx=0x7f2b100046c0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.843+0000 7f2b2207d640 1 -- 172.21.15.38:0/2517356694 shutdown_connections 2023-12-22T08:44:38.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.843+0000 7f2b2207d640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1c154b80 0x7f2b1c1e7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.843+0000 7f2b2207d640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2b0806a460 0x7f2b0806c920 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.843+0000 7f2b2207d640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b1c1547a0 0x7f2b1c14e510 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.843+0000 7f2b2207d640 1 --2- 172.21.15.38:0/2517356694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c071b90 0x7f2b1c1e7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:38.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.843+0000 7f2b2207d640 1 -- 172.21.15.38:0/2517356694 >> 172.21.15.38:0/2517356694 conn(0x7f2b1c0cf070 msgr2=0x7f2b1c153d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:38.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.843+0000 7f2b2207d640 1 -- 172.21.15.38:0/2517356694 shutdown_connections 2023-12-22T08:44:38.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:38.843+0000 7f2b2207d640 1 -- 172.21.15.38:0/2517356694 wait complete. 2023-12-22T08:44:38.864 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:44:39.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.084+0000 7f812962d640 1 Processor -- start 2023-12-22T08:44:39.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.084+0000 7f812962d640 1 -- start start 2023-12-22T08:44:39.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.085+0000 7f812962d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812406d210 0x7f812415e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:39.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.085+0000 7f812962d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f812406d5f0 0x7f8124070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:39.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.085+0000 7f812962d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81240706d0 con 0x7f81240cb4c0 2023-12-22T08:44:39.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.085+0000 7f812962d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81240cbf40 con 0x7f812406d5f0 2023-12-22T08:44:39.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.085+0000 7f812962d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81240ce840 con 0x7f812406d210 2023-12-22T08:44:39.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.086+0000 7f8128e2c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f812406d5f0 0x7f8124070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:39.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.086+0000 7f8128e2c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f812406d5f0 0x7f8124070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47340/0 (socket says 172.21.15.38:47340) 2023-12-22T08:44:39.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.086+0000 7f8128e2c640 1 -- 172.21.15.38:0/3050471516 learned_addr learned my addr 172.21.15.38:0/3050471516 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:39.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.086+0000 7f81237fe640 1 --1- 172.21.15.38:0/3050471516 >> v1:172.21.15.38:6789/0 conn(0x7f81240cb4c0 0x7f8124159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34242/0 (socket says 172.21.15.38:34242) 2023-12-22T08:44:39.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.086+0000 7f8123fff640 1 --2- 172.21.15.38:0/3050471516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812406d210 0x7f812415e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:39.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.086+0000 7f8128e2c640 1 -- 172.21.15.38:0/3050471516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812406d210 msgr2=0x7f812415e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:39.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.086+0000 7f8128e2c640 1 --2- 172.21.15.38:0/3050471516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812406d210 0x7f812415e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.086+0000 7f8128e2c640 1 -- 172.21.15.38:0/3050471516 >> v1:172.21.15.38:6789/0 conn(0x7f81240cb4c0 legacy=0x7f8124159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:39.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.086+0000 7f8128e2c640 1 -- 172.21.15.38:0/3050471516 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81240ceb20 con 0x7f812406d5f0 2023-12-22T08:44:39.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.088+0000 7f8128e2c640 1 --2- 172.21.15.38:0/3050471516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f812406d5f0 0x7f8124070b60 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f811c009e50 tx=0x7f811c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6163906019e5c4b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:39.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.088+0000 7f8122ffd640 1 -- 172.21.15.38:0/3050471516 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c02cb00 con 0x7f812406d5f0 2023-12-22T08:44:39.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.088+0000 7f8122ffd640 1 -- 172.21.15.38:0/3050471516 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c02cc60 con 0x7f812406d5f0 2023-12-22T08:44:39.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.088+0000 7f8122ffd640 1 -- 172.21.15.38:0/3050471516 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0343f0 con 0x7f812406d5f0 2023-12-22T08:44:39.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.088+0000 7f812962d640 1 -- 172.21.15.38:0/3050471516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f812406d5f0 msgr2=0x7f8124070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:39.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.088+0000 7f812962d640 1 --2- 172.21.15.38:0/3050471516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f812406d5f0 0x7f8124070b60 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f811c009e50 tx=0x7f811c02bf60 comp rx=0 tx=0).stop 2023-12-22T08:44:39.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.088+0000 7f812962d640 1 -- 172.21.15.38:0/3050471516 shutdown_connections 2023-12-22T08:44:39.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.089+0000 7f812962d640 1 --2- 172.21.15.38:0/3050471516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f812406d5f0 0x7f8124070b60 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.089+0000 7f812962d640 1 --2- 172.21.15.38:0/3050471516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812406d210 0x7f812415e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.089+0000 7f812962d640 1 -- 172.21.15.38:0/3050471516 >> 172.21.15.38:0/3050471516 conn(0x7f81240b1f70 msgr2=0x7f81240b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:39.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.089+0000 7f812962d640 1 -- 172.21.15.38:0/3050471516 shutdown_connections 2023-12-22T08:44:39.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.089+0000 7f812962d640 1 -- 172.21.15.38:0/3050471516 wait complete. 2023-12-22T08:44:39.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.090+0000 7f812962d640 1 Processor -- start 2023-12-22T08:44:39.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.090+0000 7f812962d640 1 -- start start 2023-12-22T08:44:39.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.091+0000 7f812962d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812406d210 0x7f81240a3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:39.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.091+0000 7f812962d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f812406d5f0 0x7f812415d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:39.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.091+0000 7f812962d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81240cb4c0 0x7f812414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:39.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.091+0000 7f812962d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812415ba80 con 0x7f812406d5f0 2023-12-22T08:44:39.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.091+0000 7f812962d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812415a7e0 con 0x7f81240cb4c0 2023-12-22T08:44:39.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.091+0000 7f812962d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812415b170 con 0x7f812406d210 2023-12-22T08:44:39.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.092+0000 7f81237fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f812406d5f0 0x7f812415d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:39.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.092+0000 7f81237fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f812406d5f0 0x7f812415d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47352/0 (socket says 172.21.15.38:47352) 2023-12-22T08:44:39.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.092+0000 7f81237fe640 1 -- 172.21.15.38:0/296134205 learned_addr learned my addr 172.21.15.38:0/296134205 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:39.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.092+0000 7f8123fff640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812406d210 0x7f81240a3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:39.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.092+0000 7f8128e2c640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81240cb4c0 0x7f812414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:39.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.092+0000 7f81237fe640 1 -- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812406d210 msgr2=0x7f81240a3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:39.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.092+0000 7f81237fe640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812406d210 0x7f81240a3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.092+0000 7f81237fe640 1 -- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81240cb4c0 msgr2=0x7f812414f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:39.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.092+0000 7f81237fe640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81240cb4c0 0x7f812414f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.092+0000 7f81237fe640 1 -- 172.21.15.38:0/296134205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c009b30 con 0x7f812406d5f0 2023-12-22T08:44:39.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.093+0000 7f81237fe640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f812406d5f0 0x7f812415d1d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f811800c3e0 tx=0x7f811800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:39.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.093+0000 7f8120ff9640 1 -- 172.21.15.38:0/296134205 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81180074e0 con 0x7f812406d5f0 2023-12-22T08:44:39.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.093+0000 7f8120ff9640 1 -- 172.21.15.38:0/296134205 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8118007640 con 0x7f812406d5f0 2023-12-22T08:44:39.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.093+0000 7f812962d640 1 -- 172.21.15.38:0/296134205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812415aa30 con 0x7f812406d5f0 2023-12-22T08:44:39.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.093+0000 7f8120ff9640 1 -- 172.21.15.38:0/296134205 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81180049e0 con 0x7f812406d5f0 2023-12-22T08:44:39.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.093+0000 7f812962d640 1 -- 172.21.15.38:0/296134205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812415b3c0 con 0x7f812406d5f0 2023-12-22T08:44:39.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.094+0000 7f812962d640 1 -- 172.21.15.38:0/296134205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812415b8e0 con 0x7f812406d5f0 2023-12-22T08:44:39.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.095+0000 7f8120ff9640 1 -- 172.21.15.38:0/296134205 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8118004b40 con 0x7f812406d5f0 2023-12-22T08:44:39.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.096+0000 7f8120ff9640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f811006a430 0x7f811006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:39.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.097+0000 7f8120ff9640 1 -- 172.21.15.38:0/296134205 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8118088370 con 0x7f812406d5f0 2023-12-22T08:44:39.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.097+0000 7f8120ff9640 1 -- 172.21.15.38:0/296134205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f8110072020 con 0x7f812406d5f0 2023-12-22T08:44:39.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.097+0000 7f8123fff640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f811006a430 0x7f811006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:39.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.098+0000 7f8123fff640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f811006a430 0x7f811006c8f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8114006fd0 tx=0x7f8114008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:39.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.101+0000 7f8120ff9640 1 -- 172.21.15.38:0/296134205 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f812415b8e0 con 0x7f812406d5f0 2023-12-22T08:44:39.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.304+0000 7f812962d640 1 -- 172.21.15.38:0/296134205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f812415b8e0 con 0x7f812406d5f0 2023-12-22T08:44:39.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.307+0000 7f8120ff9640 1 -- 172.21.15.38:0/296134205 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16196 (secure 0 0 0) 0x7f812415b8e0 con 0x7f812406d5f0 2023-12-22T08:44:39.309 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:39.309 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":76,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:43:50.280215+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:43:07.088485+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-22T08:43:07.718532+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","full","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.19","mappings":[{"from":6,"to":1}]},{"pgid":"9.3f","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:44:39.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.310+0000 7f812962d640 1 -- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f811006a430 msgr2=0x7f811006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:39.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.310+0000 7f812962d640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f811006a430 0x7f811006c8f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8114006fd0 tx=0x7f8114008040 comp rx=0 tx=0).stop 2023-12-22T08:44:39.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.310+0000 7f812962d640 1 -- 172.21.15.38:0/296134205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f812406d5f0 msgr2=0x7f812415d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:39.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.310+0000 7f812962d640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f812406d5f0 0x7f812415d1d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f811800c3e0 tx=0x7f811800c8a0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.310+0000 7f812962d640 1 -- 172.21.15.38:0/296134205 shutdown_connections 2023-12-22T08:44:39.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.310+0000 7f812962d640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81240cb4c0 0x7f812414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.310+0000 7f812962d640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f811006a430 0x7f811006c8f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.310+0000 7f812962d640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f812406d5f0 0x7f812415d1d0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.310+0000 7f812962d640 1 --2- 172.21.15.38:0/296134205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812406d210 0x7f81240a3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.310+0000 7f812962d640 1 -- 172.21.15.38:0/296134205 >> 172.21.15.38:0/296134205 conn(0x7f81240b1f70 msgr2=0x7f81240cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:39.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.310+0000 7f812962d640 1 -- 172.21.15.38:0/296134205 shutdown_connections 2023-12-22T08:44:39.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.310+0000 7f812962d640 1 -- 172.21.15.38:0/296134205 wait complete. 2023-12-22T08:44:39.333 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:44:39.333 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:44:39.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.559+0000 7fb0b1fce640 1 Processor -- start 2023-12-22T08:44:39.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.559+0000 7fb0b1fce640 1 -- start start 2023-12-22T08:44:39.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.561+0000 7fb0b1fce640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb0ac144d10 0x7fb0ac0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:39.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.561+0000 7fb0b1fce640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ac0b2760 0x7fb0ac070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:39.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.561+0000 7fb0b1fce640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ac1450f0 con 0x7fb0ac0cc670 2023-12-22T08:44:39.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.561+0000 7fb0b1fce640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ac0ce010 con 0x7fb0ac144d10 2023-12-22T08:44:39.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.561+0000 7fb0b1fce640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0ce2f0 con 0x7fb0ac0b2760 2023-12-22T08:44:39.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.561+0000 7fb0aaffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb0ac0cc670 0x7fb0ac0b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34256/0 (socket says 172.21.15.38:34256) 2023-12-22T08:44:39.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.561+0000 7fb0aaffd640 1 -- 172.21.15.38:0/1246163193 learned_addr learned my addr 172.21.15.38:0/1246163193 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:39.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.561+0000 7fb0ab7fe640 1 --2- 172.21.15.38:0/1246163193 >> v2:172.21.15.38:3300/0 conn(0x7fb0ac144d10 0x7fb0ac0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:39.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.562+0000 7fb0abfff640 1 --2- 172.21.15.38:0/1246163193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ac0b2760 0x7fb0ac070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:39.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.562+0000 7fb0aa7fc640 1 -- 172.21.15.38:0/1246163193 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635449245 0 0) 0x7fb0ac1450f0 con 0x7fb0ac0cc670 2023-12-22T08:44:39.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.562+0000 7fb0aa7fc640 1 -- 172.21.15.38:0/1246163193 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb094003520 con 0x7fb0ac0cc670 2023-12-22T08:44:39.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.562+0000 7fb0ab7fe640 1 -- 172.21.15.38:0/1246163193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ac0b2760 msgr2=0x7fb0ac070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:39.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.562+0000 7fb0ab7fe640 1 --2- 172.21.15.38:0/1246163193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ac0b2760 0x7fb0ac070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.562+0000 7fb0ab7fe640 1 -- 172.21.15.38:0/1246163193 >> v1:172.21.15.38:6789/0 conn(0x7fb0ac0cc670 legacy=0x7fb0ac0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:39.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.562+0000 7fb0ab7fe640 1 -- 172.21.15.38:0/1246163193 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac0ce5d0 con 0x7fb0ac144d10 2023-12-22T08:44:39.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.562+0000 7fb0abfff640 1 --2- 172.21.15.38:0/1246163193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ac0b2760 0x7fb0ac070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:44:39.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.563+0000 7fb0ab7fe640 1 --2- 172.21.15.38:0/1246163193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0ac144d10 0x7fb0ac0cc130 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0097a0 tx=0x7fb09c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f4ce832c731b19 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:39.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.564+0000 7fb0aa7fc640 1 -- 172.21.15.38:0/1246163193 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c02d040 con 0x7fb0ac144d10 2023-12-22T08:44:39.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.564+0000 7fb0aa7fc640 1 -- 172.21.15.38:0/1246163193 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c031810 con 0x7fb0ac144d10 2023-12-22T08:44:39.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.564+0000 7fb0aa7fc640 1 -- 172.21.15.38:0/1246163193 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c031ba0 con 0x7fb0ac144d10 2023-12-22T08:44:39.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.564+0000 7fb0b1fce640 1 -- 172.21.15.38:0/1246163193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0ac144d10 msgr2=0x7fb0ac0cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:39.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.564+0000 7fb0b1fce640 1 --2- 172.21.15.38:0/1246163193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0ac144d10 0x7fb0ac0cc130 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0097a0 tx=0x7fb09c02b8b0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.564+0000 7fb0b1fce640 1 -- 172.21.15.38:0/1246163193 shutdown_connections 2023-12-22T08:44:39.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.564+0000 7fb0b1fce640 1 --2- 172.21.15.38:0/1246163193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ac0b2760 0x7fb0ac070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.564+0000 7fb0b1fce640 1 --2- 172.21.15.38:0/1246163193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0ac144d10 0x7fb0ac0cc130 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.564+0000 7fb0b1fce640 1 -- 172.21.15.38:0/1246163193 >> 172.21.15.38:0/1246163193 conn(0x7fb0ac0cf070 msgr2=0x7fb0ac0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:39.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.565+0000 7fb0b1fce640 1 -- 172.21.15.38:0/1246163193 shutdown_connections 2023-12-22T08:44:39.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.565+0000 7fb0b1fce640 1 -- 172.21.15.38:0/1246163193 wait complete. 2023-12-22T08:44:39.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.566+0000 7fb0b1fce640 1 Processor -- start 2023-12-22T08:44:39.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.567+0000 7fb0b1fce640 1 -- start start 2023-12-22T08:44:39.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.567+0000 7fb0b1fce640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ac0b2760 0x7fb0ac13eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:39.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0b1fce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0ac144d10 0x7fb0ac13cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:39.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0b1fce640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0ac15a490 0x7fb0ac15a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:39.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0b1fce640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac15ae60 con 0x7fb0ac15a490 2023-12-22T08:44:39.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0b1fce640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac06d0f0 con 0x7fb0ac144d10 2023-12-22T08:44:39.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0b1fce640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac13d040 con 0x7fb0ac0b2760 2023-12-22T08:44:39.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0abfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0ac15a490 0x7fb0ac15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:39.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0abfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0ac15a490 0x7fb0ac15a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47382/0 (socket says 172.21.15.38:47382) 2023-12-22T08:44:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0abfff640 1 -- 172.21.15.38:0/378665295 learned_addr learned my addr 172.21.15.38:0/378665295 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0ab7fe640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ac0b2760 0x7fb0ac13eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0aaffd640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0ac144d10 0x7fb0ac13cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0abfff640 1 -- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ac0b2760 msgr2=0x7fb0ac13eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0abfff640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ac0b2760 0x7fb0ac13eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0abfff640 1 -- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0ac144d10 msgr2=0x7fb0ac13cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0abfff640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0ac144d10 0x7fb0ac13cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0abfff640 1 -- 172.21.15.38:0/378665295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c009400 con 0x7fb0ac15a490 2023-12-22T08:44:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.568+0000 7fb0aaffd640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0ac144d10 0x7fb0ac13cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:39.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.569+0000 7fb0abfff640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0ac15a490 0x7fb0ac15a920 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4007f20 tx=0x7fb0a400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:39.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.569+0000 7fb093fff640 1 -- 172.21.15.38:0/378665295 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a400dee0 con 0x7fb0ac15a490 2023-12-22T08:44:39.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.569+0000 7fb093fff640 1 -- 172.21.15.38:0/378665295 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a400f040 con 0x7fb0ac15a490 2023-12-22T08:44:39.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.569+0000 7fb093fff640 1 -- 172.21.15.38:0/378665295 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4003dd0 con 0x7fb0ac15a490 2023-12-22T08:44:39.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.569+0000 7fb0b1fce640 1 -- 172.21.15.38:0/378665295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ac06ce10 con 0x7fb0ac15a490 2023-12-22T08:44:39.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.569+0000 7fb0b1fce640 1 -- 172.21.15.38:0/378665295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ac13e6d0 con 0x7fb0ac15a490 2023-12-22T08:44:39.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.570+0000 7fb0b1fce640 1 -- 172.21.15.38:0/378665295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ac15fba0 con 0x7fb0ac15a490 2023-12-22T08:44:39.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.572+0000 7fb093fff640 1 -- 172.21.15.38:0/378665295 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb0a4004030 con 0x7fb0ac15a490 2023-12-22T08:44:39.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.572+0000 7fb093fff640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb09806a430 0x7fb09806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:39.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.573+0000 7fb093fff640 1 -- 172.21.15.38:0/378665295 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb0a4088cd0 con 0x7fb0ac15a490 2023-12-22T08:44:39.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.573+0000 7fb093fff640 1 -- 172.21.15.38:0/378665295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7fb098072020 con 0x7fb0ac15a490 2023-12-22T08:44:39.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.573+0000 7fb0ab7fe640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb09806a430 0x7fb09806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:39.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.574+0000 7fb0ab7fe640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb09806a430 0x7fb09806c8f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb09c036000 tx=0x7fb09c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:39.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.577+0000 7fb093fff640 1 -- 172.21.15.38:0/378665295 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb0a401a060 con 0x7fb0ac15a490 2023-12-22T08:44:39.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.815+0000 7fb0b1fce640 1 -- 172.21.15.38:0/378665295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0ac061910 con 0x7fb0ac15a490 2023-12-22T08:44:39.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.816+0000 7fb093fff640 1 -- 172.21.15.38:0/378665295 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4645 (secure 0 0 0) 0x7fb0ac15fba0 con 0x7fb0ac15a490 2023-12-22T08:44:39.818 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:39.818 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3287488986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3287488986},{"type":"v1","addr":"172.21.15.89:6836","nonce":3287488986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2154639115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2154639115},{"type":"v1","addr":"172.21.15.89:6837","nonce":2154639115}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/807798598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":807798598},{"type":"v1","addr":"172.21.15.38:6833","nonce":807798598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:43:08.736828+0000","modified":"2023-12-22T08:43:12.231629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1778808252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1778808252},{"type":"v1","addr":"172.21.15.38:6835","nonce":1778808252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-22T08:44:39.818 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 32 2023-12-22T08:44:39.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.818+0000 7fb0b1fce640 1 -- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb09806a430 msgr2=0x7fb09806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:39.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.818+0000 7fb0b1fce640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb09806a430 0x7fb09806c8f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb09c036000 tx=0x7fb09c03c040 comp rx=0 tx=0).stop 2023-12-22T08:44:39.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.819+0000 7fb0b1fce640 1 -- 172.21.15.38:0/378665295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0ac15a490 msgr2=0x7fb0ac15a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:39.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.819+0000 7fb0b1fce640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0ac15a490 0x7fb0ac15a920 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4007f20 tx=0x7fb0a400d560 comp rx=0 tx=0).stop 2023-12-22T08:44:39.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.819+0000 7fb0b1fce640 1 -- 172.21.15.38:0/378665295 shutdown_connections 2023-12-22T08:44:39.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.819+0000 7fb0b1fce640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb09806a430 0x7fb09806c8f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.819+0000 7fb0b1fce640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0ac15a490 0x7fb0ac15a920 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.819+0000 7fb0b1fce640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0ac144d10 0x7fb0ac13cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.819+0000 7fb0b1fce640 1 --2- 172.21.15.38:0/378665295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ac0b2760 0x7fb0ac13eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:39.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.819+0000 7fb0b1fce640 1 -- 172.21.15.38:0/378665295 >> 172.21.15.38:0/378665295 conn(0x7fb0ac0cf070 msgr2=0x7fb0ac0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:39.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.819+0000 7fb0b1fce640 1 -- 172.21.15.38:0/378665295 shutdown_connections 2023-12-22T08:44:39.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:39.819+0000 7fb0b1fce640 1 -- 172.21.15.38:0/378665295 wait complete. 2023-12-22T08:44:39.841 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:44:40.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.061+0000 7fd78c8c3640 1 Processor -- start 2023-12-22T08:44:40.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.061+0000 7fd78c8c3640 1 -- start start 2023-12-22T08:44:40.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.063+0000 7fd78c8c3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd788157980 0x7fd78815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.063+0000 7fd78c8c3640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7880d1520 con 0x7fd7880b3ff0 2023-12-22T08:44:40.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.063+0000 7fd78c8c3640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7880d1800 con 0x7fd78806d640 2023-12-22T08:44:40.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.063+0000 7fd78c8c3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7880d1ae0 con 0x7fd788157980 2023-12-22T08:44:40.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.063+0000 7fd77ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd7880b3ff0 0x7fd78806cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34268/0 (socket says 172.21.15.38:34268) 2023-12-22T08:44:40.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.063+0000 7fd77ffff640 1 -- 172.21.15.38:0/2780856898 learned_addr learned my addr 172.21.15.38:0/2780856898 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:40.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.064+0000 7fd786d9d640 1 --2- 172.21.15.38:0/2780856898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd788157980 0x7fd78815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:40.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.064+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034202676 0 0) 0x7fd7880d1520 con 0x7fd7880b3ff0 2023-12-22T08:44:40.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.064+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd774003520 con 0x7fd7880b3ff0 2023-12-22T08:44:40.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.064+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2413727583 0 0) 0x7fd774003520 con 0x7fd7880b3ff0 2023-12-22T08:44:40.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.064+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd788157980 msgr2=0x7fd78815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:40.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.064+0000 7fd78659c640 1 --2- 172.21.15.38:0/2780856898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd788157980 0x7fd78815eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.064+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 >> v1:172.21.15.89:6789/0 conn(0x7fd78806d640 legacy=0x7fd7880d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:40.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.064+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7880d1dc0 con 0x7fd7880b3ff0 2023-12-22T08:44:40.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.064+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fd770001670 con 0x7fd7880b3ff0 2023-12-22T08:44:40.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.064+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 >> v1:172.21.15.38:6789/0 conn(0x7fd7880b3ff0 legacy=0x7fd78806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:40.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.064+0000 7fd78659c640 1 --2- 172.21.15.38:0/2780856898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd788157980 0x7fd7740039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.064+0000 7fd78659c640 1 --2- 172.21.15.38:0/2780856898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd774003f20 0x7fd7740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.065+0000 7fd78659c640 1 --2- 172.21.15.38:0/2780856898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd774004d00 0x7fd774005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.065+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7880d1ae0 con 0x7fd774004d00 2023-12-22T08:44:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.065+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77400ba60 con 0x7fd774003f20 2023-12-22T08:44:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.065+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77400bc20 con 0x7fd788157980 2023-12-22T08:44:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.065+0000 7fd78759e640 1 --2- 172.21.15.38:0/2780856898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd774004d00 0x7fd774005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.065+0000 7fd786d9d640 1 --2- 172.21.15.38:0/2780856898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd788157980 0x7fd7740039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.065+0000 7fd77ffff640 1 --2- 172.21.15.38:0/2780856898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd774003f20 0x7fd7740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.065+0000 7fd78759e640 1 -- 172.21.15.38:0/2780856898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd788157980 msgr2=0x7fd7740039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.065+0000 7fd78759e640 1 --2- 172.21.15.38:0/2780856898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd788157980 0x7fd7740039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.065+0000 7fd78759e640 1 -- 172.21.15.38:0/2780856898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd774003f20 msgr2=0x7fd7740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.065+0000 7fd78759e640 1 --2- 172.21.15.38:0/2780856898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd774003f20 0x7fd7740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.065+0000 7fd78759e640 1 -- 172.21.15.38:0/2780856898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd774003520 con 0x7fd774004d00 2023-12-22T08:44:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.067+0000 7fd78759e640 1 --2- 172.21.15.38:0/2780856898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd774004d00 0x7fd774005180 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd78806e610 tx=0x7fd7740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d7208e07db7bce server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.067+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780003b70 con 0x7fd774004d00 2023-12-22T08:44:40.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.067+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd780003cd0 con 0x7fd774004d00 2023-12-22T08:44:40.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.067+0000 7fd78659c640 1 -- 172.21.15.38:0/2780856898 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd780005310 con 0x7fd774004d00 2023-12-22T08:44:40.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.067+0000 7fd78c8c3640 1 -- 172.21.15.38:0/2780856898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd774004d00 msgr2=0x7fd774005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:40.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.067+0000 7fd78c8c3640 1 --2- 172.21.15.38:0/2780856898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd774004d00 0x7fd774005180 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd78806e610 tx=0x7fd7740057f0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.067+0000 7fd78759e640 1 -- 172.21.15.38:0/2780856898 reap_dead start 2023-12-22T08:44:40.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.068+0000 7fd78c8c3640 1 -- 172.21.15.38:0/2780856898 shutdown_connections 2023-12-22T08:44:40.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.068+0000 7fd78c8c3640 1 -- 172.21.15.38:0/2780856898 >> 172.21.15.38:0/2780856898 conn(0x7fd7880d31f0 msgr2=0x7fd7880d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:40.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.068+0000 7fd78c8c3640 1 -- 172.21.15.38:0/2780856898 shutdown_connections 2023-12-22T08:44:40.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.068+0000 7fd78c8c3640 1 -- 172.21.15.38:0/2780856898 wait complete. 2023-12-22T08:44:40.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.070+0000 7fd78c8c3640 1 Processor -- start 2023-12-22T08:44:40.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.070+0000 7fd78c8c3640 1 -- start start 2023-12-22T08:44:40.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.071+0000 7fd78c8c3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd774004d00 0x7fd788156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.071+0000 7fd78c8c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788158f30 0x7fd78815a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.071+0000 7fd78c8c3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd78815aa60 0x7fd7881f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.071+0000 7fd78c8c3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd788156560 con 0x7fd788158f30 2023-12-22T08:44:40.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.071+0000 7fd78c8c3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78815dcd0 con 0x7fd774004d00 2023-12-22T08:44:40.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.071+0000 7fd78c8c3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78815a090 con 0x7fd78815aa60 2023-12-22T08:44:40.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.071+0000 7fd77ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788158f30 0x7fd78815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:40.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.071+0000 7fd77ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788158f30 0x7fd78815a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47398/0 (socket says 172.21.15.38:47398) 2023-12-22T08:44:40.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.071+0000 7fd77ffff640 1 -- 172.21.15.38:0/3941743678 learned_addr learned my addr 172.21.15.38:0/3941743678 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:40.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.071+0000 7fd78759e640 1 --2- 172.21.15.38:0/3941743678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd78815aa60 0x7fd7881f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:40.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.071+0000 7fd77ffff640 1 -- 172.21.15.38:0/3941743678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd78815aa60 msgr2=0x7fd7881f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:40.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.071+0000 7fd77ffff640 1 --2- 172.21.15.38:0/3941743678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd78815aa60 0x7fd7881f6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.072+0000 7fd77ffff640 1 -- 172.21.15.38:0/3941743678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd774004d00 msgr2=0x7fd788156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:40.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.072+0000 7fd77ffff640 1 --2- 172.21.15.38:0/3941743678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd774004d00 0x7fd788156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.072+0000 7fd77ffff640 1 -- 172.21.15.38:0/3941743678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd788159480 con 0x7fd788158f30 2023-12-22T08:44:40.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.072+0000 7fd77ffff640 1 --2- 172.21.15.38:0/3941743678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788158f30 0x7fd78815a520 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd77000e7f0 tx=0x7fd77000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:40.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.072+0000 7fd77f7fe640 1 -- 172.21.15.38:0/3941743678 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000c8d0 con 0x7fd788158f30 2023-12-22T08:44:40.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.072+0000 7fd77f7fe640 1 -- 172.21.15.38:0/3941743678 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77000ca30 con 0x7fd788158f30 2023-12-22T08:44:40.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.072+0000 7fd77f7fe640 1 -- 172.21.15.38:0/3941743678 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000cdc0 con 0x7fd788158f30 2023-12-22T08:44:40.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.072+0000 7fd78c8c3640 1 -- 172.21.15.38:0/3941743678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd788159760 con 0x7fd788158f30 2023-12-22T08:44:40.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.072+0000 7fd78c8c3640 1 -- 172.21.15.38:0/3941743678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd788159d20 con 0x7fd788158f30 2023-12-22T08:44:40.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.074+0000 7fd78c8c3640 1 -- 172.21.15.38:0/3941743678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd788159ee0 con 0x7fd788158f30 2023-12-22T08:44:40.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.074+0000 7fd77f7fe640 1 -- 172.21.15.38:0/3941743678 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd77001d460 con 0x7fd788158f30 2023-12-22T08:44:40.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.076+0000 7fd77f7fe640 1 --2- 172.21.15.38:0/3941743678 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd76806a430 0x7fd76806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.076+0000 7fd77f7fe640 1 -- 172.21.15.38:0/3941743678 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd770088a80 con 0x7fd788158f30 2023-12-22T08:44:40.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.076+0000 7fd77f7fe640 1 -- 172.21.15.38:0/3941743678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7fd768072020 con 0x7fd788158f30 2023-12-22T08:44:40.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.077+0000 7fd786d9d640 1 --2- 172.21.15.38:0/3941743678 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd76806a430 0x7fd76806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:40.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.078+0000 7fd786d9d640 1 --2- 172.21.15.38:0/3941743678 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd76806a430 0x7fd76806c8f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd788151710 tx=0x7fd778008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:40.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.081+0000 7fd77f7fe640 1 -- 172.21.15.38:0/3941743678 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd770053f90 con 0x7fd788158f30 2023-12-22T08:44:40.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.263+0000 7fd77f7fe640 1 -- 172.21.15.38:0/3941743678 <== mon.0 v2:172.21.15.38:3300/0 7 ==== osd_map(77..77 src has 1..77) v4 ==== 1492+0+0 (secure 0 0 0) 0x7fd770058350 con 0x7fd788158f30 2023-12-22T08:44:40.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.263+0000 7fd77f7fe640 1 -- 172.21.15.38:0/3941743678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7fd7680730c0 con 0x7fd788158f30 2023-12-22T08:44:40.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.318+0000 7fd78c8c3640 1 -- 172.21.15.38:0/3941743678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd788061910 con 0x7fd788158f30 2023-12-22T08:44:40.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.319+0000 7fd77f7fe640 1 -- 172.21.15.38:0/3941743678 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4645 (secure 0 0 0) 0x7fd7700575b0 con 0x7fd788158f30 2023-12-22T08:44:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:40.322 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3287488986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3287488986},{"type":"v1","addr":"172.21.15.89:6836","nonce":3287488986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2154639115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2154639115},{"type":"v1","addr":"172.21.15.89:6837","nonce":2154639115}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/807798598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":807798598},{"type":"v1","addr":"172.21.15.38:6833","nonce":807798598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:43:08.736828+0000","modified":"2023-12-22T08:43:12.231629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6012":{"gid":6012,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1778808252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1778808252},{"type":"v1","addr":"172.21.15.38:6835","nonce":1778808252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-22T08:44:40.322 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 32 2023-12-22T08:44:40.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.322+0000 7fd78c8c3640 1 -- 172.21.15.38:0/3941743678 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd76806a430 msgr2=0x7fd76806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:40.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.322+0000 7fd78c8c3640 1 --2- 172.21.15.38:0/3941743678 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd76806a430 0x7fd76806c8f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd788151710 tx=0x7fd778008040 comp rx=0 tx=0).stop 2023-12-22T08:44:40.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.322+0000 7fd78c8c3640 1 -- 172.21.15.38:0/3941743678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788158f30 msgr2=0x7fd78815a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:40.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.322+0000 7fd78c8c3640 1 --2- 172.21.15.38:0/3941743678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788158f30 0x7fd78815a520 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd77000e7f0 tx=0x7fd77000ecb0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.323+0000 7fd78c8c3640 1 -- 172.21.15.38:0/3941743678 shutdown_connections 2023-12-22T08:44:40.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.323+0000 7fd78c8c3640 1 --2- 172.21.15.38:0/3941743678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd78815aa60 0x7fd7881f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.323+0000 7fd78c8c3640 1 --2- 172.21.15.38:0/3941743678 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd76806a430 0x7fd76806c8f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.323+0000 7fd78c8c3640 1 --2- 172.21.15.38:0/3941743678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd788158f30 0x7fd78815a520 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.323+0000 7fd78c8c3640 1 --2- 172.21.15.38:0/3941743678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd774004d00 0x7fd788156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.323+0000 7fd78c8c3640 1 -- 172.21.15.38:0/3941743678 >> 172.21.15.38:0/3941743678 conn(0x7fd7880d31f0 msgr2=0x7fd78815b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:40.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.323+0000 7fd78c8c3640 1 -- 172.21.15.38:0/3941743678 shutdown_connections 2023-12-22T08:44:40.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.323+0000 7fd78c8c3640 1 -- 172.21.15.38:0/3941743678 wait complete. 2023-12-22T08:44:40.342 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:44:40.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.551+0000 7f86e1755640 1 Processor -- start 2023-12-22T08:44:40.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.551+0000 7f86e1755640 1 -- start start 2023-12-22T08:44:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.553+0000 7f86e1755640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f86dc0b2050 0x7f86dc0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.553+0000 7f86e1755640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86dc070800 0x7f86dc070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.553+0000 7f86e1755640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86dc1450f0 con 0x7f86dc144d10 2023-12-22T08:44:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.553+0000 7f86e1755640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86dc0cc840 con 0x7f86dc0b2050 2023-12-22T08:44:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.553+0000 7f86e1755640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc0ce010 con 0x7f86dc070800 2023-12-22T08:44:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.554+0000 7f86daffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f86dc144d10 0x7f86dc0cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:59078/0 (socket says 172.21.15.38:59078) 2023-12-22T08:44:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.554+0000 7f86daffd640 1 -- 172.21.15.38:0/3460498434 learned_addr learned my addr 172.21.15.38:0/3460498434 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:40.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.554+0000 7f86db7fe640 1 --2- 172.21.15.38:0/3460498434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86dc070800 0x7f86dc070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:40.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.554+0000 7f86d9ffb640 1 -- 172.21.15.38:0/3460498434 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929750408 0 0) 0x7f86dc1450f0 con 0x7f86dc144d10 2023-12-22T08:44:40.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.554+0000 7f86d9ffb640 1 -- 172.21.15.38:0/3460498434 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c4003520 con 0x7f86dc144d10 2023-12-22T08:44:40.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.555+0000 7f86da7fc640 1 --2- 172.21.15.38:0/3460498434 >> v2:172.21.15.89:3300/0 conn(0x7f86dc0b2050 0x7f86dc0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:40.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.555+0000 7f86db7fe640 1 -- 172.21.15.38:0/3460498434 >> v2:172.21.15.89:3300/0 conn(0x7f86dc0b2050 msgr2=0x7f86dc0b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:40.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.555+0000 7f86db7fe640 1 --2- 172.21.15.38:0/3460498434 >> v2:172.21.15.89:3300/0 conn(0x7f86dc0b2050 0x7f86dc0b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.555+0000 7f86db7fe640 1 -- 172.21.15.38:0/3460498434 >> v1:172.21.15.89:6789/0 conn(0x7f86dc144d10 legacy=0x7f86dc0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:40.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.555+0000 7f86db7fe640 1 -- 172.21.15.38:0/3460498434 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0b29f0 con 0x7f86dc070800 2023-12-22T08:44:40.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.556+0000 7f86db7fe640 1 --2- 172.21.15.38:0/3460498434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86dc070800 0x7f86dc070c30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009d90 tx=0x7f86d402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2b96d43cc86ca4c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:40.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.557+0000 7f86d9ffb640 1 -- 172.21.15.38:0/3460498434 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d402cc50 con 0x7f86dc070800 2023-12-22T08:44:40.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.557+0000 7f86d9ffb640 1 -- 172.21.15.38:0/3460498434 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d402cdb0 con 0x7f86dc070800 2023-12-22T08:44:40.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.557+0000 7f86d9ffb640 1 -- 172.21.15.38:0/3460498434 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4034640 con 0x7f86dc070800 2023-12-22T08:44:40.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.557+0000 7f86e1755640 1 -- 172.21.15.38:0/3460498434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86dc070800 msgr2=0x7f86dc070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:40.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.557+0000 7f86e1755640 1 --2- 172.21.15.38:0/3460498434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86dc070800 0x7f86dc070c30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009d90 tx=0x7f86d402bea0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.558+0000 7f86e1755640 1 -- 172.21.15.38:0/3460498434 shutdown_connections 2023-12-22T08:44:40.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.558+0000 7f86e1755640 1 --2- 172.21.15.38:0/3460498434 >> v2:172.21.15.89:3300/0 conn(0x7f86dc0b2050 0x7f86dc0b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.558+0000 7f86e1755640 1 --2- 172.21.15.38:0/3460498434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86dc070800 0x7f86dc070c30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.558+0000 7f86e1755640 1 -- 172.21.15.38:0/3460498434 >> 172.21.15.38:0/3460498434 conn(0x7f86dc0cf070 msgr2=0x7f86dc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:40.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.558+0000 7f86e1755640 1 -- 172.21.15.38:0/3460498434 shutdown_connections 2023-12-22T08:44:40.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.558+0000 7f86e1755640 1 -- 172.21.15.38:0/3460498434 wait complete. 2023-12-22T08:44:40.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.559+0000 7f86e1755640 1 Processor -- start 2023-12-22T08:44:40.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.560+0000 7f86e1755640 1 -- start start 2023-12-22T08:44:40.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.560+0000 7f86e1755640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86dc070800 0x7f86dc143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.560+0000 7f86e1755640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86dc0b2050 0x7f86dc12ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86e1755640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86dc144d10 0x7f86dc12f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86e1755640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc142f70 con 0x7f86dc070800 2023-12-22T08:44:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86e1755640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc1423a0 con 0x7f86dc144d10 2023-12-22T08:44:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86e1755640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc142640 con 0x7f86dc0b2050 2023-12-22T08:44:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86daffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86dc070800 0x7f86dc143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86daffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86dc070800 0x7f86dc143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47402/0 (socket says 172.21.15.38:47402) 2023-12-22T08:44:40.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86daffd640 1 -- 172.21.15.38:0/1383722491 learned_addr learned my addr 172.21.15.38:0/1383722491 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:40.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86da7fc640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86dc0b2050 0x7f86dc12ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:40.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86db7fe640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86dc144d10 0x7f86dc12f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:40.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86daffd640 1 -- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86dc0b2050 msgr2=0x7f86dc12ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:40.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86daffd640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86dc0b2050 0x7f86dc12ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86daffd640 1 -- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86dc144d10 msgr2=0x7f86dc12f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:40.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86daffd640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86dc144d10 0x7f86dc12f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86daffd640 1 -- 172.21.15.38:0/1383722491 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d4009a70 con 0x7f86dc070800 2023-12-22T08:44:40.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.561+0000 7f86db7fe640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86dc144d10 0x7f86dc12f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:40.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.562+0000 7f86daffd640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86dc070800 0x7f86dc143400 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0010e0 tx=0x7f86cc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:40.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.562+0000 7f86c37fe640 1 -- 172.21.15.38:0/1383722491 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc005ce0 con 0x7f86dc070800 2023-12-22T08:44:40.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.562+0000 7f86c37fe640 1 -- 172.21.15.38:0/1383722491 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc005e60 con 0x7f86dc070800 2023-12-22T08:44:40.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.562+0000 7f86c37fe640 1 -- 172.21.15.38:0/1383722491 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0072f0 con 0x7f86dc070800 2023-12-22T08:44:40.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.562+0000 7f86e1755640 1 -- 172.21.15.38:0/1383722491 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86dc142920 con 0x7f86dc070800 2023-12-22T08:44:40.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.562+0000 7f86e1755640 1 -- 172.21.15.38:0/1383722491 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86dc143940 con 0x7f86dc070800 2023-12-22T08:44:40.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.563+0000 7f86e1755640 1 -- 172.21.15.38:0/1383722491 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86dc061910 con 0x7f86dc070800 2023-12-22T08:44:40.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.564+0000 7f86c37fe640 1 -- 172.21.15.38:0/1383722491 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f86cc007450 con 0x7f86dc070800 2023-12-22T08:44:40.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.565+0000 7f86c37fe640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86c806a430 0x7f86c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:40.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.566+0000 7f86c37fe640 1 -- 172.21.15.38:0/1383722491 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f86cc087ff0 con 0x7f86dc070800 2023-12-22T08:44:40.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.566+0000 7f86da7fc640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86c806a430 0x7f86c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:40.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.567+0000 7f86da7fc640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86c806a430 0x7f86c806c8f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0b0ac0 tx=0x7f86d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:40.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.570+0000 7f86c37fe640 1 -- 172.21.15.38:0/1383722491 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f86cc0bac80 con 0x7f86dc070800 2023-12-22T08:44:40.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.762+0000 7f86e1755640 1 -- 172.21.15.38:0/1383722491 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86dc0cb8e0 con 0x7f86dc070800 2023-12-22T08:44:40.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.765+0000 7f86c37fe640 1 -- 172.21.15.38:0/1383722491 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16145 (secure 0 0 0) 0x7f86cc056fb0 con 0x7f86dc070800 2023-12-22T08:44:40.767 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:40.767 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":77,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:44:40.241945+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:43:07.088485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-22T08:43:07.718532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.19","mappings":[{"from":6,"to":1}]},{"pgid":"9.3f","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:44:40.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.768+0000 7f86e1755640 1 -- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86c806a430 msgr2=0x7f86c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:40.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.768+0000 7f86e1755640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86c806a430 0x7f86c806c8f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0b0ac0 tx=0x7f86d0008040 comp rx=0 tx=0).stop 2023-12-22T08:44:40.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.768+0000 7f86e1755640 1 -- 172.21.15.38:0/1383722491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86dc070800 msgr2=0x7f86dc143400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:40.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.768+0000 7f86e1755640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86dc070800 0x7f86dc143400 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0010e0 tx=0x7f86cc00c890 comp rx=0 tx=0).stop 2023-12-22T08:44:40.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.768+0000 7f86e1755640 1 -- 172.21.15.38:0/1383722491 shutdown_connections 2023-12-22T08:44:40.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.768+0000 7f86e1755640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86dc144d10 0x7f86dc12f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.768+0000 7f86e1755640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86dc0b2050 0x7f86dc12ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.768+0000 7f86e1755640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86c806a430 0x7f86c806c8f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.768+0000 7f86e1755640 1 --2- 172.21.15.38:0/1383722491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86dc070800 0x7f86dc143400 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:40.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.768+0000 7f86e1755640 1 -- 172.21.15.38:0/1383722491 >> 172.21.15.38:0/1383722491 conn(0x7f86dc0cf070 msgr2=0x7f86dc141600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:40.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.769+0000 7f86e1755640 1 -- 172.21.15.38:0/1383722491 shutdown_connections 2023-12-22T08:44:40.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:40.769+0000 7f86e1755640 1 -- 172.21.15.38:0/1383722491 wait complete. 2023-12-22T08:44:40.790 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T08:44:41.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.008+0000 7f964f59e640 1 Processor -- start 2023-12-22T08:44:41.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.008+0000 7f964f59e640 1 -- start start 2023-12-22T08:44:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.009+0000 7f964f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9650161bb0 0x7f965015e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.009+0000 7f964f59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965015e630 con 0x7f965015ad90 2023-12-22T08:44:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.009+0000 7f964f59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96501610d0 con 0x7f96500cb5e0 2023-12-22T08:44:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.009+0000 7f964f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96500ce2c0 con 0x7f9650161bb0 2023-12-22T08:44:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.010+0000 7f964e59c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f965015ad90 0x7f96500caed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60586/0 (socket says 172.21.15.38:60586) 2023-12-22T08:44:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.010+0000 7f964e59c640 1 -- 172.21.15.38:0/2668051995 learned_addr learned my addr 172.21.15.38:0/2668051995 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.010+0000 7f964ed9d640 1 --2- 172.21.15.38:0/2668051995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9650161bb0 0x7f965015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.010+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788010996 0 0) 0x7f965015e630 con 0x7f965015ad90 2023-12-22T08:44:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.010+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9630003520 con 0x7f965015ad90 2023-12-22T08:44:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 55005905 0 0) 0x7f9630003520 con 0x7f965015ad90 2023-12-22T08:44:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9650161bb0 msgr2=0x7f965015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f964dd9b640 1 --2- 172.21.15.38:0/2668051995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9650161bb0 0x7f965015e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 >> v1:172.21.15.89:6789/0 conn(0x7f96500cb5e0 legacy=0x7f965015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96501613b0 con 0x7f965015ad90 2023-12-22T08:44:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f9640001690 con 0x7f965015ad90 2023-12-22T08:44:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 >> v1:172.21.15.38:6789/0 conn(0x7f965015ad90 legacy=0x7f96500caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f964dd9b640 1 --2- 172.21.15.38:0/2668051995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96300039a0 0x7f9630003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f964dd9b640 1 --2- 172.21.15.38:0/2668051995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96300047c0 0x7f9630004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f964dd9b640 1 --2- 172.21.15.38:0/2668051995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9650161bb0 0x7f9630005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963000ba30 con 0x7f96300047c0 2023-12-22T08:44:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963000bba0 con 0x7f96300039a0 2023-12-22T08:44:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963000bd60 con 0x7f9650161bb0 2023-12-22T08:44:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.011+0000 7f9645d9b640 1 --2- 172.21.15.38:0/2668051995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96300047c0 0x7f9630004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.012+0000 7f964ed9d640 1 --2- 172.21.15.38:0/2668051995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9650161bb0 0x7f9630005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.012+0000 7f964e59c640 1 --2- 172.21.15.38:0/2668051995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96300039a0 0x7f9630003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.012+0000 7f9645d9b640 1 -- 172.21.15.38:0/2668051995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9650161bb0 msgr2=0x7f9630005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.012+0000 7f9645d9b640 1 --2- 172.21.15.38:0/2668051995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9650161bb0 0x7f9630005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.012+0000 7f9645d9b640 1 -- 172.21.15.38:0/2668051995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96300039a0 msgr2=0x7f9630003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.012+0000 7f9645d9b640 1 --2- 172.21.15.38:0/2668051995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96300039a0 0x7f9630003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.012+0000 7f9645d9b640 1 -- 172.21.15.38:0/2668051995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9630003520 con 0x7f96300047c0 2023-12-22T08:44:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.013+0000 7f9645d9b640 1 --2- 172.21.15.38:0/2668051995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96300047c0 0x7f9630004c40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f9638001720 tx=0x7f96300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f61b401315b3f30 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.013+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96380052d0 con 0x7f96300047c0 2023-12-22T08:44:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.014+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963802e050 con 0x7f96300047c0 2023-12-22T08:44:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.014+0000 7f964dd9b640 1 -- 172.21.15.38:0/2668051995 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96380035f0 con 0x7f96300047c0 2023-12-22T08:44:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.014+0000 7f964f59e640 1 -- 172.21.15.38:0/2668051995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96300047c0 msgr2=0x7f9630004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.014+0000 7f964f59e640 1 --2- 172.21.15.38:0/2668051995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96300047c0 0x7f9630004c40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f9638001720 tx=0x7f96300057f0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.014+0000 7f964ed9d640 1 -- 172.21.15.38:0/2668051995 reap_dead start 2023-12-22T08:44:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.014+0000 7f964f59e640 1 -- 172.21.15.38:0/2668051995 shutdown_connections 2023-12-22T08:44:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.014+0000 7f964f59e640 1 -- 172.21.15.38:0/2668051995 >> 172.21.15.38:0/2668051995 conn(0x7f96500d31c0 msgr2=0x7f96500d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.014+0000 7f964f59e640 1 -- 172.21.15.38:0/2668051995 shutdown_connections 2023-12-22T08:44:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.014+0000 7f964f59e640 1 -- 172.21.15.38:0/2668051995 wait complete. 2023-12-22T08:44:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.016+0000 7f964f59e640 1 Processor -- start 2023-12-22T08:44:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.016+0000 7f964f59e640 1 -- start start 2023-12-22T08:44:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.017+0000 7f964f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96300047c0 0x7f965014e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.017+0000 7f964f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96501f69f0 0x7f96500cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.017+0000 7f964f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96500c9d00 0x7f965015c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.017+0000 7f964f59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965014e890 con 0x7f96500c9d00 2023-12-22T08:44:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.017+0000 7f964f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96500d05a0 con 0x7f96300047c0 2023-12-22T08:44:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.017+0000 7f964f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96501f5f50 con 0x7f96501f69f0 2023-12-22T08:44:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.018+0000 7f964ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96500c9d00 0x7f965015c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.018+0000 7f964ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96500c9d00 0x7f965015c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48980/0 (socket says 172.21.15.38:48980) 2023-12-22T08:44:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.018+0000 7f964ed9d640 1 -- 172.21.15.38:0/4254157273 learned_addr learned my addr 172.21.15.38:0/4254157273 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.018+0000 7f964e59c640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96300047c0 0x7f965014e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.018+0000 7f9645d9b640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96501f69f0 0x7f96500cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.018+0000 7f964ed9d640 1 -- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96501f69f0 msgr2=0x7f96500cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.018+0000 7f964ed9d640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96501f69f0 0x7f96500cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.018+0000 7f964ed9d640 1 -- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96300047c0 msgr2=0x7f965014e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.018+0000 7f964ed9d640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96300047c0 0x7f965014e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.018+0000 7f964ed9d640 1 -- 172.21.15.38:0/4254157273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96500d02c0 con 0x7f96500c9d00 2023-12-22T08:44:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.019+0000 7f964ed9d640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96500c9d00 0x7f965015c410 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f96500d2ea0 tx=0x7f96480115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.019+0000 7f96477fe640 1 -- 172.21.15.38:0/4254157273 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964800e070 con 0x7f96500c9d00 2023-12-22T08:44:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.019+0000 7f96477fe640 1 -- 172.21.15.38:0/4254157273 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9648011ed0 con 0x7f96500c9d00 2023-12-22T08:44:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.019+0000 7f96477fe640 1 -- 172.21.15.38:0/4254157273 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9648003990 con 0x7f96500c9d00 2023-12-22T08:44:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.019+0000 7f964f59e640 1 -- 172.21.15.38:0/4254157273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96501f61f0 con 0x7f96500c9d00 2023-12-22T08:44:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.019+0000 7f964f59e640 1 -- 172.21.15.38:0/4254157273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96500cffb0 con 0x7f96500c9d00 2023-12-22T08:44:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.020+0000 7f964f59e640 1 -- 172.21.15.38:0/4254157273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9650061910 con 0x7f96500c9d00 2023-12-22T08:44:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.021+0000 7f96477fe640 1 -- 172.21.15.38:0/4254157273 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9648003b10 con 0x7f96500c9d00 2023-12-22T08:44:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.022+0000 7f96477fe640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f963406a430 0x7f963406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.022+0000 7f96477fe640 1 -- 172.21.15.38:0/4254157273 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f96480890c0 con 0x7f96500c9d00 2023-12-22T08:44:41.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.023+0000 7f964e59c640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f963406a430 0x7f963406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.024+0000 7f964e59c640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f963406a430 0x7f963406c8f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9640001eb0 tx=0x7f9640009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:41.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.027+0000 7f96477fe640 1 -- 172.21.15.38:0/4254157273 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9648054710 con 0x7f96500c9d00 2023-12-22T08:44:41.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.261+0000 7f964f59e640 1 -- 172.21.15.38:0/4254157273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f96500c6ad0 con 0x7f96500c9d00 2023-12-22T08:44:41.264 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:44:41.262+0000 7f0a26ee3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T08:44:41.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.288+0000 7f96477fe640 1 -- 172.21.15.38:0/4254157273 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9648057d30 con 0x7f96500c9d00 2023-12-22T08:44:41.290 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T08:44:41.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.291+0000 7f964f59e640 1 -- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f963406a430 msgr2=0x7f963406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:41.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.291+0000 7f964f59e640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f963406a430 0x7f963406c8f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9640001eb0 tx=0x7f9640009040 comp rx=0 tx=0).stop 2023-12-22T08:44:41.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.291+0000 7f964f59e640 1 -- 172.21.15.38:0/4254157273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96500c9d00 msgr2=0x7f965015c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:41.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.291+0000 7f964f59e640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96500c9d00 0x7f965015c410 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f96500d2ea0 tx=0x7f96480115a0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.291+0000 7f964f59e640 1 -- 172.21.15.38:0/4254157273 shutdown_connections 2023-12-22T08:44:41.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.291+0000 7f964f59e640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f963406a430 0x7f963406c8f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.291+0000 7f964f59e640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96500c9d00 0x7f965015c410 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.291+0000 7f964f59e640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96501f69f0 0x7f96500cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.291+0000 7f964f59e640 1 --2- 172.21.15.38:0/4254157273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96300047c0 0x7f965014e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.291+0000 7f964f59e640 1 -- 172.21.15.38:0/4254157273 >> 172.21.15.38:0/4254157273 conn(0x7f96500d31c0 msgr2=0x7f965014efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:41.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.291+0000 7f964f59e640 1 -- 172.21.15.38:0/4254157273 shutdown_connections 2023-12-22T08:44:41.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.291+0000 7f964f59e640 1 -- 172.21.15.38:0/4254157273 wait complete. 2023-12-22T08:44:41.315 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T08:44:41.386 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:44:41.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.512+0000 7fda3a9dc640 1 Processor -- start 2023-12-22T08:44:41.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.513+0000 7fda3a9dc640 1 -- start start 2023-12-22T08:44:41.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.514+0000 7fda3a9dc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fda34143050 0x7fda3406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.514+0000 7fda3a9dc640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda340c9550 con 0x7fda340b1e90 2023-12-22T08:44:41.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.514+0000 7fda3a9dc640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda340c9830 con 0x7fda34143740 2023-12-22T08:44:41.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.514+0000 7fda3a9dc640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda340c9b10 con 0x7fda34143050 2023-12-22T08:44:41.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.514+0000 7fda38f79640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fda340b1e90 0x7fda340b22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60602/0 (socket says 172.21.15.38:60602) 2023-12-22T08:44:41.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.514+0000 7fda38f79640 1 -- 172.21.15.38:0/2367694645 learned_addr learned my addr 172.21.15.38:0/2367694645 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:41.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.515+0000 7fda33fff640 1 --2- 172.21.15.38:0/2367694645 >> v2:172.21.15.89:3300/0 conn(0x7fda34143050 0x7fda3406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.515+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924477272 0 0) 0x7fda340c9550 con 0x7fda340b1e90 2023-12-22T08:44:41.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.515+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda20003520 con 0x7fda340b1e90 2023-12-22T08:44:41.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.515+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 791995118 0 0) 0x7fda20003520 con 0x7fda340b1e90 2023-12-22T08:44:41.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.515+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 >> v2:172.21.15.89:3300/0 conn(0x7fda34143050 msgr2=0x7fda3406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:41.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.515+0000 7fda32ffd640 1 --2- 172.21.15.38:0/2367694645 >> v2:172.21.15.89:3300/0 conn(0x7fda34143050 0x7fda3406de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.515+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 >> v1:172.21.15.89:6789/0 conn(0x7fda34143740 legacy=0x7fda340ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.515+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340c9df0 con 0x7fda340b1e90 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.515+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fda2c001670 con 0x7fda340b1e90 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.515+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 >> v1:172.21.15.38:6789/0 conn(0x7fda340b1e90 legacy=0x7fda340b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.515+0000 7fda32ffd640 1 --2- 172.21.15.38:0/2367694645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda20003970 0x7fda20003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda32ffd640 1 --2- 172.21.15.38:0/2367694645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda200047c0 0x7fda20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda32ffd640 1 --2- 172.21.15.38:0/2367694645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda20005180 0x7fda2000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340c9b10 con 0x7fda200047c0 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2000c030 con 0x7fda20005180 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2000c1f0 con 0x7fda20003970 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda337fe640 1 --2- 172.21.15.38:0/2367694645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda200047c0 0x7fda20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda33fff640 1 --2- 172.21.15.38:0/2367694645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda20003970 0x7fda20003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda38f79640 1 --2- 172.21.15.38:0/2367694645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda20005180 0x7fda2000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda337fe640 1 -- 172.21.15.38:0/2367694645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda20003970 msgr2=0x7fda20003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:41.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda337fe640 1 --2- 172.21.15.38:0/2367694645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda20003970 0x7fda20003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda337fe640 1 -- 172.21.15.38:0/2367694645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda20005180 msgr2=0x7fda2000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:41.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda337fe640 1 --2- 172.21.15.38:0/2367694645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda20005180 0x7fda2000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda337fe640 1 -- 172.21.15.38:0/2367694645 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20003520 con 0x7fda200047c0 2023-12-22T08:44:41.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda38f79640 1 --2- 172.21.15.38:0/2367694645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda20005180 0x7fda2000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:41.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.516+0000 7fda38f79640 1 -- 172.21.15.38:0/2367694645 reap_dead start 2023-12-22T08:44:41.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.518+0000 7fda337fe640 1 --2- 172.21.15.38:0/2367694645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda200047c0 0x7fda20004c40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fda1c001770 tx=0x7fda200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a98ec9e514ff57 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:41.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.518+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0052d0 con 0x7fda200047c0 2023-12-22T08:44:41.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.518+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c02e050 con 0x7fda200047c0 2023-12-22T08:44:41.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.518+0000 7fda32ffd640 1 -- 172.21.15.38:0/2367694645 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c003640 con 0x7fda200047c0 2023-12-22T08:44:41.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.518+0000 7fda3a9dc640 1 -- 172.21.15.38:0/2367694645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda200047c0 msgr2=0x7fda20004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:41.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.518+0000 7fda3a9dc640 1 --2- 172.21.15.38:0/2367694645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda200047c0 0x7fda20004c40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fda1c001770 tx=0x7fda200057f0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.519+0000 7fda3a9dc640 1 -- 172.21.15.38:0/2367694645 shutdown_connections 2023-12-22T08:44:41.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.519+0000 7fda3a9dc640 1 --2- 172.21.15.38:0/2367694645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda200047c0 0x7fda20004c40 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.519+0000 7fda3a9dc640 1 -- 172.21.15.38:0/2367694645 >> 172.21.15.38:0/2367694645 conn(0x7fda340cba10 msgr2=0x7fda340cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:41.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.519+0000 7fda3a9dc640 1 -- 172.21.15.38:0/2367694645 shutdown_connections 2023-12-22T08:44:41.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.519+0000 7fda3a9dc640 1 -- 172.21.15.38:0/2367694645 wait complete. 2023-12-22T08:44:41.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.520+0000 7fda3a9dc640 1 Processor -- start 2023-12-22T08:44:41.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.521+0000 7fda3a9dc640 1 -- start start 2023-12-22T08:44:41.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.521+0000 7fda3a9dc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda200047c0 0x7fda341f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda3a9dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3406bf00 0x7fda3406c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda3a9dc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda340af770 0x7fda340afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda3a9dc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3406c8c0 con 0x7fda340af770 2023-12-22T08:44:41.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda3a9dc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340ae7b0 con 0x7fda3406bf00 2023-12-22T08:44:41.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda3a9dc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda340b0130 con 0x7fda200047c0 2023-12-22T08:44:41.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda38f79640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda340af770 0x7fda340afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda38f79640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda340af770 0x7fda340afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48998/0 (socket says 172.21.15.38:48998) 2023-12-22T08:44:41.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda38f79640 1 -- 172.21.15.38:0/3780859680 learned_addr learned my addr 172.21.15.38:0/3780859680 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:41.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda33fff640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda200047c0 0x7fda341f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda337fe640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3406bf00 0x7fda3406c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda38f79640 1 -- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda200047c0 msgr2=0x7fda341f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:41.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda38f79640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda200047c0 0x7fda341f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda38f79640 1 -- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3406bf00 msgr2=0x7fda3406c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:41.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda38f79640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3406bf00 0x7fda3406c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:41.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda38f79640 1 -- 172.21.15.38:0/3780859680 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340ad710 con 0x7fda340af770 2023-12-22T08:44:41.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.522+0000 7fda337fe640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3406bf00 0x7fda3406c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:41.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.523+0000 7fda38f79640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda340af770 0x7fda340afbf0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fda2c001200 tx=0x7fda2c00d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:41.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.523+0000 7fda30ff9640 1 -- 172.21.15.38:0/3780859680 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c007500 con 0x7fda340af770 2023-12-22T08:44:41.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.523+0000 7fda30ff9640 1 -- 172.21.15.38:0/3780859680 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c007660 con 0x7fda340af770 2023-12-22T08:44:41.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.523+0000 7fda3a9dc640 1 -- 172.21.15.38:0/3780859680 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda340ad9f0 con 0x7fda340af770 2023-12-22T08:44:41.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.523+0000 7fda30ff9640 1 -- 172.21.15.38:0/3780859680 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0049e0 con 0x7fda340af770 2023-12-22T08:44:41.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.523+0000 7fda3a9dc640 1 -- 172.21.15.38:0/3780859680 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda340adfb0 con 0x7fda340af770 2023-12-22T08:44:41.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.524+0000 7fda3a9dc640 1 -- 172.21.15.38:0/3780859680 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3415bae0 con 0x7fda340af770 2023-12-22T08:44:41.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.525+0000 7fda30ff9640 1 -- 172.21.15.38:0/3780859680 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fda2c004b40 con 0x7fda340af770 2023-12-22T08:44:41.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.526+0000 7fda30ff9640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1406a3c0 0x7fda1406c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:41.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.526+0000 7fda30ff9640 1 -- 172.21.15.38:0/3780859680 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fda2c088550 con 0x7fda340af770 2023-12-22T08:44:41.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.527+0000 7fda33fff640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1406a3c0 0x7fda1406c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:41.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.528+0000 7fda33fff640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1406a3c0 0x7fda1406c880 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fda24009fd0 tx=0x7fda2400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:41.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.531+0000 7fda30ff9640 1 -- 172.21.15.38:0/3780859680 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fda2c053a10 con 0x7fda340af770 2023-12-22T08:44:41.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:41.761+0000 7fda3a9dc640 1 -- 172.21.15.38:0/3780859680 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fda34061910 con 0x7fda340af770 2023-12-22T08:44:42.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.291+0000 7fda30ff9640 1 -- 172.21.15.38:0/3780859680 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7fda2c057030 con 0x7fda340af770 2023-12-22T08:44:42.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.294+0000 7fda3a9dc640 1 -- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1406a3c0 msgr2=0x7fda1406c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:42.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.294+0000 7fda3a9dc640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1406a3c0 0x7fda1406c880 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fda24009fd0 tx=0x7fda2400b040 comp rx=0 tx=0).stop 2023-12-22T08:44:42.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.294+0000 7fda3a9dc640 1 -- 172.21.15.38:0/3780859680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda340af770 msgr2=0x7fda340afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.294+0000 7fda3a9dc640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda340af770 0x7fda340afbf0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fda2c001200 tx=0x7fda2c00d950 comp rx=0 tx=0).stop 2023-12-22T08:44:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.294+0000 7fda3a9dc640 1 -- 172.21.15.38:0/3780859680 shutdown_connections 2023-12-22T08:44:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.294+0000 7fda3a9dc640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1406a3c0 0x7fda1406c880 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.295+0000 7fda3a9dc640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda340af770 0x7fda340afbf0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.295+0000 7fda3a9dc640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3406bf00 0x7fda3406c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.295+0000 7fda3a9dc640 1 --2- 172.21.15.38:0/3780859680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda200047c0 0x7fda341f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.295+0000 7fda3a9dc640 1 -- 172.21.15.38:0/3780859680 >> 172.21.15.38:0/3780859680 conn(0x7fda340cba10 msgr2=0x7fda341422f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.295+0000 7fda3a9dc640 1 -- 172.21.15.38:0/3780859680 shutdown_connections 2023-12-22T08:44:42.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.295+0000 7fda3a9dc640 1 -- 172.21.15.38:0/3780859680 wait complete. 2023-12-22T08:44:42.320 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T08:44:42.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.548+0000 7fa337fff640 1 Processor -- start 2023-12-22T08:44:42.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.548+0000 7fa337fff640 1 -- start start 2023-12-22T08:44:42.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.549+0000 7fa337fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa33815b370 0x7fa33806d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:42.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.549+0000 7fa337fff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33815ca20 con 0x7fa3380ae6c0 2023-12-22T08:44:42.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.550+0000 7fa337fff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33806dc20 con 0x7fa33806d6a0 2023-12-22T08:44:42.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.550+0000 7fa337fff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33815b750 con 0x7fa33815b370 2023-12-22T08:44:42.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.550+0000 7fa3377fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa3380ae6c0 0x7fa33806fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60614/0 (socket says 172.21.15.38:60614) 2023-12-22T08:44:42.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.550+0000 7fa3377fe640 1 -- 172.21.15.38:0/1653880852 learned_addr learned my addr 172.21.15.38:0/1653880852 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:42.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.550+0000 7fa336ffd640 1 --2- 172.21.15.38:0/1653880852 >> v2:172.21.15.38:3300/0 conn(0x7fa33815b370 0x7fa33806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:42.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.550+0000 7fa335ffb640 1 -- 172.21.15.38:0/1653880852 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694397890 0 0) 0x7fa33815ca20 con 0x7fa3380ae6c0 2023-12-22T08:44:42.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.551+0000 7fa335ffb640 1 -- 172.21.15.38:0/1653880852 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa320003520 con 0x7fa3380ae6c0 2023-12-22T08:44:42.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.551+0000 7fa336ffd640 1 -- 172.21.15.38:0/1653880852 >> v1:172.21.15.89:6789/0 conn(0x7fa33806d6a0 legacy=0x7fa3380adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:42.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.551+0000 7fa336ffd640 1 -- 172.21.15.38:0/1653880852 >> v1:172.21.15.38:6789/0 conn(0x7fa3380ae6c0 legacy=0x7fa33806fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:42.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.551+0000 7fa336ffd640 1 -- 172.21.15.38:0/1653880852 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33806df00 con 0x7fa33815b370 2023-12-22T08:44:42.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.552+0000 7fa336ffd640 1 --2- 172.21.15.38:0/1653880852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33815b370 0x7fa33806d160 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa3280097a0 tx=0x7fa32802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbb3c845c19aac7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:42.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.552+0000 7fa335ffb640 1 -- 172.21.15.38:0/1653880852 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328030610 con 0x7fa33815b370 2023-12-22T08:44:42.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.552+0000 7fa335ffb640 1 -- 172.21.15.38:0/1653880852 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa328030770 con 0x7fa33815b370 2023-12-22T08:44:42.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.552+0000 7fa335ffb640 1 -- 172.21.15.38:0/1653880852 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328030b00 con 0x7fa33815b370 2023-12-22T08:44:42.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.553+0000 7fa337fff640 1 -- 172.21.15.38:0/1653880852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33815b370 msgr2=0x7fa33806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:42.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.553+0000 7fa337fff640 1 --2- 172.21.15.38:0/1653880852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33815b370 0x7fa33806d160 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa3280097a0 tx=0x7fa32802b960 comp rx=0 tx=0).stop 2023-12-22T08:44:42.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.553+0000 7fa337fff640 1 -- 172.21.15.38:0/1653880852 shutdown_connections 2023-12-22T08:44:42.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.553+0000 7fa337fff640 1 --2- 172.21.15.38:0/1653880852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33815b370 0x7fa33806d160 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:42.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.553+0000 7fa337fff640 1 -- 172.21.15.38:0/1653880852 >> 172.21.15.38:0/1653880852 conn(0x7fa3380b1110 msgr2=0x7fa3380b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:42.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.553+0000 7fa337fff640 1 -- 172.21.15.38:0/1653880852 shutdown_connections 2023-12-22T08:44:42.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.553+0000 7fa337fff640 1 -- 172.21.15.38:0/1653880852 wait complete. 2023-12-22T08:44:42.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.555+0000 7fa337fff640 1 Processor -- start 2023-12-22T08:44:42.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.555+0000 7fa337fff640 1 -- start start 2023-12-22T08:44:42.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.556+0000 7fa337fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33806d6a0 0x7fa3381401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:42.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.556+0000 7fa337fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3380ae6c0 0x7fa33813f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:42.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.556+0000 7fa337fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33815b370 0x7fa338157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.556+0000 7fa337fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380ce070 con 0x7fa33815b370 2023-12-22T08:44:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.556+0000 7fa337fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa338140730 con 0x7fa3380ae6c0 2023-12-22T08:44:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.556+0000 7fa337fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380cd460 con 0x7fa33806d6a0 2023-12-22T08:44:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.556+0000 7fa3377fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33815b370 0x7fa338157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.556+0000 7fa3377fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33815b370 0x7fa338157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49020/0 (socket says 172.21.15.38:49020) 2023-12-22T08:44:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.556+0000 7fa3377fe640 1 -- 172.21.15.38:0/3155043363 learned_addr learned my addr 172.21.15.38:0/3155043363 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.557+0000 7fa3367fc640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3380ae6c0 0x7fa33813f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.557+0000 7fa336ffd640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33806d6a0 0x7fa3381401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.557+0000 7fa3377fe640 1 -- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33806d6a0 msgr2=0x7fa3381401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.557+0000 7fa3377fe640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33806d6a0 0x7fa3381401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.557+0000 7fa3377fe640 1 -- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3380ae6c0 msgr2=0x7fa33813f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.557+0000 7fa3377fe640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3380ae6c0 0x7fa33813f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:42.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.557+0000 7fa3377fe640 1 -- 172.21.15.38:0/3155043363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa328009400 con 0x7fa33815b370 2023-12-22T08:44:42.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.557+0000 7fa3377fe640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33815b370 0x7fa338157960 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa33000cae0 tx=0x7fa33000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:42.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.557+0000 7fa31ffff640 1 -- 172.21.15.38:0/3155043363 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000ac40 con 0x7fa33815b370 2023-12-22T08:44:42.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.558+0000 7fa31ffff640 1 -- 172.21.15.38:0/3155043363 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33000ada0 con 0x7fa33815b370 2023-12-22T08:44:42.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.558+0000 7fa337fff640 1 -- 172.21.15.38:0/3155043363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3380cd740 con 0x7fa33815b370 2023-12-22T08:44:42.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.558+0000 7fa31ffff640 1 -- 172.21.15.38:0/3155043363 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330012640 con 0x7fa33815b370 2023-12-22T08:44:42.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.558+0000 7fa337fff640 1 -- 172.21.15.38:0/3155043363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3380cdd00 con 0x7fa33815b370 2023-12-22T08:44:42.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.559+0000 7fa337fff640 1 -- 172.21.15.38:0/3155043363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3380ce1e0 con 0x7fa33815b370 2023-12-22T08:44:42.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.560+0000 7fa31ffff640 1 -- 172.21.15.38:0/3155043363 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa330007070 con 0x7fa33815b370 2023-12-22T08:44:42.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.561+0000 7fa31ffff640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa32406a430 0x7fa32406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:42.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.561+0000 7fa31ffff640 1 -- 172.21.15.38:0/3155043363 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fa3300889f0 con 0x7fa33815b370 2023-12-22T08:44:42.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.562+0000 7fa336ffd640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa32406a430 0x7fa32406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:42.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.563+0000 7fa336ffd640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa32406a430 0x7fa32406c8f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa328036000 tx=0x7fa32803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:42.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.566+0000 7fa31ffff640 1 -- 172.21.15.38:0/3155043363 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa330053f40 con 0x7fa33815b370 2023-12-22T08:44:42.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:42.760+0000 7fa337fff640 1 -- 172.21.15.38:0/3155043363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa338061910 con 0x7fa33815b370 2023-12-22T08:44:43.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.300+0000 7fa31ffff640 1 -- 172.21.15.38:0/3155043363 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa330017020 con 0x7fa33815b370 2023-12-22T08:44:43.302 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2023-12-22T08:44:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.304+0000 7fa337fff640 1 -- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa32406a430 msgr2=0x7fa32406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.304+0000 7fa337fff640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa32406a430 0x7fa32406c8f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa328036000 tx=0x7fa32803b040 comp rx=0 tx=0).stop 2023-12-22T08:44:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.304+0000 7fa337fff640 1 -- 172.21.15.38:0/3155043363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33815b370 msgr2=0x7fa338157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.304+0000 7fa337fff640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33815b370 0x7fa338157960 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa33000cae0 tx=0x7fa33000a060 comp rx=0 tx=0).stop 2023-12-22T08:44:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.304+0000 7fa337fff640 1 -- 172.21.15.38:0/3155043363 shutdown_connections 2023-12-22T08:44:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.304+0000 7fa337fff640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa32406a430 0x7fa32406c8f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.304+0000 7fa337fff640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33815b370 0x7fa338157960 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.304+0000 7fa337fff640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3380ae6c0 0x7fa33813f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.304+0000 7fa337fff640 1 --2- 172.21.15.38:0/3155043363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33806d6a0 0x7fa3381401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.304+0000 7fa337fff640 1 -- 172.21.15.38:0/3155043363 >> 172.21.15.38:0/3155043363 conn(0x7fa3380b1110 msgr2=0x7fa338156dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.304+0000 7fa337fff640 1 -- 172.21.15.38:0/3155043363 shutdown_connections 2023-12-22T08:44:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.305+0000 7fa337fff640 1 -- 172.21.15.38:0/3155043363 wait complete. 2023-12-22T08:44:43.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T08:44:43.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.559+0000 7f203d204640 1 Processor -- start 2023-12-22T08:44:43.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.559+0000 7f203d204640 1 -- start start 2023-12-22T08:44:43.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.560+0000 7f203d204640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20380b22c0 0x7f20380b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:43.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.560+0000 7f203d204640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f20380cb830 0x7f20380cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:43.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.561+0000 7f203d204640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20380cc200 con 0x7f20380b26a0 2023-12-22T08:44:43.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.561+0000 7f203d204640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203806c610 con 0x7f20380cb830 2023-12-22T08:44:43.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.561+0000 7f203d204640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20380b4510 con 0x7f20380b22c0 2023-12-22T08:44:43.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.561+0000 7f202ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f20380b26a0 0x7f203806ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60628/0 (socket says 172.21.15.38:60628) 2023-12-22T08:44:43.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.561+0000 7f202ffff640 1 -- 172.21.15.38:0/2443515308 learned_addr learned my addr 172.21.15.38:0/2443515308 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:43.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.561+0000 7f203759e640 1 --2- 172.21.15.38:0/2443515308 >> v2:172.21.15.89:3300/0 conn(0x7f20380cb830 0x7f20380cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:43.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.561+0000 7f2036d9d640 1 --2- 172.21.15.38:0/2443515308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20380b22c0 0x7f20380b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:43.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.561+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545942802 0 0) 0x7f20380cc200 con 0x7f20380b26a0 2023-12-22T08:44:43.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2024003520 con 0x7f20380b26a0 2023-12-22T08:44:43.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3930102334 0 0) 0x7f2024003520 con 0x7f20380b26a0 2023-12-22T08:44:43.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20380b22c0 msgr2=0x7f20380b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:43.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 --2- 172.21.15.38:0/2443515308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20380b22c0 0x7f20380b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 >> v2:172.21.15.89:3300/0 conn(0x7f20380cb830 msgr2=0x7f20380cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 --2- 172.21.15.38:0/2443515308 >> v2:172.21.15.89:3300/0 conn(0x7f20380cb830 0x7f20380cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20380b3f50 con 0x7f20380b26a0 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f2020001670 con 0x7f20380b26a0 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 >> v1:172.21.15.38:6789/0 conn(0x7f20380b26a0 legacy=0x7f203806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 --2- 172.21.15.38:0/2443515308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20380b22c0 0x7f2024003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 --2- 172.21.15.38:0/2443515308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2024003ef0 0x7f20240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 --2- 172.21.15.38:0/2443515308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2024004d00 0x7f2024005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203806c610 con 0x7f2024003ef0 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380b4510 con 0x7f2024004d00 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202400b9d0 con 0x7f20380b22c0 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.562+0000 7f202ffff640 1 --2- 172.21.15.38:0/2443515308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2024003ef0 0x7f20240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.563+0000 7f2036d9d640 1 --2- 172.21.15.38:0/2443515308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20380b22c0 0x7f2024003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.563+0000 7f203759e640 1 --2- 172.21.15.38:0/2443515308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2024004d00 0x7f2024005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:43.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.563+0000 7f202ffff640 1 -- 172.21.15.38:0/2443515308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20380b22c0 msgr2=0x7f2024003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:43.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.563+0000 7f202ffff640 1 --2- 172.21.15.38:0/2443515308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20380b22c0 0x7f2024003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:43.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.563+0000 7f202ffff640 1 -- 172.21.15.38:0/2443515308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2024004d00 msgr2=0x7f2024005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:43.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.563+0000 7f202ffff640 1 --2- 172.21.15.38:0/2443515308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2024004d00 0x7f2024005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:43.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.563+0000 7f202ffff640 1 -- 172.21.15.38:0/2443515308 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2024003520 con 0x7f2024003ef0 2023-12-22T08:44:43.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.564+0000 7f202ffff640 1 --2- 172.21.15.38:0/2443515308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2024003ef0 0x7f20240047c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f202000c270 tx=0x7f20240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a62a68b9bbe2530 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:43.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.565+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202002cae0 con 0x7f2024003ef0 2023-12-22T08:44:43.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.565+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202002cc40 con 0x7f2024003ef0 2023-12-22T08:44:43.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.565+0000 7f203659c640 1 -- 172.21.15.38:0/2443515308 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020005af0 con 0x7f2024003ef0 2023-12-22T08:44:43.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.565+0000 7f203d204640 1 -- 172.21.15.38:0/2443515308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2024003ef0 msgr2=0x7f20240047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:43.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.565+0000 7f203d204640 1 --2- 172.21.15.38:0/2443515308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2024003ef0 0x7f20240047c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f202000c270 tx=0x7f20240057f0 comp rx=0 tx=0).stop 2023-12-22T08:44:43.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.565+0000 7f203759e640 1 -- 172.21.15.38:0/2443515308 reap_dead start 2023-12-22T08:44:43.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.565+0000 7f203d204640 1 -- 172.21.15.38:0/2443515308 shutdown_connections 2023-12-22T08:44:43.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.565+0000 7f203d204640 1 -- 172.21.15.38:0/2443515308 >> 172.21.15.38:0/2443515308 conn(0x7f20380cf070 msgr2=0x7f20380cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:43.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.565+0000 7f203d204640 1 -- 172.21.15.38:0/2443515308 shutdown_connections 2023-12-22T08:44:43.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.565+0000 7f203d204640 1 -- 172.21.15.38:0/2443515308 wait complete. 2023-12-22T08:44:43.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.567+0000 7f203d204640 1 Processor -- start 2023-12-22T08:44:43.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.567+0000 7f203d204640 1 -- start start 2023-12-22T08:44:43.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.568+0000 7f203d204640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2024003ef0 0x7f2038155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:43.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.568+0000 7f203d204640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2038156440 0x7f203815c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:43.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.568+0000 7f203d204640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f203815c7f0 0x7f203815e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:43.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.568+0000 7f203d204640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203815cc70 con 0x7f2024003ef0 2023-12-22T08:44:43.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.568+0000 7f203d204640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2038161690 con 0x7f203815c7f0 2023-12-22T08:44:43.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.568+0000 7f203d204640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2038161970 con 0x7f2038156440 2023-12-22T08:44:43.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.569+0000 7f2036d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2024003ef0 0x7f2038155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:43.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.569+0000 7f2036d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2024003ef0 0x7f2038155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49044/0 (socket says 172.21.15.38:49044) 2023-12-22T08:44:43.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.569+0000 7f2036d9d640 1 -- 172.21.15.38:0/2696715531 learned_addr learned my addr 172.21.15.38:0/2696715531 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:43.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.569+0000 7f202ffff640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2038156440 0x7f203815c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:43.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.569+0000 7f203759e640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f203815c7f0 0x7f203815e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:43.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.569+0000 7f2036d9d640 1 -- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2038156440 msgr2=0x7f203815c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:43.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.569+0000 7f2036d9d640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2038156440 0x7f203815c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:43.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.569+0000 7f2036d9d640 1 -- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f203815c7f0 msgr2=0x7f203815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:43.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.569+0000 7f2036d9d640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f203815c7f0 0x7f203815e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:43.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.569+0000 7f2036d9d640 1 -- 172.21.15.38:0/2696715531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038161c50 con 0x7f2024003ef0 2023-12-22T08:44:43.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.569+0000 7f203759e640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f203815c7f0 0x7f203815e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.570+0000 7f2036d9d640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2024003ef0 0x7f2038155c80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2028011540 tx=0x7f2028011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.570+0000 7f202f7fe640 1 -- 172.21.15.38:0/2696715531 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028015930 con 0x7f2024003ef0 2023-12-22T08:44:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.570+0000 7f202f7fe640 1 -- 172.21.15.38:0/2696715531 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2028015a90 con 0x7f2024003ef0 2023-12-22T08:44:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.570+0000 7f202f7fe640 1 -- 172.21.15.38:0/2696715531 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028015e60 con 0x7f2024003ef0 2023-12-22T08:44:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.570+0000 7f203d204640 1 -- 172.21.15.38:0/2696715531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2038161f30 con 0x7f2024003ef0 2023-12-22T08:44:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.570+0000 7f203d204640 1 -- 172.21.15.38:0/2696715531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20381561c0 con 0x7f2024003ef0 2023-12-22T08:44:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.571+0000 7f203d204640 1 -- 172.21.15.38:0/2696715531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2038061910 con 0x7f2024003ef0 2023-12-22T08:44:43.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.572+0000 7f202f7fe640 1 -- 172.21.15.38:0/2696715531 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f202800f460 con 0x7f2024003ef0 2023-12-22T08:44:43.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.573+0000 7f202f7fe640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f201806a430 0x7f201806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:43.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.573+0000 7f202f7fe640 1 -- 172.21.15.38:0/2696715531 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f2028088ff0 con 0x7f2024003ef0 2023-12-22T08:44:43.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.574+0000 7f202ffff640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f201806a430 0x7f201806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:43.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.575+0000 7f202ffff640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f201806a430 0x7f201806c8f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2020034000 tx=0x7f2020007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:43.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.578+0000 7f202f7fe640 1 -- 172.21.15.38:0/2696715531 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2028054660 con 0x7f2024003ef0 2023-12-22T08:44:43.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:43.770+0000 7f203d204640 1 -- 172.21.15.38:0/2696715531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f20380711a0 con 0x7f2024003ef0 2023-12-22T08:44:44.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.321+0000 7f202f7fe640 1 -- 172.21.15.38:0/2696715531 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2028057c80 con 0x7f2024003ef0 2023-12-22T08:44:44.325 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2023-12-22T08:44:44.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.328+0000 7f203d204640 1 -- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f201806a430 msgr2=0x7f201806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:44.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.328+0000 7f203d204640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f201806a430 0x7f201806c8f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2020034000 tx=0x7f2020007000 comp rx=0 tx=0).stop 2023-12-22T08:44:44.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.328+0000 7f203d204640 1 -- 172.21.15.38:0/2696715531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2024003ef0 msgr2=0x7f2038155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:44.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.328+0000 7f203d204640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2024003ef0 0x7f2038155c80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2028011540 tx=0x7f2028011a00 comp rx=0 tx=0).stop 2023-12-22T08:44:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.328+0000 7f203d204640 1 -- 172.21.15.38:0/2696715531 shutdown_connections 2023-12-22T08:44:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.328+0000 7f203d204640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f203815c7f0 0x7f203815e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.328+0000 7f203d204640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2038156440 0x7f203815c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.328+0000 7f203d204640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f201806a430 0x7f201806c8f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.328+0000 7f203d204640 1 --2- 172.21.15.38:0/2696715531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2024003ef0 0x7f2038155c80 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.328+0000 7f203d204640 1 -- 172.21.15.38:0/2696715531 >> 172.21.15.38:0/2696715531 conn(0x7f20380cf070 msgr2=0x7f20380cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.329+0000 7f203d204640 1 -- 172.21.15.38:0/2696715531 shutdown_connections 2023-12-22T08:44:44.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.329+0000 7f203d204640 1 -- 172.21.15.38:0/2696715531 wait complete. 2023-12-22T08:44:44.353 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-22T08:44:44.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.559+0000 7fb464869640 1 Processor -- start 2023-12-22T08:44:44.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.559+0000 7fb464869640 1 -- start start 2023-12-22T08:44:44.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.561+0000 7fb464869640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb46015b7b0 0x7fb4600ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:44.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.561+0000 7fb464869640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4600ce740 0x7fb460070520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:44.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.561+0000 7fb464869640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4600ceb90 con 0x7fb46015b3d0 2023-12-22T08:44:44.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.561+0000 7fb464869640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb460070100 con 0x7fb46015b7b0 2023-12-22T08:44:44.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.561+0000 7fb464869640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46006c1e0 con 0x7fb4600ce740 2023-12-22T08:44:44.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.561+0000 7fb45dd9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb46015b7b0 0x7fb4600ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:44.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.561+0000 7fb45ed9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4600ce740 0x7fb460070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:44.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.562+0000 7fb45ed9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4600ce740 0x7fb460070520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:40582/0 (socket says 172.21.15.38:40582) 2023-12-22T08:44:44.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.562+0000 7fb45ed9d640 1 -- 172.21.15.38:0/1904804776 learned_addr learned my addr 172.21.15.38:0/1904804776 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:44.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.562+0000 7fb45dd9b640 1 --2- 172.21.15.38:0/1904804776 >> v2:172.21.15.89:3300/0 conn(0x7fb46015b7b0 0x7fb4600ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:39322/0 (socket says 172.21.15.38:39322) 2023-12-22T08:44:44.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.562+0000 7fb45d59a640 1 -- 172.21.15.38:0/1904804776 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596692273 0 0) 0x7fb450001110 con 0x7fb46015b3d0 2023-12-22T08:44:44.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.562+0000 7fb45d59a640 1 -- 172.21.15.38:0/1904804776 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb448003520 con 0x7fb46015b3d0 2023-12-22T08:44:44.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.562+0000 7fb45ed9d640 1 -- 172.21.15.38:0/1904804776 >> v2:172.21.15.89:3300/0 conn(0x7fb46015b7b0 msgr2=0x7fb4600ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:44.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.562+0000 7fb45ed9d640 1 --2- 172.21.15.38:0/1904804776 >> v2:172.21.15.89:3300/0 conn(0x7fb46015b7b0 0x7fb4600ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:44.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.562+0000 7fb45ed9d640 1 -- 172.21.15.38:0/1904804776 >> v1:172.21.15.89:6789/0 conn(0x7fb46015b3d0 legacy=0x7fb4600ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:44.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.563+0000 7fb45ed9d640 1 -- 172.21.15.38:0/1904804776 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4600cd620 con 0x7fb4600ce740 2023-12-22T08:44:44.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.563+0000 7fb45dd9b640 1 --2- 172.21.15.38:0/1904804776 >> v2:172.21.15.89:3300/0 conn(0x7fb46015b7b0 0x7fb4600ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:44:44.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.564+0000 7fb45ed9d640 1 --2- 172.21.15.38:0/1904804776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4600ce740 0x7fb460070520 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb458009e50 tx=0x7fb45802be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d912c84b5c1088e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:44.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.565+0000 7fb45d59a640 1 -- 172.21.15.38:0/1904804776 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45802c9e0 con 0x7fb4600ce740 2023-12-22T08:44:44.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.565+0000 7fb45d59a640 1 -- 172.21.15.38:0/1904804776 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45802cb40 con 0x7fb4600ce740 2023-12-22T08:44:44.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.565+0000 7fb45d59a640 1 -- 172.21.15.38:0/1904804776 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4580343f0 con 0x7fb4600ce740 2023-12-22T08:44:44.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.565+0000 7fb464869640 1 -- 172.21.15.38:0/1904804776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4600ce740 msgr2=0x7fb460070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:44.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.565+0000 7fb464869640 1 --2- 172.21.15.38:0/1904804776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4600ce740 0x7fb460070520 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb458009e50 tx=0x7fb45802be40 comp rx=0 tx=0).stop 2023-12-22T08:44:44.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.566+0000 7fb464869640 1 -- 172.21.15.38:0/1904804776 shutdown_connections 2023-12-22T08:44:44.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.566+0000 7fb464869640 1 --2- 172.21.15.38:0/1904804776 >> v2:172.21.15.89:3300/0 conn(0x7fb46015b7b0 0x7fb4600ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:44.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.566+0000 7fb464869640 1 --2- 172.21.15.38:0/1904804776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4600ce740 0x7fb460070520 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:44.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.566+0000 7fb464869640 1 -- 172.21.15.38:0/1904804776 >> 172.21.15.38:0/1904804776 conn(0x7fb4600cba10 msgr2=0x7fb4600cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:44.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.566+0000 7fb464869640 1 -- 172.21.15.38:0/1904804776 shutdown_connections 2023-12-22T08:44:44.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.566+0000 7fb464869640 1 -- 172.21.15.38:0/1904804776 wait complete. 2023-12-22T08:44:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.567+0000 7fb464869640 1 Processor -- start 2023-12-22T08:44:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.568+0000 7fb464869640 1 -- start start 2023-12-22T08:44:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.569+0000 7fb464869640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4600ce740 0x7fb4600c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.569+0000 7fb464869640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb46015b3d0 0x7fb460071660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.569+0000 7fb464869640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb46015b7b0 0x7fb460157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.569+0000 7fb464869640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600c3b00 con 0x7fb46015b7b0 2023-12-22T08:44:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.569+0000 7fb464869640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600c3260 con 0x7fb4600ce740 2023-12-22T08:44:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.569+0000 7fb464869640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600c3540 con 0x7fb46015b3d0 2023-12-22T08:44:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.569+0000 7fb45ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb46015b7b0 0x7fb460157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.569+0000 7fb45ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb46015b7b0 0x7fb460157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49046/0 (socket says 172.21.15.38:49046) 2023-12-22T08:44:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.569+0000 7fb45ed9d640 1 -- 172.21.15.38:0/330794654 learned_addr learned my addr 172.21.15.38:0/330794654 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.569+0000 7fb45e59c640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4600ce740 0x7fb4600c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.569+0000 7fb45dd9b640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb46015b3d0 0x7fb460071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:44.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.570+0000 7fb45ed9d640 1 -- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb46015b3d0 msgr2=0x7fb460071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:44.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.570+0000 7fb45ed9d640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb46015b3d0 0x7fb460071660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:44.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.570+0000 7fb45ed9d640 1 -- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4600ce740 msgr2=0x7fb4600c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:44.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.570+0000 7fb45ed9d640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4600ce740 0x7fb4600c2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:44.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.570+0000 7fb45ed9d640 1 -- 172.21.15.38:0/330794654 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540093a0 con 0x7fb46015b7b0 2023-12-22T08:44:44.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.570+0000 7fb45e59c640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4600ce740 0x7fb4600c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:44:44.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.570+0000 7fb45ed9d640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb46015b7b0 0x7fb460157290 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb458009e50 tx=0x7fb458004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:44.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.570+0000 7fb44effd640 1 -- 172.21.15.38:0/330794654 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb458009510 con 0x7fb46015b7b0 2023-12-22T08:44:44.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.570+0000 7fb44effd640 1 -- 172.21.15.38:0/330794654 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45803e450 con 0x7fb46015b7b0 2023-12-22T08:44:44.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.570+0000 7fb44effd640 1 -- 172.21.15.38:0/330794654 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45803e800 con 0x7fb46015b7b0 2023-12-22T08:44:44.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.570+0000 7fb464869640 1 -- 172.21.15.38:0/330794654 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb458009b30 con 0x7fb46015b7b0 2023-12-22T08:44:44.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.571+0000 7fb464869640 1 -- 172.21.15.38:0/330794654 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4600aeb00 con 0x7fb46015b7b0 2023-12-22T08:44:44.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.572+0000 7fb464869640 1 -- 172.21.15.38:0/330794654 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb460061910 con 0x7fb46015b7b0 2023-12-22T08:44:44.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.573+0000 7fb44effd640 1 -- 172.21.15.38:0/330794654 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb45803e960 con 0x7fb46015b7b0 2023-12-22T08:44:44.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.574+0000 7fb44effd640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb44006a430 0x7fb44006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:44.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.574+0000 7fb44effd640 1 -- 172.21.15.38:0/330794654 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb4580ab2e0 con 0x7fb46015b7b0 2023-12-22T08:44:44.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.575+0000 7fb45e59c640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb44006a430 0x7fb44006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.576+0000 7fb45e59c640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb44006a430 0x7fb44006c8f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb450001370 tx=0x7fb450009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:44.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.579+0000 7fb44effd640 1 -- 172.21.15.38:0/330794654 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb458076b30 con 0x7fb46015b7b0 2023-12-22T08:44:44.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.776+0000 7fb464869640 1 -- 172.21.15.38:0/330794654 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb4600ccf90 con 0x7fb46015b7b0 2023-12-22T08:44:44.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.783+0000 7fb44effd640 1 -- 172.21.15.38:0/330794654 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb45807a150 con 0x7fb46015b7b0 2023-12-22T08:44:44.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.785+0000 7fb464869640 1 -- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb44006a430 msgr2=0x7fb44006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:44.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.785+0000 7fb464869640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb44006a430 0x7fb44006c8f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb450001370 tx=0x7fb450009040 comp rx=0 tx=0).stop 2023-12-22T08:44:44.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.786+0000 7fb464869640 1 -- 172.21.15.38:0/330794654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb46015b7b0 msgr2=0x7fb460157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:44.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.786+0000 7fb464869640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb46015b7b0 0x7fb460157290 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb458009e50 tx=0x7fb458004a40 comp rx=0 tx=0).stop 2023-12-22T08:44:44.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.786+0000 7fb464869640 1 -- 172.21.15.38:0/330794654 shutdown_connections 2023-12-22T08:44:44.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.786+0000 7fb464869640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb44006a430 0x7fb44006c8f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:44.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.786+0000 7fb464869640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb46015b7b0 0x7fb460157290 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:44.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.786+0000 7fb464869640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb46015b3d0 0x7fb460071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:44.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.786+0000 7fb464869640 1 --2- 172.21.15.38:0/330794654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4600ce740 0x7fb4600c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:44.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.786+0000 7fb464869640 1 -- 172.21.15.38:0/330794654 >> 172.21.15.38:0/330794654 conn(0x7fb4600cba10 msgr2=0x7fb4600659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:44.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.786+0000 7fb464869640 1 -- 172.21.15.38:0/330794654 shutdown_connections 2023-12-22T08:44:44.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:44.786+0000 7fb464869640 1 -- 172.21.15.38:0/330794654 wait complete. 2023-12-22T08:44:44.806 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-12-22T08:44:45.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.028+0000 7f136edae640 1 Processor -- start 2023-12-22T08:44:45.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.028+0000 7f136edae640 1 -- start start 2023-12-22T08:44:45.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.030+0000 7f136edae640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f136815d470 0x7f13680b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:45.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.030+0000 7f136edae640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f136815d850 0x7f13680ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:45.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.030+0000 7f136edae640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13680ac8e0 con 0x7f1368071ea0 2023-12-22T08:44:45.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.030+0000 7f136edae640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13680b4550 con 0x7f136815d850 2023-12-22T08:44:45.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.030+0000 7f136edae640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13680b4940 con 0x7f136815d470 2023-12-22T08:44:45.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.031+0000 7f1367fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f136815d850 0x7f13680ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:45.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.031+0000 7f1367fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f136815d850 0x7f13680ad330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49062/0 (socket says 172.21.15.38:49062) 2023-12-22T08:44:45.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.031+0000 7f1367fff640 1 -- 172.21.15.38:0/2347054660 learned_addr learned my addr 172.21.15.38:0/2347054660 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:45.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.031+0000 7f136cb4a640 1 --2- 172.21.15.38:0/2347054660 >> v2:172.21.15.89:3300/0 conn(0x7f136815d470 0x7f13680b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:45.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.031+0000 7f1367fff640 1 -- 172.21.15.38:0/2347054660 >> v2:172.21.15.89:3300/0 conn(0x7f136815d470 msgr2=0x7f13680b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:45.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.031+0000 7f1367fff640 1 --2- 172.21.15.38:0/2347054660 >> v2:172.21.15.89:3300/0 conn(0x7f136815d470 0x7f13680b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:45.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.031+0000 7f1367fff640 1 -- 172.21.15.38:0/2347054660 >> v1:172.21.15.89:6789/0 conn(0x7f1368071ea0 legacy=0x7f13680b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.031+0000 7f1367fff640 1 -- 172.21.15.38:0/2347054660 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13680b4c20 con 0x7f136815d850 2023-12-22T08:44:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.032+0000 7f1367fff640 1 --2- 172.21.15.38:0/2347054660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f136815d850 0x7f13680ad330 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f13680cfe80 tx=0x7f135402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4f84dff5fd6331 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.033+0000 7f13677fe640 1 -- 172.21.15.38:0/2347054660 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354031870 con 0x7f136815d850 2023-12-22T08:44:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.033+0000 7f13677fe640 1 -- 172.21.15.38:0/2347054660 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13540319d0 con 0x7f136815d850 2023-12-22T08:44:45.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.033+0000 7f13677fe640 1 -- 172.21.15.38:0/2347054660 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354031d60 con 0x7f136815d850 2023-12-22T08:44:45.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.033+0000 7f136edae640 1 -- 172.21.15.38:0/2347054660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f136815d850 msgr2=0x7f13680ad330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:45.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.033+0000 7f136edae640 1 --2- 172.21.15.38:0/2347054660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f136815d850 0x7f13680ad330 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f13680cfe80 tx=0x7f135402b910 comp rx=0 tx=0).stop 2023-12-22T08:44:45.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.033+0000 7f136edae640 1 -- 172.21.15.38:0/2347054660 shutdown_connections 2023-12-22T08:44:45.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.033+0000 7f136edae640 1 --2- 172.21.15.38:0/2347054660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f136815d850 0x7f13680ad330 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:45.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.033+0000 7f136edae640 1 --2- 172.21.15.38:0/2347054660 >> v2:172.21.15.89:3300/0 conn(0x7f136815d470 0x7f13680b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:45.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.033+0000 7f136edae640 1 -- 172.21.15.38:0/2347054660 >> 172.21.15.38:0/2347054660 conn(0x7f13680cf070 msgr2=0x7f13680cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:45.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.034+0000 7f136edae640 1 -- 172.21.15.38:0/2347054660 shutdown_connections 2023-12-22T08:44:45.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.034+0000 7f136edae640 1 -- 172.21.15.38:0/2347054660 wait complete. 2023-12-22T08:44:45.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.035+0000 7f136edae640 1 Processor -- start 2023-12-22T08:44:45.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.036+0000 7f136edae640 1 -- start start 2023-12-22T08:44:45.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.036+0000 7f136edae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1368071ea0 0x7f13680cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:45.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.036+0000 7f136edae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f136815d470 0x7f13680cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:45.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.037+0000 7f136edae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f136815d850 0x7f13680b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:45.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.037+0000 7f136edae640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1368145860 con 0x7f136815d850 2023-12-22T08:44:45.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.037+0000 7f136edae640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13681f3d20 con 0x7f1368071ea0 2023-12-22T08:44:45.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.037+0000 7f136edae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13680cb6c0 con 0x7f136815d470 2023-12-22T08:44:45.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.037+0000 7f136d34b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f136815d850 0x7f13680b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:45.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.037+0000 7f136d34b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f136815d850 0x7f13680b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49076/0 (socket says 172.21.15.38:49076) 2023-12-22T08:44:45.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.037+0000 7f136d34b640 1 -- 172.21.15.38:0/2292317519 learned_addr learned my addr 172.21.15.38:0/2292317519 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:45.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.037+0000 7f1367fff640 1 --2- 172.21.15.38:0/2292317519 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f136815d470 0x7f13680cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:45.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.037+0000 7f136d34b640 1 -- 172.21.15.38:0/2292317519 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f136815d470 msgr2=0x7f13680cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:45.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.037+0000 7f136d34b640 1 --2- 172.21.15.38:0/2292317519 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f136815d470 0x7f13680cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:45.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.037+0000 7f136d34b640 1 -- 172.21.15.38:0/2292317519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1368071ea0 msgr2=0x7f13680cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:45.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.037+0000 7f136d34b640 1 --2- 172.21.15.38:0/2292317519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1368071ea0 0x7f13680cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:45.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.037+0000 7f136d34b640 1 -- 172.21.15.38:0/2292317519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540094d0 con 0x7f136815d850 2023-12-22T08:44:45.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.038+0000 7f136d34b640 1 --2- 172.21.15.38:0/2292317519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f136815d850 0x7f13680b0130 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f136000b990 tx=0x7f136000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:45.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.038+0000 7f13657fa640 1 -- 172.21.15.38:0/2292317519 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136000cba0 con 0x7f136815d850 2023-12-22T08:44:45.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.038+0000 7f13657fa640 1 -- 172.21.15.38:0/2292317519 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136000cd00 con 0x7f136815d850 2023-12-22T08:44:45.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.038+0000 7f13657fa640 1 -- 172.21.15.38:0/2292317519 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360014680 con 0x7f136815d850 2023-12-22T08:44:45.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.038+0000 7f136edae640 1 -- 172.21.15.38:0/2292317519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13680cb9a0 con 0x7f136815d850 2023-12-22T08:44:45.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.038+0000 7f136edae640 1 -- 172.21.15.38:0/2292317519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13681f6400 con 0x7f136815d850 2023-12-22T08:44:45.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.039+0000 7f136edae640 1 -- 172.21.15.38:0/2292317519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1368061910 con 0x7f136815d850 2023-12-22T08:44:45.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.040+0000 7f13657fa640 1 -- 172.21.15.38:0/2292317519 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f13600147e0 con 0x7f136815d850 2023-12-22T08:44:45.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.041+0000 7f13657fa640 1 --2- 172.21.15.38:0/2292317519 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f134c06a430 0x7f134c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:45.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.041+0000 7f13657fa640 1 -- 172.21.15.38:0/2292317519 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1360088660 con 0x7f136815d850 2023-12-22T08:44:45.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.042+0000 7f136cb4a640 1 --2- 172.21.15.38:0/2292317519 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f134c06a430 0x7f134c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:45.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.043+0000 7f136cb4a640 1 --2- 172.21.15.38:0/2292317519 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f134c06a430 0x7f134c06c8f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f135c006fd0 tx=0x7f135c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:45.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.046+0000 7f13657fa640 1 -- 172.21.15.38:0/2292317519 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1360053eb0 con 0x7f136815d850 2023-12-22T08:44:45.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:45.312+0000 7f136edae640 1 -- 172.21.15.38:0/2292317519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f13681f65f0 con 0x7f136815d850 2023-12-22T08:44:46.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.332+0000 7f13657fa640 1 -- 172.21.15.38:0/2292317519 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v251) v1 ==== 134+0+0 (secure 0 0 0) 0x7f13600574d0 con 0x7f136815d850 2023-12-22T08:44:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.336+0000 7f136edae640 1 -- 172.21.15.38:0/2292317519 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f134c06a430 msgr2=0x7f134c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.336+0000 7f136edae640 1 --2- 172.21.15.38:0/2292317519 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f134c06a430 0x7f134c06c8f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f135c006fd0 tx=0x7f135c008040 comp rx=0 tx=0).stop 2023-12-22T08:44:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.336+0000 7f136edae640 1 -- 172.21.15.38:0/2292317519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f136815d850 msgr2=0x7f13680b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.336+0000 7f136edae640 1 --2- 172.21.15.38:0/2292317519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f136815d850 0x7f13680b0130 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f136000b990 tx=0x7f136000be50 comp rx=0 tx=0).stop 2023-12-22T08:44:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.337+0000 7f136edae640 1 -- 172.21.15.38:0/2292317519 shutdown_connections 2023-12-22T08:44:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.337+0000 7f136edae640 1 --2- 172.21.15.38:0/2292317519 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f134c06a430 0x7f134c06c8f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.337+0000 7f136edae640 1 --2- 172.21.15.38:0/2292317519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f136815d850 0x7f13680b0130 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.337+0000 7f136edae640 1 --2- 172.21.15.38:0/2292317519 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f136815d470 0x7f13680cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.337+0000 7f136edae640 1 --2- 172.21.15.38:0/2292317519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1368071ea0 0x7f13680cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.337+0000 7f136edae640 1 -- 172.21.15.38:0/2292317519 >> 172.21.15.38:0/2292317519 conn(0x7f13680cf070 msgr2=0x7f13681568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.337+0000 7f136edae640 1 -- 172.21.15.38:0/2292317519 shutdown_connections 2023-12-22T08:44:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.337+0000 7f136edae640 1 -- 172.21.15.38:0/2292317519 wait complete. 2023-12-22T08:44:46.362 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-22T08:44:46.362 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-12-22T08:44:46.362 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-12-22T08:44:46.363 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:44:46.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.591+0000 7fee2ee69640 1 Processor -- start 2023-12-22T08:44:46.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.591+0000 7fee2ee69640 1 -- start start 2023-12-22T08:44:46.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.592+0000 7fee2ee69640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee2815e740 0x7fee2815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:46.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.592+0000 7fee2ee69640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fee2806ca50 0x7fee280b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:46.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.592+0000 7fee2ee69640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee280b4210 con 0x7fee280b3dc0 2023-12-22T08:44:46.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.592+0000 7fee2ee69640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2806e650 con 0x7fee2806ca50 2023-12-22T08:44:46.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.592+0000 7fee2ee69640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2815eb20 con 0x7fee2815e740 2023-12-22T08:44:46.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.593+0000 7fee2d406640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fee280b3dc0 0x7fee28161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60630/0 (socket says 172.21.15.38:60630) 2023-12-22T08:44:46.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.593+0000 7fee2d406640 1 -- 172.21.15.38:0/1324875431 learned_addr learned my addr 172.21.15.38:0/1324875431 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:46.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.593+0000 7fee2cc05640 1 --2- 172.21.15.38:0/1324875431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee2815e740 0x7fee2815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:46.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.593+0000 7fee1ffff640 1 --2- 172.21.15.38:0/1324875431 >> v2:172.21.15.89:3300/0 conn(0x7fee2806ca50 0x7fee280b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:46.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.593+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683176868 0 0) 0x7fee20001490 con 0x7fee280b3dc0 2023-12-22T08:44:46.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.593+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee10003520 con 0x7fee280b3dc0 2023-12-22T08:44:46.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 630600695 0 0) 0x7fee10003520 con 0x7fee280b3dc0 2023-12-22T08:44:46.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee2815e740 msgr2=0x7fee2815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:46.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 --2- 172.21.15.38:0/1324875431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee2815e740 0x7fee2815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 >> v2:172.21.15.89:3300/0 conn(0x7fee2806ca50 msgr2=0x7fee280b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:46.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 --2- 172.21.15.38:0/1324875431 >> v2:172.21.15.89:3300/0 conn(0x7fee2806ca50 0x7fee280b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee28070770 con 0x7fee280b3dc0 2023-12-22T08:44:46.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fee20001b80 con 0x7fee280b3dc0 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 >> v1:172.21.15.38:6789/0 conn(0x7fee280b3dc0 legacy=0x7fee28161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 --2- 172.21.15.38:0/1324875431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee10003970 0x7fee10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 --2- 172.21.15.38:0/1324875431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee2815e740 0x7fee100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 --2- 172.21.15.38:0/1324875431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee10004d00 0x7fee10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2806e650 con 0x7fee10004d00 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2815eb20 con 0x7fee10003970 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1000ba00 con 0x7fee2815e740 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.594+0000 7fee2d406640 1 --2- 172.21.15.38:0/1324875431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee10004d00 0x7fee10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.595+0000 7fee2cc05640 1 --2- 172.21.15.38:0/1324875431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee10003970 0x7fee10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.595+0000 7fee1ffff640 1 --2- 172.21.15.38:0/1324875431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee2815e740 0x7fee100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.595+0000 7fee2d406640 1 -- 172.21.15.38:0/1324875431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee2815e740 msgr2=0x7fee100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.595+0000 7fee2d406640 1 --2- 172.21.15.38:0/1324875431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee2815e740 0x7fee100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.595+0000 7fee2d406640 1 -- 172.21.15.38:0/1324875431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee10003970 msgr2=0x7fee10003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:46.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.595+0000 7fee2d406640 1 --2- 172.21.15.38:0/1324875431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee10003970 0x7fee10003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.595+0000 7fee2d406640 1 -- 172.21.15.38:0/1324875431 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee10003520 con 0x7fee10004d00 2023-12-22T08:44:46.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.595+0000 7fee1ffff640 1 --2- 172.21.15.38:0/1324875431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee2815e740 0x7fee100047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:46.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.596+0000 7fee2d406640 1 --2- 172.21.15.38:0/1324875431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee10004d00 0x7fee10005180 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fee2000a830 tx=0x7fee100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc98ebcf64f5f68 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:46.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.596+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20034630 con 0x7fee10004d00 2023-12-22T08:44:46.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.596+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2002f070 con 0x7fee10004d00 2023-12-22T08:44:46.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.596+0000 7fee1f7fe640 1 -- 172.21.15.38:0/1324875431 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee200349d0 con 0x7fee10004d00 2023-12-22T08:44:46.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.597+0000 7fee2ee69640 1 -- 172.21.15.38:0/1324875431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee10004d00 msgr2=0x7fee10005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:46.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.597+0000 7fee2ee69640 1 --2- 172.21.15.38:0/1324875431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee10004d00 0x7fee10005180 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fee2000a830 tx=0x7fee100057f0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.597+0000 7fee2d406640 1 -- 172.21.15.38:0/1324875431 reap_dead start 2023-12-22T08:44:46.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.597+0000 7fee2ee69640 1 -- 172.21.15.38:0/1324875431 shutdown_connections 2023-12-22T08:44:46.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.597+0000 7fee2ee69640 1 -- 172.21.15.38:0/1324875431 >> 172.21.15.38:0/1324875431 conn(0x7fee280cfea0 msgr2=0x7fee280d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:46.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.597+0000 7fee2ee69640 1 -- 172.21.15.38:0/1324875431 shutdown_connections 2023-12-22T08:44:46.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.597+0000 7fee2ee69640 1 -- 172.21.15.38:0/1324875431 wait complete. 2023-12-22T08:44:46.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.599+0000 7fee2ee69640 1 Processor -- start 2023-12-22T08:44:46.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.599+0000 7fee2ee69640 1 -- start start 2023-12-22T08:44:46.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.600+0000 7fee2ee69640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee10004d00 0x7fee281f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:46.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.600+0000 7fee2ee69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee280b7da0 0x7fee28161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:46.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.600+0000 7fee2ee69640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee280b21b0 0x7fee280ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:46.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.600+0000 7fee2ee69640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee281f6290 con 0x7fee280b7da0 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.600+0000 7fee2ee69640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee280b82a0 con 0x7fee10004d00 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.600+0000 7fee2ee69640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee280b8580 con 0x7fee280b21b0 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.600+0000 7fee1ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee280b7da0 0x7fee28161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.600+0000 7fee1ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee280b7da0 0x7fee28161190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49096/0 (socket says 172.21.15.38:49096) 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.600+0000 7fee1ffff640 1 -- 172.21.15.38:0/806179500 learned_addr learned my addr 172.21.15.38:0/806179500 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.601+0000 7fee2cc05640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee10004d00 0x7fee281f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.601+0000 7fee2d406640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee280b21b0 0x7fee280ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.601+0000 7fee1ffff640 1 -- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee280b21b0 msgr2=0x7fee280ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.601+0000 7fee1ffff640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee280b21b0 0x7fee280ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.601+0000 7fee1ffff640 1 -- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee10004d00 msgr2=0x7fee281f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.601+0000 7fee1ffff640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee10004d00 0x7fee281f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.601+0000 7fee1ffff640 1 -- 172.21.15.38:0/806179500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee280b8860 con 0x7fee280b7da0 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.601+0000 7fee2cc05640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee10004d00 0x7fee281f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:46.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.601+0000 7fee1ffff640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee280b7da0 0x7fee28161190 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fee180109d0 tx=0x7fee18010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:46.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.601+0000 7fee1d7fa640 1 -- 172.21.15.38:0/806179500 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1800ec20 con 0x7fee280b7da0 2023-12-22T08:44:46.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.602+0000 7fee1d7fa640 1 -- 172.21.15.38:0/806179500 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1800ed80 con 0x7fee280b7da0 2023-12-22T08:44:46.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.602+0000 7fee1d7fa640 1 -- 172.21.15.38:0/806179500 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1801c620 con 0x7fee280b7da0 2023-12-22T08:44:46.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.602+0000 7fee2ee69640 1 -- 172.21.15.38:0/806179500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee281f5f20 con 0x7fee280b7da0 2023-12-22T08:44:46.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.602+0000 7fee2ee69640 1 -- 172.21.15.38:0/806179500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee281f6e40 con 0x7fee280b7da0 2023-12-22T08:44:46.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.603+0000 7fee2ee69640 1 -- 172.21.15.38:0/806179500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee281f6440 con 0x7fee280b7da0 2023-12-22T08:44:46.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.604+0000 7fee1d7fa640 1 -- 172.21.15.38:0/806179500 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fee1801c780 con 0x7fee280b7da0 2023-12-22T08:44:46.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.605+0000 7fee1d7fa640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fee1406a460 0x7fee1406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:46.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.605+0000 7fee1d7fa640 1 -- 172.21.15.38:0/806179500 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fee18088b40 con 0x7fee280b7da0 2023-12-22T08:44:46.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.605+0000 7fee2cc05640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fee1406a460 0x7fee1406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:46.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.607+0000 7fee2cc05640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fee1406a460 0x7fee1406c920 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fee24009980 tx=0x7fee24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:46.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.609+0000 7fee1d7fa640 1 -- 172.21.15.38:0/806179500 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fee281f6440 con 0x7fee280b7da0 2023-12-22T08:44:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.811+0000 7fee2ee69640 1 -- 172.21.15.38:0/806179500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee281f6e40 con 0x7fee280b7da0 2023-12-22T08:44:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.813+0000 7fee1d7fa640 1 -- 172.21.15.38:0/806179500 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+12470 (secure 0 0 0) 0x7fee281f6e40 con 0x7fee280b7da0 2023-12-22T08:44:46.815 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:46.815 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":80,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:44:44.307131+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6835/1778808252":"2023-12-23T08:44:41.262745+0000","172.21.15.38:6834/1778808252":"2023-12-23T08:44:41.262745+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:44:46.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.815+0000 7fee2ee69640 1 -- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fee1406a460 msgr2=0x7fee1406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.815+0000 7fee2ee69640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fee1406a460 0x7fee1406c920 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fee24009980 tx=0x7fee24008040 comp rx=0 tx=0).stop 2023-12-22T08:44:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.815+0000 7fee2ee69640 1 -- 172.21.15.38:0/806179500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee280b7da0 msgr2=0x7fee28161190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.815+0000 7fee2ee69640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee280b7da0 0x7fee28161190 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fee180109d0 tx=0x7fee18010e90 comp rx=0 tx=0).stop 2023-12-22T08:44:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.815+0000 7fee2ee69640 1 -- 172.21.15.38:0/806179500 shutdown_connections 2023-12-22T08:44:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.815+0000 7fee2ee69640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee280b21b0 0x7fee280ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.815+0000 7fee2ee69640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fee1406a460 0x7fee1406c920 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.815+0000 7fee2ee69640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fee280b7da0 0x7fee28161190 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.815+0000 7fee2ee69640 1 --2- 172.21.15.38:0/806179500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee10004d00 0x7fee281f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.816+0000 7fee2ee69640 1 -- 172.21.15.38:0/806179500 >> 172.21.15.38:0/806179500 conn(0x7fee280cfea0 msgr2=0x7fee280d2470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.816+0000 7fee2ee69640 1 -- 172.21.15.38:0/806179500 shutdown_connections 2023-12-22T08:44:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:46.816+0000 7fee2ee69640 1 -- 172.21.15.38:0/806179500 wait complete. 2023-12-22T08:44:46.837 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:44:46.837 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:44:47.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.062+0000 7f1f0cc1b640 1 Processor -- start 2023-12-22T08:44:47.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.062+0000 7f1f0cc1b640 1 -- start start 2023-12-22T08:44:47.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.064+0000 7f1f0cc1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f08070f10 0x7f1f0806f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:47.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.064+0000 7f1f0cc1b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1f0806f790 0x7f1f080712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:47.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.064+0000 7f1f0cc1b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f08161ba0 con 0x7f1f080ae6a0 2023-12-22T08:44:47.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.064+0000 7f1f0cc1b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080acc00 con 0x7f1f0806f790 2023-12-22T08:44:47.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.064+0000 7f1f0cc1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080acea0 con 0x7f1f08070f10 2023-12-22T08:44:47.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.065+0000 7f1f07fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1f080ae6a0 0x7f1f0806c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60638/0 (socket says 172.21.15.38:60638) 2023-12-22T08:44:47.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.065+0000 7f1f07fff640 1 -- 172.21.15.38:0/4275848582 learned_addr learned my addr 172.21.15.38:0/4275848582 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:47.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.065+0000 7f1f077fe640 1 --2- 172.21.15.38:0/4275848582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f08070f10 0x7f1f0806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:47.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.065+0000 7f1efffff640 1 --2- 172.21.15.38:0/4275848582 >> v2:172.21.15.89:3300/0 conn(0x7f1f0806f790 0x7f1f080712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:47.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.065+0000 7f1f06ffd640 1 -- 172.21.15.38:0/4275848582 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232172163 0 0) 0x7f1f00001490 con 0x7f1f080ae6a0 2023-12-22T08:44:47.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.065+0000 7f1f06ffd640 1 -- 172.21.15.38:0/4275848582 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef4003520 con 0x7f1f080ae6a0 2023-12-22T08:44:47.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.066+0000 7f1efffff640 1 -- 172.21.15.38:0/4275848582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f08070f10 msgr2=0x7f1f0806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:47.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.066+0000 7f1efffff640 1 --2- 172.21.15.38:0/4275848582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f08070f10 0x7f1f0806f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.066+0000 7f1f06ffd640 1 -- 172.21.15.38:0/4275848582 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 538042291 0 0) 0x7f1ef4003520 con 0x7f1f080ae6a0 2023-12-22T08:44:47.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.066+0000 7f1efffff640 1 -- 172.21.15.38:0/4275848582 >> v1:172.21.15.38:6789/0 conn(0x7f1f080ae6a0 legacy=0x7f1f0806c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:47.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.066+0000 7f1efffff640 1 -- 172.21.15.38:0/4275848582 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080ad180 con 0x7f1f0806f790 2023-12-22T08:44:47.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.067+0000 7f1efffff640 1 --2- 172.21.15.38:0/4275848582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f0806f790 0x7f1f080712f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00097a0 tx=0x7f1ef002b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91420fe64b3decac server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:47.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.068+0000 7f1f06ffd640 1 -- 172.21.15.38:0/4275848582 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f00001b80 con 0x7f1f0806f790 2023-12-22T08:44:47.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.068+0000 7f1f06ffd640 1 -- 172.21.15.38:0/4275848582 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef002e050 con 0x7f1f0806f790 2023-12-22T08:44:47.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.068+0000 7f1f06ffd640 1 -- 172.21.15.38:0/4275848582 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0030730 con 0x7f1f0806f790 2023-12-22T08:44:47.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.069+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/4275848582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f0806f790 msgr2=0x7f1f080712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:47.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.069+0000 7f1f0cc1b640 1 --2- 172.21.15.38:0/4275848582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f0806f790 0x7f1f080712f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00097a0 tx=0x7f1ef002b710 comp rx=0 tx=0).stop 2023-12-22T08:44:47.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.069+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/4275848582 shutdown_connections 2023-12-22T08:44:47.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.069+0000 7f1f0cc1b640 1 --2- 172.21.15.38:0/4275848582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f0806f790 0x7f1f080712f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.069+0000 7f1f0cc1b640 1 --2- 172.21.15.38:0/4275848582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f08070f10 0x7f1f0806f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.069+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/4275848582 >> 172.21.15.38:0/4275848582 conn(0x7f1f080b0b60 msgr2=0x7f1f080b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:47.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.069+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/4275848582 shutdown_connections 2023-12-22T08:44:47.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.069+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/4275848582 wait complete. 2023-12-22T08:44:47.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.071+0000 7f1f0cc1b640 1 Processor -- start 2023-12-22T08:44:47.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.071+0000 7f1f0cc1b640 1 -- start start 2023-12-22T08:44:47.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f0cc1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f0806f790 0x7f1f0815af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:47.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f0cc1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f08070f10 0x7f1f08146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:47.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f0cc1b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f080ae6a0 0x7f1f08155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:47.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f0cc1b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0815a240 con 0x7f1f080ae6a0 2023-12-22T08:44:47.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f0cc1b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0815b620 con 0x7f1f08070f10 2023-12-22T08:44:47.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f0cc1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08153880 con 0x7f1f0806f790 2023-12-22T08:44:47.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f07fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f080ae6a0 0x7f1f08155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:47.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f07fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f080ae6a0 0x7f1f08155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49100/0 (socket says 172.21.15.38:49100) 2023-12-22T08:44:47.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f07fff640 1 -- 172.21.15.38:0/3207937200 learned_addr learned my addr 172.21.15.38:0/3207937200 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:47.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f077fe640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f0806f790 0x7f1f0815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:47.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1efffff640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f08070f10 0x7f1f08146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:47.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f07fff640 1 -- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f0806f790 msgr2=0x7f1f0815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:47.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f07fff640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f0806f790 0x7f1f0815af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f07fff640 1 -- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f08070f10 msgr2=0x7f1f08146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:47.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f07fff640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f08070f10 0x7f1f08146180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.072+0000 7f1f07fff640 1 -- 172.21.15.38:0/3207937200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef0009400 con 0x7f1f080ae6a0 2023-12-22T08:44:47.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.073+0000 7f1f07fff640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f080ae6a0 0x7f1f08155630 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000cb80 tx=0x7f1f0000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:47.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.073+0000 7f1f04ff9640 1 -- 172.21.15.38:0/3207937200 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0000ad40 con 0x7f1f080ae6a0 2023-12-22T08:44:47.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.073+0000 7f1f04ff9640 1 -- 172.21.15.38:0/3207937200 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f00012400 con 0x7f1f080ae6a0 2023-12-22T08:44:47.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.073+0000 7f1f04ff9640 1 -- 172.21.15.38:0/3207937200 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0000aea0 con 0x7f1f080ae6a0 2023-12-22T08:44:47.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.073+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/3207937200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f081598e0 con 0x7f1f080ae6a0 2023-12-22T08:44:47.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.073+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/3207937200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f08159b80 con 0x7f1f080ae6a0 2023-12-22T08:44:47.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.074+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/3207937200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0815a380 con 0x7f1f080ae6a0 2023-12-22T08:44:47.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.075+0000 7f1f04ff9640 1 -- 172.21.15.38:0/3207937200 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1f000127d0 con 0x7f1f080ae6a0 2023-12-22T08:44:47.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.076+0000 7f1f04ff9640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ee806a430 0x7f1ee806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:47.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.076+0000 7f1f04ff9640 1 -- 172.21.15.38:0/3207937200 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1f00088bc0 con 0x7f1f080ae6a0 2023-12-22T08:44:47.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.077+0000 7f1f077fe640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ee806a430 0x7f1ee806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:47.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.078+0000 7f1f077fe640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ee806a430 0x7f1ee806c8f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009a10 tx=0x7f1ef8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:47.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.080+0000 7f1f04ff9640 1 -- 172.21.15.38:0/3207937200 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1f00054410 con 0x7f1f080ae6a0 2023-12-22T08:44:47.198 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:44:47.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:44:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.276+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/3207937200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f08161ba0 con 0x7f1f080ae6a0 2023-12-22T08:44:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.277+0000 7f1f04ff9640 1 -- 172.21.15.38:0/3207937200 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f08161ba0 con 0x7f1f080ae6a0 2023-12-22T08:44:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:44:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.280+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ee806a430 msgr2=0x7f1ee806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.280+0000 7f1f0cc1b640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ee806a430 0x7f1ee806c8f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009a10 tx=0x7f1ef8008040 comp rx=0 tx=0).stop 2023-12-22T08:44:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.280+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/3207937200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f080ae6a0 msgr2=0x7f1f08155630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.280+0000 7f1f0cc1b640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f080ae6a0 0x7f1f08155630 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000cb80 tx=0x7f1f0000a430 comp rx=0 tx=0).stop 2023-12-22T08:44:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.280+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/3207937200 shutdown_connections 2023-12-22T08:44:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.280+0000 7f1f0cc1b640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ee806a430 0x7f1ee806c8f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.280+0000 7f1f0cc1b640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f080ae6a0 0x7f1f08155630 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.280+0000 7f1f0cc1b640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f08070f10 0x7f1f08146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.280+0000 7f1f0cc1b640 1 --2- 172.21.15.38:0/3207937200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f0806f790 0x7f1f0815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.280+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/3207937200 >> 172.21.15.38:0/3207937200 conn(0x7f1f080b0b60 msgr2=0x7f1f081570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.280+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/3207937200 shutdown_connections 2023-12-22T08:44:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.280+0000 7f1f0cc1b640 1 -- 172.21.15.38:0/3207937200 wait complete. 2023-12-22T08:44:47.301 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-12-22T08:44:47.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.514+0000 7f311ad8e640 1 Processor -- start 2023-12-22T08:44:47.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.515+0000 7f311ad8e640 1 -- start start 2023-12-22T08:44:47.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.516+0000 7f311ad8e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f311415b420 0x7f311406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:47.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.516+0000 7f311ad8e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3114071000 0x7f311415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:47.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.516+0000 7f311ad8e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31140cdae0 con 0x7f31140a44a0 2023-12-22T08:44:47.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.516+0000 7f311ad8e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311406dec0 con 0x7f3114071000 2023-12-22T08:44:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.516+0000 7f311ad8e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311415b800 con 0x7f311415b420 2023-12-22T08:44:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.517+0000 7f311958b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f31140a44a0 0x7f31140708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60646/0 (socket says 172.21.15.38:60646) 2023-12-22T08:44:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.517+0000 7f311958b640 1 -- 172.21.15.38:0/3917264314 learned_addr learned my addr 172.21.15.38:0/3917264314 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.517+0000 7f311a58d640 1 --2- 172.21.15.38:0/3917264314 >> v2:172.21.15.38:3300/0 conn(0x7f3114071000 0x7f311415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.517+0000 7f3119d8c640 1 --2- 172.21.15.38:0/3917264314 >> v2:172.21.15.89:3300/0 conn(0x7f311415b420 0x7f311406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.517+0000 7f311a58d640 1 -- 172.21.15.38:0/3917264314 >> v2:172.21.15.89:3300/0 conn(0x7f311415b420 msgr2=0x7f311406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:47.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.517+0000 7f311a58d640 1 --2- 172.21.15.38:0/3917264314 >> v2:172.21.15.89:3300/0 conn(0x7f311415b420 0x7f311406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.517+0000 7f311a58d640 1 -- 172.21.15.38:0/3917264314 >> v1:172.21.15.38:6789/0 conn(0x7f31140a44a0 legacy=0x7f31140708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:47.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.517+0000 7f311a58d640 1 -- 172.21.15.38:0/3917264314 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31140cdd30 con 0x7f3114071000 2023-12-22T08:44:47.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.517+0000 7f3118d8a640 1 -- 172.21.15.38:0/3917264314 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842515759 0 0) 0x7f31140cdae0 con 0x7f31140a44a0 2023-12-22T08:44:47.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.518+0000 7f311a58d640 1 --2- 172.21.15.38:0/3917264314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3114071000 0x7f311415baa0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f31140613e0 tx=0x7f310c02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd3762b889b2c9e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:47.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.519+0000 7f3118d8a640 1 -- 172.21.15.38:0/3917264314 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c02cc70 con 0x7f3114071000 2023-12-22T08:44:47.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.519+0000 7f3118d8a640 1 -- 172.21.15.38:0/3917264314 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c02cdd0 con 0x7f3114071000 2023-12-22T08:44:47.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.519+0000 7f3118d8a640 1 -- 172.21.15.38:0/3917264314 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c034660 con 0x7f3114071000 2023-12-22T08:44:47.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.519+0000 7f311ad8e640 1 -- 172.21.15.38:0/3917264314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3114071000 msgr2=0x7f311415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:47.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.519+0000 7f311ad8e640 1 --2- 172.21.15.38:0/3917264314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3114071000 0x7f311415baa0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f31140613e0 tx=0x7f310c02bec0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.519+0000 7f311ad8e640 1 -- 172.21.15.38:0/3917264314 shutdown_connections 2023-12-22T08:44:47.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.519+0000 7f311ad8e640 1 --2- 172.21.15.38:0/3917264314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3114071000 0x7f311415baa0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.519+0000 7f311ad8e640 1 --2- 172.21.15.38:0/3917264314 >> v2:172.21.15.89:3300/0 conn(0x7f311415b420 0x7f311406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.519+0000 7f311ad8e640 1 -- 172.21.15.38:0/3917264314 >> 172.21.15.38:0/3917264314 conn(0x7f31140b1f70 msgr2=0x7f31140b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:47.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.520+0000 7f311ad8e640 1 -- 172.21.15.38:0/3917264314 shutdown_connections 2023-12-22T08:44:47.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.520+0000 7f311ad8e640 1 -- 172.21.15.38:0/3917264314 wait complete. 2023-12-22T08:44:47.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.521+0000 7f311ad8e640 1 Processor -- start 2023-12-22T08:44:47.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.522+0000 7f311ad8e640 1 -- start start 2023-12-22T08:44:47.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.523+0000 7f311ad8e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3114071000 0x7f31141f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:47.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.523+0000 7f311ad8e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31140a44a0 0x7f3114153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:47.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.523+0000 7f311ad8e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f311415b420 0x7f3114153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:47.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.523+0000 7f311ad8e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311409f710 con 0x7f31140a44a0 2023-12-22T08:44:47.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.523+0000 7f311ad8e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31141542b0 con 0x7f3114071000 2023-12-22T08:44:47.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.523+0000 7f311ad8e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31141f5c80 con 0x7f311415b420 2023-12-22T08:44:47.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.523+0000 7f311958b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31140a44a0 0x7f3114153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:47.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.523+0000 7f311958b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31140a44a0 0x7f3114153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49116/0 (socket says 172.21.15.38:49116) 2023-12-22T08:44:47.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.523+0000 7f311958b640 1 -- 172.21.15.38:0/1699835607 learned_addr learned my addr 172.21.15.38:0/1699835607 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:47.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.523+0000 7f311a58d640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f311415b420 0x7f3114153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:47.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.523+0000 7f3119d8c640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3114071000 0x7f31141f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:47.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.524+0000 7f311958b640 1 -- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f311415b420 msgr2=0x7f3114153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:47.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.524+0000 7f311958b640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f311415b420 0x7f3114153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.524+0000 7f311958b640 1 -- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3114071000 msgr2=0x7f31141f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:47.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.524+0000 7f311958b640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3114071000 0x7f31141f5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:47.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.524+0000 7f311958b640 1 -- 172.21.15.38:0/1699835607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c009a70 con 0x7f31140a44a0 2023-12-22T08:44:47.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.524+0000 7f311958b640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31140a44a0 0x7f3114153430 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f310400c3e0 tx=0x7f310400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:47.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.524+0000 7f310a7fc640 1 -- 172.21.15.38:0/1699835607 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31040074e0 con 0x7f31140a44a0 2023-12-22T08:44:47.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.524+0000 7f310a7fc640 1 -- 172.21.15.38:0/1699835607 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3104007660 con 0x7f31140a44a0 2023-12-22T08:44:47.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.524+0000 7f311ad8e640 1 -- 172.21.15.38:0/1699835607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311409ea90 con 0x7f31140a44a0 2023-12-22T08:44:47.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.524+0000 7f310a7fc640 1 -- 172.21.15.38:0/1699835607 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104004a20 con 0x7f31140a44a0 2023-12-22T08:44:47.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.524+0000 7f311ad8e640 1 -- 172.21.15.38:0/1699835607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311409f050 con 0x7f31140a44a0 2023-12-22T08:44:47.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.526+0000 7f311ad8e640 1 -- 172.21.15.38:0/1699835607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311409f850 con 0x7f31140a44a0 2023-12-22T08:44:47.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.527+0000 7f310a7fc640 1 -- 172.21.15.38:0/1699835607 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3104004b80 con 0x7f31140a44a0 2023-12-22T08:44:47.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.528+0000 7f310a7fc640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f30f806a430 0x7f30f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:47.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.528+0000 7f310a7fc640 1 -- 172.21.15.38:0/1699835607 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3104088440 con 0x7f31140a44a0 2023-12-22T08:44:47.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.529+0000 7f3119d8c640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f30f806a430 0x7f30f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:47.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.530+0000 7f3119d8c640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f30f806a430 0x7f30f806c8f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3110006fd0 tx=0x7f3110008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:47.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.532+0000 7f310a7fc640 1 -- 172.21.15.38:0/1699835607 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3104053d20 con 0x7f31140a44a0 2023-12-22T08:44:47.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:47.794+0000 7f311ad8e640 1 -- 172.21.15.38:0/1699835607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f3114061910 con 0x7f31140a44a0 2023-12-22T08:44:48.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.350+0000 7f310a7fc640 1 -- 172.21.15.38:0/1699835607 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v253) v1 ==== 136+0+0 (secure 0 0 0) 0x7f3104057340 con 0x7f31140a44a0 2023-12-22T08:44:48.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.354+0000 7f311ad8e640 1 -- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f30f806a430 msgr2=0x7f30f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:48.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.354+0000 7f311ad8e640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f30f806a430 0x7f30f806c8f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3110006fd0 tx=0x7f3110008040 comp rx=0 tx=0).stop 2023-12-22T08:44:48.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.354+0000 7f311ad8e640 1 -- 172.21.15.38:0/1699835607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31140a44a0 msgr2=0x7f3114153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:48.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.354+0000 7f311ad8e640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31140a44a0 0x7f3114153430 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f310400c3e0 tx=0x7f310400c8a0 comp rx=0 tx=0).stop 2023-12-22T08:44:48.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.354+0000 7f311ad8e640 1 -- 172.21.15.38:0/1699835607 shutdown_connections 2023-12-22T08:44:48.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.354+0000 7f311ad8e640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f311415b420 0x7f3114153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:48.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.354+0000 7f311ad8e640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f30f806a430 0x7f30f806c8f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:48.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.354+0000 7f311ad8e640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31140a44a0 0x7f3114153430 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:48.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.354+0000 7f311ad8e640 1 --2- 172.21.15.38:0/1699835607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3114071000 0x7f31141f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:48.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.354+0000 7f311ad8e640 1 -- 172.21.15.38:0/1699835607 >> 172.21.15.38:0/1699835607 conn(0x7f31140b1f70 msgr2=0x7f311406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:48.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.354+0000 7f311ad8e640 1 -- 172.21.15.38:0/1699835607 shutdown_connections 2023-12-22T08:44:48.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.354+0000 7f311ad8e640 1 -- 172.21.15.38:0/1699835607 wait complete. 2023-12-22T08:44:48.378 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-22T08:44:48.622 INFO:teuthology.orchestra.run.smithi038.stdout:{"osd_objectstore":"memstore"} 2023-12-22T08:44:48.622 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-22T08:44:48.622 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T08:44:48.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.853+0000 7fa465a51640 1 Processor -- start 2023-12-22T08:44:48.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.853+0000 7fa465a51640 1 -- start start 2023-12-22T08:44:48.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.855+0000 7fa465a51640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa46015e870 0x7fa4600ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:48.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.855+0000 7fa465a51640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4600ce4b0 con 0x7fa460070e80 2023-12-22T08:44:48.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.855+0000 7fa465a51640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46015fea0 con 0x7fa46015ec50 2023-12-22T08:44:48.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.855+0000 7fa465a51640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4600cdb80 con 0x7fa46015e870 2023-12-22T08:44:48.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.856+0000 7fa45effd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa46015e870 0x7fa4600ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:48.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.856+0000 7fa45f7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa460070e80 0x7fa46006f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60658/0 (socket says 172.21.15.38:60658) 2023-12-22T08:44:48.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.856+0000 7fa45effd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa46015e870 0x7fa4600ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49124/0 (socket says 172.21.15.38:49124) 2023-12-22T08:44:48.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.856+0000 7fa45f7fe640 1 -- 172.21.15.38:0/4082380723 learned_addr learned my addr 172.21.15.38:0/4082380723 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:48.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.856+0000 7fa45effd640 1 -- 172.21.15.38:0/4082380723 >> v1:172.21.15.89:6789/0 conn(0x7fa46015ec50 legacy=0x7fa460070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:48.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.856+0000 7fa45effd640 1 -- 172.21.15.38:0/4082380723 >> v1:172.21.15.38:6789/0 conn(0x7fa460070e80 legacy=0x7fa46006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:48.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.856+0000 7fa45effd640 1 -- 172.21.15.38:0/4082380723 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4600cde60 con 0x7fa46015e870 2023-12-22T08:44:48.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.856+0000 7fa45e7fc640 1 -- 172.21.15.38:0/4082380723 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753405275 0 0) 0x7fa4600ce4b0 con 0x7fa460070e80 2023-12-22T08:44:48.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.857+0000 7fa45effd640 1 --2- 172.21.15.38:0/4082380723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa46015e870 0x7fa4600ce940 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa4500097a0 tx=0x7fa45002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f0e0e398b72026 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:48.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.858+0000 7fa45e7fc640 1 -- 172.21.15.38:0/4082380723 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450031830 con 0x7fa46015e870 2023-12-22T08:44:48.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.858+0000 7fa45e7fc640 1 -- 172.21.15.38:0/4082380723 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa450031990 con 0x7fa46015e870 2023-12-22T08:44:48.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.858+0000 7fa45e7fc640 1 -- 172.21.15.38:0/4082380723 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450031d20 con 0x7fa46015e870 2023-12-22T08:44:48.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.858+0000 7fa465a51640 1 -- 172.21.15.38:0/4082380723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa46015e870 msgr2=0x7fa4600ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:48.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.858+0000 7fa465a51640 1 --2- 172.21.15.38:0/4082380723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa46015e870 0x7fa4600ce940 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa4500097a0 tx=0x7fa45002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:44:48.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.859+0000 7fa465a51640 1 -- 172.21.15.38:0/4082380723 shutdown_connections 2023-12-22T08:44:48.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.859+0000 7fa465a51640 1 --2- 172.21.15.38:0/4082380723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa46015e870 0x7fa4600ce940 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:48.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.859+0000 7fa465a51640 1 -- 172.21.15.38:0/4082380723 >> 172.21.15.38:0/4082380723 conn(0x7fa4600b20c0 msgr2=0x7fa4600b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:48.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.859+0000 7fa465a51640 1 -- 172.21.15.38:0/4082380723 shutdown_connections 2023-12-22T08:44:48.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.859+0000 7fa465a51640 1 -- 172.21.15.38:0/4082380723 wait complete. 2023-12-22T08:44:48.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.861+0000 7fa465a51640 1 Processor -- start 2023-12-22T08:44:48.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.861+0000 7fa465a51640 1 -- start start 2023-12-22T08:44:48.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.862+0000 7fa465a51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460070e80 0x7fa460146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:48.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.862+0000 7fa465a51640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46015e870 0x7fa46015d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:48.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.862+0000 7fa465a51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa46015ec50 0x7fa460144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:48.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.862+0000 7fa465a51640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46015d7e0 con 0x7fa46015ec50 2023-12-22T08:44:48.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.862+0000 7fa465a51640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa460146820 con 0x7fa460070e80 2023-12-22T08:44:48.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.862+0000 7fa465a51640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa460145c10 con 0x7fa46015e870 2023-12-22T08:44:48.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.862+0000 7fa45f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa46015ec50 0x7fa460144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:48.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.862+0000 7fa45f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa46015ec50 0x7fa460144ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49138/0 (socket says 172.21.15.38:49138) 2023-12-22T08:44:48.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.862+0000 7fa45f7fe640 1 -- 172.21.15.38:0/3227209231 learned_addr learned my addr 172.21.15.38:0/3227209231 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:48.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.862+0000 7fa457fff640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46015e870 0x7fa46015d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:48.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.862+0000 7fa45effd640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460070e80 0x7fa460146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:48.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.862+0000 7fa45f7fe640 1 -- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46015e870 msgr2=0x7fa46015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:48.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.863+0000 7fa45f7fe640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46015e870 0x7fa46015d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:48.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.863+0000 7fa45f7fe640 1 -- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460070e80 msgr2=0x7fa460146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:48.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.863+0000 7fa45f7fe640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460070e80 0x7fa460146cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:48.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.863+0000 7fa45f7fe640 1 -- 172.21.15.38:0/3227209231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa450009400 con 0x7fa46015ec50 2023-12-22T08:44:48.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.863+0000 7fa45f7fe640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa46015ec50 0x7fa460144ee0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c780 tx=0x7fa45800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:48.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.863+0000 7fa45cff9640 1 -- 172.21.15.38:0/3227209231 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800ce90 con 0x7fa46015ec50 2023-12-22T08:44:48.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.863+0000 7fa45cff9640 1 -- 172.21.15.38:0/3227209231 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45800a640 con 0x7fa46015ec50 2023-12-22T08:44:48.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.863+0000 7fa45cff9640 1 -- 172.21.15.38:0/3227209231 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800aa30 con 0x7fa46015ec50 2023-12-22T08:44:48.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.863+0000 7fa465a51640 1 -- 172.21.15.38:0/3227209231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa460145ef0 con 0x7fa46015ec50 2023-12-22T08:44:48.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.863+0000 7fa465a51640 1 -- 172.21.15.38:0/3227209231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4601464b0 con 0x7fa46015ec50 2023-12-22T08:44:48.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.864+0000 7fa465a51640 1 -- 172.21.15.38:0/3227209231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa460061910 con 0x7fa46015ec50 2023-12-22T08:44:48.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.865+0000 7fa45cff9640 1 -- 172.21.15.38:0/3227209231 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa45800ab90 con 0x7fa46015ec50 2023-12-22T08:44:48.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.866+0000 7fa45cff9640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa44006a430 0x7fa44006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:48.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.866+0000 7fa45cff9640 1 -- 172.21.15.38:0/3227209231 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa458087c30 con 0x7fa46015ec50 2023-12-22T08:44:48.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.867+0000 7fa45effd640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa44006a430 0x7fa44006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:48.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.868+0000 7fa45effd640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa44006a430 0x7fa44006c8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa450036000 tx=0x7fa450008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:48.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:48.871+0000 7fa45cff9640 1 -- 172.21.15.38:0/3227209231 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa458053480 con 0x7fa46015ec50 2023-12-22T08:44:49.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.063+0000 7fa465a51640 1 -- 172.21.15.38:0/3227209231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa460146960 con 0x7fa46015ec50 2023-12-22T08:44:49.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.071+0000 7fa45cff9640 1 -- 172.21.15.38:0/3227209231 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa458018020 con 0x7fa46015ec50 2023-12-22T08:44:49.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.073+0000 7fa465a51640 1 -- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa44006a430 msgr2=0x7fa44006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.073+0000 7fa465a51640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa44006a430 0x7fa44006c8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa450036000 tx=0x7fa450008030 comp rx=0 tx=0).stop 2023-12-22T08:44:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.073+0000 7fa465a51640 1 -- 172.21.15.38:0/3227209231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa46015ec50 msgr2=0x7fa460144ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.073+0000 7fa465a51640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa46015ec50 0x7fa460144ee0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c780 tx=0x7fa45800cc40 comp rx=0 tx=0).stop 2023-12-22T08:44:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.074+0000 7fa465a51640 1 -- 172.21.15.38:0/3227209231 shutdown_connections 2023-12-22T08:44:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.074+0000 7fa465a51640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa44006a430 0x7fa44006c8f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.074+0000 7fa465a51640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa46015ec50 0x7fa460144ee0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.074+0000 7fa465a51640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa46015e870 0x7fa46015d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.074+0000 7fa465a51640 1 --2- 172.21.15.38:0/3227209231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa460070e80 0x7fa460146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.074+0000 7fa465a51640 1 -- 172.21.15.38:0/3227209231 >> 172.21.15.38:0/3227209231 conn(0x7fa4600b20c0 msgr2=0x7fa4601549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.074+0000 7fa465a51640 1 -- 172.21.15.38:0/3227209231 shutdown_connections 2023-12-22T08:44:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.074+0000 7fa465a51640 1 -- 172.21.15.38:0/3227209231 wait complete. 2023-12-22T08:44:49.096 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:44:49.096 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:44:49.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:44:49.343 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:44:49.343 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:44:49.343 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:44:49.408 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:44:49.409 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:44:49.409 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:44:49.468 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:44:49.468 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:44:49.468 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:44:49.531 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:44:49.532 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:44:49.532 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:44:49.592 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:44:49.592 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-22T08:44:49.592 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:44:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.829+0000 7f23cbfff640 1 Processor -- start 2023-12-22T08:44:49.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.829+0000 7f23cbfff640 1 -- start start 2023-12-22T08:44:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.829+0000 7f23cbfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc071680 0x7f23cc162f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.829+0000 7f23cbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f23cc0b2a90 0x7f23cc0ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.829+0000 7f23cbfff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23cc0cb1f0 con 0x7f23cc0cadc0 2023-12-22T08:44:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.830+0000 7f23cbfff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23cc162ce0 con 0x7f23cc0b2a90 2023-12-22T08:44:49.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.830+0000 7f23cbfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc162160 con 0x7f23cc071680 2023-12-22T08:44:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.830+0000 7f23cb7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f23cc0cadc0 0x7f23cc06d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60662/0 (socket says 172.21.15.38:60662) 2023-12-22T08:44:49.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.830+0000 7f23cb7fe640 1 -- 172.21.15.38:0/4056001864 learned_addr learned my addr 172.21.15.38:0/4056001864 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.830+0000 7f23caffd640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc071680 0x7f23cc162f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.830+0000 7f23ca7fc640 1 --2- 172.21.15.38:0/4056001864 >> v2:172.21.15.89:3300/0 conn(0x7f23cc0b2a90 0x7f23cc0ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.830+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042526464 0 0) 0x7f23cc0cb1f0 con 0x7f23cc0cadc0 2023-12-22T08:44:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.830+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23b4003520 con 0x7f23cc0cadc0 2023-12-22T08:44:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1062192299 0 0) 0x7f23b4003520 con 0x7f23cc0cadc0 2023-12-22T08:44:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc071680 msgr2=0x7f23cc162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc071680 0x7f23cc162f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 >> v2:172.21.15.89:3300/0 conn(0x7f23cc0b2a90 msgr2=0x7f23cc0ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 --2- 172.21.15.38:0/4056001864 >> v2:172.21.15.89:3300/0 conn(0x7f23cc0b2a90 0x7f23cc0ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc162440 con 0x7f23cc0cadc0 2023-12-22T08:44:49.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f23c4001a10 con 0x7f23cc0cadc0 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 >> v1:172.21.15.38:6789/0 conn(0x7f23cc0cadc0 legacy=0x7f23cc06d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b4003970 0x7f23b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23b40047c0 0x7f23b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc071680 0x7f23b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc162ce0 con 0x7f23b40047c0 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc162160 con 0x7f23b4003970 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b400b980 con 0x7f23cc071680 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23ca7fc640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23b40047c0 0x7f23b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.831+0000 7f23caffd640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b4003970 0x7f23b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.832+0000 7f23cb7fe640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc071680 0x7f23b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.832+0000 7f23ca7fc640 1 -- 172.21.15.38:0/4056001864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc071680 msgr2=0x7f23b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.832+0000 7f23ca7fc640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc071680 0x7f23b4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.832+0000 7f23ca7fc640 1 -- 172.21.15.38:0/4056001864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b4003970 msgr2=0x7f23b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:49.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.832+0000 7f23ca7fc640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b4003970 0x7f23b4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:49.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.832+0000 7f23ca7fc640 1 -- 172.21.15.38:0/4056001864 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b4003520 con 0x7f23b40047c0 2023-12-22T08:44:49.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.832+0000 7f23caffd640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b4003970 0x7f23b4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:49.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.832+0000 7f23cb7fe640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc071680 0x7f23b4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:49.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.833+0000 7f23ca7fc640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23b40047c0 0x7f23b4004c40 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009ac0 tx=0x7f23b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec39fd7b757d3ca5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:49.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.833+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c002c710 con 0x7f23b40047c0 2023-12-22T08:44:49.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.833+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c002c870 con 0x7f23b40047c0 2023-12-22T08:44:49.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.833+0000 7f23c9ffb640 1 -- 172.21.15.38:0/4056001864 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c002cc00 con 0x7f23b40047c0 2023-12-22T08:44:49.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.834+0000 7f23cbfff640 1 -- 172.21.15.38:0/4056001864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23b40047c0 msgr2=0x7f23b4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:49.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.834+0000 7f23cbfff640 1 --2- 172.21.15.38:0/4056001864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23b40047c0 0x7f23b4004c40 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009ac0 tx=0x7f23b40057f0 comp rx=0 tx=0).stop 2023-12-22T08:44:49.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.834+0000 7f23cb7fe640 1 -- 172.21.15.38:0/4056001864 reap_dead start 2023-12-22T08:44:49.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.834+0000 7f23cbfff640 1 -- 172.21.15.38:0/4056001864 shutdown_connections 2023-12-22T08:44:49.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.834+0000 7f23cbfff640 1 -- 172.21.15.38:0/4056001864 >> 172.21.15.38:0/4056001864 conn(0x7f23cc0b1f70 msgr2=0x7f23cc0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:49.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.834+0000 7f23cbfff640 1 -- 172.21.15.38:0/4056001864 shutdown_connections 2023-12-22T08:44:49.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.834+0000 7f23cbfff640 1 -- 172.21.15.38:0/4056001864 wait complete. 2023-12-22T08:44:49.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.836+0000 7f23cbfff640 1 Processor -- start 2023-12-22T08:44:49.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.836+0000 7f23cbfff640 1 -- start start 2023-12-22T08:44:49.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.837+0000 7f23cbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b40047c0 0x7f23cc155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:49.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.837+0000 7f23cbfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc15c610 0x7f23cc15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:49.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.837+0000 7f23cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23cc159270 0x7f23cc1596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:49.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.837+0000 7f23cbfff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc15c1f0 con 0x7f23cc159270 2023-12-22T08:44:49.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.837+0000 7f23cbfff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc159c30 con 0x7f23b40047c0 2023-12-22T08:44:49.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.837+0000 7f23cbfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc15b570 con 0x7f23cc15c610 2023-12-22T08:44:49.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.837+0000 7f23cb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23cc159270 0x7f23cc1596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:49.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.838+0000 7f23cb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23cc159270 0x7f23cc1596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49152/0 (socket says 172.21.15.38:49152) 2023-12-22T08:44:49.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.838+0000 7f23cb7fe640 1 -- 172.21.15.38:0/4060504920 learned_addr learned my addr 172.21.15.38:0/4060504920 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:49.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.838+0000 7f23ca7fc640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc15c610 0x7f23cc15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:49.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.838+0000 7f23caffd640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b40047c0 0x7f23cc155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:49.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.838+0000 7f23cb7fe640 1 -- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc15c610 msgr2=0x7f23cc15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:49.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.838+0000 7f23cb7fe640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc15c610 0x7f23cc15ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:49.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.838+0000 7f23cb7fe640 1 -- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b40047c0 msgr2=0x7f23cc155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:49.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.838+0000 7f23cb7fe640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b40047c0 0x7f23cc155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:49.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.838+0000 7f23cb7fe640 1 -- 172.21.15.38:0/4060504920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc15b850 con 0x7f23cc159270 2023-12-22T08:44:49.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.838+0000 7f23cb7fe640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23cc159270 0x7f23cc1596f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0cb1a0 tx=0x7f23c400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:49.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.839+0000 7f23b3fff640 1 -- 172.21.15.38:0/4060504920 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4004d60 con 0x7f23cc159270 2023-12-22T08:44:49.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.839+0000 7f23b3fff640 1 -- 172.21.15.38:0/4060504920 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c400bb80 con 0x7f23cc159270 2023-12-22T08:44:49.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.839+0000 7f23b3fff640 1 -- 172.21.15.38:0/4060504920 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4007110 con 0x7f23cc159270 2023-12-22T08:44:49.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.839+0000 7f23cbfff640 1 -- 172.21.15.38:0/4060504920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23cc15bb30 con 0x7f23cc159270 2023-12-22T08:44:49.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.839+0000 7f23cbfff640 1 -- 172.21.15.38:0/4060504920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23cc155bb0 con 0x7f23cc159270 2023-12-22T08:44:49.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.840+0000 7f23cbfff640 1 -- 172.21.15.38:0/4060504920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23cc15c330 con 0x7f23cc159270 2023-12-22T08:44:49.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.841+0000 7f23b3fff640 1 -- 172.21.15.38:0/4060504920 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f23c4007270 con 0x7f23cc159270 2023-12-22T08:44:49.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.842+0000 7f23b3fff640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23b806a430 0x7f23b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:49.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.842+0000 7f23b3fff640 1 -- 172.21.15.38:0/4060504920 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f23c4088940 con 0x7f23cc159270 2023-12-22T08:44:49.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.843+0000 7f23caffd640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23b806a430 0x7f23b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:49.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.844+0000 7f23caffd640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23b806a430 0x7f23b806c8f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f23cc15d890 tx=0x7f23bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:49.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:49.846+0000 7f23b3fff640 1 -- 172.21.15.38:0/4060504920 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f23cc15c330 con 0x7f23cc159270 2023-12-22T08:44:50.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.077+0000 7f23cbfff640 1 -- 172.21.15.38:0/4060504920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23cc15c330 con 0x7f23cc159270 2023-12-22T08:44:50.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.078+0000 7f23b3fff640 1 -- 172.21.15.38:0/4060504920 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f23cc15c330 con 0x7f23cc159270 2023-12-22T08:44:50.080 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:50.080 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3287488986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3287488986},{"type":"v1","addr":"172.21.15.89:6836","nonce":3287488986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2154639115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2154639115},{"type":"v1","addr":"172.21.15.89:6837","nonce":2154639115}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/807798598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":807798598},{"type":"v1","addr":"172.21.15.38:6833","nonce":807798598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6357,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/4063341002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":4063341002},{"type":"v1","addr":"172.21.15.38:6835","nonce":4063341002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2023-12-22T08:44:50.080 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2023-12-22T08:44:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.081+0000 7f23cbfff640 1 -- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23b806a430 msgr2=0x7f23b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.081+0000 7f23cbfff640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23b806a430 0x7f23b806c8f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f23cc15d890 tx=0x7f23bc008040 comp rx=0 tx=0).stop 2023-12-22T08:44:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.081+0000 7f23cbfff640 1 -- 172.21.15.38:0/4060504920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23cc159270 msgr2=0x7f23cc1596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.081+0000 7f23cbfff640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23cc159270 0x7f23cc1596f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0cb1a0 tx=0x7f23c400b4a0 comp rx=0 tx=0).stop 2023-12-22T08:44:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.081+0000 7f23cbfff640 1 -- 172.21.15.38:0/4060504920 shutdown_connections 2023-12-22T08:44:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.081+0000 7f23cbfff640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23b806a430 0x7f23b806c8f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.081+0000 7f23cbfff640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23cc159270 0x7f23cc1596f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.081+0000 7f23cbfff640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23cc15c610 0x7f23cc15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.081+0000 7f23cbfff640 1 --2- 172.21.15.38:0/4060504920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23b40047c0 0x7f23cc155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.081+0000 7f23cbfff640 1 -- 172.21.15.38:0/4060504920 >> 172.21.15.38:0/4060504920 conn(0x7f23cc0b1f70 msgr2=0x7f23cc0ae6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:50.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.081+0000 7f23cbfff640 1 -- 172.21.15.38:0/4060504920 shutdown_connections 2023-12-22T08:44:50.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.081+0000 7f23cbfff640 1 -- 172.21.15.38:0/4060504920 wait complete. 2023-12-22T08:44:50.104 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T08:44:50.104 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T08:44:50.105 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T08:44:50.105 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:44:50.105 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T08:44:50.105 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T08:44:50.105 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T08:44:50.105 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:44:50.105 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T08:44:50.106 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T08:44:50.106 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T08:44:50.106 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:44:50.106 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T08:44:50.106 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T08:44:50.106 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T08:44:50.106 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:44:50.125 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T08:44:50.125 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T08:44:50.129 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T08:44:50.129 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T08:44:50.140 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T08:44:50.140 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T08:44:50.141 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T08:44:50.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T08:44:50.176 INFO:tasks.ceph.mds.a:Started 2023-12-22T08:44:50.177 DEBUG:teuthology.parallel:result is None 2023-12-22T08:44:50.184 INFO:tasks.ceph.mds.c:Started 2023-12-22T08:44:50.185 DEBUG:teuthology.parallel:result is None 2023-12-22T08:44:50.189 INFO:tasks.ceph.mds.b:Started 2023-12-22T08:44:50.189 DEBUG:teuthology.parallel:result is None 2023-12-22T08:44:50.196 INFO:tasks.ceph.mds.d:Started 2023-12-22T08:44:50.196 DEBUG:teuthology.parallel:result is None 2023-12-22T08:44:50.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-22T08:44:50.341 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:44:50.343 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:44:50.357 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-22T08:44:50.358 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-12-22T08:44:50.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.392+0000 7fdd58f3c640 1 Processor -- start 2023-12-22T08:44:50.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.392+0000 7fdd58f3c640 1 -- start start 2023-12-22T08:44:50.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.393+0000 7fdd58f3c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdd5415e740 0x7fdd5415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:50.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.393+0000 7fdd58f3c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 0x7fdd540b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:50.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.393+0000 7fdd58f3c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd540b4210 con 0x7fdd540b3dc0 2023-12-22T08:44:50.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.393+0000 7fdd58f3c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5406e650 con 0x7fdd5415e740 2023-12-22T08:44:50.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.393+0000 7fdd58f3c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5415eb20 con 0x7fdd5406ca50 2023-12-22T08:44:50.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd52d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdd540b3dc0 0x7fdd54161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60672/0 (socket says 172.21.15.38:60672) 2023-12-22T08:44:50.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd52d9d640 1 -- 172.21.15.38:0/131552189 learned_addr learned my addr 172.21.15.38:0/131552189 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd51d9b640 1 --2- 172.21.15.38:0/131552189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 0x7fdd540b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5259c640 1 --2- 172.21.15.38:0/131552189 >> v2:172.21.15.89:3300/0 conn(0x7fdd5415e740 0x7fdd5415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183474565 0 0) 0x7fdd4c001490 con 0x7fdd540b3dc0 2023-12-22T08:44:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd3c003520 con 0x7fdd540b3dc0 2023-12-22T08:44:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1748494818 0 0) 0x7fdd3c003520 con 0x7fdd540b3dc0 2023-12-22T08:44:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 msgr2=0x7fdd540b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5159a640 1 --2- 172.21.15.38:0/131552189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 0x7fdd540b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 >> v2:172.21.15.89:3300/0 conn(0x7fdd5415e740 msgr2=0x7fdd5415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5159a640 1 --2- 172.21.15.38:0/131552189 >> v2:172.21.15.89:3300/0 conn(0x7fdd5415e740 0x7fdd5415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54070770 con 0x7fdd540b3dc0 2023-12-22T08:44:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fdd4c001b80 con 0x7fdd540b3dc0 2023-12-22T08:44:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 >> v1:172.21.15.38:6789/0 conn(0x7fdd540b3dc0 legacy=0x7fdd54161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5159a640 1 --2- 172.21.15.38:0/131552189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 0x7fdd3c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5159a640 1 --2- 172.21.15.38:0/131552189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd3c003ef0 0x7fdd3c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.394+0000 7fdd5159a640 1 --2- 172.21.15.38:0/131552189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd3c004d00 0x7fdd3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.395+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5406e650 con 0x7fdd3c004d00 2023-12-22T08:44:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.395+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5415eb20 con 0x7fdd3c003ef0 2023-12-22T08:44:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.395+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c00ba60 con 0x7fdd5406ca50 2023-12-22T08:44:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.395+0000 7fdd52d9d640 1 --2- 172.21.15.38:0/131552189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd3c004d00 0x7fdd3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.395+0000 7fdd51d9b640 1 --2- 172.21.15.38:0/131552189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd3c003ef0 0x7fdd3c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.395+0000 7fdd5259c640 1 --2- 172.21.15.38:0/131552189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 0x7fdd3c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:50.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.395+0000 7fdd5259c640 1 -- 172.21.15.38:0/131552189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd3c003ef0 msgr2=0x7fdd3c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:50.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.395+0000 7fdd5259c640 1 --2- 172.21.15.38:0/131552189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd3c003ef0 0x7fdd3c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:50.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.395+0000 7fdd5259c640 1 -- 172.21.15.38:0/131552189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd3c004d00 msgr2=0x7fdd3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:50.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.395+0000 7fdd5259c640 1 --2- 172.21.15.38:0/131552189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd3c004d00 0x7fdd3c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.395+0000 7fdd5259c640 1 -- 172.21.15.38:0/131552189 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c003520 con 0x7fdd5406ca50 2023-12-22T08:44:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.396+0000 7fdd5259c640 1 --2- 172.21.15.38:0/131552189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 0x7fdd3c003970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009ac0 tx=0x7fdd3c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed30d75c8e565bac server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.397+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4402c710 con 0x7fdd5406ca50 2023-12-22T08:44:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.397+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4402c870 con 0x7fdd5406ca50 2023-12-22T08:44:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.397+0000 7fdd5159a640 1 -- 172.21.15.38:0/131552189 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4402cc00 con 0x7fdd5406ca50 2023-12-22T08:44:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.397+0000 7fdd58f3c640 1 -- 172.21.15.38:0/131552189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 msgr2=0x7fdd3c003970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.397+0000 7fdd58f3c640 1 --2- 172.21.15.38:0/131552189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 0x7fdd3c003970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009ac0 tx=0x7fdd3c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:44:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.397+0000 7fdd52d9d640 1 -- 172.21.15.38:0/131552189 reap_dead start 2023-12-22T08:44:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.397+0000 7fdd58f3c640 1 -- 172.21.15.38:0/131552189 shutdown_connections 2023-12-22T08:44:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.397+0000 7fdd58f3c640 1 -- 172.21.15.38:0/131552189 >> 172.21.15.38:0/131552189 conn(0x7fdd540cfea0 msgr2=0x7fdd540d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.397+0000 7fdd58f3c640 1 -- 172.21.15.38:0/131552189 shutdown_connections 2023-12-22T08:44:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.397+0000 7fdd58f3c640 1 -- 172.21.15.38:0/131552189 wait complete. 2023-12-22T08:44:50.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.399+0000 7fdd58f3c640 1 Processor -- start 2023-12-22T08:44:50.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.399+0000 7fdd58f3c640 1 -- start start 2023-12-22T08:44:50.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.400+0000 7fdd58f3c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 0x7fdd5413c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:50.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.400+0000 7fdd58f3c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd5414fb40 0x7fdd54161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:50.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.400+0000 7fdd58f3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd54151080 0x7fdd541f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:50.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.400+0000 7fdd58f3c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5413c830 con 0x7fdd5414fb40 2023-12-22T08:44:50.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.400+0000 7fdd58f3c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5414ffe0 con 0x7fdd54151080 2023-12-22T08:44:50.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.400+0000 7fdd58f3c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd541502c0 con 0x7fdd5406ca50 2023-12-22T08:44:50.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.401+0000 7fdd51d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd5414fb40 0x7fdd54161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:50.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.401+0000 7fdd51d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd5414fb40 0x7fdd54161190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49206/0 (socket says 172.21.15.38:49206) 2023-12-22T08:44:50.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.401+0000 7fdd51d9b640 1 -- 172.21.15.38:0/1333963102 learned_addr learned my addr 172.21.15.38:0/1333963102 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:50.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.401+0000 7fdd5259c640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 0x7fdd5413c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:50.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.401+0000 7fdd52d9d640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd54151080 0x7fdd541f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:50.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.401+0000 7fdd51d9b640 1 -- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 msgr2=0x7fdd5413c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:50.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.401+0000 7fdd51d9b640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 0x7fdd5413c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:50.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.401+0000 7fdd51d9b640 1 -- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd54151080 msgr2=0x7fdd541f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:50.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.401+0000 7fdd51d9b640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd54151080 0x7fdd541f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:50.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.401+0000 7fdd51d9b640 1 -- 172.21.15.38:0/1333963102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd541505a0 con 0x7fdd5414fb40 2023-12-22T08:44:50.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.402+0000 7fdd51d9b640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd5414fb40 0x7fdd54161190 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdd48011960 tx=0x7fdd48011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:50.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.402+0000 7fdd42ffd640 1 -- 172.21.15.38:0/1333963102 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800fa90 con 0x7fdd5414fb40 2023-12-22T08:44:50.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.402+0000 7fdd42ffd640 1 -- 172.21.15.38:0/1333963102 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4800fbf0 con 0x7fdd5414fb40 2023-12-22T08:44:50.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.402+0000 7fdd42ffd640 1 -- 172.21.15.38:0/1333963102 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48014440 con 0x7fdd5414fb40 2023-12-22T08:44:50.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.402+0000 7fdd58f3c640 1 -- 172.21.15.38:0/1333963102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd54150880 con 0x7fdd5414fb40 2023-12-22T08:44:50.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.402+0000 7fdd58f3c640 1 -- 172.21.15.38:0/1333963102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd540b8990 con 0x7fdd5414fb40 2023-12-22T08:44:50.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.403+0000 7fdd58f3c640 1 -- 172.21.15.38:0/1333963102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd54061910 con 0x7fdd5414fb40 2023-12-22T08:44:50.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.404+0000 7fdd42ffd640 1 -- 172.21.15.38:0/1333963102 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdd480145a0 con 0x7fdd5414fb40 2023-12-22T08:44:50.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.405+0000 7fdd42ffd640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdd3406a430 0x7fdd3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:50.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.405+0000 7fdd42ffd640 1 -- 172.21.15.38:0/1333963102 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdd48088da0 con 0x7fdd5414fb40 2023-12-22T08:44:50.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.406+0000 7fdd5259c640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdd3406a430 0x7fdd3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:50.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.406+0000 7fdd5259c640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdd3406a430 0x7fdd3406c8f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdd44036000 tx=0x7fdd44030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:50.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.410+0000 7fdd42ffd640 1 -- 172.21.15.38:0/1333963102 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdd480546a0 con 0x7fdd5414fb40 2023-12-22T08:44:50.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:50.616+0000 7fdd58f3c640 1 -- 172.21.15.38:0/1333963102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdd54161d30 con 0x7fdd5414fb40 2023-12-22T08:44:51.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.391+0000 7fdd42ffd640 1 -- 172.21.15.38:0/1333963102 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v85) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdd48022080 con 0x7fdd5414fb40 2023-12-22T08:44:51.392 INFO:teuthology.orchestra.run.smithi038.stderr: removed all blocklist entries 2023-12-22T08:44:51.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.395+0000 7fdd58f3c640 1 -- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdd3406a430 msgr2=0x7fdd3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:51.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.395+0000 7fdd58f3c640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdd3406a430 0x7fdd3406c8f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdd44036000 tx=0x7fdd44030000 comp rx=0 tx=0).stop 2023-12-22T08:44:51.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.395+0000 7fdd58f3c640 1 -- 172.21.15.38:0/1333963102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd5414fb40 msgr2=0x7fdd54161190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:51.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.395+0000 7fdd58f3c640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd5414fb40 0x7fdd54161190 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdd48011960 tx=0x7fdd48011e20 comp rx=0 tx=0).stop 2023-12-22T08:44:51.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.396+0000 7fdd58f3c640 1 -- 172.21.15.38:0/1333963102 shutdown_connections 2023-12-22T08:44:51.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.396+0000 7fdd58f3c640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd54151080 0x7fdd541f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.396+0000 7fdd58f3c640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdd3406a430 0x7fdd3406c8f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.396+0000 7fdd58f3c640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd5414fb40 0x7fdd54161190 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.396+0000 7fdd58f3c640 1 --2- 172.21.15.38:0/1333963102 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd5406ca50 0x7fdd5413c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.396+0000 7fdd58f3c640 1 -- 172.21.15.38:0/1333963102 >> 172.21.15.38:0/1333963102 conn(0x7fdd540cfea0 msgr2=0x7fdd5415f670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.396+0000 7fdd58f3c640 1 -- 172.21.15.38:0/1333963102 shutdown_connections 2023-12-22T08:44:51.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.396+0000 7fdd58f3c640 1 -- 172.21.15.38:0/1333963102 wait complete. 2023-12-22T08:44:51.419 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T08:44:51.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.637+0000 7f3fc3118640 1 Processor -- start 2023-12-22T08:44:51.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.637+0000 7f3fc3118640 1 -- start start 2023-12-22T08:44:51.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.639+0000 7f3fc3118640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3fbc144d10 0x7f3fbc0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:51.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.639+0000 7f3fc3118640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fbc0cc670 0x7f3fbc0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:51.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.639+0000 7f3fc3118640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3fbc0b2590 0x7f3fbc15f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:51.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.639+0000 7f3fc3118640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fbc0b2a20 con 0x7f3fbc0b2590 2023-12-22T08:44:51.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.639+0000 7f3fc3118640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fbc1450f0 con 0x7f3fbc144d10 2023-12-22T08:44:51.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.639+0000 7f3fc3118640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0ce010 con 0x7f3fbc0cc670 2023-12-22T08:44:51.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.639+0000 7f3fc16b5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3fbc0b2590 0x7f3fbc15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:51.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.639+0000 7f3fc16b5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3fbc0b2590 0x7f3fbc15f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59116/0 (socket says 172.21.15.38:59116) 2023-12-22T08:44:51.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.639+0000 7f3fc16b5640 1 -- 172.21.15.38:0/3687080212 learned_addr learned my addr 172.21.15.38:0/3687080212 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:51.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.639+0000 7f3fbbfff640 1 --2- 172.21.15.38:0/3687080212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fbc0cc670 0x7f3fbc0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:51.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.639+0000 7f3fc0eb4640 1 --2- 172.21.15.38:0/3687080212 >> v2:172.21.15.89:3300/0 conn(0x7f3fbc144d10 0x7f3fbc0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:51.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.640+0000 7f3fc16b5640 1 -- 172.21.15.38:0/3687080212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fbc0cc670 msgr2=0x7f3fbc0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:51.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.640+0000 7f3fc16b5640 1 --2- 172.21.15.38:0/3687080212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fbc0cc670 0x7f3fbc0b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.640+0000 7f3fc16b5640 1 -- 172.21.15.38:0/3687080212 >> v2:172.21.15.89:3300/0 conn(0x7f3fbc144d10 msgr2=0x7f3fbc0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:51.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.640+0000 7f3fc16b5640 1 --2- 172.21.15.38:0/3687080212 >> v2:172.21.15.89:3300/0 conn(0x7f3fbc144d10 0x7f3fbc0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.640+0000 7f3fc16b5640 1 -- 172.21.15.38:0/3687080212 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc0ce2f0 con 0x7f3fbc0b2590 2023-12-22T08:44:51.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.641+0000 7f3fc16b5640 1 --2- 172.21.15.38:0/3687080212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fbc0b2590 0x7f3fbc15f040 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0cfe00 tx=0x7f3fb402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0639b0cd524e8d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:51.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.642+0000 7f3fbb7fe640 1 -- 172.21.15.38:0/3687080212 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4031870 con 0x7f3fbc0b2590 2023-12-22T08:44:51.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.642+0000 7f3fbb7fe640 1 -- 172.21.15.38:0/3687080212 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb40319d0 con 0x7f3fbc0b2590 2023-12-22T08:44:51.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.642+0000 7f3fbb7fe640 1 -- 172.21.15.38:0/3687080212 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4031d60 con 0x7f3fbc0b2590 2023-12-22T08:44:51.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.642+0000 7f3fc3118640 1 -- 172.21.15.38:0/3687080212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fbc0b2590 msgr2=0x7f3fbc15f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:51.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.642+0000 7f3fc3118640 1 --2- 172.21.15.38:0/3687080212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fbc0b2590 0x7f3fbc15f040 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0cfe00 tx=0x7f3fb402b910 comp rx=0 tx=0).stop 2023-12-22T08:44:51.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.642+0000 7f3fc3118640 1 -- 172.21.15.38:0/3687080212 shutdown_connections 2023-12-22T08:44:51.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.642+0000 7f3fc3118640 1 --2- 172.21.15.38:0/3687080212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fbc0b2590 0x7f3fbc15f040 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.642+0000 7f3fc3118640 1 --2- 172.21.15.38:0/3687080212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fbc0cc670 0x7f3fbc0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.642+0000 7f3fc3118640 1 --2- 172.21.15.38:0/3687080212 >> v2:172.21.15.89:3300/0 conn(0x7f3fbc144d10 0x7f3fbc0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.642+0000 7f3fc3118640 1 -- 172.21.15.38:0/3687080212 >> 172.21.15.38:0/3687080212 conn(0x7f3fbc0cf070 msgr2=0x7f3fbc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:51.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.643+0000 7f3fc3118640 1 -- 172.21.15.38:0/3687080212 shutdown_connections 2023-12-22T08:44:51.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.643+0000 7f3fc3118640 1 -- 172.21.15.38:0/3687080212 wait complete. 2023-12-22T08:44:51.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.644+0000 7f3fc3118640 1 Processor -- start 2023-12-22T08:44:51.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.645+0000 7f3fc3118640 1 -- start start 2023-12-22T08:44:51.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.645+0000 7f3fc3118640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fbc0b2590 0x7f3fbc13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:51.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.645+0000 7f3fc3118640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fbc144d10 0x7f3fbc06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:51.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.645+0000 7f3fc3118640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fbc06cc10 0x7f3fbc0afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:51.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.646+0000 7f3fc3118640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc1378b0 con 0x7f3fbc06cc10 2023-12-22T08:44:51.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.646+0000 7f3fc3118640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc137b90 con 0x7f3fbc144d10 2023-12-22T08:44:51.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.646+0000 7f3fc3118640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc137e70 con 0x7f3fbc0b2590 2023-12-22T08:44:51.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.646+0000 7f3fc16b5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fbc06cc10 0x7f3fbc0afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:51.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.646+0000 7f3fc16b5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fbc06cc10 0x7f3fbc0afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59126/0 (socket says 172.21.15.38:59126) 2023-12-22T08:44:51.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.646+0000 7f3fc16b5640 1 -- 172.21.15.38:0/3178120224 learned_addr learned my addr 172.21.15.38:0/3178120224 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:51.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.646+0000 7f3fbbfff640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fbc144d10 0x7f3fbc06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:51.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.646+0000 7f3fc0eb4640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fbc0b2590 0x7f3fbc13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:51.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.646+0000 7f3fc16b5640 1 -- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fbc0b2590 msgr2=0x7f3fbc13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:51.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.646+0000 7f3fc16b5640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fbc0b2590 0x7f3fbc13c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.646+0000 7f3fc16b5640 1 -- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fbc144d10 msgr2=0x7f3fbc06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:51.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.646+0000 7f3fc16b5640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fbc144d10 0x7f3fbc06dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.646+0000 7f3fc16b5640 1 -- 172.21.15.38:0/3178120224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb40094d0 con 0x7f3fbc06cc10 2023-12-22T08:44:51.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.647+0000 7f3fc16b5640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fbc06cc10 0x7f3fbc0afb70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3fb402b950 tx=0x7f3fb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:51.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.647+0000 7f3fb97fa640 1 -- 172.21.15.38:0/3178120224 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb403ac60 con 0x7f3fbc06cc10 2023-12-22T08:44:51.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.647+0000 7f3fb97fa640 1 -- 172.21.15.38:0/3178120224 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb403ade0 con 0x7f3fbc06cc10 2023-12-22T08:44:51.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.647+0000 7f3fb97fa640 1 -- 172.21.15.38:0/3178120224 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4044630 con 0x7f3fbc06cc10 2023-12-22T08:44:51.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.647+0000 7f3fc3118640 1 -- 172.21.15.38:0/3178120224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc138150 con 0x7f3fbc06cc10 2023-12-22T08:44:51.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.647+0000 7f3fc3118640 1 -- 172.21.15.38:0/3178120224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fbc06e140 con 0x7f3fbc06cc10 2023-12-22T08:44:51.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.648+0000 7f3fc3118640 1 -- 172.21.15.38:0/3178120224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fbc0ce890 con 0x7f3fbc06cc10 2023-12-22T08:44:51.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.649+0000 7f3fb97fa640 1 -- 172.21.15.38:0/3178120224 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3fb4044790 con 0x7f3fbc06cc10 2023-12-22T08:44:51.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.650+0000 7f3fb97fa640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fa806a460 0x7f3fa806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:51.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.650+0000 7f3fb97fa640 1 -- 172.21.15.38:0/3178120224 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3fb402d040 con 0x7f3fbc06cc10 2023-12-22T08:44:51.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.651+0000 7f3fc0eb4640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fa806a460 0x7f3fa806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:51.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.652+0000 7f3fc0eb4640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fa806a460 0x7f3fa806c920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0099c0 tx=0x7f3fac003990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:51.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.655+0000 7f3fb97fa640 1 -- 172.21.15.38:0/3178120224 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3fbc0ce890 con 0x7f3fbc06cc10 2023-12-22T08:44:51.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.916+0000 7f3fc3118640 1 -- 172.21.15.38:0/3178120224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3fbc138670 con 0x7f3fbc06cc10 2023-12-22T08:44:51.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.917+0000 7f3fb97fa640 1 -- 172.21.15.38:0/3178120224 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3fbc138670 con 0x7f3fbc06cc10 2023-12-22T08:44:51.918 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:51.918 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:44:51.918 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_dump": [ 2023-12-22T08:44:51.918 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.918 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.a", 2023-12-22T08:44:51.918 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl57dkCBAAeliJIPc49iRBk2mp8WYv8A==", 2023-12-22T08:44:51.918 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.918 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:44:51.918 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:44:51.918 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:44:51.918 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.918 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.b", 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl0C0+KhAAkCsjfyn19nOz1xTyhZkbPQ==", 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.c", 2023-12-22T08:44:51.919 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl7poXGhAA+ZSohyj4dAOs6B5dZKTLAg==", 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.d", 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4VlTBuoOhAArKX4AiOQRGawIyAnInIhCg==", 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:44:51.920 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.0", 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VlnVQaChAAxfWmPqwo5D4qBYkAP/6dHQ==", 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.1", 2023-12-22T08:44:51.921 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4Vll2dlGxAAbqx4rxnz4FWIKl9OGqcwtw==", 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.2", 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VljQ3HLRAAfyrtqD4n6Da8Rl/6UKmv7g==", 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.922 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.3", 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBCS4VlOat4AxAAIkAGRvGGWrrwx/ppMbexWQ==", 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.4", 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlwg7TDxAA+L504F+Hw/6FTJ63cV3ZXg==", 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.923 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.5", 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx8zgHxAALBDm/sSYqw/fn4nLNQbu4A==", 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.6", 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx5OdLxAAaMP09nYI3HKiuhPARgnCOw==", 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:44:51.924 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.7", 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBHS4Vl/15bBBAA4maatkcgA0axcZY/L9r/IA==", 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.0", 2023-12-22T08:44:51.925 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlgDspDhAA0TWGbk4AbuOhCNotPej29A==", 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow r", 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.1", 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlwSk/JhAAM3faae43p4/gw9BmyxLpJA==", 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:44:51.926 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.2", 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VliOHMGhAARaM8FC/0maNMToLGhBR4Tg==", 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.3", 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlV/MVMRAAyN1643IAOTLOLuz4DqMZ8A==", 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:44:51.927 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.admin", 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA2S4VlBhogNhAACBsSGP7kmhCSn+XAKkvgKQ==", 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.928 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.x", 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlTHG+NhAAUNkVtrDuoK2OEsy1HHkt2A==", 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.y", 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlED5ALBAAComDf9woKBt/IXcez+Udmg==", 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:44:51.929 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:44:51.930 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:44:51.930 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.930 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:51.930 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:44:51.930 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:44:51.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.919+0000 7f3fc3118640 1 -- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fa806a460 msgr2=0x7f3fa806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.919+0000 7f3fc3118640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fa806a460 0x7f3fa806c920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0099c0 tx=0x7f3fac003990 comp rx=0 tx=0).stop 2023-12-22T08:44:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.919+0000 7f3fc3118640 1 -- 172.21.15.38:0/3178120224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fbc06cc10 msgr2=0x7f3fbc0afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.919+0000 7f3fc3118640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fbc06cc10 0x7f3fbc0afb70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3fb402b950 tx=0x7f3fb40046c0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.919+0000 7f3fc3118640 1 -- 172.21.15.38:0/3178120224 shutdown_connections 2023-12-22T08:44:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.919+0000 7f3fc3118640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fa806a460 0x7f3fa806c920 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.919+0000 7f3fc3118640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fbc06cc10 0x7f3fbc0afb70 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.919+0000 7f3fc3118640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fbc144d10 0x7f3fbc06dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.919+0000 7f3fc3118640 1 --2- 172.21.15.38:0/3178120224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fbc0b2590 0x7f3fbc13c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.919+0000 7f3fc3118640 1 -- 172.21.15.38:0/3178120224 >> 172.21.15.38:0/3178120224 conn(0x7f3fbc0cf070 msgr2=0x7f3fbc0b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.919+0000 7f3fc3118640 1 -- 172.21.15.38:0/3178120224 shutdown_connections 2023-12-22T08:44:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:51.920+0000 7f3fc3118640 1 -- 172.21.15.38:0/3178120224 wait complete. 2023-12-22T08:44:51.937 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:44:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.157+0000 7feb9b37e640 1 Processor -- start 2023-12-22T08:44:52.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.157+0000 7feb9b37e640 1 -- start start 2023-12-22T08:44:52.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.159+0000 7feb9b37e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feb94071000 0x7feb94165f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:52.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.159+0000 7feb9b37e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb940cdae0 con 0x7feb9415b420 2023-12-22T08:44:52.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.159+0000 7feb9b37e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9415b800 con 0x7feb940a44a0 2023-12-22T08:44:52.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.159+0000 7feb9b37e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb940cdd30 con 0x7feb94071000 2023-12-22T08:44:52.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.159+0000 7feb9a37c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7feb9415b420 0x7feb9406d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36836/0 (socket says 172.21.15.38:36836) 2023-12-22T08:44:52.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.160+0000 7feb9a37c640 1 -- 172.21.15.38:0/3185341718 learned_addr learned my addr 172.21.15.38:0/3185341718 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:52.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.160+0000 7feb9ab7d640 1 --2- 172.21.15.38:0/3185341718 >> v2:172.21.15.38:3300/0 conn(0x7feb94071000 0x7feb94165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:52.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.160+0000 7feb9ab7d640 1 -- 172.21.15.38:0/3185341718 >> v1:172.21.15.89:6789/0 conn(0x7feb940a44a0 legacy=0x7feb940708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:52.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.160+0000 7feb9ab7d640 1 -- 172.21.15.38:0/3185341718 >> v1:172.21.15.38:6789/0 conn(0x7feb9415b420 legacy=0x7feb9406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:52.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.160+0000 7feb9ab7d640 1 -- 172.21.15.38:0/3185341718 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940ce010 con 0x7feb94071000 2023-12-22T08:44:52.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.161+0000 7feb9ab7d640 1 --2- 172.21.15.38:0/3185341718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb94071000 0x7feb94165f50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009d90 tx=0x7feb8c02bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87db93bfa2160ac1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:52.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.162+0000 7feb9937a640 1 -- 172.21.15.38:0/3185341718 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c02ccf0 con 0x7feb94071000 2023-12-22T08:44:52.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.162+0000 7feb9937a640 1 -- 172.21.15.38:0/3185341718 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c02ce50 con 0x7feb94071000 2023-12-22T08:44:52.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.162+0000 7feb9937a640 1 -- 172.21.15.38:0/3185341718 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c034660 con 0x7feb94071000 2023-12-22T08:44:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.162+0000 7feb9b37e640 1 -- 172.21.15.38:0/3185341718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb94071000 msgr2=0x7feb94165f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.162+0000 7feb9b37e640 1 --2- 172.21.15.38:0/3185341718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb94071000 0x7feb94165f50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009d90 tx=0x7feb8c02bf40 comp rx=0 tx=0).stop 2023-12-22T08:44:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.162+0000 7feb9b37e640 1 -- 172.21.15.38:0/3185341718 shutdown_connections 2023-12-22T08:44:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.162+0000 7feb9b37e640 1 --2- 172.21.15.38:0/3185341718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb94071000 0x7feb94165f50 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.162+0000 7feb9b37e640 1 -- 172.21.15.38:0/3185341718 >> 172.21.15.38:0/3185341718 conn(0x7feb940b1f70 msgr2=0x7feb940b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.163+0000 7feb9b37e640 1 -- 172.21.15.38:0/3185341718 shutdown_connections 2023-12-22T08:44:52.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.163+0000 7feb9b37e640 1 -- 172.21.15.38:0/3185341718 wait complete. 2023-12-22T08:44:52.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.164+0000 7feb9b37e640 1 Processor -- start 2023-12-22T08:44:52.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.164+0000 7feb9b37e640 1 -- start start 2023-12-22T08:44:52.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.165+0000 7feb9b37e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb94071000 0x7feb941595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:52.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.165+0000 7feb9b37e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb940a44a0 0x7feb940a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:52.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.165+0000 7feb9b37e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb9415b420 0x7feb941f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:52.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.165+0000 7feb9b37e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb94159af0 con 0x7feb94071000 2023-12-22T08:44:52.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.165+0000 7feb9b37e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb940a23a0 con 0x7feb9415b420 2023-12-22T08:44:52.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.165+0000 7feb9b37e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb940a2680 con 0x7feb940a44a0 2023-12-22T08:44:52.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.166+0000 7feb9a37c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb94071000 0x7feb941595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:52.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.166+0000 7feb9a37c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb94071000 0x7feb941595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59146/0 (socket says 172.21.15.38:59146) 2023-12-22T08:44:52.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.166+0000 7feb9a37c640 1 -- 172.21.15.38:0/2283648734 learned_addr learned my addr 172.21.15.38:0/2283648734 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:52.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.166+0000 7feb9ab7d640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb9415b420 0x7feb941f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:52.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.166+0000 7feb99b7b640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb940a44a0 0x7feb940a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:52.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.166+0000 7feb9a37c640 1 -- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb940a44a0 msgr2=0x7feb940a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:52.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.166+0000 7feb9a37c640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb940a44a0 0x7feb940a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.166+0000 7feb9a37c640 1 -- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb9415b420 msgr2=0x7feb941f2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:52.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.166+0000 7feb9a37c640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb9415b420 0x7feb941f2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.166+0000 7feb9a37c640 1 -- 172.21.15.38:0/2283648734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c009a70 con 0x7feb94071000 2023-12-22T08:44:52.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.167+0000 7feb9a37c640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb94071000 0x7feb941595b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7feb9000c480 tx=0x7feb9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:52.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.167+0000 7feb8affd640 1 -- 172.21.15.38:0/2283648734 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90005ce0 con 0x7feb94071000 2023-12-22T08:44:52.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.167+0000 7feb8affd640 1 -- 172.21.15.38:0/2283648734 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90005e40 con 0x7feb94071000 2023-12-22T08:44:52.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.167+0000 7feb8affd640 1 -- 172.21.15.38:0/2283648734 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900072f0 con 0x7feb94071000 2023-12-22T08:44:52.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.167+0000 7feb9b37e640 1 -- 172.21.15.38:0/2283648734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb940a2960 con 0x7feb94071000 2023-12-22T08:44:52.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.167+0000 7feb9b37e640 1 -- 172.21.15.38:0/2283648734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb940a2f20 con 0x7feb94071000 2023-12-22T08:44:52.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.168+0000 7feb9b37e640 1 -- 172.21.15.38:0/2283648734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb940a3110 con 0x7feb94071000 2023-12-22T08:44:52.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.170+0000 7feb8affd640 1 -- 172.21.15.38:0/2283648734 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feb90007510 con 0x7feb94071000 2023-12-22T08:44:52.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.170+0000 7feb8affd640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb7806a430 0x7feb7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:52.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.171+0000 7feb8affd640 1 -- 172.21.15.38:0/2283648734 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feb90087af0 con 0x7feb94071000 2023-12-22T08:44:52.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.171+0000 7feb99b7b640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb7806a430 0x7feb7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:52.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.172+0000 7feb99b7b640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb7806a430 0x7feb7806c8f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7feb940caf30 tx=0x7feb84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:52.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.175+0000 7feb8affd640 1 -- 172.21.15.38:0/2283648734 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feb900534d0 con 0x7feb94071000 2023-12-22T08:44:52.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.374+0000 7feb9b37e640 1 -- 172.21.15.38:0/2283648734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb94061910 con 0x7feb94071000 2023-12-22T08:44:52.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.376+0000 7feb8affd640 1 -- 172.21.15.38:0/2283648734 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+12341 (secure 0 0 0) 0x7feb90017090 con 0x7feb94071000 2023-12-22T08:44:52.377 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:52.377 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":85,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:44:51.384080+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:44:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.378+0000 7feb9b37e640 1 -- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb7806a430 msgr2=0x7feb7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.378+0000 7feb9b37e640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb7806a430 0x7feb7806c8f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7feb940caf30 tx=0x7feb84009040 comp rx=0 tx=0).stop 2023-12-22T08:44:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.379+0000 7feb9b37e640 1 -- 172.21.15.38:0/2283648734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb94071000 msgr2=0x7feb941595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.379+0000 7feb9b37e640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb94071000 0x7feb941595b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7feb9000c480 tx=0x7feb9000c940 comp rx=0 tx=0).stop 2023-12-22T08:44:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.379+0000 7feb9b37e640 1 -- 172.21.15.38:0/2283648734 shutdown_connections 2023-12-22T08:44:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.379+0000 7feb9b37e640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb9415b420 0x7feb941f2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.379+0000 7feb9b37e640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb940a44a0 0x7feb940a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.379+0000 7feb9b37e640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feb7806a430 0x7feb7806c8f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.379+0000 7feb9b37e640 1 --2- 172.21.15.38:0/2283648734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb94071000 0x7feb941595b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.379+0000 7feb9b37e640 1 -- 172.21.15.38:0/2283648734 >> 172.21.15.38:0/2283648734 conn(0x7feb940b1f70 msgr2=0x7feb940cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:52.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.379+0000 7feb9b37e640 1 -- 172.21.15.38:0/2283648734 shutdown_connections 2023-12-22T08:44:52.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.379+0000 7feb9b37e640 1 -- 172.21.15.38:0/2283648734 wait complete. 2023-12-22T08:44:52.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:44:52.400 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:44:52.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.625+0000 7f285ef1c640 1 Processor -- start 2023-12-22T08:44:52.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.625+0000 7f285ef1c640 1 -- start start 2023-12-22T08:44:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.626+0000 7f285ef1c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2858071080 0x7f28580d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.626+0000 7f285ef1c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815d5a0 0x7f28580d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.626+0000 7f285ef1c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285815de50 con 0x7f285815d1c0 2023-12-22T08:44:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.626+0000 7f285ef1c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28580d0dd0 con 0x7f2858071080 2023-12-22T08:44:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.626+0000 7f285ef1c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28580d10b0 con 0x7f285815d5a0 2023-12-22T08:44:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.627+0000 7f285df1a640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f285815d1c0 0x7f2858070970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36846/0 (socket says 172.21.15.38:36846) 2023-12-22T08:44:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.627+0000 7f285df1a640 1 -- 172.21.15.38:0/1096622898 learned_addr learned my addr 172.21.15.38:0/1096622898 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.627+0000 7f285d719640 1 --2- 172.21.15.38:0/1096622898 >> v2:172.21.15.38:3300/0 conn(0x7f2858071080 0x7f28580d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.627+0000 7f285e71b640 1 --2- 172.21.15.38:0/1096622898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815d5a0 0x7f28580d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.627+0000 7f285d719640 1 -- 172.21.15.38:0/1096622898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815d5a0 msgr2=0x7f28580d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.627+0000 7f285cf18640 1 -- 172.21.15.38:0/1096622898 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901225395 0 0) 0x7f285815de50 con 0x7f285815d1c0 2023-12-22T08:44:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.627+0000 7f285d719640 1 --2- 172.21.15.38:0/1096622898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815d5a0 0x7f28580d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.627+0000 7f285d719640 1 -- 172.21.15.38:0/1096622898 >> v1:172.21.15.38:6789/0 conn(0x7f285815d1c0 legacy=0x7f2858070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.627+0000 7f285d719640 1 -- 172.21.15.38:0/1096622898 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285815dae0 con 0x7f2858071080 2023-12-22T08:44:52.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.629+0000 7f285d719640 1 --2- 172.21.15.38:0/1096622898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2858071080 0x7f28580d0060 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f28480097a0 tx=0x7f284802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78923217aa1b9c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:52.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.629+0000 7f285cf18640 1 -- 172.21.15.38:0/1096622898 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284802d040 con 0x7f2858071080 2023-12-22T08:44:52.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.629+0000 7f285cf18640 1 -- 172.21.15.38:0/1096622898 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2848031810 con 0x7f2858071080 2023-12-22T08:44:52.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.629+0000 7f285cf18640 1 -- 172.21.15.38:0/1096622898 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848031ba0 con 0x7f2858071080 2023-12-22T08:44:52.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.629+0000 7f285ef1c640 1 -- 172.21.15.38:0/1096622898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2858071080 msgr2=0x7f28580d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:52.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.629+0000 7f285ef1c640 1 --2- 172.21.15.38:0/1096622898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2858071080 0x7f28580d0060 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f28480097a0 tx=0x7f284802b8b0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.630+0000 7f285ef1c640 1 -- 172.21.15.38:0/1096622898 shutdown_connections 2023-12-22T08:44:52.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.630+0000 7f285ef1c640 1 --2- 172.21.15.38:0/1096622898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815d5a0 0x7f28580d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.630+0000 7f285ef1c640 1 --2- 172.21.15.38:0/1096622898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2858071080 0x7f28580d0060 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.630+0000 7f285ef1c640 1 -- 172.21.15.38:0/1096622898 >> 172.21.15.38:0/1096622898 conn(0x7f285806bf90 msgr2=0x7f285806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:52.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.630+0000 7f285ef1c640 1 -- 172.21.15.38:0/1096622898 shutdown_connections 2023-12-22T08:44:52.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.630+0000 7f285ef1c640 1 -- 172.21.15.38:0/1096622898 wait complete. 2023-12-22T08:44:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.631+0000 7f285ef1c640 1 Processor -- start 2023-12-22T08:44:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.632+0000 7f285ef1c640 1 -- start start 2023-12-22T08:44:52.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.632+0000 7f285ef1c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858071080 0x7f28580b8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.632+0000 7f285ef1c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f285815d1c0 0x7f2858150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.632+0000 7f285ef1c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815d5a0 0x7f28580b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.632+0000 7f285ef1c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580b5a70 con 0x7f285815d1c0 2023-12-22T08:44:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.632+0000 7f285ef1c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580b6310 con 0x7f2858071080 2023-12-22T08:44:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.632+0000 7f285ef1c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2858150bc0 con 0x7f285815d5a0 2023-12-22T08:44:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.633+0000 7f285d719640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f285815d1c0 0x7f2858150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.633+0000 7f285d719640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f285815d1c0 0x7f2858150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59168/0 (socket says 172.21.15.38:59168) 2023-12-22T08:44:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.633+0000 7f285d719640 1 -- 172.21.15.38:0/1842718170 learned_addr learned my addr 172.21.15.38:0/1842718170 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.633+0000 7f285df1a640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858071080 0x7f28580b8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.633+0000 7f285e71b640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815d5a0 0x7f28580b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.633+0000 7f285d719640 1 -- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815d5a0 msgr2=0x7f28580b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.633+0000 7f285d719640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815d5a0 0x7f28580b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.633+0000 7f285d719640 1 -- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858071080 msgr2=0x7f28580b8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.633+0000 7f285d719640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858071080 0x7f28580b8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.633+0000 7f285d719640 1 -- 172.21.15.38:0/1842718170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2848009400 con 0x7f285815d1c0 2023-12-22T08:44:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.633+0000 7f285df1a640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858071080 0x7f28580b8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.634+0000 7f285d719640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f285815d1c0 0x7f2858150680 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f284802bec0 tx=0x7f28480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.634+0000 7f284e7fc640 1 -- 172.21.15.38:0/1842718170 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284803ad60 con 0x7f285815d1c0 2023-12-22T08:44:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.634+0000 7f284e7fc640 1 -- 172.21.15.38:0/1842718170 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28480423f0 con 0x7f285815d1c0 2023-12-22T08:44:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.634+0000 7f285ef1c640 1 -- 172.21.15.38:0/1842718170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28580b9520 con 0x7f285815d1c0 2023-12-22T08:44:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.634+0000 7f284e7fc640 1 -- 172.21.15.38:0/1842718170 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28480427a0 con 0x7f285815d1c0 2023-12-22T08:44:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.634+0000 7f285ef1c640 1 -- 172.21.15.38:0/1842718170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28580b5fa0 con 0x7f285815d1c0 2023-12-22T08:44:52.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.635+0000 7f285ef1c640 1 -- 172.21.15.38:0/1842718170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28580b64a0 con 0x7f285815d1c0 2023-12-22T08:44:52.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.636+0000 7f284e7fc640 1 -- 172.21.15.38:0/1842718170 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2848042900 con 0x7f285815d1c0 2023-12-22T08:44:52.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.637+0000 7f284e7fc640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f283c06a460 0x7f283c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:52.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.637+0000 7f284e7fc640 1 -- 172.21.15.38:0/1842718170 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f28480aa630 con 0x7f285815d1c0 2023-12-22T08:44:52.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.638+0000 7f285df1a640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f283c06a460 0x7f283c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:52.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.639+0000 7f285df1a640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f283c06a460 0x7f283c06c920 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2854000f60 tx=0x7f2854009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:52.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.641+0000 7f284e7fc640 1 -- 172.21.15.38:0/1842718170 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2848075ed0 con 0x7f285815d1c0 2023-12-22T08:44:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.835+0000 7f285ef1c640 1 -- 172.21.15.38:0/1842718170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2858061910 con 0x7f285815d1c0 2023-12-22T08:44:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.836+0000 7f284e7fc640 1 -- 172.21.15.38:0/1842718170 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28480794f0 con 0x7f285815d1c0 2023-12-22T08:44:52.836 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:44:52.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.838+0000 7f285ef1c640 1 -- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f283c06a460 msgr2=0x7f283c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:52.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.838+0000 7f285ef1c640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f283c06a460 0x7f283c06c920 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2854000f60 tx=0x7f2854009040 comp rx=0 tx=0).stop 2023-12-22T08:44:52.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.838+0000 7f285ef1c640 1 -- 172.21.15.38:0/1842718170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f285815d1c0 msgr2=0x7f2858150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.838+0000 7f285ef1c640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f285815d1c0 0x7f2858150680 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f284802bec0 tx=0x7f28480046c0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.838+0000 7f285ef1c640 1 -- 172.21.15.38:0/1842718170 shutdown_connections 2023-12-22T08:44:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.838+0000 7f285ef1c640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f285815d5a0 0x7f28580b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.838+0000 7f285ef1c640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f283c06a460 0x7f283c06c920 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.838+0000 7f285ef1c640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f285815d1c0 0x7f2858150680 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.838+0000 7f285ef1c640 1 --2- 172.21.15.38:0/1842718170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2858071080 0x7f28580b8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.838+0000 7f285ef1c640 1 -- 172.21.15.38:0/1842718170 >> 172.21.15.38:0/1842718170 conn(0x7f285806bf90 msgr2=0x7f28580b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.838+0000 7f285ef1c640 1 -- 172.21.15.38:0/1842718170 shutdown_connections 2023-12-22T08:44:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:52.839+0000 7f285ef1c640 1 -- 172.21.15.38:0/1842718170 wait complete. 2023-12-22T08:44:52.860 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T08:44:53.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.074+0000 7ff001c56640 1 Processor -- start 2023-12-22T08:44:53.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.075+0000 7ff001c56640 1 -- start start 2023-12-22T08:44:53.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.076+0000 7ff001c56640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feffc15e740 0x7feffc15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:53.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.076+0000 7ff001c56640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feffc0b3f90 0x7feffc070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:53.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.077+0000 7ff001c56640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feffc15eb20 con 0x7feffc06ca50 2023-12-22T08:44:53.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.077+0000 7ff001c56640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc06e650 con 0x7feffc15e740 2023-12-22T08:44:53.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.077+0000 7ff001c56640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc070770 con 0x7feffc0b3f90 2023-12-22T08:44:53.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.077+0000 7feffb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feffc15e740 0x7feffc15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:53.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.077+0000 7feffb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feffc15e740 0x7feffc15db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59180/0 (socket says 172.21.15.38:59180) 2023-12-22T08:44:53.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.077+0000 7feffb7fe640 1 -- 172.21.15.38:0/1492922871 learned_addr learned my addr 172.21.15.38:0/1492922871 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:53.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.077+0000 7feffb7fe640 1 -- 172.21.15.38:0/1492922871 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feffc0b3f90 msgr2=0x7feffc070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:53.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.077+0000 7feffb7fe640 1 --2- 172.21.15.38:0/1492922871 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feffc0b3f90 0x7feffc070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.077+0000 7feffb7fe640 1 -- 172.21.15.38:0/1492922871 >> v1:172.21.15.89:6789/0 conn(0x7feffc06ca50 legacy=0x7feffc0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:53.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.077+0000 7feffb7fe640 1 -- 172.21.15.38:0/1492922871 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc06cec0 con 0x7feffc15e740 2023-12-22T08:44:53.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.078+0000 7feffb7fe640 1 --2- 172.21.15.38:0/1492922871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feffc15e740 0x7feffc15db30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fefec009e50 tx=0x7fefec02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3638873499b5116 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:53.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.079+0000 7feffa7fc640 1 -- 172.21.15.38:0/1492922871 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec02c960 con 0x7feffc15e740 2023-12-22T08:44:53.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.079+0000 7feffa7fc640 1 -- 172.21.15.38:0/1492922871 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec02cac0 con 0x7feffc15e740 2023-12-22T08:44:53.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.079+0000 7feffa7fc640 1 -- 172.21.15.38:0/1492922871 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec02ce50 con 0x7feffc15e740 2023-12-22T08:44:53.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.079+0000 7ff001c56640 1 -- 172.21.15.38:0/1492922871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feffc15e740 msgr2=0x7feffc15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:53.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.079+0000 7ff001c56640 1 --2- 172.21.15.38:0/1492922871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feffc15e740 0x7feffc15db30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fefec009e50 tx=0x7fefec02bdc0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.080+0000 7ff001c56640 1 -- 172.21.15.38:0/1492922871 shutdown_connections 2023-12-22T08:44:53.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.080+0000 7ff001c56640 1 --2- 172.21.15.38:0/1492922871 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feffc0b3f90 0x7feffc070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.080+0000 7ff001c56640 1 --2- 172.21.15.38:0/1492922871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feffc15e740 0x7feffc15db30 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.080+0000 7ff001c56640 1 -- 172.21.15.38:0/1492922871 >> 172.21.15.38:0/1492922871 conn(0x7feffc0cfea0 msgr2=0x7feffc0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:53.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.080+0000 7ff001c56640 1 -- 172.21.15.38:0/1492922871 shutdown_connections 2023-12-22T08:44:53.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.080+0000 7ff001c56640 1 -- 172.21.15.38:0/1492922871 wait complete. 2023-12-22T08:44:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.081+0000 7ff001c56640 1 Processor -- start 2023-12-22T08:44:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.082+0000 7ff001c56640 1 -- start start 2023-12-22T08:44:53.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7ff001c56640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feffc06ca50 0x7feffc157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:53.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7ff001c56640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feffc0b3f90 0x7feffc148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:53.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7ff001c56640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feffc15e740 0x7feffc1f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:53.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7ff001c56640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc0b5e20 con 0x7feffc15e740 2023-12-22T08:44:53.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7ff001c56640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc156750 con 0x7feffc0b3f90 2023-12-22T08:44:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7ff001c56640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc156a30 con 0x7feffc06ca50 2023-12-22T08:44:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7feffbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feffc15e740 0x7feffc1f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7feffbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feffc15e740 0x7feffc1f6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59182/0 (socket says 172.21.15.38:59182) 2023-12-22T08:44:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7feffbfff640 1 -- 172.21.15.38:0/3128838933 learned_addr learned my addr 172.21.15.38:0/3128838933 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7feffaffd640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feffc0b3f90 0x7feffc148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7feffb7fe640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feffc06ca50 0x7feffc157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7feffbfff640 1 -- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feffc06ca50 msgr2=0x7feffc157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7feffbfff640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feffc06ca50 0x7feffc157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7feffbfff640 1 -- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feffc0b3f90 msgr2=0x7feffc148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7feffbfff640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feffc0b3f90 0x7feffc148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7feffbfff640 1 -- 172.21.15.38:0/3128838933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec009b30 con 0x7feffc15e740 2023-12-22T08:44:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.083+0000 7feffb7fe640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feffc06ca50 0x7feffc157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.084+0000 7feffbfff640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feffc15e740 0x7feffc1f6330 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7feff400b3f0 tx=0x7feff400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:53.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.084+0000 7fefe3fff640 1 -- 172.21.15.38:0/3128838933 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4011830 con 0x7feffc15e740 2023-12-22T08:44:53.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.084+0000 7fefe3fff640 1 -- 172.21.15.38:0/3128838933 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff4011990 con 0x7feffc15e740 2023-12-22T08:44:53.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.084+0000 7fefe3fff640 1 -- 172.21.15.38:0/3128838933 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4011d40 con 0x7feffc15e740 2023-12-22T08:44:53.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.084+0000 7ff001c56640 1 -- 172.21.15.38:0/3128838933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc156d10 con 0x7feffc15e740 2023-12-22T08:44:53.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.084+0000 7ff001c56640 1 -- 172.21.15.38:0/3128838933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc149180 con 0x7feffc15e740 2023-12-22T08:44:53.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.086+0000 7ff001c56640 1 -- 172.21.15.38:0/3128838933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc156f00 con 0x7feffc15e740 2023-12-22T08:44:53.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.087+0000 7fefe3fff640 1 -- 172.21.15.38:0/3128838933 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feff401a400 con 0x7feffc15e740 2023-12-22T08:44:53.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.088+0000 7fefe3fff640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fefe806a430 0x7fefe806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:53.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.088+0000 7fefe3fff640 1 -- 172.21.15.38:0/3128838933 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feff4088820 con 0x7feffc15e740 2023-12-22T08:44:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.088+0000 7feffb7fe640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fefe806a430 0x7fefe806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.089+0000 7feffb7fe640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fefe806a430 0x7fefe806c8f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fefec035000 tx=0x7fefec030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:53.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.092+0000 7fefe3fff640 1 -- 172.21.15.38:0/3128838933 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feff40540c0 con 0x7feffc15e740 2023-12-22T08:44:53.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.285+0000 7ff001c56640 1 -- 172.21.15.38:0/3128838933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feffc061910 con 0x7feffc15e740 2023-12-22T08:44:53.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.286+0000 7fefe3fff640 1 -- 172.21.15.38:0/3128838933 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v85) v1 ==== 84+0+65 (secure 0 0 0) 0x7feff4015090 con 0x7feffc15e740 2023-12-22T08:44:53.288 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:53.288 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-12-22T08:44:53.288 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:44:53.288 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-12-22T08:44:53.288 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-12-22T08:44:53.288 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:44:53.289 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-12-22T08:44:53.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.289+0000 7ff001c56640 1 -- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fefe806a430 msgr2=0x7fefe806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:53.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.289+0000 7ff001c56640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fefe806a430 0x7fefe806c8f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fefec035000 tx=0x7fefec030000 comp rx=0 tx=0).stop 2023-12-22T08:44:53.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.289+0000 7ff001c56640 1 -- 172.21.15.38:0/3128838933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feffc15e740 msgr2=0x7feffc1f6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:53.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.289+0000 7ff001c56640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feffc15e740 0x7feffc1f6330 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7feff400b3f0 tx=0x7feff400b8b0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.289+0000 7ff001c56640 1 -- 172.21.15.38:0/3128838933 shutdown_connections 2023-12-22T08:44:53.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.289+0000 7ff001c56640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fefe806a430 0x7fefe806c8f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.289+0000 7ff001c56640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feffc15e740 0x7feffc1f6330 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.289+0000 7ff001c56640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feffc0b3f90 0x7feffc148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.289+0000 7ff001c56640 1 --2- 172.21.15.38:0/3128838933 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feffc06ca50 0x7feffc157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.289+0000 7ff001c56640 1 -- 172.21.15.38:0/3128838933 >> 172.21.15.38:0/3128838933 conn(0x7feffc0cfea0 msgr2=0x7feffc0d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:53.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.289+0000 7ff001c56640 1 -- 172.21.15.38:0/3128838933 shutdown_connections 2023-12-22T08:44:53.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.289+0000 7ff001c56640 1 -- 172.21.15.38:0/3128838933 wait complete. 2023-12-22T08:44:53.309 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T08:44:53.309 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T08:44:53.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.537+0000 7f94189c8640 1 Processor -- start 2023-12-22T08:44:53.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.538+0000 7f94189c8640 1 -- start start 2023-12-22T08:44:53.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.539+0000 7f94189c8640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f94140ae460 0x7f9414070400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:53.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.539+0000 7f94189c8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94140ae8f0 con 0x7f94140adfb0 2023-12-22T08:44:53.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.539+0000 7f94189c8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941415ca20 con 0x7f941415b370 2023-12-22T08:44:53.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.539+0000 7f94189c8640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941415b750 con 0x7f94140ae460 2023-12-22T08:44:53.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.540+0000 7f940bfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f94140adfb0 0x7f941406fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36852/0 (socket says 172.21.15.38:36852) 2023-12-22T08:44:53.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.540+0000 7f940bfff640 1 -- 172.21.15.38:0/2691715526 learned_addr learned my addr 172.21.15.38:0/2691715526 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:53.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.540+0000 7f941359e640 1 --2- 172.21.15.38:0/2691715526 >> v2:172.21.15.38:3300/0 conn(0x7f94140ae460 0x7f9414070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:53.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.540+0000 7f941259c640 1 -- 172.21.15.38:0/2691715526 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542876352 0 0) 0x7f94140ae8f0 con 0x7f94140adfb0 2023-12-22T08:44:53.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.540+0000 7f941259c640 1 -- 172.21.15.38:0/2691715526 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9400003520 con 0x7f94140adfb0 2023-12-22T08:44:53.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.540+0000 7f941359e640 1 -- 172.21.15.38:0/2691715526 >> v1:172.21.15.89:6789/0 conn(0x7f941415b370 legacy=0x7f941406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:53.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.541+0000 7f941359e640 1 -- 172.21.15.38:0/2691715526 >> v1:172.21.15.38:6789/0 conn(0x7f94140adfb0 legacy=0x7f941406fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:53.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.541+0000 7f941359e640 1 -- 172.21.15.38:0/2691715526 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941406dc20 con 0x7f94140ae460 2023-12-22T08:44:53.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.542+0000 7f941359e640 1 --2- 172.21.15.38:0/2691715526 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94140ae460 0x7f9414070400 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f940c009d90 tx=0x7f940c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea92ee267e5a4d61 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:53.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.542+0000 7f941259c640 1 -- 172.21.15.38:0/2691715526 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c02cd00 con 0x7f94140ae460 2023-12-22T08:44:53.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.542+0000 7f941259c640 1 -- 172.21.15.38:0/2691715526 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c02ce60 con 0x7f94140ae460 2023-12-22T08:44:53.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.542+0000 7f941259c640 1 -- 172.21.15.38:0/2691715526 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c034660 con 0x7f94140ae460 2023-12-22T08:44:53.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.543+0000 7f94189c8640 1 -- 172.21.15.38:0/2691715526 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94140ae460 msgr2=0x7f9414070400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:53.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.543+0000 7f94189c8640 1 --2- 172.21.15.38:0/2691715526 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94140ae460 0x7f9414070400 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f940c009d90 tx=0x7f940c02bf50 comp rx=0 tx=0).stop 2023-12-22T08:44:53.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.543+0000 7f94189c8640 1 -- 172.21.15.38:0/2691715526 shutdown_connections 2023-12-22T08:44:53.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.543+0000 7f94189c8640 1 --2- 172.21.15.38:0/2691715526 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94140ae460 0x7f9414070400 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.543+0000 7f94189c8640 1 -- 172.21.15.38:0/2691715526 >> 172.21.15.38:0/2691715526 conn(0x7f94140b1110 msgr2=0x7f94140b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:53.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.543+0000 7f94189c8640 1 -- 172.21.15.38:0/2691715526 shutdown_connections 2023-12-22T08:44:53.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.543+0000 7f94189c8640 1 -- 172.21.15.38:0/2691715526 wait complete. 2023-12-22T08:44:53.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.545+0000 7f94189c8640 1 Processor -- start 2023-12-22T08:44:53.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.545+0000 7f94189c8640 1 -- start start 2023-12-22T08:44:53.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.546+0000 7f94189c8640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140adfb0 0x7f94141511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:53.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.546+0000 7f94189c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94140ae460 0x7f9414149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:53.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.546+0000 7f94189c8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f941415b370 0x7f9414149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.546+0000 7f94189c8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94141523a0 con 0x7f941415b370 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.546+0000 7f94189c8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94140acd40 con 0x7f94140ae460 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.546+0000 7f94189c8640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94140ad020 con 0x7f94140adfb0 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.546+0000 7f941359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f941415b370 0x7f9414149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.546+0000 7f941359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f941415b370 0x7f9414149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59202/0 (socket says 172.21.15.38:59202) 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.546+0000 7f941359e640 1 -- 172.21.15.38:0/1686106289 learned_addr learned my addr 172.21.15.38:0/1686106289 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.547+0000 7f940bfff640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94140ae460 0x7f9414149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.547+0000 7f9412d9d640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140adfb0 0x7f94141511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.547+0000 7f941359e640 1 -- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140adfb0 msgr2=0x7f94141511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.547+0000 7f941359e640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140adfb0 0x7f94141511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.547+0000 7f941359e640 1 -- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94140ae460 msgr2=0x7f9414149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.547+0000 7f941359e640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94140ae460 0x7f9414149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.547+0000 7f941359e640 1 -- 172.21.15.38:0/1686106289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c009a70 con 0x7f941415b370 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.547+0000 7f940bfff640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94140ae460 0x7f9414149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.547+0000 7f9412d9d640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140adfb0 0x7f94141511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.547+0000 7f941359e640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f941415b370 0x7f9414149870 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f940c009d90 tx=0x7f940c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.547+0000 7f940b7fe640 1 -- 172.21.15.38:0/1686106289 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c03d600 con 0x7f941415b370 2023-12-22T08:44:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.548+0000 7f940b7fe640 1 -- 172.21.15.38:0/1686106289 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c03d780 con 0x7f941415b370 2023-12-22T08:44:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.548+0000 7f940b7fe640 1 -- 172.21.15.38:0/1686106289 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c03db30 con 0x7f941415b370 2023-12-22T08:44:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.548+0000 7f94189c8640 1 -- 172.21.15.38:0/1686106289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94140ad300 con 0x7f941415b370 2023-12-22T08:44:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.548+0000 7f94189c8640 1 -- 172.21.15.38:0/1686106289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94140ad8c0 con 0x7f941415b370 2023-12-22T08:44:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.549+0000 7f94189c8640 1 -- 172.21.15.38:0/1686106289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94140adab0 con 0x7f941415b370 2023-12-22T08:44:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.550+0000 7f940b7fe640 1 -- 172.21.15.38:0/1686106289 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f940c03b040 con 0x7f941415b370 2023-12-22T08:44:53.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.551+0000 7f940b7fe640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f93f406a480 0x7f93f406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:53.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.551+0000 7f940b7fe640 1 -- 172.21.15.38:0/1686106289 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f940c0aaa30 con 0x7f941415b370 2023-12-22T08:44:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.551+0000 7f9412d9d640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f93f406a480 0x7f93f406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.553+0000 7f9412d9d640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f93f406a480 0x7f93f406c940 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9404000f60 tx=0x7f9404009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:53.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.556+0000 7f940b7fe640 1 -- 172.21.15.38:0/1686106289 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f940c076450 con 0x7f941415b370 2023-12-22T08:44:53.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:53.749+0000 7f94189c8640 1 -- 172.21.15.38:0/1686106289 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f941406f4c0 con 0x7f941415b370 2023-12-22T08:44:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.408+0000 7f940b7fe640 1 -- 172.21.15.38:0/1686106289 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v86) v1 ==== 138+0+0 (secure 0 0 0) 0x7f940c0390b0 con 0x7f941415b370 2023-12-22T08:44:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-12-22T08:44:54.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.414+0000 7f94189c8640 1 -- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f93f406a480 msgr2=0x7f93f406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:54.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.414+0000 7f94189c8640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f93f406a480 0x7f93f406c940 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9404000f60 tx=0x7f9404009040 comp rx=0 tx=0).stop 2023-12-22T08:44:54.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.414+0000 7f94189c8640 1 -- 172.21.15.38:0/1686106289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f941415b370 msgr2=0x7f9414149870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:54.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.414+0000 7f94189c8640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f941415b370 0x7f9414149870 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f940c009d90 tx=0x7f940c004a40 comp rx=0 tx=0).stop 2023-12-22T08:44:54.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.415+0000 7f94189c8640 1 -- 172.21.15.38:0/1686106289 shutdown_connections 2023-12-22T08:44:54.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.415+0000 7f94189c8640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f93f406a480 0x7f93f406c940 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:54.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.415+0000 7f94189c8640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f941415b370 0x7f9414149870 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:54.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.415+0000 7f94189c8640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94140ae460 0x7f9414149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:54.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.415+0000 7f94189c8640 1 --2- 172.21.15.38:0/1686106289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94140adfb0 0x7f94141511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:54.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.415+0000 7f94189c8640 1 -- 172.21.15.38:0/1686106289 >> 172.21.15.38:0/1686106289 conn(0x7f94140b1110 msgr2=0x7f9414154800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:54.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.416+0000 7f94189c8640 1 -- 172.21.15.38:0/1686106289 shutdown_connections 2023-12-22T08:44:54.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.417+0000 7f94189c8640 1 -- 172.21.15.38:0/1686106289 wait complete. 2023-12-22T08:44:54.441 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T08:44:54.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.669+0000 7f44d1f92640 1 Processor -- start 2023-12-22T08:44:54.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.670+0000 7f44d1f92640 1 -- start start 2023-12-22T08:44:54.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.671+0000 7f44d1f92640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f44cc15e740 0x7f44cc15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:54.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.671+0000 7f44d1f92640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44cc15eb20 con 0x7f44cc06ca50 2023-12-22T08:44:54.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.671+0000 7f44d1f92640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44cc070770 con 0x7f44cc0b3f90 2023-12-22T08:44:54.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.671+0000 7f44d1f92640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc06e650 con 0x7f44cc15e740 2023-12-22T08:44:54.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.672+0000 7f44cb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f44cc15e740 0x7f44cc15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:54.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.672+0000 7f44cb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f44cc15e740 0x7f44cc15db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59210/0 (socket says 172.21.15.38:59210) 2023-12-22T08:44:54.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.672+0000 7f44cb7fe640 1 -- 172.21.15.38:0/1410182443 learned_addr learned my addr 172.21.15.38:0/1410182443 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:54.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.672+0000 7f44cb7fe640 1 -- 172.21.15.38:0/1410182443 >> v1:172.21.15.89:6789/0 conn(0x7f44cc0b3f90 legacy=0x7f44cc070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:54.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.672+0000 7f44cb7fe640 1 -- 172.21.15.38:0/1410182443 >> v1:172.21.15.38:6789/0 conn(0x7f44cc06ca50 legacy=0x7f44cc0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:54.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.672+0000 7f44cb7fe640 1 -- 172.21.15.38:0/1410182443 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc06cec0 con 0x7f44cc15e740 2023-12-22T08:44:54.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.673+0000 7f44cb7fe640 1 --2- 172.21.15.38:0/1410182443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44cc15e740 0x7f44cc15db30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009e50 tx=0x7f44bc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cdea0ac44b0529 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:54.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.674+0000 7f44ca7fc640 1 -- 172.21.15.38:0/1410182443 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc02c9f0 con 0x7f44cc15e740 2023-12-22T08:44:54.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.674+0000 7f44ca7fc640 1 -- 172.21.15.38:0/1410182443 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc02cb50 con 0x7f44cc15e740 2023-12-22T08:44:54.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.674+0000 7f44ca7fc640 1 -- 172.21.15.38:0/1410182443 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0343f0 con 0x7f44cc15e740 2023-12-22T08:44:54.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.675+0000 7f44d1f92640 1 -- 172.21.15.38:0/1410182443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44cc15e740 msgr2=0x7f44cc15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:54.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.675+0000 7f44d1f92640 1 --2- 172.21.15.38:0/1410182443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44cc15e740 0x7f44cc15db30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009e50 tx=0x7f44bc02be50 comp rx=0 tx=0).stop 2023-12-22T08:44:54.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.675+0000 7f44d1f92640 1 -- 172.21.15.38:0/1410182443 shutdown_connections 2023-12-22T08:44:54.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.675+0000 7f44d1f92640 1 --2- 172.21.15.38:0/1410182443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44cc15e740 0x7f44cc15db30 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:54.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.675+0000 7f44d1f92640 1 -- 172.21.15.38:0/1410182443 >> 172.21.15.38:0/1410182443 conn(0x7f44cc0cfea0 msgr2=0x7f44cc0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:54.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.675+0000 7f44d1f92640 1 -- 172.21.15.38:0/1410182443 shutdown_connections 2023-12-22T08:44:54.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.675+0000 7f44d1f92640 1 -- 172.21.15.38:0/1410182443 wait complete. 2023-12-22T08:44:54.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.677+0000 7f44d1f92640 1 Processor -- start 2023-12-22T08:44:54.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.677+0000 7f44d1f92640 1 -- start start 2023-12-22T08:44:54.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.678+0000 7f44d1f92640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44cc06ca50 0x7f44cc1f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:54.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.678+0000 7f44d1f92640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc0b3f90 0x7f44cc148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:54.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.678+0000 7f44d1f92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44cc15e740 0x7f44cc0d24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:54.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.678+0000 7f44d1f92640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc1587f0 con 0x7f44cc06ca50 2023-12-22T08:44:54.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.678+0000 7f44d1f92640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc158540 con 0x7f44cc15e740 2023-12-22T08:44:54.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.678+0000 7f44d1f92640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc15ad90 con 0x7f44cc0b3f90 2023-12-22T08:44:54.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.678+0000 7f44cb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44cc06ca50 0x7f44cc1f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:54.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.678+0000 7f44cb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44cc06ca50 0x7f44cc1f37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59226/0 (socket says 172.21.15.38:59226) 2023-12-22T08:44:54.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.678+0000 7f44cb7fe640 1 -- 172.21.15.38:0/1327831176 learned_addr learned my addr 172.21.15.38:0/1327831176 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:54.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.678+0000 7f44caffd640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc0b3f90 0x7f44cc148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.679+0000 7f44cbfff640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44cc15e740 0x7f44cc0d24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.679+0000 7f44cb7fe640 1 -- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc0b3f90 msgr2=0x7f44cc148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.679+0000 7f44cb7fe640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc0b3f90 0x7f44cc148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.679+0000 7f44cb7fe640 1 -- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44cc15e740 msgr2=0x7f44cc0d24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.679+0000 7f44cb7fe640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44cc15e740 0x7f44cc0d24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.679+0000 7f44cb7fe640 1 -- 172.21.15.38:0/1327831176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc009b30 con 0x7f44cc06ca50 2023-12-22T08:44:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.679+0000 7f44cb7fe640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44cc06ca50 0x7f44cc1f37b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f44bc036040 tx=0x7f44bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.679+0000 7f44c3fff640 1 -- 172.21.15.38:0/1327831176 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc03e450 con 0x7f44cc06ca50 2023-12-22T08:44:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.679+0000 7f44c3fff640 1 -- 172.21.15.38:0/1327831176 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc03e5f0 con 0x7f44cc06ca50 2023-12-22T08:44:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.679+0000 7f44c3fff640 1 -- 172.21.15.38:0/1327831176 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc03e9a0 con 0x7f44cc06ca50 2023-12-22T08:44:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.679+0000 7f44d1f92640 1 -- 172.21.15.38:0/1327831176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44cc1f3cf0 con 0x7f44cc06ca50 2023-12-22T08:44:54.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.680+0000 7f44d1f92640 1 -- 172.21.15.38:0/1327831176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44cc15a740 con 0x7f44cc06ca50 2023-12-22T08:44:54.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.681+0000 7f44d1f92640 1 -- 172.21.15.38:0/1327831176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44cc061910 con 0x7f44cc06ca50 2023-12-22T08:44:54.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.682+0000 7f44c3fff640 1 -- 172.21.15.38:0/1327831176 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f44bc03eb00 con 0x7f44cc06ca50 2023-12-22T08:44:54.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.683+0000 7f44c3fff640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f44ac06a430 0x7f44ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:54.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.683+0000 7f44c3fff640 1 -- 172.21.15.38:0/1327831176 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f44bc0ab700 con 0x7f44cc06ca50 2023-12-22T08:44:54.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.684+0000 7f44caffd640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f44ac06a430 0x7f44ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:54.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.685+0000 7f44caffd640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f44ac06a430 0x7f44ac06c8f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0cf730 tx=0x7f44b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:54.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.688+0000 7f44c3fff640 1 -- 172.21.15.38:0/1327831176 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f44bc076ee0 con 0x7f44cc06ca50 2023-12-22T08:44:54.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:54.891+0000 7f44d1f92640 1 -- 172.21.15.38:0/1327831176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f44cc0cf7d0 con 0x7f44cc06ca50 2023-12-22T08:44:55.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.433+0000 7f44c3fff640 1 -- 172.21.15.38:0/1327831176 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v87) v1 ==== 170+0+0 (secure 0 0 0) 0x7f44bc03edb0 con 0x7f44cc06ca50 2023-12-22T08:44:55.437 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-12-22T08:44:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.448+0000 7f44d1f92640 1 -- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f44ac06a430 msgr2=0x7f44ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.448+0000 7f44d1f92640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f44ac06a430 0x7f44ac06c8f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0cf730 tx=0x7f44b4009040 comp rx=0 tx=0).stop 2023-12-22T08:44:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.448+0000 7f44d1f92640 1 -- 172.21.15.38:0/1327831176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44cc06ca50 msgr2=0x7f44cc1f37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.448+0000 7f44d1f92640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44cc06ca50 0x7f44cc1f37b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f44bc036040 tx=0x7f44bc004a40 comp rx=0 tx=0).stop 2023-12-22T08:44:55.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.451+0000 7f44d1f92640 1 -- 172.21.15.38:0/1327831176 shutdown_connections 2023-12-22T08:44:55.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.451+0000 7f44d1f92640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44cc15e740 0x7f44cc0d24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:55.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.451+0000 7f44d1f92640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44cc0b3f90 0x7f44cc148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.451+0000 7f44d1f92640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f44ac06a430 0x7f44ac06c8f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.451+0000 7f44d1f92640 1 --2- 172.21.15.38:0/1327831176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44cc06ca50 0x7f44cc1f37b0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.451+0000 7f44d1f92640 1 -- 172.21.15.38:0/1327831176 >> 172.21.15.38:0/1327831176 conn(0x7f44cc0cfea0 msgr2=0x7f44cc070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.451+0000 7f44d1f92640 1 -- 172.21.15.38:0/1327831176 shutdown_connections 2023-12-22T08:44:55.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.452+0000 7f44d1f92640 1 -- 172.21.15.38:0/1327831176 wait complete. 2023-12-22T08:44:55.475 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T08:44:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.672+0000 7f853a149640 1 Processor -- start 2023-12-22T08:44:55.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.673+0000 7f853a149640 1 -- start start 2023-12-22T08:44:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.674+0000 7f853a149640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8534070300 0x7f85341461e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.674+0000 7f853a149640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853415b150 con 0x7f853415ad70 2023-12-22T08:44:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.674+0000 7f853a149640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853415da80 con 0x7f85340b3f20 2023-12-22T08:44:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.674+0000 7f853a149640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8534071070 con 0x7f8534070300 2023-12-22T08:44:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.675+0000 7f8539948640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8534070300 0x7f85341461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.675+0000 7f8539948640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8534070300 0x7f85341461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59242/0 (socket says 172.21.15.38:59242) 2023-12-22T08:44:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.675+0000 7f8539948640 1 -- 172.21.15.38:0/621648703 learned_addr learned my addr 172.21.15.38:0/621648703 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.675+0000 7f8539948640 1 -- 172.21.15.38:0/621648703 >> v1:172.21.15.89:6789/0 conn(0x7f85340b3f20 legacy=0x7f853406fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.675+0000 7f8539948640 1 -- 172.21.15.38:0/621648703 >> v1:172.21.15.38:6789/0 conn(0x7f853415ad70 legacy=0x7f85340b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.675+0000 7f8539948640 1 -- 172.21.15.38:0/621648703 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853406bf50 con 0x7f8534070300 2023-12-22T08:44:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.677+0000 7f8539948640 1 --2- 172.21.15.38:0/621648703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534070300 0x7f85341461e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f852c009e50 tx=0x7f852c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7027df5ed30b825 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.677+0000 7f852bfff640 1 -- 172.21.15.38:0/621648703 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c02ca80 con 0x7f8534070300 2023-12-22T08:44:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.677+0000 7f852bfff640 1 -- 172.21.15.38:0/621648703 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852c02cbe0 con 0x7f8534070300 2023-12-22T08:44:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.677+0000 7f852bfff640 1 -- 172.21.15.38:0/621648703 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c0343f0 con 0x7f8534070300 2023-12-22T08:44:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.678+0000 7f853a149640 1 -- 172.21.15.38:0/621648703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534070300 msgr2=0x7f85341461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.678+0000 7f853a149640 1 --2- 172.21.15.38:0/621648703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534070300 0x7f85341461e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f852c009e50 tx=0x7f852c02bee0 comp rx=0 tx=0).stop 2023-12-22T08:44:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.678+0000 7f853a149640 1 -- 172.21.15.38:0/621648703 shutdown_connections 2023-12-22T08:44:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.678+0000 7f853a149640 1 --2- 172.21.15.38:0/621648703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8534070300 0x7f85341461e0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.678+0000 7f853a149640 1 -- 172.21.15.38:0/621648703 >> 172.21.15.38:0/621648703 conn(0x7f85340d3070 msgr2=0x7f85340d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.678+0000 7f853a149640 1 -- 172.21.15.38:0/621648703 shutdown_connections 2023-12-22T08:44:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.678+0000 7f853a149640 1 -- 172.21.15.38:0/621648703 wait complete. 2023-12-22T08:44:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.680+0000 7f853a149640 1 Processor -- start 2023-12-22T08:44:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.680+0000 7f853a149640 1 -- start start 2023-12-22T08:44:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.681+0000 7f853a149640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8534070300 0x7f85341f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.681+0000 7f853a149640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85340b3f20 0x7f85341f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.681+0000 7f853a149640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f853415ad70 0x7f85341f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.681+0000 7f853a149640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8534156980 con 0x7f853415ad70 2023-12-22T08:44:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.681+0000 7f853a149640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85341f3aa0 con 0x7f8534070300 2023-12-22T08:44:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.681+0000 7f853a149640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85341f3200 con 0x7f85340b3f20 2023-12-22T08:44:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.681+0000 7f8539948640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f853415ad70 0x7f85341f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.681+0000 7f8539948640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f853415ad70 0x7f85341f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59250/0 (socket says 172.21.15.38:59250) 2023-12-22T08:44:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.681+0000 7f8539948640 1 -- 172.21.15.38:0/2075298779 learned_addr learned my addr 172.21.15.38:0/2075298779 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.682+0000 7f8539147640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8534070300 0x7f85341f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.682+0000 7f8538946640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85340b3f20 0x7f85341f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.682+0000 7f8539948640 1 -- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85340b3f20 msgr2=0x7f85341f2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.682+0000 7f8539948640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85340b3f20 0x7f85341f2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.682+0000 7f8539948640 1 -- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8534070300 msgr2=0x7f85341f5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.682+0000 7f8539948640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8534070300 0x7f85341f5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.682+0000 7f8539948640 1 -- 172.21.15.38:0/2075298779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c009b30 con 0x7f853415ad70 2023-12-22T08:44:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.682+0000 7f8539147640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8534070300 0x7f85341f5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.682+0000 7f8539948640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f853415ad70 0x7f85341f3c50 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f852c036040 tx=0x7f852c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.682+0000 7f8529ffb640 1 -- 172.21.15.38:0/2075298779 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c03e450 con 0x7f853415ad70 2023-12-22T08:44:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.683+0000 7f8529ffb640 1 -- 172.21.15.38:0/2075298779 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852c03e5d0 con 0x7f853415ad70 2023-12-22T08:44:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.683+0000 7f8529ffb640 1 -- 172.21.15.38:0/2075298779 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c03e980 con 0x7f853415ad70 2023-12-22T08:44:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.683+0000 7f853a149640 1 -- 172.21.15.38:0/2075298779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85341f34e0 con 0x7f853415ad70 2023-12-22T08:44:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.683+0000 7f853a149640 1 -- 172.21.15.38:0/2075298779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8534154d50 con 0x7f853415ad70 2023-12-22T08:44:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.684+0000 7f853a149640 1 -- 172.21.15.38:0/2075298779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8534154bb0 con 0x7f853415ad70 2023-12-22T08:44:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.685+0000 7f8529ffb640 1 -- 172.21.15.38:0/2075298779 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f852c02cd50 con 0x7f853415ad70 2023-12-22T08:44:55.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.687+0000 7f8529ffb640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f851806a460 0x7f851806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:55.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.687+0000 7f8529ffb640 1 -- 172.21.15.38:0/2075298779 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f852c0ab280 con 0x7f853415ad70 2023-12-22T08:44:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.687+0000 7f8539147640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f851806a460 0x7f851806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.688+0000 7f8539147640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f851806a460 0x7f851806c920 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8530000f60 tx=0x7f8530009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.692+0000 7f8529ffb640 1 -- 172.21.15.38:0/2075298779 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8534154bb0 con 0x7f853415ad70 2023-12-22T08:44:55.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.925+0000 7f853a149640 1 -- 172.21.15.38:0/2075298779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8534154bb0 con 0x7f853415ad70 2023-12-22T08:44:55.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.938+0000 7f8529ffb640 1 -- 172.21.15.38:0/2075298779 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v37) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8534154bb0 con 0x7f853415ad70 2023-12-22T08:44:55.943 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 10 and data pool 11 2023-12-22T08:44:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.944+0000 7f853a149640 1 -- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f851806a460 msgr2=0x7f851806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.944+0000 7f853a149640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f851806a460 0x7f851806c920 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8530000f60 tx=0x7f8530009040 comp rx=0 tx=0).stop 2023-12-22T08:44:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.944+0000 7f853a149640 1 -- 172.21.15.38:0/2075298779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f853415ad70 msgr2=0x7f85341f3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.944+0000 7f853a149640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f853415ad70 0x7f85341f3c50 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f852c036040 tx=0x7f852c004a40 comp rx=0 tx=0).stop 2023-12-22T08:44:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.945+0000 7f853a149640 1 -- 172.21.15.38:0/2075298779 shutdown_connections 2023-12-22T08:44:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.945+0000 7f853a149640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f851806a460 0x7f851806c920 secure :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8530000f60 tx=0x7f8530009040 comp rx=0 tx=0).stop 2023-12-22T08:44:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.945+0000 7f853a149640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f853415ad70 0x7f85341f3c50 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.945+0000 7f853a149640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85340b3f20 0x7f85341f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.945+0000 7f853a149640 1 --2- 172.21.15.38:0/2075298779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8534070300 0x7f85341f5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:55.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.945+0000 7f853a149640 1 -- 172.21.15.38:0/2075298779 >> 172.21.15.38:0/2075298779 conn(0x7f85340d3070 msgr2=0x7f85340d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:55.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.946+0000 7f853a149640 1 -- 172.21.15.38:0/2075298779 shutdown_connections 2023-12-22T08:44:55.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:55.946+0000 7f853a149640 1 -- 172.21.15.38:0/2075298779 wait complete. 2023-12-22T08:44:55.976 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:44:56.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.158+0000 7f1ec288f640 1 Processor -- start 2023-12-22T08:44:56.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.158+0000 7f1ec288f640 1 -- start start 2023-12-22T08:44:56.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.160+0000 7f1ec288f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1ebc0b2050 0x7f1ebc0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:56.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.160+0000 7f1ec288f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ebc1450f0 con 0x7f1ebc144d10 2023-12-22T08:44:56.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.160+0000 7f1ec288f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ebc0b29f0 con 0x7f1ebc070800 2023-12-22T08:44:56.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.160+0000 7f1ec288f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ebc0cc840 con 0x7f1ebc0b2050 2023-12-22T08:44:56.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.160+0000 7f1ebbfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1ebc144d10 0x7f1ebc0cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36884/0 (socket says 172.21.15.38:36884) 2023-12-22T08:44:56.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.160+0000 7f1ebbfff640 1 -- 172.21.15.38:0/1977765935 learned_addr learned my addr 172.21.15.38:0/1977765935 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:56.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.160+0000 7f1ebb7fe640 1 --2- 172.21.15.38:0/1977765935 >> v2:172.21.15.38:3300/0 conn(0x7f1ebc0b2050 0x7f1ebc0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:56.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.161+0000 7f1ebaffd640 1 -- 172.21.15.38:0/1977765935 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601884631 0 0) 0x7f1ebc1450f0 con 0x7f1ebc144d10 2023-12-22T08:44:56.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.161+0000 7f1ebaffd640 1 -- 172.21.15.38:0/1977765935 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea4003520 con 0x7f1ebc144d10 2023-12-22T08:44:56.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.161+0000 7f1ebb7fe640 1 -- 172.21.15.38:0/1977765935 >> v1:172.21.15.89:6789/0 conn(0x7f1ebc070800 legacy=0x7f1ebc070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:56.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.161+0000 7f1ebb7fe640 1 -- 172.21.15.38:0/1977765935 >> v1:172.21.15.38:6789/0 conn(0x7f1ebc144d10 legacy=0x7f1ebc0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:56.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.161+0000 7f1ebb7fe640 1 -- 172.21.15.38:0/1977765935 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc0ce010 con 0x7f1ebc0b2050 2023-12-22T08:44:56.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.162+0000 7f1ebb7fe640 1 --2- 172.21.15.38:0/1977765935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ebc0b2050 0x7f1ebc0b24b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00097a0 tx=0x7f1eb002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5363e6923b3867 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:56.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.162+0000 7f1ebaffd640 1 -- 172.21.15.38:0/1977765935 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0030610 con 0x7f1ebc0b2050 2023-12-22T08:44:56.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.162+0000 7f1ebaffd640 1 -- 172.21.15.38:0/1977765935 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb0030770 con 0x7f1ebc0b2050 2023-12-22T08:44:56.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.163+0000 7f1ebaffd640 1 -- 172.21.15.38:0/1977765935 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0030b00 con 0x7f1ebc0b2050 2023-12-22T08:44:56.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.163+0000 7f1ec288f640 1 -- 172.21.15.38:0/1977765935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ebc0b2050 msgr2=0x7f1ebc0b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:56.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.163+0000 7f1ec288f640 1 --2- 172.21.15.38:0/1977765935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ebc0b2050 0x7f1ebc0b24b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00097a0 tx=0x7f1eb002b960 comp rx=0 tx=0).stop 2023-12-22T08:44:56.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.163+0000 7f1ec288f640 1 -- 172.21.15.38:0/1977765935 shutdown_connections 2023-12-22T08:44:56.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.163+0000 7f1ec288f640 1 --2- 172.21.15.38:0/1977765935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ebc0b2050 0x7f1ebc0b24b0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.163+0000 7f1ec288f640 1 -- 172.21.15.38:0/1977765935 >> 172.21.15.38:0/1977765935 conn(0x7f1ebc0cf070 msgr2=0x7f1ebc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:56.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.163+0000 7f1ec288f640 1 -- 172.21.15.38:0/1977765935 shutdown_connections 2023-12-22T08:44:56.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.163+0000 7f1ec288f640 1 -- 172.21.15.38:0/1977765935 wait complete. 2023-12-22T08:44:56.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.165+0000 7f1ec288f640 1 Processor -- start 2023-12-22T08:44:56.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.165+0000 7f1ec288f640 1 -- start start 2023-12-22T08:44:56.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.166+0000 7f1ec288f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ebc070800 0x7f1ebc131a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:56.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.166+0000 7f1ec288f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc0b2050 0x7f1ebc06d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:56.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.166+0000 7f1ec288f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc144d10 0x7f1ebc15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:56.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.166+0000 7f1ec288f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc06c190 con 0x7f1ebc070800 2023-12-22T08:44:56.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.166+0000 7f1ec288f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc1415a0 con 0x7f1ebc144d10 2023-12-22T08:44:56.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.166+0000 7f1ec288f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc06c3e0 con 0x7f1ebc0b2050 2023-12-22T08:44:56.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.166+0000 7f1ebbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ebc070800 0x7f1ebc131a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:56.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.167+0000 7f1ebbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ebc070800 0x7f1ebc131a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59258/0 (socket says 172.21.15.38:59258) 2023-12-22T08:44:56.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.167+0000 7f1ebbfff640 1 -- 172.21.15.38:0/2690365130 learned_addr learned my addr 172.21.15.38:0/2690365130 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.167+0000 7f1ebbfff640 1 -- 172.21.15.38:0/2690365130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc0b2050 msgr2=0x7f1ebc06d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.167+0000 7f1ebbfff640 1 --2- 172.21.15.38:0/2690365130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc0b2050 0x7f1ebc06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.167+0000 7f1ebbfff640 1 -- 172.21.15.38:0/2690365130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc144d10 msgr2=0x7f1ebc15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.167+0000 7f1ebbfff640 1 --2- 172.21.15.38:0/2690365130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc144d10 0x7f1ebc15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.167+0000 7f1ebbfff640 1 -- 172.21.15.38:0/2690365130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb0009400 con 0x7f1ebc070800 2023-12-22T08:44:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.167+0000 7f1ebbfff640 1 --2- 172.21.15.38:0/2690365130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ebc070800 0x7f1ebc131a30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00c500 tx=0x7f1eac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.167+0000 7f1eb8ff9640 1 -- 172.21.15.38:0/2690365130 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac005ce0 con 0x7f1ebc070800 2023-12-22T08:44:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.168+0000 7f1eb8ff9640 1 -- 172.21.15.38:0/2690365130 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac005e40 con 0x7f1ebc070800 2023-12-22T08:44:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.168+0000 7f1eb8ff9640 1 -- 172.21.15.38:0/2690365130 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac007330 con 0x7f1ebc070800 2023-12-22T08:44:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.168+0000 7f1ec288f640 1 -- 172.21.15.38:0/2690365130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ebc06c6c0 con 0x7f1ebc070800 2023-12-22T08:44:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.168+0000 7f1ec288f640 1 -- 172.21.15.38:0/2690365130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ebc06cc80 con 0x7f1ebc070800 2023-12-22T08:44:56.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.169+0000 7f1ec288f640 1 -- 172.21.15.38:0/2690365130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ebc061910 con 0x7f1ebc070800 2023-12-22T08:44:56.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.170+0000 7f1eb8ff9640 1 -- 172.21.15.38:0/2690365130 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1eac007550 con 0x7f1ebc070800 2023-12-22T08:44:56.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.171+0000 7f1eb8ff9640 1 --2- 172.21.15.38:0/2690365130 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ea806a430 0x7f1ea806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:56.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.172+0000 7f1eb8ff9640 1 -- 172.21.15.38:0/2690365130 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1eac087fd0 con 0x7f1ebc070800 2023-12-22T08:44:56.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.172+0000 7f1ebb7fe640 1 --2- 172.21.15.38:0/2690365130 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ea806a430 0x7f1ea806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:56.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.174+0000 7f1ebb7fe640 1 --2- 172.21.15.38:0/2690365130 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ea806a430 0x7f1ea806c8f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0036000 tx=0x7f1eb003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:56.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.176+0000 7f1eb8ff9640 1 -- 172.21.15.38:0/2690365130 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1eac053670 con 0x7f1ebc070800 2023-12-22T08:44:56.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.373+0000 7f1ec288f640 1 -- 172.21.15.38:0/2690365130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ebc0cb8e0 con 0x7f1ebc070800 2023-12-22T08:44:56.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.376+0000 7f1eb8ff9640 1 -- 172.21.15.38:0/2690365130 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16005 (secure 0 0 0) 0x7f1eac017090 con 0x7f1ebc070800 2023-12-22T08:44:56.378 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:56.378 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":88,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:44:55.927369+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:44:53.802762+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-22T08:44:54.948144+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:44:56.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.378+0000 7f1ec288f640 1 -- 172.21.15.38:0/2690365130 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ea806a430 msgr2=0x7f1ea806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:56.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.378+0000 7f1ec288f640 1 --2- 172.21.15.38:0/2690365130 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ea806a430 0x7f1ea806c8f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0036000 tx=0x7f1eb003b040 comp rx=0 tx=0).stop 2023-12-22T08:44:56.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.378+0000 7f1ec288f640 1 -- 172.21.15.38:0/2690365130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ebc070800 msgr2=0x7f1ebc131a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.378+0000 7f1ec288f640 1 --2- 172.21.15.38:0/2690365130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ebc070800 0x7f1ebc131a30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00c500 tx=0x7f1eac00c9c0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.378+0000 7f1ec288f640 1 -- 172.21.15.38:0/2690365130 shutdown_connections 2023-12-22T08:44:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.378+0000 7f1ec288f640 1 --2- 172.21.15.38:0/2690365130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ebc144d10 0x7f1ebc15cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.378+0000 7f1ec288f640 1 --2- 172.21.15.38:0/2690365130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ebc0b2050 0x7f1ebc06d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.378+0000 7f1ec288f640 1 --2- 172.21.15.38:0/2690365130 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ea806a430 0x7f1ea806c8f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.378+0000 7f1ec288f640 1 --2- 172.21.15.38:0/2690365130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ebc070800 0x7f1ebc131a30 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.378+0000 7f1ec288f640 1 -- 172.21.15.38:0/2690365130 >> 172.21.15.38:0/2690365130 conn(0x7f1ebc0cf070 msgr2=0x7f1ebc0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.379+0000 7f1ec288f640 1 -- 172.21.15.38:0/2690365130 shutdown_connections 2023-12-22T08:44:56.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.379+0000 7f1ec288f640 1 -- 172.21.15.38:0/2690365130 wait complete. 2023-12-22T08:44:56.383 INFO:tasks.ceph.mds.b.smithi089.stderr:2023-12-22T08:44:56.382+0000 7fa4fb87c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:44:56.400 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:44:56.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.624+0000 7fe89cf92640 1 Processor -- start 2023-12-22T08:44:56.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.625+0000 7fe89cf92640 1 -- start start 2023-12-22T08:44:56.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.626+0000 7fe89cf92640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe89815e740 0x7fe89815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:56.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.626+0000 7fe89cf92640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8980b3f90 0x7fe898070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:56.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.626+0000 7fe89cf92640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89815eb20 con 0x7fe89806ca50 2023-12-22T08:44:56.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.626+0000 7fe89cf92640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89806e650 con 0x7fe89815e740 2023-12-22T08:44:56.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.626+0000 7fe89cf92640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe898070770 con 0x7fe8980b3f90 2023-12-22T08:44:56.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.627+0000 7fe89659c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe89815e740 0x7fe89815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:56.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.627+0000 7fe89659c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe89815e740 0x7fe89815db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59270/0 (socket says 172.21.15.38:59270) 2023-12-22T08:44:56.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.627+0000 7fe89659c640 1 -- 172.21.15.38:0/2637825146 learned_addr learned my addr 172.21.15.38:0/2637825146 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:56.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.627+0000 7fe896d9d640 1 --2- 172.21.15.38:0/2637825146 >> v2:172.21.15.89:3300/0 conn(0x7fe8980b3f90 0x7fe898070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:56.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.627+0000 7fe89659c640 1 -- 172.21.15.38:0/2637825146 >> v2:172.21.15.89:3300/0 conn(0x7fe8980b3f90 msgr2=0x7fe898070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:56.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.627+0000 7fe89659c640 1 --2- 172.21.15.38:0/2637825146 >> v2:172.21.15.89:3300/0 conn(0x7fe8980b3f90 0x7fe898070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.627+0000 7fe89659c640 1 -- 172.21.15.38:0/2637825146 >> v1:172.21.15.89:6789/0 conn(0x7fe89806ca50 legacy=0x7fe8980b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:56.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.627+0000 7fe89659c640 1 -- 172.21.15.38:0/2637825146 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89806cec0 con 0x7fe89815e740 2023-12-22T08:44:56.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.627+0000 7fe896d9d640 1 --2- 172.21.15.38:0/2637825146 >> v2:172.21.15.89:3300/0 conn(0x7fe8980b3f90 0x7fe898070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:56.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.629+0000 7fe89659c640 1 --2- 172.21.15.38:0/2637825146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe89815e740 0x7fe89815db30 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe89815b700 tx=0x7fe88802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2609918b643edd7e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:56.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.629+0000 7fe89559a640 1 -- 172.21.15.38:0/2637825146 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88802c960 con 0x7fe89815e740 2023-12-22T08:44:56.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.629+0000 7fe89559a640 1 -- 172.21.15.38:0/2637825146 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88802cac0 con 0x7fe89815e740 2023-12-22T08:44:56.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.629+0000 7fe89559a640 1 -- 172.21.15.38:0/2637825146 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88802ce50 con 0x7fe89815e740 2023-12-22T08:44:56.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.630+0000 7fe89cf92640 1 -- 172.21.15.38:0/2637825146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe89815e740 msgr2=0x7fe89815db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:56.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.630+0000 7fe89cf92640 1 --2- 172.21.15.38:0/2637825146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe89815e740 0x7fe89815db30 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe89815b700 tx=0x7fe88802bdc0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.630+0000 7fe89cf92640 1 -- 172.21.15.38:0/2637825146 shutdown_connections 2023-12-22T08:44:56.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.630+0000 7fe89cf92640 1 --2- 172.21.15.38:0/2637825146 >> v2:172.21.15.89:3300/0 conn(0x7fe8980b3f90 0x7fe898070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.630+0000 7fe89cf92640 1 --2- 172.21.15.38:0/2637825146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe89815e740 0x7fe89815db30 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.630+0000 7fe89cf92640 1 -- 172.21.15.38:0/2637825146 >> 172.21.15.38:0/2637825146 conn(0x7fe8980cfea0 msgr2=0x7fe8980d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:56.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.631+0000 7fe89cf92640 1 -- 172.21.15.38:0/2637825146 shutdown_connections 2023-12-22T08:44:56.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.631+0000 7fe89cf92640 1 -- 172.21.15.38:0/2637825146 wait complete. 2023-12-22T08:44:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.633+0000 7fe89cf92640 1 Processor -- start 2023-12-22T08:44:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.633+0000 7fe89cf92640 1 -- start start 2023-12-22T08:44:56.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.634+0000 7fe89cf92640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe89806ca50 0x7fe898158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:56.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.634+0000 7fe89cf92640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8980b3f90 0x7fe898155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:56.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.634+0000 7fe89cf92640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe89815e740 0x7fe8980d2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:56.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.634+0000 7fe89cf92640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89815b3d0 con 0x7fe8980b3f90 2023-12-22T08:44:56.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.634+0000 7fe89cf92640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe898155400 con 0x7fe89806ca50 2023-12-22T08:44:56.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.634+0000 7fe89cf92640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe898154df0 con 0x7fe89815e740 2023-12-22T08:44:56.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.635+0000 7fe895d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8980b3f90 0x7fe898155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:56.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.635+0000 7fe895d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8980b3f90 0x7fe898155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59272/0 (socket says 172.21.15.38:59272) 2023-12-22T08:44:56.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.635+0000 7fe895d9b640 1 -- 172.21.15.38:0/2903463635 learned_addr learned my addr 172.21.15.38:0/2903463635 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:56.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.635+0000 7fe89659c640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe89806ca50 0x7fe898158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:56.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.635+0000 7fe896d9d640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe89815e740 0x7fe8980d2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:56.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.635+0000 7fe895d9b640 1 -- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe89815e740 msgr2=0x7fe8980d2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:56.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.635+0000 7fe895d9b640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe89815e740 0x7fe8980d2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.635+0000 7fe895d9b640 1 -- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe89806ca50 msgr2=0x7fe898158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:56.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.635+0000 7fe895d9b640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe89806ca50 0x7fe898158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.635+0000 7fe895d9b640 1 -- 172.21.15.38:0/2903463635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe888009b30 con 0x7fe8980b3f90 2023-12-22T08:44:56.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.635+0000 7fe896d9d640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe89815e740 0x7fe8980d2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.636+0000 7fe895d9b640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8980b3f90 0x7fe898155890 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe88000b3f0 tx=0x7fe88000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.636+0000 7fe88effd640 1 -- 172.21.15.38:0/2903463635 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880011830 con 0x7fe8980b3f90 2023-12-22T08:44:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.636+0000 7fe88effd640 1 -- 172.21.15.38:0/2903463635 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe880011990 con 0x7fe8980b3f90 2023-12-22T08:44:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.636+0000 7fe88effd640 1 -- 172.21.15.38:0/2903463635 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880011d40 con 0x7fe8980b3f90 2023-12-22T08:44:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.636+0000 7fe89cf92640 1 -- 172.21.15.38:0/2903463635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe898071510 con 0x7fe8980b3f90 2023-12-22T08:44:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.636+0000 7fe89cf92640 1 -- 172.21.15.38:0/2903463635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe898155090 con 0x7fe8980b3f90 2023-12-22T08:44:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.637+0000 7fe89cf92640 1 -- 172.21.15.38:0/2903463635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe898154c50 con 0x7fe8980b3f90 2023-12-22T08:44:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.638+0000 7fe88effd640 1 -- 172.21.15.38:0/2903463635 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe88001a400 con 0x7fe8980b3f90 2023-12-22T08:44:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.639+0000 7fe88effd640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe87806a430 0x7fe87806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.639+0000 7fe88effd640 1 -- 172.21.15.38:0/2903463635 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8800887e0 con 0x7fe8980b3f90 2023-12-22T08:44:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.640+0000 7fe89659c640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe87806a430 0x7fe87806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.641+0000 7fe89659c640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe87806a430 0x7fe87806c8f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe888035000 tx=0x7fe888030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:56.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.644+0000 7fe88effd640 1 -- 172.21.15.38:0/2903463635 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe898154c50 con 0x7fe8980b3f90 2023-12-22T08:44:56.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.850+0000 7fe89cf92640 1 -- 172.21.15.38:0/2903463635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe898154c50 con 0x7fe8980b3f90 2023-12-22T08:44:56.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.853+0000 7fe88effd640 1 -- 172.21.15.38:0/2903463635 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16005 (secure 0 0 0) 0x7fe898154c50 con 0x7fe8980b3f90 2023-12-22T08:44:56.856 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:56.856 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":88,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:44:55.927369+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:44:53.802762+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-22T08:44:54.948144+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:44:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.856+0000 7fe89cf92640 1 -- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe87806a430 msgr2=0x7fe87806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.856+0000 7fe89cf92640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe87806a430 0x7fe87806c8f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe888035000 tx=0x7fe888030000 comp rx=0 tx=0).stop 2023-12-22T08:44:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.856+0000 7fe89cf92640 1 -- 172.21.15.38:0/2903463635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8980b3f90 msgr2=0x7fe898155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.856+0000 7fe89cf92640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8980b3f90 0x7fe898155890 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe88000b3f0 tx=0x7fe88000b8b0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.856+0000 7fe89cf92640 1 -- 172.21.15.38:0/2903463635 shutdown_connections 2023-12-22T08:44:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.856+0000 7fe89cf92640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe89815e740 0x7fe8980d2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.856+0000 7fe89cf92640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe87806a430 0x7fe87806c8f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.856+0000 7fe89cf92640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8980b3f90 0x7fe898155890 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.856+0000 7fe89cf92640 1 --2- 172.21.15.38:0/2903463635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe89806ca50 0x7fe898158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.856+0000 7fe89cf92640 1 -- 172.21.15.38:0/2903463635 >> 172.21.15.38:0/2903463635 conn(0x7fe8980cfea0 msgr2=0x7fe89815f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.857+0000 7fe89cf92640 1 -- 172.21.15.38:0/2903463635 shutdown_connections 2023-12-22T08:44:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:56.857+0000 7fe89cf92640 1 -- 172.21.15.38:0/2903463635 wait complete. 2023-12-22T08:44:56.879 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T08:44:57.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.104+0000 7fc87759e640 1 Processor -- start 2023-12-22T08:44:57.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.105+0000 7fc87759e640 1 -- start start 2023-12-22T08:44:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.106+0000 7fc87759e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc87815ad90 0x7fc8780caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.106+0000 7fc87759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc878161bb0 0x7fc8780cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.106+0000 7fc87759e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87815e630 con 0x7fc87815d940 2023-12-22T08:44:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.106+0000 7fc87759e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8780ce2c0 con 0x7fc87815ad90 2023-12-22T08:44:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.106+0000 7fc87759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87815e910 con 0x7fc878161bb0 2023-12-22T08:44:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.107+0000 7fc87659c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc87815ad90 0x7fc8780caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.107+0000 7fc876d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc87815d940 0x7fc87815ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36892/0 (socket says 172.21.15.38:36892) 2023-12-22T08:44:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.107+0000 7fc876d9d640 1 -- 172.21.15.38:0/2936727753 learned_addr learned my addr 172.21.15.38:0/2936727753 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.107+0000 7fc87659c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc87815ad90 0x7fc8780caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59278/0 (socket says 172.21.15.38:59278) 2023-12-22T08:44:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.107+0000 7fc86ffff640 1 --2- 172.21.15.38:0/2936727753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc878161bb0 0x7fc8780cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.107+0000 7fc87659c640 1 -- 172.21.15.38:0/2936727753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc878161bb0 msgr2=0x7fc8780cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.107+0000 7fc87659c640 1 --2- 172.21.15.38:0/2936727753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc878161bb0 0x7fc8780cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.107+0000 7fc87659c640 1 -- 172.21.15.38:0/2936727753 >> v1:172.21.15.38:6789/0 conn(0x7fc87815d940 legacy=0x7fc87815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:57.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.107+0000 7fc87659c640 1 -- 172.21.15.38:0/2936727753 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8781610d0 con 0x7fc87815ad90 2023-12-22T08:44:57.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.108+0000 7fc87659c640 1 --2- 172.21.15.38:0/2936727753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87815ad90 0x7fc8780caed0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc8680097a0 tx=0x7fc86802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8310b528ef8a6930 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:57.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.109+0000 7fc875d9b640 1 -- 172.21.15.38:0/2936727753 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868031830 con 0x7fc87815ad90 2023-12-22T08:44:57.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.109+0000 7fc875d9b640 1 -- 172.21.15.38:0/2936727753 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc868031990 con 0x7fc87815ad90 2023-12-22T08:44:57.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.109+0000 7fc875d9b640 1 -- 172.21.15.38:0/2936727753 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868031d20 con 0x7fc87815ad90 2023-12-22T08:44:57.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.109+0000 7fc87759e640 1 -- 172.21.15.38:0/2936727753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87815ad90 msgr2=0x7fc8780caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:57.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.109+0000 7fc87759e640 1 --2- 172.21.15.38:0/2936727753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87815ad90 0x7fc8780caed0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc8680097a0 tx=0x7fc86802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:44:57.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.109+0000 7fc87759e640 1 -- 172.21.15.38:0/2936727753 shutdown_connections 2023-12-22T08:44:57.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.109+0000 7fc87759e640 1 --2- 172.21.15.38:0/2936727753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc878161bb0 0x7fc8780cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:57.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.109+0000 7fc87759e640 1 --2- 172.21.15.38:0/2936727753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87815ad90 0x7fc8780caed0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:57.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.109+0000 7fc87759e640 1 -- 172.21.15.38:0/2936727753 >> 172.21.15.38:0/2936727753 conn(0x7fc8780d31c0 msgr2=0x7fc8780d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.110+0000 7fc87759e640 1 -- 172.21.15.38:0/2936727753 shutdown_connections 2023-12-22T08:44:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.110+0000 7fc87759e640 1 -- 172.21.15.38:0/2936727753 wait complete. 2023-12-22T08:44:57.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.112+0000 7fc87759e640 1 Processor -- start 2023-12-22T08:44:57.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.112+0000 7fc87759e640 1 -- start start 2023-12-22T08:44:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.113+0000 7fc87759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc87815ad90 0x7fc8780cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.113+0000 7fc87759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87815d940 0x7fc878070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.113+0000 7fc87759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc878161bb0 0x7fc8780c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.113+0000 7fc87759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8780cf7f0 con 0x7fc87815d940 2023-12-22T08:44:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.113+0000 7fc87759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8781607e0 con 0x7fc878161bb0 2023-12-22T08:44:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.113+0000 7fc87759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8780c95e0 con 0x7fc87815ad90 2023-12-22T08:44:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.114+0000 7fc86ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87815d940 0x7fc878070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.114+0000 7fc86ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87815d940 0x7fc878070490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59288/0 (socket says 172.21.15.38:59288) 2023-12-22T08:44:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.114+0000 7fc86ffff640 1 -- 172.21.15.38:0/963377776 learned_addr learned my addr 172.21.15.38:0/963377776 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.114+0000 7fc87659c640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc87815ad90 0x7fc8780cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.114+0000 7fc876d9d640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc878161bb0 0x7fc8780c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.114+0000 7fc86ffff640 1 -- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc87815ad90 msgr2=0x7fc8780cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.114+0000 7fc86ffff640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc87815ad90 0x7fc8780cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.114+0000 7fc86ffff640 1 -- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc878161bb0 msgr2=0x7fc8780c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.114+0000 7fc86ffff640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc878161bb0 0x7fc8780c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:57.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.114+0000 7fc86ffff640 1 -- 172.21.15.38:0/963377776 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868009400 con 0x7fc87815d940 2023-12-22T08:44:57.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.114+0000 7fc876d9d640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc878161bb0 0x7fc8780c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:44:57.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.114+0000 7fc86ffff640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87815d940 0x7fc878070490 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc86000d620 tx=0x7fc86000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:57.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.115+0000 7fc86effd640 1 -- 172.21.15.38:0/963377776 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86000b620 con 0x7fc87815d940 2023-12-22T08:44:57.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.115+0000 7fc86effd640 1 -- 172.21.15.38:0/963377776 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86000b780 con 0x7fc87815d940 2023-12-22T08:44:57.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.115+0000 7fc86effd640 1 -- 172.21.15.38:0/963377776 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86000bb30 con 0x7fc87815d940 2023-12-22T08:44:57.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.115+0000 7fc87759e640 1 -- 172.21.15.38:0/963377776 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8780c89d0 con 0x7fc87815d940 2023-12-22T08:44:57.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.115+0000 7fc87759e640 1 -- 172.21.15.38:0/963377776 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8780c8f90 con 0x7fc87815d940 2023-12-22T08:44:57.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.116+0000 7fc87759e640 1 -- 172.21.15.38:0/963377776 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8781502d0 con 0x7fc87815d940 2023-12-22T08:44:57.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.117+0000 7fc86effd640 1 -- 172.21.15.38:0/963377776 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc86000bc90 con 0x7fc87815d940 2023-12-22T08:44:57.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.118+0000 7fc86effd640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc85806a430 0x7fc85806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:57.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.118+0000 7fc86effd640 1 -- 172.21.15.38:0/963377776 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc860088e60 con 0x7fc87815d940 2023-12-22T08:44:57.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.119+0000 7fc87659c640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc85806a430 0x7fc85806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:57.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.120+0000 7fc87659c640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc85806a430 0x7fc85806c8f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc868036000 tx=0x7fc86803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:57.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.123+0000 7fc86effd640 1 -- 172.21.15.38:0/963377776 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc8600543b0 con 0x7fc87815d940 2023-12-22T08:44:57.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.359+0000 7fc87759e640 1 -- 172.21.15.38:0/963377776 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc878061910 con 0x7fc87815d940 2023-12-22T08:44:57.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.942+0000 7fc86effd640 1 -- 172.21.15.38:0/963377776 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc8600579d0 con 0x7fc87815d940 2023-12-22T08:44:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.946+0000 7fc87759e640 1 -- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc85806a430 msgr2=0x7fc85806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.946+0000 7fc87759e640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc85806a430 0x7fc85806c8f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc868036000 tx=0x7fc86803c040 comp rx=0 tx=0).stop 2023-12-22T08:44:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.946+0000 7fc87759e640 1 -- 172.21.15.38:0/963377776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87815d940 msgr2=0x7fc878070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.946+0000 7fc87759e640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87815d940 0x7fc878070490 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc86000d620 tx=0x7fc86000dae0 comp rx=0 tx=0).stop 2023-12-22T08:44:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.946+0000 7fc87759e640 1 -- 172.21.15.38:0/963377776 shutdown_connections 2023-12-22T08:44:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.946+0000 7fc87759e640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc878161bb0 0x7fc8780c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.946+0000 7fc87759e640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc85806a430 0x7fc85806c8f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.946+0000 7fc87759e640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc87815d940 0x7fc878070490 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.946+0000 7fc87759e640 1 --2- 172.21.15.38:0/963377776 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc87815ad90 0x7fc8780cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.946+0000 7fc87759e640 1 -- 172.21.15.38:0/963377776 >> 172.21.15.38:0/963377776 conn(0x7fc8780d31c0 msgr2=0x7fc8780cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.946+0000 7fc87759e640 1 -- 172.21.15.38:0/963377776 shutdown_connections 2023-12-22T08:44:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:57.946+0000 7fc87759e640 1 -- 172.21.15.38:0/963377776 wait complete. 2023-12-22T08:44:57.971 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T08:44:57.972 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T08:44:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.201+0000 7fb6e9362640 1 Processor -- start 2023-12-22T08:44:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.201+0000 7fb6e9362640 1 -- start start 2023-12-22T08:44:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.203+0000 7fb6e9362640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb6e4144a20 0x7fb6e40b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.203+0000 7fb6e9362640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb6e40b3cf0 0x7fb6e40b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.203+0000 7fb6e9362640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6e40cf290 0x7fb6e40cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.203+0000 7fb6e9362640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e40b65a0 con 0x7fb6e4144a20 2023-12-22T08:44:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.203+0000 7fb6e9362640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e40b46c0 con 0x7fb6e40b3cf0 2023-12-22T08:44:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.203+0000 7fb6e9362640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e40b5c80 con 0x7fb6e40cf290 2023-12-22T08:44:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.203+0000 7fb6e3fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb6e4144a20 0x7fb6e40b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.203+0000 7fb6e3fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb6e4144a20 0x7fb6e40b69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59294/0 (socket says 172.21.15.38:59294) 2023-12-22T08:44:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.203+0000 7fb6e3fff640 1 -- 172.21.15.38:0/2134268695 learned_addr learned my addr 172.21.15.38:0/2134268695 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.204+0000 7fb6e37fe640 1 --2- 172.21.15.38:0/2134268695 >> v2:172.21.15.89:3300/0 conn(0x7fb6e40b3cf0 0x7fb6e40b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.204+0000 7fb6e8b61640 1 --2- 172.21.15.38:0/2134268695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6e40cf290 0x7fb6e40cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.204+0000 7fb6e3fff640 1 -- 172.21.15.38:0/2134268695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6e40cf290 msgr2=0x7fb6e40cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.204+0000 7fb6e3fff640 1 --2- 172.21.15.38:0/2134268695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6e40cf290 0x7fb6e40cf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.204+0000 7fb6e3fff640 1 -- 172.21.15.38:0/2134268695 >> v2:172.21.15.89:3300/0 conn(0x7fb6e40b3cf0 msgr2=0x7fb6e40b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.204+0000 7fb6e3fff640 1 --2- 172.21.15.38:0/2134268695 >> v2:172.21.15.89:3300/0 conn(0x7fb6e40b3cf0 0x7fb6e40b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.204+0000 7fb6e3fff640 1 -- 172.21.15.38:0/2134268695 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e40b5f00 con 0x7fb6e4144a20 2023-12-22T08:44:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.205+0000 7fb6e3fff640 1 --2- 172.21.15.38:0/2134268695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6e4144a20 0x7fb6e40b69c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40b0ca0 tx=0x7fb6d402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813c473533df046d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.205+0000 7fb6e2ffd640 1 -- 172.21.15.38:0/2134268695 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d402c9f0 con 0x7fb6e4144a20 2023-12-22T08:44:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.205+0000 7fb6e2ffd640 1 -- 172.21.15.38:0/2134268695 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d402cb50 con 0x7fb6e4144a20 2023-12-22T08:44:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.205+0000 7fb6e2ffd640 1 -- 172.21.15.38:0/2134268695 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d40343f0 con 0x7fb6e4144a20 2023-12-22T08:44:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.206+0000 7fb6e9362640 1 -- 172.21.15.38:0/2134268695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6e4144a20 msgr2=0x7fb6e40b69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.206+0000 7fb6e9362640 1 --2- 172.21.15.38:0/2134268695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6e4144a20 0x7fb6e40b69c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40b0ca0 tx=0x7fb6d402be50 comp rx=0 tx=0).stop 2023-12-22T08:44:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.206+0000 7fb6e9362640 1 -- 172.21.15.38:0/2134268695 shutdown_connections 2023-12-22T08:44:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.206+0000 7fb6e9362640 1 --2- 172.21.15.38:0/2134268695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6e40cf290 0x7fb6e40cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.206+0000 7fb6e9362640 1 --2- 172.21.15.38:0/2134268695 >> v2:172.21.15.89:3300/0 conn(0x7fb6e40b3cf0 0x7fb6e40b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.206+0000 7fb6e9362640 1 --2- 172.21.15.38:0/2134268695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6e4144a20 0x7fb6e40b69c0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.206+0000 7fb6e9362640 1 -- 172.21.15.38:0/2134268695 >> 172.21.15.38:0/2134268695 conn(0x7fb6e4060720 msgr2=0x7fb6e4060b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.206+0000 7fb6e9362640 1 -- 172.21.15.38:0/2134268695 shutdown_connections 2023-12-22T08:44:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.206+0000 7fb6e9362640 1 -- 172.21.15.38:0/2134268695 wait complete. 2023-12-22T08:44:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.208+0000 7fb6e9362640 1 Processor -- start 2023-12-22T08:44:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.208+0000 7fb6e9362640 1 -- start start 2023-12-22T08:44:58.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.209+0000 7fb6e9362640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6e40b3cf0 0x7fb6e413a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:58.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.209+0000 7fb6e9362640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6e40cf290 0x7fb6e413f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:58.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.209+0000 7fb6e9362640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6e4144a20 0x7fb6e4141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:58.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.209+0000 7fb6e9362640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e40704b0 con 0x7fb6e40b3cf0 2023-12-22T08:44:58.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.209+0000 7fb6e9362640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e4070790 con 0x7fb6e4144a20 2023-12-22T08:44:58.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.209+0000 7fb6e9362640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e4070a70 con 0x7fb6e40cf290 2023-12-22T08:44:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.209+0000 7fb6e3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6e40b3cf0 0x7fb6e413a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.209+0000 7fb6e3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6e40b3cf0 0x7fb6e413a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59296/0 (socket says 172.21.15.38:59296) 2023-12-22T08:44:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.209+0000 7fb6e3fff640 1 -- 172.21.15.38:0/1389445222 learned_addr learned my addr 172.21.15.38:0/1389445222 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.210+0000 7fb6e3fff640 1 -- 172.21.15.38:0/1389445222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6e40cf290 msgr2=0x7fb6e413f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.210+0000 7fb6e3fff640 1 --2- 172.21.15.38:0/1389445222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6e40cf290 0x7fb6e413f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.210+0000 7fb6e3fff640 1 -- 172.21.15.38:0/1389445222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6e4144a20 msgr2=0x7fb6e4141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.210+0000 7fb6e3fff640 1 --2- 172.21.15.38:0/1389445222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6e4144a20 0x7fb6e4141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.210+0000 7fb6e3fff640 1 -- 172.21.15.38:0/1389445222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d4009b30 con 0x7fb6e40b3cf0 2023-12-22T08:44:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.210+0000 7fb6e3fff640 1 --2- 172.21.15.38:0/1389445222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6e40b3cf0 0x7fb6e413a870 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4000f80 tx=0x7fb6d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.210+0000 7fb6e0ff9640 1 -- 172.21.15.38:0/1389445222 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4009510 con 0x7fb6e40b3cf0 2023-12-22T08:44:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.210+0000 7fb6e0ff9640 1 -- 172.21.15.38:0/1389445222 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d403e450 con 0x7fb6e40b3cf0 2023-12-22T08:44:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.210+0000 7fb6e0ff9640 1 -- 172.21.15.38:0/1389445222 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d403e800 con 0x7fb6e40b3cf0 2023-12-22T08:44:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.210+0000 7fb6e9362640 1 -- 172.21.15.38:0/1389445222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e413adb0 con 0x7fb6e40b3cf0 2023-12-22T08:44:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.210+0000 7fb6e9362640 1 -- 172.21.15.38:0/1389445222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e41403e0 con 0x7fb6e40b3cf0 2023-12-22T08:44:58.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.212+0000 7fb6e9362640 1 -- 172.21.15.38:0/1389445222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e4061910 con 0x7fb6e40b3cf0 2023-12-22T08:44:58.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.213+0000 7fb6e0ff9640 1 -- 172.21.15.38:0/1389445222 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb6d403e960 con 0x7fb6e40b3cf0 2023-12-22T08:44:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.214+0000 7fb6e0ff9640 1 --2- 172.21.15.38:0/1389445222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb6d006a430 0x7fb6d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.214+0000 7fb6e0ff9640 1 -- 172.21.15.38:0/1389445222 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6d40ab710 con 0x7fb6e40b3cf0 2023-12-22T08:44:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.215+0000 7fb6e37fe640 1 --2- 172.21.15.38:0/1389445222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb6d006a430 0x7fb6d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:58.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.216+0000 7fb6e37fe640 1 --2- 172.21.15.38:0/1389445222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb6d006a430 0x7fb6d006c8f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb6e415d7c0 tx=0x7fb6d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.218+0000 7fb6e0ff9640 1 -- 172.21.15.38:0/1389445222 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb6d4076cf0 con 0x7fb6e40b3cf0 2023-12-22T08:44:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:58.457+0000 7fb6e9362640 1 -- 172.21.15.38:0/1389445222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb6e40705f0 con 0x7fb6e40b3cf0 2023-12-22T08:44:59.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.453+0000 7fb6e0ff9640 1 -- 172.21.15.38:0/1389445222 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb6e40705f0 con 0x7fb6e40b3cf0 2023-12-22T08:44:59.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.457+0000 7fb6e9362640 1 -- 172.21.15.38:0/1389445222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb6d006a430 msgr2=0x7fb6d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:59.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.457+0000 7fb6e9362640 1 --2- 172.21.15.38:0/1389445222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb6d006a430 0x7fb6d006c8f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb6e415d7c0 tx=0x7fb6d8008040 comp rx=0 tx=0).stop 2023-12-22T08:44:59.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.457+0000 7fb6e9362640 1 -- 172.21.15.38:0/1389445222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6e40b3cf0 msgr2=0x7fb6e413a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:59.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.457+0000 7fb6e9362640 1 --2- 172.21.15.38:0/1389445222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6e40b3cf0 0x7fb6e413a870 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4000f80 tx=0x7fb6d4004a40 comp rx=0 tx=0).stop 2023-12-22T08:44:59.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.457+0000 7fb6e9362640 1 -- 172.21.15.38:0/1389445222 shutdown_connections 2023-12-22T08:44:59.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.457+0000 7fb6e9362640 1 --2- 172.21.15.38:0/1389445222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6e4144a20 0x7fb6e4141f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.457+0000 7fb6e9362640 1 --2- 172.21.15.38:0/1389445222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6e40cf290 0x7fb6e413f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.457+0000 7fb6e9362640 1 --2- 172.21.15.38:0/1389445222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb6d006a430 0x7fb6d006c8f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.457+0000 7fb6e9362640 1 --2- 172.21.15.38:0/1389445222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6e40b3cf0 0x7fb6e413a870 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.457+0000 7fb6e9362640 1 -- 172.21.15.38:0/1389445222 >> 172.21.15.38:0/1389445222 conn(0x7fb6e4060720 msgr2=0x7fb6e4143c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.458+0000 7fb6e9362640 1 -- 172.21.15.38:0/1389445222 shutdown_connections 2023-12-22T08:44:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.458+0000 7fb6e9362640 1 -- 172.21.15.38:0/1389445222 wait complete. 2023-12-22T08:44:59.479 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T08:44:59.480 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:44:59.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.704+0000 7fe4b20cc640 1 Processor -- start 2023-12-22T08:44:59.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.704+0000 7fe4b20cc640 1 -- start start 2023-12-22T08:44:59.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.706+0000 7fe4b20cc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe4ac0b3ff0 0x7fe4ac06cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:59.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.706+0000 7fe4b20cc640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ac15f220 con 0x7fe4ac157980 2023-12-22T08:44:59.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.706+0000 7fe4b20cc640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ac0d1520 con 0x7fe4ac0b44a0 2023-12-22T08:44:59.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.706+0000 7fe4b20cc640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac0d1800 con 0x7fe4ac0b3ff0 2023-12-22T08:44:59.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.706+0000 7fe4b10ca640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe4ac157980 0x7fe4ac15eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36898/0 (socket says 172.21.15.38:36898) 2023-12-22T08:44:59.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.706+0000 7fe4b10ca640 1 -- 172.21.15.38:0/696109892 learned_addr learned my addr 172.21.15.38:0/696109892 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:44:59.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.706+0000 7fe4b08c9640 1 --2- 172.21.15.38:0/696109892 >> v2:172.21.15.38:3300/0 conn(0x7fe4ac0b3ff0 0x7fe4ac06cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:59.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.707+0000 7fe4b08c9640 1 -- 172.21.15.38:0/696109892 >> v1:172.21.15.89:6789/0 conn(0x7fe4ac0b44a0 legacy=0x7fe4ac0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:44:59.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.707+0000 7fe4b08c9640 1 -- 172.21.15.38:0/696109892 >> v1:172.21.15.38:6789/0 conn(0x7fe4ac157980 legacy=0x7fe4ac15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:59.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.707+0000 7fe4b08c9640 1 -- 172.21.15.38:0/696109892 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac0d1ae0 con 0x7fe4ac0b3ff0 2023-12-22T08:44:59.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.707+0000 7fe4a3fff640 1 -- 172.21.15.38:0/696109892 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152220728 0 0) 0x7fe4ac15f220 con 0x7fe4ac157980 2023-12-22T08:44:59.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.709+0000 7fe4b08c9640 1 --2- 172.21.15.38:0/696109892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4ac0b3ff0 0x7fe4ac06cf30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0097a0 tx=0x7fe49c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830e5fa63d1f3f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:59.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.709+0000 7fe4a3fff640 1 -- 172.21.15.38:0/696109892 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c031830 con 0x7fe4ac0b3ff0 2023-12-22T08:44:59.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.709+0000 7fe4a3fff640 1 -- 172.21.15.38:0/696109892 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c031990 con 0x7fe4ac0b3ff0 2023-12-22T08:44:59.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.709+0000 7fe4a3fff640 1 -- 172.21.15.38:0/696109892 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c031d20 con 0x7fe4ac0b3ff0 2023-12-22T08:44:59.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.709+0000 7fe4b20cc640 1 -- 172.21.15.38:0/696109892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4ac0b3ff0 msgr2=0x7fe4ac06cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:59.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.709+0000 7fe4b20cc640 1 --2- 172.21.15.38:0/696109892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4ac0b3ff0 0x7fe4ac06cf30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0097a0 tx=0x7fe49c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:44:59.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.710+0000 7fe4b20cc640 1 -- 172.21.15.38:0/696109892 shutdown_connections 2023-12-22T08:44:59.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.710+0000 7fe4b20cc640 1 --2- 172.21.15.38:0/696109892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4ac0b3ff0 0x7fe4ac06cf30 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:59.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.710+0000 7fe4b20cc640 1 -- 172.21.15.38:0/696109892 >> 172.21.15.38:0/696109892 conn(0x7fe4ac0d31f0 msgr2=0x7fe4ac0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:59.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.710+0000 7fe4b20cc640 1 -- 172.21.15.38:0/696109892 shutdown_connections 2023-12-22T08:44:59.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.710+0000 7fe4b20cc640 1 -- 172.21.15.38:0/696109892 wait complete. 2023-12-22T08:44:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.711+0000 7fe4b20cc640 1 Processor -- start 2023-12-22T08:44:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.712+0000 7fe4b20cc640 1 -- start start 2023-12-22T08:44:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.712+0000 7fe4b20cc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4ac0b3ff0 0x7fe4ac14dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.712+0000 7fe4b20cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4ac0b44a0 0x7fe4ac14cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b20cc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4ac157980 0x7fe4ac0b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b20cc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac0b8ce0 con 0x7fe4ac157980 2023-12-22T08:44:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b20cc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac0b8470 con 0x7fe4ac0b44a0 2023-12-22T08:44:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b20cc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac1525a0 con 0x7fe4ac0b3ff0 2023-12-22T08:44:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b18cb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4ac157980 0x7fe4ac0b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b18cb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4ac157980 0x7fe4ac0b8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59322/0 (socket says 172.21.15.38:59322) 2023-12-22T08:44:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b18cb640 1 -- 172.21.15.38:0/1394436891 learned_addr learned my addr 172.21.15.38:0/1394436891 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:44:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b10ca640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4ac0b3ff0 0x7fe4ac14dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b08c9640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4ac0b44a0 0x7fe4ac14cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b18cb640 1 -- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4ac0b3ff0 msgr2=0x7fe4ac14dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b18cb640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4ac0b3ff0 0x7fe4ac14dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b18cb640 1 -- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4ac0b44a0 msgr2=0x7fe4ac14cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b18cb640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4ac0b44a0 0x7fe4ac14cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.713+0000 7fe4b18cb640 1 -- 172.21.15.38:0/1394436891 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c009400 con 0x7fe4ac157980 2023-12-22T08:44:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.714+0000 7fe4b18cb640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4ac157980 0x7fe4ac0b8650 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400c780 tx=0x7fe4a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.714+0000 7fe4a1ffb640 1 -- 172.21.15.38:0/1394436891 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4004b60 con 0x7fe4ac157980 2023-12-22T08:44:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.714+0000 7fe4a1ffb640 1 -- 172.21.15.38:0/1394436891 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a400ce90 con 0x7fe4ac157980 2023-12-22T08:44:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.714+0000 7fe4a1ffb640 1 -- 172.21.15.38:0/1394436891 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a400a7f0 con 0x7fe4ac157980 2023-12-22T08:44:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.714+0000 7fe4b20cc640 1 -- 172.21.15.38:0/1394436891 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ac152880 con 0x7fe4ac157980 2023-12-22T08:44:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.714+0000 7fe4b20cc640 1 -- 172.21.15.38:0/1394436891 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ac152e40 con 0x7fe4ac157980 2023-12-22T08:44:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.715+0000 7fe4b20cc640 1 -- 172.21.15.38:0/1394436891 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ac061910 con 0x7fe4ac157980 2023-12-22T08:44:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.716+0000 7fe4a1ffb640 1 -- 172.21.15.38:0/1394436891 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe4a400a950 con 0x7fe4ac157980 2023-12-22T08:44:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.717+0000 7fe4a1ffb640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe49006a430 0x7fe49006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:44:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.717+0000 7fe4a1ffb640 1 -- 172.21.15.38:0/1394436891 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4a4088b30 con 0x7fe4ac157980 2023-12-22T08:44:59.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.718+0000 7fe4b10ca640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe49006a430 0x7fe49006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:44:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.719+0000 7fe4b10ca640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe49006a430 0x7fe49006c8f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8000f60 tx=0x7fe4a8007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:44:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.722+0000 7fe4a1ffb640 1 -- 172.21.15.38:0/1394436891 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe4a4054110 con 0x7fe4ac157980 2023-12-22T08:44:59.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.958+0000 7fe4b20cc640 1 -- 172.21.15.38:0/1394436891 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4ac0b5510 con 0x7fe4ac157980 2023-12-22T08:44:59.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.959+0000 7fe4a1ffb640 1 -- 172.21.15.38:0/1394436891 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4650 (secure 0 0 0) 0x7fe4a4057730 con 0x7fe4ac157980 2023-12-22T08:44:59.961 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:44:59.962 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2128001687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2128001687},{"type":"v1","addr":"172.21.15.89:6837","nonce":2128001687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6438,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1632983842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1632983842},{"type":"v1","addr":"172.21.15.38:6833","nonce":1632983842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6444,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2613790013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2613790013},{"type":"v1","addr":"172.21.15.38:6835","nonce":2613790013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:44:55.928210+0000","modified":"2023-12-22T08:44:59.439959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6447},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6447":{"gid":6447,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2576950091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2576950091},{"type":"v1","addr":"172.21.15.89:6836","nonce":2576950091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-22T08:44:59.962 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 40 2023-12-22T08:44:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.962+0000 7fe4b20cc640 1 -- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe49006a430 msgr2=0x7fe49006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.962+0000 7fe4b20cc640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe49006a430 0x7fe49006c8f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8000f60 tx=0x7fe4a8007c00 comp rx=0 tx=0).stop 2023-12-22T08:44:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.962+0000 7fe4b20cc640 1 -- 172.21.15.38:0/1394436891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4ac157980 msgr2=0x7fe4ac0b8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:44:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.962+0000 7fe4b20cc640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4ac157980 0x7fe4ac0b8650 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400c780 tx=0x7fe4a400cc40 comp rx=0 tx=0).stop 2023-12-22T08:44:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.962+0000 7fe4b20cc640 1 -- 172.21.15.38:0/1394436891 shutdown_connections 2023-12-22T08:44:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.962+0000 7fe4b20cc640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe49006a430 0x7fe49006c8f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.962+0000 7fe4b20cc640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4ac157980 0x7fe4ac0b8650 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:59.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.962+0000 7fe4b20cc640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4ac0b44a0 0x7fe4ac14cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:59.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.962+0000 7fe4b20cc640 1 --2- 172.21.15.38:0/1394436891 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4ac0b3ff0 0x7fe4ac14dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:44:59.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.962+0000 7fe4b20cc640 1 -- 172.21.15.38:0/1394436891 >> 172.21.15.38:0/1394436891 conn(0x7fe4ac0d31f0 msgr2=0x7fe4ac15f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:44:59.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.962+0000 7fe4b20cc640 1 -- 172.21.15.38:0/1394436891 shutdown_connections 2023-12-22T08:44:59.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:44:59.963+0000 7fe4b20cc640 1 -- 172.21.15.38:0/1394436891 wait complete. 2023-12-22T08:44:59.985 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:45:00.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.210+0000 7f34664b6640 1 Processor -- start 2023-12-22T08:45:00.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.210+0000 7f34664b6640 1 -- start start 2023-12-22T08:45:00.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.211+0000 7f34664b6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f34600b2050 0x7f34600b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.211+0000 7f34664b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3460070800 0x7f3460070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.212+0000 7f34664b6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34601450f0 con 0x7f3460144d10 2023-12-22T08:45:00.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.212+0000 7f34664b6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34600cc840 con 0x7f34600b2050 2023-12-22T08:45:00.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.212+0000 7f34664b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34600ce010 con 0x7f3460070800 2023-12-22T08:45:00.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.212+0000 7f345f7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f34600b2050 0x7f34600b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.212+0000 7f345f7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f34600b2050 0x7f34600b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59326/0 (socket says 172.21.15.38:59326) 2023-12-22T08:45:00.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.212+0000 7f345f7fe640 1 -- 172.21.15.38:0/2327966579 learned_addr learned my addr 172.21.15.38:0/2327966579 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:00.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.212+0000 7f3464a53640 1 --2- 172.21.15.38:0/2327966579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3460070800 0x7f3460070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.212+0000 7f345f7fe640 1 -- 172.21.15.38:0/2327966579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3460070800 msgr2=0x7f3460070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:00.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.213+0000 7f345f7fe640 1 --2- 172.21.15.38:0/2327966579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3460070800 0x7f3460070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.213+0000 7f345f7fe640 1 -- 172.21.15.38:0/2327966579 >> v1:172.21.15.38:6789/0 conn(0x7f3460144d10 legacy=0x7f34600cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:00.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.213+0000 7f345f7fe640 1 -- 172.21.15.38:0/2327966579 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34600b29f0 con 0x7f34600b2050 2023-12-22T08:45:00.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.213+0000 7f3464a53640 1 --2- 172.21.15.38:0/2327966579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3460070800 0x7f3460070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:00.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.214+0000 7f345f7fe640 1 --2- 172.21.15.38:0/2327966579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34600b2050 0x7f34600b24b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f3448009870 tx=0x7f344802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6701e27fbdd3cf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:00.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.214+0000 7f345effd640 1 -- 172.21.15.38:0/2327966579 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448030840 con 0x7f34600b2050 2023-12-22T08:45:00.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.214+0000 7f345effd640 1 -- 172.21.15.38:0/2327966579 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34480309a0 con 0x7f34600b2050 2023-12-22T08:45:00.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.214+0000 7f345effd640 1 -- 172.21.15.38:0/2327966579 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448030d30 con 0x7f34600b2050 2023-12-22T08:45:00.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.215+0000 7f34664b6640 1 -- 172.21.15.38:0/2327966579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34600b2050 msgr2=0x7f34600b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:00.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.215+0000 7f34664b6640 1 --2- 172.21.15.38:0/2327966579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34600b2050 0x7f34600b24b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f3448009870 tx=0x7f344802b980 comp rx=0 tx=0).stop 2023-12-22T08:45:00.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.215+0000 7f34664b6640 1 -- 172.21.15.38:0/2327966579 shutdown_connections 2023-12-22T08:45:00.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.215+0000 7f34664b6640 1 --2- 172.21.15.38:0/2327966579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3460070800 0x7f3460070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.215+0000 7f34664b6640 1 --2- 172.21.15.38:0/2327966579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34600b2050 0x7f34600b24b0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.215+0000 7f34664b6640 1 -- 172.21.15.38:0/2327966579 >> 172.21.15.38:0/2327966579 conn(0x7f34600cf070 msgr2=0x7f34600cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:00.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.215+0000 7f34664b6640 1 -- 172.21.15.38:0/2327966579 shutdown_connections 2023-12-22T08:45:00.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.215+0000 7f34664b6640 1 -- 172.21.15.38:0/2327966579 wait complete. 2023-12-22T08:45:00.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.217+0000 7f34664b6640 1 Processor -- start 2023-12-22T08:45:00.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.217+0000 7f34664b6640 1 -- start start 2023-12-22T08:45:00.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.218+0000 7f34664b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3460070800 0x7f346013f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.218+0000 7f34664b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34600b2050 0x7f34601440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.218+0000 7f34664b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3460144d10 0x7f34600ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.218+0000 7f34664b6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346013f600 con 0x7f3460144d10 2023-12-22T08:45:00.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.218+0000 7f34664b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34601445e0 con 0x7f34600b2050 2023-12-22T08:45:00.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.218+0000 7f34664b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34601f27b0 con 0x7f3460070800 2023-12-22T08:45:00.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.218+0000 7f3464a53640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3460144d10 0x7f34600ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.218+0000 7f3464a53640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3460144d10 0x7f34600ad740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59328/0 (socket says 172.21.15.38:59328) 2023-12-22T08:45:00.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.218+0000 7f3464a53640 1 -- 172.21.15.38:0/3185548643 learned_addr learned my addr 172.21.15.38:0/3185548643 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:00.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.219+0000 7f345f7fe640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34600b2050 0x7f34601440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.219+0000 7f3464a53640 1 -- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3460070800 msgr2=0x7f346013f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:00.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.219+0000 7f345ffff640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3460070800 0x7f346013f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.219+0000 7f3464a53640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3460070800 0x7f346013f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.219+0000 7f3464a53640 1 -- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34600b2050 msgr2=0x7f34601440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:00.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.219+0000 7f3464a53640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34600b2050 0x7f34601440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.219+0000 7f3464a53640 1 -- 172.21.15.38:0/3185548643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34480094d0 con 0x7f3460144d10 2023-12-22T08:45:00.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.219+0000 7f345f7fe640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34600b2050 0x7f34601440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:00.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.219+0000 7f345ffff640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3460070800 0x7f346013f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:00.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.219+0000 7f3464a53640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3460144d10 0x7f34600ad740 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f345800c820 tx=0x7f345800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:00.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.220+0000 7f345cff9640 1 -- 172.21.15.38:0/3185548643 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458007a30 con 0x7f3460144d10 2023-12-22T08:45:00.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.220+0000 7f345cff9640 1 -- 172.21.15.38:0/3185548643 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3458007b90 con 0x7f3460144d10 2023-12-22T08:45:00.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.220+0000 7f345cff9640 1 -- 172.21.15.38:0/3185548643 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345800ce10 con 0x7f3460144d10 2023-12-22T08:45:00.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.220+0000 7f34664b6640 1 -- 172.21.15.38:0/3185548643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34600aff50 con 0x7f3460144d10 2023-12-22T08:45:00.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.220+0000 7f34664b6640 1 -- 172.21.15.38:0/3185548643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34600b0510 con 0x7f3460144d10 2023-12-22T08:45:00.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.221+0000 7f34664b6640 1 -- 172.21.15.38:0/3185548643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34601f28f0 con 0x7f3460144d10 2023-12-22T08:45:00.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.222+0000 7f345cff9640 1 -- 172.21.15.38:0/3185548643 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f34580113f0 con 0x7f3460144d10 2023-12-22T08:45:00.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.223+0000 7f345cff9640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f344006a430 0x7f344006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.223+0000 7f345cff9640 1 -- 172.21.15.38:0/3185548643 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3458088ad0 con 0x7f3460144d10 2023-12-22T08:45:00.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.224+0000 7f345ffff640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f344006a430 0x7f344006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.225+0000 7f345ffff640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f344006a430 0x7f344006c8f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f34500012e0 tx=0x7f3450009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:00.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.227+0000 7f345cff9640 1 -- 172.21.15.38:0/3185548643 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3458054020 con 0x7f3460144d10 2023-12-22T08:45:00.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.421+0000 7f34664b6640 1 -- 172.21.15.38:0/3185548643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3460061910 con 0x7f3460144d10 2023-12-22T08:45:00.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.423+0000 7f345cff9640 1 -- 172.21.15.38:0/3185548643 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15992 (secure 0 0 0) 0x7f345801f090 con 0x7f3460144d10 2023-12-22T08:45:00.425 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:00.425 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":89,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:44:56.932752+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:44:53.802762+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-22T08:44:54.948144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:45:00.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.425+0000 7f34664b6640 1 -- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f344006a430 msgr2=0x7f344006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:00.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.425+0000 7f34664b6640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f344006a430 0x7f344006c8f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f34500012e0 tx=0x7f3450009040 comp rx=0 tx=0).stop 2023-12-22T08:45:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.425+0000 7f34664b6640 1 -- 172.21.15.38:0/3185548643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3460144d10 msgr2=0x7f34600ad740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.425+0000 7f34664b6640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3460144d10 0x7f34600ad740 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f345800c820 tx=0x7f345800cce0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.426+0000 7f34664b6640 1 -- 172.21.15.38:0/3185548643 shutdown_connections 2023-12-22T08:45:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.426+0000 7f34664b6640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f344006a430 0x7f344006c8f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.426+0000 7f34664b6640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3460144d10 0x7f34600ad740 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.426+0000 7f34664b6640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34600b2050 0x7f34601440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.426+0000 7f34664b6640 1 --2- 172.21.15.38:0/3185548643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3460070800 0x7f346013f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.426+0000 7f34664b6640 1 -- 172.21.15.38:0/3185548643 >> 172.21.15.38:0/3185548643 conn(0x7f34600cf070 msgr2=0x7f346015c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.426+0000 7f34664b6640 1 -- 172.21.15.38:0/3185548643 shutdown_connections 2023-12-22T08:45:00.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.426+0000 7f34664b6640 1 -- 172.21.15.38:0/3185548643 wait complete. 2023-12-22T08:45:00.447 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T08:45:00.448 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:45:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.661+0000 7f6217e26640 1 Processor -- start 2023-12-22T08:45:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.662+0000 7f6217e26640 1 -- start start 2023-12-22T08:45:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.663+0000 7f6217e26640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f62100b24b0 0x7f6210070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.663+0000 7f6217e26640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62101450f0 con 0x7f62100b2050 2023-12-22T08:45:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.663+0000 7f6217e26640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100cc840 con 0x7f6210144d10 2023-12-22T08:45:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.663+0000 7f6217e26640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62100ce010 con 0x7f62100b24b0 2023-12-22T08:45:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.664+0000 7f62153c1640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f62100b2050 0x7f6210070800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36912/0 (socket says 172.21.15.38:36912) 2023-12-22T08:45:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.664+0000 7f62153c1640 1 -- 172.21.15.38:0/3892073585 learned_addr learned my addr 172.21.15.38:0/3892073585 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.664+0000 7f62163c3640 1 --2- 172.21.15.38:0/3892073585 >> v2:172.21.15.89:3300/0 conn(0x7f62100b24b0 0x7f6210070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.664+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070589452 0 0) 0x7f62101450f0 con 0x7f62100b2050 2023-12-22T08:45:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.664+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61fc003520 con 0x7f62100b2050 2023-12-22T08:45:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3182431813 0 0) 0x7f61fc003520 con 0x7f62100b2050 2023-12-22T08:45:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 >> v2:172.21.15.89:3300/0 conn(0x7f62100b24b0 msgr2=0x7f6210070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6214bc0640 1 --2- 172.21.15.38:0/3892073585 >> v2:172.21.15.89:3300/0 conn(0x7f62100b24b0 0x7f6210070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 >> v1:172.21.15.89:6789/0 conn(0x7f6210144d10 legacy=0x7f62100cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100ce2f0 con 0x7f62100b2050 2023-12-22T08:45:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f6204001670 con 0x7f62100b2050 2023-12-22T08:45:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 >> v1:172.21.15.38:6789/0 conn(0x7f62100b2050 legacy=0x7f6210070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6214bc0640 1 --2- 172.21.15.38:0/3892073585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61fc003970 0x7f61fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6214bc0640 1 --2- 172.21.15.38:0/3892073585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61fc0047c0 0x7f61fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6214bc0640 1 --2- 172.21.15.38:0/3892073585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61fc005180 0x7f61fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62100ce010 con 0x7f61fc0047c0 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc00c020 con 0x7f61fc005180 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc00c1e0 con 0x7f61fc003970 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f62153c1640 1 --2- 172.21.15.38:0/3892073585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61fc0047c0 0x7f61fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f6215bc2640 1 --2- 172.21.15.38:0/3892073585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61fc003970 0x7f61fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.665+0000 7f62163c3640 1 --2- 172.21.15.38:0/3892073585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61fc005180 0x7f61fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.666+0000 7f62153c1640 1 -- 172.21.15.38:0/3892073585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61fc003970 msgr2=0x7f61fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.666+0000 7f62153c1640 1 --2- 172.21.15.38:0/3892073585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61fc003970 0x7f61fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.666+0000 7f62153c1640 1 -- 172.21.15.38:0/3892073585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61fc005180 msgr2=0x7f61fc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.666+0000 7f62153c1640 1 --2- 172.21.15.38:0/3892073585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61fc005180 0x7f61fc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.666+0000 7f62153c1640 1 -- 172.21.15.38:0/3892073585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61fc003520 con 0x7f61fc0047c0 2023-12-22T08:45:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.666+0000 7f62163c3640 1 -- 172.21.15.38:0/3892073585 reap_dead start 2023-12-22T08:45:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.667+0000 7f62153c1640 1 --2- 172.21.15.38:0/3892073585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61fc0047c0 0x7f61fc004c40 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f620400c190 tx=0x7f61fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9879c11f6107598d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:00.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.667+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204005ad0 con 0x7f61fc0047c0 2023-12-22T08:45:00.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.667+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6204005c30 con 0x7f61fc0047c0 2023-12-22T08:45:00.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.667+0000 7f6214bc0640 1 -- 172.21.15.38:0/3892073585 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620402cab0 con 0x7f61fc0047c0 2023-12-22T08:45:00.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.668+0000 7f6217e26640 1 -- 172.21.15.38:0/3892073585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61fc0047c0 msgr2=0x7f61fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:00.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.668+0000 7f6217e26640 1 --2- 172.21.15.38:0/3892073585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61fc0047c0 0x7f61fc004c40 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f620400c190 tx=0x7f61fc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.668+0000 7f6217e26640 1 -- 172.21.15.38:0/3892073585 shutdown_connections 2023-12-22T08:45:00.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.668+0000 7f6217e26640 1 --2- 172.21.15.38:0/3892073585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61fc0047c0 0x7f61fc004c40 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.668+0000 7f6217e26640 1 -- 172.21.15.38:0/3892073585 >> 172.21.15.38:0/3892073585 conn(0x7f62100cf070 msgr2=0x7f62100cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:00.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.668+0000 7f6217e26640 1 -- 172.21.15.38:0/3892073585 shutdown_connections 2023-12-22T08:45:00.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.668+0000 7f6217e26640 1 -- 172.21.15.38:0/3892073585 wait complete. 2023-12-22T08:45:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.670+0000 7f6217e26640 1 Processor -- start 2023-12-22T08:45:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.670+0000 7f6217e26640 1 -- start start 2023-12-22T08:45:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.671+0000 7f6217e26640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61fc0047c0 0x7f62100aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.671+0000 7f6217e26640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6210138b50 0x7f62101383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.671+0000 7f6217e26640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62100b0330 0x7f62100cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.671+0000 7f6217e26640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62100af060 con 0x7f6210138b50 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.671+0000 7f6217e26640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6210141910 con 0x7f62100b0330 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.671+0000 7f6217e26640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62100af290 con 0x7f61fc0047c0 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.671+0000 7f62153c1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6210138b50 0x7f62101383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.672+0000 7f62153c1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6210138b50 0x7f62101383b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59342/0 (socket says 172.21.15.38:59342) 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.672+0000 7f62153c1640 1 -- 172.21.15.38:0/2385892746 learned_addr learned my addr 172.21.15.38:0/2385892746 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.672+0000 7f6215bc2640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61fc0047c0 0x7f62100aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.672+0000 7f62163c3640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62100b0330 0x7f62100cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.672+0000 7f62153c1640 1 -- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61fc0047c0 msgr2=0x7f62100aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.672+0000 7f62153c1640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61fc0047c0 0x7f62100aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.672+0000 7f62153c1640 1 -- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62100b0330 msgr2=0x7f62100cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.672+0000 7f62153c1640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62100b0330 0x7f62100cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.672+0000 7f62153c1640 1 -- 172.21.15.38:0/2385892746 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100af570 con 0x7f6210138b50 2023-12-22T08:45:00.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.672+0000 7f62153c1640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6210138b50 0x7f62101383b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f6204001930 tx=0x7f620402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:00.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.673+0000 7f62027fc640 1 -- 172.21.15.38:0/2385892746 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620403c040 con 0x7f6210138b50 2023-12-22T08:45:00.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.673+0000 7f62027fc640 1 -- 172.21.15.38:0/2385892746 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620402cc80 con 0x7f6210138b50 2023-12-22T08:45:00.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.673+0000 7f6217e26640 1 -- 172.21.15.38:0/2385892746 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62100af850 con 0x7f6210138b50 2023-12-22T08:45:00.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.673+0000 7f62027fc640 1 -- 172.21.15.38:0/2385892746 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204007070 con 0x7f6210138b50 2023-12-22T08:45:00.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.673+0000 7f6217e26640 1 -- 172.21.15.38:0/2385892746 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62100afe10 con 0x7f6210138b50 2023-12-22T08:45:00.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.674+0000 7f6217e26640 1 -- 172.21.15.38:0/2385892746 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6210061910 con 0x7f6210138b50 2023-12-22T08:45:00.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.675+0000 7f62027fc640 1 -- 172.21.15.38:0/2385892746 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6204032070 con 0x7f6210138b50 2023-12-22T08:45:00.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.676+0000 7f62027fc640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f61f406a460 0x7f61f406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:00.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.676+0000 7f62027fc640 1 -- 172.21.15.38:0/2385892746 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62040a9d60 con 0x7f6210138b50 2023-12-22T08:45:00.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.677+0000 7f6215bc2640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f61f406a460 0x7f61f406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:00.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.678+0000 7f6215bc2640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f61f406a460 0x7f61f406c920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f620c000c00 tx=0x7f620c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.681+0000 7f62027fc640 1 -- 172.21.15.38:0/2385892746 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f62040753d0 con 0x7f6210138b50 2023-12-22T08:45:00.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.869+0000 7f6217e26640 1 -- 172.21.15.38:0/2385892746 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62100ce8b0 con 0x7f61f406a460 2023-12-22T08:45:00.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.893+0000 7f62027fc640 1 -- 172.21.15.38:0/2385892746 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282272 (secure 0 0 0) 0x7f620c001350 con 0x7f61f406a460 2023-12-22T08:45:00.923 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:00.925 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:45:00.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.900+0000 7f6217e26640 1 -- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f61f406a460 msgr2=0x7f61f406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:00.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.900+0000 7f6217e26640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f61f406a460 0x7f61f406c920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f620c000c00 tx=0x7f620c009040 comp rx=0 tx=0).stop 2023-12-22T08:45:00.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.900+0000 7f6217e26640 1 -- 172.21.15.38:0/2385892746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6210138b50 msgr2=0x7f62101383b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:00.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.900+0000 7f6217e26640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6210138b50 0x7f62101383b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f6204001930 tx=0x7f620402e070 comp rx=0 tx=0).stop 2023-12-22T08:45:00.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.900+0000 7f6217e26640 1 -- 172.21.15.38:0/2385892746 shutdown_connections 2023-12-22T08:45:00.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.900+0000 7f6217e26640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62100b0330 0x7f62100cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.900+0000 7f6217e26640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f61f406a460 0x7f61f406c920 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.900+0000 7f6217e26640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6210138b50 0x7f62101383b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.900+0000 7f6217e26640 1 --2- 172.21.15.38:0/2385892746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61fc0047c0 0x7f62100aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:00.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.900+0000 7f6217e26640 1 -- 172.21.15.38:0/2385892746 >> 172.21.15.38:0/2385892746 conn(0x7f62100cf070 msgr2=0x7f62101595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:00.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.901+0000 7f6217e26640 1 -- 172.21.15.38:0/2385892746 shutdown_connections 2023-12-22T08:45:00.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:00.901+0000 7f6217e26640 1 -- 172.21.15.38:0/2385892746 wait complete. 2023-12-22T08:45:00.928 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2023-12-22T08:45:00.465531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4859,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557640,"statfs":{"total":1600000000,"available":1595023391,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002040"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962957+0000","last_change":"2023-12-22T08:44:55.957119+0000","last_active":"2023-12-22T08:44:57.962957+0000","last_peered":"2023-12-22T08:44:57.962957+0000","last_clean":"2023-12-22T08:44:57.962957+0000","last_became_active":"2023-12-22T08:44:55.956103+0000","last_became_peered":"2023-12-22T08:44:55.956103+0000","last_unstale":"2023-12-22T08:44:57.962957+0000","last_undegraded":"2023-12-22T08:44:57.962957+0000","last_fullsized":"2023-12-22T08:44:57.962957+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:10:23.314856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.938972+0000","last_change":"2023-12-22T08:44:55.963600+0000","last_active":"2023-12-22T08:44:56.938972+0000","last_peered":"2023-12-22T08:44:56.938972+0000","last_clean":"2023-12-22T08:44:56.938972+0000","last_became_active":"2023-12-22T08:44:55.963256+0000","last_became_peered":"2023-12-22T08:44:55.963256+0000","last_unstale":"2023-12-22T08:44:56.938972+0000","last_undegraded":"2023-12-22T08:44:56.938972+0000","last_fullsized":"2023-12-22T08:44:56.938972+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:03:11.620542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806027+0000","last_change":"2023-12-22T08:44:55.968496+0000","last_active":"2023-12-22T08:44:57.806027+0000","last_peered":"2023-12-22T08:44:57.806027+0000","last_clean":"2023-12-22T08:44:57.806027+0000","last_became_active":"2023-12-22T08:44:55.967738+0000","last_became_peered":"2023-12-22T08:44:55.967738+0000","last_unstale":"2023-12-22T08:44:57.806027+0000","last_undegraded":"2023-12-22T08:44:57.806027+0000","last_fullsized":"2023-12-22T08:44:57.806027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:44:23.339301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.805954+0000","last_change":"2023-12-22T08:44:55.968018+0000","last_active":"2023-12-22T08:44:57.805954+0000","last_peered":"2023-12-22T08:44:57.805954+0000","last_clean":"2023-12-22T08:44:57.805954+0000","last_became_active":"2023-12-22T08:44:55.967784+0000","last_became_peered":"2023-12-22T08:44:55.967784+0000","last_unstale":"2023-12-22T08:44:57.805954+0000","last_undegraded":"2023-12-22T08:44:57.805954+0000","last_fullsized":"2023-12-22T08:44:57.805954+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:13:41.534342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.942151+0000","last_change":"2023-12-22T08:44:55.954197+0000","last_active":"2023-12-22T08:44:56.942151+0000","last_peered":"2023-12-22T08:44:56.942151+0000","last_clean":"2023-12-22T08:44:56.942151+0000","last_became_active":"2023-12-22T08:44:55.953733+0000","last_became_peered":"2023-12-22T08:44:55.953733+0000","last_unstale":"2023-12-22T08:44:56.942151+0000","last_undegraded":"2023-12-22T08:44:56.942151+0000","last_fullsized":"2023-12-22T08:44:56.942151+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:10:46.427361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964292+0000","last_change":"2023-12-22T08:44:55.960704+0000","last_active":"2023-12-22T08:44:57.964292+0000","last_peered":"2023-12-22T08:44:57.964292+0000","last_clean":"2023-12-22T08:44:57.964292+0000","last_became_active":"2023-12-22T08:44:55.960327+0000","last_became_peered":"2023-12-22T08:44:55.960327+0000","last_unstale":"2023-12-22T08:44:57.964292+0000","last_undegraded":"2023-12-22T08:44:57.964292+0000","last_fullsized":"2023-12-22T08:44:57.964292+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:23:37.624999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962801+0000","last_change":"2023-12-22T08:44:55.962476+0000","last_active":"2023-12-22T08:44:57.962801+0000","last_peered":"2023-12-22T08:44:57.962801+0000","last_clean":"2023-12-22T08:44:57.962801+0000","last_became_active":"2023-12-22T08:44:55.961958+0000","last_became_peered":"2023-12-22T08:44:55.961958+0000","last_unstale":"2023-12-22T08:44:57.962801+0000","last_undegraded":"2023-12-22T08:44:57.962801+0000","last_fullsized":"2023-12-22T08:44:57.962801+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:16:26.999597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962872+0000","last_change":"2023-12-22T08:44:55.952685+0000","last_active":"2023-12-22T08:44:57.962872+0000","last_peered":"2023-12-22T08:44:57.962872+0000","last_clean":"2023-12-22T08:44:57.962872+0000","last_became_active":"2023-12-22T08:44:55.952360+0000","last_became_peered":"2023-12-22T08:44:55.952360+0000","last_unstale":"2023-12-22T08:44:57.962872+0000","last_undegraded":"2023-12-22T08:44:57.962872+0000","last_fullsized":"2023-12-22T08:44:57.962872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:31:41.096332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806130+0000","last_change":"2023-12-22T08:44:55.959399+0000","last_active":"2023-12-22T08:44:57.806130+0000","last_peered":"2023-12-22T08:44:57.806130+0000","last_clean":"2023-12-22T08:44:57.806130+0000","last_became_active":"2023-12-22T08:44:55.958662+0000","last_became_peered":"2023-12-22T08:44:55.958662+0000","last_unstale":"2023-12-22T08:44:57.806130+0000","last_undegraded":"2023-12-22T08:44:57.806130+0000","last_fullsized":"2023-12-22T08:44:57.806130+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:35.327092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.966216+0000","last_change":"2023-12-22T08:44:55.967439+0000","last_active":"2023-12-22T08:44:57.966216+0000","last_peered":"2023-12-22T08:44:57.966216+0000","last_clean":"2023-12-22T08:44:57.966216+0000","last_became_active":"2023-12-22T08:44:55.966519+0000","last_became_peered":"2023-12-22T08:44:55.966519+0000","last_unstale":"2023-12-22T08:44:57.966216+0000","last_undegraded":"2023-12-22T08:44:57.966216+0000","last_fullsized":"2023-12-22T08:44:57.966216+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:13:41.534342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964438+0000","last_change":"2023-12-22T08:44:55.949696+0000","last_active":"2023-12-22T08:44:57.964438+0000","last_peered":"2023-12-22T08:44:57.964438+0000","last_clean":"2023-12-22T08:44:57.964438+0000","last_became_active":"2023-12-22T08:44:55.949445+0000","last_became_peered":"2023-12-22T08:44:55.949445+0000","last_unstale":"2023-12-22T08:44:57.964438+0000","last_undegraded":"2023-12-22T08:44:57.964438+0000","last_fullsized":"2023-12-22T08:44:57.964438+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:42:42.851289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.941477+0000","last_change":"2023-12-22T08:44:55.946791+0000","last_active":"2023-12-22T08:44:56.941477+0000","last_peered":"2023-12-22T08:44:56.941477+0000","last_clean":"2023-12-22T08:44:56.941477+0000","last_became_active":"2023-12-22T08:44:55.946322+0000","last_became_peered":"2023-12-22T08:44:55.946322+0000","last_unstale":"2023-12-22T08:44:56.941477+0000","last_undegraded":"2023-12-22T08:44:56.941477+0000","last_fullsized":"2023-12-22T08:44:56.941477+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:14.621279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806326+0000","last_change":"2023-12-22T08:44:55.968620+0000","last_active":"2023-12-22T08:44:57.806326+0000","last_peered":"2023-12-22T08:44:57.806326+0000","last_clean":"2023-12-22T08:44:57.806326+0000","last_became_active":"2023-12-22T08:44:55.968280+0000","last_became_peered":"2023-12-22T08:44:55.968280+0000","last_unstale":"2023-12-22T08:44:57.806326+0000","last_undegraded":"2023-12-22T08:44:57.806326+0000","last_fullsized":"2023-12-22T08:44:57.806326+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:16:26.999597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939929+0000","last_change":"2023-12-22T08:44:55.963082+0000","last_active":"2023-12-22T08:44:56.939929+0000","last_peered":"2023-12-22T08:44:56.939929+0000","last_clean":"2023-12-22T08:44:56.939929+0000","last_became_active":"2023-12-22T08:44:55.962537+0000","last_became_peered":"2023-12-22T08:44:55.962537+0000","last_unstale":"2023-12-22T08:44:56.939929+0000","last_undegraded":"2023-12-22T08:44:56.939929+0000","last_fullsized":"2023-12-22T08:44:56.939929+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:30.124618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.942495+0000","last_change":"2023-12-22T08:44:55.944583+0000","last_active":"2023-12-22T08:44:56.942495+0000","last_peered":"2023-12-22T08:44:56.942495+0000","last_clean":"2023-12-22T08:44:56.942495+0000","last_became_active":"2023-12-22T08:44:55.944359+0000","last_became_peered":"2023-12-22T08:44:55.944359+0000","last_unstale":"2023-12-22T08:44:56.942495+0000","last_undegraded":"2023-12-22T08:44:56.942495+0000","last_fullsized":"2023-12-22T08:44:56.942495+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:17:26.666640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963414+0000","last_change":"2023-12-22T08:44:55.957269+0000","last_active":"2023-12-22T08:44:57.963414+0000","last_peered":"2023-12-22T08:44:57.963414+0000","last_clean":"2023-12-22T08:44:57.963414+0000","last_became_active":"2023-12-22T08:44:55.956447+0000","last_became_peered":"2023-12-22T08:44:55.956447+0000","last_unstale":"2023-12-22T08:44:57.963414+0000","last_undegraded":"2023-12-22T08:44:57.963414+0000","last_fullsized":"2023-12-22T08:44:57.963414+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:32:11.905112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940962+0000","last_change":"2023-12-22T08:44:55.960236+0000","last_active":"2023-12-22T08:44:56.940962+0000","last_peered":"2023-12-22T08:44:56.940962+0000","last_clean":"2023-12-22T08:44:56.940962+0000","last_became_active":"2023-12-22T08:44:55.958903+0000","last_became_peered":"2023-12-22T08:44:55.958903+0000","last_unstale":"2023-12-22T08:44:56.940962+0000","last_undegraded":"2023-12-22T08:44:56.940962+0000","last_fullsized":"2023-12-22T08:44:56.940962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:08:05.329832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940054+0000","last_change":"2023-12-22T08:44:55.964442+0000","last_active":"2023-12-22T08:44:56.940054+0000","last_peered":"2023-12-22T08:44:56.940054+0000","last_clean":"2023-12-22T08:44:56.940054+0000","last_became_active":"2023-12-22T08:44:55.964239+0000","last_became_peered":"2023-12-22T08:44:55.964239+0000","last_unstale":"2023-12-22T08:44:56.940054+0000","last_undegraded":"2023-12-22T08:44:56.940054+0000","last_fullsized":"2023-12-22T08:44:56.940054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:57:52.591908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962354+0000","last_change":"2023-12-22T08:44:55.953050+0000","last_active":"2023-12-22T08:44:57.962354+0000","last_peered":"2023-12-22T08:44:57.962354+0000","last_clean":"2023-12-22T08:44:57.962354+0000","last_became_active":"2023-12-22T08:44:55.952277+0000","last_became_peered":"2023-12-22T08:44:55.952277+0000","last_unstale":"2023-12-22T08:44:57.962354+0000","last_undegraded":"2023-12-22T08:44:57.962354+0000","last_fullsized":"2023-12-22T08:44:57.962354+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:24:06.396481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.942360+0000","last_change":"2023-12-22T08:44:55.952163+0000","last_active":"2023-12-22T08:44:56.942360+0000","last_peered":"2023-12-22T08:44:56.942360+0000","last_clean":"2023-12-22T08:44:56.942360+0000","last_became_active":"2023-12-22T08:44:55.951806+0000","last_became_peered":"2023-12-22T08:44:55.951806+0000","last_unstale":"2023-12-22T08:44:56.942360+0000","last_undegraded":"2023-12-22T08:44:56.942360+0000","last_fullsized":"2023-12-22T08:44:56.942360+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:28:17.250266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.938716+0000","last_change":"2023-12-22T08:44:55.959178+0000","last_active":"2023-12-22T08:44:56.938716+0000","last_peered":"2023-12-22T08:44:56.938716+0000","last_clean":"2023-12-22T08:44:56.938716+0000","last_became_active":"2023-12-22T08:44:55.958863+0000","last_became_peered":"2023-12-22T08:44:55.958863+0000","last_unstale":"2023-12-22T08:44:56.938716+0000","last_undegraded":"2023-12-22T08:44:56.938716+0000","last_fullsized":"2023-12-22T08:44:56.938716+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:52:36.647797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964209+0000","last_change":"2023-12-22T08:44:55.954974+0000","last_active":"2023-12-22T08:44:57.964209+0000","last_peered":"2023-12-22T08:44:57.964209+0000","last_clean":"2023-12-22T08:44:57.964209+0000","last_became_active":"2023-12-22T08:44:55.953387+0000","last_became_peered":"2023-12-22T08:44:55.953387+0000","last_unstale":"2023-12-22T08:44:57.964209+0000","last_undegraded":"2023-12-22T08:44:57.964209+0000","last_fullsized":"2023-12-22T08:44:57.964209+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:06:43.996770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963713+0000","last_change":"2023-12-22T08:44:55.962731+0000","last_active":"2023-12-22T08:44:57.963713+0000","last_peered":"2023-12-22T08:44:57.963713+0000","last_clean":"2023-12-22T08:44:57.963713+0000","last_became_active":"2023-12-22T08:44:55.962190+0000","last_became_peered":"2023-12-22T08:44:55.962190+0000","last_unstale":"2023-12-22T08:44:57.963713+0000","last_undegraded":"2023-12-22T08:44:57.963713+0000","last_fullsized":"2023-12-22T08:44:57.963713+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:05:30.480831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962473+0000","last_change":"2023-12-22T08:44:55.961840+0000","last_active":"2023-12-22T08:44:57.962473+0000","last_peered":"2023-12-22T08:44:57.962473+0000","last_clean":"2023-12-22T08:44:57.962473+0000","last_became_active":"2023-12-22T08:44:55.961475+0000","last_became_peered":"2023-12-22T08:44:55.961475+0000","last_unstale":"2023-12-22T08:44:57.962473+0000","last_undegraded":"2023-12-22T08:44:57.962473+0000","last_fullsized":"2023-12-22T08:44:57.962473+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:48.745271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.965952+0000","last_change":"2023-12-22T08:44:55.967591+0000","last_active":"2023-12-22T08:44:57.965952+0000","last_peered":"2023-12-22T08:44:57.965952+0000","last_clean":"2023-12-22T08:44:57.965952+0000","last_became_active":"2023-12-22T08:44:55.966950+0000","last_became_peered":"2023-12-22T08:44:55.966950+0000","last_unstale":"2023-12-22T08:44:57.965952+0000","last_undegraded":"2023-12-22T08:44:57.965952+0000","last_fullsized":"2023-12-22T08:44:57.965952+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:06:33.829683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964914+0000","last_change":"2023-12-22T08:44:55.967884+0000","last_active":"2023-12-22T08:44:57.964914+0000","last_peered":"2023-12-22T08:44:57.964914+0000","last_clean":"2023-12-22T08:44:57.964914+0000","last_became_active":"2023-12-22T08:44:55.967652+0000","last_became_peered":"2023-12-22T08:44:55.967652+0000","last_unstale":"2023-12-22T08:44:57.964914+0000","last_undegraded":"2023-12-22T08:44:57.964914+0000","last_fullsized":"2023-12-22T08:44:57.964914+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:59:45.690689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.941389+0000","last_change":"2023-12-22T08:44:55.946988+0000","last_active":"2023-12-22T08:44:56.941389+0000","last_peered":"2023-12-22T08:44:56.941389+0000","last_clean":"2023-12-22T08:44:56.941389+0000","last_became_active":"2023-12-22T08:44:55.946708+0000","last_became_peered":"2023-12-22T08:44:55.946708+0000","last_unstale":"2023-12-22T08:44:56.941389+0000","last_undegraded":"2023-12-22T08:44:56.941389+0000","last_fullsized":"2023-12-22T08:44:56.941389+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:20:16.426697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.938976+0000","last_change":"2023-12-22T08:44:55.953618+0000","last_active":"2023-12-22T08:44:56.938976+0000","last_peered":"2023-12-22T08:44:56.938976+0000","last_clean":"2023-12-22T08:44:56.938976+0000","last_became_active":"2023-12-22T08:44:55.951143+0000","last_became_peered":"2023-12-22T08:44:55.951143+0000","last_unstale":"2023-12-22T08:44:56.938976+0000","last_undegraded":"2023-12-22T08:44:56.938976+0000","last_fullsized":"2023-12-22T08:44:56.938976+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:04:06.263315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806265+0000","last_change":"2023-12-22T08:44:55.967015+0000","last_active":"2023-12-22T08:44:57.806265+0000","last_peered":"2023-12-22T08:44:57.806265+0000","last_clean":"2023-12-22T08:44:57.806265+0000","last_became_active":"2023-12-22T08:44:55.966741+0000","last_became_peered":"2023-12-22T08:44:55.966741+0000","last_unstale":"2023-12-22T08:44:57.806265+0000","last_undegraded":"2023-12-22T08:44:57.806265+0000","last_fullsized":"2023-12-22T08:44:57.806265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:14:54.084290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963075+0000","last_change":"2023-12-22T08:44:55.955817+0000","last_active":"2023-12-22T08:44:57.963075+0000","last_peered":"2023-12-22T08:44:57.963075+0000","last_clean":"2023-12-22T08:44:57.963075+0000","last_became_active":"2023-12-22T08:44:55.954599+0000","last_became_peered":"2023-12-22T08:44:55.954599+0000","last_unstale":"2023-12-22T08:44:57.963075+0000","last_undegraded":"2023-12-22T08:44:57.963075+0000","last_fullsized":"2023-12-22T08:44:57.963075+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:47:03.537517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.938822+0000","last_change":"2023-12-22T08:44:55.953662+0000","last_active":"2023-12-22T08:44:56.938822+0000","last_peered":"2023-12-22T08:44:56.938822+0000","last_clean":"2023-12-22T08:44:56.938822+0000","last_became_active":"2023-12-22T08:44:55.953375+0000","last_became_peered":"2023-12-22T08:44:55.953375+0000","last_unstale":"2023-12-22T08:44:56.938822+0000","last_undegraded":"2023-12-22T08:44:56.938822+0000","last_fullsized":"2023-12-22T08:44:56.938822+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:33:53.651558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939254+0000","last_change":"2023-12-22T08:44:55.950237+0000","last_active":"2023-12-22T08:44:56.939254+0000","last_peered":"2023-12-22T08:44:56.939254+0000","last_clean":"2023-12-22T08:44:56.939254+0000","last_became_active":"2023-12-22T08:44:55.947521+0000","last_became_peered":"2023-12-22T08:44:55.947521+0000","last_unstale":"2023-12-22T08:44:56.939254+0000","last_undegraded":"2023-12-22T08:44:56.939254+0000","last_fullsized":"2023-12-22T08:44:56.939254+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:58:14.823531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962574+0000","last_change":"2023-12-22T08:44:55.961690+0000","last_active":"2023-12-22T08:44:57.962574+0000","last_peered":"2023-12-22T08:44:57.962574+0000","last_clean":"2023-12-22T08:44:57.962574+0000","last_became_active":"2023-12-22T08:44:55.958817+0000","last_became_peered":"2023-12-22T08:44:55.958817+0000","last_unstale":"2023-12-22T08:44:57.962574+0000","last_undegraded":"2023-12-22T08:44:57.962574+0000","last_fullsized":"2023-12-22T08:44:57.962574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:54:44.778819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"88'4","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964084+0000","last_change":"2023-12-22T08:44:55.440017+0000","last_active":"2023-12-22T08:44:57.964084+0000","last_peered":"2023-12-22T08:44:57.964084+0000","last_clean":"2023-12-22T08:44:57.964084+0000","last_became_active":"2023-12-22T08:44:55.439267+0000","last_became_peered":"2023-12-22T08:44:55.439267+0000","last_unstale":"2023-12-22T08:44:57.964084+0000","last_undegraded":"2023-12-22T08:44:57.964084+0000","last_fullsized":"2023-12-22T08:44:57.964084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:04:05.246778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806552+0000","last_change":"2023-12-22T08:44:55.961587+0000","last_active":"2023-12-22T08:44:57.806552+0000","last_peered":"2023-12-22T08:44:57.806552+0000","last_clean":"2023-12-22T08:44:57.806552+0000","last_became_active":"2023-12-22T08:44:55.961277+0000","last_became_peered":"2023-12-22T08:44:55.961277+0000","last_unstale":"2023-12-22T08:44:57.806552+0000","last_undegraded":"2023-12-22T08:44:57.806552+0000","last_fullsized":"2023-12-22T08:44:57.806552+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:17:29.279105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939716+0000","last_change":"2023-12-22T08:44:55.449318+0000","last_active":"2023-12-22T08:44:56.939716+0000","last_peered":"2023-12-22T08:44:56.939716+0000","last_clean":"2023-12-22T08:44:56.939716+0000","last_became_active":"2023-12-22T08:44:55.448839+0000","last_became_peered":"2023-12-22T08:44:55.448839+0000","last_unstale":"2023-12-22T08:44:56.939716+0000","last_undegraded":"2023-12-22T08:44:56.939716+0000","last_fullsized":"2023-12-22T08:44:56.939716+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:12:27.199068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964443+0000","last_change":"2023-12-22T08:44:55.960567+0000","last_active":"2023-12-22T08:44:57.964443+0000","last_peered":"2023-12-22T08:44:57.964443+0000","last_clean":"2023-12-22T08:44:57.964443+0000","last_became_active":"2023-12-22T08:44:55.960003+0000","last_became_peered":"2023-12-22T08:44:55.960003+0000","last_unstale":"2023-12-22T08:44:57.964443+0000","last_undegraded":"2023-12-22T08:44:57.964443+0000","last_fullsized":"2023-12-22T08:44:57.964443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:34.700682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963162+0000","last_change":"2023-12-22T08:44:55.433443+0000","last_active":"2023-12-22T08:44:57.963162+0000","last_peered":"2023-12-22T08:44:57.963162+0000","last_clean":"2023-12-22T08:44:57.963162+0000","last_became_active":"2023-12-22T08:44:55.432735+0000","last_became_peered":"2023-12-22T08:44:55.432735+0000","last_unstale":"2023-12-22T08:44:57.963162+0000","last_undegraded":"2023-12-22T08:44:57.963162+0000","last_fullsized":"2023-12-22T08:44:57.963162+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:29.108080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.966447+0000","last_change":"2023-12-22T08:44:55.967282+0000","last_active":"2023-12-22T08:44:57.966447+0000","last_peered":"2023-12-22T08:44:57.966447+0000","last_clean":"2023-12-22T08:44:57.966447+0000","last_became_active":"2023-12-22T08:44:55.966025+0000","last_became_peered":"2023-12-22T08:44:55.966025+0000","last_unstale":"2023-12-22T08:44:57.966447+0000","last_undegraded":"2023-12-22T08:44:57.966447+0000","last_fullsized":"2023-12-22T08:44:57.966447+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:17:54.343415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964796+0000","last_change":"2023-12-22T08:44:55.446622+0000","last_active":"2023-12-22T08:44:57.964796+0000","last_peered":"2023-12-22T08:44:57.964796+0000","last_clean":"2023-12-22T08:44:57.964796+0000","last_became_active":"2023-12-22T08:44:55.445628+0000","last_became_peered":"2023-12-22T08:44:55.445628+0000","last_unstale":"2023-12-22T08:44:57.964796+0000","last_undegraded":"2023-12-22T08:44:57.964796+0000","last_fullsized":"2023-12-22T08:44:57.964796+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:03:10.604004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962776+0000","last_change":"2023-12-22T08:44:55.952565+0000","last_active":"2023-12-22T08:44:57.962776+0000","last_peered":"2023-12-22T08:44:57.962776+0000","last_clean":"2023-12-22T08:44:57.962776+0000","last_became_active":"2023-12-22T08:44:55.952011+0000","last_became_peered":"2023-12-22T08:44:55.952011+0000","last_unstale":"2023-12-22T08:44:57.962776+0000","last_undegraded":"2023-12-22T08:44:57.962776+0000","last_fullsized":"2023-12-22T08:44:57.962776+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:14:49.850122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.941856+0000","last_change":"2023-12-22T08:44:55.446834+0000","last_active":"2023-12-22T08:44:56.941856+0000","last_peered":"2023-12-22T08:44:56.941856+0000","last_clean":"2023-12-22T08:44:56.941856+0000","last_became_active":"2023-12-22T08:44:55.445434+0000","last_became_peered":"2023-12-22T08:44:55.445434+0000","last_unstale":"2023-12-22T08:44:56.941856+0000","last_undegraded":"2023-12-22T08:44:56.941856+0000","last_fullsized":"2023-12-22T08:44:56.941856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:34:27.834162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964260+0000","last_change":"2023-12-22T08:44:55.958476+0000","last_active":"2023-12-22T08:44:57.964260+0000","last_peered":"2023-12-22T08:44:57.964260+0000","last_clean":"2023-12-22T08:44:57.964260+0000","last_became_active":"2023-12-22T08:44:55.958268+0000","last_became_peered":"2023-12-22T08:44:55.958268+0000","last_unstale":"2023-12-22T08:44:57.964260+0000","last_undegraded":"2023-12-22T08:44:57.964260+0000","last_fullsized":"2023-12-22T08:44:57.964260+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:22:35.325573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963946+0000","last_change":"2023-12-22T08:44:55.455852+0000","last_active":"2023-12-22T08:44:57.963946+0000","last_peered":"2023-12-22T08:44:57.963946+0000","last_clean":"2023-12-22T08:44:57.963946+0000","last_became_active":"2023-12-22T08:44:55.454962+0000","last_became_peered":"2023-12-22T08:44:55.454962+0000","last_unstale":"2023-12-22T08:44:57.963946+0000","last_undegraded":"2023-12-22T08:44:57.963946+0000","last_fullsized":"2023-12-22T08:44:57.963946+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:15:16.977341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963624+0000","last_change":"2023-12-22T08:44:55.967155+0000","last_active":"2023-12-22T08:44:57.963624+0000","last_peered":"2023-12-22T08:44:57.963624+0000","last_clean":"2023-12-22T08:44:57.963624+0000","last_became_active":"2023-12-22T08:44:55.966871+0000","last_became_peered":"2023-12-22T08:44:55.966871+0000","last_unstale":"2023-12-22T08:44:57.963624+0000","last_undegraded":"2023-12-22T08:44:57.963624+0000","last_fullsized":"2023-12-22T08:44:57.963624+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:16:26.999597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963863+0000","last_change":"2023-12-22T08:44:55.450287+0000","last_active":"2023-12-22T08:44:57.963863+0000","last_peered":"2023-12-22T08:44:57.963863+0000","last_clean":"2023-12-22T08:44:57.963863+0000","last_became_active":"2023-12-22T08:44:55.449604+0000","last_became_peered":"2023-12-22T08:44:55.449604+0000","last_unstale":"2023-12-22T08:44:57.963863+0000","last_undegraded":"2023-12-22T08:44:57.963863+0000","last_fullsized":"2023-12-22T08:44:57.963863+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:34:38.363398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940193+0000","last_change":"2023-12-22T08:44:55.962936+0000","last_active":"2023-12-22T08:44:56.940193+0000","last_peered":"2023-12-22T08:44:56.940193+0000","last_clean":"2023-12-22T08:44:56.940193+0000","last_became_active":"2023-12-22T08:44:55.962226+0000","last_became_peered":"2023-12-22T08:44:55.962226+0000","last_unstale":"2023-12-22T08:44:56.940193+0000","last_undegraded":"2023-12-22T08:44:56.940193+0000","last_fullsized":"2023-12-22T08:44:56.940193+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:48.493910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.942942+0000","last_change":"2023-12-22T08:44:55.444311+0000","last_active":"2023-12-22T08:44:56.942942+0000","last_peered":"2023-12-22T08:44:56.942942+0000","last_clean":"2023-12-22T08:44:56.942942+0000","last_became_active":"2023-12-22T08:44:55.443987+0000","last_became_peered":"2023-12-22T08:44:55.443987+0000","last_unstale":"2023-12-22T08:44:56.942942+0000","last_undegraded":"2023-12-22T08:44:56.942942+0000","last_fullsized":"2023-12-22T08:44:56.942942+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:55.494807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962948+0000","last_change":"2023-12-22T08:44:55.962345+0000","last_active":"2023-12-22T08:44:57.962948+0000","last_peered":"2023-12-22T08:44:57.962948+0000","last_clean":"2023-12-22T08:44:57.962948+0000","last_became_active":"2023-12-22T08:44:55.961702+0000","last_became_peered":"2023-12-22T08:44:55.961702+0000","last_unstale":"2023-12-22T08:44:57.962948+0000","last_undegraded":"2023-12-22T08:44:57.962948+0000","last_fullsized":"2023-12-22T08:44:57.962948+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:44:23.339301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.965228+0000","last_change":"2023-12-22T08:44:55.430708+0000","last_active":"2023-12-22T08:44:57.965228+0000","last_peered":"2023-12-22T08:44:57.965228+0000","last_clean":"2023-12-22T08:44:57.965228+0000","last_became_active":"2023-12-22T08:44:55.430013+0000","last_became_peered":"2023-12-22T08:44:55.430013+0000","last_unstale":"2023-12-22T08:44:57.965228+0000","last_undegraded":"2023-12-22T08:44:57.965228+0000","last_fullsized":"2023-12-22T08:44:57.965228+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:47.477373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.938963+0000","last_change":"2023-12-22T08:44:55.966541+0000","last_active":"2023-12-22T08:44:56.938963+0000","last_peered":"2023-12-22T08:44:56.938963+0000","last_clean":"2023-12-22T08:44:56.938963+0000","last_became_active":"2023-12-22T08:44:55.966370+0000","last_became_peered":"2023-12-22T08:44:55.966370+0000","last_unstale":"2023-12-22T08:44:56.938963+0000","last_undegraded":"2023-12-22T08:44:56.938963+0000","last_fullsized":"2023-12-22T08:44:56.938963+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:34.700682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939501+0000","last_change":"2023-12-22T08:44:55.446917+0000","last_active":"2023-12-22T08:44:56.939501+0000","last_peered":"2023-12-22T08:44:56.939501+0000","last_clean":"2023-12-22T08:44:56.939501+0000","last_became_active":"2023-12-22T08:44:55.446399+0000","last_became_peered":"2023-12-22T08:44:55.446399+0000","last_unstale":"2023-12-22T08:44:56.939501+0000","last_undegraded":"2023-12-22T08:44:56.939501+0000","last_fullsized":"2023-12-22T08:44:56.939501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:16:25.983059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962671+0000","last_change":"2023-12-22T08:44:55.962649+0000","last_active":"2023-12-22T08:44:57.962671+0000","last_peered":"2023-12-22T08:44:57.962671+0000","last_clean":"2023-12-22T08:44:57.962671+0000","last_became_active":"2023-12-22T08:44:55.962431+0000","last_became_peered":"2023-12-22T08:44:55.962431+0000","last_unstale":"2023-12-22T08:44:57.962671+0000","last_undegraded":"2023-12-22T08:44:57.962671+0000","last_fullsized":"2023-12-22T08:44:57.962671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:32:24.697878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"88'3","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940660+0000","last_change":"2023-12-22T08:44:55.448209+0000","last_active":"2023-12-22T08:44:56.940660+0000","last_peered":"2023-12-22T08:44:56.940660+0000","last_clean":"2023-12-22T08:44:56.940660+0000","last_became_active":"2023-12-22T08:44:55.447913+0000","last_became_peered":"2023-12-22T08:44:55.447913+0000","last_unstale":"2023-12-22T08:44:56.940660+0000","last_undegraded":"2023-12-22T08:44:56.940660+0000","last_fullsized":"2023-12-22T08:44:56.940660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:47:26.804508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940314+0000","last_change":"2023-12-22T08:44:55.949625+0000","last_active":"2023-12-22T08:44:56.940314+0000","last_peered":"2023-12-22T08:44:56.940314+0000","last_clean":"2023-12-22T08:44:56.940314+0000","last_became_active":"2023-12-22T08:44:55.949382+0000","last_became_peered":"2023-12-22T08:44:55.949382+0000","last_unstale":"2023-12-22T08:44:56.940314+0000","last_undegraded":"2023-12-22T08:44:56.940314+0000","last_fullsized":"2023-12-22T08:44:56.940314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:30:07.484726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"88'6","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964105+0000","last_change":"2023-12-22T08:44:55.447745+0000","last_active":"2023-12-22T08:44:57.964105+0000","last_peered":"2023-12-22T08:44:57.964105+0000","last_clean":"2023-12-22T08:44:57.964105+0000","last_became_active":"2023-12-22T08:44:55.447517+0000","last_became_peered":"2023-12-22T08:44:55.447517+0000","last_unstale":"2023-12-22T08:44:57.964105+0000","last_undegraded":"2023-12-22T08:44:57.964105+0000","last_fullsized":"2023-12-22T08:44:57.964105+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:02.822149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964583+0000","last_change":"2023-12-22T08:44:55.957638+0000","last_active":"2023-12-22T08:44:57.964583+0000","last_peered":"2023-12-22T08:44:57.964583+0000","last_clean":"2023-12-22T08:44:57.964583+0000","last_became_active":"2023-12-22T08:44:55.957365+0000","last_became_peered":"2023-12-22T08:44:55.957365+0000","last_unstale":"2023-12-22T08:44:57.964583+0000","last_undegraded":"2023-12-22T08:44:57.964583+0000","last_fullsized":"2023-12-22T08:44:57.964583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:14.621279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963770+0000","last_change":"2023-12-22T08:44:55.451714+0000","last_active":"2023-12-22T08:44:57.963770+0000","last_peered":"2023-12-22T08:44:57.963770+0000","last_clean":"2023-12-22T08:44:57.963770+0000","last_became_active":"2023-12-22T08:44:55.451393+0000","last_became_peered":"2023-12-22T08:44:55.451393+0000","last_unstale":"2023-12-22T08:44:57.963770+0000","last_undegraded":"2023-12-22T08:44:57.963770+0000","last_fullsized":"2023-12-22T08:44:57.963770+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:11:17.137785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.966670+0000","last_change":"2023-12-22T08:44:55.968319+0000","last_active":"2023-12-22T08:44:57.966670+0000","last_peered":"2023-12-22T08:44:57.966670+0000","last_clean":"2023-12-22T08:44:57.966670+0000","last_became_active":"2023-12-22T08:44:55.968071+0000","last_became_peered":"2023-12-22T08:44:55.968071+0000","last_unstale":"2023-12-22T08:44:57.966670+0000","last_undegraded":"2023-12-22T08:44:57.966670+0000","last_fullsized":"2023-12-22T08:44:57.966670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:19:55.247327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.965784+0000","last_change":"2023-12-22T08:44:55.449679+0000","last_active":"2023-12-22T08:44:57.965784+0000","last_peered":"2023-12-22T08:44:57.965784+0000","last_clean":"2023-12-22T08:44:57.965784+0000","last_became_active":"2023-12-22T08:44:55.449456+0000","last_became_peered":"2023-12-22T08:44:55.449456+0000","last_unstale":"2023-12-22T08:44:57.965784+0000","last_undegraded":"2023-12-22T08:44:57.965784+0000","last_fullsized":"2023-12-22T08:44:57.965784+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:02.337090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940526+0000","last_change":"2023-12-22T08:44:55.955622+0000","last_active":"2023-12-22T08:44:56.940526+0000","last_peered":"2023-12-22T08:44:56.940526+0000","last_clean":"2023-12-22T08:44:56.940526+0000","last_became_active":"2023-12-22T08:44:55.954958+0000","last_became_peered":"2023-12-22T08:44:55.954958+0000","last_unstale":"2023-12-22T08:44:56.940526+0000","last_undegraded":"2023-12-22T08:44:56.940526+0000","last_fullsized":"2023-12-22T08:44:56.940526+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:44:33.174891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.965465+0000","last_change":"2023-12-22T08:44:55.451837+0000","last_active":"2023-12-22T08:44:57.965465+0000","last_peered":"2023-12-22T08:44:57.965465+0000","last_clean":"2023-12-22T08:44:57.965465+0000","last_became_active":"2023-12-22T08:44:55.451549+0000","last_became_peered":"2023-12-22T08:44:55.451549+0000","last_unstale":"2023-12-22T08:44:57.965465+0000","last_undegraded":"2023-12-22T08:44:57.965465+0000","last_fullsized":"2023-12-22T08:44:57.965465+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:04:11.280843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806305+0000","last_change":"2023-12-22T08:44:55.956889+0000","last_active":"2023-12-22T08:44:57.806305+0000","last_peered":"2023-12-22T08:44:57.806305+0000","last_clean":"2023-12-22T08:44:57.806305+0000","last_became_active":"2023-12-22T08:44:55.956352+0000","last_became_peered":"2023-12-22T08:44:55.956352+0000","last_unstale":"2023-12-22T08:44:57.806305+0000","last_undegraded":"2023-12-22T08:44:57.806305+0000","last_fullsized":"2023-12-22T08:44:57.806305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:28:01.778287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"88'8","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964110+0000","last_change":"2023-12-22T08:44:55.455621+0000","last_active":"2023-12-22T08:44:57.964110+0000","last_peered":"2023-12-22T08:44:57.964110+0000","last_clean":"2023-12-22T08:44:57.964110+0000","last_became_active":"2023-12-22T08:44:55.453186+0000","last_became_peered":"2023-12-22T08:44:55.453186+0000","last_unstale":"2023-12-22T08:44:57.964110+0000","last_undegraded":"2023-12-22T08:44:57.964110+0000","last_fullsized":"2023-12-22T08:44:57.964110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:29:10.590481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939066+0000","last_change":"2023-12-22T08:44:55.952745+0000","last_active":"2023-12-22T08:44:56.939066+0000","last_peered":"2023-12-22T08:44:56.939066+0000","last_clean":"2023-12-22T08:44:56.939066+0000","last_became_active":"2023-12-22T08:44:55.949795+0000","last_became_peered":"2023-12-22T08:44:55.949795+0000","last_unstale":"2023-12-22T08:44:56.939066+0000","last_undegraded":"2023-12-22T08:44:56.939066+0000","last_fullsized":"2023-12-22T08:44:56.939066+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:12:28.215605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962768+0000","last_change":"2023-12-22T08:44:55.439890+0000","last_active":"2023-12-22T08:44:57.962768+0000","last_peered":"2023-12-22T08:44:57.962768+0000","last_clean":"2023-12-22T08:44:57.962768+0000","last_became_active":"2023-12-22T08:44:55.439267+0000","last_became_peered":"2023-12-22T08:44:55.439267+0000","last_unstale":"2023-12-22T08:44:57.962768+0000","last_undegraded":"2023-12-22T08:44:57.962768+0000","last_fullsized":"2023-12-22T08:44:57.962768+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:48:57.243184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.938835+0000","last_change":"2023-12-22T08:44:55.946124+0000","last_active":"2023-12-22T08:44:56.938835+0000","last_peered":"2023-12-22T08:44:56.938835+0000","last_clean":"2023-12-22T08:44:56.938835+0000","last_became_active":"2023-12-22T08:44:55.945722+0000","last_became_peered":"2023-12-22T08:44:55.945722+0000","last_unstale":"2023-12-22T08:44:56.938835+0000","last_undegraded":"2023-12-22T08:44:56.938835+0000","last_fullsized":"2023-12-22T08:44:56.938835+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:08:57.037258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939318+0000","last_change":"2023-12-22T08:44:55.454977+0000","last_active":"2023-12-22T08:44:56.939318+0000","last_peered":"2023-12-22T08:44:56.939318+0000","last_clean":"2023-12-22T08:44:56.939318+0000","last_became_active":"2023-12-22T08:44:55.453047+0000","last_became_peered":"2023-12-22T08:44:55.453047+0000","last_unstale":"2023-12-22T08:44:56.939318+0000","last_undegraded":"2023-12-22T08:44:56.939318+0000","last_fullsized":"2023-12-22T08:44:56.939318+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:06:32.813145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806461+0000","last_change":"2023-12-22T08:44:55.960089+0000","last_active":"2023-12-22T08:44:57.806461+0000","last_peered":"2023-12-22T08:44:57.806461+0000","last_clean":"2023-12-22T08:44:57.806461+0000","last_became_active":"2023-12-22T08:44:55.959778+0000","last_became_peered":"2023-12-22T08:44:55.959778+0000","last_unstale":"2023-12-22T08:44:57.806461+0000","last_undegraded":"2023-12-22T08:44:57.806461+0000","last_fullsized":"2023-12-22T08:44:57.806461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:39:46.747562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939125+0000","last_change":"2023-12-22T08:44:55.454912+0000","last_active":"2023-12-22T08:44:56.939125+0000","last_peered":"2023-12-22T08:44:56.939125+0000","last_clean":"2023-12-22T08:44:56.939125+0000","last_became_active":"2023-12-22T08:44:55.454675+0000","last_became_peered":"2023-12-22T08:44:55.454675+0000","last_unstale":"2023-12-22T08:44:56.939125+0000","last_undegraded":"2023-12-22T08:44:56.939125+0000","last_fullsized":"2023-12-22T08:44:56.939125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:13:40.517804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806125+0000","last_change":"2023-12-22T08:44:55.964958+0000","last_active":"2023-12-22T08:44:57.806125+0000","last_peered":"2023-12-22T08:44:57.806125+0000","last_clean":"2023-12-22T08:44:57.806125+0000","last_became_active":"2023-12-22T08:44:55.964703+0000","last_became_peered":"2023-12-22T08:44:55.964703+0000","last_unstale":"2023-12-22T08:44:57.806125+0000","last_undegraded":"2023-12-22T08:44:57.806125+0000","last_fullsized":"2023-12-22T08:44:57.806125+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:11:18.154323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964303+0000","last_change":"2023-12-22T08:44:55.434978+0000","last_active":"2023-12-22T08:44:57.964303+0000","last_peered":"2023-12-22T08:44:57.964303+0000","last_clean":"2023-12-22T08:44:57.964303+0000","last_became_active":"2023-12-22T08:44:55.433949+0000","last_became_peered":"2023-12-22T08:44:55.433949+0000","last_unstale":"2023-12-22T08:44:57.964303+0000","last_undegraded":"2023-12-22T08:44:57.964303+0000","last_fullsized":"2023-12-22T08:44:57.964303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:30.656769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963768+0000","last_change":"2023-12-22T08:44:55.961013+0000","last_active":"2023-12-22T08:44:57.963768+0000","last_peered":"2023-12-22T08:44:57.963768+0000","last_clean":"2023-12-22T08:44:57.963768+0000","last_became_active":"2023-12-22T08:44:55.960745+0000","last_became_peered":"2023-12-22T08:44:55.960745+0000","last_unstale":"2023-12-22T08:44:57.963768+0000","last_undegraded":"2023-12-22T08:44:57.963768+0000","last_fullsized":"2023-12-22T08:44:57.963768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:13:41.534342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963090+0000","last_change":"2023-12-22T08:44:55.443419+0000","last_active":"2023-12-22T08:44:57.963090+0000","last_peered":"2023-12-22T08:44:57.963090+0000","last_clean":"2023-12-22T08:44:57.963090+0000","last_became_active":"2023-12-22T08:44:55.441900+0000","last_became_peered":"2023-12-22T08:44:55.441900+0000","last_unstale":"2023-12-22T08:44:57.963090+0000","last_undegraded":"2023-12-22T08:44:57.963090+0000","last_fullsized":"2023-12-22T08:44:57.963090+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:26:38.603922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963739+0000","last_change":"2023-12-22T08:44:55.944985+0000","last_active":"2023-12-22T08:44:57.963739+0000","last_peered":"2023-12-22T08:44:57.963739+0000","last_clean":"2023-12-22T08:44:57.963739+0000","last_became_active":"2023-12-22T08:44:55.944197+0000","last_became_peered":"2023-12-22T08:44:55.944197+0000","last_unstale":"2023-12-22T08:44:57.963739+0000","last_undegraded":"2023-12-22T08:44:57.963739+0000","last_fullsized":"2023-12-22T08:44:57.963739+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:44:23.339301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939433+0000","last_change":"2023-12-22T08:44:55.448752+0000","last_active":"2023-12-22T08:44:56.939433+0000","last_peered":"2023-12-22T08:44:56.939433+0000","last_clean":"2023-12-22T08:44:56.939433+0000","last_became_active":"2023-12-22T08:44:55.448518+0000","last_became_peered":"2023-12-22T08:44:55.448518+0000","last_unstale":"2023-12-22T08:44:56.939433+0000","last_undegraded":"2023-12-22T08:44:56.939433+0000","last_fullsized":"2023-12-22T08:44:56.939433+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:17:28.262568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.942726+0000","last_change":"2023-12-22T08:44:55.955372+0000","last_active":"2023-12-22T08:44:56.942726+0000","last_peered":"2023-12-22T08:44:56.942726+0000","last_clean":"2023-12-22T08:44:56.942726+0000","last_became_active":"2023-12-22T08:44:55.955092+0000","last_became_peered":"2023-12-22T08:44:55.955092+0000","last_unstale":"2023-12-22T08:44:56.942726+0000","last_undegraded":"2023-12-22T08:44:56.942726+0000","last_fullsized":"2023-12-22T08:44:56.942726+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:06:43.996770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.941337+0000","last_change":"2023-12-22T08:44:55.455226+0000","last_active":"2023-12-22T08:44:56.941337+0000","last_peered":"2023-12-22T08:44:56.941337+0000","last_clean":"2023-12-22T08:44:56.941337+0000","last_became_active":"2023-12-22T08:44:55.454965+0000","last_became_peered":"2023-12-22T08:44:55.454965+0000","last_unstale":"2023-12-22T08:44:56.941337+0000","last_undegraded":"2023-12-22T08:44:56.941337+0000","last_fullsized":"2023-12-22T08:44:56.941337+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:10.936337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940767+0000","last_change":"2023-12-22T08:44:55.942854+0000","last_active":"2023-12-22T08:44:56.940767+0000","last_peered":"2023-12-22T08:44:56.940767+0000","last_clean":"2023-12-22T08:44:56.940767+0000","last_became_active":"2023-12-22T08:44:55.942594+0000","last_became_peered":"2023-12-22T08:44:55.942594+0000","last_unstale":"2023-12-22T08:44:56.940767+0000","last_undegraded":"2023-12-22T08:44:56.940767+0000","last_fullsized":"2023-12-22T08:44:56.940767+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:57:08.547786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962654+0000","last_change":"2023-12-22T08:44:55.441242+0000","last_active":"2023-12-22T08:44:57.962654+0000","last_peered":"2023-12-22T08:44:57.962654+0000","last_clean":"2023-12-22T08:44:57.962654+0000","last_became_active":"2023-12-22T08:44:55.440670+0000","last_became_peered":"2023-12-22T08:44:55.440670+0000","last_unstale":"2023-12-22T08:44:57.962654+0000","last_undegraded":"2023-12-22T08:44:57.962654+0000","last_fullsized":"2023-12-22T08:44:57.962654+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:17:25.650103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963123+0000","last_change":"2023-12-22T08:44:55.962207+0000","last_active":"2023-12-22T08:44:57.963123+0000","last_peered":"2023-12-22T08:44:57.963123+0000","last_clean":"2023-12-22T08:44:57.963123+0000","last_became_active":"2023-12-22T08:44:55.961464+0000","last_became_peered":"2023-12-22T08:44:55.961464+0000","last_unstale":"2023-12-22T08:44:57.963123+0000","last_undegraded":"2023-12-22T08:44:57.963123+0000","last_fullsized":"2023-12-22T08:44:57.963123+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:17:29.279105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963208+0000","last_change":"2023-12-22T08:44:55.448921+0000","last_active":"2023-12-22T08:44:57.963208+0000","last_peered":"2023-12-22T08:44:57.963208+0000","last_clean":"2023-12-22T08:44:57.963208+0000","last_became_active":"2023-12-22T08:44:55.448638+0000","last_became_peered":"2023-12-22T08:44:55.448638+0000","last_unstale":"2023-12-22T08:44:57.963208+0000","last_undegraded":"2023-12-22T08:44:57.963208+0000","last_fullsized":"2023-12-22T08:44:57.963208+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:20:15.410159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939199+0000","last_change":"2023-12-22T08:44:55.960124+0000","last_active":"2023-12-22T08:44:56.939199+0000","last_peered":"2023-12-22T08:44:56.939199+0000","last_clean":"2023-12-22T08:44:56.939199+0000","last_became_active":"2023-12-22T08:44:55.959884+0000","last_became_peered":"2023-12-22T08:44:55.959884+0000","last_unstale":"2023-12-22T08:44:56.939199+0000","last_undegraded":"2023-12-22T08:44:56.939199+0000","last_fullsized":"2023-12-22T08:44:56.939199+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:11.952874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940683+0000","last_change":"2023-12-22T08:44:55.445973+0000","last_active":"2023-12-22T08:44:56.940683+0000","last_peered":"2023-12-22T08:44:56.940683+0000","last_clean":"2023-12-22T08:44:56.940683+0000","last_became_active":"2023-12-22T08:44:55.445236+0000","last_became_peered":"2023-12-22T08:44:55.445236+0000","last_unstale":"2023-12-22T08:44:56.940683+0000","last_undegraded":"2023-12-22T08:44:56.940683+0000","last_fullsized":"2023-12-22T08:44:56.940683+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:26:38.603922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963714+0000","last_change":"2023-12-22T08:44:55.965512+0000","last_active":"2023-12-22T08:44:57.963714+0000","last_peered":"2023-12-22T08:44:57.963714+0000","last_clean":"2023-12-22T08:44:57.963714+0000","last_became_active":"2023-12-22T08:44:55.964997+0000","last_became_peered":"2023-12-22T08:44:55.964997+0000","last_unstale":"2023-12-22T08:44:57.963714+0000","last_undegraded":"2023-12-22T08:44:57.963714+0000","last_fullsized":"2023-12-22T08:44:57.963714+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:52:56.230064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.943151+0000","last_change":"2023-12-22T08:44:55.449483+0000","last_active":"2023-12-22T08:44:56.943151+0000","last_peered":"2023-12-22T08:44:56.943151+0000","last_clean":"2023-12-22T08:44:56.943151+0000","last_became_active":"2023-12-22T08:44:55.448165+0000","last_became_peered":"2023-12-22T08:44:55.448165+0000","last_unstale":"2023-12-22T08:44:56.943151+0000","last_undegraded":"2023-12-22T08:44:56.943151+0000","last_fullsized":"2023-12-22T08:44:56.943151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:12:27.199068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.941620+0000","last_change":"2023-12-22T08:44:55.956510+0000","last_active":"2023-12-22T08:44:56.941620+0000","last_peered":"2023-12-22T08:44:56.941620+0000","last_clean":"2023-12-22T08:44:56.941620+0000","last_became_active":"2023-12-22T08:44:55.956291+0000","last_became_peered":"2023-12-22T08:44:55.956291+0000","last_unstale":"2023-12-22T08:44:56.941620+0000","last_undegraded":"2023-12-22T08:44:56.941620+0000","last_fullsized":"2023-12-22T08:44:56.941620+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:09:33.334059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.942709+0000","last_change":"2023-12-22T08:44:55.444939+0000","last_active":"2023-12-22T08:44:56.942709+0000","last_peered":"2023-12-22T08:44:56.942709+0000","last_clean":"2023-12-22T08:44:56.942709+0000","last_became_active":"2023-12-22T08:44:55.444583+0000","last_became_peered":"2023-12-22T08:44:55.444583+0000","last_unstale":"2023-12-22T08:44:56.942709+0000","last_undegraded":"2023-12-22T08:44:56.942709+0000","last_fullsized":"2023-12-22T08:44:56.942709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:08:56.020720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963665+0000","last_change":"2023-12-22T08:44:55.957423+0000","last_active":"2023-12-22T08:44:57.963665+0000","last_peered":"2023-12-22T08:44:57.963665+0000","last_clean":"2023-12-22T08:44:57.963665+0000","last_became_active":"2023-12-22T08:44:55.956738+0000","last_became_peered":"2023-12-22T08:44:55.956738+0000","last_unstale":"2023-12-22T08:44:57.963665+0000","last_undegraded":"2023-12-22T08:44:57.963665+0000","last_fullsized":"2023-12-22T08:44:57.963665+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:03:04.905454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.941824+0000","last_change":"2023-12-22T08:44:55.449205+0000","last_active":"2023-12-22T08:44:56.941824+0000","last_peered":"2023-12-22T08:44:56.941824+0000","last_clean":"2023-12-22T08:44:56.941824+0000","last_became_active":"2023-12-22T08:44:55.448868+0000","last_became_peered":"2023-12-22T08:44:55.448868+0000","last_unstale":"2023-12-22T08:44:56.941824+0000","last_undegraded":"2023-12-22T08:44:56.941824+0000","last_fullsized":"2023-12-22T08:44:56.941824+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:08:56.020720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963651+0000","last_change":"2023-12-22T08:44:55.950527+0000","last_active":"2023-12-22T08:44:57.963651+0000","last_peered":"2023-12-22T08:44:57.963651+0000","last_clean":"2023-12-22T08:44:57.963651+0000","last_became_active":"2023-12-22T08:44:55.950282+0000","last_became_peered":"2023-12-22T08:44:55.950282+0000","last_unstale":"2023-12-22T08:44:57.963651+0000","last_undegraded":"2023-12-22T08:44:57.963651+0000","last_fullsized":"2023-12-22T08:44:57.963651+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:06:33.829683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939501+0000","last_change":"2023-12-22T08:44:55.453434+0000","last_active":"2023-12-22T08:44:56.939501+0000","last_peered":"2023-12-22T08:44:56.939501+0000","last_clean":"2023-12-22T08:44:56.939501+0000","last_became_active":"2023-12-22T08:44:55.452122+0000","last_became_peered":"2023-12-22T08:44:55.452122+0000","last_unstale":"2023-12-22T08:44:56.939501+0000","last_undegraded":"2023-12-22T08:44:56.939501+0000","last_fullsized":"2023-12-22T08:44:56.939501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:44:22.322763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939255+0000","last_change":"2023-12-22T08:44:55.966073+0000","last_active":"2023-12-22T08:44:56.939255+0000","last_peered":"2023-12-22T08:44:56.939255+0000","last_clean":"2023-12-22T08:44:56.939255+0000","last_became_active":"2023-12-22T08:44:55.965807+0000","last_became_peered":"2023-12-22T08:44:55.965807+0000","last_unstale":"2023-12-22T08:44:56.939255+0000","last_undegraded":"2023-12-22T08:44:56.939255+0000","last_fullsized":"2023-12-22T08:44:56.939255+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:26:39.620459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963172+0000","last_change":"2023-12-22T08:44:55.452475+0000","last_active":"2023-12-22T08:44:57.963172+0000","last_peered":"2023-12-22T08:44:57.963172+0000","last_clean":"2023-12-22T08:44:57.963172+0000","last_became_active":"2023-12-22T08:44:55.451903+0000","last_became_peered":"2023-12-22T08:44:55.451903+0000","last_unstale":"2023-12-22T08:44:57.963172+0000","last_undegraded":"2023-12-22T08:44:57.963172+0000","last_fullsized":"2023-12-22T08:44:57.963172+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:47:26.804508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939970+0000","last_change":"2023-12-22T08:44:55.962167+0000","last_active":"2023-12-22T08:44:56.939970+0000","last_peered":"2023-12-22T08:44:56.939970+0000","last_clean":"2023-12-22T08:44:56.939970+0000","last_became_active":"2023-12-22T08:44:55.961793+0000","last_became_peered":"2023-12-22T08:44:55.961793+0000","last_unstale":"2023-12-22T08:44:56.939970+0000","last_undegraded":"2023-12-22T08:44:56.939970+0000","last_fullsized":"2023-12-22T08:44:56.939970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:28.264515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964252+0000","last_change":"2023-12-22T08:44:55.452216+0000","last_active":"2023-12-22T08:44:57.964252+0000","last_peered":"2023-12-22T08:44:57.964252+0000","last_clean":"2023-12-22T08:44:57.964252+0000","last_became_active":"2023-12-22T08:44:55.451982+0000","last_became_peered":"2023-12-22T08:44:55.451982+0000","last_unstale":"2023-12-22T08:44:57.964252+0000","last_undegraded":"2023-12-22T08:44:57.964252+0000","last_fullsized":"2023-12-22T08:44:57.964252+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:24.149249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-22T08:44:55.960830+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:44:55.960830+0000","last_peered":"2023-12-22T08:44:55.960830+0000","last_clean":"2023-12-22T08:44:55.960830+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:44:55.960830+0000","last_undegraded":"2023-12-22T08:44:55.960830+0000","last_fullsized":"2023-12-22T08:44:55.960830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":465,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194846,"statfs":{"total":200000000,"available":199522840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.075,"15min":1.0780000000000001},"min":{"1min":0.71399999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.54,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.1020000000000001,"15min":1.0680000000000001},"min":{"1min":0.871,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.272}]},{"osd":1,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.169,"15min":1.157},"min":{"1min":0.70199999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.579,"5min":1.905,"15min":1.905},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2070000000000001,"15min":1.147},"min":{"1min":0.95699999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.45,"5min":1.865,"15min":1.865},"last":1.399}]},{"osd":2,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1319999999999999,"15min":1.0720000000000001},"min":{"1min":0.88600000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.522,"5min":1.875,"15min":1.875},"last":1.522},{"interface":"front","average":{"1min":1.131,"5min":1.208,"15min":1.222},"min":{"1min":0.73099999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.5920000000000001,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.97799999999999998}]},{"osd":3,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.175,"15min":1.107},"min":{"1min":0.77500000000000002,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.5389999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.032},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3049999999999999,"15min":1.2809999999999999},"min":{"1min":0.93300000000000005,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.675,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.2110000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.93600000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.8460000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.2669999999999999,"15min":1.2629999999999999},"min":{"1min":0.92400000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6279999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.4419999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.371,"15min":1.367},"min":{"1min":1.111,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.728,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.377,"15min":1.373},"min":{"1min":1.0489999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.6950000000000001,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.4870000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.496,"15min":1.488},"min":{"1min":1.1779999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.881,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.7849999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4870000000000001,"15min":1.484},"min":{"1min":1.123,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7789999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.603}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":466,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194846,"statfs":{"total":200000000,"available":199522806,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.121,"15min":1.133},"min":{"1min":0.69199999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.6779999999999999,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":1.242},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.103,"15min":1.0880000000000001},"min":{"1min":0.76600000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7789999999999999,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.1890000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0609999999999999,"15min":1.026},"min":{"1min":0.70899999999999996,"5min":0.623,"15min":0.623},"max":{"1min":1.575,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.083},{"interface":"front","average":{"1min":1.194,"5min":1.198,"15min":1.173},"min":{"1min":0.76200000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6859999999999999,"5min":1.8,"15min":1.8},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.248,"15min":1.27},"min":{"1min":0.89100000000000001,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.629,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.196,"15min":1.1539999999999999},"min":{"1min":0.91900000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.302}]},{"osd":3,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.319,"15min":1.2989999999999999},"min":{"1min":0.98499999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5149999999999999,"5min":1.847,"15min":1.847},"last":1.468},{"interface":"front","average":{"1min":1.252,"5min":1.2529999999999999,"15min":1.2350000000000001},"min":{"1min":0.94099999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6499999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.93400000000000005}]},{"osd":4,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.385,"15min":1.405},"min":{"1min":0.88500000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.7,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.028},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4119999999999999,"15min":1.4059999999999999},"min":{"1min":1.101,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.629,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.4059999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.347,"15min":1.359},"min":{"1min":1.02,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6319999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.544,"15min":1.589},"min":{"1min":1.2130000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7330000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.546}]},{"osd":7,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5740000000000001,"15min":1.589},"min":{"1min":1.284,"5min":1.159,"15min":1.159},"max":{"1min":1.71,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.52,"15min":1.55},"min":{"1min":1.2110000000000001,"5min":1.04,"15min":1.04},"max":{"1min":1.7290000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.341}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1040,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194272,"statfs":{"total":200000000,"available":198934965,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.0900000000000001,"15min":1.0800000000000001},"min":{"1min":0.71199999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5429999999999999,"5min":1.944,"15min":1.944},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.127,"15min":1.137},"min":{"1min":0.77100000000000002,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.544,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.01}]},{"osd":1,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.097,"15min":1.109},"min":{"1min":0.70199999999999996,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.619,"5min":2.79,"15min":2.79},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0640000000000001,"15min":1.024},"min":{"1min":0.79700000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4710000000000001,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.071}]},{"osd":2,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.135,"15min":1.127},"min":{"1min":0.89400000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.5900000000000001,"5min":1.72,"15min":1.72},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.1719999999999999,"15min":1.1619999999999999},"min":{"1min":0.81499999999999995,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.619,"5min":1.978,"15min":1.978},"last":1.29}]},{"osd":3,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.1850000000000001,"15min":1.163},"min":{"1min":0.91400000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.405},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.244,"15min":1.2370000000000001},"min":{"1min":0.95699999999999996,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.6619999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.4430000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.238,"15min":1.2450000000000001},"min":{"1min":0.70299999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.625,"5min":1.853,"15min":1.853},"last":1.494},{"interface":"front","average":{"1min":1.24,"5min":1.2410000000000001,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.571,"5min":1.663,"15min":1.663},"last":1.585}]},{"osd":6,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.302,"15min":1.3080000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.5860000000000001,"5min":1.821,"15min":1.821},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.403,"15min":1.421},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5609999999999999,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.643}]},{"osd":7,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3620000000000001,"15min":1.3640000000000001},"min":{"1min":0.84599999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6619999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.694},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.51,"15min":1.5649999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.7689999999999999,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":1.7509999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":465,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194847,"statfs":{"total":200000000,"available":199523710,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0089999999999999,"15min":1.0069999999999999},"min":{"1min":0.79600000000000004,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4419999999999999,"5min":1.552,"15min":1.552},"last":1.347},{"interface":"front","average":{"1min":1.256,"5min":1.1419999999999999,"15min":1.1060000000000001},"min":{"1min":0.76200000000000001,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":1.395}]},{"osd":1,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.111,"15min":1.052},"min":{"1min":0.73799999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.143},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1060000000000001,"15min":1.1080000000000001},"min":{"1min":0.86199999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.714,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.016}]},{"osd":2,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.159,"15min":1.1439999999999999},"min":{"1min":0.93300000000000005,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5569999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.216},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.224,"15min":1.202},"min":{"1min":0.81599999999999995,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.0830000000000002,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.675}]},{"osd":3,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2190000000000001,"15min":1.198},"min":{"1min":0.873,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.609,"5min":1.774,"15min":1.774},"last":0.876},{"interface":"front","average":{"1min":1.325,"5min":1.2909999999999999,"15min":1.2170000000000001},"min":{"1min":0.95199999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.8720000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.444}]},{"osd":5,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.1879999999999999,"15min":1.1399999999999999},"min":{"1min":0.72099999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.516},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4219999999999999,"15min":1.383},"min":{"1min":1.137,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.913,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.633}]},{"osd":6,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3049999999999999,"15min":1.2450000000000001},"min":{"1min":0.93999999999999995,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.29,"15min":1.2070000000000001},"min":{"1min":0.88200000000000001,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.7090000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.4239999999999999,"15min":1.3420000000000001},"min":{"1min":1.077,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.867,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.488},{"interface":"front","average":{"1min":1.607,"5min":1.5049999999999999,"15min":1.4279999999999999},"min":{"1min":1.2350000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.891}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":458,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194854,"statfs":{"total":200000000,"available":199530578,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.92100000000000004,"15min":0.96199999999999997},"min":{"1min":0.49299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4490000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.90400000000000003,"15min":0.92700000000000005},"min":{"1min":0.68799999999999994,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.4810000000000001,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2110000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85199999999999998,"15min":0.85599999999999998},"min":{"1min":0.61799999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.492,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.131,"15min":1.1180000000000001},"min":{"1min":0.65900000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.587}]},{"osd":2,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.036,"15min":1.036},"min":{"1min":0.64700000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.101},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.155,"15min":1.131},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.355}]},{"osd":4,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2210000000000001,"15min":1.204},"min":{"1min":0.998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.256,"15min":1.2290000000000001},"min":{"1min":0.93600000000000005,"5min":0.745,"15min":0.745},"max":{"1min":2.242,"5min":2.242,"15min":2.242},"last":1.387}]},{"osd":5,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3049999999999999,"15min":1.2709999999999999},"min":{"1min":0.877,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9510000000000001,"5min":1.994,"15min":1.994},"last":1.5},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3959999999999999,"15min":1.4370000000000001},"min":{"1min":0.98099999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.726,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.4730000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4350000000000001,"15min":1.4430000000000001},"min":{"1min":1.0129999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.3799999999999999,"15min":1.387},"min":{"1min":0.88400000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.786,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.4219999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.3799999999999999,"15min":1.371},"min":{"1min":0.79600000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.399,"15min":1.389},"min":{"1min":0.96099999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.9550000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.456}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":458,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194853,"statfs":{"total":200000000,"available":199530122,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.88300000000000001,"15min":0.75700000000000001},"min":{"1min":0.55500000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3380000000000001,"5min":6.8879999999999999,"15min":6.8879999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.96499999999999997,"15min":0.94699999999999995},"min":{"1min":0.495,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.246,"5min":4.5510000000000002,"15min":4.5510000000000002},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":1.0409999999999999,"15min":0.94499999999999995},"min":{"1min":0.497,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.4159999999999999,"5min":11.308999999999999,"15min":11.308999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.02,"5min":0.97899999999999998,"15min":0.91500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5009999999999999,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1990000000000001,"15min":1.0349999999999999},"min":{"1min":0.65900000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6359999999999999,"5min":13.087999999999999,"15min":13.087999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":1.175,"5min":1.268,"15min":1.0860000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.6639999999999999,"5min":12.289999999999999,"15min":12.289999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.3100000000000001,"15min":1.232},"min":{"1min":0.91300000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.788,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":1.125},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.4319999999999999,"15min":1.3660000000000001},"min":{"1min":0.89300000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.605,"5min":13.927,"15min":13.927},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.4399999999999999,"15min":1.389},"min":{"1min":0.96899999999999997,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7989999999999999,"5min":11.003,"15min":11.003},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.427,"15min":1.2749999999999999},"min":{"1min":1.042,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.9350000000000001,"5min":13.129,"15min":13.129},"last":0.93899999999999995}]},{"osd":6,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3819999999999999,"15min":1.268},"min":{"1min":0.96299999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.8300000000000001,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.419,"5min":1.4399999999999999,"15min":1.357},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.871,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":1.0740000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.482,"15min":1.391},"min":{"1min":0.92500000000000004,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.6419999999999999,"5min":10.948,"15min":10.948},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.482,"15min":1.3500000000000001},"min":{"1min":0.99099999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":3.8460000000000001,"5min":8.0980000000000008,"15min":8.0980000000000008},"last":0.96499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1040,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194271,"statfs":{"total":200000000,"available":198934036,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91200000000000003,"15min":0.90400000000000003},"min":{"1min":0.47399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.3480000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":1.131,"5min":1.0669999999999999,"15min":1.024},"min":{"1min":0.501,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.466,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.95199999999999996,"15min":0.94999999999999996},"min":{"1min":0.52000000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.544,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.002,"15min":0.95999999999999996},"min":{"1min":0.65100000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.647,"5min":2.254,"15min":2.254},"last":1.0409999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.244,"15min":1.1819999999999999},"min":{"1min":0.55800000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.754,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98899999999999999,"15min":0.97299999999999998},"min":{"1min":0.57299999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7150000000000001,"5min":2.226,"15min":2.226},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.274,"15min":1.274},"min":{"1min":0.84799999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.829,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.3879999999999999,"15min":1.3300000000000001},"min":{"1min":0.94399999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.9470000000000001,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.395}]},{"osd":5,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.274,"15min":1.2470000000000001},"min":{"1min":0.78400000000000003,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":4.6399999999999997,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.419,"5min":1.4019999999999999,"15min":1.345},"min":{"1min":0.95799999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.032,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.0149999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.304,"15min":1.262},"min":{"1min":0.81000000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":4.5819999999999999,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":1.286},{"interface":"front","average":{"1min":1.476,"5min":1.413,"15min":1.375},"min":{"1min":0.95599999999999996,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.9390000000000001,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.081}]},{"osd":7,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.448,"15min":1.3700000000000001},"min":{"1min":0.84899999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.3969999999999998,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.603,"5min":1.423,"15min":1.4139999999999999},"min":{"1min":1.046,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.508,"5min":4.508,"15min":4.508},"last":1.3580000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":464,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194847,"statfs":{"total":200000000,"available":199524334,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.755,"15min":0.72399999999999998},"min":{"1min":0.623,"5min":0.38,"15min":0.38},"max":{"1min":1.1000000000000001,"5min":1.593,"15min":1.593},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.89900000000000002,"15min":0.89700000000000002},"min":{"1min":0.58199999999999996,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.4199999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.25}]},{"osd":2,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.81599999999999995,"15min":0.79100000000000004},"min":{"1min":0.60299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.23,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.1279999999999999,"5min":0.97799999999999998,"15min":0.93400000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.0880000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.0660000000000001,"15min":1.02},"min":{"1min":0.75,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5860000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.131,"15min":1.0549999999999999},"min":{"1min":0.83499999999999996,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.645,"5min":2.145,"15min":2.145},"last":0.75700000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.286,"15min":1.262},"min":{"1min":0.98299999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.536,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.2589999999999999,"15min":1.21},"min":{"1min":0.95399999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.3740000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.254,"15min":1.244},"min":{"1min":0.94199999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.671,"5min":1.875,"15min":1.875},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.2729999999999999,"15min":1.256},"min":{"1min":1.0900000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.633,"5min":1.885,"15min":1.885},"last":1.2969999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3069999999999999,"15min":1.2749999999999999},"min":{"1min":1.05,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8149999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.206},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.3919999999999999,"15min":1.381},"min":{"1min":0.90400000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.8340000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.337}]},{"osd":7,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.361,"15min":1.355},"min":{"1min":0.98299999999999998,"5min":0.755,"15min":0.755},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.381,"15min":1.3680000000000001},"min":{"1min":1.0029999999999999,"5min":0.749,"15min":0.749},"max":{"1min":1.677,"5min":2.214,"15min":2.214},"last":0.95999999999999996}]}]}],"pool_statfs":[]}} 2023-12-22T08:45:00.933 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:45:01.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.156+0000 7f34deb67640 1 Processor -- start 2023-12-22T08:45:01.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.157+0000 7f34deb67640 1 -- start start 2023-12-22T08:45:01.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.158+0000 7f34deb67640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d80b3ff0 0x7f34d806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.158+0000 7f34deb67640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d815f220 con 0x7f34d80b4470 2023-12-22T08:45:01.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.158+0000 7f34deb67640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d80d1520 con 0x7f34d8157980 2023-12-22T08:45:01.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.158+0000 7f34deb67640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80d1800 con 0x7f34d80b3ff0 2023-12-22T08:45:01.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.159+0000 7f34de366640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f34d80b4470 0x7f34d80d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46474/0 (socket says 172.21.15.38:46474) 2023-12-22T08:45:01.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.159+0000 7f34de366640 1 -- 172.21.15.38:0/1889354964 learned_addr learned my addr 172.21.15.38:0/1889354964 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:01.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.159+0000 7f34dd364640 1 --2- 172.21.15.38:0/1889354964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d80b3ff0 0x7f34d806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.159+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089730068 0 0) 0x7f34d815f220 con 0x7f34d80b4470 2023-12-22T08:45:01.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.159+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34c4003520 con 0x7f34d80b4470 2023-12-22T08:45:01.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614015125 0 0) 0x7f34d80d1520 con 0x7f34d8157980 2023-12-22T08:45:01.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d815f220 con 0x7f34d8157980 2023-12-22T08:45:01.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 283668602 0 0) 0x7f34c4003520 con 0x7f34d80b4470 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d80b3ff0 msgr2=0x7f34d806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 --2- 172.21.15.38:0/1889354964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d80b3ff0 0x7f34d806cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 >> v1:172.21.15.89:6789/0 conn(0x7f34d8157980 legacy=0x7f34d815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d80d1ae0 con 0x7f34d80b4470 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f34d0001670 con 0x7f34d80b4470 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 >> v1:172.21.15.38:6789/0 conn(0x7f34d80b4470 legacy=0x7f34d80d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 --2- 172.21.15.38:0/1889354964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d80b3ff0 0x7f34c4003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 --2- 172.21.15.38:0/1889354964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34c4004090 0x7f34c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 --2- 172.21.15.38:0/1889354964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34c4004d00 0x7f34c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80d1800 con 0x7f34c4004d00 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c400ba60 con 0x7f34c4004090 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c400bc20 con 0x7f34d80b3ff0 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34de366640 1 --2- 172.21.15.38:0/1889354964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34c4004d00 0x7f34c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34dd364640 1 --2- 172.21.15.38:0/1889354964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34c4004090 0x7f34c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.160+0000 7f34ddb65640 1 --2- 172.21.15.38:0/1889354964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d80b3ff0 0x7f34c4003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.161+0000 7f34de366640 1 -- 172.21.15.38:0/1889354964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d80b3ff0 msgr2=0x7f34c4003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.161+0000 7f34de366640 1 --2- 172.21.15.38:0/1889354964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34d80b3ff0 0x7f34c4003b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.161+0000 7f34de366640 1 -- 172.21.15.38:0/1889354964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34c4004090 msgr2=0x7f34c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.161+0000 7f34de366640 1 --2- 172.21.15.38:0/1889354964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34c4004090 0x7f34c40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.161+0000 7f34de366640 1 -- 172.21.15.38:0/1889354964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c4003520 con 0x7f34c4004d00 2023-12-22T08:45:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.161+0000 7f34dd364640 1 --2- 172.21.15.38:0/1889354964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34c4004090 0x7f34c40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.162+0000 7f34de366640 1 --2- 172.21.15.38:0/1889354964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34c4004d00 0x7f34c4005180 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f34d0007fd0 tx=0x7f34c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568aed321b8a85d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.162+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0005ad0 con 0x7f34c4004d00 2023-12-22T08:45:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.162+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d0005c50 con 0x7f34c4004d00 2023-12-22T08:45:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.162+0000 7f34dcb63640 1 -- 172.21.15.38:0/1889354964 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d002c850 con 0x7f34c4004d00 2023-12-22T08:45:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.162+0000 7f34deb67640 1 -- 172.21.15.38:0/1889354964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34c4004d00 msgr2=0x7f34c4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.162+0000 7f34deb67640 1 --2- 172.21.15.38:0/1889354964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34c4004d00 0x7f34c4005180 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f34d0007fd0 tx=0x7f34c40057f0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.162+0000 7f34de366640 1 -- 172.21.15.38:0/1889354964 reap_dead start 2023-12-22T08:45:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.163+0000 7f34deb67640 1 -- 172.21.15.38:0/1889354964 shutdown_connections 2023-12-22T08:45:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.163+0000 7f34deb67640 1 -- 172.21.15.38:0/1889354964 >> 172.21.15.38:0/1889354964 conn(0x7f34d80d31f0 msgr2=0x7f34d80d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:01.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.163+0000 7f34deb67640 1 -- 172.21.15.38:0/1889354964 shutdown_connections 2023-12-22T08:45:01.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.163+0000 7f34deb67640 1 -- 172.21.15.38:0/1889354964 wait complete. 2023-12-22T08:45:01.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.164+0000 7f34deb67640 1 Processor -- start 2023-12-22T08:45:01.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.165+0000 7f34deb67640 1 -- start start 2023-12-22T08:45:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.165+0000 7f34deb67640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34c4004d00 0x7f34d80d2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.165+0000 7f34deb67640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d80b5c10 0x7f34d814b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.165+0000 7f34deb67640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34d814bdd0 0x7f34d80b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34deb67640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d81f6ff0 con 0x7f34d814bdd0 2023-12-22T08:45:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34deb67640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d814c260 con 0x7f34d80b5c10 2023-12-22T08:45:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34deb67640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d81f63e0 con 0x7f34c4004d00 2023-12-22T08:45:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34de366640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34d814bdd0 0x7f34d80b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34de366640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34d814bdd0 0x7f34d80b75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59988/0 (socket says 172.21.15.38:59988) 2023-12-22T08:45:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34de366640 1 -- 172.21.15.38:0/1675839269 learned_addr learned my addr 172.21.15.38:0/1675839269 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:01.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34dd364640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d80b5c10 0x7f34d814b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34ddb65640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34c4004d00 0x7f34d80d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34de366640 1 -- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34c4004d00 msgr2=0x7f34d80d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34de366640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34c4004d00 0x7f34d80d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34de366640 1 -- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d80b5c10 msgr2=0x7f34d814b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34de366640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d80b5c10 0x7f34d814b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34de366640 1 -- 172.21.15.38:0/1675839269 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d81f66c0 con 0x7f34d814bdd0 2023-12-22T08:45:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.166+0000 7f34dd364640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d80b5c10 0x7f34d814b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.167+0000 7f34de366640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34d814bdd0 0x7f34d80b75e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f34d002c4c0 tx=0x7f34d0001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.167+0000 7f34ce7fc640 1 -- 172.21.15.38:0/1675839269 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d00049e0 con 0x7f34d814bdd0 2023-12-22T08:45:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.167+0000 7f34ce7fc640 1 -- 172.21.15.38:0/1675839269 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d0004b40 con 0x7f34d814bdd0 2023-12-22T08:45:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.167+0000 7f34ce7fc640 1 -- 172.21.15.38:0/1675839269 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0001bd0 con 0x7f34d814bdd0 2023-12-22T08:45:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.167+0000 7f34deb67640 1 -- 172.21.15.38:0/1675839269 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d81f69a0 con 0x7f34d814bdd0 2023-12-22T08:45:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.167+0000 7f34deb67640 1 -- 172.21.15.38:0/1675839269 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d80d2c70 con 0x7f34d814bdd0 2023-12-22T08:45:01.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.168+0000 7f34deb67640 1 -- 172.21.15.38:0/1675839269 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d81f71a0 con 0x7f34d814bdd0 2023-12-22T08:45:01.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.169+0000 7f34ce7fc640 1 -- 172.21.15.38:0/1675839269 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f34d0032070 con 0x7f34d814bdd0 2023-12-22T08:45:01.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.170+0000 7f34ce7fc640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f34bc06a430 0x7f34bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.170+0000 7f34ce7fc640 1 -- 172.21.15.38:0/1675839269 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34d003c070 con 0x7f34d814bdd0 2023-12-22T08:45:01.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.170+0000 7f34ddb65640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f34bc06a430 0x7f34bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.172+0000 7f34ddb65640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f34bc06a430 0x7f34bc06c8f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f34d4007fd0 tx=0x7f34d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.174+0000 7f34ce7fc640 1 -- 172.21.15.38:0/1675839269 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f34d81f71a0 con 0x7f34d814bdd0 2023-12-22T08:45:01.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.366+0000 7f34deb67640 1 -- 172.21.15.38:0/1675839269 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34d80d2ef0 con 0x7f34bc06a430 2023-12-22T08:45:01.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.390+0000 7f34ce7fc640 1 -- 172.21.15.38:0/1675839269 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282272 (secure 0 0 0) 0x7f34d80d2ef0 con 0x7f34bc06a430 2023-12-22T08:45:01.396 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:01.397 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:45:01.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.395+0000 7f34deb67640 1 -- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f34bc06a430 msgr2=0x7f34bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:01.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.395+0000 7f34deb67640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f34bc06a430 0x7f34bc06c8f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f34d4007fd0 tx=0x7f34d4009040 comp rx=0 tx=0).stop 2023-12-22T08:45:01.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.395+0000 7f34deb67640 1 -- 172.21.15.38:0/1675839269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34d814bdd0 msgr2=0x7f34d80b75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:01.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.395+0000 7f34deb67640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34d814bdd0 0x7f34d80b75e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f34d002c4c0 tx=0x7f34d0001980 comp rx=0 tx=0).stop 2023-12-22T08:45:01.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.396+0000 7f34deb67640 1 -- 172.21.15.38:0/1675839269 shutdown_connections 2023-12-22T08:45:01.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.396+0000 7f34deb67640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f34bc06a430 0x7f34bc06c8f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.396+0000 7f34deb67640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34d814bdd0 0x7f34d80b75e0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.396+0000 7f34deb67640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d80b5c10 0x7f34d814b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.396+0000 7f34deb67640 1 --2- 172.21.15.38:0/1675839269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34c4004d00 0x7f34d80d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.396+0000 7f34deb67640 1 -- 172.21.15.38:0/1675839269 >> 172.21.15.38:0/1675839269 conn(0x7f34d80d31f0 msgr2=0x7f34d815ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.396+0000 7f34deb67640 1 -- 172.21.15.38:0/1675839269 shutdown_connections 2023-12-22T08:45:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.396+0000 7f34deb67640 1 -- 172.21.15.38:0/1675839269 wait complete. 2023-12-22T08:45:01.417 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2023-12-22T08:45:00.465531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4859,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557640,"statfs":{"total":1600000000,"available":1595023391,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002040"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962957+0000","last_change":"2023-12-22T08:44:55.957119+0000","last_active":"2023-12-22T08:44:57.962957+0000","last_peered":"2023-12-22T08:44:57.962957+0000","last_clean":"2023-12-22T08:44:57.962957+0000","last_became_active":"2023-12-22T08:44:55.956103+0000","last_became_peered":"2023-12-22T08:44:55.956103+0000","last_unstale":"2023-12-22T08:44:57.962957+0000","last_undegraded":"2023-12-22T08:44:57.962957+0000","last_fullsized":"2023-12-22T08:44:57.962957+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:10:23.314856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.938972+0000","last_change":"2023-12-22T08:44:55.963600+0000","last_active":"2023-12-22T08:44:56.938972+0000","last_peered":"2023-12-22T08:44:56.938972+0000","last_clean":"2023-12-22T08:44:56.938972+0000","last_became_active":"2023-12-22T08:44:55.963256+0000","last_became_peered":"2023-12-22T08:44:55.963256+0000","last_unstale":"2023-12-22T08:44:56.938972+0000","last_undegraded":"2023-12-22T08:44:56.938972+0000","last_fullsized":"2023-12-22T08:44:56.938972+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:03:11.620542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806027+0000","last_change":"2023-12-22T08:44:55.968496+0000","last_active":"2023-12-22T08:44:57.806027+0000","last_peered":"2023-12-22T08:44:57.806027+0000","last_clean":"2023-12-22T08:44:57.806027+0000","last_became_active":"2023-12-22T08:44:55.967738+0000","last_became_peered":"2023-12-22T08:44:55.967738+0000","last_unstale":"2023-12-22T08:44:57.806027+0000","last_undegraded":"2023-12-22T08:44:57.806027+0000","last_fullsized":"2023-12-22T08:44:57.806027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:44:23.339301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.805954+0000","last_change":"2023-12-22T08:44:55.968018+0000","last_active":"2023-12-22T08:44:57.805954+0000","last_peered":"2023-12-22T08:44:57.805954+0000","last_clean":"2023-12-22T08:44:57.805954+0000","last_became_active":"2023-12-22T08:44:55.967784+0000","last_became_peered":"2023-12-22T08:44:55.967784+0000","last_unstale":"2023-12-22T08:44:57.805954+0000","last_undegraded":"2023-12-22T08:44:57.805954+0000","last_fullsized":"2023-12-22T08:44:57.805954+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:13:41.534342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.942151+0000","last_change":"2023-12-22T08:44:55.954197+0000","last_active":"2023-12-22T08:44:56.942151+0000","last_peered":"2023-12-22T08:44:56.942151+0000","last_clean":"2023-12-22T08:44:56.942151+0000","last_became_active":"2023-12-22T08:44:55.953733+0000","last_became_peered":"2023-12-22T08:44:55.953733+0000","last_unstale":"2023-12-22T08:44:56.942151+0000","last_undegraded":"2023-12-22T08:44:56.942151+0000","last_fullsized":"2023-12-22T08:44:56.942151+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:10:46.427361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964292+0000","last_change":"2023-12-22T08:44:55.960704+0000","last_active":"2023-12-22T08:44:57.964292+0000","last_peered":"2023-12-22T08:44:57.964292+0000","last_clean":"2023-12-22T08:44:57.964292+0000","last_became_active":"2023-12-22T08:44:55.960327+0000","last_became_peered":"2023-12-22T08:44:55.960327+0000","last_unstale":"2023-12-22T08:44:57.964292+0000","last_undegraded":"2023-12-22T08:44:57.964292+0000","last_fullsized":"2023-12-22T08:44:57.964292+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:23:37.624999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962801+0000","last_change":"2023-12-22T08:44:55.962476+0000","last_active":"2023-12-22T08:44:57.962801+0000","last_peered":"2023-12-22T08:44:57.962801+0000","last_clean":"2023-12-22T08:44:57.962801+0000","last_became_active":"2023-12-22T08:44:55.961958+0000","last_became_peered":"2023-12-22T08:44:55.961958+0000","last_unstale":"2023-12-22T08:44:57.962801+0000","last_undegraded":"2023-12-22T08:44:57.962801+0000","last_fullsized":"2023-12-22T08:44:57.962801+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:16:26.999597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962872+0000","last_change":"2023-12-22T08:44:55.952685+0000","last_active":"2023-12-22T08:44:57.962872+0000","last_peered":"2023-12-22T08:44:57.962872+0000","last_clean":"2023-12-22T08:44:57.962872+0000","last_became_active":"2023-12-22T08:44:55.952360+0000","last_became_peered":"2023-12-22T08:44:55.952360+0000","last_unstale":"2023-12-22T08:44:57.962872+0000","last_undegraded":"2023-12-22T08:44:57.962872+0000","last_fullsized":"2023-12-22T08:44:57.962872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:31:41.096332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806130+0000","last_change":"2023-12-22T08:44:55.959399+0000","last_active":"2023-12-22T08:44:57.806130+0000","last_peered":"2023-12-22T08:44:57.806130+0000","last_clean":"2023-12-22T08:44:57.806130+0000","last_became_active":"2023-12-22T08:44:55.958662+0000","last_became_peered":"2023-12-22T08:44:55.958662+0000","last_unstale":"2023-12-22T08:44:57.806130+0000","last_undegraded":"2023-12-22T08:44:57.806130+0000","last_fullsized":"2023-12-22T08:44:57.806130+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:35.327092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.966216+0000","last_change":"2023-12-22T08:44:55.967439+0000","last_active":"2023-12-22T08:44:57.966216+0000","last_peered":"2023-12-22T08:44:57.966216+0000","last_clean":"2023-12-22T08:44:57.966216+0000","last_became_active":"2023-12-22T08:44:55.966519+0000","last_became_peered":"2023-12-22T08:44:55.966519+0000","last_unstale":"2023-12-22T08:44:57.966216+0000","last_undegraded":"2023-12-22T08:44:57.966216+0000","last_fullsized":"2023-12-22T08:44:57.966216+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:13:41.534342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964438+0000","last_change":"2023-12-22T08:44:55.949696+0000","last_active":"2023-12-22T08:44:57.964438+0000","last_peered":"2023-12-22T08:44:57.964438+0000","last_clean":"2023-12-22T08:44:57.964438+0000","last_became_active":"2023-12-22T08:44:55.949445+0000","last_became_peered":"2023-12-22T08:44:55.949445+0000","last_unstale":"2023-12-22T08:44:57.964438+0000","last_undegraded":"2023-12-22T08:44:57.964438+0000","last_fullsized":"2023-12-22T08:44:57.964438+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:42:42.851289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.941477+0000","last_change":"2023-12-22T08:44:55.946791+0000","last_active":"2023-12-22T08:44:56.941477+0000","last_peered":"2023-12-22T08:44:56.941477+0000","last_clean":"2023-12-22T08:44:56.941477+0000","last_became_active":"2023-12-22T08:44:55.946322+0000","last_became_peered":"2023-12-22T08:44:55.946322+0000","last_unstale":"2023-12-22T08:44:56.941477+0000","last_undegraded":"2023-12-22T08:44:56.941477+0000","last_fullsized":"2023-12-22T08:44:56.941477+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:14.621279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806326+0000","last_change":"2023-12-22T08:44:55.968620+0000","last_active":"2023-12-22T08:44:57.806326+0000","last_peered":"2023-12-22T08:44:57.806326+0000","last_clean":"2023-12-22T08:44:57.806326+0000","last_became_active":"2023-12-22T08:44:55.968280+0000","last_became_peered":"2023-12-22T08:44:55.968280+0000","last_unstale":"2023-12-22T08:44:57.806326+0000","last_undegraded":"2023-12-22T08:44:57.806326+0000","last_fullsized":"2023-12-22T08:44:57.806326+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:16:26.999597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939929+0000","last_change":"2023-12-22T08:44:55.963082+0000","last_active":"2023-12-22T08:44:56.939929+0000","last_peered":"2023-12-22T08:44:56.939929+0000","last_clean":"2023-12-22T08:44:56.939929+0000","last_became_active":"2023-12-22T08:44:55.962537+0000","last_became_peered":"2023-12-22T08:44:55.962537+0000","last_unstale":"2023-12-22T08:44:56.939929+0000","last_undegraded":"2023-12-22T08:44:56.939929+0000","last_fullsized":"2023-12-22T08:44:56.939929+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:30.124618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.942495+0000","last_change":"2023-12-22T08:44:55.944583+0000","last_active":"2023-12-22T08:44:56.942495+0000","last_peered":"2023-12-22T08:44:56.942495+0000","last_clean":"2023-12-22T08:44:56.942495+0000","last_became_active":"2023-12-22T08:44:55.944359+0000","last_became_peered":"2023-12-22T08:44:55.944359+0000","last_unstale":"2023-12-22T08:44:56.942495+0000","last_undegraded":"2023-12-22T08:44:56.942495+0000","last_fullsized":"2023-12-22T08:44:56.942495+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:17:26.666640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963414+0000","last_change":"2023-12-22T08:44:55.957269+0000","last_active":"2023-12-22T08:44:57.963414+0000","last_peered":"2023-12-22T08:44:57.963414+0000","last_clean":"2023-12-22T08:44:57.963414+0000","last_became_active":"2023-12-22T08:44:55.956447+0000","last_became_peered":"2023-12-22T08:44:55.956447+0000","last_unstale":"2023-12-22T08:44:57.963414+0000","last_undegraded":"2023-12-22T08:44:57.963414+0000","last_fullsized":"2023-12-22T08:44:57.963414+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:32:11.905112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940962+0000","last_change":"2023-12-22T08:44:55.960236+0000","last_active":"2023-12-22T08:44:56.940962+0000","last_peered":"2023-12-22T08:44:56.940962+0000","last_clean":"2023-12-22T08:44:56.940962+0000","last_became_active":"2023-12-22T08:44:55.958903+0000","last_became_peered":"2023-12-22T08:44:55.958903+0000","last_unstale":"2023-12-22T08:44:56.940962+0000","last_undegraded":"2023-12-22T08:44:56.940962+0000","last_fullsized":"2023-12-22T08:44:56.940962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:08:05.329832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940054+0000","last_change":"2023-12-22T08:44:55.964442+0000","last_active":"2023-12-22T08:44:56.940054+0000","last_peered":"2023-12-22T08:44:56.940054+0000","last_clean":"2023-12-22T08:44:56.940054+0000","last_became_active":"2023-12-22T08:44:55.964239+0000","last_became_peered":"2023-12-22T08:44:55.964239+0000","last_unstale":"2023-12-22T08:44:56.940054+0000","last_undegraded":"2023-12-22T08:44:56.940054+0000","last_fullsized":"2023-12-22T08:44:56.940054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:57:52.591908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962354+0000","last_change":"2023-12-22T08:44:55.953050+0000","last_active":"2023-12-22T08:44:57.962354+0000","last_peered":"2023-12-22T08:44:57.962354+0000","last_clean":"2023-12-22T08:44:57.962354+0000","last_became_active":"2023-12-22T08:44:55.952277+0000","last_became_peered":"2023-12-22T08:44:55.952277+0000","last_unstale":"2023-12-22T08:44:57.962354+0000","last_undegraded":"2023-12-22T08:44:57.962354+0000","last_fullsized":"2023-12-22T08:44:57.962354+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:24:06.396481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.942360+0000","last_change":"2023-12-22T08:44:55.952163+0000","last_active":"2023-12-22T08:44:56.942360+0000","last_peered":"2023-12-22T08:44:56.942360+0000","last_clean":"2023-12-22T08:44:56.942360+0000","last_became_active":"2023-12-22T08:44:55.951806+0000","last_became_peered":"2023-12-22T08:44:55.951806+0000","last_unstale":"2023-12-22T08:44:56.942360+0000","last_undegraded":"2023-12-22T08:44:56.942360+0000","last_fullsized":"2023-12-22T08:44:56.942360+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:28:17.250266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.938716+0000","last_change":"2023-12-22T08:44:55.959178+0000","last_active":"2023-12-22T08:44:56.938716+0000","last_peered":"2023-12-22T08:44:56.938716+0000","last_clean":"2023-12-22T08:44:56.938716+0000","last_became_active":"2023-12-22T08:44:55.958863+0000","last_became_peered":"2023-12-22T08:44:55.958863+0000","last_unstale":"2023-12-22T08:44:56.938716+0000","last_undegraded":"2023-12-22T08:44:56.938716+0000","last_fullsized":"2023-12-22T08:44:56.938716+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:52:36.647797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964209+0000","last_change":"2023-12-22T08:44:55.954974+0000","last_active":"2023-12-22T08:44:57.964209+0000","last_peered":"2023-12-22T08:44:57.964209+0000","last_clean":"2023-12-22T08:44:57.964209+0000","last_became_active":"2023-12-22T08:44:55.953387+0000","last_became_peered":"2023-12-22T08:44:55.953387+0000","last_unstale":"2023-12-22T08:44:57.964209+0000","last_undegraded":"2023-12-22T08:44:57.964209+0000","last_fullsized":"2023-12-22T08:44:57.964209+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:06:43.996770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963713+0000","last_change":"2023-12-22T08:44:55.962731+0000","last_active":"2023-12-22T08:44:57.963713+0000","last_peered":"2023-12-22T08:44:57.963713+0000","last_clean":"2023-12-22T08:44:57.963713+0000","last_became_active":"2023-12-22T08:44:55.962190+0000","last_became_peered":"2023-12-22T08:44:55.962190+0000","last_unstale":"2023-12-22T08:44:57.963713+0000","last_undegraded":"2023-12-22T08:44:57.963713+0000","last_fullsized":"2023-12-22T08:44:57.963713+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:05:30.480831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962473+0000","last_change":"2023-12-22T08:44:55.961840+0000","last_active":"2023-12-22T08:44:57.962473+0000","last_peered":"2023-12-22T08:44:57.962473+0000","last_clean":"2023-12-22T08:44:57.962473+0000","last_became_active":"2023-12-22T08:44:55.961475+0000","last_became_peered":"2023-12-22T08:44:55.961475+0000","last_unstale":"2023-12-22T08:44:57.962473+0000","last_undegraded":"2023-12-22T08:44:57.962473+0000","last_fullsized":"2023-12-22T08:44:57.962473+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:48.745271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.965952+0000","last_change":"2023-12-22T08:44:55.967591+0000","last_active":"2023-12-22T08:44:57.965952+0000","last_peered":"2023-12-22T08:44:57.965952+0000","last_clean":"2023-12-22T08:44:57.965952+0000","last_became_active":"2023-12-22T08:44:55.966950+0000","last_became_peered":"2023-12-22T08:44:55.966950+0000","last_unstale":"2023-12-22T08:44:57.965952+0000","last_undegraded":"2023-12-22T08:44:57.965952+0000","last_fullsized":"2023-12-22T08:44:57.965952+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:06:33.829683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964914+0000","last_change":"2023-12-22T08:44:55.967884+0000","last_active":"2023-12-22T08:44:57.964914+0000","last_peered":"2023-12-22T08:44:57.964914+0000","last_clean":"2023-12-22T08:44:57.964914+0000","last_became_active":"2023-12-22T08:44:55.967652+0000","last_became_peered":"2023-12-22T08:44:55.967652+0000","last_unstale":"2023-12-22T08:44:57.964914+0000","last_undegraded":"2023-12-22T08:44:57.964914+0000","last_fullsized":"2023-12-22T08:44:57.964914+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:59:45.690689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.941389+0000","last_change":"2023-12-22T08:44:55.946988+0000","last_active":"2023-12-22T08:44:56.941389+0000","last_peered":"2023-12-22T08:44:56.941389+0000","last_clean":"2023-12-22T08:44:56.941389+0000","last_became_active":"2023-12-22T08:44:55.946708+0000","last_became_peered":"2023-12-22T08:44:55.946708+0000","last_unstale":"2023-12-22T08:44:56.941389+0000","last_undegraded":"2023-12-22T08:44:56.941389+0000","last_fullsized":"2023-12-22T08:44:56.941389+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:20:16.426697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.938976+0000","last_change":"2023-12-22T08:44:55.953618+0000","last_active":"2023-12-22T08:44:56.938976+0000","last_peered":"2023-12-22T08:44:56.938976+0000","last_clean":"2023-12-22T08:44:56.938976+0000","last_became_active":"2023-12-22T08:44:55.951143+0000","last_became_peered":"2023-12-22T08:44:55.951143+0000","last_unstale":"2023-12-22T08:44:56.938976+0000","last_undegraded":"2023-12-22T08:44:56.938976+0000","last_fullsized":"2023-12-22T08:44:56.938976+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:04:06.263315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806265+0000","last_change":"2023-12-22T08:44:55.967015+0000","last_active":"2023-12-22T08:44:57.806265+0000","last_peered":"2023-12-22T08:44:57.806265+0000","last_clean":"2023-12-22T08:44:57.806265+0000","last_became_active":"2023-12-22T08:44:55.966741+0000","last_became_peered":"2023-12-22T08:44:55.966741+0000","last_unstale":"2023-12-22T08:44:57.806265+0000","last_undegraded":"2023-12-22T08:44:57.806265+0000","last_fullsized":"2023-12-22T08:44:57.806265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:14:54.084290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963075+0000","last_change":"2023-12-22T08:44:55.955817+0000","last_active":"2023-12-22T08:44:57.963075+0000","last_peered":"2023-12-22T08:44:57.963075+0000","last_clean":"2023-12-22T08:44:57.963075+0000","last_became_active":"2023-12-22T08:44:55.954599+0000","last_became_peered":"2023-12-22T08:44:55.954599+0000","last_unstale":"2023-12-22T08:44:57.963075+0000","last_undegraded":"2023-12-22T08:44:57.963075+0000","last_fullsized":"2023-12-22T08:44:57.963075+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:47:03.537517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.938822+0000","last_change":"2023-12-22T08:44:55.953662+0000","last_active":"2023-12-22T08:44:56.938822+0000","last_peered":"2023-12-22T08:44:56.938822+0000","last_clean":"2023-12-22T08:44:56.938822+0000","last_became_active":"2023-12-22T08:44:55.953375+0000","last_became_peered":"2023-12-22T08:44:55.953375+0000","last_unstale":"2023-12-22T08:44:56.938822+0000","last_undegraded":"2023-12-22T08:44:56.938822+0000","last_fullsized":"2023-12-22T08:44:56.938822+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:33:53.651558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939254+0000","last_change":"2023-12-22T08:44:55.950237+0000","last_active":"2023-12-22T08:44:56.939254+0000","last_peered":"2023-12-22T08:44:56.939254+0000","last_clean":"2023-12-22T08:44:56.939254+0000","last_became_active":"2023-12-22T08:44:55.947521+0000","last_became_peered":"2023-12-22T08:44:55.947521+0000","last_unstale":"2023-12-22T08:44:56.939254+0000","last_undegraded":"2023-12-22T08:44:56.939254+0000","last_fullsized":"2023-12-22T08:44:56.939254+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:58:14.823531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962574+0000","last_change":"2023-12-22T08:44:55.961690+0000","last_active":"2023-12-22T08:44:57.962574+0000","last_peered":"2023-12-22T08:44:57.962574+0000","last_clean":"2023-12-22T08:44:57.962574+0000","last_became_active":"2023-12-22T08:44:55.958817+0000","last_became_peered":"2023-12-22T08:44:55.958817+0000","last_unstale":"2023-12-22T08:44:57.962574+0000","last_undegraded":"2023-12-22T08:44:57.962574+0000","last_fullsized":"2023-12-22T08:44:57.962574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:54:44.778819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"88'4","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964084+0000","last_change":"2023-12-22T08:44:55.440017+0000","last_active":"2023-12-22T08:44:57.964084+0000","last_peered":"2023-12-22T08:44:57.964084+0000","last_clean":"2023-12-22T08:44:57.964084+0000","last_became_active":"2023-12-22T08:44:55.439267+0000","last_became_peered":"2023-12-22T08:44:55.439267+0000","last_unstale":"2023-12-22T08:44:57.964084+0000","last_undegraded":"2023-12-22T08:44:57.964084+0000","last_fullsized":"2023-12-22T08:44:57.964084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:04:05.246778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806552+0000","last_change":"2023-12-22T08:44:55.961587+0000","last_active":"2023-12-22T08:44:57.806552+0000","last_peered":"2023-12-22T08:44:57.806552+0000","last_clean":"2023-12-22T08:44:57.806552+0000","last_became_active":"2023-12-22T08:44:55.961277+0000","last_became_peered":"2023-12-22T08:44:55.961277+0000","last_unstale":"2023-12-22T08:44:57.806552+0000","last_undegraded":"2023-12-22T08:44:57.806552+0000","last_fullsized":"2023-12-22T08:44:57.806552+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:17:29.279105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939716+0000","last_change":"2023-12-22T08:44:55.449318+0000","last_active":"2023-12-22T08:44:56.939716+0000","last_peered":"2023-12-22T08:44:56.939716+0000","last_clean":"2023-12-22T08:44:56.939716+0000","last_became_active":"2023-12-22T08:44:55.448839+0000","last_became_peered":"2023-12-22T08:44:55.448839+0000","last_unstale":"2023-12-22T08:44:56.939716+0000","last_undegraded":"2023-12-22T08:44:56.939716+0000","last_fullsized":"2023-12-22T08:44:56.939716+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:12:27.199068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964443+0000","last_change":"2023-12-22T08:44:55.960567+0000","last_active":"2023-12-22T08:44:57.964443+0000","last_peered":"2023-12-22T08:44:57.964443+0000","last_clean":"2023-12-22T08:44:57.964443+0000","last_became_active":"2023-12-22T08:44:55.960003+0000","last_became_peered":"2023-12-22T08:44:55.960003+0000","last_unstale":"2023-12-22T08:44:57.964443+0000","last_undegraded":"2023-12-22T08:44:57.964443+0000","last_fullsized":"2023-12-22T08:44:57.964443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:34.700682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963162+0000","last_change":"2023-12-22T08:44:55.433443+0000","last_active":"2023-12-22T08:44:57.963162+0000","last_peered":"2023-12-22T08:44:57.963162+0000","last_clean":"2023-12-22T08:44:57.963162+0000","last_became_active":"2023-12-22T08:44:55.432735+0000","last_became_peered":"2023-12-22T08:44:55.432735+0000","last_unstale":"2023-12-22T08:44:57.963162+0000","last_undegraded":"2023-12-22T08:44:57.963162+0000","last_fullsized":"2023-12-22T08:44:57.963162+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:29.108080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.966447+0000","last_change":"2023-12-22T08:44:55.967282+0000","last_active":"2023-12-22T08:44:57.966447+0000","last_peered":"2023-12-22T08:44:57.966447+0000","last_clean":"2023-12-22T08:44:57.966447+0000","last_became_active":"2023-12-22T08:44:55.966025+0000","last_became_peered":"2023-12-22T08:44:55.966025+0000","last_unstale":"2023-12-22T08:44:57.966447+0000","last_undegraded":"2023-12-22T08:44:57.966447+0000","last_fullsized":"2023-12-22T08:44:57.966447+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:17:54.343415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964796+0000","last_change":"2023-12-22T08:44:55.446622+0000","last_active":"2023-12-22T08:44:57.964796+0000","last_peered":"2023-12-22T08:44:57.964796+0000","last_clean":"2023-12-22T08:44:57.964796+0000","last_became_active":"2023-12-22T08:44:55.445628+0000","last_became_peered":"2023-12-22T08:44:55.445628+0000","last_unstale":"2023-12-22T08:44:57.964796+0000","last_undegraded":"2023-12-22T08:44:57.964796+0000","last_fullsized":"2023-12-22T08:44:57.964796+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:03:10.604004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962776+0000","last_change":"2023-12-22T08:44:55.952565+0000","last_active":"2023-12-22T08:44:57.962776+0000","last_peered":"2023-12-22T08:44:57.962776+0000","last_clean":"2023-12-22T08:44:57.962776+0000","last_became_active":"2023-12-22T08:44:55.952011+0000","last_became_peered":"2023-12-22T08:44:55.952011+0000","last_unstale":"2023-12-22T08:44:57.962776+0000","last_undegraded":"2023-12-22T08:44:57.962776+0000","last_fullsized":"2023-12-22T08:44:57.962776+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:14:49.850122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.941856+0000","last_change":"2023-12-22T08:44:55.446834+0000","last_active":"2023-12-22T08:44:56.941856+0000","last_peered":"2023-12-22T08:44:56.941856+0000","last_clean":"2023-12-22T08:44:56.941856+0000","last_became_active":"2023-12-22T08:44:55.445434+0000","last_became_peered":"2023-12-22T08:44:55.445434+0000","last_unstale":"2023-12-22T08:44:56.941856+0000","last_undegraded":"2023-12-22T08:44:56.941856+0000","last_fullsized":"2023-12-22T08:44:56.941856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:34:27.834162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964260+0000","last_change":"2023-12-22T08:44:55.958476+0000","last_active":"2023-12-22T08:44:57.964260+0000","last_peered":"2023-12-22T08:44:57.964260+0000","last_clean":"2023-12-22T08:44:57.964260+0000","last_became_active":"2023-12-22T08:44:55.958268+0000","last_became_peered":"2023-12-22T08:44:55.958268+0000","last_unstale":"2023-12-22T08:44:57.964260+0000","last_undegraded":"2023-12-22T08:44:57.964260+0000","last_fullsized":"2023-12-22T08:44:57.964260+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:22:35.325573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963946+0000","last_change":"2023-12-22T08:44:55.455852+0000","last_active":"2023-12-22T08:44:57.963946+0000","last_peered":"2023-12-22T08:44:57.963946+0000","last_clean":"2023-12-22T08:44:57.963946+0000","last_became_active":"2023-12-22T08:44:55.454962+0000","last_became_peered":"2023-12-22T08:44:55.454962+0000","last_unstale":"2023-12-22T08:44:57.963946+0000","last_undegraded":"2023-12-22T08:44:57.963946+0000","last_fullsized":"2023-12-22T08:44:57.963946+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:15:16.977341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963624+0000","last_change":"2023-12-22T08:44:55.967155+0000","last_active":"2023-12-22T08:44:57.963624+0000","last_peered":"2023-12-22T08:44:57.963624+0000","last_clean":"2023-12-22T08:44:57.963624+0000","last_became_active":"2023-12-22T08:44:55.966871+0000","last_became_peered":"2023-12-22T08:44:55.966871+0000","last_unstale":"2023-12-22T08:44:57.963624+0000","last_undegraded":"2023-12-22T08:44:57.963624+0000","last_fullsized":"2023-12-22T08:44:57.963624+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:16:26.999597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963863+0000","last_change":"2023-12-22T08:44:55.450287+0000","last_active":"2023-12-22T08:44:57.963863+0000","last_peered":"2023-12-22T08:44:57.963863+0000","last_clean":"2023-12-22T08:44:57.963863+0000","last_became_active":"2023-12-22T08:44:55.449604+0000","last_became_peered":"2023-12-22T08:44:55.449604+0000","last_unstale":"2023-12-22T08:44:57.963863+0000","last_undegraded":"2023-12-22T08:44:57.963863+0000","last_fullsized":"2023-12-22T08:44:57.963863+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:34:38.363398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940193+0000","last_change":"2023-12-22T08:44:55.962936+0000","last_active":"2023-12-22T08:44:56.940193+0000","last_peered":"2023-12-22T08:44:56.940193+0000","last_clean":"2023-12-22T08:44:56.940193+0000","last_became_active":"2023-12-22T08:44:55.962226+0000","last_became_peered":"2023-12-22T08:44:55.962226+0000","last_unstale":"2023-12-22T08:44:56.940193+0000","last_undegraded":"2023-12-22T08:44:56.940193+0000","last_fullsized":"2023-12-22T08:44:56.940193+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:48.493910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.942942+0000","last_change":"2023-12-22T08:44:55.444311+0000","last_active":"2023-12-22T08:44:56.942942+0000","last_peered":"2023-12-22T08:44:56.942942+0000","last_clean":"2023-12-22T08:44:56.942942+0000","last_became_active":"2023-12-22T08:44:55.443987+0000","last_became_peered":"2023-12-22T08:44:55.443987+0000","last_unstale":"2023-12-22T08:44:56.942942+0000","last_undegraded":"2023-12-22T08:44:56.942942+0000","last_fullsized":"2023-12-22T08:44:56.942942+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:55.494807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962948+0000","last_change":"2023-12-22T08:44:55.962345+0000","last_active":"2023-12-22T08:44:57.962948+0000","last_peered":"2023-12-22T08:44:57.962948+0000","last_clean":"2023-12-22T08:44:57.962948+0000","last_became_active":"2023-12-22T08:44:55.961702+0000","last_became_peered":"2023-12-22T08:44:55.961702+0000","last_unstale":"2023-12-22T08:44:57.962948+0000","last_undegraded":"2023-12-22T08:44:57.962948+0000","last_fullsized":"2023-12-22T08:44:57.962948+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:44:23.339301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.965228+0000","last_change":"2023-12-22T08:44:55.430708+0000","last_active":"2023-12-22T08:44:57.965228+0000","last_peered":"2023-12-22T08:44:57.965228+0000","last_clean":"2023-12-22T08:44:57.965228+0000","last_became_active":"2023-12-22T08:44:55.430013+0000","last_became_peered":"2023-12-22T08:44:55.430013+0000","last_unstale":"2023-12-22T08:44:57.965228+0000","last_undegraded":"2023-12-22T08:44:57.965228+0000","last_fullsized":"2023-12-22T08:44:57.965228+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:47.477373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.938963+0000","last_change":"2023-12-22T08:44:55.966541+0000","last_active":"2023-12-22T08:44:56.938963+0000","last_peered":"2023-12-22T08:44:56.938963+0000","last_clean":"2023-12-22T08:44:56.938963+0000","last_became_active":"2023-12-22T08:44:55.966370+0000","last_became_peered":"2023-12-22T08:44:55.966370+0000","last_unstale":"2023-12-22T08:44:56.938963+0000","last_undegraded":"2023-12-22T08:44:56.938963+0000","last_fullsized":"2023-12-22T08:44:56.938963+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:20:34.700682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939501+0000","last_change":"2023-12-22T08:44:55.446917+0000","last_active":"2023-12-22T08:44:56.939501+0000","last_peered":"2023-12-22T08:44:56.939501+0000","last_clean":"2023-12-22T08:44:56.939501+0000","last_became_active":"2023-12-22T08:44:55.446399+0000","last_became_peered":"2023-12-22T08:44:55.446399+0000","last_unstale":"2023-12-22T08:44:56.939501+0000","last_undegraded":"2023-12-22T08:44:56.939501+0000","last_fullsized":"2023-12-22T08:44:56.939501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:16:25.983059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962671+0000","last_change":"2023-12-22T08:44:55.962649+0000","last_active":"2023-12-22T08:44:57.962671+0000","last_peered":"2023-12-22T08:44:57.962671+0000","last_clean":"2023-12-22T08:44:57.962671+0000","last_became_active":"2023-12-22T08:44:55.962431+0000","last_became_peered":"2023-12-22T08:44:55.962431+0000","last_unstale":"2023-12-22T08:44:57.962671+0000","last_undegraded":"2023-12-22T08:44:57.962671+0000","last_fullsized":"2023-12-22T08:44:57.962671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:32:24.697878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"88'3","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940660+0000","last_change":"2023-12-22T08:44:55.448209+0000","last_active":"2023-12-22T08:44:56.940660+0000","last_peered":"2023-12-22T08:44:56.940660+0000","last_clean":"2023-12-22T08:44:56.940660+0000","last_became_active":"2023-12-22T08:44:55.447913+0000","last_became_peered":"2023-12-22T08:44:55.447913+0000","last_unstale":"2023-12-22T08:44:56.940660+0000","last_undegraded":"2023-12-22T08:44:56.940660+0000","last_fullsized":"2023-12-22T08:44:56.940660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:47:26.804508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940314+0000","last_change":"2023-12-22T08:44:55.949625+0000","last_active":"2023-12-22T08:44:56.940314+0000","last_peered":"2023-12-22T08:44:56.940314+0000","last_clean":"2023-12-22T08:44:56.940314+0000","last_became_active":"2023-12-22T08:44:55.949382+0000","last_became_peered":"2023-12-22T08:44:55.949382+0000","last_unstale":"2023-12-22T08:44:56.940314+0000","last_undegraded":"2023-12-22T08:44:56.940314+0000","last_fullsized":"2023-12-22T08:44:56.940314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:30:07.484726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"88'6","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964105+0000","last_change":"2023-12-22T08:44:55.447745+0000","last_active":"2023-12-22T08:44:57.964105+0000","last_peered":"2023-12-22T08:44:57.964105+0000","last_clean":"2023-12-22T08:44:57.964105+0000","last_became_active":"2023-12-22T08:44:55.447517+0000","last_became_peered":"2023-12-22T08:44:55.447517+0000","last_unstale":"2023-12-22T08:44:57.964105+0000","last_undegraded":"2023-12-22T08:44:57.964105+0000","last_fullsized":"2023-12-22T08:44:57.964105+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:25:02.822149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964583+0000","last_change":"2023-12-22T08:44:55.957638+0000","last_active":"2023-12-22T08:44:57.964583+0000","last_peered":"2023-12-22T08:44:57.964583+0000","last_clean":"2023-12-22T08:44:57.964583+0000","last_became_active":"2023-12-22T08:44:55.957365+0000","last_became_peered":"2023-12-22T08:44:55.957365+0000","last_unstale":"2023-12-22T08:44:57.964583+0000","last_undegraded":"2023-12-22T08:44:57.964583+0000","last_fullsized":"2023-12-22T08:44:57.964583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:14.621279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963770+0000","last_change":"2023-12-22T08:44:55.451714+0000","last_active":"2023-12-22T08:44:57.963770+0000","last_peered":"2023-12-22T08:44:57.963770+0000","last_clean":"2023-12-22T08:44:57.963770+0000","last_became_active":"2023-12-22T08:44:55.451393+0000","last_became_peered":"2023-12-22T08:44:55.451393+0000","last_unstale":"2023-12-22T08:44:57.963770+0000","last_undegraded":"2023-12-22T08:44:57.963770+0000","last_fullsized":"2023-12-22T08:44:57.963770+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:11:17.137785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.966670+0000","last_change":"2023-12-22T08:44:55.968319+0000","last_active":"2023-12-22T08:44:57.966670+0000","last_peered":"2023-12-22T08:44:57.966670+0000","last_clean":"2023-12-22T08:44:57.966670+0000","last_became_active":"2023-12-22T08:44:55.968071+0000","last_became_peered":"2023-12-22T08:44:55.968071+0000","last_unstale":"2023-12-22T08:44:57.966670+0000","last_undegraded":"2023-12-22T08:44:57.966670+0000","last_fullsized":"2023-12-22T08:44:57.966670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:19:55.247327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.965784+0000","last_change":"2023-12-22T08:44:55.449679+0000","last_active":"2023-12-22T08:44:57.965784+0000","last_peered":"2023-12-22T08:44:57.965784+0000","last_clean":"2023-12-22T08:44:57.965784+0000","last_became_active":"2023-12-22T08:44:55.449456+0000","last_became_peered":"2023-12-22T08:44:55.449456+0000","last_unstale":"2023-12-22T08:44:57.965784+0000","last_undegraded":"2023-12-22T08:44:57.965784+0000","last_fullsized":"2023-12-22T08:44:57.965784+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:02.337090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940526+0000","last_change":"2023-12-22T08:44:55.955622+0000","last_active":"2023-12-22T08:44:56.940526+0000","last_peered":"2023-12-22T08:44:56.940526+0000","last_clean":"2023-12-22T08:44:56.940526+0000","last_became_active":"2023-12-22T08:44:55.954958+0000","last_became_peered":"2023-12-22T08:44:55.954958+0000","last_unstale":"2023-12-22T08:44:56.940526+0000","last_undegraded":"2023-12-22T08:44:56.940526+0000","last_fullsized":"2023-12-22T08:44:56.940526+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:44:33.174891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.965465+0000","last_change":"2023-12-22T08:44:55.451837+0000","last_active":"2023-12-22T08:44:57.965465+0000","last_peered":"2023-12-22T08:44:57.965465+0000","last_clean":"2023-12-22T08:44:57.965465+0000","last_became_active":"2023-12-22T08:44:55.451549+0000","last_became_peered":"2023-12-22T08:44:55.451549+0000","last_unstale":"2023-12-22T08:44:57.965465+0000","last_undegraded":"2023-12-22T08:44:57.965465+0000","last_fullsized":"2023-12-22T08:44:57.965465+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:04:11.280843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806305+0000","last_change":"2023-12-22T08:44:55.956889+0000","last_active":"2023-12-22T08:44:57.806305+0000","last_peered":"2023-12-22T08:44:57.806305+0000","last_clean":"2023-12-22T08:44:57.806305+0000","last_became_active":"2023-12-22T08:44:55.956352+0000","last_became_peered":"2023-12-22T08:44:55.956352+0000","last_unstale":"2023-12-22T08:44:57.806305+0000","last_undegraded":"2023-12-22T08:44:57.806305+0000","last_fullsized":"2023-12-22T08:44:57.806305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:28:01.778287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"88'8","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964110+0000","last_change":"2023-12-22T08:44:55.455621+0000","last_active":"2023-12-22T08:44:57.964110+0000","last_peered":"2023-12-22T08:44:57.964110+0000","last_clean":"2023-12-22T08:44:57.964110+0000","last_became_active":"2023-12-22T08:44:55.453186+0000","last_became_peered":"2023-12-22T08:44:55.453186+0000","last_unstale":"2023-12-22T08:44:57.964110+0000","last_undegraded":"2023-12-22T08:44:57.964110+0000","last_fullsized":"2023-12-22T08:44:57.964110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:29:10.590481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939066+0000","last_change":"2023-12-22T08:44:55.952745+0000","last_active":"2023-12-22T08:44:56.939066+0000","last_peered":"2023-12-22T08:44:56.939066+0000","last_clean":"2023-12-22T08:44:56.939066+0000","last_became_active":"2023-12-22T08:44:55.949795+0000","last_became_peered":"2023-12-22T08:44:55.949795+0000","last_unstale":"2023-12-22T08:44:56.939066+0000","last_undegraded":"2023-12-22T08:44:56.939066+0000","last_fullsized":"2023-12-22T08:44:56.939066+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:12:28.215605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962768+0000","last_change":"2023-12-22T08:44:55.439890+0000","last_active":"2023-12-22T08:44:57.962768+0000","last_peered":"2023-12-22T08:44:57.962768+0000","last_clean":"2023-12-22T08:44:57.962768+0000","last_became_active":"2023-12-22T08:44:55.439267+0000","last_became_peered":"2023-12-22T08:44:55.439267+0000","last_unstale":"2023-12-22T08:44:57.962768+0000","last_undegraded":"2023-12-22T08:44:57.962768+0000","last_fullsized":"2023-12-22T08:44:57.962768+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:48:57.243184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.938835+0000","last_change":"2023-12-22T08:44:55.946124+0000","last_active":"2023-12-22T08:44:56.938835+0000","last_peered":"2023-12-22T08:44:56.938835+0000","last_clean":"2023-12-22T08:44:56.938835+0000","last_became_active":"2023-12-22T08:44:55.945722+0000","last_became_peered":"2023-12-22T08:44:55.945722+0000","last_unstale":"2023-12-22T08:44:56.938835+0000","last_undegraded":"2023-12-22T08:44:56.938835+0000","last_fullsized":"2023-12-22T08:44:56.938835+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:08:57.037258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939318+0000","last_change":"2023-12-22T08:44:55.454977+0000","last_active":"2023-12-22T08:44:56.939318+0000","last_peered":"2023-12-22T08:44:56.939318+0000","last_clean":"2023-12-22T08:44:56.939318+0000","last_became_active":"2023-12-22T08:44:55.453047+0000","last_became_peered":"2023-12-22T08:44:55.453047+0000","last_unstale":"2023-12-22T08:44:56.939318+0000","last_undegraded":"2023-12-22T08:44:56.939318+0000","last_fullsized":"2023-12-22T08:44:56.939318+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:06:32.813145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806461+0000","last_change":"2023-12-22T08:44:55.960089+0000","last_active":"2023-12-22T08:44:57.806461+0000","last_peered":"2023-12-22T08:44:57.806461+0000","last_clean":"2023-12-22T08:44:57.806461+0000","last_became_active":"2023-12-22T08:44:55.959778+0000","last_became_peered":"2023-12-22T08:44:55.959778+0000","last_unstale":"2023-12-22T08:44:57.806461+0000","last_undegraded":"2023-12-22T08:44:57.806461+0000","last_fullsized":"2023-12-22T08:44:57.806461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:39:46.747562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"88'1","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939125+0000","last_change":"2023-12-22T08:44:55.454912+0000","last_active":"2023-12-22T08:44:56.939125+0000","last_peered":"2023-12-22T08:44:56.939125+0000","last_clean":"2023-12-22T08:44:56.939125+0000","last_became_active":"2023-12-22T08:44:55.454675+0000","last_became_peered":"2023-12-22T08:44:55.454675+0000","last_unstale":"2023-12-22T08:44:56.939125+0000","last_undegraded":"2023-12-22T08:44:56.939125+0000","last_fullsized":"2023-12-22T08:44:56.939125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:13:40.517804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.806125+0000","last_change":"2023-12-22T08:44:55.964958+0000","last_active":"2023-12-22T08:44:57.806125+0000","last_peered":"2023-12-22T08:44:57.806125+0000","last_clean":"2023-12-22T08:44:57.806125+0000","last_became_active":"2023-12-22T08:44:55.964703+0000","last_became_peered":"2023-12-22T08:44:55.964703+0000","last_unstale":"2023-12-22T08:44:57.806125+0000","last_undegraded":"2023-12-22T08:44:57.806125+0000","last_fullsized":"2023-12-22T08:44:57.806125+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:11:18.154323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964303+0000","last_change":"2023-12-22T08:44:55.434978+0000","last_active":"2023-12-22T08:44:57.964303+0000","last_peered":"2023-12-22T08:44:57.964303+0000","last_clean":"2023-12-22T08:44:57.964303+0000","last_became_active":"2023-12-22T08:44:55.433949+0000","last_became_peered":"2023-12-22T08:44:55.433949+0000","last_unstale":"2023-12-22T08:44:57.964303+0000","last_undegraded":"2023-12-22T08:44:57.964303+0000","last_fullsized":"2023-12-22T08:44:57.964303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:30.656769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963768+0000","last_change":"2023-12-22T08:44:55.961013+0000","last_active":"2023-12-22T08:44:57.963768+0000","last_peered":"2023-12-22T08:44:57.963768+0000","last_clean":"2023-12-22T08:44:57.963768+0000","last_became_active":"2023-12-22T08:44:55.960745+0000","last_became_peered":"2023-12-22T08:44:55.960745+0000","last_unstale":"2023-12-22T08:44:57.963768+0000","last_undegraded":"2023-12-22T08:44:57.963768+0000","last_fullsized":"2023-12-22T08:44:57.963768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:13:41.534342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963090+0000","last_change":"2023-12-22T08:44:55.443419+0000","last_active":"2023-12-22T08:44:57.963090+0000","last_peered":"2023-12-22T08:44:57.963090+0000","last_clean":"2023-12-22T08:44:57.963090+0000","last_became_active":"2023-12-22T08:44:55.441900+0000","last_became_peered":"2023-12-22T08:44:55.441900+0000","last_unstale":"2023-12-22T08:44:57.963090+0000","last_undegraded":"2023-12-22T08:44:57.963090+0000","last_fullsized":"2023-12-22T08:44:57.963090+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:26:38.603922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963739+0000","last_change":"2023-12-22T08:44:55.944985+0000","last_active":"2023-12-22T08:44:57.963739+0000","last_peered":"2023-12-22T08:44:57.963739+0000","last_clean":"2023-12-22T08:44:57.963739+0000","last_became_active":"2023-12-22T08:44:55.944197+0000","last_became_peered":"2023-12-22T08:44:55.944197+0000","last_unstale":"2023-12-22T08:44:57.963739+0000","last_undegraded":"2023-12-22T08:44:57.963739+0000","last_fullsized":"2023-12-22T08:44:57.963739+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:44:23.339301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939433+0000","last_change":"2023-12-22T08:44:55.448752+0000","last_active":"2023-12-22T08:44:56.939433+0000","last_peered":"2023-12-22T08:44:56.939433+0000","last_clean":"2023-12-22T08:44:56.939433+0000","last_became_active":"2023-12-22T08:44:55.448518+0000","last_became_peered":"2023-12-22T08:44:55.448518+0000","last_unstale":"2023-12-22T08:44:56.939433+0000","last_undegraded":"2023-12-22T08:44:56.939433+0000","last_fullsized":"2023-12-22T08:44:56.939433+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:17:28.262568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.942726+0000","last_change":"2023-12-22T08:44:55.955372+0000","last_active":"2023-12-22T08:44:56.942726+0000","last_peered":"2023-12-22T08:44:56.942726+0000","last_clean":"2023-12-22T08:44:56.942726+0000","last_became_active":"2023-12-22T08:44:55.955092+0000","last_became_peered":"2023-12-22T08:44:55.955092+0000","last_unstale":"2023-12-22T08:44:56.942726+0000","last_undegraded":"2023-12-22T08:44:56.942726+0000","last_fullsized":"2023-12-22T08:44:56.942726+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:06:43.996770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.941337+0000","last_change":"2023-12-22T08:44:55.455226+0000","last_active":"2023-12-22T08:44:56.941337+0000","last_peered":"2023-12-22T08:44:56.941337+0000","last_clean":"2023-12-22T08:44:56.941337+0000","last_became_active":"2023-12-22T08:44:55.454965+0000","last_became_peered":"2023-12-22T08:44:55.454965+0000","last_unstale":"2023-12-22T08:44:56.941337+0000","last_undegraded":"2023-12-22T08:44:56.941337+0000","last_fullsized":"2023-12-22T08:44:56.941337+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:10.936337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940767+0000","last_change":"2023-12-22T08:44:55.942854+0000","last_active":"2023-12-22T08:44:56.940767+0000","last_peered":"2023-12-22T08:44:56.940767+0000","last_clean":"2023-12-22T08:44:56.940767+0000","last_became_active":"2023-12-22T08:44:55.942594+0000","last_became_peered":"2023-12-22T08:44:55.942594+0000","last_unstale":"2023-12-22T08:44:56.940767+0000","last_undegraded":"2023-12-22T08:44:56.940767+0000","last_fullsized":"2023-12-22T08:44:56.940767+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:57:08.547786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.962654+0000","last_change":"2023-12-22T08:44:55.441242+0000","last_active":"2023-12-22T08:44:57.962654+0000","last_peered":"2023-12-22T08:44:57.962654+0000","last_clean":"2023-12-22T08:44:57.962654+0000","last_became_active":"2023-12-22T08:44:55.440670+0000","last_became_peered":"2023-12-22T08:44:55.440670+0000","last_unstale":"2023-12-22T08:44:57.962654+0000","last_undegraded":"2023-12-22T08:44:57.962654+0000","last_fullsized":"2023-12-22T08:44:57.962654+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:17:25.650103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963123+0000","last_change":"2023-12-22T08:44:55.962207+0000","last_active":"2023-12-22T08:44:57.963123+0000","last_peered":"2023-12-22T08:44:57.963123+0000","last_clean":"2023-12-22T08:44:57.963123+0000","last_became_active":"2023-12-22T08:44:55.961464+0000","last_became_peered":"2023-12-22T08:44:55.961464+0000","last_unstale":"2023-12-22T08:44:57.963123+0000","last_undegraded":"2023-12-22T08:44:57.963123+0000","last_fullsized":"2023-12-22T08:44:57.963123+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:17:29.279105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963208+0000","last_change":"2023-12-22T08:44:55.448921+0000","last_active":"2023-12-22T08:44:57.963208+0000","last_peered":"2023-12-22T08:44:57.963208+0000","last_clean":"2023-12-22T08:44:57.963208+0000","last_became_active":"2023-12-22T08:44:55.448638+0000","last_became_peered":"2023-12-22T08:44:55.448638+0000","last_unstale":"2023-12-22T08:44:57.963208+0000","last_undegraded":"2023-12-22T08:44:57.963208+0000","last_fullsized":"2023-12-22T08:44:57.963208+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:20:15.410159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939199+0000","last_change":"2023-12-22T08:44:55.960124+0000","last_active":"2023-12-22T08:44:56.939199+0000","last_peered":"2023-12-22T08:44:56.939199+0000","last_clean":"2023-12-22T08:44:56.939199+0000","last_became_active":"2023-12-22T08:44:55.959884+0000","last_became_peered":"2023-12-22T08:44:55.959884+0000","last_unstale":"2023-12-22T08:44:56.939199+0000","last_undegraded":"2023-12-22T08:44:56.939199+0000","last_fullsized":"2023-12-22T08:44:56.939199+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:54:11.952874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.940683+0000","last_change":"2023-12-22T08:44:55.445973+0000","last_active":"2023-12-22T08:44:56.940683+0000","last_peered":"2023-12-22T08:44:56.940683+0000","last_clean":"2023-12-22T08:44:56.940683+0000","last_became_active":"2023-12-22T08:44:55.445236+0000","last_became_peered":"2023-12-22T08:44:55.445236+0000","last_unstale":"2023-12-22T08:44:56.940683+0000","last_undegraded":"2023-12-22T08:44:56.940683+0000","last_fullsized":"2023-12-22T08:44:56.940683+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:26:38.603922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963714+0000","last_change":"2023-12-22T08:44:55.965512+0000","last_active":"2023-12-22T08:44:57.963714+0000","last_peered":"2023-12-22T08:44:57.963714+0000","last_clean":"2023-12-22T08:44:57.963714+0000","last_became_active":"2023-12-22T08:44:55.964997+0000","last_became_peered":"2023-12-22T08:44:55.964997+0000","last_unstale":"2023-12-22T08:44:57.963714+0000","last_undegraded":"2023-12-22T08:44:57.963714+0000","last_fullsized":"2023-12-22T08:44:57.963714+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:52:56.230064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.943151+0000","last_change":"2023-12-22T08:44:55.449483+0000","last_active":"2023-12-22T08:44:56.943151+0000","last_peered":"2023-12-22T08:44:56.943151+0000","last_clean":"2023-12-22T08:44:56.943151+0000","last_became_active":"2023-12-22T08:44:55.448165+0000","last_became_peered":"2023-12-22T08:44:55.448165+0000","last_unstale":"2023-12-22T08:44:56.943151+0000","last_undegraded":"2023-12-22T08:44:56.943151+0000","last_fullsized":"2023-12-22T08:44:56.943151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:12:27.199068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.941620+0000","last_change":"2023-12-22T08:44:55.956510+0000","last_active":"2023-12-22T08:44:56.941620+0000","last_peered":"2023-12-22T08:44:56.941620+0000","last_clean":"2023-12-22T08:44:56.941620+0000","last_became_active":"2023-12-22T08:44:55.956291+0000","last_became_peered":"2023-12-22T08:44:55.956291+0000","last_unstale":"2023-12-22T08:44:56.941620+0000","last_undegraded":"2023-12-22T08:44:56.941620+0000","last_fullsized":"2023-12-22T08:44:56.941620+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:09:33.334059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.942709+0000","last_change":"2023-12-22T08:44:55.444939+0000","last_active":"2023-12-22T08:44:56.942709+0000","last_peered":"2023-12-22T08:44:56.942709+0000","last_clean":"2023-12-22T08:44:56.942709+0000","last_became_active":"2023-12-22T08:44:55.444583+0000","last_became_peered":"2023-12-22T08:44:55.444583+0000","last_unstale":"2023-12-22T08:44:56.942709+0000","last_undegraded":"2023-12-22T08:44:56.942709+0000","last_fullsized":"2023-12-22T08:44:56.942709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:08:56.020720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963665+0000","last_change":"2023-12-22T08:44:55.957423+0000","last_active":"2023-12-22T08:44:57.963665+0000","last_peered":"2023-12-22T08:44:57.963665+0000","last_clean":"2023-12-22T08:44:57.963665+0000","last_became_active":"2023-12-22T08:44:55.956738+0000","last_became_peered":"2023-12-22T08:44:55.956738+0000","last_unstale":"2023-12-22T08:44:57.963665+0000","last_undegraded":"2023-12-22T08:44:57.963665+0000","last_fullsized":"2023-12-22T08:44:57.963665+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:03:04.905454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.941824+0000","last_change":"2023-12-22T08:44:55.449205+0000","last_active":"2023-12-22T08:44:56.941824+0000","last_peered":"2023-12-22T08:44:56.941824+0000","last_clean":"2023-12-22T08:44:56.941824+0000","last_became_active":"2023-12-22T08:44:55.448868+0000","last_became_peered":"2023-12-22T08:44:55.448868+0000","last_unstale":"2023-12-22T08:44:56.941824+0000","last_undegraded":"2023-12-22T08:44:56.941824+0000","last_fullsized":"2023-12-22T08:44:56.941824+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:08:56.020720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963651+0000","last_change":"2023-12-22T08:44:55.950527+0000","last_active":"2023-12-22T08:44:57.963651+0000","last_peered":"2023-12-22T08:44:57.963651+0000","last_clean":"2023-12-22T08:44:57.963651+0000","last_became_active":"2023-12-22T08:44:55.950282+0000","last_became_peered":"2023-12-22T08:44:55.950282+0000","last_unstale":"2023-12-22T08:44:57.963651+0000","last_undegraded":"2023-12-22T08:44:57.963651+0000","last_fullsized":"2023-12-22T08:44:57.963651+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:06:33.829683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939501+0000","last_change":"2023-12-22T08:44:55.453434+0000","last_active":"2023-12-22T08:44:56.939501+0000","last_peered":"2023-12-22T08:44:56.939501+0000","last_clean":"2023-12-22T08:44:56.939501+0000","last_became_active":"2023-12-22T08:44:55.452122+0000","last_became_peered":"2023-12-22T08:44:55.452122+0000","last_unstale":"2023-12-22T08:44:56.939501+0000","last_undegraded":"2023-12-22T08:44:56.939501+0000","last_fullsized":"2023-12-22T08:44:56.939501+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:44:22.322763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939255+0000","last_change":"2023-12-22T08:44:55.966073+0000","last_active":"2023-12-22T08:44:56.939255+0000","last_peered":"2023-12-22T08:44:56.939255+0000","last_clean":"2023-12-22T08:44:56.939255+0000","last_became_active":"2023-12-22T08:44:55.965807+0000","last_became_peered":"2023-12-22T08:44:55.965807+0000","last_unstale":"2023-12-22T08:44:56.939255+0000","last_undegraded":"2023-12-22T08:44:56.939255+0000","last_fullsized":"2023-12-22T08:44:56.939255+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:26:39.620459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.963172+0000","last_change":"2023-12-22T08:44:55.452475+0000","last_active":"2023-12-22T08:44:57.963172+0000","last_peered":"2023-12-22T08:44:57.963172+0000","last_clean":"2023-12-22T08:44:57.963172+0000","last_became_active":"2023-12-22T08:44:55.451903+0000","last_became_peered":"2023-12-22T08:44:55.451903+0000","last_unstale":"2023-12-22T08:44:57.963172+0000","last_undegraded":"2023-12-22T08:44:57.963172+0000","last_fullsized":"2023-12-22T08:44:57.963172+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:47:26.804508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:56.939970+0000","last_change":"2023-12-22T08:44:55.962167+0000","last_active":"2023-12-22T08:44:56.939970+0000","last_peered":"2023-12-22T08:44:56.939970+0000","last_clean":"2023-12-22T08:44:56.939970+0000","last_became_active":"2023-12-22T08:44:55.961793+0000","last_became_peered":"2023-12-22T08:44:55.961793+0000","last_unstale":"2023-12-22T08:44:56.939970+0000","last_undegraded":"2023-12-22T08:44:56.939970+0000","last_fullsized":"2023-12-22T08:44:56.939970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:55.406495+0000","last_clean_scrub_stamp":"2023-12-22T08:44:55.406495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:28.264515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"88'2","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-12-22T08:44:57.964252+0000","last_change":"2023-12-22T08:44:55.452216+0000","last_active":"2023-12-22T08:44:57.964252+0000","last_peered":"2023-12-22T08:44:57.964252+0000","last_clean":"2023-12-22T08:44:57.964252+0000","last_became_active":"2023-12-22T08:44:55.451982+0000","last_became_peered":"2023-12-22T08:44:55.451982+0000","last_unstale":"2023-12-22T08:44:57.964252+0000","last_undegraded":"2023-12-22T08:44:57.964252+0000","last_fullsized":"2023-12-22T08:44:57.964252+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:44:54.389957+0000","last_clean_scrub_stamp":"2023-12-22T08:44:54.389957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:24.149249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":226,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-22T08:44:55.960830+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:44:55.960830+0000","last_peered":"2023-12-22T08:44:55.960830+0000","last_clean":"2023-12-22T08:44:55.960830+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:44:55.960830+0000","last_undegraded":"2023-12-22T08:44:55.960830+0000","last_fullsized":"2023-12-22T08:44:55.960830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":465,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194846,"statfs":{"total":200000000,"available":199522840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.075,"15min":1.0780000000000001},"min":{"1min":0.71399999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.54,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.1020000000000001,"15min":1.0680000000000001},"min":{"1min":0.871,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.272}]},{"osd":1,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.169,"15min":1.157},"min":{"1min":0.70199999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.579,"5min":1.905,"15min":1.905},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2070000000000001,"15min":1.147},"min":{"1min":0.95699999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.45,"5min":1.865,"15min":1.865},"last":1.399}]},{"osd":2,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1319999999999999,"15min":1.0720000000000001},"min":{"1min":0.88600000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.522,"5min":1.875,"15min":1.875},"last":1.522},{"interface":"front","average":{"1min":1.131,"5min":1.208,"15min":1.222},"min":{"1min":0.73099999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.5920000000000001,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.97799999999999998}]},{"osd":3,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.175,"15min":1.107},"min":{"1min":0.77500000000000002,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.5389999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.032},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3049999999999999,"15min":1.2809999999999999},"min":{"1min":0.93300000000000005,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.675,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.2110000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.93600000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.8460000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.2669999999999999,"15min":1.2629999999999999},"min":{"1min":0.92400000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.6279999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.4419999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.371,"15min":1.367},"min":{"1min":1.111,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.728,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.377,"15min":1.373},"min":{"1min":1.0489999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.6950000000000001,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.4870000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.496,"15min":1.488},"min":{"1min":1.1779999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.881,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.7849999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4870000000000001,"15min":1.484},"min":{"1min":1.123,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7789999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.603}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":466,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194846,"statfs":{"total":200000000,"available":199522806,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.121,"15min":1.133},"min":{"1min":0.69199999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.6779999999999999,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":1.242},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.103,"15min":1.0880000000000001},"min":{"1min":0.76600000000000001,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7789999999999999,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.1890000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0609999999999999,"15min":1.026},"min":{"1min":0.70899999999999996,"5min":0.623,"15min":0.623},"max":{"1min":1.575,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.083},{"interface":"front","average":{"1min":1.194,"5min":1.198,"15min":1.173},"min":{"1min":0.76200000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6859999999999999,"5min":1.8,"15min":1.8},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.248,"15min":1.27},"min":{"1min":0.89100000000000001,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.629,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.196,"15min":1.1539999999999999},"min":{"1min":0.91900000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.302}]},{"osd":3,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.319,"15min":1.2989999999999999},"min":{"1min":0.98499999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5149999999999999,"5min":1.847,"15min":1.847},"last":1.468},{"interface":"front","average":{"1min":1.252,"5min":1.2529999999999999,"15min":1.2350000000000001},"min":{"1min":0.94099999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6499999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.93400000000000005}]},{"osd":4,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.385,"15min":1.405},"min":{"1min":0.88500000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.7,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.028},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4119999999999999,"15min":1.4059999999999999},"min":{"1min":1.101,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.629,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.4059999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.347,"15min":1.359},"min":{"1min":1.02,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.6319999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.544,"15min":1.589},"min":{"1min":1.2130000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7330000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.546}]},{"osd":7,"last update":"Fri Dec 22 08:43:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5740000000000001,"15min":1.589},"min":{"1min":1.284,"5min":1.159,"15min":1.159},"max":{"1min":1.71,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.52,"15min":1.55},"min":{"1min":1.2110000000000001,"5min":1.04,"15min":1.04},"max":{"1min":1.7290000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.341}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1040,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194272,"statfs":{"total":200000000,"available":198934965,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.0900000000000001,"15min":1.0800000000000001},"min":{"1min":0.71199999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5429999999999999,"5min":1.944,"15min":1.944},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.127,"15min":1.137},"min":{"1min":0.77100000000000002,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.544,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.01}]},{"osd":1,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.097,"15min":1.109},"min":{"1min":0.70199999999999996,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.619,"5min":2.79,"15min":2.79},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.0640000000000001,"15min":1.024},"min":{"1min":0.79700000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4710000000000001,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.071}]},{"osd":2,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.135,"15min":1.127},"min":{"1min":0.89400000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.5900000000000001,"5min":1.72,"15min":1.72},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.1719999999999999,"15min":1.1619999999999999},"min":{"1min":0.81499999999999995,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.619,"5min":1.978,"15min":1.978},"last":1.29}]},{"osd":3,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.1850000000000001,"15min":1.163},"min":{"1min":0.91400000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.405},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.244,"15min":1.2370000000000001},"min":{"1min":0.95699999999999996,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.6619999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.4430000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.238,"15min":1.2450000000000001},"min":{"1min":0.70299999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.625,"5min":1.853,"15min":1.853},"last":1.494},{"interface":"front","average":{"1min":1.24,"5min":1.2410000000000001,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.571,"5min":1.663,"15min":1.663},"last":1.585}]},{"osd":6,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.302,"15min":1.3080000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.5860000000000001,"5min":1.821,"15min":1.821},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.403,"15min":1.421},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5609999999999999,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.643}]},{"osd":7,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3620000000000001,"15min":1.3640000000000001},"min":{"1min":0.84599999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6619999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.694},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.51,"15min":1.5649999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.7689999999999999,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":1.7509999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":465,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194847,"statfs":{"total":200000000,"available":199523710,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0089999999999999,"15min":1.0069999999999999},"min":{"1min":0.79600000000000004,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4419999999999999,"5min":1.552,"15min":1.552},"last":1.347},{"interface":"front","average":{"1min":1.256,"5min":1.1419999999999999,"15min":1.1060000000000001},"min":{"1min":0.76200000000000001,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":1.395}]},{"osd":1,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.111,"15min":1.052},"min":{"1min":0.73799999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.143},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1060000000000001,"15min":1.1080000000000001},"min":{"1min":0.86199999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.714,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.016}]},{"osd":2,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.159,"15min":1.1439999999999999},"min":{"1min":0.93300000000000005,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5569999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.216},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.224,"15min":1.202},"min":{"1min":0.81599999999999995,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.0830000000000002,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.675}]},{"osd":3,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2190000000000001,"15min":1.198},"min":{"1min":0.873,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.609,"5min":1.774,"15min":1.774},"last":0.876},{"interface":"front","average":{"1min":1.325,"5min":1.2909999999999999,"15min":1.2170000000000001},"min":{"1min":0.95199999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.8720000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.444}]},{"osd":5,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.1879999999999999,"15min":1.1399999999999999},"min":{"1min":0.72099999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.516},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4219999999999999,"15min":1.383},"min":{"1min":1.137,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.913,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.633}]},{"osd":6,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.3049999999999999,"15min":1.2450000000000001},"min":{"1min":0.93999999999999995,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.29,"15min":1.2070000000000001},"min":{"1min":0.88200000000000001,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.7090000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:44:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.4239999999999999,"15min":1.3420000000000001},"min":{"1min":1.077,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.867,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.488},{"interface":"front","average":{"1min":1.607,"5min":1.5049999999999999,"15min":1.4279999999999999},"min":{"1min":1.2350000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.891}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":458,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194854,"statfs":{"total":200000000,"available":199530578,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.92100000000000004,"15min":0.96199999999999997},"min":{"1min":0.49299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4490000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.90400000000000003,"15min":0.92700000000000005},"min":{"1min":0.68799999999999994,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.4810000000000001,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2110000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85199999999999998,"15min":0.85599999999999998},"min":{"1min":0.61799999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.492,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.131,"15min":1.1180000000000001},"min":{"1min":0.65900000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.587}]},{"osd":2,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.036,"15min":1.036},"min":{"1min":0.64700000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.101},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.155,"15min":1.131},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.355}]},{"osd":4,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2210000000000001,"15min":1.204},"min":{"1min":0.998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.256,"15min":1.2290000000000001},"min":{"1min":0.93600000000000005,"5min":0.745,"15min":0.745},"max":{"1min":2.242,"5min":2.242,"15min":2.242},"last":1.387}]},{"osd":5,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3049999999999999,"15min":1.2709999999999999},"min":{"1min":0.877,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9510000000000001,"5min":1.994,"15min":1.994},"last":1.5},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3959999999999999,"15min":1.4370000000000001},"min":{"1min":0.98099999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.726,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.4730000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4350000000000001,"15min":1.4430000000000001},"min":{"1min":1.0129999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.3799999999999999,"15min":1.387},"min":{"1min":0.88400000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.786,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.4219999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:43:58 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.3799999999999999,"15min":1.371},"min":{"1min":0.79600000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.399,"15min":1.389},"min":{"1min":0.96099999999999997,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.9550000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.456}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":458,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194853,"statfs":{"total":200000000,"available":199530122,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.88300000000000001,"15min":0.75700000000000001},"min":{"1min":0.55500000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3380000000000001,"5min":6.8879999999999999,"15min":6.8879999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.96499999999999997,"15min":0.94699999999999995},"min":{"1min":0.495,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.246,"5min":4.5510000000000002,"15min":4.5510000000000002},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":1.0409999999999999,"15min":0.94499999999999995},"min":{"1min":0.497,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.4159999999999999,"5min":11.308999999999999,"15min":11.308999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.02,"5min":0.97899999999999998,"15min":0.91500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5009999999999999,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1990000000000001,"15min":1.0349999999999999},"min":{"1min":0.65900000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6359999999999999,"5min":13.087999999999999,"15min":13.087999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":1.175,"5min":1.268,"15min":1.0860000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.6639999999999999,"5min":12.289999999999999,"15min":12.289999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.3100000000000001,"15min":1.232},"min":{"1min":0.91300000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.788,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":1.125},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.4319999999999999,"15min":1.3660000000000001},"min":{"1min":0.89300000000000002,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.605,"5min":13.927,"15min":13.927},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.4399999999999999,"15min":1.389},"min":{"1min":0.96899999999999997,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7989999999999999,"5min":11.003,"15min":11.003},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.427,"15min":1.2749999999999999},"min":{"1min":1.042,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.9350000000000001,"5min":13.129,"15min":13.129},"last":0.93899999999999995}]},{"osd":6,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3819999999999999,"15min":1.268},"min":{"1min":0.96299999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.8300000000000001,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.419,"5min":1.4399999999999999,"15min":1.357},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.871,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":1.0740000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.482,"15min":1.391},"min":{"1min":0.92500000000000004,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.6419999999999999,"5min":10.948,"15min":10.948},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.482,"15min":1.3500000000000001},"min":{"1min":0.99099999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":3.8460000000000001,"5min":8.0980000000000008,"15min":8.0980000000000008},"last":0.96499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1040,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194271,"statfs":{"total":200000000,"available":198934036,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91200000000000003,"15min":0.90400000000000003},"min":{"1min":0.47399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.3480000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":1.131,"5min":1.0669999999999999,"15min":1.024},"min":{"1min":0.501,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.466,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.95199999999999996,"15min":0.94999999999999996},"min":{"1min":0.52000000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.544,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.002,"15min":0.95999999999999996},"min":{"1min":0.65100000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.647,"5min":2.254,"15min":2.254},"last":1.0409999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.244,"15min":1.1819999999999999},"min":{"1min":0.55800000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.754,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98899999999999999,"15min":0.97299999999999998},"min":{"1min":0.57299999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7150000000000001,"5min":2.226,"15min":2.226},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.274,"15min":1.274},"min":{"1min":0.84799999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.829,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.3879999999999999,"15min":1.3300000000000001},"min":{"1min":0.94399999999999995,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.9470000000000001,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.395}]},{"osd":5,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.274,"15min":1.2470000000000001},"min":{"1min":0.78400000000000003,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":4.6399999999999997,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.419,"5min":1.4019999999999999,"15min":1.345},"min":{"1min":0.95799999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.032,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.0149999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.304,"15min":1.262},"min":{"1min":0.81000000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":4.5819999999999999,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":1.286},{"interface":"front","average":{"1min":1.476,"5min":1.413,"15min":1.375},"min":{"1min":0.95599999999999996,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.9390000000000001,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.081}]},{"osd":7,"last update":"Fri Dec 22 08:44:58 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.448,"15min":1.3700000000000001},"min":{"1min":0.84899999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.3969999999999998,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.603,"5min":1.423,"15min":1.4139999999999999},"min":{"1min":1.046,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":4.508,"5min":4.508,"15min":4.508},"last":1.3580000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":464,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194847,"statfs":{"total":200000000,"available":199524334,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.755,"15min":0.72399999999999998},"min":{"1min":0.623,"5min":0.38,"15min":0.38},"max":{"1min":1.1000000000000001,"5min":1.593,"15min":1.593},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.89900000000000002,"15min":0.89700000000000002},"min":{"1min":0.58199999999999996,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.4199999999999999,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.25}]},{"osd":2,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.81599999999999995,"15min":0.79100000000000004},"min":{"1min":0.60299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.23,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.1279999999999999,"5min":0.97799999999999998,"15min":0.93400000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.0880000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.0660000000000001,"15min":1.02},"min":{"1min":0.75,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5860000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.131,"15min":1.0549999999999999},"min":{"1min":0.83499999999999996,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.645,"5min":2.145,"15min":2.145},"last":0.75700000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.286,"15min":1.262},"min":{"1min":0.98299999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.536,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.2589999999999999,"15min":1.21},"min":{"1min":0.95399999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.3740000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.254,"15min":1.244},"min":{"1min":0.94199999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.671,"5min":1.875,"15min":1.875},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.2729999999999999,"15min":1.256},"min":{"1min":1.0900000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.633,"5min":1.885,"15min":1.885},"last":1.2969999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3069999999999999,"15min":1.2749999999999999},"min":{"1min":1.05,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8149999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.206},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.3919999999999999,"15min":1.381},"min":{"1min":0.90400000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.8340000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.337}]},{"osd":7,"last update":"Fri Dec 22 08:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.361,"15min":1.355},"min":{"1min":0.98299999999999998,"5min":0.755,"15min":0.755},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.381,"15min":1.3680000000000001},"min":{"1min":1.0029999999999999,"5min":0.749,"15min":0.749},"max":{"1min":1.677,"5min":2.214,"15min":2.214},"last":0.95999999999999996}]}]}],"pool_statfs":[]}} 2023-12-22T08:45:01.422 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T08:45:01.422 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T08:45:01.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.696+0000 7f53fa330640 1 Processor -- start 2023-12-22T08:45:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.696+0000 7f53fa330640 1 -- start start 2023-12-22T08:45:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.698+0000 7f53fa330640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f40adfb0 0x7f53f40ae430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.698+0000 7f53fa330640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53f406fcf0 0x7f53f4070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.698+0000 7f53fa330640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f415ca20 con 0x7f53f415b370 2023-12-22T08:45:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.698+0000 7f53fa330640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f40ae970 con 0x7f53f406fcf0 2023-12-22T08:45:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.698+0000 7f53fa330640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f415b750 con 0x7f53f40adfb0 2023-12-22T08:45:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.698+0000 7f53f932e640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f53f415b370 0x7f53f406d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46484/0 (socket says 172.21.15.38:46484) 2023-12-22T08:45:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.698+0000 7f53f932e640 1 -- 172.21.15.38:0/1631997457 learned_addr learned my addr 172.21.15.38:0/1631997457 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.698+0000 7f53f9b2f640 1 --2- 172.21.15.38:0/1631997457 >> v2:172.21.15.38:3300/0 conn(0x7f53f406fcf0 0x7f53f4070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.699+0000 7f53f8b2d640 1 --2- 172.21.15.38:0/1631997457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f40adfb0 0x7f53f40ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.699+0000 7f53f9b2f640 1 -- 172.21.15.38:0/1631997457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f40adfb0 msgr2=0x7f53f40ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.699+0000 7f53f9b2f640 1 --2- 172.21.15.38:0/1631997457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f40adfb0 0x7f53f40ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.699+0000 7f53f9b2f640 1 -- 172.21.15.38:0/1631997457 >> v1:172.21.15.38:6789/0 conn(0x7f53f415b370 legacy=0x7f53f406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.699+0000 7f53f9b2f640 1 -- 172.21.15.38:0/1631997457 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f406dc20 con 0x7f53f406fcf0 2023-12-22T08:45:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.699+0000 7f53ebfff640 1 -- 172.21.15.38:0/1631997457 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213423294 0 0) 0x7f53f415ca20 con 0x7f53f415b370 2023-12-22T08:45:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.699+0000 7f53f8b2d640 1 --2- 172.21.15.38:0/1631997457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f40adfb0 0x7f53f40ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:01.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.700+0000 7f53f9b2f640 1 --2- 172.21.15.38:0/1631997457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53f406fcf0 0x7f53f4070180 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0097a0 tx=0x7f53ec02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7677f3ad205fb8c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:01.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.700+0000 7f53ebfff640 1 -- 172.21.15.38:0/1631997457 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec02d040 con 0x7f53f406fcf0 2023-12-22T08:45:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.700+0000 7f53ebfff640 1 -- 172.21.15.38:0/1631997457 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec031810 con 0x7f53f406fcf0 2023-12-22T08:45:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.700+0000 7f53ebfff640 1 -- 172.21.15.38:0/1631997457 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec031ba0 con 0x7f53f406fcf0 2023-12-22T08:45:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.701+0000 7f53fa330640 1 -- 172.21.15.38:0/1631997457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53f406fcf0 msgr2=0x7f53f4070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.701+0000 7f53fa330640 1 --2- 172.21.15.38:0/1631997457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53f406fcf0 0x7f53f4070180 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0097a0 tx=0x7f53ec02b8b0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.701+0000 7f53fa330640 1 -- 172.21.15.38:0/1631997457 shutdown_connections 2023-12-22T08:45:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.701+0000 7f53fa330640 1 --2- 172.21.15.38:0/1631997457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53f406fcf0 0x7f53f4070180 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.701+0000 7f53fa330640 1 --2- 172.21.15.38:0/1631997457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f40adfb0 0x7f53f40ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.701+0000 7f53fa330640 1 -- 172.21.15.38:0/1631997457 >> 172.21.15.38:0/1631997457 conn(0x7f53f40b1110 msgr2=0x7f53f40b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.701+0000 7f53fa330640 1 -- 172.21.15.38:0/1631997457 shutdown_connections 2023-12-22T08:45:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.701+0000 7f53fa330640 1 -- 172.21.15.38:0/1631997457 wait complete. 2023-12-22T08:45:01.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.703+0000 7f53fa330640 1 Processor -- start 2023-12-22T08:45:01.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.703+0000 7f53fa330640 1 -- start start 2023-12-22T08:45:01.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.704+0000 7f53fa330640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53f406fcf0 0x7f53f41f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.704+0000 7f53fa330640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f40adfb0 0x7f53f415ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.704+0000 7f53fa330640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f415b370 0x7f53f415e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.704+0000 7f53fa330640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f41f22e0 con 0x7f53f406fcf0 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.704+0000 7f53fa330640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f4099f00 con 0x7f53f415b370 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.704+0000 7f53fa330640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f409a1e0 con 0x7f53f40adfb0 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.704+0000 7f53f932e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53f406fcf0 0x7f53f41f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.704+0000 7f53f932e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53f406fcf0 0x7f53f41f5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59998/0 (socket says 172.21.15.38:59998) 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.704+0000 7f53f932e640 1 -- 172.21.15.38:0/2257314385 learned_addr learned my addr 172.21.15.38:0/2257314385 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.705+0000 7f53f8b2d640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f40adfb0 0x7f53f415ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.705+0000 7f53f932e640 1 -- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f40adfb0 msgr2=0x7f53f415ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.705+0000 7f53f932e640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f40adfb0 0x7f53f415ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.705+0000 7f53f9b2f640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f415b370 0x7f53f415e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.705+0000 7f53f932e640 1 -- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f415b370 msgr2=0x7f53f415e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.705+0000 7f53f932e640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f415b370 0x7f53f415e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.705+0000 7f53f932e640 1 -- 172.21.15.38:0/2257314385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec009400 con 0x7f53f406fcf0 2023-12-22T08:45:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.705+0000 7f53f932e640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53f406fcf0 0x7f53f41f5860 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c7c0 tx=0x7f53f000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.705+0000 7f53e9ffb640 1 -- 172.21.15.38:0/2257314385 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f000a640 con 0x7f53f406fcf0 2023-12-22T08:45:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.705+0000 7f53e9ffb640 1 -- 172.21.15.38:0/2257314385 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f000a7c0 con 0x7f53f406fcf0 2023-12-22T08:45:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.705+0000 7f53e9ffb640 1 -- 172.21.15.38:0/2257314385 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f000ab70 con 0x7f53f406fcf0 2023-12-22T08:45:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.705+0000 7f53fa330640 1 -- 172.21.15.38:0/2257314385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f409a4c0 con 0x7f53f406fcf0 2023-12-22T08:45:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.706+0000 7f53fa330640 1 -- 172.21.15.38:0/2257314385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f40ca550 con 0x7f53f406fcf0 2023-12-22T08:45:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.707+0000 7f53fa330640 1 -- 172.21.15.38:0/2257314385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f4061910 con 0x7f53f406fcf0 2023-12-22T08:45:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.708+0000 7f53e9ffb640 1 -- 172.21.15.38:0/2257314385 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f53f000acd0 con 0x7f53f406fcf0 2023-12-22T08:45:01.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.709+0000 7f53e9ffb640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f53d806a460 0x7f53d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:01.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.709+0000 7f53e9ffb640 1 -- 172.21.15.38:0/2257314385 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53f0087cd0 con 0x7f53f406fcf0 2023-12-22T08:45:01.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.709+0000 7f53f8b2d640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f53d806a460 0x7f53d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:01.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.711+0000 7f53f8b2d640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f53d806a460 0x7f53d806c920 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f53f41598f0 tx=0x7f53e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:01.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.713+0000 7f53e9ffb640 1 -- 172.21.15.38:0/2257314385 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f53f0053350 con 0x7f53f406fcf0 2023-12-22T08:45:01.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.976+0000 7f53fa330640 1 -- 172.21.15.38:0/2257314385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f53f40b06e0 con 0x7f53f406fcf0 2023-12-22T08:45:01.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.984+0000 7f53e9ffb640 1 -- 172.21.15.38:0/2257314385 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7f53f00180e0 con 0x7f53f406fcf0 2023-12-22T08:45:01.985 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.0 2023-12-22T08:45:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.987+0000 7f53fa330640 1 -- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f53d806a460 msgr2=0x7f53d806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.987+0000 7f53fa330640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f53d806a460 0x7f53d806c920 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f53f41598f0 tx=0x7f53e4008040 comp rx=0 tx=0).stop 2023-12-22T08:45:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.987+0000 7f53fa330640 1 -- 172.21.15.38:0/2257314385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53f406fcf0 msgr2=0x7f53f41f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.987+0000 7f53fa330640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53f406fcf0 0x7f53f41f5860 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c7c0 tx=0x7f53f000cc80 comp rx=0 tx=0).stop 2023-12-22T08:45:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.987+0000 7f53fa330640 1 -- 172.21.15.38:0/2257314385 shutdown_connections 2023-12-22T08:45:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.987+0000 7f53fa330640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53f415b370 0x7f53f415e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.987+0000 7f53fa330640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53f40adfb0 0x7f53f415ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.987+0000 7f53fa330640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f53d806a460 0x7f53d806c920 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.987+0000 7f53fa330640 1 --2- 172.21.15.38:0/2257314385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53f406fcf0 0x7f53f41f5860 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.987+0000 7f53fa330640 1 -- 172.21.15.38:0/2257314385 >> 172.21.15.38:0/2257314385 conn(0x7f53f40b1110 msgr2=0x7f53f4155b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:01.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.987+0000 7f53fa330640 1 -- 172.21.15.38:0/2257314385 shutdown_connections 2023-12-22T08:45:01.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:01.987+0000 7f53fa330640 1 -- 172.21.15.38:0/2257314385 wait complete. 2023-12-22T08:45:02.008 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:45:02.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.233+0000 7f62cd1ac640 1 Processor -- start 2023-12-22T08:45:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.233+0000 7f62cd1ac640 1 -- start start 2023-12-22T08:45:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.235+0000 7f62cd1ac640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f62c815b420 0x7f62c806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.235+0000 7f62cd1ac640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f62c8071000 0x7f62c815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.235+0000 7f62cd1ac640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c80cdae0 con 0x7f62c80a44a0 2023-12-22T08:45:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.235+0000 7f62cd1ac640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c806dec0 con 0x7f62c8071000 2023-12-22T08:45:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.235+0000 7f62cd1ac640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c815b800 con 0x7f62c815b420 2023-12-22T08:45:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.235+0000 7f62cc9ab640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f62c8071000 0x7f62c815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.235+0000 7f62cc9ab640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f62c8071000 0x7f62c815baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60000/0 (socket says 172.21.15.38:60000) 2023-12-22T08:45:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.235+0000 7f62cc9ab640 1 -- 172.21.15.38:0/2241259073 learned_addr learned my addr 172.21.15.38:0/2241259073 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.235+0000 7f62c7fff640 1 --2- 172.21.15.38:0/2241259073 >> v2:172.21.15.89:3300/0 conn(0x7f62c815b420 0x7f62c806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.236+0000 7f62cc9ab640 1 -- 172.21.15.38:0/2241259073 >> v2:172.21.15.89:3300/0 conn(0x7f62c815b420 msgr2=0x7f62c806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.236+0000 7f62cc9ab640 1 --2- 172.21.15.38:0/2241259073 >> v2:172.21.15.89:3300/0 conn(0x7f62c815b420 0x7f62c806d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.236+0000 7f62cc9ab640 1 -- 172.21.15.38:0/2241259073 >> v1:172.21.15.38:6789/0 conn(0x7f62c80a44a0 legacy=0x7f62c80708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.236+0000 7f62cc9ab640 1 -- 172.21.15.38:0/2241259073 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c80cdd30 con 0x7f62c8071000 2023-12-22T08:45:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.236+0000 7f62c6ffd640 1 -- 172.21.15.38:0/2241259073 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093351675 0 0) 0x7f62c80cdae0 con 0x7f62c80a44a0 2023-12-22T08:45:02.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.237+0000 7f62cc9ab640 1 --2- 172.21.15.38:0/2241259073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62c8071000 0x7f62c815baa0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f62c80613e0 tx=0x7f62c002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec5b182cefe29be server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:02.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.237+0000 7f62c6ffd640 1 -- 172.21.15.38:0/2241259073 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c002cb20 con 0x7f62c8071000 2023-12-22T08:45:02.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.237+0000 7f62c6ffd640 1 -- 172.21.15.38:0/2241259073 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c002cc80 con 0x7f62c8071000 2023-12-22T08:45:02.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.237+0000 7f62c6ffd640 1 -- 172.21.15.38:0/2241259073 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c00343f0 con 0x7f62c8071000 2023-12-22T08:45:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.238+0000 7f62cd1ac640 1 -- 172.21.15.38:0/2241259073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62c8071000 msgr2=0x7f62c815baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.238+0000 7f62cd1ac640 1 --2- 172.21.15.38:0/2241259073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62c8071000 0x7f62c815baa0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f62c80613e0 tx=0x7f62c002bf80 comp rx=0 tx=0).stop 2023-12-22T08:45:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.238+0000 7f62cd1ac640 1 -- 172.21.15.38:0/2241259073 shutdown_connections 2023-12-22T08:45:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.238+0000 7f62cd1ac640 1 --2- 172.21.15.38:0/2241259073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62c8071000 0x7f62c815baa0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.238+0000 7f62cd1ac640 1 --2- 172.21.15.38:0/2241259073 >> v2:172.21.15.89:3300/0 conn(0x7f62c815b420 0x7f62c806d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.238+0000 7f62cd1ac640 1 -- 172.21.15.38:0/2241259073 >> 172.21.15.38:0/2241259073 conn(0x7f62c80b1f70 msgr2=0x7f62c80b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.238+0000 7f62cd1ac640 1 -- 172.21.15.38:0/2241259073 shutdown_connections 2023-12-22T08:45:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.238+0000 7f62cd1ac640 1 -- 172.21.15.38:0/2241259073 wait complete. 2023-12-22T08:45:02.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.240+0000 7f62cd1ac640 1 Processor -- start 2023-12-22T08:45:02.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.240+0000 7f62cd1ac640 1 -- start start 2023-12-22T08:45:02.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.241+0000 7f62cd1ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8071000 0x7f62c8147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:02.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.241+0000 7f62cd1ac640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62c80a44a0 0x7f62c8151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:02.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.241+0000 7f62cd1ac640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c815b420 0x7f62c8152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:02.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.241+0000 7f62cd1ac640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c8147740 con 0x7f62c80a44a0 2023-12-22T08:45:02.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.241+0000 7f62cd1ac640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c8156190 con 0x7f62c8071000 2023-12-22T08:45:02.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.241+0000 7f62cd1ac640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c8152680 con 0x7f62c815b420 2023-12-22T08:45:02.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.241+0000 7f62c77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62c80a44a0 0x7f62c8151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:02.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.241+0000 7f62c77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62c80a44a0 0x7f62c8151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60010/0 (socket says 172.21.15.38:60010) 2023-12-22T08:45:02.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.241+0000 7f62c77fe640 1 -- 172.21.15.38:0/1428179604 learned_addr learned my addr 172.21.15.38:0/1428179604 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62cc9ab640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c815b420 0x7f62c8152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62c7fff640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8071000 0x7f62c8147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62c77fe640 1 -- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c815b420 msgr2=0x7f62c8152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62c77fe640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c815b420 0x7f62c8152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62c77fe640 1 -- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8071000 msgr2=0x7f62c8147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62c77fe640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8071000 0x7f62c8147200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62c77fe640 1 -- 172.21.15.38:0/1428179604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c0009b30 con 0x7f62c80a44a0 2023-12-22T08:45:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62cc9ab640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c815b420 0x7f62c8152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62c77fe640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62c80a44a0 0x7f62c8151ca0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00c410 tx=0x7f62bc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62c4ff9640 1 -- 172.21.15.38:0/1428179604 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0035f0 con 0x7f62c80a44a0 2023-12-22T08:45:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62c4ff9640 1 -- 172.21.15.38:0/1428179604 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc003770 con 0x7f62c80a44a0 2023-12-22T08:45:02.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62c4ff9640 1 -- 172.21.15.38:0/1428179604 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc003b20 con 0x7f62c80a44a0 2023-12-22T08:45:02.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62cd1ac640 1 -- 172.21.15.38:0/1428179604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c8155860 con 0x7f62c80a44a0 2023-12-22T08:45:02.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.242+0000 7f62cd1ac640 1 -- 172.21.15.38:0/1428179604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c8155e20 con 0x7f62c80a44a0 2023-12-22T08:45:02.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.244+0000 7f62cd1ac640 1 -- 172.21.15.38:0/1428179604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c8155fe0 con 0x7f62c80a44a0 2023-12-22T08:45:02.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.245+0000 7f62c4ff9640 1 -- 172.21.15.38:0/1428179604 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f62bc003c80 con 0x7f62c80a44a0 2023-12-22T08:45:02.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.246+0000 7f62c4ff9640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62b406a460 0x7f62b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:02.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.246+0000 7f62c4ff9640 1 -- 172.21.15.38:0/1428179604 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62bc087f70 con 0x7f62c80a44a0 2023-12-22T08:45:02.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.247+0000 7f62c7fff640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62b406a460 0x7f62b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:02.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.248+0000 7f62c7fff640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62b406a460 0x7f62b406c920 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f62b8006fd0 tx=0x7f62b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:02.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.250+0000 7f62c4ff9640 1 -- 172.21.15.38:0/1428179604 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f62bc053580 con 0x7f62c80a44a0 2023-12-22T08:45:02.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.481+0000 7f62cd1ac640 1 -- 172.21.15.38:0/1428179604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62c8156300 con 0x7f62c80a44a0 2023-12-22T08:45:02.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.482+0000 7f62c4ff9640 1 -- 172.21.15.38:0/1428179604 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f62bc017090 con 0x7f62c80a44a0 2023-12-22T08:45:02.484 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:02.485 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2128001687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2128001687},{"type":"v1","addr":"172.21.15.89:6837","nonce":2128001687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6438,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1632983842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1632983842},{"type":"v1","addr":"172.21.15.38:6833","nonce":1632983842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6444,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2613790013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2613790013},{"type":"v1","addr":"172.21.15.38:6835","nonce":2613790013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:44:55.928210+0000","modified":"2023-12-22T08:44:59.439959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6447},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6447":{"gid":6447,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2576950091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2576950091},{"type":"v1","addr":"172.21.15.89:6836","nonce":2576950091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-22T08:45:02.485 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 40 2023-12-22T08:45:02.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.485+0000 7f62cd1ac640 1 -- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62b406a460 msgr2=0x7f62b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:02.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.485+0000 7f62cd1ac640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62b406a460 0x7f62b406c920 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f62b8006fd0 tx=0x7f62b8008040 comp rx=0 tx=0).stop 2023-12-22T08:45:02.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.485+0000 7f62cd1ac640 1 -- 172.21.15.38:0/1428179604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62c80a44a0 msgr2=0x7f62c8151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:02.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.485+0000 7f62cd1ac640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62c80a44a0 0x7f62c8151ca0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00c410 tx=0x7f62bc00c8d0 comp rx=0 tx=0).stop 2023-12-22T08:45:02.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.485+0000 7f62cd1ac640 1 -- 172.21.15.38:0/1428179604 shutdown_connections 2023-12-22T08:45:02.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.485+0000 7f62cd1ac640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c815b420 0x7f62c8152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:02.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.485+0000 7f62cd1ac640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62b406a460 0x7f62b406c920 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:02.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.485+0000 7f62cd1ac640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62c80a44a0 0x7f62c8151ca0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:02.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.485+0000 7f62cd1ac640 1 --2- 172.21.15.38:0/1428179604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8071000 0x7f62c8147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:02.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.485+0000 7f62cd1ac640 1 -- 172.21.15.38:0/1428179604 >> 172.21.15.38:0/1428179604 conn(0x7f62c80b1f70 msgr2=0x7f62c806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:02.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.486+0000 7f62cd1ac640 1 -- 172.21.15.38:0/1428179604 shutdown_connections 2023-12-22T08:45:02.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:02.486+0000 7f62cd1ac640 1 -- 172.21.15.38:0/1428179604 wait complete. 2023-12-22T08:45:02.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T08:44:55.928210+0000', 'modified': '2023-12-22T08:44:59.439959+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6447}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6447': {'gid': 6447, 'name': 'b', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6836/2576950091', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6834', 'nonce': 2576950091}, {'type': 'v1', 'addr': '172.21.15.89:6836', 'nonce': 2576950091}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T08:45:02.911 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T08:45:02.911 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-22T08:45:03.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.144+0000 7f861d650640 1 Processor -- start 2023-12-22T08:45:03.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.144+0000 7f861d650640 1 -- start start 2023-12-22T08:45:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.146+0000 7f861d650640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f861815b0e0 0x7f861815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.146+0000 7f861d650640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861809c980 0x7f861815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.146+0000 7f861d650640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8618071460 0x7f86180718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.146+0000 7f861d650640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8618071df0 con 0x7f8618071460 2023-12-22T08:45:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.146+0000 7f861d650640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861815edf0 con 0x7f861815b0e0 2023-12-22T08:45:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.146+0000 7f861d650640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861815bd90 con 0x7f861809c980 2023-12-22T08:45:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.146+0000 7f861ce4f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8618071460 0x7f86180718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.146+0000 7f861ce4f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8618071460 0x7f86180718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60016/0 (socket says 172.21.15.38:60016) 2023-12-22T08:45:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.146+0000 7f861ce4f640 1 -- 172.21.15.38:0/2203017941 learned_addr learned my addr 172.21.15.38:0/2203017941 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.147+0000 7f86177fe640 1 --2- 172.21.15.38:0/2203017941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861809c980 0x7f861815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.147+0000 7f8617fff640 1 --2- 172.21.15.38:0/2203017941 >> v2:172.21.15.89:3300/0 conn(0x7f861815b0e0 0x7f861815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.147+0000 7f861ce4f640 1 -- 172.21.15.38:0/2203017941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861809c980 msgr2=0x7f861815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.147+0000 7f861ce4f640 1 --2- 172.21.15.38:0/2203017941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861809c980 0x7f861815c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.147+0000 7f861ce4f640 1 -- 172.21.15.38:0/2203017941 >> v2:172.21.15.89:3300/0 conn(0x7f861815b0e0 msgr2=0x7f861815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.147+0000 7f861ce4f640 1 --2- 172.21.15.38:0/2203017941 >> v2:172.21.15.89:3300/0 conn(0x7f861815b0e0 0x7f861815b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.147+0000 7f861ce4f640 1 -- 172.21.15.38:0/2203017941 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861815c070 con 0x7f8618071460 2023-12-22T08:45:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.147+0000 7f8617fff640 1 --2- 172.21.15.38:0/2203017941 >> v2:172.21.15.89:3300/0 conn(0x7f861815b0e0 0x7f861815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:03.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.148+0000 7f861ce4f640 1 --2- 172.21.15.38:0/2203017941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8618071460 0x7f86180718b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f86180b1c60 tx=0x7f861002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5355aaf3ed3fa29c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:03.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.148+0000 7f8616ffd640 1 -- 172.21.15.38:0/2203017941 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861002c960 con 0x7f8618071460 2023-12-22T08:45:03.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.148+0000 7f8616ffd640 1 -- 172.21.15.38:0/2203017941 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861002cac0 con 0x7f8618071460 2023-12-22T08:45:03.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.148+0000 7f8616ffd640 1 -- 172.21.15.38:0/2203017941 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861002ce50 con 0x7f8618071460 2023-12-22T08:45:03.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.149+0000 7f861d650640 1 -- 172.21.15.38:0/2203017941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8618071460 msgr2=0x7f86180718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.149+0000 7f861d650640 1 --2- 172.21.15.38:0/2203017941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8618071460 0x7f86180718b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f86180b1c60 tx=0x7f861002bdc0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.149+0000 7f861d650640 1 -- 172.21.15.38:0/2203017941 shutdown_connections 2023-12-22T08:45:03.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.149+0000 7f861d650640 1 --2- 172.21.15.38:0/2203017941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8618071460 0x7f86180718b0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.149+0000 7f861d650640 1 --2- 172.21.15.38:0/2203017941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861809c980 0x7f861815c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.149+0000 7f861d650640 1 --2- 172.21.15.38:0/2203017941 >> v2:172.21.15.89:3300/0 conn(0x7f861815b0e0 0x7f861815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.150+0000 7f861d650640 1 -- 172.21.15.38:0/2203017941 >> 172.21.15.38:0/2203017941 conn(0x7f86180cf000 msgr2=0x7f86180cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:03.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.150+0000 7f861d650640 1 -- 172.21.15.38:0/2203017941 shutdown_connections 2023-12-22T08:45:03.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.150+0000 7f861d650640 1 -- 172.21.15.38:0/2203017941 wait complete. 2023-12-22T08:45:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.152+0000 7f861d650640 1 Processor -- start 2023-12-22T08:45:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.152+0000 7f861d650640 1 -- start start 2023-12-22T08:45:03.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.153+0000 7f861d650640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8618071460 0x7f861814f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.153+0000 7f861d650640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861809c980 0x7f861815f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.153+0000 7f861d650640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f861815b0e0 0x7f861815f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.153+0000 7f861d650640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8618150ba0 con 0x7f8618071460 2023-12-22T08:45:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.153+0000 7f861d650640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861814ff60 con 0x7f861815b0e0 2023-12-22T08:45:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.153+0000 7f861d650640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8618150200 con 0x7f861809c980 2023-12-22T08:45:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.154+0000 7f8617fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8618071460 0x7f861814f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.154+0000 7f8617fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8618071460 0x7f861814f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60020/0 (socket says 172.21.15.38:60020) 2023-12-22T08:45:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.154+0000 7f8617fff640 1 -- 172.21.15.38:0/1191188746 learned_addr learned my addr 172.21.15.38:0/1191188746 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.154+0000 7f86177fe640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861809c980 0x7f861815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.154+0000 7f861ce4f640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f861815b0e0 0x7f861815f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.154+0000 7f8617fff640 1 -- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861809c980 msgr2=0x7f861815f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.154+0000 7f8617fff640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861809c980 0x7f861815f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.154+0000 7f8617fff640 1 -- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f861815b0e0 msgr2=0x7f861815f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.154+0000 7f8617fff640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f861815b0e0 0x7f861815f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.154+0000 7f8617fff640 1 -- 172.21.15.38:0/1191188746 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8610009b30 con 0x7f8618071460 2023-12-22T08:45:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.155+0000 7f8617fff640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8618071460 0x7f861814f8a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f860800c7f0 tx=0x7f860800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.155+0000 7f8614ff9640 1 -- 172.21.15.38:0/1191188746 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608007a30 con 0x7f8618071460 2023-12-22T08:45:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.155+0000 7f8614ff9640 1 -- 172.21.15.38:0/1191188746 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8608007b90 con 0x7f8618071460 2023-12-22T08:45:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.155+0000 7f8614ff9640 1 -- 172.21.15.38:0/1191188746 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860800ce40 con 0x7f8618071460 2023-12-22T08:45:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.155+0000 7f861d650640 1 -- 172.21.15.38:0/1191188746 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86181504e0 con 0x7f8618071460 2023-12-22T08:45:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.155+0000 7f861d650640 1 -- 172.21.15.38:0/1191188746 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8618150fc0 con 0x7f8618071460 2023-12-22T08:45:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.158+0000 7f8614ff9640 1 -- 172.21.15.38:0/1191188746 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f86080113f0 con 0x7f8618071460 2023-12-22T08:45:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.159+0000 7f8614ff9640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f860406a430 0x7f860406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.159+0000 7f8614ff9640 1 -- 172.21.15.38:0/1191188746 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8608088ba0 con 0x7f8618071460 2023-12-22T08:45:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.160+0000 7f862141a740 1 Processor -- start 2023-12-22T08:45:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.160+0000 7f862141a740 1 -- start start 2023-12-22T08:45:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.160+0000 7f86177fe640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f860406a430 0x7f860406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.161+0000 7f862141a740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 0x56287f3c1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.161+0000 7f862141a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3912a0 0x56287f3be590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.161+0000 7f862141a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3bead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.161+0000 7f862141a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56287f2fcf80 con 0x56287f394ea0 2023-12-22T08:45:03.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.161+0000 7f862141a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56287f2fa710 con 0x56287f3912a0 2023-12-22T08:45:03.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.161+0000 7f862141a740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56287f2f6000 con 0x56287f3c1320 2023-12-22T08:45:03.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.161+0000 7f861ce4f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3bead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.161+0000 7f86177fe640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f860406a430 0x7f860406c8f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f860c006fd0 tx=0x7f860c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:03.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.161+0000 7f861ce4f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3bead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60022/0 (socket says 172.21.15.38:60022) 2023-12-22T08:45:03.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.161+0000 7f861ce4f640 1 -- 172.21.15.38:0/735930770 learned_addr learned my addr 172.21.15.38:0/735930770 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:03.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.162+0000 7f86177fe640 1 --2- 172.21.15.38:0/735930770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3912a0 0x56287f3be590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.162+0000 7f8617fff640 1 --2- 172.21.15.38:0/735930770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 0x56287f3c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.162+0000 7f861ce4f640 1 -- 172.21.15.38:0/735930770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 msgr2=0x56287f3c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.162+0000 7f861ce4f640 1 --2- 172.21.15.38:0/735930770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 0x56287f3c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.162+0000 7f861ce4f640 1 -- 172.21.15.38:0/735930770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3912a0 msgr2=0x56287f3be590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.162+0000 7f861ce4f640 1 --2- 172.21.15.38:0/735930770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3912a0 0x56287f3be590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.162+0000 7f861ce4f640 1 -- 172.21.15.38:0/735930770 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56287f2bd690 con 0x56287f394ea0 2023-12-22T08:45:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.162+0000 7f861ce4f640 1 --2- 172.21.15.38:0/735930770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3bead0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8610009f40 tx=0x7f861002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a864009bd93abb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.162+0000 7f85fdffb640 1 -- 172.21.15.38:0/735930770 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861003e430 con 0x56287f394ea0 2023-12-22T08:45:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.163+0000 7f85fdffb640 1 -- 172.21.15.38:0/735930770 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861003e590 con 0x56287f394ea0 2023-12-22T08:45:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.163+0000 7f85fdffb640 1 -- 172.21.15.38:0/735930770 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861003e900 con 0x56287f394ea0 2023-12-22T08:45:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.163+0000 7f862141a740 1 -- 172.21.15.38:0/735930770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 msgr2=0x56287f3bead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.163+0000 7f862141a740 1 --2- 172.21.15.38:0/735930770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3bead0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8610009f40 tx=0x7f861002e000 comp rx=0 tx=0).stop 2023-12-22T08:45:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.163+0000 7f862141a740 1 -- 172.21.15.38:0/735930770 shutdown_connections 2023-12-22T08:45:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.163+0000 7f862141a740 1 --2- 172.21.15.38:0/735930770 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3bead0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.163+0000 7f862141a740 1 --2- 172.21.15.38:0/735930770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3912a0 0x56287f3be590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.163+0000 7f862141a740 1 --2- 172.21.15.38:0/735930770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 0x56287f3c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.163+0000 7f862141a740 1 -- 172.21.15.38:0/735930770 >> 172.21.15.38:0/735930770 conn(0x56287f3935b0 msgr2=0x56287f3dc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.163+0000 7f862141a740 1 -- 172.21.15.38:0/735930770 shutdown_connections 2023-12-22T08:45:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.163+0000 7f862141a740 1 -- 172.21.15.38:0/735930770 wait complete. 2023-12-22T08:45:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.164+0000 7f862141a740 1 -- start start 2023-12-22T08:45:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.164+0000 7f862141a740 1 Processor -- start 2023-12-22T08:45:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.165+0000 7f862141a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3ef010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.165+0000 7f862141a740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 0x56287f3b84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.165+0000 7f862141a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3b8a10 0x56287f3b6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.165+0000 7f862141a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56287f2977d0 con 0x56287f394ea0 2023-12-22T08:45:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.165+0000 7f862141a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56287f297470 con 0x56287f3b8a10 2023-12-22T08:45:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.165+0000 7f862141a740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56287f05df20 con 0x56287f3c1320 2023-12-22T08:45:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.165+0000 7f862141a740 10 client.0 _ll_register_callbacks cb 0x56287f2e61b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:45:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.166+0000 7f8617fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3ef010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.166+0000 7f8617fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3ef010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60026/0 (socket says 172.21.15.38:60026) 2023-12-22T08:45:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.166+0000 7f8617fff640 1 -- 172.21.15.38:0/3915901160 learned_addr learned my addr 172.21.15.38:0/3915901160 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.166+0000 7f861ce4f640 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3b8a10 0x56287f3b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.166+0000 7f86177fe640 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 0x56287f3b84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.166+0000 7f8617fff640 1 -- 172.21.15.38:0/3915901160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 msgr2=0x56287f3b84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.166+0000 7f8617fff640 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 0x56287f3b84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.166+0000 7f8617fff640 1 -- 172.21.15.38:0/3915901160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3b8a10 msgr2=0x56287f3b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.166+0000 7f8617fff640 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3b8a10 0x56287f3b6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.166+0000 7f8617fff640 1 -- 172.21.15.38:0/3915901160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861815c070 con 0x56287f394ea0 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.166+0000 7f86177fe640 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 0x56287f3b84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.166+0000 7f8617fff640 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3ef010 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f860800c7c0 tx=0x7f8608057ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d948e76f1da702b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.166+0000 7f85f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f85f6ffd640 1 -- 172.21.15.38:0/3915901160 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860805fb10 con 0x56287f394ea0 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f85f6ffd640 1 -- 172.21.15.38:0/3915901160 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f860806f1c0 con 0x56287f394ea0 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f862141a740 1 -- 172.21.15.38:0/3915901160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56287f320550 con 0x56287f394ea0 2023-12-22T08:45:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f85f6ffd640 1 -- 172.21.15.38:0/3915901160 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f860806f380 con 0x56287f394ea0 2023-12-22T08:45:03.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f862141a740 10 client.6600 fetch_fsmap learned FSMap version 40 2023-12-22T08:45:03.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f862141a740 1 -- 172.21.15.38:0/3915901160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x56287f2f4680 con 0x56287f394ea0 2023-12-22T08:45:03.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f85f6ffd640 1 -- 172.21.15.38:0/3915901160 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56287f320550 con 0x56287f394ea0 2023-12-22T08:45:03.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f85f6ffd640 1 -- 172.21.15.38:0/3915901160 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 40) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f8608053ba0 con 0x56287f394ea0 2023-12-22T08:45:03.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f862141a740 10 client.6600 fetch_fsmap finished waiting for FSMap version 40 2023-12-22T08:45:03.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f862141a740 10 client.6600 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-22T08:45:03.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f862141a740 20 client.6600 populate_metadata read hostname 'smithi038' 2023-12-22T08:45:03.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f862141a740 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.89:6834/2576950091,v1:172.21.15.89:6836/2576950091] conn(0x56287f3f6f10 0x56287f3f9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f862141a740 4 client.6600 mds_command: new command op to 6447 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T08:45:03.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.167+0000 7f862141a740 1 -- 172.21.15.38:0/3915901160 --> [v2:172.21.15.89:6834/2576950091,v1:172.21.15.89:6836/2576950091] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56287f2e8b50 con 0x56287f3f6f10 2023-12-22T08:45:03.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.168+0000 7f86177fe640 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.89:6834/2576950091,v1:172.21.15.89:6836/2576950091] conn(0x56287f3f6f10 0x56287f3f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.169+0000 7f86177fe640 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.89:6834/2576950091,v1:172.21.15.89:6836/2576950091] conn(0x56287f3f6f10 0x56287f3f9300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=525d6fa11f23029f server_cookie=8a613da0c2a74b61 in_seq=0 out_seq=0 2023-12-22T08:45:03.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.169+0000 7f85f6ffd640 10 client.6600 ms_handle_connect on v2:172.21.15.89:6834/2576950091 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f85f6ffd640 1 -- 172.21.15.38:0/3915901160 <== mds.0 v2:172.21.15.89:6834/2576950091 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x56287f2e8b50 con 0x56287f3f6f10 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f85f6ffd640 10 client.6600 handle_command_reply: tid=0 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f862141a740 1 client.6600 shutdown 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f862141a740 1 -- 172.21.15.38:0/3915901160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 msgr2=0x56287f3ef010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f862141a740 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3ef010 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f860800c7c0 tx=0x7f8608057ef0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f862141a740 1 -- 172.21.15.38:0/3915901160 shutdown_connections 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f862141a740 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.89:6834/2576950091,v1:172.21.15.89:6836/2576950091] conn(0x56287f3f6f10 0x56287f3f9300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f862141a740 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3b8a10 0x56287f3b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f862141a740 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 0x56287f3b84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f862141a740 1 --2- 172.21.15.38:0/3915901160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3ef010 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f85f6ffd640 0 client.6600 ms_handle_reset on v2:172.21.15.89:6834/2576950091 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f862141a740 1 -- 172.21.15.38:0/3915901160 >> 172.21.15.38:0/3915901160 conn(0x56287f3912a0 msgr2=0x56287f3df640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f862141a740 1 -- 172.21.15.38:0/3915901160 shutdown_connections 2023-12-22T08:45:03.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f862141a740 1 -- 172.21.15.38:0/3915901160 wait complete. 2023-12-22T08:45:03.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.171+0000 7f862141a740 20 client.6600 trim_cache size 0 max 16384 2023-12-22T08:45:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.188+0000 7f862141a740 1 Processor -- start 2023-12-22T08:45:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.188+0000 7f862141a740 1 -- start start 2023-12-22T08:45:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.189+0000 7f862141a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3b84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.189+0000 7f862141a740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3b8a10 0x56287f3ee6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.189+0000 7f862141a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3c1320 0x56287f3c1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.189+0000 7f862141a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56287f395f00 con 0x56287f394ea0 2023-12-22T08:45:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.189+0000 7f862141a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56287f3b66a0 con 0x56287f3c1320 2023-12-22T08:45:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.189+0000 7f862141a740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56287f388e70 con 0x56287f3b8a10 2023-12-22T08:45:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.189+0000 7f8617fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3b84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.189+0000 7f8617fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3b84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60036/0 (socket says 172.21.15.38:60036) 2023-12-22T08:45:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.189+0000 7f8617fff640 1 -- 172.21.15.38:0/283187036 learned_addr learned my addr 172.21.15.38:0/283187036 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.189+0000 7f86177fe640 1 --2- 172.21.15.38:0/283187036 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3b8a10 0x56287f3ee6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.189+0000 7f861ce4f640 1 --2- 172.21.15.38:0/283187036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3c1320 0x56287f3c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.190+0000 7f8617fff640 1 -- 172.21.15.38:0/283187036 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3b8a10 msgr2=0x56287f3ee6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:03.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.190+0000 7f8617fff640 1 --2- 172.21.15.38:0/283187036 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3b8a10 0x56287f3ee6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.190+0000 7f8617fff640 1 -- 172.21.15.38:0/283187036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3c1320 msgr2=0x56287f3c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:03.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.190+0000 7f8617fff640 1 --2- 172.21.15.38:0/283187036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3c1320 0x56287f3c1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.190+0000 7f8617fff640 1 -- 172.21.15.38:0/283187036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56287f2969e0 con 0x56287f394ea0 2023-12-22T08:45:03.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.190+0000 7f861ce4f640 1 --2- 172.21.15.38:0/283187036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3c1320 0x56287f3c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:45:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.190+0000 7f8617fff640 1 --2- 172.21.15.38:0/283187036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3b84d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f860800a120 tx=0x7f860801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f942b4cc2fd0ba6e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.191+0000 7f85fe7fc640 1 -- 172.21.15.38:0/283187036 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860805fd90 con 0x56287f394ea0 2023-12-22T08:45:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.191+0000 7f85fe7fc640 1 -- 172.21.15.38:0/283187036 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860805fb10 con 0x56287f394ea0 2023-12-22T08:45:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.191+0000 7f85fe7fc640 1 -- 172.21.15.38:0/283187036 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608053ba0 con 0x56287f394ea0 2023-12-22T08:45:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.191+0000 7f862141a740 1 -- 172.21.15.38:0/283187036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 msgr2=0x56287f3b84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.191+0000 7f862141a740 1 --2- 172.21.15.38:0/283187036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3b84d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f860800a120 tx=0x7f860801c000 comp rx=0 tx=0).stop 2023-12-22T08:45:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.191+0000 7f862141a740 1 -- 172.21.15.38:0/283187036 shutdown_connections 2023-12-22T08:45:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.191+0000 7f862141a740 1 --2- 172.21.15.38:0/283187036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3c1320 0x56287f3c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.191+0000 7f862141a740 1 --2- 172.21.15.38:0/283187036 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3b8a10 0x56287f3ee6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.191+0000 7f862141a740 1 --2- 172.21.15.38:0/283187036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3b84d0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.191+0000 7f862141a740 1 -- 172.21.15.38:0/283187036 >> 172.21.15.38:0/283187036 conn(0x56287f3912a0 msgr2=0x56287f391730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.191+0000 7f862141a740 1 -- 172.21.15.38:0/283187036 shutdown_connections 2023-12-22T08:45:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.191+0000 7f862141a740 1 -- 172.21.15.38:0/283187036 wait complete. 2023-12-22T08:45:03.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.192+0000 7f862141a740 1 -- start start 2023-12-22T08:45:03.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.192+0000 7f862141a740 1 Processor -- start 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.193+0000 7f862141a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3eb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.193+0000 7f862141a740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3b8a10 0x56287f3dc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.193+0000 7f862141a740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 0x56287f38be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.193+0000 7f862141a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56287f3ebbd0 con 0x56287f394ea0 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.193+0000 7f862141a740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56287f3be140 con 0x56287f3b8a10 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.193+0000 7f862141a740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56287f3be380 con 0x56287f3c1320 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.193+0000 7f862141a740 10 client.0 _ll_register_callbacks cb 0x7f8610009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.194+0000 7f8617fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3eb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.194+0000 7f8617fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3eb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60044/0 (socket says 172.21.15.38:60044) 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.194+0000 7f8617fff640 1 -- 172.21.15.38:0/379727360 learned_addr learned my addr 172.21.15.38:0/379727360 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.194+0000 7f8617fff640 1 -- 172.21.15.38:0/379727360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 msgr2=0x56287f38be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.194+0000 7f8617fff640 1 --2- 172.21.15.38:0/379727360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 0x56287f38be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.194+0000 7f8617fff640 1 -- 172.21.15.38:0/379727360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3b8a10 msgr2=0x56287f3dc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:03.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.194+0000 7f8617fff640 1 --2- 172.21.15.38:0/379727360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3b8a10 0x56287f3dc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.194+0000 7f8617fff640 1 -- 172.21.15.38:0/379727360 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56287f2f4680 con 0x56287f394ea0 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.194+0000 7f8617fff640 1 --2- 172.21.15.38:0/379727360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3eb1c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8608057a30 tx=0x7f8608086f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59808c24a71ddc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.194+0000 7f85f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.194+0000 7f85f6ffd640 1 -- 172.21.15.38:0/379727360 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608056f10 con 0x56287f394ea0 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.194+0000 7f85f6ffd640 1 -- 172.21.15.38:0/379727360 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8608057070 con 0x56287f394ea0 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.194+0000 7f862141a740 1 -- 172.21.15.38:0/379727360 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f861003e590 con 0x56287f394ea0 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.195+0000 7f85f6ffd640 1 -- 172.21.15.38:0/379727360 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f860805fd90 con 0x56287f394ea0 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.195+0000 7f862141a740 10 client.6606 fetch_fsmap learned FSMap version 40 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.195+0000 7f862141a740 1 -- 172.21.15.38:0/379727360 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x56287f2bbef0 con 0x56287f394ea0 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.195+0000 7f85f6ffd640 1 -- 172.21.15.38:0/379727360 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861003e590 con 0x56287f394ea0 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.195+0000 7f85f6ffd640 1 -- 172.21.15.38:0/379727360 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 40) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f860807d070 con 0x56287f394ea0 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.195+0000 7f862141a740 10 client.6606 fetch_fsmap finished waiting for FSMap version 40 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.195+0000 7f862141a740 10 client.6606 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-22T08:45:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.195+0000 7f862141a740 20 client.6606 populate_metadata read hostname 'smithi038' 2023-12-22T08:45:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.195+0000 7f862141a740 1 --2- 172.21.15.38:0/379727360 >> [v2:172.21.15.89:6834/2576950091,v1:172.21.15.89:6836/2576950091] conn(0x56287f3fd900 0x56287f38c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.195+0000 7f862141a740 4 client.6606 mds_command: new command op to 6447 tid=0[{"prefix": "status"}] 2023-12-22T08:45:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.195+0000 7f862141a740 1 -- 172.21.15.38:0/379727360 --> [v2:172.21.15.89:6834/2576950091,v1:172.21.15.89:6836/2576950091] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56287f2ef080 con 0x56287f3fd900 2023-12-22T08:45:03.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.196+0000 7f86177fe640 1 --2- 172.21.15.38:0/379727360 >> [v2:172.21.15.89:6834/2576950091,v1:172.21.15.89:6836/2576950091] conn(0x56287f3fd900 0x56287f38c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.197+0000 7f86177fe640 1 --2- 172.21.15.38:0/379727360 >> [v2:172.21.15.89:6834/2576950091,v1:172.21.15.89:6836/2576950091] conn(0x56287f3fd900 0x56287f38c370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f669b43d51efbf server_cookie=daa2f01c93fb6e7e in_seq=0 out_seq=0 2023-12-22T08:45:03.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.197+0000 7f85f6ffd640 10 client.6606 ms_handle_connect on v2:172.21.15.89:6834/2576950091 2023-12-22T08:45:03.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.197+0000 7f85f6ffd640 1 -- 172.21.15.38:0/379727360 <== mds.0 v2:172.21.15.89:6834/2576950091 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56287f2ef080 con 0x56287f3fd900 2023-12-22T08:45:03.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.197+0000 7f85f6ffd640 10 client.6606 handle_command_reply: tid=0 2023-12-22T08:45:03.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.197+0000 7f862141a740 1 client.6606 shutdown 2023-12-22T08:45:03.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.197+0000 7f862141a740 1 -- 172.21.15.38:0/379727360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 msgr2=0x56287f3eb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.197+0000 7f862141a740 1 --2- 172.21.15.38:0/379727360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3eb1c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8608057a30 tx=0x7f8608086f00 comp rx=0 tx=0).stop 2023-12-22T08:45:03.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.198+0000 7f862141a740 1 -- 172.21.15.38:0/379727360 shutdown_connections 2023-12-22T08:45:03.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.198+0000 7f862141a740 1 --2- 172.21.15.38:0/379727360 >> [v2:172.21.15.89:6834/2576950091,v1:172.21.15.89:6836/2576950091] conn(0x56287f3fd900 0x56287f38c370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.198+0000 7f862141a740 1 --2- 172.21.15.38:0/379727360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56287f3c1320 0x56287f38be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.198+0000 7f862141a740 1 --2- 172.21.15.38:0/379727360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56287f3b8a10 0x56287f3dc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.198+0000 7f862141a740 1 --2- 172.21.15.38:0/379727360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56287f394ea0 0x56287f3eb1c0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.198+0000 7f85f6ffd640 0 client.6606 ms_handle_reset on v2:172.21.15.89:6834/2576950091 2023-12-22T08:45:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.198+0000 7f862141a740 1 -- 172.21.15.38:0/379727360 >> 172.21.15.38:0/379727360 conn(0x56287f3912a0 msgr2=0x56287f3df640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.198+0000 7f862141a740 1 -- 172.21.15.38:0/379727360 shutdown_connections 2023-12-22T08:45:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.198+0000 7f862141a740 1 -- 172.21.15.38:0/379727360 wait complete. 2023-12-22T08:45:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.198+0000 7f862141a740 20 client.6606 trim_cache size 0 max 16384 2023-12-22T08:45:03.201 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:45:03.201 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:45:03.201 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-12-22T08:45:03.201 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 6447, 2023-12-22T08:45:03.202 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-12-22T08:45:03.202 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-12-22T08:45:03.202 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-12-22T08:45:03.202 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 7.2637377689999996, 2023-12-22T08:45:03.202 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 40, 2023-12-22T08:45:03.202 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 89, 2023-12-22T08:45:03.202 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 89, 2023-12-22T08:45:03.202 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 12.837127042000001 2023-12-22T08:45:03.202 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:45:03.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.199+0000 7f861d650640 1 -- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f860406a430 msgr2=0x7f860406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.199+0000 7f861d650640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f860406a430 0x7f860406c8f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f860c006fd0 tx=0x7f860c008040 comp rx=0 tx=0).stop 2023-12-22T08:45:03.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.199+0000 7f861d650640 1 -- 172.21.15.38:0/1191188746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8618071460 msgr2=0x7f861814f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.199+0000 7f861d650640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8618071460 0x7f861814f8a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f860800c7f0 tx=0x7f860800cbf0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.199+0000 7f861d650640 1 -- 172.21.15.38:0/1191188746 shutdown_connections 2023-12-22T08:45:03.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.199+0000 7f861d650640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f861815b0e0 0x7f861815f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.199+0000 7f861d650640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f861809c980 0x7f861815f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.199+0000 7f861d650640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f860406a430 0x7f860406c8f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.199+0000 7f861d650640 1 --2- 172.21.15.38:0/1191188746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8618071460 0x7f861814f8a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.199+0000 7f861d650640 1 -- 172.21.15.38:0/1191188746 >> 172.21.15.38:0/1191188746 conn(0x7f86180cf000 msgr2=0x7f86180cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:03.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.199+0000 7f861d650640 1 -- 172.21.15.38:0/1191188746 shutdown_connections 2023-12-22T08:45:03.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.199+0000 7f861d650640 1 -- 172.21.15.38:0/1191188746 wait complete. 2023-12-22T08:45:03.218 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:45:03.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.423+0000 7f90ac630640 1 Processor -- start 2023-12-22T08:45:03.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.424+0000 7f90ac630640 1 -- start start 2023-12-22T08:45:03.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.425+0000 7f90ac630640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f90a40b3f90 0x7f90a415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.425+0000 7f90ac630640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f90a406ca50 0x7f90a4070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.425+0000 7f90ac630640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a415eb20 con 0x7f90a415e740 2023-12-22T08:45:03.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.425+0000 7f90ac630640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a406e650 con 0x7f90a40b3f90 2023-12-22T08:45:03.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.425+0000 7f90ac630640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a4070770 con 0x7f90a406ca50 2023-12-22T08:45:03.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.425+0000 7f90a9bcb640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f90a40b3f90 0x7f90a415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.425+0000 7f90aa3cc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f90a415e740 0x7f90a40b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46508/0 (socket says 172.21.15.38:46508) 2023-12-22T08:45:03.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.425+0000 7f90aa3cc640 1 -- 172.21.15.38:0/127143638 learned_addr learned my addr 172.21.15.38:0/127143638 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:03.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.426+0000 7f90aabcd640 1 --2- 172.21.15.38:0/127143638 >> v2:172.21.15.89:3300/0 conn(0x7f90a406ca50 0x7f90a4070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.426+0000 7f90a9bcb640 1 -- 172.21.15.38:0/127143638 >> v2:172.21.15.89:3300/0 conn(0x7f90a406ca50 msgr2=0x7f90a4070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:03.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.426+0000 7f90a9bcb640 1 --2- 172.21.15.38:0/127143638 >> v2:172.21.15.89:3300/0 conn(0x7f90a406ca50 0x7f90a4070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.426+0000 7f90a9bcb640 1 -- 172.21.15.38:0/127143638 >> v1:172.21.15.38:6789/0 conn(0x7f90a415e740 legacy=0x7f90a40b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.426+0000 7f90a93ca640 1 -- 172.21.15.38:0/127143638 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522892252 0 0) 0x7f90a415eb20 con 0x7f90a415e740 2023-12-22T08:45:03.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.426+0000 7f90a9bcb640 1 -- 172.21.15.38:0/127143638 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a406d180 con 0x7f90a40b3f90 2023-12-22T08:45:03.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.427+0000 7f90a9bcb640 1 --2- 172.21.15.38:0/127143638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90a40b3f90 0x7f90a415db30 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f90a40b9050 tx=0x7f909402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b657ca81a46318 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:03.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.427+0000 7f90a93ca640 1 -- 172.21.15.38:0/127143638 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094031710 con 0x7f90a40b3f90 2023-12-22T08:45:03.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.427+0000 7f90a93ca640 1 -- 172.21.15.38:0/127143638 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909402f050 con 0x7f90a40b3f90 2023-12-22T08:45:03.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.427+0000 7f90a93ca640 1 -- 172.21.15.38:0/127143638 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094031a90 con 0x7f90a40b3f90 2023-12-22T08:45:03.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.428+0000 7f90ac630640 1 -- 172.21.15.38:0/127143638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90a40b3f90 msgr2=0x7f90a415db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.428+0000 7f90ac630640 1 --2- 172.21.15.38:0/127143638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90a40b3f90 0x7f90a415db30 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f90a40b9050 tx=0x7f909402b7b0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.428+0000 7f90ac630640 1 -- 172.21.15.38:0/127143638 shutdown_connections 2023-12-22T08:45:03.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.428+0000 7f90ac630640 1 --2- 172.21.15.38:0/127143638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90a40b3f90 0x7f90a415db30 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.428+0000 7f90ac630640 1 --2- 172.21.15.38:0/127143638 >> v2:172.21.15.89:3300/0 conn(0x7f90a406ca50 0x7f90a4070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.428+0000 7f90ac630640 1 -- 172.21.15.38:0/127143638 >> 172.21.15.38:0/127143638 conn(0x7f90a40cfea0 msgr2=0x7f90a40d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:03.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.428+0000 7f90ac630640 1 -- 172.21.15.38:0/127143638 shutdown_connections 2023-12-22T08:45:03.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.428+0000 7f90ac630640 1 -- 172.21.15.38:0/127143638 wait complete. 2023-12-22T08:45:03.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.430+0000 7f90ac630640 1 Processor -- start 2023-12-22T08:45:03.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.430+0000 7f90ac630640 1 -- start start 2023-12-22T08:45:03.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.431+0000 7f90ac630640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a406ca50 0x7f90a40b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.431+0000 7f90ac630640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a40b3f90 0x7f90a415a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.431+0000 7f90ac630640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90a415e740 0x7f90a41f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.431+0000 7f90ac630640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40b60b0 con 0x7f90a415e740 2023-12-22T08:45:03.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.431+0000 7f90ac630640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a415df60 con 0x7f90a406ca50 2023-12-22T08:45:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.431+0000 7f90ac630640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40b6520 con 0x7f90a40b3f90 2023-12-22T08:45:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.431+0000 7f90aabcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90a415e740 0x7f90a41f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.431+0000 7f90aabcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90a415e740 0x7f90a41f65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60060/0 (socket says 172.21.15.38:60060) 2023-12-22T08:45:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.431+0000 7f90aabcd640 1 -- 172.21.15.38:0/96267454 learned_addr learned my addr 172.21.15.38:0/96267454 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.431+0000 7f90aa3cc640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a406ca50 0x7f90a40b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.432+0000 7f90a9bcb640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a40b3f90 0x7f90a415a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.432+0000 7f90aabcd640 1 -- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a40b3f90 msgr2=0x7f90a415a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.432+0000 7f90aabcd640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a40b3f90 0x7f90a415a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.432+0000 7f90aabcd640 1 -- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a406ca50 msgr2=0x7f90a40b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.432+0000 7f90aabcd640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a406ca50 0x7f90a40b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.432+0000 7f90aabcd640 1 -- 172.21.15.38:0/96267454 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9094009400 con 0x7f90a415e740 2023-12-22T08:45:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.432+0000 7f90aa3cc640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a406ca50 0x7f90a40b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.432+0000 7f90aabcd640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90a415e740 0x7f90a41f65d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f909c00cd70 tx=0x7f909c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:03.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.432+0000 7f909affd640 1 -- 172.21.15.38:0/96267454 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c003b90 con 0x7f90a415e740 2023-12-22T08:45:03.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.432+0000 7f909affd640 1 -- 172.21.15.38:0/96267454 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c003cf0 con 0x7f90a415e740 2023-12-22T08:45:03.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.432+0000 7f90ac630640 1 -- 172.21.15.38:0/96267454 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a40b6800 con 0x7f90a415e740 2023-12-22T08:45:03.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.432+0000 7f909affd640 1 -- 172.21.15.38:0/96267454 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c004240 con 0x7f90a415e740 2023-12-22T08:45:03.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.432+0000 7f90ac630640 1 -- 172.21.15.38:0/96267454 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a40b6ae0 con 0x7f90a415e740 2023-12-22T08:45:03.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.434+0000 7f90ac630640 1 -- 172.21.15.38:0/96267454 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a4061910 con 0x7f90a415e740 2023-12-22T08:45:03.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.435+0000 7f909affd640 1 -- 172.21.15.38:0/96267454 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f909c0043a0 con 0x7f90a415e740 2023-12-22T08:45:03.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.436+0000 7f909affd640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f908806a460 0x7f908806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:03.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.436+0000 7f909affd640 1 -- 172.21.15.38:0/96267454 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f909c012070 con 0x7f90a415e740 2023-12-22T08:45:03.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.436+0000 7f90aa3cc640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f908806a460 0x7f908806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.437+0000 7f90aa3cc640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f908806a460 0x7f908806c920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f90a0000f60 tx=0x7f90a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:03.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.440+0000 7f909affd640 1 -- 172.21.15.38:0/96267454 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f909c0548d0 con 0x7f90a415e740 2023-12-22T08:45:03.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.673+0000 7f90ac630640 1 -- 172.21.15.38:0/96267454 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f90a406d710 con 0x7f90a415e740 2023-12-22T08:45:03.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.674+0000 7f909affd640 1 -- 172.21.15.38:0/96267454 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7f909c057ef0 con 0x7f90a415e740 2023-12-22T08:45:03.675 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:45:03.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.676+0000 7f90ac630640 1 -- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f908806a460 msgr2=0x7f908806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.676+0000 7f90ac630640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f908806a460 0x7f908806c920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f90a0000f60 tx=0x7f90a0009040 comp rx=0 tx=0).stop 2023-12-22T08:45:03.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.676+0000 7f90ac630640 1 -- 172.21.15.38:0/96267454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90a415e740 msgr2=0x7f90a41f65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:03.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.676+0000 7f90ac630640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90a415e740 0x7f90a41f65d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f909c00cd70 tx=0x7f909c00a660 comp rx=0 tx=0).stop 2023-12-22T08:45:03.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.676+0000 7f90ac630640 1 -- 172.21.15.38:0/96267454 shutdown_connections 2023-12-22T08:45:03.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.676+0000 7f90ac630640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f908806a460 0x7f908806c920 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.676+0000 7f90ac630640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90a415e740 0x7f90a41f65d0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.676+0000 7f90ac630640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90a40b3f90 0x7f90a415a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.676+0000 7f90ac630640 1 --2- 172.21.15.38:0/96267454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a406ca50 0x7f90a40b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:03.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.677+0000 7f90ac630640 1 -- 172.21.15.38:0/96267454 >> 172.21.15.38:0/96267454 conn(0x7f90a40cfea0 msgr2=0x7f90a4070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:03.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.677+0000 7f90ac630640 1 -- 172.21.15.38:0/96267454 shutdown_connections 2023-12-22T08:45:03.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:03.677+0000 7f90ac630640 1 -- 172.21.15.38:0/96267454 wait complete. 2023-12-22T08:45:03.698 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:45:03.698 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:45:03.698 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-12-22T08:45:03.698 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T08:45:03.698 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:45:03.698 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:45:03.698 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:45:03.698 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:45:03.698 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:45:03.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:03.699 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-12-22T08:45:03.754 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:45:03.755 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:45:03.755 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:45:03.755 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:03.755 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:45:03.755 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:03.755 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:45:03.755 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:45:03.755 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-12-22T08:45:03.756 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:45:03.756 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:45:03.756 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-12-22T08:45:03.756 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:45:03.756 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-12-22T08:45:03.756 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-12-22T08:45:03.756 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-22T08:45:03.756 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42062sec preferred_lft 42062sec 2023-12-22T08:45:03.757 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-22T08:45:03.757 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:03.757 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:45:03.757 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-12-22T08:45:03.757 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-12-22T08:45:03.757 INFO:teuthology.orchestra.run.smithi038.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:45:03.757 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:45:03.757 INFO:teuthology.orchestra.run.smithi038.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:45:03.758 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:03.758 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::5440:f6ff:fe40:85a/64 scope link 2023-12-22T08:45:03.758 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:03.758 INFO:teuthology.orchestra.run.smithi038.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:45:03.758 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:c3:65:6c:32:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:45:03.758 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::e4c3:65ff:fe6c:322e/64 scope link 2023-12-22T08:45:03.758 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:03.758 INFO:teuthology.orchestra.run.smithi038.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:45:03.758 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T08:45:03.759 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::34bf:8aff:fe68:3bf6/64 scope link 2023-12-22T08:45:03.759 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:03.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:03.761 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:45:03.863 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-12-22T08:45:03.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:03.868 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-12-22T08:45:03.925 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-12-22T08:45:03.926 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:45:03.926 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-22T08:45:03.926 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-22T08:45:03.926 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:45:03.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:03.926 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:45:03.926 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:45:03.926 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T08:45:03.926 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T08:45:03.926 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T08:45:03.927 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:45:04.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:04.119 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:45:04.173 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:45:04.173 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-22T08:45:04.174 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:45:04.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:04.174 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-12-22T08:45:04.276 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:45:04.277 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T08:45:04.336 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:45:04.336 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:45:04.336 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:45:04.393 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-22T08:45:04.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:04.393 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:45:04.546 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:45:04.546 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:45:04.583 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:45:04.583 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:45:04.583 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:45:04.583 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with new device syntax: 0@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:45:04.584 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:45:04.585 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T08:45:04.585 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:45:04.585 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:45:04.585 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:45:04.585 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:45:04.589 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:45:04.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:04.589 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:45:04.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:04.678 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:45:04.759 INFO:teuthology.orchestra.run.smithi038.stdout:client5698 2023-12-22T08:45:04.760 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:45:04.760 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:45:04.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:45:05.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.049+0000 7f308924b640 1 Processor -- start 2023-12-22T08:45:05.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.049+0000 7f308924b640 1 -- start start 2023-12-22T08:45:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.051+0000 7f308924b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f308406d210 0x7f308415e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.051+0000 7f308924b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30840cb4c0 0x7f3084159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.051+0000 7f308924b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30840706d0 con 0x7f308406d5f0 2023-12-22T08:45:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.051+0000 7f308924b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30840cbf40 con 0x7f308406d210 2023-12-22T08:45:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.051+0000 7f308924b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30840ce840 con 0x7f30840cb4c0 2023-12-22T08:45:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.051+0000 7f3083fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f308406d210 0x7f308415e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.051+0000 7f3083fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f308406d210 0x7f308415e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60064/0 (socket says 172.21.15.38:60064) 2023-12-22T08:45:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.051+0000 7f3083fff640 1 -- 172.21.15.38:0/317441277 learned_addr learned my addr 172.21.15.38:0/317441277 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.052+0000 7f3083fff640 1 -- 172.21.15.38:0/317441277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30840cb4c0 msgr2=0x7f3084159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.052+0000 7f3083fff640 1 --2- 172.21.15.38:0/317441277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30840cb4c0 0x7f3084159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:05.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.052+0000 7f3083fff640 1 -- 172.21.15.38:0/317441277 >> v1:172.21.15.89:6789/0 conn(0x7f308406d5f0 legacy=0x7f30840cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:05.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.052+0000 7f3083fff640 1 -- 172.21.15.38:0/317441277 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30840ceb20 con 0x7f308406d210 2023-12-22T08:45:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.053+0000 7f3083fff640 1 --2- 172.21.15.38:0/317441277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308406d210 0x7f308415e830 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3074009870 tx=0x7f307402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b1f68dee9fb91a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.053+0000 7f3082ffd640 1 -- 172.21.15.38:0/317441277 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3074031640 con 0x7f308406d210 2023-12-22T08:45:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.053+0000 7f3082ffd640 1 -- 172.21.15.38:0/317441277 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30740317a0 con 0x7f308406d210 2023-12-22T08:45:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.053+0000 7f3082ffd640 1 -- 172.21.15.38:0/317441277 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3074031b30 con 0x7f308406d210 2023-12-22T08:45:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.054+0000 7f308924b640 1 -- 172.21.15.38:0/317441277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308406d210 msgr2=0x7f308415e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.054+0000 7f308924b640 1 --2- 172.21.15.38:0/317441277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308406d210 0x7f308415e830 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3074009870 tx=0x7f307402b8f0 comp rx=0 tx=0).stop 2023-12-22T08:45:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.054+0000 7f308924b640 1 -- 172.21.15.38:0/317441277 shutdown_connections 2023-12-22T08:45:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.054+0000 7f308924b640 1 --2- 172.21.15.38:0/317441277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30840cb4c0 0x7f3084159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.054+0000 7f308924b640 1 --2- 172.21.15.38:0/317441277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f308406d210 0x7f308415e830 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.054+0000 7f308924b640 1 -- 172.21.15.38:0/317441277 >> 172.21.15.38:0/317441277 conn(0x7f30840b1f70 msgr2=0x7f30840b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.054+0000 7f308924b640 1 -- 172.21.15.38:0/317441277 shutdown_connections 2023-12-22T08:45:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.054+0000 7f308924b640 1 -- 172.21.15.38:0/317441277 wait complete. 2023-12-22T08:45:05.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.056+0000 7f308924b640 1 Processor -- start 2023-12-22T08:45:05.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.056+0000 7f308924b640 1 -- start start 2023-12-22T08:45:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.057+0000 7f308924b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f308406d210 0x7f30840c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.057+0000 7f308924b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308406d5f0 0x7f30841544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.057+0000 7f308924b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30840cb4c0 0x7f30840caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.057+0000 7f308924b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30841549f0 con 0x7f30840cb4c0 2023-12-22T08:45:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.057+0000 7f308924b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30840c3630 con 0x7f308406d5f0 2023-12-22T08:45:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.057+0000 7f308924b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30840c3910 con 0x7f308406d210 2023-12-22T08:45:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.057+0000 7f3088a4a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30840cb4c0 0x7f30840caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.057+0000 7f3088a4a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30840cb4c0 0x7f30840caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60078/0 (socket says 172.21.15.38:60078) 2023-12-22T08:45:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.057+0000 7f3088a4a640 1 -- 172.21.15.38:0/158761857 learned_addr learned my addr 172.21.15.38:0/158761857 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:05.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.058+0000 7f30837fe640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308406d5f0 0x7f30841544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:05.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.058+0000 7f3083fff640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f308406d210 0x7f30840c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:05.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.058+0000 7f3088a4a640 1 -- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f308406d210 msgr2=0x7f30840c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:05.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.058+0000 7f3088a4a640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f308406d210 0x7f30840c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:05.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.058+0000 7f3088a4a640 1 -- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308406d5f0 msgr2=0x7f30841544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:05.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.058+0000 7f3088a4a640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308406d5f0 0x7f30841544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:05.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.058+0000 7f3088a4a640 1 -- 172.21.15.38:0/158761857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30740094d0 con 0x7f30840cb4c0 2023-12-22T08:45:05.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.058+0000 7f3083fff640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f308406d210 0x7f30840c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:05.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.058+0000 7f3088a4a640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30840cb4c0 0x7f30840caaa0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f307c00c780 tx=0x7f307c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:05.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.059+0000 7f3080ff9640 1 -- 172.21.15.38:0/158761857 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c004b60 con 0x7f30840cb4c0 2023-12-22T08:45:05.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.059+0000 7f3080ff9640 1 -- 172.21.15.38:0/158761857 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307c00ce90 con 0x7f30840cb4c0 2023-12-22T08:45:05.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.059+0000 7f3080ff9640 1 -- 172.21.15.38:0/158761857 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c00a850 con 0x7f30840cb4c0 2023-12-22T08:45:05.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.059+0000 7f308924b640 1 -- 172.21.15.38:0/158761857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30840c3bf0 con 0x7f30840cb4c0 2023-12-22T08:45:05.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.059+0000 7f308924b640 1 -- 172.21.15.38:0/158761857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30840c41b0 con 0x7f30840cb4c0 2023-12-22T08:45:05.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.060+0000 7f308924b640 1 -- 172.21.15.38:0/158761857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3084061910 con 0x7f30840cb4c0 2023-12-22T08:45:05.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.061+0000 7f3080ff9640 1 -- 172.21.15.38:0/158761857 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f307c00a9b0 con 0x7f30840cb4c0 2023-12-22T08:45:05.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.062+0000 7f3080ff9640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f307006a430 0x7f307006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:05.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.062+0000 7f3080ff9640 1 -- 172.21.15.38:0/158761857 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f307c088c00 con 0x7f30840cb4c0 2023-12-22T08:45:05.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.062+0000 7f3083fff640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f307006a430 0x7f307006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:05.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.064+0000 7f3083fff640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f307006a430 0x7f307006c8f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3074036000 tx=0x7f307403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:05.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.068+0000 7f3080ff9640 1 -- 172.21.15.38:0/158761857 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f307c054150 con 0x7f30840cb4c0 2023-12-22T08:45:05.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.304+0000 7f308924b640 1 -- 172.21.15.38:0/158761857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f30840b08f0 con 0x7f30840cb4c0 2023-12-22T08:45:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.305+0000 7f3080ff9640 1 -- 172.21.15.38:0/158761857 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7f307c057770 con 0x7f30840cb4c0 2023-12-22T08:45:05.307 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:45:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.308+0000 7f308924b640 1 -- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f307006a430 msgr2=0x7f307006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.308+0000 7f308924b640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f307006a430 0x7f307006c8f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3074036000 tx=0x7f307403c040 comp rx=0 tx=0).stop 2023-12-22T08:45:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.308+0000 7f308924b640 1 -- 172.21.15.38:0/158761857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30840cb4c0 msgr2=0x7f30840caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.308+0000 7f308924b640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30840cb4c0 0x7f30840caaa0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f307c00c780 tx=0x7f307c00cc40 comp rx=0 tx=0).stop 2023-12-22T08:45:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.309+0000 7f308924b640 1 -- 172.21.15.38:0/158761857 shutdown_connections 2023-12-22T08:45:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.309+0000 7f308924b640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f307006a430 0x7f307006c8f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.309+0000 7f308924b640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30840cb4c0 0x7f30840caaa0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.309+0000 7f308924b640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308406d5f0 0x7f30841544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.309+0000 7f308924b640 1 --2- 172.21.15.38:0/158761857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f308406d210 0x7f30840c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.309+0000 7f308924b640 1 -- 172.21.15.38:0/158761857 >> 172.21.15.38:0/158761857 conn(0x7f30840b1f70 msgr2=0x7f308415e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.309+0000 7f308924b640 1 -- 172.21.15.38:0/158761857 shutdown_connections 2023-12-22T08:45:05.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:05.309+0000 7f308924b640 1 -- 172.21.15.38:0/158761857 wait complete. 2023-12-22T08:45:05.329 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:45:05.329 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:45:05.329 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-22T08:45:05.330 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T08:45:05.330 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T08:45:05.330 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:45:05.330 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:45:05.330 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:45:05.330 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:45:05.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:05.330 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-22T08:45:05.393 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:45:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:45:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:45:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:05.393 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:45:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:05.394 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:45:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:45:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-22T08:45:05.394 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:45:05.394 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:45:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-22T08:45:05.395 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:45:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:45:05.395 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:45:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:45:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:45:05.395 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42056sec preferred_lft 42056sec 2023-12-22T08:45:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-22T08:45:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:05.396 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:45:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:45:05.396 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:45:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::9cc2:a9ff:fe75:e812/64 scope link 2023-12-22T08:45:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:05.397 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:45:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8e:46:07:65:e3:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T08:45:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::8c46:7ff:fe65:e31f/64 scope link 2023-12-22T08:45:05.397 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:05.398 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:45:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T08:45:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2cc2:baff:fe6f:ea22/64 scope link 2023-12-22T08:45:05.398 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:45:05.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:05.399 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:45:05.493 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-22T08:45:05.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:05.497 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-22T08:45:05.553 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-22T08:45:05.553 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:45:05.553 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:45:05.553 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:45:05.553 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:45:05.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:05.554 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:45:05.554 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:45:05.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:45:05.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:45:05.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:45:05.554 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:45:05.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:05.743 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:45:05.791 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T08:45:05.791 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-22T08:45:05.792 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:45:05.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:05.792 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-22T08:45:05.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:45:05.886 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T08:45:05.939 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:45:05.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:45:05.939 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:45:05.991 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-22T08:45:05.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:05.992 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:45:06.128 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:45:06.128 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:45:06.158 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:45:06.158 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:45:06.158 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:45:06.159 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 1@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:45:06.159 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:45:06.160 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T08:45:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:45:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:45:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:45:06.160 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:45:06.164 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:45:06.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:06.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:45:06.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:06.242 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:45:06.291 INFO:teuthology.orchestra.run.smithi089.stdout:client5279 2023-12-22T08:45:06.291 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:45:06.291 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:45:06.341 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:45:06.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.573+0000 7fdadffff640 1 Processor -- start 2023-12-22T08:45:06.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.574+0000 7fdadffff640 1 -- start start 2023-12-22T08:45:06.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.575+0000 7fdadffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdae0157980 0x7fdae015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:06.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.575+0000 7fdadffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdae006d640 0x7fdae00d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:06.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.575+0000 7fdadffff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae00d1520 con 0x7fdae00b3ff0 2023-12-22T08:45:06.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.576+0000 7fdadffff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae00d1800 con 0x7fdae006d640 2023-12-22T08:45:06.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.576+0000 7fdadffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00d1ae0 con 0x7fdae0157980 2023-12-22T08:45:06.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.576+0000 7fdade7fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdae00b3ff0 0x7fdae006cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46516/0 (socket says 172.21.15.38:46516) 2023-12-22T08:45:06.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.576+0000 7fdade7fc640 1 -- 172.21.15.38:0/4104736697 learned_addr learned my addr 172.21.15.38:0/4104736697 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:06.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.576+0000 7fdadf7fe640 1 --2- 172.21.15.38:0/4104736697 >> v2:172.21.15.89:3300/0 conn(0x7fdae006d640 0x7fdae00d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:06.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.576+0000 7fdadeffd640 1 --2- 172.21.15.38:0/4104736697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdae0157980 0x7fdae015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.576+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894821801 0 0) 0x7fdae00d1520 con 0x7fdae00b3ff0 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.576+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac8003520 con 0x7fdae00b3ff0 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1742985236 0 0) 0x7fdac8003520 con 0x7fdae00b3ff0 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdae0157980 msgr2=0x7fdae015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 --2- 172.21.15.38:0/4104736697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdae0157980 0x7fdae015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 >> v2:172.21.15.89:3300/0 conn(0x7fdae006d640 msgr2=0x7fdae00d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 --2- 172.21.15.38:0/4104736697 >> v2:172.21.15.89:3300/0 conn(0x7fdae006d640 0x7fdae00d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae00d1dc0 con 0x7fdae00b3ff0 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fdad4001670 con 0x7fdae00b3ff0 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 >> v1:172.21.15.38:6789/0 conn(0x7fdae00b3ff0 legacy=0x7fdae006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 --2- 172.21.15.38:0/4104736697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdac8003970 0x7fdac8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 --2- 172.21.15.38:0/4104736697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdae0157980 0x7fdac80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 --2- 172.21.15.38:0/4104736697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac8004d00 0x7fdac8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00d1800 con 0x7fdac8003970 2023-12-22T08:45:06.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00d1ae0 con 0x7fdac8004d00 2023-12-22T08:45:06.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac800b980 con 0x7fdae0157980 2023-12-22T08:45:06.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.577+0000 7fdadeffd640 1 --2- 172.21.15.38:0/4104736697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdac8003970 0x7fdac8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:06.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.578+0000 7fdadf7fe640 1 --2- 172.21.15.38:0/4104736697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac8004d00 0x7fdac8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:06.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.578+0000 7fdadeffd640 1 -- 172.21.15.38:0/4104736697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdae0157980 msgr2=0x7fdac80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:06.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.578+0000 7fdadeffd640 1 --2- 172.21.15.38:0/4104736697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdae0157980 0x7fdac80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:06.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.578+0000 7fdadeffd640 1 -- 172.21.15.38:0/4104736697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac8004d00 msgr2=0x7fdac8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:06.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.578+0000 7fdadeffd640 1 --2- 172.21.15.38:0/4104736697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac8004d00 0x7fdac8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:06.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.578+0000 7fdadeffd640 1 -- 172.21.15.38:0/4104736697 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac8003520 con 0x7fdac8003970 2023-12-22T08:45:06.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.578+0000 7fdadf7fe640 1 --2- 172.21.15.38:0/4104736697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdac8004d00 0x7fdac8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:06.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.579+0000 7fdadeffd640 1 --2- 172.21.15.38:0/4104736697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdac8003970 0x7fdac8003d90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009ac0 tx=0x7fdac80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a927a83a32753f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:06.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.579+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad002c710 con 0x7fdac8003970 2023-12-22T08:45:06.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.579+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad002c870 con 0x7fdac8003970 2023-12-22T08:45:06.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.579+0000 7fdaddffb640 1 -- 172.21.15.38:0/4104736697 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad002cc00 con 0x7fdac8003970 2023-12-22T08:45:06.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.580+0000 7fdadffff640 1 -- 172.21.15.38:0/4104736697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdac8003970 msgr2=0x7fdac8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:06.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.580+0000 7fdadffff640 1 --2- 172.21.15.38:0/4104736697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdac8003970 0x7fdac8003d90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009ac0 tx=0x7fdac80057f0 comp rx=0 tx=0).stop 2023-12-22T08:45:06.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.580+0000 7fdadf7fe640 1 -- 172.21.15.38:0/4104736697 reap_dead start 2023-12-22T08:45:06.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.580+0000 7fdadffff640 1 -- 172.21.15.38:0/4104736697 shutdown_connections 2023-12-22T08:45:06.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.580+0000 7fdadffff640 1 -- 172.21.15.38:0/4104736697 >> 172.21.15.38:0/4104736697 conn(0x7fdae00d31f0 msgr2=0x7fdae00d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:06.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.580+0000 7fdadffff640 1 -- 172.21.15.38:0/4104736697 shutdown_connections 2023-12-22T08:45:06.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.580+0000 7fdadffff640 1 -- 172.21.15.38:0/4104736697 wait complete. 2023-12-22T08:45:06.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.582+0000 7fdadffff640 1 Processor -- start 2023-12-22T08:45:06.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.582+0000 7fdadffff640 1 -- start start 2023-12-22T08:45:06.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.583+0000 7fdadffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac8003970 0x7fdae014a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.583+0000 7fdadffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdae015f960 0x7fdae01f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.583+0000 7fdadffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdae015fde0 0x7fdae00b8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.583+0000 7fdadffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00b7d60 con 0x7fdae015fde0 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.583+0000 7fdadffff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00b70e0 con 0x7fdae015f960 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.583+0000 7fdadffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00b73c0 con 0x7fdac8003970 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.583+0000 7fdadf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdae015fde0 0x7fdae00b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.583+0000 7fdadf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdae015fde0 0x7fdae00b8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60096/0 (socket says 172.21.15.38:60096) 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.583+0000 7fdadf7fe640 1 -- 172.21.15.38:0/1946496912 learned_addr learned my addr 172.21.15.38:0/1946496912 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.583+0000 7fdade7fc640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdae015f960 0x7fdae01f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.584+0000 7fdadeffd640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac8003970 0x7fdae014a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.584+0000 7fdadf7fe640 1 -- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac8003970 msgr2=0x7fdae014a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.584+0000 7fdadf7fe640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac8003970 0x7fdae014a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.584+0000 7fdadf7fe640 1 -- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdae015f960 msgr2=0x7fdae01f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:06.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.584+0000 7fdadf7fe640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdae015f960 0x7fdae01f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:06.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.584+0000 7fdadf7fe640 1 -- 172.21.15.38:0/1946496912 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae00b76a0 con 0x7fdae015fde0 2023-12-22T08:45:06.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.584+0000 7fdadeffd640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac8003970 0x7fdae014a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:06.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.584+0000 7fdadf7fe640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdae015fde0 0x7fdae00b8180 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fdae00b3250 tx=0x7fdad800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:06.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.584+0000 7fdac7fff640 1 -- 172.21.15.38:0/1946496912 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8016620 con 0x7fdae015fde0 2023-12-22T08:45:06.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.584+0000 7fdac7fff640 1 -- 172.21.15.38:0/1946496912 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad80167a0 con 0x7fdae015fde0 2023-12-22T08:45:06.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.584+0000 7fdac7fff640 1 -- 172.21.15.38:0/1946496912 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8016b50 con 0x7fdae015fde0 2023-12-22T08:45:06.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.584+0000 7fdadffff640 1 -- 172.21.15.38:0/1946496912 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae00b7980 con 0x7fdae015fde0 2023-12-22T08:45:06.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.584+0000 7fdadffff640 1 -- 172.21.15.38:0/1946496912 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae01f3230 con 0x7fdae015fde0 2023-12-22T08:45:06.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.586+0000 7fdadffff640 1 -- 172.21.15.38:0/1946496912 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae0061910 con 0x7fdae015fde0 2023-12-22T08:45:06.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.586+0000 7fdac7fff640 1 -- 172.21.15.38:0/1946496912 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdad8016cb0 con 0x7fdae015fde0 2023-12-22T08:45:06.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.587+0000 7fdac7fff640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdacc06a430 0x7fdacc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:06.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.587+0000 7fdac7fff640 1 -- 172.21.15.38:0/1946496912 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdad80895d0 con 0x7fdae015fde0 2023-12-22T08:45:06.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.588+0000 7fdadeffd640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdacc06a430 0x7fdacc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:06.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.589+0000 7fdadeffd640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdacc06a430 0x7fdacc06c8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdad0036000 tx=0x7fdad0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:06.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.592+0000 7fdac7fff640 1 -- 172.21.15.38:0/1946496912 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdad8054bb0 con 0x7fdae015fde0 2023-12-22T08:45:06.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.823+0000 7fdadffff640 1 -- 172.21.15.38:0/1946496912 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdae015b9d0 con 0x7fdae015fde0 2023-12-22T08:45:06.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.824+0000 7fdac7fff640 1 -- 172.21.15.38:0/1946496912 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4650 (secure 0 0 0) 0x7fdad80581d0 con 0x7fdae015fde0 2023-12-22T08:45:06.827 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:06.827 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2128001687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2128001687},{"type":"v1","addr":"172.21.15.89:6837","nonce":2128001687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6438,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1632983842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1632983842},{"type":"v1","addr":"172.21.15.38:6833","nonce":1632983842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6444,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2613790013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2613790013},{"type":"v1","addr":"172.21.15.38:6835","nonce":2613790013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:44:55.928210+0000","modified":"2023-12-22T08:44:59.439959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6447},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6447":{"gid":6447,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2576950091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2576950091},{"type":"v1","addr":"172.21.15.89:6836","nonce":2576950091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-22T08:45:06.827 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 40 2023-12-22T08:45:06.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.827+0000 7fdadffff640 1 -- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdacc06a430 msgr2=0x7fdacc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:06.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.827+0000 7fdadffff640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdacc06a430 0x7fdacc06c8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdad0036000 tx=0x7fdad0030000 comp rx=0 tx=0).stop 2023-12-22T08:45:06.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.827+0000 7fdadffff640 1 -- 172.21.15.38:0/1946496912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdae015fde0 msgr2=0x7fdae00b8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.827+0000 7fdadffff640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdae015fde0 0x7fdae00b8180 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fdae00b3250 tx=0x7fdad800f520 comp rx=0 tx=0).stop 2023-12-22T08:45:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.827+0000 7fdadffff640 1 -- 172.21.15.38:0/1946496912 shutdown_connections 2023-12-22T08:45:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.827+0000 7fdadffff640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdacc06a430 0x7fdacc06c8f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.827+0000 7fdadffff640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdae015fde0 0x7fdae00b8180 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.827+0000 7fdadffff640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdae015f960 0x7fdae01f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.827+0000 7fdadffff640 1 --2- 172.21.15.38:0/1946496912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdac8003970 0x7fdae014a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.827+0000 7fdadffff640 1 -- 172.21.15.38:0/1946496912 >> 172.21.15.38:0/1946496912 conn(0x7fdae00d31f0 msgr2=0x7fdae00d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:06.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.828+0000 7fdadffff640 1 -- 172.21.15.38:0/1946496912 shutdown_connections 2023-12-22T08:45:06.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:06.828+0000 7fdadffff640 1 -- 172.21.15.38:0/1946496912 wait complete. 2023-12-22T08:45:06.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-12-22T08:45:07.091 INFO:teuthology.orchestra.run.smithi089.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":6447,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.140674575,"mdsmap_epoch":40,"osdmap_epoch":89,"osdmap_epoch_barrier":89,"uptime":16.714067327999999} 2023-12-22T08:45:07.092 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 6447, "mdsmap_epoch": 40, "osdmap_epoch": 89, "osdmap_epoch_barrier": 89, "rank_uptime": 11.140674575, "state": "up:active", "uptime": 16.714067328, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:45:07.092 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-22T08:45:07.345 INFO:teuthology.orchestra.run.smithi038.stdout:{"osd_mon_report_interval":"5"} 2023-12-22T08:45:07.345 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-22T08:45:07.346 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-22T08:45:07.582 INFO:teuthology.orchestra.run.smithi038.stdout:{"mon_tick_interval":"5"} 2023-12-22T08:45:07.582 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-22T08:45:07.582 INFO:tasks.cephfs.test_full:pool capacity 557033024, 531MB should be enough to fill it 2023-12-22T08:45:07.583 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T08:45:07.583 DEBUG:teuthology.orchestra.run.smithi038:> import time 2023-12-22T08:45:07.583 DEBUG:teuthology.orchestra.run.smithi038:> import datetime 2023-12-22T08:45:07.583 DEBUG:teuthology.orchestra.run.smithi038:> import subprocess 2023-12-22T08:45:07.583 DEBUG:teuthology.orchestra.run.smithi038:> import os 2023-12-22T08:45:07.583 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:45:07.584 DEBUG:teuthology.orchestra.run.smithi038:> # Write some buffered data through before going full, all should be well 2023-12-22T08:45:07.584 DEBUG:teuthology.orchestra.run.smithi038:> print("writing some data through which we expect to succeed") 2023-12-22T08:45:07.584 DEBUG:teuthology.orchestra.run.smithi038:> bytes = 0 2023-12-22T08:45:07.584 DEBUG:teuthology.orchestra.run.smithi038:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-22T08:45:07.584 DEBUG:teuthology.orchestra.run.smithi038:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-22T08:45:07.584 DEBUG:teuthology.orchestra.run.smithi038:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-12-22T08:45:07.584 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(f) 2023-12-22T08:45:07.585 DEBUG:teuthology.orchestra.run.smithi038:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-22T08:45:07.585 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:45:07.585 DEBUG:teuthology.orchestra.run.smithi038:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-22T08:45:07.585 DEBUG:teuthology.orchestra.run.smithi038:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-22T08:45:07.585 DEBUG:teuthology.orchestra.run.smithi038:> # buffered IO, the error should always only appear from fsync and not 2023-12-22T08:45:07.585 DEBUG:teuthology.orchestra.run.smithi038:> # from write 2023-12-22T08:45:07.585 DEBUG:teuthology.orchestra.run.smithi038:> full = False 2023-12-22T08:45:07.586 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:45:07.586 DEBUG:teuthology.orchestra.run.smithi038:> for n in range(0, int(531 * 1.1)): 2023-12-22T08:45:07.586 DEBUG:teuthology.orchestra.run.smithi038:> try: 2023-12-22T08:45:07.586 DEBUG:teuthology.orchestra.run.smithi038:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-22T08:45:07.586 DEBUG:teuthology.orchestra.run.smithi038:> print("wrote bytes via buffered write, moving on to fsync") 2023-12-22T08:45:07.586 DEBUG:teuthology.orchestra.run.smithi038:> except OSError as e: 2023-12-22T08:45:07.586 DEBUG:teuthology.orchestra.run.smithi038:> if False: 2023-12-22T08:45:07.586 DEBUG:teuthology.orchestra.run.smithi038:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-12-22T08:45:07.586 DEBUG:teuthology.orchestra.run.smithi038:> raise 2023-12-22T08:45:07.587 DEBUG:teuthology.orchestra.run.smithi038:> else: 2023-12-22T08:45:07.587 DEBUG:teuthology.orchestra.run.smithi038:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-22T08:45:07.587 DEBUG:teuthology.orchestra.run.smithi038:> full = True 2023-12-22T08:45:07.587 DEBUG:teuthology.orchestra.run.smithi038:> break 2023-12-22T08:45:07.587 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:45:07.587 DEBUG:teuthology.orchestra.run.smithi038:> try: 2023-12-22T08:45:07.587 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(f) 2023-12-22T08:45:07.587 DEBUG:teuthology.orchestra.run.smithi038:> print("fsync'"'"'ed successfully") 2023-12-22T08:45:07.587 DEBUG:teuthology.orchestra.run.smithi038:> except OSError as e: 2023-12-22T08:45:07.587 DEBUG:teuthology.orchestra.run.smithi038:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-22T08:45:07.588 DEBUG:teuthology.orchestra.run.smithi038:> full = True 2023-12-22T08:45:07.588 DEBUG:teuthology.orchestra.run.smithi038:> break 2023-12-22T08:45:07.588 DEBUG:teuthology.orchestra.run.smithi038:> else: 2023-12-22T08:45:07.588 DEBUG:teuthology.orchestra.run.smithi038:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-22T08:45:07.588 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:45:07.588 DEBUG:teuthology.orchestra.run.smithi038:> if n > 531 * 0.9: 2023-12-22T08:45:07.588 DEBUG:teuthology.orchestra.run.smithi038:> # Be cautious in the last region where we expect to hit 2023-12-22T08:45:07.588 DEBUG:teuthology.orchestra.run.smithi038:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-12-22T08:45:07.588 DEBUG:teuthology.orchestra.run.smithi038:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-22T08:45:07.588 DEBUG:teuthology.orchestra.run.smithi038:> time.sleep(15.0) 2023-12-22T08:45:07.589 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:45:07.589 DEBUG:teuthology.orchestra.run.smithi038:> if not full: 2023-12-22T08:45:07.589 DEBUG:teuthology.orchestra.run.smithi038:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-12-22T08:45:07.589 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:45:07.589 DEBUG:teuthology.orchestra.run.smithi038:> # close() should not raise an error because we already caught it in 2023-12-22T08:45:07.589 DEBUG:teuthology.orchestra.run.smithi038:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-12-22T08:45:07.589 DEBUG:teuthology.orchestra.run.smithi038:> # since then because all IOs got cancelled on the full flag. 2023-12-22T08:45:07.589 DEBUG:teuthology.orchestra.run.smithi038:> print("calling close") 2023-12-22T08:45:07.589 DEBUG:teuthology.orchestra.run.smithi038:> os.close(f) 2023-12-22T08:45:07.589 DEBUG:teuthology.orchestra.run.smithi038:> print("close() did not raise error") 2023-12-22T08:45:07.590 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:45:07.590 DEBUG:teuthology.orchestra.run.smithi038:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-22T08:45:07.590 DEBUG:teuthology.orchestra.run.smithi038:> ' 2023-12-22T08:45:11.378 INFO:teuthology.orchestra.run.smithi038.stdout:writing some data through which we expect to succeed 2023-12-22T08:45:11.378 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-22T08:45:11.378 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.378 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.379 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 1.00 MB 2023-12-22T08:45:11.379 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.379 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.379 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 2.00 MB 2023-12-22T08:45:11.379 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.379 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.379 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 3.00 MB 2023-12-22T08:45:11.380 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.380 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.380 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 4.00 MB 2023-12-22T08:45:11.380 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.380 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.380 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 5.00 MB 2023-12-22T08:45:11.380 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.380 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.381 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 6.00 MB 2023-12-22T08:45:11.381 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.381 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.381 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 7.00 MB 2023-12-22T08:45:11.381 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.381 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.381 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 8.00 MB 2023-12-22T08:45:11.382 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.382 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.382 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 9.00 MB 2023-12-22T08:45:11.382 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.382 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.382 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 10.00 MB 2023-12-22T08:45:11.382 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.383 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.383 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 11.00 MB 2023-12-22T08:45:11.383 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.383 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.383 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 12.00 MB 2023-12-22T08:45:11.383 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.383 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.383 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 13.00 MB 2023-12-22T08:45:11.383 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 14.00 MB 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 15.00 MB 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 16.00 MB 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 17.00 MB 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 18.00 MB 2023-12-22T08:45:11.384 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 19.00 MB 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 20.00 MB 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 21.00 MB 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 22.00 MB 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.385 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 23.00 MB 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 24.00 MB 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 25.00 MB 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 26.00 MB 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 27.00 MB 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.386 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 28.00 MB 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 29.00 MB 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 30.00 MB 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 31.00 MB 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 32.00 MB 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.387 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 33.00 MB 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 34.00 MB 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 35.00 MB 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 36.00 MB 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 37.00 MB 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.388 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 38.00 MB 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 39.00 MB 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 40.00 MB 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 41.00 MB 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 42.00 MB 2023-12-22T08:45:11.389 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 43.00 MB 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 44.00 MB 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 45.00 MB 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 46.00 MB 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.390 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 47.00 MB 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 48.00 MB 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 49.00 MB 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 50.00 MB 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 51.00 MB 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.391 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 52.00 MB 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 53.00 MB 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 54.00 MB 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 55.00 MB 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 56.00 MB 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 57.00 MB 2023-12-22T08:45:11.392 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 58.00 MB 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 59.00 MB 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 60.00 MB 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 61.00 MB 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.393 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 62.00 MB 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 63.00 MB 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 64.00 MB 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 65.00 MB 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 66.00 MB 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 67.00 MB 2023-12-22T08:45:11.394 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 68.00 MB 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 69.00 MB 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 70.00 MB 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 71.00 MB 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 72.00 MB 2023-12-22T08:45:11.395 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 73.00 MB 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 74.00 MB 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 75.00 MB 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 76.00 MB 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 77.00 MB 2023-12-22T08:45:11.396 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.397 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.397 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 78.00 MB 2023-12-22T08:45:11.397 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.397 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.397 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 79.00 MB 2023-12-22T08:45:11.397 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:11.397 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:11.397 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 80.00 MB 2023-12-22T08:45:12.304 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.304 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.304 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 81.00 MB 2023-12-22T08:45:12.304 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.304 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.304 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 82.00 MB 2023-12-22T08:45:12.304 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.304 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.304 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 83.00 MB 2023-12-22T08:45:12.304 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.304 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 84.00 MB 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 85.00 MB 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 86.00 MB 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 87.00 MB 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 88.00 MB 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.305 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 89.00 MB 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 90.00 MB 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 91.00 MB 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 92.00 MB 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 93.00 MB 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.306 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 94.00 MB 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 95.00 MB 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 96.00 MB 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 97.00 MB 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 98.00 MB 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.307 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 99.00 MB 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 100.00 MB 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 101.00 MB 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 102.00 MB 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 103.00 MB 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 104.00 MB 2023-12-22T08:45:12.308 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 105.00 MB 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 106.00 MB 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 107.00 MB 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 108.00 MB 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.309 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 109.00 MB 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 110.00 MB 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 111.00 MB 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 112.00 MB 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 113.00 MB 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 114.00 MB 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.310 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 115.00 MB 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 116.00 MB 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 117.00 MB 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 118.00 MB 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 119.00 MB 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.311 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 120.00 MB 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 121.00 MB 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 122.00 MB 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 123.00 MB 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 124.00 MB 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 125.00 MB 2023-12-22T08:45:12.312 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 126.00 MB 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 127.00 MB 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 128.00 MB 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 129.00 MB 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 130.00 MB 2023-12-22T08:45:12.313 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 131.00 MB 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 132.00 MB 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 133.00 MB 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 134.00 MB 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 135.00 MB 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.314 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.315 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 136.00 MB 2023-12-22T08:45:12.315 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.315 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.315 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 137.00 MB 2023-12-22T08:45:12.315 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.315 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.315 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 138.00 MB 2023-12-22T08:45:12.315 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.315 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.315 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 139.00 MB 2023-12-22T08:45:12.315 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.315 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.315 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 140.00 MB 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 141.00 MB 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 142.00 MB 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 143.00 MB 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 144.00 MB 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 145.00 MB 2023-12-22T08:45:12.316 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.317 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.317 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 146.00 MB 2023-12-22T08:45:12.317 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.317 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.317 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 147.00 MB 2023-12-22T08:45:12.317 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.317 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.317 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 148.00 MB 2023-12-22T08:45:12.317 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.317 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.317 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 149.00 MB 2023-12-22T08:45:12.317 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 150.00 MB 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 151.00 MB 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 152.00 MB 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 153.00 MB 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 154.00 MB 2023-12-22T08:45:12.318 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 155.00 MB 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 156.00 MB 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 157.00 MB 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 158.00 MB 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 159.00 MB 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:12.319 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:12.320 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 160.00 MB 2023-12-22T08:45:12.320 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.172 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.172 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 161.00 MB 2023-12-22T08:45:13.172 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.172 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.173 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 162.00 MB 2023-12-22T08:45:13.173 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.173 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.173 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 163.00 MB 2023-12-22T08:45:13.173 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.173 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.173 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 164.00 MB 2023-12-22T08:45:13.173 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.173 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.173 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 165.00 MB 2023-12-22T08:45:13.173 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.173 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.173 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 166.00 MB 2023-12-22T08:45:13.174 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.174 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.174 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 167.00 MB 2023-12-22T08:45:13.174 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.174 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.174 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 168.00 MB 2023-12-22T08:45:13.174 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.174 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.174 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 169.00 MB 2023-12-22T08:45:13.174 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.174 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.174 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 170.00 MB 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 171.00 MB 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 172.00 MB 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 173.00 MB 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 174.00 MB 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.175 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 175.00 MB 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 176.00 MB 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 177.00 MB 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 178.00 MB 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 179.00 MB 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.176 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.177 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 180.00 MB 2023-12-22T08:45:13.177 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.177 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.177 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 181.00 MB 2023-12-22T08:45:13.177 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.177 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.177 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 182.00 MB 2023-12-22T08:45:13.177 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.177 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 183.00 MB 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 184.00 MB 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 185.00 MB 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 186.00 MB 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 187.00 MB 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.178 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 188.00 MB 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 189.00 MB 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 190.00 MB 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 191.00 MB 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 192.00 MB 2023-12-22T08:45:13.179 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 193.00 MB 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 194.00 MB 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 195.00 MB 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 196.00 MB 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.180 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 197.00 MB 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 198.00 MB 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 199.00 MB 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 200.00 MB 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 201.00 MB 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.181 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 202.00 MB 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 203.00 MB 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 204.00 MB 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 205.00 MB 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 206.00 MB 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.182 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 207.00 MB 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 208.00 MB 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 209.00 MB 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 210.00 MB 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 211.00 MB 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 212.00 MB 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 213.00 MB 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 214.00 MB 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 215.00 MB 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 216.00 MB 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.184 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 217.00 MB 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 218.00 MB 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 219.00 MB 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 220.00 MB 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 221.00 MB 2023-12-22T08:45:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 222.00 MB 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 223.00 MB 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 224.00 MB 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 225.00 MB 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 226.00 MB 2023-12-22T08:45:13.186 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 227.00 MB 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 228.00 MB 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 229.00 MB 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 230.00 MB 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 231.00 MB 2023-12-22T08:45:13.187 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.188 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.188 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 232.00 MB 2023-12-22T08:45:13.188 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.188 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.188 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 233.00 MB 2023-12-22T08:45:13.188 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.188 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.188 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 234.00 MB 2023-12-22T08:45:13.188 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.188 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.188 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 235.00 MB 2023-12-22T08:45:13.188 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.188 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.189 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 236.00 MB 2023-12-22T08:45:13.189 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.189 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.189 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 237.00 MB 2023-12-22T08:45:13.189 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.189 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.189 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 238.00 MB 2023-12-22T08:45:13.189 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.189 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.189 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 239.00 MB 2023-12-22T08:45:13.189 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.189 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:13.189 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 240.00 MB 2023-12-22T08:45:13.190 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:13.190 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.019 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 241.00 MB 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 242.00 MB 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 243.00 MB 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 244.00 MB 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 245.00 MB 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.020 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 246.00 MB 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 247.00 MB 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 248.00 MB 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 249.00 MB 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 250.00 MB 2023-12-22T08:45:14.021 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 251.00 MB 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 252.00 MB 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 253.00 MB 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 254.00 MB 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 255.00 MB 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.022 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 256.00 MB 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 257.00 MB 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 258.00 MB 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 259.00 MB 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 260.00 MB 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.023 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 261.00 MB 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 262.00 MB 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 263.00 MB 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 264.00 MB 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 265.00 MB 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 266.00 MB 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.024 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.025 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 267.00 MB 2023-12-22T08:45:14.025 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.025 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.025 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 268.00 MB 2023-12-22T08:45:14.025 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.025 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.025 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 269.00 MB 2023-12-22T08:45:14.025 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.025 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.025 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 270.00 MB 2023-12-22T08:45:14.025 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.025 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.025 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 271.00 MB 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 272.00 MB 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 273.00 MB 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 274.00 MB 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 275.00 MB 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.026 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 276.00 MB 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 277.00 MB 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 278.00 MB 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 279.00 MB 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 280.00 MB 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 281.00 MB 2023-12-22T08:45:14.027 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 282.00 MB 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 283.00 MB 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 284.00 MB 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 285.00 MB 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 286.00 MB 2023-12-22T08:45:14.028 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 287.00 MB 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 288.00 MB 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 289.00 MB 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 290.00 MB 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 291.00 MB 2023-12-22T08:45:14.029 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 292.00 MB 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 293.00 MB 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 294.00 MB 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 295.00 MB 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 296.00 MB 2023-12-22T08:45:14.030 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 297.00 MB 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 298.00 MB 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 299.00 MB 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 300.00 MB 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 301.00 MB 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.031 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 302.00 MB 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 303.00 MB 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 304.00 MB 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 305.00 MB 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 306.00 MB 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.032 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 307.00 MB 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 308.00 MB 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 309.00 MB 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 310.00 MB 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 311.00 MB 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 312.00 MB 2023-12-22T08:45:14.033 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 313.00 MB 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 314.00 MB 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 315.00 MB 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 316.00 MB 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 317.00 MB 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.034 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 318.00 MB 2023-12-22T08:45:14.035 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.035 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.035 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 319.00 MB 2023-12-22T08:45:14.035 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.035 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.035 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 320.00 MB 2023-12-22T08:45:14.035 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.035 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.035 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 321.00 MB 2023-12-22T08:45:14.856 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.856 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.856 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 322.00 MB 2023-12-22T08:45:14.856 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.857 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.857 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 323.00 MB 2023-12-22T08:45:14.857 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.857 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.857 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 324.00 MB 2023-12-22T08:45:14.857 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.857 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.857 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 325.00 MB 2023-12-22T08:45:14.857 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.857 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.857 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 326.00 MB 2023-12-22T08:45:14.857 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.857 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 327.00 MB 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 328.00 MB 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 329.00 MB 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 330.00 MB 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 331.00 MB 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.858 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 332.00 MB 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 333.00 MB 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 334.00 MB 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 335.00 MB 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 336.00 MB 2023-12-22T08:45:14.859 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 337.00 MB 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 338.00 MB 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 339.00 MB 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 340.00 MB 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 341.00 MB 2023-12-22T08:45:14.860 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 342.00 MB 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 343.00 MB 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 344.00 MB 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 345.00 MB 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.861 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 346.00 MB 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 347.00 MB 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 348.00 MB 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 349.00 MB 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 350.00 MB 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.862 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 351.00 MB 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 352.00 MB 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 353.00 MB 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 354.00 MB 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 355.00 MB 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.863 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 356.00 MB 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 357.00 MB 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 358.00 MB 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 359.00 MB 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 360.00 MB 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 361.00 MB 2023-12-22T08:45:14.864 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 362.00 MB 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 363.00 MB 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 364.00 MB 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 365.00 MB 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.865 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 366.00 MB 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 367.00 MB 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 368.00 MB 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 369.00 MB 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 370.00 MB 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.866 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 371.00 MB 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 372.00 MB 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 373.00 MB 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 374.00 MB 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 375.00 MB 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.867 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 376.00 MB 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 377.00 MB 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 378.00 MB 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 379.00 MB 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 380.00 MB 2023-12-22T08:45:14.868 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 381.00 MB 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 382.00 MB 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 383.00 MB 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 384.00 MB 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 385.00 MB 2023-12-22T08:45:14.869 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 386.00 MB 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 387.00 MB 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 388.00 MB 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 389.00 MB 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 390.00 MB 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 391.00 MB 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 392.00 MB 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 393.00 MB 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 394.00 MB 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.871 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 395.00 MB 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 396.00 MB 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 397.00 MB 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 398.00 MB 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 399.00 MB 2023-12-22T08:45:14.872 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.873 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.873 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 400.00 MB 2023-12-22T08:45:14.873 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:14.873 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:14.873 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 401.00 MB 2023-12-22T08:45:17.349 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:45:17.359 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:45:18.268 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:45:18.266+0000 7f0a296e8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-12-22T08:45:26.200 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:45:26.199+0000 7f0a296e8640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-12-22T08:45:45.835 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.835 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.835 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 402.00 MB 2023-12-22T08:45:45.835 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.835 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.835 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 403.00 MB 2023-12-22T08:45:45.835 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.835 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.835 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 404.00 MB 2023-12-22T08:45:45.835 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.835 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.835 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 405.00 MB 2023-12-22T08:45:45.835 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 406.00 MB 2023-12-22T08:45:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 407.00 MB 2023-12-22T08:45:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 408.00 MB 2023-12-22T08:45:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 409.00 MB 2023-12-22T08:45:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.836 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 410.00 MB 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 411.00 MB 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 412.00 MB 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 413.00 MB 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 414.00 MB 2023-12-22T08:45:45.837 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 415.00 MB 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 416.00 MB 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 417.00 MB 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 418.00 MB 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 419.00 MB 2023-12-22T08:45:45.838 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 420.00 MB 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 421.00 MB 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 422.00 MB 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 423.00 MB 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 424.00 MB 2023-12-22T08:45:45.839 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 425.00 MB 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 426.00 MB 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 427.00 MB 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 428.00 MB 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.840 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 429.00 MB 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 430.00 MB 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 431.00 MB 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 432.00 MB 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 433.00 MB 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 434.00 MB 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 435.00 MB 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 436.00 MB 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 437.00 MB 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 438.00 MB 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.842 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 439.00 MB 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 440.00 MB 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 441.00 MB 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 442.00 MB 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 443.00 MB 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 444.00 MB 2023-12-22T08:45:45.843 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 445.00 MB 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 446.00 MB 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 447.00 MB 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 448.00 MB 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 449.00 MB 2023-12-22T08:45:45.844 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 450.00 MB 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 451.00 MB 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 452.00 MB 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 453.00 MB 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.845 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 454.00 MB 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 455.00 MB 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 456.00 MB 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 457.00 MB 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 458.00 MB 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 459.00 MB 2023-12-22T08:45:45.846 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 460.00 MB 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 461.00 MB 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 462.00 MB 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 463.00 MB 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 464.00 MB 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.847 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 465.00 MB 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 466.00 MB 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 467.00 MB 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 468.00 MB 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 469.00 MB 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.848 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 470.00 MB 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 471.00 MB 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 472.00 MB 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 473.00 MB 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 474.00 MB 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.849 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 475.00 MB 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 476.00 MB 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 477.00 MB 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 478.00 MB 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 479.00 MB 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:45:45.850 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 480.00 MB 2023-12-22T08:45:45.851 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:45:45.975 INFO:teuthology.orchestra.run.smithi038.stdout:Reached fullness after 480.00 MB 2023-12-22T08:45:45.975 INFO:teuthology.orchestra.run.smithi038.stdout:calling close 2023-12-22T08:45:45.975 INFO:teuthology.orchestra.run.smithi038.stdout:close() did not raise error 2023-12-22T08:45:46.196 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:45:46.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:45:46.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:45:46.452 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:45:46.452 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:45:46.452 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:45:46.518 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:45:46.519 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:45:46.578 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:45:46.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.800+0000 7fd3421f0640 1 Processor -- start 2023-12-22T08:45:46.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.801+0000 7fd3421f0640 1 -- start start 2023-12-22T08:45:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.802+0000 7fd3421f0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c1547a0 0x7fd33c15b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.802+0000 7fd3421f0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd33c154b80 0x7fd33c0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.803+0000 7fd3421f0640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0716a0 con 0x7fd33c071b90 2023-12-22T08:45:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.803+0000 7fd3421f0640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33c070e80 con 0x7fd33c154b80 2023-12-22T08:45:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.803+0000 7fd3421f0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0710e0 con 0x7fd33c1547a0 2023-12-22T08:45:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.803+0000 7fd33bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd33c154b80 0x7fd33c0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.803+0000 7fd33bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd33c154b80 0x7fd33c0ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47484/0 (socket says 172.21.15.38:47484) 2023-12-22T08:45:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.803+0000 7fd33bfff640 1 -- 172.21.15.38:0/3919933564 learned_addr learned my addr 172.21.15.38:0/3919933564 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.803+0000 7fd33b7fe640 1 --2- 172.21.15.38:0/3919933564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c1547a0 0x7fd33c15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.803+0000 7fd33bfff640 1 -- 172.21.15.38:0/3919933564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c1547a0 msgr2=0x7fd33c15b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.803+0000 7fd33bfff640 1 --2- 172.21.15.38:0/3919933564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c1547a0 0x7fd33c15b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.803+0000 7fd33bfff640 1 -- 172.21.15.38:0/3919933564 >> v1:172.21.15.38:6789/0 conn(0x7fd33c071b90 legacy=0x7fd33c070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.803+0000 7fd33bfff640 1 -- 172.21.15.38:0/3919933564 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0713c0 con 0x7fd33c154b80 2023-12-22T08:45:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.805+0000 7fd33bfff640 1 --2- 172.21.15.38:0/3919933564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd33c154b80 0x7fd33c0ce390 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd334009e50 tx=0x7fd33402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fab6165da62c237 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.805+0000 7fd33affd640 1 -- 172.21.15.38:0/3919933564 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33402cb00 con 0x7fd33c154b80 2023-12-22T08:45:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.805+0000 7fd33affd640 1 -- 172.21.15.38:0/3919933564 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33402cc60 con 0x7fd33c154b80 2023-12-22T08:45:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.805+0000 7fd33affd640 1 -- 172.21.15.38:0/3919933564 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3340343f0 con 0x7fd33c154b80 2023-12-22T08:45:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.805+0000 7fd3421f0640 1 -- 172.21.15.38:0/3919933564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd33c154b80 msgr2=0x7fd33c0ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:46.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.805+0000 7fd3421f0640 1 --2- 172.21.15.38:0/3919933564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd33c154b80 0x7fd33c0ce390 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd334009e50 tx=0x7fd33402bf60 comp rx=0 tx=0).stop 2023-12-22T08:45:46.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.806+0000 7fd3421f0640 1 -- 172.21.15.38:0/3919933564 shutdown_connections 2023-12-22T08:45:46.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.806+0000 7fd3421f0640 1 --2- 172.21.15.38:0/3919933564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd33c154b80 0x7fd33c0ce390 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:46.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.806+0000 7fd3421f0640 1 --2- 172.21.15.38:0/3919933564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c1547a0 0x7fd33c15b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:46.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.806+0000 7fd3421f0640 1 -- 172.21.15.38:0/3919933564 >> 172.21.15.38:0/3919933564 conn(0x7fd33c0cf070 msgr2=0x7fd33c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:46.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.806+0000 7fd3421f0640 1 -- 172.21.15.38:0/3919933564 shutdown_connections 2023-12-22T08:45:46.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.806+0000 7fd3421f0640 1 -- 172.21.15.38:0/3919933564 wait complete. 2023-12-22T08:45:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.807+0000 7fd3421f0640 1 Processor -- start 2023-12-22T08:45:46.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.808+0000 7fd3421f0640 1 -- start start 2023-12-22T08:45:46.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.808+0000 7fd3421f0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c071b90 0x7fd33c14b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:46.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd3421f0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd33c1547a0 0x7fd33c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:46.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd3421f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd33c154b80 0x7fd33c0afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:46.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd3421f0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c13f990 con 0x7fd33c1547a0 2023-12-22T08:45:46.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd3421f0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0b1610 con 0x7fd33c154b80 2023-12-22T08:45:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd3421f0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0b18b0 con 0x7fd33c071b90 2023-12-22T08:45:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd333fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd33c1547a0 0x7fd33c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd333fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd33c1547a0 0x7fd33c0af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47494/0 (socket says 172.21.15.38:47494) 2023-12-22T08:45:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd333fff640 1 -- 172.21.15.38:0/735575293 learned_addr learned my addr 172.21.15.38:0/735575293 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd33b7fe640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c071b90 0x7fd33c14b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd33bfff640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd33c154b80 0x7fd33c0afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd333fff640 1 -- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c071b90 msgr2=0x7fd33c14b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd333fff640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c071b90 0x7fd33c14b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd333fff640 1 -- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd33c154b80 msgr2=0x7fd33c0afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd333fff640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd33c154b80 0x7fd33c0afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd333fff640 1 -- 172.21.15.38:0/735575293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd334009b30 con 0x7fd33c1547a0 2023-12-22T08:45:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.809+0000 7fd33bfff640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd33c154b80 0x7fd33c0afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.810+0000 7fd333fff640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd33c1547a0 0x7fd33c0af5d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd32400c450 tx=0x7fd32400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.810+0000 7fd338ff9640 1 -- 172.21.15.38:0/735575293 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3240052d0 con 0x7fd33c1547a0 2023-12-22T08:45:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.810+0000 7fd338ff9640 1 -- 172.21.15.38:0/735575293 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd324005430 con 0x7fd33c1547a0 2023-12-22T08:45:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.810+0000 7fd338ff9640 1 -- 172.21.15.38:0/735575293 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324012870 con 0x7fd33c1547a0 2023-12-22T08:45:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.810+0000 7fd3421f0640 1 -- 172.21.15.38:0/735575293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c0aedd0 con 0x7fd33c1547a0 2023-12-22T08:45:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.810+0000 7fd3421f0640 1 -- 172.21.15.38:0/735575293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c14bcc0 con 0x7fd33c1547a0 2023-12-22T08:45:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.811+0000 7fd3421f0640 1 -- 172.21.15.38:0/735575293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c0aec30 con 0x7fd33c1547a0 2023-12-22T08:45:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.812+0000 7fd338ff9640 1 -- 172.21.15.38:0/735575293 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd3240129d0 con 0x7fd33c1547a0 2023-12-22T08:45:46.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.814+0000 7fd338ff9640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd31c06a430 0x7fd31c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:46.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.814+0000 7fd338ff9640 1 -- 172.21.15.38:0/735575293 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd324088460 con 0x7fd33c1547a0 2023-12-22T08:45:46.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.814+0000 7fd338ff9640 1 -- 172.21.15.38:0/735575293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7fd31c071f60 con 0x7fd33c1547a0 2023-12-22T08:45:46.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.815+0000 7fd33b7fe640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd31c06a430 0x7fd31c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:46.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.816+0000 7fd33b7fe640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd31c06a430 0x7fd31c06c8f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd32c006fd0 tx=0x7fd32c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:46.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:46.819+0000 7fd338ff9640 1 -- 172.21.15.38:0/735575293 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd33c0aec30 con 0x7fd33c1547a0 2023-12-22T08:45:47.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.012+0000 7fd3421f0640 1 -- 172.21.15.38:0/735575293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd33c0aec30 con 0x7fd33c1547a0 2023-12-22T08:45:47.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.015+0000 7fd338ff9640 1 -- 172.21.15.38:0/735575293 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16081 (secure 0 0 0) 0x7fd33c0aec30 con 0x7fd33c1547a0 2023-12-22T08:45:47.017 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:47.017 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":93,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:45:23.330914+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:44:53.802762+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-22T08:44:54.948144+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:45:47.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.018+0000 7fd3421f0640 1 -- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd31c06a430 msgr2=0x7fd31c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.018+0000 7fd3421f0640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd31c06a430 0x7fd31c06c8f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd32c006fd0 tx=0x7fd32c008040 comp rx=0 tx=0).stop 2023-12-22T08:45:47.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.018+0000 7fd3421f0640 1 -- 172.21.15.38:0/735575293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd33c1547a0 msgr2=0x7fd33c0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.018+0000 7fd3421f0640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd33c1547a0 0x7fd33c0af5d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd32400c450 tx=0x7fd32400c910 comp rx=0 tx=0).stop 2023-12-22T08:45:47.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.018+0000 7fd3421f0640 1 -- 172.21.15.38:0/735575293 shutdown_connections 2023-12-22T08:45:47.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.018+0000 7fd3421f0640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd33c154b80 0x7fd33c0afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.018+0000 7fd3421f0640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd31c06a430 0x7fd31c06c8f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.018+0000 7fd3421f0640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd33c1547a0 0x7fd33c0af5d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.018+0000 7fd3421f0640 1 --2- 172.21.15.38:0/735575293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd33c071b90 0x7fd33c14b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.018+0000 7fd3421f0640 1 -- 172.21.15.38:0/735575293 >> 172.21.15.38:0/735575293 conn(0x7fd33c0cf070 msgr2=0x7fd33c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:47.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.018+0000 7fd3421f0640 1 -- 172.21.15.38:0/735575293 shutdown_connections 2023-12-22T08:45:47.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.018+0000 7fd3421f0640 1 -- 172.21.15.38:0/735575293 wait complete. 2023-12-22T08:45:47.040 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:44:53.802762+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:44:54.948144+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:45:47.041 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:45:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.269+0000 7f742bfff640 1 Processor -- start 2023-12-22T08:45:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.269+0000 7f742bfff640 1 -- start start 2023-12-22T08:45:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.271+0000 7f742bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f742c071080 0x7f742c0d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.271+0000 7f742bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f742c15d5a0 0x7f742c0d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.271+0000 7f742bfff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742c15de50 con 0x7f742c15d1c0 2023-12-22T08:45:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.271+0000 7f742bfff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742c0d0dd0 con 0x7f742c15d5a0 2023-12-22T08:45:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.271+0000 7f742bfff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742c0d10b0 con 0x7f742c071080 2023-12-22T08:45:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.271+0000 7f742affd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f742c15d1c0 0x7f742c070970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37758/0 (socket says 172.21.15.38:37758) 2023-12-22T08:45:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.271+0000 7f742affd640 1 -- 172.21.15.38:0/1707673280 learned_addr learned my addr 172.21.15.38:0/1707673280 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:47.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.271+0000 7f742b7fe640 1 --2- 172.21.15.38:0/1707673280 >> v2:172.21.15.38:3300/0 conn(0x7f742c15d5a0 0x7f742c0d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.272+0000 7f74227fc640 1 --2- 172.21.15.38:0/1707673280 >> v2:172.21.15.89:3300/0 conn(0x7f742c071080 0x7f742c0d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.272+0000 7f742a7fc640 1 -- 172.21.15.38:0/1707673280 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838195403 0 0) 0x7f742c15de50 con 0x7f742c15d1c0 2023-12-22T08:45:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.272+0000 7f742a7fc640 1 -- 172.21.15.38:0/1707673280 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7418003520 con 0x7f742c15d1c0 2023-12-22T08:45:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.272+0000 7f742b7fe640 1 -- 172.21.15.38:0/1707673280 >> v2:172.21.15.89:3300/0 conn(0x7f742c071080 msgr2=0x7f742c0d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.272+0000 7f742b7fe640 1 --2- 172.21.15.38:0/1707673280 >> v2:172.21.15.89:3300/0 conn(0x7f742c071080 0x7f742c0d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.272+0000 7f742b7fe640 1 -- 172.21.15.38:0/1707673280 >> v1:172.21.15.38:6789/0 conn(0x7f742c15d1c0 legacy=0x7f742c070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.272+0000 7f742b7fe640 1 -- 172.21.15.38:0/1707673280 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c15dae0 con 0x7f742c15d5a0 2023-12-22T08:45:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.273+0000 7f742b7fe640 1 --2- 172.21.15.38:0/1707673280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f742c15d5a0 0x7f742c0d05a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f742c160e20 tx=0x7f742402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcbf65b7c076fc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.273+0000 7f742a7fc640 1 -- 172.21.15.38:0/1707673280 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424031830 con 0x7f742c15d5a0 2023-12-22T08:45:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.274+0000 7f742a7fc640 1 -- 172.21.15.38:0/1707673280 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7424031990 con 0x7f742c15d5a0 2023-12-22T08:45:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.274+0000 7f742a7fc640 1 -- 172.21.15.38:0/1707673280 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424031d20 con 0x7f742c15d5a0 2023-12-22T08:45:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.274+0000 7f742bfff640 1 -- 172.21.15.38:0/1707673280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f742c15d5a0 msgr2=0x7f742c0d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.274+0000 7f742bfff640 1 --2- 172.21.15.38:0/1707673280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f742c15d5a0 0x7f742c0d05a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f742c160e20 tx=0x7f742402b8d0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.274+0000 7f742bfff640 1 -- 172.21.15.38:0/1707673280 shutdown_connections 2023-12-22T08:45:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.274+0000 7f742bfff640 1 --2- 172.21.15.38:0/1707673280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f742c15d5a0 0x7f742c0d05a0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.274+0000 7f742bfff640 1 --2- 172.21.15.38:0/1707673280 >> v2:172.21.15.89:3300/0 conn(0x7f742c071080 0x7f742c0d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.274+0000 7f742bfff640 1 -- 172.21.15.38:0/1707673280 >> 172.21.15.38:0/1707673280 conn(0x7f742c06bf90 msgr2=0x7f742c06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.274+0000 7f742bfff640 1 -- 172.21.15.38:0/1707673280 shutdown_connections 2023-12-22T08:45:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.274+0000 7f742bfff640 1 -- 172.21.15.38:0/1707673280 wait complete. 2023-12-22T08:45:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.276+0000 7f742bfff640 1 Processor -- start 2023-12-22T08:45:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.276+0000 7f742bfff640 1 -- start start 2023-12-22T08:45:47.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.278+0000 7f742bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f742c071080 0x7f742c0b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:47.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.278+0000 7f742bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f742c15d1c0 0x7f742c149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:47.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.278+0000 7f742bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f742c15d5a0 0x7f742c1f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.278+0000 7f742bfff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c1f6a00 con 0x7f742c071080 2023-12-22T08:45:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.278+0000 7f742bfff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c1f6440 con 0x7f742c15d5a0 2023-12-22T08:45:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.278+0000 7f742bfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c1f6720 con 0x7f742c15d1c0 2023-12-22T08:45:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.278+0000 7f742affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f742c071080 0x7f742c0b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.278+0000 7f742affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f742c071080 0x7f742c0b6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47516/0 (socket says 172.21.15.38:47516) 2023-12-22T08:45:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.278+0000 7f742affd640 1 -- 172.21.15.38:0/2491559028 learned_addr learned my addr 172.21.15.38:0/2491559028 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.279+0000 7f74227fc640 1 --2- 172.21.15.38:0/2491559028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f742c15d1c0 0x7f742c149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.279+0000 7f742affd640 1 -- 172.21.15.38:0/2491559028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f742c15d1c0 msgr2=0x7f742c149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.279+0000 7f742affd640 1 --2- 172.21.15.38:0/2491559028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f742c15d1c0 0x7f742c149db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.279+0000 7f742affd640 1 -- 172.21.15.38:0/2491559028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f742c15d5a0 msgr2=0x7f742c1f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.279+0000 7f742affd640 1 --2- 172.21.15.38:0/2491559028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f742c15d5a0 0x7f742c1f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.279+0000 7f742affd640 1 -- 172.21.15.38:0/2491559028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7424009400 con 0x7f742c071080 2023-12-22T08:45:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.279+0000 7f742affd640 1 --2- 172.21.15.38:0/2491559028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f742c071080 0x7f742c0b6d90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f741c00c500 tx=0x7f741c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.280+0000 7f7423fff640 1 -- 172.21.15.38:0/2491559028 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c005ce0 con 0x7f742c071080 2023-12-22T08:45:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.280+0000 7f7423fff640 1 -- 172.21.15.38:0/2491559028 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741c005e40 con 0x7f742c071080 2023-12-22T08:45:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.280+0000 7f7423fff640 1 -- 172.21.15.38:0/2491559028 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c007330 con 0x7f742c071080 2023-12-22T08:45:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.280+0000 7f742bfff640 1 -- 172.21.15.38:0/2491559028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742c0aca80 con 0x7f742c071080 2023-12-22T08:45:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.280+0000 7f742bfff640 1 -- 172.21.15.38:0/2491559028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c0b72d0 con 0x7f742c071080 2023-12-22T08:45:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.281+0000 7f742bfff640 1 -- 172.21.15.38:0/2491559028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742c0ac8e0 con 0x7f742c071080 2023-12-22T08:45:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.282+0000 7f7423fff640 1 -- 172.21.15.38:0/2491559028 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f741c007550 con 0x7f742c071080 2023-12-22T08:45:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.283+0000 7f7423fff640 1 --2- 172.21.15.38:0/2491559028 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f740c06a430 0x7f740c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.283+0000 7f7423fff640 1 -- 172.21.15.38:0/2491559028 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f741c087ff0 con 0x7f742c071080 2023-12-22T08:45:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.283+0000 7f7423fff640 1 -- 172.21.15.38:0/2491559028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7f740c071f60 con 0x7f742c071080 2023-12-22T08:45:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.284+0000 7f74227fc640 1 --2- 172.21.15.38:0/2491559028 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f740c06a430 0x7f740c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.285+0000 7f74227fc640 1 --2- 172.21.15.38:0/2491559028 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f740c06a430 0x7f740c06c8f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f742c0b89d0 tx=0x7f741400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.288+0000 7f7423fff640 1 -- 172.21.15.38:0/2491559028 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f741c0bac80 con 0x7f742c071080 2023-12-22T08:45:47.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.476+0000 7f742bfff640 1 -- 172.21.15.38:0/2491559028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f742c0acfa0 con 0x7f742c071080 2023-12-22T08:45:47.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.477+0000 7f7423fff640 1 -- 172.21.15.38:0/2491559028 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f741c017060 con 0x7f742c071080 2023-12-22T08:45:47.479 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:45:47.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.479+0000 7f742bfff640 1 -- 172.21.15.38:0/2491559028 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f740c06a430 msgr2=0x7f740c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.479+0000 7f742bfff640 1 --2- 172.21.15.38:0/2491559028 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f740c06a430 0x7f740c06c8f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f742c0b89d0 tx=0x7f741400b040 comp rx=0 tx=0).stop 2023-12-22T08:45:47.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.479+0000 7f742bfff640 1 -- 172.21.15.38:0/2491559028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f742c071080 msgr2=0x7f742c0b6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.479+0000 7f742bfff640 1 --2- 172.21.15.38:0/2491559028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f742c071080 0x7f742c0b6d90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f741c00c500 tx=0x7f741c00c9c0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.479+0000 7f742bfff640 1 -- 172.21.15.38:0/2491559028 shutdown_connections 2023-12-22T08:45:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.479+0000 7f742bfff640 1 --2- 172.21.15.38:0/2491559028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f742c15d5a0 0x7f742c1f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.479+0000 7f742bfff640 1 --2- 172.21.15.38:0/2491559028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f742c15d1c0 0x7f742c149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.479+0000 7f742bfff640 1 --2- 172.21.15.38:0/2491559028 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f740c06a430 0x7f740c06c8f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.479+0000 7f742bfff640 1 --2- 172.21.15.38:0/2491559028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f742c071080 0x7f742c0b6d90 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.479+0000 7f742bfff640 1 -- 172.21.15.38:0/2491559028 >> 172.21.15.38:0/2491559028 conn(0x7f742c06bf90 msgr2=0x7f742c06cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.480+0000 7f742bfff640 1 -- 172.21.15.38:0/2491559028 shutdown_connections 2023-12-22T08:45:47.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.480+0000 7f742bfff640 1 -- 172.21.15.38:0/2491559028 wait complete. 2023-12-22T08:45:47.495 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:45:47.501 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:45:47.502 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:45:47.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.746+0000 7f796dcd5640 1 Processor -- start 2023-12-22T08:45:47.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.746+0000 7f796dcd5640 1 -- start start 2023-12-22T08:45:47.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.748+0000 7f796dcd5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79680b22c0 0x7f79680b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:47.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.748+0000 7f796dcd5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f79680cb830 0x7f79680cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:47.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.748+0000 7f796dcd5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79680cc200 con 0x7f79680b26a0 2023-12-22T08:45:47.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.748+0000 7f796dcd5640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796806c610 con 0x7f79680cb830 2023-12-22T08:45:47.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.748+0000 7f796dcd5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79680b4510 con 0x7f79680b22c0 2023-12-22T08:45:47.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.748+0000 7f7967fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f79680cb830 0x7f79680cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:47.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.748+0000 7f795ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f79680b26a0 0x7f796806ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37760/0 (socket says 172.21.15.38:37760) 2023-12-22T08:45:47.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.748+0000 7f795ffff640 1 -- 172.21.15.38:0/2803195340 learned_addr learned my addr 172.21.15.38:0/2803195340 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:47.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.749+0000 7f79677fe640 1 --2- 172.21.15.38:0/2803195340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79680b22c0 0x7f79680b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:47.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.749+0000 7f7967fff640 1 -- 172.21.15.38:0/2803195340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79680b22c0 msgr2=0x7f79680b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:47.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.749+0000 7f7967fff640 1 --2- 172.21.15.38:0/2803195340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79680b22c0 0x7f79680b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.749+0000 7f7967fff640 1 -- 172.21.15.38:0/2803195340 >> v1:172.21.15.38:6789/0 conn(0x7f79680b26a0 legacy=0x7f796806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.749+0000 7f7967fff640 1 -- 172.21.15.38:0/2803195340 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680b3f50 con 0x7f79680cb830 2023-12-22T08:45:47.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.749+0000 7f7966ffd640 1 -- 172.21.15.38:0/2803195340 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904585466 0 0) 0x7f79680cc200 con 0x7f79680b26a0 2023-12-22T08:45:47.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.751+0000 7f7967fff640 1 --2- 172.21.15.38:0/2803195340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79680cb830 0x7f79680cbcc0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7960009d90 tx=0x7f796002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a168d8324ef2c735 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:47.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.751+0000 7f7966ffd640 1 -- 172.21.15.38:0/2803195340 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796002cbc0 con 0x7f79680cb830 2023-12-22T08:45:47.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.751+0000 7f7966ffd640 1 -- 172.21.15.38:0/2803195340 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796002cd20 con 0x7f79680cb830 2023-12-22T08:45:47.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.751+0000 7f7966ffd640 1 -- 172.21.15.38:0/2803195340 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960034660 con 0x7f79680cb830 2023-12-22T08:45:47.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.751+0000 7f796dcd5640 1 -- 172.21.15.38:0/2803195340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79680cb830 msgr2=0x7f79680cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.751+0000 7f796dcd5640 1 --2- 172.21.15.38:0/2803195340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79680cb830 0x7f79680cbcc0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7960009d90 tx=0x7f796002be10 comp rx=0 tx=0).stop 2023-12-22T08:45:47.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.752+0000 7f796dcd5640 1 -- 172.21.15.38:0/2803195340 shutdown_connections 2023-12-22T08:45:47.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.752+0000 7f796dcd5640 1 --2- 172.21.15.38:0/2803195340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79680cb830 0x7f79680cbcc0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.752+0000 7f796dcd5640 1 --2- 172.21.15.38:0/2803195340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79680b22c0 0x7f79680b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.752+0000 7f796dcd5640 1 -- 172.21.15.38:0/2803195340 >> 172.21.15.38:0/2803195340 conn(0x7f79680cf070 msgr2=0x7f79680cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:47.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.752+0000 7f796dcd5640 1 -- 172.21.15.38:0/2803195340 shutdown_connections 2023-12-22T08:45:47.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.752+0000 7f796dcd5640 1 -- 172.21.15.38:0/2803195340 wait complete. 2023-12-22T08:45:47.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.753+0000 7f796dcd5640 1 Processor -- start 2023-12-22T08:45:47.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.754+0000 7f796dcd5640 1 -- start start 2023-12-22T08:45:47.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f796dcd5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79680b22c0 0x7f796815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f796dcd5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79680b26a0 0x7f7968163ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f796dcd5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79680cb830 0x7f7968164380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f796dcd5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79681648c0 con 0x7f79680b22c0 2023-12-22T08:45:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f796dcd5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7968163020 con 0x7f79680cb830 2023-12-22T08:45:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f796dcd5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7968164b40 con 0x7f79680b26a0 2023-12-22T08:45:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f79677fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79680b22c0 0x7f796815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f79677fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79680b22c0 0x7f796815ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47536/0 (socket says 172.21.15.38:47536) 2023-12-22T08:45:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f79677fe640 1 -- 172.21.15.38:0/3269938530 learned_addr learned my addr 172.21.15.38:0/3269938530 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f79677fe640 1 -- 172.21.15.38:0/3269938530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79680b26a0 msgr2=0x7f7968163ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f79677fe640 1 --2- 172.21.15.38:0/3269938530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79680b26a0 0x7f7968163ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f79677fe640 1 -- 172.21.15.38:0/3269938530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79680cb830 msgr2=0x7f7968164380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f79677fe640 1 --2- 172.21.15.38:0/3269938530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79680cb830 0x7f7968164380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.755+0000 7f79677fe640 1 -- 172.21.15.38:0/3269938530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960009a70 con 0x7f79680b22c0 2023-12-22T08:45:47.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.756+0000 7f79677fe640 1 --2- 172.21.15.38:0/3269938530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79680b22c0 0x7f796815ae70 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f795800d5f0 tx=0x7f795800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:47.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.756+0000 7f7964ff9640 1 -- 172.21.15.38:0/3269938530 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79580125f0 con 0x7f79680b22c0 2023-12-22T08:45:47.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.756+0000 7f7964ff9640 1 -- 172.21.15.38:0/3269938530 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7958012750 con 0x7f79680b22c0 2023-12-22T08:45:47.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.756+0000 7f7964ff9640 1 -- 172.21.15.38:0/3269938530 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958012b00 con 0x7f79680b22c0 2023-12-22T08:45:47.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.756+0000 7f796dcd5640 1 -- 172.21.15.38:0/3269938530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79681632c0 con 0x7f79680b22c0 2023-12-22T08:45:47.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.756+0000 7f796dcd5640 1 -- 172.21.15.38:0/3269938530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7968164e20 con 0x7f79680b22c0 2023-12-22T08:45:47.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.757+0000 7f796dcd5640 1 -- 172.21.15.38:0/3269938530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79680659a0 con 0x7f79680b22c0 2023-12-22T08:45:47.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.758+0000 7f7964ff9640 1 -- 172.21.15.38:0/3269938530 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7958012c60 con 0x7f79680b22c0 2023-12-22T08:45:47.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.759+0000 7f7964ff9640 1 --2- 172.21.15.38:0/3269938530 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f794806a430 0x7f794806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:47.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.759+0000 7f7964ff9640 1 -- 172.21.15.38:0/3269938530 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7958088e80 con 0x7f79680b22c0 2023-12-22T08:45:47.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.759+0000 7f7964ff9640 1 -- 172.21.15.38:0/3269938530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7f7948071f60 con 0x7f79680b22c0 2023-12-22T08:45:47.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.760+0000 7f795ffff640 1 --2- 172.21.15.38:0/3269938530 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f794806a430 0x7f794806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:47.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.761+0000 7f795ffff640 1 --2- 172.21.15.38:0/3269938530 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f794806a430 0x7f794806c8f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7950007fd0 tx=0x7f7950007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:47.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.763+0000 7f7964ff9640 1 -- 172.21.15.38:0/3269938530 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f79580543d0 con 0x7f79680b22c0 2023-12-22T08:45:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.962+0000 7f796dcd5640 1 -- 172.21.15.38:0/3269938530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79680ce3d0 con 0x7f79680b22c0 2023-12-22T08:45:47.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.963+0000 7f7964ff9640 1 -- 172.21.15.38:0/3269938530 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f79580579f0 con 0x7f79680b22c0 2023-12-22T08:45:47.965 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:45:47.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.965+0000 7f796dcd5640 1 -- 172.21.15.38:0/3269938530 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f794806a430 msgr2=0x7f794806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.965+0000 7f796dcd5640 1 --2- 172.21.15.38:0/3269938530 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f794806a430 0x7f794806c8f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7950007fd0 tx=0x7f7950007920 comp rx=0 tx=0).stop 2023-12-22T08:45:47.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.965+0000 7f796dcd5640 1 -- 172.21.15.38:0/3269938530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79680b22c0 msgr2=0x7f796815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:47.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.965+0000 7f796dcd5640 1 --2- 172.21.15.38:0/3269938530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79680b22c0 0x7f796815ae70 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f795800d5f0 tx=0x7f795800dab0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.965+0000 7f796dcd5640 1 -- 172.21.15.38:0/3269938530 shutdown_connections 2023-12-22T08:45:47.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.966+0000 7f796dcd5640 1 --2- 172.21.15.38:0/3269938530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79680cb830 0x7f7968164380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.966+0000 7f796dcd5640 1 --2- 172.21.15.38:0/3269938530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79680b26a0 0x7f7968163ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.966+0000 7f796dcd5640 1 --2- 172.21.15.38:0/3269938530 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f794806a430 0x7f794806c8f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.966+0000 7f796dcd5640 1 --2- 172.21.15.38:0/3269938530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79680b22c0 0x7f796815ae70 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:47.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.966+0000 7f796dcd5640 1 -- 172.21.15.38:0/3269938530 >> 172.21.15.38:0/3269938530 conn(0x7f79680cf070 msgr2=0x7f79680cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:47.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.966+0000 7f796dcd5640 1 -- 172.21.15.38:0/3269938530 shutdown_connections 2023-12-22T08:45:47.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:47.966+0000 7f796dcd5640 1 -- 172.21.15.38:0/3269938530 wait complete. 2023-12-22T08:45:47.987 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:45:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.212+0000 7fd700c4d640 1 Processor -- start 2023-12-22T08:45:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.213+0000 7fd700c4d640 1 -- start start 2023-12-22T08:45:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.214+0000 7fd700c4d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6fc15d1c0 0x7fd6fc070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.214+0000 7fd700c4d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6fc0d0770 0x7fd6fc070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.214+0000 7fd700c4d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc15de50 con 0x7fd6fc15d5a0 2023-12-22T08:45:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.214+0000 7fd700c4d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc0d0be0 con 0x7fd6fc0d0770 2023-12-22T08:45:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.214+0000 7fd700c4d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0d0dd0 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.215+0000 7fd6fbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6fc0d0770 0x7fd6fc070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.215+0000 7fd6fb7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6fc15d1c0 0x7fd6fc070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.215+0000 7fd6fbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6fc0d0770 0x7fd6fc070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47550/0 (socket says 172.21.15.38:47550) 2023-12-22T08:45:48.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.215+0000 7fd6fbfff640 1 -- 172.21.15.38:0/389600713 learned_addr learned my addr 172.21.15.38:0/389600713 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:48.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.215+0000 7fd6fbfff640 1 -- 172.21.15.38:0/389600713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6fc15d1c0 msgr2=0x7fd6fc070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:48.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.215+0000 7fd6fbfff640 1 --2- 172.21.15.38:0/389600713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6fc15d1c0 0x7fd6fc070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.215+0000 7fd6fbfff640 1 -- 172.21.15.38:0/389600713 >> v1:172.21.15.38:6789/0 conn(0x7fd6fc15d5a0 legacy=0x7fd6fc0d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:48.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.215+0000 7fd6fbfff640 1 -- 172.21.15.38:0/389600713 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0d10b0 con 0x7fd6fc0d0770 2023-12-22T08:45:48.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.216+0000 7fd6fbfff640 1 --2- 172.21.15.38:0/389600713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6fc0d0770 0x7fd6fc070eb0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009e50 tx=0x7fd6f402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2256b2124bcf48 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:48.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.217+0000 7fd6fa7fc640 1 -- 172.21.15.38:0/389600713 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f402caf0 con 0x7fd6fc0d0770 2023-12-22T08:45:48.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.217+0000 7fd6fa7fc640 1 -- 172.21.15.38:0/389600713 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f402cc50 con 0x7fd6fc0d0770 2023-12-22T08:45:48.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.217+0000 7fd6fa7fc640 1 -- 172.21.15.38:0/389600713 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40343f0 con 0x7fd6fc0d0770 2023-12-22T08:45:48.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.217+0000 7fd700c4d640 1 -- 172.21.15.38:0/389600713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6fc0d0770 msgr2=0x7fd6fc070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:48.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.217+0000 7fd700c4d640 1 --2- 172.21.15.38:0/389600713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6fc0d0770 0x7fd6fc070eb0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009e50 tx=0x7fd6f402bf50 comp rx=0 tx=0).stop 2023-12-22T08:45:48.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.217+0000 7fd700c4d640 1 -- 172.21.15.38:0/389600713 shutdown_connections 2023-12-22T08:45:48.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.217+0000 7fd700c4d640 1 --2- 172.21.15.38:0/389600713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6fc0d0770 0x7fd6fc070eb0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.217+0000 7fd700c4d640 1 --2- 172.21.15.38:0/389600713 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6fc15d1c0 0x7fd6fc070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.218+0000 7fd700c4d640 1 -- 172.21.15.38:0/389600713 >> 172.21.15.38:0/389600713 conn(0x7fd6fc06bf90 msgr2=0x7fd6fc06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:48.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.218+0000 7fd700c4d640 1 -- 172.21.15.38:0/389600713 shutdown_connections 2023-12-22T08:45:48.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.218+0000 7fd700c4d640 1 -- 172.21.15.38:0/389600713 wait complete. 2023-12-22T08:45:48.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.219+0000 7fd700c4d640 1 Processor -- start 2023-12-22T08:45:48.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.219+0000 7fd700c4d640 1 -- start start 2023-12-22T08:45:48.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.220+0000 7fd700c4d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6fc0d0770 0x7fd6fc0b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.220+0000 7fd700c4d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6fc15d1c0 0x7fd6fc145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.220+0000 7fd700c4d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6fc15d5a0 0x7fd6fc145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.220+0000 7fd700c4d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc1f2860 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.220+0000 7fd700c4d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc152ed0 con 0x7fd6fc15d5a0 2023-12-22T08:45:48.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.220+0000 7fd700c4d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc1531b0 con 0x7fd6fc0d0770 2023-12-22T08:45:48.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.221+0000 7fd6faffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6fc15d1c0 0x7fd6fc145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.221+0000 7fd6faffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6fc15d1c0 0x7fd6fc145ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47566/0 (socket says 172.21.15.38:47566) 2023-12-22T08:45:48.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.221+0000 7fd6faffd640 1 -- 172.21.15.38:0/3555802222 learned_addr learned my addr 172.21.15.38:0/3555802222 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.221+0000 7fd6fbfff640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6fc15d5a0 0x7fd6fc145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.221+0000 7fd6fb7fe640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6fc0d0770 0x7fd6fc0b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.221+0000 7fd6faffd640 1 -- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6fc0d0770 msgr2=0x7fd6fc0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.221+0000 7fd6faffd640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6fc0d0770 0x7fd6fc0b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.221+0000 7fd6faffd640 1 -- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6fc15d5a0 msgr2=0x7fd6fc145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.221+0000 7fd6faffd640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6fc15d5a0 0x7fd6fc145ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.221+0000 7fd6faffd640 1 -- 172.21.15.38:0/3555802222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f4009b30 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.222+0000 7fd6faffd640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6fc15d1c0 0x7fd6fc145ab0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000c400 tx=0x7fd6f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:48.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.222+0000 7fd6e3fff640 1 -- 172.21.15.38:0/3555802222 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00052d0 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.222+0000 7fd6e3fff640 1 -- 172.21.15.38:0/3555802222 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f0005430 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.222+0000 7fd6e3fff640 1 -- 172.21.15.38:0/3555802222 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0003830 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.222+0000 7fd700c4d640 1 -- 172.21.15.38:0/3555802222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc153490 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.222+0000 7fd700c4d640 1 -- 172.21.15.38:0/3555802222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc1e5b60 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.223+0000 7fd700c4d640 1 -- 172.21.15.38:0/3555802222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc15dac0 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.224+0000 7fd6e3fff640 1 -- 172.21.15.38:0/3555802222 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6f0003990 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.225+0000 7fd6e3fff640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6e806a430 0x7fd6e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.225+0000 7fd6e3fff640 1 -- 172.21.15.38:0/3555802222 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6f0087ff0 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.225+0000 7fd6e3fff640 1 -- 172.21.15.38:0/3555802222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7fd6e8071f60 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.226+0000 7fd6fb7fe640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6e806a430 0x7fd6e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.227+0000 7fd6fb7fe640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6e806a430 0x7fd6e806c8f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009a10 tx=0x7fd6ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:48.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.229+0000 7fd6e3fff640 1 -- 172.21.15.38:0/3555802222 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd6f0017020 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.426+0000 7fd700c4d640 1 -- 172.21.15.38:0/3555802222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6fc1539b0 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.427+0000 7fd6e3fff640 1 -- 172.21.15.38:0/3555802222 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6fc1539b0 con 0x7fd6fc15d1c0 2023-12-22T08:45:48.429 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:45:48.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.429+0000 7fd700c4d640 1 -- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6e806a430 msgr2=0x7fd6e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:48.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.429+0000 7fd700c4d640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6e806a430 0x7fd6e806c8f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009a10 tx=0x7fd6ec008040 comp rx=0 tx=0).stop 2023-12-22T08:45:48.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.429+0000 7fd700c4d640 1 -- 172.21.15.38:0/3555802222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6fc15d1c0 msgr2=0x7fd6fc145ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:48.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.429+0000 7fd700c4d640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6fc15d1c0 0x7fd6fc145ab0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000c400 tx=0x7fd6f000c8c0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.429+0000 7fd700c4d640 1 -- 172.21.15.38:0/3555802222 shutdown_connections 2023-12-22T08:45:48.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.429+0000 7fd700c4d640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6fc15d5a0 0x7fd6fc145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.429+0000 7fd700c4d640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6e806a430 0x7fd6e806c8f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.429+0000 7fd700c4d640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6fc15d1c0 0x7fd6fc145ab0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.429+0000 7fd700c4d640 1 --2- 172.21.15.38:0/3555802222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6fc0d0770 0x7fd6fc0b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.429+0000 7fd700c4d640 1 -- 172.21.15.38:0/3555802222 >> 172.21.15.38:0/3555802222 conn(0x7fd6fc06bf90 msgr2=0x7fd6fc0b9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:48.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.430+0000 7fd700c4d640 1 -- 172.21.15.38:0/3555802222 shutdown_connections 2023-12-22T08:45:48.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.430+0000 7fd700c4d640 1 -- 172.21.15.38:0/3555802222 wait complete. 2023-12-22T08:45:48.449 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:45:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.671+0000 7fb4bdd55640 1 Processor -- start 2023-12-22T08:45:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.672+0000 7fb4bdd55640 1 -- start start 2023-12-22T08:45:48.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.673+0000 7fb4bdd55640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb4b81547a0 0x7fb4b815b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.673+0000 7fb4bdd55640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b8154b80 0x7fb4b80ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.673+0000 7fb4bdd55640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b80716a0 con 0x7fb4b8071b90 2023-12-22T08:45:48.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.673+0000 7fb4bdd55640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b8070e80 con 0x7fb4b81547a0 2023-12-22T08:45:48.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.673+0000 7fb4bdd55640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b80710e0 con 0x7fb4b8154b80 2023-12-22T08:45:48.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.673+0000 7fb4affff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb4b8071b90 0x7fb4b8070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37774/0 (socket says 172.21.15.38:37774) 2023-12-22T08:45:48.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.673+0000 7fb4affff640 1 -- 172.21.15.38:0/1707009035 learned_addr learned my addr 172.21.15.38:0/1707009035 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:48.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b77fe640 1 --2- 172.21.15.38:0/1707009035 >> v2:172.21.15.89:3300/0 conn(0x7fb4b81547a0 0x7fb4b815b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b7fff640 1 --2- 172.21.15.38:0/1707009035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b8154b80 0x7fb4b80ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611541209 0 0) 0x7fb4b80716a0 con 0x7fb4b8071b90 2023-12-22T08:45:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a4003520 con 0x7fb4b8071b90 2023-12-22T08:45:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1340649879 0 0) 0x7fb4a4003520 con 0x7fb4b8071b90 2023-12-22T08:45:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b8154b80 msgr2=0x7fb4b80ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 --2- 172.21.15.38:0/1707009035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b8154b80 0x7fb4b80ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 >> v2:172.21.15.89:3300/0 conn(0x7fb4b81547a0 msgr2=0x7fb4b815b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 --2- 172.21.15.38:0/1707009035 >> v2:172.21.15.89:3300/0 conn(0x7fb4b81547a0 0x7fb4b815b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b80713c0 con 0x7fb4b8071b90 2023-12-22T08:45:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fb4a0001670 con 0x7fb4b8071b90 2023-12-22T08:45:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 >> v1:172.21.15.38:6789/0 conn(0x7fb4b8071b90 legacy=0x7fb4b8070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 --2- 172.21.15.38:0/1707009035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b8154b80 0x7fb4a4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 --2- 172.21.15.38:0/1707009035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4a4003ef0 0x7fb4a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 --2- 172.21.15.38:0/1707009035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4a4004d00 0x7fb4a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b8070e80 con 0x7fb4a4003ef0 2023-12-22T08:45:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.674+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b80710e0 con 0x7fb4a4004d00 2023-12-22T08:45:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.675+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a400db90 con 0x7fb4b8154b80 2023-12-22T08:45:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.675+0000 7fb4affff640 1 --2- 172.21.15.38:0/1707009035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4a4003ef0 0x7fb4a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.675+0000 7fb4b77fe640 1 --2- 172.21.15.38:0/1707009035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b8154b80 0x7fb4a4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.675+0000 7fb4b7fff640 1 --2- 172.21.15.38:0/1707009035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4a4004d00 0x7fb4a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.675+0000 7fb4affff640 1 -- 172.21.15.38:0/1707009035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b8154b80 msgr2=0x7fb4a4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.675+0000 7fb4affff640 1 --2- 172.21.15.38:0/1707009035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b8154b80 0x7fb4a4003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.675+0000 7fb4affff640 1 -- 172.21.15.38:0/1707009035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4a4004d00 msgr2=0x7fb4a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.675+0000 7fb4affff640 1 --2- 172.21.15.38:0/1707009035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4a4004d00 0x7fb4a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.675+0000 7fb4affff640 1 -- 172.21.15.38:0/1707009035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a4003520 con 0x7fb4a4003ef0 2023-12-22T08:45:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.675+0000 7fb4b7fff640 1 --2- 172.21.15.38:0/1707009035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4a4004d00 0x7fb4a4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:48.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.676+0000 7fb4affff640 1 --2- 172.21.15.38:0/1707009035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4a4003ef0 0x7fb4a40047c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000c210 tx=0x7fb4a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5facdc0c9c93ab7f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:48.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.677+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0005ad0 con 0x7fb4a4003ef0 2023-12-22T08:45:48.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.677+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a0005c30 con 0x7fb4a4003ef0 2023-12-22T08:45:48.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.677+0000 7fb4b6ffd640 1 -- 172.21.15.38:0/1707009035 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a002cae0 con 0x7fb4a4003ef0 2023-12-22T08:45:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.677+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1707009035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4a4003ef0 msgr2=0x7fb4a40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.677+0000 7fb4bdd55640 1 --2- 172.21.15.38:0/1707009035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4a4003ef0 0x7fb4a40047c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000c210 tx=0x7fb4a40057f0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.677+0000 7fb4b7fff640 1 -- 172.21.15.38:0/1707009035 reap_dead start 2023-12-22T08:45:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.678+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1707009035 shutdown_connections 2023-12-22T08:45:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.678+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1707009035 >> 172.21.15.38:0/1707009035 conn(0x7fb4b80cf070 msgr2=0x7fb4b80cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.678+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1707009035 shutdown_connections 2023-12-22T08:45:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.678+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1707009035 wait complete. 2023-12-22T08:45:48.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.680+0000 7fb4bdd55640 1 Processor -- start 2023-12-22T08:45:48.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.680+0000 7fb4bdd55640 1 -- start start 2023-12-22T08:45:48.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.681+0000 7fb4bdd55640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4a4003ef0 0x7fb4b80b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.681+0000 7fb4bdd55640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4b80cd540 0x7fb4b80b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.681+0000 7fb4bdd55640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b8151b60 0x7fb4b80aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.681+0000 7fb4bdd55640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b80b03e0 con 0x7fb4b80cd540 2023-12-22T08:45:48.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.681+0000 7fb4bdd55640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b81e5eb0 con 0x7fb4a4003ef0 2023-12-22T08:45:48.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.681+0000 7fb4bdd55640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b81e5610 con 0x7fb4b8151b60 2023-12-22T08:45:48.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.681+0000 7fb4affff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4b80cd540 0x7fb4b80b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.681+0000 7fb4affff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4b80cd540 0x7fb4b80b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47576/0 (socket says 172.21.15.38:47576) 2023-12-22T08:45:48.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.681+0000 7fb4affff640 1 -- 172.21.15.38:0/1174518774 learned_addr learned my addr 172.21.15.38:0/1174518774 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:48.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.681+0000 7fb4b77fe640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4a4003ef0 0x7fb4b80b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.681+0000 7fb4b7fff640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b8151b60 0x7fb4b80aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.682+0000 7fb4affff640 1 -- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b8151b60 msgr2=0x7fb4b80aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:48.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.682+0000 7fb4affff640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b8151b60 0x7fb4b80aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.682+0000 7fb4affff640 1 -- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4a4003ef0 msgr2=0x7fb4b80b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:48.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.682+0000 7fb4affff640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4a4003ef0 0x7fb4b80b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.682+0000 7fb4affff640 1 -- 172.21.15.38:0/1174518774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b81e58f0 con 0x7fb4b80cd540 2023-12-22T08:45:48.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.682+0000 7fb4affff640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4b80cd540 0x7fb4b80b2320 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb4a002c4c0 tx=0x7fb4a0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:48.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.682+0000 7fb4b4ff9640 1 -- 172.21.15.38:0/1174518774 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0039030 con 0x7fb4b80cd540 2023-12-22T08:45:48.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.682+0000 7fb4b4ff9640 1 -- 172.21.15.38:0/1174518774 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a002ccf0 con 0x7fb4b80cd540 2023-12-22T08:45:48.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.682+0000 7fb4b4ff9640 1 -- 172.21.15.38:0/1174518774 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a003c040 con 0x7fb4b80cd540 2023-12-22T08:45:48.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.682+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1174518774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b81e5bd0 con 0x7fb4b80cd540 2023-12-22T08:45:48.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.683+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1174518774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b8145de0 con 0x7fb4b80cd540 2023-12-22T08:45:48.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.684+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1174518774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b80b0520 con 0x7fb4b80cd540 2023-12-22T08:45:48.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.685+0000 7fb4b4ff9640 1 -- 172.21.15.38:0/1174518774 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb4a0032070 con 0x7fb4b80cd540 2023-12-22T08:45:48.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.686+0000 7fb4b4ff9640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb49806a460 0x7fb49806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:48.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.686+0000 7fb4b4ff9640 1 -- 172.21.15.38:0/1174518774 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4a00a9ca0 con 0x7fb4b80cd540 2023-12-22T08:45:48.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.686+0000 7fb4b4ff9640 1 -- 172.21.15.38:0/1174518774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7fb498071f90 con 0x7fb4b80cd540 2023-12-22T08:45:48.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.686+0000 7fb4b77fe640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb49806a460 0x7fb49806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:48.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.688+0000 7fb4b77fe640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb49806a460 0x7fb49806c920 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009a10 tx=0x7fb4a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:48.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.690+0000 7fb4b4ff9640 1 -- 172.21.15.38:0/1174518774 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb4b80b0520 con 0x7fb4b80cd540 2023-12-22T08:45:48.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.895+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1174518774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb4b80b0520 con 0x7fb4b80cd540 2023-12-22T08:45:48.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.896+0000 7fb4b4ff9640 1 -- 172.21.15.38:0/1174518774 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v93) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb4b80b0520 con 0x7fb4b80cd540 2023-12-22T08:45:48.898 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:45:48.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.898+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb49806a460 msgr2=0x7fb49806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:48.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.898+0000 7fb4bdd55640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb49806a460 0x7fb49806c920 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009a10 tx=0x7fb4a8008040 comp rx=0 tx=0).stop 2023-12-22T08:45:48.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.898+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1174518774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4b80cd540 msgr2=0x7fb4b80b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:48.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.898+0000 7fb4bdd55640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4b80cd540 0x7fb4b80b2320 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb4a002c4c0 tx=0x7fb4a0001a00 comp rx=0 tx=0).stop 2023-12-22T08:45:48.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.899+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1174518774 shutdown_connections 2023-12-22T08:45:48.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.899+0000 7fb4bdd55640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b8151b60 0x7fb4b80aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.899+0000 7fb4bdd55640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb49806a460 0x7fb49806c920 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.899+0000 7fb4bdd55640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4b80cd540 0x7fb4b80b2320 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.899+0000 7fb4bdd55640 1 --2- 172.21.15.38:0/1174518774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4a4003ef0 0x7fb4b80b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:48.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.899+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1174518774 >> 172.21.15.38:0/1174518774 conn(0x7fb4b80cf070 msgr2=0x7fb4b8153c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:48.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.899+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1174518774 shutdown_connections 2023-12-22T08:45:48.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:48.899+0000 7fb4bdd55640 1 -- 172.21.15.38:0/1174518774 wait complete. 2023-12-22T08:45:48.920 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T08:45:48.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:48.920 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-22T08:45:49.037 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:45:49.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:49.038 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T08:45:49.094 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:45:49.095 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:45:49.155 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:45:49.155 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:45:49.207 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:45:49.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.441+0000 7fd82bfff640 1 Processor -- start 2023-12-22T08:45:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.441+0000 7fd82bfff640 1 -- start start 2023-12-22T08:45:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.443+0000 7fd82bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd82c0b3e80 0x7fd82c15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.443+0000 7fd82bfff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82c0d0a10 con 0x7fd82c0ce170 2023-12-22T08:45:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.443+0000 7fd82bfff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82c0b43b0 con 0x7fd82c144e60 2023-12-22T08:45:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.443+0000 7fd82bfff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82c15b930 con 0x7fd82c0b3e80 2023-12-22T08:45:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.443+0000 7fd82affd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd82c0ce170 0x7fd82c144750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37782/0 (socket says 172.21.15.38:37782) 2023-12-22T08:45:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.443+0000 7fd82affd640 1 -- 172.21.15.38:0/3266210180 learned_addr learned my addr 172.21.15.38:0/3266210180 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:49.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.443+0000 7fd82b7fe640 1 --2- 172.21.15.38:0/3266210180 >> v2:172.21.15.38:3300/0 conn(0x7fd82c0b3e80 0x7fd82c15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:49.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.443+0000 7fd829ffb640 1 -- 172.21.15.38:0/3266210180 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362237782 0 0) 0x7fd82c0d0a10 con 0x7fd82c0ce170 2023-12-22T08:45:49.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.443+0000 7fd829ffb640 1 -- 172.21.15.38:0/3266210180 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd818003520 con 0x7fd82c0ce170 2023-12-22T08:45:49.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.443+0000 7fd82b7fe640 1 -- 172.21.15.38:0/3266210180 >> v1:172.21.15.89:6789/0 conn(0x7fd82c144e60 legacy=0x7fd82c0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:49.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.444+0000 7fd82b7fe640 1 -- 172.21.15.38:0/3266210180 >> v1:172.21.15.38:6789/0 conn(0x7fd82c0ce170 legacy=0x7fd82c144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:49.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.444+0000 7fd82b7fe640 1 -- 172.21.15.38:0/3266210180 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c15bb10 con 0x7fd82c0b3e80 2023-12-22T08:45:49.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.445+0000 7fd82b7fe640 1 --2- 172.21.15.38:0/3266210180 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0b3e80 0x7fd82c15c5f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd8240097a0 tx=0x7fd82402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377da311d4c4156c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.445+0000 7fd829ffb640 1 -- 172.21.15.38:0/3266210180 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824031830 con 0x7fd82c0b3e80 2023-12-22T08:45:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.445+0000 7fd829ffb640 1 -- 172.21.15.38:0/3266210180 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd824031990 con 0x7fd82c0b3e80 2023-12-22T08:45:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.445+0000 7fd829ffb640 1 -- 172.21.15.38:0/3266210180 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824031d20 con 0x7fd82c0b3e80 2023-12-22T08:45:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.446+0000 7fd82bfff640 1 -- 172.21.15.38:0/3266210180 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0b3e80 msgr2=0x7fd82c15c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.446+0000 7fd82bfff640 1 --2- 172.21.15.38:0/3266210180 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0b3e80 0x7fd82c15c5f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd8240097a0 tx=0x7fd82402b8d0 comp rx=0 tx=0).stop 2023-12-22T08:45:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.446+0000 7fd82bfff640 1 -- 172.21.15.38:0/3266210180 shutdown_connections 2023-12-22T08:45:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.446+0000 7fd82bfff640 1 --2- 172.21.15.38:0/3266210180 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0b3e80 0x7fd82c15c5f0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.446+0000 7fd82bfff640 1 -- 172.21.15.38:0/3266210180 >> 172.21.15.38:0/3266210180 conn(0x7fd82c0d14b0 msgr2=0x7fd82c0d18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.446+0000 7fd82bfff640 1 -- 172.21.15.38:0/3266210180 shutdown_connections 2023-12-22T08:45:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.446+0000 7fd82bfff640 1 -- 172.21.15.38:0/3266210180 wait complete. 2023-12-22T08:45:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.448+0000 7fd82bfff640 1 Processor -- start 2023-12-22T08:45:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.448+0000 7fd82bfff640 1 -- start start 2023-12-22T08:45:49.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.449+0000 7fd82bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82c0b3e80 0x7fd82c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:49.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.449+0000 7fd82bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0ce170 0x7fd82c1e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:49.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.449+0000 7fd82bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd82c144e60 0x7fd82c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:49.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.449+0000 7fd82bfff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c1e3c00 con 0x7fd82c0ce170 2023-12-22T08:45:49.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.449+0000 7fd82bfff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c06b140 con 0x7fd82c0b3e80 2023-12-22T08:45:49.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.449+0000 7fd82bfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c06b420 con 0x7fd82c144e60 2023-12-22T08:45:49.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.449+0000 7fd82a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0ce170 0x7fd82c1e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:49.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.449+0000 7fd82a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0ce170 0x7fd82c1e7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47582/0 (socket says 172.21.15.38:47582) 2023-12-22T08:45:49.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.449+0000 7fd82a7fc640 1 -- 172.21.15.38:0/748040736 learned_addr learned my addr 172.21.15.38:0/748040736 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:49.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.450+0000 7fd82b7fe640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd82c144e60 0x7fd82c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.450+0000 7fd82affd640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82c0b3e80 0x7fd82c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.450+0000 7fd82a7fc640 1 -- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd82c144e60 msgr2=0x7fd82c15ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.450+0000 7fd82a7fc640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd82c144e60 0x7fd82c15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.450+0000 7fd82a7fc640 1 -- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82c0b3e80 msgr2=0x7fd82c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.450+0000 7fd82a7fc640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82c0b3e80 0x7fd82c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.450+0000 7fd82a7fc640 1 -- 172.21.15.38:0/748040736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd824009400 con 0x7fd82c0ce170 2023-12-22T08:45:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.450+0000 7fd82affd640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82c0b3e80 0x7fd82c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:49.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.450+0000 7fd82a7fc640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0ce170 0x7fd82c1e7860 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd81400ba50 tx=0x7fd81400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:49.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.450+0000 7fd8237fe640 1 -- 172.21.15.38:0/748040736 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81400cbe0 con 0x7fd82c0ce170 2023-12-22T08:45:49.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.450+0000 7fd8237fe640 1 -- 172.21.15.38:0/748040736 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81400cd80 con 0x7fd82c0ce170 2023-12-22T08:45:49.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.450+0000 7fd8237fe640 1 -- 172.21.15.38:0/748040736 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814014680 con 0x7fd82c0ce170 2023-12-22T08:45:49.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.450+0000 7fd82bfff640 1 -- 172.21.15.38:0/748040736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82c06b700 con 0x7fd82c0ce170 2023-12-22T08:45:49.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.451+0000 7fd82bfff640 1 -- 172.21.15.38:0/748040736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82c1e7da0 con 0x7fd82c0ce170 2023-12-22T08:45:49.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.452+0000 7fd82bfff640 1 -- 172.21.15.38:0/748040736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82c1e3db0 con 0x7fd82c0ce170 2023-12-22T08:45:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.452+0000 7fd8237fe640 1 -- 172.21.15.38:0/748040736 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd8140147e0 con 0x7fd82c0ce170 2023-12-22T08:45:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.453+0000 7fd8237fe640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd80c06a430 0x7fd80c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.453+0000 7fd8237fe640 1 -- 172.21.15.38:0/748040736 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd814088840 con 0x7fd82c0ce170 2023-12-22T08:45:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.454+0000 7fd8237fe640 1 -- 172.21.15.38:0/748040736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7fd80c071f60 con 0x7fd82c0ce170 2023-12-22T08:45:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.454+0000 7fd82affd640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd80c06a430 0x7fd80c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:49.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.455+0000 7fd82affd640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd80c06a430 0x7fd80c06c8f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0011e0 tx=0x7fd81c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:49.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.458+0000 7fd8237fe640 1 -- 172.21.15.38:0/748040736 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd814019060 con 0x7fd82c0ce170 2023-12-22T08:45:49.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.651+0000 7fd82bfff640 1 -- 172.21.15.38:0/748040736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd82c061910 con 0x7fd82c0ce170 2023-12-22T08:45:49.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.654+0000 7fd8237fe640 1 -- 172.21.15.38:0/748040736 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16081 (secure 0 0 0) 0x7fd82c1e3db0 con 0x7fd82c0ce170 2023-12-22T08:45:49.656 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:49.656 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":93,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:45:23.330914+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:44:53.802762+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-22T08:44:54.948144+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:45:49.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.656+0000 7fd82bfff640 1 -- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd80c06a430 msgr2=0x7fd80c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.656+0000 7fd82bfff640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd80c06a430 0x7fd80c06c8f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0011e0 tx=0x7fd81c009040 comp rx=0 tx=0).stop 2023-12-22T08:45:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.656+0000 7fd82bfff640 1 -- 172.21.15.38:0/748040736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0ce170 msgr2=0x7fd82c1e7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.656+0000 7fd82bfff640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0ce170 0x7fd82c1e7860 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd81400ba50 tx=0x7fd81400bf10 comp rx=0 tx=0).stop 2023-12-22T08:45:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.657+0000 7fd82bfff640 1 -- 172.21.15.38:0/748040736 shutdown_connections 2023-12-22T08:45:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.657+0000 7fd82bfff640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd82c144e60 0x7fd82c15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.657+0000 7fd82bfff640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd80c06a430 0x7fd80c06c8f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:49.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.657+0000 7fd82bfff640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd82c0ce170 0x7fd82c1e7860 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:49.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.657+0000 7fd82bfff640 1 --2- 172.21.15.38:0/748040736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82c0b3e80 0x7fd82c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:49.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.657+0000 7fd82bfff640 1 -- 172.21.15.38:0/748040736 >> 172.21.15.38:0/748040736 conn(0x7fd82c0d14b0 msgr2=0x7fd82c0cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:49.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.657+0000 7fd82bfff640 1 -- 172.21.15.38:0/748040736 shutdown_connections 2023-12-22T08:45:49.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.657+0000 7fd82bfff640 1 -- 172.21.15.38:0/748040736 wait complete. 2023-12-22T08:45:49.679 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:44:53.802762+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:44:54.948144+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:45:49.680 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:45:49.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.899+0000 7fe4996cc640 1 Processor -- start 2023-12-22T08:45:49.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.899+0000 7fe4996cc640 1 -- start start 2023-12-22T08:45:49.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.901+0000 7fe4996cc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe49415d1c0 0x7fe494070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:49.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.901+0000 7fe4996cc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe49415d5a0 0x7fe494070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:49.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.901+0000 7fe4996cc640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49415de50 con 0x7fe4940d0060 2023-12-22T08:45:49.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.901+0000 7fe4996cc640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4940d0be0 con 0x7fe49415d1c0 2023-12-22T08:45:49.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.901+0000 7fe4996cc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940d0dd0 con 0x7fe49415d5a0 2023-12-22T08:45:49.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.902+0000 7fe493fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe49415d1c0 0x7fe494070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:49.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.902+0000 7fe4937fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe49415d5a0 0x7fe494070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:49.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.902+0000 7fe493fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe49415d1c0 0x7fe494070970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:46518/0 (socket says 172.21.15.38:46518) 2023-12-22T08:45:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.902+0000 7fe493fff640 1 -- 172.21.15.38:0/1872741014 learned_addr learned my addr 172.21.15.38:0/1872741014 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.902+0000 7fe493fff640 1 -- 172.21.15.38:0/1872741014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe49415d5a0 msgr2=0x7fe494070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.902+0000 7fe493fff640 1 --2- 172.21.15.38:0/1872741014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe49415d5a0 0x7fe494070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.903+0000 7fe493fff640 1 -- 172.21.15.38:0/1872741014 >> v1:172.21.15.89:6789/0 conn(0x7fe4940d0060 legacy=0x7fe4940d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.903+0000 7fe493fff640 1 -- 172.21.15.38:0/1872741014 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940d10b0 con 0x7fe49415d1c0 2023-12-22T08:45:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.903+0000 7fe492ffd640 1 -- 172.21.15.38:0/1872741014 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886270248 0 0) 0x7fe49415de50 con 0x7fe4940d0060 2023-12-22T08:45:49.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.903+0000 7fe4937fe640 1 --2- 172.21.15.38:0/1872741014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe49415d5a0 0x7fe494070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:45:49.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.904+0000 7fe493fff640 1 --2- 172.21.15.38:0/1872741014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe49415d1c0 0x7fe494070970 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe484009870 tx=0x7fe48402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90d1bfb631bdecb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:49.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.904+0000 7fe492ffd640 1 -- 172.21.15.38:0/1872741014 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484030840 con 0x7fe49415d1c0 2023-12-22T08:45:49.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.905+0000 7fe492ffd640 1 -- 172.21.15.38:0/1872741014 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4840309a0 con 0x7fe49415d1c0 2023-12-22T08:45:49.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.905+0000 7fe492ffd640 1 -- 172.21.15.38:0/1872741014 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484030d30 con 0x7fe49415d1c0 2023-12-22T08:45:49.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.905+0000 7fe4996cc640 1 -- 172.21.15.38:0/1872741014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe49415d1c0 msgr2=0x7fe494070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:49.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.905+0000 7fe4996cc640 1 --2- 172.21.15.38:0/1872741014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe49415d1c0 0x7fe494070970 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe484009870 tx=0x7fe48402b980 comp rx=0 tx=0).stop 2023-12-22T08:45:49.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.905+0000 7fe4996cc640 1 -- 172.21.15.38:0/1872741014 shutdown_connections 2023-12-22T08:45:49.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.905+0000 7fe4996cc640 1 --2- 172.21.15.38:0/1872741014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe49415d5a0 0x7fe494070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:49.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.905+0000 7fe4996cc640 1 --2- 172.21.15.38:0/1872741014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe49415d1c0 0x7fe494070970 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:49.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.905+0000 7fe4996cc640 1 -- 172.21.15.38:0/1872741014 >> 172.21.15.38:0/1872741014 conn(0x7fe49406bf90 msgr2=0x7fe49406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:49.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.905+0000 7fe4996cc640 1 -- 172.21.15.38:0/1872741014 shutdown_connections 2023-12-22T08:45:49.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.905+0000 7fe4996cc640 1 -- 172.21.15.38:0/1872741014 wait complete. 2023-12-22T08:45:49.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.907+0000 7fe4996cc640 1 Processor -- start 2023-12-22T08:45:49.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.907+0000 7fe4996cc640 1 -- start start 2023-12-22T08:45:49.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.908+0000 7fe4996cc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4940d0060 0x7fe4940b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:49.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.908+0000 7fe4996cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe49415d1c0 0x7fe4940b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:49.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.908+0000 7fe4996cc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49415d5a0 0x7fe4940b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:49.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.908+0000 7fe4996cc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940b8900 con 0x7fe49415d5a0 2023-12-22T08:45:49.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.908+0000 7fe4996cc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415a4b0 con 0x7fe49415d1c0 2023-12-22T08:45:49.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.908+0000 7fe4996cc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415a790 con 0x7fe4940d0060 2023-12-22T08:45:49.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.909+0000 7fe498ecb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49415d5a0 0x7fe4940b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:49.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.909+0000 7fe498ecb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49415d5a0 0x7fe4940b5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47592/0 (socket says 172.21.15.38:47592) 2023-12-22T08:45:49.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.909+0000 7fe498ecb640 1 -- 172.21.15.38:0/2060864238 learned_addr learned my addr 172.21.15.38:0/2060864238 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:49.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.909+0000 7fe4937fe640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe49415d1c0 0x7fe4940b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:49.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.909+0000 7fe493fff640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4940d0060 0x7fe4940b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:49.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.909+0000 7fe498ecb640 1 -- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4940d0060 msgr2=0x7fe4940b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:49.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.909+0000 7fe498ecb640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4940d0060 0x7fe4940b83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:49.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.909+0000 7fe498ecb640 1 -- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe49415d1c0 msgr2=0x7fe4940b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:49.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.909+0000 7fe498ecb640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe49415d1c0 0x7fe4940b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:49.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.909+0000 7fe498ecb640 1 -- 172.21.15.38:0/2060864238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe488009400 con 0x7fe49415d5a0 2023-12-22T08:45:49.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.910+0000 7fe498ecb640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49415d5a0 0x7fe4940b5fb0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe48c001560 tx=0x7fe48c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:49.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.910+0000 7fe490ff9640 1 -- 172.21.15.38:0/2060864238 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c003da0 con 0x7fe49415d5a0 2023-12-22T08:45:49.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.910+0000 7fe490ff9640 1 -- 172.21.15.38:0/2060864238 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c005070 con 0x7fe49415d5a0 2023-12-22T08:45:49.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.910+0000 7fe490ff9640 1 -- 172.21.15.38:0/2060864238 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c005420 con 0x7fe49415d5a0 2023-12-22T08:45:49.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.910+0000 7fe4996cc640 1 -- 172.21.15.38:0/2060864238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4840094d0 con 0x7fe49415d5a0 2023-12-22T08:45:49.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.910+0000 7fe4996cc640 1 -- 172.21.15.38:0/2060864238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49415ad50 con 0x7fe49415d5a0 2023-12-22T08:45:49.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.911+0000 7fe4996cc640 1 -- 172.21.15.38:0/2060864238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe494061910 con 0x7fe49415d5a0 2023-12-22T08:45:49.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.912+0000 7fe490ff9640 1 -- 172.21.15.38:0/2060864238 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe48c005580 con 0x7fe49415d5a0 2023-12-22T08:45:49.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.914+0000 7fe490ff9640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe48006a430 0x7fe48006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:49.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.914+0000 7fe490ff9640 1 -- 172.21.15.38:0/2060864238 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe48c0881d0 con 0x7fe49415d5a0 2023-12-22T08:45:49.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.914+0000 7fe490ff9640 1 -- 172.21.15.38:0/2060864238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7fe480071f60 con 0x7fe49415d5a0 2023-12-22T08:45:49.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.914+0000 7fe493fff640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe48006a430 0x7fe48006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:49.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.916+0000 7fe493fff640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe48006a430 0x7fe48006c8f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe484036000 tx=0x7fe48403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:49.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:49.918+0000 7fe490ff9640 1 -- 172.21.15.38:0/2060864238 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe48c017060 con 0x7fe49415d5a0 2023-12-22T08:45:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.176+0000 7fe4996cc640 1 -- 172.21.15.38:0/2060864238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4940b4b30 con 0x7fe49415d5a0 2023-12-22T08:45:50.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.177+0000 7fe490ff9640 1 -- 172.21.15.38:0/2060864238 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe48c0537b0 con 0x7fe49415d5a0 2023-12-22T08:45:50.179 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:45:50.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.181+0000 7fe4996cc640 1 -- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe48006a430 msgr2=0x7fe48006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:50.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.181+0000 7fe4996cc640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe48006a430 0x7fe48006c8f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe484036000 tx=0x7fe48403b040 comp rx=0 tx=0).stop 2023-12-22T08:45:50.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.181+0000 7fe4996cc640 1 -- 172.21.15.38:0/2060864238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49415d5a0 msgr2=0x7fe4940b5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:50.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.181+0000 7fe4996cc640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49415d5a0 0x7fe4940b5fb0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe48c001560 tx=0x7fe48c00cc70 comp rx=0 tx=0).stop 2023-12-22T08:45:50.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.181+0000 7fe4996cc640 1 -- 172.21.15.38:0/2060864238 shutdown_connections 2023-12-22T08:45:50.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.181+0000 7fe4996cc640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe48006a430 0x7fe48006c8f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.181+0000 7fe4996cc640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe49415d5a0 0x7fe4940b5fb0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.181+0000 7fe4996cc640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe49415d1c0 0x7fe4940b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.181+0000 7fe4996cc640 1 --2- 172.21.15.38:0/2060864238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4940d0060 0x7fe4940b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.181+0000 7fe4996cc640 1 -- 172.21.15.38:0/2060864238 >> 172.21.15.38:0/2060864238 conn(0x7fe49406bf90 msgr2=0x7fe4940cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:50.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.182+0000 7fe4996cc640 1 -- 172.21.15.38:0/2060864238 shutdown_connections 2023-12-22T08:45:50.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.182+0000 7fe4996cc640 1 -- 172.21.15.38:0/2060864238 wait complete. 2023-12-22T08:45:50.210 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:45:50.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.407+0000 7f79809df640 1 Processor -- start 2023-12-22T08:45:50.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.408+0000 7f79809df640 1 -- start start 2023-12-22T08:45:50.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.409+0000 7f79809df640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f797c15b0e0 0x7f797c15b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.409+0000 7f79809df640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c15edf0 con 0x7f797c09c980 2023-12-22T08:45:50.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.409+0000 7f79809df640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c15bd90 con 0x7f797c071460 2023-12-22T08:45:50.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.409+0000 7f79809df640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c15d0d0 con 0x7f797c15b0e0 2023-12-22T08:45:50.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.409+0000 7f7973fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f797c09c980 0x7f797c15c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37792/0 (socket says 172.21.15.38:37792) 2023-12-22T08:45:50.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.409+0000 7f7973fff640 1 -- 172.21.15.38:0/4228257022 learned_addr learned my addr 172.21.15.38:0/4228257022 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:50.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439407792 0 0) 0x7f797c15edf0 con 0x7f797c09c980 2023-12-22T08:45:50.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7968003520 con 0x7f797c09c980 2023-12-22T08:45:50.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797b7fe640 1 --2- 172.21.15.38:0/4228257022 >> v2:172.21.15.89:3300/0 conn(0x7f797c15b0e0 0x7f797c15b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 555430345 0 0) 0x7f7968003520 con 0x7f797c09c980 2023-12-22T08:45:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 >> v2:172.21.15.89:3300/0 conn(0x7f797c15b0e0 msgr2=0x7f797c15b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 --2- 172.21.15.38:0/4228257022 >> v2:172.21.15.89:3300/0 conn(0x7f797c15b0e0 0x7f797c15b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 >> v1:172.21.15.89:6789/0 conn(0x7f797c071460 legacy=0x7f797c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c15c070 con 0x7f797c09c980 2023-12-22T08:45:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f7964001670 con 0x7f797c09c980 2023-12-22T08:45:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797b7fe640 1 --2- 172.21.15.38:0/4228257022 >> v2:172.21.15.89:3300/0 conn(0x7f797c15b0e0 0x7f797c15b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:45:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 >> v1:172.21.15.38:6789/0 conn(0x7f797c09c980 legacy=0x7f797c15c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:50.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 --2- 172.21.15.38:0/4228257022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7968003970 0x7f7968003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 --2- 172.21.15.38:0/4228257022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79680047c0 0x7f7968004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 --2- 172.21.15.38:0/4228257022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7968005380 0x7f796800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c15d0d0 con 0x7f7968005380 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.410+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796800c210 con 0x7f79680047c0 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.411+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796800c3d0 con 0x7f7968003970 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.411+0000 7f797bfff640 1 --2- 172.21.15.38:0/4228257022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7968005380 0x7f796800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.411+0000 7f7973fff640 1 --2- 172.21.15.38:0/4228257022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79680047c0 0x7f7968004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.411+0000 7f797b7fe640 1 --2- 172.21.15.38:0/4228257022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7968003970 0x7f7968003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.411+0000 7f797bfff640 1 -- 172.21.15.38:0/4228257022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7968003970 msgr2=0x7f7968003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.411+0000 7f797bfff640 1 --2- 172.21.15.38:0/4228257022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7968003970 0x7f7968003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.411+0000 7f797bfff640 1 -- 172.21.15.38:0/4228257022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79680047c0 msgr2=0x7f7968004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.411+0000 7f797bfff640 1 --2- 172.21.15.38:0/4228257022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79680047c0 0x7f7968004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.411+0000 7f797bfff640 1 -- 172.21.15.38:0/4228257022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7968003520 con 0x7f7968005380 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.412+0000 7f797bfff640 1 -- 172.21.15.38:0/4228257022 reap_dead start 2023-12-22T08:45:50.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.412+0000 7f797bfff640 1 --2- 172.21.15.38:0/4228257022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7968005380 0x7f796800b980 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f7974001e50 tx=0x7f79680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24dc4dbd63b4646 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:50.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.413+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974003b70 con 0x7f7968005380 2023-12-22T08:45:50.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.413+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974003d10 con 0x7f7968005380 2023-12-22T08:45:50.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.413+0000 7f797affd640 1 -- 172.21.15.38:0/4228257022 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974005310 con 0x7f7968005380 2023-12-22T08:45:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.413+0000 7f79809df640 1 -- 172.21.15.38:0/4228257022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7968005380 msgr2=0x7f796800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.413+0000 7f79809df640 1 --2- 172.21.15.38:0/4228257022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7968005380 0x7f796800b980 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f7974001e50 tx=0x7f79680057f0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.413+0000 7f79809df640 1 -- 172.21.15.38:0/4228257022 shutdown_connections 2023-12-22T08:45:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.413+0000 7f79809df640 1 --2- 172.21.15.38:0/4228257022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7968005380 0x7f796800b980 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.413+0000 7f79809df640 1 -- 172.21.15.38:0/4228257022 >> 172.21.15.38:0/4228257022 conn(0x7f797c0cf000 msgr2=0x7f797c0cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.413+0000 7f79809df640 1 -- 172.21.15.38:0/4228257022 shutdown_connections 2023-12-22T08:45:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.414+0000 7f79809df640 1 -- 172.21.15.38:0/4228257022 wait complete. 2023-12-22T08:45:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.415+0000 7f79809df640 1 Processor -- start 2023-12-22T08:45:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.415+0000 7f79809df640 1 -- start start 2023-12-22T08:45:50.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.416+0000 7f79809df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7968005380 0x7f797c1f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.416+0000 7f79809df640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f797c1f5b10 0x7f797c1e4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.416+0000 7f79809df640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f797c1e71b0 0x7f797c15f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.416+0000 7f79809df640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c1588c0 con 0x7f797c1f5b10 2023-12-22T08:45:50.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.416+0000 7f79809df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c1f6fd0 con 0x7f7968005380 2023-12-22T08:45:50.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.416+0000 7f79809df640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c1e7760 con 0x7f797c1e71b0 2023-12-22T08:45:50.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.417+0000 7f7973fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f797c1f5b10 0x7f797c1e4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.417+0000 7f7973fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f797c1f5b10 0x7f797c1e4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47616/0 (socket says 172.21.15.38:47616) 2023-12-22T08:45:50.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.417+0000 7f7973fff640 1 -- 172.21.15.38:0/2501616012 learned_addr learned my addr 172.21.15.38:0/2501616012 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:50.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.417+0000 7f797bfff640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f797c1e71b0 0x7f797c15f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.417+0000 7f797b7fe640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7968005380 0x7f797c1f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.417+0000 7f7973fff640 1 -- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f797c1e71b0 msgr2=0x7f797c15f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:50.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.417+0000 7f7973fff640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f797c1e71b0 0x7f797c15f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.417+0000 7f7973fff640 1 -- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7968005380 msgr2=0x7f797c1f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:50.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.417+0000 7f7973fff640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7968005380 0x7f797c1f6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.417+0000 7f7973fff640 1 -- 172.21.15.38:0/2501616012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c1e7a40 con 0x7f797c1f5b10 2023-12-22T08:45:50.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.417+0000 7f7973fff640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f797c1f5b10 0x7f797c1e4c50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f79640010e0 tx=0x7f796400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:50.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.418+0000 7f7978ff9640 1 -- 172.21.15.38:0/2501616012 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400ee60 con 0x7f797c1f5b10 2023-12-22T08:45:50.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.418+0000 7f7978ff9640 1 -- 172.21.15.38:0/2501616012 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796400c870 con 0x7f797c1f5b10 2023-12-22T08:45:50.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.418+0000 7f7978ff9640 1 -- 172.21.15.38:0/2501616012 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400cc20 con 0x7f797c1f5b10 2023-12-22T08:45:50.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.418+0000 7f79809df640 1 -- 172.21.15.38:0/2501616012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c0a2e80 con 0x7f797c1f5b10 2023-12-22T08:45:50.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.418+0000 7f79809df640 1 -- 172.21.15.38:0/2501616012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c0a3440 con 0x7f797c1f5b10 2023-12-22T08:45:50.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.419+0000 7f79809df640 1 -- 172.21.15.38:0/2501616012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c0a2ce0 con 0x7f797c1f5b10 2023-12-22T08:45:50.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.420+0000 7f7978ff9640 1 -- 172.21.15.38:0/2501616012 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f796401d460 con 0x7f797c1f5b10 2023-12-22T08:45:50.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.421+0000 7f7978ff9640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f795c06a430 0x7f795c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.421+0000 7f7978ff9640 1 -- 172.21.15.38:0/2501616012 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f79640888c0 con 0x7f797c1f5b10 2023-12-22T08:45:50.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.421+0000 7f7978ff9640 1 -- 172.21.15.38:0/2501616012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f795c072080 con 0x7f797c1f5b10 2023-12-22T08:45:50.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.421+0000 7f797b7fe640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f795c06a430 0x7f795c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.423+0000 7f797b7fe640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f795c06a430 0x7f795c06c8f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f796c006fd0 tx=0x7f796c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:50.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.425+0000 7f7978ff9640 1 -- 172.21.15.38:0/2501616012 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f797c0a2ce0 con 0x7f797c1f5b10 2023-12-22T08:45:50.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.620+0000 7f79809df640 1 -- 172.21.15.38:0/2501616012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f797c0a2ce0 con 0x7f797c1f5b10 2023-12-22T08:45:50.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.621+0000 7f7978ff9640 1 -- 172.21.15.38:0/2501616012 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f797c0a2ce0 con 0x7f797c1f5b10 2023-12-22T08:45:50.623 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:45:50.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.624+0000 7f79809df640 1 -- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f795c06a430 msgr2=0x7f795c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:50.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.624+0000 7f79809df640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f795c06a430 0x7f795c06c8f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f796c006fd0 tx=0x7f796c008040 comp rx=0 tx=0).stop 2023-12-22T08:45:50.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.624+0000 7f79809df640 1 -- 172.21.15.38:0/2501616012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f797c1f5b10 msgr2=0x7f797c1e4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:50.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.624+0000 7f79809df640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f797c1f5b10 0x7f797c1e4c50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f79640010e0 tx=0x7f796400ec10 comp rx=0 tx=0).stop 2023-12-22T08:45:50.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.624+0000 7f79809df640 1 -- 172.21.15.38:0/2501616012 shutdown_connections 2023-12-22T08:45:50.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.624+0000 7f79809df640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f797c1e71b0 0x7f797c15f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.624+0000 7f79809df640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f795c06a430 0x7f795c06c8f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.624+0000 7f79809df640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f797c1f5b10 0x7f797c1e4c50 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.624+0000 7f79809df640 1 --2- 172.21.15.38:0/2501616012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7968005380 0x7f797c1f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.624+0000 7f79809df640 1 -- 172.21.15.38:0/2501616012 >> 172.21.15.38:0/2501616012 conn(0x7f797c0cf000 msgr2=0x7f797c065a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:50.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.624+0000 7f79809df640 1 -- 172.21.15.38:0/2501616012 shutdown_connections 2023-12-22T08:45:50.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.624+0000 7f79809df640 1 -- 172.21.15.38:0/2501616012 wait complete. 2023-12-22T08:45:50.644 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:45:50.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.869+0000 7f8f9f59e640 1 Processor -- start 2023-12-22T08:45:50.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.869+0000 7f8f9f59e640 1 -- start start 2023-12-22T08:45:50.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.871+0000 7f8f9f59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8fa0070b70 0x7f8fa006bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.871+0000 7f8f9f59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8fa0071660 0x7f8fa0164d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.871+0000 7f8f9f59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa006d5f0 con 0x7f8fa006c4d0 2023-12-22T08:45:50.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.871+0000 7f8f9f59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa0144fa0 con 0x7f8fa0071660 2023-12-22T08:45:50.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.871+0000 7f8f9f59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa006da80 con 0x7f8fa0070b70 2023-12-22T08:45:50.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.871+0000 7f8f9ed9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8fa0071660 0x7f8fa0164d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.871+0000 7f8f9dd9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8fa006c4d0 0x7f8fa0070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37798/0 (socket says 172.21.15.38:37798) 2023-12-22T08:45:50.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.871+0000 7f8f9dd9b640 1 -- 172.21.15.38:0/451198049 learned_addr learned my addr 172.21.15.38:0/451198049 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:50.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.872+0000 7f8f9e59c640 1 --2- 172.21.15.38:0/451198049 >> v2:172.21.15.89:3300/0 conn(0x7f8fa0070b70 0x7f8fa006bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.872+0000 7f8f9ed9d640 1 -- 172.21.15.38:0/451198049 >> v2:172.21.15.89:3300/0 conn(0x7f8fa0070b70 msgr2=0x7f8fa006bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:50.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.872+0000 7f8f9ed9d640 1 --2- 172.21.15.38:0/451198049 >> v2:172.21.15.89:3300/0 conn(0x7f8fa0070b70 0x7f8fa006bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.872+0000 7f8f9ed9d640 1 -- 172.21.15.38:0/451198049 >> v1:172.21.15.38:6789/0 conn(0x7f8fa006c4d0 legacy=0x7f8fa0070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:50.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.872+0000 7f8f9ed9d640 1 -- 172.21.15.38:0/451198049 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa006c9e0 con 0x7f8fa0071660 2023-12-22T08:45:50.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.873+0000 7f8f9ed9d640 1 --2- 172.21.15.38:0/451198049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fa0071660 0x7f8fa0164d50 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00b1c60 tx=0x7f8f9802bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb7e4da1d4454bf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:50.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.874+0000 7f8f9d59a640 1 -- 172.21.15.38:0/451198049 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9802ca30 con 0x7f8fa0071660 2023-12-22T08:45:50.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.874+0000 7f8f9d59a640 1 -- 172.21.15.38:0/451198049 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9802cb90 con 0x7f8fa0071660 2023-12-22T08:45:50.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.874+0000 7f8f9d59a640 1 -- 172.21.15.38:0/451198049 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f98034440 con 0x7f8fa0071660 2023-12-22T08:45:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.874+0000 7f8f9f59e640 1 -- 172.21.15.38:0/451198049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fa0071660 msgr2=0x7f8fa0164d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.874+0000 7f8f9f59e640 1 --2- 172.21.15.38:0/451198049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fa0071660 0x7f8fa0164d50 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00b1c60 tx=0x7f8f9802bd00 comp rx=0 tx=0).stop 2023-12-22T08:45:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.874+0000 7f8f9f59e640 1 -- 172.21.15.38:0/451198049 shutdown_connections 2023-12-22T08:45:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.874+0000 7f8f9f59e640 1 --2- 172.21.15.38:0/451198049 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fa0071660 0x7f8fa0164d50 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.874+0000 7f8f9f59e640 1 --2- 172.21.15.38:0/451198049 >> v2:172.21.15.89:3300/0 conn(0x7f8fa0070b70 0x7f8fa006bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.874+0000 7f8f9f59e640 1 -- 172.21.15.38:0/451198049 >> 172.21.15.38:0/451198049 conn(0x7f8fa00b0b60 msgr2=0x7f8fa00b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.874+0000 7f8f9f59e640 1 -- 172.21.15.38:0/451198049 shutdown_connections 2023-12-22T08:45:50.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.874+0000 7f8f9f59e640 1 -- 172.21.15.38:0/451198049 wait complete. 2023-12-22T08:45:50.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.876+0000 7f8f9f59e640 1 Processor -- start 2023-12-22T08:45:50.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.876+0000 7f8f9f59e640 1 -- start start 2023-12-22T08:45:50.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.877+0000 7f8f9f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fa006c4d0 0x7f8fa01e2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.877+0000 7f8f9f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fa0070b70 0x7f8fa015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.877+0000 7f8f9f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fa0071660 0x7f8fa015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.877+0000 7f8f9f59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa009a160 con 0x7f8fa006c4d0 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.877+0000 7f8f9f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa01e4e80 con 0x7f8fa0070b70 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.877+0000 7f8f9f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa01e5160 con 0x7f8fa0071660 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.877+0000 7f8f9e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fa006c4d0 0x7f8fa01e2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.878+0000 7f8f9e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fa006c4d0 0x7f8fa01e2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47628/0 (socket says 172.21.15.38:47628) 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.878+0000 7f8f9e59c640 1 -- 172.21.15.38:0/3028786852 learned_addr learned my addr 172.21.15.38:0/3028786852 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.878+0000 7f8f9dd9b640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fa0070b70 0x7f8fa015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.878+0000 7f8f9ed9d640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fa0071660 0x7f8fa015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.878+0000 7f8f9e59c640 1 -- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fa0071660 msgr2=0x7f8fa015afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.878+0000 7f8f9e59c640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fa0071660 0x7f8fa015afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.878+0000 7f8f9e59c640 1 -- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fa0070b70 msgr2=0x7f8fa015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.878+0000 7f8f9e59c640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fa0070b70 0x7f8fa015aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:50.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.878+0000 7f8f9e59c640 1 -- 172.21.15.38:0/3028786852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f98009a70 con 0x7f8fa006c4d0 2023-12-22T08:45:50.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.878+0000 7f8f9ed9d640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fa0071660 0x7f8fa015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:50.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.878+0000 7f8f9dd9b640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fa0070b70 0x7f8fa015aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:50.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.878+0000 7f8f9e59c640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fa006c4d0 0x7f8fa01e2aa0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000d800 tx=0x7f8f9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:50.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.879+0000 7f8f8effd640 1 -- 172.21.15.38:0/3028786852 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9000b6c0 con 0x7f8fa006c4d0 2023-12-22T08:45:50.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.879+0000 7f8f8effd640 1 -- 172.21.15.38:0/3028786852 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9000b820 con 0x7f8fa006c4d0 2023-12-22T08:45:50.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.879+0000 7f8f8effd640 1 -- 172.21.15.38:0/3028786852 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9000bbb0 con 0x7f8fa006c4d0 2023-12-22T08:45:50.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.879+0000 7f8f9f59e640 1 -- 172.21.15.38:0/3028786852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa0099b10 con 0x7f8fa006c4d0 2023-12-22T08:45:50.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.879+0000 7f8f9f59e640 1 -- 172.21.15.38:0/3028786852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa01e2fe0 con 0x7f8fa006c4d0 2023-12-22T08:45:50.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.880+0000 7f8f9f59e640 1 -- 172.21.15.38:0/3028786852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa01e3170 con 0x7f8fa006c4d0 2023-12-22T08:45:50.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.881+0000 7f8f8effd640 1 -- 172.21.15.38:0/3028786852 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f9000bd10 con 0x7f8fa006c4d0 2023-12-22T08:45:50.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.882+0000 7f8f8effd640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f8006a430 0x7f8f8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:50.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.882+0000 7f8f8effd640 1 -- 172.21.15.38:0/3028786852 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f8f90088ed0 con 0x7f8fa006c4d0 2023-12-22T08:45:50.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.883+0000 7f8f8effd640 1 -- 172.21.15.38:0/3028786852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f8f80072080 con 0x7f8fa006c4d0 2023-12-22T08:45:50.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.883+0000 7f8f9dd9b640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f8006a430 0x7f8f8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:50.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.884+0000 7f8f9dd9b640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f8006a430 0x7f8f8006c8f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8fa01449b0 tx=0x7f8f94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:50.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:50.887+0000 7f8f8effd640 1 -- 172.21.15.38:0/3028786852 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8f90054450 con 0x7f8fa006c4d0 2023-12-22T08:45:51.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.073+0000 7f8f9f59e640 1 -- 172.21.15.38:0/3028786852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8fa0061910 con 0x7f8fa006c4d0 2023-12-22T08:45:51.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.074+0000 7f8f8effd640 1 -- 172.21.15.38:0/3028786852 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f90057a70 con 0x7f8fa006c4d0 2023-12-22T08:45:51.075 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:45:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.076+0000 7f8f9f59e640 1 -- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f8006a430 msgr2=0x7f8f8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.076+0000 7f8f9f59e640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f8006a430 0x7f8f8006c8f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8fa01449b0 tx=0x7f8f94009040 comp rx=0 tx=0).stop 2023-12-22T08:45:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.076+0000 7f8f9f59e640 1 -- 172.21.15.38:0/3028786852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fa006c4d0 msgr2=0x7f8fa01e2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.076+0000 7f8f9f59e640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fa006c4d0 0x7f8fa01e2aa0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000d800 tx=0x7f8f9000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.076+0000 7f8f9f59e640 1 -- 172.21.15.38:0/3028786852 shutdown_connections 2023-12-22T08:45:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.076+0000 7f8f9f59e640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fa0071660 0x7f8fa015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.076+0000 7f8f9f59e640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fa0070b70 0x7f8fa015aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.076+0000 7f8f9f59e640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f8006a430 0x7f8f8006c8f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.076+0000 7f8f9f59e640 1 --2- 172.21.15.38:0/3028786852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fa006c4d0 0x7f8fa01e2aa0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.076+0000 7f8f9f59e640 1 -- 172.21.15.38:0/3028786852 >> 172.21.15.38:0/3028786852 conn(0x7f8fa00b0b60 msgr2=0x7f8fa00afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.077+0000 7f8f9f59e640 1 -- 172.21.15.38:0/3028786852 shutdown_connections 2023-12-22T08:45:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.077+0000 7f8f9f59e640 1 -- 172.21.15.38:0/3028786852 wait complete. 2023-12-22T08:45:51.096 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:45:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.321+0000 7ff37f59e640 1 Processor -- start 2023-12-22T08:45:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.322+0000 7ff37f59e640 1 -- start start 2023-12-22T08:45:51.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.324+0000 7ff37f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff38015b310 0x7ff38006f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:51.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.325+0000 7ff37f59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff38015e1e0 0x7ff3801670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:51.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.325+0000 7ff37f59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3800a1ac0 con 0x7ff38006f790 2023-12-22T08:45:51.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.325+0000 7ff37f59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38006c6c0 con 0x7ff38015e1e0 2023-12-22T08:45:51.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.325+0000 7ff37f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38006db60 con 0x7ff38015b310 2023-12-22T08:45:51.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.325+0000 7ff37ed9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff38015e1e0 0x7ff3801670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:51.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.325+0000 7ff37ed9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff38015e1e0 0x7ff3801670f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33192/0 (socket says 172.21.15.38:33192) 2023-12-22T08:45:51.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.325+0000 7ff37ed9d640 1 -- 172.21.15.38:0/3484380761 learned_addr learned my addr 172.21.15.38:0/3484380761 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:51.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.325+0000 7ff37e59c640 1 --2- 172.21.15.38:0/3484380761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff38015b310 0x7ff38006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:51.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.325+0000 7ff37ed9d640 1 -- 172.21.15.38:0/3484380761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff38015b310 msgr2=0x7ff38006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:51.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.325+0000 7ff37ed9d640 1 --2- 172.21.15.38:0/3484380761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff38015b310 0x7ff38006f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.325+0000 7ff37ed9d640 1 -- 172.21.15.38:0/3484380761 >> v1:172.21.15.89:6789/0 conn(0x7ff38006f790 legacy=0x7ff38015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:51.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.325+0000 7ff37ed9d640 1 -- 172.21.15.38:0/3484380761 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3800a4450 con 0x7ff38015e1e0 2023-12-22T08:45:51.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.327+0000 7ff37ed9d640 1 --2- 172.21.15.38:0/3484380761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff38015e1e0 0x7ff3801670f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff378009e50 tx=0x7ff37802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8218d63850d1341 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:51.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.334+0000 7ff37d59a640 1 -- 172.21.15.38:0/3484380761 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37802ca70 con 0x7ff38015e1e0 2023-12-22T08:45:51.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.335+0000 7ff37d59a640 1 -- 172.21.15.38:0/3484380761 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37802cbd0 con 0x7ff38015e1e0 2023-12-22T08:45:51.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.335+0000 7ff37d59a640 1 -- 172.21.15.38:0/3484380761 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3780343f0 con 0x7ff38015e1e0 2023-12-22T08:45:51.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.335+0000 7ff37f59e640 1 -- 172.21.15.38:0/3484380761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff38015e1e0 msgr2=0x7ff3801670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:51.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.335+0000 7ff37f59e640 1 --2- 172.21.15.38:0/3484380761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff38015e1e0 0x7ff3801670f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff378009e50 tx=0x7ff37802bed0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.336+0000 7ff37f59e640 1 -- 172.21.15.38:0/3484380761 shutdown_connections 2023-12-22T08:45:51.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.336+0000 7ff37f59e640 1 --2- 172.21.15.38:0/3484380761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff38015e1e0 0x7ff3801670f0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.336+0000 7ff37f59e640 1 --2- 172.21.15.38:0/3484380761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff38015b310 0x7ff38006f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.336+0000 7ff37f59e640 1 -- 172.21.15.38:0/3484380761 >> 172.21.15.38:0/3484380761 conn(0x7ff3800cf000 msgr2=0x7ff3800cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:51.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.336+0000 7ff37f59e640 1 -- 172.21.15.38:0/3484380761 shutdown_connections 2023-12-22T08:45:51.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.336+0000 7ff37f59e640 1 -- 172.21.15.38:0/3484380761 wait complete. 2023-12-22T08:45:51.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.338+0000 7ff37f59e640 1 Processor -- start 2023-12-22T08:45:51.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.338+0000 7ff37f59e640 1 -- start start 2023-12-22T08:45:51.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.339+0000 7ff37f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff38006f790 0x7ff3800cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:51.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.339+0000 7ff37f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff38015b310 0x7ff3800cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:51.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.339+0000 7ff37f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff38015e1e0 0x7ff380152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:51.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.339+0000 7ff37f59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3801553f0 con 0x7ff38015e1e0 2023-12-22T08:45:51.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.339+0000 7ff37f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff380154ac0 con 0x7ff38006f790 2023-12-22T08:45:51.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.339+0000 7ff37f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff380154da0 con 0x7ff38015b310 2023-12-22T08:45:51.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.340+0000 7ff37ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff38015e1e0 0x7ff380152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:51.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.340+0000 7ff37ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff38015e1e0 0x7ff380152310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33200/0 (socket says 172.21.15.38:33200) 2023-12-22T08:45:51.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.340+0000 7ff37ed9d640 1 -- 172.21.15.38:0/3289472828 learned_addr learned my addr 172.21.15.38:0/3289472828 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:51.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.340+0000 7ff37dd9b640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff38015b310 0x7ff3800cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:51.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.340+0000 7ff37e59c640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff38006f790 0x7ff3800cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:51.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.340+0000 7ff37ed9d640 1 -- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff38015b310 msgr2=0x7ff3800cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:51.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.340+0000 7ff37ed9d640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff38015b310 0x7ff3800cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.340+0000 7ff37ed9d640 1 -- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff38006f790 msgr2=0x7ff3800cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:51.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.340+0000 7ff37ed9d640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff38006f790 0x7ff3800cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.340+0000 7ff37ed9d640 1 -- 172.21.15.38:0/3289472828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378009b30 con 0x7ff38015e1e0 2023-12-22T08:45:51.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.341+0000 7ff37ed9d640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff38015e1e0 0x7ff380152310 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff378009e50 tx=0x7ff378004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.341+0000 7ff36effd640 1 -- 172.21.15.38:0/3289472828 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37803e450 con 0x7ff38015e1e0 2023-12-22T08:45:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.341+0000 7ff36effd640 1 -- 172.21.15.38:0/3289472828 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37803e5d0 con 0x7ff38015e1e0 2023-12-22T08:45:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.341+0000 7ff36effd640 1 -- 172.21.15.38:0/3289472828 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37803e980 con 0x7ff38015e1e0 2023-12-22T08:45:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.341+0000 7ff37f59e640 1 -- 172.21.15.38:0/3289472828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff380155080 con 0x7ff38015e1e0 2023-12-22T08:45:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.341+0000 7ff37f59e640 1 -- 172.21.15.38:0/3289472828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3800cba90 con 0x7ff38015e1e0 2023-12-22T08:45:51.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.342+0000 7ff37f59e640 1 -- 172.21.15.38:0/3289472828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3801555a0 con 0x7ff38015e1e0 2023-12-22T08:45:51.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.343+0000 7ff36effd640 1 -- 172.21.15.38:0/3289472828 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff37803eae0 con 0x7ff38015e1e0 2023-12-22T08:45:51.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.344+0000 7ff36effd640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff36006a460 0x7ff36006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:51.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.344+0000 7ff36effd640 1 -- 172.21.15.38:0/3289472828 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5796+0+0 (secure 0 0 0) 0x7ff3780ab680 con 0x7ff38015e1e0 2023-12-22T08:45:51.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.344+0000 7ff36effd640 1 -- 172.21.15.38:0/3289472828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=96}) v3 -- 0x7ff3600720b0 con 0x7ff38015e1e0 2023-12-22T08:45:51.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.345+0000 7ff37e59c640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff36006a460 0x7ff36006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:51.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.346+0000 7ff37e59c640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff36006a460 0x7ff36006c920 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff37000a970 tx=0x7ff370008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:51.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.349+0000 7ff36effd640 1 -- 172.21.15.38:0/3289472828 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff3801555a0 con 0x7ff38015e1e0 2023-12-22T08:45:51.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.558+0000 7ff37f59e640 1 -- 172.21.15.38:0/3289472828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff3800cf910 con 0x7ff38015e1e0 2023-12-22T08:45:51.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.558+0000 7ff36effd640 1 -- 172.21.15.38:0/3289472828 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v95) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff378076c00 con 0x7ff38015e1e0 2023-12-22T08:45:51.560 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:45:51.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.561+0000 7ff37f59e640 1 -- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff36006a460 msgr2=0x7ff36006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:51.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.561+0000 7ff37f59e640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff36006a460 0x7ff36006c920 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff37000a970 tx=0x7ff370008040 comp rx=0 tx=0).stop 2023-12-22T08:45:51.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.561+0000 7ff37f59e640 1 -- 172.21.15.38:0/3289472828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff38015e1e0 msgr2=0x7ff380152310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:51.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.561+0000 7ff37f59e640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff38015e1e0 0x7ff380152310 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff378009e50 tx=0x7ff378004a40 comp rx=0 tx=0).stop 2023-12-22T08:45:51.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.561+0000 7ff37f59e640 1 -- 172.21.15.38:0/3289472828 shutdown_connections 2023-12-22T08:45:51.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.561+0000 7ff37f59e640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff36006a460 0x7ff36006c920 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.561+0000 7ff37f59e640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff38015e1e0 0x7ff380152310 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.561+0000 7ff37f59e640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff38015b310 0x7ff3800cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.561+0000 7ff37f59e640 1 --2- 172.21.15.38:0/3289472828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff38006f790 0x7ff3800cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:51.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.561+0000 7ff37f59e640 1 -- 172.21.15.38:0/3289472828 >> 172.21.15.38:0/3289472828 conn(0x7ff3800cf000 msgr2=0x7ff3800ade10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:51.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.561+0000 7ff37f59e640 1 -- 172.21.15.38:0/3289472828 shutdown_connections 2023-12-22T08:45:51.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:51.562+0000 7ff37f59e640 1 -- 172.21.15.38:0/3289472828 wait complete. 2023-12-22T08:45:51.583 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T08:45:51.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:51.583 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-22T08:45:51.699 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:45:51.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:45:51.699 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T08:45:51.753 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:45:51.753 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:45:51.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:45:51.815 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:45:51.816 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:45:51.875 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:45:51.875 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:45:52.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.107+0000 7ff9a0c57640 1 Processor -- start 2023-12-22T08:45:52.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.107+0000 7ff9a0c57640 1 -- start start 2023-12-22T08:45:52.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.108+0000 7ff9a0c57640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff99c15b420 0x7ff99c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:52.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.108+0000 7ff9a0c57640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c0a44a0 0x7ff99c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:52.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.109+0000 7ff9a0c57640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99c0cdae0 con 0x7ff99c070e30 2023-12-22T08:45:52.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.109+0000 7ff9a0c57640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c071260 con 0x7ff99c15b420 2023-12-22T08:45:52.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.109+0000 7ff9a0c57640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c06dec0 con 0x7ff99c0a44a0 2023-12-22T08:45:52.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.109+0000 7ff99bfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff99c070e30 0x7ff99c06f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33948/0 (socket says 172.21.15.38:33948) 2023-12-22T08:45:52.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.109+0000 7ff99bfff640 1 -- 172.21.15.38:0/83898518 learned_addr learned my addr 172.21.15.38:0/83898518 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:52.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.109+0000 7ff99b7fe640 1 --2- 172.21.15.38:0/83898518 >> v2:172.21.15.38:3300/0 conn(0x7ff99c15b420 0x7ff99c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:52.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.109+0000 7ff99affd640 1 --2- 172.21.15.38:0/83898518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c0a44a0 0x7ff99c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:52.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.109+0000 7ff99a7fc640 1 -- 172.21.15.38:0/83898518 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952271032 0 0) 0x7ff99c0cdae0 con 0x7ff99c070e30 2023-12-22T08:45:52.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.109+0000 7ff99a7fc640 1 -- 172.21.15.38:0/83898518 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff984003520 con 0x7ff99c070e30 2023-12-22T08:45:52.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.110+0000 7ff99b7fe640 1 -- 172.21.15.38:0/83898518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c0a44a0 msgr2=0x7ff99c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:52.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.110+0000 7ff99b7fe640 1 --2- 172.21.15.38:0/83898518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c0a44a0 0x7ff99c0708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.110+0000 7ff99b7fe640 1 -- 172.21.15.38:0/83898518 >> v1:172.21.15.38:6789/0 conn(0x7ff99c070e30 legacy=0x7ff99c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:52.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.110+0000 7ff99b7fe640 1 -- 172.21.15.38:0/83898518 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c15b800 con 0x7ff99c15b420 2023-12-22T08:45:52.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.111+0000 7ff99b7fe640 1 --2- 172.21.15.38:0/83898518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff99c15b420 0x7ff99c06d980 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0097a0 tx=0x7ff98c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5584aa939f5d57 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:52.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.111+0000 7ff99a7fc640 1 -- 172.21.15.38:0/83898518 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c031830 con 0x7ff99c15b420 2023-12-22T08:45:52.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.111+0000 7ff99a7fc640 1 -- 172.21.15.38:0/83898518 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c031990 con 0x7ff99c15b420 2023-12-22T08:45:52.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.111+0000 7ff99a7fc640 1 -- 172.21.15.38:0/83898518 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c031d20 con 0x7ff99c15b420 2023-12-22T08:45:52.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.112+0000 7ff9a0c57640 1 -- 172.21.15.38:0/83898518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff99c15b420 msgr2=0x7ff99c06d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:52.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.112+0000 7ff9a0c57640 1 --2- 172.21.15.38:0/83898518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff99c15b420 0x7ff99c06d980 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0097a0 tx=0x7ff98c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.112+0000 7ff9a0c57640 1 -- 172.21.15.38:0/83898518 shutdown_connections 2023-12-22T08:45:52.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.112+0000 7ff9a0c57640 1 --2- 172.21.15.38:0/83898518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c0a44a0 0x7ff99c0708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.112+0000 7ff9a0c57640 1 --2- 172.21.15.38:0/83898518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff99c15b420 0x7ff99c06d980 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.112+0000 7ff9a0c57640 1 -- 172.21.15.38:0/83898518 >> 172.21.15.38:0/83898518 conn(0x7ff99c0b1f70 msgr2=0x7ff99c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:52.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.112+0000 7ff9a0c57640 1 -- 172.21.15.38:0/83898518 shutdown_connections 2023-12-22T08:45:52.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.112+0000 7ff9a0c57640 1 -- 172.21.15.38:0/83898518 wait complete. 2023-12-22T08:45:52.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.115+0000 7ff9a0c57640 1 Processor -- start 2023-12-22T08:45:52.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.115+0000 7ff9a0c57640 1 -- start start 2023-12-22T08:45:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.116+0000 7ff9a0c57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff99c070e30 0x7ff99c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.116+0000 7ff9a0c57640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c0a44a0 0x7ff99c150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.116+0000 7ff9a0c57640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff99c15b420 0x7ff99c151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.116+0000 7ff9a0c57640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c156110 con 0x7ff99c15b420 2023-12-22T08:45:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.116+0000 7ff9a0c57640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c1563f0 con 0x7ff99c070e30 2023-12-22T08:45:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.116+0000 7ff9a0c57640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c1566d0 con 0x7ff99c0a44a0 2023-12-22T08:45:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.117+0000 7ff99bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff99c15b420 0x7ff99c151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.117+0000 7ff99bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff99c15b420 0x7ff99c151440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33216/0 (socket says 172.21.15.38:33216) 2023-12-22T08:45:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.117+0000 7ff99bfff640 1 -- 172.21.15.38:0/235853835 learned_addr learned my addr 172.21.15.38:0/235853835 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.117+0000 7ff99affd640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c0a44a0 0x7ff99c150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.117+0000 7ff99b7fe640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff99c070e30 0x7ff99c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.117+0000 7ff99bfff640 1 -- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c0a44a0 msgr2=0x7ff99c150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:52.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.117+0000 7ff99bfff640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c0a44a0 0x7ff99c150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.117+0000 7ff99bfff640 1 -- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff99c070e30 msgr2=0x7ff99c0a3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:52.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.117+0000 7ff99bfff640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff99c070e30 0x7ff99c0a3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.117+0000 7ff99bfff640 1 -- 172.21.15.38:0/235853835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c009400 con 0x7ff99c15b420 2023-12-22T08:45:52.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.117+0000 7ff99bfff640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff99c15b420 0x7ff99c151440 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff99400caa0 tx=0x7ff99400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:52.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.118+0000 7ff983fff640 1 -- 172.21.15.38:0/235853835 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99400ac00 con 0x7ff99c15b420 2023-12-22T08:45:52.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.118+0000 7ff983fff640 1 -- 172.21.15.38:0/235853835 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99400ad60 con 0x7ff99c15b420 2023-12-22T08:45:52.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.118+0000 7ff983fff640 1 -- 172.21.15.38:0/235853835 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994012620 con 0x7ff99c15b420 2023-12-22T08:45:52.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.118+0000 7ff9a0c57640 1 -- 172.21.15.38:0/235853835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99c1569b0 con 0x7ff99c15b420 2023-12-22T08:45:52.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.118+0000 7ff9a0c57640 1 -- 172.21.15.38:0/235853835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c0a3ec0 con 0x7ff99c15b420 2023-12-22T08:45:52.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.119+0000 7ff9a0c57640 1 -- 172.21.15.38:0/235853835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99c0a40b0 con 0x7ff99c15b420 2023-12-22T08:45:52.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.120+0000 7ff983fff640 1 -- 172.21.15.38:0/235853835 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff994007070 con 0x7ff99c15b420 2023-12-22T08:45:52.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.121+0000 7ff983fff640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff98806a430 0x7ff98806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:52.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.121+0000 7ff983fff640 1 -- 172.21.15.38:0/235853835 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5796+0+0 (secure 0 0 0) 0x7ff994088970 con 0x7ff99c15b420 2023-12-22T08:45:52.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.121+0000 7ff983fff640 1 -- 172.21.15.38:0/235853835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=96}) v3 -- 0x7ff988072080 con 0x7ff99c15b420 2023-12-22T08:45:52.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.122+0000 7ff99b7fe640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff98806a430 0x7ff98806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:52.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.123+0000 7ff99b7fe640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff98806a430 0x7ff98806c8f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff98c036000 tx=0x7ff98c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:52.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.125+0000 7ff983fff640 1 -- 172.21.15.38:0/235853835 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff994017020 con 0x7ff99c15b420 2023-12-22T08:45:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.347+0000 7ff983fff640 1 -- 172.21.15.38:0/235853835 <== mon.0 v2:172.21.15.38:3300/0 7 ==== osd_map(96..96 src has 1..96) v4 ==== 320+0+0 (secure 0 0 0) 0x7ff9940582c0 con 0x7ff99c15b420 2023-12-22T08:45:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.347+0000 7ff983fff640 1 -- 172.21.15.38:0/235853835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7ff988072930 con 0x7ff99c15b420 2023-12-22T08:45:52.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.364+0000 7ff9a0c57640 1 -- 172.21.15.38:0/235853835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff99c156ed0 con 0x7ff99c15b420 2023-12-22T08:45:52.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.365+0000 7ff983fff640 1 -- 172.21.15.38:0/235853835 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4650 (secure 0 0 0) 0x7ff99c156ed0 con 0x7ff99c15b420 2023-12-22T08:45:52.367 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:52.367 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2128001687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2128001687},{"type":"v1","addr":"172.21.15.89:6837","nonce":2128001687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6438,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1632983842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1632983842},{"type":"v1","addr":"172.21.15.38:6833","nonce":1632983842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6444,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2613790013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2613790013},{"type":"v1","addr":"172.21.15.38:6835","nonce":2613790013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:44:55.928210+0000","modified":"2023-12-22T08:44:59.439959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6447},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6447":{"gid":6447,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2576950091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2576950091},{"type":"v1","addr":"172.21.15.89:6836","nonce":2576950091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-22T08:45:52.367 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 40 2023-12-22T08:45:52.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.368+0000 7ff9a0c57640 1 -- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff98806a430 msgr2=0x7ff98806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:52.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.368+0000 7ff9a0c57640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff98806a430 0x7ff98806c8f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff98c036000 tx=0x7ff98c03c040 comp rx=0 tx=0).stop 2023-12-22T08:45:52.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.368+0000 7ff9a0c57640 1 -- 172.21.15.38:0/235853835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff99c15b420 msgr2=0x7ff99c151440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:52.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.368+0000 7ff9a0c57640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff99c15b420 0x7ff99c151440 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff99400caa0 tx=0x7ff99400cf60 comp rx=0 tx=0).stop 2023-12-22T08:45:52.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.368+0000 7ff9a0c57640 1 -- 172.21.15.38:0/235853835 shutdown_connections 2023-12-22T08:45:52.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.368+0000 7ff9a0c57640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff98806a430 0x7ff98806c8f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.368+0000 7ff9a0c57640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff99c15b420 0x7ff99c151440 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.368+0000 7ff9a0c57640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c0a44a0 0x7ff99c150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.368+0000 7ff9a0c57640 1 --2- 172.21.15.38:0/235853835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff99c070e30 0x7ff99c0a3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.368+0000 7ff9a0c57640 1 -- 172.21.15.38:0/235853835 >> 172.21.15.38:0/235853835 conn(0x7ff99c0b1f70 msgr2=0x7ff99c06d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:52.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.368+0000 7ff9a0c57640 1 -- 172.21.15.38:0/235853835 shutdown_connections 2023-12-22T08:45:52.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.368+0000 7ff9a0c57640 1 -- 172.21.15.38:0/235853835 wait complete. 2023-12-22T08:45:52.387 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:45:52.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.616+0000 7fbc172b6640 1 Processor -- start 2023-12-22T08:45:52.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.616+0000 7fbc172b6640 1 -- start start 2023-12-22T08:45:52.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.618+0000 7fbc172b6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc100cb4c0 0x7fbc1015e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.618+0000 7fbc172b6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbc1006d5f0 0x7fbc10070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.618+0000 7fbc172b6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc100706d0 con 0x7fbc1006d210 2023-12-22T08:45:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.618+0000 7fbc172b6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc100cbf40 con 0x7fbc100cb4c0 2023-12-22T08:45:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.618+0000 7fbc172b6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc100ce840 con 0x7fbc1006d5f0 2023-12-22T08:45:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.618+0000 7fbc15ab3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc100cb4c0 0x7fbc1015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.618+0000 7fbc15ab3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbc100cb4c0 0x7fbc1015e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33228/0 (socket says 172.21.15.38:33228) 2023-12-22T08:45:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.618+0000 7fbc15ab3640 1 -- 172.21.15.38:0/3366269068 learned_addr learned my addr 172.21.15.38:0/3366269068 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.618+0000 7fbc162b4640 1 --1- 172.21.15.38:0/3366269068 >> v1:172.21.15.38:6789/0 conn(0x7fbc1006d210 0x7fbc10159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33964/0 (socket says 172.21.15.38:33964) 2023-12-22T08:45:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.619+0000 7fbc16ab5640 1 --2- 172.21.15.38:0/3366269068 >> v2:172.21.15.89:3300/0 conn(0x7fbc1006d5f0 0x7fbc10070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.619+0000 7fbc15ab3640 1 -- 172.21.15.38:0/3366269068 >> v2:172.21.15.89:3300/0 conn(0x7fbc1006d5f0 msgr2=0x7fbc10070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:52.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.619+0000 7fbc15ab3640 1 --2- 172.21.15.38:0/3366269068 >> v2:172.21.15.89:3300/0 conn(0x7fbc1006d5f0 0x7fbc10070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.619+0000 7fbc15ab3640 1 -- 172.21.15.38:0/3366269068 >> v1:172.21.15.38:6789/0 conn(0x7fbc1006d210 legacy=0x7fbc10159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:52.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.619+0000 7fbc15ab3640 1 -- 172.21.15.38:0/3366269068 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc100ceb20 con 0x7fbc100cb4c0 2023-12-22T08:45:52.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.619+0000 7fbc152b2640 1 -- 172.21.15.38:0/3366269068 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469016669 0 0) 0x7fbc100706d0 con 0x7fbc1006d210 2023-12-22T08:45:52.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.619+0000 7fbc16ab5640 1 --2- 172.21.15.38:0/3366269068 >> v2:172.21.15.89:3300/0 conn(0x7fbc1006d5f0 0x7fbc10070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.620+0000 7fbc15ab3640 1 --2- 172.21.15.38:0/3366269068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc100cb4c0 0x7fbc1015e830 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fbc100b1f00 tx=0x7fbc0002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e921c1f82a07baf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.620+0000 7fbc152b2640 1 -- 172.21.15.38:0/3366269068 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00030860 con 0x7fbc100cb4c0 2023-12-22T08:45:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.621+0000 7fbc152b2640 1 -- 172.21.15.38:0/3366269068 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc000309c0 con 0x7fbc100cb4c0 2023-12-22T08:45:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.621+0000 7fbc152b2640 1 -- 172.21.15.38:0/3366269068 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00030d50 con 0x7fbc100cb4c0 2023-12-22T08:45:52.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.621+0000 7fbc172b6640 1 -- 172.21.15.38:0/3366269068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc100cb4c0 msgr2=0x7fbc1015e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:52.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.621+0000 7fbc172b6640 1 --2- 172.21.15.38:0/3366269068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc100cb4c0 0x7fbc1015e830 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fbc100b1f00 tx=0x7fbc0002b9a0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.621+0000 7fbc172b6640 1 -- 172.21.15.38:0/3366269068 shutdown_connections 2023-12-22T08:45:52.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.621+0000 7fbc172b6640 1 --2- 172.21.15.38:0/3366269068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc100cb4c0 0x7fbc1015e830 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.621+0000 7fbc172b6640 1 --2- 172.21.15.38:0/3366269068 >> v2:172.21.15.89:3300/0 conn(0x7fbc1006d5f0 0x7fbc10070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.621+0000 7fbc172b6640 1 -- 172.21.15.38:0/3366269068 >> 172.21.15.38:0/3366269068 conn(0x7fbc100b1f70 msgr2=0x7fbc100b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:52.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.621+0000 7fbc172b6640 1 -- 172.21.15.38:0/3366269068 shutdown_connections 2023-12-22T08:45:52.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.621+0000 7fbc172b6640 1 -- 172.21.15.38:0/3366269068 wait complete. 2023-12-22T08:45:52.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.623+0000 7fbc172b6640 1 Processor -- start 2023-12-22T08:45:52.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.624+0000 7fbc172b6640 1 -- start start 2023-12-22T08:45:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.624+0000 7fbc172b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc1006d210 0x7fbc10152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc172b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc1006d5f0 0x7fbc100a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:52.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc172b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc100cb4c0 0x7fbc100a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc172b6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100a3260 con 0x7fbc1006d210 2023-12-22T08:45:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc172b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100a1d10 con 0x7fbc100cb4c0 2023-12-22T08:45:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc172b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100a1f60 con 0x7fbc1006d5f0 2023-12-22T08:45:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc162b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc1006d210 0x7fbc10152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc162b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc1006d210 0x7fbc10152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33230/0 (socket says 172.21.15.38:33230) 2023-12-22T08:45:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc162b4640 1 -- 172.21.15.38:0/32270139 learned_addr learned my addr 172.21.15.38:0/32270139 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc15ab3640 1 --2- 172.21.15.38:0/32270139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc1006d5f0 0x7fbc100a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc162b4640 1 -- 172.21.15.38:0/32270139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc1006d5f0 msgr2=0x7fbc100a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc162b4640 1 --2- 172.21.15.38:0/32270139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc1006d5f0 0x7fbc100a2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc162b4640 1 -- 172.21.15.38:0/32270139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc100cb4c0 msgr2=0x7fbc100a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc162b4640 1 --2- 172.21.15.38:0/32270139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc100cb4c0 0x7fbc100a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.625+0000 7fbc162b4640 1 -- 172.21.15.38:0/32270139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc000094d0 con 0x7fbc1006d210 2023-12-22T08:45:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.626+0000 7fbc162b4640 1 --2- 172.21.15.38:0/32270139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc1006d210 0x7fbc10152c20 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00c500 tx=0x7fbc0c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.626+0000 7fbc06ffd640 1 -- 172.21.15.38:0/32270139 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c007560 con 0x7fbc1006d210 2023-12-22T08:45:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.626+0000 7fbc06ffd640 1 -- 172.21.15.38:0/32270139 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0c0047e0 con 0x7fbc1006d210 2023-12-22T08:45:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.626+0000 7fbc172b6640 1 -- 172.21.15.38:0/32270139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc100a2240 con 0x7fbc1006d210 2023-12-22T08:45:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.626+0000 7fbc06ffd640 1 -- 172.21.15.38:0/32270139 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c004b90 con 0x7fbc1006d210 2023-12-22T08:45:52.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.626+0000 7fbc172b6640 1 -- 172.21.15.38:0/32270139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc100a2800 con 0x7fbc1006d210 2023-12-22T08:45:52.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.627+0000 7fbc172b6640 1 -- 172.21.15.38:0/32270139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc10061910 con 0x7fbc1006d210 2023-12-22T08:45:52.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.628+0000 7fbc06ffd640 1 -- 172.21.15.38:0/32270139 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbc0c004cf0 con 0x7fbc1006d210 2023-12-22T08:45:52.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.630+0000 7fbc06ffd640 1 --2- 172.21.15.38:0/32270139 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbbf406a430 0x7fbbf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:52.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.630+0000 7fbc06ffd640 1 -- 172.21.15.38:0/32270139 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fbc0c087b10 con 0x7fbc1006d210 2023-12-22T08:45:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.630+0000 7fbc06ffd640 1 -- 172.21.15.38:0/32270139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fbbf4072080 con 0x7fbc1006d210 2023-12-22T08:45:52.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.631+0000 7fbc15ab3640 1 --2- 172.21.15.38:0/32270139 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbbf406a430 0x7fbbf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:52.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.632+0000 7fbc15ab3640 1 --2- 172.21.15.38:0/32270139 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbbf406a430 0x7fbbf406c8f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbc00036000 tx=0x7fbc0003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:52.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.635+0000 7fbc06ffd640 1 -- 172.21.15.38:0/32270139 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbc0c0530b0 con 0x7fbc1006d210 2023-12-22T08:45:52.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.829+0000 7fbc172b6640 1 -- 172.21.15.38:0/32270139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc100b2bc0 con 0x7fbc1006d210 2023-12-22T08:45:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.832+0000 7fbc06ffd640 1 -- 172.21.15.38:0/32270139 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16167 (secure 0 0 0) 0x7fbc0c018030 con 0x7fbc1006d210 2023-12-22T08:45:52.834 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:52.834 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":96,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:45:52.328831+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:44:53.802762+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-22T08:44:54.948144+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.1b","mappings":[{"from":2,"to":7}]},{"pgid":"11.14","mappings":[{"from":1,"to":4}]},{"pgid":"11.16","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:45:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.835+0000 7fbc172b6640 1 -- 172.21.15.38:0/32270139 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbbf406a430 msgr2=0x7fbbf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.835+0000 7fbc172b6640 1 --2- 172.21.15.38:0/32270139 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbbf406a430 0x7fbbf406c8f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbc00036000 tx=0x7fbc0003b040 comp rx=0 tx=0).stop 2023-12-22T08:45:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.835+0000 7fbc172b6640 1 -- 172.21.15.38:0/32270139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc1006d210 msgr2=0x7fbc10152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.835+0000 7fbc172b6640 1 --2- 172.21.15.38:0/32270139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc1006d210 0x7fbc10152c20 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00c500 tx=0x7fbc0c00c9c0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.835+0000 7fbc172b6640 1 -- 172.21.15.38:0/32270139 shutdown_connections 2023-12-22T08:45:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.835+0000 7fbc172b6640 1 --2- 172.21.15.38:0/32270139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc100cb4c0 0x7fbc100a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.835+0000 7fbc172b6640 1 --2- 172.21.15.38:0/32270139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc1006d5f0 0x7fbc100a2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.835+0000 7fbc172b6640 1 --2- 172.21.15.38:0/32270139 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbbf406a430 0x7fbbf406c8f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.835+0000 7fbc172b6640 1 --2- 172.21.15.38:0/32270139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc1006d210 0x7fbc10152c20 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.835+0000 7fbc172b6640 1 -- 172.21.15.38:0/32270139 >> 172.21.15.38:0/32270139 conn(0x7fbc100b1f70 msgr2=0x7fbc1009de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.835+0000 7fbc172b6640 1 -- 172.21.15.38:0/32270139 shutdown_connections 2023-12-22T08:45:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:52.835+0000 7fbc172b6640 1 -- 172.21.15.38:0/32270139 wait complete. 2023-12-22T08:45:52.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:44:53.802762+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:44:54.948144+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:45:52.857 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:45:53.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.087+0000 7f282c701640 1 Processor -- start 2023-12-22T08:45:53.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.087+0000 7f282c701640 1 -- start start 2023-12-22T08:45:53.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.089+0000 7f282c701640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f28240cea50 0x7f28240ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.089+0000 7f282c701640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2824140f70 con 0x7f2824143600 2023-12-22T08:45:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.089+0000 7f282c701640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282406c300 con 0x7f282406d590 2023-12-22T08:45:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.089+0000 7f282c701640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28240cf410 con 0x7f28240cea50 2023-12-22T08:45:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.090+0000 7f282a49d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2824143600 0x7f282415e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33976/0 (socket says 172.21.15.38:33976) 2023-12-22T08:45:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.090+0000 7f282a49d640 1 -- 172.21.15.38:0/4209443373 learned_addr learned my addr 172.21.15.38:0/4209443373 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.090+0000 7f2829c9c640 1 --2- 172.21.15.38:0/4209443373 >> v2:172.21.15.38:3300/0 conn(0x7f28240cea50 0x7f28240ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.090+0000 7f2829c9c640 1 -- 172.21.15.38:0/4209443373 >> v1:172.21.15.89:6789/0 conn(0x7f282406d590 legacy=0x7f282406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.090+0000 7f2829c9c640 1 -- 172.21.15.38:0/4209443373 >> v1:172.21.15.38:6789/0 conn(0x7f2824143600 legacy=0x7f282415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.090+0000 7f2829c9c640 1 -- 172.21.15.38:0/4209443373 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282406c5e0 con 0x7f28240cea50 2023-12-22T08:45:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.090+0000 7f282949b640 1 -- 172.21.15.38:0/4209443373 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610724227 0 0) 0x7f2824140f70 con 0x7f2824143600 2023-12-22T08:45:53.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.091+0000 7f2829c9c640 1 --2- 172.21.15.38:0/4209443373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28240cea50 0x7f28240ceed0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f28180097a0 tx=0x7f281802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f285ceed9395240e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:53.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.092+0000 7f282949b640 1 -- 172.21.15.38:0/4209443373 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818030610 con 0x7f28240cea50 2023-12-22T08:45:53.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.092+0000 7f282949b640 1 -- 172.21.15.38:0/4209443373 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2818030770 con 0x7f28240cea50 2023-12-22T08:45:53.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.092+0000 7f282949b640 1 -- 172.21.15.38:0/4209443373 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818030b00 con 0x7f28240cea50 2023-12-22T08:45:53.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.092+0000 7f282c701640 1 -- 172.21.15.38:0/4209443373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28240cea50 msgr2=0x7f28240ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:53.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.092+0000 7f282c701640 1 --2- 172.21.15.38:0/4209443373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28240cea50 0x7f28240ceed0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f28180097a0 tx=0x7f281802b960 comp rx=0 tx=0).stop 2023-12-22T08:45:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.092+0000 7f282c701640 1 -- 172.21.15.38:0/4209443373 shutdown_connections 2023-12-22T08:45:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.092+0000 7f282c701640 1 --2- 172.21.15.38:0/4209443373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28240cea50 0x7f28240ceed0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.092+0000 7f282c701640 1 -- 172.21.15.38:0/4209443373 >> 172.21.15.38:0/4209443373 conn(0x7f28240cfe70 msgr2=0x7f28240d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.093+0000 7f282c701640 1 -- 172.21.15.38:0/4209443373 shutdown_connections 2023-12-22T08:45:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.093+0000 7f282c701640 1 -- 172.21.15.38:0/4209443373 wait complete. 2023-12-22T08:45:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.094+0000 7f282c701640 1 Processor -- start 2023-12-22T08:45:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.095+0000 7f282c701640 1 -- start start 2023-12-22T08:45:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.095+0000 7f282c701640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f282406d590 0x7f282415dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.095+0000 7f282c701640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28240cea50 0x7f2824155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f282c701640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2824143600 0x7f2824152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f282c701640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282415e240 con 0x7f28240cea50 2023-12-22T08:45:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f282c701640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28241559d0 con 0x7f282406d590 2023-12-22T08:45:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f282c701640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28241f7040 con 0x7f2824143600 2023-12-22T08:45:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f2829c9c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28240cea50 0x7f2824155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f2829c9c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28240cea50 0x7f2824155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33248/0 (socket says 172.21.15.38:33248) 2023-12-22T08:45:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f2829c9c640 1 -- 172.21.15.38:0/2255176886 learned_addr learned my addr 172.21.15.38:0/2255176886 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f282a49d640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f282406d590 0x7f282415dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f282ac9e640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2824143600 0x7f2824152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f2829c9c640 1 -- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2824143600 msgr2=0x7f2824152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f2829c9c640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2824143600 0x7f2824152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f2829c9c640 1 -- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f282406d590 msgr2=0x7f282415dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f2829c9c640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f282406d590 0x7f282415dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f2829c9c640 1 -- 172.21.15.38:0/2255176886 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2818009400 con 0x7f28240cea50 2023-12-22T08:45:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.096+0000 7f282ac9e640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2824143600 0x7f2824152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.097+0000 7f2829c9c640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28240cea50 0x7f2824155490 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f281802bf70 tx=0x7f28180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:53.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.097+0000 7f2822ffd640 1 -- 172.21.15.38:0/2255176886 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281803e070 con 0x7f28240cea50 2023-12-22T08:45:53.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.097+0000 7f2822ffd640 1 -- 172.21.15.38:0/2255176886 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2818039a10 con 0x7f28240cea50 2023-12-22T08:45:53.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.097+0000 7f2822ffd640 1 -- 172.21.15.38:0/2255176886 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818039dc0 con 0x7f28240cea50 2023-12-22T08:45:53.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.097+0000 7f282c701640 1 -- 172.21.15.38:0/2255176886 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282415fb20 con 0x7f28240cea50 2023-12-22T08:45:53.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.097+0000 7f282c701640 1 -- 172.21.15.38:0/2255176886 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2824154f70 con 0x7f28240cea50 2023-12-22T08:45:53.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.099+0000 7f282c701640 1 -- 172.21.15.38:0/2255176886 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282415fcb0 con 0x7f28240cea50 2023-12-22T08:45:53.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.099+0000 7f2822ffd640 1 -- 172.21.15.38:0/2255176886 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f281804b400 con 0x7f28240cea50 2023-12-22T08:45:53.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.101+0000 7f2822ffd640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f281006a430 0x7f281006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:53.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.101+0000 7f2822ffd640 1 -- 172.21.15.38:0/2255176886 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f28180aadc0 con 0x7f28240cea50 2023-12-22T08:45:53.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.101+0000 7f2822ffd640 1 -- 172.21.15.38:0/2255176886 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f2810072080 con 0x7f28240cea50 2023-12-22T08:45:53.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.101+0000 7f282a49d640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f281006a430 0x7f281006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:53.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.103+0000 7f282a49d640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f281006a430 0x7f281006c8f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2814005fd0 tx=0x7f2814007f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:53.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.105+0000 7f2822ffd640 1 -- 172.21.15.38:0/2255176886 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2818034060 con 0x7f28240cea50 2023-12-22T08:45:53.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.302+0000 7f282c701640 1 -- 172.21.15.38:0/2255176886 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2824061910 con 0x7f28240cea50 2023-12-22T08:45:53.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.303+0000 7f2822ffd640 1 -- 172.21.15.38:0/2255176886 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28180763e0 con 0x7f28240cea50 2023-12-22T08:45:53.305 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:45:53.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.306+0000 7f282c701640 1 -- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f281006a430 msgr2=0x7f281006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:53.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.306+0000 7f282c701640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f281006a430 0x7f281006c8f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2814005fd0 tx=0x7f2814007f10 comp rx=0 tx=0).stop 2023-12-22T08:45:53.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.306+0000 7f282c701640 1 -- 172.21.15.38:0/2255176886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28240cea50 msgr2=0x7f2824155490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:53.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.306+0000 7f282c701640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28240cea50 0x7f2824155490 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f281802bf70 tx=0x7f28180046c0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.306+0000 7f282c701640 1 -- 172.21.15.38:0/2255176886 shutdown_connections 2023-12-22T08:45:53.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.306+0000 7f282c701640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2824143600 0x7f2824152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.306+0000 7f282c701640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f281006a430 0x7f281006c8f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.306+0000 7f282c701640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28240cea50 0x7f2824155490 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.306+0000 7f282c701640 1 --2- 172.21.15.38:0/2255176886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f282406d590 0x7f282415dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.306+0000 7f282c701640 1 -- 172.21.15.38:0/2255176886 >> 172.21.15.38:0/2255176886 conn(0x7f28240cfe70 msgr2=0x7f28240b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:53.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.306+0000 7f282c701640 1 -- 172.21.15.38:0/2255176886 shutdown_connections 2023-12-22T08:45:53.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.306+0000 7f282c701640 1 -- 172.21.15.38:0/2255176886 wait complete. 2023-12-22T08:45:53.325 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:45:53.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.547+0000 7fd2edea8640 1 Processor -- start 2023-12-22T08:45:53.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.547+0000 7fd2edea8640 1 -- start start 2023-12-22T08:45:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.549+0000 7fd2edea8640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2e8070990 0x7fd2e8070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.549+0000 7fd2edea8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e806f650 con 0x7fd2e8146c70 2023-12-22T08:45:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.549+0000 7fd2edea8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e806f8f0 con 0x7fd2e8145fa0 2023-12-22T08:45:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.549+0000 7fd2edea8640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8071300 con 0x7fd2e8070990 2023-12-22T08:45:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.549+0000 7fd2dffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd2e8146c70 0x7fd2e815d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33980/0 (socket says 172.21.15.38:33980) 2023-12-22T08:45:53.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.549+0000 7fd2dffff640 1 -- 172.21.15.38:0/2036487012 learned_addr learned my addr 172.21.15.38:0/2036487012 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.549+0000 7fd2ed6a7640 1 --2- 172.21.15.38:0/2036487012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2e8070990 0x7fd2e8070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.549+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041604533 0 0) 0x7fd2e806f650 con 0x7fd2e8146c70 2023-12-22T08:45:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2d0003520 con 0x7fd2e8146c70 2023-12-22T08:45:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3625301452 0 0) 0x7fd2d0003520 con 0x7fd2e8146c70 2023-12-22T08:45:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2e8070990 msgr2=0x7fd2e8070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 --2- 172.21.15.38:0/2036487012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2e8070990 0x7fd2e8070dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 >> v1:172.21.15.89:6789/0 conn(0x7fd2e8145fa0 legacy=0x7fd2e81618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e806fbd0 con 0x7fd2e8146c70 2023-12-22T08:45:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fd2d8001690 con 0x7fd2e8146c70 2023-12-22T08:45:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 >> v1:172.21.15.38:6789/0 conn(0x7fd2e8146c70 legacy=0x7fd2e815d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 --2- 172.21.15.38:0/2036487012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2d00039a0 0x7fd2d0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:53.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 --2- 172.21.15.38:0/2036487012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00047c0 0x7fd2d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 --2- 172.21.15.38:0/2036487012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2e8070990 0x7fd2d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8071300 con 0x7fd2d00047c0 2023-12-22T08:45:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d000ba60 con 0x7fd2d00039a0 2023-12-22T08:45:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d000bc20 con 0x7fd2e8070990 2023-12-22T08:45:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.550+0000 7fd2dffff640 1 --2- 172.21.15.38:0/2036487012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00047c0 0x7fd2d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.551+0000 7fd2ecea6640 1 --2- 172.21.15.38:0/2036487012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2d00039a0 0x7fd2d0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.551+0000 7fd2dffff640 1 -- 172.21.15.38:0/2036487012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2e8070990 msgr2=0x7fd2d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.551+0000 7fd2dffff640 1 --2- 172.21.15.38:0/2036487012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2e8070990 0x7fd2d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.551+0000 7fd2dffff640 1 -- 172.21.15.38:0/2036487012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2d00039a0 msgr2=0x7fd2d0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.551+0000 7fd2dffff640 1 --2- 172.21.15.38:0/2036487012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2d00039a0 0x7fd2d0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.551+0000 7fd2dffff640 1 -- 172.21.15.38:0/2036487012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0003520 con 0x7fd2d00047c0 2023-12-22T08:45:53.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.551+0000 7fd2ecea6640 1 --2- 172.21.15.38:0/2036487012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2d00039a0 0x7fd2d0003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.552+0000 7fd2dffff640 1 --2- 172.21.15.38:0/2036487012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00047c0 0x7fd2d0004c40 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80ced20 tx=0x7fd2d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd935e29d5cc1980 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.552+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8005ad0 con 0x7fd2d00047c0 2023-12-22T08:45:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.552+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d8005c30 con 0x7fd2d00047c0 2023-12-22T08:45:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.552+0000 7fd2df7fe640 1 -- 172.21.15.38:0/2036487012 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8007070 con 0x7fd2d00047c0 2023-12-22T08:45:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.553+0000 7fd2edea8640 1 -- 172.21.15.38:0/2036487012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00047c0 msgr2=0x7fd2d0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.553+0000 7fd2edea8640 1 --2- 172.21.15.38:0/2036487012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2d00047c0 0x7fd2d0004c40 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80ced20 tx=0x7fd2d00057f0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.553+0000 7fd2ed6a7640 1 -- 172.21.15.38:0/2036487012 reap_dead start 2023-12-22T08:45:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.553+0000 7fd2edea8640 1 -- 172.21.15.38:0/2036487012 shutdown_connections 2023-12-22T08:45:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.553+0000 7fd2edea8640 1 -- 172.21.15.38:0/2036487012 >> 172.21.15.38:0/2036487012 conn(0x7fd2e8060720 msgr2=0x7fd2e8060b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.553+0000 7fd2edea8640 1 -- 172.21.15.38:0/2036487012 shutdown_connections 2023-12-22T08:45:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.553+0000 7fd2edea8640 1 -- 172.21.15.38:0/2036487012 wait complete. 2023-12-22T08:45:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.555+0000 7fd2edea8640 1 Processor -- start 2023-12-22T08:45:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.555+0000 7fd2edea8640 1 -- start start 2023-12-22T08:45:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.556+0000 7fd2edea8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2d00047c0 0x7fd2e815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.556+0000 7fd2edea8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e8142ab0 0x7fd2e8142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.556+0000 7fd2edea8640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2e8144740 0x7fd2e8144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.556+0000 7fd2edea8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8143c30 con 0x7fd2e8142ab0 2023-12-22T08:45:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.556+0000 7fd2edea8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e815aa40 con 0x7fd2d00047c0 2023-12-22T08:45:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.556+0000 7fd2edea8640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8143470 con 0x7fd2e8144740 2023-12-22T08:45:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.556+0000 7fd2dffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e8142ab0 0x7fd2e8142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.556+0000 7fd2dffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e8142ab0 0x7fd2e8142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33262/0 (socket says 172.21.15.38:33262) 2023-12-22T08:45:53.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.556+0000 7fd2dffff640 1 -- 172.21.15.38:0/174656428 learned_addr learned my addr 172.21.15.38:0/174656428 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.557+0000 7fd2ed6a7640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2e8144740 0x7fd2e8144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.557+0000 7fd2ecea6640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2d00047c0 0x7fd2e815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.557+0000 7fd2dffff640 1 -- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2e8144740 msgr2=0x7fd2e8144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.557+0000 7fd2dffff640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2e8144740 0x7fd2e8144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.557+0000 7fd2dffff640 1 -- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2d00047c0 msgr2=0x7fd2e815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.557+0000 7fd2dffff640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2d00047c0 0x7fd2e815a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.557+0000 7fd2dffff640 1 -- 172.21.15.38:0/174656428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e813c6e0 con 0x7fd2e8142ab0 2023-12-22T08:45:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.557+0000 7fd2dffff640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e8142ab0 0x7fd2e8142f30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fd2d802c310 tx=0x7fd2e806f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.558+0000 7fd2dd7fa640 1 -- 172.21.15.38:0/174656428 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8007480 con 0x7fd2e8142ab0 2023-12-22T08:45:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.558+0000 7fd2dd7fa640 1 -- 172.21.15.38:0/174656428 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d80075e0 con 0x7fd2e8142ab0 2023-12-22T08:45:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.558+0000 7fd2edea8640 1 -- 172.21.15.38:0/174656428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e8143670 con 0x7fd2e8142ab0 2023-12-22T08:45:53.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.558+0000 7fd2dd7fa640 1 -- 172.21.15.38:0/174656428 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d802c990 con 0x7fd2e8142ab0 2023-12-22T08:45:53.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.558+0000 7fd2edea8640 1 -- 172.21.15.38:0/174656428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e813c980 con 0x7fd2e8142ab0 2023-12-22T08:45:53.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.559+0000 7fd2edea8640 1 -- 172.21.15.38:0/174656428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e8061910 con 0x7fd2e8142ab0 2023-12-22T08:45:53.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.560+0000 7fd2dd7fa640 1 -- 172.21.15.38:0/174656428 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd2d8032070 con 0x7fd2e8142ab0 2023-12-22T08:45:53.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.561+0000 7fd2dd7fa640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd2d406a430 0x7fd2d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:53.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.561+0000 7fd2dd7fa640 1 -- 172.21.15.38:0/174656428 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fd2d80a9cd0 con 0x7fd2e8142ab0 2023-12-22T08:45:53.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.562+0000 7fd2dd7fa640 1 -- 172.21.15.38:0/174656428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fd2d4072080 con 0x7fd2e8142ab0 2023-12-22T08:45:53.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.562+0000 7fd2ecea6640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd2d406a430 0x7fd2d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:53.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.563+0000 7fd2ecea6640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd2d406a430 0x7fd2d406c8f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4001e40 tx=0x7fd2e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:53.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.566+0000 7fd2dd7fa640 1 -- 172.21.15.38:0/174656428 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd2d8045020 con 0x7fd2e8142ab0 2023-12-22T08:45:53.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.762+0000 7fd2edea8640 1 -- 172.21.15.38:0/174656428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2e806f430 con 0x7fd2e8142ab0 2023-12-22T08:45:53.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.763+0000 7fd2dd7fa640 1 -- 172.21.15.38:0/174656428 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd2d8075250 con 0x7fd2e8142ab0 2023-12-22T08:45:53.765 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:45:53.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.766+0000 7fd2edea8640 1 -- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd2d406a430 msgr2=0x7fd2d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:53.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.766+0000 7fd2edea8640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd2d406a430 0x7fd2d406c8f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4001e40 tx=0x7fd2e4009040 comp rx=0 tx=0).stop 2023-12-22T08:45:53.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.766+0000 7fd2edea8640 1 -- 172.21.15.38:0/174656428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e8142ab0 msgr2=0x7fd2e8142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:53.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.766+0000 7fd2edea8640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e8142ab0 0x7fd2e8142f30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fd2d802c310 tx=0x7fd2e806f7e0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.766+0000 7fd2edea8640 1 -- 172.21.15.38:0/174656428 shutdown_connections 2023-12-22T08:45:53.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.766+0000 7fd2edea8640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2e8144740 0x7fd2e8144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.766+0000 7fd2edea8640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd2d406a430 0x7fd2d406c8f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.766+0000 7fd2edea8640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2e8142ab0 0x7fd2e8142f30 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.766+0000 7fd2edea8640 1 --2- 172.21.15.38:0/174656428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2d00047c0 0x7fd2e815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:53.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.766+0000 7fd2edea8640 1 -- 172.21.15.38:0/174656428 >> 172.21.15.38:0/174656428 conn(0x7fd2e8060720 msgr2=0x7fd2e815c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:53.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.767+0000 7fd2edea8640 1 -- 172.21.15.38:0/174656428 shutdown_connections 2023-12-22T08:45:53.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:53.767+0000 7fd2edea8640 1 -- 172.21.15.38:0/174656428 wait complete. 2023-12-22T08:45:53.788 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:45:54.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.014+0000 7f5ea67c9640 1 Processor -- start 2023-12-22T08:45:54.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.014+0000 7f5ea67c9640 1 -- start start 2023-12-22T08:45:54.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.016+0000 7f5ea67c9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5ea0160c50 0x7f5ea00b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.016+0000 7f5ea67c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ea00ce020 0x7f5ea00ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.016+0000 7f5ea67c9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea00ceb70 con 0x7f5ea006f250 2023-12-22T08:45:54.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.016+0000 7f5ea67c9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea00cee50 con 0x7f5ea0160c50 2023-12-22T08:45:54.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.016+0000 7f5ea67c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea00ad140 con 0x7f5ea00ce020 2023-12-22T08:45:54.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.016+0000 7f5e9ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5ea0160c50 0x7f5ea00b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.016+0000 7f5ea4d66640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5ea006f250 0x7f5ea00ad560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33984/0 (socket says 172.21.15.38:33984) 2023-12-22T08:45:54.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.016+0000 7f5ea4d66640 1 -- 172.21.15.38:0/1503195944 learned_addr learned my addr 172.21.15.38:0/1503195944 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:54.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.017+0000 7f5e9ffff640 1 -- 172.21.15.38:0/1503195944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ea00ce020 msgr2=0x7f5ea00ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.017+0000 7f5e97fff640 1 --2- 172.21.15.38:0/1503195944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ea00ce020 0x7f5ea00ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.017+0000 7f5e9f7fe640 1 -- 172.21.15.38:0/1503195944 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167975953 0 0) 0x7f5ea00ceb70 con 0x7f5ea006f250 2023-12-22T08:45:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.017+0000 7f5e9ffff640 1 --2- 172.21.15.38:0/1503195944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ea00ce020 0x7f5ea00ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.017+0000 7f5e9ffff640 1 -- 172.21.15.38:0/1503195944 >> v1:172.21.15.38:6789/0 conn(0x7f5ea006f250 legacy=0x7f5ea00ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.017+0000 7f5e9ffff640 1 -- 172.21.15.38:0/1503195944 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea00aca80 con 0x7f5ea0160c50 2023-12-22T08:45:54.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.017+0000 7f5e97fff640 1 --2- 172.21.15.38:0/1503195944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ea00ce020 0x7f5ea00ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:54.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.018+0000 7f5e9ffff640 1 --2- 172.21.15.38:0/1503195944 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ea0160c50 0x7f5ea00b3600 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5e900097a0 tx=0x7f5e9002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861d107423d472a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:54.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.018+0000 7f5e9f7fe640 1 -- 172.21.15.38:0/1503195944 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90031780 con 0x7f5ea0160c50 2023-12-22T08:45:54.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.018+0000 7f5e9f7fe640 1 -- 172.21.15.38:0/1503195944 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e900318e0 con 0x7f5ea0160c50 2023-12-22T08:45:54.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.018+0000 7f5e9f7fe640 1 -- 172.21.15.38:0/1503195944 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90031c70 con 0x7f5ea0160c50 2023-12-22T08:45:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.019+0000 7f5ea67c9640 1 -- 172.21.15.38:0/1503195944 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ea0160c50 msgr2=0x7f5ea00b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.019+0000 7f5ea67c9640 1 --2- 172.21.15.38:0/1503195944 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ea0160c50 0x7f5ea00b3600 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5e900097a0 tx=0x7f5e9002b820 comp rx=0 tx=0).stop 2023-12-22T08:45:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.019+0000 7f5ea67c9640 1 -- 172.21.15.38:0/1503195944 shutdown_connections 2023-12-22T08:45:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.019+0000 7f5ea67c9640 1 --2- 172.21.15.38:0/1503195944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ea00ce020 0x7f5ea00ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.019+0000 7f5ea67c9640 1 --2- 172.21.15.38:0/1503195944 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ea0160c50 0x7f5ea00b3600 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.019+0000 7f5ea67c9640 1 -- 172.21.15.38:0/1503195944 >> 172.21.15.38:0/1503195944 conn(0x7f5ea00b20c0 msgr2=0x7f5ea00b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.019+0000 7f5ea67c9640 1 -- 172.21.15.38:0/1503195944 shutdown_connections 2023-12-22T08:45:54.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.019+0000 7f5ea67c9640 1 -- 172.21.15.38:0/1503195944 wait complete. 2023-12-22T08:45:54.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.021+0000 7f5ea67c9640 1 Processor -- start 2023-12-22T08:45:54.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.021+0000 7f5ea67c9640 1 -- start start 2023-12-22T08:45:54.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.022+0000 7f5ea67c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea006f250 0x7f5ea0143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.022+0000 7f5ea67c9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ea00ce020 0x7f5ea00b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.022+0000 7f5ea67c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ea0160c50 0x7f5ea0141330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.022+0000 7f5ea67c9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea0144430 con 0x7f5ea00ce020 2023-12-22T08:45:54.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.022+0000 7f5ea67c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea0144710 con 0x7f5ea006f250 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.022+0000 7f5ea67c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea01449f0 con 0x7f5ea0160c50 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.022+0000 7f5e97fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ea00ce020 0x7f5ea00b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.022+0000 7f5e97fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ea00ce020 0x7f5ea00b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33278/0 (socket says 172.21.15.38:33278) 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.022+0000 7f5e97fff640 1 -- 172.21.15.38:0/2789903104 learned_addr learned my addr 172.21.15.38:0/2789903104 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.022+0000 7f5e9ffff640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea006f250 0x7f5ea0143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.022+0000 7f5ea4d66640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ea0160c50 0x7f5ea0141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.023+0000 7f5e97fff640 1 -- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ea0160c50 msgr2=0x7f5ea0141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.023+0000 7f5e97fff640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ea0160c50 0x7f5ea0141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.023+0000 7f5e97fff640 1 -- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea006f250 msgr2=0x7f5ea0143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.023+0000 7f5e97fff640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea006f250 0x7f5ea0143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.023+0000 7f5e97fff640 1 -- 172.21.15.38:0/2789903104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e90009400 con 0x7f5ea00ce020 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.023+0000 7f5e9ffff640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea006f250 0x7f5ea0143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.023+0000 7f5ea4d66640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ea0160c50 0x7f5ea0141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:54.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.023+0000 7f5e97fff640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ea00ce020 0x7f5ea00b0240 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800c7f0 tx=0x7f5e8800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:54.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.023+0000 7f5e9d7fa640 1 -- 172.21.15.38:0/2789903104 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800cea0 con 0x7f5ea00ce020 2023-12-22T08:45:54.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.023+0000 7f5e9d7fa640 1 -- 172.21.15.38:0/2789903104 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e88004230 con 0x7f5ea00ce020 2023-12-22T08:45:54.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.023+0000 7f5e9d7fa640 1 -- 172.21.15.38:0/2789903104 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e88007830 con 0x7f5ea00ce020 2023-12-22T08:45:54.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.023+0000 7f5ea67c9640 1 -- 172.21.15.38:0/2789903104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea0144cd0 con 0x7f5ea00ce020 2023-12-22T08:45:54.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.023+0000 7f5ea67c9640 1 -- 172.21.15.38:0/2789903104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea0141870 con 0x7f5ea00ce020 2023-12-22T08:45:54.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.024+0000 7f5ea67c9640 1 -- 172.21.15.38:0/2789903104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea0141a90 con 0x7f5ea00ce020 2023-12-22T08:45:54.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.025+0000 7f5e9d7fa640 1 -- 172.21.15.38:0/2789903104 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5e88007990 con 0x7f5ea00ce020 2023-12-22T08:45:54.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.026+0000 7f5e9d7fa640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5e8006a460 0x7f5e8006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.026+0000 7f5e9d7fa640 1 -- 172.21.15.38:0/2789903104 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f5e88088960 con 0x7f5ea00ce020 2023-12-22T08:45:54.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.027+0000 7f5e9d7fa640 1 -- 172.21.15.38:0/2789903104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f5e800720b0 con 0x7f5ea00ce020 2023-12-22T08:45:54.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.027+0000 7f5e9ffff640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5e8006a460 0x7f5e8006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.028+0000 7f5e9ffff640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5e8006a460 0x7f5e8006c920 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5e90036000 tx=0x7f5e90008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:54.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.031+0000 7f5e9d7fa640 1 -- 172.21.15.38:0/2789903104 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5e8801e060 con 0x7f5ea00ce020 2023-12-22T08:45:54.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.223+0000 7f5ea67c9640 1 -- 172.21.15.38:0/2789903104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ea0061910 con 0x7f5ea00ce020 2023-12-22T08:45:54.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.224+0000 7f5e9d7fa640 1 -- 172.21.15.38:0/2789903104 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e8801e020 con 0x7f5ea00ce020 2023-12-22T08:45:54.226 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:45:54.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.227+0000 7f5ea67c9640 1 -- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5e8006a460 msgr2=0x7f5e8006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.227+0000 7f5ea67c9640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5e8006a460 0x7f5e8006c920 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5e90036000 tx=0x7f5e90008030 comp rx=0 tx=0).stop 2023-12-22T08:45:54.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.227+0000 7f5ea67c9640 1 -- 172.21.15.38:0/2789903104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ea00ce020 msgr2=0x7f5ea00b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.227+0000 7f5ea67c9640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ea00ce020 0x7f5ea00b0240 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800c7f0 tx=0x7f5e8800ccb0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.227+0000 7f5ea67c9640 1 -- 172.21.15.38:0/2789903104 shutdown_connections 2023-12-22T08:45:54.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.227+0000 7f5ea67c9640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ea0160c50 0x7f5ea0141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.227+0000 7f5ea67c9640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5e8006a460 0x7f5e8006c920 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.227+0000 7f5ea67c9640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ea00ce020 0x7f5ea00b0240 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.227+0000 7f5ea67c9640 1 --2- 172.21.15.38:0/2789903104 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea006f250 0x7f5ea0143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.227+0000 7f5ea67c9640 1 -- 172.21.15.38:0/2789903104 >> 172.21.15.38:0/2789903104 conn(0x7f5ea00b20c0 msgr2=0x7f5ea015ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:54.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.227+0000 7f5ea67c9640 1 -- 172.21.15.38:0/2789903104 shutdown_connections 2023-12-22T08:45:54.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.227+0000 7f5ea67c9640 1 -- 172.21.15.38:0/2789903104 wait complete. 2023-12-22T08:45:54.249 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:45:54.346 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:45:54.345+0000 7f0a296e8640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-12-22T08:45:54.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.474+0000 7f162f095640 1 Processor -- start 2023-12-22T08:45:54.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.474+0000 7f162f095640 1 -- start start 2023-12-22T08:45:54.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.475+0000 7f162f095640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162815b420 0x7f162806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.476+0000 7f162f095640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1628071000 0x7f162815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.476+0000 7f162f095640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16280cdae0 con 0x7f16280a44a0 2023-12-22T08:45:54.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.476+0000 7f162f095640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162806dec0 con 0x7f1628071000 2023-12-22T08:45:54.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.476+0000 7f162f095640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162815b800 con 0x7f162815b420 2023-12-22T08:45:54.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.476+0000 7f162d892640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f16280a44a0 0x7f16280708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33994/0 (socket says 172.21.15.38:33994) 2023-12-22T08:45:54.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.476+0000 7f162d892640 1 -- 172.21.15.38:0/3555123691 learned_addr learned my addr 172.21.15.38:0/3555123691 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:54.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.476+0000 7f162e093640 1 --2- 172.21.15.38:0/3555123691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162815b420 0x7f162806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.476+0000 7f162e894640 1 --2- 172.21.15.38:0/3555123691 >> v2:172.21.15.89:3300/0 conn(0x7f1628071000 0x7f162815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988719510 0 0) 0x7f16280cdae0 con 0x7f16280a44a0 2023-12-22T08:45:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1614003520 con 0x7f16280a44a0 2023-12-22T08:45:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3135828208 0 0) 0x7f1614003520 con 0x7f16280a44a0 2023-12-22T08:45:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162815b420 msgr2=0x7f162806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 --2- 172.21.15.38:0/3555123691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162815b420 0x7f162806d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 >> v2:172.21.15.89:3300/0 conn(0x7f1628071000 msgr2=0x7f162815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 --2- 172.21.15.38:0/3555123691 >> v2:172.21.15.89:3300/0 conn(0x7f1628071000 0x7f162815baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16280cdd30 con 0x7f16280a44a0 2023-12-22T08:45:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f1618001670 con 0x7f16280a44a0 2023-12-22T08:45:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 >> v1:172.21.15.38:6789/0 conn(0x7f16280a44a0 legacy=0x7f16280708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 --2- 172.21.15.38:0/3555123691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1614003970 0x7f1614003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 --2- 172.21.15.38:0/3555123691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16140047c0 0x7f1614004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 --2- 172.21.15.38:0/3555123691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162815b420 0x7f1614005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162806dec0 con 0x7f16140047c0 2023-12-22T08:45:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162815b800 con 0x7f1614003970 2023-12-22T08:45:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161400b980 con 0x7f162815b420 2023-12-22T08:45:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.477+0000 7f162d892640 1 --2- 172.21.15.38:0/3555123691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16140047c0 0x7f1614004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.478+0000 7f162e093640 1 --2- 172.21.15.38:0/3555123691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1614003970 0x7f1614003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.478+0000 7f162e894640 1 --2- 172.21.15.38:0/3555123691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162815b420 0x7f1614005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.478+0000 7f162d892640 1 -- 172.21.15.38:0/3555123691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162815b420 msgr2=0x7f1614005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.478+0000 7f162d892640 1 --2- 172.21.15.38:0/3555123691 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162815b420 0x7f1614005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.478+0000 7f162d892640 1 -- 172.21.15.38:0/3555123691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1614003970 msgr2=0x7f1614003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.478+0000 7f162d892640 1 --2- 172.21.15.38:0/3555123691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1614003970 0x7f1614003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.478+0000 7f162d892640 1 -- 172.21.15.38:0/3555123691 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1614003520 con 0x7f16140047c0 2023-12-22T08:45:54.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.479+0000 7f162d892640 1 --2- 172.21.15.38:0/3555123691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16140047c0 0x7f1614004c40 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f161800c240 tx=0x7f16140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56174480cac92f32 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:54.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.479+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161802cb00 con 0x7f16140047c0 2023-12-22T08:45:54.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.480+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161802cc60 con 0x7f16140047c0 2023-12-22T08:45:54.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.480+0000 7f162d091640 1 -- 172.21.15.38:0/3555123691 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618005af0 con 0x7f16140047c0 2023-12-22T08:45:54.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.480+0000 7f162f095640 1 -- 172.21.15.38:0/3555123691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16140047c0 msgr2=0x7f1614004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.480+0000 7f162f095640 1 --2- 172.21.15.38:0/3555123691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16140047c0 0x7f1614004c40 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f161800c240 tx=0x7f16140057f0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.480+0000 7f162e894640 1 -- 172.21.15.38:0/3555123691 reap_dead start 2023-12-22T08:45:54.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.480+0000 7f162f095640 1 -- 172.21.15.38:0/3555123691 shutdown_connections 2023-12-22T08:45:54.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.480+0000 7f162f095640 1 -- 172.21.15.38:0/3555123691 >> 172.21.15.38:0/3555123691 conn(0x7f16280b1f70 msgr2=0x7f16280b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:54.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.480+0000 7f162f095640 1 -- 172.21.15.38:0/3555123691 shutdown_connections 2023-12-22T08:45:54.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.480+0000 7f162f095640 1 -- 172.21.15.38:0/3555123691 wait complete. 2023-12-22T08:45:54.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.482+0000 7f162f095640 1 Processor -- start 2023-12-22T08:45:54.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.482+0000 7f162f095640 1 -- start start 2023-12-22T08:45:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.483+0000 7f162f095640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16140047c0 0x7f162814c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.483+0000 7f162f095640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16280ccd60 0x7f1628152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.483+0000 7f162f095640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16280cd180 0x7f1628153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.483+0000 7f162f095640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280cc940 con 0x7f16280cd180 2023-12-22T08:45:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.483+0000 7f162f095640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280cbd00 con 0x7f16140047c0 2023-12-22T08:45:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.483+0000 7f162f095640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280cbfa0 con 0x7f16280ccd60 2023-12-22T08:45:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.484+0000 7f162e894640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16280cd180 0x7f1628153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.484+0000 7f162e894640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16280cd180 0x7f1628153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33290/0 (socket says 172.21.15.38:33290) 2023-12-22T08:45:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.484+0000 7f162e894640 1 -- 172.21.15.38:0/4269945962 learned_addr learned my addr 172.21.15.38:0/4269945962 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.484+0000 7f162d892640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16280ccd60 0x7f1628152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.484+0000 7f162e093640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16140047c0 0x7f162814c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.484+0000 7f162e894640 1 -- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16280ccd60 msgr2=0x7f1628152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.484+0000 7f162e894640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16280ccd60 0x7f1628152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.484+0000 7f162e894640 1 -- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16140047c0 msgr2=0x7f162814c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.484+0000 7f162e894640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16140047c0 0x7f162814c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.484+0000 7f162e894640 1 -- 172.21.15.38:0/4269945962 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16280cc280 con 0x7f16280cd180 2023-12-22T08:45:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.485+0000 7f162e894640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16280cd180 0x7f1628153020 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1628070670 tx=0x7f162000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.485+0000 7f161effd640 1 -- 172.21.15.38:0/4269945962 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620017400 con 0x7f16280cd180 2023-12-22T08:45:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.485+0000 7f161effd640 1 -- 172.21.15.38:0/4269945962 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1620011040 con 0x7f16280cd180 2023-12-22T08:45:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.485+0000 7f161effd640 1 -- 172.21.15.38:0/4269945962 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16200177e0 con 0x7f16280cd180 2023-12-22T08:45:54.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.485+0000 7f162f095640 1 -- 172.21.15.38:0/4269945962 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16280cc560 con 0x7f16280cd180 2023-12-22T08:45:54.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.485+0000 7f162f095640 1 -- 172.21.15.38:0/4269945962 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162814ca20 con 0x7f16280cd180 2023-12-22T08:45:54.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.486+0000 7f162f095640 1 -- 172.21.15.38:0/4269945962 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1628061910 con 0x7f16280cd180 2023-12-22T08:45:54.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.487+0000 7f161effd640 1 -- 172.21.15.38:0/4269945962 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1620017940 con 0x7f16280cd180 2023-12-22T08:45:54.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.488+0000 7f161effd640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f160c06a430 0x7f160c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.488+0000 7f161effd640 1 -- 172.21.15.38:0/4269945962 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f1620088f20 con 0x7f16280cd180 2023-12-22T08:45:54.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.488+0000 7f161effd640 1 -- 172.21.15.38:0/4269945962 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f160c072080 con 0x7f16280cd180 2023-12-22T08:45:54.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.489+0000 7f162e093640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f160c06a430 0x7f160c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.490+0000 7f162e093640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f160c06a430 0x7f160c06c8f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f16240098b0 tx=0x7f1624008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:54.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.493+0000 7f161effd640 1 -- 172.21.15.38:0/4269945962 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f16200544a0 con 0x7f16280cd180 2023-12-22T08:45:54.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.724+0000 7f162f095640 1 -- 172.21.15.38:0/4269945962 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f162815daa0 con 0x7f16280cd180 2023-12-22T08:45:54.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.725+0000 7f161effd640 1 -- 172.21.15.38:0/4269945962 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f162005b240 con 0x7f16280cd180 2023-12-22T08:45:54.727 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:54.727 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2128001687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2128001687},{"type":"v1","addr":"172.21.15.89:6837","nonce":2128001687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6438,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1632983842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1632983842},{"type":"v1","addr":"172.21.15.38:6833","nonce":1632983842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6444,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2613790013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2613790013},{"type":"v1","addr":"172.21.15.38:6835","nonce":2613790013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:44:55.928210+0000","modified":"2023-12-22T08:44:59.439959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6447},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6447":{"gid":6447,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2576950091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2576950091},{"type":"v1","addr":"172.21.15.89:6836","nonce":2576950091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-22T08:45:54.727 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 40 2023-12-22T08:45:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.729+0000 7f162f095640 1 -- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f160c06a430 msgr2=0x7f160c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.729+0000 7f162f095640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f160c06a430 0x7f160c06c8f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f16240098b0 tx=0x7f1624008040 comp rx=0 tx=0).stop 2023-12-22T08:45:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.729+0000 7f162f095640 1 -- 172.21.15.38:0/4269945962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16280cd180 msgr2=0x7f1628153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.729+0000 7f162f095640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16280cd180 0x7f1628153020 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1628070670 tx=0x7f162000f4a0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.729+0000 7f162f095640 1 -- 172.21.15.38:0/4269945962 shutdown_connections 2023-12-22T08:45:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.729+0000 7f162f095640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f160c06a430 0x7f160c06c8f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.729+0000 7f162f095640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16280cd180 0x7f1628153020 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.729+0000 7f162f095640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f16280ccd60 0x7f1628152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.729+0000 7f162f095640 1 --2- 172.21.15.38:0/4269945962 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16140047c0 0x7f162814c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.729+0000 7f162f095640 1 -- 172.21.15.38:0/4269945962 >> 172.21.15.38:0/4269945962 conn(0x7f16280b1f70 msgr2=0x7f162815ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.729+0000 7f162f095640 1 -- 172.21.15.38:0/4269945962 shutdown_connections 2023-12-22T08:45:54.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.729+0000 7f162f095640 1 -- 172.21.15.38:0/4269945962 wait complete. 2023-12-22T08:45:54.750 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:45:54.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.954+0000 7f8241c1b640 1 Processor -- start 2023-12-22T08:45:54.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.954+0000 7f8241c1b640 1 -- start start 2023-12-22T08:45:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.956+0000 7f8241c1b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f823c0b3ff0 0x7f823c06cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.956+0000 7f8241c1b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f823c0b44a0 0x7f823c06d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.956+0000 7f8241c1b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c15f220 con 0x7f823c157980 2023-12-22T08:45:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.956+0000 7f8241c1b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823c0d1520 con 0x7f823c0b3ff0 2023-12-22T08:45:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.956+0000 7f8241c1b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823c0d1800 con 0x7f823c0b44a0 2023-12-22T08:45:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.956+0000 7f823bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f823c0b3ff0 0x7f823c06cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.956+0000 7f8240c19640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f823c157980 0x7f823c15eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33996/0 (socket says 172.21.15.38:33996) 2023-12-22T08:45:54.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.956+0000 7f8240c19640 1 -- 172.21.15.38:0/87731403 learned_addr learned my addr 172.21.15.38:0/87731403 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.957+0000 7f824141a640 1 --2- 172.21.15.38:0/87731403 >> v2:172.21.15.89:3300/0 conn(0x7f823c0b44a0 0x7f823c06d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.957+0000 7f823bfff640 1 -- 172.21.15.38:0/87731403 >> v2:172.21.15.89:3300/0 conn(0x7f823c0b44a0 msgr2=0x7f823c06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.957+0000 7f823bfff640 1 --2- 172.21.15.38:0/87731403 >> v2:172.21.15.89:3300/0 conn(0x7f823c0b44a0 0x7f823c06d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.957+0000 7f823bfff640 1 -- 172.21.15.38:0/87731403 >> v1:172.21.15.38:6789/0 conn(0x7f823c157980 legacy=0x7f823c15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.957+0000 7f823bfff640 1 -- 172.21.15.38:0/87731403 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c0d1ae0 con 0x7f823c0b3ff0 2023-12-22T08:45:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.957+0000 7f824141a640 1 --2- 172.21.15.38:0/87731403 >> v2:172.21.15.89:3300/0 conn(0x7f823c0b44a0 0x7f823c06d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.957+0000 7f823b7fe640 1 -- 172.21.15.38:0/87731403 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205210586 0 0) 0x7f823c15f220 con 0x7f823c157980 2023-12-22T08:45:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.958+0000 7f823bfff640 1 --2- 172.21.15.38:0/87731403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f823c0b3ff0 0x7f823c06cf30 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f823c06e5f0 tx=0x7f822802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9163bf7011ce070d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.959+0000 7f823b7fe640 1 -- 172.21.15.38:0/87731403 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228031830 con 0x7f823c0b3ff0 2023-12-22T08:45:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.959+0000 7f823b7fe640 1 -- 172.21.15.38:0/87731403 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8228031990 con 0x7f823c0b3ff0 2023-12-22T08:45:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.959+0000 7f823b7fe640 1 -- 172.21.15.38:0/87731403 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228031d20 con 0x7f823c0b3ff0 2023-12-22T08:45:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.959+0000 7f8241c1b640 1 -- 172.21.15.38:0/87731403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f823c0b3ff0 msgr2=0x7f823c06cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.959+0000 7f8241c1b640 1 --2- 172.21.15.38:0/87731403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f823c0b3ff0 0x7f823c06cf30 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f823c06e5f0 tx=0x7f822802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.959+0000 7f8241c1b640 1 -- 172.21.15.38:0/87731403 shutdown_connections 2023-12-22T08:45:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.959+0000 7f8241c1b640 1 --2- 172.21.15.38:0/87731403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f823c0b3ff0 0x7f823c06cf30 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.959+0000 7f8241c1b640 1 --2- 172.21.15.38:0/87731403 >> v2:172.21.15.89:3300/0 conn(0x7f823c0b44a0 0x7f823c06d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.959+0000 7f8241c1b640 1 -- 172.21.15.38:0/87731403 >> 172.21.15.38:0/87731403 conn(0x7f823c0d31f0 msgr2=0x7f823c0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.959+0000 7f8241c1b640 1 -- 172.21.15.38:0/87731403 shutdown_connections 2023-12-22T08:45:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.959+0000 7f8241c1b640 1 -- 172.21.15.38:0/87731403 wait complete. 2023-12-22T08:45:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.961+0000 7f8241c1b640 1 Processor -- start 2023-12-22T08:45:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.961+0000 7f8241c1b640 1 -- start start 2023-12-22T08:45:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.962+0000 7f8241c1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f823c0b3ff0 0x7f823c0b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.962+0000 7f8241c1b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f823c0b44a0 0x7f823c0b8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.962+0000 7f8241c1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c157980 0x7f823c156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.962+0000 7f8241c1b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c0b8980 con 0x7f823c0b44a0 2023-12-22T08:45:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.962+0000 7f8241c1b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c0ac9f0 con 0x7f823c157980 2023-12-22T08:45:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.962+0000 7f8241c1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1f6f10 con 0x7f823c0b3ff0 2023-12-22T08:45:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.963+0000 7f823bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f823c0b44a0 0x7f823c0b8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.963+0000 7f823bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f823c0b44a0 0x7f823c0b8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33310/0 (socket says 172.21.15.38:33310) 2023-12-22T08:45:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.963+0000 7f823bfff640 1 -- 172.21.15.38:0/1614612161 learned_addr learned my addr 172.21.15.38:0/1614612161 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:54.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.963+0000 7f8240c19640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f823c0b3ff0 0x7f823c0b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.963+0000 7f824141a640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c157980 0x7f823c156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.963+0000 7f823bfff640 1 -- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f823c0b3ff0 msgr2=0x7f823c0b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.963+0000 7f823bfff640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f823c0b3ff0 0x7f823c0b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.963+0000 7f823bfff640 1 -- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c157980 msgr2=0x7f823c156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.963+0000 7f823bfff640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c157980 0x7f823c156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.963+0000 7f823bfff640 1 -- 172.21.15.38:0/1614612161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8228009400 con 0x7f823c0b44a0 2023-12-22T08:45:54.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.964+0000 7f823bfff640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f823c0b44a0 0x7f823c0b8440 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8228000c00 tx=0x7f82280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:54.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.964+0000 7f82397fa640 1 -- 172.21.15.38:0/1614612161 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228004230 con 0x7f823c0b44a0 2023-12-22T08:45:54.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.964+0000 7f82397fa640 1 -- 172.21.15.38:0/1614612161 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8228004390 con 0x7f823c0b44a0 2023-12-22T08:45:54.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.964+0000 7f82397fa640 1 -- 172.21.15.38:0/1614612161 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822803a920 con 0x7f823c0b44a0 2023-12-22T08:45:54.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.964+0000 7f8241c1b640 1 -- 172.21.15.38:0/1614612161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823c157fa0 con 0x7f823c0b44a0 2023-12-22T08:45:54.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.964+0000 7f8241c1b640 1 -- 172.21.15.38:0/1614612161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c158560 con 0x7f823c0b44a0 2023-12-22T08:45:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.965+0000 7f8241c1b640 1 -- 172.21.15.38:0/1614612161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c061910 con 0x7f823c0b44a0 2023-12-22T08:45:54.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.966+0000 7f82397fa640 1 -- 172.21.15.38:0/1614612161 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f822803aa80 con 0x7f823c0b44a0 2023-12-22T08:45:54.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.967+0000 7f82397fa640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f822006a430 0x7f822006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:54.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.968+0000 7f82397fa640 1 -- 172.21.15.38:0/1614612161 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f82280ab210 con 0x7f823c0b44a0 2023-12-22T08:45:54.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.968+0000 7f82397fa640 1 -- 172.21.15.38:0/1614612161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f8220072080 con 0x7f823c0b44a0 2023-12-22T08:45:54.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.968+0000 7f8240c19640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f822006a430 0x7f822006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:54.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.969+0000 7f8240c19640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f822006a430 0x7f822006c8f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8230000f60 tx=0x7f8230007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:54.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:54.972+0000 7f82397fa640 1 -- 172.21.15.38:0/1614612161 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8228035060 con 0x7f823c0b44a0 2023-12-22T08:45:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.168+0000 7f8241c1b640 1 -- 172.21.15.38:0/1614612161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f823c0d2fd0 con 0x7f823c0b44a0 2023-12-22T08:45:55.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.171+0000 7f82397fa640 1 -- 172.21.15.38:0/1614612161 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16160 (secure 0 0 0) 0x7f8228035070 con 0x7f823c0b44a0 2023-12-22T08:45:55.173 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:55.173 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":97,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:45:54.346170+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:44:53.802762+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-22T08:44:54.948144+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.1b","mappings":[{"from":2,"to":7}]},{"pgid":"11.14","mappings":[{"from":1,"to":4}]},{"pgid":"11.16","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:45:55.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.174+0000 7f8241c1b640 1 -- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f822006a430 msgr2=0x7f822006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.174+0000 7f8241c1b640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f822006a430 0x7f822006c8f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8230000f60 tx=0x7f8230007c00 comp rx=0 tx=0).stop 2023-12-22T08:45:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.174+0000 7f8241c1b640 1 -- 172.21.15.38:0/1614612161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f823c0b44a0 msgr2=0x7f823c0b8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.174+0000 7f8241c1b640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f823c0b44a0 0x7f823c0b8440 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8228000c00 tx=0x7f82280046c0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.174+0000 7f8241c1b640 1 -- 172.21.15.38:0/1614612161 shutdown_connections 2023-12-22T08:45:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.174+0000 7f8241c1b640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c157980 0x7f823c156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.174+0000 7f8241c1b640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f822006a430 0x7f822006c8f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.174+0000 7f8241c1b640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f823c0b44a0 0x7f823c0b8440 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.174+0000 7f8241c1b640 1 --2- 172.21.15.38:0/1614612161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f823c0b3ff0 0x7f823c0b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.174+0000 7f8241c1b640 1 -- 172.21.15.38:0/1614612161 >> 172.21.15.38:0/1614612161 conn(0x7f823c0d31f0 msgr2=0x7f823c15ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.174+0000 7f8241c1b640 1 -- 172.21.15.38:0/1614612161 shutdown_connections 2023-12-22T08:45:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.174+0000 7f8241c1b640 1 -- 172.21.15.38:0/1614612161 wait complete. 2023-12-22T08:45:55.194 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:45:55.195 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:45:55.366 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:45:55.364+0000 7f0a296e8640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL) 2023-12-22T08:45:55.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.419+0000 7f6f9c927640 1 Processor -- start 2023-12-22T08:45:55.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.419+0000 7f6f9c927640 1 -- start start 2023-12-22T08:45:55.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.421+0000 7f6f9c927640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6f980b24b0 0x7f6f98070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.421+0000 7f6f9c927640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f981450f0 con 0x7f6f98144d10 2023-12-22T08:45:55.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.421+0000 7f6f9c927640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f980cc840 con 0x7f6f980b2050 2023-12-22T08:45:55.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.421+0000 7f6f9c927640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f980ce010 con 0x7f6f980b24b0 2023-12-22T08:45:55.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.421+0000 7f6f9659c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6f98144d10 0x7f6f980cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34012/0 (socket says 172.21.15.38:34012) 2023-12-22T08:45:55.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.421+0000 7f6f9659c640 1 -- 172.21.15.38:0/2053003331 learned_addr learned my addr 172.21.15.38:0/2053003331 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.421+0000 7f6f96d9d640 1 --2- 172.21.15.38:0/2053003331 >> v2:172.21.15.89:3300/0 conn(0x7f6f980b24b0 0x7f6f98070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.421+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450579360 0 0) 0x7f6f981450f0 con 0x7f6f98144d10 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.421+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f80003520 con 0x7f6f98144d10 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3119954182 0 0) 0x7f6f80003520 con 0x7f6f98144d10 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 >> v2:172.21.15.89:3300/0 conn(0x7f6f980b24b0 msgr2=0x7f6f98070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f9559a640 1 --2- 172.21.15.38:0/2053003331 >> v2:172.21.15.89:3300/0 conn(0x7f6f980b24b0 0x7f6f98070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 >> v1:172.21.15.89:6789/0 conn(0x7f6f980b2050 legacy=0x7f6f98070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f980ce2f0 con 0x7f6f98144d10 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f6f88001670 con 0x7f6f98144d10 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 >> v1:172.21.15.38:6789/0 conn(0x7f6f98144d10 legacy=0x7f6f980cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f9559a640 1 --2- 172.21.15.38:0/2053003331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f800039c0 0x7f6f80003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f9559a640 1 --2- 172.21.15.38:0/2053003331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f800047c0 0x7f6f80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f9559a640 1 --2- 172.21.15.38:0/2053003331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f80005180 0x7f6f8000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980ce010 con 0x7f6f800047c0 2023-12-22T08:45:55.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8000c080 con 0x7f6f80005180 2023-12-22T08:45:55.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8000c240 con 0x7f6f800039c0 2023-12-22T08:45:55.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.422+0000 7f6f95d9b640 1 --2- 172.21.15.38:0/2053003331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f800047c0 0x7f6f80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:55.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.423+0000 7f6f96d9d640 1 --2- 172.21.15.38:0/2053003331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f80005180 0x7f6f8000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:55.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.423+0000 7f6f95d9b640 1 -- 172.21.15.38:0/2053003331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f800039c0 msgr2=0x7f6f80003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:55.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.423+0000 7f6f95d9b640 1 --2- 172.21.15.38:0/2053003331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f800039c0 0x7f6f80003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.423+0000 7f6f95d9b640 1 -- 172.21.15.38:0/2053003331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f80005180 msgr2=0x7f6f8000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:55.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.423+0000 7f6f95d9b640 1 --2- 172.21.15.38:0/2053003331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f80005180 0x7f6f8000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.423+0000 7f6f95d9b640 1 -- 172.21.15.38:0/2053003331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f80003520 con 0x7f6f800047c0 2023-12-22T08:45:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.423+0000 7f6f96d9d640 1 -- 172.21.15.38:0/2053003331 reap_dead start 2023-12-22T08:45:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.424+0000 7f6f95d9b640 1 --2- 172.21.15.38:0/2053003331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f800047c0 0x7f6f80004c40 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c001750 tx=0x7f6f800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdd14713960cc3a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.424+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0052d0 con 0x7f6f800047c0 2023-12-22T08:45:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.424+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c02e050 con 0x7f6f800047c0 2023-12-22T08:45:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.424+0000 7f6f9559a640 1 -- 172.21.15.38:0/2053003331 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c003830 con 0x7f6f800047c0 2023-12-22T08:45:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.425+0000 7f6f9c927640 1 -- 172.21.15.38:0/2053003331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f800047c0 msgr2=0x7f6f80004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.425+0000 7f6f9c927640 1 --2- 172.21.15.38:0/2053003331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f800047c0 0x7f6f80004c40 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c001750 tx=0x7f6f800057f0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.425+0000 7f6f9c927640 1 -- 172.21.15.38:0/2053003331 shutdown_connections 2023-12-22T08:45:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.425+0000 7f6f9c927640 1 --2- 172.21.15.38:0/2053003331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f800047c0 0x7f6f80004c40 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.425+0000 7f6f9c927640 1 -- 172.21.15.38:0/2053003331 >> 172.21.15.38:0/2053003331 conn(0x7f6f980cf070 msgr2=0x7f6f980cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.425+0000 7f6f9c927640 1 -- 172.21.15.38:0/2053003331 shutdown_connections 2023-12-22T08:45:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.425+0000 7f6f9c927640 1 -- 172.21.15.38:0/2053003331 wait complete. 2023-12-22T08:45:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.427+0000 7f6f9c927640 1 Processor -- start 2023-12-22T08:45:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.427+0000 7f6f9c927640 1 -- start start 2023-12-22T08:45:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.428+0000 7f6f9c927640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f800047c0 0x7f6f980afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.428+0000 7f6f9c927640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f98156f60 0x7f6f980b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.428+0000 7f6f9c927640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f98156040 0x7f6f9806c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.428+0000 7f6f9c927640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9813f3d0 con 0x7f6f98156f60 2023-12-22T08:45:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.428+0000 7f6f9c927640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f98157500 con 0x7f6f98156040 2023-12-22T08:45:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.428+0000 7f6f9c927640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f981577e0 con 0x7f6f800047c0 2023-12-22T08:45:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.428+0000 7f6f95d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f98156f60 0x7f6f980b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.428+0000 7f6f95d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f98156f60 0x7f6f980b00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33324/0 (socket says 172.21.15.38:33324) 2023-12-22T08:45:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.428+0000 7f6f95d9b640 1 -- 172.21.15.38:0/2310848968 learned_addr learned my addr 172.21.15.38:0/2310848968 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.428+0000 7f6f96d9d640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f98156040 0x7f6f9806c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.428+0000 7f6f95d9b640 1 -- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f800047c0 msgr2=0x7f6f980afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.428+0000 7f6f9659c640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f800047c0 0x7f6f980afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.429+0000 7f6f95d9b640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f800047c0 0x7f6f980afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.429+0000 7f6f95d9b640 1 -- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f98156040 msgr2=0x7f6f9806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.429+0000 7f6f95d9b640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f98156040 0x7f6f9806c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.429+0000 7f6f95d9b640 1 -- 172.21.15.38:0/2310848968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98157ac0 con 0x7f6f98156f60 2023-12-22T08:45:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.429+0000 7f6f96d9d640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f98156040 0x7f6f9806c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.429+0000 7f6f9659c640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f800047c0 0x7f6f980afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.429+0000 7f6f95d9b640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f98156f60 0x7f6f980b00b0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c000c00 tx=0x7f6f8c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.429+0000 7f6f86ffd640 1 -- 172.21.15.38:0/2310848968 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0076c0 con 0x7f6f98156f60 2023-12-22T08:45:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.429+0000 7f6f86ffd640 1 -- 172.21.15.38:0/2310848968 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c007a30 con 0x7f6f98156f60 2023-12-22T08:45:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.429+0000 7f6f86ffd640 1 -- 172.21.15.38:0/2310848968 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c006be0 con 0x7f6f98156f60 2023-12-22T08:45:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.429+0000 7f6f9c927640 1 -- 172.21.15.38:0/2310848968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f98157da0 con 0x7f6f98156f60 2023-12-22T08:45:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.429+0000 7f6f9c927640 1 -- 172.21.15.38:0/2310848968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f98158080 con 0x7f6f98156f60 2023-12-22T08:45:55.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.431+0000 7f6f9c927640 1 -- 172.21.15.38:0/2310848968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f98157920 con 0x7f6f98156f60 2023-12-22T08:45:55.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.431+0000 7f6f86ffd640 1 -- 172.21.15.38:0/2310848968 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6f8c006d40 con 0x7f6f98156f60 2023-12-22T08:45:55.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.433+0000 7f6f86ffd640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6f7806a430 0x7f6f7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.433+0000 7f6f86ffd640 1 -- 172.21.15.38:0/2310848968 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f6f8c0aa610 con 0x7f6f98156f60 2023-12-22T08:45:55.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.434+0000 7f6f9659c640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6f7806a430 0x7f6f7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:55.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.435+0000 7f6f9659c640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6f7806a430 0x7f6f7806c8f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6f88001820 tx=0x7f6f88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:55.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.438+0000 7f6f86ffd640 1 -- 172.21.15.38:0/2310848968 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6f98157920 con 0x7f6f98156f60 2023-12-22T08:45:55.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.668+0000 7f6f9c927640 1 -- 172.21.15.38:0/2310848968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f98157920 con 0x7f6f98156f60 2023-12-22T08:45:55.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.669+0000 7f6f86ffd640 1 -- 172.21.15.38:0/2310848968 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f6f98157920 con 0x7f6f98156f60 2023-12-22T08:45:55.671 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:55.671 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2128001687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2128001687},{"type":"v1","addr":"172.21.15.89:6837","nonce":2128001687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6438,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1632983842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1632983842},{"type":"v1","addr":"172.21.15.38:6833","nonce":1632983842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6444,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2613790013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2613790013},{"type":"v1","addr":"172.21.15.38:6835","nonce":2613790013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:44:55.928210+0000","modified":"2023-12-22T08:44:59.439959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6447},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6447":{"gid":6447,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2576950091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2576950091},{"type":"v1","addr":"172.21.15.89:6836","nonce":2576950091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-22T08:45:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 40 2023-12-22T08:45:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.672+0000 7f6f9c927640 1 -- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6f7806a430 msgr2=0x7f6f7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.672+0000 7f6f9c927640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6f7806a430 0x7f6f7806c8f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6f88001820 tx=0x7f6f88009040 comp rx=0 tx=0).stop 2023-12-22T08:45:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.672+0000 7f6f9c927640 1 -- 172.21.15.38:0/2310848968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f98156f60 msgr2=0x7f6f980b00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.672+0000 7f6f9c927640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f98156f60 0x7f6f980b00b0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c000c00 tx=0x7f6f8c001120 comp rx=0 tx=0).stop 2023-12-22T08:45:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.672+0000 7f6f9c927640 1 -- 172.21.15.38:0/2310848968 shutdown_connections 2023-12-22T08:45:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.672+0000 7f6f9c927640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f98156040 0x7f6f9806c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.672+0000 7f6f9c927640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6f7806a430 0x7f6f7806c8f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.672+0000 7f6f9c927640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f98156f60 0x7f6f980b00b0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.672+0000 7f6f9c927640 1 --2- 172.21.15.38:0/2310848968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f800047c0 0x7f6f980afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.672+0000 7f6f9c927640 1 -- 172.21.15.38:0/2310848968 >> 172.21.15.38:0/2310848968 conn(0x7f6f980cf070 msgr2=0x7f6f980cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.672+0000 7f6f9c927640 1 -- 172.21.15.38:0/2310848968 shutdown_connections 2023-12-22T08:45:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.672+0000 7f6f9c927640 1 -- 172.21.15.38:0/2310848968 wait complete. 2023-12-22T08:45:55.691 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:45:55.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.915+0000 7f6464bea640 1 Processor -- start 2023-12-22T08:45:55.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.915+0000 7f6464bea640 1 -- start start 2023-12-22T08:45:55.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.916+0000 7f6464bea640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f646015b420 0x7f646006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.916+0000 7f6464bea640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6460071000 0x7f646015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.917+0000 7f6464bea640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64600cdae0 con 0x7f64600a44a0 2023-12-22T08:45:55.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.917+0000 7f6464bea640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646006dec0 con 0x7f646015b420 2023-12-22T08:45:55.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.917+0000 7f6464bea640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646015b800 con 0x7f6460071000 2023-12-22T08:45:55.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.917+0000 7f645f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f646015b420 0x7f646006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:55.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.917+0000 7f645ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6460071000 0x7f646015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:55.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.917+0000 7f645f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f646015b420 0x7f646006d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:41186/0 (socket says 172.21.15.38:41186) 2023-12-22T08:45:55.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.917+0000 7f645f7fe640 1 -- 172.21.15.38:0/975501770 learned_addr learned my addr 172.21.15.38:0/975501770 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:55.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.918+0000 7f645f7fe640 1 -- 172.21.15.38:0/975501770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6460071000 msgr2=0x7f646015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:55.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.918+0000 7f645f7fe640 1 --2- 172.21.15.38:0/975501770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6460071000 0x7f646015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.918+0000 7f645f7fe640 1 -- 172.21.15.38:0/975501770 >> v1:172.21.15.89:6789/0 conn(0x7f64600a44a0 legacy=0x7f64600708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:55.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.918+0000 7f645f7fe640 1 -- 172.21.15.38:0/975501770 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64600cdd30 con 0x7f646015b420 2023-12-22T08:45:55.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.919+0000 7f645f7fe640 1 --2- 172.21.15.38:0/975501770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f646015b420 0x7f646006d980 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6450009e50 tx=0x7f645002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=392b7fc548f5bd88 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:55.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.920+0000 7f645e7fc640 1 -- 172.21.15.38:0/975501770 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645002cb00 con 0x7f646015b420 2023-12-22T08:45:55.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.920+0000 7f645e7fc640 1 -- 172.21.15.38:0/975501770 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645002cc60 con 0x7f646015b420 2023-12-22T08:45:55.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.920+0000 7f645e7fc640 1 -- 172.21.15.38:0/975501770 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64500343f0 con 0x7f646015b420 2023-12-22T08:45:55.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.921+0000 7f6464bea640 1 -- 172.21.15.38:0/975501770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f646015b420 msgr2=0x7f646006d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:55.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.921+0000 7f6464bea640 1 --2- 172.21.15.38:0/975501770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f646015b420 0x7f646006d980 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6450009e50 tx=0x7f645002bf60 comp rx=0 tx=0).stop 2023-12-22T08:45:55.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.921+0000 7f6464bea640 1 -- 172.21.15.38:0/975501770 shutdown_connections 2023-12-22T08:45:55.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.921+0000 7f6464bea640 1 --2- 172.21.15.38:0/975501770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6460071000 0x7f646015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.921+0000 7f6464bea640 1 --2- 172.21.15.38:0/975501770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f646015b420 0x7f646006d980 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.921+0000 7f6464bea640 1 -- 172.21.15.38:0/975501770 >> 172.21.15.38:0/975501770 conn(0x7f64600b1f70 msgr2=0x7f64600b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:55.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.921+0000 7f6464bea640 1 -- 172.21.15.38:0/975501770 shutdown_connections 2023-12-22T08:45:55.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.921+0000 7f6464bea640 1 -- 172.21.15.38:0/975501770 wait complete. 2023-12-22T08:45:55.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.923+0000 7f6464bea640 1 Processor -- start 2023-12-22T08:45:55.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.923+0000 7f6464bea640 1 -- start start 2023-12-22T08:45:55.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.924+0000 7f6464bea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6460071000 0x7f6460148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.924+0000 7f6464bea640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64600a44a0 0x7f64600a3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.924+0000 7f6464bea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f646015b420 0x7f64600a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.924+0000 7f6464bea640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600cbec0 con 0x7f6460071000 2023-12-22T08:45:55.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.924+0000 7f6464bea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600cb8d0 con 0x7f646015b420 2023-12-22T08:45:55.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.924+0000 7f6464bea640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6460145a70 con 0x7f64600a44a0 2023-12-22T08:45:55.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.925+0000 7f645f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6460071000 0x7f6460148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:55.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.925+0000 7f645f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6460071000 0x7f6460148530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33332/0 (socket says 172.21.15.38:33332) 2023-12-22T08:45:55.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.925+0000 7f645f7fe640 1 -- 172.21.15.38:0/3675342146 learned_addr learned my addr 172.21.15.38:0/3675342146 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.925+0000 7f645effd640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64600a44a0 0x7f64600a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.925+0000 7f645ffff640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f646015b420 0x7f64600a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.925+0000 7f645f7fe640 1 -- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64600a44a0 msgr2=0x7f64600a3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.925+0000 7f645f7fe640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64600a44a0 0x7f64600a3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.925+0000 7f645f7fe640 1 -- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f646015b420 msgr2=0x7f64600a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.925+0000 7f645f7fe640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f646015b420 0x7f64600a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.925+0000 7f645f7fe640 1 -- 172.21.15.38:0/3675342146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6450009b30 con 0x7f6460071000 2023-12-22T08:45:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.926+0000 7f645f7fe640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6460071000 0x7f6460148530 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f6450000f80 tx=0x7f6450004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.926+0000 7f6457fff640 1 -- 172.21.15.38:0/3675342146 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450009510 con 0x7f6460071000 2023-12-22T08:45:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.926+0000 7f6457fff640 1 -- 172.21.15.38:0/3675342146 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645003e450 con 0x7f6460071000 2023-12-22T08:45:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.926+0000 7f6457fff640 1 -- 172.21.15.38:0/3675342146 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645003e800 con 0x7f6460071000 2023-12-22T08:45:55.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.926+0000 7f6464bea640 1 -- 172.21.15.38:0/3675342146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6460153fd0 con 0x7f6460071000 2023-12-22T08:45:55.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.926+0000 7f6464bea640 1 -- 172.21.15.38:0/3675342146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64600cbae0 con 0x7f6460071000 2023-12-22T08:45:55.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.928+0000 7f6464bea640 1 -- 172.21.15.38:0/3675342146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64600cc000 con 0x7f6460071000 2023-12-22T08:45:55.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.928+0000 7f6457fff640 1 -- 172.21.15.38:0/3675342146 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f645003e960 con 0x7f6460071000 2023-12-22T08:45:55.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.930+0000 7f6457fff640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f644006a480 0x7f644006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:55.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.930+0000 7f6457fff640 1 -- 172.21.15.38:0/3675342146 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f64500ab6a0 con 0x7f6460071000 2023-12-22T08:45:55.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.931+0000 7f645effd640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f644006a480 0x7f644006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:55.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.932+0000 7f645effd640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f644006a480 0x7f644006c940 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f64601508e0 tx=0x7f6448009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:55.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:55.934+0000 7f6457fff640 1 -- 172.21.15.38:0/3675342146 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f64600cc000 con 0x7f6460071000 2023-12-22T08:45:56.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.166+0000 7f6464bea640 1 -- 172.21.15.38:0/3675342146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64600cc000 con 0x7f6460071000 2023-12-22T08:45:56.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.167+0000 7f6457fff640 1 -- 172.21.15.38:0/3675342146 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f64600cc000 con 0x7f6460071000 2023-12-22T08:45:56.169 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:56.169 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2128001687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2128001687},{"type":"v1","addr":"172.21.15.89:6837","nonce":2128001687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6438,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1632983842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1632983842},{"type":"v1","addr":"172.21.15.38:6833","nonce":1632983842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6444,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2613790013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2613790013},{"type":"v1","addr":"172.21.15.38:6835","nonce":2613790013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:44:55.928210+0000","modified":"2023-12-22T08:44:59.439959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6447},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6447":{"gid":6447,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6836/2576950091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2576950091},{"type":"v1","addr":"172.21.15.89:6836","nonce":2576950091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-22T08:45:56.169 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 40 2023-12-22T08:45:56.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.170+0000 7f6464bea640 1 -- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f644006a480 msgr2=0x7f644006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:56.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.170+0000 7f6464bea640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f644006a480 0x7f644006c940 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f64601508e0 tx=0x7f6448009040 comp rx=0 tx=0).stop 2023-12-22T08:45:56.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.170+0000 7f6464bea640 1 -- 172.21.15.38:0/3675342146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6460071000 msgr2=0x7f6460148530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:56.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.170+0000 7f6464bea640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6460071000 0x7f6460148530 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f6450000f80 tx=0x7f6450004a40 comp rx=0 tx=0).stop 2023-12-22T08:45:56.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.170+0000 7f6464bea640 1 -- 172.21.15.38:0/3675342146 shutdown_connections 2023-12-22T08:45:56.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.170+0000 7f6464bea640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f646015b420 0x7f64600a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.170+0000 7f6464bea640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64600a44a0 0x7f64600a3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.170+0000 7f6464bea640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f644006a480 0x7f644006c940 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.170+0000 7f6464bea640 1 --2- 172.21.15.38:0/3675342146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6460071000 0x7f6460148530 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.170+0000 7f6464bea640 1 -- 172.21.15.38:0/3675342146 >> 172.21.15.38:0/3675342146 conn(0x7f64600b1f70 msgr2=0x7f646006c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:56.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.170+0000 7f6464bea640 1 -- 172.21.15.38:0/3675342146 shutdown_connections 2023-12-22T08:45:56.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.170+0000 7f6464bea640 1 -- 172.21.15.38:0/3675342146 wait complete. 2023-12-22T08:45:56.191 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:45:56.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.414+0000 7f20b6bea640 1 Processor -- start 2023-12-22T08:45:56.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.414+0000 7f20b6bea640 1 -- start start 2023-12-22T08:45:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.416+0000 7f20b6bea640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f20b015d470 0x7f20b00b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.416+0000 7f20b6bea640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b0071ea0 0x7f20b00b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.416+0000 7f20b6bea640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b00ac8e0 con 0x7f20b015d850 2023-12-22T08:45:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.416+0000 7f20b6bea640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b00ada40 con 0x7f20b015d470 2023-12-22T08:45:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.416+0000 7f20b6bea640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00b4550 con 0x7f20b0071ea0 2023-12-22T08:45:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.416+0000 7f20b4986640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f20b015d470 0x7f20b00b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.416+0000 7f20b4986640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f20b015d470 0x7f20b00b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33348/0 (socket says 172.21.15.38:33348) 2023-12-22T08:45:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.416+0000 7f20b4986640 1 -- 172.21.15.38:0/2856830204 learned_addr learned my addr 172.21.15.38:0/2856830204 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.416+0000 7f20affff640 1 --1- 172.21.15.38:0/2856830204 >> v1:172.21.15.38:6789/0 conn(0x7f20b015d850 0x7f20b00ad330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34028/0 (socket says 172.21.15.38:34028) 2023-12-22T08:45:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.417+0000 7f20b5187640 1 --2- 172.21.15.38:0/2856830204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b0071ea0 0x7f20b00b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.417+0000 7f20b4986640 1 -- 172.21.15.38:0/2856830204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b0071ea0 msgr2=0x7f20b00b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.417+0000 7f20b4986640 1 --2- 172.21.15.38:0/2856830204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b0071ea0 0x7f20b00b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.417+0000 7f20b4986640 1 -- 172.21.15.38:0/2856830204 >> v1:172.21.15.38:6789/0 conn(0x7f20b015d850 legacy=0x7f20b00ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.417+0000 7f20b4986640 1 -- 172.21.15.38:0/2856830204 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00b4940 con 0x7f20b015d470 2023-12-22T08:45:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.417+0000 7f20b5187640 1 --2- 172.21.15.38:0/2856830204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b0071ea0 0x7f20b00b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.418+0000 7f20b4986640 1 --2- 172.21.15.38:0/2856830204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20b015d470 0x7f20b00b4010 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009870 tx=0x7f20a402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54b2fffc14e5518 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:56.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.418+0000 7f20af7fe640 1 -- 172.21.15.38:0/2856830204 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4030840 con 0x7f20b015d470 2023-12-22T08:45:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.418+0000 7f20af7fe640 1 -- 172.21.15.38:0/2856830204 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a40309a0 con 0x7f20b015d470 2023-12-22T08:45:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.418+0000 7f20af7fe640 1 -- 172.21.15.38:0/2856830204 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4030d30 con 0x7f20b015d470 2023-12-22T08:45:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.419+0000 7f20b6bea640 1 -- 172.21.15.38:0/2856830204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20b015d470 msgr2=0x7f20b00b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.419+0000 7f20b6bea640 1 --2- 172.21.15.38:0/2856830204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20b015d470 0x7f20b00b4010 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009870 tx=0x7f20a402b980 comp rx=0 tx=0).stop 2023-12-22T08:45:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.419+0000 7f20b6bea640 1 -- 172.21.15.38:0/2856830204 shutdown_connections 2023-12-22T08:45:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.419+0000 7f20b6bea640 1 --2- 172.21.15.38:0/2856830204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b0071ea0 0x7f20b00b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.419+0000 7f20b6bea640 1 --2- 172.21.15.38:0/2856830204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20b015d470 0x7f20b00b4010 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.419+0000 7f20b6bea640 1 -- 172.21.15.38:0/2856830204 >> 172.21.15.38:0/2856830204 conn(0x7f20b00cf070 msgr2=0x7f20b00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.419+0000 7f20b6bea640 1 -- 172.21.15.38:0/2856830204 shutdown_connections 2023-12-22T08:45:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.419+0000 7f20b6bea640 1 -- 172.21.15.38:0/2856830204 wait complete. 2023-12-22T08:45:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.421+0000 7f20b6bea640 1 Processor -- start 2023-12-22T08:45:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.421+0000 7f20b6bea640 1 -- start start 2023-12-22T08:45:56.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.422+0000 7f20b6bea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b0071ea0 0x7f20b015f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.422+0000 7f20b6bea640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b015d470 0x7f20b01602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.422+0000 7f20b6bea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20b015d850 0x7f20b01534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.422+0000 7f20b6bea640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b015f720 con 0x7f20b015d850 2023-12-22T08:45:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.422+0000 7f20b6bea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b015e140 con 0x7f20b0071ea0 2023-12-22T08:45:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.422+0000 7f20b6bea640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b015e420 con 0x7f20b015d470 2023-12-22T08:45:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.422+0000 7f20b5187640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20b015d850 0x7f20b01534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.423+0000 7f20b5187640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20b015d850 0x7f20b01534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33358/0 (socket says 172.21.15.38:33358) 2023-12-22T08:45:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.423+0000 7f20b5187640 1 -- 172.21.15.38:0/3027210811 learned_addr learned my addr 172.21.15.38:0/3027210811 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.423+0000 7f20b4986640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b0071ea0 0x7f20b015f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.423+0000 7f20b5187640 1 -- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b015d470 msgr2=0x7f20b01602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.423+0000 7f20affff640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b015d470 0x7f20b01602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.423+0000 7f20b5187640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b015d470 0x7f20b01602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.423+0000 7f20b5187640 1 -- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b0071ea0 msgr2=0x7f20b015f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.423+0000 7f20b5187640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b0071ea0 0x7f20b015f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.423+0000 7f20b5187640 1 -- 172.21.15.38:0/3027210811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a40094d0 con 0x7f20b015d850 2023-12-22T08:45:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.423+0000 7f20b4986640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b0071ea0 0x7f20b015f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:56.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.423+0000 7f20b5187640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20b015d850 0x7f20b01534d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f20a800cef0 tx=0x7f20a800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:56.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.423+0000 7f20ad7fa640 1 -- 172.21.15.38:0/3027210811 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800d840 con 0x7f20b015d850 2023-12-22T08:45:56.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.424+0000 7f20ad7fa640 1 -- 172.21.15.38:0/3027210811 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a800d9c0 con 0x7f20b015d850 2023-12-22T08:45:56.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.424+0000 7f20b6bea640 1 -- 172.21.15.38:0/3027210811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b015e700 con 0x7f20b015d850 2023-12-22T08:45:56.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.424+0000 7f20ad7fa640 1 -- 172.21.15.38:0/3027210811 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800dd70 con 0x7f20b015d850 2023-12-22T08:45:56.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.424+0000 7f20b6bea640 1 -- 172.21.15.38:0/3027210811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b015ecc0 con 0x7f20b015d850 2023-12-22T08:45:56.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.425+0000 7f20b6bea640 1 -- 172.21.15.38:0/3027210811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b0061910 con 0x7f20b015d850 2023-12-22T08:45:56.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.426+0000 7f20ad7fa640 1 -- 172.21.15.38:0/3027210811 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f20a801e3b0 con 0x7f20b015d850 2023-12-22T08:45:56.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.427+0000 7f20ad7fa640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f209406a430 0x7f209406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.427+0000 7f20ad7fa640 1 -- 172.21.15.38:0/3027210811 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f20a8089450 con 0x7f20b015d850 2023-12-22T08:45:56.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.427+0000 7f20b4986640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f209406a430 0x7f209406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.428+0000 7f20b4986640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f209406a430 0x7f209406c8f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f20a4036000 tx=0x7f20a403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.431+0000 7f20ad7fa640 1 -- 172.21.15.38:0/3027210811 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f20a8054a90 con 0x7f20b015d850 2023-12-22T08:45:56.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.627+0000 7f20b6bea640 1 -- 172.21.15.38:0/3027210811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20b0160f20 con 0x7f20b015d850 2023-12-22T08:45:56.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.629+0000 7f20ad7fa640 1 -- 172.21.15.38:0/3027210811 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16138 (secure 0 0 0) 0x7f20a80580b0 con 0x7f20b015d850 2023-12-22T08:45:56.631 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:45:56.631 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":98,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:45:55.366696+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:44:53.802762+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-22T08:44:54.948144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.1b","mappings":[{"from":2,"to":7}]},{"pgid":"11.14","mappings":[{"from":1,"to":4}]},{"pgid":"11.16","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:45:56.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.632+0000 7f20b6bea640 1 -- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f209406a430 msgr2=0x7f209406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.632+0000 7f20b6bea640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f209406a430 0x7f209406c8f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f20a4036000 tx=0x7f20a403b040 comp rx=0 tx=0).stop 2023-12-22T08:45:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.632+0000 7f20b6bea640 1 -- 172.21.15.38:0/3027210811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20b015d850 msgr2=0x7f20b01534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.632+0000 7f20b6bea640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20b015d850 0x7f20b01534d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f20a800cef0 tx=0x7f20a800a710 comp rx=0 tx=0).stop 2023-12-22T08:45:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.632+0000 7f20b6bea640 1 -- 172.21.15.38:0/3027210811 shutdown_connections 2023-12-22T08:45:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.632+0000 7f20b6bea640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f209406a430 0x7f209406c8f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.632+0000 7f20b6bea640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20b015d850 0x7f20b01534d0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.632+0000 7f20b6bea640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20b015d470 0x7f20b01602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.632+0000 7f20b6bea640 1 --2- 172.21.15.38:0/3027210811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20b0071ea0 0x7f20b015f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.632+0000 7f20b6bea640 1 -- 172.21.15.38:0/3027210811 >> 172.21.15.38:0/3027210811 conn(0x7f20b00cf070 msgr2=0x7f20b00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.632+0000 7f20b6bea640 1 -- 172.21.15.38:0/3027210811 shutdown_connections 2023-12-22T08:45:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.632+0000 7f20b6bea640 1 -- 172.21.15.38:0/3027210811 wait complete. 2023-12-22T08:45:56.652 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T08:45:56.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.877+0000 7f123890a640 1 Processor -- start 2023-12-22T08:45:56.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.878+0000 7f123890a640 1 -- start start 2023-12-22T08:45:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.879+0000 7f123890a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f123415e740 0x7f123415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.879+0000 7f123890a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123415eb20 con 0x7f12340b3f90 2023-12-22T08:45:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.879+0000 7f123890a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1234070770 con 0x7f123406ca50 2023-12-22T08:45:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.879+0000 7f123890a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123406e650 con 0x7f123415e740 2023-12-22T08:45:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.880+0000 7f1232d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f12340b3f90 0x7f1234070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34032/0 (socket says 172.21.15.38:34032) 2023-12-22T08:45:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.880+0000 7f1232d9d640 1 -- 172.21.15.38:0/3872378270 learned_addr learned my addr 172.21.15.38:0/3872378270 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.880+0000 7f123259c640 1 --2- 172.21.15.38:0/3872378270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f123415e740 0x7f123415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.880+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946168800 0 0) 0x7f123415eb20 con 0x7f12340b3f90 2023-12-22T08:45:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1220003520 con 0x7f12340b3f90 2023-12-22T08:45:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4057348920 0 0) 0x7f1220003520 con 0x7f12340b3f90 2023-12-22T08:45:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f123415e740 msgr2=0x7f123415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 --2- 172.21.15.38:0/3872378270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f123415e740 0x7f123415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 >> v1:172.21.15.89:6789/0 conn(0x7f123406ca50 legacy=0x7f12340b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123406d180 con 0x7f12340b3f90 2023-12-22T08:45:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f122c0019f0 con 0x7f12340b3f90 2023-12-22T08:45:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 >> v1:172.21.15.38:6789/0 conn(0x7f12340b3f90 legacy=0x7f1234070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 --2- 172.21.15.38:0/3872378270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f123415e740 0x7f12200039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 --2- 172.21.15.38:0/3872378270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1220003ee0 0x7f12200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 --2- 172.21.15.38:0/3872378270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1220004d00 0x7f1220005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123406e650 con 0x7f1220004d00 2023-12-22T08:45:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122000bb70 con 0x7f1220003ee0 2023-12-22T08:45:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.881+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122000bd30 con 0x7f123415e740 2023-12-22T08:45:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.882+0000 7f1232d9d640 1 --2- 172.21.15.38:0/3872378270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1220004d00 0x7f1220005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.882+0000 7f122bfff640 1 --2- 172.21.15.38:0/3872378270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1220003ee0 0x7f12200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.882+0000 7f123259c640 1 --2- 172.21.15.38:0/3872378270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f123415e740 0x7f12200039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.882+0000 7f1232d9d640 1 -- 172.21.15.38:0/3872378270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f123415e740 msgr2=0x7f12200039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.882+0000 7f1232d9d640 1 --2- 172.21.15.38:0/3872378270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f123415e740 0x7f12200039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.882+0000 7f1232d9d640 1 -- 172.21.15.38:0/3872378270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1220003ee0 msgr2=0x7f12200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.882+0000 7f1232d9d640 1 --2- 172.21.15.38:0/3872378270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1220003ee0 0x7f12200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.882+0000 7f1232d9d640 1 -- 172.21.15.38:0/3872378270 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1220003520 con 0x7f1220004d00 2023-12-22T08:45:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.883+0000 7f1232d9d640 1 --2- 172.21.15.38:0/3872378270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1220004d00 0x7f1220005180 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f122c00a7e0 tx=0x7f12200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dec569836a18257 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.883+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c034630 con 0x7f1220004d00 2023-12-22T08:45:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.883+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c02f070 con 0x7f1220004d00 2023-12-22T08:45:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.883+0000 7f1231d9b640 1 -- 172.21.15.38:0/3872378270 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c034a10 con 0x7f1220004d00 2023-12-22T08:45:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.884+0000 7f123890a640 1 -- 172.21.15.38:0/3872378270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1220004d00 msgr2=0x7f1220005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.884+0000 7f123890a640 1 --2- 172.21.15.38:0/3872378270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1220004d00 0x7f1220005180 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f122c00a7e0 tx=0x7f12200057f0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.884+0000 7f1232d9d640 1 -- 172.21.15.38:0/3872378270 reap_dead start 2023-12-22T08:45:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.884+0000 7f123890a640 1 -- 172.21.15.38:0/3872378270 shutdown_connections 2023-12-22T08:45:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.884+0000 7f123890a640 1 -- 172.21.15.38:0/3872378270 >> 172.21.15.38:0/3872378270 conn(0x7f12340cfea0 msgr2=0x7f12340d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.884+0000 7f123890a640 1 -- 172.21.15.38:0/3872378270 shutdown_connections 2023-12-22T08:45:56.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.884+0000 7f123890a640 1 -- 172.21.15.38:0/3872378270 wait complete. 2023-12-22T08:45:56.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.886+0000 7f123890a640 1 Processor -- start 2023-12-22T08:45:56.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.886+0000 7f123890a640 1 -- start start 2023-12-22T08:45:56.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.887+0000 7f123890a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1220004d00 0x7f12340b8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.887+0000 7f123890a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1234152db0 0x7f12341f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.887+0000 7f123890a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12341f6560 0x7f12341f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.887+0000 7f123890a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1234157cb0 con 0x7f1220004d00 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.887+0000 7f123890a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340b6d60 con 0x7f1234152db0 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.887+0000 7f123890a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12340b8b80 con 0x7f12341f6560 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.887+0000 7f123259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1220004d00 0x7f12340b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.888+0000 7f123259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1220004d00 0x7f12340b8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33378/0 (socket says 172.21.15.38:33378) 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.888+0000 7f123259c640 1 -- 172.21.15.38:0/734383755 learned_addr learned my addr 172.21.15.38:0/734383755 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.888+0000 7f122bfff640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1234152db0 0x7f12341f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.888+0000 7f1232d9d640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12341f6560 0x7f12341f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.888+0000 7f123259c640 1 -- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12341f6560 msgr2=0x7f12341f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.888+0000 7f123259c640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12341f6560 0x7f12341f69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.888+0000 7f123259c640 1 -- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1234152db0 msgr2=0x7f12341f6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.888+0000 7f123259c640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1234152db0 0x7f12341f6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.888+0000 7f123259c640 1 -- 172.21.15.38:0/734383755 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12341571c0 con 0x7f1220004d00 2023-12-22T08:45:56.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.888+0000 7f122bfff640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1234152db0 0x7f12341f6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:56.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.888+0000 7f123259c640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1220004d00 0x7f12340b8640 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f1224011600 tx=0x7f1224011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:56.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.888+0000 7f122affd640 1 -- 172.21.15.38:0/734383755 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400f920 con 0x7f1220004d00 2023-12-22T08:45:56.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.889+0000 7f122affd640 1 -- 172.21.15.38:0/734383755 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122400fa80 con 0x7f1220004d00 2023-12-22T08:45:56.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.889+0000 7f122affd640 1 -- 172.21.15.38:0/734383755 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400fdf0 con 0x7f1220004d00 2023-12-22T08:45:56.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.889+0000 7f123890a640 1 -- 172.21.15.38:0/734383755 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1234159470 con 0x7f1220004d00 2023-12-22T08:45:56.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.889+0000 7f123890a640 1 -- 172.21.15.38:0/734383755 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12341576f0 con 0x7f1220004d00 2023-12-22T08:45:56.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.890+0000 7f123890a640 1 -- 172.21.15.38:0/734383755 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1234159240 con 0x7f1220004d00 2023-12-22T08:45:56.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.891+0000 7f122affd640 1 -- 172.21.15.38:0/734383755 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1224015460 con 0x7f1220004d00 2023-12-22T08:45:56.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.892+0000 7f122affd640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f121406a430 0x7f121406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:56.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.892+0000 7f122affd640 1 -- 172.21.15.38:0/734383755 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f1224088f50 con 0x7f1220004d00 2023-12-22T08:45:56.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.892+0000 7f122bfff640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f121406a430 0x7f121406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.894+0000 7f122bfff640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f121406a430 0x7f121406c8f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1234153600 tx=0x7f121c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:56.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:56.897+0000 7f122affd640 1 -- 172.21.15.38:0/734383755 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1234159240 con 0x7f1220004d00 2023-12-22T08:45:57.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.129+0000 7f123890a640 1 -- 172.21.15.38:0/734383755 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1234061910 con 0x7f1220004d00 2023-12-22T08:45:57.132 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:45:57.131+0000 7f0a26ee3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T08:45:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.150+0000 7f122affd640 1 -- 172.21.15.38:0/734383755 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1224054440 con 0x7f1220004d00 2023-12-22T08:45:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T08:45:57.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.153+0000 7f123890a640 1 -- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f121406a430 msgr2=0x7f121406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:57.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.153+0000 7f123890a640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f121406a430 0x7f121406c8f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1234153600 tx=0x7f121c009040 comp rx=0 tx=0).stop 2023-12-22T08:45:57.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.153+0000 7f123890a640 1 -- 172.21.15.38:0/734383755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1220004d00 msgr2=0x7f12340b8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:57.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.153+0000 7f123890a640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1220004d00 0x7f12340b8640 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f1224011600 tx=0x7f1224011ac0 comp rx=0 tx=0).stop 2023-12-22T08:45:57.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.153+0000 7f123890a640 1 -- 172.21.15.38:0/734383755 shutdown_connections 2023-12-22T08:45:57.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.153+0000 7f123890a640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12341f6560 0x7f12341f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:57.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.153+0000 7f123890a640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1234152db0 0x7f12341f6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:57.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.153+0000 7f123890a640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f121406a430 0x7f121406c8f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:57.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.153+0000 7f123890a640 1 --2- 172.21.15.38:0/734383755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1220004d00 0x7f12340b8640 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:57.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.153+0000 7f123890a640 1 -- 172.21.15.38:0/734383755 >> 172.21.15.38:0/734383755 conn(0x7f12340cfea0 msgr2=0x7f1234153cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:57.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.153+0000 7f123890a640 1 -- 172.21.15.38:0/734383755 shutdown_connections 2023-12-22T08:45:57.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.153+0000 7f123890a640 1 -- 172.21.15.38:0/734383755 wait complete. 2023-12-22T08:45:57.173 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T08:45:57.266 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-22T08:45:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.398+0000 7f7fbb477640 1 Processor -- start 2023-12-22T08:45:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.398+0000 7f7fbb477640 1 -- start start 2023-12-22T08:45:57.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.400+0000 7f7fbb477640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7fb40ce910 0x7f7fb4166100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:57.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.400+0000 7f7fbb477640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb406c1e0 con 0x7f7fb415b3d0 2023-12-22T08:45:57.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.400+0000 7f7fbb477640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb40cd620 con 0x7f7fb415b7b0 2023-12-22T08:45:57.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.400+0000 7f7fbb477640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb4070100 con 0x7f7fb40ce910 2023-12-22T08:45:57.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.400+0000 7f7fb9213640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7fb415b3d0 0x7f7fb40ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34044/0 (socket says 172.21.15.38:34044) 2023-12-22T08:45:57.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.400+0000 7f7fb9213640 1 -- 172.21.15.38:0/1051973016 learned_addr learned my addr 172.21.15.38:0/1051973016 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:57.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661893756 0 0) 0x7f7fb406c1e0 con 0x7f7fb415b3d0 2023-12-22T08:45:57.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fa0003520 con 0x7f7fb415b3d0 2023-12-22T08:45:57.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fb9a14640 1 --2- 172.21.15.38:0/1051973016 >> v2:172.21.15.89:3300/0 conn(0x7f7fb40ce910 0x7f7fb4166100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:57.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 406413222 0 0) 0x7f7fa0003520 con 0x7f7fb415b3d0 2023-12-22T08:45:57.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 >> v2:172.21.15.89:3300/0 conn(0x7f7fb40ce910 msgr2=0x7f7fb4166100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:57.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 --2- 172.21.15.38:0/1051973016 >> v2:172.21.15.89:3300/0 conn(0x7f7fb40ce910 0x7f7fb4166100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:57.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 >> v1:172.21.15.89:6789/0 conn(0x7f7fb415b7b0 legacy=0x7f7fb40ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:57.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb40cd900 con 0x7f7fb415b3d0 2023-12-22T08:45:57.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f7fb0001670 con 0x7f7fb415b3d0 2023-12-22T08:45:57.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 >> v1:172.21.15.38:6789/0 conn(0x7f7fb415b3d0 legacy=0x7f7fb40ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:57.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 --2- 172.21.15.38:0/1051973016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa0003970 0x7f7fa0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:57.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 --2- 172.21.15.38:0/1051973016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa00047c0 0x7f7fa0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:57.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 --2- 172.21.15.38:0/1051973016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fa00052a0 0x7f7fa000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:57.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4070100 con 0x7f7fa00052a0 2023-12-22T08:45:57.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa000c170 con 0x7f7fa00047c0 2023-12-22T08:45:57.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.401+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa000c330 con 0x7f7fa0003970 2023-12-22T08:45:57.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.402+0000 7f7fb9a14640 1 --2- 172.21.15.38:0/1051973016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fa00052a0 0x7f7fa000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:57.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.402+0000 7f7fb9213640 1 --2- 172.21.15.38:0/1051973016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa0003970 0x7f7fa0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:57.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.402+0000 7f7fb8a12640 1 --2- 172.21.15.38:0/1051973016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa00047c0 0x7f7fa0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:57.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.402+0000 7f7fb9a14640 1 -- 172.21.15.38:0/1051973016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa0003970 msgr2=0x7f7fa0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:57.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.402+0000 7f7fb9a14640 1 --2- 172.21.15.38:0/1051973016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa0003970 0x7f7fa0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:57.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.402+0000 7f7fb9a14640 1 -- 172.21.15.38:0/1051973016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa00047c0 msgr2=0x7f7fa0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:57.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.402+0000 7f7fb9a14640 1 --2- 172.21.15.38:0/1051973016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fa00047c0 0x7f7fa0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:57.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.402+0000 7f7fb9a14640 1 -- 172.21.15.38:0/1051973016 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa0003520 con 0x7f7fa00052a0 2023-12-22T08:45:57.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.403+0000 7f7fb9a14640 1 -- 172.21.15.38:0/1051973016 reap_dead start 2023-12-22T08:45:57.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.403+0000 7f7fb9a14640 1 --2- 172.21.15.38:0/1051973016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fa00052a0 0x7f7fa000b980 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009f90 tx=0x7f7fa00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8855033ae93d3c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:57.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.404+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac02cc20 con 0x7f7fa00052a0 2023-12-22T08:45:57.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.404+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac00f040 con 0x7f7fa00052a0 2023-12-22T08:45:57.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.404+0000 7f7fabfff640 1 -- 172.21.15.38:0/1051973016 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac003990 con 0x7f7fa00052a0 2023-12-22T08:45:57.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.404+0000 7f7fbb477640 1 -- 172.21.15.38:0/1051973016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fa00052a0 msgr2=0x7f7fa000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:57.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.404+0000 7f7fbb477640 1 --2- 172.21.15.38:0/1051973016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fa00052a0 0x7f7fa000b980 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009f90 tx=0x7f7fa00057f0 comp rx=0 tx=0).stop 2023-12-22T08:45:57.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.404+0000 7f7fbb477640 1 -- 172.21.15.38:0/1051973016 shutdown_connections 2023-12-22T08:45:57.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.404+0000 7f7fbb477640 1 --2- 172.21.15.38:0/1051973016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fa00052a0 0x7f7fa000b980 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:57.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.404+0000 7f7fbb477640 1 -- 172.21.15.38:0/1051973016 >> 172.21.15.38:0/1051973016 conn(0x7f7fb40cba10 msgr2=0x7f7fb40cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:57.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.404+0000 7f7fbb477640 1 -- 172.21.15.38:0/1051973016 shutdown_connections 2023-12-22T08:45:57.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.405+0000 7f7fbb477640 1 -- 172.21.15.38:0/1051973016 wait complete. 2023-12-22T08:45:57.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.406+0000 7f7fbb477640 1 Processor -- start 2023-12-22T08:45:57.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.407+0000 7f7fbb477640 1 -- start start 2023-12-22T08:45:57.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.407+0000 7f7fbb477640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa00052a0 0x7f7fb40b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:57.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fbb477640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb415a4c0 0x7f7fb40b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:57.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fbb477640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fb40b07e0 0x7f7fb40b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:57.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fbb477640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4152860 con 0x7f7fb40b07e0 2023-12-22T08:45:57.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fbb477640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb41560a0 con 0x7f7fb415a4c0 2023-12-22T08:45:57.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fbb477640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4156380 con 0x7f7fa00052a0 2023-12-22T08:45:57.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fb9a14640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fb40b07e0 0x7f7fb40b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:57.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fb9a14640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fb40b07e0 0x7f7fb40b0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33396/0 (socket says 172.21.15.38:33396) 2023-12-22T08:45:57.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fb9a14640 1 -- 172.21.15.38:0/2017680134 learned_addr learned my addr 172.21.15.38:0/2017680134 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:57.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fb8a12640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb415a4c0 0x7f7fb40b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:57.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fb9213640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa00052a0 0x7f7fb40b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:57.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fb9a14640 1 -- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa00052a0 msgr2=0x7f7fb40b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:57.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fb9a14640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa00052a0 0x7f7fb40b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:57.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fb9a14640 1 -- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb415a4c0 msgr2=0x7f7fb40b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:57.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fb9a14640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb415a4c0 0x7f7fb40b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:57.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fb9a14640 1 -- 172.21.15.38:0/2017680134 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4156660 con 0x7f7fb40b07e0 2023-12-22T08:45:57.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.408+0000 7f7fb9213640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa00052a0 0x7f7fb40b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:57.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.409+0000 7f7fb9a14640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fb40b07e0 0x7f7fb40b0c60 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f7fac02c690 tx=0x7f7fac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:57.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.409+0000 7f7fa9ffb640 1 -- 172.21.15.38:0/2017680134 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac02cea0 con 0x7f7fb40b07e0 2023-12-22T08:45:57.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.409+0000 7f7fa9ffb640 1 -- 172.21.15.38:0/2017680134 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac004230 con 0x7f7fb40b07e0 2023-12-22T08:45:57.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.409+0000 7f7fa9ffb640 1 -- 172.21.15.38:0/2017680134 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac0045e0 con 0x7f7fb40b07e0 2023-12-22T08:45:57.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.409+0000 7f7fbb477640 1 -- 172.21.15.38:0/2017680134 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb4156940 con 0x7f7fb40b07e0 2023-12-22T08:45:57.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.409+0000 7f7fbb477640 1 -- 172.21.15.38:0/2017680134 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb4157140 con 0x7f7fb40b07e0 2023-12-22T08:45:57.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.410+0000 7f7fbb477640 1 -- 172.21.15.38:0/2017680134 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb4157300 con 0x7f7fb40b07e0 2023-12-22T08:45:57.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.411+0000 7f7fa9ffb640 1 -- 172.21.15.38:0/2017680134 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7fac004740 con 0x7f7fb40b07e0 2023-12-22T08:45:57.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.412+0000 7f7fa9ffb640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f9806a460 0x7f7f9806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:57.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.412+0000 7f7fa9ffb640 1 -- 172.21.15.38:0/2017680134 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5882+0+0 (secure 0 0 0) 0x7f7fac0aaf90 con 0x7f7fb40b07e0 2023-12-22T08:45:57.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.413+0000 7f7fb9213640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f9806a460 0x7f7f9806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:57.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.414+0000 7f7fb9213640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f9806a460 0x7f7f9806c920 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0001eb0 tx=0x7f7fb0000f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:57.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.417+0000 7f7fa9ffb640 1 -- 172.21.15.38:0/2017680134 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7fac0765e0 con 0x7f7fb40b07e0 2023-12-22T08:45:57.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:57.652+0000 7f7fbb477640 1 -- 172.21.15.38:0/2017680134 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7fb40ae070 con 0x7f7fb40b07e0 2023-12-22T08:45:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.156+0000 7f7fa9ffb640 1 -- 172.21.15.38:0/2017680134 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7fac079c00 con 0x7f7fb40b07e0 2023-12-22T08:45:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.159+0000 7f7fbb477640 1 -- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f9806a460 msgr2=0x7f7f9806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.160+0000 7f7fbb477640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f9806a460 0x7f7f9806c920 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0001eb0 tx=0x7f7fb0000f50 comp rx=0 tx=0).stop 2023-12-22T08:45:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.160+0000 7f7fbb477640 1 -- 172.21.15.38:0/2017680134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fb40b07e0 msgr2=0x7f7fb40b0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.160+0000 7f7fbb477640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fb40b07e0 0x7f7fb40b0c60 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f7fac02c690 tx=0x7f7fac009750 comp rx=0 tx=0).stop 2023-12-22T08:45:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.160+0000 7f7fbb477640 1 -- 172.21.15.38:0/2017680134 shutdown_connections 2023-12-22T08:45:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.160+0000 7f7fbb477640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f9806a460 0x7f7f9806c920 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.160+0000 7f7fbb477640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fb40b07e0 0x7f7fb40b0c60 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.160+0000 7f7fbb477640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb415a4c0 0x7f7fb40b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.160+0000 7f7fbb477640 1 --2- 172.21.15.38:0/2017680134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fa00052a0 0x7f7fb40b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.160+0000 7f7fbb477640 1 -- 172.21.15.38:0/2017680134 >> 172.21.15.38:0/2017680134 conn(0x7f7fb40cba10 msgr2=0x7f7fb4070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.160+0000 7f7fbb477640 1 -- 172.21.15.38:0/2017680134 shutdown_connections 2023-12-22T08:45:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.160+0000 7f7fbb477640 1 -- 172.21.15.38:0/2017680134 wait complete. 2023-12-22T08:45:58.184 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T08:45:58.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.415+0000 7f8464c17640 1 Processor -- start 2023-12-22T08:45:58.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.415+0000 7f8464c17640 1 -- start start 2023-12-22T08:45:58.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.417+0000 7f8464c17640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f846015b480 0x7f84600cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:58.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.417+0000 7f8464c17640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f84600b3600 0x7f84600b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:58.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.417+0000 7f8464c17640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8460071b70 con 0x7f84600cc580 2023-12-22T08:45:58.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.417+0000 7f8464c17640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84600b3fd0 con 0x7f84600b3600 2023-12-22T08:45:58.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.417+0000 7f8464c17640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8460070770 con 0x7f846015b480 2023-12-22T08:45:58.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.417+0000 7f845ed9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f84600b3600 0x7f84600b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:58.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.418+0000 7f845ed9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f84600b3600 0x7f84600b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33412/0 (socket says 172.21.15.38:33412) 2023-12-22T08:45:58.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.418+0000 7f845ed9d640 1 -- 172.21.15.38:0/1962309693 learned_addr learned my addr 172.21.15.38:0/1962309693 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:58.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.418+0000 7f845e59c640 1 --2- 172.21.15.38:0/1962309693 >> v2:172.21.15.89:3300/0 conn(0x7f846015b480 0x7f84600cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:58.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.418+0000 7f845ed9d640 1 -- 172.21.15.38:0/1962309693 >> v2:172.21.15.89:3300/0 conn(0x7f846015b480 msgr2=0x7f84600cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:58.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.418+0000 7f845ed9d640 1 --2- 172.21.15.38:0/1962309693 >> v2:172.21.15.89:3300/0 conn(0x7f846015b480 0x7f84600cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:58.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.418+0000 7f845ed9d640 1 -- 172.21.15.38:0/1962309693 >> v1:172.21.15.89:6789/0 conn(0x7f84600cc580 legacy=0x7f8460071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:58.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.418+0000 7f845ed9d640 1 -- 172.21.15.38:0/1962309693 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84600b17a0 con 0x7f84600b3600 2023-12-22T08:45:58.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.419+0000 7f845ed9d640 1 --2- 172.21.15.38:0/1962309693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84600b3600 0x7f84600b3a90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f84600cefa0 tx=0x7f845802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4982af479f79932b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:58.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.420+0000 7f845d59a640 1 -- 172.21.15.38:0/1962309693 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845802ca80 con 0x7f84600b3600 2023-12-22T08:45:58.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.420+0000 7f845d59a640 1 -- 172.21.15.38:0/1962309693 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845802cbe0 con 0x7f84600b3600 2023-12-22T08:45:58.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.420+0000 7f845d59a640 1 -- 172.21.15.38:0/1962309693 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84580343f0 con 0x7f84600b3600 2023-12-22T08:45:58.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.420+0000 7f8464c17640 1 -- 172.21.15.38:0/1962309693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84600b3600 msgr2=0x7f84600b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:58.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.420+0000 7f8464c17640 1 --2- 172.21.15.38:0/1962309693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84600b3600 0x7f84600b3a90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f84600cefa0 tx=0x7f845802bee0 comp rx=0 tx=0).stop 2023-12-22T08:45:58.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.421+0000 7f8464c17640 1 -- 172.21.15.38:0/1962309693 shutdown_connections 2023-12-22T08:45:58.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.421+0000 7f8464c17640 1 --2- 172.21.15.38:0/1962309693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84600b3600 0x7f84600b3a90 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:58.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.421+0000 7f8464c17640 1 --2- 172.21.15.38:0/1962309693 >> v2:172.21.15.89:3300/0 conn(0x7f846015b480 0x7f84600cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:58.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.421+0000 7f8464c17640 1 -- 172.21.15.38:0/1962309693 >> 172.21.15.38:0/1962309693 conn(0x7f846006f880 msgr2=0x7f84600b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:58.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.421+0000 7f8464c17640 1 -- 172.21.15.38:0/1962309693 shutdown_connections 2023-12-22T08:45:58.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.421+0000 7f8464c17640 1 -- 172.21.15.38:0/1962309693 wait complete. 2023-12-22T08:45:58.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.423+0000 7f8464c17640 1 Processor -- start 2023-12-22T08:45:58.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.423+0000 7f8464c17640 1 -- start start 2023-12-22T08:45:58.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.425+0000 7f8464c17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84600b3600 0x7f8460143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:58.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.425+0000 7f8464c17640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84600cc580 0x7f84600ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:58.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.425+0000 7f8464c17640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f846015b480 0x7f84601512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:58.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.425+0000 7f8464c17640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84601444c0 con 0x7f84600cc580 2023-12-22T08:45:58.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.425+0000 7f8464c17640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8460141880 con 0x7f84600b3600 2023-12-22T08:45:58.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.425+0000 7f8464c17640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8460141b60 con 0x7f846015b480 2023-12-22T08:45:58.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.425+0000 7f845dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84600cc580 0x7f84600ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:58.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.425+0000 7f845dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84600cc580 0x7f84600ade20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33418/0 (socket says 172.21.15.38:33418) 2023-12-22T08:45:58.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.425+0000 7f845dd9b640 1 -- 172.21.15.38:0/3203233653 learned_addr learned my addr 172.21.15.38:0/3203233653 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.426+0000 7f845ed9d640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f846015b480 0x7f84601512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.426+0000 7f845e59c640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84600b3600 0x7f8460143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.426+0000 7f845dd9b640 1 -- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f846015b480 msgr2=0x7f84601512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.426+0000 7f845dd9b640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f846015b480 0x7f84601512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.426+0000 7f845dd9b640 1 -- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84600b3600 msgr2=0x7f8460143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.426+0000 7f845dd9b640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84600b3600 0x7f8460143f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.426+0000 7f845dd9b640 1 -- 172.21.15.38:0/3203233653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8458009b30 con 0x7f84600cc580 2023-12-22T08:45:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.426+0000 7f845e59c640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84600b3600 0x7f8460143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.426+0000 7f845dd9b640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84600cc580 0x7f84600ade20 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f845400c430 tx=0x7f845400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:58.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.426+0000 7f844effd640 1 -- 172.21.15.38:0/3203233653 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454011790 con 0x7f84600cc580 2023-12-22T08:45:58.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.426+0000 7f844effd640 1 -- 172.21.15.38:0/3203233653 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84540118f0 con 0x7f84600cc580 2023-12-22T08:45:58.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.426+0000 7f8464c17640 1 -- 172.21.15.38:0/3203233653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8460141e40 con 0x7f84600cc580 2023-12-22T08:45:58.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.426+0000 7f844effd640 1 -- 172.21.15.38:0/3203233653 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454011ce0 con 0x7f84600cc580 2023-12-22T08:45:58.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.427+0000 7f8464c17640 1 -- 172.21.15.38:0/3203233653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8460142400 con 0x7f84600cc580 2023-12-22T08:45:58.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.428+0000 7f8464c17640 1 -- 172.21.15.38:0/3203233653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8460061910 con 0x7f84600cc580 2023-12-22T08:45:58.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.429+0000 7f844effd640 1 -- 172.21.15.38:0/3203233653 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f845401c460 con 0x7f84600cc580 2023-12-22T08:45:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.429+0000 7f844effd640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f844006a480 0x7f844006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.430+0000 7f844effd640 1 -- 172.21.15.38:0/3203233653 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5882+0+0 (secure 0 0 0) 0x7f8454088990 con 0x7f84600cc580 2023-12-22T08:45:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.430+0000 7f845e59c640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f844006a480 0x7f844006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:58.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.431+0000 7f845e59c640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f844006a480 0x7f844006c940 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8450006fd0 tx=0x7f8450008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.434+0000 7f844effd640 1 -- 172.21.15.38:0/3203233653 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8454053eb0 con 0x7f84600cc580 2023-12-22T08:45:58.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:58.628+0000 7f8464c17640 1 -- 172.21.15.38:0/3203233653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8460065d10 con 0x7f84600cc580 2023-12-22T08:45:59.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.405+0000 7f844effd640 1 -- 172.21.15.38:0/3203233653 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v100) v1 ==== 181+0+0 (secure 0 0 0) 0x7f84540574d0 con 0x7f84600cc580 2023-12-22T08:45:59.407 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2023-12-22T08:45:59.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.409+0000 7f8464c17640 1 -- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f844006a480 msgr2=0x7f844006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:59.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.409+0000 7f8464c17640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f844006a480 0x7f844006c940 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8450006fd0 tx=0x7f8450008040 comp rx=0 tx=0).stop 2023-12-22T08:45:59.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.409+0000 7f8464c17640 1 -- 172.21.15.38:0/3203233653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84600cc580 msgr2=0x7f84600ade20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:59.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.409+0000 7f8464c17640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84600cc580 0x7f84600ade20 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f845400c430 tx=0x7f845400c8f0 comp rx=0 tx=0).stop 2023-12-22T08:45:59.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.409+0000 7f8464c17640 1 -- 172.21.15.38:0/3203233653 shutdown_connections 2023-12-22T08:45:59.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.409+0000 7f8464c17640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f846015b480 0x7f84601512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:59.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.409+0000 7f8464c17640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f844006a480 0x7f844006c940 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:59.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.409+0000 7f8464c17640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84600cc580 0x7f84600ade20 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:59.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.409+0000 7f8464c17640 1 --2- 172.21.15.38:0/3203233653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84600b3600 0x7f8460143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:59.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.409+0000 7f8464c17640 1 -- 172.21.15.38:0/3203233653 >> 172.21.15.38:0/3203233653 conn(0x7f846006f880 msgr2=0x7f84600cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:59.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.410+0000 7f8464c17640 1 -- 172.21.15.38:0/3203233653 shutdown_connections 2023-12-22T08:45:59.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.410+0000 7f8464c17640 1 -- 172.21.15.38:0/3203233653 wait complete. 2023-12-22T08:45:59.433 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T08:45:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.655+0000 7fa919b47640 1 Processor -- start 2023-12-22T08:45:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.656+0000 7fa919b47640 1 -- start start 2023-12-22T08:45:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.658+0000 7fa919b47640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa9141618d0 0x7fa914168550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.658+0000 7fa919b47640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9140b4120 con 0x7fa914161df0 2023-12-22T08:45:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.658+0000 7fa919b47640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9140b4400 con 0x7fa914146e40 2023-12-22T08:45:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.658+0000 7fa919b47640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9140cfdc0 con 0x7fa9141618d0 2023-12-22T08:45:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.658+0000 7fa912ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa914161df0 0x7fa9141611c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34056/0 (socket says 172.21.15.38:34056) 2023-12-22T08:45:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.658+0000 7fa912ffd640 1 -- 172.21.15.38:0/2514916416 learned_addr learned my addr 172.21.15.38:0/2514916416 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:45:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.658+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075096042 0 0) 0x7fa9140b4120 con 0x7fa914161df0 2023-12-22T08:45:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.658+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8fc003520 con 0x7fa914161df0 2023-12-22T08:45:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.658+0000 7fa913fff640 1 --2- 172.21.15.38:0/2514916416 >> v2:172.21.15.89:3300/0 conn(0x7fa9141618d0 0x7fa914168550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.659+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1602339451 0 0) 0x7fa8fc003520 con 0x7fa914161df0 2023-12-22T08:45:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.659+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 >> v2:172.21.15.89:3300/0 conn(0x7fa9141618d0 msgr2=0x7fa914168550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.659+0000 7fa9127fc640 1 --2- 172.21.15.38:0/2514916416 >> v2:172.21.15.89:3300/0 conn(0x7fa9141618d0 0x7fa914168550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.659+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 >> v1:172.21.15.89:6789/0 conn(0x7fa914146e40 legacy=0x7fa9140cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.659+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9140b46e0 con 0x7fa914161df0 2023-12-22T08:45:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.659+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fa9080017f0 con 0x7fa914161df0 2023-12-22T08:45:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.659+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 >> v1:172.21.15.38:6789/0 conn(0x7fa914161df0 legacy=0x7fa9141611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.659+0000 7fa9127fc640 1 --2- 172.21.15.38:0/2514916416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8fc003970 0x7fa8fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.659+0000 7fa9127fc640 1 --2- 172.21.15.38:0/2514916416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8fc0047c0 0x7fa8fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.659+0000 7fa9127fc640 1 --2- 172.21.15.38:0/2514916416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc0052a0 0x7fa8fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.659+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc00c140 con 0x7fa8fc0052a0 2023-12-22T08:45:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.659+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc00c2b0 con 0x7fa8fc0047c0 2023-12-22T08:45:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.659+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc00c470 con 0x7fa8fc003970 2023-12-22T08:45:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.660+0000 7fa913fff640 1 --2- 172.21.15.38:0/2514916416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc0052a0 0x7fa8fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.660+0000 7fa912ffd640 1 --2- 172.21.15.38:0/2514916416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8fc0047c0 0x7fa8fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.660+0000 7fa9137fe640 1 --2- 172.21.15.38:0/2514916416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8fc003970 0x7fa8fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.660+0000 7fa913fff640 1 -- 172.21.15.38:0/2514916416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8fc003970 msgr2=0x7fa8fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.660+0000 7fa913fff640 1 --2- 172.21.15.38:0/2514916416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8fc003970 0x7fa8fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.660+0000 7fa913fff640 1 -- 172.21.15.38:0/2514916416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8fc0047c0 msgr2=0x7fa8fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:45:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.660+0000 7fa913fff640 1 --2- 172.21.15.38:0/2514916416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8fc0047c0 0x7fa8fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.660+0000 7fa913fff640 1 -- 172.21.15.38:0/2514916416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc003520 con 0x7fa8fc0052a0 2023-12-22T08:45:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.660+0000 7fa9137fe640 1 --2- 172.21.15.38:0/2514916416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8fc003970 0x7fa8fc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.661+0000 7fa913fff640 1 -- 172.21.15.38:0/2514916416 reap_dead start 2023-12-22T08:45:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.661+0000 7fa913fff640 1 --2- 172.21.15.38:0/2514916416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc0052a0 0x7fa8fc00b980 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009f90 tx=0x7fa8fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551ddb8d61fc3d4f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.661+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c02cc20 con 0x7fa8fc0052a0 2023-12-22T08:45:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.661+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90c00f040 con 0x7fa8fc0052a0 2023-12-22T08:45:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.661+0000 7fa9127fc640 1 -- 172.21.15.38:0/2514916416 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c003990 con 0x7fa8fc0052a0 2023-12-22T08:45:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.662+0000 7fa919b47640 1 -- 172.21.15.38:0/2514916416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc0052a0 msgr2=0x7fa8fc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.662+0000 7fa919b47640 1 --2- 172.21.15.38:0/2514916416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc0052a0 0x7fa8fc00b980 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009f90 tx=0x7fa8fc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:45:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.662+0000 7fa919b47640 1 -- 172.21.15.38:0/2514916416 shutdown_connections 2023-12-22T08:45:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.662+0000 7fa919b47640 1 --2- 172.21.15.38:0/2514916416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc0052a0 0x7fa8fc00b980 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.662+0000 7fa919b47640 1 -- 172.21.15.38:0/2514916416 >> 172.21.15.38:0/2514916416 conn(0x7fa9140cff10 msgr2=0x7fa9140d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:45:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.662+0000 7fa919b47640 1 -- 172.21.15.38:0/2514916416 shutdown_connections 2023-12-22T08:45:59.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.662+0000 7fa919b47640 1 -- 172.21.15.38:0/2514916416 wait complete. 2023-12-22T08:45:59.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.664+0000 7fa919b47640 1 Processor -- start 2023-12-22T08:45:59.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.664+0000 7fa919b47640 1 -- start start 2023-12-22T08:45:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.665+0000 7fa919b47640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc0052a0 0x7fa91413cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.665+0000 7fa919b47640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9140ad380 0x7fa9140ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.665+0000 7fa919b47640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9140b84c0 0x7fa9140b8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.665+0000 7fa919b47640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140b7980 con 0x7fa8fc0052a0 2023-12-22T08:45:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.665+0000 7fa919b47640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140add40 con 0x7fa9140b84c0 2023-12-22T08:45:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.665+0000 7fa919b47640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9141f3090 con 0x7fa9140ad380 2023-12-22T08:45:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.665+0000 7fa9137fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc0052a0 0x7fa91413cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.665+0000 7fa9137fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc0052a0 0x7fa91413cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33432/0 (socket says 172.21.15.38:33432) 2023-12-22T08:45:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.665+0000 7fa9137fe640 1 -- 172.21.15.38:0/631462355 learned_addr learned my addr 172.21.15.38:0/631462355 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:45:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.666+0000 7fa912ffd640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9140ad380 0x7fa9140ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.666+0000 7fa9137fe640 1 -- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9140ad380 msgr2=0x7fa9140ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.666+0000 7fa9137fe640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9140ad380 0x7fa9140ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.666+0000 7fa9137fe640 1 -- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9140b84c0 msgr2=0x7fa9140b8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:45:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.666+0000 7fa913fff640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9140b84c0 0x7fa9140b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.666+0000 7fa9137fe640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9140b84c0 0x7fa9140b8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:45:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.666+0000 7fa9137fe640 1 -- 172.21.15.38:0/631462355 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9140b8e80 con 0x7fa8fc0052a0 2023-12-22T08:45:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.666+0000 7fa912ffd640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9140ad380 0x7fa9140ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:45:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.666+0000 7fa9137fe640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc0052a0 0x7fa91413cda0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa90400d7a0 tx=0x7fa90400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.667+0000 7fa8fbfff640 1 -- 172.21.15.38:0/631462355 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904005270 con 0x7fa8fc0052a0 2023-12-22T08:45:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.667+0000 7fa8fbfff640 1 -- 172.21.15.38:0/631462355 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9040053d0 con 0x7fa8fc0052a0 2023-12-22T08:45:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.667+0000 7fa8fbfff640 1 -- 172.21.15.38:0/631462355 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400b8f0 con 0x7fa8fc0052a0 2023-12-22T08:45:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.667+0000 7fa919b47640 1 -- 172.21.15.38:0/631462355 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9140b9100 con 0x7fa8fc0052a0 2023-12-22T08:45:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.667+0000 7fa919b47640 1 -- 172.21.15.38:0/631462355 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9141f2d20 con 0x7fa8fc0052a0 2023-12-22T08:45:59.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.668+0000 7fa919b47640 1 -- 172.21.15.38:0/631462355 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa914061910 con 0x7fa8fc0052a0 2023-12-22T08:45:59.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.669+0000 7fa8fbfff640 1 -- 172.21.15.38:0/631462355 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa90400ba50 con 0x7fa8fc0052a0 2023-12-22T08:45:59.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.670+0000 7fa8fbfff640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa90006a430 0x7fa90006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:45:59.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.670+0000 7fa8fbfff640 1 -- 172.21.15.38:0/631462355 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fa904088800 con 0x7fa8fc0052a0 2023-12-22T08:45:59.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.670+0000 7fa912ffd640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa90006a430 0x7fa90006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:45:59.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.671+0000 7fa912ffd640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa90006a430 0x7fa90006c8f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa908001260 tx=0x7fa908009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:45:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.674+0000 7fa8fbfff640 1 -- 172.21.15.38:0/631462355 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa904053e70 con 0x7fa8fc0052a0 2023-12-22T08:45:59.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:45:59.869+0000 7fa919b47640 1 -- 172.21.15.38:0/631462355 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa91406cac0 con 0x7fa8fc0052a0 2023-12-22T08:46:00.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.411+0000 7fa8fbfff640 1 -- 172.21.15.38:0/631462355 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v101) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa904057490 con 0x7fa8fc0052a0 2023-12-22T08:46:00.414 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2023-12-22T08:46:00.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.415+0000 7fa919b47640 1 -- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa90006a430 msgr2=0x7fa90006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:00.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.415+0000 7fa919b47640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa90006a430 0x7fa90006c8f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa908001260 tx=0x7fa908009040 comp rx=0 tx=0).stop 2023-12-22T08:46:00.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.415+0000 7fa919b47640 1 -- 172.21.15.38:0/631462355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc0052a0 msgr2=0x7fa91413cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:00.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.415+0000 7fa919b47640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc0052a0 0x7fa91413cda0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa90400d7a0 tx=0x7fa90400dc60 comp rx=0 tx=0).stop 2023-12-22T08:46:00.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.416+0000 7fa919b47640 1 -- 172.21.15.38:0/631462355 shutdown_connections 2023-12-22T08:46:00.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.416+0000 7fa919b47640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9140b84c0 0x7fa9140b8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.416+0000 7fa919b47640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9140ad380 0x7fa9140ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.416+0000 7fa919b47640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa90006a430 0x7fa90006c8f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.416+0000 7fa919b47640 1 --2- 172.21.15.38:0/631462355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc0052a0 0x7fa91413cda0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.416+0000 7fa919b47640 1 -- 172.21.15.38:0/631462355 >> 172.21.15.38:0/631462355 conn(0x7fa9140cff10 msgr2=0x7fa91415d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:00.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.416+0000 7fa919b47640 1 -- 172.21.15.38:0/631462355 shutdown_connections 2023-12-22T08:46:00.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.416+0000 7fa919b47640 1 -- 172.21.15.38:0/631462355 wait complete. 2023-12-22T08:46:00.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-22T08:46:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.649+0000 7f282f59e640 1 Processor -- start 2023-12-22T08:46:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.649+0000 7f282f59e640 1 -- start start 2023-12-22T08:46:00.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.651+0000 7f282f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283015ad90 0x7f28300caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.651+0000 7f282f59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f283015e050 0x7f28300cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.651+0000 7f282f59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283015e630 con 0x7f2830161bb0 2023-12-22T08:46:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.651+0000 7f282f59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28300ce2c0 con 0x7f283015e050 2023-12-22T08:46:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.651+0000 7f282f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283015e910 con 0x7f283015ad90 2023-12-22T08:46:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.651+0000 7f282ed9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f283015e050 0x7f28300cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.651+0000 7f282ed9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f283015e050 0x7f28300cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33446/0 (socket says 172.21.15.38:33446) 2023-12-22T08:46:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.651+0000 7f282ed9d640 1 -- 172.21.15.38:0/1797055832 learned_addr learned my addr 172.21.15.38:0/1797055832 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.652+0000 7f282ed9d640 1 -- 172.21.15.38:0/1797055832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283015ad90 msgr2=0x7f28300caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.652+0000 7f282ed9d640 1 --2- 172.21.15.38:0/1797055832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283015ad90 0x7f28300caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.652+0000 7f282ed9d640 1 -- 172.21.15.38:0/1797055832 >> v1:172.21.15.89:6789/0 conn(0x7f2830161bb0 legacy=0x7f283015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.652+0000 7f282ed9d640 1 -- 172.21.15.38:0/1797055832 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28301610d0 con 0x7f283015e050 2023-12-22T08:46:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.653+0000 7f282ed9d640 1 --2- 172.21.15.38:0/1797055832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f283015e050 0x7f28300cb410 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f2828009870 tx=0x7f282802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecc67d4a03b8802 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.653+0000 7f282d59a640 1 -- 172.21.15.38:0/1797055832 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2828031640 con 0x7f283015e050 2023-12-22T08:46:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.653+0000 7f282d59a640 1 -- 172.21.15.38:0/1797055832 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28280317a0 con 0x7f283015e050 2023-12-22T08:46:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.653+0000 7f282d59a640 1 -- 172.21.15.38:0/1797055832 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2828031b30 con 0x7f283015e050 2023-12-22T08:46:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.653+0000 7f282f59e640 1 -- 172.21.15.38:0/1797055832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f283015e050 msgr2=0x7f28300cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.653+0000 7f282f59e640 1 --2- 172.21.15.38:0/1797055832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f283015e050 0x7f28300cb410 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f2828009870 tx=0x7f282802b8f0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.654+0000 7f282f59e640 1 -- 172.21.15.38:0/1797055832 shutdown_connections 2023-12-22T08:46:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.654+0000 7f282f59e640 1 --2- 172.21.15.38:0/1797055832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f283015e050 0x7f28300cb410 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.654+0000 7f282f59e640 1 --2- 172.21.15.38:0/1797055832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f283015ad90 0x7f28300caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.654+0000 7f282f59e640 1 -- 172.21.15.38:0/1797055832 >> 172.21.15.38:0/1797055832 conn(0x7f28300d31c0 msgr2=0x7f28300d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:00.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.654+0000 7f282f59e640 1 -- 172.21.15.38:0/1797055832 shutdown_connections 2023-12-22T08:46:00.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.654+0000 7f282f59e640 1 -- 172.21.15.38:0/1797055832 wait complete. 2023-12-22T08:46:00.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.656+0000 7f282f59e640 1 Processor -- start 2023-12-22T08:46:00.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.656+0000 7f282f59e640 1 -- start start 2023-12-22T08:46:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.657+0000 7f282f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f283015ad90 0x7f283015c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.657+0000 7f282f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f283015e050 0x7f2830151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.657+0000 7f282f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2830161bb0 0x7f2830151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.657+0000 7f282f59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28301f3920 con 0x7f283015ad90 2023-12-22T08:46:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.657+0000 7f282f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28301f2a60 con 0x7f283015e050 2023-12-22T08:46:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.657+0000 7f282f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28301f2ca0 con 0x7f2830161bb0 2023-12-22T08:46:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.657+0000 7f282e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f283015ad90 0x7f283015c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.657+0000 7f282e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f283015ad90 0x7f283015c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33458/0 (socket says 172.21.15.38:33458) 2023-12-22T08:46:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.657+0000 7f282e59c640 1 -- 172.21.15.38:0/397753019 learned_addr learned my addr 172.21.15.38:0/397753019 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f282ed9d640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2830161bb0 0x7f2830151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f282dd9b640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f283015e050 0x7f2830151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f282e59c640 1 -- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2830161bb0 msgr2=0x7f2830151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f282e59c640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2830161bb0 0x7f2830151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f282e59c640 1 -- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f283015e050 msgr2=0x7f2830151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f282e59c640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f283015e050 0x7f2830151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f282e59c640 1 -- 172.21.15.38:0/397753019 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28280094d0 con 0x7f283015ad90 2023-12-22T08:46:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f282dd9b640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f283015e050 0x7f2830151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f282ed9d640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2830161bb0 0x7f2830151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f282e59c640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f283015ad90 0x7f283015c2a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f282000ba50 tx=0x7f282000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f2826ffd640 1 -- 172.21.15.38:0/397753019 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282000cb80 con 0x7f283015ad90 2023-12-22T08:46:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f2826ffd640 1 -- 172.21.15.38:0/397753019 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282000cd00 con 0x7f283015ad90 2023-12-22T08:46:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f2826ffd640 1 -- 172.21.15.38:0/397753019 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2820014680 con 0x7f283015ad90 2023-12-22T08:46:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.658+0000 7f282f59e640 1 -- 172.21.15.38:0/397753019 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28301f2f80 con 0x7f283015ad90 2023-12-22T08:46:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.659+0000 7f282f59e640 1 -- 172.21.15.38:0/397753019 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28301f3540 con 0x7f283015ad90 2023-12-22T08:46:00.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.660+0000 7f282f59e640 1 -- 172.21.15.38:0/397753019 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2830061910 con 0x7f283015ad90 2023-12-22T08:46:00.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.661+0000 7f2826ffd640 1 -- 172.21.15.38:0/397753019 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f282001d3b0 con 0x7f283015ad90 2023-12-22T08:46:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.661+0000 7f2826ffd640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f281006a430 0x7f281006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.662+0000 7f2826ffd640 1 -- 172.21.15.38:0/397753019 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2820088620 con 0x7f283015ad90 2023-12-22T08:46:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.662+0000 7f282dd9b640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f281006a430 0x7f281006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:00.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.663+0000 7f282dd9b640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f281006a430 0x7f281006c8f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f28300c69f0 tx=0x7f2818008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.666+0000 7f2826ffd640 1 -- 172.21.15.38:0/397753019 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2820053e70 con 0x7f283015ad90 2023-12-22T08:46:00.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.863+0000 7f282f59e640 1 -- 172.21.15.38:0/397753019 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f28300c6ad0 con 0x7f283015ad90 2023-12-22T08:46:00.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.872+0000 7f2826ffd640 1 -- 172.21.15.38:0/397753019 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2820057490 con 0x7f283015ad90 2023-12-22T08:46:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.875+0000 7f282f59e640 1 -- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f281006a430 msgr2=0x7f281006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.875+0000 7f282f59e640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f281006a430 0x7f281006c8f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f28300c69f0 tx=0x7f2818008040 comp rx=0 tx=0).stop 2023-12-22T08:46:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.875+0000 7f282f59e640 1 -- 172.21.15.38:0/397753019 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f283015ad90 msgr2=0x7f283015c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.875+0000 7f282f59e640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f283015ad90 0x7f283015c2a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f282000ba50 tx=0x7f282000bf10 comp rx=0 tx=0).stop 2023-12-22T08:46:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.875+0000 7f282f59e640 1 -- 172.21.15.38:0/397753019 shutdown_connections 2023-12-22T08:46:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.875+0000 7f282f59e640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2830161bb0 0x7f2830151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.875+0000 7f282f59e640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f283015e050 0x7f2830151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.875+0000 7f282f59e640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f281006a430 0x7f281006c8f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.875+0000 7f282f59e640 1 --2- 172.21.15.38:0/397753019 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f283015ad90 0x7f283015c2a0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.875+0000 7f282f59e640 1 -- 172.21.15.38:0/397753019 >> 172.21.15.38:0/397753019 conn(0x7f28300d31c0 msgr2=0x7f283015d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.875+0000 7f282f59e640 1 -- 172.21.15.38:0/397753019 shutdown_connections 2023-12-22T08:46:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:00.875+0000 7f282f59e640 1 -- 172.21.15.38:0/397753019 wait complete. 2023-12-22T08:46:00.895 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-12-22T08:46:01.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.115+0000 7fb165794640 1 Processor -- start 2023-12-22T08:46:01.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.115+0000 7fb165794640 1 -- start start 2023-12-22T08:46:01.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.116+0000 7fb165794640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb16006d210 0x7fb16015e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.116+0000 7fb165794640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1600cb4c0 0x7fb160159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.116+0000 7fb165794640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1600706d0 con 0x7fb16006d5f0 2023-12-22T08:46:01.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.117+0000 7fb165794640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1600cbf40 con 0x7fb16006d210 2023-12-22T08:46:01.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.117+0000 7fb165794640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1600ce840 con 0x7fb1600cb4c0 2023-12-22T08:46:01.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.117+0000 7fb15ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb16006d210 0x7fb16015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:01.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.117+0000 7fb164f93640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb16006d5f0 0x7fb1600cc150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44752/0 (socket says 172.21.15.38:44752) 2023-12-22T08:46:01.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.117+0000 7fb164f93640 1 -- 172.21.15.38:0/769680359 learned_addr learned my addr 172.21.15.38:0/769680359 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.117+0000 7fb15ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb16006d210 0x7fb16015e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35488/0 (socket says 172.21.15.38:35488) 2023-12-22T08:46:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.117+0000 7fb15ffff640 1 -- 172.21.15.38:0/769680359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1600cb4c0 msgr2=0x7fb160159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.117+0000 7fb15ffff640 1 --2- 172.21.15.38:0/769680359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1600cb4c0 0x7fb160159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.117+0000 7fb15ffff640 1 -- 172.21.15.38:0/769680359 >> v1:172.21.15.38:6789/0 conn(0x7fb16006d5f0 legacy=0x7fb1600cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.117+0000 7fb15ffff640 1 -- 172.21.15.38:0/769680359 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600ceb20 con 0x7fb16006d210 2023-12-22T08:46:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.117+0000 7fb15effd640 1 -- 172.21.15.38:0/769680359 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250887758 0 0) 0x7fb1600706d0 con 0x7fb16006d5f0 2023-12-22T08:46:01.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.118+0000 7fb15ffff640 1 --2- 172.21.15.38:0/769680359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16006d210 0x7fb16015e830 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb1500097a0 tx=0x7fb15002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94044188f6c66ff9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:01.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.119+0000 7fb15effd640 1 -- 172.21.15.38:0/769680359 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15002d040 con 0x7fb16006d210 2023-12-22T08:46:01.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.119+0000 7fb15effd640 1 -- 172.21.15.38:0/769680359 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb150031810 con 0x7fb16006d210 2023-12-22T08:46:01.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.119+0000 7fb15effd640 1 -- 172.21.15.38:0/769680359 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150031ba0 con 0x7fb16006d210 2023-12-22T08:46:01.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.119+0000 7fb165794640 1 -- 172.21.15.38:0/769680359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16006d210 msgr2=0x7fb16015e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:01.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.119+0000 7fb165794640 1 --2- 172.21.15.38:0/769680359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16006d210 0x7fb16015e830 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb1500097a0 tx=0x7fb15002b8b0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.119+0000 7fb165794640 1 -- 172.21.15.38:0/769680359 shutdown_connections 2023-12-22T08:46:01.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.119+0000 7fb165794640 1 --2- 172.21.15.38:0/769680359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1600cb4c0 0x7fb160159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.119+0000 7fb165794640 1 --2- 172.21.15.38:0/769680359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16006d210 0x7fb16015e830 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.119+0000 7fb165794640 1 -- 172.21.15.38:0/769680359 >> 172.21.15.38:0/769680359 conn(0x7fb1600b1f70 msgr2=0x7fb1600b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:01.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.119+0000 7fb165794640 1 -- 172.21.15.38:0/769680359 shutdown_connections 2023-12-22T08:46:01.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.120+0000 7fb165794640 1 -- 172.21.15.38:0/769680359 wait complete. 2023-12-22T08:46:01.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.121+0000 7fb165794640 1 Processor -- start 2023-12-22T08:46:01.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.121+0000 7fb165794640 1 -- start start 2023-12-22T08:46:01.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.122+0000 7fb165794640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16006d210 0x7fb160150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.122+0000 7fb165794640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb16006d5f0 0x7fb1601513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.122+0000 7fb165794640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1600cb4c0 0x7fb16013c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.122+0000 7fb165794640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16013be70 con 0x7fb16006d210 2023-12-22T08:46:01.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.122+0000 7fb165794640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1601511a0 con 0x7fb1600cb4c0 2023-12-22T08:46:01.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.122+0000 7fb165794640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16013b1f0 con 0x7fb16006d5f0 2023-12-22T08:46:01.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.122+0000 7fb15ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16006d210 0x7fb160150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:01.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.123+0000 7fb15ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16006d210 0x7fb160150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35492/0 (socket says 172.21.15.38:35492) 2023-12-22T08:46:01.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.123+0000 7fb15ffff640 1 -- 172.21.15.38:0/2396058981 learned_addr learned my addr 172.21.15.38:0/2396058981 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:01.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.123+0000 7fb15f7fe640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb16006d5f0 0x7fb1601513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:01.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.123+0000 7fb164f93640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1600cb4c0 0x7fb16013c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:01.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.123+0000 7fb15ffff640 1 -- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb16006d5f0 msgr2=0x7fb1601513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:01.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.123+0000 7fb15ffff640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb16006d5f0 0x7fb1601513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.123+0000 7fb15ffff640 1 -- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1600cb4c0 msgr2=0x7fb16013c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:01.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.123+0000 7fb15ffff640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1600cb4c0 0x7fb16013c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.123+0000 7fb15ffff640 1 -- 172.21.15.38:0/2396058981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150009400 con 0x7fb16006d210 2023-12-22T08:46:01.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.123+0000 7fb164f93640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1600cb4c0 0x7fb16013c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:01.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.123+0000 7fb15ffff640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16006d210 0x7fb160150c60 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb15002bec0 tx=0x7fb1500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:01.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.124+0000 7fb15cff9640 1 -- 172.21.15.38:0/2396058981 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15003ad60 con 0x7fb16006d210 2023-12-22T08:46:01.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.124+0000 7fb15cff9640 1 -- 172.21.15.38:0/2396058981 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1500423f0 con 0x7fb16006d210 2023-12-22T08:46:01.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.124+0000 7fb165794640 1 -- 172.21.15.38:0/2396058981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16013b4d0 con 0x7fb16006d210 2023-12-22T08:46:01.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.124+0000 7fb15cff9640 1 -- 172.21.15.38:0/2396058981 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1500427a0 con 0x7fb16006d210 2023-12-22T08:46:01.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.124+0000 7fb165794640 1 -- 172.21.15.38:0/2396058981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16013ba90 con 0x7fb16006d210 2023-12-22T08:46:01.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.125+0000 7fb165794640 1 -- 172.21.15.38:0/2396058981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16013c0e0 con 0x7fb16006d210 2023-12-22T08:46:01.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.126+0000 7fb15cff9640 1 -- 172.21.15.38:0/2396058981 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb15004b3b0 con 0x7fb16006d210 2023-12-22T08:46:01.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.127+0000 7fb15cff9640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb14c06a430 0x7fb14c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.127+0000 7fb15cff9640 1 -- 172.21.15.38:0/2396058981 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb1500aa840 con 0x7fb16006d210 2023-12-22T08:46:01.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.128+0000 7fb15f7fe640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb14c06a430 0x7fb14c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:01.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.129+0000 7fb15f7fe640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb14c06a430 0x7fb14c06c8f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb1601550e0 tx=0x7fb154008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:01.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.131+0000 7fb15cff9640 1 -- 172.21.15.38:0/2396058981 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb150076110 con 0x7fb16006d210 2023-12-22T08:46:01.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.389+0000 7fb165794640 1 -- 172.21.15.38:0/2396058981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7fb160061910 con 0x7fb16006d210 2023-12-22T08:46:01.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.433+0000 7fb15cff9640 1 -- 172.21.15.38:0/2396058981 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v308) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb1500470c0 con 0x7fb16006d210 2023-12-22T08:46:01.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.436+0000 7fb165794640 1 -- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb14c06a430 msgr2=0x7fb14c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:01.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.436+0000 7fb165794640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb14c06a430 0x7fb14c06c8f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb1601550e0 tx=0x7fb154008040 comp rx=0 tx=0).stop 2023-12-22T08:46:01.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.436+0000 7fb165794640 1 -- 172.21.15.38:0/2396058981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16006d210 msgr2=0x7fb160150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:01.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.436+0000 7fb165794640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16006d210 0x7fb160150c60 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb15002bec0 tx=0x7fb1500046c0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.436+0000 7fb165794640 1 -- 172.21.15.38:0/2396058981 shutdown_connections 2023-12-22T08:46:01.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.436+0000 7fb165794640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1600cb4c0 0x7fb16013c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.436+0000 7fb165794640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb16006d5f0 0x7fb1601513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.436+0000 7fb165794640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb14c06a430 0x7fb14c06c8f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.436+0000 7fb165794640 1 --2- 172.21.15.38:0/2396058981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb16006d210 0x7fb160150c60 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.436+0000 7fb165794640 1 -- 172.21.15.38:0/2396058981 >> 172.21.15.38:0/2396058981 conn(0x7fb1600b1f70 msgr2=0x7fb160070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:01.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.436+0000 7fb165794640 1 -- 172.21.15.38:0/2396058981 shutdown_connections 2023-12-22T08:46:01.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.436+0000 7fb165794640 1 -- 172.21.15.38:0/2396058981 wait complete. 2023-12-22T08:46:01.456 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-12-22T08:46:01.456 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-12-22T08:46:01.457 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:46:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.670+0000 7f7c5b3c9640 1 Processor -- start 2023-12-22T08:46:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.671+0000 7f7c5b3c9640 1 -- start start 2023-12-22T08:46:01.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.672+0000 7f7c5b3c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7c540b3f90 0x7f7c5415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.672+0000 7f7c5b3c9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5415eb20 con 0x7f7c5415e740 2023-12-22T08:46:01.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.672+0000 7f7c5b3c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c54070770 con 0x7f7c5406ca50 2023-12-22T08:46:01.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.672+0000 7f7c5b3c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5406e650 con 0x7f7c540b3f90 2023-12-22T08:46:01.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.672+0000 7f7c59165640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7c5415e740 0x7f7c540b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44766/0 (socket says 172.21.15.38:44766) 2023-12-22T08:46:01.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.672+0000 7f7c59165640 1 -- 172.21.15.38:0/1466651888 learned_addr learned my addr 172.21.15.38:0/1466651888 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274436125 0 0) 0x7f7c5415eb20 con 0x7f7c5415e740 2023-12-22T08:46:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c40003520 con 0x7f7c5415e740 2023-12-22T08:46:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c58964640 1 --2- 172.21.15.38:0/1466651888 >> v2:172.21.15.89:3300/0 conn(0x7f7c540b3f90 0x7f7c5415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3933766269 0 0) 0x7f7c40003520 con 0x7f7c5415e740 2023-12-22T08:46:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 >> v2:172.21.15.89:3300/0 conn(0x7f7c540b3f90 msgr2=0x7f7c5415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 --2- 172.21.15.38:0/1466651888 >> v2:172.21.15.89:3300/0 conn(0x7f7c540b3f90 0x7f7c5415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 >> v1:172.21.15.89:6789/0 conn(0x7f7c5406ca50 legacy=0x7f7c54070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5406d180 con 0x7f7c5415e740 2023-12-22T08:46:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f7c50001670 con 0x7f7c5415e740 2023-12-22T08:46:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 >> v1:172.21.15.38:6789/0 conn(0x7f7c5415e740 legacy=0x7f7c540b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 --2- 172.21.15.38:0/1466651888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c40003970 0x7f7c40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 --2- 172.21.15.38:0/1466651888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c400047c0 0x7f7c40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 --2- 172.21.15.38:0/1466651888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c40005380 0x7f7c4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5406e650 con 0x7f7c400047c0 2023-12-22T08:46:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4000c210 con 0x7f7c40003970 2023-12-22T08:46:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4000c3d0 con 0x7f7c40005380 2023-12-22T08:46:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.673+0000 7f7c58964640 1 --2- 172.21.15.38:0/1466651888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c400047c0 0x7f7c40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.674+0000 7f7c59165640 1 --2- 172.21.15.38:0/1466651888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c40003970 0x7f7c40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.674+0000 7f7c58964640 1 -- 172.21.15.38:0/1466651888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c40005380 msgr2=0x7f7c4000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.674+0000 7f7c58964640 1 --2- 172.21.15.38:0/1466651888 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c40005380 0x7f7c4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.674+0000 7f7c58964640 1 -- 172.21.15.38:0/1466651888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c40003970 msgr2=0x7f7c40003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.674+0000 7f7c58964640 1 --2- 172.21.15.38:0/1466651888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c40003970 0x7f7c40003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.674+0000 7f7c58964640 1 -- 172.21.15.38:0/1466651888 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c40003520 con 0x7f7c400047c0 2023-12-22T08:46:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.674+0000 7f7c59165640 1 --2- 172.21.15.38:0/1466651888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c40003970 0x7f7c40003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:01.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.674+0000 7f7c59966640 1 -- 172.21.15.38:0/1466651888 reap_dead start 2023-12-22T08:46:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.675+0000 7f7c58964640 1 --2- 172.21.15.38:0/1466651888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c400047c0 0x7f7c40004c40 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400ba30 tx=0x7f7c400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde96cb1581c1665 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.675+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44032650 con 0x7f7c400047c0 2023-12-22T08:46:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.675+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c440327b0 con 0x7f7c400047c0 2023-12-22T08:46:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.675+0000 7f7c4bfff640 1 -- 172.21.15.38:0/1466651888 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44032b40 con 0x7f7c400047c0 2023-12-22T08:46:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.676+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/1466651888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c400047c0 msgr2=0x7f7c40004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.676+0000 7f7c5b3c9640 1 --2- 172.21.15.38:0/1466651888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c400047c0 0x7f7c40004c40 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400ba30 tx=0x7f7c400057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.676+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/1466651888 shutdown_connections 2023-12-22T08:46:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.676+0000 7f7c5b3c9640 1 --2- 172.21.15.38:0/1466651888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c400047c0 0x7f7c40004c40 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.676+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/1466651888 >> 172.21.15.38:0/1466651888 conn(0x7f7c540cfea0 msgr2=0x7f7c540d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.676+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/1466651888 shutdown_connections 2023-12-22T08:46:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.676+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/1466651888 wait complete. 2023-12-22T08:46:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.677+0000 7f7c5b3c9640 1 Processor -- start 2023-12-22T08:46:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.678+0000 7f7c5b3c9640 1 -- start start 2023-12-22T08:46:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.678+0000 7f7c5b3c9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c400047c0 0x7f7c540b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.678+0000 7f7c5b3c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c540b21f0 0x7f7c540b8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.679+0000 7f7c5b3c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c541f6580 0x7f7c5414dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.679+0000 7f7c5b3c9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540b1150 con 0x7f7c400047c0 2023-12-22T08:46:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.679+0000 7f7c5b3c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540b1430 con 0x7f7c541f6580 2023-12-22T08:46:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.679+0000 7f7c5b3c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540b1710 con 0x7f7c540b21f0 2023-12-22T08:46:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.679+0000 7f7c59165640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c400047c0 0x7f7c540b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.679+0000 7f7c59165640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c400047c0 0x7f7c540b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35516/0 (socket says 172.21.15.38:35516) 2023-12-22T08:46:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.679+0000 7f7c59165640 1 -- 172.21.15.38:0/2294661964 learned_addr learned my addr 172.21.15.38:0/2294661964 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.679+0000 7f7c59165640 1 -- 172.21.15.38:0/2294661964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c540b21f0 msgr2=0x7f7c540b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.679+0000 7f7c59165640 1 --2- 172.21.15.38:0/2294661964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c540b21f0 0x7f7c540b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.679+0000 7f7c59165640 1 -- 172.21.15.38:0/2294661964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c541f6580 msgr2=0x7f7c5414dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.679+0000 7f7c59165640 1 --2- 172.21.15.38:0/2294661964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c541f6580 0x7f7c5414dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.679+0000 7f7c59165640 1 -- 172.21.15.38:0/2294661964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540b19f0 con 0x7f7c400047c0 2023-12-22T08:46:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.679+0000 7f7c59165640 1 --2- 172.21.15.38:0/2294661964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c400047c0 0x7f7c540b0ae0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000d810 tx=0x7f7c5000dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:01.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.680+0000 7f7c49ffb640 1 -- 172.21.15.38:0/2294661964 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c500074e0 con 0x7f7c400047c0 2023-12-22T08:46:01.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.680+0000 7f7c49ffb640 1 -- 172.21.15.38:0/2294661964 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50007640 con 0x7f7c400047c0 2023-12-22T08:46:01.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.680+0000 7f7c49ffb640 1 -- 172.21.15.38:0/2294661964 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50004a00 con 0x7f7c400047c0 2023-12-22T08:46:01.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.680+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/2294661964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c540b1cd0 con 0x7f7c400047c0 2023-12-22T08:46:01.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.680+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/2294661964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c540b2670 con 0x7f7c400047c0 2023-12-22T08:46:01.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.681+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/2294661964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c54061910 con 0x7f7c400047c0 2023-12-22T08:46:01.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.682+0000 7f7c49ffb640 1 -- 172.21.15.38:0/2294661964 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c50004b60 con 0x7f7c400047c0 2023-12-22T08:46:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.683+0000 7f7c49ffb640 1 --2- 172.21.15.38:0/2294661964 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7c3806a430 0x7f7c3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.683+0000 7f7c49ffb640 1 -- 172.21.15.38:0/2294661964 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7c50087e70 con 0x7f7c400047c0 2023-12-22T08:46:01.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.684+0000 7f7c58964640 1 --2- 172.21.15.38:0/2294661964 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7c3806a430 0x7f7c3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:01.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.685+0000 7f7c58964640 1 --2- 172.21.15.38:0/2294661964 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7c3806a430 0x7f7c3806c8f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400ba00 tx=0x7f7c44032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:01.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.688+0000 7f7c49ffb640 1 -- 172.21.15.38:0/2294661964 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7c500538a0 con 0x7f7c400047c0 2023-12-22T08:46:01.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.872+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/2294661964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c54071eb0 con 0x7f7c400047c0 2023-12-22T08:46:01.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.873+0000 7f7c49ffb640 1 -- 172.21.15.38:0/2294661964 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+12472 (secure 0 0 0) 0x7f7c50019090 con 0x7f7c400047c0 2023-12-22T08:46:01.875 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:01.875 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":101,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:46:00.402021+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6836/2576950091":"2023-12-23T08:45:57.130966+0000","172.21.15.89:6834/2576950091":"2023-12-23T08:45:57.130966+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:46:01.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.876+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/2294661964 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7c3806a430 msgr2=0x7f7c3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:01.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.876+0000 7f7c5b3c9640 1 --2- 172.21.15.38:0/2294661964 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7c3806a430 0x7f7c3806c8f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400ba00 tx=0x7f7c44032000 comp rx=0 tx=0).stop 2023-12-22T08:46:01.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.876+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/2294661964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c400047c0 msgr2=0x7f7c540b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:01.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.876+0000 7f7c5b3c9640 1 --2- 172.21.15.38:0/2294661964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c400047c0 0x7f7c540b0ae0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000d810 tx=0x7f7c5000dcd0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.876+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/2294661964 shutdown_connections 2023-12-22T08:46:01.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.876+0000 7f7c5b3c9640 1 --2- 172.21.15.38:0/2294661964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c541f6580 0x7f7c5414dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.876+0000 7f7c5b3c9640 1 --2- 172.21.15.38:0/2294661964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c540b21f0 0x7f7c540b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.876+0000 7f7c5b3c9640 1 --2- 172.21.15.38:0/2294661964 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7c3806a430 0x7f7c3806c8f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.876+0000 7f7c5b3c9640 1 --2- 172.21.15.38:0/2294661964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c400047c0 0x7f7c540b0ae0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:01.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.876+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/2294661964 >> 172.21.15.38:0/2294661964 conn(0x7f7c540cfea0 msgr2=0x7f7c540d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:01.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.876+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/2294661964 shutdown_connections 2023-12-22T08:46:01.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:01.876+0000 7f7c5b3c9640 1 -- 172.21.15.38:0/2294661964 wait complete. 2023-12-22T08:46:01.896 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:46:01.897 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:46:02.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.118+0000 7ffb86d22640 1 Processor -- start 2023-12-22T08:46:02.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.119+0000 7ffb86d22640 1 -- start start 2023-12-22T08:46:02.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.120+0000 7ffb86d22640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8015e870 0x7ffb800ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.120+0000 7ffb86d22640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffb80070e80 0x7ffb8006f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.120+0000 7ffb86d22640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb800ce4b0 con 0x7ffb8015ec50 2023-12-22T08:46:02.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.120+0000 7ffb86d22640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8015fea0 con 0x7ffb80070e80 2023-12-22T08:46:02.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.120+0000 7ffb86d22640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800cdb80 con 0x7ffb8015e870 2023-12-22T08:46:02.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.121+0000 7ffb77fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ffb8015ec50 0x7ffb80070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44770/0 (socket says 172.21.15.38:44770) 2023-12-22T08:46:02.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.121+0000 7ffb77fff640 1 -- 172.21.15.38:0/3445203168 learned_addr learned my addr 172.21.15.38:0/3445203168 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:02.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.121+0000 7ffb84abe640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8015e870 0x7ffb800ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.121+0000 7ffb852bf640 1 --2- 172.21.15.38:0/3445203168 >> v2:172.21.15.89:3300/0 conn(0x7ffb80070e80 0x7ffb8006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.121+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107275181 0 0) 0x7ffb800ce4b0 con 0x7ffb8015ec50 2023-12-22T08:46:02.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.121+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb68003520 con 0x7ffb8015ec50 2023-12-22T08:46:02.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1516515071 0 0) 0x7ffb68003520 con 0x7ffb8015ec50 2023-12-22T08:46:02.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8015e870 msgr2=0x7ffb800ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:02.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8015e870 0x7ffb800ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 >> v2:172.21.15.89:3300/0 conn(0x7ffb80070e80 msgr2=0x7ffb8006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:02.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 --2- 172.21.15.38:0/3445203168 >> v2:172.21.15.89:3300/0 conn(0x7ffb80070e80 0x7ffb8006f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800cde60 con 0x7ffb8015ec50 2023-12-22T08:46:02.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7ffb70001670 con 0x7ffb8015ec50 2023-12-22T08:46:02.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb84abe640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8015e870 0x7ffb800ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:46:02.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 >> v1:172.21.15.38:6789/0 conn(0x7ffb8015ec50 legacy=0x7ffb80070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:02.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb68003970 0x7ffb68003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8015e870 0x7ffb680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb68004d00 0x7ffb68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8015fea0 con 0x7ffb68004d00 2023-12-22T08:46:02.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800cdb80 con 0x7ffb68003970 2023-12-22T08:46:02.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6800b9d0 con 0x7ffb8015e870 2023-12-22T08:46:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb852bf640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb68004d00 0x7ffb68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.122+0000 7ffb84abe640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb68003970 0x7ffb68003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.123+0000 7ffb77fff640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8015e870 0x7ffb680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.123+0000 7ffb852bf640 1 -- 172.21.15.38:0/3445203168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8015e870 msgr2=0x7ffb680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.123+0000 7ffb852bf640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb8015e870 0x7ffb680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.123+0000 7ffb852bf640 1 -- 172.21.15.38:0/3445203168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb68003970 msgr2=0x7ffb68003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.123+0000 7ffb852bf640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb68003970 0x7ffb68003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.123+0000 7ffb852bf640 1 -- 172.21.15.38:0/3445203168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68003520 con 0x7ffb68004d00 2023-12-22T08:46:02.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.123+0000 7ffb84abe640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb68003970 0x7ffb68003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:46:02.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.124+0000 7ffb852bf640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb68004d00 0x7ffb68005180 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7ffb8006a3f0 tx=0x7ffb680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a72608cec79d59a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:02.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.124+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7802cbd0 con 0x7ffb68004d00 2023-12-22T08:46:02.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.124+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7800f040 con 0x7ffb68004d00 2023-12-22T08:46:02.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.124+0000 7ffb777fe640 1 -- 172.21.15.38:0/3445203168 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb78034440 con 0x7ffb68004d00 2023-12-22T08:46:02.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.125+0000 7ffb86d22640 1 -- 172.21.15.38:0/3445203168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb68004d00 msgr2=0x7ffb68005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:02.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.125+0000 7ffb86d22640 1 --2- 172.21.15.38:0/3445203168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb68004d00 0x7ffb68005180 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7ffb8006a3f0 tx=0x7ffb680057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.125+0000 7ffb852bf640 1 -- 172.21.15.38:0/3445203168 reap_dead start 2023-12-22T08:46:02.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.125+0000 7ffb86d22640 1 -- 172.21.15.38:0/3445203168 shutdown_connections 2023-12-22T08:46:02.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.125+0000 7ffb86d22640 1 -- 172.21.15.38:0/3445203168 >> 172.21.15.38:0/3445203168 conn(0x7ffb800b20c0 msgr2=0x7ffb800b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:02.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.125+0000 7ffb86d22640 1 -- 172.21.15.38:0/3445203168 shutdown_connections 2023-12-22T08:46:02.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.125+0000 7ffb86d22640 1 -- 172.21.15.38:0/3445203168 wait complete. 2023-12-22T08:46:02.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.127+0000 7ffb86d22640 1 Processor -- start 2023-12-22T08:46:02.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.127+0000 7ffb86d22640 1 -- start start 2023-12-22T08:46:02.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.128+0000 7ffb86d22640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb68004d00 0x7ffb80148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.128+0000 7ffb86d22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb80149800 0x7ffb800ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.128+0000 7ffb86d22640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb800ade70 0x7ffb8015b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.128+0000 7ffb86d22640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80158f30 con 0x7ffb800ade70 2023-12-22T08:46:02.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.128+0000 7ffb86d22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800ae2e0 con 0x7ffb80149800 2023-12-22T08:46:02.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.128+0000 7ffb86d22640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8015c4e0 con 0x7ffb68004d00 2023-12-22T08:46:02.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.128+0000 7ffb852bf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb800ade70 0x7ffb8015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.128+0000 7ffb852bf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb800ade70 0x7ffb8015b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35544/0 (socket says 172.21.15.38:35544) 2023-12-22T08:46:02.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.128+0000 7ffb852bf640 1 -- 172.21.15.38:0/1014322340 learned_addr learned my addr 172.21.15.38:0/1014322340 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:02.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.129+0000 7ffb84abe640 1 --2- 172.21.15.38:0/1014322340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb68004d00 0x7ffb80148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.129+0000 7ffb852bf640 1 -- 172.21.15.38:0/1014322340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb68004d00 msgr2=0x7ffb80148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:02.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.129+0000 7ffb852bf640 1 --2- 172.21.15.38:0/1014322340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb68004d00 0x7ffb80148d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.129+0000 7ffb852bf640 1 -- 172.21.15.38:0/1014322340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb80149800 msgr2=0x7ffb800ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:02.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.129+0000 7ffb852bf640 1 --2- 172.21.15.38:0/1014322340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb80149800 0x7ffb800ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.129+0000 7ffb852bf640 1 -- 172.21.15.38:0/1014322340 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb801565f0 con 0x7ffb800ade70 2023-12-22T08:46:02.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.129+0000 7ffb852bf640 1 --2- 172.21.15.38:0/1014322340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb800ade70 0x7ffb8015b790 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800e230 tx=0x7ffb78009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:02.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.129+0000 7ffb757fa640 1 -- 172.21.15.38:0/1014322340 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb78034c10 con 0x7ffb800ade70 2023-12-22T08:46:02.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.129+0000 7ffb757fa640 1 -- 172.21.15.38:0/1014322340 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb78034d70 con 0x7ffb800ade70 2023-12-22T08:46:02.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.129+0000 7ffb757fa640 1 -- 172.21.15.38:0/1014322340 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb78003bd0 con 0x7ffb800ade70 2023-12-22T08:46:02.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.129+0000 7ffb86d22640 1 -- 172.21.15.38:0/1014322340 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb801568d0 con 0x7ffb800ade70 2023-12-22T08:46:02.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.130+0000 7ffb86d22640 1 -- 172.21.15.38:0/1014322340 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb80149250 con 0x7ffb800ade70 2023-12-22T08:46:02.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.131+0000 7ffb86d22640 1 -- 172.21.15.38:0/1014322340 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb80156df0 con 0x7ffb800ade70 2023-12-22T08:46:02.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.132+0000 7ffb757fa640 1 -- 172.21.15.38:0/1014322340 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffb78047460 con 0x7ffb800ade70 2023-12-22T08:46:02.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.134+0000 7ffb757fa640 1 --2- 172.21.15.38:0/1014322340 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb6c06a460 0x7ffb6c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.134+0000 7ffb757fa640 1 -- 172.21.15.38:0/1014322340 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffb780aa680 con 0x7ffb800ade70 2023-12-22T08:46:02.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.134+0000 7ffb84abe640 1 --2- 172.21.15.38:0/1014322340 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb6c06a460 0x7ffb6c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.135+0000 7ffb84abe640 1 --2- 172.21.15.38:0/1014322340 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb6c06a460 0x7ffb6c06c920 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c006fd0 tx=0x7ffb7c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:02.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.138+0000 7ffb757fa640 1 -- 172.21.15.38:0/1014322340 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffb80156df0 con 0x7ffb800ade70 2023-12-22T08:46:02.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.331+0000 7ffb86d22640 1 -- 172.21.15.38:0/1014322340 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb80156df0 con 0x7ffb800ade70 2023-12-22T08:46:02.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.331+0000 7ffb757fa640 1 -- 172.21.15.38:0/1014322340 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb80156df0 con 0x7ffb800ade70 2023-12-22T08:46:02.333 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:46:02.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.334+0000 7ffb86d22640 1 -- 172.21.15.38:0/1014322340 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb6c06a460 msgr2=0x7ffb6c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:02.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.334+0000 7ffb86d22640 1 --2- 172.21.15.38:0/1014322340 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb6c06a460 0x7ffb6c06c920 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c006fd0 tx=0x7ffb7c008040 comp rx=0 tx=0).stop 2023-12-22T08:46:02.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.334+0000 7ffb86d22640 1 -- 172.21.15.38:0/1014322340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb800ade70 msgr2=0x7ffb8015b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:02.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.334+0000 7ffb86d22640 1 --2- 172.21.15.38:0/1014322340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb800ade70 0x7ffb8015b790 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800e230 tx=0x7ffb78009750 comp rx=0 tx=0).stop 2023-12-22T08:46:02.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.334+0000 7ffb86d22640 1 -- 172.21.15.38:0/1014322340 shutdown_connections 2023-12-22T08:46:02.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.334+0000 7ffb86d22640 1 --2- 172.21.15.38:0/1014322340 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb6c06a460 0x7ffb6c06c920 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.334+0000 7ffb86d22640 1 --2- 172.21.15.38:0/1014322340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb800ade70 0x7ffb8015b790 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.334+0000 7ffb86d22640 1 --2- 172.21.15.38:0/1014322340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb80149800 0x7ffb800ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.334+0000 7ffb86d22640 1 --2- 172.21.15.38:0/1014322340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb68004d00 0x7ffb80148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.334+0000 7ffb86d22640 1 -- 172.21.15.38:0/1014322340 >> 172.21.15.38:0/1014322340 conn(0x7ffb800b20c0 msgr2=0x7ffb80155ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:02.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.334+0000 7ffb86d22640 1 -- 172.21.15.38:0/1014322340 shutdown_connections 2023-12-22T08:46:02.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.334+0000 7ffb86d22640 1 -- 172.21.15.38:0/1014322340 wait complete. 2023-12-22T08:46:02.355 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-12-22T08:46:02.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.573+0000 7f66bfd77640 1 Processor -- start 2023-12-22T08:46:02.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.573+0000 7f66bfd77640 1 -- start start 2023-12-22T08:46:02.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.575+0000 7f66bfd77640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f66b80b24b0 0x7f66b8070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.575+0000 7f66bfd77640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b81450f0 con 0x7f66b8144d10 2023-12-22T08:46:02.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.575+0000 7f66bfd77640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b80cc840 con 0x7f66b80b2050 2023-12-22T08:46:02.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.575+0000 7f66bfd77640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b80ce010 con 0x7f66b80b24b0 2023-12-22T08:46:02.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.576+0000 7f66bdb13640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f66b8144d10 0x7f66b80cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44778/0 (socket says 172.21.15.38:44778) 2023-12-22T08:46:02.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.576+0000 7f66bdb13640 1 -- 172.21.15.38:0/1587398745 learned_addr learned my addr 172.21.15.38:0/1587398745 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:02.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.576+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009933653 0 0) 0x7f66b81450f0 con 0x7f66b8144d10 2023-12-22T08:46:02.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.576+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66a4003520 con 0x7f66b8144d10 2023-12-22T08:46:02.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.576+0000 7f66be314640 1 --2- 172.21.15.38:0/1587398745 >> v2:172.21.15.89:3300/0 conn(0x7f66b80b24b0 0x7f66b8070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.576+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 102687259 0 0) 0x7f66a4003520 con 0x7f66b8144d10 2023-12-22T08:46:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.576+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 >> v2:172.21.15.89:3300/0 conn(0x7f66b80b24b0 msgr2=0x7f66b8070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.576+0000 7f66bcb11640 1 --2- 172.21.15.38:0/1587398745 >> v2:172.21.15.89:3300/0 conn(0x7f66b80b24b0 0x7f66b8070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.576+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 >> v1:172.21.15.89:6789/0 conn(0x7f66b80b2050 legacy=0x7f66b8070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.576+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b80ce2f0 con 0x7f66b8144d10 2023-12-22T08:46:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.576+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f66b4001670 con 0x7f66b8144d10 2023-12-22T08:46:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 >> v1:172.21.15.38:6789/0 conn(0x7f66b8144d10 legacy=0x7f66b80cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bcb11640 1 --2- 172.21.15.38:0/1587398745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66a40039c0 0x7f66a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bcb11640 1 --2- 172.21.15.38:0/1587398745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66a40047c0 0x7f66a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bcb11640 1 --2- 172.21.15.38:0/1587398745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a40051d0 0x7f66a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b80ce010 con 0x7f66a40039c0 2023-12-22T08:46:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a400c120 con 0x7f66a40047c0 2023-12-22T08:46:02.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a400c2e0 con 0x7f66a40051d0 2023-12-22T08:46:02.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bdb13640 1 --2- 172.21.15.38:0/1587398745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66a40039c0 0x7f66a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bd312640 1 --2- 172.21.15.38:0/1587398745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66a40047c0 0x7f66a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bdb13640 1 -- 172.21.15.38:0/1587398745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a40051d0 msgr2=0x7f66a400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:02.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bdb13640 1 --2- 172.21.15.38:0/1587398745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a40051d0 0x7f66a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bdb13640 1 -- 172.21.15.38:0/1587398745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66a40047c0 msgr2=0x7f66a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:02.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bdb13640 1 --2- 172.21.15.38:0/1587398745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66a40047c0 0x7f66a4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66bdb13640 1 -- 172.21.15.38:0/1587398745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4003520 con 0x7f66a40039c0 2023-12-22T08:46:02.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.577+0000 7f66be314640 1 -- 172.21.15.38:0/1587398745 reap_dead start 2023-12-22T08:46:02.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.578+0000 7f66bdb13640 1 --2- 172.21.15.38:0/1587398745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66a40039c0 0x7f66a4003de0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f66b400c0e0 tx=0x7f66a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cff60ac5052691 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:02.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.579+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4005ad0 con 0x7f66a40039c0 2023-12-22T08:46:02.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.579+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b4005c50 con 0x7f66a40039c0 2023-12-22T08:46:02.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.579+0000 7f66bcb11640 1 -- 172.21.15.38:0/1587398745 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b402c7d0 con 0x7f66a40039c0 2023-12-22T08:46:02.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.579+0000 7f66bfd77640 1 -- 172.21.15.38:0/1587398745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66a40039c0 msgr2=0x7f66a4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:02.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.579+0000 7f66bfd77640 1 --2- 172.21.15.38:0/1587398745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66a40039c0 0x7f66a4003de0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f66b400c0e0 tx=0x7f66a40057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.579+0000 7f66bfd77640 1 -- 172.21.15.38:0/1587398745 shutdown_connections 2023-12-22T08:46:02.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.579+0000 7f66bfd77640 1 --2- 172.21.15.38:0/1587398745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66a40039c0 0x7f66a4003de0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.579+0000 7f66bfd77640 1 -- 172.21.15.38:0/1587398745 >> 172.21.15.38:0/1587398745 conn(0x7f66b80cf070 msgr2=0x7f66b80cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:02.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.580+0000 7f66bfd77640 1 -- 172.21.15.38:0/1587398745 shutdown_connections 2023-12-22T08:46:02.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.580+0000 7f66bfd77640 1 -- 172.21.15.38:0/1587398745 wait complete. 2023-12-22T08:46:02.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.581+0000 7f66bfd77640 1 Processor -- start 2023-12-22T08:46:02.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.582+0000 7f66bfd77640 1 -- start start 2023-12-22T08:46:02.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66bfd77640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a40039c0 0x7f66b806c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66bfd77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66b813eb90 0x7f66b80ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66bfd77640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b80ae340 0x7f66b80cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66bfd77640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b81f2b40 con 0x7f66b80ae340 2023-12-22T08:46:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66bfd77640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b81f3960 con 0x7f66b813eb90 2023-12-22T08:46:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66bfd77640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b81f2d50 con 0x7f66a40039c0 2023-12-22T08:46:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66be314640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b80ae340 0x7f66b80cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66be314640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b80ae340 0x7f66b80cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35564/0 (socket says 172.21.15.38:35564) 2023-12-22T08:46:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66be314640 1 -- 172.21.15.38:0/3509169657 learned_addr learned my addr 172.21.15.38:0/3509169657 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66bdb13640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a40039c0 0x7f66b806c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66bd312640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66b813eb90 0x7f66b80ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66be314640 1 -- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a40039c0 msgr2=0x7f66b806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66be314640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a40039c0 0x7f66b806c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66be314640 1 -- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66b813eb90 msgr2=0x7f66b80ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66be314640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66b813eb90 0x7f66b80ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66be314640 1 -- 172.21.15.38:0/3509169657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b81f3030 con 0x7f66b80ae340 2023-12-22T08:46:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66bd312640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66b813eb90 0x7f66b80ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.583+0000 7f66bdb13640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a40039c0 0x7f66b806c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.584+0000 7f66be314640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b80ae340 0x7f66b80cbb00 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f66b80b4fc0 tx=0x7f66b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.584+0000 7f66ae7fc640 1 -- 172.21.15.38:0/3509169657 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b000ed90 con 0x7f66b80ae340 2023-12-22T08:46:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.584+0000 7f66ae7fc640 1 -- 172.21.15.38:0/3509169657 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b0014420 con 0x7f66b80ae340 2023-12-22T08:46:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.584+0000 7f66ae7fc640 1 -- 172.21.15.38:0/3509169657 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b0014810 con 0x7f66b80ae340 2023-12-22T08:46:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.584+0000 7f66bfd77640 1 -- 172.21.15.38:0/3509169657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b81f3310 con 0x7f66b80ae340 2023-12-22T08:46:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.584+0000 7f66bfd77640 1 -- 172.21.15.38:0/3509169657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b81416a0 con 0x7f66b80ae340 2023-12-22T08:46:02.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.585+0000 7f66bfd77640 1 -- 172.21.15.38:0/3509169657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b8061910 con 0x7f66b80ae340 2023-12-22T08:46:02.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.586+0000 7f66ae7fc640 1 -- 172.21.15.38:0/3509169657 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f66b0014970 con 0x7f66b80ae340 2023-12-22T08:46:02.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.588+0000 7f66ae7fc640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f669c06a460 0x7f669c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:02.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.588+0000 7f66ae7fc640 1 -- 172.21.15.38:0/3509169657 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f66b0088a20 con 0x7f66b80ae340 2023-12-22T08:46:02.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.588+0000 7f66bdb13640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f669c06a460 0x7f669c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:02.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.590+0000 7f66bdb13640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f669c06a460 0x7f669c06c920 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f66b4034000 tx=0x7f66b4009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:02.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.592+0000 7f66ae7fc640 1 -- 172.21.15.38:0/3509169657 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f66b0054320 con 0x7f66b80ae340 2023-12-22T08:46:02.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:02.860+0000 7f66bfd77640 1 -- 172.21.15.38:0/3509169657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f66b80cb8e0 con 0x7f66b80ae340 2023-12-22T08:46:03.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.456+0000 7f66ae7fc640 1 -- 172.21.15.38:0/3509169657 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v310) v1 ==== 140+0+0 (secure 0 0 0) 0x7f66b0057940 con 0x7f66b80ae340 2023-12-22T08:46:03.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.459+0000 7f66bfd77640 1 -- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f669c06a460 msgr2=0x7f669c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:03.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.459+0000 7f66bfd77640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f669c06a460 0x7f669c06c920 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f66b4034000 tx=0x7f66b4009030 comp rx=0 tx=0).stop 2023-12-22T08:46:03.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.459+0000 7f66bfd77640 1 -- 172.21.15.38:0/3509169657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b80ae340 msgr2=0x7f66b80cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:03.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.459+0000 7f66bfd77640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b80ae340 0x7f66b80cbb00 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f66b80b4fc0 tx=0x7f66b000e4b0 comp rx=0 tx=0).stop 2023-12-22T08:46:03.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.460+0000 7f66bfd77640 1 -- 172.21.15.38:0/3509169657 shutdown_connections 2023-12-22T08:46:03.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.460+0000 7f66bfd77640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f669c06a460 0x7f669c06c920 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:03.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.460+0000 7f66bfd77640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b80ae340 0x7f66b80cbb00 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:03.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.460+0000 7f66bfd77640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66b813eb90 0x7f66b80ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:03.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.460+0000 7f66bfd77640 1 --2- 172.21.15.38:0/3509169657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66a40039c0 0x7f66b806c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:03.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.460+0000 7f66bfd77640 1 -- 172.21.15.38:0/3509169657 >> 172.21.15.38:0/3509169657 conn(0x7f66b80cf070 msgr2=0x7f66b80cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:03.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.460+0000 7f66bfd77640 1 -- 172.21.15.38:0/3509169657 shutdown_connections 2023-12-22T08:46:03.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.460+0000 7f66bfd77640 1 -- 172.21.15.38:0/3509169657 wait complete. 2023-12-22T08:46:03.483 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-22T08:46:03.722 INFO:teuthology.orchestra.run.smithi038.stdout:{"osd_objectstore":"memstore"} 2023-12-22T08:46:03.722 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-22T08:46:03.722 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T08:46:03.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.949+0000 7ff632aca640 1 Processor -- start 2023-12-22T08:46:03.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.949+0000 7ff632aca640 1 -- start start 2023-12-22T08:46:03.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.951+0000 7ff632aca640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff62c160c50 0x7ff62c0b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:03.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.951+0000 7ff632aca640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff62c0ce020 0x7ff62c0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:03.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.951+0000 7ff632aca640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62c0ceb70 con 0x7ff62c06f250 2023-12-22T08:46:03.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.951+0000 7ff632aca640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62c0cee50 con 0x7ff62c160c50 2023-12-22T08:46:03.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.951+0000 7ff632aca640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0ad140 con 0x7ff62c0ce020 2023-12-22T08:46:03.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.952+0000 7ff623fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff62c0ce020 0x7ff62c0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:03.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.952+0000 7ff631067640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff62c06f250 0x7ff62c0ad560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:56704/0 (socket says 172.21.15.38:56704) 2023-12-22T08:46:03.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.952+0000 7ff631067640 1 -- 172.21.15.38:0/2786824721 learned_addr learned my addr 172.21.15.38:0/2786824721 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:03.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.952+0000 7ff630866640 1 --2- 172.21.15.38:0/2786824721 >> v2:172.21.15.89:3300/0 conn(0x7ff62c160c50 0x7ff62c0b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:03.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.953+0000 7ff6237fe640 1 -- 172.21.15.38:0/2786824721 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398899403 0 0) 0x7ff62c0ceb70 con 0x7ff62c06f250 2023-12-22T08:46:03.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.953+0000 7ff6237fe640 1 -- 172.21.15.38:0/2786824721 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff614003520 con 0x7ff62c06f250 2023-12-22T08:46:03.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.953+0000 7ff630866640 1 -- 172.21.15.38:0/2786824721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff62c0ce020 msgr2=0x7ff62c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:03.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.953+0000 7ff630866640 1 --2- 172.21.15.38:0/2786824721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff62c0ce020 0x7ff62c0ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.953+0000 7ff630866640 1 -- 172.21.15.38:0/2786824721 >> v1:172.21.15.89:6789/0 conn(0x7ff62c06f250 legacy=0x7ff62c0ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.953+0000 7ff630866640 1 -- 172.21.15.38:0/2786824721 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c0aca80 con 0x7ff62c160c50 2023-12-22T08:46:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.954+0000 7ff630866640 1 --2- 172.21.15.38:0/2786824721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff62c160c50 0x7ff62c0b3600 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff6280097a0 tx=0x7ff62802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aff1f471ac097ef9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.955+0000 7ff6237fe640 1 -- 172.21.15.38:0/2786824721 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62802e070 con 0x7ff62c160c50 2023-12-22T08:46:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.955+0000 7ff6237fe640 1 -- 172.21.15.38:0/2786824721 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6280315a0 con 0x7ff62c160c50 2023-12-22T08:46:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.955+0000 7ff6237fe640 1 -- 172.21.15.38:0/2786824721 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628031910 con 0x7ff62c160c50 2023-12-22T08:46:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.955+0000 7ff632aca640 1 -- 172.21.15.38:0/2786824721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff62c160c50 msgr2=0x7ff62c0b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.955+0000 7ff632aca640 1 --2- 172.21.15.38:0/2786824721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff62c160c50 0x7ff62c0b3600 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff6280097a0 tx=0x7ff62802b840 comp rx=0 tx=0).stop 2023-12-22T08:46:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.956+0000 7ff632aca640 1 -- 172.21.15.38:0/2786824721 shutdown_connections 2023-12-22T08:46:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.956+0000 7ff632aca640 1 --2- 172.21.15.38:0/2786824721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff62c0ce020 0x7ff62c0ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.956+0000 7ff632aca640 1 --2- 172.21.15.38:0/2786824721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff62c160c50 0x7ff62c0b3600 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.956+0000 7ff632aca640 1 -- 172.21.15.38:0/2786824721 >> 172.21.15.38:0/2786824721 conn(0x7ff62c0b20c0 msgr2=0x7ff62c0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.956+0000 7ff632aca640 1 -- 172.21.15.38:0/2786824721 shutdown_connections 2023-12-22T08:46:03.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.956+0000 7ff632aca640 1 -- 172.21.15.38:0/2786824721 wait complete. 2023-12-22T08:46:03.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.958+0000 7ff632aca640 1 Processor -- start 2023-12-22T08:46:03.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.958+0000 7ff632aca640 1 -- start start 2023-12-22T08:46:03.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.960+0000 7ff632aca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff62c06f250 0x7ff62c1f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:03.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.960+0000 7ff632aca640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff62c0ce020 0x7ff62c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:03.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.960+0000 7ff632aca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff62c160c50 0x7ff62c0cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:03.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.960+0000 7ff632aca640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c1f7180 con 0x7ff62c06f250 2023-12-22T08:46:03.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.960+0000 7ff632aca640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c1f2fe0 con 0x7ff62c160c50 2023-12-22T08:46:03.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.960+0000 7ff632aca640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c1f32c0 con 0x7ff62c0ce020 2023-12-22T08:46:03.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.960+0000 7ff630866640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff62c06f250 0x7ff62c1f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:03.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.960+0000 7ff630866640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff62c06f250 0x7ff62c1f6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35574/0 (socket says 172.21.15.38:35574) 2023-12-22T08:46:03.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.960+0000 7ff630866640 1 -- 172.21.15.38:0/3604887715 learned_addr learned my addr 172.21.15.38:0/3604887715 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:03.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.960+0000 7ff623fff640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff62c0ce020 0x7ff62c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.960+0000 7ff631067640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff62c160c50 0x7ff62c0cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.961+0000 7ff630866640 1 -- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff62c0ce020 msgr2=0x7ff62c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.961+0000 7ff630866640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff62c0ce020 0x7ff62c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.961+0000 7ff630866640 1 -- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff62c160c50 msgr2=0x7ff62c0cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.961+0000 7ff630866640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff62c160c50 0x7ff62c0cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.961+0000 7ff630866640 1 -- 172.21.15.38:0/3604887715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff628009400 con 0x7ff62c06f250 2023-12-22T08:46:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.961+0000 7ff631067640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff62c160c50 0x7ff62c0cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:03.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.961+0000 7ff630866640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff62c06f250 0x7ff62c1f6c40 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7ff628034040 tx=0x7ff6280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:03.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.961+0000 7ff6217fa640 1 -- 172.21.15.38:0/3604887715 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628032630 con 0x7ff62c06f250 2023-12-22T08:46:03.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.961+0000 7ff6217fa640 1 -- 172.21.15.38:0/3604887715 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff628032790 con 0x7ff62c06f250 2023-12-22T08:46:03.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.961+0000 7ff6217fa640 1 -- 172.21.15.38:0/3604887715 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628032b00 con 0x7ff62c06f250 2023-12-22T08:46:03.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.961+0000 7ff632aca640 1 -- 172.21.15.38:0/3604887715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62c1f35a0 con 0x7ff62c06f250 2023-12-22T08:46:03.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.962+0000 7ff632aca640 1 -- 172.21.15.38:0/3604887715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62c1f3b60 con 0x7ff62c06f250 2023-12-22T08:46:03.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.963+0000 7ff632aca640 1 -- 172.21.15.38:0/3604887715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62c061910 con 0x7ff62c06f250 2023-12-22T08:46:03.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.963+0000 7ff6217fa640 1 -- 172.21.15.38:0/3604887715 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff628032c60 con 0x7ff62c06f250 2023-12-22T08:46:03.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.964+0000 7ff6217fa640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff61806a430 0x7ff61806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:03.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.964+0000 7ff6217fa640 1 -- 172.21.15.38:0/3604887715 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff6280aa580 con 0x7ff62c06f250 2023-12-22T08:46:03.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.965+0000 7ff623fff640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff61806a430 0x7ff61806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:03.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.966+0000 7ff623fff640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff61806a430 0x7ff61806c8f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff62c071cf0 tx=0x7ff61c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:03.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:03.969+0000 7ff6217fa640 1 -- 172.21.15.38:0/3604887715 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff628075dd0 con 0x7ff62c06f250 2023-12-22T08:46:04.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.164+0000 7ff632aca640 1 -- 172.21.15.38:0/3604887715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff62c156a30 con 0x7ff62c06f250 2023-12-22T08:46:04.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.170+0000 7ff6217fa640 1 -- 172.21.15.38:0/3604887715 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff6280793f0 con 0x7ff62c06f250 2023-12-22T08:46:04.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.172+0000 7ff632aca640 1 -- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff61806a430 msgr2=0x7ff61806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:04.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.172+0000 7ff632aca640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff61806a430 0x7ff61806c8f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff62c071cf0 tx=0x7ff61c008040 comp rx=0 tx=0).stop 2023-12-22T08:46:04.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.172+0000 7ff632aca640 1 -- 172.21.15.38:0/3604887715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff62c06f250 msgr2=0x7ff62c1f6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:04.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.172+0000 7ff632aca640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff62c06f250 0x7ff62c1f6c40 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7ff628034040 tx=0x7ff6280046c0 comp rx=0 tx=0).stop 2023-12-22T08:46:04.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.173+0000 7ff632aca640 1 -- 172.21.15.38:0/3604887715 shutdown_connections 2023-12-22T08:46:04.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.173+0000 7ff632aca640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff62c160c50 0x7ff62c0cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:04.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.173+0000 7ff632aca640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff62c0ce020 0x7ff62c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:04.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.173+0000 7ff632aca640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff61806a430 0x7ff61806c8f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:04.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.173+0000 7ff632aca640 1 --2- 172.21.15.38:0/3604887715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff62c06f250 0x7ff62c1f6c40 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:04.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.173+0000 7ff632aca640 1 -- 172.21.15.38:0/3604887715 >> 172.21.15.38:0/3604887715 conn(0x7ff62c0b20c0 msgr2=0x7ff62c0af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:04.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.173+0000 7ff632aca640 1 -- 172.21.15.38:0/3604887715 shutdown_connections 2023-12-22T08:46:04.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.173+0000 7ff632aca640 1 -- 172.21.15.38:0/3604887715 wait complete. 2023-12-22T08:46:04.193 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:46:04.193 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:46:04.303 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:46:04.427 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:46:04.428 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:46:04.428 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:04.490 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:46:04.491 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:46:04.491 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:04.550 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:46:04.550 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:46:04.550 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:04.614 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:46:04.614 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:46:04.615 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:04.673 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:46:04.673 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-22T08:46:04.674 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:46:04.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.904+0000 7fb8299ac640 1 Processor -- start 2023-12-22T08:46:04.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.904+0000 7fb8299ac640 1 -- start start 2023-12-22T08:46:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.906+0000 7fb8299ac640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb824157980 0x7fb82415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.906+0000 7fb8299ac640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb82406d640 0x7fb8240d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:04.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.906+0000 7fb8299ac640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8240d1520 con 0x7fb8240b3ff0 2023-12-22T08:46:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.906+0000 7fb8299ac640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8240d1800 con 0x7fb82406d640 2023-12-22T08:46:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.906+0000 7fb8299ac640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8240d1ae0 con 0x7fb824157980 2023-12-22T08:46:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.906+0000 7fb8291ab640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb82406d640 0x7fb8240d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.906+0000 7fb8291ab640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb82406d640 0x7fb8240d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35578/0 (socket says 172.21.15.38:35578) 2023-12-22T08:46:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.906+0000 7fb8291ab640 1 -- 172.21.15.38:0/2215304472 learned_addr learned my addr 172.21.15.38:0/2215304472 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.907+0000 7fb8291ab640 1 -- 172.21.15.38:0/2215304472 >> v2:172.21.15.89:3300/0 conn(0x7fb824157980 msgr2=0x7fb82415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.907+0000 7fb8291ab640 1 --2- 172.21.15.38:0/2215304472 >> v2:172.21.15.89:3300/0 conn(0x7fb824157980 0x7fb82415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.907+0000 7fb8291ab640 1 -- 172.21.15.38:0/2215304472 >> v1:172.21.15.89:6789/0 conn(0x7fb8240b3ff0 legacy=0x7fb82406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:04.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.907+0000 7fb8291ab640 1 -- 172.21.15.38:0/2215304472 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8240d1dc0 con 0x7fb82406d640 2023-12-22T08:46:04.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.908+0000 7fb8291ab640 1 --2- 172.21.15.38:0/2215304472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82406d640 0x7fb8240d25c0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb8240d3df0 tx=0x7fb81c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f55aeba872ea543 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:04.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.908+0000 7fb8237fe640 1 -- 172.21.15.38:0/2215304472 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c02ca80 con 0x7fb82406d640 2023-12-22T08:46:04.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.908+0000 7fb8237fe640 1 -- 172.21.15.38:0/2215304472 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c02cbe0 con 0x7fb82406d640 2023-12-22T08:46:04.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.908+0000 7fb8237fe640 1 -- 172.21.15.38:0/2215304472 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0343f0 con 0x7fb82406d640 2023-12-22T08:46:04.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.908+0000 7fb8299ac640 1 -- 172.21.15.38:0/2215304472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82406d640 msgr2=0x7fb8240d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:04.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.908+0000 7fb8299ac640 1 --2- 172.21.15.38:0/2215304472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82406d640 0x7fb8240d25c0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb8240d3df0 tx=0x7fb81c02bee0 comp rx=0 tx=0).stop 2023-12-22T08:46:04.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.909+0000 7fb8299ac640 1 -- 172.21.15.38:0/2215304472 shutdown_connections 2023-12-22T08:46:04.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.909+0000 7fb8299ac640 1 --2- 172.21.15.38:0/2215304472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82406d640 0x7fb8240d25c0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:04.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.909+0000 7fb8299ac640 1 --2- 172.21.15.38:0/2215304472 >> v2:172.21.15.89:3300/0 conn(0x7fb824157980 0x7fb82415eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:04.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.909+0000 7fb8299ac640 1 -- 172.21.15.38:0/2215304472 >> 172.21.15.38:0/2215304472 conn(0x7fb8240d31f0 msgr2=0x7fb8240d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:04.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.909+0000 7fb8299ac640 1 -- 172.21.15.38:0/2215304472 shutdown_connections 2023-12-22T08:46:04.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.909+0000 7fb8299ac640 1 -- 172.21.15.38:0/2215304472 wait complete. 2023-12-22T08:46:04.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.911+0000 7fb8299ac640 1 Processor -- start 2023-12-22T08:46:04.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.911+0000 7fb8299ac640 1 -- start start 2023-12-22T08:46:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.912+0000 7fb8299ac640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82406d640 0x7fb82414d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.912+0000 7fb8299ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8240b3ff0 0x7fb82406bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.912+0000 7fb8299ac640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb824157980 0x7fb82406c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.912+0000 7fb8299ac640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82414e7e0 con 0x7fb82406d640 2023-12-22T08:46:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.912+0000 7fb8299ac640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240b7c30 con 0x7fb8240b3ff0 2023-12-22T08:46:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.912+0000 7fb8299ac640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240b7f10 con 0x7fb824157980 2023-12-22T08:46:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.912+0000 7fb8289aa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82406d640 0x7fb82414d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.912+0000 7fb8289aa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82406d640 0x7fb82414d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35594/0 (socket says 172.21.15.38:35594) 2023-12-22T08:46:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.912+0000 7fb8289aa640 1 -- 172.21.15.38:0/1749012303 learned_addr learned my addr 172.21.15.38:0/1749012303 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.913+0000 7fb823fff640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8240b3ff0 0x7fb82406bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.913+0000 7fb8289aa640 1 -- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb824157980 msgr2=0x7fb82406c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.913+0000 7fb8289aa640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb824157980 0x7fb82406c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.913+0000 7fb8289aa640 1 -- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8240b3ff0 msgr2=0x7fb82406bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.913+0000 7fb8289aa640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8240b3ff0 0x7fb82406bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.913+0000 7fb8289aa640 1 -- 172.21.15.38:0/1749012303 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c009b30 con 0x7fb82406d640 2023-12-22T08:46:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.913+0000 7fb823fff640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8240b3ff0 0x7fb82406bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.913+0000 7fb8289aa640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82406d640 0x7fb82414d0e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fb81800b410 tx=0x7fb81800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.913+0000 7fb8217fa640 1 -- 172.21.15.38:0/1749012303 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818011830 con 0x7fb82406d640 2023-12-22T08:46:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.913+0000 7fb8217fa640 1 -- 172.21.15.38:0/1749012303 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8180119b0 con 0x7fb82406d640 2023-12-22T08:46:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.913+0000 7fb8217fa640 1 -- 172.21.15.38:0/1749012303 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818011d60 con 0x7fb82406d640 2023-12-22T08:46:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.913+0000 7fb8299ac640 1 -- 172.21.15.38:0/1749012303 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8240b81f0 con 0x7fb82406d640 2023-12-22T08:46:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.913+0000 7fb8299ac640 1 -- 172.21.15.38:0/1749012303 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82414d620 con 0x7fb82406d640 2023-12-22T08:46:04.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.915+0000 7fb8299ac640 1 -- 172.21.15.38:0/1749012303 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb824061910 con 0x7fb82406d640 2023-12-22T08:46:04.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.915+0000 7fb8217fa640 1 -- 172.21.15.38:0/1749012303 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb81801a400 con 0x7fb82406d640 2023-12-22T08:46:04.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.916+0000 7fb8217fa640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb80806a460 0x7fb80806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:04.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.917+0000 7fb8217fa640 1 -- 172.21.15.38:0/1749012303 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb8180887f0 con 0x7fb82406d640 2023-12-22T08:46:04.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.917+0000 7fb823fff640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb80806a460 0x7fb80806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.918+0000 7fb823fff640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb80806a460 0x7fb80806c920 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb810007fd0 tx=0x7fb810009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:04.921+0000 7fb8217fa640 1 -- 172.21.15.38:0/1749012303 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb818054040 con 0x7fb82406d640 2023-12-22T08:46:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.150+0000 7fb8299ac640 1 -- 172.21.15.38:0/1749012303 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8240b5230 con 0x7fb82406d640 2023-12-22T08:46:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.151+0000 7fb8217fa640 1 -- 172.21.15.38:0/1749012303 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fb818015090 con 0x7fb82406d640 2023-12-22T08:46:05.153 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:05.153 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5225,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2128001687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2128001687},{"type":"v1","addr":"172.21.15.89:6837","nonce":2128001687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1981758458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1981758458},{"type":"v1","addr":"172.21.15.89:6836","nonce":1981758458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6438,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1632983842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1632983842},{"type":"v1","addr":"172.21.15.38:6833","nonce":1632983842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6444,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2613790013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2613790013},{"type":"v1","addr":"172.21.15.38:6835","nonce":2613790013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[]} 2023-12-22T08:46:05.154 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 42 2023-12-22T08:46:05.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.154+0000 7fb8299ac640 1 -- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb80806a460 msgr2=0x7fb80806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.154+0000 7fb8299ac640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb80806a460 0x7fb80806c920 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb810007fd0 tx=0x7fb810009040 comp rx=0 tx=0).stop 2023-12-22T08:46:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.154+0000 7fb8299ac640 1 -- 172.21.15.38:0/1749012303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82406d640 msgr2=0x7fb82414d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.154+0000 7fb8299ac640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82406d640 0x7fb82414d0e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fb81800b410 tx=0x7fb81800b8d0 comp rx=0 tx=0).stop 2023-12-22T08:46:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.154+0000 7fb8299ac640 1 -- 172.21.15.38:0/1749012303 shutdown_connections 2023-12-22T08:46:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.154+0000 7fb8299ac640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb824157980 0x7fb82406c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.154+0000 7fb8299ac640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8240b3ff0 0x7fb82406bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.154+0000 7fb8299ac640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb80806a460 0x7fb80806c920 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.154+0000 7fb8299ac640 1 --2- 172.21.15.38:0/1749012303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82406d640 0x7fb82414d0e0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.154+0000 7fb8299ac640 1 -- 172.21.15.38:0/1749012303 >> 172.21.15.38:0/1749012303 conn(0x7fb8240d31f0 msgr2=0x7fb82406ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.154+0000 7fb8299ac640 1 -- 172.21.15.38:0/1749012303 shutdown_connections 2023-12-22T08:46:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.154+0000 7fb8299ac640 1 -- 172.21.15.38:0/1749012303 wait complete. 2023-12-22T08:46:05.175 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T08:46:05.175 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T08:46:05.176 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T08:46:05.176 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:46:05.176 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T08:46:05.176 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T08:46:05.176 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T08:46:05.176 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:46:05.176 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T08:46:05.177 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T08:46:05.177 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T08:46:05.177 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:46:05.177 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T08:46:05.177 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T08:46:05.178 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T08:46:05.178 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:46:05.194 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T08:46:05.194 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T08:46:05.196 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T08:46:05.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T08:46:05.199 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T08:46:05.199 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T08:46:05.202 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T08:46:05.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T08:46:05.244 INFO:tasks.ceph.mds.a:Started 2023-12-22T08:46:05.245 DEBUG:teuthology.parallel:result is None 2023-12-22T08:46:05.250 INFO:tasks.ceph.mds.b:Started 2023-12-22T08:46:05.250 DEBUG:teuthology.parallel:result is None 2023-12-22T08:46:05.253 INFO:tasks.ceph.mds.c:Started 2023-12-22T08:46:05.253 DEBUG:teuthology.parallel:result is None 2023-12-22T08:46:05.257 INFO:tasks.ceph.mds.d:Started 2023-12-22T08:46:05.257 DEBUG:teuthology.parallel:result is None 2023-12-22T08:46:05.257 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-22T08:46:05.417 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:46:05.417 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-12-22T08:46:05.417 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-22T08:46:05.418 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:46:05.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.450+0000 7fe9e9327640 1 Processor -- start 2023-12-22T08:46:05.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.451+0000 7fe9e9327640 1 -- start start 2023-12-22T08:46:05.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.453+0000 7fe9e9327640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe9e415e740 0x7fe9e415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:05.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.453+0000 7fe9e9327640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e415eb20 con 0x7fe9e40b3f90 2023-12-22T08:46:05.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.453+0000 7fe9e9327640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e4070770 con 0x7fe9e406ca50 2023-12-22T08:46:05.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.453+0000 7fe9e9327640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e406e650 con 0x7fe9e415e740 2023-12-22T08:46:05.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.453+0000 7fe9e27fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe9e406ca50 0x7fe9e40b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:56728/0 (socket says 172.21.15.38:56728) 2023-12-22T08:46:05.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.453+0000 7fe9e37fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe9e40b3f90 0x7fe9e4070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44798/0 (socket says 172.21.15.38:44798) 2023-12-22T08:46:05.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.453+0000 7fe9e27fc640 1 -- 172.21.15.38:0/1216421726 learned_addr learned my addr 172.21.15.38:0/1216421726 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:05.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.453+0000 7fe9e2ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe9e415e740 0x7fe9e415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:05.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.454+0000 7fe9e1ffb640 1 -- 172.21.15.38:0/1216421726 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049180243 0 0) 0x7fe9e4070770 con 0x7fe9e406ca50 2023-12-22T08:46:05.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.454+0000 7fe9e1ffb640 1 -- 172.21.15.38:0/1216421726 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9cc003520 con 0x7fe9e406ca50 2023-12-22T08:46:05.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.454+0000 7fe9e2ffd640 1 -- 172.21.15.38:0/1216421726 >> v1:172.21.15.89:6789/0 conn(0x7fe9e406ca50 legacy=0x7fe9e40b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:05.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.454+0000 7fe9e2ffd640 1 -- 172.21.15.38:0/1216421726 >> v1:172.21.15.38:6789/0 conn(0x7fe9e40b3f90 legacy=0x7fe9e4070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:05.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.454+0000 7fe9e2ffd640 1 -- 172.21.15.38:0/1216421726 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e406cec0 con 0x7fe9e415e740 2023-12-22T08:46:05.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.455+0000 7fe9e2ffd640 1 --2- 172.21.15.38:0/1216421726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e415e740 0x7fe9e415db30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40097a0 tx=0x7fe9d402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dc91440617f3920 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:05.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.455+0000 7fe9e1ffb640 1 -- 172.21.15.38:0/1216421726 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d402e070 con 0x7fe9e415e740 2023-12-22T08:46:05.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.455+0000 7fe9e1ffb640 1 -- 172.21.15.38:0/1216421726 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d40315a0 con 0x7fe9e415e740 2023-12-22T08:46:05.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.455+0000 7fe9e1ffb640 1 -- 172.21.15.38:0/1216421726 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4031930 con 0x7fe9e415e740 2023-12-22T08:46:05.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.456+0000 7fe9e9327640 1 -- 172.21.15.38:0/1216421726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e415e740 msgr2=0x7fe9e415db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:05.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.456+0000 7fe9e9327640 1 --2- 172.21.15.38:0/1216421726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e415e740 0x7fe9e415db30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40097a0 tx=0x7fe9d402b840 comp rx=0 tx=0).stop 2023-12-22T08:46:05.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.457+0000 7fe9e9327640 1 -- 172.21.15.38:0/1216421726 shutdown_connections 2023-12-22T08:46:05.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.457+0000 7fe9e9327640 1 --2- 172.21.15.38:0/1216421726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e415e740 0x7fe9e415db30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:05.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.457+0000 7fe9e9327640 1 -- 172.21.15.38:0/1216421726 >> 172.21.15.38:0/1216421726 conn(0x7fe9e40cfea0 msgr2=0x7fe9e40d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:05.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.457+0000 7fe9e9327640 1 -- 172.21.15.38:0/1216421726 shutdown_connections 2023-12-22T08:46:05.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.457+0000 7fe9e9327640 1 -- 172.21.15.38:0/1216421726 wait complete. 2023-12-22T08:46:05.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.459+0000 7fe9e9327640 1 Processor -- start 2023-12-22T08:46:05.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.459+0000 7fe9e9327640 1 -- start start 2023-12-22T08:46:05.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.461+0000 7fe9e9327640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e406ca50 0x7fe9e41f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:05.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.461+0000 7fe9e9327640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e40b3f90 0x7fe9e4150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:05.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.461+0000 7fe9e9327640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9e415e740 0x7fe9e40b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:05.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.461+0000 7fe9e9327640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e41f6710 con 0x7fe9e40b3f90 2023-12-22T08:46:05.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.461+0000 7fe9e9327640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e40b6340 con 0x7fe9e406ca50 2023-12-22T08:46:05.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.461+0000 7fe9e9327640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e41f60c0 con 0x7fe9e415e740 2023-12-22T08:46:05.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.461+0000 7fe9e27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e40b3f90 0x7fe9e4150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:05.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.461+0000 7fe9e2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e406ca50 0x7fe9e41f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:05.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.461+0000 7fe9e27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e40b3f90 0x7fe9e4150cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35634/0 (socket says 172.21.15.38:35634) 2023-12-22T08:46:05.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.461+0000 7fe9e27fc640 1 -- 172.21.15.38:0/1954277066 learned_addr learned my addr 172.21.15.38:0/1954277066 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:05.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.461+0000 7fe9e37fe640 1 --2- 172.21.15.38:0/1954277066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9e415e740 0x7fe9e40b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:05.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.462+0000 7fe9e27fc640 1 -- 172.21.15.38:0/1954277066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9e415e740 msgr2=0x7fe9e40b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:05.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.462+0000 7fe9e27fc640 1 --2- 172.21.15.38:0/1954277066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9e415e740 0x7fe9e40b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:05.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.462+0000 7fe9e27fc640 1 -- 172.21.15.38:0/1954277066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e406ca50 msgr2=0x7fe9e41f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:05.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.462+0000 7fe9e27fc640 1 --2- 172.21.15.38:0/1954277066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e406ca50 0x7fe9e41f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:05.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.462+0000 7fe9e27fc640 1 -- 172.21.15.38:0/1954277066 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d4009400 con 0x7fe9e40b3f90 2023-12-22T08:46:05.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.462+0000 7fe9e27fc640 1 --2- 172.21.15.38:0/1954277066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e40b3f90 0x7fe9e4150cc0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c410 tx=0x7fe9d800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:05.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.465+0000 7fe9cb7fe640 1 -- 172.21.15.38:0/1954277066 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8005ce0 con 0x7fe9e40b3f90 2023-12-22T08:46:05.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.465+0000 7fe9e9327640 1 -- 172.21.15.38:0/1954277066 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e41f63a0 con 0x7fe9e40b3f90 2023-12-22T08:46:05.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.465+0000 7fe9e9327640 1 -- 172.21.15.38:0/1954277066 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e4151200 con 0x7fe9e40b3f90 2023-12-22T08:46:05.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.465+0000 7fe9cb7fe640 1 -- 172.21.15.38:0/1954277066 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d8005e40 con 0x7fe9e40b3f90 2023-12-22T08:46:05.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.465+0000 7fe9cb7fe640 1 -- 172.21.15.38:0/1954277066 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80072d0 con 0x7fe9e40b3f90 2023-12-22T08:46:05.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.466+0000 7fe9e9327640 1 -- 172.21.15.38:0/1954277066 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c4005250 con 0x7fe9e40b3f90 2023-12-22T08:46:05.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.468+0000 7fe9cb7fe640 1 -- 172.21.15.38:0/1954277066 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe9d8007430 con 0x7fe9e40b3f90 2023-12-22T08:46:05.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.470+0000 7fe9cb7fe640 1 --2- 172.21.15.38:0/1954277066 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe9d006a430 0x7fe9d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:05.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.470+0000 7fe9cb7fe640 1 -- 172.21.15.38:0/1954277066 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe9d8087ae0 con 0x7fe9e40b3f90 2023-12-22T08:46:05.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.470+0000 7fe9e2ffd640 1 --2- 172.21.15.38:0/1954277066 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe9d006a430 0x7fe9d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:05.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.471+0000 7fe9e2ffd640 1 --2- 172.21.15.38:0/1954277066 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe9d006a430 0x7fe9d006c8f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4036000 tx=0x7fe9d403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:05.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.474+0000 7fe9cb7fe640 1 -- 172.21.15.38:0/1954277066 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe9d8053540 con 0x7fe9e40b3f90 2023-12-22T08:46:05.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:05.679+0000 7fe9e9327640 1 -- 172.21.15.38:0/1954277066 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe9c4005500 con 0x7fe9e40b3f90 2023-12-22T08:46:06.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.478+0000 7fe9cb7fe640 1 -- 172.21.15.38:0/1954277066 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v106) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe9d8056b60 con 0x7fe9e40b3f90 2023-12-22T08:46:06.481 INFO:teuthology.orchestra.run.smithi038.stderr: removed all blocklist entries 2023-12-22T08:46:06.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.483+0000 7fe9e9327640 1 -- 172.21.15.38:0/1954277066 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe9d006a430 msgr2=0x7fe9d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:06.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.483+0000 7fe9e9327640 1 --2- 172.21.15.38:0/1954277066 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe9d006a430 0x7fe9d006c8f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4036000 tx=0x7fe9d403d040 comp rx=0 tx=0).stop 2023-12-22T08:46:06.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.483+0000 7fe9e9327640 1 -- 172.21.15.38:0/1954277066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e40b3f90 msgr2=0x7fe9e4150cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:06.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.483+0000 7fe9e9327640 1 --2- 172.21.15.38:0/1954277066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e40b3f90 0x7fe9e4150cc0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c410 tx=0x7fe9d800c8d0 comp rx=0 tx=0).stop 2023-12-22T08:46:06.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.483+0000 7fe9e9327640 1 -- 172.21.15.38:0/1954277066 shutdown_connections 2023-12-22T08:46:06.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.483+0000 7fe9e9327640 1 --2- 172.21.15.38:0/1954277066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9e415e740 0x7fe9e40b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:06.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.483+0000 7fe9e9327640 1 --2- 172.21.15.38:0/1954277066 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe9d006a430 0x7fe9d006c8f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:06.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.483+0000 7fe9e9327640 1 --2- 172.21.15.38:0/1954277066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9e40b3f90 0x7fe9e4150cc0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:06.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.483+0000 7fe9e9327640 1 --2- 172.21.15.38:0/1954277066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9e406ca50 0x7fe9e41f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:06.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.483+0000 7fe9e9327640 1 -- 172.21.15.38:0/1954277066 >> 172.21.15.38:0/1954277066 conn(0x7fe9e40cfea0 msgr2=0x7fe9e40b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:06.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.483+0000 7fe9e9327640 1 -- 172.21.15.38:0/1954277066 shutdown_connections 2023-12-22T08:46:06.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.483+0000 7fe9e9327640 1 -- 172.21.15.38:0/1954277066 wait complete. 2023-12-22T08:46:06.507 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T08:46:06.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.733+0000 7fdf9a99b640 1 Processor -- start 2023-12-22T08:46:06.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.733+0000 7fdf9a99b640 1 -- start start 2023-12-22T08:46:06.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf9a99b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdf94157980 0x7fdf9415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:06.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf9a99b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdf940b3ff0 0x7fdf9406cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:06.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf9a99b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf940d1520 con 0x7fdf940b44a0 2023-12-22T08:46:06.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf9a99b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf940d1800 con 0x7fdf94157980 2023-12-22T08:46:06.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf9a99b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf940d1ae0 con 0x7fdf940b3ff0 2023-12-22T08:46:06.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf99999640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdf94157980 0x7fdf9415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:06.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf99999640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdf94157980 0x7fdf9415eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35640/0 (socket says 172.21.15.38:35640) 2023-12-22T08:46:06.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf99999640 1 -- 172.21.15.38:0/3453043297 learned_addr learned my addr 172.21.15.38:0/3453043297 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:06.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf99198640 1 --2- 172.21.15.38:0/3453043297 >> v2:172.21.15.89:3300/0 conn(0x7fdf940b3ff0 0x7fdf9406cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:06.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf99999640 1 -- 172.21.15.38:0/3453043297 >> v2:172.21.15.89:3300/0 conn(0x7fdf940b3ff0 msgr2=0x7fdf9406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:06.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf99999640 1 --2- 172.21.15.38:0/3453043297 >> v2:172.21.15.89:3300/0 conn(0x7fdf940b3ff0 0x7fdf9406cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:06.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf99999640 1 -- 172.21.15.38:0/3453043297 >> v1:172.21.15.89:6789/0 conn(0x7fdf940b44a0 legacy=0x7fdf940d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:06.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf99999640 1 -- 172.21.15.38:0/3453043297 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf940d1dc0 con 0x7fdf94157980 2023-12-22T08:46:06.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.735+0000 7fdf99198640 1 --2- 172.21.15.38:0/3453043297 >> v2:172.21.15.89:3300/0 conn(0x7fdf940b3ff0 0x7fdf9406cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:06.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.737+0000 7fdf99999640 1 --2- 172.21.15.38:0/3453043297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf94157980 0x7fdf9415eb10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fdf940d3f10 tx=0x7fdf9002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf43cc679b3d64a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:06.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.737+0000 7fdf98997640 1 -- 172.21.15.38:0/3453043297 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9002ca80 con 0x7fdf94157980 2023-12-22T08:46:06.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.737+0000 7fdf98997640 1 -- 172.21.15.38:0/3453043297 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9002cbe0 con 0x7fdf94157980 2023-12-22T08:46:06.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.737+0000 7fdf98997640 1 -- 172.21.15.38:0/3453043297 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf900343f0 con 0x7fdf94157980 2023-12-22T08:46:06.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.738+0000 7fdf9a99b640 1 -- 172.21.15.38:0/3453043297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf94157980 msgr2=0x7fdf9415eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:06.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.738+0000 7fdf9a99b640 1 --2- 172.21.15.38:0/3453043297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf94157980 0x7fdf9415eb10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fdf940d3f10 tx=0x7fdf9002bee0 comp rx=0 tx=0).stop 2023-12-22T08:46:06.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.738+0000 7fdf9a99b640 1 -- 172.21.15.38:0/3453043297 shutdown_connections 2023-12-22T08:46:06.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.738+0000 7fdf9a99b640 1 --2- 172.21.15.38:0/3453043297 >> v2:172.21.15.89:3300/0 conn(0x7fdf940b3ff0 0x7fdf9406cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:06.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.738+0000 7fdf9a99b640 1 --2- 172.21.15.38:0/3453043297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf94157980 0x7fdf9415eb10 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:06.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.738+0000 7fdf9a99b640 1 -- 172.21.15.38:0/3453043297 >> 172.21.15.38:0/3453043297 conn(0x7fdf940d31f0 msgr2=0x7fdf940d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:06.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.738+0000 7fdf9a99b640 1 -- 172.21.15.38:0/3453043297 shutdown_connections 2023-12-22T08:46:06.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.738+0000 7fdf9a99b640 1 -- 172.21.15.38:0/3453043297 wait complete. 2023-12-22T08:46:06.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.740+0000 7fdf9a99b640 1 Processor -- start 2023-12-22T08:46:06.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.740+0000 7fdf9a99b640 1 -- start start 2023-12-22T08:46:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.741+0000 7fdf9a99b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf940b3ff0 0x7fdf94148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.741+0000 7fdf9a99b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf940b44a0 0x7fdf94160b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.741+0000 7fdf9a99b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf94157980 0x7fdf94161060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.741+0000 7fdf9a99b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94160550 con 0x7fdf94157980 2023-12-22T08:46:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.741+0000 7fdf9a99b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf941f2e70 con 0x7fdf940b3ff0 2023-12-22T08:46:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.741+0000 7fdf9a99b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9415f9d0 con 0x7fdf940b44a0 2023-12-22T08:46:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.741+0000 7fdf9a19a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf94157980 0x7fdf94161060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.741+0000 7fdf9a19a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf94157980 0x7fdf94161060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35646/0 (socket says 172.21.15.38:35646) 2023-12-22T08:46:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.741+0000 7fdf9a19a640 1 -- 172.21.15.38:0/1393727582 learned_addr learned my addr 172.21.15.38:0/1393727582 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.741+0000 7fdf99999640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf940b3ff0 0x7fdf94148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.741+0000 7fdf9a19a640 1 -- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf940b44a0 msgr2=0x7fdf94160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.741+0000 7fdf99198640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf940b44a0 0x7fdf94160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.742+0000 7fdf9a19a640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf940b44a0 0x7fdf94160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.742+0000 7fdf9a19a640 1 -- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf940b3ff0 msgr2=0x7fdf94148700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.742+0000 7fdf9a19a640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf940b3ff0 0x7fdf94148700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.742+0000 7fdf9a19a640 1 -- 172.21.15.38:0/1393727582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf90009b30 con 0x7fdf94157980 2023-12-22T08:46:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.742+0000 7fdf99999640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf940b3ff0 0x7fdf94148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.742+0000 7fdf9a19a640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf94157980 0x7fdf94161060 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00c390 tx=0x7fdf8c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.742+0000 7fdf8a7fc640 1 -- 172.21.15.38:0/1393727582 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0035f0 con 0x7fdf94157980 2023-12-22T08:46:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.742+0000 7fdf8a7fc640 1 -- 172.21.15.38:0/1393727582 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c003750 con 0x7fdf94157980 2023-12-22T08:46:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.742+0000 7fdf8a7fc640 1 -- 172.21.15.38:0/1393727582 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c003b00 con 0x7fdf94157980 2023-12-22T08:46:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.742+0000 7fdf9a99b640 1 -- 172.21.15.38:0/1393727582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9415fcb0 con 0x7fdf94157980 2023-12-22T08:46:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.742+0000 7fdf9a99b640 1 -- 172.21.15.38:0/1393727582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf94160270 con 0x7fdf94157980 2023-12-22T08:46:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.744+0000 7fdf9a99b640 1 -- 172.21.15.38:0/1393727582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf941f2fe0 con 0x7fdf94157980 2023-12-22T08:46:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.745+0000 7fdf8a7fc640 1 -- 172.21.15.38:0/1393727582 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdf8c003c60 con 0x7fdf94157980 2023-12-22T08:46:06.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.745+0000 7fdf8a7fc640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdf7806a430 0x7fdf7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:06.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.746+0000 7fdf8a7fc640 1 -- 172.21.15.38:0/1393727582 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdf8c0878c0 con 0x7fdf94157980 2023-12-22T08:46:06.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.746+0000 7fdf99999640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdf7806a430 0x7fdf7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:06.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.748+0000 7fdf99999640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdf7806a430 0x7fdf7806c8f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdf90035000 tx=0x7fdf90030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:06.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:06.750+0000 7fdf8a7fc640 1 -- 172.21.15.38:0/1393727582 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdf941f2fe0 con 0x7fdf94157980 2023-12-22T08:46:07.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.014+0000 7fdf9a99b640 1 -- 172.21.15.38:0/1393727582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdf941f2fe0 con 0x7fdf94157980 2023-12-22T08:46:07.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.015+0000 7fdf8a7fc640 1 -- 172.21.15.38:0/1393727582 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdf941f2fe0 con 0x7fdf94157980 2023-12-22T08:46:07.017 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:07.017 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:46:07.017 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_dump": [ 2023-12-22T08:46:07.017 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.017 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.a", 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl57dkCBAAeliJIPc49iRBk2mp8WYv8A==", 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.b", 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl0C0+KhAAkCsjfyn19nOz1xTyhZkbPQ==", 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:46:07.018 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.c", 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl7poXGhAA+ZSohyj4dAOs6B5dZKTLAg==", 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.019 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.d", 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4VlTBuoOhAArKX4AiOQRGawIyAnInIhCg==", 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.0", 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VlnVQaChAAxfWmPqwo5D4qBYkAP/6dHQ==", 2023-12-22T08:46:07.020 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.021 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:46:07.021 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:46:07.021 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.021 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.021 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.021 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.021 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.1", 2023-12-22T08:46:07.021 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4Vll2dlGxAAbqx4rxnz4FWIKl9OGqcwtw==", 2023-12-22T08:46:07.021 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.021 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:46:07.021 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:46:07.021 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.021 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.022 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.022 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.022 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.2", 2023-12-22T08:46:07.022 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VljQ3HLRAAfyrtqD4n6Da8Rl/6UKmv7g==", 2023-12-22T08:46:07.022 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.022 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:46:07.022 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:46:07.022 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.022 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.3", 2023-12-22T08:46:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBCS4VlOat4AxAAIkAGRvGGWrrwx/ppMbexWQ==", 2023-12-22T08:46:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:46:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:46:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.4", 2023-12-22T08:46:07.023 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlwg7TDxAA+L504F+Hw/6FTJ63cV3ZXg==", 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.5", 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx8zgHxAALBDm/sSYqw/fn4nLNQbu4A==", 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.024 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.6", 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx5OdLxAAaMP09nYI3HKiuhPARgnCOw==", 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.7", 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBHS4Vl/15bBBAA4maatkcgA0axcZY/L9r/IA==", 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.025 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.0", 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlgDspDhAA0TWGbk4AbuOhCNotPej29A==", 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow r", 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.026 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.1", 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlwSk/JhAAM3faae43p4/gw9BmyxLpJA==", 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.2", 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VliOHMGhAARaM8FC/0maNMToLGhBR4Tg==", 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:46:07.027 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.3", 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlV/MVMRAAyN1643IAOTLOLuz4DqMZ8A==", 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.028 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.admin", 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA2S4VlBhogNhAACBsSGP7kmhCSn+XAKkvgKQ==", 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.x", 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlTHG+NhAAUNkVtrDuoK2OEsy1HHkt2A==", 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:46:07.029 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.y", 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlED5ALBAAComDf9woKBt/IXcez+Udmg==", 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:07.030 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:46:07.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.018+0000 7fdf9a99b640 1 -- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdf7806a430 msgr2=0x7fdf7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.018+0000 7fdf9a99b640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdf7806a430 0x7fdf7806c8f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdf90035000 tx=0x7fdf90030000 comp rx=0 tx=0).stop 2023-12-22T08:46:07.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.018+0000 7fdf9a99b640 1 -- 172.21.15.38:0/1393727582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf94157980 msgr2=0x7fdf94161060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.018+0000 7fdf9a99b640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf94157980 0x7fdf94161060 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00c390 tx=0x7fdf8c00c850 comp rx=0 tx=0).stop 2023-12-22T08:46:07.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.019+0000 7fdf9a99b640 1 -- 172.21.15.38:0/1393727582 shutdown_connections 2023-12-22T08:46:07.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.019+0000 7fdf9a99b640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdf7806a430 0x7fdf7806c8f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.019+0000 7fdf9a99b640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf94157980 0x7fdf94161060 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.019+0000 7fdf9a99b640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf940b44a0 0x7fdf94160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.019+0000 7fdf9a99b640 1 --2- 172.21.15.38:0/1393727582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf940b3ff0 0x7fdf94148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.019+0000 7fdf9a99b640 1 -- 172.21.15.38:0/1393727582 >> 172.21.15.38:0/1393727582 conn(0x7fdf940d31f0 msgr2=0x7fdf9406cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:07.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.019+0000 7fdf9a99b640 1 -- 172.21.15.38:0/1393727582 shutdown_connections 2023-12-22T08:46:07.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.019+0000 7fdf9a99b640 1 -- 172.21.15.38:0/1393727582 wait complete. 2023-12-22T08:46:07.040 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:46:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.263+0000 7f8f72450640 1 Processor -- start 2023-12-22T08:46:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.264+0000 7f8f72450640 1 -- start start 2023-12-22T08:46:07.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.265+0000 7f8f72450640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f6c06d210 0x7f8f6c15e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:07.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.265+0000 7f8f72450640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f6c06d5f0 0x7f8f6c070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:07.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.265+0000 7f8f72450640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6c0706d0 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.265+0000 7f8f72450640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c0cbf40 con 0x7f8f6c06d5f0 2023-12-22T08:46:07.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.265+0000 7f8f72450640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0ce840 con 0x7f8f6c06d210 2023-12-22T08:46:07.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.266+0000 7f8f71c4f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f6c06d5f0 0x7f8f6c070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:07.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.266+0000 7f8f7144e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f6c06d210 0x7f8f6c15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:07.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.266+0000 7f8f71c4f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f6c06d5f0 0x7f8f6c070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:59322/0 (socket says 172.21.15.38:59322) 2023-12-22T08:46:07.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.266+0000 7f8f71c4f640 1 -- 172.21.15.38:0/4119574240 learned_addr learned my addr 172.21.15.38:0/4119574240 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:07.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.266+0000 7f8f71c4f640 1 -- 172.21.15.38:0/4119574240 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f6c06d210 msgr2=0x7f8f6c15e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:07.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.266+0000 7f8f71c4f640 1 --2- 172.21.15.38:0/4119574240 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f6c06d210 0x7f8f6c15e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.266+0000 7f8f71c4f640 1 -- 172.21.15.38:0/4119574240 >> v1:172.21.15.89:6789/0 conn(0x7f8f6c0cb4c0 legacy=0x7f8f6c159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.266+0000 7f8f71c4f640 1 -- 172.21.15.38:0/4119574240 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c0ceb20 con 0x7f8f6c06d5f0 2023-12-22T08:46:07.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.268+0000 7f8f71c4f640 1 --2- 172.21.15.38:0/4119574240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c06d5f0 0x7f8f6c070b60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009870 tx=0x7f8f6402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ce2b02399ab1ec1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.268+0000 7f8f63fff640 1 -- 172.21.15.38:0/4119574240 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64030840 con 0x7f8f6c06d5f0 2023-12-22T08:46:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.269+0000 7f8f63fff640 1 -- 172.21.15.38:0/4119574240 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f640309a0 con 0x7f8f6c06d5f0 2023-12-22T08:46:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.269+0000 7f8f63fff640 1 -- 172.21.15.38:0/4119574240 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64030d30 con 0x7f8f6c06d5f0 2023-12-22T08:46:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.269+0000 7f8f72450640 1 -- 172.21.15.38:0/4119574240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c06d5f0 msgr2=0x7f8f6c070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.269+0000 7f8f72450640 1 --2- 172.21.15.38:0/4119574240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c06d5f0 0x7f8f6c070b60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009870 tx=0x7f8f6402b980 comp rx=0 tx=0).stop 2023-12-22T08:46:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.269+0000 7f8f72450640 1 -- 172.21.15.38:0/4119574240 shutdown_connections 2023-12-22T08:46:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.269+0000 7f8f72450640 1 --2- 172.21.15.38:0/4119574240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c06d5f0 0x7f8f6c070b60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.269+0000 7f8f72450640 1 --2- 172.21.15.38:0/4119574240 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f6c06d210 0x7f8f6c15e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.269+0000 7f8f72450640 1 -- 172.21.15.38:0/4119574240 >> 172.21.15.38:0/4119574240 conn(0x7f8f6c0b1f70 msgr2=0x7f8f6c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.269+0000 7f8f72450640 1 -- 172.21.15.38:0/4119574240 shutdown_connections 2023-12-22T08:46:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.270+0000 7f8f72450640 1 -- 172.21.15.38:0/4119574240 wait complete. 2023-12-22T08:46:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.271+0000 7f8f72450640 1 Processor -- start 2023-12-22T08:46:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.271+0000 7f8f72450640 1 -- start start 2023-12-22T08:46:07.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.272+0000 7f8f72450640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c06d210 0x7f8f6c1f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:07.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.272+0000 7f8f72450640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f6c06d5f0 0x7f8f6c071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:07.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.272+0000 7f8f72450640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f6c0cb4c0 0x7f8f6c0c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:07.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.272+0000 7f8f72450640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c153be0 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.272+0000 7f8f72450640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0c2d30 con 0x7f8f6c06d210 2023-12-22T08:46:07.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.272+0000 7f8f72450640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c1f2910 con 0x7f8f6c06d5f0 2023-12-22T08:46:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.273+0000 7f8f71c4f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f6c0cb4c0 0x7f8f6c0c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.273+0000 7f8f71c4f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f6c0cb4c0 0x7f8f6c0c2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35652/0 (socket says 172.21.15.38:35652) 2023-12-22T08:46:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.273+0000 7f8f71c4f640 1 -- 172.21.15.38:0/3553533917 learned_addr learned my addr 172.21.15.38:0/3553533917 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:07.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.273+0000 7f8f7144e640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c06d210 0x7f8f6c1f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:07.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.273+0000 7f8f70c4d640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f6c06d5f0 0x7f8f6c071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:07.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.274+0000 7f8f71c4f640 1 -- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f6c06d5f0 msgr2=0x7f8f6c071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.274+0000 7f8f71c4f640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f6c06d5f0 0x7f8f6c071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.274+0000 7f8f71c4f640 1 -- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c06d210 msgr2=0x7f8f6c1f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.274+0000 7f8f71c4f640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c06d210 0x7f8f6c1f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.274+0000 7f8f71c4f640 1 -- 172.21.15.38:0/3553533917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f640094d0 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.274+0000 7f8f71c4f640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f6c0cb4c0 0x7f8f6c0c2070 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009870 tx=0x7f8f64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:07.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.274+0000 7f8f61ffb640 1 -- 172.21.15.38:0/3553533917 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64039c90 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.274+0000 7f8f61ffb640 1 -- 172.21.15.38:0/3553533917 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f64039e10 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.274+0000 7f8f72450640 1 -- 172.21.15.38:0/3553533917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c0c2f40 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.274+0000 7f8f61ffb640 1 -- 172.21.15.38:0/3553533917 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64043640 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.275+0000 7f8f72450640 1 -- 172.21.15.38:0/3553533917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c0c3500 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.276+0000 7f8f72450640 1 -- 172.21.15.38:0/3553533917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c06eaf0 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.277+0000 7f8f61ffb640 1 -- 172.21.15.38:0/3553533917 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f640437a0 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.277+0000 7f8f61ffb640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f5006a430 0x7f8f5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:07.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.278+0000 7f8f61ffb640 1 -- 172.21.15.38:0/3553533917 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8f6403e070 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.278+0000 7f8f7144e640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f5006a430 0x7f8f5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:07.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.280+0000 7f8f7144e640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f5006a430 0x7f8f5006c8f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8f680113e0 tx=0x7f8f6800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:07.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.283+0000 7f8f61ffb640 1 -- 172.21.15.38:0/3553533917 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8f64076e60 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.480+0000 7f8f72450640 1 -- 172.21.15.38:0/3553533917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f6c061910 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.482+0000 7f8f61ffb640 1 -- 172.21.15.38:0/3553533917 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+12343 (secure 0 0 0) 0x7f8f6407a480 con 0x7f8f6c0cb4c0 2023-12-22T08:46:07.484 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:07.484 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":106,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:46:06.462248+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:46:07.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.484+0000 7f8f72450640 1 -- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f5006a430 msgr2=0x7f8f5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.484+0000 7f8f72450640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f5006a430 0x7f8f5006c8f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8f680113e0 tx=0x7f8f6800b040 comp rx=0 tx=0).stop 2023-12-22T08:46:07.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.484+0000 7f8f72450640 1 -- 172.21.15.38:0/3553533917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f6c0cb4c0 msgr2=0x7f8f6c0c2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.484+0000 7f8f72450640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f6c0cb4c0 0x7f8f6c0c2070 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009870 tx=0x7f8f64004730 comp rx=0 tx=0).stop 2023-12-22T08:46:07.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.485+0000 7f8f72450640 1 -- 172.21.15.38:0/3553533917 shutdown_connections 2023-12-22T08:46:07.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.485+0000 7f8f72450640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8f5006a430 0x7f8f5006c8f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.485+0000 7f8f72450640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f6c0cb4c0 0x7f8f6c0c2070 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.485+0000 7f8f72450640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f6c06d5f0 0x7f8f6c071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.485+0000 7f8f72450640 1 --2- 172.21.15.38:0/3553533917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c06d210 0x7f8f6c1f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.485+0000 7f8f72450640 1 -- 172.21.15.38:0/3553533917 >> 172.21.15.38:0/3553533917 conn(0x7f8f6c0b1f70 msgr2=0x7f8f6c06f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:07.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.485+0000 7f8f72450640 1 -- 172.21.15.38:0/3553533917 shutdown_connections 2023-12-22T08:46:07.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.485+0000 7f8f72450640 1 -- 172.21.15.38:0/3553533917 wait complete. 2023-12-22T08:46:07.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:46:07.508 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:46:07.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.738+0000 7f8eca384640 1 Processor -- start 2023-12-22T08:46:07.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.738+0000 7f8eca384640 1 -- start start 2023-12-22T08:46:07.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.740+0000 7f8eca384640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8ec415e870 0x7f8ec40ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:07.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.740+0000 7f8eca384640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ec4070e80 0x7f8ec406f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:07.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.740+0000 7f8eca384640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec40ce4b0 con 0x7f8ec415ec50 2023-12-22T08:46:07.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.740+0000 7f8eca384640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec415fea0 con 0x7f8ec415e870 2023-12-22T08:46:07.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.740+0000 7f8eca384640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40cdb80 con 0x7f8ec4070e80 2023-12-22T08:46:07.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.741+0000 7f8ec3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8ec415e870 0x7f8ec40ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:07.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.741+0000 7f8ec3fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8ec415e870 0x7f8ec40ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:59354/0 (socket says 172.21.15.38:59354) 2023-12-22T08:46:07.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.741+0000 7f8ec3fff640 1 -- 172.21.15.38:0/1637943443 learned_addr learned my addr 172.21.15.38:0/1637943443 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:07.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.741+0000 7f8ec8921640 1 --2- 172.21.15.38:0/1637943443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ec4070e80 0x7f8ec406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:07.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.742+0000 7f8ec3fff640 1 -- 172.21.15.38:0/1637943443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ec4070e80 msgr2=0x7f8ec406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:07.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.742+0000 7f8ec3fff640 1 --2- 172.21.15.38:0/1637943443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ec4070e80 0x7f8ec406f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.742+0000 7f8ec3fff640 1 -- 172.21.15.38:0/1637943443 >> v1:172.21.15.89:6789/0 conn(0x7f8ec415ec50 legacy=0x7f8ec4070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.742+0000 7f8ec3fff640 1 -- 172.21.15.38:0/1637943443 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec40cde60 con 0x7f8ec415e870 2023-12-22T08:46:07.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.743+0000 7f8ec3fff640 1 --2- 172.21.15.38:0/1637943443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec415e870 0x7f8ec40ce940 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009870 tx=0x7f8eb402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81d2fcf67e719377 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:07.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.744+0000 7f8ec2ffd640 1 -- 172.21.15.38:0/1637943443 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4031640 con 0x7f8ec415e870 2023-12-22T08:46:07.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.744+0000 7f8ec2ffd640 1 -- 172.21.15.38:0/1637943443 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb40317a0 con 0x7f8ec415e870 2023-12-22T08:46:07.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.744+0000 7f8ec2ffd640 1 -- 172.21.15.38:0/1637943443 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4031b30 con 0x7f8ec415e870 2023-12-22T08:46:07.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.744+0000 7f8eca384640 1 -- 172.21.15.38:0/1637943443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec415e870 msgr2=0x7f8ec40ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.744+0000 7f8eca384640 1 --2- 172.21.15.38:0/1637943443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec415e870 0x7f8ec40ce940 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009870 tx=0x7f8eb402b8f0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.745+0000 7f8eca384640 1 -- 172.21.15.38:0/1637943443 shutdown_connections 2023-12-22T08:46:07.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.745+0000 7f8eca384640 1 --2- 172.21.15.38:0/1637943443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ec4070e80 0x7f8ec406f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.745+0000 7f8eca384640 1 --2- 172.21.15.38:0/1637943443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec415e870 0x7f8ec40ce940 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.745+0000 7f8eca384640 1 -- 172.21.15.38:0/1637943443 >> 172.21.15.38:0/1637943443 conn(0x7f8ec40b20c0 msgr2=0x7f8ec40b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:07.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.745+0000 7f8eca384640 1 -- 172.21.15.38:0/1637943443 shutdown_connections 2023-12-22T08:46:07.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.745+0000 7f8eca384640 1 -- 172.21.15.38:0/1637943443 wait complete. 2023-12-22T08:46:07.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.747+0000 7f8eca384640 1 Processor -- start 2023-12-22T08:46:07.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.747+0000 7f8eca384640 1 -- start start 2023-12-22T08:46:07.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.749+0000 7f8eca384640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec4070e80 0x7f8ec415d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:07.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.749+0000 7f8eca384640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ec415e870 0x7f8ec4152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:07.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.749+0000 7f8eca384640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ec415ec50 0x7f8ec4150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:07.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.749+0000 7f8eca384640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4154b20 con 0x7f8ec415ec50 2023-12-22T08:46:07.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.749+0000 7f8eca384640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4144ce0 con 0x7f8ec4070e80 2023-12-22T08:46:07.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.749+0000 7f8eca384640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4154210 con 0x7f8ec415e870 2023-12-22T08:46:07.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.749+0000 7f8ec8921640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ec415ec50 0x7f8ec4150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:07.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.749+0000 7f8ec8921640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ec415ec50 0x7f8ec4150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35656/0 (socket says 172.21.15.38:35656) 2023-12-22T08:46:07.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.749+0000 7f8ec8921640 1 -- 172.21.15.38:0/1542840467 learned_addr learned my addr 172.21.15.38:0/1542840467 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:07.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.749+0000 7f8ec3fff640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec4070e80 0x7f8ec415d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.750+0000 7f8ec8921640 1 -- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ec415e870 msgr2=0x7f8ec4152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.750+0000 7f8ec37fe640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ec415e870 0x7f8ec4152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:07.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.750+0000 7f8ec8921640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ec415e870 0x7f8ec4152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.750+0000 7f8ec8921640 1 -- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec4070e80 msgr2=0x7f8ec415d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.750+0000 7f8ec8921640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec4070e80 0x7f8ec415d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.750+0000 7f8ec8921640 1 -- 172.21.15.38:0/1542840467 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb40094d0 con 0x7f8ec415ec50 2023-12-22T08:46:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.750+0000 7f8ec3fff640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec4070e80 0x7f8ec415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:46:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.750+0000 7f8ec37fe640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ec415e870 0x7f8ec4152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.750+0000 7f8ec8921640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ec415ec50 0x7f8ec4150e40 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00efc0 tx=0x7f8ebc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.750+0000 7f8ec0ff9640 1 -- 172.21.15.38:0/1542840467 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc009ca0 con 0x7f8ec415ec50 2023-12-22T08:46:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.750+0000 7f8ec0ff9640 1 -- 172.21.15.38:0/1542840467 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc00f040 con 0x7f8ec415ec50 2023-12-22T08:46:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.750+0000 7f8ec0ff9640 1 -- 172.21.15.38:0/1542840467 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0146c0 con 0x7f8ec415ec50 2023-12-22T08:46:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.750+0000 7f8eca384640 1 -- 172.21.15.38:0/1542840467 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec4150740 con 0x7f8ec415ec50 2023-12-22T08:46:07.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.751+0000 7f8eca384640 1 -- 172.21.15.38:0/1542840467 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec4154740 con 0x7f8ec415ec50 2023-12-22T08:46:07.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.752+0000 7f8eca384640 1 -- 172.21.15.38:0/1542840467 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec4061910 con 0x7f8ec415ec50 2023-12-22T08:46:07.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.753+0000 7f8ec0ff9640 1 -- 172.21.15.38:0/1542840467 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8ebc014820 con 0x7f8ec415ec50 2023-12-22T08:46:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.754+0000 7f8ec0ff9640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8eb006a430 0x7f8eb006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.754+0000 7f8ec0ff9640 1 -- 172.21.15.38:0/1542840467 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8ebc089480 con 0x7f8ec415ec50 2023-12-22T08:46:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.755+0000 7f8ec3fff640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8eb006a430 0x7f8eb006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:07.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.756+0000 7f8ec3fff640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8eb006a430 0x7f8eb006c8f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4036000 tx=0x7f8eb403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:07.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.759+0000 7f8ec0ff9640 1 -- 172.21.15.38:0/1542840467 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8ebc054e50 con 0x7f8ec415ec50 2023-12-22T08:46:07.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.955+0000 7f8eca384640 1 -- 172.21.15.38:0/1542840467 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ec40b2ce0 con 0x7f8ec415ec50 2023-12-22T08:46:07.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.956+0000 7f8ec0ff9640 1 -- 172.21.15.38:0/1542840467 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ebc0180a0 con 0x7f8ec415ec50 2023-12-22T08:46:07.958 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:46:07.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.959+0000 7f8eca384640 1 -- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8eb006a430 msgr2=0x7f8eb006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.959+0000 7f8eca384640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8eb006a430 0x7f8eb006c8f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4036000 tx=0x7f8eb403c040 comp rx=0 tx=0).stop 2023-12-22T08:46:07.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.959+0000 7f8eca384640 1 -- 172.21.15.38:0/1542840467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ec415ec50 msgr2=0x7f8ec4150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:07.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.959+0000 7f8eca384640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ec415ec50 0x7f8ec4150e40 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00efc0 tx=0x7f8ebc00c490 comp rx=0 tx=0).stop 2023-12-22T08:46:07.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.959+0000 7f8eca384640 1 -- 172.21.15.38:0/1542840467 shutdown_connections 2023-12-22T08:46:07.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.959+0000 7f8eca384640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8eb006a430 0x7f8eb006c8f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.959+0000 7f8eca384640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ec415ec50 0x7f8ec4150e40 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.959+0000 7f8eca384640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ec415e870 0x7f8ec4152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.959+0000 7f8eca384640 1 --2- 172.21.15.38:0/1542840467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ec4070e80 0x7f8ec415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:07.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.959+0000 7f8eca384640 1 -- 172.21.15.38:0/1542840467 >> 172.21.15.38:0/1542840467 conn(0x7f8ec40b20c0 msgr2=0x7f8ec415aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:07.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.959+0000 7f8eca384640 1 -- 172.21.15.38:0/1542840467 shutdown_connections 2023-12-22T08:46:07.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:07.959+0000 7f8eca384640 1 -- 172.21.15.38:0/1542840467 wait complete. 2023-12-22T08:46:07.982 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T08:46:08.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.205+0000 7faece1d6640 1 Processor -- start 2023-12-22T08:46:08.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.205+0000 7faece1d6640 1 -- start start 2023-12-22T08:46:08.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.207+0000 7faece1d6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7faec815ad90 0x7faec80caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.207+0000 7faece1d6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faec8161bb0 0x7faec80cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.207+0000 7faece1d6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec815e630 con 0x7faec815d940 2023-12-22T08:46:08.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.207+0000 7faece1d6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec80ce2c0 con 0x7faec815ad90 2023-12-22T08:46:08.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.207+0000 7faece1d6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec815e910 con 0x7faec8161bb0 2023-12-22T08:46:08.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.207+0000 7faecd9d5640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7faec815d940 0x7faec815dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44808/0 (socket says 172.21.15.38:44808) 2023-12-22T08:46:08.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.207+0000 7faecd9d5640 1 -- 172.21.15.38:0/4042047490 learned_addr learned my addr 172.21.15.38:0/4042047490 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:08.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.208+0000 7faecd1d4640 1 --2- 172.21.15.38:0/4042047490 >> v2:172.21.15.38:3300/0 conn(0x7faec815ad90 0x7faec80caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:08.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.208+0000 7faecc9d3640 1 --2- 172.21.15.38:0/4042047490 >> v2:172.21.15.89:3300/0 conn(0x7faec8161bb0 0x7faec80cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:08.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.208+0000 7faebffff640 1 -- 172.21.15.38:0/4042047490 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648809182 0 0) 0x7faec815e630 con 0x7faec815d940 2023-12-22T08:46:08.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.208+0000 7faebffff640 1 -- 172.21.15.38:0/4042047490 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb4003520 con 0x7faec815d940 2023-12-22T08:46:08.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.208+0000 7faecd1d4640 1 -- 172.21.15.38:0/4042047490 >> v2:172.21.15.89:3300/0 conn(0x7faec8161bb0 msgr2=0x7faec80cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:08.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.208+0000 7faecd1d4640 1 --2- 172.21.15.38:0/4042047490 >> v2:172.21.15.89:3300/0 conn(0x7faec8161bb0 0x7faec80cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.208+0000 7faecd1d4640 1 -- 172.21.15.38:0/4042047490 >> v1:172.21.15.38:6789/0 conn(0x7faec815d940 legacy=0x7faec815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:08.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.208+0000 7faecd1d4640 1 -- 172.21.15.38:0/4042047490 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec81610d0 con 0x7faec815ad90 2023-12-22T08:46:08.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.209+0000 7faecd1d4640 1 --2- 172.21.15.38:0/4042047490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faec815ad90 0x7faec80caed0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7faec80d0d40 tx=0x7faec402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17237959575a39c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:08.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.210+0000 7faebffff640 1 -- 172.21.15.38:0/4042047490 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4031830 con 0x7faec815ad90 2023-12-22T08:46:08.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.210+0000 7faebffff640 1 -- 172.21.15.38:0/4042047490 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec4031990 con 0x7faec815ad90 2023-12-22T08:46:08.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.210+0000 7faebffff640 1 -- 172.21.15.38:0/4042047490 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4031d20 con 0x7faec815ad90 2023-12-22T08:46:08.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.210+0000 7faece1d6640 1 -- 172.21.15.38:0/4042047490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faec815ad90 msgr2=0x7faec80caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:08.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.210+0000 7faece1d6640 1 --2- 172.21.15.38:0/4042047490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faec815ad90 0x7faec80caed0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7faec80d0d40 tx=0x7faec402b8d0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.210+0000 7faece1d6640 1 -- 172.21.15.38:0/4042047490 shutdown_connections 2023-12-22T08:46:08.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.210+0000 7faece1d6640 1 --2- 172.21.15.38:0/4042047490 >> v2:172.21.15.89:3300/0 conn(0x7faec8161bb0 0x7faec80cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.210+0000 7faece1d6640 1 --2- 172.21.15.38:0/4042047490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faec815ad90 0x7faec80caed0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.210+0000 7faece1d6640 1 -- 172.21.15.38:0/4042047490 >> 172.21.15.38:0/4042047490 conn(0x7faec80d31c0 msgr2=0x7faec80d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:08.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.211+0000 7faece1d6640 1 -- 172.21.15.38:0/4042047490 shutdown_connections 2023-12-22T08:46:08.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.211+0000 7faece1d6640 1 -- 172.21.15.38:0/4042047490 wait complete. 2023-12-22T08:46:08.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.212+0000 7faece1d6640 1 Processor -- start 2023-12-22T08:46:08.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.213+0000 7faece1d6640 1 -- start start 2023-12-22T08:46:08.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.213+0000 7faece1d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec815ad90 0x7faec81f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.213+0000 7faece1d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faec815d940 0x7faec8154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.213+0000 7faece1d6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faec8161bb0 0x7faec81f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faece1d6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec80c6d80 con 0x7faec815d940 2023-12-22T08:46:08.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faece1d6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec8154d40 con 0x7faec815ad90 2023-12-22T08:46:08.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faece1d6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec81f6d60 con 0x7faec8161bb0 2023-12-22T08:46:08.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faecc9d3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faec815d940 0x7faec8154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:08.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faecc9d3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faec815d940 0x7faec8154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35676/0 (socket says 172.21.15.38:35676) 2023-12-22T08:46:08.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faecc9d3640 1 -- 172.21.15.38:0/736341745 learned_addr learned my addr 172.21.15.38:0/736341745 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:08.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faecd1d4640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec815ad90 0x7faec81f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:08.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faecd9d5640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faec8161bb0 0x7faec81f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:08.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faecc9d3640 1 -- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faec8161bb0 msgr2=0x7faec81f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:08.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faecc9d3640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faec8161bb0 0x7faec81f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faecc9d3640 1 -- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec815ad90 msgr2=0x7faec81f2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:08.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faecc9d3640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec815ad90 0x7faec81f2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faecc9d3640 1 -- 172.21.15.38:0/736341745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec4009400 con 0x7faec815d940 2023-12-22T08:46:08.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.214+0000 7faecd9d5640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faec8161bb0 0x7faec81f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:08.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.215+0000 7faecc9d3640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faec815d940 0x7faec8154800 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7faeb800e8a0 tx=0x7faeb800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:08.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.215+0000 7faebdffb640 1 -- 172.21.15.38:0/736341745 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb80094f0 con 0x7faec815d940 2023-12-22T08:46:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.215+0000 7faebdffb640 1 -- 172.21.15.38:0/736341745 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb800c940 con 0x7faec815d940 2023-12-22T08:46:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.215+0000 7faebdffb640 1 -- 172.21.15.38:0/736341745 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb800ccf0 con 0x7faec815d940 2023-12-22T08:46:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.215+0000 7faece1d6640 1 -- 172.21.15.38:0/736341745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec81f2e30 con 0x7faec815d940 2023-12-22T08:46:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.215+0000 7faece1d6640 1 -- 172.21.15.38:0/736341745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec81f33f0 con 0x7faec815d940 2023-12-22T08:46:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.216+0000 7faece1d6640 1 -- 172.21.15.38:0/736341745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec8061910 con 0x7faec815d940 2023-12-22T08:46:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.217+0000 7faebdffb640 1 -- 172.21.15.38:0/736341745 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faeb8013470 con 0x7faec815d940 2023-12-22T08:46:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.218+0000 7faebdffb640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faeac06a430 0x7faeac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.218+0000 7faebdffb640 1 -- 172.21.15.38:0/736341745 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faeb80886f0 con 0x7faec815d940 2023-12-22T08:46:08.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.219+0000 7faecd1d4640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faeac06a430 0x7faeac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:08.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.220+0000 7faecd1d4640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faeac06a430 0x7faeac06c8f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faec4036000 tx=0x7faec403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:08.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.223+0000 7faebdffb640 1 -- 172.21.15.38:0/736341745 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faeb8053f90 con 0x7faec815d940 2023-12-22T08:46:08.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.422+0000 7faece1d6640 1 -- 172.21.15.38:0/736341745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7faec80c6780 con 0x7faec815d940 2023-12-22T08:46:08.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.422+0000 7faebdffb640 1 -- 172.21.15.38:0/736341745 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v106) v1 ==== 84+0+65 (secure 0 0 0) 0x7faeb80575b0 con 0x7faec815d940 2023-12-22T08:46:08.424 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:08.424 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-12-22T08:46:08.424 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:08.425 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-12-22T08:46:08.425 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-12-22T08:46:08.425 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:08.425 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-12-22T08:46:08.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.425+0000 7faece1d6640 1 -- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faeac06a430 msgr2=0x7faeac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:08.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.425+0000 7faece1d6640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faeac06a430 0x7faeac06c8f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faec4036000 tx=0x7faec403c040 comp rx=0 tx=0).stop 2023-12-22T08:46:08.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.425+0000 7faece1d6640 1 -- 172.21.15.38:0/736341745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faec815d940 msgr2=0x7faec8154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:08.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.425+0000 7faece1d6640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faec815d940 0x7faec8154800 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7faeb800e8a0 tx=0x7faeb800ed60 comp rx=0 tx=0).stop 2023-12-22T08:46:08.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.426+0000 7faece1d6640 1 -- 172.21.15.38:0/736341745 shutdown_connections 2023-12-22T08:46:08.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.426+0000 7faece1d6640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faec8161bb0 0x7faec81f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.426+0000 7faece1d6640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faeac06a430 0x7faeac06c8f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.426+0000 7faece1d6640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faec815d940 0x7faec8154800 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.426+0000 7faece1d6640 1 --2- 172.21.15.38:0/736341745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faec815ad90 0x7faec81f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.426+0000 7faece1d6640 1 -- 172.21.15.38:0/736341745 >> 172.21.15.38:0/736341745 conn(0x7faec80d31c0 msgr2=0x7faec80cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:08.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.426+0000 7faece1d6640 1 -- 172.21.15.38:0/736341745 shutdown_connections 2023-12-22T08:46:08.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.426+0000 7faece1d6640 1 -- 172.21.15.38:0/736341745 wait complete. 2023-12-22T08:46:08.445 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T08:46:08.445 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T08:46:08.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.667+0000 7fb0288d6640 1 Processor -- start 2023-12-22T08:46:08.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.667+0000 7fb0288d6640 1 -- start start 2023-12-22T08:46:08.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.669+0000 7fb0288d6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb0240d24e0 0x7fb024168340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.669+0000 7fb0288d6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb024070a70 con 0x7fb024146eb0 2023-12-22T08:46:08.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.669+0000 7fb0288d6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02409ed10 con 0x7fb024146ad0 2023-12-22T08:46:08.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.669+0000 7fb0288d6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb024070850 con 0x7fb0240d24e0 2023-12-22T08:46:08.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.670+0000 7fb022ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb024146eb0 0x7fb0240d1dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44816/0 (socket says 172.21.15.38:44816) 2023-12-22T08:46:08.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.670+0000 7fb022ffd640 1 -- 172.21.15.38:0/1483377139 learned_addr learned my addr 172.21.15.38:0/1483377139 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:08.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.670+0000 7fb023fff640 1 --2- 172.21.15.38:0/1483377139 >> v2:172.21.15.89:3300/0 conn(0x7fb0240d24e0 0x7fb024168340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:08.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.670+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801988551 0 0) 0x7fb024070a70 con 0x7fb024146eb0 2023-12-22T08:46:08.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.670+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb00c003520 con 0x7fb024146eb0 2023-12-22T08:46:08.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.670+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3040336984 0 0) 0x7fb00c003520 con 0x7fb024146eb0 2023-12-22T08:46:08.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 >> v2:172.21.15.89:3300/0 conn(0x7fb0240d24e0 msgr2=0x7fb024168340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:08.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb0227fc640 1 --2- 172.21.15.38:0/1483377139 >> v2:172.21.15.89:3300/0 conn(0x7fb0240d24e0 0x7fb024168340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 >> v1:172.21.15.89:6789/0 conn(0x7fb024146ad0 legacy=0x7fb024070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02409eff0 con 0x7fb024146eb0 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fb018001670 con 0x7fb024146eb0 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 >> v1:172.21.15.38:6789/0 conn(0x7fb024146eb0 legacy=0x7fb0240d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb0227fc640 1 --2- 172.21.15.38:0/1483377139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb00c003970 0x7fb00c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb0227fc640 1 --2- 172.21.15.38:0/1483377139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb00c0047c0 0x7fb00c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb0227fc640 1 --2- 172.21.15.38:0/1483377139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb00c005180 0x7fb00c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb024070850 con 0x7fb00c0047c0 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c00c120 con 0x7fb00c003970 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c00c2e0 con 0x7fb00c005180 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb022ffd640 1 --2- 172.21.15.38:0/1483377139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb00c0047c0 0x7fb00c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.671+0000 7fb0237fe640 1 --2- 172.21.15.38:0/1483377139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb00c003970 0x7fb00c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.672+0000 7fb022ffd640 1 -- 172.21.15.38:0/1483377139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb00c005180 msgr2=0x7fb00c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.672+0000 7fb022ffd640 1 --2- 172.21.15.38:0/1483377139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb00c005180 0x7fb00c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.672+0000 7fb022ffd640 1 -- 172.21.15.38:0/1483377139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb00c003970 msgr2=0x7fb00c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:08.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.672+0000 7fb022ffd640 1 --2- 172.21.15.38:0/1483377139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb00c003970 0x7fb00c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.672+0000 7fb022ffd640 1 -- 172.21.15.38:0/1483377139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c003520 con 0x7fb00c0047c0 2023-12-22T08:46:08.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.672+0000 7fb023fff640 1 -- 172.21.15.38:0/1483377139 reap_dead start 2023-12-22T08:46:08.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.673+0000 7fb022ffd640 1 --2- 172.21.15.38:0/1483377139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb00c0047c0 0x7fb00c004c40 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fb01800c240 tx=0x7fb00c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad32d31312e83b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:08.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.673+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018005ad0 con 0x7fb00c0047c0 2023-12-22T08:46:08.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.673+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb018005c30 con 0x7fb00c0047c0 2023-12-22T08:46:08.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.673+0000 7fb0227fc640 1 -- 172.21.15.38:0/1483377139 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01802cab0 con 0x7fb00c0047c0 2023-12-22T08:46:08.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.674+0000 7fb0288d6640 1 -- 172.21.15.38:0/1483377139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb00c0047c0 msgr2=0x7fb00c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:08.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.674+0000 7fb0288d6640 1 --2- 172.21.15.38:0/1483377139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb00c0047c0 0x7fb00c004c40 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fb01800c240 tx=0x7fb00c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.674+0000 7fb0288d6640 1 -- 172.21.15.38:0/1483377139 shutdown_connections 2023-12-22T08:46:08.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.674+0000 7fb0288d6640 1 --2- 172.21.15.38:0/1483377139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb00c0047c0 0x7fb00c004c40 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.674+0000 7fb0288d6640 1 -- 172.21.15.38:0/1483377139 >> 172.21.15.38:0/1483377139 conn(0x7fb02406cf30 msgr2=0x7fb0240b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:08.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.674+0000 7fb0288d6640 1 -- 172.21.15.38:0/1483377139 shutdown_connections 2023-12-22T08:46:08.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.674+0000 7fb0288d6640 1 -- 172.21.15.38:0/1483377139 wait complete. 2023-12-22T08:46:08.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.676+0000 7fb0288d6640 1 Processor -- start 2023-12-22T08:46:08.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.676+0000 7fb0288d6640 1 -- start start 2023-12-22T08:46:08.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.677+0000 7fb0288d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb00c0047c0 0x7fb0241f78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.677+0000 7fb0288d6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0240b1e60 0x7fb02415c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.677+0000 7fb0288d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0240b01b0 0x7fb024143680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.677+0000 7fb0288d6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0241f6eb0 con 0x7fb0240b01b0 2023-12-22T08:46:08.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.677+0000 7fb0288d6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240b1030 con 0x7fb00c0047c0 2023-12-22T08:46:08.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.677+0000 7fb0288d6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240b0a70 con 0x7fb0240b1e60 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.677+0000 7fb023fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0240b01b0 0x7fb024143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.677+0000 7fb023fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0240b01b0 0x7fb024143680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35696/0 (socket says 172.21.15.38:35696) 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.677+0000 7fb023fff640 1 -- 172.21.15.38:0/1635532865 learned_addr learned my addr 172.21.15.38:0/1635532865 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.678+0000 7fb0237fe640 1 --2- 172.21.15.38:0/1635532865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb00c0047c0 0x7fb0241f78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.678+0000 7fb023fff640 1 -- 172.21.15.38:0/1635532865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0240b1e60 msgr2=0x7fb02415c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.678+0000 7fb023fff640 1 --2- 172.21.15.38:0/1635532865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0240b1e60 0x7fb02415c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.678+0000 7fb023fff640 1 -- 172.21.15.38:0/1635532865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb00c0047c0 msgr2=0x7fb0241f78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.678+0000 7fb023fff640 1 --2- 172.21.15.38:0/1635532865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb00c0047c0 0x7fb0241f78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.678+0000 7fb023fff640 1 -- 172.21.15.38:0/1635532865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240b0d50 con 0x7fb0240b01b0 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.678+0000 7fb023fff640 1 --2- 172.21.15.38:0/1635532865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0240b01b0 0x7fb024143680 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb0240b9760 tx=0x7fb01c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.678+0000 7fb00bfff640 1 -- 172.21.15.38:0/1635532865 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c010040 con 0x7fb0240b01b0 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.679+0000 7fb00bfff640 1 -- 172.21.15.38:0/1635532865 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c00bc80 con 0x7fb0240b01b0 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.679+0000 7fb0288d6640 1 -- 172.21.15.38:0/1635532865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0241f70a0 con 0x7fb0240b01b0 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.679+0000 7fb00bfff640 1 -- 172.21.15.38:0/1635532865 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c014400 con 0x7fb0240b01b0 2023-12-22T08:46:08.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.679+0000 7fb0288d6640 1 -- 172.21.15.38:0/1635532865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0241f7de0 con 0x7fb0240b01b0 2023-12-22T08:46:08.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.680+0000 7fb0288d6640 1 -- 172.21.15.38:0/1635532865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0241f75c0 con 0x7fb0240b01b0 2023-12-22T08:46:08.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.681+0000 7fb00bfff640 1 -- 172.21.15.38:0/1635532865 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb01c014560 con 0x7fb0240b01b0 2023-12-22T08:46:08.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.682+0000 7fb00bfff640 1 --2- 172.21.15.38:0/1635532865 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb01006a430 0x7fb01006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:08.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.682+0000 7fb00bfff640 1 -- 172.21.15.38:0/1635532865 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb01c088bf0 con 0x7fb0240b01b0 2023-12-22T08:46:08.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.682+0000 7fb0237fe640 1 --2- 172.21.15.38:0/1635532865 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb01006a430 0x7fb01006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:08.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.683+0000 7fb0237fe640 1 --2- 172.21.15.38:0/1635532865 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb01006a430 0x7fb01006c8f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb014007fd0 tx=0x7fb014009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:08.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.686+0000 7fb00bfff640 1 -- 172.21.15.38:0/1635532865 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb0241f75c0 con 0x7fb0240b01b0 2023-12-22T08:46:08.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:08.878+0000 7fb0288d6640 1 -- 172.21.15.38:0/1635532865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb0241f75c0 con 0x7fb0240b01b0 2023-12-22T08:46:09.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.511+0000 7fb00bfff640 1 -- 172.21.15.38:0/1635532865 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v107) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb0241f75c0 con 0x7fb0240b01b0 2023-12-22T08:46:09.516 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-12-22T08:46:09.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.516+0000 7fb0288d6640 1 -- 172.21.15.38:0/1635532865 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb01006a430 msgr2=0x7fb01006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:09.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.516+0000 7fb0288d6640 1 --2- 172.21.15.38:0/1635532865 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb01006a430 0x7fb01006c8f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb014007fd0 tx=0x7fb014009040 comp rx=0 tx=0).stop 2023-12-22T08:46:09.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.516+0000 7fb0288d6640 1 -- 172.21.15.38:0/1635532865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0240b01b0 msgr2=0x7fb024143680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:09.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.516+0000 7fb0288d6640 1 --2- 172.21.15.38:0/1635532865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0240b01b0 0x7fb024143680 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb0240b9760 tx=0x7fb01c00b480 comp rx=0 tx=0).stop 2023-12-22T08:46:09.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.517+0000 7fb0288d6640 1 -- 172.21.15.38:0/1635532865 shutdown_connections 2023-12-22T08:46:09.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.517+0000 7fb0288d6640 1 --2- 172.21.15.38:0/1635532865 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb01006a430 0x7fb01006c8f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:09.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.517+0000 7fb0288d6640 1 --2- 172.21.15.38:0/1635532865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0240b01b0 0x7fb024143680 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:09.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.517+0000 7fb0288d6640 1 --2- 172.21.15.38:0/1635532865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0240b1e60 0x7fb02415c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:09.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.517+0000 7fb0288d6640 1 --2- 172.21.15.38:0/1635532865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb00c0047c0 0x7fb0241f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:09.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.517+0000 7fb0288d6640 1 -- 172.21.15.38:0/1635532865 >> 172.21.15.38:0/1635532865 conn(0x7fb02406cf30 msgr2=0x7fb024070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:09.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.517+0000 7fb0288d6640 1 -- 172.21.15.38:0/1635532865 shutdown_connections 2023-12-22T08:46:09.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.518+0000 7fb0288d6640 1 -- 172.21.15.38:0/1635532865 wait complete. 2023-12-22T08:46:09.539 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T08:46:09.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.761+0000 7fc696670640 1 Processor -- start 2023-12-22T08:46:09.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.761+0000 7fc696670640 1 -- start start 2023-12-22T08:46:09.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.763+0000 7fc696670640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc69015e740 0x7fc69015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:09.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.763+0000 7fc696670640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc69006ca50 0x7fc6900b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.763+0000 7fc696670640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69015eb20 con 0x7fc6900b3dc0 2023-12-22T08:46:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.763+0000 7fc696670640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69006e650 con 0x7fc69006ca50 2023-12-22T08:46:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.763+0000 7fc696670640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc690070770 con 0x7fc69015e740 2023-12-22T08:46:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.763+0000 7fc68f7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc69006ca50 0x7fc6900b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.764+0000 7fc68f7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc69006ca50 0x7fc6900b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35706/0 (socket says 172.21.15.38:35706) 2023-12-22T08:46:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.764+0000 7fc68f7fe640 1 -- 172.21.15.38:0/3119142547 learned_addr learned my addr 172.21.15.38:0/3119142547 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.764+0000 7fc694c0d640 1 --1- 172.21.15.38:0/3119142547 >> v1:172.21.15.38:6789/0 conn(0x7fc6900b3dc0 0x7fc690161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44830/0 (socket says 172.21.15.38:44830) 2023-12-22T08:46:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.764+0000 7fc68ffff640 1 --2- 172.21.15.38:0/3119142547 >> v2:172.21.15.89:3300/0 conn(0x7fc69015e740 0x7fc69015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.764+0000 7fc68f7fe640 1 -- 172.21.15.38:0/3119142547 >> v2:172.21.15.89:3300/0 conn(0x7fc69015e740 msgr2=0x7fc69015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.764+0000 7fc68f7fe640 1 --2- 172.21.15.38:0/3119142547 >> v2:172.21.15.89:3300/0 conn(0x7fc69015e740 0x7fc69015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.764+0000 7fc68f7fe640 1 -- 172.21.15.38:0/3119142547 >> v1:172.21.15.38:6789/0 conn(0x7fc6900b3dc0 legacy=0x7fc690161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.764+0000 7fc68f7fe640 1 -- 172.21.15.38:0/3119142547 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900b41d0 con 0x7fc69006ca50 2023-12-22T08:46:09.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.765+0000 7fc68f7fe640 1 --2- 172.21.15.38:0/3119142547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc69006ca50 0x7fc6900b3880 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc69006ca20 tx=0x7fc68402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c14b049546c7f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:09.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.766+0000 7fc68effd640 1 -- 172.21.15.38:0/3119142547 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6840317e0 con 0x7fc69006ca50 2023-12-22T08:46:09.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.766+0000 7fc68effd640 1 -- 172.21.15.38:0/3119142547 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc684031940 con 0x7fc69006ca50 2023-12-22T08:46:09.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.766+0000 7fc68effd640 1 -- 172.21.15.38:0/3119142547 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684031cd0 con 0x7fc69006ca50 2023-12-22T08:46:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.766+0000 7fc696670640 1 -- 172.21.15.38:0/3119142547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc69006ca50 msgr2=0x7fc6900b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.766+0000 7fc696670640 1 --2- 172.21.15.38:0/3119142547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc69006ca50 0x7fc6900b3880 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc69006ca20 tx=0x7fc68402b880 comp rx=0 tx=0).stop 2023-12-22T08:46:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.766+0000 7fc696670640 1 -- 172.21.15.38:0/3119142547 shutdown_connections 2023-12-22T08:46:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.766+0000 7fc696670640 1 --2- 172.21.15.38:0/3119142547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc69006ca50 0x7fc6900b3880 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.766+0000 7fc696670640 1 --2- 172.21.15.38:0/3119142547 >> v2:172.21.15.89:3300/0 conn(0x7fc69015e740 0x7fc69015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.766+0000 7fc696670640 1 -- 172.21.15.38:0/3119142547 >> 172.21.15.38:0/3119142547 conn(0x7fc6900cfea0 msgr2=0x7fc6900d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.767+0000 7fc696670640 1 -- 172.21.15.38:0/3119142547 shutdown_connections 2023-12-22T08:46:09.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.767+0000 7fc696670640 1 -- 172.21.15.38:0/3119142547 wait complete. 2023-12-22T08:46:09.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.768+0000 7fc696670640 1 Processor -- start 2023-12-22T08:46:09.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.768+0000 7fc696670640 1 -- start start 2023-12-22T08:46:09.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.769+0000 7fc696670640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc69006ca50 0x7fc6901499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.769+0000 7fc696670640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6900b3dc0 0x7fc6901f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.769+0000 7fc696670640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc69015e740 0x7fc6900d2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.769+0000 7fc696670640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690149f00 con 0x7fc69006ca50 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.769+0000 7fc696670640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6901567a0 con 0x7fc6900b3dc0 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.769+0000 7fc696670640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc690156a80 con 0x7fc69015e740 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.770+0000 7fc68ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc69006ca50 0x7fc6901499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.770+0000 7fc68ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc69006ca50 0x7fc6901499c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35708/0 (socket says 172.21.15.38:35708) 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.770+0000 7fc68ffff640 1 -- 172.21.15.38:0/3478272954 learned_addr learned my addr 172.21.15.38:0/3478272954 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.770+0000 7fc68f7fe640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6900b3dc0 0x7fc6901f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.770+0000 7fc694c0d640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc69015e740 0x7fc6900d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.770+0000 7fc68ffff640 1 -- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc69015e740 msgr2=0x7fc6900d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.770+0000 7fc68ffff640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc69015e740 0x7fc6900d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.770+0000 7fc68ffff640 1 -- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6900b3dc0 msgr2=0x7fc6901f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.770+0000 7fc68ffff640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6900b3dc0 0x7fc6901f2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:09.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.770+0000 7fc68ffff640 1 -- 172.21.15.38:0/3478272954 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6840094d0 con 0x7fc69006ca50 2023-12-22T08:46:09.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.770+0000 7fc694c0d640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc69015e740 0x7fc6900d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.771+0000 7fc68ffff640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc69006ca50 0x7fc6901499c0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc68000d800 tx=0x7fc68000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.771+0000 7fc68cff9640 1 -- 172.21.15.38:0/3478272954 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68000b6c0 con 0x7fc69006ca50 2023-12-22T08:46:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.771+0000 7fc68cff9640 1 -- 172.21.15.38:0/3478272954 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68000b820 con 0x7fc69006ca50 2023-12-22T08:46:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.771+0000 7fc696670640 1 -- 172.21.15.38:0/3478272954 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc690156d60 con 0x7fc69006ca50 2023-12-22T08:46:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.771+0000 7fc68cff9640 1 -- 172.21.15.38:0/3478272954 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68000bbb0 con 0x7fc69006ca50 2023-12-22T08:46:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.771+0000 7fc696670640 1 -- 172.21.15.38:0/3478272954 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc690157320 con 0x7fc69006ca50 2023-12-22T08:46:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.772+0000 7fc696670640 1 -- 172.21.15.38:0/3478272954 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6901574b0 con 0x7fc69006ca50 2023-12-22T08:46:09.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.773+0000 7fc68cff9640 1 -- 172.21.15.38:0/3478272954 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc68000bd10 con 0x7fc69006ca50 2023-12-22T08:46:09.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.775+0000 7fc68cff9640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc67c06a460 0x7fc67c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:09.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.775+0000 7fc68cff9640 1 -- 172.21.15.38:0/3478272954 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc680088ce0 con 0x7fc69006ca50 2023-12-22T08:46:09.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.776+0000 7fc68f7fe640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc67c06a460 0x7fc67c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:09.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.777+0000 7fc68f7fe640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc67c06a460 0x7fc67c06c920 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc684036000 tx=0x7fc68403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:09.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.781+0000 7fc68cff9640 1 -- 172.21.15.38:0/3478272954 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc680054410 con 0x7fc69006ca50 2023-12-22T08:46:09.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:09.978+0000 7fc696670640 1 -- 172.21.15.38:0/3478272954 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc690061910 con 0x7fc69006ca50 2023-12-22T08:46:10.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.521+0000 7fc68cff9640 1 -- 172.21.15.38:0/3478272954 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v108) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc680057a30 con 0x7fc69006ca50 2023-12-22T08:46:10.523 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-12-22T08:46:10.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.531+0000 7fc696670640 1 -- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc67c06a460 msgr2=0x7fc67c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:10.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.531+0000 7fc696670640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc67c06a460 0x7fc67c06c920 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc684036000 tx=0x7fc68403d040 comp rx=0 tx=0).stop 2023-12-22T08:46:10.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.531+0000 7fc696670640 1 -- 172.21.15.38:0/3478272954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc69006ca50 msgr2=0x7fc6901499c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:10.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.531+0000 7fc696670640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc69006ca50 0x7fc6901499c0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc68000d800 tx=0x7fc68000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:46:10.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.532+0000 7fc696670640 1 -- 172.21.15.38:0/3478272954 shutdown_connections 2023-12-22T08:46:10.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.532+0000 7fc696670640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc69015e740 0x7fc6900d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:10.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.532+0000 7fc696670640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6900b3dc0 0x7fc6901f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:10.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.532+0000 7fc696670640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc67c06a460 0x7fc67c06c920 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:10.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.532+0000 7fc696670640 1 --2- 172.21.15.38:0/3478272954 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc69006ca50 0x7fc6901499c0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:10.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.532+0000 7fc696670640 1 -- 172.21.15.38:0/3478272954 >> 172.21.15.38:0/3478272954 conn(0x7fc6900cfea0 msgr2=0x7fc69015f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:10.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.534+0000 7fc696670640 1 -- 172.21.15.38:0/3478272954 shutdown_connections 2023-12-22T08:46:10.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.534+0000 7fc696670640 1 -- 172.21.15.38:0/3478272954 wait complete. 2023-12-22T08:46:10.560 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T08:46:10.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.757+0000 7f2706b3d640 1 Processor -- start 2023-12-22T08:46:10.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.758+0000 7f2706b3d640 1 -- start start 2023-12-22T08:46:10.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.759+0000 7f2706b3d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2700070b70 0x7f270006bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:10.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.759+0000 7f2706b3d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2700071660 0x7f2700164d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:10.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.759+0000 7f2706b3d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270006d5f0 con 0x7f270006c4d0 2023-12-22T08:46:10.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.759+0000 7f2706b3d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2700144fa0 con 0x7f2700071660 2023-12-22T08:46:10.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.759+0000 7f2706b3d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270006da80 con 0x7f2700070b70 2023-12-22T08:46:10.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.760+0000 7f270633c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2700071660 0x7f2700164d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:10.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.760+0000 7f270633c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2700071660 0x7f2700164d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35724/0 (socket says 172.21.15.38:35724) 2023-12-22T08:46:10.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.760+0000 7f270633c640 1 -- 172.21.15.38:0/2422375705 learned_addr learned my addr 172.21.15.38:0/2422375705 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:10.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.760+0000 7f2705b3b640 1 --2- 172.21.15.38:0/2422375705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2700070b70 0x7f270006bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:10.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.760+0000 7f270633c640 1 -- 172.21.15.38:0/2422375705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2700070b70 msgr2=0x7f270006bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:10.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.760+0000 7f270633c640 1 --2- 172.21.15.38:0/2422375705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2700070b70 0x7f270006bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:10.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.760+0000 7f270633c640 1 -- 172.21.15.38:0/2422375705 >> v1:172.21.15.89:6789/0 conn(0x7f270006c4d0 legacy=0x7f2700070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:10.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.760+0000 7f270633c640 1 -- 172.21.15.38:0/2422375705 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270006c9e0 con 0x7f2700071660 2023-12-22T08:46:10.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.762+0000 7f270633c640 1 --2- 172.21.15.38:0/2422375705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2700071660 0x7f2700164d50 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009e50 tx=0x7f26f802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d84d878632e990a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:10.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.762+0000 7f2704b39640 1 -- 172.21.15.38:0/2422375705 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f802c9f0 con 0x7f2700071660 2023-12-22T08:46:10.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.762+0000 7f2704b39640 1 -- 172.21.15.38:0/2422375705 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f802cb50 con 0x7f2700071660 2023-12-22T08:46:10.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.762+0000 7f2704b39640 1 -- 172.21.15.38:0/2422375705 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f80343f0 con 0x7f2700071660 2023-12-22T08:46:10.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.763+0000 7f2706b3d640 1 -- 172.21.15.38:0/2422375705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2700071660 msgr2=0x7f2700164d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:10.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.763+0000 7f2706b3d640 1 --2- 172.21.15.38:0/2422375705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2700071660 0x7f2700164d50 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009e50 tx=0x7f26f802be50 comp rx=0 tx=0).stop 2023-12-22T08:46:10.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.763+0000 7f2706b3d640 1 -- 172.21.15.38:0/2422375705 shutdown_connections 2023-12-22T08:46:10.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.763+0000 7f2706b3d640 1 --2- 172.21.15.38:0/2422375705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2700071660 0x7f2700164d50 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:10.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.763+0000 7f2706b3d640 1 --2- 172.21.15.38:0/2422375705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2700070b70 0x7f270006bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:10.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.763+0000 7f2706b3d640 1 -- 172.21.15.38:0/2422375705 >> 172.21.15.38:0/2422375705 conn(0x7f27000b0b60 msgr2=0x7f27000b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:10.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.763+0000 7f2706b3d640 1 -- 172.21.15.38:0/2422375705 shutdown_connections 2023-12-22T08:46:10.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.763+0000 7f2706b3d640 1 -- 172.21.15.38:0/2422375705 wait complete. 2023-12-22T08:46:10.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.765+0000 7f2706b3d640 1 Processor -- start 2023-12-22T08:46:10.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.765+0000 7f2706b3d640 1 -- start start 2023-12-22T08:46:10.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.766+0000 7f2706b3d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f270006c4d0 0x7f2700152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:10.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.766+0000 7f2706b3d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2700070b70 0x7f270015d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:10.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.766+0000 7f2706b3d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2700071660 0x7f270015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:10.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.766+0000 7f2706b3d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2700152fe0 con 0x7f2700070b70 2023-12-22T08:46:10.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.766+0000 7f2706b3d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270009b500 con 0x7f2700071660 2023-12-22T08:46:10.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.766+0000 7f2706b3d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270009a8f0 con 0x7f270006c4d0 2023-12-22T08:46:10.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.766+0000 7f270533a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2700070b70 0x7f270015d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:10.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.766+0000 7f270533a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2700070b70 0x7f270015d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35726/0 (socket says 172.21.15.38:35726) 2023-12-22T08:46:10.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.766+0000 7f270533a640 1 -- 172.21.15.38:0/1021066749 learned_addr learned my addr 172.21.15.38:0/1021066749 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:10.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.767+0000 7f270533a640 1 -- 172.21.15.38:0/1021066749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f270006c4d0 msgr2=0x7f2700152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:10.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.767+0000 7f270533a640 1 --2- 172.21.15.38:0/1021066749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f270006c4d0 0x7f2700152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:10.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.767+0000 7f270533a640 1 -- 172.21.15.38:0/1021066749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2700071660 msgr2=0x7f270015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:10.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.767+0000 7f270533a640 1 --2- 172.21.15.38:0/1021066749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2700071660 0x7f270015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:10.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.767+0000 7f270533a640 1 -- 172.21.15.38:0/1021066749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f8009b30 con 0x7f2700070b70 2023-12-22T08:46:10.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.767+0000 7f270533a640 1 --2- 172.21.15.38:0/1021066749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2700070b70 0x7f270015d470 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f26f000b3c0 tx=0x7f26f000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:10.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.767+0000 7f26f67fc640 1 -- 172.21.15.38:0/1021066749 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0011830 con 0x7f2700070b70 2023-12-22T08:46:10.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.767+0000 7f26f67fc640 1 -- 172.21.15.38:0/1021066749 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f0011990 con 0x7f2700070b70 2023-12-22T08:46:10.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.767+0000 7f26f67fc640 1 -- 172.21.15.38:0/1021066749 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0011d80 con 0x7f2700070b70 2023-12-22T08:46:10.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.767+0000 7f2706b3d640 1 -- 172.21.15.38:0/1021066749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270009abd0 con 0x7f2700070b70 2023-12-22T08:46:10.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.767+0000 7f2706b3d640 1 -- 172.21.15.38:0/1021066749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270009b190 con 0x7f2700070b70 2023-12-22T08:46:10.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.769+0000 7f2706b3d640 1 -- 172.21.15.38:0/1021066749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2700061910 con 0x7f2700070b70 2023-12-22T08:46:10.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.770+0000 7f26f67fc640 1 -- 172.21.15.38:0/1021066749 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f26f001b460 con 0x7f2700070b70 2023-12-22T08:46:10.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.770+0000 7f26f67fc640 1 --2- 172.21.15.38:0/1021066749 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f26e406a460 0x7f26e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:10.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.771+0000 7f26f67fc640 1 -- 172.21.15.38:0/1021066749 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f26f0088440 con 0x7f2700070b70 2023-12-22T08:46:10.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.771+0000 7f2705b3b640 1 --2- 172.21.15.38:0/1021066749 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f26e406a460 0x7f26e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:10.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.772+0000 7f2705b3b640 1 --2- 172.21.15.38:0/1021066749 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f26e406a460 0x7f26e406c920 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0098f0 tx=0x7f26fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:10.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:10.775+0000 7f26f67fc640 1 -- 172.21.15.38:0/1021066749 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f26f00539f0 con 0x7f2700070b70 2023-12-22T08:46:11.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.011+0000 7f2706b3d640 1 -- 172.21.15.38:0/1021066749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f270009b320 con 0x7f2700070b70 2023-12-22T08:46:11.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.025+0000 7f26f67fc640 1 -- 172.21.15.38:0/1021066749 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f26f0057010 con 0x7f2700070b70 2023-12-22T08:46:11.027 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 12 and data pool 13 2023-12-22T08:46:11.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.031+0000 7f2706b3d640 1 -- 172.21.15.38:0/1021066749 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f26e406a460 msgr2=0x7f26e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:11.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.031+0000 7f2706b3d640 1 --2- 172.21.15.38:0/1021066749 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f26e406a460 0x7f26e406c920 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0098f0 tx=0x7f26fc008040 comp rx=0 tx=0).stop 2023-12-22T08:46:11.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.031+0000 7f2706b3d640 1 -- 172.21.15.38:0/1021066749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2700070b70 msgr2=0x7f270015d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:11.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.031+0000 7f2706b3d640 1 --2- 172.21.15.38:0/1021066749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2700070b70 0x7f270015d470 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f26f000b3c0 tx=0x7f26f000b880 comp rx=0 tx=0).stop 2023-12-22T08:46:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.032+0000 7f2706b3d640 1 -- 172.21.15.38:0/1021066749 shutdown_connections 2023-12-22T08:46:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.032+0000 7f2706b3d640 1 --2- 172.21.15.38:0/1021066749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2700071660 0x7f270015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.032+0000 7f2706b3d640 1 --2- 172.21.15.38:0/1021066749 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f26e406a460 0x7f26e406c920 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.032+0000 7f2706b3d640 1 --2- 172.21.15.38:0/1021066749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2700070b70 0x7f270015d470 secure :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f26f000b3c0 tx=0x7f26f000b880 comp rx=0 tx=0).stop 2023-12-22T08:46:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.032+0000 7f2706b3d640 1 --2- 172.21.15.38:0/1021066749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f270006c4d0 0x7f2700152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.032+0000 7f2706b3d640 1 -- 172.21.15.38:0/1021066749 >> 172.21.15.38:0/1021066749 conn(0x7f27000b0b60 msgr2=0x7f27000b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:11.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.035+0000 7f2706b3d640 1 -- 172.21.15.38:0/1021066749 shutdown_connections 2023-12-22T08:46:11.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.035+0000 7f2706b3d640 1 -- 172.21.15.38:0/1021066749 wait complete. 2023-12-22T08:46:11.063 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:46:11.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.250+0000 7efe3b2db640 1 Processor -- start 2023-12-22T08:46:11.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.250+0000 7efe3b2db640 1 -- start start 2023-12-22T08:46:11.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.252+0000 7efe3b2db640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efe340b2050 0x7efe340b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:11.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.252+0000 7efe3b2db640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe341450f0 con 0x7efe34144d10 2023-12-22T08:46:11.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.252+0000 7efe3b2db640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe340b29f0 con 0x7efe34070800 2023-12-22T08:46:11.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.252+0000 7efe3b2db640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe340cc840 con 0x7efe340b2050 2023-12-22T08:46:11.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.252+0000 7efe38876640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efe340b2050 0x7efe340b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:11.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.252+0000 7efe38876640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efe340b2050 0x7efe340b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47874/0 (socket says 172.21.15.38:47874) 2023-12-22T08:46:11.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.252+0000 7efe38876640 1 -- 172.21.15.38:0/1954736312 learned_addr learned my addr 172.21.15.38:0/1954736312 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:11.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.253+0000 7efe38876640 1 -- 172.21.15.38:0/1954736312 >> v1:172.21.15.89:6789/0 conn(0x7efe34070800 legacy=0x7efe34070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:11.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.253+0000 7efe38876640 1 -- 172.21.15.38:0/1954736312 >> v1:172.21.15.38:6789/0 conn(0x7efe34144d10 legacy=0x7efe340cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:11.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.253+0000 7efe2bfff640 1 -- 172.21.15.38:0/1954736312 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240908457 0 0) 0x7efe341450f0 con 0x7efe34144d10 2023-12-22T08:46:11.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.253+0000 7efe38876640 1 -- 172.21.15.38:0/1954736312 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe340ce010 con 0x7efe340b2050 2023-12-22T08:46:11.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.254+0000 7efe38876640 1 --2- 172.21.15.38:0/1954736312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe340b2050 0x7efe340b24b0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7efe24009870 tx=0x7efe2402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3267da6fba9c27 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:11.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.254+0000 7efe2bfff640 1 -- 172.21.15.38:0/1954736312 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24030860 con 0x7efe340b2050 2023-12-22T08:46:11.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.255+0000 7efe2bfff640 1 -- 172.21.15.38:0/1954736312 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe240309c0 con 0x7efe340b2050 2023-12-22T08:46:11.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.255+0000 7efe2bfff640 1 -- 172.21.15.38:0/1954736312 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24030d50 con 0x7efe340b2050 2023-12-22T08:46:11.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.255+0000 7efe3b2db640 1 -- 172.21.15.38:0/1954736312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe340b2050 msgr2=0x7efe340b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:11.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.255+0000 7efe3b2db640 1 --2- 172.21.15.38:0/1954736312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe340b2050 0x7efe340b24b0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7efe24009870 tx=0x7efe2402b9a0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.255+0000 7efe3b2db640 1 -- 172.21.15.38:0/1954736312 shutdown_connections 2023-12-22T08:46:11.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.255+0000 7efe3b2db640 1 --2- 172.21.15.38:0/1954736312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe340b2050 0x7efe340b24b0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.255+0000 7efe3b2db640 1 -- 172.21.15.38:0/1954736312 >> 172.21.15.38:0/1954736312 conn(0x7efe340cf070 msgr2=0x7efe340cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:11.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.255+0000 7efe3b2db640 1 -- 172.21.15.38:0/1954736312 shutdown_connections 2023-12-22T08:46:11.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.255+0000 7efe3b2db640 1 -- 172.21.15.38:0/1954736312 wait complete. 2023-12-22T08:46:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.257+0000 7efe3b2db640 1 Processor -- start 2023-12-22T08:46:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.257+0000 7efe3b2db640 1 -- start start 2023-12-22T08:46:11.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.258+0000 7efe3b2db640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe34070800 0x7efe34138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:11.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.258+0000 7efe3b2db640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe340b2050 0x7efe34143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:11.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.258+0000 7efe3b2db640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe34144d10 0x7efe3415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:11.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.258+0000 7efe3b2db640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe34142db0 con 0x7efe34144d10 2023-12-22T08:46:11.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.258+0000 7efe3b2db640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe34138e40 con 0x7efe34070800 2023-12-22T08:46:11.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.258+0000 7efe3b2db640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe34156220 con 0x7efe340b2050 2023-12-22T08:46:11.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.259+0000 7efe39878640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe34144d10 0x7efe3415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:11.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.259+0000 7efe39878640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe34144d10 0x7efe3415cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47882/0 (socket says 172.21.15.38:47882) 2023-12-22T08:46:11.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.259+0000 7efe39878640 1 -- 172.21.15.38:0/551079718 learned_addr learned my addr 172.21.15.38:0/551079718 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.259+0000 7efe38876640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe340b2050 0x7efe34143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.259+0000 7efe39077640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe34070800 0x7efe34138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.259+0000 7efe39878640 1 -- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe340b2050 msgr2=0x7efe34143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.259+0000 7efe39878640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe340b2050 0x7efe34143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.259+0000 7efe39878640 1 -- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe34070800 msgr2=0x7efe34138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.259+0000 7efe39878640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe34070800 0x7efe34138900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.259+0000 7efe39878640 1 -- 172.21.15.38:0/551079718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe240094d0 con 0x7efe34144d10 2023-12-22T08:46:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.259+0000 7efe38876640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe340b2050 0x7efe34143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.259+0000 7efe39878640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe34144d10 0x7efe3415cb80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00b970 tx=0x7efe2c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.260+0000 7efe29ffb640 1 -- 172.21.15.38:0/551079718 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00cb40 con 0x7efe34144d10 2023-12-22T08:46:11.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.260+0000 7efe29ffb640 1 -- 172.21.15.38:0/551079718 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c00cca0 con 0x7efe34144d10 2023-12-22T08:46:11.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.260+0000 7efe29ffb640 1 -- 172.21.15.38:0/551079718 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c014680 con 0x7efe34144d10 2023-12-22T08:46:11.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.260+0000 7efe3b2db640 1 -- 172.21.15.38:0/551079718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe34156500 con 0x7efe34144d10 2023-12-22T08:46:11.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.260+0000 7efe3b2db640 1 -- 172.21.15.38:0/551079718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe34143ab0 con 0x7efe34144d10 2023-12-22T08:46:11.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.261+0000 7efe3b2db640 1 -- 172.21.15.38:0/551079718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe34143290 con 0x7efe34144d10 2023-12-22T08:46:11.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.262+0000 7efe29ffb640 1 -- 172.21.15.38:0/551079718 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efe2c01d3b0 con 0x7efe34144d10 2023-12-22T08:46:11.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.263+0000 7efe29ffb640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efe1806a430 0x7efe1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:11.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.263+0000 7efe29ffb640 1 -- 172.21.15.38:0/551079718 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe2c088770 con 0x7efe34144d10 2023-12-22T08:46:11.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.264+0000 7efe39077640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efe1806a430 0x7efe1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.265+0000 7efe39077640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efe1806a430 0x7efe1806c8f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efe30000f60 tx=0x7efe30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.268+0000 7efe29ffb640 1 -- 172.21.15.38:0/551079718 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efe34143290 con 0x7efe34144d10 2023-12-22T08:46:11.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.464+0000 7efe3b2db640 1 -- 172.21.15.38:0/551079718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe34143290 con 0x7efe34144d10 2023-12-22T08:46:11.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.467+0000 7efe29ffb640 1 -- 172.21.15.38:0/551079718 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16080 (secure 0 0 0) 0x7efe34143290 con 0x7efe34144d10 2023-12-22T08:46:11.469 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:11.469 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":109,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:46:11.013109+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:46:08.930859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-22T08:46:10.036922+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:46:11.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.470+0000 7efe3b2db640 1 -- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efe1806a430 msgr2=0x7efe1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:11.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.470+0000 7efe3b2db640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efe1806a430 0x7efe1806c8f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efe30000f60 tx=0x7efe30009040 comp rx=0 tx=0).stop 2023-12-22T08:46:11.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.470+0000 7efe3b2db640 1 -- 172.21.15.38:0/551079718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe34144d10 msgr2=0x7efe3415cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:11.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.470+0000 7efe3b2db640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe34144d10 0x7efe3415cb80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00b970 tx=0x7efe2c00be30 comp rx=0 tx=0).stop 2023-12-22T08:46:11.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.470+0000 7efe3b2db640 1 -- 172.21.15.38:0/551079718 shutdown_connections 2023-12-22T08:46:11.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.470+0000 7efe3b2db640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efe1806a430 0x7efe1806c8f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.470+0000 7efe3b2db640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe34144d10 0x7efe3415cb80 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.470+0000 7efe3b2db640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe340b2050 0x7efe34143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.470+0000 7efe3b2db640 1 --2- 172.21.15.38:0/551079718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe34070800 0x7efe34138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.470+0000 7efe3b2db640 1 -- 172.21.15.38:0/551079718 >> 172.21.15.38:0/551079718 conn(0x7efe340cf070 msgr2=0x7efe340712c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.470+0000 7efe3b2db640 1 -- 172.21.15.38:0/551079718 shutdown_connections 2023-12-22T08:46:11.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.470+0000 7efe3b2db640 1 -- 172.21.15.38:0/551079718 wait complete. 2023-12-22T08:46:11.492 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:46:11.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.713+0000 7f471454e640 1 Processor -- start 2023-12-22T08:46:11.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.714+0000 7f471454e640 1 -- start start 2023-12-22T08:46:11.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.715+0000 7f471454e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470c15e740 0x7f470c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.715+0000 7f471454e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f470c06ca50 0x7f470c0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.715+0000 7f471454e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f470c0b3dc0 0x7f470c161120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.715+0000 7f471454e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470c06e650 con 0x7f470c0b3dc0 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.715+0000 7f471454e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470c0b4210 con 0x7f470c06ca50 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.715+0000 7f471454e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c15eb20 con 0x7f470c15e740 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.716+0000 7f4712aeb640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f470c0b3dc0 0x7f470c161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.716+0000 7f4712aeb640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f470c0b3dc0 0x7f470c161120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47888/0 (socket says 172.21.15.38:47888) 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.716+0000 7f4712aeb640 1 -- 172.21.15.38:0/2277116372 learned_addr learned my addr 172.21.15.38:0/2277116372 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.716+0000 7f47122ea640 1 --2- 172.21.15.38:0/2277116372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470c15e740 0x7f470c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.716+0000 7f4711ae9640 1 --2- 172.21.15.38:0/2277116372 >> v2:172.21.15.89:3300/0 conn(0x7f470c06ca50 0x7f470c0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.716+0000 7f4712aeb640 1 -- 172.21.15.38:0/2277116372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470c15e740 msgr2=0x7f470c15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.716+0000 7f4712aeb640 1 --2- 172.21.15.38:0/2277116372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470c15e740 0x7f470c15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.716+0000 7f4712aeb640 1 -- 172.21.15.38:0/2277116372 >> v2:172.21.15.89:3300/0 conn(0x7f470c06ca50 msgr2=0x7f470c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.716+0000 7f4712aeb640 1 --2- 172.21.15.38:0/2277116372 >> v2:172.21.15.89:3300/0 conn(0x7f470c06ca50 0x7f470c0b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.716+0000 7f4712aeb640 1 -- 172.21.15.38:0/2277116372 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c070770 con 0x7f470c0b3dc0 2023-12-22T08:46:11.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.718+0000 7f4712aeb640 1 --2- 172.21.15.38:0/2277116372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f470c0b3dc0 0x7f470c161120 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f470c0d3300 tx=0x7f46fc02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1211e598e1a9fd6a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.718+0000 7f47112e8640 1 -- 172.21.15.38:0/2277116372 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc031740 con 0x7f470c0b3dc0 2023-12-22T08:46:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.718+0000 7f47112e8640 1 -- 172.21.15.38:0/2277116372 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc0318a0 con 0x7f470c0b3dc0 2023-12-22T08:46:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.718+0000 7f47112e8640 1 -- 172.21.15.38:0/2277116372 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc031c30 con 0x7f470c0b3dc0 2023-12-22T08:46:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.718+0000 7f471454e640 1 -- 172.21.15.38:0/2277116372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f470c0b3dc0 msgr2=0x7f470c161120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:11.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.718+0000 7f471454e640 1 --2- 172.21.15.38:0/2277116372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f470c0b3dc0 0x7f470c161120 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f470c0d3300 tx=0x7f46fc02b7e0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.719+0000 7f471454e640 1 -- 172.21.15.38:0/2277116372 shutdown_connections 2023-12-22T08:46:11.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.719+0000 7f471454e640 1 --2- 172.21.15.38:0/2277116372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f470c0b3dc0 0x7f470c161120 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.719+0000 7f471454e640 1 --2- 172.21.15.38:0/2277116372 >> v2:172.21.15.89:3300/0 conn(0x7f470c06ca50 0x7f470c0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.719+0000 7f471454e640 1 --2- 172.21.15.38:0/2277116372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470c15e740 0x7f470c15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.719+0000 7f471454e640 1 -- 172.21.15.38:0/2277116372 >> 172.21.15.38:0/2277116372 conn(0x7f470c0cfea0 msgr2=0x7f470c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:11.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.719+0000 7f471454e640 1 -- 172.21.15.38:0/2277116372 shutdown_connections 2023-12-22T08:46:11.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.719+0000 7f471454e640 1 -- 172.21.15.38:0/2277116372 wait complete. 2023-12-22T08:46:11.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.720+0000 7f471454e640 1 Processor -- start 2023-12-22T08:46:11.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.721+0000 7f471454e640 1 -- start start 2023-12-22T08:46:11.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f471454e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470c06ca50 0x7f470c13ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:11.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f471454e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f470c0b3dc0 0x7f470c13f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:11.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f471454e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f470c15e740 0x7f470c151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:11.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f471454e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c13fc10 con 0x7f470c0b3dc0 2023-12-22T08:46:11.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f471454e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c1532e0 con 0x7f470c15e740 2023-12-22T08:46:11.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f471454e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c152240 con 0x7f470c06ca50 2023-12-22T08:46:11.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f4711ae9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f470c0b3dc0 0x7f470c13f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:11.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f4711ae9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f470c0b3dc0 0x7f470c13f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47892/0 (socket says 172.21.15.38:47892) 2023-12-22T08:46:11.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f4711ae9640 1 -- 172.21.15.38:0/3021537858 learned_addr learned my addr 172.21.15.38:0/3021537858 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:11.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f47122ea640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470c06ca50 0x7f470c13ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:11.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f4712aeb640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f470c15e740 0x7f470c151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:11.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f4711ae9640 1 -- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470c06ca50 msgr2=0x7f470c13ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:11.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f4711ae9640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470c06ca50 0x7f470c13ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f4711ae9640 1 -- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f470c15e740 msgr2=0x7f470c151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:11.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f4711ae9640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f470c15e740 0x7f470c151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.722+0000 7f4711ae9640 1 -- 172.21.15.38:0/3021537858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc0094d0 con 0x7f470c0b3dc0 2023-12-22T08:46:11.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.723+0000 7f4711ae9640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f470c0b3dc0 0x7f470c13f230 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f470000d800 tx=0x7f470000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:11.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.723+0000 7f470affd640 1 -- 172.21.15.38:0/3021537858 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47000096a0 con 0x7f470c0b3dc0 2023-12-22T08:46:11.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.723+0000 7f470affd640 1 -- 172.21.15.38:0/3021537858 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4700009800 con 0x7f470c0b3dc0 2023-12-22T08:46:11.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.723+0000 7f470affd640 1 -- 172.21.15.38:0/3021537858 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700009b90 con 0x7f470c0b3dc0 2023-12-22T08:46:11.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.723+0000 7f471454e640 1 -- 172.21.15.38:0/3021537858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470c152520 con 0x7f470c0b3dc0 2023-12-22T08:46:11.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.723+0000 7f471454e640 1 -- 172.21.15.38:0/3021537858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470c152ae0 con 0x7f470c0b3dc0 2023-12-22T08:46:11.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.724+0000 7f471454e640 1 -- 172.21.15.38:0/3021537858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470c0b8c20 con 0x7f470c0b3dc0 2023-12-22T08:46:11.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.725+0000 7f470affd640 1 -- 172.21.15.38:0/3021537858 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4700009cf0 con 0x7f470c0b3dc0 2023-12-22T08:46:11.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.726+0000 7f470affd640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f46f806a430 0x7f46f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:11.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.727+0000 7f470affd640 1 -- 172.21.15.38:0/3021537858 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4700089100 con 0x7f470c0b3dc0 2023-12-22T08:46:11.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.727+0000 7f47122ea640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f46f806a430 0x7f46f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:11.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.728+0000 7f47122ea640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f46f806a430 0x7f46f806c8f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f47040099c0 tx=0x7f4704003990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:11.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.731+0000 7f470affd640 1 -- 172.21.15.38:0/3021537858 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4700054650 con 0x7f470c0b3dc0 2023-12-22T08:46:11.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.925+0000 7f471454e640 1 -- 172.21.15.38:0/3021537858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f470c061910 con 0x7f470c0b3dc0 2023-12-22T08:46:11.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.928+0000 7f470affd640 1 -- 172.21.15.38:0/3021537858 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16080 (secure 0 0 0) 0x7f470000b440 con 0x7f470c0b3dc0 2023-12-22T08:46:11.930 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:11.930 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":109,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:46:11.013109+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:46:08.930859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-22T08:46:10.036922+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:46:11.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.931+0000 7f471454e640 1 -- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f46f806a430 msgr2=0x7f46f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:11.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.931+0000 7f471454e640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f46f806a430 0x7f46f806c8f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f47040099c0 tx=0x7f4704003990 comp rx=0 tx=0).stop 2023-12-22T08:46:11.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.931+0000 7f471454e640 1 -- 172.21.15.38:0/3021537858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f470c0b3dc0 msgr2=0x7f470c13f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:11.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.931+0000 7f471454e640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f470c0b3dc0 0x7f470c13f230 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f470000d800 tx=0x7f470000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.931+0000 7f471454e640 1 -- 172.21.15.38:0/3021537858 shutdown_connections 2023-12-22T08:46:11.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.931+0000 7f471454e640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f470c15e740 0x7f470c151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.931+0000 7f471454e640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f46f806a430 0x7f46f806c8f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.931+0000 7f471454e640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f470c0b3dc0 0x7f470c13f230 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.931+0000 7f471454e640 1 --2- 172.21.15.38:0/3021537858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470c06ca50 0x7f470c13ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:11.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.931+0000 7f471454e640 1 -- 172.21.15.38:0/3021537858 >> 172.21.15.38:0/3021537858 conn(0x7f470c0cfea0 msgr2=0x7f470c0d13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:11.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.931+0000 7f471454e640 1 -- 172.21.15.38:0/3021537858 shutdown_connections 2023-12-22T08:46:11.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:11.931+0000 7f471454e640 1 -- 172.21.15.38:0/3021537858 wait complete. 2023-12-22T08:46:11.956 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T08:46:12.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.163+0000 7fd9b4b0c640 1 Processor -- start 2023-12-22T08:46:12.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.164+0000 7fd9b4b0c640 1 -- start start 2023-12-22T08:46:12.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.165+0000 7fd9b4b0c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd9b00b6620 0x7fd9b00b8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:12.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.165+0000 7fd9b4b0c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b0146f00 0x7fd9b00d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:12.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.165+0000 7fd9b4b0c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b00b4430 con 0x7fd9b00b3b20 2023-12-22T08:46:12.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.165+0000 7fd9b4b0c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b00b4710 con 0x7fd9b00b6620 2023-12-22T08:46:12.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.165+0000 7fd9b4b0c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00b49f0 con 0x7fd9b0146f00 2023-12-22T08:46:12.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.166+0000 7fd9af7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd9b00b6620 0x7fd9b00b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:12.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.166+0000 7fd9af7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd9b00b6620 0x7fd9b00b8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47906/0 (socket says 172.21.15.38:47906) 2023-12-22T08:46:12.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.166+0000 7fd9af7fe640 1 -- 172.21.15.38:0/3757370765 learned_addr learned my addr 172.21.15.38:0/3757370765 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:12.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.166+0000 7fd9af7fe640 1 -- 172.21.15.38:0/3757370765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b0146f00 msgr2=0x7fd9b00d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:12.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.166+0000 7fd9af7fe640 1 --2- 172.21.15.38:0/3757370765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b0146f00 0x7fd9b00d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:12.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.166+0000 7fd9af7fe640 1 -- 172.21.15.38:0/3757370765 >> v1:172.21.15.89:6789/0 conn(0x7fd9b00b3b20 legacy=0x7fd9b01467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:12.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.166+0000 7fd9af7fe640 1 -- 172.21.15.38:0/3757370765 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b00b4cd0 con 0x7fd9b00b6620 2023-12-22T08:46:12.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.167+0000 7fd9af7fe640 1 --2- 172.21.15.38:0/3757370765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9b00b6620 0x7fd9b00b8750 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009e50 tx=0x7fd9a002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2221a2f7941e685a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:12.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.168+0000 7fd9ae7fc640 1 -- 172.21.15.38:0/3757370765 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a002c9e0 con 0x7fd9b00b6620 2023-12-22T08:46:12.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.168+0000 7fd9ae7fc640 1 -- 172.21.15.38:0/3757370765 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a002cb40 con 0x7fd9b00b6620 2023-12-22T08:46:12.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.168+0000 7fd9ae7fc640 1 -- 172.21.15.38:0/3757370765 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a00343f0 con 0x7fd9b00b6620 2023-12-22T08:46:12.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.168+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/3757370765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9b00b6620 msgr2=0x7fd9b00b8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:12.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.168+0000 7fd9b4b0c640 1 --2- 172.21.15.38:0/3757370765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9b00b6620 0x7fd9b00b8750 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009e50 tx=0x7fd9a002be40 comp rx=0 tx=0).stop 2023-12-22T08:46:12.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.168+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/3757370765 shutdown_connections 2023-12-22T08:46:12.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.168+0000 7fd9b4b0c640 1 --2- 172.21.15.38:0/3757370765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b0146f00 0x7fd9b00d0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:12.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.168+0000 7fd9b4b0c640 1 --2- 172.21.15.38:0/3757370765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9b00b6620 0x7fd9b00b8750 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:12.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.169+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/3757370765 >> 172.21.15.38:0/3757370765 conn(0x7fd9b00d32c0 msgr2=0x7fd9b00d36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:12.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.169+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/3757370765 shutdown_connections 2023-12-22T08:46:12.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.169+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/3757370765 wait complete. 2023-12-22T08:46:12.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.170+0000 7fd9b4b0c640 1 Processor -- start 2023-12-22T08:46:12.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.170+0000 7fd9b4b0c640 1 -- start start 2023-12-22T08:46:12.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.171+0000 7fd9b4b0c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b00b6620 0x7fd9b00b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:12.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.171+0000 7fd9b4b0c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b0146f00 0x7fd9b00704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:12.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.171+0000 7fd9b4b0c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9b0143b10 0x7fd9b006f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:12.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.171+0000 7fd9b4b0c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00a9bb0 con 0x7fd9b0143b10 2023-12-22T08:46:12.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.171+0000 7fd9b4b0c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00709e0 con 0x7fd9b00b6620 2023-12-22T08:46:12.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.171+0000 7fd9b4b0c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00aa130 con 0x7fd9b0146f00 2023-12-22T08:46:12.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.172+0000 7fd9affff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9b0143b10 0x7fd9b006f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:12.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.172+0000 7fd9affff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9b0143b10 0x7fd9b006f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47908/0 (socket says 172.21.15.38:47908) 2023-12-22T08:46:12.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.172+0000 7fd9affff640 1 -- 172.21.15.38:0/2587258721 learned_addr learned my addr 172.21.15.38:0/2587258721 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:12.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.172+0000 7fd9af7fe640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b00b6620 0x7fd9b00b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:12.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.172+0000 7fd9aeffd640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b0146f00 0x7fd9b00704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:12.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.172+0000 7fd9affff640 1 -- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b0146f00 msgr2=0x7fd9b00704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:12.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.172+0000 7fd9affff640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b0146f00 0x7fd9b00704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:12.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.172+0000 7fd9affff640 1 -- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b00b6620 msgr2=0x7fd9b00b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:12.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.172+0000 7fd9affff640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b00b6620 0x7fd9b00b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:12.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.172+0000 7fd9affff640 1 -- 172.21.15.38:0/2587258721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a0009b30 con 0x7fd9b0143b10 2023-12-22T08:46:12.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.173+0000 7fd9affff640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9b0143b10 0x7fd9b006f1d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800b410 tx=0x7fd9a800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:12.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.173+0000 7fd9a7fff640 1 -- 172.21.15.38:0/2587258721 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8011830 con 0x7fd9b0143b10 2023-12-22T08:46:12.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.173+0000 7fd9a7fff640 1 -- 172.21.15.38:0/2587258721 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a8011990 con 0x7fd9b0143b10 2023-12-22T08:46:12.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.173+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/2587258721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b0070bf0 con 0x7fd9b0143b10 2023-12-22T08:46:12.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.173+0000 7fd9a7fff640 1 -- 172.21.15.38:0/2587258721 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8011d40 con 0x7fd9b0143b10 2023-12-22T08:46:12.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.173+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/2587258721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b00a9dc0 con 0x7fd9b0143b10 2023-12-22T08:46:12.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.174+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/2587258721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b0061910 con 0x7fd9b0143b10 2023-12-22T08:46:12.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.175+0000 7fd9a7fff640 1 -- 172.21.15.38:0/2587258721 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd9a801a400 con 0x7fd9b0143b10 2023-12-22T08:46:12.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.177+0000 7fd9a7fff640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd99006a460 0x7fd99006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:12.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.177+0000 7fd9a7fff640 1 -- 172.21.15.38:0/2587258721 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9a80889f0 con 0x7fd9b0143b10 2023-12-22T08:46:12.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.177+0000 7fd9af7fe640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd99006a460 0x7fd99006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:12.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.179+0000 7fd9af7fe640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd99006a460 0x7fd99006c920 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0035000 tx=0x7fd9a0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:12.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.181+0000 7fd9a7fff640 1 -- 172.21.15.38:0/2587258721 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd9a8053fe0 con 0x7fd9b0143b10 2023-12-22T08:46:12.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:12.413+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/2587258721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd9b00aa270 con 0x7fd9b0143b10 2023-12-22T08:46:13.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.028+0000 7fd9a7fff640 1 -- 172.21.15.38:0/2587258721 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd9a8015020 con 0x7fd9b0143b10 2023-12-22T08:46:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.032+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd99006a460 msgr2=0x7fd99006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.032+0000 7fd9b4b0c640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd99006a460 0x7fd99006c920 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0035000 tx=0x7fd9a0030000 comp rx=0 tx=0).stop 2023-12-22T08:46:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.032+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/2587258721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9b0143b10 msgr2=0x7fd9b006f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.032+0000 7fd9b4b0c640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9b0143b10 0x7fd9b006f1d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800b410 tx=0x7fd9a800b810 comp rx=0 tx=0).stop 2023-12-22T08:46:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.032+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/2587258721 shutdown_connections 2023-12-22T08:46:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.032+0000 7fd9b4b0c640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd99006a460 0x7fd99006c920 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.032+0000 7fd9b4b0c640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9b0143b10 0x7fd9b006f1d0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.032+0000 7fd9b4b0c640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b0146f00 0x7fd9b00704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.032+0000 7fd9b4b0c640 1 --2- 172.21.15.38:0/2587258721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b00b6620 0x7fd9b00b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.032+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/2587258721 >> 172.21.15.38:0/2587258721 conn(0x7fd9b00d32c0 msgr2=0x7fd9b00b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.032+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/2587258721 shutdown_connections 2023-12-22T08:46:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.032+0000 7fd9b4b0c640 1 -- 172.21.15.38:0/2587258721 wait complete. 2023-12-22T08:46:13.055 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T08:46:13.055 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T08:46:13.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.280+0000 7f852ee57640 1 Processor -- start 2023-12-22T08:46:13.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.280+0000 7f852ee57640 1 -- start start 2023-12-22T08:46:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.282+0000 7f852ee57640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f85280b6620 0x7f85280b8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.282+0000 7f852ee57640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85280b4430 con 0x7f85280b3b20 2023-12-22T08:46:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.282+0000 7f852ee57640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85280b4710 con 0x7f8528146f00 2023-12-22T08:46:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.282+0000 7f852ee57640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85280b49f0 con 0x7f85280b6620 2023-12-22T08:46:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.283+0000 7f852d654640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f85280b3b20 0x7f85281467f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47008/0 (socket says 172.21.15.38:47008) 2023-12-22T08:46:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.283+0000 7f852d654640 1 -- 172.21.15.38:0/4250252716 learned_addr learned my addr 172.21.15.38:0/4250252716 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:13.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.283+0000 7f852de55640 1 --2- 172.21.15.38:0/4250252716 >> v2:172.21.15.38:3300/0 conn(0x7f85280b6620 0x7f85280b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:13.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.283+0000 7f852ce53640 1 -- 172.21.15.38:0/4250252716 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826749998 0 0) 0x7f85280b4430 con 0x7f85280b3b20 2023-12-22T08:46:13.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.283+0000 7f852ce53640 1 -- 172.21.15.38:0/4250252716 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8514003520 con 0x7f85280b3b20 2023-12-22T08:46:13.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.283+0000 7f852de55640 1 -- 172.21.15.38:0/4250252716 >> v1:172.21.15.89:6789/0 conn(0x7f8528146f00 legacy=0x7f85280d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:13.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.283+0000 7f852de55640 1 -- 172.21.15.38:0/4250252716 >> v1:172.21.15.38:6789/0 conn(0x7f85280b3b20 legacy=0x7f85281467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:13.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.283+0000 7f852de55640 1 -- 172.21.15.38:0/4250252716 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85280b4cd0 con 0x7f85280b6620 2023-12-22T08:46:13.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.285+0000 7f852de55640 1 --2- 172.21.15.38:0/4250252716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85280b6620 0x7f85280b8750 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f85240097a0 tx=0x7f852402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1031e94038ff9aa server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:13.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.285+0000 7f852ce53640 1 -- 172.21.15.38:0/4250252716 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852402e070 con 0x7f85280b6620 2023-12-22T08:46:13.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.285+0000 7f852ce53640 1 -- 172.21.15.38:0/4250252716 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85240315a0 con 0x7f85280b6620 2023-12-22T08:46:13.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.285+0000 7f852ce53640 1 -- 172.21.15.38:0/4250252716 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524031930 con 0x7f85280b6620 2023-12-22T08:46:13.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.285+0000 7f852ee57640 1 -- 172.21.15.38:0/4250252716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85280b6620 msgr2=0x7f85280b8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:13.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.286+0000 7f852ee57640 1 --2- 172.21.15.38:0/4250252716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85280b6620 0x7f85280b8750 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f85240097a0 tx=0x7f852402b840 comp rx=0 tx=0).stop 2023-12-22T08:46:13.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.286+0000 7f852ee57640 1 -- 172.21.15.38:0/4250252716 shutdown_connections 2023-12-22T08:46:13.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.286+0000 7f852ee57640 1 --2- 172.21.15.38:0/4250252716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85280b6620 0x7f85280b8750 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:13.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.286+0000 7f852ee57640 1 -- 172.21.15.38:0/4250252716 >> 172.21.15.38:0/4250252716 conn(0x7f85280d32c0 msgr2=0x7f85280d36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:13.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.286+0000 7f852ee57640 1 -- 172.21.15.38:0/4250252716 shutdown_connections 2023-12-22T08:46:13.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.286+0000 7f852ee57640 1 -- 172.21.15.38:0/4250252716 wait complete. 2023-12-22T08:46:13.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.287+0000 7f852ee57640 1 Processor -- start 2023-12-22T08:46:13.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.288+0000 7f852ee57640 1 -- start start 2023-12-22T08:46:13.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852ee57640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85280b6620 0x7f8528140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:13.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852ee57640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8528146f00 0x7f8528139dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:13.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852ee57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8528147340 0x7f8528149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:13.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852ee57640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85281484c0 con 0x7f8528146f00 2023-12-22T08:46:13.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852ee57640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8528147840 con 0x7f8528147340 2023-12-22T08:46:13.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852ee57640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8528147b20 con 0x7f85280b6620 2023-12-22T08:46:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852d654640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8528146f00 0x7f8528139dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852d654640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8528146f00 0x7f8528139dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47916/0 (socket says 172.21.15.38:47916) 2023-12-22T08:46:13.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852d654640 1 -- 172.21.15.38:0/3852177430 learned_addr learned my addr 172.21.15.38:0/3852177430 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852de55640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85280b6620 0x7f8528140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852e656640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8528147340 0x7f8528149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852d654640 1 -- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85280b6620 msgr2=0x7f8528140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852d654640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85280b6620 0x7f8528140920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852d654640 1 -- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8528147340 msgr2=0x7f8528149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852d654640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8528147340 0x7f8528149570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.289+0000 7f852d654640 1 -- 172.21.15.38:0/3852177430 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8524009400 con 0x7f8528146f00 2023-12-22T08:46:13.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.290+0000 7f852d654640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8528146f00 0x7f8528139dc0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f851800c500 tx=0x7f851800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.290+0000 7f851e7fc640 1 -- 172.21.15.38:0/3852177430 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8518005ce0 con 0x7f8528146f00 2023-12-22T08:46:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.290+0000 7f851e7fc640 1 -- 172.21.15.38:0/3852177430 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8518005e40 con 0x7f8528146f00 2023-12-22T08:46:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.290+0000 7f851e7fc640 1 -- 172.21.15.38:0/3852177430 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8518007330 con 0x7f8528146f00 2023-12-22T08:46:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.290+0000 7f852ee57640 1 -- 172.21.15.38:0/3852177430 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8528147e00 con 0x7f8528146f00 2023-12-22T08:46:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.290+0000 7f852ee57640 1 -- 172.21.15.38:0/3852177430 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852813a300 con 0x7f8528146f00 2023-12-22T08:46:13.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.291+0000 7f852ee57640 1 -- 172.21.15.38:0/3852177430 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8528148600 con 0x7f8528146f00 2023-12-22T08:46:13.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.292+0000 7f851e7fc640 1 -- 172.21.15.38:0/3852177430 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8518007550 con 0x7f8528146f00 2023-12-22T08:46:13.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.294+0000 7f851e7fc640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f850c06a430 0x7f850c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:13.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.294+0000 7f851e7fc640 1 -- 172.21.15.38:0/3852177430 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8518088060 con 0x7f8528146f00 2023-12-22T08:46:13.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.295+0000 7f852de55640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f850c06a430 0x7f850c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:13.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.296+0000 7f852de55640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f850c06a430 0x7f850c06c8f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8524036000 tx=0x7f852403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:13.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.298+0000 7f851e7fc640 1 -- 172.21.15.38:0/3852177430 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f85180bac80 con 0x7f8528146f00 2023-12-22T08:46:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:13.522+0000 7f852ee57640 1 -- 172.21.15.38:0/3852177430 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8528061910 con 0x7f8528146f00 2023-12-22T08:46:14.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.039+0000 7f851e7fc640 1 -- 172.21.15.38:0/3852177430 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) v1 ==== 122+0+0 (secure 0 0 0) 0x7f85180170c0 con 0x7f8528146f00 2023-12-22T08:46:14.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.043+0000 7f852ee57640 1 -- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f850c06a430 msgr2=0x7f850c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:14.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.043+0000 7f852ee57640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f850c06a430 0x7f850c06c8f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8524036000 tx=0x7f852403d040 comp rx=0 tx=0).stop 2023-12-22T08:46:14.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.043+0000 7f852ee57640 1 -- 172.21.15.38:0/3852177430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8528146f00 msgr2=0x7f8528139dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:14.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.043+0000 7f852ee57640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8528146f00 0x7f8528139dc0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f851800c500 tx=0x7f851800c9c0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.043+0000 7f852ee57640 1 -- 172.21.15.38:0/3852177430 shutdown_connections 2023-12-22T08:46:14.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.043+0000 7f852ee57640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8528147340 0x7f8528149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.043+0000 7f852ee57640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f850c06a430 0x7f850c06c8f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.043+0000 7f852ee57640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8528146f00 0x7f8528139dc0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.043+0000 7f852ee57640 1 --2- 172.21.15.38:0/3852177430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85280b6620 0x7f8528140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.043+0000 7f852ee57640 1 -- 172.21.15.38:0/3852177430 >> 172.21.15.38:0/3852177430 conn(0x7f85280d32c0 msgr2=0x7f85280d36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:14.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.043+0000 7f852ee57640 1 -- 172.21.15.38:0/3852177430 shutdown_connections 2023-12-22T08:46:14.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.043+0000 7f852ee57640 1 -- 172.21.15.38:0/3852177430 wait complete. 2023-12-22T08:46:14.066 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T08:46:14.067 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:46:14.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.292+0000 7f3571dd0640 1 Processor -- start 2023-12-22T08:46:14.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.293+0000 7f3571dd0640 1 -- start start 2023-12-22T08:46:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.294+0000 7f3571dd0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f356c146e40 0x7f356c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.294+0000 7f3571dd0640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c0b4120 con 0x7f356c161df0 2023-12-22T08:46:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.294+0000 7f3571dd0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c0b4400 con 0x7f356c1618d0 2023-12-22T08:46:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.294+0000 7f3571dd0640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c0b4da0 con 0x7f356c146e40 2023-12-22T08:46:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.294+0000 7f356b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f356c146e40 0x7f356c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.294+0000 7f356b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f356c146e40 0x7f356c0cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47922/0 (socket says 172.21.15.38:47922) 2023-12-22T08:46:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.294+0000 7f356b7fe640 1 -- 172.21.15.38:0/1971708160 learned_addr learned my addr 172.21.15.38:0/1971708160 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.295+0000 7f356b7fe640 1 -- 172.21.15.38:0/1971708160 >> v1:172.21.15.89:6789/0 conn(0x7f356c1618d0 legacy=0x7f356c070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.295+0000 7f356b7fe640 1 -- 172.21.15.38:0/1971708160 >> v1:172.21.15.38:6789/0 conn(0x7f356c161df0 legacy=0x7f356c1611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:14.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.295+0000 7f356b7fe640 1 -- 172.21.15.38:0/1971708160 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c0b46e0 con 0x7f356c146e40 2023-12-22T08:46:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.296+0000 7f356b7fe640 1 --2- 172.21.15.38:0/1971708160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f356c146e40 0x7f356c0cf6b0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f355c009e50 tx=0x7f355c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a880b088923995 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.296+0000 7f356a7fc640 1 -- 172.21.15.38:0/1971708160 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c02c9e0 con 0x7f356c146e40 2023-12-22T08:46:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.296+0000 7f356a7fc640 1 -- 172.21.15.38:0/1971708160 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c02cb40 con 0x7f356c146e40 2023-12-22T08:46:14.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.297+0000 7f356a7fc640 1 -- 172.21.15.38:0/1971708160 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0343f0 con 0x7f356c146e40 2023-12-22T08:46:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.297+0000 7f3571dd0640 1 -- 172.21.15.38:0/1971708160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f356c146e40 msgr2=0x7f356c0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.297+0000 7f3571dd0640 1 --2- 172.21.15.38:0/1971708160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f356c146e40 0x7f356c0cf6b0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f355c009e50 tx=0x7f355c02be40 comp rx=0 tx=0).stop 2023-12-22T08:46:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.297+0000 7f3571dd0640 1 -- 172.21.15.38:0/1971708160 shutdown_connections 2023-12-22T08:46:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.297+0000 7f3571dd0640 1 --2- 172.21.15.38:0/1971708160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f356c146e40 0x7f356c0cf6b0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.297+0000 7f3571dd0640 1 -- 172.21.15.38:0/1971708160 >> 172.21.15.38:0/1971708160 conn(0x7f356c0cff10 msgr2=0x7f356c0d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.297+0000 7f3571dd0640 1 -- 172.21.15.38:0/1971708160 shutdown_connections 2023-12-22T08:46:14.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.297+0000 7f3571dd0640 1 -- 172.21.15.38:0/1971708160 wait complete. 2023-12-22T08:46:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.299+0000 7f3571dd0640 1 Processor -- start 2023-12-22T08:46:14.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.299+0000 7f3571dd0640 1 -- start start 2023-12-22T08:46:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.300+0000 7f3571dd0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c146e40 0x7f356c0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.300+0000 7f3571dd0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f356c1618d0 0x7f356c1f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.300+0000 7f3571dd0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f356c161df0 0x7f356c1f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.300+0000 7f3571dd0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c0ade60 con 0x7f356c161df0 2023-12-22T08:46:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.300+0000 7f3571dd0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1f68d0 con 0x7f356c146e40 2023-12-22T08:46:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.300+0000 7f3571dd0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1f6b00 con 0x7f356c1618d0 2023-12-22T08:46:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.301+0000 7f356bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f356c161df0 0x7f356c1f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.301+0000 7f356bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f356c161df0 0x7f356c1f2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47926/0 (socket says 172.21.15.38:47926) 2023-12-22T08:46:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.301+0000 7f356bfff640 1 -- 172.21.15.38:0/4150874620 learned_addr learned my addr 172.21.15.38:0/4150874620 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:14.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.301+0000 7f356b7fe640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c146e40 0x7f356c0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:14.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.301+0000 7f356affd640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f356c1618d0 0x7f356c1f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.301+0000 7f356bfff640 1 -- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f356c1618d0 msgr2=0x7f356c1f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.301+0000 7f356bfff640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f356c1618d0 0x7f356c1f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.301+0000 7f356bfff640 1 -- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c146e40 msgr2=0x7f356c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.301+0000 7f356bfff640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c146e40 0x7f356c0b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.301+0000 7f356bfff640 1 -- 172.21.15.38:0/4150874620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c009b30 con 0x7f356c161df0 2023-12-22T08:46:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.301+0000 7f356affd640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f356c1618d0 0x7f356c1f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:46:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.302+0000 7f356bfff640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f356c161df0 0x7f356c1f2570 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f356400c410 tx=0x7f356400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.302+0000 7f3553fff640 1 -- 172.21.15.38:0/4150874620 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564011790 con 0x7f356c161df0 2023-12-22T08:46:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.302+0000 7f3553fff640 1 -- 172.21.15.38:0/4150874620 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35640118f0 con 0x7f356c161df0 2023-12-22T08:46:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.302+0000 7f3553fff640 1 -- 172.21.15.38:0/4150874620 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564011ce0 con 0x7f356c161df0 2023-12-22T08:46:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.302+0000 7f3571dd0640 1 -- 172.21.15.38:0/4150874620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c1f6de0 con 0x7f356c161df0 2023-12-22T08:46:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.302+0000 7f3571dd0640 1 -- 172.21.15.38:0/4150874620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c1f2ab0 con 0x7f356c161df0 2023-12-22T08:46:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.303+0000 7f3571dd0640 1 -- 172.21.15.38:0/4150874620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c0adfa0 con 0x7f356c161df0 2023-12-22T08:46:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.304+0000 7f3553fff640 1 -- 172.21.15.38:0/4150874620 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f356401c460 con 0x7f356c161df0 2023-12-22T08:46:14.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.305+0000 7f3553fff640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f355806a460 0x7f355806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.305+0000 7f3553fff640 1 -- 172.21.15.38:0/4150874620 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35640884b0 con 0x7f356c161df0 2023-12-22T08:46:14.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.306+0000 7f356b7fe640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f355806a460 0x7f355806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:14.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.307+0000 7f356b7fe640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f355806a460 0x7f355806c920 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f355c035000 tx=0x7f355c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:14.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.309+0000 7f3553fff640 1 -- 172.21.15.38:0/4150874620 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f356c0adfa0 con 0x7f356c161df0 2023-12-22T08:46:14.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.545+0000 7f3571dd0640 1 -- 172.21.15.38:0/4150874620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f356c0adfa0 con 0x7f356c161df0 2023-12-22T08:46:14.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.546+0000 7f3553fff640 1 -- 172.21.15.38:0/4150874620 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f356c0adfa0 con 0x7f356c161df0 2023-12-22T08:46:14.548 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:14.548 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/4163741517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4163741517},{"type":"v1","addr":"172.21.15.89:6836","nonce":4163741517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/972467119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":972467119},{"type":"v1","addr":"172.21.15.89:6837","nonce":972467119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/2124959631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2124959631},{"type":"v1","addr":"172.21.15.38:6834","nonce":2124959631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:46:11.013927+0000","modified":"2023-12-22T08:46:14.032400+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/2733146003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2733146003},{"type":"v1","addr":"172.21.15.38:6835","nonce":2733146003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-22T08:46:14.548 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 47 2023-12-22T08:46:14.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.550+0000 7f3571dd0640 1 -- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f355806a460 msgr2=0x7f355806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:14.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.550+0000 7f3571dd0640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f355806a460 0x7f355806c920 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f355c035000 tx=0x7f355c030000 comp rx=0 tx=0).stop 2023-12-22T08:46:14.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.550+0000 7f3571dd0640 1 -- 172.21.15.38:0/4150874620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f356c161df0 msgr2=0x7f356c1f2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:14.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.550+0000 7f3571dd0640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f356c161df0 0x7f356c1f2570 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f356400c410 tx=0x7f356400c8d0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.550+0000 7f3571dd0640 1 -- 172.21.15.38:0/4150874620 shutdown_connections 2023-12-22T08:46:14.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.550+0000 7f3571dd0640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f355806a460 0x7f355806c920 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.550+0000 7f3571dd0640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f356c161df0 0x7f356c1f2570 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.550+0000 7f3571dd0640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f356c1618d0 0x7f356c1f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.550+0000 7f3571dd0640 1 --2- 172.21.15.38:0/4150874620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356c146e40 0x7f356c0b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.550+0000 7f3571dd0640 1 -- 172.21.15.38:0/4150874620 >> 172.21.15.38:0/4150874620 conn(0x7f356c0cff10 msgr2=0x7f356c160010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:14.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.550+0000 7f3571dd0640 1 -- 172.21.15.38:0/4150874620 shutdown_connections 2023-12-22T08:46:14.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.550+0000 7f3571dd0640 1 -- 172.21.15.38:0/4150874620 wait complete. 2023-12-22T08:46:14.571 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:46:14.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.784+0000 7feede6b2640 1 Processor -- start 2023-12-22T08:46:14.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.784+0000 7feede6b2640 1 -- start start 2023-12-22T08:46:14.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.786+0000 7feede6b2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feed815e740 0x7feed815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.786+0000 7feede6b2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feed80b3f90 0x7feed8070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.786+0000 7feede6b2640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed815eb20 con 0x7feed806ca50 2023-12-22T08:46:14.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.786+0000 7feede6b2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed806e650 con 0x7feed80b3f90 2023-12-22T08:46:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.786+0000 7feede6b2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed8070770 con 0x7feed815e740 2023-12-22T08:46:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.786+0000 7feed77fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7feed806ca50 0x7feed80b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47028/0 (socket says 172.21.15.38:47028) 2023-12-22T08:46:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.786+0000 7feed77fe640 1 -- 172.21.15.38:0/925290488 learned_addr learned my addr 172.21.15.38:0/925290488 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:14.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.786+0000 7feed7fff640 1 --2- 172.21.15.38:0/925290488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feed815e740 0x7feed815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:14.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feedcc4f640 1 --2- 172.21.15.38:0/925290488 >> v2:172.21.15.89:3300/0 conn(0x7feed80b3f90 0x7feed8070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:14.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261707959 0 0) 0x7feed815eb20 con 0x7feed806ca50 2023-12-22T08:46:14.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec4003520 con 0x7feed806ca50 2023-12-22T08:46:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1034720416 0 0) 0x7feec4003520 con 0x7feed806ca50 2023-12-22T08:46:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feed815e740 msgr2=0x7feed815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 --2- 172.21.15.38:0/925290488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feed815e740 0x7feed815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 >> v2:172.21.15.89:3300/0 conn(0x7feed80b3f90 msgr2=0x7feed8070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 --2- 172.21.15.38:0/925290488 >> v2:172.21.15.89:3300/0 conn(0x7feed80b3f90 0x7feed8070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed806d180 con 0x7feed806ca50 2023-12-22T08:46:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7feec0001670 con 0x7feed806ca50 2023-12-22T08:46:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 >> v1:172.21.15.38:6789/0 conn(0x7feed806ca50 legacy=0x7feed80b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 --2- 172.21.15.38:0/925290488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec4003970 0x7feec4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 --2- 172.21.15.38:0/925290488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec40047c0 0x7feec4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 --2- 172.21.15.38:0/925290488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feed815e740 0x7feec4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed806e650 con 0x7feec4003970 2023-12-22T08:46:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed8070770 con 0x7feec40047c0 2023-12-22T08:46:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec400ba00 con 0x7feed815e740 2023-12-22T08:46:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.787+0000 7feed7fff640 1 --2- 172.21.15.38:0/925290488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec4003970 0x7feec4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.788+0000 7feed7fff640 1 -- 172.21.15.38:0/925290488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feed815e740 msgr2=0x7feec4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.788+0000 7feed7fff640 1 --2- 172.21.15.38:0/925290488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feed815e740 0x7feec4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.788+0000 7feed7fff640 1 -- 172.21.15.38:0/925290488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec40047c0 msgr2=0x7feec4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.788+0000 7feed7fff640 1 --2- 172.21.15.38:0/925290488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec40047c0 0x7feec4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.788+0000 7feed7fff640 1 -- 172.21.15.38:0/925290488 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec4003520 con 0x7feec4003970 2023-12-22T08:46:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.789+0000 7feed7fff640 1 --2- 172.21.15.38:0/925290488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec4003970 0x7feec4003d90 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7feec8009fc0 tx=0x7feec40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d5c8b68d84cffb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.789+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec802cc60 con 0x7feec4003970 2023-12-22T08:46:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.789+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec800f040 con 0x7feec4003970 2023-12-22T08:46:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.789+0000 7feed6ffd640 1 -- 172.21.15.38:0/925290488 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8034440 con 0x7feec4003970 2023-12-22T08:46:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.790+0000 7feede6b2640 1 -- 172.21.15.38:0/925290488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec4003970 msgr2=0x7feec4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.790+0000 7feede6b2640 1 --2- 172.21.15.38:0/925290488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec4003970 0x7feec4003d90 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7feec8009fc0 tx=0x7feec40057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.790+0000 7feedcc4f640 1 -- 172.21.15.38:0/925290488 reap_dead start 2023-12-22T08:46:14.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.790+0000 7feede6b2640 1 -- 172.21.15.38:0/925290488 shutdown_connections 2023-12-22T08:46:14.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.790+0000 7feede6b2640 1 -- 172.21.15.38:0/925290488 >> 172.21.15.38:0/925290488 conn(0x7feed80cfea0 msgr2=0x7feed80d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:14.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.790+0000 7feede6b2640 1 -- 172.21.15.38:0/925290488 shutdown_connections 2023-12-22T08:46:14.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.790+0000 7feede6b2640 1 -- 172.21.15.38:0/925290488 wait complete. 2023-12-22T08:46:14.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.792+0000 7feede6b2640 1 Processor -- start 2023-12-22T08:46:14.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.792+0000 7feede6b2640 1 -- start start 2023-12-22T08:46:14.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.793+0000 7feede6b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec4003970 0x7feed8143340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.793+0000 7feede6b2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feed81407c0 0x7feed80b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.793+0000 7feede6b2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed8141f60 0x7feed815f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.793+0000 7feede6b2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed8141b40 con 0x7feed8141f60 2023-12-22T08:46:14.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.793+0000 7feede6b2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed8140c40 con 0x7feec4003970 2023-12-22T08:46:14.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.793+0000 7feede6b2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed8140ec0 con 0x7feed81407c0 2023-12-22T08:46:14.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.793+0000 7feedcc4f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed8141f60 0x7feed815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:14.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.794+0000 7feedcc4f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed8141f60 0x7feed815f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47940/0 (socket says 172.21.15.38:47940) 2023-12-22T08:46:14.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.794+0000 7feedcc4f640 1 -- 172.21.15.38:0/1367467323 learned_addr learned my addr 172.21.15.38:0/1367467323 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.794+0000 7feed77fe640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feed81407c0 0x7feed80b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.794+0000 7feed7fff640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec4003970 0x7feed8143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.794+0000 7feedcc4f640 1 -- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feed81407c0 msgr2=0x7feed80b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.794+0000 7feedcc4f640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feed81407c0 0x7feed80b84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.794+0000 7feedcc4f640 1 -- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec4003970 msgr2=0x7feed8143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.794+0000 7feedcc4f640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec4003970 0x7feed8143340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.794+0000 7feedcc4f640 1 -- 172.21.15.38:0/1367467323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed81411a0 con 0x7feed8141f60 2023-12-22T08:46:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.794+0000 7feedcc4f640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed8141f60 0x7feed815f650 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7feed80cfe40 tx=0x7feed000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.795+0000 7feed4ff9640 1 -- 172.21.15.38:0/1367467323 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed000c680 con 0x7feed8141f60 2023-12-22T08:46:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.795+0000 7feed4ff9640 1 -- 172.21.15.38:0/1367467323 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed000c7e0 con 0x7feed8141f60 2023-12-22T08:46:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.795+0000 7feed4ff9640 1 -- 172.21.15.38:0/1367467323 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed000cb90 con 0x7feed8141f60 2023-12-22T08:46:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.795+0000 7feede6b2640 1 -- 172.21.15.38:0/1367467323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed8141480 con 0x7feed8141f60 2023-12-22T08:46:14.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.795+0000 7feede6b2640 1 -- 172.21.15.38:0/1367467323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed80b8a00 con 0x7feed8141f60 2023-12-22T08:46:14.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.796+0000 7feede6b2640 1 -- 172.21.15.38:0/1367467323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed8141c80 con 0x7feed8141f60 2023-12-22T08:46:14.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.797+0000 7feed4ff9640 1 -- 172.21.15.38:0/1367467323 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feed000ccf0 con 0x7feed8141f60 2023-12-22T08:46:14.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.798+0000 7feed4ff9640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feeb806a430 0x7feeb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:14.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.798+0000 7feed4ff9640 1 -- 172.21.15.38:0/1367467323 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feed0088430 con 0x7feed8141f60 2023-12-22T08:46:14.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.799+0000 7feed7fff640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feeb806a430 0x7feeb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:14.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.800+0000 7feed7fff640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feeb806a430 0x7feeb806c8f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7feec8036000 tx=0x7feec802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:14.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.802+0000 7feed4ff9640 1 -- 172.21.15.38:0/1367467323 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feed8141c80 con 0x7feed8141f60 2023-12-22T08:46:15.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:14.999+0000 7feede6b2640 1 -- 172.21.15.38:0/1367467323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feed8141c80 con 0x7feed8141f60 2023-12-22T08:46:15.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.002+0000 7feed4ff9640 1 -- 172.21.15.38:0/1367467323 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16067 (secure 0 0 0) 0x7feed8141c80 con 0x7feed8141f60 2023-12-22T08:46:15.004 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:15.004 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":110,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:46:12.018310+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:46:08.930859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-22T08:46:10.036922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:46:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.005+0000 7feede6b2640 1 -- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feeb806a430 msgr2=0x7feeb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.005+0000 7feede6b2640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feeb806a430 0x7feeb806c8f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7feec8036000 tx=0x7feec802e000 comp rx=0 tx=0).stop 2023-12-22T08:46:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.005+0000 7feede6b2640 1 -- 172.21.15.38:0/1367467323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed8141f60 msgr2=0x7feed815f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.005+0000 7feede6b2640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed8141f60 0x7feed815f650 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7feed80cfe40 tx=0x7feed000ec00 comp rx=0 tx=0).stop 2023-12-22T08:46:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.005+0000 7feede6b2640 1 -- 172.21.15.38:0/1367467323 shutdown_connections 2023-12-22T08:46:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.005+0000 7feede6b2640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feeb806a430 0x7feeb806c8f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.005+0000 7feede6b2640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed8141f60 0x7feed815f650 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.005+0000 7feede6b2640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feed81407c0 0x7feed80b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.005+0000 7feede6b2640 1 --2- 172.21.15.38:0/1367467323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec4003970 0x7feed8143340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.005+0000 7feede6b2640 1 -- 172.21.15.38:0/1367467323 >> 172.21.15.38:0/1367467323 conn(0x7feed80cfea0 msgr2=0x7feed8154210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.005+0000 7feede6b2640 1 -- 172.21.15.38:0/1367467323 shutdown_connections 2023-12-22T08:46:15.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.005+0000 7feede6b2640 1 -- 172.21.15.38:0/1367467323 wait complete. 2023-12-22T08:46:15.026 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T08:46:15.026 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:46:15.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.229+0000 7fe99acd6640 1 Processor -- start 2023-12-22T08:46:15.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.230+0000 7fe99acd6640 1 -- start start 2023-12-22T08:46:15.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.231+0000 7fe99acd6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe994146690 0x7fe9940cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.231+0000 7fe99acd6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe9940cf4f0 0x7fe9940b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.231+0000 7fe99acd6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9940cf950 con 0x7fe9940b0ca0 2023-12-22T08:46:15.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.231+0000 7fe99acd6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe994146a70 con 0x7fe994146690 2023-12-22T08:46:15.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.231+0000 7fe99acd6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe994146f40 con 0x7fe9940cf4f0 2023-12-22T08:46:15.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.232+0000 7fe999cd4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe994146690 0x7fe9940cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.232+0000 7fe99a4d5640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe9940b0ca0 0x7fe994160f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47042/0 (socket says 172.21.15.38:47042) 2023-12-22T08:46:15.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.232+0000 7fe999cd4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe994146690 0x7fe9940cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47942/0 (socket says 172.21.15.38:47942) 2023-12-22T08:46:15.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.232+0000 7fe99a4d5640 1 -- 172.21.15.38:0/3333883463 learned_addr learned my addr 172.21.15.38:0/3333883463 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:15.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.232+0000 7fe9994d3640 1 --2- 172.21.15.38:0/3333883463 >> v2:172.21.15.89:3300/0 conn(0x7fe9940cf4f0 0x7fe9940b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.232+0000 7fe999cd4640 1 -- 172.21.15.38:0/3333883463 >> v2:172.21.15.89:3300/0 conn(0x7fe9940cf4f0 msgr2=0x7fe9940b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:15.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.232+0000 7fe999cd4640 1 --2- 172.21.15.38:0/3333883463 >> v2:172.21.15.89:3300/0 conn(0x7fe9940cf4f0 0x7fe9940b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.232+0000 7fe999cd4640 1 -- 172.21.15.38:0/3333883463 >> v1:172.21.15.38:6789/0 conn(0x7fe9940b0ca0 legacy=0x7fe994160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.232+0000 7fe999cd4640 1 -- 172.21.15.38:0/3333883463 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99406a470 con 0x7fe994146690 2023-12-22T08:46:15.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.234+0000 7fe999cd4640 1 --2- 172.21.15.38:0/3333883463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe994146690 0x7fe9940cefb0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe9940b2060 tx=0x7fe99002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b6023b93c266d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:15.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.234+0000 7fe998cd2640 1 -- 172.21.15.38:0/3333883463 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990031830 con 0x7fe994146690 2023-12-22T08:46:15.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.234+0000 7fe998cd2640 1 -- 172.21.15.38:0/3333883463 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe990031990 con 0x7fe994146690 2023-12-22T08:46:15.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.234+0000 7fe998cd2640 1 -- 172.21.15.38:0/3333883463 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990031d20 con 0x7fe994146690 2023-12-22T08:46:15.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.234+0000 7fe99acd6640 1 -- 172.21.15.38:0/3333883463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe994146690 msgr2=0x7fe9940cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.234+0000 7fe99acd6640 1 --2- 172.21.15.38:0/3333883463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe994146690 0x7fe9940cefb0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe9940b2060 tx=0x7fe99002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.235+0000 7fe99acd6640 1 -- 172.21.15.38:0/3333883463 shutdown_connections 2023-12-22T08:46:15.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.235+0000 7fe99acd6640 1 --2- 172.21.15.38:0/3333883463 >> v2:172.21.15.89:3300/0 conn(0x7fe9940cf4f0 0x7fe9940b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.235+0000 7fe99acd6640 1 --2- 172.21.15.38:0/3333883463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe994146690 0x7fe9940cefb0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.235+0000 7fe99acd6640 1 -- 172.21.15.38:0/3333883463 >> 172.21.15.38:0/3333883463 conn(0x7fe994060720 msgr2=0x7fe994060b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:15.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.235+0000 7fe99acd6640 1 -- 172.21.15.38:0/3333883463 shutdown_connections 2023-12-22T08:46:15.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.235+0000 7fe99acd6640 1 -- 172.21.15.38:0/3333883463 wait complete. 2023-12-22T08:46:15.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.237+0000 7fe99acd6640 1 Processor -- start 2023-12-22T08:46:15.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.237+0000 7fe99acd6640 1 -- start start 2023-12-22T08:46:15.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.238+0000 7fe99acd6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9940b0ca0 0x7fe9941e26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.238+0000 7fe99acd6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9940cf4f0 0x7fe9941f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.238+0000 7fe99acd6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe994146690 0x7fe99406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.238+0000 7fe99acd6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9941e44f0 con 0x7fe994146690 2023-12-22T08:46:15.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.238+0000 7fe99acd6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9941e3780 con 0x7fe9940cf4f0 2023-12-22T08:46:15.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.238+0000 7fe99acd6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9941e2c10 con 0x7fe9940b0ca0 2023-12-22T08:46:15.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.238+0000 7fe99a4d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe994146690 0x7fe99406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.238+0000 7fe99a4d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe994146690 0x7fe99406cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47952/0 (socket says 172.21.15.38:47952) 2023-12-22T08:46:15.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.238+0000 7fe99a4d5640 1 -- 172.21.15.38:0/2573516166 learned_addr learned my addr 172.21.15.38:0/2573516166 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:15.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.239+0000 7fe9994d3640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9940cf4f0 0x7fe9941f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.239+0000 7fe999cd4640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9940b0ca0 0x7fe9941e26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.239+0000 7fe99a4d5640 1 -- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9940b0ca0 msgr2=0x7fe9941e26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.239+0000 7fe99a4d5640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9940b0ca0 0x7fe9941e26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.239+0000 7fe99a4d5640 1 -- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9940cf4f0 msgr2=0x7fe9941f1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.239+0000 7fe99a4d5640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9940cf4f0 0x7fe9941f1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.239+0000 7fe99a4d5640 1 -- 172.21.15.38:0/2573516166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe990009400 con 0x7fe994146690 2023-12-22T08:46:15.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.239+0000 7fe99a4d5640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe994146690 0x7fe99406cd00 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00cae0 tx=0x7fe98c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:15.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.240+0000 7fe98a7fc640 1 -- 172.21.15.38:0/2573516166 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c00ac40 con 0x7fe994146690 2023-12-22T08:46:15.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.240+0000 7fe98a7fc640 1 -- 172.21.15.38:0/2573516166 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c00ada0 con 0x7fe994146690 2023-12-22T08:46:15.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.240+0000 7fe99acd6640 1 -- 172.21.15.38:0/2573516166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9941e2ee0 con 0x7fe994146690 2023-12-22T08:46:15.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.240+0000 7fe98a7fc640 1 -- 172.21.15.38:0/2573516166 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c012620 con 0x7fe994146690 2023-12-22T08:46:15.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.240+0000 7fe99acd6640 1 -- 172.21.15.38:0/2573516166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9941e34a0 con 0x7fe994146690 2023-12-22T08:46:15.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.241+0000 7fe99acd6640 1 -- 172.21.15.38:0/2573516166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9941e4630 con 0x7fe994146690 2023-12-22T08:46:15.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.242+0000 7fe98a7fc640 1 -- 172.21.15.38:0/2573516166 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe98c007070 con 0x7fe994146690 2023-12-22T08:46:15.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.243+0000 7fe98a7fc640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe97806a480 0x7fe97806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.243+0000 7fe98a7fc640 1 -- 172.21.15.38:0/2573516166 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe98c088860 con 0x7fe994146690 2023-12-22T08:46:15.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.243+0000 7fe999cd4640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe97806a480 0x7fe97806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.245+0000 7fe999cd4640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe97806a480 0x7fe97806c940 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe990036000 tx=0x7fe99003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:15.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.247+0000 7fe98a7fc640 1 -- 172.21.15.38:0/2573516166 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe9941e4630 con 0x7fe994146690 2023-12-22T08:46:15.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.434+0000 7fe99acd6640 1 -- 172.21.15.38:0/2573516166 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9940b1110 con 0x7fe97806a480 2023-12-22T08:46:15.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.458+0000 7fe98a7fc640 1 -- 172.21.15.38:0/2573516166 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283036 (secure 0 0 0) 0x7fe990044400 con 0x7fe97806a480 2023-12-22T08:46:15.462 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:15.466 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:46:15.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.465+0000 7fe99acd6640 1 -- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe97806a480 msgr2=0x7fe97806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.465+0000 7fe99acd6640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe97806a480 0x7fe97806c940 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe990036000 tx=0x7fe99003c040 comp rx=0 tx=0).stop 2023-12-22T08:46:15.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.465+0000 7fe99acd6640 1 -- 172.21.15.38:0/2573516166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe994146690 msgr2=0x7fe99406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.465+0000 7fe99acd6640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe994146690 0x7fe99406cd00 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00cae0 tx=0x7fe98c00a060 comp rx=0 tx=0).stop 2023-12-22T08:46:15.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.465+0000 7fe99acd6640 1 -- 172.21.15.38:0/2573516166 shutdown_connections 2023-12-22T08:46:15.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.465+0000 7fe99acd6640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe97806a480 0x7fe97806c940 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.465+0000 7fe99acd6640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe994146690 0x7fe99406cd00 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.465+0000 7fe99acd6640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9940cf4f0 0x7fe9941f1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.465+0000 7fe99acd6640 1 --2- 172.21.15.38:0/2573516166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9940b0ca0 0x7fe9941e26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.465+0000 7fe99acd6640 1 -- 172.21.15.38:0/2573516166 >> 172.21.15.38:0/2573516166 conn(0x7fe994060720 msgr2=0x7fe9940cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:15.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.465+0000 7fe99acd6640 1 -- 172.21.15.38:0/2573516166 shutdown_connections 2023-12-22T08:46:15.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.465+0000 7fe99acd6640 1 -- 172.21.15.38:0/2573516166 wait complete. 2023-12-22T08:46:15.472 INFO:tasks.ceph.mds.a.smithi038.stderr:2023-12-22T08:46:15.471+0000 7fea553e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:46:15.486 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2023-12-22T08:46:14.493518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5817,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556682,"statfs":{"total":1600000000,"available":1594043267,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.989284"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.042645+0000","last_change":"2023-12-22T08:46:11.042519+0000","last_active":"2023-12-22T08:46:11.042645+0000","last_peered":"2023-12-22T08:46:11.042645+0000","last_clean":"2023-12-22T08:46:11.042645+0000","last_became_active":"2023-12-22T08:46:11.042206+0000","last_became_peered":"2023-12-22T08:46:11.042206+0000","last_unstale":"2023-12-22T08:46:11.042645+0000","last_undegraded":"2023-12-22T08:46:11.042645+0000","last_fullsized":"2023-12-22T08:46:11.042645+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:51:25.597889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024295+0000","last_change":"2023-12-22T08:46:11.041501+0000","last_active":"2023-12-22T08:46:12.024295+0000","last_peered":"2023-12-22T08:46:12.024295+0000","last_clean":"2023-12-22T08:46:12.024295+0000","last_became_active":"2023-12-22T08:46:11.040876+0000","last_became_peered":"2023-12-22T08:46:11.040876+0000","last_unstale":"2023-12-22T08:46:12.024295+0000","last_undegraded":"2023-12-22T08:46:12.024295+0000","last_fullsized":"2023-12-22T08:46:12.024295+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:51.163696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.033891+0000","last_change":"2023-12-22T08:46:11.031617+0000","last_active":"2023-12-22T08:46:11.033891+0000","last_peered":"2023-12-22T08:46:11.033891+0000","last_clean":"2023-12-22T08:46:11.033891+0000","last_became_active":"2023-12-22T08:46:11.031391+0000","last_became_peered":"2023-12-22T08:46:11.031391+0000","last_unstale":"2023-12-22T08:46:11.033891+0000","last_undegraded":"2023-12-22T08:46:11.033891+0000","last_fullsized":"2023-12-22T08:46:11.033891+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:36:10.900466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.044106+0000","last_change":"2023-12-22T08:46:11.039823+0000","last_active":"2023-12-22T08:46:11.044106+0000","last_peered":"2023-12-22T08:46:11.044106+0000","last_clean":"2023-12-22T08:46:11.044106+0000","last_became_active":"2023-12-22T08:46:11.039333+0000","last_became_peered":"2023-12-22T08:46:11.039333+0000","last_unstale":"2023-12-22T08:46:11.044106+0000","last_undegraded":"2023-12-22T08:46:11.044106+0000","last_fullsized":"2023-12-22T08:46:11.044106+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:28.575655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.393028+0000","last_change":"2023-12-22T08:46:11.044225+0000","last_active":"2023-12-22T08:46:13.393028+0000","last_peered":"2023-12-22T08:46:13.393028+0000","last_clean":"2023-12-22T08:46:13.393028+0000","last_became_active":"2023-12-22T08:46:11.043929+0000","last_became_peered":"2023-12-22T08:46:11.043929+0000","last_unstale":"2023-12-22T08:46:13.393028+0000","last_undegraded":"2023-12-22T08:46:13.393028+0000","last_fullsized":"2023-12-22T08:46:13.393028+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:09:16.593565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048213+0000","last_change":"2023-12-22T08:46:11.048143+0000","last_active":"2023-12-22T08:46:11.048213+0000","last_peered":"2023-12-22T08:46:11.048213+0000","last_clean":"2023-12-22T08:46:11.048213+0000","last_became_active":"2023-12-22T08:46:11.046825+0000","last_became_peered":"2023-12-22T08:46:11.046825+0000","last_unstale":"2023-12-22T08:46:11.048213+0000","last_undegraded":"2023-12-22T08:46:11.048213+0000","last_fullsized":"2023-12-22T08:46:11.048213+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:01:34.613784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024742+0000","last_change":"2023-12-22T08:46:11.041315+0000","last_active":"2023-12-22T08:46:12.024742+0000","last_peered":"2023-12-22T08:46:12.024742+0000","last_clean":"2023-12-22T08:46:12.024742+0000","last_became_active":"2023-12-22T08:46:11.039843+0000","last_became_peered":"2023-12-22T08:46:11.039843+0000","last_unstale":"2023-12-22T08:46:12.024742+0000","last_undegraded":"2023-12-22T08:46:12.024742+0000","last_fullsized":"2023-12-22T08:46:12.024742+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:24.020932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.053811+0000","last_change":"2023-12-22T08:46:11.053472+0000","last_active":"2023-12-22T08:46:11.053811+0000","last_peered":"2023-12-22T08:46:11.053811+0000","last_clean":"2023-12-22T08:46:11.053811+0000","last_became_active":"2023-12-22T08:46:11.051122+0000","last_became_peered":"2023-12-22T08:46:11.051122+0000","last_unstale":"2023-12-22T08:46:11.053811+0000","last_undegraded":"2023-12-22T08:46:11.053811+0000","last_fullsized":"2023-12-22T08:46:11.053811+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:37:16.118123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.051165+0000","last_change":"2023-12-22T08:46:11.051075+0000","last_active":"2023-12-22T08:46:11.051165+0000","last_peered":"2023-12-22T08:46:11.051165+0000","last_clean":"2023-12-22T08:46:11.051165+0000","last_became_active":"2023-12-22T08:46:11.049819+0000","last_became_peered":"2023-12-22T08:46:11.049819+0000","last_unstale":"2023-12-22T08:46:11.051165+0000","last_undegraded":"2023-12-22T08:46:11.051165+0000","last_fullsized":"2023-12-22T08:46:11.051165+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:41.251857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.045500+0000","last_change":"2023-12-22T08:46:11.045409+0000","last_active":"2023-12-22T08:46:11.045500+0000","last_peered":"2023-12-22T08:46:11.045500+0000","last_clean":"2023-12-22T08:46:11.045500+0000","last_became_active":"2023-12-22T08:46:11.043779+0000","last_became_peered":"2023-12-22T08:46:11.043779+0000","last_unstale":"2023-12-22T08:46:11.045500+0000","last_undegraded":"2023-12-22T08:46:11.045500+0000","last_fullsized":"2023-12-22T08:46:11.045500+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:03.877163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.028962+0000","last_change":"2023-12-22T08:46:11.043255+0000","last_active":"2023-12-22T08:46:12.028962+0000","last_peered":"2023-12-22T08:46:12.028962+0000","last_clean":"2023-12-22T08:46:12.028962+0000","last_became_active":"2023-12-22T08:46:11.034411+0000","last_became_peered":"2023-12-22T08:46:11.034411+0000","last_unstale":"2023-12-22T08:46:12.028962+0000","last_undegraded":"2023-12-22T08:46:12.028962+0000","last_fullsized":"2023-12-22T08:46:12.028962+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:41.251857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.051655+0000","last_change":"2023-12-22T08:46:11.051512+0000","last_active":"2023-12-22T08:46:11.051655+0000","last_peered":"2023-12-22T08:46:11.051655+0000","last_clean":"2023-12-22T08:46:11.051655+0000","last_became_active":"2023-12-22T08:46:11.050303+0000","last_became_peered":"2023-12-22T08:46:11.050303+0000","last_unstale":"2023-12-22T08:46:11.051655+0000","last_undegraded":"2023-12-22T08:46:11.051655+0000","last_fullsized":"2023-12-22T08:46:11.051655+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:25:43.481886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.392376+0000","last_change":"2023-12-22T08:46:11.034063+0000","last_active":"2023-12-22T08:46:13.392376+0000","last_peered":"2023-12-22T08:46:13.392376+0000","last_clean":"2023-12-22T08:46:13.392376+0000","last_became_active":"2023-12-22T08:46:11.032875+0000","last_became_peered":"2023-12-22T08:46:11.032875+0000","last_unstale":"2023-12-22T08:46:13.392376+0000","last_undegraded":"2023-12-22T08:46:13.392376+0000","last_fullsized":"2023-12-22T08:46:13.392376+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:18:17.194704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026170+0000","last_change":"2023-12-22T08:46:11.057155+0000","last_active":"2023-12-22T08:46:12.026170+0000","last_peered":"2023-12-22T08:46:12.026170+0000","last_clean":"2023-12-22T08:46:12.026170+0000","last_became_active":"2023-12-22T08:46:11.056608+0000","last_became_peered":"2023-12-22T08:46:11.056608+0000","last_unstale":"2023-12-22T08:46:12.026170+0000","last_undegraded":"2023-12-22T08:46:12.026170+0000","last_fullsized":"2023-12-22T08:46:12.026170+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:40.788407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024635+0000","last_change":"2023-12-22T08:46:11.056300+0000","last_active":"2023-12-22T08:46:12.024635+0000","last_peered":"2023-12-22T08:46:12.024635+0000","last_clean":"2023-12-22T08:46:12.024635+0000","last_became_active":"2023-12-22T08:46:11.055686+0000","last_became_peered":"2023-12-22T08:46:11.055686+0000","last_unstale":"2023-12-22T08:46:12.024635+0000","last_undegraded":"2023-12-22T08:46:12.024635+0000","last_fullsized":"2023-12-22T08:46:12.024635+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:28.575655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.032879+0000","last_change":"2023-12-22T08:46:11.032609+0000","last_active":"2023-12-22T08:46:11.032879+0000","last_peered":"2023-12-22T08:46:11.032879+0000","last_clean":"2023-12-22T08:46:11.032879+0000","last_became_active":"2023-12-22T08:46:11.032391+0000","last_became_peered":"2023-12-22T08:46:11.032391+0000","last_unstale":"2023-12-22T08:46:11.032879+0000","last_undegraded":"2023-12-22T08:46:11.032879+0000","last_fullsized":"2023-12-22T08:46:11.032879+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:52:00.531522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.051637+0000","last_change":"2023-12-22T08:46:11.051159+0000","last_active":"2023-12-22T08:46:11.051637+0000","last_peered":"2023-12-22T08:46:11.051637+0000","last_clean":"2023-12-22T08:46:11.051637+0000","last_became_active":"2023-12-22T08:46:11.049733+0000","last_became_peered":"2023-12-22T08:46:11.049733+0000","last_unstale":"2023-12-22T08:46:11.051637+0000","last_undegraded":"2023-12-22T08:46:11.051637+0000","last_fullsized":"2023-12-22T08:46:11.051637+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:09.504250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027766+0000","last_change":"2023-12-22T08:46:11.049880+0000","last_active":"2023-12-22T08:46:12.027766+0000","last_peered":"2023-12-22T08:46:12.027766+0000","last_clean":"2023-12-22T08:46:12.027766+0000","last_became_active":"2023-12-22T08:46:11.049216+0000","last_became_peered":"2023-12-22T08:46:11.049216+0000","last_unstale":"2023-12-22T08:46:12.027766+0000","last_undegraded":"2023-12-22T08:46:12.027766+0000","last_fullsized":"2023-12-22T08:46:12.027766+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:40.788407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026434+0000","last_change":"2023-12-22T08:46:11.057305+0000","last_active":"2023-12-22T08:46:12.026434+0000","last_peered":"2023-12-22T08:46:12.026434+0000","last_clean":"2023-12-22T08:46:12.026434+0000","last_became_active":"2023-12-22T08:46:11.056917+0000","last_became_peered":"2023-12-22T08:46:11.056917+0000","last_unstale":"2023-12-22T08:46:12.026434+0000","last_undegraded":"2023-12-22T08:46:12.026434+0000","last_fullsized":"2023-12-22T08:46:12.026434+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:51:25.597889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027407+0000","last_change":"2023-12-22T08:46:11.055914+0000","last_active":"2023-12-22T08:46:12.027407+0000","last_peered":"2023-12-22T08:46:12.027407+0000","last_clean":"2023-12-22T08:46:12.027407+0000","last_became_active":"2023-12-22T08:46:11.055686+0000","last_became_peered":"2023-12-22T08:46:11.055686+0000","last_unstale":"2023-12-22T08:46:12.027407+0000","last_undegraded":"2023-12-22T08:46:12.027407+0000","last_fullsized":"2023-12-22T08:46:12.027407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:49:16.929281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048632+0000","last_change":"2023-12-22T08:46:11.045608+0000","last_active":"2023-12-22T08:46:11.048632+0000","last_peered":"2023-12-22T08:46:11.048632+0000","last_clean":"2023-12-22T08:46:11.048632+0000","last_became_active":"2023-12-22T08:46:11.045307+0000","last_became_peered":"2023-12-22T08:46:11.045307+0000","last_unstale":"2023-12-22T08:46:11.048632+0000","last_undegraded":"2023-12-22T08:46:11.048632+0000","last_fullsized":"2023-12-22T08:46:11.048632+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:51.163696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.028238+0000","last_change":"2023-12-22T08:46:11.054792+0000","last_active":"2023-12-22T08:46:12.028238+0000","last_peered":"2023-12-22T08:46:12.028238+0000","last_clean":"2023-12-22T08:46:12.028238+0000","last_became_active":"2023-12-22T08:46:11.053145+0000","last_became_peered":"2023-12-22T08:46:11.053145+0000","last_unstale":"2023-12-22T08:46:12.028238+0000","last_undegraded":"2023-12-22T08:46:12.028238+0000","last_fullsized":"2023-12-22T08:46:12.028238+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:46.906772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.049112+0000","last_change":"2023-12-22T08:46:11.049027+0000","last_active":"2023-12-22T08:46:11.049112+0000","last_peered":"2023-12-22T08:46:11.049112+0000","last_clean":"2023-12-22T08:46:11.049112+0000","last_became_active":"2023-12-22T08:46:11.048786+0000","last_became_peered":"2023-12-22T08:46:11.048786+0000","last_unstale":"2023-12-22T08:46:11.049112+0000","last_undegraded":"2023-12-22T08:46:11.049112+0000","last_fullsized":"2023-12-22T08:46:11.049112+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:32.952933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026754+0000","last_change":"2023-12-22T08:46:11.046272+0000","last_active":"2023-12-22T08:46:12.026754+0000","last_peered":"2023-12-22T08:46:12.026754+0000","last_clean":"2023-12-22T08:46:12.026754+0000","last_became_active":"2023-12-22T08:46:11.046029+0000","last_became_peered":"2023-12-22T08:46:11.046029+0000","last_unstale":"2023-12-22T08:46:12.026754+0000","last_undegraded":"2023-12-22T08:46:12.026754+0000","last_fullsized":"2023-12-22T08:46:12.026754+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:44:02.430317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.029580+0000","last_change":"2023-12-22T08:46:11.029694+0000","last_active":"2023-12-22T08:46:12.029580+0000","last_peered":"2023-12-22T08:46:12.029580+0000","last_clean":"2023-12-22T08:46:12.029580+0000","last_became_active":"2023-12-22T08:46:11.029047+0000","last_became_peered":"2023-12-22T08:46:11.029047+0000","last_unstale":"2023-12-22T08:46:12.029580+0000","last_undegraded":"2023-12-22T08:46:12.029580+0000","last_fullsized":"2023-12-22T08:46:12.029580+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:47.914410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.392773+0000","last_change":"2023-12-22T08:46:11.037301+0000","last_active":"2023-12-22T08:46:13.392773+0000","last_peered":"2023-12-22T08:46:13.392773+0000","last_clean":"2023-12-22T08:46:13.392773+0000","last_became_active":"2023-12-22T08:46:11.036887+0000","last_became_peered":"2023-12-22T08:46:11.036887+0000","last_unstale":"2023-12-22T08:46:13.392773+0000","last_undegraded":"2023-12-22T08:46:13.392773+0000","last_fullsized":"2023-12-22T08:46:13.392773+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:20.635968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.392675+0000","last_change":"2023-12-22T08:46:11.045165+0000","last_active":"2023-12-22T08:46:13.392675+0000","last_peered":"2023-12-22T08:46:13.392675+0000","last_clean":"2023-12-22T08:46:13.392675+0000","last_became_active":"2023-12-22T08:46:11.044591+0000","last_became_peered":"2023-12-22T08:46:11.044591+0000","last_unstale":"2023-12-22T08:46:13.392675+0000","last_undegraded":"2023-12-22T08:46:13.392675+0000","last_fullsized":"2023-12-22T08:46:13.392675+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:03:57.979012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.037607+0000","last_change":"2023-12-22T08:46:11.037345+0000","last_active":"2023-12-22T08:46:11.037607+0000","last_peered":"2023-12-22T08:46:11.037607+0000","last_clean":"2023-12-22T08:46:11.037607+0000","last_became_active":"2023-12-22T08:46:11.036529+0000","last_became_peered":"2023-12-22T08:46:11.036529+0000","last_unstale":"2023-12-22T08:46:11.037607+0000","last_undegraded":"2023-12-22T08:46:11.037607+0000","last_fullsized":"2023-12-22T08:46:11.037607+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:14:22.771654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.049858+0000","last_change":"2023-12-22T08:46:11.049412+0000","last_active":"2023-12-22T08:46:11.049858+0000","last_peered":"2023-12-22T08:46:11.049858+0000","last_clean":"2023-12-22T08:46:11.049858+0000","last_became_active":"2023-12-22T08:46:11.048533+0000","last_became_peered":"2023-12-22T08:46:11.048533+0000","last_unstale":"2023-12-22T08:46:11.049858+0000","last_undegraded":"2023-12-22T08:46:11.049858+0000","last_fullsized":"2023-12-22T08:46:11.049858+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:24.020932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027199+0000","last_change":"2023-12-22T08:46:11.053979+0000","last_active":"2023-12-22T08:46:12.027199+0000","last_peered":"2023-12-22T08:46:12.027199+0000","last_clean":"2023-12-22T08:46:12.027199+0000","last_became_active":"2023-12-22T08:46:11.053739+0000","last_became_peered":"2023-12-22T08:46:11.053739+0000","last_unstale":"2023-12-22T08:46:12.027199+0000","last_undegraded":"2023-12-22T08:46:12.027199+0000","last_fullsized":"2023-12-22T08:46:12.027199+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:11:34.215769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048094+0000","last_change":"2023-12-22T08:46:11.047688+0000","last_active":"2023-12-22T08:46:11.048094+0000","last_peered":"2023-12-22T08:46:11.048094+0000","last_clean":"2023-12-22T08:46:11.048094+0000","last_became_active":"2023-12-22T08:46:11.045738+0000","last_became_peered":"2023-12-22T08:46:11.045738+0000","last_unstale":"2023-12-22T08:46:11.048094+0000","last_undegraded":"2023-12-22T08:46:11.048094+0000","last_fullsized":"2023-12-22T08:46:11.048094+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:31.174659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048372+0000","last_change":"2023-12-22T08:46:11.048294+0000","last_active":"2023-12-22T08:46:11.048372+0000","last_peered":"2023-12-22T08:46:11.048372+0000","last_clean":"2023-12-22T08:46:11.048372+0000","last_became_active":"2023-12-22T08:46:11.047009+0000","last_became_peered":"2023-12-22T08:46:11.047009+0000","last_unstale":"2023-12-22T08:46:11.048372+0000","last_undegraded":"2023-12-22T08:46:11.048372+0000","last_fullsized":"2023-12-22T08:46:11.048372+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:02:30.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.041479+0000","last_change":"2023-12-22T08:46:11.039402+0000","last_active":"2023-12-22T08:46:11.041479+0000","last_peered":"2023-12-22T08:46:11.041479+0000","last_clean":"2023-12-22T08:46:11.041479+0000","last_became_active":"2023-12-22T08:46:11.039116+0000","last_became_peered":"2023-12-22T08:46:11.039116+0000","last_unstale":"2023-12-22T08:46:11.041479+0000","last_undegraded":"2023-12-22T08:46:11.041479+0000","last_fullsized":"2023-12-22T08:46:11.041479+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:27:08.201555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"109'4","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.393574+0000","last_change":"2023-12-22T08:46:10.519168+0000","last_active":"2023-12-22T08:46:13.393574+0000","last_peered":"2023-12-22T08:46:13.393574+0000","last_clean":"2023-12-22T08:46:13.393574+0000","last_became_active":"2023-12-22T08:46:10.518506+0000","last_became_peered":"2023-12-22T08:46:10.518506+0000","last_unstale":"2023-12-22T08:46:13.393574+0000","last_undegraded":"2023-12-22T08:46:13.393574+0000","last_fullsized":"2023-12-22T08:46:13.393574+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:26.990460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.041406+0000","last_change":"2023-12-22T08:46:11.040121+0000","last_active":"2023-12-22T08:46:11.041406+0000","last_peered":"2023-12-22T08:46:11.041406+0000","last_clean":"2023-12-22T08:46:11.041406+0000","last_became_active":"2023-12-22T08:46:11.039740+0000","last_became_peered":"2023-12-22T08:46:11.039740+0000","last_unstale":"2023-12-22T08:46:11.041406+0000","last_undegraded":"2023-12-22T08:46:11.041406+0000","last_fullsized":"2023-12-22T08:46:11.041406+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:40.788407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"109'1","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048719+0000","last_change":"2023-12-22T08:46:10.542385+0000","last_active":"2023-12-22T08:46:11.048719+0000","last_peered":"2023-12-22T08:46:11.048719+0000","last_clean":"2023-12-22T08:46:11.048719+0000","last_became_active":"2023-12-22T08:46:10.542183+0000","last_became_peered":"2023-12-22T08:46:10.542183+0000","last_unstale":"2023-12-22T08:46:11.048719+0000","last_undegraded":"2023-12-22T08:46:11.048719+0000","last_fullsized":"2023-12-22T08:46:11.048719+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:08.489668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.053344+0000","last_change":"2023-12-22T08:46:11.053235+0000","last_active":"2023-12-22T08:46:11.053344+0000","last_peered":"2023-12-22T08:46:11.053344+0000","last_clean":"2023-12-22T08:46:11.053344+0000","last_became_active":"2023-12-22T08:46:11.052905+0000","last_became_peered":"2023-12-22T08:46:11.052905+0000","last_unstale":"2023-12-22T08:46:11.053344+0000","last_undegraded":"2023-12-22T08:46:11.053344+0000","last_fullsized":"2023-12-22T08:46:11.053344+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:05:28.593431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.029887+0000","last_change":"2023-12-22T08:46:10.537623+0000","last_active":"2023-12-22T08:46:12.029887+0000","last_peered":"2023-12-22T08:46:12.029887+0000","last_clean":"2023-12-22T08:46:12.029887+0000","last_became_active":"2023-12-22T08:46:10.536888+0000","last_became_peered":"2023-12-22T08:46:10.536888+0000","last_unstale":"2023-12-22T08:46:12.029887+0000","last_undegraded":"2023-12-22T08:46:12.029887+0000","last_fullsized":"2023-12-22T08:46:12.029887+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:50.237711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.049237+0000","last_change":"2023-12-22T08:46:11.049177+0000","last_active":"2023-12-22T08:46:11.049237+0000","last_peered":"2023-12-22T08:46:11.049237+0000","last_clean":"2023-12-22T08:46:11.049237+0000","last_became_active":"2023-12-22T08:46:11.048693+0000","last_became_peered":"2023-12-22T08:46:11.048693+0000","last_unstale":"2023-12-22T08:46:11.049237+0000","last_undegraded":"2023-12-22T08:46:11.049237+0000","last_fullsized":"2023-12-22T08:46:11.049237+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:31:11.707403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"109'2","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.053164+0000","last_change":"2023-12-22T08:46:10.526784+0000","last_active":"2023-12-22T08:46:11.053164+0000","last_peered":"2023-12-22T08:46:11.053164+0000","last_clean":"2023-12-22T08:46:11.053164+0000","last_became_active":"2023-12-22T08:46:10.525921+0000","last_became_peered":"2023-12-22T08:46:10.525921+0000","last_unstale":"2023-12-22T08:46:11.053164+0000","last_undegraded":"2023-12-22T08:46:11.053164+0000","last_fullsized":"2023-12-22T08:46:11.053164+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:50:06.237184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048687+0000","last_change":"2023-12-22T08:46:11.048338+0000","last_active":"2023-12-22T08:46:11.048687+0000","last_peered":"2023-12-22T08:46:11.048687+0000","last_clean":"2023-12-22T08:46:11.048687+0000","last_became_active":"2023-12-22T08:46:11.047981+0000","last_became_peered":"2023-12-22T08:46:11.047981+0000","last_unstale":"2023-12-22T08:46:11.048687+0000","last_undegraded":"2023-12-22T08:46:11.048687+0000","last_fullsized":"2023-12-22T08:46:11.048687+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:11.510313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"109'1","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.044280+0000","last_change":"2023-12-22T08:46:10.536129+0000","last_active":"2023-12-22T08:46:11.044280+0000","last_peered":"2023-12-22T08:46:11.044280+0000","last_clean":"2023-12-22T08:46:11.044280+0000","last_became_active":"2023-12-22T08:46:10.535598+0000","last_became_peered":"2023-12-22T08:46:10.535598+0000","last_unstale":"2023-12-22T08:46:11.044280+0000","last_undegraded":"2023-12-22T08:46:11.044280+0000","last_fullsized":"2023-12-22T08:46:11.044280+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:40.237275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048586+0000","last_change":"2023-12-22T08:46:11.048495+0000","last_active":"2023-12-22T08:46:11.048586+0000","last_peered":"2023-12-22T08:46:11.048586+0000","last_clean":"2023-12-22T08:46:11.048586+0000","last_became_active":"2023-12-22T08:46:11.047866+0000","last_became_peered":"2023-12-22T08:46:11.047866+0000","last_unstale":"2023-12-22T08:46:11.048586+0000","last_undegraded":"2023-12-22T08:46:11.048586+0000","last_fullsized":"2023-12-22T08:46:11.048586+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:38.806422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"109'1","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.053180+0000","last_change":"2023-12-22T08:46:10.527943+0000","last_active":"2023-12-22T08:46:11.053180+0000","last_peered":"2023-12-22T08:46:11.053180+0000","last_clean":"2023-12-22T08:46:11.053180+0000","last_became_active":"2023-12-22T08:46:10.527183+0000","last_became_peered":"2023-12-22T08:46:10.527183+0000","last_unstale":"2023-12-22T08:46:11.053180+0000","last_undegraded":"2023-12-22T08:46:11.053180+0000","last_fullsized":"2023-12-22T08:46:11.053180+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:30:02.506914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.049118+0000","last_change":"2023-12-22T08:46:11.049045+0000","last_active":"2023-12-22T08:46:11.049118+0000","last_peered":"2023-12-22T08:46:11.049118+0000","last_clean":"2023-12-22T08:46:11.049118+0000","last_became_active":"2023-12-22T08:46:11.048341+0000","last_became_peered":"2023-12-22T08:46:11.048341+0000","last_unstale":"2023-12-22T08:46:11.049118+0000","last_undegraded":"2023-12-22T08:46:11.049118+0000","last_fullsized":"2023-12-22T08:46:11.049118+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:42:25.840694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027097+0000","last_change":"2023-12-22T08:46:10.544131+0000","last_active":"2023-12-22T08:46:12.027097+0000","last_peered":"2023-12-22T08:46:12.027097+0000","last_clean":"2023-12-22T08:46:12.027097+0000","last_became_active":"2023-12-22T08:46:10.543727+0000","last_became_peered":"2023-12-22T08:46:10.543727+0000","last_unstale":"2023-12-22T08:46:12.027097+0000","last_undegraded":"2023-12-22T08:46:12.027097+0000","last_fullsized":"2023-12-22T08:46:12.027097+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:12:08.681748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026677+0000","last_change":"2023-12-22T08:46:11.043823+0000","last_active":"2023-12-22T08:46:12.026677+0000","last_peered":"2023-12-22T08:46:12.026677+0000","last_clean":"2023-12-22T08:46:12.026677+0000","last_became_active":"2023-12-22T08:46:11.041943+0000","last_became_peered":"2023-12-22T08:46:11.041943+0000","last_unstale":"2023-12-22T08:46:12.026677+0000","last_undegraded":"2023-12-22T08:46:12.026677+0000","last_fullsized":"2023-12-22T08:46:12.026677+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:41.251857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027589+0000","last_change":"2023-12-22T08:46:10.544851+0000","last_active":"2023-12-22T08:46:12.027589+0000","last_peered":"2023-12-22T08:46:12.027589+0000","last_clean":"2023-12-22T08:46:12.027589+0000","last_became_active":"2023-12-22T08:46:10.544318+0000","last_became_peered":"2023-12-22T08:46:10.544318+0000","last_unstale":"2023-12-22T08:46:12.027589+0000","last_undegraded":"2023-12-22T08:46:12.027589+0000","last_fullsized":"2023-12-22T08:46:12.027589+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:30:48.146204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027916+0000","last_change":"2023-12-22T08:46:11.054579+0000","last_active":"2023-12-22T08:46:12.027916+0000","last_peered":"2023-12-22T08:46:12.027916+0000","last_clean":"2023-12-22T08:46:12.027916+0000","last_became_active":"2023-12-22T08:46:11.052397+0000","last_became_peered":"2023-12-22T08:46:11.052397+0000","last_unstale":"2023-12-22T08:46:12.027916+0000","last_undegraded":"2023-12-22T08:46:12.027916+0000","last_fullsized":"2023-12-22T08:46:12.027916+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:04:12.172382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.035216+0000","last_change":"2023-12-22T08:46:10.540176+0000","last_active":"2023-12-22T08:46:11.035216+0000","last_peered":"2023-12-22T08:46:11.035216+0000","last_clean":"2023-12-22T08:46:11.035216+0000","last_became_active":"2023-12-22T08:46:10.539548+0000","last_became_peered":"2023-12-22T08:46:10.539548+0000","last_unstale":"2023-12-22T08:46:11.035216+0000","last_undegraded":"2023-12-22T08:46:11.035216+0000","last_fullsized":"2023-12-22T08:46:11.035216+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:45:20.212930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.047685+0000","last_change":"2023-12-22T08:46:11.047211+0000","last_active":"2023-12-22T08:46:11.047685+0000","last_peered":"2023-12-22T08:46:11.047685+0000","last_clean":"2023-12-22T08:46:11.047685+0000","last_became_active":"2023-12-22T08:46:11.046958+0000","last_became_peered":"2023-12-22T08:46:11.046958+0000","last_unstale":"2023-12-22T08:46:11.047685+0000","last_undegraded":"2023-12-22T08:46:11.047685+0000","last_fullsized":"2023-12-22T08:46:11.047685+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:07:38.207334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.029838+0000","last_change":"2023-12-22T08:46:10.538381+0000","last_active":"2023-12-22T08:46:11.029838+0000","last_peered":"2023-12-22T08:46:11.029838+0000","last_clean":"2023-12-22T08:46:11.029838+0000","last_became_active":"2023-12-22T08:46:10.537776+0000","last_became_peered":"2023-12-22T08:46:10.537776+0000","last_unstale":"2023-12-22T08:46:11.029838+0000","last_undegraded":"2023-12-22T08:46:11.029838+0000","last_fullsized":"2023-12-22T08:46:11.029838+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:17:57.950255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026941+0000","last_change":"2023-12-22T08:46:11.035928+0000","last_active":"2023-12-22T08:46:12.026941+0000","last_peered":"2023-12-22T08:46:12.026941+0000","last_clean":"2023-12-22T08:46:12.026941+0000","last_became_active":"2023-12-22T08:46:11.031662+0000","last_became_peered":"2023-12-22T08:46:11.031662+0000","last_unstale":"2023-12-22T08:46:12.026941+0000","last_undegraded":"2023-12-22T08:46:12.026941+0000","last_fullsized":"2023-12-22T08:46:12.026941+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:02.869321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"109'3","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.046740+0000","last_change":"2023-12-22T08:46:10.540184+0000","last_active":"2023-12-22T08:46:11.046740+0000","last_peered":"2023-12-22T08:46:11.046740+0000","last_clean":"2023-12-22T08:46:11.046740+0000","last_became_active":"2023-12-22T08:46:10.539295+0000","last_became_peered":"2023-12-22T08:46:10.539295+0000","last_unstale":"2023-12-22T08:46:11.046740+0000","last_undegraded":"2023-12-22T08:46:11.046740+0000","last_fullsized":"2023-12-22T08:46:11.046740+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:52:11.740354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.392627+0000","last_change":"2023-12-22T08:46:11.044645+0000","last_active":"2023-12-22T08:46:13.392627+0000","last_peered":"2023-12-22T08:46:13.392627+0000","last_clean":"2023-12-22T08:46:13.392627+0000","last_became_active":"2023-12-22T08:46:11.044135+0000","last_became_peered":"2023-12-22T08:46:11.044135+0000","last_unstale":"2023-12-22T08:46:13.392627+0000","last_undegraded":"2023-12-22T08:46:13.392627+0000","last_fullsized":"2023-12-22T08:46:13.392627+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:12.676435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"109'6","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.055481+0000","last_change":"2023-12-22T08:46:10.542699+0000","last_active":"2023-12-22T08:46:11.055481+0000","last_peered":"2023-12-22T08:46:11.055481+0000","last_clean":"2023-12-22T08:46:11.055481+0000","last_became_active":"2023-12-22T08:46:10.541103+0000","last_became_peered":"2023-12-22T08:46:10.541103+0000","last_unstale":"2023-12-22T08:46:11.055481+0000","last_undegraded":"2023-12-22T08:46:11.055481+0000","last_fullsized":"2023-12-22T08:46:11.055481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:51:24.583307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.029167+0000","last_change":"2023-12-22T08:46:11.048774+0000","last_active":"2023-12-22T08:46:12.029167+0000","last_peered":"2023-12-22T08:46:12.029167+0000","last_clean":"2023-12-22T08:46:12.029167+0000","last_became_active":"2023-12-22T08:46:11.048555+0000","last_became_peered":"2023-12-22T08:46:11.048555+0000","last_unstale":"2023-12-22T08:46:12.029167+0000","last_undegraded":"2023-12-22T08:46:12.029167+0000","last_fullsized":"2023-12-22T08:46:12.029167+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:51:25.597889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"109'2","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.057005+0000","last_change":"2023-12-22T08:46:10.530290+0000","last_active":"2023-12-22T08:46:11.057005+0000","last_peered":"2023-12-22T08:46:11.057005+0000","last_clean":"2023-12-22T08:46:11.057005+0000","last_became_active":"2023-12-22T08:46:10.529662+0000","last_became_peered":"2023-12-22T08:46:10.529662+0000","last_unstale":"2023-12-22T08:46:11.057005+0000","last_undegraded":"2023-12-22T08:46:11.057005+0000","last_fullsized":"2023-12-22T08:46:11.057005+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:27:56.461932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048971+0000","last_change":"2023-12-22T08:46:11.048895+0000","last_active":"2023-12-22T08:46:11.048971+0000","last_peered":"2023-12-22T08:46:11.048971+0000","last_clean":"2023-12-22T08:46:11.048971+0000","last_became_active":"2023-12-22T08:46:11.046395+0000","last_became_peered":"2023-12-22T08:46:11.046395+0000","last_unstale":"2023-12-22T08:46:11.048971+0000","last_undegraded":"2023-12-22T08:46:11.048971+0000","last_fullsized":"2023-12-22T08:46:11.048971+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:11:34.215769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024514+0000","last_change":"2023-12-22T08:46:10.536329+0000","last_active":"2023-12-22T08:46:12.024514+0000","last_peered":"2023-12-22T08:46:12.024514+0000","last_clean":"2023-12-22T08:46:12.024514+0000","last_became_active":"2023-12-22T08:46:10.535469+0000","last_became_peered":"2023-12-22T08:46:10.535469+0000","last_unstale":"2023-12-22T08:46:12.024514+0000","last_undegraded":"2023-12-22T08:46:12.024514+0000","last_fullsized":"2023-12-22T08:46:12.024514+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:17:57.950255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026179+0000","last_change":"2023-12-22T08:46:11.053902+0000","last_active":"2023-12-22T08:46:12.026179+0000","last_peered":"2023-12-22T08:46:12.026179+0000","last_clean":"2023-12-22T08:46:12.026179+0000","last_became_active":"2023-12-22T08:46:11.053587+0000","last_became_peered":"2023-12-22T08:46:11.053587+0000","last_unstale":"2023-12-22T08:46:12.026179+0000","last_undegraded":"2023-12-22T08:46:12.026179+0000","last_fullsized":"2023-12-22T08:46:12.026179+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:44:02.430317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.029935+0000","last_change":"2023-12-22T08:46:10.538113+0000","last_active":"2023-12-22T08:46:11.029935+0000","last_peered":"2023-12-22T08:46:11.029935+0000","last_clean":"2023-12-22T08:46:11.029935+0000","last_became_active":"2023-12-22T08:46:10.537144+0000","last_became_peered":"2023-12-22T08:46:10.537144+0000","last_unstale":"2023-12-22T08:46:11.029935+0000","last_undegraded":"2023-12-22T08:46:11.029935+0000","last_fullsized":"2023-12-22T08:46:11.029935+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:27:56.461932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.028301+0000","last_change":"2023-12-22T08:46:11.048880+0000","last_active":"2023-12-22T08:46:12.028301+0000","last_peered":"2023-12-22T08:46:12.028301+0000","last_clean":"2023-12-22T08:46:12.028301+0000","last_became_active":"2023-12-22T08:46:11.047198+0000","last_became_peered":"2023-12-22T08:46:11.047198+0000","last_unstale":"2023-12-22T08:46:12.028301+0000","last_undegraded":"2023-12-22T08:46:12.028301+0000","last_fullsized":"2023-12-22T08:46:12.028301+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:46.906772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"109'8","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.029552+0000","last_change":"2023-12-22T08:46:10.525406+0000","last_active":"2023-12-22T08:46:12.029552+0000","last_peered":"2023-12-22T08:46:12.029552+0000","last_clean":"2023-12-22T08:46:12.029552+0000","last_became_active":"2023-12-22T08:46:10.524120+0000","last_became_peered":"2023-12-22T08:46:10.524120+0000","last_unstale":"2023-12-22T08:46:12.029552+0000","last_undegraded":"2023-12-22T08:46:12.029552+0000","last_fullsized":"2023-12-22T08:46:12.029552+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:34.011450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.046810+0000","last_change":"2023-12-22T08:46:11.046631+0000","last_active":"2023-12-22T08:46:11.046810+0000","last_peered":"2023-12-22T08:46:11.046810+0000","last_clean":"2023-12-22T08:46:11.046810+0000","last_became_active":"2023-12-22T08:46:11.045712+0000","last_became_peered":"2023-12-22T08:46:11.045712+0000","last_unstale":"2023-12-22T08:46:11.046810+0000","last_undegraded":"2023-12-22T08:46:11.046810+0000","last_fullsized":"2023-12-22T08:46:11.046810+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:30:03.521496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.393028+0000","last_change":"2023-12-22T08:46:10.538874+0000","last_active":"2023-12-22T08:46:13.393028+0000","last_peered":"2023-12-22T08:46:13.393028+0000","last_clean":"2023-12-22T08:46:13.393028+0000","last_became_active":"2023-12-22T08:46:10.538520+0000","last_became_peered":"2023-12-22T08:46:10.538520+0000","last_unstale":"2023-12-22T08:46:13.393028+0000","last_undegraded":"2023-12-22T08:46:13.393028+0000","last_fullsized":"2023-12-22T08:46:13.393028+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:50.061043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.038599+0000","last_change":"2023-12-22T08:46:11.038135+0000","last_active":"2023-12-22T08:46:11.038599+0000","last_peered":"2023-12-22T08:46:11.038599+0000","last_clean":"2023-12-22T08:46:11.038599+0000","last_became_active":"2023-12-22T08:46:11.037832+0000","last_became_peered":"2023-12-22T08:46:11.037832+0000","last_unstale":"2023-12-22T08:46:11.038599+0000","last_undegraded":"2023-12-22T08:46:11.038599+0000","last_fullsized":"2023-12-22T08:46:11.038599+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:48:15.869745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027921+0000","last_change":"2023-12-22T08:46:10.544974+0000","last_active":"2023-12-22T08:46:12.027921+0000","last_peered":"2023-12-22T08:46:12.027921+0000","last_clean":"2023-12-22T08:46:12.027921+0000","last_became_active":"2023-12-22T08:46:10.544682+0000","last_became_peered":"2023-12-22T08:46:10.544682+0000","last_unstale":"2023-12-22T08:46:12.027921+0000","last_undegraded":"2023-12-22T08:46:12.027921+0000","last_fullsized":"2023-12-22T08:46:12.027921+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:50.237711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.046518+0000","last_change":"2023-12-22T08:46:11.045761+0000","last_active":"2023-12-22T08:46:11.046518+0000","last_peered":"2023-12-22T08:46:11.046518+0000","last_clean":"2023-12-22T08:46:11.046518+0000","last_became_active":"2023-12-22T08:46:11.045524+0000","last_became_peered":"2023-12-22T08:46:11.045524+0000","last_unstale":"2023-12-22T08:46:11.046518+0000","last_undegraded":"2023-12-22T08:46:11.046518+0000","last_fullsized":"2023-12-22T08:46:11.046518+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:27:57.476514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.028347+0000","last_change":"2023-12-22T08:46:10.543496+0000","last_active":"2023-12-22T08:46:12.028347+0000","last_peered":"2023-12-22T08:46:12.028347+0000","last_clean":"2023-12-22T08:46:12.028347+0000","last_became_active":"2023-12-22T08:46:10.543144+0000","last_became_peered":"2023-12-22T08:46:10.543144+0000","last_unstale":"2023-12-22T08:46:12.028347+0000","last_undegraded":"2023-12-22T08:46:12.028347+0000","last_fullsized":"2023-12-22T08:46:12.028347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:34.011450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024032+0000","last_change":"2023-12-22T08:46:11.045716+0000","last_active":"2023-12-22T08:46:12.024032+0000","last_peered":"2023-12-22T08:46:12.024032+0000","last_clean":"2023-12-22T08:46:12.024032+0000","last_became_active":"2023-12-22T08:46:11.045406+0000","last_became_peered":"2023-12-22T08:46:11.045406+0000","last_unstale":"2023-12-22T08:46:12.024032+0000","last_undegraded":"2023-12-22T08:46:12.024032+0000","last_fullsized":"2023-12-22T08:46:12.024032+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:03.877163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026408+0000","last_change":"2023-12-22T08:46:10.540191+0000","last_active":"2023-12-22T08:46:12.026408+0000","last_peered":"2023-12-22T08:46:12.026408+0000","last_clean":"2023-12-22T08:46:12.026408+0000","last_became_active":"2023-12-22T08:46:10.539860+0000","last_became_peered":"2023-12-22T08:46:10.539860+0000","last_unstale":"2023-12-22T08:46:12.026408+0000","last_undegraded":"2023-12-22T08:46:12.026408+0000","last_fullsized":"2023-12-22T08:46:12.026408+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:08:05.737332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.393458+0000","last_change":"2023-12-22T08:46:11.039758+0000","last_active":"2023-12-22T08:46:13.393458+0000","last_peered":"2023-12-22T08:46:13.393458+0000","last_clean":"2023-12-22T08:46:13.393458+0000","last_became_active":"2023-12-22T08:46:11.039537+0000","last_became_peered":"2023-12-22T08:46:11.039537+0000","last_unstale":"2023-12-22T08:46:13.393458+0000","last_undegraded":"2023-12-22T08:46:13.393458+0000","last_fullsized":"2023-12-22T08:46:13.393458+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:30.713185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024636+0000","last_change":"2023-12-22T08:46:10.533548+0000","last_active":"2023-12-22T08:46:12.024636+0000","last_peered":"2023-12-22T08:46:12.024636+0000","last_clean":"2023-12-22T08:46:12.024636+0000","last_became_active":"2023-12-22T08:46:10.533133+0000","last_became_peered":"2023-12-22T08:46:10.533133+0000","last_unstale":"2023-12-22T08:46:12.024636+0000","last_undegraded":"2023-12-22T08:46:12.024636+0000","last_fullsized":"2023-12-22T08:46:12.024636+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:08.489668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048668+0000","last_change":"2023-12-22T08:46:11.048221+0000","last_active":"2023-12-22T08:46:11.048668+0000","last_peered":"2023-12-22T08:46:11.048668+0000","last_clean":"2023-12-22T08:46:11.048668+0000","last_became_active":"2023-12-22T08:46:11.047809+0000","last_became_peered":"2023-12-22T08:46:11.047809+0000","last_unstale":"2023-12-22T08:46:11.048668+0000","last_undegraded":"2023-12-22T08:46:11.048668+0000","last_fullsized":"2023-12-22T08:46:11.048668+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:03.877163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.030002+0000","last_change":"2023-12-22T08:46:10.528688+0000","last_active":"2023-12-22T08:46:12.030002+0000","last_peered":"2023-12-22T08:46:12.030002+0000","last_clean":"2023-12-22T08:46:12.030002+0000","last_became_active":"2023-12-22T08:46:10.528191+0000","last_became_peered":"2023-12-22T08:46:10.528191+0000","last_unstale":"2023-12-22T08:46:12.030002+0000","last_undegraded":"2023-12-22T08:46:12.030002+0000","last_fullsized":"2023-12-22T08:46:12.030002+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:30:48.146204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.051671+0000","last_change":"2023-12-22T08:46:11.051624+0000","last_active":"2023-12-22T08:46:11.051671+0000","last_peered":"2023-12-22T08:46:11.051671+0000","last_clean":"2023-12-22T08:46:11.051671+0000","last_became_active":"2023-12-22T08:46:11.051191+0000","last_became_peered":"2023-12-22T08:46:11.051191+0000","last_unstale":"2023-12-22T08:46:11.051671+0000","last_undegraded":"2023-12-22T08:46:11.051671+0000","last_fullsized":"2023-12-22T08:46:11.051671+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:17:58.964837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026806+0000","last_change":"2023-12-22T08:46:10.542798+0000","last_active":"2023-12-22T08:46:12.026806+0000","last_peered":"2023-12-22T08:46:12.026806+0000","last_clean":"2023-12-22T08:46:12.026806+0000","last_became_active":"2023-12-22T08:46:10.542539+0000","last_became_peered":"2023-12-22T08:46:10.542539+0000","last_unstale":"2023-12-22T08:46:12.026806+0000","last_undegraded":"2023-12-22T08:46:12.026806+0000","last_fullsized":"2023-12-22T08:46:12.026806+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:45:20.212930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.392890+0000","last_change":"2023-12-22T08:46:11.036000+0000","last_active":"2023-12-22T08:46:13.392890+0000","last_peered":"2023-12-22T08:46:13.392890+0000","last_clean":"2023-12-22T08:46:13.392890+0000","last_became_active":"2023-12-22T08:46:11.035778+0000","last_became_peered":"2023-12-22T08:46:11.035778+0000","last_unstale":"2023-12-22T08:46:13.392890+0000","last_undegraded":"2023-12-22T08:46:13.392890+0000","last_fullsized":"2023-12-22T08:46:13.392890+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:52:56.850450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.028041+0000","last_change":"2023-12-22T08:46:10.542625+0000","last_active":"2023-12-22T08:46:12.028041+0000","last_peered":"2023-12-22T08:46:12.028041+0000","last_clean":"2023-12-22T08:46:12.028041+0000","last_became_active":"2023-12-22T08:46:10.542131+0000","last_became_peered":"2023-12-22T08:46:10.542131+0000","last_unstale":"2023-12-22T08:46:12.028041+0000","last_undegraded":"2023-12-22T08:46:12.028041+0000","last_fullsized":"2023-12-22T08:46:12.028041+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:52:11.740354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.392481+0000","last_change":"2023-12-22T08:46:11.045315+0000","last_active":"2023-12-22T08:46:13.392481+0000","last_peered":"2023-12-22T08:46:13.392481+0000","last_clean":"2023-12-22T08:46:13.392481+0000","last_became_active":"2023-12-22T08:46:11.044910+0000","last_became_peered":"2023-12-22T08:46:11.044910+0000","last_unstale":"2023-12-22T08:46:13.392481+0000","last_undegraded":"2023-12-22T08:46:13.392481+0000","last_fullsized":"2023-12-22T08:46:13.392481+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:19.301724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.029855+0000","last_change":"2023-12-22T08:46:10.527079+0000","last_active":"2023-12-22T08:46:12.029855+0000","last_peered":"2023-12-22T08:46:12.029855+0000","last_clean":"2023-12-22T08:46:12.029855+0000","last_became_active":"2023-12-22T08:46:10.526460+0000","last_became_peered":"2023-12-22T08:46:10.526460+0000","last_unstale":"2023-12-22T08:46:12.029855+0000","last_undegraded":"2023-12-22T08:46:12.029855+0000","last_fullsized":"2023-12-22T08:46:12.029855+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:11:42.253557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.393307+0000","last_change":"2023-12-22T08:46:11.043176+0000","last_active":"2023-12-22T08:46:13.393307+0000","last_peered":"2023-12-22T08:46:13.393307+0000","last_clean":"2023-12-22T08:46:13.393307+0000","last_became_active":"2023-12-22T08:46:11.042947+0000","last_became_peered":"2023-12-22T08:46:11.042947+0000","last_unstale":"2023-12-22T08:46:13.393307+0000","last_undegraded":"2023-12-22T08:46:13.393307+0000","last_fullsized":"2023-12-22T08:46:13.393307+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:54:38.777246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.038614+0000","last_change":"2023-12-22T08:46:10.541389+0000","last_active":"2023-12-22T08:46:11.038614+0000","last_peered":"2023-12-22T08:46:11.038614+0000","last_clean":"2023-12-22T08:46:11.038614+0000","last_became_active":"2023-12-22T08:46:10.539493+0000","last_became_peered":"2023-12-22T08:46:10.539493+0000","last_unstale":"2023-12-22T08:46:11.038614+0000","last_undegraded":"2023-12-22T08:46:11.038614+0000","last_fullsized":"2023-12-22T08:46:11.038614+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:04:11.157801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.042681+0000","last_change":"2023-12-22T08:46:11.042172+0000","last_active":"2023-12-22T08:46:11.042681+0000","last_peered":"2023-12-22T08:46:11.042681+0000","last_clean":"2023-12-22T08:46:11.042681+0000","last_became_active":"2023-12-22T08:46:11.041938+0000","last_became_peered":"2023-12-22T08:46:11.041938+0000","last_unstale":"2023-12-22T08:46:11.042681+0000","last_undegraded":"2023-12-22T08:46:11.042681+0000","last_fullsized":"2023-12-22T08:46:11.042681+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:09:37.601490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.030639+0000","last_change":"2023-12-22T08:46:10.542517+0000","last_active":"2023-12-22T08:46:11.030639+0000","last_peered":"2023-12-22T08:46:11.030639+0000","last_clean":"2023-12-22T08:46:11.030639+0000","last_became_active":"2023-12-22T08:46:10.542181+0000","last_became_peered":"2023-12-22T08:46:10.542181+0000","last_unstale":"2023-12-22T08:46:11.030639+0000","last_undegraded":"2023-12-22T08:46:11.030639+0000","last_fullsized":"2023-12-22T08:46:11.030639+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:27:07.186973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.041384+0000","last_change":"2023-12-22T08:46:11.039242+0000","last_active":"2023-12-22T08:46:11.041384+0000","last_peered":"2023-12-22T08:46:11.041384+0000","last_clean":"2023-12-22T08:46:11.041384+0000","last_became_active":"2023-12-22T08:46:11.038900+0000","last_became_peered":"2023-12-22T08:46:11.038900+0000","last_unstale":"2023-12-22T08:46:11.041384+0000","last_undegraded":"2023-12-22T08:46:11.041384+0000","last_fullsized":"2023-12-22T08:46:11.041384+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:35:00.187246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024716+0000","last_change":"2023-12-22T08:46:10.536030+0000","last_active":"2023-12-22T08:46:12.024716+0000","last_peered":"2023-12-22T08:46:12.024716+0000","last_clean":"2023-12-22T08:46:12.024716+0000","last_became_active":"2023-12-22T08:46:10.534716+0000","last_became_peered":"2023-12-22T08:46:10.534716+0000","last_unstale":"2023-12-22T08:46:12.024716+0000","last_undegraded":"2023-12-22T08:46:12.024716+0000","last_fullsized":"2023-12-22T08:46:12.024716+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:27:07.186973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.029344+0000","last_change":"2023-12-22T08:46:11.035698+0000","last_active":"2023-12-22T08:46:12.029344+0000","last_peered":"2023-12-22T08:46:12.029344+0000","last_clean":"2023-12-22T08:46:12.029344+0000","last_became_active":"2023-12-22T08:46:11.033813+0000","last_became_peered":"2023-12-22T08:46:11.033813+0000","last_unstale":"2023-12-22T08:46:12.029344+0000","last_undegraded":"2023-12-22T08:46:12.029344+0000","last_fullsized":"2023-12-22T08:46:12.029344+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:04:12.172382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.030032+0000","last_change":"2023-12-22T08:46:10.533644+0000","last_active":"2023-12-22T08:46:11.030032+0000","last_peered":"2023-12-22T08:46:11.030032+0000","last_clean":"2023-12-22T08:46:11.030032+0000","last_became_active":"2023-12-22T08:46:10.529284+0000","last_became_peered":"2023-12-22T08:46:10.529284+0000","last_unstale":"2023-12-22T08:46:11.030032+0000","last_undegraded":"2023-12-22T08:46:11.030032+0000","last_fullsized":"2023-12-22T08:46:11.030032+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:51:58.756356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.041317+0000","last_change":"2023-12-22T08:46:11.038933+0000","last_active":"2023-12-22T08:46:11.041317+0000","last_peered":"2023-12-22T08:46:11.041317+0000","last_clean":"2023-12-22T08:46:11.041317+0000","last_became_active":"2023-12-22T08:46:11.038761+0000","last_became_peered":"2023-12-22T08:46:11.038761+0000","last_unstale":"2023-12-22T08:46:11.041317+0000","last_undegraded":"2023-12-22T08:46:11.041317+0000","last_fullsized":"2023-12-22T08:46:11.041317+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:44:02.430317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.034060+0000","last_change":"2023-12-22T08:46:10.540003+0000","last_active":"2023-12-22T08:46:11.034060+0000","last_peered":"2023-12-22T08:46:11.034060+0000","last_clean":"2023-12-22T08:46:11.034060+0000","last_became_active":"2023-12-22T08:46:10.538484+0000","last_became_peered":"2023-12-22T08:46:10.538484+0000","last_unstale":"2023-12-22T08:46:11.034060+0000","last_undegraded":"2023-12-22T08:46:11.034060+0000","last_fullsized":"2023-12-22T08:46:11.034060+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:08:05.737332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.041422+0000","last_change":"2023-12-22T08:46:11.041197+0000","last_active":"2023-12-22T08:46:11.041422+0000","last_peered":"2023-12-22T08:46:11.041422+0000","last_clean":"2023-12-22T08:46:11.041422+0000","last_became_active":"2023-12-22T08:46:11.040944+0000","last_became_peered":"2023-12-22T08:46:11.040944+0000","last_unstale":"2023-12-22T08:46:11.041422+0000","last_undegraded":"2023-12-22T08:46:11.041422+0000","last_fullsized":"2023-12-22T08:46:11.041422+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:49:16.929281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.038700+0000","last_change":"2023-12-22T08:46:10.542977+0000","last_active":"2023-12-22T08:46:11.038700+0000","last_peered":"2023-12-22T08:46:11.038700+0000","last_clean":"2023-12-22T08:46:11.038700+0000","last_became_active":"2023-12-22T08:46:10.542399+0000","last_became_peered":"2023-12-22T08:46:10.542399+0000","last_unstale":"2023-12-22T08:46:11.038700+0000","last_undegraded":"2023-12-22T08:46:11.038700+0000","last_fullsized":"2023-12-22T08:46:11.038700+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:44:01.415735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.028500+0000","last_change":"2023-12-22T08:46:11.029428+0000","last_active":"2023-12-22T08:46:12.028500+0000","last_peered":"2023-12-22T08:46:12.028500+0000","last_clean":"2023-12-22T08:46:12.028500+0000","last_became_active":"2023-12-22T08:46:11.028717+0000","last_became_peered":"2023-12-22T08:46:11.028717+0000","last_unstale":"2023-12-22T08:46:12.028500+0000","last_undegraded":"2023-12-22T08:46:12.028500+0000","last_fullsized":"2023-12-22T08:46:12.028500+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:55.966404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.393211+0000","last_change":"2023-12-22T08:46:10.542440+0000","last_active":"2023-12-22T08:46:13.393211+0000","last_peered":"2023-12-22T08:46:13.393211+0000","last_clean":"2023-12-22T08:46:13.393211+0000","last_became_active":"2023-12-22T08:46:10.541847+0000","last_became_peered":"2023-12-22T08:46:10.541847+0000","last_unstale":"2023-12-22T08:46:13.393211+0000","last_undegraded":"2023-12-22T08:46:13.393211+0000","last_fullsized":"2023-12-22T08:46:13.393211+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:42:19.395065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":244,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-22T08:46:10.533110+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:46:10.533110+0000","last_peered":"2023-12-22T08:46:10.533110+0000","last_clean":"2023-12-22T08:46:10.533110+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:46:10.533110+0000","last_undegraded":"2023-12-22T08:46:10.533110+0000","last_fullsized":"2023-12-22T08:46:10.533110+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":586,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194726,"statfs":{"total":200000000,"available":199399456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.087,"15min":1.0820000000000001},"min":{"1min":0.70399999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6459999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.1259999999999999,"15min":1.0760000000000001},"min":{"1min":0.75700000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5640000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.95999999999999996}]},{"osd":1,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.2090000000000001,"15min":1.1699999999999999},"min":{"1min":0.90800000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.617,"5min":1.905,"15min":1.905},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.2529999999999999,"15min":1.1619999999999999},"min":{"1min":1.0249999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6279999999999999,"5min":1.865,"15min":1.865},"last":1.083}]},{"osd":2,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.143,"15min":1.075},"min":{"1min":0.78400000000000003,"5min":0.745,"15min":0.69799999999999995},"max":{"1min":1.4530000000000001,"5min":1.875,"15min":1.875},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.262,"5min":1.2150000000000001,"15min":1.2250000000000001},"min":{"1min":0.93400000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.609,"5min":1.742,"15min":2.1379999999999999},"last":1.135}]},{"osd":3,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2010000000000001,"15min":1.115},"min":{"1min":0.80900000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.409,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.3220000000000001,"15min":1.2869999999999999},"min":{"1min":1.1140000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.661,"5min":1.952,"15min":2.2959999999999998},"last":1.3320000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1839999999999999,"15min":1.1919999999999999},"min":{"1min":0.79900000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8169999999999999,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.246,"15min":1.256},"min":{"1min":0.93799999999999994,"5min":0.64100000000000001,"15min":0.59399999999999997},"max":{"1min":1.371,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.4119999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3680000000000001,"15min":1.3660000000000001},"min":{"1min":1.0089999999999999,"5min":0.74299999999999999,"15min":0.51800000000000002},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.4300000000000002},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":1.0680000000000001,"5min":0.76300000000000001,"15min":0.67800000000000005},"max":{"1min":1.722,"5min":1.722,"15min":2.3410000000000002},"last":1.389}]},{"osd":6,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.494,"15min":1.4870000000000001},"min":{"1min":1.1180000000000001,"5min":0.83499999999999996,"15min":0.66900000000000004},"max":{"1min":1.9099999999999999,"5min":2.1259999999999999,"15min":2.2440000000000002},"last":1.488},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.466,"15min":1.4770000000000001},"min":{"1min":1.097,"5min":0.82299999999999995,"15min":0.71999999999999997},"max":{"1min":1.585,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.518}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":587,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194725,"statfs":{"total":200000000,"available":199398854,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.1359999999999999,"15min":1.1379999999999999},"min":{"1min":0.69499999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.548,"5min":1.9350000000000001,"15min":3.0489999999999999},"last":1.087},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1379999999999999,"15min":1.1000000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.67800000000000005},"max":{"1min":1.579,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.159}]},{"osd":1,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.121,"15min":1.046},"min":{"1min":0.76600000000000001,"5min":0.63,"15min":0.623},"max":{"1min":1.5660000000000001,"5min":1.575,"15min":1.6519999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2010000000000001,"15min":1.1739999999999999},"min":{"1min":0.64500000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.4450000000000001,"5min":1.8,"15min":1.8},"last":1.212}]},{"osd":2,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.254,"15min":1.272},"min":{"1min":0.72799999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.556,"5min":1.7969999999999999,"15min":1.8799999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.2210000000000001,"15min":1.163},"min":{"1min":0.80800000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5149999999999999,"5min":1.881,"15min":1.881},"last":1.2529999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.3109999999999999,"15min":1.2969999999999999},"min":{"1min":0.86899999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5920000000000001,"5min":1.738,"15min":1.847},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2569999999999999,"15min":1.236},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.77900000000000003},"max":{"1min":1.506,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.83799999999999997}]},{"osd":4,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.329,"15min":1.387},"min":{"1min":0.88800000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.6100000000000001,"5min":1.9139999999999999,"15min":2.0739999999999998},"last":1.369},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3740000000000001,"15min":1.3939999999999999},"min":{"1min":0.89500000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6479999999999999,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.343}]},{"osd":5,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.3169999999999999,"15min":1.349},"min":{"1min":1.0049999999999999,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.595,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.474,"5min":1.4930000000000001,"15min":1.5720000000000001},"min":{"1min":1.1399999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6919999999999999,"5min":2.1030000000000002,"15min":3.1819999999999999},"last":1.4299999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.5169999999999999,"15min":1.5700000000000001},"min":{"1min":0.97899999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.708,"5min":2.2999999999999998,"15min":2.8069999999999999},"last":1.397},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.4630000000000001,"15min":1.5309999999999999},"min":{"1min":1.1180000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.673,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.999}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1157,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194155,"statfs":{"total":200000000,"available":198814879,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.107,"15min":1.0860000000000001},"min":{"1min":0.84999999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3169999999999999,"5min":1.944,"15min":1.944},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1040000000000001,"15min":1.129},"min":{"1min":0.84799999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.381,"5min":2.2690000000000001,"15min":3.1379999999999999},"last":1.2450000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.109,"15min":1.113},"min":{"1min":0.84799999999999998,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5329999999999999,"5min":1.619,"15min":2.79},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.101,"15min":1.036},"min":{"1min":0.89100000000000001,"5min":0.69099999999999995,"15min":0.64500000000000002},"max":{"1min":1.4119999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.1020000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.155,"15min":1.1339999999999999},"min":{"1min":0.92000000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.4330000000000001,"5min":1.6279999999999999,"15min":1.72},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.23,"5min":1.2190000000000001,"15min":1.177},"min":{"1min":0.81799999999999995,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.716,"5min":1.716,"15min":1.978},"last":1.45}]},{"osd":3,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.236,"15min":1.1799999999999999},"min":{"1min":1.0009999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.282},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.28,"15min":1.2490000000000001},"min":{"1min":1.0389999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5760000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.367}]},{"osd":4,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.2589999999999999,"15min":1.252},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.575,"5min":1.853,"15min":1.853},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.2629999999999999,"15min":1.2549999999999999},"min":{"1min":0.95199999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6200000000000001,"5min":1.663,"15min":1.663},"last":1.2050000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3260000000000001,"15min":1.3160000000000001},"min":{"1min":0.91000000000000003,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.788,"5min":1.788,"15min":1.821},"last":1.179},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4019999999999999,"15min":1.4199999999999999},"min":{"1min":0.79600000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.798,"5min":1.823,"15min":2.8780000000000001},"last":1.3240000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.4179999999999999,"15min":1.3819999999999999},"min":{"1min":1.2609999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.873,"5min":1.873,"15min":2.2189999999999999},"last":1.407},{"interface":"front","average":{"1min":1.587,"5min":1.486,"15min":1.5569999999999999},"min":{"1min":1.177,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.8899999999999999,"5min":2.3610000000000002,"15min":4.7249999999999996},"last":1.2989999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":586,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194726,"statfs":{"total":200000000,"available":199399492,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":1.0109999999999999},"min":{"1min":0.71999999999999997,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.014},{"interface":"front","average":{"1min":1.133,"5min":1.151,"15min":1.109},"min":{"1min":0.69299999999999995,"5min":0.69099999999999995,"15min":0.68300000000000005},"max":{"1min":1.6379999999999999,"5min":1.796,"15min":1.796},"last":1.298}]},{"osd":1,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1160000000000001,"15min":1.054},"min":{"1min":0.68500000000000005,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4850000000000001,"5min":1.76,"15min":1.76},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1120000000000001,"15min":1.1100000000000001},"min":{"1min":0.77000000000000002,"5min":0.65600000000000003,"15min":0.57399999999999995},"max":{"1min":1.454,"5min":1.794,"15min":2.4249999999999998},"last":0.872}]},{"osd":2,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.181,"15min":1.151},"min":{"1min":0.83899999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5149999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.242,"15min":1.208},"min":{"1min":0.877,"5min":0.79500000000000004,"15min":0.78800000000000003},"max":{"1min":1.6910000000000001,"5min":2.0830000000000002,"15min":2.1600000000000001},"last":1.206}]},{"osd":3,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2230000000000001,"15min":1.1990000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.774},"last":1.109},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3169999999999999,"15min":1.2250000000000001},"min":{"1min":0.96399999999999997,"5min":0.84099999999999997,"15min":0.83899999999999997},"max":{"1min":1.7290000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.3740000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.202,"15min":1.1439999999999999},"min":{"1min":0.79900000000000004,"5min":0.68700000000000006,"15min":0.60299999999999998},"max":{"1min":1.6140000000000001,"5min":1.639,"15min":1.639},"last":1.26},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4370000000000001,"15min":1.3879999999999999},"min":{"1min":0.997,"5min":0.997,"15min":0.82699999999999996},"max":{"1min":1.8660000000000001,"5min":1.913,"15min":2.0979999999999999},"last":1.4319999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.325,"15min":1.2509999999999999},"min":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.58599999999999997},"max":{"1min":1.978,"5min":2.141,"15min":2.141},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.3180000000000001,"15min":1.216},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.355}]},{"osd":7,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.4570000000000001,"15min":1.353},"min":{"1min":1.0649999999999999,"5min":0.97799999999999998,"15min":0.67300000000000004},"max":{"1min":1.9279999999999999,"5min":2.0089999999999999,"15min":2.1200000000000001},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.528,"15min":1.4359999999999999},"min":{"1min":1.1020000000000001,"5min":1.0860000000000001,"15min":0.73299999999999998},"max":{"1min":2.1400000000000001,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.696}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":580,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194731,"statfs":{"total":200000000,"available":199405152,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.878,"15min":0.94799999999999995},"min":{"1min":0.53700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.1240000000000001,"5min":0.94199999999999995,"15min":0.93999999999999995},"min":{"1min":0.65200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.871}]},{"osd":1,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.88800000000000001,"15min":0.86799999999999999},"min":{"1min":0.60699999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3919999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.294,"5min":1.1870000000000001,"15min":1.137},"min":{"1min":0.68999999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6659999999999999,"5min":1.861,"15min":1.861},"last":1.1140000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0529999999999999,"15min":1.042},"min":{"1min":0.56100000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3460000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.198,"5min":1.1719999999999999,"15min":1.1359999999999999},"min":{"1min":0.68400000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6699999999999999,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.345}]},{"osd":4,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2490000000000001,"15min":1.2130000000000001},"min":{"1min":0.98599999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.603},{"interface":"front","average":{"1min":1.375,"5min":1.302,"15min":1.244},"min":{"1min":1.052,"5min":0.745,"15min":0.745},"max":{"1min":2.085,"5min":2.242,"15min":2.242},"last":1.7649999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3560000000000001,"15min":1.288},"min":{"1min":1.02,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9790000000000001,"5min":1.994,"15min":1.994},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.385,"15min":1.4330000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.7969999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.423}]},{"osd":6,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4419999999999999,"15min":1.4450000000000001},"min":{"1min":1.1120000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.8899999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.482},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.3879999999999999,"15min":1.3899999999999999},"min":{"1min":0.98999999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.1759999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.4219999999999999,"15min":1.385},"min":{"1min":1.081,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.4410000000000001,"15min":1.403},"min":{"1min":1.1519999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.698}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":580,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194732,"statfs":{"total":200000000,"available":199405826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95199999999999996,"15min":0.78000000000000003},"min":{"1min":0.54800000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.6789999999999998,"5min":6.8879999999999999,"15min":6.8879999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95599999999999996,"15min":0.94399999999999995},"min":{"1min":0.50600000000000001,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.5069999999999999,"5min":4.5510000000000002,"15min":4.5510000000000002},"last":1.4119999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":1.038,"15min":0.94399999999999995},"min":{"1min":0.63900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.633,"5min":11.308999999999999,"15min":11.308999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.175,"5min":1.0700000000000001,"15min":0.94499999999999995},"min":{"1min":0.51500000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.036}]},{"osd":3,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.252,"15min":1.052},"min":{"1min":0.69799999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5780000000000001,"5min":13.087999999999999,"15min":13.087999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.363,"15min":1.117},"min":{"1min":0.67300000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":3.2959999999999998,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.202}]},{"osd":4,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.3899999999999999,"15min":1.258},"min":{"1min":0.94899999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3999999999999999,"15min":1.3560000000000001},"min":{"1min":1.0329999999999999,"5min":0.623,"15min":0.61499999999999999},"max":{"1min":1.6160000000000001,"5min":13.927,"15min":13.927},"last":1.1399999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.409,"15min":1.379},"min":{"1min":0.91500000000000004,"5min":0.72399999999999998,"15min":0.64000000000000001},"max":{"1min":1.722,"5min":11.003,"15min":11.003},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.454,"15min":1.284},"min":{"1min":0.93100000000000005,"5min":0.83699999999999997,"15min":0.79400000000000004},"max":{"1min":2.0470000000000002,"5min":13.129,"15min":13.129},"last":1.093}]},{"osd":6,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4510000000000001,"15min":1.2909999999999999},"min":{"1min":0.995,"5min":0.77200000000000002,"15min":0.751},"max":{"1min":2.1240000000000001,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":1.456},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.518,"15min":1.383},"min":{"1min":0.97799999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":3.8959999999999999,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":1.319}]},{"osd":7,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.506,"15min":1.399},"min":{"1min":0.97299999999999998,"5min":0.753,"15min":0.61299999999999999},"max":{"1min":1.7729999999999999,"5min":10.948,"15min":10.948},"last":1.244},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.5489999999999999,"15min":1.3720000000000001},"min":{"1min":0.90600000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.1789999999999998,"5min":8.0980000000000008,"15min":8.0980000000000008},"last":1.3380000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1156,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194155,"statfs":{"total":200000000,"available":198815368,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92000000000000004,"15min":0.90600000000000003},"min":{"1min":0.41299999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.361,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.105,"15min":1.0369999999999999},"min":{"1min":0.629,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.857,"5min":1.857,"15min":2.4159999999999999},"last":1.276}]},{"osd":2,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":0.98799999999999999,"15min":0.96199999999999997},"min":{"1min":0.61099999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.194},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0389999999999999,"15min":0.97199999999999998},"min":{"1min":0.70999999999999996,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6120000000000001,"5min":1.647,"15min":2.254},"last":1.1519999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.296,"15min":1.1990000000000001},"min":{"1min":0.76400000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.3479999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.151,"5min":1.026,"15min":0.98599999999999999},"min":{"1min":0.68300000000000005,"5min":0.497,"15min":0.47799999999999998},"max":{"1min":1.7490000000000001,"5min":2.226,"15min":2.226},"last":0.65200000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.3080000000000001,"15min":1.286},"min":{"1min":0.874,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.306},{"interface":"front","average":{"1min":1.536,"5min":1.4350000000000001,"15min":1.3460000000000001},"min":{"1min":1.0309999999999999,"5min":0.876,"15min":0.85499999999999998},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.423}]},{"osd":5,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.2909999999999999,"15min":1.2529999999999999},"min":{"1min":0.79200000000000004,"5min":0.71599999999999997,"15min":0.61399999999999999},"max":{"1min":2.4089999999999998,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":1.101},{"interface":"front","average":{"1min":1.508,"5min":1.4399999999999999,"15min":1.3580000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.66800000000000004},"max":{"1min":2.3100000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.357,"15min":1.2789999999999999},"min":{"1min":0.92100000000000004,"5min":0.81000000000000005,"15min":0.65200000000000002},"max":{"1min":2.7440000000000002,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":1.321},{"interface":"front","average":{"1min":1.569,"5min":1.456,"15min":1.3899999999999999},"min":{"1min":0.96999999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2229999999999999},"last":1.2490000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6539999999999999,"5min":1.5129999999999999,"15min":1.3919999999999999},"min":{"1min":1.0629999999999999,"5min":0.76900000000000002,"15min":0.64400000000000002},"max":{"1min":2.3610000000000002,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.587,"5min":1.458,"15min":1.4259999999999999},"min":{"1min":0.90200000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.5379999999999998,"5min":4.508,"15min":4.508},"last":1.391}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":581,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194730,"statfs":{"total":200000000,"available":199404240,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.82499999999999996,"15min":0.747},"min":{"1min":0.61199999999999999,"5min":0.40100000000000002,"15min":0.38},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":2.9470000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":0.95899999999999996,"15min":0.91700000000000004},"min":{"1min":0.52600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.593,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.8360000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.86899999999999999,"15min":0.80900000000000005},"min":{"1min":0.68200000000000005,"5min":0.442,"15min":0.40600000000000003},"max":{"1min":1.5229999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.069,"15min":0.96399999999999997},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.157,"15min":1.0509999999999999},"min":{"1min":0.64300000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":2.1339999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.228,"15min":1.0880000000000001},"min":{"1min":0.77600000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.9219999999999999,"5min":2.145,"15min":2.145},"last":1.8080000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.351,"15min":1.284},"min":{"1min":0.85599999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":2.0910000000000002},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.333,"15min":1.2350000000000001},"min":{"1min":1.0069999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.964}]},{"osd":5,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.3400000000000001,"15min":1.272},"min":{"1min":1.0820000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":5.4290000000000003},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.341,"15min":1.2789999999999999},"min":{"1min":1.0609999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":3.0910000000000002}]},{"osd":6,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.379,"15min":1.2989999999999999},"min":{"1min":1.034,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.7589999999999999,"5min":1.478,"15min":1.4099999999999999},"min":{"1min":1.2529999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.93600000000000005}]},{"osd":7,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":1.458,"15min":1.387},"min":{"1min":1.1950000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.6819999999999999,"5min":1.448,"15min":1.3899999999999999},"min":{"1min":1.1799999999999999,"5min":0.749,"15min":0.749},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":2.1680000000000001}]}]}],"pool_statfs":[]}} 2023-12-22T08:46:15.492 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:46:15.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.753+0000 7faee993c640 1 Processor -- start 2023-12-22T08:46:15.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.753+0000 7faee993c640 1 -- start start 2023-12-22T08:46:15.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.755+0000 7faee993c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee40b24b0 0x7faee4070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.755+0000 7faee993c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee41450f0 con 0x7faee40b2050 2023-12-22T08:46:15.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.755+0000 7faee993c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee40cc840 con 0x7faee4144d10 2023-12-22T08:46:15.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.755+0000 7faee993c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee40ce010 con 0x7faee40b24b0 2023-12-22T08:46:15.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.755+0000 7faee27fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7faee40b2050 0x7faee4070800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47046/0 (socket says 172.21.15.38:47046) 2023-12-22T08:46:15.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.755+0000 7faee27fc640 1 -- 172.21.15.38:0/1063658343 learned_addr learned my addr 172.21.15.38:0/1063658343 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:15.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.756+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374981612 0 0) 0x7faee41450f0 con 0x7faee40b2050 2023-12-22T08:46:15.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.756+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faecc003520 con 0x7faee40b2050 2023-12-22T08:46:15.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.756+0000 7faee37fe640 1 --2- 172.21.15.38:0/1063658343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee40b24b0 0x7faee4070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.756+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1884047660 0 0) 0x7faecc003520 con 0x7faee40b2050 2023-12-22T08:46:15.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.756+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee40b24b0 msgr2=0x7faee4070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.756+0000 7faee1ffb640 1 --2- 172.21.15.38:0/1063658343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee40b24b0 0x7faee4070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.756+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 >> v1:172.21.15.89:6789/0 conn(0x7faee4144d10 legacy=0x7faee40cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.756+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40ce2f0 con 0x7faee40b2050 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.756+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7faed8001690 con 0x7faee40b2050 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.756+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 >> v1:172.21.15.38:6789/0 conn(0x7faee40b2050 legacy=0x7faee4070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.756+0000 7faee1ffb640 1 --2- 172.21.15.38:0/1063658343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faecc0039a0 0x7faecc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.756+0000 7faee1ffb640 1 --2- 172.21.15.38:0/1063658343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faecc0047c0 0x7faecc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.756+0000 7faee1ffb640 1 --2- 172.21.15.38:0/1063658343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee40b24b0 0x7faecc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.757+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee40ce010 con 0x7faecc0039a0 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.757+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc00bb10 con 0x7faecc0047c0 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.757+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc00bcd0 con 0x7faee40b24b0 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.757+0000 7faee2ffd640 1 --2- 172.21.15.38:0/1063658343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faecc0039a0 0x7faecc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.757+0000 7faee27fc640 1 --2- 172.21.15.38:0/1063658343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faecc0047c0 0x7faecc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.757+0000 7faee37fe640 1 --2- 172.21.15.38:0/1063658343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee40b24b0 0x7faecc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.757+0000 7faee2ffd640 1 -- 172.21.15.38:0/1063658343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee40b24b0 msgr2=0x7faecc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:15.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.757+0000 7faee2ffd640 1 --2- 172.21.15.38:0/1063658343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee40b24b0 0x7faecc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.757+0000 7faee2ffd640 1 -- 172.21.15.38:0/1063658343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faecc0047c0 msgr2=0x7faecc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:15.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.757+0000 7faee2ffd640 1 --2- 172.21.15.38:0/1063658343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faecc0047c0 0x7faecc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.757+0000 7faee2ffd640 1 -- 172.21.15.38:0/1063658343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc003520 con 0x7faecc0039a0 2023-12-22T08:46:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.758+0000 7faee2ffd640 1 --2- 172.21.15.38:0/1063658343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faecc0039a0 0x7faecc003dc0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7faed4001750 tx=0x7faecc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea59f24344fc12e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.759+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed40052d0 con 0x7faecc0039a0 2023-12-22T08:46:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.759+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed402e050 con 0x7faecc0039a0 2023-12-22T08:46:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.759+0000 7faee1ffb640 1 -- 172.21.15.38:0/1063658343 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed40035f0 con 0x7faecc0039a0 2023-12-22T08:46:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.759+0000 7faee993c640 1 -- 172.21.15.38:0/1063658343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faecc0039a0 msgr2=0x7faecc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.759+0000 7faee993c640 1 --2- 172.21.15.38:0/1063658343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faecc0039a0 0x7faecc003dc0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7faed4001750 tx=0x7faecc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.759+0000 7faee37fe640 1 -- 172.21.15.38:0/1063658343 reap_dead start 2023-12-22T08:46:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.759+0000 7faee993c640 1 -- 172.21.15.38:0/1063658343 shutdown_connections 2023-12-22T08:46:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.759+0000 7faee993c640 1 -- 172.21.15.38:0/1063658343 >> 172.21.15.38:0/1063658343 conn(0x7faee40cf070 msgr2=0x7faee40cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.760+0000 7faee993c640 1 -- 172.21.15.38:0/1063658343 shutdown_connections 2023-12-22T08:46:15.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.760+0000 7faee993c640 1 -- 172.21.15.38:0/1063658343 wait complete. 2023-12-22T08:46:15.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.761+0000 7faee993c640 1 Processor -- start 2023-12-22T08:46:15.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.761+0000 7faee993c640 1 -- start start 2023-12-22T08:46:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.762+0000 7faee993c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee413a3d0 0x7faee4158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.762+0000 7faee993c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee413a7b0 0x7faee406dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.762+0000 7faee993c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faee4071780 0x7faee4071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.762+0000 7faee993c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee4072170 con 0x7faee4071780 2023-12-22T08:46:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.762+0000 7faee993c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee406e150 con 0x7faee413a7b0 2023-12-22T08:46:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.762+0000 7faee993c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee406c190 con 0x7faee413a3d0 2023-12-22T08:46:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.763+0000 7faee37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faee4071780 0x7faee4071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.763+0000 7faee37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faee4071780 0x7faee4071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47982/0 (socket says 172.21.15.38:47982) 2023-12-22T08:46:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.763+0000 7faee37fe640 1 -- 172.21.15.38:0/3653157889 learned_addr learned my addr 172.21.15.38:0/3653157889 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.763+0000 7faee27fc640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee413a7b0 0x7faee406dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.763+0000 7faee2ffd640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee413a3d0 0x7faee4158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.763+0000 7faee37fe640 1 -- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee413a3d0 msgr2=0x7faee4158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.763+0000 7faee37fe640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee413a3d0 0x7faee4158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.763+0000 7faee37fe640 1 -- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee413a7b0 msgr2=0x7faee406dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.763+0000 7faee37fe640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee413a7b0 0x7faee406dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.763+0000 7faee37fe640 1 -- 172.21.15.38:0/3653157889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee406c470 con 0x7faee4071780 2023-12-22T08:46:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.764+0000 7faee37fe640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faee4071780 0x7faee4071c30 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7faee40b4fc0 tx=0x7faedc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.764+0000 7faecbfff640 1 -- 172.21.15.38:0/3653157889 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc007db0 con 0x7faee4071780 2023-12-22T08:46:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.764+0000 7faecbfff640 1 -- 172.21.15.38:0/3653157889 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc00f050 con 0x7faee4071780 2023-12-22T08:46:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.764+0000 7faecbfff640 1 -- 172.21.15.38:0/3653157889 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc014650 con 0x7faee4071780 2023-12-22T08:46:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.764+0000 7faee993c640 1 -- 172.21.15.38:0/3653157889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee406c750 con 0x7faee4071780 2023-12-22T08:46:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.764+0000 7faee993c640 1 -- 172.21.15.38:0/3653157889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee406cd10 con 0x7faee4071780 2023-12-22T08:46:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.765+0000 7faee993c640 1 -- 172.21.15.38:0/3653157889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee4061910 con 0x7faee4071780 2023-12-22T08:46:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.766+0000 7faecbfff640 1 -- 172.21.15.38:0/3653157889 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faedc0147b0 con 0x7faee4071780 2023-12-22T08:46:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.767+0000 7faecbfff640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faed006a430 0x7faed006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.767+0000 7faecbfff640 1 -- 172.21.15.38:0/3653157889 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faedc088e70 con 0x7faee4071780 2023-12-22T08:46:15.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.768+0000 7faee2ffd640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faed006a430 0x7faed006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:15.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.769+0000 7faee2ffd640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faed006a430 0x7faed006c8f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7faed4001750 tx=0x7faed4009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.771+0000 7faecbfff640 1 -- 172.21.15.38:0/3653157889 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faedc054450 con 0x7faee4071780 2023-12-22T08:46:15.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.959+0000 7faee993c640 1 -- 172.21.15.38:0/3653157889 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faee40ce8b0 con 0x7faed006a430 2023-12-22T08:46:15.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.981+0000 7faecbfff640 1 -- 172.21.15.38:0/3653157889 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283036 (secure 0 0 0) 0x7faed4005350 con 0x7faed006a430 2023-12-22T08:46:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:15.987 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:46:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.987+0000 7faee993c640 1 -- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faed006a430 msgr2=0x7faed006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.987+0000 7faee993c640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faed006a430 0x7faed006c8f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7faed4001750 tx=0x7faed4009030 comp rx=0 tx=0).stop 2023-12-22T08:46:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.987+0000 7faee993c640 1 -- 172.21.15.38:0/3653157889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faee4071780 msgr2=0x7faee4071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.987+0000 7faee993c640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faee4071780 0x7faee4071c30 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7faee40b4fc0 tx=0x7faedc009da0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.987+0000 7faee993c640 1 -- 172.21.15.38:0/3653157889 shutdown_connections 2023-12-22T08:46:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.987+0000 7faee993c640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faed006a430 0x7faed006c8f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.987+0000 7faee993c640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faee4071780 0x7faee4071c30 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.987+0000 7faee993c640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee413a7b0 0x7faee406dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.987+0000 7faee993c640 1 --2- 172.21.15.38:0/3653157889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee413a3d0 0x7faee4158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.987+0000 7faee993c640 1 -- 172.21.15.38:0/3653157889 >> 172.21.15.38:0/3653157889 conn(0x7faee40cf070 msgr2=0x7faee40b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:15.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.987+0000 7faee993c640 1 -- 172.21.15.38:0/3653157889 shutdown_connections 2023-12-22T08:46:15.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:15.987+0000 7faee993c640 1 -- 172.21.15.38:0/3653157889 wait complete. 2023-12-22T08:46:16.010 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2023-12-22T08:46:14.493518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5817,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556682,"statfs":{"total":1600000000,"available":1594043267,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.989284"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.042645+0000","last_change":"2023-12-22T08:46:11.042519+0000","last_active":"2023-12-22T08:46:11.042645+0000","last_peered":"2023-12-22T08:46:11.042645+0000","last_clean":"2023-12-22T08:46:11.042645+0000","last_became_active":"2023-12-22T08:46:11.042206+0000","last_became_peered":"2023-12-22T08:46:11.042206+0000","last_unstale":"2023-12-22T08:46:11.042645+0000","last_undegraded":"2023-12-22T08:46:11.042645+0000","last_fullsized":"2023-12-22T08:46:11.042645+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:51:25.597889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024295+0000","last_change":"2023-12-22T08:46:11.041501+0000","last_active":"2023-12-22T08:46:12.024295+0000","last_peered":"2023-12-22T08:46:12.024295+0000","last_clean":"2023-12-22T08:46:12.024295+0000","last_became_active":"2023-12-22T08:46:11.040876+0000","last_became_peered":"2023-12-22T08:46:11.040876+0000","last_unstale":"2023-12-22T08:46:12.024295+0000","last_undegraded":"2023-12-22T08:46:12.024295+0000","last_fullsized":"2023-12-22T08:46:12.024295+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:51.163696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.033891+0000","last_change":"2023-12-22T08:46:11.031617+0000","last_active":"2023-12-22T08:46:11.033891+0000","last_peered":"2023-12-22T08:46:11.033891+0000","last_clean":"2023-12-22T08:46:11.033891+0000","last_became_active":"2023-12-22T08:46:11.031391+0000","last_became_peered":"2023-12-22T08:46:11.031391+0000","last_unstale":"2023-12-22T08:46:11.033891+0000","last_undegraded":"2023-12-22T08:46:11.033891+0000","last_fullsized":"2023-12-22T08:46:11.033891+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:36:10.900466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.044106+0000","last_change":"2023-12-22T08:46:11.039823+0000","last_active":"2023-12-22T08:46:11.044106+0000","last_peered":"2023-12-22T08:46:11.044106+0000","last_clean":"2023-12-22T08:46:11.044106+0000","last_became_active":"2023-12-22T08:46:11.039333+0000","last_became_peered":"2023-12-22T08:46:11.039333+0000","last_unstale":"2023-12-22T08:46:11.044106+0000","last_undegraded":"2023-12-22T08:46:11.044106+0000","last_fullsized":"2023-12-22T08:46:11.044106+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:28.575655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.393028+0000","last_change":"2023-12-22T08:46:11.044225+0000","last_active":"2023-12-22T08:46:13.393028+0000","last_peered":"2023-12-22T08:46:13.393028+0000","last_clean":"2023-12-22T08:46:13.393028+0000","last_became_active":"2023-12-22T08:46:11.043929+0000","last_became_peered":"2023-12-22T08:46:11.043929+0000","last_unstale":"2023-12-22T08:46:13.393028+0000","last_undegraded":"2023-12-22T08:46:13.393028+0000","last_fullsized":"2023-12-22T08:46:13.393028+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:09:16.593565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048213+0000","last_change":"2023-12-22T08:46:11.048143+0000","last_active":"2023-12-22T08:46:11.048213+0000","last_peered":"2023-12-22T08:46:11.048213+0000","last_clean":"2023-12-22T08:46:11.048213+0000","last_became_active":"2023-12-22T08:46:11.046825+0000","last_became_peered":"2023-12-22T08:46:11.046825+0000","last_unstale":"2023-12-22T08:46:11.048213+0000","last_undegraded":"2023-12-22T08:46:11.048213+0000","last_fullsized":"2023-12-22T08:46:11.048213+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:01:34.613784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024742+0000","last_change":"2023-12-22T08:46:11.041315+0000","last_active":"2023-12-22T08:46:12.024742+0000","last_peered":"2023-12-22T08:46:12.024742+0000","last_clean":"2023-12-22T08:46:12.024742+0000","last_became_active":"2023-12-22T08:46:11.039843+0000","last_became_peered":"2023-12-22T08:46:11.039843+0000","last_unstale":"2023-12-22T08:46:12.024742+0000","last_undegraded":"2023-12-22T08:46:12.024742+0000","last_fullsized":"2023-12-22T08:46:12.024742+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:24.020932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.053811+0000","last_change":"2023-12-22T08:46:11.053472+0000","last_active":"2023-12-22T08:46:11.053811+0000","last_peered":"2023-12-22T08:46:11.053811+0000","last_clean":"2023-12-22T08:46:11.053811+0000","last_became_active":"2023-12-22T08:46:11.051122+0000","last_became_peered":"2023-12-22T08:46:11.051122+0000","last_unstale":"2023-12-22T08:46:11.053811+0000","last_undegraded":"2023-12-22T08:46:11.053811+0000","last_fullsized":"2023-12-22T08:46:11.053811+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:37:16.118123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.051165+0000","last_change":"2023-12-22T08:46:11.051075+0000","last_active":"2023-12-22T08:46:11.051165+0000","last_peered":"2023-12-22T08:46:11.051165+0000","last_clean":"2023-12-22T08:46:11.051165+0000","last_became_active":"2023-12-22T08:46:11.049819+0000","last_became_peered":"2023-12-22T08:46:11.049819+0000","last_unstale":"2023-12-22T08:46:11.051165+0000","last_undegraded":"2023-12-22T08:46:11.051165+0000","last_fullsized":"2023-12-22T08:46:11.051165+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:41.251857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.045500+0000","last_change":"2023-12-22T08:46:11.045409+0000","last_active":"2023-12-22T08:46:11.045500+0000","last_peered":"2023-12-22T08:46:11.045500+0000","last_clean":"2023-12-22T08:46:11.045500+0000","last_became_active":"2023-12-22T08:46:11.043779+0000","last_became_peered":"2023-12-22T08:46:11.043779+0000","last_unstale":"2023-12-22T08:46:11.045500+0000","last_undegraded":"2023-12-22T08:46:11.045500+0000","last_fullsized":"2023-12-22T08:46:11.045500+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:03.877163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.028962+0000","last_change":"2023-12-22T08:46:11.043255+0000","last_active":"2023-12-22T08:46:12.028962+0000","last_peered":"2023-12-22T08:46:12.028962+0000","last_clean":"2023-12-22T08:46:12.028962+0000","last_became_active":"2023-12-22T08:46:11.034411+0000","last_became_peered":"2023-12-22T08:46:11.034411+0000","last_unstale":"2023-12-22T08:46:12.028962+0000","last_undegraded":"2023-12-22T08:46:12.028962+0000","last_fullsized":"2023-12-22T08:46:12.028962+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:41.251857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.051655+0000","last_change":"2023-12-22T08:46:11.051512+0000","last_active":"2023-12-22T08:46:11.051655+0000","last_peered":"2023-12-22T08:46:11.051655+0000","last_clean":"2023-12-22T08:46:11.051655+0000","last_became_active":"2023-12-22T08:46:11.050303+0000","last_became_peered":"2023-12-22T08:46:11.050303+0000","last_unstale":"2023-12-22T08:46:11.051655+0000","last_undegraded":"2023-12-22T08:46:11.051655+0000","last_fullsized":"2023-12-22T08:46:11.051655+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:25:43.481886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.392376+0000","last_change":"2023-12-22T08:46:11.034063+0000","last_active":"2023-12-22T08:46:13.392376+0000","last_peered":"2023-12-22T08:46:13.392376+0000","last_clean":"2023-12-22T08:46:13.392376+0000","last_became_active":"2023-12-22T08:46:11.032875+0000","last_became_peered":"2023-12-22T08:46:11.032875+0000","last_unstale":"2023-12-22T08:46:13.392376+0000","last_undegraded":"2023-12-22T08:46:13.392376+0000","last_fullsized":"2023-12-22T08:46:13.392376+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:18:17.194704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026170+0000","last_change":"2023-12-22T08:46:11.057155+0000","last_active":"2023-12-22T08:46:12.026170+0000","last_peered":"2023-12-22T08:46:12.026170+0000","last_clean":"2023-12-22T08:46:12.026170+0000","last_became_active":"2023-12-22T08:46:11.056608+0000","last_became_peered":"2023-12-22T08:46:11.056608+0000","last_unstale":"2023-12-22T08:46:12.026170+0000","last_undegraded":"2023-12-22T08:46:12.026170+0000","last_fullsized":"2023-12-22T08:46:12.026170+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:40.788407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024635+0000","last_change":"2023-12-22T08:46:11.056300+0000","last_active":"2023-12-22T08:46:12.024635+0000","last_peered":"2023-12-22T08:46:12.024635+0000","last_clean":"2023-12-22T08:46:12.024635+0000","last_became_active":"2023-12-22T08:46:11.055686+0000","last_became_peered":"2023-12-22T08:46:11.055686+0000","last_unstale":"2023-12-22T08:46:12.024635+0000","last_undegraded":"2023-12-22T08:46:12.024635+0000","last_fullsized":"2023-12-22T08:46:12.024635+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:28.575655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.032879+0000","last_change":"2023-12-22T08:46:11.032609+0000","last_active":"2023-12-22T08:46:11.032879+0000","last_peered":"2023-12-22T08:46:11.032879+0000","last_clean":"2023-12-22T08:46:11.032879+0000","last_became_active":"2023-12-22T08:46:11.032391+0000","last_became_peered":"2023-12-22T08:46:11.032391+0000","last_unstale":"2023-12-22T08:46:11.032879+0000","last_undegraded":"2023-12-22T08:46:11.032879+0000","last_fullsized":"2023-12-22T08:46:11.032879+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:52:00.531522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.051637+0000","last_change":"2023-12-22T08:46:11.051159+0000","last_active":"2023-12-22T08:46:11.051637+0000","last_peered":"2023-12-22T08:46:11.051637+0000","last_clean":"2023-12-22T08:46:11.051637+0000","last_became_active":"2023-12-22T08:46:11.049733+0000","last_became_peered":"2023-12-22T08:46:11.049733+0000","last_unstale":"2023-12-22T08:46:11.051637+0000","last_undegraded":"2023-12-22T08:46:11.051637+0000","last_fullsized":"2023-12-22T08:46:11.051637+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:09.504250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027766+0000","last_change":"2023-12-22T08:46:11.049880+0000","last_active":"2023-12-22T08:46:12.027766+0000","last_peered":"2023-12-22T08:46:12.027766+0000","last_clean":"2023-12-22T08:46:12.027766+0000","last_became_active":"2023-12-22T08:46:11.049216+0000","last_became_peered":"2023-12-22T08:46:11.049216+0000","last_unstale":"2023-12-22T08:46:12.027766+0000","last_undegraded":"2023-12-22T08:46:12.027766+0000","last_fullsized":"2023-12-22T08:46:12.027766+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:40.788407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026434+0000","last_change":"2023-12-22T08:46:11.057305+0000","last_active":"2023-12-22T08:46:12.026434+0000","last_peered":"2023-12-22T08:46:12.026434+0000","last_clean":"2023-12-22T08:46:12.026434+0000","last_became_active":"2023-12-22T08:46:11.056917+0000","last_became_peered":"2023-12-22T08:46:11.056917+0000","last_unstale":"2023-12-22T08:46:12.026434+0000","last_undegraded":"2023-12-22T08:46:12.026434+0000","last_fullsized":"2023-12-22T08:46:12.026434+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:51:25.597889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027407+0000","last_change":"2023-12-22T08:46:11.055914+0000","last_active":"2023-12-22T08:46:12.027407+0000","last_peered":"2023-12-22T08:46:12.027407+0000","last_clean":"2023-12-22T08:46:12.027407+0000","last_became_active":"2023-12-22T08:46:11.055686+0000","last_became_peered":"2023-12-22T08:46:11.055686+0000","last_unstale":"2023-12-22T08:46:12.027407+0000","last_undegraded":"2023-12-22T08:46:12.027407+0000","last_fullsized":"2023-12-22T08:46:12.027407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:49:16.929281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048632+0000","last_change":"2023-12-22T08:46:11.045608+0000","last_active":"2023-12-22T08:46:11.048632+0000","last_peered":"2023-12-22T08:46:11.048632+0000","last_clean":"2023-12-22T08:46:11.048632+0000","last_became_active":"2023-12-22T08:46:11.045307+0000","last_became_peered":"2023-12-22T08:46:11.045307+0000","last_unstale":"2023-12-22T08:46:11.048632+0000","last_undegraded":"2023-12-22T08:46:11.048632+0000","last_fullsized":"2023-12-22T08:46:11.048632+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:51.163696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.028238+0000","last_change":"2023-12-22T08:46:11.054792+0000","last_active":"2023-12-22T08:46:12.028238+0000","last_peered":"2023-12-22T08:46:12.028238+0000","last_clean":"2023-12-22T08:46:12.028238+0000","last_became_active":"2023-12-22T08:46:11.053145+0000","last_became_peered":"2023-12-22T08:46:11.053145+0000","last_unstale":"2023-12-22T08:46:12.028238+0000","last_undegraded":"2023-12-22T08:46:12.028238+0000","last_fullsized":"2023-12-22T08:46:12.028238+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:46.906772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.049112+0000","last_change":"2023-12-22T08:46:11.049027+0000","last_active":"2023-12-22T08:46:11.049112+0000","last_peered":"2023-12-22T08:46:11.049112+0000","last_clean":"2023-12-22T08:46:11.049112+0000","last_became_active":"2023-12-22T08:46:11.048786+0000","last_became_peered":"2023-12-22T08:46:11.048786+0000","last_unstale":"2023-12-22T08:46:11.049112+0000","last_undegraded":"2023-12-22T08:46:11.049112+0000","last_fullsized":"2023-12-22T08:46:11.049112+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:00:32.952933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026754+0000","last_change":"2023-12-22T08:46:11.046272+0000","last_active":"2023-12-22T08:46:12.026754+0000","last_peered":"2023-12-22T08:46:12.026754+0000","last_clean":"2023-12-22T08:46:12.026754+0000","last_became_active":"2023-12-22T08:46:11.046029+0000","last_became_peered":"2023-12-22T08:46:11.046029+0000","last_unstale":"2023-12-22T08:46:12.026754+0000","last_undegraded":"2023-12-22T08:46:12.026754+0000","last_fullsized":"2023-12-22T08:46:12.026754+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:44:02.430317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.029580+0000","last_change":"2023-12-22T08:46:11.029694+0000","last_active":"2023-12-22T08:46:12.029580+0000","last_peered":"2023-12-22T08:46:12.029580+0000","last_clean":"2023-12-22T08:46:12.029580+0000","last_became_active":"2023-12-22T08:46:11.029047+0000","last_became_peered":"2023-12-22T08:46:11.029047+0000","last_unstale":"2023-12-22T08:46:12.029580+0000","last_undegraded":"2023-12-22T08:46:12.029580+0000","last_fullsized":"2023-12-22T08:46:12.029580+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:47.914410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.392773+0000","last_change":"2023-12-22T08:46:11.037301+0000","last_active":"2023-12-22T08:46:13.392773+0000","last_peered":"2023-12-22T08:46:13.392773+0000","last_clean":"2023-12-22T08:46:13.392773+0000","last_became_active":"2023-12-22T08:46:11.036887+0000","last_became_peered":"2023-12-22T08:46:11.036887+0000","last_unstale":"2023-12-22T08:46:13.392773+0000","last_undegraded":"2023-12-22T08:46:13.392773+0000","last_fullsized":"2023-12-22T08:46:13.392773+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:20.635968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.392675+0000","last_change":"2023-12-22T08:46:11.045165+0000","last_active":"2023-12-22T08:46:13.392675+0000","last_peered":"2023-12-22T08:46:13.392675+0000","last_clean":"2023-12-22T08:46:13.392675+0000","last_became_active":"2023-12-22T08:46:11.044591+0000","last_became_peered":"2023-12-22T08:46:11.044591+0000","last_unstale":"2023-12-22T08:46:13.392675+0000","last_undegraded":"2023-12-22T08:46:13.392675+0000","last_fullsized":"2023-12-22T08:46:13.392675+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:03:57.979012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.037607+0000","last_change":"2023-12-22T08:46:11.037345+0000","last_active":"2023-12-22T08:46:11.037607+0000","last_peered":"2023-12-22T08:46:11.037607+0000","last_clean":"2023-12-22T08:46:11.037607+0000","last_became_active":"2023-12-22T08:46:11.036529+0000","last_became_peered":"2023-12-22T08:46:11.036529+0000","last_unstale":"2023-12-22T08:46:11.037607+0000","last_undegraded":"2023-12-22T08:46:11.037607+0000","last_fullsized":"2023-12-22T08:46:11.037607+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:14:22.771654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.049858+0000","last_change":"2023-12-22T08:46:11.049412+0000","last_active":"2023-12-22T08:46:11.049858+0000","last_peered":"2023-12-22T08:46:11.049858+0000","last_clean":"2023-12-22T08:46:11.049858+0000","last_became_active":"2023-12-22T08:46:11.048533+0000","last_became_peered":"2023-12-22T08:46:11.048533+0000","last_unstale":"2023-12-22T08:46:11.049858+0000","last_undegraded":"2023-12-22T08:46:11.049858+0000","last_fullsized":"2023-12-22T08:46:11.049858+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:24.020932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027199+0000","last_change":"2023-12-22T08:46:11.053979+0000","last_active":"2023-12-22T08:46:12.027199+0000","last_peered":"2023-12-22T08:46:12.027199+0000","last_clean":"2023-12-22T08:46:12.027199+0000","last_became_active":"2023-12-22T08:46:11.053739+0000","last_became_peered":"2023-12-22T08:46:11.053739+0000","last_unstale":"2023-12-22T08:46:12.027199+0000","last_undegraded":"2023-12-22T08:46:12.027199+0000","last_fullsized":"2023-12-22T08:46:12.027199+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:11:34.215769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048094+0000","last_change":"2023-12-22T08:46:11.047688+0000","last_active":"2023-12-22T08:46:11.048094+0000","last_peered":"2023-12-22T08:46:11.048094+0000","last_clean":"2023-12-22T08:46:11.048094+0000","last_became_active":"2023-12-22T08:46:11.045738+0000","last_became_peered":"2023-12-22T08:46:11.045738+0000","last_unstale":"2023-12-22T08:46:11.048094+0000","last_undegraded":"2023-12-22T08:46:11.048094+0000","last_fullsized":"2023-12-22T08:46:11.048094+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:31.174659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048372+0000","last_change":"2023-12-22T08:46:11.048294+0000","last_active":"2023-12-22T08:46:11.048372+0000","last_peered":"2023-12-22T08:46:11.048372+0000","last_clean":"2023-12-22T08:46:11.048372+0000","last_became_active":"2023-12-22T08:46:11.047009+0000","last_became_peered":"2023-12-22T08:46:11.047009+0000","last_unstale":"2023-12-22T08:46:11.048372+0000","last_undegraded":"2023-12-22T08:46:11.048372+0000","last_fullsized":"2023-12-22T08:46:11.048372+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:02:30.245567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.041479+0000","last_change":"2023-12-22T08:46:11.039402+0000","last_active":"2023-12-22T08:46:11.041479+0000","last_peered":"2023-12-22T08:46:11.041479+0000","last_clean":"2023-12-22T08:46:11.041479+0000","last_became_active":"2023-12-22T08:46:11.039116+0000","last_became_peered":"2023-12-22T08:46:11.039116+0000","last_unstale":"2023-12-22T08:46:11.041479+0000","last_undegraded":"2023-12-22T08:46:11.041479+0000","last_fullsized":"2023-12-22T08:46:11.041479+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:27:08.201555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"109'4","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.393574+0000","last_change":"2023-12-22T08:46:10.519168+0000","last_active":"2023-12-22T08:46:13.393574+0000","last_peered":"2023-12-22T08:46:13.393574+0000","last_clean":"2023-12-22T08:46:13.393574+0000","last_became_active":"2023-12-22T08:46:10.518506+0000","last_became_peered":"2023-12-22T08:46:10.518506+0000","last_unstale":"2023-12-22T08:46:13.393574+0000","last_undegraded":"2023-12-22T08:46:13.393574+0000","last_fullsized":"2023-12-22T08:46:13.393574+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:51:26.990460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.041406+0000","last_change":"2023-12-22T08:46:11.040121+0000","last_active":"2023-12-22T08:46:11.041406+0000","last_peered":"2023-12-22T08:46:11.041406+0000","last_clean":"2023-12-22T08:46:11.041406+0000","last_became_active":"2023-12-22T08:46:11.039740+0000","last_became_peered":"2023-12-22T08:46:11.039740+0000","last_unstale":"2023-12-22T08:46:11.041406+0000","last_undegraded":"2023-12-22T08:46:11.041406+0000","last_fullsized":"2023-12-22T08:46:11.041406+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:40.788407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"109'1","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048719+0000","last_change":"2023-12-22T08:46:10.542385+0000","last_active":"2023-12-22T08:46:11.048719+0000","last_peered":"2023-12-22T08:46:11.048719+0000","last_clean":"2023-12-22T08:46:11.048719+0000","last_became_active":"2023-12-22T08:46:10.542183+0000","last_became_peered":"2023-12-22T08:46:10.542183+0000","last_unstale":"2023-12-22T08:46:11.048719+0000","last_undegraded":"2023-12-22T08:46:11.048719+0000","last_fullsized":"2023-12-22T08:46:11.048719+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:08.489668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.053344+0000","last_change":"2023-12-22T08:46:11.053235+0000","last_active":"2023-12-22T08:46:11.053344+0000","last_peered":"2023-12-22T08:46:11.053344+0000","last_clean":"2023-12-22T08:46:11.053344+0000","last_became_active":"2023-12-22T08:46:11.052905+0000","last_became_peered":"2023-12-22T08:46:11.052905+0000","last_unstale":"2023-12-22T08:46:11.053344+0000","last_undegraded":"2023-12-22T08:46:11.053344+0000","last_fullsized":"2023-12-22T08:46:11.053344+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:05:28.593431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.029887+0000","last_change":"2023-12-22T08:46:10.537623+0000","last_active":"2023-12-22T08:46:12.029887+0000","last_peered":"2023-12-22T08:46:12.029887+0000","last_clean":"2023-12-22T08:46:12.029887+0000","last_became_active":"2023-12-22T08:46:10.536888+0000","last_became_peered":"2023-12-22T08:46:10.536888+0000","last_unstale":"2023-12-22T08:46:12.029887+0000","last_undegraded":"2023-12-22T08:46:12.029887+0000","last_fullsized":"2023-12-22T08:46:12.029887+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:50.237711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.049237+0000","last_change":"2023-12-22T08:46:11.049177+0000","last_active":"2023-12-22T08:46:11.049237+0000","last_peered":"2023-12-22T08:46:11.049237+0000","last_clean":"2023-12-22T08:46:11.049237+0000","last_became_active":"2023-12-22T08:46:11.048693+0000","last_became_peered":"2023-12-22T08:46:11.048693+0000","last_unstale":"2023-12-22T08:46:11.049237+0000","last_undegraded":"2023-12-22T08:46:11.049237+0000","last_fullsized":"2023-12-22T08:46:11.049237+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:31:11.707403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"109'2","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.053164+0000","last_change":"2023-12-22T08:46:10.526784+0000","last_active":"2023-12-22T08:46:11.053164+0000","last_peered":"2023-12-22T08:46:11.053164+0000","last_clean":"2023-12-22T08:46:11.053164+0000","last_became_active":"2023-12-22T08:46:10.525921+0000","last_became_peered":"2023-12-22T08:46:10.525921+0000","last_unstale":"2023-12-22T08:46:11.053164+0000","last_undegraded":"2023-12-22T08:46:11.053164+0000","last_fullsized":"2023-12-22T08:46:11.053164+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:50:06.237184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048687+0000","last_change":"2023-12-22T08:46:11.048338+0000","last_active":"2023-12-22T08:46:11.048687+0000","last_peered":"2023-12-22T08:46:11.048687+0000","last_clean":"2023-12-22T08:46:11.048687+0000","last_became_active":"2023-12-22T08:46:11.047981+0000","last_became_peered":"2023-12-22T08:46:11.047981+0000","last_unstale":"2023-12-22T08:46:11.048687+0000","last_undegraded":"2023-12-22T08:46:11.048687+0000","last_fullsized":"2023-12-22T08:46:11.048687+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:11.510313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"109'1","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.044280+0000","last_change":"2023-12-22T08:46:10.536129+0000","last_active":"2023-12-22T08:46:11.044280+0000","last_peered":"2023-12-22T08:46:11.044280+0000","last_clean":"2023-12-22T08:46:11.044280+0000","last_became_active":"2023-12-22T08:46:10.535598+0000","last_became_peered":"2023-12-22T08:46:10.535598+0000","last_unstale":"2023-12-22T08:46:11.044280+0000","last_undegraded":"2023-12-22T08:46:11.044280+0000","last_fullsized":"2023-12-22T08:46:11.044280+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:40.237275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048586+0000","last_change":"2023-12-22T08:46:11.048495+0000","last_active":"2023-12-22T08:46:11.048586+0000","last_peered":"2023-12-22T08:46:11.048586+0000","last_clean":"2023-12-22T08:46:11.048586+0000","last_became_active":"2023-12-22T08:46:11.047866+0000","last_became_peered":"2023-12-22T08:46:11.047866+0000","last_unstale":"2023-12-22T08:46:11.048586+0000","last_undegraded":"2023-12-22T08:46:11.048586+0000","last_fullsized":"2023-12-22T08:46:11.048586+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:54:38.806422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"109'1","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.053180+0000","last_change":"2023-12-22T08:46:10.527943+0000","last_active":"2023-12-22T08:46:11.053180+0000","last_peered":"2023-12-22T08:46:11.053180+0000","last_clean":"2023-12-22T08:46:11.053180+0000","last_became_active":"2023-12-22T08:46:10.527183+0000","last_became_peered":"2023-12-22T08:46:10.527183+0000","last_unstale":"2023-12-22T08:46:11.053180+0000","last_undegraded":"2023-12-22T08:46:11.053180+0000","last_fullsized":"2023-12-22T08:46:11.053180+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:30:02.506914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.049118+0000","last_change":"2023-12-22T08:46:11.049045+0000","last_active":"2023-12-22T08:46:11.049118+0000","last_peered":"2023-12-22T08:46:11.049118+0000","last_clean":"2023-12-22T08:46:11.049118+0000","last_became_active":"2023-12-22T08:46:11.048341+0000","last_became_peered":"2023-12-22T08:46:11.048341+0000","last_unstale":"2023-12-22T08:46:11.049118+0000","last_undegraded":"2023-12-22T08:46:11.049118+0000","last_fullsized":"2023-12-22T08:46:11.049118+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:42:25.840694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027097+0000","last_change":"2023-12-22T08:46:10.544131+0000","last_active":"2023-12-22T08:46:12.027097+0000","last_peered":"2023-12-22T08:46:12.027097+0000","last_clean":"2023-12-22T08:46:12.027097+0000","last_became_active":"2023-12-22T08:46:10.543727+0000","last_became_peered":"2023-12-22T08:46:10.543727+0000","last_unstale":"2023-12-22T08:46:12.027097+0000","last_undegraded":"2023-12-22T08:46:12.027097+0000","last_fullsized":"2023-12-22T08:46:12.027097+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:12:08.681748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026677+0000","last_change":"2023-12-22T08:46:11.043823+0000","last_active":"2023-12-22T08:46:12.026677+0000","last_peered":"2023-12-22T08:46:12.026677+0000","last_clean":"2023-12-22T08:46:12.026677+0000","last_became_active":"2023-12-22T08:46:11.041943+0000","last_became_peered":"2023-12-22T08:46:11.041943+0000","last_unstale":"2023-12-22T08:46:12.026677+0000","last_undegraded":"2023-12-22T08:46:12.026677+0000","last_fullsized":"2023-12-22T08:46:12.026677+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:41.251857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027589+0000","last_change":"2023-12-22T08:46:10.544851+0000","last_active":"2023-12-22T08:46:12.027589+0000","last_peered":"2023-12-22T08:46:12.027589+0000","last_clean":"2023-12-22T08:46:12.027589+0000","last_became_active":"2023-12-22T08:46:10.544318+0000","last_became_peered":"2023-12-22T08:46:10.544318+0000","last_unstale":"2023-12-22T08:46:12.027589+0000","last_undegraded":"2023-12-22T08:46:12.027589+0000","last_fullsized":"2023-12-22T08:46:12.027589+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:30:48.146204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027916+0000","last_change":"2023-12-22T08:46:11.054579+0000","last_active":"2023-12-22T08:46:12.027916+0000","last_peered":"2023-12-22T08:46:12.027916+0000","last_clean":"2023-12-22T08:46:12.027916+0000","last_became_active":"2023-12-22T08:46:11.052397+0000","last_became_peered":"2023-12-22T08:46:11.052397+0000","last_unstale":"2023-12-22T08:46:12.027916+0000","last_undegraded":"2023-12-22T08:46:12.027916+0000","last_fullsized":"2023-12-22T08:46:12.027916+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:04:12.172382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.035216+0000","last_change":"2023-12-22T08:46:10.540176+0000","last_active":"2023-12-22T08:46:11.035216+0000","last_peered":"2023-12-22T08:46:11.035216+0000","last_clean":"2023-12-22T08:46:11.035216+0000","last_became_active":"2023-12-22T08:46:10.539548+0000","last_became_peered":"2023-12-22T08:46:10.539548+0000","last_unstale":"2023-12-22T08:46:11.035216+0000","last_undegraded":"2023-12-22T08:46:11.035216+0000","last_fullsized":"2023-12-22T08:46:11.035216+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:45:20.212930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.047685+0000","last_change":"2023-12-22T08:46:11.047211+0000","last_active":"2023-12-22T08:46:11.047685+0000","last_peered":"2023-12-22T08:46:11.047685+0000","last_clean":"2023-12-22T08:46:11.047685+0000","last_became_active":"2023-12-22T08:46:11.046958+0000","last_became_peered":"2023-12-22T08:46:11.046958+0000","last_unstale":"2023-12-22T08:46:11.047685+0000","last_undegraded":"2023-12-22T08:46:11.047685+0000","last_fullsized":"2023-12-22T08:46:11.047685+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:07:38.207334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.029838+0000","last_change":"2023-12-22T08:46:10.538381+0000","last_active":"2023-12-22T08:46:11.029838+0000","last_peered":"2023-12-22T08:46:11.029838+0000","last_clean":"2023-12-22T08:46:11.029838+0000","last_became_active":"2023-12-22T08:46:10.537776+0000","last_became_peered":"2023-12-22T08:46:10.537776+0000","last_unstale":"2023-12-22T08:46:11.029838+0000","last_undegraded":"2023-12-22T08:46:11.029838+0000","last_fullsized":"2023-12-22T08:46:11.029838+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:17:57.950255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026941+0000","last_change":"2023-12-22T08:46:11.035928+0000","last_active":"2023-12-22T08:46:12.026941+0000","last_peered":"2023-12-22T08:46:12.026941+0000","last_clean":"2023-12-22T08:46:12.026941+0000","last_became_active":"2023-12-22T08:46:11.031662+0000","last_became_peered":"2023-12-22T08:46:11.031662+0000","last_unstale":"2023-12-22T08:46:12.026941+0000","last_undegraded":"2023-12-22T08:46:12.026941+0000","last_fullsized":"2023-12-22T08:46:12.026941+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:02.869321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"109'3","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.046740+0000","last_change":"2023-12-22T08:46:10.540184+0000","last_active":"2023-12-22T08:46:11.046740+0000","last_peered":"2023-12-22T08:46:11.046740+0000","last_clean":"2023-12-22T08:46:11.046740+0000","last_became_active":"2023-12-22T08:46:10.539295+0000","last_became_peered":"2023-12-22T08:46:10.539295+0000","last_unstale":"2023-12-22T08:46:11.046740+0000","last_undegraded":"2023-12-22T08:46:11.046740+0000","last_fullsized":"2023-12-22T08:46:11.046740+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:52:11.740354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.392627+0000","last_change":"2023-12-22T08:46:11.044645+0000","last_active":"2023-12-22T08:46:13.392627+0000","last_peered":"2023-12-22T08:46:13.392627+0000","last_clean":"2023-12-22T08:46:13.392627+0000","last_became_active":"2023-12-22T08:46:11.044135+0000","last_became_peered":"2023-12-22T08:46:11.044135+0000","last_unstale":"2023-12-22T08:46:13.392627+0000","last_undegraded":"2023-12-22T08:46:13.392627+0000","last_fullsized":"2023-12-22T08:46:13.392627+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:12.676435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"109'6","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.055481+0000","last_change":"2023-12-22T08:46:10.542699+0000","last_active":"2023-12-22T08:46:11.055481+0000","last_peered":"2023-12-22T08:46:11.055481+0000","last_clean":"2023-12-22T08:46:11.055481+0000","last_became_active":"2023-12-22T08:46:10.541103+0000","last_became_peered":"2023-12-22T08:46:10.541103+0000","last_unstale":"2023-12-22T08:46:11.055481+0000","last_undegraded":"2023-12-22T08:46:11.055481+0000","last_fullsized":"2023-12-22T08:46:11.055481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:51:24.583307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.029167+0000","last_change":"2023-12-22T08:46:11.048774+0000","last_active":"2023-12-22T08:46:12.029167+0000","last_peered":"2023-12-22T08:46:12.029167+0000","last_clean":"2023-12-22T08:46:12.029167+0000","last_became_active":"2023-12-22T08:46:11.048555+0000","last_became_peered":"2023-12-22T08:46:11.048555+0000","last_unstale":"2023-12-22T08:46:12.029167+0000","last_undegraded":"2023-12-22T08:46:12.029167+0000","last_fullsized":"2023-12-22T08:46:12.029167+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:51:25.597889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"109'2","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.057005+0000","last_change":"2023-12-22T08:46:10.530290+0000","last_active":"2023-12-22T08:46:11.057005+0000","last_peered":"2023-12-22T08:46:11.057005+0000","last_clean":"2023-12-22T08:46:11.057005+0000","last_became_active":"2023-12-22T08:46:10.529662+0000","last_became_peered":"2023-12-22T08:46:10.529662+0000","last_unstale":"2023-12-22T08:46:11.057005+0000","last_undegraded":"2023-12-22T08:46:11.057005+0000","last_fullsized":"2023-12-22T08:46:11.057005+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:27:56.461932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048971+0000","last_change":"2023-12-22T08:46:11.048895+0000","last_active":"2023-12-22T08:46:11.048971+0000","last_peered":"2023-12-22T08:46:11.048971+0000","last_clean":"2023-12-22T08:46:11.048971+0000","last_became_active":"2023-12-22T08:46:11.046395+0000","last_became_peered":"2023-12-22T08:46:11.046395+0000","last_unstale":"2023-12-22T08:46:11.048971+0000","last_undegraded":"2023-12-22T08:46:11.048971+0000","last_fullsized":"2023-12-22T08:46:11.048971+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:11:34.215769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024514+0000","last_change":"2023-12-22T08:46:10.536329+0000","last_active":"2023-12-22T08:46:12.024514+0000","last_peered":"2023-12-22T08:46:12.024514+0000","last_clean":"2023-12-22T08:46:12.024514+0000","last_became_active":"2023-12-22T08:46:10.535469+0000","last_became_peered":"2023-12-22T08:46:10.535469+0000","last_unstale":"2023-12-22T08:46:12.024514+0000","last_undegraded":"2023-12-22T08:46:12.024514+0000","last_fullsized":"2023-12-22T08:46:12.024514+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:17:57.950255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026179+0000","last_change":"2023-12-22T08:46:11.053902+0000","last_active":"2023-12-22T08:46:12.026179+0000","last_peered":"2023-12-22T08:46:12.026179+0000","last_clean":"2023-12-22T08:46:12.026179+0000","last_became_active":"2023-12-22T08:46:11.053587+0000","last_became_peered":"2023-12-22T08:46:11.053587+0000","last_unstale":"2023-12-22T08:46:12.026179+0000","last_undegraded":"2023-12-22T08:46:12.026179+0000","last_fullsized":"2023-12-22T08:46:12.026179+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:44:02.430317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.029935+0000","last_change":"2023-12-22T08:46:10.538113+0000","last_active":"2023-12-22T08:46:11.029935+0000","last_peered":"2023-12-22T08:46:11.029935+0000","last_clean":"2023-12-22T08:46:11.029935+0000","last_became_active":"2023-12-22T08:46:10.537144+0000","last_became_peered":"2023-12-22T08:46:10.537144+0000","last_unstale":"2023-12-22T08:46:11.029935+0000","last_undegraded":"2023-12-22T08:46:11.029935+0000","last_fullsized":"2023-12-22T08:46:11.029935+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:27:56.461932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.028301+0000","last_change":"2023-12-22T08:46:11.048880+0000","last_active":"2023-12-22T08:46:12.028301+0000","last_peered":"2023-12-22T08:46:12.028301+0000","last_clean":"2023-12-22T08:46:12.028301+0000","last_became_active":"2023-12-22T08:46:11.047198+0000","last_became_peered":"2023-12-22T08:46:11.047198+0000","last_unstale":"2023-12-22T08:46:12.028301+0000","last_undegraded":"2023-12-22T08:46:12.028301+0000","last_fullsized":"2023-12-22T08:46:12.028301+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:50:46.906772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"109'8","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.029552+0000","last_change":"2023-12-22T08:46:10.525406+0000","last_active":"2023-12-22T08:46:12.029552+0000","last_peered":"2023-12-22T08:46:12.029552+0000","last_clean":"2023-12-22T08:46:12.029552+0000","last_became_active":"2023-12-22T08:46:10.524120+0000","last_became_peered":"2023-12-22T08:46:10.524120+0000","last_unstale":"2023-12-22T08:46:12.029552+0000","last_undegraded":"2023-12-22T08:46:12.029552+0000","last_fullsized":"2023-12-22T08:46:12.029552+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:34.011450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.046810+0000","last_change":"2023-12-22T08:46:11.046631+0000","last_active":"2023-12-22T08:46:11.046810+0000","last_peered":"2023-12-22T08:46:11.046810+0000","last_clean":"2023-12-22T08:46:11.046810+0000","last_became_active":"2023-12-22T08:46:11.045712+0000","last_became_peered":"2023-12-22T08:46:11.045712+0000","last_unstale":"2023-12-22T08:46:11.046810+0000","last_undegraded":"2023-12-22T08:46:11.046810+0000","last_fullsized":"2023-12-22T08:46:11.046810+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:30:03.521496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.393028+0000","last_change":"2023-12-22T08:46:10.538874+0000","last_active":"2023-12-22T08:46:13.393028+0000","last_peered":"2023-12-22T08:46:13.393028+0000","last_clean":"2023-12-22T08:46:13.393028+0000","last_became_active":"2023-12-22T08:46:10.538520+0000","last_became_peered":"2023-12-22T08:46:10.538520+0000","last_unstale":"2023-12-22T08:46:13.393028+0000","last_undegraded":"2023-12-22T08:46:13.393028+0000","last_fullsized":"2023-12-22T08:46:13.393028+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:50.061043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.038599+0000","last_change":"2023-12-22T08:46:11.038135+0000","last_active":"2023-12-22T08:46:11.038599+0000","last_peered":"2023-12-22T08:46:11.038599+0000","last_clean":"2023-12-22T08:46:11.038599+0000","last_became_active":"2023-12-22T08:46:11.037832+0000","last_became_peered":"2023-12-22T08:46:11.037832+0000","last_unstale":"2023-12-22T08:46:11.038599+0000","last_undegraded":"2023-12-22T08:46:11.038599+0000","last_fullsized":"2023-12-22T08:46:11.038599+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:48:15.869745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.027921+0000","last_change":"2023-12-22T08:46:10.544974+0000","last_active":"2023-12-22T08:46:12.027921+0000","last_peered":"2023-12-22T08:46:12.027921+0000","last_clean":"2023-12-22T08:46:12.027921+0000","last_became_active":"2023-12-22T08:46:10.544682+0000","last_became_peered":"2023-12-22T08:46:10.544682+0000","last_unstale":"2023-12-22T08:46:12.027921+0000","last_undegraded":"2023-12-22T08:46:12.027921+0000","last_fullsized":"2023-12-22T08:46:12.027921+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:01:50.237711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.046518+0000","last_change":"2023-12-22T08:46:11.045761+0000","last_active":"2023-12-22T08:46:11.046518+0000","last_peered":"2023-12-22T08:46:11.046518+0000","last_clean":"2023-12-22T08:46:11.046518+0000","last_became_active":"2023-12-22T08:46:11.045524+0000","last_became_peered":"2023-12-22T08:46:11.045524+0000","last_unstale":"2023-12-22T08:46:11.046518+0000","last_undegraded":"2023-12-22T08:46:11.046518+0000","last_fullsized":"2023-12-22T08:46:11.046518+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:27:57.476514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.028347+0000","last_change":"2023-12-22T08:46:10.543496+0000","last_active":"2023-12-22T08:46:12.028347+0000","last_peered":"2023-12-22T08:46:12.028347+0000","last_clean":"2023-12-22T08:46:12.028347+0000","last_became_active":"2023-12-22T08:46:10.543144+0000","last_became_peered":"2023-12-22T08:46:10.543144+0000","last_unstale":"2023-12-22T08:46:12.028347+0000","last_undegraded":"2023-12-22T08:46:12.028347+0000","last_fullsized":"2023-12-22T08:46:12.028347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:34.011450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024032+0000","last_change":"2023-12-22T08:46:11.045716+0000","last_active":"2023-12-22T08:46:12.024032+0000","last_peered":"2023-12-22T08:46:12.024032+0000","last_clean":"2023-12-22T08:46:12.024032+0000","last_became_active":"2023-12-22T08:46:11.045406+0000","last_became_peered":"2023-12-22T08:46:11.045406+0000","last_unstale":"2023-12-22T08:46:12.024032+0000","last_undegraded":"2023-12-22T08:46:12.024032+0000","last_fullsized":"2023-12-22T08:46:12.024032+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:03.877163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026408+0000","last_change":"2023-12-22T08:46:10.540191+0000","last_active":"2023-12-22T08:46:12.026408+0000","last_peered":"2023-12-22T08:46:12.026408+0000","last_clean":"2023-12-22T08:46:12.026408+0000","last_became_active":"2023-12-22T08:46:10.539860+0000","last_became_peered":"2023-12-22T08:46:10.539860+0000","last_unstale":"2023-12-22T08:46:12.026408+0000","last_undegraded":"2023-12-22T08:46:12.026408+0000","last_fullsized":"2023-12-22T08:46:12.026408+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:08:05.737332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.393458+0000","last_change":"2023-12-22T08:46:11.039758+0000","last_active":"2023-12-22T08:46:13.393458+0000","last_peered":"2023-12-22T08:46:13.393458+0000","last_clean":"2023-12-22T08:46:13.393458+0000","last_became_active":"2023-12-22T08:46:11.039537+0000","last_became_peered":"2023-12-22T08:46:11.039537+0000","last_unstale":"2023-12-22T08:46:13.393458+0000","last_undegraded":"2023-12-22T08:46:13.393458+0000","last_fullsized":"2023-12-22T08:46:13.393458+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:30.713185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024636+0000","last_change":"2023-12-22T08:46:10.533548+0000","last_active":"2023-12-22T08:46:12.024636+0000","last_peered":"2023-12-22T08:46:12.024636+0000","last_clean":"2023-12-22T08:46:12.024636+0000","last_became_active":"2023-12-22T08:46:10.533133+0000","last_became_peered":"2023-12-22T08:46:10.533133+0000","last_unstale":"2023-12-22T08:46:12.024636+0000","last_undegraded":"2023-12-22T08:46:12.024636+0000","last_fullsized":"2023-12-22T08:46:12.024636+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:56:08.489668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.048668+0000","last_change":"2023-12-22T08:46:11.048221+0000","last_active":"2023-12-22T08:46:11.048668+0000","last_peered":"2023-12-22T08:46:11.048668+0000","last_clean":"2023-12-22T08:46:11.048668+0000","last_became_active":"2023-12-22T08:46:11.047809+0000","last_became_peered":"2023-12-22T08:46:11.047809+0000","last_unstale":"2023-12-22T08:46:11.048668+0000","last_undegraded":"2023-12-22T08:46:11.048668+0000","last_fullsized":"2023-12-22T08:46:11.048668+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:33:03.877163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.030002+0000","last_change":"2023-12-22T08:46:10.528688+0000","last_active":"2023-12-22T08:46:12.030002+0000","last_peered":"2023-12-22T08:46:12.030002+0000","last_clean":"2023-12-22T08:46:12.030002+0000","last_became_active":"2023-12-22T08:46:10.528191+0000","last_became_peered":"2023-12-22T08:46:10.528191+0000","last_unstale":"2023-12-22T08:46:12.030002+0000","last_undegraded":"2023-12-22T08:46:12.030002+0000","last_fullsized":"2023-12-22T08:46:12.030002+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:30:48.146204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.051671+0000","last_change":"2023-12-22T08:46:11.051624+0000","last_active":"2023-12-22T08:46:11.051671+0000","last_peered":"2023-12-22T08:46:11.051671+0000","last_clean":"2023-12-22T08:46:11.051671+0000","last_became_active":"2023-12-22T08:46:11.051191+0000","last_became_peered":"2023-12-22T08:46:11.051191+0000","last_unstale":"2023-12-22T08:46:11.051671+0000","last_undegraded":"2023-12-22T08:46:11.051671+0000","last_fullsized":"2023-12-22T08:46:11.051671+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:17:58.964837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.026806+0000","last_change":"2023-12-22T08:46:10.542798+0000","last_active":"2023-12-22T08:46:12.026806+0000","last_peered":"2023-12-22T08:46:12.026806+0000","last_clean":"2023-12-22T08:46:12.026806+0000","last_became_active":"2023-12-22T08:46:10.542539+0000","last_became_peered":"2023-12-22T08:46:10.542539+0000","last_unstale":"2023-12-22T08:46:12.026806+0000","last_undegraded":"2023-12-22T08:46:12.026806+0000","last_fullsized":"2023-12-22T08:46:12.026806+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:45:20.212930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.392890+0000","last_change":"2023-12-22T08:46:11.036000+0000","last_active":"2023-12-22T08:46:13.392890+0000","last_peered":"2023-12-22T08:46:13.392890+0000","last_clean":"2023-12-22T08:46:13.392890+0000","last_became_active":"2023-12-22T08:46:11.035778+0000","last_became_peered":"2023-12-22T08:46:11.035778+0000","last_unstale":"2023-12-22T08:46:13.392890+0000","last_undegraded":"2023-12-22T08:46:13.392890+0000","last_fullsized":"2023-12-22T08:46:13.392890+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:52:56.850450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"109'2","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.028041+0000","last_change":"2023-12-22T08:46:10.542625+0000","last_active":"2023-12-22T08:46:12.028041+0000","last_peered":"2023-12-22T08:46:12.028041+0000","last_clean":"2023-12-22T08:46:12.028041+0000","last_became_active":"2023-12-22T08:46:10.542131+0000","last_became_peered":"2023-12-22T08:46:10.542131+0000","last_unstale":"2023-12-22T08:46:12.028041+0000","last_undegraded":"2023-12-22T08:46:12.028041+0000","last_fullsized":"2023-12-22T08:46:12.028041+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:52:11.740354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.392481+0000","last_change":"2023-12-22T08:46:11.045315+0000","last_active":"2023-12-22T08:46:13.392481+0000","last_peered":"2023-12-22T08:46:13.392481+0000","last_clean":"2023-12-22T08:46:13.392481+0000","last_became_active":"2023-12-22T08:46:11.044910+0000","last_became_peered":"2023-12-22T08:46:11.044910+0000","last_unstale":"2023-12-22T08:46:13.392481+0000","last_undegraded":"2023-12-22T08:46:13.392481+0000","last_fullsized":"2023-12-22T08:46:13.392481+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:19.301724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.029855+0000","last_change":"2023-12-22T08:46:10.527079+0000","last_active":"2023-12-22T08:46:12.029855+0000","last_peered":"2023-12-22T08:46:12.029855+0000","last_clean":"2023-12-22T08:46:12.029855+0000","last_became_active":"2023-12-22T08:46:10.526460+0000","last_became_peered":"2023-12-22T08:46:10.526460+0000","last_unstale":"2023-12-22T08:46:12.029855+0000","last_undegraded":"2023-12-22T08:46:12.029855+0000","last_fullsized":"2023-12-22T08:46:12.029855+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:11:42.253557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.393307+0000","last_change":"2023-12-22T08:46:11.043176+0000","last_active":"2023-12-22T08:46:13.393307+0000","last_peered":"2023-12-22T08:46:13.393307+0000","last_clean":"2023-12-22T08:46:13.393307+0000","last_became_active":"2023-12-22T08:46:11.042947+0000","last_became_peered":"2023-12-22T08:46:11.042947+0000","last_unstale":"2023-12-22T08:46:13.393307+0000","last_undegraded":"2023-12-22T08:46:13.393307+0000","last_fullsized":"2023-12-22T08:46:13.393307+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:54:38.777246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.038614+0000","last_change":"2023-12-22T08:46:10.541389+0000","last_active":"2023-12-22T08:46:11.038614+0000","last_peered":"2023-12-22T08:46:11.038614+0000","last_clean":"2023-12-22T08:46:11.038614+0000","last_became_active":"2023-12-22T08:46:10.539493+0000","last_became_peered":"2023-12-22T08:46:10.539493+0000","last_unstale":"2023-12-22T08:46:11.038614+0000","last_undegraded":"2023-12-22T08:46:11.038614+0000","last_fullsized":"2023-12-22T08:46:11.038614+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:04:11.157801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.042681+0000","last_change":"2023-12-22T08:46:11.042172+0000","last_active":"2023-12-22T08:46:11.042681+0000","last_peered":"2023-12-22T08:46:11.042681+0000","last_clean":"2023-12-22T08:46:11.042681+0000","last_became_active":"2023-12-22T08:46:11.041938+0000","last_became_peered":"2023-12-22T08:46:11.041938+0000","last_unstale":"2023-12-22T08:46:11.042681+0000","last_undegraded":"2023-12-22T08:46:11.042681+0000","last_fullsized":"2023-12-22T08:46:11.042681+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:09:37.601490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.030639+0000","last_change":"2023-12-22T08:46:10.542517+0000","last_active":"2023-12-22T08:46:11.030639+0000","last_peered":"2023-12-22T08:46:11.030639+0000","last_clean":"2023-12-22T08:46:11.030639+0000","last_became_active":"2023-12-22T08:46:10.542181+0000","last_became_peered":"2023-12-22T08:46:10.542181+0000","last_unstale":"2023-12-22T08:46:11.030639+0000","last_undegraded":"2023-12-22T08:46:11.030639+0000","last_fullsized":"2023-12-22T08:46:11.030639+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:27:07.186973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.041384+0000","last_change":"2023-12-22T08:46:11.039242+0000","last_active":"2023-12-22T08:46:11.041384+0000","last_peered":"2023-12-22T08:46:11.041384+0000","last_clean":"2023-12-22T08:46:11.041384+0000","last_became_active":"2023-12-22T08:46:11.038900+0000","last_became_peered":"2023-12-22T08:46:11.038900+0000","last_unstale":"2023-12-22T08:46:11.041384+0000","last_undegraded":"2023-12-22T08:46:11.041384+0000","last_fullsized":"2023-12-22T08:46:11.041384+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:35:00.187246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.024716+0000","last_change":"2023-12-22T08:46:10.536030+0000","last_active":"2023-12-22T08:46:12.024716+0000","last_peered":"2023-12-22T08:46:12.024716+0000","last_clean":"2023-12-22T08:46:12.024716+0000","last_became_active":"2023-12-22T08:46:10.534716+0000","last_became_peered":"2023-12-22T08:46:10.534716+0000","last_unstale":"2023-12-22T08:46:12.024716+0000","last_undegraded":"2023-12-22T08:46:12.024716+0000","last_fullsized":"2023-12-22T08:46:12.024716+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:27:07.186973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.029344+0000","last_change":"2023-12-22T08:46:11.035698+0000","last_active":"2023-12-22T08:46:12.029344+0000","last_peered":"2023-12-22T08:46:12.029344+0000","last_clean":"2023-12-22T08:46:12.029344+0000","last_became_active":"2023-12-22T08:46:11.033813+0000","last_became_peered":"2023-12-22T08:46:11.033813+0000","last_unstale":"2023-12-22T08:46:12.029344+0000","last_undegraded":"2023-12-22T08:46:12.029344+0000","last_fullsized":"2023-12-22T08:46:12.029344+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:04:12.172382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.030032+0000","last_change":"2023-12-22T08:46:10.533644+0000","last_active":"2023-12-22T08:46:11.030032+0000","last_peered":"2023-12-22T08:46:11.030032+0000","last_clean":"2023-12-22T08:46:11.030032+0000","last_became_active":"2023-12-22T08:46:10.529284+0000","last_became_peered":"2023-12-22T08:46:10.529284+0000","last_unstale":"2023-12-22T08:46:11.030032+0000","last_undegraded":"2023-12-22T08:46:11.030032+0000","last_fullsized":"2023-12-22T08:46:11.030032+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:51:58.756356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.041317+0000","last_change":"2023-12-22T08:46:11.038933+0000","last_active":"2023-12-22T08:46:11.041317+0000","last_peered":"2023-12-22T08:46:11.041317+0000","last_clean":"2023-12-22T08:46:11.041317+0000","last_became_active":"2023-12-22T08:46:11.038761+0000","last_became_peered":"2023-12-22T08:46:11.038761+0000","last_unstale":"2023-12-22T08:46:11.041317+0000","last_undegraded":"2023-12-22T08:46:11.041317+0000","last_fullsized":"2023-12-22T08:46:11.041317+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:44:02.430317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.034060+0000","last_change":"2023-12-22T08:46:10.540003+0000","last_active":"2023-12-22T08:46:11.034060+0000","last_peered":"2023-12-22T08:46:11.034060+0000","last_clean":"2023-12-22T08:46:11.034060+0000","last_became_active":"2023-12-22T08:46:10.538484+0000","last_became_peered":"2023-12-22T08:46:10.538484+0000","last_unstale":"2023-12-22T08:46:11.034060+0000","last_undegraded":"2023-12-22T08:46:11.034060+0000","last_fullsized":"2023-12-22T08:46:11.034060+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:08:05.737332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.041422+0000","last_change":"2023-12-22T08:46:11.041197+0000","last_active":"2023-12-22T08:46:11.041422+0000","last_peered":"2023-12-22T08:46:11.041422+0000","last_clean":"2023-12-22T08:46:11.041422+0000","last_became_active":"2023-12-22T08:46:11.040944+0000","last_became_peered":"2023-12-22T08:46:11.040944+0000","last_unstale":"2023-12-22T08:46:11.041422+0000","last_undegraded":"2023-12-22T08:46:11.041422+0000","last_fullsized":"2023-12-22T08:46:11.041422+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:49:16.929281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-22T08:46:11.038700+0000","last_change":"2023-12-22T08:46:10.542977+0000","last_active":"2023-12-22T08:46:11.038700+0000","last_peered":"2023-12-22T08:46:11.038700+0000","last_clean":"2023-12-22T08:46:11.038700+0000","last_became_active":"2023-12-22T08:46:10.542399+0000","last_became_peered":"2023-12-22T08:46:10.542399+0000","last_unstale":"2023-12-22T08:46:11.038700+0000","last_undegraded":"2023-12-22T08:46:11.038700+0000","last_fullsized":"2023-12-22T08:46:11.038700+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:44:01.415735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:12.028500+0000","last_change":"2023-12-22T08:46:11.029428+0000","last_active":"2023-12-22T08:46:12.028500+0000","last_peered":"2023-12-22T08:46:12.028500+0000","last_clean":"2023-12-22T08:46:12.028500+0000","last_became_active":"2023-12-22T08:46:11.028717+0000","last_became_peered":"2023-12-22T08:46:11.028717+0000","last_unstale":"2023-12-22T08:46:12.028500+0000","last_undegraded":"2023-12-22T08:46:12.028500+0000","last_fullsized":"2023-12-22T08:46:12.028500+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:10.502451+0000","last_clean_scrub_stamp":"2023-12-22T08:46:10.502451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:55.966404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"109'1","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-22T08:46:13.393211+0000","last_change":"2023-12-22T08:46:10.542440+0000","last_active":"2023-12-22T08:46:13.393211+0000","last_peered":"2023-12-22T08:46:13.393211+0000","last_clean":"2023-12-22T08:46:13.393211+0000","last_became_active":"2023-12-22T08:46:10.541847+0000","last_became_peered":"2023-12-22T08:46:10.541847+0000","last_unstale":"2023-12-22T08:46:13.393211+0000","last_undegraded":"2023-12-22T08:46:13.393211+0000","last_fullsized":"2023-12-22T08:46:13.393211+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:46:09.487869+0000","last_clean_scrub_stamp":"2023-12-22T08:46:09.487869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:42:19.395065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":244,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-12-22T08:46:10.533110+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:46:10.533110+0000","last_peered":"2023-12-22T08:46:10.533110+0000","last_clean":"2023-12-22T08:46:10.533110+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:46:10.533110+0000","last_undegraded":"2023-12-22T08:46:10.533110+0000","last_fullsized":"2023-12-22T08:46:10.533110+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":586,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194726,"statfs":{"total":200000000,"available":199399456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.087,"15min":1.0820000000000001},"min":{"1min":0.70399999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6459999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.1259999999999999,"15min":1.0760000000000001},"min":{"1min":0.75700000000000001,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5640000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.95999999999999996}]},{"osd":1,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.2090000000000001,"15min":1.1699999999999999},"min":{"1min":0.90800000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.617,"5min":1.905,"15min":1.905},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.2529999999999999,"15min":1.1619999999999999},"min":{"1min":1.0249999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6279999999999999,"5min":1.865,"15min":1.865},"last":1.083}]},{"osd":2,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.143,"15min":1.075},"min":{"1min":0.78400000000000003,"5min":0.745,"15min":0.69799999999999995},"max":{"1min":1.4530000000000001,"5min":1.875,"15min":1.875},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.262,"5min":1.2150000000000001,"15min":1.2250000000000001},"min":{"1min":0.93400000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.609,"5min":1.742,"15min":2.1379999999999999},"last":1.135}]},{"osd":3,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2010000000000001,"15min":1.115},"min":{"1min":0.80900000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.409,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.3220000000000001,"15min":1.2869999999999999},"min":{"1min":1.1140000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.661,"5min":1.952,"15min":2.2959999999999998},"last":1.3320000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1839999999999999,"15min":1.1919999999999999},"min":{"1min":0.79900000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.8169999999999999,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.246,"15min":1.256},"min":{"1min":0.93799999999999994,"5min":0.64100000000000001,"15min":0.59399999999999997},"max":{"1min":1.371,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.4119999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3680000000000001,"15min":1.3660000000000001},"min":{"1min":1.0089999999999999,"5min":0.74299999999999999,"15min":0.51800000000000002},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.4300000000000002},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":1.0680000000000001,"5min":0.76300000000000001,"15min":0.67800000000000005},"max":{"1min":1.722,"5min":1.722,"15min":2.3410000000000002},"last":1.389}]},{"osd":6,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.494,"15min":1.4870000000000001},"min":{"1min":1.1180000000000001,"5min":0.83499999999999996,"15min":0.66900000000000004},"max":{"1min":1.9099999999999999,"5min":2.1259999999999999,"15min":2.2440000000000002},"last":1.488},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.466,"15min":1.4770000000000001},"min":{"1min":1.097,"5min":0.82299999999999995,"15min":0.71999999999999997},"max":{"1min":1.585,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.518}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":587,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194725,"statfs":{"total":200000000,"available":199398854,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.1359999999999999,"15min":1.1379999999999999},"min":{"1min":0.69499999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.548,"5min":1.9350000000000001,"15min":3.0489999999999999},"last":1.087},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1379999999999999,"15min":1.1000000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.67800000000000005},"max":{"1min":1.579,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.159}]},{"osd":1,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.121,"15min":1.046},"min":{"1min":0.76600000000000001,"5min":0.63,"15min":0.623},"max":{"1min":1.5660000000000001,"5min":1.575,"15min":1.6519999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2010000000000001,"15min":1.1739999999999999},"min":{"1min":0.64500000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.4450000000000001,"5min":1.8,"15min":1.8},"last":1.212}]},{"osd":2,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.254,"15min":1.272},"min":{"1min":0.72799999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.556,"5min":1.7969999999999999,"15min":1.8799999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.2210000000000001,"15min":1.163},"min":{"1min":0.80800000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5149999999999999,"5min":1.881,"15min":1.881},"last":1.2529999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.3109999999999999,"15min":1.2969999999999999},"min":{"1min":0.86899999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5920000000000001,"5min":1.738,"15min":1.847},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2569999999999999,"15min":1.236},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.77900000000000003},"max":{"1min":1.506,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.83799999999999997}]},{"osd":4,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.329,"15min":1.387},"min":{"1min":0.88800000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.6100000000000001,"5min":1.9139999999999999,"15min":2.0739999999999998},"last":1.369},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3740000000000001,"15min":1.3939999999999999},"min":{"1min":0.89500000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6479999999999999,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.343}]},{"osd":5,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.3169999999999999,"15min":1.349},"min":{"1min":1.0049999999999999,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.595,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.474,"5min":1.4930000000000001,"15min":1.5720000000000001},"min":{"1min":1.1399999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6919999999999999,"5min":2.1030000000000002,"15min":3.1819999999999999},"last":1.4299999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.5169999999999999,"15min":1.5700000000000001},"min":{"1min":0.97899999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.708,"5min":2.2999999999999998,"15min":2.8069999999999999},"last":1.397},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.4630000000000001,"15min":1.5309999999999999},"min":{"1min":1.1180000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.673,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.999}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1157,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194155,"statfs":{"total":200000000,"available":198814879,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.107,"15min":1.0860000000000001},"min":{"1min":0.84999999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3169999999999999,"5min":1.944,"15min":1.944},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1040000000000001,"15min":1.129},"min":{"1min":0.84799999999999998,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.381,"5min":2.2690000000000001,"15min":3.1379999999999999},"last":1.2450000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.109,"15min":1.113},"min":{"1min":0.84799999999999998,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5329999999999999,"5min":1.619,"15min":2.79},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.101,"15min":1.036},"min":{"1min":0.89100000000000001,"5min":0.69099999999999995,"15min":0.64500000000000002},"max":{"1min":1.4119999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.1020000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.155,"15min":1.1339999999999999},"min":{"1min":0.92000000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.4330000000000001,"5min":1.6279999999999999,"15min":1.72},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.23,"5min":1.2190000000000001,"15min":1.177},"min":{"1min":0.81799999999999995,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.716,"5min":1.716,"15min":1.978},"last":1.45}]},{"osd":3,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.236,"15min":1.1799999999999999},"min":{"1min":1.0009999999999999,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.282},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.28,"15min":1.2490000000000001},"min":{"1min":1.0389999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5760000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.367}]},{"osd":4,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.2589999999999999,"15min":1.252},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.575,"5min":1.853,"15min":1.853},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.2629999999999999,"15min":1.2549999999999999},"min":{"1min":0.95199999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6200000000000001,"5min":1.663,"15min":1.663},"last":1.2050000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.3260000000000001,"15min":1.3160000000000001},"min":{"1min":0.91000000000000003,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.788,"5min":1.788,"15min":1.821},"last":1.179},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4019999999999999,"15min":1.4199999999999999},"min":{"1min":0.79600000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.798,"5min":1.823,"15min":2.8780000000000001},"last":1.3240000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.4179999999999999,"15min":1.3819999999999999},"min":{"1min":1.2609999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.873,"5min":1.873,"15min":2.2189999999999999},"last":1.407},{"interface":"front","average":{"1min":1.587,"5min":1.486,"15min":1.5569999999999999},"min":{"1min":1.177,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.8899999999999999,"5min":2.3610000000000002,"15min":4.7249999999999996},"last":1.2989999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":586,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194726,"statfs":{"total":200000000,"available":199399492,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0189999999999999,"15min":1.0109999999999999},"min":{"1min":0.71999999999999997,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.014},{"interface":"front","average":{"1min":1.133,"5min":1.151,"15min":1.109},"min":{"1min":0.69299999999999995,"5min":0.69099999999999995,"15min":0.68300000000000005},"max":{"1min":1.6379999999999999,"5min":1.796,"15min":1.796},"last":1.298}]},{"osd":1,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1160000000000001,"15min":1.054},"min":{"1min":0.68500000000000005,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4850000000000001,"5min":1.76,"15min":1.76},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1120000000000001,"15min":1.1100000000000001},"min":{"1min":0.77000000000000002,"5min":0.65600000000000003,"15min":0.57399999999999995},"max":{"1min":1.454,"5min":1.794,"15min":2.4249999999999998},"last":0.872}]},{"osd":2,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.181,"15min":1.151},"min":{"1min":0.83899999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5149999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.242,"15min":1.208},"min":{"1min":0.877,"5min":0.79500000000000004,"15min":0.78800000000000003},"max":{"1min":1.6910000000000001,"5min":2.0830000000000002,"15min":2.1600000000000001},"last":1.206}]},{"osd":3,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2230000000000001,"15min":1.1990000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.774},"last":1.109},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3169999999999999,"15min":1.2250000000000001},"min":{"1min":0.96399999999999997,"5min":0.84099999999999997,"15min":0.83899999999999997},"max":{"1min":1.7290000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.3740000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.202,"15min":1.1439999999999999},"min":{"1min":0.79900000000000004,"5min":0.68700000000000006,"15min":0.60299999999999998},"max":{"1min":1.6140000000000001,"5min":1.639,"15min":1.639},"last":1.26},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4370000000000001,"15min":1.3879999999999999},"min":{"1min":0.997,"5min":0.997,"15min":0.82699999999999996},"max":{"1min":1.8660000000000001,"5min":1.913,"15min":2.0979999999999999},"last":1.4319999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.325,"15min":1.2509999999999999},"min":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.58599999999999997},"max":{"1min":1.978,"5min":2.141,"15min":2.141},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.3180000000000001,"15min":1.216},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.355}]},{"osd":7,"last update":"Fri Dec 22 08:46:00 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.4570000000000001,"15min":1.353},"min":{"1min":1.0649999999999999,"5min":0.97799999999999998,"15min":0.67300000000000004},"max":{"1min":1.9279999999999999,"5min":2.0089999999999999,"15min":2.1200000000000001},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.528,"15min":1.4359999999999999},"min":{"1min":1.1020000000000001,"5min":1.0860000000000001,"15min":0.73299999999999998},"max":{"1min":2.1400000000000001,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.696}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":580,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194731,"statfs":{"total":200000000,"available":199405152,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.878,"15min":0.94799999999999995},"min":{"1min":0.53700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.1240000000000001,"5min":0.94199999999999995,"15min":0.93999999999999995},"min":{"1min":0.65200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.871}]},{"osd":1,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.88800000000000001,"15min":0.86799999999999999},"min":{"1min":0.60699999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3919999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.294,"5min":1.1870000000000001,"15min":1.137},"min":{"1min":0.68999999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.6659999999999999,"5min":1.861,"15min":1.861},"last":1.1140000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0529999999999999,"15min":1.042},"min":{"1min":0.56100000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3460000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.198,"5min":1.1719999999999999,"15min":1.1359999999999999},"min":{"1min":0.68400000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6699999999999999,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.345}]},{"osd":4,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2490000000000001,"15min":1.2130000000000001},"min":{"1min":0.98599999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.7210000000000001,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.603},{"interface":"front","average":{"1min":1.375,"5min":1.302,"15min":1.244},"min":{"1min":1.052,"5min":0.745,"15min":0.745},"max":{"1min":2.085,"5min":2.242,"15min":2.242},"last":1.7649999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3560000000000001,"15min":1.288},"min":{"1min":1.02,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.9790000000000001,"5min":1.994,"15min":1.994},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.385,"15min":1.4330000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.7969999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.423}]},{"osd":6,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4419999999999999,"15min":1.4450000000000001},"min":{"1min":1.1120000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.8899999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.482},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.3879999999999999,"15min":1.3899999999999999},"min":{"1min":0.98999999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.1759999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.4219999999999999,"15min":1.385},"min":{"1min":1.081,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.4410000000000001,"15min":1.403},"min":{"1min":1.1519999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.698}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":580,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194732,"statfs":{"total":200000000,"available":199405826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95199999999999996,"15min":0.78000000000000003},"min":{"1min":0.54800000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.6789999999999998,"5min":6.8879999999999999,"15min":6.8879999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95599999999999996,"15min":0.94399999999999995},"min":{"1min":0.50600000000000001,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.5069999999999999,"5min":4.5510000000000002,"15min":4.5510000000000002},"last":1.4119999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":1.038,"15min":0.94399999999999995},"min":{"1min":0.63900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.633,"5min":11.308999999999999,"15min":11.308999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.175,"5min":1.0700000000000001,"15min":0.94499999999999995},"min":{"1min":0.51500000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.036}]},{"osd":3,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.252,"15min":1.052},"min":{"1min":0.69799999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5780000000000001,"5min":13.087999999999999,"15min":13.087999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.363,"15min":1.117},"min":{"1min":0.67300000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":3.2959999999999998,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.202}]},{"osd":4,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.3899999999999999,"15min":1.258},"min":{"1min":0.94899999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3999999999999999,"15min":1.3560000000000001},"min":{"1min":1.0329999999999999,"5min":0.623,"15min":0.61499999999999999},"max":{"1min":1.6160000000000001,"5min":13.927,"15min":13.927},"last":1.1399999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.409,"15min":1.379},"min":{"1min":0.91500000000000004,"5min":0.72399999999999998,"15min":0.64000000000000001},"max":{"1min":1.722,"5min":11.003,"15min":11.003},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.454,"15min":1.284},"min":{"1min":0.93100000000000005,"5min":0.83699999999999997,"15min":0.79400000000000004},"max":{"1min":2.0470000000000002,"5min":13.129,"15min":13.129},"last":1.093}]},{"osd":6,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4510000000000001,"15min":1.2909999999999999},"min":{"1min":0.995,"5min":0.77200000000000002,"15min":0.751},"max":{"1min":2.1240000000000001,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":1.456},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.518,"15min":1.383},"min":{"1min":0.97799999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":3.8959999999999999,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":1.319}]},{"osd":7,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.506,"15min":1.399},"min":{"1min":0.97299999999999998,"5min":0.753,"15min":0.61299999999999999},"max":{"1min":1.7729999999999999,"5min":10.948,"15min":10.948},"last":1.244},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.5489999999999999,"15min":1.3720000000000001},"min":{"1min":0.90600000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.1789999999999998,"5min":8.0980000000000008,"15min":8.0980000000000008},"last":1.3380000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1156,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194155,"statfs":{"total":200000000,"available":198815368,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92000000000000004,"15min":0.90600000000000003},"min":{"1min":0.41299999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.361,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.105,"15min":1.0369999999999999},"min":{"1min":0.629,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.857,"5min":1.857,"15min":2.4159999999999999},"last":1.276}]},{"osd":2,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":0.98799999999999999,"15min":0.96199999999999997},"min":{"1min":0.61099999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.194},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0389999999999999,"15min":0.97199999999999998},"min":{"1min":0.70999999999999996,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6120000000000001,"5min":1.647,"15min":2.254},"last":1.1519999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.296,"15min":1.1990000000000001},"min":{"1min":0.76400000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.3479999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.151,"5min":1.026,"15min":0.98599999999999999},"min":{"1min":0.68300000000000005,"5min":0.497,"15min":0.47799999999999998},"max":{"1min":1.7490000000000001,"5min":2.226,"15min":2.226},"last":0.65200000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.3080000000000001,"15min":1.286},"min":{"1min":0.874,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.306},{"interface":"front","average":{"1min":1.536,"5min":1.4350000000000001,"15min":1.3460000000000001},"min":{"1min":1.0309999999999999,"5min":0.876,"15min":0.85499999999999998},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.423}]},{"osd":5,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.2909999999999999,"15min":1.2529999999999999},"min":{"1min":0.79200000000000004,"5min":0.71599999999999997,"15min":0.61399999999999999},"max":{"1min":2.4089999999999998,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":1.101},{"interface":"front","average":{"1min":1.508,"5min":1.4399999999999999,"15min":1.3580000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.66800000000000004},"max":{"1min":2.3100000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.357,"15min":1.2789999999999999},"min":{"1min":0.92100000000000004,"5min":0.81000000000000005,"15min":0.65200000000000002},"max":{"1min":2.7440000000000002,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":1.321},{"interface":"front","average":{"1min":1.569,"5min":1.456,"15min":1.3899999999999999},"min":{"1min":0.96999999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2229999999999999},"last":1.2490000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:45:58 2023","interfaces":[{"interface":"back","average":{"1min":1.6539999999999999,"5min":1.5129999999999999,"15min":1.3919999999999999},"min":{"1min":1.0629999999999999,"5min":0.76900000000000002,"15min":0.64400000000000002},"max":{"1min":2.3610000000000002,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.587,"5min":1.458,"15min":1.4259999999999999},"min":{"1min":0.90200000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.5379999999999998,"5min":4.508,"15min":4.508},"last":1.391}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":581,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194730,"statfs":{"total":200000000,"available":199404240,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.82499999999999996,"15min":0.747},"min":{"1min":0.61199999999999999,"5min":0.40100000000000002,"15min":0.38},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":2.9470000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":0.95899999999999996,"15min":0.91700000000000004},"min":{"1min":0.52600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.593,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.8360000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.86899999999999999,"15min":0.80900000000000005},"min":{"1min":0.68200000000000005,"5min":0.442,"15min":0.40600000000000003},"max":{"1min":1.5229999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.069,"15min":0.96399999999999997},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.157,"15min":1.0509999999999999},"min":{"1min":0.64300000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":2.1339999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.228,"15min":1.0880000000000001},"min":{"1min":0.77600000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.9219999999999999,"5min":2.145,"15min":2.145},"last":1.8080000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.351,"15min":1.284},"min":{"1min":0.85599999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":2.0910000000000002},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.333,"15min":1.2350000000000001},"min":{"1min":1.0069999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.964}]},{"osd":5,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.3400000000000001,"15min":1.272},"min":{"1min":1.0820000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":5.4290000000000003},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.341,"15min":1.2789999999999999},"min":{"1min":1.0609999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.4550000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":3.0910000000000002}]},{"osd":6,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.379,"15min":1.2989999999999999},"min":{"1min":1.034,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.7589999999999999,"5min":1.478,"15min":1.4099999999999999},"min":{"1min":1.2529999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.577,"5min":2.577,"15min":2.577},"last":0.93600000000000005}]},{"osd":7,"last update":"Fri Dec 22 08:46:05 2023","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":1.458,"15min":1.387},"min":{"1min":1.1950000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.6819999999999999,"5min":1.448,"15min":1.3899999999999999},"min":{"1min":1.1799999999999999,"5min":0.749,"15min":0.749},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":2.1680000000000001}]}]}],"pool_statfs":[]}} 2023-12-22T08:46:16.016 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T08:46:16.016 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T08:46:16.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.292+0000 7f38e337e640 1 Processor -- start 2023-12-22T08:46:16.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.292+0000 7f38e337e640 1 -- start start 2023-12-22T08:46:16.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.293+0000 7f38e337e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38dc0a90c0 0x7f38dc0b1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:16.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.293+0000 7f38e337e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f38dc1558c0 0x7f38dc0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:16.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.293+0000 7f38e337e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38dc0cda10 con 0x7f38dc0a94a0 2023-12-22T08:46:16.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.293+0000 7f38e337e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc0b1ad0 con 0x7f38dc1558c0 2023-12-22T08:46:16.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.293+0000 7f38e337e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0cdca0 con 0x7f38dc0a90c0 2023-12-22T08:46:16.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.293+0000 7f38e2b7d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f38dc1558c0 0x7f38dc0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:16.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.294+0000 7f38e2b7d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f38dc1558c0 0x7f38dc0cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47986/0 (socket says 172.21.15.38:47986) 2023-12-22T08:46:16.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.294+0000 7f38e2b7d640 1 -- 172.21.15.38:0/3357714038 learned_addr learned my addr 172.21.15.38:0/3357714038 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:16.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.294+0000 7f38e237c640 1 --2- 172.21.15.38:0/3357714038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38dc0a90c0 0x7f38dc0b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:16.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.294+0000 7f38e2b7d640 1 -- 172.21.15.38:0/3357714038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38dc0a90c0 msgr2=0x7f38dc0b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:16.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.294+0000 7f38e2b7d640 1 --2- 172.21.15.38:0/3357714038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38dc0a90c0 0x7f38dc0b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.294+0000 7f38e2b7d640 1 -- 172.21.15.38:0/3357714038 >> v1:172.21.15.89:6789/0 conn(0x7f38dc0a94a0 legacy=0x7f38dc1551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:16.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.294+0000 7f38e2b7d640 1 -- 172.21.15.38:0/3357714038 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc0cdf80 con 0x7f38dc1558c0 2023-12-22T08:46:16.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.294+0000 7f38e237c640 1 --2- 172.21.15.38:0/3357714038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38dc0a90c0 0x7f38dc0b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:16.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.295+0000 7f38e2b7d640 1 --2- 172.21.15.38:0/3357714038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38dc1558c0 0x7f38dc0cf200 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009e50 tx=0x7f38d402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b547fc983d2609d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:16.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.296+0000 7f38e137a640 1 -- 172.21.15.38:0/3357714038 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d402ca70 con 0x7f38dc1558c0 2023-12-22T08:46:16.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.296+0000 7f38e137a640 1 -- 172.21.15.38:0/3357714038 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d402cbd0 con 0x7f38dc1558c0 2023-12-22T08:46:16.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.296+0000 7f38e137a640 1 -- 172.21.15.38:0/3357714038 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d40343f0 con 0x7f38dc1558c0 2023-12-22T08:46:16.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.296+0000 7f38e337e640 1 -- 172.21.15.38:0/3357714038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38dc1558c0 msgr2=0x7f38dc0cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:16.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.296+0000 7f38e337e640 1 --2- 172.21.15.38:0/3357714038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38dc1558c0 0x7f38dc0cf200 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009e50 tx=0x7f38d402bed0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.296+0000 7f38e337e640 1 -- 172.21.15.38:0/3357714038 shutdown_connections 2023-12-22T08:46:16.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.296+0000 7f38e337e640 1 --2- 172.21.15.38:0/3357714038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38dc1558c0 0x7f38dc0cf200 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.296+0000 7f38e337e640 1 --2- 172.21.15.38:0/3357714038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38dc0a90c0 0x7f38dc0b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.296+0000 7f38e337e640 1 -- 172.21.15.38:0/3357714038 >> 172.21.15.38:0/3357714038 conn(0x7f38dc060720 msgr2=0x7f38dc060b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:16.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.296+0000 7f38e337e640 1 -- 172.21.15.38:0/3357714038 shutdown_connections 2023-12-22T08:46:16.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.296+0000 7f38e337e640 1 -- 172.21.15.38:0/3357714038 wait complete. 2023-12-22T08:46:16.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.298+0000 7f38e337e640 1 Processor -- start 2023-12-22T08:46:16.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.298+0000 7f38e337e640 1 -- start start 2023-12-22T08:46:16.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.299+0000 7f38e337e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38dc0a90c0 0x7f38dc06a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:16.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.299+0000 7f38e337e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38dc0a94a0 0x7f38dc06bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:16.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.299+0000 7f38e337e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc1558c0 0x7f38dc15c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:16.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.299+0000 7f38e337e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc155d00 con 0x7f38dc0a90c0 2023-12-22T08:46:16.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.299+0000 7f38e337e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc06b6f0 con 0x7f38dc1558c0 2023-12-22T08:46:16.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.299+0000 7f38e337e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc06c0c0 con 0x7f38dc0a94a0 2023-12-22T08:46:16.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.300+0000 7f38e237c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38dc0a90c0 0x7f38dc06a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:16.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.300+0000 7f38e237c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38dc0a90c0 0x7f38dc06a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47990/0 (socket says 172.21.15.38:47990) 2023-12-22T08:46:16.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.300+0000 7f38e237c640 1 -- 172.21.15.38:0/1541135224 learned_addr learned my addr 172.21.15.38:0/1541135224 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:16.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.300+0000 7f38e2b7d640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc1558c0 0x7f38dc15c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.300+0000 7f38e237c640 1 -- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38dc0a94a0 msgr2=0x7f38dc06bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.300+0000 7f38e237c640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38dc0a94a0 0x7f38dc06bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.300+0000 7f38e237c640 1 -- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc1558c0 msgr2=0x7f38dc15c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.300+0000 7f38e237c640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc1558c0 0x7f38dc15c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.300+0000 7f38e237c640 1 -- 172.21.15.38:0/1541135224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d4009b30 con 0x7f38dc0a90c0 2023-12-22T08:46:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.300+0000 7f38e2b7d640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc1558c0 0x7f38dc15c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.300+0000 7f38e237c640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38dc0a90c0 0x7f38dc06a3d0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f38d800c7f0 tx=0x7f38d800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.301+0000 7f38d2ffd640 1 -- 172.21.15.38:0/1541135224 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d8007a30 con 0x7f38dc0a90c0 2023-12-22T08:46:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.301+0000 7f38d2ffd640 1 -- 172.21.15.38:0/1541135224 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d8007b90 con 0x7f38dc0a90c0 2023-12-22T08:46:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.301+0000 7f38d2ffd640 1 -- 172.21.15.38:0/1541135224 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d800ce40 con 0x7f38dc0a90c0 2023-12-22T08:46:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.301+0000 7f38e337e640 1 -- 172.21.15.38:0/1541135224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38dc06aae0 con 0x7f38dc0a90c0 2023-12-22T08:46:16.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.301+0000 7f38e337e640 1 -- 172.21.15.38:0/1541135224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc06b0a0 con 0x7f38dc0a90c0 2023-12-22T08:46:16.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.302+0000 7f38e337e640 1 -- 172.21.15.38:0/1541135224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc061910 con 0x7f38dc0a90c0 2023-12-22T08:46:16.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.303+0000 7f38d2ffd640 1 -- 172.21.15.38:0/1541135224 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f38d80113f0 con 0x7f38dc0a90c0 2023-12-22T08:46:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.304+0000 7f38d2ffd640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f38c006a430 0x7f38c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:16.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.304+0000 7f38d2ffd640 1 -- 172.21.15.38:0/1541135224 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38d8088b80 con 0x7f38dc0a90c0 2023-12-22T08:46:16.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.305+0000 7f38e1b7b640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f38c006a430 0x7f38c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:16.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.306+0000 7f38e1b7b640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f38c006a430 0x7f38c006c8f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f38dc06c570 tx=0x7f38cc0079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:16.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.309+0000 7f38d2ffd640 1 -- 172.21.15.38:0/1541135224 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f38d80540d0 con 0x7f38dc0a90c0 2023-12-22T08:46:16.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.570+0000 7f38e337e640 1 -- 172.21.15.38:0/1541135224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f38dc0cef00 con 0x7f38dc0a90c0 2023-12-22T08:46:16.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.577+0000 7f38d2ffd640 1 -- 172.21.15.38:0/1541135224 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f38d801f0e0 con 0x7f38dc0a90c0 2023-12-22T08:46:16.578 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.0 2023-12-22T08:46:16.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.579+0000 7f38e337e640 1 -- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f38c006a430 msgr2=0x7f38c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:16.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.579+0000 7f38e337e640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f38c006a430 0x7f38c006c8f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f38dc06c570 tx=0x7f38cc0079b0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.579+0000 7f38e337e640 1 -- 172.21.15.38:0/1541135224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38dc0a90c0 msgr2=0x7f38dc06a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:16.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.579+0000 7f38e337e640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38dc0a90c0 0x7f38dc06a3d0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f38d800c7f0 tx=0x7f38d800cbf0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.579+0000 7f38e337e640 1 -- 172.21.15.38:0/1541135224 shutdown_connections 2023-12-22T08:46:16.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.579+0000 7f38e337e640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc1558c0 0x7f38dc15c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.579+0000 7f38e337e640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38dc0a94a0 0x7f38dc06bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.579+0000 7f38e337e640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f38c006a430 0x7f38c006c8f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.579+0000 7f38e337e640 1 --2- 172.21.15.38:0/1541135224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38dc0a90c0 0x7f38dc06a3d0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.579+0000 7f38e337e640 1 -- 172.21.15.38:0/1541135224 >> 172.21.15.38:0/1541135224 conn(0x7f38dc060720 msgr2=0x7f38dc15bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:16.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.580+0000 7f38e337e640 1 -- 172.21.15.38:0/1541135224 shutdown_connections 2023-12-22T08:46:16.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.580+0000 7f38e337e640 1 -- 172.21.15.38:0/1541135224 wait complete. 2023-12-22T08:46:16.599 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:46:16.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.813+0000 7f4b2f59e640 1 Processor -- start 2023-12-22T08:46:16.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.814+0000 7f4b2f59e640 1 -- start start 2023-12-22T08:46:16.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.815+0000 7f4b2f59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4b30161340 0x7f4b30071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:16.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.815+0000 7f4b2f59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4b30161720 0x7f4b300ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:16.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.815+0000 7f4b2f59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b300ce950 con 0x7f4b30071fa0 2023-12-22T08:46:16.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.815+0000 7f4b2f59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b300cdd40 con 0x7f4b30161340 2023-12-22T08:46:16.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.815+0000 7f4b2f59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b300ce020 con 0x7f4b30161720 2023-12-22T08:46:16.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.816+0000 7f4b2e59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4b30161340 0x7f4b30071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:16.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.816+0000 7f4b2e59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4b30161340 0x7f4b30071a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47998/0 (socket says 172.21.15.38:47998) 2023-12-22T08:46:16.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.816+0000 7f4b2e59c640 1 -- 172.21.15.38:0/4034313497 learned_addr learned my addr 172.21.15.38:0/4034313497 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:16.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.816+0000 7f4b2ed9d640 1 --2- 172.21.15.38:0/4034313497 >> v2:172.21.15.89:3300/0 conn(0x7f4b30161720 0x7f4b300ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:16.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.816+0000 7f4b2e59c640 1 -- 172.21.15.38:0/4034313497 >> v2:172.21.15.89:3300/0 conn(0x7f4b30161720 msgr2=0x7f4b300ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:16.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.816+0000 7f4b2e59c640 1 --2- 172.21.15.38:0/4034313497 >> v2:172.21.15.89:3300/0 conn(0x7f4b30161720 0x7f4b300ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.816+0000 7f4b2e59c640 1 -- 172.21.15.38:0/4034313497 >> v1:172.21.15.89:6789/0 conn(0x7f4b30071fa0 legacy=0x7f4b300adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:16.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.816+0000 7f4b2e59c640 1 -- 172.21.15.38:0/4034313497 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b300ce300 con 0x7f4b30161340 2023-12-22T08:46:16.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.816+0000 7f4b2ed9d640 1 --2- 172.21.15.38:0/4034313497 >> v2:172.21.15.89:3300/0 conn(0x7f4b30161720 0x7f4b300ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:16.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.818+0000 7f4b2e59c640 1 --2- 172.21.15.38:0/4034313497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b30161340 0x7f4b30071a60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f4b300cc990 tx=0x7f4b2002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b52948c07e4eeec server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:16.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.818+0000 7f4b2d59a640 1 -- 172.21.15.38:0/4034313497 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2002c960 con 0x7f4b30161340 2023-12-22T08:46:16.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.818+0000 7f4b2d59a640 1 -- 172.21.15.38:0/4034313497 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2002cac0 con 0x7f4b30161340 2023-12-22T08:46:16.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.818+0000 7f4b2d59a640 1 -- 172.21.15.38:0/4034313497 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2002ce50 con 0x7f4b30161340 2023-12-22T08:46:16.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.819+0000 7f4b2f59e640 1 -- 172.21.15.38:0/4034313497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b30161340 msgr2=0x7f4b30071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:16.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.819+0000 7f4b2f59e640 1 --2- 172.21.15.38:0/4034313497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b30161340 0x7f4b30071a60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f4b300cc990 tx=0x7f4b2002bdc0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.819+0000 7f4b2f59e640 1 -- 172.21.15.38:0/4034313497 shutdown_connections 2023-12-22T08:46:16.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.819+0000 7f4b2f59e640 1 --2- 172.21.15.38:0/4034313497 >> v2:172.21.15.89:3300/0 conn(0x7f4b30161720 0x7f4b300ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.819+0000 7f4b2f59e640 1 --2- 172.21.15.38:0/4034313497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b30161340 0x7f4b30071a60 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.819+0000 7f4b2f59e640 1 -- 172.21.15.38:0/4034313497 >> 172.21.15.38:0/4034313497 conn(0x7f4b300b1f70 msgr2=0x7f4b300b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:16.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.819+0000 7f4b2f59e640 1 -- 172.21.15.38:0/4034313497 shutdown_connections 2023-12-22T08:46:16.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.819+0000 7f4b2f59e640 1 -- 172.21.15.38:0/4034313497 wait complete. 2023-12-22T08:46:16.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.821+0000 7f4b2f59e640 1 Processor -- start 2023-12-22T08:46:16.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.821+0000 7f4b2f59e640 1 -- start start 2023-12-22T08:46:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.822+0000 7f4b2f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b30071fa0 0x7f4b301543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.822+0000 7f4b2f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b30161340 0x7f4b301557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.822+0000 7f4b2f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b30161720 0x7f4b30155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.822+0000 7f4b2f59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30153300 con 0x7f4b30161720 2023-12-22T08:46:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.822+0000 7f4b2f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b301535e0 con 0x7f4b30161340 2023-12-22T08:46:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.822+0000 7f4b2f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b301538c0 con 0x7f4b30071fa0 2023-12-22T08:46:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.823+0000 7f4b2ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b30161720 0x7f4b30155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.823+0000 7f4b2ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b30161720 0x7f4b30155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48014/0 (socket says 172.21.15.38:48014) 2023-12-22T08:46:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.823+0000 7f4b2ed9d640 1 -- 172.21.15.38:0/2420303936 learned_addr learned my addr 172.21.15.38:0/2420303936 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.823+0000 7f4b2e59c640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b30071fa0 0x7f4b301543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:16.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.823+0000 7f4b2dd9b640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b30161340 0x7f4b301557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.823+0000 7f4b2ed9d640 1 -- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b30071fa0 msgr2=0x7f4b301543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.823+0000 7f4b2ed9d640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b30071fa0 0x7f4b301543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.823+0000 7f4b2ed9d640 1 -- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b30161340 msgr2=0x7f4b301557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.823+0000 7f4b2ed9d640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b30161340 0x7f4b301557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.823+0000 7f4b2ed9d640 1 -- 172.21.15.38:0/2420303936 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b20009b30 con 0x7f4b30161720 2023-12-22T08:46:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.823+0000 7f4b2e59c640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b30071fa0 0x7f4b301543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:46:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.823+0000 7f4b2dd9b640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b30161340 0x7f4b301557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.823+0000 7f4b2ed9d640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b30161720 0x7f4b30155d20 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800c7c0 tx=0x7f4b2800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.824+0000 7f4b26ffd640 1 -- 172.21.15.38:0/2420303936 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28004230 con 0x7f4b30161720 2023-12-22T08:46:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.824+0000 7f4b26ffd640 1 -- 172.21.15.38:0/2420303936 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b28004390 con 0x7f4b30161720 2023-12-22T08:46:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.824+0000 7f4b26ffd640 1 -- 172.21.15.38:0/2420303936 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28007860 con 0x7f4b30161720 2023-12-22T08:46:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.824+0000 7f4b2f59e640 1 -- 172.21.15.38:0/2420303936 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b30153ba0 con 0x7f4b30161720 2023-12-22T08:46:16.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.824+0000 7f4b2f59e640 1 -- 172.21.15.38:0/2420303936 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b30158480 con 0x7f4b30161720 2023-12-22T08:46:16.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.825+0000 7f4b2f59e640 1 -- 172.21.15.38:0/2420303936 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b301540c0 con 0x7f4b30161720 2023-12-22T08:46:16.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.826+0000 7f4b26ffd640 1 -- 172.21.15.38:0/2420303936 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b280079c0 con 0x7f4b30161720 2023-12-22T08:46:16.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.827+0000 7f4b26ffd640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b1006a430 0x7f4b1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:16.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.828+0000 7f4b26ffd640 1 -- 172.21.15.38:0/2420303936 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b28088c70 con 0x7f4b30161720 2023-12-22T08:46:16.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.828+0000 7f4b2e59c640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b1006a430 0x7f4b1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:16.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.829+0000 7f4b2e59c640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b1006a430 0x7f4b1006c8f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b20035000 tx=0x7f4b20030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:16.832+0000 7f4b26ffd640 1 -- 172.21.15.38:0/2420303936 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4b301540c0 con 0x7f4b30161720 2023-12-22T08:46:17.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.054+0000 7f4b2f59e640 1 -- 172.21.15.38:0/2420303936 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b301540c0 con 0x7f4b30161720 2023-12-22T08:46:17.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.055+0000 7f4b26ffd640 1 -- 172.21.15.38:0/2420303936 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f4b301540c0 con 0x7f4b30161720 2023-12-22T08:46:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:17.057 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/4163741517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4163741517},{"type":"v1","addr":"172.21.15.89:6836","nonce":4163741517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/972467119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":972467119},{"type":"v1","addr":"172.21.15.89:6837","nonce":972467119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/2124959631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2124959631},{"type":"v1","addr":"172.21.15.38:6834","nonce":2124959631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:46:11.013927+0000","modified":"2023-12-22T08:46:14.032400+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/2733146003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2733146003},{"type":"v1","addr":"172.21.15.38:6835","nonce":2733146003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-22T08:46:17.057 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 47 2023-12-22T08:46:17.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.057+0000 7f4b2f59e640 1 -- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b1006a430 msgr2=0x7f4b1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:17.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.057+0000 7f4b2f59e640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b1006a430 0x7f4b1006c8f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b20035000 tx=0x7f4b20030000 comp rx=0 tx=0).stop 2023-12-22T08:46:17.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.057+0000 7f4b2f59e640 1 -- 172.21.15.38:0/2420303936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b30161720 msgr2=0x7f4b30155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:17.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.057+0000 7f4b2f59e640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b30161720 0x7f4b30155d20 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800c7c0 tx=0x7f4b2800cc80 comp rx=0 tx=0).stop 2023-12-22T08:46:17.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.057+0000 7f4b2f59e640 1 -- 172.21.15.38:0/2420303936 shutdown_connections 2023-12-22T08:46:17.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.057+0000 7f4b2f59e640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b1006a430 0x7f4b1006c8f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.057+0000 7f4b2f59e640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b30161720 0x7f4b30155d20 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.057+0000 7f4b2f59e640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b30161340 0x7f4b301557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.057+0000 7f4b2f59e640 1 --2- 172.21.15.38:0/2420303936 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b30071fa0 0x7f4b301543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.057+0000 7f4b2f59e640 1 -- 172.21.15.38:0/2420303936 >> 172.21.15.38:0/2420303936 conn(0x7f4b300b1f70 msgr2=0x7f4b3015e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:17.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.057+0000 7f4b2f59e640 1 -- 172.21.15.38:0/2420303936 shutdown_connections 2023-12-22T08:46:17.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.058+0000 7f4b2f59e640 1 -- 172.21.15.38:0/2420303936 wait complete. 2023-12-22T08:46:17.480 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T08:46:11.013927+0000', 'modified': '2023-12-22T08:46:14.032400+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6867}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6867': {'gid': 6867, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.38:6835/2733146003', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6833', 'nonce': 2733146003}, {'type': 'v1', 'addr': '172.21.15.38:6835', 'nonce': 2733146003}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T08:46:17.480 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T08:46:17.481 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-22T08:46:17.650 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:46:17.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.712+0000 7fa751139640 1 Processor -- start 2023-12-22T08:46:17.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.712+0000 7fa751139640 1 -- start start 2023-12-22T08:46:17.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.714+0000 7fa751139640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa74c144b70 0x7fa74c0d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.714+0000 7fa751139640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa74c0d0ae0 0x7fa74c161ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.714+0000 7fa751139640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74c0d0f30 con 0x7fa74c144790 2023-12-22T08:46:17.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.714+0000 7fa751139640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74c1471a0 con 0x7fa74c144b70 2023-12-22T08:46:17.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.714+0000 7fa751139640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c147480 con 0x7fa74c0d0ae0 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.714+0000 7fa74a59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa74c144b70 0x7fa74c0d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.714+0000 7fa74b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa74c0d0ae0 0x7fa74c161ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.715+0000 7fa74a59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa74c144b70 0x7fa74c0d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:47548/0 (socket says 172.21.15.38:47548) 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.715+0000 7fa74b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa74c0d0ae0 0x7fa74c161ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:49084/0 (socket says 172.21.15.38:49084) 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.715+0000 7fa74a59c640 1 -- 172.21.15.38:0/3449850253 learned_addr learned my addr 172.21.15.38:0/3449850253 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.715+0000 7fa74ad9d640 1 --1- 172.21.15.38:0/3449850253 >> v1:172.21.15.89:6789/0 conn(0x7fa74c144790 0x7fa74c0b23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:52836/0 (socket says 172.21.15.38:52836) 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.715+0000 7fa74a59c640 1 -- 172.21.15.38:0/3449850253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa74c0d0ae0 msgr2=0x7fa74c161ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.715+0000 7fa74a59c640 1 --2- 172.21.15.38:0/3449850253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa74c0d0ae0 0x7fa74c161ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.715+0000 7fa74a59c640 1 -- 172.21.15.38:0/3449850253 >> v1:172.21.15.89:6789/0 conn(0x7fa74c144790 legacy=0x7fa74c0b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.715+0000 7fa74a59c640 1 -- 172.21.15.38:0/3449850253 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c147760 con 0x7fa74c144b70 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.715+0000 7fa74b59e640 1 --2- 172.21.15.38:0/3449850253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa74c0d0ae0 0x7fa74c161ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.717+0000 7fa74a59c640 1 --2- 172.21.15.38:0/3449850253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa74c144b70 0x7fa74c0d05a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa734009870 tx=0x7fa73402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c00ca97dfea7eb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.717+0000 7fa749d9b640 1 -- 172.21.15.38:0/3449850253 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734030840 con 0x7fa74c144b70 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.717+0000 7fa749d9b640 1 -- 172.21.15.38:0/3449850253 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7340309a0 con 0x7fa74c144b70 2023-12-22T08:46:17.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.717+0000 7fa749d9b640 1 -- 172.21.15.38:0/3449850253 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734030d30 con 0x7fa74c144b70 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.718+0000 7fa751139640 1 -- 172.21.15.38:0/3449850253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa74c144b70 msgr2=0x7fa74c0d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.718+0000 7fa751139640 1 --2- 172.21.15.38:0/3449850253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa74c144b70 0x7fa74c0d05a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa734009870 tx=0x7fa73402b980 comp rx=0 tx=0).stop 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.718+0000 7fa751139640 1 -- 172.21.15.38:0/3449850253 shutdown_connections 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.718+0000 7fa751139640 1 --2- 172.21.15.38:0/3449850253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa74c144b70 0x7fa74c0d05a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.718+0000 7fa751139640 1 --2- 172.21.15.38:0/3449850253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa74c0d0ae0 0x7fa74c161ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.718+0000 7fa751139640 1 -- 172.21.15.38:0/3449850253 >> 172.21.15.38:0/3449850253 conn(0x7fa74c071840 msgr2=0x7fa74c071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.718+0000 7fa751139640 1 -- 172.21.15.38:0/3449850253 shutdown_connections 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.718+0000 7fa751139640 1 -- 172.21.15.38:0/3449850253 wait complete. 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.721+0000 7fa751139640 1 Processor -- start 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.721+0000 7fa751139640 1 -- start start 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.722+0000 7fa751139640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0d0ae0 0x7fa74c13d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.722+0000 7fa751139640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa74c144790 0x7fa74c1422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.722+0000 7fa751139640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa74c144b70 0x7fa74c142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.722+0000 7fa751139640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0b4700 con 0x7fa74c0d0ae0 2023-12-22T08:46:17.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.722+0000 7fa751139640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0b4120 con 0x7fa74c144b70 2023-12-22T08:46:17.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.722+0000 7fa751139640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c1435d0 con 0x7fa74c144790 2023-12-22T08:46:17.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.722+0000 7fa74ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0d0ae0 0x7fa74c13d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.723+0000 7fa74ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0d0ae0 0x7fa74c13d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48022/0 (socket says 172.21.15.38:48022) 2023-12-22T08:46:17.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.723+0000 7fa74ad9d640 1 -- 172.21.15.38:0/3265053379 learned_addr learned my addr 172.21.15.38:0/3265053379 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:17.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.723+0000 7fa74a59c640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa74c144790 0x7fa74c1422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.723+0000 7fa74b59e640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa74c144b70 0x7fa74c142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.723+0000 7fa74ad9d640 1 -- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa74c144790 msgr2=0x7fa74c1422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:17.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.723+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa74c144790 0x7fa74c1422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.723+0000 7fa74ad9d640 1 -- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa74c144b70 msgr2=0x7fa74c142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:17.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.723+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa74c144b70 0x7fa74c142800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.723+0000 7fa74ad9d640 1 -- 172.21.15.38:0/3265053379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa744009400 con 0x7fa74c0d0ae0 2023-12-22T08:46:17.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.723+0000 7fa74b59e640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa74c144b70 0x7fa74c142800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:17.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.723+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0d0ae0 0x7fa74c13d840 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00c830 tx=0x7fa73c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.724+0000 7fa7437fe640 1 -- 172.21.15.38:0/3265053379 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c00a640 con 0x7fa74c0d0ae0 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.724+0000 7fa7437fe640 1 -- 172.21.15.38:0/3265053379 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c00a7a0 con 0x7fa74c0d0ae0 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.724+0000 7fa7437fe640 1 -- 172.21.15.38:0/3265053379 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c00ab10 con 0x7fa74c0d0ae0 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.724+0000 7fa751139640 1 -- 172.21.15.38:0/3265053379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7340094d0 con 0x7fa74c0d0ae0 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.724+0000 7fa751139640 1 -- 172.21.15.38:0/3265053379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74c06fe80 con 0x7fa74c0d0ae0 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.726+0000 7fa7437fe640 1 -- 172.21.15.38:0/3265053379 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa73c00ac70 con 0x7fa74c0d0ae0 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.727+0000 7fa7437fe640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa72c06a430 0x7fa72c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.727+0000 7fa7437fe640 1 -- 172.21.15.38:0/3265053379 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa73c087fe0 con 0x7fa74c0d0ae0 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.727+0000 7fa753d7d740 1 Processor -- start 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.728+0000 7fa74a59c640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa72c06a430 0x7fa72c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.728+0000 7fa753d7d740 1 -- start start 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.729+0000 7fa753d7d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 0x56419d2f7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.729+0000 7fa753d7d740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2c6cb0 0x56419d2f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.729+0000 7fa753d7d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2ca8b0 0x56419d2f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.729+0000 7fa753d7d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419d236f80 con 0x56419d2f6d30 2023-12-22T08:46:17.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.729+0000 7fa753d7d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419d234710 con 0x56419d2ca8b0 2023-12-22T08:46:17.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.729+0000 7fa753d7d740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56419d230000 con 0x56419d2c6cb0 2023-12-22T08:46:17.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.729+0000 7fa74a59c640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa72c06a430 0x7fa72c06c8f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa734036000 tx=0x7fa73403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:17.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.729+0000 7fa74ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 0x56419d2f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.729+0000 7fa74ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 0x56419d2f7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48026/0 (socket says 172.21.15.38:48026) 2023-12-22T08:46:17.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.729+0000 7fa74ad9d640 1 -- 172.21.15.38:0/750215660 learned_addr learned my addr 172.21.15.38:0/750215660 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:17.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.729+0000 7fa74b59e640 1 --2- 172.21.15.38:0/750215660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2ca8b0 0x56419d2f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.729+0000 7fa74a59c640 1 --2- 172.21.15.38:0/750215660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2c6cb0 0x56419d2f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.730+0000 7fa74ad9d640 1 -- 172.21.15.38:0/750215660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2c6cb0 msgr2=0x56419d2f3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:17.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.730+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/750215660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2c6cb0 0x56419d2f3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.730+0000 7fa74ad9d640 1 -- 172.21.15.38:0/750215660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2ca8b0 msgr2=0x56419d2f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:17.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.730+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/750215660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2ca8b0 0x56419d2f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.730+0000 7fa74ad9d640 1 -- 172.21.15.38:0/750215660 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56419d1f7690 con 0x56419d2f6d30 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.730+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/750215660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 0x56419d2f7110 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0537a0 tx=0x7fa73c001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e871e75b7ccac8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.730+0000 7fa740ff9640 1 -- 172.21.15.38:0/750215660 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c055640 con 0x56419d2f6d30 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.730+0000 7fa740ff9640 1 -- 172.21.15.38:0/750215660 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c0539b0 con 0x56419d2f6d30 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.730+0000 7fa740ff9640 1 -- 172.21.15.38:0/750215660 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0569b0 con 0x56419d2f6d30 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.731+0000 7fa753d7d740 1 -- 172.21.15.38:0/750215660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 msgr2=0x56419d2f7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.731+0000 7fa753d7d740 1 --2- 172.21.15.38:0/750215660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 0x56419d2f7110 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0537a0 tx=0x7fa73c001980 comp rx=0 tx=0).stop 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.731+0000 7fa753d7d740 1 -- 172.21.15.38:0/750215660 shutdown_connections 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.731+0000 7fa753d7d740 1 --2- 172.21.15.38:0/750215660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2ca8b0 0x56419d2f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.731+0000 7fa753d7d740 1 --2- 172.21.15.38:0/750215660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2c6cb0 0x56419d2f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.731+0000 7fa753d7d740 1 --2- 172.21.15.38:0/750215660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 0x56419d2f7110 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.731+0000 7fa753d7d740 1 -- 172.21.15.38:0/750215660 >> 172.21.15.38:0/750215660 conn(0x56419d2c8fc0 msgr2=0x56419d311b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.731+0000 7fa753d7d740 1 -- 172.21.15.38:0/750215660 shutdown_connections 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.731+0000 7fa753d7d740 1 -- 172.21.15.38:0/750215660 wait complete. 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.732+0000 7fa753d7d740 1 -- start start 2023-12-22T08:46:17.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.732+0000 7fa753d7d740 1 Processor -- start 2023-12-22T08:46:17.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.733+0000 7fa753d7d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 0x56419d2f8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.733+0000 7fa753d7d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2f6d30 0x56419d2ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.733+0000 7fa753d7d740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2f7210 0x56419d2ee040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.733+0000 7fa753d7d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419d1d17d0 con 0x56419d2ca8b0 2023-12-22T08:46:17.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.733+0000 7fa753d7d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419d1d1470 con 0x56419d2f6d30 2023-12-22T08:46:17.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.733+0000 7fa753d7d740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56419cf97f20 con 0x56419d2f7210 2023-12-22T08:46:17.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.733+0000 7fa753d7d740 10 client.0 _ll_register_callbacks cb 0x56419d2201b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:46:17.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.733+0000 7fa74ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 0x56419d2f8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.733+0000 7fa74ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 0x56419d2f8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48036/0 (socket says 172.21.15.38:48036) 2023-12-22T08:46:17.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.733+0000 7fa74ad9d640 1 -- 172.21.15.38:0/1957613861 learned_addr learned my addr 172.21.15.38:0/1957613861 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:17.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa74a59c640 1 --2- 172.21.15.38:0/1957613861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2f6d30 0x56419d2ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa74ad9d640 1 -- 172.21.15.38:0/1957613861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2f7210 msgr2=0x56419d2ee040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:17.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/1957613861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2f7210 0x56419d2ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa74ad9d640 1 -- 172.21.15.38:0/1957613861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2f6d30 msgr2=0x56419d2ef6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/1957613861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2f6d30 0x56419d2ef6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa74ad9d640 1 -- 172.21.15.38:0/1957613861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74c06fe80 con 0x56419d2ca8b0 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/1957613861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 0x56419d2f8b70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00a430 tx=0x7fa73c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f60190b3e998841 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa729ffb640 1 -- 172.21.15.38:0/1957613861 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c073070 con 0x56419d2ca8b0 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa729ffb640 1 -- 172.21.15.38:0/1957613861 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa73c053b20 con 0x56419d2ca8b0 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa753d7d740 1 -- 172.21.15.38:0/1957613861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56419d25a550 con 0x56419d2ca8b0 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa729ffb640 1 -- 172.21.15.38:0/1957613861 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa73c0861e0 con 0x56419d2ca8b0 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa753d7d740 10 client.6993 fetch_fsmap learned FSMap version 47 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.734+0000 7fa753d7d740 1 -- 172.21.15.38:0/1957613861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x56419d22e680 con 0x56419d2ca8b0 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.735+0000 7fa729ffb640 1 -- 172.21.15.38:0/1957613861 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56419d25a550 con 0x56419d2ca8b0 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.735+0000 7fa729ffb640 1 -- 172.21.15.38:0/1957613861 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 47) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fa73c05ed40 con 0x56419d2ca8b0 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.735+0000 7fa753d7d740 10 client.6993 fetch_fsmap finished waiting for FSMap version 47 2023-12-22T08:46:17.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.735+0000 7fa753d7d740 10 client.6993 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.735+0000 7fa753d7d740 20 client.6993 populate_metadata read hostname 'smithi038' 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.735+0000 7fa753d7d740 1 --2- 172.21.15.38:0/1957613861 >> [v2:172.21.15.38:6833/2733146003,v1:172.21.15.38:6835/2733146003] conn(0x56419d2cc9c0 0x56419d2f10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.735+0000 7fa753d7d740 4 client.6993 mds_command: new command op to 6867 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.735+0000 7fa753d7d740 1 -- 172.21.15.38:0/1957613861 --> [v2:172.21.15.38:6833/2733146003,v1:172.21.15.38:6835/2733146003] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56419d222b50 con 0x56419d2cc9c0 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.735+0000 7fa74a59c640 1 --2- 172.21.15.38:0/1957613861 >> [v2:172.21.15.38:6833/2733146003,v1:172.21.15.38:6835/2733146003] conn(0x56419d2cc9c0 0x56419d2f10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.736+0000 7fa729ffb640 10 client.6993 ms_handle_connect on v2:172.21.15.38:6833/2733146003 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.736+0000 7fa74a59c640 1 --2- 172.21.15.38:0/1957613861 >> [v2:172.21.15.38:6833/2733146003,v1:172.21.15.38:6835/2733146003] conn(0x56419d2cc9c0 0x56419d2f10f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f96411274bb7fdde server_cookie=26e6a03cc2a9f230 in_seq=0 out_seq=0 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.736+0000 7fa729ffb640 1 -- 172.21.15.38:0/1957613861 <== mds.0 v2:172.21.15.38:6833/2733146003 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x56419d222b50 con 0x56419d2cc9c0 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.736+0000 7fa729ffb640 10 client.6993 handle_command_reply: tid=0 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.736+0000 7fa753d7d740 1 client.6993 shutdown 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.737+0000 7fa753d7d740 1 -- 172.21.15.38:0/1957613861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 msgr2=0x56419d2f8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.737+0000 7fa753d7d740 1 --2- 172.21.15.38:0/1957613861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 0x56419d2f8b70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00a430 tx=0x7fa73c001250 comp rx=0 tx=0).stop 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.737+0000 7fa753d7d740 1 -- 172.21.15.38:0/1957613861 shutdown_connections 2023-12-22T08:46:17.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.737+0000 7fa753d7d740 1 --2- 172.21.15.38:0/1957613861 >> [v2:172.21.15.38:6833/2733146003,v1:172.21.15.38:6835/2733146003] conn(0x56419d2cc9c0 0x56419d2f10f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.737+0000 7fa753d7d740 1 --2- 172.21.15.38:0/1957613861 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2f7210 0x56419d2ee040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.737+0000 7fa753d7d740 1 --2- 172.21.15.38:0/1957613861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2f6d30 0x56419d2ef6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.737+0000 7fa729ffb640 0 client.6993 ms_handle_reset on v2:172.21.15.38:6833/2733146003 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.737+0000 7fa753d7d740 1 --2- 172.21.15.38:0/1957613861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 0x56419d2f8b70 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.737+0000 7fa753d7d740 1 -- 172.21.15.38:0/1957613861 >> 172.21.15.38:0/1957613861 conn(0x56419d2c6cb0 msgr2=0x56419d315050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.737+0000 7fa753d7d740 1 -- 172.21.15.38:0/1957613861 shutdown_connections 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.737+0000 7fa753d7d740 1 -- 172.21.15.38:0/1957613861 wait complete. 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.737+0000 7fa753d7d740 20 client.6993 trim_cache size 0 max 16384 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.753+0000 7fa753d7d740 1 Processor -- start 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.753+0000 7fa753d7d740 1 -- start start 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.754+0000 7fa753d7d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 0x56419d312740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.754+0000 7fa753d7d740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2f6d30 0x56419d2f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.754+0000 7fa753d7d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2f7210 0x56419d2cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.754+0000 7fa753d7d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419d2c7620 con 0x56419d2ca8b0 2023-12-22T08:46:17.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.754+0000 7fa753d7d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419d2cd540 con 0x56419d2f7210 2023-12-22T08:46:17.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.754+0000 7fa753d7d740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56419d2f3370 con 0x56419d2f6d30 2023-12-22T08:46:17.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.754+0000 7fa74ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 0x56419d312740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.754+0000 7fa74ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 0x56419d312740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48044/0 (socket says 172.21.15.38:48044) 2023-12-22T08:46:17.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.754+0000 7fa74ad9d640 1 -- 172.21.15.38:0/2387943845 learned_addr learned my addr 172.21.15.38:0/2387943845 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:17.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.755+0000 7fa74ad9d640 1 -- 172.21.15.38:0/2387943845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2f6d30 msgr2=0x56419d2f7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:17.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.755+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/2387943845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2f6d30 0x56419d2f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.755+0000 7fa74ad9d640 1 -- 172.21.15.38:0/2387943845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2f7210 msgr2=0x56419d2cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:17.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.755+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/2387943845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2f7210 0x56419d2cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.755+0000 7fa74ad9d640 1 -- 172.21.15.38:0/2387943845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56419d1d09e0 con 0x56419d2ca8b0 2023-12-22T08:46:17.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.755+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/2387943845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 0x56419d312740 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0555f0 tx=0x7fa73c082040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50d0f1404805eaf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:17.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.755+0000 7fa7417fa640 1 -- 172.21.15.38:0/2387943845 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c073040 con 0x56419d2ca8b0 2023-12-22T08:46:17.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.755+0000 7fa7417fa640 1 -- 172.21.15.38:0/2387943845 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c053b20 con 0x56419d2ca8b0 2023-12-22T08:46:17.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.755+0000 7fa7417fa640 1 -- 172.21.15.38:0/2387943845 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0861e0 con 0x56419d2ca8b0 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.756+0000 7fa753d7d740 1 -- 172.21.15.38:0/2387943845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 msgr2=0x56419d312740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.756+0000 7fa753d7d740 1 --2- 172.21.15.38:0/2387943845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 0x56419d312740 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0555f0 tx=0x7fa73c082040 comp rx=0 tx=0).stop 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.756+0000 7fa753d7d740 1 -- 172.21.15.38:0/2387943845 shutdown_connections 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.756+0000 7fa753d7d740 1 --2- 172.21.15.38:0/2387943845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2f7210 0x56419d2cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.756+0000 7fa753d7d740 1 --2- 172.21.15.38:0/2387943845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2f6d30 0x56419d2f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.756+0000 7fa753d7d740 1 --2- 172.21.15.38:0/2387943845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2ca8b0 0x56419d312740 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.756+0000 7fa753d7d740 1 -- 172.21.15.38:0/2387943845 >> 172.21.15.38:0/2387943845 conn(0x56419d2c6cb0 msgr2=0x56419d2e2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.756+0000 7fa753d7d740 1 -- 172.21.15.38:0/2387943845 shutdown_connections 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.756+0000 7fa753d7d740 1 -- 172.21.15.38:0/2387943845 wait complete. 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.757+0000 7fa753d7d740 1 -- start start 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.757+0000 7fa753d7d740 1 Processor -- start 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa753d7d740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2ca8b0 0x56419d313fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa753d7d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 0x56419d2eb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa753d7d740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2f7210 0x56419d377190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa753d7d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419d377f90 con 0x56419d2f6d30 2023-12-22T08:46:17.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa753d7d740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56419d2cb850 con 0x56419d2f7210 2023-12-22T08:46:17.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa753d7d740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x56419d313560 con 0x56419d2ca8b0 2023-12-22T08:46:17.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa753d7d740 10 client.0 _ll_register_callbacks cb 0x7fa73c053660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:46:17.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa74a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 0x56419d2eb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa74a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 0x56419d2eb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48046/0 (socket says 172.21.15.38:48046) 2023-12-22T08:46:17.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa74a59c640 1 -- 172.21.15.38:0/3879207975 learned_addr learned my addr 172.21.15.38:0/3879207975 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:17.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa74a59c640 1 -- 172.21.15.38:0/3879207975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2ca8b0 msgr2=0x56419d313fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:17.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa74a59c640 1 --2- 172.21.15.38:0/3879207975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2ca8b0 0x56419d313fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa74a59c640 1 -- 172.21.15.38:0/3879207975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2f7210 msgr2=0x56419d377190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:17.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa74a59c640 1 --2- 172.21.15.38:0/3879207975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2f7210 0x56419d377190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.758+0000 7fa74a59c640 1 -- 172.21.15.38:0/3879207975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56419d22e680 con 0x56419d2f6d30 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.759+0000 7fa74a59c640 1 --2- 172.21.15.38:0/3879207975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 0x56419d2eb990 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fa734000c00 tx=0x7fa7340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a721bab89272c0a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.759+0000 7fa729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.759+0000 7fa729ffb640 1 -- 172.21.15.38:0/3879207975 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734049040 con 0x56419d2f6d30 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.759+0000 7fa729ffb640 1 -- 172.21.15.38:0/3879207975 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa73403e040 con 0x56419d2f6d30 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.759+0000 7fa753d7d740 1 -- 172.21.15.38:0/3879207975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa73c0539b0 con 0x56419d2f6d30 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.759+0000 7fa729ffb640 1 -- 172.21.15.38:0/3879207975 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa734053350 con 0x56419d2f6d30 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.759+0000 7fa753d7d740 10 client.6999 fetch_fsmap learned FSMap version 47 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.759+0000 7fa753d7d740 1 -- 172.21.15.38:0/3879207975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x56419d1f5ef0 con 0x56419d2f6d30 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.759+0000 7fa729ffb640 1 -- 172.21.15.38:0/3879207975 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c0539b0 con 0x56419d2f6d30 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.759+0000 7fa729ffb640 1 -- 172.21.15.38:0/3879207975 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 47) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fa734042050 con 0x56419d2f6d30 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.759+0000 7fa753d7d740 10 client.6999 fetch_fsmap finished waiting for FSMap version 47 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.759+0000 7fa753d7d740 10 client.6999 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.759+0000 7fa753d7d740 20 client.6999 populate_metadata read hostname 'smithi038' 2023-12-22T08:46:17.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.760+0000 7fa753d7d740 1 --2- 172.21.15.38:0/3879207975 >> [v2:172.21.15.38:6833/2733146003,v1:172.21.15.38:6835/2733146003] conn(0x56419d2cbbb0 0x56419d2cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.760+0000 7fa753d7d740 4 client.6999 mds_command: new command op to 6867 tid=0[{"prefix": "status"}] 2023-12-22T08:46:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.760+0000 7fa753d7d740 1 -- 172.21.15.38:0/3879207975 --> [v2:172.21.15.38:6833/2733146003,v1:172.21.15.38:6835/2733146003] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56419d229080 con 0x56419d2cbbb0 2023-12-22T08:46:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.760+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/3879207975 >> [v2:172.21.15.38:6833/2733146003,v1:172.21.15.38:6835/2733146003] conn(0x56419d2cbbb0 0x56419d2cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.760+0000 7fa74ad9d640 1 --2- 172.21.15.38:0/3879207975 >> [v2:172.21.15.38:6833/2733146003,v1:172.21.15.38:6835/2733146003] conn(0x56419d2cbbb0 0x56419d2cbf90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=912b83cebb0925a4 server_cookie=e6827089e14ea2d3 in_seq=0 out_seq=0 2023-12-22T08:46:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.760+0000 7fa729ffb640 10 client.6999 ms_handle_connect on v2:172.21.15.38:6833/2733146003 2023-12-22T08:46:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.760+0000 7fa729ffb640 1 -- 172.21.15.38:0/3879207975 <== mds.0 v2:172.21.15.38:6833/2733146003 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x56419d229080 con 0x56419d2cbbb0 2023-12-22T08:46:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.760+0000 7fa729ffb640 10 client.6999 handle_command_reply: tid=0 2023-12-22T08:46:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.760+0000 7fa753d7d740 1 client.6999 shutdown 2023-12-22T08:46:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.761+0000 7fa753d7d740 1 -- 172.21.15.38:0/3879207975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 msgr2=0x56419d2eb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.761+0000 7fa753d7d740 1 --2- 172.21.15.38:0/3879207975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 0x56419d2eb990 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fa734000c00 tx=0x7fa7340046c0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.761+0000 7fa753d7d740 1 -- 172.21.15.38:0/3879207975 shutdown_connections 2023-12-22T08:46:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.761+0000 7fa753d7d740 1 --2- 172.21.15.38:0/3879207975 >> [v2:172.21.15.38:6833/2733146003,v1:172.21.15.38:6835/2733146003] conn(0x56419d2cbbb0 0x56419d2cbf90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.761+0000 7fa753d7d740 1 --2- 172.21.15.38:0/3879207975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56419d2f7210 0x56419d377190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.761+0000 7fa753d7d740 1 --2- 172.21.15.38:0/3879207975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56419d2f6d30 0x56419d2eb990 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.761+0000 7fa753d7d740 1 --2- 172.21.15.38:0/3879207975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56419d2ca8b0 0x56419d313fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.761+0000 7fa729ffb640 0 client.6999 ms_handle_reset on v2:172.21.15.38:6833/2733146003 2023-12-22T08:46:17.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.761+0000 7fa753d7d740 1 -- 172.21.15.38:0/3879207975 >> 172.21.15.38:0/3879207975 conn(0x56419d2c6cb0 msgr2=0x56419d2f7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:17.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.761+0000 7fa753d7d740 1 -- 172.21.15.38:0/3879207975 shutdown_connections 2023-12-22T08:46:17.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.761+0000 7fa753d7d740 1 -- 172.21.15.38:0/3879207975 wait complete. 2023-12-22T08:46:17.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.761+0000 7fa753d7d740 20 client.6999 trim_cache size 0 max 16384 2023-12-22T08:46:17.786 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:46:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:46:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-12-22T08:46:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 6867, 2023-12-22T08:46:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-12-22T08:46:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-12-22T08:46:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-12-22T08:46:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 6.7421136370000001, 2023-12-22T08:46:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 47, 2023-12-22T08:46:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 110, 2023-12-22T08:46:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 110, 2023-12-22T08:46:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 12.336344858 2023-12-22T08:46:17.787 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:46:17.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.762+0000 7fa751139640 1 -- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa72c06a430 msgr2=0x7fa72c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:17.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.762+0000 7fa751139640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa72c06a430 0x7fa72c06c8f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa734036000 tx=0x7fa73403b040 comp rx=0 tx=0).stop 2023-12-22T08:46:17.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.762+0000 7fa751139640 1 -- 172.21.15.38:0/3265053379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0d0ae0 msgr2=0x7fa74c13d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:17.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.762+0000 7fa751139640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0d0ae0 0x7fa74c13d840 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00c830 tx=0x7fa73c00ccf0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.762+0000 7fa751139640 1 -- 172.21.15.38:0/3265053379 shutdown_connections 2023-12-22T08:46:17.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.762+0000 7fa751139640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa74c144b70 0x7fa74c142800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.762+0000 7fa751139640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa74c144790 0x7fa74c1422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.762+0000 7fa751139640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa72c06a430 0x7fa72c06c8f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.762+0000 7fa751139640 1 --2- 172.21.15.38:0/3265053379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0d0ae0 0x7fa74c13d840 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:17.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.762+0000 7fa751139640 1 -- 172.21.15.38:0/3265053379 >> 172.21.15.38:0/3265053379 conn(0x7fa74c071840 msgr2=0x7fa74c071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:17.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.762+0000 7fa751139640 1 -- 172.21.15.38:0/3265053379 shutdown_connections 2023-12-22T08:46:17.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:17.762+0000 7fa751139640 1 -- 172.21.15.38:0/3265053379 wait complete. 2023-12-22T08:46:17.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:46:17.790 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:46:18.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.026+0000 7f5fe56a8640 1 Processor -- start 2023-12-22T08:46:18.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.026+0000 7f5fe56a8640 1 -- start start 2023-12-22T08:46:18.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.027+0000 7f5fe56a8640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5fe006d210 0x7f5fe015e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:18.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.027+0000 7f5fe56a8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe00706d0 con 0x7f5fe006d5f0 2023-12-22T08:46:18.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.027+0000 7f5fe56a8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe00cbf40 con 0x7f5fe00cb4c0 2023-12-22T08:46:18.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.027+0000 7f5fe56a8640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe00ce840 con 0x7f5fe006d210 2023-12-22T08:46:18.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.028+0000 7f5fdffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5fe006d210 0x7f5fe015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:18.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.028+0000 7f5fdffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5fe006d210 0x7f5fe015e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48054/0 (socket says 172.21.15.38:48054) 2023-12-22T08:46:18.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.028+0000 7f5fdffff640 1 -- 172.21.15.38:0/657785724 learned_addr learned my addr 172.21.15.38:0/657785724 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:18.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.028+0000 7f5fe4ea7640 1 --1- 172.21.15.38:0/657785724 >> v1:172.21.15.38:6789/0 conn(0x7f5fe006d5f0 0x7f5fe0070b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47050/0 (socket says 172.21.15.38:47050) 2023-12-22T08:46:18.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.028+0000 7f5fdffff640 1 -- 172.21.15.38:0/657785724 >> v1:172.21.15.89:6789/0 conn(0x7f5fe00cb4c0 legacy=0x7f5fe0159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:18.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.028+0000 7f5fdffff640 1 -- 172.21.15.38:0/657785724 >> v1:172.21.15.38:6789/0 conn(0x7f5fe006d5f0 legacy=0x7f5fe0070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:18.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.028+0000 7f5fdffff640 1 -- 172.21.15.38:0/657785724 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe00ceb20 con 0x7f5fe006d210 2023-12-22T08:46:18.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.029+0000 7f5fdffff640 1 --2- 172.21.15.38:0/657785724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe006d210 0x7f5fe015e830 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009870 tx=0x7f5fd002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca72a1d52e1b142 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:18.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.030+0000 7f5fdeffd640 1 -- 172.21.15.38:0/657785724 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0030860 con 0x7f5fe006d210 2023-12-22T08:46:18.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.030+0000 7f5fdeffd640 1 -- 172.21.15.38:0/657785724 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd00309c0 con 0x7f5fe006d210 2023-12-22T08:46:18.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.030+0000 7f5fdeffd640 1 -- 172.21.15.38:0/657785724 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0030d50 con 0x7f5fe006d210 2023-12-22T08:46:18.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.030+0000 7f5fe56a8640 1 -- 172.21.15.38:0/657785724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe006d210 msgr2=0x7f5fe015e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:18.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.030+0000 7f5fe56a8640 1 --2- 172.21.15.38:0/657785724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe006d210 0x7f5fe015e830 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009870 tx=0x7f5fd002b9a0 comp rx=0 tx=0).stop 2023-12-22T08:46:18.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.030+0000 7f5fe56a8640 1 -- 172.21.15.38:0/657785724 shutdown_connections 2023-12-22T08:46:18.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.030+0000 7f5fe56a8640 1 --2- 172.21.15.38:0/657785724 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe006d210 0x7f5fe015e830 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:18.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.030+0000 7f5fe56a8640 1 -- 172.21.15.38:0/657785724 >> 172.21.15.38:0/657785724 conn(0x7f5fe00b1f70 msgr2=0x7f5fe00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:18.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.030+0000 7f5fe56a8640 1 -- 172.21.15.38:0/657785724 shutdown_connections 2023-12-22T08:46:18.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.030+0000 7f5fe56a8640 1 -- 172.21.15.38:0/657785724 wait complete. 2023-12-22T08:46:18.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.032+0000 7f5fe56a8640 1 Processor -- start 2023-12-22T08:46:18.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.032+0000 7f5fe56a8640 1 -- start start 2023-12-22T08:46:18.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.033+0000 7f5fe56a8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe006d210 0x7f5fe0159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:18.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.033+0000 7f5fe56a8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fe006d5f0 0x7f5fe00c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:18.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fe56a8640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5fe00cb4c0 0x7f5fe015a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:18.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fe56a8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00c3740 con 0x7f5fe006d210 2023-12-22T08:46:18.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fe56a8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0159c40 con 0x7f5fe006d5f0 2023-12-22T08:46:18.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fe56a8640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00c2b30 con 0x7f5fe00cb4c0 2023-12-22T08:46:18.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fdffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe006d210 0x7f5fe0159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:18.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fdffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe006d210 0x7f5fe0159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48060/0 (socket says 172.21.15.38:48060) 2023-12-22T08:46:18.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fdffff640 1 -- 172.21.15.38:0/2973580393 learned_addr learned my addr 172.21.15.38:0/2973580393 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:18.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fdf7fe640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fe006d5f0 0x7f5fe00c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:18.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fe4ea7640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5fe00cb4c0 0x7f5fe015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:18.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fdffff640 1 -- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5fe00cb4c0 msgr2=0x7f5fe015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:18.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fdffff640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5fe00cb4c0 0x7f5fe015a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:18.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fdffff640 1 -- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fe006d5f0 msgr2=0x7f5fe00c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:18.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fdffff640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fe006d5f0 0x7f5fe00c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:18.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fdffff640 1 -- 172.21.15.38:0/2973580393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00094d0 con 0x7f5fe006d210 2023-12-22T08:46:18.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.034+0000 7f5fdf7fe640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fe006d5f0 0x7f5fe00c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:18.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.035+0000 7f5fdffff640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe006d210 0x7f5fe0159700 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009870 tx=0x7f5fd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:18.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.035+0000 7f5fdcff9640 1 -- 172.21.15.38:0/2973580393 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0030810 con 0x7f5fe006d210 2023-12-22T08:46:18.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.035+0000 7f5fdcff9640 1 -- 172.21.15.38:0/2973580393 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0043400 con 0x7f5fe006d210 2023-12-22T08:46:18.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.035+0000 7f5fdcff9640 1 -- 172.21.15.38:0/2973580393 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00437b0 con 0x7f5fe006d210 2023-12-22T08:46:18.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.035+0000 7f5fe56a8640 1 -- 172.21.15.38:0/2973580393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe00c2e10 con 0x7f5fe006d210 2023-12-22T08:46:18.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.035+0000 7f5fe56a8640 1 -- 172.21.15.38:0/2973580393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe00c33d0 con 0x7f5fe006d210 2023-12-22T08:46:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.037+0000 7f5fe56a8640 1 -- 172.21.15.38:0/2973580393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe00a02d0 con 0x7f5fe006d210 2023-12-22T08:46:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.038+0000 7f5fdcff9640 1 -- 172.21.15.38:0/2973580393 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5fd0043910 con 0x7f5fe006d210 2023-12-22T08:46:18.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.039+0000 7f5fdcff9640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5fcc06a460 0x7f5fcc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:18.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.039+0000 7f5fdcff9640 1 -- 172.21.15.38:0/2973580393 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fd003e070 con 0x7f5fe006d210 2023-12-22T08:46:18.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.039+0000 7f5fdf7fe640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5fcc06a460 0x7f5fcc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:18.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.041+0000 7f5fdf7fe640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5fcc06a460 0x7f5fcc06c920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00a4400 tx=0x7f5fd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.043+0000 7f5fdcff9640 1 -- 172.21.15.38:0/2973580393 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5fd0077250 con 0x7f5fe006d210 2023-12-22T08:46:18.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.281+0000 7f5fe56a8640 1 -- 172.21.15.38:0/2973580393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5fe0061910 con 0x7f5fe006d210 2023-12-22T08:46:18.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.282+0000 7f5fdcff9640 1 -- 172.21.15.38:0/2973580393 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5fd0034070 con 0x7f5fe006d210 2023-12-22T08:46:18.283 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:46:18.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.285+0000 7f5fe56a8640 1 -- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5fcc06a460 msgr2=0x7f5fcc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:18.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.285+0000 7f5fe56a8640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5fcc06a460 0x7f5fcc06c920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00a4400 tx=0x7f5fd4008040 comp rx=0 tx=0).stop 2023-12-22T08:46:18.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.285+0000 7f5fe56a8640 1 -- 172.21.15.38:0/2973580393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe006d210 msgr2=0x7f5fe0159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:18.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.285+0000 7f5fe56a8640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe006d210 0x7f5fe0159700 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009870 tx=0x7f5fd0004730 comp rx=0 tx=0).stop 2023-12-22T08:46:18.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.285+0000 7f5fe56a8640 1 -- 172.21.15.38:0/2973580393 shutdown_connections 2023-12-22T08:46:18.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.285+0000 7f5fe56a8640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5fe00cb4c0 0x7f5fe015a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:18.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.285+0000 7f5fe56a8640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fe006d5f0 0x7f5fe00c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:18.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.285+0000 7f5fe56a8640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5fcc06a460 0x7f5fcc06c920 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:18.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.285+0000 7f5fe56a8640 1 --2- 172.21.15.38:0/2973580393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fe006d210 0x7f5fe0159700 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:18.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.285+0000 7f5fe56a8640 1 -- 172.21.15.38:0/2973580393 >> 172.21.15.38:0/2973580393 conn(0x7f5fe00b1f70 msgr2=0x7f5fe006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:18.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.285+0000 7f5fe56a8640 1 -- 172.21.15.38:0/2973580393 shutdown_connections 2023-12-22T08:46:18.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:18.285+0000 7f5fe56a8640 1 -- 172.21.15.38:0/2973580393 wait complete. 2023-12-22T08:46:18.306 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:46:18.306 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:46:18.306 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-12-22T08:46:18.306 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T08:46:18.306 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:46:18.306 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:46:18.306 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:46:18.306 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:46:18.306 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:46:18.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:18.307 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-12-22T08:46:18.354 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:46:18.354 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:46:18.354 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:46:18.354 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:18.354 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:46:18.354 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:18.354 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:46:18.354 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 41988sec preferred_lft 41988sec 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-12-22T08:46:18.355 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::5440:f6ff:fe40:85a/64 scope link 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:c3:65:6c:32:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::e4c3:65ff:fe6c:322e/64 scope link 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::34bf:8aff:fe68:3bf6/64 scope link 2023-12-22T08:46:18.356 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:18.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:18.357 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:46:18.497 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-12-22T08:46:18.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:18.502 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-12-22T08:46:18.564 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-12-22T08:46:18.564 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:46:18.564 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-22T08:46:18.564 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-22T08:46:18.564 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:46:18.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:18.565 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:46:18.565 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:46:18.565 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T08:46:18.565 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T08:46:18.565 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T08:46:18.565 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:46:18.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:18.758 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:46:18.815 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:46:18.816 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-22T08:46:18.816 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:46:18.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:18.816 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-12-22T08:46:18.918 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:46:18.918 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T08:46:18.975 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:46:18.975 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:46:18.975 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:46:19.034 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-22T08:46:19.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:19.034 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:46:19.185 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:46:19.186 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:46:19.218 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:46:19.219 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:46:19.219 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:46:19.219 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with new device syntax: 0@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:46:19.219 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:46:19.223 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T08:46:19.223 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:46:19.223 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:46:19.223 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:46:19.223 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:46:19.228 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:46:19.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:19.228 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:46:19.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:19.319 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:46:19.390 INFO:teuthology.orchestra.run.smithi038.stdout:client7011 2023-12-22T08:46:19.391 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:46:19.391 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:19.450 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:46:19.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.674+0000 7fd61279b640 1 Processor -- start 2023-12-22T08:46:19.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.674+0000 7fd61279b640 1 -- start start 2023-12-22T08:46:19.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.676+0000 7fd61279b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd60c161340 0x7fd60c071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:19.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.676+0000 7fd61279b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd60c071fa0 0x7fd60c0adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:19.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.676+0000 7fd61279b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c0ce950 con 0x7fd60c161720 2023-12-22T08:46:19.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.676+0000 7fd61279b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c0cdd40 con 0x7fd60c161340 2023-12-22T08:46:19.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.676+0000 7fd61279b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0ce020 con 0x7fd60c071fa0 2023-12-22T08:46:19.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.676+0000 7fd611799640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd60c161340 0x7fd60c071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:19.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.677+0000 7fd611799640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd60c161340 0x7fd60c071a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48068/0 (socket says 172.21.15.38:48068) 2023-12-22T08:46:19.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.677+0000 7fd611799640 1 -- 172.21.15.38:0/2780567553 learned_addr learned my addr 172.21.15.38:0/2780567553 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:19.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.677+0000 7fd610f98640 1 --2- 172.21.15.38:0/2780567553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd60c071fa0 0x7fd60c0adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:19.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.677+0000 7fd611799640 1 -- 172.21.15.38:0/2780567553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd60c071fa0 msgr2=0x7fd60c0adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:19.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.677+0000 7fd611799640 1 --2- 172.21.15.38:0/2780567553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd60c071fa0 0x7fd60c0adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:19.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.677+0000 7fd611799640 1 -- 172.21.15.38:0/2780567553 >> v1:172.21.15.89:6789/0 conn(0x7fd60c161720 legacy=0x7fd60c0ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:19.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.677+0000 7fd611799640 1 -- 172.21.15.38:0/2780567553 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0ce300 con 0x7fd60c161340 2023-12-22T08:46:19.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.679+0000 7fd611799640 1 --2- 172.21.15.38:0/2780567553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c161340 0x7fd60c071a60 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd608009870 tx=0x7fd60802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e379b2890b4e53 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:19.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.679+0000 7fd603fff640 1 -- 172.21.15.38:0/2780567553 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd608031640 con 0x7fd60c161340 2023-12-22T08:46:19.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.679+0000 7fd603fff640 1 -- 172.21.15.38:0/2780567553 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6080317a0 con 0x7fd60c161340 2023-12-22T08:46:19.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.679+0000 7fd603fff640 1 -- 172.21.15.38:0/2780567553 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd608031b30 con 0x7fd60c161340 2023-12-22T08:46:19.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.680+0000 7fd61279b640 1 -- 172.21.15.38:0/2780567553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c161340 msgr2=0x7fd60c071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:19.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.680+0000 7fd61279b640 1 --2- 172.21.15.38:0/2780567553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c161340 0x7fd60c071a60 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd608009870 tx=0x7fd60802b8f0 comp rx=0 tx=0).stop 2023-12-22T08:46:19.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.680+0000 7fd61279b640 1 -- 172.21.15.38:0/2780567553 shutdown_connections 2023-12-22T08:46:19.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.680+0000 7fd61279b640 1 --2- 172.21.15.38:0/2780567553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd60c071fa0 0x7fd60c0adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:19.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.680+0000 7fd61279b640 1 --2- 172.21.15.38:0/2780567553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c161340 0x7fd60c071a60 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:19.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.680+0000 7fd61279b640 1 -- 172.21.15.38:0/2780567553 >> 172.21.15.38:0/2780567553 conn(0x7fd60c0b1f70 msgr2=0x7fd60c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:19.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.680+0000 7fd61279b640 1 -- 172.21.15.38:0/2780567553 shutdown_connections 2023-12-22T08:46:19.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.680+0000 7fd61279b640 1 -- 172.21.15.38:0/2780567553 wait complete. 2023-12-22T08:46:19.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.682+0000 7fd61279b640 1 Processor -- start 2023-12-22T08:46:19.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.682+0000 7fd61279b640 1 -- start start 2023-12-22T08:46:19.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.683+0000 7fd61279b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c071fa0 0x7fd60c1f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.683+0000 7fd61279b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd60c161340 0x7fd60c159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.683+0000 7fd61279b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd60c161720 0x7fd60c151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.683+0000 7fd61279b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c156430 con 0x7fd60c071fa0 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.683+0000 7fd61279b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c1599b0 con 0x7fd60c161340 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.683+0000 7fd61279b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c1f6950 con 0x7fd60c161720 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.683+0000 7fd611799640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c071fa0 0x7fd60c1f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.684+0000 7fd611799640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c071fa0 0x7fd60c1f60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48076/0 (socket says 172.21.15.38:48076) 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.684+0000 7fd611799640 1 -- 172.21.15.38:0/973072089 learned_addr learned my addr 172.21.15.38:0/973072089 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.684+0000 7fd610f98640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd60c161340 0x7fd60c159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.684+0000 7fd611799640 1 -- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd60c161720 msgr2=0x7fd60c151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.684+0000 7fd611799640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd60c161720 0x7fd60c151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.684+0000 7fd611799640 1 -- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd60c161340 msgr2=0x7fd60c159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.684+0000 7fd611799640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd60c161340 0x7fd60c159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:19.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.684+0000 7fd611799640 1 -- 172.21.15.38:0/973072089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080094d0 con 0x7fd60c071fa0 2023-12-22T08:46:19.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.684+0000 7fd610f98640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd60c161340 0x7fd60c159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:19.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.684+0000 7fd611799640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c071fa0 0x7fd60c1f60e0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd608000c00 tx=0x7fd6080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:19.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.685+0000 7fd601ffb640 1 -- 172.21.15.38:0/973072089 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60803ac60 con 0x7fd60c071fa0 2023-12-22T08:46:19.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.685+0000 7fd601ffb640 1 -- 172.21.15.38:0/973072089 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60803adc0 con 0x7fd60c071fa0 2023-12-22T08:46:19.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.685+0000 7fd601ffb640 1 -- 172.21.15.38:0/973072089 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd608044630 con 0x7fd60c071fa0 2023-12-22T08:46:19.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.685+0000 7fd61279b640 1 -- 172.21.15.38:0/973072089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c1f6c30 con 0x7fd60c071fa0 2023-12-22T08:46:19.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.685+0000 7fd61279b640 1 -- 172.21.15.38:0/973072089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c159c70 con 0x7fd60c071fa0 2023-12-22T08:46:19.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.686+0000 7fd61279b640 1 -- 172.21.15.38:0/973072089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60c061910 con 0x7fd60c071fa0 2023-12-22T08:46:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.687+0000 7fd601ffb640 1 -- 172.21.15.38:0/973072089 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd60802f050 con 0x7fd60c071fa0 2023-12-22T08:46:19.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.689+0000 7fd601ffb640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd5f006a430 0x7fd5f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:19.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.689+0000 7fd601ffb640 1 -- 172.21.15.38:0/973072089 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6080aa8d0 con 0x7fd60c071fa0 2023-12-22T08:46:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.690+0000 7fd610f98640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd5f006a430 0x7fd5f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:19.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.691+0000 7fd610f98640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd5f006a430 0x7fd5f006c8f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd60c15cee0 tx=0x7fd5fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:19.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.694+0000 7fd601ffb640 1 -- 172.21.15.38:0/973072089 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd608075e20 con 0x7fd60c071fa0 2023-12-22T08:46:19.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.931+0000 7fd61279b640 1 -- 172.21.15.38:0/973072089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd60c0a0130 con 0x7fd60c071fa0 2023-12-22T08:46:19.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.932+0000 7fd601ffb640 1 -- 172.21.15.38:0/973072089 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd608035070 con 0x7fd60c071fa0 2023-12-22T08:46:19.933 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:46:19.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.935+0000 7fd61279b640 1 -- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd5f006a430 msgr2=0x7fd5f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:19.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.935+0000 7fd61279b640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd5f006a430 0x7fd5f006c8f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd60c15cee0 tx=0x7fd5fc008040 comp rx=0 tx=0).stop 2023-12-22T08:46:19.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.935+0000 7fd61279b640 1 -- 172.21.15.38:0/973072089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c071fa0 msgr2=0x7fd60c1f60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:19.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.935+0000 7fd61279b640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c071fa0 0x7fd60c1f60e0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd608000c00 tx=0x7fd6080046c0 comp rx=0 tx=0).stop 2023-12-22T08:46:19.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.935+0000 7fd61279b640 1 -- 172.21.15.38:0/973072089 shutdown_connections 2023-12-22T08:46:19.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.935+0000 7fd61279b640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd60c161720 0x7fd60c151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:19.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.935+0000 7fd61279b640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd60c161340 0x7fd60c159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:19.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.935+0000 7fd61279b640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd5f006a430 0x7fd5f006c8f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:19.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.935+0000 7fd61279b640 1 --2- 172.21.15.38:0/973072089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd60c071fa0 0x7fd60c1f60e0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:19.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.935+0000 7fd61279b640 1 -- 172.21.15.38:0/973072089 >> 172.21.15.38:0/973072089 conn(0x7fd60c0b1f70 msgr2=0x7fd60c15e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:19.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.935+0000 7fd61279b640 1 -- 172.21.15.38:0/973072089 shutdown_connections 2023-12-22T08:46:19.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:19.935+0000 7fd61279b640 1 -- 172.21.15.38:0/973072089 wait complete. 2023-12-22T08:46:19.961 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:46:19.961 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:46:19.961 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-22T08:46:19.961 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T08:46:19.961 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T08:46:19.961 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:46:19.961 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:46:19.961 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:46:19.961 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:46:19.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:19.962 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-22T08:46:20.023 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:46:20.023 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:46:20.024 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:46:20.024 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:20.024 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:46:20.024 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:20.024 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:46:20.024 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:46:20.024 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-22T08:46:20.024 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:46:20.024 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:46:20.024 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-22T08:46:20.024 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:46:20.025 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:46:20.025 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:46:20.025 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:46:20.025 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:46:20.025 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 41981sec preferred_lft 41981sec 2023-12-22T08:46:20.025 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-22T08:46:20.025 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:20.025 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:46:20.025 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:46:20.025 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:46:20.025 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:20.025 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::9cc2:a9ff:fe75:e812/64 scope link 2023-12-22T08:46:20.026 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:20.026 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:46:20.026 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8e:46:07:65:e3:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T08:46:20.026 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::8c46:7ff:fe65:e31f/64 scope link 2023-12-22T08:46:20.026 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:20.026 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:46:20.026 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T08:46:20.026 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2cc2:baff:fe6f:ea22/64 scope link 2023-12-22T08:46:20.026 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:46:20.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:20.026 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:46:20.117 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-22T08:46:20.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:20.121 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-22T08:46:20.177 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-22T08:46:20.177 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:46:20.177 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:46:20.178 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:46:20.178 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:46:20.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:20.178 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:46:20.178 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:46:20.178 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:46:20.178 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:46:20.178 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:46:20.178 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:46:20.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:20.366 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:46:20.417 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T08:46:20.417 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-22T08:46:20.418 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:46:20.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:20.418 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-22T08:46:20.511 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:46:20.511 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T08:46:20.565 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:46:20.566 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:46:20.566 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:46:20.618 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-22T08:46:20.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:20.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:46:20.758 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:46:20.759 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:46:20.791 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:46:20.791 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:46:20.791 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:46:20.791 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 1@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:46:20.791 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:46:20.794 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T08:46:20.794 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:46:20.794 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:46:20.794 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:46:20.794 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:46:20.799 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:46:20.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:20.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:46:20.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:20.880 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:46:20.936 INFO:teuthology.orchestra.run.smithi089.stdout:client5932 2023-12-22T08:46:20.936 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:46:20.937 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:20.985 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:46:21.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.223+0000 7f97f080e640 1 Processor -- start 2023-12-22T08:46:21.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.223+0000 7f97f080e640 1 -- start start 2023-12-22T08:46:21.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.225+0000 7f97f080e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f97ec06d210 0x7f97ec15e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:21.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.225+0000 7f97f080e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec0706d0 con 0x7f97ec0cb4c0 2023-12-22T08:46:21.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.225+0000 7f97f080e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec0cbf40 con 0x7f97ec06d5f0 2023-12-22T08:46:21.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.225+0000 7f97f080e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec0ce840 con 0x7f97ec06d210 2023-12-22T08:46:21.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.225+0000 7f97eb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f97ec06d210 0x7f97ec15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:21.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.225+0000 7f97eb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f97ec06d210 0x7f97ec15e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55536/0 (socket says 172.21.15.38:55536) 2023-12-22T08:46:21.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.225+0000 7f97eb7fe640 1 -- 172.21.15.38:0/3486648476 learned_addr learned my addr 172.21.15.38:0/3486648476 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:21.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.225+0000 7f97e3fff640 1 --1- 172.21.15.38:0/3486648476 >> v1:172.21.15.38:6789/0 conn(0x7f97ec0cb4c0 0x7f97ec159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43106/0 (socket says 172.21.15.38:43106) 2023-12-22T08:46:21.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.226+0000 7f97eb7fe640 1 -- 172.21.15.38:0/3486648476 >> v1:172.21.15.89:6789/0 conn(0x7f97ec06d5f0 legacy=0x7f97ec070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:21.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.226+0000 7f97eb7fe640 1 -- 172.21.15.38:0/3486648476 >> v1:172.21.15.38:6789/0 conn(0x7f97ec0cb4c0 legacy=0x7f97ec159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:21.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.226+0000 7f97eb7fe640 1 -- 172.21.15.38:0/3486648476 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec0ceb20 con 0x7f97ec06d210 2023-12-22T08:46:21.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.227+0000 7f97eb7fe640 1 --2- 172.21.15.38:0/3486648476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97ec06d210 0x7f97ec15e830 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00bb10 tx=0x7f97dc02e200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b53a946d5d976e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:21.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.227+0000 7f97eaffd640 1 -- 172.21.15.38:0/3486648476 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc036440 con 0x7f97ec06d210 2023-12-22T08:46:21.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.227+0000 7f97eaffd640 1 -- 172.21.15.38:0/3486648476 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc0365a0 con 0x7f97ec06d210 2023-12-22T08:46:21.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.227+0000 7f97eaffd640 1 -- 172.21.15.38:0/3486648476 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc036930 con 0x7f97ec06d210 2023-12-22T08:46:21.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.228+0000 7f97f080e640 1 -- 172.21.15.38:0/3486648476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97ec06d210 msgr2=0x7f97ec15e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:21.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.228+0000 7f97f080e640 1 --2- 172.21.15.38:0/3486648476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97ec06d210 0x7f97ec15e830 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00bb10 tx=0x7f97dc02e200 comp rx=0 tx=0).stop 2023-12-22T08:46:21.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.228+0000 7f97f080e640 1 -- 172.21.15.38:0/3486648476 shutdown_connections 2023-12-22T08:46:21.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.228+0000 7f97f080e640 1 --2- 172.21.15.38:0/3486648476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97ec06d210 0x7f97ec15e830 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:21.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.228+0000 7f97f080e640 1 -- 172.21.15.38:0/3486648476 >> 172.21.15.38:0/3486648476 conn(0x7f97ec0b1f70 msgr2=0x7f97ec0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:21.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.228+0000 7f97f080e640 1 -- 172.21.15.38:0/3486648476 shutdown_connections 2023-12-22T08:46:21.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.228+0000 7f97f080e640 1 -- 172.21.15.38:0/3486648476 wait complete. 2023-12-22T08:46:21.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.232+0000 7f97f080e640 1 Processor -- start 2023-12-22T08:46:21.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.232+0000 7f97f080e640 1 -- start start 2023-12-22T08:46:21.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.233+0000 7f97f080e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec06d210 0x7f97ec15cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:21.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.233+0000 7f97f080e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97ec06d5f0 0x7f97ec0a3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:21.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.233+0000 7f97f080e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec0cb4c0 0x7f97ec151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:21.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.233+0000 7f97f080e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1ef180 con 0x7f97ec06d5f0 2023-12-22T08:46:21.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.233+0000 7f97f080e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1ef460 con 0x7f97ec0cb4c0 2023-12-22T08:46:21.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.233+0000 7f97f080e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1ef740 con 0x7f97ec06d210 2023-12-22T08:46:21.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.234+0000 7f97e3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97ec06d5f0 0x7f97ec0a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:21.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.234+0000 7f97e3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97ec06d5f0 0x7f97ec0a3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55550/0 (socket says 172.21.15.38:55550) 2023-12-22T08:46:21.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.234+0000 7f97e3fff640 1 -- 172.21.15.38:0/2193735534 learned_addr learned my addr 172.21.15.38:0/2193735534 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:21.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.234+0000 7f97eb7fe640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec06d210 0x7f97ec15cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:21.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.234+0000 7f97ebfff640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec0cb4c0 0x7f97ec151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:21.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.234+0000 7f97e3fff640 1 -- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec06d210 msgr2=0x7f97ec15cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:21.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.234+0000 7f97e3fff640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec06d210 0x7f97ec15cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:21.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.234+0000 7f97e3fff640 1 -- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec0cb4c0 msgr2=0x7f97ec151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:21.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.234+0000 7f97e3fff640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec0cb4c0 0x7f97ec151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:21.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.234+0000 7f97e3fff640 1 -- 172.21.15.38:0/2193735534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc00b770 con 0x7f97ec06d5f0 2023-12-22T08:46:21.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.234+0000 7f97e3fff640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97ec06d5f0 0x7f97ec0a3430 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c3e0 tx=0x7f97d400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:21.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.235+0000 7f97e8ff9640 1 -- 172.21.15.38:0/2193735534 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d40074e0 con 0x7f97ec06d5f0 2023-12-22T08:46:21.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.235+0000 7f97e8ff9640 1 -- 172.21.15.38:0/2193735534 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d4007640 con 0x7f97ec06d5f0 2023-12-22T08:46:21.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.235+0000 7f97e8ff9640 1 -- 172.21.15.38:0/2193735534 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d40049e0 con 0x7f97ec06d5f0 2023-12-22T08:46:21.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.235+0000 7f97f080e640 1 -- 172.21.15.38:0/2193735534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ec1efa20 con 0x7f97ec06d5f0 2023-12-22T08:46:21.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.235+0000 7f97f080e640 1 -- 172.21.15.38:0/2193735534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec15d1d0 con 0x7f97ec06d5f0 2023-12-22T08:46:21.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.236+0000 7f97f080e640 1 -- 172.21.15.38:0/2193735534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec1efc60 con 0x7f97ec06d5f0 2023-12-22T08:46:21.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.237+0000 7f97e8ff9640 1 -- 172.21.15.38:0/2193735534 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f97d4004b40 con 0x7f97ec06d5f0 2023-12-22T08:46:21.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.238+0000 7f97e8ff9640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f97cc06a430 0x7f97cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:21.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.238+0000 7f97e8ff9640 1 -- 172.21.15.38:0/2193735534 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97d4088240 con 0x7f97ec06d5f0 2023-12-22T08:46:21.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.239+0000 7f97eb7fe640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f97cc06a430 0x7f97cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:21.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.240+0000 7f97eb7fe640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f97cc06a430 0x7f97cc06c8f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f97dc038000 tx=0x7f97dc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:21.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.243+0000 7f97e8ff9640 1 -- 172.21.15.38:0/2193735534 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f97d4053790 con 0x7f97ec06d5f0 2023-12-22T08:46:21.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.477+0000 7f97f080e640 1 -- 172.21.15.38:0/2193735534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97ec15d1d0 con 0x7f97ec06d5f0 2023-12-22T08:46:21.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.479+0000 7f97e8ff9640 1 -- 172.21.15.38:0/2193735534 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f97ec15d1d0 con 0x7f97ec06d5f0 2023-12-22T08:46:21.480 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:21.481 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/4163741517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4163741517},{"type":"v1","addr":"172.21.15.89:6836","nonce":4163741517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/972467119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":972467119},{"type":"v1","addr":"172.21.15.89:6837","nonce":972467119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/2124959631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2124959631},{"type":"v1","addr":"172.21.15.38:6834","nonce":2124959631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:46:11.013927+0000","modified":"2023-12-22T08:46:14.032400+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/2733146003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2733146003},{"type":"v1","addr":"172.21.15.38:6835","nonce":2733146003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-22T08:46:21.481 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 47 2023-12-22T08:46:21.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.481+0000 7f97f080e640 1 -- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f97cc06a430 msgr2=0x7f97cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:21.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.481+0000 7f97f080e640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f97cc06a430 0x7f97cc06c8f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f97dc038000 tx=0x7f97dc032000 comp rx=0 tx=0).stop 2023-12-22T08:46:21.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.481+0000 7f97f080e640 1 -- 172.21.15.38:0/2193735534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97ec06d5f0 msgr2=0x7f97ec0a3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.481+0000 7f97f080e640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97ec06d5f0 0x7f97ec0a3430 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c3e0 tx=0x7f97d400c8a0 comp rx=0 tx=0).stop 2023-12-22T08:46:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.482+0000 7f97f080e640 1 -- 172.21.15.38:0/2193735534 shutdown_connections 2023-12-22T08:46:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.482+0000 7f97f080e640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ec0cb4c0 0x7f97ec151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.482+0000 7f97f080e640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f97cc06a430 0x7f97cc06c8f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.482+0000 7f97f080e640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97ec06d5f0 0x7f97ec0a3430 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.482+0000 7f97f080e640 1 --2- 172.21.15.38:0/2193735534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ec06d210 0x7f97ec15cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.482+0000 7f97f080e640 1 -- 172.21.15.38:0/2193735534 >> 172.21.15.38:0/2193735534 conn(0x7f97ec0b1f70 msgr2=0x7f97ec070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.482+0000 7f97f080e640 1 -- 172.21.15.38:0/2193735534 shutdown_connections 2023-12-22T08:46:21.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:21.482+0000 7f97f080e640 1 -- 172.21.15.38:0/2193735534 wait complete. 2023-12-22T08:46:21.503 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-22T08:46:21.747 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":6867,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.710635696000001,"mdsmap_epoch":47,"osdmap_epoch":110,"osdmap_epoch_barrier":110,"uptime":16.304871193} 2023-12-22T08:46:21.747 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 6867, "mdsmap_epoch": 47, "osdmap_epoch": 110, "osdmap_epoch_barrier": 110, "rank_uptime": 10.710635696, "state": "up:active", "uptime": 16.304871193, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:46:21.748 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-22T08:46:21.992 INFO:teuthology.orchestra.run.smithi038.stdout:{"osd_mon_report_interval":"5"} 2023-12-22T08:46:21.993 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-22T08:46:21.993 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-12-22T08:46:21.993 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:46:21.993 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:22.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:22.054 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-12-22T08:46:24.041 INFO:teuthology.orchestra.run.smithi038.stderr:265+0 records in 2023-12-22T08:46:24.041 INFO:teuthology.orchestra.run.smithi038.stderr:265+0 records out 2023-12-22T08:46:24.041 INFO:teuthology.orchestra.run.smithi038.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.9248 s, 144 MB/s 2023-12-22T08:46:24.042 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:46:24.042 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:24.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:24.083 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-12-22T08:46:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:292+0 records in 2023-12-22T08:46:26.236 INFO:teuthology.orchestra.run.smithi038.stderr:292+0 records out 2023-12-22T08:46:26.236 INFO:teuthology.orchestra.run.smithi038.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.05503 s, 149 MB/s 2023-12-22T08:46:26.237 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-22T08:46:26.237 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:46:26.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.422+0000 7fa3429a9640 1 Processor -- start 2023-12-22T08:46:26.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.422+0000 7fa3429a9640 1 -- start start 2023-12-22T08:46:26.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.424+0000 7fa3429a9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33c15b420 0x7fa33c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:26.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.424+0000 7fa3429a9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa33c0a44a0 0x7fa33c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:26.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.424+0000 7fa3429a9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c0cdae0 con 0x7fa33c070e30 2023-12-22T08:46:26.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.424+0000 7fa3429a9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33c071260 con 0x7fa33c0a44a0 2023-12-22T08:46:26.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.424+0000 7fa3429a9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c06dec0 con 0x7fa33c15b420 2023-12-22T08:46:26.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.424+0000 7fa3419a7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33c15b420 0x7fa33c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:26.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.424+0000 7fa3419a7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33c15b420 0x7fa33c06d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:49472/0 (socket says 172.21.15.38:49472) 2023-12-22T08:46:26.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.424+0000 7fa3419a7640 1 -- 172.21.15.38:0/145133435 learned_addr learned my addr 172.21.15.38:0/145133435 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:26.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.425+0000 7fa3411a6640 1 --2- 172.21.15.38:0/145133435 >> v2:172.21.15.89:3300/0 conn(0x7fa33c0a44a0 0x7fa33c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:26.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.425+0000 7fa3419a7640 1 -- 172.21.15.38:0/145133435 >> v2:172.21.15.89:3300/0 conn(0x7fa33c0a44a0 msgr2=0x7fa33c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:26.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.425+0000 7fa3419a7640 1 --2- 172.21.15.38:0/145133435 >> v2:172.21.15.89:3300/0 conn(0x7fa33c0a44a0 0x7fa33c0708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:26.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.425+0000 7fa3419a7640 1 -- 172.21.15.38:0/145133435 >> v1:172.21.15.89:6789/0 conn(0x7fa33c070e30 legacy=0x7fa33c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:26.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.425+0000 7fa3419a7640 1 -- 172.21.15.38:0/145133435 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c15b800 con 0x7fa33c15b420 2023-12-22T08:46:26.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.427+0000 7fa3419a7640 1 --2- 172.21.15.38:0/145133435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33c15b420 0x7fa33c06d980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa338009870 tx=0x7fa33802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e64cf62cf43bee60 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:26.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.427+0000 7fa3409a5640 1 -- 172.21.15.38:0/145133435 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338030840 con 0x7fa33c15b420 2023-12-22T08:46:26.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.428+0000 7fa3409a5640 1 -- 172.21.15.38:0/145133435 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3380309a0 con 0x7fa33c15b420 2023-12-22T08:46:26.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.428+0000 7fa3409a5640 1 -- 172.21.15.38:0/145133435 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338030d30 con 0x7fa33c15b420 2023-12-22T08:46:26.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.428+0000 7fa3429a9640 1 -- 172.21.15.38:0/145133435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33c15b420 msgr2=0x7fa33c06d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:26.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.428+0000 7fa3429a9640 1 --2- 172.21.15.38:0/145133435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33c15b420 0x7fa33c06d980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa338009870 tx=0x7fa33802b980 comp rx=0 tx=0).stop 2023-12-22T08:46:26.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.428+0000 7fa3429a9640 1 -- 172.21.15.38:0/145133435 shutdown_connections 2023-12-22T08:46:26.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.428+0000 7fa3429a9640 1 --2- 172.21.15.38:0/145133435 >> v2:172.21.15.89:3300/0 conn(0x7fa33c0a44a0 0x7fa33c0708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:26.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.428+0000 7fa3429a9640 1 --2- 172.21.15.38:0/145133435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33c15b420 0x7fa33c06d980 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:26.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.428+0000 7fa3429a9640 1 -- 172.21.15.38:0/145133435 >> 172.21.15.38:0/145133435 conn(0x7fa33c0b1f70 msgr2=0x7fa33c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:26.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.428+0000 7fa3429a9640 1 -- 172.21.15.38:0/145133435 shutdown_connections 2023-12-22T08:46:26.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.429+0000 7fa3429a9640 1 -- 172.21.15.38:0/145133435 wait complete. 2023-12-22T08:46:26.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.430+0000 7fa3429a9640 1 Processor -- start 2023-12-22T08:46:26.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.430+0000 7fa3429a9640 1 -- start start 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.431+0000 7fa3429a9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33c070e30 0x7fa33c0a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.431+0000 7fa3429a9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33c0a44a0 0x7fa33c1f9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.431+0000 7fa3429a9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33c15b420 0x7fa33c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.431+0000 7fa3429a9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c0a19c0 con 0x7fa33c070e30 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.431+0000 7fa3429a9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c0a2400 con 0x7fa33c0a44a0 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.431+0000 7fa3429a9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c156c50 con 0x7fa33c15b420 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.432+0000 7fa3419a7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33c070e30 0x7fa33c0a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.432+0000 7fa3419a7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33c070e30 0x7fa33c0a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55564/0 (socket says 172.21.15.38:55564) 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.432+0000 7fa3419a7640 1 -- 172.21.15.38:0/865943304 learned_addr learned my addr 172.21.15.38:0/865943304 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.432+0000 7fa3411a6640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33c0a44a0 0x7fa33c1f9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.432+0000 7fa3421a8640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33c15b420 0x7fa33c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.432+0000 7fa3419a7640 1 -- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33c15b420 msgr2=0x7fa33c155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.432+0000 7fa3419a7640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33c15b420 0x7fa33c155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:26.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.432+0000 7fa3419a7640 1 -- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33c0a44a0 msgr2=0x7fa33c1f9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:26.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.432+0000 7fa3419a7640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33c0a44a0 0x7fa33c1f9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:26.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.432+0000 7fa3419a7640 1 -- 172.21.15.38:0/865943304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3380094d0 con 0x7fa33c070e30 2023-12-22T08:46:26.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.433+0000 7fa3419a7640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33c070e30 0x7fa33c0a1ec0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa338000c00 tx=0x7fa338004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:26.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.433+0000 7fa3327fc640 1 -- 172.21.15.38:0/865943304 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338039c90 con 0x7fa33c070e30 2023-12-22T08:46:26.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.433+0000 7fa3327fc640 1 -- 172.21.15.38:0/865943304 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa338039df0 con 0x7fa33c070e30 2023-12-22T08:46:26.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.433+0000 7fa3327fc640 1 -- 172.21.15.38:0/865943304 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338043640 con 0x7fa33c070e30 2023-12-22T08:46:26.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.433+0000 7fa3429a9640 1 -- 172.21.15.38:0/865943304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33c156f30 con 0x7fa33c070e30 2023-12-22T08:46:26.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.433+0000 7fa3429a9640 1 -- 172.21.15.38:0/865943304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33c1574f0 con 0x7fa33c070e30 2023-12-22T08:46:26.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.434+0000 7fa3429a9640 1 -- 172.21.15.38:0/865943304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33c061910 con 0x7fa33c070e30 2023-12-22T08:46:26.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.435+0000 7fa3327fc640 1 -- 172.21.15.38:0/865943304 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa3380437a0 con 0x7fa33c070e30 2023-12-22T08:46:26.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.436+0000 7fa3327fc640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa32006a430 0x7fa32006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:26.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.436+0000 7fa3327fc640 1 -- 172.21.15.38:0/865943304 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa33803e070 con 0x7fa33c070e30 2023-12-22T08:46:26.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.436+0000 7fa3411a6640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa32006a430 0x7fa32006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:26.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.437+0000 7fa3411a6640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa32006a430 0x7fa32006c8f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa33c158e20 tx=0x7fa32c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:26.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.440+0000 7fa3327fc640 1 -- 172.21.15.38:0/865943304 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa338076ef0 con 0x7fa33c070e30 2023-12-22T08:46:26.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.629+0000 7fa3429a9640 1 -- 172.21.15.38:0/865943304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa33c065c30 con 0x7fa33c070e30 2023-12-22T08:46:26.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.631+0000 7fa3327fc640 1 -- 172.21.15.38:0/865943304 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+33502 (secure 0 0 0) 0x7fa33807a510 con 0x7fa33c070e30 2023-12-22T08:46:26.633 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 110, 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:46:12.018310+0000", 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:46:26.634 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 13, 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.635 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:26.636 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "98", 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:26.637 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:26.638 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:26.639 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:26.639 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:26.639 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:26.639 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:26.639 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:26.639 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:26.639 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:26.639 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:26.639 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.639 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:26.639 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:26.639 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:26.639 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:26.640 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 12, 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:46:08.930859+0000", 2023-12-22T08:46:26.641 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:46:26.642 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "109", 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:26.643 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:26.644 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:26.645 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.75, 2023-12-22T08:46:26.646 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.75, 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.75, 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.75, 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 13, 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:46:10.036922+0000", 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:46:26.647 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:46:26.648 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:46:26.649 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:26.649 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:26.649 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:26.649 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:26.649 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:26.649 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:26.649 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:26.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.649 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "110", 2023-12-22T08:46:26.649 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:26.649 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:26.649 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:26.649 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:26.650 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:26.651 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.652 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.653 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:26.653 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:46:26.653 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:46:26.653 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:46:26.653 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:46:26.653 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:46:26.653 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:26.653 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:26.653 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:26.653 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.653 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.653 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:26.653 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:26.654 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:26.655 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:26.656 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.657 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.657 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.657 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:46:26.657 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:26.657 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.657 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.657 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.657 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:46:26.657 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:26.657 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.657 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.657 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.657 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:46:26.658 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:26.659 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:26.660 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:26.660 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:26.660 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:26.660 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:26.660 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:26.660 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:26.660 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:26.660 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.660 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.660 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.662 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:46:26.663 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:26.664 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:26.665 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.666 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.667 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.668 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.669 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:26.670 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:26.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.672 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.674 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.675 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:26.676 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.677 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.678 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.678 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:46:26.678 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:26.678 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.678 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.678 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.678 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:46:26.678 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:26.678 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.678 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.678 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.678 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:26.678 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:26.679 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:46:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:26.682 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.683 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.684 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.685 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:26.686 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.687 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.688 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.689 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.690 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:26.691 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:46:26.692 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:46:26.693 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.694 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:26.695 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:46:26.696 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:26.697 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:26.698 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:46:26.699 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:26.700 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:46:26.701 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:46:26.702 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:26.703 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:46:26.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.634+0000 7fa3429a9640 1 -- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa32006a430 msgr2=0x7fa32006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:26.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.634+0000 7fa3429a9640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa32006a430 0x7fa32006c8f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa33c158e20 tx=0x7fa32c008040 comp rx=0 tx=0).stop 2023-12-22T08:46:26.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.634+0000 7fa3429a9640 1 -- 172.21.15.38:0/865943304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33c070e30 msgr2=0x7fa33c0a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:26.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.634+0000 7fa3429a9640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33c070e30 0x7fa33c0a1ec0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa338000c00 tx=0x7fa338004730 comp rx=0 tx=0).stop 2023-12-22T08:46:26.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.634+0000 7fa3429a9640 1 -- 172.21.15.38:0/865943304 shutdown_connections 2023-12-22T08:46:26.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.634+0000 7fa3429a9640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa33c15b420 0x7fa33c155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:26.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.634+0000 7fa3429a9640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa33c0a44a0 0x7fa33c1f9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:26.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.634+0000 7fa3429a9640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa32006a430 0x7fa32006c8f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:26.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.634+0000 7fa3429a9640 1 --2- 172.21.15.38:0/865943304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa33c070e30 0x7fa33c0a1ec0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:26.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.634+0000 7fa3429a9640 1 -- 172.21.15.38:0/865943304 >> 172.21.15.38:0/865943304 conn(0x7fa33c0b1f70 msgr2=0x7fa33c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:26.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.634+0000 7fa3429a9640 1 -- 172.21.15.38:0/865943304 shutdown_connections 2023-12-22T08:46:26.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:26.634+0000 7fa3429a9640 1 -- 172.21.15.38:0/865943304 wait complete. 2023-12-22T08:46:26.706 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-22T08:46:28.288 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:46:28.286+0000 7f0a296e8640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-12-22T08:46:31.708 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:46:31.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.946+0000 7fb5ce4a8640 1 Processor -- start 2023-12-22T08:46:31.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.946+0000 7fb5ce4a8640 1 -- start start 2023-12-22T08:46:31.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.948+0000 7fb5ce4a8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5c806d5f0 0x7fb5c815e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:31.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.948+0000 7fb5ce4a8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c80706d0 con 0x7fb5c80cb4c0 2023-12-22T08:46:31.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.948+0000 7fb5ce4a8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c80cbf40 con 0x7fb5c806d210 2023-12-22T08:46:31.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.948+0000 7fb5ce4a8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c80ce840 con 0x7fb5c806d5f0 2023-12-22T08:46:31.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.948+0000 7fb5ccca5640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb5c80cb4c0 0x7fb5c8070b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57886/0 (socket says 172.21.15.38:57886) 2023-12-22T08:46:31.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.948+0000 7fb5ccca5640 1 -- 172.21.15.38:0/2527092346 learned_addr learned my addr 172.21.15.38:0/2527092346 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:31.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.949+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554418941 0 0) 0x7fb5c80706d0 con 0x7fb5c80cb4c0 2023-12-22T08:46:31.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.949+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b4005730 con 0x7fb5c80cb4c0 2023-12-22T08:46:31.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.949+0000 7fb5cdca7640 1 --2- 172.21.15.38:0/2527092346 >> v2:172.21.15.89:3300/0 conn(0x7fb5c806d5f0 0x7fb5c815e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:31.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.949+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1328876648 0 0) 0x7fb5b4005730 con 0x7fb5c80cb4c0 2023-12-22T08:46:31.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.949+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 >> v2:172.21.15.89:3300/0 conn(0x7fb5c806d5f0 msgr2=0x7fb5c815e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:31.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.949+0000 7fb5bffff640 1 --2- 172.21.15.38:0/2527092346 >> v2:172.21.15.89:3300/0 conn(0x7fb5c806d5f0 0x7fb5c815e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:31.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.949+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 >> v1:172.21.15.89:6789/0 conn(0x7fb5c806d210 legacy=0x7fb5c8159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:31.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.949+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c80ceb20 con 0x7fb5c80cb4c0 2023-12-22T08:46:31.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.949+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fb5b8001670 con 0x7fb5c80cb4c0 2023-12-22T08:46:31.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.949+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 >> v1:172.21.15.38:6789/0 conn(0x7fb5c80cb4c0 legacy=0x7fb5c8070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:31.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.949+0000 7fb5bffff640 1 --2- 172.21.15.38:0/2527092346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b4005bd0 0x7fb5b4005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:31.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5bffff640 1 --2- 172.21.15.38:0/2527092346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40069d0 0x7fb5b4006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:31.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5bffff640 1 --2- 172.21.15.38:0/2527092346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b40073e0 0x7fb5b400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:31.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80ce840 con 0x7fb5b4005bd0 2023-12-22T08:46:31.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b400e330 con 0x7fb5b40069d0 2023-12-22T08:46:31.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b400e4f0 con 0x7fb5b40073e0 2023-12-22T08:46:31.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5cd4a6640 1 --2- 172.21.15.38:0/2527092346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b4005bd0 0x7fb5b4005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:31.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5ccca5640 1 --2- 172.21.15.38:0/2527092346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40069d0 0x7fb5b4006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:31.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5cd4a6640 1 -- 172.21.15.38:0/2527092346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b40073e0 msgr2=0x7fb5b400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:31.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5cd4a6640 1 --2- 172.21.15.38:0/2527092346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5b40073e0 0x7fb5b400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:31.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5cd4a6640 1 -- 172.21.15.38:0/2527092346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40069d0 msgr2=0x7fb5b4006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:31.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5cd4a6640 1 --2- 172.21.15.38:0/2527092346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40069d0 0x7fb5b4006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:31.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5cd4a6640 1 -- 172.21.15.38:0/2527092346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4005730 con 0x7fb5b4005bd0 2023-12-22T08:46:31.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5ccca5640 1 --2- 172.21.15.38:0/2527092346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b40069d0 0x7fb5b4006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:31.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.950+0000 7fb5cdca7640 1 -- 172.21.15.38:0/2527092346 reap_dead start 2023-12-22T08:46:31.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.951+0000 7fb5cd4a6640 1 --2- 172.21.15.38:0/2527092346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b4005bd0 0x7fb5b4005ff0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4001750 tx=0x7fb5b4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ba11144687e079 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:31.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.952+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40052d0 con 0x7fb5b4005bd0 2023-12-22T08:46:31.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.952+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c402e050 con 0x7fb5b4005bd0 2023-12-22T08:46:31.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.952+0000 7fb5bffff640 1 -- 172.21.15.38:0/2527092346 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4003830 con 0x7fb5b4005bd0 2023-12-22T08:46:31.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.952+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/2527092346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b4005bd0 msgr2=0x7fb5b4005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:31.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.952+0000 7fb5ce4a8640 1 --2- 172.21.15.38:0/2527092346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b4005bd0 0x7fb5b4005ff0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4001750 tx=0x7fb5b4007a00 comp rx=0 tx=0).stop 2023-12-22T08:46:31.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.952+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/2527092346 shutdown_connections 2023-12-22T08:46:31.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.952+0000 7fb5ce4a8640 1 --2- 172.21.15.38:0/2527092346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5b4005bd0 0x7fb5b4005ff0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:31.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.952+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/2527092346 >> 172.21.15.38:0/2527092346 conn(0x7fb5c80b1f70 msgr2=0x7fb5c80b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:31.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.952+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/2527092346 shutdown_connections 2023-12-22T08:46:31.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.952+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/2527092346 wait complete. 2023-12-22T08:46:31.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.954+0000 7fb5ce4a8640 1 Processor -- start 2023-12-22T08:46:31.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.954+0000 7fb5ce4a8640 1 -- start start 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.955+0000 7fb5ce4a8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b4005bd0 0x7fb5c814f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.955+0000 7fb5ce4a8640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5c80cc100 0x7fb5c80cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.955+0000 7fb5ce4a8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5c80a1b50 0x7fb5c80a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.955+0000 7fb5ce4a8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80ccac0 con 0x7fb5c80a1b50 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.955+0000 7fb5ce4a8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c8156820 con 0x7fb5b4005bd0 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.955+0000 7fb5ce4a8640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c81573a0 con 0x7fb5c80cc100 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.956+0000 7fb5cdca7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5c80a1b50 0x7fb5c80a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.956+0000 7fb5cdca7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5c80a1b50 0x7fb5c80a1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48786/0 (socket says 172.21.15.38:48786) 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.956+0000 7fb5cdca7640 1 -- 172.21.15.38:0/57327373 learned_addr learned my addr 172.21.15.38:0/57327373 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.956+0000 7fb5cd4a6640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b4005bd0 0x7fb5c814f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.956+0000 7fb5ccca5640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5c80cc100 0x7fb5c80cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.956+0000 7fb5cdca7640 1 -- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5c80cc100 msgr2=0x7fb5c80cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.956+0000 7fb5cdca7640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5c80cc100 0x7fb5c80cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:31.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.956+0000 7fb5cdca7640 1 -- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b4005bd0 msgr2=0x7fb5c814f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:31.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.956+0000 7fb5cdca7640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b4005bd0 0x7fb5c814f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:31.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.956+0000 7fb5cdca7640 1 -- 172.21.15.38:0/57327373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c8156a70 con 0x7fb5c80a1b50 2023-12-22T08:46:31.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.956+0000 7fb5cdca7640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5c80a1b50 0x7fb5c80a1fd0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fb5c815dd80 tx=0x7fb5c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:31.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.957+0000 7fb5bdffb640 1 -- 172.21.15.38:0/57327373 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0007e40 con 0x7fb5c80a1b50 2023-12-22T08:46:31.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.957+0000 7fb5bdffb640 1 -- 172.21.15.38:0/57327373 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c0014420 con 0x7fb5c80a1b50 2023-12-22T08:46:31.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.957+0000 7fb5bdffb640 1 -- 172.21.15.38:0/57327373 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c00147d0 con 0x7fb5c80a1b50 2023-12-22T08:46:31.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.957+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/57327373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c8156d50 con 0x7fb5c80a1b50 2023-12-22T08:46:31.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.957+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/57327373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c814fc50 con 0x7fb5c80a1b50 2023-12-22T08:46:31.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.958+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/57327373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c8157550 con 0x7fb5c80a1b50 2023-12-22T08:46:31.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.959+0000 7fb5bdffb640 1 -- 172.21.15.38:0/57327373 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb5c0014930 con 0x7fb5c80a1b50 2023-12-22T08:46:31.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.960+0000 7fb5bdffb640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5ac06a460 0x7fb5ac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:31.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.960+0000 7fb5bdffb640 1 -- 172.21.15.38:0/57327373 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5c0088cd0 con 0x7fb5c80a1b50 2023-12-22T08:46:31.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.961+0000 7fb5bdffb640 1 -- 172.21.15.38:0/57327373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=113}) v3 -- 0x7fb5ac071f90 con 0x7fb5c80a1b50 2023-12-22T08:46:31.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.961+0000 7fb5cd4a6640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5ac06a460 0x7fb5ac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:31.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.962+0000 7fb5cd4a6640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5ac06a460 0x7fb5ac06c920 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4033000 tx=0x7fb5c4009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:31.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:31.965+0000 7fb5bdffb640 1 -- 172.21.15.38:0/57327373 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb5c8157550 con 0x7fb5c80a1b50 2023-12-22T08:46:32.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.165+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/57327373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb5c815e7f0 con 0x7fb5c80a1b50 2023-12-22T08:46:32.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.168+0000 7fb5bdffb640 1 -- 172.21.15.38:0/57327373 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v112) v1 ==== 81+0+33654 (secure 0 0 0) 0x7fb5c0054350 con 0x7fb5c80a1b50 2023-12-22T08:46:32.170 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:32.171 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:46:32.171 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 112, 2023-12-22T08:46:32.171 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:46:32.171 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:46:32.171 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:46:29.304345+0000", 2023-12-22T08:46:32.171 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:46:32.171 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:46:32.171 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:46:32.171 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:46:32.171 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:46:32.171 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:46:32.171 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:46:32.171 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:46:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:46:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:46:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:46:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:46:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:46:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:46:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 13, 2023-12-22T08:46:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:46:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:46:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:46:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:46:32.172 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:46:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:46:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:46:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:46:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:46:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:46:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:46:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:32.173 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:32.174 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "111", 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:32.175 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:32.176 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:46:32.177 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:46:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:46:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:46:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:46:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:46:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:46:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:32.178 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 12, 2023-12-22T08:46:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:46:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:46:08.930859+0000", 2023-12-22T08:46:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:46:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:46:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:32.179 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:32.180 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "111", 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:32.181 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:32.182 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.183 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:32.183 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:32.183 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:32.183 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:32.183 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:32.183 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:32.183 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:32.183 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:32.183 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:32.183 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:32.183 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:32.183 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:32.183 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.75, 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.75, 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.75, 2023-12-22T08:46:32.184 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.75, 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 13, 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:46:10.036922+0000", 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:32.185 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:32.186 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "111", 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:32.187 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:32.188 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:32.189 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:32.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.189 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:32.189 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:32.189 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:32.189 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:32.189 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:32.189 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:32.189 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:32.189 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:32.189 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:32.189 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:32.189 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:32.190 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:32.190 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:46:32.190 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:46:32.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.190 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:32.190 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:46:32.190 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:46:32.190 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.190 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:32.190 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:46:32.190 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:46:32.190 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:32.191 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:32.192 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.193 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.193 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.193 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:46:32.193 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:32.193 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.193 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.193 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.193 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:32.193 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.193 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.193 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.193 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:46:32.193 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.194 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.196 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.197 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.198 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.199 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.200 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:46:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:32.202 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:32.203 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.204 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.205 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.206 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:32.207 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.208 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.209 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.209 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:46:32.209 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:32.209 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.209 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.209 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.209 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:32.209 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.209 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.209 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.210 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.211 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.212 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:46:32.212 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:32.212 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.212 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.212 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.212 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:46:32.212 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:32.212 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.212 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.212 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.212 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:46:32.212 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:46:32.212 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:46:32.213 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:46:32.213 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:32.213 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:32.213 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:46:32.213 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:32.213 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.213 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.213 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.213 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:46:32.213 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:32.213 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:32.213 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:32.213 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:32.214 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:32.214 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:32.214 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:32.214 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:32.214 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:32.214 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:32.214 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:32.214 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:32.214 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.214 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.214 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.214 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:46:32.214 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:46:32.215 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:46:32.216 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:46:32.217 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:32.219 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.219 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.219 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.219 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:46:32.219 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:32.219 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:32.219 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:32.219 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:32.219 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:32.219 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:32.219 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:32.219 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:32.219 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:32.220 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:32.221 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.222 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.223 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.223 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:32.223 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.223 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.223 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.223 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:46:32.223 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:32.223 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.223 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.223 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.223 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:46:32.223 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:32.223 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:46:32.224 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:32.225 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:32.225 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:32.225 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:32.225 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:32.225 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:32.225 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:32.225 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:32.225 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:32.225 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:32.225 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:32.225 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:32.225 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.225 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.226 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.227 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.228 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:46:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:46:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:46:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:46:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:46:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:32.230 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.231 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.232 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.233 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.234 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:46:32.235 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:46:32.235 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:46:32.235 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:46:32.235 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:32.235 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:32.235 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:46:32.235 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:32.235 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:32.235 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.235 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:32.235 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:46:32.235 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:32.236 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:32.237 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:32.239 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.240 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:32.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:46:32.241 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:32.241 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:32.241 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:32.241 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:32.241 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:32.241 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:46:32.241 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:32.241 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.241 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:32.241 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:46:32.241 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:46:32.241 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:46:32.242 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:46:32.243 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:46:32.243 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:46:32.243 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:46:32.243 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:46:32.243 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:46:32.243 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:46:32.243 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:46:32.243 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:46:32.243 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:46:32.243 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:32.243 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:46:32.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.171+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5ac06a460 msgr2=0x7fb5ac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:32.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.171+0000 7fb5ce4a8640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5ac06a460 0x7fb5ac06c920 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4033000 tx=0x7fb5c4009030 comp rx=0 tx=0).stop 2023-12-22T08:46:32.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.171+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/57327373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5c80a1b50 msgr2=0x7fb5c80a1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:32.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.171+0000 7fb5ce4a8640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5c80a1b50 0x7fb5c80a1fd0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fb5c815dd80 tx=0x7fb5c000e4b0 comp rx=0 tx=0).stop 2023-12-22T08:46:32.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.171+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/57327373 shutdown_connections 2023-12-22T08:46:32.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.171+0000 7fb5ce4a8640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5ac06a460 0x7fb5ac06c920 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:32.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.171+0000 7fb5ce4a8640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5c80a1b50 0x7fb5c80a1fd0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:32.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.171+0000 7fb5ce4a8640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5c80cc100 0x7fb5c80cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:32.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.171+0000 7fb5ce4a8640 1 --2- 172.21.15.38:0/57327373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5b4005bd0 0x7fb5c814f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:32.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.171+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/57327373 >> 172.21.15.38:0/57327373 conn(0x7fb5c80b1f70 msgr2=0x7fb5c80a0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:32.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.171+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/57327373 shutdown_connections 2023-12-22T08:46:32.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.172+0000 7fb5ce4a8640 1 -- 172.21.15.38:0/57327373 wait complete. 2023-12-22T08:46:32.247 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-22T08:46:32.247 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:46:32.247 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:32.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:32.310 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-12-22T08:46:32.721 INFO:teuthology.orchestra.run.smithi038.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-12-22T08:46:32.721 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records in 2023-12-22T08:46:32.721 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records out 2023-12-22T08:46:32.722 INFO:teuthology.orchestra.run.smithi038.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.339373 s, 154 MB/s 2023-12-22T08:46:32.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:46:32.723 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:46:32.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.938+0000 7fb9fb1dc640 1 Processor -- start 2023-12-22T08:46:32.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.938+0000 7fb9fb1dc640 1 -- start start 2023-12-22T08:46:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.939+0000 7fb9fb1dc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb9f415e740 0x7fb9f415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.939+0000 7fb9fb1dc640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f415eb20 con 0x7fb9f406ca50 2023-12-22T08:46:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.939+0000 7fb9fb1dc640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f4070770 con 0x7fb9f40b3f90 2023-12-22T08:46:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.939+0000 7fb9fb1dc640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f406e650 con 0x7fb9f415e740 2023-12-22T08:46:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.939+0000 7fb9f8f78640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb9f415e740 0x7fb9f415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.939+0000 7fb9f8f78640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb9f415e740 0x7fb9f415db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48800/0 (socket says 172.21.15.38:48800) 2023-12-22T08:46:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.939+0000 7fb9f8f78640 1 -- 172.21.15.38:0/2162038802 learned_addr learned my addr 172.21.15.38:0/2162038802 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.940+0000 7fb9f8f78640 1 -- 172.21.15.38:0/2162038802 >> v1:172.21.15.89:6789/0 conn(0x7fb9f40b3f90 legacy=0x7fb9f4070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.940+0000 7fb9f8f78640 1 -- 172.21.15.38:0/2162038802 >> v1:172.21.15.38:6789/0 conn(0x7fb9f406ca50 legacy=0x7fb9f40b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.940+0000 7fb9f8f78640 1 -- 172.21.15.38:0/2162038802 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f406cec0 con 0x7fb9f415e740 2023-12-22T08:46:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.941+0000 7fb9f8f78640 1 --2- 172.21.15.38:0/2162038802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9f415e740 0x7fb9f415db30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4009e50 tx=0x7fb9e402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad544b30bcda4c80 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.941+0000 7fb9f37fe640 1 -- 172.21.15.38:0/2162038802 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e402c9f0 con 0x7fb9f415e740 2023-12-22T08:46:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.941+0000 7fb9f37fe640 1 -- 172.21.15.38:0/2162038802 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e402cb50 con 0x7fb9f415e740 2023-12-22T08:46:32.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.941+0000 7fb9f37fe640 1 -- 172.21.15.38:0/2162038802 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e40343f0 con 0x7fb9f415e740 2023-12-22T08:46:32.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.942+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/2162038802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9f415e740 msgr2=0x7fb9f415db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:32.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.942+0000 7fb9fb1dc640 1 --2- 172.21.15.38:0/2162038802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9f415e740 0x7fb9f415db30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4009e50 tx=0x7fb9e402be50 comp rx=0 tx=0).stop 2023-12-22T08:46:32.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.942+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/2162038802 shutdown_connections 2023-12-22T08:46:32.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.942+0000 7fb9fb1dc640 1 --2- 172.21.15.38:0/2162038802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9f415e740 0x7fb9f415db30 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:32.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.942+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/2162038802 >> 172.21.15.38:0/2162038802 conn(0x7fb9f40cfea0 msgr2=0x7fb9f40d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:32.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.942+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/2162038802 shutdown_connections 2023-12-22T08:46:32.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.942+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/2162038802 wait complete. 2023-12-22T08:46:32.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.944+0000 7fb9fb1dc640 1 Processor -- start 2023-12-22T08:46:32.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.944+0000 7fb9fb1dc640 1 -- start start 2023-12-22T08:46:32.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.945+0000 7fb9fb1dc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f406ca50 0x7fb9f414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:32.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.945+0000 7fb9fb1dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9f40b3f90 0x7fb9f415a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:32.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.945+0000 7fb9fb1dc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9f415e740 0x7fb9f4152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:32.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.945+0000 7fb9fb1dc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f4158a20 con 0x7fb9f415e740 2023-12-22T08:46:32.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.945+0000 7fb9fb1dc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f4154c50 con 0x7fb9f40b3f90 2023-12-22T08:46:32.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.945+0000 7fb9fb1dc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f414e640 con 0x7fb9f406ca50 2023-12-22T08:46:32.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.946+0000 7fb9f9779640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9f415e740 0x7fb9f4152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:32.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.946+0000 7fb9f9779640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9f415e740 0x7fb9f4152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48816/0 (socket says 172.21.15.38:48816) 2023-12-22T08:46:32.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.946+0000 7fb9f9779640 1 -- 172.21.15.38:0/535354394 learned_addr learned my addr 172.21.15.38:0/535354394 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:32.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.946+0000 7fb9f3fff640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9f40b3f90 0x7fb9f415a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:32.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.946+0000 7fb9f8f78640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f406ca50 0x7fb9f414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:32.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.946+0000 7fb9f9779640 1 -- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f406ca50 msgr2=0x7fb9f414e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.946+0000 7fb9f9779640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f406ca50 0x7fb9f414e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.946+0000 7fb9f9779640 1 -- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9f40b3f90 msgr2=0x7fb9f415a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.946+0000 7fb9f9779640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9f40b3f90 0x7fb9f415a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.946+0000 7fb9f9779640 1 -- 172.21.15.38:0/535354394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e4009b30 con 0x7fb9f415e740 2023-12-22T08:46:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.946+0000 7fb9f3fff640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9f40b3f90 0x7fb9f415a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.946+0000 7fb9f9779640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9f415e740 0x7fb9f4152e60 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00c390 tx=0x7fb9ec00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.947+0000 7fb9f17fa640 1 -- 172.21.15.38:0/535354394 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0035f0 con 0x7fb9f415e740 2023-12-22T08:46:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.947+0000 7fb9f17fa640 1 -- 172.21.15.38:0/535354394 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec003750 con 0x7fb9f415e740 2023-12-22T08:46:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.947+0000 7fb9f17fa640 1 -- 172.21.15.38:0/535354394 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec003b00 con 0x7fb9f415e740 2023-12-22T08:46:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.947+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/535354394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f4154ea0 con 0x7fb9f415e740 2023-12-22T08:46:32.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.947+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/535354394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f4155460 con 0x7fb9f415e740 2023-12-22T08:46:32.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.948+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/535354394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f4061910 con 0x7fb9f415e740 2023-12-22T08:46:32.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.949+0000 7fb9f17fa640 1 -- 172.21.15.38:0/535354394 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb9ec003c60 con 0x7fb9f415e740 2023-12-22T08:46:32.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.950+0000 7fb9f17fa640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb9d406a430 0x7fb9d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:32.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.950+0000 7fb9f17fa640 1 -- 172.21.15.38:0/535354394 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9ec087c10 con 0x7fb9f415e740 2023-12-22T08:46:32.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.950+0000 7fb9f17fa640 1 -- 172.21.15.38:0/535354394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=113}) v3 -- 0x7fb9d4071f60 con 0x7fb9f415e740 2023-12-22T08:46:32.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.951+0000 7fb9f8f78640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb9d406a430 0x7fb9d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:32.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.952+0000 7fb9f8f78640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb9d406a430 0x7fb9d406c8f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4035000 tx=0x7fb9e4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:32.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:32.955+0000 7fb9f17fa640 1 -- 172.21.15.38:0/535354394 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb9ec017060 con 0x7fb9f415e740 2023-12-22T08:46:33.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.151+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/535354394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb9f4071a90 con 0x7fb9f415e740 2023-12-22T08:46:33.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.154+0000 7fb9f17fa640 1 -- 172.21.15.38:0/535354394 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v112) v1 ==== 81+0+33654 (secure 0 0 0) 0x7fb9ec053160 con 0x7fb9f415e740 2023-12-22T08:46:33.156 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:33.156 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:46:33.156 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 112, 2023-12-22T08:46:33.156 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:46:33.156 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:46:33.156 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:46:29.304345+0000", 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:46:33.157 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:46:33.158 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:46:33.158 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 13, 2023-12-22T08:46:33.158 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:46:33.158 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:46:33.158 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:46:33.158 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:46:33.158 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:46:33.158 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:46:33.158 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.158 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:46:33.158 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:46:33.158 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:46:33.158 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:46:33.159 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:46:33.159 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:33.159 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:33.159 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:33.159 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:33.159 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:33.159 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:33.159 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:33.159 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:33.159 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:33.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:33.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:46:33.159 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:46:33.160 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:46:33.160 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:46:33.160 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:46:33.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:33.160 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:33.160 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:33.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:33.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:33.160 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:33.160 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:33.160 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.160 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "111", 2023-12-22T08:46:33.161 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:33.161 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:33.161 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:33.161 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:33.161 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:33.161 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:33.161 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:33.161 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:33.161 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:33.161 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:33.161 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:33.161 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:33.161 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:33.162 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:33.162 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:33.162 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:33.162 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:33.162 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:33.162 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:33.162 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:33.162 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:33.162 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:33.162 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:33.162 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:33.162 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:33.162 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:33.163 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.163 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:33.163 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:33.163 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:33.163 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:33.163 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:33.163 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:33.163 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:33.163 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:33.163 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:33.163 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:33.163 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:33.163 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:33.164 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 12, 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:46:08.930859+0000", 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:33.166 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:33.167 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:33.167 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:33.167 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.167 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "111", 2023-12-22T08:46:33.167 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:33.167 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:33.167 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:33.167 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:33.167 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:33.167 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:33.167 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:33.168 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:33.168 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:33.168 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:33.168 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:33.168 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:33.168 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:33.168 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:33.168 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:33.168 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:33.168 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:33.168 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:33.168 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:33.168 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:33.169 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:33.169 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:33.169 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:33.169 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:33.169 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:33.169 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:33.169 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.169 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:33.169 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:33.169 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:33.169 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:33.169 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:33.169 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:46:33.170 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.75, 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.75, 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.75, 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.75, 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 13, 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:46:33.171 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:46:10.036922+0000", 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:46:33.172 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:46:33.173 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:46:33.173 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:33.173 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:33.173 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:33.173 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:33.173 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:33.173 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:33.173 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:33.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.173 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "111", 2023-12-22T08:46:33.173 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:33.173 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:33.173 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:33.174 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:33.175 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:46:33.176 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:46:33.177 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:46:33.177 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:46:33.177 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:33.177 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:33.177 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:33.177 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.177 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.177 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:33.177 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:46:33.177 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.177 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:46:33.177 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.178 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.179 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.180 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.181 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:33.182 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:33.183 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:33.184 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:33.184 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:33.184 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.184 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.184 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.184 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:46:33.184 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:33.184 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.184 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.184 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.184 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:46:33.184 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:33.185 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.186 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:46:33.187 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:33.188 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:33.189 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:33.189 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:33.189 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:33.189 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:33.189 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:33.189 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:33.189 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:33.189 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.189 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.189 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.189 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:46:33.189 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:33.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.190 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:46:33.191 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.192 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:33.193 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:33.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.196 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:33.197 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.198 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.198 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.198 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:46:33.198 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:46:33.198 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:46:33.198 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:46:33.198 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:33.198 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:33.198 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:46:33.198 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:33.198 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.198 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.198 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:33.199 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.200 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.201 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.202 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:46:33.203 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:33.204 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.205 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.206 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.207 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:46:33.208 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:46:33.209 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:33.209 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:33.209 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:33.209 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.209 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.209 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.209 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:46:33.209 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:33.209 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:33.209 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:33.209 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:33.209 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:33.209 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.210 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:33.211 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:33.212 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.213 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:33.214 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.215 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:46:33.216 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:46:33.217 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:33.218 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:46:33.219 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:33.220 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:46:33.221 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:46:33.222 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:46:33.223 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:33.224 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:46:33.225 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:46:33.226 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:46:33.227 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:46:33.227 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:46:33.227 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:33.227 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:46:33.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.157+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb9d406a430 msgr2=0x7fb9d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:33.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.157+0000 7fb9fb1dc640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb9d406a430 0x7fb9d406c8f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4035000 tx=0x7fb9e4030000 comp rx=0 tx=0).stop 2023-12-22T08:46:33.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.157+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/535354394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9f415e740 msgr2=0x7fb9f4152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:33.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.157+0000 7fb9fb1dc640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9f415e740 0x7fb9f4152e60 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00c390 tx=0x7fb9ec00c850 comp rx=0 tx=0).stop 2023-12-22T08:46:33.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.157+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/535354394 shutdown_connections 2023-12-22T08:46:33.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.157+0000 7fb9fb1dc640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb9d406a430 0x7fb9d406c8f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.157+0000 7fb9fb1dc640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9f415e740 0x7fb9f4152e60 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.157+0000 7fb9fb1dc640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9f40b3f90 0x7fb9f415a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.157+0000 7fb9fb1dc640 1 --2- 172.21.15.38:0/535354394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9f406ca50 0x7fb9f414e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.157+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/535354394 >> 172.21.15.38:0/535354394 conn(0x7fb9f40cfea0 msgr2=0x7fb9f4070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:33.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.157+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/535354394 shutdown_connections 2023-12-22T08:46:33.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.157+0000 7fb9fb1dc640 1 -- 172.21.15.38:0/535354394 wait complete. 2023-12-22T08:46:33.230 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:46:33.327 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:46:33.325+0000 7f0a296e8640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-12-22T08:46:33.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.468+0000 7f6e97716640 1 Processor -- start 2023-12-22T08:46:33.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.468+0000 7f6e97716640 1 -- start start 2023-12-22T08:46:33.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.470+0000 7f6e97716640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6e9015d470 0x7f6e900b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:33.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.470+0000 7f6e97716640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6e90071ea0 0x7f6e900b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:33.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.470+0000 7f6e97716640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e900ac8e0 con 0x7f6e9015d850 2023-12-22T08:46:33.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.470+0000 7f6e97716640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e900ada40 con 0x7f6e9015d470 2023-12-22T08:46:33.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.470+0000 7f6e97716640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e900b4550 con 0x7f6e90071ea0 2023-12-22T08:46:33.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.470+0000 7f6e954b2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6e9015d470 0x7f6e900b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:33.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.470+0000 7f6e94cb1640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6e9015d850 0x7f6e900ad330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57898/0 (socket says 172.21.15.38:57898) 2023-12-22T08:46:33.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.470+0000 7f6e954b2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6e9015d470 0x7f6e900b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48822/0 (socket says 172.21.15.38:48822) 2023-12-22T08:46:33.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.470+0000 7f6e94cb1640 1 -- 172.21.15.38:0/4080943776 learned_addr learned my addr 172.21.15.38:0/4080943776 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:33.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.471+0000 7f6e95cb3640 1 --2- 172.21.15.38:0/4080943776 >> v2:172.21.15.89:3300/0 conn(0x7f6e90071ea0 0x7f6e900b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:33.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.471+0000 7f6e954b2640 1 -- 172.21.15.38:0/4080943776 >> v2:172.21.15.89:3300/0 conn(0x7f6e90071ea0 msgr2=0x7f6e900b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:33.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.471+0000 7f6e954b2640 1 --2- 172.21.15.38:0/4080943776 >> v2:172.21.15.89:3300/0 conn(0x7f6e90071ea0 0x7f6e900b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.471+0000 7f6e954b2640 1 -- 172.21.15.38:0/4080943776 >> v1:172.21.15.38:6789/0 conn(0x7f6e9015d850 legacy=0x7f6e900ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:33.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.471+0000 7f6e954b2640 1 -- 172.21.15.38:0/4080943776 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e900b4940 con 0x7f6e9015d470 2023-12-22T08:46:33.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.471+0000 7f6e95cb3640 1 --2- 172.21.15.38:0/4080943776 >> v2:172.21.15.89:3300/0 conn(0x7f6e90071ea0 0x7f6e900b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:33.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.472+0000 7f6e954b2640 1 --2- 172.21.15.38:0/4080943776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e9015d470 0x7f6e900b4010 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f6e90162250 tx=0x7f6e8c02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b77d220e169ea server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:33.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.472+0000 7f6e87fff640 1 -- 172.21.15.38:0/4080943776 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c02cc70 con 0x7f6e9015d470 2023-12-22T08:46:33.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.472+0000 7f6e87fff640 1 -- 172.21.15.38:0/4080943776 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c02cdd0 con 0x7f6e9015d470 2023-12-22T08:46:33.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.472+0000 7f6e87fff640 1 -- 172.21.15.38:0/4080943776 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c034660 con 0x7f6e9015d470 2023-12-22T08:46:33.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.473+0000 7f6e97716640 1 -- 172.21.15.38:0/4080943776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e9015d470 msgr2=0x7f6e900b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:33.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.473+0000 7f6e97716640 1 --2- 172.21.15.38:0/4080943776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e9015d470 0x7f6e900b4010 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f6e90162250 tx=0x7f6e8c02bec0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.473+0000 7f6e97716640 1 -- 172.21.15.38:0/4080943776 shutdown_connections 2023-12-22T08:46:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.473+0000 7f6e97716640 1 --2- 172.21.15.38:0/4080943776 >> v2:172.21.15.89:3300/0 conn(0x7f6e90071ea0 0x7f6e900b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.473+0000 7f6e97716640 1 --2- 172.21.15.38:0/4080943776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e9015d470 0x7f6e900b4010 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.473+0000 7f6e97716640 1 -- 172.21.15.38:0/4080943776 >> 172.21.15.38:0/4080943776 conn(0x7f6e900cf070 msgr2=0x7f6e900cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.473+0000 7f6e97716640 1 -- 172.21.15.38:0/4080943776 shutdown_connections 2023-12-22T08:46:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.473+0000 7f6e97716640 1 -- 172.21.15.38:0/4080943776 wait complete. 2023-12-22T08:46:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.476+0000 7f6e97716640 1 Processor -- start 2023-12-22T08:46:33.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.476+0000 7f6e97716640 1 -- start start 2023-12-22T08:46:33.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.477+0000 7f6e97716640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e90071ea0 0x7f6e90142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:33.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.477+0000 7f6e97716640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e9015d470 0x7f6e90160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:33.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.477+0000 7f6e97716640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e9015d850 0x7f6e90155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.477+0000 7f6e97716640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e90145f00 con 0x7f6e9015d850 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.477+0000 7f6e97716640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9015f5d0 con 0x7f6e90071ea0 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.477+0000 7f6e97716640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9015f8b0 con 0x7f6e9015d470 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.477+0000 7f6e95cb3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e9015d850 0x7f6e90155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.477+0000 7f6e95cb3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e9015d850 0x7f6e90155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48838/0 (socket says 172.21.15.38:48838) 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.477+0000 7f6e95cb3640 1 -- 172.21.15.38:0/3033614779 learned_addr learned my addr 172.21.15.38:0/3033614779 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.478+0000 7f6e954b2640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e90071ea0 0x7f6e90142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.478+0000 7f6e94cb1640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e9015d470 0x7f6e90160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.478+0000 7f6e95cb3640 1 -- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e9015d470 msgr2=0x7f6e90160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.478+0000 7f6e95cb3640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e9015d470 0x7f6e90160390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.478+0000 7f6e95cb3640 1 -- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e90071ea0 msgr2=0x7f6e90142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.478+0000 7f6e95cb3640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e90071ea0 0x7f6e90142780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.478+0000 7f6e95cb3640 1 -- 172.21.15.38:0/3033614779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c009a70 con 0x7f6e9015d850 2023-12-22T08:46:33.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.478+0000 7f6e95cb3640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e9015d850 0x7f6e90155730 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c7f0 tx=0x7f6e8800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:33.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.479+0000 7f6e85ffb640 1 -- 172.21.15.38:0/3033614779 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88007820 con 0x7f6e9015d850 2023-12-22T08:46:33.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.479+0000 7f6e85ffb640 1 -- 172.21.15.38:0/3033614779 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e88007980 con 0x7f6e9015d850 2023-12-22T08:46:33.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.479+0000 7f6e85ffb640 1 -- 172.21.15.38:0/3033614779 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88007d70 con 0x7f6e9015d850 2023-12-22T08:46:33.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.479+0000 7f6e97716640 1 -- 172.21.15.38:0/3033614779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9015fb90 con 0x7f6e9015d850 2023-12-22T08:46:33.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.479+0000 7f6e97716640 1 -- 172.21.15.38:0/3033614779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e90142cc0 con 0x7f6e9015d850 2023-12-22T08:46:33.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.480+0000 7f6e97716640 1 -- 172.21.15.38:0/3033614779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e901600b0 con 0x7f6e9015d850 2023-12-22T08:46:33.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.481+0000 7f6e85ffb640 1 -- 172.21.15.38:0/3033614779 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6e880113f0 con 0x7f6e9015d850 2023-12-22T08:46:33.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.482+0000 7f6e85ffb640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6e7406a430 0x7f6e7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:33.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.482+0000 7f6e85ffb640 1 -- 172.21.15.38:0/3033614779 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e88088d00 con 0x7f6e9015d850 2023-12-22T08:46:33.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.482+0000 7f6e85ffb640 1 -- 172.21.15.38:0/3033614779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=114}) v3 -- 0x7f6e74071f60 con 0x7f6e9015d850 2023-12-22T08:46:33.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.483+0000 7f6e954b2640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6e7406a430 0x7f6e7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:33.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.484+0000 7f6e954b2640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6e7406a430 0x7f6e7406c8f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c036000 tx=0x7f6e8c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:33.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.486+0000 7f6e85ffb640 1 -- 172.21.15.38:0/3033614779 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6e901600b0 con 0x7f6e9015d850 2023-12-22T08:46:33.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.717+0000 7f6e97716640 1 -- 172.21.15.38:0/3033614779 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e901600b0 con 0x7f6e9015d850 2023-12-22T08:46:33.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.719+0000 7f6e85ffb640 1 -- 172.21.15.38:0/3033614779 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f6e901600b0 con 0x7f6e9015d850 2023-12-22T08:46:33.720 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:33.720 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/4163741517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4163741517},{"type":"v1","addr":"172.21.15.89:6836","nonce":4163741517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/972467119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":972467119},{"type":"v1","addr":"172.21.15.89:6837","nonce":972467119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/2124959631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2124959631},{"type":"v1","addr":"172.21.15.38:6834","nonce":2124959631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:46:11.013927+0000","modified":"2023-12-22T08:46:14.032400+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/2733146003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2733146003},{"type":"v1","addr":"172.21.15.38:6835","nonce":2733146003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-22T08:46:33.721 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 47 2023-12-22T08:46:33.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.721+0000 7f6e97716640 1 -- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6e7406a430 msgr2=0x7f6e7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.721+0000 7f6e97716640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6e7406a430 0x7f6e7406c8f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c036000 tx=0x7f6e8c030000 comp rx=0 tx=0).stop 2023-12-22T08:46:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.721+0000 7f6e97716640 1 -- 172.21.15.38:0/3033614779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e9015d850 msgr2=0x7f6e90155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.721+0000 7f6e97716640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e9015d850 0x7f6e90155730 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c7f0 tx=0x7f6e8800ccb0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.721+0000 7f6e97716640 1 -- 172.21.15.38:0/3033614779 shutdown_connections 2023-12-22T08:46:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.721+0000 7f6e97716640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6e7406a430 0x7f6e7406c8f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.721+0000 7f6e97716640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e9015d850 0x7f6e90155730 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.721+0000 7f6e97716640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e9015d470 0x7f6e90160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.721+0000 7f6e97716640 1 --2- 172.21.15.38:0/3033614779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e90071ea0 0x7f6e90142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.721+0000 7f6e97716640 1 -- 172.21.15.38:0/3033614779 >> 172.21.15.38:0/3033614779 conn(0x7f6e900cf070 msgr2=0x7f6e900b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.721+0000 7f6e97716640 1 -- 172.21.15.38:0/3033614779 shutdown_connections 2023-12-22T08:46:33.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:33.721+0000 7f6e97716640 1 -- 172.21.15.38:0/3033614779 wait complete. 2023-12-22T08:46:33.743 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-22T08:46:33.984 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":6867,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":22.949068544999999,"mdsmap_epoch":47,"osdmap_epoch":113,"osdmap_epoch_barrier":112,"uptime":28.543303669} 2023-12-22T08:46:33.985 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 6867, "mdsmap_epoch": 47, "osdmap_epoch": 113, "osdmap_epoch_barrier": 112, "rank_uptime": 22.949068545, "state": "up:active", "uptime": 28.543303669, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:46:33.985 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-22T08:46:33.985 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:46:33.985 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:34.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:34.042 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-12-22T08:46:34.098 INFO:teuthology.orchestra.run.smithi038.stderr:dd: failed to open 'small_file_1': Permission denied 2023-12-22T08:46:34.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:46:34.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:34.100 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-22T08:46:34.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:34.159 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-22T08:46:34.310 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:46:34.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.525+0000 7f2df3fff640 1 Processor -- start 2023-12-22T08:46:34.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.525+0000 7f2df3fff640 1 -- start start 2023-12-22T08:46:34.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df3fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2df4157980 0x7f2df415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:34.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df3fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2df40b3ff0 0x7f2df406cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:34.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df3fff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df40d1520 con 0x7f2df40b4470 2023-12-22T08:46:34.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df3fff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df40d1800 con 0x7f2df4157980 2023-12-22T08:46:34.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df3fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40d1ae0 con 0x7f2df40b3ff0 2023-12-22T08:46:34.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df2ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2df4157980 0x7f2df415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:34.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df2ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2df4157980 0x7f2df415eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48852/0 (socket says 172.21.15.38:48852) 2023-12-22T08:46:34.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df2ffd640 1 -- 172.21.15.38:0/3998732497 learned_addr learned my addr 172.21.15.38:0/3998732497 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:34.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df27fc640 1 --2- 172.21.15.38:0/3998732497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2df40b3ff0 0x7f2df406cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:34.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df1ffb640 1 -- 172.21.15.38:0/3998732497 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227286563 0 0) 0x7f2df40d1520 con 0x7f2df40b4470 2023-12-22T08:46:34.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df1ffb640 1 -- 172.21.15.38:0/3998732497 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ddc003520 con 0x7f2df40b4470 2023-12-22T08:46:34.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df2ffd640 1 -- 172.21.15.38:0/3998732497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2df40b3ff0 msgr2=0x7f2df406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:34.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df2ffd640 1 --2- 172.21.15.38:0/3998732497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2df40b3ff0 0x7f2df406cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:34.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df2ffd640 1 -- 172.21.15.38:0/3998732497 >> v1:172.21.15.38:6789/0 conn(0x7f2df40b4470 legacy=0x7f2df40d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:34.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.527+0000 7f2df2ffd640 1 -- 172.21.15.38:0/3998732497 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df40d1dc0 con 0x7f2df4157980 2023-12-22T08:46:34.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.529+0000 7f2df2ffd640 1 --2- 172.21.15.38:0/3998732497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2df4157980 0x7f2df415eb10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009870 tx=0x7f2de402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8e42bd634a0709 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:34.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.531+0000 7f2df1ffb640 1 -- 172.21.15.38:0/3998732497 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de4030840 con 0x7f2df4157980 2023-12-22T08:46:34.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.531+0000 7f2df1ffb640 1 -- 172.21.15.38:0/3998732497 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de40309a0 con 0x7f2df4157980 2023-12-22T08:46:34.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.531+0000 7f2df1ffb640 1 -- 172.21.15.38:0/3998732497 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de4030d30 con 0x7f2df4157980 2023-12-22T08:46:34.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.531+0000 7f2df3fff640 1 -- 172.21.15.38:0/3998732497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2df4157980 msgr2=0x7f2df415eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:34.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.531+0000 7f2df3fff640 1 --2- 172.21.15.38:0/3998732497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2df4157980 0x7f2df415eb10 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009870 tx=0x7f2de402b980 comp rx=0 tx=0).stop 2023-12-22T08:46:34.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.531+0000 7f2df3fff640 1 -- 172.21.15.38:0/3998732497 shutdown_connections 2023-12-22T08:46:34.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.531+0000 7f2df3fff640 1 --2- 172.21.15.38:0/3998732497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2df40b3ff0 0x7f2df406cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:34.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.531+0000 7f2df3fff640 1 --2- 172.21.15.38:0/3998732497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2df4157980 0x7f2df415eb10 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:34.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.531+0000 7f2df3fff640 1 -- 172.21.15.38:0/3998732497 >> 172.21.15.38:0/3998732497 conn(0x7f2df40d31f0 msgr2=0x7f2df40d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:34.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.531+0000 7f2df3fff640 1 -- 172.21.15.38:0/3998732497 shutdown_connections 2023-12-22T08:46:34.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.531+0000 7f2df3fff640 1 -- 172.21.15.38:0/3998732497 wait complete. 2023-12-22T08:46:34.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.533+0000 7f2df3fff640 1 Processor -- start 2023-12-22T08:46:34.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.533+0000 7f2df3fff640 1 -- start start 2023-12-22T08:46:34.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.534+0000 7f2df3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2df40b3ff0 0x7f2df415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:34.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.534+0000 7f2df3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2df40b4470 0x7f2df4070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:34.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.534+0000 7f2df3fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2df4157980 0x7f2df41f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:34.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.534+0000 7f2df3fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df413cec0 con 0x7f2df40b3ff0 2023-12-22T08:46:34.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.534+0000 7f2df3fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df415af40 con 0x7f2df40b4470 2023-12-22T08:46:34.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.534+0000 7f2df3fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df415ace0 con 0x7f2df4157980 2023-12-22T08:46:34.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.534+0000 7f2df2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2df40b3ff0 0x7f2df415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:34.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.534+0000 7f2df2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2df40b3ff0 0x7f2df415a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48868/0 (socket says 172.21.15.38:48868) 2023-12-22T08:46:34.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.534+0000 7f2df2ffd640 1 -- 172.21.15.38:0/3078106226 learned_addr learned my addr 172.21.15.38:0/3078106226 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:34.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.534+0000 7f2df27fc640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2df40b4470 0x7f2df4070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:34.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.534+0000 7f2df37fe640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2df4157980 0x7f2df41f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:34.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.535+0000 7f2df2ffd640 1 -- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2df4157980 msgr2=0x7f2df41f1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:34.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.535+0000 7f2df2ffd640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2df4157980 0x7f2df41f1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:34.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.535+0000 7f2df2ffd640 1 -- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2df40b4470 msgr2=0x7f2df4070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:34.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.535+0000 7f2df2ffd640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2df40b4470 0x7f2df4070680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:34.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.535+0000 7f2df2ffd640 1 -- 172.21.15.38:0/3078106226 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de40094d0 con 0x7f2df40b3ff0 2023-12-22T08:46:34.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.535+0000 7f2df37fe640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2df4157980 0x7f2df41f1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:34.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.535+0000 7f2df2ffd640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2df40b3ff0 0x7f2df415a7a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f2de402b9c0 tx=0x7f2de4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:34.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.536+0000 7f2ddb7fe640 1 -- 172.21.15.38:0/3078106226 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de4039a90 con 0x7f2df40b3ff0 2023-12-22T08:46:34.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.536+0000 7f2ddb7fe640 1 -- 172.21.15.38:0/3078106226 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de4039bf0 con 0x7f2df40b3ff0 2023-12-22T08:46:34.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.536+0000 7f2df3fff640 1 -- 172.21.15.38:0/3078106226 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df413c560 con 0x7f2df40b3ff0 2023-12-22T08:46:34.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.536+0000 7f2ddb7fe640 1 -- 172.21.15.38:0/3078106226 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de4043410 con 0x7f2df40b3ff0 2023-12-22T08:46:34.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.536+0000 7f2df3fff640 1 -- 172.21.15.38:0/3078106226 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df413cae0 con 0x7f2df40b3ff0 2023-12-22T08:46:34.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.537+0000 7f2df3fff640 1 -- 172.21.15.38:0/3078106226 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df4061910 con 0x7f2df40b3ff0 2023-12-22T08:46:34.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.539+0000 7f2ddb7fe640 1 -- 172.21.15.38:0/3078106226 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2de404c3b0 con 0x7f2df40b3ff0 2023-12-22T08:46:34.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.540+0000 7f2ddb7fe640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2de006a430 0x7f2de006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:34.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.540+0000 7f2ddb7fe640 1 -- 172.21.15.38:0/3078106226 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2de40aad50 con 0x7f2df40b3ff0 2023-12-22T08:46:34.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.540+0000 7f2ddb7fe640 1 -- 172.21.15.38:0/3078106226 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=114}) v3 -- 0x7f2de0071f60 con 0x7f2df40b3ff0 2023-12-22T08:46:34.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.540+0000 7f2df27fc640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2de006a430 0x7f2de006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:34.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.541+0000 7f2df27fc640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2de006a430 0x7f2de006c8f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2df41f60c0 tx=0x7f2de8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:34.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.545+0000 7f2ddb7fe640 1 -- 172.21.15.38:0/3078106226 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2de4076440 con 0x7f2df40b3ff0 2023-12-22T08:46:34.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.739+0000 7f2df3fff640 1 -- 172.21.15.38:0/3078106226 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2df40d39e0 con 0x7f2df40b3ff0 2023-12-22T08:46:34.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.741+0000 7f2ddb7fe640 1 -- 172.21.15.38:0/3078106226 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v113) v1 ==== 81+0+33678 (secure 0 0 0) 0x7f2de4048090 con 0x7f2df40b3ff0 2023-12-22T08:46:34.743 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:34.743 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:46:34.743 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 113, 2023-12-22T08:46:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:46:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:46:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:46:33.326637+0000", 2023-12-22T08:46:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:46:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:46:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:46:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:46:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:46:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:46:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:46:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:46:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:46:34.744 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:34.745 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:46:34.745 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:46:34.745 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:46:34.745 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:46:34.745 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:46:34.745 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 13, 2023-12-22T08:46:34.745 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:46:34.745 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:46:34.745 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:46:34.745 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:46:34.745 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:46:34.745 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:46:34.745 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:34.746 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:34.747 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:46:34.747 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:46:34.747 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:46:34.747 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:46:34.747 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:46:34.747 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:34.747 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:34.747 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:34.747 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:34.747 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:34.747 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "111", 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:34.748 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:34.749 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:46:34.750 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.751 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 12, 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:46:08.930859+0000", 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:34.752 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.753 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "111", 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:34.754 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:34.755 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:34.756 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:34.756 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:34.756 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:34.756 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:34.756 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:34.756 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:34.756 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:34.756 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:34.756 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:46:34.756 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:46:34.756 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:46:34.756 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.757 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:34.757 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:46:34.757 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:46:34.757 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.757 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.757 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:34.757 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.75, 2023-12-22T08:46:34.757 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.75, 2023-12-22T08:46:34.757 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.75, 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.75, 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 13, 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:46:10.036922+0000", 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 3, 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full", 2023-12-22T08:46:34.758 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:46:34.759 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "111", 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:34.760 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:34.761 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:34.762 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:46:34.763 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:34.764 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.765 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.766 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.767 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:46:34.768 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:34.769 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.769 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.769 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.769 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:46:34.769 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:46:34.769 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:46:34.769 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:46:34.769 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:34.769 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:34.769 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:46:34.769 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:34.769 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.770 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.770 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.770 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:46:34.770 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:34.770 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:34.770 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:34.770 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:34.770 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:34.770 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:34.770 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:34.770 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:34.770 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:46:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:46:34.771 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:46:34.772 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:46:34.773 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:34.774 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:46:34.775 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:46:34.776 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:46:34.777 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:34.778 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.778 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.778 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.778 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:46:34.778 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:34.778 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.778 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.778 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.778 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:34.778 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.778 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.778 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.778 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:46:34.779 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull", 2023-12-22T08:46:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.785 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:34.786 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:46:34.787 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:46:34.788 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:46:34.789 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:34.790 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.790 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.790 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.790 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:46:34.790 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:34.790 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.790 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.790 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.790 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:34.790 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.790 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.790 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.790 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:46:34.791 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:34.791 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.791 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.791 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.791 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:46:34.791 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:34.791 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.791 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.791 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.791 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:46:34.791 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:46:34.791 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:46:34.791 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:34.792 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:46:34.793 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:46:34.794 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:34.795 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.796 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.796 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.796 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:34.796 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.796 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.796 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:46:34.796 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:34.796 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.796 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.797 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:46:34.797 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:34.797 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.797 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.797 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.797 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:46:34.797 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:46:34.797 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:46:34.797 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:46:34.797 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:34.797 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:34.797 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:34.798 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.798 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.798 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.798 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:46:34.798 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:34.798 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:34.798 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:34.798 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:34.798 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:34.798 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:34.798 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:34.798 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:46:34.799 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:46:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:46:34.801 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:46:34.802 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:34.803 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.803 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.803 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.803 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:46:34.803 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:46:34.803 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:46:34.803 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:46:34.803 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:34.803 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:34.803 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:46:34.803 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:34.803 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:34.804 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:34.805 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:34.805 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.805 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.805 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.805 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:46:34.805 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:34.805 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.805 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.805 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.805 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:46:34.805 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:34.806 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.806 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.806 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.806 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:34.806 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.806 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.806 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.806 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:46:34.806 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:34.806 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.806 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.807 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.807 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:46:34.807 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:34.807 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.807 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.807 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:34.807 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.807 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.807 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.808 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:46:34.808 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:34.808 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.808 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.808 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.808 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:46:34.808 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:34.808 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.808 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.808 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.808 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:34.808 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:34.808 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.809 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:34.809 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:46:34.809 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:34.809 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.809 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.809 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:34.809 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:46:34.809 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:34.809 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.809 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.809 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.809 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: "full", 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:46:34.810 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:34.811 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.812 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:46:34.813 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:34.813 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:34.813 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:34.813 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:34.813 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:34.813 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:46:34.813 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:34.813 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.813 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.813 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:46:34.813 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:34.813 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:34.813 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:46:34.814 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:34.815 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:46:34.816 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:46:34.817 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:46:34.818 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:46:34.818 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:34.818 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:46:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.744+0000 7f2df3fff640 1 -- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2de006a430 msgr2=0x7f2de006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.744+0000 7f2df3fff640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2de006a430 0x7f2de006c8f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2df41f60c0 tx=0x7f2de8008040 comp rx=0 tx=0).stop 2023-12-22T08:46:34.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.744+0000 7f2df3fff640 1 -- 172.21.15.38:0/3078106226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2df40b3ff0 msgr2=0x7f2df415a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.744+0000 7f2df3fff640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2df40b3ff0 0x7f2df415a7a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f2de402b9c0 tx=0x7f2de4004730 comp rx=0 tx=0).stop 2023-12-22T08:46:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.744+0000 7f2df3fff640 1 -- 172.21.15.38:0/3078106226 shutdown_connections 2023-12-22T08:46:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.744+0000 7f2df3fff640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2df4157980 0x7f2df41f1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.744+0000 7f2df3fff640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2df40b4470 0x7f2df4070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.744+0000 7f2df3fff640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2de006a430 0x7f2de006c8f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.744+0000 7f2df3fff640 1 --2- 172.21.15.38:0/3078106226 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2df40b3ff0 0x7f2df415a7a0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.744+0000 7f2df3fff640 1 -- 172.21.15.38:0/3078106226 >> 172.21.15.38:0/3078106226 conn(0x7f2df40d31f0 msgr2=0x7f2df40b8320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.744+0000 7f2df3fff640 1 -- 172.21.15.38:0/3078106226 shutdown_connections 2023-12-22T08:46:34.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:34.744+0000 7f2df3fff640 1 -- 172.21.15.38:0/3078106226 wait complete. 2023-12-22T08:46:34.821 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-22T08:46:39.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:46:40.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.055+0000 7fe2110ca640 1 Processor -- start 2023-12-22T08:46:40.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.055+0000 7fe2110ca640 1 -- start start 2023-12-22T08:46:40.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.057+0000 7fe2110ca640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe20c15d850 0x7fe20c0ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:40.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.057+0000 7fe2110ca640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe20c071ea0 0x7fe20c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:40.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.057+0000 7fe2110ca640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20c0ac8e0 con 0x7fe20c15d470 2023-12-22T08:46:40.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.057+0000 7fe2110ca640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20c0b4940 con 0x7fe20c071ea0 2023-12-22T08:46:40.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.057+0000 7fe2110ca640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0b4c20 con 0x7fe20c15d850 2023-12-22T08:46:40.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.058+0000 7fe20b59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe20c071ea0 0x7fe20c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:40.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.058+0000 7fe20b59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe20c071ea0 0x7fe20c0b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48880/0 (socket says 172.21.15.38:48880) 2023-12-22T08:46:40.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.058+0000 7fe20b59e640 1 -- 172.21.15.38:0/2547624648 learned_addr learned my addr 172.21.15.38:0/2547624648 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:40.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.058+0000 7fe203fff640 1 --2- 172.21.15.38:0/2547624648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe20c15d850 0x7fe20c0ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:40.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.058+0000 7fe20b59e640 1 -- 172.21.15.38:0/2547624648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe20c15d850 msgr2=0x7fe20c0ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:40.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.058+0000 7fe20b59e640 1 --2- 172.21.15.38:0/2547624648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe20c15d850 0x7fe20c0ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.058+0000 7fe20b59e640 1 -- 172.21.15.38:0/2547624648 >> v1:172.21.15.89:6789/0 conn(0x7fe20c15d470 legacy=0x7fe20c0b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:40.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.058+0000 7fe20b59e640 1 -- 172.21.15.38:0/2547624648 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c0acb30 con 0x7fe20c071ea0 2023-12-22T08:46:40.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.059+0000 7fe20b59e640 1 --2- 172.21.15.38:0/2547624648 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe20c071ea0 0x7fe20c0b2050 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe204009e50 tx=0x7fe20402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe8cc4751d7674a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:40.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.060+0000 7fe20a59c640 1 -- 172.21.15.38:0/2547624648 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20402cb00 con 0x7fe20c071ea0 2023-12-22T08:46:40.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.060+0000 7fe20a59c640 1 -- 172.21.15.38:0/2547624648 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20402cc60 con 0x7fe20c071ea0 2023-12-22T08:46:40.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.060+0000 7fe20a59c640 1 -- 172.21.15.38:0/2547624648 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2040343f0 con 0x7fe20c071ea0 2023-12-22T08:46:40.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.060+0000 7fe2110ca640 1 -- 172.21.15.38:0/2547624648 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe20c071ea0 msgr2=0x7fe20c0b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:40.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.060+0000 7fe2110ca640 1 --2- 172.21.15.38:0/2547624648 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe20c071ea0 0x7fe20c0b2050 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe204009e50 tx=0x7fe20402bf60 comp rx=0 tx=0).stop 2023-12-22T08:46:40.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.060+0000 7fe2110ca640 1 -- 172.21.15.38:0/2547624648 shutdown_connections 2023-12-22T08:46:40.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.061+0000 7fe2110ca640 1 --2- 172.21.15.38:0/2547624648 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe20c071ea0 0x7fe20c0b2050 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.061+0000 7fe2110ca640 1 --2- 172.21.15.38:0/2547624648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe20c15d850 0x7fe20c0ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.061+0000 7fe2110ca640 1 -- 172.21.15.38:0/2547624648 >> 172.21.15.38:0/2547624648 conn(0x7fe20c0cf070 msgr2=0x7fe20c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:40.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.061+0000 7fe2110ca640 1 -- 172.21.15.38:0/2547624648 shutdown_connections 2023-12-22T08:46:40.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.061+0000 7fe2110ca640 1 -- 172.21.15.38:0/2547624648 wait complete. 2023-12-22T08:46:40.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.062+0000 7fe2110ca640 1 Processor -- start 2023-12-22T08:46:40.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.063+0000 7fe2110ca640 1 -- start start 2023-12-22T08:46:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.063+0000 7fe2110ca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe20c071ea0 0x7fe20c143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe2110ca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe20c15d470 0x7fe20c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe2110ca640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe20c15d850 0x7fe20c15f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe2110ca640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c144dd0 con 0x7fe20c15d470 2023-12-22T08:46:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe2110ca640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0ce430 con 0x7fe20c071ea0 2023-12-22T08:46:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe2110ca640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c1444a0 con 0x7fe20c15d850 2023-12-22T08:46:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe203fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe20c15d470 0x7fe20c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe203fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe20c15d470 0x7fe20c15ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48892/0 (socket says 172.21.15.38:48892) 2023-12-22T08:46:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe203fff640 1 -- 172.21.15.38:0/3591429257 learned_addr learned my addr 172.21.15.38:0/3591429257 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:40.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe20b59e640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe20c15d850 0x7fe20c15f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe20ad9d640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe20c071ea0 0x7fe20c143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe203fff640 1 -- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe20c15d850 msgr2=0x7fe20c15f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe203fff640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe20c15d850 0x7fe20c15f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe203fff640 1 -- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe20c071ea0 msgr2=0x7fe20c143c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe203fff640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe20c071ea0 0x7fe20c143c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.064+0000 7fe203fff640 1 -- 172.21.15.38:0/3591429257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe204009b30 con 0x7fe20c15d470 2023-12-22T08:46:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.065+0000 7fe203fff640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe20c15d470 0x7fe20c15ec80 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400d5d0 tx=0x7fe1f400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.065+0000 7fe2037fe640 1 -- 172.21.15.38:0/3591429257 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f40125f0 con 0x7fe20c15d470 2023-12-22T08:46:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.065+0000 7fe2037fe640 1 -- 172.21.15.38:0/3591429257 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f4012770 con 0x7fe20c15d470 2023-12-22T08:46:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.065+0000 7fe2110ca640 1 -- 172.21.15.38:0/3591429257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20c144780 con 0x7fe20c15d470 2023-12-22T08:46:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.065+0000 7fe2037fe640 1 -- 172.21.15.38:0/3591429257 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4012b20 con 0x7fe20c15d470 2023-12-22T08:46:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.065+0000 7fe2110ca640 1 -- 172.21.15.38:0/3591429257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c144180 con 0x7fe20c15d470 2023-12-22T08:46:40.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.066+0000 7fe2110ca640 1 -- 172.21.15.38:0/3591429257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c061910 con 0x7fe20c15d470 2023-12-22T08:46:40.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.067+0000 7fe2037fe640 1 -- 172.21.15.38:0/3591429257 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe1f4012c80 con 0x7fe20c15d470 2023-12-22T08:46:40.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.068+0000 7fe2037fe640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1ec06a430 0x7fe1ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:40.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.069+0000 7fe2037fe640 1 -- 172.21.15.38:0/3591429257 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1f4088d80 con 0x7fe20c15d470 2023-12-22T08:46:40.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.069+0000 7fe20ad9d640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1ec06a430 0x7fe1ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:40.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.070+0000 7fe20ad9d640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1ec06a430 0x7fe1ec06c8f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc000f60 tx=0x7fe1fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:40.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.073+0000 7fe2037fe640 1 -- 172.21.15.38:0/3591429257 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe1f4054360 con 0x7fe20c15d470 2023-12-22T08:46:40.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.272+0000 7fe2110ca640 1 -- 172.21.15.38:0/3591429257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe20c160f20 con 0x7fe20c15d470 2023-12-22T08:46:40.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.276+0000 7fe2037fe640 1 -- 172.21.15.38:0/3591429257 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v115) v1 ==== 81+0+33503 (secure 0 0 0) 0x7fe1f4057980 con 0x7fe20c15d470 2023-12-22T08:46:40.278 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:40.278 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:46:40.278 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 115, 2023-12-22T08:46:40.278 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:46:40.278 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:46:38.242259+0000", 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:46:40.279 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 13, 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:46:40.280 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:46:40.281 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:46:40.281 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:40.281 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:40.281 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:40.281 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:40.281 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:40.281 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:40.281 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:40.281 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:40.281 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:40.281 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:40.282 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:46:40.282 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:46:40.282 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:46:40.282 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:46:40.282 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:46:40.282 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:40.282 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:40.282 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:40.283 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:40.283 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:40.283 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:40.283 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:40.283 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.283 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:46:40.283 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:40.284 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:40.284 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:40.284 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:40.284 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:40.284 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:40.284 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:40.284 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:40.285 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:40.285 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:40.285 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:40.285 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:40.285 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:40.285 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:40.286 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:40.286 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:40.286 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:40.286 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:40.286 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:40.286 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:40.286 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:40.287 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:40.287 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:40.287 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:40.287 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:40.287 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:40.287 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.287 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:40.287 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:40.287 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:40.288 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:40.288 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:40.288 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:40.288 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:40.288 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:40.288 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:40.288 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:40.288 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:40.289 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:40.289 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:46:40.289 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:46:40.289 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.289 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:40.289 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:46:40.290 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.290 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:40.290 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:46:40.290 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:46:40.290 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:46:40.290 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:46:40.290 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:46:40.291 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:40.291 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:40.291 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:40.291 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.291 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.291 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.291 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 12, 2023-12-22T08:46:40.291 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:46:40.291 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:46:08.930859+0000", 2023-12-22T08:46:40.292 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:46:40.292 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:46:40.292 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:40.292 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:40.292 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:40.292 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:40.292 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:40.292 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:40.292 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:40.292 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:40.292 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:40.292 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:40.292 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:46:40.293 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:40.294 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:40.295 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:40.296 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:46:40.297 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:46:40.297 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.297 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.297 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:40.297 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.75, 2023-12-22T08:46:40.297 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.75, 2023-12-22T08:46:40.297 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:46:40.297 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.75, 2023-12-22T08:46:40.297 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.75, 2023-12-22T08:46:40.297 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:40.297 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:40.297 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:40.297 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.298 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.298 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.298 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 13, 2023-12-22T08:46:40.298 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:46:40.298 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:46:10.036922+0000", 2023-12-22T08:46:40.298 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:46:40.298 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:46:40.298 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:40.298 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:40.298 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:40.299 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:40.300 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:40.300 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:40.300 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:40.300 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:40.300 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.300 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:46:40.300 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:40.300 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:40.300 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:40.300 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:40.300 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:40.300 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:40.300 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:40.301 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:40.302 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:46:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:46:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:46:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:46:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:40.303 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:46:40.304 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:46:40.304 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:46:40.304 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:46:40.304 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:46:40.304 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:40.304 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:40.304 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:40.304 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.304 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.304 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:40.304 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:46:40.304 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.305 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:46:40.305 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.305 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.305 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.305 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.305 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.305 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.305 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.305 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.305 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.305 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.305 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.306 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.307 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.308 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.308 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.308 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.308 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.308 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:46:40.308 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.308 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.308 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.308 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.308 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:46:40.308 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.308 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.309 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.309 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.309 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.309 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.309 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.309 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:46:40.309 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.309 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.309 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.309 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:46:40.309 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.310 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.311 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:46:40.312 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.312 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.312 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.312 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.312 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:46:40.312 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.312 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.312 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.312 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.312 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.312 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.312 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.312 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.313 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:46:40.313 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.313 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.313 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.313 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:46:40.313 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.313 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.313 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.314 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.315 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.315 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.315 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.315 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.315 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:46:40.315 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.315 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.316 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.316 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.316 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:46:40.316 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.316 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.316 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.316 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.317 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:46:40.317 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:46:40.317 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:46:40.317 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:46:40.317 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.317 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.317 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.317 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.317 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.317 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:46:40.317 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.317 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:46:40.318 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.319 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.319 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.319 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.319 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:46:40.319 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.319 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.319 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.319 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.319 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.319 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.319 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.320 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.320 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:46:40.320 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.320 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.320 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.320 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.320 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:46:40.320 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.320 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.320 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.320 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.320 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.320 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:46:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:46:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.321 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.322 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:46:40.323 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:46:40.323 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:46:40.323 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:46:40.323 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.323 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.323 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.323 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.323 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.323 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:46:40.323 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.323 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.323 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.324 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.325 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.325 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.325 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:46:40.325 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.325 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.325 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.325 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.325 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.325 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.325 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.325 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.325 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:46:40.325 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:46:40.326 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.327 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.327 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.327 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.327 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:46:40.327 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.327 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.327 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.327 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.327 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.327 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.327 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.327 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.327 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:46:40.328 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.329 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.329 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.329 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.329 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.329 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.329 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:46:40.329 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.329 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.330 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.330 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.330 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.330 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.330 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.330 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.330 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.330 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.330 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:46:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:46:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.331 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.332 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.332 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.332 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.332 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.332 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.332 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.332 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:46:40.332 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.332 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.332 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.332 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.333 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.334 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.335 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:46:40.335 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.335 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.335 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.335 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.335 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:46:40.335 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:46:40.335 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.336 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.337 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.338 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:46:40.339 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.339 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.339 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.339 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.339 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.339 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.339 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.339 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:46:40.339 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.339 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.339 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.340 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:46:40.340 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.340 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.340 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.340 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.340 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.340 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.340 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.340 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:46:40.341 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.341 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.341 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.341 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:46:40.341 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.341 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.341 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.341 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:46:40.341 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:46:40.341 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:46:40.341 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.342 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.343 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.344 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.345 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.345 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.345 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.345 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.345 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.345 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:46:40.345 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.345 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.345 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.345 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.345 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:46:40.345 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.346 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.346 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.346 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.346 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.346 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.346 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.346 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.346 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:46:40.346 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.346 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.347 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.348 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.348 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.348 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.348 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:46:40.348 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.348 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.348 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.348 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.348 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.348 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.348 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.348 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.349 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.349 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.349 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.349 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.349 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.349 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.349 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.349 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:46:40.349 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.349 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.349 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.349 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.350 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:46:40.350 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.350 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.350 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.350 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.350 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.350 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.350 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.350 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.350 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:46:40.351 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.351 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.351 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.351 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.351 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:46:40.351 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.351 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.351 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.351 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.351 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.351 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.351 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.351 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.352 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:46:40.352 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.352 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.352 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.352 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.352 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:46:40.352 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.352 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.352 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.352 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.352 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.352 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.352 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:46:40.353 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.354 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.355 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:46:40.356 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.356 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.356 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.356 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.356 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.356 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:46:40.356 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.356 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.356 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.356 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:46:40.356 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.356 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.357 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.357 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.357 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.357 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:46:40.357 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.357 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.357 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.357 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:46:40.357 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.357 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:46:40.358 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.359 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:46:40.360 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:46:40.361 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:46:40.361 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:46:40.361 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:46:40.361 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:46:40.361 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:46:40.361 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:46:40.361 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.361 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.361 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:46:40.362 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:46:40.362 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:46:40.362 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:46:40.362 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:46:40.362 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:46:40.362 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:46:40.362 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:46:40.362 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:46:40.362 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:46:40.362 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:46:40.362 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.362 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:46:40.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.279+0000 7fe2110ca640 1 -- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1ec06a430 msgr2=0x7fe1ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:40.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.279+0000 7fe2110ca640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1ec06a430 0x7fe1ec06c8f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc000f60 tx=0x7fe1fc009040 comp rx=0 tx=0).stop 2023-12-22T08:46:40.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.279+0000 7fe2110ca640 1 -- 172.21.15.38:0/3591429257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe20c15d470 msgr2=0x7fe20c15ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:40.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.279+0000 7fe2110ca640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe20c15d470 0x7fe20c15ec80 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400d5d0 tx=0x7fe1f400da90 comp rx=0 tx=0).stop 2023-12-22T08:46:40.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.279+0000 7fe2110ca640 1 -- 172.21.15.38:0/3591429257 shutdown_connections 2023-12-22T08:46:40.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.279+0000 7fe2110ca640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe20c15d850 0x7fe20c15f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.279+0000 7fe2110ca640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1ec06a430 0x7fe1ec06c8f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.279+0000 7fe2110ca640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe20c15d470 0x7fe20c15ec80 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.279+0000 7fe2110ca640 1 --2- 172.21.15.38:0/3591429257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe20c071ea0 0x7fe20c143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.279+0000 7fe2110ca640 1 -- 172.21.15.38:0/3591429257 >> 172.21.15.38:0/3591429257 conn(0x7fe20c0cf070 msgr2=0x7fe20c0b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:40.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.279+0000 7fe2110ca640 1 -- 172.21.15.38:0/3591429257 shutdown_connections 2023-12-22T08:46:40.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.279+0000 7fe2110ca640 1 -- 172.21.15.38:0/3591429257 wait complete. 2023-12-22T08:46:40.365 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-22T08:46:40.365 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:46:40.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.597+0000 7f344c886640 1 Processor -- start 2023-12-22T08:46:40.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.597+0000 7f344c886640 1 -- start start 2023-12-22T08:46:40.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.599+0000 7f344c886640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3448071680 0x7f3448162f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:40.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.599+0000 7f344c886640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f34480caf90 0x7f344806d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:40.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.599+0000 7f344c886640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3448162ce0 con 0x7f34480b2a90 2023-12-22T08:46:40.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.599+0000 7f344c886640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3448162160 con 0x7f34480caf90 2023-12-22T08:46:40.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.599+0000 7f344c886640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3448162440 con 0x7f3448071680 2023-12-22T08:46:40.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.599+0000 7f344759e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f34480caf90 0x7f344806d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:40.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.599+0000 7f344659c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f34480b2a90 0x7f34480ca880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57904/0 (socket says 172.21.15.38:57904) 2023-12-22T08:46:40.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.599+0000 7f344659c640 1 -- 172.21.15.38:0/3342934340 learned_addr learned my addr 172.21.15.38:0/3342934340 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:40.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.600+0000 7f3446d9d640 1 --2- 172.21.15.38:0/3342934340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3448071680 0x7f3448162f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:40.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.600+0000 7f344759e640 1 -- 172.21.15.38:0/3342934340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3448071680 msgr2=0x7f3448162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:40.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.600+0000 7f344759e640 1 --2- 172.21.15.38:0/3342934340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3448071680 0x7f3448162f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.600+0000 7f344759e640 1 -- 172.21.15.38:0/3342934340 >> v1:172.21.15.38:6789/0 conn(0x7f34480b2a90 legacy=0x7f34480ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:40.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.600+0000 7f3445d9b640 1 -- 172.21.15.38:0/3342934340 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784039386 0 0) 0x7f3448162ce0 con 0x7f34480b2a90 2023-12-22T08:46:40.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.600+0000 7f344759e640 1 -- 172.21.15.38:0/3342934340 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3448162720 con 0x7f34480caf90 2023-12-22T08:46:40.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.601+0000 7f344759e640 1 --2- 172.21.15.38:0/3342934340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34480caf90 0x7f344806d280 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f3448162ed0 tx=0x7f344002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5790d189eb17904f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:40.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.601+0000 7f3445d9b640 1 -- 172.21.15.38:0/3342934340 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344002cc40 con 0x7f34480caf90 2023-12-22T08:46:40.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.602+0000 7f3445d9b640 1 -- 172.21.15.38:0/3342934340 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344002cda0 con 0x7f34480caf90 2023-12-22T08:46:40.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.602+0000 7f3445d9b640 1 -- 172.21.15.38:0/3342934340 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440034660 con 0x7f34480caf90 2023-12-22T08:46:40.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.602+0000 7f344c886640 1 -- 172.21.15.38:0/3342934340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34480caf90 msgr2=0x7f344806d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:40.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.602+0000 7f344c886640 1 --2- 172.21.15.38:0/3342934340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34480caf90 0x7f344806d280 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f3448162ed0 tx=0x7f344002be90 comp rx=0 tx=0).stop 2023-12-22T08:46:40.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.602+0000 7f344c886640 1 -- 172.21.15.38:0/3342934340 shutdown_connections 2023-12-22T08:46:40.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.602+0000 7f344c886640 1 --2- 172.21.15.38:0/3342934340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34480caf90 0x7f344806d280 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.602+0000 7f344c886640 1 --2- 172.21.15.38:0/3342934340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3448071680 0x7f3448162f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.602+0000 7f344c886640 1 -- 172.21.15.38:0/3342934340 >> 172.21.15.38:0/3342934340 conn(0x7f34480b1f70 msgr2=0x7f34480b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:40.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.602+0000 7f344c886640 1 -- 172.21.15.38:0/3342934340 shutdown_connections 2023-12-22T08:46:40.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.602+0000 7f344c886640 1 -- 172.21.15.38:0/3342934340 wait complete. 2023-12-22T08:46:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.605+0000 7f344c886640 1 Processor -- start 2023-12-22T08:46:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.605+0000 7f344c886640 1 -- start start 2023-12-22T08:46:40.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.606+0000 7f344c886640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3448071680 0x7f34480ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:40.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.606+0000 7f344c886640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34480b2a90 0x7f34480cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:40.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.606+0000 7f344c886640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34480caf90 0x7f34480cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:40.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.606+0000 7f344c886640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344815d5b0 con 0x7f34480caf90 2023-12-22T08:46:40.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.606+0000 7f344c886640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344815c9e0 con 0x7f3448071680 2023-12-22T08:46:40.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.606+0000 7f344c886640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344815cc80 con 0x7f34480b2a90 2023-12-22T08:46:40.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.606+0000 7f344759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34480caf90 0x7f34480cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:40.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.606+0000 7f344759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34480caf90 0x7f34480cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48910/0 (socket says 172.21.15.38:48910) 2023-12-22T08:46:40.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.606+0000 7f344759e640 1 -- 172.21.15.38:0/1162497556 learned_addr learned my addr 172.21.15.38:0/1162497556 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:40.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.607+0000 7f344659c640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34480b2a90 0x7f34480cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:40.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.607+0000 7f3446d9d640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3448071680 0x7f34480ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:40.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.607+0000 7f344759e640 1 -- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34480b2a90 msgr2=0x7f34480cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:40.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.607+0000 7f344759e640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34480b2a90 0x7f34480cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.607+0000 7f344759e640 1 -- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3448071680 msgr2=0x7f34480ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:40.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.607+0000 7f344759e640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3448071680 0x7f34480ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.607+0000 7f344759e640 1 -- 172.21.15.38:0/1162497556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3440009a70 con 0x7f34480caf90 2023-12-22T08:46:40.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.607+0000 7f3446d9d640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3448071680 0x7f34480ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:40.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.607+0000 7f344759e640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34480caf90 0x7f34480cdc20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3440009e80 tx=0x7f3440004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:40.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.607+0000 7f342f7fe640 1 -- 172.21.15.38:0/1162497556 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440040650 con 0x7f34480caf90 2023-12-22T08:46:40.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.608+0000 7f342f7fe640 1 -- 172.21.15.38:0/1162497556 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34400407d0 con 0x7f34480caf90 2023-12-22T08:46:40.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.608+0000 7f342f7fe640 1 -- 172.21.15.38:0/1162497556 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440040b80 con 0x7f34480caf90 2023-12-22T08:46:40.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.608+0000 7f344c886640 1 -- 172.21.15.38:0/1162497556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344815cf60 con 0x7f34480caf90 2023-12-22T08:46:40.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.608+0000 7f344c886640 1 -- 172.21.15.38:0/1162497556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344815c6d0 con 0x7f34480caf90 2023-12-22T08:46:40.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.609+0000 7f344c886640 1 -- 172.21.15.38:0/1162497556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344815d760 con 0x7f34480caf90 2023-12-22T08:46:40.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.610+0000 7f342f7fe640 1 -- 172.21.15.38:0/1162497556 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3440040ce0 con 0x7f34480caf90 2023-12-22T08:46:40.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.611+0000 7f342f7fe640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f343406a430 0x7f343406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:40.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.611+0000 7f342f7fe640 1 -- 172.21.15.38:0/1162497556 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34400ab7f0 con 0x7f34480caf90 2023-12-22T08:46:40.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.611+0000 7f3446d9d640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f343406a430 0x7f343406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:40.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.612+0000 7f3446d9d640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f343406a430 0x7f343406c8f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3438006fd0 tx=0x7f3438008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:40.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.615+0000 7f342f7fe640 1 -- 172.21.15.38:0/1162497556 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f344815d760 con 0x7f34480caf90 2023-12-22T08:46:40.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.807+0000 7f344c886640 1 -- 172.21.15.38:0/1162497556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3448061910 con 0x7f34480caf90 2023-12-22T08:46:40.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.809+0000 7f342f7fe640 1 -- 172.21.15.38:0/1162497556 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v115) v1 ==== 81+0+33503 (secure 0 0 0) 0x7f3440076d40 con 0x7f34480caf90 2023-12-22T08:46:40.811 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:40.811 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:46:40.811 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 115, 2023-12-22T08:46:40.811 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:46:40.811 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:46:40.811 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:46:38.242259+0000", 2023-12-22T08:46:40.811 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:46:40.812 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:46:40.813 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 13, 2023-12-22T08:46:40.813 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:46:40.813 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:46:40.813 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:46:40.813 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:46:40.813 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:46:40.813 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:46:40.813 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.813 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:46:40.813 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:46:40.813 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:46:40.813 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:46:40.814 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:40.815 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:40.816 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:40.817 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:40.818 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 12, 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:46:08.930859+0000", 2023-12-22T08:46:40.819 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:46:40.820 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:40.821 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:40.822 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:40.823 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:40.823 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:40.823 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:40.823 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:40.823 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:40.823 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:40.823 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:40.823 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:40.823 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.823 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:40.823 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:40.823 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:40.823 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:46:40.824 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.75, 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.75, 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.75, 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.75, 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.825 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 13, 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:46:10.036922+0000", 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:46:40.826 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:46:40.827 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:46:40.828 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:46:40.829 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:46:40.829 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:46:40.829 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:46:40.829 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:46:40.829 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:46:40.829 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:46:40.829 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:46:40.829 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:46:40.829 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:46:40.829 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:46:40.829 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.829 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:46:40.829 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:46:40.830 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:46:40.830 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:46:40.830 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:46:40.830 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:46:40.830 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:46:40.830 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:46:40.830 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:46:40.830 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:46:40.830 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:46:40.830 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:46:40.830 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:46:40.830 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:46:40.831 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.832 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:46:40.833 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.834 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.835 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.836 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.837 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:46:40.837 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:46:40.837 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:46:40.837 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:46:40.837 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.837 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.837 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.837 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.837 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.837 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.837 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:46:40.837 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.837 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:46:40.838 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.839 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.840 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.841 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.841 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:46:40.841 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.841 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.841 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.841 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.841 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.841 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.841 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.841 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.841 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:46:40.841 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.841 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.842 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.843 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.844 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.845 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.846 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:46:40.847 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.848 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.849 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.850 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.851 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.852 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.853 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.854 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.855 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.856 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.857 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:46:40.858 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.859 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:46:40.860 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.861 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.862 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.863 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.864 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:46:40.865 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:46:40.866 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:46:40.867 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.868 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.869 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.869 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.869 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:46:40.869 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:46:40.869 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.869 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.869 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.869 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:46:40.869 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:46:40.869 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:46:40.869 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:46:40.869 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.869 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 108, 2023-12-22T08:46:40.870 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:46:40.871 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:46:40.871 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:46:40.871 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.871 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.871 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.871 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:46:40.871 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.871 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.871 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.871 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.871 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:46:40.871 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.871 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.872 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.873 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.874 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.875 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:46:40.876 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:46:40.877 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.878 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.879 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:46:40.880 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:46:40.881 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:46:40.882 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:46:40.883 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:46:40.883 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:46:40.883 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:46:40.883 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:46:40.883 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:46:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.811+0000 7f344c886640 1 -- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f343406a430 msgr2=0x7f343406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.811+0000 7f344c886640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f343406a430 0x7f343406c8f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3438006fd0 tx=0x7f3438008040 comp rx=0 tx=0).stop 2023-12-22T08:46:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.811+0000 7f344c886640 1 -- 172.21.15.38:0/1162497556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34480caf90 msgr2=0x7f34480cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.811+0000 7f344c886640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34480caf90 0x7f34480cdc20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3440009e80 tx=0x7f3440004a40 comp rx=0 tx=0).stop 2023-12-22T08:46:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.812+0000 7f344c886640 1 -- 172.21.15.38:0/1162497556 shutdown_connections 2023-12-22T08:46:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.812+0000 7f344c886640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f343406a430 0x7f343406c8f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.812+0000 7f344c886640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34480caf90 0x7f34480cdc20 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.812+0000 7f344c886640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34480b2a90 0x7f34480cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.812+0000 7f344c886640 1 --2- 172.21.15.38:0/1162497556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3448071680 0x7f34480ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.812+0000 7f344c886640 1 -- 172.21.15.38:0/1162497556 >> 172.21.15.38:0/1162497556 conn(0x7f34480b1f70 msgr2=0x7f344806c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.812+0000 7f344c886640 1 -- 172.21.15.38:0/1162497556 shutdown_connections 2023-12-22T08:46:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:40.812+0000 7f344c886640 1 -- 172.21.15.38:0/1162497556 wait complete. 2023-12-22T08:46:40.886 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:46:41.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.117+0000 7fadd6e15640 1 Processor -- start 2023-12-22T08:46:41.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.117+0000 7fadd6e15640 1 -- start start 2023-12-22T08:46:41.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.119+0000 7fadd6e15640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fadd00b3ff0 0x7fadd006cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:41.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.119+0000 7fadd6e15640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fadd00b44a0 0x7fadd006d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:41.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.119+0000 7fadd6e15640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd015f220 con 0x7fadd0157980 2023-12-22T08:46:41.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.119+0000 7fadd6e15640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd00d1520 con 0x7fadd00b44a0 2023-12-22T08:46:41.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.119+0000 7fadd6e15640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd00d1800 con 0x7fadd00b3ff0 2023-12-22T08:46:41.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.119+0000 7fadd5e13640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fadd0157980 0x7fadd015eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41908/0 (socket says 172.21.15.38:41908) 2023-12-22T08:46:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.119+0000 7fadd5e13640 1 -- 172.21.15.38:0/630318863 learned_addr learned my addr 172.21.15.38:0/630318863 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.119+0000 7fadd6614640 1 --2- 172.21.15.38:0/630318863 >> v2:172.21.15.38:3300/0 conn(0x7fadd00b44a0 0x7fadd006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.120+0000 7fadd5612640 1 --2- 172.21.15.38:0/630318863 >> v2:172.21.15.89:3300/0 conn(0x7fadd00b3ff0 0x7fadd006cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.120+0000 7fadd4e11640 1 -- 172.21.15.38:0/630318863 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877930520 0 0) 0x7fadd015f220 con 0x7fadd0157980 2023-12-22T08:46:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.120+0000 7fadd4e11640 1 -- 172.21.15.38:0/630318863 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadbc003520 con 0x7fadd0157980 2023-12-22T08:46:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.120+0000 7fadd6614640 1 -- 172.21.15.38:0/630318863 >> v2:172.21.15.89:3300/0 conn(0x7fadd00b3ff0 msgr2=0x7fadd006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.120+0000 7fadd6614640 1 --2- 172.21.15.38:0/630318863 >> v2:172.21.15.89:3300/0 conn(0x7fadd00b3ff0 0x7fadd006cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.120+0000 7fadd6614640 1 -- 172.21.15.38:0/630318863 >> v1:172.21.15.38:6789/0 conn(0x7fadd0157980 legacy=0x7fadd015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.120+0000 7fadd6614640 1 -- 172.21.15.38:0/630318863 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd00d1ae0 con 0x7fadd00b44a0 2023-12-22T08:46:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.121+0000 7fadd6614640 1 --2- 172.21.15.38:0/630318863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadd00b44a0 0x7fadd006d470 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fadd00d3f10 tx=0x7fadc802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b3fc254c107664 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:41.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.121+0000 7fadd4e11640 1 -- 172.21.15.38:0/630318863 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc802cc80 con 0x7fadd00b44a0 2023-12-22T08:46:41.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.121+0000 7fadd4e11640 1 -- 172.21.15.38:0/630318863 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc802cde0 con 0x7fadd00b44a0 2023-12-22T08:46:41.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.121+0000 7fadd4e11640 1 -- 172.21.15.38:0/630318863 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8034660 con 0x7fadd00b44a0 2023-12-22T08:46:41.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.122+0000 7fadd6e15640 1 -- 172.21.15.38:0/630318863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadd00b44a0 msgr2=0x7fadd006d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:41.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.122+0000 7fadd6e15640 1 --2- 172.21.15.38:0/630318863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadd00b44a0 0x7fadd006d470 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fadd00d3f10 tx=0x7fadc802bed0 comp rx=0 tx=0).stop 2023-12-22T08:46:41.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.122+0000 7fadd6e15640 1 -- 172.21.15.38:0/630318863 shutdown_connections 2023-12-22T08:46:41.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.122+0000 7fadd6e15640 1 --2- 172.21.15.38:0/630318863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadd00b44a0 0x7fadd006d470 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:41.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.122+0000 7fadd6e15640 1 --2- 172.21.15.38:0/630318863 >> v2:172.21.15.89:3300/0 conn(0x7fadd00b3ff0 0x7fadd006cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:41.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.122+0000 7fadd6e15640 1 -- 172.21.15.38:0/630318863 >> 172.21.15.38:0/630318863 conn(0x7fadd00d31f0 msgr2=0x7fadd00d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:41.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.122+0000 7fadd6e15640 1 -- 172.21.15.38:0/630318863 shutdown_connections 2023-12-22T08:46:41.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.122+0000 7fadd6e15640 1 -- 172.21.15.38:0/630318863 wait complete. 2023-12-22T08:46:41.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.124+0000 7fadd6e15640 1 Processor -- start 2023-12-22T08:46:41.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.124+0000 7fadd6e15640 1 -- start start 2023-12-22T08:46:41.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.125+0000 7fadd6e15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd00b3ff0 0x7fadd01f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:41.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.125+0000 7fadd6e15640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadd00b44a0 0x7fadd0157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:41.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.125+0000 7fadd6e15640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadd0157980 0x7fadd00b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:41.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.125+0000 7fadd6e15640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd01584e0 con 0x7fadd00b44a0 2023-12-22T08:46:41.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.125+0000 7fadd6e15640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd015a870 con 0x7fadd00b3ff0 2023-12-22T08:46:41.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.125+0000 7fadd6e15640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd015ab50 con 0x7fadd0157980 2023-12-22T08:46:41.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.125+0000 7fadd5612640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadd00b44a0 0x7fadd0157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:41.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.125+0000 7fadd5612640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadd00b44a0 0x7fadd0157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45168/0 (socket says 172.21.15.38:45168) 2023-12-22T08:46:41.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.125+0000 7fadd5612640 1 -- 172.21.15.38:0/2734787696 learned_addr learned my addr 172.21.15.38:0/2734787696 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:41.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.126+0000 7fadd5e13640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd00b3ff0 0x7fadd01f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:41.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.126+0000 7fadd5612640 1 -- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadd0157980 msgr2=0x7fadd00b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:41.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.126+0000 7fadd5612640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadd0157980 0x7fadd00b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:41.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.126+0000 7fadd5612640 1 -- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd00b3ff0 msgr2=0x7fadd01f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:41.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.126+0000 7fadd5612640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd00b3ff0 0x7fadd01f6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:41.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.126+0000 7fadd5612640 1 -- 172.21.15.38:0/2734787696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc8009a70 con 0x7fadd00b44a0 2023-12-22T08:46:41.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.126+0000 7fadd5e13640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd00b3ff0 0x7fadd01f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:41.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.126+0000 7fadd5612640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadd00b44a0 0x7fadd0157fa0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fadc000d800 tx=0x7fadc000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:41.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.126+0000 7fadc67fc640 1 -- 172.21.15.38:0/2734787696 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000b6c0 con 0x7fadd00b44a0 2023-12-22T08:46:41.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.126+0000 7fadc67fc640 1 -- 172.21.15.38:0/2734787696 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc000b820 con 0x7fadd00b44a0 2023-12-22T08:46:41.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.126+0000 7fadc67fc640 1 -- 172.21.15.38:0/2734787696 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000bbb0 con 0x7fadd00b44a0 2023-12-22T08:46:41.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.126+0000 7fadd6e15640 1 -- 172.21.15.38:0/2734787696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd015ae30 con 0x7fadd00b44a0 2023-12-22T08:46:41.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.127+0000 7fadd6e15640 1 -- 172.21.15.38:0/2734787696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd0158760 con 0x7fadd00b44a0 2023-12-22T08:46:41.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.128+0000 7fadd6e15640 1 -- 172.21.15.38:0/2734787696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd0061910 con 0x7fadd00b44a0 2023-12-22T08:46:41.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.129+0000 7fadc67fc640 1 -- 172.21.15.38:0/2734787696 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fadc000bd10 con 0x7fadd00b44a0 2023-12-22T08:46:41.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.130+0000 7fadc67fc640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fadb406a430 0x7fadb406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:41.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.130+0000 7fadc67fc640 1 -- 172.21.15.38:0/2734787696 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadc0088ec0 con 0x7fadd00b44a0 2023-12-22T08:46:41.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.131+0000 7fadd5e13640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fadb406a430 0x7fadb406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:41.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.132+0000 7fadd5e13640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fadb406a430 0x7fadb406c8f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fadcc005880 tx=0x7fadcc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:41.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.135+0000 7fadc67fc640 1 -- 172.21.15.38:0/2734787696 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fadc0054410 con 0x7fadd00b44a0 2023-12-22T08:46:41.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.369+0000 7fadd6e15640 1 -- 172.21.15.38:0/2734787696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadd00d0f20 con 0x7fadd00b44a0 2023-12-22T08:46:41.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.370+0000 7fadc67fc640 1 -- 172.21.15.38:0/2734787696 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4647 (secure 0 0 0) 0x7fadc0057a30 con 0x7fadd00b44a0 2023-12-22T08:46:41.372 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:41.372 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/4163741517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4163741517},{"type":"v1","addr":"172.21.15.89:6836","nonce":4163741517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/972467119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":972467119},{"type":"v1","addr":"172.21.15.89:6837","nonce":972467119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/2124959631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2124959631},{"type":"v1","addr":"172.21.15.38:6834","nonce":2124959631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:46:11.013927+0000","modified":"2023-12-22T08:46:14.032400+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/2733146003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2733146003},{"type":"v1","addr":"172.21.15.38:6835","nonce":2733146003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-22T08:46:41.372 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 47 2023-12-22T08:46:41.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.373+0000 7fadd6e15640 1 -- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fadb406a430 msgr2=0x7fadb406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:41.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.373+0000 7fadd6e15640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fadb406a430 0x7fadb406c8f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fadcc005880 tx=0x7fadcc009040 comp rx=0 tx=0).stop 2023-12-22T08:46:41.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.373+0000 7fadd6e15640 1 -- 172.21.15.38:0/2734787696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadd00b44a0 msgr2=0x7fadd0157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:41.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.373+0000 7fadd6e15640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadd00b44a0 0x7fadd0157fa0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fadc000d800 tx=0x7fadc000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:46:41.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.373+0000 7fadd6e15640 1 -- 172.21.15.38:0/2734787696 shutdown_connections 2023-12-22T08:46:41.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.373+0000 7fadd6e15640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadd0157980 0x7fadd00b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:41.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.373+0000 7fadd6e15640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fadb406a430 0x7fadb406c8f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:41.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.373+0000 7fadd6e15640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadd00b44a0 0x7fadd0157fa0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:41.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.373+0000 7fadd6e15640 1 --2- 172.21.15.38:0/2734787696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadd00b3ff0 0x7fadd01f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:41.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.373+0000 7fadd6e15640 1 -- 172.21.15.38:0/2734787696 >> 172.21.15.38:0/2734787696 conn(0x7fadd00d31f0 msgr2=0x7fadd015e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:41.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.373+0000 7fadd6e15640 1 -- 172.21.15.38:0/2734787696 shutdown_connections 2023-12-22T08:46:41.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:41.373+0000 7fadd6e15640 1 -- 172.21.15.38:0/2734787696 wait complete. 2023-12-22T08:46:41.396 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-22T08:46:41.643 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":6867,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":30.606243882000001,"mdsmap_epoch":47,"osdmap_epoch":115,"osdmap_epoch_barrier":112,"uptime":36.200487500000001} 2023-12-22T08:46:41.644 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 6867, "mdsmap_epoch": 47, "osdmap_epoch": 115, "osdmap_epoch_barrier": 112, "rank_uptime": 30.606243882, "state": "up:active", "uptime": 36.2004875, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:46:41.644 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-22T08:46:41.644 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:46:41.644 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:41.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:41.699 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-22T08:46:42.153 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records in 2023-12-22T08:46:42.154 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records out 2023-12-22T08:46:42.154 INFO:teuthology.orchestra.run.smithi038.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.390367 s, 134 MB/s 2023-12-22T08:46:42.155 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:46:42.155 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:46:42.271 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:46:42.395 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:46:42.395 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:46:42.395 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:42.461 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:46:42.461 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:42.515 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:46:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.725+0000 7fdc22095640 1 Processor -- start 2023-12-22T08:46:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.726+0000 7fdc22095640 1 -- start start 2023-12-22T08:46:42.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.727+0000 7fdc22095640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdc1c157980 0x7fdc1c15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:42.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.727+0000 7fdc22095640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc1c06d640 0x7fdc1c0d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:42.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.727+0000 7fdc22095640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1c0d1520 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.727+0000 7fdc22095640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1c0d1800 con 0x7fdc1c157980 2023-12-22T08:46:42.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.727+0000 7fdc22095640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1c0d1ae0 con 0x7fdc1c06d640 2023-12-22T08:46:42.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.728+0000 7fdc21093640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdc1c157980 0x7fdc1c15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:42.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.728+0000 7fdc21093640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdc1c157980 0x7fdc1c15eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45174/0 (socket says 172.21.15.38:45174) 2023-12-22T08:46:42.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.728+0000 7fdc21093640 1 -- 172.21.15.38:0/3294271664 learned_addr learned my addr 172.21.15.38:0/3294271664 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:42.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.728+0000 7fdc21894640 1 --2- 172.21.15.38:0/3294271664 >> v2:172.21.15.89:3300/0 conn(0x7fdc1c06d640 0x7fdc1c0d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:42.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.728+0000 7fdc21093640 1 -- 172.21.15.38:0/3294271664 >> v2:172.21.15.89:3300/0 conn(0x7fdc1c06d640 msgr2=0x7fdc1c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:42.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.728+0000 7fdc21093640 1 --2- 172.21.15.38:0/3294271664 >> v2:172.21.15.89:3300/0 conn(0x7fdc1c06d640 0x7fdc1c0d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:42.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.728+0000 7fdc21093640 1 -- 172.21.15.38:0/3294271664 >> v1:172.21.15.38:6789/0 conn(0x7fdc1c0b3ff0 legacy=0x7fdc1c06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:42.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.728+0000 7fdc13fff640 1 -- 172.21.15.38:0/3294271664 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209550249 0 0) 0x7fdc1c0d1520 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.728+0000 7fdc21093640 1 -- 172.21.15.38:0/3294271664 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c0d1dc0 con 0x7fdc1c157980 2023-12-22T08:46:42.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.728+0000 7fdc21894640 1 --2- 172.21.15.38:0/3294271664 >> v2:172.21.15.89:3300/0 conn(0x7fdc1c06d640 0x7fdc1c0d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:42.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.730+0000 7fdc21093640 1 --2- 172.21.15.38:0/3294271664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c157980 0x7fdc1c15eb10 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c06e5f0 tx=0x7fdc1802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6239e9a5074ea5b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:42.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.730+0000 7fdc13fff640 1 -- 172.21.15.38:0/3294271664 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18030860 con 0x7fdc1c157980 2023-12-22T08:46:42.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.730+0000 7fdc13fff640 1 -- 172.21.15.38:0/3294271664 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc180309c0 con 0x7fdc1c157980 2023-12-22T08:46:42.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.730+0000 7fdc13fff640 1 -- 172.21.15.38:0/3294271664 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18030d50 con 0x7fdc1c157980 2023-12-22T08:46:42.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.730+0000 7fdc22095640 1 -- 172.21.15.38:0/3294271664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c157980 msgr2=0x7fdc1c15eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:42.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.730+0000 7fdc22095640 1 --2- 172.21.15.38:0/3294271664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c157980 0x7fdc1c15eb10 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c06e5f0 tx=0x7fdc1802b9a0 comp rx=0 tx=0).stop 2023-12-22T08:46:42.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.731+0000 7fdc22095640 1 -- 172.21.15.38:0/3294271664 shutdown_connections 2023-12-22T08:46:42.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.731+0000 7fdc22095640 1 --2- 172.21.15.38:0/3294271664 >> v2:172.21.15.89:3300/0 conn(0x7fdc1c06d640 0x7fdc1c0d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:42.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.731+0000 7fdc22095640 1 --2- 172.21.15.38:0/3294271664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c157980 0x7fdc1c15eb10 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:42.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.731+0000 7fdc22095640 1 -- 172.21.15.38:0/3294271664 >> 172.21.15.38:0/3294271664 conn(0x7fdc1c0d31f0 msgr2=0x7fdc1c0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:42.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.731+0000 7fdc22095640 1 -- 172.21.15.38:0/3294271664 shutdown_connections 2023-12-22T08:46:42.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.731+0000 7fdc22095640 1 -- 172.21.15.38:0/3294271664 wait complete. 2023-12-22T08:46:42.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.732+0000 7fdc22095640 1 Processor -- start 2023-12-22T08:46:42.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.733+0000 7fdc22095640 1 -- start start 2023-12-22T08:46:42.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.733+0000 7fdc22095640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c06d640 0x7fdc1c161120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:42.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc22095640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c0b3ff0 0x7fdc1c153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:42.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc22095640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c157980 0x7fdc1c155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:42.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc22095640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c1538a0 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc22095640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c161700 con 0x7fdc1c157980 2023-12-22T08:46:42.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc22095640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c1619e0 con 0x7fdc1c06d640 2023-12-22T08:46:42.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc20892640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c0b3ff0 0x7fdc1c153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:42.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc20892640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c0b3ff0 0x7fdc1c153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45178/0 (socket says 172.21.15.38:45178) 2023-12-22T08:46:42.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc20892640 1 -- 172.21.15.38:0/4262761679 learned_addr learned my addr 172.21.15.38:0/4262761679 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:42.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc21894640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c157980 0x7fdc1c155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:42.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc21093640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c06d640 0x7fdc1c161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:42.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc20892640 1 -- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c06d640 msgr2=0x7fdc1c161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:42.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc20892640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c06d640 0x7fdc1c161120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc20892640 1 -- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c157980 msgr2=0x7fdc1c155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc20892640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c157980 0x7fdc1c155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc20892640 1 -- 172.21.15.38:0/4262761679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180094d0 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.734+0000 7fdc21093640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c06d640 0x7fdc1c161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.735+0000 7fdc20892640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c0b3ff0 0x7fdc1c153060 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00c4b0 tx=0x7fdc0c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.735+0000 7fdc11ffb640 1 -- 172.21.15.38:0/4262761679 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c005480 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.735+0000 7fdc11ffb640 1 -- 172.21.15.38:0/4262761679 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c0035f0 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.735+0000 7fdc22095640 1 -- 172.21.15.38:0/4262761679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1c161cc0 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.735+0000 7fdc11ffb640 1 -- 172.21.15.38:0/4262761679 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c0039e0 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.735+0000 7fdc22095640 1 -- 172.21.15.38:0/4262761679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1c1535a0 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.736+0000 7fdc22095640 1 -- 172.21.15.38:0/4262761679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1c061910 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.737+0000 7fdc11ffb640 1 -- 172.21.15.38:0/4262761679 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc0c003b40 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.738+0000 7fdc11ffb640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:42.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.738+0000 7fdc11ffb640 1 -- 172.21.15.38:0/4262761679 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc0c087fe0 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.739+0000 7fdc21093640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:42.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.740+0000 7fdc21093640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc0006a430 0x7fdc0006c8f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdc18036000 tx=0x7fdc1803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:42.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.743+0000 7fdc11ffb640 1 -- 172.21.15.38:0/4262761679 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdc0c053530 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.940+0000 7fdc22095640 1 -- 172.21.15.38:0/4262761679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc1c06f6c0 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.943+0000 7fdc11ffb640 1 -- 172.21.15.38:0/4262761679 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16068 (secure 0 0 0) 0x7fdc0c017020 con 0x7fdc1c0b3ff0 2023-12-22T08:46:42.945 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:42.945 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":115,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:46:38.242259+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:46:08.930859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-22T08:46:10.036922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:46:42.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.946+0000 7fdc22095640 1 -- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc0006a430 msgr2=0x7fdc0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:42.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.946+0000 7fdc22095640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc0006a430 0x7fdc0006c8f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdc18036000 tx=0x7fdc1803b040 comp rx=0 tx=0).stop 2023-12-22T08:46:42.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.946+0000 7fdc22095640 1 -- 172.21.15.38:0/4262761679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c0b3ff0 msgr2=0x7fdc1c153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:42.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.946+0000 7fdc22095640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c0b3ff0 0x7fdc1c153060 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00c4b0 tx=0x7fdc0c00c970 comp rx=0 tx=0).stop 2023-12-22T08:46:42.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.946+0000 7fdc22095640 1 -- 172.21.15.38:0/4262761679 shutdown_connections 2023-12-22T08:46:42.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.946+0000 7fdc22095640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc1c157980 0x7fdc1c155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:42.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.946+0000 7fdc22095640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:42.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.946+0000 7fdc22095640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc1c0b3ff0 0x7fdc1c153060 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:42.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.946+0000 7fdc22095640 1 --2- 172.21.15.38:0/4262761679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc1c06d640 0x7fdc1c161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:42.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.946+0000 7fdc22095640 1 -- 172.21.15.38:0/4262761679 >> 172.21.15.38:0/4262761679 conn(0x7fdc1c0d31f0 msgr2=0x7fdc1c070040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:42.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.946+0000 7fdc22095640 1 -- 172.21.15.38:0/4262761679 shutdown_connections 2023-12-22T08:46:42.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:42.946+0000 7fdc22095640 1 -- 172.21.15.38:0/4262761679 wait complete. 2023-12-22T08:46:42.965 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:46:08.930859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:46:10.036922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:46:42.966 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:46:43.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.196+0000 7f917f700640 1 Processor -- start 2023-12-22T08:46:43.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.196+0000 7f917f700640 1 -- start start 2023-12-22T08:46:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.197+0000 7f917f700640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f917815a370 0x7f9178071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.197+0000 7f917f700640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f917815b3c0 0x7f9178071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.197+0000 7f917f700640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f917806c260 0x7f917806f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.197+0000 7f917f700640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917815b940 con 0x7f917815b3c0 2023-12-22T08:46:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.197+0000 7f917f700640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91780cd080 con 0x7f917815a370 2023-12-22T08:46:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.197+0000 7f917f700640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91780cd320 con 0x7f917806c260 2023-12-22T08:46:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.198+0000 7f917cc9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f917815b3c0 0x7f9178071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.198+0000 7f917cc9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f917815b3c0 0x7f9178071dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45188/0 (socket says 172.21.15.38:45188) 2023-12-22T08:46:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.198+0000 7f917cc9b640 1 -- 172.21.15.38:0/2038127095 learned_addr learned my addr 172.21.15.38:0/2038127095 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.198+0000 7f917d49c640 1 --2- 172.21.15.38:0/2038127095 >> v2:172.21.15.89:3300/0 conn(0x7f917815a370 0x7f9178071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.198+0000 7f917dc9d640 1 --2- 172.21.15.38:0/2038127095 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f917806c260 0x7f917806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.199+0000 7f917cc9b640 1 -- 172.21.15.38:0/2038127095 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f917806c260 msgr2=0x7f917806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.199+0000 7f917cc9b640 1 --2- 172.21.15.38:0/2038127095 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f917806c260 0x7f917806f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.199+0000 7f917cc9b640 1 -- 172.21.15.38:0/2038127095 >> v2:172.21.15.89:3300/0 conn(0x7f917815a370 msgr2=0x7f9178071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.199+0000 7f917cc9b640 1 --2- 172.21.15.38:0/2038127095 >> v2:172.21.15.89:3300/0 conn(0x7f917815a370 0x7f9178071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.199+0000 7f917cc9b640 1 -- 172.21.15.38:0/2038127095 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780cd600 con 0x7f917815b3c0 2023-12-22T08:46:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.200+0000 7f917cc9b640 1 --2- 172.21.15.38:0/2038127095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f917815b3c0 0x7f9178071dc0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f91780703c0 tx=0x7f916802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ed6f6eb6ab1cf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.200+0000 7f916ffff640 1 -- 172.21.15.38:0/2038127095 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168031870 con 0x7f917815b3c0 2023-12-22T08:46:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.200+0000 7f916ffff640 1 -- 172.21.15.38:0/2038127095 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91680319d0 con 0x7f917815b3c0 2023-12-22T08:46:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.200+0000 7f916ffff640 1 -- 172.21.15.38:0/2038127095 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168031d60 con 0x7f917815b3c0 2023-12-22T08:46:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.201+0000 7f917f700640 1 -- 172.21.15.38:0/2038127095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f917815b3c0 msgr2=0x7f9178071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.201+0000 7f917f700640 1 --2- 172.21.15.38:0/2038127095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f917815b3c0 0x7f9178071dc0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f91780703c0 tx=0x7f916802b910 comp rx=0 tx=0).stop 2023-12-22T08:46:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.201+0000 7f917f700640 1 -- 172.21.15.38:0/2038127095 shutdown_connections 2023-12-22T08:46:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.201+0000 7f917f700640 1 --2- 172.21.15.38:0/2038127095 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f917806c260 0x7f917806f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.201+0000 7f917f700640 1 --2- 172.21.15.38:0/2038127095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f917815b3c0 0x7f9178071dc0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.201+0000 7f917f700640 1 --2- 172.21.15.38:0/2038127095 >> v2:172.21.15.89:3300/0 conn(0x7f917815a370 0x7f9178071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.201+0000 7f917f700640 1 -- 172.21.15.38:0/2038127095 >> 172.21.15.38:0/2038127095 conn(0x7f91780b20c0 msgr2=0x7f91780b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.201+0000 7f917f700640 1 -- 172.21.15.38:0/2038127095 shutdown_connections 2023-12-22T08:46:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.201+0000 7f917f700640 1 -- 172.21.15.38:0/2038127095 wait complete. 2023-12-22T08:46:43.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.203+0000 7f917f700640 1 Processor -- start 2023-12-22T08:46:43.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.203+0000 7f917f700640 1 -- start start 2023-12-22T08:46:43.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.204+0000 7f917f700640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f917806c260 0x7f917814a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.204+0000 7f917f700640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f917815a370 0x7f91781553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.204+0000 7f917f700640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f917815b3c0 0x7f9178149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.204+0000 7f917f700640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917814bbe0 con 0x7f917806c260 2023-12-22T08:46:43.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.204+0000 7f917f700640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91781f6f50 con 0x7f917815a370 2023-12-22T08:46:43.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.204+0000 7f917f700640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91781f63d0 con 0x7f917815b3c0 2023-12-22T08:46:43.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.204+0000 7f917d49c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f917806c260 0x7f917814a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:43.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.204+0000 7f917d49c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f917806c260 0x7f917814a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45202/0 (socket says 172.21.15.38:45202) 2023-12-22T08:46:43.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.204+0000 7f917d49c640 1 -- 172.21.15.38:0/53872060 learned_addr learned my addr 172.21.15.38:0/53872060 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:43.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.205+0000 7f917dc9d640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f917815b3c0 0x7f9178149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:43.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.205+0000 7f917d49c640 1 -- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f917815b3c0 msgr2=0x7f9178149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:43.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.205+0000 7f917d49c640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f917815b3c0 0x7f9178149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.205+0000 7f917d49c640 1 -- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f917815a370 msgr2=0x7f91781553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:43.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.205+0000 7f917d49c640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f917815a370 0x7f91781553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.205+0000 7f917d49c640 1 -- 172.21.15.38:0/53872060 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91680094d0 con 0x7f917806c260 2023-12-22T08:46:43.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.205+0000 7f917dc9d640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f917815b3c0 0x7f9178149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:43.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.205+0000 7f917d49c640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f917806c260 0x7f917814a770 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f917400d830 tx=0x7f917400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:43.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.205+0000 7f916dffb640 1 -- 172.21.15.38:0/53872060 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917400b6c0 con 0x7f917806c260 2023-12-22T08:46:43.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.205+0000 7f916dffb640 1 -- 172.21.15.38:0/53872060 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917400b820 con 0x7f917806c260 2023-12-22T08:46:43.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.205+0000 7f917f700640 1 -- 172.21.15.38:0/53872060 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91781f66b0 con 0x7f917806c260 2023-12-22T08:46:43.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.206+0000 7f916dffb640 1 -- 172.21.15.38:0/53872060 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917400bbb0 con 0x7f917806c260 2023-12-22T08:46:43.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.206+0000 7f917f700640 1 -- 172.21.15.38:0/53872060 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91781f6c70 con 0x7f917806c260 2023-12-22T08:46:43.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.207+0000 7f917f700640 1 -- 172.21.15.38:0/53872060 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9178061910 con 0x7f917806c260 2023-12-22T08:46:43.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.208+0000 7f916dffb640 1 -- 172.21.15.38:0/53872060 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f917401e460 con 0x7f917806c260 2023-12-22T08:46:43.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.209+0000 7f916dffb640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f915c06a430 0x7f915c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.209+0000 7f916dffb640 1 -- 172.21.15.38:0/53872060 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9174089130 con 0x7f917806c260 2023-12-22T08:46:43.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.210+0000 7f917cc9b640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f915c06a430 0x7f915c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:43.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.211+0000 7f917cc9b640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f915c06a430 0x7f915c06c8f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9168036000 tx=0x7f9168030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:43.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.214+0000 7f916dffb640 1 -- 172.21.15.38:0/53872060 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9174054680 con 0x7f917806c260 2023-12-22T08:46:43.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.411+0000 7f917f700640 1 -- 172.21.15.38:0/53872060 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91780b45d0 con 0x7f917806c260 2023-12-22T08:46:43.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.412+0000 7f916dffb640 1 -- 172.21.15.38:0/53872060 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9174057ca0 con 0x7f917806c260 2023-12-22T08:46:43.413 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:46:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.414+0000 7f917f700640 1 -- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f915c06a430 msgr2=0x7f915c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.414+0000 7f917f700640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f915c06a430 0x7f915c06c8f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9168036000 tx=0x7f9168030000 comp rx=0 tx=0).stop 2023-12-22T08:46:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.414+0000 7f917f700640 1 -- 172.21.15.38:0/53872060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f917806c260 msgr2=0x7f917814a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.414+0000 7f917f700640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f917806c260 0x7f917814a770 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f917400d830 tx=0x7f917400dcf0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.414+0000 7f917f700640 1 -- 172.21.15.38:0/53872060 shutdown_connections 2023-12-22T08:46:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.414+0000 7f917f700640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f917815b3c0 0x7f9178149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.414+0000 7f917f700640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f917815a370 0x7f91781553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.414+0000 7f917f700640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f915c06a430 0x7f915c06c8f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.414+0000 7f917f700640 1 --2- 172.21.15.38:0/53872060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f917806c260 0x7f917814a770 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.414+0000 7f917f700640 1 -- 172.21.15.38:0/53872060 >> 172.21.15.38:0/53872060 conn(0x7f91780b20c0 msgr2=0x7f91780ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:43.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.414+0000 7f917f700640 1 -- 172.21.15.38:0/53872060 shutdown_connections 2023-12-22T08:46:43.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.414+0000 7f917f700640 1 -- 172.21.15.38:0/53872060 wait complete. 2023-12-22T08:46:43.434 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:46:43.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.644+0000 7f379af3d640 1 Processor -- start 2023-12-22T08:46:43.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.645+0000 7f379af3d640 1 -- start start 2023-12-22T08:46:43.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.646+0000 7f379af3d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379409c980 0x7f379415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.646+0000 7f379af3d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3794071460 0x7f37940718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.646+0000 7f379af3d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3794071df0 con 0x7f379415b0e0 2023-12-22T08:46:43.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.646+0000 7f379af3d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379415edf0 con 0x7f3794071460 2023-12-22T08:46:43.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.646+0000 7f379af3d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379415bd90 con 0x7f379409c980 2023-12-22T08:46:43.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.647+0000 7f3799f3b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f379415b0e0 0x7f379415b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41924/0 (socket says 172.21.15.38:41924) 2023-12-22T08:46:43.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.647+0000 7f3799f3b640 1 -- 172.21.15.38:0/2319391788 learned_addr learned my addr 172.21.15.38:0/2319391788 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:43.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.647+0000 7f379a73c640 1 --2- 172.21.15.38:0/2319391788 >> v2:172.21.15.89:3300/0 conn(0x7f3794071460 0x7f37940718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:43.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.647+0000 7f379973a640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379409c980 0x7f379415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:43.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.647+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239945886 0 0) 0x7f3790001110 con 0x7f379415b0e0 2023-12-22T08:46:43.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.647+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3780003520 con 0x7f379415b0e0 2023-12-22T08:46:43.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3280349665 0 0) 0x7f3780003520 con 0x7f379415b0e0 2023-12-22T08:46:43.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379409c980 msgr2=0x7f379415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:43.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379409c980 0x7f379415c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 >> v2:172.21.15.89:3300/0 conn(0x7f3794071460 msgr2=0x7f37940718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 --2- 172.21.15.38:0/2319391788 >> v2:172.21.15.89:3300/0 conn(0x7f3794071460 0x7f37940718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379415c070 con 0x7f379415b0e0 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f3790001800 con 0x7f379415b0e0 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 >> v1:172.21.15.38:6789/0 conn(0x7f379415b0e0 legacy=0x7f379415b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3780003970 0x7f3780003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379409c980 0x7f37800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3780004d00 0x7f3780005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379415edf0 con 0x7f3780004d00 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379415bd90 con 0x7f3780003970 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378000ba80 con 0x7f379409c980 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f379a73c640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3780004d00 0x7f3780005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f379973a640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379409c980 0x7f37800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.648+0000 7f3799f3b640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3780003970 0x7f3780003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.649+0000 7f379a73c640 1 -- 172.21.15.38:0/2319391788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379409c980 msgr2=0x7f37800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:43.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.649+0000 7f379a73c640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379409c980 0x7f37800047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.649+0000 7f379a73c640 1 -- 172.21.15.38:0/2319391788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3780003970 msgr2=0x7f3780003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:43.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.649+0000 7f379a73c640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3780003970 0x7f3780003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.649+0000 7f379a73c640 1 -- 172.21.15.38:0/2319391788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780003520 con 0x7f3780004d00 2023-12-22T08:46:43.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.649+0000 7f3799f3b640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3780003970 0x7f3780003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:46:43.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.649+0000 7f379973a640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379409c980 0x7f37800047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:46:43.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.650+0000 7f379a73c640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3780004d00 0x7f3780005180 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f378c009fc0 tx=0x7f37800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f9007099378283 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:43.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.650+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c02cc60 con 0x7f3780004d00 2023-12-22T08:46:43.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.650+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c00f040 con 0x7f3780004d00 2023-12-22T08:46:43.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.650+0000 7f3798f39640 1 -- 172.21.15.38:0/2319391788 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c034440 con 0x7f3780004d00 2023-12-22T08:46:43.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.651+0000 7f379af3d640 1 -- 172.21.15.38:0/2319391788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3780004d00 msgr2=0x7f3780005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:43.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.651+0000 7f379af3d640 1 --2- 172.21.15.38:0/2319391788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3780004d00 0x7f3780005180 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f378c009fc0 tx=0x7f37800057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.651+0000 7f379a73c640 1 -- 172.21.15.38:0/2319391788 reap_dead start 2023-12-22T08:46:43.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.651+0000 7f379af3d640 1 -- 172.21.15.38:0/2319391788 shutdown_connections 2023-12-22T08:46:43.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.651+0000 7f379af3d640 1 -- 172.21.15.38:0/2319391788 >> 172.21.15.38:0/2319391788 conn(0x7f37940cf000 msgr2=0x7f37940cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:43.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.651+0000 7f379af3d640 1 -- 172.21.15.38:0/2319391788 shutdown_connections 2023-12-22T08:46:43.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.651+0000 7f379af3d640 1 -- 172.21.15.38:0/2319391788 wait complete. 2023-12-22T08:46:43.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.653+0000 7f379af3d640 1 Processor -- start 2023-12-22T08:46:43.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.653+0000 7f379af3d640 1 -- start start 2023-12-22T08:46:43.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.654+0000 7f379af3d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3780004d00 0x7f379406fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.654+0000 7f379af3d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379415daa0 0x7f37941f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.654+0000 7f379af3d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379415df00 0x7f37941f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.654+0000 7f379af3d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3794071080 con 0x7f3780004d00 2023-12-22T08:46:43.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.654+0000 7f379af3d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37941f6a00 con 0x7f379415daa0 2023-12-22T08:46:43.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.654+0000 7f379af3d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37941f6ce0 con 0x7f379415df00 2023-12-22T08:46:43.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.654+0000 7f3799f3b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3780004d00 0x7f379406fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:43.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.654+0000 7f3799f3b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3780004d00 0x7f379406fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45220/0 (socket says 172.21.15.38:45220) 2023-12-22T08:46:43.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.654+0000 7f3799f3b640 1 -- 172.21.15.38:0/4102746761 learned_addr learned my addr 172.21.15.38:0/4102746761 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:43.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.655+0000 7f3799f3b640 1 -- 172.21.15.38:0/4102746761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379415df00 msgr2=0x7f37941f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:43.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.655+0000 7f3799f3b640 1 --2- 172.21.15.38:0/4102746761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379415df00 0x7f37941f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.655+0000 7f3799f3b640 1 -- 172.21.15.38:0/4102746761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379415daa0 msgr2=0x7f37941f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:43.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.655+0000 7f3799f3b640 1 --2- 172.21.15.38:0/4102746761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379415daa0 0x7f37941f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.655+0000 7f3799f3b640 1 -- 172.21.15.38:0/4102746761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379406f2f0 con 0x7f3780004d00 2023-12-22T08:46:43.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.655+0000 7f3799f3b640 1 --2- 172.21.15.38:0/4102746761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3780004d00 0x7f379406fdd0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f379000e780 tx=0x7f379000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:43.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.655+0000 7f378a7fc640 1 -- 172.21.15.38:0/4102746761 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000ee30 con 0x7f3780004d00 2023-12-22T08:46:43.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.655+0000 7f378a7fc640 1 -- 172.21.15.38:0/4102746761 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379000c7f0 con 0x7f3780004d00 2023-12-22T08:46:43.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.655+0000 7f378a7fc640 1 -- 172.21.15.38:0/4102746761 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000cb80 con 0x7f3780004d00 2023-12-22T08:46:43.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.655+0000 7f379af3d640 1 -- 172.21.15.38:0/4102746761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379406f5d0 con 0x7f3780004d00 2023-12-22T08:46:43.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.655+0000 7f379af3d640 1 -- 172.21.15.38:0/4102746761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3794158150 con 0x7f3780004d00 2023-12-22T08:46:43.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.657+0000 7f379af3d640 1 -- 172.21.15.38:0/4102746761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379406faf0 con 0x7f3780004d00 2023-12-22T08:46:43.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.657+0000 7f378a7fc640 1 -- 172.21.15.38:0/4102746761 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f379000cce0 con 0x7f3780004d00 2023-12-22T08:46:43.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.658+0000 7f378a7fc640 1 --2- 172.21.15.38:0/4102746761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f377806a430 0x7f377806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.658+0000 7f378a7fc640 1 -- 172.21.15.38:0/4102746761 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3790088770 con 0x7f3780004d00 2023-12-22T08:46:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.659+0000 7f379973a640 1 --2- 172.21.15.38:0/4102746761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f377806a430 0x7f377806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.660+0000 7f379973a640 1 --2- 172.21.15.38:0/4102746761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f377806a430 0x7f377806c8f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3794099e20 tx=0x7f3784008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:43.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.663+0000 7f378a7fc640 1 -- 172.21.15.38:0/4102746761 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f379406faf0 con 0x7f3780004d00 2023-12-22T08:46:43.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.856+0000 7f379af3d640 1 -- 172.21.15.38:0/4102746761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3794071df0 con 0x7f3780004d00 2023-12-22T08:46:43.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.857+0000 7f378a7fc640 1 -- 172.21.15.38:0/4102746761 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3794071df0 con 0x7f3780004d00 2023-12-22T08:46:43.859 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:46:43.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.860+0000 7f379af3d640 1 -- 172.21.15.38:0/4102746761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f377806a430 msgr2=0x7f377806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:43.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.860+0000 7f379af3d640 1 --2- 172.21.15.38:0/4102746761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f377806a430 0x7f377806c8f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3794099e20 tx=0x7f3784008040 comp rx=0 tx=0).stop 2023-12-22T08:46:43.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.860+0000 7f379af3d640 1 -- 172.21.15.38:0/4102746761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3780004d00 msgr2=0x7f379406fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:43.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.860+0000 7f379af3d640 1 --2- 172.21.15.38:0/4102746761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3780004d00 0x7f379406fdd0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f379000e780 tx=0x7f379000ec40 comp rx=0 tx=0).stop 2023-12-22T08:46:43.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.860+0000 7f379af3d640 1 -- 172.21.15.38:0/4102746761 shutdown_connections 2023-12-22T08:46:43.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.860+0000 7f379af3d640 1 --2- 172.21.15.38:0/4102746761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f379415df00 0x7f37941f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.860+0000 7f379af3d640 1 --2- 172.21.15.38:0/4102746761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379415daa0 0x7f37941f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.860+0000 7f379af3d640 1 --2- 172.21.15.38:0/4102746761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f377806a430 0x7f377806c8f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.860+0000 7f379af3d640 1 --2- 172.21.15.38:0/4102746761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3780004d00 0x7f379406fdd0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:43.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.860+0000 7f379af3d640 1 -- 172.21.15.38:0/4102746761 >> 172.21.15.38:0/4102746761 conn(0x7f37940cf000 msgr2=0x7f37941596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:43.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.861+0000 7f379af3d640 1 -- 172.21.15.38:0/4102746761 shutdown_connections 2023-12-22T08:46:43.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:43.861+0000 7f379af3d640 1 -- 172.21.15.38:0/4102746761 wait complete. 2023-12-22T08:46:43.881 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:46:44.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.107+0000 7f1d357a4640 1 Processor -- start 2023-12-22T08:46:44.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.107+0000 7f1d357a4640 1 -- start start 2023-12-22T08:46:44.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.109+0000 7f1d357a4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1d3015ec50 0x7f1d300ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:44.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.109+0000 7f1d357a4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d30070e80 0x7f1d3006f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:44.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.109+0000 7f1d357a4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d300ce4b0 con 0x7f1d3015e870 2023-12-22T08:46:44.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.109+0000 7f1d357a4640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3015fea0 con 0x7f1d3015ec50 2023-12-22T08:46:44.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.109+0000 7f1d357a4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300cdb80 con 0x7f1d30070e80 2023-12-22T08:46:44.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.110+0000 7f1d2e7fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1d3015ec50 0x7f1d300ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:44.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.110+0000 7f1d2effd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1d3015e870 0x7f1d30070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41934/0 (socket says 172.21.15.38:41934) 2023-12-22T08:46:44.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.110+0000 7f1d2effd640 1 -- 172.21.15.38:0/4098391394 learned_addr learned my addr 172.21.15.38:0/4098391394 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:44.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.110+0000 7f1d2f7fe640 1 --2- 172.21.15.38:0/4098391394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d30070e80 0x7f1d3006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:44.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.110+0000 7f1d2e7fc640 1 -- 172.21.15.38:0/4098391394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d30070e80 msgr2=0x7f1d3006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:44.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.110+0000 7f1d2e7fc640 1 --2- 172.21.15.38:0/4098391394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d30070e80 0x7f1d3006f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.110+0000 7f1d2e7fc640 1 -- 172.21.15.38:0/4098391394 >> v1:172.21.15.38:6789/0 conn(0x7f1d3015e870 legacy=0x7f1d30070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:44.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.110+0000 7f1d2e7fc640 1 -- 172.21.15.38:0/4098391394 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d300cde60 con 0x7f1d3015ec50 2023-12-22T08:46:44.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.110+0000 7f1d2dffb640 1 -- 172.21.15.38:0/4098391394 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089395716 0 0) 0x7f1d300ce4b0 con 0x7f1d3015e870 2023-12-22T08:46:44.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.111+0000 7f1d2e7fc640 1 --2- 172.21.15.38:0/4098391394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d3015ec50 0x7f1d300ce940 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f1d200097a0 tx=0x7f1d2002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd687855b5ccefd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:44.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.112+0000 7f1d2dffb640 1 -- 172.21.15.38:0/4098391394 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20031780 con 0x7f1d3015ec50 2023-12-22T08:46:44.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.112+0000 7f1d2dffb640 1 -- 172.21.15.38:0/4098391394 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d200318e0 con 0x7f1d3015ec50 2023-12-22T08:46:44.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.112+0000 7f1d2dffb640 1 -- 172.21.15.38:0/4098391394 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20031c70 con 0x7f1d3015ec50 2023-12-22T08:46:44.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.112+0000 7f1d357a4640 1 -- 172.21.15.38:0/4098391394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d3015ec50 msgr2=0x7f1d300ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:44.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.112+0000 7f1d357a4640 1 --2- 172.21.15.38:0/4098391394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d3015ec50 0x7f1d300ce940 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f1d200097a0 tx=0x7f1d2002b820 comp rx=0 tx=0).stop 2023-12-22T08:46:44.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.113+0000 7f1d357a4640 1 -- 172.21.15.38:0/4098391394 shutdown_connections 2023-12-22T08:46:44.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.113+0000 7f1d357a4640 1 --2- 172.21.15.38:0/4098391394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d30070e80 0x7f1d3006f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.113+0000 7f1d357a4640 1 --2- 172.21.15.38:0/4098391394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d3015ec50 0x7f1d300ce940 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.113+0000 7f1d357a4640 1 -- 172.21.15.38:0/4098391394 >> 172.21.15.38:0/4098391394 conn(0x7f1d300b20c0 msgr2=0x7f1d300b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:44.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.113+0000 7f1d357a4640 1 -- 172.21.15.38:0/4098391394 shutdown_connections 2023-12-22T08:46:44.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.113+0000 7f1d357a4640 1 -- 172.21.15.38:0/4098391394 wait complete. 2023-12-22T08:46:44.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.115+0000 7f1d357a4640 1 Processor -- start 2023-12-22T08:46:44.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.115+0000 7f1d357a4640 1 -- start start 2023-12-22T08:46:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.116+0000 7f1d357a4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d30070e80 0x7f1d301f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.116+0000 7f1d357a4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d3015e870 0x7f1d301f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.116+0000 7f1d357a4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d3015ec50 0x7f1d3006d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.116+0000 7f1d357a4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3015b850 con 0x7f1d3015ec50 2023-12-22T08:46:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.116+0000 7f1d357a4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3015bb30 con 0x7f1d3015e870 2023-12-22T08:46:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.116+0000 7f1d357a4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3015be10 con 0x7f1d30070e80 2023-12-22T08:46:44.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.116+0000 7f1d2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d3015ec50 0x7f1d3006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:44.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.116+0000 7f1d2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d3015ec50 0x7f1d3006d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45242/0 (socket says 172.21.15.38:45242) 2023-12-22T08:46:44.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.116+0000 7f1d2f7fe640 1 -- 172.21.15.38:0/1551127623 learned_addr learned my addr 172.21.15.38:0/1551127623 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:44.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.117+0000 7f1d2effd640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d30070e80 0x7f1d301f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:44.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.117+0000 7f1d2e7fc640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d3015e870 0x7f1d301f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:44.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.117+0000 7f1d2f7fe640 1 -- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d30070e80 msgr2=0x7f1d301f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:44.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.117+0000 7f1d2f7fe640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d30070e80 0x7f1d301f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.117+0000 7f1d2f7fe640 1 -- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d3015e870 msgr2=0x7f1d301f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.117+0000 7f1d2f7fe640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d3015e870 0x7f1d301f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.117+0000 7f1d2f7fe640 1 -- 172.21.15.38:0/1551127623 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20009400 con 0x7f1d3015ec50 2023-12-22T08:46:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.117+0000 7f1d2e7fc640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d3015e870 0x7f1d301f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.117+0000 7f1d2f7fe640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d3015ec50 0x7f1d3006d170 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f1d28007de0 tx=0x7f1d2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.117+0000 7f1d277fe640 1 -- 172.21.15.38:0/1551127623 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28014620 con 0x7f1d3015ec50 2023-12-22T08:46:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.117+0000 7f1d277fe640 1 -- 172.21.15.38:0/1551127623 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2800ee90 con 0x7f1d3015ec50 2023-12-22T08:46:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.117+0000 7f1d357a4640 1 -- 172.21.15.38:0/1551127623 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3015c0f0 con 0x7f1d3015ec50 2023-12-22T08:46:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.118+0000 7f1d277fe640 1 -- 172.21.15.38:0/1551127623 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280149e0 con 0x7f1d3015ec50 2023-12-22T08:46:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.118+0000 7f1d357a4640 1 -- 172.21.15.38:0/1551127623 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d301f5ef0 con 0x7f1d3015ec50 2023-12-22T08:46:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.119+0000 7f1d357a4640 1 -- 172.21.15.38:0/1551127623 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3015c610 con 0x7f1d3015ec50 2023-12-22T08:46:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.120+0000 7f1d277fe640 1 -- 172.21.15.38:0/1551127623 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1d28014b40 con 0x7f1d3015ec50 2023-12-22T08:46:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.121+0000 7f1d277fe640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d1006a430 0x7f1d1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.121+0000 7f1d277fe640 1 -- 172.21.15.38:0/1551127623 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d280893f0 con 0x7f1d3015ec50 2023-12-22T08:46:44.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.121+0000 7f1d2effd640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d1006a430 0x7f1d1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:44.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.122+0000 7f1d2effd640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d1006a430 0x7f1d1006c8f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1d18000f60 tx=0x7f1d18007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:44.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.125+0000 7f1d277fe640 1 -- 172.21.15.38:0/1551127623 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1d3015c610 con 0x7f1d3015ec50 2023-12-22T08:46:44.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.318+0000 7f1d357a4640 1 -- 172.21.15.38:0/1551127623 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d3015c610 con 0x7f1d3015ec50 2023-12-22T08:46:44.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.321+0000 7f1d277fe640 1 -- 172.21.15.38:0/1551127623 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1d3015c610 con 0x7f1d3015ec50 2023-12-22T08:46:44.322 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:46:44.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.324+0000 7f1d357a4640 1 -- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d1006a430 msgr2=0x7f1d1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.324+0000 7f1d357a4640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d1006a430 0x7f1d1006c8f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1d18000f60 tx=0x7f1d18007b50 comp rx=0 tx=0).stop 2023-12-22T08:46:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.324+0000 7f1d357a4640 1 -- 172.21.15.38:0/1551127623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d3015ec50 msgr2=0x7f1d3006d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.324+0000 7f1d357a4640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d3015ec50 0x7f1d3006d170 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f1d28007de0 tx=0x7f1d2800e4b0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.324+0000 7f1d357a4640 1 -- 172.21.15.38:0/1551127623 shutdown_connections 2023-12-22T08:46:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.324+0000 7f1d357a4640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d1006a430 0x7f1d1006c8f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.324+0000 7f1d357a4640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d3015ec50 0x7f1d3006d170 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.324+0000 7f1d357a4640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d3015e870 0x7f1d301f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.324+0000 7f1d357a4640 1 --2- 172.21.15.38:0/1551127623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d30070e80 0x7f1d301f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.324+0000 7f1d357a4640 1 -- 172.21.15.38:0/1551127623 >> 172.21.15.38:0/1551127623 conn(0x7f1d300b20c0 msgr2=0x7f1d300aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.324+0000 7f1d357a4640 1 -- 172.21.15.38:0/1551127623 shutdown_connections 2023-12-22T08:46:44.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.324+0000 7f1d357a4640 1 -- 172.21.15.38:0/1551127623 wait complete. 2023-12-22T08:46:44.345 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:46:44.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.573+0000 7fd00adc1640 1 Processor -- start 2023-12-22T08:46:44.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.573+0000 7fd00adc1640 1 -- start start 2023-12-22T08:46:44.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.574+0000 7fd00adc1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd00406e060 0x7fd004071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:44.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.574+0000 7fd00adc1640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd00409ba90 0x7fd00409bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.574+0000 7fd00adc1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0040ccc50 con 0x7fd00406dc80 2023-12-22T08:46:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.574+0000 7fd00adc1640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd004070980 con 0x7fd00409ba90 2023-12-22T08:46:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.574+0000 7fd00adc1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd004070b90 con 0x7fd00406e060 2023-12-22T08:46:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.574+0000 7fd00a5c0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd00409ba90 0x7fd00409bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.575+0000 7fd00a5c0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd00409ba90 0x7fd00409bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45258/0 (socket says 172.21.15.38:45258) 2023-12-22T08:46:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.575+0000 7fd00a5c0640 1 -- 172.21.15.38:0/630750887 learned_addr learned my addr 172.21.15.38:0/630750887 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.575+0000 7fd0095be640 1 --2- 172.21.15.38:0/630750887 >> v2:172.21.15.89:3300/0 conn(0x7fd00406e060 0x7fd004071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.575+0000 7fd00a5c0640 1 -- 172.21.15.38:0/630750887 >> v2:172.21.15.89:3300/0 conn(0x7fd00406e060 msgr2=0x7fd004071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.575+0000 7fd00a5c0640 1 --2- 172.21.15.38:0/630750887 >> v2:172.21.15.89:3300/0 conn(0x7fd00406e060 0x7fd004071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.575+0000 7fd00a5c0640 1 -- 172.21.15.38:0/630750887 >> v1:172.21.15.89:6789/0 conn(0x7fd00406dc80 legacy=0x7fd0040cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.575+0000 7fd00a5c0640 1 -- 172.21.15.38:0/630750887 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd004070e70 con 0x7fd00409ba90 2023-12-22T08:46:44.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.577+0000 7fd00a5c0640 1 --2- 172.21.15.38:0/630750887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00409ba90 0x7fd00409bee0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd0040cfda0 tx=0x7fcffc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6f777e0260d2e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:44.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.577+0000 7fd008dbd640 1 -- 172.21.15.38:0/630750887 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc02ca80 con 0x7fd00409ba90 2023-12-22T08:46:44.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.577+0000 7fd008dbd640 1 -- 172.21.15.38:0/630750887 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc02cbe0 con 0x7fd00409ba90 2023-12-22T08:46:44.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.577+0000 7fd008dbd640 1 -- 172.21.15.38:0/630750887 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0343f0 con 0x7fd00409ba90 2023-12-22T08:46:44.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.578+0000 7fd00adc1640 1 -- 172.21.15.38:0/630750887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00409ba90 msgr2=0x7fd00409bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:44.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.578+0000 7fd00adc1640 1 --2- 172.21.15.38:0/630750887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00409ba90 0x7fd00409bee0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd0040cfda0 tx=0x7fcffc02bee0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.578+0000 7fd00adc1640 1 -- 172.21.15.38:0/630750887 shutdown_connections 2023-12-22T08:46:44.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.578+0000 7fd00adc1640 1 --2- 172.21.15.38:0/630750887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00409ba90 0x7fd00409bee0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.578+0000 7fd00adc1640 1 --2- 172.21.15.38:0/630750887 >> v2:172.21.15.89:3300/0 conn(0x7fd00406e060 0x7fd004071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.578+0000 7fd00adc1640 1 -- 172.21.15.38:0/630750887 >> 172.21.15.38:0/630750887 conn(0x7fd0040cf000 msgr2=0x7fd0040cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:44.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.578+0000 7fd00adc1640 1 -- 172.21.15.38:0/630750887 shutdown_connections 2023-12-22T08:46:44.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.578+0000 7fd00adc1640 1 -- 172.21.15.38:0/630750887 wait complete. 2023-12-22T08:46:44.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.580+0000 7fd00adc1640 1 Processor -- start 2023-12-22T08:46:44.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.580+0000 7fd00adc1640 1 -- start start 2023-12-22T08:46:44.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd00adc1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00406dc80 0x7fd00406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:44.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd00adc1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd00406e060 0x7fd00406cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:44.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd00adc1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd00409ba90 0x7fd00414d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:44.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd00adc1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0041559b0 con 0x7fd00406dc80 2023-12-22T08:46:44.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd00adc1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd004151fe0 con 0x7fd00406e060 2023-12-22T08:46:44.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd00adc1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0040a2160 con 0x7fd00409ba90 2023-12-22T08:46:44.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd009dbf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00406dc80 0x7fd00406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:44.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd009dbf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00406dc80 0x7fd00406c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45270/0 (socket says 172.21.15.38:45270) 2023-12-22T08:46:44.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd009dbf640 1 -- 172.21.15.38:0/3214205029 learned_addr learned my addr 172.21.15.38:0/3214205029 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:44.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd00a5c0640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd00409ba90 0x7fd00414d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:44.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd009dbf640 1 -- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd00409ba90 msgr2=0x7fd00414d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:44.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd009dbf640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd00409ba90 0x7fd00414d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd009dbf640 1 -- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd00406e060 msgr2=0x7fd00406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:44.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd009dbf640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd00406e060 0x7fd00406cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd009dbf640 1 -- 172.21.15.38:0/3214205029 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc009b30 con 0x7fd00406dc80 2023-12-22T08:46:44.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.581+0000 7fd00a5c0640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd00409ba90 0x7fd00414d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:44.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.582+0000 7fd009dbf640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00406dc80 0x7fd00406c8a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd00000c430 tx=0x7fd00000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:44.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.582+0000 7fcffa7fc640 1 -- 172.21.15.38:0/3214205029 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000011790 con 0x7fd00406dc80 2023-12-22T08:46:44.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.582+0000 7fcffa7fc640 1 -- 172.21.15.38:0/3214205029 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0000118f0 con 0x7fd00406dc80 2023-12-22T08:46:44.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.582+0000 7fcffa7fc640 1 -- 172.21.15.38:0/3214205029 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000011ce0 con 0x7fd00406dc80 2023-12-22T08:46:44.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.582+0000 7fd00adc1640 1 -- 172.21.15.38:0/3214205029 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0040a2440 con 0x7fd00406dc80 2023-12-22T08:46:44.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.582+0000 7fd00adc1640 1 -- 172.21.15.38:0/3214205029 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00414e990 con 0x7fd00406dc80 2023-12-22T08:46:44.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.583+0000 7fd00adc1640 1 -- 172.21.15.38:0/3214205029 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0040707a0 con 0x7fd00406dc80 2023-12-22T08:46:44.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.584+0000 7fcffa7fc640 1 -- 172.21.15.38:0/3214205029 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd00001c460 con 0x7fd00406dc80 2023-12-22T08:46:44.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.585+0000 7fcffa7fc640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfe806a430 0x7fcfe806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:44.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.585+0000 7fcffa7fc640 1 -- 172.21.15.38:0/3214205029 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd000088930 con 0x7fd00406dc80 2023-12-22T08:46:44.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.586+0000 7fd0095be640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfe806a430 0x7fcfe806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:44.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.587+0000 7fd0095be640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfe806a430 0x7fcfe806c8f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcff4006fd0 tx=0x7fcff4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:44.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.590+0000 7fcffa7fc640 1 -- 172.21.15.38:0/3214205029 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd000053f10 con 0x7fd00406dc80 2023-12-22T08:46:44.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.801+0000 7fd00adc1640 1 -- 172.21.15.38:0/3214205029 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd004061910 con 0x7fd00406dc80 2023-12-22T08:46:44.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.802+0000 7fcffa7fc640 1 -- 172.21.15.38:0/3214205029 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v115) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd000057530 con 0x7fd00406dc80 2023-12-22T08:46:44.803 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:46:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.804+0000 7fd00adc1640 1 -- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfe806a430 msgr2=0x7fcfe806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.804+0000 7fd00adc1640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfe806a430 0x7fcfe806c8f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcff4006fd0 tx=0x7fcff4008040 comp rx=0 tx=0).stop 2023-12-22T08:46:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.804+0000 7fd00adc1640 1 -- 172.21.15.38:0/3214205029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00406dc80 msgr2=0x7fd00406c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.804+0000 7fd00adc1640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00406dc80 0x7fd00406c8a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd00000c430 tx=0x7fd00000c8f0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.804+0000 7fd00adc1640 1 -- 172.21.15.38:0/3214205029 shutdown_connections 2023-12-22T08:46:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.804+0000 7fd00adc1640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd00409ba90 0x7fd00414d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.804+0000 7fd00adc1640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd00406e060 0x7fd00406cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.804+0000 7fd00adc1640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfe806a430 0x7fcfe806c8f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.804+0000 7fd00adc1640 1 --2- 172.21.15.38:0/3214205029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd00406dc80 0x7fd00406c8a0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.804+0000 7fd00adc1640 1 -- 172.21.15.38:0/3214205029 >> 172.21.15.38:0/3214205029 conn(0x7fd0040cf000 msgr2=0x7fd004071570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.805+0000 7fd00adc1640 1 -- 172.21.15.38:0/3214205029 shutdown_connections 2023-12-22T08:46:44.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:44.805+0000 7fd00adc1640 1 -- 172.21.15.38:0/3214205029 wait complete. 2023-12-22T08:46:44.826 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T08:46:44.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:44.826 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-22T08:46:44.986 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:46:44.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:44.986 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T08:46:45.033 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:46:45.034 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:45.080 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:46:45.080 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:45.175 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:46:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.406+0000 7f7839177640 1 Processor -- start 2023-12-22T08:46:45.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.406+0000 7f7839177640 1 -- start start 2023-12-22T08:46:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.408+0000 7f7839177640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415b420 0x7f783406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.408+0000 7f7839177640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f78340a44a0 0x7f78340708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.408+0000 7f7839177640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78340cdae0 con 0x7f7834070e30 2023-12-22T08:46:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.408+0000 7f7839177640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7834071260 con 0x7f78340a44a0 2023-12-22T08:46:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.408+0000 7f7839177640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783406dec0 con 0x7f783415b420 2023-12-22T08:46:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.408+0000 7f782bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f78340a44a0 0x7f78340708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.408+0000 7f782bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f78340a44a0 0x7f78340708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45278/0 (socket says 172.21.15.38:45278) 2023-12-22T08:46:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.408+0000 7f782bfff640 1 -- 172.21.15.38:0/2060865422 learned_addr learned my addr 172.21.15.38:0/2060865422 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.409+0000 7f7833fff640 1 --2- 172.21.15.38:0/2060865422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415b420 0x7f783406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.409+0000 7f782bfff640 1 -- 172.21.15.38:0/2060865422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415b420 msgr2=0x7f783406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:45.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.409+0000 7f782bfff640 1 --2- 172.21.15.38:0/2060865422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415b420 0x7f783406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.409+0000 7f782bfff640 1 -- 172.21.15.38:0/2060865422 >> v1:172.21.15.89:6789/0 conn(0x7f7834070e30 legacy=0x7f783406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:45.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.409+0000 7f782bfff640 1 -- 172.21.15.38:0/2060865422 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783415b800 con 0x7f78340a44a0 2023-12-22T08:46:45.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.410+0000 7f782bfff640 1 --2- 172.21.15.38:0/2060865422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78340a44a0 0x7f78340708f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f781c009870 tx=0x7f781c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8de9c795aa5d83 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:45.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.410+0000 7f78337fe640 1 -- 172.21.15.38:0/2060865422 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c031640 con 0x7f78340a44a0 2023-12-22T08:46:45.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.410+0000 7f78337fe640 1 -- 172.21.15.38:0/2060865422 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c0317a0 con 0x7f78340a44a0 2023-12-22T08:46:45.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.410+0000 7f78337fe640 1 -- 172.21.15.38:0/2060865422 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c031b30 con 0x7f78340a44a0 2023-12-22T08:46:45.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.411+0000 7f7839177640 1 -- 172.21.15.38:0/2060865422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78340a44a0 msgr2=0x7f78340708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:45.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.411+0000 7f7839177640 1 --2- 172.21.15.38:0/2060865422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78340a44a0 0x7f78340708f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f781c009870 tx=0x7f781c02b8f0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.411+0000 7f7839177640 1 -- 172.21.15.38:0/2060865422 shutdown_connections 2023-12-22T08:46:45.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.411+0000 7f7839177640 1 --2- 172.21.15.38:0/2060865422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78340a44a0 0x7f78340708f0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.411+0000 7f7839177640 1 --2- 172.21.15.38:0/2060865422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415b420 0x7f783406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.411+0000 7f7839177640 1 -- 172.21.15.38:0/2060865422 >> 172.21.15.38:0/2060865422 conn(0x7f78340b1f70 msgr2=0x7f78340b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:45.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.411+0000 7f7839177640 1 -- 172.21.15.38:0/2060865422 shutdown_connections 2023-12-22T08:46:45.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.411+0000 7f7839177640 1 -- 172.21.15.38:0/2060865422 wait complete. 2023-12-22T08:46:45.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.413+0000 7f7839177640 1 Processor -- start 2023-12-22T08:46:45.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.413+0000 7f7839177640 1 -- start start 2023-12-22T08:46:45.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.414+0000 7f7839177640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7834070e30 0x7f78340cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:45.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.414+0000 7f7839177640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340a44a0 0x7f783414b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:45.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.414+0000 7f7839177640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415b420 0x7f783414c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:45.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.414+0000 7f7839177640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783414ce60 con 0x7f7834070e30 2023-12-22T08:46:45.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.414+0000 7f7839177640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783414d110 con 0x7f78340a44a0 2023-12-22T08:46:45.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.414+0000 7f7839177640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783414d3f0 con 0x7f783415b420 2023-12-22T08:46:45.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.414+0000 7f7833fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7834070e30 0x7f78340cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:45.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.414+0000 7f7833fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7834070e30 0x7f78340cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45284/0 (socket says 172.21.15.38:45284) 2023-12-22T08:46:45.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.414+0000 7f7833fff640 1 -- 172.21.15.38:0/3447339500 learned_addr learned my addr 172.21.15.38:0/3447339500 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:45.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.415+0000 7f782bfff640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340a44a0 0x7f783414b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:45.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.415+0000 7f7838976640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415b420 0x7f783414c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:45.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.415+0000 7f7833fff640 1 -- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415b420 msgr2=0x7f783414c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:45.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.415+0000 7f7833fff640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415b420 0x7f783414c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.415+0000 7f7833fff640 1 -- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340a44a0 msgr2=0x7f783414b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:45.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.415+0000 7f7833fff640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340a44a0 0x7f783414b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.415+0000 7f7833fff640 1 -- 172.21.15.38:0/3447339500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c0094d0 con 0x7f7834070e30 2023-12-22T08:46:45.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.415+0000 7f782bfff640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340a44a0 0x7f783414b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:46:45.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.415+0000 7f7833fff640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7834070e30 0x7f78340cced0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f782400d5f0 tx=0x7f782400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:45.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.416+0000 7f78317fa640 1 -- 172.21.15.38:0/3447339500 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240125f0 con 0x7f7834070e30 2023-12-22T08:46:45.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.416+0000 7f78317fa640 1 -- 172.21.15.38:0/3447339500 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7824012750 con 0x7f7834070e30 2023-12-22T08:46:45.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.416+0000 7f78317fa640 1 -- 172.21.15.38:0/3447339500 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824012b00 con 0x7f7834070e30 2023-12-22T08:46:45.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.416+0000 7f7839177640 1 -- 172.21.15.38:0/3447339500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783414d6d0 con 0x7f7834070e30 2023-12-22T08:46:45.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.416+0000 7f7839177640 1 -- 172.21.15.38:0/3447339500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783414dc90 con 0x7f7834070e30 2023-12-22T08:46:45.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.417+0000 7f7839177640 1 -- 172.21.15.38:0/3447339500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78340a0610 con 0x7f7834070e30 2023-12-22T08:46:45.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.418+0000 7f78317fa640 1 -- 172.21.15.38:0/3447339500 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7824012c60 con 0x7f7834070e30 2023-12-22T08:46:45.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.419+0000 7f78317fa640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f781406a430 0x7f781406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:45.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.419+0000 7f78317fa640 1 -- 172.21.15.38:0/3447339500 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7824088db0 con 0x7f7834070e30 2023-12-22T08:46:45.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.420+0000 7f782bfff640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f781406a430 0x7f781406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:45.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.421+0000 7f782bfff640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f781406a430 0x7f781406c8f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f781c036000 tx=0x7f781c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:45.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.424+0000 7f78317fa640 1 -- 172.21.15.38:0/3447339500 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f782408d070 con 0x7f7834070e30 2023-12-22T08:46:45.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.619+0000 7f7839177640 1 -- 172.21.15.38:0/3447339500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7834061910 con 0x7f7834070e30 2023-12-22T08:46:45.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.621+0000 7f78317fa640 1 -- 172.21.15.38:0/3447339500 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16068 (secure 0 0 0) 0x7f7824054390 con 0x7f7834070e30 2023-12-22T08:46:45.623 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:45.623 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":115,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:46:38.242259+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:46:08.930859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-22T08:46:10.036922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:46:45.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.624+0000 7f7839177640 1 -- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f781406a430 msgr2=0x7f781406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.624+0000 7f7839177640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f781406a430 0x7f781406c8f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f781c036000 tx=0x7f781c03c040 comp rx=0 tx=0).stop 2023-12-22T08:46:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.624+0000 7f7839177640 1 -- 172.21.15.38:0/3447339500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7834070e30 msgr2=0x7f78340cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.624+0000 7f7839177640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7834070e30 0x7f78340cced0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f782400d5f0 tx=0x7f782400dab0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.624+0000 7f7839177640 1 -- 172.21.15.38:0/3447339500 shutdown_connections 2023-12-22T08:46:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.624+0000 7f7839177640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415b420 0x7f783414c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.624+0000 7f7839177640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78340a44a0 0x7f783414b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.624+0000 7f7839177640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f781406a430 0x7f781406c8f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.624+0000 7f7839177640 1 --2- 172.21.15.38:0/3447339500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7834070e30 0x7f78340cced0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.624+0000 7f7839177640 1 -- 172.21.15.38:0/3447339500 >> 172.21.15.38:0/3447339500 conn(0x7f78340b1f70 msgr2=0x7f783406cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.624+0000 7f7839177640 1 -- 172.21.15.38:0/3447339500 shutdown_connections 2023-12-22T08:46:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.624+0000 7f7839177640 1 -- 172.21.15.38:0/3447339500 wait complete. 2023-12-22T08:46:45.646 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:46:08.930859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:46:10.036922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:46:45.646 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:46:45.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.858+0000 7fb156d9b640 1 Processor -- start 2023-12-22T08:46:45.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.858+0000 7fb156d9b640 1 -- start start 2023-12-22T08:46:45.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.860+0000 7fb156d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb15015d3e0 0x7fb15015b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:45.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.860+0000 7fb156d9b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15015a7b0 0x7fb15006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:45.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.860+0000 7fb156d9b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb150070360 con 0x7fb15015d7c0 2023-12-22T08:46:45.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.860+0000 7fb156d9b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb150070170 con 0x7fb15015d3e0 2023-12-22T08:46:45.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.860+0000 7fb156d9b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb150070640 con 0x7fb15015a7b0 2023-12-22T08:46:45.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.861+0000 7fb15659a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15015a7b0 0x7fb15006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:45.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.861+0000 7fb15659a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15015a7b0 0x7fb15006d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:48832/0 (socket says 172.21.15.38:48832) 2023-12-22T08:46:45.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.861+0000 7fb15659a640 1 -- 172.21.15.38:0/3829136111 learned_addr learned my addr 172.21.15.38:0/3829136111 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:45.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.861+0000 7fb155d99640 1 --2- 172.21.15.38:0/3829136111 >> v2:172.21.15.89:3300/0 conn(0x7fb15015d3e0 0x7fb15015b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:45.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.862+0000 7fb15659a640 1 -- 172.21.15.38:0/3829136111 >> v2:172.21.15.89:3300/0 conn(0x7fb15015d3e0 msgr2=0x7fb15015b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:45.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.862+0000 7fb15659a640 1 --2- 172.21.15.38:0/3829136111 >> v2:172.21.15.89:3300/0 conn(0x7fb15015d3e0 0x7fb15015b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.862+0000 7fb15659a640 1 -- 172.21.15.38:0/3829136111 >> v1:172.21.15.89:6789/0 conn(0x7fb15015d7c0 legacy=0x7fb15006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:45.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.862+0000 7fb15659a640 1 -- 172.21.15.38:0/3829136111 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150070920 con 0x7fb15015a7b0 2023-12-22T08:46:45.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.862+0000 7fb155d99640 1 --2- 172.21.15.38:0/3829136111 >> v2:172.21.15.89:3300/0 conn(0x7fb15015d3e0 0x7fb15015b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:46:45.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.864+0000 7fb15659a640 1 --2- 172.21.15.38:0/3829136111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15015a7b0 0x7fb15006d930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb14800d150 tx=0x7fb14802e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3359350f7df0fcf3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:45.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.864+0000 7fb154d97640 1 -- 172.21.15.38:0/3829136111 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14800b0d0 con 0x7fb15015a7b0 2023-12-22T08:46:45.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.864+0000 7fb154d97640 1 -- 172.21.15.38:0/3829136111 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14800b230 con 0x7fb15015a7b0 2023-12-22T08:46:45.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.864+0000 7fb154d97640 1 -- 172.21.15.38:0/3829136111 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148009600 con 0x7fb15015a7b0 2023-12-22T08:46:45.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.865+0000 7fb156d9b640 1 -- 172.21.15.38:0/3829136111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15015a7b0 msgr2=0x7fb15006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:45.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.865+0000 7fb156d9b640 1 --2- 172.21.15.38:0/3829136111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15015a7b0 0x7fb15006d930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb14800d150 tx=0x7fb14802e160 comp rx=0 tx=0).stop 2023-12-22T08:46:45.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.865+0000 7fb156d9b640 1 -- 172.21.15.38:0/3829136111 shutdown_connections 2023-12-22T08:46:45.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.865+0000 7fb156d9b640 1 --2- 172.21.15.38:0/3829136111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15015a7b0 0x7fb15006d930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.865+0000 7fb156d9b640 1 --2- 172.21.15.38:0/3829136111 >> v2:172.21.15.89:3300/0 conn(0x7fb15015d3e0 0x7fb15015b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.865+0000 7fb156d9b640 1 -- 172.21.15.38:0/3829136111 >> 172.21.15.38:0/3829136111 conn(0x7fb1500b0b60 msgr2=0x7fb1500b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:45.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.865+0000 7fb156d9b640 1 -- 172.21.15.38:0/3829136111 shutdown_connections 2023-12-22T08:46:45.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.865+0000 7fb156d9b640 1 -- 172.21.15.38:0/3829136111 wait complete. 2023-12-22T08:46:45.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.868+0000 7fb156d9b640 1 Processor -- start 2023-12-22T08:46:45.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.868+0000 7fb156d9b640 1 -- start start 2023-12-22T08:46:45.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.869+0000 7fb156d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb15015a7b0 0x7fb1500ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:45.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.869+0000 7fb156d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15015d3e0 0x7fb150140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:45.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.869+0000 7fb156d9b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15015d7c0 0x7fb1501e6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:45.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.869+0000 7fb156d9b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500adc20 con 0x7fb15015d3e0 2023-12-22T08:46:45.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.869+0000 7fb156d9b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb150141050 con 0x7fb15015a7b0 2023-12-22T08:46:45.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.869+0000 7fb156d9b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500ad5f0 con 0x7fb15015d7c0 2023-12-22T08:46:45.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.870+0000 7fb155598640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15015d3e0 0x7fb150140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:45.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.870+0000 7fb155598640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15015d3e0 0x7fb150140b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45288/0 (socket says 172.21.15.38:45288) 2023-12-22T08:46:45.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.870+0000 7fb155598640 1 -- 172.21.15.38:0/3465986105 learned_addr learned my addr 172.21.15.38:0/3465986105 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:45.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.870+0000 7fb155d99640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb15015a7b0 0x7fb1500ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.870+0000 7fb15659a640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15015d7c0 0x7fb1501e6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.870+0000 7fb155598640 1 -- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15015d7c0 msgr2=0x7fb1501e6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.870+0000 7fb155598640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15015d7c0 0x7fb1501e6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.870+0000 7fb155598640 1 -- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb15015a7b0 msgr2=0x7fb1500ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.870+0000 7fb155598640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb15015a7b0 0x7fb1500ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:45.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.870+0000 7fb155598640 1 -- 172.21.15.38:0/3465986105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c009400 con 0x7fb15015d3e0 2023-12-22T08:46:45.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.871+0000 7fb155598640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15015d3e0 0x7fb150140b10 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c400 tx=0x7fb14000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:45.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.871+0000 7fb1467fc640 1 -- 172.21.15.38:0/3465986105 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1400052d0 con 0x7fb15015d3e0 2023-12-22T08:46:45.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.871+0000 7fb1467fc640 1 -- 172.21.15.38:0/3465986105 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb140005430 con 0x7fb15015d3e0 2023-12-22T08:46:45.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.871+0000 7fb156d9b640 1 -- 172.21.15.38:0/3465986105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14800bd40 con 0x7fb15015d3e0 2023-12-22T08:46:45.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.871+0000 7fb1467fc640 1 -- 172.21.15.38:0/3465986105 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140003830 con 0x7fb15015d3e0 2023-12-22T08:46:45.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.871+0000 7fb156d9b640 1 -- 172.21.15.38:0/3465986105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1501e72a0 con 0x7fb15015d3e0 2023-12-22T08:46:45.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.873+0000 7fb156d9b640 1 -- 172.21.15.38:0/3465986105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1500add90 con 0x7fb15015d3e0 2023-12-22T08:46:45.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.874+0000 7fb1467fc640 1 -- 172.21.15.38:0/3465986105 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb140003990 con 0x7fb15015d3e0 2023-12-22T08:46:45.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.875+0000 7fb1467fc640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb13406a430 0x7fb13406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:45.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.875+0000 7fb1467fc640 1 -- 172.21.15.38:0/3465986105 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb140087e20 con 0x7fb15015d3e0 2023-12-22T08:46:45.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.876+0000 7fb155d99640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb13406a430 0x7fb13406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:45.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.877+0000 7fb155d99640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb13406a430 0x7fb13406c8f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009cd0 tx=0x7fb14c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:45.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:45.880+0000 7fb1467fc640 1 -- 172.21.15.38:0/3465986105 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb1400534b0 con 0x7fb15015d3e0 2023-12-22T08:46:46.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.075+0000 7fb156d9b640 1 -- 172.21.15.38:0/3465986105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb150061910 con 0x7fb15015d3e0 2023-12-22T08:46:46.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.076+0000 7fb1467fc640 1 -- 172.21.15.38:0/3465986105 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb140017020 con 0x7fb15015d3e0 2023-12-22T08:46:46.078 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:46:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.079+0000 7fb156d9b640 1 -- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb13406a430 msgr2=0x7fb13406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.079+0000 7fb156d9b640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb13406a430 0x7fb13406c8f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009cd0 tx=0x7fb14c009190 comp rx=0 tx=0).stop 2023-12-22T08:46:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.079+0000 7fb156d9b640 1 -- 172.21.15.38:0/3465986105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15015d3e0 msgr2=0x7fb150140b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.079+0000 7fb156d9b640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15015d3e0 0x7fb150140b10 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c400 tx=0x7fb14000c8c0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.079+0000 7fb156d9b640 1 -- 172.21.15.38:0/3465986105 shutdown_connections 2023-12-22T08:46:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.079+0000 7fb156d9b640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15015d7c0 0x7fb1501e6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.079+0000 7fb156d9b640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb13406a430 0x7fb13406c8f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.079+0000 7fb156d9b640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15015d3e0 0x7fb150140b10 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.079+0000 7fb156d9b640 1 --2- 172.21.15.38:0/3465986105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb15015a7b0 0x7fb1500ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.079+0000 7fb156d9b640 1 -- 172.21.15.38:0/3465986105 >> 172.21.15.38:0/3465986105 conn(0x7fb1500b0b60 msgr2=0x7fb15014d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.079+0000 7fb156d9b640 1 -- 172.21.15.38:0/3465986105 shutdown_connections 2023-12-22T08:46:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.079+0000 7fb156d9b640 1 -- 172.21.15.38:0/3465986105 wait complete. 2023-12-22T08:46:46.100 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:46:46.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.326+0000 7f6fd5dae640 1 Processor -- start 2023-12-22T08:46:46.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.327+0000 7f6fd5dae640 1 -- start start 2023-12-22T08:46:46.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.328+0000 7f6fd5dae640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6fd015e740 0x7f6fd015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:46.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.328+0000 7f6fd5dae640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd015eb20 con 0x7f6fd006ca50 2023-12-22T08:46:46.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.328+0000 7f6fd5dae640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd0070770 con 0x7f6fd00b3f90 2023-12-22T08:46:46.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.328+0000 7f6fd5dae640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd006e650 con 0x7f6fd015e740 2023-12-22T08:46:46.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.329+0000 7f6fc7fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6fd006ca50 0x7f6fd00b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41940/0 (socket says 172.21.15.38:41940) 2023-12-22T08:46:46.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.329+0000 7f6fc7fff640 1 -- 172.21.15.38:0/3952884392 learned_addr learned my addr 172.21.15.38:0/3952884392 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:46.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.329+0000 7f6fceffd640 1 -- 172.21.15.38:0/3952884392 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416179716 0 0) 0x7f6fd015eb20 con 0x7f6fd006ca50 2023-12-22T08:46:46.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.329+0000 7f6fcf7fe640 1 --2- 172.21.15.38:0/3952884392 >> v2:172.21.15.89:3300/0 conn(0x7f6fd015e740 0x7f6fd015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:46.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.329+0000 7f6fceffd640 1 -- 172.21.15.38:0/3952884392 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fbc003520 con 0x7f6fd006ca50 2023-12-22T08:46:46.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.330+0000 7f6fcf7fe640 1 -- 172.21.15.38:0/3952884392 >> v1:172.21.15.89:6789/0 conn(0x7f6fd00b3f90 legacy=0x7f6fd0070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:46.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.330+0000 7f6fcf7fe640 1 -- 172.21.15.38:0/3952884392 >> v1:172.21.15.38:6789/0 conn(0x7f6fd006ca50 legacy=0x7f6fd00b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:46.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.330+0000 7f6fcf7fe640 1 -- 172.21.15.38:0/3952884392 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd006cec0 con 0x7f6fd015e740 2023-12-22T08:46:46.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.332+0000 7f6fcf7fe640 1 --2- 172.21.15.38:0/3952884392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd015e740 0x7f6fd015db30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00097a0 tx=0x7f6fc002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48c0dacbb7b6b28c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:46.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.337+0000 7f6fceffd640 1 -- 172.21.15.38:0/3952884392 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc002e070 con 0x7f6fd015e740 2023-12-22T08:46:46.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.337+0000 7f6fceffd640 1 -- 172.21.15.38:0/3952884392 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc00315a0 con 0x7f6fd015e740 2023-12-22T08:46:46.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.337+0000 7f6fceffd640 1 -- 172.21.15.38:0/3952884392 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0031930 con 0x7f6fd015e740 2023-12-22T08:46:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.338+0000 7f6fd5dae640 1 -- 172.21.15.38:0/3952884392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd015e740 msgr2=0x7f6fd015db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.338+0000 7f6fd5dae640 1 --2- 172.21.15.38:0/3952884392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd015e740 0x7f6fd015db30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00097a0 tx=0x7f6fc002b840 comp rx=0 tx=0).stop 2023-12-22T08:46:46.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.338+0000 7f6fd5dae640 1 -- 172.21.15.38:0/3952884392 shutdown_connections 2023-12-22T08:46:46.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.338+0000 7f6fd5dae640 1 --2- 172.21.15.38:0/3952884392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd015e740 0x7f6fd015db30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.338+0000 7f6fd5dae640 1 -- 172.21.15.38:0/3952884392 >> 172.21.15.38:0/3952884392 conn(0x7f6fd00cfea0 msgr2=0x7f6fd00d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:46.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.338+0000 7f6fd5dae640 1 -- 172.21.15.38:0/3952884392 shutdown_connections 2023-12-22T08:46:46.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.338+0000 7f6fd5dae640 1 -- 172.21.15.38:0/3952884392 wait complete. 2023-12-22T08:46:46.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.340+0000 7f6fd5dae640 1 Processor -- start 2023-12-22T08:46:46.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.340+0000 7f6fd5dae640 1 -- start start 2023-12-22T08:46:46.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.341+0000 7f6fd5dae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fd006ca50 0x7f6fd01531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:46.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.341+0000 7f6fd5dae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd00b3f90 0x7f6fd015f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:46.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.341+0000 7f6fd5dae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fd015e740 0x7f6fd015b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:46.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.341+0000 7f6fd5dae640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd0153700 con 0x7f6fd015e740 2023-12-22T08:46:46.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.341+0000 7f6fd5dae640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd00b7a50 con 0x7f6fd00b3f90 2023-12-22T08:46:46.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.341+0000 7f6fd5dae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd01570a0 con 0x7f6fd006ca50 2023-12-22T08:46:46.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.341+0000 7f6fcffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fd015e740 0x7f6fd015b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:46.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.341+0000 7f6fcffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fd015e740 0x7f6fd015b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45290/0 (socket says 172.21.15.38:45290) 2023-12-22T08:46:46.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.341+0000 7f6fcffff640 1 -- 172.21.15.38:0/2305075211 learned_addr learned my addr 172.21.15.38:0/2305075211 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:46.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.341+0000 7f6fcf7fe640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fd006ca50 0x7f6fd01531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:46.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.341+0000 7f6fc7fff640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd00b3f90 0x7f6fd015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:46.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.342+0000 7f6fcffff640 1 -- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fd006ca50 msgr2=0x7f6fd01531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:46.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.342+0000 7f6fcffff640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fd006ca50 0x7f6fd01531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.342+0000 7f6fcffff640 1 -- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd00b3f90 msgr2=0x7f6fd015f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:46.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.342+0000 7f6fcffff640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd00b3f90 0x7f6fd015f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.342+0000 7f6fcffff640 1 -- 172.21.15.38:0/2305075211 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0009400 con 0x7f6fd015e740 2023-12-22T08:46:46.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.342+0000 7f6fcffff640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fd015e740 0x7f6fd015b220 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800c7a0 tx=0x7f6fc800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:46.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.342+0000 7f6fccff9640 1 -- 172.21.15.38:0/2305075211 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8003b70 con 0x7f6fd015e740 2023-12-22T08:46:46.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.342+0000 7f6fccff9640 1 -- 172.21.15.38:0/2305075211 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc8003cf0 con 0x7f6fd015e740 2023-12-22T08:46:46.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.342+0000 7f6fd5dae640 1 -- 172.21.15.38:0/2305075211 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd00b7d10 con 0x7f6fd015e740 2023-12-22T08:46:46.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.342+0000 7f6fccff9640 1 -- 172.21.15.38:0/2305075211 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8003ea0 con 0x7f6fd015e740 2023-12-22T08:46:46.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.343+0000 7f6fd5dae640 1 -- 172.21.15.38:0/2305075211 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd00b82d0 con 0x7f6fd015e740 2023-12-22T08:46:46.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.344+0000 7f6fd5dae640 1 -- 172.21.15.38:0/2305075211 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd01f62c0 con 0x7f6fd015e740 2023-12-22T08:46:46.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.345+0000 7f6fccff9640 1 -- 172.21.15.38:0/2305075211 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6fc800aa90 con 0x7f6fd015e740 2023-12-22T08:46:46.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.346+0000 7f6fccff9640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6fb006a430 0x7f6fb006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:46.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.346+0000 7f6fccff9640 1 -- 172.21.15.38:0/2305075211 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fc8088770 con 0x7f6fd015e740 2023-12-22T08:46:46.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.347+0000 7f6fcf7fe640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6fb006a430 0x7f6fb006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:46.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.348+0000 7f6fcf7fe640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6fb006a430 0x7f6fb006c8f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0036000 tx=0x7f6fc003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:46.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.351+0000 7f6fccff9640 1 -- 172.21.15.38:0/2305075211 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6fd01f62c0 con 0x7f6fd015e740 2023-12-22T08:46:46.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.547+0000 7f6fd5dae640 1 -- 172.21.15.38:0/2305075211 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6fd01f62c0 con 0x7f6fd015e740 2023-12-22T08:46:46.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.548+0000 7f6fccff9640 1 -- 172.21.15.38:0/2305075211 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6fd01f62c0 con 0x7f6fd015e740 2023-12-22T08:46:46.549 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:46:46.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.551+0000 7f6fd5dae640 1 -- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6fb006a430 msgr2=0x7f6fb006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:46.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.551+0000 7f6fd5dae640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6fb006a430 0x7f6fb006c8f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0036000 tx=0x7f6fc003d040 comp rx=0 tx=0).stop 2023-12-22T08:46:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.551+0000 7f6fd5dae640 1 -- 172.21.15.38:0/2305075211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fd015e740 msgr2=0x7f6fd015b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.551+0000 7f6fd5dae640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fd015e740 0x7f6fd015b220 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800c7a0 tx=0x7f6fc800cc60 comp rx=0 tx=0).stop 2023-12-22T08:46:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.551+0000 7f6fd5dae640 1 -- 172.21.15.38:0/2305075211 shutdown_connections 2023-12-22T08:46:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.551+0000 7f6fd5dae640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6fb006a430 0x7f6fb006c8f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.551+0000 7f6fd5dae640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fd015e740 0x7f6fd015b220 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.551+0000 7f6fd5dae640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd00b3f90 0x7f6fd015f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.551+0000 7f6fd5dae640 1 --2- 172.21.15.38:0/2305075211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fd006ca50 0x7f6fd01531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.551+0000 7f6fd5dae640 1 -- 172.21.15.38:0/2305075211 >> 172.21.15.38:0/2305075211 conn(0x7f6fd00cfea0 msgr2=0x7f6fd0071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.551+0000 7f6fd5dae640 1 -- 172.21.15.38:0/2305075211 shutdown_connections 2023-12-22T08:46:46.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.551+0000 7f6fd5dae640 1 -- 172.21.15.38:0/2305075211 wait complete. 2023-12-22T08:46:46.572 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:46:46.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.799+0000 7f87fcbc4640 1 Processor -- start 2023-12-22T08:46:46.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.800+0000 7f87fcbc4640 1 -- start start 2023-12-22T08:46:46.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.801+0000 7f87fcbc4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f87f815d3e0 0x7f87f815b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:46.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.801+0000 7f87fcbc4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87f815a7b0 0x7f87f806d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:46.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.801+0000 7f87fcbc4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f8070360 con 0x7f87f815d7c0 2023-12-22T08:46:46.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.801+0000 7f87fcbc4640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f8070170 con 0x7f87f815d3e0 2023-12-22T08:46:46.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.801+0000 7f87fcbc4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f8070640 con 0x7f87f815a7b0 2023-12-22T08:46:46.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.801+0000 7f87f77fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f87f815d3e0 0x7f87f815b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:46.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.801+0000 7f87f77fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f87f815d3e0 0x7f87f815b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45302/0 (socket says 172.21.15.38:45302) 2023-12-22T08:46:46.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.801+0000 7f87f77fe640 1 -- 172.21.15.38:0/1746357927 learned_addr learned my addr 172.21.15.38:0/1746357927 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:46.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.802+0000 7f87f7fff640 1 --2- 172.21.15.38:0/1746357927 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87f815a7b0 0x7f87f806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.802+0000 7f87f77fe640 1 -- 172.21.15.38:0/1746357927 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87f815a7b0 msgr2=0x7f87f806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.802+0000 7f87f77fe640 1 --2- 172.21.15.38:0/1746357927 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87f815a7b0 0x7f87f806d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.802+0000 7f87f77fe640 1 -- 172.21.15.38:0/1746357927 >> v1:172.21.15.89:6789/0 conn(0x7f87f815d7c0 legacy=0x7f87f806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.802+0000 7f87f77fe640 1 -- 172.21.15.38:0/1746357927 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8070920 con 0x7f87f815d3e0 2023-12-22T08:46:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.803+0000 7f87f77fe640 1 --2- 172.21.15.38:0/1746357927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87f815d3e0 0x7f87f815b820 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009870 tx=0x7f87e802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46757d1f7cfe987a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.803+0000 7f87f6ffd640 1 -- 172.21.15.38:0/1746357927 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8031640 con 0x7f87f815d3e0 2023-12-22T08:46:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.803+0000 7f87f6ffd640 1 -- 172.21.15.38:0/1746357927 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e80317a0 con 0x7f87f815d3e0 2023-12-22T08:46:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.803+0000 7f87f6ffd640 1 -- 172.21.15.38:0/1746357927 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8031b30 con 0x7f87f815d3e0 2023-12-22T08:46:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.804+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1746357927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87f815d3e0 msgr2=0x7f87f815b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.804+0000 7f87fcbc4640 1 --2- 172.21.15.38:0/1746357927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87f815d3e0 0x7f87f815b820 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009870 tx=0x7f87e802b8f0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.804+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1746357927 shutdown_connections 2023-12-22T08:46:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.804+0000 7f87fcbc4640 1 --2- 172.21.15.38:0/1746357927 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87f815a7b0 0x7f87f806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.804+0000 7f87fcbc4640 1 --2- 172.21.15.38:0/1746357927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87f815d3e0 0x7f87f815b820 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.804+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1746357927 >> 172.21.15.38:0/1746357927 conn(0x7f87f80b0b60 msgr2=0x7f87f80b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.804+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1746357927 shutdown_connections 2023-12-22T08:46:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.804+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1746357927 wait complete. 2023-12-22T08:46:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.806+0000 7f87fcbc4640 1 Processor -- start 2023-12-22T08:46:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.806+0000 7f87fcbc4640 1 -- start start 2023-12-22T08:46:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.807+0000 7f87fcbc4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87f815a7b0 0x7f87f814fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.807+0000 7f87fcbc4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87f815d3e0 0x7f87f813f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.807+0000 7f87fcbc4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87f815d7c0 0x7f87f8148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.807+0000 7f87fcbc4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f8147d20 con 0x7f87f815a7b0 2023-12-22T08:46:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.807+0000 7f87fcbc4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f813fad0 con 0x7f87f815d7c0 2023-12-22T08:46:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.807+0000 7f87fcbc4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f8147110 con 0x7f87f815d3e0 2023-12-22T08:46:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.807+0000 7f87f77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87f815a7b0 0x7f87f814fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.807+0000 7f87f77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87f815a7b0 0x7f87f814fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45312/0 (socket says 172.21.15.38:45312) 2023-12-22T08:46:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.807+0000 7f87f77fe640 1 -- 172.21.15.38:0/1117144200 learned_addr learned my addr 172.21.15.38:0/1117144200 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.808+0000 7f87f77fe640 1 -- 172.21.15.38:0/1117144200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87f815d3e0 msgr2=0x7f87f813f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.808+0000 7f87f77fe640 1 --2- 172.21.15.38:0/1117144200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87f815d3e0 0x7f87f813f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.808+0000 7f87f7fff640 1 --2- 172.21.15.38:0/1117144200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87f815d7c0 0x7f87f8148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.808+0000 7f87f77fe640 1 -- 172.21.15.38:0/1117144200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87f815d7c0 msgr2=0x7f87f8148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.808+0000 7f87f77fe640 1 --2- 172.21.15.38:0/1117144200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87f815d7c0 0x7f87f8148c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.808+0000 7f87f77fe640 1 -- 172.21.15.38:0/1117144200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80094d0 con 0x7f87f815a7b0 2023-12-22T08:46:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.808+0000 7f87f77fe640 1 --2- 172.21.15.38:0/1117144200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87f815a7b0 0x7f87f814fa60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009870 tx=0x7f87e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.808+0000 7f87f4ff9640 1 -- 172.21.15.38:0/1117144200 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e803ac60 con 0x7f87f815a7b0 2023-12-22T08:46:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.808+0000 7f87f4ff9640 1 -- 172.21.15.38:0/1117144200 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e803ade0 con 0x7f87f815a7b0 2023-12-22T08:46:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.808+0000 7f87f4ff9640 1 -- 172.21.15.38:0/1117144200 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8044630 con 0x7f87f815a7b0 2023-12-22T08:46:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.808+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1117144200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f81473f0 con 0x7f87f815a7b0 2023-12-22T08:46:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.808+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1117144200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f81479b0 con 0x7f87f815a7b0 2023-12-22T08:46:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.810+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1117144200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f8061910 con 0x7f87f815a7b0 2023-12-22T08:46:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.811+0000 7f87f4ff9640 1 -- 172.21.15.38:0/1117144200 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f87e802f050 con 0x7f87f815a7b0 2023-12-22T08:46:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.811+0000 7f87f4ff9640 1 --2- 172.21.15.38:0/1117144200 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87d806a460 0x7f87d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.811+0000 7f87f4ff9640 1 -- 172.21.15.38:0/1117144200 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87e80aaa00 con 0x7f87f815a7b0 2023-12-22T08:46:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.812+0000 7f87effff640 1 --2- 172.21.15.38:0/1117144200 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87d806a460 0x7f87d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.813+0000 7f87effff640 1 --2- 172.21.15.38:0/1117144200 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87d806a460 0x7f87d806c920 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f87e0006fd0 tx=0x7f87e0006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:46.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:46.816+0000 7f87f4ff9640 1 -- 172.21.15.38:0/1117144200 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f87e8076080 con 0x7f87f815a7b0 2023-12-22T08:46:47.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.004+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1117144200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87f80ce230 con 0x7f87f815a7b0 2023-12-22T08:46:47.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.005+0000 7f87f4ff9640 1 -- 172.21.15.38:0/1117144200 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87e80796a0 con 0x7f87f815a7b0 2023-12-22T08:46:47.006 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:46:47.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.008+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1117144200 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87d806a460 msgr2=0x7f87d806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:47.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.008+0000 7f87fcbc4640 1 --2- 172.21.15.38:0/1117144200 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87d806a460 0x7f87d806c920 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f87e0006fd0 tx=0x7f87e0006bc0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.008+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1117144200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87f815a7b0 msgr2=0x7f87f814fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:47.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.008+0000 7f87fcbc4640 1 --2- 172.21.15.38:0/1117144200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87f815a7b0 0x7f87f814fa60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009870 tx=0x7f87e80046c0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.008+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1117144200 shutdown_connections 2023-12-22T08:46:47.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.008+0000 7f87fcbc4640 1 --2- 172.21.15.38:0/1117144200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87f815d7c0 0x7f87f8148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.008+0000 7f87fcbc4640 1 --2- 172.21.15.38:0/1117144200 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87f815d3e0 0x7f87f813f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.008+0000 7f87fcbc4640 1 --2- 172.21.15.38:0/1117144200 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87d806a460 0x7f87d806c920 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.008+0000 7f87fcbc4640 1 --2- 172.21.15.38:0/1117144200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87f815a7b0 0x7f87f814fa60 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.008+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1117144200 >> 172.21.15.38:0/1117144200 conn(0x7f87f80b0b60 msgr2=0x7f87f8159130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:47.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.008+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1117144200 shutdown_connections 2023-12-22T08:46:47.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.008+0000 7f87fcbc4640 1 -- 172.21.15.38:0/1117144200 wait complete. 2023-12-22T08:46:47.029 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:46:47.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.252+0000 7f2a8d17e640 1 Processor -- start 2023-12-22T08:46:47.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.252+0000 7f2a8d17e640 1 -- start start 2023-12-22T08:46:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.254+0000 7f2a8d17e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2a8815ad90 0x7f2a880caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.254+0000 7f2a8d17e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2a88161bb0 0x7f2a880cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.254+0000 7f2a8d17e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a8815d940 0x7f2a8815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.254+0000 7f2a8d17e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a880ce2c0 con 0x7f2a88161bb0 2023-12-22T08:46:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.254+0000 7f2a8d17e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8815e910 con 0x7f2a8815ad90 2023-12-22T08:46:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.254+0000 7f2a8d17e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8815e630 con 0x7f2a8815d940 2023-12-22T08:46:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.254+0000 7f2a877fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2a88161bb0 0x7f2a880cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.254+0000 7f2a877fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2a88161bb0 0x7f2a880cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45316/0 (socket says 172.21.15.38:45316) 2023-12-22T08:46:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.254+0000 7f2a877fe640 1 -- 172.21.15.38:0/3710306476 learned_addr learned my addr 172.21.15.38:0/3710306476 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.255+0000 7f2a8c97d640 1 --2- 172.21.15.38:0/3710306476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a8815d940 0x7f2a8815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.255+0000 7f2a87fff640 1 --2- 172.21.15.38:0/3710306476 >> v2:172.21.15.89:3300/0 conn(0x7f2a8815ad90 0x7f2a880caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.255+0000 7f2a877fe640 1 -- 172.21.15.38:0/3710306476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a8815d940 msgr2=0x7f2a8815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.255+0000 7f2a877fe640 1 --2- 172.21.15.38:0/3710306476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a8815d940 0x7f2a8815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.255+0000 7f2a877fe640 1 -- 172.21.15.38:0/3710306476 >> v2:172.21.15.89:3300/0 conn(0x7f2a8815ad90 msgr2=0x7f2a880caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.255+0000 7f2a877fe640 1 --2- 172.21.15.38:0/3710306476 >> v2:172.21.15.89:3300/0 conn(0x7f2a8815ad90 0x7f2a880caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.255+0000 7f2a877fe640 1 -- 172.21.15.38:0/3710306476 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a881610d0 con 0x7f2a88161bb0 2023-12-22T08:46:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.256+0000 7f2a877fe640 1 --2- 172.21.15.38:0/3710306476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a88161bb0 0x7f2a880cb410 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f2a880d28f0 tx=0x7f2a7c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ce0872fbe204bb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.256+0000 7f2a86ffd640 1 -- 172.21.15.38:0/3710306476 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c031870 con 0x7f2a88161bb0 2023-12-22T08:46:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.256+0000 7f2a86ffd640 1 -- 172.21.15.38:0/3710306476 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c0319d0 con 0x7f2a88161bb0 2023-12-22T08:46:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.256+0000 7f2a86ffd640 1 -- 172.21.15.38:0/3710306476 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c031d60 con 0x7f2a88161bb0 2023-12-22T08:46:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.257+0000 7f2a8d17e640 1 -- 172.21.15.38:0/3710306476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a88161bb0 msgr2=0x7f2a880cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.257+0000 7f2a8d17e640 1 --2- 172.21.15.38:0/3710306476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a88161bb0 0x7f2a880cb410 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f2a880d28f0 tx=0x7f2a7c02b910 comp rx=0 tx=0).stop 2023-12-22T08:46:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.257+0000 7f2a8d17e640 1 -- 172.21.15.38:0/3710306476 shutdown_connections 2023-12-22T08:46:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.257+0000 7f2a8d17e640 1 --2- 172.21.15.38:0/3710306476 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a8815d940 0x7f2a8815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.257+0000 7f2a8d17e640 1 --2- 172.21.15.38:0/3710306476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a88161bb0 0x7f2a880cb410 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.257+0000 7f2a8d17e640 1 --2- 172.21.15.38:0/3710306476 >> v2:172.21.15.89:3300/0 conn(0x7f2a8815ad90 0x7f2a880caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.257+0000 7f2a8d17e640 1 -- 172.21.15.38:0/3710306476 >> 172.21.15.38:0/3710306476 conn(0x7f2a880d31c0 msgr2=0x7f2a880d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.257+0000 7f2a8d17e640 1 -- 172.21.15.38:0/3710306476 shutdown_connections 2023-12-22T08:46:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.257+0000 7f2a8d17e640 1 -- 172.21.15.38:0/3710306476 wait complete. 2023-12-22T08:46:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.259+0000 7f2a8d17e640 1 Processor -- start 2023-12-22T08:46:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.259+0000 7f2a8d17e640 1 -- start start 2023-12-22T08:46:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.260+0000 7f2a8d17e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a8815ad90 0x7f2a880c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.260+0000 7f2a8d17e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a8815d940 0x7f2a880aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.260+0000 7f2a8d17e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a88161bb0 0x7f2a880ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.260+0000 7f2a8d17e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880c92d0 con 0x7f2a8815ad90 2023-12-22T08:46:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.260+0000 7f2a8d17e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880a9d60 con 0x7f2a88161bb0 2023-12-22T08:46:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.260+0000 7f2a8d17e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880aa040 con 0x7f2a8815d940 2023-12-22T08:46:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.260+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a8815ad90 0x7f2a880c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.260+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a8815ad90 0x7f2a880c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45332/0 (socket says 172.21.15.38:45332) 2023-12-22T08:46:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.260+0000 7f2a87fff640 1 -- 172.21.15.38:0/4093573032 learned_addr learned my addr 172.21.15.38:0/4093573032 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:47.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.261+0000 7f2a877fe640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a8815d940 0x7f2a880aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.261+0000 7f2a87fff640 1 -- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a8815d940 msgr2=0x7f2a880aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.261+0000 7f2a87fff640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a8815d940 0x7f2a880aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.261+0000 7f2a87fff640 1 -- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a88161bb0 msgr2=0x7f2a880ab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.261+0000 7f2a8c97d640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a88161bb0 0x7f2a880ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.261+0000 7f2a87fff640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a88161bb0 0x7f2a880ab7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.261+0000 7f2a87fff640 1 -- 172.21.15.38:0/4093573032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c0094d0 con 0x7f2a8815ad90 2023-12-22T08:46:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.261+0000 7f2a877fe640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a8815d940 0x7f2a880aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.261+0000 7f2a87fff640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a8815ad90 0x7f2a880c8aa0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800d800 tx=0x7f2a7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.262+0000 7f2a84ff9640 1 -- 172.21.15.38:0/4093573032 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a780096a0 con 0x7f2a8815ad90 2023-12-22T08:46:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.262+0000 7f2a84ff9640 1 -- 172.21.15.38:0/4093573032 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a78009800 con 0x7f2a8815ad90 2023-12-22T08:46:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.262+0000 7f2a8d17e640 1 -- 172.21.15.38:0/4093573032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a880aa320 con 0x7f2a8815ad90 2023-12-22T08:46:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.262+0000 7f2a84ff9640 1 -- 172.21.15.38:0/4093573032 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a78009b90 con 0x7f2a8815ad90 2023-12-22T08:46:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.262+0000 7f2a8d17e640 1 -- 172.21.15.38:0/4093573032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a880c8fe0 con 0x7f2a8815ad90 2023-12-22T08:46:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.263+0000 7f2a8d17e640 1 -- 172.21.15.38:0/4093573032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a88061910 con 0x7f2a8815ad90 2023-12-22T08:46:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.264+0000 7f2a84ff9640 1 -- 172.21.15.38:0/4093573032 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2a78009cf0 con 0x7f2a8815ad90 2023-12-22T08:46:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.265+0000 7f2a84ff9640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a7406a430 0x7f2a7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.265+0000 7f2a84ff9640 1 -- 172.21.15.38:0/4093573032 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a78088df0 con 0x7f2a8815ad90 2023-12-22T08:46:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.266+0000 7f2a877fe640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a7406a430 0x7f2a7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.267+0000 7f2a877fe640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a7406a430 0x7f2a7406c8f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c036000 tx=0x7f2a7c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.269+0000 7f2a84ff9640 1 -- 172.21.15.38:0/4093573032 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2a780543d0 con 0x7f2a8815ad90 2023-12-22T08:46:47.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.479+0000 7f2a8d17e640 1 -- 172.21.15.38:0/4093573032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2a880a9ea0 con 0x7f2a8815ad90 2023-12-22T08:46:47.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.480+0000 7f2a84ff9640 1 -- 172.21.15.38:0/4093573032 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v115) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2a880a9ea0 con 0x7f2a8815ad90 2023-12-22T08:46:47.481 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:46:47.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.482+0000 7f2a8d17e640 1 -- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a7406a430 msgr2=0x7f2a7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:47.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.482+0000 7f2a8d17e640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a7406a430 0x7f2a7406c8f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c036000 tx=0x7f2a7c03c040 comp rx=0 tx=0).stop 2023-12-22T08:46:47.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.482+0000 7f2a8d17e640 1 -- 172.21.15.38:0/4093573032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a8815ad90 msgr2=0x7f2a880c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:47.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.482+0000 7f2a8d17e640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a8815ad90 0x7f2a880c8aa0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800d800 tx=0x7f2a7800dcc0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.482+0000 7f2a8d17e640 1 -- 172.21.15.38:0/4093573032 shutdown_connections 2023-12-22T08:46:47.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.482+0000 7f2a8d17e640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a88161bb0 0x7f2a880ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.482+0000 7f2a8d17e640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a8815d940 0x7f2a880aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.483+0000 7f2a8d17e640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a7406a430 0x7f2a7406c8f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.483+0000 7f2a8d17e640 1 --2- 172.21.15.38:0/4093573032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a8815ad90 0x7f2a880c8aa0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:47.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.483+0000 7f2a8d17e640 1 -- 172.21.15.38:0/4093573032 >> 172.21.15.38:0/4093573032 conn(0x7f2a880d31c0 msgr2=0x7f2a880d35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:47.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.483+0000 7f2a8d17e640 1 -- 172.21.15.38:0/4093573032 shutdown_connections 2023-12-22T08:46:47.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:47.483+0000 7f2a8d17e640 1 -- 172.21.15.38:0/4093573032 wait complete. 2023-12-22T08:46:47.503 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T08:46:47.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:47.503 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-22T08:46:47.615 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:46:47.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:46:47.615 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T08:46:47.666 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:46:47.666 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:47.730 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:46:47.731 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:46:47.731 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:46:47.789 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:46:47.790 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:46:47.932 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:46:47.941 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:46:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.006+0000 7f2257f47640 1 Processor -- start 2023-12-22T08:46:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.006+0000 7f2257f47640 1 -- start start 2023-12-22T08:46:48.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.007+0000 7f2257f47640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225015e740 0x7f225015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.007+0000 7f2257f47640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f225006ca50 0x7f22500b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.007+0000 7f2257f47640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22500b4210 con 0x7f22500b3dc0 2023-12-22T08:46:48.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.007+0000 7f2257f47640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225006e650 con 0x7f225006ca50 2023-12-22T08:46:48.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.007+0000 7f2257f47640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225015eb20 con 0x7f225015e740 2023-12-22T08:46:48.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.008+0000 7f22554e2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f225006ca50 0x7f22500b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.008+0000 7f22564e4640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f22500b3dc0 0x7f2250161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41950/0 (socket says 172.21.15.38:41950) 2023-12-22T08:46:48.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.008+0000 7f22564e4640 1 -- 172.21.15.38:0/3330920083 learned_addr learned my addr 172.21.15.38:0/3330920083 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:48.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.008+0000 7f2255ce3640 1 --2- 172.21.15.38:0/3330920083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225015e740 0x7f225015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.008+0000 7f22554e2640 1 -- 172.21.15.38:0/3330920083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225015e740 msgr2=0x7f225015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:48.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.008+0000 7f22554e2640 1 --2- 172.21.15.38:0/3330920083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225015e740 0x7f225015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.008+0000 7f22554e2640 1 -- 172.21.15.38:0/3330920083 >> v1:172.21.15.38:6789/0 conn(0x7f22500b3dc0 legacy=0x7f2250161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.008+0000 7f22554e2640 1 -- 172.21.15.38:0/3330920083 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2250070770 con 0x7f225006ca50 2023-12-22T08:46:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.008+0000 7f2254ce1640 1 -- 172.21.15.38:0/3330920083 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861788640 0 0) 0x7f2248001490 con 0x7f22500b3dc0 2023-12-22T08:46:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.010+0000 7f22554e2640 1 --2- 172.21.15.38:0/3330920083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225006ca50 0x7f22500b3880 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097a0 tx=0x7f224c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b39ffc06cadbca server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.010+0000 7f2254ce1640 1 -- 172.21.15.38:0/3330920083 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c02f050 con 0x7f225006ca50 2023-12-22T08:46:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.010+0000 7f2254ce1640 1 -- 172.21.15.38:0/3330920083 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c031700 con 0x7f225006ca50 2023-12-22T08:46:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.010+0000 7f2254ce1640 1 -- 172.21.15.38:0/3330920083 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c031a90 con 0x7f225006ca50 2023-12-22T08:46:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.011+0000 7f2257f47640 1 -- 172.21.15.38:0/3330920083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225006ca50 msgr2=0x7f22500b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.011+0000 7f2257f47640 1 --2- 172.21.15.38:0/3330920083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225006ca50 0x7f22500b3880 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097a0 tx=0x7f224c02b7a0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.011+0000 7f2257f47640 1 -- 172.21.15.38:0/3330920083 shutdown_connections 2023-12-22T08:46:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.011+0000 7f2257f47640 1 --2- 172.21.15.38:0/3330920083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225006ca50 0x7f22500b3880 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.011+0000 7f2257f47640 1 --2- 172.21.15.38:0/3330920083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225015e740 0x7f225015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.011+0000 7f2257f47640 1 -- 172.21.15.38:0/3330920083 >> 172.21.15.38:0/3330920083 conn(0x7f22500cfea0 msgr2=0x7f22500d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.011+0000 7f2257f47640 1 -- 172.21.15.38:0/3330920083 shutdown_connections 2023-12-22T08:46:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.011+0000 7f2257f47640 1 -- 172.21.15.38:0/3330920083 wait complete. 2023-12-22T08:46:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.013+0000 7f2257f47640 1 Processor -- start 2023-12-22T08:46:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.013+0000 7f2257f47640 1 -- start start 2023-12-22T08:46:48.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.014+0000 7f2257f47640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225006ca50 0x7f22500b8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.014+0000 7f2257f47640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22500b3dc0 0x7f22501581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.014+0000 7f2257f47640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225015e740 0x7f22501527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.014+0000 7f2257f47640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22501563c0 con 0x7f225006ca50 2023-12-22T08:46:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.014+0000 7f2257f47640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22501f2be0 con 0x7f22500b3dc0 2023-12-22T08:46:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.014+0000 7f2257f47640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500b6740 con 0x7f225015e740 2023-12-22T08:46:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.014+0000 7f2255ce3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225006ca50 0x7f22500b8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.014+0000 7f2255ce3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225006ca50 0x7f22500b8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45360/0 (socket says 172.21.15.38:45360) 2023-12-22T08:46:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.014+0000 7f2255ce3640 1 -- 172.21.15.38:0/1022801885 learned_addr learned my addr 172.21.15.38:0/1022801885 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.015+0000 7f22564e4640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225015e740 0x7f22501527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.015+0000 7f22554e2640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22500b3dc0 0x7f22501581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.015+0000 7f2255ce3640 1 -- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225015e740 msgr2=0x7f22501527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.015+0000 7f2255ce3640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225015e740 0x7f22501527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.015+0000 7f2255ce3640 1 -- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22500b3dc0 msgr2=0x7f22501581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.015+0000 7f2255ce3640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22500b3dc0 0x7f22501581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.015+0000 7f2255ce3640 1 -- 172.21.15.38:0/1022801885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c009400 con 0x7f225006ca50 2023-12-22T08:46:48.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.015+0000 7f2255ce3640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225006ca50 0x7f22500b8010 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f224000d5f0 tx=0x7f224000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:48.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.016+0000 7f22467fc640 1 -- 172.21.15.38:0/1022801885 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22400125f0 con 0x7f225006ca50 2023-12-22T08:46:48.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.016+0000 7f22467fc640 1 -- 172.21.15.38:0/1022801885 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2240012750 con 0x7f225006ca50 2023-12-22T08:46:48.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.016+0000 7f22467fc640 1 -- 172.21.15.38:0/1022801885 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240012b00 con 0x7f225006ca50 2023-12-22T08:46:48.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.016+0000 7f2257f47640 1 -- 172.21.15.38:0/1022801885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2250155d70 con 0x7f225006ca50 2023-12-22T08:46:48.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.016+0000 7f2257f47640 1 -- 172.21.15.38:0/1022801885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22500b6410 con 0x7f225006ca50 2023-12-22T08:46:48.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.017+0000 7f2257f47640 1 -- 172.21.15.38:0/1022801885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2250061910 con 0x7f225006ca50 2023-12-22T08:46:48.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.018+0000 7f22467fc640 1 -- 172.21.15.38:0/1022801885 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2240012c60 con 0x7f225006ca50 2023-12-22T08:46:48.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.019+0000 7f22467fc640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f223406a430 0x7f223406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.019+0000 7f22467fc640 1 -- 172.21.15.38:0/1022801885 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2240088da0 con 0x7f225006ca50 2023-12-22T08:46:48.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.020+0000 7f22554e2640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f223406a430 0x7f223406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.021+0000 7f22554e2640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f223406a430 0x7f223406c8f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f224c035000 tx=0x7f224c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:48.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.024+0000 7f22467fc640 1 -- 172.21.15.38:0/1022801885 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f22400542f0 con 0x7f225006ca50 2023-12-22T08:46:48.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.258+0000 7f2257f47640 1 -- 172.21.15.38:0/1022801885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f225006da10 con 0x7f225006ca50 2023-12-22T08:46:48.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.259+0000 7f22467fc640 1 -- 172.21.15.38:0/1022801885 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f2240057910 con 0x7f225006ca50 2023-12-22T08:46:48.261 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:48.261 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/4163741517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4163741517},{"type":"v1","addr":"172.21.15.89:6836","nonce":4163741517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/972467119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":972467119},{"type":"v1","addr":"172.21.15.89:6837","nonce":972467119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/2124959631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2124959631},{"type":"v1","addr":"172.21.15.38:6834","nonce":2124959631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:46:11.013927+0000","modified":"2023-12-22T08:46:14.032400+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/2733146003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2733146003},{"type":"v1","addr":"172.21.15.38:6835","nonce":2733146003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-22T08:46:48.261 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 47 2023-12-22T08:46:48.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.262+0000 7f2257f47640 1 -- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f223406a430 msgr2=0x7f223406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.262+0000 7f2257f47640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f223406a430 0x7f223406c8f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f224c035000 tx=0x7f224c008030 comp rx=0 tx=0).stop 2023-12-22T08:46:48.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.262+0000 7f2257f47640 1 -- 172.21.15.38:0/1022801885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225006ca50 msgr2=0x7f22500b8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.262+0000 7f2257f47640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225006ca50 0x7f22500b8010 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f224000d5f0 tx=0x7f224000dab0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.262+0000 7f2257f47640 1 -- 172.21.15.38:0/1022801885 shutdown_connections 2023-12-22T08:46:48.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.262+0000 7f2257f47640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225015e740 0x7f22501527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.262+0000 7f2257f47640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22500b3dc0 0x7f22501581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.262+0000 7f2257f47640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f223406a430 0x7f223406c8f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.262+0000 7f2257f47640 1 --2- 172.21.15.38:0/1022801885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225006ca50 0x7f22500b8010 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.262+0000 7f2257f47640 1 -- 172.21.15.38:0/1022801885 >> 172.21.15.38:0/1022801885 conn(0x7f22500cfea0 msgr2=0x7f22500659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:48.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.263+0000 7f2257f47640 1 -- 172.21.15.38:0/1022801885 shutdown_connections 2023-12-22T08:46:48.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.263+0000 7f2257f47640 1 -- 172.21.15.38:0/1022801885 wait complete. 2023-12-22T08:46:48.282 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:46:48.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.507+0000 7f20e69d6640 1 Processor -- start 2023-12-22T08:46:48.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.507+0000 7f20e69d6640 1 -- start start 2023-12-22T08:46:48.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.508+0000 7f20e69d6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e006d210 0x7f20e015e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.508+0000 7f20e69d6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f20e006d5f0 0x7f20e0070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.508+0000 7f20e69d6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e00706d0 con 0x7f20e00cb4c0 2023-12-22T08:46:48.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.509+0000 7f20e69d6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e00cbf40 con 0x7f20e006d5f0 2023-12-22T08:46:48.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.509+0000 7f20e69d6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00ce840 con 0x7f20e006d210 2023-12-22T08:46:48.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.509+0000 7f20e61d5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f20e006d5f0 0x7f20e0070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.509+0000 7f20e61d5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f20e006d5f0 0x7f20e0070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:35956/0 (socket says 172.21.15.38:35956) 2023-12-22T08:46:48.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.509+0000 7f20e61d5640 1 -- 172.21.15.38:0/1232911088 learned_addr learned my addr 172.21.15.38:0/1232911088 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:48.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.509+0000 7f20e59d4640 1 --2- 172.21.15.38:0/1232911088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e006d210 0x7f20e015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.510+0000 7f20e61d5640 1 -- 172.21.15.38:0/1232911088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e006d210 msgr2=0x7f20e015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:48.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.510+0000 7f20e61d5640 1 --2- 172.21.15.38:0/1232911088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e006d210 0x7f20e015e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.510+0000 7f20e61d5640 1 -- 172.21.15.38:0/1232911088 >> v1:172.21.15.89:6789/0 conn(0x7f20e00cb4c0 legacy=0x7f20e0159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.510+0000 7f20e61d5640 1 -- 172.21.15.38:0/1232911088 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e00ceb20 con 0x7f20e006d5f0 2023-12-22T08:46:48.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.511+0000 7f20e61d5640 1 --2- 172.21.15.38:0/1232911088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e006d5f0 0x7f20e0070b60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009e50 tx=0x7f20d802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4620fc6626b27604 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:48.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.512+0000 7f20e49d2640 1 -- 172.21.15.38:0/1232911088 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d802cb00 con 0x7f20e006d5f0 2023-12-22T08:46:48.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.512+0000 7f20e49d2640 1 -- 172.21.15.38:0/1232911088 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d802cc60 con 0x7f20e006d5f0 2023-12-22T08:46:48.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.512+0000 7f20e49d2640 1 -- 172.21.15.38:0/1232911088 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d80343f0 con 0x7f20e006d5f0 2023-12-22T08:46:48.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.513+0000 7f20e69d6640 1 -- 172.21.15.38:0/1232911088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e006d5f0 msgr2=0x7f20e0070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.513+0000 7f20e69d6640 1 --2- 172.21.15.38:0/1232911088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e006d5f0 0x7f20e0070b60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009e50 tx=0x7f20d802bf60 comp rx=0 tx=0).stop 2023-12-22T08:46:48.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.513+0000 7f20e69d6640 1 -- 172.21.15.38:0/1232911088 shutdown_connections 2023-12-22T08:46:48.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.513+0000 7f20e69d6640 1 --2- 172.21.15.38:0/1232911088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e006d5f0 0x7f20e0070b60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.513+0000 7f20e69d6640 1 --2- 172.21.15.38:0/1232911088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e006d210 0x7f20e015e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.513+0000 7f20e69d6640 1 -- 172.21.15.38:0/1232911088 >> 172.21.15.38:0/1232911088 conn(0x7f20e00b1f70 msgr2=0x7f20e00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:48.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.513+0000 7f20e69d6640 1 -- 172.21.15.38:0/1232911088 shutdown_connections 2023-12-22T08:46:48.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.513+0000 7f20e69d6640 1 -- 172.21.15.38:0/1232911088 wait complete. 2023-12-22T08:46:48.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.516+0000 7f20e69d6640 1 Processor -- start 2023-12-22T08:46:48.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.516+0000 7f20e69d6640 1 -- start start 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.517+0000 7f20e69d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20e006d210 0x7f20e015d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.517+0000 7f20e69d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e006d5f0 0x7f20e00cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.517+0000 7f20e69d6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e00cb4c0 0x7f20e00c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.517+0000 7f20e69d6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00c5000 con 0x7f20e006d210 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.517+0000 7f20e69d6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00c2070 con 0x7f20e006d5f0 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.517+0000 7f20e69d6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e0158fe0 con 0x7f20e00cb4c0 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.518+0000 7f20e59d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20e006d210 0x7f20e015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.518+0000 7f20e59d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20e006d210 0x7f20e015d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45374/0 (socket says 172.21.15.38:45374) 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.518+0000 7f20e59d4640 1 -- 172.21.15.38:0/183869846 learned_addr learned my addr 172.21.15.38:0/183869846 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.518+0000 7f20e51d3640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e006d5f0 0x7f20e00cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.518+0000 7f20e61d5640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e00cb4c0 0x7f20e00c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.518+0000 7f20e59d4640 1 -- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e00cb4c0 msgr2=0x7f20e00c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.518+0000 7f20e59d4640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e00cb4c0 0x7f20e00c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.518+0000 7f20e59d4640 1 -- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e006d5f0 msgr2=0x7f20e00cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.518+0000 7f20e59d4640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e006d5f0 0x7f20e00cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.518+0000 7f20e59d4640 1 -- 172.21.15.38:0/183869846 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d8009b30 con 0x7f20e006d210 2023-12-22T08:46:48.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.519+0000 7f20e59d4640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20e006d210 0x7f20e015d730 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0089e0 tx=0x7f20dc008ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:48.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.519+0000 7f20d67fc640 1 -- 172.21.15.38:0/183869846 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc010040 con 0x7f20e006d210 2023-12-22T08:46:48.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.519+0000 7f20d67fc640 1 -- 172.21.15.38:0/183869846 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc009d20 con 0x7f20e006d210 2023-12-22T08:46:48.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.519+0000 7f20d67fc640 1 -- 172.21.15.38:0/183869846 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc00bea0 con 0x7f20e006d210 2023-12-22T08:46:48.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.519+0000 7f20e69d6640 1 -- 172.21.15.38:0/183869846 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e00c22c0 con 0x7f20e006d210 2023-12-22T08:46:48.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.519+0000 7f20e69d6640 1 -- 172.21.15.38:0/183869846 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e00c2880 con 0x7f20e006d210 2023-12-22T08:46:48.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.520+0000 7f20e69d6640 1 -- 172.21.15.38:0/183869846 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e0061910 con 0x7f20e006d210 2023-12-22T08:46:48.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.521+0000 7f20d67fc640 1 -- 172.21.15.38:0/183869846 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f20dc015660 con 0x7f20e006d210 2023-12-22T08:46:48.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.522+0000 7f20d67fc640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f20c406a430 0x7f20c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.522+0000 7f20d67fc640 1 -- 172.21.15.38:0/183869846 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20dc088460 con 0x7f20e006d210 2023-12-22T08:46:48.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.523+0000 7f20e51d3640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f20c406a430 0x7f20c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.524+0000 7f20e51d3640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f20c406a430 0x7f20c406c8f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f20e01f5ce0 tx=0x7f20d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:48.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.528+0000 7f20d67fc640 1 -- 172.21.15.38:0/183869846 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f20dc053a60 con 0x7f20e006d210 2023-12-22T08:46:48.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.724+0000 7f20e69d6640 1 -- 172.21.15.38:0/183869846 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20e00b2e10 con 0x7f20e006d210 2023-12-22T08:46:48.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.727+0000 7f20d67fc640 1 -- 172.21.15.38:0/183869846 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16068 (secure 0 0 0) 0x7f20dc057080 con 0x7f20e006d210 2023-12-22T08:46:48.728 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:48.729 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":115,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:46:38.242259+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:46:08.930859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-22T08:46:10.036922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:46:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.730+0000 7f20e69d6640 1 -- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f20c406a430 msgr2=0x7f20c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.730+0000 7f20e69d6640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f20c406a430 0x7f20c406c8f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f20e01f5ce0 tx=0x7f20d0009040 comp rx=0 tx=0).stop 2023-12-22T08:46:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.730+0000 7f20e69d6640 1 -- 172.21.15.38:0/183869846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20e006d210 msgr2=0x7f20e015d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.730+0000 7f20e69d6640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20e006d210 0x7f20e015d730 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0089e0 tx=0x7f20dc008ad0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.730+0000 7f20e69d6640 1 -- 172.21.15.38:0/183869846 shutdown_connections 2023-12-22T08:46:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.730+0000 7f20e69d6640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e00cb4c0 0x7f20e00c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.730+0000 7f20e69d6640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e006d5f0 0x7f20e00cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.730+0000 7f20e69d6640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f20c406a430 0x7f20c406c8f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.730+0000 7f20e69d6640 1 --2- 172.21.15.38:0/183869846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f20e006d210 0x7f20e015d730 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.730+0000 7f20e69d6640 1 -- 172.21.15.38:0/183869846 >> 172.21.15.38:0/183869846 conn(0x7f20e00b1f70 msgr2=0x7f20e0071830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.730+0000 7f20e69d6640 1 -- 172.21.15.38:0/183869846 shutdown_connections 2023-12-22T08:46:48.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.730+0000 7f20e69d6640 1 -- 172.21.15.38:0/183869846 wait complete. 2023-12-22T08:46:48.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:46:08.930859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:46:10.036922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:46:48.752 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:46:48.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.983+0000 7f905919c640 1 Processor -- start 2023-12-22T08:46:48.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.983+0000 7f905919c640 1 -- start start 2023-12-22T08:46:48.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.985+0000 7f905919c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f90540cea50 0x7f90540ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.985+0000 7f905919c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f905406d590 0x7f905406d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.985+0000 7f905919c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9054140f70 con 0x7f9054143600 2023-12-22T08:46:48.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.985+0000 7f905919c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90540cf410 con 0x7f90540cea50 2023-12-22T08:46:48.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.985+0000 7f905919c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905406c300 con 0x7f905406d590 2023-12-22T08:46:48.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.985+0000 7f905259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f90540cea50 0x7f90540ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.985+0000 7f905259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f90540cea50 0x7f90540ceed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45382/0 (socket says 172.21.15.38:45382) 2023-12-22T08:46:48.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.985+0000 7f905259c640 1 -- 172.21.15.38:0/3187755448 learned_addr learned my addr 172.21.15.38:0/3187755448 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:48.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.985+0000 7f905359e640 1 --2- 172.21.15.38:0/3187755448 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f905406d590 0x7f905406d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.986+0000 7f905259c640 1 -- 172.21.15.38:0/3187755448 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f905406d590 msgr2=0x7f905406d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:48.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.986+0000 7f905259c640 1 --2- 172.21.15.38:0/3187755448 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f905406d590 0x7f905406d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.986+0000 7f905259c640 1 -- 172.21.15.38:0/3187755448 >> v1:172.21.15.89:6789/0 conn(0x7f9054143600 legacy=0x7f905415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.986+0000 7f905259c640 1 -- 172.21.15.38:0/3187755448 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905406c5e0 con 0x7f90540cea50 2023-12-22T08:46:48.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.987+0000 7f905259c640 1 --2- 172.21.15.38:0/3187755448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cea50 0x7f90540ceed0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f9048009870 tx=0x7f904802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c0389ae48a059f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:48.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.987+0000 7f9051d9b640 1 -- 172.21.15.38:0/3187755448 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048030840 con 0x7f90540cea50 2023-12-22T08:46:48.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.987+0000 7f9051d9b640 1 -- 172.21.15.38:0/3187755448 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90480309a0 con 0x7f90540cea50 2023-12-22T08:46:48.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.987+0000 7f9051d9b640 1 -- 172.21.15.38:0/3187755448 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048030d30 con 0x7f90540cea50 2023-12-22T08:46:48.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.988+0000 7f905919c640 1 -- 172.21.15.38:0/3187755448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cea50 msgr2=0x7f90540ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.988+0000 7f905919c640 1 --2- 172.21.15.38:0/3187755448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cea50 0x7f90540ceed0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f9048009870 tx=0x7f904802b980 comp rx=0 tx=0).stop 2023-12-22T08:46:48.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.988+0000 7f905919c640 1 -- 172.21.15.38:0/3187755448 shutdown_connections 2023-12-22T08:46:48.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.988+0000 7f905919c640 1 --2- 172.21.15.38:0/3187755448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cea50 0x7f90540ceed0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.988+0000 7f905919c640 1 --2- 172.21.15.38:0/3187755448 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f905406d590 0x7f905406d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.988+0000 7f905919c640 1 -- 172.21.15.38:0/3187755448 >> 172.21.15.38:0/3187755448 conn(0x7f90540cfe70 msgr2=0x7f90540d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:48.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.988+0000 7f905919c640 1 -- 172.21.15.38:0/3187755448 shutdown_connections 2023-12-22T08:46:48.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.988+0000 7f905919c640 1 -- 172.21.15.38:0/3187755448 wait complete. 2023-12-22T08:46:48.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.990+0000 7f905919c640 1 Processor -- start 2023-12-22T08:46:48.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.990+0000 7f905919c640 1 -- start start 2023-12-22T08:46:48.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.991+0000 7f905919c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f905406d590 0x7f9054160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.991+0000 7f905919c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cea50 0x7f9054142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.991+0000 7f905919c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9054143600 0x7f9054142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.991+0000 7f905919c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9054160bc0 con 0x7f90540cea50 2023-12-22T08:46:48.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.991+0000 7f905919c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9054155f40 con 0x7f905406d590 2023-12-22T08:46:48.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.991+0000 7f905919c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9054154ea0 con 0x7f9054143600 2023-12-22T08:46:48.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.991+0000 7f905259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cea50 0x7f9054142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.992+0000 7f905259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cea50 0x7f9054142310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45384/0 (socket says 172.21.15.38:45384) 2023-12-22T08:46:48.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.992+0000 7f905259c640 1 -- 172.21.15.38:0/2358359075 learned_addr learned my addr 172.21.15.38:0/2358359075 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:48.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.992+0000 7f905359e640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9054143600 0x7f9054142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.992+0000 7f9052d9d640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f905406d590 0x7f9054160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.992+0000 7f905259c640 1 -- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9054143600 msgr2=0x7f9054142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.992+0000 7f905259c640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9054143600 0x7f9054142850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.992+0000 7f905259c640 1 -- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f905406d590 msgr2=0x7f9054160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:48.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.992+0000 7f905259c640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f905406d590 0x7f9054160680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:48.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.992+0000 7f905259c640 1 -- 172.21.15.38:0/2358359075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90480094d0 con 0x7f90540cea50 2023-12-22T08:46:48.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.992+0000 7f905259c640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cea50 0x7f9054142310 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9048000c00 tx=0x7f9048004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:48.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.993+0000 7f903b7fe640 1 -- 172.21.15.38:0/2358359075 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048039c90 con 0x7f90540cea50 2023-12-22T08:46:48.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.993+0000 7f903b7fe640 1 -- 172.21.15.38:0/2358359075 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9048039df0 con 0x7f90540cea50 2023-12-22T08:46:48.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.993+0000 7f905919c640 1 -- 172.21.15.38:0/2358359075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9054155180 con 0x7f90540cea50 2023-12-22T08:46:48.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.993+0000 7f903b7fe640 1 -- 172.21.15.38:0/2358359075 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048043640 con 0x7f90540cea50 2023-12-22T08:46:48.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.993+0000 7f905919c640 1 -- 172.21.15.38:0/2358359075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9054155740 con 0x7f90540cea50 2023-12-22T08:46:48.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.994+0000 7f905919c640 1 -- 172.21.15.38:0/2358359075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9054061910 con 0x7f90540cea50 2023-12-22T08:46:48.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.995+0000 7f903b7fe640 1 -- 172.21.15.38:0/2358359075 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f90480437a0 con 0x7f90540cea50 2023-12-22T08:46:48.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.996+0000 7f903b7fe640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f904006a480 0x7f904006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:48.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.996+0000 7f903b7fe640 1 -- 172.21.15.38:0/2358359075 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f904803e070 con 0x7f90540cea50 2023-12-22T08:46:48.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.997+0000 7f9052d9d640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f904006a480 0x7f904006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:48.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:48.998+0000 7f9052d9d640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f904006a480 0x7f904006c940 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9044007fd0 tx=0x7f9044009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:49.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.000+0000 7f903b7fe640 1 -- 172.21.15.38:0/2358359075 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9048076fe0 con 0x7f90540cea50 2023-12-22T08:46:49.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.194+0000 7f905919c640 1 -- 172.21.15.38:0/2358359075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9054061250 con 0x7f90540cea50 2023-12-22T08:46:49.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.195+0000 7f903b7fe640 1 -- 172.21.15.38:0/2358359075 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7f904807a600 con 0x7f90540cea50 2023-12-22T08:46:49.196 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:46:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.197+0000 7f905919c640 1 -- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f904006a480 msgr2=0x7f904006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.198+0000 7f905919c640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f904006a480 0x7f904006c940 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9044007fd0 tx=0x7f9044009040 comp rx=0 tx=0).stop 2023-12-22T08:46:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.198+0000 7f905919c640 1 -- 172.21.15.38:0/2358359075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cea50 msgr2=0x7f9054142310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:49.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.198+0000 7f905919c640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cea50 0x7f9054142310 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9048000c00 tx=0x7f9048004730 comp rx=0 tx=0).stop 2023-12-22T08:46:49.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.198+0000 7f905919c640 1 -- 172.21.15.38:0/2358359075 shutdown_connections 2023-12-22T08:46:49.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.198+0000 7f905919c640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9054143600 0x7f9054142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.198+0000 7f905919c640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f904006a480 0x7f904006c940 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.198+0000 7f905919c640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cea50 0x7f9054142310 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.198+0000 7f905919c640 1 --2- 172.21.15.38:0/2358359075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f905406d590 0x7f9054160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.198+0000 7f905919c640 1 -- 172.21.15.38:0/2358359075 >> 172.21.15.38:0/2358359075 conn(0x7f90540cfe70 msgr2=0x7f9054153fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:49.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.198+0000 7f905919c640 1 -- 172.21.15.38:0/2358359075 shutdown_connections 2023-12-22T08:46:49.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.198+0000 7f905919c640 1 -- 172.21.15.38:0/2358359075 wait complete. 2023-12-22T08:46:49.219 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:46:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.448+0000 7fb8708b9640 1 Processor -- start 2023-12-22T08:46:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.448+0000 7fb8708b9640 1 -- start start 2023-12-22T08:46:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.450+0000 7fb8708b9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb86c070840 0x7fb86c070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.450+0000 7fb8708b9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb86c15ebe0 0x7fb86c15f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.450+0000 7fb8708b9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c06e600 con 0x7fb86c15b180 2023-12-22T08:46:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.450+0000 7fb8708b9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86c071210 con 0x7fb86c15ebe0 2023-12-22T08:46:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.450+0000 7fb8708b9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86c06e320 con 0x7fb86c070840 2023-12-22T08:46:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.450+0000 7fb86bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb86c15ebe0 0x7fb86c15f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.450+0000 7fb86bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb86c15ebe0 0x7fb86c15f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45400/0 (socket says 172.21.15.38:45400) 2023-12-22T08:46:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.450+0000 7fb86bfff640 1 -- 172.21.15.38:0/3696000324 learned_addr learned my addr 172.21.15.38:0/3696000324 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.451+0000 7fb86affd640 1 --2- 172.21.15.38:0/3696000324 >> v2:172.21.15.89:3300/0 conn(0x7fb86c070840 0x7fb86c070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.451+0000 7fb86bfff640 1 -- 172.21.15.38:0/3696000324 >> v2:172.21.15.89:3300/0 conn(0x7fb86c070840 msgr2=0x7fb86c070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:49.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.451+0000 7fb86bfff640 1 --2- 172.21.15.38:0/3696000324 >> v2:172.21.15.89:3300/0 conn(0x7fb86c070840 0x7fb86c070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.451+0000 7fb86bfff640 1 -- 172.21.15.38:0/3696000324 >> v1:172.21.15.89:6789/0 conn(0x7fb86c15b180 legacy=0x7fb86c06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:49.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.451+0000 7fb86bfff640 1 -- 172.21.15.38:0/3696000324 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c15b560 con 0x7fb86c15ebe0 2023-12-22T08:46:49.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.451+0000 7fb86affd640 1 --2- 172.21.15.38:0/3696000324 >> v2:172.21.15.89:3300/0 conn(0x7fb86c070840 0x7fb86c070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:46:49.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.452+0000 7fb86bfff640 1 --2- 172.21.15.38:0/3696000324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c15ebe0 0x7fb86c15f010 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fb86c06fed0 tx=0x7fb86402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6502c98fa24753 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:49.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.453+0000 7fb86a7fc640 1 -- 172.21.15.38:0/3696000324 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86402cb20 con 0x7fb86c15ebe0 2023-12-22T08:46:49.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.453+0000 7fb86a7fc640 1 -- 172.21.15.38:0/3696000324 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86402cc80 con 0x7fb86c15ebe0 2023-12-22T08:46:49.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.453+0000 7fb86a7fc640 1 -- 172.21.15.38:0/3696000324 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8640343f0 con 0x7fb86c15ebe0 2023-12-22T08:46:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.453+0000 7fb8708b9640 1 -- 172.21.15.38:0/3696000324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c15ebe0 msgr2=0x7fb86c15f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.453+0000 7fb8708b9640 1 --2- 172.21.15.38:0/3696000324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c15ebe0 0x7fb86c15f010 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fb86c06fed0 tx=0x7fb86402bf80 comp rx=0 tx=0).stop 2023-12-22T08:46:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.453+0000 7fb8708b9640 1 -- 172.21.15.38:0/3696000324 shutdown_connections 2023-12-22T08:46:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.453+0000 7fb8708b9640 1 --2- 172.21.15.38:0/3696000324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c15ebe0 0x7fb86c15f010 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.453+0000 7fb8708b9640 1 --2- 172.21.15.38:0/3696000324 >> v2:172.21.15.89:3300/0 conn(0x7fb86c070840 0x7fb86c070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.453+0000 7fb8708b9640 1 -- 172.21.15.38:0/3696000324 >> 172.21.15.38:0/3696000324 conn(0x7fb86c060b40 msgr2=0x7fb86c06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:49.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.453+0000 7fb8708b9640 1 -- 172.21.15.38:0/3696000324 shutdown_connections 2023-12-22T08:46:49.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.453+0000 7fb8708b9640 1 -- 172.21.15.38:0/3696000324 wait complete. 2023-12-22T08:46:49.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.455+0000 7fb8708b9640 1 Processor -- start 2023-12-22T08:46:49.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.455+0000 7fb8708b9640 1 -- start start 2023-12-22T08:46:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.456+0000 7fb8708b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c070840 0x7fb86c141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.456+0000 7fb8708b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb86c15b180 0x7fb86c0ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.456+0000 7fb8708b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb86c15ebe0 0x7fb86c0adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.456+0000 7fb8708b9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c142220 con 0x7fb86c070840 2023-12-22T08:46:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.456+0000 7fb8708b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c153ad0 con 0x7fb86c15ebe0 2023-12-22T08:46:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.456+0000 7fb8708b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c144640 con 0x7fb86c15b180 2023-12-22T08:46:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.457+0000 7fb86b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c070840 0x7fb86c141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.457+0000 7fb86b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c070840 0x7fb86c141ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45408/0 (socket says 172.21.15.38:45408) 2023-12-22T08:46:49.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.457+0000 7fb86b7fe640 1 -- 172.21.15.38:0/2871848477 learned_addr learned my addr 172.21.15.38:0/2871848477 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:49.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.457+0000 7fb86bfff640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb86c15ebe0 0x7fb86c0adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.457+0000 7fb86affd640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb86c15b180 0x7fb86c0ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.457+0000 7fb86b7fe640 1 -- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb86c15b180 msgr2=0x7fb86c0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:49.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.457+0000 7fb86b7fe640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb86c15b180 0x7fb86c0ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.457+0000 7fb86b7fe640 1 -- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb86c15ebe0 msgr2=0x7fb86c0adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:49.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.457+0000 7fb86b7fe640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb86c15ebe0 0x7fb86c0adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.457+0000 7fb86b7fe640 1 -- 172.21.15.38:0/2871848477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864009b30 con 0x7fb86c070840 2023-12-22T08:46:49.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.457+0000 7fb86affd640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb86c15b180 0x7fb86c0ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:49.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.458+0000 7fb86b7fe640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c070840 0x7fb86c141ce0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00c450 tx=0x7fb85c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:49.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.458+0000 7fb853fff640 1 -- 172.21.15.38:0/2871848477 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0052d0 con 0x7fb86c070840 2023-12-22T08:46:49.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.458+0000 7fb853fff640 1 -- 172.21.15.38:0/2871848477 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c005430 con 0x7fb86c070840 2023-12-22T08:46:49.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.458+0000 7fb853fff640 1 -- 172.21.15.38:0/2871848477 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c012870 con 0x7fb86c070840 2023-12-22T08:46:49.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.458+0000 7fb8708b9640 1 -- 172.21.15.38:0/2871848477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c144920 con 0x7fb86c070840 2023-12-22T08:46:49.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.458+0000 7fb8708b9640 1 -- 172.21.15.38:0/2871848477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c144ee0 con 0x7fb86c070840 2023-12-22T08:46:49.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.459+0000 7fb8708b9640 1 -- 172.21.15.38:0/2871848477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c145100 con 0x7fb86c070840 2023-12-22T08:46:49.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.461+0000 7fb853fff640 1 -- 172.21.15.38:0/2871848477 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb85c0129d0 con 0x7fb86c070840 2023-12-22T08:46:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.462+0000 7fb853fff640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb85806a430 0x7fb85806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.463+0000 7fb853fff640 1 -- 172.21.15.38:0/2871848477 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb85c088f70 con 0x7fb86c070840 2023-12-22T08:46:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.463+0000 7fb86affd640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb85806a430 0x7fb85806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.464+0000 7fb86affd640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb85806a430 0x7fb85806c8f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb860006fd0 tx=0x7fb860008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:49.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.466+0000 7fb853fff640 1 -- 172.21.15.38:0/2871848477 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb85c054540 con 0x7fb86c070840 2023-12-22T08:46:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.658+0000 7fb8708b9640 1 -- 172.21.15.38:0/2871848477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb86c061910 con 0x7fb86c070840 2023-12-22T08:46:49.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.659+0000 7fb853fff640 1 -- 172.21.15.38:0/2871848477 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb85c019300 con 0x7fb86c070840 2023-12-22T08:46:49.660 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:46:49.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.661+0000 7fb8708b9640 1 -- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb85806a430 msgr2=0x7fb85806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:49.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.661+0000 7fb8708b9640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb85806a430 0x7fb85806c8f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb860006fd0 tx=0x7fb860008040 comp rx=0 tx=0).stop 2023-12-22T08:46:49.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.661+0000 7fb8708b9640 1 -- 172.21.15.38:0/2871848477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c070840 msgr2=0x7fb86c141ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:49.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.661+0000 7fb8708b9640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c070840 0x7fb86c141ce0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00c450 tx=0x7fb85c00c910 comp rx=0 tx=0).stop 2023-12-22T08:46:49.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.662+0000 7fb8708b9640 1 -- 172.21.15.38:0/2871848477 shutdown_connections 2023-12-22T08:46:49.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.662+0000 7fb8708b9640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb86c15ebe0 0x7fb86c0adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.662+0000 7fb8708b9640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb86c15b180 0x7fb86c0ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.662+0000 7fb8708b9640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb85806a430 0x7fb85806c8f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.662+0000 7fb8708b9640 1 --2- 172.21.15.38:0/2871848477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c070840 0x7fb86c141ce0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.662+0000 7fb8708b9640 1 -- 172.21.15.38:0/2871848477 >> 172.21.15.38:0/2871848477 conn(0x7fb86c060b40 msgr2=0x7fb86c0b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.662+0000 7fb8708b9640 1 -- 172.21.15.38:0/2871848477 shutdown_connections 2023-12-22T08:46:49.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.662+0000 7fb8708b9640 1 -- 172.21.15.38:0/2871848477 wait complete. 2023-12-22T08:46:49.684 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:46:49.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.914+0000 7fb8eda70640 1 Processor -- start 2023-12-22T08:46:49.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.914+0000 7fb8eda70640 1 -- start start 2023-12-22T08:46:49.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.916+0000 7fb8eda70640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8e8143600 0x7fb8e815e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.916+0000 7fb8eda70640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb8e80cea50 0x7fb8e80ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.916+0000 7fb8eda70640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e815ea00 con 0x7fb8e806d590 2023-12-22T08:46:49.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.916+0000 7fb8eda70640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e80cf410 con 0x7fb8e80cea50 2023-12-22T08:46:49.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.916+0000 7fb8eda70640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8140f70 con 0x7fb8e8143600 2023-12-22T08:46:49.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.916+0000 7fb8e7fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb8e806d590 0x7fb8e806d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41964/0 (socket says 172.21.15.38:41964) 2023-12-22T08:46:49.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.916+0000 7fb8e7fff640 1 -- 172.21.15.38:0/2599338265 learned_addr learned my addr 172.21.15.38:0/2599338265 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:49.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.916+0000 7fb8e77fe640 1 --2- 172.21.15.38:0/2599338265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8e8143600 0x7fb8e815e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8deffd640 1 --2- 172.21.15.38:0/2599338265 >> v2:172.21.15.89:3300/0 conn(0x7fb8e80cea50 0x7fb8e80ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959925629 0 0) 0x7fb8e815ea00 con 0x7fb8e806d590 2023-12-22T08:46:49.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d4003520 con 0x7fb8e806d590 2023-12-22T08:46:49.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 150320710 0 0) 0x7fb8d4003520 con 0x7fb8e806d590 2023-12-22T08:46:49.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8e8143600 msgr2=0x7fb8e815e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:49.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 --2- 172.21.15.38:0/2599338265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8e8143600 0x7fb8e815e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 >> v2:172.21.15.89:3300/0 conn(0x7fb8e80cea50 msgr2=0x7fb8e80ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:49.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 --2- 172.21.15.38:0/2599338265 >> v2:172.21.15.89:3300/0 conn(0x7fb8e80cea50 0x7fb8e80ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e806c300 con 0x7fb8e806d590 2023-12-22T08:46:49.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fb8e0001670 con 0x7fb8e806d590 2023-12-22T08:46:49.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 >> v1:172.21.15.38:6789/0 conn(0x7fb8e806d590 legacy=0x7fb8e806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:49.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 --2- 172.21.15.38:0/2599338265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d4003970 0x7fb8d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 --2- 172.21.15.38:0/2599338265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8e8143600 0x7fb8d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 --2- 172.21.15.38:0/2599338265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8d4004d00 0x7fb8d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80cf410 con 0x7fb8d4003970 2023-12-22T08:46:49.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8140f70 con 0x7fb8d4004d00 2023-12-22T08:46:49.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.917+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d400b980 con 0x7fb8e8143600 2023-12-22T08:46:49.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.918+0000 7fb8e77fe640 1 --2- 172.21.15.38:0/2599338265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d4003970 0x7fb8d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.918+0000 7fb8e7fff640 1 --2- 172.21.15.38:0/2599338265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8d4004d00 0x7fb8d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.918+0000 7fb8e77fe640 1 -- 172.21.15.38:0/2599338265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8e8143600 msgr2=0x7fb8d40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:49.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.918+0000 7fb8e77fe640 1 --2- 172.21.15.38:0/2599338265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8e8143600 0x7fb8d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.918+0000 7fb8e77fe640 1 -- 172.21.15.38:0/2599338265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8d4004d00 msgr2=0x7fb8d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:49.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.918+0000 7fb8e77fe640 1 --2- 172.21.15.38:0/2599338265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8d4004d00 0x7fb8d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.918+0000 7fb8e77fe640 1 -- 172.21.15.38:0/2599338265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d4003520 con 0x7fb8d4003970 2023-12-22T08:46:49.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.918+0000 7fb8e7fff640 1 --2- 172.21.15.38:0/2599338265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8d4004d00 0x7fb8d4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:49.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.919+0000 7fb8e77fe640 1 --2- 172.21.15.38:0/2599338265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d4003970 0x7fb8d4003d90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009fc0 tx=0x7fb8d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5491748ce303b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:49.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.919+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d802cc60 con 0x7fb8d4003970 2023-12-22T08:46:49.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.920+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d800f040 con 0x7fb8d4003970 2023-12-22T08:46:49.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.920+0000 7fb8e6ffd640 1 -- 172.21.15.38:0/2599338265 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8034440 con 0x7fb8d4003970 2023-12-22T08:46:49.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.920+0000 7fb8eda70640 1 -- 172.21.15.38:0/2599338265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d4003970 msgr2=0x7fb8d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:49.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.920+0000 7fb8eda70640 1 --2- 172.21.15.38:0/2599338265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d4003970 0x7fb8d4003d90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009fc0 tx=0x7fb8d40057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.920+0000 7fb8e7fff640 1 -- 172.21.15.38:0/2599338265 reap_dead start 2023-12-22T08:46:49.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.920+0000 7fb8eda70640 1 -- 172.21.15.38:0/2599338265 shutdown_connections 2023-12-22T08:46:49.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.920+0000 7fb8eda70640 1 -- 172.21.15.38:0/2599338265 >> 172.21.15.38:0/2599338265 conn(0x7fb8e80cfe70 msgr2=0x7fb8e80d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:49.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.920+0000 7fb8eda70640 1 -- 172.21.15.38:0/2599338265 shutdown_connections 2023-12-22T08:46:49.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.920+0000 7fb8eda70640 1 -- 172.21.15.38:0/2599338265 wait complete. 2023-12-22T08:46:49.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.922+0000 7fb8eda70640 1 Processor -- start 2023-12-22T08:46:49.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.922+0000 7fb8eda70640 1 -- start start 2023-12-22T08:46:49.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.923+0000 7fb8eda70640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d4003970 0x7fb8e80a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.923+0000 7fb8eda70640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8e81569f0 0x7fb8e815c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.923+0000 7fb8eda70640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8e81410b0 0x7fb8e809e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.923+0000 7fb8eda70640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8160b30 con 0x7fb8d4003970 2023-12-22T08:46:49.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.923+0000 7fb8eda70640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8160850 con 0x7fb8e81410b0 2023-12-22T08:46:49.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.923+0000 7fb8eda70640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e815e670 con 0x7fb8e81569f0 2023-12-22T08:46:49.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.924+0000 7fb8e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d4003970 0x7fb8e80a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.924+0000 7fb8e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d4003970 0x7fb8e80a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45426/0 (socket says 172.21.15.38:45426) 2023-12-22T08:46:49.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.924+0000 7fb8e77fe640 1 -- 172.21.15.38:0/2893063372 learned_addr learned my addr 172.21.15.38:0/2893063372 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:49.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.924+0000 7fb8deffd640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8e81569f0 0x7fb8e815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.924+0000 7fb8e7fff640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8e81410b0 0x7fb8e809e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.924+0000 7fb8e77fe640 1 -- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8e81569f0 msgr2=0x7fb8e815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:49.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.924+0000 7fb8e77fe640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8e81569f0 0x7fb8e815c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.924+0000 7fb8e77fe640 1 -- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8e81410b0 msgr2=0x7fb8e809e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:49.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.924+0000 7fb8e77fe640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8e81410b0 0x7fb8e809e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:49.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.924+0000 7fb8e77fe640 1 -- 172.21.15.38:0/2893063372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e815e950 con 0x7fb8d4003970 2023-12-22T08:46:49.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.924+0000 7fb8deffd640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8e81569f0 0x7fb8e815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:49.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.924+0000 7fb8e77fe640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d4003970 0x7fb8e80a0b10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800e230 tx=0x7fb8d8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:49.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.925+0000 7fb8e4ff9640 1 -- 172.21.15.38:0/2893063372 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8034bd0 con 0x7fb8d4003970 2023-12-22T08:46:49.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.925+0000 7fb8e4ff9640 1 -- 172.21.15.38:0/2893063372 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d8034d30 con 0x7fb8d4003970 2023-12-22T08:46:49.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.925+0000 7fb8e4ff9640 1 -- 172.21.15.38:0/2893063372 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8034ea0 con 0x7fb8d4003970 2023-12-22T08:46:49.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.925+0000 7fb8eda70640 1 -- 172.21.15.38:0/2893063372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e815ec30 con 0x7fb8d4003970 2023-12-22T08:46:49.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.925+0000 7fb8eda70640 1 -- 172.21.15.38:0/2893063372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e8160450 con 0x7fb8d4003970 2023-12-22T08:46:49.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.926+0000 7fb8eda70640 1 -- 172.21.15.38:0/2893063372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e815edc0 con 0x7fb8d4003970 2023-12-22T08:46:49.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.927+0000 7fb8e4ff9640 1 -- 172.21.15.38:0/2893063372 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb8d8040450 con 0x7fb8d4003970 2023-12-22T08:46:49.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.928+0000 7fb8e4ff9640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb8c806a480 0x7fb8c806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:49.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.928+0000 7fb8e4ff9640 1 -- 172.21.15.38:0/2893063372 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8d80ab0a0 con 0x7fb8d4003970 2023-12-22T08:46:49.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.929+0000 7fb8deffd640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb8c806a480 0x7fb8c806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:49.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.930+0000 7fb8deffd640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb8c806a480 0x7fb8c806c940 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8156df0 tx=0x7fb8d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:49.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:49.933+0000 7fb8e4ff9640 1 -- 172.21.15.38:0/2893063372 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb8d8076700 con 0x7fb8d4003970 2023-12-22T08:46:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.127+0000 7fb8eda70640 1 -- 172.21.15.38:0/2893063372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8e8061910 con 0x7fb8d4003970 2023-12-22T08:46:50.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.128+0000 7fb8e4ff9640 1 -- 172.21.15.38:0/2893063372 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8d8079d20 con 0x7fb8d4003970 2023-12-22T08:46:50.129 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:46:50.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.130+0000 7fb8eda70640 1 -- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb8c806a480 msgr2=0x7fb8c806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:50.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.130+0000 7fb8eda70640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb8c806a480 0x7fb8c806c940 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8156df0 tx=0x7fb8d0008040 comp rx=0 tx=0).stop 2023-12-22T08:46:50.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.130+0000 7fb8eda70640 1 -- 172.21.15.38:0/2893063372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d4003970 msgr2=0x7fb8e80a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:50.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.130+0000 7fb8eda70640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d4003970 0x7fb8e80a0b10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800e230 tx=0x7fb8d8009750 comp rx=0 tx=0).stop 2023-12-22T08:46:50.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.131+0000 7fb8eda70640 1 -- 172.21.15.38:0/2893063372 shutdown_connections 2023-12-22T08:46:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.131+0000 7fb8eda70640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8e81410b0 0x7fb8e809e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.131+0000 7fb8eda70640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8e81569f0 0x7fb8e815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.131+0000 7fb8eda70640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb8c806a480 0x7fb8c806c940 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.131+0000 7fb8eda70640 1 --2- 172.21.15.38:0/2893063372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8d4003970 0x7fb8e80a0b10 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.131+0000 7fb8eda70640 1 -- 172.21.15.38:0/2893063372 >> 172.21.15.38:0/2893063372 conn(0x7fb8e80cfe70 msgr2=0x7fb8e813f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.131+0000 7fb8eda70640 1 -- 172.21.15.38:0/2893063372 shutdown_connections 2023-12-22T08:46:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.131+0000 7fb8eda70640 1 -- 172.21.15.38:0/2893063372 wait complete. 2023-12-22T08:46:50.153 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:46:50.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.378+0000 7f8e267d9640 1 Processor -- start 2023-12-22T08:46:50.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.379+0000 7f8e267d9640 1 -- start start 2023-12-22T08:46:50.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.380+0000 7f8e267d9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8e20146e40 0x7f8e200cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.380+0000 7f8e267d9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e201618d0 0x7f8e20070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.380+0000 7f8e267d9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e200b4120 con 0x7f8e20161df0 2023-12-22T08:46:50.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.381+0000 7f8e267d9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e200b4da0 con 0x7f8e20146e40 2023-12-22T08:46:50.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.381+0000 7f8e267d9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200b4400 con 0x7f8e201618d0 2023-12-22T08:46:50.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.381+0000 7f8e17fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8e20161df0 0x7f8e201611c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41976/0 (socket says 172.21.15.38:41976) 2023-12-22T08:46:50.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.381+0000 7f8e17fff640 1 -- 172.21.15.38:0/1864959947 learned_addr learned my addr 172.21.15.38:0/1864959947 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:50.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.381+0000 7f8e24d76640 1 --2- 172.21.15.38:0/1864959947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e201618d0 0x7f8e20070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.381+0000 7f8e1ffff640 1 --2- 172.21.15.38:0/1864959947 >> v2:172.21.15.89:3300/0 conn(0x7f8e20146e40 0x7f8e200cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.381+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789375234 0 0) 0x7f8e200b4120 con 0x7f8e20161df0 2023-12-22T08:46:50.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.381+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e0c003520 con 0x7f8e20161df0 2023-12-22T08:46:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 395688403 0 0) 0x7f8e0c003520 con 0x7f8e20161df0 2023-12-22T08:46:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e201618d0 msgr2=0x7f8e20070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 --2- 172.21.15.38:0/1864959947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e201618d0 0x7f8e20070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 >> v2:172.21.15.89:3300/0 conn(0x7f8e20146e40 msgr2=0x7f8e200cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 --2- 172.21.15.38:0/1864959947 >> v2:172.21.15.89:3300/0 conn(0x7f8e20146e40 0x7f8e200cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e200b46e0 con 0x7f8e20161df0 2023-12-22T08:46:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f8e080017f0 con 0x7f8e20161df0 2023-12-22T08:46:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 >> v1:172.21.15.38:6789/0 conn(0x7f8e20161df0 legacy=0x7f8e201611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 --2- 172.21.15.38:0/1864959947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e201618d0 0x7f8e0c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 --2- 172.21.15.38:0/1864959947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e0c003f40 0x7f8e0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 --2- 172.21.15.38:0/1864959947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e0c004d00 0x7f8e0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200b4da0 con 0x7f8e0c003f40 2023-12-22T08:46:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200b4400 con 0x7f8e0c004d00 2023-12-22T08:46:50.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c00bab0 con 0x7f8e201618d0 2023-12-22T08:46:50.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.382+0000 7f8e17fff640 1 --2- 172.21.15.38:0/1864959947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e0c003f40 0x7f8e0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.383+0000 7f8e24d76640 1 --2- 172.21.15.38:0/1864959947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e0c004d00 0x7f8e0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.383+0000 7f8e1ffff640 1 --2- 172.21.15.38:0/1864959947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e201618d0 0x7f8e0c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.383+0000 7f8e17fff640 1 -- 172.21.15.38:0/1864959947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e201618d0 msgr2=0x7f8e0c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:50.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.383+0000 7f8e17fff640 1 --2- 172.21.15.38:0/1864959947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e201618d0 0x7f8e0c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.383+0000 7f8e17fff640 1 -- 172.21.15.38:0/1864959947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e0c004d00 msgr2=0x7f8e0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:50.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.383+0000 7f8e17fff640 1 --2- 172.21.15.38:0/1864959947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e0c004d00 0x7f8e0c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.383+0000 7f8e17fff640 1 -- 172.21.15.38:0/1864959947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c003520 con 0x7f8e0c003f40 2023-12-22T08:46:50.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.384+0000 7f8e17fff640 1 --2- 172.21.15.38:0/1864959947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e0c003f40 0x7f8e0c0047c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c110 tx=0x7f8e0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23516626dccde227 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:50.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.384+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08007270 con 0x7f8e0c003f40 2023-12-22T08:46:50.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.384+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e080073f0 con 0x7f8e0c003f40 2023-12-22T08:46:50.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.384+0000 7f8e1f7fe640 1 -- 172.21.15.38:0/1864959947 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0802c830 con 0x7f8e0c003f40 2023-12-22T08:46:50.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.385+0000 7f8e267d9640 1 -- 172.21.15.38:0/1864959947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e0c003f40 msgr2=0x7f8e0c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:50.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.385+0000 7f8e267d9640 1 --2- 172.21.15.38:0/1864959947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e0c003f40 0x7f8e0c0047c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c110 tx=0x7f8e0c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.385+0000 7f8e24d76640 1 -- 172.21.15.38:0/1864959947 reap_dead start 2023-12-22T08:46:50.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.385+0000 7f8e267d9640 1 -- 172.21.15.38:0/1864959947 shutdown_connections 2023-12-22T08:46:50.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.385+0000 7f8e267d9640 1 -- 172.21.15.38:0/1864959947 >> 172.21.15.38:0/1864959947 conn(0x7f8e200cff10 msgr2=0x7f8e200d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:50.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.385+0000 7f8e267d9640 1 -- 172.21.15.38:0/1864959947 shutdown_connections 2023-12-22T08:46:50.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.385+0000 7f8e267d9640 1 -- 172.21.15.38:0/1864959947 wait complete. 2023-12-22T08:46:50.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.387+0000 7f8e267d9640 1 Processor -- start 2023-12-22T08:46:50.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.387+0000 7f8e267d9640 1 -- start start 2023-12-22T08:46:50.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.388+0000 7f8e267d9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e0c003f40 0x7f8e20140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.388+0000 7f8e267d9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e201520f0 0x7f8e200d2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.388+0000 7f8e267d9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e201f5330 0x7f8e201f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.388+0000 7f8e267d9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e201f5cf0 con 0x7f8e0c003f40 2023-12-22T08:46:50.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.388+0000 7f8e267d9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e201405c0 con 0x7f8e201f5330 2023-12-22T08:46:50.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.388+0000 7f8e267d9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20140880 con 0x7f8e201520f0 2023-12-22T08:46:50.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.388+0000 7f8e1ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e0c003f40 0x7f8e20140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.388+0000 7f8e1ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e0c003f40 0x7f8e20140080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45438/0 (socket says 172.21.15.38:45438) 2023-12-22T08:46:50.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.388+0000 7f8e1ffff640 1 -- 172.21.15.38:0/215038616 learned_addr learned my addr 172.21.15.38:0/215038616 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:50.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.389+0000 7f8e17fff640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e201520f0 0x7f8e200d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.389+0000 7f8e24d76640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e201f5330 0x7f8e201f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.389+0000 7f8e1ffff640 1 -- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e201520f0 msgr2=0x7f8e200d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.389+0000 7f8e1ffff640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e201520f0 0x7f8e200d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.389+0000 7f8e1ffff640 1 -- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e201f5330 msgr2=0x7f8e201f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.389+0000 7f8e1ffff640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e201f5330 0x7f8e201f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.389+0000 7f8e1ffff640 1 -- 172.21.15.38:0/215038616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e20140b60 con 0x7f8e0c003f40 2023-12-22T08:46:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.389+0000 7f8e24d76640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e201f5330 0x7f8e201f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:50.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.389+0000 7f8e1ffff640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e0c003f40 0x7f8e20140080 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f8e100116d0 tx=0x7f8e10011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.390+0000 7f8e1d7fa640 1 -- 172.21.15.38:0/215038616 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000f9c0 con 0x7f8e0c003f40 2023-12-22T08:46:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.390+0000 7f8e1d7fa640 1 -- 172.21.15.38:0/215038616 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1000fb20 con 0x7f8e0c003f40 2023-12-22T08:46:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.390+0000 7f8e1d7fa640 1 -- 172.21.15.38:0/215038616 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000fe90 con 0x7f8e0c003f40 2023-12-22T08:46:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.390+0000 7f8e267d9640 1 -- 172.21.15.38:0/215038616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e20140e40 con 0x7f8e0c003f40 2023-12-22T08:46:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.390+0000 7f8e267d9640 1 -- 172.21.15.38:0/215038616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2014f8b0 con 0x7f8e0c003f40 2023-12-22T08:46:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.391+0000 7f8e267d9640 1 -- 172.21.15.38:0/215038616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e20061910 con 0x7f8e0c003f40 2023-12-22T08:46:50.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.392+0000 7f8e1d7fa640 1 -- 172.21.15.38:0/215038616 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8e10015460 con 0x7f8e0c003f40 2023-12-22T08:46:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.393+0000 7f8e1d7fa640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e0006a460 0x7f8e0006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.393+0000 7f8e1d7fa640 1 -- 172.21.15.38:0/215038616 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e10088e60 con 0x7f8e0c003f40 2023-12-22T08:46:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.394+0000 7f8e17fff640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e0006a460 0x7f8e0006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.395+0000 7f8e17fff640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e0006a460 0x7f8e0006c920 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8e08034000 tx=0x7f8e08007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:50.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.398+0000 7f8e1d7fa640 1 -- 172.21.15.38:0/215038616 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8e10054500 con 0x7f8e0c003f40 2023-12-22T08:46:50.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.635+0000 7f8e267d9640 1 -- 172.21.15.38:0/215038616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e2006cac0 con 0x7f8e0c003f40 2023-12-22T08:46:50.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.636+0000 7f8e1d7fa640 1 -- 172.21.15.38:0/215038616 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f8e10057b20 con 0x7f8e0c003f40 2023-12-22T08:46:50.637 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:50.638 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/4163741517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4163741517},{"type":"v1","addr":"172.21.15.89:6836","nonce":4163741517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/972467119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":972467119},{"type":"v1","addr":"172.21.15.89:6837","nonce":972467119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/2124959631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2124959631},{"type":"v1","addr":"172.21.15.38:6834","nonce":2124959631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:46:11.013927+0000","modified":"2023-12-22T08:46:14.032400+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/2733146003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2733146003},{"type":"v1","addr":"172.21.15.38:6835","nonce":2733146003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-22T08:46:50.638 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 47 2023-12-22T08:46:50.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.639+0000 7f8e267d9640 1 -- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e0006a460 msgr2=0x7f8e0006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:50.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.639+0000 7f8e267d9640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e0006a460 0x7f8e0006c920 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8e08034000 tx=0x7f8e08007000 comp rx=0 tx=0).stop 2023-12-22T08:46:50.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.639+0000 7f8e267d9640 1 -- 172.21.15.38:0/215038616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e0c003f40 msgr2=0x7f8e20140080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:50.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.639+0000 7f8e267d9640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e0c003f40 0x7f8e20140080 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f8e100116d0 tx=0x7f8e10011b90 comp rx=0 tx=0).stop 2023-12-22T08:46:50.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.639+0000 7f8e267d9640 1 -- 172.21.15.38:0/215038616 shutdown_connections 2023-12-22T08:46:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.639+0000 7f8e267d9640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e201f5330 0x7f8e201f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.639+0000 7f8e267d9640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e201520f0 0x7f8e200d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.639+0000 7f8e267d9640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8e0006a460 0x7f8e0006c920 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.639+0000 7f8e267d9640 1 --2- 172.21.15.38:0/215038616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e0c003f40 0x7f8e20140080 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.639+0000 7f8e267d9640 1 -- 172.21.15.38:0/215038616 >> 172.21.15.38:0/215038616 conn(0x7f8e200cff10 msgr2=0x7f8e2006df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.639+0000 7f8e267d9640 1 -- 172.21.15.38:0/215038616 shutdown_connections 2023-12-22T08:46:50.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.639+0000 7f8e267d9640 1 -- 172.21.15.38:0/215038616 wait complete. 2023-12-22T08:46:50.660 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:46:50.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.886+0000 7f11dbdc6640 1 Processor -- start 2023-12-22T08:46:50.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.886+0000 7f11dbdc6640 1 -- start start 2023-12-22T08:46:50.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.888+0000 7f11dbdc6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f11d4144d10 0x7f11d40cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.888+0000 7f11dbdc6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11d40b2760 0x7f11d4070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.888+0000 7f11dbdc6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d41450f0 con 0x7f11d40cc670 2023-12-22T08:46:50.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.888+0000 7f11dbdc6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d40ce010 con 0x7f11d4144d10 2023-12-22T08:46:50.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.888+0000 7f11dbdc6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d40ce2f0 con 0x7f11d40b2760 2023-12-22T08:46:50.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.889+0000 7f11d9361640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f11d40cc670 0x7f11d40b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41992/0 (socket says 172.21.15.38:41992) 2023-12-22T08:46:50.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.889+0000 7f11d9361640 1 -- 172.21.15.38:0/2553028056 learned_addr learned my addr 172.21.15.38:0/2553028056 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:50.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.889+0000 7f11d9b62640 1 --2- 172.21.15.38:0/2553028056 >> v2:172.21.15.89:3300/0 conn(0x7f11d4144d10 0x7f11d40cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.889+0000 7f11da363640 1 --2- 172.21.15.38:0/2553028056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11d40b2760 0x7f11d4070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.889+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751875965 0 0) 0x7f11d41450f0 con 0x7f11d40cc670 2023-12-22T08:46:50.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.889+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11c0003520 con 0x7f11d40cc670 2023-12-22T08:46:50.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3888916148 0 0) 0x7f11c0003520 con 0x7f11d40cc670 2023-12-22T08:46:50.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11d40b2760 msgr2=0x7f11d4070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:50.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 --2- 172.21.15.38:0/2553028056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11d40b2760 0x7f11d4070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 >> v2:172.21.15.89:3300/0 conn(0x7f11d4144d10 msgr2=0x7f11d40cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:50.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 --2- 172.21.15.38:0/2553028056 >> v2:172.21.15.89:3300/0 conn(0x7f11d4144d10 0x7f11d40cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d40ce5d0 con 0x7f11d40cc670 2023-12-22T08:46:50.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f11c4001670 con 0x7f11d40cc670 2023-12-22T08:46:50.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 >> v1:172.21.15.38:6789/0 conn(0x7f11d40cc670 legacy=0x7f11d40b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:50.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 --2- 172.21.15.38:0/2553028056 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c0003970 0x7f11c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 --2- 172.21.15.38:0/2553028056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c00047c0 0x7f11c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 --2- 172.21.15.38:0/2553028056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11d40b2760 0x7f11c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d40ce010 con 0x7f11c0003970 2023-12-22T08:46:50.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d40ce2f0 con 0x7f11c00047c0 2023-12-22T08:46:50.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c000b980 con 0x7f11d40b2760 2023-12-22T08:46:50.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.890+0000 7f11d9b62640 1 --2- 172.21.15.38:0/2553028056 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c0003970 0x7f11c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.891+0000 7f11d9b62640 1 -- 172.21.15.38:0/2553028056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11d40b2760 msgr2=0x7f11c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:50.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.891+0000 7f11d9b62640 1 --2- 172.21.15.38:0/2553028056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11d40b2760 0x7f11c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.891+0000 7f11d9b62640 1 -- 172.21.15.38:0/2553028056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c00047c0 msgr2=0x7f11c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:50.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.891+0000 7f11d9b62640 1 --2- 172.21.15.38:0/2553028056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c00047c0 0x7f11c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.891+0000 7f11d9b62640 1 -- 172.21.15.38:0/2553028056 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0003520 con 0x7f11c0003970 2023-12-22T08:46:50.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.892+0000 7f11d9b62640 1 --2- 172.21.15.38:0/2553028056 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c0003970 0x7f11c0003d90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009af0 tx=0x7f11c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ae7a815722140a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:50.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.892+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d002c710 con 0x7f11c0003970 2023-12-22T08:46:50.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.892+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d002c870 con 0x7f11c0003970 2023-12-22T08:46:50.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.892+0000 7f11d8b60640 1 -- 172.21.15.38:0/2553028056 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d002cc00 con 0x7f11c0003970 2023-12-22T08:46:50.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.893+0000 7f11dbdc6640 1 -- 172.21.15.38:0/2553028056 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c0003970 msgr2=0x7f11c0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:50.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.893+0000 7f11dbdc6640 1 --2- 172.21.15.38:0/2553028056 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c0003970 0x7f11c0003d90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009af0 tx=0x7f11c00057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.893+0000 7f11da363640 1 -- 172.21.15.38:0/2553028056 reap_dead start 2023-12-22T08:46:50.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.893+0000 7f11dbdc6640 1 -- 172.21.15.38:0/2553028056 shutdown_connections 2023-12-22T08:46:50.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.893+0000 7f11dbdc6640 1 -- 172.21.15.38:0/2553028056 >> 172.21.15.38:0/2553028056 conn(0x7f11d40cf070 msgr2=0x7f11d40cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:50.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.893+0000 7f11dbdc6640 1 -- 172.21.15.38:0/2553028056 shutdown_connections 2023-12-22T08:46:50.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.893+0000 7f11dbdc6640 1 -- 172.21.15.38:0/2553028056 wait complete. 2023-12-22T08:46:50.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.895+0000 7f11dbdc6640 1 Processor -- start 2023-12-22T08:46:50.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.895+0000 7f11dbdc6640 1 -- start start 2023-12-22T08:46:50.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.896+0000 7f11dbdc6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c0003970 0x7f11d41f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.896+0000 7f11dbdc6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d41f05d0 0x7f11d41f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.896+0000 7f11dbdc6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11d41f6c80 0x7f11d415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.896+0000 7f11dbdc6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d41f76e0 con 0x7f11d41f6c80 2023-12-22T08:46:50.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.896+0000 7f11dbdc6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d41f36d0 con 0x7f11d41f05d0 2023-12-22T08:46:50.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.896+0000 7f11dbdc6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d41f3100 con 0x7f11c0003970 2023-12-22T08:46:50.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.897+0000 7f11da363640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11d41f6c80 0x7f11d415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.897+0000 7f11da363640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11d41f6c80 0x7f11d415a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45460/0 (socket says 172.21.15.38:45460) 2023-12-22T08:46:50.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.897+0000 7f11da363640 1 -- 172.21.15.38:0/1154491673 learned_addr learned my addr 172.21.15.38:0/1154491673 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:50.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.897+0000 7f11d9361640 1 --2- 172.21.15.38:0/1154491673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d41f05d0 0x7f11d41f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.897+0000 7f11da363640 1 -- 172.21.15.38:0/1154491673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c0003970 msgr2=0x7f11d41f3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:50.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.897+0000 7f11da363640 1 --2- 172.21.15.38:0/1154491673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c0003970 0x7f11d41f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.897+0000 7f11da363640 1 -- 172.21.15.38:0/1154491673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d41f05d0 msgr2=0x7f11d41f6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:50.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.897+0000 7f11da363640 1 --2- 172.21.15.38:0/1154491673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d41f05d0 0x7f11d41f6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:50.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.897+0000 7f11da363640 1 -- 172.21.15.38:0/1154491673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d41f7120 con 0x7f11d41f6c80 2023-12-22T08:46:50.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.897+0000 7f11da363640 1 --2- 172.21.15.38:0/1154491673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11d41f6c80 0x7f11d415a490 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f11d40b4fc0 tx=0x7f11cc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:50.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.898+0000 7f11ca7fc640 1 -- 172.21.15.38:0/1154491673 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc010040 con 0x7f11d41f6c80 2023-12-22T08:46:50.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.898+0000 7f11ca7fc640 1 -- 172.21.15.38:0/1154491673 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11cc00bae0 con 0x7f11d41f6c80 2023-12-22T08:46:50.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.898+0000 7f11dbdc6640 1 -- 172.21.15.38:0/1154491673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d41f7400 con 0x7f11d41f6c80 2023-12-22T08:46:50.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.898+0000 7f11ca7fc640 1 -- 172.21.15.38:0/1154491673 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc00be70 con 0x7f11d41f6c80 2023-12-22T08:46:50.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.898+0000 7f11dbdc6640 1 -- 172.21.15.38:0/1154491673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d41f40a0 con 0x7f11d41f6c80 2023-12-22T08:46:50.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.899+0000 7f11dbdc6640 1 -- 172.21.15.38:0/1154491673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d4061910 con 0x7f11d41f6c80 2023-12-22T08:46:50.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.900+0000 7f11ca7fc640 1 -- 172.21.15.38:0/1154491673 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f11cc01e410 con 0x7f11d41f6c80 2023-12-22T08:46:50.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.901+0000 7f11ca7fc640 1 --2- 172.21.15.38:0/1154491673 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f11b806a460 0x7f11b806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:50.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.901+0000 7f11ca7fc640 1 -- 172.21.15.38:0/1154491673 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11cc088c20 con 0x7f11d41f6c80 2023-12-22T08:46:50.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.902+0000 7f11d9b62640 1 --2- 172.21.15.38:0/1154491673 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f11b806a460 0x7f11b806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:50.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.903+0000 7f11d9b62640 1 --2- 172.21.15.38:0/1154491673 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f11b806a460 0x7f11b806c920 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f11d0036000 tx=0x7f11d002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:50.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:50.905+0000 7f11ca7fc640 1 -- 172.21.15.38:0/1154491673 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f11cc057ca0 con 0x7f11d41f6c80 2023-12-22T08:46:51.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.107+0000 7f11dbdc6640 1 -- 172.21.15.38:0/1154491673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11d41f3840 con 0x7f11d41f6c80 2023-12-22T08:46:51.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.110+0000 7f11ca7fc640 1 -- 172.21.15.38:0/1154491673 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16068 (secure 0 0 0) 0x7f11cc057830 con 0x7f11d41f6c80 2023-12-22T08:46:51.112 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:51.112 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":115,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:46:38.242259+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:46:08.930859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-22T08:46:10.036922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:46:51.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.112+0000 7f11dbdc6640 1 -- 172.21.15.38:0/1154491673 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f11b806a460 msgr2=0x7f11b806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:51.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.112+0000 7f11dbdc6640 1 --2- 172.21.15.38:0/1154491673 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f11b806a460 0x7f11b806c920 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f11d0036000 tx=0x7f11d002e000 comp rx=0 tx=0).stop 2023-12-22T08:46:51.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.112+0000 7f11dbdc6640 1 -- 172.21.15.38:0/1154491673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11d41f6c80 msgr2=0x7f11d415a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:51.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.112+0000 7f11dbdc6640 1 --2- 172.21.15.38:0/1154491673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11d41f6c80 0x7f11d415a490 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f11d40b4fc0 tx=0x7f11cc00b480 comp rx=0 tx=0).stop 2023-12-22T08:46:51.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.113+0000 7f11dbdc6640 1 -- 172.21.15.38:0/1154491673 shutdown_connections 2023-12-22T08:46:51.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.113+0000 7f11dbdc6640 1 --2- 172.21.15.38:0/1154491673 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f11b806a460 0x7f11b806c920 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.113+0000 7f11dbdc6640 1 --2- 172.21.15.38:0/1154491673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11d41f6c80 0x7f11d415a490 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.113+0000 7f11dbdc6640 1 --2- 172.21.15.38:0/1154491673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d41f05d0 0x7f11d41f6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.113+0000 7f11dbdc6640 1 --2- 172.21.15.38:0/1154491673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c0003970 0x7f11d41f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.113+0000 7f11dbdc6640 1 -- 172.21.15.38:0/1154491673 >> 172.21.15.38:0/1154491673 conn(0x7f11d40cf070 msgr2=0x7f11d40b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:51.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.113+0000 7f11dbdc6640 1 -- 172.21.15.38:0/1154491673 shutdown_connections 2023-12-22T08:46:51.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.113+0000 7f11dbdc6640 1 -- 172.21.15.38:0/1154491673 wait complete. 2023-12-22T08:46:51.134 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:46:51.134 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:46:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.353+0000 7f2291822640 1 Processor -- start 2023-12-22T08:46:51.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.353+0000 7f2291822640 1 -- start start 2023-12-22T08:46:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.354+0000 7f2291822640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f228c161720 0x7f228c0adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.354+0000 7f2291822640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f228c0ae1e0 0x7f228c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.354+0000 7f2291822640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228c0ce950 con 0x7f228c161340 2023-12-22T08:46:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.354+0000 7f2291822640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228c072170 con 0x7f228c0ae1e0 2023-12-22T08:46:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.354+0000 7f2291822640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228c0cdd40 con 0x7f228c161720 2023-12-22T08:46:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.355+0000 7f2290820640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f228c161340 0x7f228c071a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45810/0 (socket says 172.21.15.38:45810) 2023-12-22T08:46:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.355+0000 7f2290820640 1 -- 172.21.15.38:0/1427060442 learned_addr learned my addr 172.21.15.38:0/1427060442 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.355+0000 7f2291021640 1 --2- 172.21.15.38:0/1427060442 >> v2:172.21.15.38:3300/0 conn(0x7f228c0ae1e0 0x7f228c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.355+0000 7f228bfff640 1 --2- 172.21.15.38:0/1427060442 >> v2:172.21.15.89:3300/0 conn(0x7f228c161720 0x7f228c0adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.355+0000 7f228b7fe640 1 -- 172.21.15.38:0/1427060442 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363785644 0 0) 0x7f228c0ce950 con 0x7f228c161340 2023-12-22T08:46:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.355+0000 7f228b7fe640 1 -- 172.21.15.38:0/1427060442 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2274003520 con 0x7f228c161340 2023-12-22T08:46:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.355+0000 7f2291021640 1 -- 172.21.15.38:0/1427060442 >> v2:172.21.15.89:3300/0 conn(0x7f228c161720 msgr2=0x7f228c0adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.355+0000 7f2291021640 1 --2- 172.21.15.38:0/1427060442 >> v2:172.21.15.89:3300/0 conn(0x7f228c161720 0x7f228c0adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.355+0000 7f2291021640 1 -- 172.21.15.38:0/1427060442 >> v1:172.21.15.38:6789/0 conn(0x7f228c161340 legacy=0x7f228c071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.355+0000 7f2291021640 1 -- 172.21.15.38:0/1427060442 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c0ce020 con 0x7f228c0ae1e0 2023-12-22T08:46:51.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.357+0000 7f2291021640 1 --2- 172.21.15.38:0/1427060442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f228c0ae1e0 0x7f228c06f250 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2284009d90 tx=0x7f228402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1923fbe8b1cb0c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:51.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.357+0000 7f228b7fe640 1 -- 172.21.15.38:0/1427060442 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228402cbe0 con 0x7f228c0ae1e0 2023-12-22T08:46:51.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.357+0000 7f228b7fe640 1 -- 172.21.15.38:0/1427060442 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228402cd40 con 0x7f228c0ae1e0 2023-12-22T08:46:51.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.357+0000 7f228b7fe640 1 -- 172.21.15.38:0/1427060442 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2284034660 con 0x7f228c0ae1e0 2023-12-22T08:46:51.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.357+0000 7f2291822640 1 -- 172.21.15.38:0/1427060442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f228c0ae1e0 msgr2=0x7f228c06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:51.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.357+0000 7f2291822640 1 --2- 172.21.15.38:0/1427060442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f228c0ae1e0 0x7f228c06f250 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2284009d90 tx=0x7f228402be30 comp rx=0 tx=0).stop 2023-12-22T08:46:51.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.358+0000 7f2291822640 1 -- 172.21.15.38:0/1427060442 shutdown_connections 2023-12-22T08:46:51.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.358+0000 7f2291822640 1 --2- 172.21.15.38:0/1427060442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f228c0ae1e0 0x7f228c06f250 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.358+0000 7f2291822640 1 --2- 172.21.15.38:0/1427060442 >> v2:172.21.15.89:3300/0 conn(0x7f228c161720 0x7f228c0adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.358+0000 7f2291822640 1 -- 172.21.15.38:0/1427060442 >> 172.21.15.38:0/1427060442 conn(0x7f228c0b1f70 msgr2=0x7f228c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:51.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.358+0000 7f2291822640 1 -- 172.21.15.38:0/1427060442 shutdown_connections 2023-12-22T08:46:51.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.358+0000 7f2291822640 1 -- 172.21.15.38:0/1427060442 wait complete. 2023-12-22T08:46:51.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.359+0000 7f2291822640 1 Processor -- start 2023-12-22T08:46:51.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.360+0000 7f2291822640 1 -- start start 2023-12-22T08:46:51.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2291822640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f228c0ae1e0 0x7f228c156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:51.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2291822640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f228c161340 0x7f228c06c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:51.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2291822640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f228c161720 0x7f228c151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:51.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2291822640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c152420 con 0x7f228c0ae1e0 2023-12-22T08:46:51.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2291822640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c158230 con 0x7f228c161340 2023-12-22T08:46:51.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2291822640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228c158510 con 0x7f228c161720 2023-12-22T08:46:51.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2290820640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f228c0ae1e0 0x7f228c156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:51.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2290820640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f228c0ae1e0 0x7f228c156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45540/0 (socket says 172.21.15.38:45540) 2023-12-22T08:46:51.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2290820640 1 -- 172.21.15.38:0/1578651094 learned_addr learned my addr 172.21.15.38:0/1578651094 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:51.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f228bfff640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f228c161340 0x7f228c06c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:51.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2290820640 1 -- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f228c161720 msgr2=0x7f228c151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:51.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2290820640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f228c161720 0x7f228c151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2290820640 1 -- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f228c161340 msgr2=0x7f228c06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:51.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2290820640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f228c161340 0x7f228c06c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f2290820640 1 -- 172.21.15.38:0/1578651094 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2284009a70 con 0x7f228c0ae1e0 2023-12-22T08:46:51.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.361+0000 7f228bfff640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f228c161340 0x7f228c06c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:51.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.362+0000 7f2290820640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f228c0ae1e0 0x7f228c156250 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f228000c500 tx=0x7f228000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:51.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.362+0000 7f22897fa640 1 -- 172.21.15.38:0/1578651094 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280005ce0 con 0x7f228c0ae1e0 2023-12-22T08:46:51.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.362+0000 7f22897fa640 1 -- 172.21.15.38:0/1578651094 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2280005e40 con 0x7f228c0ae1e0 2023-12-22T08:46:51.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.362+0000 7f22897fa640 1 -- 172.21.15.38:0/1578651094 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280007330 con 0x7f228c0ae1e0 2023-12-22T08:46:51.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.362+0000 7f2291822640 1 -- 172.21.15.38:0/1578651094 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228c1587f0 con 0x7f228c0ae1e0 2023-12-22T08:46:51.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.362+0000 7f2291822640 1 -- 172.21.15.38:0/1578651094 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228c158db0 con 0x7f228c0ae1e0 2023-12-22T08:46:51.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.364+0000 7f2291822640 1 -- 172.21.15.38:0/1578651094 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228c0ae930 con 0x7f228c0ae1e0 2023-12-22T08:46:51.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.364+0000 7f22897fa640 1 -- 172.21.15.38:0/1578651094 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2280007550 con 0x7f228c0ae1e0 2023-12-22T08:46:51.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.365+0000 7f22897fa640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f227806a430 0x7f227806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:51.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.366+0000 7f22897fa640 1 -- 172.21.15.38:0/1578651094 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2280087ff0 con 0x7f228c0ae1e0 2023-12-22T08:46:51.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.366+0000 7f228bfff640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f227806a430 0x7f227806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:51.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.367+0000 7f228bfff640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f227806a430 0x7f227806c8f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f227c006fd0 tx=0x7f227c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:51.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.370+0000 7f22897fa640 1 -- 172.21.15.38:0/1578651094 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f22800bac80 con 0x7f228c0ae1e0 2023-12-22T08:46:51.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.601+0000 7f2291822640 1 -- 172.21.15.38:0/1578651094 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f228c061910 con 0x7f228c0ae1e0 2023-12-22T08:46:51.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.601+0000 7f22897fa640 1 -- 172.21.15.38:0/1578651094 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f22800536d0 con 0x7f228c0ae1e0 2023-12-22T08:46:51.603 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:51.603 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/4163741517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4163741517},{"type":"v1","addr":"172.21.15.89:6836","nonce":4163741517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/972467119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":972467119},{"type":"v1","addr":"172.21.15.89:6837","nonce":972467119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/2124959631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2124959631},{"type":"v1","addr":"172.21.15.38:6834","nonce":2124959631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:46:11.013927+0000","modified":"2023-12-22T08:46:14.032400+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/2733146003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2733146003},{"type":"v1","addr":"172.21.15.38:6835","nonce":2733146003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-22T08:46:51.604 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 47 2023-12-22T08:46:51.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.604+0000 7f2291822640 1 -- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f227806a430 msgr2=0x7f227806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:51.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.604+0000 7f2291822640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f227806a430 0x7f227806c8f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f227c006fd0 tx=0x7f227c008040 comp rx=0 tx=0).stop 2023-12-22T08:46:51.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.604+0000 7f2291822640 1 -- 172.21.15.38:0/1578651094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f228c0ae1e0 msgr2=0x7f228c156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:51.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.604+0000 7f2291822640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f228c0ae1e0 0x7f228c156250 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f228000c500 tx=0x7f228000c9c0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.604+0000 7f2291822640 1 -- 172.21.15.38:0/1578651094 shutdown_connections 2023-12-22T08:46:51.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.604+0000 7f2291822640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f228c161720 0x7f228c151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.604+0000 7f2291822640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f228c161340 0x7f228c06c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.604+0000 7f2291822640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f227806a430 0x7f227806c8f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.604+0000 7f2291822640 1 --2- 172.21.15.38:0/1578651094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f228c0ae1e0 0x7f228c156250 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.604+0000 7f2291822640 1 -- 172.21.15.38:0/1578651094 >> 172.21.15.38:0/1578651094 conn(0x7f228c0b1f70 msgr2=0x7f228c0719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:51.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.604+0000 7f2291822640 1 -- 172.21.15.38:0/1578651094 shutdown_connections 2023-12-22T08:46:51.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.604+0000 7f2291822640 1 -- 172.21.15.38:0/1578651094 wait complete. 2023-12-22T08:46:51.626 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:46:51.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.845+0000 7ff9b31b9640 1 Processor -- start 2023-12-22T08:46:51.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.845+0000 7ff9b31b9640 1 -- start start 2023-12-22T08:46:51.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.846+0000 7ff9b31b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9ac1547a0 0x7ff9ac15b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:51.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.846+0000 7ff9b31b9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9ac154b80 0x7ff9ac0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:51.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.846+0000 7ff9b31b9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac0716a0 con 0x7ff9ac071b90 2023-12-22T08:46:51.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.846+0000 7ff9b31b9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ac070e80 con 0x7ff9ac154b80 2023-12-22T08:46:51.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.846+0000 7ff9b31b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0710e0 con 0x7ff9ac1547a0 2023-12-22T08:46:51.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.847+0000 7ff9b0f55640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9ac1547a0 0x7ff9ac15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:51.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.847+0000 7ff9b1756640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9ac154b80 0x7ff9ac0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:51.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.847+0000 7ff9abfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff9ac071b90 0x7ff9ac070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:34592/0 (socket says 172.21.15.38:34592) 2023-12-22T08:46:51.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.847+0000 7ff9b0f55640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9ac1547a0 0x7ff9ac15b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:32792/0 (socket says 172.21.15.38:32792) 2023-12-22T08:46:51.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.847+0000 7ff9abfff640 1 -- 172.21.15.38:0/1093491670 learned_addr learned my addr 172.21.15.38:0/1093491670 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:51.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.848+0000 7ff9b0f55640 1 -- 172.21.15.38:0/1093491670 >> v2:172.21.15.89:3300/0 conn(0x7ff9ac154b80 msgr2=0x7ff9ac0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:51.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.848+0000 7ff9b0f55640 1 --2- 172.21.15.38:0/1093491670 >> v2:172.21.15.89:3300/0 conn(0x7ff9ac154b80 0x7ff9ac0ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.848+0000 7ff9b0f55640 1 -- 172.21.15.38:0/1093491670 >> v1:172.21.15.89:6789/0 conn(0x7ff9ac071b90 legacy=0x7ff9ac070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:51.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.848+0000 7ff9b0f55640 1 -- 172.21.15.38:0/1093491670 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0713c0 con 0x7ff9ac1547a0 2023-12-22T08:46:51.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.849+0000 7ff9b0f55640 1 --2- 172.21.15.38:0/1093491670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9ac1547a0 0x7ff9ac15b300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00097a0 tx=0x7ff9a002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c4c5517bd9c3f9e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:51.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.850+0000 7ff9ab7fe640 1 -- 172.21.15.38:0/1093491670 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a002d040 con 0x7ff9ac1547a0 2023-12-22T08:46:51.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.850+0000 7ff9ab7fe640 1 -- 172.21.15.38:0/1093491670 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a0031810 con 0x7ff9ac1547a0 2023-12-22T08:46:51.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.850+0000 7ff9ab7fe640 1 -- 172.21.15.38:0/1093491670 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0031ba0 con 0x7ff9ac1547a0 2023-12-22T08:46:51.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.851+0000 7ff9b31b9640 1 -- 172.21.15.38:0/1093491670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9ac1547a0 msgr2=0x7ff9ac15b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:51.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.851+0000 7ff9b31b9640 1 --2- 172.21.15.38:0/1093491670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9ac1547a0 0x7ff9ac15b300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00097a0 tx=0x7ff9a002b8b0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.851+0000 7ff9b31b9640 1 -- 172.21.15.38:0/1093491670 shutdown_connections 2023-12-22T08:46:51.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.851+0000 7ff9b31b9640 1 --2- 172.21.15.38:0/1093491670 >> v2:172.21.15.89:3300/0 conn(0x7ff9ac154b80 0x7ff9ac0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.851+0000 7ff9b31b9640 1 --2- 172.21.15.38:0/1093491670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9ac1547a0 0x7ff9ac15b300 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.851+0000 7ff9b31b9640 1 -- 172.21.15.38:0/1093491670 >> 172.21.15.38:0/1093491670 conn(0x7ff9ac0cf070 msgr2=0x7ff9ac0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:51.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.851+0000 7ff9b31b9640 1 -- 172.21.15.38:0/1093491670 shutdown_connections 2023-12-22T08:46:51.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.851+0000 7ff9b31b9640 1 -- 172.21.15.38:0/1093491670 wait complete. 2023-12-22T08:46:51.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.853+0000 7ff9b31b9640 1 Processor -- start 2023-12-22T08:46:51.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.853+0000 7ff9b31b9640 1 -- start start 2023-12-22T08:46:51.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.854+0000 7ff9b31b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9ac071b90 0x7ff9ac0cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:51.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.854+0000 7ff9b31b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9ac1547a0 0x7ff9ac159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:51.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.854+0000 7ff9b31b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9ac154b80 0x7ff9ac1f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:51.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.854+0000 7ff9b31b9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0cdef0 con 0x7ff9ac1547a0 2023-12-22T08:46:51.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.854+0000 7ff9b31b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac159aa0 con 0x7ff9ac071b90 2023-12-22T08:46:51.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.854+0000 7ff9b31b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0ad2a0 con 0x7ff9ac154b80 2023-12-22T08:46:51.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.854+0000 7ff9abfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9ac1547a0 0x7ff9ac159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:51.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.854+0000 7ff9abfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9ac1547a0 0x7ff9ac159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45552/0 (socket says 172.21.15.38:45552) 2023-12-22T08:46:51.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.854+0000 7ff9abfff640 1 -- 172.21.15.38:0/154364836 learned_addr learned my addr 172.21.15.38:0/154364836 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:51.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.855+0000 7ff9b0f55640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9ac071b90 0x7ff9ac0cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:51.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.855+0000 7ff9b1756640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9ac154b80 0x7ff9ac1f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:51.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.855+0000 7ff9abfff640 1 -- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9ac154b80 msgr2=0x7ff9ac1f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:51.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.855+0000 7ff9abfff640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9ac154b80 0x7ff9ac1f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.855+0000 7ff9abfff640 1 -- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9ac071b90 msgr2=0x7ff9ac0cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.855+0000 7ff9abfff640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9ac071b90 0x7ff9ac0cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.855+0000 7ff9abfff640 1 -- 172.21.15.38:0/154364836 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0009400 con 0x7ff9ac1547a0 2023-12-22T08:46:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.855+0000 7ff9b0f55640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9ac071b90 0x7ff9ac0cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.855+0000 7ff9abfff640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9ac1547a0 0x7ff9ac159560 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7ff99800c4a0 tx=0x7ff99800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.855+0000 7ff9a97fa640 1 -- 172.21.15.38:0/154364836 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998005ce0 con 0x7ff9ac1547a0 2023-12-22T08:46:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.855+0000 7ff9a97fa640 1 -- 172.21.15.38:0/154364836 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff998005e40 con 0x7ff9ac1547a0 2023-12-22T08:46:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.855+0000 7ff9b31b9640 1 -- 172.21.15.38:0/154364836 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac0addc0 con 0x7ff9ac1547a0 2023-12-22T08:46:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.855+0000 7ff9a97fa640 1 -- 172.21.15.38:0/154364836 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998007270 con 0x7ff9ac1547a0 2023-12-22T08:46:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.856+0000 7ff9b31b9640 1 -- 172.21.15.38:0/154364836 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac0ada50 con 0x7ff9ac1547a0 2023-12-22T08:46:51.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.857+0000 7ff9b31b9640 1 -- 172.21.15.38:0/154364836 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac0adbe0 con 0x7ff9ac1547a0 2023-12-22T08:46:51.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.858+0000 7ff9a97fa640 1 -- 172.21.15.38:0/154364836 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff998007490 con 0x7ff9ac1547a0 2023-12-22T08:46:51.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.858+0000 7ff9a97fa640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff99006a430 0x7ff99006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:51.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.859+0000 7ff9a97fa640 1 -- 172.21.15.38:0/154364836 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff998087db0 con 0x7ff9ac1547a0 2023-12-22T08:46:51.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.859+0000 7ff9b0f55640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff99006a430 0x7ff99006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:51.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.860+0000 7ff9b0f55640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff99006a430 0x7ff99006c8f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0036000 tx=0x7ff9a003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:51.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:51.863+0000 7ff9a97fa640 1 -- 172.21.15.38:0/154364836 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff99808c070 con 0x7ff9ac1547a0 2023-12-22T08:46:52.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.092+0000 7ff9b31b9640 1 -- 172.21.15.38:0/154364836 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9ac0ad5a0 con 0x7ff9ac1547a0 2023-12-22T08:46:52.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.093+0000 7ff9a97fa640 1 -- 172.21.15.38:0/154364836 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4647 (secure 0 0 0) 0x7ff998017090 con 0x7ff9ac1547a0 2023-12-22T08:46:52.095 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:52.095 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/4163741517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4163741517},{"type":"v1","addr":"172.21.15.89:6836","nonce":4163741517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/972467119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":972467119},{"type":"v1","addr":"172.21.15.89:6837","nonce":972467119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/2124959631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2124959631},{"type":"v1","addr":"172.21.15.38:6834","nonce":2124959631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:46:11.013927+0000","modified":"2023-12-22T08:46:14.032400+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/2733146003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2733146003},{"type":"v1","addr":"172.21.15.38:6835","nonce":2733146003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-22T08:46:52.095 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 47 2023-12-22T08:46:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.095+0000 7ff9b31b9640 1 -- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff99006a430 msgr2=0x7ff99006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.095+0000 7ff9b31b9640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff99006a430 0x7ff99006c8f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0036000 tx=0x7ff9a003c040 comp rx=0 tx=0).stop 2023-12-22T08:46:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.095+0000 7ff9b31b9640 1 -- 172.21.15.38:0/154364836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9ac1547a0 msgr2=0x7ff9ac159560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.095+0000 7ff9b31b9640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9ac1547a0 0x7ff9ac159560 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7ff99800c4a0 tx=0x7ff99800c960 comp rx=0 tx=0).stop 2023-12-22T08:46:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.096+0000 7ff9b31b9640 1 -- 172.21.15.38:0/154364836 shutdown_connections 2023-12-22T08:46:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.096+0000 7ff9b31b9640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9ac154b80 0x7ff9ac1f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.096+0000 7ff9b31b9640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff99006a430 0x7ff99006c8f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.096+0000 7ff9b31b9640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9ac1547a0 0x7ff9ac159560 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.096+0000 7ff9b31b9640 1 --2- 172.21.15.38:0/154364836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9ac071b90 0x7ff9ac0cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.096+0000 7ff9b31b9640 1 -- 172.21.15.38:0/154364836 >> 172.21.15.38:0/154364836 conn(0x7ff9ac0cf070 msgr2=0x7ff9ac070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:52.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.096+0000 7ff9b31b9640 1 -- 172.21.15.38:0/154364836 shutdown_connections 2023-12-22T08:46:52.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.096+0000 7ff9b31b9640 1 -- 172.21.15.38:0/154364836 wait complete. 2023-12-22T08:46:52.119 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:46:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.348+0000 7fa63a11b640 1 Processor -- start 2023-12-22T08:46:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.348+0000 7fa63a11b640 1 -- start start 2023-12-22T08:46:52.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.349+0000 7fa63a11b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa6340cb4c0 0x7fa63415e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.349+0000 7fa63a11b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6340706d0 con 0x7fa63406d210 2023-12-22T08:46:52.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.350+0000 7fa63a11b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6340cbf40 con 0x7fa63406d5f0 2023-12-22T08:46:52.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.350+0000 7fa63a11b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6340ce840 con 0x7fa6340cb4c0 2023-12-22T08:46:52.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.350+0000 7fa639119640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa63406d210 0x7fa634159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45816/0 (socket says 172.21.15.38:45816) 2023-12-22T08:46:52.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.350+0000 7fa639119640 1 -- 172.21.15.38:0/1964078062 learned_addr learned my addr 172.21.15.38:0/1964078062 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:52.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.350+0000 7fa638918640 1 --2- 172.21.15.38:0/1964078062 >> v2:172.21.15.89:3300/0 conn(0x7fa6340cb4c0 0x7fa63415e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.350+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564316286 0 0) 0x7fa6340706d0 con 0x7fa63406d210 2023-12-22T08:46:52.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.350+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa620003520 con 0x7fa63406d210 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2615598213 0 0) 0x7fa620003520 con 0x7fa63406d210 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 >> v2:172.21.15.89:3300/0 conn(0x7fa6340cb4c0 msgr2=0x7fa63415e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa62bfff640 1 --2- 172.21.15.38:0/1964078062 >> v2:172.21.15.89:3300/0 conn(0x7fa6340cb4c0 0x7fa63415e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 >> v1:172.21.15.89:6789/0 conn(0x7fa63406d5f0 legacy=0x7fa634070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6340ceb20 con 0x7fa63406d210 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fa630001670 con 0x7fa63406d210 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 >> v1:172.21.15.38:6789/0 conn(0x7fa63406d210 legacy=0x7fa634159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa62bfff640 1 --2- 172.21.15.38:0/1964078062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa620003970 0x7fa620003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa62bfff640 1 --2- 172.21.15.38:0/1964078062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6200047c0 0x7fa620004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa62bfff640 1 --2- 172.21.15.38:0/1964078062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620005180 0x7fa62000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340ce840 con 0x7fa620003970 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62000e230 con 0x7fa620005180 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62000e3f0 con 0x7fa6200047c0 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.351+0000 7fa639119640 1 --2- 172.21.15.38:0/1964078062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa620003970 0x7fa620003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.352+0000 7fa639119640 1 -- 172.21.15.38:0/1964078062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6200047c0 msgr2=0x7fa620004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:52.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.352+0000 7fa638918640 1 --2- 172.21.15.38:0/1964078062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6200047c0 0x7fa620004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.352+0000 7fa63991a640 1 --2- 172.21.15.38:0/1964078062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620005180 0x7fa62000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.352+0000 7fa639119640 1 --2- 172.21.15.38:0/1964078062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6200047c0 0x7fa620004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.352+0000 7fa639119640 1 -- 172.21.15.38:0/1964078062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620005180 msgr2=0x7fa62000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:52.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.352+0000 7fa639119640 1 --2- 172.21.15.38:0/1964078062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620005180 0x7fa62000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.352+0000 7fa639119640 1 -- 172.21.15.38:0/1964078062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa620003520 con 0x7fa620003970 2023-12-22T08:46:52.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.352+0000 7fa638918640 1 --2- 172.21.15.38:0/1964078062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6200047c0 0x7fa620004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:52.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.352+0000 7fa63991a640 1 --2- 172.21.15.38:0/1964078062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620005180 0x7fa62000db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:52.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.352+0000 7fa63991a640 1 -- 172.21.15.38:0/1964078062 reap_dead start 2023-12-22T08:46:52.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.353+0000 7fa639119640 1 --2- 172.21.15.38:0/1964078062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa620003970 0x7fa620003d90 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fa63000c190 tx=0x7fa6200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b37b23f3e5116f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:52.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.353+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630005ad0 con 0x7fa620003970 2023-12-22T08:46:52.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.353+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa630005c30 con 0x7fa620003970 2023-12-22T08:46:52.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.353+0000 7fa62bfff640 1 -- 172.21.15.38:0/1964078062 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63002caf0 con 0x7fa620003970 2023-12-22T08:46:52.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.354+0000 7fa63a11b640 1 -- 172.21.15.38:0/1964078062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa620003970 msgr2=0x7fa620003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:52.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.354+0000 7fa63a11b640 1 --2- 172.21.15.38:0/1964078062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa620003970 0x7fa620003d90 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fa63000c190 tx=0x7fa6200057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.354+0000 7fa63a11b640 1 -- 172.21.15.38:0/1964078062 shutdown_connections 2023-12-22T08:46:52.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.354+0000 7fa63a11b640 1 --2- 172.21.15.38:0/1964078062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa620003970 0x7fa620003d90 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.354+0000 7fa63a11b640 1 -- 172.21.15.38:0/1964078062 >> 172.21.15.38:0/1964078062 conn(0x7fa6340b1f70 msgr2=0x7fa6340b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:52.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.354+0000 7fa63a11b640 1 -- 172.21.15.38:0/1964078062 shutdown_connections 2023-12-22T08:46:52.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.354+0000 7fa63a11b640 1 -- 172.21.15.38:0/1964078062 wait complete. 2023-12-22T08:46:52.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.356+0000 7fa63a11b640 1 Processor -- start 2023-12-22T08:46:52.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.356+0000 7fa63a11b640 1 -- start start 2023-12-22T08:46:52.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.357+0000 7fa63a11b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa620003970 0x7fa634151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.357+0000 7fa63a11b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6341f2960 0x7fa6341f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.357+0000 7fa63a11b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa63409f000 0x7fa63409f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.357+0000 7fa63a11b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63409f9c0 con 0x7fa6341f2960 2023-12-22T08:46:52.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.357+0000 7fa63a11b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa634151ac0 con 0x7fa63409f000 2023-12-22T08:46:52.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.357+0000 7fa63a11b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa634151850 con 0x7fa620003970 2023-12-22T08:46:52.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.357+0000 7fa638918640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6341f2960 0x7fa6341f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.357+0000 7fa638918640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6341f2960 0x7fa6341f2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45564/0 (socket says 172.21.15.38:45564) 2023-12-22T08:46:52.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.357+0000 7fa638918640 1 -- 172.21.15.38:0/735504145 learned_addr learned my addr 172.21.15.38:0/735504145 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:52.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.358+0000 7fa63991a640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa63409f000 0x7fa63409f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.358+0000 7fa639119640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa620003970 0x7fa634151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.358+0000 7fa638918640 1 -- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa620003970 msgr2=0x7fa634151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:52.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.358+0000 7fa638918640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa620003970 0x7fa634151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.358+0000 7fa638918640 1 -- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa63409f000 msgr2=0x7fa63409f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:52.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.358+0000 7fa638918640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa63409f000 0x7fa63409f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.358+0000 7fa638918640 1 -- 172.21.15.38:0/735504145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6341f34c0 con 0x7fa6341f2960 2023-12-22T08:46:52.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.358+0000 7fa63991a640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa63409f000 0x7fa63409f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:46:52.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.358+0000 7fa638918640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6341f2960 0x7fa6341f2de0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fa6240107f0 tx=0x7fa624010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:52.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.359+0000 7fa629ffb640 1 -- 172.21.15.38:0/735504145 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62400eb60 con 0x7fa6341f2960 2023-12-22T08:46:52.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.359+0000 7fa629ffb640 1 -- 172.21.15.38:0/735504145 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62400ecc0 con 0x7fa6341f2960 2023-12-22T08:46:52.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.359+0000 7fa629ffb640 1 -- 172.21.15.38:0/735504145 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62401c400 con 0x7fa6341f2960 2023-12-22T08:46:52.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.359+0000 7fa63a11b640 1 -- 172.21.15.38:0/735504145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6341f37a0 con 0x7fa6341f2960 2023-12-22T08:46:52.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.359+0000 7fa63a11b640 1 -- 172.21.15.38:0/735504145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa634151ff0 con 0x7fa6341f2960 2023-12-22T08:46:52.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.360+0000 7fa63a11b640 1 -- 172.21.15.38:0/735504145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa634061910 con 0x7fa6341f2960 2023-12-22T08:46:52.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.361+0000 7fa629ffb640 1 -- 172.21.15.38:0/735504145 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa62401c580 con 0x7fa6341f2960 2023-12-22T08:46:52.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.362+0000 7fa629ffb640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa61806a430 0x7fa61806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.362+0000 7fa629ffb640 1 -- 172.21.15.38:0/735504145 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa624088e10 con 0x7fa6341f2960 2023-12-22T08:46:52.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.363+0000 7fa639119640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa61806a430 0x7fa61806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.364+0000 7fa639119640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa61806a430 0x7fa61806c8f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa630034000 tx=0x7fa630009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:52.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.366+0000 7fa629ffb640 1 -- 172.21.15.38:0/735504145 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa62408c030 con 0x7fa6341f2960 2023-12-22T08:46:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.562+0000 7fa63a11b640 1 -- 172.21.15.38:0/735504145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6340b2e10 con 0x7fa6341f2960 2023-12-22T08:46:52.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.565+0000 7fa629ffb640 1 -- 172.21.15.38:0/735504145 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16068 (secure 0 0 0) 0x7fa624054360 con 0x7fa6341f2960 2023-12-22T08:46:52.567 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:52.567 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":115,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:46:38.242259+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:46:08.930859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-22T08:46:10.036922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:46:52.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.568+0000 7fa63a11b640 1 -- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa61806a430 msgr2=0x7fa61806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:52.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.568+0000 7fa63a11b640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa61806a430 0x7fa61806c8f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa630034000 tx=0x7fa630009030 comp rx=0 tx=0).stop 2023-12-22T08:46:52.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.568+0000 7fa63a11b640 1 -- 172.21.15.38:0/735504145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6341f2960 msgr2=0x7fa6341f2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:52.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.568+0000 7fa63a11b640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6341f2960 0x7fa6341f2de0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fa6240107f0 tx=0x7fa624010cb0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.568+0000 7fa63a11b640 1 -- 172.21.15.38:0/735504145 shutdown_connections 2023-12-22T08:46:52.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.568+0000 7fa63a11b640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa63409f000 0x7fa63409f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.568+0000 7fa63a11b640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa61806a430 0x7fa61806c8f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.568+0000 7fa63a11b640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6341f2960 0x7fa6341f2de0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.568+0000 7fa63a11b640 1 --2- 172.21.15.38:0/735504145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa620003970 0x7fa634151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.568+0000 7fa63a11b640 1 -- 172.21.15.38:0/735504145 >> 172.21.15.38:0/735504145 conn(0x7fa6340b1f70 msgr2=0x7fa63415c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:52.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.568+0000 7fa63a11b640 1 -- 172.21.15.38:0/735504145 shutdown_connections 2023-12-22T08:46:52.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.568+0000 7fa63a11b640 1 -- 172.21.15.38:0/735504145 wait complete. 2023-12-22T08:46:52.591 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T08:46:52.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.818+0000 7f2d9b18f640 1 Processor -- start 2023-12-22T08:46:52.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.818+0000 7f2d9b18f640 1 -- start start 2023-12-22T08:46:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.819+0000 7f2d9b18f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2d9415ad90 0x7f2d940caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.819+0000 7f2d9b18f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2d94161bb0 0x7f2d940cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.819+0000 7f2d9b18f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9415e630 con 0x7f2d9415d940 2023-12-22T08:46:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.819+0000 7f2d9b18f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d940ce2c0 con 0x7f2d9415ad90 2023-12-22T08:46:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.819+0000 7f2d9b18f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9415e910 con 0x7f2d94161bb0 2023-12-22T08:46:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.820+0000 7f2d9a18d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2d9415ad90 0x7f2d940caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.820+0000 7f2d9a18d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2d9415ad90 0x7f2d940caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45580/0 (socket says 172.21.15.38:45580) 2023-12-22T08:46:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.820+0000 7f2d9a18d640 1 -- 172.21.15.38:0/2141530274 learned_addr learned my addr 172.21.15.38:0/2141530274 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.820+0000 7f2d9998c640 1 --2- 172.21.15.38:0/2141530274 >> v2:172.21.15.89:3300/0 conn(0x7f2d94161bb0 0x7f2d940cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.820+0000 7f2d9a18d640 1 -- 172.21.15.38:0/2141530274 >> v2:172.21.15.89:3300/0 conn(0x7f2d94161bb0 msgr2=0x7f2d940cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.820+0000 7f2d9a18d640 1 --2- 172.21.15.38:0/2141530274 >> v2:172.21.15.89:3300/0 conn(0x7f2d94161bb0 0x7f2d940cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.820+0000 7f2d9a18d640 1 -- 172.21.15.38:0/2141530274 >> v1:172.21.15.89:6789/0 conn(0x7f2d9415d940 legacy=0x7f2d9415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.820+0000 7f2d9a18d640 1 -- 172.21.15.38:0/2141530274 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d941610d0 con 0x7f2d9415ad90 2023-12-22T08:46:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.820+0000 7f2d9998c640 1 --2- 172.21.15.38:0/2141530274 >> v2:172.21.15.89:3300/0 conn(0x7f2d94161bb0 0x7f2d940cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.821+0000 7f2d9a18d640 1 --2- 172.21.15.38:0/2141530274 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d9415ad90 0x7f2d940caed0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f2d940d0d40 tx=0x7f2d8802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd248b72dfeef772 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.822+0000 7f2d9918b640 1 -- 172.21.15.38:0/2141530274 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8802ca80 con 0x7f2d9415ad90 2023-12-22T08:46:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.822+0000 7f2d9918b640 1 -- 172.21.15.38:0/2141530274 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8802cbe0 con 0x7f2d9415ad90 2023-12-22T08:46:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.822+0000 7f2d9918b640 1 -- 172.21.15.38:0/2141530274 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d880343f0 con 0x7f2d9415ad90 2023-12-22T08:46:52.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.822+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2141530274 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d9415ad90 msgr2=0x7f2d940caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:52.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.822+0000 7f2d9b18f640 1 --2- 172.21.15.38:0/2141530274 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d9415ad90 0x7f2d940caed0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f2d940d0d40 tx=0x7f2d8802bee0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.823+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2141530274 shutdown_connections 2023-12-22T08:46:52.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.823+0000 7f2d9b18f640 1 --2- 172.21.15.38:0/2141530274 >> v2:172.21.15.89:3300/0 conn(0x7f2d94161bb0 0x7f2d940cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.823+0000 7f2d9b18f640 1 --2- 172.21.15.38:0/2141530274 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d9415ad90 0x7f2d940caed0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.823+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2141530274 >> 172.21.15.38:0/2141530274 conn(0x7f2d940d31c0 msgr2=0x7f2d940d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:52.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.823+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2141530274 shutdown_connections 2023-12-22T08:46:52.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.823+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2141530274 wait complete. 2023-12-22T08:46:52.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.825+0000 7f2d9b18f640 1 Processor -- start 2023-12-22T08:46:52.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.825+0000 7f2d9b18f640 1 -- start start 2023-12-22T08:46:52.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9b18f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d9415ad90 0x7f2d94157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9b18f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d9415d940 0x7f2d9415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9b18f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d94161bb0 0x7f2d941f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9b18f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d941f3440 con 0x7f2d9415ad90 2023-12-22T08:46:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9b18f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d941f3720 con 0x7f2d9415d940 2023-12-22T08:46:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9b18f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d94156a60 con 0x7f2d94161bb0 2023-12-22T08:46:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9a18d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d9415ad90 0x7f2d94157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9a18d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d9415ad90 0x7f2d94157260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45584/0 (socket says 172.21.15.38:45584) 2023-12-22T08:46:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9a18d640 1 -- 172.21.15.38:0/2357321319 learned_addr learned my addr 172.21.15.38:0/2357321319 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9998c640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d9415d940 0x7f2d9415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9a98e640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d94161bb0 0x7f2d941f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9a18d640 1 -- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d94161bb0 msgr2=0x7f2d941f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9a18d640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d94161bb0 0x7f2d941f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9a18d640 1 -- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d9415d940 msgr2=0x7f2d9415c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9a18d640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d9415d940 0x7f2d9415c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.826+0000 7f2d9a18d640 1 -- 172.21.15.38:0/2357321319 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d88009b30 con 0x7f2d9415ad90 2023-12-22T08:46:52.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.827+0000 7f2d9998c640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d9415d940 0x7f2d9415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:52.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.827+0000 7f2d9a98e640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d94161bb0 0x7f2d941f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:52.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.827+0000 7f2d9a18d640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d9415ad90 0x7f2d94157260 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009e50 tx=0x7f2d88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:52.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.827+0000 7f2d92ffd640 1 -- 172.21.15.38:0/2357321319 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8803e450 con 0x7f2d9415ad90 2023-12-22T08:46:52.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.827+0000 7f2d92ffd640 1 -- 172.21.15.38:0/2357321319 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8803e5f0 con 0x7f2d9415ad90 2023-12-22T08:46:52.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.827+0000 7f2d92ffd640 1 -- 172.21.15.38:0/2357321319 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8803e9a0 con 0x7f2d9415ad90 2023-12-22T08:46:52.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.827+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2357321319 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d94156d40 con 0x7f2d9415ad90 2023-12-22T08:46:52.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.827+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2357321319 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d941f6130 con 0x7f2d9415ad90 2023-12-22T08:46:52.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.829+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2357321319 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d941f62c0 con 0x7f2d9415ad90 2023-12-22T08:46:52.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.829+0000 7f2d92ffd640 1 -- 172.21.15.38:0/2357321319 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2d8802cd50 con 0x7f2d9415ad90 2023-12-22T08:46:52.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.830+0000 7f2d92ffd640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2d7806a430 0x7f2d7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:52.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.830+0000 7f2d92ffd640 1 -- 172.21.15.38:0/2357321319 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d880ab560 con 0x7f2d9415ad90 2023-12-22T08:46:52.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.831+0000 7f2d9998c640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2d7806a430 0x7f2d7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.832+0000 7f2d9998c640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2d7806a430 0x7f2d7806c8f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2d80006fd0 tx=0x7f2d80008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:52.835+0000 7f2d92ffd640 1 -- 172.21.15.38:0/2357321319 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2d88076b40 con 0x7f2d9415ad90 2023-12-22T08:46:53.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.065+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2357321319 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2d94061910 con 0x7f2d9415ad90 2023-12-22T08:46:53.069 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:46:53.067+0000 7f0a26ee3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T08:46:53.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.087+0000 7f2d92ffd640 1 -- 172.21.15.38:0/2357321319 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2d8807a160 con 0x7f2d9415ad90 2023-12-22T08:46:53.088 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T08:46:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.089+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2d7806a430 msgr2=0x7f2d7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.089+0000 7f2d9b18f640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2d7806a430 0x7f2d7806c8f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2d80006fd0 tx=0x7f2d80008040 comp rx=0 tx=0).stop 2023-12-22T08:46:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.089+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2357321319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d9415ad90 msgr2=0x7f2d94157260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.089+0000 7f2d9b18f640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d9415ad90 0x7f2d94157260 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009e50 tx=0x7f2d88004a40 comp rx=0 tx=0).stop 2023-12-22T08:46:53.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.090+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2357321319 shutdown_connections 2023-12-22T08:46:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.090+0000 7f2d9b18f640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d94161bb0 0x7f2d941f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.090+0000 7f2d9b18f640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d9415d940 0x7f2d9415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.090+0000 7f2d9b18f640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2d7806a430 0x7f2d7806c8f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.090+0000 7f2d9b18f640 1 --2- 172.21.15.38:0/2357321319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2d9415ad90 0x7f2d94157260 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.090+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2357321319 >> 172.21.15.38:0/2357321319 conn(0x7f2d940d31c0 msgr2=0x7f2d94159d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.090+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2357321319 shutdown_connections 2023-12-22T08:46:53.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.090+0000 7f2d9b18f640 1 -- 172.21.15.38:0/2357321319 wait complete. 2023-12-22T08:46:53.110 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T08:46:53.156 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:46:53.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.298+0000 7f726a65b640 1 Processor -- start 2023-12-22T08:46:53.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.298+0000 7f726a65b640 1 -- start start 2023-12-22T08:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.299+0000 7f726a65b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f726415b0e0 0x7f726415b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.300+0000 7f726a65b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f726409c980 0x7f726415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:53.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.300+0000 7f726a65b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726415edf0 con 0x7f7264071460 2023-12-22T08:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.300+0000 7f726a65b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726415bd90 con 0x7f726409c980 2023-12-22T08:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.300+0000 7f726a65b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726415c070 con 0x7f726415b0e0 2023-12-22T08:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.300+0000 7f7268e58640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f726409c980 0x7f726415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.300+0000 7f7268e58640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f726409c980 0x7f726415c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45612/0 (socket says 172.21.15.38:45612) 2023-12-22T08:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.300+0000 7f7268e58640 1 -- 172.21.15.38:0/2669949161 learned_addr learned my addr 172.21.15.38:0/2669949161 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.300+0000 7f7269659640 1 --2- 172.21.15.38:0/2669949161 >> v2:172.21.15.89:3300/0 conn(0x7f726415b0e0 0x7f726415b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.300+0000 7f7268e58640 1 -- 172.21.15.38:0/2669949161 >> v2:172.21.15.89:3300/0 conn(0x7f726415b0e0 msgr2=0x7f726415b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:53.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.301+0000 7f7268e58640 1 --2- 172.21.15.38:0/2669949161 >> v2:172.21.15.89:3300/0 conn(0x7f726415b0e0 0x7f726415b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.301+0000 7f7268e58640 1 -- 172.21.15.38:0/2669949161 >> v1:172.21.15.89:6789/0 conn(0x7f7264071460 legacy=0x7f7264071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.301+0000 7f7268e58640 1 -- 172.21.15.38:0/2669949161 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726415c350 con 0x7f726409c980 2023-12-22T08:46:53.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.301+0000 7f7269659640 1 --2- 172.21.15.38:0/2669949161 >> v2:172.21.15.89:3300/0 conn(0x7f726415b0e0 0x7f726415b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.302+0000 7f7268e58640 1 --2- 172.21.15.38:0/2669949161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f726409c980 0x7f726415c9c0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f72640b1c60 tx=0x7f725402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989bc81c5470d5d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.302+0000 7f725bfff640 1 -- 172.21.15.38:0/2669949161 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254031750 con 0x7f726409c980 2023-12-22T08:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.302+0000 7f725bfff640 1 -- 172.21.15.38:0/2669949161 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72540318b0 con 0x7f726409c980 2023-12-22T08:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.302+0000 7f725bfff640 1 -- 172.21.15.38:0/2669949161 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254031c40 con 0x7f726409c980 2023-12-22T08:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.302+0000 7f726a65b640 1 -- 172.21.15.38:0/2669949161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f726409c980 msgr2=0x7f726415c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.302+0000 7f726a65b640 1 --2- 172.21.15.38:0/2669949161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f726409c980 0x7f726415c9c0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f72640b1c60 tx=0x7f725402b7f0 comp rx=0 tx=0).stop 2023-12-22T08:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.303+0000 7f726a65b640 1 -- 172.21.15.38:0/2669949161 shutdown_connections 2023-12-22T08:46:53.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.303+0000 7f726a65b640 1 --2- 172.21.15.38:0/2669949161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f726409c980 0x7f726415c9c0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.303+0000 7f726a65b640 1 --2- 172.21.15.38:0/2669949161 >> v2:172.21.15.89:3300/0 conn(0x7f726415b0e0 0x7f726415b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.303+0000 7f726a65b640 1 -- 172.21.15.38:0/2669949161 >> 172.21.15.38:0/2669949161 conn(0x7f72640cf000 msgr2=0x7f72640cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.303+0000 7f726a65b640 1 -- 172.21.15.38:0/2669949161 shutdown_connections 2023-12-22T08:46:53.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.303+0000 7f726a65b640 1 -- 172.21.15.38:0/2669949161 wait complete. 2023-12-22T08:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.304+0000 7f726a65b640 1 Processor -- start 2023-12-22T08:46:53.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.305+0000 7f726a65b640 1 -- start start 2023-12-22T08:46:53.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.305+0000 7f726a65b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7264071460 0x7f726409d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.305+0000 7f726a65b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f726409c980 0x7f726414b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.306+0000 7f726a65b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f726415b0e0 0x7f72640b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.306+0000 7f726a65b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726414c520 con 0x7f7264071460 2023-12-22T08:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.306+0000 7f726a65b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7264150c20 con 0x7f726409c980 2023-12-22T08:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.306+0000 7f726a65b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726414b8a0 con 0x7f726415b0e0 2023-12-22T08:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.306+0000 7f7269659640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7264071460 0x7f726409d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:53.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.306+0000 7f7269659640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7264071460 0x7f726409d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45614/0 (socket says 172.21.15.38:45614) 2023-12-22T08:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.306+0000 7f7269659640 1 -- 172.21.15.38:0/2407303546 learned_addr learned my addr 172.21.15.38:0/2407303546 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.306+0000 7f7269e5a640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f726415b0e0 0x7f72640b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.306+0000 7f7268e58640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f726409c980 0x7f726414b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.307+0000 7f7269659640 1 -- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f726415b0e0 msgr2=0x7f72640b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.307+0000 7f7269659640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f726415b0e0 0x7f72640b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.307+0000 7f7269659640 1 -- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f726409c980 msgr2=0x7f726414b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.307+0000 7f7269659640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f726409c980 0x7f726414b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.307+0000 7f7269659640 1 -- 172.21.15.38:0/2407303546 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72540094d0 con 0x7f7264071460 2023-12-22T08:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.307+0000 7f7269659640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7264071460 0x7f726409d750 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f726000c7f0 tx=0x7f726000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.307+0000 7f7259ffb640 1 -- 172.21.15.38:0/2407303546 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260007820 con 0x7f7264071460 2023-12-22T08:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.307+0000 7f7259ffb640 1 -- 172.21.15.38:0/2407303546 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7260007980 con 0x7f7264071460 2023-12-22T08:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.307+0000 7f7259ffb640 1 -- 172.21.15.38:0/2407303546 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260007cf0 con 0x7f7264071460 2023-12-22T08:46:53.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.307+0000 7f726a65b640 1 -- 172.21.15.38:0/2407303546 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726414bb80 con 0x7f7264071460 2023-12-22T08:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.307+0000 7f726a65b640 1 -- 172.21.15.38:0/2407303546 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726414c140 con 0x7f7264071460 2023-12-22T08:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.308+0000 7f726a65b640 1 -- 172.21.15.38:0/2407303546 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7264061910 con 0x7f7264071460 2023-12-22T08:46:53.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.309+0000 7f7259ffb640 1 -- 172.21.15.38:0/2407303546 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f72600113f0 con 0x7f7264071460 2023-12-22T08:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.310+0000 7f7259ffb640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f724806a430 0x7f724806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.310+0000 7f7259ffb640 1 -- 172.21.15.38:0/2407303546 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7260088c10 con 0x7f7264071460 2023-12-22T08:46:53.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.311+0000 7f7268e58640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f724806a430 0x7f724806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:53.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.312+0000 7f7268e58640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f724806a430 0x7f724806c8f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7254035000 tx=0x7f7254008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:53.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.314+0000 7f7259ffb640 1 -- 172.21.15.38:0/2407303546 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7260054230 con 0x7f7264071460 2023-12-22T08:46:53.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:53.548+0000 7f726a65b640 1 -- 172.21.15.38:0/2407303546 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f726415b9b0 con 0x7f7264071460 2023-12-22T08:46:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.092+0000 7f7259ffb640 1 -- 172.21.15.38:0/2407303546 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7260057850 con 0x7f7264071460 2023-12-22T08:46:54.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.096+0000 7f726a65b640 1 -- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f724806a430 msgr2=0x7f724806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:54.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.096+0000 7f726a65b640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f724806a430 0x7f724806c8f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7254035000 tx=0x7f7254008030 comp rx=0 tx=0).stop 2023-12-22T08:46:54.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.096+0000 7f726a65b640 1 -- 172.21.15.38:0/2407303546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7264071460 msgr2=0x7f726409d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:54.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.096+0000 7f726a65b640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7264071460 0x7f726409d750 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f726000c7f0 tx=0x7f726000ccb0 comp rx=0 tx=0).stop 2023-12-22T08:46:54.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.096+0000 7f726a65b640 1 -- 172.21.15.38:0/2407303546 shutdown_connections 2023-12-22T08:46:54.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.096+0000 7f726a65b640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f726415b0e0 0x7f72640b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:54.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.096+0000 7f726a65b640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f726409c980 0x7f726414b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:54.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.096+0000 7f726a65b640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f724806a430 0x7f724806c8f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:54.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.096+0000 7f726a65b640 1 --2- 172.21.15.38:0/2407303546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7264071460 0x7f726409d750 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:54.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.096+0000 7f726a65b640 1 -- 172.21.15.38:0/2407303546 >> 172.21.15.38:0/2407303546 conn(0x7f72640cf000 msgr2=0x7f726415d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:54.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.096+0000 7f726a65b640 1 -- 172.21.15.38:0/2407303546 shutdown_connections 2023-12-22T08:46:54.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.096+0000 7f726a65b640 1 -- 172.21.15.38:0/2407303546 wait complete. 2023-12-22T08:46:54.121 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T08:46:54.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.390+0000 7f81f359e640 1 Processor -- start 2023-12-22T08:46:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.390+0000 7f81f359e640 1 -- start start 2023-12-22T08:46:54.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.392+0000 7f81f359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81f4146ad0 0x7f81f4070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:54.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.392+0000 7f81f359e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f4070a70 con 0x7f81f4146eb0 2023-12-22T08:46:54.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.392+0000 7f81f359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f409ed10 con 0x7f81f40d24e0 2023-12-22T08:46:54.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.392+0000 7f81f359e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f409eff0 con 0x7f81f4146ad0 2023-12-22T08:46:54.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.392+0000 7f81f1d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f81f4146eb0 0x7f81f40d1dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45834/0 (socket says 172.21.15.38:45834) 2023-12-22T08:46:54.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.392+0000 7f81f1d9b640 1 -- 172.21.15.38:0/2417050321 learned_addr learned my addr 172.21.15.38:0/2417050321 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:54.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.392+0000 7f81f259c640 1 --2- 172.21.15.38:0/2417050321 >> v2:172.21.15.89:3300/0 conn(0x7f81f4146ad0 0x7f81f4070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:54.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.393+0000 7f81f159a640 1 -- 172.21.15.38:0/2417050321 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891519555 0 0) 0x7f81f4070a70 con 0x7f81f4146eb0 2023-12-22T08:46:54.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.393+0000 7f81f159a640 1 -- 172.21.15.38:0/2417050321 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81dc003520 con 0x7f81f4146eb0 2023-12-22T08:46:54.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.394+0000 7f81f259c640 1 -- 172.21.15.38:0/2417050321 >> v1:172.21.15.89:6789/0 conn(0x7f81f40d24e0 legacy=0x7f81f409f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:54.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.394+0000 7f81f259c640 1 -- 172.21.15.38:0/2417050321 >> v1:172.21.15.38:6789/0 conn(0x7f81f4146eb0 legacy=0x7f81f40d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:54.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.394+0000 7f81f259c640 1 -- 172.21.15.38:0/2417050321 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f409f2d0 con 0x7f81f4146ad0 2023-12-22T08:46:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.395+0000 7f81f259c640 1 --2- 172.21.15.38:0/2417050321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f4146ad0 0x7f81f4070140 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f81e40097a0 tx=0x7f81e402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37890c20aed320ce server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:54.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.403+0000 7f81f159a640 1 -- 172.21.15.38:0/2417050321 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4031830 con 0x7f81f4146ad0 2023-12-22T08:46:54.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.403+0000 7f81f159a640 1 -- 172.21.15.38:0/2417050321 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4031990 con 0x7f81f4146ad0 2023-12-22T08:46:54.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.403+0000 7f81f159a640 1 -- 172.21.15.38:0/2417050321 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4031d00 con 0x7f81f4146ad0 2023-12-22T08:46:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.404+0000 7f81f359e640 1 -- 172.21.15.38:0/2417050321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f4146ad0 msgr2=0x7f81f4070140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.404+0000 7f81f359e640 1 --2- 172.21.15.38:0/2417050321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f4146ad0 0x7f81f4070140 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f81e40097a0 tx=0x7f81e402b8d0 comp rx=0 tx=0).stop 2023-12-22T08:46:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.404+0000 7f81f359e640 1 -- 172.21.15.38:0/2417050321 shutdown_connections 2023-12-22T08:46:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.404+0000 7f81f359e640 1 --2- 172.21.15.38:0/2417050321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f4146ad0 0x7f81f4070140 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.404+0000 7f81f359e640 1 -- 172.21.15.38:0/2417050321 >> 172.21.15.38:0/2417050321 conn(0x7f81f406cf30 msgr2=0x7f81f40b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.404+0000 7f81f359e640 1 -- 172.21.15.38:0/2417050321 shutdown_connections 2023-12-22T08:46:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.404+0000 7f81f359e640 1 -- 172.21.15.38:0/2417050321 wait complete. 2023-12-22T08:46:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.406+0000 7f81f359e640 1 Processor -- start 2023-12-22T08:46:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.407+0000 7f81f359e640 1 -- start start 2023-12-22T08:46:54.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.408+0000 7f81f359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f40d24e0 0x7f81f413f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:54.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.408+0000 7f81f359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f4146ad0 0x7f81f415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:54.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.408+0000 7f81f359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81f4146eb0 0x7f81f4144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:54.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.408+0000 7f81f359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40b4320 con 0x7f81f4146eb0 2023-12-22T08:46:54.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.408+0000 7f81f359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f41404c0 con 0x7f81f4146ad0 2023-12-22T08:46:54.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.408+0000 7f81f359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f413fc20 con 0x7f81f40d24e0 2023-12-22T08:46:54.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.408+0000 7f81f2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81f4146eb0 0x7f81f4144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.408+0000 7f81f2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81f4146eb0 0x7f81f4144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45620/0 (socket says 172.21.15.38:45620) 2023-12-22T08:46:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.408+0000 7f81f2d9d640 1 -- 172.21.15.38:0/58371942 learned_addr learned my addr 172.21.15.38:0/58371942 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.409+0000 7f81f1d9b640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f4146ad0 0x7f81f415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.409+0000 7f81f2d9d640 1 -- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f40d24e0 msgr2=0x7f81f413f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.409+0000 7f81f259c640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f40d24e0 0x7f81f413f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.409+0000 7f81f2d9d640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f40d24e0 0x7f81f413f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.409+0000 7f81f2d9d640 1 -- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f4146ad0 msgr2=0x7f81f415bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.409+0000 7f81f2d9d640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f4146ad0 0x7f81f415bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.409+0000 7f81f2d9d640 1 -- 172.21.15.38:0/58371942 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e4009400 con 0x7f81f4146eb0 2023-12-22T08:46:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.409+0000 7f81f2d9d640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81f4146eb0 0x7f81f4144750 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00c7a0 tx=0x7f81ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:54.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.409+0000 7f81e2ffd640 1 -- 172.21.15.38:0/58371942 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec003b70 con 0x7f81f4146eb0 2023-12-22T08:46:54.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.409+0000 7f81e2ffd640 1 -- 172.21.15.38:0/58371942 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec003cf0 con 0x7f81f4146eb0 2023-12-22T08:46:54.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.409+0000 7f81f359e640 1 -- 172.21.15.38:0/58371942 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f413ff00 con 0x7f81f4146eb0 2023-12-22T08:46:54.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.409+0000 7f81e2ffd640 1 -- 172.21.15.38:0/58371942 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec003ea0 con 0x7f81f4146eb0 2023-12-22T08:46:54.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.409+0000 7f81f359e640 1 -- 172.21.15.38:0/58371942 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f413f910 con 0x7f81f4146eb0 2023-12-22T08:46:54.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.411+0000 7f81f359e640 1 -- 172.21.15.38:0/58371942 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f40b44d0 con 0x7f81f4146eb0 2023-12-22T08:46:54.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.412+0000 7f81e2ffd640 1 -- 172.21.15.38:0/58371942 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f81ec00aa90 con 0x7f81f4146eb0 2023-12-22T08:46:54.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.412+0000 7f81e2ffd640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f81d406a430 0x7f81d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:54.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.413+0000 7f81e2ffd640 1 -- 172.21.15.38:0/58371942 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f81ec088890 con 0x7f81f4146eb0 2023-12-22T08:46:54.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.413+0000 7f81f259c640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f81d406a430 0x7f81d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:54.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.414+0000 7f81f259c640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f81d406a430 0x7f81d406c8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f81e4036000 tx=0x7f81e4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:54.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.417+0000 7f81e2ffd640 1 -- 172.21.15.38:0/58371942 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f81f40b44d0 con 0x7f81f4146eb0 2023-12-22T08:46:54.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:54.610+0000 7f81f359e640 1 -- 172.21.15.38:0/58371942 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f81f4061910 con 0x7f81f4146eb0 2023-12-22T08:46:55.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.415+0000 7f81e2ffd640 1 -- 172.21.15.38:0/58371942 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v117) v1 ==== 181+0+0 (secure 0 0 0) 0x7f81ec053d80 con 0x7f81f4146eb0 2023-12-22T08:46:55.417 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2023-12-22T08:46:55.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.419+0000 7f81f359e640 1 -- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f81d406a430 msgr2=0x7f81d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:55.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.419+0000 7f81f359e640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f81d406a430 0x7f81d406c8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f81e4036000 tx=0x7f81e4008030 comp rx=0 tx=0).stop 2023-12-22T08:46:55.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.419+0000 7f81f359e640 1 -- 172.21.15.38:0/58371942 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81f4146eb0 msgr2=0x7f81f4144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:55.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.419+0000 7f81f359e640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81f4146eb0 0x7f81f4144750 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00c7a0 tx=0x7f81ec00cc60 comp rx=0 tx=0).stop 2023-12-22T08:46:55.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.420+0000 7f81f359e640 1 -- 172.21.15.38:0/58371942 shutdown_connections 2023-12-22T08:46:55.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.420+0000 7f81f359e640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f81d406a430 0x7f81d406c8f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:55.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.420+0000 7f81f359e640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81f4146eb0 0x7f81f4144750 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:55.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.420+0000 7f81f359e640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f4146ad0 0x7f81f415bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:55.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.420+0000 7f81f359e640 1 --2- 172.21.15.38:0/58371942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f40d24e0 0x7f81f413f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:55.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.420+0000 7f81f359e640 1 -- 172.21.15.38:0/58371942 >> 172.21.15.38:0/58371942 conn(0x7f81f406cf30 msgr2=0x7f81f40a0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:55.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.421+0000 7f81f359e640 1 -- 172.21.15.38:0/58371942 shutdown_connections 2023-12-22T08:46:55.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.421+0000 7f81f359e640 1 -- 172.21.15.38:0/58371942 wait complete. 2023-12-22T08:46:55.443 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T08:46:55.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.667+0000 7f460d5c9640 1 Processor -- start 2023-12-22T08:46:55.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.668+0000 7f460d5c9640 1 -- start start 2023-12-22T08:46:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.669+0000 7f460d5c9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4608146e40 0x7f46080cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.670+0000 7f460d5c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46081618d0 0x7f4608070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.670+0000 7f460d5c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46080b4120 con 0x7f4608161df0 2023-12-22T08:46:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.670+0000 7f460d5c9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46080b4da0 con 0x7f4608146e40 2023-12-22T08:46:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.670+0000 7f460d5c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46080b4400 con 0x7f46081618d0 2023-12-22T08:46:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.670+0000 7f4606ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4608146e40 0x7f46080cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.670+0000 7f4606ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4608146e40 0x7f46080cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45624/0 (socket says 172.21.15.38:45624) 2023-12-22T08:46:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.670+0000 7f4606ffd640 1 -- 172.21.15.38:0/1073102800 learned_addr learned my addr 172.21.15.38:0/1073102800 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.670+0000 7f4606ffd640 1 -- 172.21.15.38:0/1073102800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46081618d0 msgr2=0x7f4608070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.670+0000 7f4606ffd640 1 --2- 172.21.15.38:0/1073102800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46081618d0 0x7f4608070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.670+0000 7f4606ffd640 1 -- 172.21.15.38:0/1073102800 >> v1:172.21.15.89:6789/0 conn(0x7f4608161df0 legacy=0x7f46081611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.670+0000 7f4606ffd640 1 -- 172.21.15.38:0/1073102800 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46080b46e0 con 0x7f4608146e40 2023-12-22T08:46:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.671+0000 7f4606ffd640 1 --2- 172.21.15.38:0/1073102800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4608146e40 0x7f46080cf6b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009e50 tx=0x7f45f802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc45a3232e9f7323 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:55.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.672+0000 7f4605ffb640 1 -- 172.21.15.38:0/1073102800 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f802c960 con 0x7f4608146e40 2023-12-22T08:46:55.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.672+0000 7f4605ffb640 1 -- 172.21.15.38:0/1073102800 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f802cac0 con 0x7f4608146e40 2023-12-22T08:46:55.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.672+0000 7f4605ffb640 1 -- 172.21.15.38:0/1073102800 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f802ce50 con 0x7f4608146e40 2023-12-22T08:46:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.672+0000 7f460d5c9640 1 -- 172.21.15.38:0/1073102800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4608146e40 msgr2=0x7f46080cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.672+0000 7f460d5c9640 1 --2- 172.21.15.38:0/1073102800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4608146e40 0x7f46080cf6b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009e50 tx=0x7f45f802bdc0 comp rx=0 tx=0).stop 2023-12-22T08:46:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.672+0000 7f460d5c9640 1 -- 172.21.15.38:0/1073102800 shutdown_connections 2023-12-22T08:46:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.672+0000 7f460d5c9640 1 --2- 172.21.15.38:0/1073102800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46081618d0 0x7f4608070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.672+0000 7f460d5c9640 1 --2- 172.21.15.38:0/1073102800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4608146e40 0x7f46080cf6b0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.672+0000 7f460d5c9640 1 -- 172.21.15.38:0/1073102800 >> 172.21.15.38:0/1073102800 conn(0x7f46080cff10 msgr2=0x7f46080d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.673+0000 7f460d5c9640 1 -- 172.21.15.38:0/1073102800 shutdown_connections 2023-12-22T08:46:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.673+0000 7f460d5c9640 1 -- 172.21.15.38:0/1073102800 wait complete. 2023-12-22T08:46:55.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.674+0000 7f460d5c9640 1 Processor -- start 2023-12-22T08:46:55.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.674+0000 7f460d5c9640 1 -- start start 2023-12-22T08:46:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.675+0000 7f460d5c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4608146e40 0x7f46081f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.675+0000 7f460d5c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46081618d0 0x7f46080b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.675+0000 7f460d5c9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4608161df0 0x7f46080b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.675+0000 7f460d5c9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46081f7190 con 0x7f4608161df0 2023-12-22T08:46:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.675+0000 7f460d5c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080b0b50 con 0x7f46081618d0 2023-12-22T08:46:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.675+0000 7f460d5c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46081f68f0 con 0x7f4608146e40 2023-12-22T08:46:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.676+0000 7f46077fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4608161df0 0x7f46080b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.676+0000 7f46077fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4608161df0 0x7f46080b2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45640/0 (socket says 172.21.15.38:45640) 2023-12-22T08:46:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.676+0000 7f46077fe640 1 -- 172.21.15.38:0/877806214 learned_addr learned my addr 172.21.15.38:0/877806214 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.676+0000 7f46067fc640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46081618d0 0x7f46080b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.676+0000 7f4606ffd640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4608146e40 0x7f46081f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.676+0000 7f46077fe640 1 -- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4608146e40 msgr2=0x7f46081f6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.676+0000 7f46077fe640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4608146e40 0x7f46081f6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.676+0000 7f46077fe640 1 -- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46081618d0 msgr2=0x7f46080b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.676+0000 7f46077fe640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46081618d0 0x7f46080b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.676+0000 7f46077fe640 1 -- 172.21.15.38:0/877806214 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8009b30 con 0x7f4608161df0 2023-12-22T08:46:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.677+0000 7f46077fe640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4608161df0 0x7f46080b2650 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4600009fd0 tx=0x7f460000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.677+0000 7f45ff7fe640 1 -- 172.21.15.38:0/877806214 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600011830 con 0x7f4608161df0 2023-12-22T08:46:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.677+0000 7f45ff7fe640 1 -- 172.21.15.38:0/877806214 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4600011990 con 0x7f4608161df0 2023-12-22T08:46:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.677+0000 7f45ff7fe640 1 -- 172.21.15.38:0/877806214 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600011d20 con 0x7f4608161df0 2023-12-22T08:46:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.677+0000 7f460d5c9640 1 -- 172.21.15.38:0/877806214 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46081f6bd0 con 0x7f4608161df0 2023-12-22T08:46:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.677+0000 7f460d5c9640 1 -- 172.21.15.38:0/877806214 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460814dbc0 con 0x7f4608161df0 2023-12-22T08:46:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.678+0000 7f460d5c9640 1 -- 172.21.15.38:0/877806214 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4608061910 con 0x7f4608161df0 2023-12-22T08:46:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.679+0000 7f45ff7fe640 1 -- 172.21.15.38:0/877806214 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f460001b460 con 0x7f4608161df0 2023-12-22T08:46:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.680+0000 7f45ff7fe640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f45e806a430 0x7f45e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.680+0000 7f45ff7fe640 1 -- 172.21.15.38:0/877806214 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f4600088520 con 0x7f4608161df0 2023-12-22T08:46:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.681+0000 7f4606ffd640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f45e806a430 0x7f45e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.682+0000 7f4606ffd640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f45e806a430 0x7f45e806c8f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f45f8035000 tx=0x7f45f8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.684+0000 7f45ff7fe640 1 -- 172.21.15.38:0/877806214 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4600057790 con 0x7f4608161df0 2023-12-22T08:46:55.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:55.880+0000 7f460d5c9640 1 -- 172.21.15.38:0/877806214 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f46080d2d80 con 0x7f4608161df0 2023-12-22T08:46:56.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.422+0000 7f45ff7fe640 1 -- 172.21.15.38:0/877806214 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v118) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4600057320 con 0x7f4608161df0 2023-12-22T08:46:56.425 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2023-12-22T08:46:56.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.428+0000 7f460d5c9640 1 -- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f45e806a430 msgr2=0x7f45e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:56.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.428+0000 7f460d5c9640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f45e806a430 0x7f45e806c8f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f45f8035000 tx=0x7f45f8030000 comp rx=0 tx=0).stop 2023-12-22T08:46:56.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.428+0000 7f460d5c9640 1 -- 172.21.15.38:0/877806214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4608161df0 msgr2=0x7f46080b2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:56.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.428+0000 7f460d5c9640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4608161df0 0x7f46080b2650 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4600009fd0 tx=0x7f460000b8e0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.428+0000 7f460d5c9640 1 -- 172.21.15.38:0/877806214 shutdown_connections 2023-12-22T08:46:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.428+0000 7f460d5c9640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f45e806a430 0x7f45e806c8f0 secure :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f45f8035000 tx=0x7f45f8030000 comp rx=0 tx=0).stop 2023-12-22T08:46:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.428+0000 7f460d5c9640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4608161df0 0x7f46080b2650 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.428+0000 7f460d5c9640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46081618d0 0x7f46080b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.428+0000 7f460d5c9640 1 --2- 172.21.15.38:0/877806214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4608146e40 0x7f46081f6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.428+0000 7f460d5c9640 1 -- 172.21.15.38:0/877806214 >> 172.21.15.38:0/877806214 conn(0x7f46080cff10 msgr2=0x7f46080d2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.429+0000 7f460d5c9640 1 -- 172.21.15.38:0/877806214 shutdown_connections 2023-12-22T08:46:56.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.429+0000 7f460d5c9640 1 -- 172.21.15.38:0/877806214 wait complete. 2023-12-22T08:46:56.456 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-22T08:46:56.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.664+0000 7fea3ff3c640 1 Processor -- start 2023-12-22T08:46:56.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.664+0000 7fea3ff3c640 1 -- start start 2023-12-22T08:46:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.666+0000 7fea3ff3c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3815b7b0 0x7fea380ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.666+0000 7fea3ff3c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea380ceb70 con 0x7fea3815b3d0 2023-12-22T08:46:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.666+0000 7fea3ff3c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3806c1e0 con 0x7fea380ce740 2023-12-22T08:46:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.666+0000 7fea3ff3c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea38070100 con 0x7fea3815b7b0 2023-12-22T08:46:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.666+0000 7fea3dcd8640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fea3815b3d0 0x7fea380ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45848/0 (socket says 172.21.15.38:45848) 2023-12-22T08:46:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.666+0000 7fea3dcd8640 1 -- 172.21.15.38:0/2483357788 learned_addr learned my addr 172.21.15.38:0/2483357788 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3d4d7640 1 --2- 172.21.15.38:0/2483357788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3815b7b0 0x7fea380ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470031537 0 0) 0x7fea380ceb70 con 0x7fea3815b3d0 2023-12-22T08:46:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea24003520 con 0x7fea3815b3d0 2023-12-22T08:46:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2563283286 0 0) 0x7fea24003520 con 0x7fea3815b3d0 2023-12-22T08:46:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3815b7b0 msgr2=0x7fea380ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 --2- 172.21.15.38:0/2483357788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3815b7b0 0x7fea380ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 >> v1:172.21.15.89:6789/0 conn(0x7fea380ce740 legacy=0x7fea38070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea380cd620 con 0x7fea3815b3d0 2023-12-22T08:46:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fea34001670 con 0x7fea3815b3d0 2023-12-22T08:46:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 >> v1:172.21.15.38:6789/0 conn(0x7fea3815b3d0 legacy=0x7fea380ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 --2- 172.21.15.38:0/2483357788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea240039a0 0x7fea24003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 --2- 172.21.15.38:0/2483357788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3815b7b0 0x7fea240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 --2- 172.21.15.38:0/2483357788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea24004d00 0x7fea24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea38070100 con 0x7fea24004d00 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2400bb40 con 0x7fea240039a0 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.667+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2400bd00 con 0x7fea3815b7b0 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.668+0000 7fea3e4d9640 1 --2- 172.21.15.38:0/2483357788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea24004d00 0x7fea24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.668+0000 7fea3d4d7640 1 --2- 172.21.15.38:0/2483357788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3815b7b0 0x7fea240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.668+0000 7fea3dcd8640 1 --2- 172.21.15.38:0/2483357788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea240039a0 0x7fea24003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.668+0000 7fea3e4d9640 1 -- 172.21.15.38:0/2483357788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3815b7b0 msgr2=0x7fea240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.668+0000 7fea3e4d9640 1 --2- 172.21.15.38:0/2483357788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3815b7b0 0x7fea240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.668+0000 7fea3e4d9640 1 -- 172.21.15.38:0/2483357788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea240039a0 msgr2=0x7fea24003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.668+0000 7fea3e4d9640 1 --2- 172.21.15.38:0/2483357788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea240039a0 0x7fea24003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.668+0000 7fea3e4d9640 1 -- 172.21.15.38:0/2483357788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea24003520 con 0x7fea24004d00 2023-12-22T08:46:56.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.668+0000 7fea3dcd8640 1 --2- 172.21.15.38:0/2483357788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea240039a0 0x7fea24003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:46:56.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.669+0000 7fea3e4d9640 1 --2- 172.21.15.38:0/2483357788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea24004d00 0x7fea24005180 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fea30001e20 tx=0x7fea240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa65493635eae80 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.670+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30003b70 con 0x7fea24004d00 2023-12-22T08:46:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.670+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea30003cd0 con 0x7fea24004d00 2023-12-22T08:46:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.670+0000 7fea3ccd6640 1 -- 172.21.15.38:0/2483357788 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30005310 con 0x7fea24004d00 2023-12-22T08:46:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.670+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2483357788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea24004d00 msgr2=0x7fea24005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.670+0000 7fea3ff3c640 1 --2- 172.21.15.38:0/2483357788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea24004d00 0x7fea24005180 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fea30001e20 tx=0x7fea240057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.670+0000 7fea3e4d9640 1 -- 172.21.15.38:0/2483357788 reap_dead start 2023-12-22T08:46:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.670+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2483357788 shutdown_connections 2023-12-22T08:46:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.670+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2483357788 >> 172.21.15.38:0/2483357788 conn(0x7fea380cba10 msgr2=0x7fea380cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.671+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2483357788 shutdown_connections 2023-12-22T08:46:56.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.671+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2483357788 wait complete. 2023-12-22T08:46:56.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.672+0000 7fea3ff3c640 1 Processor -- start 2023-12-22T08:46:56.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.673+0000 7fea3ff3c640 1 -- start start 2023-12-22T08:46:56.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.673+0000 7fea3ff3c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea24004d00 0x7fea381506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:56.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.673+0000 7fea3ff3c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea38152260 0x7fea3814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:56.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.673+0000 7fea3ff3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea380c7b10 0x7fea380c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:56.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.673+0000 7fea3ff3c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea380c84d0 con 0x7fea38152260 2023-12-22T08:46:56.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.673+0000 7fea3ff3c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea38150be0 con 0x7fea380c7b10 2023-12-22T08:46:56.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.673+0000 7fea3ff3c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea38150e10 con 0x7fea24004d00 2023-12-22T08:46:56.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.674+0000 7fea3d4d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea38152260 0x7fea3814ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:56.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.674+0000 7fea3d4d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea38152260 0x7fea3814ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45660/0 (socket says 172.21.15.38:45660) 2023-12-22T08:46:56.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.674+0000 7fea3d4d7640 1 -- 172.21.15.38:0/2706836682 learned_addr learned my addr 172.21.15.38:0/2706836682 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.674+0000 7fea3dcd8640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea24004d00 0x7fea381506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.674+0000 7fea3d4d7640 1 -- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea24004d00 msgr2=0x7fea381506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.674+0000 7fea3e4d9640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea380c7b10 0x7fea380c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.674+0000 7fea3d4d7640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea24004d00 0x7fea381506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.674+0000 7fea3d4d7640 1 -- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea380c7b10 msgr2=0x7fea380c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.674+0000 7fea3d4d7640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea380c7b10 0x7fea380c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.674+0000 7fea3d4d7640 1 -- 172.21.15.38:0/2706836682 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea381510f0 con 0x7fea38152260 2023-12-22T08:46:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.675+0000 7fea3d4d7640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea38152260 0x7fea3814ea70 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fea28011910 tx=0x7fea28011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.675+0000 7fea2e7fc640 1 -- 172.21.15.38:0/2706836682 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28009580 con 0x7fea38152260 2023-12-22T08:46:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.675+0000 7fea2e7fc640 1 -- 172.21.15.38:0/2706836682 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2800faf0 con 0x7fea38152260 2023-12-22T08:46:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.675+0000 7fea2e7fc640 1 -- 172.21.15.38:0/2706836682 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800fee0 con 0x7fea38152260 2023-12-22T08:46:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.675+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2706836682 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea381513d0 con 0x7fea38152260 2023-12-22T08:46:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.675+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2706836682 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea38151990 con 0x7fea38152260 2023-12-22T08:46:56.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.677+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2706836682 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea38061910 con 0x7fea38152260 2023-12-22T08:46:56.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.677+0000 7fea2e7fc640 1 -- 172.21.15.38:0/2706836682 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fea28005990 con 0x7fea38152260 2023-12-22T08:46:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.678+0000 7fea2e7fc640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea1c06a430 0x7fea1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.678+0000 7fea2e7fc640 1 -- 172.21.15.38:0/2706836682 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fea28088c20 con 0x7fea38152260 2023-12-22T08:46:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.679+0000 7fea3dcd8640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea1c06a430 0x7fea1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:56.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.680+0000 7fea3dcd8640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea1c06a430 0x7fea1c06c8f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fea340059f0 tx=0x7fea34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:56.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.683+0000 7fea2e7fc640 1 -- 172.21.15.38:0/2706836682 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fea28054510 con 0x7fea38152260 2023-12-22T08:46:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.883+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2706836682 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fea3806a600 con 0x7fea38152260 2023-12-22T08:46:56.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.889+0000 7fea2e7fc640 1 -- 172.21.15.38:0/2706836682 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fea280220a0 con 0x7fea38152260 2023-12-22T08:46:56.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.892+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea1c06a430 msgr2=0x7fea1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:56.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.893+0000 7fea3ff3c640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea1c06a430 0x7fea1c06c8f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fea340059f0 tx=0x7fea34009040 comp rx=0 tx=0).stop 2023-12-22T08:46:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.893+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2706836682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea38152260 msgr2=0x7fea3814ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.893+0000 7fea3ff3c640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea38152260 0x7fea3814ea70 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fea28011910 tx=0x7fea28011dd0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.893+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2706836682 shutdown_connections 2023-12-22T08:46:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.893+0000 7fea3ff3c640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea380c7b10 0x7fea380c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.893+0000 7fea3ff3c640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea1c06a430 0x7fea1c06c8f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.893+0000 7fea3ff3c640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea38152260 0x7fea3814ea70 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.893+0000 7fea3ff3c640 1 --2- 172.21.15.38:0/2706836682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea24004d00 0x7fea381506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.893+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2706836682 >> 172.21.15.38:0/2706836682 conn(0x7fea380cba10 msgr2=0x7fea380cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.893+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2706836682 shutdown_connections 2023-12-22T08:46:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:56.893+0000 7fea3ff3c640 1 -- 172.21.15.38:0/2706836682 wait complete. 2023-12-22T08:46:56.915 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-12-22T08:46:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.135+0000 7f9e841f1640 1 Processor -- start 2023-12-22T08:46:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.135+0000 7f9e841f1640 1 -- start start 2023-12-22T08:46:57.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.137+0000 7f9e841f1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c1547a0 0x7f9e7c15b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.137+0000 7f9e841f1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9e7c154b80 0x7f9e7c0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.137+0000 7f9e841f1640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7c0716a0 con 0x7f9e7c071b90 2023-12-22T08:46:57.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.137+0000 7f9e841f1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7c070e80 con 0x7f9e7c154b80 2023-12-22T08:46:57.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.137+0000 7f9e841f1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0710e0 con 0x7f9e7c1547a0 2023-12-22T08:46:57.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.137+0000 7f9e8178c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9e7c071b90 0x7f9e7c070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45856/0 (socket says 172.21.15.38:45856) 2023-12-22T08:46:57.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.137+0000 7f9e8178c640 1 -- 172.21.15.38:0/3542733900 learned_addr learned my addr 172.21.15.38:0/3542733900 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.137+0000 7f9e81f8d640 1 --2- 172.21.15.38:0/3542733900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c1547a0 0x7f9e7c15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.137+0000 7f9e8278e640 1 --2- 172.21.15.38:0/3542733900 >> v2:172.21.15.89:3300/0 conn(0x7f9e7c154b80 0x7f9e7c0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822242347 0 0) 0x7f9e7c0716a0 con 0x7f9e7c071b90 2023-12-22T08:46:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e68003520 con 0x7f9e7c071b90 2023-12-22T08:46:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 346658660 0 0) 0x7f9e68003520 con 0x7f9e7c071b90 2023-12-22T08:46:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c1547a0 msgr2=0x7f9e7c15b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 --2- 172.21.15.38:0/3542733900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c1547a0 0x7f9e7c15b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 >> v2:172.21.15.89:3300/0 conn(0x7f9e7c154b80 msgr2=0x7f9e7c0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 --2- 172.21.15.38:0/3542733900 >> v2:172.21.15.89:3300/0 conn(0x7f9e7c154b80 0x7f9e7c0ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c0713c0 con 0x7f9e7c071b90 2023-12-22T08:46:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f9e6c001670 con 0x7f9e7c071b90 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 >> v1:172.21.15.38:6789/0 conn(0x7f9e7c071b90 legacy=0x7f9e7c070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 --2- 172.21.15.38:0/3542733900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c1547a0 0x7f9e68003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 --2- 172.21.15.38:0/3542733900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e68003f40 0x7f9e680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 --2- 172.21.15.38:0/3542733900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e68004d00 0x7f9e68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c070e80 con 0x7f9e68004d00 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0710e0 con 0x7f9e68003f40 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.138+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6800b980 con 0x7f9e7c1547a0 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.139+0000 7f9e8278e640 1 --2- 172.21.15.38:0/3542733900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e68004d00 0x7f9e68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.139+0000 7f9e81f8d640 1 --2- 172.21.15.38:0/3542733900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c1547a0 0x7f9e68003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.139+0000 7f9e8178c640 1 --2- 172.21.15.38:0/3542733900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e68003f40 0x7f9e680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.139+0000 7f9e8278e640 1 -- 172.21.15.38:0/3542733900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c1547a0 msgr2=0x7f9e68003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.139+0000 7f9e8278e640 1 --2- 172.21.15.38:0/3542733900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c1547a0 0x7f9e68003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.139+0000 7f9e8278e640 1 -- 172.21.15.38:0/3542733900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e68003f40 msgr2=0x7f9e680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.139+0000 7f9e8278e640 1 --2- 172.21.15.38:0/3542733900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e68003f40 0x7f9e680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.139+0000 7f9e8278e640 1 -- 172.21.15.38:0/3542733900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68003520 con 0x7f9e68004d00 2023-12-22T08:46:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.140+0000 7f9e8278e640 1 --2- 172.21.15.38:0/3542733900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e68004d00 0x7f9e68005180 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400e170 tx=0x7f9e680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67326dc8a2ec92a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.140+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7402cc20 con 0x7f9e68004d00 2023-12-22T08:46:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.141+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7400f040 con 0x7f9e68004d00 2023-12-22T08:46:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.141+0000 7f9e80f8b640 1 -- 172.21.15.38:0/3542733900 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74034440 con 0x7f9e68004d00 2023-12-22T08:46:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.141+0000 7f9e841f1640 1 -- 172.21.15.38:0/3542733900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e68004d00 msgr2=0x7f9e68005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.141+0000 7f9e841f1640 1 --2- 172.21.15.38:0/3542733900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e68004d00 0x7f9e68005180 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400e170 tx=0x7f9e680057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.141+0000 7f9e8278e640 1 -- 172.21.15.38:0/3542733900 reap_dead start 2023-12-22T08:46:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.141+0000 7f9e841f1640 1 -- 172.21.15.38:0/3542733900 shutdown_connections 2023-12-22T08:46:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.141+0000 7f9e841f1640 1 -- 172.21.15.38:0/3542733900 >> 172.21.15.38:0/3542733900 conn(0x7f9e7c0cf070 msgr2=0x7f9e7c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.141+0000 7f9e841f1640 1 -- 172.21.15.38:0/3542733900 shutdown_connections 2023-12-22T08:46:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.141+0000 7f9e841f1640 1 -- 172.21.15.38:0/3542733900 wait complete. 2023-12-22T08:46:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.143+0000 7f9e841f1640 1 Processor -- start 2023-12-22T08:46:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.143+0000 7f9e841f1640 1 -- start start 2023-12-22T08:46:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.144+0000 7f9e841f1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e68004d00 0x7f9e7c149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.144+0000 7f9e841f1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c147e90 0x7f9e7c148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.144+0000 7f9e841f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e7c148b90 0x7f9e7c149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.144+0000 7f9e841f1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c149e50 con 0x7f9e68004d00 2023-12-22T08:46:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.144+0000 7f9e841f1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c156400 con 0x7f9e7c148b90 2023-12-22T08:46:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.144+0000 7f9e841f1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c155ad0 con 0x7f9e7c147e90 2023-12-22T08:46:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.144+0000 7f9e81f8d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e68004d00 0x7f9e7c149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.144+0000 7f9e81f8d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e68004d00 0x7f9e7c149910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45680/0 (socket says 172.21.15.38:45680) 2023-12-22T08:46:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.144+0000 7f9e81f8d640 1 -- 172.21.15.38:0/1490247698 learned_addr learned my addr 172.21.15.38:0/1490247698 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.145+0000 7f9e8178c640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c147e90 0x7f9e7c148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.145+0000 7f9e81f8d640 1 -- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c147e90 msgr2=0x7f9e7c148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.145+0000 7f9e81f8d640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c147e90 0x7f9e7c148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.145+0000 7f9e81f8d640 1 -- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e7c148b90 msgr2=0x7f9e7c149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.145+0000 7f9e8278e640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e7c148b90 0x7f9e7c149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.145+0000 7f9e81f8d640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e7c148b90 0x7f9e7c149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.145+0000 7f9e81f8d640 1 -- 172.21.15.38:0/1490247698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c155db0 con 0x7f9e68004d00 2023-12-22T08:46:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.145+0000 7f9e8178c640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c147e90 0x7f9e7c148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.145+0000 7f9e81f8d640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e68004d00 0x7f9e7c149910 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9e78011600 tx=0x7f9e78011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.146+0000 7f9e727fc640 1 -- 172.21.15.38:0/1490247698 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800f920 con 0x7f9e68004d00 2023-12-22T08:46:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.146+0000 7f9e727fc640 1 -- 172.21.15.38:0/1490247698 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7800fa80 con 0x7f9e68004d00 2023-12-22T08:46:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.146+0000 7f9e727fc640 1 -- 172.21.15.38:0/1490247698 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800fdf0 con 0x7f9e68004d00 2023-12-22T08:46:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.146+0000 7f9e841f1640 1 -- 172.21.15.38:0/1490247698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c156090 con 0x7f9e68004d00 2023-12-22T08:46:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.146+0000 7f9e841f1640 1 -- 172.21.15.38:0/1490247698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c148310 con 0x7f9e68004d00 2023-12-22T08:46:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.147+0000 7f9e841f1640 1 -- 172.21.15.38:0/1490247698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c0ce850 con 0x7f9e68004d00 2023-12-22T08:46:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.148+0000 7f9e727fc640 1 -- 172.21.15.38:0/1490247698 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9e78015460 con 0x7f9e68004d00 2023-12-22T08:46:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.149+0000 7f9e727fc640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9e6006a460 0x7f9e6006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.150+0000 7f9e727fc640 1 -- 172.21.15.38:0/1490247698 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9e78088b50 con 0x7f9e68004d00 2023-12-22T08:46:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.150+0000 7f9e8178c640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9e6006a460 0x7f9e6006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.151+0000 7f9e8178c640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9e6006a460 0x7f9e6006c920 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c001eb0 tx=0x7f9e6c001b80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:57.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.153+0000 7f9e727fc640 1 -- 172.21.15.38:0/1490247698 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9e780543a0 con 0x7f9e68004d00 2023-12-22T08:46:57.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.416+0000 7f9e841f1640 1 -- 172.21.15.38:0/1490247698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f9e7c061910 con 0x7f9e68004d00 2023-12-22T08:46:57.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.443+0000 7f9e727fc640 1 -- 172.21.15.38:0/1490247698 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v358) v1 ==== 137+0+0 (secure 0 0 0) 0x7f9e780579c0 con 0x7f9e68004d00 2023-12-22T08:46:57.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.446+0000 7f9e841f1640 1 -- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9e6006a460 msgr2=0x7f9e6006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:57.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.446+0000 7f9e841f1640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9e6006a460 0x7f9e6006c920 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c001eb0 tx=0x7f9e6c001b80 comp rx=0 tx=0).stop 2023-12-22T08:46:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.446+0000 7f9e841f1640 1 -- 172.21.15.38:0/1490247698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e68004d00 msgr2=0x7f9e7c149910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.446+0000 7f9e841f1640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e68004d00 0x7f9e7c149910 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9e78011600 tx=0x7f9e78011ac0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.446+0000 7f9e841f1640 1 -- 172.21.15.38:0/1490247698 shutdown_connections 2023-12-22T08:46:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.446+0000 7f9e841f1640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e7c148b90 0x7f9e7c149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.446+0000 7f9e841f1640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e7c147e90 0x7f9e7c148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.446+0000 7f9e841f1640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9e6006a460 0x7f9e6006c920 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.446+0000 7f9e841f1640 1 --2- 172.21.15.38:0/1490247698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e68004d00 0x7f9e7c149910 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.446+0000 7f9e841f1640 1 -- 172.21.15.38:0/1490247698 >> 172.21.15.38:0/1490247698 conn(0x7f9e7c0cf070 msgr2=0x7f9e7c14a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.446+0000 7f9e841f1640 1 -- 172.21.15.38:0/1490247698 shutdown_connections 2023-12-22T08:46:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.446+0000 7f9e841f1640 1 -- 172.21.15.38:0/1490247698 wait complete. 2023-12-22T08:46:57.464 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-22T08:46:57.464 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-12-22T08:46:57.464 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-12-22T08:46:57.465 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:46:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.686+0000 7f43714f7640 1 Processor -- start 2023-12-22T08:46:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.686+0000 7f43714f7640 1 -- start start 2023-12-22T08:46:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.688+0000 7f43714f7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f436c146be0 0x7f436c0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.688+0000 7f43714f7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f436c146fc0 0x7f436c0d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.688+0000 7f43714f7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c15eac0 con 0x7f436c15dfb0 2023-12-22T08:46:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.688+0000 7f43714f7640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436c0d1b70 con 0x7f436c146be0 2023-12-22T08:46:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.688+0000 7f43714f7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436c15ed10 con 0x7f436c146fc0 2023-12-22T08:46:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.688+0000 7f436affd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f436c146be0 0x7f436c0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.688+0000 7f436affd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f436c146be0 0x7f436c0d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45682/0 (socket says 172.21.15.38:45682) 2023-12-22T08:46:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.688+0000 7f436affd640 1 -- 172.21.15.38:0/2917099102 learned_addr learned my addr 172.21.15.38:0/2917099102 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.688+0000 7f436affd640 1 -- 172.21.15.38:0/2917099102 >> v2:172.21.15.89:3300/0 conn(0x7f436c146fc0 msgr2=0x7f436c0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.688+0000 7f436affd640 1 --2- 172.21.15.38:0/2917099102 >> v2:172.21.15.89:3300/0 conn(0x7f436c146fc0 0x7f436c0d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.688+0000 7f436affd640 1 -- 172.21.15.38:0/2917099102 >> v1:172.21.15.89:6789/0 conn(0x7f436c15dfb0 legacy=0x7f436c15e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.688+0000 7f436affd640 1 -- 172.21.15.38:0/2917099102 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c162200 con 0x7f436c146be0 2023-12-22T08:46:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.690+0000 7f436affd640 1 --2- 172.21.15.38:0/2917099102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436c146be0 0x7f436c0d10f0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f436c06d590 tx=0x7f435c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21175884030bc766 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.690+0000 7f4369ffb640 1 -- 172.21.15.38:0/2917099102 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c031870 con 0x7f436c146be0 2023-12-22T08:46:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.690+0000 7f4369ffb640 1 -- 172.21.15.38:0/2917099102 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c0319d0 con 0x7f436c146be0 2023-12-22T08:46:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.690+0000 7f4369ffb640 1 -- 172.21.15.38:0/2917099102 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c031d60 con 0x7f436c146be0 2023-12-22T08:46:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.690+0000 7f43714f7640 1 -- 172.21.15.38:0/2917099102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436c146be0 msgr2=0x7f436c0d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.690+0000 7f43714f7640 1 --2- 172.21.15.38:0/2917099102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436c146be0 0x7f436c0d10f0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f436c06d590 tx=0x7f435c02b910 comp rx=0 tx=0).stop 2023-12-22T08:46:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.690+0000 7f43714f7640 1 -- 172.21.15.38:0/2917099102 shutdown_connections 2023-12-22T08:46:57.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.690+0000 7f43714f7640 1 --2- 172.21.15.38:0/2917099102 >> v2:172.21.15.89:3300/0 conn(0x7f436c146fc0 0x7f436c0d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.690+0000 7f43714f7640 1 --2- 172.21.15.38:0/2917099102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436c146be0 0x7f436c0d10f0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.690+0000 7f43714f7640 1 -- 172.21.15.38:0/2917099102 >> 172.21.15.38:0/2917099102 conn(0x7f436c06c5e0 msgr2=0x7f436c06c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.691+0000 7f43714f7640 1 -- 172.21.15.38:0/2917099102 shutdown_connections 2023-12-22T08:46:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.691+0000 7f43714f7640 1 -- 172.21.15.38:0/2917099102 wait complete. 2023-12-22T08:46:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.692+0000 7f43714f7640 1 Processor -- start 2023-12-22T08:46:57.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.692+0000 7f43714f7640 1 -- start start 2023-12-22T08:46:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.693+0000 7f43714f7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f436c146be0 0x7f436c1f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.693+0000 7f43714f7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f436c146fc0 0x7f436c1f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.693+0000 7f43714f7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436c15dfb0 0x7f436c1f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.693+0000 7f43714f7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c13b500 con 0x7f436c15dfb0 2023-12-22T08:46:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.693+0000 7f43714f7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c1f58d0 con 0x7f436c146be0 2023-12-22T08:46:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.693+0000 7f43714f7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c1f4cc0 con 0x7f436c146fc0 2023-12-22T08:46:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.694+0000 7f436b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436c15dfb0 0x7f436c1f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.694+0000 7f436b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436c15dfb0 0x7f436c1f4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45684/0 (socket says 172.21.15.38:45684) 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.694+0000 7f436b7fe640 1 -- 172.21.15.38:0/1234236441 learned_addr learned my addr 172.21.15.38:0/1234236441 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.694+0000 7f436a7fc640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f436c146fc0 0x7f436c1f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.694+0000 7f436affd640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f436c146be0 0x7f436c1f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.694+0000 7f436b7fe640 1 -- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f436c146fc0 msgr2=0x7f436c1f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.694+0000 7f436b7fe640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f436c146fc0 0x7f436c1f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.694+0000 7f436b7fe640 1 -- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f436c146be0 msgr2=0x7f436c1f3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.694+0000 7f436b7fe640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f436c146be0 0x7f436c1f3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.694+0000 7f436b7fe640 1 -- 172.21.15.38:0/1234236441 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c0094d0 con 0x7f436c15dfb0 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.694+0000 7f436affd640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f436c146be0 0x7f436c1f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.695+0000 7f436b7fe640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436c15dfb0 0x7f436c1f4240 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f436400b990 tx=0x7f436400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.695+0000 7f43537fe640 1 -- 172.21.15.38:0/1234236441 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436400cba0 con 0x7f436c15dfb0 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.695+0000 7f43537fe640 1 -- 172.21.15.38:0/1234236441 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436400cd00 con 0x7f436c15dfb0 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.695+0000 7f43537fe640 1 -- 172.21.15.38:0/1234236441 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364014680 con 0x7f436c15dfb0 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.695+0000 7f43714f7640 1 -- 172.21.15.38:0/1234236441 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436c1f4fa0 con 0x7f436c15dfb0 2023-12-22T08:46:57.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.695+0000 7f43714f7640 1 -- 172.21.15.38:0/1234236441 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c1f5560 con 0x7f436c15dfb0 2023-12-22T08:46:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.696+0000 7f43714f7640 1 -- 172.21.15.38:0/1234236441 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436c1f5a40 con 0x7f436c15dfb0 2023-12-22T08:46:57.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.697+0000 7f43537fe640 1 -- 172.21.15.38:0/1234236441 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f43640147e0 con 0x7f436c15dfb0 2023-12-22T08:46:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.698+0000 7f43537fe640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f435806a430 0x7f435806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:57.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.698+0000 7f43537fe640 1 -- 172.21.15.38:0/1234236441 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4364088620 con 0x7f436c15dfb0 2023-12-22T08:46:57.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.699+0000 7f436affd640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f435806a430 0x7f435806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:57.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.700+0000 7f436affd640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f435806a430 0x7f435806c8f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f435c036000 tx=0x7f435c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:57.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.702+0000 7f43537fe640 1 -- 172.21.15.38:0/1234236441 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4364053eb0 con 0x7f436c15dfb0 2023-12-22T08:46:57.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.896+0000 7f43714f7640 1 -- 172.21.15.38:0/1234236441 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f436c061910 con 0x7f436c15dfb0 2023-12-22T08:46:57.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.898+0000 7f43537fe640 1 -- 172.21.15.38:0/1234236441 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+12481 (secure 0 0 0) 0x7f43640574d0 con 0x7f436c15dfb0 2023-12-22T08:46:57.900 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:46:57.900 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":118,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:46:56.408956+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6835/2733146003":"2023-12-23T08:46:53.067482+0000","172.21.15.38:6833/2733146003":"2023-12-23T08:46:53.067482+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:46:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.901+0000 7f43714f7640 1 -- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f435806a430 msgr2=0x7f435806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.901+0000 7f43714f7640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f435806a430 0x7f435806c8f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f435c036000 tx=0x7f435c03c040 comp rx=0 tx=0).stop 2023-12-22T08:46:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.901+0000 7f43714f7640 1 -- 172.21.15.38:0/1234236441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436c15dfb0 msgr2=0x7f436c1f4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.901+0000 7f43714f7640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436c15dfb0 0x7f436c1f4240 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f436400b990 tx=0x7f436400be50 comp rx=0 tx=0).stop 2023-12-22T08:46:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.901+0000 7f43714f7640 1 -- 172.21.15.38:0/1234236441 shutdown_connections 2023-12-22T08:46:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.901+0000 7f43714f7640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f435806a430 0x7f435806c8f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.901+0000 7f43714f7640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f436c15dfb0 0x7f436c1f4240 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.901+0000 7f43714f7640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f436c146fc0 0x7f436c1f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.901+0000 7f43714f7640 1 --2- 172.21.15.38:0/1234236441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f436c146be0 0x7f436c1f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.901+0000 7f43714f7640 1 -- 172.21.15.38:0/1234236441 >> 172.21.15.38:0/1234236441 conn(0x7f436c06c5e0 msgr2=0x7f436c0d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.902+0000 7f43714f7640 1 -- 172.21.15.38:0/1234236441 shutdown_connections 2023-12-22T08:46:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:57.902+0000 7f43714f7640 1 -- 172.21.15.38:0/1234236441 wait complete. 2023-12-22T08:46:57.923 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:46:57.923 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:46:58.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.154+0000 7f2c18c15640 1 Processor -- start 2023-12-22T08:46:58.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.154+0000 7f2c18c15640 1 -- start start 2023-12-22T08:46:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.156+0000 7f2c18c15640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2c14070b70 0x7f2c1406bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.156+0000 7f2c18c15640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2c14071660 0x7f2c14164d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.156+0000 7f2c18c15640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1406d5f0 con 0x7f2c1406c4d0 2023-12-22T08:46:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.156+0000 7f2c18c15640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c14144fa0 con 0x7f2c14071660 2023-12-22T08:46:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.156+0000 7f2c18c15640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1406da80 con 0x7f2c14070b70 2023-12-22T08:46:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.156+0000 7f2c13fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2c14071660 0x7f2c14164d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.156+0000 7f2c13fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2c14071660 0x7f2c14164d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45692/0 (socket says 172.21.15.38:45692) 2023-12-22T08:46:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.156+0000 7f2c13fff640 1 -- 172.21.15.38:0/785009710 learned_addr learned my addr 172.21.15.38:0/785009710 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.156+0000 7f2c0bfff640 1 --1- 172.21.15.38:0/785009710 >> v1:172.21.15.38:6789/0 conn(0x7f2c1406c4d0 0x7f2c14070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45872/0 (socket says 172.21.15.38:45872) 2023-12-22T08:46:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.157+0000 7f2c137fe640 1 --2- 172.21.15.38:0/785009710 >> v2:172.21.15.89:3300/0 conn(0x7f2c14070b70 0x7f2c1406bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.157+0000 7f2c13fff640 1 -- 172.21.15.38:0/785009710 >> v2:172.21.15.89:3300/0 conn(0x7f2c14070b70 msgr2=0x7f2c1406bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.157+0000 7f2c13fff640 1 --2- 172.21.15.38:0/785009710 >> v2:172.21.15.89:3300/0 conn(0x7f2c14070b70 0x7f2c1406bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.157+0000 7f2c13fff640 1 -- 172.21.15.38:0/785009710 >> v1:172.21.15.38:6789/0 conn(0x7f2c1406c4d0 legacy=0x7f2c14070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.157+0000 7f2c13fff640 1 -- 172.21.15.38:0/785009710 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1406c9e0 con 0x7f2c14071660 2023-12-22T08:46:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.157+0000 7f2c137fe640 1 --2- 172.21.15.38:0/785009710 >> v2:172.21.15.89:3300/0 conn(0x7f2c14070b70 0x7f2c1406bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.158+0000 7f2c13fff640 1 --2- 172.21.15.38:0/785009710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c14071660 0x7f2c14164d50 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f2c140b1c60 tx=0x7f2c0c02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21a46cbcdd54cca server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.158+0000 7f2c12ffd640 1 -- 172.21.15.38:0/785009710 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c02cb10 con 0x7f2c14071660 2023-12-22T08:46:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.158+0000 7f2c12ffd640 1 -- 172.21.15.38:0/785009710 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c02cc70 con 0x7f2c14071660 2023-12-22T08:46:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.158+0000 7f2c12ffd640 1 -- 172.21.15.38:0/785009710 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0343f0 con 0x7f2c14071660 2023-12-22T08:46:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.159+0000 7f2c18c15640 1 -- 172.21.15.38:0/785009710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c14071660 msgr2=0x7f2c14164d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.159+0000 7f2c18c15640 1 --2- 172.21.15.38:0/785009710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c14071660 0x7f2c14164d50 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f2c140b1c60 tx=0x7f2c0c02bf70 comp rx=0 tx=0).stop 2023-12-22T08:46:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.159+0000 7f2c18c15640 1 -- 172.21.15.38:0/785009710 shutdown_connections 2023-12-22T08:46:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.159+0000 7f2c18c15640 1 --2- 172.21.15.38:0/785009710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c14071660 0x7f2c14164d50 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.159+0000 7f2c18c15640 1 --2- 172.21.15.38:0/785009710 >> v2:172.21.15.89:3300/0 conn(0x7f2c14070b70 0x7f2c1406bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.159+0000 7f2c18c15640 1 -- 172.21.15.38:0/785009710 >> 172.21.15.38:0/785009710 conn(0x7f2c140b0b60 msgr2=0x7f2c140b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.159+0000 7f2c18c15640 1 -- 172.21.15.38:0/785009710 shutdown_connections 2023-12-22T08:46:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.159+0000 7f2c18c15640 1 -- 172.21.15.38:0/785009710 wait complete. 2023-12-22T08:46:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.161+0000 7f2c18c15640 1 Processor -- start 2023-12-22T08:46:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.161+0000 7f2c18c15640 1 -- start start 2023-12-22T08:46:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.162+0000 7f2c18c15640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c1406c4d0 0x7f2c140afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.162+0000 7f2c18c15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c14070b70 0x7f2c141f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.162+0000 7f2c18c15640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c14071660 0x7f2c141f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.162+0000 7f2c18c15640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c141f2350 con 0x7f2c1406c4d0 2023-12-22T08:46:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.162+0000 7f2c18c15640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c14136550 con 0x7f2c14070b70 2023-12-22T08:46:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.162+0000 7f2c18c15640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c141f6720 con 0x7f2c14071660 2023-12-22T08:46:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.162+0000 7f2c137fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c1406c4d0 0x7f2c140afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.162+0000 7f2c137fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c1406c4d0 0x7f2c140afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45704/0 (socket says 172.21.15.38:45704) 2023-12-22T08:46:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.162+0000 7f2c137fe640 1 -- 172.21.15.38:0/1455969220 learned_addr learned my addr 172.21.15.38:0/1455969220 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.163+0000 7f2c0bfff640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c14070b70 0x7f2c141f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.163+0000 7f2c137fe640 1 -- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c14071660 msgr2=0x7f2c141f1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.163+0000 7f2c137fe640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c14071660 0x7f2c141f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.163+0000 7f2c137fe640 1 -- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c14070b70 msgr2=0x7f2c141f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.163+0000 7f2c137fe640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c14070b70 0x7f2c141f18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.163+0000 7f2c137fe640 1 -- 172.21.15.38:0/1455969220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c009b30 con 0x7f2c1406c4d0 2023-12-22T08:46:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.163+0000 7f2c0bfff640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c14070b70 0x7f2c141f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.163+0000 7f2c137fe640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c1406c4d0 0x7f2c140afa80 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c7f0 tx=0x7f2c0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.163+0000 7f2c10ff9640 1 -- 172.21.15.38:0/1455969220 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04007a30 con 0x7f2c1406c4d0 2023-12-22T08:46:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.163+0000 7f2c10ff9640 1 -- 172.21.15.38:0/1455969220 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c04007b90 con 0x7f2c1406c4d0 2023-12-22T08:46:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.164+0000 7f2c10ff9640 1 -- 172.21.15.38:0/1455969220 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0400ce40 con 0x7f2c1406c4d0 2023-12-22T08:46:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.164+0000 7f2c18c15640 1 -- 172.21.15.38:0/1455969220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c14136820 con 0x7f2c1406c4d0 2023-12-22T08:46:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.164+0000 7f2c18c15640 1 -- 172.21.15.38:0/1455969220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c14136de0 con 0x7f2c1406c4d0 2023-12-22T08:46:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.165+0000 7f2c18c15640 1 -- 172.21.15.38:0/1455969220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1406cf80 con 0x7f2c1406c4d0 2023-12-22T08:46:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.166+0000 7f2c10ff9640 1 -- 172.21.15.38:0/1455969220 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2c040113f0 con 0x7f2c1406c4d0 2023-12-22T08:46:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.167+0000 7f2c10ff9640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2bf406a430 0x7f2bf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.167+0000 7f2c10ff9640 1 -- 172.21.15.38:0/1455969220 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2c040887f0 con 0x7f2c1406c4d0 2023-12-22T08:46:58.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.167+0000 7f2c0bfff640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2bf406a430 0x7f2bf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:58.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.169+0000 7f2c0bfff640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2bf406a430 0x7f2bf406c8f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2c141f5950 tx=0x7f2bfc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:58.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.171+0000 7f2c10ff9640 1 -- 172.21.15.38:0/1455969220 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2c1406cf80 con 0x7f2c1406c4d0 2023-12-22T08:46:58.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.366+0000 7f2c18c15640 1 -- 172.21.15.38:0/1455969220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c14136690 con 0x7f2c1406c4d0 2023-12-22T08:46:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.367+0000 7f2c10ff9640 1 -- 172.21.15.38:0/1455969220 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c040540d0 con 0x7f2c1406c4d0 2023-12-22T08:46:58.369 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:46:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.370+0000 7f2c18c15640 1 -- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2bf406a430 msgr2=0x7f2bf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.370+0000 7f2c18c15640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2bf406a430 0x7f2bf406c8f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2c141f5950 tx=0x7f2bfc009040 comp rx=0 tx=0).stop 2023-12-22T08:46:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.370+0000 7f2c18c15640 1 -- 172.21.15.38:0/1455969220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c1406c4d0 msgr2=0x7f2c140afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.370+0000 7f2c18c15640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c1406c4d0 0x7f2c140afa80 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c7f0 tx=0x7f2c0400cbf0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.370+0000 7f2c18c15640 1 -- 172.21.15.38:0/1455969220 shutdown_connections 2023-12-22T08:46:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.370+0000 7f2c18c15640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c14071660 0x7f2c141f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.370+0000 7f2c18c15640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c14070b70 0x7f2c141f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.370+0000 7f2c18c15640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2bf406a430 0x7f2bf406c8f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.370+0000 7f2c18c15640 1 --2- 172.21.15.38:0/1455969220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c1406c4d0 0x7f2c140afa80 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.370+0000 7f2c18c15640 1 -- 172.21.15.38:0/1455969220 >> 172.21.15.38:0/1455969220 conn(0x7f2c140b0b60 msgr2=0x7f2c140b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:58.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.370+0000 7f2c18c15640 1 -- 172.21.15.38:0/1455969220 shutdown_connections 2023-12-22T08:46:58.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.370+0000 7f2c18c15640 1 -- 172.21.15.38:0/1455969220 wait complete. 2023-12-22T08:46:58.391 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-12-22T08:46:58.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.618+0000 7f72bd6ec640 1 Processor -- start 2023-12-22T08:46:58.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.619+0000 7f72bd6ec640 1 -- start start 2023-12-22T08:46:58.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.620+0000 7f72bd6ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72b815d730 0x7f72b80cde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.620+0000 7f72bd6ec640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b80cd970 con 0x7f72b815d350 2023-12-22T08:46:58.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.620+0000 7f72bd6ec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b80cf320 con 0x7f72b80ce390 2023-12-22T08:46:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.620+0000 7f72bd6ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80ce840 con 0x7f72b815d730 2023-12-22T08:46:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.621+0000 7f72b7fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f72b815d350 0x7f72b80d06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45874/0 (socket says 172.21.15.38:45874) 2023-12-22T08:46:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.621+0000 7f72b7fff640 1 -- 172.21.15.38:0/3963643026 learned_addr learned my addr 172.21.15.38:0/3963643026 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:46:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.621+0000 7f72b77fe640 1 --2- 172.21.15.38:0/3963643026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72b815d730 0x7f72b80cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.621+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089077010 0 0) 0x7f72b80cd970 con 0x7f72b815d350 2023-12-22T08:46:58.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.621+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a0003520 con 0x7f72b815d350 2023-12-22T08:46:58.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.621+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1105075599 0 0) 0x7f72a0003520 con 0x7f72b815d350 2023-12-22T08:46:58.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.621+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72b815d730 msgr2=0x7f72b80cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:58.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.621+0000 7f72b6ffd640 1 --2- 172.21.15.38:0/3963643026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72b815d730 0x7f72b80cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.621+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 >> v1:172.21.15.89:6789/0 conn(0x7f72b80ce390 legacy=0x7f72b80ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:58.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.621+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b80cf600 con 0x7f72b815d350 2023-12-22T08:46:58.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.621+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f72a8001670 con 0x7f72b815d350 2023-12-22T08:46:58.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 >> v1:172.21.15.38:6789/0 conn(0x7f72b815d350 legacy=0x7f72b80d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:58.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72b6ffd640 1 --2- 172.21.15.38:0/3963643026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72a00039a0 0x7f72a0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72b6ffd640 1 --2- 172.21.15.38:0/3963643026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72b815d730 0x7f72a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72b6ffd640 1 --2- 172.21.15.38:0/3963643026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72a0004d00 0x7f72a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80ce840 con 0x7f72a0004d00 2023-12-22T08:46:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a000bb10 con 0x7f72a00039a0 2023-12-22T08:46:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a000bcd0 con 0x7f72b815d730 2023-12-22T08:46:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72bceeb640 1 --2- 172.21.15.38:0/3963643026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72a0004d00 0x7f72a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72b7fff640 1 --2- 172.21.15.38:0/3963643026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72a00039a0 0x7f72a0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72b77fe640 1 --2- 172.21.15.38:0/3963643026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72b815d730 0x7f72a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72bceeb640 1 -- 172.21.15.38:0/3963643026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72b815d730 msgr2=0x7f72a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72bceeb640 1 --2- 172.21.15.38:0/3963643026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72b815d730 0x7f72a00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72bceeb640 1 -- 172.21.15.38:0/3963643026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72a00039a0 msgr2=0x7f72a0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72bceeb640 1 --2- 172.21.15.38:0/3963643026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72a00039a0 0x7f72a0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.622+0000 7f72bceeb640 1 -- 172.21.15.38:0/3963643026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0003520 con 0x7f72a0004d00 2023-12-22T08:46:58.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.624+0000 7f72bceeb640 1 --2- 172.21.15.38:0/3963643026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72a0004d00 0x7f72a0005180 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f72b0001e50 tx=0x7f72a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df86f79a2dbb17ef server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:58.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.624+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0003b70 con 0x7f72a0004d00 2023-12-22T08:46:58.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.624+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0003cd0 con 0x7f72a0004d00 2023-12-22T08:46:58.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.624+0000 7f72b6ffd640 1 -- 172.21.15.38:0/3963643026 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0005310 con 0x7f72a0004d00 2023-12-22T08:46:58.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.625+0000 7f72bd6ec640 1 -- 172.21.15.38:0/3963643026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72a0004d00 msgr2=0x7f72a0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:58.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.625+0000 7f72bd6ec640 1 --2- 172.21.15.38:0/3963643026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72a0004d00 0x7f72a0005180 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f72b0001e50 tx=0x7f72a00057f0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.625+0000 7f72bceeb640 1 -- 172.21.15.38:0/3963643026 reap_dead start 2023-12-22T08:46:58.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.625+0000 7f72bd6ec640 1 -- 172.21.15.38:0/3963643026 shutdown_connections 2023-12-22T08:46:58.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.625+0000 7f72bd6ec640 1 -- 172.21.15.38:0/3963643026 >> 172.21.15.38:0/3963643026 conn(0x7f72b80d14b0 msgr2=0x7f72b80d18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:58.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.625+0000 7f72bd6ec640 1 -- 172.21.15.38:0/3963643026 shutdown_connections 2023-12-22T08:46:58.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.625+0000 7f72bd6ec640 1 -- 172.21.15.38:0/3963643026 wait complete. 2023-12-22T08:46:58.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.627+0000 7f72bd6ec640 1 Processor -- start 2023-12-22T08:46:58.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.627+0000 7f72bd6ec640 1 -- start start 2023-12-22T08:46:58.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.628+0000 7f72bd6ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72a0004d00 0x7f72b814d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.628+0000 7f72bd6ec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72b81502f0 0x7f72b814d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.628+0000 7f72bd6ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72b815bac0 0x7f72b815bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.628+0000 7f72bd6ec640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b815c480 con 0x7f72b81502f0 2023-12-22T08:46:58.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.628+0000 7f72bd6ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8155880 con 0x7f72b815bac0 2023-12-22T08:46:58.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.628+0000 7f72bd6ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b814d570 con 0x7f72a0004d00 2023-12-22T08:46:58.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.628+0000 7f72b77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72b81502f0 0x7f72b814d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:58.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.628+0000 7f72b77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72b81502f0 0x7f72b814d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45728/0 (socket says 172.21.15.38:45728) 2023-12-22T08:46:58.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.628+0000 7f72b77fe640 1 -- 172.21.15.38:0/2273159240 learned_addr learned my addr 172.21.15.38:0/2273159240 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:58.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.628+0000 7f72b7fff640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72a0004d00 0x7f72b814d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:58.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.628+0000 7f72bceeb640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72b815bac0 0x7f72b815bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:58.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.629+0000 7f72b77fe640 1 -- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72a0004d00 msgr2=0x7f72b814d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:58.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.629+0000 7f72b77fe640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72a0004d00 0x7f72b814d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.629+0000 7f72b77fe640 1 -- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72b815bac0 msgr2=0x7f72b815bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:58.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.629+0000 7f72b77fe640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72b815bac0 0x7f72b815bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:58.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.629+0000 7f72b77fe640 1 -- 172.21.15.38:0/2273159240 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b81508b0 con 0x7f72b81502f0 2023-12-22T08:46:58.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.629+0000 7f72bceeb640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72b815bac0 0x7f72b815bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:46:58.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.629+0000 7f72b77fe640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72b81502f0 0x7f72b814d030 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00f580 tx=0x7f72ac00fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:58.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.629+0000 7f72b4ff9640 1 -- 172.21.15.38:0/2273159240 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac014870 con 0x7f72b81502f0 2023-12-22T08:46:58.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.629+0000 7f72b4ff9640 1 -- 172.21.15.38:0/2273159240 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac0149d0 con 0x7f72b81502f0 2023-12-22T08:46:58.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.629+0000 7f72bd6ec640 1 -- 172.21.15.38:0/2273159240 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b8150b90 con 0x7f72b81502f0 2023-12-22T08:46:58.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.629+0000 7f72b4ff9640 1 -- 172.21.15.38:0/2273159240 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac014d80 con 0x7f72b81502f0 2023-12-22T08:46:58.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.629+0000 7f72bd6ec640 1 -- 172.21.15.38:0/2273159240 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b814e940 con 0x7f72b81502f0 2023-12-22T08:46:58.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.631+0000 7f72bd6ec640 1 -- 172.21.15.38:0/2273159240 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b8150dd0 con 0x7f72b81502f0 2023-12-22T08:46:58.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.631+0000 7f72b4ff9640 1 -- 172.21.15.38:0/2273159240 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f72ac015410 con 0x7f72b81502f0 2023-12-22T08:46:58.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.633+0000 7f72b4ff9640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f72a406a430 0x7f72a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:58.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.633+0000 7f72b4ff9640 1 -- 172.21.15.38:0/2273159240 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f72ac0890e0 con 0x7f72b81502f0 2023-12-22T08:46:58.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.634+0000 7f72b7fff640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f72a406a430 0x7f72a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:58.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.635+0000 7f72b7fff640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f72a406a430 0x7f72a406c8f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f72a8001eb0 tx=0x7f72a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:58.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.638+0000 7f72b4ff9640 1 -- 172.21.15.38:0/2273159240 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f72b8150dd0 con 0x7f72b81502f0 2023-12-22T08:46:58.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:58.900+0000 7f72bd6ec640 1 -- 172.21.15.38:0/2273159240 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f72b814e4c0 con 0x7f72b81502f0 2023-12-22T08:46:59.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.460+0000 7f72b4ff9640 1 -- 172.21.15.38:0/2273159240 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v360) v1 ==== 131+0+0 (secure 0 0 0) 0x7f72b814e4c0 con 0x7f72b81502f0 2023-12-22T08:46:59.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.463+0000 7f72bd6ec640 1 -- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f72a406a430 msgr2=0x7f72a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:59.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.463+0000 7f72bd6ec640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f72a406a430 0x7f72a406c8f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f72a8001eb0 tx=0x7f72a8009040 comp rx=0 tx=0).stop 2023-12-22T08:46:59.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.463+0000 7f72bd6ec640 1 -- 172.21.15.38:0/2273159240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72b81502f0 msgr2=0x7f72b814d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:59.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.463+0000 7f72bd6ec640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72b81502f0 0x7f72b814d030 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00f580 tx=0x7f72ac00fa40 comp rx=0 tx=0).stop 2023-12-22T08:46:59.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.464+0000 7f72bd6ec640 1 -- 172.21.15.38:0/2273159240 shutdown_connections 2023-12-22T08:46:59.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.464+0000 7f72bd6ec640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72b815bac0 0x7f72b815bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.464+0000 7f72bd6ec640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f72a406a430 0x7f72a406c8f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.464+0000 7f72bd6ec640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72b81502f0 0x7f72b814d030 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.464+0000 7f72bd6ec640 1 --2- 172.21.15.38:0/2273159240 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72a0004d00 0x7f72b814d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.464+0000 7f72bd6ec640 1 -- 172.21.15.38:0/2273159240 >> 172.21.15.38:0/2273159240 conn(0x7f72b80d14b0 msgr2=0x7f72b806d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:59.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.464+0000 7f72bd6ec640 1 -- 172.21.15.38:0/2273159240 shutdown_connections 2023-12-22T08:46:59.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.464+0000 7f72bd6ec640 1 -- 172.21.15.38:0/2273159240 wait complete. 2023-12-22T08:46:59.486 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T08:46:59.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.711+0000 7f2ef3355640 1 Processor -- start 2023-12-22T08:46:59.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.712+0000 7f2ef3355640 1 -- start start 2023-12-22T08:46:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.713+0000 7f2ef3355640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2eec160c50 0x7f2eec0b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.713+0000 7f2ef3355640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2eec0ce020 0x7f2eec0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.714+0000 7f2ef3355640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eec06f250 0x7f2eec06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.714+0000 7f2ef3355640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eec0cee50 con 0x7f2eec0ce020 2023-12-22T08:46:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.714+0000 7f2ef3355640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eec06fc40 con 0x7f2eec160c50 2023-12-22T08:46:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.714+0000 7f2ef3355640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0ad140 con 0x7f2eec06f250 2023-12-22T08:46:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.714+0000 7f2ef08f0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2eec0ce020 0x7f2eec0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.714+0000 7f2ef08f0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2eec0ce020 0x7f2eec0ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45730/0 (socket says 172.21.15.38:45730) 2023-12-22T08:46:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.714+0000 7f2ef08f0640 1 -- 172.21.15.38:0/2730585009 learned_addr learned my addr 172.21.15.38:0/2730585009 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.714+0000 7f2ef10f1640 1 --2- 172.21.15.38:0/2730585009 >> v2:172.21.15.89:3300/0 conn(0x7f2eec160c50 0x7f2eec0b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.714+0000 7f2ef18f2640 1 --2- 172.21.15.38:0/2730585009 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eec06f250 0x7f2eec06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.714+0000 7f2ef08f0640 1 -- 172.21.15.38:0/2730585009 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eec06f250 msgr2=0x7f2eec06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.714+0000 7f2ef08f0640 1 --2- 172.21.15.38:0/2730585009 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eec06f250 0x7f2eec06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.715+0000 7f2ef08f0640 1 -- 172.21.15.38:0/2730585009 >> v2:172.21.15.89:3300/0 conn(0x7f2eec160c50 msgr2=0x7f2eec0b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:46:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.715+0000 7f2ef08f0640 1 --2- 172.21.15.38:0/2730585009 >> v2:172.21.15.89:3300/0 conn(0x7f2eec160c50 0x7f2eec0b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.715+0000 7f2ef08f0640 1 -- 172.21.15.38:0/2730585009 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec0ceb70 con 0x7f2eec0ce020 2023-12-22T08:46:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.716+0000 7f2ef08f0640 1 --2- 172.21.15.38:0/2730585009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2eec0ce020 0x7f2eec0ce480 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0b32c0 tx=0x7f2edc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8057d9908dbc2476 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.716+0000 7f2ee3fff640 1 -- 172.21.15.38:0/2730585009 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc0317e0 con 0x7f2eec0ce020 2023-12-22T08:46:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.716+0000 7f2ee3fff640 1 -- 172.21.15.38:0/2730585009 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc031940 con 0x7f2eec0ce020 2023-12-22T08:46:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.716+0000 7f2ee3fff640 1 -- 172.21.15.38:0/2730585009 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc031cd0 con 0x7f2eec0ce020 2023-12-22T08:46:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.716+0000 7f2ef3355640 1 -- 172.21.15.38:0/2730585009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2eec0ce020 msgr2=0x7f2eec0ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.716+0000 7f2ef3355640 1 --2- 172.21.15.38:0/2730585009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2eec0ce020 0x7f2eec0ce480 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0b32c0 tx=0x7f2edc02b880 comp rx=0 tx=0).stop 2023-12-22T08:46:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.717+0000 7f2ef3355640 1 -- 172.21.15.38:0/2730585009 shutdown_connections 2023-12-22T08:46:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.717+0000 7f2ef3355640 1 --2- 172.21.15.38:0/2730585009 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eec06f250 0x7f2eec06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.717+0000 7f2ef3355640 1 --2- 172.21.15.38:0/2730585009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2eec0ce020 0x7f2eec0ce480 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.717+0000 7f2ef3355640 1 --2- 172.21.15.38:0/2730585009 >> v2:172.21.15.89:3300/0 conn(0x7f2eec160c50 0x7f2eec0b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.717+0000 7f2ef3355640 1 -- 172.21.15.38:0/2730585009 >> 172.21.15.38:0/2730585009 conn(0x7f2eec0b20c0 msgr2=0x7f2eec0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.717+0000 7f2ef3355640 1 -- 172.21.15.38:0/2730585009 shutdown_connections 2023-12-22T08:46:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.717+0000 7f2ef3355640 1 -- 172.21.15.38:0/2730585009 wait complete. 2023-12-22T08:46:59.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.718+0000 7f2ef3355640 1 Processor -- start 2023-12-22T08:46:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.719+0000 7f2ef3355640 1 -- start start 2023-12-22T08:46:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.719+0000 7f2ef3355640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eec06f250 0x7f2eec0c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef3355640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eec0ce020 0x7f2eec14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef3355640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2eec160c50 0x7f2eec0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef3355640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0c73e0 con 0x7f2eec160c50 2023-12-22T08:46:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef3355640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0c76c0 con 0x7f2eec0ce020 2023-12-22T08:46:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef3355640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0c79a0 con 0x7f2eec06f250 2023-12-22T08:46:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef18f2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2eec160c50 0x7f2eec0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef18f2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2eec160c50 0x7f2eec0cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45740/0 (socket says 172.21.15.38:45740) 2023-12-22T08:46:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef18f2640 1 -- 172.21.15.38:0/2565629129 learned_addr learned my addr 172.21.15.38:0/2565629129 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:46:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef08f0640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eec0ce020 0x7f2eec14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef10f1640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eec06f250 0x7f2eec0c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef18f2640 1 -- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eec06f250 msgr2=0x7f2eec0c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef18f2640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eec06f250 0x7f2eec0c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef18f2640 1 -- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eec0ce020 msgr2=0x7f2eec14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef18f2640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eec0ce020 0x7f2eec14dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.720+0000 7f2ef18f2640 1 -- 172.21.15.38:0/2565629129 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc0094d0 con 0x7f2eec160c50 2023-12-22T08:46:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.721+0000 7f2ef18f2640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2eec160c50 0x7f2eec0cbae0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400ccf0 tx=0x7f2ee400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.721+0000 7f2ee1ffb640 1 -- 172.21.15.38:0/2565629129 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4003b90 con 0x7f2eec160c50 2023-12-22T08:46:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.721+0000 7f2ee1ffb640 1 -- 172.21.15.38:0/2565629129 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee4003cf0 con 0x7f2eec160c50 2023-12-22T08:46:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.721+0000 7f2ee1ffb640 1 -- 172.21.15.38:0/2565629129 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4004240 con 0x7f2eec160c50 2023-12-22T08:46:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.721+0000 7f2ef3355640 1 -- 172.21.15.38:0/2565629129 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eec0c7c80 con 0x7f2eec160c50 2023-12-22T08:46:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.721+0000 7f2ef3355640 1 -- 172.21.15.38:0/2565629129 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eec0c8240 con 0x7f2eec160c50 2023-12-22T08:46:59.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.722+0000 7f2ef3355640 1 -- 172.21.15.38:0/2565629129 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eec0c8430 con 0x7f2eec160c50 2023-12-22T08:46:59.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.723+0000 7f2ee1ffb640 1 -- 172.21.15.38:0/2565629129 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2ee40043a0 con 0x7f2eec160c50 2023-12-22T08:46:59.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.724+0000 7f2ee1ffb640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ed006a430 0x7f2ed006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:46:59.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.724+0000 7f2ee1ffb640 1 -- 172.21.15.38:0/2565629129 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2ee4012070 con 0x7f2eec160c50 2023-12-22T08:46:59.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.725+0000 7f2ef10f1640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ed006a430 0x7f2ed006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:46:59.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.726+0000 7f2ef10f1640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ed006a430 0x7f2ed006c8f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8006fd0 tx=0x7f2ee8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:46:59.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.728+0000 7f2ee1ffb640 1 -- 172.21.15.38:0/2565629129 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2ee40548a0 con 0x7f2eec160c50 2023-12-22T08:46:59.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.920+0000 7f2ef3355640 1 -- 172.21.15.38:0/2565629129 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2eec061910 con 0x7f2eec160c50 2023-12-22T08:46:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.929+0000 7f2ee1ffb640 1 -- 172.21.15.38:0/2565629129 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2ee4057ec0 con 0x7f2eec160c50 2023-12-22T08:46:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.932+0000 7f2ef3355640 1 -- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ed006a430 msgr2=0x7f2ed006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.932+0000 7f2ef3355640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ed006a430 0x7f2ed006c8f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8006fd0 tx=0x7f2ee8008040 comp rx=0 tx=0).stop 2023-12-22T08:46:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.932+0000 7f2ef3355640 1 -- 172.21.15.38:0/2565629129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2eec160c50 msgr2=0x7f2eec0cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:46:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.932+0000 7f2ef3355640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2eec160c50 0x7f2eec0cbae0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400ccf0 tx=0x7f2ee400a660 comp rx=0 tx=0).stop 2023-12-22T08:46:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.932+0000 7f2ef3355640 1 -- 172.21.15.38:0/2565629129 shutdown_connections 2023-12-22T08:46:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.932+0000 7f2ef3355640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ed006a430 0x7f2ed006c8f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.932+0000 7f2ef3355640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2eec160c50 0x7f2eec0cbae0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.932+0000 7f2ef3355640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eec0ce020 0x7f2eec14dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.932+0000 7f2ef3355640 1 --2- 172.21.15.38:0/2565629129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2eec06f250 0x7f2eec0c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:46:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.932+0000 7f2ef3355640 1 -- 172.21.15.38:0/2565629129 >> 172.21.15.38:0/2565629129 conn(0x7f2eec0b20c0 msgr2=0x7f2eec0af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:46:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.932+0000 7f2ef3355640 1 -- 172.21.15.38:0/2565629129 shutdown_connections 2023-12-22T08:46:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:46:59.932+0000 7f2ef3355640 1 -- 172.21.15.38:0/2565629129 wait complete. 2023-12-22T08:46:59.952 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:46:59.952 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:47:00.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:47:00.198 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:47:00.198 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:47:00.199 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:00.262 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:47:00.262 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:47:00.263 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:00.323 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:47:00.324 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:47:00.324 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:00.386 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:47:00.386 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:47:00.386 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:00.446 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:47:00.447 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-22T08:47:00.447 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:47:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.679+0000 7f1a77e26640 1 Processor -- start 2023-12-22T08:47:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.679+0000 7f1a77e26640 1 -- start start 2023-12-22T08:47:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.681+0000 7f1a77e26640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a700d1780 0x7f1a700d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.681+0000 7f1a77e26640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7006a3d0 con 0x7f1a70147bd0 2023-12-22T08:47:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.681+0000 7f1a77e26640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a70164240 con 0x7f1a70147fb0 2023-12-22T08:47:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.681+0000 7f1a77e26640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7006a670 con 0x7f1a700d1780 2023-12-22T08:47:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.681+0000 7f1a75bc2640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1a70147bd0 0x7f1a700d1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45886/0 (socket says 172.21.15.38:45886) 2023-12-22T08:47:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.681+0000 7f1a75bc2640 1 -- 172.21.15.38:0/911551930 learned_addr learned my addr 172.21.15.38:0/911551930 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:00.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.681+0000 7f1a763c3640 1 --2- 172.21.15.38:0/911551930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a700d1780 0x7f1a700d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:00.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998436128 0 0) 0x7f1a7006a3d0 con 0x7f1a70147bd0 2023-12-22T08:47:00.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a5c003520 con 0x7f1a70147bd0 2023-12-22T08:47:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2977635634 0 0) 0x7f1a5c003520 con 0x7f1a70147bd0 2023-12-22T08:47:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a700d1780 msgr2=0x7f1a700d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 --2- 172.21.15.38:0/911551930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a700d1780 0x7f1a700d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 >> v1:172.21.15.89:6789/0 conn(0x7f1a70147fb0 legacy=0x7f1a700cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7006a950 con 0x7f1a70147bd0 2023-12-22T08:47:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f1a6c001670 con 0x7f1a70147bd0 2023-12-22T08:47:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 >> v1:172.21.15.38:6789/0 conn(0x7f1a70147bd0 legacy=0x7f1a700d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 --2- 172.21.15.38:0/911551930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a700d1780 0x7f1a5c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 --2- 172.21.15.38:0/911551930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a5c003f20 0x7f1a5c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 --2- 172.21.15.38:0/911551930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a5c004d00 0x7f1a5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7006a670 con 0x7f1a5c003f20 2023-12-22T08:47:00.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c00ba60 con 0x7f1a5c004d00 2023-12-22T08:47:00.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c00bc20 con 0x7f1a700d1780 2023-12-22T08:47:00.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.682+0000 7f1a753c1640 1 --2- 172.21.15.38:0/911551930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a5c003f20 0x7f1a5c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:00.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.683+0000 7f1a75bc2640 1 --2- 172.21.15.38:0/911551930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a700d1780 0x7f1a5c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:00.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.683+0000 7f1a763c3640 1 --2- 172.21.15.38:0/911551930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a5c004d00 0x7f1a5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:00.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.683+0000 7f1a753c1640 1 -- 172.21.15.38:0/911551930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a700d1780 msgr2=0x7f1a5c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:00.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.683+0000 7f1a753c1640 1 --2- 172.21.15.38:0/911551930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a700d1780 0x7f1a5c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:00.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.683+0000 7f1a753c1640 1 -- 172.21.15.38:0/911551930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a5c004d00 msgr2=0x7f1a5c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:00.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.683+0000 7f1a753c1640 1 --2- 172.21.15.38:0/911551930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a5c004d00 0x7f1a5c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:00.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.683+0000 7f1a753c1640 1 -- 172.21.15.38:0/911551930 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c003520 con 0x7f1a5c003f20 2023-12-22T08:47:00.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.684+0000 7f1a753c1640 1 --2- 172.21.15.38:0/911551930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a5c003f20 0x7f1a5c0047c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f1a60001750 tx=0x7f1a5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add4bc361bd3dcf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:00.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.685+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a600052d0 con 0x7f1a5c003f20 2023-12-22T08:47:00.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.685+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6002e050 con 0x7f1a5c003f20 2023-12-22T08:47:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.685+0000 7f1a74bc0640 1 -- 172.21.15.38:0/911551930 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60003830 con 0x7f1a5c003f20 2023-12-22T08:47:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.685+0000 7f1a77e26640 1 -- 172.21.15.38:0/911551930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a5c003f20 msgr2=0x7f1a5c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.685+0000 7f1a77e26640 1 --2- 172.21.15.38:0/911551930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a5c003f20 0x7f1a5c0047c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f1a60001750 tx=0x7f1a5c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.685+0000 7f1a763c3640 1 -- 172.21.15.38:0/911551930 reap_dead start 2023-12-22T08:47:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.685+0000 7f1a77e26640 1 -- 172.21.15.38:0/911551930 shutdown_connections 2023-12-22T08:47:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.685+0000 7f1a77e26640 1 -- 172.21.15.38:0/911551930 >> 172.21.15.38:0/911551930 conn(0x7f1a7006c5e0 msgr2=0x7f1a7006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.685+0000 7f1a77e26640 1 -- 172.21.15.38:0/911551930 shutdown_connections 2023-12-22T08:47:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.685+0000 7f1a77e26640 1 -- 172.21.15.38:0/911551930 wait complete. 2023-12-22T08:47:00.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.687+0000 7f1a77e26640 1 Processor -- start 2023-12-22T08:47:00.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.687+0000 7f1a77e26640 1 -- start start 2023-12-22T08:47:00.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.688+0000 7f1a77e26640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a5c003f20 0x7f1a701325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:00.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.688+0000 7f1a77e26640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a7015bdb0 0x7f1a70130810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:00.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.688+0000 7f1a77e26640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a7014a3e0 0x7f1a7014a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:00.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.688+0000 7f1a77e26640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7014add0 con 0x7f1a7014a3e0 2023-12-22T08:47:00.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.688+0000 7f1a77e26640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a700b3ed0 con 0x7f1a5c003f20 2023-12-22T08:47:00.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.688+0000 7f1a77e26640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a70149f50 con 0x7f1a7015bdb0 2023-12-22T08:47:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.689+0000 7f1a763c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a7014a3e0 0x7f1a7014a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.689+0000 7f1a763c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a7014a3e0 0x7f1a7014a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45756/0 (socket says 172.21.15.38:45756) 2023-12-22T08:47:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.689+0000 7f1a763c3640 1 -- 172.21.15.38:0/3169507885 learned_addr learned my addr 172.21.15.38:0/3169507885 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.689+0000 7f1a75bc2640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a5c003f20 0x7f1a701325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.689+0000 7f1a763c3640 1 -- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a7015bdb0 msgr2=0x7f1a70130810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.689+0000 7f1a753c1640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a7015bdb0 0x7f1a70130810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.689+0000 7f1a763c3640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a7015bdb0 0x7f1a70130810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.689+0000 7f1a763c3640 1 -- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a5c003f20 msgr2=0x7f1a701325c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.689+0000 7f1a763c3640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a5c003f20 0x7f1a701325c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.689+0000 7f1a763c3640 1 -- 172.21.15.38:0/3169507885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a700b6b50 con 0x7f1a7014a3e0 2023-12-22T08:47:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.689+0000 7f1a763c3640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a7014a3e0 0x7f1a7014a890 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f1a7006d1c0 tx=0x7f1a680115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.690+0000 7f1a667fc640 1 -- 172.21.15.38:0/3169507885 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800e070 con 0x7f1a7014a3e0 2023-12-22T08:47:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.690+0000 7f1a667fc640 1 -- 172.21.15.38:0/3169507885 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a68011de0 con 0x7f1a7014a3e0 2023-12-22T08:47:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.690+0000 7f1a667fc640 1 -- 172.21.15.38:0/3169507885 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68003990 con 0x7f1a7014a3e0 2023-12-22T08:47:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.690+0000 7f1a77e26640 1 -- 172.21.15.38:0/3169507885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a700b4400 con 0x7f1a7014a3e0 2023-12-22T08:47:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.690+0000 7f1a77e26640 1 -- 172.21.15.38:0/3169507885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a700b6df0 con 0x7f1a7014a3e0 2023-12-22T08:47:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.691+0000 7f1a77e26640 1 -- 172.21.15.38:0/3169507885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a70061910 con 0x7f1a7014a3e0 2023-12-22T08:47:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.692+0000 7f1a667fc640 1 -- 172.21.15.38:0/3169507885 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1a68003af0 con 0x7f1a7014a3e0 2023-12-22T08:47:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.693+0000 7f1a667fc640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1a5406a460 0x7f1a5406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.693+0000 7f1a667fc640 1 -- 172.21.15.38:0/3169507885 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1a68088dd0 con 0x7f1a7014a3e0 2023-12-22T08:47:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.694+0000 7f1a75bc2640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1a5406a460 0x7f1a5406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.696+0000 7f1a75bc2640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1a5406a460 0x7f1a5406c920 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c001eb0 tx=0x7f1a6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.697+0000 7f1a667fc640 1 -- 172.21.15.38:0/3169507885 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1a680546b0 con 0x7f1a7014a3e0 2023-12-22T08:47:00.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.926+0000 7f1a77e26640 1 -- 172.21.15.38:0/3169507885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a7006ac00 con 0x7f1a7014a3e0 2023-12-22T08:47:00.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.927+0000 7f1a667fc640 1 -- 172.21.15.38:0/3169507885 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f1a68057cd0 con 0x7f1a7014a3e0 2023-12-22T08:47:00.929 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:00.929 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5369,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/4163741517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":4163741517},{"type":"v1","addr":"172.21.15.89:6836","nonce":4163741517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/972467119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":972467119},{"type":"v1","addr":"172.21.15.89:6837","nonce":972467119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6864,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/2124959631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2124959631},{"type":"v1","addr":"172.21.15.38:6834","nonce":2124959631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2574419537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":2574419537},{"type":"v1","addr":"172.21.15.38:6835","nonce":2574419537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[]} 2023-12-22T08:47:00.929 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 49 2023-12-22T08:47:00.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.930+0000 7f1a77e26640 1 -- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1a5406a460 msgr2=0x7f1a5406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:00.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.930+0000 7f1a77e26640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1a5406a460 0x7f1a5406c920 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c001eb0 tx=0x7f1a6c009040 comp rx=0 tx=0).stop 2023-12-22T08:47:00.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.930+0000 7f1a77e26640 1 -- 172.21.15.38:0/3169507885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a7014a3e0 msgr2=0x7f1a7014a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:00.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.930+0000 7f1a77e26640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a7014a3e0 0x7f1a7014a890 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f1a7006d1c0 tx=0x7f1a680115a0 comp rx=0 tx=0).stop 2023-12-22T08:47:00.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.930+0000 7f1a77e26640 1 -- 172.21.15.38:0/3169507885 shutdown_connections 2023-12-22T08:47:00.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.930+0000 7f1a77e26640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1a5406a460 0x7f1a5406c920 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:00.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.930+0000 7f1a77e26640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a7014a3e0 0x7f1a7014a890 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:00.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.930+0000 7f1a77e26640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a7015bdb0 0x7f1a70130810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:00.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.930+0000 7f1a77e26640 1 --2- 172.21.15.38:0/3169507885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a5c003f20 0x7f1a701325c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:00.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.930+0000 7f1a77e26640 1 -- 172.21.15.38:0/3169507885 >> 172.21.15.38:0/3169507885 conn(0x7f1a7006c5e0 msgr2=0x7f1a70143d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:00.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.931+0000 7f1a77e26640 1 -- 172.21.15.38:0/3169507885 shutdown_connections 2023-12-22T08:47:00.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:00.931+0000 7f1a77e26640 1 -- 172.21.15.38:0/3169507885 wait complete. 2023-12-22T08:47:00.949 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T08:47:00.949 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T08:47:00.950 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T08:47:00.950 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:47:00.950 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T08:47:00.950 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T08:47:00.950 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T08:47:00.950 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:47:00.950 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T08:47:00.951 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T08:47:00.951 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T08:47:00.951 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:47:00.951 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T08:47:00.951 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T08:47:00.951 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T08:47:00.951 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:47:00.965 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T08:47:00.965 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T08:47:00.968 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T08:47:00.968 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T08:47:00.976 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T08:47:00.977 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T08:47:00.981 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T08:47:00.981 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T08:47:01.014 INFO:tasks.ceph.mds.a:Started 2023-12-22T08:47:01.014 DEBUG:teuthology.parallel:result is None 2023-12-22T08:47:01.019 INFO:tasks.ceph.mds.c:Started 2023-12-22T08:47:01.019 DEBUG:teuthology.parallel:result is None 2023-12-22T08:47:01.027 INFO:tasks.ceph.mds.b:Started 2023-12-22T08:47:01.027 DEBUG:teuthology.parallel:result is None 2023-12-22T08:47:01.034 INFO:tasks.ceph.mds.d:Started 2023-12-22T08:47:01.035 DEBUG:teuthology.parallel:result is None 2023-12-22T08:47:01.035 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-22T08:47:01.167 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:47:01.167 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:47:01.194 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-22T08:47:01.203 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-12-22T08:47:01.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.226+0000 7f88ce821640 1 Processor -- start 2023-12-22T08:47:01.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.226+0000 7f88ce821640 1 -- start start 2023-12-22T08:47:01.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.227+0000 7f88ce821640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f88c815e740 0x7f88c815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:01.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.227+0000 7f88ce821640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88c80b3f90 0x7f88c8070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:01.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.227+0000 7f88ce821640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c815eb20 con 0x7f88c806ca50 2023-12-22T08:47:01.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.227+0000 7f88ce821640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c806e650 con 0x7f88c815e740 2023-12-22T08:47:01.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.227+0000 7f88ce821640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c8070770 con 0x7f88c80b3f90 2023-12-22T08:47:01.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.228+0000 7f88c7fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f88c815e740 0x7f88c815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:01.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.228+0000 7f88c7fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f88c815e740 0x7f88c815db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42250/0 (socket says 172.21.15.38:42250) 2023-12-22T08:47:01.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.228+0000 7f88c7fff640 1 -- 172.21.15.38:0/2350334425 learned_addr learned my addr 172.21.15.38:0/2350334425 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:01.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.228+0000 7f88ccdbe640 1 --2- 172.21.15.38:0/2350334425 >> v2:172.21.15.89:3300/0 conn(0x7f88c80b3f90 0x7f88c8070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:01.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.228+0000 7f88c7fff640 1 -- 172.21.15.38:0/2350334425 >> v2:172.21.15.89:3300/0 conn(0x7f88c80b3f90 msgr2=0x7f88c8070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:01.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.228+0000 7f88c7fff640 1 --2- 172.21.15.38:0/2350334425 >> v2:172.21.15.89:3300/0 conn(0x7f88c80b3f90 0x7f88c8070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:01.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.228+0000 7f88c7fff640 1 -- 172.21.15.38:0/2350334425 >> v1:172.21.15.38:6789/0 conn(0x7f88c806ca50 legacy=0x7f88c80b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:01.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.228+0000 7f88c7fff640 1 -- 172.21.15.38:0/2350334425 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c806cec0 con 0x7f88c815e740 2023-12-22T08:47:01.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.229+0000 7f88c7fff640 1 --2- 172.21.15.38:0/2350334425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88c815e740 0x7f88c815db30 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f88c815b700 tx=0x7f88b802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6091648a51d7da server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:01.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.230+0000 7f88c77fe640 1 -- 172.21.15.38:0/2350334425 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80317e0 con 0x7f88c815e740 2023-12-22T08:47:01.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.230+0000 7f88c77fe640 1 -- 172.21.15.38:0/2350334425 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8031940 con 0x7f88c815e740 2023-12-22T08:47:01.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.230+0000 7f88c77fe640 1 -- 172.21.15.38:0/2350334425 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8031cd0 con 0x7f88c815e740 2023-12-22T08:47:01.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.230+0000 7f88ce821640 1 -- 172.21.15.38:0/2350334425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88c815e740 msgr2=0x7f88c815db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:01.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.230+0000 7f88ce821640 1 --2- 172.21.15.38:0/2350334425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88c815e740 0x7f88c815db30 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f88c815b700 tx=0x7f88b802b880 comp rx=0 tx=0).stop 2023-12-22T08:47:01.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.230+0000 7f88ce821640 1 -- 172.21.15.38:0/2350334425 shutdown_connections 2023-12-22T08:47:01.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.230+0000 7f88ce821640 1 --2- 172.21.15.38:0/2350334425 >> v2:172.21.15.89:3300/0 conn(0x7f88c80b3f90 0x7f88c8070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:01.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.230+0000 7f88ce821640 1 --2- 172.21.15.38:0/2350334425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88c815e740 0x7f88c815db30 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:01.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.230+0000 7f88ce821640 1 -- 172.21.15.38:0/2350334425 >> 172.21.15.38:0/2350334425 conn(0x7f88c80cfea0 msgr2=0x7f88c80d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:01.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.230+0000 7f88ce821640 1 -- 172.21.15.38:0/2350334425 shutdown_connections 2023-12-22T08:47:01.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.230+0000 7f88ce821640 1 -- 172.21.15.38:0/2350334425 wait complete. 2023-12-22T08:47:01.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.232+0000 7f88ce821640 1 Processor -- start 2023-12-22T08:47:01.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.232+0000 7f88ce821640 1 -- start start 2023-12-22T08:47:01.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.233+0000 7f88ce821640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88c806ca50 0x7f88c8156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:01.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.233+0000 7f88ce821640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88c80b3f90 0x7f88c8156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:01.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.233+0000 7f88ce821640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c815e740 0x7f88c8157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:01.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.233+0000 7f88ce821640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c8154f80 con 0x7f88c806ca50 2023-12-22T08:47:01.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.233+0000 7f88ce821640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c8155260 con 0x7f88c80b3f90 2023-12-22T08:47:01.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.233+0000 7f88ce821640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c8155540 con 0x7f88c815e740 2023-12-22T08:47:01.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.233+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88c806ca50 0x7f88c8156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:01.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.233+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88c806ca50 0x7f88c8156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42262/0 (socket says 172.21.15.38:42262) 2023-12-22T08:47:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.233+0000 7f88c7fff640 1 -- 172.21.15.38:0/2579959353 learned_addr learned my addr 172.21.15.38:0/2579959353 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88ccdbe640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c815e740 0x7f88c8157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88bffff640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88c80b3f90 0x7f88c8156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88c7fff640 1 -- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c815e740 msgr2=0x7f88c8157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88c7fff640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c815e740 0x7f88c8157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88c7fff640 1 -- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88c80b3f90 msgr2=0x7f88c8156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88c7fff640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88c80b3f90 0x7f88c8156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88c7fff640 1 -- 172.21.15.38:0/2579959353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b80094d0 con 0x7f88c806ca50 2023-12-22T08:47:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88ccdbe640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c815e740 0x7f88c8157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88bffff640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88c80b3f90 0x7f88c8156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88c7fff640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88c806ca50 0x7f88c8156020 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000c00 tx=0x7f88b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88c57fa640 1 -- 172.21.15.38:0/2579959353 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8032880 con 0x7f88c806ca50 2023-12-22T08:47:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88c57fa640 1 -- 172.21.15.38:0/2579959353 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8032a20 con 0x7f88c806ca50 2023-12-22T08:47:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88c57fa640 1 -- 172.21.15.38:0/2579959353 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8032dd0 con 0x7f88c806ca50 2023-12-22T08:47:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.234+0000 7f88ce821640 1 -- 172.21.15.38:0/2579959353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c8155820 con 0x7f88c806ca50 2023-12-22T08:47:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.235+0000 7f88ce821640 1 -- 172.21.15.38:0/2579959353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c8154c30 con 0x7f88c806ca50 2023-12-22T08:47:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.236+0000 7f88ce821640 1 -- 172.21.15.38:0/2579959353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c8155d40 con 0x7f88c806ca50 2023-12-22T08:47:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.236+0000 7f88c57fa640 1 -- 172.21.15.38:0/2579959353 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f88b804e450 con 0x7f88c806ca50 2023-12-22T08:47:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.237+0000 7f88c57fa640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88a806a430 0x7f88a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.237+0000 7f88c57fa640 1 -- 172.21.15.38:0/2579959353 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f88b80aa7f0 con 0x7f88c806ca50 2023-12-22T08:47:01.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.238+0000 7f88bffff640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88a806a430 0x7f88a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:01.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.238+0000 7f88bffff640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88a806a430 0x7f88a806c8f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f88c80d2e00 tx=0x7f88b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:01.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.241+0000 7f88c57fa640 1 -- 172.21.15.38:0/2579959353 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f88c8155d40 con 0x7f88c806ca50 2023-12-22T08:47:01.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:01.448+0000 7f88ce821640 1 -- 172.21.15.38:0/2579959353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f88c8155d40 con 0x7f88c806ca50 2023-12-22T08:47:02.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.262+0000 7f88c57fa640 1 -- 172.21.15.38:0/2579959353 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v123) v1 ==== 97+0+0 (secure 0 0 0) 0x7f88c8155d40 con 0x7f88c806ca50 2023-12-22T08:47:02.264 INFO:teuthology.orchestra.run.smithi038.stderr: removed all blocklist entries 2023-12-22T08:47:02.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.266+0000 7f88ce821640 1 -- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88a806a430 msgr2=0x7f88a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:02.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.266+0000 7f88ce821640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88a806a430 0x7f88a806c8f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f88c80d2e00 tx=0x7f88b0009040 comp rx=0 tx=0).stop 2023-12-22T08:47:02.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.266+0000 7f88ce821640 1 -- 172.21.15.38:0/2579959353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88c806ca50 msgr2=0x7f88c8156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:02.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.266+0000 7f88ce821640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88c806ca50 0x7f88c8156020 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000c00 tx=0x7f88b80046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.266+0000 7f88ce821640 1 -- 172.21.15.38:0/2579959353 shutdown_connections 2023-12-22T08:47:02.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.266+0000 7f88ce821640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88c815e740 0x7f88c8157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.266+0000 7f88ce821640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88c80b3f90 0x7f88c8156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.266+0000 7f88ce821640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88a806a430 0x7f88a806c8f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.266+0000 7f88ce821640 1 --2- 172.21.15.38:0/2579959353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88c806ca50 0x7f88c8156020 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.266+0000 7f88ce821640 1 -- 172.21.15.38:0/2579959353 >> 172.21.15.38:0/2579959353 conn(0x7f88c80cfea0 msgr2=0x7f88c815d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:02.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.266+0000 7f88ce821640 1 -- 172.21.15.38:0/2579959353 shutdown_connections 2023-12-22T08:47:02.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.266+0000 7f88ce821640 1 -- 172.21.15.38:0/2579959353 wait complete. 2023-12-22T08:47:02.290 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T08:47:02.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.502+0000 7fa63359e640 1 Processor -- start 2023-12-22T08:47:02.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.503+0000 7fa63359e640 1 -- start start 2023-12-22T08:47:02.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.504+0000 7fa63359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa634071000 0x7fa634165f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:02.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.504+0000 7fa63359e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6340cdae0 con 0x7fa63415b420 2023-12-22T08:47:02.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.504+0000 7fa63359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63415b800 con 0x7fa6340a44a0 2023-12-22T08:47:02.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.504+0000 7fa63359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340cdd30 con 0x7fa634071000 2023-12-22T08:47:02.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.505+0000 7fa63259c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa63415b420 0x7fa63406d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34916/0 (socket says 172.21.15.38:34916) 2023-12-22T08:47:02.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.505+0000 7fa63259c640 1 -- 172.21.15.38:0/1341743636 learned_addr learned my addr 172.21.15.38:0/1341743636 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:02.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.505+0000 7fa632d9d640 1 --2- 172.21.15.38:0/1341743636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa634071000 0x7fa634165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:02.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.505+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744630480 0 0) 0x7fa6340cdae0 con 0x7fa63415b420 2023-12-22T08:47:02.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.505+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa620003520 con 0x7fa63415b420 2023-12-22T08:47:02.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.505+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 804390602 0 0) 0x7fa620003520 con 0x7fa63415b420 2023-12-22T08:47:02.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.505+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa634071000 msgr2=0x7fa634165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:02.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.505+0000 7fa631d9b640 1 --2- 172.21.15.38:0/1341743636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa634071000 0x7fa634165f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.505+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 >> v1:172.21.15.89:6789/0 conn(0x7fa6340a44a0 legacy=0x7fa6340708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:02.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6340ce010 con 0x7fa63415b420 2023-12-22T08:47:02.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fa624001670 con 0x7fa63415b420 2023-12-22T08:47:02.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 >> v1:172.21.15.38:6789/0 conn(0x7fa63415b420 legacy=0x7fa63406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:02.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa631d9b640 1 --2- 172.21.15.38:0/1341743636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa634071000 0x7fa6200039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:02.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa631d9b640 1 --2- 172.21.15.38:0/1341743636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa620003f20 0x7fa6200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:02.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa631d9b640 1 --2- 172.21.15.38:0/1341743636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620004d00 0x7fa620005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:02.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340cdd30 con 0x7fa620003f20 2023-12-22T08:47:02.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62000ba60 con 0x7fa620004d00 2023-12-22T08:47:02.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62000bc20 con 0x7fa634071000 2023-12-22T08:47:02.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa62bfff640 1 --2- 172.21.15.38:0/1341743636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa620003f20 0x7fa6200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:02.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa632d9d640 1 --2- 172.21.15.38:0/1341743636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620004d00 0x7fa620005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:02.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa63259c640 1 --2- 172.21.15.38:0/1341743636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa634071000 0x7fa6200039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:02.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa62bfff640 1 -- 172.21.15.38:0/1341743636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa634071000 msgr2=0x7fa6200039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:02.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa62bfff640 1 --2- 172.21.15.38:0/1341743636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa634071000 0x7fa6200039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa62bfff640 1 -- 172.21.15.38:0/1341743636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620004d00 msgr2=0x7fa620005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:02.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa62bfff640 1 --2- 172.21.15.38:0/1341743636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620004d00 0x7fa620005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa62bfff640 1 -- 172.21.15.38:0/1341743636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa620003520 con 0x7fa620003f20 2023-12-22T08:47:02.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.506+0000 7fa632d9d640 1 --2- 172.21.15.38:0/1341743636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620004d00 0x7fa620005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:02.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.508+0000 7fa62bfff640 1 --2- 172.21.15.38:0/1341743636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa620003f20 0x7fa6200047c0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa6340b1f40 tx=0x7fa6200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecba468fc02a5f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:02.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.508+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0052d0 con 0x7fa620003f20 2023-12-22T08:47:02.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.508+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c02e050 con 0x7fa620003f20 2023-12-22T08:47:02.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.508+0000 7fa631d9b640 1 -- 172.21.15.38:0/1341743636 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c003830 con 0x7fa620003f20 2023-12-22T08:47:02.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.508+0000 7fa63359e640 1 -- 172.21.15.38:0/1341743636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa620003f20 msgr2=0x7fa6200047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:02.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.508+0000 7fa63359e640 1 --2- 172.21.15.38:0/1341743636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa620003f20 0x7fa6200047c0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa6340b1f40 tx=0x7fa6200057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.508+0000 7fa632d9d640 1 -- 172.21.15.38:0/1341743636 reap_dead start 2023-12-22T08:47:02.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.509+0000 7fa63359e640 1 -- 172.21.15.38:0/1341743636 shutdown_connections 2023-12-22T08:47:02.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.509+0000 7fa63359e640 1 -- 172.21.15.38:0/1341743636 >> 172.21.15.38:0/1341743636 conn(0x7fa6340b1f70 msgr2=0x7fa6340b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:02.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.509+0000 7fa63359e640 1 -- 172.21.15.38:0/1341743636 shutdown_connections 2023-12-22T08:47:02.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.509+0000 7fa63359e640 1 -- 172.21.15.38:0/1341743636 wait complete. 2023-12-22T08:47:02.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.511+0000 7fa63359e640 1 Processor -- start 2023-12-22T08:47:02.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.511+0000 7fa63359e640 1 -- start start 2023-12-22T08:47:02.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.512+0000 7fa63359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620003f20 0x7fa6340cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:02.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.512+0000 7fa63359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6340c2a50 0x7fa6340c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:02.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.512+0000 7fa63359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa63406c820 0x7fa63406cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:02.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.512+0000 7fa63359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63406d1e0 con 0x7fa6340c2a50 2023-12-22T08:47:02.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.512+0000 7fa63359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa634149b50 con 0x7fa620003f20 2023-12-22T08:47:02.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.512+0000 7fa63359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa634149e30 con 0x7fa63406c820 2023-12-22T08:47:02.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.513+0000 7fa62bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6340c2a50 0x7fa6340c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:02.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.513+0000 7fa62bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6340c2a50 0x7fa6340c2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42284/0 (socket says 172.21.15.38:42284) 2023-12-22T08:47:02.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.513+0000 7fa62bfff640 1 -- 172.21.15.38:0/4019455331 learned_addr learned my addr 172.21.15.38:0/4019455331 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:02.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.513+0000 7fa63259c640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620003f20 0x7fa6340cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:02.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.513+0000 7fa632d9d640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa63406c820 0x7fa63406cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:02.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.513+0000 7fa62bfff640 1 -- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa63406c820 msgr2=0x7fa63406cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:02.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.513+0000 7fa62bfff640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa63406c820 0x7fa63406cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.513+0000 7fa62bfff640 1 -- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620003f20 msgr2=0x7fa6340cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:02.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.513+0000 7fa62bfff640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620003f20 0x7fa6340cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.513+0000 7fa62bfff640 1 -- 172.21.15.38:0/4019455331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63414a110 con 0x7fa6340c2a50 2023-12-22T08:47:02.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.514+0000 7fa62bfff640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6340c2a50 0x7fa6340c2e90 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa61c02bbb0 tx=0x7fa61c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:02.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.514+0000 7fa62affd640 1 -- 172.21.15.38:0/4019455331 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c007a30 con 0x7fa6340c2a50 2023-12-22T08:47:02.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.514+0000 7fa62affd640 1 -- 172.21.15.38:0/4019455331 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c007640 con 0x7fa6340c2a50 2023-12-22T08:47:02.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.514+0000 7fa62affd640 1 -- 172.21.15.38:0/4019455331 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c006c00 con 0x7fa6340c2a50 2023-12-22T08:47:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.514+0000 7fa63359e640 1 -- 172.21.15.38:0/4019455331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63414a3f0 con 0x7fa6340c2a50 2023-12-22T08:47:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.514+0000 7fa63359e640 1 -- 172.21.15.38:0/4019455331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6340cb8d0 con 0x7fa6340c2a50 2023-12-22T08:47:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.515+0000 7fa63359e640 1 -- 172.21.15.38:0/4019455331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa634061910 con 0x7fa6340c2a50 2023-12-22T08:47:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.516+0000 7fa62affd640 1 -- 172.21.15.38:0/4019455331 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa61c0035f0 con 0x7fa6340c2a50 2023-12-22T08:47:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.517+0000 7fa62affd640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa61406a460 0x7fa61406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.517+0000 7fa62affd640 1 -- 172.21.15.38:0/4019455331 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa61c0aa360 con 0x7fa6340c2a50 2023-12-22T08:47:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.518+0000 7fa63259c640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa61406a460 0x7fa61406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.519+0000 7fa63259c640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa61406a460 0x7fa61406c920 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa624005a10 tx=0x7fa624009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:02.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.522+0000 7fa62affd640 1 -- 172.21.15.38:0/4019455331 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa61c075c00 con 0x7fa6340c2a50 2023-12-22T08:47:02.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.775+0000 7fa63359e640 1 -- 172.21.15.38:0/4019455331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa6340ce880 con 0x7fa6340c2a50 2023-12-22T08:47:02.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.776+0000 7fa62affd640 1 -- 172.21.15.38:0/4019455331 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa61c079220 con 0x7fa6340c2a50 2023-12-22T08:47:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:02.778 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:47:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_dump": [ 2023-12-22T08:47:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.a", 2023-12-22T08:47:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl57dkCBAAeliJIPc49iRBk2mp8WYv8A==", 2023-12-22T08:47:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:47:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:47:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.b", 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl0C0+KhAAkCsjfyn19nOz1xTyhZkbPQ==", 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.c", 2023-12-22T08:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl7poXGhAA+ZSohyj4dAOs6B5dZKTLAg==", 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.d", 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4VlTBuoOhAArKX4AiOQRGawIyAnInIhCg==", 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:47:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.0", 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VlnVQaChAAxfWmPqwo5D4qBYkAP/6dHQ==", 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.1", 2023-12-22T08:47:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4Vll2dlGxAAbqx4rxnz4FWIKl9OGqcwtw==", 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.2", 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VljQ3HLRAAfyrtqD4n6Da8Rl/6UKmv7g==", 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.3", 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBCS4VlOat4AxAAIkAGRvGGWrrwx/ppMbexWQ==", 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.4", 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlwg7TDxAA+L504F+Hw/6FTJ63cV3ZXg==", 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.5", 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx8zgHxAALBDm/sSYqw/fn4nLNQbu4A==", 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.6", 2023-12-22T08:47:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx5OdLxAAaMP09nYI3HKiuhPARgnCOw==", 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.7", 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBHS4Vl/15bBBAA4maatkcgA0axcZY/L9r/IA==", 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.0", 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlgDspDhAA0TWGbk4AbuOhCNotPej29A==", 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow r", 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.1", 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlwSk/JhAAM3faae43p4/gw9BmyxLpJA==", 2023-12-22T08:47:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:47:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:47:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:47:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.2", 2023-12-22T08:47:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VliOHMGhAARaM8FC/0maNMToLGhBR4Tg==", 2023-12-22T08:47:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:47:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.3", 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlV/MVMRAAyN1643IAOTLOLuz4DqMZ8A==", 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.admin", 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA2S4VlBhogNhAACBsSGP7kmhCSn+XAKkvgKQ==", 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.x", 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlTHG+NhAAUNkVtrDuoK2OEsy1HHkt2A==", 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:47:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.y", 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlED5ALBAAComDf9woKBt/IXcez+Udmg==", 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:47:02.790 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:47:02.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.779+0000 7fa63359e640 1 -- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa61406a460 msgr2=0x7fa61406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:02.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.779+0000 7fa63359e640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa61406a460 0x7fa61406c920 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa624005a10 tx=0x7fa624009040 comp rx=0 tx=0).stop 2023-12-22T08:47:02.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.779+0000 7fa63359e640 1 -- 172.21.15.38:0/4019455331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6340c2a50 msgr2=0x7fa6340c2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:02.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.779+0000 7fa63359e640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6340c2a50 0x7fa6340c2e90 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa61c02bbb0 tx=0x7fa61c001120 comp rx=0 tx=0).stop 2023-12-22T08:47:02.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.779+0000 7fa63359e640 1 -- 172.21.15.38:0/4019455331 shutdown_connections 2023-12-22T08:47:02.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.779+0000 7fa63359e640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa63406c820 0x7fa63406cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.779+0000 7fa63359e640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa61406a460 0x7fa61406c920 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.779+0000 7fa63359e640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6340c2a50 0x7fa6340c2e90 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.779+0000 7fa63359e640 1 --2- 172.21.15.38:0/4019455331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa620003f20 0x7fa6340cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:02.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.779+0000 7fa63359e640 1 -- 172.21.15.38:0/4019455331 >> 172.21.15.38:0/4019455331 conn(0x7fa6340b1f70 msgr2=0x7fa63415db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:02.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.779+0000 7fa63359e640 1 -- 172.21.15.38:0/4019455331 shutdown_connections 2023-12-22T08:47:02.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:02.779+0000 7fa63359e640 1 -- 172.21.15.38:0/4019455331 wait complete. 2023-12-22T08:47:02.799 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:03.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.016+0000 7f92cd20e640 1 Processor -- start 2023-12-22T08:47:03.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.016+0000 7f92cd20e640 1 -- start start 2023-12-22T08:47:03.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.017+0000 7f92cd20e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f92c806d210 0x7f92c815e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92cd20e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f92c80cb4c0 0x7f92c8159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92cd20e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c806d5f0 0x7f92c815a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92cd20e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c80706d0 con 0x7f92c806d210 2023-12-22T08:47:03.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92cd20e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c80cbf40 con 0x7f92c80cb4c0 2023-12-22T08:47:03.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92cd20e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c815a760 con 0x7f92c806d5f0 2023-12-22T08:47:03.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92c7fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f92c806d210 0x7f92c815e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92c7fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f92c806d210 0x7f92c815e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42300/0 (socket says 172.21.15.38:42300) 2023-12-22T08:47:03.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92c7fff640 1 -- 172.21.15.38:0/2530374435 learned_addr learned my addr 172.21.15.38:0/2530374435 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:03.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92bf7fe640 1 --2- 172.21.15.38:0/2530374435 >> v2:172.21.15.89:3300/0 conn(0x7f92c80cb4c0 0x7f92c8159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92cca0d640 1 --2- 172.21.15.38:0/2530374435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c806d5f0 0x7f92c815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92c7fff640 1 -- 172.21.15.38:0/2530374435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c806d5f0 msgr2=0x7f92c815a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:03.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92c7fff640 1 --2- 172.21.15.38:0/2530374435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c806d5f0 0x7f92c815a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92c7fff640 1 -- 172.21.15.38:0/2530374435 >> v2:172.21.15.89:3300/0 conn(0x7f92c80cb4c0 msgr2=0x7f92c8159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:03.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.018+0000 7f92c7fff640 1 --2- 172.21.15.38:0/2530374435 >> v2:172.21.15.89:3300/0 conn(0x7f92c80cb4c0 0x7f92c8159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.019+0000 7f92c7fff640 1 -- 172.21.15.38:0/2530374435 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c80ce840 con 0x7f92c806d210 2023-12-22T08:47:03.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.020+0000 7f92c7fff640 1 --2- 172.21.15.38:0/2530374435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c806d210 0x7f92c815e830 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f92c80a4590 tx=0x7f92b802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ce44e7d0e569b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:03.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.020+0000 7f92c77fe640 1 -- 172.21.15.38:0/2530374435 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b802ca70 con 0x7f92c806d210 2023-12-22T08:47:03.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.020+0000 7f92c77fe640 1 -- 172.21.15.38:0/2530374435 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b802cbd0 con 0x7f92c806d210 2023-12-22T08:47:03.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.020+0000 7f92c77fe640 1 -- 172.21.15.38:0/2530374435 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80343f0 con 0x7f92c806d210 2023-12-22T08:47:03.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.021+0000 7f92cd20e640 1 -- 172.21.15.38:0/2530374435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c806d210 msgr2=0x7f92c815e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.021+0000 7f92cd20e640 1 --2- 172.21.15.38:0/2530374435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c806d210 0x7f92c815e830 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f92c80a4590 tx=0x7f92b802bed0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.021+0000 7f92cd20e640 1 -- 172.21.15.38:0/2530374435 shutdown_connections 2023-12-22T08:47:03.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.021+0000 7f92cd20e640 1 --2- 172.21.15.38:0/2530374435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c806d5f0 0x7f92c815a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.021+0000 7f92cd20e640 1 --2- 172.21.15.38:0/2530374435 >> v2:172.21.15.89:3300/0 conn(0x7f92c80cb4c0 0x7f92c8159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.021+0000 7f92cd20e640 1 --2- 172.21.15.38:0/2530374435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c806d210 0x7f92c815e830 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.021+0000 7f92cd20e640 1 -- 172.21.15.38:0/2530374435 >> 172.21.15.38:0/2530374435 conn(0x7f92c80b1f70 msgr2=0x7f92c80b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:03.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.021+0000 7f92cd20e640 1 -- 172.21.15.38:0/2530374435 shutdown_connections 2023-12-22T08:47:03.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.021+0000 7f92cd20e640 1 -- 172.21.15.38:0/2530374435 wait complete. 2023-12-22T08:47:03.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.023+0000 7f92cd20e640 1 Processor -- start 2023-12-22T08:47:03.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.023+0000 7f92cd20e640 1 -- start start 2023-12-22T08:47:03.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.024+0000 7f92cd20e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c806d210 0x7f92c81f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.024+0000 7f92cd20e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c806d5f0 0x7f92c81536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.024+0000 7f92cd20e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c80cb4c0 0x7f92c81f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.024+0000 7f92cd20e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80a0b60 con 0x7f92c80cb4c0 2023-12-22T08:47:03.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.024+0000 7f92cd20e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c809e860 con 0x7f92c806d210 2023-12-22T08:47:03.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.024+0000 7f92cd20e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80a0350 con 0x7f92c806d5f0 2023-12-22T08:47:03.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.024+0000 7f92cca0d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c80cb4c0 0x7f92c81f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.025+0000 7f92cca0d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c80cb4c0 0x7f92c81f2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42316/0 (socket says 172.21.15.38:42316) 2023-12-22T08:47:03.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.025+0000 7f92cca0d640 1 -- 172.21.15.38:0/4220737806 learned_addr learned my addr 172.21.15.38:0/4220737806 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:03.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.025+0000 7f92c7fff640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c806d210 0x7f92c81f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.025+0000 7f92bf7fe640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c806d5f0 0x7f92c81536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.025+0000 7f92cca0d640 1 -- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c806d5f0 msgr2=0x7f92c81536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.025+0000 7f92cca0d640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c806d5f0 0x7f92c81536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.025+0000 7f92cca0d640 1 -- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c806d210 msgr2=0x7f92c81f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.025+0000 7f92cca0d640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c806d210 0x7f92c81f69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.025+0000 7f92cca0d640 1 -- 172.21.15.38:0/4220737806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b8009b30 con 0x7f92c80cb4c0 2023-12-22T08:47:03.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.025+0000 7f92cca0d640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c80cb4c0 0x7f92c81f2180 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f92c000d800 tx=0x7f92c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:03.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.026+0000 7f92c57fa640 1 -- 172.21.15.38:0/4220737806 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0009660 con 0x7f92c80cb4c0 2023-12-22T08:47:03.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.026+0000 7f92c57fa640 1 -- 172.21.15.38:0/4220737806 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c00097e0 con 0x7f92c80cb4c0 2023-12-22T08:47:03.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.026+0000 7f92cd20e640 1 -- 172.21.15.38:0/4220737806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c809eb30 con 0x7f92c80cb4c0 2023-12-22T08:47:03.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.026+0000 7f92c57fa640 1 -- 172.21.15.38:0/4220737806 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0009b90 con 0x7f92c80cb4c0 2023-12-22T08:47:03.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.026+0000 7f92cd20e640 1 -- 172.21.15.38:0/4220737806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c8153c50 con 0x7f92c80cb4c0 2023-12-22T08:47:03.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.027+0000 7f92cd20e640 1 -- 172.21.15.38:0/4220737806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c806eaf0 con 0x7f92c80cb4c0 2023-12-22T08:47:03.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.028+0000 7f92c57fa640 1 -- 172.21.15.38:0/4220737806 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f92c0009cf0 con 0x7f92c80cb4c0 2023-12-22T08:47:03.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.029+0000 7f92c57fa640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f92a806a430 0x7f92a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.029+0000 7f92c57fa640 1 -- 172.21.15.38:0/4220737806 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f92c0088bc0 con 0x7f92c80cb4c0 2023-12-22T08:47:03.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.030+0000 7f92c7fff640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f92a806a430 0x7f92a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.031+0000 7f92c7fff640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f92a806a430 0x7f92a806c8f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f92b8035000 tx=0x7f92b8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:03.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.033+0000 7f92c57fa640 1 -- 172.21.15.38:0/4220737806 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f92c00544f0 con 0x7f92c80cb4c0 2023-12-22T08:47:03.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.234+0000 7f92cd20e640 1 -- 172.21.15.38:0/4220737806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92c80a09a0 con 0x7f92c80cb4c0 2023-12-22T08:47:03.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.235+0000 7f92c57fa640 1 -- 172.21.15.38:0/4220737806 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+12352 (secure 0 0 0) 0x7f92c0057b10 con 0x7f92c80cb4c0 2023-12-22T08:47:03.237 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:03.237 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":123,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:02.248271+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:03.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.238+0000 7f92cd20e640 1 -- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f92a806a430 msgr2=0x7f92a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.238+0000 7f92cd20e640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f92a806a430 0x7f92a806c8f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f92b8035000 tx=0x7f92b8030000 comp rx=0 tx=0).stop 2023-12-22T08:47:03.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.239+0000 7f92cd20e640 1 -- 172.21.15.38:0/4220737806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c80cb4c0 msgr2=0x7f92c81f2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.239+0000 7f92cd20e640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c80cb4c0 0x7f92c81f2180 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f92c000d800 tx=0x7f92c000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.239+0000 7f92cd20e640 1 -- 172.21.15.38:0/4220737806 shutdown_connections 2023-12-22T08:47:03.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.239+0000 7f92cd20e640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f92a806a430 0x7f92a806c8f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.239+0000 7f92cd20e640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c80cb4c0 0x7f92c81f2180 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.239+0000 7f92cd20e640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c806d5f0 0x7f92c81536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.239+0000 7f92cd20e640 1 --2- 172.21.15.38:0/4220737806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c806d210 0x7f92c81f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.239+0000 7f92cd20e640 1 -- 172.21.15.38:0/4220737806 >> 172.21.15.38:0/4220737806 conn(0x7f92c80b1f70 msgr2=0x7f92c8159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:03.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.239+0000 7f92cd20e640 1 -- 172.21.15.38:0/4220737806 shutdown_connections 2023-12-22T08:47:03.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.239+0000 7f92cd20e640 1 -- 172.21.15.38:0/4220737806 wait complete. 2023-12-22T08:47:03.260 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:47:03.260 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:47:03.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.485+0000 7f7f8095c640 1 Processor -- start 2023-12-22T08:47:03.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.485+0000 7f7f8095c640 1 -- start start 2023-12-22T08:47:03.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.487+0000 7f7f8095c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c06f4c0 0x7f7f7c06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.487+0000 7f7f8095c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7f7c15d9d0 0x7f7f7c0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.487+0000 7f7f8095c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7c0b4180 con 0x7f7f7c0cb150 2023-12-22T08:47:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.487+0000 7f7f8095c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7c06e7f0 con 0x7f7f7c15d9d0 2023-12-22T08:47:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.487+0000 7f7f8095c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c06dc80 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.488+0000 7f7f7ad9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7f7c15d9d0 0x7f7f7c0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.488+0000 7f7f7ad9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7f7c15d9d0 0x7f7f7c0b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42324/0 (socket says 172.21.15.38:42324) 2023-12-22T08:47:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.488+0000 7f7f7ad9d640 1 -- 172.21.15.38:0/3307307113 learned_addr learned my addr 172.21.15.38:0/3307307113 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.488+0000 7f7f7a59c640 1 --2- 172.21.15.38:0/3307307113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c06f4c0 0x7f7f7c06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.488+0000 7f7f7ad9d640 1 -- 172.21.15.38:0/3307307113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c06f4c0 msgr2=0x7f7f7c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.488+0000 7f7f7ad9d640 1 --2- 172.21.15.38:0/3307307113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c06f4c0 0x7f7f7c06d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.488+0000 7f7f7ad9d640 1 -- 172.21.15.38:0/3307307113 >> v1:172.21.15.89:6789/0 conn(0x7f7f7c0cb150 legacy=0x7f7f7c15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.488+0000 7f7f7ad9d640 1 -- 172.21.15.38:0/3307307113 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c06df50 con 0x7f7f7c15d9d0 2023-12-22T08:47:03.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.489+0000 7f7f7ad9d640 1 --2- 172.21.15.38:0/3307307113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f7c15d9d0 0x7f7f7c0b48d0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009e50 tx=0x7f7f7402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0a26fbe2e5999a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:03.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.492+0000 7f7f7959a640 1 -- 172.21.15.38:0/3307307113 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7402cb00 con 0x7f7f7c15d9d0 2023-12-22T08:47:03.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.492+0000 7f7f7959a640 1 -- 172.21.15.38:0/3307307113 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7402cc60 con 0x7f7f7c15d9d0 2023-12-22T08:47:03.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.492+0000 7f7f7959a640 1 -- 172.21.15.38:0/3307307113 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f740343f0 con 0x7f7f7c15d9d0 2023-12-22T08:47:03.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.492+0000 7f7f8095c640 1 -- 172.21.15.38:0/3307307113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f7c15d9d0 msgr2=0x7f7f7c0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.492+0000 7f7f8095c640 1 --2- 172.21.15.38:0/3307307113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f7c15d9d0 0x7f7f7c0b48d0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009e50 tx=0x7f7f7402bf60 comp rx=0 tx=0).stop 2023-12-22T08:47:03.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.493+0000 7f7f8095c640 1 -- 172.21.15.38:0/3307307113 shutdown_connections 2023-12-22T08:47:03.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.493+0000 7f7f8095c640 1 --2- 172.21.15.38:0/3307307113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f7c15d9d0 0x7f7f7c0b48d0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.493+0000 7f7f8095c640 1 --2- 172.21.15.38:0/3307307113 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c06f4c0 0x7f7f7c06d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.493+0000 7f7f8095c640 1 -- 172.21.15.38:0/3307307113 >> 172.21.15.38:0/3307307113 conn(0x7f7f7c070360 msgr2=0x7f7f7c070740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:03.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.493+0000 7f7f8095c640 1 -- 172.21.15.38:0/3307307113 shutdown_connections 2023-12-22T08:47:03.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.493+0000 7f7f8095c640 1 -- 172.21.15.38:0/3307307113 wait complete. 2023-12-22T08:47:03.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.495+0000 7f7f8095c640 1 Processor -- start 2023-12-22T08:47:03.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.495+0000 7f7f8095c640 1 -- start start 2023-12-22T08:47:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.496+0000 7f7f8095c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f7c06f4c0 0x7f7f7c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.496+0000 7f7f8095c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f7c0cb150 0x7f7f7c1f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.496+0000 7f7f8095c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c15d9d0 0x7f7f7c0c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.496+0000 7f7f8095c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c0aee40 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.496+0000 7f7f8095c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c0ae810 con 0x7f7f7c0cb150 2023-12-22T08:47:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.496+0000 7f7f8095c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c1f6fe0 con 0x7f7f7c15d9d0 2023-12-22T08:47:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.496+0000 7f7f7a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f7c06f4c0 0x7f7f7c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.496+0000 7f7f7a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f7c06f4c0 0x7f7f7c1554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42340/0 (socket says 172.21.15.38:42340) 2023-12-22T08:47:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.496+0000 7f7f7a59c640 1 -- 172.21.15.38:0/3016423444 learned_addr learned my addr 172.21.15.38:0/3016423444 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.496+0000 7f7f79d9b640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f7c0cb150 0x7f7f7c1f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.496+0000 7f7f7ad9d640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c15d9d0 0x7f7f7c0c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.497+0000 7f7f7a59c640 1 -- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c15d9d0 msgr2=0x7f7f7c0c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.497+0000 7f7f7a59c640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c15d9d0 0x7f7f7c0c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.497+0000 7f7f7a59c640 1 -- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f7c0cb150 msgr2=0x7f7f7c1f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.497+0000 7f7f7a59c640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f7c0cb150 0x7f7f7c1f6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.497+0000 7f7f7a59c640 1 -- 172.21.15.38:0/3016423444 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f74009b30 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.497+0000 7f7f7a59c640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f7c06f4c0 0x7f7f7c1554d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00d800 tx=0x7f7f6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.497+0000 7f7f6affd640 1 -- 172.21.15.38:0/3016423444 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00b6c0 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.497+0000 7f7f6affd640 1 -- 172.21.15.38:0/3016423444 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c00b820 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.497+0000 7f7f6affd640 1 -- 172.21.15.38:0/3016423444 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00bbb0 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.497+0000 7f7f8095c640 1 -- 172.21.15.38:0/3016423444 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c1f72c0 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.498+0000 7f7f8095c640 1 -- 172.21.15.38:0/3016423444 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c155a10 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.499+0000 7f7f8095c640 1 -- 172.21.15.38:0/3016423444 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7c1f74b0 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.500+0000 7f7f6affd640 1 -- 172.21.15.38:0/3016423444 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f6c00bd10 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.501+0000 7f7f6affd640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f5c06a430 0x7f7f5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.501+0000 7f7f6affd640 1 -- 172.21.15.38:0/3016423444 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7f6c088ae0 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.501+0000 7f7f79d9b640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f5c06a430 0x7f7f5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.503+0000 7f7f79d9b640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f5c06a430 0x7f7f5c06c8f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0c2b40 tx=0x7f7f70009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:03.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.505+0000 7f7f6affd640 1 -- 172.21.15.38:0/3016423444 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7f6c054410 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.700+0000 7f7f8095c640 1 -- 172.21.15.38:0/3016423444 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f7c0cb9d0 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.701+0000 7f7f6affd640 1 -- 172.21.15.38:0/3016423444 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f6c057a30 con 0x7f7f7c06f4c0 2023-12-22T08:47:03.703 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:47:03.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.703+0000 7f7f8095c640 1 -- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f5c06a430 msgr2=0x7f7f5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.703+0000 7f7f8095c640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f5c06a430 0x7f7f5c06c8f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0c2b40 tx=0x7f7f70009040 comp rx=0 tx=0).stop 2023-12-22T08:47:03.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.704+0000 7f7f8095c640 1 -- 172.21.15.38:0/3016423444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f7c06f4c0 msgr2=0x7f7f7c1554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.704+0000 7f7f8095c640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f7c06f4c0 0x7f7f7c1554d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00d800 tx=0x7f7f6c00dcc0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.704+0000 7f7f8095c640 1 -- 172.21.15.38:0/3016423444 shutdown_connections 2023-12-22T08:47:03.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.704+0000 7f7f8095c640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f7c15d9d0 0x7f7f7c0c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.704+0000 7f7f8095c640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f7c0cb150 0x7f7f7c1f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.704+0000 7f7f8095c640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7f5c06a430 0x7f7f5c06c8f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.704+0000 7f7f8095c640 1 --2- 172.21.15.38:0/3016423444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f7c06f4c0 0x7f7f7c1554d0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.704+0000 7f7f8095c640 1 -- 172.21.15.38:0/3016423444 >> 172.21.15.38:0/3016423444 conn(0x7f7f7c070360 msgr2=0x7f7f7c0c3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:03.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.704+0000 7f7f8095c640 1 -- 172.21.15.38:0/3016423444 shutdown_connections 2023-12-22T08:47:03.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.704+0000 7f7f8095c640 1 -- 172.21.15.38:0/3016423444 wait complete. 2023-12-22T08:47:03.723 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T08:47:03.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.952+0000 7f39cf530640 1 Processor -- start 2023-12-22T08:47:03.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.952+0000 7f39cf530640 1 -- start start 2023-12-22T08:47:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.954+0000 7f39cf530640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f39c815b0e0 0x7f39c815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.954+0000 7f39cf530640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c8071460 0x7f39c8071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.954+0000 7f39cf530640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c815edf0 con 0x7f39c809c980 2023-12-22T08:47:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.954+0000 7f39cf530640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c815d0d0 con 0x7f39c815b0e0 2023-12-22T08:47:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.954+0000 7f39cf530640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c8071db0 con 0x7f39c8071460 2023-12-22T08:47:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.954+0000 7f39ce52e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f39c815b0e0 0x7f39c815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.954+0000 7f39ce52e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f39c815b0e0 0x7f39c815b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42350/0 (socket says 172.21.15.38:42350) 2023-12-22T08:47:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.954+0000 7f39ce52e640 1 -- 172.21.15.38:0/1628867264 learned_addr learned my addr 172.21.15.38:0/1628867264 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.954+0000 7f39cdd2d640 1 --1- 172.21.15.38:0/1628867264 >> v1:172.21.15.38:6789/0 conn(0x7f39c809c980 0x7f39c815c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34930/0 (socket says 172.21.15.38:34930) 2023-12-22T08:47:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.955+0000 7f39ced2f640 1 --2- 172.21.15.38:0/1628867264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c8071460 0x7f39c8071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.955+0000 7f39ce52e640 1 -- 172.21.15.38:0/1628867264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c8071460 msgr2=0x7f39c8071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.955+0000 7f39ce52e640 1 --2- 172.21.15.38:0/1628867264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c8071460 0x7f39c8071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.955+0000 7f39ce52e640 1 -- 172.21.15.38:0/1628867264 >> v1:172.21.15.38:6789/0 conn(0x7f39c809c980 legacy=0x7f39c815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.955+0000 7f39ce52e640 1 -- 172.21.15.38:0/1628867264 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c815bd90 con 0x7f39c815b0e0 2023-12-22T08:47:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.955+0000 7f39cd52c640 1 -- 172.21.15.38:0/1628867264 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479154379 0 0) 0x7f39c815edf0 con 0x7f39c809c980 2023-12-22T08:47:03.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.956+0000 7f39ce52e640 1 --2- 172.21.15.38:0/1628867264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39c815b0e0 0x7f39c815b4c0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009870 tx=0x7f39c402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458c38aadb8aba5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:03.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.956+0000 7f39cd52c640 1 -- 172.21.15.38:0/1628867264 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c40317c0 con 0x7f39c815b0e0 2023-12-22T08:47:03.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.956+0000 7f39cd52c640 1 -- 172.21.15.38:0/1628867264 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c4031920 con 0x7f39c815b0e0 2023-12-22T08:47:03.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.956+0000 7f39cd52c640 1 -- 172.21.15.38:0/1628867264 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c4031cb0 con 0x7f39c815b0e0 2023-12-22T08:47:03.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.957+0000 7f39cf530640 1 -- 172.21.15.38:0/1628867264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39c815b0e0 msgr2=0x7f39c815b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.957+0000 7f39cf530640 1 --2- 172.21.15.38:0/1628867264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39c815b0e0 0x7f39c815b4c0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009870 tx=0x7f39c402b860 comp rx=0 tx=0).stop 2023-12-22T08:47:03.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.957+0000 7f39cf530640 1 -- 172.21.15.38:0/1628867264 shutdown_connections 2023-12-22T08:47:03.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.957+0000 7f39cf530640 1 --2- 172.21.15.38:0/1628867264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c8071460 0x7f39c8071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.957+0000 7f39cf530640 1 --2- 172.21.15.38:0/1628867264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39c815b0e0 0x7f39c815b4c0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.957+0000 7f39cf530640 1 -- 172.21.15.38:0/1628867264 >> 172.21.15.38:0/1628867264 conn(0x7f39c80cf000 msgr2=0x7f39c80cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:03.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.957+0000 7f39cf530640 1 -- 172.21.15.38:0/1628867264 shutdown_connections 2023-12-22T08:47:03.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.957+0000 7f39cf530640 1 -- 172.21.15.38:0/1628867264 wait complete. 2023-12-22T08:47:03.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.959+0000 7f39cf530640 1 Processor -- start 2023-12-22T08:47:03.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.959+0000 7f39cf530640 1 -- start start 2023-12-22T08:47:03.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.960+0000 7f39cf530640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c8071460 0x7f39c814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.960+0000 7f39cf530640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39c809c980 0x7f39c815e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.960+0000 7f39cf530640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c815b0e0 0x7f39c81e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.960+0000 7f39cf530640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c814f9b0 con 0x7f39c809c980 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.960+0000 7f39cf530640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c81e6d10 con 0x7f39c8071460 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.960+0000 7f39cf530640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c81e6ff0 con 0x7f39c815b0e0 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.961+0000 7f39cdd2d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39c809c980 0x7f39c815e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.961+0000 7f39cdd2d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39c809c980 0x7f39c815e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42358/0 (socket says 172.21.15.38:42358) 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.961+0000 7f39cdd2d640 1 -- 172.21.15.38:0/2482051078 learned_addr learned my addr 172.21.15.38:0/2482051078 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.961+0000 7f39ced2f640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c815b0e0 0x7f39c81e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.961+0000 7f39ce52e640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c8071460 0x7f39c814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.961+0000 7f39cdd2d640 1 -- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c815b0e0 msgr2=0x7f39c81e5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.961+0000 7f39cdd2d640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c815b0e0 0x7f39c81e5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.961+0000 7f39cdd2d640 1 -- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c8071460 msgr2=0x7f39c814ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.961+0000 7f39cdd2d640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c8071460 0x7f39c814ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.961+0000 7f39cdd2d640 1 -- 172.21.15.38:0/2482051078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c40094d0 con 0x7f39c809c980 2023-12-22T08:47:03.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.961+0000 7f39cdd2d640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39c809c980 0x7f39c815e350 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c4d0 tx=0x7f39b800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:03.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.962+0000 7f39beffd640 1 -- 172.21.15.38:0/2482051078 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b80074e0 con 0x7f39c809c980 2023-12-22T08:47:03.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.962+0000 7f39beffd640 1 -- 172.21.15.38:0/2482051078 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b8007660 con 0x7f39c809c980 2023-12-22T08:47:03.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.962+0000 7f39beffd640 1 -- 172.21.15.38:0/2482051078 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8004a20 con 0x7f39c809c980 2023-12-22T08:47:03.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.962+0000 7f39cf530640 1 -- 172.21.15.38:0/2482051078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c81e72d0 con 0x7f39c809c980 2023-12-22T08:47:03.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.962+0000 7f39cf530640 1 -- 172.21.15.38:0/2482051078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c80a1ac0 con 0x7f39c809c980 2023-12-22T08:47:03.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.963+0000 7f39cf530640 1 -- 172.21.15.38:0/2482051078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c8061910 con 0x7f39c809c980 2023-12-22T08:47:03.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.964+0000 7f39beffd640 1 -- 172.21.15.38:0/2482051078 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f39b8004b80 con 0x7f39c809c980 2023-12-22T08:47:03.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.965+0000 7f39beffd640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f39ac06a430 0x7f39ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:03.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.966+0000 7f39beffd640 1 -- 172.21.15.38:0/2482051078 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f39b8087840 con 0x7f39c809c980 2023-12-22T08:47:03.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.966+0000 7f39ce52e640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f39ac06a430 0x7f39ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:03.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.967+0000 7f39ce52e640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f39ac06a430 0x7f39ac06c8f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f39c4036000 tx=0x7f39c4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:03.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:03.970+0000 7f39beffd640 1 -- 172.21.15.38:0/2482051078 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f39b80530e0 con 0x7f39c809c980 2023-12-22T08:47:04.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.167+0000 7f39cf530640 1 -- 172.21.15.38:0/2482051078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f39c806d7d0 con 0x7f39c809c980 2023-12-22T08:47:04.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.168+0000 7f39beffd640 1 -- 172.21.15.38:0/2482051078 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v123) v1 ==== 84+0+65 (secure 0 0 0) 0x7f39b8018090 con 0x7f39c809c980 2023-12-22T08:47:04.170 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:04.170 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-12-22T08:47:04.170 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:04.170 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-12-22T08:47:04.170 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-12-22T08:47:04.170 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:04.170 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-12-22T08:47:04.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.171+0000 7f39cf530640 1 -- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f39ac06a430 msgr2=0x7f39ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:04.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.171+0000 7f39cf530640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f39ac06a430 0x7f39ac06c8f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f39c4036000 tx=0x7f39c4008030 comp rx=0 tx=0).stop 2023-12-22T08:47:04.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.171+0000 7f39cf530640 1 -- 172.21.15.38:0/2482051078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39c809c980 msgr2=0x7f39c815e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:04.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.171+0000 7f39cf530640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39c809c980 0x7f39c815e350 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c4d0 tx=0x7f39b800c990 comp rx=0 tx=0).stop 2023-12-22T08:47:04.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.171+0000 7f39cf530640 1 -- 172.21.15.38:0/2482051078 shutdown_connections 2023-12-22T08:47:04.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.171+0000 7f39cf530640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39c815b0e0 0x7f39c81e5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:04.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.171+0000 7f39cf530640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f39ac06a430 0x7f39ac06c8f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:04.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.171+0000 7f39cf530640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39c809c980 0x7f39c815e350 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:04.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.171+0000 7f39cf530640 1 --2- 172.21.15.38:0/2482051078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39c8071460 0x7f39c814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:04.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.171+0000 7f39cf530640 1 -- 172.21.15.38:0/2482051078 >> 172.21.15.38:0/2482051078 conn(0x7f39c80cf000 msgr2=0x7f39c815a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:04.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.171+0000 7f39cf530640 1 -- 172.21.15.38:0/2482051078 shutdown_connections 2023-12-22T08:47:04.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.171+0000 7f39cf530640 1 -- 172.21.15.38:0/2482051078 wait complete. 2023-12-22T08:47:04.191 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T08:47:04.192 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T08:47:04.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.415+0000 7fcfc86ec640 1 Processor -- start 2023-12-22T08:47:04.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.415+0000 7fcfc86ec640 1 -- start start 2023-12-22T08:47:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.417+0000 7fcfc86ec640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcfc015b2c0 0x7fcfc00b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.417+0000 7fcfc86ec640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcfc00b43a0 0x7fcfc00b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.417+0000 7fcfc86ec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc00b5480 con 0x7fcfc015aee0 2023-12-22T08:47:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.417+0000 7fcfc86ec640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc00b3a40 con 0x7fcfc00b43a0 2023-12-22T08:47:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.417+0000 7fcfc86ec640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc00b36a0 con 0x7fcfc015b2c0 2023-12-22T08:47:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.417+0000 7fcfc6c89640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcfc00b43a0 0x7fcfc00b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.418+0000 7fcfc6c89640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcfc00b43a0 0x7fcfc00b8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42364/0 (socket says 172.21.15.38:42364) 2023-12-22T08:47:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.418+0000 7fcfc6c89640 1 -- 172.21.15.38:0/2338915447 learned_addr learned my addr 172.21.15.38:0/2338915447 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.418+0000 7fcfc6c89640 1 -- 172.21.15.38:0/2338915447 >> v2:172.21.15.89:3300/0 conn(0x7fcfc015b2c0 msgr2=0x7fcfc00b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.418+0000 7fcfc6c89640 1 --2- 172.21.15.38:0/2338915447 >> v2:172.21.15.89:3300/0 conn(0x7fcfc015b2c0 0x7fcfc00b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.418+0000 7fcfc6c89640 1 -- 172.21.15.38:0/2338915447 >> v1:172.21.15.89:6789/0 conn(0x7fcfc015aee0 legacy=0x7fcfc00b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.418+0000 7fcfc6c89640 1 -- 172.21.15.38:0/2338915447 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc00b56e0 con 0x7fcfc00b43a0 2023-12-22T08:47:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.419+0000 7fcfc6c89640 1 --2- 172.21.15.38:0/2338915447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc00b43a0 0x7fcfc00b8a00 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00b6d90 tx=0x7fcfb802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27bd05d336d3a46 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:04.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.419+0000 7fcfc5486640 1 -- 172.21.15.38:0/2338915447 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb802c9c0 con 0x7fcfc00b43a0 2023-12-22T08:47:04.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.420+0000 7fcfc5486640 1 -- 172.21.15.38:0/2338915447 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb802cb20 con 0x7fcfc00b43a0 2023-12-22T08:47:04.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.420+0000 7fcfc5486640 1 -- 172.21.15.38:0/2338915447 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80343f0 con 0x7fcfc00b43a0 2023-12-22T08:47:04.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.420+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2338915447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc00b43a0 msgr2=0x7fcfc00b8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:04.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.420+0000 7fcfc86ec640 1 --2- 172.21.15.38:0/2338915447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc00b43a0 0x7fcfc00b8a00 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00b6d90 tx=0x7fcfb802be20 comp rx=0 tx=0).stop 2023-12-22T08:47:04.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.420+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2338915447 shutdown_connections 2023-12-22T08:47:04.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.420+0000 7fcfc86ec640 1 --2- 172.21.15.38:0/2338915447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc00b43a0 0x7fcfc00b8a00 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:04.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.420+0000 7fcfc86ec640 1 --2- 172.21.15.38:0/2338915447 >> v2:172.21.15.89:3300/0 conn(0x7fcfc015b2c0 0x7fcfc00b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:04.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.420+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2338915447 >> 172.21.15.38:0/2338915447 conn(0x7fcfc0070770 msgr2=0x7fcfc0070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:04.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.420+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2338915447 shutdown_connections 2023-12-22T08:47:04.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.420+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2338915447 wait complete. 2023-12-22T08:47:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.422+0000 7fcfc86ec640 1 Processor -- start 2023-12-22T08:47:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.422+0000 7fcfc86ec640 1 -- start start 2023-12-22T08:47:04.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.423+0000 7fcfc86ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015aee0 0x7fcfc01523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:04.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.423+0000 7fcfc86ec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0144d80 0x7fcfc015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:04.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.423+0000 7fcfc86ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfc006d240 0x7fcfc006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:04.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.423+0000 7fcfc86ec640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc006dc00 con 0x7fcfc0144d80 2023-12-22T08:47:04.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.423+0000 7fcfc86ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0153c80 con 0x7fcfc006d240 2023-12-22T08:47:04.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.423+0000 7fcfc86ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0145200 con 0x7fcfc015aee0 2023-12-22T08:47:04.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.424+0000 7fcfc5c87640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0144d80 0x7fcfc015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:04.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.424+0000 7fcfc5c87640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0144d80 0x7fcfc015eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42374/0 (socket says 172.21.15.38:42374) 2023-12-22T08:47:04.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.424+0000 7fcfc5c87640 1 -- 172.21.15.38:0/2960089925 learned_addr learned my addr 172.21.15.38:0/2960089925 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.424+0000 7fcfc6c89640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfc006d240 0x7fcfc006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.424+0000 7fcfc6488640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015aee0 0x7fcfc01523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.424+0000 7fcfc5c87640 1 -- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015aee0 msgr2=0x7fcfc01523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.424+0000 7fcfc5c87640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015aee0 0x7fcfc01523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.424+0000 7fcfc5c87640 1 -- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfc006d240 msgr2=0x7fcfc006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.424+0000 7fcfc5c87640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfc006d240 0x7fcfc006d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.424+0000 7fcfc5c87640 1 -- 172.21.15.38:0/2960089925 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb8009b30 con 0x7fcfc0144d80 2023-12-22T08:47:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.425+0000 7fcfc5c87640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0144d80 0x7fcfc015eba0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000b410 tx=0x7fcfb000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.425+0000 7fcfb6ffd640 1 -- 172.21.15.38:0/2960089925 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0011830 con 0x7fcfc0144d80 2023-12-22T08:47:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.425+0000 7fcfb6ffd640 1 -- 172.21.15.38:0/2960089925 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb00119b0 con 0x7fcfc0144d80 2023-12-22T08:47:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.425+0000 7fcfb6ffd640 1 -- 172.21.15.38:0/2960089925 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0011d60 con 0x7fcfc0144d80 2023-12-22T08:47:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.425+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2960089925 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc015f3f0 con 0x7fcfc0144d80 2023-12-22T08:47:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.425+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2960089925 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc015f9b0 con 0x7fcfc0144d80 2023-12-22T08:47:04.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.426+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2960089925 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc0061910 con 0x7fcfc0144d80 2023-12-22T08:47:04.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.427+0000 7fcfb6ffd640 1 -- 172.21.15.38:0/2960089925 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcfb001a400 con 0x7fcfc0144d80 2023-12-22T08:47:04.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.428+0000 7fcfb6ffd640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfa406a460 0x7fcfa406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:04.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.428+0000 7fcfb6ffd640 1 -- 172.21.15.38:0/2960089925 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcfb0088710 con 0x7fcfc0144d80 2023-12-22T08:47:04.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.429+0000 7fcfc6488640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfa406a460 0x7fcfa406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:04.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.430+0000 7fcfc6488640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfa406a460 0x7fcfa406c920 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc004ea0 tx=0x7fcfbc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:04.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.432+0000 7fcfb6ffd640 1 -- 172.21.15.38:0/2960089925 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcfb0054040 con 0x7fcfc0144d80 2023-12-22T08:47:04.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:04.628+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2960089925 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcfc015cc60 con 0x7fcfc0144d80 2023-12-22T08:47:05.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.522+0000 7fcfb6ffd640 1 -- 172.21.15.38:0/2960089925 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v124) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcfb00150b0 con 0x7fcfc0144d80 2023-12-22T08:47:05.524 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-12-22T08:47:05.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.527+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfa406a460 msgr2=0x7fcfa406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:05.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.527+0000 7fcfc86ec640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfa406a460 0x7fcfa406c920 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc004ea0 tx=0x7fcfbc009040 comp rx=0 tx=0).stop 2023-12-22T08:47:05.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.527+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2960089925 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0144d80 msgr2=0x7fcfc015eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:05.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.527+0000 7fcfc86ec640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0144d80 0x7fcfc015eba0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000b410 tx=0x7fcfb000b8d0 comp rx=0 tx=0).stop 2023-12-22T08:47:05.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.527+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2960089925 shutdown_connections 2023-12-22T08:47:05.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.528+0000 7fcfc86ec640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfc006d240 0x7fcfc006d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:05.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.528+0000 7fcfc86ec640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfa406a460 0x7fcfa406c920 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:05.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.528+0000 7fcfc86ec640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0144d80 0x7fcfc015eba0 secure :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000b410 tx=0x7fcfb000b8d0 comp rx=0 tx=0).stop 2023-12-22T08:47:05.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.528+0000 7fcfc86ec640 1 --2- 172.21.15.38:0/2960089925 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015aee0 0x7fcfc01523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:05.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.528+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2960089925 >> 172.21.15.38:0/2960089925 conn(0x7fcfc0070770 msgr2=0x7fcfc015a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:05.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.528+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2960089925 shutdown_connections 2023-12-22T08:47:05.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.528+0000 7fcfc86ec640 1 -- 172.21.15.38:0/2960089925 wait complete. 2023-12-22T08:47:05.551 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T08:47:05.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.784+0000 7f5207511640 1 Processor -- start 2023-12-22T08:47:05.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.784+0000 7f5207511640 1 -- start start 2023-12-22T08:47:05.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.786+0000 7f5207511640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5200070b00 0x7f5200164620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:05.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.786+0000 7f5207511640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520006c900 con 0x7f5200159780 2023-12-22T08:47:05.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.786+0000 7f5207511640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5200071790 con 0x7f5200159b60 2023-12-22T08:47:05.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.786+0000 7f5207511640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52000ceca0 con 0x7f5200070b00 2023-12-22T08:47:05.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.786+0000 7f520650f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5200159780 0x7f52000ce590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34934/0 (socket says 172.21.15.38:34934) 2023-12-22T08:47:05.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.786+0000 7f520650f640 1 -- 172.21.15.38:0/3549959388 learned_addr learned my addr 172.21.15.38:0/3549959388 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:05.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.787+0000 7f5206d10640 1 --2- 172.21.15.38:0/3549959388 >> v2:172.21.15.89:3300/0 conn(0x7f5200070b00 0x7f5200164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:05.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.787+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450978303 0 0) 0x7f520006c900 con 0x7f5200159780 2023-12-22T08:47:05.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.787+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51ec003520 con 0x7f5200159780 2023-12-22T08:47:05.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.787+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1449245337 0 0) 0x7f51ec003520 con 0x7f5200159780 2023-12-22T08:47:05.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 >> v2:172.21.15.89:3300/0 conn(0x7f5200070b00 msgr2=0x7f5200164620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:05.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f520550d640 1 --2- 172.21.15.38:0/3549959388 >> v2:172.21.15.89:3300/0 conn(0x7f5200070b00 0x7f5200164620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:05.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 >> v1:172.21.15.89:6789/0 conn(0x7f5200159b60 legacy=0x7f52000703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:05.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5200071a70 con 0x7f5200159780 2023-12-22T08:47:05.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f51fc001670 con 0x7f5200159780 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 >> v1:172.21.15.38:6789/0 conn(0x7f5200159780 legacy=0x7f52000ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f520550d640 1 --2- 172.21.15.38:0/3549959388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51ec003970 0x7f51ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f520550d640 1 --2- 172.21.15.38:0/3549959388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ec0047c0 0x7f51ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f520550d640 1 --2- 172.21.15.38:0/3549959388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51ec005180 0x7f51ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52000ceca0 con 0x7f51ec003970 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec00c020 con 0x7f51ec005180 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec00c1e0 con 0x7f51ec0047c0 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f520650f640 1 --2- 172.21.15.38:0/3549959388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51ec003970 0x7f51ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.788+0000 7f5205d0e640 1 --2- 172.21.15.38:0/3549959388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ec0047c0 0x7f51ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.789+0000 7f520650f640 1 -- 172.21.15.38:0/3549959388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ec0047c0 msgr2=0x7f51ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.789+0000 7f520650f640 1 --2- 172.21.15.38:0/3549959388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ec0047c0 0x7f51ec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.789+0000 7f520650f640 1 -- 172.21.15.38:0/3549959388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51ec005180 msgr2=0x7f51ec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.789+0000 7f5206d10640 1 --2- 172.21.15.38:0/3549959388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51ec005180 0x7f51ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.789+0000 7f520650f640 1 --2- 172.21.15.38:0/3549959388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51ec005180 0x7f51ec00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:05.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.789+0000 7f520650f640 1 -- 172.21.15.38:0/3549959388 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec003520 con 0x7f51ec003970 2023-12-22T08:47:05.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.789+0000 7f5206d10640 1 --2- 172.21.15.38:0/3549959388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51ec005180 0x7f51ec00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:05.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.789+0000 7f5206d10640 1 -- 172.21.15.38:0/3549959388 reap_dead start 2023-12-22T08:47:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.790+0000 7f520650f640 1 --2- 172.21.15.38:0/3549959388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51ec003970 0x7f51ec003d90 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c240 tx=0x7f51ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66ae950504e1904 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.790+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc005ad0 con 0x7f51ec003970 2023-12-22T08:47:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.790+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc005c30 con 0x7f51ec003970 2023-12-22T08:47:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.790+0000 7f520550d640 1 -- 172.21.15.38:0/3549959388 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc02ca90 con 0x7f51ec003970 2023-12-22T08:47:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.791+0000 7f5207511640 1 -- 172.21.15.38:0/3549959388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51ec003970 msgr2=0x7f51ec003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.791+0000 7f5207511640 1 --2- 172.21.15.38:0/3549959388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51ec003970 0x7f51ec003d90 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c240 tx=0x7f51ec0057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.791+0000 7f5207511640 1 -- 172.21.15.38:0/3549959388 shutdown_connections 2023-12-22T08:47:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.791+0000 7f5207511640 1 --2- 172.21.15.38:0/3549959388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51ec003970 0x7f51ec003d90 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.791+0000 7f5207511640 1 -- 172.21.15.38:0/3549959388 >> 172.21.15.38:0/3549959388 conn(0x7f52000cf000 msgr2=0x7f52000cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.791+0000 7f5207511640 1 -- 172.21.15.38:0/3549959388 shutdown_connections 2023-12-22T08:47:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.791+0000 7f5207511640 1 -- 172.21.15.38:0/3549959388 wait complete. 2023-12-22T08:47:05.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.793+0000 7f5207511640 1 Processor -- start 2023-12-22T08:47:05.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.793+0000 7f5207511640 1 -- start start 2023-12-22T08:47:05.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.794+0000 7f5207511640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ec003970 0x7f52001f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:05.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.794+0000 7f5207511640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52001f3520 0x7f52001e2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:05.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.794+0000 7f5207511640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52001f3000 0x7f520006cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.794+0000 7f5207511640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52001e3470 con 0x7f52001f3000 2023-12-22T08:47:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.794+0000 7f5207511640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5200156d80 con 0x7f52001f3520 2023-12-22T08:47:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.794+0000 7f5207511640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5200157060 con 0x7f51ec003970 2023-12-22T08:47:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.794+0000 7f5206d10640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52001f3000 0x7f520006cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.794+0000 7f5206d10640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52001f3000 0x7f520006cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42386/0 (socket says 172.21.15.38:42386) 2023-12-22T08:47:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.794+0000 7f5206d10640 1 -- 172.21.15.38:0/701899497 learned_addr learned my addr 172.21.15.38:0/701899497 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.794+0000 7f520650f640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ec003970 0x7f52001f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.794+0000 7f5205d0e640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52001f3520 0x7f52001e2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.795+0000 7f5206d10640 1 -- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ec003970 msgr2=0x7f52001f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.795+0000 7f5206d10640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ec003970 0x7f52001f5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.795+0000 7f5206d10640 1 -- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52001f3520 msgr2=0x7f52001e2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.795+0000 7f5206d10640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52001f3520 0x7f52001e2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.795+0000 7f5206d10640 1 -- 172.21.15.38:0/701899497 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5200157340 con 0x7f52001f3000 2023-12-22T08:47:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.795+0000 7f520650f640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ec003970 0x7f52001f5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:47:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.795+0000 7f5206d10640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52001f3000 0x7f520006cbe0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f520006be30 tx=0x7f51f800f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.795+0000 7f51f6ffd640 1 -- 172.21.15.38:0/701899497 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f800fd70 con 0x7f52001f3000 2023-12-22T08:47:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.795+0000 7f51f6ffd640 1 -- 172.21.15.38:0/701899497 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f8010040 con 0x7f52001f3000 2023-12-22T08:47:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.796+0000 7f5207511640 1 -- 172.21.15.38:0/701899497 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52001e30b0 con 0x7f52001f3000 2023-12-22T08:47:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.796+0000 7f51f6ffd640 1 -- 172.21.15.38:0/701899497 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80156a0 con 0x7f52001f3000 2023-12-22T08:47:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.796+0000 7f5207511640 1 -- 172.21.15.38:0/701899497 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520006d300 con 0x7f52001f3000 2023-12-22T08:47:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.797+0000 7f5207511640 1 -- 172.21.15.38:0/701899497 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5200061910 con 0x7f52001f3000 2023-12-22T08:47:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.798+0000 7f51f6ffd640 1 -- 172.21.15.38:0/701899497 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f51f8015800 con 0x7f52001f3000 2023-12-22T08:47:05.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.799+0000 7f51f6ffd640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f51e406a460 0x7f51e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:05.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.799+0000 7f51f6ffd640 1 -- 172.21.15.38:0/701899497 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f51f8088ea0 con 0x7f52001f3000 2023-12-22T08:47:05.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.800+0000 7f520650f640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f51e406a460 0x7f51e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:05.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.801+0000 7f520650f640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f51e406a460 0x7f51e406c920 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f51fc034000 tx=0x7f51fc009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:05.804+0000 7f51f6ffd640 1 -- 172.21.15.38:0/701899497 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f51f80545d0 con 0x7f52001f3000 2023-12-22T08:47:06.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.006+0000 7f5207511640 1 -- 172.21.15.38:0/701899497 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f520006c290 con 0x7f52001f3000 2023-12-22T08:47:06.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.539+0000 7f51f6ffd640 1 -- 172.21.15.38:0/701899497 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v125) v1 ==== 170+0+0 (secure 0 0 0) 0x7f51f800a2e0 con 0x7f52001f3000 2023-12-22T08:47:06.541 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-12-22T08:47:06.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.545+0000 7f5207511640 1 -- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f51e406a460 msgr2=0x7f51e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:06.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.545+0000 7f5207511640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f51e406a460 0x7f51e406c920 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f51fc034000 tx=0x7f51fc009030 comp rx=0 tx=0).stop 2023-12-22T08:47:06.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.545+0000 7f5207511640 1 -- 172.21.15.38:0/701899497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52001f3000 msgr2=0x7f520006cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:06.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.545+0000 7f5207511640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52001f3000 0x7f520006cbe0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f520006be30 tx=0x7f51f800f510 comp rx=0 tx=0).stop 2023-12-22T08:47:06.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.545+0000 7f5207511640 1 -- 172.21.15.38:0/701899497 shutdown_connections 2023-12-22T08:47:06.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.545+0000 7f5207511640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f51e406a460 0x7f51e406c920 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:06.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.545+0000 7f5207511640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52001f3000 0x7f520006cbe0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:06.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.545+0000 7f5207511640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52001f3520 0x7f52001e2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:06.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.545+0000 7f5207511640 1 --2- 172.21.15.38:0/701899497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ec003970 0x7f52001f5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:06.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.545+0000 7f5207511640 1 -- 172.21.15.38:0/701899497 >> 172.21.15.38:0/701899497 conn(0x7f52000cf000 msgr2=0x7f52000ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:06.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.546+0000 7f5207511640 1 -- 172.21.15.38:0/701899497 shutdown_connections 2023-12-22T08:47:06.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.547+0000 7f5207511640 1 -- 172.21.15.38:0/701899497 wait complete. 2023-12-22T08:47:06.574 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T08:47:06.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.780+0000 7f8d7359e640 1 Processor -- start 2023-12-22T08:47:06.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.780+0000 7f8d7359e640 1 -- start start 2023-12-22T08:47:06.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.782+0000 7f8d7359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8d74163d50 0x7f8d74166140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:06.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.782+0000 7f8d7359e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7406d5f0 con 0x7f8d74070b70 2023-12-22T08:47:06.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.782+0000 7f8d7359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d74144fa0 con 0x7f8d74070f50 2023-12-22T08:47:06.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.782+0000 7f8d7359e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7406da80 con 0x7f8d74163d50 2023-12-22T08:47:06.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.782+0000 7f8d7259c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8d74070b70 0x7f8d7406bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34948/0 (socket says 172.21.15.38:34948) 2023-12-22T08:47:06.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.782+0000 7f8d7259c640 1 -- 172.21.15.38:0/3427785696 learned_addr learned my addr 172.21.15.38:0/3427785696 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:06.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.783+0000 7f8d72d9d640 1 --2- 172.21.15.38:0/3427785696 >> v2:172.21.15.89:3300/0 conn(0x7f8d74163d50 0x7f8d74166140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:06.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.783+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406295263 0 0) 0x7f8d7406d5f0 con 0x7f8d74070b70 2023-12-22T08:47:06.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.783+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d60003520 con 0x7f8d74070b70 2023-12-22T08:47:06.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208627364 0 0) 0x7f8d74144fa0 con 0x7f8d74070f50 2023-12-22T08:47:06.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d7406d5f0 con 0x7f8d74070f50 2023-12-22T08:47:06.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2166403874 0 0) 0x7f8d60003520 con 0x7f8d74070b70 2023-12-22T08:47:06.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 >> v2:172.21.15.89:3300/0 conn(0x7f8d74163d50 msgr2=0x7f8d74166140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:06.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 --2- 172.21.15.38:0/3427785696 >> v2:172.21.15.89:3300/0 conn(0x7f8d74163d50 0x7f8d74166140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:06.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 >> v1:172.21.15.89:6789/0 conn(0x7f8d74070f50 legacy=0x7f8d740713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:06.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7406c9e0 con 0x7f8d74070b70 2023-12-22T08:47:06.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f8d64001670 con 0x7f8d74070b70 2023-12-22T08:47:06.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 >> v1:172.21.15.38:6789/0 conn(0x7f8d74070b70 legacy=0x7f8d7406bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:06.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 --2- 172.21.15.38:0/3427785696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d60003b50 0x7f8d60003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:06.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 --2- 172.21.15.38:0/3427785696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d600047c0 0x7f8d60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:06.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 --2- 172.21.15.38:0/3427785696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60005180 0x7f8d6000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:06.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7406da80 con 0x7f8d600047c0 2023-12-22T08:47:06.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6000c050 con 0x7f8d60005180 2023-12-22T08:47:06.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6000c210 con 0x7f8d60003b50 2023-12-22T08:47:06.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d71d9b640 1 --2- 172.21.15.38:0/3427785696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d600047c0 0x7f8d60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:06.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.784+0000 7f8d72d9d640 1 --2- 172.21.15.38:0/3427785696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60005180 0x7f8d6000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:06.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.785+0000 7f8d7259c640 1 --2- 172.21.15.38:0/3427785696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d60003b50 0x7f8d60003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:06.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.785+0000 7f8d71d9b640 1 -- 172.21.15.38:0/3427785696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d60003b50 msgr2=0x7f8d60003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:06.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.785+0000 7f8d71d9b640 1 --2- 172.21.15.38:0/3427785696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d60003b50 0x7f8d60003f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:06.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.785+0000 7f8d71d9b640 1 -- 172.21.15.38:0/3427785696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60005180 msgr2=0x7f8d6000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:06.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.785+0000 7f8d71d9b640 1 --2- 172.21.15.38:0/3427785696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60005180 0x7f8d6000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:06.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.785+0000 7f8d71d9b640 1 -- 172.21.15.38:0/3427785696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d60003520 con 0x7f8d600047c0 2023-12-22T08:47:06.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.785+0000 7f8d72d9d640 1 --2- 172.21.15.38:0/3427785696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d60005180 0x7f8d6000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:06.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.785+0000 7f8d72d9d640 1 -- 172.21.15.38:0/3427785696 reap_dead start 2023-12-22T08:47:06.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.786+0000 7f8d71d9b640 1 --2- 172.21.15.38:0/3427785696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d600047c0 0x7f8d60004c40 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0018d0 tx=0x7f8d600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561c09ba3d169e56 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:06.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.786+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c0050d0 con 0x7f8d600047c0 2023-12-22T08:47:06.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.786+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c005230 con 0x7f8d600047c0 2023-12-22T08:47:06.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.786+0000 7f8d7159a640 1 -- 172.21.15.38:0/3427785696 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c0035f0 con 0x7f8d600047c0 2023-12-22T08:47:06.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.787+0000 7f8d7359e640 1 -- 172.21.15.38:0/3427785696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d600047c0 msgr2=0x7f8d60004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:06.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.787+0000 7f8d7359e640 1 --2- 172.21.15.38:0/3427785696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d600047c0 0x7f8d60004c40 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0018d0 tx=0x7f8d600057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:06.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.787+0000 7f8d7359e640 1 -- 172.21.15.38:0/3427785696 shutdown_connections 2023-12-22T08:47:06.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.787+0000 7f8d7359e640 1 --2- 172.21.15.38:0/3427785696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d600047c0 0x7f8d60004c40 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:06.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.787+0000 7f8d7359e640 1 -- 172.21.15.38:0/3427785696 >> 172.21.15.38:0/3427785696 conn(0x7f8d740b0b60 msgr2=0x7f8d740b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:06.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.787+0000 7f8d7359e640 1 -- 172.21.15.38:0/3427785696 shutdown_connections 2023-12-22T08:47:06.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.787+0000 7f8d7359e640 1 -- 172.21.15.38:0/3427785696 wait complete. 2023-12-22T08:47:06.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.789+0000 7f8d7359e640 1 Processor -- start 2023-12-22T08:47:06.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.789+0000 7f8d7359e640 1 -- start start 2023-12-22T08:47:06.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.790+0000 7f8d7359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d600047c0 0x7f8d7415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:06.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.790+0000 7f8d7359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7413f940 0x7f8d7415bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.790+0000 7f8d7359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d741f5e50 0x7f8d740abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.790+0000 7f8d7359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7415c4d0 con 0x7f8d7413f940 2023-12-22T08:47:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.790+0000 7f8d7359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d74099e80 con 0x7f8d741f5e50 2023-12-22T08:47:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.790+0000 7f8d7359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d741f66a0 con 0x7f8d600047c0 2023-12-22T08:47:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.791+0000 7f8d71d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7413f940 0x7f8d7415bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.791+0000 7f8d71d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7413f940 0x7f8d7415bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42396/0 (socket says 172.21.15.38:42396) 2023-12-22T08:47:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.791+0000 7f8d71d9b640 1 -- 172.21.15.38:0/215968138 learned_addr learned my addr 172.21.15.38:0/215968138 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.791+0000 7f8d7259c640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d600047c0 0x7f8d7415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.791+0000 7f8d72d9d640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d741f5e50 0x7f8d740abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.791+0000 7f8d71d9b640 1 -- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d600047c0 msgr2=0x7f8d7415ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.791+0000 7f8d71d9b640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d600047c0 0x7f8d7415ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.791+0000 7f8d71d9b640 1 -- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d741f5e50 msgr2=0x7f8d740abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:06.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.791+0000 7f8d71d9b640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d741f5e50 0x7f8d740abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:06.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.791+0000 7f8d71d9b640 1 -- 172.21.15.38:0/215968138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d741f6980 con 0x7f8d7413f940 2023-12-22T08:47:06.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.791+0000 7f8d72d9d640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d741f5e50 0x7f8d740abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:47:06.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.792+0000 7f8d71d9b640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7413f940 0x7f8d7415bf90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c035040 tx=0x7f8d5c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:06.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.792+0000 7f8d6affd640 1 -- 172.21.15.38:0/215968138 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c007250 con 0x7f8d7413f940 2023-12-22T08:47:06.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.792+0000 7f8d6affd640 1 -- 172.21.15.38:0/215968138 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c0073b0 con 0x7f8d7413f940 2023-12-22T08:47:06.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.792+0000 7f8d6affd640 1 -- 172.21.15.38:0/215968138 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c0035f0 con 0x7f8d7413f940 2023-12-22T08:47:06.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.792+0000 7f8d7359e640 1 -- 172.21.15.38:0/215968138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d741f6c60 con 0x7f8d7413f940 2023-12-22T08:47:06.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.792+0000 7f8d7359e640 1 -- 172.21.15.38:0/215968138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d741f62d0 con 0x7f8d7413f940 2023-12-22T08:47:06.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.793+0000 7f8d7359e640 1 -- 172.21.15.38:0/215968138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d741f6460 con 0x7f8d7413f940 2023-12-22T08:47:06.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.794+0000 7f8d6affd640 1 -- 172.21.15.38:0/215968138 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8d5c003750 con 0x7f8d7413f940 2023-12-22T08:47:06.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.795+0000 7f8d6affd640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8d5406a460 0x7f8d5406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:06.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.795+0000 7f8d6affd640 1 -- 172.21.15.38:0/215968138 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8d5c0aa740 con 0x7f8d7413f940 2023-12-22T08:47:06.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.796+0000 7f8d7259c640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8d5406a460 0x7f8d5406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:06.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.797+0000 7f8d7259c640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8d5406a460 0x7f8d5406c920 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8d64000c00 tx=0x7f8d64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:06.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:06.800+0000 7f8d6affd640 1 -- 172.21.15.38:0/215968138 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8d741f6460 con 0x7f8d7413f940 2023-12-22T08:47:07.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.032+0000 7f8d7359e640 1 -- 172.21.15.38:0/215968138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8d7415c4d0 con 0x7f8d7413f940 2023-12-22T08:47:07.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.046+0000 7f8d6affd640 1 -- 172.21.15.38:0/215968138 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v51) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8d5c075ea0 con 0x7f8d7413f940 2023-12-22T08:47:07.048 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 14 and data pool 15 2023-12-22T08:47:07.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.051+0000 7f8d7359e640 1 -- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8d5406a460 msgr2=0x7f8d5406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.051+0000 7f8d7359e640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8d5406a460 0x7f8d5406c920 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8d64000c00 tx=0x7f8d64009040 comp rx=0 tx=0).stop 2023-12-22T08:47:07.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.051+0000 7f8d7359e640 1 -- 172.21.15.38:0/215968138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7413f940 msgr2=0x7f8d7415bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.051+0000 7f8d7359e640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7413f940 0x7f8d7415bf90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c035040 tx=0x7f8d5c0012d0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.052+0000 7f8d7359e640 1 -- 172.21.15.38:0/215968138 shutdown_connections 2023-12-22T08:47:07.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.052+0000 7f8d7359e640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d741f5e50 0x7f8d740abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.052+0000 7f8d7359e640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8d5406a460 0x7f8d5406c920 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.052+0000 7f8d7359e640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d7413f940 0x7f8d7415bf90 secure :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c035040 tx=0x7f8d5c0012d0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.052+0000 7f8d7359e640 1 --2- 172.21.15.38:0/215968138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d600047c0 0x7f8d7415ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.052+0000 7f8d7359e640 1 -- 172.21.15.38:0/215968138 >> 172.21.15.38:0/215968138 conn(0x7f8d740b0b60 msgr2=0x7f8d7413db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:07.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.054+0000 7f8d7359e640 1 -- 172.21.15.38:0/215968138 shutdown_connections 2023-12-22T08:47:07.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.054+0000 7f8d7359e640 1 -- 172.21.15.38:0/215968138 wait complete. 2023-12-22T08:47:07.080 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:07.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.263+0000 7fbf011a2640 1 Processor -- start 2023-12-22T08:47:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.263+0000 7fbf011a2640 1 -- start start 2023-12-22T08:47:07.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.265+0000 7fbf011a2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbefc0a44a0 0x7fbefc0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.265+0000 7fbf011a2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbefc070e30 0x7fbefc15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.265+0000 7fbf011a2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc0cdae0 con 0x7fbefc15b420 2023-12-22T08:47:07.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.265+0000 7fbf011a2640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc071250 con 0x7fbefc0a44a0 2023-12-22T08:47:07.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.265+0000 7fbf011a2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc15b800 con 0x7fbefc070e30 2023-12-22T08:47:07.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.265+0000 7fbef37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbefc0a44a0 0x7fbefc0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.265+0000 7fbef37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbefc0a44a0 0x7fbefc0708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42406/0 (socket says 172.21.15.38:42406) 2023-12-22T08:47:07.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.265+0000 7fbef37fe640 1 -- 172.21.15.38:0/559425876 learned_addr learned my addr 172.21.15.38:0/559425876 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:07.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.265+0000 7fbf009a1640 1 --2- 172.21.15.38:0/559425876 >> v2:172.21.15.89:3300/0 conn(0x7fbefc070e30 0x7fbefc15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.266+0000 7fbef37fe640 1 -- 172.21.15.38:0/559425876 >> v2:172.21.15.89:3300/0 conn(0x7fbefc070e30 msgr2=0x7fbefc15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:07.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.266+0000 7fbef37fe640 1 --2- 172.21.15.38:0/559425876 >> v2:172.21.15.89:3300/0 conn(0x7fbefc070e30 0x7fbefc15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.266+0000 7fbef37fe640 1 -- 172.21.15.38:0/559425876 >> v1:172.21.15.89:6789/0 conn(0x7fbefc15b420 legacy=0x7fbefc06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.266+0000 7fbef37fe640 1 -- 172.21.15.38:0/559425876 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc0cdd30 con 0x7fbefc0a44a0 2023-12-22T08:47:07.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.266+0000 7fbf009a1640 1 --2- 172.21.15.38:0/559425876 >> v2:172.21.15.89:3300/0 conn(0x7fbefc070e30 0x7fbefc15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:47:07.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.267+0000 7fbef37fe640 1 --2- 172.21.15.38:0/559425876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0a44a0 0x7fbefc0708f0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fbefc070670 tx=0x7fbee402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c17bac023927d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:07.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.267+0000 7fbefb7fe640 1 -- 172.21.15.38:0/559425876 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4030860 con 0x7fbefc0a44a0 2023-12-22T08:47:07.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.267+0000 7fbefb7fe640 1 -- 172.21.15.38:0/559425876 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee40309c0 con 0x7fbefc0a44a0 2023-12-22T08:47:07.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.267+0000 7fbefb7fe640 1 -- 172.21.15.38:0/559425876 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4030d50 con 0x7fbefc0a44a0 2023-12-22T08:47:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.268+0000 7fbf011a2640 1 -- 172.21.15.38:0/559425876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0a44a0 msgr2=0x7fbefc0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.268+0000 7fbf011a2640 1 --2- 172.21.15.38:0/559425876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0a44a0 0x7fbefc0708f0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fbefc070670 tx=0x7fbee402b9a0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.268+0000 7fbf011a2640 1 -- 172.21.15.38:0/559425876 shutdown_connections 2023-12-22T08:47:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.268+0000 7fbf011a2640 1 --2- 172.21.15.38:0/559425876 >> v2:172.21.15.89:3300/0 conn(0x7fbefc070e30 0x7fbefc15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.268+0000 7fbf011a2640 1 --2- 172.21.15.38:0/559425876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0a44a0 0x7fbefc0708f0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.268+0000 7fbf011a2640 1 -- 172.21.15.38:0/559425876 >> 172.21.15.38:0/559425876 conn(0x7fbefc0b1f70 msgr2=0x7fbefc0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.268+0000 7fbf011a2640 1 -- 172.21.15.38:0/559425876 shutdown_connections 2023-12-22T08:47:07.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.268+0000 7fbf011a2640 1 -- 172.21.15.38:0/559425876 wait complete. 2023-12-22T08:47:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.270+0000 7fbf011a2640 1 Processor -- start 2023-12-22T08:47:07.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.270+0000 7fbf011a2640 1 -- start start 2023-12-22T08:47:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.271+0000 7fbf011a2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc070e30 0x7fbefc0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.271+0000 7fbf011a2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbefc0a44a0 0x7fbefc0cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.271+0000 7fbf011a2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbefc15b420 0x7fbefc14dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.271+0000 7fbf011a2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0ccef0 con 0x7fbefc070e30 2023-12-22T08:47:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.271+0000 7fbf011a2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc14b140 con 0x7fbefc0a44a0 2023-12-22T08:47:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.271+0000 7fbf011a2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc14b420 con 0x7fbefc15b420 2023-12-22T08:47:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.271+0000 7fbefbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc070e30 0x7fbefc0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.271+0000 7fbefbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc070e30 0x7fbefc0cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42408/0 (socket says 172.21.15.38:42408) 2023-12-22T08:47:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.271+0000 7fbefbfff640 1 -- 172.21.15.38:0/3652320351 learned_addr learned my addr 172.21.15.38:0/3652320351 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.272+0000 7fbef37fe640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbefc0a44a0 0x7fbefc0cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.272+0000 7fbf009a1640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbefc15b420 0x7fbefc14dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.272+0000 7fbefbfff640 1 -- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbefc15b420 msgr2=0x7fbefc14dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.272+0000 7fbefbfff640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbefc15b420 0x7fbefc14dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.272+0000 7fbefbfff640 1 -- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbefc0a44a0 msgr2=0x7fbefc0cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.272+0000 7fbefbfff640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbefc0a44a0 0x7fbefc0cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.272+0000 7fbefbfff640 1 -- 172.21.15.38:0/3652320351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee40094d0 con 0x7fbefc070e30 2023-12-22T08:47:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.272+0000 7fbefbfff640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc070e30 0x7fbefc0cb860 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00c870 tx=0x7fbeec00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.273+0000 7fbef97fa640 1 -- 172.21.15.38:0/3652320351 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec003b70 con 0x7fbefc070e30 2023-12-22T08:47:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.273+0000 7fbef97fa640 1 -- 172.21.15.38:0/3652320351 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec003cf0 con 0x7fbefc070e30 2023-12-22T08:47:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.273+0000 7fbf011a2640 1 -- 172.21.15.38:0/3652320351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbefc14b700 con 0x7fbefc070e30 2023-12-22T08:47:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.273+0000 7fbef97fa640 1 -- 172.21.15.38:0/3652320351 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00aa90 con 0x7fbefc070e30 2023-12-22T08:47:07.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.273+0000 7fbf011a2640 1 -- 172.21.15.38:0/3652320351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc065c40 con 0x7fbefc070e30 2023-12-22T08:47:07.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.274+0000 7fbf011a2640 1 -- 172.21.15.38:0/3652320351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbefc065dd0 con 0x7fbefc070e30 2023-12-22T08:47:07.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.275+0000 7fbef97fa640 1 -- 172.21.15.38:0/3652320351 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbeec00abf0 con 0x7fbefc070e30 2023-12-22T08:47:07.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.276+0000 7fbef97fa640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbedc06a430 0x7fbedc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.276+0000 7fbef97fa640 1 -- 172.21.15.38:0/3652320351 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbeec0887f0 con 0x7fbefc070e30 2023-12-22T08:47:07.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.277+0000 7fbef37fe640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbedc06a430 0x7fbedc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.278+0000 7fbef37fe640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbedc06a430 0x7fbedc06c8f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbee4036000 tx=0x7fbee403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:07.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.281+0000 7fbef97fa640 1 -- 172.21.15.38:0/3652320351 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbeec053de0 con 0x7fbefc070e30 2023-12-22T08:47:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.471+0000 7fbf011a2640 1 -- 172.21.15.38:0/3652320351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbefc06e680 con 0x7fbefc070e30 2023-12-22T08:47:07.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.473+0000 7fbef97fa640 1 -- 172.21.15.38:0/3652320351 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16017 (secure 0 0 0) 0x7fbeec080e60 con 0x7fbefc070e30 2023-12-22T08:47:07.475 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:07.475 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":126,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:07.034824+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:04.687287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:06.061571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:07.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.475+0000 7fbf011a2640 1 -- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbedc06a430 msgr2=0x7fbedc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.475+0000 7fbf011a2640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbedc06a430 0x7fbedc06c8f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbee4036000 tx=0x7fbee403b040 comp rx=0 tx=0).stop 2023-12-22T08:47:07.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.476+0000 7fbf011a2640 1 -- 172.21.15.38:0/3652320351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc070e30 msgr2=0x7fbefc0cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.476+0000 7fbf011a2640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc070e30 0x7fbefc0cb860 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00c870 tx=0x7fbeec00cd30 comp rx=0 tx=0).stop 2023-12-22T08:47:07.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.476+0000 7fbf011a2640 1 -- 172.21.15.38:0/3652320351 shutdown_connections 2023-12-22T08:47:07.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.476+0000 7fbf011a2640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbefc15b420 0x7fbefc14dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.476+0000 7fbf011a2640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbefc0a44a0 0x7fbefc0cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.476+0000 7fbf011a2640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbedc06a430 0x7fbedc06c8f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.476+0000 7fbf011a2640 1 --2- 172.21.15.38:0/3652320351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc070e30 0x7fbefc0cb860 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.476+0000 7fbf011a2640 1 -- 172.21.15.38:0/3652320351 >> 172.21.15.38:0/3652320351 conn(0x7fbefc0b1f70 msgr2=0x7fbefc15dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:07.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.476+0000 7fbf011a2640 1 -- 172.21.15.38:0/3652320351 shutdown_connections 2023-12-22T08:47:07.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.476+0000 7fbf011a2640 1 -- 172.21.15.38:0/3652320351 wait complete. 2023-12-22T08:47:07.494 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:07.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.704+0000 7f962759e640 1 Processor -- start 2023-12-22T08:47:07.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.704+0000 7f962759e640 1 -- start start 2023-12-22T08:47:07.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.706+0000 7f962759e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9628162f20 0x7f96280b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.706+0000 7f962759e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96280b2fd0 con 0x7f9628071680 2023-12-22T08:47:07.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.706+0000 7f962759e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9628163370 con 0x7f96280caf90 2023-12-22T08:47:07.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.706+0000 7f962759e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9628162ce0 con 0x7f9628162f20 2023-12-22T08:47:07.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.706+0000 7f962659c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9628071680 0x7f96280ca880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34958/0 (socket says 172.21.15.38:34958) 2023-12-22T08:47:07.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.706+0000 7f962659c640 1 -- 172.21.15.38:0/799939024 learned_addr learned my addr 172.21.15.38:0/799939024 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.707+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014419370 0 0) 0x7f9618001110 con 0x7f9628071680 2023-12-22T08:47:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.707+0000 7f9626d9d640 1 --2- 172.21.15.38:0/799939024 >> v2:172.21.15.89:3300/0 conn(0x7f9628162f20 0x7f96280b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.707+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9614003520 con 0x7f9628071680 2023-12-22T08:47:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.707+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1032016348 0 0) 0x7f9614003520 con 0x7f9628071680 2023-12-22T08:47:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.707+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 >> v2:172.21.15.89:3300/0 conn(0x7f9628162f20 msgr2=0x7f96280b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.707+0000 7f9625d9b640 1 --2- 172.21.15.38:0/799939024 >> v2:172.21.15.89:3300/0 conn(0x7f9628162f20 0x7f96280b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.707+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 >> v1:172.21.15.89:6789/0 conn(0x7f96280caf90 legacy=0x7f962806d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.707+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9628162160 con 0x7f9628071680 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.707+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f9618001800 con 0x7f9628071680 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.707+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 >> v1:172.21.15.38:6789/0 conn(0x7f9628071680 legacy=0x7f96280ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f9625d9b640 1 --2- 172.21.15.38:0/799939024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96140039c0 0x7f9614003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f9625d9b640 1 --2- 172.21.15.38:0/799939024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96140047c0 0x7f9614004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f9625d9b640 1 --2- 172.21.15.38:0/799939024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96140051d0 0x7f961400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9628162ce0 con 0x7f96140039c0 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961400c120 con 0x7f96140047c0 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961400c2e0 con 0x7f96140051d0 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f962659c640 1 --2- 172.21.15.38:0/799939024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96140039c0 0x7f9614003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f961ffff640 1 --2- 172.21.15.38:0/799939024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96140047c0 0x7f9614004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f962659c640 1 -- 172.21.15.38:0/799939024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96140051d0 msgr2=0x7f961400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f9626d9d640 1 --2- 172.21.15.38:0/799939024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96140051d0 0x7f961400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f962659c640 1 --2- 172.21.15.38:0/799939024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96140051d0 0x7f961400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f962659c640 1 -- 172.21.15.38:0/799939024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96140047c0 msgr2=0x7f9614004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:07.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f962659c640 1 --2- 172.21.15.38:0/799939024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96140047c0 0x7f9614004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f962659c640 1 -- 172.21.15.38:0/799939024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614003520 con 0x7f96140039c0 2023-12-22T08:47:07.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f961ffff640 1 --2- 172.21.15.38:0/799939024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96140047c0 0x7f9614004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:07.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.708+0000 7f9626d9d640 1 -- 172.21.15.38:0/799939024 reap_dead start 2023-12-22T08:47:07.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.709+0000 7f962659c640 1 --2- 172.21.15.38:0/799939024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96140039c0 0x7f9614003de0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f9618007fa0 tx=0x7f96140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3076d5b2d1b7210 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:07.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.710+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618005ad0 con 0x7f96140039c0 2023-12-22T08:47:07.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.710+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9618005c30 con 0x7f96140039c0 2023-12-22T08:47:07.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.710+0000 7f9625d9b640 1 -- 172.21.15.38:0/799939024 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961802c940 con 0x7f96140039c0 2023-12-22T08:47:07.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.710+0000 7f962759e640 1 -- 172.21.15.38:0/799939024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96140039c0 msgr2=0x7f9614003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.710+0000 7f962759e640 1 --2- 172.21.15.38:0/799939024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96140039c0 0x7f9614003de0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f9618007fa0 tx=0x7f96140057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.710+0000 7f962759e640 1 -- 172.21.15.38:0/799939024 shutdown_connections 2023-12-22T08:47:07.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.710+0000 7f962759e640 1 --2- 172.21.15.38:0/799939024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96140039c0 0x7f9614003de0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.710+0000 7f962759e640 1 -- 172.21.15.38:0/799939024 >> 172.21.15.38:0/799939024 conn(0x7f96280b1f70 msgr2=0x7f96280b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:07.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.711+0000 7f962759e640 1 -- 172.21.15.38:0/799939024 shutdown_connections 2023-12-22T08:47:07.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.711+0000 7f962759e640 1 -- 172.21.15.38:0/799939024 wait complete. 2023-12-22T08:47:07.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.712+0000 7f962759e640 1 Processor -- start 2023-12-22T08:47:07.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.713+0000 7f962759e640 1 -- start start 2023-12-22T08:47:07.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.713+0000 7f962759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96140039c0 0x7f962815a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.713+0000 7f962759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9628157720 0x7f96281f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f962759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9628163cd0 0x7f9628164150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f962759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962815b590 con 0x7f9628163cd0 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f962759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9628164690 con 0x7f96140039c0 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f962759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96281f8370 con 0x7f9628157720 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f9626d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9628163cd0 0x7f9628164150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f9626d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9628163cd0 0x7f9628164150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42420/0 (socket says 172.21.15.38:42420) 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f9626d9d640 1 -- 172.21.15.38:0/928289515 learned_addr learned my addr 172.21.15.38:0/928289515 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f962659c640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96140039c0 0x7f962815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f961ffff640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9628157720 0x7f96281f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f9626d9d640 1 -- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9628157720 msgr2=0x7f96281f71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f9626d9d640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9628157720 0x7f96281f71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f9626d9d640 1 -- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96140039c0 msgr2=0x7f962815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f9626d9d640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96140039c0 0x7f962815a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f9626d9d640 1 -- 172.21.15.38:0/928289515 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9628157ba0 con 0x7f9628163cd0 2023-12-22T08:47:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.714+0000 7f962659c640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96140039c0 0x7f962815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:47:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.715+0000 7f9626d9d640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9628163cd0 0x7f9628164150 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f96280ae400 tx=0x7f962000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.715+0000 7f961effd640 1 -- 172.21.15.38:0/928289515 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620016620 con 0x7f9628163cd0 2023-12-22T08:47:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.715+0000 7f961effd640 1 -- 172.21.15.38:0/928289515 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96200167a0 con 0x7f9628163cd0 2023-12-22T08:47:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.715+0000 7f961effd640 1 -- 172.21.15.38:0/928289515 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620016b50 con 0x7f9628163cd0 2023-12-22T08:47:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.715+0000 7f962759e640 1 -- 172.21.15.38:0/928289515 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96281f7a00 con 0x7f9628163cd0 2023-12-22T08:47:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.715+0000 7f962759e640 1 -- 172.21.15.38:0/928289515 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96281f7fc0 con 0x7f9628163cd0 2023-12-22T08:47:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.716+0000 7f962759e640 1 -- 172.21.15.38:0/928289515 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96281f8150 con 0x7f9628163cd0 2023-12-22T08:47:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.717+0000 7f961effd640 1 -- 172.21.15.38:0/928289515 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9620016cb0 con 0x7f9628163cd0 2023-12-22T08:47:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.718+0000 7f961effd640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f960806a430 0x7f960806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.718+0000 7f961effd640 1 -- 172.21.15.38:0/928289515 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9620089820 con 0x7f9628163cd0 2023-12-22T08:47:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.719+0000 7f962659c640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f960806a430 0x7f960806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:07.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.720+0000 7f962659c640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f960806a430 0x7f960806c8f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9618034000 tx=0x7f9618009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.723+0000 7f961effd640 1 -- 172.21.15.38:0/928289515 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9620054d70 con 0x7f9628163cd0 2023-12-22T08:47:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.915+0000 7f962759e640 1 -- 172.21.15.38:0/928289515 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9628061910 con 0x7f9628163cd0 2023-12-22T08:47:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.917+0000 7f961effd640 1 -- 172.21.15.38:0/928289515 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16017 (secure 0 0 0) 0x7f9620058390 con 0x7f9628163cd0 2023-12-22T08:47:07.918 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:07.918 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":126,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:07.034824+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:04.687287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:06.061571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.919+0000 7f962759e640 1 -- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f960806a430 msgr2=0x7f960806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.919+0000 7f962759e640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f960806a430 0x7f960806c8f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9618034000 tx=0x7f9618009030 comp rx=0 tx=0).stop 2023-12-22T08:47:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.919+0000 7f962759e640 1 -- 172.21.15.38:0/928289515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9628163cd0 msgr2=0x7f9628164150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:07.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.919+0000 7f962759e640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9628163cd0 0x7f9628164150 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f96280ae400 tx=0x7f962000f520 comp rx=0 tx=0).stop 2023-12-22T08:47:07.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.920+0000 7f962759e640 1 -- 172.21.15.38:0/928289515 shutdown_connections 2023-12-22T08:47:07.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.920+0000 7f962759e640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f960806a430 0x7f960806c8f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.920+0000 7f962759e640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9628163cd0 0x7f9628164150 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.920+0000 7f962759e640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9628157720 0x7f96281f71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.920+0000 7f962759e640 1 --2- 172.21.15.38:0/928289515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96140039c0 0x7f962815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:07.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.920+0000 7f962759e640 1 -- 172.21.15.38:0/928289515 >> 172.21.15.38:0/928289515 conn(0x7f96280b1f70 msgr2=0x7f96280b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:07.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.920+0000 7f962759e640 1 -- 172.21.15.38:0/928289515 shutdown_connections 2023-12-22T08:47:07.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:07.920+0000 7f962759e640 1 -- 172.21.15.38:0/928289515 wait complete. 2023-12-22T08:47:07.940 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T08:47:08.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.161+0000 7f8051357640 1 Processor -- start 2023-12-22T08:47:08.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.161+0000 7f8051357640 1 -- start start 2023-12-22T08:47:08.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.163+0000 7f8051357640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f804c15ad90 0x7f804c0caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:08.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.163+0000 7f8051357640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f804c15e050 0x7f804c0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:08.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.163+0000 7f8051357640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804c15e630 con 0x7f804c161bb0 2023-12-22T08:47:08.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.163+0000 7f8051357640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804c0ce2c0 con 0x7f804c15ad90 2023-12-22T08:47:08.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.163+0000 7f8051357640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c15e910 con 0x7f804c15e050 2023-12-22T08:47:08.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.163+0000 7f804b7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f804c161bb0 0x7f804c15d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34966/0 (socket says 172.21.15.38:34966) 2023-12-22T08:47:08.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.163+0000 7f804b7fe640 1 -- 172.21.15.38:0/2895999164 learned_addr learned my addr 172.21.15.38:0/2895999164 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:08.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.163+0000 7f8050b56640 1 --2- 172.21.15.38:0/2895999164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f804c15e050 0x7f804c0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:08.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.163+0000 7f804bfff640 1 --2- 172.21.15.38:0/2895999164 >> v2:172.21.15.89:3300/0 conn(0x7f804c15ad90 0x7f804c0caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:08.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.163+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876670840 0 0) 0x7f804c15e630 con 0x7f804c161bb0 2023-12-22T08:47:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8034003520 con 0x7f804c161bb0 2023-12-22T08:47:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1367016056 0 0) 0x7f8034003520 con 0x7f804c161bb0 2023-12-22T08:47:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f804c15e050 msgr2=0x7f804c0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 --2- 172.21.15.38:0/2895999164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f804c15e050 0x7f804c0cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 >> v2:172.21.15.89:3300/0 conn(0x7f804c15ad90 msgr2=0x7f804c0caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 --2- 172.21.15.38:0/2895999164 >> v2:172.21.15.89:3300/0 conn(0x7f804c15ad90 0x7f804c0caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c1610d0 con 0x7f804c161bb0 2023-12-22T08:47:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f8040001670 con 0x7f804c161bb0 2023-12-22T08:47:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 >> v1:172.21.15.38:6789/0 conn(0x7f804c161bb0 legacy=0x7f804c15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 --2- 172.21.15.38:0/2895999164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f804c15e050 0x7f80340039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 --2- 172.21.15.38:0/2895999164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8034003f70 0x7f80340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:08.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 --2- 172.21.15.38:0/2895999164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8034004d00 0x7f8034005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:08.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c15e910 con 0x7f8034004d00 2023-12-22T08:47:08.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803400b980 con 0x7f8034003f70 2023-12-22T08:47:08.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803400baf0 con 0x7f804c15e050 2023-12-22T08:47:08.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.164+0000 7f8050b56640 1 --2- 172.21.15.38:0/2895999164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8034004d00 0x7f8034005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:08.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.165+0000 7f804b7fe640 1 --2- 172.21.15.38:0/2895999164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8034003f70 0x7f80340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:08.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.165+0000 7f8050b56640 1 -- 172.21.15.38:0/2895999164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f804c15e050 msgr2=0x7f80340039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:08.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.165+0000 7f8050b56640 1 --2- 172.21.15.38:0/2895999164 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f804c15e050 0x7f80340039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:08.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.165+0000 7f8050b56640 1 -- 172.21.15.38:0/2895999164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8034003f70 msgr2=0x7f80340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:08.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.165+0000 7f8050b56640 1 --2- 172.21.15.38:0/2895999164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8034003f70 0x7f80340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:08.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.165+0000 7f8050b56640 1 -- 172.21.15.38:0/2895999164 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8034003520 con 0x7f8034004d00 2023-12-22T08:47:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.166+0000 7f8050b56640 1 --2- 172.21.15.38:0/2895999164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8034004d00 0x7f8034005180 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f8044009fc0 tx=0x7f80340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9ad11211c05bad server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.166+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804402cc40 con 0x7f8034004d00 2023-12-22T08:47:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.167+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804400f040 con 0x7f8034004d00 2023-12-22T08:47:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.167+0000 7f804affd640 1 -- 172.21.15.38:0/2895999164 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044034440 con 0x7f8034004d00 2023-12-22T08:47:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.167+0000 7f8051357640 1 -- 172.21.15.38:0/2895999164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8034004d00 msgr2=0x7f8034005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.167+0000 7f8051357640 1 --2- 172.21.15.38:0/2895999164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8034004d00 0x7f8034005180 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f8044009fc0 tx=0x7f80340057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.167+0000 7f8050b56640 1 -- 172.21.15.38:0/2895999164 reap_dead start 2023-12-22T08:47:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.167+0000 7f8051357640 1 -- 172.21.15.38:0/2895999164 shutdown_connections 2023-12-22T08:47:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.167+0000 7f8051357640 1 -- 172.21.15.38:0/2895999164 >> 172.21.15.38:0/2895999164 conn(0x7f804c0d31c0 msgr2=0x7f804c0d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.167+0000 7f8051357640 1 -- 172.21.15.38:0/2895999164 shutdown_connections 2023-12-22T08:47:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.167+0000 7f8051357640 1 -- 172.21.15.38:0/2895999164 wait complete. 2023-12-22T08:47:08.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.169+0000 7f8051357640 1 Processor -- start 2023-12-22T08:47:08.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.169+0000 7f8051357640 1 -- start start 2023-12-22T08:47:08.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.170+0000 7f8051357640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8034004d00 0x7f804c157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:08.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.170+0000 7f8051357640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f804c0b4420 0x7f804c0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:08.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.170+0000 7f8051357640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f804c0ca7d0 0x7f804c0b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:08.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.170+0000 7f8051357640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0cac50 con 0x7f804c0b4420 2023-12-22T08:47:08.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.170+0000 7f8051357640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c1582b0 con 0x7f804c0ca7d0 2023-12-22T08:47:08.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.170+0000 7f8051357640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0b3660 con 0x7f8034004d00 2023-12-22T08:47:08.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.171+0000 7f804b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f804c0b4420 0x7f804c0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:08.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.171+0000 7f804b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f804c0b4420 0x7f804c0ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42442/0 (socket says 172.21.15.38:42442) 2023-12-22T08:47:08.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.171+0000 7f804b7fe640 1 -- 172.21.15.38:0/3988166924 learned_addr learned my addr 172.21.15.38:0/3988166924 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:08.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.171+0000 7f8050b56640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f804c0ca7d0 0x7f804c0b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.171+0000 7f804bfff640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8034004d00 0x7f804c157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.171+0000 7f804b7fe640 1 -- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8034004d00 msgr2=0x7f804c157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.171+0000 7f804b7fe640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8034004d00 0x7f804c157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.171+0000 7f804b7fe640 1 -- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f804c0ca7d0 msgr2=0x7f804c0b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.171+0000 7f804b7fe640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f804c0ca7d0 0x7f804c0b6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.171+0000 7f804b7fe640 1 -- 172.21.15.38:0/3988166924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c0b3940 con 0x7f804c0b4420 2023-12-22T08:47:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.171+0000 7f804bfff640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8034004d00 0x7f804c157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.171+0000 7f804b7fe640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f804c0b4420 0x7f804c0ca290 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f804000e7b0 tx=0x7f804000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.172+0000 7f8048ff9640 1 -- 172.21.15.38:0/3988166924 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804000ee60 con 0x7f804c0b4420 2023-12-22T08:47:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.172+0000 7f8048ff9640 1 -- 172.21.15.38:0/3988166924 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804000c8d0 con 0x7f804c0b4420 2023-12-22T08:47:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.172+0000 7f8048ff9640 1 -- 172.21.15.38:0/3988166924 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804000cc80 con 0x7f804c0b4420 2023-12-22T08:47:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.172+0000 7f8051357640 1 -- 172.21.15.38:0/3988166924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c0b3c20 con 0x7f804c0b4420 2023-12-22T08:47:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.172+0000 7f8051357640 1 -- 172.21.15.38:0/3988166924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c0b7970 con 0x7f804c0b4420 2023-12-22T08:47:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.173+0000 7f8051357640 1 -- 172.21.15.38:0/3988166924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804c0b4140 con 0x7f804c0b4420 2023-12-22T08:47:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.174+0000 7f8048ff9640 1 -- 172.21.15.38:0/3988166924 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f804001d460 con 0x7f804c0b4420 2023-12-22T08:47:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.175+0000 7f8048ff9640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f803806a430 0x7f803806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.175+0000 7f8048ff9640 1 -- 172.21.15.38:0/3988166924 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8040088900 con 0x7f804c0b4420 2023-12-22T08:47:08.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.176+0000 7f804bfff640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f803806a430 0x7f803806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:08.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.177+0000 7f804bfff640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f803806a430 0x7f803806c8f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f803c009a40 tx=0x7f803c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:08.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.180+0000 7f8048ff9640 1 -- 172.21.15.38:0/3988166924 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f804c0b4140 con 0x7f804c0b4420 2023-12-22T08:47:08.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:08.437+0000 7f8051357640 1 -- 172.21.15.38:0/3988166924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f804c061910 con 0x7f804c0b4420 2023-12-22T08:47:09.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.077+0000 7f8048ff9640 1 -- 172.21.15.38:0/3988166924 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8040053ef0 con 0x7f804c0b4420 2023-12-22T08:47:09.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.081+0000 7f8051357640 1 -- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f803806a430 msgr2=0x7f803806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:09.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.081+0000 7f8051357640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f803806a430 0x7f803806c8f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f803c009a40 tx=0x7f803c008040 comp rx=0 tx=0).stop 2023-12-22T08:47:09.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.081+0000 7f8051357640 1 -- 172.21.15.38:0/3988166924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f804c0b4420 msgr2=0x7f804c0ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:09.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.081+0000 7f8051357640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f804c0b4420 0x7f804c0ca290 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f804000e7b0 tx=0x7f804000ec70 comp rx=0 tx=0).stop 2023-12-22T08:47:09.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.081+0000 7f8051357640 1 -- 172.21.15.38:0/3988166924 shutdown_connections 2023-12-22T08:47:09.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.081+0000 7f8051357640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f804c0ca7d0 0x7f804c0b6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:09.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.081+0000 7f8051357640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f803806a430 0x7f803806c8f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:09.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.081+0000 7f8051357640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f804c0b4420 0x7f804c0ca290 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:09.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.081+0000 7f8051357640 1 --2- 172.21.15.38:0/3988166924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8034004d00 0x7f804c157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:09.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.081+0000 7f8051357640 1 -- 172.21.15.38:0/3988166924 >> 172.21.15.38:0/3988166924 conn(0x7f804c0d31c0 msgr2=0x7f804c15cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:09.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.081+0000 7f8051357640 1 -- 172.21.15.38:0/3988166924 shutdown_connections 2023-12-22T08:47:09.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.081+0000 7f8051357640 1 -- 172.21.15.38:0/3988166924 wait complete. 2023-12-22T08:47:09.104 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T08:47:09.104 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T08:47:09.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.326+0000 7f978d5b9640 1 Processor -- start 2023-12-22T08:47:09.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.326+0000 7f978d5b9640 1 -- start start 2023-12-22T08:47:09.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.328+0000 7f978d5b9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f978815d470 0x7f97880b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:09.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.328+0000 7f978d5b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978815d850 0x7f97880ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:09.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.328+0000 7f978d5b9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97880ac8e0 con 0x7f9788071ea0 2023-12-22T08:47:09.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.328+0000 7f978d5b9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97880b4550 con 0x7f978815d470 2023-12-22T08:47:09.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.328+0000 7f978d5b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97880b4940 con 0x7f978815d850 2023-12-22T08:47:09.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.328+0000 7f9786ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f978815d470 0x7f97880b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:09.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.328+0000 7f9786ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f978815d470 0x7f97880b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42446/0 (socket says 172.21.15.38:42446) 2023-12-22T08:47:09.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.328+0000 7f9786ffd640 1 -- 172.21.15.38:0/3588163100 learned_addr learned my addr 172.21.15.38:0/3588163100 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:09.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.329+0000 7f97867fc640 1 --2- 172.21.15.38:0/3588163100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978815d850 0x7f97880ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:09.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.329+0000 7f9786ffd640 1 -- 172.21.15.38:0/3588163100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978815d850 msgr2=0x7f97880ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:09.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.329+0000 7f9786ffd640 1 --2- 172.21.15.38:0/3588163100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978815d850 0x7f97880ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:09.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.329+0000 7f9786ffd640 1 -- 172.21.15.38:0/3588163100 >> v1:172.21.15.89:6789/0 conn(0x7f9788071ea0 legacy=0x7f97880b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:09.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.329+0000 7f9786ffd640 1 -- 172.21.15.38:0/3588163100 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97880b4c20 con 0x7f978815d470 2023-12-22T08:47:09.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.329+0000 7f97867fc640 1 --2- 172.21.15.38:0/3588163100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978815d850 0x7f97880ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:47:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.331+0000 7f9786ffd640 1 --2- 172.21.15.38:0/3588163100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f978815d470 0x7f97880b4010 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f977c009870 tx=0x7f977c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a975684e105d0d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:09.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.331+0000 7f9785ffb640 1 -- 172.21.15.38:0/3588163100 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c030840 con 0x7f978815d470 2023-12-22T08:47:09.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.331+0000 7f9785ffb640 1 -- 172.21.15.38:0/3588163100 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c0309a0 con 0x7f978815d470 2023-12-22T08:47:09.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.331+0000 7f9785ffb640 1 -- 172.21.15.38:0/3588163100 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c030d30 con 0x7f978815d470 2023-12-22T08:47:09.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.332+0000 7f978d5b9640 1 -- 172.21.15.38:0/3588163100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f978815d470 msgr2=0x7f97880b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:09.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.332+0000 7f978d5b9640 1 --2- 172.21.15.38:0/3588163100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f978815d470 0x7f97880b4010 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f977c009870 tx=0x7f977c02b980 comp rx=0 tx=0).stop 2023-12-22T08:47:09.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.332+0000 7f978d5b9640 1 -- 172.21.15.38:0/3588163100 shutdown_connections 2023-12-22T08:47:09.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.332+0000 7f978d5b9640 1 --2- 172.21.15.38:0/3588163100 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978815d850 0x7f97880ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:09.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.332+0000 7f978d5b9640 1 --2- 172.21.15.38:0/3588163100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f978815d470 0x7f97880b4010 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:09.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.332+0000 7f978d5b9640 1 -- 172.21.15.38:0/3588163100 >> 172.21.15.38:0/3588163100 conn(0x7f97880cf070 msgr2=0x7f97880cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:09.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.332+0000 7f978d5b9640 1 -- 172.21.15.38:0/3588163100 shutdown_connections 2023-12-22T08:47:09.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.332+0000 7f978d5b9640 1 -- 172.21.15.38:0/3588163100 wait complete. 2023-12-22T08:47:09.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.334+0000 7f978d5b9640 1 Processor -- start 2023-12-22T08:47:09.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.334+0000 7f978d5b9640 1 -- start start 2023-12-22T08:47:09.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.335+0000 7f978d5b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9788071ea0 0x7f9788140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.335+0000 7f978d5b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978815d470 0x7f978813f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.335+0000 7f978d5b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f978815d850 0x7f97881f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.335+0000 7f978d5b9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9788160b90 con 0x7f978815d850 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.335+0000 7f978d5b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880cd070 con 0x7f9788071ea0 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.335+0000 7f978d5b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978813fec0 con 0x7f978815d470 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.336+0000 7f97877fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f978815d850 0x7f97881f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.336+0000 7f97877fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f978815d850 0x7f97881f5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42460/0 (socket says 172.21.15.38:42460) 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.336+0000 7f97877fe640 1 -- 172.21.15.38:0/2665903261 learned_addr learned my addr 172.21.15.38:0/2665903261 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.336+0000 7f9786ffd640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9788071ea0 0x7f9788140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.336+0000 7f97867fc640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978815d470 0x7f978813f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.336+0000 7f97877fe640 1 -- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978815d470 msgr2=0x7f978813f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.336+0000 7f97877fe640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978815d470 0x7f978813f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.336+0000 7f97877fe640 1 -- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9788071ea0 msgr2=0x7f9788140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:09.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.336+0000 7f97877fe640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9788071ea0 0x7f9788140090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:09.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.336+0000 7f97877fe640 1 -- 172.21.15.38:0/2665903261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c0094d0 con 0x7f978815d850 2023-12-22T08:47:09.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.337+0000 7f97877fe640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f978815d850 0x7f97881f5fc0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f978000c7d0 tx=0x7f978000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:09.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.337+0000 7f976f7fe640 1 -- 172.21.15.38:0/2665903261 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780003b70 con 0x7f978815d850 2023-12-22T08:47:09.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.337+0000 7f976f7fe640 1 -- 172.21.15.38:0/2665903261 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780003cf0 con 0x7f978815d850 2023-12-22T08:47:09.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.337+0000 7f976f7fe640 1 -- 172.21.15.38:0/2665903261 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978000aa90 con 0x7f978815d850 2023-12-22T08:47:09.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.337+0000 7f978d5b9640 1 -- 172.21.15.38:0/2665903261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97881f6810 con 0x7f978815d850 2023-12-22T08:47:09.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.337+0000 7f978d5b9640 1 -- 172.21.15.38:0/2665903261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97881f6dd0 con 0x7f978815d850 2023-12-22T08:47:09.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.338+0000 7f978d5b9640 1 -- 172.21.15.38:0/2665903261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97880cd200 con 0x7f978815d850 2023-12-22T08:47:09.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.339+0000 7f976f7fe640 1 -- 172.21.15.38:0/2665903261 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f978000abf0 con 0x7f978815d850 2023-12-22T08:47:09.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.340+0000 7f976f7fe640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f977406a430 0x7f977406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:09.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.340+0000 7f976f7fe640 1 -- 172.21.15.38:0/2665903261 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97800887e0 con 0x7f978815d850 2023-12-22T08:47:09.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.341+0000 7f9786ffd640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f977406a430 0x7f977406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:09.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.342+0000 7f9786ffd640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f977406a430 0x7f977406c8f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f977c036000 tx=0x7f977c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:09.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.344+0000 7f976f7fe640 1 -- 172.21.15.38:0/2665903261 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9780053d30 con 0x7f978815d850 2023-12-22T08:47:09.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:09.578+0000 7f978d5b9640 1 -- 172.21.15.38:0/2665903261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9788061910 con 0x7f978815d850 2023-12-22T08:47:10.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.583+0000 7f976f7fe640 1 -- 172.21.15.38:0/2665903261 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v55) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9780003e60 con 0x7f978815d850 2023-12-22T08:47:10.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.587+0000 7f978d5b9640 1 -- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f977406a430 msgr2=0x7f977406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:10.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.587+0000 7f978d5b9640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f977406a430 0x7f977406c8f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f977c036000 tx=0x7f977c008030 comp rx=0 tx=0).stop 2023-12-22T08:47:10.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.587+0000 7f978d5b9640 1 -- 172.21.15.38:0/2665903261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f978815d850 msgr2=0x7f97881f5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:10.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.587+0000 7f978d5b9640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f978815d850 0x7f97881f5fc0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f978000c7d0 tx=0x7f978000cc90 comp rx=0 tx=0).stop 2023-12-22T08:47:10.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.588+0000 7f978d5b9640 1 -- 172.21.15.38:0/2665903261 shutdown_connections 2023-12-22T08:47:10.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.588+0000 7f978d5b9640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f977406a430 0x7f977406c8f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:10.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.588+0000 7f978d5b9640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f978815d850 0x7f97881f5fc0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:10.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.588+0000 7f978d5b9640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978815d470 0x7f978813f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:10.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.588+0000 7f978d5b9640 1 --2- 172.21.15.38:0/2665903261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9788071ea0 0x7f9788140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:10.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.588+0000 7f978d5b9640 1 -- 172.21.15.38:0/2665903261 >> 172.21.15.38:0/2665903261 conn(0x7f97880cf070 msgr2=0x7f978814e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:10.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.588+0000 7f978d5b9640 1 -- 172.21.15.38:0/2665903261 shutdown_connections 2023-12-22T08:47:10.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.588+0000 7f978d5b9640 1 -- 172.21.15.38:0/2665903261 wait complete. 2023-12-22T08:47:10.611 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T08:47:10.612 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:47:10.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.838+0000 7f5b6b6ec640 1 Processor -- start 2023-12-22T08:47:10.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.839+0000 7f5b6b6ec640 1 -- start start 2023-12-22T08:47:10.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.840+0000 7f5b6b6ec640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5b6415d850 0x7f5b640ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:10.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.840+0000 7f5b6b6ec640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b640ac8e0 con 0x7f5b64071ea0 2023-12-22T08:47:10.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.840+0000 7f5b6b6ec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b640b4940 con 0x7f5b6415d470 2023-12-22T08:47:10.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.840+0000 7f5b6b6ec640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b640b4c20 con 0x7f5b6415d850 2023-12-22T08:47:10.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.840+0000 7f5b69c89640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5b64071ea0 0x7f5b640b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34980/0 (socket says 172.21.15.38:34980) 2023-12-22T08:47:10.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.840+0000 7f5b69c89640 1 -- 172.21.15.38:0/1095459965 learned_addr learned my addr 172.21.15.38:0/1095459965 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:10.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530416525 0 0) 0x7f5b640ac8e0 con 0x7f5b64071ea0 2023-12-22T08:47:10.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b4c003520 con 0x7f5b64071ea0 2023-12-22T08:47:10.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b68c87640 1 --2- 172.21.15.38:0/1095459965 >> v2:172.21.15.89:3300/0 conn(0x7f5b6415d850 0x7f5b640ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:10.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 278697863 0 0) 0x7f5b4c003520 con 0x7f5b64071ea0 2023-12-22T08:47:10.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 >> v2:172.21.15.89:3300/0 conn(0x7f5b6415d850 msgr2=0x7f5b640ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:10.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 --2- 172.21.15.38:0/1095459965 >> v2:172.21.15.89:3300/0 conn(0x7f5b6415d850 0x7f5b640ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:10.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 >> v1:172.21.15.89:6789/0 conn(0x7f5b6415d470 legacy=0x7f5b640b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:10.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b640acb30 con 0x7f5b64071ea0 2023-12-22T08:47:10.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f5b5c001670 con 0x7f5b64071ea0 2023-12-22T08:47:10.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 >> v1:172.21.15.38:6789/0 conn(0x7f5b64071ea0 legacy=0x7f5b640b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:10.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 --2- 172.21.15.38:0/1095459965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b4c0039c0 0x7f5b4c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:10.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 --2- 172.21.15.38:0/1095459965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b4c0047c0 0x7f5b4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:10.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 --2- 172.21.15.38:0/1095459965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b4c0051d0 0x7f5b4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:10.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640b4c20 con 0x7f5b4c0047c0 2023-12-22T08:47:10.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c00c120 con 0x7f5b4c0039c0 2023-12-22T08:47:10.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.841+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c00c2e0 con 0x7f5b4c0051d0 2023-12-22T08:47:10.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.842+0000 7f5b68c87640 1 --2- 172.21.15.38:0/1095459965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b4c0047c0 0x7f5b4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:10.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.842+0000 7f5b69488640 1 --2- 172.21.15.38:0/1095459965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b4c0039c0 0x7f5b4c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:10.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.842+0000 7f5b69c89640 1 --2- 172.21.15.38:0/1095459965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b4c0051d0 0x7f5b4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:10.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.842+0000 7f5b68c87640 1 -- 172.21.15.38:0/1095459965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b4c0051d0 msgr2=0x7f5b4c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:10.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.842+0000 7f5b68c87640 1 --2- 172.21.15.38:0/1095459965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b4c0051d0 0x7f5b4c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:10.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.842+0000 7f5b68c87640 1 -- 172.21.15.38:0/1095459965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b4c0039c0 msgr2=0x7f5b4c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:10.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.842+0000 7f5b68c87640 1 --2- 172.21.15.38:0/1095459965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b4c0039c0 0x7f5b4c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:10.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.842+0000 7f5b68c87640 1 -- 172.21.15.38:0/1095459965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c003520 con 0x7f5b4c0047c0 2023-12-22T08:47:10.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.842+0000 7f5b69c89640 1 -- 172.21.15.38:0/1095459965 reap_dead start 2023-12-22T08:47:10.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.843+0000 7f5b68c87640 1 --2- 172.21.15.38:0/1095459965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b4c0047c0 0x7f5b4c004c40 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800ba30 tx=0x7f5b4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbedc04d9c37dc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:10.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.844+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58032660 con 0x7f5b4c0047c0 2023-12-22T08:47:10.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.844+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b580327c0 con 0x7f5b4c0047c0 2023-12-22T08:47:10.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.844+0000 7f5b63fff640 1 -- 172.21.15.38:0/1095459965 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58032b50 con 0x7f5b4c0047c0 2023-12-22T08:47:10.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.844+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/1095459965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b4c0047c0 msgr2=0x7f5b4c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:10.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.844+0000 7f5b6b6ec640 1 --2- 172.21.15.38:0/1095459965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b4c0047c0 0x7f5b4c004c40 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800ba30 tx=0x7f5b4c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:10.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.844+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/1095459965 shutdown_connections 2023-12-22T08:47:10.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.844+0000 7f5b6b6ec640 1 --2- 172.21.15.38:0/1095459965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b4c0047c0 0x7f5b4c004c40 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:10.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.844+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/1095459965 >> 172.21.15.38:0/1095459965 conn(0x7f5b640cf070 msgr2=0x7f5b640cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:10.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.844+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/1095459965 shutdown_connections 2023-12-22T08:47:10.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.844+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/1095459965 wait complete. 2023-12-22T08:47:10.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.846+0000 7f5b6b6ec640 1 Processor -- start 2023-12-22T08:47:10.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.846+0000 7f5b6b6ec640 1 -- start start 2023-12-22T08:47:10.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.847+0000 7f5b6b6ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b4c0047c0 0x7f5b641540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:10.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.847+0000 7f5b6b6ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b6415f650 0x7f5b640cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.847+0000 7f5b6b6ec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b640710a0 0x7f5b64071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.847+0000 7f5b6b6ec640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b64160960 con 0x7f5b640710a0 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.847+0000 7f5b6b6ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b64071a60 con 0x7f5b6415f650 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.847+0000 7f5b6b6ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640ce4c0 con 0x7f5b4c0047c0 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.848+0000 7f5b69c89640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b640710a0 0x7f5b64071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.848+0000 7f5b69c89640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b640710a0 0x7f5b64071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42472/0 (socket says 172.21.15.38:42472) 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.848+0000 7f5b69c89640 1 -- 172.21.15.38:0/2635199329 learned_addr learned my addr 172.21.15.38:0/2635199329 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.848+0000 7f5b68c87640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b6415f650 0x7f5b640cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.848+0000 7f5b69488640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b4c0047c0 0x7f5b641540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.848+0000 7f5b69c89640 1 -- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b4c0047c0 msgr2=0x7f5b641540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.848+0000 7f5b69c89640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b4c0047c0 0x7f5b641540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.848+0000 7f5b69c89640 1 -- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b6415f650 msgr2=0x7f5b640cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.848+0000 7f5b69c89640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b6415f650 0x7f5b640cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:10.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.848+0000 7f5b69c89640 1 -- 172.21.15.38:0/2635199329 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b64159db0 con 0x7f5b640710a0 2023-12-22T08:47:10.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.848+0000 7f5b68c87640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b6415f650 0x7f5b640cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:10.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.848+0000 7f5b69c89640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b640710a0 0x7f5b64071520 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f5b6406e350 tx=0x7f5b5c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:10.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.849+0000 7f5b61ffb640 1 -- 172.21.15.38:0/2635199329 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00eed0 con 0x7f5b640710a0 2023-12-22T08:47:10.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.849+0000 7f5b61ffb640 1 -- 172.21.15.38:0/2635199329 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c00c5e0 con 0x7f5b640710a0 2023-12-22T08:47:10.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.849+0000 7f5b61ffb640 1 -- 172.21.15.38:0/2635199329 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00c970 con 0x7f5b640710a0 2023-12-22T08:47:10.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.849+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/2635199329 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6415fad0 con 0x7f5b640710a0 2023-12-22T08:47:10.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.849+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/2635199329 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b64160030 con 0x7f5b640710a0 2023-12-22T08:47:10.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.850+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/2635199329 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b64159f40 con 0x7f5b640710a0 2023-12-22T08:47:10.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.851+0000 7f5b61ffb640 1 -- 172.21.15.38:0/2635199329 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5b5c00cad0 con 0x7f5b640710a0 2023-12-22T08:47:10.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.852+0000 7f5b61ffb640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b5006a430 0x7f5b5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:10.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.852+0000 7f5b61ffb640 1 -- 172.21.15.38:0/2635199329 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b5c0880f0 con 0x7f5b640710a0 2023-12-22T08:47:10.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.853+0000 7f5b69488640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b5006a430 0x7f5b5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:10.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.854+0000 7f5b69488640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b5006a430 0x7f5b5006c8f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5b54000f80 tx=0x7f5b54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:10.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:10.856+0000 7f5b61ffb640 1 -- 172.21.15.38:0/2635199329 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5b5c053640 con 0x7f5b640710a0 2023-12-22T08:47:11.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.085+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/2635199329 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b64061910 con 0x7f5b640710a0 2023-12-22T08:47:11.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.086+0000 7f5b61ffb640 1 -- 172.21.15.38:0/2635199329 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f5b5c019090 con 0x7f5b640710a0 2023-12-22T08:47:11.087 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:11.087 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/186375012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":186375012},{"type":"v1","addr":"172.21.15.89:6837","nonce":186375012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1819583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1819583870},{"type":"v1","addr":"172.21.15.89:6835","nonce":1819583870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3793773672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3793773672},{"type":"v1","addr":"172.21.15.38:6834","nonce":3793773672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:07.035669+0000","modified":"2023-12-22T08:47:10.565916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7293":{"gid":7293,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3340763944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3340763944},{"type":"v1","addr":"172.21.15.38:6835","nonce":3340763944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-22T08:47:11.087 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 55 2023-12-22T08:47:11.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.088+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b5006a430 msgr2=0x7f5b5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:11.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.088+0000 7f5b6b6ec640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b5006a430 0x7f5b5006c8f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5b54000f80 tx=0x7f5b54009040 comp rx=0 tx=0).stop 2023-12-22T08:47:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.088+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/2635199329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b640710a0 msgr2=0x7f5b64071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.088+0000 7f5b6b6ec640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b640710a0 0x7f5b64071520 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f5b6406e350 tx=0x7f5b5c00eb90 comp rx=0 tx=0).stop 2023-12-22T08:47:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.088+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/2635199329 shutdown_connections 2023-12-22T08:47:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.088+0000 7f5b6b6ec640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b5006a430 0x7f5b5006c8f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.088+0000 7f5b6b6ec640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b640710a0 0x7f5b64071520 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.088+0000 7f5b6b6ec640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b6415f650 0x7f5b640cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.088+0000 7f5b6b6ec640 1 --2- 172.21.15.38:0/2635199329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b4c0047c0 0x7f5b641540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.088+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/2635199329 >> 172.21.15.38:0/2635199329 conn(0x7f5b640cf070 msgr2=0x7f5b6406d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.088+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/2635199329 shutdown_connections 2023-12-22T08:47:11.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.088+0000 7f5b6b6ec640 1 -- 172.21.15.38:0/2635199329 wait complete. 2023-12-22T08:47:11.110 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:11.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.330+0000 7f2f11fc4640 1 Processor -- start 2023-12-22T08:47:11.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.331+0000 7f2f11fc4640 1 -- start start 2023-12-22T08:47:11.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.332+0000 7f2f11fc4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2f0c15b420 0x7f2f0c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:11.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.332+0000 7f2f11fc4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2f0c0a44a0 0x7f2f0c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:11.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.332+0000 7f2f11fc4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c0cdae0 con 0x7f2f0c070e30 2023-12-22T08:47:11.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.332+0000 7f2f11fc4640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c06dec0 con 0x7f2f0c0a44a0 2023-12-22T08:47:11.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.332+0000 7f2f11fc4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c071250 con 0x7f2f0c15b420 2023-12-22T08:47:11.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.332+0000 7f2f0bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2f0c0a44a0 0x7f2f0c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:11.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.332+0000 7f2f117c3640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2f0c070e30 0x7f2f0c06f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51468/0 (socket says 172.21.15.38:51468) 2023-12-22T08:47:11.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.332+0000 7f2f117c3640 1 -- 172.21.15.38:0/3037515126 learned_addr learned my addr 172.21.15.38:0/3037515126 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:11.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.333+0000 7f2f10fc2640 1 --2- 172.21.15.38:0/3037515126 >> v2:172.21.15.89:3300/0 conn(0x7f2f0c15b420 0x7f2f0c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:11.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.333+0000 7f2f0bfff640 1 -- 172.21.15.38:0/3037515126 >> v2:172.21.15.89:3300/0 conn(0x7f2f0c15b420 msgr2=0x7f2f0c06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:11.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.333+0000 7f2f0bfff640 1 --2- 172.21.15.38:0/3037515126 >> v2:172.21.15.89:3300/0 conn(0x7f2f0c15b420 0x7f2f0c06d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.333+0000 7f2f0bfff640 1 -- 172.21.15.38:0/3037515126 >> v1:172.21.15.38:6789/0 conn(0x7f2f0c070e30 legacy=0x7f2f0c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:11.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.333+0000 7f2f0bfff640 1 -- 172.21.15.38:0/3037515126 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c15b800 con 0x7f2f0c0a44a0 2023-12-22T08:47:11.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.333+0000 7f2f0b7fe640 1 -- 172.21.15.38:0/3037515126 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823027694 0 0) 0x7f2f0c0cdae0 con 0x7f2f0c070e30 2023-12-22T08:47:11.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.334+0000 7f2f0bfff640 1 --2- 172.21.15.38:0/3037515126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f0c0a44a0 0x7f2f0c0708f0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0613e0 tx=0x7f2ef802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccff17abcb1318b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:11.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.335+0000 7f2f0b7fe640 1 -- 172.21.15.38:0/3037515126 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8031830 con 0x7f2f0c0a44a0 2023-12-22T08:47:11.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.335+0000 7f2f0b7fe640 1 -- 172.21.15.38:0/3037515126 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef8031990 con 0x7f2f0c0a44a0 2023-12-22T08:47:11.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.335+0000 7f2f0b7fe640 1 -- 172.21.15.38:0/3037515126 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8031d20 con 0x7f2f0c0a44a0 2023-12-22T08:47:11.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.335+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3037515126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f0c0a44a0 msgr2=0x7f2f0c0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:11.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.335+0000 7f2f11fc4640 1 --2- 172.21.15.38:0/3037515126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f0c0a44a0 0x7f2f0c0708f0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0613e0 tx=0x7f2ef802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.335+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3037515126 shutdown_connections 2023-12-22T08:47:11.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.335+0000 7f2f11fc4640 1 --2- 172.21.15.38:0/3037515126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f0c0a44a0 0x7f2f0c0708f0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.335+0000 7f2f11fc4640 1 --2- 172.21.15.38:0/3037515126 >> v2:172.21.15.89:3300/0 conn(0x7f2f0c15b420 0x7f2f0c06d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.335+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3037515126 >> 172.21.15.38:0/3037515126 conn(0x7f2f0c0b1f70 msgr2=0x7f2f0c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:11.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.336+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3037515126 shutdown_connections 2023-12-22T08:47:11.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.336+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3037515126 wait complete. 2023-12-22T08:47:11.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.337+0000 7f2f11fc4640 1 Processor -- start 2023-12-22T08:47:11.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.337+0000 7f2f11fc4640 1 -- start start 2023-12-22T08:47:11.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.338+0000 7f2f11fc4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f0c070e30 0x7f2f0c14bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:11.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.338+0000 7f2f11fc4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0c0a44a0 0x7f2f0c151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:11.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.338+0000 7f2f11fc4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c15b420 0x7f2f0c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:11.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.338+0000 7f2f11fc4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c14f180 con 0x7f2f0c070e30 2023-12-22T08:47:11.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.338+0000 7f2f11fc4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c14ffe0 con 0x7f2f0c15b420 2023-12-22T08:47:11.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.338+0000 7f2f11fc4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c14c240 con 0x7f2f0c0a44a0 2023-12-22T08:47:11.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.339+0000 7f2f10fc2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f0c070e30 0x7f2f0c14bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:11.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.339+0000 7f2f10fc2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f0c070e30 0x7f2f0c14bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40910/0 (socket says 172.21.15.38:40910) 2023-12-22T08:47:11.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.339+0000 7f2f10fc2640 1 -- 172.21.15.38:0/3041389813 learned_addr learned my addr 172.21.15.38:0/3041389813 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:11.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.339+0000 7f2f117c3640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c15b420 0x7f2f0c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:11.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.339+0000 7f2f10fc2640 1 -- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0c0a44a0 msgr2=0x7f2f0c151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:11.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.339+0000 7f2f10fc2640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0c0a44a0 0x7f2f0c151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.339+0000 7f2f10fc2640 1 -- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c15b420 msgr2=0x7f2f0c0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:11.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.339+0000 7f2f10fc2640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c15b420 0x7f2f0c0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.339+0000 7f2f10fc2640 1 -- 172.21.15.38:0/3041389813 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef8009400 con 0x7f2f0c070e30 2023-12-22T08:47:11.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.339+0000 7f2f117c3640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c15b420 0x7f2f0c0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:11.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.340+0000 7f2f10fc2640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f0c070e30 0x7f2f0c14bd00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000d860 tx=0x7f2f0000dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:11.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.340+0000 7f2f097fa640 1 -- 172.21.15.38:0/3041389813 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000de50 con 0x7f2f0c070e30 2023-12-22T08:47:11.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.340+0000 7f2f097fa640 1 -- 172.21.15.38:0/3041389813 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0000b8d0 con 0x7f2f0c070e30 2023-12-22T08:47:11.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.340+0000 7f2f097fa640 1 -- 172.21.15.38:0/3041389813 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000bc60 con 0x7f2f0c070e30 2023-12-22T08:47:11.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.340+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3041389813 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c14f3d0 con 0x7f2f0c070e30 2023-12-22T08:47:11.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.340+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3041389813 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c14f990 con 0x7f2f0c070e30 2023-12-22T08:47:11.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.341+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3041389813 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c061910 con 0x7f2f0c070e30 2023-12-22T08:47:11.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.342+0000 7f2f097fa640 1 -- 172.21.15.38:0/3041389813 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2f0001e460 con 0x7f2f0c070e30 2023-12-22T08:47:11.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.343+0000 7f2f097fa640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ef006a460 0x7f2ef006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:11.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.343+0000 7f2f097fa640 1 -- 172.21.15.38:0/3041389813 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f00088e70 con 0x7f2f0c070e30 2023-12-22T08:47:11.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.344+0000 7f2f0bfff640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ef006a460 0x7f2ef006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:11.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.345+0000 7f2f0bfff640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ef006a460 0x7f2ef006c920 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8036000 tx=0x7f2ef8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:11.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.348+0000 7f2f097fa640 1 -- 172.21.15.38:0/3041389813 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2f00054460 con 0x7f2f0c070e30 2023-12-22T08:47:11.476 INFO:tasks.ceph.mds.c.smithi038.stderr:2023-12-22T08:47:11.474+0000 7fe6a0f30640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:47:11.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.542+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3041389813 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f0c0cb5c0 con 0x7f2f0c070e30 2023-12-22T08:47:11.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.545+0000 7f2f097fa640 1 -- 172.21.15.38:0/3041389813 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+16004 (secure 0 0 0) 0x7f2f00057a80 con 0x7f2f0c070e30 2023-12-22T08:47:11.547 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:11.547 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":127,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:08.040255+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:04.687287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:06.061571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:11.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.548+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ef006a460 msgr2=0x7f2ef006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:11.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.548+0000 7f2f11fc4640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ef006a460 0x7f2ef006c920 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8036000 tx=0x7f2ef8030000 comp rx=0 tx=0).stop 2023-12-22T08:47:11.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.548+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3041389813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f0c070e30 msgr2=0x7f2f0c14bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:11.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.548+0000 7f2f11fc4640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f0c070e30 0x7f2f0c14bd00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000d860 tx=0x7f2f0000dd20 comp rx=0 tx=0).stop 2023-12-22T08:47:11.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.548+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3041389813 shutdown_connections 2023-12-22T08:47:11.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.548+0000 7f2f11fc4640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f0c15b420 0x7f2f0c0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.548+0000 7f2f11fc4640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0c0a44a0 0x7f2f0c151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.548+0000 7f2f11fc4640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ef006a460 0x7f2ef006c920 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.548+0000 7f2f11fc4640 1 --2- 172.21.15.38:0/3041389813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f0c070e30 0x7f2f0c14bd00 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.548+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3041389813 >> 172.21.15.38:0/3041389813 conn(0x7f2f0c0b1f70 msgr2=0x7f2f0c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:11.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.548+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3041389813 shutdown_connections 2023-12-22T08:47:11.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.548+0000 7f2f11fc4640 1 -- 172.21.15.38:0/3041389813 wait complete. 2023-12-22T08:47:11.567 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T08:47:11.567 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:47:11.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.781+0000 7f6dc8339640 1 Processor -- start 2023-12-22T08:47:11.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.781+0000 7f6dc8339640 1 -- start start 2023-12-22T08:47:11.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.783+0000 7f6dc8339640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6dc015d470 0x7f6dc00b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:11.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.783+0000 7f6dc8339640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6dc015d850 0x7f6dc00ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:11.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.783+0000 7f6dc8339640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc00ac8e0 con 0x7f6dc0071ea0 2023-12-22T08:47:11.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.783+0000 7f6dc8339640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc00b4550 con 0x7f6dc015d470 2023-12-22T08:47:11.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.783+0000 7f6dc8339640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc00b4940 con 0x7f6dc015d850 2023-12-22T08:47:11.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.783+0000 7f6dc60d5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6dc015d470 0x7f6dc00b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:11.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.783+0000 7f6dc60d5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6dc015d470 0x7f6dc00b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40916/0 (socket says 172.21.15.38:40916) 2023-12-22T08:47:11.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.783+0000 7f6dc60d5640 1 -- 172.21.15.38:0/4198158737 learned_addr learned my addr 172.21.15.38:0/4198158737 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:11.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.784+0000 7f6dc60d5640 1 -- 172.21.15.38:0/4198158737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6dc015d850 msgr2=0x7f6dc00ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:11.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.784+0000 7f6dc60d5640 1 --2- 172.21.15.38:0/4198158737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6dc015d850 0x7f6dc00ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.784+0000 7f6dc60d5640 1 -- 172.21.15.38:0/4198158737 >> v1:172.21.15.89:6789/0 conn(0x7f6dc0071ea0 legacy=0x7f6dc00b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:11.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.784+0000 7f6dc60d5640 1 -- 172.21.15.38:0/4198158737 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc00b4c20 con 0x7f6dc015d470 2023-12-22T08:47:11.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.785+0000 7f6dc60d5640 1 --2- 172.21.15.38:0/4198158737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dc015d470 0x7f6dc00b4010 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009870 tx=0x7f6dbc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f29678bb212b35 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:11.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.785+0000 7f6dc50d3640 1 -- 172.21.15.38:0/4198158737 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc031640 con 0x7f6dc015d470 2023-12-22T08:47:11.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.786+0000 7f6dc50d3640 1 -- 172.21.15.38:0/4198158737 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc0317a0 con 0x7f6dc015d470 2023-12-22T08:47:11.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.786+0000 7f6dc50d3640 1 -- 172.21.15.38:0/4198158737 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc031b30 con 0x7f6dc015d470 2023-12-22T08:47:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.786+0000 7f6dc8339640 1 -- 172.21.15.38:0/4198158737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dc015d470 msgr2=0x7f6dc00b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.786+0000 7f6dc8339640 1 --2- 172.21.15.38:0/4198158737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dc015d470 0x7f6dc00b4010 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009870 tx=0x7f6dbc02b8f0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.786+0000 7f6dc8339640 1 -- 172.21.15.38:0/4198158737 shutdown_connections 2023-12-22T08:47:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.786+0000 7f6dc8339640 1 --2- 172.21.15.38:0/4198158737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6dc015d850 0x7f6dc00ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.786+0000 7f6dc8339640 1 --2- 172.21.15.38:0/4198158737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dc015d470 0x7f6dc00b4010 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.786+0000 7f6dc8339640 1 -- 172.21.15.38:0/4198158737 >> 172.21.15.38:0/4198158737 conn(0x7f6dc00cf070 msgr2=0x7f6dc00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.787+0000 7f6dc8339640 1 -- 172.21.15.38:0/4198158737 shutdown_connections 2023-12-22T08:47:11.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.787+0000 7f6dc8339640 1 -- 172.21.15.38:0/4198158737 wait complete. 2023-12-22T08:47:11.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.788+0000 7f6dc8339640 1 Processor -- start 2023-12-22T08:47:11.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.788+0000 7f6dc8339640 1 -- start start 2023-12-22T08:47:11.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.789+0000 7f6dc8339640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dc0071ea0 0x7f6dc0154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:11.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.789+0000 7f6dc8339640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6dc015d470 0x7f6dc00cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:11.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.789+0000 7f6dc8339640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6dc015d850 0x7f6dc0151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:11.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.789+0000 7f6dc8339640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc01548a0 con 0x7f6dc0071ea0 2023-12-22T08:47:11.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.789+0000 7f6dc8339640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc01525e0 con 0x7f6dc015d850 2023-12-22T08:47:11.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.789+0000 7f6dc8339640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc00cce80 con 0x7f6dc015d470 2023-12-22T08:47:11.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.790+0000 7f6dc60d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dc0071ea0 0x7f6dc0154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:11.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.790+0000 7f6dc60d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dc0071ea0 0x7f6dc0154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40918/0 (socket says 172.21.15.38:40918) 2023-12-22T08:47:11.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.790+0000 7f6dc60d5640 1 -- 172.21.15.38:0/3929815186 learned_addr learned my addr 172.21.15.38:0/3929815186 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:11.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.790+0000 7f6dc68d6640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6dc015d850 0x7f6dc0151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:11.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.790+0000 7f6dc58d4640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6dc015d470 0x7f6dc00cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:11.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.790+0000 7f6dc60d5640 1 -- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6dc015d470 msgr2=0x7f6dc00cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:11.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.790+0000 7f6dc60d5640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6dc015d470 0x7f6dc00cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.790+0000 7f6dc60d5640 1 -- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6dc015d850 msgr2=0x7f6dc0151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:11.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.790+0000 7f6dc60d5640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6dc015d850 0x7f6dc0151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:11.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.790+0000 7f6dc60d5640 1 -- 172.21.15.38:0/3929815186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0094d0 con 0x7f6dc0071ea0 2023-12-22T08:47:11.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.790+0000 7f6dc68d6640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6dc015d850 0x7f6dc0151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:11.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.791+0000 7f6dc60d5640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dc0071ea0 0x7f6dc0154360 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009870 tx=0x7f6dbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:11.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.791+0000 7f6db6ffd640 1 -- 172.21.15.38:0/3929815186 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc03ac60 con 0x7f6dc0071ea0 2023-12-22T08:47:11.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.791+0000 7f6db6ffd640 1 -- 172.21.15.38:0/3929815186 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc03adc0 con 0x7f6dc0071ea0 2023-12-22T08:47:11.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.791+0000 7f6db6ffd640 1 -- 172.21.15.38:0/3929815186 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc044630 con 0x7f6dc0071ea0 2023-12-22T08:47:11.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.791+0000 7f6dc8339640 1 -- 172.21.15.38:0/3929815186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc015eeb0 con 0x7f6dc0071ea0 2023-12-22T08:47:11.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.791+0000 7f6dc8339640 1 -- 172.21.15.38:0/3929815186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc0152b10 con 0x7f6dc0071ea0 2023-12-22T08:47:11.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.792+0000 7f6dc8339640 1 -- 172.21.15.38:0/3929815186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc0061910 con 0x7f6dc0071ea0 2023-12-22T08:47:11.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.793+0000 7f6db6ffd640 1 -- 172.21.15.38:0/3929815186 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6dbc02f050 con 0x7f6dc0071ea0 2023-12-22T08:47:11.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.795+0000 7f6db6ffd640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6da406a460 0x7f6da406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:11.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.795+0000 7f6db6ffd640 1 -- 172.21.15.38:0/3929815186 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dbc0aa8f0 con 0x7f6dc0071ea0 2023-12-22T08:47:11.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.795+0000 7f6dc58d4640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6da406a460 0x7f6da406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:11.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.797+0000 7f6dc58d4640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6da406a460 0x7f6da406c920 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6dc015f650 tx=0x7f6db0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:11.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.799+0000 7f6db6ffd640 1 -- 172.21.15.38:0/3929815186 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6dbc075ed0 con 0x7f6dc0071ea0 2023-12-22T08:47:11.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:11.989+0000 7f6dc8339640 1 -- 172.21.15.38:0/3929815186 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6dc00ace10 con 0x7f6da406a460 2023-12-22T08:47:12.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.014+0000 7f6db6ffd640 1 -- 172.21.15.38:0/3929815186 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283100 (secure 0 0 0) 0x7f6db000bdc0 con 0x7f6da406a460 2023-12-22T08:47:12.019 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:12.021 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:47:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.020+0000 7f6dc8339640 1 -- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6da406a460 msgr2=0x7f6da406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.020+0000 7f6dc8339640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6da406a460 0x7f6da406c920 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6dc015f650 tx=0x7f6db0008040 comp rx=0 tx=0).stop 2023-12-22T08:47:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.020+0000 7f6dc8339640 1 -- 172.21.15.38:0/3929815186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dc0071ea0 msgr2=0x7f6dc0154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.020+0000 7f6dc8339640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dc0071ea0 0x7f6dc0154360 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009870 tx=0x7f6dbc0046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.020+0000 7f6dc8339640 1 -- 172.21.15.38:0/3929815186 shutdown_connections 2023-12-22T08:47:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.020+0000 7f6dc8339640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6dc015d850 0x7f6dc0151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.020+0000 7f6dc8339640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6dc015d470 0x7f6dc00cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.020+0000 7f6dc8339640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6da406a460 0x7f6da406c920 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.020+0000 7f6dc8339640 1 --2- 172.21.15.38:0/3929815186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6dc0071ea0 0x7f6dc0154360 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.020+0000 7f6dc8339640 1 -- 172.21.15.38:0/3929815186 >> 172.21.15.38:0/3929815186 conn(0x7f6dc00cf070 msgr2=0x7f6dc01579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.020+0000 7f6dc8339640 1 -- 172.21.15.38:0/3929815186 shutdown_connections 2023-12-22T08:47:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.020+0000 7f6dc8339640 1 -- 172.21.15.38:0/3929815186 wait complete. 2023-12-22T08:47:12.042 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2023-12-22T08:47:10.513489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6596,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555903,"statfs":{"total":1600000000,"available":1593245567,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.993903"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047778+0000","last_change":"2023-12-22T08:47:07.062786+0000","last_active":"2023-12-22T08:47:08.047778+0000","last_peered":"2023-12-22T08:47:08.047778+0000","last_clean":"2023-12-22T08:47:08.047778+0000","last_became_active":"2023-12-22T08:47:07.061375+0000","last_became_peered":"2023-12-22T08:47:07.061375+0000","last_unstale":"2023-12-22T08:47:08.047778+0000","last_undegraded":"2023-12-22T08:47:08.047778+0000","last_fullsized":"2023-12-22T08:47:08.047778+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:04:37.592731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047697+0000","last_change":"2023-12-22T08:47:07.067559+0000","last_active":"2023-12-22T08:47:08.047697+0000","last_peered":"2023-12-22T08:47:08.047697+0000","last_clean":"2023-12-22T08:47:08.047697+0000","last_became_active":"2023-12-22T08:47:07.066725+0000","last_became_peered":"2023-12-22T08:47:07.066725+0000","last_unstale":"2023-12-22T08:47:08.047697+0000","last_undegraded":"2023-12-22T08:47:08.047697+0000","last_fullsized":"2023-12-22T08:47:08.047697+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:24:49.917274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305200+0000","last_change":"2023-12-22T08:47:07.069899+0000","last_active":"2023-12-22T08:47:08.305200+0000","last_peered":"2023-12-22T08:47:08.305200+0000","last_clean":"2023-12-22T08:47:08.305200+0000","last_became_active":"2023-12-22T08:47:07.068657+0000","last_became_peered":"2023-12-22T08:47:07.068657+0000","last_unstale":"2023-12-22T08:47:08.305200+0000","last_undegraded":"2023-12-22T08:47:08.305200+0000","last_fullsized":"2023-12-22T08:47:08.305200+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:31:19.386328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047810+0000","last_change":"2023-12-22T08:47:07.075128+0000","last_active":"2023-12-22T08:47:08.047810+0000","last_peered":"2023-12-22T08:47:08.047810+0000","last_clean":"2023-12-22T08:47:08.047810+0000","last_became_active":"2023-12-22T08:47:07.074873+0000","last_became_peered":"2023-12-22T08:47:07.074873+0000","last_unstale":"2023-12-22T08:47:08.047810+0000","last_undegraded":"2023-12-22T08:47:08.047810+0000","last_fullsized":"2023-12-22T08:47:08.047810+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:03:30.291361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050994+0000","last_change":"2023-12-22T08:47:07.055373+0000","last_active":"2023-12-22T08:47:08.050994+0000","last_peered":"2023-12-22T08:47:08.050994+0000","last_clean":"2023-12-22T08:47:08.050994+0000","last_became_active":"2023-12-22T08:47:07.055107+0000","last_became_peered":"2023-12-22T08:47:07.055107+0000","last_unstale":"2023-12-22T08:47:08.050994+0000","last_undegraded":"2023-12-22T08:47:08.050994+0000","last_fullsized":"2023-12-22T08:47:08.050994+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:44.532290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050653+0000","last_change":"2023-12-22T08:47:07.063641+0000","last_active":"2023-12-22T08:47:08.050653+0000","last_peered":"2023-12-22T08:47:08.050653+0000","last_clean":"2023-12-22T08:47:08.050653+0000","last_became_active":"2023-12-22T08:47:07.062799+0000","last_became_peered":"2023-12-22T08:47:07.062799+0000","last_unstale":"2023-12-22T08:47:08.050653+0000","last_undegraded":"2023-12-22T08:47:08.050653+0000","last_fullsized":"2023-12-22T08:47:08.050653+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:39:16.057923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050571+0000","last_change":"2023-12-22T08:47:07.059439+0000","last_active":"2023-12-22T08:47:08.050571+0000","last_peered":"2023-12-22T08:47:08.050571+0000","last_clean":"2023-12-22T08:47:08.050571+0000","last_became_active":"2023-12-22T08:47:07.059166+0000","last_became_peered":"2023-12-22T08:47:07.059166+0000","last_unstale":"2023-12-22T08:47:08.050571+0000","last_undegraded":"2023-12-22T08:47:08.050571+0000","last_fullsized":"2023-12-22T08:47:08.050571+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:51:50.669403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305479+0000","last_change":"2023-12-22T08:47:07.070172+0000","last_active":"2023-12-22T08:47:08.305479+0000","last_peered":"2023-12-22T08:47:08.305479+0000","last_clean":"2023-12-22T08:47:08.305479+0000","last_became_active":"2023-12-22T08:47:07.069671+0000","last_became_peered":"2023-12-22T08:47:07.069671+0000","last_unstale":"2023-12-22T08:47:08.305479+0000","last_undegraded":"2023-12-22T08:47:08.305479+0000","last_fullsized":"2023-12-22T08:47:08.305479+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:35:43.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.049880+0000","last_change":"2023-12-22T08:47:07.066670+0000","last_active":"2023-12-22T08:47:08.049880+0000","last_peered":"2023-12-22T08:47:08.049880+0000","last_clean":"2023-12-22T08:47:08.049880+0000","last_became_active":"2023-12-22T08:47:07.065840+0000","last_became_peered":"2023-12-22T08:47:07.065840+0000","last_unstale":"2023-12-22T08:47:08.049880+0000","last_undegraded":"2023-12-22T08:47:08.049880+0000","last_fullsized":"2023-12-22T08:47:08.049880+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:01:16.551578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.304305+0000","last_change":"2023-12-22T08:47:07.070923+0000","last_active":"2023-12-22T08:47:08.304305+0000","last_peered":"2023-12-22T08:47:08.304305+0000","last_clean":"2023-12-22T08:47:08.304305+0000","last_became_active":"2023-12-22T08:47:07.070686+0000","last_became_peered":"2023-12-22T08:47:07.070686+0000","last_unstale":"2023-12-22T08:47:08.304305+0000","last_undegraded":"2023-12-22T08:47:08.304305+0000","last_fullsized":"2023-12-22T08:47:08.304305+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:37.116288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050768+0000","last_change":"2023-12-22T08:47:07.063508+0000","last_active":"2023-12-22T08:47:08.050768+0000","last_peered":"2023-12-22T08:47:08.050768+0000","last_clean":"2023-12-22T08:47:08.050768+0000","last_became_active":"2023-12-22T08:47:07.062505+0000","last_became_peered":"2023-12-22T08:47:07.062505+0000","last_unstale":"2023-12-22T08:47:08.050768+0000","last_undegraded":"2023-12-22T08:47:08.050768+0000","last_fullsized":"2023-12-22T08:47:08.050768+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:30.761903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047473+0000","last_change":"2023-12-22T08:47:07.060915+0000","last_active":"2023-12-22T08:47:08.047473+0000","last_peered":"2023-12-22T08:47:08.047473+0000","last_clean":"2023-12-22T08:47:08.047473+0000","last_became_active":"2023-12-22T08:47:07.060190+0000","last_became_peered":"2023-12-22T08:47:07.060190+0000","last_unstale":"2023-12-22T08:47:08.047473+0000","last_undegraded":"2023-12-22T08:47:08.047473+0000","last_fullsized":"2023-12-22T08:47:08.047473+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:04:37.592731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.135894+0000","last_change":"2023-12-22T08:47:07.058609+0000","last_active":"2023-12-22T08:47:08.135894+0000","last_peered":"2023-12-22T08:47:08.135894+0000","last_clean":"2023-12-22T08:47:08.135894+0000","last_became_active":"2023-12-22T08:47:07.058039+0000","last_became_peered":"2023-12-22T08:47:07.058039+0000","last_unstale":"2023-12-22T08:47:08.135894+0000","last_undegraded":"2023-12-22T08:47:08.135894+0000","last_fullsized":"2023-12-22T08:47:08.135894+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:42:48.216242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048108+0000","last_change":"2023-12-22T08:47:07.068178+0000","last_active":"2023-12-22T08:47:08.048108+0000","last_peered":"2023-12-22T08:47:08.048108+0000","last_clean":"2023-12-22T08:47:08.048108+0000","last_became_active":"2023-12-22T08:47:07.067347+0000","last_became_peered":"2023-12-22T08:47:07.067347+0000","last_unstale":"2023-12-22T08:47:08.048108+0000","last_undegraded":"2023-12-22T08:47:08.048108+0000","last_fullsized":"2023-12-22T08:47:08.048108+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:41.877264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048508+0000","last_change":"2023-12-22T08:47:07.074340+0000","last_active":"2023-12-22T08:47:08.048508+0000","last_peered":"2023-12-22T08:47:08.048508+0000","last_clean":"2023-12-22T08:47:08.048508+0000","last_became_active":"2023-12-22T08:47:07.073544+0000","last_became_peered":"2023-12-22T08:47:07.073544+0000","last_unstale":"2023-12-22T08:47:08.048508+0000","last_undegraded":"2023-12-22T08:47:08.048508+0000","last_fullsized":"2023-12-22T08:47:08.048508+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:49:11.191400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050892+0000","last_change":"2023-12-22T08:47:07.063787+0000","last_active":"2023-12-22T08:47:08.050892+0000","last_peered":"2023-12-22T08:47:08.050892+0000","last_clean":"2023-12-22T08:47:08.050892+0000","last_became_active":"2023-12-22T08:47:07.063303+0000","last_became_peered":"2023-12-22T08:47:07.063303+0000","last_unstale":"2023-12-22T08:47:08.050892+0000","last_undegraded":"2023-12-22T08:47:08.050892+0000","last_fullsized":"2023-12-22T08:47:08.050892+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:25:21.999245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305625+0000","last_change":"2023-12-22T08:47:07.070280+0000","last_active":"2023-12-22T08:47:08.305625+0000","last_peered":"2023-12-22T08:47:08.305625+0000","last_clean":"2023-12-22T08:47:08.305625+0000","last_became_active":"2023-12-22T08:47:07.070047+0000","last_became_peered":"2023-12-22T08:47:07.070047+0000","last_unstale":"2023-12-22T08:47:08.305625+0000","last_undegraded":"2023-12-22T08:47:08.305625+0000","last_fullsized":"2023-12-22T08:47:08.305625+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:05:29.406949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047838+0000","last_change":"2023-12-22T08:47:07.069199+0000","last_active":"2023-12-22T08:47:08.047838+0000","last_peered":"2023-12-22T08:47:08.047838+0000","last_clean":"2023-12-22T08:47:08.047838+0000","last_became_active":"2023-12-22T08:47:07.068957+0000","last_became_peered":"2023-12-22T08:47:07.068957+0000","last_unstale":"2023-12-22T08:47:08.047838+0000","last_undegraded":"2023-12-22T08:47:08.047838+0000","last_fullsized":"2023-12-22T08:47:08.047838+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:33.526112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305459+0000","last_change":"2023-12-22T08:47:07.076956+0000","last_active":"2023-12-22T08:47:08.305459+0000","last_peered":"2023-12-22T08:47:08.305459+0000","last_clean":"2023-12-22T08:47:08.305459+0000","last_became_active":"2023-12-22T08:47:07.076272+0000","last_became_peered":"2023-12-22T08:47:07.076272+0000","last_unstale":"2023-12-22T08:47:08.305459+0000","last_undegraded":"2023-12-22T08:47:08.305459+0000","last_fullsized":"2023-12-22T08:47:08.305459+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:59:39.879275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.046927+0000","last_change":"2023-12-22T08:47:07.071512+0000","last_active":"2023-12-22T08:47:08.046927+0000","last_peered":"2023-12-22T08:47:08.046927+0000","last_clean":"2023-12-22T08:47:08.046927+0000","last_became_active":"2023-12-22T08:47:07.071246+0000","last_became_peered":"2023-12-22T08:47:07.071246+0000","last_unstale":"2023-12-22T08:47:08.046927+0000","last_undegraded":"2023-12-22T08:47:08.046927+0000","last_fullsized":"2023-12-22T08:47:08.046927+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:37:23.550550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.307129+0000","last_change":"2023-12-22T08:47:07.070984+0000","last_active":"2023-12-22T08:47:08.307129+0000","last_peered":"2023-12-22T08:47:08.307129+0000","last_clean":"2023-12-22T08:47:08.307129+0000","last_became_active":"2023-12-22T08:47:07.067968+0000","last_became_peered":"2023-12-22T08:47:07.067968+0000","last_unstale":"2023-12-22T08:47:08.307129+0000","last_undegraded":"2023-12-22T08:47:08.307129+0000","last_fullsized":"2023-12-22T08:47:08.307129+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:54:41.176967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305735+0000","last_change":"2023-12-22T08:47:07.068990+0000","last_active":"2023-12-22T08:47:08.305735+0000","last_peered":"2023-12-22T08:47:08.305735+0000","last_clean":"2023-12-22T08:47:08.305735+0000","last_became_active":"2023-12-22T08:47:07.068718+0000","last_became_peered":"2023-12-22T08:47:07.068718+0000","last_unstale":"2023-12-22T08:47:08.305735+0000","last_undegraded":"2023-12-22T08:47:08.305735+0000","last_fullsized":"2023-12-22T08:47:08.305735+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:10.578674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048197+0000","last_change":"2023-12-22T08:47:07.065581+0000","last_active":"2023-12-22T08:47:08.048197+0000","last_peered":"2023-12-22T08:47:08.048197+0000","last_clean":"2023-12-22T08:47:08.048197+0000","last_became_active":"2023-12-22T08:47:07.065325+0000","last_became_peered":"2023-12-22T08:47:07.065325+0000","last_unstale":"2023-12-22T08:47:08.048197+0000","last_undegraded":"2023-12-22T08:47:08.048197+0000","last_fullsized":"2023-12-22T08:47:08.048197+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:18:56.111546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305437+0000","last_change":"2023-12-22T08:47:07.070953+0000","last_active":"2023-12-22T08:47:08.305437+0000","last_peered":"2023-12-22T08:47:08.305437+0000","last_clean":"2023-12-22T08:47:08.305437+0000","last_became_active":"2023-12-22T08:47:07.070795+0000","last_became_peered":"2023-12-22T08:47:07.070795+0000","last_unstale":"2023-12-22T08:47:08.305437+0000","last_undegraded":"2023-12-22T08:47:08.305437+0000","last_fullsized":"2023-12-22T08:47:08.305437+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:59:39.879275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.304099+0000","last_change":"2023-12-22T08:47:07.068322+0000","last_active":"2023-12-22T08:47:08.304099+0000","last_peered":"2023-12-22T08:47:08.304099+0000","last_clean":"2023-12-22T08:47:08.304099+0000","last_became_active":"2023-12-22T08:47:07.068096+0000","last_became_peered":"2023-12-22T08:47:07.068096+0000","last_unstale":"2023-12-22T08:47:08.304099+0000","last_undegraded":"2023-12-22T08:47:08.304099+0000","last_fullsized":"2023-12-22T08:47:08.304099+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:37:23.550550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.136228+0000","last_change":"2023-12-22T08:47:07.064979+0000","last_active":"2023-12-22T08:47:08.136228+0000","last_peered":"2023-12-22T08:47:08.136228+0000","last_clean":"2023-12-22T08:47:08.136228+0000","last_became_active":"2023-12-22T08:47:07.063994+0000","last_became_peered":"2023-12-22T08:47:07.063994+0000","last_unstale":"2023-12-22T08:47:08.136228+0000","last_undegraded":"2023-12-22T08:47:08.136228+0000","last_fullsized":"2023-12-22T08:47:08.136228+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:45.977176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306258+0000","last_change":"2023-12-22T08:47:07.066934+0000","last_active":"2023-12-22T08:47:08.306258+0000","last_peered":"2023-12-22T08:47:08.306258+0000","last_clean":"2023-12-22T08:47:08.306258+0000","last_became_active":"2023-12-22T08:47:07.066732+0000","last_became_peered":"2023-12-22T08:47:07.066732+0000","last_unstale":"2023-12-22T08:47:08.306258+0000","last_undegraded":"2023-12-22T08:47:08.306258+0000","last_fullsized":"2023-12-22T08:47:08.306258+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:10.578674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305715+0000","last_change":"2023-12-22T08:47:07.068856+0000","last_active":"2023-12-22T08:47:08.305715+0000","last_peered":"2023-12-22T08:47:08.305715+0000","last_clean":"2023-12-22T08:47:08.305715+0000","last_became_active":"2023-12-22T08:47:07.068637+0000","last_became_peered":"2023-12-22T08:47:07.068637+0000","last_unstale":"2023-12-22T08:47:08.305715+0000","last_undegraded":"2023-12-22T08:47:08.305715+0000","last_fullsized":"2023-12-22T08:47:08.305715+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:31:19.386328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.136034+0000","last_change":"2023-12-22T08:47:07.069111+0000","last_active":"2023-12-22T08:47:08.136034+0000","last_peered":"2023-12-22T08:47:08.136034+0000","last_clean":"2023-12-22T08:47:08.136034+0000","last_became_active":"2023-12-22T08:47:07.068725+0000","last_became_peered":"2023-12-22T08:47:07.068725+0000","last_unstale":"2023-12-22T08:47:08.136034+0000","last_undegraded":"2023-12-22T08:47:08.136034+0000","last_fullsized":"2023-12-22T08:47:08.136034+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:38.082746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.135937+0000","last_change":"2023-12-22T08:47:07.072183+0000","last_active":"2023-12-22T08:47:08.135937+0000","last_peered":"2023-12-22T08:47:08.135937+0000","last_clean":"2023-12-22T08:47:08.135937+0000","last_became_active":"2023-12-22T08:47:07.071832+0000","last_became_peered":"2023-12-22T08:47:07.071832+0000","last_unstale":"2023-12-22T08:47:08.135937+0000","last_undegraded":"2023-12-22T08:47:08.135937+0000","last_fullsized":"2023-12-22T08:47:08.135937+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:25:33.453738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.307356+0000","last_change":"2023-12-22T08:47:07.071192+0000","last_active":"2023-12-22T08:47:08.307356+0000","last_peered":"2023-12-22T08:47:08.307356+0000","last_clean":"2023-12-22T08:47:08.307356+0000","last_became_active":"2023-12-22T08:47:07.068224+0000","last_became_peered":"2023-12-22T08:47:07.068224+0000","last_unstale":"2023-12-22T08:47:08.307356+0000","last_undegraded":"2023-12-22T08:47:08.307356+0000","last_fullsized":"2023-12-22T08:47:08.307356+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:06.024340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048384+0000","last_change":"2023-12-22T08:47:07.075962+0000","last_active":"2023-12-22T08:47:08.048384+0000","last_peered":"2023-12-22T08:47:08.048384+0000","last_clean":"2023-12-22T08:47:08.048384+0000","last_became_active":"2023-12-22T08:47:07.075369+0000","last_became_peered":"2023-12-22T08:47:07.075369+0000","last_unstale":"2023-12-22T08:47:08.048384+0000","last_undegraded":"2023-12-22T08:47:08.048384+0000","last_fullsized":"2023-12-22T08:47:08.048384+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:16.806099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305705+0000","last_change":"2023-12-22T08:47:07.068777+0000","last_active":"2023-12-22T08:47:08.305705+0000","last_peered":"2023-12-22T08:47:08.305705+0000","last_clean":"2023-12-22T08:47:08.305705+0000","last_became_active":"2023-12-22T08:47:07.066487+0000","last_became_peered":"2023-12-22T08:47:07.066487+0000","last_unstale":"2023-12-22T08:47:08.305705+0000","last_undegraded":"2023-12-22T08:47:08.305705+0000","last_fullsized":"2023-12-22T08:47:08.305705+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:27:18.998252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"126'4","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.136282+0000","last_change":"2023-12-22T08:47:06.550562+0000","last_active":"2023-12-22T08:47:08.136282+0000","last_peered":"2023-12-22T08:47:08.136282+0000","last_clean":"2023-12-22T08:47:08.136282+0000","last_became_active":"2023-12-22T08:47:06.549981+0000","last_became_peered":"2023-12-22T08:47:06.549981+0000","last_unstale":"2023-12-22T08:47:08.136282+0000","last_undegraded":"2023-12-22T08:47:08.136282+0000","last_fullsized":"2023-12-22T08:47:08.136282+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:01:24.014343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.136157+0000","last_change":"2023-12-22T08:47:07.065557+0000","last_active":"2023-12-22T08:47:08.136157+0000","last_peered":"2023-12-22T08:47:08.136157+0000","last_clean":"2023-12-22T08:47:08.136157+0000","last_became_active":"2023-12-22T08:47:07.065196+0000","last_became_peered":"2023-12-22T08:47:07.065196+0000","last_unstale":"2023-12-22T08:47:08.136157+0000","last_undegraded":"2023-12-22T08:47:08.136157+0000","last_fullsized":"2023-12-22T08:47:08.136157+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:36.964162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"126'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050124+0000","last_change":"2023-12-22T08:47:06.557212+0000","last_active":"2023-12-22T08:47:08.050124+0000","last_peered":"2023-12-22T08:47:08.050124+0000","last_clean":"2023-12-22T08:47:08.050124+0000","last_became_active":"2023-12-22T08:47:06.556296+0000","last_became_peered":"2023-12-22T08:47:06.556296+0000","last_unstale":"2023-12-22T08:47:08.050124+0000","last_undegraded":"2023-12-22T08:47:08.050124+0000","last_fullsized":"2023-12-22T08:47:08.050124+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:40:39.182636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048644+0000","last_change":"2023-12-22T08:47:07.063047+0000","last_active":"2023-12-22T08:47:08.048644+0000","last_peered":"2023-12-22T08:47:08.048644+0000","last_clean":"2023-12-22T08:47:08.048644+0000","last_became_active":"2023-12-22T08:47:07.062098+0000","last_became_peered":"2023-12-22T08:47:07.062098+0000","last_unstale":"2023-12-22T08:47:08.048644+0000","last_undegraded":"2023-12-22T08:47:08.048644+0000","last_fullsized":"2023-12-22T08:47:08.048644+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:37:23.550550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"126'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.307032+0000","last_change":"2023-12-22T08:47:06.558416+0000","last_active":"2023-12-22T08:47:08.307032+0000","last_peered":"2023-12-22T08:47:08.307032+0000","last_clean":"2023-12-22T08:47:08.307032+0000","last_became_active":"2023-12-22T08:47:06.557919+0000","last_became_peered":"2023-12-22T08:47:06.557919+0000","last_unstale":"2023-12-22T08:47:08.307032+0000","last_undegraded":"2023-12-22T08:47:08.307032+0000","last_fullsized":"2023-12-22T08:47:08.307032+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:40.854777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.304429+0000","last_change":"2023-12-22T08:47:07.060622+0000","last_active":"2023-12-22T08:47:08.304429+0000","last_peered":"2023-12-22T08:47:08.304429+0000","last_clean":"2023-12-22T08:47:08.304429+0000","last_became_active":"2023-12-22T08:47:07.060343+0000","last_became_peered":"2023-12-22T08:47:07.060343+0000","last_unstale":"2023-12-22T08:47:08.304429+0000","last_undegraded":"2023-12-22T08:47:08.304429+0000","last_fullsized":"2023-12-22T08:47:08.304429+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:06:43.135406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"126'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.049271+0000","last_change":"2023-12-22T08:47:06.557847+0000","last_active":"2023-12-22T08:47:08.049271+0000","last_peered":"2023-12-22T08:47:08.049271+0000","last_clean":"2023-12-22T08:47:08.049271+0000","last_became_active":"2023-12-22T08:47:06.557225+0000","last_became_peered":"2023-12-22T08:47:06.557225+0000","last_unstale":"2023-12-22T08:47:08.049271+0000","last_undegraded":"2023-12-22T08:47:08.049271+0000","last_fullsized":"2023-12-22T08:47:08.049271+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:35.941675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047120+0000","last_change":"2023-12-22T08:47:07.059988+0000","last_active":"2023-12-22T08:47:08.047120+0000","last_peered":"2023-12-22T08:47:08.047120+0000","last_clean":"2023-12-22T08:47:08.047120+0000","last_became_active":"2023-12-22T08:47:07.059667+0000","last_became_peered":"2023-12-22T08:47:07.059667+0000","last_unstale":"2023-12-22T08:47:08.047120+0000","last_undegraded":"2023-12-22T08:47:08.047120+0000","last_fullsized":"2023-12-22T08:47:08.047120+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:52:50.825609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"126'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048603+0000","last_change":"2023-12-22T08:47:06.550601+0000","last_active":"2023-12-22T08:47:08.048603+0000","last_peered":"2023-12-22T08:47:08.048603+0000","last_clean":"2023-12-22T08:47:08.048603+0000","last_became_active":"2023-12-22T08:47:06.549937+0000","last_became_peered":"2023-12-22T08:47:06.549937+0000","last_unstale":"2023-12-22T08:47:08.048603+0000","last_undegraded":"2023-12-22T08:47:08.048603+0000","last_fullsized":"2023-12-22T08:47:08.048603+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:43:10.157292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050826+0000","last_change":"2023-12-22T08:47:07.057439+0000","last_active":"2023-12-22T08:47:08.050826+0000","last_peered":"2023-12-22T08:47:08.050826+0000","last_clean":"2023-12-22T08:47:08.050826+0000","last_became_active":"2023-12-22T08:47:07.057171+0000","last_became_peered":"2023-12-22T08:47:07.057171+0000","last_unstale":"2023-12-22T08:47:08.050826+0000","last_undegraded":"2023-12-22T08:47:08.050826+0000","last_fullsized":"2023-12-22T08:47:08.050826+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:19.691796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"126'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306835+0000","last_change":"2023-12-22T08:47:06.547898+0000","last_active":"2023-12-22T08:47:08.306835+0000","last_peered":"2023-12-22T08:47:08.306835+0000","last_clean":"2023-12-22T08:47:08.306835+0000","last_became_active":"2023-12-22T08:47:06.547393+0000","last_became_peered":"2023-12-22T08:47:06.547393+0000","last_unstale":"2023-12-22T08:47:08.306835+0000","last_undegraded":"2023-12-22T08:47:08.306835+0000","last_fullsized":"2023-12-22T08:47:08.306835+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:15.783613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.136113+0000","last_change":"2023-12-22T08:47:07.073780+0000","last_active":"2023-12-22T08:47:08.136113+0000","last_peered":"2023-12-22T08:47:08.136113+0000","last_clean":"2023-12-22T08:47:08.136113+0000","last_became_active":"2023-12-22T08:47:07.072920+0000","last_became_peered":"2023-12-22T08:47:07.072920+0000","last_unstale":"2023-12-22T08:47:08.136113+0000","last_undegraded":"2023-12-22T08:47:08.136113+0000","last_fullsized":"2023-12-22T08:47:08.136113+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:23.312141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050322+0000","last_change":"2023-12-22T08:47:06.556986+0000","last_active":"2023-12-22T08:47:08.050322+0000","last_peered":"2023-12-22T08:47:08.050322+0000","last_clean":"2023-12-22T08:47:08.050322+0000","last_became_active":"2023-12-22T08:47:06.555952+0000","last_became_peered":"2023-12-22T08:47:06.555952+0000","last_unstale":"2023-12-22T08:47:08.050322+0000","last_undegraded":"2023-12-22T08:47:08.050322+0000","last_fullsized":"2023-12-22T08:47:08.050322+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:16.557590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.046686+0000","last_change":"2023-12-22T08:47:07.059860+0000","last_active":"2023-12-22T08:47:08.046686+0000","last_peered":"2023-12-22T08:47:08.046686+0000","last_clean":"2023-12-22T08:47:08.046686+0000","last_became_active":"2023-12-22T08:47:07.059508+0000","last_became_peered":"2023-12-22T08:47:07.059508+0000","last_unstale":"2023-12-22T08:47:08.046686+0000","last_undegraded":"2023-12-22T08:47:08.046686+0000","last_fullsized":"2023-12-22T08:47:08.046686+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:24:49.917274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306941+0000","last_change":"2023-12-22T08:47:06.558573+0000","last_active":"2023-12-22T08:47:08.306941+0000","last_peered":"2023-12-22T08:47:08.306941+0000","last_clean":"2023-12-22T08:47:08.306941+0000","last_became_active":"2023-12-22T08:47:06.558257+0000","last_became_peered":"2023-12-22T08:47:06.558257+0000","last_unstale":"2023-12-22T08:47:08.306941+0000","last_undegraded":"2023-12-22T08:47:08.306941+0000","last_fullsized":"2023-12-22T08:47:08.306941+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:15.783613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047961+0000","last_change":"2023-12-22T08:47:07.076131+0000","last_active":"2023-12-22T08:47:08.047961+0000","last_peered":"2023-12-22T08:47:08.047961+0000","last_clean":"2023-12-22T08:47:08.047961+0000","last_became_active":"2023-12-22T08:47:07.075661+0000","last_became_peered":"2023-12-22T08:47:07.075661+0000","last_unstale":"2023-12-22T08:47:08.047961+0000","last_undegraded":"2023-12-22T08:47:08.047961+0000","last_fullsized":"2023-12-22T08:47:08.047961+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:48.083935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.307877+0000","last_change":"2023-12-22T08:47:06.549699+0000","last_active":"2023-12-22T08:47:08.307877+0000","last_peered":"2023-12-22T08:47:08.307877+0000","last_clean":"2023-12-22T08:47:08.307877+0000","last_became_active":"2023-12-22T08:47:06.549247+0000","last_became_peered":"2023-12-22T08:47:06.549247+0000","last_unstale":"2023-12-22T08:47:08.307877+0000","last_undegraded":"2023-12-22T08:47:08.307877+0000","last_fullsized":"2023-12-22T08:47:08.307877+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:49.232801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305688+0000","last_change":"2023-12-22T08:47:07.056676+0000","last_active":"2023-12-22T08:47:08.305688+0000","last_peered":"2023-12-22T08:47:08.305688+0000","last_clean":"2023-12-22T08:47:08.305688+0000","last_became_active":"2023-12-22T08:47:07.056447+0000","last_became_peered":"2023-12-22T08:47:07.056447+0000","last_unstale":"2023-12-22T08:47:08.305688+0000","last_undegraded":"2023-12-22T08:47:08.305688+0000","last_fullsized":"2023-12-22T08:47:08.305688+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:34:00.380882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048830+0000","last_change":"2023-12-22T08:47:06.555833+0000","last_active":"2023-12-22T08:47:08.048830+0000","last_peered":"2023-12-22T08:47:08.048830+0000","last_clean":"2023-12-22T08:47:08.048830+0000","last_became_active":"2023-12-22T08:47:06.555566+0000","last_became_peered":"2023-12-22T08:47:06.555566+0000","last_unstale":"2023-12-22T08:47:08.048830+0000","last_undegraded":"2023-12-22T08:47:08.048830+0000","last_fullsized":"2023-12-22T08:47:08.048830+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:42.780725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050000+0000","last_change":"2023-12-22T08:47:07.060763+0000","last_active":"2023-12-22T08:47:08.050000+0000","last_peered":"2023-12-22T08:47:08.050000+0000","last_clean":"2023-12-22T08:47:08.050000+0000","last_became_active":"2023-12-22T08:47:07.060551+0000","last_became_peered":"2023-12-22T08:47:07.060551+0000","last_unstale":"2023-12-22T08:47:08.050000+0000","last_undegraded":"2023-12-22T08:47:08.050000+0000","last_fullsized":"2023-12-22T08:47:08.050000+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:22:57.400623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"126'3","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050021+0000","last_change":"2023-12-22T08:47:06.553389+0000","last_active":"2023-12-22T08:47:08.050021+0000","last_peered":"2023-12-22T08:47:08.050021+0000","last_clean":"2023-12-22T08:47:08.050021+0000","last_became_active":"2023-12-22T08:47:06.553100+0000","last_became_peered":"2023-12-22T08:47:06.553100+0000","last_unstale":"2023-12-22T08:47:08.050021+0000","last_undegraded":"2023-12-22T08:47:08.050021+0000","last_fullsized":"2023-12-22T08:47:08.050021+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:02:29.135480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305968+0000","last_change":"2023-12-22T08:47:07.065345+0000","last_active":"2023-12-22T08:47:08.305968+0000","last_peered":"2023-12-22T08:47:08.305968+0000","last_clean":"2023-12-22T08:47:08.305968+0000","last_became_active":"2023-12-22T08:47:07.065124+0000","last_became_peered":"2023-12-22T08:47:07.065124+0000","last_unstale":"2023-12-22T08:47:08.305968+0000","last_undegraded":"2023-12-22T08:47:08.305968+0000","last_fullsized":"2023-12-22T08:47:08.305968+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:06.024340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"126'6","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.046938+0000","last_change":"2023-12-22T08:47:06.553459+0000","last_active":"2023-12-22T08:47:08.046938+0000","last_peered":"2023-12-22T08:47:08.046938+0000","last_clean":"2023-12-22T08:47:08.046938+0000","last_became_active":"2023-12-22T08:47:06.553009+0000","last_became_peered":"2023-12-22T08:47:06.553009+0000","last_unstale":"2023-12-22T08:47:08.046938+0000","last_undegraded":"2023-12-22T08:47:08.046938+0000","last_fullsized":"2023-12-22T08:47:08.046938+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:22.289654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048878+0000","last_change":"2023-12-22T08:47:07.062557+0000","last_active":"2023-12-22T08:47:08.048878+0000","last_peered":"2023-12-22T08:47:08.048878+0000","last_clean":"2023-12-22T08:47:08.048878+0000","last_became_active":"2023-12-22T08:47:07.060705+0000","last_became_peered":"2023-12-22T08:47:07.060705+0000","last_unstale":"2023-12-22T08:47:08.048878+0000","last_undegraded":"2023-12-22T08:47:08.048878+0000","last_fullsized":"2023-12-22T08:47:08.048878+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:52:50.825609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"126'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.307170+0000","last_change":"2023-12-22T08:47:06.549604+0000","last_active":"2023-12-22T08:47:08.307170+0000","last_peered":"2023-12-22T08:47:08.307170+0000","last_clean":"2023-12-22T08:47:08.307170+0000","last_became_active":"2023-12-22T08:47:06.549201+0000","last_became_peered":"2023-12-22T08:47:06.549201+0000","last_unstale":"2023-12-22T08:47:08.307170+0000","last_undegraded":"2023-12-22T08:47:08.307170+0000","last_fullsized":"2023-12-22T08:47:08.307170+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:36.192993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306124+0000","last_change":"2023-12-22T08:47:07.077698+0000","last_active":"2023-12-22T08:47:08.306124+0000","last_peered":"2023-12-22T08:47:08.306124+0000","last_clean":"2023-12-22T08:47:08.306124+0000","last_became_active":"2023-12-22T08:47:07.076381+0000","last_became_peered":"2023-12-22T08:47:07.076381+0000","last_unstale":"2023-12-22T08:47:08.306124+0000","last_undegraded":"2023-12-22T08:47:08.306124+0000","last_fullsized":"2023-12-22T08:47:08.306124+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:02:49.423640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.049377+0000","last_change":"2023-12-22T08:47:06.557648+0000","last_active":"2023-12-22T08:47:08.049377+0000","last_peered":"2023-12-22T08:47:08.049377+0000","last_clean":"2023-12-22T08:47:08.049377+0000","last_became_active":"2023-12-22T08:47:06.556579+0000","last_became_peered":"2023-12-22T08:47:06.556579+0000","last_unstale":"2023-12-22T08:47:08.049377+0000","last_undegraded":"2023-12-22T08:47:08.049377+0000","last_fullsized":"2023-12-22T08:47:08.049377+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:15:16.849545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.049882+0000","last_change":"2023-12-22T08:47:07.058778+0000","last_active":"2023-12-22T08:47:08.049882+0000","last_peered":"2023-12-22T08:47:08.049882+0000","last_clean":"2023-12-22T08:47:08.049882+0000","last_became_active":"2023-12-22T08:47:07.058469+0000","last_became_peered":"2023-12-22T08:47:07.058469+0000","last_unstale":"2023-12-22T08:47:08.049882+0000","last_undegraded":"2023-12-22T08:47:08.049882+0000","last_fullsized":"2023-12-22T08:47:08.049882+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:53.662624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047682+0000","last_change":"2023-12-22T08:47:06.546138+0000","last_active":"2023-12-22T08:47:08.047682+0000","last_peered":"2023-12-22T08:47:08.047682+0000","last_clean":"2023-12-22T08:47:08.047682+0000","last_became_active":"2023-12-22T08:47:06.544243+0000","last_became_peered":"2023-12-22T08:47:06.544243+0000","last_unstale":"2023-12-22T08:47:08.047682+0000","last_undegraded":"2023-12-22T08:47:08.047682+0000","last_fullsized":"2023-12-22T08:47:08.047682+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:25:32.431251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305483+0000","last_change":"2023-12-22T08:47:07.067945+0000","last_active":"2023-12-22T08:47:08.305483+0000","last_peered":"2023-12-22T08:47:08.305483+0000","last_clean":"2023-12-22T08:47:08.305483+0000","last_became_active":"2023-12-22T08:47:07.067690+0000","last_became_peered":"2023-12-22T08:47:07.067690+0000","last_unstale":"2023-12-22T08:47:08.305483+0000","last_undegraded":"2023-12-22T08:47:08.305483+0000","last_fullsized":"2023-12-22T08:47:08.305483+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:59:39.879275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"126'8","reported_seq":19,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048437+0000","last_change":"2023-12-22T08:47:06.553248+0000","last_active":"2023-12-22T08:47:08.048437+0000","last_peered":"2023-12-22T08:47:08.048437+0000","last_clean":"2023-12-22T08:47:08.048437+0000","last_became_active":"2023-12-22T08:47:06.552829+0000","last_became_peered":"2023-12-22T08:47:06.552829+0000","last_unstale":"2023-12-22T08:47:08.048437+0000","last_undegraded":"2023-12-22T08:47:08.048437+0000","last_fullsized":"2023-12-22T08:47:08.048437+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:48:33.981473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305632+0000","last_change":"2023-12-22T08:47:07.063051+0000","last_active":"2023-12-22T08:47:08.305632+0000","last_peered":"2023-12-22T08:47:08.305632+0000","last_clean":"2023-12-22T08:47:08.305632+0000","last_became_active":"2023-12-22T08:47:07.062824+0000","last_became_peered":"2023-12-22T08:47:07.062824+0000","last_unstale":"2023-12-22T08:47:08.305632+0000","last_undegraded":"2023-12-22T08:47:08.305632+0000","last_fullsized":"2023-12-22T08:47:08.305632+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:35:43.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"126'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047087+0000","last_change":"2023-12-22T08:47:06.549314+0000","last_active":"2023-12-22T08:47:08.047087+0000","last_peered":"2023-12-22T08:47:08.047087+0000","last_clean":"2023-12-22T08:47:08.047087+0000","last_became_active":"2023-12-22T08:47:06.548973+0000","last_became_peered":"2023-12-22T08:47:06.548973+0000","last_unstale":"2023-12-22T08:47:08.047087+0000","last_undegraded":"2023-12-22T08:47:08.047087+0000","last_fullsized":"2023-12-22T08:47:08.047087+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:42:47.193756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306371+0000","last_change":"2023-12-22T08:47:07.061844+0000","last_active":"2023-12-22T08:47:08.306371+0000","last_peered":"2023-12-22T08:47:08.306371+0000","last_clean":"2023-12-22T08:47:08.306371+0000","last_became_active":"2023-12-22T08:47:07.061244+0000","last_became_peered":"2023-12-22T08:47:07.061244+0000","last_unstale":"2023-12-22T08:47:08.306371+0000","last_undegraded":"2023-12-22T08:47:08.306371+0000","last_fullsized":"2023-12-22T08:47:08.306371+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:27:18.998252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"126'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.051246+0000","last_change":"2023-12-22T08:47:06.551765+0000","last_active":"2023-12-22T08:47:08.051246+0000","last_peered":"2023-12-22T08:47:08.051246+0000","last_clean":"2023-12-22T08:47:08.051246+0000","last_became_active":"2023-12-22T08:47:06.547856+0000","last_became_peered":"2023-12-22T08:47:06.547856+0000","last_unstale":"2023-12-22T08:47:08.051246+0000","last_undegraded":"2023-12-22T08:47:08.051246+0000","last_fullsized":"2023-12-22T08:47:08.051246+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:19:12.174519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.046757+0000","last_change":"2023-12-22T08:47:07.070960+0000","last_active":"2023-12-22T08:47:08.046757+0000","last_peered":"2023-12-22T08:47:08.046757+0000","last_clean":"2023-12-22T08:47:08.046757+0000","last_became_active":"2023-12-22T08:47:07.070740+0000","last_became_peered":"2023-12-22T08:47:07.070740+0000","last_unstale":"2023-12-22T08:47:08.046757+0000","last_undegraded":"2023-12-22T08:47:08.046757+0000","last_fullsized":"2023-12-22T08:47:08.046757+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:37.116288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306964+0000","last_change":"2023-12-22T08:47:06.558293+0000","last_active":"2023-12-22T08:47:08.306964+0000","last_peered":"2023-12-22T08:47:08.306964+0000","last_clean":"2023-12-22T08:47:08.306964+0000","last_became_active":"2023-12-22T08:47:06.557987+0000","last_became_peered":"2023-12-22T08:47:06.557987+0000","last_unstale":"2023-12-22T08:47:08.306964+0000","last_undegraded":"2023-12-22T08:47:08.306964+0000","last_fullsized":"2023-12-22T08:47:08.306964+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:03:29.268874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305925+0000","last_change":"2023-12-22T08:47:07.074674+0000","last_active":"2023-12-22T08:47:08.305925+0000","last_peered":"2023-12-22T08:47:08.305925+0000","last_clean":"2023-12-22T08:47:08.305925+0000","last_became_active":"2023-12-22T08:47:07.074435+0000","last_became_peered":"2023-12-22T08:47:07.074435+0000","last_unstale":"2023-12-22T08:47:08.305925+0000","last_undegraded":"2023-12-22T08:47:08.305925+0000","last_fullsized":"2023-12-22T08:47:08.305925+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:06.024340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"126'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048673+0000","last_change":"2023-12-22T08:47:06.557467+0000","last_active":"2023-12-22T08:47:08.048673+0000","last_peered":"2023-12-22T08:47:08.048673+0000","last_clean":"2023-12-22T08:47:08.048673+0000","last_became_active":"2023-12-22T08:47:06.557109+0000","last_became_peered":"2023-12-22T08:47:06.557109+0000","last_unstale":"2023-12-22T08:47:08.048673+0000","last_undegraded":"2023-12-22T08:47:08.048673+0000","last_fullsized":"2023-12-22T08:47:08.048673+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:37:07.666881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305459+0000","last_change":"2023-12-22T08:47:07.072443+0000","last_active":"2023-12-22T08:47:08.305459+0000","last_peered":"2023-12-22T08:47:08.305459+0000","last_clean":"2023-12-22T08:47:08.305459+0000","last_became_active":"2023-12-22T08:47:07.072174+0000","last_became_peered":"2023-12-22T08:47:07.072174+0000","last_unstale":"2023-12-22T08:47:08.305459+0000","last_undegraded":"2023-12-22T08:47:08.305459+0000","last_fullsized":"2023-12-22T08:47:08.305459+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:35:43.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305755+0000","last_change":"2023-12-22T08:47:06.554789+0000","last_active":"2023-12-22T08:47:08.305755+0000","last_peered":"2023-12-22T08:47:08.305755+0000","last_clean":"2023-12-22T08:47:08.305755+0000","last_became_active":"2023-12-22T08:47:06.553891+0000","last_became_peered":"2023-12-22T08:47:06.553891+0000","last_unstale":"2023-12-22T08:47:08.305755+0000","last_undegraded":"2023-12-22T08:47:08.305755+0000","last_fullsized":"2023-12-22T08:47:08.305755+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:02:44.269557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.049112+0000","last_change":"2023-12-22T08:47:07.070721+0000","last_active":"2023-12-22T08:47:08.049112+0000","last_peered":"2023-12-22T08:47:08.049112+0000","last_clean":"2023-12-22T08:47:08.049112+0000","last_became_active":"2023-12-22T08:47:07.070407+0000","last_became_peered":"2023-12-22T08:47:07.070407+0000","last_unstale":"2023-12-22T08:47:08.049112+0000","last_undegraded":"2023-12-22T08:47:08.049112+0000","last_fullsized":"2023-12-22T08:47:08.049112+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:37.215480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.304558+0000","last_change":"2023-12-22T08:47:06.554930+0000","last_active":"2023-12-22T08:47:08.304558+0000","last_peered":"2023-12-22T08:47:08.304558+0000","last_clean":"2023-12-22T08:47:08.304558+0000","last_became_active":"2023-12-22T08:47:06.554711+0000","last_became_peered":"2023-12-22T08:47:06.554711+0000","last_unstale":"2023-12-22T08:47:08.304558+0000","last_undegraded":"2023-12-22T08:47:08.304558+0000","last_fullsized":"2023-12-22T08:47:08.304558+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:33:20.305807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305716+0000","last_change":"2023-12-22T08:47:07.072114+0000","last_active":"2023-12-22T08:47:08.305716+0000","last_peered":"2023-12-22T08:47:08.305716+0000","last_clean":"2023-12-22T08:47:08.305716+0000","last_became_active":"2023-12-22T08:47:07.071915+0000","last_became_peered":"2023-12-22T08:47:07.071915+0000","last_unstale":"2023-12-22T08:47:08.305716+0000","last_undegraded":"2023-12-22T08:47:08.305716+0000","last_fullsized":"2023-12-22T08:47:08.305716+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:05:29.406949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.308092+0000","last_change":"2023-12-22T08:47:06.560855+0000","last_active":"2023-12-22T08:47:08.308092+0000","last_peered":"2023-12-22T08:47:08.308092+0000","last_clean":"2023-12-22T08:47:08.308092+0000","last_became_active":"2023-12-22T08:47:06.559423+0000","last_became_peered":"2023-12-22T08:47:06.559423+0000","last_unstale":"2023-12-22T08:47:08.308092+0000","last_undegraded":"2023-12-22T08:47:08.308092+0000","last_fullsized":"2023-12-22T08:47:08.308092+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:02:44.269557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305713+0000","last_change":"2023-12-22T08:47:07.066879+0000","last_active":"2023-12-22T08:47:08.305713+0000","last_peered":"2023-12-22T08:47:08.305713+0000","last_clean":"2023-12-22T08:47:08.305713+0000","last_became_active":"2023-12-22T08:47:07.066638+0000","last_became_peered":"2023-12-22T08:47:07.066638+0000","last_unstale":"2023-12-22T08:47:08.305713+0000","last_undegraded":"2023-12-22T08:47:08.305713+0000","last_fullsized":"2023-12-22T08:47:08.305713+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:11:02.036443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"126'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047900+0000","last_change":"2023-12-22T08:47:06.546714+0000","last_active":"2023-12-22T08:47:08.047900+0000","last_peered":"2023-12-22T08:47:08.047900+0000","last_clean":"2023-12-22T08:47:08.047900+0000","last_became_active":"2023-12-22T08:47:06.545442+0000","last_became_peered":"2023-12-22T08:47:06.545442+0000","last_unstale":"2023-12-22T08:47:08.047900+0000","last_undegraded":"2023-12-22T08:47:08.047900+0000","last_fullsized":"2023-12-22T08:47:08.047900+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:37.060259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306118+0000","last_change":"2023-12-22T08:47:07.075741+0000","last_active":"2023-12-22T08:47:08.306118+0000","last_peered":"2023-12-22T08:47:08.306118+0000","last_clean":"2023-12-22T08:47:08.306118+0000","last_became_active":"2023-12-22T08:47:07.075504+0000","last_became_peered":"2023-12-22T08:47:07.075504+0000","last_unstale":"2023-12-22T08:47:08.306118+0000","last_undegraded":"2023-12-22T08:47:08.306118+0000","last_fullsized":"2023-12-22T08:47:08.306118+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:10.578674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305908+0000","last_change":"2023-12-22T08:47:06.557287+0000","last_active":"2023-12-22T08:47:08.305908+0000","last_peered":"2023-12-22T08:47:08.305908+0000","last_clean":"2023-12-22T08:47:08.305908+0000","last_became_active":"2023-12-22T08:47:06.556828+0000","last_became_peered":"2023-12-22T08:47:06.556828+0000","last_unstale":"2023-12-22T08:47:08.305908+0000","last_undegraded":"2023-12-22T08:47:08.305908+0000","last_fullsized":"2023-12-22T08:47:08.305908+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:47.061448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306617+0000","last_change":"2023-12-22T08:47:07.070460+0000","last_active":"2023-12-22T08:47:08.306617+0000","last_peered":"2023-12-22T08:47:08.306617+0000","last_clean":"2023-12-22T08:47:08.306617+0000","last_became_active":"2023-12-22T08:47:07.069252+0000","last_became_peered":"2023-12-22T08:47:07.069252+0000","last_unstale":"2023-12-22T08:47:08.306617+0000","last_undegraded":"2023-12-22T08:47:08.306617+0000","last_fullsized":"2023-12-22T08:47:08.306617+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:05:29.406949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306563+0000","last_change":"2023-12-22T08:47:06.552660+0000","last_active":"2023-12-22T08:47:08.306563+0000","last_peered":"2023-12-22T08:47:08.306563+0000","last_clean":"2023-12-22T08:47:08.306563+0000","last_became_active":"2023-12-22T08:47:06.552125+0000","last_became_peered":"2023-12-22T08:47:06.552125+0000","last_unstale":"2023-12-22T08:47:08.306563+0000","last_undegraded":"2023-12-22T08:47:08.306563+0000","last_fullsized":"2023-12-22T08:47:08.306563+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:32.503625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050231+0000","last_change":"2023-12-22T08:47:07.057637+0000","last_active":"2023-12-22T08:47:08.050231+0000","last_peered":"2023-12-22T08:47:08.050231+0000","last_clean":"2023-12-22T08:47:08.050231+0000","last_became_active":"2023-12-22T08:47:07.056901+0000","last_became_peered":"2023-12-22T08:47:07.056901+0000","last_unstale":"2023-12-22T08:47:08.050231+0000","last_undegraded":"2023-12-22T08:47:08.050231+0000","last_fullsized":"2023-12-22T08:47:08.050231+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:27:17.938587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305948+0000","last_change":"2023-12-22T08:47:06.544812+0000","last_active":"2023-12-22T08:47:08.305948+0000","last_peered":"2023-12-22T08:47:08.305948+0000","last_clean":"2023-12-22T08:47:08.305948+0000","last_became_active":"2023-12-22T08:47:06.544512+0000","last_became_peered":"2023-12-22T08:47:06.544512+0000","last_unstale":"2023-12-22T08:47:08.305948+0000","last_undegraded":"2023-12-22T08:47:08.305948+0000","last_fullsized":"2023-12-22T08:47:08.305948+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:40.854777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306379+0000","last_change":"2023-12-22T08:47:07.069812+0000","last_active":"2023-12-22T08:47:08.306379+0000","last_peered":"2023-12-22T08:47:08.306379+0000","last_clean":"2023-12-22T08:47:08.306379+0000","last_became_active":"2023-12-22T08:47:07.069582+0000","last_became_peered":"2023-12-22T08:47:07.069582+0000","last_unstale":"2023-12-22T08:47:08.306379+0000","last_undegraded":"2023-12-22T08:47:08.306379+0000","last_fullsized":"2023-12-22T08:47:08.306379+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:31:19.386328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.308286+0000","last_change":"2023-12-22T08:47:06.560556+0000","last_active":"2023-12-22T08:47:08.308286+0000","last_peered":"2023-12-22T08:47:08.308286+0000","last_clean":"2023-12-22T08:47:08.308286+0000","last_became_active":"2023-12-22T08:47:06.559081+0000","last_became_peered":"2023-12-22T08:47:06.559081+0000","last_unstale":"2023-12-22T08:47:08.308286+0000","last_undegraded":"2023-12-22T08:47:08.308286+0000","last_fullsized":"2023-12-22T08:47:08.308286+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:47.061448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.051015+0000","last_change":"2023-12-22T08:47:07.063049+0000","last_active":"2023-12-22T08:47:08.051015+0000","last_peered":"2023-12-22T08:47:08.051015+0000","last_clean":"2023-12-22T08:47:08.051015+0000","last_became_active":"2023-12-22T08:47:07.062177+0000","last_became_peered":"2023-12-22T08:47:07.062177+0000","last_unstale":"2023-12-22T08:47:08.051015+0000","last_undegraded":"2023-12-22T08:47:08.051015+0000","last_fullsized":"2023-12-22T08:47:08.051015+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:32:56.658237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306472+0000","last_change":"2023-12-22T08:47:06.556024+0000","last_active":"2023-12-22T08:47:08.306472+0000","last_peered":"2023-12-22T08:47:08.306472+0000","last_clean":"2023-12-22T08:47:08.306472+0000","last_became_active":"2023-12-22T08:47:06.555729+0000","last_became_peered":"2023-12-22T08:47:06.555729+0000","last_unstale":"2023-12-22T08:47:08.306472+0000","last_undegraded":"2023-12-22T08:47:08.306472+0000","last_fullsized":"2023-12-22T08:47:08.306472+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:47.061448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306172+0000","last_change":"2023-12-22T08:47:07.071627+0000","last_active":"2023-12-22T08:47:08.306172+0000","last_peered":"2023-12-22T08:47:08.306172+0000","last_clean":"2023-12-22T08:47:08.306172+0000","last_became_active":"2023-12-22T08:47:07.071367+0000","last_became_peered":"2023-12-22T08:47:07.071367+0000","last_unstale":"2023-12-22T08:47:08.306172+0000","last_undegraded":"2023-12-22T08:47:08.306172+0000","last_fullsized":"2023-12-22T08:47:08.306172+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:49:28.972166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.136390+0000","last_change":"2023-12-22T08:47:06.561662+0000","last_active":"2023-12-22T08:47:08.136390+0000","last_peered":"2023-12-22T08:47:08.136390+0000","last_clean":"2023-12-22T08:47:08.136390+0000","last_became_active":"2023-12-22T08:47:06.561413+0000","last_became_peered":"2023-12-22T08:47:06.561413+0000","last_unstale":"2023-12-22T08:47:08.136390+0000","last_undegraded":"2023-12-22T08:47:08.136390+0000","last_fullsized":"2023-12-22T08:47:08.136390+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:52:08.730260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047264+0000","last_change":"2023-12-22T08:47:07.065628+0000","last_active":"2023-12-22T08:47:08.047264+0000","last_peered":"2023-12-22T08:47:08.047264+0000","last_clean":"2023-12-22T08:47:08.047264+0000","last_became_active":"2023-12-22T08:47:07.064644+0000","last_became_peered":"2023-12-22T08:47:07.064644+0000","last_unstale":"2023-12-22T08:47:08.047264+0000","last_undegraded":"2023-12-22T08:47:08.047264+0000","last_fullsized":"2023-12-22T08:47:08.047264+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:03:30.291361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306241+0000","last_change":"2023-12-22T08:47:06.556580+0000","last_active":"2023-12-22T08:47:08.306241+0000","last_peered":"2023-12-22T08:47:08.306241+0000","last_clean":"2023-12-22T08:47:08.306241+0000","last_became_active":"2023-12-22T08:47:06.556351+0000","last_became_peered":"2023-12-22T08:47:06.556351+0000","last_unstale":"2023-12-22T08:47:08.306241+0000","last_undegraded":"2023-12-22T08:47:08.306241+0000","last_fullsized":"2023-12-22T08:47:08.306241+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:36.192993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306372+0000","last_change":"2023-12-22T08:47:07.078036+0000","last_active":"2023-12-22T08:47:08.306372+0000","last_peered":"2023-12-22T08:47:08.306372+0000","last_clean":"2023-12-22T08:47:08.306372+0000","last_became_active":"2023-12-22T08:47:07.076918+0000","last_became_peered":"2023-12-22T08:47:07.076918+0000","last_unstale":"2023-12-22T08:47:08.306372+0000","last_undegraded":"2023-12-22T08:47:08.306372+0000","last_fullsized":"2023-12-22T08:47:08.306372+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:49:56.911810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"126'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047072+0000","last_change":"2023-12-22T08:47:06.553272+0000","last_active":"2023-12-22T08:47:08.047072+0000","last_peered":"2023-12-22T08:47:08.047072+0000","last_clean":"2023-12-22T08:47:08.047072+0000","last_became_active":"2023-12-22T08:47:06.552492+0000","last_became_peered":"2023-12-22T08:47:06.552492+0000","last_unstale":"2023-12-22T08:47:08.047072+0000","last_undegraded":"2023-12-22T08:47:08.047072+0000","last_fullsized":"2023-12-22T08:47:08.047072+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:44.954690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":259,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-12-22T08:47:07.056614+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:47:07.056614+0000","last_peered":"2023-12-22T08:47:07.056614+0000","last_clean":"2023-12-22T08:47:07.056614+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:47:07.056614+0000","last_undegraded":"2023-12-22T08:47:07.056614+0000","last_fullsized":"2023-12-22T08:47:07.056614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":678,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194633,"statfs":{"total":200000000,"available":199304744,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0960000000000001,"15min":1.0840000000000001},"min":{"1min":0.80200000000000005,"5min":0.60999999999999999,"15min":0.58199999999999996},"max":{"1min":1.5169999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1160000000000001,"15min":1.077},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.054}]},{"osd":1,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1870000000000001,"15min":1.167},"min":{"1min":0.73399999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6839999999999999,"5min":1.905,"15min":1.905},"last":1.49},{"interface":"front","average":{"1min":1.2,"5min":1.2549999999999999,"15min":1.1679999999999999},"min":{"1min":0.85099999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7709999999999999,"5min":1.865,"15min":1.865},"last":1.448}]},{"osd":2,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.163,"15min":1.089},"min":{"1min":0.89600000000000002,"5min":0.78100000000000003,"15min":0.69799999999999995},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.2,"15min":1.22},"min":{"1min":0.79900000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.589,"5min":1.742,"15min":2.1379999999999999},"last":0.96799999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.23,"15min":1.133},"min":{"1min":0.94699999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.635,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.3300000000000001,"15min":1.2909999999999999},"min":{"1min":0.97299999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5620000000000001,"5min":1.952,"15min":2.2959999999999998},"last":1.3089999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2050000000000001,"15min":1.2},"min":{"1min":1.032,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.603,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.254},{"interface":"front","average":{"1min":1.371,"5min":1.262,"15min":1.2629999999999999},"min":{"1min":1.0229999999999999,"5min":0.64100000000000001,"15min":0.59399999999999997},"max":{"1min":2.0840000000000001,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.5600000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.375,"15min":1.3740000000000001},"min":{"1min":0.97299999999999998,"5min":0.74299999999999999,"15min":0.51800000000000002},"max":{"1min":1.8939999999999999,"5min":2.0510000000000002,"15min":2.4300000000000002},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3759999999999999,"15min":1.3740000000000001},"min":{"1min":1.135,"5min":0.76300000000000001,"15min":0.67800000000000005},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":2.3410000000000002},"last":1.5209999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.496,"15min":1.4910000000000001},"min":{"1min":1.056,"5min":0.83499999999999996,"15min":0.66900000000000004},"max":{"1min":1.9930000000000001,"5min":2.1259999999999999,"15min":2.2440000000000002},"last":1.645},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.4830000000000001,"15min":1.484},"min":{"1min":1.294,"5min":0.82299999999999995,"15min":0.71999999999999997},"max":{"1min":2.1379999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.921}]}]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":678,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194634,"statfs":{"total":200000000,"available":199305326,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.1479999999999999,"15min":1.1299999999999999},"min":{"1min":0.61499999999999999,"5min":0.55300000000000005,"15min":0.42099999999999999},"max":{"1min":1.6870000000000001,"5min":1.9350000000000001,"15min":3.0489999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.177,"15min":1.107},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.5509999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.125,"15min":1.0509999999999999},"min":{"1min":0.67800000000000005,"5min":0.63,"15min":0.623},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1859999999999999,"15min":1.167},"min":{"1min":0.69699999999999995,"5min":0.64500000000000002,"15min":0.63100000000000001},"max":{"1min":1.4870000000000001,"5min":1.8,"15min":1.8},"last":1.292}]},{"osd":2,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.264,"15min":1.268},"min":{"1min":0.73999999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.7090000000000001,"5min":1.7969999999999999,"15min":1.8799999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.248,"15min":1.1759999999999999},"min":{"1min":0.748,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.4319999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3169999999999999,"15min":1.3},"min":{"1min":0.79200000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.258,"15min":1.2370000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.77900000000000003},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.464}]},{"osd":4,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.351,"15min":1.3859999999999999},"min":{"1min":0.90600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.381},{"interface":"front","average":{"1min":1.454,"5min":1.391,"15min":1.397},"min":{"1min":0.88300000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.831,"5min":2.831,"15min":2.831},"last":1.2110000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3160000000000001,"15min":1.345},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.575},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.502,"15min":1.5629999999999999},"min":{"1min":1.0369999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.7949999999999999,"5min":2.1030000000000002,"15min":3.1819999999999999},"last":1.516}]},{"osd":7,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.522,"15min":1.5680000000000001},"min":{"1min":0.93300000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":1.613},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.45,"15min":1.522},"min":{"1min":0.90400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.6279999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1255,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194056,"statfs":{"total":200000000,"available":198714357,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.101,"15min":1.0800000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.65300000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.944},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1060000000000001,"15min":1.1279999999999999},"min":{"1min":0.76500000000000001,"5min":0.68899999999999995,"15min":0.67000000000000004},"max":{"1min":1.5069999999999999,"5min":1.544,"15min":3.1379999999999999},"last":1.046}]},{"osd":1,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.135,"15min":1.1160000000000001},"min":{"1min":0.88200000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5009999999999999,"5min":1.619,"15min":2.79},"last":2.3319999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.1120000000000001,"15min":1.04},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.64500000000000002},"max":{"1min":1.476,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.5049999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1559999999999999,"15min":1.1359999999999999},"min":{"1min":0.79200000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.5860000000000001,"5min":1.5900000000000001,"15min":1.72},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2390000000000001,"15min":1.1819999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.657,"5min":1.716,"15min":1.978},"last":1.218}]},{"osd":3,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.236,"15min":1.1830000000000001},"min":{"1min":0.80200000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.5249999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.339},{"interface":"front","average":{"1min":1.351,"5min":1.3089999999999999,"15min":1.2569999999999999},"min":{"1min":0.86399999999999999,"5min":0.77800000000000002,"15min":0.73299999999999998},"max":{"1min":1.5409999999999999,"5min":1.6619999999999999,"15min":2.1499999999999999},"last":1.1850000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.274,"15min":1.2549999999999999},"min":{"1min":0.63300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6879999999999999,"5min":1.7070000000000001,"15min":1.853},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.262,"15min":1.258},"min":{"1min":0.93799999999999994,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.246}]},{"osd":6,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.3480000000000001,"15min":1.323},"min":{"1min":0.81799999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.6639999999999999,"5min":1.788,"15min":1.821},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.407,"15min":1.421},"min":{"1min":0.79600000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.764,"5min":1.823,"15min":2.8780000000000001},"last":0.98599999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.4330000000000001,"15min":1.3879999999999999},"min":{"1min":0.84299999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6579999999999999,"5min":1.873,"15min":2.2189999999999999},"last":1.411},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.49,"15min":1.5529999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.75,"5min":1.8899999999999999,"15min":4.7249999999999996},"last":1.369}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":678,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194633,"statfs":{"total":200000000,"available":199304744,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.02,"15min":1.01},"min":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.55,"5min":1.597,"15min":1.597},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1319999999999999,"15min":1.1060000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.552,"5min":1.796,"15min":1.796},"last":0.66000000000000003}]},{"osd":1,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.117,"15min":1.056},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.482,"5min":1.76,"15min":1.76},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.66900000000000004,"5min":0.65600000000000003,"15min":0.57399999999999995},"max":{"1min":1.5600000000000001,"5min":1.794,"15min":2.4249999999999998},"last":0.92900000000000005}]},{"osd":2,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.171,"15min":1.149},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6160000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.244,"15min":1.208},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.4990000000000001,"5min":2.0830000000000002,"15min":2.1600000000000001},"last":1.276}]},{"osd":3,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2190000000000001,"15min":1.2010000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.333,"15min":1.2350000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7110000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.196}]},{"osd":5,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1890000000000001,"15min":1.145},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5580000000000001,"5min":1.639,"15min":1.639},"last":1.046},{"interface":"front","average":{"1min":1.365,"5min":1.4259999999999999,"15min":1.3879999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8939999999999999,"5min":1.913,"15min":2.0979999999999999},"last":1.0980000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.337,"15min":1.2589999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.58599999999999997},"max":{"1min":1.9330000000000001,"5min":2.141,"15min":2.141},"last":1.387},{"interface":"front","average":{"1min":1.258,"5min":1.3100000000000001,"15min":1.222},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7210000000000001,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.1339999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.4510000000000001,"15min":1.3620000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.67300000000000004},"max":{"1min":1.992,"5min":2.0089999999999999,"15min":2.1200000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.5329999999999999,"15min":1.4410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.859,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.429}]}]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":684,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194627,"statfs":{"total":200000000,"available":199298832,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90300000000000002,"15min":0.94099999999999995},"min":{"1min":0.55500000000000005,"5min":0.49299999999999999,"15min":0.39800000000000002},"max":{"1min":1.2390000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.878},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.95499999999999996,"15min":0.93300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.262,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.65600000000000003}]},{"osd":1,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.90800000000000003,"15min":0.86899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.528,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.208,"15min":1.1339999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.46200000000000002},"max":{"1min":1.6020000000000001,"5min":1.861,"15min":1.861},"last":1.407}]},{"osd":2,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0669999999999999,"15min":1.042},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5469999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.1859999999999999,"15min":1.137},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.679,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.6419999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.276,"15min":1.2190000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.73199999999999998},"max":{"1min":2.2839999999999998,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.097},{"interface":"front","average":{"1min":1.264,"5min":1.323,"15min":1.2470000000000001},"min":{"1min":0.91000000000000003,"5min":0.77300000000000002,"15min":0.745},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.3320000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3680000000000001,"15min":1.288},"min":{"1min":0.754,"5min":0.754,"15min":0.66700000000000004},"max":{"1min":1.9059999999999999,"5min":1.994,"15min":1.994},"last":1.9059999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.409,"15min":1.427},"min":{"1min":0.84599999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.7949999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.7949999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.478,"15min":1.4470000000000001},"min":{"1min":1.0609999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.964,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.964},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3999999999999999,"15min":1.385},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7849999999999999,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.474}]},{"osd":7,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.456,"15min":1.387},"min":{"1min":0.81299999999999994,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.851,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.4630000000000001,"15min":1.405},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.80600000000000005},"max":{"1min":1.837,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.71}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":678,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194634,"statfs":{"total":200000000,"available":199305256,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95199999999999996,"15min":0.78000000000000003},"min":{"1min":0.54800000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.6789999999999998,"5min":6.8879999999999999,"15min":6.8879999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95599999999999996,"15min":0.94399999999999995},"min":{"1min":0.50600000000000001,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.5069999999999999,"5min":4.5510000000000002,"15min":4.5510000000000002},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":1.038,"15min":0.94399999999999995},"min":{"1min":0.63900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.633,"5min":11.308999999999999,"15min":11.308999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.175,"5min":1.0700000000000001,"15min":0.94499999999999995},"min":{"1min":0.51500000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.252,"15min":1.052},"min":{"1min":0.69799999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5780000000000001,"5min":13.087999999999999,"15min":13.087999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.363,"15min":1.117},"min":{"1min":0.67300000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":3.2959999999999998,"5min":12.289999999999999,"15min":12.289999999999999},"last":0.80300000000000005}]},{"osd":4,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.3899999999999999,"15min":1.258},"min":{"1min":0.94899999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3999999999999999,"15min":1.3560000000000001},"min":{"1min":1.0329999999999999,"5min":0.623,"15min":0.61499999999999999},"max":{"1min":1.6160000000000001,"5min":13.927,"15min":13.927},"last":0.84899999999999998}]},{"osd":5,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.409,"15min":1.379},"min":{"1min":0.91500000000000004,"5min":0.72399999999999998,"15min":0.64000000000000001},"max":{"1min":1.722,"5min":11.003,"15min":11.003},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.298,"5min":1.454,"15min":1.284},"min":{"1min":0.93100000000000005,"5min":0.83699999999999997,"15min":0.79400000000000004},"max":{"1min":2.0470000000000002,"5min":13.129,"15min":13.129},"last":1.1759999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4510000000000001,"15min":1.2909999999999999},"min":{"1min":0.995,"5min":0.77200000000000002,"15min":0.751},"max":{"1min":2.1240000000000001,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.518,"15min":1.383},"min":{"1min":0.97799999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":3.8959999999999999,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":1.03}]},{"osd":7,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.506,"15min":1.399},"min":{"1min":0.97299999999999998,"5min":0.753,"15min":0.61299999999999999},"max":{"1min":1.7729999999999999,"5min":10.948,"15min":10.948},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.5489999999999999,"15min":1.3720000000000001},"min":{"1min":0.90600000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.1789999999999998,"5min":8.0980000000000008,"15min":8.0980000000000008},"last":1.093}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194049,"statfs":{"total":200000000,"available":198706982,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.91200000000000003},"min":{"1min":0.44600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.244,"5min":1.1699999999999999,"15min":1.0529999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":4.2030000000000003,"5min":4.2030000000000003,"15min":4.2030000000000003},"last":1.1080000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.98899999999999999,"15min":0.95699999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4450000000000001,"5min":1.732,"15min":1.732},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.05,"15min":0.97399999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34999999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":2.254},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.331,"15min":1.2050000000000001},"min":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.54000000000000004},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.544},{"interface":"front","average":{"1min":1.087,"5min":1.0720000000000001,"15min":0.99399999999999999},"min":{"1min":0.54000000000000004,"5min":0.497,"15min":0.47799999999999998},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.3009999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3049999999999999,"15min":1.278},"min":{"1min":0.71299999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.518,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.198},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.4359999999999999,"15min":1.3500000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.6910000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.4630000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.2949999999999999,"15min":1.248},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.536,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.4359999999999999,"15min":1.351},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.66800000000000004},"max":{"1min":1.5720000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.4059999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.3600000000000001,"15min":1.28},"min":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.65200000000000002},"max":{"1min":1.5780000000000001,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":1.393},{"interface":"front","average":{"1min":1.367,"5min":1.468,"15min":1.3899999999999999},"min":{"1min":0.80600000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.748,"5min":2.2210000000000001,"15min":2.2229999999999999},"last":1.506}]},{"osd":7,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.496,"15min":1.393},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.64400000000000002},"max":{"1min":1.7889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.369},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.486,"15min":1.4219999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.66200000000000003},"max":{"1min":1.718,"5min":4.508,"15min":4.508},"last":1.2470000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":678,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194634,"statfs":{"total":200000000,"available":199305326,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.871,"15min":0.76300000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.9470000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.97599999999999998,"15min":0.91700000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.88600000000000001,"15min":0.81299999999999994},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.40600000000000003},"max":{"1min":1.341,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0700000000000001,"15min":0.96399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5409999999999999,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.0780000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1739999999999999,"15min":1.056},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.123,"5min":1.234,"15min":1.095},"min":{"1min":0.56999999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.8080000000000001,"5min":2.145,"15min":2.145},"last":0.89400000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3640000000000001,"15min":1.288},"min":{"1min":0.86299999999999999,"5min":0.80600000000000005,"15min":0.70799999999999996},"max":{"1min":2.0910000000000002,"5min":2.625,"15min":2.625},"last":1.339},{"interface":"front","average":{"1min":1.351,"5min":1.3520000000000001,"15min":1.246},"min":{"1min":0.89900000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.964,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.165}]},{"osd":5,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.417,"15min":1.2949999999999999},"min":{"1min":0.71099999999999997,"5min":0.67600000000000005,"15min":0.59299999999999997},"max":{"1min":5.4290000000000003,"5min":5.4290000000000003,"15min":5.4290000000000003},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.373,"15min":1.2889999999999999},"min":{"1min":0.79500000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.0910000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.423}]},{"osd":6,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3919999999999999,"15min":1.304},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.64800000000000002},"max":{"1min":1.8799999999999999,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.488,"15min":1.4099999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.69099999999999995},"max":{"1min":1.8620000000000001,"5min":2.577,"15min":2.577},"last":1.488}]},{"osd":7,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.4770000000000001,"15min":1.3899999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.755},"max":{"1min":1.841,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.4770000000000001,"15min":1.399},"min":{"1min":0.96499999999999997,"5min":0.749,"15min":0.749},"max":{"1min":2.1680000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.623}]}]}],"pool_statfs":[]}} 2023-12-22T08:47:12.052 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:47:12.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.309+0000 7f943a634640 1 Processor -- start 2023-12-22T08:47:12.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.310+0000 7f943a634640 1 -- start start 2023-12-22T08:47:12.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.311+0000 7f943a634640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9434157980 0x7f943415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.311+0000 7f943a634640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94340b3ff0 0x7f943406cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.311+0000 7f943a634640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94340d1520 con 0x7f94340b4470 2023-12-22T08:47:12.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.311+0000 7f943a634640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94340d1800 con 0x7f9434157980 2023-12-22T08:47:12.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.311+0000 7f943a634640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94340d1ae0 con 0x7f94340b3ff0 2023-12-22T08:47:12.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.312+0000 7f9439632640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9434157980 0x7f943415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:12.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.312+0000 7f9439632640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9434157980 0x7f943415eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40928/0 (socket says 172.21.15.38:40928) 2023-12-22T08:47:12.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.312+0000 7f9439632640 1 -- 172.21.15.38:0/170887630 learned_addr learned my addr 172.21.15.38:0/170887630 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:12.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.312+0000 7f9438e31640 1 --2- 172.21.15.38:0/170887630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94340b3ff0 0x7f943406cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:12.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.312+0000 7f9439632640 1 -- 172.21.15.38:0/170887630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94340b3ff0 msgr2=0x7f943406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:12.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.312+0000 7f9439632640 1 --2- 172.21.15.38:0/170887630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94340b3ff0 0x7f943406cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.312+0000 7f9439632640 1 -- 172.21.15.38:0/170887630 >> v1:172.21.15.89:6789/0 conn(0x7f94340b4470 legacy=0x7f94340d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:12.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.312+0000 7f9439632640 1 -- 172.21.15.38:0/170887630 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94340d1dc0 con 0x7f9434157980 2023-12-22T08:47:12.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.312+0000 7f9438e31640 1 --2- 172.21.15.38:0/170887630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94340b3ff0 0x7f943406cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:12.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.313+0000 7f9439632640 1 --2- 172.21.15.38:0/170887630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9434157980 0x7f943415eb10 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f9430009e50 tx=0x7f943002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb0cd993a53c896 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:12.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.314+0000 7f942bfff640 1 -- 172.21.15.38:0/170887630 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943002ca70 con 0x7f9434157980 2023-12-22T08:47:12.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.314+0000 7f942bfff640 1 -- 172.21.15.38:0/170887630 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943002cbd0 con 0x7f9434157980 2023-12-22T08:47:12.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.314+0000 7f942bfff640 1 -- 172.21.15.38:0/170887630 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94300343f0 con 0x7f9434157980 2023-12-22T08:47:12.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.314+0000 7f943a634640 1 -- 172.21.15.38:0/170887630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9434157980 msgr2=0x7f943415eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:12.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.314+0000 7f943a634640 1 --2- 172.21.15.38:0/170887630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9434157980 0x7f943415eb10 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f9430009e50 tx=0x7f943002bed0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.315+0000 7f943a634640 1 -- 172.21.15.38:0/170887630 shutdown_connections 2023-12-22T08:47:12.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.315+0000 7f943a634640 1 --2- 172.21.15.38:0/170887630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94340b3ff0 0x7f943406cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.315+0000 7f943a634640 1 --2- 172.21.15.38:0/170887630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9434157980 0x7f943415eb10 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.315+0000 7f943a634640 1 -- 172.21.15.38:0/170887630 >> 172.21.15.38:0/170887630 conn(0x7f94340d31f0 msgr2=0x7f94340d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:12.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.315+0000 7f943a634640 1 -- 172.21.15.38:0/170887630 shutdown_connections 2023-12-22T08:47:12.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.315+0000 7f943a634640 1 -- 172.21.15.38:0/170887630 wait complete. 2023-12-22T08:47:12.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.316+0000 7f943a634640 1 Processor -- start 2023-12-22T08:47:12.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.317+0000 7f943a634640 1 -- start start 2023-12-22T08:47:12.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f943a634640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94340b3ff0 0x7f9434156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f943a634640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94340b4470 0x7f9434154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f943a634640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9434157980 0x7f943413c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f943a634640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9434161ac0 con 0x7f9434157980 2023-12-22T08:47:12.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f943a634640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94341424e0 con 0x7f94340b3ff0 2023-12-22T08:47:12.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f943a634640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9434160a20 con 0x7f94340b4470 2023-12-22T08:47:12.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f9439e33640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9434157980 0x7f943413c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:12.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f9439e33640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9434157980 0x7f943413c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40936/0 (socket says 172.21.15.38:40936) 2023-12-22T08:47:12.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f9439e33640 1 -- 172.21.15.38:0/411594652 learned_addr learned my addr 172.21.15.38:0/411594652 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:12.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f9439632640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94340b3ff0 0x7f9434156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:12.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f9438e31640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94340b4470 0x7f9434154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:12.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f9439e33640 1 -- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94340b4470 msgr2=0x7f9434154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:12.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f9439e33640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94340b4470 0x7f9434154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f9439e33640 1 -- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94340b3ff0 msgr2=0x7f9434156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:12.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f9439e33640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94340b3ff0 0x7f9434156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f9439e33640 1 -- 172.21.15.38:0/411594652 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430009b30 con 0x7f9434157980 2023-12-22T08:47:12.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.318+0000 7f9439632640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94340b3ff0 0x7f9434156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:12.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.319+0000 7f9439e33640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9434157980 0x7f943413c680 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f942c00c410 tx=0x7f942c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:12.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.319+0000 7f9429ffb640 1 -- 172.21.15.38:0/411594652 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c011790 con 0x7f9434157980 2023-12-22T08:47:12.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.319+0000 7f9429ffb640 1 -- 172.21.15.38:0/411594652 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c0118f0 con 0x7f9434157980 2023-12-22T08:47:12.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.319+0000 7f9429ffb640 1 -- 172.21.15.38:0/411594652 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c011ca0 con 0x7f9434157980 2023-12-22T08:47:12.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.319+0000 7f943a634640 1 -- 172.21.15.38:0/411594652 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9434160d00 con 0x7f9434157980 2023-12-22T08:47:12.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.319+0000 7f943a634640 1 -- 172.21.15.38:0/411594652 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94341612c0 con 0x7f9434157980 2023-12-22T08:47:12.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.320+0000 7f943a634640 1 -- 172.21.15.38:0/411594652 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9434061910 con 0x7f9434157980 2023-12-22T08:47:12.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.321+0000 7f9429ffb640 1 -- 172.21.15.38:0/411594652 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f942c01c460 con 0x7f9434157980 2023-12-22T08:47:12.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.322+0000 7f9429ffb640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f941806a460 0x7f941806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.322+0000 7f9429ffb640 1 -- 172.21.15.38:0/411594652 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f942c0885d0 con 0x7f9434157980 2023-12-22T08:47:12.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.323+0000 7f9439632640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f941806a460 0x7f941806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:12.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.324+0000 7f9439632640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f941806a460 0x7f941806c920 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9430035000 tx=0x7f9430030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:12.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.327+0000 7f9429ffb640 1 -- 172.21.15.38:0/411594652 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f942c053b20 con 0x7f9434157980 2023-12-22T08:47:12.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.517+0000 7f943a634640 1 -- 172.21.15.38:0/411594652 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9434157d60 con 0x7f941806a460 2023-12-22T08:47:12.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.540+0000 7f9429ffb640 1 -- 172.21.15.38:0/411594652 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283100 (secure 0 0 0) 0x7f94300343f0 con 0x7f941806a460 2023-12-22T08:47:12.546 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:12.548 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:47:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.547+0000 7f943a634640 1 -- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f941806a460 msgr2=0x7f941806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.547+0000 7f943a634640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f941806a460 0x7f941806c920 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9430035000 tx=0x7f9430030000 comp rx=0 tx=0).stop 2023-12-22T08:47:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.547+0000 7f943a634640 1 -- 172.21.15.38:0/411594652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9434157980 msgr2=0x7f943413c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.547+0000 7f943a634640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9434157980 0x7f943413c680 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f942c00c410 tx=0x7f942c00c8d0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.547+0000 7f943a634640 1 -- 172.21.15.38:0/411594652 shutdown_connections 2023-12-22T08:47:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.547+0000 7f943a634640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f941806a460 0x7f941806c920 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.547+0000 7f943a634640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9434157980 0x7f943413c680 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.547+0000 7f943a634640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94340b4470 0x7f9434154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.547+0000 7f943a634640 1 --2- 172.21.15.38:0/411594652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94340b3ff0 0x7f9434156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.547+0000 7f943a634640 1 -- 172.21.15.38:0/411594652 >> 172.21.15.38:0/411594652 conn(0x7f94340d31f0 msgr2=0x7f943406f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:12.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.548+0000 7f943a634640 1 -- 172.21.15.38:0/411594652 shutdown_connections 2023-12-22T08:47:12.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.548+0000 7f943a634640 1 -- 172.21.15.38:0/411594652 wait complete. 2023-12-22T08:47:12.569 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2023-12-22T08:47:12.514130+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6596,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555903,"statfs":{"total":1600000000,"available":1593245567,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002095"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047778+0000","last_change":"2023-12-22T08:47:07.062786+0000","last_active":"2023-12-22T08:47:08.047778+0000","last_peered":"2023-12-22T08:47:08.047778+0000","last_clean":"2023-12-22T08:47:08.047778+0000","last_became_active":"2023-12-22T08:47:07.061375+0000","last_became_peered":"2023-12-22T08:47:07.061375+0000","last_unstale":"2023-12-22T08:47:08.047778+0000","last_undegraded":"2023-12-22T08:47:08.047778+0000","last_fullsized":"2023-12-22T08:47:08.047778+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:04:37.592731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047697+0000","last_change":"2023-12-22T08:47:07.067559+0000","last_active":"2023-12-22T08:47:08.047697+0000","last_peered":"2023-12-22T08:47:08.047697+0000","last_clean":"2023-12-22T08:47:08.047697+0000","last_became_active":"2023-12-22T08:47:07.066725+0000","last_became_peered":"2023-12-22T08:47:07.066725+0000","last_unstale":"2023-12-22T08:47:08.047697+0000","last_undegraded":"2023-12-22T08:47:08.047697+0000","last_fullsized":"2023-12-22T08:47:08.047697+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:24:49.917274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305200+0000","last_change":"2023-12-22T08:47:07.069899+0000","last_active":"2023-12-22T08:47:08.305200+0000","last_peered":"2023-12-22T08:47:08.305200+0000","last_clean":"2023-12-22T08:47:08.305200+0000","last_became_active":"2023-12-22T08:47:07.068657+0000","last_became_peered":"2023-12-22T08:47:07.068657+0000","last_unstale":"2023-12-22T08:47:08.305200+0000","last_undegraded":"2023-12-22T08:47:08.305200+0000","last_fullsized":"2023-12-22T08:47:08.305200+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:31:19.386328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047810+0000","last_change":"2023-12-22T08:47:07.075128+0000","last_active":"2023-12-22T08:47:08.047810+0000","last_peered":"2023-12-22T08:47:08.047810+0000","last_clean":"2023-12-22T08:47:08.047810+0000","last_became_active":"2023-12-22T08:47:07.074873+0000","last_became_peered":"2023-12-22T08:47:07.074873+0000","last_unstale":"2023-12-22T08:47:08.047810+0000","last_undegraded":"2023-12-22T08:47:08.047810+0000","last_fullsized":"2023-12-22T08:47:08.047810+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:03:30.291361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050994+0000","last_change":"2023-12-22T08:47:07.055373+0000","last_active":"2023-12-22T08:47:08.050994+0000","last_peered":"2023-12-22T08:47:08.050994+0000","last_clean":"2023-12-22T08:47:08.050994+0000","last_became_active":"2023-12-22T08:47:07.055107+0000","last_became_peered":"2023-12-22T08:47:07.055107+0000","last_unstale":"2023-12-22T08:47:08.050994+0000","last_undegraded":"2023-12-22T08:47:08.050994+0000","last_fullsized":"2023-12-22T08:47:08.050994+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:38:44.532290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050653+0000","last_change":"2023-12-22T08:47:07.063641+0000","last_active":"2023-12-22T08:47:08.050653+0000","last_peered":"2023-12-22T08:47:08.050653+0000","last_clean":"2023-12-22T08:47:08.050653+0000","last_became_active":"2023-12-22T08:47:07.062799+0000","last_became_peered":"2023-12-22T08:47:07.062799+0000","last_unstale":"2023-12-22T08:47:08.050653+0000","last_undegraded":"2023-12-22T08:47:08.050653+0000","last_fullsized":"2023-12-22T08:47:08.050653+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:39:16.057923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050571+0000","last_change":"2023-12-22T08:47:07.059439+0000","last_active":"2023-12-22T08:47:08.050571+0000","last_peered":"2023-12-22T08:47:08.050571+0000","last_clean":"2023-12-22T08:47:08.050571+0000","last_became_active":"2023-12-22T08:47:07.059166+0000","last_became_peered":"2023-12-22T08:47:07.059166+0000","last_unstale":"2023-12-22T08:47:08.050571+0000","last_undegraded":"2023-12-22T08:47:08.050571+0000","last_fullsized":"2023-12-22T08:47:08.050571+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:51:50.669403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305479+0000","last_change":"2023-12-22T08:47:07.070172+0000","last_active":"2023-12-22T08:47:08.305479+0000","last_peered":"2023-12-22T08:47:08.305479+0000","last_clean":"2023-12-22T08:47:08.305479+0000","last_became_active":"2023-12-22T08:47:07.069671+0000","last_became_peered":"2023-12-22T08:47:07.069671+0000","last_unstale":"2023-12-22T08:47:08.305479+0000","last_undegraded":"2023-12-22T08:47:08.305479+0000","last_fullsized":"2023-12-22T08:47:08.305479+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:35:43.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.049880+0000","last_change":"2023-12-22T08:47:07.066670+0000","last_active":"2023-12-22T08:47:08.049880+0000","last_peered":"2023-12-22T08:47:08.049880+0000","last_clean":"2023-12-22T08:47:08.049880+0000","last_became_active":"2023-12-22T08:47:07.065840+0000","last_became_peered":"2023-12-22T08:47:07.065840+0000","last_unstale":"2023-12-22T08:47:08.049880+0000","last_undegraded":"2023-12-22T08:47:08.049880+0000","last_fullsized":"2023-12-22T08:47:08.049880+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:01:16.551578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.304305+0000","last_change":"2023-12-22T08:47:07.070923+0000","last_active":"2023-12-22T08:47:08.304305+0000","last_peered":"2023-12-22T08:47:08.304305+0000","last_clean":"2023-12-22T08:47:08.304305+0000","last_became_active":"2023-12-22T08:47:07.070686+0000","last_became_peered":"2023-12-22T08:47:07.070686+0000","last_unstale":"2023-12-22T08:47:08.304305+0000","last_undegraded":"2023-12-22T08:47:08.304305+0000","last_fullsized":"2023-12-22T08:47:08.304305+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:37.116288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050768+0000","last_change":"2023-12-22T08:47:07.063508+0000","last_active":"2023-12-22T08:47:08.050768+0000","last_peered":"2023-12-22T08:47:08.050768+0000","last_clean":"2023-12-22T08:47:08.050768+0000","last_became_active":"2023-12-22T08:47:07.062505+0000","last_became_peered":"2023-12-22T08:47:07.062505+0000","last_unstale":"2023-12-22T08:47:08.050768+0000","last_undegraded":"2023-12-22T08:47:08.050768+0000","last_fullsized":"2023-12-22T08:47:08.050768+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:30.761903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047473+0000","last_change":"2023-12-22T08:47:07.060915+0000","last_active":"2023-12-22T08:47:08.047473+0000","last_peered":"2023-12-22T08:47:08.047473+0000","last_clean":"2023-12-22T08:47:08.047473+0000","last_became_active":"2023-12-22T08:47:07.060190+0000","last_became_peered":"2023-12-22T08:47:07.060190+0000","last_unstale":"2023-12-22T08:47:08.047473+0000","last_undegraded":"2023-12-22T08:47:08.047473+0000","last_fullsized":"2023-12-22T08:47:08.047473+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:04:37.592731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.135894+0000","last_change":"2023-12-22T08:47:07.058609+0000","last_active":"2023-12-22T08:47:08.135894+0000","last_peered":"2023-12-22T08:47:08.135894+0000","last_clean":"2023-12-22T08:47:08.135894+0000","last_became_active":"2023-12-22T08:47:07.058039+0000","last_became_peered":"2023-12-22T08:47:07.058039+0000","last_unstale":"2023-12-22T08:47:08.135894+0000","last_undegraded":"2023-12-22T08:47:08.135894+0000","last_fullsized":"2023-12-22T08:47:08.135894+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:42:48.216242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048108+0000","last_change":"2023-12-22T08:47:07.068178+0000","last_active":"2023-12-22T08:47:08.048108+0000","last_peered":"2023-12-22T08:47:08.048108+0000","last_clean":"2023-12-22T08:47:08.048108+0000","last_became_active":"2023-12-22T08:47:07.067347+0000","last_became_peered":"2023-12-22T08:47:07.067347+0000","last_unstale":"2023-12-22T08:47:08.048108+0000","last_undegraded":"2023-12-22T08:47:08.048108+0000","last_fullsized":"2023-12-22T08:47:08.048108+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:41.877264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048508+0000","last_change":"2023-12-22T08:47:07.074340+0000","last_active":"2023-12-22T08:47:08.048508+0000","last_peered":"2023-12-22T08:47:08.048508+0000","last_clean":"2023-12-22T08:47:08.048508+0000","last_became_active":"2023-12-22T08:47:07.073544+0000","last_became_peered":"2023-12-22T08:47:07.073544+0000","last_unstale":"2023-12-22T08:47:08.048508+0000","last_undegraded":"2023-12-22T08:47:08.048508+0000","last_fullsized":"2023-12-22T08:47:08.048508+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:49:11.191400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050892+0000","last_change":"2023-12-22T08:47:07.063787+0000","last_active":"2023-12-22T08:47:08.050892+0000","last_peered":"2023-12-22T08:47:08.050892+0000","last_clean":"2023-12-22T08:47:08.050892+0000","last_became_active":"2023-12-22T08:47:07.063303+0000","last_became_peered":"2023-12-22T08:47:07.063303+0000","last_unstale":"2023-12-22T08:47:08.050892+0000","last_undegraded":"2023-12-22T08:47:08.050892+0000","last_fullsized":"2023-12-22T08:47:08.050892+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:25:21.999245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305625+0000","last_change":"2023-12-22T08:47:07.070280+0000","last_active":"2023-12-22T08:47:08.305625+0000","last_peered":"2023-12-22T08:47:08.305625+0000","last_clean":"2023-12-22T08:47:08.305625+0000","last_became_active":"2023-12-22T08:47:07.070047+0000","last_became_peered":"2023-12-22T08:47:07.070047+0000","last_unstale":"2023-12-22T08:47:08.305625+0000","last_undegraded":"2023-12-22T08:47:08.305625+0000","last_fullsized":"2023-12-22T08:47:08.305625+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:05:29.406949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047838+0000","last_change":"2023-12-22T08:47:07.069199+0000","last_active":"2023-12-22T08:47:08.047838+0000","last_peered":"2023-12-22T08:47:08.047838+0000","last_clean":"2023-12-22T08:47:08.047838+0000","last_became_active":"2023-12-22T08:47:07.068957+0000","last_became_peered":"2023-12-22T08:47:07.068957+0000","last_unstale":"2023-12-22T08:47:08.047838+0000","last_undegraded":"2023-12-22T08:47:08.047838+0000","last_fullsized":"2023-12-22T08:47:08.047838+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:33.526112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305459+0000","last_change":"2023-12-22T08:47:07.076956+0000","last_active":"2023-12-22T08:47:08.305459+0000","last_peered":"2023-12-22T08:47:08.305459+0000","last_clean":"2023-12-22T08:47:08.305459+0000","last_became_active":"2023-12-22T08:47:07.076272+0000","last_became_peered":"2023-12-22T08:47:07.076272+0000","last_unstale":"2023-12-22T08:47:08.305459+0000","last_undegraded":"2023-12-22T08:47:08.305459+0000","last_fullsized":"2023-12-22T08:47:08.305459+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:59:39.879275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.046927+0000","last_change":"2023-12-22T08:47:07.071512+0000","last_active":"2023-12-22T08:47:08.046927+0000","last_peered":"2023-12-22T08:47:08.046927+0000","last_clean":"2023-12-22T08:47:08.046927+0000","last_became_active":"2023-12-22T08:47:07.071246+0000","last_became_peered":"2023-12-22T08:47:07.071246+0000","last_unstale":"2023-12-22T08:47:08.046927+0000","last_undegraded":"2023-12-22T08:47:08.046927+0000","last_fullsized":"2023-12-22T08:47:08.046927+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:37:23.550550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.307129+0000","last_change":"2023-12-22T08:47:07.070984+0000","last_active":"2023-12-22T08:47:08.307129+0000","last_peered":"2023-12-22T08:47:08.307129+0000","last_clean":"2023-12-22T08:47:08.307129+0000","last_became_active":"2023-12-22T08:47:07.067968+0000","last_became_peered":"2023-12-22T08:47:07.067968+0000","last_unstale":"2023-12-22T08:47:08.307129+0000","last_undegraded":"2023-12-22T08:47:08.307129+0000","last_fullsized":"2023-12-22T08:47:08.307129+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:54:41.176967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305735+0000","last_change":"2023-12-22T08:47:07.068990+0000","last_active":"2023-12-22T08:47:08.305735+0000","last_peered":"2023-12-22T08:47:08.305735+0000","last_clean":"2023-12-22T08:47:08.305735+0000","last_became_active":"2023-12-22T08:47:07.068718+0000","last_became_peered":"2023-12-22T08:47:07.068718+0000","last_unstale":"2023-12-22T08:47:08.305735+0000","last_undegraded":"2023-12-22T08:47:08.305735+0000","last_fullsized":"2023-12-22T08:47:08.305735+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:10.578674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048197+0000","last_change":"2023-12-22T08:47:07.065581+0000","last_active":"2023-12-22T08:47:08.048197+0000","last_peered":"2023-12-22T08:47:08.048197+0000","last_clean":"2023-12-22T08:47:08.048197+0000","last_became_active":"2023-12-22T08:47:07.065325+0000","last_became_peered":"2023-12-22T08:47:07.065325+0000","last_unstale":"2023-12-22T08:47:08.048197+0000","last_undegraded":"2023-12-22T08:47:08.048197+0000","last_fullsized":"2023-12-22T08:47:08.048197+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:18:56.111546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305437+0000","last_change":"2023-12-22T08:47:07.070953+0000","last_active":"2023-12-22T08:47:08.305437+0000","last_peered":"2023-12-22T08:47:08.305437+0000","last_clean":"2023-12-22T08:47:08.305437+0000","last_became_active":"2023-12-22T08:47:07.070795+0000","last_became_peered":"2023-12-22T08:47:07.070795+0000","last_unstale":"2023-12-22T08:47:08.305437+0000","last_undegraded":"2023-12-22T08:47:08.305437+0000","last_fullsized":"2023-12-22T08:47:08.305437+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:59:39.879275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.304099+0000","last_change":"2023-12-22T08:47:07.068322+0000","last_active":"2023-12-22T08:47:08.304099+0000","last_peered":"2023-12-22T08:47:08.304099+0000","last_clean":"2023-12-22T08:47:08.304099+0000","last_became_active":"2023-12-22T08:47:07.068096+0000","last_became_peered":"2023-12-22T08:47:07.068096+0000","last_unstale":"2023-12-22T08:47:08.304099+0000","last_undegraded":"2023-12-22T08:47:08.304099+0000","last_fullsized":"2023-12-22T08:47:08.304099+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:37:23.550550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.136228+0000","last_change":"2023-12-22T08:47:07.064979+0000","last_active":"2023-12-22T08:47:08.136228+0000","last_peered":"2023-12-22T08:47:08.136228+0000","last_clean":"2023-12-22T08:47:08.136228+0000","last_became_active":"2023-12-22T08:47:07.063994+0000","last_became_peered":"2023-12-22T08:47:07.063994+0000","last_unstale":"2023-12-22T08:47:08.136228+0000","last_undegraded":"2023-12-22T08:47:08.136228+0000","last_fullsized":"2023-12-22T08:47:08.136228+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:45.977176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306258+0000","last_change":"2023-12-22T08:47:07.066934+0000","last_active":"2023-12-22T08:47:08.306258+0000","last_peered":"2023-12-22T08:47:08.306258+0000","last_clean":"2023-12-22T08:47:08.306258+0000","last_became_active":"2023-12-22T08:47:07.066732+0000","last_became_peered":"2023-12-22T08:47:07.066732+0000","last_unstale":"2023-12-22T08:47:08.306258+0000","last_undegraded":"2023-12-22T08:47:08.306258+0000","last_fullsized":"2023-12-22T08:47:08.306258+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:10.578674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305715+0000","last_change":"2023-12-22T08:47:07.068856+0000","last_active":"2023-12-22T08:47:08.305715+0000","last_peered":"2023-12-22T08:47:08.305715+0000","last_clean":"2023-12-22T08:47:08.305715+0000","last_became_active":"2023-12-22T08:47:07.068637+0000","last_became_peered":"2023-12-22T08:47:07.068637+0000","last_unstale":"2023-12-22T08:47:08.305715+0000","last_undegraded":"2023-12-22T08:47:08.305715+0000","last_fullsized":"2023-12-22T08:47:08.305715+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:31:19.386328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.136034+0000","last_change":"2023-12-22T08:47:07.069111+0000","last_active":"2023-12-22T08:47:08.136034+0000","last_peered":"2023-12-22T08:47:08.136034+0000","last_clean":"2023-12-22T08:47:08.136034+0000","last_became_active":"2023-12-22T08:47:07.068725+0000","last_became_peered":"2023-12-22T08:47:07.068725+0000","last_unstale":"2023-12-22T08:47:08.136034+0000","last_undegraded":"2023-12-22T08:47:08.136034+0000","last_fullsized":"2023-12-22T08:47:08.136034+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:38.082746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.135937+0000","last_change":"2023-12-22T08:47:07.072183+0000","last_active":"2023-12-22T08:47:08.135937+0000","last_peered":"2023-12-22T08:47:08.135937+0000","last_clean":"2023-12-22T08:47:08.135937+0000","last_became_active":"2023-12-22T08:47:07.071832+0000","last_became_peered":"2023-12-22T08:47:07.071832+0000","last_unstale":"2023-12-22T08:47:08.135937+0000","last_undegraded":"2023-12-22T08:47:08.135937+0000","last_fullsized":"2023-12-22T08:47:08.135937+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:25:33.453738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.307356+0000","last_change":"2023-12-22T08:47:07.071192+0000","last_active":"2023-12-22T08:47:08.307356+0000","last_peered":"2023-12-22T08:47:08.307356+0000","last_clean":"2023-12-22T08:47:08.307356+0000","last_became_active":"2023-12-22T08:47:07.068224+0000","last_became_peered":"2023-12-22T08:47:07.068224+0000","last_unstale":"2023-12-22T08:47:08.307356+0000","last_undegraded":"2023-12-22T08:47:08.307356+0000","last_fullsized":"2023-12-22T08:47:08.307356+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:06.024340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048384+0000","last_change":"2023-12-22T08:47:07.075962+0000","last_active":"2023-12-22T08:47:08.048384+0000","last_peered":"2023-12-22T08:47:08.048384+0000","last_clean":"2023-12-22T08:47:08.048384+0000","last_became_active":"2023-12-22T08:47:07.075369+0000","last_became_peered":"2023-12-22T08:47:07.075369+0000","last_unstale":"2023-12-22T08:47:08.048384+0000","last_undegraded":"2023-12-22T08:47:08.048384+0000","last_fullsized":"2023-12-22T08:47:08.048384+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:16.806099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305705+0000","last_change":"2023-12-22T08:47:07.068777+0000","last_active":"2023-12-22T08:47:08.305705+0000","last_peered":"2023-12-22T08:47:08.305705+0000","last_clean":"2023-12-22T08:47:08.305705+0000","last_became_active":"2023-12-22T08:47:07.066487+0000","last_became_peered":"2023-12-22T08:47:07.066487+0000","last_unstale":"2023-12-22T08:47:08.305705+0000","last_undegraded":"2023-12-22T08:47:08.305705+0000","last_fullsized":"2023-12-22T08:47:08.305705+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:27:18.998252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"126'4","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.136282+0000","last_change":"2023-12-22T08:47:06.550562+0000","last_active":"2023-12-22T08:47:08.136282+0000","last_peered":"2023-12-22T08:47:08.136282+0000","last_clean":"2023-12-22T08:47:08.136282+0000","last_became_active":"2023-12-22T08:47:06.549981+0000","last_became_peered":"2023-12-22T08:47:06.549981+0000","last_unstale":"2023-12-22T08:47:08.136282+0000","last_undegraded":"2023-12-22T08:47:08.136282+0000","last_fullsized":"2023-12-22T08:47:08.136282+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:01:24.014343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.136157+0000","last_change":"2023-12-22T08:47:07.065557+0000","last_active":"2023-12-22T08:47:08.136157+0000","last_peered":"2023-12-22T08:47:08.136157+0000","last_clean":"2023-12-22T08:47:08.136157+0000","last_became_active":"2023-12-22T08:47:07.065196+0000","last_became_peered":"2023-12-22T08:47:07.065196+0000","last_unstale":"2023-12-22T08:47:08.136157+0000","last_undegraded":"2023-12-22T08:47:08.136157+0000","last_fullsized":"2023-12-22T08:47:08.136157+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:36.964162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"126'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050124+0000","last_change":"2023-12-22T08:47:06.557212+0000","last_active":"2023-12-22T08:47:08.050124+0000","last_peered":"2023-12-22T08:47:08.050124+0000","last_clean":"2023-12-22T08:47:08.050124+0000","last_became_active":"2023-12-22T08:47:06.556296+0000","last_became_peered":"2023-12-22T08:47:06.556296+0000","last_unstale":"2023-12-22T08:47:08.050124+0000","last_undegraded":"2023-12-22T08:47:08.050124+0000","last_fullsized":"2023-12-22T08:47:08.050124+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:40:39.182636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048644+0000","last_change":"2023-12-22T08:47:07.063047+0000","last_active":"2023-12-22T08:47:08.048644+0000","last_peered":"2023-12-22T08:47:08.048644+0000","last_clean":"2023-12-22T08:47:08.048644+0000","last_became_active":"2023-12-22T08:47:07.062098+0000","last_became_peered":"2023-12-22T08:47:07.062098+0000","last_unstale":"2023-12-22T08:47:08.048644+0000","last_undegraded":"2023-12-22T08:47:08.048644+0000","last_fullsized":"2023-12-22T08:47:08.048644+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:37:23.550550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"126'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.307032+0000","last_change":"2023-12-22T08:47:06.558416+0000","last_active":"2023-12-22T08:47:08.307032+0000","last_peered":"2023-12-22T08:47:08.307032+0000","last_clean":"2023-12-22T08:47:08.307032+0000","last_became_active":"2023-12-22T08:47:06.557919+0000","last_became_peered":"2023-12-22T08:47:06.557919+0000","last_unstale":"2023-12-22T08:47:08.307032+0000","last_undegraded":"2023-12-22T08:47:08.307032+0000","last_fullsized":"2023-12-22T08:47:08.307032+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:40.854777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.304429+0000","last_change":"2023-12-22T08:47:07.060622+0000","last_active":"2023-12-22T08:47:08.304429+0000","last_peered":"2023-12-22T08:47:08.304429+0000","last_clean":"2023-12-22T08:47:08.304429+0000","last_became_active":"2023-12-22T08:47:07.060343+0000","last_became_peered":"2023-12-22T08:47:07.060343+0000","last_unstale":"2023-12-22T08:47:08.304429+0000","last_undegraded":"2023-12-22T08:47:08.304429+0000","last_fullsized":"2023-12-22T08:47:08.304429+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:06:43.135406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"126'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.049271+0000","last_change":"2023-12-22T08:47:06.557847+0000","last_active":"2023-12-22T08:47:08.049271+0000","last_peered":"2023-12-22T08:47:08.049271+0000","last_clean":"2023-12-22T08:47:08.049271+0000","last_became_active":"2023-12-22T08:47:06.557225+0000","last_became_peered":"2023-12-22T08:47:06.557225+0000","last_unstale":"2023-12-22T08:47:08.049271+0000","last_undegraded":"2023-12-22T08:47:08.049271+0000","last_fullsized":"2023-12-22T08:47:08.049271+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:35.941675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047120+0000","last_change":"2023-12-22T08:47:07.059988+0000","last_active":"2023-12-22T08:47:08.047120+0000","last_peered":"2023-12-22T08:47:08.047120+0000","last_clean":"2023-12-22T08:47:08.047120+0000","last_became_active":"2023-12-22T08:47:07.059667+0000","last_became_peered":"2023-12-22T08:47:07.059667+0000","last_unstale":"2023-12-22T08:47:08.047120+0000","last_undegraded":"2023-12-22T08:47:08.047120+0000","last_fullsized":"2023-12-22T08:47:08.047120+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:52:50.825609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"126'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048603+0000","last_change":"2023-12-22T08:47:06.550601+0000","last_active":"2023-12-22T08:47:08.048603+0000","last_peered":"2023-12-22T08:47:08.048603+0000","last_clean":"2023-12-22T08:47:08.048603+0000","last_became_active":"2023-12-22T08:47:06.549937+0000","last_became_peered":"2023-12-22T08:47:06.549937+0000","last_unstale":"2023-12-22T08:47:08.048603+0000","last_undegraded":"2023-12-22T08:47:08.048603+0000","last_fullsized":"2023-12-22T08:47:08.048603+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:43:10.157292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050826+0000","last_change":"2023-12-22T08:47:07.057439+0000","last_active":"2023-12-22T08:47:08.050826+0000","last_peered":"2023-12-22T08:47:08.050826+0000","last_clean":"2023-12-22T08:47:08.050826+0000","last_became_active":"2023-12-22T08:47:07.057171+0000","last_became_peered":"2023-12-22T08:47:07.057171+0000","last_unstale":"2023-12-22T08:47:08.050826+0000","last_undegraded":"2023-12-22T08:47:08.050826+0000","last_fullsized":"2023-12-22T08:47:08.050826+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:19.691796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"126'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306835+0000","last_change":"2023-12-22T08:47:06.547898+0000","last_active":"2023-12-22T08:47:08.306835+0000","last_peered":"2023-12-22T08:47:08.306835+0000","last_clean":"2023-12-22T08:47:08.306835+0000","last_became_active":"2023-12-22T08:47:06.547393+0000","last_became_peered":"2023-12-22T08:47:06.547393+0000","last_unstale":"2023-12-22T08:47:08.306835+0000","last_undegraded":"2023-12-22T08:47:08.306835+0000","last_fullsized":"2023-12-22T08:47:08.306835+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:15.783613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.136113+0000","last_change":"2023-12-22T08:47:07.073780+0000","last_active":"2023-12-22T08:47:08.136113+0000","last_peered":"2023-12-22T08:47:08.136113+0000","last_clean":"2023-12-22T08:47:08.136113+0000","last_became_active":"2023-12-22T08:47:07.072920+0000","last_became_peered":"2023-12-22T08:47:07.072920+0000","last_unstale":"2023-12-22T08:47:08.136113+0000","last_undegraded":"2023-12-22T08:47:08.136113+0000","last_fullsized":"2023-12-22T08:47:08.136113+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:23.312141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050322+0000","last_change":"2023-12-22T08:47:06.556986+0000","last_active":"2023-12-22T08:47:08.050322+0000","last_peered":"2023-12-22T08:47:08.050322+0000","last_clean":"2023-12-22T08:47:08.050322+0000","last_became_active":"2023-12-22T08:47:06.555952+0000","last_became_peered":"2023-12-22T08:47:06.555952+0000","last_unstale":"2023-12-22T08:47:08.050322+0000","last_undegraded":"2023-12-22T08:47:08.050322+0000","last_fullsized":"2023-12-22T08:47:08.050322+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:16.557590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.046686+0000","last_change":"2023-12-22T08:47:07.059860+0000","last_active":"2023-12-22T08:47:08.046686+0000","last_peered":"2023-12-22T08:47:08.046686+0000","last_clean":"2023-12-22T08:47:08.046686+0000","last_became_active":"2023-12-22T08:47:07.059508+0000","last_became_peered":"2023-12-22T08:47:07.059508+0000","last_unstale":"2023-12-22T08:47:08.046686+0000","last_undegraded":"2023-12-22T08:47:08.046686+0000","last_fullsized":"2023-12-22T08:47:08.046686+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:24:49.917274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306941+0000","last_change":"2023-12-22T08:47:06.558573+0000","last_active":"2023-12-22T08:47:08.306941+0000","last_peered":"2023-12-22T08:47:08.306941+0000","last_clean":"2023-12-22T08:47:08.306941+0000","last_became_active":"2023-12-22T08:47:06.558257+0000","last_became_peered":"2023-12-22T08:47:06.558257+0000","last_unstale":"2023-12-22T08:47:08.306941+0000","last_undegraded":"2023-12-22T08:47:08.306941+0000","last_fullsized":"2023-12-22T08:47:08.306941+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:01:15.783613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047961+0000","last_change":"2023-12-22T08:47:07.076131+0000","last_active":"2023-12-22T08:47:08.047961+0000","last_peered":"2023-12-22T08:47:08.047961+0000","last_clean":"2023-12-22T08:47:08.047961+0000","last_became_active":"2023-12-22T08:47:07.075661+0000","last_became_peered":"2023-12-22T08:47:07.075661+0000","last_unstale":"2023-12-22T08:47:08.047961+0000","last_undegraded":"2023-12-22T08:47:08.047961+0000","last_fullsized":"2023-12-22T08:47:08.047961+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:48.083935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.307877+0000","last_change":"2023-12-22T08:47:06.549699+0000","last_active":"2023-12-22T08:47:08.307877+0000","last_peered":"2023-12-22T08:47:08.307877+0000","last_clean":"2023-12-22T08:47:08.307877+0000","last_became_active":"2023-12-22T08:47:06.549247+0000","last_became_peered":"2023-12-22T08:47:06.549247+0000","last_unstale":"2023-12-22T08:47:08.307877+0000","last_undegraded":"2023-12-22T08:47:08.307877+0000","last_fullsized":"2023-12-22T08:47:08.307877+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:49.232801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305688+0000","last_change":"2023-12-22T08:47:07.056676+0000","last_active":"2023-12-22T08:47:08.305688+0000","last_peered":"2023-12-22T08:47:08.305688+0000","last_clean":"2023-12-22T08:47:08.305688+0000","last_became_active":"2023-12-22T08:47:07.056447+0000","last_became_peered":"2023-12-22T08:47:07.056447+0000","last_unstale":"2023-12-22T08:47:08.305688+0000","last_undegraded":"2023-12-22T08:47:08.305688+0000","last_fullsized":"2023-12-22T08:47:08.305688+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:34:00.380882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048830+0000","last_change":"2023-12-22T08:47:06.555833+0000","last_active":"2023-12-22T08:47:08.048830+0000","last_peered":"2023-12-22T08:47:08.048830+0000","last_clean":"2023-12-22T08:47:08.048830+0000","last_became_active":"2023-12-22T08:47:06.555566+0000","last_became_peered":"2023-12-22T08:47:06.555566+0000","last_unstale":"2023-12-22T08:47:08.048830+0000","last_undegraded":"2023-12-22T08:47:08.048830+0000","last_fullsized":"2023-12-22T08:47:08.048830+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:42.780725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050000+0000","last_change":"2023-12-22T08:47:07.060763+0000","last_active":"2023-12-22T08:47:08.050000+0000","last_peered":"2023-12-22T08:47:08.050000+0000","last_clean":"2023-12-22T08:47:08.050000+0000","last_became_active":"2023-12-22T08:47:07.060551+0000","last_became_peered":"2023-12-22T08:47:07.060551+0000","last_unstale":"2023-12-22T08:47:08.050000+0000","last_undegraded":"2023-12-22T08:47:08.050000+0000","last_fullsized":"2023-12-22T08:47:08.050000+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:22:57.400623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"126'3","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050021+0000","last_change":"2023-12-22T08:47:06.553389+0000","last_active":"2023-12-22T08:47:08.050021+0000","last_peered":"2023-12-22T08:47:08.050021+0000","last_clean":"2023-12-22T08:47:08.050021+0000","last_became_active":"2023-12-22T08:47:06.553100+0000","last_became_peered":"2023-12-22T08:47:06.553100+0000","last_unstale":"2023-12-22T08:47:08.050021+0000","last_undegraded":"2023-12-22T08:47:08.050021+0000","last_fullsized":"2023-12-22T08:47:08.050021+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:02:29.135480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305968+0000","last_change":"2023-12-22T08:47:07.065345+0000","last_active":"2023-12-22T08:47:08.305968+0000","last_peered":"2023-12-22T08:47:08.305968+0000","last_clean":"2023-12-22T08:47:08.305968+0000","last_became_active":"2023-12-22T08:47:07.065124+0000","last_became_peered":"2023-12-22T08:47:07.065124+0000","last_unstale":"2023-12-22T08:47:08.305968+0000","last_undegraded":"2023-12-22T08:47:08.305968+0000","last_fullsized":"2023-12-22T08:47:08.305968+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:06.024340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"126'6","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.046938+0000","last_change":"2023-12-22T08:47:06.553459+0000","last_active":"2023-12-22T08:47:08.046938+0000","last_peered":"2023-12-22T08:47:08.046938+0000","last_clean":"2023-12-22T08:47:08.046938+0000","last_became_active":"2023-12-22T08:47:06.553009+0000","last_became_peered":"2023-12-22T08:47:06.553009+0000","last_unstale":"2023-12-22T08:47:08.046938+0000","last_undegraded":"2023-12-22T08:47:08.046938+0000","last_fullsized":"2023-12-22T08:47:08.046938+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:52:22.289654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048878+0000","last_change":"2023-12-22T08:47:07.062557+0000","last_active":"2023-12-22T08:47:08.048878+0000","last_peered":"2023-12-22T08:47:08.048878+0000","last_clean":"2023-12-22T08:47:08.048878+0000","last_became_active":"2023-12-22T08:47:07.060705+0000","last_became_peered":"2023-12-22T08:47:07.060705+0000","last_unstale":"2023-12-22T08:47:08.048878+0000","last_undegraded":"2023-12-22T08:47:08.048878+0000","last_fullsized":"2023-12-22T08:47:08.048878+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:52:50.825609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"126'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.307170+0000","last_change":"2023-12-22T08:47:06.549604+0000","last_active":"2023-12-22T08:47:08.307170+0000","last_peered":"2023-12-22T08:47:08.307170+0000","last_clean":"2023-12-22T08:47:08.307170+0000","last_became_active":"2023-12-22T08:47:06.549201+0000","last_became_peered":"2023-12-22T08:47:06.549201+0000","last_unstale":"2023-12-22T08:47:08.307170+0000","last_undegraded":"2023-12-22T08:47:08.307170+0000","last_fullsized":"2023-12-22T08:47:08.307170+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:36.192993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306124+0000","last_change":"2023-12-22T08:47:07.077698+0000","last_active":"2023-12-22T08:47:08.306124+0000","last_peered":"2023-12-22T08:47:08.306124+0000","last_clean":"2023-12-22T08:47:08.306124+0000","last_became_active":"2023-12-22T08:47:07.076381+0000","last_became_peered":"2023-12-22T08:47:07.076381+0000","last_unstale":"2023-12-22T08:47:08.306124+0000","last_undegraded":"2023-12-22T08:47:08.306124+0000","last_fullsized":"2023-12-22T08:47:08.306124+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:02:49.423640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.049377+0000","last_change":"2023-12-22T08:47:06.557648+0000","last_active":"2023-12-22T08:47:08.049377+0000","last_peered":"2023-12-22T08:47:08.049377+0000","last_clean":"2023-12-22T08:47:08.049377+0000","last_became_active":"2023-12-22T08:47:06.556579+0000","last_became_peered":"2023-12-22T08:47:06.556579+0000","last_unstale":"2023-12-22T08:47:08.049377+0000","last_undegraded":"2023-12-22T08:47:08.049377+0000","last_fullsized":"2023-12-22T08:47:08.049377+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:15:16.849545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.049882+0000","last_change":"2023-12-22T08:47:07.058778+0000","last_active":"2023-12-22T08:47:08.049882+0000","last_peered":"2023-12-22T08:47:08.049882+0000","last_clean":"2023-12-22T08:47:08.049882+0000","last_became_active":"2023-12-22T08:47:07.058469+0000","last_became_peered":"2023-12-22T08:47:07.058469+0000","last_unstale":"2023-12-22T08:47:08.049882+0000","last_undegraded":"2023-12-22T08:47:08.049882+0000","last_fullsized":"2023-12-22T08:47:08.049882+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:42:53.662624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047682+0000","last_change":"2023-12-22T08:47:06.546138+0000","last_active":"2023-12-22T08:47:08.047682+0000","last_peered":"2023-12-22T08:47:08.047682+0000","last_clean":"2023-12-22T08:47:08.047682+0000","last_became_active":"2023-12-22T08:47:06.544243+0000","last_became_peered":"2023-12-22T08:47:06.544243+0000","last_unstale":"2023-12-22T08:47:08.047682+0000","last_undegraded":"2023-12-22T08:47:08.047682+0000","last_fullsized":"2023-12-22T08:47:08.047682+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:25:32.431251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305483+0000","last_change":"2023-12-22T08:47:07.067945+0000","last_active":"2023-12-22T08:47:08.305483+0000","last_peered":"2023-12-22T08:47:08.305483+0000","last_clean":"2023-12-22T08:47:08.305483+0000","last_became_active":"2023-12-22T08:47:07.067690+0000","last_became_peered":"2023-12-22T08:47:07.067690+0000","last_unstale":"2023-12-22T08:47:08.305483+0000","last_undegraded":"2023-12-22T08:47:08.305483+0000","last_fullsized":"2023-12-22T08:47:08.305483+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:59:39.879275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"126'8","reported_seq":19,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048437+0000","last_change":"2023-12-22T08:47:06.553248+0000","last_active":"2023-12-22T08:47:08.048437+0000","last_peered":"2023-12-22T08:47:08.048437+0000","last_clean":"2023-12-22T08:47:08.048437+0000","last_became_active":"2023-12-22T08:47:06.552829+0000","last_became_peered":"2023-12-22T08:47:06.552829+0000","last_unstale":"2023-12-22T08:47:08.048437+0000","last_undegraded":"2023-12-22T08:47:08.048437+0000","last_fullsized":"2023-12-22T08:47:08.048437+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:48:33.981473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305632+0000","last_change":"2023-12-22T08:47:07.063051+0000","last_active":"2023-12-22T08:47:08.305632+0000","last_peered":"2023-12-22T08:47:08.305632+0000","last_clean":"2023-12-22T08:47:08.305632+0000","last_became_active":"2023-12-22T08:47:07.062824+0000","last_became_peered":"2023-12-22T08:47:07.062824+0000","last_unstale":"2023-12-22T08:47:08.305632+0000","last_undegraded":"2023-12-22T08:47:08.305632+0000","last_fullsized":"2023-12-22T08:47:08.305632+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:35:43.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"126'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047087+0000","last_change":"2023-12-22T08:47:06.549314+0000","last_active":"2023-12-22T08:47:08.047087+0000","last_peered":"2023-12-22T08:47:08.047087+0000","last_clean":"2023-12-22T08:47:08.047087+0000","last_became_active":"2023-12-22T08:47:06.548973+0000","last_became_peered":"2023-12-22T08:47:06.548973+0000","last_unstale":"2023-12-22T08:47:08.047087+0000","last_undegraded":"2023-12-22T08:47:08.047087+0000","last_fullsized":"2023-12-22T08:47:08.047087+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:42:47.193756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306371+0000","last_change":"2023-12-22T08:47:07.061844+0000","last_active":"2023-12-22T08:47:08.306371+0000","last_peered":"2023-12-22T08:47:08.306371+0000","last_clean":"2023-12-22T08:47:08.306371+0000","last_became_active":"2023-12-22T08:47:07.061244+0000","last_became_peered":"2023-12-22T08:47:07.061244+0000","last_unstale":"2023-12-22T08:47:08.306371+0000","last_undegraded":"2023-12-22T08:47:08.306371+0000","last_fullsized":"2023-12-22T08:47:08.306371+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:27:18.998252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"126'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.051246+0000","last_change":"2023-12-22T08:47:06.551765+0000","last_active":"2023-12-22T08:47:08.051246+0000","last_peered":"2023-12-22T08:47:08.051246+0000","last_clean":"2023-12-22T08:47:08.051246+0000","last_became_active":"2023-12-22T08:47:06.547856+0000","last_became_peered":"2023-12-22T08:47:06.547856+0000","last_unstale":"2023-12-22T08:47:08.051246+0000","last_undegraded":"2023-12-22T08:47:08.051246+0000","last_fullsized":"2023-12-22T08:47:08.051246+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:19:12.174519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.046757+0000","last_change":"2023-12-22T08:47:07.070960+0000","last_active":"2023-12-22T08:47:08.046757+0000","last_peered":"2023-12-22T08:47:08.046757+0000","last_clean":"2023-12-22T08:47:08.046757+0000","last_became_active":"2023-12-22T08:47:07.070740+0000","last_became_peered":"2023-12-22T08:47:07.070740+0000","last_unstale":"2023-12-22T08:47:08.046757+0000","last_undegraded":"2023-12-22T08:47:08.046757+0000","last_fullsized":"2023-12-22T08:47:08.046757+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:37.116288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306964+0000","last_change":"2023-12-22T08:47:06.558293+0000","last_active":"2023-12-22T08:47:08.306964+0000","last_peered":"2023-12-22T08:47:08.306964+0000","last_clean":"2023-12-22T08:47:08.306964+0000","last_became_active":"2023-12-22T08:47:06.557987+0000","last_became_peered":"2023-12-22T08:47:06.557987+0000","last_unstale":"2023-12-22T08:47:08.306964+0000","last_undegraded":"2023-12-22T08:47:08.306964+0000","last_fullsized":"2023-12-22T08:47:08.306964+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:03:29.268874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305925+0000","last_change":"2023-12-22T08:47:07.074674+0000","last_active":"2023-12-22T08:47:08.305925+0000","last_peered":"2023-12-22T08:47:08.305925+0000","last_clean":"2023-12-22T08:47:08.305925+0000","last_became_active":"2023-12-22T08:47:07.074435+0000","last_became_peered":"2023-12-22T08:47:07.074435+0000","last_unstale":"2023-12-22T08:47:08.305925+0000","last_undegraded":"2023-12-22T08:47:08.305925+0000","last_fullsized":"2023-12-22T08:47:08.305925+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:06.024340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"126'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.048673+0000","last_change":"2023-12-22T08:47:06.557467+0000","last_active":"2023-12-22T08:47:08.048673+0000","last_peered":"2023-12-22T08:47:08.048673+0000","last_clean":"2023-12-22T08:47:08.048673+0000","last_became_active":"2023-12-22T08:47:06.557109+0000","last_became_peered":"2023-12-22T08:47:06.557109+0000","last_unstale":"2023-12-22T08:47:08.048673+0000","last_undegraded":"2023-12-22T08:47:08.048673+0000","last_fullsized":"2023-12-22T08:47:08.048673+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:37:07.666881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305459+0000","last_change":"2023-12-22T08:47:07.072443+0000","last_active":"2023-12-22T08:47:08.305459+0000","last_peered":"2023-12-22T08:47:08.305459+0000","last_clean":"2023-12-22T08:47:08.305459+0000","last_became_active":"2023-12-22T08:47:07.072174+0000","last_became_peered":"2023-12-22T08:47:07.072174+0000","last_unstale":"2023-12-22T08:47:08.305459+0000","last_undegraded":"2023-12-22T08:47:08.305459+0000","last_fullsized":"2023-12-22T08:47:08.305459+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:35:43.782485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305755+0000","last_change":"2023-12-22T08:47:06.554789+0000","last_active":"2023-12-22T08:47:08.305755+0000","last_peered":"2023-12-22T08:47:08.305755+0000","last_clean":"2023-12-22T08:47:08.305755+0000","last_became_active":"2023-12-22T08:47:06.553891+0000","last_became_peered":"2023-12-22T08:47:06.553891+0000","last_unstale":"2023-12-22T08:47:08.305755+0000","last_undegraded":"2023-12-22T08:47:08.305755+0000","last_fullsized":"2023-12-22T08:47:08.305755+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:02:44.269557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.049112+0000","last_change":"2023-12-22T08:47:07.070721+0000","last_active":"2023-12-22T08:47:08.049112+0000","last_peered":"2023-12-22T08:47:08.049112+0000","last_clean":"2023-12-22T08:47:08.049112+0000","last_became_active":"2023-12-22T08:47:07.070407+0000","last_became_peered":"2023-12-22T08:47:07.070407+0000","last_unstale":"2023-12-22T08:47:08.049112+0000","last_undegraded":"2023-12-22T08:47:08.049112+0000","last_fullsized":"2023-12-22T08:47:08.049112+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:37.215480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.304558+0000","last_change":"2023-12-22T08:47:06.554930+0000","last_active":"2023-12-22T08:47:08.304558+0000","last_peered":"2023-12-22T08:47:08.304558+0000","last_clean":"2023-12-22T08:47:08.304558+0000","last_became_active":"2023-12-22T08:47:06.554711+0000","last_became_peered":"2023-12-22T08:47:06.554711+0000","last_unstale":"2023-12-22T08:47:08.304558+0000","last_undegraded":"2023-12-22T08:47:08.304558+0000","last_fullsized":"2023-12-22T08:47:08.304558+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:33:20.305807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305716+0000","last_change":"2023-12-22T08:47:07.072114+0000","last_active":"2023-12-22T08:47:08.305716+0000","last_peered":"2023-12-22T08:47:08.305716+0000","last_clean":"2023-12-22T08:47:08.305716+0000","last_became_active":"2023-12-22T08:47:07.071915+0000","last_became_peered":"2023-12-22T08:47:07.071915+0000","last_unstale":"2023-12-22T08:47:08.305716+0000","last_undegraded":"2023-12-22T08:47:08.305716+0000","last_fullsized":"2023-12-22T08:47:08.305716+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:05:29.406949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.308092+0000","last_change":"2023-12-22T08:47:06.560855+0000","last_active":"2023-12-22T08:47:08.308092+0000","last_peered":"2023-12-22T08:47:08.308092+0000","last_clean":"2023-12-22T08:47:08.308092+0000","last_became_active":"2023-12-22T08:47:06.559423+0000","last_became_peered":"2023-12-22T08:47:06.559423+0000","last_unstale":"2023-12-22T08:47:08.308092+0000","last_undegraded":"2023-12-22T08:47:08.308092+0000","last_fullsized":"2023-12-22T08:47:08.308092+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:02:44.269557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305713+0000","last_change":"2023-12-22T08:47:07.066879+0000","last_active":"2023-12-22T08:47:08.305713+0000","last_peered":"2023-12-22T08:47:08.305713+0000","last_clean":"2023-12-22T08:47:08.305713+0000","last_became_active":"2023-12-22T08:47:07.066638+0000","last_became_peered":"2023-12-22T08:47:07.066638+0000","last_unstale":"2023-12-22T08:47:08.305713+0000","last_undegraded":"2023-12-22T08:47:08.305713+0000","last_fullsized":"2023-12-22T08:47:08.305713+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:11:02.036443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"126'2","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047900+0000","last_change":"2023-12-22T08:47:06.546714+0000","last_active":"2023-12-22T08:47:08.047900+0000","last_peered":"2023-12-22T08:47:08.047900+0000","last_clean":"2023-12-22T08:47:08.047900+0000","last_became_active":"2023-12-22T08:47:06.545442+0000","last_became_peered":"2023-12-22T08:47:06.545442+0000","last_unstale":"2023-12-22T08:47:08.047900+0000","last_undegraded":"2023-12-22T08:47:08.047900+0000","last_fullsized":"2023-12-22T08:47:08.047900+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:53:37.060259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306118+0000","last_change":"2023-12-22T08:47:07.075741+0000","last_active":"2023-12-22T08:47:08.306118+0000","last_peered":"2023-12-22T08:47:08.306118+0000","last_clean":"2023-12-22T08:47:08.306118+0000","last_became_active":"2023-12-22T08:47:07.075504+0000","last_became_peered":"2023-12-22T08:47:07.075504+0000","last_unstale":"2023-12-22T08:47:08.306118+0000","last_undegraded":"2023-12-22T08:47:08.306118+0000","last_fullsized":"2023-12-22T08:47:08.306118+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:45:10.578674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305908+0000","last_change":"2023-12-22T08:47:06.557287+0000","last_active":"2023-12-22T08:47:08.305908+0000","last_peered":"2023-12-22T08:47:08.305908+0000","last_clean":"2023-12-22T08:47:08.305908+0000","last_became_active":"2023-12-22T08:47:06.556828+0000","last_became_peered":"2023-12-22T08:47:06.556828+0000","last_unstale":"2023-12-22T08:47:08.305908+0000","last_undegraded":"2023-12-22T08:47:08.305908+0000","last_fullsized":"2023-12-22T08:47:08.305908+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:47.061448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306617+0000","last_change":"2023-12-22T08:47:07.070460+0000","last_active":"2023-12-22T08:47:08.306617+0000","last_peered":"2023-12-22T08:47:08.306617+0000","last_clean":"2023-12-22T08:47:08.306617+0000","last_became_active":"2023-12-22T08:47:07.069252+0000","last_became_peered":"2023-12-22T08:47:07.069252+0000","last_unstale":"2023-12-22T08:47:08.306617+0000","last_undegraded":"2023-12-22T08:47:08.306617+0000","last_fullsized":"2023-12-22T08:47:08.306617+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:05:29.406949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306563+0000","last_change":"2023-12-22T08:47:06.552660+0000","last_active":"2023-12-22T08:47:08.306563+0000","last_peered":"2023-12-22T08:47:08.306563+0000","last_clean":"2023-12-22T08:47:08.306563+0000","last_became_active":"2023-12-22T08:47:06.552125+0000","last_became_peered":"2023-12-22T08:47:06.552125+0000","last_unstale":"2023-12-22T08:47:08.306563+0000","last_undegraded":"2023-12-22T08:47:08.306563+0000","last_fullsized":"2023-12-22T08:47:08.306563+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:08:32.503625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.050231+0000","last_change":"2023-12-22T08:47:07.057637+0000","last_active":"2023-12-22T08:47:08.050231+0000","last_peered":"2023-12-22T08:47:08.050231+0000","last_clean":"2023-12-22T08:47:08.050231+0000","last_became_active":"2023-12-22T08:47:07.056901+0000","last_became_peered":"2023-12-22T08:47:07.056901+0000","last_unstale":"2023-12-22T08:47:08.050231+0000","last_undegraded":"2023-12-22T08:47:08.050231+0000","last_fullsized":"2023-12-22T08:47:08.050231+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:27:17.938587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.305948+0000","last_change":"2023-12-22T08:47:06.544812+0000","last_active":"2023-12-22T08:47:08.305948+0000","last_peered":"2023-12-22T08:47:08.305948+0000","last_clean":"2023-12-22T08:47:08.305948+0000","last_became_active":"2023-12-22T08:47:06.544512+0000","last_became_peered":"2023-12-22T08:47:06.544512+0000","last_unstale":"2023-12-22T08:47:08.305948+0000","last_undegraded":"2023-12-22T08:47:08.305948+0000","last_fullsized":"2023-12-22T08:47:08.305948+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:51:40.854777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306379+0000","last_change":"2023-12-22T08:47:07.069812+0000","last_active":"2023-12-22T08:47:08.306379+0000","last_peered":"2023-12-22T08:47:08.306379+0000","last_clean":"2023-12-22T08:47:08.306379+0000","last_became_active":"2023-12-22T08:47:07.069582+0000","last_became_peered":"2023-12-22T08:47:07.069582+0000","last_unstale":"2023-12-22T08:47:08.306379+0000","last_undegraded":"2023-12-22T08:47:08.306379+0000","last_fullsized":"2023-12-22T08:47:08.306379+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:31:19.386328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.308286+0000","last_change":"2023-12-22T08:47:06.560556+0000","last_active":"2023-12-22T08:47:08.308286+0000","last_peered":"2023-12-22T08:47:08.308286+0000","last_clean":"2023-12-22T08:47:08.308286+0000","last_became_active":"2023-12-22T08:47:06.559081+0000","last_became_peered":"2023-12-22T08:47:06.559081+0000","last_unstale":"2023-12-22T08:47:08.308286+0000","last_undegraded":"2023-12-22T08:47:08.308286+0000","last_fullsized":"2023-12-22T08:47:08.308286+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:47.061448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.051015+0000","last_change":"2023-12-22T08:47:07.063049+0000","last_active":"2023-12-22T08:47:08.051015+0000","last_peered":"2023-12-22T08:47:08.051015+0000","last_clean":"2023-12-22T08:47:08.051015+0000","last_became_active":"2023-12-22T08:47:07.062177+0000","last_became_peered":"2023-12-22T08:47:07.062177+0000","last_unstale":"2023-12-22T08:47:08.051015+0000","last_undegraded":"2023-12-22T08:47:08.051015+0000","last_fullsized":"2023-12-22T08:47:08.051015+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:32:56.658237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306472+0000","last_change":"2023-12-22T08:47:06.556024+0000","last_active":"2023-12-22T08:47:08.306472+0000","last_peered":"2023-12-22T08:47:08.306472+0000","last_clean":"2023-12-22T08:47:08.306472+0000","last_became_active":"2023-12-22T08:47:06.555729+0000","last_became_peered":"2023-12-22T08:47:06.555729+0000","last_unstale":"2023-12-22T08:47:08.306472+0000","last_undegraded":"2023-12-22T08:47:08.306472+0000","last_fullsized":"2023-12-22T08:47:08.306472+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:11:47.061448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306172+0000","last_change":"2023-12-22T08:47:07.071627+0000","last_active":"2023-12-22T08:47:08.306172+0000","last_peered":"2023-12-22T08:47:08.306172+0000","last_clean":"2023-12-22T08:47:08.306172+0000","last_became_active":"2023-12-22T08:47:07.071367+0000","last_became_peered":"2023-12-22T08:47:07.071367+0000","last_unstale":"2023-12-22T08:47:08.306172+0000","last_undegraded":"2023-12-22T08:47:08.306172+0000","last_fullsized":"2023-12-22T08:47:08.306172+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:49:28.972166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.136390+0000","last_change":"2023-12-22T08:47:06.561662+0000","last_active":"2023-12-22T08:47:08.136390+0000","last_peered":"2023-12-22T08:47:08.136390+0000","last_clean":"2023-12-22T08:47:08.136390+0000","last_became_active":"2023-12-22T08:47:06.561413+0000","last_became_peered":"2023-12-22T08:47:06.561413+0000","last_unstale":"2023-12-22T08:47:08.136390+0000","last_undegraded":"2023-12-22T08:47:08.136390+0000","last_fullsized":"2023-12-22T08:47:08.136390+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:52:08.730260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047264+0000","last_change":"2023-12-22T08:47:07.065628+0000","last_active":"2023-12-22T08:47:08.047264+0000","last_peered":"2023-12-22T08:47:08.047264+0000","last_clean":"2023-12-22T08:47:08.047264+0000","last_became_active":"2023-12-22T08:47:07.064644+0000","last_became_peered":"2023-12-22T08:47:07.064644+0000","last_unstale":"2023-12-22T08:47:08.047264+0000","last_undegraded":"2023-12-22T08:47:08.047264+0000","last_fullsized":"2023-12-22T08:47:08.047264+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:03:30.291361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306241+0000","last_change":"2023-12-22T08:47:06.556580+0000","last_active":"2023-12-22T08:47:08.306241+0000","last_peered":"2023-12-22T08:47:08.306241+0000","last_clean":"2023-12-22T08:47:08.306241+0000","last_became_active":"2023-12-22T08:47:06.556351+0000","last_became_peered":"2023-12-22T08:47:06.556351+0000","last_unstale":"2023-12-22T08:47:08.306241+0000","last_undegraded":"2023-12-22T08:47:08.306241+0000","last_fullsized":"2023-12-22T08:47:08.306241+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:36.192993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.306372+0000","last_change":"2023-12-22T08:47:07.078036+0000","last_active":"2023-12-22T08:47:08.306372+0000","last_peered":"2023-12-22T08:47:08.306372+0000","last_clean":"2023-12-22T08:47:08.306372+0000","last_became_active":"2023-12-22T08:47:07.076918+0000","last_became_peered":"2023-12-22T08:47:07.076918+0000","last_unstale":"2023-12-22T08:47:08.306372+0000","last_undegraded":"2023-12-22T08:47:08.306372+0000","last_fullsized":"2023-12-22T08:47:08.306372+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:06.517995+0000","last_clean_scrub_stamp":"2023-12-22T08:47:06.517995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:49:56.911810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"126'1","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-22T08:47:08.047072+0000","last_change":"2023-12-22T08:47:06.553272+0000","last_active":"2023-12-22T08:47:08.047072+0000","last_peered":"2023-12-22T08:47:08.047072+0000","last_clean":"2023-12-22T08:47:08.047072+0000","last_became_active":"2023-12-22T08:47:06.552492+0000","last_became_peered":"2023-12-22T08:47:06.552492+0000","last_unstale":"2023-12-22T08:47:08.047072+0000","last_undegraded":"2023-12-22T08:47:08.047072+0000","last_fullsized":"2023-12-22T08:47:08.047072+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:05.495508+0000","last_clean_scrub_stamp":"2023-12-22T08:47:05.495508+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:44.954690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":259,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-12-22T08:47:07.056614+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:47:07.056614+0000","last_peered":"2023-12-22T08:47:07.056614+0000","last_clean":"2023-12-22T08:47:07.056614+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:47:07.056614+0000","last_undegraded":"2023-12-22T08:47:07.056614+0000","last_fullsized":"2023-12-22T08:47:07.056614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":678,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194633,"statfs":{"total":200000000,"available":199304744,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0960000000000001,"15min":1.0840000000000001},"min":{"1min":0.80200000000000005,"5min":0.60999999999999999,"15min":0.58199999999999996},"max":{"1min":1.5169999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1160000000000001,"15min":1.077},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.054}]},{"osd":1,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1870000000000001,"15min":1.167},"min":{"1min":0.73399999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6839999999999999,"5min":1.905,"15min":1.905},"last":1.49},{"interface":"front","average":{"1min":1.2,"5min":1.2549999999999999,"15min":1.1679999999999999},"min":{"1min":0.85099999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7709999999999999,"5min":1.865,"15min":1.865},"last":1.448}]},{"osd":2,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.163,"15min":1.089},"min":{"1min":0.89600000000000002,"5min":0.78100000000000003,"15min":0.69799999999999995},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.2,"15min":1.22},"min":{"1min":0.79900000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.589,"5min":1.742,"15min":2.1379999999999999},"last":0.96799999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.23,"15min":1.133},"min":{"1min":0.94699999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.635,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.3300000000000001,"15min":1.2909999999999999},"min":{"1min":0.97299999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5620000000000001,"5min":1.952,"15min":2.2959999999999998},"last":1.3089999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2050000000000001,"15min":1.2},"min":{"1min":1.032,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.603,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.254},{"interface":"front","average":{"1min":1.371,"5min":1.262,"15min":1.2629999999999999},"min":{"1min":1.0229999999999999,"5min":0.64100000000000001,"15min":0.59399999999999997},"max":{"1min":2.0840000000000001,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.5600000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.375,"15min":1.3740000000000001},"min":{"1min":0.97299999999999998,"5min":0.74299999999999999,"15min":0.51800000000000002},"max":{"1min":1.8939999999999999,"5min":2.0510000000000002,"15min":2.4300000000000002},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3759999999999999,"15min":1.3740000000000001},"min":{"1min":1.135,"5min":0.76300000000000001,"15min":0.67800000000000005},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":2.3410000000000002},"last":1.5209999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.496,"15min":1.4910000000000001},"min":{"1min":1.056,"5min":0.83499999999999996,"15min":0.66900000000000004},"max":{"1min":1.9930000000000001,"5min":2.1259999999999999,"15min":2.2440000000000002},"last":1.645},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.4830000000000001,"15min":1.484},"min":{"1min":1.294,"5min":0.82299999999999995,"15min":0.71999999999999997},"max":{"1min":2.1379999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.921}]}]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":678,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194634,"statfs":{"total":200000000,"available":199305326,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.1479999999999999,"15min":1.1299999999999999},"min":{"1min":0.61499999999999999,"5min":0.55300000000000005,"15min":0.42099999999999999},"max":{"1min":1.6870000000000001,"5min":1.9350000000000001,"15min":3.0489999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.177,"15min":1.107},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.5509999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.125,"15min":1.0509999999999999},"min":{"1min":0.67800000000000005,"5min":0.63,"15min":0.623},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1859999999999999,"15min":1.167},"min":{"1min":0.69699999999999995,"5min":0.64500000000000002,"15min":0.63100000000000001},"max":{"1min":1.4870000000000001,"5min":1.8,"15min":1.8},"last":1.292}]},{"osd":2,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.264,"15min":1.268},"min":{"1min":0.73999999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.7090000000000001,"5min":1.7969999999999999,"15min":1.8799999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.248,"15min":1.1759999999999999},"min":{"1min":0.748,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.4319999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3169999999999999,"15min":1.3},"min":{"1min":0.79200000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.258,"15min":1.2370000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.77900000000000003},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.464}]},{"osd":4,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.351,"15min":1.3859999999999999},"min":{"1min":0.90600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.381},{"interface":"front","average":{"1min":1.454,"5min":1.391,"15min":1.397},"min":{"1min":0.88300000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.831,"5min":2.831,"15min":2.831},"last":1.2110000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3160000000000001,"15min":1.345},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.575},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.502,"15min":1.5629999999999999},"min":{"1min":1.0369999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.7949999999999999,"5min":2.1030000000000002,"15min":3.1819999999999999},"last":1.516}]},{"osd":7,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.522,"15min":1.5680000000000001},"min":{"1min":0.93300000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":1.613},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.45,"15min":1.522},"min":{"1min":0.90400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.6279999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1255,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194056,"statfs":{"total":200000000,"available":198714357,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.101,"15min":1.0800000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.65300000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.944},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1060000000000001,"15min":1.1279999999999999},"min":{"1min":0.76500000000000001,"5min":0.68899999999999995,"15min":0.67000000000000004},"max":{"1min":1.5069999999999999,"5min":1.544,"15min":3.1379999999999999},"last":1.046}]},{"osd":1,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.135,"15min":1.1160000000000001},"min":{"1min":0.88200000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5009999999999999,"5min":1.619,"15min":2.79},"last":2.3319999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.1120000000000001,"15min":1.04},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.64500000000000002},"max":{"1min":1.476,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.5049999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1559999999999999,"15min":1.1359999999999999},"min":{"1min":0.79200000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.5860000000000001,"5min":1.5900000000000001,"15min":1.72},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2390000000000001,"15min":1.1819999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.657,"5min":1.716,"15min":1.978},"last":1.218}]},{"osd":3,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.236,"15min":1.1830000000000001},"min":{"1min":0.80200000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.5249999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.339},{"interface":"front","average":{"1min":1.351,"5min":1.3089999999999999,"15min":1.2569999999999999},"min":{"1min":0.86399999999999999,"5min":0.77800000000000002,"15min":0.73299999999999998},"max":{"1min":1.5409999999999999,"5min":1.6619999999999999,"15min":2.1499999999999999},"last":1.1850000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.274,"15min":1.2549999999999999},"min":{"1min":0.63300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6879999999999999,"5min":1.7070000000000001,"15min":1.853},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.262,"15min":1.258},"min":{"1min":0.93799999999999994,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.246}]},{"osd":6,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.3480000000000001,"15min":1.323},"min":{"1min":0.81799999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.6639999999999999,"5min":1.788,"15min":1.821},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.407,"15min":1.421},"min":{"1min":0.79600000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.764,"5min":1.823,"15min":2.8780000000000001},"last":0.98599999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.4330000000000001,"15min":1.3879999999999999},"min":{"1min":0.84299999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6579999999999999,"5min":1.873,"15min":2.2189999999999999},"last":1.411},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.49,"15min":1.5529999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.75,"5min":1.8899999999999999,"15min":4.7249999999999996},"last":1.369}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":678,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194633,"statfs":{"total":200000000,"available":199304744,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.02,"15min":1.01},"min":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.55,"5min":1.597,"15min":1.597},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1319999999999999,"15min":1.1060000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.552,"5min":1.796,"15min":1.796},"last":0.66000000000000003}]},{"osd":1,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.117,"15min":1.056},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.482,"5min":1.76,"15min":1.76},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.66900000000000004,"5min":0.65600000000000003,"15min":0.57399999999999995},"max":{"1min":1.5600000000000001,"5min":1.794,"15min":2.4249999999999998},"last":0.92900000000000005}]},{"osd":2,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.171,"15min":1.149},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6160000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.244,"15min":1.208},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.4990000000000001,"5min":2.0830000000000002,"15min":2.1600000000000001},"last":1.276}]},{"osd":3,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2190000000000001,"15min":1.2010000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.333,"15min":1.2350000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7110000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.196}]},{"osd":5,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1890000000000001,"15min":1.145},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5580000000000001,"5min":1.639,"15min":1.639},"last":1.046},{"interface":"front","average":{"1min":1.365,"5min":1.4259999999999999,"15min":1.3879999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8939999999999999,"5min":1.913,"15min":2.0979999999999999},"last":1.0980000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.337,"15min":1.2589999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.58599999999999997},"max":{"1min":1.9330000000000001,"5min":2.141,"15min":2.141},"last":1.387},{"interface":"front","average":{"1min":1.258,"5min":1.3100000000000001,"15min":1.222},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7210000000000001,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.1339999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.4510000000000001,"15min":1.3620000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.67300000000000004},"max":{"1min":1.992,"5min":2.0089999999999999,"15min":2.1200000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.5329999999999999,"15min":1.4410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.859,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.429}]}]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":684,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194627,"statfs":{"total":200000000,"available":199298832,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90300000000000002,"15min":0.94099999999999995},"min":{"1min":0.55500000000000005,"5min":0.49299999999999999,"15min":0.39800000000000002},"max":{"1min":1.2390000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.878},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.95499999999999996,"15min":0.93300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.262,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.65600000000000003}]},{"osd":1,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.90800000000000003,"15min":0.86899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.528,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.208,"15min":1.1339999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.46200000000000002},"max":{"1min":1.6020000000000001,"5min":1.861,"15min":1.861},"last":1.407}]},{"osd":2,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0669999999999999,"15min":1.042},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5469999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.1859999999999999,"15min":1.137},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.679,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.6419999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.276,"15min":1.2190000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.73199999999999998},"max":{"1min":2.2839999999999998,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.097},{"interface":"front","average":{"1min":1.264,"5min":1.323,"15min":1.2470000000000001},"min":{"1min":0.91000000000000003,"5min":0.77300000000000002,"15min":0.745},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.3320000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3680000000000001,"15min":1.288},"min":{"1min":0.754,"5min":0.754,"15min":0.66700000000000004},"max":{"1min":1.9059999999999999,"5min":1.994,"15min":1.994},"last":1.9059999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.409,"15min":1.427},"min":{"1min":0.84599999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.7949999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.7949999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.478,"15min":1.4470000000000001},"min":{"1min":1.0609999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.964,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.964},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3999999999999999,"15min":1.385},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7849999999999999,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.474}]},{"osd":7,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.456,"15min":1.387},"min":{"1min":0.81299999999999994,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.851,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.4630000000000001,"15min":1.405},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.80600000000000005},"max":{"1min":1.837,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.71}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":678,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194634,"statfs":{"total":200000000,"available":199305256,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95199999999999996,"15min":0.78000000000000003},"min":{"1min":0.54800000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.6789999999999998,"5min":6.8879999999999999,"15min":6.8879999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.95599999999999996,"15min":0.94399999999999995},"min":{"1min":0.50600000000000001,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.5069999999999999,"5min":4.5510000000000002,"15min":4.5510000000000002},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":1.038,"15min":0.94399999999999995},"min":{"1min":0.63900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.633,"5min":11.308999999999999,"15min":11.308999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.175,"5min":1.0700000000000001,"15min":0.94499999999999995},"min":{"1min":0.51500000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.252,"15min":1.052},"min":{"1min":0.69799999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5780000000000001,"5min":13.087999999999999,"15min":13.087999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.363,"15min":1.117},"min":{"1min":0.67300000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":3.2959999999999998,"5min":12.289999999999999,"15min":12.289999999999999},"last":0.80300000000000005}]},{"osd":4,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.3899999999999999,"15min":1.258},"min":{"1min":0.94899999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3999999999999999,"15min":1.3560000000000001},"min":{"1min":1.0329999999999999,"5min":0.623,"15min":0.61499999999999999},"max":{"1min":1.6160000000000001,"5min":13.927,"15min":13.927},"last":0.84899999999999998}]},{"osd":5,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.409,"15min":1.379},"min":{"1min":0.91500000000000004,"5min":0.72399999999999998,"15min":0.64000000000000001},"max":{"1min":1.722,"5min":11.003,"15min":11.003},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.298,"5min":1.454,"15min":1.284},"min":{"1min":0.93100000000000005,"5min":0.83699999999999997,"15min":0.79400000000000004},"max":{"1min":2.0470000000000002,"5min":13.129,"15min":13.129},"last":1.1759999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4510000000000001,"15min":1.2909999999999999},"min":{"1min":0.995,"5min":0.77200000000000002,"15min":0.751},"max":{"1min":2.1240000000000001,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.518,"15min":1.383},"min":{"1min":0.97799999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":3.8959999999999999,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":1.03}]},{"osd":7,"last update":"Fri Dec 22 08:46:09 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.506,"15min":1.399},"min":{"1min":0.97299999999999998,"5min":0.753,"15min":0.61299999999999999},"max":{"1min":1.7729999999999999,"5min":10.948,"15min":10.948},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.5489999999999999,"15min":1.3720000000000001},"min":{"1min":0.90600000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.1789999999999998,"5min":8.0980000000000008,"15min":8.0980000000000008},"last":1.093}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1262,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194049,"statfs":{"total":200000000,"available":198706982,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.91200000000000003},"min":{"1min":0.44600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.244,"5min":1.1699999999999999,"15min":1.0529999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":4.2030000000000003,"5min":4.2030000000000003,"15min":4.2030000000000003},"last":1.1080000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.98899999999999999,"15min":0.95699999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4450000000000001,"5min":1.732,"15min":1.732},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.05,"15min":0.97399999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34999999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":2.254},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.331,"15min":1.2050000000000001},"min":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.54000000000000004},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.544},{"interface":"front","average":{"1min":1.087,"5min":1.0720000000000001,"15min":0.99399999999999999},"min":{"1min":0.54000000000000004,"5min":0.497,"15min":0.47799999999999998},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.3009999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3049999999999999,"15min":1.278},"min":{"1min":0.71299999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.518,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.198},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.4359999999999999,"15min":1.3500000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.6910000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.4630000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.2949999999999999,"15min":1.248},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.536,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.4359999999999999,"15min":1.351},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.66800000000000004},"max":{"1min":1.5720000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.4059999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.3600000000000001,"15min":1.28},"min":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.65200000000000002},"max":{"1min":1.5780000000000001,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":1.393},{"interface":"front","average":{"1min":1.367,"5min":1.468,"15min":1.3899999999999999},"min":{"1min":0.80600000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.748,"5min":2.2210000000000001,"15min":2.2229999999999999},"last":1.506}]},{"osd":7,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.496,"15min":1.393},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.64400000000000002},"max":{"1min":1.7889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.369},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.486,"15min":1.4219999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.66200000000000003},"max":{"1min":1.718,"5min":4.508,"15min":4.508},"last":1.2470000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":678,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194634,"statfs":{"total":200000000,"available":199305326,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.871,"15min":0.76300000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.9470000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.97599999999999998,"15min":0.91700000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.88600000000000001,"15min":0.81299999999999994},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.40600000000000003},"max":{"1min":1.341,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0700000000000001,"15min":0.96399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5409999999999999,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.0780000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1739999999999999,"15min":1.056},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.123,"5min":1.234,"15min":1.095},"min":{"1min":0.56999999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.8080000000000001,"5min":2.145,"15min":2.145},"last":0.89400000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3640000000000001,"15min":1.288},"min":{"1min":0.86299999999999999,"5min":0.80600000000000005,"15min":0.70799999999999996},"max":{"1min":2.0910000000000002,"5min":2.625,"15min":2.625},"last":1.339},{"interface":"front","average":{"1min":1.351,"5min":1.3520000000000001,"15min":1.246},"min":{"1min":0.89900000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.964,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.165}]},{"osd":5,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.417,"15min":1.2949999999999999},"min":{"1min":0.71099999999999997,"5min":0.67600000000000005,"15min":0.59299999999999997},"max":{"1min":5.4290000000000003,"5min":5.4290000000000003,"15min":5.4290000000000003},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.373,"15min":1.2889999999999999},"min":{"1min":0.79500000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.0910000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.423}]},{"osd":6,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3919999999999999,"15min":1.304},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.64800000000000002},"max":{"1min":1.8799999999999999,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.488,"15min":1.4099999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.69099999999999995},"max":{"1min":1.8620000000000001,"5min":2.577,"15min":2.577},"last":1.488}]},{"osd":7,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.4770000000000001,"15min":1.3899999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.755},"max":{"1min":1.841,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.4770000000000001,"15min":1.399},"min":{"1min":0.96499999999999997,"5min":0.749,"15min":0.749},"max":{"1min":2.1680000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.623}]}]}],"pool_statfs":[]}} 2023-12-22T08:47:12.574 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T08:47:12.575 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T08:47:12.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.855+0000 7f1ea6fc4640 1 Processor -- start 2023-12-22T08:47:12.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.855+0000 7f1ea6fc4640 1 -- start start 2023-12-22T08:47:12.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.857+0000 7f1ea6fc4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea015b370 0x7f1ea006d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.857+0000 7f1ea6fc4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ea00ae6c0 0x7f1ea006fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.857+0000 7f1ea6fc4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea015ca20 con 0x7f1ea006d6a0 2023-12-22T08:47:12.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.857+0000 7f1ea6fc4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea015b750 con 0x7f1ea00ae6c0 2023-12-22T08:47:12.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.857+0000 7f1ea6fc4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea006dc20 con 0x7f1ea015b370 2023-12-22T08:47:12.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.857+0000 7f1ea57c1640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1ea006d6a0 0x7f1ea00adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51482/0 (socket says 172.21.15.38:51482) 2023-12-22T08:47:12.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.857+0000 7f1ea57c1640 1 -- 172.21.15.38:0/3441077042 learned_addr learned my addr 172.21.15.38:0/3441077042 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea5fc2640 1 --2- 172.21.15.38:0/3441077042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea015b370 0x7f1ea006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea67c3640 1 --2- 172.21.15.38:0/3441077042 >> v2:172.21.15.89:3300/0 conn(0x7f1ea00ae6c0 0x7f1ea006fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795571131 0 0) 0x7f1ea015ca20 con 0x7f1ea006d6a0 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e8c003520 con 0x7f1ea006d6a0 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 82106359 0 0) 0x7f1e8c003520 con 0x7f1ea006d6a0 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea015b370 msgr2=0x7f1ea006d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 --2- 172.21.15.38:0/3441077042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea015b370 0x7f1ea006d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 >> v2:172.21.15.89:3300/0 conn(0x7f1ea00ae6c0 msgr2=0x7f1ea006fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 --2- 172.21.15.38:0/3441077042 >> v2:172.21.15.89:3300/0 conn(0x7f1ea00ae6c0 0x7f1ea006fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea006df00 con 0x7f1ea006d6a0 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f1e90001670 con 0x7f1ea006d6a0 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 >> v1:172.21.15.38:6789/0 conn(0x7f1ea006d6a0 legacy=0x7f1ea00adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 --2- 172.21.15.38:0/3441077042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea015b370 0x7f1e8c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 --2- 172.21.15.38:0/3441077042 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e8c003f40 0x7f1e8c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 --2- 172.21.15.38:0/3441077042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e8c004d00 0x7f1e8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea015b750 con 0x7f1e8c003f40 2023-12-22T08:47:12.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea006dc20 con 0x7f1e8c004d00 2023-12-22T08:47:12.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.858+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c00b980 con 0x7f1ea015b370 2023-12-22T08:47:12.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.859+0000 7f1ea57c1640 1 --2- 172.21.15.38:0/3441077042 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e8c003f40 0x7f1e8c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:12.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.859+0000 7f1ea5fc2640 1 --2- 172.21.15.38:0/3441077042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea015b370 0x7f1e8c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:12.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.859+0000 7f1ea57c1640 1 -- 172.21.15.38:0/3441077042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea015b370 msgr2=0x7f1e8c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:12.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.859+0000 7f1ea57c1640 1 --2- 172.21.15.38:0/3441077042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea015b370 0x7f1e8c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.859+0000 7f1ea57c1640 1 -- 172.21.15.38:0/3441077042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e8c004d00 msgr2=0x7f1e8c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:12.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.859+0000 7f1ea57c1640 1 --2- 172.21.15.38:0/3441077042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e8c004d00 0x7f1e8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.859+0000 7f1ea57c1640 1 -- 172.21.15.38:0/3441077042 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c003520 con 0x7f1e8c003f40 2023-12-22T08:47:12.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.861+0000 7f1ea57c1640 1 --2- 172.21.15.38:0/3441077042 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e8c003f40 0x7f1e8c0047c0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000c140 tx=0x7f1e8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a13949c2eb67e25 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:12.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.861+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90005ad0 con 0x7f1e8c003f40 2023-12-22T08:47:12.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.861+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e90005c50 con 0x7f1e8c003f40 2023-12-22T08:47:12.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.861+0000 7f1ea4fc0640 1 -- 172.21.15.38:0/3441077042 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9002c810 con 0x7f1e8c003f40 2023-12-22T08:47:12.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.861+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3441077042 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e8c003f40 msgr2=0x7f1e8c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:12.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.861+0000 7f1ea6fc4640 1 --2- 172.21.15.38:0/3441077042 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e8c003f40 0x7f1e8c0047c0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000c140 tx=0x7f1e8c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.862+0000 7f1ea67c3640 1 -- 172.21.15.38:0/3441077042 reap_dead start 2023-12-22T08:47:12.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.862+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3441077042 shutdown_connections 2023-12-22T08:47:12.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.862+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3441077042 >> 172.21.15.38:0/3441077042 conn(0x7f1ea00b1110 msgr2=0x7f1ea00b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:12.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.862+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3441077042 shutdown_connections 2023-12-22T08:47:12.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.862+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3441077042 wait complete. 2023-12-22T08:47:12.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.864+0000 7f1ea6fc4640 1 Processor -- start 2023-12-22T08:47:12.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.864+0000 7f1ea6fc4640 1 -- start start 2023-12-22T08:47:12.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea6fc4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e8c003f40 0x7f1ea00cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea6fc4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea009a1d0 0x7f1ea01f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea6fc4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea00afb50 0x7f1ea00affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea6fc4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea0155fd0 con 0x7f1e8c003f40 2023-12-22T08:47:12.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea6fc4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea00b0510 con 0x7f1ea009a1d0 2023-12-22T08:47:12.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea6fc4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea00ce090 con 0x7f1ea00afb50 2023-12-22T08:47:12.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea5fc2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e8c003f40 0x7f1ea00cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:12.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea5fc2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e8c003f40 0x7f1ea00cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40958/0 (socket says 172.21.15.38:40958) 2023-12-22T08:47:12.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea5fc2640 1 -- 172.21.15.38:0/3665074575 learned_addr learned my addr 172.21.15.38:0/3665074575 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:12.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea57c1640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea009a1d0 0x7f1ea01f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:12.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea5fc2640 1 -- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea00afb50 msgr2=0x7f1ea00affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:12.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea5fc2640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea00afb50 0x7f1ea00affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea5fc2640 1 -- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea009a1d0 msgr2=0x7f1ea01f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:12.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea5fc2640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea009a1d0 0x7f1ea01f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:12.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea5fc2640 1 -- 172.21.15.38:0/3665074575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea009b3a0 con 0x7f1e8c003f40 2023-12-22T08:47:12.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.865+0000 7f1ea57c1640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea009a1d0 0x7f1ea01f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:12.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.866+0000 7f1ea5fc2640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e8c003f40 0x7f1ea00cdb50 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c011630 tx=0x7f1e9c011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:12.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.866+0000 7f1e967fc640 1 -- 172.21.15.38:0/3665074575 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c015870 con 0x7f1e8c003f40 2023-12-22T08:47:12.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.866+0000 7f1e967fc640 1 -- 172.21.15.38:0/3665074575 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c0159d0 con 0x7f1e8c003f40 2023-12-22T08:47:12.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.866+0000 7f1e967fc640 1 -- 172.21.15.38:0/3665074575 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c015d40 con 0x7f1e8c003f40 2023-12-22T08:47:12.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.866+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3665074575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea01f6d80 con 0x7f1e8c003f40 2023-12-22T08:47:12.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.866+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3665074575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea009aa70 con 0x7f1e8c003f40 2023-12-22T08:47:12.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.868+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3665074575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea0061910 con 0x7f1e8c003f40 2023-12-22T08:47:12.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.869+0000 7f1e967fc640 1 -- 172.21.15.38:0/3665074575 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1e9c00f490 con 0x7f1e8c003f40 2023-12-22T08:47:12.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.869+0000 7f1e967fc640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8406a430 0x7f1e8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:12.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.870+0000 7f1e967fc640 1 -- 172.21.15.38:0/3665074575 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e9c088d90 con 0x7f1e8c003f40 2023-12-22T08:47:12.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.870+0000 7f1ea57c1640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8406a430 0x7f1e8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:12.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.871+0000 7f1ea57c1640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8406a430 0x7f1e8406c8f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1e90034000 tx=0x7f1e90007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:12.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:12.874+0000 7f1e967fc640 1 -- 172.21.15.38:0/3665074575 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1e9c0542e0 con 0x7f1e8c003f40 2023-12-22T08:47:13.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.138+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3665074575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1ea006f4c0 con 0x7f1e8c003f40 2023-12-22T08:47:13.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.147+0000 7f1e967fc640 1 -- 172.21.15.38:0/3665074575 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1e9c0220e0 con 0x7f1e8c003f40 2023-12-22T08:47:13.148 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.0 2023-12-22T08:47:13.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.149+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8406a430 msgr2=0x7f1e8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:13.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.149+0000 7f1ea6fc4640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8406a430 0x7f1e8406c8f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1e90034000 tx=0x7f1e90007000 comp rx=0 tx=0).stop 2023-12-22T08:47:13.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.149+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3665074575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e8c003f40 msgr2=0x7f1ea00cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:13.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.149+0000 7f1ea6fc4640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e8c003f40 0x7f1ea00cdb50 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c011630 tx=0x7f1e9c011af0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.149+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3665074575 shutdown_connections 2023-12-22T08:47:13.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.149+0000 7f1ea6fc4640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea00afb50 0x7f1ea00affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.149+0000 7f1ea6fc4640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea009a1d0 0x7f1ea01f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.149+0000 7f1ea6fc4640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8406a430 0x7f1e8406c8f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.149+0000 7f1ea6fc4640 1 --2- 172.21.15.38:0/3665074575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1e8c003f40 0x7f1ea00cdb50 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.150+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3665074575 >> 172.21.15.38:0/3665074575 conn(0x7f1ea00b1110 msgr2=0x7f1ea006fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:13.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.150+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3665074575 shutdown_connections 2023-12-22T08:47:13.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.150+0000 7f1ea6fc4640 1 -- 172.21.15.38:0/3665074575 wait complete. 2023-12-22T08:47:13.171 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:47:13.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.400+0000 7f4dbc3ea640 1 Processor -- start 2023-12-22T08:47:13.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.400+0000 7f4dbc3ea640 1 -- start start 2023-12-22T08:47:13.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.402+0000 7f4dbc3ea640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4db40d1240 0x7f4db40b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:13.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.402+0000 7f4dbc3ea640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4db40d1620 0x7f4db40b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:13.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.402+0000 7f4dbc3ea640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db40b5c80 con 0x7f4db40b3b40 2023-12-22T08:47:13.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.402+0000 7f4dbc3ea640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db40d0760 con 0x7f4db40d1620 2023-12-22T08:47:13.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.402+0000 7f4dbc3ea640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db40d01a0 con 0x7f4db40d1240 2023-12-22T08:47:13.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.402+0000 7f4dba987640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4db40d1620 0x7f4db40b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:13.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.403+0000 7f4dba987640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4db40d1620 0x7f4db40b6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40966/0 (socket says 172.21.15.38:40966) 2023-12-22T08:47:13.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.403+0000 7f4dba987640 1 -- 172.21.15.38:0/2399880903 learned_addr learned my addr 172.21.15.38:0/2399880903 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:13.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.403+0000 7f4dba186640 1 --2- 172.21.15.38:0/2399880903 >> v2:172.21.15.89:3300/0 conn(0x7f4db40d1240 0x7f4db40b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:13.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.403+0000 7f4dba987640 1 -- 172.21.15.38:0/2399880903 >> v2:172.21.15.89:3300/0 conn(0x7f4db40d1240 msgr2=0x7f4db40b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:13.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.403+0000 7f4dba987640 1 --2- 172.21.15.38:0/2399880903 >> v2:172.21.15.89:3300/0 conn(0x7f4db40d1240 0x7f4db40b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.403+0000 7f4dba987640 1 -- 172.21.15.38:0/2399880903 >> v1:172.21.15.89:6789/0 conn(0x7f4db40b3b40 legacy=0x7f4db40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:13.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.403+0000 7f4dba987640 1 -- 172.21.15.38:0/2399880903 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db40d0480 con 0x7f4db40d1620 2023-12-22T08:47:13.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.404+0000 7f4dba987640 1 --2- 172.21.15.38:0/2399880903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db40d1620 0x7f4db40b6b20 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f4db40b3290 tx=0x7f4dac02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8d61ccb7eaf0bf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:13.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.405+0000 7f4db9184640 1 -- 172.21.15.38:0/2399880903 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac02ca50 con 0x7f4db40d1620 2023-12-22T08:47:13.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.405+0000 7f4db9184640 1 -- 172.21.15.38:0/2399880903 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac02cbb0 con 0x7f4db40d1620 2023-12-22T08:47:13.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.405+0000 7f4db9184640 1 -- 172.21.15.38:0/2399880903 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0343f0 con 0x7f4db40d1620 2023-12-22T08:47:13.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.405+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2399880903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db40d1620 msgr2=0x7f4db40b6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:13.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.405+0000 7f4dbc3ea640 1 --2- 172.21.15.38:0/2399880903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db40d1620 0x7f4db40b6b20 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f4db40b3290 tx=0x7f4dac02beb0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.405+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2399880903 shutdown_connections 2023-12-22T08:47:13.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.405+0000 7f4dbc3ea640 1 --2- 172.21.15.38:0/2399880903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db40d1620 0x7f4db40b6b20 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.405+0000 7f4dbc3ea640 1 --2- 172.21.15.38:0/2399880903 >> v2:172.21.15.89:3300/0 conn(0x7f4db40d1240 0x7f4db40b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.405+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2399880903 >> 172.21.15.38:0/2399880903 conn(0x7f4db406c5e0 msgr2=0x7f4db406c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:13.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.405+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2399880903 shutdown_connections 2023-12-22T08:47:13.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.405+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2399880903 wait complete. 2023-12-22T08:47:13.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.407+0000 7f4dbc3ea640 1 Processor -- start 2023-12-22T08:47:13.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.407+0000 7f4dbc3ea640 1 -- start start 2023-12-22T08:47:13.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.408+0000 7f4dbc3ea640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4db40b3b40 0x7f4db4157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:13.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.408+0000 7f4dbc3ea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4db40d1240 0x7f4db415f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:13.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.408+0000 7f4dbc3ea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db40d1620 0x7f4db415f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.408+0000 7f4dbc3ea640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db4157550 con 0x7f4db40d1620 2023-12-22T08:47:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.408+0000 7f4dbc3ea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db40b0350 con 0x7f4db40d1240 2023-12-22T08:47:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.408+0000 7f4dbc3ea640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db41579e0 con 0x7f4db40b3b40 2023-12-22T08:47:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.409+0000 7f4dba987640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db40d1620 0x7f4db415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.409+0000 7f4dba987640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db40d1620 0x7f4db415f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40980/0 (socket says 172.21.15.38:40980) 2023-12-22T08:47:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.409+0000 7f4dba987640 1 -- 172.21.15.38:0/2926049067 learned_addr learned my addr 172.21.15.38:0/2926049067 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.409+0000 7f4db9985640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4db40d1240 0x7f4db415f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.409+0000 7f4dba186640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4db40b3b40 0x7f4db4157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.409+0000 7f4dba987640 1 -- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4db40b3b40 msgr2=0x7f4db4157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.409+0000 7f4dba987640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4db40b3b40 0x7f4db4157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.409+0000 7f4dba987640 1 -- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4db40d1240 msgr2=0x7f4db415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:13.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.409+0000 7f4dba987640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4db40d1240 0x7f4db415f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.409+0000 7f4dba987640 1 -- 172.21.15.38:0/2926049067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac009b30 con 0x7f4db40d1620 2023-12-22T08:47:13.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.409+0000 7f4dba186640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4db40b3b40 0x7f4db4157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:13.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.409+0000 7f4dba987640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db40d1620 0x7f4db415f770 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f4dac036040 tx=0x7f4dac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:13.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.410+0000 7f4daaffd640 1 -- 172.21.15.38:0/2926049067 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac03e450 con 0x7f4db40d1620 2023-12-22T08:47:13.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.410+0000 7f4daaffd640 1 -- 172.21.15.38:0/2926049067 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac03e5d0 con 0x7f4db40d1620 2023-12-22T08:47:13.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.410+0000 7f4daaffd640 1 -- 172.21.15.38:0/2926049067 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac03e980 con 0x7f4db40d1620 2023-12-22T08:47:13.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.410+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2926049067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db4156c20 con 0x7f4db40d1620 2023-12-22T08:47:13.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.410+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2926049067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db41571e0 con 0x7f4db40d1620 2023-12-22T08:47:13.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.411+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2926049067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db4061910 con 0x7f4db40d1620 2023-12-22T08:47:13.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.412+0000 7f4daaffd640 1 -- 172.21.15.38:0/2926049067 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4dac03eae0 con 0x7f4db40d1620 2023-12-22T08:47:13.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.413+0000 7f4daaffd640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d9806a480 0x7f4d9806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:13.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.413+0000 7f4daaffd640 1 -- 172.21.15.38:0/2926049067 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4dac0ab730 con 0x7f4db40d1620 2023-12-22T08:47:13.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.414+0000 7f4dba186640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d9806a480 0x7f4d9806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:13.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.415+0000 7f4dba186640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d9806a480 0x7f4d9806c940 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4db0008890 tx=0x7f4db0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:13.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.417+0000 7f4daaffd640 1 -- 172.21.15.38:0/2926049067 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4dac076e00 con 0x7f4db40d1620 2023-12-22T08:47:13.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.650+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2926049067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4db40cf500 con 0x7f4db40d1620 2023-12-22T08:47:13.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.651+0000 7f4daaffd640 1 -- 172.21.15.38:0/2926049067 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f4dac07a420 con 0x7f4db40d1620 2023-12-22T08:47:13.652 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:13.652 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/186375012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":186375012},{"type":"v1","addr":"172.21.15.89:6837","nonce":186375012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1819583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1819583870},{"type":"v1","addr":"172.21.15.89:6835","nonce":1819583870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3793773672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3793773672},{"type":"v1","addr":"172.21.15.38:6834","nonce":3793773672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:07.035669+0000","modified":"2023-12-22T08:47:10.565916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7293":{"gid":7293,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3340763944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3340763944},{"type":"v1","addr":"172.21.15.38:6835","nonce":3340763944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-22T08:47:13.652 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 55 2023-12-22T08:47:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.653+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d9806a480 msgr2=0x7f4d9806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.653+0000 7f4dbc3ea640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d9806a480 0x7f4d9806c940 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4db0008890 tx=0x7f4db0008040 comp rx=0 tx=0).stop 2023-12-22T08:47:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.653+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2926049067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db40d1620 msgr2=0x7f4db415f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.653+0000 7f4dbc3ea640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db40d1620 0x7f4db415f770 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f4dac036040 tx=0x7f4dac004a40 comp rx=0 tx=0).stop 2023-12-22T08:47:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.653+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2926049067 shutdown_connections 2023-12-22T08:47:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.653+0000 7f4dbc3ea640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d9806a480 0x7f4d9806c940 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.653+0000 7f4dbc3ea640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4db40d1620 0x7f4db415f770 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.653+0000 7f4dbc3ea640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4db40d1240 0x7f4db415f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.653+0000 7f4dbc3ea640 1 --2- 172.21.15.38:0/2926049067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4db40b3b40 0x7f4db4157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.653+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2926049067 >> 172.21.15.38:0/2926049067 conn(0x7f4db406c5e0 msgr2=0x7f4db40b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:13.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.654+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2926049067 shutdown_connections 2023-12-22T08:47:13.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:13.654+0000 7f4dbc3ea640 1 -- 172.21.15.38:0/2926049067 wait complete. 2023-12-22T08:47:14.080 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T08:47:07.035669+0000', 'modified': '2023-12-22T08:47:10.565916+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7293': {'gid': 7293, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.38:6835/3340763944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6833', 'nonce': 3340763944}, {'type': 'v1', 'addr': '172.21.15.38:6835', 'nonce': 3340763944}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T08:47:14.080 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T08:47:14.080 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-22T08:47:14.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.318+0000 7f133c98f640 1 Processor -- start 2023-12-22T08:47:14.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.318+0000 7f133c98f640 1 -- start start 2023-12-22T08:47:14.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.319+0000 7f133c98f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1338071d80 0x7f13380a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.320+0000 7f133c98f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1338161750 0x7f133806c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.320+0000 7f133c98f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133806c2a0 con 0x7f13380a35a0 2023-12-22T08:47:14.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.320+0000 7f133c98f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13380a44a0 con 0x7f1338071d80 2023-12-22T08:47:14.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.320+0000 7f133c98f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13380a3a00 con 0x7f1338161750 2023-12-22T08:47:14.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.320+0000 7f1337fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1338161750 0x7f133806c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.320+0000 7f1336ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f13380a35a0 0x7f1338161040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:38244/0 (socket says 172.21.15.38:38244) 2023-12-22T08:47:14.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.320+0000 7f1336ffd640 1 -- 172.21.15.38:0/962832551 learned_addr learned my addr 172.21.15.38:0/962832551 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:14.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.321+0000 7f13377fe640 1 --2- 172.21.15.38:0/962832551 >> v2:172.21.15.89:3300/0 conn(0x7f1338071d80 0x7f13380a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.321+0000 7f13367fc640 1 -- 172.21.15.38:0/962832551 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877818500 0 0) 0x7f133806c2a0 con 0x7f13380a35a0 2023-12-22T08:47:14.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.321+0000 7f13377fe640 1 -- 172.21.15.38:0/962832551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1338161750 msgr2=0x7f133806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:14.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.321+0000 7f13377fe640 1 --2- 172.21.15.38:0/962832551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1338161750 0x7f133806c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.321+0000 7f13377fe640 1 -- 172.21.15.38:0/962832551 >> v1:172.21.15.89:6789/0 conn(0x7f13380a35a0 legacy=0x7f1338161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.321+0000 7f13377fe640 1 -- 172.21.15.38:0/962832551 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1338072160 con 0x7f1338071d80 2023-12-22T08:47:14.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.321+0000 7f1337fff640 1 --2- 172.21.15.38:0/962832551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1338161750 0x7f133806c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:47:14.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.323+0000 7f13377fe640 1 --2- 172.21.15.38:0/962832551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1338071d80 0x7f13380a3060 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f13280097a0 tx=0x7f132802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=995fc72fd89f8cbe server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:14.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.323+0000 7f13367fc640 1 -- 172.21.15.38:0/962832551 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132802d040 con 0x7f1338071d80 2023-12-22T08:47:14.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.323+0000 7f13367fc640 1 -- 172.21.15.38:0/962832551 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1328031810 con 0x7f1338071d80 2023-12-22T08:47:14.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.323+0000 7f13367fc640 1 -- 172.21.15.38:0/962832551 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328031ba0 con 0x7f1338071d80 2023-12-22T08:47:14.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.324+0000 7f133c98f640 1 -- 172.21.15.38:0/962832551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1338071d80 msgr2=0x7f13380a3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.324+0000 7f133c98f640 1 --2- 172.21.15.38:0/962832551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1338071d80 0x7f13380a3060 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f13280097a0 tx=0x7f132802b8b0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.324+0000 7f133c98f640 1 -- 172.21.15.38:0/962832551 shutdown_connections 2023-12-22T08:47:14.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.324+0000 7f133c98f640 1 --2- 172.21.15.38:0/962832551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1338161750 0x7f133806c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.324+0000 7f133c98f640 1 --2- 172.21.15.38:0/962832551 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1338071d80 0x7f13380a3060 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.324+0000 7f133c98f640 1 -- 172.21.15.38:0/962832551 >> 172.21.15.38:0/962832551 conn(0x7f13380cf000 msgr2=0x7f13380cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:14.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.324+0000 7f133c98f640 1 -- 172.21.15.38:0/962832551 shutdown_connections 2023-12-22T08:47:14.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.324+0000 7f133c98f640 1 -- 172.21.15.38:0/962832551 wait complete. 2023-12-22T08:47:14.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.326+0000 7f133c98f640 1 Processor -- start 2023-12-22T08:47:14.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.326+0000 7f133c98f640 1 -- start start 2023-12-22T08:47:14.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.327+0000 7f133c98f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1338071d80 0x7f133815f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.327+0000 7f133c98f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13380a35a0 0x7f1338099c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.327+0000 7f133c98f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1338161750 0x7f13381f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.327+0000 7f133c98f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1338143650 con 0x7f13380a35a0 2023-12-22T08:47:14.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.327+0000 7f133c98f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13381438c0 con 0x7f1338071d80 2023-12-22T08:47:14.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.327+0000 7f133c98f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1338143ba0 con 0x7f1338161750 2023-12-22T08:47:14.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.327+0000 7f1336ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13380a35a0 0x7f1338099c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.327+0000 7f1336ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13380a35a0 0x7f1338099c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40984/0 (socket says 172.21.15.38:40984) 2023-12-22T08:47:14.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.327+0000 7f1336ffd640 1 -- 172.21.15.38:0/2341139664 learned_addr learned my addr 172.21.15.38:0/2341139664 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:14.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.328+0000 7f13377fe640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1338071d80 0x7f133815f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.328+0000 7f1337fff640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1338161750 0x7f13381f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.328+0000 7f1336ffd640 1 -- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1338161750 msgr2=0x7f13381f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.328+0000 7f1336ffd640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1338161750 0x7f13381f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.328+0000 7f1336ffd640 1 -- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1338071d80 msgr2=0x7f133815f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.328+0000 7f1336ffd640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1338071d80 0x7f133815f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.328+0000 7f1336ffd640 1 -- 172.21.15.38:0/2341139664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330009a70 con 0x7f13380a35a0 2023-12-22T08:47:14.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.328+0000 7f1336ffd640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13380a35a0 0x7f1338099c70 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f132c00c4a0 tx=0x7f132c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:14.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.328+0000 7f131ffff640 1 -- 172.21.15.38:0/2341139664 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c0074e0 con 0x7f13380a35a0 2023-12-22T08:47:14.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.328+0000 7f131ffff640 1 -- 172.21.15.38:0/2341139664 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c007640 con 0x7f13380a35a0 2023-12-22T08:47:14.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.328+0000 7f131ffff640 1 -- 172.21.15.38:0/2341139664 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c004a00 con 0x7f13380a35a0 2023-12-22T08:47:14.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.328+0000 7f133c98f640 1 -- 172.21.15.38:0/2341139664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1328009400 con 0x7f13380a35a0 2023-12-22T08:47:14.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.329+0000 7f133c98f640 1 -- 172.21.15.38:0/2341139664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133815fa80 con 0x7f13380a35a0 2023-12-22T08:47:14.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.331+0000 7f131ffff640 1 -- 172.21.15.38:0/2341139664 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f132c004b60 con 0x7f13380a35a0 2023-12-22T08:47:14.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.331+0000 7f131ffff640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f132406a430 0x7f132406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.332+0000 7f131ffff640 1 -- 172.21.15.38:0/2341139664 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f132c087a40 con 0x7f13380a35a0 2023-12-22T08:47:14.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.332+0000 7f13377fe640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f132406a430 0x7f132406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.333+0000 7f1340834740 1 Processor -- start 2023-12-22T08:47:14.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.333+0000 7f1340834740 1 -- start start 2023-12-22T08:47:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.334+0000 7f13377fe640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f132406a430 0x7f132406c8f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1328036000 tx=0x7f132803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.334+0000 7f1340834740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771d4f10 0x55e8771d52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.334+0000 7f1340834740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a4e90 0x55e8771d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.334+0000 7f1340834740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771a8a90 0x55e8771d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.334+0000 7f1340834740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e877114f80 con 0x55e8771a8a90 2023-12-22T08:47:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.334+0000 7f1340834740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e877112710 con 0x55e8771d4f10 2023-12-22T08:47:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.334+0000 7f1340834740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e87710e000 con 0x55e8771a4e90 2023-12-22T08:47:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.334+0000 7f1337fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771a8a90 0x55e8771d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.334+0000 7f1337fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771a8a90 0x55e8771d26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40986/0 (socket says 172.21.15.38:40986) 2023-12-22T08:47:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.334+0000 7f1337fff640 1 -- 172.21.15.38:0/3976658506 learned_addr learned my addr 172.21.15.38:0/3976658506 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.335+0000 7f1336ffd640 1 --2- 172.21.15.38:0/3976658506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a4e90 0x55e8771d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.335+0000 7f13377fe640 1 --2- 172.21.15.38:0/3976658506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771d4f10 0x55e8771d52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.335+0000 7f1337fff640 1 -- 172.21.15.38:0/3976658506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a4e90 msgr2=0x55e8771d2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.335+0000 7f1337fff640 1 --2- 172.21.15.38:0/3976658506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a4e90 0x55e8771d2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.335+0000 7f1337fff640 1 -- 172.21.15.38:0/3976658506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771d4f10 msgr2=0x55e8771d52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.335+0000 7f1337fff640 1 --2- 172.21.15.38:0/3976658506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771d4f10 0x55e8771d52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.335+0000 7f1337fff640 1 -- 172.21.15.38:0/3976658506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8770d5690 con 0x55e8771a8a90 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.335+0000 7f1336ffd640 1 --2- 172.21.15.38:0/3976658506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a4e90 0x55e8771d2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.335+0000 7f1337fff640 1 --2- 172.21.15.38:0/3976658506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771a8a90 0x55e8771d26c0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f1330009a40 tx=0x7f1330009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1c20cbf0ec4897 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.335+0000 7f131d7fa640 1 -- 172.21.15.38:0/3976658506 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133000e050 con 0x55e8771a8a90 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.335+0000 7f131d7fa640 1 -- 172.21.15.38:0/3976658506 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133000f040 con 0x55e8771a8a90 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.335+0000 7f131d7fa640 1 -- 172.21.15.38:0/3976658506 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330015a50 con 0x55e8771a8a90 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.336+0000 7f1340834740 1 -- 172.21.15.38:0/3976658506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771a8a90 msgr2=0x55e8771d26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.336+0000 7f1340834740 1 --2- 172.21.15.38:0/3976658506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771a8a90 0x55e8771d26c0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f1330009a40 tx=0x7f1330009750 comp rx=0 tx=0).stop 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.336+0000 7f1340834740 1 -- 172.21.15.38:0/3976658506 shutdown_connections 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.336+0000 7f1340834740 1 --2- 172.21.15.38:0/3976658506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771a8a90 0x55e8771d26c0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.336+0000 7f1340834740 1 --2- 172.21.15.38:0/3976658506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a4e90 0x55e8771d2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.336+0000 7f1340834740 1 --2- 172.21.15.38:0/3976658506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771d4f10 0x55e8771d52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.336+0000 7f1340834740 1 -- 172.21.15.38:0/3976658506 >> 172.21.15.38:0/3976658506 conn(0x55e8771a71a0 msgr2=0x55e8771efd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:14.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.336+0000 7f1340834740 1 -- 172.21.15.38:0/3976658506 shutdown_connections 2023-12-22T08:47:14.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.336+0000 7f1340834740 1 -- 172.21.15.38:0/3976658506 wait complete. 2023-12-22T08:47:14.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.337+0000 7f1340834740 1 -- start start 2023-12-22T08:47:14.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.337+0000 7f1340834740 1 Processor -- start 2023-12-22T08:47:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.338+0000 7f1340834740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a8a90 0x55e8771fed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.338+0000 7f1340834740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771c1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.338+0000 7f1340834740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771f24b0 0x55e8771f2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.338+0000 7f1340834740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8770af7d0 con 0x55e8771d4f10 2023-12-22T08:47:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.338+0000 7f1340834740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8770af470 con 0x55e8771f24b0 2023-12-22T08:47:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.338+0000 7f1340834740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e876e75f20 con 0x55e8771a8a90 2023-12-22T08:47:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.338+0000 7f1340834740 10 client.0 _ll_register_callbacks cb 0x55e8770fe1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:47:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.338+0000 7f1336ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.339+0000 7f1336ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771c1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40992/0 (socket says 172.21.15.38:40992) 2023-12-22T08:47:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.339+0000 7f1336ffd640 1 -- 172.21.15.38:0/851503514 learned_addr learned my addr 172.21.15.38:0/851503514 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.339+0000 7f13377fe640 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a8a90 0x55e8771fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.339+0000 7f1336ffd640 1 -- 172.21.15.38:0/851503514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a8a90 msgr2=0x55e8771fed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.339+0000 7f1336ffd640 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a8a90 0x55e8771fed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.339+0000 7f1337fff640 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771f24b0 0x55e8771f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.339+0000 7f1336ffd640 1 -- 172.21.15.38:0/851503514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771f24b0 msgr2=0x55e8771f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.339+0000 7f1336ffd640 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771f24b0 0x55e8771f2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.339+0000 7f1336ffd640 1 -- 172.21.15.38:0/851503514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1330007350 con 0x55e8771d4f10 2023-12-22T08:47:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.339+0000 7f13377fe640 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a8a90 0x55e8771fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.339+0000 7f1336ffd640 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771c1a30 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f132c00c470 tx=0x7f132c056e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7357ddd0cde9cff9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.339+0000 7f13167fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:47:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.339+0000 7f13167fc640 1 -- 172.21.15.38:0/851503514 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c06e370 con 0x55e8771d4f10 2023-12-22T08:47:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.340+0000 7f13167fc640 1 -- 172.21.15.38:0/851503514 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f132c004e10 con 0x55e8771d4f10 2023-12-22T08:47:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.340+0000 7f1340834740 1 -- 172.21.15.38:0/851503514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e877138550 con 0x55e8771d4f10 2023-12-22T08:47:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.340+0000 7f13167fc640 1 -- 172.21.15.38:0/851503514 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f132c05e8d0 con 0x55e8771d4f10 2023-12-22T08:47:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.340+0000 7f1340834740 10 client.7434 fetch_fsmap learned FSMap version 55 2023-12-22T08:47:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.340+0000 7f1340834740 1 -- 172.21.15.38:0/851503514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55e87710c680 con 0x55e8771d4f10 2023-12-22T08:47:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.340+0000 7f13167fc640 1 -- 172.21.15.38:0/851503514 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c072020 con 0x55e8771d4f10 2023-12-22T08:47:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.340+0000 7f13167fc640 1 -- 172.21.15.38:0/851503514 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 55) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f132c052b70 con 0x55e8771d4f10 2023-12-22T08:47:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.340+0000 7f1340834740 10 client.7434 fetch_fsmap finished waiting for FSMap version 55 2023-12-22T08:47:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.340+0000 7f1340834740 10 client.7434 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-22T08:47:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.340+0000 7f1340834740 20 client.7434 populate_metadata read hostname 'smithi038' 2023-12-22T08:47:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.340+0000 7f1340834740 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.38:6833/3340763944,v1:172.21.15.38:6835/3340763944] conn(0x55e8771c3d00 0x55e8771c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.340+0000 7f1340834740 4 client.7434 mds_command: new command op to 7293 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T08:47:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.340+0000 7f1340834740 1 -- 172.21.15.38:0/851503514 --> [v2:172.21.15.38:6833/3340763944,v1:172.21.15.38:6835/3340763944] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e877100b50 con 0x55e8771c3d00 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.341+0000 7f13377fe640 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.38:6833/3340763944,v1:172.21.15.38:6835/3340763944] conn(0x55e8771c3d00 0x55e8771c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.341+0000 7f13377fe640 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.38:6833/3340763944,v1:172.21.15.38:6835/3340763944] conn(0x55e8771c3d00 0x55e8771c40e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5bae01448b25d17 server_cookie=963d7be3e42de18f in_seq=0 out_seq=0 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.341+0000 7f13167fc640 10 client.7434 ms_handle_connect on v2:172.21.15.38:6833/3340763944 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.342+0000 7f13167fc640 1 -- 172.21.15.38:0/851503514 <== mds.0 v2:172.21.15.38:6833/3340763944 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55e877100b50 con 0x55e8771c3d00 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.342+0000 7f13167fc640 10 client.7434 handle_command_reply: tid=0 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.342+0000 7f1340834740 1 client.7434 shutdown 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.342+0000 7f1340834740 1 -- 172.21.15.38:0/851503514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 msgr2=0x55e8771c1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.342+0000 7f1340834740 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771c1a30 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f132c00c470 tx=0x7f132c056e40 comp rx=0 tx=0).stop 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.342+0000 7f1340834740 1 -- 172.21.15.38:0/851503514 shutdown_connections 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.342+0000 7f1340834740 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.38:6833/3340763944,v1:172.21.15.38:6835/3340763944] conn(0x55e8771c3d00 0x55e8771c40e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.342+0000 7f1340834740 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771f24b0 0x55e8771f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.342+0000 7f1340834740 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771c1a30 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.342+0000 7f1340834740 1 --2- 172.21.15.38:0/851503514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a8a90 0x55e8771fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.342+0000 7f13167fc640 0 client.7434 ms_handle_reset on v2:172.21.15.38:6833/3340763944 2023-12-22T08:47:14.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.342+0000 7f1340834740 1 -- 172.21.15.38:0/851503514 >> 172.21.15.38:0/851503514 conn(0x55e8771a4e90 msgr2=0x55e8771a9340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:14.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.343+0000 7f1340834740 1 -- 172.21.15.38:0/851503514 shutdown_connections 2023-12-22T08:47:14.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.343+0000 7f1340834740 1 -- 172.21.15.38:0/851503514 wait complete. 2023-12-22T08:47:14.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.343+0000 7f1340834740 20 client.7434 trim_cache size 0 max 16384 2023-12-22T08:47:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.359+0000 7f1340834740 1 Processor -- start 2023-12-22T08:47:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.359+0000 7f1340834740 1 -- start start 2023-12-22T08:47:14.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.360+0000 7f1340834740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771a8a90 0x55e8771ab320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.360+0000 7f1340834740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.360+0000 7f1340834740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771f24b0 0x55e8771d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.360+0000 7f1340834740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8771e9bb0 con 0x55e8771d4f10 2023-12-22T08:47:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.360+0000 7f1340834740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8771fe4d0 con 0x55e8771a8a90 2023-12-22T08:47:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.360+0000 7f1340834740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e877114050 con 0x55e8771f24b0 2023-12-22T08:47:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.360+0000 7f1336ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.360+0000 7f1336ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771f28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41004/0 (socket says 172.21.15.38:41004) 2023-12-22T08:47:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.360+0000 7f1336ffd640 1 -- 172.21.15.38:0/527690620 learned_addr learned my addr 172.21.15.38:0/527690620 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.361+0000 7f1336ffd640 1 -- 172.21.15.38:0/527690620 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771f24b0 msgr2=0x55e8771d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.361+0000 7f1336ffd640 1 --2- 172.21.15.38:0/527690620 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771f24b0 0x55e8771d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.361+0000 7f1336ffd640 1 -- 172.21.15.38:0/527690620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771a8a90 msgr2=0x55e8771ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.361+0000 7f1336ffd640 1 --2- 172.21.15.38:0/527690620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771a8a90 0x55e8771ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.361+0000 7f1336ffd640 1 -- 172.21.15.38:0/527690620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8771a67f0 con 0x55e8771d4f10 2023-12-22T08:47:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.361+0000 7f1336ffd640 1 --2- 172.21.15.38:0/527690620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771f28b0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f132c056d10 tx=0x7f132c05a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9179749333c54c41 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.361+0000 7f131dffb640 1 -- 172.21.15.38:0/527690620 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c05ac30 con 0x55e8771d4f10 2023-12-22T08:47:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.361+0000 7f131dffb640 1 -- 172.21.15.38:0/527690620 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c072070 con 0x55e8771d4f10 2023-12-22T08:47:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.361+0000 7f131dffb640 1 -- 172.21.15.38:0/527690620 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00e040 con 0x55e8771d4f10 2023-12-22T08:47:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.362+0000 7f1340834740 1 -- 172.21.15.38:0/527690620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 msgr2=0x55e8771f28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.362+0000 7f1340834740 1 --2- 172.21.15.38:0/527690620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771f28b0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f132c056d10 tx=0x7f132c05a000 comp rx=0 tx=0).stop 2023-12-22T08:47:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.362+0000 7f1340834740 1 -- 172.21.15.38:0/527690620 shutdown_connections 2023-12-22T08:47:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.362+0000 7f1340834740 1 --2- 172.21.15.38:0/527690620 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771f24b0 0x55e8771d1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.362+0000 7f1340834740 1 --2- 172.21.15.38:0/527690620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771f28b0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.362+0000 7f1340834740 1 --2- 172.21.15.38:0/527690620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771a8a90 0x55e8771ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.362+0000 7f1340834740 1 -- 172.21.15.38:0/527690620 >> 172.21.15.38:0/527690620 conn(0x55e8771a4e90 msgr2=0x55e8771d6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.362+0000 7f1340834740 1 -- 172.21.15.38:0/527690620 shutdown_connections 2023-12-22T08:47:14.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.362+0000 7f1340834740 1 -- 172.21.15.38:0/527690620 wait complete. 2023-12-22T08:47:14.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.363+0000 7f1340834740 1 -- start start 2023-12-22T08:47:14.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.363+0000 7f1340834740 1 Processor -- start 2023-12-22T08:47:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.364+0000 7f1340834740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a8a90 0x55e877255bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.364+0000 7f1340834740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771e9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.364+0000 7f1340834740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771f24b0 0x55e8771e9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.364+0000 7f1340834740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e877201150 con 0x55e8771d4f10 2023-12-22T08:47:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.364+0000 7f1340834740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8771cff70 con 0x55e8771f24b0 2023-12-22T08:47:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.364+0000 7f1340834740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e8771d0530 con 0x55e8771a8a90 2023-12-22T08:47:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.364+0000 7f1340834740 10 client.0 _ll_register_callbacks cb 0x7f1330009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:47:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.364+0000 7f1336ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.365+0000 7f1336ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771e9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41020/0 (socket says 172.21.15.38:41020) 2023-12-22T08:47:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.365+0000 7f1336ffd640 1 -- 172.21.15.38:0/3458129451 learned_addr learned my addr 172.21.15.38:0/3458129451 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.365+0000 7f13377fe640 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a8a90 0x55e877255bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.365+0000 7f1337fff640 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771f24b0 0x55e8771e9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.365+0000 7f1336ffd640 1 -- 172.21.15.38:0/3458129451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a8a90 msgr2=0x55e877255bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:14.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.365+0000 7f1336ffd640 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a8a90 0x55e877255bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.365+0000 7f1336ffd640 1 -- 172.21.15.38:0/3458129451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771f24b0 msgr2=0x55e8771e9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:14.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.365+0000 7f1336ffd640 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771f24b0 0x55e8771e9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.365+0000 7f1336ffd640 1 -- 172.21.15.38:0/3458129451 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e87710c680 con 0x55e8771d4f10 2023-12-22T08:47:14.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.365+0000 7f1337fff640 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771f24b0 0x55e8771e9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:14.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.365+0000 7f1336ffd640 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771e9010 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f132c00c470 tx=0x7f132c085ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258c9a6bcdaa4f63 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:14.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.365+0000 7f13167fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:47:14.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.365+0000 7f13167fc640 1 -- 172.21.15.38:0/3458129451 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c052ea0 con 0x55e8771d4f10 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.366+0000 7f13167fc640 1 -- 172.21.15.38:0/3458129451 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f132c073080 con 0x55e8771d4f10 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.366+0000 7f1340834740 1 -- 172.21.15.38:0/3458129451 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f133000f040 con 0x55e8771d4f10 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.366+0000 7f13167fc640 1 -- 172.21.15.38:0/3458129451 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f132c05abb0 con 0x55e8771d4f10 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.366+0000 7f1340834740 10 client.7440 fetch_fsmap learned FSMap version 55 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.366+0000 7f1340834740 1 -- 172.21.15.38:0/3458129451 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55e8771abde0 con 0x55e8771d4f10 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.366+0000 7f13167fc640 1 -- 172.21.15.38:0/3458129451 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133000f040 con 0x55e8771d4f10 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.366+0000 7f13167fc640 1 -- 172.21.15.38:0/3458129451 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 55) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f132c075040 con 0x55e8771d4f10 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.366+0000 7f1340834740 10 client.7440 fetch_fsmap finished waiting for FSMap version 55 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.366+0000 7f1340834740 10 client.7440 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.366+0000 7f1340834740 20 client.7440 populate_metadata read hostname 'smithi038' 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.366+0000 7f1340834740 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.38:6833/3340763944,v1:172.21.15.38:6835/3340763944] conn(0x55e8771f1290 0x55e8771f1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.366+0000 7f1340834740 4 client.7440 mds_command: new command op to 7293 tid=0[{"prefix": "status"}] 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.366+0000 7f1340834740 1 -- 172.21.15.38:0/3458129451 --> [v2:172.21.15.38:6833/3340763944,v1:172.21.15.38:6835/3340763944] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e877107080 con 0x55e8771f1290 2023-12-22T08:47:14.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.367+0000 7f13377fe640 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.38:6833/3340763944,v1:172.21.15.38:6835/3340763944] conn(0x55e8771f1290 0x55e8771f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.367+0000 7f13377fe640 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.38:6833/3340763944,v1:172.21.15.38:6835/3340763944] conn(0x55e8771f1290 0x55e8771f1670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f138bfbc4488ab8f server_cookie=8425eccc1b252a10 in_seq=0 out_seq=0 2023-12-22T08:47:14.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.367+0000 7f13167fc640 10 client.7440 ms_handle_connect on v2:172.21.15.38:6833/3340763944 2023-12-22T08:47:14.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.367+0000 7f13167fc640 1 -- 172.21.15.38:0/3458129451 <== mds.0 v2:172.21.15.38:6833/3340763944 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55e877107080 con 0x55e8771f1290 2023-12-22T08:47:14.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.367+0000 7f13167fc640 10 client.7440 handle_command_reply: tid=0 2023-12-22T08:47:14.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.367+0000 7f1340834740 1 client.7440 shutdown 2023-12-22T08:47:14.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.368+0000 7f1340834740 1 -- 172.21.15.38:0/3458129451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 msgr2=0x55e8771e9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.368+0000 7f1340834740 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771e9010 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f132c00c470 tx=0x7f132c085ed0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.368+0000 7f1340834740 1 -- 172.21.15.38:0/3458129451 shutdown_connections 2023-12-22T08:47:14.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.368+0000 7f1340834740 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.38:6833/3340763944,v1:172.21.15.38:6835/3340763944] conn(0x55e8771f1290 0x55e8771f1670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.368+0000 7f1340834740 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e8771f24b0 0x55e8771e9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.368+0000 7f1340834740 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8771d4f10 0x55e8771e9010 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.368+0000 7f1340834740 1 --2- 172.21.15.38:0/3458129451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55e8771a8a90 0x55e877255bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.368+0000 7f13167fc640 0 client.7440 ms_handle_reset on v2:172.21.15.38:6833/3340763944 2023-12-22T08:47:14.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.368+0000 7f1340834740 1 -- 172.21.15.38:0/3458129451 >> 172.21.15.38:0/3458129451 conn(0x55e8771a4e90 msgr2=0x55e8771d1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:14.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.368+0000 7f1340834740 1 -- 172.21.15.38:0/3458129451 shutdown_connections 2023-12-22T08:47:14.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.368+0000 7f1340834740 1 -- 172.21.15.38:0/3458129451 wait complete. 2023-12-22T08:47:14.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.368+0000 7f1340834740 20 client.7440 trim_cache size 0 max 16384 2023-12-22T08:47:14.374 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:47:14.374 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:47:14.374 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-12-22T08:47:14.374 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 7293, 2023-12-22T08:47:14.374 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-12-22T08:47:14.375 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-12-22T08:47:14.375 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-12-22T08:47:14.375 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 7.3269414919999996, 2023-12-22T08:47:14.375 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 55, 2023-12-22T08:47:14.375 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 127, 2023-12-22T08:47:14.375 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 127, 2023-12-22T08:47:14.375 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 13.194335317 2023-12-22T08:47:14.375 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:47:14.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.369+0000 7f133c98f640 1 -- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f132406a430 msgr2=0x7f132406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.369+0000 7f133c98f640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f132406a430 0x7f132406c8f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1328036000 tx=0x7f132803c040 comp rx=0 tx=0).stop 2023-12-22T08:47:14.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.369+0000 7f133c98f640 1 -- 172.21.15.38:0/2341139664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13380a35a0 msgr2=0x7f1338099c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.369+0000 7f133c98f640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13380a35a0 0x7f1338099c70 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f132c00c4a0 tx=0x7f132c00c960 comp rx=0 tx=0).stop 2023-12-22T08:47:14.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.369+0000 7f133c98f640 1 -- 172.21.15.38:0/2341139664 shutdown_connections 2023-12-22T08:47:14.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.369+0000 7f133c98f640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1338161750 0x7f13381f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.369+0000 7f133c98f640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f132406a430 0x7f132406c8f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.369+0000 7f133c98f640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13380a35a0 0x7f1338099c70 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.369+0000 7f133c98f640 1 --2- 172.21.15.38:0/2341139664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1338071d80 0x7f133815f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.369+0000 7f133c98f640 1 -- 172.21.15.38:0/2341139664 >> 172.21.15.38:0/2341139664 conn(0x7f13380cf000 msgr2=0x7f133806cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:14.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.369+0000 7f133c98f640 1 -- 172.21.15.38:0/2341139664 shutdown_connections 2023-12-22T08:47:14.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.369+0000 7f133c98f640 1 -- 172.21.15.38:0/2341139664 wait complete. 2023-12-22T08:47:14.387 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:47:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.599+0000 7fbb917d6640 1 Processor -- start 2023-12-22T08:47:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.599+0000 7fbb917d6640 1 -- start start 2023-12-22T08:47:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.601+0000 7fbb917d6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb8c157980 0x7fbb8c15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.601+0000 7fbb917d6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8c0d1520 con 0x7fbb8c06d640 2023-12-22T08:47:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.601+0000 7fbb917d6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8c0d1800 con 0x7fbb8c0b3ff0 2023-12-22T08:47:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.601+0000 7fbb917d6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0d1ae0 con 0x7fbb8c157980 2023-12-22T08:47:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.602+0000 7fbb90fd5640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbb8c06d640 0x7fbb8c0d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51490/0 (socket says 172.21.15.38:51490) 2023-12-22T08:47:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.602+0000 7fbb90fd5640 1 -- 172.21.15.38:0/3410579975 learned_addr learned my addr 172.21.15.38:0/3410579975 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.602+0000 7fbb8bfff640 1 --2- 172.21.15.38:0/3410579975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb8c157980 0x7fbb8c15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.602+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231899987 0 0) 0x7fbb8c0d1520 con 0x7fbb8c06d640 2023-12-22T08:47:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.602+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb78003520 con 0x7fbb8c06d640 2023-12-22T08:47:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.602+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2630912267 0 0) 0x7fbb78003520 con 0x7fbb8c06d640 2023-12-22T08:47:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.602+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb8c157980 msgr2=0x7fbb8c15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.602+0000 7fbb8b7fe640 1 --2- 172.21.15.38:0/3410579975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb8c157980 0x7fbb8c15eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.602+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 >> v1:172.21.15.89:6789/0 conn(0x7fbb8c0b3ff0 legacy=0x7fbb8c06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.602+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c0d1dc0 con 0x7fbb8c06d640 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.602+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fbb840019f0 con 0x7fbb8c06d640 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 >> v1:172.21.15.38:6789/0 conn(0x7fbb8c06d640 legacy=0x7fbb8c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb8b7fe640 1 --2- 172.21.15.38:0/3410579975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb8c157980 0x7fbb780039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb8b7fe640 1 --2- 172.21.15.38:0/3410579975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb78003f70 0x7fbb780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb8b7fe640 1 --2- 172.21.15.38:0/3410579975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb78004d00 0x7fbb78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0d1ae0 con 0x7fbb78003f70 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7800bac0 con 0x7fbb78004d00 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7800bc80 con 0x7fbb8c157980 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb83fff640 1 --2- 172.21.15.38:0/3410579975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb78003f70 0x7fbb780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb8bfff640 1 --2- 172.21.15.38:0/3410579975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb8c157980 0x7fbb780039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb90fd5640 1 --2- 172.21.15.38:0/3410579975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb78004d00 0x7fbb78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb83fff640 1 -- 172.21.15.38:0/3410579975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb8c157980 msgr2=0x7fbb780039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:14.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb83fff640 1 --2- 172.21.15.38:0/3410579975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb8c157980 0x7fbb780039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb83fff640 1 -- 172.21.15.38:0/3410579975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb78004d00 msgr2=0x7fbb78005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:14.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.603+0000 7fbb83fff640 1 --2- 172.21.15.38:0/3410579975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb78004d00 0x7fbb78005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.604+0000 7fbb83fff640 1 -- 172.21.15.38:0/3410579975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb78003520 con 0x7fbb78003f70 2023-12-22T08:47:14.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.605+0000 7fbb83fff640 1 --2- 172.21.15.38:0/3410579975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb78003f70 0x7fbb780047c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbb74001750 tx=0x7fbb780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8137ab30dab145 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:14.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.608+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb740052d0 con 0x7fbb78003f70 2023-12-22T08:47:14.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.608+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7402e050 con 0x7fbb78003f70 2023-12-22T08:47:14.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.608+0000 7fbb8b7fe640 1 -- 172.21.15.38:0/3410579975 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74003830 con 0x7fbb78003f70 2023-12-22T08:47:14.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.609+0000 7fbb917d6640 1 -- 172.21.15.38:0/3410579975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb78003f70 msgr2=0x7fbb780047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.609+0000 7fbb917d6640 1 --2- 172.21.15.38:0/3410579975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb78003f70 0x7fbb780047c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbb74001750 tx=0x7fbb780057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.609+0000 7fbb90fd5640 1 -- 172.21.15.38:0/3410579975 reap_dead start 2023-12-22T08:47:14.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.609+0000 7fbb917d6640 1 -- 172.21.15.38:0/3410579975 shutdown_connections 2023-12-22T08:47:14.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.609+0000 7fbb917d6640 1 -- 172.21.15.38:0/3410579975 >> 172.21.15.38:0/3410579975 conn(0x7fbb8c0d31f0 msgr2=0x7fbb8c0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:14.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.609+0000 7fbb917d6640 1 -- 172.21.15.38:0/3410579975 shutdown_connections 2023-12-22T08:47:14.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.609+0000 7fbb917d6640 1 -- 172.21.15.38:0/3410579975 wait complete. 2023-12-22T08:47:14.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.611+0000 7fbb917d6640 1 Processor -- start 2023-12-22T08:47:14.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.611+0000 7fbb917d6640 1 -- start start 2023-12-22T08:47:14.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.612+0000 7fbb917d6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb8c1f2460 0x7fbb8c1f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.612+0000 7fbb917d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb8c1f6280 0x7fbb8c1f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.612+0000 7fbb917d6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb8c15a6a0 0x7fbb8c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.612+0000 7fbb917d6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c158f30 con 0x7fbb8c1f6280 2023-12-22T08:47:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.612+0000 7fbb917d6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c159210 con 0x7fbb8c15a6a0 2023-12-22T08:47:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.612+0000 7fbb917d6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c1594f0 con 0x7fbb8c1f2460 2023-12-22T08:47:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.612+0000 7fbb83fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb8c1f6280 0x7fbb8c1f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.612+0000 7fbb83fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb8c1f6280 0x7fbb8c1f2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41032/0 (socket says 172.21.15.38:41032) 2023-12-22T08:47:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.612+0000 7fbb83fff640 1 -- 172.21.15.38:0/264024997 learned_addr learned my addr 172.21.15.38:0/264024997 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.613+0000 7fbb8bfff640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb8c1f2460 0x7fbb8c1f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.613+0000 7fbb90fd5640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb8c15a6a0 0x7fbb8c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.613+0000 7fbb83fff640 1 -- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb8c1f2460 msgr2=0x7fbb8c1f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.613+0000 7fbb83fff640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb8c1f2460 0x7fbb8c1f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.613+0000 7fbb83fff640 1 -- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb8c15a6a0 msgr2=0x7fbb8c06f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.613+0000 7fbb83fff640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb8c15a6a0 0x7fbb8c06f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.613+0000 7fbb83fff640 1 -- 172.21.15.38:0/264024997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c1597d0 con 0x7fbb8c1f6280 2023-12-22T08:47:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.613+0000 7fbb83fff640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb8c1f6280 0x7fbb8c1f2d80 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fbb74005040 tx=0x7fbb74001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:14.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.614+0000 7fbb897fa640 1 -- 172.21.15.38:0/264024997 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74007a30 con 0x7fbb8c1f6280 2023-12-22T08:47:14.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.614+0000 7fbb897fa640 1 -- 172.21.15.38:0/264024997 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb740069e0 con 0x7fbb8c1f6280 2023-12-22T08:47:14.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.614+0000 7fbb897fa640 1 -- 172.21.15.38:0/264024997 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74006d70 con 0x7fbb8c1f6280 2023-12-22T08:47:14.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.614+0000 7fbb917d6640 1 -- 172.21.15.38:0/264024997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8c159ab0 con 0x7fbb8c1f6280 2023-12-22T08:47:14.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.614+0000 7fbb917d6640 1 -- 172.21.15.38:0/264024997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8c06fbf0 con 0x7fbb8c1f6280 2023-12-22T08:47:14.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.615+0000 7fbb917d6640 1 -- 172.21.15.38:0/264024997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8c061910 con 0x7fbb8c1f6280 2023-12-22T08:47:14.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.616+0000 7fbb897fa640 1 -- 172.21.15.38:0/264024997 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbb740035f0 con 0x7fbb8c1f6280 2023-12-22T08:47:14.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.617+0000 7fbb897fa640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb6c06a460 0x7fbb6c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:14.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.617+0000 7fbb897fa640 1 -- 172.21.15.38:0/264024997 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb740aa5e0 con 0x7fbb8c1f6280 2023-12-22T08:47:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.618+0000 7fbb8bfff640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb6c06a460 0x7fbb6c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:14.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.619+0000 7fbb8bfff640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb6c06a460 0x7fbb6c06c920 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009a10 tx=0x7fbb7c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:14.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.621+0000 7fbb897fa640 1 -- 172.21.15.38:0/264024997 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbb74075c50 con 0x7fbb8c1f6280 2023-12-22T08:47:14.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.854+0000 7fbb917d6640 1 -- 172.21.15.38:0/264024997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbb8c15c0b0 con 0x7fbb8c1f6280 2023-12-22T08:47:14.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.854+0000 7fbb897fa640 1 -- 172.21.15.38:0/264024997 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbb74079270 con 0x7fbb8c1f6280 2023-12-22T08:47:14.856 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:47:14.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.857+0000 7fbb917d6640 1 -- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb6c06a460 msgr2=0x7fbb6c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.857+0000 7fbb917d6640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb6c06a460 0x7fbb6c06c920 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009a10 tx=0x7fbb7c008040 comp rx=0 tx=0).stop 2023-12-22T08:47:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.857+0000 7fbb917d6640 1 -- 172.21.15.38:0/264024997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb8c1f6280 msgr2=0x7fbb8c1f2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.857+0000 7fbb917d6640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb8c1f6280 0x7fbb8c1f2d80 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fbb74005040 tx=0x7fbb74001120 comp rx=0 tx=0).stop 2023-12-22T08:47:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.857+0000 7fbb917d6640 1 -- 172.21.15.38:0/264024997 shutdown_connections 2023-12-22T08:47:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.857+0000 7fbb917d6640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb8c15a6a0 0x7fbb8c06f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.857+0000 7fbb917d6640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb6c06a460 0x7fbb6c06c920 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.857+0000 7fbb917d6640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb8c1f6280 0x7fbb8c1f2d80 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.857+0000 7fbb917d6640 1 --2- 172.21.15.38:0/264024997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb8c1f2460 0x7fbb8c1f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.857+0000 7fbb917d6640 1 -- 172.21.15.38:0/264024997 >> 172.21.15.38:0/264024997 conn(0x7fbb8c0d31f0 msgr2=0x7fbb8c070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.857+0000 7fbb917d6640 1 -- 172.21.15.38:0/264024997 shutdown_connections 2023-12-22T08:47:14.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:14.858+0000 7fbb917d6640 1 -- 172.21.15.38:0/264024997 wait complete. 2023-12-22T08:47:14.878 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:47:14.879 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:47:14.879 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-12-22T08:47:14.879 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T08:47:14.879 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:47:14.879 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:47:14.879 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:47:14.879 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:47:14.879 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:47:14.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:14.879 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-12-22T08:47:14.935 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:47:14.935 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:47:14.936 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:47:14.936 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:14.936 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:47:14.936 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:14.936 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:47:14.936 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:14.936 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-12-22T08:47:14.936 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:47:14.936 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:14.936 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-12-22T08:47:14.936 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:47:14.937 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:14.938 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-12-22T08:47:14.938 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-22T08:47:14.938 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 41931sec preferred_lft 41931sec 2023-12-22T08:47:14.938 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-22T08:47:14.938 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:14.938 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:47:14.938 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:14.938 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-12-22T08:47:14.938 INFO:teuthology.orchestra.run.smithi038.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:47:14.938 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:14.938 INFO:teuthology.orchestra.run.smithi038.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:47:14.938 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:14.938 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::5440:f6ff:fe40:85a/64 scope link 2023-12-22T08:47:14.939 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:14.939 INFO:teuthology.orchestra.run.smithi038.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:47:14.939 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:c3:65:6c:32:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:47:14.939 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::e4c3:65ff:fe6c:322e/64 scope link 2023-12-22T08:47:14.939 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:14.939 INFO:teuthology.orchestra.run.smithi038.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:47:14.939 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T08:47:14.939 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::34bf:8aff:fe68:3bf6/64 scope link 2023-12-22T08:47:14.939 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:14.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:14.940 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:47:15.039 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-12-22T08:47:15.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:15.044 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-12-22T08:47:15.110 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-12-22T08:47:15.110 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:47:15.110 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-22T08:47:15.110 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-22T08:47:15.110 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:47:15.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:15.111 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:47:15.111 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:47:15.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T08:47:15.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T08:47:15.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T08:47:15.111 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:47:15.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:15.300 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:47:15.356 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:47:15.356 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-22T08:47:15.356 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:47:15.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:15.356 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-12-22T08:47:15.464 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:47:15.464 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T08:47:15.521 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:47:15.522 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:47:15.522 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:47:15.578 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-22T08:47:15.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:15.578 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:47:15.730 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:47:15.730 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:47:15.765 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:47:15.765 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:47:15.765 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:47:15.765 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with new device syntax: 0@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:47:15.765 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:47:15.768 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T08:47:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:47:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:47:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:47:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:47:15.772 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:47:15.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:15.773 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:47:15.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:15.854 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:47:15.922 INFO:teuthology.orchestra.run.smithi038.stdout:client6208 2023-12-22T08:47:15.923 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:47:15.923 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:15.978 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:47:16.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.198+0000 7f9cebfff640 1 Processor -- start 2023-12-22T08:47:16.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.199+0000 7f9cebfff640 1 -- start start 2023-12-22T08:47:16.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.200+0000 7f9cebfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9cec161720 0x7f9cec0adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:16.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.200+0000 7f9cebfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9cec0ae1e0 0x7f9cec06f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:16.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.200+0000 7f9cebfff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec0ce950 con 0x7f9cec161340 2023-12-22T08:47:16.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.200+0000 7f9cebfff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec072170 con 0x7f9cec0ae1e0 2023-12-22T08:47:16.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.200+0000 7f9cebfff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec0cdd40 con 0x7f9cec161720 2023-12-22T08:47:16.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.200+0000 7f9ceb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9cec0ae1e0 0x7f9cec06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:16.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.200+0000 7f9ceb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9cec0ae1e0 0x7f9cec06f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41040/0 (socket says 172.21.15.38:41040) 2023-12-22T08:47:16.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.200+0000 7f9ceb7fe640 1 -- 172.21.15.38:0/3484744789 learned_addr learned my addr 172.21.15.38:0/3484744789 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:16.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.201+0000 7f9cea7fc640 1 --2- 172.21.15.38:0/3484744789 >> v2:172.21.15.89:3300/0 conn(0x7f9cec161720 0x7f9cec0adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:16.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.201+0000 7f9ceb7fe640 1 -- 172.21.15.38:0/3484744789 >> v2:172.21.15.89:3300/0 conn(0x7f9cec161720 msgr2=0x7f9cec0adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:16.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.201+0000 7f9ceb7fe640 1 --2- 172.21.15.38:0/3484744789 >> v2:172.21.15.89:3300/0 conn(0x7f9cec161720 0x7f9cec0adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:16.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.201+0000 7f9ceb7fe640 1 -- 172.21.15.38:0/3484744789 >> v1:172.21.15.89:6789/0 conn(0x7f9cec161340 legacy=0x7f9cec071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:16.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.201+0000 7f9ceb7fe640 1 -- 172.21.15.38:0/3484744789 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0ce020 con 0x7f9cec0ae1e0 2023-12-22T08:47:16.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.202+0000 7f9ceb7fe640 1 --2- 172.21.15.38:0/3484744789 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cec0ae1e0 0x7f9cec06f250 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009870 tx=0x7f9ce402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30ca29138da3769 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:16.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.202+0000 7f9ce9ffb640 1 -- 172.21.15.38:0/3484744789 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40317e0 con 0x7f9cec0ae1e0 2023-12-22T08:47:16.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.202+0000 7f9ce9ffb640 1 -- 172.21.15.38:0/3484744789 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce4031940 con 0x7f9cec0ae1e0 2023-12-22T08:47:16.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.202+0000 7f9ce9ffb640 1 -- 172.21.15.38:0/3484744789 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4031cd0 con 0x7f9cec0ae1e0 2023-12-22T08:47:16.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.203+0000 7f9cebfff640 1 -- 172.21.15.38:0/3484744789 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cec0ae1e0 msgr2=0x7f9cec06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:16.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.203+0000 7f9cebfff640 1 --2- 172.21.15.38:0/3484744789 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cec0ae1e0 0x7f9cec06f250 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009870 tx=0x7f9ce402b880 comp rx=0 tx=0).stop 2023-12-22T08:47:16.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.203+0000 7f9cebfff640 1 -- 172.21.15.38:0/3484744789 shutdown_connections 2023-12-22T08:47:16.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.203+0000 7f9cebfff640 1 --2- 172.21.15.38:0/3484744789 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cec0ae1e0 0x7f9cec06f250 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:16.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.203+0000 7f9cebfff640 1 --2- 172.21.15.38:0/3484744789 >> v2:172.21.15.89:3300/0 conn(0x7f9cec161720 0x7f9cec0adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:16.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.203+0000 7f9cebfff640 1 -- 172.21.15.38:0/3484744789 >> 172.21.15.38:0/3484744789 conn(0x7f9cec0b1f70 msgr2=0x7f9cec0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:16.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.203+0000 7f9cebfff640 1 -- 172.21.15.38:0/3484744789 shutdown_connections 2023-12-22T08:47:16.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.203+0000 7f9cebfff640 1 -- 172.21.15.38:0/3484744789 wait complete. 2023-12-22T08:47:16.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.205+0000 7f9cebfff640 1 Processor -- start 2023-12-22T08:47:16.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.205+0000 7f9cebfff640 1 -- start start 2023-12-22T08:47:16.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.206+0000 7f9cebfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cec0ae1e0 0x7f9cec1534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:16.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.206+0000 7f9cebfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9cec161340 0x7f9cec1f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:16.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.206+0000 7f9cebfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cec161720 0x7f9cec1e78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:16.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.206+0000 7f9cebfff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec15fa00 con 0x7f9cec161720 2023-12-22T08:47:16.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.206+0000 7f9cebfff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec15f0d0 con 0x7f9cec0ae1e0 2023-12-22T08:47:16.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.206+0000 7f9cebfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec15f3b0 con 0x7f9cec161340 2023-12-22T08:47:16.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.207+0000 7f9ceb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cec161720 0x7f9cec1e78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:16.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.207+0000 7f9ceb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cec161720 0x7f9cec1e78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41054/0 (socket says 172.21.15.38:41054) 2023-12-22T08:47:16.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.207+0000 7f9ceb7fe640 1 -- 172.21.15.38:0/1558489545 learned_addr learned my addr 172.21.15.38:0/1558489545 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:16.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.207+0000 7f9ceaffd640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cec0ae1e0 0x7f9cec1534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:16.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.207+0000 7f9cea7fc640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9cec161340 0x7f9cec1f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:16.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.207+0000 7f9ceb7fe640 1 -- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9cec161340 msgr2=0x7f9cec1f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:16.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.207+0000 7f9ceb7fe640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9cec161340 0x7f9cec1f2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:16.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.207+0000 7f9ceb7fe640 1 -- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cec0ae1e0 msgr2=0x7f9cec1534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:16.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.207+0000 7f9ceb7fe640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cec0ae1e0 0x7f9cec1534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:16.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.207+0000 7f9ceb7fe640 1 -- 172.21.15.38:0/1558489545 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce40094d0 con 0x7f9cec161720 2023-12-22T08:47:16.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.208+0000 7f9ceb7fe640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cec161720 0x7f9cec1e78b0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009870 tx=0x7f9ce40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:16.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.208+0000 7f9ce3fff640 1 -- 172.21.15.38:0/1558489545 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4032880 con 0x7f9cec161720 2023-12-22T08:47:16.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.208+0000 7f9ce3fff640 1 -- 172.21.15.38:0/1558489545 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce40329e0 con 0x7f9cec161720 2023-12-22T08:47:16.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.208+0000 7f9ce3fff640 1 -- 172.21.15.38:0/1558489545 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4032d90 con 0x7f9cec161720 2023-12-22T08:47:16.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.208+0000 7f9cebfff640 1 -- 172.21.15.38:0/1558489545 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec15f690 con 0x7f9cec161720 2023-12-22T08:47:16.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.208+0000 7f9cebfff640 1 -- 172.21.15.38:0/1558489545 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec1f6f50 con 0x7f9cec161720 2023-12-22T08:47:16.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.209+0000 7f9cebfff640 1 -- 172.21.15.38:0/1558489545 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec15fb70 con 0x7f9cec161720 2023-12-22T08:47:16.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.210+0000 7f9ce3fff640 1 -- 172.21.15.38:0/1558489545 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9ce404e450 con 0x7f9cec161720 2023-12-22T08:47:16.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.211+0000 7f9ce3fff640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9ccc06a430 0x7f9ccc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:16.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.211+0000 7f9ce3fff640 1 -- 172.21.15.38:0/1558489545 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ce40aaaa0 con 0x7f9cec161720 2023-12-22T08:47:16.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.212+0000 7f9ceaffd640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9ccc06a430 0x7f9ccc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:16.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.213+0000 7f9ceaffd640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9ccc06a430 0x7f9ccc06c8f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc001db0 tx=0x7f9cdc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:16.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.215+0000 7f9ce3fff640 1 -- 172.21.15.38:0/1558489545 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9ce4076130 con 0x7f9cec161720 2023-12-22T08:47:16.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.450+0000 7f9cebfff640 1 -- 172.21.15.38:0/1558489545 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9cec061910 con 0x7f9cec161720 2023-12-22T08:47:16.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.451+0000 7f9ce3fff640 1 -- 172.21.15.38:0/1558489545 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9ce4079750 con 0x7f9cec161720 2023-12-22T08:47:16.453 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:47:16.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.454+0000 7f9cebfff640 1 -- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9ccc06a430 msgr2=0x7f9ccc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:16.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.454+0000 7f9cebfff640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9ccc06a430 0x7f9ccc06c8f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc001db0 tx=0x7f9cdc009040 comp rx=0 tx=0).stop 2023-12-22T08:47:16.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.454+0000 7f9cebfff640 1 -- 172.21.15.38:0/1558489545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cec161720 msgr2=0x7f9cec1e78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:16.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.454+0000 7f9cebfff640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cec161720 0x7f9cec1e78b0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009870 tx=0x7f9ce40046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.454+0000 7f9cebfff640 1 -- 172.21.15.38:0/1558489545 shutdown_connections 2023-12-22T08:47:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.454+0000 7f9cebfff640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9ccc06a430 0x7f9ccc06c8f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.454+0000 7f9cebfff640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9cec161720 0x7f9cec1e78b0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.454+0000 7f9cebfff640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9cec161340 0x7f9cec1f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.454+0000 7f9cebfff640 1 --2- 172.21.15.38:0/1558489545 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9cec0ae1e0 0x7f9cec1534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.454+0000 7f9cebfff640 1 -- 172.21.15.38:0/1558489545 >> 172.21.15.38:0/1558489545 conn(0x7f9cec0b1f70 msgr2=0x7f9cec0ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.454+0000 7f9cebfff640 1 -- 172.21.15.38:0/1558489545 shutdown_connections 2023-12-22T08:47:16.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:16.454+0000 7f9cebfff640 1 -- 172.21.15.38:0/1558489545 wait complete. 2023-12-22T08:47:16.475 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:47:16.476 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:47:16.476 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-22T08:47:16.476 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T08:47:16.476 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T08:47:16.476 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:47:16.476 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:47:16.476 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:47:16.476 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:47:16.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:16.476 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-22T08:47:16.537 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:47:16.537 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:47:16.537 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:16.538 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:47:16.539 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 41925sec preferred_lft 41925sec 2023-12-22T08:47:16.539 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-22T08:47:16.539 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:16.539 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:47:16.539 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:16.539 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:47:16.539 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:16.539 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::9cc2:a9ff:fe75:e812/64 scope link 2023-12-22T08:47:16.539 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:16.540 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:47:16.540 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8e:46:07:65:e3:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T08:47:16.540 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::8c46:7ff:fe65:e31f/64 scope link 2023-12-22T08:47:16.540 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:16.540 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:47:16.540 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T08:47:16.540 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2cc2:baff:fe6f:ea22/64 scope link 2023-12-22T08:47:16.540 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:16.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:16.541 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:47:16.632 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-22T08:47:16.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:16.637 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-22T08:47:16.687 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-22T08:47:16.687 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:47:16.688 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:47:16.688 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:47:16.688 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:47:16.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:16.688 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:47:16.688 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:47:16.689 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:47:16.689 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:47:16.689 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:47:16.689 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:47:16.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:16.867 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:47:16.919 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T08:47:16.919 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-22T08:47:16.921 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:47:16.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:16.921 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-22T08:47:17.018 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:47:17.018 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T08:47:17.075 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:47:17.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:47:17.075 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:47:17.128 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-22T08:47:17.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:17.128 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:47:17.269 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:47:17.269 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:47:17.304 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:47:17.304 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:47:17.304 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:47:17.304 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 1@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:47:17.304 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:47:17.306 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T08:47:17.306 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:47:17.306 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:47:17.306 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:47:17.307 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:47:17.312 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:47:17.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:17.312 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:47:17.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:17.391 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:47:17.442 INFO:teuthology.orchestra.run.smithi089.stdout:client7455 2023-12-22T08:47:17.443 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:47:17.443 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:17.493 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:47:17.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.728+0000 7f96be70a640 1 Processor -- start 2023-12-22T08:47:17.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.728+0000 7f96be70a640 1 -- start start 2023-12-22T08:47:17.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.730+0000 7f96be70a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f96b8144d10 0x7f96b80cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:17.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.730+0000 7f96be70a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96b80b2760 0x7f96b8070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:17.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.730+0000 7f96be70a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b81450f0 con 0x7f96b80cc670 2023-12-22T08:47:17.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.730+0000 7f96be70a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b80ce010 con 0x7f96b80b2760 2023-12-22T08:47:17.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.730+0000 7f96be70a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b80ce2f0 con 0x7f96b8144d10 2023-12-22T08:47:17.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.730+0000 7f96bcca7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96b80b2760 0x7f96b8070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:17.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.730+0000 7f96bcca7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f96b80b2760 0x7f96b8070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41060/0 (socket says 172.21.15.38:41060) 2023-12-22T08:47:17.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.730+0000 7f96bcca7640 1 -- 172.21.15.38:0/2876519446 learned_addr learned my addr 172.21.15.38:0/2876519446 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:17.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.731+0000 7f96b7fff640 1 --2- 172.21.15.38:0/2876519446 >> v2:172.21.15.89:3300/0 conn(0x7f96b8144d10 0x7f96b80cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:17.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.731+0000 7f96bcca7640 1 -- 172.21.15.38:0/2876519446 >> v2:172.21.15.89:3300/0 conn(0x7f96b8144d10 msgr2=0x7f96b80cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:17.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.731+0000 7f96bcca7640 1 --2- 172.21.15.38:0/2876519446 >> v2:172.21.15.89:3300/0 conn(0x7f96b8144d10 0x7f96b80cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:17.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.731+0000 7f96bcca7640 1 -- 172.21.15.38:0/2876519446 >> v1:172.21.15.89:6789/0 conn(0x7f96b80cc670 legacy=0x7f96b80b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:17.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.731+0000 7f96bcca7640 1 -- 172.21.15.38:0/2876519446 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b80ce5d0 con 0x7f96b80b2760 2023-12-22T08:47:17.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.732+0000 7f96bcca7640 1 --2- 172.21.15.38:0/2876519446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96b80b2760 0x7f96b8070800 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f96b80cfe00 tx=0x7f96b002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ac986e23e7c055 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:17.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.732+0000 7f96b6ffd640 1 -- 172.21.15.38:0/2876519446 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b002ca80 con 0x7f96b80b2760 2023-12-22T08:47:17.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.732+0000 7f96b6ffd640 1 -- 172.21.15.38:0/2876519446 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b002cbe0 con 0x7f96b80b2760 2023-12-22T08:47:17.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.732+0000 7f96b6ffd640 1 -- 172.21.15.38:0/2876519446 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00343f0 con 0x7f96b80b2760 2023-12-22T08:47:17.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.733+0000 7f96be70a640 1 -- 172.21.15.38:0/2876519446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96b80b2760 msgr2=0x7f96b8070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:17.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.733+0000 7f96be70a640 1 --2- 172.21.15.38:0/2876519446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96b80b2760 0x7f96b8070800 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f96b80cfe00 tx=0x7f96b002bee0 comp rx=0 tx=0).stop 2023-12-22T08:47:17.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.733+0000 7f96be70a640 1 -- 172.21.15.38:0/2876519446 shutdown_connections 2023-12-22T08:47:17.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.733+0000 7f96be70a640 1 --2- 172.21.15.38:0/2876519446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96b80b2760 0x7f96b8070800 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:17.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.733+0000 7f96be70a640 1 --2- 172.21.15.38:0/2876519446 >> v2:172.21.15.89:3300/0 conn(0x7f96b8144d10 0x7f96b80cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:17.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.733+0000 7f96be70a640 1 -- 172.21.15.38:0/2876519446 >> 172.21.15.38:0/2876519446 conn(0x7f96b80cf070 msgr2=0x7f96b80cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:17.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.733+0000 7f96be70a640 1 -- 172.21.15.38:0/2876519446 shutdown_connections 2023-12-22T08:47:17.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.733+0000 7f96be70a640 1 -- 172.21.15.38:0/2876519446 wait complete. 2023-12-22T08:47:17.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.735+0000 7f96be70a640 1 Processor -- start 2023-12-22T08:47:17.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.735+0000 7f96be70a640 1 -- start start 2023-12-22T08:47:17.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.736+0000 7f96be70a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96b80b2760 0x7f96b806c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:17.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.736+0000 7f96be70a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b8144d10 0x7f96b815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:17.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.736+0000 7f96be70a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96b806dbf0 0x7f96b815a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:17.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.736+0000 7f96be70a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b806c770 con 0x7f96b806dbf0 2023-12-22T08:47:17.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.736+0000 7f96be70a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b806ca50 con 0x7f96b8144d10 2023-12-22T08:47:17.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.736+0000 7f96be70a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b806cd30 con 0x7f96b80b2760 2023-12-22T08:47:17.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.737+0000 7f96bcca7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96b806dbf0 0x7f96b815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:17.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.737+0000 7f96bcca7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96b806dbf0 0x7f96b815a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41068/0 (socket says 172.21.15.38:41068) 2023-12-22T08:47:17.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.737+0000 7f96bcca7640 1 -- 172.21.15.38:0/1659333127 learned_addr learned my addr 172.21.15.38:0/1659333127 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:17.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.737+0000 7f96b77fe640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b8144d10 0x7f96b815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:17.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.737+0000 7f96b7fff640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96b80b2760 0x7f96b806c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:17.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.737+0000 7f96bcca7640 1 -- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96b80b2760 msgr2=0x7f96b806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:17.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.737+0000 7f96bcca7640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96b80b2760 0x7f96b806c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:17.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.737+0000 7f96bcca7640 1 -- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b8144d10 msgr2=0x7f96b815fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:17.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.737+0000 7f96bcca7640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b8144d10 0x7f96b815fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:17.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.737+0000 7f96bcca7640 1 -- 172.21.15.38:0/1659333127 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b0009b30 con 0x7f96b806dbf0 2023-12-22T08:47:17.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.738+0000 7f96bcca7640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96b806dbf0 0x7f96b815a490 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f96b0036040 tx=0x7f96b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:17.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.738+0000 7f96b4ff9640 1 -- 172.21.15.38:0/1659333127 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b0009510 con 0x7f96b806dbf0 2023-12-22T08:47:17.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.738+0000 7f96b4ff9640 1 -- 172.21.15.38:0/1659333127 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b003e450 con 0x7f96b806dbf0 2023-12-22T08:47:17.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.738+0000 7f96be70a640 1 -- 172.21.15.38:0/1659333127 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b806d010 con 0x7f96b806dbf0 2023-12-22T08:47:17.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.738+0000 7f96b4ff9640 1 -- 172.21.15.38:0/1659333127 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b003e7e0 con 0x7f96b806dbf0 2023-12-22T08:47:17.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.738+0000 7f96be70a640 1 -- 172.21.15.38:0/1659333127 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b806e0a0 con 0x7f96b806dbf0 2023-12-22T08:47:17.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.739+0000 7f96be70a640 1 -- 172.21.15.38:0/1659333127 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b81f34d0 con 0x7f96b806dbf0 2023-12-22T08:47:17.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.740+0000 7f96b4ff9640 1 -- 172.21.15.38:0/1659333127 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f96b002cd50 con 0x7f96b806dbf0 2023-12-22T08:47:17.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.741+0000 7f96b4ff9640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f96a406a430 0x7f96a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:17.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.741+0000 7f96b4ff9640 1 -- 172.21.15.38:0/1659333127 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96b00ab410 con 0x7f96b806dbf0 2023-12-22T08:47:17.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.742+0000 7f96b7fff640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f96a406a430 0x7f96a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:17.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.743+0000 7f96b7fff640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f96a406a430 0x7f96a406c8f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f96a8006fd0 tx=0x7f96a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:17.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.746+0000 7f96b4ff9640 1 -- 172.21.15.38:0/1659333127 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f96b00769f0 con 0x7f96b806dbf0 2023-12-22T08:47:17.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.975+0000 7f96be70a640 1 -- 172.21.15.38:0/1659333127 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96b8061910 con 0x7f96b806dbf0 2023-12-22T08:47:17.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.976+0000 7f96b4ff9640 1 -- 172.21.15.38:0/1659333127 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f96b007a010 con 0x7f96b806dbf0 2023-12-22T08:47:17.977 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:17.978 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/186375012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":186375012},{"type":"v1","addr":"172.21.15.89:6837","nonce":186375012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1819583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1819583870},{"type":"v1","addr":"172.21.15.89:6835","nonce":1819583870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3793773672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3793773672},{"type":"v1","addr":"172.21.15.38:6834","nonce":3793773672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:07.035669+0000","modified":"2023-12-22T08:47:10.565916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7293":{"gid":7293,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3340763944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3340763944},{"type":"v1","addr":"172.21.15.38:6835","nonce":3340763944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-22T08:47:17.978 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 55 2023-12-22T08:47:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.979+0000 7f96be70a640 1 -- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f96a406a430 msgr2=0x7f96a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.979+0000 7f96be70a640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f96a406a430 0x7f96a406c8f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f96a8006fd0 tx=0x7f96a8008040 comp rx=0 tx=0).stop 2023-12-22T08:47:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.979+0000 7f96be70a640 1 -- 172.21.15.38:0/1659333127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96b806dbf0 msgr2=0x7f96b815a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.979+0000 7f96be70a640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96b806dbf0 0x7f96b815a490 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f96b0036040 tx=0x7f96b0004a40 comp rx=0 tx=0).stop 2023-12-22T08:47:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.979+0000 7f96be70a640 1 -- 172.21.15.38:0/1659333127 shutdown_connections 2023-12-22T08:47:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.979+0000 7f96be70a640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f96a406a430 0x7f96a406c8f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.979+0000 7f96be70a640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96b806dbf0 0x7f96b815a490 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.979+0000 7f96be70a640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96b8144d10 0x7f96b815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.979+0000 7f96be70a640 1 --2- 172.21.15.38:0/1659333127 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96b80b2760 0x7f96b806c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.979+0000 7f96be70a640 1 -- 172.21.15.38:0/1659333127 >> 172.21.15.38:0/1659333127 conn(0x7f96b80cf070 msgr2=0x7f96b80b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.979+0000 7f96be70a640 1 -- 172.21.15.38:0/1659333127 shutdown_connections 2023-12-22T08:47:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:17.979+0000 7f96be70a640 1 -- 172.21.15.38:0/1659333127 wait complete. 2023-12-22T08:47:17.999 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-22T08:47:18.072 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:47:18.081 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:47:18.237 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":7293,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.178420836000001,"mdsmap_epoch":55,"osdmap_epoch":127,"osdmap_epoch_barrier":127,"uptime":17.045828188000002} 2023-12-22T08:47:18.237 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 7293, "mdsmap_epoch": 55, "osdmap_epoch": 127, "osdmap_epoch_barrier": 127, "rank_uptime": 11.178420836, "state": "up:active", "uptime": 17.045828188, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:47:18.238 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-22T08:47:18.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.513+0000 7efcf359e640 1 Processor -- start 2023-12-22T08:47:18.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.513+0000 7efcf359e640 1 -- start start 2023-12-22T08:47:18.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.515+0000 7efcf359e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efcf406d520 0x7efcf415a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:18.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.515+0000 7efcf359e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efcf415d450 0x7efcf415d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:18.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.515+0000 7efcf359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf415de10 0x7efcf40ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:18.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.515+0000 7efcf359e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf415ae20 con 0x7efcf406d520 2023-12-22T08:47:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.515+0000 7efcf359e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf406f4c0 con 0x7efcf415d450 2023-12-22T08:47:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.515+0000 7efcf359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40ae660 con 0x7efcf415de10 2023-12-22T08:47:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.515+0000 7efcf259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efcf406d520 0x7efcf415a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.515+0000 7efcf259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efcf406d520 0x7efcf415a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41080/0 (socket says 172.21.15.38:41080) 2023-12-22T08:47:18.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.515+0000 7efcf259c640 1 -- 172.21.15.38:0/3502101165 learned_addr learned my addr 172.21.15.38:0/3502101165 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:18.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.515+0000 7efcf2d9d640 1 --2- 172.21.15.38:0/3502101165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf415de10 0x7efcf40ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:18.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.516+0000 7efce9d9b640 1 --2- 172.21.15.38:0/3502101165 >> v2:172.21.15.89:3300/0 conn(0x7efcf415d450 0x7efcf415d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:18.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.516+0000 7efcf259c640 1 -- 172.21.15.38:0/3502101165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf415de10 msgr2=0x7efcf40ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:18.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.516+0000 7efcf259c640 1 --2- 172.21.15.38:0/3502101165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf415de10 0x7efcf40ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:18.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.516+0000 7efcf259c640 1 -- 172.21.15.38:0/3502101165 >> v2:172.21.15.89:3300/0 conn(0x7efcf415d450 msgr2=0x7efcf415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:18.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.516+0000 7efcf259c640 1 --2- 172.21.15.38:0/3502101165 >> v2:172.21.15.89:3300/0 conn(0x7efcf415d450 0x7efcf415d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:18.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.516+0000 7efcf259c640 1 -- 172.21.15.38:0/3502101165 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40adac0 con 0x7efcf406d520 2023-12-22T08:47:18.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.516+0000 7efcf2d9d640 1 --2- 172.21.15.38:0/3502101165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf415de10 0x7efcf40ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:18.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.517+0000 7efcf259c640 1 --2- 172.21.15.38:0/3502101165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf406d520 0x7efcf415a8e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7efcf40b1df0 tx=0x7efce402cff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4900fe029c4605b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:18.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.517+0000 7efcf1d9b640 1 -- 172.21.15.38:0/3502101165 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce402d990 con 0x7efcf406d520 2023-12-22T08:47:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.517+0000 7efcf1d9b640 1 -- 172.21.15.38:0/3502101165 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce402daf0 con 0x7efcf406d520 2023-12-22T08:47:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.517+0000 7efcf1d9b640 1 -- 172.21.15.38:0/3502101165 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce402de80 con 0x7efcf406d520 2023-12-22T08:47:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.518+0000 7efcf359e640 1 -- 172.21.15.38:0/3502101165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf406d520 msgr2=0x7efcf415a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.518+0000 7efcf359e640 1 --2- 172.21.15.38:0/3502101165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf406d520 0x7efcf415a8e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7efcf40b1df0 tx=0x7efce402cff0 comp rx=0 tx=0).stop 2023-12-22T08:47:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.518+0000 7efcf359e640 1 -- 172.21.15.38:0/3502101165 shutdown_connections 2023-12-22T08:47:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.518+0000 7efcf359e640 1 --2- 172.21.15.38:0/3502101165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf415de10 0x7efcf40ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.518+0000 7efcf359e640 1 --2- 172.21.15.38:0/3502101165 >> v2:172.21.15.89:3300/0 conn(0x7efcf415d450 0x7efcf415d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.518+0000 7efcf359e640 1 --2- 172.21.15.38:0/3502101165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf406d520 0x7efcf415a8e0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.518+0000 7efcf359e640 1 -- 172.21.15.38:0/3502101165 >> 172.21.15.38:0/3502101165 conn(0x7efcf40b1110 msgr2=0x7efcf40b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.518+0000 7efcf359e640 1 -- 172.21.15.38:0/3502101165 shutdown_connections 2023-12-22T08:47:18.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.518+0000 7efcf359e640 1 -- 172.21.15.38:0/3502101165 wait complete. 2023-12-22T08:47:18.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.520+0000 7efcf359e640 1 Processor -- start 2023-12-22T08:47:18.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.520+0000 7efcf359e640 1 -- start start 2023-12-22T08:47:18.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.521+0000 7efcf359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf406d520 0x7efcf41459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:18.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.521+0000 7efcf359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcf415d450 0x7efcf40af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:18.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.521+0000 7efcf359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf415de10 0x7efcf4158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:18.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.521+0000 7efcf359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40cc010 con 0x7efcf415de10 2023-12-22T08:47:18.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.521+0000 7efcf359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40c8b90 con 0x7efcf415d450 2023-12-22T08:47:18.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.521+0000 7efcf359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4145ef0 con 0x7efcf406d520 2023-12-22T08:47:18.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.521+0000 7efcf2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf415de10 0x7efcf4158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.521+0000 7efcf2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf415de10 0x7efcf4158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41090/0 (socket says 172.21.15.38:41090) 2023-12-22T08:47:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.521+0000 7efcf2d9d640 1 -- 172.21.15.38:0/1777617558 learned_addr learned my addr 172.21.15.38:0/1777617558 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.522+0000 7efce9d9b640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcf415d450 0x7efcf40af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.522+0000 7efcf259c640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf406d520 0x7efcf41459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.522+0000 7efcf2d9d640 1 -- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf406d520 msgr2=0x7efcf41459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.522+0000 7efcf2d9d640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf406d520 0x7efcf41459b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.522+0000 7efcf2d9d640 1 -- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcf415d450 msgr2=0x7efcf40af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.522+0000 7efcf2d9d640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcf415d450 0x7efcf40af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.522+0000 7efcf2d9d640 1 -- 172.21.15.38:0/1777617558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce400ac40 con 0x7efcf415de10 2023-12-22T08:47:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.522+0000 7efce9d9b640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcf415d450 0x7efcf40af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:18.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.522+0000 7efcf2d9d640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf415de10 0x7efcf4158a40 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7efcec00c7c0 tx=0x7efcec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:18.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.522+0000 7efceb7fe640 1 -- 172.21.15.38:0/1777617558 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec004230 con 0x7efcf415de10 2023-12-22T08:47:18.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.522+0000 7efceb7fe640 1 -- 172.21.15.38:0/1777617558 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec004390 con 0x7efcf415de10 2023-12-22T08:47:18.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.522+0000 7efceb7fe640 1 -- 172.21.15.38:0/1777617558 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec007860 con 0x7efcf415de10 2023-12-22T08:47:18.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.522+0000 7efcf359e640 1 -- 172.21.15.38:0/1777617558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf40c8560 con 0x7efcf415de10 2023-12-22T08:47:18.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.523+0000 7efcf359e640 1 -- 172.21.15.38:0/1777617558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf40c8820 con 0x7efcf415de10 2023-12-22T08:47:18.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.524+0000 7efcf359e640 1 -- 172.21.15.38:0/1777617558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf40c8d00 con 0x7efcf415de10 2023-12-22T08:47:18.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.525+0000 7efceb7fe640 1 -- 172.21.15.38:0/1777617558 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efcec0079c0 con 0x7efcf415de10 2023-12-22T08:47:18.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.525+0000 7efceb7fe640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efcd406a430 0x7efcd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:18.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.526+0000 7efceb7fe640 1 -- 172.21.15.38:0/1777617558 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcec088cb0 con 0x7efcf415de10 2023-12-22T08:47:18.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.526+0000 7efcf259c640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efcd406a430 0x7efcd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:18.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.527+0000 7efcf259c640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efcd406a430 0x7efcd406c8f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efce4036000 tx=0x7efce4031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:18.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.530+0000 7efceb7fe640 1 -- 172.21.15.38:0/1777617558 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efcec0543f0 con 0x7efcf415de10 2023-12-22T08:47:18.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:18.726+0000 7efcf359e640 1 -- 172.21.15.38:0/1777617558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7efcf40adfe0 con 0x7efcf415de10 2023-12-22T08:47:19.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:19.290+0000 7efceb7fe640 1 -- 172.21.15.38:0/1777617558 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v128) v1 ==== 181+0+0 (secure 0 0 0) 0x7efcec057a10 con 0x7efcf415de10 2023-12-22T08:47:19.292 INFO:teuthology.orchestra.run.smithi038.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-22T08:47:19.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:19.294+0000 7efcf359e640 1 -- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efcd406a430 msgr2=0x7efcd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:19.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:19.294+0000 7efcf359e640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efcd406a430 0x7efcd406c8f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efce4036000 tx=0x7efce4031000 comp rx=0 tx=0).stop 2023-12-22T08:47:19.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:19.294+0000 7efcf359e640 1 -- 172.21.15.38:0/1777617558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf415de10 msgr2=0x7efcf4158a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:19.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:19.294+0000 7efcf359e640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf415de10 0x7efcf4158a40 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7efcec00c7c0 tx=0x7efcec00cc80 comp rx=0 tx=0).stop 2023-12-22T08:47:19.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:19.294+0000 7efcf359e640 1 -- 172.21.15.38:0/1777617558 shutdown_connections 2023-12-22T08:47:19.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:19.294+0000 7efcf359e640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efcd406a430 0x7efcd406c8f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:19.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:19.294+0000 7efcf359e640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf415de10 0x7efcf4158a40 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:19.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:19.294+0000 7efcf359e640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcf415d450 0x7efcf40af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:19.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:19.294+0000 7efcf359e640 1 --2- 172.21.15.38:0/1777617558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf406d520 0x7efcf41459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:19.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:19.294+0000 7efcf359e640 1 -- 172.21.15.38:0/1777617558 >> 172.21.15.38:0/1777617558 conn(0x7efcf40b1110 msgr2=0x7efcf415af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:19.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:19.294+0000 7efcf359e640 1 -- 172.21.15.38:0/1777617558 shutdown_connections 2023-12-22T08:47:19.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:19.294+0000 7efcf359e640 1 -- 172.21.15.38:0/1777617558 wait complete. 2023-12-22T08:47:19.318 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T08:47:19.318 DEBUG:teuthology.orchestra.run.smithi038:> import os 2023-12-22T08:47:19.318 DEBUG:teuthology.orchestra.run.smithi038:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-22T08:47:19.318 DEBUG:teuthology.orchestra.run.smithi038:> os.fchmod(fd, 0O666) 2023-12-22T08:47:19.319 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(fd) 2023-12-22T08:47:19.319 DEBUG:teuthology.orchestra.run.smithi038:> os.close(fd) 2023-12-22T08:47:19.319 DEBUG:teuthology.orchestra.run.smithi038:> ' 2023-12-22T08:47:19.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:19.640 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:47:19.747 INFO:teuthology.orchestra.run.smithi038.stdout:client6208 2023-12-22T08:47:19.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:19.748 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/893856d7-5d01-4896-9127-f971dbad2b97.client6208/osdmap') 2023-12-22T08:47:19.844 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 127 barrier 127 flags 0x588000 2023-12-22T08:47:19.844 INFO:teuthology.orchestra.run.smithi038.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:47:19.844 INFO:teuthology.orchestra.run.smithi038.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:47:19.844 INFO:teuthology.orchestra.run.smithi038.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:47:19.844 INFO:teuthology.orchestra.run.smithi038.stdout:osd0 (2)172.21.15.38:6800 100% (exists, up) 100% -1 2023-12-22T08:47:19.844 INFO:teuthology.orchestra.run.smithi038.stdout:osd1 (2)172.21.15.38:6808 100% (exists, up) 100% -1 2023-12-22T08:47:19.844 INFO:teuthology.orchestra.run.smithi038.stdout:osd2 (2)172.21.15.38:6824 100% (exists, up) 100% -1 2023-12-22T08:47:19.844 INFO:teuthology.orchestra.run.smithi038.stdout:osd3 (2)172.21.15.38:6816 100% (exists, up) 100% -1 2023-12-22T08:47:19.844 INFO:teuthology.orchestra.run.smithi038.stdout:osd4 (2)172.21.15.89:6800 100% (exists, up) 100% -1 2023-12-22T08:47:19.844 INFO:teuthology.orchestra.run.smithi038.stdout:osd5 (2)172.21.15.89:6816 100% (exists, up) 100% -1 2023-12-22T08:47:19.844 INFO:teuthology.orchestra.run.smithi038.stdout:osd6 (2)172.21.15.89:6808 100% (exists, up) 100% -1 2023-12-22T08:47:19.844 INFO:teuthology.orchestra.run.smithi038.stdout:osd7 (2)172.21.15.89:6821 100% (exists, up) 100% -1 2023-12-22T08:47:19.845 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records in 2023-12-22T08:47:19.845 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records out 2023-12-22T08:47:19.845 INFO:teuthology.orchestra.run.smithi038.stderr:795 bytes copied, 0.000101999 s, 7.8 MB/s 2023-12-22T08:47:19.848 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-12-22T08:47:20.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.069+0000 7f6e40dd6640 1 Processor -- start 2023-12-22T08:47:20.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.069+0000 7f6e40dd6640 1 -- start start 2023-12-22T08:47:20.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.071+0000 7f6e40dd6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e3c06dc80 0x7f6e3c071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:20.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.071+0000 7f6e40dd6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6e3c09ba90 0x7f6e3c09bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:20.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.071+0000 7f6e40dd6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e3c09c460 con 0x7f6e3c06e060 2023-12-22T08:47:20.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.071+0000 7f6e40dd6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3c070980 con 0x7f6e3c09ba90 2023-12-22T08:47:20.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.071+0000 7f6e40dd6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c0ccc50 con 0x7f6e3c06dc80 2023-12-22T08:47:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.071+0000 7f6e32ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6e3c06e060 0x7f6e3c0cc1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51498/0 (socket says 172.21.15.38:51498) 2023-12-22T08:47:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.071+0000 7f6e32ffd640 1 -- 172.21.15.38:0/1711658997 learned_addr learned my addr 172.21.15.38:0/1711658997 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3bfff640 1 --2- 172.21.15.38:0/1711658997 >> v2:172.21.15.89:3300/0 conn(0x7f6e3c09ba90 0x7f6e3c09bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3b7fe640 1 --2- 172.21.15.38:0/1711658997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e3c06dc80 0x7f6e3c071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656502280 0 0) 0x7f6e3c09c460 con 0x7f6e3c06e060 2023-12-22T08:47:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e28003520 con 0x7f6e3c06e060 2023-12-22T08:47:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1361044263 0 0) 0x7f6e28003520 con 0x7f6e3c06e060 2023-12-22T08:47:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e3c06dc80 msgr2=0x7f6e3c071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 --2- 172.21.15.38:0/1711658997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e3c06dc80 0x7f6e3c071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 >> v2:172.21.15.89:3300/0 conn(0x7f6e3c09ba90 msgr2=0x7f6e3c09bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 --2- 172.21.15.38:0/1711658997 >> v2:172.21.15.89:3300/0 conn(0x7f6e3c09ba90 0x7f6e3c09bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c070b90 con 0x7f6e3c06e060 2023-12-22T08:47:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f6e24001670 con 0x7f6e3c06e060 2023-12-22T08:47:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 >> v1:172.21.15.38:6789/0 conn(0x7f6e3c06e060 legacy=0x7f6e3c0cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 --2- 172.21.15.38:0/1711658997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e3c06dc80 0x7f6e28003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 --2- 172.21.15.38:0/1711658997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e28003eb0 0x7f6e280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 --2- 172.21.15.38:0/1711658997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e28004330 0x7f6e28004d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c070980 con 0x7f6e28003eb0 2023-12-22T08:47:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c0ccc50 con 0x7f6e28004330 2023-12-22T08:47:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.072+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e28005570 con 0x7f6e3c06dc80 2023-12-22T08:47:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.073+0000 7f6e32ffd640 1 --2- 172.21.15.38:0/1711658997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e28003eb0 0x7f6e280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.073+0000 7f6e3b7fe640 1 --2- 172.21.15.38:0/1711658997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e3c06dc80 0x7f6e28003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.073+0000 7f6e3bfff640 1 --2- 172.21.15.38:0/1711658997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e28004330 0x7f6e28004d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.073+0000 7f6e32ffd640 1 -- 172.21.15.38:0/1711658997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e3c06dc80 msgr2=0x7f6e28003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.073+0000 7f6e32ffd640 1 --2- 172.21.15.38:0/1711658997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e3c06dc80 0x7f6e28003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.073+0000 7f6e32ffd640 1 -- 172.21.15.38:0/1711658997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e28004330 msgr2=0x7f6e28004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.073+0000 7f6e32ffd640 1 --2- 172.21.15.38:0/1711658997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e28004330 0x7f6e28004d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.073+0000 7f6e32ffd640 1 -- 172.21.15.38:0/1711658997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e28003520 con 0x7f6e28003eb0 2023-12-22T08:47:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.073+0000 7f6e3bfff640 1 --2- 172.21.15.38:0/1711658997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e28004330 0x7f6e28004d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:47:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.075+0000 7f6e32ffd640 1 --2- 172.21.15.38:0/1711658997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e28003eb0 0x7f6e280047c0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400c240 tx=0x7f6e280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25027fd6fa24a269 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.075+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2402cb00 con 0x7f6e28003eb0 2023-12-22T08:47:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.075+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2402cc60 con 0x7f6e28003eb0 2023-12-22T08:47:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.075+0000 7f6e3affd640 1 -- 172.21.15.38:0/1711658997 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24005af0 con 0x7f6e28003eb0 2023-12-22T08:47:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.076+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1711658997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e28003eb0 msgr2=0x7f6e280047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.076+0000 7f6e40dd6640 1 --2- 172.21.15.38:0/1711658997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e28003eb0 0x7f6e280047c0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400c240 tx=0x7f6e280057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.076+0000 7f6e3bfff640 1 -- 172.21.15.38:0/1711658997 reap_dead start 2023-12-22T08:47:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.076+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1711658997 shutdown_connections 2023-12-22T08:47:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.076+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1711658997 >> 172.21.15.38:0/1711658997 conn(0x7f6e3c0cf000 msgr2=0x7f6e3c0cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.076+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1711658997 shutdown_connections 2023-12-22T08:47:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.076+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1711658997 wait complete. 2023-12-22T08:47:20.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.078+0000 7f6e40dd6640 1 Processor -- start 2023-12-22T08:47:20.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.078+0000 7f6e40dd6640 1 -- start start 2023-12-22T08:47:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.079+0000 7f6e40dd6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e3c1ee0c0 0x7f6e3c145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.079+0000 7f6e40dd6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e3c1ee4a0 0x7f6e3c1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.079+0000 7f6e40dd6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e3c09ad60 0x7f6e3c09b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.079+0000 7f6e40dd6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c09b750 con 0x7f6e3c1ee0c0 2023-12-22T08:47:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.079+0000 7f6e40dd6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c155c20 con 0x7f6e3c09ad60 2023-12-22T08:47:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.079+0000 7f6e40dd6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c146d30 con 0x7f6e3c1ee4a0 2023-12-22T08:47:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.080+0000 7f6e3b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e3c1ee0c0 0x7f6e3c145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.080+0000 7f6e3b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e3c1ee0c0 0x7f6e3c145dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41114/0 (socket says 172.21.15.38:41114) 2023-12-22T08:47:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.080+0000 7f6e3b7fe640 1 -- 172.21.15.38:0/1346418899 learned_addr learned my addr 172.21.15.38:0/1346418899 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.080+0000 7f6e3bfff640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e3c09ad60 0x7f6e3c09b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.080+0000 7f6e32ffd640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e3c1ee4a0 0x7f6e3c1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.080+0000 7f6e3b7fe640 1 -- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e3c1ee4a0 msgr2=0x7f6e3c1556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.080+0000 7f6e3b7fe640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e3c1ee4a0 0x7f6e3c1556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.080+0000 7f6e3b7fe640 1 -- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e3c09ad60 msgr2=0x7f6e3c09b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.080+0000 7f6e3b7fe640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e3c09ad60 0x7f6e3c09b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.080+0000 7f6e3b7fe640 1 -- 172.21.15.38:0/1346418899 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c146490 con 0x7f6e3c1ee0c0 2023-12-22T08:47:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.080+0000 7f6e3b7fe640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e3c1ee0c0 0x7f6e3c145dc0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c007f30 tx=0x7f6e2c011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:20.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.081+0000 7f6e38ff9640 1 -- 172.21.15.38:0/1346418899 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c00e030 con 0x7f6e3c1ee0c0 2023-12-22T08:47:20.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.081+0000 7f6e38ff9640 1 -- 172.21.15.38:0/1346418899 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c016470 con 0x7f6e3c1ee0c0 2023-12-22T08:47:20.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.081+0000 7f6e38ff9640 1 -- 172.21.15.38:0/1346418899 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c016820 con 0x7f6e3c1ee0c0 2023-12-22T08:47:20.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.081+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1346418899 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3c146770 con 0x7f6e3c1ee0c0 2023-12-22T08:47:20.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.081+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1346418899 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3c143e10 con 0x7f6e3c1ee0c0 2023-12-22T08:47:20.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.082+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1346418899 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e3c061910 con 0x7f6e3c1ee0c0 2023-12-22T08:47:20.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.083+0000 7f6e38ff9640 1 -- 172.21.15.38:0/1346418899 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6e2c016980 con 0x7f6e3c1ee0c0 2023-12-22T08:47:20.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.085+0000 7f6e38ff9640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6e1c06a460 0x7f6e1c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:20.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.085+0000 7f6e38ff9640 1 -- 172.21.15.38:0/1346418899 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e2c00f070 con 0x7f6e3c1ee0c0 2023-12-22T08:47:20.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.085+0000 7f6e32ffd640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6e1c06a460 0x7f6e1c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:20.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.087+0000 7f6e32ffd640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6e1c06a460 0x7f6e1c06c920 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6e24034000 tx=0x7f6e24007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:20.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.090+0000 7f6e38ff9640 1 -- 172.21.15.38:0/1346418899 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6e2c054da0 con 0x7f6e3c1ee0c0 2023-12-22T08:47:20.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:20.294+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1346418899 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f6e3c0cc890 con 0x7f6e3c1ee0c0 2023-12-22T08:47:21.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.306+0000 7f6e38ff9640 1 -- 172.21.15.38:0/1346418899 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v129) v1 ==== 93+0+0 (secure 0 0 0) 0x7f6e2c0583c0 con 0x7f6e3c1ee0c0 2023-12-22T08:47:21.308 INFO:teuthology.orchestra.run.smithi038.stderr:pauserd,pausewr is set 2023-12-22T08:47:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.310+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6e1c06a460 msgr2=0x7f6e1c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.310+0000 7f6e40dd6640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6e1c06a460 0x7f6e1c06c920 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6e24034000 tx=0x7f6e24007000 comp rx=0 tx=0).stop 2023-12-22T08:47:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.310+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1346418899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e3c1ee0c0 msgr2=0x7f6e3c145dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.310+0000 7f6e40dd6640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e3c1ee0c0 0x7f6e3c145dc0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c007f30 tx=0x7f6e2c011660 comp rx=0 tx=0).stop 2023-12-22T08:47:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.310+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1346418899 shutdown_connections 2023-12-22T08:47:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.310+0000 7f6e40dd6640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e3c09ad60 0x7f6e3c09b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.310+0000 7f6e40dd6640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6e3c1ee4a0 0x7f6e3c1556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.310+0000 7f6e40dd6640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6e1c06a460 0x7f6e1c06c920 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.310+0000 7f6e40dd6640 1 --2- 172.21.15.38:0/1346418899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6e3c1ee0c0 0x7f6e3c145dc0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:21.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.310+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1346418899 >> 172.21.15.38:0/1346418899 conn(0x7f6e3c0cf000 msgr2=0x7f6e3c099b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:21.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.311+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1346418899 shutdown_connections 2023-12-22T08:47:21.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.311+0000 7f6e40dd6640 1 -- 172.21.15.38:0/1346418899 wait complete. 2023-12-22T08:47:21.335 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-12-22T08:47:21.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.561+0000 7fb99f054640 1 Processor -- start 2023-12-22T08:47:21.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.562+0000 7fb99f054640 1 -- start start 2023-12-22T08:47:21.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.563+0000 7fb99f054640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb99806e060 0x7fb998071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:21.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.563+0000 7fb99f054640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9980ccc50 con 0x7fb99806dc80 2023-12-22T08:47:21.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.563+0000 7fb99f054640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb998070b90 con 0x7fb99809ba90 2023-12-22T08:47:21.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.563+0000 7fb99f054640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb998070980 con 0x7fb99806e060 2023-12-22T08:47:21.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.564+0000 7fb99e052640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb99806dc80 0x7fb9980cc1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55362/0 (socket says 172.21.15.38:55362) 2023-12-22T08:47:21.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.564+0000 7fb99e052640 1 -- 172.21.15.38:0/2811711207 learned_addr learned my addr 172.21.15.38:0/2811711207 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:21.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.564+0000 7fb99d851640 1 --2- 172.21.15.38:0/2811711207 >> v2:172.21.15.38:3300/0 conn(0x7fb99806e060 0x7fb998071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:21.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.564+0000 7fb99d050640 1 -- 172.21.15.38:0/2811711207 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996595049 0 0) 0x7fb9980ccc50 con 0x7fb99806dc80 2023-12-22T08:47:21.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.564+0000 7fb99d050640 1 -- 172.21.15.38:0/2811711207 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb984003520 con 0x7fb99806dc80 2023-12-22T08:47:21.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.564+0000 7fb99d851640 1 -- 172.21.15.38:0/2811711207 >> v1:172.21.15.89:6789/0 conn(0x7fb99809ba90 legacy=0x7fb99809bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:21.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.564+0000 7fb99d851640 1 -- 172.21.15.38:0/2811711207 >> v1:172.21.15.38:6789/0 conn(0x7fb99806dc80 legacy=0x7fb9980cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:21.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.564+0000 7fb99d851640 1 -- 172.21.15.38:0/2811711207 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb998070e70 con 0x7fb99806e060 2023-12-22T08:47:21.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.566+0000 7fb99d851640 1 --2- 172.21.15.38:0/2811711207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb99806e060 0x7fb998071670 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fb9880097a0 tx=0x7fb98802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34292e5c26da216 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.566+0000 7fb99d050640 1 -- 172.21.15.38:0/2811711207 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988031830 con 0x7fb99806e060 2023-12-22T08:47:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.566+0000 7fb99d050640 1 -- 172.21.15.38:0/2811711207 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb988031990 con 0x7fb99806e060 2023-12-22T08:47:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.566+0000 7fb99d050640 1 -- 172.21.15.38:0/2811711207 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988031d00 con 0x7fb99806e060 2023-12-22T08:47:21.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.566+0000 7fb99f054640 1 -- 172.21.15.38:0/2811711207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb99806e060 msgr2=0x7fb998071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:21.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.566+0000 7fb99f054640 1 --2- 172.21.15.38:0/2811711207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb99806e060 0x7fb998071670 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fb9880097a0 tx=0x7fb98802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:47:21.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.567+0000 7fb99f054640 1 -- 172.21.15.38:0/2811711207 shutdown_connections 2023-12-22T08:47:21.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.567+0000 7fb99f054640 1 --2- 172.21.15.38:0/2811711207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb99806e060 0x7fb998071670 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:21.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.567+0000 7fb99f054640 1 -- 172.21.15.38:0/2811711207 >> 172.21.15.38:0/2811711207 conn(0x7fb9980cf000 msgr2=0x7fb9980cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:21.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.567+0000 7fb99f054640 1 -- 172.21.15.38:0/2811711207 shutdown_connections 2023-12-22T08:47:21.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.567+0000 7fb99f054640 1 -- 172.21.15.38:0/2811711207 wait complete. 2023-12-22T08:47:21.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.569+0000 7fb99f054640 1 Processor -- start 2023-12-22T08:47:21.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.569+0000 7fb99f054640 1 -- start start 2023-12-22T08:47:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.570+0000 7fb99f054640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb99806dc80 0x7fb998153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.570+0000 7fb99f054640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb99806e060 0x7fb998154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.570+0000 7fb99f054640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb99809ba90 0x7fb99806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.570+0000 7fb99f054640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb998152c30 con 0x7fb99806dc80 2023-12-22T08:47:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.570+0000 7fb99f054640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9981549d0 con 0x7fb99809ba90 2023-12-22T08:47:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.570+0000 7fb99f054640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb998154cb0 con 0x7fb99806e060 2023-12-22T08:47:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.570+0000 7fb99e052640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb99806dc80 0x7fb998153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.570+0000 7fb99e052640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb99806dc80 0x7fb998153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37848/0 (socket says 172.21.15.38:37848) 2023-12-22T08:47:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.570+0000 7fb99e052640 1 -- 172.21.15.38:0/323284190 learned_addr learned my addr 172.21.15.38:0/323284190 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.570+0000 7fb99e052640 1 -- 172.21.15.38:0/323284190 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb99806e060 msgr2=0x7fb998154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:21.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.570+0000 7fb99e052640 1 --2- 172.21.15.38:0/323284190 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb99806e060 0x7fb998154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:21.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.570+0000 7fb99e052640 1 -- 172.21.15.38:0/323284190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb99809ba90 msgr2=0x7fb99806c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:21.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.571+0000 7fb99e052640 1 --2- 172.21.15.38:0/323284190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb99809ba90 0x7fb99806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:21.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.571+0000 7fb99e052640 1 -- 172.21.15.38:0/323284190 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb988009400 con 0x7fb99806dc80 2023-12-22T08:47:21.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.571+0000 7fb99e052640 1 --2- 172.21.15.38:0/323284190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb99806dc80 0x7fb998153680 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fb99400c430 tx=0x7fb99400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:21.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.571+0000 7fb98effd640 1 -- 172.21.15.38:0/323284190 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994005ce0 con 0x7fb99806dc80 2023-12-22T08:47:21.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.571+0000 7fb98effd640 1 -- 172.21.15.38:0/323284190 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb994005e40 con 0x7fb99806dc80 2023-12-22T08:47:21.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.571+0000 7fb98effd640 1 -- 172.21.15.38:0/323284190 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9940072f0 con 0x7fb99806dc80 2023-12-22T08:47:21.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.571+0000 7fb99f054640 1 -- 172.21.15.38:0/323284190 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb998152e80 con 0x7fb99806dc80 2023-12-22T08:47:21.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.571+0000 7fb99f054640 1 -- 172.21.15.38:0/323284190 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9981546c0 con 0x7fb99806dc80 2023-12-22T08:47:21.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.572+0000 7fb99f054640 1 -- 172.21.15.38:0/323284190 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9981533a0 con 0x7fb99806dc80 2023-12-22T08:47:21.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.573+0000 7fb98effd640 1 -- 172.21.15.38:0/323284190 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb994007450 con 0x7fb99806dc80 2023-12-22T08:47:21.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.574+0000 7fb98effd640 1 --2- 172.21.15.38:0/323284190 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb97c06a430 0x7fb97c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.574+0000 7fb98effd640 1 -- 172.21.15.38:0/323284190 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb994088070 con 0x7fb99806dc80 2023-12-22T08:47:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.575+0000 7fb98effd640 1 -- 172.21.15.38:0/323284190 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=130+}) v3 -- 0x7fb97c071f60 con 0x7fb99806dc80 2023-12-22T08:47:21.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.575+0000 7fb99d851640 1 --2- 172.21.15.38:0/323284190 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb97c06a430 0x7fb97c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:21.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.576+0000 7fb99d851640 1 --2- 172.21.15.38:0/323284190 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb97c06a430 0x7fb97c06c8f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb988036000 tx=0x7fb988030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:21.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.579+0000 7fb98effd640 1 -- 172.21.15.38:0/323284190 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb9940bac80 con 0x7fb99806dc80 2023-12-22T08:47:21.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:21.783+0000 7fb99f054640 1 -- 172.21.15.38:0/323284190 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fb9980cdc20 con 0x7fb99806dc80 2023-12-22T08:47:22.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.306+0000 7fb98effd640 1 -- 172.21.15.38:0/323284190 <== mon.0 v2:172.21.15.38:3300/0 7 ==== osd_map(130..130 src has 1..130) v4 ==== 288+0+0 (secure 0 0 0) 0x7fb994057980 con 0x7fb99806dc80 2023-12-22T08:47:22.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.306+0000 7fb98effd640 1 -- 172.21.15.38:0/323284190 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=131}) v3 -- 0x7fb97c072810 con 0x7fb99806dc80 2023-12-22T08:47:22.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.310+0000 7fb98effd640 1 -- 172.21.15.38:0/323284190 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v130) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb994017060 con 0x7fb99806dc80 2023-12-22T08:47:22.312 INFO:teuthology.orchestra.run.smithi038.stderr:pauserd,pausewr is unset 2023-12-22T08:47:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.314+0000 7fb99f054640 1 -- 172.21.15.38:0/323284190 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb97c06a430 msgr2=0x7fb97c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.314+0000 7fb99f054640 1 --2- 172.21.15.38:0/323284190 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb97c06a430 0x7fb97c06c8f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb988036000 tx=0x7fb988030000 comp rx=0 tx=0).stop 2023-12-22T08:47:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.314+0000 7fb99f054640 1 -- 172.21.15.38:0/323284190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb99806dc80 msgr2=0x7fb998153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.314+0000 7fb99f054640 1 --2- 172.21.15.38:0/323284190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb99806dc80 0x7fb998153680 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fb99400c430 tx=0x7fb99400c8f0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.314+0000 7fb99f054640 1 -- 172.21.15.38:0/323284190 shutdown_connections 2023-12-22T08:47:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.314+0000 7fb99f054640 1 --2- 172.21.15.38:0/323284190 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb99809ba90 0x7fb99806c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.314+0000 7fb99f054640 1 --2- 172.21.15.38:0/323284190 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb99806e060 0x7fb998154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.314+0000 7fb99f054640 1 --2- 172.21.15.38:0/323284190 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb97c06a430 0x7fb97c06c8f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.314+0000 7fb99f054640 1 --2- 172.21.15.38:0/323284190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb99806dc80 0x7fb998153680 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.314+0000 7fb99f054640 1 -- 172.21.15.38:0/323284190 >> 172.21.15.38:0/323284190 conn(0x7fb9980cf000 msgr2=0x7fb99809b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.314+0000 7fb99f054640 1 -- 172.21.15.38:0/323284190 shutdown_connections 2023-12-22T08:47:22.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.314+0000 7fb99f054640 1 -- 172.21.15.38:0/323284190 wait complete. 2023-12-22T08:47:22.336 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:22.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.559+0000 7fc9a6ffd640 1 Processor -- start 2023-12-22T08:47:22.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.559+0000 7fc9a6ffd640 1 -- start start 2023-12-22T08:47:22.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.560+0000 7fc9a6ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9a0162f20 0x7fc9a00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:22.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.560+0000 7fc9a6ffd640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a00b2fd0 con 0x7fc9a00caf90 2023-12-22T08:47:22.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.561+0000 7fc9a6ffd640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a0163370 con 0x7fc9a0071680 2023-12-22T08:47:22.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.561+0000 7fc9a6ffd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a0162ce0 con 0x7fc9a0162f20 2023-12-22T08:47:22.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.561+0000 7fc9a57fa640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc9a00caf90 0x7fc9a006d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55376/0 (socket says 172.21.15.38:55376) 2023-12-22T08:47:22.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.561+0000 7fc9a57fa640 1 -- 172.21.15.38:0/3151177033 learned_addr learned my addr 172.21.15.38:0/3151177033 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:22.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.561+0000 7fc9a67fc640 1 --2- 172.21.15.38:0/3151177033 >> v2:172.21.15.89:3300/0 conn(0x7fc9a0162f20 0x7fc9a00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:22.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.561+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322803999 0 0) 0x7fc994001110 con 0x7fc9a00caf90 2023-12-22T08:47:22.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc988003520 con 0x7fc9a00caf90 2023-12-22T08:47:22.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1816423060 0 0) 0x7fc988003520 con 0x7fc9a00caf90 2023-12-22T08:47:22.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 >> v2:172.21.15.89:3300/0 conn(0x7fc9a0162f20 msgr2=0x7fc9a00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:22.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 --2- 172.21.15.38:0/3151177033 >> v2:172.21.15.89:3300/0 conn(0x7fc9a0162f20 0x7fc9a00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 >> v1:172.21.15.89:6789/0 conn(0x7fc9a0071680 legacy=0x7fc9a00ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:22.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a0162160 con 0x7fc9a00caf90 2023-12-22T08:47:22.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fc994001800 con 0x7fc9a00caf90 2023-12-22T08:47:22.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 >> v1:172.21.15.38:6789/0 conn(0x7fc9a00caf90 legacy=0x7fc9a006d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:22.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 --2- 172.21.15.38:0/3151177033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc988003970 0x7fc988003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:22.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 --2- 172.21.15.38:0/3151177033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9880047c0 0x7fc988004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:22.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 --2- 172.21.15.38:0/3151177033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc988005180 0x7fc98800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:22.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0162ce0 con 0x7fc9880047c0 2023-12-22T08:47:22.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98800c120 con 0x7fc988003970 2023-12-22T08:47:22.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98800c2e0 con 0x7fc988005180 2023-12-22T08:47:22.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.562+0000 7fc9a57fa640 1 --2- 172.21.15.38:0/3151177033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9880047c0 0x7fc988004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:22.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.563+0000 7fc9a5ffb640 1 --2- 172.21.15.38:0/3151177033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc988003970 0x7fc988003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:22.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.563+0000 7fc9a67fc640 1 --2- 172.21.15.38:0/3151177033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc988005180 0x7fc98800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:22.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.563+0000 7fc9a57fa640 1 -- 172.21.15.38:0/3151177033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc988005180 msgr2=0x7fc98800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:22.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.563+0000 7fc9a57fa640 1 --2- 172.21.15.38:0/3151177033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc988005180 0x7fc98800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.563+0000 7fc9a57fa640 1 -- 172.21.15.38:0/3151177033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc988003970 msgr2=0x7fc988003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:22.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.563+0000 7fc9a57fa640 1 --2- 172.21.15.38:0/3151177033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc988003970 0x7fc988003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.563+0000 7fc9a57fa640 1 -- 172.21.15.38:0/3151177033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc988003520 con 0x7fc9880047c0 2023-12-22T08:47:22.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.563+0000 7fc9a5ffb640 1 --2- 172.21.15.38:0/3151177033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc988003970 0x7fc988003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:47:22.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.563+0000 7fc9a67fc640 1 -- 172.21.15.38:0/3151177033 reap_dead start 2023-12-22T08:47:22.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.564+0000 7fc9a57fa640 1 --2- 172.21.15.38:0/3151177033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9880047c0 0x7fc988004c40 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00b1f40 tx=0x7fc9880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5809b2ff6967dd42 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:22.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.564+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994005ad0 con 0x7fc9880047c0 2023-12-22T08:47:22.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.564+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc994005c50 con 0x7fc9880047c0 2023-12-22T08:47:22.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.564+0000 7fc9a4ff9640 1 -- 172.21.15.38:0/3151177033 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994007070 con 0x7fc9880047c0 2023-12-22T08:47:22.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.565+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/3151177033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9880047c0 msgr2=0x7fc988004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:22.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.565+0000 7fc9a6ffd640 1 --2- 172.21.15.38:0/3151177033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9880047c0 0x7fc988004c40 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00b1f40 tx=0x7fc9880057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.565+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/3151177033 shutdown_connections 2023-12-22T08:47:22.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.565+0000 7fc9a6ffd640 1 --2- 172.21.15.38:0/3151177033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9880047c0 0x7fc988004c40 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.565+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/3151177033 >> 172.21.15.38:0/3151177033 conn(0x7fc9a00b1f70 msgr2=0x7fc9a00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:22.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.565+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/3151177033 shutdown_connections 2023-12-22T08:47:22.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.565+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/3151177033 wait complete. 2023-12-22T08:47:22.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.567+0000 7fc9a6ffd640 1 Processor -- start 2023-12-22T08:47:22.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.567+0000 7fc9a6ffd640 1 -- start start 2023-12-22T08:47:22.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.568+0000 7fc9a6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9880047c0 0x7fc9a0158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:22.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.568+0000 7fc9a6ffd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a015e9d0 0x7fc9a015ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:22.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.568+0000 7fc9a6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a0151bb0 0x7fc9a0152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:22.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.568+0000 7fc9a6ffd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0160150 con 0x7fc9880047c0 2023-12-22T08:47:22.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.568+0000 7fc9a6ffd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a015f540 con 0x7fc9a0151bb0 2023-12-22T08:47:22.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.568+0000 7fc9a6ffd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a015f820 con 0x7fc9a015e9d0 2023-12-22T08:47:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.568+0000 7fc9a5ffb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9880047c0 0x7fc9a0158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.568+0000 7fc9a5ffb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9880047c0 0x7fc9a0158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37860/0 (socket says 172.21.15.38:37860) 2023-12-22T08:47:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.568+0000 7fc9a5ffb640 1 -- 172.21.15.38:0/2199703143 learned_addr learned my addr 172.21.15.38:0/2199703143 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.569+0000 7fc9a57fa640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a015e9d0 0x7fc9a015ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.569+0000 7fc9a5ffb640 1 -- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a015e9d0 msgr2=0x7fc9a015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.569+0000 7fc9a67fc640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a0151bb0 0x7fc9a0152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.569+0000 7fc9a5ffb640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a015e9d0 0x7fc9a015ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.569+0000 7fc9a5ffb640 1 -- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a0151bb0 msgr2=0x7fc9a0152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.569+0000 7fc9a5ffb640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a0151bb0 0x7fc9a0152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.569+0000 7fc9a5ffb640 1 -- 172.21.15.38:0/2199703143 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a015fb00 con 0x7fc9880047c0 2023-12-22T08:47:22.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.569+0000 7fc9a5ffb640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9880047c0 0x7fc9a0158090 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fc99000e480 tx=0x7fc99000e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:22.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.569+0000 7fc99e7fc640 1 -- 172.21.15.38:0/2199703143 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990017070 con 0x7fc9880047c0 2023-12-22T08:47:22.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.569+0000 7fc99e7fc640 1 -- 172.21.15.38:0/2199703143 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9900052e0 con 0x7fc9880047c0 2023-12-22T08:47:22.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.569+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/2199703143 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a015fde0 con 0x7fc9880047c0 2023-12-22T08:47:22.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.570+0000 7fc99e7fc640 1 -- 172.21.15.38:0/2199703143 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990005490 con 0x7fc9880047c0 2023-12-22T08:47:22.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.570+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/2199703143 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a01585d0 con 0x7fc9880047c0 2023-12-22T08:47:22.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.571+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/2199703143 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a0061910 con 0x7fc9880047c0 2023-12-22T08:47:22.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.572+0000 7fc99e7fc640 1 -- 172.21.15.38:0/2199703143 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc990007020 con 0x7fc9880047c0 2023-12-22T08:47:22.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.573+0000 7fc99e7fc640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc98c06a460 0x7fc98c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:22.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.573+0000 7fc99e7fc640 1 -- 172.21.15.38:0/2199703143 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc990087f60 con 0x7fc9880047c0 2023-12-22T08:47:22.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.573+0000 7fc9a57fa640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc98c06a460 0x7fc98c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:22.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.575+0000 7fc9a57fa640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc98c06a460 0x7fc98c06c920 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc994034000 tx=0x7fc994009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:22.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.577+0000 7fc99e7fc640 1 -- 172.21.15.38:0/2199703143 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc990053540 con 0x7fc9880047c0 2023-12-22T08:47:22.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.773+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/2199703143 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9a0070a70 con 0x7fc9880047c0 2023-12-22T08:47:22.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.775+0000 7fc99e7fc640 1 -- 172.21.15.38:0/2199703143 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16011 (secure 0 0 0) 0x7fc990056b60 con 0x7fc9880047c0 2023-12-22T08:47:22.777 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:22.777 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":130,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:22.301110+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:04.687287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:06.061571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:22.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.778+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc98c06a460 msgr2=0x7fc98c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:22.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.778+0000 7fc9a6ffd640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc98c06a460 0x7fc98c06c920 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc994034000 tx=0x7fc994009030 comp rx=0 tx=0).stop 2023-12-22T08:47:22.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.778+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/2199703143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9880047c0 msgr2=0x7fc9a0158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:22.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.778+0000 7fc9a6ffd640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9880047c0 0x7fc9a0158090 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fc99000e480 tx=0x7fc99000e940 comp rx=0 tx=0).stop 2023-12-22T08:47:22.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.778+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/2199703143 shutdown_connections 2023-12-22T08:47:22.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.778+0000 7fc9a6ffd640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a0151bb0 0x7fc9a0152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.778+0000 7fc9a6ffd640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a015e9d0 0x7fc9a015ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.778+0000 7fc9a6ffd640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc98c06a460 0x7fc98c06c920 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.778+0000 7fc9a6ffd640 1 --2- 172.21.15.38:0/2199703143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9880047c0 0x7fc9a0158090 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:22.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.778+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/2199703143 >> 172.21.15.38:0/2199703143 conn(0x7fc9a00b1f70 msgr2=0x7fc9a0161470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:22.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.778+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/2199703143 shutdown_connections 2023-12-22T08:47:22.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:22.778+0000 7fc9a6ffd640 1 -- 172.21.15.38:0/2199703143 wait complete. 2023-12-22T08:47:22.800 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T08:47:22.800 DEBUG:teuthology.orchestra.run.smithi038:> import os 2023-12-22T08:47:22.800 DEBUG:teuthology.orchestra.run.smithi038:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-22T08:47:22.800 DEBUG:teuthology.orchestra.run.smithi038:> os.fchmod(fd, 0O666) 2023-12-22T08:47:22.800 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(fd) 2023-12-22T08:47:22.800 DEBUG:teuthology.orchestra.run.smithi038:> os.close(fd) 2023-12-22T08:47:22.800 DEBUG:teuthology.orchestra.run.smithi038:> ' 2023-12-22T08:47:23.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:23.132 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:47:23.241 INFO:teuthology.orchestra.run.smithi038.stdout:client6208 2023-12-22T08:47:23.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:23.241 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/893856d7-5d01-4896-9127-f971dbad2b97.client6208/osdmap') 2023-12-22T08:47:23.340 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 127 barrier 127 flags 0x588000 2023-12-22T08:47:23.341 INFO:teuthology.orchestra.run.smithi038.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:47:23.341 INFO:teuthology.orchestra.run.smithi038.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:47:23.341 INFO:teuthology.orchestra.run.smithi038.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:47:23.341 INFO:teuthology.orchestra.run.smithi038.stdout:osd0 (2)172.21.15.38:6800 100% (exists, up) 100% -1 2023-12-22T08:47:23.341 INFO:teuthology.orchestra.run.smithi038.stdout:osd1 (2)172.21.15.38:6808 100% (exists, up) 100% -1 2023-12-22T08:47:23.341 INFO:teuthology.orchestra.run.smithi038.stdout:osd2 (2)172.21.15.38:6824 100% (exists, up) 100% -1 2023-12-22T08:47:23.341 INFO:teuthology.orchestra.run.smithi038.stdout:osd3 (2)172.21.15.38:6816 100% (exists, up) 100% -1 2023-12-22T08:47:23.341 INFO:teuthology.orchestra.run.smithi038.stdout:osd4 (2)172.21.15.89:6800 100% (exists, up) 100% -1 2023-12-22T08:47:23.341 INFO:teuthology.orchestra.run.smithi038.stdout:osd5 (2)172.21.15.89:6816 100% (exists, up) 100% -1 2023-12-22T08:47:23.341 INFO:teuthology.orchestra.run.smithi038.stdout:osd6 (2)172.21.15.89:6808 100% (exists, up) 100% -1 2023-12-22T08:47:23.341 INFO:teuthology.orchestra.run.smithi038.stdout:osd7 (2)172.21.15.89:6821 100% (exists, up) 100% -1 2023-12-22T08:47:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records in 2023-12-22T08:47:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records out 2023-12-22T08:47:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:795 bytes copied, 8.9321e-05 s, 8.9 MB/s 2023-12-22T08:47:23.345 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:47:23.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.576+0000 7f2a31315640 1 Processor -- start 2023-12-22T08:47:23.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.576+0000 7f2a31315640 1 -- start start 2023-12-22T08:47:23.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.578+0000 7f2a31315640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2a2c157980 0x7f2a2c15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:23.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.578+0000 7f2a31315640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a2c06d640 0x7f2a2c0d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:23.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.578+0000 7f2a31315640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c0d1520 con 0x7f2a2c0b3ff0 2023-12-22T08:47:23.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.578+0000 7f2a31315640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c0d1800 con 0x7f2a2c157980 2023-12-22T08:47:23.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.578+0000 7f2a31315640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c0d1ae0 con 0x7f2a2c06d640 2023-12-22T08:47:23.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.578+0000 7f2a2bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2a2c157980 0x7f2a2c15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:23.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.578+0000 7f2a2bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2a2c157980 0x7f2a2c15eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37866/0 (socket says 172.21.15.38:37866) 2023-12-22T08:47:23.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.578+0000 7f2a2bfff640 1 -- 172.21.15.38:0/2310547712 learned_addr learned my addr 172.21.15.38:0/2310547712 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:23.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.579+0000 7f2a30b14640 1 --2- 172.21.15.38:0/2310547712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a2c06d640 0x7f2a2c0d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:23.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.579+0000 7f2a2bfff640 1 -- 172.21.15.38:0/2310547712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a2c06d640 msgr2=0x7f2a2c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:23.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.579+0000 7f2a2bfff640 1 --2- 172.21.15.38:0/2310547712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a2c06d640 0x7f2a2c0d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:23.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.579+0000 7f2a2bfff640 1 -- 172.21.15.38:0/2310547712 >> v1:172.21.15.89:6789/0 conn(0x7f2a2c0b3ff0 legacy=0x7f2a2c06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:23.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.579+0000 7f2a2bfff640 1 -- 172.21.15.38:0/2310547712 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c0d1dc0 con 0x7f2a2c157980 2023-12-22T08:47:23.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.580+0000 7f2a2bfff640 1 --2- 172.21.15.38:0/2310547712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a2c157980 0x7f2a2c15eb10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009870 tx=0x7f2a1c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3b766d76cda622 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:23.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.580+0000 7f2a2affd640 1 -- 172.21.15.38:0/2310547712 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c031640 con 0x7f2a2c157980 2023-12-22T08:47:23.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.580+0000 7f2a2affd640 1 -- 172.21.15.38:0/2310547712 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c0317a0 con 0x7f2a2c157980 2023-12-22T08:47:23.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.580+0000 7f2a2affd640 1 -- 172.21.15.38:0/2310547712 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c031b30 con 0x7f2a2c157980 2023-12-22T08:47:23.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.581+0000 7f2a31315640 1 -- 172.21.15.38:0/2310547712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a2c157980 msgr2=0x7f2a2c15eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:23.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.581+0000 7f2a31315640 1 --2- 172.21.15.38:0/2310547712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a2c157980 0x7f2a2c15eb10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009870 tx=0x7f2a1c02b8f0 comp rx=0 tx=0).stop 2023-12-22T08:47:23.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.581+0000 7f2a31315640 1 -- 172.21.15.38:0/2310547712 shutdown_connections 2023-12-22T08:47:23.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.581+0000 7f2a31315640 1 --2- 172.21.15.38:0/2310547712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a2c06d640 0x7f2a2c0d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:23.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.581+0000 7f2a31315640 1 --2- 172.21.15.38:0/2310547712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a2c157980 0x7f2a2c15eb10 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:23.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.581+0000 7f2a31315640 1 -- 172.21.15.38:0/2310547712 >> 172.21.15.38:0/2310547712 conn(0x7f2a2c0d31f0 msgr2=0x7f2a2c0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:23.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.581+0000 7f2a31315640 1 -- 172.21.15.38:0/2310547712 shutdown_connections 2023-12-22T08:47:23.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.581+0000 7f2a31315640 1 -- 172.21.15.38:0/2310547712 wait complete. 2023-12-22T08:47:23.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.583+0000 7f2a31315640 1 Processor -- start 2023-12-22T08:47:23.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.583+0000 7f2a31315640 1 -- start start 2023-12-22T08:47:23.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.584+0000 7f2a31315640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a2c06d640 0x7f2a2c0d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:23.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.584+0000 7f2a31315640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a2c0b3ff0 0x7f2a2c0d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:23.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.584+0000 7f2a31315640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a2c157980 0x7f2a2c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:23.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.584+0000 7f2a31315640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c15fc00 con 0x7f2a2c157980 2023-12-22T08:47:23.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.584+0000 7f2a31315640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c159bb0 con 0x7f2a2c0b3ff0 2023-12-22T08:47:23.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.584+0000 7f2a31315640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c159e90 con 0x7f2a2c06d640 2023-12-22T08:47:23.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.584+0000 7f2a30b14640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a2c157980 0x7f2a2c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:23.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.584+0000 7f2a30b14640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a2c157980 0x7f2a2c15e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37872/0 (socket says 172.21.15.38:37872) 2023-12-22T08:47:23.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.584+0000 7f2a30b14640 1 -- 172.21.15.38:0/2278691250 learned_addr learned my addr 172.21.15.38:0/2278691250 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:23.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.585+0000 7f2a2bfff640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a2c06d640 0x7f2a2c0d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:23.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.585+0000 7f2a30b14640 1 -- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a2c06d640 msgr2=0x7f2a2c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:23.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.585+0000 7f2a30b14640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a2c06d640 0x7f2a2c0d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:23.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.585+0000 7f2a2b7fe640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a2c0b3ff0 0x7f2a2c0d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:23.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.585+0000 7f2a30b14640 1 -- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a2c0b3ff0 msgr2=0x7f2a2c0d2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:23.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.585+0000 7f2a30b14640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a2c0b3ff0 0x7f2a2c0d2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:23.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.585+0000 7f2a30b14640 1 -- 172.21.15.38:0/2278691250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c0094d0 con 0x7f2a2c157980 2023-12-22T08:47:23.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.585+0000 7f2a2bfff640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a2c06d640 0x7f2a2c0d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:23.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.585+0000 7f2a30b14640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a2c157980 0x7f2a2c15e3f0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f2a24007de0 tx=0x7f2a2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:23.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.585+0000 7f2a28ff9640 1 -- 172.21.15.38:0/2278691250 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24014620 con 0x7f2a2c157980 2023-12-22T08:47:23.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.585+0000 7f2a28ff9640 1 -- 172.21.15.38:0/2278691250 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2400ee90 con 0x7f2a2c157980 2023-12-22T08:47:23.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.585+0000 7f2a28ff9640 1 -- 172.21.15.38:0/2278691250 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a240149e0 con 0x7f2a2c157980 2023-12-22T08:47:23.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.585+0000 7f2a31315640 1 -- 172.21.15.38:0/2278691250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c15d910 con 0x7f2a2c157980 2023-12-22T08:47:23.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.586+0000 7f2a31315640 1 -- 172.21.15.38:0/2278691250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c15ded0 con 0x7f2a2c157980 2023-12-22T08:47:23.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.587+0000 7f2a31315640 1 -- 172.21.15.38:0/2278691250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c061910 con 0x7f2a2c157980 2023-12-22T08:47:23.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.588+0000 7f2a28ff9640 1 -- 172.21.15.38:0/2278691250 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2a24014b40 con 0x7f2a2c157980 2023-12-22T08:47:23.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.588+0000 7f2a28ff9640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a1806a430 0x7f2a1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:23.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.589+0000 7f2a28ff9640 1 -- 172.21.15.38:0/2278691250 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a240893f0 con 0x7f2a2c157980 2023-12-22T08:47:23.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.589+0000 7f2a2bfff640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a1806a430 0x7f2a1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:23.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.590+0000 7f2a2bfff640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a1806a430 0x7f2a1806c8f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c036000 tx=0x7f2a1c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:23.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.593+0000 7f2a28ff9640 1 -- 172.21.15.38:0/2278691250 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2a24054940 con 0x7f2a2c157980 2023-12-22T08:47:23.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.826+0000 7f2a31315640 1 -- 172.21.15.38:0/2278691250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a2c15e090 con 0x7f2a2c157980 2023-12-22T08:47:23.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.827+0000 7f2a28ff9640 1 -- 172.21.15.38:0/2278691250 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f2a2405e030 con 0x7f2a2c157980 2023-12-22T08:47:23.828 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:23.828 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/186375012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":186375012},{"type":"v1","addr":"172.21.15.89:6837","nonce":186375012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1819583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1819583870},{"type":"v1","addr":"172.21.15.89:6835","nonce":1819583870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3793773672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3793773672},{"type":"v1","addr":"172.21.15.38:6834","nonce":3793773672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:07.035669+0000","modified":"2023-12-22T08:47:10.565916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7293":{"gid":7293,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3340763944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3340763944},{"type":"v1","addr":"172.21.15.38:6835","nonce":3340763944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-22T08:47:23.829 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 55 2023-12-22T08:47:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.829+0000 7f2a31315640 1 -- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a1806a430 msgr2=0x7f2a1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.829+0000 7f2a31315640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a1806a430 0x7f2a1806c8f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c036000 tx=0x7f2a1c03c040 comp rx=0 tx=0).stop 2023-12-22T08:47:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.829+0000 7f2a31315640 1 -- 172.21.15.38:0/2278691250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a2c157980 msgr2=0x7f2a2c15e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.829+0000 7f2a31315640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a2c157980 0x7f2a2c15e3f0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f2a24007de0 tx=0x7f2a2400e4b0 comp rx=0 tx=0).stop 2023-12-22T08:47:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.830+0000 7f2a31315640 1 -- 172.21.15.38:0/2278691250 shutdown_connections 2023-12-22T08:47:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.830+0000 7f2a31315640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2a1806a430 0x7f2a1806c8f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.830+0000 7f2a31315640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a2c157980 0x7f2a2c15e3f0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.830+0000 7f2a31315640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a2c0b3ff0 0x7f2a2c0d2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:23.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.830+0000 7f2a31315640 1 --2- 172.21.15.38:0/2278691250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2a2c06d640 0x7f2a2c0d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:23.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.830+0000 7f2a31315640 1 -- 172.21.15.38:0/2278691250 >> 172.21.15.38:0/2278691250 conn(0x7f2a2c0d31f0 msgr2=0x7f2a2c070b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:23.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.830+0000 7f2a31315640 1 -- 172.21.15.38:0/2278691250 shutdown_connections 2023-12-22T08:47:23.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:23.830+0000 7f2a31315640 1 -- 172.21.15.38:0/2278691250 wait complete. 2023-12-22T08:47:23.852 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 130 2023-12-22T08:47:24.099 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-12-22T08:47:24.100 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T08:47:24.100 DEBUG:teuthology.orchestra.run.smithi038:> import os 2023-12-22T08:47:24.100 DEBUG:teuthology.orchestra.run.smithi038:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-22T08:47:24.100 DEBUG:teuthology.orchestra.run.smithi038:> os.fchmod(fd, 0O666) 2023-12-22T08:47:24.100 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(fd) 2023-12-22T08:47:24.100 DEBUG:teuthology.orchestra.run.smithi038:> os.close(fd) 2023-12-22T08:47:24.100 DEBUG:teuthology.orchestra.run.smithi038:> ' 2023-12-22T08:47:24.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:24.428 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:47:24.538 INFO:teuthology.orchestra.run.smithi038.stdout:client6208 2023-12-22T08:47:24.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:24.539 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/893856d7-5d01-4896-9127-f971dbad2b97.client6208/osdmap') 2023-12-22T08:47:24.640 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 130 barrier 130 flags 0x588000 2023-12-22T08:47:24.640 INFO:teuthology.orchestra.run.smithi038.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:47:24.640 INFO:teuthology.orchestra.run.smithi038.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:47:24.641 INFO:teuthology.orchestra.run.smithi038.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:47:24.641 INFO:teuthology.orchestra.run.smithi038.stdout:osd0 (2)172.21.15.38:6800 100% (exists, up) 100% -1 2023-12-22T08:47:24.641 INFO:teuthology.orchestra.run.smithi038.stdout:osd1 (2)172.21.15.38:6808 100% (exists, up) 100% -1 2023-12-22T08:47:24.641 INFO:teuthology.orchestra.run.smithi038.stdout:osd2 (2)172.21.15.38:6824 100% (exists, up) 100% -1 2023-12-22T08:47:24.641 INFO:teuthology.orchestra.run.smithi038.stdout:osd3 (2)172.21.15.38:6816 100% (exists, up) 100% -1 2023-12-22T08:47:24.641 INFO:teuthology.orchestra.run.smithi038.stdout:osd4 (2)172.21.15.89:6800 100% (exists, up) 100% -1 2023-12-22T08:47:24.641 INFO:teuthology.orchestra.run.smithi038.stdout:osd5 (2)172.21.15.89:6816 100% (exists, up) 100% -1 2023-12-22T08:47:24.641 INFO:teuthology.orchestra.run.smithi038.stdout:osd6 (2)172.21.15.89:6808 100% (exists, up) 100% -1 2023-12-22T08:47:24.641 INFO:teuthology.orchestra.run.smithi038.stdout:osd7 (2)172.21.15.89:6821 100% (exists, up) 100% -1 2023-12-22T08:47:24.641 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records in 2023-12-22T08:47:24.642 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records out 2023-12-22T08:47:24.642 INFO:teuthology.orchestra.run.smithi038.stderr:795 bytes copied, 9.5137e-05 s, 8.4 MB/s 2023-12-22T08:47:24.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:24.645 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:47:24.706 INFO:teuthology.orchestra.run.smithi038.stdout:client6208 2023-12-22T08:47:24.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:24.706 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/893856d7-5d01-4896-9127-f971dbad2b97.client6208/osdmap') 2023-12-22T08:47:24.811 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 130 barrier 130 flags 0x588000 2023-12-22T08:47:24.811 INFO:teuthology.orchestra.run.smithi038.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:47:24.811 INFO:teuthology.orchestra.run.smithi038.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:47:24.811 INFO:teuthology.orchestra.run.smithi038.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-12-22T08:47:24.811 INFO:teuthology.orchestra.run.smithi038.stdout:osd0 (2)172.21.15.38:6800 100% (exists, up) 100% -1 2023-12-22T08:47:24.811 INFO:teuthology.orchestra.run.smithi038.stdout:osd1 (2)172.21.15.38:6808 100% (exists, up) 100% -1 2023-12-22T08:47:24.811 INFO:teuthology.orchestra.run.smithi038.stdout:osd2 (2)172.21.15.38:6824 100% (exists, up) 100% -1 2023-12-22T08:47:24.811 INFO:teuthology.orchestra.run.smithi038.stdout:osd3 (2)172.21.15.38:6816 100% (exists, up) 100% -1 2023-12-22T08:47:24.812 INFO:teuthology.orchestra.run.smithi038.stdout:osd4 (2)172.21.15.89:6800 100% (exists, up) 100% -1 2023-12-22T08:47:24.812 INFO:teuthology.orchestra.run.smithi038.stdout:osd5 (2)172.21.15.89:6816 100% (exists, up) 100% -1 2023-12-22T08:47:24.812 INFO:teuthology.orchestra.run.smithi038.stdout:osd6 (2)172.21.15.89:6808 100% (exists, up) 100% -1 2023-12-22T08:47:24.812 INFO:teuthology.orchestra.run.smithi038.stdout:osd7 (2)172.21.15.89:6821 100% (exists, up) 100% -1 2023-12-22T08:47:24.812 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records in 2023-12-22T08:47:24.812 INFO:teuthology.orchestra.run.smithi038.stderr:1+1 records out 2023-12-22T08:47:24.812 INFO:teuthology.orchestra.run.smithi038.stderr:795 bytes copied, 9.2606e-05 s, 8.6 MB/s 2023-12-22T08:47:24.815 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-22T08:47:24.815 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:47:24.815 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:47:24.940 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:47:25.058 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:47:25.058 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:47:25.058 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:25.121 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:47:25.121 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:25.180 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.409+0000 7fc396880640 1 Processor -- start 2023-12-22T08:47:25.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.409+0000 7fc396880640 1 -- start start 2023-12-22T08:47:25.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.411+0000 7fc396880640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc39015b420 0x7fc39006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:25.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.411+0000 7fc396880640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3900cdae0 con 0x7fc390071000 2023-12-22T08:47:25.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.411+0000 7fc396880640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39006dec0 con 0x7fc3900a44a0 2023-12-22T08:47:25.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.411+0000 7fc396880640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39015b800 con 0x7fc39015b420 2023-12-22T08:47:25.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.411+0000 7fc39607f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc390071000 0x7fc39015baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55382/0 (socket says 172.21.15.38:55382) 2023-12-22T08:47:25.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.411+0000 7fc39607f640 1 -- 172.21.15.38:0/3810600006 learned_addr learned my addr 172.21.15.38:0/3810600006 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:25.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.412+0000 7fc39587e640 1 --2- 172.21.15.38:0/3810600006 >> v2:172.21.15.89:3300/0 conn(0x7fc39015b420 0x7fc39006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:25.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.412+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47563396 0 0) 0x7fc3900cdae0 con 0x7fc390071000 2023-12-22T08:47:25.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.412+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc378003520 con 0x7fc390071000 2023-12-22T08:47:25.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.412+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1156626993 0 0) 0x7fc378003520 con 0x7fc390071000 2023-12-22T08:47:25.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.412+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 >> v2:172.21.15.89:3300/0 conn(0x7fc39015b420 msgr2=0x7fc39006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:25.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.412+0000 7fc39487c640 1 --2- 172.21.15.38:0/3810600006 >> v2:172.21.15.89:3300/0 conn(0x7fc39015b420 0x7fc39006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.412+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 >> v1:172.21.15.89:6789/0 conn(0x7fc3900a44a0 legacy=0x7fc3900708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:25.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.412+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3900cdd30 con 0x7fc390071000 2023-12-22T08:47:25.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.412+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fc388001670 con 0x7fc390071000 2023-12-22T08:47:25.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.412+0000 7fc39587e640 1 --2- 172.21.15.38:0/3810600006 >> v2:172.21.15.89:3300/0 conn(0x7fc39015b420 0x7fc39006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:47:25.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.412+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 >> v1:172.21.15.38:6789/0 conn(0x7fc390071000 legacy=0x7fc39015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:25.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.412+0000 7fc39487c640 1 --2- 172.21.15.38:0/3810600006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc378003970 0x7fc378003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:25.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39487c640 1 --2- 172.21.15.38:0/3810600006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3780047c0 0x7fc378004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:25.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39487c640 1 --2- 172.21.15.38:0/3810600006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc378005180 0x7fc37800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:25.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39015b800 con 0x7fc378005180 2023-12-22T08:47:25.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37800c020 con 0x7fc378003970 2023-12-22T08:47:25.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37800c1e0 con 0x7fc3780047c0 2023-12-22T08:47:25.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39607f640 1 --2- 172.21.15.38:0/3810600006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc378005180 0x7fc37800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:25.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39587e640 1 --2- 172.21.15.38:0/3810600006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc378003970 0x7fc378003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:25.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39507d640 1 --2- 172.21.15.38:0/3810600006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3780047c0 0x7fc378004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:25.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39607f640 1 -- 172.21.15.38:0/3810600006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3780047c0 msgr2=0x7fc378004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:25.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39607f640 1 --2- 172.21.15.38:0/3810600006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3780047c0 0x7fc378004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39607f640 1 -- 172.21.15.38:0/3810600006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc378003970 msgr2=0x7fc378003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:25.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39607f640 1 --2- 172.21.15.38:0/3810600006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc378003970 0x7fc378003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39607f640 1 -- 172.21.15.38:0/3810600006 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc378003520 con 0x7fc378005180 2023-12-22T08:47:25.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.413+0000 7fc39507d640 1 --2- 172.21.15.38:0/3810600006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3780047c0 0x7fc378004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:25.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.414+0000 7fc39607f640 1 -- 172.21.15.38:0/3810600006 reap_dead start 2023-12-22T08:47:25.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.414+0000 7fc39607f640 1 --2- 172.21.15.38:0/3810600006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc378005180 0x7fc37800b980 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fc38800c240 tx=0x7fc3780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2240d68a14874853 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:25.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.415+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388005ad0 con 0x7fc378005180 2023-12-22T08:47:25.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.415+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc388005c70 con 0x7fc378005180 2023-12-22T08:47:25.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.415+0000 7fc39487c640 1 -- 172.21.15.38:0/3810600006 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38802c8b0 con 0x7fc378005180 2023-12-22T08:47:25.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.415+0000 7fc396880640 1 -- 172.21.15.38:0/3810600006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc378005180 msgr2=0x7fc37800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:25.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.415+0000 7fc396880640 1 --2- 172.21.15.38:0/3810600006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc378005180 0x7fc37800b980 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fc38800c240 tx=0x7fc3780057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.415+0000 7fc396880640 1 -- 172.21.15.38:0/3810600006 shutdown_connections 2023-12-22T08:47:25.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.415+0000 7fc396880640 1 --2- 172.21.15.38:0/3810600006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc378005180 0x7fc37800b980 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.415+0000 7fc396880640 1 -- 172.21.15.38:0/3810600006 >> 172.21.15.38:0/3810600006 conn(0x7fc3900b1f70 msgr2=0x7fc3900b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:25.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.416+0000 7fc396880640 1 -- 172.21.15.38:0/3810600006 shutdown_connections 2023-12-22T08:47:25.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.416+0000 7fc396880640 1 -- 172.21.15.38:0/3810600006 wait complete. 2023-12-22T08:47:25.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.417+0000 7fc396880640 1 Processor -- start 2023-12-22T08:47:25.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.418+0000 7fc396880640 1 -- start start 2023-12-22T08:47:25.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.418+0000 7fc396880640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc378005180 0x7fc3901511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:25.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.418+0000 7fc396880640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc39006d060 0x7fc3901e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:25.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.418+0000 7fc396880640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39014d0a0 0x7fc3900a24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:25.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.418+0000 7fc396880640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3901e5120 con 0x7fc39006d060 2023-12-22T08:47:25.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.418+0000 7fc396880640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3901e40f0 con 0x7fc378005180 2023-12-22T08:47:25.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.418+0000 7fc396880640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3900a0fb0 con 0x7fc39014d0a0 2023-12-22T08:47:25.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.419+0000 7fc39507d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc39006d060 0x7fc3901e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:25.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.419+0000 7fc39507d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc39006d060 0x7fc3901e3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37902/0 (socket says 172.21.15.38:37902) 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.419+0000 7fc39507d640 1 -- 172.21.15.38:0/574675785 learned_addr learned my addr 172.21.15.38:0/574675785 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.419+0000 7fc39587e640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc378005180 0x7fc3901511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.419+0000 7fc39607f640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39014d0a0 0x7fc3900a24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.419+0000 7fc39507d640 1 -- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39014d0a0 msgr2=0x7fc3900a24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.419+0000 7fc39507d640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39014d0a0 0x7fc3900a24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.419+0000 7fc39507d640 1 -- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc378005180 msgr2=0x7fc3901511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.419+0000 7fc39507d640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc378005180 0x7fc3901511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.419+0000 7fc39507d640 1 -- 172.21.15.38:0/574675785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3901e4370 con 0x7fc39006d060 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.420+0000 7fc39507d640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc39006d060 0x7fc3901e3bb0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fc384001eb0 tx=0x7fc38400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.420+0000 7fc38e7fc640 1 -- 172.21.15.38:0/574675785 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384005480 con 0x7fc39006d060 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.420+0000 7fc38e7fc640 1 -- 172.21.15.38:0/574675785 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc384003610 con 0x7fc39006d060 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.420+0000 7fc38e7fc640 1 -- 172.21.15.38:0/574675785 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3840039c0 con 0x7fc39006d060 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.420+0000 7fc396880640 1 -- 172.21.15.38:0/574675785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3901e4650 con 0x7fc39006d060 2023-12-22T08:47:25.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.420+0000 7fc396880640 1 -- 172.21.15.38:0/574675785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39014d550 con 0x7fc39006d060 2023-12-22T08:47:25.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.421+0000 7fc396880640 1 -- 172.21.15.38:0/574675785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39014d710 con 0x7fc39006d060 2023-12-22T08:47:25.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.422+0000 7fc38e7fc640 1 -- 172.21.15.38:0/574675785 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc384003b20 con 0x7fc39006d060 2023-12-22T08:47:25.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.423+0000 7fc38e7fc640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc37c06a460 0x7fc37c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:25.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.423+0000 7fc38e7fc640 1 -- 172.21.15.38:0/574675785 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3840883d0 con 0x7fc39006d060 2023-12-22T08:47:25.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.424+0000 7fc39587e640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc37c06a460 0x7fc37c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:25.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.425+0000 7fc39587e640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc37c06a460 0x7fc37c06c920 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc380007580 tx=0x7fc38000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:25.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.427+0000 7fc38e7fc640 1 -- 172.21.15.38:0/574675785 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc39014d710 con 0x7fc39006d060 2023-12-22T08:47:25.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.619+0000 7fc396880640 1 -- 172.21.15.38:0/574675785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc39014d710 con 0x7fc39006d060 2023-12-22T08:47:25.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.620+0000 7fc38e7fc640 1 -- 172.21.15.38:0/574675785 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16011 (secure 0 0 0) 0x7fc39014d710 con 0x7fc39006d060 2023-12-22T08:47:25.622 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:25.622 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":130,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:22.301110+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:04.687287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:06.061571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:25.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.623+0000 7fc396880640 1 -- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc37c06a460 msgr2=0x7fc37c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:25.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.623+0000 7fc396880640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc37c06a460 0x7fc37c06c920 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc380007580 tx=0x7fc38000b040 comp rx=0 tx=0).stop 2023-12-22T08:47:25.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.623+0000 7fc396880640 1 -- 172.21.15.38:0/574675785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc39006d060 msgr2=0x7fc3901e3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:25.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.623+0000 7fc396880640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc39006d060 0x7fc3901e3bb0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fc384001eb0 tx=0x7fc38400d9d0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.623+0000 7fc396880640 1 -- 172.21.15.38:0/574675785 shutdown_connections 2023-12-22T08:47:25.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.623+0000 7fc396880640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc39014d0a0 0x7fc3900a24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.623+0000 7fc396880640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc37c06a460 0x7fc37c06c920 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.623+0000 7fc396880640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc39006d060 0x7fc3901e3bb0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.623+0000 7fc396880640 1 --2- 172.21.15.38:0/574675785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc378005180 0x7fc3901511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.623+0000 7fc396880640 1 -- 172.21.15.38:0/574675785 >> 172.21.15.38:0/574675785 conn(0x7fc3900b1f70 msgr2=0x7fc3900659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:25.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.623+0000 7fc396880640 1 -- 172.21.15.38:0/574675785 shutdown_connections 2023-12-22T08:47:25.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.623+0000 7fc396880640 1 -- 172.21.15.38:0/574675785 wait complete. 2023-12-22T08:47:25.646 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:47:04.687287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:47:06.061571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:47:25.646 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:47:25.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.876+0000 7fe63a5ef640 1 Processor -- start 2023-12-22T08:47:25.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.877+0000 7fe63a5ef640 1 -- start start 2023-12-22T08:47:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.879+0000 7fe63a5ef640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe63415d5a0 0x7fe6340d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.879+0000 7fe63a5ef640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63415de50 con 0x7fe63415d1c0 2023-12-22T08:47:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.879+0000 7fe63a5ef640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6340d0dd0 con 0x7fe634071080 2023-12-22T08:47:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.879+0000 7fe63a5ef640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6340d10b0 con 0x7fe63415d5a0 2023-12-22T08:47:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.879+0000 7fe639dee640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe63415d5a0 0x7fe6340d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.879+0000 7fe6395ed640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe63415d1c0 0x7fe634070970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55398/0 (socket says 172.21.15.38:55398) 2023-12-22T08:47:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.879+0000 7fe639dee640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe63415d5a0 0x7fe6340d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37910/0 (socket says 172.21.15.38:37910) 2023-12-22T08:47:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.879+0000 7fe6395ed640 1 -- 172.21.15.38:0/1850609561 learned_addr learned my addr 172.21.15.38:0/1850609561 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.880+0000 7fe639dee640 1 -- 172.21.15.38:0/1850609561 >> v1:172.21.15.89:6789/0 conn(0x7fe634071080 legacy=0x7fe6340d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:25.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.880+0000 7fe639dee640 1 -- 172.21.15.38:0/1850609561 >> v1:172.21.15.38:6789/0 conn(0x7fe63415d1c0 legacy=0x7fe634070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:25.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.880+0000 7fe639dee640 1 -- 172.21.15.38:0/1850609561 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63415dae0 con 0x7fe63415d5a0 2023-12-22T08:47:25.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.880+0000 7fe62bfff640 1 -- 172.21.15.38:0/1850609561 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386738706 0 0) 0x7fe63415de50 con 0x7fe63415d1c0 2023-12-22T08:47:25.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.881+0000 7fe639dee640 1 --2- 172.21.15.38:0/1850609561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe63415d5a0 0x7fe6340d0770 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0097a0 tx=0x7fe62c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9c231df51ae0b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:25.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.881+0000 7fe62bfff640 1 -- 172.21.15.38:0/1850609561 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c030610 con 0x7fe63415d5a0 2023-12-22T08:47:25.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.881+0000 7fe62bfff640 1 -- 172.21.15.38:0/1850609561 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c030770 con 0x7fe63415d5a0 2023-12-22T08:47:25.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.881+0000 7fe62bfff640 1 -- 172.21.15.38:0/1850609561 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c030b00 con 0x7fe63415d5a0 2023-12-22T08:47:25.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.882+0000 7fe63a5ef640 1 -- 172.21.15.38:0/1850609561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe63415d5a0 msgr2=0x7fe6340d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:25.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.882+0000 7fe63a5ef640 1 --2- 172.21.15.38:0/1850609561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe63415d5a0 0x7fe6340d0770 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0097a0 tx=0x7fe62c02b960 comp rx=0 tx=0).stop 2023-12-22T08:47:25.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.882+0000 7fe63a5ef640 1 -- 172.21.15.38:0/1850609561 shutdown_connections 2023-12-22T08:47:25.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.882+0000 7fe63a5ef640 1 --2- 172.21.15.38:0/1850609561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe63415d5a0 0x7fe6340d0770 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.882+0000 7fe63a5ef640 1 -- 172.21.15.38:0/1850609561 >> 172.21.15.38:0/1850609561 conn(0x7fe63406bf90 msgr2=0x7fe63406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:25.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.882+0000 7fe63a5ef640 1 -- 172.21.15.38:0/1850609561 shutdown_connections 2023-12-22T08:47:25.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.882+0000 7fe63a5ef640 1 -- 172.21.15.38:0/1850609561 wait complete. 2023-12-22T08:47:25.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.884+0000 7fe63a5ef640 1 Processor -- start 2023-12-22T08:47:25.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.884+0000 7fe63a5ef640 1 -- start start 2023-12-22T08:47:25.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.885+0000 7fe63a5ef640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe634071080 0x7fe6340b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:25.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.885+0000 7fe63a5ef640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe63415d1c0 0x7fe634155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:25.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.885+0000 7fe63a5ef640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe63415d5a0 0x7fe6341519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:25.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.885+0000 7fe63a5ef640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340b75b0 con 0x7fe634071080 2023-12-22T08:47:25.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.885+0000 7fe63a5ef640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340b6510 con 0x7fe63415d5a0 2023-12-22T08:47:25.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.885+0000 7fe63a5ef640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340b67f0 con 0x7fe63415d1c0 2023-12-22T08:47:25.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.885+0000 7fe6395ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe634071080 0x7fe6340b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:25.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.885+0000 7fe6395ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe634071080 0x7fe6340b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37924/0 (socket says 172.21.15.38:37924) 2023-12-22T08:47:25.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.885+0000 7fe6395ed640 1 -- 172.21.15.38:0/183402304 learned_addr learned my addr 172.21.15.38:0/183402304 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:25.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.886+0000 7fe639dee640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe63415d5a0 0x7fe6341519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:25.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.886+0000 7fe638dec640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe63415d1c0 0x7fe634155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:25.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.886+0000 7fe6395ed640 1 -- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe63415d1c0 msgr2=0x7fe634155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:25.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.886+0000 7fe6395ed640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe63415d1c0 0x7fe634155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.886+0000 7fe6395ed640 1 -- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe63415d5a0 msgr2=0x7fe6341519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:25.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.886+0000 7fe6395ed640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe63415d5a0 0x7fe6341519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:25.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.886+0000 7fe6395ed640 1 -- 172.21.15.38:0/183402304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c009400 con 0x7fe634071080 2023-12-22T08:47:25.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.886+0000 7fe639dee640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe63415d5a0 0x7fe6341519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:25.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.886+0000 7fe6395ed640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe634071080 0x7fe6340b5c10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fe63000c8c0 tx=0x7fe63000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:25.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.886+0000 7fe629ffb640 1 -- 172.21.15.38:0/183402304 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000a640 con 0x7fe634071080 2023-12-22T08:47:25.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.886+0000 7fe629ffb640 1 -- 172.21.15.38:0/183402304 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63000a7a0 con 0x7fe634071080 2023-12-22T08:47:25.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.886+0000 7fe629ffb640 1 -- 172.21.15.38:0/183402304 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000ab90 con 0x7fe634071080 2023-12-22T08:47:25.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.886+0000 7fe63a5ef640 1 -- 172.21.15.38:0/183402304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6340b6ad0 con 0x7fe634071080 2023-12-22T08:47:25.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.887+0000 7fe63a5ef640 1 -- 172.21.15.38:0/183402304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6340b7090 con 0x7fe634071080 2023-12-22T08:47:25.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.888+0000 7fe63a5ef640 1 -- 172.21.15.38:0/183402304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6340b7280 con 0x7fe634071080 2023-12-22T08:47:25.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.889+0000 7fe629ffb640 1 -- 172.21.15.38:0/183402304 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe63000acf0 con 0x7fe634071080 2023-12-22T08:47:25.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.890+0000 7fe629ffb640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe61806a430 0x7fe61806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:25.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.890+0000 7fe629ffb640 1 -- 172.21.15.38:0/183402304 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe630087f20 con 0x7fe634071080 2023-12-22T08:47:25.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.890+0000 7fe638dec640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe61806a430 0x7fe61806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:25.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.892+0000 7fe638dec640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe61806a430 0x7fe61806c8f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe634154990 tx=0x7fe624009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:25.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:25.894+0000 7fe629ffb640 1 -- 172.21.15.38:0/183402304 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe630053500 con 0x7fe634071080 2023-12-22T08:47:26.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.089+0000 7fe63a5ef640 1 -- 172.21.15.38:0/183402304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe634061910 con 0x7fe634071080 2023-12-22T08:47:26.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.090+0000 7fe629ffb640 1 -- 172.21.15.38:0/183402304 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v130) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe630018020 con 0x7fe634071080 2023-12-22T08:47:26.092 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:47:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.093+0000 7fe63a5ef640 1 -- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe61806a430 msgr2=0x7fe61806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.093+0000 7fe63a5ef640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe61806a430 0x7fe61806c8f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe634154990 tx=0x7fe624009040 comp rx=0 tx=0).stop 2023-12-22T08:47:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.093+0000 7fe63a5ef640 1 -- 172.21.15.38:0/183402304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe634071080 msgr2=0x7fe6340b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.093+0000 7fe63a5ef640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe634071080 0x7fe6340b5c10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fe63000c8c0 tx=0x7fe63000cd80 comp rx=0 tx=0).stop 2023-12-22T08:47:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.093+0000 7fe63a5ef640 1 -- 172.21.15.38:0/183402304 shutdown_connections 2023-12-22T08:47:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.093+0000 7fe63a5ef640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe63415d5a0 0x7fe6341519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.093+0000 7fe63a5ef640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe63415d1c0 0x7fe634155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.093+0000 7fe63a5ef640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe61806a430 0x7fe61806c8f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.093+0000 7fe63a5ef640 1 --2- 172.21.15.38:0/183402304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe634071080 0x7fe6340b5c10 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.093+0000 7fe63a5ef640 1 -- 172.21.15.38:0/183402304 >> 172.21.15.38:0/183402304 conn(0x7fe63406bf90 msgr2=0x7fe6340cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.093+0000 7fe63a5ef640 1 -- 172.21.15.38:0/183402304 shutdown_connections 2023-12-22T08:47:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.093+0000 7fe63a5ef640 1 -- 172.21.15.38:0/183402304 wait complete. 2023-12-22T08:47:26.115 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:47:26.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.353+0000 7f547f0a1640 1 Processor -- start 2023-12-22T08:47:26.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.353+0000 7f547f0a1640 1 -- start start 2023-12-22T08:47:26.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.355+0000 7f547f0a1640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f547815d470 0x7f54780b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:26.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.355+0000 7f547f0a1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5478071ea0 0x7f54780b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:26.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.355+0000 7f547f0a1640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54780ac8e0 con 0x7f547815d850 2023-12-22T08:47:26.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.355+0000 7f547f0a1640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54780ada40 con 0x7f547815d470 2023-12-22T08:47:26.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.355+0000 7f547f0a1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54780b4550 con 0x7f5478071ea0 2023-12-22T08:47:26.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.355+0000 7f547ce3d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f547815d470 0x7f54780b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:26.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.355+0000 7f5477fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f547815d850 0x7f54780ad330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55402/0 (socket says 172.21.15.38:55402) 2023-12-22T08:47:26.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.355+0000 7f5477fff640 1 -- 172.21.15.38:0/3535853355 learned_addr learned my addr 172.21.15.38:0/3535853355 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:26.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.356+0000 7f547d63e640 1 --2- 172.21.15.38:0/3535853355 >> v2:172.21.15.89:3300/0 conn(0x7f5478071ea0 0x7f54780b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:26.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.356+0000 7f547ce3d640 1 -- 172.21.15.38:0/3535853355 >> v2:172.21.15.89:3300/0 conn(0x7f5478071ea0 msgr2=0x7f54780b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:26.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.356+0000 7f547ce3d640 1 --2- 172.21.15.38:0/3535853355 >> v2:172.21.15.89:3300/0 conn(0x7f5478071ea0 0x7f54780b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.356+0000 7f547ce3d640 1 -- 172.21.15.38:0/3535853355 >> v1:172.21.15.38:6789/0 conn(0x7f547815d850 legacy=0x7f54780ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:26.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.356+0000 7f54777fe640 1 -- 172.21.15.38:0/3535853355 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095391995 0 0) 0x7f54780ac8e0 con 0x7f547815d850 2023-12-22T08:47:26.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.356+0000 7f547ce3d640 1 -- 172.21.15.38:0/3535853355 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54780b4940 con 0x7f547815d470 2023-12-22T08:47:26.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.357+0000 7f547ce3d640 1 --2- 172.21.15.38:0/3535853355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f547815d470 0x7f54780b4010 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f5478162250 tx=0x7f546c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4721a83ac8d3ab9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:26.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.357+0000 7f54777fe640 1 -- 172.21.15.38:0/3535853355 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c031830 con 0x7f547815d470 2023-12-22T08:47:26.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.358+0000 7f54777fe640 1 -- 172.21.15.38:0/3535853355 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c031990 con 0x7f547815d470 2023-12-22T08:47:26.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.358+0000 7f54777fe640 1 -- 172.21.15.38:0/3535853355 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c031d20 con 0x7f547815d470 2023-12-22T08:47:26.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.358+0000 7f547f0a1640 1 -- 172.21.15.38:0/3535853355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f547815d470 msgr2=0x7f54780b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:26.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.358+0000 7f547f0a1640 1 --2- 172.21.15.38:0/3535853355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f547815d470 0x7f54780b4010 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f5478162250 tx=0x7f546c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.358+0000 7f547f0a1640 1 -- 172.21.15.38:0/3535853355 shutdown_connections 2023-12-22T08:47:26.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.358+0000 7f547f0a1640 1 --2- 172.21.15.38:0/3535853355 >> v2:172.21.15.89:3300/0 conn(0x7f5478071ea0 0x7f54780b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.358+0000 7f547f0a1640 1 --2- 172.21.15.38:0/3535853355 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f547815d470 0x7f54780b4010 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.358+0000 7f547f0a1640 1 -- 172.21.15.38:0/3535853355 >> 172.21.15.38:0/3535853355 conn(0x7f54780cf070 msgr2=0x7f54780cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:26.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.358+0000 7f547f0a1640 1 -- 172.21.15.38:0/3535853355 shutdown_connections 2023-12-22T08:47:26.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.358+0000 7f547f0a1640 1 -- 172.21.15.38:0/3535853355 wait complete. 2023-12-22T08:47:26.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.360+0000 7f547f0a1640 1 Processor -- start 2023-12-22T08:47:26.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.360+0000 7f547f0a1640 1 -- start start 2023-12-22T08:47:26.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.361+0000 7f547f0a1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5478071ea0 0x7f5478159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:26.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.361+0000 7f547f0a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f547815d470 0x7f54781564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:26.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.361+0000 7f547f0a1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f547815d850 0x7f5478155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:26.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.361+0000 7f547f0a1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54781569f0 con 0x7f547815d850 2023-12-22T08:47:26.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.361+0000 7f547f0a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54781f27f0 con 0x7f547815d470 2023-12-22T08:47:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.361+0000 7f547f0a1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54781f2db0 con 0x7f5478071ea0 2023-12-22T08:47:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.361+0000 7f547d63e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f547815d850 0x7f5478155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.362+0000 7f547d63e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f547815d850 0x7f5478155960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37940/0 (socket says 172.21.15.38:37940) 2023-12-22T08:47:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.362+0000 7f547d63e640 1 -- 172.21.15.38:0/3257180602 learned_addr learned my addr 172.21.15.38:0/3257180602 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.362+0000 7f547ce3d640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5478071ea0 0x7f5478159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.362+0000 7f5477fff640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f547815d470 0x7f54781564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.362+0000 7f547d63e640 1 -- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5478071ea0 msgr2=0x7f5478159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.362+0000 7f547d63e640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5478071ea0 0x7f5478159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.362+0000 7f547d63e640 1 -- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f547815d470 msgr2=0x7f54781564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.362+0000 7f547d63e640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f547815d470 0x7f54781564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.362+0000 7f547d63e640 1 -- 172.21.15.38:0/3257180602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c009400 con 0x7f547815d850 2023-12-22T08:47:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.362+0000 7f5477fff640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f547815d470 0x7f54781564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:26.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.362+0000 7f547d63e640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f547815d850 0x7f5478155960 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f5470007e70 tx=0x7f547000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:26.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.363+0000 7f54757fa640 1 -- 172.21.15.38:0/3257180602 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470014620 con 0x7f547815d850 2023-12-22T08:47:26.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.363+0000 7f54757fa640 1 -- 172.21.15.38:0/3257180602 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54700147a0 con 0x7f547815d850 2023-12-22T08:47:26.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.363+0000 7f54757fa640 1 -- 172.21.15.38:0/3257180602 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470014b50 con 0x7f547815d850 2023-12-22T08:47:26.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.363+0000 7f547f0a1640 1 -- 172.21.15.38:0/3257180602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547815a090 con 0x7f547815d850 2023-12-22T08:47:26.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.363+0000 7f547f0a1640 1 -- 172.21.15.38:0/3257180602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54781f2a40 con 0x7f547815d850 2023-12-22T08:47:26.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.364+0000 7f547f0a1640 1 -- 172.21.15.38:0/3257180602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54781f2f40 con 0x7f547815d850 2023-12-22T08:47:26.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.366+0000 7f54757fa640 1 -- 172.21.15.38:0/3257180602 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5470014cb0 con 0x7f547815d850 2023-12-22T08:47:26.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.366+0000 7f54757fa640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f545c06a430 0x7f545c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:26.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.366+0000 7f54757fa640 1 -- 172.21.15.38:0/3257180602 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5470089310 con 0x7f547815d850 2023-12-22T08:47:26.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.367+0000 7f547ce3d640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f545c06a430 0x7f545c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:26.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.368+0000 7f547ce3d640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f545c06a430 0x7f545c06c8f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f546c036000 tx=0x7f546c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:26.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.372+0000 7f54757fa640 1 -- 172.21.15.38:0/3257180602 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5470054860 con 0x7f547815d850 2023-12-22T08:47:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.562+0000 7f547f0a1640 1 -- 172.21.15.38:0/3257180602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5478061910 con 0x7f547815d850 2023-12-22T08:47:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.563+0000 7f54757fa640 1 -- 172.21.15.38:0/3257180602 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v130) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5470057e80 con 0x7f547815d850 2023-12-22T08:47:26.564 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:47:26.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.567+0000 7f547f0a1640 1 -- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f545c06a430 msgr2=0x7f545c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:26.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.567+0000 7f547f0a1640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f545c06a430 0x7f545c06c8f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f546c036000 tx=0x7f546c008030 comp rx=0 tx=0).stop 2023-12-22T08:47:26.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.567+0000 7f547f0a1640 1 -- 172.21.15.38:0/3257180602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f547815d850 msgr2=0x7f5478155960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:26.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.567+0000 7f547f0a1640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f547815d850 0x7f5478155960 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f5470007e70 tx=0x7f547000e4b0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.567+0000 7f547f0a1640 1 -- 172.21.15.38:0/3257180602 shutdown_connections 2023-12-22T08:47:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.567+0000 7f547f0a1640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f545c06a430 0x7f545c06c8f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.567+0000 7f547f0a1640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f547815d850 0x7f5478155960 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.567+0000 7f547f0a1640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f547815d470 0x7f54781564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.567+0000 7f547f0a1640 1 --2- 172.21.15.38:0/3257180602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5478071ea0 0x7f5478159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.567+0000 7f547f0a1640 1 -- 172.21.15.38:0/3257180602 >> 172.21.15.38:0/3257180602 conn(0x7f54780cf070 msgr2=0x7f5478156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.567+0000 7f547f0a1640 1 -- 172.21.15.38:0/3257180602 shutdown_connections 2023-12-22T08:47:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.567+0000 7f547f0a1640 1 -- 172.21.15.38:0/3257180602 wait complete. 2023-12-22T08:47:26.587 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:47:26.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.815+0000 7f79faf00640 1 Processor -- start 2023-12-22T08:47:26.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.815+0000 7f79faf00640 1 -- start start 2023-12-22T08:47:26.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.817+0000 7f79faf00640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f79f40cb150 0x7f79f415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:26.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.817+0000 7f79faf00640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f79f406f8a0 0x7f79f415d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:26.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.817+0000 7f79faf00640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f40b4180 con 0x7f79f406f4c0 2023-12-22T08:47:26.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.817+0000 7f79faf00640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f415dd40 con 0x7f79f406f8a0 2023-12-22T08:47:26.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.817+0000 7f79faf00640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f406e7f0 con 0x7f79f40cb150 2023-12-22T08:47:26.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.817+0000 7f79f949d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f79f406f8a0 0x7f79f415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:26.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.817+0000 7f79f949d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f79f406f8a0 0x7f79f415d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37942/0 (socket says 172.21.15.38:37942) 2023-12-22T08:47:26.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.817+0000 7f79f949d640 1 -- 172.21.15.38:0/2364920592 learned_addr learned my addr 172.21.15.38:0/2364920592 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:26.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.818+0000 7f79f3fff640 1 --2- 172.21.15.38:0/2364920592 >> v2:172.21.15.89:3300/0 conn(0x7f79f40cb150 0x7f79f415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:26.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.818+0000 7f79f949d640 1 -- 172.21.15.38:0/2364920592 >> v2:172.21.15.89:3300/0 conn(0x7f79f40cb150 msgr2=0x7f79f415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:26.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.818+0000 7f79f949d640 1 --2- 172.21.15.38:0/2364920592 >> v2:172.21.15.89:3300/0 conn(0x7f79f40cb150 0x7f79f415d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.818+0000 7f79f949d640 1 -- 172.21.15.38:0/2364920592 >> v1:172.21.15.38:6789/0 conn(0x7f79f406f4c0 legacy=0x7f79f406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:26.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.818+0000 7f79f949d640 1 -- 172.21.15.38:0/2364920592 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f406df50 con 0x7f79f406f8a0 2023-12-22T08:47:26.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.818+0000 7f79f37fe640 1 -- 172.21.15.38:0/2364920592 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155368972 0 0) 0x7f79f40b4180 con 0x7f79f406f4c0 2023-12-22T08:47:26.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.819+0000 7f79f949d640 1 --2- 172.21.15.38:0/2364920592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f406f8a0 0x7f79f415d800 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f79f40ca6f0 tx=0x7f79ec02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6519952650b93eee server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:26.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.819+0000 7f79f37fe640 1 -- 172.21.15.38:0/2364920592 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec02cbb0 con 0x7f79f406f8a0 2023-12-22T08:47:26.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.819+0000 7f79f37fe640 1 -- 172.21.15.38:0/2364920592 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec02cd10 con 0x7f79f406f8a0 2023-12-22T08:47:26.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.819+0000 7f79f37fe640 1 -- 172.21.15.38:0/2364920592 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec034610 con 0x7f79f406f8a0 2023-12-22T08:47:26.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.820+0000 7f79faf00640 1 -- 172.21.15.38:0/2364920592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f406f8a0 msgr2=0x7f79f415d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:26.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.820+0000 7f79faf00640 1 --2- 172.21.15.38:0/2364920592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f406f8a0 0x7f79f415d800 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f79f40ca6f0 tx=0x7f79ec02c010 comp rx=0 tx=0).stop 2023-12-22T08:47:26.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.820+0000 7f79faf00640 1 -- 172.21.15.38:0/2364920592 shutdown_connections 2023-12-22T08:47:26.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.820+0000 7f79faf00640 1 --2- 172.21.15.38:0/2364920592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f406f8a0 0x7f79f415d800 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.820+0000 7f79faf00640 1 --2- 172.21.15.38:0/2364920592 >> v2:172.21.15.89:3300/0 conn(0x7f79f40cb150 0x7f79f415d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.820+0000 7f79faf00640 1 -- 172.21.15.38:0/2364920592 >> 172.21.15.38:0/2364920592 conn(0x7f79f4070360 msgr2=0x7f79f4070740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:26.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.820+0000 7f79faf00640 1 -- 172.21.15.38:0/2364920592 shutdown_connections 2023-12-22T08:47:26.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.820+0000 7f79faf00640 1 -- 172.21.15.38:0/2364920592 wait complete. 2023-12-22T08:47:26.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.822+0000 7f79faf00640 1 Processor -- start 2023-12-22T08:47:26.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.822+0000 7f79faf00640 1 -- start start 2023-12-22T08:47:26.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.823+0000 7f79faf00640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79f406f4c0 0x7f79f4152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:26.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.823+0000 7f79faf00640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79f406f8a0 0x7f79f415de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:26.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.823+0000 7f79faf00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f40cb150 0x7f79f415e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:26.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.823+0000 7f79faf00640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f4160900 con 0x7f79f40cb150 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.823+0000 7f79faf00640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f415f3a0 con 0x7f79f406f4c0 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.823+0000 7f79faf00640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f4153910 con 0x7f79f406f8a0 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.823+0000 7f79f949d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f40cb150 0x7f79f415e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.823+0000 7f79f949d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f40cb150 0x7f79f415e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37956/0 (socket says 172.21.15.38:37956) 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.823+0000 7f79f949d640 1 -- 172.21.15.38:0/2803226818 learned_addr learned my addr 172.21.15.38:0/2803226818 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.824+0000 7f79f8c9c640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79f406f4c0 0x7f79f4152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.824+0000 7f79f3fff640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79f406f8a0 0x7f79f415de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.824+0000 7f79f949d640 1 -- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79f406f8a0 msgr2=0x7f79f415de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.824+0000 7f79f949d640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79f406f8a0 0x7f79f415de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.824+0000 7f79f949d640 1 -- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79f406f4c0 msgr2=0x7f79f4152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.824+0000 7f79f949d640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79f406f4c0 0x7f79f4152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.824+0000 7f79f949d640 1 -- 172.21.15.38:0/2803226818 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec009b30 con 0x7f79f40cb150 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.824+0000 7f79f949d640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f40cb150 0x7f79f415e3c0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009f40 tx=0x7f79ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.824+0000 7f79f17fa640 1 -- 172.21.15.38:0/2803226818 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec009510 con 0x7f79f40cb150 2023-12-22T08:47:26.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.824+0000 7f79f17fa640 1 -- 172.21.15.38:0/2803226818 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec03e450 con 0x7f79f40cb150 2023-12-22T08:47:26.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.824+0000 7f79f17fa640 1 -- 172.21.15.38:0/2803226818 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec03e800 con 0x7f79f40cb150 2023-12-22T08:47:26.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.824+0000 7f79faf00640 1 -- 172.21.15.38:0/2803226818 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f415fc80 con 0x7f79f40cb150 2023-12-22T08:47:26.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.825+0000 7f79faf00640 1 -- 172.21.15.38:0/2803226818 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f4160240 con 0x7f79f40cb150 2023-12-22T08:47:26.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.826+0000 7f79faf00640 1 -- 172.21.15.38:0/2803226818 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f4160a40 con 0x7f79f40cb150 2023-12-22T08:47:26.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.826+0000 7f79f17fa640 1 -- 172.21.15.38:0/2803226818 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f79ec03e960 con 0x7f79f40cb150 2023-12-22T08:47:26.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.829+0000 7f79f17fa640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f79d806a430 0x7f79d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:26.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.829+0000 7f79f17fa640 1 -- 172.21.15.38:0/2803226818 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79ec0ab720 con 0x7f79f40cb150 2023-12-22T08:47:26.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.830+0000 7f79f8c9c640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f79d806a430 0x7f79d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:26.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.831+0000 7f79f8c9c640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f79d806a430 0x7f79d806c8f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f79e8000f60 tx=0x7f79e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:26.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:26.833+0000 7f79f17fa640 1 -- 172.21.15.38:0/2803226818 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f79f4160a40 con 0x7f79f40cb150 2023-12-22T08:47:27.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.027+0000 7f79faf00640 1 -- 172.21.15.38:0/2803226818 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79f4160a40 con 0x7f79f40cb150 2023-12-22T08:47:27.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.028+0000 7f79f17fa640 1 -- 172.21.15.38:0/2803226818 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v130) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79f4160a40 con 0x7f79f40cb150 2023-12-22T08:47:27.029 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:47:27.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.031+0000 7f79faf00640 1 -- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f79d806a430 msgr2=0x7f79d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:27.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.031+0000 7f79faf00640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f79d806a430 0x7f79d806c8f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f79e8000f60 tx=0x7f79e8009040 comp rx=0 tx=0).stop 2023-12-22T08:47:27.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.031+0000 7f79faf00640 1 -- 172.21.15.38:0/2803226818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f40cb150 msgr2=0x7f79f415e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:27.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.031+0000 7f79faf00640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f40cb150 0x7f79f415e3c0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009f40 tx=0x7f79ec004a40 comp rx=0 tx=0).stop 2023-12-22T08:47:27.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.031+0000 7f79faf00640 1 -- 172.21.15.38:0/2803226818 shutdown_connections 2023-12-22T08:47:27.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.031+0000 7f79faf00640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f79d806a430 0x7f79d806c8f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.031+0000 7f79faf00640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79f40cb150 0x7f79f415e3c0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.031+0000 7f79faf00640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79f406f8a0 0x7f79f415de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.031+0000 7f79faf00640 1 --2- 172.21.15.38:0/2803226818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79f406f4c0 0x7f79f4152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.031+0000 7f79faf00640 1 -- 172.21.15.38:0/2803226818 >> 172.21.15.38:0/2803226818 conn(0x7f79f4070360 msgr2=0x7f79f40c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.032+0000 7f79faf00640 1 -- 172.21.15.38:0/2803226818 shutdown_connections 2023-12-22T08:47:27.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.032+0000 7f79faf00640 1 -- 172.21.15.38:0/2803226818 wait complete. 2023-12-22T08:47:27.053 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:47:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.273+0000 7f4902b58640 1 Processor -- start 2023-12-22T08:47:27.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.273+0000 7f4902b58640 1 -- start start 2023-12-22T08:47:27.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.275+0000 7f4902b58640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48fc146be0 0x7f48fc0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:27.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.275+0000 7f4902b58640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48fc15eac0 con 0x7f48fc146fc0 2023-12-22T08:47:27.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.275+0000 7f4902b58640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48fc162200 con 0x7f48fc15e6c0 2023-12-22T08:47:27.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.275+0000 7f4902b58640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48fc15ed10 con 0x7f48fc146be0 2023-12-22T08:47:27.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.275+0000 7f48fbfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f48fc146fc0 0x7f48fc15dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55418/0 (socket says 172.21.15.38:55418) 2023-12-22T08:47:27.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.275+0000 7f48fbfff640 1 -- 172.21.15.38:0/693947556 learned_addr learned my addr 172.21.15.38:0/693947556 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:27.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.276+0000 7f49008f4640 1 --2- 172.21.15.38:0/693947556 >> v2:172.21.15.89:3300/0 conn(0x7f48fc146be0 0x7f48fc0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:27.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.276+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774800226 0 0) 0x7f48fc15eac0 con 0x7f48fc146fc0 2023-12-22T08:47:27.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.276+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e4003520 con 0x7f48fc146fc0 2023-12-22T08:47:27.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.276+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3409834929 0 0) 0x7f48e4003520 con 0x7f48fc146fc0 2023-12-22T08:47:27.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.276+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 >> v2:172.21.15.89:3300/0 conn(0x7f48fc146be0 msgr2=0x7f48fc0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:27.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.276+0000 7f48fb7fe640 1 --2- 172.21.15.38:0/693947556 >> v2:172.21.15.89:3300/0 conn(0x7f48fc146be0 0x7f48fc0d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.276+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 >> v1:172.21.15.89:6789/0 conn(0x7f48fc15e6c0 legacy=0x7f48fc15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:27.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.276+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc161440 con 0x7f48fc146fc0 2023-12-22T08:47:27.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.276+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f48f0001670 con 0x7f48fc146fc0 2023-12-22T08:47:27.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.276+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 >> v1:172.21.15.38:6789/0 conn(0x7f48fc146fc0 legacy=0x7f48fc15dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:27.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.276+0000 7f48fb7fe640 1 --2- 172.21.15.38:0/693947556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48e4003970 0x7f48e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:27.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.276+0000 7f48fb7fe640 1 --2- 172.21.15.38:0/693947556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48e40047c0 0x7f48e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:27.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.276+0000 7f48fb7fe640 1 --2- 172.21.15.38:0/693947556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48e4005180 0x7f48e400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:27.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.277+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc15ed10 con 0x7f48e40047c0 2023-12-22T08:47:27.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.277+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e400c020 con 0x7f48e4003970 2023-12-22T08:47:27.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.277+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e400c1e0 con 0x7f48e4005180 2023-12-22T08:47:27.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.277+0000 7f48fbfff640 1 --2- 172.21.15.38:0/693947556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48e40047c0 0x7f48e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:27.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.277+0000 7f49008f4640 1 --2- 172.21.15.38:0/693947556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48e4003970 0x7f48e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:27.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.277+0000 7f48fbfff640 1 -- 172.21.15.38:0/693947556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48e4005180 msgr2=0x7f48e400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:27.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.277+0000 7f49010f5640 1 --2- 172.21.15.38:0/693947556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48e4005180 0x7f48e400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:27.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.277+0000 7f48fbfff640 1 --2- 172.21.15.38:0/693947556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48e4005180 0x7f48e400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.277+0000 7f48fbfff640 1 -- 172.21.15.38:0/693947556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48e4003970 msgr2=0x7f48e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:27.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.277+0000 7f48fbfff640 1 --2- 172.21.15.38:0/693947556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48e4003970 0x7f48e4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.277+0000 7f48fbfff640 1 -- 172.21.15.38:0/693947556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e4003520 con 0x7f48e40047c0 2023-12-22T08:47:27.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.277+0000 7f49008f4640 1 --2- 172.21.15.38:0/693947556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48e4003970 0x7f48e4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:47:27.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.277+0000 7f49010f5640 1 -- 172.21.15.38:0/693947556 reap_dead start 2023-12-22T08:47:27.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.279+0000 7f48fbfff640 1 --2- 172.21.15.38:0/693947556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48e40047c0 0x7f48e4004c40 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f48f000c240 tx=0x7f48e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533c69007932f79f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:27.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.279+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f0005ad0 con 0x7f48e40047c0 2023-12-22T08:47:27.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.279+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f0005c30 con 0x7f48e40047c0 2023-12-22T08:47:27.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.279+0000 7f48fb7fe640 1 -- 172.21.15.38:0/693947556 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f002caf0 con 0x7f48e40047c0 2023-12-22T08:47:27.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.279+0000 7f4902b58640 1 -- 172.21.15.38:0/693947556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48e40047c0 msgr2=0x7f48e4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:27.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.279+0000 7f4902b58640 1 --2- 172.21.15.38:0/693947556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48e40047c0 0x7f48e4004c40 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f48f000c240 tx=0x7f48e40057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.279+0000 7f4902b58640 1 -- 172.21.15.38:0/693947556 shutdown_connections 2023-12-22T08:47:27.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.279+0000 7f4902b58640 1 --2- 172.21.15.38:0/693947556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48e40047c0 0x7f48e4004c40 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.279+0000 7f4902b58640 1 -- 172.21.15.38:0/693947556 >> 172.21.15.38:0/693947556 conn(0x7f48fc06c5e0 msgr2=0x7f48fc06c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:27.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.280+0000 7f4902b58640 1 -- 172.21.15.38:0/693947556 shutdown_connections 2023-12-22T08:47:27.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.280+0000 7f4902b58640 1 -- 172.21.15.38:0/693947556 wait complete. 2023-12-22T08:47:27.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.281+0000 7f4902b58640 1 Processor -- start 2023-12-22T08:47:27.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.282+0000 7f4902b58640 1 -- start start 2023-12-22T08:47:27.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.282+0000 7f4902b58640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48e40047c0 0x7f48fc15f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:27.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f4902b58640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48fc0b7330 0x7f48fc0b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:27.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f4902b58640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48fc143e90 0x7f48fc144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:27.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f4902b58640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0b6290 con 0x7f48e40047c0 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f4902b58640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0b6570 con 0x7f48fc143e90 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f4902b58640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0b6850 con 0x7f48fc0b7330 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f49008f4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48e40047c0 0x7f48fc15f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f49008f4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48e40047c0 0x7f48fc15f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37972/0 (socket says 172.21.15.38:37972) 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f49008f4640 1 -- 172.21.15.38:0/1846426320 learned_addr learned my addr 172.21.15.38:0/1846426320 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f48fbfff640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48fc0b7330 0x7f48fc0b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f49010f5640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48fc143e90 0x7f48fc144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f49008f4640 1 -- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48fc0b7330 msgr2=0x7f48fc0b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f49008f4640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48fc0b7330 0x7f48fc0b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f49008f4640 1 -- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48fc143e90 msgr2=0x7f48fc144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f49008f4640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48fc143e90 0x7f48fc144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f49008f4640 1 -- 172.21.15.38:0/1846426320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0b6b30 con 0x7f48e40047c0 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.283+0000 7f48fbfff640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48fc0b7330 0x7f48fc0b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:27.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.284+0000 7f49008f4640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48e40047c0 0x7f48fc15f150 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009f90 tx=0x7f48ec010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:27.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.284+0000 7f48f97fa640 1 -- 172.21.15.38:0/1846426320 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec00e050 con 0x7f48e40047c0 2023-12-22T08:47:27.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.284+0000 7f48f97fa640 1 -- 172.21.15.38:0/1846426320 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec00f040 con 0x7f48e40047c0 2023-12-22T08:47:27.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.284+0000 7f48f97fa640 1 -- 172.21.15.38:0/1846426320 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec003bb0 con 0x7f48e40047c0 2023-12-22T08:47:27.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.284+0000 7f4902b58640 1 -- 172.21.15.38:0/1846426320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48fc0b6e10 con 0x7f48e40047c0 2023-12-22T08:47:27.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.284+0000 7f4902b58640 1 -- 172.21.15.38:0/1846426320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48fc144d00 con 0x7f48e40047c0 2023-12-22T08:47:27.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.285+0000 7f4902b58640 1 -- 172.21.15.38:0/1846426320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48fc061910 con 0x7f48e40047c0 2023-12-22T08:47:27.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.286+0000 7f48f97fa640 1 -- 172.21.15.38:0/1846426320 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f48ec003d10 con 0x7f48e40047c0 2023-12-22T08:47:27.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.287+0000 7f48f97fa640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f48e806a430 0x7f48e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:27.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.287+0000 7f48f97fa640 1 -- 172.21.15.38:0/1846426320 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48ec0897d0 con 0x7f48e40047c0 2023-12-22T08:47:27.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.288+0000 7f48fbfff640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f48e806a430 0x7f48e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:27.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.289+0000 7f48fbfff640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f48e806a430 0x7f48e806c8f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f48f0034000 tx=0x7f48f0009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:27.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.291+0000 7f48f97fa640 1 -- 172.21.15.38:0/1846426320 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f48ec054c90 con 0x7f48e40047c0 2023-12-22T08:47:27.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.495+0000 7f4902b58640 1 -- 172.21.15.38:0/1846426320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f48fc06bbc0 con 0x7f48e40047c0 2023-12-22T08:47:27.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.496+0000 7f48f97fa640 1 -- 172.21.15.38:0/1846426320 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v130) v1 ==== 80+0+0 (secure 0 0 0) 0x7f48ec0582b0 con 0x7f48e40047c0 2023-12-22T08:47:27.496 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:47:27.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.498+0000 7f4902b58640 1 -- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f48e806a430 msgr2=0x7f48e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:27.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.498+0000 7f4902b58640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f48e806a430 0x7f48e806c8f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f48f0034000 tx=0x7f48f0009030 comp rx=0 tx=0).stop 2023-12-22T08:47:27.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.498+0000 7f4902b58640 1 -- 172.21.15.38:0/1846426320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48e40047c0 msgr2=0x7f48fc15f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:27.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.498+0000 7f4902b58640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48e40047c0 0x7f48fc15f150 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009f90 tx=0x7f48ec010590 comp rx=0 tx=0).stop 2023-12-22T08:47:27.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.498+0000 7f4902b58640 1 -- 172.21.15.38:0/1846426320 shutdown_connections 2023-12-22T08:47:27.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.498+0000 7f4902b58640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48fc143e90 0x7f48fc144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.498+0000 7f4902b58640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48fc0b7330 0x7f48fc0b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.498+0000 7f4902b58640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f48e806a430 0x7f48e806c8f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.498+0000 7f4902b58640 1 --2- 172.21.15.38:0/1846426320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48e40047c0 0x7f48fc15f150 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:27.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.498+0000 7f4902b58640 1 -- 172.21.15.38:0/1846426320 >> 172.21.15.38:0/1846426320 conn(0x7f48fc06c5e0 msgr2=0x7f48fc06c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:27.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.499+0000 7f4902b58640 1 -- 172.21.15.38:0/1846426320 shutdown_connections 2023-12-22T08:47:27.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:27.499+0000 7f4902b58640 1 -- 172.21.15.38:0/1846426320 wait complete. 2023-12-22T08:47:27.516 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T08:47:27.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:27.516 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-22T08:47:27.632 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:47:27.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:27.632 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T08:47:27.680 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:47:27.681 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:27.722 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:47:27.723 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:27.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:28.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.041+0000 7f6dfdb01640 1 Processor -- start 2023-12-22T08:47:28.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.041+0000 7f6dfdb01640 1 -- start start 2023-12-22T08:47:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.043+0000 7f6dfdb01640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6df806d210 0x7f6df815e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.043+0000 7f6dfdb01640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df80706d0 con 0x7f6df806d5f0 2023-12-22T08:47:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.043+0000 7f6dfdb01640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df80cbf40 con 0x7f6df80cb4c0 2023-12-22T08:47:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.043+0000 7f6dfdb01640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df80ce840 con 0x7f6df806d210 2023-12-22T08:47:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.043+0000 7f6dfd300640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6df806d5f0 0x7f6df8070b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55432/0 (socket says 172.21.15.38:55432) 2023-12-22T08:47:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.043+0000 7f6dfd300640 1 -- 172.21.15.38:0/4282778735 learned_addr learned my addr 172.21.15.38:0/4282778735 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.043+0000 7f6dfcaff640 1 --2- 172.21.15.38:0/4282778735 >> v2:172.21.15.89:3300/0 conn(0x7f6df806d210 0x7f6df815e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.043+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157841285 0 0) 0x7f6df80706d0 con 0x7f6df806d5f0 2023-12-22T08:47:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.043+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6de8003520 con 0x7f6df806d5f0 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3790663533 0 0) 0x7f6de8003520 con 0x7f6df806d5f0 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 >> v2:172.21.15.89:3300/0 conn(0x7f6df806d210 msgr2=0x7f6df815e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df77fe640 1 --2- 172.21.15.38:0/4282778735 >> v2:172.21.15.89:3300/0 conn(0x7f6df806d210 0x7f6df815e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 >> v1:172.21.15.89:6789/0 conn(0x7f6df80cb4c0 legacy=0x7f6df8159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df80ceb20 con 0x7f6df806d5f0 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f6df00019f0 con 0x7f6df806d5f0 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 >> v1:172.21.15.38:6789/0 conn(0x7f6df806d5f0 legacy=0x7f6df8070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df77fe640 1 --2- 172.21.15.38:0/4282778735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de80039c0 0x7f6de8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df77fe640 1 --2- 172.21.15.38:0/4282778735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6de80047c0 0x7f6de8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df77fe640 1 --2- 172.21.15.38:0/4282778735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6de80051d0 0x7f6de800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df80ce840 con 0x7f6de80039c0 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de800e330 con 0x7f6de80047c0 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de800e4f0 con 0x7f6de80051d0 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6dfcaff640 1 --2- 172.21.15.38:0/4282778735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de80039c0 0x7f6de8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.044+0000 7f6df7fff640 1 --2- 172.21.15.38:0/4282778735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6de80047c0 0x7f6de8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.045+0000 7f6dfcaff640 1 -- 172.21.15.38:0/4282778735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6de80051d0 msgr2=0x7f6de800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:28.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.045+0000 7f6dfcaff640 1 --2- 172.21.15.38:0/4282778735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6de80051d0 0x7f6de800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.045+0000 7f6dfcaff640 1 -- 172.21.15.38:0/4282778735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6de80047c0 msgr2=0x7f6de8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:28.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.045+0000 7f6dfcaff640 1 --2- 172.21.15.38:0/4282778735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6de80047c0 0x7f6de8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.045+0000 7f6dfcaff640 1 -- 172.21.15.38:0/4282778735 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de8003520 con 0x7f6de80039c0 2023-12-22T08:47:28.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.045+0000 7f6dfd300640 1 -- 172.21.15.38:0/4282778735 reap_dead start 2023-12-22T08:47:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.046+0000 7f6dfcaff640 1 --2- 172.21.15.38:0/4282778735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de80039c0 0x7f6de8003de0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00ba30 tx=0x7f6de80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965cbe256c1e8d1e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.046+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec032630 con 0x7f6de80039c0 2023-12-22T08:47:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.046+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec032790 con 0x7f6de80039c0 2023-12-22T08:47:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.046+0000 7f6df77fe640 1 -- 172.21.15.38:0/4282778735 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec032b20 con 0x7f6de80039c0 2023-12-22T08:47:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.046+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4282778735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de80039c0 msgr2=0x7f6de8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.046+0000 7f6dfdb01640 1 --2- 172.21.15.38:0/4282778735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de80039c0 0x7f6de8003de0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00ba30 tx=0x7f6de80057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.047+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4282778735 shutdown_connections 2023-12-22T08:47:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.047+0000 7f6dfdb01640 1 --2- 172.21.15.38:0/4282778735 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de80039c0 0x7f6de8003de0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.047+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4282778735 >> 172.21.15.38:0/4282778735 conn(0x7f6df80b1f70 msgr2=0x7f6df80b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.047+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4282778735 shutdown_connections 2023-12-22T08:47:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.047+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4282778735 wait complete. 2023-12-22T08:47:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.048+0000 7f6dfdb01640 1 Processor -- start 2023-12-22T08:47:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.049+0000 7f6dfdb01640 1 -- start start 2023-12-22T08:47:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfdb01640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6de80039c0 0x7f6df8151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfdb01640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6df8157ef0 0x7f6df81511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfdb01640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6df80cc100 0x7f6df80cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfdb01640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df8152ed0 con 0x7f6df80cc100 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfdb01640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df80ccaf0 con 0x7f6de80039c0 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfdb01640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df806fde0 con 0x7f6df8157ef0 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfd300640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6df80cc100 0x7f6df80cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfd300640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6df80cc100 0x7f6df80cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37984/0 (socket says 172.21.15.38:37984) 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfd300640 1 -- 172.21.15.38:0/4138824927 learned_addr learned my addr 172.21.15.38:0/4138824927 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfcaff640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6de80039c0 0x7f6df8151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfd300640 1 -- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6df8157ef0 msgr2=0x7f6df81511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6df7fff640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6df8157ef0 0x7f6df81511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfd300640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6df8157ef0 0x7f6df81511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfd300640 1 -- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6de80039c0 msgr2=0x7f6df8151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfd300640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6de80039c0 0x7f6df8151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.050+0000 7f6dfd300640 1 -- 172.21.15.38:0/4138824927 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df8152250 con 0x7f6df80cc100 2023-12-22T08:47:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.051+0000 7f6dfd300640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6df80cc100 0x7f6df80cc5b0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f6df0001370 tx=0x7f6df000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.051+0000 7f6df57fa640 1 -- 172.21.15.38:0/4138824927 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df000ce70 con 0x7f6df80cc100 2023-12-22T08:47:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.051+0000 7f6df57fa640 1 -- 172.21.15.38:0/4138824927 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df000a610 con 0x7f6df80cc100 2023-12-22T08:47:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.051+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4138824927 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df8152530 con 0x7f6df80cc100 2023-12-22T08:47:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.051+0000 7f6df57fa640 1 -- 172.21.15.38:0/4138824927 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df000a9a0 con 0x7f6df80cc100 2023-12-22T08:47:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.051+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4138824927 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df8152af0 con 0x7f6df80cc100 2023-12-22T08:47:28.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.052+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4138824927 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df8153010 con 0x7f6df80cc100 2023-12-22T08:47:28.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.053+0000 7f6df57fa640 1 -- 172.21.15.38:0/4138824927 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6df000ab00 con 0x7f6df80cc100 2023-12-22T08:47:28.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.054+0000 7f6df57fa640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ddc06a460 0x7f6ddc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.054+0000 7f6df57fa640 1 -- 172.21.15.38:0/4138824927 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6df0087ff0 con 0x7f6df80cc100 2023-12-22T08:47:28.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.055+0000 7f6dfcaff640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ddc06a460 0x7f6ddc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.056+0000 7f6dfcaff640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ddc06a460 0x7f6ddc06c920 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00ba00 tx=0x7f6dec03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:28.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.058+0000 7f6df57fa640 1 -- 172.21.15.38:0/4138824927 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6df8153010 con 0x7f6df80cc100 2023-12-22T08:47:28.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.244+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4138824927 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6df8153010 con 0x7f6df80cc100 2023-12-22T08:47:28.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.246+0000 7f6df57fa640 1 -- 172.21.15.38:0/4138824927 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16011 (secure 0 0 0) 0x7f6df8153010 con 0x7f6df80cc100 2023-12-22T08:47:28.246 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:28.246 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":130,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:22.301110+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:04.687287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:06.061571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.248+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ddc06a460 msgr2=0x7f6ddc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.248+0000 7f6dfdb01640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ddc06a460 0x7f6ddc06c920 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00ba00 tx=0x7f6dec03d040 comp rx=0 tx=0).stop 2023-12-22T08:47:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.248+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4138824927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6df80cc100 msgr2=0x7f6df80cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.248+0000 7f6dfdb01640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6df80cc100 0x7f6df80cc5b0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f6df0001370 tx=0x7f6df000cc20 comp rx=0 tx=0).stop 2023-12-22T08:47:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.248+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4138824927 shutdown_connections 2023-12-22T08:47:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.248+0000 7f6dfdb01640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ddc06a460 0x7f6ddc06c920 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.248+0000 7f6dfdb01640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6df80cc100 0x7f6df80cc5b0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.248+0000 7f6dfdb01640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6df8157ef0 0x7f6df81511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.248+0000 7f6dfdb01640 1 --2- 172.21.15.38:0/4138824927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6de80039c0 0x7f6df8151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.248+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4138824927 >> 172.21.15.38:0/4138824927 conn(0x7f6df80b1f70 msgr2=0x7f6df80cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:28.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.248+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4138824927 shutdown_connections 2023-12-22T08:47:28.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.249+0000 7f6dfdb01640 1 -- 172.21.15.38:0/4138824927 wait complete. 2023-12-22T08:47:28.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:47:04.687287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:47:06.061571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:47:28.267 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:47:28.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.490+0000 7f0a90930640 1 Processor -- start 2023-12-22T08:47:28.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.491+0000 7f0a90930640 1 -- start start 2023-12-22T08:47:28.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.492+0000 7f0a90930640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a8c1508e0 0x7f0a8c071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.492+0000 7f0a90930640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0a8c0ae600 0x7f0a8c071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.492+0000 7f0a90930640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c15ac10 con 0x7f0a8c06c820 2023-12-22T08:47:28.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.492+0000 7f0a90930640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c15a000 con 0x7f0a8c1508e0 2023-12-22T08:47:28.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.492+0000 7f0a90930640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c15a2e0 con 0x7f0a8c0ae600 2023-12-22T08:47:28.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.493+0000 7f0a8b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a8c1508e0 0x7f0a8c071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.493+0000 7f0a8b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0a8c1508e0 0x7f0a8c071a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37996/0 (socket says 172.21.15.38:37996) 2023-12-22T08:47:28.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.493+0000 7f0a8b7fe640 1 -- 172.21.15.38:0/4270038919 learned_addr learned my addr 172.21.15.38:0/4270038919 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:28.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.493+0000 7f0a8b7fe640 1 -- 172.21.15.38:0/4270038919 >> v2:172.21.15.89:3300/0 conn(0x7f0a8c0ae600 msgr2=0x7f0a8c071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:28.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.493+0000 7f0a8b7fe640 1 --2- 172.21.15.38:0/4270038919 >> v2:172.21.15.89:3300/0 conn(0x7f0a8c0ae600 0x7f0a8c071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.493+0000 7f0a8b7fe640 1 -- 172.21.15.38:0/4270038919 >> v1:172.21.15.89:6789/0 conn(0x7f0a8c06c820 legacy=0x7f0a8c0adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:28.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.493+0000 7f0a8b7fe640 1 -- 172.21.15.38:0/4270038919 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c15a5c0 con 0x7f0a8c1508e0 2023-12-22T08:47:28.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.494+0000 7f0a8b7fe640 1 --2- 172.21.15.38:0/4270038919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a8c1508e0 0x7f0a8c071a20 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c04e2b0 tx=0x7f0a7c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb2607c5cf30d62 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:28.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.495+0000 7f0a8affd640 1 -- 172.21.15.38:0/4270038919 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0317e0 con 0x7f0a8c1508e0 2023-12-22T08:47:28.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.495+0000 7f0a8affd640 1 -- 172.21.15.38:0/4270038919 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c031940 con 0x7f0a8c1508e0 2023-12-22T08:47:28.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.495+0000 7f0a8affd640 1 -- 172.21.15.38:0/4270038919 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c031cd0 con 0x7f0a8c1508e0 2023-12-22T08:47:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.495+0000 7f0a90930640 1 -- 172.21.15.38:0/4270038919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a8c1508e0 msgr2=0x7f0a8c071a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.495+0000 7f0a90930640 1 --2- 172.21.15.38:0/4270038919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a8c1508e0 0x7f0a8c071a20 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c04e2b0 tx=0x7f0a7c02b880 comp rx=0 tx=0).stop 2023-12-22T08:47:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.495+0000 7f0a90930640 1 -- 172.21.15.38:0/4270038919 shutdown_connections 2023-12-22T08:47:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.495+0000 7f0a90930640 1 --2- 172.21.15.38:0/4270038919 >> v2:172.21.15.89:3300/0 conn(0x7f0a8c0ae600 0x7f0a8c071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.495+0000 7f0a90930640 1 --2- 172.21.15.38:0/4270038919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a8c1508e0 0x7f0a8c071a20 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.495+0000 7f0a90930640 1 -- 172.21.15.38:0/4270038919 >> 172.21.15.38:0/4270038919 conn(0x7f0a8c0b0b60 msgr2=0x7f0a8c0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:28.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.496+0000 7f0a90930640 1 -- 172.21.15.38:0/4270038919 shutdown_connections 2023-12-22T08:47:28.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.496+0000 7f0a90930640 1 -- 172.21.15.38:0/4270038919 wait complete. 2023-12-22T08:47:28.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.497+0000 7f0a90930640 1 Processor -- start 2023-12-22T08:47:28.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.498+0000 7f0a90930640 1 -- start start 2023-12-22T08:47:28.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.498+0000 7f0a90930640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a8c06c820 0x7f0a8c139930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.498+0000 7f0a90930640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a8c0ae600 0x7f0a8c0cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a90930640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a8c1508e0 0x7f0a8c15d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a90930640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0cc740 con 0x7f0a8c06c820 2023-12-22T08:47:28.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a90930640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c139e70 con 0x7f0a8c1508e0 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a90930640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0cd780 con 0x7f0a8c0ae600 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a8c06c820 0x7f0a8c139930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a8c06c820 0x7f0a8c139930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38012/0 (socket says 172.21.15.38:38012) 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a8b7fe640 1 -- 172.21.15.38:0/4052493066 learned_addr learned my addr 172.21.15.38:0/4052493066 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a8b7fe640 1 -- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a8c0ae600 msgr2=0x7f0a8c0cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a8bfff640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a8c1508e0 0x7f0a8c15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a83fff640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a8c0ae600 0x7f0a8c0cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a8b7fe640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a8c0ae600 0x7f0a8c0cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a8b7fe640 1 -- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a8c1508e0 msgr2=0x7f0a8c15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a8b7fe640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a8c1508e0 0x7f0a8c15d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a8b7fe640 1 -- 172.21.15.38:0/4052493066 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c0094d0 con 0x7f0a8c06c820 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a83fff640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a8c0ae600 0x7f0a8c0cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.499+0000 7f0a8bfff640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a8c1508e0 0x7f0a8c15d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.500+0000 7f0a8b7fe640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a8c06c820 0x7f0a8c139930 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c000c00 tx=0x7f0a7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.500+0000 7f0a88ff9640 1 -- 172.21.15.38:0/4052493066 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c032940 con 0x7f0a8c06c820 2023-12-22T08:47:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.500+0000 7f0a88ff9640 1 -- 172.21.15.38:0/4052493066 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c032aa0 con 0x7f0a8c06c820 2023-12-22T08:47:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.500+0000 7f0a88ff9640 1 -- 172.21.15.38:0/4052493066 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c032e50 con 0x7f0a8c06c820 2023-12-22T08:47:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.500+0000 7f0a90930640 1 -- 172.21.15.38:0/4052493066 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c0cbb30 con 0x7f0a8c06c820 2023-12-22T08:47:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.500+0000 7f0a90930640 1 -- 172.21.15.38:0/4052493066 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c0cc0f0 con 0x7f0a8c06c820 2023-12-22T08:47:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.501+0000 7f0a90930640 1 -- 172.21.15.38:0/4052493066 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c061910 con 0x7f0a8c06c820 2023-12-22T08:47:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.502+0000 7f0a88ff9640 1 -- 172.21.15.38:0/4052493066 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0a7c0453f0 con 0x7f0a8c06c820 2023-12-22T08:47:28.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.503+0000 7f0a88ff9640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a6c06a430 0x7f0a6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.503+0000 7f0a88ff9640 1 -- 172.21.15.38:0/4052493066 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a7c0aabf0 con 0x7f0a8c06c820 2023-12-22T08:47:28.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.504+0000 7f0a83fff640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a6c06a430 0x7f0a6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.505+0000 7f0a83fff640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a6c06a430 0x7f0a6c06c8f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0a74007fd0 tx=0x7f0a74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:28.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.507+0000 7f0a88ff9640 1 -- 172.21.15.38:0/4052493066 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0a7c076260 con 0x7f0a8c06c820 2023-12-22T08:47:28.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.694+0000 7f0a90930640 1 -- 172.21.15.38:0/4052493066 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a8c15a870 con 0x7f0a8c06c820 2023-12-22T08:47:28.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.695+0000 7f0a88ff9640 1 -- 172.21.15.38:0/4052493066 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v130) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a7c079880 con 0x7f0a8c06c820 2023-12-22T08:47:28.695 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:47:28.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.698+0000 7f0a90930640 1 -- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a6c06a430 msgr2=0x7f0a6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.698+0000 7f0a90930640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a6c06a430 0x7f0a6c06c8f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0a74007fd0 tx=0x7f0a74009040 comp rx=0 tx=0).stop 2023-12-22T08:47:28.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.698+0000 7f0a90930640 1 -- 172.21.15.38:0/4052493066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a8c06c820 msgr2=0x7f0a8c139930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.698+0000 7f0a90930640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a8c06c820 0x7f0a8c139930 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c000c00 tx=0x7f0a7c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.698+0000 7f0a90930640 1 -- 172.21.15.38:0/4052493066 shutdown_connections 2023-12-22T08:47:28.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.698+0000 7f0a90930640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a8c1508e0 0x7f0a8c15d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.698+0000 7f0a90930640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a8c0ae600 0x7f0a8c0cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.698+0000 7f0a90930640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0a6c06a430 0x7f0a6c06c8f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.698+0000 7f0a90930640 1 --2- 172.21.15.38:0/4052493066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a8c06c820 0x7f0a8c139930 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.698+0000 7f0a90930640 1 -- 172.21.15.38:0/4052493066 >> 172.21.15.38:0/4052493066 conn(0x7f0a8c0b0b60 msgr2=0x7f0a8c14fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:28.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.698+0000 7f0a90930640 1 -- 172.21.15.38:0/4052493066 shutdown_connections 2023-12-22T08:47:28.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.698+0000 7f0a90930640 1 -- 172.21.15.38:0/4052493066 wait complete. 2023-12-22T08:47:28.718 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:47:28.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.945+0000 7f226096e640 1 Processor -- start 2023-12-22T08:47:28.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.945+0000 7f226096e640 1 -- start start 2023-12-22T08:47:28.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.947+0000 7f226096e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225c144d10 0x7f225c0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.947+0000 7f226096e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f225c0b2760 0x7f225c070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.947+0000 7f226096e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c1450f0 con 0x7f225c0cc670 2023-12-22T08:47:28.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.947+0000 7f226096e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225c0ce010 con 0x7f225c0b2760 2023-12-22T08:47:28.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.947+0000 7f226096e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0ce2f0 con 0x7f225c144d10 2023-12-22T08:47:28.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.947+0000 7f225a59c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225c144d10 0x7f225c0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.947+0000 7f225ad9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f225c0b2760 0x7f225c070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.948+0000 7f2259d9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f225c0cc670 0x7f225c0b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:43136/0 (socket says 172.21.15.38:43136) 2023-12-22T08:47:28.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.948+0000 7f2259d9b640 1 -- 172.21.15.38:0/344630231 learned_addr learned my addr 172.21.15.38:0/344630231 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:28.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.948+0000 7f225a59c640 1 -- 172.21.15.38:0/344630231 >> v2:172.21.15.89:3300/0 conn(0x7f225c0b2760 msgr2=0x7f225c070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:28.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.948+0000 7f225a59c640 1 --2- 172.21.15.38:0/344630231 >> v2:172.21.15.89:3300/0 conn(0x7f225c0b2760 0x7f225c070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.948+0000 7f225a59c640 1 -- 172.21.15.38:0/344630231 >> v1:172.21.15.89:6789/0 conn(0x7f225c0cc670 legacy=0x7f225c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.948+0000 7f225a59c640 1 -- 172.21.15.38:0/344630231 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0ce5d0 con 0x7f225c144d10 2023-12-22T08:47:28.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.950+0000 7f225a59c640 1 --2- 172.21.15.38:0/344630231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225c144d10 0x7f225c0cc130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f224c009d90 tx=0x7f224c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb4af595df5a82d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:28.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.950+0000 7f225959a640 1 -- 172.21.15.38:0/344630231 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c02cc50 con 0x7f225c144d10 2023-12-22T08:47:28.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.950+0000 7f225959a640 1 -- 172.21.15.38:0/344630231 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c02cdb0 con 0x7f225c144d10 2023-12-22T08:47:28.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.950+0000 7f225959a640 1 -- 172.21.15.38:0/344630231 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c034660 con 0x7f225c144d10 2023-12-22T08:47:28.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.951+0000 7f226096e640 1 -- 172.21.15.38:0/344630231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225c144d10 msgr2=0x7f225c0cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.951+0000 7f226096e640 1 --2- 172.21.15.38:0/344630231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225c144d10 0x7f225c0cc130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f224c009d90 tx=0x7f224c02bea0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.951+0000 7f226096e640 1 -- 172.21.15.38:0/344630231 shutdown_connections 2023-12-22T08:47:28.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.951+0000 7f226096e640 1 --2- 172.21.15.38:0/344630231 >> v2:172.21.15.89:3300/0 conn(0x7f225c0b2760 0x7f225c070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.951+0000 7f226096e640 1 --2- 172.21.15.38:0/344630231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225c144d10 0x7f225c0cc130 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.951+0000 7f226096e640 1 -- 172.21.15.38:0/344630231 >> 172.21.15.38:0/344630231 conn(0x7f225c0cf070 msgr2=0x7f225c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:28.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.951+0000 7f226096e640 1 -- 172.21.15.38:0/344630231 shutdown_connections 2023-12-22T08:47:28.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.951+0000 7f226096e640 1 -- 172.21.15.38:0/344630231 wait complete. 2023-12-22T08:47:28.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.953+0000 7f226096e640 1 Processor -- start 2023-12-22T08:47:28.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.953+0000 7f226096e640 1 -- start start 2023-12-22T08:47:28.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.954+0000 7f226096e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225c0b2760 0x7f225c15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.954+0000 7f226096e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f225c144d10 0x7f225c0a9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.954+0000 7f226096e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225c0a9f90 0x7f225c1f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.954+0000 7f226096e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c1f2ae0 con 0x7f225c0b2760 2023-12-22T08:47:28.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.954+0000 7f226096e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c1f2d50 con 0x7f225c144d10 2023-12-22T08:47:28.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.954+0000 7f226096e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c1f3030 con 0x7f225c0a9f90 2023-12-22T08:47:28.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.954+0000 7f225a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225c0b2760 0x7f225c15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.954+0000 7f225a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225c0b2760 0x7f225c15baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38024/0 (socket says 172.21.15.38:38024) 2023-12-22T08:47:28.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.954+0000 7f225a59c640 1 -- 172.21.15.38:0/2479117869 learned_addr learned my addr 172.21.15.38:0/2479117869 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:28.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.955+0000 7f225ad9d640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225c0a9f90 0x7f225c1f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.955+0000 7f2259d9b640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f225c144d10 0x7f225c0a9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.955+0000 7f225a59c640 1 -- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225c0a9f90 msgr2=0x7f225c1f6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.955+0000 7f225a59c640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225c0a9f90 0x7f225c1f6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.955+0000 7f225a59c640 1 -- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f225c144d10 msgr2=0x7f225c0a9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:28.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.955+0000 7f225a59c640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f225c144d10 0x7f225c0a9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:28.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.955+0000 7f225a59c640 1 -- 172.21.15.38:0/2479117869 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c009a70 con 0x7f225c0b2760 2023-12-22T08:47:28.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.955+0000 7f225a59c640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225c0b2760 0x7f225c15baa0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f224c009d90 tx=0x7f224c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:28.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.956+0000 7f2252ffd640 1 -- 172.21.15.38:0/2479117869 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c040650 con 0x7f225c0b2760 2023-12-22T08:47:28.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.956+0000 7f2252ffd640 1 -- 172.21.15.38:0/2479117869 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c0407b0 con 0x7f225c0b2760 2023-12-22T08:47:28.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.956+0000 7f226096e640 1 -- 172.21.15.38:0/2479117869 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c1f3310 con 0x7f225c0b2760 2023-12-22T08:47:28.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.956+0000 7f2252ffd640 1 -- 172.21.15.38:0/2479117869 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c040b60 con 0x7f225c0b2760 2023-12-22T08:47:28.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.956+0000 7f226096e640 1 -- 172.21.15.38:0/2479117869 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c1f6d90 con 0x7f225c0b2760 2023-12-22T08:47:28.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.957+0000 7f226096e640 1 -- 172.21.15.38:0/2479117869 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c061910 con 0x7f225c0b2760 2023-12-22T08:47:28.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.958+0000 7f2252ffd640 1 -- 172.21.15.38:0/2479117869 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f224c040cc0 con 0x7f225c0b2760 2023-12-22T08:47:28.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.959+0000 7f2252ffd640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f223c06a430 0x7f223c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:28.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.959+0000 7f2252ffd640 1 -- 172.21.15.38:0/2479117869 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f224c0ab7b0 con 0x7f225c0b2760 2023-12-22T08:47:28.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.959+0000 7f2259d9b640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f223c06a430 0x7f223c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:28.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.961+0000 7f2259d9b640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f223c06a430 0x7f223c06c8f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f225c15eb00 tx=0x7f2244009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:28.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:28.963+0000 7f2252ffd640 1 -- 172.21.15.38:0/2479117869 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f224c076d90 con 0x7f225c0b2760 2023-12-22T08:47:29.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.147+0000 7f226096e640 1 -- 172.21.15.38:0/2479117869 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f225c0cb8e0 con 0x7f225c0b2760 2023-12-22T08:47:29.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.147+0000 7f2252ffd640 1 -- 172.21.15.38:0/2479117869 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v130) v1 ==== 104+0+11 (secure 0 0 0) 0x7f224c07a3b0 con 0x7f225c0b2760 2023-12-22T08:47:29.149 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:47:29.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.150+0000 7f226096e640 1 -- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f223c06a430 msgr2=0x7f223c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.150+0000 7f226096e640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f223c06a430 0x7f223c06c8f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f225c15eb00 tx=0x7f2244009040 comp rx=0 tx=0).stop 2023-12-22T08:47:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.150+0000 7f226096e640 1 -- 172.21.15.38:0/2479117869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225c0b2760 msgr2=0x7f225c15baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.150+0000 7f226096e640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225c0b2760 0x7f225c15baa0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f224c009d90 tx=0x7f224c004a40 comp rx=0 tx=0).stop 2023-12-22T08:47:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.150+0000 7f226096e640 1 -- 172.21.15.38:0/2479117869 shutdown_connections 2023-12-22T08:47:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.150+0000 7f226096e640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f225c0a9f90 0x7f225c1f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.150+0000 7f226096e640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f225c144d10 0x7f225c0a9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.150+0000 7f226096e640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f223c06a430 0x7f223c06c8f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.150+0000 7f226096e640 1 --2- 172.21.15.38:0/2479117869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f225c0b2760 0x7f225c15baa0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.150+0000 7f226096e640 1 -- 172.21.15.38:0/2479117869 >> 172.21.15.38:0/2479117869 conn(0x7f225c0cf070 msgr2=0x7f225c0b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.150+0000 7f226096e640 1 -- 172.21.15.38:0/2479117869 shutdown_connections 2023-12-22T08:47:29.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.150+0000 7f226096e640 1 -- 172.21.15.38:0/2479117869 wait complete. 2023-12-22T08:47:29.170 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:47:29.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.393+0000 7f91bf1b9640 1 Processor -- start 2023-12-22T08:47:29.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.394+0000 7f91bf1b9640 1 -- start start 2023-12-22T08:47:29.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.395+0000 7f91bf1b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91b815e870 0x7f91b80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.395+0000 7f91bf1b9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f91b8070e80 0x7f91b806f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.395+0000 7f91bf1b9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b80ce4b0 con 0x7f91b815ec50 2023-12-22T08:47:29.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.395+0000 7f91bf1b9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b815fea0 con 0x7f91b8070e80 2023-12-22T08:47:29.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.395+0000 7f91bf1b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80cdb80 con 0x7f91b815e870 2023-12-22T08:47:29.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.396+0000 7f91b7fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f91b815ec50 0x7f91b8070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55440/0 (socket says 172.21.15.38:55440) 2023-12-22T08:47:29.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.396+0000 7f91b7fff640 1 -- 172.21.15.38:0/2854578081 learned_addr learned my addr 172.21.15.38:0/2854578081 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:29.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.396+0000 7f91bcf55640 1 --2- 172.21.15.38:0/2854578081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91b815e870 0x7f91b80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.396+0000 7f91bd756640 1 --2- 172.21.15.38:0/2854578081 >> v2:172.21.15.89:3300/0 conn(0x7f91b8070e80 0x7f91b806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.396+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651675958 0 0) 0x7f91b80ce4b0 con 0x7f91b815ec50 2023-12-22T08:47:29.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.396+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91a0003520 con 0x7f91b815ec50 2023-12-22T08:47:29.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1990381399 0 0) 0x7f91a0003520 con 0x7f91b815ec50 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91b815e870 msgr2=0x7f91b80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 --2- 172.21.15.38:0/2854578081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91b815e870 0x7f91b80ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 >> v2:172.21.15.89:3300/0 conn(0x7f91b8070e80 msgr2=0x7f91b806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 --2- 172.21.15.38:0/2854578081 >> v2:172.21.15.89:3300/0 conn(0x7f91b8070e80 0x7f91b806f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80cde60 con 0x7f91b815ec50 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f91a8001670 con 0x7f91b815ec50 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 >> v1:172.21.15.38:6789/0 conn(0x7f91b815ec50 legacy=0x7f91b8070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 --2- 172.21.15.38:0/2854578081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0003970 0x7f91a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 --2- 172.21.15.38:0/2854578081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91b815e870 0x7f91a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 --2- 172.21.15.38:0/2854578081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91a0004d00 0x7f91a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b815fea0 con 0x7f91a0004d00 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80cdb80 con 0x7f91a0003970 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a000b980 con 0x7f91b815e870 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.397+0000 7f91bd756640 1 --2- 172.21.15.38:0/2854578081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91a0004d00 0x7f91a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.398+0000 7f91bcf55640 1 --2- 172.21.15.38:0/2854578081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0003970 0x7f91a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.398+0000 7f91b7fff640 1 --2- 172.21.15.38:0/2854578081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91b815e870 0x7f91a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.398+0000 7f91bd756640 1 -- 172.21.15.38:0/2854578081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91b815e870 msgr2=0x7f91a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.398+0000 7f91bd756640 1 --2- 172.21.15.38:0/2854578081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91b815e870 0x7f91a00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.398+0000 7f91bd756640 1 -- 172.21.15.38:0/2854578081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0003970 msgr2=0x7f91a0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.398+0000 7f91bd756640 1 --2- 172.21.15.38:0/2854578081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0003970 0x7f91a0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.398+0000 7f91bd756640 1 -- 172.21.15.38:0/2854578081 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a0003520 con 0x7f91a0004d00 2023-12-22T08:47:29.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.399+0000 7f91bd756640 1 --2- 172.21.15.38:0/2854578081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91a0004d00 0x7f91a0005180 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f91b806a3f0 tx=0x7f91a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7dc6b18f0b1151 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:29.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.399+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b002cbd0 con 0x7f91a0004d00 2023-12-22T08:47:29.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.399+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b000f040 con 0x7f91a0004d00 2023-12-22T08:47:29.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.399+0000 7f91b77fe640 1 -- 172.21.15.38:0/2854578081 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0034440 con 0x7f91a0004d00 2023-12-22T08:47:29.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.400+0000 7f91bf1b9640 1 -- 172.21.15.38:0/2854578081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91a0004d00 msgr2=0x7f91a0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:29.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.400+0000 7f91bf1b9640 1 --2- 172.21.15.38:0/2854578081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91a0004d00 0x7f91a0005180 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f91b806a3f0 tx=0x7f91a00057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.400+0000 7f91bd756640 1 -- 172.21.15.38:0/2854578081 reap_dead start 2023-12-22T08:47:29.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.400+0000 7f91bf1b9640 1 -- 172.21.15.38:0/2854578081 shutdown_connections 2023-12-22T08:47:29.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.400+0000 7f91bf1b9640 1 -- 172.21.15.38:0/2854578081 >> 172.21.15.38:0/2854578081 conn(0x7f91b80b20c0 msgr2=0x7f91b80b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:29.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.400+0000 7f91bf1b9640 1 -- 172.21.15.38:0/2854578081 shutdown_connections 2023-12-22T08:47:29.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.400+0000 7f91bf1b9640 1 -- 172.21.15.38:0/2854578081 wait complete. 2023-12-22T08:47:29.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.402+0000 7f91bf1b9640 1 Processor -- start 2023-12-22T08:47:29.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.402+0000 7f91bf1b9640 1 -- start start 2023-12-22T08:47:29.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.403+0000 7f91bf1b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0004d00 0x7f91b8152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.403+0000 7f91bf1b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91b815a300 0x7f91b815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.403+0000 7f91bf1b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91b8157250 0x7f91b81576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.403+0000 7f91bf1b9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b815baf0 con 0x7f91b8157250 2023-12-22T08:47:29.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.403+0000 7f91bf1b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b8157bf0 con 0x7f91a0004d00 2023-12-22T08:47:29.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.403+0000 7f91bf1b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b8152da0 con 0x7f91b815a300 2023-12-22T08:47:29.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.403+0000 7f91bd756640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91b8157250 0x7f91b81576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.403+0000 7f91bd756640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91b8157250 0x7f91b81576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38034/0 (socket says 172.21.15.38:38034) 2023-12-22T08:47:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.403+0000 7f91bd756640 1 -- 172.21.15.38:0/1293780242 learned_addr learned my addr 172.21.15.38:0/1293780242 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.404+0000 7f91b7fff640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91b815a300 0x7f91b815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.404+0000 7f91bd756640 1 -- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91b815a300 msgr2=0x7f91b815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.404+0000 7f91bcf55640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0004d00 0x7f91b8152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.404+0000 7f91bd756640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91b815a300 0x7f91b815a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.404+0000 7f91bd756640 1 -- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0004d00 msgr2=0x7f91b8152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.404+0000 7f91bd756640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0004d00 0x7f91b8152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.404+0000 7f91bd756640 1 -- 172.21.15.38:0/1293780242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b8156b60 con 0x7f91b8157250 2023-12-22T08:47:29.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.404+0000 7f91bcf55640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0004d00 0x7f91b8152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:29.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.404+0000 7f91bd756640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91b8157250 0x7f91b81576b0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f91b000e230 tx=0x7f91b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:29.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.404+0000 7f91b57fa640 1 -- 172.21.15.38:0/1293780242 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0034d50 con 0x7f91b8157250 2023-12-22T08:47:29.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.404+0000 7f91b57fa640 1 -- 172.21.15.38:0/1293780242 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b0003990 con 0x7f91b8157250 2023-12-22T08:47:29.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.404+0000 7f91b57fa640 1 -- 172.21.15.38:0/1293780242 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0003d40 con 0x7f91b8157250 2023-12-22T08:47:29.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.405+0000 7f91bf1b9640 1 -- 172.21.15.38:0/1293780242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b815ae70 con 0x7f91b8157250 2023-12-22T08:47:29.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.405+0000 7f91bf1b9640 1 -- 172.21.15.38:0/1293780242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b815b430 con 0x7f91b8157250 2023-12-22T08:47:29.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.406+0000 7f91bf1b9640 1 -- 172.21.15.38:0/1293780242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b8061910 con 0x7f91b8157250 2023-12-22T08:47:29.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.407+0000 7f91b57fa640 1 -- 172.21.15.38:0/1293780242 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f91b0004030 con 0x7f91b8157250 2023-12-22T08:47:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.408+0000 7f91b57fa640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91a406a430 0x7f91a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.408+0000 7f91b57fa640 1 -- 172.21.15.38:0/1293780242 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91b00aa490 con 0x7f91b8157250 2023-12-22T08:47:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.408+0000 7f91bcf55640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91a406a430 0x7f91a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.410+0000 7f91bcf55640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91a406a430 0x7f91a406c8f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009a40 tx=0x7f91ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:29.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.412+0000 7f91b57fa640 1 -- 172.21.15.38:0/1293780242 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f91b0075b20 con 0x7f91b8157250 2023-12-22T08:47:29.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.601+0000 7f91bf1b9640 1 -- 172.21.15.38:0/1293780242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91b80ccb00 con 0x7f91b8157250 2023-12-22T08:47:29.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.602+0000 7f91b57fa640 1 -- 172.21.15.38:0/1293780242 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v130) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91b0079140 con 0x7f91b8157250 2023-12-22T08:47:29.603 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:47:29.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.605+0000 7f91bf1b9640 1 -- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91a406a430 msgr2=0x7f91a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:29.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.605+0000 7f91bf1b9640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91a406a430 0x7f91a406c8f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009a40 tx=0x7f91ac008040 comp rx=0 tx=0).stop 2023-12-22T08:47:29.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.605+0000 7f91bf1b9640 1 -- 172.21.15.38:0/1293780242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91b8157250 msgr2=0x7f91b81576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:29.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.605+0000 7f91bf1b9640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91b8157250 0x7f91b81576b0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f91b000e230 tx=0x7f91b0009750 comp rx=0 tx=0).stop 2023-12-22T08:47:29.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.605+0000 7f91bf1b9640 1 -- 172.21.15.38:0/1293780242 shutdown_connections 2023-12-22T08:47:29.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.605+0000 7f91bf1b9640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91a406a430 0x7f91a406c8f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.605+0000 7f91bf1b9640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91b8157250 0x7f91b81576b0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.605+0000 7f91bf1b9640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91b815a300 0x7f91b815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.605+0000 7f91bf1b9640 1 --2- 172.21.15.38:0/1293780242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91a0004d00 0x7f91b8152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.605+0000 7f91bf1b9640 1 -- 172.21.15.38:0/1293780242 >> 172.21.15.38:0/1293780242 conn(0x7f91b80b20c0 msgr2=0x7f91b815d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:29.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.605+0000 7f91bf1b9640 1 -- 172.21.15.38:0/1293780242 shutdown_connections 2023-12-22T08:47:29.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.605+0000 7f91bf1b9640 1 -- 172.21.15.38:0/1293780242 wait complete. 2023-12-22T08:47:29.626 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:47:29.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.838+0000 7f25db59e640 1 Processor -- start 2023-12-22T08:47:29.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.838+0000 7f25db59e640 1 -- start start 2023-12-22T08:47:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.839+0000 7f25db59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25dc0cb5e0 0x7f25dc15d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.839+0000 7f25db59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25dc161bb0 0x7f25dc15de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.839+0000 7f25db59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25dc15e3c0 con 0x7f25dc15ad90 2023-12-22T08:47:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.839+0000 7f25db59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25dc0ce2c0 con 0x7f25dc161bb0 2023-12-22T08:47:29.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.839+0000 7f25db59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc15e910 con 0x7f25dc0cb5e0 2023-12-22T08:47:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.840+0000 7f25dad9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25dc161bb0 0x7f25dc15de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.840+0000 7f25dad9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25dc161bb0 0x7f25dc15de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38050/0 (socket says 172.21.15.38:38050) 2023-12-22T08:47:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.840+0000 7f25dad9d640 1 -- 172.21.15.38:0/2164207968 learned_addr learned my addr 172.21.15.38:0/2164207968 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.840+0000 7f25d9d9b640 1 --2- 172.21.15.38:0/2164207968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25dc0cb5e0 0x7f25dc15d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.840+0000 7f25dad9d640 1 -- 172.21.15.38:0/2164207968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25dc0cb5e0 msgr2=0x7f25dc15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.840+0000 7f25dad9d640 1 --2- 172.21.15.38:0/2164207968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25dc0cb5e0 0x7f25dc15d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.840+0000 7f25dad9d640 1 -- 172.21.15.38:0/2164207968 >> v1:172.21.15.89:6789/0 conn(0x7f25dc15ad90 legacy=0x7f25dc0caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:29.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.840+0000 7f25dad9d640 1 -- 172.21.15.38:0/2164207968 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc15e630 con 0x7f25dc161bb0 2023-12-22T08:47:29.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.841+0000 7f25dad9d640 1 --2- 172.21.15.38:0/2164207968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25dc161bb0 0x7f25dc15de80 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009870 tx=0x7f25d402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2442811e83895d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:29.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.841+0000 7f25d959a640 1 -- 172.21.15.38:0/2164207968 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4031640 con 0x7f25dc161bb0 2023-12-22T08:47:29.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.842+0000 7f25d959a640 1 -- 172.21.15.38:0/2164207968 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d40317a0 con 0x7f25dc161bb0 2023-12-22T08:47:29.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.842+0000 7f25d959a640 1 -- 172.21.15.38:0/2164207968 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4031b30 con 0x7f25dc161bb0 2023-12-22T08:47:29.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.842+0000 7f25db59e640 1 -- 172.21.15.38:0/2164207968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25dc161bb0 msgr2=0x7f25dc15de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:29.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.842+0000 7f25db59e640 1 --2- 172.21.15.38:0/2164207968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25dc161bb0 0x7f25dc15de80 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009870 tx=0x7f25d402b8f0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.842+0000 7f25db59e640 1 -- 172.21.15.38:0/2164207968 shutdown_connections 2023-12-22T08:47:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.842+0000 7f25db59e640 1 --2- 172.21.15.38:0/2164207968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25dc161bb0 0x7f25dc15de80 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.842+0000 7f25db59e640 1 --2- 172.21.15.38:0/2164207968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25dc0cb5e0 0x7f25dc15d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.842+0000 7f25db59e640 1 -- 172.21.15.38:0/2164207968 >> 172.21.15.38:0/2164207968 conn(0x7f25dc0d31c0 msgr2=0x7f25dc0d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.842+0000 7f25db59e640 1 -- 172.21.15.38:0/2164207968 shutdown_connections 2023-12-22T08:47:29.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.842+0000 7f25db59e640 1 -- 172.21.15.38:0/2164207968 wait complete. 2023-12-22T08:47:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.844+0000 7f25db59e640 1 Processor -- start 2023-12-22T08:47:29.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.844+0000 7f25db59e640 1 -- start start 2023-12-22T08:47:29.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.845+0000 7f25db59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25dc0cb5e0 0x7f25dc14f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.845+0000 7f25db59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25dc15ad90 0x7f25dc160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25db59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25dc161bb0 0x7f25dc15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25db59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc14f930 con 0x7f25dc161bb0 2023-12-22T08:47:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25db59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc155da0 con 0x7f25dc0cb5e0 2023-12-22T08:47:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25db59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc155190 con 0x7f25dc15ad90 2023-12-22T08:47:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25dad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25dc161bb0 0x7f25dc15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25dad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25dc161bb0 0x7f25dc15bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38054/0 (socket says 172.21.15.38:38054) 2023-12-22T08:47:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25dad9d640 1 -- 172.21.15.38:0/2961860243 learned_addr learned my addr 172.21.15.38:0/2961860243 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25da59c640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25dc0cb5e0 0x7f25dc14f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25d9d9b640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25dc15ad90 0x7f25dc160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25dad9d640 1 -- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25dc15ad90 msgr2=0x7f25dc160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:29.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25dad9d640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25dc15ad90 0x7f25dc160250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25dad9d640 1 -- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25dc0cb5e0 msgr2=0x7f25dc14f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:29.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25dad9d640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25dc0cb5e0 0x7f25dc14f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:29.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25dad9d640 1 -- 172.21.15.38:0/2961860243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d40094d0 con 0x7f25dc161bb0 2023-12-22T08:47:29.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.846+0000 7f25da59c640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25dc0cb5e0 0x7f25dc14f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:29.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.847+0000 7f25dad9d640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25dc161bb0 0x7f25dc15bd80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f25d402b930 tx=0x7f25d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:29.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.847+0000 7f25d2ffd640 1 -- 172.21.15.38:0/2961860243 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d403ac60 con 0x7f25dc161bb0 2023-12-22T08:47:29.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.847+0000 7f25d2ffd640 1 -- 172.21.15.38:0/2961860243 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d403ade0 con 0x7f25dc161bb0 2023-12-22T08:47:29.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.847+0000 7f25d2ffd640 1 -- 172.21.15.38:0/2961860243 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4044630 con 0x7f25dc161bb0 2023-12-22T08:47:29.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.847+0000 7f25db59e640 1 -- 172.21.15.38:0/2961860243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25dc155470 con 0x7f25dc161bb0 2023-12-22T08:47:29.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.847+0000 7f25db59e640 1 -- 172.21.15.38:0/2961860243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc155a30 con 0x7f25dc161bb0 2023-12-22T08:47:29.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.848+0000 7f25db59e640 1 -- 172.21.15.38:0/2961860243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25dc061910 con 0x7f25dc161bb0 2023-12-22T08:47:29.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.849+0000 7f25d2ffd640 1 -- 172.21.15.38:0/2961860243 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f25d402f050 con 0x7f25dc161bb0 2023-12-22T08:47:29.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.850+0000 7f25d2ffd640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25bc06a430 0x7f25bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:29.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.850+0000 7f25d2ffd640 1 -- 172.21.15.38:0/2961860243 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25d40aa9f0 con 0x7f25dc161bb0 2023-12-22T08:47:29.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.851+0000 7f25da59c640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25bc06a430 0x7f25bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:29.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.852+0000 7f25da59c640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25bc06a430 0x7f25bc06c8f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f25dc156450 tx=0x7f25cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:29.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:29.855+0000 7f25d2ffd640 1 -- 172.21.15.38:0/2961860243 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f25d40760d0 con 0x7f25dc161bb0 2023-12-22T08:47:30.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.061+0000 7f25db59e640 1 -- 172.21.15.38:0/2961860243 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f25dc0c6ad0 con 0x7f25dc161bb0 2023-12-22T08:47:30.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.062+0000 7f25d2ffd640 1 -- 172.21.15.38:0/2961860243 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v130) v1 ==== 80+0+0 (secure 0 0 0) 0x7f25d404d450 con 0x7f25dc161bb0 2023-12-22T08:47:30.063 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:47:30.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.065+0000 7f25db59e640 1 -- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25bc06a430 msgr2=0x7f25bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:30.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.065+0000 7f25db59e640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25bc06a430 0x7f25bc06c8f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f25dc156450 tx=0x7f25cc009040 comp rx=0 tx=0).stop 2023-12-22T08:47:30.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.065+0000 7f25db59e640 1 -- 172.21.15.38:0/2961860243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25dc161bb0 msgr2=0x7f25dc15bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:30.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.065+0000 7f25db59e640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25dc161bb0 0x7f25dc15bd80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f25d402b930 tx=0x7f25d40046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.065+0000 7f25db59e640 1 -- 172.21.15.38:0/2961860243 shutdown_connections 2023-12-22T08:47:30.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.065+0000 7f25db59e640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25bc06a430 0x7f25bc06c8f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.065+0000 7f25db59e640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25dc161bb0 0x7f25dc15bd80 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.065+0000 7f25db59e640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25dc15ad90 0x7f25dc160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.065+0000 7f25db59e640 1 --2- 172.21.15.38:0/2961860243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25dc0cb5e0 0x7f25dc14f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.065+0000 7f25db59e640 1 -- 172.21.15.38:0/2961860243 >> 172.21.15.38:0/2961860243 conn(0x7f25dc0d31c0 msgr2=0x7f25dc15d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:30.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.065+0000 7f25db59e640 1 -- 172.21.15.38:0/2961860243 shutdown_connections 2023-12-22T08:47:30.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.065+0000 7f25db59e640 1 -- 172.21.15.38:0/2961860243 wait complete. 2023-12-22T08:47:30.087 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T08:47:30.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:30.087 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-22T08:47:30.205 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:47:30.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:30.206 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T08:47:30.259 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:47:30.259 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:30.324 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:47:30.324 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:47:30.325 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:30.384 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:47:30.384 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:47:30.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.621+0000 7f63ab592640 1 Processor -- start 2023-12-22T08:47:30.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.621+0000 7f63ab592640 1 -- start start 2023-12-22T08:47:30.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.623+0000 7f63ab592640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f63a4154b80 0x7f63a40ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:30.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.623+0000 7f63ab592640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a40716a0 con 0x7f63a4071b90 2023-12-22T08:47:30.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.623+0000 7f63ab592640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a4070e80 con 0x7f63a41547a0 2023-12-22T08:47:30.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.623+0000 7f63ab592640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a40710e0 con 0x7f63a4154b80 2023-12-22T08:47:30.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.623+0000 7f63a8b2d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f63a4071b90 0x7f63a4070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55454/0 (socket says 172.21.15.38:55454) 2023-12-22T08:47:30.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.623+0000 7f63a8b2d640 1 -- 172.21.15.38:0/3919402383 learned_addr learned my addr 172.21.15.38:0/3919402383 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:30.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.623+0000 7f63a9b2f640 1 --2- 172.21.15.38:0/3919402383 >> v2:172.21.15.89:3300/0 conn(0x7f63a4154b80 0x7f63a40ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:30.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206614667 0 0) 0x7f63a40716a0 con 0x7f63a4071b90 2023-12-22T08:47:30.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6390003520 con 0x7f63a4071b90 2023-12-22T08:47:30.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2377782608 0 0) 0x7f6390003520 con 0x7f63a4071b90 2023-12-22T08:47:30.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 >> v2:172.21.15.89:3300/0 conn(0x7f63a4154b80 msgr2=0x7f63a40ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:30.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 --2- 172.21.15.38:0/3919402383 >> v2:172.21.15.89:3300/0 conn(0x7f63a4154b80 0x7f63a40ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 >> v1:172.21.15.89:6789/0 conn(0x7f63a41547a0 legacy=0x7f63a415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:30.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a40713c0 con 0x7f63a4071b90 2023-12-22T08:47:30.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f6394001670 con 0x7f63a4071b90 2023-12-22T08:47:30.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 >> v1:172.21.15.38:6789/0 conn(0x7f63a4071b90 legacy=0x7f63a4070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:30.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 --2- 172.21.15.38:0/3919402383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63900039c0 0x7f6390003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:30.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 --2- 172.21.15.38:0/3919402383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63900047c0 0x7f6390004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:30.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 --2- 172.21.15.38:0/3919402383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6390005180 0x7f639000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:30.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40710e0 con 0x7f63900047c0 2023-12-22T08:47:30.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6390010490 con 0x7f63900039c0 2023-12-22T08:47:30.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6390010650 con 0x7f6390005180 2023-12-22T08:47:30.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.624+0000 7f63a8b2d640 1 --2- 172.21.15.38:0/3919402383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63900047c0 0x7f6390004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:30.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.625+0000 7f63a8b2d640 1 -- 172.21.15.38:0/3919402383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6390005180 msgr2=0x7f639000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:30.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.625+0000 7f63a8b2d640 1 --2- 172.21.15.38:0/3919402383 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6390005180 0x7f639000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.625+0000 7f63a8b2d640 1 -- 172.21.15.38:0/3919402383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63900039c0 msgr2=0x7f6390003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:30.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.625+0000 7f63a8b2d640 1 --2- 172.21.15.38:0/3919402383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63900039c0 0x7f6390003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.625+0000 7f63a8b2d640 1 -- 172.21.15.38:0/3919402383 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390003520 con 0x7f63900047c0 2023-12-22T08:47:30.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.625+0000 7f63a9b2f640 1 -- 172.21.15.38:0/3919402383 reap_dead start 2023-12-22T08:47:30.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.626+0000 7f63a8b2d640 1 --2- 172.21.15.38:0/3919402383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63900047c0 0x7f6390004c40 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f63a40ce150 tx=0x7f63900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff74b36e8f918342 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:30.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.627+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6394005ad0 con 0x7f63900047c0 2023-12-22T08:47:30.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.627+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6394005c30 con 0x7f63900047c0 2023-12-22T08:47:30.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.627+0000 7f639bfff640 1 -- 172.21.15.38:0/3919402383 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639402c9d0 con 0x7f63900047c0 2023-12-22T08:47:30.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.627+0000 7f63ab592640 1 -- 172.21.15.38:0/3919402383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63900047c0 msgr2=0x7f6390004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:30.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.627+0000 7f63ab592640 1 --2- 172.21.15.38:0/3919402383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63900047c0 0x7f6390004c40 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f63a40ce150 tx=0x7f63900057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.627+0000 7f63ab592640 1 -- 172.21.15.38:0/3919402383 shutdown_connections 2023-12-22T08:47:30.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.628+0000 7f63ab592640 1 --2- 172.21.15.38:0/3919402383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63900047c0 0x7f6390004c40 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.628+0000 7f63ab592640 1 -- 172.21.15.38:0/3919402383 >> 172.21.15.38:0/3919402383 conn(0x7f63a40cf070 msgr2=0x7f63a40cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:30.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.628+0000 7f63ab592640 1 -- 172.21.15.38:0/3919402383 shutdown_connections 2023-12-22T08:47:30.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.628+0000 7f63ab592640 1 -- 172.21.15.38:0/3919402383 wait complete. 2023-12-22T08:47:30.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.629+0000 7f63ab592640 1 Processor -- start 2023-12-22T08:47:30.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.630+0000 7f63ab592640 1 -- start start 2023-12-22T08:47:30.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63ab592640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63900047c0 0x7f63a40aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63ab592640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a40af180 0x7f63a40b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63ab592640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63a40b0eb0 0x7f63a40b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63ab592640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4145040 con 0x7f63a40af180 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63ab592640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40b0210 con 0x7f63a40b0eb0 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63ab592640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40af600 con 0x7f63900047c0 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63a8b2d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a40af180 0x7f63a40b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63a8b2d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a40af180 0x7f63a40b0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38064/0 (socket says 172.21.15.38:38064) 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63a8b2d640 1 -- 172.21.15.38:0/181711890 learned_addr learned my addr 172.21.15.38:0/181711890 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63a932e640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63900047c0 0x7f63a40aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63a9b2f640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63a40b0eb0 0x7f63a40b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63a8b2d640 1 -- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63900047c0 msgr2=0x7f63a40aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63a8b2d640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63900047c0 0x7f63a40aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63a8b2d640 1 -- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63a40b0eb0 msgr2=0x7f63a40b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:30.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63a8b2d640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63a40b0eb0 0x7f63a40b1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.631+0000 7f63a8b2d640 1 -- 172.21.15.38:0/181711890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a40af8e0 con 0x7f63a40af180 2023-12-22T08:47:30.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.632+0000 7f63a8b2d640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a40af180 0x7f63a40b0970 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f639402c330 tx=0x7f639402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:30.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.632+0000 7f6399ffb640 1 -- 172.21.15.38:0/181711890 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639403c040 con 0x7f63a40af180 2023-12-22T08:47:30.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.632+0000 7f6399ffb640 1 -- 172.21.15.38:0/181711890 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639402cc80 con 0x7f63a40af180 2023-12-22T08:47:30.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.632+0000 7f6399ffb640 1 -- 172.21.15.38:0/181711890 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6394007070 con 0x7f63a40af180 2023-12-22T08:47:30.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.632+0000 7f63ab592640 1 -- 172.21.15.38:0/181711890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a40afbc0 con 0x7f63a40af180 2023-12-22T08:47:30.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.632+0000 7f63ab592640 1 -- 172.21.15.38:0/181711890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a40b06a0 con 0x7f63a40af180 2023-12-22T08:47:30.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.633+0000 7f63ab592640 1 -- 172.21.15.38:0/181711890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a40b0380 con 0x7f63a40af180 2023-12-22T08:47:30.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.634+0000 7f6399ffb640 1 -- 172.21.15.38:0/181711890 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6394032070 con 0x7f63a40af180 2023-12-22T08:47:30.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.635+0000 7f6399ffb640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f638806a460 0x7f638806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:30.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.635+0000 7f6399ffb640 1 -- 172.21.15.38:0/181711890 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63940a9d60 con 0x7f63a40af180 2023-12-22T08:47:30.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.636+0000 7f63a932e640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f638806a460 0x7f638806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:30.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.637+0000 7f63a932e640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f638806a460 0x7f638806c920 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f63a0001df0 tx=0x7f63a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:30.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.640+0000 7f6399ffb640 1 -- 172.21.15.38:0/181711890 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f63940752b0 con 0x7f63a40af180 2023-12-22T08:47:30.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.871+0000 7f63ab592640 1 -- 172.21.15.38:0/181711890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63a4061910 con 0x7f63a40af180 2023-12-22T08:47:30.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.872+0000 7f6399ffb640 1 -- 172.21.15.38:0/181711890 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f63940788d0 con 0x7f63a40af180 2023-12-22T08:47:30.874 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:30.874 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/186375012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":186375012},{"type":"v1","addr":"172.21.15.89:6837","nonce":186375012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1819583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1819583870},{"type":"v1","addr":"172.21.15.89:6835","nonce":1819583870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3793773672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3793773672},{"type":"v1","addr":"172.21.15.38:6834","nonce":3793773672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:07.035669+0000","modified":"2023-12-22T08:47:10.565916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7293":{"gid":7293,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3340763944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3340763944},{"type":"v1","addr":"172.21.15.38:6835","nonce":3340763944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-22T08:47:30.874 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 55 2023-12-22T08:47:30.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.874+0000 7f63ab592640 1 -- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f638806a460 msgr2=0x7f638806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:30.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.874+0000 7f63ab592640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f638806a460 0x7f638806c920 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f63a0001df0 tx=0x7f63a0009040 comp rx=0 tx=0).stop 2023-12-22T08:47:30.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.874+0000 7f63ab592640 1 -- 172.21.15.38:0/181711890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a40af180 msgr2=0x7f63a40b0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:30.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.874+0000 7f63ab592640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a40af180 0x7f63a40b0970 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f639402c330 tx=0x7f639402e070 comp rx=0 tx=0).stop 2023-12-22T08:47:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.875+0000 7f63ab592640 1 -- 172.21.15.38:0/181711890 shutdown_connections 2023-12-22T08:47:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.875+0000 7f63ab592640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63a40b0eb0 0x7f63a40b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.875+0000 7f63ab592640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f638806a460 0x7f638806c920 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.875+0000 7f63ab592640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a40af180 0x7f63a40b0970 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.875+0000 7f63ab592640 1 --2- 172.21.15.38:0/181711890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63900047c0 0x7f63a40aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.875+0000 7f63ab592640 1 -- 172.21.15.38:0/181711890 >> 172.21.15.38:0/181711890 conn(0x7f63a40cf070 msgr2=0x7f63a406d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.875+0000 7f63ab592640 1 -- 172.21.15.38:0/181711890 shutdown_connections 2023-12-22T08:47:30.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:30.875+0000 7f63ab592640 1 -- 172.21.15.38:0/181711890 wait complete. 2023-12-22T08:47:30.897 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:31.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.129+0000 7f7d9f342640 1 Processor -- start 2023-12-22T08:47:31.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.129+0000 7f7d9f342640 1 -- start start 2023-12-22T08:47:31.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.130+0000 7f7d9f342640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d980cca90 0x7f7d98071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:31.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.131+0000 7f7d9f342640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7d9815f340 0x7f7d980ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:31.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.131+0000 7f7d9f342640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d980ce570 con 0x7f7d9815ef60 2023-12-22T08:47:31.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.131+0000 7f7d9f342640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9806f3f0 con 0x7f7d9815f340 2023-12-22T08:47:31.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.131+0000 7f7d9f342640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d98071690 con 0x7f7d980cca90 2023-12-22T08:47:31.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.131+0000 7f7d9eb41640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7d9815f340 0x7f7d980ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:31.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.131+0000 7f7d9eb41640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7d9815f340 0x7f7d980ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37982/0 (socket says 172.21.15.38:37982) 2023-12-22T08:47:31.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.131+0000 7f7d9eb41640 1 -- 172.21.15.38:0/3237546362 learned_addr learned my addr 172.21.15.38:0/3237546362 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:31.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.131+0000 7f7d9db3f640 1 --2- 172.21.15.38:0/3237546362 >> v2:172.21.15.89:3300/0 conn(0x7f7d980cca90 0x7f7d98071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:31.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.131+0000 7f7d9eb41640 1 -- 172.21.15.38:0/3237546362 >> v2:172.21.15.89:3300/0 conn(0x7f7d980cca90 msgr2=0x7f7d98071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:31.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.131+0000 7f7d9eb41640 1 --2- 172.21.15.38:0/3237546362 >> v2:172.21.15.89:3300/0 conn(0x7f7d980cca90 0x7f7d98071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.131+0000 7f7d9eb41640 1 -- 172.21.15.38:0/3237546362 >> v1:172.21.15.89:6789/0 conn(0x7f7d9815ef60 legacy=0x7f7d980cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:31.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.132+0000 7f7d9eb41640 1 -- 172.21.15.38:0/3237546362 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d980718a0 con 0x7f7d9815f340 2023-12-22T08:47:31.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.132+0000 7f7d9db3f640 1 --2- 172.21.15.38:0/3237546362 >> v2:172.21.15.89:3300/0 conn(0x7f7d980cca90 0x7f7d98071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:31.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.133+0000 7f7d9eb41640 1 --2- 172.21.15.38:0/3237546362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9815f340 0x7f7d980ce030 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7d980717d0 tx=0x7f7d9002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d7e428822afdf0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:31.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.133+0000 7f7d9d33e640 1 -- 172.21.15.38:0/3237546362 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9002c9f0 con 0x7f7d9815f340 2023-12-22T08:47:31.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.133+0000 7f7d9d33e640 1 -- 172.21.15.38:0/3237546362 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9002cb50 con 0x7f7d9815f340 2023-12-22T08:47:31.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.133+0000 7f7d9d33e640 1 -- 172.21.15.38:0/3237546362 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d900343f0 con 0x7f7d9815f340 2023-12-22T08:47:31.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.134+0000 7f7d9f342640 1 -- 172.21.15.38:0/3237546362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9815f340 msgr2=0x7f7d980ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:31.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.134+0000 7f7d9f342640 1 --2- 172.21.15.38:0/3237546362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9815f340 0x7f7d980ce030 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7d980717d0 tx=0x7f7d9002be50 comp rx=0 tx=0).stop 2023-12-22T08:47:31.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.134+0000 7f7d9f342640 1 -- 172.21.15.38:0/3237546362 shutdown_connections 2023-12-22T08:47:31.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.134+0000 7f7d9f342640 1 --2- 172.21.15.38:0/3237546362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9815f340 0x7f7d980ce030 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.134+0000 7f7d9f342640 1 --2- 172.21.15.38:0/3237546362 >> v2:172.21.15.89:3300/0 conn(0x7f7d980cca90 0x7f7d98071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.134+0000 7f7d9f342640 1 -- 172.21.15.38:0/3237546362 >> 172.21.15.38:0/3237546362 conn(0x7f7d980b1c70 msgr2=0x7f7d980b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:31.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.134+0000 7f7d9f342640 1 -- 172.21.15.38:0/3237546362 shutdown_connections 2023-12-22T08:47:31.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.134+0000 7f7d9f342640 1 -- 172.21.15.38:0/3237546362 wait complete. 2023-12-22T08:47:31.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.136+0000 7f7d9f342640 1 Processor -- start 2023-12-22T08:47:31.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.136+0000 7f7d9f342640 1 -- start start 2023-12-22T08:47:31.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.137+0000 7f7d9f342640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d980cca90 0x7f7d98154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:31.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.137+0000 7f7d9f342640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d9815ef60 0x7f7d981f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:31.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.137+0000 7f7d9f342640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9815f340 0x7f7d98153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:31.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.137+0000 7f7d9f342640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98156480 con 0x7f7d9815f340 2023-12-22T08:47:31.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.137+0000 7f7d9f342640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d981f2880 con 0x7f7d980cca90 2023-12-22T08:47:31.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.137+0000 7f7d9f342640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d981540e0 con 0x7f7d9815ef60 2023-12-22T08:47:31.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.137+0000 7f7d9eb41640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9815f340 0x7f7d98153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:31.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.137+0000 7f7d9eb41640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9815f340 0x7f7d98153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37986/0 (socket says 172.21.15.38:37986) 2023-12-22T08:47:31.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.137+0000 7f7d9eb41640 1 -- 172.21.15.38:0/1484191296 learned_addr learned my addr 172.21.15.38:0/1484191296 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:31.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.138+0000 7f7d9e340640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d980cca90 0x7f7d98154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:31.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.138+0000 7f7d9db3f640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d9815ef60 0x7f7d981f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:31.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.138+0000 7f7d9eb41640 1 -- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d9815ef60 msgr2=0x7f7d981f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:31.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.138+0000 7f7d9eb41640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d9815ef60 0x7f7d981f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.138+0000 7f7d9eb41640 1 -- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d980cca90 msgr2=0x7f7d98154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:31.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.138+0000 7f7d9eb41640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d980cca90 0x7f7d98154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.138+0000 7f7d9eb41640 1 -- 172.21.15.38:0/1484191296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d90009b30 con 0x7f7d9815f340 2023-12-22T08:47:31.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.138+0000 7f7d9eb41640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9815f340 0x7f7d98153ba0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f7d90036040 tx=0x7f7d90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:31.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.138+0000 7f7d8effd640 1 -- 172.21.15.38:0/1484191296 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9003e450 con 0x7f7d9815f340 2023-12-22T08:47:31.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.138+0000 7f7d8effd640 1 -- 172.21.15.38:0/1484191296 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9003e5d0 con 0x7f7d9815f340 2023-12-22T08:47:31.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.138+0000 7f7d8effd640 1 -- 172.21.15.38:0/1484191296 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9003e980 con 0x7f7d9815f340 2023-12-22T08:47:31.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.138+0000 7f7d9f342640 1 -- 172.21.15.38:0/1484191296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9815dfd0 con 0x7f7d9815f340 2023-12-22T08:47:31.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.139+0000 7f7d9f342640 1 -- 172.21.15.38:0/1484191296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d98155dc0 con 0x7f7d9815f340 2023-12-22T08:47:31.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.140+0000 7f7d9f342640 1 -- 172.21.15.38:0/1484191296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d981565c0 con 0x7f7d9815f340 2023-12-22T08:47:31.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.141+0000 7f7d8effd640 1 -- 172.21.15.38:0/1484191296 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7d9003eae0 con 0x7f7d9815f340 2023-12-22T08:47:31.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.142+0000 7f7d8effd640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d7c06a430 0x7f7d7c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:31.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.142+0000 7f7d8effd640 1 -- 172.21.15.38:0/1484191296 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d900ab880 con 0x7f7d9815f340 2023-12-22T08:47:31.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.142+0000 7f7d9e340640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d7c06a430 0x7f7d7c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:31.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.143+0000 7f7d9e340640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d7c06a430 0x7f7d7c06c8f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7d94004ea0 tx=0x7f7d94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:31.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.147+0000 7f7d8effd640 1 -- 172.21.15.38:0/1484191296 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7d981565c0 con 0x7f7d9815f340 2023-12-22T08:47:31.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.347+0000 7f7d9f342640 1 -- 172.21.15.38:0/1484191296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d981565c0 con 0x7f7d9815f340 2023-12-22T08:47:31.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.352+0000 7f7d8effd640 1 -- 172.21.15.38:0/1484191296 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16011 (secure 0 0 0) 0x7f7d981565c0 con 0x7f7d9815f340 2023-12-22T08:47:31.354 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:31.354 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":130,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:22.301110+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:04.687287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:06.061571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:31.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.355+0000 7f7d9f342640 1 -- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d7c06a430 msgr2=0x7f7d7c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:31.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.355+0000 7f7d9f342640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d7c06a430 0x7f7d7c06c8f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7d94004ea0 tx=0x7f7d94009040 comp rx=0 tx=0).stop 2023-12-22T08:47:31.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.355+0000 7f7d9f342640 1 -- 172.21.15.38:0/1484191296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9815f340 msgr2=0x7f7d98153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:31.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.355+0000 7f7d9f342640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9815f340 0x7f7d98153ba0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f7d90036040 tx=0x7f7d90004a40 comp rx=0 tx=0).stop 2023-12-22T08:47:31.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.355+0000 7f7d9f342640 1 -- 172.21.15.38:0/1484191296 shutdown_connections 2023-12-22T08:47:31.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.355+0000 7f7d9f342640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d7c06a430 0x7f7d7c06c8f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.355+0000 7f7d9f342640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d9815f340 0x7f7d98153ba0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.355+0000 7f7d9f342640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d9815ef60 0x7f7d981f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.355+0000 7f7d9f342640 1 --2- 172.21.15.38:0/1484191296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d980cca90 0x7f7d98154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.355+0000 7f7d9f342640 1 -- 172.21.15.38:0/1484191296 >> 172.21.15.38:0/1484191296 conn(0x7f7d980b1c70 msgr2=0x7f7d9815a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:31.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.356+0000 7f7d9f342640 1 -- 172.21.15.38:0/1484191296 shutdown_connections 2023-12-22T08:47:31.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.356+0000 7f7d9f342640 1 -- 172.21.15.38:0/1484191296 wait complete. 2023-12-22T08:47:31.376 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:47:04.687287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:47:06.061571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:47:31.376 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:47:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.599+0000 7f266c38b640 1 Processor -- start 2023-12-22T08:47:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.600+0000 7f266c38b640 1 -- start start 2023-12-22T08:47:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.601+0000 7f266c38b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f26640ce990 0x7f26640b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.601+0000 7f266c38b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2664071990 0x7f266415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.601+0000 7f266c38b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26640b3600 0x7f26640b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.601+0000 7f266c38b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266415e130 con 0x7f2664071990 2023-12-22T08:47:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.601+0000 7f266c38b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26640ccee0 con 0x7f26640ce990 2023-12-22T08:47:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.601+0000 7f266c38b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266415e650 con 0x7f26640b3600 2023-12-22T08:47:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.602+0000 7f2669926640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2664071990 0x7f266415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.602+0000 7f2669926640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2664071990 0x7f266415cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37988/0 (socket says 172.21.15.38:37988) 2023-12-22T08:47:31.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.602+0000 7f2669926640 1 -- 172.21.15.38:0/2692113702 learned_addr learned my addr 172.21.15.38:0/2692113702 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:31.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.602+0000 7f266a127640 1 --2- 172.21.15.38:0/2692113702 >> v2:172.21.15.89:3300/0 conn(0x7f26640ce990 0x7f26640b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:31.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.602+0000 7f266a928640 1 --2- 172.21.15.38:0/2692113702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26640b3600 0x7f26640b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:31.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.602+0000 7f2669926640 1 -- 172.21.15.38:0/2692113702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26640b3600 msgr2=0x7f26640b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:31.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.602+0000 7f2669926640 1 --2- 172.21.15.38:0/2692113702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26640b3600 0x7f26640b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.602+0000 7f2669926640 1 -- 172.21.15.38:0/2692113702 >> v2:172.21.15.89:3300/0 conn(0x7f26640ce990 msgr2=0x7f26640b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:31.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.602+0000 7f2669926640 1 --2- 172.21.15.38:0/2692113702 >> v2:172.21.15.89:3300/0 conn(0x7f26640ce990 0x7f26640b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.602+0000 7f2669926640 1 -- 172.21.15.38:0/2692113702 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266415e320 con 0x7f2664071990 2023-12-22T08:47:31.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.602+0000 7f266a127640 1 --2- 172.21.15.38:0/2692113702 >> v2:172.21.15.89:3300/0 conn(0x7f26640ce990 0x7f26640b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:47:31.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.603+0000 7f2669926640 1 --2- 172.21.15.38:0/2692113702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2664071990 0x7f266415cf10 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f26640ccc80 tx=0x7f265402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffaafdd2676a7fd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:31.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.604+0000 7f2669125640 1 -- 172.21.15.38:0/2692113702 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654031750 con 0x7f2664071990 2023-12-22T08:47:31.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.604+0000 7f2669125640 1 -- 172.21.15.38:0/2692113702 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26540318b0 con 0x7f2664071990 2023-12-22T08:47:31.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.604+0000 7f2669125640 1 -- 172.21.15.38:0/2692113702 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654031c40 con 0x7f2664071990 2023-12-22T08:47:31.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.604+0000 7f266c38b640 1 -- 172.21.15.38:0/2692113702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2664071990 msgr2=0x7f266415cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:31.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.604+0000 7f266c38b640 1 --2- 172.21.15.38:0/2692113702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2664071990 0x7f266415cf10 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f26640ccc80 tx=0x7f265402b7f0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.605+0000 7f266c38b640 1 -- 172.21.15.38:0/2692113702 shutdown_connections 2023-12-22T08:47:31.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.605+0000 7f266c38b640 1 --2- 172.21.15.38:0/2692113702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26640b3600 0x7f26640b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.605+0000 7f266c38b640 1 --2- 172.21.15.38:0/2692113702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2664071990 0x7f266415cf10 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.605+0000 7f266c38b640 1 --2- 172.21.15.38:0/2692113702 >> v2:172.21.15.89:3300/0 conn(0x7f26640ce990 0x7f26640b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.605+0000 7f266c38b640 1 -- 172.21.15.38:0/2692113702 >> 172.21.15.38:0/2692113702 conn(0x7f26640b20c0 msgr2=0x7f26640b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:31.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.605+0000 7f266c38b640 1 -- 172.21.15.38:0/2692113702 shutdown_connections 2023-12-22T08:47:31.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.605+0000 7f266c38b640 1 -- 172.21.15.38:0/2692113702 wait complete. 2023-12-22T08:47:31.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.606+0000 7f266c38b640 1 Processor -- start 2023-12-22T08:47:31.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.607+0000 7f266c38b640 1 -- start start 2023-12-22T08:47:31.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.607+0000 7f266c38b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2664071990 0x7f2664158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f266c38b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26640b3600 0x7f2664157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f266c38b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26640ce990 0x7f2664144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f266c38b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2664159c20 con 0x7f26640b3600 2023-12-22T08:47:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f266c38b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2664157db0 con 0x7f26640ce990 2023-12-22T08:47:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f266c38b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2664144fd0 con 0x7f2664071990 2023-12-22T08:47:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f2669926640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26640b3600 0x7f2664157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f2669926640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26640b3600 0x7f2664157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38004/0 (socket says 172.21.15.38:38004) 2023-12-22T08:47:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f2669926640 1 -- 172.21.15.38:0/4120071295 learned_addr learned my addr 172.21.15.38:0/4120071295 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f2669926640 1 -- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2664071990 msgr2=0x7f2664158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f2669926640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2664071990 0x7f2664158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f2669926640 1 -- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26640ce990 msgr2=0x7f2664144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f266a928640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26640ce990 0x7f2664144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f2669926640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26640ce990 0x7f2664144a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f2669926640 1 -- 172.21.15.38:0/4120071295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26540094d0 con 0x7f26640b3600 2023-12-22T08:47:31.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.608+0000 7f266a928640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26640ce990 0x7f2664144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:31.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.609+0000 7f2669926640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26640b3600 0x7f2664157870 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f2654000c00 tx=0x7f26540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:31.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.609+0000 7f265affd640 1 -- 172.21.15.38:0/4120071295 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654033c80 con 0x7f26640b3600 2023-12-22T08:47:31.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.609+0000 7f265affd640 1 -- 172.21.15.38:0/4120071295 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2654033e00 con 0x7f26640b3600 2023-12-22T08:47:31.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.609+0000 7f266c38b640 1 -- 172.21.15.38:0/4120071295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2664159010 con 0x7f26640b3600 2023-12-22T08:47:31.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.609+0000 7f265affd640 1 -- 172.21.15.38:0/4120071295 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265403c640 con 0x7f26640b3600 2023-12-22T08:47:31.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.609+0000 7f266c38b640 1 -- 172.21.15.38:0/4120071295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26641595d0 con 0x7f26640b3600 2023-12-22T08:47:31.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.610+0000 7f266c38b640 1 -- 172.21.15.38:0/4120071295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2664061910 con 0x7f26640b3600 2023-12-22T08:47:31.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.611+0000 7f265affd640 1 -- 172.21.15.38:0/4120071295 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f265403a040 con 0x7f26640b3600 2023-12-22T08:47:31.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.612+0000 7f265affd640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f264806a430 0x7f264806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:31.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.613+0000 7f265affd640 1 -- 172.21.15.38:0/4120071295 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26540aa4e0 con 0x7f26640b3600 2023-12-22T08:47:31.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.613+0000 7f266a127640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f264806a430 0x7f264806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:31.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.614+0000 7f266a127640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f264806a430 0x7f264806c8f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2660006fd0 tx=0x7f2660008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:31.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.617+0000 7f265affd640 1 -- 172.21.15.38:0/4120071295 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2654075ac0 con 0x7f26640b3600 2023-12-22T08:47:31.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.812+0000 7f266c38b640 1 -- 172.21.15.38:0/4120071295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f266415c520 con 0x7f26640b3600 2023-12-22T08:47:31.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.812+0000 7f265affd640 1 -- 172.21.15.38:0/4120071295 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v130) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2654038020 con 0x7f26640b3600 2023-12-22T08:47:31.814 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:47:31.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.815+0000 7f266c38b640 1 -- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f264806a430 msgr2=0x7f264806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:31.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.815+0000 7f266c38b640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f264806a430 0x7f264806c8f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2660006fd0 tx=0x7f2660008040 comp rx=0 tx=0).stop 2023-12-22T08:47:31.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.815+0000 7f266c38b640 1 -- 172.21.15.38:0/4120071295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26640b3600 msgr2=0x7f2664157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:31.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.815+0000 7f266c38b640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26640b3600 0x7f2664157870 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f2654000c00 tx=0x7f26540046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.815+0000 7f266c38b640 1 -- 172.21.15.38:0/4120071295 shutdown_connections 2023-12-22T08:47:31.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.816+0000 7f266c38b640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26640ce990 0x7f2664144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.816+0000 7f266c38b640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f264806a430 0x7f264806c8f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.816+0000 7f266c38b640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26640b3600 0x7f2664157870 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.816+0000 7f266c38b640 1 --2- 172.21.15.38:0/4120071295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2664071990 0x7f2664158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:31.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.816+0000 7f266c38b640 1 -- 172.21.15.38:0/4120071295 >> 172.21.15.38:0/4120071295 conn(0x7f26640b20c0 msgr2=0x7f26640cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:31.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.816+0000 7f266c38b640 1 -- 172.21.15.38:0/4120071295 shutdown_connections 2023-12-22T08:47:31.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:31.816+0000 7f266c38b640 1 -- 172.21.15.38:0/4120071295 wait complete. 2023-12-22T08:47:31.837 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:47:32.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.071+0000 7f2f83841640 1 Processor -- start 2023-12-22T08:47:32.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.071+0000 7f2f83841640 1 -- start start 2023-12-22T08:47:32.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.073+0000 7f2f83841640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2f7c0b3f90 0x7f2f7c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.073+0000 7f2f83841640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7c15eb20 con 0x7f2f7c15e740 2023-12-22T08:47:32.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.073+0000 7f2f83841640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7c070770 con 0x7f2f7c06ca50 2023-12-22T08:47:32.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.073+0000 7f2f83841640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7c06e650 con 0x7f2f7c0b3f90 2023-12-22T08:47:32.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.073+0000 7f2f815dd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2f7c15e740 0x7f2f7c0b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58824/0 (socket says 172.21.15.38:58824) 2023-12-22T08:47:32.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.073+0000 7f2f815dd640 1 -- 172.21.15.38:0/3155435678 learned_addr learned my addr 172.21.15.38:0/3155435678 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:32.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.074+0000 7f2f80ddc640 1 --2- 172.21.15.38:0/3155435678 >> v2:172.21.15.89:3300/0 conn(0x7f2f7c0b3f90 0x7f2f7c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.074+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429944657 0 0) 0x7f2f7c15eb20 con 0x7f2f7c15e740 2023-12-22T08:47:32.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.074+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f68003520 con 0x7f2f7c15e740 2023-12-22T08:47:32.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.074+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1775052276 0 0) 0x7f2f68003520 con 0x7f2f7c15e740 2023-12-22T08:47:32.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.074+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 >> v2:172.21.15.89:3300/0 conn(0x7f2f7c0b3f90 msgr2=0x7f2f7c15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:32.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.074+0000 7f2f73fff640 1 --2- 172.21.15.38:0/3155435678 >> v2:172.21.15.89:3300/0 conn(0x7f2f7c0b3f90 0x7f2f7c15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.074+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 >> v1:172.21.15.89:6789/0 conn(0x7f2f7c06ca50 legacy=0x7f2f7c070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:32.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.074+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c06d180 con 0x7f2f7c15e740 2023-12-22T08:47:32.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.074+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f2f78001670 con 0x7f2f7c15e740 2023-12-22T08:47:32.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 >> v1:172.21.15.38:6789/0 conn(0x7f2f7c15e740 legacy=0x7f2f7c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:32.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f73fff640 1 --2- 172.21.15.38:0/3155435678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f68003970 0x7f2f68003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f73fff640 1 --2- 172.21.15.38:0/3155435678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f680047c0 0x7f2f68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f73fff640 1 --2- 172.21.15.38:0/3155435678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f680052a0 0x7f2f6800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c06e650 con 0x7f2f680047c0 2023-12-22T08:47:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6800c170 con 0x7f2f68003970 2023-12-22T08:47:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6800c330 con 0x7f2f680052a0 2023-12-22T08:47:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f80ddc640 1 --2- 172.21.15.38:0/3155435678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f680047c0 0x7f2f68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f815dd640 1 --2- 172.21.15.38:0/3155435678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f68003970 0x7f2f68003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f81dde640 1 --2- 172.21.15.38:0/3155435678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f680052a0 0x7f2f6800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f80ddc640 1 -- 172.21.15.38:0/3155435678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f680052a0 msgr2=0x7f2f6800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f80ddc640 1 --2- 172.21.15.38:0/3155435678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f680052a0 0x7f2f6800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f80ddc640 1 -- 172.21.15.38:0/3155435678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f68003970 msgr2=0x7f2f68003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.075+0000 7f2f80ddc640 1 --2- 172.21.15.38:0/3155435678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f68003970 0x7f2f68003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.076+0000 7f2f80ddc640 1 -- 172.21.15.38:0/3155435678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68003520 con 0x7f2f680047c0 2023-12-22T08:47:32.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.076+0000 7f2f81dde640 1 -- 172.21.15.38:0/3155435678 reap_dead start 2023-12-22T08:47:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.077+0000 7f2f80ddc640 1 --2- 172.21.15.38:0/3155435678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f680047c0 0x7f2f68004c40 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009a90 tx=0x7f2f680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cac465671caf791 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.077+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c02c680 con 0x7f2f680047c0 2023-12-22T08:47:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.077+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c02c7e0 con 0x7f2f680047c0 2023-12-22T08:47:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.077+0000 7f2f73fff640 1 -- 172.21.15.38:0/3155435678 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c02cb70 con 0x7f2f680047c0 2023-12-22T08:47:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.078+0000 7f2f83841640 1 -- 172.21.15.38:0/3155435678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f680047c0 msgr2=0x7f2f68004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.078+0000 7f2f83841640 1 --2- 172.21.15.38:0/3155435678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f680047c0 0x7f2f68004c40 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009a90 tx=0x7f2f680057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.078+0000 7f2f83841640 1 -- 172.21.15.38:0/3155435678 shutdown_connections 2023-12-22T08:47:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.078+0000 7f2f83841640 1 --2- 172.21.15.38:0/3155435678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f680047c0 0x7f2f68004c40 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.078+0000 7f2f83841640 1 -- 172.21.15.38:0/3155435678 >> 172.21.15.38:0/3155435678 conn(0x7f2f7c0cfea0 msgr2=0x7f2f7c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.078+0000 7f2f83841640 1 -- 172.21.15.38:0/3155435678 shutdown_connections 2023-12-22T08:47:32.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.078+0000 7f2f83841640 1 -- 172.21.15.38:0/3155435678 wait complete. 2023-12-22T08:47:32.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.080+0000 7f2f83841640 1 Processor -- start 2023-12-22T08:47:32.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.080+0000 7f2f83841640 1 -- start start 2023-12-22T08:47:32.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.081+0000 7f2f83841640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f680047c0 0x7f2f7c1f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.081+0000 7f2f83841640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f7c146800 0x7f2f7c0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.081+0000 7f2f83841640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f7c0ace20 0x7f2f7c1488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.081+0000 7f2f83841640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c15b730 con 0x7f2f680047c0 2023-12-22T08:47:32.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.081+0000 7f2f83841640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0ad2a0 con 0x7f2f7c146800 2023-12-22T08:47:32.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.081+0000 7f2f83841640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c146c80 con 0x7f2f7c0ace20 2023-12-22T08:47:32.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.081+0000 7f2f815dd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f680047c0 0x7f2f7c1f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.081+0000 7f2f815dd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f680047c0 0x7f2f7c1f3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38026/0 (socket says 172.21.15.38:38026) 2023-12-22T08:47:32.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.081+0000 7f2f815dd640 1 -- 172.21.15.38:0/1162033103 learned_addr learned my addr 172.21.15.38:0/1162033103 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:32.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.081+0000 7f2f80ddc640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f7c146800 0x7f2f7c0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.081+0000 7f2f815dd640 1 -- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f7c0ace20 msgr2=0x7f2f7c1488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:32.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.081+0000 7f2f81dde640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f7c0ace20 0x7f2f7c1488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.082+0000 7f2f815dd640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f7c0ace20 0x7f2f7c1488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.082+0000 7f2f815dd640 1 -- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f7c146800 msgr2=0x7f2f7c0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:32.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.082+0000 7f2f815dd640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f7c146800 0x7f2f7c0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.082+0000 7f2f815dd640 1 -- 172.21.15.38:0/1162033103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c149630 con 0x7f2f680047c0 2023-12-22T08:47:32.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.082+0000 7f2f80ddc640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f7c146800 0x7f2f7c0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:32.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.082+0000 7f2f815dd640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f680047c0 0x7f2f7c1f3770 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800e730 tx=0x7f2f7800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:32.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.082+0000 7f2f71ffb640 1 -- 172.21.15.38:0/1162033103 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800c6c0 con 0x7f2f680047c0 2023-12-22T08:47:32.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.082+0000 7f2f71ffb640 1 -- 172.21.15.38:0/1162033103 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7800c820 con 0x7f2f680047c0 2023-12-22T08:47:32.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.082+0000 7f2f83841640 1 -- 172.21.15.38:0/1162033103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7c15b940 con 0x7f2f680047c0 2023-12-22T08:47:32.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.082+0000 7f2f71ffb640 1 -- 172.21.15.38:0/1162033103 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800cbd0 con 0x7f2f680047c0 2023-12-22T08:47:32.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.082+0000 7f2f83841640 1 -- 172.21.15.38:0/1162033103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c15bf00 con 0x7f2f680047c0 2023-12-22T08:47:32.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.084+0000 7f2f83841640 1 -- 172.21.15.38:0/1162033103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7c061910 con 0x7f2f680047c0 2023-12-22T08:47:32.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.085+0000 7f2f71ffb640 1 -- 172.21.15.38:0/1162033103 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2f7800cd30 con 0x7f2f680047c0 2023-12-22T08:47:32.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.086+0000 7f2f71ffb640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2f6006a460 0x7f2f6006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.086+0000 7f2f71ffb640 1 -- 172.21.15.38:0/1162033103 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f78088790 con 0x7f2f680047c0 2023-12-22T08:47:32.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.086+0000 7f2f80ddc640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2f6006a460 0x7f2f6006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.087+0000 7f2f80ddc640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2f6006a460 0x7f2f6006c920 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c036000 tx=0x7f2f6c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:32.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.090+0000 7f2f71ffb640 1 -- 172.21.15.38:0/1162033103 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2f78053ce0 con 0x7f2f680047c0 2023-12-22T08:47:32.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.296+0000 7f2f83841640 1 -- 172.21.15.38:0/1162033103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f7c0cf760 con 0x7f2f680047c0 2023-12-22T08:47:32.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.297+0000 7f2f71ffb640 1 -- 172.21.15.38:0/1162033103 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v130) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f78057300 con 0x7f2f680047c0 2023-12-22T08:47:32.298 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:47:32.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.299+0000 7f2f83841640 1 -- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2f6006a460 msgr2=0x7f2f6006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:32.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.299+0000 7f2f83841640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2f6006a460 0x7f2f6006c920 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c036000 tx=0x7f2f6c030000 comp rx=0 tx=0).stop 2023-12-22T08:47:32.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.299+0000 7f2f83841640 1 -- 172.21.15.38:0/1162033103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f680047c0 msgr2=0x7f2f7c1f3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:32.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.299+0000 7f2f83841640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f680047c0 0x7f2f7c1f3770 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800e730 tx=0x7f2f7800ebf0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.299+0000 7f2f83841640 1 -- 172.21.15.38:0/1162033103 shutdown_connections 2023-12-22T08:47:32.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.299+0000 7f2f83841640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f7c0ace20 0x7f2f7c1488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.299+0000 7f2f83841640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f7c146800 0x7f2f7c0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.299+0000 7f2f83841640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2f6006a460 0x7f2f6006c920 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.299+0000 7f2f83841640 1 --2- 172.21.15.38:0/1162033103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f680047c0 0x7f2f7c1f3770 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.299+0000 7f2f83841640 1 -- 172.21.15.38:0/1162033103 >> 172.21.15.38:0/1162033103 conn(0x7f2f7c0cfea0 msgr2=0x7f2f7c15ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:32.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.300+0000 7f2f83841640 1 -- 172.21.15.38:0/1162033103 shutdown_connections 2023-12-22T08:47:32.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.300+0000 7f2f83841640 1 -- 172.21.15.38:0/1162033103 wait complete. 2023-12-22T08:47:32.323 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:47:32.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.546+0000 7ff9c8f62640 1 Processor -- start 2023-12-22T08:47:32.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.547+0000 7ff9c8f62640 1 -- start start 2023-12-22T08:47:32.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.548+0000 7ff9c8f62640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9c415d1c0 0x7ff9c4070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.548+0000 7ff9c8f62640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9c415d5a0 0x7ff9c4070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.548+0000 7ff9c8f62640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c415de50 con 0x7ff9c40d0060 2023-12-22T08:47:32.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.549+0000 7ff9c8f62640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c40d0be0 con 0x7ff9c415d5a0 2023-12-22T08:47:32.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.549+0000 7ff9c8f62640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40d0dd0 con 0x7ff9c415d1c0 2023-12-22T08:47:32.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.549+0000 7ff9c3fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff9c40d0060 0x7ff9c40d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58836/0 (socket says 172.21.15.38:58836) 2023-12-22T08:47:32.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.549+0000 7ff9c3fff640 1 -- 172.21.15.38:0/2455574035 learned_addr learned my addr 172.21.15.38:0/2455574035 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:32.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.549+0000 7ff9c37fe640 1 --2- 172.21.15.38:0/2455574035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9c415d1c0 0x7ff9c4070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.549+0000 7ff9c2ffd640 1 --2- 172.21.15.38:0/2455574035 >> v2:172.21.15.89:3300/0 conn(0x7ff9c415d5a0 0x7ff9c4070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.549+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625983437 0 0) 0x7ff9c415de50 con 0x7ff9c40d0060 2023-12-22T08:47:32.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.549+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b0003520 con 0x7ff9c40d0060 2023-12-22T08:47:32.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 672735063 0 0) 0x7ff9b0003520 con 0x7ff9c40d0060 2023-12-22T08:47:32.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9c415d1c0 msgr2=0x7ff9c4070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:32.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 --2- 172.21.15.38:0/2455574035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9c415d1c0 0x7ff9c4070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 >> v2:172.21.15.89:3300/0 conn(0x7ff9c415d5a0 msgr2=0x7ff9c4070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:32.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 --2- 172.21.15.38:0/2455574035 >> v2:172.21.15.89:3300/0 conn(0x7ff9c415d5a0 0x7ff9c4070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c40d10b0 con 0x7ff9c40d0060 2023-12-22T08:47:32.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7ff9bc001670 con 0x7ff9c40d0060 2023-12-22T08:47:32.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 >> v1:172.21.15.38:6789/0 conn(0x7ff9c40d0060 legacy=0x7ff9c40d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:32.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 --2- 172.21.15.38:0/2455574035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9c415d1c0 0x7ff9b0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 --2- 172.21.15.38:0/2455574035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b0003f40 0x7ff9b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 --2- 172.21.15.38:0/2455574035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b0004d00 0x7ff9b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40d0dd0 con 0x7ff9b0003f40 2023-12-22T08:47:32.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b000b980 con 0x7ff9b0004d00 2023-12-22T08:47:32.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b000bac0 con 0x7ff9c415d1c0 2023-12-22T08:47:32.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.550+0000 7ff9c2ffd640 1 --2- 172.21.15.38:0/2455574035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b0003f40 0x7ff9b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.551+0000 7ff9c37fe640 1 --2- 172.21.15.38:0/2455574035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9c415d1c0 0x7ff9b0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.551+0000 7ff9c2ffd640 1 -- 172.21.15.38:0/2455574035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9c415d1c0 msgr2=0x7ff9b0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:32.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.551+0000 7ff9c2ffd640 1 --2- 172.21.15.38:0/2455574035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9c415d1c0 0x7ff9b0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.551+0000 7ff9c2ffd640 1 -- 172.21.15.38:0/2455574035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b0004d00 msgr2=0x7ff9b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:32.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.551+0000 7ff9c2ffd640 1 --2- 172.21.15.38:0/2455574035 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b0004d00 0x7ff9b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.551+0000 7ff9c2ffd640 1 -- 172.21.15.38:0/2455574035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0003520 con 0x7ff9b0003f40 2023-12-22T08:47:32.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.551+0000 7ff9c37fe640 1 --2- 172.21.15.38:0/2455574035 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9c415d1c0 0x7ff9b0003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:32.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.552+0000 7ff9c2ffd640 1 --2- 172.21.15.38:0/2455574035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b0003f40 0x7ff9b00047c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009af0 tx=0x7ff9b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1601727399fc881c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:32.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.552+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac02c710 con 0x7ff9b0003f40 2023-12-22T08:47:32.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.552+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac02c870 con 0x7ff9b0003f40 2023-12-22T08:47:32.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.552+0000 7ff9c27fc640 1 -- 172.21.15.38:0/2455574035 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac02cc00 con 0x7ff9b0003f40 2023-12-22T08:47:32.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.553+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2455574035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b0003f40 msgr2=0x7ff9b00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:32.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.553+0000 7ff9c8f62640 1 --2- 172.21.15.38:0/2455574035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b0003f40 0x7ff9b00047c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009af0 tx=0x7ff9b00057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.553+0000 7ff9c3fff640 1 -- 172.21.15.38:0/2455574035 reap_dead start 2023-12-22T08:47:32.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.553+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2455574035 shutdown_connections 2023-12-22T08:47:32.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.553+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2455574035 >> 172.21.15.38:0/2455574035 conn(0x7ff9c406bf90 msgr2=0x7ff9c406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:32.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.553+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2455574035 shutdown_connections 2023-12-22T08:47:32.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.553+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2455574035 wait complete. 2023-12-22T08:47:32.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.555+0000 7ff9c8f62640 1 Processor -- start 2023-12-22T08:47:32.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.555+0000 7ff9c8f62640 1 -- start start 2023-12-22T08:47:32.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.556+0000 7ff9c8f62640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b0003f40 0x7ff9c4159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.556+0000 7ff9c8f62640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c40700d0 0x7ff9c414f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.556+0000 7ff9c8f62640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9c414fe70 0x7ff9c406f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.556+0000 7ff9c8f62640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c41596b0 con 0x7ff9b0003f40 2023-12-22T08:47:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.556+0000 7ff9c8f62640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c414fd00 con 0x7ff9c40700d0 2023-12-22T08:47:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.556+0000 7ff9c8f62640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4070620 con 0x7ff9c414fe70 2023-12-22T08:47:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.556+0000 7ff9c37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b0003f40 0x7ff9c4159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.556+0000 7ff9c37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b0003f40 0x7ff9c4159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38036/0 (socket says 172.21.15.38:38036) 2023-12-22T08:47:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.556+0000 7ff9c37fe640 1 -- 172.21.15.38:0/2816335235 learned_addr learned my addr 172.21.15.38:0/2816335235 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.557+0000 7ff9c2ffd640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c40700d0 0x7ff9c414f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.557+0000 7ff9c37fe640 1 -- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9c414fe70 msgr2=0x7ff9c406f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.557+0000 7ff9c37fe640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9c414fe70 0x7ff9c406f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.557+0000 7ff9c37fe640 1 -- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c40700d0 msgr2=0x7ff9c414f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.557+0000 7ff9c37fe640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c40700d0 0x7ff9c414f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.557+0000 7ff9c37fe640 1 -- 172.21.15.38:0/2816335235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4158690 con 0x7ff9b0003f40 2023-12-22T08:47:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.557+0000 7ff9c2ffd640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c40700d0 0x7ff9c414f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.557+0000 7ff9c37fe640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b0003f40 0x7ff9c4159170 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400f350 tx=0x7ff9b400f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.557+0000 7ff9bbfff640 1 -- 172.21.15.38:0/2816335235 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4003b90 con 0x7ff9b0003f40 2023-12-22T08:47:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.557+0000 7ff9bbfff640 1 -- 172.21.15.38:0/2816335235 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b4011040 con 0x7ff9b0003f40 2023-12-22T08:47:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.557+0000 7ff9bbfff640 1 -- 172.21.15.38:0/2816335235 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4004020 con 0x7ff9b0003f40 2023-12-22T08:47:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.557+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2816335235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c4158970 con 0x7ff9b0003f40 2023-12-22T08:47:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.557+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2816335235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c41504c0 con 0x7ff9b0003f40 2023-12-22T08:47:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.558+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2816335235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c4061910 con 0x7ff9b0003f40 2023-12-22T08:47:32.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.560+0000 7ff9bbfff640 1 -- 172.21.15.38:0/2816335235 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff9b4004180 con 0x7ff9b0003f40 2023-12-22T08:47:32.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.561+0000 7ff9bbfff640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff9a406a430 0x7ff9a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:32.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.561+0000 7ff9bbfff640 1 -- 172.21.15.38:0/2816335235 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9b4089020 con 0x7ff9b0003f40 2023-12-22T08:47:32.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.561+0000 7ff9c2ffd640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff9a406a430 0x7ff9a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:32.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.562+0000 7ff9c2ffd640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff9a406a430 0x7ff9a406c8f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac036000 tx=0x7ff9ac030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.565+0000 7ff9bbfff640 1 -- 172.21.15.38:0/2816335235 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff9b4054580 con 0x7ff9b0003f40 2023-12-22T08:47:32.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.760+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2816335235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9c40d2a80 con 0x7ff9b0003f40 2023-12-22T08:47:32.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.760+0000 7ff9bbfff640 1 -- 172.21.15.38:0/2816335235 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v130) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9b4057ba0 con 0x7ff9b0003f40 2023-12-22T08:47:32.762 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:47:32.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.763+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff9a406a430 msgr2=0x7ff9a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:32.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.763+0000 7ff9c8f62640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff9a406a430 0x7ff9a406c8f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac036000 tx=0x7ff9ac030000 comp rx=0 tx=0).stop 2023-12-22T08:47:32.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.763+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2816335235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b0003f40 msgr2=0x7ff9c4159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:32.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.763+0000 7ff9c8f62640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b0003f40 0x7ff9c4159170 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400f350 tx=0x7ff9b400f810 comp rx=0 tx=0).stop 2023-12-22T08:47:32.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.763+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2816335235 shutdown_connections 2023-12-22T08:47:32.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.763+0000 7ff9c8f62640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9c414fe70 0x7ff9c406f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.763+0000 7ff9c8f62640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9c40700d0 0x7ff9c414f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.763+0000 7ff9c8f62640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff9a406a430 0x7ff9a406c8f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:32.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.763+0000 7ff9c8f62640 1 --2- 172.21.15.38:0/2816335235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b0003f40 0x7ff9c4159170 secure :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400f350 tx=0x7ff9b400f810 comp rx=0 tx=0).stop 2023-12-22T08:47:32.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.763+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2816335235 >> 172.21.15.38:0/2816335235 conn(0x7ff9c406bf90 msgr2=0x7ff9c4160160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:32.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.764+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2816335235 shutdown_connections 2023-12-22T08:47:32.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:32.764+0000 7ff9c8f62640 1 -- 172.21.15.38:0/2816335235 wait complete. 2023-12-22T08:47:32.785 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:47:33.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.003+0000 7fd55bfff640 1 Processor -- start 2023-12-22T08:47:33.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.004+0000 7fd55bfff640 1 -- start start 2023-12-22T08:47:33.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.005+0000 7fd55bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd55c0a44a0 0x7fd55c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.005+0000 7fd55bfff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55c0cdae0 con 0x7fd55c070e30 2023-12-22T08:47:33.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.006+0000 7fd55bfff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55c071250 con 0x7fd55c15b420 2023-12-22T08:47:33.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.006+0000 7fd55bfff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55c15b800 con 0x7fd55c0a44a0 2023-12-22T08:47:33.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.006+0000 7fd55b7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd55c070e30 0x7fd55c15baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58840/0 (socket says 172.21.15.38:58840) 2023-12-22T08:47:33.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.006+0000 7fd55b7fe640 1 -- 172.21.15.38:0/4282462458 learned_addr learned my addr 172.21.15.38:0/4282462458 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:33.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.006+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605720357 0 0) 0x7fd55c0cdae0 con 0x7fd55c070e30 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.006+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd548003520 con 0x7fd55c070e30 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.006+0000 7fd553fff640 1 --2- 172.21.15.38:0/4282462458 >> v2:172.21.15.89:3300/0 conn(0x7fd55c0a44a0 0x7fd55c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.007+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1551522510 0 0) 0x7fd548003520 con 0x7fd55c070e30 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.007+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 >> v2:172.21.15.89:3300/0 conn(0x7fd55c0a44a0 msgr2=0x7fd55c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.007+0000 7fd55a7fc640 1 --2- 172.21.15.38:0/4282462458 >> v2:172.21.15.89:3300/0 conn(0x7fd55c0a44a0 0x7fd55c0708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.007+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 >> v1:172.21.15.89:6789/0 conn(0x7fd55c15b420 legacy=0x7fd55c06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.007+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c0cdd30 con 0x7fd55c070e30 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.007+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fd5540019f0 con 0x7fd55c070e30 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.007+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 >> v1:172.21.15.38:6789/0 conn(0x7fd55c070e30 legacy=0x7fd55c15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.007+0000 7fd55a7fc640 1 --2- 172.21.15.38:0/4282462458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd548003970 0x7fd548003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.007+0000 7fd55a7fc640 1 --2- 172.21.15.38:0/4282462458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd548004370 0x7fd548004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.007+0000 7fd55a7fc640 1 --2- 172.21.15.38:0/4282462458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd548005040 0x7fd54800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.007+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c15b800 con 0x7fd548005040 2023-12-22T08:47:33.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.007+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54800bfa0 con 0x7fd548003970 2023-12-22T08:47:33.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.007+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54800c160 con 0x7fd548004370 2023-12-22T08:47:33.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.008+0000 7fd55b7fe640 1 --2- 172.21.15.38:0/4282462458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd548005040 0x7fd54800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.008+0000 7fd553fff640 1 --2- 172.21.15.38:0/4282462458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd548004370 0x7fd548004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.008+0000 7fd55affd640 1 --2- 172.21.15.38:0/4282462458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd548003970 0x7fd548003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.008+0000 7fd55b7fe640 1 -- 172.21.15.38:0/4282462458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd548004370 msgr2=0x7fd548004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.008+0000 7fd55b7fe640 1 --2- 172.21.15.38:0/4282462458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd548004370 0x7fd548004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.008+0000 7fd55b7fe640 1 -- 172.21.15.38:0/4282462458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd548003970 msgr2=0x7fd548003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.008+0000 7fd55b7fe640 1 --2- 172.21.15.38:0/4282462458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd548003970 0x7fd548003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.008+0000 7fd55b7fe640 1 -- 172.21.15.38:0/4282462458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd548003520 con 0x7fd548005040 2023-12-22T08:47:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.009+0000 7fd55b7fe640 1 -- 172.21.15.38:0/4282462458 reap_dead start 2023-12-22T08:47:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.009+0000 7fd55b7fe640 1 --2- 172.21.15.38:0/4282462458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd548005040 0x7fd54800b980 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fd55400a830 tx=0x7fd5480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5971f6352befee50 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.009+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55402cea0 con 0x7fd548005040 2023-12-22T08:47:33.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.009+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55402f070 con 0x7fd548005040 2023-12-22T08:47:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.009+0000 7fd55a7fc640 1 -- 172.21.15.38:0/4282462458 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554034890 con 0x7fd548005040 2023-12-22T08:47:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.010+0000 7fd55bfff640 1 -- 172.21.15.38:0/4282462458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd548005040 msgr2=0x7fd54800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.010+0000 7fd55bfff640 1 --2- 172.21.15.38:0/4282462458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd548005040 0x7fd54800b980 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fd55400a830 tx=0x7fd5480057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.010+0000 7fd55bfff640 1 -- 172.21.15.38:0/4282462458 shutdown_connections 2023-12-22T08:47:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.010+0000 7fd55bfff640 1 --2- 172.21.15.38:0/4282462458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd548005040 0x7fd54800b980 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.010+0000 7fd55bfff640 1 -- 172.21.15.38:0/4282462458 >> 172.21.15.38:0/4282462458 conn(0x7fd55c0b1f70 msgr2=0x7fd55c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.010+0000 7fd55bfff640 1 -- 172.21.15.38:0/4282462458 shutdown_connections 2023-12-22T08:47:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.010+0000 7fd55bfff640 1 -- 172.21.15.38:0/4282462458 wait complete. 2023-12-22T08:47:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.012+0000 7fd55bfff640 1 Processor -- start 2023-12-22T08:47:33.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.012+0000 7fd55bfff640 1 -- start start 2023-12-22T08:47:33.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.013+0000 7fd55bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd548005040 0x7fd55c0a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.013+0000 7fd55bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd55c0a0d10 0x7fd55c1472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.013+0000 7fd55bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd55c09aba0 0x7fd55c09b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.013+0000 7fd55bfff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c158d20 con 0x7fd55c09aba0 2023-12-22T08:47:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.013+0000 7fd55bfff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c0a1db0 con 0x7fd55c0a0d10 2023-12-22T08:47:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.013+0000 7fd55bfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c147820 con 0x7fd548005040 2023-12-22T08:47:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.014+0000 7fd55b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd55c09aba0 0x7fd55c09b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.014+0000 7fd55b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd55c09aba0 0x7fd55c09b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38044/0 (socket says 172.21.15.38:38044) 2023-12-22T08:47:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.014+0000 7fd55b7fe640 1 -- 172.21.15.38:0/1734844367 learned_addr learned my addr 172.21.15.38:0/1734844367 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.014+0000 7fd55affd640 1 --2- 172.21.15.38:0/1734844367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd548005040 0x7fd55c0a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.014+0000 7fd55b7fe640 1 -- 172.21.15.38:0/1734844367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd548005040 msgr2=0x7fd55c0a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.014+0000 7fd55b7fe640 1 --2- 172.21.15.38:0/1734844367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd548005040 0x7fd55c0a2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.014+0000 7fd55b7fe640 1 -- 172.21.15.38:0/1734844367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd55c0a0d10 msgr2=0x7fd55c1472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.014+0000 7fd55b7fe640 1 --2- 172.21.15.38:0/1734844367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd55c0a0d10 0x7fd55c1472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.014+0000 7fd55b7fe640 1 -- 172.21.15.38:0/1734844367 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c0a11a0 con 0x7fd55c09aba0 2023-12-22T08:47:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.014+0000 7fd55b7fe640 1 --2- 172.21.15.38:0/1734844367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd55c09aba0 0x7fd55c09b5b0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fd554002230 tx=0x7fd554001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.015+0000 7fd5537fe640 1 -- 172.21.15.38:0/1734844367 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5540019b0 con 0x7fd55c09aba0 2023-12-22T08:47:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.015+0000 7fd5537fe640 1 -- 172.21.15.38:0/1734844367 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd554001b10 con 0x7fd55c09aba0 2023-12-22T08:47:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.015+0000 7fd5537fe640 1 -- 172.21.15.38:0/1734844367 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55403f690 con 0x7fd55c09aba0 2023-12-22T08:47:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.015+0000 7fd55bfff640 1 -- 172.21.15.38:0/1734844367 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55c0a1480 con 0x7fd55c09aba0 2023-12-22T08:47:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.015+0000 7fd55bfff640 1 -- 172.21.15.38:0/1734844367 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55c0a1a40 con 0x7fd55c09aba0 2023-12-22T08:47:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.016+0000 7fd55bfff640 1 -- 172.21.15.38:0/1734844367 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55c0a1f40 con 0x7fd55c09aba0 2023-12-22T08:47:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.017+0000 7fd5537fe640 1 -- 172.21.15.38:0/1734844367 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd554031030 con 0x7fd55c09aba0 2023-12-22T08:47:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.018+0000 7fd5537fe640 1 --2- 172.21.15.38:0/1734844367 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd53c06a430 0x7fd53c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.018+0000 7fd5537fe640 1 -- 172.21.15.38:0/1734844367 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5540a9cc0 con 0x7fd55c09aba0 2023-12-22T08:47:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.018+0000 7fd55affd640 1 --2- 172.21.15.38:0/1734844367 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd53c06a430 0x7fd53c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.020+0000 7fd55affd640 1 --2- 172.21.15.38:0/1734844367 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd53c06a430 0x7fd53c06c8f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0016a0 tx=0x7fd54c007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:33.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.022+0000 7fd5537fe640 1 -- 172.21.15.38:0/1734844367 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd5540b0080 con 0x7fd55c09aba0 2023-12-22T08:47:33.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.251+0000 7fd55bfff640 1 -- 172.21.15.38:0/1734844367 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd55c061910 con 0x7fd55c09aba0 2023-12-22T08:47:33.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.253+0000 7fd5537fe640 1 -- 172.21.15.38:0/1734844367 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4647 (secure 0 0 0) 0x7fd554044070 con 0x7fd55c09aba0 2023-12-22T08:47:33.254 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:33.254 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/186375012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":186375012},{"type":"v1","addr":"172.21.15.89:6837","nonce":186375012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1819583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1819583870},{"type":"v1","addr":"172.21.15.89:6835","nonce":1819583870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3793773672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3793773672},{"type":"v1","addr":"172.21.15.38:6834","nonce":3793773672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:07.035669+0000","modified":"2023-12-22T08:47:10.565916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7293":{"gid":7293,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3340763944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3340763944},{"type":"v1","addr":"172.21.15.38:6835","nonce":3340763944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-22T08:47:33.255 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 55 2023-12-22T08:47:33.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.255+0000 7fd55bfff640 1 -- 172.21.15.38:0/1734844367 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd53c06a430 msgr2=0x7fd53c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.255+0000 7fd55bfff640 1 --2- 172.21.15.38:0/1734844367 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd53c06a430 0x7fd53c06c8f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0016a0 tx=0x7fd54c007a90 comp rx=0 tx=0).stop 2023-12-22T08:47:33.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.255+0000 7fd55bfff640 1 -- 172.21.15.38:0/1734844367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd55c09aba0 msgr2=0x7fd55c09b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.255+0000 7fd55bfff640 1 --2- 172.21.15.38:0/1734844367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd55c09aba0 0x7fd55c09b5b0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fd554002230 tx=0x7fd554001d80 comp rx=0 tx=0).stop 2023-12-22T08:47:33.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.255+0000 7fd55bfff640 1 -- 172.21.15.38:0/1734844367 shutdown_connections 2023-12-22T08:47:33.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.255+0000 7fd55bfff640 1 --2- 172.21.15.38:0/1734844367 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd53c06a430 0x7fd53c06c8f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.255+0000 7fd55bfff640 1 --2- 172.21.15.38:0/1734844367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd55c09aba0 0x7fd55c09b5b0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.255+0000 7fd55bfff640 1 --2- 172.21.15.38:0/1734844367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd55c0a0d10 0x7fd55c1472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.255+0000 7fd55bfff640 1 --2- 172.21.15.38:0/1734844367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd548005040 0x7fd55c0a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.255+0000 7fd55bfff640 1 -- 172.21.15.38:0/1734844367 >> 172.21.15.38:0/1734844367 conn(0x7fd55c0b1f70 msgr2=0x7fd55c15e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:33.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.255+0000 7fd55bfff640 1 -- 172.21.15.38:0/1734844367 shutdown_connections 2023-12-22T08:47:33.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.256+0000 7fd55bfff640 1 -- 172.21.15.38:0/1734844367 wait complete. 2023-12-22T08:47:33.276 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:33.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.502+0000 7f6542099640 1 Processor -- start 2023-12-22T08:47:33.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.502+0000 7f6542099640 1 -- start start 2023-12-22T08:47:33.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.504+0000 7f6542099640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f653c157980 0x7f653c15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.504+0000 7f6542099640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653c0d1520 con 0x7f653c0b3ff0 2023-12-22T08:47:33.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.504+0000 7f6542099640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653c0d1800 con 0x7f653c06d640 2023-12-22T08:47:33.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.504+0000 7f6542099640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0d1ae0 con 0x7f653c157980 2023-12-22T08:47:33.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.504+0000 7f6540896640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f653c0b3ff0 0x7f653c06cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58842/0 (socket says 172.21.15.38:58842) 2023-12-22T08:47:33.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.504+0000 7f6540896640 1 -- 172.21.15.38:0/1214857124 learned_addr learned my addr 172.21.15.38:0/1214857124 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:33.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034459717 0 0) 0x7f653c0d1520 con 0x7f653c0b3ff0 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6528003520 con 0x7f653c0b3ff0 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6541097640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f653c157980 0x7f653c15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 680461306 0 0) 0x7f6528003520 con 0x7f653c0b3ff0 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f653c157980 msgr2=0x7f653c15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f653c157980 0x7f653c15eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 >> v1:172.21.15.89:6789/0 conn(0x7f653c06d640 legacy=0x7f653c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c0d1dc0 con 0x7f653c0b3ff0 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f652c001670 con 0x7f653c0b3ff0 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6541097640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f653c157980 0x7f653c15eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 >> v1:172.21.15.38:6789/0 conn(0x7f653c0b3ff0 legacy=0x7f653c06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65280039a0 0x7f6528003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f653c157980 0x7f65280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6528004d00 0x7f6528005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0d1ae0 con 0x7f6528004d00 2023-12-22T08:47:33.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652800ba90 con 0x7f65280039a0 2023-12-22T08:47:33.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.505+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652800bc50 con 0x7f653c157980 2023-12-22T08:47:33.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.506+0000 7f6541898640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6528004d00 0x7f6528005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.506+0000 7f6540896640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f653c157980 0x7f65280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.506+0000 7f6541097640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65280039a0 0x7f6528003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.506+0000 7f6541898640 1 -- 172.21.15.38:0/1214857124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f653c157980 msgr2=0x7f65280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:33.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.506+0000 7f6541898640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f653c157980 0x7f65280047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.506+0000 7f6541898640 1 -- 172.21.15.38:0/1214857124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65280039a0 msgr2=0x7f6528003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:33.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.506+0000 7f6541898640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65280039a0 0x7f6528003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.506+0000 7f6541898640 1 -- 172.21.15.38:0/1214857124 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528003520 con 0x7f6528004d00 2023-12-22T08:47:33.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.506+0000 7f6541097640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65280039a0 0x7f6528003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.507+0000 7f6541898640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6528004d00 0x7f6528005180 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f653c0b3250 tx=0x7f65280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a8b0fec95717a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.508+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534003b70 con 0x7f6528004d00 2023-12-22T08:47:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.508+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534003cd0 con 0x7f6528004d00 2023-12-22T08:47:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.508+0000 7f6533fff640 1 -- 172.21.15.38:0/1214857124 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534005310 con 0x7f6528004d00 2023-12-22T08:47:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.508+0000 7f6542099640 1 -- 172.21.15.38:0/1214857124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6528004d00 msgr2=0x7f6528005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.508+0000 7f6542099640 1 --2- 172.21.15.38:0/1214857124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6528004d00 0x7f6528005180 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f653c0b3250 tx=0x7f65280057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.508+0000 7f6541898640 1 -- 172.21.15.38:0/1214857124 reap_dead start 2023-12-22T08:47:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.508+0000 7f6542099640 1 -- 172.21.15.38:0/1214857124 shutdown_connections 2023-12-22T08:47:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.508+0000 7f6542099640 1 -- 172.21.15.38:0/1214857124 >> 172.21.15.38:0/1214857124 conn(0x7f653c0d31f0 msgr2=0x7f653c0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.508+0000 7f6542099640 1 -- 172.21.15.38:0/1214857124 shutdown_connections 2023-12-22T08:47:33.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.508+0000 7f6542099640 1 -- 172.21.15.38:0/1214857124 wait complete. 2023-12-22T08:47:33.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.510+0000 7f6542099640 1 Processor -- start 2023-12-22T08:47:33.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.510+0000 7f6542099640 1 -- start start 2023-12-22T08:47:33.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.511+0000 7f6542099640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6528004d00 0x7f653c1f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.511+0000 7f6542099640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f653c157ee0 0x7f653c0b6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.511+0000 7f6542099640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f653c0b6a80 0x7f653c159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.511+0000 7f6542099640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c15a990 con 0x7f653c0b6a80 2023-12-22T08:47:33.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.511+0000 7f6542099640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c1f5280 con 0x7f653c157ee0 2023-12-22T08:47:33.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.511+0000 7f6542099640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c1f43d0 con 0x7f6528004d00 2023-12-22T08:47:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.511+0000 7f6541898640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f653c0b6a80 0x7f653c159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.512+0000 7f6541898640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f653c0b6a80 0x7f653c159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38062/0 (socket says 172.21.15.38:38062) 2023-12-22T08:47:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.512+0000 7f6541898640 1 -- 172.21.15.38:0/96418188 learned_addr learned my addr 172.21.15.38:0/96418188 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.512+0000 7f6541097640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6528004d00 0x7f653c1f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.512+0000 7f6541898640 1 -- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6528004d00 msgr2=0x7f653c1f3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.512+0000 7f6541898640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6528004d00 0x7f653c1f3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.512+0000 7f6541898640 1 -- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f653c157ee0 msgr2=0x7f653c0b6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.512+0000 7f6540896640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f653c157ee0 0x7f653c0b6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.512+0000 7f6541898640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f653c157ee0 0x7f653c0b6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.512+0000 7f6541898640 1 -- 172.21.15.38:0/96418188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c1f4670 con 0x7f653c0b6a80 2023-12-22T08:47:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.512+0000 7f6541097640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6528004d00 0x7f653c1f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.512+0000 7f6541898640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f653c0b6a80 0x7f653c159aa0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f653402bfd0 tx=0x7f65340014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:33.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.513+0000 7f6531ffb640 1 -- 172.21.15.38:0/96418188 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534044670 con 0x7f653c0b6a80 2023-12-22T08:47:33.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.513+0000 7f6531ffb640 1 -- 172.21.15.38:0/96418188 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65340447d0 con 0x7f653c0b6a80 2023-12-22T08:47:33.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.513+0000 7f6531ffb640 1 -- 172.21.15.38:0/96418188 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534044b40 con 0x7f653c0b6a80 2023-12-22T08:47:33.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.513+0000 7f6542099640 1 -- 172.21.15.38:0/96418188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c1f4950 con 0x7f653c0b6a80 2023-12-22T08:47:33.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.513+0000 7f6542099640 1 -- 172.21.15.38:0/96418188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c1f4f10 con 0x7f653c0b6a80 2023-12-22T08:47:33.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.514+0000 7f6542099640 1 -- 172.21.15.38:0/96418188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653c1f50d0 con 0x7f653c0b6a80 2023-12-22T08:47:33.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.515+0000 7f6531ffb640 1 -- 172.21.15.38:0/96418188 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6534041070 con 0x7f653c0b6a80 2023-12-22T08:47:33.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.516+0000 7f6531ffb640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f652006a430 0x7f652006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.516+0000 7f6531ffb640 1 -- 172.21.15.38:0/96418188 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65340aa9d0 con 0x7f653c0b6a80 2023-12-22T08:47:33.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.517+0000 7f6541097640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f652006a430 0x7f652006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.518+0000 7f6541097640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f652006a430 0x7f652006c8f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f653800b9e0 tx=0x7f6538008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:33.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.520+0000 7f6531ffb640 1 -- 172.21.15.38:0/96418188 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6534075fb0 con 0x7f653c0b6a80 2023-12-22T08:47:33.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.718+0000 7f6542099640 1 -- 172.21.15.38:0/96418188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f653c061910 con 0x7f653c0b6a80 2023-12-22T08:47:33.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.720+0000 7f6531ffb640 1 -- 172.21.15.38:0/96418188 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16011 (secure 0 0 0) 0x7f65340795d0 con 0x7f653c0b6a80 2023-12-22T08:47:33.721 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:33.722 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":130,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:22.301110+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:04.687287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:06.061571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:33.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.723+0000 7f6542099640 1 -- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f652006a430 msgr2=0x7f652006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.723+0000 7f6542099640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f652006a430 0x7f652006c8f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f653800b9e0 tx=0x7f6538008040 comp rx=0 tx=0).stop 2023-12-22T08:47:33.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.723+0000 7f6542099640 1 -- 172.21.15.38:0/96418188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f653c0b6a80 msgr2=0x7f653c159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.723+0000 7f6542099640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f653c0b6a80 0x7f653c159aa0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f653402bfd0 tx=0x7f65340014a0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.723+0000 7f6542099640 1 -- 172.21.15.38:0/96418188 shutdown_connections 2023-12-22T08:47:33.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.723+0000 7f6542099640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f652006a430 0x7f652006c8f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.723+0000 7f6542099640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f653c0b6a80 0x7f653c159aa0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.723+0000 7f6542099640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f653c157ee0 0x7f653c0b6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.723+0000 7f6542099640 1 --2- 172.21.15.38:0/96418188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6528004d00 0x7f653c1f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.723+0000 7f6542099640 1 -- 172.21.15.38:0/96418188 >> 172.21.15.38:0/96418188 conn(0x7f653c0d31f0 msgr2=0x7f653c151f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:33.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.723+0000 7f6542099640 1 -- 172.21.15.38:0/96418188 shutdown_connections 2023-12-22T08:47:33.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.723+0000 7f6542099640 1 -- 172.21.15.38:0/96418188 wait complete. 2023-12-22T08:47:33.744 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:47:33.744 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:47:33.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.972+0000 7f7fdaeb9640 1 Processor -- start 2023-12-22T08:47:33.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.973+0000 7f7fdaeb9640 1 -- start start 2023-12-22T08:47:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.974+0000 7f7fdaeb9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd406d640 0x7f7fd40d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.974+0000 7f7fdaeb9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd415f220 con 0x7f7fd40b3ff0 2023-12-22T08:47:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.974+0000 7f7fdaeb9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40d1520 con 0x7f7fd4157980 2023-12-22T08:47:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.974+0000 7f7fdaeb9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40d1800 con 0x7f7fd406d640 2023-12-22T08:47:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.975+0000 7f7fd96b6640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7fd40b3ff0 0x7f7fd406cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58854/0 (socket says 172.21.15.38:58854) 2023-12-22T08:47:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.975+0000 7f7fd96b6640 1 -- 172.21.15.38:0/1339105083 learned_addr learned my addr 172.21.15.38:0/1339105083 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.975+0000 7f7fda6b8640 1 --2- 172.21.15.38:0/1339105083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd406d640 0x7f7fd40d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.975+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265089155 0 0) 0x7f7fd415f220 con 0x7f7fd40b3ff0 2023-12-22T08:47:33.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.975+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc4003520 con 0x7f7fd40b3ff0 2023-12-22T08:47:33.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3844061116 0 0) 0x7f7fc4003520 con 0x7f7fd40b3ff0 2023-12-22T08:47:33.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd406d640 msgr2=0x7f7fd40d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:33.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fd8eb5640 1 --2- 172.21.15.38:0/1339105083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd406d640 0x7f7fd40d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 >> v1:172.21.15.89:6789/0 conn(0x7f7fd4157980 legacy=0x7f7fd415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd40d1ae0 con 0x7f7fd40b3ff0 2023-12-22T08:47:33.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f7fc0001670 con 0x7f7fd40b3ff0 2023-12-22T08:47:33.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 >> v1:172.21.15.38:6789/0 conn(0x7f7fd40b3ff0 legacy=0x7f7fd406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fd8eb5640 1 --2- 172.21.15.38:0/1339105083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fc40039a0 0x7f7fc4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fd8eb5640 1 --2- 172.21.15.38:0/1339105083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd406d640 0x7f7fc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fd8eb5640 1 --2- 172.21.15.38:0/1339105083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fc4004d00 0x7f7fc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40d1800 con 0x7f7fc4004d00 2023-12-22T08:47:33.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc400ba90 con 0x7f7fc40039a0 2023-12-22T08:47:33.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc400bc50 con 0x7f7fd406d640 2023-12-22T08:47:33.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.976+0000 7f7fda6b8640 1 --2- 172.21.15.38:0/1339105083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fc4004d00 0x7f7fc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.977+0000 7f7fd96b6640 1 --2- 172.21.15.38:0/1339105083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd406d640 0x7f7fc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.977+0000 7f7fd9eb7640 1 --2- 172.21.15.38:0/1339105083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fc40039a0 0x7f7fc4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.977+0000 7f7fda6b8640 1 -- 172.21.15.38:0/1339105083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd406d640 msgr2=0x7f7fc40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:33.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.977+0000 7f7fda6b8640 1 --2- 172.21.15.38:0/1339105083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd406d640 0x7f7fc40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.977+0000 7f7fda6b8640 1 -- 172.21.15.38:0/1339105083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fc40039a0 msgr2=0x7f7fc4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:33.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.977+0000 7f7fda6b8640 1 --2- 172.21.15.38:0/1339105083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fc40039a0 0x7f7fc4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.977+0000 7f7fda6b8640 1 -- 172.21.15.38:0/1339105083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc4003520 con 0x7f7fc4004d00 2023-12-22T08:47:33.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.977+0000 7f7fd9eb7640 1 --2- 172.21.15.38:0/1339105083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fc40039a0 0x7f7fc4003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:33.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.978+0000 7f7fda6b8640 1 --2- 172.21.15.38:0/1339105083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fc4004d00 0x7f7fc4005180 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40b3250 tx=0x7f7fc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f43f01dcd842afd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:33.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.978+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc02c630 con 0x7f7fc4004d00 2023-12-22T08:47:33.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.978+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc02c790 con 0x7f7fc4004d00 2023-12-22T08:47:33.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.978+0000 7f7fd8eb5640 1 -- 172.21.15.38:0/1339105083 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc02cb40 con 0x7f7fc4004d00 2023-12-22T08:47:33.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.979+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1339105083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fc4004d00 msgr2=0x7f7fc4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.979+0000 7f7fdaeb9640 1 --2- 172.21.15.38:0/1339105083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fc4004d00 0x7f7fc4005180 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40b3250 tx=0x7f7fc40057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.979+0000 7f7fda6b8640 1 -- 172.21.15.38:0/1339105083 reap_dead start 2023-12-22T08:47:33.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.979+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1339105083 shutdown_connections 2023-12-22T08:47:33.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.979+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1339105083 >> 172.21.15.38:0/1339105083 conn(0x7f7fd40d31f0 msgr2=0x7f7fd40d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:33.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.979+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1339105083 shutdown_connections 2023-12-22T08:47:33.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.979+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1339105083 wait complete. 2023-12-22T08:47:33.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.981+0000 7f7fdaeb9640 1 Processor -- start 2023-12-22T08:47:33.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.981+0000 7f7fdaeb9640 1 -- start start 2023-12-22T08:47:33.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.982+0000 7f7fdaeb9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fc4004d00 0x7f7fd40b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.982+0000 7f7fdaeb9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd415a970 0x7f7fd4158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.982+0000 7f7fdaeb9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4158eb0 0x7f7fd41f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.982+0000 7f7fdaeb9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd4159330 con 0x7f7fc4004d00 2023-12-22T08:47:33.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.982+0000 7f7fdaeb9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd41595d0 con 0x7f7fd4158eb0 2023-12-22T08:47:33.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.982+0000 7f7fdaeb9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd41598b0 con 0x7f7fd415a970 2023-12-22T08:47:33.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.982+0000 7f7fd9eb7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fc4004d00 0x7f7fd40b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.982+0000 7f7fd9eb7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fc4004d00 0x7f7fd40b86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38090/0 (socket says 172.21.15.38:38090) 2023-12-22T08:47:33.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.983+0000 7f7fd9eb7640 1 -- 172.21.15.38:0/1917217165 learned_addr learned my addr 172.21.15.38:0/1917217165 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:33.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.983+0000 7f7fd9eb7640 1 -- 172.21.15.38:0/1917217165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd415a970 msgr2=0x7f7fd4158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.983+0000 7f7fd9eb7640 1 --2- 172.21.15.38:0/1917217165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd415a970 0x7f7fd4158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.983+0000 7f7fd9eb7640 1 -- 172.21.15.38:0/1917217165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4158eb0 msgr2=0x7f7fd41f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:33.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.983+0000 7f7fd9eb7640 1 --2- 172.21.15.38:0/1917217165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4158eb0 0x7f7fd41f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:33.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.983+0000 7f7fd9eb7640 1 -- 172.21.15.38:0/1917217165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd4158100 con 0x7f7fc4004d00 2023-12-22T08:47:33.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.983+0000 7f7fd9eb7640 1 --2- 172.21.15.38:0/1917217165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fc4004d00 0x7f7fd40b86c0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800db10 tx=0x7f7fc80020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:33.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.984+0000 7f7fd27fc640 1 -- 172.21.15.38:0/1917217165 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8003da0 con 0x7f7fc4004d00 2023-12-22T08:47:33.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.984+0000 7f7fd27fc640 1 -- 172.21.15.38:0/1917217165 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc8006b50 con 0x7f7fc4004d00 2023-12-22T08:47:33.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.984+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1917217165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd41583e0 con 0x7f7fc4004d00 2023-12-22T08:47:33.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.984+0000 7f7fd27fc640 1 -- 172.21.15.38:0/1917217165 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc800b6c0 con 0x7f7fc4004d00 2023-12-22T08:47:33.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.984+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1917217165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd41f2bd0 con 0x7f7fc4004d00 2023-12-22T08:47:33.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.985+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1917217165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd4061910 con 0x7f7fc4004d00 2023-12-22T08:47:33.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.986+0000 7f7fd27fc640 1 -- 172.21.15.38:0/1917217165 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7fc800b820 con 0x7f7fc4004d00 2023-12-22T08:47:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.987+0000 7f7fd27fc640 1 --2- 172.21.15.38:0/1917217165 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7fb806a430 0x7f7fb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.987+0000 7f7fd27fc640 1 -- 172.21.15.38:0/1917217165 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fc8087e90 con 0x7f7fc4004d00 2023-12-22T08:47:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.988+0000 7f7fd96b6640 1 --2- 172.21.15.38:0/1917217165 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7fb806a430 0x7f7fb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:33.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.989+0000 7f7fd96b6640 1 --2- 172.21.15.38:0/1917217165 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7fb806a430 0x7f7fb806c8f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0001050 tx=0x7f7fc0000f60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:33.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:33.991+0000 7f7fd27fc640 1 -- 172.21.15.38:0/1917217165 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7fc80534a0 con 0x7f7fc4004d00 2023-12-22T08:47:34.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.233+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1917217165 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fd4150330 con 0x7f7fc4004d00 2023-12-22T08:47:34.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.234+0000 7f7fd27fc640 1 -- 172.21.15.38:0/1917217165 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f7fc8056ac0 con 0x7f7fc4004d00 2023-12-22T08:47:34.235 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:34.235 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/186375012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":186375012},{"type":"v1","addr":"172.21.15.89:6837","nonce":186375012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1819583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1819583870},{"type":"v1","addr":"172.21.15.89:6835","nonce":1819583870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3793773672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3793773672},{"type":"v1","addr":"172.21.15.38:6834","nonce":3793773672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:07.035669+0000","modified":"2023-12-22T08:47:10.565916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7293":{"gid":7293,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3340763944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3340763944},{"type":"v1","addr":"172.21.15.38:6835","nonce":3340763944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-22T08:47:34.236 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 55 2023-12-22T08:47:34.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.237+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1917217165 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7fb806a430 msgr2=0x7f7fb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:34.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.237+0000 7f7fdaeb9640 1 --2- 172.21.15.38:0/1917217165 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7fb806a430 0x7f7fb806c8f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0001050 tx=0x7f7fc0000f60 comp rx=0 tx=0).stop 2023-12-22T08:47:34.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.237+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1917217165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fc4004d00 msgr2=0x7f7fd40b86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:34.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.237+0000 7f7fdaeb9640 1 --2- 172.21.15.38:0/1917217165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fc4004d00 0x7f7fd40b86c0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800db10 tx=0x7f7fc80020c0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.237+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1917217165 shutdown_connections 2023-12-22T08:47:34.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.237+0000 7f7fdaeb9640 1 --2- 172.21.15.38:0/1917217165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4158eb0 0x7f7fd41f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.237+0000 7f7fdaeb9640 1 --2- 172.21.15.38:0/1917217165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fd415a970 0x7f7fd4158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.237+0000 7f7fdaeb9640 1 --2- 172.21.15.38:0/1917217165 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7fb806a430 0x7f7fb806c8f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.237+0000 7f7fdaeb9640 1 --2- 172.21.15.38:0/1917217165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fc4004d00 0x7f7fd40b86c0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.237+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1917217165 >> 172.21.15.38:0/1917217165 conn(0x7f7fd40d31f0 msgr2=0x7f7fd40d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:34.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.237+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1917217165 shutdown_connections 2023-12-22T08:47:34.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.237+0000 7f7fdaeb9640 1 -- 172.21.15.38:0/1917217165 wait complete. 2023-12-22T08:47:34.257 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:47:34.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.482+0000 7fb8134bd640 1 Processor -- start 2023-12-22T08:47:34.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.482+0000 7fb8134bd640 1 -- start start 2023-12-22T08:47:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.484+0000 7fb8134bd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb80c144d10 0x7fb80c0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.484+0000 7fb8134bd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb80c0cc670 0x7fb80c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.484+0000 7fb8134bd640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80c1450f0 con 0x7fb80c0b2590 2023-12-22T08:47:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.484+0000 7fb8134bd640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80c0b2a00 con 0x7fb80c0cc670 2023-12-22T08:47:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.484+0000 7fb8134bd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80c0ce010 con 0x7fb80c144d10 2023-12-22T08:47:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.484+0000 7fb810a58640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb80c0cc670 0x7fb80c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.484+0000 7fb811a5a640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb80c0b2590 0x7fb80c15f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58860/0 (socket says 172.21.15.38:58860) 2023-12-22T08:47:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.484+0000 7fb811a5a640 1 -- 172.21.15.38:0/3468999262 learned_addr learned my addr 172.21.15.38:0/3468999262 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.484+0000 7fb811259640 1 --2- 172.21.15.38:0/3468999262 >> v2:172.21.15.89:3300/0 conn(0x7fb80c144d10 0x7fb80c0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.485+0000 7fb810a58640 1 -- 172.21.15.38:0/3468999262 >> v2:172.21.15.89:3300/0 conn(0x7fb80c144d10 msgr2=0x7fb80c0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.485+0000 7fb810a58640 1 --2- 172.21.15.38:0/3468999262 >> v2:172.21.15.89:3300/0 conn(0x7fb80c144d10 0x7fb80c0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.485+0000 7fb810a58640 1 -- 172.21.15.38:0/3468999262 >> v1:172.21.15.38:6789/0 conn(0x7fb80c0b2590 legacy=0x7fb80c15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:34.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.485+0000 7fb810a58640 1 -- 172.21.15.38:0/3468999262 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c0ce2f0 con 0x7fb80c0cc670 2023-12-22T08:47:34.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.486+0000 7fb810a58640 1 --2- 172.21.15.38:0/3468999262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb80c0cc670 0x7fb80c0b2050 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0cfe00 tx=0x7fb7fc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c913151563517775 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:34.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.486+0000 7fb803fff640 1 -- 172.21.15.38:0/3468999262 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc031830 con 0x7fb80c0cc670 2023-12-22T08:47:34.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.486+0000 7fb803fff640 1 -- 172.21.15.38:0/3468999262 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc031990 con 0x7fb80c0cc670 2023-12-22T08:47:34.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.486+0000 7fb803fff640 1 -- 172.21.15.38:0/3468999262 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc031d20 con 0x7fb80c0cc670 2023-12-22T08:47:34.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.487+0000 7fb8134bd640 1 -- 172.21.15.38:0/3468999262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb80c0cc670 msgr2=0x7fb80c0b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:34.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.487+0000 7fb8134bd640 1 --2- 172.21.15.38:0/3468999262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb80c0cc670 0x7fb80c0b2050 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0cfe00 tx=0x7fb7fc02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.487+0000 7fb8134bd640 1 -- 172.21.15.38:0/3468999262 shutdown_connections 2023-12-22T08:47:34.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.487+0000 7fb8134bd640 1 --2- 172.21.15.38:0/3468999262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb80c0cc670 0x7fb80c0b2050 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.487+0000 7fb8134bd640 1 --2- 172.21.15.38:0/3468999262 >> v2:172.21.15.89:3300/0 conn(0x7fb80c144d10 0x7fb80c0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.487+0000 7fb8134bd640 1 -- 172.21.15.38:0/3468999262 >> 172.21.15.38:0/3468999262 conn(0x7fb80c0cf070 msgr2=0x7fb80c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:34.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.487+0000 7fb8134bd640 1 -- 172.21.15.38:0/3468999262 shutdown_connections 2023-12-22T08:47:34.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.487+0000 7fb8134bd640 1 -- 172.21.15.38:0/3468999262 wait complete. 2023-12-22T08:47:34.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.489+0000 7fb8134bd640 1 Processor -- start 2023-12-22T08:47:34.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.489+0000 7fb8134bd640 1 -- start start 2023-12-22T08:47:34.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.490+0000 7fb8134bd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb80c0b2590 0x7fb80c1f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:34.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.490+0000 7fb8134bd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb80c144d10 0x7fb80c139470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:34.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.490+0000 7fb8134bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb80c13bad0 0x7fb80c143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:34.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.490+0000 7fb8134bd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c142300 con 0x7fb80c144d10 2023-12-22T08:47:34.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.490+0000 7fb8134bd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c142550 con 0x7fb80c13bad0 2023-12-22T08:47:34.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.490+0000 7fb8134bd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c142830 con 0x7fb80c0b2590 2023-12-22T08:47:34.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.490+0000 7fb810a58640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb80c144d10 0x7fb80c139470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:34.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.490+0000 7fb810a58640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb80c144d10 0x7fb80c139470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38114/0 (socket says 172.21.15.38:38114) 2023-12-22T08:47:34.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.490+0000 7fb810a58640 1 -- 172.21.15.38:0/1554268474 learned_addr learned my addr 172.21.15.38:0/1554268474 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:34.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.491+0000 7fb811a5a640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb80c13bad0 0x7fb80c143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:34.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.491+0000 7fb810a58640 1 -- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb80c0b2590 msgr2=0x7fb80c1f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:34.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.491+0000 7fb810a58640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb80c0b2590 0x7fb80c1f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.491+0000 7fb810a58640 1 -- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb80c13bad0 msgr2=0x7fb80c143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:34.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.491+0000 7fb810a58640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb80c13bad0 0x7fb80c143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.491+0000 7fb810a58640 1 -- 172.21.15.38:0/1554268474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc009400 con 0x7fb80c144d10 2023-12-22T08:47:34.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.491+0000 7fb811a5a640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb80c13bad0 0x7fb80c143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:34.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.491+0000 7fb810a58640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb80c144d10 0x7fb80c139470 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009890 tx=0x7fb7fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:34.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.491+0000 7fb801ffb640 1 -- 172.21.15.38:0/1554268474 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc03ba70 con 0x7fb80c144d10 2023-12-22T08:47:34.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.491+0000 7fb801ffb640 1 -- 172.21.15.38:0/1554268474 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc03bbf0 con 0x7fb80c144d10 2023-12-22T08:47:34.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.491+0000 7fb801ffb640 1 -- 172.21.15.38:0/1554268474 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc045400 con 0x7fb80c144d10 2023-12-22T08:47:34.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.491+0000 7fb8134bd640 1 -- 172.21.15.38:0/1554268474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80c142b10 con 0x7fb80c144d10 2023-12-22T08:47:34.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.492+0000 7fb8134bd640 1 -- 172.21.15.38:0/1554268474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80c1f6020 con 0x7fb80c144d10 2023-12-22T08:47:34.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.493+0000 7fb8134bd640 1 -- 172.21.15.38:0/1554268474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80c143030 con 0x7fb80c144d10 2023-12-22T08:47:34.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.494+0000 7fb801ffb640 1 -- 172.21.15.38:0/1554268474 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb7fc04e440 con 0x7fb80c144d10 2023-12-22T08:47:34.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.495+0000 7fb801ffb640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb7f006a480 0x7fb7f006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:34.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.495+0000 7fb801ffb640 1 -- 172.21.15.38:0/1554268474 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7fc0aab90 con 0x7fb80c144d10 2023-12-22T08:47:34.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.495+0000 7fb811259640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb7f006a480 0x7fb7f006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:34.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.497+0000 7fb811259640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb7f006a480 0x7fb7f006c940 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb808006fd0 tx=0x7fb808008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:34.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.499+0000 7fb801ffb640 1 -- 172.21.15.38:0/1554268474 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb80c143030 con 0x7fb80c144d10 2023-12-22T08:47:34.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.732+0000 7fb8134bd640 1 -- 172.21.15.38:0/1554268474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb80c143030 con 0x7fb80c144d10 2023-12-22T08:47:34.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.733+0000 7fb801ffb640 1 -- 172.21.15.38:0/1554268474 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4647 (secure 0 0 0) 0x7fb80c143030 con 0x7fb80c144d10 2023-12-22T08:47:34.735 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:34.735 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/186375012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":186375012},{"type":"v1","addr":"172.21.15.89:6837","nonce":186375012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1819583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1819583870},{"type":"v1","addr":"172.21.15.89:6835","nonce":1819583870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3793773672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3793773672},{"type":"v1","addr":"172.21.15.38:6834","nonce":3793773672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:07.035669+0000","modified":"2023-12-22T08:47:10.565916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7293":{"gid":7293,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3340763944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3340763944},{"type":"v1","addr":"172.21.15.38:6835","nonce":3340763944}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-22T08:47:34.735 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 55 2023-12-22T08:47:34.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.736+0000 7fb8134bd640 1 -- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb7f006a480 msgr2=0x7fb7f006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:34.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.736+0000 7fb8134bd640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb7f006a480 0x7fb7f006c940 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb808006fd0 tx=0x7fb808008040 comp rx=0 tx=0).stop 2023-12-22T08:47:34.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.736+0000 7fb8134bd640 1 -- 172.21.15.38:0/1554268474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb80c144d10 msgr2=0x7fb80c139470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:34.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.736+0000 7fb8134bd640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb80c144d10 0x7fb80c139470 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009890 tx=0x7fb7fc0046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.736+0000 7fb8134bd640 1 -- 172.21.15.38:0/1554268474 shutdown_connections 2023-12-22T08:47:34.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.736+0000 7fb8134bd640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb80c13bad0 0x7fb80c143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.736+0000 7fb8134bd640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb7f006a480 0x7fb7f006c940 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.736+0000 7fb8134bd640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb80c144d10 0x7fb80c139470 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.736+0000 7fb8134bd640 1 --2- 172.21.15.38:0/1554268474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb80c0b2590 0x7fb80c1f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.736+0000 7fb8134bd640 1 -- 172.21.15.38:0/1554268474 >> 172.21.15.38:0/1554268474 conn(0x7fb80c0cf070 msgr2=0x7fb80c071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:34.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.736+0000 7fb8134bd640 1 -- 172.21.15.38:0/1554268474 shutdown_connections 2023-12-22T08:47:34.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.736+0000 7fb8134bd640 1 -- 172.21.15.38:0/1554268474 wait complete. 2023-12-22T08:47:34.757 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:34.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.979+0000 7f3595cd6640 1 Processor -- start 2023-12-22T08:47:34.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.979+0000 7f3595cd6640 1 -- start start 2023-12-22T08:47:34.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.981+0000 7f3595cd6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f359015b420 0x7f359006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:34.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.981+0000 7f3595cd6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f35900a44a0 0x7f35900708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:34.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.981+0000 7f3595cd6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3590070e30 0x7f359006f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:34.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.981+0000 7f3595cd6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35900cdae0 con 0x7f35900a44a0 2023-12-22T08:47:34.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.981+0000 7f3595cd6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3590071260 con 0x7f3590070e30 2023-12-22T08:47:34.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.981+0000 7f3595cd6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359006dec0 con 0x7f359015b420 2023-12-22T08:47:34.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.982+0000 7f358ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f35900a44a0 0x7f35900708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:34.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.982+0000 7f358ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f35900a44a0 0x7f35900708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38130/0 (socket says 172.21.15.38:38130) 2023-12-22T08:47:34.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.982+0000 7f358ffff640 1 -- 172.21.15.38:0/3815720474 learned_addr learned my addr 172.21.15.38:0/3815720474 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:34.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.982+0000 7f3594cd4640 1 --2- 172.21.15.38:0/3815720474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f359015b420 0x7f359006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:34.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.982+0000 7f35954d5640 1 --2- 172.21.15.38:0/3815720474 >> v2:172.21.15.89:3300/0 conn(0x7f3590070e30 0x7f359006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:34.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.982+0000 7f358ffff640 1 -- 172.21.15.38:0/3815720474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f359015b420 msgr2=0x7f359006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:34.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.982+0000 7f358ffff640 1 --2- 172.21.15.38:0/3815720474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f359015b420 0x7f359006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.982+0000 7f358ffff640 1 -- 172.21.15.38:0/3815720474 >> v2:172.21.15.89:3300/0 conn(0x7f3590070e30 msgr2=0x7f359006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:34.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.982+0000 7f358ffff640 1 --2- 172.21.15.38:0/3815720474 >> v2:172.21.15.89:3300/0 conn(0x7f3590070e30 0x7f359006f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.982+0000 7f358ffff640 1 -- 172.21.15.38:0/3815720474 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359015b800 con 0x7f35900a44a0 2023-12-22T08:47:34.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.982+0000 7f3594cd4640 1 --2- 172.21.15.38:0/3815720474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f359015b420 0x7f359006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:47:34.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.984+0000 7f358ffff640 1 --2- 172.21.15.38:0/3815720474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35900a44a0 0x7f35900708f0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f359006e400 tx=0x7f357c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e68a50db6cc7ff server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:34.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.984+0000 7f358f7fe640 1 -- 172.21.15.38:0/3815720474 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c031870 con 0x7f35900a44a0 2023-12-22T08:47:34.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.985+0000 7f358f7fe640 1 -- 172.21.15.38:0/3815720474 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c0319d0 con 0x7f35900a44a0 2023-12-22T08:47:34.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.985+0000 7f358f7fe640 1 -- 172.21.15.38:0/3815720474 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c031d60 con 0x7f35900a44a0 2023-12-22T08:47:34.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.985+0000 7f3595cd6640 1 -- 172.21.15.38:0/3815720474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35900a44a0 msgr2=0x7f35900708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:34.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.985+0000 7f3595cd6640 1 --2- 172.21.15.38:0/3815720474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35900a44a0 0x7f35900708f0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f359006e400 tx=0x7f357c02b910 comp rx=0 tx=0).stop 2023-12-22T08:47:34.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.985+0000 7f3595cd6640 1 -- 172.21.15.38:0/3815720474 shutdown_connections 2023-12-22T08:47:34.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.985+0000 7f3595cd6640 1 --2- 172.21.15.38:0/3815720474 >> v2:172.21.15.89:3300/0 conn(0x7f3590070e30 0x7f359006f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.985+0000 7f3595cd6640 1 --2- 172.21.15.38:0/3815720474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35900a44a0 0x7f35900708f0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.985+0000 7f3595cd6640 1 --2- 172.21.15.38:0/3815720474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f359015b420 0x7f359006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.985+0000 7f3595cd6640 1 -- 172.21.15.38:0/3815720474 >> 172.21.15.38:0/3815720474 conn(0x7f35900b1f70 msgr2=0x7f35900b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:34.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.985+0000 7f3595cd6640 1 -- 172.21.15.38:0/3815720474 shutdown_connections 2023-12-22T08:47:34.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.985+0000 7f3595cd6640 1 -- 172.21.15.38:0/3815720474 wait complete. 2023-12-22T08:47:34.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.987+0000 7f3595cd6640 1 Processor -- start 2023-12-22T08:47:34.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.987+0000 7f3595cd6640 1 -- start start 2023-12-22T08:47:34.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.988+0000 7f3595cd6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3590070e30 0x7f35900ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:34.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.988+0000 7f3595cd6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35900a44a0 0x7f359015ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:34.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.988+0000 7f3595cd6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f359015b420 0x7f359015cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:34.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.988+0000 7f3595cd6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35901f3ee0 con 0x7f35900a44a0 2023-12-22T08:47:34.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.988+0000 7f3595cd6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35901f3c00 con 0x7f3590070e30 2023-12-22T08:47:34.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.988+0000 7f3595cd6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35901f4210 con 0x7f359015b420 2023-12-22T08:47:34.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.989+0000 7f358ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35900a44a0 0x7f359015ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:34.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.989+0000 7f358ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35900a44a0 0x7f359015ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38140/0 (socket says 172.21.15.38:38140) 2023-12-22T08:47:34.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.989+0000 7f358ffff640 1 -- 172.21.15.38:0/1351460795 learned_addr learned my addr 172.21.15.38:0/1351460795 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:34.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.989+0000 7f3594cd4640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3590070e30 0x7f35900ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:34.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.989+0000 7f35954d5640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f359015b420 0x7f359015cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:34.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.989+0000 7f358ffff640 1 -- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f359015b420 msgr2=0x7f359015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:34.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.989+0000 7f358ffff640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f359015b420 0x7f359015cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.989+0000 7f358ffff640 1 -- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3590070e30 msgr2=0x7f35900ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:34.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.989+0000 7f358ffff640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3590070e30 0x7f35900ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:34.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.989+0000 7f358ffff640 1 -- 172.21.15.38:0/1351460795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0094d0 con 0x7f35900a44a0 2023-12-22T08:47:34.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.989+0000 7f3594cd4640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3590070e30 0x7f35900ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:34.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.989+0000 7f358ffff640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35900a44a0 0x7f359015ca60 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f357c02b950 tx=0x7f357c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:34.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.990+0000 7f358d7fa640 1 -- 172.21.15.38:0/1351460795 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c03abe0 con 0x7f35900a44a0 2023-12-22T08:47:34.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.990+0000 7f358d7fa640 1 -- 172.21.15.38:0/1351460795 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c03ad60 con 0x7f35900a44a0 2023-12-22T08:47:34.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.990+0000 7f3595cd6640 1 -- 172.21.15.38:0/1351460795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35901f44f0 con 0x7f35900a44a0 2023-12-22T08:47:34.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.990+0000 7f358d7fa640 1 -- 172.21.15.38:0/1351460795 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c044630 con 0x7f35900a44a0 2023-12-22T08:47:34.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.990+0000 7f3595cd6640 1 -- 172.21.15.38:0/1351460795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35901f2e80 con 0x7f35900a44a0 2023-12-22T08:47:34.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.991+0000 7f3595cd6640 1 -- 172.21.15.38:0/1351460795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35901f4070 con 0x7f35900a44a0 2023-12-22T08:47:34.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.992+0000 7f358d7fa640 1 -- 172.21.15.38:0/1351460795 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f357c04d450 con 0x7f35900a44a0 2023-12-22T08:47:34.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.993+0000 7f358d7fa640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f357406a430 0x7f357406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:34.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.993+0000 7f358d7fa640 1 -- 172.21.15.38:0/1351460795 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f357c02d040 con 0x7f35900a44a0 2023-12-22T08:47:34.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.994+0000 7f3594cd4640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f357406a430 0x7f357406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:34.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.995+0000 7f3594cd4640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f357406a430 0x7f357406c8f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f359006c750 tx=0x7f3584008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:34.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:34.997+0000 7f358d7fa640 1 -- 172.21.15.38:0/1351460795 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f35901f4070 con 0x7f35900a44a0 2023-12-22T08:47:35.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.195+0000 7f3595cd6640 1 -- 172.21.15.38:0/1351460795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35901f4a10 con 0x7f35900a44a0 2023-12-22T08:47:35.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.198+0000 7f358d7fa640 1 -- 172.21.15.38:0/1351460795 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16011 (secure 0 0 0) 0x7f35901f4a10 con 0x7f35900a44a0 2023-12-22T08:47:35.202 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:35.202 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":130,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:22.301110+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:04.687287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:06.061571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:35.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.200+0000 7f3595cd6640 1 -- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f357406a430 msgr2=0x7f357406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:35.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.200+0000 7f3595cd6640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f357406a430 0x7f357406c8f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f359006c750 tx=0x7f3584008040 comp rx=0 tx=0).stop 2023-12-22T08:47:35.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.200+0000 7f3595cd6640 1 -- 172.21.15.38:0/1351460795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35900a44a0 msgr2=0x7f359015ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:35.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.200+0000 7f3595cd6640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35900a44a0 0x7f359015ca60 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f357c02b950 tx=0x7f357c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.200+0000 7f3595cd6640 1 -- 172.21.15.38:0/1351460795 shutdown_connections 2023-12-22T08:47:35.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.200+0000 7f3595cd6640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f359015b420 0x7f359015cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.200+0000 7f3595cd6640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f357406a430 0x7f357406c8f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.200+0000 7f3595cd6640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35900a44a0 0x7f359015ca60 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.200+0000 7f3595cd6640 1 --2- 172.21.15.38:0/1351460795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3590070e30 0x7f35900ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.200+0000 7f3595cd6640 1 -- 172.21.15.38:0/1351460795 >> 172.21.15.38:0/1351460795 conn(0x7f35900b1f70 msgr2=0x7f359015dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:35.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.201+0000 7f3595cd6640 1 -- 172.21.15.38:0/1351460795 shutdown_connections 2023-12-22T08:47:35.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.201+0000 7f3595cd6640 1 -- 172.21.15.38:0/1351460795 wait complete. 2023-12-22T08:47:35.220 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T08:47:35.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.448+0000 7f6529438640 1 Processor -- start 2023-12-22T08:47:35.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.449+0000 7f6529438640 1 -- start start 2023-12-22T08:47:35.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.450+0000 7f6529438640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6524144d10 0x7f65240cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:35.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.450+0000 7f6529438640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65240cc670 0x7f65240b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:35.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.450+0000 7f6529438640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65241450f0 con 0x7f65240b2590 2023-12-22T08:47:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.450+0000 7f6529438640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65240b2a00 con 0x7f65240cc670 2023-12-22T08:47:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.450+0000 7f6529438640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65240ce010 con 0x7f6524144d10 2023-12-22T08:47:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.451+0000 7f65227fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65240cc670 0x7f65240b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.451+0000 7f65227fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65240cc670 0x7f65240b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38150/0 (socket says 172.21.15.38:38150) 2023-12-22T08:47:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.451+0000 7f65227fc640 1 -- 172.21.15.38:0/1512662002 learned_addr learned my addr 172.21.15.38:0/1512662002 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.451+0000 7f6522ffd640 1 --2- 172.21.15.38:0/1512662002 >> v2:172.21.15.89:3300/0 conn(0x7f6524144d10 0x7f65240cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.451+0000 7f65227fc640 1 -- 172.21.15.38:0/1512662002 >> v2:172.21.15.89:3300/0 conn(0x7f6524144d10 msgr2=0x7f65240cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.451+0000 7f65227fc640 1 --2- 172.21.15.38:0/1512662002 >> v2:172.21.15.89:3300/0 conn(0x7f6524144d10 0x7f65240cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.451+0000 7f65227fc640 1 -- 172.21.15.38:0/1512662002 >> v1:172.21.15.89:6789/0 conn(0x7f65240b2590 legacy=0x7f652415f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:35.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.451+0000 7f65227fc640 1 -- 172.21.15.38:0/1512662002 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65240ce2f0 con 0x7f65240cc670 2023-12-22T08:47:35.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.452+0000 7f65227fc640 1 --2- 172.21.15.38:0/1512662002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65240cc670 0x7f65240b2050 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f65240cfe00 tx=0x7f650c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd63fff02ae3809a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:35.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.453+0000 7f6521ffb640 1 -- 172.21.15.38:0/1512662002 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c031870 con 0x7f65240cc670 2023-12-22T08:47:35.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.453+0000 7f6521ffb640 1 -- 172.21.15.38:0/1512662002 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c0319d0 con 0x7f65240cc670 2023-12-22T08:47:35.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.453+0000 7f6521ffb640 1 -- 172.21.15.38:0/1512662002 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c031d60 con 0x7f65240cc670 2023-12-22T08:47:35.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.453+0000 7f6529438640 1 -- 172.21.15.38:0/1512662002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65240cc670 msgr2=0x7f65240b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:35.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.453+0000 7f6529438640 1 --2- 172.21.15.38:0/1512662002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65240cc670 0x7f65240b2050 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f65240cfe00 tx=0x7f650c02b910 comp rx=0 tx=0).stop 2023-12-22T08:47:35.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.453+0000 7f6529438640 1 -- 172.21.15.38:0/1512662002 shutdown_connections 2023-12-22T08:47:35.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.453+0000 7f6529438640 1 --2- 172.21.15.38:0/1512662002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65240cc670 0x7f65240b2050 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.453+0000 7f6529438640 1 --2- 172.21.15.38:0/1512662002 >> v2:172.21.15.89:3300/0 conn(0x7f6524144d10 0x7f65240cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.453+0000 7f6529438640 1 -- 172.21.15.38:0/1512662002 >> 172.21.15.38:0/1512662002 conn(0x7f65240cf070 msgr2=0x7f65240cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:35.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.453+0000 7f6529438640 1 -- 172.21.15.38:0/1512662002 shutdown_connections 2023-12-22T08:47:35.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.454+0000 7f6529438640 1 -- 172.21.15.38:0/1512662002 wait complete. 2023-12-22T08:47:35.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.455+0000 7f6529438640 1 Processor -- start 2023-12-22T08:47:35.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.455+0000 7f6529438640 1 -- start start 2023-12-22T08:47:35.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.456+0000 7f6529438640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65240b2590 0x7f652413dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:35.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.456+0000 7f6529438640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6524144d10 0x7f652413f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:35.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.456+0000 7f6529438640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65241f1720 0x7f652413cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:35.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.456+0000 7f6529438640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65241f1bd0 con 0x7f65240b2590 2023-12-22T08:47:35.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.456+0000 7f6529438640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652413e210 con 0x7f6524144d10 2023-12-22T08:47:35.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.456+0000 7f6529438640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652413e4f0 con 0x7f65241f1720 2023-12-22T08:47:35.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.457+0000 7f6522ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65240b2590 0x7f652413dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:35.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.457+0000 7f6522ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65240b2590 0x7f652413dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38160/0 (socket says 172.21.15.38:38160) 2023-12-22T08:47:35.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.457+0000 7f6522ffd640 1 -- 172.21.15.38:0/4041957980 learned_addr learned my addr 172.21.15.38:0/4041957980 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:35.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.457+0000 7f65227fc640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6524144d10 0x7f652413f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:35.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.457+0000 7f65237fe640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65241f1720 0x7f652413cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:35.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.457+0000 7f6522ffd640 1 -- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65241f1720 msgr2=0x7f652413cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:35.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.457+0000 7f6522ffd640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65241f1720 0x7f652413cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.457+0000 7f6522ffd640 1 -- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6524144d10 msgr2=0x7f652413f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:35.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.457+0000 7f6522ffd640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6524144d10 0x7f652413f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.457+0000 7f6522ffd640 1 -- 172.21.15.38:0/4041957980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c0094d0 con 0x7f65240b2590 2023-12-22T08:47:35.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.458+0000 7f6522ffd640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65240b2590 0x7f652413dc30 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f6514007e40 tx=0x7f651400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:35.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.458+0000 7f651b7fe640 1 -- 172.21.15.38:0/4041957980 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6514014620 con 0x7f65240b2590 2023-12-22T08:47:35.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.458+0000 7f651b7fe640 1 -- 172.21.15.38:0/4041957980 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651400ee90 con 0x7f65240b2590 2023-12-22T08:47:35.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.458+0000 7f651b7fe640 1 -- 172.21.15.38:0/4041957980 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65140149c0 con 0x7f65240b2590 2023-12-22T08:47:35.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.458+0000 7f6529438640 1 -- 172.21.15.38:0/4041957980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652413e7d0 con 0x7f65240b2590 2023-12-22T08:47:35.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.458+0000 7f6529438640 1 -- 172.21.15.38:0/4041957980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652413ed90 con 0x7f65240b2590 2023-12-22T08:47:35.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.459+0000 7f6529438640 1 -- 172.21.15.38:0/4041957980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652413ef20 con 0x7f65240b2590 2023-12-22T08:47:35.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.460+0000 7f651b7fe640 1 -- 172.21.15.38:0/4041957980 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6514014b20 con 0x7f65240b2590 2023-12-22T08:47:35.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.461+0000 7f651b7fe640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f650406a430 0x7f650406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:35.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.462+0000 7f651b7fe640 1 -- 172.21.15.38:0/4041957980 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6514089280 con 0x7f65240b2590 2023-12-22T08:47:35.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.462+0000 7f65227fc640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f650406a430 0x7f650406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:35.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.463+0000 7f65227fc640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f650406a430 0x7f650406c8f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f650c036000 tx=0x7f650c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:35.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.466+0000 7f651b7fe640 1 -- 172.21.15.38:0/4041957980 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6514054870 con 0x7f65240b2590 2023-12-22T08:47:35.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.690+0000 7f6529438640 1 -- 172.21.15.38:0/4041957980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6524061910 con 0x7f65240b2590 2023-12-22T08:47:35.692 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:47:35.691+0000 7f0a26ee3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T08:47:35.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.712+0000 7f651b7fe640 1 -- 172.21.15.38:0/4041957980 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6514057e90 con 0x7f65240b2590 2023-12-22T08:47:35.713 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T08:47:35.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.714+0000 7f6529438640 1 -- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f650406a430 msgr2=0x7f650406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:35.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.714+0000 7f6529438640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f650406a430 0x7f650406c8f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f650c036000 tx=0x7f650c03c040 comp rx=0 tx=0).stop 2023-12-22T08:47:35.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.714+0000 7f6529438640 1 -- 172.21.15.38:0/4041957980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65240b2590 msgr2=0x7f652413dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:35.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.714+0000 7f6529438640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65240b2590 0x7f652413dc30 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f6514007e40 tx=0x7f651400e4b0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.714+0000 7f6529438640 1 -- 172.21.15.38:0/4041957980 shutdown_connections 2023-12-22T08:47:35.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.714+0000 7f6529438640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65241f1720 0x7f652413cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.714+0000 7f6529438640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6524144d10 0x7f652413f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.714+0000 7f6529438640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f650406a430 0x7f650406c8f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.714+0000 7f6529438640 1 --2- 172.21.15.38:0/4041957980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65240b2590 0x7f652413dc30 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.714+0000 7f6529438640 1 -- 172.21.15.38:0/4041957980 >> 172.21.15.38:0/4041957980 conn(0x7f65240cf070 msgr2=0x7f65241595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.715+0000 7f6529438640 1 -- 172.21.15.38:0/4041957980 shutdown_connections 2023-12-22T08:47:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.715+0000 7f6529438640 1 -- 172.21.15.38:0/4041957980 wait complete. 2023-12-22T08:47:35.727 INFO:tasks.ceph.mds.c.smithi038.stderr: -4942> 2023-12-22T08:47:11.474+0000 7fe6a0f30640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:47:35.732 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T08:47:35.787 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:47:35.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.921+0000 7f3e5f3fd640 1 Processor -- start 2023-12-22T08:47:35.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.921+0000 7f3e5f3fd640 1 -- start start 2023-12-22T08:47:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.922+0000 7f3e5f3fd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e5815ad90 0x7f3e580caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.923+0000 7f3e5f3fd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3e5815e050 0x7f3e580cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.923+0000 7f3e5f3fd640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5815e630 con 0x7f3e58161bb0 2023-12-22T08:47:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.923+0000 7f3e5f3fd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e580ce2c0 con 0x7f3e5815e050 2023-12-22T08:47:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.923+0000 7f3e5f3fd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5815e910 con 0x7f3e5815ad90 2023-12-22T08:47:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.923+0000 7f3e5e3fb640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e5815ad90 0x7f3e580caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:35.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.923+0000 7f3e5e3fb640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e5815ad90 0x7f3e580caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:58384/0 (socket says 172.21.15.38:58384) 2023-12-22T08:47:35.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.923+0000 7f3e5e3fb640 1 -- 172.21.15.38:0/1910840952 learned_addr learned my addr 172.21.15.38:0/1910840952 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:35.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.924+0000 7f3e5ebfc640 1 --2- 172.21.15.38:0/1910840952 >> v2:172.21.15.89:3300/0 conn(0x7f3e5815e050 0x7f3e580cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:35.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.924+0000 7f3e5e3fb640 1 -- 172.21.15.38:0/1910840952 >> v2:172.21.15.89:3300/0 conn(0x7f3e5815e050 msgr2=0x7f3e580cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:35.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.924+0000 7f3e5e3fb640 1 --2- 172.21.15.38:0/1910840952 >> v2:172.21.15.89:3300/0 conn(0x7f3e5815e050 0x7f3e580cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.924+0000 7f3e5e3fb640 1 -- 172.21.15.38:0/1910840952 >> v1:172.21.15.89:6789/0 conn(0x7f3e58161bb0 legacy=0x7f3e5815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:35.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.924+0000 7f3e5e3fb640 1 -- 172.21.15.38:0/1910840952 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e581610d0 con 0x7f3e5815ad90 2023-12-22T08:47:35.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.925+0000 7f3e5e3fb640 1 --2- 172.21.15.38:0/1910840952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e5815ad90 0x7f3e580caed0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009870 tx=0x7f3e5402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38c978ea831db0d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:35.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.926+0000 7f3e5d3f9640 1 -- 172.21.15.38:0/1910840952 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e54030840 con 0x7f3e5815ad90 2023-12-22T08:47:35.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.926+0000 7f3e5d3f9640 1 -- 172.21.15.38:0/1910840952 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e540309a0 con 0x7f3e5815ad90 2023-12-22T08:47:35.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.926+0000 7f3e5d3f9640 1 -- 172.21.15.38:0/1910840952 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e54030d30 con 0x7f3e5815ad90 2023-12-22T08:47:35.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.927+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/1910840952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e5815ad90 msgr2=0x7f3e580caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:35.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.927+0000 7f3e5f3fd640 1 --2- 172.21.15.38:0/1910840952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e5815ad90 0x7f3e580caed0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009870 tx=0x7f3e5402b980 comp rx=0 tx=0).stop 2023-12-22T08:47:35.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.927+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/1910840952 shutdown_connections 2023-12-22T08:47:35.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.927+0000 7f3e5f3fd640 1 --2- 172.21.15.38:0/1910840952 >> v2:172.21.15.89:3300/0 conn(0x7f3e5815e050 0x7f3e580cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.927+0000 7f3e5f3fd640 1 --2- 172.21.15.38:0/1910840952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e5815ad90 0x7f3e580caed0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.927+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/1910840952 >> 172.21.15.38:0/1910840952 conn(0x7f3e580d31c0 msgr2=0x7f3e580d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:35.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.927+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/1910840952 shutdown_connections 2023-12-22T08:47:35.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.927+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/1910840952 wait complete. 2023-12-22T08:47:35.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.930+0000 7f3e5f3fd640 1 Processor -- start 2023-12-22T08:47:35.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.930+0000 7f3e5f3fd640 1 -- start start 2023-12-22T08:47:35.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.931+0000 7f3e5f3fd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e5815ad90 0x7f3e581f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:35.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.931+0000 7f3e5f3fd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e5815e050 0x7f3e5814e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:35.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.931+0000 7f3e5f3fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e58161bb0 0x7f3e58157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:35.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.931+0000 7f3e5f3fd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e581580a0 con 0x7f3e5815ad90 2023-12-22T08:47:35.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.931+0000 7f3e5f3fd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5814ebc0 con 0x7f3e58161bb0 2023-12-22T08:47:35.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.931+0000 7f3e5f3fd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e58156590 con 0x7f3e5815e050 2023-12-22T08:47:35.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.931+0000 7f3e5e3fb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e5815ad90 0x7f3e581f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:35.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.931+0000 7f3e5e3fb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e5815ad90 0x7f3e581f38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38194/0 (socket says 172.21.15.38:38194) 2023-12-22T08:47:35.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.931+0000 7f3e5e3fb640 1 -- 172.21.15.38:0/4150244197 learned_addr learned my addr 172.21.15.38:0/4150244197 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:35.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.932+0000 7f3e5dbfa640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e5815e050 0x7f3e5814e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:35.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.932+0000 7f3e5ebfc640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e58161bb0 0x7f3e58157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:35.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.932+0000 7f3e5e3fb640 1 -- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e5815e050 msgr2=0x7f3e5814e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:35.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.932+0000 7f3e5e3fb640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e5815e050 0x7f3e5814e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.932+0000 7f3e5e3fb640 1 -- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e58161bb0 msgr2=0x7f3e58157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:35.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.932+0000 7f3e5e3fb640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e58161bb0 0x7f3e58157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:35.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.932+0000 7f3e5e3fb640 1 -- 172.21.15.38:0/4150244197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e540094d0 con 0x7f3e5815ad90 2023-12-22T08:47:35.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.932+0000 7f3e5e3fb640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e5815ad90 0x7f3e581f38e0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f3e54000c00 tx=0x7f3e54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:35.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.932+0000 7f3e4effd640 1 -- 172.21.15.38:0/4150244197 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e54039c90 con 0x7f3e5815ad90 2023-12-22T08:47:35.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.933+0000 7f3e4effd640 1 -- 172.21.15.38:0/4150244197 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e54039df0 con 0x7f3e5815ad90 2023-12-22T08:47:35.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.933+0000 7f3e4effd640 1 -- 172.21.15.38:0/4150244197 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e54043640 con 0x7f3e5815ad90 2023-12-22T08:47:35.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.933+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/4150244197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e58156870 con 0x7f3e5815ad90 2023-12-22T08:47:35.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.933+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/4150244197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e58156e30 con 0x7f3e5815ad90 2023-12-22T08:47:35.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.934+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/4150244197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e58061910 con 0x7f3e5815ad90 2023-12-22T08:47:35.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.935+0000 7f3e4effd640 1 -- 172.21.15.38:0/4150244197 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e540437a0 con 0x7f3e5815ad90 2023-12-22T08:47:35.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.935+0000 7f3e4effd640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e3c06a460 0x7f3e3c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:35.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.936+0000 7f3e4effd640 1 -- 172.21.15.38:0/4150244197 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3e5403e070 con 0x7f3e5815ad90 2023-12-22T08:47:35.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.936+0000 7f3e5dbfa640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e3c06a460 0x7f3e3c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:35.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.937+0000 7f3e5dbfa640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e3c06a460 0x7f3e3c06c920 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3e58160d70 tx=0x7f3e48009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:35.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:35.940+0000 7f3e4effd640 1 -- 172.21.15.38:0/4150244197 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3e54076ef0 con 0x7f3e5815ad90 2023-12-22T08:47:36.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.161+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/4150244197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3e580c6ad0 con 0x7f3e5815ad90 2023-12-22T08:47:36.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.717+0000 7f3e4effd640 1 -- 172.21.15.38:0/4150244197 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3e5407a510 con 0x7f3e5815ad90 2023-12-22T08:47:36.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.720+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e3c06a460 msgr2=0x7f3e3c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:36.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.720+0000 7f3e5f3fd640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e3c06a460 0x7f3e3c06c920 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3e58160d70 tx=0x7f3e48009040 comp rx=0 tx=0).stop 2023-12-22T08:47:36.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.720+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/4150244197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e5815ad90 msgr2=0x7f3e581f38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:36.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.720+0000 7f3e5f3fd640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e5815ad90 0x7f3e581f38e0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f3e54000c00 tx=0x7f3e54004730 comp rx=0 tx=0).stop 2023-12-22T08:47:36.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.720+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/4150244197 shutdown_connections 2023-12-22T08:47:36.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.720+0000 7f3e5f3fd640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e58161bb0 0x7f3e58157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:36.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.720+0000 7f3e5f3fd640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e5815e050 0x7f3e5814e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:36.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.720+0000 7f3e5f3fd640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e3c06a460 0x7f3e3c06c920 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:36.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.720+0000 7f3e5f3fd640 1 --2- 172.21.15.38:0/4150244197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e5815ad90 0x7f3e581f38e0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:36.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.720+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/4150244197 >> 172.21.15.38:0/4150244197 conn(0x7f3e580d31c0 msgr2=0x7f3e580cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:36.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.720+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/4150244197 shutdown_connections 2023-12-22T08:47:36.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.721+0000 7f3e5f3fd640 1 -- 172.21.15.38:0/4150244197 wait complete. 2023-12-22T08:47:36.743 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T08:47:36.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.970+0000 7fd2b1ad5640 1 Processor -- start 2023-12-22T08:47:36.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.971+0000 7fd2b1ad5640 1 -- start start 2023-12-22T08:47:36.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.973+0000 7fd2b1ad5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd2ac15aee0 0x7fd2ac0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:36.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.973+0000 7fd2b1ad5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ac0b36a0 con 0x7fd2ac15b2c0 2023-12-22T08:47:36.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.973+0000 7fd2b1ad5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ac0b4570 con 0x7fd2ac15dbe0 2023-12-22T08:47:36.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.973+0000 7fd2b1ad5640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ac0b3a40 con 0x7fd2ac15aee0 2023-12-22T08:47:36.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.973+0000 7fd2ab7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd2ac15aee0 0x7fd2ac0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:36.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.973+0000 7fd2ab7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd2ac15aee0 0x7fd2ac0b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38208/0 (socket says 172.21.15.38:38208) 2023-12-22T08:47:36.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.973+0000 7fd2ab7fe640 1 -- 172.21.15.38:0/3376995065 learned_addr learned my addr 172.21.15.38:0/3376995065 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:36.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.973+0000 7fd2a3fff640 1 --1- 172.21.15.38:0/3376995065 >> v1:172.21.15.38:6789/0 conn(0x7fd2ac15b2c0 0x7fd2ac0b3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58874/0 (socket says 172.21.15.38:58874) 2023-12-22T08:47:36.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.974+0000 7fd2ab7fe640 1 -- 172.21.15.38:0/3376995065 >> v1:172.21.15.89:6789/0 conn(0x7fd2ac15dbe0 legacy=0x7fd2ac0b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:36.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.974+0000 7fd2ab7fe640 1 -- 172.21.15.38:0/3376995065 >> v1:172.21.15.38:6789/0 conn(0x7fd2ac15b2c0 legacy=0x7fd2ac0b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:36.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.974+0000 7fd2ab7fe640 1 -- 172.21.15.38:0/3376995065 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac0b56e0 con 0x7fd2ac15aee0 2023-12-22T08:47:36.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.975+0000 7fd2ab7fe640 1 --2- 172.21.15.38:0/3376995065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac15aee0 0x7fd2ac0b4d70 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009870 tx=0x7fd29c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb66498003651e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:36.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.975+0000 7fd2aaffd640 1 -- 172.21.15.38:0/3376995065 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c031870 con 0x7fd2ac15aee0 2023-12-22T08:47:36.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.975+0000 7fd2aaffd640 1 -- 172.21.15.38:0/3376995065 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c0319d0 con 0x7fd2ac15aee0 2023-12-22T08:47:36.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.975+0000 7fd2aaffd640 1 -- 172.21.15.38:0/3376995065 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c031d60 con 0x7fd2ac15aee0 2023-12-22T08:47:36.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.976+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/3376995065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac15aee0 msgr2=0x7fd2ac0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:36.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.976+0000 7fd2b1ad5640 1 --2- 172.21.15.38:0/3376995065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac15aee0 0x7fd2ac0b4d70 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009870 tx=0x7fd29c02b910 comp rx=0 tx=0).stop 2023-12-22T08:47:36.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.976+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/3376995065 shutdown_connections 2023-12-22T08:47:36.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.976+0000 7fd2b1ad5640 1 --2- 172.21.15.38:0/3376995065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac15aee0 0x7fd2ac0b4d70 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:36.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.976+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/3376995065 >> 172.21.15.38:0/3376995065 conn(0x7fd2ac070770 msgr2=0x7fd2ac070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:36.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.976+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/3376995065 shutdown_connections 2023-12-22T08:47:36.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.976+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/3376995065 wait complete. 2023-12-22T08:47:36.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.978+0000 7fd2b1ad5640 1 Processor -- start 2023-12-22T08:47:36.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.978+0000 7fd2b1ad5640 1 -- start start 2023-12-22T08:47:36.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.979+0000 7fd2b1ad5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac15aee0 0x7fd2ac1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:36.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.979+0000 7fd2b1ad5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2ac15dbe0 0x7fd2ac1e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:36.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.979+0000 7fd2b1ad5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac154e80 0x7fd2ac1e8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:36.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.979+0000 7fd2b1ad5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac158820 con 0x7fd2ac15aee0 2023-12-22T08:47:36.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.979+0000 7fd2b1ad5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac0cfea0 con 0x7fd2ac15dbe0 2023-12-22T08:47:36.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.979+0000 7fd2b1ad5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac1e6490 con 0x7fd2ac154e80 2023-12-22T08:47:36.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.979+0000 7fd2ab7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac15aee0 0x7fd2ac1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:36.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.979+0000 7fd2ab7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac15aee0 0x7fd2ac1582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38224/0 (socket says 172.21.15.38:38224) 2023-12-22T08:47:36.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.979+0000 7fd2ab7fe640 1 -- 172.21.15.38:0/1827776859 learned_addr learned my addr 172.21.15.38:0/1827776859 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:36.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.980+0000 7fd2ab7fe640 1 -- 172.21.15.38:0/1827776859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac154e80 msgr2=0x7fd2ac1e8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:36.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.980+0000 7fd2ab7fe640 1 --2- 172.21.15.38:0/1827776859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac154e80 0x7fd2ac1e8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:36.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.980+0000 7fd2ab7fe640 1 -- 172.21.15.38:0/1827776859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2ac15dbe0 msgr2=0x7fd2ac1e5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:36.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.980+0000 7fd2ab7fe640 1 --2- 172.21.15.38:0/1827776859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2ac15dbe0 0x7fd2ac1e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:36.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.980+0000 7fd2ab7fe640 1 -- 172.21.15.38:0/1827776859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c0094d0 con 0x7fd2ac15aee0 2023-12-22T08:47:36.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.980+0000 7fd2ab7fe640 1 --2- 172.21.15.38:0/1827776859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac15aee0 0x7fd2ac1582e0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009870 tx=0x7fd29c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:36.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.980+0000 7fd2a8ff9640 1 -- 172.21.15.38:0/1827776859 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c031820 con 0x7fd2ac15aee0 2023-12-22T08:47:36.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.980+0000 7fd2a8ff9640 1 -- 172.21.15.38:0/1827776859 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c0443f0 con 0x7fd2ac15aee0 2023-12-22T08:47:36.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.980+0000 7fd2a8ff9640 1 -- 172.21.15.38:0/1827776859 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c044780 con 0x7fd2ac15aee0 2023-12-22T08:47:36.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.980+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/1827776859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ac158a10 con 0x7fd2ac15aee0 2023-12-22T08:47:36.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.981+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/1827776859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ac1e87d0 con 0x7fd2ac15aee0 2023-12-22T08:47:36.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.982+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/1827776859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ac061910 con 0x7fd2ac15aee0 2023-12-22T08:47:36.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.982+0000 7fd2a8ff9640 1 -- 172.21.15.38:0/1827776859 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd29c04d450 con 0x7fd2ac15aee0 2023-12-22T08:47:36.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.983+0000 7fd2a8ff9640 1 --2- 172.21.15.38:0/1827776859 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd28c06a430 0x7fd28c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:36.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.983+0000 7fd2a8ff9640 1 -- 172.21.15.38:0/1827776859 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd29c02d040 con 0x7fd2ac15aee0 2023-12-22T08:47:36.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.984+0000 7fd2a3fff640 1 --2- 172.21.15.38:0/1827776859 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd28c06a430 0x7fd28c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:36.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.985+0000 7fd2a3fff640 1 --2- 172.21.15.38:0/1827776859 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd28c06a430 0x7fd28c06c8f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac15a6a0 tx=0x7fd2940079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:36.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:36.988+0000 7fd2a8ff9640 1 -- 172.21.15.38:0/1827776859 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd29c076740 con 0x7fd2ac15aee0 2023-12-22T08:47:37.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.184+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/1827776859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd2ac156330 con 0x7fd2ac15aee0 2023-12-22T08:47:37.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.728+0000 7fd2a8ff9640 1 -- 172.21.15.38:0/1827776859 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v132) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd29c079d60 con 0x7fd2ac15aee0 2023-12-22T08:47:37.730 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2023-12-22T08:47:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.732+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/1827776859 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd28c06a430 msgr2=0x7fd28c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.732+0000 7fd2b1ad5640 1 --2- 172.21.15.38:0/1827776859 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd28c06a430 0x7fd28c06c8f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac15a6a0 tx=0x7fd2940079c0 comp rx=0 tx=0).stop 2023-12-22T08:47:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.732+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/1827776859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac15aee0 msgr2=0x7fd2ac1582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.732+0000 7fd2b1ad5640 1 --2- 172.21.15.38:0/1827776859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac15aee0 0x7fd2ac1582e0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009870 tx=0x7fd29c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.733+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/1827776859 shutdown_connections 2023-12-22T08:47:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.733+0000 7fd2b1ad5640 1 --2- 172.21.15.38:0/1827776859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd2ac154e80 0x7fd2ac1e8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:37.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.733+0000 7fd2b1ad5640 1 --2- 172.21.15.38:0/1827776859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2ac15dbe0 0x7fd2ac1e5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:37.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.733+0000 7fd2b1ad5640 1 --2- 172.21.15.38:0/1827776859 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd28c06a430 0x7fd28c06c8f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:37.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.733+0000 7fd2b1ad5640 1 --2- 172.21.15.38:0/1827776859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ac15aee0 0x7fd2ac1582e0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:37.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.733+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/1827776859 >> 172.21.15.38:0/1827776859 conn(0x7fd2ac070770 msgr2=0x7fd2ac0b4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:37.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.733+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/1827776859 shutdown_connections 2023-12-22T08:47:37.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.733+0000 7fd2b1ad5640 1 -- 172.21.15.38:0/1827776859 wait complete. 2023-12-22T08:47:37.758 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T08:47:37.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.978+0000 7f79ba10a640 1 Processor -- start 2023-12-22T08:47:37.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.978+0000 7f79ba10a640 1 -- start start 2023-12-22T08:47:37.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.980+0000 7f79ba10a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f79b4146e40 0x7f79b40cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:37.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.980+0000 7f79ba10a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f79b4161df0 0x7f79b41611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:37.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.980+0000 7f79ba10a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b4161b40 con 0x7f79b4161700 2023-12-22T08:47:37.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.980+0000 7f79ba10a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b40b4da0 con 0x7f79b4161df0 2023-12-22T08:47:37.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.980+0000 7f79ba10a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b40b4120 con 0x7f79b4146e40 2023-12-22T08:47:37.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.981+0000 7f79abfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f79b4161df0 0x7f79b41611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:37.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.981+0000 7f79abfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f79b4161df0 0x7f79b41611c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38238/0 (socket says 172.21.15.38:38238) 2023-12-22T08:47:37.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.981+0000 7f79abfff640 1 -- 172.21.15.38:0/296853057 learned_addr learned my addr 172.21.15.38:0/296853057 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:37.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.981+0000 7f79b37fe640 1 --2- 172.21.15.38:0/296853057 >> v2:172.21.15.89:3300/0 conn(0x7f79b4146e40 0x7f79b40cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:37.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.981+0000 7f79abfff640 1 -- 172.21.15.38:0/296853057 >> v2:172.21.15.89:3300/0 conn(0x7f79b4146e40 msgr2=0x7f79b40cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:37.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.981+0000 7f79abfff640 1 --2- 172.21.15.38:0/296853057 >> v2:172.21.15.89:3300/0 conn(0x7f79b4146e40 0x7f79b40cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:37.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.981+0000 7f79abfff640 1 -- 172.21.15.38:0/296853057 >> v1:172.21.15.89:6789/0 conn(0x7f79b4161700 legacy=0x7f79b406cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:37.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.981+0000 7f79abfff640 1 -- 172.21.15.38:0/296853057 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40b4400 con 0x7f79b4161df0 2023-12-22T08:47:37.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.981+0000 7f79b37fe640 1 --2- 172.21.15.38:0/296853057 >> v2:172.21.15.89:3300/0 conn(0x7f79b4146e40 0x7f79b40cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:37.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.983+0000 7f79abfff640 1 --2- 172.21.15.38:0/296853057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79b4161df0 0x7f79b41611c0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f79b406c620 tx=0x7f799c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57c5f5dbac3c496 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:37.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.983+0000 7f79b2ffd640 1 -- 172.21.15.38:0/296853057 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c004230 con 0x7f79b4161df0 2023-12-22T08:47:37.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.983+0000 7f79b2ffd640 1 -- 172.21.15.38:0/296853057 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c004390 con 0x7f79b4161df0 2023-12-22T08:47:37.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.983+0000 7f79b2ffd640 1 -- 172.21.15.38:0/296853057 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c003810 con 0x7f79b4161df0 2023-12-22T08:47:37.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.983+0000 7f79ba10a640 1 -- 172.21.15.38:0/296853057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79b4161df0 msgr2=0x7f79b41611c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:37.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.983+0000 7f79ba10a640 1 --2- 172.21.15.38:0/296853057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79b4161df0 0x7f79b41611c0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f79b406c620 tx=0x7f799c02b860 comp rx=0 tx=0).stop 2023-12-22T08:47:37.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.984+0000 7f79ba10a640 1 -- 172.21.15.38:0/296853057 shutdown_connections 2023-12-22T08:47:37.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.984+0000 7f79ba10a640 1 --2- 172.21.15.38:0/296853057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79b4161df0 0x7f79b41611c0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:37.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.984+0000 7f79ba10a640 1 --2- 172.21.15.38:0/296853057 >> v2:172.21.15.89:3300/0 conn(0x7f79b4146e40 0x7f79b40cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:37.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.984+0000 7f79ba10a640 1 -- 172.21.15.38:0/296853057 >> 172.21.15.38:0/296853057 conn(0x7f79b40cff10 msgr2=0x7f79b40d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:37.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.984+0000 7f79ba10a640 1 -- 172.21.15.38:0/296853057 shutdown_connections 2023-12-22T08:47:37.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.984+0000 7f79ba10a640 1 -- 172.21.15.38:0/296853057 wait complete. 2023-12-22T08:47:37.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.985+0000 7f79ba10a640 1 Processor -- start 2023-12-22T08:47:37.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.986+0000 7f79ba10a640 1 -- start start 2023-12-22T08:47:37.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79ba10a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79b4146e40 0x7f79b415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:37.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79ba10a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79b4161700 0x7f79b41f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79ba10a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79b4161df0 0x7f79b41f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79ba10a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b415d3c0 con 0x7f79b4146e40 2023-12-22T08:47:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79ba10a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b415f040 con 0x7f79b4161df0 2023-12-22T08:47:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79ba10a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b415e200 con 0x7f79b4161700 2023-12-22T08:47:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79b37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79b4146e40 0x7f79b415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79b37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79b4146e40 0x7f79b415dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38242/0 (socket says 172.21.15.38:38242) 2023-12-22T08:47:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79b37fe640 1 -- 172.21.15.38:0/2674548369 learned_addr learned my addr 172.21.15.38:0/2674548369 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79abfff640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79b4161700 0x7f79b41f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79b3fff640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79b4161df0 0x7f79b41f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79b37fe640 1 -- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79b4161700 msgr2=0x7f79b41f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79b37fe640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79b4161700 0x7f79b41f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79b37fe640 1 -- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79b4161df0 msgr2=0x7f79b41f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:37.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79b37fe640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79b4161df0 0x7f79b41f2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:37.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79b37fe640 1 -- 172.21.15.38:0/2674548369 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c009460 con 0x7f79b4146e40 2023-12-22T08:47:37.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79abfff640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79b4161700 0x7f79b41f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:37.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.987+0000 7f79b3fff640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79b4161df0 0x7f79b41f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:37.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.988+0000 7f79b37fe640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79b4146e40 0x7f79b415dcc0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c7f0 tx=0x7f79a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:37.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.988+0000 7f79b0ff9640 1 -- 172.21.15.38:0/2674548369 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4007820 con 0x7f79b4146e40 2023-12-22T08:47:37.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.988+0000 7f79b0ff9640 1 -- 172.21.15.38:0/2674548369 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a4007980 con 0x7f79b4146e40 2023-12-22T08:47:37.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.988+0000 7f79b0ff9640 1 -- 172.21.15.38:0/2674548369 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4007cf0 con 0x7f79b4146e40 2023-12-22T08:47:37.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.988+0000 7f79ba10a640 1 -- 172.21.15.38:0/2674548369 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b415e430 con 0x7f79b4146e40 2023-12-22T08:47:37.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.988+0000 7f79ba10a640 1 -- 172.21.15.38:0/2674548369 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b415e9f0 con 0x7f79b4146e40 2023-12-22T08:47:37.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.989+0000 7f79ba10a640 1 -- 172.21.15.38:0/2674548369 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b413ef40 con 0x7f79b4146e40 2023-12-22T08:47:37.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.991+0000 7f79b0ff9640 1 -- 172.21.15.38:0/2674548369 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f79a40113f0 con 0x7f79b4146e40 2023-12-22T08:47:37.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.992+0000 7f79b0ff9640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f799406a430 0x7f799406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:37.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.992+0000 7f79b0ff9640 1 -- 172.21.15.38:0/2674548369 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f79a4088ae0 con 0x7f79b4146e40 2023-12-22T08:47:37.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.992+0000 7f79abfff640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f799406a430 0x7f799406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:37.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.993+0000 7f79abfff640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f799406a430 0x7f799406c8f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f799c034000 tx=0x7f799c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:37.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:37.996+0000 7f79b0ff9640 1 -- 172.21.15.38:0/2674548369 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f79a4054230 con 0x7f79b4146e40 2023-12-22T08:47:38.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.192+0000 7f79ba10a640 1 -- 172.21.15.38:0/2674548369 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f79b4061910 con 0x7f79b4146e40 2023-12-22T08:47:38.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.735+0000 7f79b0ff9640 1 -- 172.21.15.38:0/2674548369 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v133) v1 ==== 169+0+0 (secure 0 0 0) 0x7f79a401f0d0 con 0x7f79b4146e40 2023-12-22T08:47:38.737 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2023-12-22T08:47:38.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.740+0000 7f79ba10a640 1 -- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f799406a430 msgr2=0x7f799406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:38.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.740+0000 7f79ba10a640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f799406a430 0x7f799406c8f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f799c034000 tx=0x7f799c008030 comp rx=0 tx=0).stop 2023-12-22T08:47:38.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.740+0000 7f79ba10a640 1 -- 172.21.15.38:0/2674548369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79b4146e40 msgr2=0x7f79b415dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:38.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.740+0000 7f79ba10a640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79b4146e40 0x7f79b415dcc0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c7f0 tx=0x7f79a400ccb0 comp rx=0 tx=0).stop 2023-12-22T08:47:38.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.740+0000 7f79ba10a640 1 -- 172.21.15.38:0/2674548369 shutdown_connections 2023-12-22T08:47:38.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.740+0000 7f79ba10a640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79b4161df0 0x7f79b41f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:38.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.740+0000 7f79ba10a640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79b4161700 0x7f79b41f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:38.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.740+0000 7f79ba10a640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f799406a430 0x7f799406c8f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:38.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.740+0000 7f79ba10a640 1 --2- 172.21.15.38:0/2674548369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79b4146e40 0x7f79b415dcc0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:38.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.740+0000 7f79ba10a640 1 -- 172.21.15.38:0/2674548369 >> 172.21.15.38:0/2674548369 conn(0x7f79b40cff10 msgr2=0x7f79b4144810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:38.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.740+0000 7f79ba10a640 1 -- 172.21.15.38:0/2674548369 shutdown_connections 2023-12-22T08:47:38.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.740+0000 7f79ba10a640 1 -- 172.21.15.38:0/2674548369 wait complete. 2023-12-22T08:47:38.763 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-22T08:47:38.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.982+0000 7f6b83a5f640 1 Processor -- start 2023-12-22T08:47:38.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.982+0000 7f6b83a5f640 1 -- start start 2023-12-22T08:47:38.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.984+0000 7f6b83a5f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6b7c0b2100 0x7f6b7c06cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:38.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.984+0000 7f6b83a5f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b7c161c30 0x7f6b7c06d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.984+0000 7f6b83a5f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7c0c9550 con 0x7f6b7c0b24e0 2023-12-22T08:47:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.984+0000 7f6b83a5f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b7c06d900 con 0x7f6b7c0b2100 2023-12-22T08:47:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.984+0000 7f6b83a5f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c06dbe0 con 0x7f6b7c161c30 2023-12-22T08:47:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.985+0000 7f6b81ffc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b7c161c30 0x7f6b7c06d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.985+0000 7f6b81ffc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b7c161c30 0x7f6b7c06d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:58406/0 (socket says 172.21.15.38:58406) 2023-12-22T08:47:38.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.985+0000 7f6b81ffc640 1 -- 172.21.15.38:0/3835937493 learned_addr learned my addr 172.21.15.38:0/3835937493 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:38.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.985+0000 7f6b817fb640 1 --2- 172.21.15.38:0/3835937493 >> v2:172.21.15.89:3300/0 conn(0x7f6b7c0b2100 0x7f6b7c06cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:38.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.986+0000 7f6b81ffc640 1 -- 172.21.15.38:0/3835937493 >> v2:172.21.15.89:3300/0 conn(0x7f6b7c0b2100 msgr2=0x7f6b7c06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:38.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.986+0000 7f6b81ffc640 1 --2- 172.21.15.38:0/3835937493 >> v2:172.21.15.89:3300/0 conn(0x7f6b7c0b2100 0x7f6b7c06cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:38.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.986+0000 7f6b81ffc640 1 -- 172.21.15.38:0/3835937493 >> v1:172.21.15.89:6789/0 conn(0x7f6b7c0b24e0 legacy=0x7f6b7c161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:38.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.986+0000 7f6b81ffc640 1 -- 172.21.15.38:0/3835937493 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c06dec0 con 0x7f6b7c161c30 2023-12-22T08:47:38.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.986+0000 7f6b73fff640 1 -- 172.21.15.38:0/3835937493 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446755118 0 0) 0x7f6b7c0c9550 con 0x7f6b7c0b24e0 2023-12-22T08:47:38.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.987+0000 7f6b81ffc640 1 --2- 172.21.15.38:0/3835937493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b7c161c30 0x7f6b7c06d280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009e50 tx=0x7f6b7402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c33760abc4987d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:38.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.988+0000 7f6b73fff640 1 -- 172.21.15.38:0/3835937493 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7402cb00 con 0x7f6b7c161c30 2023-12-22T08:47:38.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.988+0000 7f6b73fff640 1 -- 172.21.15.38:0/3835937493 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7402cc60 con 0x7f6b7c161c30 2023-12-22T08:47:38.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.988+0000 7f6b73fff640 1 -- 172.21.15.38:0/3835937493 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b740343f0 con 0x7f6b7c161c30 2023-12-22T08:47:38.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.988+0000 7f6b83a5f640 1 -- 172.21.15.38:0/3835937493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b7c161c30 msgr2=0x7f6b7c06d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:38.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.988+0000 7f6b83a5f640 1 --2- 172.21.15.38:0/3835937493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b7c161c30 0x7f6b7c06d280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009e50 tx=0x7f6b7402bf60 comp rx=0 tx=0).stop 2023-12-22T08:47:38.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.988+0000 7f6b83a5f640 1 -- 172.21.15.38:0/3835937493 shutdown_connections 2023-12-22T08:47:38.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.988+0000 7f6b83a5f640 1 --2- 172.21.15.38:0/3835937493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b7c161c30 0x7f6b7c06d280 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:38.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.988+0000 7f6b83a5f640 1 --2- 172.21.15.38:0/3835937493 >> v2:172.21.15.89:3300/0 conn(0x7f6b7c0b2100 0x7f6b7c06cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:38.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.988+0000 7f6b83a5f640 1 -- 172.21.15.38:0/3835937493 >> 172.21.15.38:0/3835937493 conn(0x7f6b7c0cba10 msgr2=0x7f6b7c0cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:38.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.989+0000 7f6b83a5f640 1 -- 172.21.15.38:0/3835937493 shutdown_connections 2023-12-22T08:47:38.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.989+0000 7f6b83a5f640 1 -- 172.21.15.38:0/3835937493 wait complete. 2023-12-22T08:47:38.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.990+0000 7f6b83a5f640 1 Processor -- start 2023-12-22T08:47:38.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.991+0000 7f6b83a5f640 1 -- start start 2023-12-22T08:47:38.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.991+0000 7f6b83a5f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b7c0b2100 0x7f6b7c1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:38.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.991+0000 7f6b83a5f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c0b24e0 0x7f6b7c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:38.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.991+0000 7f6b83a5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b7c161c30 0x7f6b7c163920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:38.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.991+0000 7f6b83a5f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c153a70 con 0x7f6b7c0b24e0 2023-12-22T08:47:38.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.991+0000 7f6b83a5f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c0c6320 con 0x7f6b7c161c30 2023-12-22T08:47:38.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.991+0000 7f6b83a5f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c153e00 con 0x7f6b7c0b2100 2023-12-22T08:47:38.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.992+0000 7f6b80ffa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c0b24e0 0x7f6b7c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:38.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.992+0000 7f6b80ffa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c0b24e0 0x7f6b7c1555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38254/0 (socket says 172.21.15.38:38254) 2023-12-22T08:47:38.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.992+0000 7f6b80ffa640 1 -- 172.21.15.38:0/62353823 learned_addr learned my addr 172.21.15.38:0/62353823 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:38.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.992+0000 7f6b81ffc640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b7c161c30 0x7f6b7c163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:38.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.992+0000 7f6b817fb640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b7c0b2100 0x7f6b7c1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:38.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.992+0000 7f6b80ffa640 1 -- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b7c0b2100 msgr2=0x7f6b7c1531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:38.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.992+0000 7f6b80ffa640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b7c0b2100 0x7f6b7c1531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:38.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.992+0000 7f6b80ffa640 1 -- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b7c161c30 msgr2=0x7f6b7c163920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:38.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.992+0000 7f6b80ffa640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b7c161c30 0x7f6b7c163920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:38.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.992+0000 7f6b80ffa640 1 -- 172.21.15.38:0/62353823 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b74009b30 con 0x7f6b7c0b24e0 2023-12-22T08:47:38.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.993+0000 7f6b80ffa640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c0b24e0 0x7f6b7c1555b0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00c4b0 tx=0x7f6b6c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:38.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.993+0000 7f6b71ffb640 1 -- 172.21.15.38:0/62353823 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c005480 con 0x7f6b7c0b24e0 2023-12-22T08:47:38.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.993+0000 7f6b71ffb640 1 -- 172.21.15.38:0/62353823 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c003640 con 0x7f6b7c0b24e0 2023-12-22T08:47:38.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.993+0000 7f6b83a5f640 1 -- 172.21.15.38:0/62353823 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7c0c6570 con 0x7f6b7c0b24e0 2023-12-22T08:47:38.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.993+0000 7f6b71ffb640 1 -- 172.21.15.38:0/62353823 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c0039f0 con 0x7f6b7c0b24e0 2023-12-22T08:47:38.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.993+0000 7f6b83a5f640 1 -- 172.21.15.38:0/62353823 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7c0c6b30 con 0x7f6b7c0b24e0 2023-12-22T08:47:38.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.995+0000 7f6b83a5f640 1 -- 172.21.15.38:0/62353823 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7c153f90 con 0x7f6b7c0b24e0 2023-12-22T08:47:38.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.996+0000 7f6b71ffb640 1 -- 172.21.15.38:0/62353823 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6b6c003b50 con 0x7f6b7c0b24e0 2023-12-22T08:47:38.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.997+0000 7f6b71ffb640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6b6006a430 0x7f6b6006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:38.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.997+0000 7f6b71ffb640 1 -- 172.21.15.38:0/62353823 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6b6c087bf0 con 0x7f6b7c0b24e0 2023-12-22T08:47:38.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.998+0000 7f6b817fb640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6b6006a430 0x7f6b6006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:39.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:38.999+0000 7f6b817fb640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6b6006a430 0x7f6b6006c8f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6b78006fd0 tx=0x7f6b78008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:39.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.001+0000 7f6b71ffb640 1 -- 172.21.15.38:0/62353823 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6b6c0534d0 con 0x7f6b7c0b24e0 2023-12-22T08:47:39.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.201+0000 7f6b83a5f640 1 -- 172.21.15.38:0/62353823 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6b7c061910 con 0x7f6b7c0b24e0 2023-12-22T08:47:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.210+0000 7f6b71ffb640 1 -- 172.21.15.38:0/62353823 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6b6c0170a0 con 0x7f6b7c0b24e0 2023-12-22T08:47:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.213+0000 7f6b83a5f640 1 -- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6b6006a430 msgr2=0x7f6b6006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.213+0000 7f6b83a5f640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6b6006a430 0x7f6b6006c8f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6b78006fd0 tx=0x7f6b78008040 comp rx=0 tx=0).stop 2023-12-22T08:47:39.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.213+0000 7f6b83a5f640 1 -- 172.21.15.38:0/62353823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c0b24e0 msgr2=0x7f6b7c1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:39.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.213+0000 7f6b83a5f640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c0b24e0 0x7f6b7c1555b0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00c4b0 tx=0x7f6b6c00c970 comp rx=0 tx=0).stop 2023-12-22T08:47:39.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.214+0000 7f6b83a5f640 1 -- 172.21.15.38:0/62353823 shutdown_connections 2023-12-22T08:47:39.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.214+0000 7f6b83a5f640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b7c161c30 0x7f6b7c163920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:39.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.214+0000 7f6b83a5f640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6b6006a430 0x7f6b6006c8f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.214+0000 7f6b83a5f640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c0b24e0 0x7f6b7c1555b0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.214+0000 7f6b83a5f640 1 --2- 172.21.15.38:0/62353823 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b7c0b2100 0x7f6b7c1531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.214+0000 7f6b83a5f640 1 -- 172.21.15.38:0/62353823 >> 172.21.15.38:0/62353823 conn(0x7f6b7c0cba10 msgr2=0x7f6b7c156700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.214+0000 7f6b83a5f640 1 -- 172.21.15.38:0/62353823 shutdown_connections 2023-12-22T08:47:39.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.214+0000 7f6b83a5f640 1 -- 172.21.15.38:0/62353823 wait complete. 2023-12-22T08:47:39.236 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-12-22T08:47:39.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.468+0000 7f631a99f640 1 Processor -- start 2023-12-22T08:47:39.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.468+0000 7f631a99f640 1 -- start start 2023-12-22T08:47:39.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.469+0000 7f631a99f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f631415e740 0x7f631415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:39.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.469+0000 7f631a99f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f63140b3f90 0x7f6314070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:39.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.469+0000 7f631a99f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631415eb20 con 0x7f631406ca50 2023-12-22T08:47:39.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.469+0000 7f631a99f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631406e650 con 0x7f63140b3f90 2023-12-22T08:47:39.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.469+0000 7f631a99f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6314070770 con 0x7f631415e740 2023-12-22T08:47:39.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.470+0000 7f6313fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f631415e740 0x7f631415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:39.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.470+0000 7f6318f3c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f63140b3f90 0x7f6314070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:39.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.470+0000 7f63137fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f631406ca50 0x7f63140b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58890/0 (socket says 172.21.15.38:58890) 2023-12-22T08:47:39.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.470+0000 7f63137fe640 1 -- 172.21.15.38:0/4274210039 learned_addr learned my addr 172.21.15.38:0/4274210039 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:39.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.471+0000 7f6318f3c640 1 -- 172.21.15.38:0/4274210039 >> v2:172.21.15.89:3300/0 conn(0x7f631415e740 msgr2=0x7f631415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:39.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.471+0000 7f6318f3c640 1 --2- 172.21.15.38:0/4274210039 >> v2:172.21.15.89:3300/0 conn(0x7f631415e740 0x7f631415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:39.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.471+0000 7f6312ffd640 1 -- 172.21.15.38:0/4274210039 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109950191 0 0) 0x7f631415eb20 con 0x7f631406ca50 2023-12-22T08:47:39.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.471+0000 7f6318f3c640 1 -- 172.21.15.38:0/4274210039 >> v1:172.21.15.38:6789/0 conn(0x7f631406ca50 legacy=0x7f63140b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:39.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.471+0000 7f6318f3c640 1 -- 172.21.15.38:0/4274210039 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631406cec0 con 0x7f63140b3f90 2023-12-22T08:47:39.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.472+0000 7f6318f3c640 1 --2- 172.21.15.38:0/4274210039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63140b3f90 0x7f6314070c00 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f631406ca20 tx=0x7f630c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bd844ec3801792 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:39.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.472+0000 7f6312ffd640 1 -- 172.21.15.38:0/4274210039 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c031710 con 0x7f63140b3f90 2023-12-22T08:47:39.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.473+0000 7f6312ffd640 1 -- 172.21.15.38:0/4274210039 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c02f050 con 0x7f63140b3f90 2023-12-22T08:47:39.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.473+0000 7f6312ffd640 1 -- 172.21.15.38:0/4274210039 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c031a90 con 0x7f63140b3f90 2023-12-22T08:47:39.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.473+0000 7f631a99f640 1 -- 172.21.15.38:0/4274210039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63140b3f90 msgr2=0x7f6314070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:39.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.473+0000 7f631a99f640 1 --2- 172.21.15.38:0/4274210039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63140b3f90 0x7f6314070c00 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f631406ca20 tx=0x7f630c02b7b0 comp rx=0 tx=0).stop 2023-12-22T08:47:39.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.473+0000 7f631a99f640 1 -- 172.21.15.38:0/4274210039 shutdown_connections 2023-12-22T08:47:39.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.473+0000 7f631a99f640 1 --2- 172.21.15.38:0/4274210039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63140b3f90 0x7f6314070c00 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:39.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.473+0000 7f631a99f640 1 --2- 172.21.15.38:0/4274210039 >> v2:172.21.15.89:3300/0 conn(0x7f631415e740 0x7f631415db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:39.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.473+0000 7f631a99f640 1 -- 172.21.15.38:0/4274210039 >> 172.21.15.38:0/4274210039 conn(0x7f63140cfea0 msgr2=0x7f63140d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:39.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.473+0000 7f631a99f640 1 -- 172.21.15.38:0/4274210039 shutdown_connections 2023-12-22T08:47:39.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.473+0000 7f631a99f640 1 -- 172.21.15.38:0/4274210039 wait complete. 2023-12-22T08:47:39.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.475+0000 7f631a99f640 1 Processor -- start 2023-12-22T08:47:39.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.475+0000 7f631a99f640 1 -- start start 2023-12-22T08:47:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.476+0000 7f631a99f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f631406ca50 0x7f6314158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.476+0000 7f631a99f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63140b3f90 0x7f63141575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.476+0000 7f631a99f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f631415e740 0x7f631415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.476+0000 7f631a99f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6314157120 con 0x7f631406ca50 2023-12-22T08:47:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.476+0000 7f631a99f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6314156510 con 0x7f63140b3f90 2023-12-22T08:47:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.476+0000 7f631a99f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63141567f0 con 0x7f631415e740 2023-12-22T08:47:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.477+0000 7f6313fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f631406ca50 0x7f6314158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.477+0000 7f6313fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f631406ca50 0x7f6314158310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38272/0 (socket says 172.21.15.38:38272) 2023-12-22T08:47:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.477+0000 7f6313fff640 1 -- 172.21.15.38:0/721945343 learned_addr learned my addr 172.21.15.38:0/721945343 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.477+0000 7f6318f3c640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f631415e740 0x7f631415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.477+0000 7f63137fe640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63140b3f90 0x7f63141575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.477+0000 7f6313fff640 1 -- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f631415e740 msgr2=0x7f631415ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.477+0000 7f6313fff640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f631415e740 0x7f631415ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.477+0000 7f6313fff640 1 -- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63140b3f90 msgr2=0x7f63141575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.477+0000 7f6313fff640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63140b3f90 0x7f63141575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.477+0000 7f6313fff640 1 -- 172.21.15.38:0/721945343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c009400 con 0x7f631406ca50 2023-12-22T08:47:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.477+0000 7f6318f3c640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f631415e740 0x7f631415ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.477+0000 7f63137fe640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63140b3f90 0x7f63141575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.478+0000 7f6313fff640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f631406ca50 0x7f6314158310 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f630400efc0 tx=0x7f630400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.478+0000 7f6310ff9640 1 -- 172.21.15.38:0/721945343 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304009b80 con 0x7f631406ca50 2023-12-22T08:47:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.478+0000 7f6310ff9640 1 -- 172.21.15.38:0/721945343 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630400f040 con 0x7f631406ca50 2023-12-22T08:47:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.478+0000 7f6310ff9640 1 -- 172.21.15.38:0/721945343 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63040146a0 con 0x7f631406ca50 2023-12-22T08:47:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.478+0000 7f631a99f640 1 -- 172.21.15.38:0/721945343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6314156ad0 con 0x7f631406ca50 2023-12-22T08:47:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.478+0000 7f631a99f640 1 -- 172.21.15.38:0/721945343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6314158850 con 0x7f631406ca50 2023-12-22T08:47:39.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.479+0000 7f631a99f640 1 -- 172.21.15.38:0/721945343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6314061910 con 0x7f631406ca50 2023-12-22T08:47:39.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.480+0000 7f6310ff9640 1 -- 172.21.15.38:0/721945343 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6304014800 con 0x7f631406ca50 2023-12-22T08:47:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.481+0000 7f6310ff9640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62f406a480 0x7f62f406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:39.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.481+0000 7f6310ff9640 1 -- 172.21.15.38:0/721945343 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6304089360 con 0x7f631406ca50 2023-12-22T08:47:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.482+0000 7f63137fe640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62f406a480 0x7f62f406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:39.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.483+0000 7f63137fe640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62f406a480 0x7f62f406c940 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6314155da0 tx=0x7f62fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.486+0000 7f6310ff9640 1 -- 172.21.15.38:0/721945343 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6304054d30 con 0x7f631406ca50 2023-12-22T08:47:39.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:39.748+0000 7f631a99f640 1 -- 172.21.15.38:0/721945343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f63140b2c60 con 0x7f631406ca50 2023-12-22T08:47:40.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:40.749+0000 7f6310ff9640 1 -- 172.21.15.38:0/721945343 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v399) v1 ==== 128+0+0 (secure 0 0 0) 0x7f6304058350 con 0x7f631406ca50 2023-12-22T08:47:40.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:40.753+0000 7f631a99f640 1 -- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62f406a480 msgr2=0x7f62f406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:40.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:40.753+0000 7f631a99f640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62f406a480 0x7f62f406c940 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6314155da0 tx=0x7f62fc009040 comp rx=0 tx=0).stop 2023-12-22T08:47:40.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:40.753+0000 7f631a99f640 1 -- 172.21.15.38:0/721945343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f631406ca50 msgr2=0x7f6314158310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:40.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:40.753+0000 7f631a99f640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f631406ca50 0x7f6314158310 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f630400efc0 tx=0x7f630400c490 comp rx=0 tx=0).stop 2023-12-22T08:47:40.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:40.753+0000 7f631a99f640 1 -- 172.21.15.38:0/721945343 shutdown_connections 2023-12-22T08:47:40.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:40.753+0000 7f631a99f640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f631415e740 0x7f631415ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:40.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:40.753+0000 7f631a99f640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63140b3f90 0x7f63141575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:40.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:40.753+0000 7f631a99f640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62f406a480 0x7f62f406c940 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:40.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:40.753+0000 7f631a99f640 1 --2- 172.21.15.38:0/721945343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f631406ca50 0x7f6314158310 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:40.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:40.753+0000 7f631a99f640 1 -- 172.21.15.38:0/721945343 >> 172.21.15.38:0/721945343 conn(0x7f63140cfea0 msgr2=0x7f63140b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:40.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:40.753+0000 7f631a99f640 1 -- 172.21.15.38:0/721945343 shutdown_connections 2023-12-22T08:47:40.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:40.753+0000 7f631a99f640 1 -- 172.21.15.38:0/721945343 wait complete. 2023-12-22T08:47:40.780 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-12-22T08:47:40.780 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-12-22T08:47:40.781 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.007+0000 7fe597547640 1 Processor -- start 2023-12-22T08:47:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.008+0000 7fe597547640 1 -- start start 2023-12-22T08:47:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.009+0000 7fe597547640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5900b3f90 0x7fe59015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.009+0000 7fe597547640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe59006ca50 0x7fe590070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.009+0000 7fe597547640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59015eb20 con 0x7fe59015e740 2023-12-22T08:47:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.009+0000 7fe597547640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59006e650 con 0x7fe59006ca50 2023-12-22T08:47:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.009+0000 7fe597547640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe590070770 con 0x7fe5900b3f90 2023-12-22T08:47:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.010+0000 7fe5952e3640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe59015e740 0x7fe5900b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56272/0 (socket says 172.21.15.38:56272) 2023-12-22T08:47:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.010+0000 7fe5952e3640 1 -- 172.21.15.38:0/1777096173 learned_addr learned my addr 172.21.15.38:0/1777096173 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.010+0000 7fe595ae4640 1 --2- 172.21.15.38:0/1777096173 >> v2:172.21.15.38:3300/0 conn(0x7fe59006ca50 0x7fe590070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.010+0000 7fe594ae2640 1 --2- 172.21.15.38:0/1777096173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5900b3f90 0x7fe59015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.010+0000 7fe587fff640 1 -- 172.21.15.38:0/1777096173 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054311017 0 0) 0x7fe59015eb20 con 0x7fe59015e740 2023-12-22T08:47:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.010+0000 7fe587fff640 1 -- 172.21.15.38:0/1777096173 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe57c003520 con 0x7fe59015e740 2023-12-22T08:47:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.010+0000 7fe595ae4640 1 -- 172.21.15.38:0/1777096173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5900b3f90 msgr2=0x7fe59015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.010+0000 7fe595ae4640 1 --2- 172.21.15.38:0/1777096173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5900b3f90 0x7fe59015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.010+0000 7fe595ae4640 1 -- 172.21.15.38:0/1777096173 >> v1:172.21.15.38:6789/0 conn(0x7fe59015e740 legacy=0x7fe5900b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.010+0000 7fe595ae4640 1 -- 172.21.15.38:0/1777096173 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59006cec0 con 0x7fe59006ca50 2023-12-22T08:47:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.011+0000 7fe595ae4640 1 --2- 172.21.15.38:0/1777096173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe59006ca50 0x7fe590070c00 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fe588009d90 tx=0x7fe58802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800c6659dbf7b142 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.012+0000 7fe587fff640 1 -- 172.21.15.38:0/1777096173 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58802cb30 con 0x7fe59006ca50 2023-12-22T08:47:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.012+0000 7fe587fff640 1 -- 172.21.15.38:0/1777096173 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58802cc90 con 0x7fe59006ca50 2023-12-22T08:47:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.012+0000 7fe587fff640 1 -- 172.21.15.38:0/1777096173 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588034440 con 0x7fe59006ca50 2023-12-22T08:47:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.012+0000 7fe597547640 1 -- 172.21.15.38:0/1777096173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe59006ca50 msgr2=0x7fe590070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.012+0000 7fe597547640 1 --2- 172.21.15.38:0/1777096173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe59006ca50 0x7fe590070c00 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fe588009d90 tx=0x7fe58802bd80 comp rx=0 tx=0).stop 2023-12-22T08:47:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.012+0000 7fe597547640 1 -- 172.21.15.38:0/1777096173 shutdown_connections 2023-12-22T08:47:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.012+0000 7fe597547640 1 --2- 172.21.15.38:0/1777096173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe59006ca50 0x7fe590070c00 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.012+0000 7fe597547640 1 --2- 172.21.15.38:0/1777096173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5900b3f90 0x7fe59015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.012+0000 7fe597547640 1 -- 172.21.15.38:0/1777096173 >> 172.21.15.38:0/1777096173 conn(0x7fe5900cfea0 msgr2=0x7fe5900d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.013+0000 7fe597547640 1 -- 172.21.15.38:0/1777096173 shutdown_connections 2023-12-22T08:47:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.013+0000 7fe597547640 1 -- 172.21.15.38:0/1777096173 wait complete. 2023-12-22T08:47:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.014+0000 7fe597547640 1 Processor -- start 2023-12-22T08:47:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.014+0000 7fe597547640 1 -- start start 2023-12-22T08:47:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.015+0000 7fe597547640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59006ca50 0x7fe5900aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.015+0000 7fe597547640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5900b3f90 0x7fe5900b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.015+0000 7fe597547640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe59015e740 0x7fe5901527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.015+0000 7fe597547640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900ade50 con 0x7fe5900b3f90 2023-12-22T08:47:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.015+0000 7fe597547640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900af410 con 0x7fe59006ca50 2023-12-22T08:47:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.015+0000 7fe597547640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900ae110 con 0x7fe59015e740 2023-12-22T08:47:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.016+0000 7fe594ae2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5900b3f90 0x7fe5900b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.016+0000 7fe594ae2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5900b3f90 0x7fe5900b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59942/0 (socket says 172.21.15.38:59942) 2023-12-22T08:47:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.016+0000 7fe594ae2640 1 -- 172.21.15.38:0/3994351509 learned_addr learned my addr 172.21.15.38:0/3994351509 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.016+0000 7fe595ae4640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe59015e740 0x7fe5901527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.016+0000 7fe5952e3640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59006ca50 0x7fe5900aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.016+0000 7fe594ae2640 1 -- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe59015e740 msgr2=0x7fe5901527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.016+0000 7fe594ae2640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe59015e740 0x7fe5901527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.016+0000 7fe594ae2640 1 -- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59006ca50 msgr2=0x7fe5900aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.016+0000 7fe594ae2640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59006ca50 0x7fe5900aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.016+0000 7fe594ae2640 1 -- 172.21.15.38:0/3994351509 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe588009a70 con 0x7fe5900b3f90 2023-12-22T08:47:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.017+0000 7fe594ae2640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5900b3f90 0x7fe5900b80d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fe58000d800 tx=0x7fe58000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.017+0000 7fe585ffb640 1 -- 172.21.15.38:0/3994351509 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58000b6c0 con 0x7fe5900b3f90 2023-12-22T08:47:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.017+0000 7fe585ffb640 1 -- 172.21.15.38:0/3994351509 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58000b820 con 0x7fe5900b3f90 2023-12-22T08:47:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.017+0000 7fe585ffb640 1 -- 172.21.15.38:0/3994351509 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58000bbb0 con 0x7fe5900b3f90 2023-12-22T08:47:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.017+0000 7fe597547640 1 -- 172.21.15.38:0/3994351509 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5900ae3f0 con 0x7fe5900b3f90 2023-12-22T08:47:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.017+0000 7fe597547640 1 -- 172.21.15.38:0/3994351509 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5900b8610 con 0x7fe5900b3f90 2023-12-22T08:47:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.018+0000 7fe597547640 1 -- 172.21.15.38:0/3994351509 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5900b87d0 con 0x7fe5900b3f90 2023-12-22T08:47:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.019+0000 7fe585ffb640 1 -- 172.21.15.38:0/3994351509 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe58000bd10 con 0x7fe5900b3f90 2023-12-22T08:47:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.021+0000 7fe585ffb640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe57406a480 0x7fe57406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.021+0000 7fe585ffb640 1 -- 172.21.15.38:0/3994351509 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe580088ab0 con 0x7fe5900b3f90 2023-12-22T08:47:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.022+0000 7fe5952e3640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe57406a480 0x7fe57406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.023+0000 7fe5952e3640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe57406a480 0x7fe57406c940 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0011e0 tx=0x7fe58c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:41.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.025+0000 7fe585ffb640 1 -- 172.21.15.38:0/3994351509 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe580054410 con 0x7fe5900b3f90 2023-12-22T08:47:41.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.221+0000 7fe597547640 1 -- 172.21.15.38:0/3994351509 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe590061910 con 0x7fe5900b3f90 2023-12-22T08:47:41.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.223+0000 7fe585ffb640 1 -- 172.21.15.38:0/3994351509 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+12481 (secure 0 0 0) 0x7fe580057a30 con 0x7fe5900b3f90 2023-12-22T08:47:41.225 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:41.225 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":133,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:38.716673+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6835/3340763944":"2023-12-23T08:47:35.691844+0000","172.21.15.38:6833/3340763944":"2023-12-23T08:47:35.691844+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:41.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.227+0000 7fe597547640 1 -- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe57406a480 msgr2=0x7fe57406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.227+0000 7fe597547640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe57406a480 0x7fe57406c940 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0011e0 tx=0x7fe58c009040 comp rx=0 tx=0).stop 2023-12-22T08:47:41.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.227+0000 7fe597547640 1 -- 172.21.15.38:0/3994351509 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5900b3f90 msgr2=0x7fe5900b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.227+0000 7fe597547640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5900b3f90 0x7fe5900b80d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fe58000d800 tx=0x7fe58000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.227+0000 7fe597547640 1 -- 172.21.15.38:0/3994351509 shutdown_connections 2023-12-22T08:47:41.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.227+0000 7fe597547640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe59015e740 0x7fe5901527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.227+0000 7fe597547640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe57406a480 0x7fe57406c940 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.227+0000 7fe597547640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5900b3f90 0x7fe5900b80d0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.227+0000 7fe597547640 1 --2- 172.21.15.38:0/3994351509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59006ca50 0x7fe5900aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.227+0000 7fe597547640 1 -- 172.21.15.38:0/3994351509 >> 172.21.15.38:0/3994351509 conn(0x7fe5900cfea0 msgr2=0x7fe59015d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:41.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.227+0000 7fe597547640 1 -- 172.21.15.38:0/3994351509 shutdown_connections 2023-12-22T08:47:41.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.227+0000 7fe597547640 1 -- 172.21.15.38:0/3994351509 wait complete. 2023-12-22T08:47:41.248 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:47:41.248 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:47:41.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.473+0000 7f91df6e2640 1 Processor -- start 2023-12-22T08:47:41.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.473+0000 7f91df6e2640 1 -- start start 2023-12-22T08:47:41.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.475+0000 7f91df6e2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f91d815cf10 0x7f91d80b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.475+0000 7f91df6e2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91d815d2f0 0x7f91d806fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.475+0000 7f91df6e2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d80ccee0 con 0x7f91d80ce990 2023-12-22T08:47:41.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.475+0000 7f91df6e2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d815e130 con 0x7f91d815cf10 2023-12-22T08:47:41.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.475+0000 7f91df6e2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d815e650 con 0x7f91d815d2f0 2023-12-22T08:47:41.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.476+0000 7f91dcc7d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91d815d2f0 0x7f91d806fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.476+0000 7f91dcc7d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91d815d2f0 0x7f91d806fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:48300/0 (socket says 172.21.15.38:48300) 2023-12-22T08:47:41.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.476+0000 7f91dcc7d640 1 -- 172.21.15.38:0/2727051271 learned_addr learned my addr 172.21.15.38:0/2727051271 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:41.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.476+0000 7f91dd47e640 1 --2- 172.21.15.38:0/2727051271 >> v2:172.21.15.89:3300/0 conn(0x7f91d815cf10 0x7f91d80b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.476+0000 7f91dcc7d640 1 -- 172.21.15.38:0/2727051271 >> v2:172.21.15.89:3300/0 conn(0x7f91d815cf10 msgr2=0x7f91d80b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:41.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.476+0000 7f91dcc7d640 1 --2- 172.21.15.38:0/2727051271 >> v2:172.21.15.89:3300/0 conn(0x7f91d815cf10 0x7f91d80b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.476+0000 7f91dcc7d640 1 -- 172.21.15.38:0/2727051271 >> v1:172.21.15.89:6789/0 conn(0x7f91d80ce990 legacy=0x7f91d80b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.476+0000 7f91dcc7d640 1 -- 172.21.15.38:0/2727051271 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d815e320 con 0x7f91d815d2f0 2023-12-22T08:47:41.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.476+0000 7f91cffff640 1 -- 172.21.15.38:0/2727051271 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218572112 0 0) 0x7f91d80ccee0 con 0x7f91d80ce990 2023-12-22T08:47:41.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.478+0000 7f91dcc7d640 1 --2- 172.21.15.38:0/2727051271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91d815d2f0 0x7f91d806fae0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009870 tx=0x7f91c802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0793d768d83308e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.479+0000 7f91cffff640 1 -- 172.21.15.38:0/2727051271 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c80317c0 con 0x7f91d815d2f0 2023-12-22T08:47:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.479+0000 7f91cffff640 1 -- 172.21.15.38:0/2727051271 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c8031920 con 0x7f91d815d2f0 2023-12-22T08:47:41.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.479+0000 7f91cffff640 1 -- 172.21.15.38:0/2727051271 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8031cb0 con 0x7f91d815d2f0 2023-12-22T08:47:41.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.479+0000 7f91df6e2640 1 -- 172.21.15.38:0/2727051271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91d815d2f0 msgr2=0x7f91d806fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.479+0000 7f91df6e2640 1 --2- 172.21.15.38:0/2727051271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91d815d2f0 0x7f91d806fae0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009870 tx=0x7f91c802b860 comp rx=0 tx=0).stop 2023-12-22T08:47:41.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.479+0000 7f91df6e2640 1 -- 172.21.15.38:0/2727051271 shutdown_connections 2023-12-22T08:47:41.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.479+0000 7f91df6e2640 1 --2- 172.21.15.38:0/2727051271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91d815d2f0 0x7f91d806fae0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.479+0000 7f91df6e2640 1 --2- 172.21.15.38:0/2727051271 >> v2:172.21.15.89:3300/0 conn(0x7f91d815cf10 0x7f91d80b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.479+0000 7f91df6e2640 1 -- 172.21.15.38:0/2727051271 >> 172.21.15.38:0/2727051271 conn(0x7f91d80b20c0 msgr2=0x7f91d80b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:41.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.480+0000 7f91df6e2640 1 -- 172.21.15.38:0/2727051271 shutdown_connections 2023-12-22T08:47:41.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.480+0000 7f91df6e2640 1 -- 172.21.15.38:0/2727051271 wait complete. 2023-12-22T08:47:41.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.481+0000 7f91df6e2640 1 Processor -- start 2023-12-22T08:47:41.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.482+0000 7f91df6e2640 1 -- start start 2023-12-22T08:47:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.482+0000 7f91df6e2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91d80ce990 0x7f91d81f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91df6e2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91d815cf10 0x7f91d8155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91df6e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91d815d2f0 0x7f91d81559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91df6e2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d81f64a0 con 0x7f91d80ce990 2023-12-22T08:47:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91df6e2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d81f42f0 con 0x7f91d815d2f0 2023-12-22T08:47:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91df6e2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d81f3250 con 0x7f91d815cf10 2023-12-22T08:47:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91dd47e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91d80ce990 0x7f91d81f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91dd47e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91d80ce990 0x7f91d81f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59954/0 (socket says 172.21.15.38:59954) 2023-12-22T08:47:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91dd47e640 1 -- 172.21.15.38:0/4149475372 learned_addr learned my addr 172.21.15.38:0/4149475372 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91ddc7f640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91d815d2f0 0x7f91d81559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91dcc7d640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91d815cf10 0x7f91d8155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91dd47e640 1 -- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91d815cf10 msgr2=0x7f91d8155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91dd47e640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91d815cf10 0x7f91d8155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91dd47e640 1 -- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91d815d2f0 msgr2=0x7f91d81559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91dd47e640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91d815d2f0 0x7f91d81559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.483+0000 7f91dd47e640 1 -- 172.21.15.38:0/4149475372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c80094d0 con 0x7f91d80ce990 2023-12-22T08:47:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.484+0000 7f91dd47e640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91d80ce990 0x7f91d81f5f60 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f91d400e9b0 tx=0x7f91d400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.484+0000 7f91cdffb640 1 -- 172.21.15.38:0/4149475372 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4009670 con 0x7f91d80ce990 2023-12-22T08:47:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.484+0000 7f91cdffb640 1 -- 172.21.15.38:0/4149475372 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d400c9a0 con 0x7f91d80ce990 2023-12-22T08:47:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.484+0000 7f91df6e2640 1 -- 172.21.15.38:0/4149475372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d81f3530 con 0x7f91d80ce990 2023-12-22T08:47:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.484+0000 7f91cdffb640 1 -- 172.21.15.38:0/4149475372 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d400cd50 con 0x7f91d80ce990 2023-12-22T08:47:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.484+0000 7f91df6e2640 1 -- 172.21.15.38:0/4149475372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d81f3af0 con 0x7f91d80ce990 2023-12-22T08:47:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.486+0000 7f91df6e2640 1 -- 172.21.15.38:0/4149475372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d8061910 con 0x7f91d80ce990 2023-12-22T08:47:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.487+0000 7f91cdffb640 1 -- 172.21.15.38:0/4149475372 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f91d4013470 con 0x7f91d80ce990 2023-12-22T08:47:41.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.487+0000 7f91cdffb640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91bc06a430 0x7f91bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.488+0000 7f91cdffb640 1 -- 172.21.15.38:0/4149475372 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f91d4088970 con 0x7f91d80ce990 2023-12-22T08:47:41.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.488+0000 7f91dcc7d640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91bc06a430 0x7f91bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.489+0000 7f91dcc7d640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91bc06a430 0x7f91bc06c8f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f91c8036000 tx=0x7f91c803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:41.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.493+0000 7f91cdffb640 1 -- 172.21.15.38:0/4149475372 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f91d40541d0 con 0x7f91d80ce990 2023-12-22T08:47:41.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.684+0000 7f91df6e2640 1 -- 172.21.15.38:0/4149475372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91d80b2fd0 con 0x7f91d80ce990 2023-12-22T08:47:41.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.686+0000 7f91cdffb640 1 -- 172.21.15.38:0/4149475372 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v133) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91d40210a0 con 0x7f91d80ce990 2023-12-22T08:47:41.687 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:47:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.688+0000 7f91df6e2640 1 -- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91bc06a430 msgr2=0x7f91bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.688+0000 7f91df6e2640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91bc06a430 0x7f91bc06c8f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f91c8036000 tx=0x7f91c803d040 comp rx=0 tx=0).stop 2023-12-22T08:47:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.688+0000 7f91df6e2640 1 -- 172.21.15.38:0/4149475372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91d80ce990 msgr2=0x7f91d81f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.688+0000 7f91df6e2640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91d80ce990 0x7f91d81f5f60 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f91d400e9b0 tx=0x7f91d400ee70 comp rx=0 tx=0).stop 2023-12-22T08:47:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.688+0000 7f91df6e2640 1 -- 172.21.15.38:0/4149475372 shutdown_connections 2023-12-22T08:47:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.688+0000 7f91df6e2640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91d815d2f0 0x7f91d81559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.688+0000 7f91df6e2640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91d815cf10 0x7f91d8155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.688+0000 7f91df6e2640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f91bc06a430 0x7f91bc06c8f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.688+0000 7f91df6e2640 1 --2- 172.21.15.38:0/4149475372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91d80ce990 0x7f91d81f5f60 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.688+0000 7f91df6e2640 1 -- 172.21.15.38:0/4149475372 >> 172.21.15.38:0/4149475372 conn(0x7f91d80b20c0 msgr2=0x7f91d8071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:41.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.689+0000 7f91df6e2640 1 -- 172.21.15.38:0/4149475372 shutdown_connections 2023-12-22T08:47:41.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.689+0000 7f91df6e2640 1 -- 172.21.15.38:0/4149475372 wait complete. 2023-12-22T08:47:41.711 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-12-22T08:47:41.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.935+0000 7efd9c727640 1 Processor -- start 2023-12-22T08:47:41.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.936+0000 7efd9c727640 1 -- start start 2023-12-22T08:47:41.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.937+0000 7efd9c727640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd941547a0 0x7efd9415b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.937+0000 7efd9c727640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd94154b80 0x7efd940ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.937+0000 7efd9c727640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd940716a0 con 0x7efd94071b90 2023-12-22T08:47:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.937+0000 7efd9c727640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd94070e80 con 0x7efd941547a0 2023-12-22T08:47:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.937+0000 7efd9c727640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd940710e0 con 0x7efd94154b80 2023-12-22T08:47:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.938+0000 7efd9a4c3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd941547a0 0x7efd9415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.938+0000 7efd9a4c3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd941547a0 0x7efd9415b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59968/0 (socket says 172.21.15.38:59968) 2023-12-22T08:47:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.938+0000 7efd9a4c3640 1 -- 172.21.15.38:0/1908704512 learned_addr learned my addr 172.21.15.38:0/1908704512 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.938+0000 7efd9acc4640 1 --2- 172.21.15.38:0/1908704512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd94154b80 0x7efd940ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.938+0000 7efd9a4c3640 1 -- 172.21.15.38:0/1908704512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd94154b80 msgr2=0x7efd940ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.938+0000 7efd9a4c3640 1 --2- 172.21.15.38:0/1908704512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd94154b80 0x7efd940ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.938+0000 7efd9a4c3640 1 -- 172.21.15.38:0/1908704512 >> v1:172.21.15.89:6789/0 conn(0x7efd94071b90 legacy=0x7efd94070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:41.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.938+0000 7efd9a4c3640 1 -- 172.21.15.38:0/1908704512 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd940713c0 con 0x7efd941547a0 2023-12-22T08:47:41.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.938+0000 7efd9acc4640 1 --2- 172.21.15.38:0/1908704512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd94154b80 0x7efd940ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.939+0000 7efd9a4c3640 1 --2- 172.21.15.38:0/1908704512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd941547a0 0x7efd9415b300 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7efd90009870 tx=0x7efd9002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1001498149ae4b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.940+0000 7efd994c1640 1 -- 172.21.15.38:0/1908704512 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90031640 con 0x7efd941547a0 2023-12-22T08:47:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.940+0000 7efd994c1640 1 -- 172.21.15.38:0/1908704512 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd900317a0 con 0x7efd941547a0 2023-12-22T08:47:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.940+0000 7efd994c1640 1 -- 172.21.15.38:0/1908704512 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90031b30 con 0x7efd941547a0 2023-12-22T08:47:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.940+0000 7efd9c727640 1 -- 172.21.15.38:0/1908704512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd941547a0 msgr2=0x7efd9415b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.940+0000 7efd9c727640 1 --2- 172.21.15.38:0/1908704512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd941547a0 0x7efd9415b300 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7efd90009870 tx=0x7efd9002b8f0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.941+0000 7efd9c727640 1 -- 172.21.15.38:0/1908704512 shutdown_connections 2023-12-22T08:47:41.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.941+0000 7efd9c727640 1 --2- 172.21.15.38:0/1908704512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd94154b80 0x7efd940ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.941+0000 7efd9c727640 1 --2- 172.21.15.38:0/1908704512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd941547a0 0x7efd9415b300 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.941+0000 7efd9c727640 1 -- 172.21.15.38:0/1908704512 >> 172.21.15.38:0/1908704512 conn(0x7efd940cf070 msgr2=0x7efd940cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:41.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.941+0000 7efd9c727640 1 -- 172.21.15.38:0/1908704512 shutdown_connections 2023-12-22T08:47:41.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.941+0000 7efd9c727640 1 -- 172.21.15.38:0/1908704512 wait complete. 2023-12-22T08:47:41.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.943+0000 7efd9c727640 1 Processor -- start 2023-12-22T08:47:41.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.943+0000 7efd9c727640 1 -- start start 2023-12-22T08:47:41.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.944+0000 7efd9c727640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd94071b90 0x7efd94151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.944+0000 7efd9c727640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd941547a0 0x7efd9414b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.944+0000 7efd9c727640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd94154b80 0x7efd9414c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.944+0000 7efd9c727640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9414b7d0 con 0x7efd94071b90 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.944+0000 7efd9c727640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd94137860 con 0x7efd941547a0 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.944+0000 7efd9c727640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd94137b40 con 0x7efd94154b80 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.945+0000 7efd9a4c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd94071b90 0x7efd94151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.945+0000 7efd9a4c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd94071b90 0x7efd94151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59984/0 (socket says 172.21.15.38:59984) 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.945+0000 7efd9a4c3640 1 -- 172.21.15.38:0/3217054424 learned_addr learned my addr 172.21.15.38:0/3217054424 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.945+0000 7efd9acc4640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd94154b80 0x7efd9414c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.945+0000 7efd99cc2640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd941547a0 0x7efd9414b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.945+0000 7efd9a4c3640 1 -- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd94154b80 msgr2=0x7efd9414c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.945+0000 7efd9a4c3640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd94154b80 0x7efd9414c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.945+0000 7efd9a4c3640 1 -- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd941547a0 msgr2=0x7efd9414b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.945+0000 7efd9a4c3640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd941547a0 0x7efd9414b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.945+0000 7efd9a4c3640 1 -- 172.21.15.38:0/3217054424 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd900094d0 con 0x7efd94071b90 2023-12-22T08:47:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.946+0000 7efd9a4c3640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd94071b90 0x7efd94151600 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7efd90009870 tx=0x7efd900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.946+0000 7efd8affd640 1 -- 172.21.15.38:0/3217054424 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9003ac60 con 0x7efd94071b90 2023-12-22T08:47:41.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.946+0000 7efd8affd640 1 -- 172.21.15.38:0/3217054424 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9003ade0 con 0x7efd94071b90 2023-12-22T08:47:41.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.946+0000 7efd8affd640 1 -- 172.21.15.38:0/3217054424 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90044630 con 0x7efd94071b90 2023-12-22T08:47:41.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.946+0000 7efd9c727640 1 -- 172.21.15.38:0/3217054424 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd94137e20 con 0x7efd94071b90 2023-12-22T08:47:41.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.946+0000 7efd9c727640 1 -- 172.21.15.38:0/3217054424 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9414bb80 con 0x7efd94071b90 2023-12-22T08:47:41.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.947+0000 7efd9c727640 1 -- 172.21.15.38:0/3217054424 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd94138340 con 0x7efd94071b90 2023-12-22T08:47:41.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.948+0000 7efd8affd640 1 -- 172.21.15.38:0/3217054424 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd9002f050 con 0x7efd94071b90 2023-12-22T08:47:41.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.949+0000 7efd8affd640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd7806a430 0x7efd7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:41.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.949+0000 7efd8affd640 1 -- 172.21.15.38:0/3217054424 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd900aa7e0 con 0x7efd94071b90 2023-12-22T08:47:41.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.950+0000 7efd99cc2640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd7806a430 0x7efd7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:41.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.951+0000 7efd99cc2640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd7806a430 0x7efd7806c8f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7efd940b4a90 tx=0x7efd84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:41.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:41.954+0000 7efd8affd640 1 -- 172.21.15.38:0/3217054424 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd900760d0 con 0x7efd94071b90 2023-12-22T08:47:42.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.216+0000 7efd9c727640 1 -- 172.21.15.38:0/3217054424 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7efd94061910 con 0x7efd94071b90 2023-12-22T08:47:42.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.755+0000 7efd8affd640 1 -- 172.21.15.38:0/3217054424 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v401) v1 ==== 143+0+0 (secure 0 0 0) 0x7efd900796f0 con 0x7efd94071b90 2023-12-22T08:47:42.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.760+0000 7efd9c727640 1 -- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd7806a430 msgr2=0x7efd7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:42.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.760+0000 7efd9c727640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd7806a430 0x7efd7806c8f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7efd940b4a90 tx=0x7efd84009040 comp rx=0 tx=0).stop 2023-12-22T08:47:42.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.760+0000 7efd9c727640 1 -- 172.21.15.38:0/3217054424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd94071b90 msgr2=0x7efd94151600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:42.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.760+0000 7efd9c727640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd94071b90 0x7efd94151600 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7efd90009870 tx=0x7efd900046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:42.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.760+0000 7efd9c727640 1 -- 172.21.15.38:0/3217054424 shutdown_connections 2023-12-22T08:47:42.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.760+0000 7efd9c727640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd94154b80 0x7efd9414c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:42.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.760+0000 7efd9c727640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd941547a0 0x7efd9414b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:42.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.760+0000 7efd9c727640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd7806a430 0x7efd7806c8f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:42.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.760+0000 7efd9c727640 1 --2- 172.21.15.38:0/3217054424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd94071b90 0x7efd94151600 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:42.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.760+0000 7efd9c727640 1 -- 172.21.15.38:0/3217054424 >> 172.21.15.38:0/3217054424 conn(0x7efd940cf070 msgr2=0x7efd94150350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:42.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.760+0000 7efd9c727640 1 -- 172.21.15.38:0/3217054424 shutdown_connections 2023-12-22T08:47:42.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:42.760+0000 7efd9c727640 1 -- 172.21.15.38:0/3217054424 wait complete. 2023-12-22T08:47:42.787 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T08:47:43.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.014+0000 7f9889e84640 1 Processor -- start 2023-12-22T08:47:43.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.015+0000 7f9889e84640 1 -- start start 2023-12-22T08:47:43.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.016+0000 7f9889e84640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98840cea50 0x7f98840ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:43.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.017+0000 7f9889e84640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9884140f70 con 0x7f988406d590 2023-12-22T08:47:43.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.017+0000 7f9889e84640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988406c300 con 0x7f9884143600 2023-12-22T08:47:43.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.017+0000 7f9889e84640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98840cf410 con 0x7f98840cea50 2023-12-22T08:47:43.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.017+0000 7f9883fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f988406d590 0x7f988406da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56280/0 (socket says 172.21.15.38:56280) 2023-12-22T08:47:43.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.017+0000 7f9883fff640 1 -- 172.21.15.38:0/1356506749 learned_addr learned my addr 172.21.15.38:0/1356506749 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:43.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.017+0000 7f987bfff640 1 --2- 172.21.15.38:0/1356506749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98840cea50 0x7f98840ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:43.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.017+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086898796 0 0) 0x7f9884140f70 con 0x7f988406d590 2023-12-22T08:47:43.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.017+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9870003520 con 0x7f988406d590 2023-12-22T08:47:43.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.018+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3693332359 0 0) 0x7f9870003520 con 0x7f988406d590 2023-12-22T08:47:43.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.018+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98840cea50 msgr2=0x7f98840ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:43.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.018+0000 7f9882ffd640 1 --2- 172.21.15.38:0/1356506749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98840cea50 0x7f98840ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.018+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 >> v1:172.21.15.89:6789/0 conn(0x7f9884143600 legacy=0x7f988415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.018+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988406c5e0 con 0x7f988406d590 2023-12-22T08:47:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.018+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f987c0019f0 con 0x7f988406d590 2023-12-22T08:47:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.018+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 >> v1:172.21.15.38:6789/0 conn(0x7f988406d590 legacy=0x7f988406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.018+0000 7f9882ffd640 1 --2- 172.21.15.38:0/1356506749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98700039a0 0x7f9870003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.018+0000 7f9882ffd640 1 --2- 172.21.15.38:0/1356506749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98700047c0 0x7f9870004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.018+0000 7f9882ffd640 1 --2- 172.21.15.38:0/1356506749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98840cea50 0x7f9870005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.018+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98840cf410 con 0x7f98700039a0 2023-12-22T08:47:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.018+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987000ba30 con 0x7f98700047c0 2023-12-22T08:47:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.018+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987000bbf0 con 0x7f98840cea50 2023-12-22T08:47:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.019+0000 7f98837fe640 1 --2- 172.21.15.38:0/1356506749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98700039a0 0x7f9870003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.019+0000 7f987bfff640 1 --2- 172.21.15.38:0/1356506749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98700047c0 0x7f9870004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:43.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.019+0000 7f98837fe640 1 -- 172.21.15.38:0/1356506749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98840cea50 msgr2=0x7f9870005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:43.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.019+0000 7f98837fe640 1 --2- 172.21.15.38:0/1356506749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98840cea50 0x7f9870005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:43.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.019+0000 7f98837fe640 1 -- 172.21.15.38:0/1356506749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98700047c0 msgr2=0x7f9870004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:43.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.019+0000 7f98837fe640 1 --2- 172.21.15.38:0/1356506749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98700047c0 0x7f9870004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:43.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.019+0000 7f98837fe640 1 -- 172.21.15.38:0/1356506749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9870003520 con 0x7f98700039a0 2023-12-22T08:47:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.020+0000 7f98837fe640 1 --2- 172.21.15.38:0/1356506749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98700039a0 0x7f9870003dc0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f9874001720 tx=0x7f98700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc34b89f21ba6ef9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.021+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740052d0 con 0x7f98700039a0 2023-12-22T08:47:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.021+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987402e050 con 0x7f98700039a0 2023-12-22T08:47:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.021+0000 7f9882ffd640 1 -- 172.21.15.38:0/1356506749 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740035f0 con 0x7f98700039a0 2023-12-22T08:47:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.021+0000 7f9889e84640 1 -- 172.21.15.38:0/1356506749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98700039a0 msgr2=0x7f9870003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.021+0000 7f9889e84640 1 --2- 172.21.15.38:0/1356506749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98700039a0 0x7f9870003dc0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f9874001720 tx=0x7f98700057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.021+0000 7f9883fff640 1 -- 172.21.15.38:0/1356506749 reap_dead start 2023-12-22T08:47:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.021+0000 7f9889e84640 1 -- 172.21.15.38:0/1356506749 shutdown_connections 2023-12-22T08:47:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.021+0000 7f9889e84640 1 -- 172.21.15.38:0/1356506749 >> 172.21.15.38:0/1356506749 conn(0x7f98840cfe70 msgr2=0x7f98840d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:43.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.021+0000 7f9889e84640 1 -- 172.21.15.38:0/1356506749 shutdown_connections 2023-12-22T08:47:43.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.022+0000 7f9889e84640 1 -- 172.21.15.38:0/1356506749 wait complete. 2023-12-22T08:47:43.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.023+0000 7f9889e84640 1 Processor -- start 2023-12-22T08:47:43.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.024+0000 7f9889e84640 1 -- start start 2023-12-22T08:47:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.024+0000 7f9889e84640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98700039a0 0x7f98840b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f9889e84640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98840d1f80 0x7f98840d23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f9889e84640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98841f6340 0x7f98841f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f9889e84640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988413d650 con 0x7f98840d1f80 2023-12-22T08:47:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f9889e84640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98840d2920 con 0x7f98700039a0 2023-12-22T08:47:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f9889e84640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98840b0330 con 0x7f98841f6340 2023-12-22T08:47:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f987bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98840d1f80 0x7f98840d23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f987bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98840d1f80 0x7f98840d23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59992/0 (socket says 172.21.15.38:59992) 2023-12-22T08:47:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f987bfff640 1 -- 172.21.15.38:0/2726700271 learned_addr learned my addr 172.21.15.38:0/2726700271 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f98837fe640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98700039a0 0x7f98840b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:43.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f987bfff640 1 -- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98841f6340 msgr2=0x7f98841f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:43.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f9883fff640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98841f6340 0x7f98841f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:43.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f987bfff640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98841f6340 0x7f98841f67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:43.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f987bfff640 1 -- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98700039a0 msgr2=0x7f98840b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:43.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f987bfff640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98700039a0 0x7f98840b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:43.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.025+0000 7f987bfff640 1 -- 172.21.15.38:0/2726700271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98841f6fe0 con 0x7f98840d1f80 2023-12-22T08:47:43.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.026+0000 7f987bfff640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98840d1f80 0x7f98840d23e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f986c011630 tx=0x7f986c011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:43.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.026+0000 7f9880ff9640 1 -- 172.21.15.38:0/2726700271 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00f920 con 0x7f98840d1f80 2023-12-22T08:47:43.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.026+0000 7f9880ff9640 1 -- 172.21.15.38:0/2726700271 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c00fa80 con 0x7f98840d1f80 2023-12-22T08:47:43.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.026+0000 7f9880ff9640 1 -- 172.21.15.38:0/2726700271 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00fdf0 con 0x7f98840d1f80 2023-12-22T08:47:43.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.026+0000 7f9889e84640 1 -- 172.21.15.38:0/2726700271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98840b05f0 con 0x7f98840d1f80 2023-12-22T08:47:43.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.026+0000 7f9889e84640 1 -- 172.21.15.38:0/2726700271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98841f6d00 con 0x7f98840d1f80 2023-12-22T08:47:43.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.027+0000 7f9889e84640 1 -- 172.21.15.38:0/2726700271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9884061910 con 0x7f98840d1f80 2023-12-22T08:47:43.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.028+0000 7f9880ff9640 1 -- 172.21.15.38:0/2726700271 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f986c015460 con 0x7f98840d1f80 2023-12-22T08:47:43.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.029+0000 7f9880ff9640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f986406a460 0x7f986406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:43.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.029+0000 7f9880ff9640 1 -- 172.21.15.38:0/2726700271 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f986c088a40 con 0x7f98840d1f80 2023-12-22T08:47:43.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.030+0000 7f98837fe640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f986406a460 0x7f986406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:43.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.031+0000 7f98837fe640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f986406a460 0x7f986406c920 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9874033000 tx=0x7f9874009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:43.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.033+0000 7f9880ff9640 1 -- 172.21.15.38:0/2726700271 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f986c054290 con 0x7f98840d1f80 2023-12-22T08:47:43.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.233+0000 7f9889e84640 1 -- 172.21.15.38:0/2726700271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9884142650 con 0x7f98840d1f80 2023-12-22T08:47:43.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.245+0000 7f9880ff9640 1 -- 172.21.15.38:0/2726700271 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f986c0220c0 con 0x7f98840d1f80 2023-12-22T08:47:43.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.248+0000 7f9889e84640 1 -- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f986406a460 msgr2=0x7f986406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:43.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.248+0000 7f9889e84640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f986406a460 0x7f986406c920 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9874033000 tx=0x7f9874009030 comp rx=0 tx=0).stop 2023-12-22T08:47:43.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.248+0000 7f9889e84640 1 -- 172.21.15.38:0/2726700271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98840d1f80 msgr2=0x7f98840d23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:43.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.248+0000 7f9889e84640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98840d1f80 0x7f98840d23e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f986c011630 tx=0x7f986c011af0 comp rx=0 tx=0).stop 2023-12-22T08:47:43.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.248+0000 7f9889e84640 1 -- 172.21.15.38:0/2726700271 shutdown_connections 2023-12-22T08:47:43.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.248+0000 7f9889e84640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98841f6340 0x7f98841f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:43.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.248+0000 7f9889e84640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f986406a460 0x7f986406c920 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:43.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.248+0000 7f9889e84640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98840d1f80 0x7f98840d23e0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:43.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.248+0000 7f9889e84640 1 --2- 172.21.15.38:0/2726700271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98700039a0 0x7f98840b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:43.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.248+0000 7f9889e84640 1 -- 172.21.15.38:0/2726700271 >> 172.21.15.38:0/2726700271 conn(0x7f98840cfe70 msgr2=0x7f98840cda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:43.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.249+0000 7f9889e84640 1 -- 172.21.15.38:0/2726700271 shutdown_connections 2023-12-22T08:47:43.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.249+0000 7f9889e84640 1 -- 172.21.15.38:0/2726700271 wait complete. 2023-12-22T08:47:43.270 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:47:43.270 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:47:43.400 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:47:43.516 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:47:43.516 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:47:43.516 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:43.580 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:47:43.581 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:47:43.581 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:43.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:47:43.641 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:47:43.641 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:43.704 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:47:43.704 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:47:43.704 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:43.763 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:47:43.764 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-22T08:47:43.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:47:44.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:43.999+0000 7f6715ad6640 1 Processor -- start 2023-12-22T08:47:44.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.000+0000 7f6715ad6640 1 -- start start 2023-12-22T08:47:44.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.001+0000 7f6715ad6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f67100a44a0 0x7f67100708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.001+0000 7f6715ad6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6710070e30 0x7f671015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.002+0000 7f6715ad6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67100cdae0 con 0x7f671015b420 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.002+0000 7f6715ad6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6710071250 con 0x7f67100a44a0 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.002+0000 7f6715ad6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671015b800 con 0x7f6710070e30 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.002+0000 7f670ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f67100a44a0 0x7f67100708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.002+0000 7f6714ad4640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f671015b420 0x7f671006d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56290/0 (socket says 172.21.15.38:56290) 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.002+0000 7f670ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f67100a44a0 0x7f67100708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59998/0 (socket says 172.21.15.38:59998) 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.002+0000 7f6714ad4640 1 -- 172.21.15.38:0/225666257 learned_addr learned my addr 172.21.15.38:0/225666257 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.002+0000 7f67152d5640 1 --2- 172.21.15.38:0/225666257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6710070e30 0x7f671015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.002+0000 7f670ffff640 1 -- 172.21.15.38:0/225666257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6710070e30 msgr2=0x7f671015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.002+0000 7f670ffff640 1 --2- 172.21.15.38:0/225666257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6710070e30 0x7f671015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.003+0000 7f670ffff640 1 -- 172.21.15.38:0/225666257 >> v1:172.21.15.38:6789/0 conn(0x7f671015b420 legacy=0x7f671006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.003+0000 7f670ffff640 1 -- 172.21.15.38:0/225666257 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67100cdd30 con 0x7f67100a44a0 2023-12-22T08:47:44.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.003+0000 7f670f7fe640 1 -- 172.21.15.38:0/225666257 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060764014 0 0) 0x7f67100cdae0 con 0x7f671015b420 2023-12-22T08:47:44.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.004+0000 7f670ffff640 1 --2- 172.21.15.38:0/225666257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67100a44a0 0x7f67100708f0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0097a0 tx=0x7f66fc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb264a89314066e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:44.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.004+0000 7f670f7fe640 1 -- 172.21.15.38:0/225666257 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc031830 con 0x7f67100a44a0 2023-12-22T08:47:44.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.004+0000 7f670f7fe640 1 -- 172.21.15.38:0/225666257 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66fc031990 con 0x7f67100a44a0 2023-12-22T08:47:44.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.004+0000 7f670f7fe640 1 -- 172.21.15.38:0/225666257 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc031d20 con 0x7f67100a44a0 2023-12-22T08:47:44.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.005+0000 7f6715ad6640 1 -- 172.21.15.38:0/225666257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67100a44a0 msgr2=0x7f67100708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:44.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.005+0000 7f6715ad6640 1 --2- 172.21.15.38:0/225666257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67100a44a0 0x7f67100708f0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0097a0 tx=0x7f66fc02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.005+0000 7f6715ad6640 1 -- 172.21.15.38:0/225666257 shutdown_connections 2023-12-22T08:47:44.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.005+0000 7f6715ad6640 1 --2- 172.21.15.38:0/225666257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6710070e30 0x7f671015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.005+0000 7f6715ad6640 1 --2- 172.21.15.38:0/225666257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f67100a44a0 0x7f67100708f0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.005+0000 7f6715ad6640 1 -- 172.21.15.38:0/225666257 >> 172.21.15.38:0/225666257 conn(0x7f67100b1f70 msgr2=0x7f67100b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:44.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.005+0000 7f6715ad6640 1 -- 172.21.15.38:0/225666257 shutdown_connections 2023-12-22T08:47:44.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.005+0000 7f6715ad6640 1 -- 172.21.15.38:0/225666257 wait complete. 2023-12-22T08:47:44.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.007+0000 7f6715ad6640 1 Processor -- start 2023-12-22T08:47:44.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.007+0000 7f6715ad6640 1 -- start start 2023-12-22T08:47:44.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.008+0000 7f6715ad6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6710070e30 0x7f671009ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:44.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.008+0000 7f6715ad6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67100a44a0 0x7f67100ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:44.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.008+0000 7f6715ad6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671015b420 0x7f67101599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:44.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.008+0000 7f6715ad6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671009b7c0 con 0x7f671015b420 2023-12-22T08:47:44.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.008+0000 7f6715ad6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671009b4b0 con 0x7f6710070e30 2023-12-22T08:47:44.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.008+0000 7f6715ad6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100caf00 con 0x7f67100a44a0 2023-12-22T08:47:44.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.008+0000 7f67152d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671015b420 0x7f67101599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:44.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.008+0000 7f67152d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671015b420 0x7f67101599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60002/0 (socket says 172.21.15.38:60002) 2023-12-22T08:47:44.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.008+0000 7f67152d5640 1 -- 172.21.15.38:0/3835979953 learned_addr learned my addr 172.21.15.38:0/3835979953 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:44.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.009+0000 7f670ffff640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67100a44a0 0x7f67100ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:44.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.009+0000 7f67152d5640 1 -- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67100a44a0 msgr2=0x7f67100ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:44.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.009+0000 7f6714ad4640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6710070e30 0x7f671009ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:44.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.009+0000 7f67152d5640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67100a44a0 0x7f67100ca9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.009+0000 7f67152d5640 1 -- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6710070e30 msgr2=0x7f671009ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:44.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.009+0000 7f67152d5640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6710070e30 0x7f671009ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.009+0000 7f67152d5640 1 -- 172.21.15.38:0/3835979953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc009400 con 0x7f671015b420 2023-12-22T08:47:44.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.009+0000 7f67152d5640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671015b420 0x7f67101599c0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f6708007e60 tx=0x7f670800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:44.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.009+0000 7f670d7fa640 1 -- 172.21.15.38:0/3835979953 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708014420 con 0x7f671015b420 2023-12-22T08:47:44.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.009+0000 7f670d7fa640 1 -- 172.21.15.38:0/3835979953 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67080145a0 con 0x7f671015b420 2023-12-22T08:47:44.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.009+0000 7f670d7fa640 1 -- 172.21.15.38:0/3835979953 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708014950 con 0x7f671015b420 2023-12-22T08:47:44.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.009+0000 7f6715ad6640 1 -- 172.21.15.38:0/3835979953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6710159f00 con 0x7f671015b420 2023-12-22T08:47:44.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.010+0000 7f6715ad6640 1 -- 172.21.15.38:0/3835979953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671009f5f0 con 0x7f671015b420 2023-12-22T08:47:44.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.011+0000 7f6715ad6640 1 -- 172.21.15.38:0/3835979953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671009b900 con 0x7f671015b420 2023-12-22T08:47:44.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.012+0000 7f670d7fa640 1 -- 172.21.15.38:0/3835979953 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6708014ab0 con 0x7f671015b420 2023-12-22T08:47:44.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.013+0000 7f670d7fa640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f66f406a430 0x7f66f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:44.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.013+0000 7f670d7fa640 1 -- 172.21.15.38:0/3835979953 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6708088e80 con 0x7f671015b420 2023-12-22T08:47:44.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.013+0000 7f6714ad4640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f66f406a430 0x7f66f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:44.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.014+0000 7f6714ad4640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f66f406a430 0x7f66f406c8f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6704007fd0 tx=0x7f6704009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:44.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.017+0000 7f670d7fa640 1 -- 172.21.15.38:0/3835979953 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f671009b900 con 0x7f671015b420 2023-12-22T08:47:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.248+0000 7f6715ad6640 1 -- 172.21.15.38:0/3835979953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f671009b900 con 0x7f671015b420 2023-12-22T08:47:44.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.249+0000 7f670d7fa640 1 -- 172.21.15.38:0/3835979953 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f671009b900 con 0x7f671015b420 2023-12-22T08:47:44.251 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:44.251 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5570,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/186375012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":186375012},{"type":"v1","addr":"172.21.15.89:6837","nonce":186375012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1819583870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1819583870},{"type":"v1","addr":"172.21.15.89:6835","nonce":1819583870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3793773672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3793773672},{"type":"v1","addr":"172.21.15.38:6834","nonce":3793773672}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7635,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/3651508032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3651508032},{"type":"v1","addr":"172.21.15.38:6835","nonce":3651508032}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[]} 2023-12-22T08:47:44.251 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 57 2023-12-22T08:47:44.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.252+0000 7f6715ad6640 1 -- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f66f406a430 msgr2=0x7f66f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.252+0000 7f6715ad6640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f66f406a430 0x7f66f406c8f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6704007fd0 tx=0x7f6704009040 comp rx=0 tx=0).stop 2023-12-22T08:47:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.252+0000 7f6715ad6640 1 -- 172.21.15.38:0/3835979953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671015b420 msgr2=0x7f67101599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.252+0000 7f6715ad6640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671015b420 0x7f67101599c0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f6708007e60 tx=0x7f670800e4b0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.252+0000 7f6715ad6640 1 -- 172.21.15.38:0/3835979953 shutdown_connections 2023-12-22T08:47:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.252+0000 7f6715ad6640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f66f406a430 0x7f66f406c8f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.252+0000 7f6715ad6640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671015b420 0x7f67101599c0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.252+0000 7f6715ad6640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f67100a44a0 0x7f67100ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.252+0000 7f6715ad6640 1 --2- 172.21.15.38:0/3835979953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6710070e30 0x7f671009ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.252+0000 7f6715ad6640 1 -- 172.21.15.38:0/3835979953 >> 172.21.15.38:0/3835979953 conn(0x7f67100b1f70 msgr2=0x7f671015da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:44.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.252+0000 7f6715ad6640 1 -- 172.21.15.38:0/3835979953 shutdown_connections 2023-12-22T08:47:44.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.252+0000 7f6715ad6640 1 -- 172.21.15.38:0/3835979953 wait complete. 2023-12-22T08:47:44.272 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T08:47:44.272 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T08:47:44.272 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T08:47:44.272 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:47:44.273 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T08:47:44.273 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T08:47:44.273 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T08:47:44.273 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:47:44.273 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T08:47:44.273 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T08:47:44.274 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T08:47:44.274 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:47:44.274 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T08:47:44.274 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T08:47:44.274 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T08:47:44.274 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:47:44.295 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T08:47:44.295 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T08:47:44.296 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T08:47:44.297 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T08:47:44.298 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T08:47:44.298 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T08:47:44.302 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T08:47:44.302 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T08:47:44.346 INFO:tasks.ceph.mds.a:Started 2023-12-22T08:47:44.346 DEBUG:teuthology.parallel:result is None 2023-12-22T08:47:44.350 INFO:tasks.ceph.mds.d:Started 2023-12-22T08:47:44.350 DEBUG:teuthology.parallel:result is None 2023-12-22T08:47:44.354 INFO:tasks.ceph.mds.c:Started 2023-12-22T08:47:44.354 DEBUG:teuthology.parallel:result is None 2023-12-22T08:47:44.357 INFO:tasks.ceph.mds.b:Started 2023-12-22T08:47:44.358 DEBUG:teuthology.parallel:result is None 2023-12-22T08:47:44.358 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-22T08:47:44.509 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:47:44.509 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:47:44.512 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-22T08:47:44.513 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-12-22T08:47:44.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.559+0000 7fe0f1ae7640 1 Processor -- start 2023-12-22T08:47:44.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.559+0000 7fe0f1ae7640 1 -- start start 2023-12-22T08:47:44.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.560+0000 7fe0f1ae7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec0b2050 0x7fe0ec0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:44.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.560+0000 7fe0f1ae7640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ec1450f0 con 0x7fe0ec070800 2023-12-22T08:47:44.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.560+0000 7fe0f1ae7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ec0b29f0 con 0x7fe0ec144d10 2023-12-22T08:47:44.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.560+0000 7fe0f1ae7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0cc840 con 0x7fe0ec0b2050 2023-12-22T08:47:44.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.561+0000 7fe0ebfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe0ec070800 0x7fe0ec070c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56318/0 (socket says 172.21.15.38:56318) 2023-12-22T08:47:44.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.561+0000 7fe0ebfff640 1 -- 172.21.15.38:0/3588572314 learned_addr learned my addr 172.21.15.38:0/3588572314 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:44.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.561+0000 7fe0eaffd640 1 --2- 172.21.15.38:0/3588572314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec0b2050 0x7fe0ec0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:44.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.561+0000 7fe0ea7fc640 1 -- 172.21.15.38:0/3588572314 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614775922 0 0) 0x7fe0ec1450f0 con 0x7fe0ec070800 2023-12-22T08:47:44.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.561+0000 7fe0ea7fc640 1 -- 172.21.15.38:0/3588572314 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d4003520 con 0x7fe0ec070800 2023-12-22T08:47:44.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.561+0000 7fe0eaffd640 1 -- 172.21.15.38:0/3588572314 >> v1:172.21.15.89:6789/0 conn(0x7fe0ec144d10 legacy=0x7fe0ec0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:44.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.561+0000 7fe0ea7fc640 1 -- 172.21.15.38:0/3588572314 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682672324 0 0) 0x7fe0ec0b29f0 con 0x7fe0ec144d10 2023-12-22T08:47:44.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.561+0000 7fe0eaffd640 1 -- 172.21.15.38:0/3588572314 >> v1:172.21.15.38:6789/0 conn(0x7fe0ec070800 legacy=0x7fe0ec070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:44.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.561+0000 7fe0eaffd640 1 -- 172.21.15.38:0/3588572314 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0ce010 con 0x7fe0ec0b2050 2023-12-22T08:47:44.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.563+0000 7fe0eaffd640 1 --2- 172.21.15.38:0/3588572314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec0b2050 0x7fe0ec0b24b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00097d0 tx=0x7fe0e002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fd1cca16e5e2a40 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:44.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.563+0000 7fe0ea7fc640 1 -- 172.21.15.38:0/3588572314 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0030800 con 0x7fe0ec0b2050 2023-12-22T08:47:44.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.563+0000 7fe0ea7fc640 1 -- 172.21.15.38:0/3588572314 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e0030960 con 0x7fe0ec0b2050 2023-12-22T08:47:44.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.563+0000 7fe0ea7fc640 1 -- 172.21.15.38:0/3588572314 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0030cf0 con 0x7fe0ec0b2050 2023-12-22T08:47:44.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.563+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/3588572314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec0b2050 msgr2=0x7fe0ec0b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:44.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.563+0000 7fe0f1ae7640 1 --2- 172.21.15.38:0/3588572314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec0b2050 0x7fe0ec0b24b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00097d0 tx=0x7fe0e002b940 comp rx=0 tx=0).stop 2023-12-22T08:47:44.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.564+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/3588572314 shutdown_connections 2023-12-22T08:47:44.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.564+0000 7fe0f1ae7640 1 --2- 172.21.15.38:0/3588572314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec0b2050 0x7fe0ec0b24b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.564+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/3588572314 >> 172.21.15.38:0/3588572314 conn(0x7fe0ec0cf070 msgr2=0x7fe0ec0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:44.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.564+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/3588572314 shutdown_connections 2023-12-22T08:47:44.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.564+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/3588572314 wait complete. 2023-12-22T08:47:44.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.565+0000 7fe0f1ae7640 1 Processor -- start 2023-12-22T08:47:44.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.566+0000 7fe0f1ae7640 1 -- start start 2023-12-22T08:47:44.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.566+0000 7fe0f1ae7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec070800 0x7fe0ec15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:44.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.566+0000 7fe0f1ae7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0ec0b2050 0x7fe0ec1f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:44.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.566+0000 7fe0f1ae7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec144d10 0x7fe0ec1f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:44.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.566+0000 7fe0f1ae7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec1f2be0 con 0x7fe0ec0b2050 2023-12-22T08:47:44.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.566+0000 7fe0f1ae7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec06c230 con 0x7fe0ec144d10 2023-12-22T08:47:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.567+0000 7fe0f1ae7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec06c4d0 con 0x7fe0ec070800 2023-12-22T08:47:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.567+0000 7fe0eaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0ec0b2050 0x7fe0ec1f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.567+0000 7fe0eaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0ec0b2050 0x7fe0ec1f2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60022/0 (socket says 172.21.15.38:60022) 2023-12-22T08:47:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.567+0000 7fe0eaffd640 1 -- 172.21.15.38:0/538822318 learned_addr learned my addr 172.21.15.38:0/538822318 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.567+0000 7fe0eb7fe640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec070800 0x7fe0ec15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.567+0000 7fe0ebfff640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec144d10 0x7fe0ec1f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.567+0000 7fe0eaffd640 1 -- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec070800 msgr2=0x7fe0ec15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.567+0000 7fe0eaffd640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec070800 0x7fe0ec15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.567+0000 7fe0eaffd640 1 -- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec144d10 msgr2=0x7fe0ec1f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.567+0000 7fe0eaffd640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec144d10 0x7fe0ec1f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:44.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.567+0000 7fe0eaffd640 1 -- 172.21.15.38:0/538822318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e0009400 con 0x7fe0ec0b2050 2023-12-22T08:47:44.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.568+0000 7fe0eaffd640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0ec0b2050 0x7fe0ec1f2160 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00097d0 tx=0x7fe0e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:44.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.568+0000 7fe0d3fff640 1 -- 172.21.15.38:0/538822318 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e003e040 con 0x7fe0ec0b2050 2023-12-22T08:47:44.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.568+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/538822318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ec06c7b0 con 0x7fe0ec0b2050 2023-12-22T08:47:44.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.568+0000 7fe0d3fff640 1 -- 172.21.15.38:0/538822318 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e0039c90 con 0x7fe0ec0b2050 2023-12-22T08:47:44.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.568+0000 7fe0d3fff640 1 -- 172.21.15.38:0/538822318 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0004030 con 0x7fe0ec0b2050 2023-12-22T08:47:44.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.568+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/538822318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec06cd70 con 0x7fe0ec0b2050 2023-12-22T08:47:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.569+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/538822318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec06cf60 con 0x7fe0ec0b2050 2023-12-22T08:47:44.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.570+0000 7fe0d3fff640 1 -- 172.21.15.38:0/538822318 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe0e0004190 con 0x7fe0ec0b2050 2023-12-22T08:47:44.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.571+0000 7fe0d3fff640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0d806a430 0x7fe0d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:44.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.571+0000 7fe0d3fff640 1 -- 172.21.15.38:0/538822318 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe0e00aaa20 con 0x7fe0ec0b2050 2023-12-22T08:47:44.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.571+0000 7fe0eb7fe640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0d806a430 0x7fe0d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:44.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.572+0000 7fe0eb7fe640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0d806a430 0x7fe0d806c8f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc000f60 tx=0x7fe0dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:44.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.575+0000 7fe0d3fff640 1 -- 172.21.15.38:0/538822318 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe0e0076570 con 0x7fe0ec0b2050 2023-12-22T08:47:44.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:44.786+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/538822318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe0ec061910 con 0x7fe0ec0b2050 2023-12-22T08:47:45.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:45.774+0000 7fe0d3fff640 1 -- 172.21.15.38:0/538822318 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v138) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe0e0079b90 con 0x7fe0ec0b2050 2023-12-22T08:47:45.776 INFO:teuthology.orchestra.run.smithi038.stderr: removed all blocklist entries 2023-12-22T08:47:45.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:45.778+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0d806a430 msgr2=0x7fe0d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:45.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:45.778+0000 7fe0f1ae7640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0d806a430 0x7fe0d806c8f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc000f60 tx=0x7fe0dc009040 comp rx=0 tx=0).stop 2023-12-22T08:47:45.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:45.778+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/538822318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0ec0b2050 msgr2=0x7fe0ec1f2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:45.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:45.778+0000 7fe0f1ae7640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0ec0b2050 0x7fe0ec1f2160 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00097d0 tx=0x7fe0e0004730 comp rx=0 tx=0).stop 2023-12-22T08:47:45.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:45.778+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/538822318 shutdown_connections 2023-12-22T08:47:45.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:45.778+0000 7fe0f1ae7640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0ec144d10 0x7fe0ec1f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:45.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:45.778+0000 7fe0f1ae7640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0d806a430 0x7fe0d806c8f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:45.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:45.778+0000 7fe0f1ae7640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0ec0b2050 0x7fe0ec1f2160 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:45.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:45.778+0000 7fe0f1ae7640 1 --2- 172.21.15.38:0/538822318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0ec070800 0x7fe0ec15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:45.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:45.778+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/538822318 >> 172.21.15.38:0/538822318 conn(0x7fe0ec0cf070 msgr2=0x7fe0ec0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:45.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:45.778+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/538822318 shutdown_connections 2023-12-22T08:47:45.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:45.778+0000 7fe0f1ae7640 1 -- 172.21.15.38:0/538822318 wait complete. 2023-12-22T08:47:45.800 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T08:47:46.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.026+0000 7f61db49e640 1 Processor -- start 2023-12-22T08:47:46.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.026+0000 7f61db49e640 1 -- start start 2023-12-22T08:47:46.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.028+0000 7f61db49e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f61d4071000 0x7f61d4165f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.028+0000 7f61db49e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d40cdae0 con 0x7f61d415b420 2023-12-22T08:47:46.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.028+0000 7f61db49e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d415b800 con 0x7f61d40a44a0 2023-12-22T08:47:46.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.028+0000 7f61db49e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d40cdd30 con 0x7f61d4071000 2023-12-22T08:47:46.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.028+0000 7f61da49c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f61d415b420 0x7f61d406d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56330/0 (socket says 172.21.15.38:56330) 2023-12-22T08:47:46.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.028+0000 7f61da49c640 1 -- 172.21.15.38:0/1610023530 learned_addr learned my addr 172.21.15.38:0/1610023530 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:46.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643493938 0 0) 0x7f61d40cdae0 con 0x7f61d415b420 2023-12-22T08:47:46.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c0003520 con 0x7f61d415b420 2023-12-22T08:47:46.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61dac9d640 1 --2- 172.21.15.38:0/1610023530 >> v2:172.21.15.89:3300/0 conn(0x7f61d4071000 0x7f61d4165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2864768709 0 0) 0x7f61c0003520 con 0x7f61d415b420 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 >> v2:172.21.15.89:3300/0 conn(0x7f61d4071000 msgr2=0x7f61d4165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 --2- 172.21.15.38:0/1610023530 >> v2:172.21.15.89:3300/0 conn(0x7f61d4071000 0x7f61d4165f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 >> v1:172.21.15.89:6789/0 conn(0x7f61d40a44a0 legacy=0x7f61d40708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d40ce010 con 0x7f61d415b420 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f61d0001670 con 0x7f61d415b420 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 >> v1:172.21.15.38:6789/0 conn(0x7f61d415b420 legacy=0x7f61d406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 --2- 172.21.15.38:0/1610023530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61c00039c0 0x7f61c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 --2- 172.21.15.38:0/1610023530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c00047c0 0x7f61c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 --2- 172.21.15.38:0/1610023530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61c00051d0 0x7f61c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d40cdd30 con 0x7f61c00051d0 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c000c120 con 0x7f61c00039c0 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c000c2e0 con 0x7f61c00047c0 2023-12-22T08:47:46.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.029+0000 7f61dac9d640 1 --2- 172.21.15.38:0/1610023530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61c00051d0 0x7f61c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.030+0000 7f61da49c640 1 --2- 172.21.15.38:0/1610023530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61c00039c0 0x7f61c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.030+0000 7f61d9c9b640 1 --2- 172.21.15.38:0/1610023530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c00047c0 0x7f61c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.030+0000 7f61dac9d640 1 -- 172.21.15.38:0/1610023530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c00047c0 msgr2=0x7f61c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:46.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.030+0000 7f61dac9d640 1 --2- 172.21.15.38:0/1610023530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c00047c0 0x7f61c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.030+0000 7f61dac9d640 1 -- 172.21.15.38:0/1610023530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61c00039c0 msgr2=0x7f61c0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:46.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.030+0000 7f61dac9d640 1 --2- 172.21.15.38:0/1610023530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61c00039c0 0x7f61c0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.030+0000 7f61dac9d640 1 -- 172.21.15.38:0/1610023530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c0003520 con 0x7f61c00051d0 2023-12-22T08:47:46.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.031+0000 7f61dac9d640 1 -- 172.21.15.38:0/1610023530 reap_dead start 2023-12-22T08:47:46.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.031+0000 7f61dac9d640 1 --2- 172.21.15.38:0/1610023530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61c00051d0 0x7f61c000b980 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f61cc007360 tx=0x7f61c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902f6cf3f278b9f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:46.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.031+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc02ccf0 con 0x7f61c00051d0 2023-12-22T08:47:46.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.031+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc02ce90 con 0x7f61c00051d0 2023-12-22T08:47:46.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.031+0000 7f61d949a640 1 -- 172.21.15.38:0/1610023530 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc003bd0 con 0x7f61c00051d0 2023-12-22T08:47:46.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.032+0000 7f61db49e640 1 -- 172.21.15.38:0/1610023530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61c00051d0 msgr2=0x7f61c000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:46.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.032+0000 7f61db49e640 1 --2- 172.21.15.38:0/1610023530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61c00051d0 0x7f61c000b980 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f61cc007360 tx=0x7f61c00057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.032+0000 7f61db49e640 1 -- 172.21.15.38:0/1610023530 shutdown_connections 2023-12-22T08:47:46.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.032+0000 7f61db49e640 1 --2- 172.21.15.38:0/1610023530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61c00051d0 0x7f61c000b980 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.032+0000 7f61db49e640 1 -- 172.21.15.38:0/1610023530 >> 172.21.15.38:0/1610023530 conn(0x7f61d40b1f70 msgr2=0x7f61d40b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:46.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.032+0000 7f61db49e640 1 -- 172.21.15.38:0/1610023530 shutdown_connections 2023-12-22T08:47:46.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.032+0000 7f61db49e640 1 -- 172.21.15.38:0/1610023530 wait complete. 2023-12-22T08:47:46.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.034+0000 7f61db49e640 1 Processor -- start 2023-12-22T08:47:46.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.034+0000 7f61db49e640 1 -- start start 2023-12-22T08:47:46.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.035+0000 7f61db49e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c00051d0 0x7f61d41e6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.035+0000 7f61db49e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61d41e68c0 0x7f61d409e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.035+0000 7f61db49e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61d4159d20 0x7f61d409e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.035+0000 7f61db49e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41e5c20 con 0x7f61d41e68c0 2023-12-22T08:47:46.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.035+0000 7f61db49e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41e5010 con 0x7f61d4159d20 2023-12-22T08:47:46.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.035+0000 7f61db49e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41e52f0 con 0x7f61c00051d0 2023-12-22T08:47:46.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.036+0000 7f61d9c9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61d41e68c0 0x7f61d409e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.036+0000 7f61d9c9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61d41e68c0 0x7f61d409e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60042/0 (socket says 172.21.15.38:60042) 2023-12-22T08:47:46.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.036+0000 7f61d9c9b640 1 -- 172.21.15.38:0/1847735271 learned_addr learned my addr 172.21.15.38:0/1847735271 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:46.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.036+0000 7f61da49c640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c00051d0 0x7f61d41e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.036+0000 7f61dac9d640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61d4159d20 0x7f61d409e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.036+0000 7f61d9c9b640 1 -- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c00051d0 msgr2=0x7f61d41e6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:46.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.036+0000 7f61d9c9b640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c00051d0 0x7f61d41e6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.036+0000 7f61d9c9b640 1 -- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61d4159d20 msgr2=0x7f61d409e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:46.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.036+0000 7f61d9c9b640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61d4159d20 0x7f61d409e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.036+0000 7f61d9c9b640 1 -- 172.21.15.38:0/1847735271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d41e55d0 con 0x7f61d41e68c0 2023-12-22T08:47:46.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.036+0000 7f61dac9d640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61d4159d20 0x7f61d409e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:46.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.036+0000 7f61d9c9b640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61d41e68c0 0x7f61d409e340 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f61c400e440 tx=0x7f61c400e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:46.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.037+0000 7f61caffd640 1 -- 172.21.15.38:0/1847735271 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40052e0 con 0x7f61d41e68c0 2023-12-22T08:47:46.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.037+0000 7f61caffd640 1 -- 172.21.15.38:0/1847735271 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c4005440 con 0x7f61d41e68c0 2023-12-22T08:47:46.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.037+0000 7f61caffd640 1 -- 172.21.15.38:0/1847735271 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4003830 con 0x7f61d41e68c0 2023-12-22T08:47:46.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.037+0000 7f61db49e640 1 -- 172.21.15.38:0/1847735271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d41e58b0 con 0x7f61d41e68c0 2023-12-22T08:47:46.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.037+0000 7f61db49e640 1 -- 172.21.15.38:0/1847735271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d40a09f0 con 0x7f61d41e68c0 2023-12-22T08:47:46.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.038+0000 7f61db49e640 1 -- 172.21.15.38:0/1847735271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d41f2aa0 con 0x7f61d41e68c0 2023-12-22T08:47:46.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.039+0000 7f61caffd640 1 -- 172.21.15.38:0/1847735271 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61c4003990 con 0x7f61d41e68c0 2023-12-22T08:47:46.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.040+0000 7f61caffd640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f61b806a430 0x7f61b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.040+0000 7f61caffd640 1 -- 172.21.15.38:0/1847735271 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f61c4088360 con 0x7f61d41e68c0 2023-12-22T08:47:46.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.041+0000 7f61da49c640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f61b806a430 0x7f61b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.042+0000 7f61da49c640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f61b806a430 0x7f61b806c8f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f61d0001eb0 tx=0x7f61d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:46.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.044+0000 7f61caffd640 1 -- 172.21.15.38:0/1847735271 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f61c4053c00 con 0x7f61d41e68c0 2023-12-22T08:47:46.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.309+0000 7f61db49e640 1 -- 172.21.15.38:0/1847735271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f61d4061910 con 0x7f61d41e68c0 2023-12-22T08:47:46.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.310+0000 7f61caffd640 1 -- 172.21.15.38:0/1847735271 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f61c4057220 con 0x7f61d41e68c0 2023-12-22T08:47:46.312 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:46.312 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:47:46.312 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_dump": [ 2023-12-22T08:47:46.312 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.312 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.a", 2023-12-22T08:47:46.312 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl57dkCBAAeliJIPc49iRBk2mp8WYv8A==", 2023-12-22T08:47:46.312 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.312 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:46.312 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:47:46.312 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:47:46.313 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.313 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.313 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.313 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.b", 2023-12-22T08:47:46.313 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl0C0+KhAAkCsjfyn19nOz1xTyhZkbPQ==", 2023-12-22T08:47:46.313 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.313 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:46.313 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:47:46.313 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:47:46.313 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.313 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.c", 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl7poXGhAA+ZSohyj4dAOs6B5dZKTLAg==", 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.d", 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4VlTBuoOhAArKX4AiOQRGawIyAnInIhCg==", 2023-12-22T08:47:46.314 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.0", 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VlnVQaChAAxfWmPqwo5D4qBYkAP/6dHQ==", 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.315 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.316 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.316 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.316 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.1", 2023-12-22T08:47:46.316 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4Vll2dlGxAAbqx4rxnz4FWIKl9OGqcwtw==", 2023-12-22T08:47:46.316 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.316 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:46.316 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:46.316 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.316 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.316 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.316 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.316 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.2", 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VljQ3HLRAAfyrtqD4n6Da8Rl/6UKmv7g==", 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.3", 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBCS4VlOat4AxAAIkAGRvGGWrrwx/ppMbexWQ==", 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:46.317 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.4", 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlwg7TDxAA+L504F+Hw/6FTJ63cV3ZXg==", 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.5", 2023-12-22T08:47:46.318 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx8zgHxAALBDm/sSYqw/fn4nLNQbu4A==", 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.6", 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx5OdLxAAaMP09nYI3HKiuhPARgnCOw==", 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.319 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.320 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.320 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.320 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.7", 2023-12-22T08:47:46.320 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBHS4Vl/15bBBAA4maatkcgA0axcZY/L9r/IA==", 2023-12-22T08:47:46.320 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.320 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:47:46.320 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:47:46.320 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.320 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.320 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.0", 2023-12-22T08:47:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlgDspDhAA0TWGbk4AbuOhCNotPej29A==", 2023-12-22T08:47:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow r", 2023-12-22T08:47:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-22T08:47:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.1", 2023-12-22T08:47:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlwSk/JhAAM3faae43p4/gw9BmyxLpJA==", 2023-12-22T08:47:46.321 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.2", 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VliOHMGhAARaM8FC/0maNMToLGhBR4Tg==", 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:47:46.322 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.3", 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlV/MVMRAAyN1643IAOTLOLuz4DqMZ8A==", 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.admin", 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA2S4VlBhogNhAACBsSGP7kmhCSn+XAKkvgKQ==", 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.323 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.x", 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlTHG+NhAAUNkVtrDuoK2OEsy1HHkt2A==", 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:47:46.324 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:46.325 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.y", 2023-12-22T08:47:46.325 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlED5ALBAAComDf9woKBt/IXcez+Udmg==", 2023-12-22T08:47:46.325 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:47:46.325 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:47:46.325 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:47:46.325 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:47:46.325 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.325 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:46.325 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:47:46.325 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:47:46.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.313+0000 7f61db49e640 1 -- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f61b806a430 msgr2=0x7f61b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:46.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.313+0000 7f61db49e640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f61b806a430 0x7f61b806c8f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f61d0001eb0 tx=0x7f61d0009040 comp rx=0 tx=0).stop 2023-12-22T08:47:46.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.313+0000 7f61db49e640 1 -- 172.21.15.38:0/1847735271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61d41e68c0 msgr2=0x7f61d409e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:46.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.313+0000 7f61db49e640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61d41e68c0 0x7f61d409e340 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f61c400e440 tx=0x7f61c400e900 comp rx=0 tx=0).stop 2023-12-22T08:47:46.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.313+0000 7f61db49e640 1 -- 172.21.15.38:0/1847735271 shutdown_connections 2023-12-22T08:47:46.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.313+0000 7f61db49e640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61d4159d20 0x7f61d409e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.313+0000 7f61db49e640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f61b806a430 0x7f61b806c8f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.313+0000 7f61db49e640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61d41e68c0 0x7f61d409e340 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.313+0000 7f61db49e640 1 --2- 172.21.15.38:0/1847735271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61c00051d0 0x7f61d41e6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.313+0000 7f61db49e640 1 -- 172.21.15.38:0/1847735271 >> 172.21.15.38:0/1847735271 conn(0x7f61d40b1f70 msgr2=0x7f61d415da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:46.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.313+0000 7f61db49e640 1 -- 172.21.15.38:0/1847735271 shutdown_connections 2023-12-22T08:47:46.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.313+0000 7f61db49e640 1 -- 172.21.15.38:0/1847735271 wait complete. 2023-12-22T08:47:46.335 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:46.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.567+0000 7fca8ae68640 1 Processor -- start 2023-12-22T08:47:46.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.568+0000 7fca8ae68640 1 -- start start 2023-12-22T08:47:46.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.569+0000 7fca8ae68640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fca84157980 0x7fca8415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.569+0000 7fca8ae68640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca840b3ff0 0x7fca8406cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.569+0000 7fca8ae68640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca840d1520 con 0x7fca840b4470 2023-12-22T08:47:46.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.569+0000 7fca8ae68640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca840d1800 con 0x7fca84157980 2023-12-22T08:47:46.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.569+0000 7fca8ae68640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca840d1ae0 con 0x7fca840b3ff0 2023-12-22T08:47:46.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.570+0000 7fca89e66640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fca84157980 0x7fca8415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.570+0000 7fca8a667640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fca840b4470 0x7fca840d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:55282/0 (socket says 172.21.15.38:55282) 2023-12-22T08:47:46.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.570+0000 7fca8a667640 1 -- 172.21.15.38:0/913043181 learned_addr learned my addr 172.21.15.38:0/913043181 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:46.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.570+0000 7fca89665640 1 --2- 172.21.15.38:0/913043181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca840b3ff0 0x7fca8406cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.571+0000 7fca89e66640 1 -- 172.21.15.38:0/913043181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca840b3ff0 msgr2=0x7fca8406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:46.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.571+0000 7fca89e66640 1 --2- 172.21.15.38:0/913043181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca840b3ff0 0x7fca8406cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.571+0000 7fca89e66640 1 -- 172.21.15.38:0/913043181 >> v1:172.21.15.89:6789/0 conn(0x7fca840b4470 legacy=0x7fca840d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:46.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.571+0000 7fca89e66640 1 -- 172.21.15.38:0/913043181 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca840d1dc0 con 0x7fca84157980 2023-12-22T08:47:46.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.572+0000 7fca89e66640 1 --2- 172.21.15.38:0/913043181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca84157980 0x7fca8415eb10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fca800097a0 tx=0x7fca8002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=184a9b9a333164bb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:46.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.573+0000 7fca88e64640 1 -- 172.21.15.38:0/913043181 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8002d040 con 0x7fca84157980 2023-12-22T08:47:46.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.573+0000 7fca88e64640 1 -- 172.21.15.38:0/913043181 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca80031810 con 0x7fca84157980 2023-12-22T08:47:46.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.573+0000 7fca88e64640 1 -- 172.21.15.38:0/913043181 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80031ba0 con 0x7fca84157980 2023-12-22T08:47:46.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.574+0000 7fca8ae68640 1 -- 172.21.15.38:0/913043181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca84157980 msgr2=0x7fca8415eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:46.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.574+0000 7fca8ae68640 1 --2- 172.21.15.38:0/913043181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca84157980 0x7fca8415eb10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fca800097a0 tx=0x7fca8002b8b0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.574+0000 7fca8ae68640 1 -- 172.21.15.38:0/913043181 shutdown_connections 2023-12-22T08:47:46.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.574+0000 7fca8ae68640 1 --2- 172.21.15.38:0/913043181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca840b3ff0 0x7fca8406cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.574+0000 7fca8ae68640 1 --2- 172.21.15.38:0/913043181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca84157980 0x7fca8415eb10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.574+0000 7fca8ae68640 1 -- 172.21.15.38:0/913043181 >> 172.21.15.38:0/913043181 conn(0x7fca840d31f0 msgr2=0x7fca840d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:46.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.574+0000 7fca8ae68640 1 -- 172.21.15.38:0/913043181 shutdown_connections 2023-12-22T08:47:46.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.574+0000 7fca8ae68640 1 -- 172.21.15.38:0/913043181 wait complete. 2023-12-22T08:47:46.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.576+0000 7fca8ae68640 1 Processor -- start 2023-12-22T08:47:46.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.577+0000 7fca8ae68640 1 -- start start 2023-12-22T08:47:46.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.578+0000 7fca8ae68640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca840b3ff0 0x7fca8414b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.578+0000 7fca8ae68640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca840b4470 0x7fca8415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.578+0000 7fca8ae68640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca84157980 0x7fca8415a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.578+0000 7fca8ae68640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca841599b0 con 0x7fca840b4470 2023-12-22T08:47:46.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.578+0000 7fca8ae68640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8414bf20 con 0x7fca840b3ff0 2023-12-22T08:47:46.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.578+0000 7fca8ae68640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca84158d30 con 0x7fca84157980 2023-12-22T08:47:46.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.578+0000 7fca89665640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca840b4470 0x7fca8415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.579+0000 7fca89665640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca840b4470 0x7fca8415a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60048/0 (socket says 172.21.15.38:60048) 2023-12-22T08:47:46.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.579+0000 7fca89665640 1 -- 172.21.15.38:0/910213335 learned_addr learned my addr 172.21.15.38:0/910213335 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:46.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.579+0000 7fca8a667640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca84157980 0x7fca8415a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.579+0000 7fca89e66640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca840b3ff0 0x7fca8414b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.579+0000 7fca89665640 1 -- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca84157980 msgr2=0x7fca8415a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:46.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.579+0000 7fca89665640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca84157980 0x7fca8415a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.579+0000 7fca89665640 1 -- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca840b3ff0 msgr2=0x7fca8414b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:46.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.579+0000 7fca89665640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca840b3ff0 0x7fca8414b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.579+0000 7fca89665640 1 -- 172.21.15.38:0/910213335 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca80009400 con 0x7fca840b4470 2023-12-22T08:47:46.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.579+0000 7fca8a667640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca84157980 0x7fca8415a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:46.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.579+0000 7fca89665640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca840b4470 0x7fca8415a490 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fca7400e9b0 tx=0x7fca7400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:46.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.580+0000 7fca7a7fc640 1 -- 172.21.15.38:0/910213335 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74009670 con 0x7fca840b4470 2023-12-22T08:47:46.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.580+0000 7fca7a7fc640 1 -- 172.21.15.38:0/910213335 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7400c9a0 con 0x7fca840b4470 2023-12-22T08:47:46.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.580+0000 7fca7a7fc640 1 -- 172.21.15.38:0/910213335 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7400cd50 con 0x7fca840b4470 2023-12-22T08:47:46.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.580+0000 7fca8ae68640 1 -- 172.21.15.38:0/910213335 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca84159010 con 0x7fca840b4470 2023-12-22T08:47:46.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.580+0000 7fca8ae68640 1 -- 172.21.15.38:0/910213335 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca841595d0 con 0x7fca840b4470 2023-12-22T08:47:46.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.581+0000 7fca8ae68640 1 -- 172.21.15.38:0/910213335 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca84061910 con 0x7fca840b4470 2023-12-22T08:47:46.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.582+0000 7fca7a7fc640 1 -- 172.21.15.38:0/910213335 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca74013470 con 0x7fca840b4470 2023-12-22T08:47:46.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.583+0000 7fca7a7fc640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca6806a430 0x7fca6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:46.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.583+0000 7fca7a7fc640 1 -- 172.21.15.38:0/910213335 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fca740888a0 con 0x7fca840b4470 2023-12-22T08:47:46.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.583+0000 7fca89e66640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca6806a430 0x7fca6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:46.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.585+0000 7fca89e66640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca6806a430 0x7fca6806c8f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fca80036000 tx=0x7fca8003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:46.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.588+0000 7fca7a7fc640 1 -- 172.21.15.38:0/910213335 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fca740541d0 con 0x7fca840b4470 2023-12-22T08:47:46.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.795+0000 7fca8ae68640 1 -- 172.21.15.38:0/910213335 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca8406c9d0 con 0x7fca840b4470 2023-12-22T08:47:46.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.796+0000 7fca7a7fc640 1 -- 172.21.15.38:0/910213335 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+12352 (secure 0 0 0) 0x7fca74017090 con 0x7fca840b4470 2023-12-22T08:47:46.798 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:46.798 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":138,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:45.765875+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:46.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.799+0000 7fca8ae68640 1 -- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca6806a430 msgr2=0x7fca6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:46.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.799+0000 7fca8ae68640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca6806a430 0x7fca6806c8f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fca80036000 tx=0x7fca8003c040 comp rx=0 tx=0).stop 2023-12-22T08:47:46.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.799+0000 7fca8ae68640 1 -- 172.21.15.38:0/910213335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca840b4470 msgr2=0x7fca8415a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:46.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.799+0000 7fca8ae68640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca840b4470 0x7fca8415a490 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fca7400e9b0 tx=0x7fca7400ee70 comp rx=0 tx=0).stop 2023-12-22T08:47:46.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.799+0000 7fca8ae68640 1 -- 172.21.15.38:0/910213335 shutdown_connections 2023-12-22T08:47:46.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.799+0000 7fca8ae68640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca84157980 0x7fca8415a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.799+0000 7fca8ae68640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca6806a430 0x7fca6806c8f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.799+0000 7fca8ae68640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca840b4470 0x7fca8415a490 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.799+0000 7fca8ae68640 1 --2- 172.21.15.38:0/910213335 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca840b3ff0 0x7fca8414b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:46.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.799+0000 7fca8ae68640 1 -- 172.21.15.38:0/910213335 >> 172.21.15.38:0/910213335 conn(0x7fca840d31f0 msgr2=0x7fca8406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:46.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.800+0000 7fca8ae68640 1 -- 172.21.15.38:0/910213335 shutdown_connections 2023-12-22T08:47:46.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:46.800+0000 7fca8ae68640 1 -- 172.21.15.38:0/910213335 wait complete. 2023-12-22T08:47:46.822 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:47:46.822 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:47:47.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.046+0000 7f3fea749640 1 Processor -- start 2023-12-22T08:47:47.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.046+0000 7f3fea749640 1 -- start start 2023-12-22T08:47:47.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.048+0000 7f3fea749640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe4070f50 0x7f3fe40713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.048+0000 7f3fea749640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3fe4162d40 0x7f3fe4165130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.048+0000 7f3fea749640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe406d5f0 con 0x7f3fe4070b70 2023-12-22T08:47:47.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.048+0000 7f3fea749640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe4144fa0 con 0x7f3fe4162d40 2023-12-22T08:47:47.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.048+0000 7f3fea749640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe406da80 con 0x7f3fe4070f50 2023-12-22T08:47:47.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.048+0000 7f3fe9747640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3fe4070b70 0x7f3fe406bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56340/0 (socket says 172.21.15.38:56340) 2023-12-22T08:47:47.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.049+0000 7f3fe9747640 1 -- 172.21.15.38:0/1244932797 learned_addr learned my addr 172.21.15.38:0/1244932797 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:47.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.049+0000 7f3fe8f46640 1 --2- 172.21.15.38:0/1244932797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe4070f50 0x7f3fe40713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.049+0000 7f3fe9f48640 1 --2- 172.21.15.38:0/1244932797 >> v2:172.21.15.89:3300/0 conn(0x7f3fe4162d40 0x7f3fe4165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.049+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577066138 0 0) 0x7f3fe406d5f0 con 0x7f3fe4070b70 2023-12-22T08:47:47.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.049+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fd0003520 con 0x7f3fe4070b70 2023-12-22T08:47:47.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.049+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4069405779 0 0) 0x7f3fd0003520 con 0x7f3fe4070b70 2023-12-22T08:47:47.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.049+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe4070f50 msgr2=0x7f3fe40713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:47.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.049+0000 7f3fdbfff640 1 --2- 172.21.15.38:0/1244932797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe4070f50 0x7f3fe40713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.049+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 >> v2:172.21.15.89:3300/0 conn(0x7f3fe4162d40 msgr2=0x7f3fe4165130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:47.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.050+0000 7f3fdbfff640 1 --2- 172.21.15.38:0/1244932797 >> v2:172.21.15.89:3300/0 conn(0x7f3fe4162d40 0x7f3fe4165130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.050+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe406c9e0 con 0x7f3fe4070b70 2023-12-22T08:47:47.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.050+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f3fe0001670 con 0x7f3fe4070b70 2023-12-22T08:47:47.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.050+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 >> v1:172.21.15.38:6789/0 conn(0x7f3fe4070b70 legacy=0x7f3fe406bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.050+0000 7f3fdbfff640 1 --2- 172.21.15.38:0/1244932797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd0003970 0x7f3fd0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.050+0000 7f3fdbfff640 1 --2- 172.21.15.38:0/1244932797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd00047c0 0x7f3fd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.050+0000 7f3fdbfff640 1 --2- 172.21.15.38:0/1244932797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe4070f50 0x7f3fd0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.050+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4144fa0 con 0x7f3fd0003970 2023-12-22T08:47:47.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.050+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe406da80 con 0x7f3fd00047c0 2023-12-22T08:47:47.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.050+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd000b980 con 0x7f3fe4070f50 2023-12-22T08:47:47.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.050+0000 7f3fe9747640 1 --2- 172.21.15.38:0/1244932797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd0003970 0x7f3fd0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.051+0000 7f3fe8f46640 1 --2- 172.21.15.38:0/1244932797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd00047c0 0x7f3fd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.051+0000 7f3fe9747640 1 -- 172.21.15.38:0/1244932797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe4070f50 msgr2=0x7f3fd0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:47.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.051+0000 7f3fe9747640 1 --2- 172.21.15.38:0/1244932797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe4070f50 0x7f3fd0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.051+0000 7f3fe9747640 1 -- 172.21.15.38:0/1244932797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd00047c0 msgr2=0x7f3fd0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:47.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.051+0000 7f3fe9747640 1 --2- 172.21.15.38:0/1244932797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fd00047c0 0x7f3fd0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.051+0000 7f3fe9747640 1 -- 172.21.15.38:0/1244932797 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0003520 con 0x7f3fd0003970 2023-12-22T08:47:47.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.052+0000 7f3fe9747640 1 --2- 172.21.15.38:0/1244932797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd0003970 0x7f3fd0003d90 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000c210 tx=0x7f3fd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58549516d0f5191 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:47.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.052+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0005ad0 con 0x7f3fd0003970 2023-12-22T08:47:47.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.052+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe0005c30 con 0x7f3fd0003970 2023-12-22T08:47:47.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.052+0000 7f3fdbfff640 1 -- 172.21.15.38:0/1244932797 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe002c8d0 con 0x7f3fd0003970 2023-12-22T08:47:47.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.053+0000 7f3fea749640 1 -- 172.21.15.38:0/1244932797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd0003970 msgr2=0x7f3fd0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.053+0000 7f3fea749640 1 --2- 172.21.15.38:0/1244932797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd0003970 0x7f3fd0003d90 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000c210 tx=0x7f3fd00057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.053+0000 7f3fe9f48640 1 -- 172.21.15.38:0/1244932797 reap_dead start 2023-12-22T08:47:47.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.053+0000 7f3fea749640 1 -- 172.21.15.38:0/1244932797 shutdown_connections 2023-12-22T08:47:47.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.053+0000 7f3fea749640 1 -- 172.21.15.38:0/1244932797 >> 172.21.15.38:0/1244932797 conn(0x7f3fe40b0b60 msgr2=0x7f3fe40b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:47.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.053+0000 7f3fea749640 1 -- 172.21.15.38:0/1244932797 shutdown_connections 2023-12-22T08:47:47.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.053+0000 7f3fea749640 1 -- 172.21.15.38:0/1244932797 wait complete. 2023-12-22T08:47:47.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.055+0000 7f3fea749640 1 Processor -- start 2023-12-22T08:47:47.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.055+0000 7f3fea749640 1 -- start start 2023-12-22T08:47:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.056+0000 7f3fea749640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd0003970 0x7f3fe41569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.056+0000 7f3fea749640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fe4159700 0x7f3fe415fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.056+0000 7f3fea749640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe4159ea0 0x7f3fe415a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.056+0000 7f3fea749640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe415a890 con 0x7f3fe4159ea0 2023-12-22T08:47:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.056+0000 7f3fea749640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40ac420 con 0x7f3fe4159700 2023-12-22T08:47:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.056+0000 7f3fea749640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40abe40 con 0x7f3fd0003970 2023-12-22T08:47:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.056+0000 7f3fe9f48640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe4159ea0 0x7f3fe415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.056+0000 7f3fe9f48640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe4159ea0 0x7f3fe415a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60058/0 (socket says 172.21.15.38:60058) 2023-12-22T08:47:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.056+0000 7f3fe9f48640 1 -- 172.21.15.38:0/2427088138 learned_addr learned my addr 172.21.15.38:0/2427088138 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.057+0000 7f3fe9f48640 1 -- 172.21.15.38:0/2427088138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd0003970 msgr2=0x7f3fe41569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.057+0000 7f3fe9f48640 1 --2- 172.21.15.38:0/2427088138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd0003970 0x7f3fe41569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.057+0000 7f3fe8f46640 1 --2- 172.21.15.38:0/2427088138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fe4159700 0x7f3fe415fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.057+0000 7f3fe9f48640 1 -- 172.21.15.38:0/2427088138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fe4159700 msgr2=0x7f3fe415fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.057+0000 7f3fe9f48640 1 --2- 172.21.15.38:0/2427088138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fe4159700 0x7f3fe415fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.057+0000 7f3fe9f48640 1 -- 172.21.15.38:0/2427088138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4160490 con 0x7f3fe4159ea0 2023-12-22T08:47:47.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.057+0000 7f3fe9f48640 1 --2- 172.21.15.38:0/2427088138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe4159ea0 0x7f3fe415a350 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f3fe406e440 tx=0x7f3fdc00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:47.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.057+0000 7f3fd9ffb640 1 -- 172.21.15.38:0/2427088138 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc010040 con 0x7f3fe4159ea0 2023-12-22T08:47:47.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.057+0000 7f3fd9ffb640 1 -- 172.21.15.38:0/2427088138 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc00bb70 con 0x7f3fe4159ea0 2023-12-22T08:47:47.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.057+0000 7f3fd9ffb640 1 -- 172.21.15.38:0/2427088138 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc014400 con 0x7f3fe4159ea0 2023-12-22T08:47:47.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.057+0000 7f3fea749640 1 -- 172.21.15.38:0/2427088138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe40ac0b0 con 0x7f3fe4159ea0 2023-12-22T08:47:47.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.057+0000 7f3fea749640 1 -- 172.21.15.38:0/2427088138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe4099a70 con 0x7f3fe4159ea0 2023-12-22T08:47:47.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.059+0000 7f3fea749640 1 -- 172.21.15.38:0/2427088138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe4061910 con 0x7f3fe4159ea0 2023-12-22T08:47:47.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.059+0000 7f3fd9ffb640 1 -- 172.21.15.38:0/2427088138 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3fdc014560 con 0x7f3fe4159ea0 2023-12-22T08:47:47.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.060+0000 7f3fd9ffb640 1 --2- 172.21.15.38:0/2427088138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fc806a460 0x7f3fc806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.060+0000 7f3fd9ffb640 1 -- 172.21.15.38:0/2427088138 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3fdc088860 con 0x7f3fe4159ea0 2023-12-22T08:47:47.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.061+0000 7f3fe9747640 1 --2- 172.21.15.38:0/2427088138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fc806a460 0x7f3fc806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.062+0000 7f3fe9747640 1 --2- 172.21.15.38:0/2427088138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fc806a460 0x7f3fc806c920 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0034000 tx=0x7f3fe002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:47.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.065+0000 7f3fd9ffb640 1 -- 172.21.15.38:0/2427088138 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3fdc054100 con 0x7f3fe4159ea0 2023-12-22T08:47:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.263+0000 7f3fea749640 1 -- 172.21.15.38:0/2427088138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3fe40ac590 con 0x7f3fe4159ea0 2023-12-22T08:47:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.264+0000 7f3fd9ffb640 1 -- 172.21.15.38:0/2427088138 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v138) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3fdc057720 con 0x7f3fe4159ea0 2023-12-22T08:47:47.266 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:47:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.267+0000 7f3fea749640 1 -- 172.21.15.38:0/2427088138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fc806a460 msgr2=0x7f3fc806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.267+0000 7f3fea749640 1 --2- 172.21.15.38:0/2427088138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fc806a460 0x7f3fc806c920 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0034000 tx=0x7f3fe002e000 comp rx=0 tx=0).stop 2023-12-22T08:47:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.267+0000 7f3fea749640 1 -- 172.21.15.38:0/2427088138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe4159ea0 msgr2=0x7f3fe415a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.267+0000 7f3fea749640 1 --2- 172.21.15.38:0/2427088138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe4159ea0 0x7f3fe415a350 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f3fe406e440 tx=0x7f3fdc00ef30 comp rx=0 tx=0).stop 2023-12-22T08:47:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.267+0000 7f3fea749640 1 -- 172.21.15.38:0/2427088138 shutdown_connections 2023-12-22T08:47:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.267+0000 7f3fea749640 1 --2- 172.21.15.38:0/2427088138 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3fc806a460 0x7f3fc806c920 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.267+0000 7f3fea749640 1 --2- 172.21.15.38:0/2427088138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fe4159ea0 0x7f3fe415a350 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.267+0000 7f3fea749640 1 --2- 172.21.15.38:0/2427088138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fe4159700 0x7f3fe415fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.267+0000 7f3fea749640 1 --2- 172.21.15.38:0/2427088138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fd0003970 0x7f3fe41569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.267+0000 7f3fea749640 1 -- 172.21.15.38:0/2427088138 >> 172.21.15.38:0/2427088138 conn(0x7f3fe40b0b60 msgr2=0x7f3fe406c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.267+0000 7f3fea749640 1 -- 172.21.15.38:0/2427088138 shutdown_connections 2023-12-22T08:47:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.267+0000 7f3fea749640 1 -- 172.21.15.38:0/2427088138 wait complete. 2023-12-22T08:47:47.289 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T08:47:47.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.492+0000 7fbecc6c4640 1 Processor -- start 2023-12-22T08:47:47.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.492+0000 7fbecc6c4640 1 -- start start 2023-12-22T08:47:47.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.494+0000 7fbecc6c4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbec4144d10 0x7fbec40cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.494+0000 7fbecc6c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec40b2760 0x7fbec4070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.494+0000 7fbecc6c4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec41450f0 con 0x7fbec40cc670 2023-12-22T08:47:47.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.494+0000 7fbecc6c4640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec40ce010 con 0x7fbec4144d10 2023-12-22T08:47:47.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.494+0000 7fbecc6c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40ce2f0 con 0x7fbec40b2760 2023-12-22T08:47:47.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.494+0000 7fbec9c5f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbec40cc670 0x7fbec40b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56354/0 (socket says 172.21.15.38:56354) 2023-12-22T08:47:47.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.494+0000 7fbec9c5f640 1 -- 172.21.15.38:0/1529112000 learned_addr learned my addr 172.21.15.38:0/1529112000 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:47.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.494+0000 7fbeca460640 1 --2- 172.21.15.38:0/1529112000 >> v2:172.21.15.38:3300/0 conn(0x7fbec4144d10 0x7fbec40cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.494+0000 7fbecac61640 1 --2- 172.21.15.38:0/1529112000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec40b2760 0x7fbec4070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.494+0000 7fbeca460640 1 -- 172.21.15.38:0/1529112000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec40b2760 msgr2=0x7fbec4070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:47.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.495+0000 7fbeca460640 1 --2- 172.21.15.38:0/1529112000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec40b2760 0x7fbec4070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.495+0000 7fbeca460640 1 -- 172.21.15.38:0/1529112000 >> v1:172.21.15.38:6789/0 conn(0x7fbec40cc670 legacy=0x7fbec40b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.495+0000 7fbeca460640 1 -- 172.21.15.38:0/1529112000 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec40ce5d0 con 0x7fbec4144d10 2023-12-22T08:47:47.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.495+0000 7fbec945e640 1 -- 172.21.15.38:0/1529112000 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512692695 0 0) 0x7fbec41450f0 con 0x7fbec40cc670 2023-12-22T08:47:47.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.496+0000 7fbeca460640 1 --2- 172.21.15.38:0/1529112000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbec4144d10 0x7fbec40cc130 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fbec00097a0 tx=0x7fbec002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4b9d383d50c42e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:47.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.496+0000 7fbec945e640 1 -- 172.21.15.38:0/1529112000 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0031830 con 0x7fbec4144d10 2023-12-22T08:47:47.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.496+0000 7fbec945e640 1 -- 172.21.15.38:0/1529112000 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec0031990 con 0x7fbec4144d10 2023-12-22T08:47:47.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.496+0000 7fbec945e640 1 -- 172.21.15.38:0/1529112000 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0031d20 con 0x7fbec4144d10 2023-12-22T08:47:47.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.496+0000 7fbecc6c4640 1 -- 172.21.15.38:0/1529112000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbec4144d10 msgr2=0x7fbec40cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.496+0000 7fbecc6c4640 1 --2- 172.21.15.38:0/1529112000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbec4144d10 0x7fbec40cc130 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fbec00097a0 tx=0x7fbec002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.496+0000 7fbecc6c4640 1 -- 172.21.15.38:0/1529112000 shutdown_connections 2023-12-22T08:47:47.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.496+0000 7fbecc6c4640 1 --2- 172.21.15.38:0/1529112000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec40b2760 0x7fbec4070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.497+0000 7fbecc6c4640 1 --2- 172.21.15.38:0/1529112000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbec4144d10 0x7fbec40cc130 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.497+0000 7fbecc6c4640 1 -- 172.21.15.38:0/1529112000 >> 172.21.15.38:0/1529112000 conn(0x7fbec40cf070 msgr2=0x7fbec40cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:47.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.497+0000 7fbecc6c4640 1 -- 172.21.15.38:0/1529112000 shutdown_connections 2023-12-22T08:47:47.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.497+0000 7fbecc6c4640 1 -- 172.21.15.38:0/1529112000 wait complete. 2023-12-22T08:47:47.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.498+0000 7fbecc6c4640 1 Processor -- start 2023-12-22T08:47:47.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.499+0000 7fbecc6c4640 1 -- start start 2023-12-22T08:47:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.499+0000 7fbecc6c4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbec40b2760 0x7fbec4158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.499+0000 7fbecc6c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbec4144d10 0x7fbec415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.499+0000 7fbecc6c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec4154b60 0x7fbec4143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.499+0000 7fbecc6c4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4156080 con 0x7fbec40b2760 2023-12-22T08:47:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.499+0000 7fbecc6c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4156640 con 0x7fbec4144d10 2023-12-22T08:47:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.499+0000 7fbecc6c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4159350 con 0x7fbec4154b60 2023-12-22T08:47:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.500+0000 7fbeca460640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbec40b2760 0x7fbec4158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.500+0000 7fbeca460640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbec40b2760 0x7fbec4158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60084/0 (socket says 172.21.15.38:60084) 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.500+0000 7fbeca460640 1 -- 172.21.15.38:0/259057631 learned_addr learned my addr 172.21.15.38:0/259057631 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.500+0000 7fbecac61640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec4154b60 0x7fbec4143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.500+0000 7fbec9c5f640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbec4144d10 0x7fbec415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.500+0000 7fbeca460640 1 -- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec4154b60 msgr2=0x7fbec4143a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.500+0000 7fbeca460640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec4154b60 0x7fbec4143a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.500+0000 7fbeca460640 1 -- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbec4144d10 msgr2=0x7fbec415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.500+0000 7fbeca460640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbec4144d10 0x7fbec415af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.500+0000 7fbeca460640 1 -- 172.21.15.38:0/259057631 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec0009400 con 0x7fbec40b2760 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.500+0000 7fbecac61640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec4154b60 0x7fbec4143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.500+0000 7fbec9c5f640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbec4144d10 0x7fbec415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.501+0000 7fbeca460640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbec40b2760 0x7fbec4158c50 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fbec00098c0 tx=0x7fbec00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.501+0000 7fbebaffd640 1 -- 172.21.15.38:0/259057631 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec003aa60 con 0x7fbec40b2760 2023-12-22T08:47:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.501+0000 7fbebaffd640 1 -- 172.21.15.38:0/259057631 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec003abc0 con 0x7fbec40b2760 2023-12-22T08:47:47.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.501+0000 7fbebaffd640 1 -- 172.21.15.38:0/259057631 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec00423f0 con 0x7fbec40b2760 2023-12-22T08:47:47.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.501+0000 7fbecc6c4640 1 -- 172.21.15.38:0/259057631 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec4159630 con 0x7fbec40b2760 2023-12-22T08:47:47.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.501+0000 7fbecc6c4640 1 -- 172.21.15.38:0/259057631 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec4155010 con 0x7fbec40b2760 2023-12-22T08:47:47.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.502+0000 7fbecc6c4640 1 -- 172.21.15.38:0/259057631 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec4061910 con 0x7fbec40b2760 2023-12-22T08:47:47.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.503+0000 7fbebaffd640 1 -- 172.21.15.38:0/259057631 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbec0030380 con 0x7fbec40b2760 2023-12-22T08:47:47.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.504+0000 7fbebaffd640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbea806a460 0x7fbea806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.504+0000 7fbebaffd640 1 -- 172.21.15.38:0/259057631 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbec00aa0c0 con 0x7fbec40b2760 2023-12-22T08:47:47.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.505+0000 7fbec9c5f640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbea806a460 0x7fbea806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.506+0000 7fbec9c5f640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbea806a460 0x7fbea806c920 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbec415c610 tx=0x7fbeb4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:47.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.508+0000 7fbebaffd640 1 -- 172.21.15.38:0/259057631 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbec0075a90 con 0x7fbec40b2760 2023-12-22T08:47:47.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.701+0000 7fbecc6c4640 1 -- 172.21.15.38:0/259057631 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbec40ce880 con 0x7fbec40b2760 2023-12-22T08:47:47.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.702+0000 7fbebaffd640 1 -- 172.21.15.38:0/259057631 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v138) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbec0035060 con 0x7fbec40b2760 2023-12-22T08:47:47.706 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:47.706 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-12-22T08:47:47.706 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:47:47.706 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-12-22T08:47:47.706 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-12-22T08:47:47.706 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:47:47.706 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-12-22T08:47:47.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.704+0000 7fbecc6c4640 1 -- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbea806a460 msgr2=0x7fbea806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.704+0000 7fbecc6c4640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbea806a460 0x7fbea806c920 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbec415c610 tx=0x7fbeb4009040 comp rx=0 tx=0).stop 2023-12-22T08:47:47.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.704+0000 7fbecc6c4640 1 -- 172.21.15.38:0/259057631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbec40b2760 msgr2=0x7fbec4158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.704+0000 7fbecc6c4640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbec40b2760 0x7fbec4158c50 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fbec00098c0 tx=0x7fbec00046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.704+0000 7fbecc6c4640 1 -- 172.21.15.38:0/259057631 shutdown_connections 2023-12-22T08:47:47.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.704+0000 7fbecc6c4640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbec4154b60 0x7fbec4143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.704+0000 7fbecc6c4640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbec4144d10 0x7fbec415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.704+0000 7fbecc6c4640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbea806a460 0x7fbea806c920 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.704+0000 7fbecc6c4640 1 --2- 172.21.15.38:0/259057631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbec40b2760 0x7fbec4158c50 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.704+0000 7fbecc6c4640 1 -- 172.21.15.38:0/259057631 >> 172.21.15.38:0/259057631 conn(0x7fbec40cf070 msgr2=0x7fbec40b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:47.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.705+0000 7fbecc6c4640 1 -- 172.21.15.38:0/259057631 shutdown_connections 2023-12-22T08:47:47.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.705+0000 7fbecc6c4640 1 -- 172.21.15.38:0/259057631 wait complete. 2023-12-22T08:47:47.723 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T08:47:47.723 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T08:47:47.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.951+0000 7f03f5607640 1 Processor -- start 2023-12-22T08:47:47.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.952+0000 7f03f5607640 1 -- start start 2023-12-22T08:47:47.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.953+0000 7f03f5607640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f03f015aee0 0x7f03f00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.953+0000 7f03f5607640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03f015dbe0 0x7f03f00b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.953+0000 7f03f5607640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00b36a0 con 0x7f03f015b2c0 2023-12-22T08:47:47.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.953+0000 7f03f5607640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00b3a40 con 0x7f03f015aee0 2023-12-22T08:47:47.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.953+0000 7f03f5607640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00b4570 con 0x7f03f015dbe0 2023-12-22T08:47:47.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.954+0000 7f03ef7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03f015dbe0 0x7f03f00b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.954+0000 7f03ee7fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f03f015b2c0 0x7f03f00b3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:55284/0 (socket says 172.21.15.38:55284) 2023-12-22T08:47:47.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.954+0000 7f03eeffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f03f015aee0 0x7f03f00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.954+0000 7f03ee7fc640 1 -- 172.21.15.38:0/593058109 learned_addr learned my addr 172.21.15.38:0/593058109 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.955+0000 7f03eeffd640 1 -- 172.21.15.38:0/593058109 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03f015dbe0 msgr2=0x7f03f00b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.955+0000 7f03eeffd640 1 --2- 172.21.15.38:0/593058109 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03f015dbe0 0x7f03f00b8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.955+0000 7f03eeffd640 1 -- 172.21.15.38:0/593058109 >> v1:172.21.15.89:6789/0 conn(0x7f03f015b2c0 legacy=0x7f03f00b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.955+0000 7f03eeffd640 1 -- 172.21.15.38:0/593058109 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00b56e0 con 0x7f03f015aee0 2023-12-22T08:47:47.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.956+0000 7f03eeffd640 1 --2- 172.21.15.38:0/593058109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03f015aee0 0x7f03f00b4d70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f03d80097a0 tx=0x7f03d802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=818c33b130fcd497 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:47.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.957+0000 7f03edffb640 1 -- 172.21.15.38:0/593058109 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8031780 con 0x7f03f015aee0 2023-12-22T08:47:47.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.957+0000 7f03edffb640 1 -- 172.21.15.38:0/593058109 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d80318e0 con 0x7f03f015aee0 2023-12-22T08:47:47.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.957+0000 7f03edffb640 1 -- 172.21.15.38:0/593058109 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8031c70 con 0x7f03f015aee0 2023-12-22T08:47:47.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.958+0000 7f03f5607640 1 -- 172.21.15.38:0/593058109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03f015aee0 msgr2=0x7f03f00b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.958+0000 7f03f5607640 1 --2- 172.21.15.38:0/593058109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03f015aee0 0x7f03f00b4d70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f03d80097a0 tx=0x7f03d802b820 comp rx=0 tx=0).stop 2023-12-22T08:47:47.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.958+0000 7f03f5607640 1 -- 172.21.15.38:0/593058109 shutdown_connections 2023-12-22T08:47:47.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.958+0000 7f03f5607640 1 --2- 172.21.15.38:0/593058109 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03f015dbe0 0x7f03f00b8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.958+0000 7f03f5607640 1 --2- 172.21.15.38:0/593058109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03f015aee0 0x7f03f00b4d70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.958+0000 7f03f5607640 1 -- 172.21.15.38:0/593058109 >> 172.21.15.38:0/593058109 conn(0x7f03f0070770 msgr2=0x7f03f0070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:47.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.958+0000 7f03f5607640 1 -- 172.21.15.38:0/593058109 shutdown_connections 2023-12-22T08:47:47.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.958+0000 7f03f5607640 1 -- 172.21.15.38:0/593058109 wait complete. 2023-12-22T08:47:47.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.960+0000 7f03f5607640 1 Processor -- start 2023-12-22T08:47:47.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.961+0000 7f03f5607640 1 -- start start 2023-12-22T08:47:47.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.962+0000 7f03f5607640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03f015aee0 0x7f03f00ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.962+0000 7f03f5607640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f015dbe0 0x7f03f0154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.962+0000 7f03f5607640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03f0155400 0x7f03f015e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.962+0000 7f03f5607640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0155890 con 0x7f03f015dbe0 2023-12-22T08:47:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.962+0000 7f03f5607640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f015fb20 con 0x7f03f015aee0 2023-12-22T08:47:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.962+0000 7f03f5607640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f015efa0 con 0x7f03f0155400 2023-12-22T08:47:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.962+0000 7f03ee7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f015dbe0 0x7f03f0154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.962+0000 7f03ee7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f015dbe0 0x7f03f0154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60090/0 (socket says 172.21.15.38:60090) 2023-12-22T08:47:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.962+0000 7f03ee7fc640 1 -- 172.21.15.38:0/3668874772 learned_addr learned my addr 172.21.15.38:0/3668874772 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.962+0000 7f03eeffd640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03f015aee0 0x7f03f00ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.963+0000 7f03ef7fe640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03f0155400 0x7f03f015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.963+0000 7f03ee7fc640 1 -- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03f0155400 msgr2=0x7f03f015e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.963+0000 7f03ee7fc640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03f0155400 0x7f03f015e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.963+0000 7f03ee7fc640 1 -- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03f015aee0 msgr2=0x7f03f00ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:47.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.963+0000 7f03ee7fc640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03f015aee0 0x7f03f00ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:47.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.963+0000 7f03ee7fc640 1 -- 172.21.15.38:0/3668874772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d8009400 con 0x7f03f015dbe0 2023-12-22T08:47:47.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.963+0000 7f03ee7fc640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f015dbe0 0x7f03f0154ec0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f03e000c4a0 tx=0x7f03e000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:47.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.963+0000 7f03e77fe640 1 -- 172.21.15.38:0/3668874772 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0005ce0 con 0x7f03f015dbe0 2023-12-22T08:47:47.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.964+0000 7f03e77fe640 1 -- 172.21.15.38:0/3668874772 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e0005e40 con 0x7f03f015dbe0 2023-12-22T08:47:47.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.964+0000 7f03e77fe640 1 -- 172.21.15.38:0/3668874772 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0007270 con 0x7f03f015dbe0 2023-12-22T08:47:47.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.964+0000 7f03f5607640 1 -- 172.21.15.38:0/3668874772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f015f280 con 0x7f03f015dbe0 2023-12-22T08:47:47.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.964+0000 7f03f5607640 1 -- 172.21.15.38:0/3668874772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f015f840 con 0x7f03f015dbe0 2023-12-22T08:47:47.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.965+0000 7f03f5607640 1 -- 172.21.15.38:0/3668874772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f0061910 con 0x7f03f015dbe0 2023-12-22T08:47:47.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.966+0000 7f03e77fe640 1 -- 172.21.15.38:0/3668874772 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f03e0007490 con 0x7f03f015dbe0 2023-12-22T08:47:47.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.967+0000 7f03e77fe640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f03d006a430 0x7f03d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:47.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.967+0000 7f03e77fe640 1 -- 172.21.15.38:0/3668874772 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f03e0087af0 con 0x7f03f015dbe0 2023-12-22T08:47:47.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.968+0000 7f03eeffd640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f03d006a430 0x7f03d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:47.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.969+0000 7f03eeffd640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f03d006a430 0x7f03d006c8f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f03d8036000 tx=0x7f03d803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:47.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:47.971+0000 7f03e77fe640 1 -- 172.21.15.38:0/3668874772 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f03e0053440 con 0x7f03f015dbe0 2023-12-22T08:47:48.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.161+0000 7f03f5607640 1 -- 172.21.15.38:0/3668874772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f03f00b5420 con 0x7f03f015dbe0 2023-12-22T08:47:48.220 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:47:48.229 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:47:48.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.808+0000 7f03e77fe640 1 -- 172.21.15.38:0/3668874772 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v139) v1 ==== 138+0+0 (secure 0 0 0) 0x7f03e00170b0 con 0x7f03f015dbe0 2023-12-22T08:47:48.810 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-12-22T08:47:48.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.814+0000 7f03f5607640 1 -- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f03d006a430 msgr2=0x7f03d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:48.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.814+0000 7f03f5607640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f03d006a430 0x7f03d006c8f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f03d8036000 tx=0x7f03d803d040 comp rx=0 tx=0).stop 2023-12-22T08:47:48.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.814+0000 7f03f5607640 1 -- 172.21.15.38:0/3668874772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f015dbe0 msgr2=0x7f03f0154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:48.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.814+0000 7f03f5607640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f015dbe0 0x7f03f0154ec0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f03e000c4a0 tx=0x7f03e000c960 comp rx=0 tx=0).stop 2023-12-22T08:47:48.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.814+0000 7f03f5607640 1 -- 172.21.15.38:0/3668874772 shutdown_connections 2023-12-22T08:47:48.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.814+0000 7f03f5607640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03f0155400 0x7f03f015e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:48.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.814+0000 7f03f5607640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f03d006a430 0x7f03d006c8f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:48.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.814+0000 7f03f5607640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03f015dbe0 0x7f03f0154ec0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:48.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.814+0000 7f03f5607640 1 --2- 172.21.15.38:0/3668874772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03f015aee0 0x7f03f00ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:48.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.814+0000 7f03f5607640 1 -- 172.21.15.38:0/3668874772 >> 172.21.15.38:0/3668874772 conn(0x7f03f0070770 msgr2=0x7f03f0071840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:48.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.814+0000 7f03f5607640 1 -- 172.21.15.38:0/3668874772 shutdown_connections 2023-12-22T08:47:48.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:48.815+0000 7f03f5607640 1 -- 172.21.15.38:0/3668874772 wait complete. 2023-12-22T08:47:48.839 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T08:47:49.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.069+0000 7f93b96d5640 1 Processor -- start 2023-12-22T08:47:49.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.069+0000 7f93b96d5640 1 -- start start 2023-12-22T08:47:49.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.071+0000 7f93b96d5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93b40b3f90 0x7f93b415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:49.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.071+0000 7f93b96d5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f93b406ca50 0x7f93b4070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:49.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.071+0000 7f93b96d5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b415eb20 con 0x7f93b415e740 2023-12-22T08:47:49.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.071+0000 7f93b96d5640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b406e650 con 0x7f93b406ca50 2023-12-22T08:47:49.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.071+0000 7f93b96d5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4070770 con 0x7f93b40b3f90 2023-12-22T08:47:49.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.072+0000 7f93b37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f93b406ca50 0x7f93b4070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:49.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.072+0000 7f93b2ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f93b415e740 0x7f93b40b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56358/0 (socket says 172.21.15.38:56358) 2023-12-22T08:47:49.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.072+0000 7f93b2ffd640 1 -- 172.21.15.38:0/683268404 learned_addr learned my addr 172.21.15.38:0/683268404 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:49.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.072+0000 7f93aa7fc640 1 --2- 172.21.15.38:0/683268404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93b40b3f90 0x7f93b415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:49.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.073+0000 7f93b37fe640 1 -- 172.21.15.38:0/683268404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93b40b3f90 msgr2=0x7f93b415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:49.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.073+0000 7f93b37fe640 1 --2- 172.21.15.38:0/683268404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93b40b3f90 0x7f93b415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:49.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.073+0000 7f93b37fe640 1 -- 172.21.15.38:0/683268404 >> v1:172.21.15.38:6789/0 conn(0x7f93b415e740 legacy=0x7f93b40b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:49.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.073+0000 7f93b37fe640 1 -- 172.21.15.38:0/683268404 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b406cec0 con 0x7f93b406ca50 2023-12-22T08:47:49.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.073+0000 7f93b27fc640 1 -- 172.21.15.38:0/683268404 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408853428 0 0) 0x7f93b415eb20 con 0x7f93b415e740 2023-12-22T08:47:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.074+0000 7f93b37fe640 1 --2- 172.21.15.38:0/683268404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93b406ca50 0x7f93b4070c00 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0097a0 tx=0x7f93ac02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d698f14acbb28d4b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.074+0000 7f93b27fc640 1 -- 172.21.15.38:0/683268404 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac02f050 con 0x7f93b406ca50 2023-12-22T08:47:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.074+0000 7f93b27fc640 1 -- 172.21.15.38:0/683268404 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ac031700 con 0x7f93b406ca50 2023-12-22T08:47:49.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.074+0000 7f93b27fc640 1 -- 172.21.15.38:0/683268404 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac031a90 con 0x7f93b406ca50 2023-12-22T08:47:49.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.075+0000 7f93b96d5640 1 -- 172.21.15.38:0/683268404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93b406ca50 msgr2=0x7f93b4070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:49.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.075+0000 7f93b96d5640 1 --2- 172.21.15.38:0/683268404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93b406ca50 0x7f93b4070c00 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0097a0 tx=0x7f93ac02b7a0 comp rx=0 tx=0).stop 2023-12-22T08:47:49.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.075+0000 7f93b96d5640 1 -- 172.21.15.38:0/683268404 shutdown_connections 2023-12-22T08:47:49.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.075+0000 7f93b96d5640 1 --2- 172.21.15.38:0/683268404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93b406ca50 0x7f93b4070c00 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:49.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.075+0000 7f93b96d5640 1 --2- 172.21.15.38:0/683268404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93b40b3f90 0x7f93b415db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:49.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.075+0000 7f93b96d5640 1 -- 172.21.15.38:0/683268404 >> 172.21.15.38:0/683268404 conn(0x7f93b40cfea0 msgr2=0x7f93b40d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:49.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.075+0000 7f93b96d5640 1 -- 172.21.15.38:0/683268404 shutdown_connections 2023-12-22T08:47:49.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.075+0000 7f93b96d5640 1 -- 172.21.15.38:0/683268404 wait complete. 2023-12-22T08:47:49.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.077+0000 7f93b96d5640 1 Processor -- start 2023-12-22T08:47:49.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.077+0000 7f93b96d5640 1 -- start start 2023-12-22T08:47:49.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.078+0000 7f93b96d5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93b406ca50 0x7f93b4157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:49.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.078+0000 7f93b96d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93b40b3f90 0x7f93b415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:49.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.078+0000 7f93b96d5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b415e740 0x7f93b415ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:49.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.078+0000 7f93b96d5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4157eb0 con 0x7f93b40b3f90 2023-12-22T08:47:49.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.078+0000 7f93b96d5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4143070 con 0x7f93b415e740 2023-12-22T08:47:49.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.078+0000 7f93b96d5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4156e90 con 0x7f93b406ca50 2023-12-22T08:47:49.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.079+0000 7f93aa7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93b40b3f90 0x7f93b415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:49.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.079+0000 7f93aa7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93b40b3f90 0x7f93b415fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60104/0 (socket says 172.21.15.38:60104) 2023-12-22T08:47:49.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.079+0000 7f93aa7fc640 1 -- 172.21.15.38:0/512062293 learned_addr learned my addr 172.21.15.38:0/512062293 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:49.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.079+0000 7f93b2ffd640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93b406ca50 0x7f93b4157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:49.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.079+0000 7f93b37fe640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b415e740 0x7f93b415ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:49.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.079+0000 7f93aa7fc640 1 -- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93b406ca50 msgr2=0x7f93b4157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:49.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.079+0000 7f93aa7fc640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93b406ca50 0x7f93b4157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:49.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.079+0000 7f93aa7fc640 1 -- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b415e740 msgr2=0x7f93b415ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:49.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.079+0000 7f93aa7fc640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b415e740 0x7f93b415ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:49.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.079+0000 7f93aa7fc640 1 -- 172.21.15.38:0/512062293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac009400 con 0x7f93b40b3f90 2023-12-22T08:47:49.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.080+0000 7f93aa7fc640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93b40b3f90 0x7f93b415fa80 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f939c00e9b0 tx=0x7f939c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:49.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.080+0000 7f93abfff640 1 -- 172.21.15.38:0/512062293 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c009670 con 0x7f93b40b3f90 2023-12-22T08:47:49.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.080+0000 7f93abfff640 1 -- 172.21.15.38:0/512062293 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c00c9a0 con 0x7f93b40b3f90 2023-12-22T08:47:49.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.080+0000 7f93abfff640 1 -- 172.21.15.38:0/512062293 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c00cd50 con 0x7f93b40b3f90 2023-12-22T08:47:49.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.080+0000 7f93b96d5640 1 -- 172.21.15.38:0/512062293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b4157170 con 0x7f93b40b3f90 2023-12-22T08:47:49.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.080+0000 7f93b96d5640 1 -- 172.21.15.38:0/512062293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b4156b40 con 0x7f93b40b3f90 2023-12-22T08:47:49.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.081+0000 7f93b96d5640 1 -- 172.21.15.38:0/512062293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b4061910 con 0x7f93b40b3f90 2023-12-22T08:47:49.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.083+0000 7f93abfff640 1 -- 172.21.15.38:0/512062293 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f939c013470 con 0x7f93b40b3f90 2023-12-22T08:47:49.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.084+0000 7f93abfff640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f939406a430 0x7f939406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:49.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.085+0000 7f93abfff640 1 -- 172.21.15.38:0/512062293 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f939c089190 con 0x7f93b40b3f90 2023-12-22T08:47:49.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.085+0000 7f93b2ffd640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f939406a430 0x7f939406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:49.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.086+0000 7f93b2ffd640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f939406a430 0x7f939406c8f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f93a40012e0 tx=0x7f93a4007ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:49.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.089+0000 7f93abfff640 1 -- 172.21.15.38:0/512062293 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f939c054940 con 0x7f93b40b3f90 2023-12-22T08:47:49.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.288+0000 7f93b96d5640 1 -- 172.21.15.38:0/512062293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f93b40b5340 con 0x7f93b40b3f90 2023-12-22T08:47:49.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.827+0000 7f93abfff640 1 -- 172.21.15.38:0/512062293 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v140) v1 ==== 170+0+0 (secure 0 0 0) 0x7f939c05e030 con 0x7f93b40b3f90 2023-12-22T08:47:49.829 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-12-22T08:47:49.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.835+0000 7f93b96d5640 1 -- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f939406a430 msgr2=0x7f939406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:49.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.835+0000 7f93b96d5640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f939406a430 0x7f939406c8f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f93a40012e0 tx=0x7f93a4007ed0 comp rx=0 tx=0).stop 2023-12-22T08:47:49.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.835+0000 7f93b96d5640 1 -- 172.21.15.38:0/512062293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93b40b3f90 msgr2=0x7f93b415fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:49.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.835+0000 7f93b96d5640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93b40b3f90 0x7f93b415fa80 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f939c00e9b0 tx=0x7f939c00ee70 comp rx=0 tx=0).stop 2023-12-22T08:47:49.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.840+0000 7f93b96d5640 1 -- 172.21.15.38:0/512062293 shutdown_connections 2023-12-22T08:47:49.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.840+0000 7f93b96d5640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93b415e740 0x7f93b415ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:49.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.840+0000 7f93b96d5640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f939406a430 0x7f939406c8f0 secure :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f93a40012e0 tx=0x7f93a4007ed0 comp rx=0 tx=0).stop 2023-12-22T08:47:49.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.840+0000 7f93b96d5640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93b40b3f90 0x7f93b415fa80 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:49.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.840+0000 7f93b96d5640 1 --2- 172.21.15.38:0/512062293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93b406ca50 0x7f93b4157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:49.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.840+0000 7f93b96d5640 1 -- 172.21.15.38:0/512062293 >> 172.21.15.38:0/512062293 conn(0x7f93b40cfea0 msgr2=0x7f93b4161ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:49.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.841+0000 7f93b96d5640 1 -- 172.21.15.38:0/512062293 shutdown_connections 2023-12-22T08:47:49.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:49.841+0000 7f93b96d5640 1 -- 172.21.15.38:0/512062293 wait complete. 2023-12-22T08:47:49.868 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T08:47:50.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.070+0000 7fe759c5f640 1 Processor -- start 2023-12-22T08:47:50.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.070+0000 7fe759c5f640 1 -- start start 2023-12-22T08:47:50.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.072+0000 7fe759c5f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe75415ec50 0x7fe7540ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.072+0000 7fe759c5f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7540ce4b0 con 0x7fe754070e80 2023-12-22T08:47:50.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.072+0000 7fe759c5f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75415fea0 con 0x7fe75415e870 2023-12-22T08:47:50.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.072+0000 7fe759c5f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7540cdb80 con 0x7fe75415ec50 2023-12-22T08:47:50.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.072+0000 7fe753fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe754070e80 0x7fe75406f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56362/0 (socket says 172.21.15.38:56362) 2023-12-22T08:47:50.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.072+0000 7fe753fff640 1 -- 172.21.15.38:0/367817422 learned_addr learned my addr 172.21.15.38:0/367817422 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:50.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe752ffd640 1 --2- 172.21.15.38:0/367817422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe75415ec50 0x7fe7540ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573720473 0 0) 0x7fe7540ce4b0 con 0x7fe754070e80 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe73c003520 con 0x7fe754070e80 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3559063287 0 0) 0x7fe73c003520 con 0x7fe754070e80 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe75415ec50 msgr2=0x7fe7540ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 --2- 172.21.15.38:0/367817422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe75415ec50 0x7fe7540ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 >> v1:172.21.15.89:6789/0 conn(0x7fe75415e870 legacy=0x7fe754070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7540cde60 con 0x7fe754070e80 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fe74c0019f0 con 0x7fe754070e80 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 >> v1:172.21.15.38:6789/0 conn(0x7fe754070e80 legacy=0x7fe75406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 --2- 172.21.15.38:0/367817422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe75415ec50 0x7fe73c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 --2- 172.21.15.38:0/367817422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe73c003f20 0x7fe73c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 --2- 172.21.15.38:0/367817422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe73c004d00 0x7fe73c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7540cdb80 con 0x7fe73c003f20 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c00bb10 con 0x7fe73c004d00 2023-12-22T08:47:50.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.073+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c00bcd0 con 0x7fe75415ec50 2023-12-22T08:47:50.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.074+0000 7fe752ffd640 1 --2- 172.21.15.38:0/367817422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe73c003f20 0x7fe73c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.074+0000 7fe7537fe640 1 --2- 172.21.15.38:0/367817422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe75415ec50 0x7fe73c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.074+0000 7fe752ffd640 1 -- 172.21.15.38:0/367817422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe75415ec50 msgr2=0x7fe73c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:50.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.074+0000 7fe752ffd640 1 --2- 172.21.15.38:0/367817422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe75415ec50 0x7fe73c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.074+0000 7fe753fff640 1 --2- 172.21.15.38:0/367817422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe73c004d00 0x7fe73c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.074+0000 7fe752ffd640 1 -- 172.21.15.38:0/367817422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe73c004d00 msgr2=0x7fe73c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:50.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.074+0000 7fe752ffd640 1 --2- 172.21.15.38:0/367817422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe73c004d00 0x7fe73c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.074+0000 7fe752ffd640 1 -- 172.21.15.38:0/367817422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c003520 con 0x7fe73c003f20 2023-12-22T08:47:50.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.075+0000 7fe752ffd640 1 --2- 172.21.15.38:0/367817422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe73c003f20 0x7fe73c0047c0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fe748009a90 tx=0x7fe73c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1ac39731d6307f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:50.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.075+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74802c680 con 0x7fe73c003f20 2023-12-22T08:47:50.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.076+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74802c7e0 con 0x7fe73c003f20 2023-12-22T08:47:50.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.076+0000 7fe7527fc640 1 -- 172.21.15.38:0/367817422 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74802cb70 con 0x7fe73c003f20 2023-12-22T08:47:50.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.076+0000 7fe759c5f640 1 -- 172.21.15.38:0/367817422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe73c003f20 msgr2=0x7fe73c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:50.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.076+0000 7fe759c5f640 1 --2- 172.21.15.38:0/367817422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe73c003f20 0x7fe73c0047c0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fe748009a90 tx=0x7fe73c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.076+0000 7fe753fff640 1 -- 172.21.15.38:0/367817422 reap_dead start 2023-12-22T08:47:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.076+0000 7fe759c5f640 1 -- 172.21.15.38:0/367817422 shutdown_connections 2023-12-22T08:47:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.076+0000 7fe759c5f640 1 -- 172.21.15.38:0/367817422 >> 172.21.15.38:0/367817422 conn(0x7fe7540b20c0 msgr2=0x7fe7540b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.076+0000 7fe759c5f640 1 -- 172.21.15.38:0/367817422 shutdown_connections 2023-12-22T08:47:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.076+0000 7fe759c5f640 1 -- 172.21.15.38:0/367817422 wait complete. 2023-12-22T08:47:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.078+0000 7fe759c5f640 1 Processor -- start 2023-12-22T08:47:50.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.078+0000 7fe759c5f640 1 -- start start 2023-12-22T08:47:50.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.079+0000 7fe759c5f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe73c003f20 0x7fe7541f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.079+0000 7fe759c5f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe754150d90 0x7fe7540c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.079+0000 7fe759c5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe75415d310 0x7fe75415c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.079+0000 7fe759c5f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7540c5540 con 0x7fe754150d90 2023-12-22T08:47:50.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.079+0000 7fe759c5f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7541f3680 con 0x7fe75415d310 2023-12-22T08:47:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.079+0000 7fe759c5f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7541f3960 con 0x7fe73c003f20 2023-12-22T08:47:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.079+0000 7fe752ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe754150d90 0x7fe7540c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.080+0000 7fe752ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe754150d90 0x7fe7540c4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60130/0 (socket says 172.21.15.38:60130) 2023-12-22T08:47:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.080+0000 7fe752ffd640 1 -- 172.21.15.38:0/4039910436 learned_addr learned my addr 172.21.15.38:0/4039910436 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.080+0000 7fe7537fe640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe73c003f20 0x7fe7541f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.080+0000 7fe752ffd640 1 -- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe73c003f20 msgr2=0x7fe7541f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.080+0000 7fe753fff640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe75415d310 0x7fe75415c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.080+0000 7fe752ffd640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe73c003f20 0x7fe7541f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.080+0000 7fe752ffd640 1 -- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe75415d310 msgr2=0x7fe75415c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.080+0000 7fe752ffd640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe75415d310 0x7fe75415c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.080+0000 7fe752ffd640 1 -- 172.21.15.38:0/4039910436 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7541f3c40 con 0x7fe754150d90 2023-12-22T08:47:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.080+0000 7fe7537fe640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe73c003f20 0x7fe7541f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.080+0000 7fe752ffd640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe754150d90 0x7fe7540c4060 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fe748037040 tx=0x7fe748004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.081+0000 7fe73bfff640 1 -- 172.21.15.38:0/4039910436 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748003810 con 0x7fe754150d90 2023-12-22T08:47:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.081+0000 7fe73bfff640 1 -- 172.21.15.38:0/4039910436 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe748003970 con 0x7fe754150d90 2023-12-22T08:47:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.081+0000 7fe73bfff640 1 -- 172.21.15.38:0/4039910436 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748003d00 con 0x7fe754150d90 2023-12-22T08:47:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.081+0000 7fe759c5f640 1 -- 172.21.15.38:0/4039910436 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7541f3f20 con 0x7fe754150d90 2023-12-22T08:47:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.081+0000 7fe759c5f640 1 -- 172.21.15.38:0/4039910436 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75415d7a0 con 0x7fe754150d90 2023-12-22T08:47:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.082+0000 7fe759c5f640 1 -- 172.21.15.38:0/4039910436 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75415d930 con 0x7fe754150d90 2023-12-22T08:47:50.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.084+0000 7fe73bfff640 1 -- 172.21.15.38:0/4039910436 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe748051480 con 0x7fe754150d90 2023-12-22T08:47:50.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.085+0000 7fe73bfff640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe74006a430 0x7fe74006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.085+0000 7fe73bfff640 1 -- 172.21.15.38:0/4039910436 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe7480aac10 con 0x7fe754150d90 2023-12-22T08:47:50.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.086+0000 7fe7537fe640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe74006a430 0x7fe74006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.087+0000 7fe7537fe640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe74006a430 0x7fe74006c8f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe7440016b0 tx=0x7fe744009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:50.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.089+0000 7fe73bfff640 1 -- 172.21.15.38:0/4039910436 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe748076380 con 0x7fe754150d90 2023-12-22T08:47:50.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.319+0000 7fe759c5f640 1 -- 172.21.15.38:0/4039910436 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe754061910 con 0x7fe754150d90 2023-12-22T08:47:50.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.330+0000 7fe73bfff640 1 -- 172.21.15.38:0/4039910436 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v59) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe748003e60 con 0x7fe754150d90 2023-12-22T08:47:50.332 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 16 and data pool 17 2023-12-22T08:47:50.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.335+0000 7fe759c5f640 1 -- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe74006a430 msgr2=0x7fe74006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:50.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.335+0000 7fe759c5f640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe74006a430 0x7fe74006c8f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe7440016b0 tx=0x7fe744009040 comp rx=0 tx=0).stop 2023-12-22T08:47:50.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.335+0000 7fe759c5f640 1 -- 172.21.15.38:0/4039910436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe754150d90 msgr2=0x7fe7540c4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:50.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.335+0000 7fe759c5f640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe754150d90 0x7fe7540c4060 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fe748037040 tx=0x7fe748004730 comp rx=0 tx=0).stop 2023-12-22T08:47:50.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.335+0000 7fe759c5f640 1 -- 172.21.15.38:0/4039910436 shutdown_connections 2023-12-22T08:47:50.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.335+0000 7fe759c5f640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe75415d310 0x7fe75415c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.335+0000 7fe759c5f640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe74006a430 0x7fe74006c8f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.335+0000 7fe759c5f640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe754150d90 0x7fe7540c4060 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.335+0000 7fe759c5f640 1 --2- 172.21.15.38:0/4039910436 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe73c003f20 0x7fe7541f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.335+0000 7fe759c5f640 1 -- 172.21.15.38:0/4039910436 >> 172.21.15.38:0/4039910436 conn(0x7fe7540b20c0 msgr2=0x7fe75406c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:50.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.335+0000 7fe759c5f640 1 -- 172.21.15.38:0/4039910436 shutdown_connections 2023-12-22T08:47:50.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.336+0000 7fe759c5f640 1 -- 172.21.15.38:0/4039910436 wait complete. 2023-12-22T08:47:50.365 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.553+0000 7f6720b9f640 1 Processor -- start 2023-12-22T08:47:50.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.553+0000 7f6720b9f640 1 -- start start 2023-12-22T08:47:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.554+0000 7f6720b9f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f671c144d10 0x7f671c0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f6720b9f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0cc670 0x7f671c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f6720b9f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f671c0b2590 0x7f671c15f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f6720b9f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671c0b2a20 con 0x7f671c144d10 2023-12-22T08:47:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f6720b9f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671c1450f0 con 0x7f671c0b2590 2023-12-22T08:47:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f6720b9f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671c0ce010 con 0x7f671c0cc670 2023-12-22T08:47:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f671a59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f671c144d10 0x7f671c0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f671a59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f671c144d10 0x7f671c0cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60136/0 (socket says 172.21.15.38:60136) 2023-12-22T08:47:50.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f671a59c640 1 -- 172.21.15.38:0/2446915218 learned_addr learned my addr 172.21.15.38:0/2446915218 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:50.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f671ad9d640 1 --2- 172.21.15.38:0/2446915218 >> v2:172.21.15.89:3300/0 conn(0x7f671c0b2590 0x7f671c15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f6713fff640 1 --2- 172.21.15.38:0/2446915218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0cc670 0x7f671c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f671a59c640 1 -- 172.21.15.38:0/2446915218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0cc670 msgr2=0x7f671c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f671a59c640 1 --2- 172.21.15.38:0/2446915218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0cc670 0x7f671c0b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f671a59c640 1 -- 172.21.15.38:0/2446915218 >> v2:172.21.15.89:3300/0 conn(0x7f671c0b2590 msgr2=0x7f671c15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f671a59c640 1 --2- 172.21.15.38:0/2446915218 >> v2:172.21.15.89:3300/0 conn(0x7f671c0b2590 0x7f671c15f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.555+0000 7f671a59c640 1 -- 172.21.15.38:0/2446915218 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c0ce2f0 con 0x7f671c144d10 2023-12-22T08:47:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.556+0000 7f671ad9d640 1 --2- 172.21.15.38:0/2446915218 >> v2:172.21.15.89:3300/0 conn(0x7f671c0b2590 0x7f671c15f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.556+0000 7f6713fff640 1 --2- 172.21.15.38:0/2446915218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0cc670 0x7f671c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.557+0000 7f671a59c640 1 --2- 172.21.15.38:0/2446915218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c144d10 0x7f671c0cc130 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f671c159590 tx=0x7f670c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c4aa812c1a9d87 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:50.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.557+0000 7f6719d9b640 1 -- 172.21.15.38:0/2446915218 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c031860 con 0x7f671c144d10 2023-12-22T08:47:50.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.557+0000 7f6719d9b640 1 -- 172.21.15.38:0/2446915218 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c0319c0 con 0x7f671c144d10 2023-12-22T08:47:50.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.557+0000 7f6719d9b640 1 -- 172.21.15.38:0/2446915218 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c031d50 con 0x7f671c144d10 2023-12-22T08:47:50.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.558+0000 7f6720b9f640 1 -- 172.21.15.38:0/2446915218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c144d10 msgr2=0x7f671c0cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:50.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.558+0000 7f6720b9f640 1 --2- 172.21.15.38:0/2446915218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c144d10 0x7f671c0cc130 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f671c159590 tx=0x7f670c02b900 comp rx=0 tx=0).stop 2023-12-22T08:47:50.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.558+0000 7f6720b9f640 1 -- 172.21.15.38:0/2446915218 shutdown_connections 2023-12-22T08:47:50.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.558+0000 7f6720b9f640 1 --2- 172.21.15.38:0/2446915218 >> v2:172.21.15.89:3300/0 conn(0x7f671c0b2590 0x7f671c15f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.558+0000 7f6720b9f640 1 --2- 172.21.15.38:0/2446915218 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0cc670 0x7f671c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.558+0000 7f6720b9f640 1 --2- 172.21.15.38:0/2446915218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c144d10 0x7f671c0cc130 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.558+0000 7f6720b9f640 1 -- 172.21.15.38:0/2446915218 >> 172.21.15.38:0/2446915218 conn(0x7f671c0cf070 msgr2=0x7f671c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:50.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.558+0000 7f6720b9f640 1 -- 172.21.15.38:0/2446915218 shutdown_connections 2023-12-22T08:47:50.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.558+0000 7f6720b9f640 1 -- 172.21.15.38:0/2446915218 wait complete. 2023-12-22T08:47:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.560+0000 7f6720b9f640 1 Processor -- start 2023-12-22T08:47:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.560+0000 7f6720b9f640 1 -- start start 2023-12-22T08:47:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.561+0000 7f6720b9f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0b2590 0x7f671c15f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.561+0000 7f6720b9f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c144d10 0x7f671c13a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.561+0000 7f6720b9f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f671c06c190 0x7f671c06c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.561+0000 7f6720b9f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c15cb80 con 0x7f671c144d10 2023-12-22T08:47:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.561+0000 7f6720b9f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671c15d140 con 0x7f671c06c190 2023-12-22T08:47:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.561+0000 7f6720b9f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671c06cc50 con 0x7f671c0b2590 2023-12-22T08:47:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.561+0000 7f6713fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c144d10 0x7f671c13a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.561+0000 7f6713fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c144d10 0x7f671c13a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60148/0 (socket says 172.21.15.38:60148) 2023-12-22T08:47:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.561+0000 7f6713fff640 1 -- 172.21.15.38:0/3513234703 learned_addr learned my addr 172.21.15.38:0/3513234703 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f671a59c640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0b2590 0x7f671c15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f671ad9d640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f671c06c190 0x7f671c06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f6713fff640 1 -- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0b2590 msgr2=0x7f671c15f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f6713fff640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0b2590 0x7f671c15f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f6713fff640 1 -- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f671c06c190 msgr2=0x7f671c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f6713fff640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f671c06c190 0x7f671c06c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f6713fff640 1 -- 172.21.15.38:0/3513234703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c0094d0 con 0x7f671c144d10 2023-12-22T08:47:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f671ad9d640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f671c06c190 0x7f671c06c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f671a59c640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0b2590 0x7f671c15f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f6713fff640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c144d10 0x7f671c13a350 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f670400c7f0 tx=0x7f670400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f6712ffd640 1 -- 172.21.15.38:0/3513234703 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670400cea0 con 0x7f671c144d10 2023-12-22T08:47:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f6712ffd640 1 -- 172.21.15.38:0/3513234703 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6704007a30 con 0x7f671c144d10 2023-12-22T08:47:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f6720b9f640 1 -- 172.21.15.38:0/3513234703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671c06cf30 con 0x7f671c144d10 2023-12-22T08:47:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.562+0000 7f6712ffd640 1 -- 172.21.15.38:0/3513234703 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704007dc0 con 0x7f671c144d10 2023-12-22T08:47:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.563+0000 7f6720b9f640 1 -- 172.21.15.38:0/3513234703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671c15f960 con 0x7f671c144d10 2023-12-22T08:47:50.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.564+0000 7f6720b9f640 1 -- 172.21.15.38:0/3513234703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671c15d2b0 con 0x7f671c144d10 2023-12-22T08:47:50.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.565+0000 7f6712ffd640 1 -- 172.21.15.38:0/3513234703 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f67040113f0 con 0x7f671c144d10 2023-12-22T08:47:50.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.566+0000 7f6712ffd640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f66fc06a460 0x7f66fc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:50.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.566+0000 7f6712ffd640 1 -- 172.21.15.38:0/3513234703 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6704088a40 con 0x7f671c144d10 2023-12-22T08:47:50.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.566+0000 7f671a59c640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f66fc06a460 0x7f66fc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:50.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.568+0000 7f671a59c640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f66fc06a460 0x7f66fc06c920 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f670c036000 tx=0x7f670c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:50.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.570+0000 7f6712ffd640 1 -- 172.21.15.38:0/3513234703 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6704054020 con 0x7f671c144d10 2023-12-22T08:47:50.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.768+0000 7f6720b9f640 1 -- 172.21.15.38:0/3513234703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f671c061910 con 0x7f671c144d10 2023-12-22T08:47:50.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.771+0000 7f6712ffd640 1 -- 172.21.15.38:0/3513234703 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+16081 (secure 0 0 0) 0x7f670401f090 con 0x7f671c144d10 2023-12-22T08:47:50.773 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:50.773 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":141,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:50.321492+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:48.219096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:49.341846+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:50.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.775+0000 7f6720b9f640 1 -- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f66fc06a460 msgr2=0x7f66fc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:50.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.775+0000 7f6720b9f640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f66fc06a460 0x7f66fc06c920 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f670c036000 tx=0x7f670c03c040 comp rx=0 tx=0).stop 2023-12-22T08:47:50.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.775+0000 7f6720b9f640 1 -- 172.21.15.38:0/3513234703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c144d10 msgr2=0x7f671c13a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:50.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.775+0000 7f6720b9f640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c144d10 0x7f671c13a350 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f670400c7f0 tx=0x7f670400ccb0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.775+0000 7f6720b9f640 1 -- 172.21.15.38:0/3513234703 shutdown_connections 2023-12-22T08:47:50.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.775+0000 7f6720b9f640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f671c06c190 0x7f671c06c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.775+0000 7f6720b9f640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f66fc06a460 0x7f66fc06c920 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.775+0000 7f6720b9f640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c144d10 0x7f671c13a350 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.775+0000 7f6720b9f640 1 --2- 172.21.15.38:0/3513234703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f671c0b2590 0x7f671c15f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:50.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.775+0000 7f6720b9f640 1 -- 172.21.15.38:0/3513234703 >> 172.21.15.38:0/3513234703 conn(0x7f671c0cf070 msgr2=0x7f671c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:50.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.775+0000 7f6720b9f640 1 -- 172.21.15.38:0/3513234703 shutdown_connections 2023-12-22T08:47:50.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:50.775+0000 7f6720b9f640 1 -- 172.21.15.38:0/3513234703 wait complete. 2023-12-22T08:47:50.796 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:51.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.015+0000 7f36c22b6640 1 Processor -- start 2023-12-22T08:47:51.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.015+0000 7f36c22b6640 1 -- start start 2023-12-22T08:47:51.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.017+0000 7f36c22b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36bc144d10 0x7f36bc0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:51.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.017+0000 7f36c22b6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f36bc0b2760 0x7f36bc070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:51.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.017+0000 7f36c22b6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36bc1450f0 con 0x7f36bc0cc670 2023-12-22T08:47:51.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.017+0000 7f36c22b6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36bc0ce010 con 0x7f36bc0b2760 2023-12-22T08:47:51.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.017+0000 7f36c22b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0ce2f0 con 0x7f36bc144d10 2023-12-22T08:47:51.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.017+0000 7f36c0853640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f36bc0b2760 0x7f36bc070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:51.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.017+0000 7f36c0853640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f36bc0b2760 0x7f36bc070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36924/0 (socket says 172.21.15.38:36924) 2023-12-22T08:47:51.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.017+0000 7f36c0853640 1 -- 172.21.15.38:0/3082127651 learned_addr learned my addr 172.21.15.38:0/3082127651 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:51.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.018+0000 7f36bbfff640 1 --2- 172.21.15.38:0/3082127651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36bc144d10 0x7f36bc0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:51.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.018+0000 7f36c0853640 1 -- 172.21.15.38:0/3082127651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36bc144d10 msgr2=0x7f36bc0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:51.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.018+0000 7f36c0853640 1 --2- 172.21.15.38:0/3082127651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36bc144d10 0x7f36bc0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.018+0000 7f36c0853640 1 -- 172.21.15.38:0/3082127651 >> v1:172.21.15.89:6789/0 conn(0x7f36bc0cc670 legacy=0x7f36bc0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:51.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.018+0000 7f36c0853640 1 -- 172.21.15.38:0/3082127651 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc0ce5d0 con 0x7f36bc0b2760 2023-12-22T08:47:51.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.019+0000 7f36c0853640 1 --2- 172.21.15.38:0/3082127651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36bc0b2760 0x7f36bc070800 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009e50 tx=0x7f36b402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467868f3fc85881 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:51.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.019+0000 7f36bb7fe640 1 -- 172.21.15.38:0/3082127651 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b402ca70 con 0x7f36bc0b2760 2023-12-22T08:47:51.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.019+0000 7f36bb7fe640 1 -- 172.21.15.38:0/3082127651 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b402cbd0 con 0x7f36bc0b2760 2023-12-22T08:47:51.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.019+0000 7f36bb7fe640 1 -- 172.21.15.38:0/3082127651 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b40343f0 con 0x7f36bc0b2760 2023-12-22T08:47:51.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.020+0000 7f36c22b6640 1 -- 172.21.15.38:0/3082127651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36bc0b2760 msgr2=0x7f36bc070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:51.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.020+0000 7f36c22b6640 1 --2- 172.21.15.38:0/3082127651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36bc0b2760 0x7f36bc070800 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009e50 tx=0x7f36b402bed0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.020+0000 7f36c22b6640 1 -- 172.21.15.38:0/3082127651 shutdown_connections 2023-12-22T08:47:51.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.020+0000 7f36c22b6640 1 --2- 172.21.15.38:0/3082127651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36bc0b2760 0x7f36bc070800 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.020+0000 7f36c22b6640 1 --2- 172.21.15.38:0/3082127651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36bc144d10 0x7f36bc0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.020+0000 7f36c22b6640 1 -- 172.21.15.38:0/3082127651 >> 172.21.15.38:0/3082127651 conn(0x7f36bc0cf070 msgr2=0x7f36bc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:51.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.020+0000 7f36c22b6640 1 -- 172.21.15.38:0/3082127651 shutdown_connections 2023-12-22T08:47:51.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.020+0000 7f36c22b6640 1 -- 172.21.15.38:0/3082127651 wait complete. 2023-12-22T08:47:51.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.022+0000 7f36c22b6640 1 Processor -- start 2023-12-22T08:47:51.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.022+0000 7f36c22b6640 1 -- start start 2023-12-22T08:47:51.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.023+0000 7f36c22b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36bc0b2760 0x7f36bc13f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:51.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.023+0000 7f36c22b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36bc144d10 0x7f36bc0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:51.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.023+0000 7f36c22b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36bc13f420 0x7f36bc0b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:51.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.023+0000 7f36c22b6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc1411a0 con 0x7f36bc0b2760 2023-12-22T08:47:51.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.023+0000 7f36c22b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0ae4d0 con 0x7f36bc13f420 2023-12-22T08:47:51.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.023+0000 7f36c22b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc13ff90 con 0x7f36bc144d10 2023-12-22T08:47:51.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.023+0000 7f36bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36bc0b2760 0x7f36bc13f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:51.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.023+0000 7f36bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36bc0b2760 0x7f36bc13f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36932/0 (socket says 172.21.15.38:36932) 2023-12-22T08:47:51.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.023+0000 7f36bbfff640 1 -- 172.21.15.38:0/3630086548 learned_addr learned my addr 172.21.15.38:0/3630086548 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:51.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.024+0000 7f36b3fff640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36bc144d10 0x7f36bc0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:51.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.024+0000 7f36c0853640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36bc13f420 0x7f36bc0b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:51.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.024+0000 7f36bbfff640 1 -- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36bc144d10 msgr2=0x7f36bc0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:51.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.024+0000 7f36bbfff640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36bc144d10 0x7f36bc0b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.024+0000 7f36bbfff640 1 -- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36bc13f420 msgr2=0x7f36bc0b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:51.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.024+0000 7f36bbfff640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36bc13f420 0x7f36bc0b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.024+0000 7f36bbfff640 1 -- 172.21.15.38:0/3630086548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b4009b30 con 0x7f36bc0b2760 2023-12-22T08:47:51.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.024+0000 7f36b3fff640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36bc144d10 0x7f36bc0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:51.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.024+0000 7f36bbfff640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36bc0b2760 0x7f36bc13f890 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00d620 tx=0x7f36ac00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:51.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.024+0000 7f36b97fa640 1 -- 172.21.15.38:0/3630086548 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00b620 con 0x7f36bc0b2760 2023-12-22T08:47:51.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.024+0000 7f36b97fa640 1 -- 172.21.15.38:0/3630086548 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac00b780 con 0x7f36bc0b2760 2023-12-22T08:47:51.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.025+0000 7f36b97fa640 1 -- 172.21.15.38:0/3630086548 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00bb30 con 0x7f36bc0b2760 2023-12-22T08:47:51.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.025+0000 7f36c22b6640 1 -- 172.21.15.38:0/3630086548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36bc140270 con 0x7f36bc0b2760 2023-12-22T08:47:51.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.025+0000 7f36c22b6640 1 -- 172.21.15.38:0/3630086548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36bc140830 con 0x7f36bc0b2760 2023-12-22T08:47:51.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.026+0000 7f36c22b6640 1 -- 172.21.15.38:0/3630086548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36bc061910 con 0x7f36bc0b2760 2023-12-22T08:47:51.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.027+0000 7f36b97fa640 1 -- 172.21.15.38:0/3630086548 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f36ac00bc90 con 0x7f36bc0b2760 2023-12-22T08:47:51.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.028+0000 7f36b97fa640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f369c06a430 0x7f369c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:51.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.028+0000 7f36b97fa640 1 -- 172.21.15.38:0/3630086548 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36ac088e80 con 0x7f36bc0b2760 2023-12-22T08:47:51.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.028+0000 7f36b3fff640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f369c06a430 0x7f369c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:51.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.030+0000 7f36b3fff640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f369c06a430 0x7f369c06c8f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f36bc1f6020 tx=0x7f36a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:51.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.032+0000 7f36b97fa640 1 -- 172.21.15.38:0/3630086548 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f36ac0543d0 con 0x7f36bc0b2760 2023-12-22T08:47:51.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.224+0000 7f36c22b6640 1 -- 172.21.15.38:0/3630086548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36bc0cb8e0 con 0x7f36bc0b2760 2023-12-22T08:47:51.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.226+0000 7f36b97fa640 1 -- 172.21.15.38:0/3630086548 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+16081 (secure 0 0 0) 0x7f36ac0579f0 con 0x7f36bc0b2760 2023-12-22T08:47:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:51.228 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":141,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:50.321492+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:48.219096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:49.341846+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:51.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.228+0000 7f36c22b6640 1 -- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f369c06a430 msgr2=0x7f369c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:51.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.228+0000 7f36c22b6640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f369c06a430 0x7f369c06c8f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f36bc1f6020 tx=0x7f36a4009040 comp rx=0 tx=0).stop 2023-12-22T08:47:51.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.228+0000 7f36c22b6640 1 -- 172.21.15.38:0/3630086548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36bc0b2760 msgr2=0x7f36bc13f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:51.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.228+0000 7f36c22b6640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36bc0b2760 0x7f36bc13f890 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00d620 tx=0x7f36ac00dae0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.229+0000 7f36c22b6640 1 -- 172.21.15.38:0/3630086548 shutdown_connections 2023-12-22T08:47:51.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.229+0000 7f36c22b6640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36bc13f420 0x7f36bc0b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.229+0000 7f36c22b6640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36bc144d10 0x7f36bc0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.229+0000 7f36c22b6640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f369c06a430 0x7f369c06c8f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.229+0000 7f36c22b6640 1 --2- 172.21.15.38:0/3630086548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f36bc0b2760 0x7f36bc13f890 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.229+0000 7f36c22b6640 1 -- 172.21.15.38:0/3630086548 >> 172.21.15.38:0/3630086548 conn(0x7f36bc0cf070 msgr2=0x7f36bc0af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:51.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.229+0000 7f36c22b6640 1 -- 172.21.15.38:0/3630086548 shutdown_connections 2023-12-22T08:47:51.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.229+0000 7f36c22b6640 1 -- 172.21.15.38:0/3630086548 wait complete. 2023-12-22T08:47:51.249 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T08:47:51.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.453+0000 7f07c70e2640 1 Processor -- start 2023-12-22T08:47:51.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.453+0000 7f07c70e2640 1 -- start start 2023-12-22T08:47:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.455+0000 7f07c70e2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f07c0146e40 0x7f07c00cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.455+0000 7f07c70e2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f07c0161df0 0x7f07c01611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.455+0000 7f07c70e2640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c0161b40 con 0x7f07c0161700 2023-12-22T08:47:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.455+0000 7f07c70e2640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c00b4da0 con 0x7f07c0161df0 2023-12-22T08:47:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.455+0000 7f07c70e2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c00b4120 con 0x7f07c0146e40 2023-12-22T08:47:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.455+0000 7f07bffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f07c0161df0 0x7f07c01611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.455+0000 7f07c567f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f07c0161700 0x7f07c006cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:35880/0 (socket says 172.21.15.38:35880) 2023-12-22T08:47:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.455+0000 7f07c567f640 1 -- 172.21.15.38:0/2522881979 learned_addr learned my addr 172.21.15.38:0/2522881979 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:51.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.456+0000 7f07c4e7e640 1 --2- 172.21.15.38:0/2522881979 >> v2:172.21.15.89:3300/0 conn(0x7f07c0146e40 0x7f07c00cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:51.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.456+0000 7f07bffff640 1 -- 172.21.15.38:0/2522881979 >> v2:172.21.15.89:3300/0 conn(0x7f07c0146e40 msgr2=0x7f07c00cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:51.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.456+0000 7f07bffff640 1 --2- 172.21.15.38:0/2522881979 >> v2:172.21.15.89:3300/0 conn(0x7f07c0146e40 0x7f07c00cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.456+0000 7f07bffff640 1 -- 172.21.15.38:0/2522881979 >> v1:172.21.15.38:6789/0 conn(0x7f07c0161700 legacy=0x7f07c006cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:51.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.456+0000 7f07bffff640 1 -- 172.21.15.38:0/2522881979 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c00b4400 con 0x7f07c0161df0 2023-12-22T08:47:51.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.457+0000 7f07bffff640 1 --2- 172.21.15.38:0/2522881979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c0161df0 0x7f07c01611c0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f07c006c620 tx=0x7f07b402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842b254f489288f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:51.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.457+0000 7f07bf7fe640 1 -- 172.21.15.38:0/2522881979 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b402f050 con 0x7f07c0161df0 2023-12-22T08:47:51.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.457+0000 7f07bf7fe640 1 -- 172.21.15.38:0/2522881979 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b4031700 con 0x7f07c0161df0 2023-12-22T08:47:51.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.457+0000 7f07bf7fe640 1 -- 172.21.15.38:0/2522881979 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b4031a90 con 0x7f07c0161df0 2023-12-22T08:47:51.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.458+0000 7f07c70e2640 1 -- 172.21.15.38:0/2522881979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c0161df0 msgr2=0x7f07c01611c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:51.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.458+0000 7f07c70e2640 1 --2- 172.21.15.38:0/2522881979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c0161df0 0x7f07c01611c0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f07c006c620 tx=0x7f07b402b7a0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.458+0000 7f07c70e2640 1 -- 172.21.15.38:0/2522881979 shutdown_connections 2023-12-22T08:47:51.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.458+0000 7f07c70e2640 1 --2- 172.21.15.38:0/2522881979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c0161df0 0x7f07c01611c0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.458+0000 7f07c70e2640 1 --2- 172.21.15.38:0/2522881979 >> v2:172.21.15.89:3300/0 conn(0x7f07c0146e40 0x7f07c00cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.458+0000 7f07c70e2640 1 -- 172.21.15.38:0/2522881979 >> 172.21.15.38:0/2522881979 conn(0x7f07c00cff10 msgr2=0x7f07c00d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:51.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.458+0000 7f07c70e2640 1 -- 172.21.15.38:0/2522881979 shutdown_connections 2023-12-22T08:47:51.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.458+0000 7f07c70e2640 1 -- 172.21.15.38:0/2522881979 wait complete. 2023-12-22T08:47:51.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.460+0000 7f07c70e2640 1 Processor -- start 2023-12-22T08:47:51.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.460+0000 7f07c70e2640 1 -- start start 2023-12-22T08:47:51.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.461+0000 7f07c70e2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c0146e40 0x7f07c015c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:51.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.461+0000 7f07c70e2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c0161700 0x7f07c0141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:51.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.461+0000 7f07c70e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c0161df0 0x7f07c0141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:51.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.461+0000 7f07c70e2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0142750 con 0x7f07c0146e40 2023-12-22T08:47:51.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.461+0000 7f07c70e2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0141eb0 con 0x7f07c0161df0 2023-12-22T08:47:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.461+0000 7f07c70e2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0142190 con 0x7f07c0161700 2023-12-22T08:47:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.461+0000 7f07c4e7e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c0146e40 0x7f07c015c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.461+0000 7f07c4e7e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c0146e40 0x7f07c015c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36956/0 (socket says 172.21.15.38:36956) 2023-12-22T08:47:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.461+0000 7f07c4e7e640 1 -- 172.21.15.38:0/720528203 learned_addr learned my addr 172.21.15.38:0/720528203 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.462+0000 7f07bffff640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c0161700 0x7f07c0141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.462+0000 7f07c567f640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c0161df0 0x7f07c0141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.462+0000 7f07c4e7e640 1 -- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c0161700 msgr2=0x7f07c0141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.462+0000 7f07c4e7e640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c0161700 0x7f07c0141340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.462+0000 7f07c4e7e640 1 -- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c0161df0 msgr2=0x7f07c0141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.462+0000 7f07c4e7e640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c0161df0 0x7f07c0141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.462+0000 7f07c4e7e640 1 -- 172.21.15.38:0/720528203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b40093a0 con 0x7f07c0146e40 2023-12-22T08:47:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.462+0000 7f07c567f640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c0161df0 0x7f07c0141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:51.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.462+0000 7f07c4e7e640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c0146e40 0x7f07c015c780 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f07b0007e40 tx=0x7f07b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:51.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.463+0000 7f07bd7fa640 1 -- 172.21.15.38:0/720528203 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0014620 con 0x7f07c0146e40 2023-12-22T08:47:51.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.463+0000 7f07bd7fa640 1 -- 172.21.15.38:0/720528203 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b000ee90 con 0x7f07c0146e40 2023-12-22T08:47:51.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.463+0000 7f07bd7fa640 1 -- 172.21.15.38:0/720528203 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00149c0 con 0x7f07c0146e40 2023-12-22T08:47:51.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.463+0000 7f07c70e2640 1 -- 172.21.15.38:0/720528203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c0142470 con 0x7f07c0146e40 2023-12-22T08:47:51.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.463+0000 7f07c70e2640 1 -- 172.21.15.38:0/720528203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c015ccc0 con 0x7f07c0146e40 2023-12-22T08:47:51.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.464+0000 7f07c70e2640 1 -- 172.21.15.38:0/720528203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c0061910 con 0x7f07c0146e40 2023-12-22T08:47:51.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.465+0000 7f07bd7fa640 1 -- 172.21.15.38:0/720528203 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f07b0014b20 con 0x7f07c0146e40 2023-12-22T08:47:51.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.466+0000 7f07bd7fa640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f07ac06a430 0x7f07ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:51.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.466+0000 7f07bd7fa640 1 -- 172.21.15.38:0/720528203 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07b0089290 con 0x7f07c0146e40 2023-12-22T08:47:51.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.467+0000 7f07bffff640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f07ac06a430 0x7f07ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:51.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.468+0000 7f07bffff640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f07ac06a430 0x7f07ac06c8f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f07b4035000 tx=0x7f07b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:51.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.471+0000 7f07bd7fa640 1 -- 172.21.15.38:0/720528203 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f07b0054870 con 0x7f07c0146e40 2023-12-22T08:47:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:51.700+0000 7f07c70e2640 1 -- 172.21.15.38:0/720528203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f07c01611e0 con 0x7f07c0146e40 2023-12-22T08:47:52.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.344+0000 7f07bd7fa640 1 -- 172.21.15.38:0/720528203 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) v1 ==== 118+0+0 (secure 0 0 0) 0x7f07b0057e90 con 0x7f07c0146e40 2023-12-22T08:47:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.348+0000 7f07c70e2640 1 -- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f07ac06a430 msgr2=0x7f07ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.348+0000 7f07c70e2640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f07ac06a430 0x7f07ac06c8f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f07b4035000 tx=0x7f07b4008030 comp rx=0 tx=0).stop 2023-12-22T08:47:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.348+0000 7f07c70e2640 1 -- 172.21.15.38:0/720528203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c0146e40 msgr2=0x7f07c015c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.348+0000 7f07c70e2640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c0146e40 0x7f07c015c780 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f07b0007e40 tx=0x7f07b000e4b0 comp rx=0 tx=0).stop 2023-12-22T08:47:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.348+0000 7f07c70e2640 1 -- 172.21.15.38:0/720528203 shutdown_connections 2023-12-22T08:47:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.348+0000 7f07c70e2640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07c0161df0 0x7f07c0141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.348+0000 7f07c70e2640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07c0161700 0x7f07c0141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.348+0000 7f07c70e2640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f07ac06a430 0x7f07ac06c8f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.348+0000 7f07c70e2640 1 --2- 172.21.15.38:0/720528203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07c0146e40 0x7f07c015c780 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.348+0000 7f07c70e2640 1 -- 172.21.15.38:0/720528203 >> 172.21.15.38:0/720528203 conn(0x7f07c00cff10 msgr2=0x7f07c00709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.348+0000 7f07c70e2640 1 -- 172.21.15.38:0/720528203 shutdown_connections 2023-12-22T08:47:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.348+0000 7f07c70e2640 1 -- 172.21.15.38:0/720528203 wait complete. 2023-12-22T08:47:52.371 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T08:47:52.371 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T08:47:52.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.598+0000 7fc0f69d9640 1 Processor -- start 2023-12-22T08:47:52.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.598+0000 7fc0f69d9640 1 -- start start 2023-12-22T08:47:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.599+0000 7fc0f69d9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f0144d10 0x7fc0f00cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.599+0000 7fc0f69d9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc0f00b2760 0x7fc0f0070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.599+0000 7fc0f69d9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f01450f0 con 0x7fc0f00cc670 2023-12-22T08:47:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.599+0000 7fc0f69d9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f00ce010 con 0x7fc0f00b2760 2023-12-22T08:47:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.599+0000 7fc0f69d9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00ce2f0 con 0x7fc0f0144d10 2023-12-22T08:47:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.600+0000 7fc0e7fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc0f00cc670 0x7fc0f00b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:35888/0 (socket says 172.21.15.38:35888) 2023-12-22T08:47:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.600+0000 7fc0e7fff640 1 -- 172.21.15.38:0/99734530 learned_addr learned my addr 172.21.15.38:0/99734530 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.600+0000 7fc0f4f76640 1 --2- 172.21.15.38:0/99734530 >> v2:172.21.15.38:3300/0 conn(0x7fc0f00b2760 0x7fc0f0070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.600+0000 7fc0effff640 1 --2- 172.21.15.38:0/99734530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f0144d10 0x7fc0f00cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.600+0000 7fc0f4f76640 1 -- 172.21.15.38:0/99734530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f0144d10 msgr2=0x7fc0f00cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.600+0000 7fc0f4f76640 1 --2- 172.21.15.38:0/99734530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f0144d10 0x7fc0f00cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.600+0000 7fc0f4f76640 1 -- 172.21.15.38:0/99734530 >> v1:172.21.15.38:6789/0 conn(0x7fc0f00cc670 legacy=0x7fc0f00b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.600+0000 7fc0f4f76640 1 -- 172.21.15.38:0/99734530 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f00ce5d0 con 0x7fc0f00b2760 2023-12-22T08:47:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.602+0000 7fc0f4f76640 1 --2- 172.21.15.38:0/99734530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0f00b2760 0x7fc0f0070800 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009d90 tx=0x7fc0e802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168ebac50ed524bc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.602+0000 7fc0ef7fe640 1 -- 172.21.15.38:0/99734530 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e802cc60 con 0x7fc0f00b2760 2023-12-22T08:47:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.602+0000 7fc0ef7fe640 1 -- 172.21.15.38:0/99734530 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e802cdc0 con 0x7fc0f00b2760 2023-12-22T08:47:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.602+0000 7fc0ef7fe640 1 -- 172.21.15.38:0/99734530 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8034660 con 0x7fc0f00b2760 2023-12-22T08:47:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.602+0000 7fc0f69d9640 1 -- 172.21.15.38:0/99734530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0f00b2760 msgr2=0x7fc0f0070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.602+0000 7fc0f69d9640 1 --2- 172.21.15.38:0/99734530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0f00b2760 0x7fc0f0070800 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009d90 tx=0x7fc0e802beb0 comp rx=0 tx=0).stop 2023-12-22T08:47:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.603+0000 7fc0f69d9640 1 -- 172.21.15.38:0/99734530 shutdown_connections 2023-12-22T08:47:52.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.603+0000 7fc0f69d9640 1 --2- 172.21.15.38:0/99734530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0f00b2760 0x7fc0f0070800 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.603+0000 7fc0f69d9640 1 --2- 172.21.15.38:0/99734530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f0144d10 0x7fc0f00cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.603+0000 7fc0f69d9640 1 -- 172.21.15.38:0/99734530 >> 172.21.15.38:0/99734530 conn(0x7fc0f00cf070 msgr2=0x7fc0f00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.603+0000 7fc0f69d9640 1 -- 172.21.15.38:0/99734530 shutdown_connections 2023-12-22T08:47:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.603+0000 7fc0f69d9640 1 -- 172.21.15.38:0/99734530 wait complete. 2023-12-22T08:47:52.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.605+0000 7fc0f69d9640 1 Processor -- start 2023-12-22T08:47:52.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.605+0000 7fc0f69d9640 1 -- start start 2023-12-22T08:47:52.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.606+0000 7fc0f69d9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f00b2760 0x7fc0f0140660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:52.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.606+0000 7fc0f69d9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f0144d10 0x7fc0f00ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:52.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.606+0000 7fc0f69d9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0f00a9070 0x7fc0f01f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:52.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.606+0000 7fc0f69d9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f01f4680 con 0x7fc0f00a9070 2023-12-22T08:47:52.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.606+0000 7fc0f69d9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f01f4960 con 0x7fc0f0144d10 2023-12-22T08:47:52.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.606+0000 7fc0f69d9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f01f4c40 con 0x7fc0f00b2760 2023-12-22T08:47:52.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.606+0000 7fc0f4f76640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0f00a9070 0x7fc0f01f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:52.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.606+0000 7fc0f4f76640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0f00a9070 0x7fc0f01f5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36986/0 (socket says 172.21.15.38:36986) 2023-12-22T08:47:52.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.606+0000 7fc0f4f76640 1 -- 172.21.15.38:0/1829121395 learned_addr learned my addr 172.21.15.38:0/1829121395 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.606+0000 7fc0f4f76640 1 -- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f00b2760 msgr2=0x7fc0f0140660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.606+0000 7fc0effff640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f00b2760 0x7fc0f0140660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.606+0000 7fc0e7fff640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f0144d10 0x7fc0f00ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.606+0000 7fc0f4f76640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f00b2760 0x7fc0f0140660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:52.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.607+0000 7fc0f4f76640 1 -- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f0144d10 msgr2=0x7fc0f00ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:52.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.607+0000 7fc0f4f76640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f0144d10 0x7fc0f00ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:52.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.607+0000 7fc0f4f76640 1 -- 172.21.15.38:0/1829121395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e8009a70 con 0x7fc0f00a9070 2023-12-22T08:47:52.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.607+0000 7fc0f4f76640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0f00a9070 0x7fc0f01f5720 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009d90 tx=0x7fc0e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:52.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.607+0000 7fc0ed7fa640 1 -- 172.21.15.38:0/1829121395 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8040650 con 0x7fc0f00a9070 2023-12-22T08:47:52.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.607+0000 7fc0ed7fa640 1 -- 172.21.15.38:0/1829121395 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e80407d0 con 0x7fc0f00a9070 2023-12-22T08:47:52.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.607+0000 7fc0ed7fa640 1 -- 172.21.15.38:0/1829121395 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8040b80 con 0x7fc0f00a9070 2023-12-22T08:47:52.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.607+0000 7fc0f69d9640 1 -- 172.21.15.38:0/1829121395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f01f4f20 con 0x7fc0f00a9070 2023-12-22T08:47:52.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.608+0000 7fc0f69d9640 1 -- 172.21.15.38:0/1829121395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f00ae680 con 0x7fc0f00a9070 2023-12-22T08:47:52.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.609+0000 7fc0f69d9640 1 -- 172.21.15.38:0/1829121395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f01f5440 con 0x7fc0f00a9070 2023-12-22T08:47:52.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.610+0000 7fc0ed7fa640 1 -- 172.21.15.38:0/1829121395 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc0e8040ce0 con 0x7fc0f00a9070 2023-12-22T08:47:52.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.611+0000 7fc0ed7fa640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc0d006a460 0x7fc0d006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:52.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.611+0000 7fc0ed7fa640 1 -- 172.21.15.38:0/1829121395 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0e80ab7e0 con 0x7fc0f00a9070 2023-12-22T08:47:52.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.611+0000 7fc0effff640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc0d006a460 0x7fc0d006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:52.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.613+0000 7fc0effff640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc0d006a460 0x7fc0d006c920 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0006fd0 tx=0x7fc0e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:52.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.615+0000 7fc0ed7fa640 1 -- 172.21.15.38:0/1829121395 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc0f01f5440 con 0x7fc0f00a9070 2023-12-22T08:47:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:52.839+0000 7fc0f69d9640 1 -- 172.21.15.38:0/1829121395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc0f01f5440 con 0x7fc0f00a9070 2023-12-22T08:47:53.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.357+0000 7fc0ed7fa640 1 -- 172.21.15.38:0/1829121395 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc0f01f5440 con 0x7fc0f00a9070 2023-12-22T08:47:53.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.361+0000 7fc0f69d9640 1 -- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc0d006a460 msgr2=0x7fc0d006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:53.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.361+0000 7fc0f69d9640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc0d006a460 0x7fc0d006c920 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0006fd0 tx=0x7fc0e0008040 comp rx=0 tx=0).stop 2023-12-22T08:47:53.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.361+0000 7fc0f69d9640 1 -- 172.21.15.38:0/1829121395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0f00a9070 msgr2=0x7fc0f01f5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:53.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.361+0000 7fc0f69d9640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0f00a9070 0x7fc0f01f5720 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009d90 tx=0x7fc0e8004a40 comp rx=0 tx=0).stop 2023-12-22T08:47:53.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.361+0000 7fc0f69d9640 1 -- 172.21.15.38:0/1829121395 shutdown_connections 2023-12-22T08:47:53.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.361+0000 7fc0f69d9640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc0d006a460 0x7fc0d006c920 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:53.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.361+0000 7fc0f69d9640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc0f00a9070 0x7fc0f01f5720 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:53.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.361+0000 7fc0f69d9640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0f0144d10 0x7fc0f00ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:53.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.361+0000 7fc0f69d9640 1 --2- 172.21.15.38:0/1829121395 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0f00b2760 0x7fc0f0140660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:53.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.361+0000 7fc0f69d9640 1 -- 172.21.15.38:0/1829121395 >> 172.21.15.38:0/1829121395 conn(0x7fc0f00cf070 msgr2=0x7fc0f00b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:53.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.361+0000 7fc0f69d9640 1 -- 172.21.15.38:0/1829121395 shutdown_connections 2023-12-22T08:47:53.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.361+0000 7fc0f69d9640 1 -- 172.21.15.38:0/1829121395 wait complete. 2023-12-22T08:47:53.382 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T08:47:53.382 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:47:53.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.598+0000 7f03653d2640 1 Processor -- start 2023-12-22T08:47:53.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.599+0000 7f03653d2640 1 -- start start 2023-12-22T08:47:53.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.601+0000 7f03653d2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036015e740 0x7f036015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:53.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.601+0000 7f03653d2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f036006ca50 0x7f03600b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:53.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.601+0000 7f03653d2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03600b4210 con 0x7f03600b3dc0 2023-12-22T08:47:53.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.601+0000 7f03653d2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036006e650 con 0x7f036006ca50 2023-12-22T08:47:53.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.601+0000 7f03653d2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036015eb20 con 0x7f036015e740 2023-12-22T08:47:53.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.601+0000 7f035effd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036015e740 0x7f036015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:53.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.602+0000 7f0357fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f036006ca50 0x7f03600b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:53.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.602+0000 7f035effd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036015e740 0x7f036015db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:36634/0 (socket says 172.21.15.38:36634) 2023-12-22T08:47:53.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.602+0000 7f035effd640 1 -- 172.21.15.38:0/3904408881 learned_addr learned my addr 172.21.15.38:0/3904408881 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:53.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.602+0000 7f035effd640 1 -- 172.21.15.38:0/3904408881 >> v2:172.21.15.89:3300/0 conn(0x7f036006ca50 msgr2=0x7f03600b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:53.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.602+0000 7f035effd640 1 --2- 172.21.15.38:0/3904408881 >> v2:172.21.15.89:3300/0 conn(0x7f036006ca50 0x7f03600b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:53.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.602+0000 7f035effd640 1 -- 172.21.15.38:0/3904408881 >> v1:172.21.15.89:6789/0 conn(0x7f03600b3dc0 legacy=0x7f0360161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:53.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.602+0000 7f035effd640 1 -- 172.21.15.38:0/3904408881 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0360070770 con 0x7f036015e740 2023-12-22T08:47:53.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.604+0000 7f035effd640 1 --2- 172.21.15.38:0/3904408881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036015e740 0x7f036015db30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0350009870 tx=0x7f035002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76a2f5e82ef2d0a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:53.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.604+0000 7f035e7fc640 1 -- 172.21.15.38:0/3904408881 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500317c0 con 0x7f036015e740 2023-12-22T08:47:53.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.604+0000 7f035e7fc640 1 -- 172.21.15.38:0/3904408881 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0350031920 con 0x7f036015e740 2023-12-22T08:47:53.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.604+0000 7f035e7fc640 1 -- 172.21.15.38:0/3904408881 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350031cb0 con 0x7f036015e740 2023-12-22T08:47:53.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.605+0000 7f03653d2640 1 -- 172.21.15.38:0/3904408881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036015e740 msgr2=0x7f036015db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:53.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.605+0000 7f03653d2640 1 --2- 172.21.15.38:0/3904408881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036015e740 0x7f036015db30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0350009870 tx=0x7f035002b860 comp rx=0 tx=0).stop 2023-12-22T08:47:53.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.605+0000 7f03653d2640 1 -- 172.21.15.38:0/3904408881 shutdown_connections 2023-12-22T08:47:53.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.605+0000 7f03653d2640 1 --2- 172.21.15.38:0/3904408881 >> v2:172.21.15.89:3300/0 conn(0x7f036006ca50 0x7f03600b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:53.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.605+0000 7f03653d2640 1 --2- 172.21.15.38:0/3904408881 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036015e740 0x7f036015db30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:53.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.605+0000 7f03653d2640 1 -- 172.21.15.38:0/3904408881 >> 172.21.15.38:0/3904408881 conn(0x7f03600cfea0 msgr2=0x7f03600d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:53.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.605+0000 7f03653d2640 1 -- 172.21.15.38:0/3904408881 shutdown_connections 2023-12-22T08:47:53.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.605+0000 7f03653d2640 1 -- 172.21.15.38:0/3904408881 wait complete. 2023-12-22T08:47:53.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.607+0000 7f03653d2640 1 Processor -- start 2023-12-22T08:47:53.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.608+0000 7f03653d2640 1 -- start start 2023-12-22T08:47:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.609+0000 7f03653d2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036006ca50 0x7f036015a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.609+0000 7f03653d2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03600b3dc0 0x7f0360154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.609+0000 7f03653d2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f036015e740 0x7f0360145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.609+0000 7f03653d2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036015af20 con 0x7f03600b3dc0 2023-12-22T08:47:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.609+0000 7f03653d2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0360143b40 con 0x7f036015e740 2023-12-22T08:47:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.609+0000 7f03653d2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036015c620 con 0x7f036006ca50 2023-12-22T08:47:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.609+0000 7f0357fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03600b3dc0 0x7f0360154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.609+0000 7f0357fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03600b3dc0 0x7f0360154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37000/0 (socket says 172.21.15.38:37000) 2023-12-22T08:47:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.609+0000 7f0357fff640 1 -- 172.21.15.38:0/3192734510 learned_addr learned my addr 172.21.15.38:0/3192734510 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.610+0000 7f035effd640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036006ca50 0x7f036015a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.610+0000 7f035f7fe640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f036015e740 0x7f0360145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.610+0000 7f0357fff640 1 -- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036006ca50 msgr2=0x7f036015a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.610+0000 7f0357fff640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036006ca50 0x7f036015a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.610+0000 7f0357fff640 1 -- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f036015e740 msgr2=0x7f0360145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.610+0000 7f0357fff640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f036015e740 0x7f0360145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.610+0000 7f0357fff640 1 -- 172.21.15.38:0/3192734510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500094d0 con 0x7f03600b3dc0 2023-12-22T08:47:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.610+0000 7f035f7fe640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f036015e740 0x7f0360145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.610+0000 7f0357fff640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03600b3dc0 0x7f0360154c30 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f034800e9b0 tx=0x7f034800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.610+0000 7f03577fe640 1 -- 172.21.15.38:0/3192734510 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348009670 con 0x7f03600b3dc0 2023-12-22T08:47:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.610+0000 7f03577fe640 1 -- 172.21.15.38:0/3192734510 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034800c9a0 con 0x7f03600b3dc0 2023-12-22T08:47:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.610+0000 7f03577fe640 1 -- 172.21.15.38:0/3192734510 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034800cd50 con 0x7f03600b3dc0 2023-12-22T08:47:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.610+0000 7f03653d2640 1 -- 172.21.15.38:0/3192734510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036015c900 con 0x7f03600b3dc0 2023-12-22T08:47:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.611+0000 7f03653d2640 1 -- 172.21.15.38:0/3192734510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036015cec0 con 0x7f03600b3dc0 2023-12-22T08:47:53.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.612+0000 7f03653d2640 1 -- 172.21.15.38:0/3192734510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0360061910 con 0x7f03600b3dc0 2023-12-22T08:47:53.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.613+0000 7f03577fe640 1 -- 172.21.15.38:0/3192734510 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0348013470 con 0x7f03600b3dc0 2023-12-22T08:47:53.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.614+0000 7f03577fe640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f034006a430 0x7f034006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:53.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.614+0000 7f03577fe640 1 -- 172.21.15.38:0/3192734510 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0348088bb0 con 0x7f03600b3dc0 2023-12-22T08:47:53.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.614+0000 7f035effd640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f034006a430 0x7f034006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:53.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.615+0000 7f035effd640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f034006a430 0x7f034006c8f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0350036000 tx=0x7f035003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:53.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.618+0000 7f03577fe640 1 -- 172.21.15.38:0/3192734510 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0348054190 con 0x7f03600b3dc0 2023-12-22T08:47:53.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.847+0000 7f03653d2640 1 -- 172.21.15.38:0/3192734510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f036006c140 con 0x7f03600b3dc0 2023-12-22T08:47:53.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.848+0000 7f03577fe640 1 -- 172.21.15.38:0/3192734510 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f0348017090 con 0x7f03600b3dc0 2023-12-22T08:47:53.850 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:53.850 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3891984223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3891984223},{"type":"v1","addr":"172.21.15.38:6834","nonce":3891984223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1561904072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1561904072},{"type":"v1","addr":"172.21.15.89:6836","nonce":1561904072}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4192516230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4192516230},{"type":"v1","addr":"172.21.15.89:6837","nonce":4192516230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:50.322298+0000","modified":"2023-12-22T08:47:53.343300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7716},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7716":{"gid":7716,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1276125280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1276125280},{"type":"v1","addr":"172.21.15.38:6835","nonce":1276125280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-22T08:47:53.850 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 62 2023-12-22T08:47:53.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.851+0000 7f03653d2640 1 -- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f034006a430 msgr2=0x7f034006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:53.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.851+0000 7f03653d2640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f034006a430 0x7f034006c8f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0350036000 tx=0x7f035003d040 comp rx=0 tx=0).stop 2023-12-22T08:47:53.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.851+0000 7f03653d2640 1 -- 172.21.15.38:0/3192734510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03600b3dc0 msgr2=0x7f0360154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:53.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.851+0000 7f03653d2640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03600b3dc0 0x7f0360154c30 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f034800e9b0 tx=0x7f034800ee70 comp rx=0 tx=0).stop 2023-12-22T08:47:53.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.851+0000 7f03653d2640 1 -- 172.21.15.38:0/3192734510 shutdown_connections 2023-12-22T08:47:53.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.851+0000 7f03653d2640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f036015e740 0x7f0360145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:53.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.851+0000 7f03653d2640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f034006a430 0x7f034006c8f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:53.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.851+0000 7f03653d2640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03600b3dc0 0x7f0360154c30 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:53.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.851+0000 7f03653d2640 1 --2- 172.21.15.38:0/3192734510 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f036006ca50 0x7f036015a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:53.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.851+0000 7f03653d2640 1 -- 172.21.15.38:0/3192734510 >> 172.21.15.38:0/3192734510 conn(0x7f03600cfea0 msgr2=0x7f0360154310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:53.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.851+0000 7f03653d2640 1 -- 172.21.15.38:0/3192734510 shutdown_connections 2023-12-22T08:47:53.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:53.851+0000 7f03653d2640 1 -- 172.21.15.38:0/3192734510 wait complete. 2023-12-22T08:47:53.871 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:47:54.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.099+0000 7f17bdeb9640 1 Processor -- start 2023-12-22T08:47:54.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.100+0000 7f17bdeb9640 1 -- start start 2023-12-22T08:47:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.101+0000 7f17bdeb9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b80ce170 0x7f17b815c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.101+0000 7f17bdeb9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f17b80b3e80 0x7f17b815f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.101+0000 7f17bdeb9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b80d0a10 con 0x7f17b80ce550 2023-12-22T08:47:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.101+0000 7f17bdeb9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b815b930 con 0x7f17b80b3e80 2023-12-22T08:47:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.101+0000 7f17bdeb9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b815feb0 con 0x7f17b80ce170 2023-12-22T08:47:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.102+0000 7f17bd6b8640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f17b80ce550 0x7f17b8144750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:35898/0 (socket says 172.21.15.38:35898) 2023-12-22T08:47:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.102+0000 7f17bd6b8640 1 -- 172.21.15.38:0/2388355515 learned_addr learned my addr 172.21.15.38:0/2388355515 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:54.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.102+0000 7f17bceb7640 1 --2- 172.21.15.38:0/2388355515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b80ce170 0x7f17b815c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.102+0000 7f17b7fff640 1 --2- 172.21.15.38:0/2388355515 >> v2:172.21.15.89:3300/0 conn(0x7f17b80b3e80 0x7f17b815f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.102+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342608249 0 0) 0x7f17b80d0a10 con 0x7f17b80ce550 2023-12-22T08:47:54.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.102+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17a0003520 con 0x7f17b80ce550 2023-12-22T08:47:54.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 119127269 0 0) 0x7f17a0003520 con 0x7f17b80ce550 2023-12-22T08:47:54.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b80ce170 msgr2=0x7f17b815c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:54.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 --2- 172.21.15.38:0/2388355515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b80ce170 0x7f17b815c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 >> v2:172.21.15.89:3300/0 conn(0x7f17b80b3e80 msgr2=0x7f17b815f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:54.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 --2- 172.21.15.38:0/2388355515 >> v2:172.21.15.89:3300/0 conn(0x7f17b80b3e80 0x7f17b815f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b80b43b0 con 0x7f17b80ce550 2023-12-22T08:47:54.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f17b0001670 con 0x7f17b80ce550 2023-12-22T08:47:54.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 >> v1:172.21.15.38:6789/0 conn(0x7f17b80ce550 legacy=0x7f17b8144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:54.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 --2- 172.21.15.38:0/2388355515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b80ce170 0x7f17a0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 --2- 172.21.15.38:0/2388355515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17a0003ef0 0x7f17a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 --2- 172.21.15.38:0/2388355515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17a0004d00 0x7f17a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b815b930 con 0x7f17a0004d00 2023-12-22T08:47:54.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b815feb0 con 0x7f17a0003ef0 2023-12-22T08:47:54.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a000b980 con 0x7f17b80ce170 2023-12-22T08:47:54.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.103+0000 7f17bd6b8640 1 --2- 172.21.15.38:0/2388355515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17a0004d00 0x7f17a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.104+0000 7f17bceb7640 1 --2- 172.21.15.38:0/2388355515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b80ce170 0x7f17a0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.104+0000 7f17b7fff640 1 --2- 172.21.15.38:0/2388355515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17a0003ef0 0x7f17a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.104+0000 7f17bd6b8640 1 -- 172.21.15.38:0/2388355515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b80ce170 msgr2=0x7f17a0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:54.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.104+0000 7f17bd6b8640 1 --2- 172.21.15.38:0/2388355515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b80ce170 0x7f17a0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.104+0000 7f17bd6b8640 1 -- 172.21.15.38:0/2388355515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17a0003ef0 msgr2=0x7f17a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:54.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.104+0000 7f17bd6b8640 1 --2- 172.21.15.38:0/2388355515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17a0003ef0 0x7f17a00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.104+0000 7f17bd6b8640 1 -- 172.21.15.38:0/2388355515 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0003520 con 0x7f17a0004d00 2023-12-22T08:47:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.105+0000 7f17bd6b8640 1 --2- 172.21.15.38:0/2388355515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17a0004d00 0x7f17a0005180 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f17b80cea00 tx=0x7f17a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9df807fb9ab6a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.105+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0005ad0 con 0x7f17a0004d00 2023-12-22T08:47:54.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.105+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b0005c30 con 0x7f17a0004d00 2023-12-22T08:47:54.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.105+0000 7f17b77fe640 1 -- 172.21.15.38:0/2388355515 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b002c880 con 0x7f17a0004d00 2023-12-22T08:47:54.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.106+0000 7f17bdeb9640 1 -- 172.21.15.38:0/2388355515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17a0004d00 msgr2=0x7f17a0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:54.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.106+0000 7f17bdeb9640 1 --2- 172.21.15.38:0/2388355515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17a0004d00 0x7f17a0005180 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f17b80cea00 tx=0x7f17a00057f0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.106+0000 7f17bd6b8640 1 -- 172.21.15.38:0/2388355515 reap_dead start 2023-12-22T08:47:54.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.106+0000 7f17bdeb9640 1 -- 172.21.15.38:0/2388355515 shutdown_connections 2023-12-22T08:47:54.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.106+0000 7f17bdeb9640 1 -- 172.21.15.38:0/2388355515 >> 172.21.15.38:0/2388355515 conn(0x7f17b80d14b0 msgr2=0x7f17b80d18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:54.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.106+0000 7f17bdeb9640 1 -- 172.21.15.38:0/2388355515 shutdown_connections 2023-12-22T08:47:54.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.106+0000 7f17bdeb9640 1 -- 172.21.15.38:0/2388355515 wait complete. 2023-12-22T08:47:54.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.108+0000 7f17bdeb9640 1 Processor -- start 2023-12-22T08:47:54.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.108+0000 7f17bdeb9640 1 -- start start 2023-12-22T08:47:54.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.109+0000 7f17bdeb9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17b806dab0 0x7f17b813ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.109+0000 7f17bdeb9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b806de90 0x7f17b81f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.109+0000 7f17bdeb9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17b813ad30 0x7f17b813b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.109+0000 7f17bdeb9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b813a930 con 0x7f17b813ad30 2023-12-22T08:47:54.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.109+0000 7f17bdeb9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b813a620 con 0x7f17b806dab0 2023-12-22T08:47:54.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.109+0000 7f17bdeb9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b81f47a0 con 0x7f17b806de90 2023-12-22T08:47:54.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.109+0000 7f17bd6b8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17b813ad30 0x7f17b813b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.109+0000 7f17bd6b8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17b813ad30 0x7f17b813b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37012/0 (socket says 172.21.15.38:37012) 2023-12-22T08:47:54.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.109+0000 7f17bd6b8640 1 -- 172.21.15.38:0/1824040405 learned_addr learned my addr 172.21.15.38:0/1824040405 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:54.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.110+0000 7f17bceb7640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17b806dab0 0x7f17b813ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.110+0000 7f17b7fff640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b806de90 0x7f17b81f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.110+0000 7f17bd6b8640 1 -- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b806de90 msgr2=0x7f17b81f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.110+0000 7f17bd6b8640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b806de90 0x7f17b81f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.110+0000 7f17bd6b8640 1 -- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17b806dab0 msgr2=0x7f17b813ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.110+0000 7f17bd6b8640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17b806dab0 0x7f17b813ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.110+0000 7f17bd6b8640 1 -- 172.21.15.38:0/1824040405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b81f49d0 con 0x7f17b813ad30 2023-12-22T08:47:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.110+0000 7f17bceb7640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17b806dab0 0x7f17b813ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:47:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.110+0000 7f17bd6b8640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17b813ad30 0x7f17b813b190 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f17b000c380 tx=0x7f17b0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.110+0000 7f17b57fa640 1 -- 172.21.15.38:0/1824040405 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b002ca80 con 0x7f17b813ad30 2023-12-22T08:47:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.111+0000 7f17b57fa640 1 -- 172.21.15.38:0/1824040405 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b002cbe0 con 0x7f17b813ad30 2023-12-22T08:47:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.111+0000 7f17b57fa640 1 -- 172.21.15.38:0/1824040405 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0001640 con 0x7f17b813ad30 2023-12-22T08:47:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.111+0000 7f17bdeb9640 1 -- 172.21.15.38:0/1824040405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b81f4cb0 con 0x7f17b813ad30 2023-12-22T08:47:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.111+0000 7f17bdeb9640 1 -- 172.21.15.38:0/1824040405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b813b6d0 con 0x7f17b813ad30 2023-12-22T08:47:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.112+0000 7f17bdeb9640 1 -- 172.21.15.38:0/1824040405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b8061910 con 0x7f17b813ad30 2023-12-22T08:47:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.113+0000 7f17b57fa640 1 -- 172.21.15.38:0/1824040405 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f17b0032070 con 0x7f17b813ad30 2023-12-22T08:47:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.114+0000 7f17b57fa640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f17a406a430 0x7f17a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.114+0000 7f17b57fa640 1 -- 172.21.15.38:0/1824040405 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17b003c070 con 0x7f17b813ad30 2023-12-22T08:47:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.115+0000 7f17bceb7640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f17a406a430 0x7f17a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.116+0000 7f17bceb7640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f17a406a430 0x7f17a406c8f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f17a80074d0 tx=0x7f17a800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:54.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.119+0000 7f17b57fa640 1 -- 172.21.15.38:0/1824040405 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f17b0078550 con 0x7f17b813ad30 2023-12-22T08:47:54.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.315+0000 7f17bdeb9640 1 -- 172.21.15.38:0/1824040405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17b80cd250 con 0x7f17b813ad30 2023-12-22T08:47:54.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.317+0000 7f17b57fa640 1 -- 172.21.15.38:0/1824040405 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16068 (secure 0 0 0) 0x7f17b0001c80 con 0x7f17b813ad30 2023-12-22T08:47:54.318 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:54.318 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":142,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:47:51.326307+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:48.219096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:49.341846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:47:54.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.319+0000 7f17bdeb9640 1 -- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f17a406a430 msgr2=0x7f17a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:54.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.319+0000 7f17bdeb9640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f17a406a430 0x7f17a406c8f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f17a80074d0 tx=0x7f17a800b040 comp rx=0 tx=0).stop 2023-12-22T08:47:54.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.319+0000 7f17bdeb9640 1 -- 172.21.15.38:0/1824040405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17b813ad30 msgr2=0x7f17b813b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:54.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.319+0000 7f17bdeb9640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17b813ad30 0x7f17b813b190 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f17b000c380 tx=0x7f17b0000fe0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.320+0000 7f17bdeb9640 1 -- 172.21.15.38:0/1824040405 shutdown_connections 2023-12-22T08:47:54.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.320+0000 7f17bdeb9640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f17a406a430 0x7f17a406c8f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.320+0000 7f17bdeb9640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17b813ad30 0x7f17b813b190 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.320+0000 7f17bdeb9640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b806de90 0x7f17b81f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.320+0000 7f17bdeb9640 1 --2- 172.21.15.38:0/1824040405 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17b806dab0 0x7f17b813ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.320+0000 7f17bdeb9640 1 -- 172.21.15.38:0/1824040405 >> 172.21.15.38:0/1824040405 conn(0x7f17b80d14b0 msgr2=0x7f17b8143be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:54.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.320+0000 7f17bdeb9640 1 -- 172.21.15.38:0/1824040405 shutdown_connections 2023-12-22T08:47:54.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.320+0000 7f17bdeb9640 1 -- 172.21.15.38:0/1824040405 wait complete. 2023-12-22T08:47:54.339 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T08:47:54.339 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:47:54.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.559+0000 7fd19e40e640 1 Processor -- start 2023-12-22T08:47:54.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.560+0000 7fd19e40e640 1 -- start start 2023-12-22T08:47:54.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.561+0000 7fd19e40e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd19815e740 0x7fd19815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.561+0000 7fd19e40e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd1980b3f90 0x7fd198070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.561+0000 7fd19e40e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19815eb20 con 0x7fd19806ca50 2023-12-22T08:47:54.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.562+0000 7fd19e40e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19806e650 con 0x7fd1980b3f90 2023-12-22T08:47:54.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.562+0000 7fd19e40e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd198070770 con 0x7fd19815e740 2023-12-22T08:47:54.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.562+0000 7fd19c9ab640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd1980b3f90 0x7fd198070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.562+0000 7fd1977fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd19806ca50 0x7fd1980b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:35910/0 (socket says 172.21.15.38:35910) 2023-12-22T08:47:54.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.562+0000 7fd1977fe640 1 -- 172.21.15.38:0/2904540907 learned_addr learned my addr 172.21.15.38:0/2904540907 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:54.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.562+0000 7fd197fff640 1 --2- 172.21.15.38:0/2904540907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd19815e740 0x7fd19815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.562+0000 7fd19c9ab640 1 -- 172.21.15.38:0/2904540907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd19815e740 msgr2=0x7fd19815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:54.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.562+0000 7fd19c9ab640 1 --2- 172.21.15.38:0/2904540907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd19815e740 0x7fd19815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.562+0000 7fd19c9ab640 1 -- 172.21.15.38:0/2904540907 >> v1:172.21.15.38:6789/0 conn(0x7fd19806ca50 legacy=0x7fd1980b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:54.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.562+0000 7fd19c9ab640 1 -- 172.21.15.38:0/2904540907 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19806d180 con 0x7fd1980b3f90 2023-12-22T08:47:54.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.564+0000 7fd19c9ab640 1 --2- 172.21.15.38:0/2904540907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1980b3f90 0x7fd198070c00 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fd1900097a0 tx=0x7fd19002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a033ef0762565e8a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:54.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.564+0000 7fd196ffd640 1 -- 172.21.15.38:0/2904540907 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19002f050 con 0x7fd1980b3f90 2023-12-22T08:47:54.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.564+0000 7fd196ffd640 1 -- 172.21.15.38:0/2904540907 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd190031700 con 0x7fd1980b3f90 2023-12-22T08:47:54.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.564+0000 7fd196ffd640 1 -- 172.21.15.38:0/2904540907 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190031a90 con 0x7fd1980b3f90 2023-12-22T08:47:54.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.564+0000 7fd19e40e640 1 -- 172.21.15.38:0/2904540907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1980b3f90 msgr2=0x7fd198070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:54.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.564+0000 7fd19e40e640 1 --2- 172.21.15.38:0/2904540907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1980b3f90 0x7fd198070c00 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fd1900097a0 tx=0x7fd19002b7a0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.565+0000 7fd19e40e640 1 -- 172.21.15.38:0/2904540907 shutdown_connections 2023-12-22T08:47:54.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.565+0000 7fd19e40e640 1 --2- 172.21.15.38:0/2904540907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1980b3f90 0x7fd198070c00 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.565+0000 7fd19e40e640 1 --2- 172.21.15.38:0/2904540907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd19815e740 0x7fd19815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.565+0000 7fd19e40e640 1 -- 172.21.15.38:0/2904540907 >> 172.21.15.38:0/2904540907 conn(0x7fd1980cfea0 msgr2=0x7fd1980d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:54.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.565+0000 7fd19e40e640 1 -- 172.21.15.38:0/2904540907 shutdown_connections 2023-12-22T08:47:54.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.565+0000 7fd19e40e640 1 -- 172.21.15.38:0/2904540907 wait complete. 2023-12-22T08:47:54.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.566+0000 7fd19e40e640 1 Processor -- start 2023-12-22T08:47:54.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.567+0000 7fd19e40e640 1 -- start start 2023-12-22T08:47:54.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.568+0000 7fd19e40e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd19806ca50 0x7fd1981605c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.568+0000 7fd19e40e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1980b3f90 0x7fd198144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.568+0000 7fd19e40e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd19815e740 0x7fd1980b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.568+0000 7fd19e40e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd198160b00 con 0x7fd19815e740 2023-12-22T08:47:54.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.568+0000 7fd19e40e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1980b5fc0 con 0x7fd1980b3f90 2023-12-22T08:47:54.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.568+0000 7fd19e40e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1980b62a0 con 0x7fd19806ca50 2023-12-22T08:47:54.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.568+0000 7fd19c9ab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd19815e740 0x7fd1980b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.568+0000 7fd19c9ab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd19815e740 0x7fd1980b7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37034/0 (socket says 172.21.15.38:37034) 2023-12-22T08:47:54.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.568+0000 7fd19c9ab640 1 -- 172.21.15.38:0/1659368968 learned_addr learned my addr 172.21.15.38:0/1659368968 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:54.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.568+0000 7fd197fff640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd19806ca50 0x7fd1981605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.568+0000 7fd1977fe640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1980b3f90 0x7fd198144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.569+0000 7fd19c9ab640 1 -- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd19806ca50 msgr2=0x7fd1981605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:54.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.569+0000 7fd19c9ab640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd19806ca50 0x7fd1981605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.569+0000 7fd19c9ab640 1 -- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1980b3f90 msgr2=0x7fd198144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:54.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.569+0000 7fd19c9ab640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1980b3f90 0x7fd198144d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.569+0000 7fd19c9ab640 1 -- 172.21.15.38:0/1659368968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd190009400 con 0x7fd19815e740 2023-12-22T08:47:54.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.569+0000 7fd1977fe640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1980b3f90 0x7fd198144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:54.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.569+0000 7fd19c9ab640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd19815e740 0x7fd1980b7060 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fd190036040 tx=0x7fd1900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:54.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.569+0000 7fd194ff9640 1 -- 172.21.15.38:0/1659368968 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190033bb0 con 0x7fd19815e740 2023-12-22T08:47:54.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.569+0000 7fd194ff9640 1 -- 172.21.15.38:0/1659368968 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd190033d30 con 0x7fd19815e740 2023-12-22T08:47:54.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.569+0000 7fd194ff9640 1 -- 172.21.15.38:0/1659368968 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190033ea0 con 0x7fd19815e740 2023-12-22T08:47:54.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.569+0000 7fd19e40e640 1 -- 172.21.15.38:0/1659368968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1980b6580 con 0x7fd19815e740 2023-12-22T08:47:54.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.569+0000 7fd19e40e640 1 -- 172.21.15.38:0/1659368968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1980b6b40 con 0x7fd19815e740 2023-12-22T08:47:54.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.571+0000 7fd19e40e640 1 -- 172.21.15.38:0/1659368968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd198061910 con 0x7fd19815e740 2023-12-22T08:47:54.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.572+0000 7fd194ff9640 1 -- 172.21.15.38:0/1659368968 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd19003a040 con 0x7fd19815e740 2023-12-22T08:47:54.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.572+0000 7fd194ff9640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd17806a430 0x7fd17806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:54.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.573+0000 7fd194ff9640 1 -- 172.21.15.38:0/1659368968 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1900aa320 con 0x7fd19815e740 2023-12-22T08:47:54.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.573+0000 7fd197fff640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd17806a430 0x7fd17806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:54.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.574+0000 7fd197fff640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd17806a430 0x7fd17806c8f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd188006fd0 tx=0x7fd188008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:54.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.577+0000 7fd194ff9640 1 -- 172.21.15.38:0/1659368968 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd190075870 con 0x7fd19815e740 2023-12-22T08:47:54.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.769+0000 7fd19e40e640 1 -- 172.21.15.38:0/1659368968 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd19806d740 con 0x7fd17806a430 2023-12-22T08:47:54.781 INFO:tasks.ceph.mds.c.smithi038.stderr:2023-12-22T08:47:54.780+0000 7fe223c35640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:47:54.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.795+0000 7fd194ff9640 1 -- 172.21.15.38:0/1659368968 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282912 (secure 0 0 0) 0x7fd18800f860 con 0x7fd17806a430 2023-12-22T08:47:54.801 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:54.803 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:47:54.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.801+0000 7fd19e40e640 1 -- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd17806a430 msgr2=0x7fd17806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:54.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.801+0000 7fd19e40e640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd17806a430 0x7fd17806c8f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd188006fd0 tx=0x7fd188008040 comp rx=0 tx=0).stop 2023-12-22T08:47:54.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.801+0000 7fd19e40e640 1 -- 172.21.15.38:0/1659368968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd19815e740 msgr2=0x7fd1980b7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:54.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.801+0000 7fd19e40e640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd19815e740 0x7fd1980b7060 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fd190036040 tx=0x7fd1900046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.802+0000 7fd19e40e640 1 -- 172.21.15.38:0/1659368968 shutdown_connections 2023-12-22T08:47:54.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.802+0000 7fd19e40e640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd17806a430 0x7fd17806c8f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.802+0000 7fd19e40e640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd19815e740 0x7fd1980b7060 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.802+0000 7fd19e40e640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1980b3f90 0x7fd198144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.802+0000 7fd19e40e640 1 --2- 172.21.15.38:0/1659368968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd19806ca50 0x7fd1981605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:54.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.802+0000 7fd19e40e640 1 -- 172.21.15.38:0/1659368968 >> 172.21.15.38:0/1659368968 conn(0x7fd1980cfea0 msgr2=0x7fd1980d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:54.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.802+0000 7fd19e40e640 1 -- 172.21.15.38:0/1659368968 shutdown_connections 2023-12-22T08:47:54.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:54.802+0000 7fd19e40e640 1 -- 172.21.15.38:0/1659368968 wait complete. 2023-12-22T08:47:54.825 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":377,"stamp":"2023-12-22T08:47:54.529653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7309,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555190,"statfs":{"total":1600000000,"available":1592514703,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.724530"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334201+0000","last_change":"2023-12-22T08:47:50.352340+0000","last_active":"2023-12-22T08:47:51.334201+0000","last_peered":"2023-12-22T08:47:51.334201+0000","last_clean":"2023-12-22T08:47:51.334201+0000","last_became_active":"2023-12-22T08:47:50.351474+0000","last_became_peered":"2023-12-22T08:47:50.351474+0000","last_unstale":"2023-12-22T08:47:51.334201+0000","last_undegraded":"2023-12-22T08:47:51.334201+0000","last_fullsized":"2023-12-22T08:47:51.334201+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:06:11.909459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949596+0000","last_change":"2023-12-22T08:47:50.352848+0000","last_active":"2023-12-22T08:47:51.949596+0000","last_peered":"2023-12-22T08:47:51.949596+0000","last_clean":"2023-12-22T08:47:51.949596+0000","last_became_active":"2023-12-22T08:47:50.352276+0000","last_became_peered":"2023-12-22T08:47:50.352276+0000","last_unstale":"2023-12-22T08:47:51.949596+0000","last_undegraded":"2023-12-22T08:47:51.949596+0000","last_fullsized":"2023-12-22T08:47:51.949596+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:42:10.636165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947081+0000","last_change":"2023-12-22T08:47:50.352006+0000","last_active":"2023-12-22T08:47:51.947081+0000","last_peered":"2023-12-22T08:47:51.947081+0000","last_clean":"2023-12-22T08:47:51.947081+0000","last_became_active":"2023-12-22T08:47:50.350843+0000","last_became_peered":"2023-12-22T08:47:50.350843+0000","last_unstale":"2023-12-22T08:47:51.947081+0000","last_undegraded":"2023-12-22T08:47:51.947081+0000","last_fullsized":"2023-12-22T08:47:51.947081+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:12:36.859618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947608+0000","last_change":"2023-12-22T08:47:50.358176+0000","last_active":"2023-12-22T08:47:51.947608+0000","last_peered":"2023-12-22T08:47:51.947608+0000","last_clean":"2023-12-22T08:47:51.947608+0000","last_became_active":"2023-12-22T08:47:50.357829+0000","last_became_peered":"2023-12-22T08:47:50.357829+0000","last_unstale":"2023-12-22T08:47:51.947608+0000","last_undegraded":"2023-12-22T08:47:51.947608+0000","last_fullsized":"2023-12-22T08:47:51.947608+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:30:56.551048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336557+0000","last_change":"2023-12-22T08:47:50.359418+0000","last_active":"2023-12-22T08:47:51.336557+0000","last_peered":"2023-12-22T08:47:51.336557+0000","last_clean":"2023-12-22T08:47:51.336557+0000","last_became_active":"2023-12-22T08:47:50.359141+0000","last_became_peered":"2023-12-22T08:47:50.359141+0000","last_unstale":"2023-12-22T08:47:51.336557+0000","last_undegraded":"2023-12-22T08:47:51.336557+0000","last_fullsized":"2023-12-22T08:47:51.336557+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:57:58.323078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.946976+0000","last_change":"2023-12-22T08:47:50.364594+0000","last_active":"2023-12-22T08:47:51.946976+0000","last_peered":"2023-12-22T08:47:51.946976+0000","last_clean":"2023-12-22T08:47:51.946976+0000","last_became_active":"2023-12-22T08:47:50.364194+0000","last_became_peered":"2023-12-22T08:47:50.364194+0000","last_unstale":"2023-12-22T08:47:51.946976+0000","last_undegraded":"2023-12-22T08:47:51.946976+0000","last_fullsized":"2023-12-22T08:47:51.946976+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:29:23.249680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331602+0000","last_change":"2023-12-22T08:47:50.342266+0000","last_active":"2023-12-22T08:47:51.331602+0000","last_peered":"2023-12-22T08:47:51.331602+0000","last_clean":"2023-12-22T08:47:51.331602+0000","last_became_active":"2023-12-22T08:47:50.341970+0000","last_became_peered":"2023-12-22T08:47:50.341970+0000","last_unstale":"2023-12-22T08:47:51.331602+0000","last_undegraded":"2023-12-22T08:47:51.331602+0000","last_fullsized":"2023-12-22T08:47:51.331602+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:11:45.013951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331355+0000","last_change":"2023-12-22T08:47:50.347624+0000","last_active":"2023-12-22T08:47:51.331355+0000","last_peered":"2023-12-22T08:47:51.331355+0000","last_clean":"2023-12-22T08:47:51.331355+0000","last_became_active":"2023-12-22T08:47:50.347393+0000","last_became_peered":"2023-12-22T08:47:50.347393+0000","last_unstale":"2023-12-22T08:47:51.331355+0000","last_undegraded":"2023-12-22T08:47:51.331355+0000","last_fullsized":"2023-12-22T08:47:51.331355+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:48.773460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.333849+0000","last_change":"2023-12-22T08:47:50.366320+0000","last_active":"2023-12-22T08:47:51.333849+0000","last_peered":"2023-12-22T08:47:51.333849+0000","last_clean":"2023-12-22T08:47:51.333849+0000","last_became_active":"2023-12-22T08:47:50.365995+0000","last_became_peered":"2023-12-22T08:47:50.365995+0000","last_unstale":"2023-12-22T08:47:51.333849+0000","last_undegraded":"2023-12-22T08:47:51.333849+0000","last_fullsized":"2023-12-22T08:47:51.333849+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:44:27.390709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.335741+0000","last_change":"2023-12-22T08:47:50.357491+0000","last_active":"2023-12-22T08:47:51.335741+0000","last_peered":"2023-12-22T08:47:51.335741+0000","last_clean":"2023-12-22T08:47:51.335741+0000","last_became_active":"2023-12-22T08:47:50.356906+0000","last_became_peered":"2023-12-22T08:47:50.356906+0000","last_unstale":"2023-12-22T08:47:51.335741+0000","last_undegraded":"2023-12-22T08:47:51.335741+0000","last_fullsized":"2023-12-22T08:47:51.335741+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:16.888772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331854+0000","last_change":"2023-12-22T08:47:50.342374+0000","last_active":"2023-12-22T08:47:51.331854+0000","last_peered":"2023-12-22T08:47:51.331854+0000","last_clean":"2023-12-22T08:47:51.331854+0000","last_became_active":"2023-12-22T08:47:50.342144+0000","last_became_peered":"2023-12-22T08:47:50.342144+0000","last_unstale":"2023-12-22T08:47:51.331854+0000","last_undegraded":"2023-12-22T08:47:51.331854+0000","last_fullsized":"2023-12-22T08:47:51.331854+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:01.178987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.333552+0000","last_change":"2023-12-22T08:47:50.353503+0000","last_active":"2023-12-22T08:47:51.333552+0000","last_peered":"2023-12-22T08:47:51.333552+0000","last_clean":"2023-12-22T08:47:51.333552+0000","last_became_active":"2023-12-22T08:47:50.353186+0000","last_became_peered":"2023-12-22T08:47:50.353186+0000","last_unstale":"2023-12-22T08:47:51.333552+0000","last_undegraded":"2023-12-22T08:47:51.333552+0000","last_fullsized":"2023-12-22T08:47:51.333552+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:21:22.616248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948151+0000","last_change":"2023-12-22T08:47:50.354955+0000","last_active":"2023-12-22T08:47:51.948151+0000","last_peered":"2023-12-22T08:47:51.948151+0000","last_clean":"2023-12-22T08:47:51.948151+0000","last_became_active":"2023-12-22T08:47:50.354603+0000","last_became_peered":"2023-12-22T08:47:50.354603+0000","last_unstale":"2023-12-22T08:47:51.948151+0000","last_undegraded":"2023-12-22T08:47:51.948151+0000","last_fullsized":"2023-12-22T08:47:51.948151+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:18.069615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948240+0000","last_change":"2023-12-22T08:47:50.345176+0000","last_active":"2023-12-22T08:47:51.948240+0000","last_peered":"2023-12-22T08:47:51.948240+0000","last_clean":"2023-12-22T08:47:51.948240+0000","last_became_active":"2023-12-22T08:47:50.344788+0000","last_became_peered":"2023-12-22T08:47:50.344788+0000","last_unstale":"2023-12-22T08:47:51.948240+0000","last_undegraded":"2023-12-22T08:47:51.948240+0000","last_fullsized":"2023-12-22T08:47:51.948240+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:36:37.683576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336150+0000","last_change":"2023-12-22T08:47:50.363067+0000","last_active":"2023-12-22T08:47:51.336150+0000","last_peered":"2023-12-22T08:47:51.336150+0000","last_clean":"2023-12-22T08:47:51.336150+0000","last_became_active":"2023-12-22T08:47:50.362499+0000","last_became_peered":"2023-12-22T08:47:50.362499+0000","last_unstale":"2023-12-22T08:47:51.336150+0000","last_undegraded":"2023-12-22T08:47:51.336150+0000","last_fullsized":"2023-12-22T08:47:51.336150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:54:19.066048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.335378+0000","last_change":"2023-12-22T08:47:50.348441+0000","last_active":"2023-12-22T08:47:51.335378+0000","last_peered":"2023-12-22T08:47:51.335378+0000","last_clean":"2023-12-22T08:47:51.335378+0000","last_became_active":"2023-12-22T08:47:50.340946+0000","last_became_peered":"2023-12-22T08:47:50.340946+0000","last_unstale":"2023-12-22T08:47:51.335378+0000","last_undegraded":"2023-12-22T08:47:51.335378+0000","last_fullsized":"2023-12-22T08:47:51.335378+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:39:04.442278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.946965+0000","last_change":"2023-12-22T08:47:50.347454+0000","last_active":"2023-12-22T08:47:51.946965+0000","last_peered":"2023-12-22T08:47:51.946965+0000","last_clean":"2023-12-22T08:47:51.946965+0000","last_became_active":"2023-12-22T08:47:50.347149+0000","last_became_peered":"2023-12-22T08:47:50.347149+0000","last_unstale":"2023-12-22T08:47:51.946965+0000","last_undegraded":"2023-12-22T08:47:51.946965+0000","last_fullsized":"2023-12-22T08:47:51.946965+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:19:58.447334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331455+0000","last_change":"2023-12-22T08:47:50.348686+0000","last_active":"2023-12-22T08:47:51.331455+0000","last_peered":"2023-12-22T08:47:51.331455+0000","last_clean":"2023-12-22T08:47:51.331455+0000","last_became_active":"2023-12-22T08:47:50.348483+0000","last_became_peered":"2023-12-22T08:47:50.348483+0000","last_unstale":"2023-12-22T08:47:51.331455+0000","last_undegraded":"2023-12-22T08:47:51.331455+0000","last_fullsized":"2023-12-22T08:47:51.331455+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:03.423989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947121+0000","last_change":"2023-12-22T08:47:50.354145+0000","last_active":"2023-12-22T08:47:51.947121+0000","last_peered":"2023-12-22T08:47:51.947121+0000","last_clean":"2023-12-22T08:47:51.947121+0000","last_became_active":"2023-12-22T08:47:50.353896+0000","last_became_peered":"2023-12-22T08:47:50.353896+0000","last_unstale":"2023-12-22T08:47:51.947121+0000","last_undegraded":"2023-12-22T08:47:51.947121+0000","last_fullsized":"2023-12-22T08:47:51.947121+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:58:50.033419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949079+0000","last_change":"2023-12-22T08:47:50.360929+0000","last_active":"2023-12-22T08:47:51.949079+0000","last_peered":"2023-12-22T08:47:51.949079+0000","last_clean":"2023-12-22T08:47:51.949079+0000","last_became_active":"2023-12-22T08:47:50.360699+0000","last_became_peered":"2023-12-22T08:47:50.360699+0000","last_unstale":"2023-12-22T08:47:51.949079+0000","last_undegraded":"2023-12-22T08:47:51.949079+0000","last_fullsized":"2023-12-22T08:47:51.949079+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:56:02.995508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.332126+0000","last_change":"2023-12-22T08:47:50.355486+0000","last_active":"2023-12-22T08:47:51.332126+0000","last_peered":"2023-12-22T08:47:51.332126+0000","last_clean":"2023-12-22T08:47:51.332126+0000","last_became_active":"2023-12-22T08:47:50.355132+0000","last_became_peered":"2023-12-22T08:47:50.355132+0000","last_unstale":"2023-12-22T08:47:51.332126+0000","last_undegraded":"2023-12-22T08:47:51.332126+0000","last_fullsized":"2023-12-22T08:47:51.332126+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:28:20.143568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947240+0000","last_change":"2023-12-22T08:47:50.358792+0000","last_active":"2023-12-22T08:47:51.947240+0000","last_peered":"2023-12-22T08:47:51.947240+0000","last_clean":"2023-12-22T08:47:51.947240+0000","last_became_active":"2023-12-22T08:47:50.354322+0000","last_became_peered":"2023-12-22T08:47:50.354322+0000","last_unstale":"2023-12-22T08:47:51.947240+0000","last_undegraded":"2023-12-22T08:47:51.947240+0000","last_fullsized":"2023-12-22T08:47:51.947240+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:36:13.756474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947370+0000","last_change":"2023-12-22T08:47:50.349185+0000","last_active":"2023-12-22T08:47:51.947370+0000","last_peered":"2023-12-22T08:47:51.947370+0000","last_clean":"2023-12-22T08:47:51.947370+0000","last_became_active":"2023-12-22T08:47:50.348508+0000","last_became_peered":"2023-12-22T08:47:50.348508+0000","last_unstale":"2023-12-22T08:47:51.947370+0000","last_undegraded":"2023-12-22T08:47:51.947370+0000","last_fullsized":"2023-12-22T08:47:51.947370+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:14.630836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947871+0000","last_change":"2023-12-22T08:47:50.354014+0000","last_active":"2023-12-22T08:47:51.947871+0000","last_peered":"2023-12-22T08:47:51.947871+0000","last_clean":"2023-12-22T08:47:51.947871+0000","last_became_active":"2023-12-22T08:47:50.353332+0000","last_became_peered":"2023-12-22T08:47:50.353332+0000","last_unstale":"2023-12-22T08:47:51.947871+0000","last_undegraded":"2023-12-22T08:47:51.947871+0000","last_fullsized":"2023-12-22T08:47:51.947871+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:45:16.272592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331355+0000","last_change":"2023-12-22T08:47:50.343675+0000","last_active":"2023-12-22T08:47:51.331355+0000","last_peered":"2023-12-22T08:47:51.331355+0000","last_clean":"2023-12-22T08:47:51.331355+0000","last_became_active":"2023-12-22T08:47:50.343459+0000","last_became_peered":"2023-12-22T08:47:50.343459+0000","last_unstale":"2023-12-22T08:47:51.331355+0000","last_undegraded":"2023-12-22T08:47:51.331355+0000","last_fullsized":"2023-12-22T08:47:51.331355+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:21:58.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947490+0000","last_change":"2023-12-22T08:47:50.353348+0000","last_active":"2023-12-22T08:47:51.947490+0000","last_peered":"2023-12-22T08:47:51.947490+0000","last_clean":"2023-12-22T08:47:51.947490+0000","last_became_active":"2023-12-22T08:47:50.353037+0000","last_became_peered":"2023-12-22T08:47:50.353037+0000","last_unstale":"2023-12-22T08:47:51.947490+0000","last_undegraded":"2023-12-22T08:47:51.947490+0000","last_fullsized":"2023-12-22T08:47:51.947490+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:43.447838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948266+0000","last_change":"2023-12-22T08:47:50.357506+0000","last_active":"2023-12-22T08:47:51.948266+0000","last_peered":"2023-12-22T08:47:51.948266+0000","last_clean":"2023-12-22T08:47:51.948266+0000","last_became_active":"2023-12-22T08:47:50.357004+0000","last_became_peered":"2023-12-22T08:47:50.357004+0000","last_unstale":"2023-12-22T08:47:51.948266+0000","last_undegraded":"2023-12-22T08:47:51.948266+0000","last_fullsized":"2023-12-22T08:47:51.948266+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:45:34.129055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.946976+0000","last_change":"2023-12-22T08:47:50.363143+0000","last_active":"2023-12-22T08:47:51.946976+0000","last_peered":"2023-12-22T08:47:51.946976+0000","last_clean":"2023-12-22T08:47:51.946976+0000","last_became_active":"2023-12-22T08:47:50.362908+0000","last_became_peered":"2023-12-22T08:47:50.362908+0000","last_unstale":"2023-12-22T08:47:51.946976+0000","last_undegraded":"2023-12-22T08:47:51.946976+0000","last_fullsized":"2023-12-22T08:47:51.946976+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:22:26.468738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948496+0000","last_change":"2023-12-22T08:47:50.345016+0000","last_active":"2023-12-22T08:47:51.948496+0000","last_peered":"2023-12-22T08:47:51.948496+0000","last_clean":"2023-12-22T08:47:51.948496+0000","last_became_active":"2023-12-22T08:47:50.344183+0000","last_became_peered":"2023-12-22T08:47:50.344183+0000","last_unstale":"2023-12-22T08:47:51.948496+0000","last_undegraded":"2023-12-22T08:47:51.948496+0000","last_fullsized":"2023-12-22T08:47:51.948496+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:58:50.033419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331478+0000","last_change":"2023-12-22T08:47:50.353753+0000","last_active":"2023-12-22T08:47:51.331478+0000","last_peered":"2023-12-22T08:47:51.331478+0000","last_clean":"2023-12-22T08:47:51.331478+0000","last_became_active":"2023-12-22T08:47:50.353528+0000","last_became_peered":"2023-12-22T08:47:50.353528+0000","last_unstale":"2023-12-22T08:47:51.331478+0000","last_undegraded":"2023-12-22T08:47:51.331478+0000","last_fullsized":"2023-12-22T08:47:51.331478+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:32.187056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334428+0000","last_change":"2023-12-22T08:47:50.351886+0000","last_active":"2023-12-22T08:47:51.334428+0000","last_peered":"2023-12-22T08:47:51.334428+0000","last_clean":"2023-12-22T08:47:51.334428+0000","last_became_active":"2023-12-22T08:47:50.350892+0000","last_became_peered":"2023-12-22T08:47:50.350892+0000","last_unstale":"2023-12-22T08:47:51.334428+0000","last_undegraded":"2023-12-22T08:47:51.334428+0000","last_fullsized":"2023-12-22T08:47:51.334428+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:55:12.199121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.333960+0000","last_change":"2023-12-22T08:47:50.344606+0000","last_active":"2023-12-22T08:47:51.333960+0000","last_peered":"2023-12-22T08:47:51.333960+0000","last_clean":"2023-12-22T08:47:51.333960+0000","last_became_active":"2023-12-22T08:47:50.344093+0000","last_became_peered":"2023-12-22T08:47:50.344093+0000","last_unstale":"2023-12-22T08:47:51.333960+0000","last_undegraded":"2023-12-22T08:47:51.333960+0000","last_fullsized":"2023-12-22T08:47:51.333960+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:51:36.972891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334097+0000","last_change":"2023-12-22T08:47:50.360981+0000","last_active":"2023-12-22T08:47:51.334097+0000","last_peered":"2023-12-22T08:47:51.334097+0000","last_clean":"2023-12-22T08:47:51.334097+0000","last_became_active":"2023-12-22T08:47:50.360375+0000","last_became_peered":"2023-12-22T08:47:50.360375+0000","last_unstale":"2023-12-22T08:47:51.334097+0000","last_undegraded":"2023-12-22T08:47:51.334097+0000","last_fullsized":"2023-12-22T08:47:51.334097+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:02:09.526119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"141'4","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948137+0000","last_change":"2023-12-22T08:47:49.843225+0000","last_active":"2023-12-22T08:47:51.948137+0000","last_peered":"2023-12-22T08:47:51.948137+0000","last_clean":"2023-12-22T08:47:51.948137+0000","last_became_active":"2023-12-22T08:47:49.842899+0000","last_became_peered":"2023-12-22T08:47:49.842899+0000","last_unstale":"2023-12-22T08:47:51.948137+0000","last_undegraded":"2023-12-22T08:47:51.948137+0000","last_fullsized":"2023-12-22T08:47:51.948137+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:39:58.328498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947618+0000","last_change":"2023-12-22T08:47:50.348894+0000","last_active":"2023-12-22T08:47:51.947618+0000","last_peered":"2023-12-22T08:47:51.947618+0000","last_clean":"2023-12-22T08:47:51.947618+0000","last_became_active":"2023-12-22T08:47:50.348180+0000","last_became_peered":"2023-12-22T08:47:50.348180+0000","last_unstale":"2023-12-22T08:47:51.947618+0000","last_undegraded":"2023-12-22T08:47:51.947618+0000","last_fullsized":"2023-12-22T08:47:51.947618+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:56:02.995508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"141'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948742+0000","last_change":"2023-12-22T08:47:49.843603+0000","last_active":"2023-12-22T08:47:51.948742+0000","last_peered":"2023-12-22T08:47:51.948742+0000","last_clean":"2023-12-22T08:47:51.948742+0000","last_became_active":"2023-12-22T08:47:49.843329+0000","last_became_peered":"2023-12-22T08:47:49.843329+0000","last_unstale":"2023-12-22T08:47:51.948742+0000","last_undegraded":"2023-12-22T08:47:51.948742+0000","last_fullsized":"2023-12-22T08:47:51.948742+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:02:08.510134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947733+0000","last_change":"2023-12-22T08:47:50.364443+0000","last_active":"2023-12-22T08:47:51.947733+0000","last_peered":"2023-12-22T08:47:51.947733+0000","last_clean":"2023-12-22T08:47:51.947733+0000","last_became_active":"2023-12-22T08:47:50.363827+0000","last_became_peered":"2023-12-22T08:47:50.363827+0000","last_unstale":"2023-12-22T08:47:51.947733+0000","last_undegraded":"2023-12-22T08:47:51.947733+0000","last_fullsized":"2023-12-22T08:47:51.947733+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:59.384521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"141'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948401+0000","last_change":"2023-12-22T08:47:49.853114+0000","last_active":"2023-12-22T08:47:51.948401+0000","last_peered":"2023-12-22T08:47:51.948401+0000","last_clean":"2023-12-22T08:47:51.948401+0000","last_became_active":"2023-12-22T08:47:49.852882+0000","last_became_peered":"2023-12-22T08:47:49.852882+0000","last_unstale":"2023-12-22T08:47:51.948401+0000","last_undegraded":"2023-12-22T08:47:51.948401+0000","last_fullsized":"2023-12-22T08:47:51.948401+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:21.383268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949323+0000","last_change":"2023-12-22T08:47:50.358130+0000","last_active":"2023-12-22T08:47:51.949323+0000","last_peered":"2023-12-22T08:47:51.949323+0000","last_clean":"2023-12-22T08:47:51.949323+0000","last_became_active":"2023-12-22T08:47:50.357887+0000","last_became_peered":"2023-12-22T08:47:50.357887+0000","last_unstale":"2023-12-22T08:47:51.949323+0000","last_undegraded":"2023-12-22T08:47:51.949323+0000","last_fullsized":"2023-12-22T08:47:51.949323+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:36:37.683576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"141'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948784+0000","last_change":"2023-12-22T08:47:49.852454+0000","last_active":"2023-12-22T08:47:51.948784+0000","last_peered":"2023-12-22T08:47:51.948784+0000","last_clean":"2023-12-22T08:47:51.948784+0000","last_became_active":"2023-12-22T08:47:49.852235+0000","last_became_peered":"2023-12-22T08:47:49.852235+0000","last_unstale":"2023-12-22T08:47:51.948784+0000","last_undegraded":"2023-12-22T08:47:51.948784+0000","last_fullsized":"2023-12-22T08:47:51.948784+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:29:22.233695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947557+0000","last_change":"2023-12-22T08:47:50.359149+0000","last_active":"2023-12-22T08:47:51.947557+0000","last_peered":"2023-12-22T08:47:51.947557+0000","last_clean":"2023-12-22T08:47:51.947557+0000","last_became_active":"2023-12-22T08:47:50.353233+0000","last_became_peered":"2023-12-22T08:47:50.353233+0000","last_unstale":"2023-12-22T08:47:51.947557+0000","last_undegraded":"2023-12-22T08:47:51.947557+0000","last_fullsized":"2023-12-22T08:47:51.947557+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:06:25.571324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"141'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948806+0000","last_change":"2023-12-22T08:47:49.846743+0000","last_active":"2023-12-22T08:47:51.948806+0000","last_peered":"2023-12-22T08:47:51.948806+0000","last_clean":"2023-12-22T08:47:51.948806+0000","last_became_active":"2023-12-22T08:47:49.846303+0000","last_became_peered":"2023-12-22T08:47:49.846303+0000","last_unstale":"2023-12-22T08:47:51.948806+0000","last_undegraded":"2023-12-22T08:47:51.948806+0000","last_fullsized":"2023-12-22T08:47:51.948806+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:39:03.426293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331849+0000","last_change":"2023-12-22T08:47:50.335851+0000","last_active":"2023-12-22T08:47:51.331849+0000","last_peered":"2023-12-22T08:47:51.331849+0000","last_clean":"2023-12-22T08:47:51.331849+0000","last_became_active":"2023-12-22T08:47:50.335577+0000","last_became_peered":"2023-12-22T08:47:50.335577+0000","last_unstale":"2023-12-22T08:47:51.331849+0000","last_undegraded":"2023-12-22T08:47:51.331849+0000","last_fullsized":"2023-12-22T08:47:51.331849+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:19.529050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"141'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.335700+0000","last_change":"2023-12-22T08:47:49.843449+0000","last_active":"2023-12-22T08:47:51.335700+0000","last_peered":"2023-12-22T08:47:51.335700+0000","last_clean":"2023-12-22T08:47:51.335700+0000","last_became_active":"2023-12-22T08:47:49.843133+0000","last_became_peered":"2023-12-22T08:47:49.843133+0000","last_unstale":"2023-12-22T08:47:51.335700+0000","last_undegraded":"2023-12-22T08:47:51.335700+0000","last_fullsized":"2023-12-22T08:47:51.335700+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:36.853291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.335177+0000","last_change":"2023-12-22T08:47:50.358655+0000","last_active":"2023-12-22T08:47:51.335177+0000","last_peered":"2023-12-22T08:47:51.335177+0000","last_clean":"2023-12-22T08:47:51.335177+0000","last_became_active":"2023-12-22T08:47:50.357269+0000","last_became_peered":"2023-12-22T08:47:50.357269+0000","last_unstale":"2023-12-22T08:47:51.335177+0000","last_undegraded":"2023-12-22T08:47:51.335177+0000","last_fullsized":"2023-12-22T08:47:51.335177+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:54:46.585497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.332180+0000","last_change":"2023-12-22T08:47:49.852011+0000","last_active":"2023-12-22T08:47:51.332180+0000","last_peered":"2023-12-22T08:47:51.332180+0000","last_clean":"2023-12-22T08:47:51.332180+0000","last_became_active":"2023-12-22T08:47:49.851717+0000","last_became_peered":"2023-12-22T08:47:49.851717+0000","last_unstale":"2023-12-22T08:47:51.332180+0000","last_undegraded":"2023-12-22T08:47:51.332180+0000","last_fullsized":"2023-12-22T08:47:51.332180+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:37.832514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331768+0000","last_change":"2023-12-22T08:47:50.343488+0000","last_active":"2023-12-22T08:47:51.331768+0000","last_peered":"2023-12-22T08:47:51.331768+0000","last_clean":"2023-12-22T08:47:51.331768+0000","last_became_active":"2023-12-22T08:47:50.343254+0000","last_became_peered":"2023-12-22T08:47:50.343254+0000","last_unstale":"2023-12-22T08:47:51.331768+0000","last_undegraded":"2023-12-22T08:47:51.331768+0000","last_fullsized":"2023-12-22T08:47:51.331768+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:23:46.194398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336322+0000","last_change":"2023-12-22T08:47:49.856170+0000","last_active":"2023-12-22T08:47:51.336322+0000","last_peered":"2023-12-22T08:47:51.336322+0000","last_clean":"2023-12-22T08:47:51.336322+0000","last_became_active":"2023-12-22T08:47:49.855005+0000","last_became_peered":"2023-12-22T08:47:49.855005+0000","last_unstale":"2023-12-22T08:47:51.336322+0000","last_undegraded":"2023-12-22T08:47:51.336322+0000","last_fullsized":"2023-12-22T08:47:51.336322+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:23:39.671198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949749+0000","last_change":"2023-12-22T08:47:50.352636+0000","last_active":"2023-12-22T08:47:51.949749+0000","last_peered":"2023-12-22T08:47:51.949749+0000","last_clean":"2023-12-22T08:47:51.949749+0000","last_became_active":"2023-12-22T08:47:50.351954+0000","last_became_peered":"2023-12-22T08:47:50.351954+0000","last_unstale":"2023-12-22T08:47:51.949749+0000","last_undegraded":"2023-12-22T08:47:51.949749+0000","last_fullsized":"2023-12-22T08:47:51.949749+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:26.637741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948995+0000","last_change":"2023-12-22T08:47:49.851210+0000","last_active":"2023-12-22T08:47:51.948995+0000","last_peered":"2023-12-22T08:47:51.948995+0000","last_clean":"2023-12-22T08:47:51.948995+0000","last_became_active":"2023-12-22T08:47:49.850858+0000","last_became_peered":"2023-12-22T08:47:49.850858+0000","last_unstale":"2023-12-22T08:47:51.948995+0000","last_undegraded":"2023-12-22T08:47:51.948995+0000","last_fullsized":"2023-12-22T08:47:51.948995+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:36:12.740489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.946930+0000","last_change":"2023-12-22T08:47:50.351864+0000","last_active":"2023-12-22T08:47:51.946930+0000","last_peered":"2023-12-22T08:47:51.946930+0000","last_clean":"2023-12-22T08:47:51.946930+0000","last_became_active":"2023-12-22T08:47:50.351636+0000","last_became_peered":"2023-12-22T08:47:50.351636+0000","last_unstale":"2023-12-22T08:47:51.946930+0000","last_undegraded":"2023-12-22T08:47:51.946930+0000","last_fullsized":"2023-12-22T08:47:51.946930+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:59.384521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334348+0000","last_change":"2023-12-22T08:47:49.852394+0000","last_active":"2023-12-22T08:47:51.334348+0000","last_peered":"2023-12-22T08:47:51.334348+0000","last_clean":"2023-12-22T08:47:51.334348+0000","last_became_active":"2023-12-22T08:47:49.852148+0000","last_became_peered":"2023-12-22T08:47:49.852148+0000","last_unstale":"2023-12-22T08:47:51.334348+0000","last_undegraded":"2023-12-22T08:47:51.334348+0000","last_fullsized":"2023-12-22T08:47:51.334348+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:52:32.939978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.946802+0000","last_change":"2023-12-22T08:47:50.359828+0000","last_active":"2023-12-22T08:47:51.946802+0000","last_peered":"2023-12-22T08:47:51.946802+0000","last_clean":"2023-12-22T08:47:51.946802+0000","last_became_active":"2023-12-22T08:47:50.359501+0000","last_became_peered":"2023-12-22T08:47:50.359501+0000","last_unstale":"2023-12-22T08:47:51.946802+0000","last_undegraded":"2023-12-22T08:47:51.946802+0000","last_fullsized":"2023-12-22T08:47:51.946802+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:07:31.512559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"141'3","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.333399+0000","last_change":"2023-12-22T08:47:49.851254+0000","last_active":"2023-12-22T08:47:51.333399+0000","last_peered":"2023-12-22T08:47:51.333399+0000","last_clean":"2023-12-22T08:47:51.333399+0000","last_became_active":"2023-12-22T08:47:49.850908+0000","last_became_peered":"2023-12-22T08:47:49.850908+0000","last_unstale":"2023-12-22T08:47:51.333399+0000","last_undegraded":"2023-12-22T08:47:51.333399+0000","last_fullsized":"2023-12-22T08:47:51.333399+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:39:22.944671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331552+0000","last_change":"2023-12-22T08:47:50.346317+0000","last_active":"2023-12-22T08:47:51.331552+0000","last_peered":"2023-12-22T08:47:51.331552+0000","last_clean":"2023-12-22T08:47:51.331552+0000","last_became_active":"2023-12-22T08:47:50.346086+0000","last_became_peered":"2023-12-22T08:47:50.346086+0000","last_unstale":"2023-12-22T08:47:51.331552+0000","last_undegraded":"2023-12-22T08:47:51.331552+0000","last_fullsized":"2023-12-22T08:47:51.331552+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:45:16.178742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"141'6","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948151+0000","last_change":"2023-12-22T08:47:49.852747+0000","last_active":"2023-12-22T08:47:51.948151+0000","last_peered":"2023-12-22T08:47:51.948151+0000","last_clean":"2023-12-22T08:47:51.948151+0000","last_became_active":"2023-12-22T08:47:49.852496+0000","last_became_peered":"2023-12-22T08:47:49.852496+0000","last_unstale":"2023-12-22T08:47:51.948151+0000","last_undegraded":"2023-12-22T08:47:51.948151+0000","last_fullsized":"2023-12-22T08:47:51.948151+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:58.368536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334973+0000","last_change":"2023-12-22T08:47:50.341562+0000","last_active":"2023-12-22T08:47:51.334973+0000","last_peered":"2023-12-22T08:47:51.334973+0000","last_clean":"2023-12-22T08:47:51.334973+0000","last_became_active":"2023-12-22T08:47:50.340150+0000","last_became_peered":"2023-12-22T08:47:50.340150+0000","last_unstale":"2023-12-22T08:47:51.334973+0000","last_undegraded":"2023-12-22T08:47:51.334973+0000","last_fullsized":"2023-12-22T08:47:51.334973+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:46:58.911364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"141'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336783+0000","last_change":"2023-12-22T08:47:49.855653+0000","last_active":"2023-12-22T08:47:51.336783+0000","last_peered":"2023-12-22T08:47:51.336783+0000","last_clean":"2023-12-22T08:47:51.336783+0000","last_became_active":"2023-12-22T08:47:49.854167+0000","last_became_peered":"2023-12-22T08:47:49.854167+0000","last_unstale":"2023-12-22T08:47:51.336783+0000","last_undegraded":"2023-12-22T08:47:51.336783+0000","last_fullsized":"2023-12-22T08:47:51.336783+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:00.209162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948167+0000","last_change":"2023-12-22T08:47:50.356265+0000","last_active":"2023-12-22T08:47:51.948167+0000","last_peered":"2023-12-22T08:47:51.948167+0000","last_clean":"2023-12-22T08:47:51.948167+0000","last_became_active":"2023-12-22T08:47:50.355974+0000","last_became_peered":"2023-12-22T08:47:50.355974+0000","last_unstale":"2023-12-22T08:47:51.948167+0000","last_undegraded":"2023-12-22T08:47:51.948167+0000","last_fullsized":"2023-12-22T08:47:51.948167+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:48:56.542921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949850+0000","last_change":"2023-12-22T08:47:49.849970+0000","last_active":"2023-12-22T08:47:51.949850+0000","last_peered":"2023-12-22T08:47:51.949850+0000","last_clean":"2023-12-22T08:47:51.949850+0000","last_became_active":"2023-12-22T08:47:49.849506+0000","last_became_peered":"2023-12-22T08:47:49.849506+0000","last_unstale":"2023-12-22T08:47:51.949850+0000","last_undegraded":"2023-12-22T08:47:51.949850+0000","last_fullsized":"2023-12-22T08:47:51.949850+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:41.234123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948493+0000","last_change":"2023-12-22T08:47:50.356579+0000","last_active":"2023-12-22T08:47:51.948493+0000","last_peered":"2023-12-22T08:47:51.948493+0000","last_clean":"2023-12-22T08:47:51.948493+0000","last_became_active":"2023-12-22T08:47:50.351368+0000","last_became_peered":"2023-12-22T08:47:50.351368+0000","last_unstale":"2023-12-22T08:47:51.948493+0000","last_undegraded":"2023-12-22T08:47:51.948493+0000","last_fullsized":"2023-12-22T08:47:51.948493+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:38.848498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"141'8","reported_seq":19,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336169+0000","last_change":"2023-12-22T08:47:49.845685+0000","last_active":"2023-12-22T08:47:51.336169+0000","last_peered":"2023-12-22T08:47:51.336169+0000","last_clean":"2023-12-22T08:47:51.336169+0000","last_became_active":"2023-12-22T08:47:49.845106+0000","last_became_peered":"2023-12-22T08:47:49.845106+0000","last_unstale":"2023-12-22T08:47:51.336169+0000","last_undegraded":"2023-12-22T08:47:51.336169+0000","last_fullsized":"2023-12-22T08:47:51.336169+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:57:57.307093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336403+0000","last_change":"2023-12-22T08:47:50.355233+0000","last_active":"2023-12-22T08:47:51.336403+0000","last_peered":"2023-12-22T08:47:51.336403+0000","last_clean":"2023-12-22T08:47:51.336403+0000","last_became_active":"2023-12-22T08:47:50.354807+0000","last_became_peered":"2023-12-22T08:47:50.354807+0000","last_unstale":"2023-12-22T08:47:51.336403+0000","last_undegraded":"2023-12-22T08:47:51.336403+0000","last_fullsized":"2023-12-22T08:47:51.336403+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:59.492556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"141'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947029+0000","last_change":"2023-12-22T08:47:49.840680+0000","last_active":"2023-12-22T08:47:51.947029+0000","last_peered":"2023-12-22T08:47:51.947029+0000","last_clean":"2023-12-22T08:47:51.947029+0000","last_became_active":"2023-12-22T08:47:49.840245+0000","last_became_peered":"2023-12-22T08:47:49.840245+0000","last_unstale":"2023-12-22T08:47:51.947029+0000","last_undegraded":"2023-12-22T08:47:51.947029+0000","last_fullsized":"2023-12-22T08:47:51.947029+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:06:10.893474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334327+0000","last_change":"2023-12-22T08:47:50.360828+0000","last_active":"2023-12-22T08:47:51.334327+0000","last_peered":"2023-12-22T08:47:51.334327+0000","last_clean":"2023-12-22T08:47:51.334327+0000","last_became_active":"2023-12-22T08:47:50.357041+0000","last_became_peered":"2023-12-22T08:47:50.357041+0000","last_unstale":"2023-12-22T08:47:51.334327+0000","last_undegraded":"2023-12-22T08:47:51.334327+0000","last_fullsized":"2023-12-22T08:47:51.334327+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:03.081749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"141'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336989+0000","last_change":"2023-12-22T08:47:49.855927+0000","last_active":"2023-12-22T08:47:51.336989+0000","last_peered":"2023-12-22T08:47:51.336989+0000","last_clean":"2023-12-22T08:47:51.336989+0000","last_became_active":"2023-12-22T08:47:49.854626+0000","last_became_peered":"2023-12-22T08:47:49.854626+0000","last_unstale":"2023-12-22T08:47:51.336989+0000","last_undegraded":"2023-12-22T08:47:51.336989+0000","last_fullsized":"2023-12-22T08:47:51.336989+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:35.933199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.332131+0000","last_change":"2023-12-22T08:47:50.339358+0000","last_active":"2023-12-22T08:47:51.332131+0000","last_peered":"2023-12-22T08:47:51.332131+0000","last_clean":"2023-12-22T08:47:51.332131+0000","last_became_active":"2023-12-22T08:47:50.339164+0000","last_became_peered":"2023-12-22T08:47:50.339164+0000","last_unstale":"2023-12-22T08:47:51.332131+0000","last_undegraded":"2023-12-22T08:47:51.332131+0000","last_fullsized":"2023-12-22T08:47:51.332131+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:05:48.268564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"141'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948685+0000","last_change":"2023-12-22T08:47:49.844780+0000","last_active":"2023-12-22T08:47:51.948685+0000","last_peered":"2023-12-22T08:47:51.948685+0000","last_clean":"2023-12-22T08:47:51.948685+0000","last_became_active":"2023-12-22T08:47:49.844592+0000","last_became_peered":"2023-12-22T08:47:49.844592+0000","last_unstale":"2023-12-22T08:47:51.948685+0000","last_undegraded":"2023-12-22T08:47:51.948685+0000","last_fullsized":"2023-12-22T08:47:51.948685+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:33:38.928813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947914+0000","last_change":"2023-12-22T08:47:50.350557+0000","last_active":"2023-12-22T08:47:51.947914+0000","last_peered":"2023-12-22T08:47:51.947914+0000","last_clean":"2023-12-22T08:47:51.947914+0000","last_became_active":"2023-12-22T08:47:50.350297+0000","last_became_peered":"2023-12-22T08:47:50.350297+0000","last_unstale":"2023-12-22T08:47:51.947914+0000","last_undegraded":"2023-12-22T08:47:51.947914+0000","last_fullsized":"2023-12-22T08:47:51.947914+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:26.332766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947936+0000","last_change":"2023-12-22T08:47:49.850221+0000","last_active":"2023-12-22T08:47:51.947936+0000","last_peered":"2023-12-22T08:47:51.947936+0000","last_clean":"2023-12-22T08:47:51.947936+0000","last_became_active":"2023-12-22T08:47:49.849910+0000","last_became_peered":"2023-12-22T08:47:49.849910+0000","last_unstale":"2023-12-22T08:47:51.947936+0000","last_undegraded":"2023-12-22T08:47:51.947936+0000","last_fullsized":"2023-12-22T08:47:51.947936+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:41.234123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947525+0000","last_change":"2023-12-22T08:47:50.349394+0000","last_active":"2023-12-22T08:47:51.947525+0000","last_peered":"2023-12-22T08:47:51.947525+0000","last_clean":"2023-12-22T08:47:51.947525+0000","last_became_active":"2023-12-22T08:47:50.346485+0000","last_became_peered":"2023-12-22T08:47:50.346485+0000","last_unstale":"2023-12-22T08:47:51.947525+0000","last_undegraded":"2023-12-22T08:47:51.947525+0000","last_fullsized":"2023-12-22T08:47:51.947525+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:54:46.585497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"141'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.333622+0000","last_change":"2023-12-22T08:47:49.852972+0000","last_active":"2023-12-22T08:47:51.333622+0000","last_peered":"2023-12-22T08:47:51.333622+0000","last_clean":"2023-12-22T08:47:51.333622+0000","last_became_active":"2023-12-22T08:47:49.852716+0000","last_became_peered":"2023-12-22T08:47:49.852716+0000","last_unstale":"2023-12-22T08:47:51.333622+0000","last_undegraded":"2023-12-22T08:47:51.333622+0000","last_fullsized":"2023-12-22T08:47:51.333622+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:28:23.476638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.335933+0000","last_change":"2023-12-22T08:47:50.351562+0000","last_active":"2023-12-22T08:47:51.335933+0000","last_peered":"2023-12-22T08:47:51.335933+0000","last_clean":"2023-12-22T08:47:51.335933+0000","last_became_active":"2023-12-22T08:47:50.351046+0000","last_became_peered":"2023-12-22T08:47:50.351046+0000","last_unstale":"2023-12-22T08:47:51.335933+0000","last_undegraded":"2023-12-22T08:47:51.335933+0000","last_fullsized":"2023-12-22T08:47:51.335933+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:00.488867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334605+0000","last_change":"2023-12-22T08:47:49.850430+0000","last_active":"2023-12-22T08:47:51.334605+0000","last_peered":"2023-12-22T08:47:51.334605+0000","last_clean":"2023-12-22T08:47:51.334605+0000","last_became_active":"2023-12-22T08:47:49.850175+0000","last_became_peered":"2023-12-22T08:47:49.850175+0000","last_unstale":"2023-12-22T08:47:51.334605+0000","last_undegraded":"2023-12-22T08:47:51.334605+0000","last_fullsized":"2023-12-22T08:47:51.334605+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:15.872787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948197+0000","last_change":"2023-12-22T08:47:50.353301+0000","last_active":"2023-12-22T08:47:51.948197+0000","last_peered":"2023-12-22T08:47:51.948197+0000","last_clean":"2023-12-22T08:47:51.948197+0000","last_became_active":"2023-12-22T08:47:50.352789+0000","last_became_peered":"2023-12-22T08:47:50.352789+0000","last_unstale":"2023-12-22T08:47:51.948197+0000","last_undegraded":"2023-12-22T08:47:51.948197+0000","last_fullsized":"2023-12-22T08:47:51.948197+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:12:36.859618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948603+0000","last_change":"2023-12-22T08:47:49.848072+0000","last_active":"2023-12-22T08:47:51.948603+0000","last_peered":"2023-12-22T08:47:51.948603+0000","last_clean":"2023-12-22T08:47:51.948603+0000","last_became_active":"2023-12-22T08:47:49.847818+0000","last_became_peered":"2023-12-22T08:47:49.847818+0000","last_unstale":"2023-12-22T08:47:51.948603+0000","last_undegraded":"2023-12-22T08:47:51.948603+0000","last_fullsized":"2023-12-22T08:47:51.948603+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:04.221967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.335401+0000","last_change":"2023-12-22T08:47:50.364546+0000","last_active":"2023-12-22T08:47:51.335401+0000","last_peered":"2023-12-22T08:47:51.335401+0000","last_clean":"2023-12-22T08:47:51.335401+0000","last_became_active":"2023-12-22T08:47:50.363081+0000","last_became_peered":"2023-12-22T08:47:50.363081+0000","last_unstale":"2023-12-22T08:47:51.335401+0000","last_undegraded":"2023-12-22T08:47:51.335401+0000","last_fullsized":"2023-12-22T08:47:51.335401+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:37.869276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949272+0000","last_change":"2023-12-22T08:47:49.849016+0000","last_active":"2023-12-22T08:47:51.949272+0000","last_peered":"2023-12-22T08:47:51.949272+0000","last_clean":"2023-12-22T08:47:51.949272+0000","last_became_active":"2023-12-22T08:47:49.848743+0000","last_became_peered":"2023-12-22T08:47:49.848743+0000","last_unstale":"2023-12-22T08:47:51.949272+0000","last_undegraded":"2023-12-22T08:47:51.949272+0000","last_fullsized":"2023-12-22T08:47:51.949272+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:22:25.452753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947853+0000","last_change":"2023-12-22T08:47:50.345252+0000","last_active":"2023-12-22T08:47:51.947853+0000","last_peered":"2023-12-22T08:47:51.947853+0000","last_clean":"2023-12-22T08:47:51.947853+0000","last_became_active":"2023-12-22T08:47:50.344989+0000","last_became_peered":"2023-12-22T08:47:50.344989+0000","last_unstale":"2023-12-22T08:47:51.947853+0000","last_undegraded":"2023-12-22T08:47:51.947853+0000","last_fullsized":"2023-12-22T08:47:51.947853+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:03:34.184827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"141'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948838+0000","last_change":"2023-12-22T08:47:49.851684+0000","last_active":"2023-12-22T08:47:51.948838+0000","last_peered":"2023-12-22T08:47:51.948838+0000","last_clean":"2023-12-22T08:47:51.948838+0000","last_became_active":"2023-12-22T08:47:49.851403+0000","last_became_peered":"2023-12-22T08:47:49.851403+0000","last_unstale":"2023-12-22T08:47:51.948838+0000","last_undegraded":"2023-12-22T08:47:51.948838+0000","last_fullsized":"2023-12-22T08:47:51.948838+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:07:30.496575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947488+0000","last_change":"2023-12-22T08:47:50.358972+0000","last_active":"2023-12-22T08:47:51.947488+0000","last_peered":"2023-12-22T08:47:51.947488+0000","last_clean":"2023-12-22T08:47:51.947488+0000","last_became_active":"2023-12-22T08:47:50.358551+0000","last_became_peered":"2023-12-22T08:47:50.358551+0000","last_unstale":"2023-12-22T08:47:51.947488+0000","last_undegraded":"2023-12-22T08:47:51.947488+0000","last_fullsized":"2023-12-22T08:47:51.947488+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:18.069615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331602+0000","last_change":"2023-12-22T08:47:49.846633+0000","last_active":"2023-12-22T08:47:51.331602+0000","last_peered":"2023-12-22T08:47:51.331602+0000","last_clean":"2023-12-22T08:47:51.331602+0000","last_became_active":"2023-12-22T08:47:49.844374+0000","last_became_peered":"2023-12-22T08:47:49.844374+0000","last_unstale":"2023-12-22T08:47:51.331602+0000","last_undegraded":"2023-12-22T08:47:51.331602+0000","last_fullsized":"2023-12-22T08:47:51.331602+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:45:15.256608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336643+0000","last_change":"2023-12-22T08:47:50.362880+0000","last_active":"2023-12-22T08:47:51.336643+0000","last_peered":"2023-12-22T08:47:51.336643+0000","last_clean":"2023-12-22T08:47:51.336643+0000","last_became_active":"2023-12-22T08:47:50.362174+0000","last_became_peered":"2023-12-22T08:47:50.362174+0000","last_unstale":"2023-12-22T08:47:51.336643+0000","last_undegraded":"2023-12-22T08:47:51.336643+0000","last_fullsized":"2023-12-22T08:47:51.336643+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:19:27.325657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948279+0000","last_change":"2023-12-22T08:47:49.846172+0000","last_active":"2023-12-22T08:47:51.948279+0000","last_peered":"2023-12-22T08:47:51.948279+0000","last_clean":"2023-12-22T08:47:51.948279+0000","last_became_active":"2023-12-22T08:47:49.845830+0000","last_became_peered":"2023-12-22T08:47:49.845830+0000","last_unstale":"2023-12-22T08:47:51.948279+0000","last_undegraded":"2023-12-22T08:47:51.948279+0000","last_fullsized":"2023-12-22T08:47:51.948279+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:30:16.514947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948751+0000","last_change":"2023-12-22T08:47:50.353507+0000","last_active":"2023-12-22T08:47:51.948751+0000","last_peered":"2023-12-22T08:47:51.948751+0000","last_clean":"2023-12-22T08:47:51.948751+0000","last_became_active":"2023-12-22T08:47:50.353233+0000","last_became_peered":"2023-12-22T08:47:50.353233+0000","last_unstale":"2023-12-22T08:47:51.948751+0000","last_undegraded":"2023-12-22T08:47:51.948751+0000","last_fullsized":"2023-12-22T08:47:51.948751+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:00.488867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948808+0000","last_change":"2023-12-22T08:47:49.846910+0000","last_active":"2023-12-22T08:47:51.948808+0000","last_peered":"2023-12-22T08:47:51.948808+0000","last_clean":"2023-12-22T08:47:51.948808+0000","last_became_active":"2023-12-22T08:47:49.846673+0000","last_became_peered":"2023-12-22T08:47:49.846673+0000","last_unstale":"2023-12-22T08:47:51.948808+0000","last_undegraded":"2023-12-22T08:47:51.948808+0000","last_fullsized":"2023-12-22T08:47:51.948808+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:42.431853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948568+0000","last_change":"2023-12-22T08:47:50.358184+0000","last_active":"2023-12-22T08:47:51.948568+0000","last_peered":"2023-12-22T08:47:51.948568+0000","last_clean":"2023-12-22T08:47:51.948568+0000","last_became_active":"2023-12-22T08:47:50.357945+0000","last_became_peered":"2023-12-22T08:47:50.357945+0000","last_unstale":"2023-12-22T08:47:51.948568+0000","last_undegraded":"2023-12-22T08:47:51.948568+0000","last_fullsized":"2023-12-22T08:47:51.948568+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:14.630836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.332335+0000","last_change":"2023-12-22T08:47:49.845991+0000","last_active":"2023-12-22T08:47:51.332335+0000","last_peered":"2023-12-22T08:47:51.332335+0000","last_clean":"2023-12-22T08:47:51.332335+0000","last_became_active":"2023-12-22T08:47:49.845568+0000","last_became_peered":"2023-12-22T08:47:49.845568+0000","last_unstale":"2023-12-22T08:47:51.332335+0000","last_undegraded":"2023-12-22T08:47:51.332335+0000","last_fullsized":"2023-12-22T08:47:51.332335+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:48:55.526936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948436+0000","last_change":"2023-12-22T08:47:50.355663+0000","last_active":"2023-12-22T08:47:51.948436+0000","last_peered":"2023-12-22T08:47:51.948436+0000","last_clean":"2023-12-22T08:47:51.948436+0000","last_became_active":"2023-12-22T08:47:50.355434+0000","last_became_peered":"2023-12-22T08:47:50.355434+0000","last_unstale":"2023-12-22T08:47:51.948436+0000","last_undegraded":"2023-12-22T08:47:51.948436+0000","last_fullsized":"2023-12-22T08:47:51.948436+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:52:12.347927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948183+0000","last_change":"2023-12-22T08:47:49.844184+0000","last_active":"2023-12-22T08:47:51.948183+0000","last_peered":"2023-12-22T08:47:51.948183+0000","last_clean":"2023-12-22T08:47:51.948183+0000","last_became_active":"2023-12-22T08:47:49.843824+0000","last_became_peered":"2023-12-22T08:47:49.843824+0000","last_unstale":"2023-12-22T08:47:51.948183+0000","last_undegraded":"2023-12-22T08:47:51.948183+0000","last_fullsized":"2023-12-22T08:47:51.948183+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:39:03.426293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948992+0000","last_change":"2023-12-22T08:47:50.345667+0000","last_active":"2023-12-22T08:47:51.948992+0000","last_peered":"2023-12-22T08:47:51.948992+0000","last_clean":"2023-12-22T08:47:51.948992+0000","last_became_active":"2023-12-22T08:47:50.345423+0000","last_became_peered":"2023-12-22T08:47:50.345423+0000","last_unstale":"2023-12-22T08:47:51.948992+0000","last_undegraded":"2023-12-22T08:47:51.948992+0000","last_fullsized":"2023-12-22T08:47:51.948992+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:19:58.447334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336425+0000","last_change":"2023-12-22T08:47:49.845445+0000","last_active":"2023-12-22T08:47:51.336425+0000","last_peered":"2023-12-22T08:47:51.336425+0000","last_clean":"2023-12-22T08:47:51.336425+0000","last_became_active":"2023-12-22T08:47:49.844698+0000","last_became_peered":"2023-12-22T08:47:49.844698+0000","last_unstale":"2023-12-22T08:47:51.336425+0000","last_undegraded":"2023-12-22T08:47:51.336425+0000","last_fullsized":"2023-12-22T08:47:51.336425+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:21:21.600263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947244+0000","last_change":"2023-12-22T08:47:50.361301+0000","last_active":"2023-12-22T08:47:51.947244+0000","last_peered":"2023-12-22T08:47:51.947244+0000","last_clean":"2023-12-22T08:47:51.947244+0000","last_became_active":"2023-12-22T08:47:50.361042+0000","last_became_peered":"2023-12-22T08:47:50.361042+0000","last_unstale":"2023-12-22T08:47:51.947244+0000","last_undegraded":"2023-12-22T08:47:51.947244+0000","last_fullsized":"2023-12-22T08:47:51.947244+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:05.237951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947245+0000","last_change":"2023-12-22T08:47:49.842526+0000","last_active":"2023-12-22T08:47:51.947245+0000","last_peered":"2023-12-22T08:47:51.947245+0000","last_clean":"2023-12-22T08:47:51.947245+0000","last_became_active":"2023-12-22T08:47:49.842088+0000","last_became_peered":"2023-12-22T08:47:49.842088+0000","last_unstale":"2023-12-22T08:47:51.947245+0000","last_undegraded":"2023-12-22T08:47:51.947245+0000","last_fullsized":"2023-12-22T08:47:51.947245+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:58.476572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948008+0000","last_change":"2023-12-22T08:47:50.361799+0000","last_active":"2023-12-22T08:47:51.948008+0000","last_peered":"2023-12-22T08:47:51.948008+0000","last_clean":"2023-12-22T08:47:51.948008+0000","last_became_active":"2023-12-22T08:47:50.361462+0000","last_became_peered":"2023-12-22T08:47:50.361462+0000","last_unstale":"2023-12-22T08:47:51.948008+0000","last_undegraded":"2023-12-22T08:47:51.948008+0000","last_fullsized":"2023-12-22T08:47:51.948008+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:59:03.176758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949860+0000","last_change":"2023-12-22T08:47:49.835123+0000","last_active":"2023-12-22T08:47:51.949860+0000","last_peered":"2023-12-22T08:47:51.949860+0000","last_clean":"2023-12-22T08:47:51.949860+0000","last_became_active":"2023-12-22T08:47:49.834204+0000","last_became_peered":"2023-12-22T08:47:49.834204+0000","last_unstale":"2023-12-22T08:47:51.949860+0000","last_undegraded":"2023-12-22T08:47:51.949860+0000","last_fullsized":"2023-12-22T08:47:51.949860+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:44:26.374725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":273,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947900+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:47:51.947900+0000","last_peered":"2023-12-22T08:47:51.947900+0000","last_clean":"2023-12-22T08:47:51.947900+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:47:51.947900+0000","last_undegraded":"2023-12-22T08:47:51.947900+0000","last_fullsized":"2023-12-22T08:47:51.947900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574947,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":770,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194541,"statfs":{"total":200000000,"available":199210705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0960000000000001,"15min":1.0840000000000001},"min":{"1min":0.80200000000000005,"5min":0.60999999999999999,"15min":0.58199999999999996},"max":{"1min":1.5169999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.032},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1160000000000001,"15min":1.077},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.88100000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1870000000000001,"15min":1.167},"min":{"1min":0.73399999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6839999999999999,"5min":1.905,"15min":1.905},"last":1.28},{"interface":"front","average":{"1min":1.2,"5min":1.2549999999999999,"15min":1.1679999999999999},"min":{"1min":0.85099999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7709999999999999,"5min":1.865,"15min":1.865},"last":1.4470000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.163,"15min":1.089},"min":{"1min":0.89600000000000002,"5min":0.78100000000000003,"15min":0.69799999999999995},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.74},{"interface":"front","average":{"1min":1.167,"5min":1.2,"15min":1.22},"min":{"1min":0.79900000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.589,"5min":1.742,"15min":2.1379999999999999},"last":1.145}]},{"osd":3,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.23,"15min":1.133},"min":{"1min":0.94699999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.635,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3300000000000001,"15min":1.2909999999999999},"min":{"1min":0.97299999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5620000000000001,"5min":1.952,"15min":2.2959999999999998},"last":1.494}]},{"osd":4,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2050000000000001,"15min":1.2},"min":{"1min":1.032,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.603,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.2},{"interface":"front","average":{"1min":1.371,"5min":1.262,"15min":1.2629999999999999},"min":{"1min":1.0229999999999999,"5min":0.64100000000000001,"15min":0.59399999999999997},"max":{"1min":2.0840000000000001,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.613}]},{"osd":5,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.375,"15min":1.3740000000000001},"min":{"1min":0.97299999999999998,"5min":0.74299999999999999,"15min":0.51800000000000002},"max":{"1min":1.8939999999999999,"5min":2.0510000000000002,"15min":2.4300000000000002},"last":1.548},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3759999999999999,"15min":1.3740000000000001},"min":{"1min":1.135,"5min":0.76300000000000001,"15min":0.67800000000000005},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":2.3410000000000002},"last":1.663}]},{"osd":6,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.496,"15min":1.4910000000000001},"min":{"1min":1.056,"5min":0.83499999999999996,"15min":0.66900000000000004},"max":{"1min":1.9930000000000001,"5min":2.1259999999999999,"15min":2.2440000000000002},"last":1.718},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.4830000000000001,"15min":1.484},"min":{"1min":1.294,"5min":0.82299999999999995,"15min":0.71999999999999997},"max":{"1min":2.1379999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.7929999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":769,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194543,"statfs":{"total":200000000,"available":199212393,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.1479999999999999,"15min":1.1299999999999999},"min":{"1min":0.61499999999999999,"5min":0.55300000000000005,"15min":0.42099999999999999},"max":{"1min":1.6870000000000001,"5min":1.9350000000000001,"15min":3.0489999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.177,"15min":1.107},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.137}]},{"osd":1,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.125,"15min":1.0509999999999999},"min":{"1min":0.67800000000000005,"5min":0.63,"15min":0.623},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1859999999999999,"15min":1.167},"min":{"1min":0.69699999999999995,"5min":0.64500000000000002,"15min":0.63100000000000001},"max":{"1min":1.4870000000000001,"5min":1.8,"15min":1.8},"last":1.0049999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.264,"15min":1.268},"min":{"1min":0.73999999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.7090000000000001,"5min":1.7969999999999999,"15min":1.8799999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.337,"5min":1.248,"15min":1.1759999999999999},"min":{"1min":0.748,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.228}]},{"osd":3,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3169999999999999,"15min":1.3},"min":{"1min":0.79200000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.056},{"interface":"front","average":{"1min":1.24,"5min":1.258,"15min":1.2370000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.77900000000000003},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.0820000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.351,"15min":1.3859999999999999},"min":{"1min":0.90600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.391,"15min":1.397},"min":{"1min":0.88300000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.831,"5min":2.831,"15min":2.831},"last":1.321}]},{"osd":5,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3160000000000001,"15min":1.345},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.502,"15min":1.5629999999999999},"min":{"1min":1.0369999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.7949999999999999,"5min":2.1030000000000002,"15min":3.1819999999999999},"last":1.179}]},{"osd":7,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.522,"15min":1.5680000000000001},"min":{"1min":0.93300000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":1.413},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.45,"15min":1.522},"min":{"1min":0.90400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.5880000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1344,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193967,"statfs":{"total":200000000,"available":198622952,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.101,"15min":1.0800000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.65300000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.944},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1060000000000001,"15min":1.1279999999999999},"min":{"1min":0.76500000000000001,"5min":0.68899999999999995,"15min":0.67000000000000004},"max":{"1min":1.5069999999999999,"5min":1.544,"15min":3.1379999999999999},"last":1.353}]},{"osd":1,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.135,"15min":1.1160000000000001},"min":{"1min":0.88200000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5009999999999999,"5min":1.619,"15min":2.79},"last":1.228},{"interface":"front","average":{"1min":1.069,"5min":1.1120000000000001,"15min":1.04},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.64500000000000002},"max":{"1min":1.476,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.1259999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1559999999999999,"15min":1.1359999999999999},"min":{"1min":0.79200000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.5860000000000001,"5min":1.5900000000000001,"15min":1.72},"last":1.087},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2390000000000001,"15min":1.1819999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.657,"5min":1.716,"15min":1.978},"last":1.532}]},{"osd":3,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.236,"15min":1.1830000000000001},"min":{"1min":0.80200000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.5249999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.3089999999999999,"15min":1.2569999999999999},"min":{"1min":0.86399999999999999,"5min":0.77800000000000002,"15min":0.73299999999999998},"max":{"1min":1.5409999999999999,"5min":1.6619999999999999,"15min":2.1499999999999999},"last":1}]},{"osd":4,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.274,"15min":1.2549999999999999},"min":{"1min":0.63300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6879999999999999,"5min":1.7070000000000001,"15min":1.853},"last":1.474},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.262,"15min":1.258},"min":{"1min":0.93799999999999994,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.3109999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.3480000000000001,"15min":1.323},"min":{"1min":0.81799999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.6639999999999999,"5min":1.788,"15min":1.821},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.407,"15min":1.421},"min":{"1min":0.79600000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.764,"5min":1.823,"15min":2.8780000000000001},"last":1.581}]},{"osd":7,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.4330000000000001,"15min":1.3879999999999999},"min":{"1min":0.84299999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6579999999999999,"5min":1.873,"15min":2.2189999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.49,"15min":1.5529999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.75,"5min":1.8899999999999999,"15min":4.7249999999999996},"last":0.88700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574947,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":770,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194541,"statfs":{"total":200000000,"available":199210739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.02,"15min":1.01},"min":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.55,"5min":1.597,"15min":1.597},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1319999999999999,"15min":1.1060000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.552,"5min":1.796,"15min":1.796},"last":0.96099999999999997}]},{"osd":1,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.117,"15min":1.056},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.482,"5min":1.76,"15min":1.76},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.66900000000000004,"5min":0.65600000000000003,"15min":0.57399999999999995},"max":{"1min":1.5600000000000001,"5min":1.794,"15min":2.4249999999999998},"last":1.1259999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.171,"15min":1.149},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6160000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.075},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.244,"15min":1.208},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.4990000000000001,"5min":2.0830000000000002,"15min":2.1600000000000001},"last":0.998}]},{"osd":3,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2190000000000001,"15min":1.2010000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.397},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.333,"15min":1.2350000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7110000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.3560000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1890000000000001,"15min":1.145},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5580000000000001,"5min":1.639,"15min":1.639},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.4259999999999999,"15min":1.3879999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8939999999999999,"5min":1.913,"15min":2.0979999999999999},"last":1.6719999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.337,"15min":1.2589999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.58599999999999997},"max":{"1min":1.9330000000000001,"5min":2.141,"15min":2.141},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.3100000000000001,"15min":1.222},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7210000000000001,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.4510000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.4510000000000001,"15min":1.3620000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.67300000000000004},"max":{"1min":1.992,"5min":2.0089999999999999,"15min":2.1200000000000001},"last":1.764},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.5329999999999999,"15min":1.4410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.859,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.5600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":769,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194543,"statfs":{"total":200000000,"available":199212393,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90300000000000002,"15min":0.94099999999999995},"min":{"1min":0.55500000000000005,"5min":0.49299999999999999,"15min":0.39800000000000002},"max":{"1min":1.2390000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.95499999999999996,"15min":0.93300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.262,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.90800000000000003,"15min":0.86899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.528,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.04},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.208,"15min":1.1339999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.46200000000000002},"max":{"1min":1.6020000000000001,"5min":1.861,"15min":1.861},"last":0.73399999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0669999999999999,"15min":1.042},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5469999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.286},{"interface":"front","average":{"1min":1.127,"5min":1.1859999999999999,"15min":1.137},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.679,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.006}]},{"osd":4,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.276,"15min":1.2190000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.73199999999999998},"max":{"1min":2.2839999999999998,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.264,"5min":1.323,"15min":1.2470000000000001},"min":{"1min":0.91000000000000003,"5min":0.77300000000000002,"15min":0.745},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.601}]},{"osd":5,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3680000000000001,"15min":1.288},"min":{"1min":0.754,"5min":0.754,"15min":0.66700000000000004},"max":{"1min":1.9059999999999999,"5min":1.994,"15min":1.994},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.409,"15min":1.427},"min":{"1min":0.84599999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.7949999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.145}]},{"osd":6,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.478,"15min":1.4470000000000001},"min":{"1min":1.0609999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.964,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3999999999999999,"15min":1.385},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7849999999999999,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.159}]},{"osd":7,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.456,"15min":1.387},"min":{"1min":0.81299999999999994,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.851,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.21},{"interface":"front","average":{"1min":1.415,"5min":1.4630000000000001,"15min":1.405},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.80600000000000005},"max":{"1min":1.837,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.6779999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":769,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194542,"statfs":{"total":200000000,"available":199211755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.94799999999999995,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.3799999999999999,"5min":6.8879999999999999,"15min":6.8879999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.96499999999999997,"15min":0.93899999999999995},"min":{"1min":0.497,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.5609999999999999,"5min":4.5510000000000002,"15min":4.5510000000000002},"last":1.1879999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.02,"15min":0.93999999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.34000000000000002},"max":{"1min":1.302,"5min":11.308999999999999,"15min":11.308999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.077,"5min":1.093,"15min":0.95799999999999996},"min":{"1min":0.60199999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5760000000000001,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.3919999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.234,"15min":1.0529999999999999},"min":{"1min":0.56000000000000005,"5min":0.47999999999999998,"15min":0.41099999999999998},"max":{"1min":1.5589999999999999,"5min":13.087999999999999,"15min":13.087999999999999},"last":1.036},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.361,"15min":1.1299999999999999},"min":{"1min":0.78600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.742,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.593}]},{"osd":4,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.3999999999999999,"15min":1.2729999999999999},"min":{"1min":0.96399999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.3159999999999998,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.528},{"interface":"front","average":{"1min":1.306,"5min":1.4179999999999999,"15min":1.3540000000000001},"min":{"1min":0.84899999999999998,"5min":0.748,"15min":0.61499999999999999},"max":{"1min":1.6319999999999999,"5min":13.927,"15min":13.927},"last":1.0960000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.421,"15min":1.375},"min":{"1min":0.88500000000000001,"5min":0.72399999999999998,"15min":0.64000000000000001},"max":{"1min":1.9530000000000001,"5min":11.003,"15min":11.003},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.448,"15min":1.286},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6850000000000001,"5min":13.129,"15min":13.129},"last":1.2190000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.444,"15min":1.298},"min":{"1min":0.93000000000000005,"5min":0.77200000000000002,"15min":0.751},"max":{"1min":1.7909999999999999,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.5309999999999999,"15min":1.393},"min":{"1min":1.03,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0939999999999999,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":1.6499999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.4930000000000001,"15min":1.397},"min":{"1min":0.89100000000000001,"5min":0.753,"15min":0.61299999999999999},"max":{"1min":1.7090000000000001,"5min":10.948,"15min":10.948},"last":1.286},{"interface":"front","average":{"1min":1.863,"5min":1.6459999999999999,"15min":1.411},"min":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.78200000000000003},"max":{"1min":9.0239999999999991,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":1.4470000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1345,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193966,"statfs":{"total":200000000,"available":198622025,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.91200000000000003},"min":{"1min":0.44600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.244,"5min":1.1699999999999999,"15min":1.0529999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":4.2030000000000003,"5min":4.2030000000000003,"15min":4.2030000000000003},"last":0.92400000000000004}]},{"osd":2,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.98899999999999999,"15min":0.95699999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4450000000000001,"5min":1.732,"15min":1.732},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.05,"15min":0.97399999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34999999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":2.254},"last":1.0509999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.331,"15min":1.2050000000000001},"min":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.54000000000000004},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.474},{"interface":"front","average":{"1min":1.087,"5min":1.0720000000000001,"15min":0.99399999999999999},"min":{"1min":0.54000000000000004,"5min":0.497,"15min":0.47799999999999998},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.2030000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3049999999999999,"15min":1.278},"min":{"1min":0.71299999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.518,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.4359999999999999,"15min":1.3500000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.6910000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.25}]},{"osd":5,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.2949999999999999,"15min":1.248},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.536,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":1.538},{"interface":"front","average":{"1min":1.224,"5min":1.4359999999999999,"15min":1.351},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.66800000000000004},"max":{"1min":1.5720000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.4590000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.3600000000000001,"15min":1.28},"min":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.65200000000000002},"max":{"1min":1.5780000000000001,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.468,"15min":1.3899999999999999},"min":{"1min":0.80600000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.748,"5min":2.2210000000000001,"15min":2.2229999999999999},"last":1.403}]},{"osd":7,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.496,"15min":1.393},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.64400000000000002},"max":{"1min":1.7889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.306},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.486,"15min":1.4219999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.66200000000000003},"max":{"1min":1.718,"5min":4.508,"15min":4.508},"last":1.6279999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":769,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194542,"statfs":{"total":200000000,"available":199211741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.871,"15min":0.76300000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.9470000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.97599999999999998,"15min":0.91700000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.88600000000000001,"15min":0.81299999999999994},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.40600000000000003},"max":{"1min":1.341,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.131},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0700000000000001,"15min":0.96399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5409999999999999,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.083}]},{"osd":3,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1739999999999999,"15min":1.056},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.234,"15min":1.095},"min":{"1min":0.56999999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.8080000000000001,"5min":2.145,"15min":2.145},"last":1.452}]},{"osd":4,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3640000000000001,"15min":1.288},"min":{"1min":0.86299999999999999,"5min":0.80600000000000005,"15min":0.70799999999999996},"max":{"1min":2.0910000000000002,"5min":2.625,"15min":2.625},"last":1.399},{"interface":"front","average":{"1min":1.351,"5min":1.3520000000000001,"15min":1.246},"min":{"1min":0.89900000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.964,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.649}]},{"osd":5,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.417,"15min":1.2949999999999999},"min":{"1min":0.71099999999999997,"5min":0.67600000000000005,"15min":0.59299999999999997},"max":{"1min":5.4290000000000003,"5min":5.4290000000000003,"15min":5.4290000000000003},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.373,"15min":1.2889999999999999},"min":{"1min":0.79500000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.0910000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.276}]},{"osd":6,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3919999999999999,"15min":1.304},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.64800000000000002},"max":{"1min":1.8799999999999999,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.488,"15min":1.4099999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.69099999999999995},"max":{"1min":1.8620000000000001,"5min":2.577,"15min":2.577},"last":1.613}]},{"osd":7,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.4770000000000001,"15min":1.3899999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.755},"max":{"1min":1.841,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.6679999999999999},{"interface":"front","average":{"1min":1.488,"5min":1.4770000000000001,"15min":1.399},"min":{"1min":0.96499999999999997,"5min":0.749,"15min":0.749},"max":{"1min":2.1680000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.552}]}]}],"pool_statfs":[]}} 2023-12-22T08:47:54.830 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:47:55.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.085+0000 7f0cfa530640 1 Processor -- start 2023-12-22T08:47:55.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.085+0000 7f0cfa530640 1 -- start start 2023-12-22T08:47:55.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.087+0000 7f0cfa530640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0cf415b420 0x7f0cf406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:55.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.087+0000 7f0cfa530640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0cf40a44a0 0x7f0cf40708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:55.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.087+0000 7f0cfa530640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf40cdae0 con 0x7f0cf4070e30 2023-12-22T08:47:55.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.087+0000 7f0cfa530640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf4071260 con 0x7f0cf40a44a0 2023-12-22T08:47:55.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.087+0000 7f0cfa530640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf406dec0 con 0x7f0cf415b420 2023-12-22T08:47:55.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.087+0000 7f0cf8d2d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0cf40a44a0 0x7f0cf40708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:55.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.087+0000 7f0cf8d2d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0cf40a44a0 0x7f0cf40708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37042/0 (socket says 172.21.15.38:37042) 2023-12-22T08:47:55.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.087+0000 7f0cf8d2d640 1 -- 172.21.15.38:0/1978263921 learned_addr learned my addr 172.21.15.38:0/1978263921 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:55.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.088+0000 7f0cf952e640 1 --2- 172.21.15.38:0/1978263921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0cf415b420 0x7f0cf406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:55.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.088+0000 7f0cf8d2d640 1 -- 172.21.15.38:0/1978263921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0cf415b420 msgr2=0x7f0cf406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:55.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.088+0000 7f0cf8d2d640 1 --2- 172.21.15.38:0/1978263921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0cf415b420 0x7f0cf406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.088+0000 7f0cf8d2d640 1 -- 172.21.15.38:0/1978263921 >> v1:172.21.15.89:6789/0 conn(0x7f0cf4070e30 legacy=0x7f0cf406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:55.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.088+0000 7f0cf8d2d640 1 -- 172.21.15.38:0/1978263921 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf415b800 con 0x7f0cf40a44a0 2023-12-22T08:47:55.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.088+0000 7f0cf952e640 1 --2- 172.21.15.38:0/1978263921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0cf415b420 0x7f0cf406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:55.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.089+0000 7f0cf8d2d640 1 --2- 172.21.15.38:0/1978263921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf40a44a0 0x7f0cf40708f0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009870 tx=0x7f0ce402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34de1223eb7a63ef server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.089+0000 7f0cebfff640 1 -- 172.21.15.38:0/1978263921 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4031640 con 0x7f0cf40a44a0 2023-12-22T08:47:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.090+0000 7f0cebfff640 1 -- 172.21.15.38:0/1978263921 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce40317a0 con 0x7f0cf40a44a0 2023-12-22T08:47:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.090+0000 7f0cebfff640 1 -- 172.21.15.38:0/1978263921 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4031b30 con 0x7f0cf40a44a0 2023-12-22T08:47:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.090+0000 7f0cfa530640 1 -- 172.21.15.38:0/1978263921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf40a44a0 msgr2=0x7f0cf40708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.090+0000 7f0cfa530640 1 --2- 172.21.15.38:0/1978263921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf40a44a0 0x7f0cf40708f0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009870 tx=0x7f0ce402b8f0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.090+0000 7f0cfa530640 1 -- 172.21.15.38:0/1978263921 shutdown_connections 2023-12-22T08:47:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.090+0000 7f0cfa530640 1 --2- 172.21.15.38:0/1978263921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf40a44a0 0x7f0cf40708f0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.090+0000 7f0cfa530640 1 --2- 172.21.15.38:0/1978263921 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0cf415b420 0x7f0cf406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.090+0000 7f0cfa530640 1 -- 172.21.15.38:0/1978263921 >> 172.21.15.38:0/1978263921 conn(0x7f0cf40b1f70 msgr2=0x7f0cf40b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.090+0000 7f0cfa530640 1 -- 172.21.15.38:0/1978263921 shutdown_connections 2023-12-22T08:47:55.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.090+0000 7f0cfa530640 1 -- 172.21.15.38:0/1978263921 wait complete. 2023-12-22T08:47:55.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.092+0000 7f0cfa530640 1 Processor -- start 2023-12-22T08:47:55.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.092+0000 7f0cfa530640 1 -- start start 2023-12-22T08:47:55.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.093+0000 7f0cfa530640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cf4070e30 0x7f0cf41f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:55.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.093+0000 7f0cfa530640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0cf40a44a0 0x7f0cf40a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:55.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.093+0000 7f0cfa530640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf415b420 0x7f0cf415cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.093+0000 7f0cfa530640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf41f3370 con 0x7f0cf415b420 2023-12-22T08:47:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.093+0000 7f0cfa530640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40a24d0 con 0x7f0cf4070e30 2023-12-22T08:47:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.093+0000 7f0cfa530640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40a1f10 con 0x7f0cf40a44a0 2023-12-22T08:47:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.094+0000 7f0cf9d2f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf415b420 0x7f0cf415cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.094+0000 7f0cf9d2f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf415b420 0x7f0cf415cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37050/0 (socket says 172.21.15.38:37050) 2023-12-22T08:47:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.094+0000 7f0cf9d2f640 1 -- 172.21.15.38:0/2415441298 learned_addr learned my addr 172.21.15.38:0/2415441298 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.094+0000 7f0cf8d2d640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0cf40a44a0 0x7f0cf40a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.094+0000 7f0cf952e640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cf4070e30 0x7f0cf41f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:55.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.094+0000 7f0cf9d2f640 1 -- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0cf40a44a0 msgr2=0x7f0cf40a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:55.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.094+0000 7f0cf9d2f640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0cf40a44a0 0x7f0cf40a3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.094+0000 7f0cf9d2f640 1 -- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cf4070e30 msgr2=0x7f0cf41f2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:55.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.094+0000 7f0cf9d2f640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cf4070e30 0x7f0cf41f2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.094+0000 7f0cf9d2f640 1 -- 172.21.15.38:0/2415441298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce40094d0 con 0x7f0cf415b420 2023-12-22T08:47:55.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.094+0000 7f0cf8d2d640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0cf40a44a0 0x7f0cf40a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:47:55.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.095+0000 7f0cf9d2f640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf415b420 0x7f0cf415cfe0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00b970 tx=0x7f0cec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:55.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.095+0000 7f0ce9ffb640 1 -- 172.21.15.38:0/2415441298 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00cb40 con 0x7f0cf415b420 2023-12-22T08:47:55.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.095+0000 7f0ce9ffb640 1 -- 172.21.15.38:0/2415441298 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00cca0 con 0x7f0cf415b420 2023-12-22T08:47:55.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.095+0000 7f0ce9ffb640 1 -- 172.21.15.38:0/2415441298 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec014680 con 0x7f0cf415b420 2023-12-22T08:47:55.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.095+0000 7f0cfa530640 1 -- 172.21.15.38:0/2415441298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf40a21f0 con 0x7f0cf415b420 2023-12-22T08:47:55.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.095+0000 7f0cfa530640 1 -- 172.21.15.38:0/2415441298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf41559d0 con 0x7f0cf415b420 2023-12-22T08:47:55.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.096+0000 7f0cfa530640 1 -- 172.21.15.38:0/2415441298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf4155bc0 con 0x7f0cf415b420 2023-12-22T08:47:55.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.097+0000 7f0ce9ffb640 1 -- 172.21.15.38:0/2415441298 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0cec01d3b0 con 0x7f0cf415b420 2023-12-22T08:47:55.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.098+0000 7f0ce9ffb640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0cd806a430 0x7f0cd806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:55.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.098+0000 7f0ce9ffb640 1 -- 172.21.15.38:0/2415441298 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cec0886b0 con 0x7f0cf415b420 2023-12-22T08:47:55.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.099+0000 7f0cf952e640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0cd806a430 0x7f0cd806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:55.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.100+0000 7f0cf952e640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0cd806a430 0x7f0cd806c8f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000a990 tx=0x7f0cf0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:55.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.102+0000 7f0ce9ffb640 1 -- 172.21.15.38:0/2415441298 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0cec053d30 con 0x7f0cf415b420 2023-12-22T08:47:55.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.300+0000 7f0cfa530640 1 -- 172.21.15.38:0/2415441298 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0cf40ce010 con 0x7f0cd806a430 2023-12-22T08:47:55.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.323+0000 7f0ce9ffb640 1 -- 172.21.15.38:0/2415441298 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282912 (secure 0 0 0) 0x7f0cf000a710 con 0x7f0cd806a430 2023-12-22T08:47:55.328 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:55.330 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:47:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.328+0000 7f0cfa530640 1 -- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0cd806a430 msgr2=0x7f0cd806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.328+0000 7f0cfa530640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0cd806a430 0x7f0cd806c8f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000a990 tx=0x7f0cf0008040 comp rx=0 tx=0).stop 2023-12-22T08:47:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.328+0000 7f0cfa530640 1 -- 172.21.15.38:0/2415441298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf415b420 msgr2=0x7f0cf415cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.328+0000 7f0cfa530640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf415b420 0x7f0cf415cfe0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00b970 tx=0x7f0cec00be30 comp rx=0 tx=0).stop 2023-12-22T08:47:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.328+0000 7f0cfa530640 1 -- 172.21.15.38:0/2415441298 shutdown_connections 2023-12-22T08:47:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.328+0000 7f0cfa530640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0cd806a430 0x7f0cd806c8f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.328+0000 7f0cfa530640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf415b420 0x7f0cf415cfe0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.328+0000 7f0cfa530640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0cf40a44a0 0x7f0cf40a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.328+0000 7f0cfa530640 1 --2- 172.21.15.38:0/2415441298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cf4070e30 0x7f0cf41f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.328+0000 7f0cfa530640 1 -- 172.21.15.38:0/2415441298 >> 172.21.15.38:0/2415441298 conn(0x7f0cf40b1f70 msgr2=0x7f0cf40cb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.328+0000 7f0cfa530640 1 -- 172.21.15.38:0/2415441298 shutdown_connections 2023-12-22T08:47:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.328+0000 7f0cfa530640 1 -- 172.21.15.38:0/2415441298 wait complete. 2023-12-22T08:47:55.348 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":377,"stamp":"2023-12-22T08:47:54.529653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7309,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555190,"statfs":{"total":1600000000,"available":1592514703,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.724530"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334201+0000","last_change":"2023-12-22T08:47:50.352340+0000","last_active":"2023-12-22T08:47:51.334201+0000","last_peered":"2023-12-22T08:47:51.334201+0000","last_clean":"2023-12-22T08:47:51.334201+0000","last_became_active":"2023-12-22T08:47:50.351474+0000","last_became_peered":"2023-12-22T08:47:50.351474+0000","last_unstale":"2023-12-22T08:47:51.334201+0000","last_undegraded":"2023-12-22T08:47:51.334201+0000","last_fullsized":"2023-12-22T08:47:51.334201+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:06:11.909459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949596+0000","last_change":"2023-12-22T08:47:50.352848+0000","last_active":"2023-12-22T08:47:51.949596+0000","last_peered":"2023-12-22T08:47:51.949596+0000","last_clean":"2023-12-22T08:47:51.949596+0000","last_became_active":"2023-12-22T08:47:50.352276+0000","last_became_peered":"2023-12-22T08:47:50.352276+0000","last_unstale":"2023-12-22T08:47:51.949596+0000","last_undegraded":"2023-12-22T08:47:51.949596+0000","last_fullsized":"2023-12-22T08:47:51.949596+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:42:10.636165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947081+0000","last_change":"2023-12-22T08:47:50.352006+0000","last_active":"2023-12-22T08:47:51.947081+0000","last_peered":"2023-12-22T08:47:51.947081+0000","last_clean":"2023-12-22T08:47:51.947081+0000","last_became_active":"2023-12-22T08:47:50.350843+0000","last_became_peered":"2023-12-22T08:47:50.350843+0000","last_unstale":"2023-12-22T08:47:51.947081+0000","last_undegraded":"2023-12-22T08:47:51.947081+0000","last_fullsized":"2023-12-22T08:47:51.947081+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:12:36.859618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947608+0000","last_change":"2023-12-22T08:47:50.358176+0000","last_active":"2023-12-22T08:47:51.947608+0000","last_peered":"2023-12-22T08:47:51.947608+0000","last_clean":"2023-12-22T08:47:51.947608+0000","last_became_active":"2023-12-22T08:47:50.357829+0000","last_became_peered":"2023-12-22T08:47:50.357829+0000","last_unstale":"2023-12-22T08:47:51.947608+0000","last_undegraded":"2023-12-22T08:47:51.947608+0000","last_fullsized":"2023-12-22T08:47:51.947608+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:30:56.551048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336557+0000","last_change":"2023-12-22T08:47:50.359418+0000","last_active":"2023-12-22T08:47:51.336557+0000","last_peered":"2023-12-22T08:47:51.336557+0000","last_clean":"2023-12-22T08:47:51.336557+0000","last_became_active":"2023-12-22T08:47:50.359141+0000","last_became_peered":"2023-12-22T08:47:50.359141+0000","last_unstale":"2023-12-22T08:47:51.336557+0000","last_undegraded":"2023-12-22T08:47:51.336557+0000","last_fullsized":"2023-12-22T08:47:51.336557+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:57:58.323078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.946976+0000","last_change":"2023-12-22T08:47:50.364594+0000","last_active":"2023-12-22T08:47:51.946976+0000","last_peered":"2023-12-22T08:47:51.946976+0000","last_clean":"2023-12-22T08:47:51.946976+0000","last_became_active":"2023-12-22T08:47:50.364194+0000","last_became_peered":"2023-12-22T08:47:50.364194+0000","last_unstale":"2023-12-22T08:47:51.946976+0000","last_undegraded":"2023-12-22T08:47:51.946976+0000","last_fullsized":"2023-12-22T08:47:51.946976+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:29:23.249680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331602+0000","last_change":"2023-12-22T08:47:50.342266+0000","last_active":"2023-12-22T08:47:51.331602+0000","last_peered":"2023-12-22T08:47:51.331602+0000","last_clean":"2023-12-22T08:47:51.331602+0000","last_became_active":"2023-12-22T08:47:50.341970+0000","last_became_peered":"2023-12-22T08:47:50.341970+0000","last_unstale":"2023-12-22T08:47:51.331602+0000","last_undegraded":"2023-12-22T08:47:51.331602+0000","last_fullsized":"2023-12-22T08:47:51.331602+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:11:45.013951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331355+0000","last_change":"2023-12-22T08:47:50.347624+0000","last_active":"2023-12-22T08:47:51.331355+0000","last_peered":"2023-12-22T08:47:51.331355+0000","last_clean":"2023-12-22T08:47:51.331355+0000","last_became_active":"2023-12-22T08:47:50.347393+0000","last_became_peered":"2023-12-22T08:47:50.347393+0000","last_unstale":"2023-12-22T08:47:51.331355+0000","last_undegraded":"2023-12-22T08:47:51.331355+0000","last_fullsized":"2023-12-22T08:47:51.331355+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:48.773460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.333849+0000","last_change":"2023-12-22T08:47:50.366320+0000","last_active":"2023-12-22T08:47:51.333849+0000","last_peered":"2023-12-22T08:47:51.333849+0000","last_clean":"2023-12-22T08:47:51.333849+0000","last_became_active":"2023-12-22T08:47:50.365995+0000","last_became_peered":"2023-12-22T08:47:50.365995+0000","last_unstale":"2023-12-22T08:47:51.333849+0000","last_undegraded":"2023-12-22T08:47:51.333849+0000","last_fullsized":"2023-12-22T08:47:51.333849+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:44:27.390709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.335741+0000","last_change":"2023-12-22T08:47:50.357491+0000","last_active":"2023-12-22T08:47:51.335741+0000","last_peered":"2023-12-22T08:47:51.335741+0000","last_clean":"2023-12-22T08:47:51.335741+0000","last_became_active":"2023-12-22T08:47:50.356906+0000","last_became_peered":"2023-12-22T08:47:50.356906+0000","last_unstale":"2023-12-22T08:47:51.335741+0000","last_undegraded":"2023-12-22T08:47:51.335741+0000","last_fullsized":"2023-12-22T08:47:51.335741+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:16.888772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331854+0000","last_change":"2023-12-22T08:47:50.342374+0000","last_active":"2023-12-22T08:47:51.331854+0000","last_peered":"2023-12-22T08:47:51.331854+0000","last_clean":"2023-12-22T08:47:51.331854+0000","last_became_active":"2023-12-22T08:47:50.342144+0000","last_became_peered":"2023-12-22T08:47:50.342144+0000","last_unstale":"2023-12-22T08:47:51.331854+0000","last_undegraded":"2023-12-22T08:47:51.331854+0000","last_fullsized":"2023-12-22T08:47:51.331854+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:28:01.178987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.333552+0000","last_change":"2023-12-22T08:47:50.353503+0000","last_active":"2023-12-22T08:47:51.333552+0000","last_peered":"2023-12-22T08:47:51.333552+0000","last_clean":"2023-12-22T08:47:51.333552+0000","last_became_active":"2023-12-22T08:47:50.353186+0000","last_became_peered":"2023-12-22T08:47:50.353186+0000","last_unstale":"2023-12-22T08:47:51.333552+0000","last_undegraded":"2023-12-22T08:47:51.333552+0000","last_fullsized":"2023-12-22T08:47:51.333552+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:21:22.616248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948151+0000","last_change":"2023-12-22T08:47:50.354955+0000","last_active":"2023-12-22T08:47:51.948151+0000","last_peered":"2023-12-22T08:47:51.948151+0000","last_clean":"2023-12-22T08:47:51.948151+0000","last_became_active":"2023-12-22T08:47:50.354603+0000","last_became_peered":"2023-12-22T08:47:50.354603+0000","last_unstale":"2023-12-22T08:47:51.948151+0000","last_undegraded":"2023-12-22T08:47:51.948151+0000","last_fullsized":"2023-12-22T08:47:51.948151+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:18.069615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948240+0000","last_change":"2023-12-22T08:47:50.345176+0000","last_active":"2023-12-22T08:47:51.948240+0000","last_peered":"2023-12-22T08:47:51.948240+0000","last_clean":"2023-12-22T08:47:51.948240+0000","last_became_active":"2023-12-22T08:47:50.344788+0000","last_became_peered":"2023-12-22T08:47:50.344788+0000","last_unstale":"2023-12-22T08:47:51.948240+0000","last_undegraded":"2023-12-22T08:47:51.948240+0000","last_fullsized":"2023-12-22T08:47:51.948240+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:36:37.683576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336150+0000","last_change":"2023-12-22T08:47:50.363067+0000","last_active":"2023-12-22T08:47:51.336150+0000","last_peered":"2023-12-22T08:47:51.336150+0000","last_clean":"2023-12-22T08:47:51.336150+0000","last_became_active":"2023-12-22T08:47:50.362499+0000","last_became_peered":"2023-12-22T08:47:50.362499+0000","last_unstale":"2023-12-22T08:47:51.336150+0000","last_undegraded":"2023-12-22T08:47:51.336150+0000","last_fullsized":"2023-12-22T08:47:51.336150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:54:19.066048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.335378+0000","last_change":"2023-12-22T08:47:50.348441+0000","last_active":"2023-12-22T08:47:51.335378+0000","last_peered":"2023-12-22T08:47:51.335378+0000","last_clean":"2023-12-22T08:47:51.335378+0000","last_became_active":"2023-12-22T08:47:50.340946+0000","last_became_peered":"2023-12-22T08:47:50.340946+0000","last_unstale":"2023-12-22T08:47:51.335378+0000","last_undegraded":"2023-12-22T08:47:51.335378+0000","last_fullsized":"2023-12-22T08:47:51.335378+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:39:04.442278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.946965+0000","last_change":"2023-12-22T08:47:50.347454+0000","last_active":"2023-12-22T08:47:51.946965+0000","last_peered":"2023-12-22T08:47:51.946965+0000","last_clean":"2023-12-22T08:47:51.946965+0000","last_became_active":"2023-12-22T08:47:50.347149+0000","last_became_peered":"2023-12-22T08:47:50.347149+0000","last_unstale":"2023-12-22T08:47:51.946965+0000","last_undegraded":"2023-12-22T08:47:51.946965+0000","last_fullsized":"2023-12-22T08:47:51.946965+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:19:58.447334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331455+0000","last_change":"2023-12-22T08:47:50.348686+0000","last_active":"2023-12-22T08:47:51.331455+0000","last_peered":"2023-12-22T08:47:51.331455+0000","last_clean":"2023-12-22T08:47:51.331455+0000","last_became_active":"2023-12-22T08:47:50.348483+0000","last_became_peered":"2023-12-22T08:47:50.348483+0000","last_unstale":"2023-12-22T08:47:51.331455+0000","last_undegraded":"2023-12-22T08:47:51.331455+0000","last_fullsized":"2023-12-22T08:47:51.331455+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:48:03.423989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947121+0000","last_change":"2023-12-22T08:47:50.354145+0000","last_active":"2023-12-22T08:47:51.947121+0000","last_peered":"2023-12-22T08:47:51.947121+0000","last_clean":"2023-12-22T08:47:51.947121+0000","last_became_active":"2023-12-22T08:47:50.353896+0000","last_became_peered":"2023-12-22T08:47:50.353896+0000","last_unstale":"2023-12-22T08:47:51.947121+0000","last_undegraded":"2023-12-22T08:47:51.947121+0000","last_fullsized":"2023-12-22T08:47:51.947121+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:58:50.033419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949079+0000","last_change":"2023-12-22T08:47:50.360929+0000","last_active":"2023-12-22T08:47:51.949079+0000","last_peered":"2023-12-22T08:47:51.949079+0000","last_clean":"2023-12-22T08:47:51.949079+0000","last_became_active":"2023-12-22T08:47:50.360699+0000","last_became_peered":"2023-12-22T08:47:50.360699+0000","last_unstale":"2023-12-22T08:47:51.949079+0000","last_undegraded":"2023-12-22T08:47:51.949079+0000","last_fullsized":"2023-12-22T08:47:51.949079+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:56:02.995508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.332126+0000","last_change":"2023-12-22T08:47:50.355486+0000","last_active":"2023-12-22T08:47:51.332126+0000","last_peered":"2023-12-22T08:47:51.332126+0000","last_clean":"2023-12-22T08:47:51.332126+0000","last_became_active":"2023-12-22T08:47:50.355132+0000","last_became_peered":"2023-12-22T08:47:50.355132+0000","last_unstale":"2023-12-22T08:47:51.332126+0000","last_undegraded":"2023-12-22T08:47:51.332126+0000","last_fullsized":"2023-12-22T08:47:51.332126+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:28:20.143568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947240+0000","last_change":"2023-12-22T08:47:50.358792+0000","last_active":"2023-12-22T08:47:51.947240+0000","last_peered":"2023-12-22T08:47:51.947240+0000","last_clean":"2023-12-22T08:47:51.947240+0000","last_became_active":"2023-12-22T08:47:50.354322+0000","last_became_peered":"2023-12-22T08:47:50.354322+0000","last_unstale":"2023-12-22T08:47:51.947240+0000","last_undegraded":"2023-12-22T08:47:51.947240+0000","last_fullsized":"2023-12-22T08:47:51.947240+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:36:13.756474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947370+0000","last_change":"2023-12-22T08:47:50.349185+0000","last_active":"2023-12-22T08:47:51.947370+0000","last_peered":"2023-12-22T08:47:51.947370+0000","last_clean":"2023-12-22T08:47:51.947370+0000","last_became_active":"2023-12-22T08:47:50.348508+0000","last_became_peered":"2023-12-22T08:47:50.348508+0000","last_unstale":"2023-12-22T08:47:51.947370+0000","last_undegraded":"2023-12-22T08:47:51.947370+0000","last_fullsized":"2023-12-22T08:47:51.947370+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:14.630836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947871+0000","last_change":"2023-12-22T08:47:50.354014+0000","last_active":"2023-12-22T08:47:51.947871+0000","last_peered":"2023-12-22T08:47:51.947871+0000","last_clean":"2023-12-22T08:47:51.947871+0000","last_became_active":"2023-12-22T08:47:50.353332+0000","last_became_peered":"2023-12-22T08:47:50.353332+0000","last_unstale":"2023-12-22T08:47:51.947871+0000","last_undegraded":"2023-12-22T08:47:51.947871+0000","last_fullsized":"2023-12-22T08:47:51.947871+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:45:16.272592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331355+0000","last_change":"2023-12-22T08:47:50.343675+0000","last_active":"2023-12-22T08:47:51.331355+0000","last_peered":"2023-12-22T08:47:51.331355+0000","last_clean":"2023-12-22T08:47:51.331355+0000","last_became_active":"2023-12-22T08:47:50.343459+0000","last_became_peered":"2023-12-22T08:47:50.343459+0000","last_unstale":"2023-12-22T08:47:51.331355+0000","last_undegraded":"2023-12-22T08:47:51.331355+0000","last_fullsized":"2023-12-22T08:47:51.331355+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:21:58.377872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947490+0000","last_change":"2023-12-22T08:47:50.353348+0000","last_active":"2023-12-22T08:47:51.947490+0000","last_peered":"2023-12-22T08:47:51.947490+0000","last_clean":"2023-12-22T08:47:51.947490+0000","last_became_active":"2023-12-22T08:47:50.353037+0000","last_became_peered":"2023-12-22T08:47:50.353037+0000","last_unstale":"2023-12-22T08:47:51.947490+0000","last_undegraded":"2023-12-22T08:47:51.947490+0000","last_fullsized":"2023-12-22T08:47:51.947490+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:43.447838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948266+0000","last_change":"2023-12-22T08:47:50.357506+0000","last_active":"2023-12-22T08:47:51.948266+0000","last_peered":"2023-12-22T08:47:51.948266+0000","last_clean":"2023-12-22T08:47:51.948266+0000","last_became_active":"2023-12-22T08:47:50.357004+0000","last_became_peered":"2023-12-22T08:47:50.357004+0000","last_unstale":"2023-12-22T08:47:51.948266+0000","last_undegraded":"2023-12-22T08:47:51.948266+0000","last_fullsized":"2023-12-22T08:47:51.948266+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:45:34.129055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.946976+0000","last_change":"2023-12-22T08:47:50.363143+0000","last_active":"2023-12-22T08:47:51.946976+0000","last_peered":"2023-12-22T08:47:51.946976+0000","last_clean":"2023-12-22T08:47:51.946976+0000","last_became_active":"2023-12-22T08:47:50.362908+0000","last_became_peered":"2023-12-22T08:47:50.362908+0000","last_unstale":"2023-12-22T08:47:51.946976+0000","last_undegraded":"2023-12-22T08:47:51.946976+0000","last_fullsized":"2023-12-22T08:47:51.946976+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:22:26.468738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948496+0000","last_change":"2023-12-22T08:47:50.345016+0000","last_active":"2023-12-22T08:47:51.948496+0000","last_peered":"2023-12-22T08:47:51.948496+0000","last_clean":"2023-12-22T08:47:51.948496+0000","last_became_active":"2023-12-22T08:47:50.344183+0000","last_became_peered":"2023-12-22T08:47:50.344183+0000","last_unstale":"2023-12-22T08:47:51.948496+0000","last_undegraded":"2023-12-22T08:47:51.948496+0000","last_fullsized":"2023-12-22T08:47:51.948496+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:58:50.033419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331478+0000","last_change":"2023-12-22T08:47:50.353753+0000","last_active":"2023-12-22T08:47:51.331478+0000","last_peered":"2023-12-22T08:47:51.331478+0000","last_clean":"2023-12-22T08:47:51.331478+0000","last_became_active":"2023-12-22T08:47:50.353528+0000","last_became_peered":"2023-12-22T08:47:50.353528+0000","last_unstale":"2023-12-22T08:47:51.331478+0000","last_undegraded":"2023-12-22T08:47:51.331478+0000","last_fullsized":"2023-12-22T08:47:51.331478+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:32.187056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334428+0000","last_change":"2023-12-22T08:47:50.351886+0000","last_active":"2023-12-22T08:47:51.334428+0000","last_peered":"2023-12-22T08:47:51.334428+0000","last_clean":"2023-12-22T08:47:51.334428+0000","last_became_active":"2023-12-22T08:47:50.350892+0000","last_became_peered":"2023-12-22T08:47:50.350892+0000","last_unstale":"2023-12-22T08:47:51.334428+0000","last_undegraded":"2023-12-22T08:47:51.334428+0000","last_fullsized":"2023-12-22T08:47:51.334428+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:55:12.199121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.333960+0000","last_change":"2023-12-22T08:47:50.344606+0000","last_active":"2023-12-22T08:47:51.333960+0000","last_peered":"2023-12-22T08:47:51.333960+0000","last_clean":"2023-12-22T08:47:51.333960+0000","last_became_active":"2023-12-22T08:47:50.344093+0000","last_became_peered":"2023-12-22T08:47:50.344093+0000","last_unstale":"2023-12-22T08:47:51.333960+0000","last_undegraded":"2023-12-22T08:47:51.333960+0000","last_fullsized":"2023-12-22T08:47:51.333960+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:51:36.972891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334097+0000","last_change":"2023-12-22T08:47:50.360981+0000","last_active":"2023-12-22T08:47:51.334097+0000","last_peered":"2023-12-22T08:47:51.334097+0000","last_clean":"2023-12-22T08:47:51.334097+0000","last_became_active":"2023-12-22T08:47:50.360375+0000","last_became_peered":"2023-12-22T08:47:50.360375+0000","last_unstale":"2023-12-22T08:47:51.334097+0000","last_undegraded":"2023-12-22T08:47:51.334097+0000","last_fullsized":"2023-12-22T08:47:51.334097+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:02:09.526119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"141'4","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948137+0000","last_change":"2023-12-22T08:47:49.843225+0000","last_active":"2023-12-22T08:47:51.948137+0000","last_peered":"2023-12-22T08:47:51.948137+0000","last_clean":"2023-12-22T08:47:51.948137+0000","last_became_active":"2023-12-22T08:47:49.842899+0000","last_became_peered":"2023-12-22T08:47:49.842899+0000","last_unstale":"2023-12-22T08:47:51.948137+0000","last_undegraded":"2023-12-22T08:47:51.948137+0000","last_fullsized":"2023-12-22T08:47:51.948137+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:39:58.328498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947618+0000","last_change":"2023-12-22T08:47:50.348894+0000","last_active":"2023-12-22T08:47:51.947618+0000","last_peered":"2023-12-22T08:47:51.947618+0000","last_clean":"2023-12-22T08:47:51.947618+0000","last_became_active":"2023-12-22T08:47:50.348180+0000","last_became_peered":"2023-12-22T08:47:50.348180+0000","last_unstale":"2023-12-22T08:47:51.947618+0000","last_undegraded":"2023-12-22T08:47:51.947618+0000","last_fullsized":"2023-12-22T08:47:51.947618+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:56:02.995508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"141'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948742+0000","last_change":"2023-12-22T08:47:49.843603+0000","last_active":"2023-12-22T08:47:51.948742+0000","last_peered":"2023-12-22T08:47:51.948742+0000","last_clean":"2023-12-22T08:47:51.948742+0000","last_became_active":"2023-12-22T08:47:49.843329+0000","last_became_peered":"2023-12-22T08:47:49.843329+0000","last_unstale":"2023-12-22T08:47:51.948742+0000","last_undegraded":"2023-12-22T08:47:51.948742+0000","last_fullsized":"2023-12-22T08:47:51.948742+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:02:08.510134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947733+0000","last_change":"2023-12-22T08:47:50.364443+0000","last_active":"2023-12-22T08:47:51.947733+0000","last_peered":"2023-12-22T08:47:51.947733+0000","last_clean":"2023-12-22T08:47:51.947733+0000","last_became_active":"2023-12-22T08:47:50.363827+0000","last_became_peered":"2023-12-22T08:47:50.363827+0000","last_unstale":"2023-12-22T08:47:51.947733+0000","last_undegraded":"2023-12-22T08:47:51.947733+0000","last_fullsized":"2023-12-22T08:47:51.947733+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:59.384521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"141'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948401+0000","last_change":"2023-12-22T08:47:49.853114+0000","last_active":"2023-12-22T08:47:51.948401+0000","last_peered":"2023-12-22T08:47:51.948401+0000","last_clean":"2023-12-22T08:47:51.948401+0000","last_became_active":"2023-12-22T08:47:49.852882+0000","last_became_peered":"2023-12-22T08:47:49.852882+0000","last_unstale":"2023-12-22T08:47:51.948401+0000","last_undegraded":"2023-12-22T08:47:51.948401+0000","last_fullsized":"2023-12-22T08:47:51.948401+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:21.383268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949323+0000","last_change":"2023-12-22T08:47:50.358130+0000","last_active":"2023-12-22T08:47:51.949323+0000","last_peered":"2023-12-22T08:47:51.949323+0000","last_clean":"2023-12-22T08:47:51.949323+0000","last_became_active":"2023-12-22T08:47:50.357887+0000","last_became_peered":"2023-12-22T08:47:50.357887+0000","last_unstale":"2023-12-22T08:47:51.949323+0000","last_undegraded":"2023-12-22T08:47:51.949323+0000","last_fullsized":"2023-12-22T08:47:51.949323+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:36:37.683576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"141'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948784+0000","last_change":"2023-12-22T08:47:49.852454+0000","last_active":"2023-12-22T08:47:51.948784+0000","last_peered":"2023-12-22T08:47:51.948784+0000","last_clean":"2023-12-22T08:47:51.948784+0000","last_became_active":"2023-12-22T08:47:49.852235+0000","last_became_peered":"2023-12-22T08:47:49.852235+0000","last_unstale":"2023-12-22T08:47:51.948784+0000","last_undegraded":"2023-12-22T08:47:51.948784+0000","last_fullsized":"2023-12-22T08:47:51.948784+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:29:22.233695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947557+0000","last_change":"2023-12-22T08:47:50.359149+0000","last_active":"2023-12-22T08:47:51.947557+0000","last_peered":"2023-12-22T08:47:51.947557+0000","last_clean":"2023-12-22T08:47:51.947557+0000","last_became_active":"2023-12-22T08:47:50.353233+0000","last_became_peered":"2023-12-22T08:47:50.353233+0000","last_unstale":"2023-12-22T08:47:51.947557+0000","last_undegraded":"2023-12-22T08:47:51.947557+0000","last_fullsized":"2023-12-22T08:47:51.947557+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:06:25.571324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"141'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948806+0000","last_change":"2023-12-22T08:47:49.846743+0000","last_active":"2023-12-22T08:47:51.948806+0000","last_peered":"2023-12-22T08:47:51.948806+0000","last_clean":"2023-12-22T08:47:51.948806+0000","last_became_active":"2023-12-22T08:47:49.846303+0000","last_became_peered":"2023-12-22T08:47:49.846303+0000","last_unstale":"2023-12-22T08:47:51.948806+0000","last_undegraded":"2023-12-22T08:47:51.948806+0000","last_fullsized":"2023-12-22T08:47:51.948806+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:39:03.426293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331849+0000","last_change":"2023-12-22T08:47:50.335851+0000","last_active":"2023-12-22T08:47:51.331849+0000","last_peered":"2023-12-22T08:47:51.331849+0000","last_clean":"2023-12-22T08:47:51.331849+0000","last_became_active":"2023-12-22T08:47:50.335577+0000","last_became_peered":"2023-12-22T08:47:50.335577+0000","last_unstale":"2023-12-22T08:47:51.331849+0000","last_undegraded":"2023-12-22T08:47:51.331849+0000","last_fullsized":"2023-12-22T08:47:51.331849+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:19.529050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"141'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.335700+0000","last_change":"2023-12-22T08:47:49.843449+0000","last_active":"2023-12-22T08:47:51.335700+0000","last_peered":"2023-12-22T08:47:51.335700+0000","last_clean":"2023-12-22T08:47:51.335700+0000","last_became_active":"2023-12-22T08:47:49.843133+0000","last_became_peered":"2023-12-22T08:47:49.843133+0000","last_unstale":"2023-12-22T08:47:51.335700+0000","last_undegraded":"2023-12-22T08:47:51.335700+0000","last_fullsized":"2023-12-22T08:47:51.335700+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:36.853291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.335177+0000","last_change":"2023-12-22T08:47:50.358655+0000","last_active":"2023-12-22T08:47:51.335177+0000","last_peered":"2023-12-22T08:47:51.335177+0000","last_clean":"2023-12-22T08:47:51.335177+0000","last_became_active":"2023-12-22T08:47:50.357269+0000","last_became_peered":"2023-12-22T08:47:50.357269+0000","last_unstale":"2023-12-22T08:47:51.335177+0000","last_undegraded":"2023-12-22T08:47:51.335177+0000","last_fullsized":"2023-12-22T08:47:51.335177+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:54:46.585497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.332180+0000","last_change":"2023-12-22T08:47:49.852011+0000","last_active":"2023-12-22T08:47:51.332180+0000","last_peered":"2023-12-22T08:47:51.332180+0000","last_clean":"2023-12-22T08:47:51.332180+0000","last_became_active":"2023-12-22T08:47:49.851717+0000","last_became_peered":"2023-12-22T08:47:49.851717+0000","last_unstale":"2023-12-22T08:47:51.332180+0000","last_undegraded":"2023-12-22T08:47:51.332180+0000","last_fullsized":"2023-12-22T08:47:51.332180+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:37.832514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331768+0000","last_change":"2023-12-22T08:47:50.343488+0000","last_active":"2023-12-22T08:47:51.331768+0000","last_peered":"2023-12-22T08:47:51.331768+0000","last_clean":"2023-12-22T08:47:51.331768+0000","last_became_active":"2023-12-22T08:47:50.343254+0000","last_became_peered":"2023-12-22T08:47:50.343254+0000","last_unstale":"2023-12-22T08:47:51.331768+0000","last_undegraded":"2023-12-22T08:47:51.331768+0000","last_fullsized":"2023-12-22T08:47:51.331768+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:23:46.194398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336322+0000","last_change":"2023-12-22T08:47:49.856170+0000","last_active":"2023-12-22T08:47:51.336322+0000","last_peered":"2023-12-22T08:47:51.336322+0000","last_clean":"2023-12-22T08:47:51.336322+0000","last_became_active":"2023-12-22T08:47:49.855005+0000","last_became_peered":"2023-12-22T08:47:49.855005+0000","last_unstale":"2023-12-22T08:47:51.336322+0000","last_undegraded":"2023-12-22T08:47:51.336322+0000","last_fullsized":"2023-12-22T08:47:51.336322+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:23:39.671198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949749+0000","last_change":"2023-12-22T08:47:50.352636+0000","last_active":"2023-12-22T08:47:51.949749+0000","last_peered":"2023-12-22T08:47:51.949749+0000","last_clean":"2023-12-22T08:47:51.949749+0000","last_became_active":"2023-12-22T08:47:50.351954+0000","last_became_peered":"2023-12-22T08:47:50.351954+0000","last_unstale":"2023-12-22T08:47:51.949749+0000","last_undegraded":"2023-12-22T08:47:51.949749+0000","last_fullsized":"2023-12-22T08:47:51.949749+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:26.637741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948995+0000","last_change":"2023-12-22T08:47:49.851210+0000","last_active":"2023-12-22T08:47:51.948995+0000","last_peered":"2023-12-22T08:47:51.948995+0000","last_clean":"2023-12-22T08:47:51.948995+0000","last_became_active":"2023-12-22T08:47:49.850858+0000","last_became_peered":"2023-12-22T08:47:49.850858+0000","last_unstale":"2023-12-22T08:47:51.948995+0000","last_undegraded":"2023-12-22T08:47:51.948995+0000","last_fullsized":"2023-12-22T08:47:51.948995+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:36:12.740489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.946930+0000","last_change":"2023-12-22T08:47:50.351864+0000","last_active":"2023-12-22T08:47:51.946930+0000","last_peered":"2023-12-22T08:47:51.946930+0000","last_clean":"2023-12-22T08:47:51.946930+0000","last_became_active":"2023-12-22T08:47:50.351636+0000","last_became_peered":"2023-12-22T08:47:50.351636+0000","last_unstale":"2023-12-22T08:47:51.946930+0000","last_undegraded":"2023-12-22T08:47:51.946930+0000","last_fullsized":"2023-12-22T08:47:51.946930+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:59.384521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334348+0000","last_change":"2023-12-22T08:47:49.852394+0000","last_active":"2023-12-22T08:47:51.334348+0000","last_peered":"2023-12-22T08:47:51.334348+0000","last_clean":"2023-12-22T08:47:51.334348+0000","last_became_active":"2023-12-22T08:47:49.852148+0000","last_became_peered":"2023-12-22T08:47:49.852148+0000","last_unstale":"2023-12-22T08:47:51.334348+0000","last_undegraded":"2023-12-22T08:47:51.334348+0000","last_fullsized":"2023-12-22T08:47:51.334348+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:52:32.939978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.946802+0000","last_change":"2023-12-22T08:47:50.359828+0000","last_active":"2023-12-22T08:47:51.946802+0000","last_peered":"2023-12-22T08:47:51.946802+0000","last_clean":"2023-12-22T08:47:51.946802+0000","last_became_active":"2023-12-22T08:47:50.359501+0000","last_became_peered":"2023-12-22T08:47:50.359501+0000","last_unstale":"2023-12-22T08:47:51.946802+0000","last_undegraded":"2023-12-22T08:47:51.946802+0000","last_fullsized":"2023-12-22T08:47:51.946802+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:07:31.512559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"141'3","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.333399+0000","last_change":"2023-12-22T08:47:49.851254+0000","last_active":"2023-12-22T08:47:51.333399+0000","last_peered":"2023-12-22T08:47:51.333399+0000","last_clean":"2023-12-22T08:47:51.333399+0000","last_became_active":"2023-12-22T08:47:49.850908+0000","last_became_peered":"2023-12-22T08:47:49.850908+0000","last_unstale":"2023-12-22T08:47:51.333399+0000","last_undegraded":"2023-12-22T08:47:51.333399+0000","last_fullsized":"2023-12-22T08:47:51.333399+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:39:22.944671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331552+0000","last_change":"2023-12-22T08:47:50.346317+0000","last_active":"2023-12-22T08:47:51.331552+0000","last_peered":"2023-12-22T08:47:51.331552+0000","last_clean":"2023-12-22T08:47:51.331552+0000","last_became_active":"2023-12-22T08:47:50.346086+0000","last_became_peered":"2023-12-22T08:47:50.346086+0000","last_unstale":"2023-12-22T08:47:51.331552+0000","last_undegraded":"2023-12-22T08:47:51.331552+0000","last_fullsized":"2023-12-22T08:47:51.331552+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:45:16.178742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"141'6","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948151+0000","last_change":"2023-12-22T08:47:49.852747+0000","last_active":"2023-12-22T08:47:51.948151+0000","last_peered":"2023-12-22T08:47:51.948151+0000","last_clean":"2023-12-22T08:47:51.948151+0000","last_became_active":"2023-12-22T08:47:49.852496+0000","last_became_peered":"2023-12-22T08:47:49.852496+0000","last_unstale":"2023-12-22T08:47:51.948151+0000","last_undegraded":"2023-12-22T08:47:51.948151+0000","last_fullsized":"2023-12-22T08:47:51.948151+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:58.368536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334973+0000","last_change":"2023-12-22T08:47:50.341562+0000","last_active":"2023-12-22T08:47:51.334973+0000","last_peered":"2023-12-22T08:47:51.334973+0000","last_clean":"2023-12-22T08:47:51.334973+0000","last_became_active":"2023-12-22T08:47:50.340150+0000","last_became_peered":"2023-12-22T08:47:50.340150+0000","last_unstale":"2023-12-22T08:47:51.334973+0000","last_undegraded":"2023-12-22T08:47:51.334973+0000","last_fullsized":"2023-12-22T08:47:51.334973+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:46:58.911364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"141'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336783+0000","last_change":"2023-12-22T08:47:49.855653+0000","last_active":"2023-12-22T08:47:51.336783+0000","last_peered":"2023-12-22T08:47:51.336783+0000","last_clean":"2023-12-22T08:47:51.336783+0000","last_became_active":"2023-12-22T08:47:49.854167+0000","last_became_peered":"2023-12-22T08:47:49.854167+0000","last_unstale":"2023-12-22T08:47:51.336783+0000","last_undegraded":"2023-12-22T08:47:51.336783+0000","last_fullsized":"2023-12-22T08:47:51.336783+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:00.209162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948167+0000","last_change":"2023-12-22T08:47:50.356265+0000","last_active":"2023-12-22T08:47:51.948167+0000","last_peered":"2023-12-22T08:47:51.948167+0000","last_clean":"2023-12-22T08:47:51.948167+0000","last_became_active":"2023-12-22T08:47:50.355974+0000","last_became_peered":"2023-12-22T08:47:50.355974+0000","last_unstale":"2023-12-22T08:47:51.948167+0000","last_undegraded":"2023-12-22T08:47:51.948167+0000","last_fullsized":"2023-12-22T08:47:51.948167+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:48:56.542921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949850+0000","last_change":"2023-12-22T08:47:49.849970+0000","last_active":"2023-12-22T08:47:51.949850+0000","last_peered":"2023-12-22T08:47:51.949850+0000","last_clean":"2023-12-22T08:47:51.949850+0000","last_became_active":"2023-12-22T08:47:49.849506+0000","last_became_peered":"2023-12-22T08:47:49.849506+0000","last_unstale":"2023-12-22T08:47:51.949850+0000","last_undegraded":"2023-12-22T08:47:51.949850+0000","last_fullsized":"2023-12-22T08:47:51.949850+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:41.234123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948493+0000","last_change":"2023-12-22T08:47:50.356579+0000","last_active":"2023-12-22T08:47:51.948493+0000","last_peered":"2023-12-22T08:47:51.948493+0000","last_clean":"2023-12-22T08:47:51.948493+0000","last_became_active":"2023-12-22T08:47:50.351368+0000","last_became_peered":"2023-12-22T08:47:50.351368+0000","last_unstale":"2023-12-22T08:47:51.948493+0000","last_undegraded":"2023-12-22T08:47:51.948493+0000","last_fullsized":"2023-12-22T08:47:51.948493+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:49:38.848498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"141'8","reported_seq":19,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336169+0000","last_change":"2023-12-22T08:47:49.845685+0000","last_active":"2023-12-22T08:47:51.336169+0000","last_peered":"2023-12-22T08:47:51.336169+0000","last_clean":"2023-12-22T08:47:51.336169+0000","last_became_active":"2023-12-22T08:47:49.845106+0000","last_became_peered":"2023-12-22T08:47:49.845106+0000","last_unstale":"2023-12-22T08:47:51.336169+0000","last_undegraded":"2023-12-22T08:47:51.336169+0000","last_fullsized":"2023-12-22T08:47:51.336169+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:57:57.307093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336403+0000","last_change":"2023-12-22T08:47:50.355233+0000","last_active":"2023-12-22T08:47:51.336403+0000","last_peered":"2023-12-22T08:47:51.336403+0000","last_clean":"2023-12-22T08:47:51.336403+0000","last_became_active":"2023-12-22T08:47:50.354807+0000","last_became_peered":"2023-12-22T08:47:50.354807+0000","last_unstale":"2023-12-22T08:47:51.336403+0000","last_undegraded":"2023-12-22T08:47:51.336403+0000","last_fullsized":"2023-12-22T08:47:51.336403+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:59.492556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"141'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947029+0000","last_change":"2023-12-22T08:47:49.840680+0000","last_active":"2023-12-22T08:47:51.947029+0000","last_peered":"2023-12-22T08:47:51.947029+0000","last_clean":"2023-12-22T08:47:51.947029+0000","last_became_active":"2023-12-22T08:47:49.840245+0000","last_became_peered":"2023-12-22T08:47:49.840245+0000","last_unstale":"2023-12-22T08:47:51.947029+0000","last_undegraded":"2023-12-22T08:47:51.947029+0000","last_fullsized":"2023-12-22T08:47:51.947029+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:06:10.893474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334327+0000","last_change":"2023-12-22T08:47:50.360828+0000","last_active":"2023-12-22T08:47:51.334327+0000","last_peered":"2023-12-22T08:47:51.334327+0000","last_clean":"2023-12-22T08:47:51.334327+0000","last_became_active":"2023-12-22T08:47:50.357041+0000","last_became_peered":"2023-12-22T08:47:50.357041+0000","last_unstale":"2023-12-22T08:47:51.334327+0000","last_undegraded":"2023-12-22T08:47:51.334327+0000","last_fullsized":"2023-12-22T08:47:51.334327+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:31:03.081749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"141'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336989+0000","last_change":"2023-12-22T08:47:49.855927+0000","last_active":"2023-12-22T08:47:51.336989+0000","last_peered":"2023-12-22T08:47:51.336989+0000","last_clean":"2023-12-22T08:47:51.336989+0000","last_became_active":"2023-12-22T08:47:49.854626+0000","last_became_peered":"2023-12-22T08:47:49.854626+0000","last_unstale":"2023-12-22T08:47:51.336989+0000","last_undegraded":"2023-12-22T08:47:51.336989+0000","last_fullsized":"2023-12-22T08:47:51.336989+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:35.933199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.332131+0000","last_change":"2023-12-22T08:47:50.339358+0000","last_active":"2023-12-22T08:47:51.332131+0000","last_peered":"2023-12-22T08:47:51.332131+0000","last_clean":"2023-12-22T08:47:51.332131+0000","last_became_active":"2023-12-22T08:47:50.339164+0000","last_became_peered":"2023-12-22T08:47:50.339164+0000","last_unstale":"2023-12-22T08:47:51.332131+0000","last_undegraded":"2023-12-22T08:47:51.332131+0000","last_fullsized":"2023-12-22T08:47:51.332131+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:05:48.268564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"141'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948685+0000","last_change":"2023-12-22T08:47:49.844780+0000","last_active":"2023-12-22T08:47:51.948685+0000","last_peered":"2023-12-22T08:47:51.948685+0000","last_clean":"2023-12-22T08:47:51.948685+0000","last_became_active":"2023-12-22T08:47:49.844592+0000","last_became_peered":"2023-12-22T08:47:49.844592+0000","last_unstale":"2023-12-22T08:47:51.948685+0000","last_undegraded":"2023-12-22T08:47:51.948685+0000","last_fullsized":"2023-12-22T08:47:51.948685+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:33:38.928813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947914+0000","last_change":"2023-12-22T08:47:50.350557+0000","last_active":"2023-12-22T08:47:51.947914+0000","last_peered":"2023-12-22T08:47:51.947914+0000","last_clean":"2023-12-22T08:47:51.947914+0000","last_became_active":"2023-12-22T08:47:50.350297+0000","last_became_peered":"2023-12-22T08:47:50.350297+0000","last_unstale":"2023-12-22T08:47:51.947914+0000","last_undegraded":"2023-12-22T08:47:51.947914+0000","last_fullsized":"2023-12-22T08:47:51.947914+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:26.332766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947936+0000","last_change":"2023-12-22T08:47:49.850221+0000","last_active":"2023-12-22T08:47:51.947936+0000","last_peered":"2023-12-22T08:47:51.947936+0000","last_clean":"2023-12-22T08:47:51.947936+0000","last_became_active":"2023-12-22T08:47:49.849910+0000","last_became_peered":"2023-12-22T08:47:49.849910+0000","last_unstale":"2023-12-22T08:47:51.947936+0000","last_undegraded":"2023-12-22T08:47:51.947936+0000","last_fullsized":"2023-12-22T08:47:51.947936+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:41.234123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947525+0000","last_change":"2023-12-22T08:47:50.349394+0000","last_active":"2023-12-22T08:47:51.947525+0000","last_peered":"2023-12-22T08:47:51.947525+0000","last_clean":"2023-12-22T08:47:51.947525+0000","last_became_active":"2023-12-22T08:47:50.346485+0000","last_became_peered":"2023-12-22T08:47:50.346485+0000","last_unstale":"2023-12-22T08:47:51.947525+0000","last_undegraded":"2023-12-22T08:47:51.947525+0000","last_fullsized":"2023-12-22T08:47:51.947525+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:54:46.585497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"141'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.333622+0000","last_change":"2023-12-22T08:47:49.852972+0000","last_active":"2023-12-22T08:47:51.333622+0000","last_peered":"2023-12-22T08:47:51.333622+0000","last_clean":"2023-12-22T08:47:51.333622+0000","last_became_active":"2023-12-22T08:47:49.852716+0000","last_became_peered":"2023-12-22T08:47:49.852716+0000","last_unstale":"2023-12-22T08:47:51.333622+0000","last_undegraded":"2023-12-22T08:47:51.333622+0000","last_fullsized":"2023-12-22T08:47:51.333622+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:28:23.476638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.335933+0000","last_change":"2023-12-22T08:47:50.351562+0000","last_active":"2023-12-22T08:47:51.335933+0000","last_peered":"2023-12-22T08:47:51.335933+0000","last_clean":"2023-12-22T08:47:51.335933+0000","last_became_active":"2023-12-22T08:47:50.351046+0000","last_became_peered":"2023-12-22T08:47:50.351046+0000","last_unstale":"2023-12-22T08:47:51.335933+0000","last_undegraded":"2023-12-22T08:47:51.335933+0000","last_fullsized":"2023-12-22T08:47:51.335933+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:00.488867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.334605+0000","last_change":"2023-12-22T08:47:49.850430+0000","last_active":"2023-12-22T08:47:51.334605+0000","last_peered":"2023-12-22T08:47:51.334605+0000","last_clean":"2023-12-22T08:47:51.334605+0000","last_became_active":"2023-12-22T08:47:49.850175+0000","last_became_peered":"2023-12-22T08:47:49.850175+0000","last_unstale":"2023-12-22T08:47:51.334605+0000","last_undegraded":"2023-12-22T08:47:51.334605+0000","last_fullsized":"2023-12-22T08:47:51.334605+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:26:15.872787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948197+0000","last_change":"2023-12-22T08:47:50.353301+0000","last_active":"2023-12-22T08:47:51.948197+0000","last_peered":"2023-12-22T08:47:51.948197+0000","last_clean":"2023-12-22T08:47:51.948197+0000","last_became_active":"2023-12-22T08:47:50.352789+0000","last_became_peered":"2023-12-22T08:47:50.352789+0000","last_unstale":"2023-12-22T08:47:51.948197+0000","last_undegraded":"2023-12-22T08:47:51.948197+0000","last_fullsized":"2023-12-22T08:47:51.948197+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:12:36.859618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948603+0000","last_change":"2023-12-22T08:47:49.848072+0000","last_active":"2023-12-22T08:47:51.948603+0000","last_peered":"2023-12-22T08:47:51.948603+0000","last_clean":"2023-12-22T08:47:51.948603+0000","last_became_active":"2023-12-22T08:47:49.847818+0000","last_became_peered":"2023-12-22T08:47:49.847818+0000","last_unstale":"2023-12-22T08:47:51.948603+0000","last_undegraded":"2023-12-22T08:47:51.948603+0000","last_fullsized":"2023-12-22T08:47:51.948603+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:04.221967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.335401+0000","last_change":"2023-12-22T08:47:50.364546+0000","last_active":"2023-12-22T08:47:51.335401+0000","last_peered":"2023-12-22T08:47:51.335401+0000","last_clean":"2023-12-22T08:47:51.335401+0000","last_became_active":"2023-12-22T08:47:50.363081+0000","last_became_peered":"2023-12-22T08:47:50.363081+0000","last_unstale":"2023-12-22T08:47:51.335401+0000","last_undegraded":"2023-12-22T08:47:51.335401+0000","last_fullsized":"2023-12-22T08:47:51.335401+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:37.869276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949272+0000","last_change":"2023-12-22T08:47:49.849016+0000","last_active":"2023-12-22T08:47:51.949272+0000","last_peered":"2023-12-22T08:47:51.949272+0000","last_clean":"2023-12-22T08:47:51.949272+0000","last_became_active":"2023-12-22T08:47:49.848743+0000","last_became_peered":"2023-12-22T08:47:49.848743+0000","last_unstale":"2023-12-22T08:47:51.949272+0000","last_undegraded":"2023-12-22T08:47:51.949272+0000","last_fullsized":"2023-12-22T08:47:51.949272+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:22:25.452753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947853+0000","last_change":"2023-12-22T08:47:50.345252+0000","last_active":"2023-12-22T08:47:51.947853+0000","last_peered":"2023-12-22T08:47:51.947853+0000","last_clean":"2023-12-22T08:47:51.947853+0000","last_became_active":"2023-12-22T08:47:50.344989+0000","last_became_peered":"2023-12-22T08:47:50.344989+0000","last_unstale":"2023-12-22T08:47:51.947853+0000","last_undegraded":"2023-12-22T08:47:51.947853+0000","last_fullsized":"2023-12-22T08:47:51.947853+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:03:34.184827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"141'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948838+0000","last_change":"2023-12-22T08:47:49.851684+0000","last_active":"2023-12-22T08:47:51.948838+0000","last_peered":"2023-12-22T08:47:51.948838+0000","last_clean":"2023-12-22T08:47:51.948838+0000","last_became_active":"2023-12-22T08:47:49.851403+0000","last_became_peered":"2023-12-22T08:47:49.851403+0000","last_unstale":"2023-12-22T08:47:51.948838+0000","last_undegraded":"2023-12-22T08:47:51.948838+0000","last_fullsized":"2023-12-22T08:47:51.948838+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:07:30.496575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947488+0000","last_change":"2023-12-22T08:47:50.358972+0000","last_active":"2023-12-22T08:47:51.947488+0000","last_peered":"2023-12-22T08:47:51.947488+0000","last_clean":"2023-12-22T08:47:51.947488+0000","last_became_active":"2023-12-22T08:47:50.358551+0000","last_became_peered":"2023-12-22T08:47:50.358551+0000","last_unstale":"2023-12-22T08:47:51.947488+0000","last_undegraded":"2023-12-22T08:47:51.947488+0000","last_fullsized":"2023-12-22T08:47:51.947488+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:18.069615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.331602+0000","last_change":"2023-12-22T08:47:49.846633+0000","last_active":"2023-12-22T08:47:51.331602+0000","last_peered":"2023-12-22T08:47:51.331602+0000","last_clean":"2023-12-22T08:47:51.331602+0000","last_became_active":"2023-12-22T08:47:49.844374+0000","last_became_peered":"2023-12-22T08:47:49.844374+0000","last_unstale":"2023-12-22T08:47:51.331602+0000","last_undegraded":"2023-12-22T08:47:51.331602+0000","last_fullsized":"2023-12-22T08:47:51.331602+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:45:15.256608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336643+0000","last_change":"2023-12-22T08:47:50.362880+0000","last_active":"2023-12-22T08:47:51.336643+0000","last_peered":"2023-12-22T08:47:51.336643+0000","last_clean":"2023-12-22T08:47:51.336643+0000","last_became_active":"2023-12-22T08:47:50.362174+0000","last_became_peered":"2023-12-22T08:47:50.362174+0000","last_unstale":"2023-12-22T08:47:51.336643+0000","last_undegraded":"2023-12-22T08:47:51.336643+0000","last_fullsized":"2023-12-22T08:47:51.336643+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:19:27.325657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948279+0000","last_change":"2023-12-22T08:47:49.846172+0000","last_active":"2023-12-22T08:47:51.948279+0000","last_peered":"2023-12-22T08:47:51.948279+0000","last_clean":"2023-12-22T08:47:51.948279+0000","last_became_active":"2023-12-22T08:47:49.845830+0000","last_became_peered":"2023-12-22T08:47:49.845830+0000","last_unstale":"2023-12-22T08:47:51.948279+0000","last_undegraded":"2023-12-22T08:47:51.948279+0000","last_fullsized":"2023-12-22T08:47:51.948279+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:30:16.514947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948751+0000","last_change":"2023-12-22T08:47:50.353507+0000","last_active":"2023-12-22T08:47:51.948751+0000","last_peered":"2023-12-22T08:47:51.948751+0000","last_clean":"2023-12-22T08:47:51.948751+0000","last_became_active":"2023-12-22T08:47:50.353233+0000","last_became_peered":"2023-12-22T08:47:50.353233+0000","last_unstale":"2023-12-22T08:47:51.948751+0000","last_undegraded":"2023-12-22T08:47:51.948751+0000","last_fullsized":"2023-12-22T08:47:51.948751+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:00.488867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948808+0000","last_change":"2023-12-22T08:47:49.846910+0000","last_active":"2023-12-22T08:47:51.948808+0000","last_peered":"2023-12-22T08:47:51.948808+0000","last_clean":"2023-12-22T08:47:51.948808+0000","last_became_active":"2023-12-22T08:47:49.846673+0000","last_became_peered":"2023-12-22T08:47:49.846673+0000","last_unstale":"2023-12-22T08:47:51.948808+0000","last_undegraded":"2023-12-22T08:47:51.948808+0000","last_fullsized":"2023-12-22T08:47:51.948808+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:15:42.431853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948568+0000","last_change":"2023-12-22T08:47:50.358184+0000","last_active":"2023-12-22T08:47:51.948568+0000","last_peered":"2023-12-22T08:47:51.948568+0000","last_clean":"2023-12-22T08:47:51.948568+0000","last_became_active":"2023-12-22T08:47:50.357945+0000","last_became_peered":"2023-12-22T08:47:50.357945+0000","last_unstale":"2023-12-22T08:47:51.948568+0000","last_undegraded":"2023-12-22T08:47:51.948568+0000","last_fullsized":"2023-12-22T08:47:51.948568+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:45:14.630836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.332335+0000","last_change":"2023-12-22T08:47:49.845991+0000","last_active":"2023-12-22T08:47:51.332335+0000","last_peered":"2023-12-22T08:47:51.332335+0000","last_clean":"2023-12-22T08:47:51.332335+0000","last_became_active":"2023-12-22T08:47:49.845568+0000","last_became_peered":"2023-12-22T08:47:49.845568+0000","last_unstale":"2023-12-22T08:47:51.332335+0000","last_undegraded":"2023-12-22T08:47:51.332335+0000","last_fullsized":"2023-12-22T08:47:51.332335+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:48:55.526936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948436+0000","last_change":"2023-12-22T08:47:50.355663+0000","last_active":"2023-12-22T08:47:51.948436+0000","last_peered":"2023-12-22T08:47:51.948436+0000","last_clean":"2023-12-22T08:47:51.948436+0000","last_became_active":"2023-12-22T08:47:50.355434+0000","last_became_peered":"2023-12-22T08:47:50.355434+0000","last_unstale":"2023-12-22T08:47:51.948436+0000","last_undegraded":"2023-12-22T08:47:51.948436+0000","last_fullsized":"2023-12-22T08:47:51.948436+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:52:12.347927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948183+0000","last_change":"2023-12-22T08:47:49.844184+0000","last_active":"2023-12-22T08:47:51.948183+0000","last_peered":"2023-12-22T08:47:51.948183+0000","last_clean":"2023-12-22T08:47:51.948183+0000","last_became_active":"2023-12-22T08:47:49.843824+0000","last_became_peered":"2023-12-22T08:47:49.843824+0000","last_unstale":"2023-12-22T08:47:51.948183+0000","last_undegraded":"2023-12-22T08:47:51.948183+0000","last_fullsized":"2023-12-22T08:47:51.948183+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:39:03.426293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948992+0000","last_change":"2023-12-22T08:47:50.345667+0000","last_active":"2023-12-22T08:47:51.948992+0000","last_peered":"2023-12-22T08:47:51.948992+0000","last_clean":"2023-12-22T08:47:51.948992+0000","last_became_active":"2023-12-22T08:47:50.345423+0000","last_became_peered":"2023-12-22T08:47:50.345423+0000","last_unstale":"2023-12-22T08:47:51.948992+0000","last_undegraded":"2023-12-22T08:47:51.948992+0000","last_fullsized":"2023-12-22T08:47:51.948992+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:19:58.447334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.336425+0000","last_change":"2023-12-22T08:47:49.845445+0000","last_active":"2023-12-22T08:47:51.336425+0000","last_peered":"2023-12-22T08:47:51.336425+0000","last_clean":"2023-12-22T08:47:51.336425+0000","last_became_active":"2023-12-22T08:47:49.844698+0000","last_became_peered":"2023-12-22T08:47:49.844698+0000","last_unstale":"2023-12-22T08:47:51.336425+0000","last_undegraded":"2023-12-22T08:47:51.336425+0000","last_fullsized":"2023-12-22T08:47:51.336425+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:21:21.600263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947244+0000","last_change":"2023-12-22T08:47:50.361301+0000","last_active":"2023-12-22T08:47:51.947244+0000","last_peered":"2023-12-22T08:47:51.947244+0000","last_clean":"2023-12-22T08:47:51.947244+0000","last_became_active":"2023-12-22T08:47:50.361042+0000","last_became_peered":"2023-12-22T08:47:50.361042+0000","last_unstale":"2023-12-22T08:47:51.947244+0000","last_undegraded":"2023-12-22T08:47:51.947244+0000","last_fullsized":"2023-12-22T08:47:51.947244+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:05.237951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947245+0000","last_change":"2023-12-22T08:47:49.842526+0000","last_active":"2023-12-22T08:47:51.947245+0000","last_peered":"2023-12-22T08:47:51.947245+0000","last_clean":"2023-12-22T08:47:51.947245+0000","last_became_active":"2023-12-22T08:47:49.842088+0000","last_became_peered":"2023-12-22T08:47:49.842088+0000","last_unstale":"2023-12-22T08:47:51.947245+0000","last_undegraded":"2023-12-22T08:47:51.947245+0000","last_fullsized":"2023-12-22T08:47:51.947245+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:58.476572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.948008+0000","last_change":"2023-12-22T08:47:50.361799+0000","last_active":"2023-12-22T08:47:51.948008+0000","last_peered":"2023-12-22T08:47:51.948008+0000","last_clean":"2023-12-22T08:47:51.948008+0000","last_became_active":"2023-12-22T08:47:50.361462+0000","last_became_peered":"2023-12-22T08:47:50.361462+0000","last_unstale":"2023-12-22T08:47:51.948008+0000","last_undegraded":"2023-12-22T08:47:51.948008+0000","last_fullsized":"2023-12-22T08:47:51.948008+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:49.804555+0000","last_clean_scrub_stamp":"2023-12-22T08:47:49.804555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:59:03.176758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.949860+0000","last_change":"2023-12-22T08:47:49.835123+0000","last_active":"2023-12-22T08:47:51.949860+0000","last_peered":"2023-12-22T08:47:51.949860+0000","last_clean":"2023-12-22T08:47:51.949860+0000","last_became_active":"2023-12-22T08:47:49.834204+0000","last_became_peered":"2023-12-22T08:47:49.834204+0000","last_unstale":"2023-12-22T08:47:51.949860+0000","last_undegraded":"2023-12-22T08:47:51.949860+0000","last_fullsized":"2023-12-22T08:47:51.949860+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:47:48.788570+0000","last_clean_scrub_stamp":"2023-12-22T08:47:48.788570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:44:26.374725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":273,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-12-22T08:47:51.947900+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:47:51.947900+0000","last_peered":"2023-12-22T08:47:51.947900+0000","last_clean":"2023-12-22T08:47:51.947900+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:47:51.947900+0000","last_undegraded":"2023-12-22T08:47:51.947900+0000","last_fullsized":"2023-12-22T08:47:51.947900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574947,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":770,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194541,"statfs":{"total":200000000,"available":199210705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0960000000000001,"15min":1.0840000000000001},"min":{"1min":0.80200000000000005,"5min":0.60999999999999999,"15min":0.58199999999999996},"max":{"1min":1.5169999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.032},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1160000000000001,"15min":1.077},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.88100000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1870000000000001,"15min":1.167},"min":{"1min":0.73399999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6839999999999999,"5min":1.905,"15min":1.905},"last":1.28},{"interface":"front","average":{"1min":1.2,"5min":1.2549999999999999,"15min":1.1679999999999999},"min":{"1min":0.85099999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.7709999999999999,"5min":1.865,"15min":1.865},"last":1.4470000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.163,"15min":1.089},"min":{"1min":0.89600000000000002,"5min":0.78100000000000003,"15min":0.69799999999999995},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.74},{"interface":"front","average":{"1min":1.167,"5min":1.2,"15min":1.22},"min":{"1min":0.79900000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.589,"5min":1.742,"15min":2.1379999999999999},"last":1.145}]},{"osd":3,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.23,"15min":1.133},"min":{"1min":0.94699999999999995,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.635,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3300000000000001,"15min":1.2909999999999999},"min":{"1min":0.97299999999999998,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.5620000000000001,"5min":1.952,"15min":2.2959999999999998},"last":1.494}]},{"osd":4,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2050000000000001,"15min":1.2},"min":{"1min":1.032,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.603,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.2},{"interface":"front","average":{"1min":1.371,"5min":1.262,"15min":1.2629999999999999},"min":{"1min":1.0229999999999999,"5min":0.64100000000000001,"15min":0.59399999999999997},"max":{"1min":2.0840000000000001,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.613}]},{"osd":5,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.375,"15min":1.3740000000000001},"min":{"1min":0.97299999999999998,"5min":0.74299999999999999,"15min":0.51800000000000002},"max":{"1min":1.8939999999999999,"5min":2.0510000000000002,"15min":2.4300000000000002},"last":1.548},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3759999999999999,"15min":1.3740000000000001},"min":{"1min":1.135,"5min":0.76300000000000001,"15min":0.67800000000000005},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":2.3410000000000002},"last":1.663}]},{"osd":6,"last update":"Fri Dec 22 08:46:59 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.496,"15min":1.4910000000000001},"min":{"1min":1.056,"5min":0.83499999999999996,"15min":0.66900000000000004},"max":{"1min":1.9930000000000001,"5min":2.1259999999999999,"15min":2.2440000000000002},"last":1.718},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.4830000000000001,"15min":1.484},"min":{"1min":1.294,"5min":0.82299999999999995,"15min":0.71999999999999997},"max":{"1min":2.1379999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.7929999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":769,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194543,"statfs":{"total":200000000,"available":199212393,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.1479999999999999,"15min":1.1299999999999999},"min":{"1min":0.61499999999999999,"5min":0.55300000000000005,"15min":0.42099999999999999},"max":{"1min":1.6870000000000001,"5min":1.9350000000000001,"15min":3.0489999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.177,"15min":1.107},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.137}]},{"osd":1,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.125,"15min":1.0509999999999999},"min":{"1min":0.67800000000000005,"5min":0.63,"15min":0.623},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1859999999999999,"15min":1.167},"min":{"1min":0.69699999999999995,"5min":0.64500000000000002,"15min":0.63100000000000001},"max":{"1min":1.4870000000000001,"5min":1.8,"15min":1.8},"last":1.0049999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.264,"15min":1.268},"min":{"1min":0.73999999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.7090000000000001,"5min":1.7969999999999999,"15min":1.8799999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.337,"5min":1.248,"15min":1.1759999999999999},"min":{"1min":0.748,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.228}]},{"osd":3,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.3169999999999999,"15min":1.3},"min":{"1min":0.79200000000000004,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":2.6499999999999999},"last":1.056},{"interface":"front","average":{"1min":1.24,"5min":1.258,"15min":1.2370000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.77900000000000003},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.0820000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.351,"15min":1.3859999999999999},"min":{"1min":0.90600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.391,"15min":1.397},"min":{"1min":0.88300000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.831,"5min":2.831,"15min":2.831},"last":1.321}]},{"osd":5,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3160000000000001,"15min":1.345},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.502,"15min":1.5629999999999999},"min":{"1min":1.0369999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.7949999999999999,"5min":2.1030000000000002,"15min":3.1819999999999999},"last":1.179}]},{"osd":7,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.522,"15min":1.5680000000000001},"min":{"1min":0.93300000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":1.413},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.45,"15min":1.522},"min":{"1min":0.90400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.5880000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1344,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193967,"statfs":{"total":200000000,"available":198622952,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.101,"15min":1.0800000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.65300000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.944},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1060000000000001,"15min":1.1279999999999999},"min":{"1min":0.76500000000000001,"5min":0.68899999999999995,"15min":0.67000000000000004},"max":{"1min":1.5069999999999999,"5min":1.544,"15min":3.1379999999999999},"last":1.353}]},{"osd":1,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.135,"15min":1.1160000000000001},"min":{"1min":0.88200000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5009999999999999,"5min":1.619,"15min":2.79},"last":1.228},{"interface":"front","average":{"1min":1.069,"5min":1.1120000000000001,"15min":1.04},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.64500000000000002},"max":{"1min":1.476,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.1259999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1559999999999999,"15min":1.1359999999999999},"min":{"1min":0.79200000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.5860000000000001,"5min":1.5900000000000001,"15min":1.72},"last":1.087},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2390000000000001,"15min":1.1819999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.657,"5min":1.716,"15min":1.978},"last":1.532}]},{"osd":3,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.236,"15min":1.1830000000000001},"min":{"1min":0.80200000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.5249999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.3089999999999999,"15min":1.2569999999999999},"min":{"1min":0.86399999999999999,"5min":0.77800000000000002,"15min":0.73299999999999998},"max":{"1min":1.5409999999999999,"5min":1.6619999999999999,"15min":2.1499999999999999},"last":1}]},{"osd":4,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.274,"15min":1.2549999999999999},"min":{"1min":0.63300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6879999999999999,"5min":1.7070000000000001,"15min":1.853},"last":1.474},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.262,"15min":1.258},"min":{"1min":0.93799999999999994,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.3109999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.3480000000000001,"15min":1.323},"min":{"1min":0.81799999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.6639999999999999,"5min":1.788,"15min":1.821},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.407,"15min":1.421},"min":{"1min":0.79600000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.764,"5min":1.823,"15min":2.8780000000000001},"last":1.581}]},{"osd":7,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.4330000000000001,"15min":1.3879999999999999},"min":{"1min":0.84299999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6579999999999999,"5min":1.873,"15min":2.2189999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.49,"15min":1.5529999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.75,"5min":1.8899999999999999,"15min":4.7249999999999996},"last":0.88700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574947,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":770,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194541,"statfs":{"total":200000000,"available":199210739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.02,"15min":1.01},"min":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.55,"5min":1.597,"15min":1.597},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1319999999999999,"15min":1.1060000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.552,"5min":1.796,"15min":1.796},"last":0.96099999999999997}]},{"osd":1,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.117,"15min":1.056},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.482,"5min":1.76,"15min":1.76},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.66900000000000004,"5min":0.65600000000000003,"15min":0.57399999999999995},"max":{"1min":1.5600000000000001,"5min":1.794,"15min":2.4249999999999998},"last":1.1259999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.171,"15min":1.149},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.6160000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.075},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.244,"15min":1.208},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.4990000000000001,"5min":2.0830000000000002,"15min":2.1600000000000001},"last":0.998}]},{"osd":3,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2190000000000001,"15min":1.2010000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.397},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.333,"15min":1.2350000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.7110000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.3560000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1890000000000001,"15min":1.145},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5580000000000001,"5min":1.639,"15min":1.639},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.4259999999999999,"15min":1.3879999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8939999999999999,"5min":1.913,"15min":2.0979999999999999},"last":1.6719999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.337,"15min":1.2589999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.58599999999999997},"max":{"1min":1.9330000000000001,"5min":2.141,"15min":2.141},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.3100000000000001,"15min":1.222},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7210000000000001,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.4510000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:47:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.4510000000000001,"15min":1.3620000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.67300000000000004},"max":{"1min":1.992,"5min":2.0089999999999999,"15min":2.1200000000000001},"last":1.764},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.5329999999999999,"15min":1.4410000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.859,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.5600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":769,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194543,"statfs":{"total":200000000,"available":199212393,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90300000000000002,"15min":0.94099999999999995},"min":{"1min":0.55500000000000005,"5min":0.49299999999999999,"15min":0.39800000000000002},"max":{"1min":1.2390000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.95499999999999996,"15min":0.93300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.262,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.90800000000000003,"15min":0.86899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.528,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.04},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.208,"15min":1.1339999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.46200000000000002},"max":{"1min":1.6020000000000001,"5min":1.861,"15min":1.861},"last":0.73399999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.0669999999999999,"15min":1.042},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5469999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.286},{"interface":"front","average":{"1min":1.127,"5min":1.1859999999999999,"15min":1.137},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.679,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.006}]},{"osd":4,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.276,"15min":1.2190000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.73199999999999998},"max":{"1min":2.2839999999999998,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.264,"5min":1.323,"15min":1.2470000000000001},"min":{"1min":0.91000000000000003,"5min":0.77300000000000002,"15min":0.745},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.601}]},{"osd":5,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3680000000000001,"15min":1.288},"min":{"1min":0.754,"5min":0.754,"15min":0.66700000000000004},"max":{"1min":1.9059999999999999,"5min":1.994,"15min":1.994},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.409,"15min":1.427},"min":{"1min":0.84599999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.7949999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.145}]},{"osd":6,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.478,"15min":1.4470000000000001},"min":{"1min":1.0609999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.964,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3999999999999999,"15min":1.385},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7849999999999999,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.159}]},{"osd":7,"last update":"Fri Dec 22 08:47:08 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.456,"15min":1.387},"min":{"1min":0.81299999999999994,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.851,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.21},{"interface":"front","average":{"1min":1.415,"5min":1.4630000000000001,"15min":1.405},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.80600000000000005},"max":{"1min":1.837,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.6779999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":769,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194542,"statfs":{"total":200000000,"available":199211755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.94799999999999995,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.3799999999999999,"5min":6.8879999999999999,"15min":6.8879999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.96499999999999997,"15min":0.93899999999999995},"min":{"1min":0.497,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.5609999999999999,"5min":4.5510000000000002,"15min":4.5510000000000002},"last":1.1879999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":1.02,"15min":0.93999999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.34000000000000002},"max":{"1min":1.302,"5min":11.308999999999999,"15min":11.308999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.077,"5min":1.093,"15min":0.95799999999999996},"min":{"1min":0.60199999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.5760000000000001,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.3919999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.234,"15min":1.0529999999999999},"min":{"1min":0.56000000000000005,"5min":0.47999999999999998,"15min":0.41099999999999998},"max":{"1min":1.5589999999999999,"5min":13.087999999999999,"15min":13.087999999999999},"last":1.036},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.361,"15min":1.1299999999999999},"min":{"1min":0.78600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.742,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.593}]},{"osd":4,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.3999999999999999,"15min":1.2729999999999999},"min":{"1min":0.96399999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.3159999999999998,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.528},{"interface":"front","average":{"1min":1.306,"5min":1.4179999999999999,"15min":1.3540000000000001},"min":{"1min":0.84899999999999998,"5min":0.748,"15min":0.61499999999999999},"max":{"1min":1.6319999999999999,"5min":13.927,"15min":13.927},"last":1.0960000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.421,"15min":1.375},"min":{"1min":0.88500000000000001,"5min":0.72399999999999998,"15min":0.64000000000000001},"max":{"1min":1.9530000000000001,"5min":11.003,"15min":11.003},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.448,"15min":1.286},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.6850000000000001,"5min":13.129,"15min":13.129},"last":1.2190000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.444,"15min":1.298},"min":{"1min":0.93000000000000005,"5min":0.77200000000000002,"15min":0.751},"max":{"1min":1.7909999999999999,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.5309999999999999,"15min":1.393},"min":{"1min":1.03,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0939999999999999,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":1.6499999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:47:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.4930000000000001,"15min":1.397},"min":{"1min":0.89100000000000001,"5min":0.753,"15min":0.61299999999999999},"max":{"1min":1.7090000000000001,"5min":10.948,"15min":10.948},"last":1.286},{"interface":"front","average":{"1min":1.863,"5min":1.6459999999999999,"15min":1.411},"min":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.78200000000000003},"max":{"1min":9.0239999999999991,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":1.4470000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1345,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193966,"statfs":{"total":200000000,"available":198622025,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.91200000000000003},"min":{"1min":0.44600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.244,"5min":1.1699999999999999,"15min":1.0529999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.39900000000000002},"max":{"1min":4.2030000000000003,"5min":4.2030000000000003,"15min":4.2030000000000003},"last":0.92400000000000004}]},{"osd":2,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.98899999999999999,"15min":0.95699999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4450000000000001,"5min":1.732,"15min":1.732},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.05,"15min":0.97399999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.34999999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":2.254},"last":1.0509999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.331,"15min":1.2050000000000001},"min":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.54000000000000004},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.474},{"interface":"front","average":{"1min":1.087,"5min":1.0720000000000001,"15min":0.99399999999999999},"min":{"1min":0.54000000000000004,"5min":0.497,"15min":0.47799999999999998},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.2030000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3049999999999999,"15min":1.278},"min":{"1min":0.71299999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.518,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.4359999999999999,"15min":1.3500000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.6910000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.25}]},{"osd":5,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.2949999999999999,"15min":1.248},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.536,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":1.538},{"interface":"front","average":{"1min":1.224,"5min":1.4359999999999999,"15min":1.351},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.66800000000000004},"max":{"1min":1.5720000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.4590000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.3600000000000001,"15min":1.28},"min":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.65200000000000002},"max":{"1min":1.5780000000000001,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.468,"15min":1.3899999999999999},"min":{"1min":0.80600000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.748,"5min":2.2210000000000001,"15min":2.2229999999999999},"last":1.403}]},{"osd":7,"last update":"Fri Dec 22 08:47:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.496,"15min":1.393},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.64400000000000002},"max":{"1min":1.7889999999999999,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.306},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.486,"15min":1.4219999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.66200000000000003},"max":{"1min":1.718,"5min":4.508,"15min":4.508},"last":1.6279999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":769,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194542,"statfs":{"total":200000000,"available":199211741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.871,"15min":0.76300000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.9470000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.97599999999999998,"15min":0.91700000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.88600000000000001,"15min":0.81299999999999994},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.40600000000000003},"max":{"1min":1.341,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.131},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0700000000000001,"15min":0.96399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.5409999999999999,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.083}]},{"osd":3,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1739999999999999,"15min":1.056},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52500000000000002},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.234,"15min":1.095},"min":{"1min":0.56999999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.8080000000000001,"5min":2.145,"15min":2.145},"last":1.452}]},{"osd":4,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3640000000000001,"15min":1.288},"min":{"1min":0.86299999999999999,"5min":0.80600000000000005,"15min":0.70799999999999996},"max":{"1min":2.0910000000000002,"5min":2.625,"15min":2.625},"last":1.399},{"interface":"front","average":{"1min":1.351,"5min":1.3520000000000001,"15min":1.246},"min":{"1min":0.89900000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.964,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.649}]},{"osd":5,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.417,"15min":1.2949999999999999},"min":{"1min":0.71099999999999997,"5min":0.67600000000000005,"15min":0.59299999999999997},"max":{"1min":5.4290000000000003,"5min":5.4290000000000003,"15min":5.4290000000000003},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.373,"15min":1.2889999999999999},"min":{"1min":0.79500000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.0910000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.276}]},{"osd":6,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3919999999999999,"15min":1.304},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.64800000000000002},"max":{"1min":1.8799999999999999,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.488,"15min":1.4099999999999999},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.69099999999999995},"max":{"1min":1.8620000000000001,"5min":2.577,"15min":2.577},"last":1.613}]},{"osd":7,"last update":"Fri Dec 22 08:47:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.4770000000000001,"15min":1.3899999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.755},"max":{"1min":1.841,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.6679999999999999},{"interface":"front","average":{"1min":1.488,"5min":1.4770000000000001,"15min":1.399},"min":{"1min":0.96499999999999997,"5min":0.749,"15min":0.749},"max":{"1min":2.1680000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.552}]}]}],"pool_statfs":[]}} 2023-12-22T08:47:55.353 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T08:47:55.353 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T08:47:55.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.629+0000 7f4ad9d4c640 1 Processor -- start 2023-12-22T08:47:55.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.629+0000 7f4ad9d4c640 1 -- start start 2023-12-22T08:47:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.631+0000 7f4ad9d4c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4ad415b370 0x7f4ad406d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.631+0000 7f4ad9d4c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4ad406d6a0 0x7f4ad40adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.631+0000 7f4ad9d4c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad415ca20 con 0x7f4ad40ae4f0 2023-12-22T08:47:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.631+0000 7f4ad9d4c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad40ae9a0 con 0x7f4ad415b370 2023-12-22T08:47:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.631+0000 7f4ad9d4c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad415b750 con 0x7f4ad406d6a0 2023-12-22T08:47:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.632+0000 7f4ad8d4a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4ad415b370 0x7f4ad406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.632+0000 7f4ad954b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4ad40ae4f0 0x7f4ad40b3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:35920/0 (socket says 172.21.15.38:35920) 2023-12-22T08:47:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.632+0000 7f4ad954b640 1 -- 172.21.15.38:0/192789371 learned_addr learned my addr 172.21.15.38:0/192789371 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.632+0000 7f4ad3fff640 1 --2- 172.21.15.38:0/192789371 >> v2:172.21.15.89:3300/0 conn(0x7f4ad406d6a0 0x7f4ad40adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.632+0000 7f4ad37fe640 1 -- 172.21.15.38:0/192789371 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564649856 0 0) 0x7f4ad415ca20 con 0x7f4ad40ae4f0 2023-12-22T08:47:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.632+0000 7f4ad37fe640 1 -- 172.21.15.38:0/192789371 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4abc003520 con 0x7f4ad40ae4f0 2023-12-22T08:47:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.632+0000 7f4ad8d4a640 1 -- 172.21.15.38:0/192789371 >> v2:172.21.15.89:3300/0 conn(0x7f4ad406d6a0 msgr2=0x7f4ad40adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.632+0000 7f4ad8d4a640 1 --2- 172.21.15.38:0/192789371 >> v2:172.21.15.89:3300/0 conn(0x7f4ad406d6a0 0x7f4ad40adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.632+0000 7f4ad8d4a640 1 -- 172.21.15.38:0/192789371 >> v1:172.21.15.38:6789/0 conn(0x7f4ad40ae4f0 legacy=0x7f4ad40b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.632+0000 7f4ad8d4a640 1 -- 172.21.15.38:0/192789371 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad406dc20 con 0x7f4ad415b370 2023-12-22T08:47:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.634+0000 7f4ad8d4a640 1 --2- 172.21.15.38:0/192789371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad415b370 0x7f4ad406d160 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4ad406a7f0 tx=0x7f4ac402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433d1d5eb5b32462 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.634+0000 7f4ad37fe640 1 -- 172.21.15.38:0/192789371 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4031830 con 0x7f4ad415b370 2023-12-22T08:47:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.634+0000 7f4ad37fe640 1 -- 172.21.15.38:0/192789371 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac4031990 con 0x7f4ad415b370 2023-12-22T08:47:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.634+0000 7f4ad37fe640 1 -- 172.21.15.38:0/192789371 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4031d20 con 0x7f4ad415b370 2023-12-22T08:47:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.634+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/192789371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad415b370 msgr2=0x7f4ad406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.634+0000 7f4ad9d4c640 1 --2- 172.21.15.38:0/192789371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad415b370 0x7f4ad406d160 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4ad406a7f0 tx=0x7f4ac402b8d0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.634+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/192789371 shutdown_connections 2023-12-22T08:47:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.635+0000 7f4ad9d4c640 1 --2- 172.21.15.38:0/192789371 >> v2:172.21.15.89:3300/0 conn(0x7f4ad406d6a0 0x7f4ad40adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.635+0000 7f4ad9d4c640 1 --2- 172.21.15.38:0/192789371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad415b370 0x7f4ad406d160 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.635+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/192789371 >> 172.21.15.38:0/192789371 conn(0x7f4ad40b1110 msgr2=0x7f4ad40b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.635+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/192789371 shutdown_connections 2023-12-22T08:47:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.635+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/192789371 wait complete. 2023-12-22T08:47:55.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.636+0000 7f4ad9d4c640 1 Processor -- start 2023-12-22T08:47:55.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.637+0000 7f4ad9d4c640 1 -- start start 2023-12-22T08:47:55.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.637+0000 7f4ad9d4c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad406d6a0 0x7f4ad413dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:55.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad9d4c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ad40ae4f0 0x7f4ad40afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:55.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad9d4c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ad415b370 0x7f4ad40b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:55.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad9d4c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad414bee0 con 0x7f4ad406d6a0 2023-12-22T08:47:55.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad9d4c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad414b2d0 con 0x7f4ad40ae4f0 2023-12-22T08:47:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad9d4c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad414b5b0 con 0x7f4ad415b370 2023-12-22T08:47:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad8d4a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad406d6a0 0x7f4ad413dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad8d4a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad406d6a0 0x7f4ad413dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37064/0 (socket says 172.21.15.38:37064) 2023-12-22T08:47:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad8d4a640 1 -- 172.21.15.38:0/2650380461 learned_addr learned my addr 172.21.15.38:0/2650380461 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad3fff640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ad40ae4f0 0x7f4ad40afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad954b640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ad415b370 0x7f4ad40b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad8d4a640 1 -- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ad415b370 msgr2=0x7f4ad40b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad8d4a640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ad415b370 0x7f4ad40b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad8d4a640 1 -- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ad40ae4f0 msgr2=0x7f4ad40afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad8d4a640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ad40ae4f0 0x7f4ad40afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad8d4a640 1 -- 172.21.15.38:0/2650380461 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac4009400 con 0x7f4ad406d6a0 2023-12-22T08:47:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad3fff640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ad40ae4f0 0x7f4ad40afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.638+0000 7f4ad954b640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ad415b370 0x7f4ad40b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:55.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.639+0000 7f4ad8d4a640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad406d6a0 0x7f4ad413dac0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009720 tx=0x7f4ac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:55.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.639+0000 7f4ad17fa640 1 -- 172.21.15.38:0/2650380461 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac403a8f0 con 0x7f4ad406d6a0 2023-12-22T08:47:55.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.639+0000 7f4ad17fa640 1 -- 172.21.15.38:0/2650380461 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac403aa50 con 0x7f4ad406d6a0 2023-12-22T08:47:55.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.639+0000 7f4ad17fa640 1 -- 172.21.15.38:0/2650380461 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac403ae00 con 0x7f4ad406d6a0 2023-12-22T08:47:55.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.639+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/2650380461 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad414b890 con 0x7f4ad406d6a0 2023-12-22T08:47:55.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.639+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/2650380461 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad414ae60 con 0x7f4ad406d6a0 2023-12-22T08:47:55.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.640+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/2650380461 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad414b050 con 0x7f4ad406d6a0 2023-12-22T08:47:55.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.641+0000 7f4ad17fa640 1 -- 172.21.15.38:0/2650380461 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4ac404d450 con 0x7f4ad406d6a0 2023-12-22T08:47:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.642+0000 7f4ad17fa640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ac006a480 0x7f4ac006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.643+0000 7f4ad17fa640 1 -- 172.21.15.38:0/2650380461 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ac40aaa80 con 0x7f4ad406d6a0 2023-12-22T08:47:55.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.643+0000 7f4ad3fff640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ac006a480 0x7f4ac006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.644+0000 7f4ad3fff640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ac006a480 0x7f4ac006c940 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4ad415e530 tx=0x7f4ac8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:55.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.647+0000 7f4ad17fa640 1 -- 172.21.15.38:0/2650380461 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4ac4076170 con 0x7f4ad406d6a0 2023-12-22T08:47:55.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.908+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/2650380461 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4ad4061910 con 0x7f4ad406d6a0 2023-12-22T08:47:55.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.915+0000 7f4ad17fa640 1 -- 172.21.15.38:0/2650380461 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4ac4079790 con 0x7f4ad406d6a0 2023-12-22T08:47:55.917 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.0 2023-12-22T08:47:55.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.918+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ac006a480 msgr2=0x7f4ac006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:55.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.918+0000 7f4ad9d4c640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ac006a480 0x7f4ac006c940 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4ad415e530 tx=0x7f4ac8008040 comp rx=0 tx=0).stop 2023-12-22T08:47:55.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.918+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/2650380461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad406d6a0 msgr2=0x7f4ad413dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:55.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.918+0000 7f4ad9d4c640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad406d6a0 0x7f4ad413dac0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009720 tx=0x7f4ac40046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.918+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/2650380461 shutdown_connections 2023-12-22T08:47:55.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.918+0000 7f4ad9d4c640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ad415b370 0x7f4ad40b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.918+0000 7f4ad9d4c640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ad40ae4f0 0x7f4ad40afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.918+0000 7f4ad9d4c640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ac006a480 0x7f4ac006c940 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.918+0000 7f4ad9d4c640 1 --2- 172.21.15.38:0/2650380461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad406d6a0 0x7f4ad413dac0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:55.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.918+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/2650380461 >> 172.21.15.38:0/2650380461 conn(0x7f4ad40b1110 msgr2=0x7f4ad4150f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:55.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.918+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/2650380461 shutdown_connections 2023-12-22T08:47:55.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:55.918+0000 7f4ad9d4c640 1 -- 172.21.15.38:0/2650380461 wait complete. 2023-12-22T08:47:55.940 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:47:56.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.162+0000 7f80f959f640 1 Processor -- start 2023-12-22T08:47:56.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.163+0000 7f80f959f640 1 -- start start 2023-12-22T08:47:56.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.164+0000 7f80f959f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f80f40b3f90 0x7f80f415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:56.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.164+0000 7f80f959f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f406ca50 0x7f80f4070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:56.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.165+0000 7f80f959f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f415eb20 con 0x7f80f415e740 2023-12-22T08:47:56.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.165+0000 7f80f959f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f406e650 con 0x7f80f40b3f90 2023-12-22T08:47:56.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.165+0000 7f80f959f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f4070770 con 0x7f80f406ca50 2023-12-22T08:47:56.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.165+0000 7f80f2ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f80f415e740 0x7f80f40b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:60814/0 (socket says 172.21.15.38:60814) 2023-12-22T08:47:56.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.165+0000 7f80f2ffd640 1 -- 172.21.15.38:0/2762045238 learned_addr learned my addr 172.21.15.38:0/2762045238 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:56.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.165+0000 7f80f37fe640 1 --2- 172.21.15.38:0/2762045238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f406ca50 0x7f80f4070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:56.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.166+0000 7f80f27fc640 1 --2- 172.21.15.38:0/2762045238 >> v2:172.21.15.89:3300/0 conn(0x7f80f40b3f90 0x7f80f415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:56.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.166+0000 7f80f1ffb640 1 -- 172.21.15.38:0/2762045238 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633727285 0 0) 0x7f80f415eb20 con 0x7f80f415e740 2023-12-22T08:47:56.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.166+0000 7f80f37fe640 1 -- 172.21.15.38:0/2762045238 >> v2:172.21.15.89:3300/0 conn(0x7f80f40b3f90 msgr2=0x7f80f415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:56.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.166+0000 7f80f37fe640 1 --2- 172.21.15.38:0/2762045238 >> v2:172.21.15.89:3300/0 conn(0x7f80f40b3f90 0x7f80f415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:56.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.166+0000 7f80f37fe640 1 -- 172.21.15.38:0/2762045238 >> v1:172.21.15.89:6789/0 conn(0x7f80f415e740 legacy=0x7f80f40b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:56.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.166+0000 7f80f37fe640 1 -- 172.21.15.38:0/2762045238 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f406d180 con 0x7f80f406ca50 2023-12-22T08:47:56.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.168+0000 7f80f37fe640 1 --2- 172.21.15.38:0/2762045238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f406ca50 0x7f80f4070c00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0097a0 tx=0x7f80ec02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b57e10f1f93c3bf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:56.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.168+0000 7f80f1ffb640 1 -- 172.21.15.38:0/2762045238 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec02f050 con 0x7f80f406ca50 2023-12-22T08:47:56.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.168+0000 7f80f1ffb640 1 -- 172.21.15.38:0/2762045238 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec031700 con 0x7f80f406ca50 2023-12-22T08:47:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.168+0000 7f80f1ffb640 1 -- 172.21.15.38:0/2762045238 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec031a90 con 0x7f80f406ca50 2023-12-22T08:47:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.169+0000 7f80f959f640 1 -- 172.21.15.38:0/2762045238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f406ca50 msgr2=0x7f80f4070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:56.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.169+0000 7f80f959f640 1 --2- 172.21.15.38:0/2762045238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f406ca50 0x7f80f4070c00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0097a0 tx=0x7f80ec02b7a0 comp rx=0 tx=0).stop 2023-12-22T08:47:56.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.169+0000 7f80f959f640 1 -- 172.21.15.38:0/2762045238 shutdown_connections 2023-12-22T08:47:56.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.169+0000 7f80f959f640 1 --2- 172.21.15.38:0/2762045238 >> v2:172.21.15.89:3300/0 conn(0x7f80f40b3f90 0x7f80f415db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:56.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.169+0000 7f80f959f640 1 --2- 172.21.15.38:0/2762045238 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f406ca50 0x7f80f4070c00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:56.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.169+0000 7f80f959f640 1 -- 172.21.15.38:0/2762045238 >> 172.21.15.38:0/2762045238 conn(0x7f80f40cfea0 msgr2=0x7f80f40d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:56.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.169+0000 7f80f959f640 1 -- 172.21.15.38:0/2762045238 shutdown_connections 2023-12-22T08:47:56.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.169+0000 7f80f959f640 1 -- 172.21.15.38:0/2762045238 wait complete. 2023-12-22T08:47:56.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.172+0000 7f80f959f640 1 Processor -- start 2023-12-22T08:47:56.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.172+0000 7f80f959f640 1 -- start start 2023-12-22T08:47:56.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.173+0000 7f80f959f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f406ca50 0x7f80f40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:56.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.173+0000 7f80f959f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f40b3f90 0x7f80f414d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:56.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.173+0000 7f80f959f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f415e740 0x7f80f40ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:56.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.173+0000 7f80f959f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f40b83c0 con 0x7f80f406ca50 2023-12-22T08:47:56.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.173+0000 7f80f959f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f414da00 con 0x7f80f415e740 2023-12-22T08:47:56.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.173+0000 7f80f959f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f40acf20 con 0x7f80f40b3f90 2023-12-22T08:47:56.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.174+0000 7f80f2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f406ca50 0x7f80f40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:56.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.174+0000 7f80f2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f406ca50 0x7f80f40b70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37078/0 (socket says 172.21.15.38:37078) 2023-12-22T08:47:56.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.174+0000 7f80f2ffd640 1 -- 172.21.15.38:0/950509122 learned_addr learned my addr 172.21.15.38:0/950509122 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:56.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.174+0000 7f80f27fc640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f40b3f90 0x7f80f414d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:56.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.174+0000 7f80f37fe640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f415e740 0x7f80f40ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:56.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.174+0000 7f80f2ffd640 1 -- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f40b3f90 msgr2=0x7f80f414d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:56.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.174+0000 7f80f2ffd640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f40b3f90 0x7f80f414d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:56.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.174+0000 7f80f2ffd640 1 -- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f415e740 msgr2=0x7f80f40ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:56.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.174+0000 7f80f2ffd640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f415e740 0x7f80f40ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:56.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.174+0000 7f80f2ffd640 1 -- 172.21.15.38:0/950509122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec009400 con 0x7f80f406ca50 2023-12-22T08:47:56.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.175+0000 7f80f2ffd640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f406ca50 0x7f80f40b70d0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f80e400c890 tx=0x7f80e400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:56.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.175+0000 7f80db7fe640 1 -- 172.21.15.38:0/950509122 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e400a640 con 0x7f80f406ca50 2023-12-22T08:47:56.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.175+0000 7f80db7fe640 1 -- 172.21.15.38:0/950509122 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e400a7c0 con 0x7f80f406ca50 2023-12-22T08:47:56.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.175+0000 7f80db7fe640 1 -- 172.21.15.38:0/950509122 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e400ab70 con 0x7f80f406ca50 2023-12-22T08:47:56.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.175+0000 7f80f959f640 1 -- 172.21.15.38:0/950509122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f40b7740 con 0x7f80f406ca50 2023-12-22T08:47:56.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.175+0000 7f80f959f640 1 -- 172.21.15.38:0/950509122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f40b7d00 con 0x7f80f406ca50 2023-12-22T08:47:56.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.177+0000 7f80f959f640 1 -- 172.21.15.38:0/950509122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f4061910 con 0x7f80f406ca50 2023-12-22T08:47:56.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.178+0000 7f80db7fe640 1 -- 172.21.15.38:0/950509122 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f80e400acd0 con 0x7f80f406ca50 2023-12-22T08:47:56.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.179+0000 7f80db7fe640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80e006a430 0x7f80e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:56.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.179+0000 7f80db7fe640 1 -- 172.21.15.38:0/950509122 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80e4087dc0 con 0x7f80f406ca50 2023-12-22T08:47:56.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.180+0000 7f80f27fc640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80e006a430 0x7f80e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:56.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.181+0000 7f80f27fc640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80e006a430 0x7f80e006c8f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f80f41f5f80 tx=0x7f80e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:56.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.184+0000 7f80db7fe640 1 -- 172.21.15.38:0/950509122 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f80e4053440 con 0x7f80f406ca50 2023-12-22T08:47:56.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.426+0000 7f80f959f640 1 -- 172.21.15.38:0/950509122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80f40b8a70 con 0x7f80f406ca50 2023-12-22T08:47:56.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.427+0000 7f80db7fe640 1 -- 172.21.15.38:0/950509122 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f80e4018090 con 0x7f80f406ca50 2023-12-22T08:47:56.429 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:47:56.429 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3891984223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3891984223},{"type":"v1","addr":"172.21.15.38:6834","nonce":3891984223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1561904072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1561904072},{"type":"v1","addr":"172.21.15.89:6836","nonce":1561904072}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4192516230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4192516230},{"type":"v1","addr":"172.21.15.89:6837","nonce":4192516230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:50.322298+0000","modified":"2023-12-22T08:47:53.343300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7716},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7716":{"gid":7716,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1276125280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1276125280},{"type":"v1","addr":"172.21.15.38:6835","nonce":1276125280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-22T08:47:56.429 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 62 2023-12-22T08:47:56.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.430+0000 7f80f959f640 1 -- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80e006a430 msgr2=0x7f80e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:56.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.430+0000 7f80f959f640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80e006a430 0x7f80e006c8f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f80f41f5f80 tx=0x7f80e8008040 comp rx=0 tx=0).stop 2023-12-22T08:47:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.430+0000 7f80f959f640 1 -- 172.21.15.38:0/950509122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f406ca50 msgr2=0x7f80f40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.430+0000 7f80f959f640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f406ca50 0x7f80f40b70d0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f80e400c890 tx=0x7f80e400cd50 comp rx=0 tx=0).stop 2023-12-22T08:47:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.430+0000 7f80f959f640 1 -- 172.21.15.38:0/950509122 shutdown_connections 2023-12-22T08:47:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.430+0000 7f80f959f640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80f415e740 0x7f80f40ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.430+0000 7f80f959f640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f80f40b3f90 0x7f80f414d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.430+0000 7f80f959f640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f80e006a430 0x7f80e006c8f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.430+0000 7f80f959f640 1 --2- 172.21.15.38:0/950509122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80f406ca50 0x7f80f40b70d0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.430+0000 7f80f959f640 1 -- 172.21.15.38:0/950509122 >> 172.21.15.38:0/950509122 conn(0x7f80f40cfea0 msgr2=0x7f80f4158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.431+0000 7f80f959f640 1 -- 172.21.15.38:0/950509122 shutdown_connections 2023-12-22T08:47:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:56.431+0000 7f80f959f640 1 -- 172.21.15.38:0/950509122 wait complete. 2023-12-22T08:47:56.854 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T08:47:50.322298+0000', 'modified': '2023-12-22T08:47:53.343300+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7716}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7716': {'gid': 7716, 'name': 'c', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.38:6835/1276125280', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6833', 'nonce': 1276125280}, {'type': 'v1', 'addr': '172.21.15.38:6835', 'nonce': 1276125280}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T08:47:56.855 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T08:47:56.855 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-22T08:47:57.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.089+0000 7fcf4a62d640 1 Processor -- start 2023-12-22T08:47:57.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.089+0000 7fcf4a62d640 1 -- start start 2023-12-22T08:47:57.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.090+0000 7fcf4a62d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcf4415ad90 0x7fcf440caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.090+0000 7fcf4a62d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcf4415e050 0x7fcf440cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.090+0000 7fcf4a62d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4415e630 con 0x7fcf44161bb0 2023-12-22T08:47:57.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.091+0000 7fcf4a62d640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf440ce2c0 con 0x7fcf4415ad90 2023-12-22T08:47:57.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.091+0000 7fcf4a62d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4415e910 con 0x7fcf4415e050 2023-12-22T08:47:57.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.091+0000 7fcf4962b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcf4415ad90 0x7fcf440caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.091+0000 7fcf4962b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcf4415ad90 0x7fcf440caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37092/0 (socket says 172.21.15.38:37092) 2023-12-22T08:47:57.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.091+0000 7fcf4962b640 1 -- 172.21.15.38:0/1440086176 learned_addr learned my addr 172.21.15.38:0/1440086176 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:57.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.091+0000 7fcf4962b640 1 -- 172.21.15.38:0/1440086176 >> v2:172.21.15.89:3300/0 conn(0x7fcf4415e050 msgr2=0x7fcf440cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:57.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.091+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/1440086176 >> v2:172.21.15.89:3300/0 conn(0x7fcf4415e050 0x7fcf440cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.091+0000 7fcf4962b640 1 --2- 172.21.15.38:0/1440086176 >> v2:172.21.15.89:3300/0 conn(0x7fcf4415e050 0x7fcf440cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.091+0000 7fcf4962b640 1 -- 172.21.15.38:0/1440086176 >> v1:172.21.15.89:6789/0 conn(0x7fcf44161bb0 legacy=0x7fcf4415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:57.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.091+0000 7fcf4962b640 1 -- 172.21.15.38:0/1440086176 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf441610d0 con 0x7fcf4415ad90 2023-12-22T08:47:57.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.091+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/1440086176 >> v2:172.21.15.89:3300/0 conn(0x7fcf4415e050 0x7fcf440cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:57.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.093+0000 7fcf4962b640 1 --2- 172.21.15.38:0/1440086176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4415ad90 0x7fcf440caed0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fcf440ca220 tx=0x7fcf4002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4854baf44452388 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:57.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.093+0000 7fcf37fff640 1 -- 172.21.15.38:0/1440086176 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40031870 con 0x7fcf4415ad90 2023-12-22T08:47:57.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.093+0000 7fcf37fff640 1 -- 172.21.15.38:0/1440086176 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf400319d0 con 0x7fcf4415ad90 2023-12-22T08:47:57.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.093+0000 7fcf37fff640 1 -- 172.21.15.38:0/1440086176 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40031d60 con 0x7fcf4415ad90 2023-12-22T08:47:57.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.094+0000 7fcf4a62d640 1 -- 172.21.15.38:0/1440086176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4415ad90 msgr2=0x7fcf440caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.094+0000 7fcf4a62d640 1 --2- 172.21.15.38:0/1440086176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4415ad90 0x7fcf440caed0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fcf440ca220 tx=0x7fcf4002b910 comp rx=0 tx=0).stop 2023-12-22T08:47:57.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.094+0000 7fcf4a62d640 1 -- 172.21.15.38:0/1440086176 shutdown_connections 2023-12-22T08:47:57.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.094+0000 7fcf4a62d640 1 --2- 172.21.15.38:0/1440086176 >> v2:172.21.15.89:3300/0 conn(0x7fcf4415e050 0x7fcf440cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.094+0000 7fcf4a62d640 1 --2- 172.21.15.38:0/1440086176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4415ad90 0x7fcf440caed0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.094+0000 7fcf4a62d640 1 -- 172.21.15.38:0/1440086176 >> 172.21.15.38:0/1440086176 conn(0x7fcf440d31c0 msgr2=0x7fcf440d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:57.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.094+0000 7fcf4a62d640 1 -- 172.21.15.38:0/1440086176 shutdown_connections 2023-12-22T08:47:57.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.094+0000 7fcf4a62d640 1 -- 172.21.15.38:0/1440086176 wait complete. 2023-12-22T08:47:57.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.096+0000 7fcf4a62d640 1 Processor -- start 2023-12-22T08:47:57.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.096+0000 7fcf4a62d640 1 -- start start 2023-12-22T08:47:57.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.098+0000 7fcf4a62d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4415ad90 0x7fcf4414c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.098+0000 7fcf4a62d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf4415e050 0x7fcf440c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.098+0000 7fcf4a62d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf44161bb0 0x7fcf440cf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.098+0000 7fcf4a62d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440c8630 con 0x7fcf4415ad90 2023-12-22T08:47:57.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.098+0000 7fcf4a62d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440c7d70 con 0x7fcf44161bb0 2023-12-22T08:47:57.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.098+0000 7fcf4a62d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440c8050 con 0x7fcf4415e050 2023-12-22T08:47:57.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.098+0000 7fcf4962b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4415ad90 0x7fcf4414c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.098+0000 7fcf4962b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4415ad90 0x7fcf4414c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37100/0 (socket says 172.21.15.38:37100) 2023-12-22T08:47:57.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.098+0000 7fcf4962b640 1 -- 172.21.15.38:0/1012455639 learned_addr learned my addr 172.21.15.38:0/1012455639 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:57.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.098+0000 7fcf48e2a640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf4415e050 0x7fcf440c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.098+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf44161bb0 0x7fcf440cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.098+0000 7fcf4962b640 1 -- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf4415e050 msgr2=0x7fcf440c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.098+0000 7fcf4962b640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf4415e050 0x7fcf440c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.099+0000 7fcf4962b640 1 -- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf44161bb0 msgr2=0x7fcf440cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.099+0000 7fcf4962b640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf44161bb0 0x7fcf440cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.099+0000 7fcf4962b640 1 -- 172.21.15.38:0/1012455639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf400094d0 con 0x7fcf4415ad90 2023-12-22T08:47:57.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.099+0000 7fcf48e2a640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf4415e050 0x7fcf440c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:57.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.099+0000 7fcf4962b640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4415ad90 0x7fcf4414c880 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fcf400097f0 tx=0x7fcf400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:57.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.099+0000 7fcf35ffb640 1 -- 172.21.15.38:0/1012455639 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40031820 con 0x7fcf4415ad90 2023-12-22T08:47:57.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.099+0000 7fcf35ffb640 1 -- 172.21.15.38:0/1012455639 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf400443f0 con 0x7fcf4415ad90 2023-12-22T08:47:57.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.099+0000 7fcf35ffb640 1 -- 172.21.15.38:0/1012455639 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf400447a0 con 0x7fcf4415ad90 2023-12-22T08:47:57.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.099+0000 7fcf4a62d640 1 -- 172.21.15.38:0/1012455639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf440c8880 con 0x7fcf4415ad90 2023-12-22T08:47:57.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.099+0000 7fcf4a62d640 1 -- 172.21.15.38:0/1012455639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf440a9de0 con 0x7fcf4415ad90 2023-12-22T08:47:57.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.101+0000 7fcf35ffb640 1 -- 172.21.15.38:0/1012455639 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcf4004d450 con 0x7fcf4415ad90 2023-12-22T08:47:57.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.103+0000 7fcf35ffb640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcf2806a460 0x7fcf2806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.103+0000 7fcf35ffb640 1 -- 172.21.15.38:0/1012455639 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf4002d040 con 0x7fcf4415ad90 2023-12-22T08:47:57.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.104+0000 7fcf4e3ff740 1 Processor -- start 2023-12-22T08:47:57.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.104+0000 7fcf48e2a640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcf2806a460 0x7fcf2806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.104+0000 7fcf4e3ff740 1 -- start start 2023-12-22T08:47:57.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.105+0000 7fcf4e3ff740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba5bf10 0x55faeba5c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.105+0000 7fcf4e3ff740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2be90 0x55faeba59180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.105+0000 7fcf4e3ff740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba2fa90 0x55faeba596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.105+0000 7fcf4e3ff740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faeb99bf80 con 0x55faeba2fa90 2023-12-22T08:47:57.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.105+0000 7fcf4e3ff740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faeb999710 con 0x55faeba2be90 2023-12-22T08:47:57.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.105+0000 7fcf4e3ff740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55faeb995000 con 0x55faeba5bf10 2023-12-22T08:47:57.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.105+0000 7fcf49e2c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba2fa90 0x55faeba596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.105+0000 7fcf48e2a640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcf2806a460 0x7fcf2806c920 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcf4415a7a0 tx=0x7fcf38008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.105+0000 7fcf49e2c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba2fa90 0x55faeba596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37116/0 (socket says 172.21.15.38:37116) 2023-12-22T08:47:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.105+0000 7fcf49e2c640 1 -- 172.21.15.38:0/1323026689 learned_addr learned my addr 172.21.15.38:0/1323026689 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.106+0000 7fcf48e2a640 1 --2- 172.21.15.38:0/1323026689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2be90 0x55faeba59180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.106+0000 7fcf4962b640 1 --2- 172.21.15.38:0/1323026689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba5bf10 0x55faeba5c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.106+0000 7fcf49e2c640 1 -- 172.21.15.38:0/1323026689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba5bf10 msgr2=0x55faeba5c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.106+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/1323026689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba5bf10 0x55faeba5c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.106+0000 7fcf49e2c640 1 -- 172.21.15.38:0/1323026689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2be90 msgr2=0x55faeba59180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.106+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/1323026689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2be90 0x55faeba59180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.106+0000 7fcf49e2c640 1 -- 172.21.15.38:0/1323026689 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55faeb95c690 con 0x55faeba2fa90 2023-12-22T08:47:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.106+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/1323026689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba2fa90 0x55faeba596c0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00d430 tx=0x7fcf3c00d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f51b29abc04081e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.106+0000 7fcf26ffd640 1 -- 172.21.15.38:0/1323026689 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00b6e0 con 0x55faeba2fa90 2023-12-22T08:47:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.106+0000 7fcf26ffd640 1 -- 172.21.15.38:0/1323026689 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c00b840 con 0x55faeba2fa90 2023-12-22T08:47:57.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.106+0000 7fcf26ffd640 1 -- 172.21.15.38:0/1323026689 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00bbd0 con 0x55faeba2fa90 2023-12-22T08:47:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.107+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/1323026689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba2fa90 msgr2=0x55faeba596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.107+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/1323026689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba2fa90 0x55faeba596c0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00d430 tx=0x7fcf3c00d8f0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.107+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/1323026689 shutdown_connections 2023-12-22T08:47:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.107+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/1323026689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba2fa90 0x55faeba596c0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.107+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/1323026689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2be90 0x55faeba59180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.107+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/1323026689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba5bf10 0x55faeba5c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.107+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/1323026689 >> 172.21.15.38:0/1323026689 conn(0x55faeba2e1a0 msgr2=0x55faeba76d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.108+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/1323026689 shutdown_connections 2023-12-22T08:47:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.108+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/1323026689 wait complete. 2023-12-22T08:47:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.108+0000 7fcf4e3ff740 1 -- start start 2023-12-22T08:47:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.108+0000 7fcf4e3ff740 1 Processor -- start 2023-12-22T08:47:57.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.109+0000 7fcf4e3ff740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba2fa90 0x55faeba87550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.109+0000 7fcf4e3ff740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba5bf10 0x55faeba5ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.109+0000 7fcf4e3ff740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 0x55faeba83fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf4e3ff740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faeb9367d0 con 0x55faeba498b0 2023-12-22T08:47:57.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf4e3ff740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faeb936470 con 0x55faeba5bf10 2023-12-22T08:47:57.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf4e3ff740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55faeb6fcf20 con 0x55faeba2fa90 2023-12-22T08:47:57.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf4e3ff740 10 client.0 _ll_register_callbacks cb 0x55faeb9851b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:47:57.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf49e2c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 0x55faeba83fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf49e2c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 0x55faeba83fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37132/0 (socket says 172.21.15.38:37132) 2023-12-22T08:47:57.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf49e2c640 1 -- 172.21.15.38:0/2797772792 learned_addr learned my addr 172.21.15.38:0/2797772792 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:57.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf48e2a640 1 --2- 172.21.15.38:0/2797772792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba5bf10 0x55faeba5ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf4962b640 1 --2- 172.21.15.38:0/2797772792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba2fa90 0x55faeba87550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf49e2c640 1 -- 172.21.15.38:0/2797772792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba2fa90 msgr2=0x55faeba87550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:57.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/2797772792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba2fa90 0x55faeba87550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf49e2c640 1 -- 172.21.15.38:0/2797772792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba5bf10 msgr2=0x55faeba5ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:57.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/2797772792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba5bf10 0x55faeba5ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.110+0000 7fcf49e2c640 1 -- 172.21.15.38:0/2797772792 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c008c30 con 0x55faeba498b0 2023-12-22T08:47:57.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.111+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/2797772792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 0x55faeba83fd0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c000f80 tx=0x7fcf3c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f5edb8afbedb55 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:57.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.111+0000 7fcf1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:47:57.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.111+0000 7fcf1ffff640 1 -- 172.21.15.38:0/2797772792 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00b6e0 con 0x55faeba498b0 2023-12-22T08:47:57.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.111+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2797772792 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55faeb9bf550 con 0x55faeba498b0 2023-12-22T08:47:57.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.111+0000 7fcf1ffff640 1 -- 172.21.15.38:0/2797772792 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf3c015820 con 0x55faeba498b0 2023-12-22T08:47:57.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.111+0000 7fcf1ffff640 1 -- 172.21.15.38:0/2797772792 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf3c0159e0 con 0x55faeba498b0 2023-12-22T08:47:57.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.111+0000 7fcf4e3ff740 10 client.7848 fetch_fsmap learned FSMap version 62 2023-12-22T08:47:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.111+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2797772792 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x55faeb993680 con 0x55faeba498b0 2023-12-22T08:47:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.112+0000 7fcf1ffff640 1 -- 172.21.15.38:0/2797772792 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55faeb9bf550 con 0x55faeba498b0 2023-12-22T08:47:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.112+0000 7fcf1ffff640 1 -- 172.21.15.38:0/2797772792 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 62) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fcf3c008040 con 0x55faeba498b0 2023-12-22T08:47:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.112+0000 7fcf4e3ff740 10 client.7848 fetch_fsmap finished waiting for FSMap version 62 2023-12-22T08:47:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.112+0000 7fcf4e3ff740 10 client.7848 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-22T08:47:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.112+0000 7fcf4e3ff740 20 client.7848 populate_metadata read hostname 'smithi038' 2023-12-22T08:47:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.112+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/2797772792 >> [v2:172.21.15.38:6833/1276125280,v1:172.21.15.38:6835/1276125280] conn(0x55faeba91cb0 0x55faeba940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.112+0000 7fcf4e3ff740 4 client.7848 mds_command: new command op to 7716 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T08:47:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.112+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2797772792 --> [v2:172.21.15.38:6833/1276125280,v1:172.21.15.38:6835/1276125280] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55faeb987b50 con 0x55faeba91cb0 2023-12-22T08:47:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.112+0000 7fcf4962b640 1 --2- 172.21.15.38:0/2797772792 >> [v2:172.21.15.38:6833/1276125280,v1:172.21.15.38:6835/1276125280] conn(0x55faeba91cb0 0x55faeba940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.113+0000 7fcf4962b640 1 --2- 172.21.15.38:0/2797772792 >> [v2:172.21.15.38:6833/1276125280,v1:172.21.15.38:6835/1276125280] conn(0x55faeba91cb0 0x55faeba940a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44288022ed47fdfb server_cookie=73b92fa0b6e8e67d in_seq=0 out_seq=0 2023-12-22T08:47:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.113+0000 7fcf1ffff640 10 client.7848 ms_handle_connect on v2:172.21.15.38:6833/1276125280 2023-12-22T08:47:57.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.113+0000 7fcf1ffff640 1 -- 172.21.15.38:0/2797772792 <== mds.0 v2:172.21.15.38:6833/1276125280 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55faeb987b50 con 0x55faeba91cb0 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.113+0000 7fcf1ffff640 10 client.7848 handle_command_reply: tid=0 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.114+0000 7fcf4e3ff740 1 client.7848 shutdown 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.114+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2797772792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 msgr2=0x55faeba83fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.114+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/2797772792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 0x55faeba83fd0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c000f80 tx=0x7fcf3c004ab0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.114+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2797772792 shutdown_connections 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.114+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/2797772792 >> [v2:172.21.15.38:6833/1276125280,v1:172.21.15.38:6835/1276125280] conn(0x55faeba91cb0 0x55faeba940a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.114+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/2797772792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 0x55faeba83fd0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.114+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/2797772792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba5bf10 0x55faeba5ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.114+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/2797772792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba2fa90 0x55faeba87550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.114+0000 7fcf1ffff640 0 client.7848 ms_handle_reset on v2:172.21.15.38:6833/1276125280 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.114+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2797772792 >> 172.21.15.38:0/2797772792 conn(0x55faeba2be90 msgr2=0x55faeba30340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.114+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2797772792 shutdown_connections 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.114+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2797772792 wait complete. 2023-12-22T08:47:57.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.114+0000 7fcf4e3ff740 20 client.7848 trim_cache size 0 max 16384 2023-12-22T08:47:57.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.131+0000 7fcf4e3ff740 1 Processor -- start 2023-12-22T08:47:57.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.131+0000 7fcf4e3ff740 1 -- start start 2023-12-22T08:47:57.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.132+0000 7fcf4e3ff740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2fa90 0x55faeba77cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.132+0000 7fcf4e3ff740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba498b0 0x55faeba2ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.132+0000 7fcf4e3ff740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba5bf10 0x55faeba2b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.132+0000 7fcf4e3ff740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faeba321c0 con 0x55faeba5bf10 2023-12-22T08:47:57.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.132+0000 7fcf4e3ff740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faeba304f0 con 0x55faeba2fa90 2023-12-22T08:47:57.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.132+0000 7fcf4e3ff740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55faeba989f0 con 0x55faeba498b0 2023-12-22T08:47:57.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.132+0000 7fcf49e2c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba5bf10 0x55faeba2b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.132+0000 7fcf49e2c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba5bf10 0x55faeba2b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37136/0 (socket says 172.21.15.38:37136) 2023-12-22T08:47:57.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.132+0000 7fcf49e2c640 1 -- 172.21.15.38:0/1943980363 learned_addr learned my addr 172.21.15.38:0/1943980363 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:57.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.133+0000 7fcf48e2a640 1 --2- 172.21.15.38:0/1943980363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba498b0 0x55faeba2ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.133+0000 7fcf49e2c640 1 -- 172.21.15.38:0/1943980363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba498b0 msgr2=0x55faeba2ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:57.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.133+0000 7fcf4962b640 1 --2- 172.21.15.38:0/1943980363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2fa90 0x55faeba77cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.133+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/1943980363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba498b0 0x55faeba2ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.133+0000 7fcf49e2c640 1 -- 172.21.15.38:0/1943980363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2fa90 msgr2=0x55faeba77cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.133+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/1943980363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2fa90 0x55faeba77cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.133+0000 7fcf49e2c640 1 -- 172.21.15.38:0/1943980363 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55faeb9359e0 con 0x55faeba5bf10 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.133+0000 7fcf48e2a640 1 --2- 172.21.15.38:0/1943980363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba498b0 0x55faeba2ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.133+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/1943980363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba5bf10 0x55faeba2b370 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00d430 tx=0x7fcf3c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe18971a08a458 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.133+0000 7fcf277fe640 1 -- 172.21.15.38:0/1943980363 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00b6e0 con 0x55faeba5bf10 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.133+0000 7fcf277fe640 1 -- 172.21.15.38:0/1943980363 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c015c80 con 0x55faeba5bf10 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.133+0000 7fcf277fe640 1 -- 172.21.15.38:0/1943980363 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c015880 con 0x55faeba5bf10 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.134+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/1943980363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba5bf10 msgr2=0x55faeba2b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.134+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/1943980363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba5bf10 0x55faeba2b370 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00d430 tx=0x7fcf3c01e000 comp rx=0 tx=0).stop 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.134+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/1943980363 shutdown_connections 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.134+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/1943980363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba5bf10 0x55faeba2b370 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.134+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/1943980363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba498b0 0x55faeba2ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.134+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/1943980363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2fa90 0x55faeba77cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.134+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/1943980363 >> 172.21.15.38:0/1943980363 conn(0x55faeba2be90 msgr2=0x55faeba71830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:57.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.134+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/1943980363 shutdown_connections 2023-12-22T08:47:57.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.134+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/1943980363 wait complete. 2023-12-22T08:47:57.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.135+0000 7fcf4e3ff740 1 -- start start 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.135+0000 7fcf4e3ff740 1 Processor -- start 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.136+0000 7fcf4e3ff740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2fa90 0x55faebad70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.136+0000 7fcf4e3ff740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 0x55faebadda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.136+0000 7fcf4e3ff740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba5bf10 0x55faeba6f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.136+0000 7fcf4e3ff740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faeba774a0 con 0x55faeba498b0 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.136+0000 7fcf4e3ff740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faeba85920 con 0x55faeba2fa90 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.136+0000 7fcf4e3ff740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55faeba76840 con 0x55faeba5bf10 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.136+0000 7fcf4e3ff740 10 client.0 _ll_register_callbacks cb 0x7fcf3c008790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.136+0000 7fcf48e2a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 0x55faebadda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.136+0000 7fcf48e2a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 0x55faebadda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37146/0 (socket says 172.21.15.38:37146) 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.136+0000 7fcf48e2a640 1 -- 172.21.15.38:0/2558410706 learned_addr learned my addr 172.21.15.38:0/2558410706 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.137+0000 7fcf4962b640 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2fa90 0x55faebad70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.137+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba5bf10 0x55faeba6f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.137+0000 7fcf48e2a640 1 -- 172.21.15.38:0/2558410706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba5bf10 msgr2=0x55faeba6f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.137+0000 7fcf48e2a640 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba5bf10 0x55faeba6f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.137+0000 7fcf48e2a640 1 -- 172.21.15.38:0/2558410706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2fa90 msgr2=0x55faebad70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.137+0000 7fcf48e2a640 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2fa90 0x55faebad70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.137+0000 7fcf48e2a640 1 -- 172.21.15.38:0/2558410706 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55faeb993680 con 0x55faeba498b0 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.137+0000 7fcf49e2c640 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba5bf10 0x55faeba6f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.137+0000 7fcf48e2a640 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 0x55faebadda00 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fcf4415ef50 tx=0x7fcf38004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b840401c236eeed server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.137+0000 7fcf1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.137+0000 7fcf1ffff640 1 -- 172.21.15.38:0/2558410706 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38013e40 con 0x55faeba498b0 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.137+0000 7fcf1ffff640 1 -- 172.21.15.38:0/2558410706 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf38021410 con 0x55faeba498b0 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.138+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2558410706 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf3c00b840 con 0x55faeba498b0 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.138+0000 7fcf1ffff640 1 -- 172.21.15.38:0/2558410706 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf380215d0 con 0x55faeba498b0 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.138+0000 7fcf4e3ff740 10 client.7854 fetch_fsmap learned FSMap version 62 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.138+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2558410706 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x55faeb95aef0 con 0x55faeba498b0 2023-12-22T08:47:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.138+0000 7fcf1ffff640 1 -- 172.21.15.38:0/2558410706 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c00b840 con 0x55faeba498b0 2023-12-22T08:47:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.138+0000 7fcf1ffff640 1 -- 172.21.15.38:0/2558410706 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 62) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fcf38021730 con 0x55faeba498b0 2023-12-22T08:47:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.138+0000 7fcf4e3ff740 10 client.7854 fetch_fsmap finished waiting for FSMap version 62 2023-12-22T08:47:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.138+0000 7fcf4e3ff740 10 client.7854 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-22T08:47:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.138+0000 7fcf4e3ff740 20 client.7854 populate_metadata read hostname 'smithi038' 2023-12-22T08:47:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.138+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.38:6833/1276125280,v1:172.21.15.38:6835/1276125280] conn(0x55faeba84d70 0x55faebae85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.138+0000 7fcf4e3ff740 4 client.7854 mds_command: new command op to 7716 tid=0[{"prefix": "status"}] 2023-12-22T08:47:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.138+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2558410706 --> [v2:172.21.15.38:6833/1276125280,v1:172.21.15.38:6835/1276125280] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55faeb98e080 con 0x55faeba84d70 2023-12-22T08:47:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.139+0000 7fcf4962b640 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.38:6833/1276125280,v1:172.21.15.38:6835/1276125280] conn(0x55faeba84d70 0x55faebae85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.139+0000 7fcf4962b640 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.38:6833/1276125280,v1:172.21.15.38:6835/1276125280] conn(0x55faeba84d70 0x55faebae85b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a04d2fbbd5cafa8 server_cookie=394cae584d626d28 in_seq=0 out_seq=0 2023-12-22T08:47:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.139+0000 7fcf1ffff640 10 client.7854 ms_handle_connect on v2:172.21.15.38:6833/1276125280 2023-12-22T08:47:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.139+0000 7fcf1ffff640 1 -- 172.21.15.38:0/2558410706 <== mds.0 v2:172.21.15.38:6833/1276125280 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55faeb98e080 con 0x55faeba84d70 2023-12-22T08:47:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.139+0000 7fcf1ffff640 10 client.7854 handle_command_reply: tid=0 2023-12-22T08:47:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.139+0000 7fcf4e3ff740 1 client.7854 shutdown 2023-12-22T08:47:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.140+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2558410706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 msgr2=0x55faebadda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.140+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 0x55faebadda00 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fcf4415ef50 tx=0x7fcf38004680 comp rx=0 tx=0).stop 2023-12-22T08:47:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.140+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2558410706 shutdown_connections 2023-12-22T08:47:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.140+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.38:6833/1276125280,v1:172.21.15.38:6835/1276125280] conn(0x55faeba84d70 0x55faebae85b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.140+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55faeba5bf10 0x55faeba6f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.140+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55faeba498b0 0x55faebadda00 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.140+0000 7fcf4e3ff740 1 --2- 172.21.15.38:0/2558410706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55faeba2fa90 0x55faebad70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.140+0000 7fcf1ffff640 0 client.7854 ms_handle_reset on v2:172.21.15.38:6833/1276125280 2023-12-22T08:47:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.140+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2558410706 >> 172.21.15.38:0/2558410706 conn(0x55faeba2be90 msgr2=0x55faeba71830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.140+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2558410706 shutdown_connections 2023-12-22T08:47:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.140+0000 7fcf4e3ff740 1 -- 172.21.15.38:0/2558410706 wait complete. 2023-12-22T08:47:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.140+0000 7fcf4e3ff740 20 client.7854 trim_cache size 0 max 16384 2023-12-22T08:47:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:47:57.145 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:47:57.145 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-12-22T08:47:57.145 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 7716, 2023-12-22T08:47:57.145 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-12-22T08:47:57.145 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-12-22T08:47:57.145 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-12-22T08:47:57.145 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 6.8127942519999998, 2023-12-22T08:47:57.145 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 62, 2023-12-22T08:47:57.145 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 142, 2023-12-22T08:47:57.145 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 142, 2023-12-22T08:47:57.145 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 12.625623007 2023-12-22T08:47:57.145 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:47:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.141+0000 7fcf4a62d640 1 -- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcf2806a460 msgr2=0x7fcf2806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.141+0000 7fcf4a62d640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcf2806a460 0x7fcf2806c920 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcf4415a7a0 tx=0x7fcf38008040 comp rx=0 tx=0).stop 2023-12-22T08:47:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.141+0000 7fcf4a62d640 1 -- 172.21.15.38:0/1012455639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4415ad90 msgr2=0x7fcf4414c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.141+0000 7fcf4a62d640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4415ad90 0x7fcf4414c880 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fcf400097f0 tx=0x7fcf400046c0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.141+0000 7fcf4a62d640 1 -- 172.21.15.38:0/1012455639 shutdown_connections 2023-12-22T08:47:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.141+0000 7fcf4a62d640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf44161bb0 0x7fcf440cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.141+0000 7fcf4a62d640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf4415e050 0x7fcf440c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.141+0000 7fcf4a62d640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcf2806a460 0x7fcf2806c920 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.141+0000 7fcf4a62d640 1 --2- 172.21.15.38:0/1012455639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4415ad90 0x7fcf4414c880 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.141+0000 7fcf4a62d640 1 -- 172.21.15.38:0/1012455639 >> 172.21.15.38:0/1012455639 conn(0x7fcf440d31c0 msgr2=0x7fcf440cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.141+0000 7fcf4a62d640 1 -- 172.21.15.38:0/1012455639 shutdown_connections 2023-12-22T08:47:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.141+0000 7fcf4a62d640 1 -- 172.21.15.38:0/1012455639 wait complete. 2023-12-22T08:47:57.159 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:47:57.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.369+0000 7faa554d7640 1 Processor -- start 2023-12-22T08:47:57.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.369+0000 7faa554d7640 1 -- start start 2023-12-22T08:47:57.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.371+0000 7faa554d7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa50161720 0x7faa500adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.371+0000 7faa554d7640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa500ce950 con 0x7faa500ae1e0 2023-12-22T08:47:57.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.371+0000 7faa554d7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa50072170 con 0x7faa50161340 2023-12-22T08:47:57.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.371+0000 7faa554d7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa500cdd40 con 0x7faa50161720 2023-12-22T08:47:57.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.371+0000 7faa54cd6640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7faa500ae1e0 0x7faa5006f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:35926/0 (socket says 172.21.15.38:35926) 2023-12-22T08:47:57.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.371+0000 7faa54cd6640 1 -- 172.21.15.38:0/1210568884 learned_addr learned my addr 172.21.15.38:0/1210568884 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:47:57.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.371+0000 7faa47fff640 1 --2- 172.21.15.38:0/1210568884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa50161720 0x7faa500adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.372+0000 7faa47fff640 1 -- 172.21.15.38:0/1210568884 >> v1:172.21.15.89:6789/0 conn(0x7faa50161340 legacy=0x7faa50071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.372+0000 7faa47fff640 1 -- 172.21.15.38:0/1210568884 >> v1:172.21.15.38:6789/0 conn(0x7faa500ae1e0 legacy=0x7faa5006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.372+0000 7faa47fff640 1 -- 172.21.15.38:0/1210568884 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500ce020 con 0x7faa50161720 2023-12-22T08:47:57.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.374+0000 7faa47fff640 1 --2- 172.21.15.38:0/1210568884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa50161720 0x7faa500adca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faa38009800 tx=0x7faa3802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b708f5d67e669c71 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:57.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.377+0000 7faa4f7fe640 1 -- 172.21.15.38:0/1210568884 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38031800 con 0x7faa50161720 2023-12-22T08:47:57.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.377+0000 7faa4f7fe640 1 -- 172.21.15.38:0/1210568884 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa38031960 con 0x7faa50161720 2023-12-22T08:47:57.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.377+0000 7faa4f7fe640 1 -- 172.21.15.38:0/1210568884 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38031cf0 con 0x7faa50161720 2023-12-22T08:47:57.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.377+0000 7faa554d7640 1 -- 172.21.15.38:0/1210568884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa50161720 msgr2=0x7faa500adca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.377+0000 7faa554d7640 1 --2- 172.21.15.38:0/1210568884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa50161720 0x7faa500adca0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faa38009800 tx=0x7faa3802b8a0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.377+0000 7faa554d7640 1 -- 172.21.15.38:0/1210568884 shutdown_connections 2023-12-22T08:47:57.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.377+0000 7faa554d7640 1 --2- 172.21.15.38:0/1210568884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa50161720 0x7faa500adca0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.377+0000 7faa554d7640 1 -- 172.21.15.38:0/1210568884 >> 172.21.15.38:0/1210568884 conn(0x7faa500b1f70 msgr2=0x7faa500b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:57.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.377+0000 7faa554d7640 1 -- 172.21.15.38:0/1210568884 shutdown_connections 2023-12-22T08:47:57.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.377+0000 7faa554d7640 1 -- 172.21.15.38:0/1210568884 wait complete. 2023-12-22T08:47:57.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.379+0000 7faa554d7640 1 Processor -- start 2023-12-22T08:47:57.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.379+0000 7faa554d7640 1 -- start start 2023-12-22T08:47:57.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.380+0000 7faa554d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa500ae1e0 0x7faa5009efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.380+0000 7faa554d7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa50161340 0x7faa5014ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.380+0000 7faa554d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa50161720 0x7faa5015ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.380+0000 7faa554d7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa50149ba0 con 0x7faa50161720 2023-12-22T08:47:57.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.380+0000 7faa554d7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5009f8b0 con 0x7faa500ae1e0 2023-12-22T08:47:57.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.380+0000 7faa554d7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa50149270 con 0x7faa50161340 2023-12-22T08:47:57.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.381+0000 7faa54cd6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa50161720 0x7faa5015ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.381+0000 7faa54cd6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa50161720 0x7faa5015ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37156/0 (socket says 172.21.15.38:37156) 2023-12-22T08:47:57.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.381+0000 7faa54cd6640 1 -- 172.21.15.38:0/1838407484 learned_addr learned my addr 172.21.15.38:0/1838407484 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:57.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.381+0000 7faa47fff640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa50161340 0x7faa5014ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.381+0000 7faa4ffff640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa500ae1e0 0x7faa5009efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.381+0000 7faa54cd6640 1 -- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa50161340 msgr2=0x7faa5014ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.381+0000 7faa54cd6640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa50161340 0x7faa5014ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.381+0000 7faa54cd6640 1 -- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa500ae1e0 msgr2=0x7faa5009efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.381+0000 7faa54cd6640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa500ae1e0 0x7faa5009efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.382+0000 7faa54cd6640 1 -- 172.21.15.38:0/1838407484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38009400 con 0x7faa50161720 2023-12-22T08:47:57.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.382+0000 7faa54cd6640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa50161720 0x7faa5015ec20 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7faa4800cbc0 tx=0x7faa4800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:57.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.382+0000 7faa4d7fa640 1 -- 172.21.15.38:0/1838407484 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800ad40 con 0x7faa50161720 2023-12-22T08:47:57.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.382+0000 7faa4d7fa640 1 -- 172.21.15.38:0/1838407484 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa48012400 con 0x7faa50161720 2023-12-22T08:47:57.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.382+0000 7faa4d7fa640 1 -- 172.21.15.38:0/1838407484 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800aea0 con 0x7faa50161720 2023-12-22T08:47:57.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.382+0000 7faa554d7640 1 -- 172.21.15.38:0/1838407484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa50149550 con 0x7faa50161720 2023-12-22T08:47:57.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.382+0000 7faa554d7640 1 -- 172.21.15.38:0/1838407484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5009f510 con 0x7faa50161720 2023-12-22T08:47:57.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.384+0000 7faa554d7640 1 -- 172.21.15.38:0/1838407484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa50149d10 con 0x7faa50161720 2023-12-22T08:47:57.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.385+0000 7faa4d7fa640 1 -- 172.21.15.38:0/1838407484 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faa48007070 con 0x7faa50161720 2023-12-22T08:47:57.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.386+0000 7faa4d7fa640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faa3006a430 0x7faa3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:57.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.386+0000 7faa4d7fa640 1 -- 172.21.15.38:0/1838407484 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa48088780 con 0x7faa50161720 2023-12-22T08:47:57.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.386+0000 7faa4ffff640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faa3006a430 0x7faa3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:57.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.388+0000 7faa4ffff640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faa3006a430 0x7faa3006c8f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7faa40000f60 tx=0x7faa40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:57.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.390+0000 7faa4d7fa640 1 -- 172.21.15.38:0/1838407484 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faa48053e10 con 0x7faa50161720 2023-12-22T08:47:57.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.626+0000 7faa554d7640 1 -- 172.21.15.38:0/1838407484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faa500ce5b0 con 0x7faa50161720 2023-12-22T08:47:57.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.627+0000 7faa4d7fa640 1 -- 172.21.15.38:0/1838407484 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7faa48017070 con 0x7faa50161720 2023-12-22T08:47:57.628 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:47:57.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.630+0000 7faa554d7640 1 -- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faa3006a430 msgr2=0x7faa3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.630+0000 7faa554d7640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faa3006a430 0x7faa3006c8f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7faa40000f60 tx=0x7faa40009040 comp rx=0 tx=0).stop 2023-12-22T08:47:57.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.630+0000 7faa554d7640 1 -- 172.21.15.38:0/1838407484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa50161720 msgr2=0x7faa5015ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:57.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.630+0000 7faa554d7640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa50161720 0x7faa5015ec20 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7faa4800cbc0 tx=0x7faa4800a430 comp rx=0 tx=0).stop 2023-12-22T08:47:57.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.630+0000 7faa554d7640 1 -- 172.21.15.38:0/1838407484 shutdown_connections 2023-12-22T08:47:57.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.630+0000 7faa554d7640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7faa3006a430 0x7faa3006c8f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.630+0000 7faa554d7640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa50161720 0x7faa5015ec20 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.630+0000 7faa554d7640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa50161340 0x7faa5014ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.630+0000 7faa554d7640 1 --2- 172.21.15.38:0/1838407484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa500ae1e0 0x7faa5009efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:57.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.630+0000 7faa554d7640 1 -- 172.21.15.38:0/1838407484 >> 172.21.15.38:0/1838407484 conn(0x7faa500b1f70 msgr2=0x7faa500b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:57.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.630+0000 7faa554d7640 1 -- 172.21.15.38:0/1838407484 shutdown_connections 2023-12-22T08:47:57.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:57.630+0000 7faa554d7640 1 -- 172.21.15.38:0/1838407484 wait complete. 2023-12-22T08:47:57.652 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:47:57.652 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:47:57.652 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-12-22T08:47:57.652 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T08:47:57.652 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:47:57.652 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:47:57.652 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:47:57.653 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:47:57.653 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:47:57.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:57.653 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-12-22T08:47:57.709 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:47:57.709 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:47:57.709 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:47:57.709 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:57.709 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:47:57.709 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:57.709 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:47:57.709 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 41889sec preferred_lft 41889sec 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-12-22T08:47:57.710 INFO:teuthology.orchestra.run.smithi038.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:47:57.711 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:57.711 INFO:teuthology.orchestra.run.smithi038.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:47:57.711 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:57.711 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::5440:f6ff:fe40:85a/64 scope link 2023-12-22T08:47:57.711 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:57.711 INFO:teuthology.orchestra.run.smithi038.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:47:57.711 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:c3:65:6c:32:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:47:57.711 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::e4c3:65ff:fe6c:322e/64 scope link 2023-12-22T08:47:57.711 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:57.711 INFO:teuthology.orchestra.run.smithi038.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:47:57.711 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T08:47:57.711 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::34bf:8aff:fe68:3bf6/64 scope link 2023-12-22T08:47:57.711 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:57.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:57.713 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:47:57.813 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-12-22T08:47:57.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:57.818 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-12-22T08:47:57.876 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-12-22T08:47:57.876 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:47:57.876 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-22T08:47:57.876 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-22T08:47:57.876 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:47:57.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:57.877 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:47:57.877 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:47:57.877 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T08:47:57.877 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T08:47:57.877 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T08:47:57.877 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:47:58.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:58.075 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:47:58.129 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:47:58.129 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-22T08:47:58.130 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:47:58.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:58.130 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-12-22T08:47:58.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:47:58.236 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T08:47:58.297 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:47:58.298 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:47:58.298 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:47:58.358 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-22T08:47:58.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:58.358 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:47:58.507 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:47:58.507 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:47:58.541 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:47:58.541 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:47:58.541 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:47:58.541 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with new device syntax: 0@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:47:58.541 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:47:58.543 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T08:47:58.543 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:47:58.543 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:47:58.543 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:47:58.543 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:47:58.548 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:47:58.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:58.548 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:47:58.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:58.633 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:47:58.704 INFO:teuthology.orchestra.run.smithi038.stdout:client5813 2023-12-22T08:47:58.704 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:47:58.705 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:47:58.760 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:47:58.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.984+0000 7fad01c29640 1 Processor -- start 2023-12-22T08:47:58.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.985+0000 7fad01c29640 1 -- start start 2023-12-22T08:47:58.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.986+0000 7fad01c29640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7facfc157980 0x7facfc15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:58.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.986+0000 7fad01c29640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facfc0b3ff0 0x7facfc06cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:58.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.986+0000 7fad01c29640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7facfc0b4470 0x7facfc06d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:58.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.986+0000 7fad01c29640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facfc0d1520 con 0x7facfc157980 2023-12-22T08:47:58.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.986+0000 7fad01c29640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facfc0d1800 con 0x7facfc0b4470 2023-12-22T08:47:58.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.986+0000 7fad01c29640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0d1ae0 con 0x7facfc0b3ff0 2023-12-22T08:47:58.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.986+0000 7fad00c27640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7facfc157980 0x7facfc15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:58.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.987+0000 7fad00c27640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7facfc157980 0x7facfc15eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37160/0 (socket says 172.21.15.38:37160) 2023-12-22T08:47:58.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.987+0000 7fad00c27640 1 -- 172.21.15.38:0/729207205 learned_addr learned my addr 172.21.15.38:0/729207205 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:58.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.987+0000 7fad01428640 1 --2- 172.21.15.38:0/729207205 >> v2:172.21.15.89:3300/0 conn(0x7facfc0b4470 0x7facfc06d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:58.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.987+0000 7facfbfff640 1 --2- 172.21.15.38:0/729207205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facfc0b3ff0 0x7facfc06cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:58.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.987+0000 7fad00c27640 1 -- 172.21.15.38:0/729207205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facfc0b3ff0 msgr2=0x7facfc06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:58.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.987+0000 7fad00c27640 1 --2- 172.21.15.38:0/729207205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facfc0b3ff0 0x7facfc06cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:58.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.987+0000 7fad00c27640 1 -- 172.21.15.38:0/729207205 >> v2:172.21.15.89:3300/0 conn(0x7facfc0b4470 msgr2=0x7facfc06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:47:58.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.987+0000 7fad00c27640 1 --2- 172.21.15.38:0/729207205 >> v2:172.21.15.89:3300/0 conn(0x7facfc0b4470 0x7facfc06d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:58.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.987+0000 7fad00c27640 1 -- 172.21.15.38:0/729207205 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0d1dc0 con 0x7facfc157980 2023-12-22T08:47:58.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.987+0000 7facfbfff640 1 --2- 172.21.15.38:0/729207205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facfc0b3ff0 0x7facfc06cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:58.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.988+0000 7fad00c27640 1 --2- 172.21.15.38:0/729207205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facfc157980 0x7facfc15eb10 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7facfc161fe0 tx=0x7facec02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108c99a5bb446cf7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:58.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.988+0000 7facfb7fe640 1 -- 172.21.15.38:0/729207205 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec02ca80 con 0x7facfc157980 2023-12-22T08:47:58.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.989+0000 7facfb7fe640 1 -- 172.21.15.38:0/729207205 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec02cbe0 con 0x7facfc157980 2023-12-22T08:47:58.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.989+0000 7facfb7fe640 1 -- 172.21.15.38:0/729207205 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec0343f0 con 0x7facfc157980 2023-12-22T08:47:58.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.989+0000 7fad01c29640 1 -- 172.21.15.38:0/729207205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facfc157980 msgr2=0x7facfc15eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:58.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.989+0000 7fad01c29640 1 --2- 172.21.15.38:0/729207205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facfc157980 0x7facfc15eb10 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7facfc161fe0 tx=0x7facec02bee0 comp rx=0 tx=0).stop 2023-12-22T08:47:58.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.989+0000 7fad01c29640 1 -- 172.21.15.38:0/729207205 shutdown_connections 2023-12-22T08:47:58.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.989+0000 7fad01c29640 1 --2- 172.21.15.38:0/729207205 >> v2:172.21.15.89:3300/0 conn(0x7facfc0b4470 0x7facfc06d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:58.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.989+0000 7fad01c29640 1 --2- 172.21.15.38:0/729207205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facfc0b3ff0 0x7facfc06cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:58.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.989+0000 7fad01c29640 1 --2- 172.21.15.38:0/729207205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facfc157980 0x7facfc15eb10 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:58.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.989+0000 7fad01c29640 1 -- 172.21.15.38:0/729207205 >> 172.21.15.38:0/729207205 conn(0x7facfc0d31f0 msgr2=0x7facfc0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:58.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.989+0000 7fad01c29640 1 -- 172.21.15.38:0/729207205 shutdown_connections 2023-12-22T08:47:58.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.989+0000 7fad01c29640 1 -- 172.21.15.38:0/729207205 wait complete. 2023-12-22T08:47:58.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.991+0000 7fad01c29640 1 Processor -- start 2023-12-22T08:47:58.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.991+0000 7fad01c29640 1 -- start start 2023-12-22T08:47:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.992+0000 7fad01c29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facfc0b3ff0 0x7facfc15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.992+0000 7fad01c29640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facfc0b4470 0x7facfc1f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.992+0000 7fad01c29640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facfc157980 0x7facfc145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.992+0000 7fad01c29640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc156490 con 0x7facfc0b4470 2023-12-22T08:47:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.992+0000 7fad01c29640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc1558c0 con 0x7facfc0b3ff0 2023-12-22T08:47:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.992+0000 7fad01c29640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc155b60 con 0x7facfc157980 2023-12-22T08:47:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.993+0000 7facfbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facfc0b4470 0x7facfc1f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.993+0000 7facfbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facfc0b4470 0x7facfc1f6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37164/0 (socket says 172.21.15.38:37164) 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.993+0000 7facfbfff640 1 -- 172.21.15.38:0/93125371 learned_addr learned my addr 172.21.15.38:0/93125371 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.993+0000 7fad00c27640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facfc0b3ff0 0x7facfc15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.993+0000 7fad01428640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facfc157980 0x7facfc145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.993+0000 7facfbfff640 1 -- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facfc157980 msgr2=0x7facfc145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.993+0000 7facfbfff640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facfc157980 0x7facfc145ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.993+0000 7facfbfff640 1 -- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facfc0b3ff0 msgr2=0x7facfc15a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.993+0000 7facfbfff640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facfc0b3ff0 0x7facfc15a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.993+0000 7facfbfff640 1 -- 172.21.15.38:0/93125371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec009b30 con 0x7facfc0b4470 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.993+0000 7fad01428640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facfc157980 0x7facfc145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.994+0000 7facfbfff640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facfc0b4470 0x7facfc1f6f50 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7facf000c7c0 tx=0x7facf000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.994+0000 7facf97fa640 1 -- 172.21.15.38:0/93125371 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0007a30 con 0x7facfc0b4470 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.994+0000 7facf97fa640 1 -- 172.21.15.38:0/93125371 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf0007b90 con 0x7facfc0b4470 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.994+0000 7facf97fa640 1 -- 172.21.15.38:0/93125371 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000ce70 con 0x7facfc0b4470 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.994+0000 7fad01c29640 1 -- 172.21.15.38:0/93125371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc155e40 con 0x7facfc0b4470 2023-12-22T08:47:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.994+0000 7fad01c29640 1 -- 172.21.15.38:0/93125371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc146410 con 0x7facfc0b4470 2023-12-22T08:47:58.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.995+0000 7fad01c29640 1 -- 172.21.15.38:0/93125371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facfc156640 con 0x7facfc0b4470 2023-12-22T08:47:58.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.996+0000 7facf97fa640 1 -- 172.21.15.38:0/93125371 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7facf00113f0 con 0x7facfc0b4470 2023-12-22T08:47:58.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.997+0000 7facf97fa640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7face806a430 0x7face806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:47:58.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.997+0000 7facf97fa640 1 -- 172.21.15.38:0/93125371 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facf0088960 con 0x7facfc0b4470 2023-12-22T08:47:58.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.998+0000 7fad00c27640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7face806a430 0x7face806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:47:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:58.999+0000 7fad00c27640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7face806a430 0x7face806c8f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7facec035000 tx=0x7facec030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:47:59.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.002+0000 7facf97fa640 1 -- 172.21.15.38:0/93125371 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7facfc156640 con 0x7facfc0b4470 2023-12-22T08:47:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.232+0000 7fad01c29640 1 -- 172.21.15.38:0/93125371 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7facfc061910 con 0x7facfc0b4470 2023-12-22T08:47:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.233+0000 7facf97fa640 1 -- 172.21.15.38:0/93125371 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7facf0054090 con 0x7facfc0b4470 2023-12-22T08:47:59.234 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:47:59.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.236+0000 7fad01c29640 1 -- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7face806a430 msgr2=0x7face806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:59.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.236+0000 7fad01c29640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7face806a430 0x7face806c8f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7facec035000 tx=0x7facec030000 comp rx=0 tx=0).stop 2023-12-22T08:47:59.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.236+0000 7fad01c29640 1 -- 172.21.15.38:0/93125371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facfc0b4470 msgr2=0x7facfc1f6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:47:59.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.236+0000 7fad01c29640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facfc0b4470 0x7facfc1f6f50 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7facf000c7c0 tx=0x7facf000cc80 comp rx=0 tx=0).stop 2023-12-22T08:47:59.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.236+0000 7fad01c29640 1 -- 172.21.15.38:0/93125371 shutdown_connections 2023-12-22T08:47:59.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.236+0000 7fad01c29640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facfc157980 0x7facfc145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:59.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.236+0000 7fad01c29640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7face806a430 0x7face806c8f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:59.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.236+0000 7fad01c29640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facfc0b4470 0x7facfc1f6f50 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:59.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.236+0000 7fad01c29640 1 --2- 172.21.15.38:0/93125371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facfc0b3ff0 0x7facfc15a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:47:59.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.236+0000 7fad01c29640 1 -- 172.21.15.38:0/93125371 >> 172.21.15.38:0/93125371 conn(0x7facfc0d31f0 msgr2=0x7facfc06f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:47:59.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.236+0000 7fad01c29640 1 -- 172.21.15.38:0/93125371 shutdown_connections 2023-12-22T08:47:59.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:47:59.236+0000 7fad01c29640 1 -- 172.21.15.38:0/93125371 wait complete. 2023-12-22T08:47:59.257 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:47:59.257 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:47:59.257 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-22T08:47:59.257 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T08:47:59.257 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T08:47:59.257 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:47:59.258 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:47:59.258 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:47:59.258 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:47:59.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:59.258 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-22T08:47:59.320 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:47:59.320 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:47:59.320 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:47:59.320 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:47:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 41882sec preferred_lft 41882sec 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::9cc2:a9ff:fe75:e812/64 scope link 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8e:46:07:65:e3:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::8c46:7ff:fe65:e31f/64 scope link 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:47:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T08:47:59.323 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2cc2:baff:fe6f:ea22/64 scope link 2023-12-22T08:47:59.323 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:47:59.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:59.323 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:47:59.415 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-22T08:47:59.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:59.420 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-22T08:47:59.475 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-22T08:47:59.475 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:47:59.475 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:47:59.475 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:47:59.476 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:47:59.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:59.476 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:47:59.476 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:47:59.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:47:59.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:47:59.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:47:59.476 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:47:59.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:59.644 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:47:59.691 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T08:47:59.692 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-22T08:47:59.692 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:47:59.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:59.692 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-22T08:47:59.790 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:47:59.790 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T08:47:59.848 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:47:59.848 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:47:59.848 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:47:59.900 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-22T08:47:59.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:47:59.901 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:48:00.038 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:48:00.038 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:48:00.071 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:48:00.071 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:48:00.071 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:48:00.071 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 1@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:48:00.071 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:48:00.073 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T08:48:00.073 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:48:00.073 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:48:00.073 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:48:00.073 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:48:00.077 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:48:00.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:00.077 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:48:00.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:00.156 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:48:00.209 INFO:teuthology.orchestra.run.smithi089.stdout:client5816 2023-12-22T08:48:00.209 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:48:00.209 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:00.260 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:48:00.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.497+0000 7f7e3e0ab640 1 Processor -- start 2023-12-22T08:48:00.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.498+0000 7f7e3e0ab640 1 -- start start 2023-12-22T08:48:00.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.499+0000 7f7e3e0ab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e380cddd0 0x7f7e38071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:00.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.499+0000 7f7e3e0ab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e3806c090 0x7f7e380ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:00.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.499+0000 7f7e3e0ab640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e380ce6f0 con 0x7f7e38161c30 2023-12-22T08:48:00.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.499+0000 7f7e3e0ab640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3806c830 con 0x7f7e3806c090 2023-12-22T08:48:00.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.499+0000 7f7e3e0ab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3806cb10 con 0x7f7e380cddd0 2023-12-22T08:48:00.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.500+0000 7f7e37fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7e38161c30 0x7f7e3806d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:35934/0 (socket says 172.21.15.38:35934) 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.500+0000 7f7e37fff640 1 -- 172.21.15.38:0/1546311393 learned_addr learned my addr 172.21.15.38:0/1546311393 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.500+0000 7f7e377fe640 1 --2- 172.21.15.38:0/1546311393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e380cddd0 0x7f7e38071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.500+0000 7f7e36ffd640 1 --2- 172.21.15.38:0/1546311393 >> v2:172.21.15.89:3300/0 conn(0x7f7e3806c090 0x7f7e380ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.500+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576771810 0 0) 0x7f7e380ce6f0 con 0x7f7e38161c30 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.500+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e20003520 con 0x7f7e38161c30 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4225424010 0 0) 0x7f7e20003520 con 0x7f7e38161c30 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e380cddd0 msgr2=0x7f7e38071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 --2- 172.21.15.38:0/1546311393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e380cddd0 0x7f7e38071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 >> v2:172.21.15.89:3300/0 conn(0x7f7e3806c090 msgr2=0x7f7e380ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 --2- 172.21.15.38:0/1546311393 >> v2:172.21.15.89:3300/0 conn(0x7f7e3806c090 0x7f7e380ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3806cdf0 con 0x7f7e38161c30 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f7e300019f0 con 0x7f7e38161c30 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 >> v1:172.21.15.38:6789/0 conn(0x7f7e38161c30 legacy=0x7f7e3806d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 --2- 172.21.15.38:0/1546311393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e200039e0 0x7f7e20003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:00.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 --2- 172.21.15.38:0/1546311393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e380cddd0 0x7f7e200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:00.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 --2- 172.21.15.38:0/1546311393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e20004d00 0x7f7e20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:00.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3806c830 con 0x7f7e20004d00 2023-12-22T08:48:00.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3806cb10 con 0x7f7e200039e0 2023-12-22T08:48:00.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2000b9d0 con 0x7f7e380cddd0 2023-12-22T08:48:00.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e37fff640 1 --2- 172.21.15.38:0/1546311393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e20004d00 0x7f7e20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:00.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.501+0000 7f7e36ffd640 1 --2- 172.21.15.38:0/1546311393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e380cddd0 0x7f7e200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:00.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.502+0000 7f7e377fe640 1 --2- 172.21.15.38:0/1546311393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e200039e0 0x7f7e20003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:00.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.502+0000 7f7e37fff640 1 -- 172.21.15.38:0/1546311393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e380cddd0 msgr2=0x7f7e200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:00.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.502+0000 7f7e37fff640 1 --2- 172.21.15.38:0/1546311393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e380cddd0 0x7f7e200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:00.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.502+0000 7f7e37fff640 1 -- 172.21.15.38:0/1546311393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e200039e0 msgr2=0x7f7e20003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:00.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.502+0000 7f7e37fff640 1 --2- 172.21.15.38:0/1546311393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e200039e0 0x7f7e20003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:00.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.502+0000 7f7e37fff640 1 -- 172.21.15.38:0/1546311393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20003520 con 0x7f7e20004d00 2023-12-22T08:48:00.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.503+0000 7f7e37fff640 1 --2- 172.21.15.38:0/1546311393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e20004d00 0x7f7e20005180 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000a860 tx=0x7f7e200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4dd7a46fdcf377 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:00.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.504+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30034630 con 0x7f7e20004d00 2023-12-22T08:48:00.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.504+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3002f070 con 0x7f7e20004d00 2023-12-22T08:48:00.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.504+0000 7f7e367fc640 1 -- 172.21.15.38:0/1546311393 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e300349f0 con 0x7f7e20004d00 2023-12-22T08:48:00.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.504+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/1546311393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e20004d00 msgr2=0x7f7e20005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:00.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.504+0000 7f7e3e0ab640 1 --2- 172.21.15.38:0/1546311393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e20004d00 0x7f7e20005180 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000a860 tx=0x7f7e200057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:00.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.504+0000 7f7e37fff640 1 -- 172.21.15.38:0/1546311393 reap_dead start 2023-12-22T08:48:00.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.504+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/1546311393 shutdown_connections 2023-12-22T08:48:00.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.504+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/1546311393 >> 172.21.15.38:0/1546311393 conn(0x7f7e380cf010 msgr2=0x7f7e380cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:00.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.505+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/1546311393 shutdown_connections 2023-12-22T08:48:00.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.505+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/1546311393 wait complete. 2023-12-22T08:48:00.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.507+0000 7f7e3e0ab640 1 Processor -- start 2023-12-22T08:48:00.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.507+0000 7f7e3e0ab640 1 -- start start 2023-12-22T08:48:00.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.508+0000 7f7e3e0ab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e381490a0 0x7f7e3815a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:00.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.508+0000 7f7e3e0ab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e3815ad40 0x7f7e38070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:00.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.508+0000 7f7e3e0ab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e381496e0 0x7f7e38070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:00.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.508+0000 7f7e3e0ab640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e381fac10 con 0x7f7e3815ad40 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.508+0000 7f7e3e0ab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3815b1e0 con 0x7f7e381490a0 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.508+0000 7f7e3e0ab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e381fa2e0 con 0x7f7e381496e0 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.508+0000 7f7e36ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e3815ad40 0x7f7e38070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.508+0000 7f7e36ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e3815ad40 0x7f7e38070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37182/0 (socket says 172.21.15.38:37182) 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.508+0000 7f7e36ffd640 1 -- 172.21.15.38:0/218182241 learned_addr learned my addr 172.21.15.38:0/218182241 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.508+0000 7f7e36ffd640 1 -- 172.21.15.38:0/218182241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e381496e0 msgr2=0x7f7e38070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.508+0000 7f7e36ffd640 1 --2- 172.21.15.38:0/218182241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e381496e0 0x7f7e38070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.509+0000 7f7e36ffd640 1 -- 172.21.15.38:0/218182241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e381490a0 msgr2=0x7f7e3815a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.509+0000 7f7e36ffd640 1 --2- 172.21.15.38:0/218182241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e381490a0 0x7f7e3815a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.509+0000 7f7e36ffd640 1 -- 172.21.15.38:0/218182241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e381fa5c0 con 0x7f7e3815ad40 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.509+0000 7f7e36ffd640 1 --2- 172.21.15.38:0/218182241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e3815ad40 0x7f7e38070770 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0116d0 tx=0x7f7e2c011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.509+0000 7f7e1ffff640 1 -- 172.21.15.38:0/218182241 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c00f940 con 0x7f7e3815ad40 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.509+0000 7f7e1ffff640 1 -- 172.21.15.38:0/218182241 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2c00faa0 con 0x7f7e3815ad40 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.509+0000 7f7e1ffff640 1 -- 172.21.15.38:0/218182241 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c00fe10 con 0x7f7e3815ad40 2023-12-22T08:48:00.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.509+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/218182241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e381fa8a0 con 0x7f7e3815ad40 2023-12-22T08:48:00.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.509+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/218182241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e381fb280 con 0x7f7e3815ad40 2023-12-22T08:48:00.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.510+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/218182241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e38061910 con 0x7f7e3815ad40 2023-12-22T08:48:00.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.511+0000 7f7e1ffff640 1 -- 172.21.15.38:0/218182241 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e2c015460 con 0x7f7e3815ad40 2023-12-22T08:48:00.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.512+0000 7f7e1ffff640 1 --2- 172.21.15.38:0/218182241 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e2406a430 0x7f7e2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:00.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.513+0000 7f7e1ffff640 1 -- 172.21.15.38:0/218182241 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e2c088e70 con 0x7f7e3815ad40 2023-12-22T08:48:00.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.513+0000 7f7e377fe640 1 --2- 172.21.15.38:0/218182241 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e2406a430 0x7f7e2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:00.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.514+0000 7f7e377fe640 1 --2- 172.21.15.38:0/218182241 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e2406a430 0x7f7e2406c8f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009890 tx=0x7f7e28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:00.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.517+0000 7f7e1ffff640 1 -- 172.21.15.38:0/218182241 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7e2c054460 con 0x7f7e3815ad40 2023-12-22T08:48:00.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.746+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/218182241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e381fad50 con 0x7f7e3815ad40 2023-12-22T08:48:00.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.748+0000 7f7e1ffff640 1 -- 172.21.15.38:0/218182241 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f7e2c057a80 con 0x7f7e3815ad40 2023-12-22T08:48:00.749 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:00.749 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3891984223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3891984223},{"type":"v1","addr":"172.21.15.38:6834","nonce":3891984223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1561904072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1561904072},{"type":"v1","addr":"172.21.15.89:6836","nonce":1561904072}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4192516230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4192516230},{"type":"v1","addr":"172.21.15.89:6837","nonce":4192516230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:50.322298+0000","modified":"2023-12-22T08:47:53.343300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7716},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7716":{"gid":7716,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1276125280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1276125280},{"type":"v1","addr":"172.21.15.38:6835","nonce":1276125280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-22T08:48:00.749 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 62 2023-12-22T08:48:00.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.750+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/218182241 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e2406a430 msgr2=0x7f7e2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:00.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.750+0000 7f7e3e0ab640 1 --2- 172.21.15.38:0/218182241 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e2406a430 0x7f7e2406c8f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009890 tx=0x7f7e28008040 comp rx=0 tx=0).stop 2023-12-22T08:48:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.750+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/218182241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e3815ad40 msgr2=0x7f7e38070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.750+0000 7f7e3e0ab640 1 --2- 172.21.15.38:0/218182241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e3815ad40 0x7f7e38070770 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0116d0 tx=0x7f7e2c011b90 comp rx=0 tx=0).stop 2023-12-22T08:48:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.750+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/218182241 shutdown_connections 2023-12-22T08:48:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.750+0000 7f7e3e0ab640 1 --2- 172.21.15.38:0/218182241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e381496e0 0x7f7e38070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.750+0000 7f7e3e0ab640 1 --2- 172.21.15.38:0/218182241 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e2406a430 0x7f7e2406c8f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.750+0000 7f7e3e0ab640 1 --2- 172.21.15.38:0/218182241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e3815ad40 0x7f7e38070770 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.750+0000 7f7e3e0ab640 1 --2- 172.21.15.38:0/218182241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e381490a0 0x7f7e3815a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.750+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/218182241 >> 172.21.15.38:0/218182241 conn(0x7f7e380cf010 msgr2=0x7f7e38160d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.750+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/218182241 shutdown_connections 2023-12-22T08:48:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:00.751+0000 7f7e3e0ab640 1 -- 172.21.15.38:0/218182241 wait complete. 2023-12-22T08:48:00.773 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-22T08:48:01.017 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":7716,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.672921587999999,"mdsmap_epoch":62,"osdmap_epoch":142,"osdmap_epoch_barrier":142,"uptime":16.485763589000001} 2023-12-22T08:48:01.017 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 7716, "mdsmap_epoch": 62, "osdmap_epoch": 142, "osdmap_epoch_barrier": 142, "rank_uptime": 10.672921588, "state": "up:active", "uptime": 16.485763589, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:48:01.018 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-22T08:48:01.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.253+0000 7f17cb425640 1 Processor -- start 2023-12-22T08:48:01.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.254+0000 7f17cb425640 1 -- start start 2023-12-22T08:48:01.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.255+0000 7f17cb425640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f17c40adfb0 0x7f17c40ae460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:01.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.255+0000 7f17cb425640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f17c406fcf0 0x7f17c4070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:01.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.255+0000 7f17cb425640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c415ca20 con 0x7f17c415b370 2023-12-22T08:48:01.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.255+0000 7f17cb425640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c40ae9a0 con 0x7f17c406fcf0 2023-12-22T08:48:01.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.255+0000 7f17cb425640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c415b750 con 0x7f17c40adfb0 2023-12-22T08:48:01.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.256+0000 7f17cac24640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f17c406fcf0 0x7f17c4070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:01.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.256+0000 7f17cac24640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f17c406fcf0 0x7f17c4070180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55496/0 (socket says 172.21.15.38:55496) 2023-12-22T08:48:01.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.256+0000 7f17cac24640 1 -- 172.21.15.38:0/2139775804 learned_addr learned my addr 172.21.15.38:0/2139775804 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:01.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.256+0000 7f17cac24640 1 -- 172.21.15.38:0/2139775804 >> v2:172.21.15.89:3300/0 conn(0x7f17c40adfb0 msgr2=0x7f17c40ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:01.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.256+0000 7f17cac24640 1 --2- 172.21.15.38:0/2139775804 >> v2:172.21.15.89:3300/0 conn(0x7f17c40adfb0 0x7f17c40ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:01.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.256+0000 7f17cac24640 1 -- 172.21.15.38:0/2139775804 >> v1:172.21.15.89:6789/0 conn(0x7f17c415b370 legacy=0x7f17c406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:01.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.256+0000 7f17cac24640 1 -- 172.21.15.38:0/2139775804 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c406dc20 con 0x7f17c406fcf0 2023-12-22T08:48:01.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.257+0000 7f17cac24640 1 --2- 172.21.15.38:0/2139775804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17c406fcf0 0x7f17c4070180 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f17c406a7b0 tx=0x7f17bc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea9902ba1cda59b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:01.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.258+0000 7f17c9421640 1 -- 172.21.15.38:0/2139775804 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc02ca80 con 0x7f17c406fcf0 2023-12-22T08:48:01.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.258+0000 7f17c9421640 1 -- 172.21.15.38:0/2139775804 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc02cbe0 con 0x7f17c406fcf0 2023-12-22T08:48:01.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.258+0000 7f17c9421640 1 -- 172.21.15.38:0/2139775804 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0343f0 con 0x7f17c406fcf0 2023-12-22T08:48:01.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.258+0000 7f17cb425640 1 -- 172.21.15.38:0/2139775804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17c406fcf0 msgr2=0x7f17c4070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:01.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.258+0000 7f17cb425640 1 --2- 172.21.15.38:0/2139775804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17c406fcf0 0x7f17c4070180 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f17c406a7b0 tx=0x7f17bc02bee0 comp rx=0 tx=0).stop 2023-12-22T08:48:01.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.259+0000 7f17cb425640 1 -- 172.21.15.38:0/2139775804 shutdown_connections 2023-12-22T08:48:01.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.259+0000 7f17cb425640 1 --2- 172.21.15.38:0/2139775804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17c406fcf0 0x7f17c4070180 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:01.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.259+0000 7f17cb425640 1 --2- 172.21.15.38:0/2139775804 >> v2:172.21.15.89:3300/0 conn(0x7f17c40adfb0 0x7f17c40ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:01.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.259+0000 7f17cb425640 1 -- 172.21.15.38:0/2139775804 >> 172.21.15.38:0/2139775804 conn(0x7f17c40b1110 msgr2=0x7f17c40b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:01.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.259+0000 7f17cb425640 1 -- 172.21.15.38:0/2139775804 shutdown_connections 2023-12-22T08:48:01.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.259+0000 7f17cb425640 1 -- 172.21.15.38:0/2139775804 wait complete. 2023-12-22T08:48:01.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.261+0000 7f17cb425640 1 Processor -- start 2023-12-22T08:48:01.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.261+0000 7f17cb425640 1 -- start start 2023-12-22T08:48:01.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.262+0000 7f17cb425640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c406fcf0 0x7f17c40ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:01.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.262+0000 7f17cb425640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c40adfb0 0x7f17c40ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:01.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.262+0000 7f17cb425640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17c415b370 0x7f17c414aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:01.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.262+0000 7f17cb425640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40adde0 con 0x7f17c415b370 2023-12-22T08:48:01.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.262+0000 7f17cb425640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40ac5f0 con 0x7f17c406fcf0 2023-12-22T08:48:01.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.262+0000 7f17cb425640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c414b400 con 0x7f17c40adfb0 2023-12-22T08:48:01.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.262+0000 7f17cac24640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17c415b370 0x7f17c414aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:01.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.262+0000 7f17cac24640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17c415b370 0x7f17c414aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55500/0 (socket says 172.21.15.38:55500) 2023-12-22T08:48:01.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.262+0000 7f17cac24640 1 -- 172.21.15.38:0/3306567126 learned_addr learned my addr 172.21.15.38:0/3306567126 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:01.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.262+0000 7f17cac24640 1 -- 172.21.15.38:0/3306567126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c40adfb0 msgr2=0x7f17c40ac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:01.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.262+0000 7f17cac24640 1 --2- 172.21.15.38:0/3306567126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c40adfb0 0x7f17c40ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:01.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.262+0000 7f17cac24640 1 -- 172.21.15.38:0/3306567126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c406fcf0 msgr2=0x7f17c40ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:01.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.262+0000 7f17ca423640 1 --2- 172.21.15.38:0/3306567126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c406fcf0 0x7f17c40ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:01.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.263+0000 7f17cac24640 1 --2- 172.21.15.38:0/3306567126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c406fcf0 0x7f17c40ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:01.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.263+0000 7f17cac24640 1 -- 172.21.15.38:0/3306567126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc009b30 con 0x7f17c415b370 2023-12-22T08:48:01.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.263+0000 7f17cac24640 1 --2- 172.21.15.38:0/3306567126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17c415b370 0x7f17c414aec0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f17bc036040 tx=0x7f17bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:01.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.263+0000 7f17baffd640 1 -- 172.21.15.38:0/3306567126 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc03e450 con 0x7f17c415b370 2023-12-22T08:48:01.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.263+0000 7f17baffd640 1 -- 172.21.15.38:0/3306567126 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc03e5d0 con 0x7f17c415b370 2023-12-22T08:48:01.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.263+0000 7f17baffd640 1 -- 172.21.15.38:0/3306567126 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc03e980 con 0x7f17c415b370 2023-12-22T08:48:01.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.263+0000 7f17cb425640 1 -- 172.21.15.38:0/3306567126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c40ac800 con 0x7f17c415b370 2023-12-22T08:48:01.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.263+0000 7f17cb425640 1 -- 172.21.15.38:0/3306567126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c40acdc0 con 0x7f17c415b370 2023-12-22T08:48:01.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.265+0000 7f17cb425640 1 -- 172.21.15.38:0/3306567126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c4061910 con 0x7f17c415b370 2023-12-22T08:48:01.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.266+0000 7f17baffd640 1 -- 172.21.15.38:0/3306567126 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f17bc02cd50 con 0x7f17c415b370 2023-12-22T08:48:01.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.266+0000 7f17baffd640 1 --2- 172.21.15.38:0/3306567126 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f17a806a430 0x7f17a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:01.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.267+0000 7f17baffd640 1 -- 172.21.15.38:0/3306567126 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17bc0ab500 con 0x7f17c415b370 2023-12-22T08:48:01.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.267+0000 7f17ca423640 1 --2- 172.21.15.38:0/3306567126 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f17a806a430 0x7f17a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:01.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.268+0000 7f17ca423640 1 --2- 172.21.15.38:0/3306567126 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f17a806a430 0x7f17a806c8f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f17c415c990 tx=0x7f17c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:01.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.271+0000 7f17baffd640 1 -- 172.21.15.38:0/3306567126 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f17bc076b90 con 0x7f17c415b370 2023-12-22T08:48:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:01.469+0000 7f17cb425640 1 -- 172.21.15.38:0/3306567126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f17c406f4c0 con 0x7f17c415b370 2023-12-22T08:48:02.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:02.436+0000 7f17baffd640 1 -- 172.21.15.38:0/3306567126 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v143) v1 ==== 181+0+0 (secure 0 0 0) 0x7f17bc07a1b0 con 0x7f17c415b370 2023-12-22T08:48:02.438 INFO:teuthology.orchestra.run.smithi038.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-22T08:48:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:02.439+0000 7f17cb425640 1 -- 172.21.15.38:0/3306567126 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f17a806a430 msgr2=0x7f17a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:02.439+0000 7f17cb425640 1 --2- 172.21.15.38:0/3306567126 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f17a806a430 0x7f17a806c8f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f17c415c990 tx=0x7f17c0008040 comp rx=0 tx=0).stop 2023-12-22T08:48:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:02.440+0000 7f17cb425640 1 -- 172.21.15.38:0/3306567126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17c415b370 msgr2=0x7f17c414aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:02.440+0000 7f17cb425640 1 --2- 172.21.15.38:0/3306567126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17c415b370 0x7f17c414aec0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f17bc036040 tx=0x7f17bc004a40 comp rx=0 tx=0).stop 2023-12-22T08:48:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:02.440+0000 7f17cb425640 1 -- 172.21.15.38:0/3306567126 shutdown_connections 2023-12-22T08:48:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:02.440+0000 7f17cb425640 1 --2- 172.21.15.38:0/3306567126 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f17a806a430 0x7f17a806c8f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:02.440+0000 7f17cb425640 1 --2- 172.21.15.38:0/3306567126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17c415b370 0x7f17c414aec0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:02.440+0000 7f17cb425640 1 --2- 172.21.15.38:0/3306567126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c40adfb0 0x7f17c40ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:02.440+0000 7f17cb425640 1 --2- 172.21.15.38:0/3306567126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c406fcf0 0x7f17c40ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:02.440+0000 7f17cb425640 1 -- 172.21.15.38:0/3306567126 >> 172.21.15.38:0/3306567126 conn(0x7f17c40b1110 msgr2=0x7f17c414f670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:02.440+0000 7f17cb425640 1 -- 172.21.15.38:0/3306567126 shutdown_connections 2023-12-22T08:48:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:02.440+0000 7f17cb425640 1 -- 172.21.15.38:0/3306567126 wait complete. 2023-12-22T08:48:02.461 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-22T08:48:02.699 INFO:teuthology.orchestra.run.smithi038.stdout:{"osd_mon_report_interval":"5"} 2023-12-22T08:48:02.700 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-22T08:48:02.700 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-12-22T08:48:02.700 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:48:02.700 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:02.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:02.755 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-12-22T08:48:02.989 INFO:teuthology.orchestra.run.smithi038.stderr:16+0 records in 2023-12-22T08:48:02.990 INFO:teuthology.orchestra.run.smithi038.stderr:16+0 records out 2023-12-22T08:48:02.990 INFO:teuthology.orchestra.run.smithi038.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.169631 s, 98.9 MB/s 2023-12-22T08:48:02.991 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:48:02.991 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:03.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:03.039 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-12-22T08:48:03.327 INFO:teuthology.orchestra.run.smithi038.stderr:17+0 records in 2023-12-22T08:48:03.328 INFO:teuthology.orchestra.run.smithi038.stderr:17+0 records out 2023-12-22T08:48:03.328 INFO:teuthology.orchestra.run.smithi038.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.183194 s, 97.3 MB/s 2023-12-22T08:48:03.329 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-22T08:48:03.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:48:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.539+0000 7f2598f77640 1 Processor -- start 2023-12-22T08:48:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.540+0000 7f2598f77640 1 -- start start 2023-12-22T08:48:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.541+0000 7f2598f77640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f259415e740 0x7f259415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.541+0000 7f2598f77640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25940b3f90 0x7f2594070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.541+0000 7f2598f77640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259415eb20 con 0x7f259406ca50 2023-12-22T08:48:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.541+0000 7f2598f77640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259406e650 con 0x7f259415e740 2023-12-22T08:48:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.541+0000 7f2598f77640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2594070770 con 0x7f25940b3f90 2023-12-22T08:48:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.542+0000 7f259259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f259415e740 0x7f259415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.542+0000 7f259259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f259415e740 0x7f259415db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55508/0 (socket says 172.21.15.38:55508) 2023-12-22T08:48:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.542+0000 7f259259c640 1 -- 172.21.15.38:0/1602504902 learned_addr learned my addr 172.21.15.38:0/1602504902 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.542+0000 7f259259c640 1 -- 172.21.15.38:0/1602504902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25940b3f90 msgr2=0x7f2594070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.542+0000 7f259259c640 1 --2- 172.21.15.38:0/1602504902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25940b3f90 0x7f2594070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.542+0000 7f259259c640 1 -- 172.21.15.38:0/1602504902 >> v1:172.21.15.38:6789/0 conn(0x7f259406ca50 legacy=0x7f25940b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.542+0000 7f259259c640 1 -- 172.21.15.38:0/1602504902 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259406cec0 con 0x7f259415e740 2023-12-22T08:48:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.543+0000 7f259259c640 1 --2- 172.21.15.38:0/1602504902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f259415e740 0x7f259415db30 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f2584009870 tx=0x7f258402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22500c406168f0fe server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:03.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.544+0000 7f259159a640 1 -- 172.21.15.38:0/1602504902 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25840317c0 con 0x7f259415e740 2023-12-22T08:48:03.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.544+0000 7f259159a640 1 -- 172.21.15.38:0/1602504902 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2584031920 con 0x7f259415e740 2023-12-22T08:48:03.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.544+0000 7f259159a640 1 -- 172.21.15.38:0/1602504902 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584031cb0 con 0x7f259415e740 2023-12-22T08:48:03.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.544+0000 7f2598f77640 1 -- 172.21.15.38:0/1602504902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f259415e740 msgr2=0x7f259415db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:03.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.544+0000 7f2598f77640 1 --2- 172.21.15.38:0/1602504902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f259415e740 0x7f259415db30 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f2584009870 tx=0x7f258402b860 comp rx=0 tx=0).stop 2023-12-22T08:48:03.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.544+0000 7f2598f77640 1 -- 172.21.15.38:0/1602504902 shutdown_connections 2023-12-22T08:48:03.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.544+0000 7f2598f77640 1 --2- 172.21.15.38:0/1602504902 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25940b3f90 0x7f2594070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:03.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.544+0000 7f2598f77640 1 --2- 172.21.15.38:0/1602504902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f259415e740 0x7f259415db30 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:03.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.544+0000 7f2598f77640 1 -- 172.21.15.38:0/1602504902 >> 172.21.15.38:0/1602504902 conn(0x7f25940cfea0 msgr2=0x7f25940d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:03.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.544+0000 7f2598f77640 1 -- 172.21.15.38:0/1602504902 shutdown_connections 2023-12-22T08:48:03.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.545+0000 7f2598f77640 1 -- 172.21.15.38:0/1602504902 wait complete. 2023-12-22T08:48:03.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.546+0000 7f2598f77640 1 Processor -- start 2023-12-22T08:48:03.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.546+0000 7f2598f77640 1 -- start start 2023-12-22T08:48:03.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.547+0000 7f2598f77640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f259406ca50 0x7f2594157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:03.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.547+0000 7f2598f77640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25940b3f90 0x7f25940b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:03.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f2598f77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f259415e740 0x7f259415c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:03.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f2598f77640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2594155490 con 0x7f259406ca50 2023-12-22T08:48:03.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f2598f77640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2594157a90 con 0x7f259415e740 2023-12-22T08:48:03.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f2598f77640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25940b6490 con 0x7f25940b3f90 2023-12-22T08:48:03.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f259259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f259406ca50 0x7f2594157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:03.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f259259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f259406ca50 0x7f2594157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55518/0 (socket says 172.21.15.38:55518) 2023-12-22T08:48:03.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f259259c640 1 -- 172.21.15.38:0/2660253202 learned_addr learned my addr 172.21.15.38:0/2660253202 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f2591d9b640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25940b3f90 0x7f25940b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f259259c640 1 -- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25940b3f90 msgr2=0x7f25940b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f259259c640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25940b3f90 0x7f25940b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f259259c640 1 -- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f259415e740 msgr2=0x7f259415c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f2592d9d640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f259415e740 0x7f259415c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f259259c640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f259415e740 0x7f259415c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f259259c640 1 -- 172.21.15.38:0/2660253202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25840094d0 con 0x7f259406ca50 2023-12-22T08:48:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.548+0000 7f2591d9b640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25940b3f90 0x7f25940b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.549+0000 7f259259c640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f259406ca50 0x7f2594157550 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f2584000c00 tx=0x7f25840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.549+0000 7f258affd640 1 -- 172.21.15.38:0/2660253202 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584032960 con 0x7f259406ca50 2023-12-22T08:48:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.549+0000 7f258affd640 1 -- 172.21.15.38:0/2660253202 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2584032ae0 con 0x7f259406ca50 2023-12-22T08:48:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.549+0000 7f2598f77640 1 -- 172.21.15.38:0/2660253202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2594154dd0 con 0x7f259406ca50 2023-12-22T08:48:03.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.549+0000 7f258affd640 1 -- 172.21.15.38:0/2660253202 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584032e90 con 0x7f259406ca50 2023-12-22T08:48:03.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.549+0000 7f2598f77640 1 -- 172.21.15.38:0/2660253202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259415d580 con 0x7f259406ca50 2023-12-22T08:48:03.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.550+0000 7f2598f77640 1 -- 172.21.15.38:0/2660253202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2594061910 con 0x7f259406ca50 2023-12-22T08:48:03.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.551+0000 7f258affd640 1 -- 172.21.15.38:0/2660253202 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f258404d3f0 con 0x7f259406ca50 2023-12-22T08:48:03.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.552+0000 7f258affd640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f257406a430 0x7f257406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:03.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.552+0000 7f258affd640 1 -- 172.21.15.38:0/2660253202 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25840aa980 con 0x7f259406ca50 2023-12-22T08:48:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.553+0000 7f2591d9b640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f257406a430 0x7f257406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:03.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.554+0000 7f2591d9b640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f257406a430 0x7f257406c8f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2594154610 tx=0x7f257c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:03.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.557+0000 7f258affd640 1 -- 172.21.15.38:0/2660253202 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2584075f60 con 0x7f259406ca50 2023-12-22T08:48:03.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.755+0000 7f2598f77640 1 -- 172.21.15.38:0/2660253202 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2594071d40 con 0x7f259406ca50 2023-12-22T08:48:03.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.758+0000 7f258affd640 1 -- 172.21.15.38:0/2660253202 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v143) v1 ==== 81+0+33510 (secure 0 0 0) 0x7f2584079580 con 0x7f259406ca50 2023-12-22T08:48:03.759 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:03.760 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:48:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 143, 2023-12-22T08:48:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:48:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:48:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:48:02.413211+0000", 2023-12-22T08:48:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:48:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:48:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:48:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:48:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:48:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:48:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:48:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 17, 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:48:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:48:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:48:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:48:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:48:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:48:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:48:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:48:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:48:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:48:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:48:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:48:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 16, 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:47:48.219096+0000", 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:48:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:48:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:48:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:48:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:48:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "141", 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:48:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 2.25, 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 2.25, 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2.25, 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2.25, 2023-12-22T08:48:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 17, 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:47:49.341846+0000", 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "143", 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 33554432, 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:48:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:48:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:48:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:48:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:48:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:48:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:48:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:48:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:48:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:48:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:48:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:48:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:03.793 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.793 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.793 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.793 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:48:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:48:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:48:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:48:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:48:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:48:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:48:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:48:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:48:03.831 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:48:03.831 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:48:03.831 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:48:03.831 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:48:03.831 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:48:03.831 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:03.831 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:48:03.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.760+0000 7f2598f77640 1 -- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f257406a430 msgr2=0x7f257406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:03.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.760+0000 7f2598f77640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f257406a430 0x7f257406c8f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2594154610 tx=0x7f257c009040 comp rx=0 tx=0).stop 2023-12-22T08:48:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.760+0000 7f2598f77640 1 -- 172.21.15.38:0/2660253202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f259406ca50 msgr2=0x7f2594157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.761+0000 7f2598f77640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f259406ca50 0x7f2594157550 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f2584000c00 tx=0x7f25840046c0 comp rx=0 tx=0).stop 2023-12-22T08:48:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.761+0000 7f2598f77640 1 -- 172.21.15.38:0/2660253202 shutdown_connections 2023-12-22T08:48:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.761+0000 7f2598f77640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f259415e740 0x7f259415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.761+0000 7f2598f77640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25940b3f90 0x7f25940b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.761+0000 7f2598f77640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f257406a430 0x7f257406c8f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.761+0000 7f2598f77640 1 --2- 172.21.15.38:0/2660253202 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f259406ca50 0x7f2594157550 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.761+0000 7f2598f77640 1 -- 172.21.15.38:0/2660253202 >> 172.21.15.38:0/2660253202 conn(0x7f25940cfea0 msgr2=0x7f25941617b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.761+0000 7f2598f77640 1 -- 172.21.15.38:0/2660253202 shutdown_connections 2023-12-22T08:48:03.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:03.761+0000 7f2598f77640 1 -- 172.21.15.38:0/2660253202 wait complete. 2023-12-22T08:48:03.834 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-22T08:48:08.834 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:48:09.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.072+0000 7fe855e95640 1 Processor -- start 2023-12-22T08:48:09.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.072+0000 7fe855e95640 1 -- start start 2023-12-22T08:48:09.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.074+0000 7fe855e95640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe8500a44a0 0x7fe8500708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:09.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.074+0000 7fe855e95640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe850070e30 0x7fe85015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:09.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.074+0000 7fe855e95640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8500cdae0 con 0x7fe85015b420 2023-12-22T08:48:09.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.074+0000 7fe855e95640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe850071250 con 0x7fe8500a44a0 2023-12-22T08:48:09.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.074+0000 7fe855e95640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85015b800 con 0x7fe850070e30 2023-12-22T08:48:09.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.075+0000 7fe855694640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe850070e30 0x7fe85015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:09.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.075+0000 7fe854e93640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe85015b420 0x7fe85006d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:41984/0 (socket says 172.21.15.38:41984) 2023-12-22T08:48:09.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.075+0000 7fe855694640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe850070e30 0x7fe85015baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:41904/0 (socket says 172.21.15.38:41904) 2023-12-22T08:48:09.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.075+0000 7fe854e93640 1 -- 172.21.15.38:0/145837330 learned_addr learned my addr 172.21.15.38:0/145837330 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:09.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.075+0000 7fe84ffff640 1 --2- 172.21.15.38:0/145837330 >> v2:172.21.15.89:3300/0 conn(0x7fe8500a44a0 0x7fe8500708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:09.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.076+0000 7fe855694640 1 -- 172.21.15.38:0/145837330 >> v2:172.21.15.89:3300/0 conn(0x7fe8500a44a0 msgr2=0x7fe8500708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:09.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.076+0000 7fe855694640 1 --2- 172.21.15.38:0/145837330 >> v2:172.21.15.89:3300/0 conn(0x7fe8500a44a0 0x7fe8500708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:09.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.076+0000 7fe855694640 1 -- 172.21.15.38:0/145837330 >> v1:172.21.15.89:6789/0 conn(0x7fe85015b420 legacy=0x7fe85006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:09.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.076+0000 7fe855694640 1 -- 172.21.15.38:0/145837330 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500cdd30 con 0x7fe850070e30 2023-12-22T08:48:09.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.077+0000 7fe855694640 1 --2- 172.21.15.38:0/145837330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe850070e30 0x7fe85015baa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe848009d90 tx=0x7fe84802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be4a1ac06d1f0d86 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:09.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.077+0000 7fe84f7fe640 1 -- 172.21.15.38:0/145837330 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84802cc50 con 0x7fe850070e30 2023-12-22T08:48:09.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.078+0000 7fe84f7fe640 1 -- 172.21.15.38:0/145837330 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84802cdb0 con 0x7fe850070e30 2023-12-22T08:48:09.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.078+0000 7fe84f7fe640 1 -- 172.21.15.38:0/145837330 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848034660 con 0x7fe850070e30 2023-12-22T08:48:09.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.078+0000 7fe855e95640 1 -- 172.21.15.38:0/145837330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe850070e30 msgr2=0x7fe85015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:09.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.078+0000 7fe855e95640 1 --2- 172.21.15.38:0/145837330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe850070e30 0x7fe85015baa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe848009d90 tx=0x7fe84802bea0 comp rx=0 tx=0).stop 2023-12-22T08:48:09.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.079+0000 7fe855e95640 1 -- 172.21.15.38:0/145837330 shutdown_connections 2023-12-22T08:48:09.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.079+0000 7fe855e95640 1 --2- 172.21.15.38:0/145837330 >> v2:172.21.15.89:3300/0 conn(0x7fe8500a44a0 0x7fe8500708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:09.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.079+0000 7fe855e95640 1 --2- 172.21.15.38:0/145837330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe850070e30 0x7fe85015baa0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:09.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.079+0000 7fe855e95640 1 -- 172.21.15.38:0/145837330 >> 172.21.15.38:0/145837330 conn(0x7fe8500b1f70 msgr2=0x7fe8500b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:09.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.079+0000 7fe855e95640 1 -- 172.21.15.38:0/145837330 shutdown_connections 2023-12-22T08:48:09.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.079+0000 7fe855e95640 1 -- 172.21.15.38:0/145837330 wait complete. 2023-12-22T08:48:09.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.081+0000 7fe855e95640 1 Processor -- start 2023-12-22T08:48:09.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.081+0000 7fe855e95640 1 -- start start 2023-12-22T08:48:09.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.082+0000 7fe855e95640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe850070e30 0x7fe8501533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:09.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.082+0000 7fe855e95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8500a44a0 0x7fe8501f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:09.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.082+0000 7fe855e95640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85015b420 0x7fe850152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:09.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.082+0000 7fe855e95640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8501f6ef0 con 0x7fe85015b420 2023-12-22T08:48:09.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.082+0000 7fe855e95640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8501546f0 con 0x7fe8500a44a0 2023-12-22T08:48:09.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.082+0000 7fe855e95640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe850152960 con 0x7fe850070e30 2023-12-22T08:48:09.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.083+0000 7fe855694640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85015b420 0x7fe850152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:09.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.083+0000 7fe855694640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85015b420 0x7fe850152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55532/0 (socket says 172.21.15.38:55532) 2023-12-22T08:48:09.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.083+0000 7fe855694640 1 -- 172.21.15.38:0/2076848761 learned_addr learned my addr 172.21.15.38:0/2076848761 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.083+0000 7fe854e93640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe850070e30 0x7fe8501533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.083+0000 7fe84ffff640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8500a44a0 0x7fe8501f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.083+0000 7fe855694640 1 -- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe850070e30 msgr2=0x7fe8501533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.083+0000 7fe855694640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe850070e30 0x7fe8501533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.083+0000 7fe855694640 1 -- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8500a44a0 msgr2=0x7fe8501f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.083+0000 7fe855694640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8500a44a0 0x7fe8501f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.083+0000 7fe855694640 1 -- 172.21.15.38:0/2076848761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848009a70 con 0x7fe85015b420 2023-12-22T08:48:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.084+0000 7fe855694640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85015b420 0x7fe850152420 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fe848009eb0 tx=0x7fe848004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.084+0000 7fe84d7fa640 1 -- 172.21.15.38:0/2076848761 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848040650 con 0x7fe85015b420 2023-12-22T08:48:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.084+0000 7fe84d7fa640 1 -- 172.21.15.38:0/2076848761 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8480407b0 con 0x7fe85015b420 2023-12-22T08:48:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.084+0000 7fe855e95640 1 -- 172.21.15.38:0/2076848761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe850153ae0 con 0x7fe85015b420 2023-12-22T08:48:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.084+0000 7fe84d7fa640 1 -- 172.21.15.38:0/2076848761 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848040b60 con 0x7fe85015b420 2023-12-22T08:48:09.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.084+0000 7fe855e95640 1 -- 172.21.15.38:0/2076848761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8501540a0 con 0x7fe85015b420 2023-12-22T08:48:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.085+0000 7fe855e95640 1 -- 172.21.15.38:0/2076848761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8501548a0 con 0x7fe85015b420 2023-12-22T08:48:09.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.086+0000 7fe84d7fa640 1 -- 172.21.15.38:0/2076848761 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe848040cc0 con 0x7fe85015b420 2023-12-22T08:48:09.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.087+0000 7fe84d7fa640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe83406a430 0x7fe83406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:09.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.087+0000 7fe84d7fa640 1 -- 172.21.15.38:0/2076848761 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8480ab6b0 con 0x7fe85015b420 2023-12-22T08:48:09.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.087+0000 7fe84d7fa640 1 -- 172.21.15.38:0/2076848761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=145}) v3 -- 0x7fe834071f60 con 0x7fe85015b420 2023-12-22T08:48:09.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.088+0000 7fe854e93640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe83406a430 0x7fe83406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:09.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.089+0000 7fe854e93640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe83406a430 0x7fe83406c8f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe844005880 tx=0x7fe844009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:09.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.092+0000 7fe84d7fa640 1 -- 172.21.15.38:0/2076848761 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe8501548a0 con 0x7fe85015b420 2023-12-22T08:48:09.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.285+0000 7fe855e95640 1 -- 172.21.15.38:0/2076848761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe8501548a0 con 0x7fe85015b420 2023-12-22T08:48:09.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.287+0000 7fe84d7fa640 1 -- 172.21.15.38:0/2076848761 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v144) v1 ==== 81+0+33529 (secure 0 0 0) 0x7fe8501548a0 con 0x7fe85015b420 2023-12-22T08:48:09.289 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:09.289 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:48:09.289 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 144, 2023-12-22T08:48:09.289 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:48:09.289 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:48:09.289 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:48:06.274562+0000", 2023-12-22T08:48:09.289 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:48:09.290 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 17, 2023-12-22T08:48:09.291 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:48:09.291 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:48:09.291 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:48:09.291 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:48:09.291 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:48:09.291 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:48:09.291 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.291 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:48:09.291 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:48:09.291 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:48:09.291 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:09.291 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:09.291 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:48:09.292 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:48:09.293 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:09.293 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:09.293 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:09.293 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:09.293 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:09.293 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:09.293 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:09.293 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.293 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:48:09.293 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:09.293 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:09.293 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:09.293 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:09.294 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:09.295 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:48:09.296 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:48:09.297 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:48:09.297 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:48:09.297 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:48:09.297 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:09.297 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:09.297 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:09.297 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.297 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.297 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.297 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 16, 2023-12-22T08:48:09.297 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:48:09.297 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:47:48.219096+0000", 2023-12-22T08:48:09.297 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:48:09.298 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "141", 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:09.299 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:09.300 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:09.301 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:09.301 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:09.301 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:09.301 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:09.301 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:09.301 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:09.301 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:09.301 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.301 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:09.301 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:09.301 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:09.301 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:09.301 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:48:09.302 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 2.25, 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 2.25, 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2.25, 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2.25, 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 17, 2023-12-22T08:48:09.303 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:47:49.341846+0000", 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1027, 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:48:09.304 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:48:09.305 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:48:09.305 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:48:09.305 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:09.305 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:09.305 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:09.305 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:09.305 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:09.305 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:09.305 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:09.305 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.305 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "144", 2023-12-22T08:48:09.305 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:09.305 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 33554432, 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:09.306 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:09.307 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:48:09.308 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:09.309 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:09.310 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.311 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:09.312 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:09.313 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:48:09.314 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:09.315 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.316 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.318 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.319 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:09.319 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.319 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.319 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.319 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:48:09.319 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:09.319 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.319 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.319 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.319 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:48:09.319 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:09.319 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:09.320 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:48:09.321 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:48:09.322 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:48:09.323 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:09.324 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.325 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.325 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.325 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:48:09.325 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:09.325 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.325 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.325 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.325 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:48:09.325 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:48:09.325 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:48:09.325 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:48:09.325 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:09.325 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:09.326 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:09.326 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.326 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.326 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.326 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:48:09.326 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:09.326 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:09.326 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:09.326 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:09.326 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:09.326 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:09.326 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:09.326 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:48:09.327 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:09.328 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.329 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.329 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.329 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:09.329 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.329 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.329 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.329 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:48:09.329 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:09.329 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.329 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.329 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.329 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:48:09.329 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:09.330 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:48:09.331 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:09.332 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:09.332 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:09.332 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:09.332 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:09.332 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:09.332 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:09.332 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:09.332 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:09.332 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:09.332 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:09.332 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:09.332 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.332 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.333 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.334 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.335 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:48:09.336 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:09.337 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:48:09.338 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:09.339 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:09.342 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.343 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.344 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.345 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.346 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.347 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.347 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:48:09.347 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:09.347 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.347 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.347 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.347 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:48:09.347 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:48:09.347 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:48:09.347 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:48:09.347 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:09.347 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:09.348 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.349 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.350 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.351 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:48:09.352 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:09.353 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:09.354 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:09.355 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:09.356 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:09.357 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:09.358 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:48:09.359 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:09.359 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.359 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:09.359 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:48:09.359 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:48:09.359 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:48:09.359 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:48:09.359 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:48:09.359 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:48:09.359 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:48:09.359 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:48:09.360 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:48:09.361 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:48:09.361 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:48:09.361 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:48:09.361 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:48:09.361 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:48:09.361 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:09.361 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:48:09.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.290+0000 7fe855e95640 1 -- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe83406a430 msgr2=0x7fe83406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:09.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.290+0000 7fe855e95640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe83406a430 0x7fe83406c8f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe844005880 tx=0x7fe844009040 comp rx=0 tx=0).stop 2023-12-22T08:48:09.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.290+0000 7fe855e95640 1 -- 172.21.15.38:0/2076848761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85015b420 msgr2=0x7fe850152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:09.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.290+0000 7fe855e95640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85015b420 0x7fe850152420 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fe848009eb0 tx=0x7fe848004a40 comp rx=0 tx=0).stop 2023-12-22T08:48:09.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.290+0000 7fe855e95640 1 -- 172.21.15.38:0/2076848761 shutdown_connections 2023-12-22T08:48:09.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.290+0000 7fe855e95640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe83406a430 0x7fe83406c8f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:09.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.290+0000 7fe855e95640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe85015b420 0x7fe850152420 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:09.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.290+0000 7fe855e95640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8500a44a0 0x7fe8501f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:09.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.290+0000 7fe855e95640 1 --2- 172.21.15.38:0/2076848761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe850070e30 0x7fe8501533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:09.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.290+0000 7fe855e95640 1 -- 172.21.15.38:0/2076848761 >> 172.21.15.38:0/2076848761 conn(0x7fe8500b1f70 msgr2=0x7fe8500cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:09.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.290+0000 7fe855e95640 1 -- 172.21.15.38:0/2076848761 shutdown_connections 2023-12-22T08:48:09.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:09.290+0000 7fe855e95640 1 -- 172.21.15.38:0/2076848761 wait complete. 2023-12-22T08:48:09.364 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-22T08:48:09.364 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:48:09.364 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:09.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:09.427 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-12-22T08:48:09.880 INFO:teuthology.orchestra.run.smithi038.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-12-22T08:48:09.881 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records in 2023-12-22T08:48:09.881 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records out 2023-12-22T08:48:09.881 INFO:teuthology.orchestra.run.smithi038.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.388714 s, 135 MB/s 2023-12-22T08:48:09.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:48:09.882 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:48:10.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.096+0000 7f644aba9640 1 Processor -- start 2023-12-22T08:48:10.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.096+0000 7f644aba9640 1 -- start start 2023-12-22T08:48:10.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.098+0000 7f644aba9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f64440a44a0 0x7f64440708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:10.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.098+0000 7f644aba9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6444070e30 0x7f644415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:10.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.098+0000 7f644aba9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64440cdae0 con 0x7f644415b420 2023-12-22T08:48:10.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.098+0000 7f644aba9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6444071250 con 0x7f64440a44a0 2023-12-22T08:48:10.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.098+0000 7f644aba9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644415b800 con 0x7f6444070e30 2023-12-22T08:48:10.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.098+0000 7f64493a6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f64440a44a0 0x7f64440708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:10.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.098+0000 7f64493a6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f64440a44a0 0x7f64440708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55534/0 (socket says 172.21.15.38:55534) 2023-12-22T08:48:10.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.098+0000 7f6449ba7640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f644415b420 0x7f644406d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44662/0 (socket says 172.21.15.38:44662) 2023-12-22T08:48:10.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.098+0000 7f64493a6640 1 -- 172.21.15.38:0/349458580 learned_addr learned my addr 172.21.15.38:0/349458580 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:10.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.099+0000 7f644a3a8640 1 --2- 172.21.15.38:0/349458580 >> v2:172.21.15.89:3300/0 conn(0x7f6444070e30 0x7f644415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:10.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.099+0000 7f64493a6640 1 -- 172.21.15.38:0/349458580 >> v2:172.21.15.89:3300/0 conn(0x7f6444070e30 msgr2=0x7f644415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:10.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.099+0000 7f64493a6640 1 --2- 172.21.15.38:0/349458580 >> v2:172.21.15.89:3300/0 conn(0x7f6444070e30 0x7f644415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.099+0000 7f64493a6640 1 -- 172.21.15.38:0/349458580 >> v1:172.21.15.38:6789/0 conn(0x7f644415b420 legacy=0x7f644406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:10.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.099+0000 7f64493a6640 1 -- 172.21.15.38:0/349458580 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64440cdd30 con 0x7f64440a44a0 2023-12-22T08:48:10.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.099+0000 7f644a3a8640 1 --2- 172.21.15.38:0/349458580 >> v2:172.21.15.89:3300/0 conn(0x7f6444070e30 0x7f644415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:10.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.100+0000 7f64493a6640 1 --2- 172.21.15.38:0/349458580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64440a44a0 0x7f64440708f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f6444070670 tx=0x7f643402b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf020da9c398c242 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:10.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.100+0000 7f6448ba5640 1 -- 172.21.15.38:0/349458580 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434030870 con 0x7f64440a44a0 2023-12-22T08:48:10.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.100+0000 7f6448ba5640 1 -- 172.21.15.38:0/349458580 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64340309d0 con 0x7f64440a44a0 2023-12-22T08:48:10.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.100+0000 7f6448ba5640 1 -- 172.21.15.38:0/349458580 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434030d60 con 0x7f64440a44a0 2023-12-22T08:48:10.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.101+0000 7f644aba9640 1 -- 172.21.15.38:0/349458580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64440a44a0 msgr2=0x7f64440708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:10.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.101+0000 7f644aba9640 1 --2- 172.21.15.38:0/349458580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64440a44a0 0x7f64440708f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f6444070670 tx=0x7f643402b9b0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.101+0000 7f644aba9640 1 -- 172.21.15.38:0/349458580 shutdown_connections 2023-12-22T08:48:10.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.101+0000 7f644aba9640 1 --2- 172.21.15.38:0/349458580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64440a44a0 0x7f64440708f0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.101+0000 7f644aba9640 1 --2- 172.21.15.38:0/349458580 >> v2:172.21.15.89:3300/0 conn(0x7f6444070e30 0x7f644415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.101+0000 7f644aba9640 1 -- 172.21.15.38:0/349458580 >> 172.21.15.38:0/349458580 conn(0x7f64440b1f70 msgr2=0x7f64440b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:10.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.101+0000 7f644aba9640 1 -- 172.21.15.38:0/349458580 shutdown_connections 2023-12-22T08:48:10.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.101+0000 7f644aba9640 1 -- 172.21.15.38:0/349458580 wait complete. 2023-12-22T08:48:10.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.103+0000 7f644aba9640 1 Processor -- start 2023-12-22T08:48:10.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.103+0000 7f644aba9640 1 -- start start 2023-12-22T08:48:10.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.104+0000 7f644aba9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6444070e30 0x7f64440a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:10.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.104+0000 7f644aba9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64440a44a0 0x7f6444148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:10.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.104+0000 7f644aba9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f644415b420 0x7f64440a3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:10.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.104+0000 7f644aba9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64440a1c30 con 0x7f6444070e30 2023-12-22T08:48:10.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.104+0000 7f644aba9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64440a1f10 con 0x7f64440a44a0 2023-12-22T08:48:10.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.104+0000 7f644aba9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64440a21f0 con 0x7f644415b420 2023-12-22T08:48:10.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.104+0000 7f6449ba7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6444070e30 0x7f64440a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:10.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.104+0000 7f6449ba7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6444070e30 0x7f64440a1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55548/0 (socket says 172.21.15.38:55548) 2023-12-22T08:48:10.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.104+0000 7f6449ba7640 1 -- 172.21.15.38:0/359444290 learned_addr learned my addr 172.21.15.38:0/359444290 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:10.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.105+0000 7f64493a6640 1 --2- 172.21.15.38:0/359444290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64440a44a0 0x7f6444148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:10.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.105+0000 7f6449ba7640 1 -- 172.21.15.38:0/359444290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f644415b420 msgr2=0x7f64440a3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:10.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.105+0000 7f6449ba7640 1 --2- 172.21.15.38:0/359444290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f644415b420 0x7f64440a3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.105+0000 7f6449ba7640 1 -- 172.21.15.38:0/359444290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64440a44a0 msgr2=0x7f6444148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:10.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.105+0000 7f6449ba7640 1 --2- 172.21.15.38:0/359444290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64440a44a0 0x7f6444148fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.105+0000 7f6449ba7640 1 -- 172.21.15.38:0/359444290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64340094d0 con 0x7f6444070e30 2023-12-22T08:48:10.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.105+0000 7f6449ba7640 1 --2- 172.21.15.38:0/359444290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6444070e30 0x7f64440a1400 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f644000c4d0 tx=0x7f644000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:10.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.105+0000 7f643a7fc640 1 -- 172.21.15.38:0/359444290 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440007480 con 0x7f6444070e30 2023-12-22T08:48:10.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.105+0000 7f643a7fc640 1 -- 172.21.15.38:0/359444290 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64400075e0 con 0x7f6444070e30 2023-12-22T08:48:10.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.105+0000 7f643a7fc640 1 -- 172.21.15.38:0/359444290 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64400049e0 con 0x7f6444070e30 2023-12-22T08:48:10.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.105+0000 7f644aba9640 1 -- 172.21.15.38:0/359444290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64440a24d0 con 0x7f6444070e30 2023-12-22T08:48:10.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.106+0000 7f644aba9640 1 -- 172.21.15.38:0/359444290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64440a27b0 con 0x7f6444070e30 2023-12-22T08:48:10.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.107+0000 7f644aba9640 1 -- 172.21.15.38:0/359444290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6444061910 con 0x7f6444070e30 2023-12-22T08:48:10.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.108+0000 7f643a7fc640 1 -- 172.21.15.38:0/359444290 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6440004b40 con 0x7f6444070e30 2023-12-22T08:48:10.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.109+0000 7f643a7fc640 1 --2- 172.21.15.38:0/359444290 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f642806a430 0x7f642806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:10.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.109+0000 7f643a7fc640 1 -- 172.21.15.38:0/359444290 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6440087af0 con 0x7f6444070e30 2023-12-22T08:48:10.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.109+0000 7f643a7fc640 1 -- 172.21.15.38:0/359444290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=145}) v3 -- 0x7f6428071f60 con 0x7f6444070e30 2023-12-22T08:48:10.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.109+0000 7f64493a6640 1 --2- 172.21.15.38:0/359444290 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f642806a430 0x7f642806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:10.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.111+0000 7f64493a6640 1 --2- 172.21.15.38:0/359444290 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f642806a430 0x7f642806c8f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6434036000 tx=0x7f643403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:10.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.113+0000 7f643a7fc640 1 -- 172.21.15.38:0/359444290 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6440018070 con 0x7f6444070e30 2023-12-22T08:48:10.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.309+0000 7f644aba9640 1 -- 172.21.15.38:0/359444290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f64440cb5c0 con 0x7f6444070e30 2023-12-22T08:48:10.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.312+0000 7f643a7fc640 1 -- 172.21.15.38:0/359444290 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v144) v1 ==== 81+0+33529 (secure 0 0 0) 0x7f6440053060 con 0x7f6444070e30 2023-12-22T08:48:10.314 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:10.314 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:48:10.314 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 144, 2023-12-22T08:48:10.314 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:48:06.274562+0000", 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:48:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:48:10.316 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:48:10.316 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:48:10.316 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:48:10.316 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 17, 2023-12-22T08:48:10.316 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:48:10.316 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:48:10.316 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:48:10.316 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:48:10.316 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:48:10.316 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:48:10.316 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.316 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:10.317 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:10.318 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:48:10.318 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:48:10.318 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:48:10.318 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:48:10.318 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:48:10.318 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:10.318 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:10.318 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:10.318 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:10.318 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:10.318 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:10.318 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:10.318 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:10.319 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:10.320 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:10.321 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.321 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:10.321 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:10.321 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:10.321 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:10.321 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:10.321 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:10.321 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:10.321 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:10.321 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:10.321 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:10.321 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:10.321 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:10.322 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 16, 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:47:48.219096+0000", 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:10.323 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:10.324 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:10.324 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:10.324 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:48:10.324 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:48:10.324 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:48:10.324 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:48:10.324 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:48:10.324 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:10.324 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:10.324 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:10.324 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:10.324 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:10.324 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "141", 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:48:10.325 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:10.326 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:48:10.327 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 2.25, 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 2.25, 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2.25, 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2.25, 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:10.328 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 17, 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:47:49.341846+0000", 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1027, 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:10.329 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:10.330 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "144", 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 33554432, 2023-12-22T08:48:10.331 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:10.332 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:10.333 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.333 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:10.333 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:10.333 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:10.333 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:10.333 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:10.333 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:10.333 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:10.333 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:10.333 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:10.333 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:10.333 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:48:10.334 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:10.335 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:48:10.336 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:48:10.337 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:10.338 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:10.339 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:10.340 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:48:10.341 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.342 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.343 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:10.345 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:10.346 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:10.346 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:10.346 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:10.346 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:10.346 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:10.346 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:10.346 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:10.346 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:10.346 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:10.346 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.346 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.347 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.348 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.349 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:48:10.349 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:10.349 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.349 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.349 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.349 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:48:10.349 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:10.349 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.349 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.349 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.349 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:10.349 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.349 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:48:10.350 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:10.351 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:48:10.352 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:10.353 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:10.354 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.355 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:10.356 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.357 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:48:10.358 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:48:10.359 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:48:10.360 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:10.361 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:10.362 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.363 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.364 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.365 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:48:10.366 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:10.367 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.368 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.369 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.370 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:48:10.371 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.372 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:48:10.373 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:10.373 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:10.373 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:10.373 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:10.373 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:10.373 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:10.373 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:10.373 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:10.373 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:10.373 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:10.373 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:10.373 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:10.373 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.375 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:48:10.376 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:10.377 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.378 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:10.379 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.380 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:10.381 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.382 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:48:10.383 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:48:10.384 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:48:10.385 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:48:10.385 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:48:10.385 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:48:10.385 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:48:10.385 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:10.385 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:48:10.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.315+0000 7f644aba9640 1 -- 172.21.15.38:0/359444290 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f642806a430 msgr2=0x7f642806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:10.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.315+0000 7f644aba9640 1 --2- 172.21.15.38:0/359444290 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f642806a430 0x7f642806c8f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6434036000 tx=0x7f643403b040 comp rx=0 tx=0).stop 2023-12-22T08:48:10.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.315+0000 7f644aba9640 1 -- 172.21.15.38:0/359444290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6444070e30 msgr2=0x7f64440a1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.315+0000 7f644aba9640 1 --2- 172.21.15.38:0/359444290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6444070e30 0x7f64440a1400 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f644000c4d0 tx=0x7f644000c990 comp rx=0 tx=0).stop 2023-12-22T08:48:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.315+0000 7f644aba9640 1 -- 172.21.15.38:0/359444290 shutdown_connections 2023-12-22T08:48:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.315+0000 7f644aba9640 1 --2- 172.21.15.38:0/359444290 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f644415b420 0x7f64440a3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.315+0000 7f644aba9640 1 --2- 172.21.15.38:0/359444290 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64440a44a0 0x7f6444148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.315+0000 7f644aba9640 1 --2- 172.21.15.38:0/359444290 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f642806a430 0x7f642806c8f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.315+0000 7f644aba9640 1 --2- 172.21.15.38:0/359444290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6444070e30 0x7f64440a1400 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.315+0000 7f644aba9640 1 -- 172.21.15.38:0/359444290 >> 172.21.15.38:0/359444290 conn(0x7f64440b1f70 msgr2=0x7f644415dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.315+0000 7f644aba9640 1 -- 172.21.15.38:0/359444290 shutdown_connections 2023-12-22T08:48:10.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.315+0000 7f644aba9640 1 -- 172.21.15.38:0/359444290 wait complete. 2023-12-22T08:48:10.388 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:48:10.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.619+0000 7f6d631c9640 1 Processor -- start 2023-12-22T08:48:10.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.619+0000 7f6d631c9640 1 -- start start 2023-12-22T08:48:10.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.621+0000 7f6d631c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6d5c144d10 0x7f6d5c0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:10.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.621+0000 7f6d631c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d5c0b2760 0x7f6d5c070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:10.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.621+0000 7f6d631c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5c1450f0 con 0x7f6d5c0cc670 2023-12-22T08:48:10.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.621+0000 7f6d631c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5c0ce010 con 0x7f6d5c144d10 2023-12-22T08:48:10.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.621+0000 7f6d631c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c0ce2f0 con 0x7f6d5c0b2760 2023-12-22T08:48:10.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.622+0000 7f6d61766640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d5c0b2760 0x7f6d5c070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:10.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.622+0000 7f6d61766640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d5c0b2760 0x7f6d5c070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:41932/0 (socket says 172.21.15.38:41932) 2023-12-22T08:48:10.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.622+0000 7f6d61766640 1 -- 172.21.15.38:0/4259920923 learned_addr learned my addr 172.21.15.38:0/4259920923 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:10.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.622+0000 7f6d60f65640 1 --2- 172.21.15.38:0/4259920923 >> v2:172.21.15.89:3300/0 conn(0x7f6d5c144d10 0x7f6d5c0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:10.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.622+0000 7f6d61766640 1 -- 172.21.15.38:0/4259920923 >> v2:172.21.15.89:3300/0 conn(0x7f6d5c144d10 msgr2=0x7f6d5c0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:10.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.622+0000 7f6d61766640 1 --2- 172.21.15.38:0/4259920923 >> v2:172.21.15.89:3300/0 conn(0x7f6d5c144d10 0x7f6d5c0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.623+0000 7f6d61766640 1 -- 172.21.15.38:0/4259920923 >> v1:172.21.15.89:6789/0 conn(0x7f6d5c0cc670 legacy=0x7f6d5c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:10.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.623+0000 7f6d61766640 1 -- 172.21.15.38:0/4259920923 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0ce5d0 con 0x7f6d5c0b2760 2023-12-22T08:48:10.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.624+0000 7f6d61766640 1 --2- 172.21.15.38:0/4259920923 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d5c0b2760 0x7f6d5c070800 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009e50 tx=0x7f6d5402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=245dcfc80472106a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:10.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.624+0000 7f6d5b7fe640 1 -- 172.21.15.38:0/4259920923 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5402cb00 con 0x7f6d5c0b2760 2023-12-22T08:48:10.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.624+0000 7f6d5b7fe640 1 -- 172.21.15.38:0/4259920923 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5402cc60 con 0x7f6d5c0b2760 2023-12-22T08:48:10.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.624+0000 7f6d5b7fe640 1 -- 172.21.15.38:0/4259920923 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d540343f0 con 0x7f6d5c0b2760 2023-12-22T08:48:10.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.625+0000 7f6d631c9640 1 -- 172.21.15.38:0/4259920923 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d5c0b2760 msgr2=0x7f6d5c070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:10.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.625+0000 7f6d631c9640 1 --2- 172.21.15.38:0/4259920923 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d5c0b2760 0x7f6d5c070800 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009e50 tx=0x7f6d5402bf60 comp rx=0 tx=0).stop 2023-12-22T08:48:10.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.625+0000 7f6d631c9640 1 -- 172.21.15.38:0/4259920923 shutdown_connections 2023-12-22T08:48:10.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.625+0000 7f6d631c9640 1 --2- 172.21.15.38:0/4259920923 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d5c0b2760 0x7f6d5c070800 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.625+0000 7f6d631c9640 1 --2- 172.21.15.38:0/4259920923 >> v2:172.21.15.89:3300/0 conn(0x7f6d5c144d10 0x7f6d5c0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.625+0000 7f6d631c9640 1 -- 172.21.15.38:0/4259920923 >> 172.21.15.38:0/4259920923 conn(0x7f6d5c0cf070 msgr2=0x7f6d5c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:10.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.625+0000 7f6d631c9640 1 -- 172.21.15.38:0/4259920923 shutdown_connections 2023-12-22T08:48:10.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.625+0000 7f6d631c9640 1 -- 172.21.15.38:0/4259920923 wait complete. 2023-12-22T08:48:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.627+0000 7f6d631c9640 1 Processor -- start 2023-12-22T08:48:10.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.627+0000 7f6d631c9640 1 -- start start 2023-12-22T08:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.628+0000 7f6d631c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d5c0b2760 0x7f6d5c157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.628+0000 7f6d631c9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c144d10 0x7f6d5c156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.628+0000 7f6d631c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d5c1f08f0 0x7f6d5c1f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.628+0000 7f6d631c9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c158450 con 0x7f6d5c144d10 2023-12-22T08:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.628+0000 7f6d631c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c159ec0 con 0x7f6d5c1f08f0 2023-12-22T08:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.628+0000 7f6d631c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c1f1420 con 0x7f6d5c0b2760 2023-12-22T08:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.628+0000 7f6d5bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c144d10 0x7f6d5c156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.628+0000 7f6d5bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c144d10 0x7f6d5c156080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55564/0 (socket says 172.21.15.38:55564) 2023-12-22T08:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.629+0000 7f6d5bfff640 1 -- 172.21.15.38:0/3181528089 learned_addr learned my addr 172.21.15.38:0/3181528089 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.629+0000 7f6d61766640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d5c1f08f0 0x7f6d5c1f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.629+0000 7f6d60f65640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d5c0b2760 0x7f6d5c157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.629+0000 7f6d5bfff640 1 -- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d5c0b2760 msgr2=0x7f6d5c157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:10.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.629+0000 7f6d5bfff640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d5c0b2760 0x7f6d5c157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.629+0000 7f6d5bfff640 1 -- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d5c1f08f0 msgr2=0x7f6d5c1f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.629+0000 7f6d5bfff640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d5c1f08f0 0x7f6d5c1f0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.629+0000 7f6d5bfff640 1 -- 172.21.15.38:0/3181528089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d54009b30 con 0x7f6d5c144d10 2023-12-22T08:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.629+0000 7f6d61766640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d5c1f08f0 0x7f6d5c1f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.629+0000 7f6d60f65640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d5c0b2760 0x7f6d5c157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.629+0000 7f6d5bfff640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c144d10 0x7f6d5c156080 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000c400 tx=0x7f6d5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.630+0000 7f6d597fa640 1 -- 172.21.15.38:0/3181528089 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500052d0 con 0x7f6d5c144d10 2023-12-22T08:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.630+0000 7f6d597fa640 1 -- 172.21.15.38:0/3181528089 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d50005430 con 0x7f6d5c144d10 2023-12-22T08:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.630+0000 7f6d631c9640 1 -- 172.21.15.38:0/3181528089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5c1f1700 con 0x7f6d5c144d10 2023-12-22T08:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.630+0000 7f6d597fa640 1 -- 172.21.15.38:0/3181528089 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50003830 con 0x7f6d5c144d10 2023-12-22T08:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.630+0000 7f6d631c9640 1 -- 172.21.15.38:0/3181528089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c159840 con 0x7f6d5c144d10 2023-12-22T08:48:10.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.631+0000 7f6d631c9640 1 -- 172.21.15.38:0/3181528089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5c1f18f0 con 0x7f6d5c144d10 2023-12-22T08:48:10.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.632+0000 7f6d597fa640 1 -- 172.21.15.38:0/3181528089 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6d50003990 con 0x7f6d5c144d10 2023-12-22T08:48:10.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.633+0000 7f6d597fa640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6d4806a460 0x7f6d4806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:10.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.634+0000 7f6d597fa640 1 -- 172.21.15.38:0/3181528089 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d50087fe0 con 0x7f6d5c144d10 2023-12-22T08:48:10.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.634+0000 7f6d597fa640 1 -- 172.21.15.38:0/3181528089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=145}) v3 -- 0x7f6d48071f90 con 0x7f6d5c144d10 2023-12-22T08:48:10.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.634+0000 7f6d60f65640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6d4806a460 0x7f6d4806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:10.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.635+0000 7f6d60f65640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6d4806a460 0x7f6d4806c920 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c006fd0 tx=0x7f6d4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:10.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.638+0000 7f6d597fa640 1 -- 172.21.15.38:0/3181528089 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6d5c1f18f0 con 0x7f6d5c144d10 2023-12-22T08:48:10.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.872+0000 7f6d631c9640 1 -- 172.21.15.38:0/3181528089 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d5c1f18f0 con 0x7f6d5c144d10 2023-12-22T08:48:10.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.873+0000 7f6d597fa640 1 -- 172.21.15.38:0/3181528089 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f6d5c1f18f0 con 0x7f6d5c144d10 2023-12-22T08:48:10.875 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:10.875 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3891984223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3891984223},{"type":"v1","addr":"172.21.15.38:6834","nonce":3891984223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1561904072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1561904072},{"type":"v1","addr":"172.21.15.89:6836","nonce":1561904072}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4192516230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4192516230},{"type":"v1","addr":"172.21.15.89:6837","nonce":4192516230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:50.322298+0000","modified":"2023-12-22T08:47:53.343300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7716},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7716":{"gid":7716,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1276125280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1276125280},{"type":"v1","addr":"172.21.15.38:6835","nonce":1276125280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-22T08:48:10.875 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 62 2023-12-22T08:48:10.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.876+0000 7f6d631c9640 1 -- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6d4806a460 msgr2=0x7f6d4806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:10.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.876+0000 7f6d631c9640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6d4806a460 0x7f6d4806c920 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c006fd0 tx=0x7f6d4c008040 comp rx=0 tx=0).stop 2023-12-22T08:48:10.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.876+0000 7f6d631c9640 1 -- 172.21.15.38:0/3181528089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c144d10 msgr2=0x7f6d5c156080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:10.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.876+0000 7f6d631c9640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c144d10 0x7f6d5c156080 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000c400 tx=0x7f6d5000c8c0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.877+0000 7f6d631c9640 1 -- 172.21.15.38:0/3181528089 shutdown_connections 2023-12-22T08:48:10.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.877+0000 7f6d631c9640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d5c1f08f0 0x7f6d5c1f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.877+0000 7f6d631c9640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6d4806a460 0x7f6d4806c920 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.877+0000 7f6d631c9640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d5c144d10 0x7f6d5c156080 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.877+0000 7f6d631c9640 1 --2- 172.21.15.38:0/3181528089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d5c0b2760 0x7f6d5c157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:10.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.877+0000 7f6d631c9640 1 -- 172.21.15.38:0/3181528089 >> 172.21.15.38:0/3181528089 conn(0x7f6d5c0cf070 msgr2=0x7f6d5c0aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:10.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.877+0000 7f6d631c9640 1 -- 172.21.15.38:0/3181528089 shutdown_connections 2023-12-22T08:48:10.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:10.877+0000 7f6d631c9640 1 -- 172.21.15.38:0/3181528089 wait complete. 2023-12-22T08:48:10.896 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-22T08:48:11.139 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":7716,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":20.795400421,"mdsmap_epoch":62,"osdmap_epoch":144,"osdmap_epoch_barrier":144,"uptime":26.608243038000001} 2023-12-22T08:48:11.140 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 7716, "mdsmap_epoch": 62, "osdmap_epoch": 144, "osdmap_epoch_barrier": 144, "rank_uptime": 20.795400421, "state": "up:active", "uptime": 26.608243038, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:48:11.140 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-22T08:48:11.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:11.140 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-22T08:48:11.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:11.198 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-22T08:48:11.259 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:48:11.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.479+0000 7fb5e4e1b640 1 Processor -- start 2023-12-22T08:48:11.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.479+0000 7fb5e4e1b640 1 -- start start 2023-12-22T08:48:11.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.480+0000 7fb5e4e1b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5e015b420 0x7fb5e006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:11.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.481+0000 7fb5e4e1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e00a44a0 0x7fb5e00708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:11.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.481+0000 7fb5e4e1b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e00cdae0 con 0x7fb5e0070e30 2023-12-22T08:48:11.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.481+0000 7fb5e4e1b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e0071260 con 0x7fb5e015b420 2023-12-22T08:48:11.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.481+0000 7fb5e4e1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e006dec0 con 0x7fb5e00a44a0 2023-12-22T08:48:11.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.481+0000 7fb5dffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb5e0070e30 0x7fb5e006f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51918/0 (socket says 172.21.15.38:51918) 2023-12-22T08:48:11.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.481+0000 7fb5dffff640 1 -- 172.21.15.38:0/3098208771 learned_addr learned my addr 172.21.15.38:0/3098208771 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:11.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.481+0000 7fb5df7fe640 1 --2- 172.21.15.38:0/3098208771 >> v2:172.21.15.89:3300/0 conn(0x7fb5e015b420 0x7fb5e006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:11.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.481+0000 7fb5d7fff640 1 --2- 172.21.15.38:0/3098208771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e00a44a0 0x7fb5e00708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:11.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280653921 0 0) 0x7fb5e00cdae0 con 0x7fb5e0070e30 2023-12-22T08:48:11.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5cc003520 con 0x7fb5e0070e30 2023-12-22T08:48:11.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1866909138 0 0) 0x7fb5cc003520 con 0x7fb5e0070e30 2023-12-22T08:48:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e00a44a0 msgr2=0x7fb5e00708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 --2- 172.21.15.38:0/3098208771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e00a44a0 0x7fb5e00708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 >> v2:172.21.15.89:3300/0 conn(0x7fb5e015b420 msgr2=0x7fb5e006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 --2- 172.21.15.38:0/3098208771 >> v2:172.21.15.89:3300/0 conn(0x7fb5e015b420 0x7fb5e006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e015b800 con 0x7fb5e0070e30 2023-12-22T08:48:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fb5d80019f0 con 0x7fb5e0070e30 2023-12-22T08:48:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5df7fe640 1 --2- 172.21.15.38:0/3098208771 >> v2:172.21.15.89:3300/0 conn(0x7fb5e015b420 0x7fb5e006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:48:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 >> v1:172.21.15.38:6789/0 conn(0x7fb5e0070e30 legacy=0x7fb5e006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 --2- 172.21.15.38:0/3098208771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5cc003970 0x7fb5cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 --2- 172.21.15.38:0/3098208771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5cc0047c0 0x7fb5cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 --2- 172.21.15.38:0/3098208771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e00a44a0 0x7fb5cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e0071260 con 0x7fb5cc003970 2023-12-22T08:48:11.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e006dec0 con 0x7fb5cc0047c0 2023-12-22T08:48:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc00b980 con 0x7fb5e00a44a0 2023-12-22T08:48:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.482+0000 7fb5df7fe640 1 --2- 172.21.15.38:0/3098208771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5cc003970 0x7fb5cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.483+0000 7fb5d7fff640 1 --2- 172.21.15.38:0/3098208771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5cc0047c0 0x7fb5cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.483+0000 7fb5dffff640 1 --2- 172.21.15.38:0/3098208771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e00a44a0 0x7fb5cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.483+0000 7fb5df7fe640 1 -- 172.21.15.38:0/3098208771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e00a44a0 msgr2=0x7fb5cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.483+0000 7fb5df7fe640 1 --2- 172.21.15.38:0/3098208771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e00a44a0 0x7fb5cc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.483+0000 7fb5df7fe640 1 -- 172.21.15.38:0/3098208771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5cc0047c0 msgr2=0x7fb5cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.483+0000 7fb5df7fe640 1 --2- 172.21.15.38:0/3098208771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5cc0047c0 0x7fb5cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.483+0000 7fb5df7fe640 1 -- 172.21.15.38:0/3098208771 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc003520 con 0x7fb5cc003970 2023-12-22T08:48:11.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.483+0000 7fb5dffff640 1 --2- 172.21.15.38:0/3098208771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e00a44a0 0x7fb5cc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.484+0000 7fb5df7fe640 1 --2- 172.21.15.38:0/3098208771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5cc003970 0x7fb5cc003d90 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009c90 tx=0x7fb5cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1f7ad89afa0316 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.484+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d002c980 con 0x7fb5cc003970 2023-12-22T08:48:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.484+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d002cae0 con 0x7fb5cc003970 2023-12-22T08:48:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.484+0000 7fb5deffd640 1 -- 172.21.15.38:0/3098208771 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d002ce90 con 0x7fb5cc003970 2023-12-22T08:48:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.485+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/3098208771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5cc003970 msgr2=0x7fb5cc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.485+0000 7fb5e4e1b640 1 --2- 172.21.15.38:0/3098208771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5cc003970 0x7fb5cc003d90 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009c90 tx=0x7fb5cc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.485+0000 7fb5dffff640 1 -- 172.21.15.38:0/3098208771 reap_dead start 2023-12-22T08:48:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.485+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/3098208771 shutdown_connections 2023-12-22T08:48:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.485+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/3098208771 >> 172.21.15.38:0/3098208771 conn(0x7fb5e00b1f70 msgr2=0x7fb5e00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.485+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/3098208771 shutdown_connections 2023-12-22T08:48:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.485+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/3098208771 wait complete. 2023-12-22T08:48:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.487+0000 7fb5e4e1b640 1 Processor -- start 2023-12-22T08:48:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.487+0000 7fb5e4e1b640 1 -- start start 2023-12-22T08:48:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.488+0000 7fb5e4e1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5cc003970 0x7fb5e014ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.488+0000 7fb5e4e1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e014ddd0 0x7fb5e00c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.488+0000 7fb5e4e1b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5e00cc270 0x7fb5e00cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.488+0000 7fb5e4e1b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e014c2f0 con 0x7fb5e00cc270 2023-12-22T08:48:11.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.488+0000 7fb5e4e1b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e00ccc60 con 0x7fb5cc003970 2023-12-22T08:48:11.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.488+0000 7fb5e4e1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e014b670 con 0x7fb5e014ddd0 2023-12-22T08:48:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.489+0000 7fb5dffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5e00cc270 0x7fb5e00cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.489+0000 7fb5dffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5e00cc270 0x7fb5e00cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35074/0 (socket says 172.21.15.38:35074) 2023-12-22T08:48:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.489+0000 7fb5dffff640 1 -- 172.21.15.38:0/750965721 learned_addr learned my addr 172.21.15.38:0/750965721 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.489+0000 7fb5d7fff640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e014ddd0 0x7fb5e00c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.489+0000 7fb5df7fe640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5cc003970 0x7fb5e014ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.489+0000 7fb5dffff640 1 -- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e014ddd0 msgr2=0x7fb5e00c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.489+0000 7fb5dffff640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e014ddd0 0x7fb5e00c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.489+0000 7fb5dffff640 1 -- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5cc003970 msgr2=0x7fb5e014ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.489+0000 7fb5dffff640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5cc003970 0x7fb5e014ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.489+0000 7fb5dffff640 1 -- 172.21.15.38:0/750965721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e014b950 con 0x7fb5e00cc270 2023-12-22T08:48:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.489+0000 7fb5dffff640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5e00cc270 0x7fb5e00cc720 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fb5e015ee70 tx=0x7fb5d800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.490+0000 7fb5dcff9640 1 -- 172.21.15.38:0/750965721 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800bb80 con 0x7fb5e00cc270 2023-12-22T08:48:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.490+0000 7fb5dcff9640 1 -- 172.21.15.38:0/750965721 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d800bce0 con 0x7fb5e00cc270 2023-12-22T08:48:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.490+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/750965721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e014bc30 con 0x7fb5e00cc270 2023-12-22T08:48:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.490+0000 7fb5dcff9640 1 -- 172.21.15.38:0/750965721 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8007310 con 0x7fb5e00cc270 2023-12-22T08:48:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.490+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/750965721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e014b360 con 0x7fb5e00cc270 2023-12-22T08:48:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.491+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/750965721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e014c430 con 0x7fb5e00cc270 2023-12-22T08:48:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.492+0000 7fb5dcff9640 1 -- 172.21.15.38:0/750965721 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb5d8007470 con 0x7fb5e00cc270 2023-12-22T08:48:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.493+0000 7fb5dcff9640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5c006a430 0x7fb5c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.493+0000 7fb5dcff9640 1 -- 172.21.15.38:0/750965721 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5d8088d80 con 0x7fb5e00cc270 2023-12-22T08:48:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.493+0000 7fb5dcff9640 1 -- 172.21.15.38:0/750965721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=145}) v3 -- 0x7fb5c0071f60 con 0x7fb5e00cc270 2023-12-22T08:48:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.494+0000 7fb5df7fe640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5c006a430 0x7fb5c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.495+0000 7fb5df7fe640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5c006a430 0x7fb5c006c8f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0036000 tx=0x7fb5d0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.498+0000 7fb5dcff9640 1 -- 172.21.15.38:0/750965721 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb5e014c430 con 0x7fb5e00cc270 2023-12-22T08:48:11.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.692+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/750965721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb5e014c430 con 0x7fb5e00cc270 2023-12-22T08:48:11.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.695+0000 7fb5dcff9640 1 -- 172.21.15.38:0/750965721 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v144) v1 ==== 81+0+33529 (secure 0 0 0) 0x7fb5e014c430 con 0x7fb5e00cc270 2023-12-22T08:48:11.697 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:11.697 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:48:11.697 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 144, 2023-12-22T08:48:11.697 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:48:11.697 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:48:11.697 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:48:06.274562+0000", 2023-12-22T08:48:11.697 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:48:11.697 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:48:11.697 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:48:11.697 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:48:11.698 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:48:11.698 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:48:11.698 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:48:11.698 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:48:11.698 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:48:11.698 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:11.698 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:48:11.698 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:48:11.698 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:48:11.698 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:48:11.698 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:48:11.698 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 17, 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:11.699 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:11.700 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:11.701 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:11.702 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:11.703 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:48:11.704 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 16, 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:47:48.219096+0000", 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:11.705 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:11.706 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:11.707 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:11.707 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:11.707 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.707 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "141", 2023-12-22T08:48:11.707 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:11.707 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:11.707 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:11.707 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:11.707 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:11.707 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:11.707 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:11.707 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:11.707 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:11.708 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:11.709 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:11.709 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:11.709 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:11.709 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.709 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:11.709 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:11.709 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:11.709 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:11.709 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:11.709 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:11.709 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:11.709 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:11.709 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 2.25, 2023-12-22T08:48:11.710 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 2.25, 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2.25, 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2.25, 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 17, 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:47:49.341846+0000", 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1027, 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-22T08:48:11.711 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:48:11.712 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "144", 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:11.713 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 33554432, 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:11.714 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:11.715 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:48:11.716 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:11.717 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.718 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.719 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:48:11.720 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:48:11.721 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.722 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.723 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:48:11.724 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:11.725 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.726 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.726 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.726 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:48:11.726 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:11.726 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.726 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.726 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.726 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:11.726 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.726 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.726 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.726 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:11.727 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:11.728 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:11.728 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.728 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.728 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.728 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:48:11.728 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:11.728 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:11.728 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:11.728 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:11.728 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:11.729 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:11.729 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:11.729 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:11.729 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:11.729 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:11.729 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.730 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.731 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.732 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:48:11.733 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:11.734 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:11.735 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.736 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.737 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:11.738 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.740 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.741 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:11.742 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.743 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.744 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:48:11.745 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:48:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.746 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.747 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:11.748 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.749 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.749 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.749 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:48:11.749 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:11.749 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:11.749 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:11.749 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:11.749 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:11.749 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:11.749 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:11.749 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:11.749 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:11.749 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:11.750 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.751 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.751 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.751 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:48:11.751 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:11.751 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.751 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.751 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.751 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:48:11.751 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:11.751 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:11.752 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:11.753 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:48:11.754 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:11.755 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.756 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.757 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.757 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:48:11.757 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:11.757 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.757 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.757 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.757 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:11.757 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.757 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.757 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.757 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:48:11.757 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:11.757 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:11.758 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:11.759 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:11.760 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.761 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.761 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:48:11.761 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:11.761 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:11.761 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:11.761 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:11.761 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:11.761 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:48:11.761 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:11.761 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.761 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.761 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:48:11.761 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:11.762 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:48:11.763 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:11.764 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:11.764 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:11.764 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:11.764 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:11.764 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:48:11.764 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:11.764 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.764 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.764 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:48:11.764 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:11.764 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:11.764 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:11.764 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:11.765 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:48:11.766 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:11.767 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:48:11.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.697+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5c006a430 msgr2=0x7fb5c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:11.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.697+0000 7fb5e4e1b640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5c006a430 0x7fb5c006c8f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0036000 tx=0x7fb5d0030000 comp rx=0 tx=0).stop 2023-12-22T08:48:11.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.697+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/750965721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5e00cc270 msgr2=0x7fb5e00cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:11.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.697+0000 7fb5e4e1b640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5e00cc270 0x7fb5e00cc720 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fb5e015ee70 tx=0x7fb5d800b4a0 comp rx=0 tx=0).stop 2023-12-22T08:48:11.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.698+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/750965721 shutdown_connections 2023-12-22T08:48:11.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.698+0000 7fb5e4e1b640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5c006a430 0x7fb5c006c8f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.698+0000 7fb5e4e1b640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5e00cc270 0x7fb5e00cc720 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.698+0000 7fb5e4e1b640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5e014ddd0 0x7fb5e00c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.698+0000 7fb5e4e1b640 1 --2- 172.21.15.38:0/750965721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5cc003970 0x7fb5e014ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.698+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/750965721 >> 172.21.15.38:0/750965721 conn(0x7fb5e00b1f70 msgr2=0x7fb5e00cd270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.698+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/750965721 shutdown_connections 2023-12-22T08:48:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:11.698+0000 7fb5e4e1b640 1 -- 172.21.15.38:0/750965721 wait complete. 2023-12-22T08:48:11.770 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-22T08:48:16.771 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:48:17.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.009+0000 7fb43967d640 1 Processor -- start 2023-12-22T08:48:17.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.009+0000 7fb43967d640 1 -- start start 2023-12-22T08:48:17.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.010+0000 7fb43967d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb43415b420 0x7fb43406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.010+0000 7fb43967d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4340a44a0 0x7fb4340708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.010+0000 7fb43967d640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4340cdae0 con 0x7fb434070e30 2023-12-22T08:48:17.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.010+0000 7fb43967d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb434071260 con 0x7fb43415b420 2023-12-22T08:48:17.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.010+0000 7fb43967d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43406dec0 con 0x7fb4340a44a0 2023-12-22T08:48:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.011+0000 7fb4337fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4340a44a0 0x7fb4340708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.011+0000 7fb4337fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4340a44a0 0x7fb4340708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:40772/0 (socket says 172.21.15.38:40772) 2023-12-22T08:48:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.011+0000 7fb4337fe640 1 -- 172.21.15.38:0/2607931376 learned_addr learned my addr 172.21.15.38:0/2607931376 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:17.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.011+0000 7fb433fff640 1 --2- 172.21.15.38:0/2607931376 >> v2:172.21.15.89:3300/0 conn(0x7fb43415b420 0x7fb43406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.011+0000 7fb432ffd640 1 -- 172.21.15.38:0/2607931376 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158694470 0 0) 0x7fb4340cdae0 con 0x7fb434070e30 2023-12-22T08:48:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.012+0000 7fb432ffd640 1 -- 172.21.15.38:0/2607931376 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb41c003520 con 0x7fb434070e30 2023-12-22T08:48:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.012+0000 7fb4337fe640 1 -- 172.21.15.38:0/2607931376 >> v2:172.21.15.89:3300/0 conn(0x7fb43415b420 msgr2=0x7fb43406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.012+0000 7fb4337fe640 1 --2- 172.21.15.38:0/2607931376 >> v2:172.21.15.89:3300/0 conn(0x7fb43415b420 0x7fb43406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.012+0000 7fb4337fe640 1 -- 172.21.15.38:0/2607931376 >> v1:172.21.15.89:6789/0 conn(0x7fb434070e30 legacy=0x7fb43406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.012+0000 7fb4337fe640 1 -- 172.21.15.38:0/2607931376 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43415b800 con 0x7fb4340a44a0 2023-12-22T08:48:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.013+0000 7fb4337fe640 1 --2- 172.21.15.38:0/2607931376 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4340a44a0 0x7fb4340708f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb428009870 tx=0x7fb42802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4171db172e076360 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.013+0000 7fb432ffd640 1 -- 172.21.15.38:0/2607931376 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428030840 con 0x7fb4340a44a0 2023-12-22T08:48:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.013+0000 7fb432ffd640 1 -- 172.21.15.38:0/2607931376 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4280309a0 con 0x7fb4340a44a0 2023-12-22T08:48:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.014+0000 7fb432ffd640 1 -- 172.21.15.38:0/2607931376 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428030d10 con 0x7fb4340a44a0 2023-12-22T08:48:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.014+0000 7fb43967d640 1 -- 172.21.15.38:0/2607931376 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4340a44a0 msgr2=0x7fb4340708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.014+0000 7fb43967d640 1 --2- 172.21.15.38:0/2607931376 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4340a44a0 0x7fb4340708f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb428009870 tx=0x7fb42802b980 comp rx=0 tx=0).stop 2023-12-22T08:48:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.014+0000 7fb43967d640 1 -- 172.21.15.38:0/2607931376 shutdown_connections 2023-12-22T08:48:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.014+0000 7fb43967d640 1 --2- 172.21.15.38:0/2607931376 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4340a44a0 0x7fb4340708f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.014+0000 7fb43967d640 1 --2- 172.21.15.38:0/2607931376 >> v2:172.21.15.89:3300/0 conn(0x7fb43415b420 0x7fb43406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.014+0000 7fb43967d640 1 -- 172.21.15.38:0/2607931376 >> 172.21.15.38:0/2607931376 conn(0x7fb4340b1f70 msgr2=0x7fb4340b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.014+0000 7fb43967d640 1 -- 172.21.15.38:0/2607931376 shutdown_connections 2023-12-22T08:48:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.015+0000 7fb43967d640 1 -- 172.21.15.38:0/2607931376 wait complete. 2023-12-22T08:48:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.017+0000 7fb43967d640 1 Processor -- start 2023-12-22T08:48:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.017+0000 7fb43967d640 1 -- start start 2023-12-22T08:48:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.018+0000 7fb43967d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb434070e30 0x7fb4341f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.018+0000 7fb43967d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4340a44a0 0x7fb4341501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.018+0000 7fb43967d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb43415b420 0x7fb43409eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.018+0000 7fb43967d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340cb8d0 con 0x7fb434070e30 2023-12-22T08:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.018+0000 7fb43967d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340cbe90 con 0x7fb43415b420 2023-12-22T08:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.018+0000 7fb43967d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340c3d30 con 0x7fb4340a44a0 2023-12-22T08:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.018+0000 7fb433fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb434070e30 0x7fb4341f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.019+0000 7fb433fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb434070e30 0x7fb4341f2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35090/0 (socket says 172.21.15.38:35090) 2023-12-22T08:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.019+0000 7fb433fff640 1 -- 172.21.15.38:0/2391879541 learned_addr learned my addr 172.21.15.38:0/2391879541 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.019+0000 7fb438e7c640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb43415b420 0x7fb43409eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.019+0000 7fb4337fe640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4340a44a0 0x7fb4341501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.019+0000 7fb433fff640 1 -- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4340a44a0 msgr2=0x7fb4341501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.019+0000 7fb433fff640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4340a44a0 0x7fb4341501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.019+0000 7fb433fff640 1 -- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb43415b420 msgr2=0x7fb43409eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.019+0000 7fb433fff640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb43415b420 0x7fb43409eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.019+0000 7fb433fff640 1 -- 172.21.15.38:0/2391879541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4280094d0 con 0x7fb434070e30 2023-12-22T08:48:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.019+0000 7fb433fff640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb434070e30 0x7fb4341f2da0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fb42400e9e0 tx=0x7fb42400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:17.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.020+0000 7fb430ff9640 1 -- 172.21.15.38:0/2391879541 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424009670 con 0x7fb434070e30 2023-12-22T08:48:17.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.020+0000 7fb430ff9640 1 -- 172.21.15.38:0/2391879541 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42400c9d0 con 0x7fb434070e30 2023-12-22T08:48:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.020+0000 7fb430ff9640 1 -- 172.21.15.38:0/2391879541 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42400cd80 con 0x7fb434070e30 2023-12-22T08:48:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.020+0000 7fb43967d640 1 -- 172.21.15.38:0/2391879541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4340c4010 con 0x7fb434070e30 2023-12-22T08:48:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.020+0000 7fb43967d640 1 -- 172.21.15.38:0/2391879541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb434150710 con 0x7fb434070e30 2023-12-22T08:48:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.021+0000 7fb43967d640 1 -- 172.21.15.38:0/2391879541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43415d8a0 con 0x7fb434070e30 2023-12-22T08:48:17.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.022+0000 7fb430ff9640 1 -- 172.21.15.38:0/2391879541 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb424013470 con 0x7fb434070e30 2023-12-22T08:48:17.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.023+0000 7fb430ff9640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb42006a460 0x7fb42006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.023+0000 7fb430ff9640 1 -- 172.21.15.38:0/2391879541 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb424088b80 con 0x7fb434070e30 2023-12-22T08:48:17.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.024+0000 7fb4337fe640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb42006a460 0x7fb42006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.025+0000 7fb4337fe640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb42006a460 0x7fb42006c920 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb428036000 tx=0x7fb428008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:17.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.028+0000 7fb430ff9640 1 -- 172.21.15.38:0/2391879541 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb424054160 con 0x7fb434070e30 2023-12-22T08:48:17.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.222+0000 7fb43967d640 1 -- 172.21.15.38:0/2391879541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb434061910 con 0x7fb434070e30 2023-12-22T08:48:17.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.225+0000 7fb430ff9640 1 -- 172.21.15.38:0/2391879541 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+33510 (secure 0 0 0) 0x7fb424017090 con 0x7fb434070e30 2023-12-22T08:48:17.227 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:17.227 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:48:17.227 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 145, 2023-12-22T08:48:17.227 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:48:17.227 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:48:17.227 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:48:16.278594+0000", 2023-12-22T08:48:17.227 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:48:17.227 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 17, 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:48:17.228 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:17.229 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:17.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:17.231 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:17.232 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:17.233 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:17.234 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 16, 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:47:48.219096+0000", 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:17.235 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:17.236 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "141", 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:48:17.237 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:17.238 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:17.239 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 2.25, 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 2.25, 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2.25, 2023-12-22T08:48:17.240 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2.25, 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 17, 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:47:49.341846+0000", 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:17.241 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:17.242 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "145", 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:17.243 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 33554432, 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:17.244 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:17.245 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.245 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:17.245 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:17.245 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:17.245 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:17.245 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:17.245 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:17.245 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:17.245 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:17.245 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:17.245 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:17.245 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:48:17.246 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.247 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.248 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.248 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.248 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.248 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.248 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.248 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.248 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.248 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.248 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.248 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.248 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:48:17.248 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.248 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.249 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.250 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.251 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.252 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.253 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.254 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.255 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.256 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:48:17.256 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.256 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.256 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.256 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.256 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:48:17.256 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.256 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.256 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.256 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.256 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.256 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.257 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.257 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.257 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:48:17.257 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.257 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.257 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.257 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.257 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:48:17.257 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.257 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.257 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.257 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.257 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.258 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.259 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.259 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.259 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.259 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.259 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.259 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.259 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.259 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.259 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.259 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.259 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.259 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:48:17.259 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.260 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.260 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.260 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.260 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:48:17.260 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.260 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.260 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.260 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.260 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.260 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.260 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.260 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.261 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:48:17.261 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.261 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.261 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.261 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.261 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:48:17.261 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.261 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.261 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.261 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.261 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.261 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.261 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.262 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.263 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.263 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:48:17.263 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.263 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.263 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.263 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.263 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:48:17.263 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.263 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.263 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.263 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.263 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:48:17.263 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:48:17.264 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:48:17.264 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:48:17.264 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.264 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.264 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.264 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.264 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.264 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.264 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:48:17.264 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.264 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.264 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.264 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.265 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.265 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.265 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.265 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.265 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.265 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.265 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.265 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.265 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.265 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.265 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.265 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:48:17.265 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.266 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.266 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.266 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.266 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:48:17.266 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.266 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.266 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.266 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.266 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.266 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.266 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.266 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.266 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.268 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:48:17.269 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.270 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.271 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.272 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.273 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.273 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.273 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.273 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.273 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.273 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.273 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:48:17.273 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.273 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.273 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.273 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.273 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:48:17.274 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.274 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.274 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.274 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.274 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.274 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.274 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.274 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.274 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:48:17.274 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.274 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.274 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.274 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.275 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:48:17.275 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.275 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.275 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.275 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.275 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:48:17.275 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:48:17.275 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:48:17.275 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:48:17.275 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.275 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.275 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.275 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.276 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.277 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.278 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.279 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.280 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.280 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.280 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:48:17.280 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.280 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.280 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.280 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.280 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:48:17.280 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.280 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.280 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.280 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.280 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:48:17.281 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:48:17.281 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:48:17.281 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:48:17.281 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.281 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.281 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.281 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.281 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.281 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.281 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:48:17.281 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.281 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.281 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:48:17.282 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.283 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.284 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.285 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:48:17.285 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.285 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.285 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.285 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.285 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.285 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.285 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.285 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.285 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:48:17.285 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.285 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.285 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.287 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.288 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.289 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.290 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.291 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.292 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.293 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:48:17.293 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.293 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.293 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.293 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.293 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.293 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:48:17.293 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.293 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.293 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.293 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:48:17.293 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.293 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:48:17.294 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.295 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.296 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:48:17.297 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:48:17.298 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:48:17.299 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:48:17.299 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:48:17.299 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:48:17.299 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:48:17.299 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:48:17.299 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:48:17.299 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:48:17.299 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:48:17.299 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.299 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:48:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.228+0000 7fb43967d640 1 -- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb42006a460 msgr2=0x7fb42006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.228+0000 7fb43967d640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb42006a460 0x7fb42006c920 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb428036000 tx=0x7fb428008030 comp rx=0 tx=0).stop 2023-12-22T08:48:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.228+0000 7fb43967d640 1 -- 172.21.15.38:0/2391879541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb434070e30 msgr2=0x7fb4341f2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.228+0000 7fb43967d640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb434070e30 0x7fb4341f2da0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fb42400e9e0 tx=0x7fb42400eea0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.228+0000 7fb43967d640 1 -- 172.21.15.38:0/2391879541 shutdown_connections 2023-12-22T08:48:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.228+0000 7fb43967d640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb43415b420 0x7fb43409eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.228+0000 7fb43967d640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4340a44a0 0x7fb4341501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.228+0000 7fb43967d640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb42006a460 0x7fb42006c920 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.228+0000 7fb43967d640 1 --2- 172.21.15.38:0/2391879541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb434070e30 0x7fb4341f2da0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.228+0000 7fb43967d640 1 -- 172.21.15.38:0/2391879541 >> 172.21.15.38:0/2391879541 conn(0x7fb4340b1f70 msgr2=0x7fb43415c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:17.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.228+0000 7fb43967d640 1 -- 172.21.15.38:0/2391879541 shutdown_connections 2023-12-22T08:48:17.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.228+0000 7fb43967d640 1 -- 172.21.15.38:0/2391879541 wait complete. 2023-12-22T08:48:17.302 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-22T08:48:17.302 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:48:17.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.537+0000 7fc507fff640 1 Processor -- start 2023-12-22T08:48:17.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.537+0000 7fc507fff640 1 -- start start 2023-12-22T08:48:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.539+0000 7fc507fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5080ce560 0x7fc5081682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.539+0000 7fc507fff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5080cd970 con 0x7fc50815d350 2023-12-22T08:48:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.539+0000 7fc507fff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5080cf320 con 0x7fc50815d730 2023-12-22T08:48:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.540+0000 7fc507fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5080cf600 con 0x7fc5080ce560 2023-12-22T08:48:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.540+0000 7fc506ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc50815d350 0x7fc5080d06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51926/0 (socket says 172.21.15.38:51926) 2023-12-22T08:48:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.540+0000 7fc506ffd640 1 -- 172.21.15.38:0/78390139 learned_addr learned my addr 172.21.15.38:0/78390139 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.540+0000 7fc5077fe640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5080ce560 0x7fc5081682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.540+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390803646 0 0) 0x7fc5080cd970 con 0x7fc50815d350 2023-12-22T08:48:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.540+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f4003520 con 0x7fc50815d350 2023-12-22T08:48:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1642132503 0 0) 0x7fc4f4003520 con 0x7fc50815d350 2023-12-22T08:48:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5080ce560 msgr2=0x7fc5081682c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5067fc640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5080ce560 0x7fc5081682c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 >> v1:172.21.15.89:6789/0 conn(0x7fc50815d730 legacy=0x7fc5080cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5080cf8e0 con 0x7fc50815d350 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fc4f8001670 con 0x7fc50815d350 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 >> v1:172.21.15.38:6789/0 conn(0x7fc50815d350 legacy=0x7fc5080d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5067fc640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f40039a0 0x7fc4f4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5067fc640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4f40047c0 0x7fc4f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5067fc640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f4005180 0x7fc4f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5080cf600 con 0x7fc4f40047c0 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f400c080 con 0x7fc4f4005180 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f400c240 con 0x7fc4f40039a0 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5077fe640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5080ce560 0x7fc5081682c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc4fffff640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4f40047c0 0x7fc4f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.541+0000 7fc5077fe640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f4005180 0x7fc4f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.542+0000 7fc506ffd640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f40039a0 0x7fc4f4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.542+0000 7fc4fffff640 1 -- 172.21.15.38:0/78390139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f40039a0 msgr2=0x7fc4f4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:17.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.542+0000 7fc4fffff640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4f40039a0 0x7fc4f4003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.542+0000 7fc4fffff640 1 -- 172.21.15.38:0/78390139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f4005180 msgr2=0x7fc4f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:17.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.542+0000 7fc4fffff640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f4005180 0x7fc4f400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.542+0000 7fc4fffff640 1 -- 172.21.15.38:0/78390139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f4003520 con 0x7fc4f40047c0 2023-12-22T08:48:17.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.542+0000 7fc5077fe640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f4005180 0x7fc4f400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:17.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.543+0000 7fc4fffff640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4f40047c0 0x7fc4f4004c40 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0001750 tx=0x7fc4f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611ab5f5bcd6e550 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:17.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.543+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00052d0 con 0x7fc4f40047c0 2023-12-22T08:48:17.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.543+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f002e050 con 0x7fc4f40047c0 2023-12-22T08:48:17.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.543+0000 7fc5067fc640 1 -- 172.21.15.38:0/78390139 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0003830 con 0x7fc4f40047c0 2023-12-22T08:48:17.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.544+0000 7fc507fff640 1 -- 172.21.15.38:0/78390139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4f40047c0 msgr2=0x7fc4f4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:17.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.544+0000 7fc507fff640 1 --2- 172.21.15.38:0/78390139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4f40047c0 0x7fc4f4004c40 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0001750 tx=0x7fc4f40057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.544+0000 7fc5077fe640 1 -- 172.21.15.38:0/78390139 reap_dead start 2023-12-22T08:48:17.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.544+0000 7fc507fff640 1 -- 172.21.15.38:0/78390139 shutdown_connections 2023-12-22T08:48:17.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.544+0000 7fc507fff640 1 -- 172.21.15.38:0/78390139 >> 172.21.15.38:0/78390139 conn(0x7fc5080d14b0 msgr2=0x7fc5080d18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:17.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.544+0000 7fc507fff640 1 -- 172.21.15.38:0/78390139 shutdown_connections 2023-12-22T08:48:17.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.544+0000 7fc507fff640 1 -- 172.21.15.38:0/78390139 wait complete. 2023-12-22T08:48:17.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.546+0000 7fc507fff640 1 Processor -- start 2023-12-22T08:48:17.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.546+0000 7fc507fff640 1 -- start start 2023-12-22T08:48:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.547+0000 7fc507fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f40047c0 0x7fc50814b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.547+0000 7fc507fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5080b42d0 0x7fc5080b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.547+0000 7fc507fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5080b62f0 0x7fc5080b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.547+0000 7fc507fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50814c130 con 0x7fc5080b62f0 2023-12-22T08:48:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.547+0000 7fc507fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50814bc50 con 0x7fc4f40047c0 2023-12-22T08:48:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.547+0000 7fc507fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5080b3b20 con 0x7fc5080b42d0 2023-12-22T08:48:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.547+0000 7fc5077fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5080b62f0 0x7fc5080b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.548+0000 7fc5077fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5080b62f0 0x7fc5080b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35094/0 (socket says 172.21.15.38:35094) 2023-12-22T08:48:17.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.548+0000 7fc5077fe640 1 -- 172.21.15.38:0/3703975071 learned_addr learned my addr 172.21.15.38:0/3703975071 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.548+0000 7fc506ffd640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f40047c0 0x7fc50814b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.548+0000 7fc4fffff640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5080b42d0 0x7fc5080b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.548+0000 7fc5077fe640 1 -- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5080b42d0 msgr2=0x7fc5080b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.548+0000 7fc5077fe640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5080b42d0 0x7fc5080b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.548+0000 7fc5077fe640 1 -- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f40047c0 msgr2=0x7fc50814b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.548+0000 7fc5077fe640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f40047c0 0x7fc50814b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.548+0000 7fc5077fe640 1 -- 172.21.15.38:0/3703975071 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5080b47d0 con 0x7fc5080b62f0 2023-12-22T08:48:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.548+0000 7fc5077fe640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5080b62f0 0x7fc5080b67a0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fc50806a820 tx=0x7fc500004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.549+0000 7fc504ff9640 1 -- 172.21.15.38:0/3703975071 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500007d60 con 0x7fc5080b62f0 2023-12-22T08:48:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.549+0000 7fc504ff9640 1 -- 172.21.15.38:0/3703975071 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc500014400 con 0x7fc5080b62f0 2023-12-22T08:48:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.549+0000 7fc504ff9640 1 -- 172.21.15.38:0/3703975071 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500014790 con 0x7fc5080b62f0 2023-12-22T08:48:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.549+0000 7fc507fff640 1 -- 172.21.15.38:0/3703975071 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5080b4ab0 con 0x7fc5080b62f0 2023-12-22T08:48:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.549+0000 7fc507fff640 1 -- 172.21.15.38:0/3703975071 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50815f450 con 0x7fc5080b62f0 2023-12-22T08:48:17.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.550+0000 7fc507fff640 1 -- 172.21.15.38:0/3703975071 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc50815f640 con 0x7fc5080b62f0 2023-12-22T08:48:17.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.551+0000 7fc504ff9640 1 -- 172.21.15.38:0/3703975071 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc50001d3b0 con 0x7fc5080b62f0 2023-12-22T08:48:17.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.552+0000 7fc504ff9640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc4e806a430 0x7fc4e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:17.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.552+0000 7fc504ff9640 1 -- 172.21.15.38:0/3703975071 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc500088680 con 0x7fc5080b62f0 2023-12-22T08:48:17.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.553+0000 7fc506ffd640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc4e806a430 0x7fc4e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:17.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.554+0000 7fc506ffd640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc4e806a430 0x7fc4e806c8f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8000ff0 tx=0x7fc4f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:17.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.557+0000 7fc504ff9640 1 -- 172.21.15.38:0/3703975071 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc500053c70 con 0x7fc5080b62f0 2023-12-22T08:48:17.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.763+0000 7fc507fff640 1 -- 172.21.15.38:0/3703975071 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc5080cfea0 con 0x7fc5080b62f0 2023-12-22T08:48:17.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.766+0000 7fc504ff9640 1 -- 172.21.15.38:0/3703975071 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+33510 (secure 0 0 0) 0x7fc500057290 con 0x7fc5080b62f0 2023-12-22T08:48:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:17.768 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:48:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 145, 2023-12-22T08:48:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:48:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:48:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:48:16.278594+0000", 2023-12-22T08:48:17.768 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:48:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:48:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:48:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:48:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:48:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:48:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:48:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:48:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:48:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:48:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:48:17.769 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:48:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:48:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:48:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 17, 2023-12-22T08:48:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:48:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:48:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:48:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:48:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:48:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:48:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:48:17.770 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:17.773 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:17.774 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:48:17.775 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 16, 2023-12-22T08:48:17.776 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:48:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:47:48.219096+0000", 2023-12-22T08:48:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:17.777 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:48:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:48:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:48:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:48:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:48:17.778 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "141", 2023-12-22T08:48:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:17.779 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:17.780 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:48:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:17.781 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:17.782 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:48:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:48:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:48:17.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:48:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:48:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 2.25, 2023-12-22T08:48:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 2.25, 2023-12-22T08:48:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:48:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2.25, 2023-12-22T08:48:17.784 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2.25, 2023-12-22T08:48:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 17, 2023-12-22T08:48:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:48:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:47:49.341846+0000", 2023-12-22T08:48:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:48:17.785 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:48:17.786 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "145", 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:48:17.787 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:48:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:48:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:48:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:48:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:48:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 33554432, 2023-12-22T08:48:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:48:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:48:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:48:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:48:17.788 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:48:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:48:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:48:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:48:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:48:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:48:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:48:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:48:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:48:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:48:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:48:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:48:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.789 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:48:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:48:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:48:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:48:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:48:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:48:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:48:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:48:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:48:17.790 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:48:17.791 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:48:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:48:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:48:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:48:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:48:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:48:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:48:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.792 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.793 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:48:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:48:17.794 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:48:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.795 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.796 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:48:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:48:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.797 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.798 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.799 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.800 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.801 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.801 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:48:17.801 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.801 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.801 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.801 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.801 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:48:17.801 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.801 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.801 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.801 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.802 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:48:17.803 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.804 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.805 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.805 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.805 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.805 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.805 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.805 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.805 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.805 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.805 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.805 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.805 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:48:17.805 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.805 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.806 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.806 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.806 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:48:17.806 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.806 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.806 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.806 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.806 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.806 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.806 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.806 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:48:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:48:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.807 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.808 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.808 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:48:17.808 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.808 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.808 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.808 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.808 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:48:17.808 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.808 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.808 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.808 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.809 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.809 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.809 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.809 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.809 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:48:17.809 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.809 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.809 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.809 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.809 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:48:17.809 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:48:17.809 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.809 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.810 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.811 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.811 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.811 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.811 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.811 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.811 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.811 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.811 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.811 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.811 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.812 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.813 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.813 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.813 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:48:17.813 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.813 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.813 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.813 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.813 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:48:17.813 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.813 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.813 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.813 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.813 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.814 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:48:17.815 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.816 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.817 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:48:17.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.822 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.823 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:48:17.824 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.825 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.825 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.825 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.825 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:48:17.825 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.825 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.825 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.825 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.825 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.825 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.825 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.825 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.825 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:48:17.826 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.826 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.826 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.826 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.826 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:48:17.826 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:48:17.826 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.826 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.826 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.826 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:48:17.826 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:48:17.826 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:48:17.827 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:48:17.827 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.827 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.827 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.827 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.827 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.827 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.827 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:48:17.827 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.827 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.827 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.827 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.827 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.828 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.829 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.830 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.831 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:48:17.832 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:48:17.833 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:48:17.833 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:48:17.833 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:48:17.833 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:48:17.833 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:48:17.833 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:48:17.833 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:48:17.833 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 140, 2023-12-22T08:48:17.833 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:48:17.833 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:48:17.833 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:48:17.834 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.834 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.834 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.834 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:48:17.834 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.834 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.834 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.834 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.834 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:48:17.834 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.834 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.834 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.834 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.835 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:48:17.836 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:48:17.837 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.838 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.839 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.840 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.840 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:48:17.840 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.840 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.840 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.840 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.840 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.840 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:48:17.840 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.840 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.840 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.840 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:48:17.840 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.841 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.842 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.843 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.844 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:17.845 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:48:17.845 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:48:17.845 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:48:17.845 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:48:17.845 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:48:17.845 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:48:17.845 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:48:17.845 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:48:17.845 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:48:17.845 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:48:17.845 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:48:17.845 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:17.845 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:48:17.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.769+0000 7fc507fff640 1 -- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc4e806a430 msgr2=0x7fc4e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:17.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.769+0000 7fc507fff640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc4e806a430 0x7fc4e806c8f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8000ff0 tx=0x7fc4f8009040 comp rx=0 tx=0).stop 2023-12-22T08:48:17.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.769+0000 7fc507fff640 1 -- 172.21.15.38:0/3703975071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5080b62f0 msgr2=0x7fc5080b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:17.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.769+0000 7fc507fff640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5080b62f0 0x7fc5080b67a0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fc50806a820 tx=0x7fc500004840 comp rx=0 tx=0).stop 2023-12-22T08:48:17.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.769+0000 7fc507fff640 1 -- 172.21.15.38:0/3703975071 shutdown_connections 2023-12-22T08:48:17.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.769+0000 7fc507fff640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc4e806a430 0x7fc4e806c8f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.769+0000 7fc507fff640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5080b62f0 0x7fc5080b67a0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.769+0000 7fc507fff640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5080b42d0 0x7fc5080b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.769+0000 7fc507fff640 1 --2- 172.21.15.38:0/3703975071 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4f40047c0 0x7fc50814b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:17.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.769+0000 7fc507fff640 1 -- 172.21.15.38:0/3703975071 >> 172.21.15.38:0/3703975071 conn(0x7fc5080d14b0 msgr2=0x7fc50815a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:17.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.769+0000 7fc507fff640 1 -- 172.21.15.38:0/3703975071 shutdown_connections 2023-12-22T08:48:17.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:17.769+0000 7fc507fff640 1 -- 172.21.15.38:0/3703975071 wait complete. 2023-12-22T08:48:17.848 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:48:18.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.081+0000 7fea3fcc7640 1 Processor -- start 2023-12-22T08:48:18.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.082+0000 7fea3fcc7640 1 -- start start 2023-12-22T08:48:18.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.084+0000 7fea3fcc7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fea3815e740 0x7fea3815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:18.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.084+0000 7fea3fcc7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3806ca50 0x7fea380b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:18.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.084+0000 7fea3fcc7640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea380b4210 con 0x7fea380b3dc0 2023-12-22T08:48:18.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.084+0000 7fea3fcc7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3806e650 con 0x7fea3815e740 2023-12-22T08:48:18.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.084+0000 7fea3fcc7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3815eb20 con 0x7fea3806ca50 2023-12-22T08:48:18.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.084+0000 7fea3e264640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fea380b3dc0 0x7fea38161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51928/0 (socket says 172.21.15.38:51928) 2023-12-22T08:48:18.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.084+0000 7fea3e264640 1 -- 172.21.15.38:0/1733429718 learned_addr learned my addr 172.21.15.38:0/1733429718 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.084+0000 7fea3d262640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3806ca50 0x7fea380b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.084+0000 7fea3da63640 1 --2- 172.21.15.38:0/1733429718 >> v2:172.21.15.89:3300/0 conn(0x7fea3815e740 0x7fea3815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.084+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961025587 0 0) 0x7fea30001110 con 0x7fea380b3dc0 2023-12-22T08:48:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.084+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea24003520 con 0x7fea380b3dc0 2023-12-22T08:48:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 953019651 0 0) 0x7fea24003520 con 0x7fea380b3dc0 2023-12-22T08:48:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3806ca50 msgr2=0x7fea380b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3806ca50 0x7fea380b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 >> v2:172.21.15.89:3300/0 conn(0x7fea3815e740 msgr2=0x7fea3815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 --2- 172.21.15.38:0/1733429718 >> v2:172.21.15.89:3300/0 conn(0x7fea3815e740 0x7fea3815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38070770 con 0x7fea380b3dc0 2023-12-22T08:48:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fea30001800 con 0x7fea380b3dc0 2023-12-22T08:48:18.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 >> v1:172.21.15.38:6789/0 conn(0x7fea380b3dc0 legacy=0x7fea38161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:18.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea24003970 0x7fea24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:18.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea240047c0 0x7fea24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:18.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3806ca50 0x7fea24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:18.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3806e650 con 0x7fea24003970 2023-12-22T08:48:18.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3815eb20 con 0x7fea240047c0 2023-12-22T08:48:18.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.085+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2400ba60 con 0x7fea3806ca50 2023-12-22T08:48:18.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.086+0000 7fea3da63640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea24003970 0x7fea24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:18.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.086+0000 7fea3e264640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3806ca50 0x7fea24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.086+0000 7fea3d262640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea240047c0 0x7fea24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.086+0000 7fea3da63640 1 -- 172.21.15.38:0/1733429718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3806ca50 msgr2=0x7fea24005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.086+0000 7fea3da63640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3806ca50 0x7fea24005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.086+0000 7fea3da63640 1 -- 172.21.15.38:0/1733429718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea240047c0 msgr2=0x7fea24004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.086+0000 7fea3da63640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea240047c0 0x7fea24004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.086+0000 7fea3da63640 1 -- 172.21.15.38:0/1733429718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea24003520 con 0x7fea24003970 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.086+0000 7fea3d262640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea240047c0 0x7fea24004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.086+0000 7fea3e264640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea3806ca50 0x7fea24005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.087+0000 7fea3da63640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea24003970 0x7fea24003d90 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fea34009f90 tx=0x7fea240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377e67273953c424 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.088+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3402cbf0 con 0x7fea24003970 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.088+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3400f040 con 0x7fea24003970 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.088+0000 7fea3ca61640 1 -- 172.21.15.38:0/1733429718 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34034440 con 0x7fea24003970 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.088+0000 7fea3fcc7640 1 -- 172.21.15.38:0/1733429718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea24003970 msgr2=0x7fea24003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:18.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.088+0000 7fea3fcc7640 1 --2- 172.21.15.38:0/1733429718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea24003970 0x7fea24003d90 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fea34009f90 tx=0x7fea240057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:18.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.088+0000 7fea3e264640 1 -- 172.21.15.38:0/1733429718 reap_dead start 2023-12-22T08:48:18.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.088+0000 7fea3fcc7640 1 -- 172.21.15.38:0/1733429718 shutdown_connections 2023-12-22T08:48:18.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.088+0000 7fea3fcc7640 1 -- 172.21.15.38:0/1733429718 >> 172.21.15.38:0/1733429718 conn(0x7fea380cfea0 msgr2=0x7fea380d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:18.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.088+0000 7fea3fcc7640 1 -- 172.21.15.38:0/1733429718 shutdown_connections 2023-12-22T08:48:18.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.088+0000 7fea3fcc7640 1 -- 172.21.15.38:0/1733429718 wait complete. 2023-12-22T08:48:18.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.091+0000 7fea3fcc7640 1 Processor -- start 2023-12-22T08:48:18.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.091+0000 7fea3fcc7640 1 -- start start 2023-12-22T08:48:18.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3fcc7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea24003970 0x7fea38155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:18.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3fcc7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea381f2cf0 0x7fea381f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:18.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3fcc7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea38150ef0 0x7fea380710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:18.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3fcc7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea380b7ad0 con 0x7fea381f2cf0 2023-12-22T08:48:18.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3fcc7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea38155cd0 con 0x7fea24003970 2023-12-22T08:48:18.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3fcc7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea380b71a0 con 0x7fea38150ef0 2023-12-22T08:48:18.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3d262640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea381f2cf0 0x7fea381f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:18.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3d262640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea381f2cf0 0x7fea381f6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35124/0 (socket says 172.21.15.38:35124) 2023-12-22T08:48:18.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3d262640 1 -- 172.21.15.38:0/4280710332 learned_addr learned my addr 172.21.15.38:0/4280710332 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:18.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3da63640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea24003970 0x7fea38155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:18.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3e264640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea38150ef0 0x7fea380710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:18.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3d262640 1 -- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea38150ef0 msgr2=0x7fea380710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:18.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3d262640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea38150ef0 0x7fea380710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:18.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3d262640 1 -- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea24003970 msgr2=0x7fea38155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:18.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3d262640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea24003970 0x7fea38155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:18.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.092+0000 7fea3d262640 1 -- 172.21.15.38:0/4280710332 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea380b7480 con 0x7fea381f2cf0 2023-12-22T08:48:18.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.093+0000 7fea3d262640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea381f2cf0 0x7fea381f6cb0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fea280108b0 tx=0x7fea28010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:18.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.093+0000 7fea2e7fc640 1 -- 172.21.15.38:0/4280710332 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800eb60 con 0x7fea381f2cf0 2023-12-22T08:48:18.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.093+0000 7fea2e7fc640 1 -- 172.21.15.38:0/4280710332 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2800ecc0 con 0x7fea381f2cf0 2023-12-22T08:48:18.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.093+0000 7fea3fcc7640 1 -- 172.21.15.38:0/4280710332 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea380b7760 con 0x7fea381f2cf0 2023-12-22T08:48:18.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.093+0000 7fea2e7fc640 1 -- 172.21.15.38:0/4280710332 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2801c400 con 0x7fea381f2cf0 2023-12-22T08:48:18.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.093+0000 7fea3fcc7640 1 -- 172.21.15.38:0/4280710332 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea380715e0 con 0x7fea381f2cf0 2023-12-22T08:48:18.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.094+0000 7fea3fcc7640 1 -- 172.21.15.38:0/4280710332 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea38061910 con 0x7fea381f2cf0 2023-12-22T08:48:18.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.095+0000 7fea2e7fc640 1 -- 172.21.15.38:0/4280710332 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fea2801c560 con 0x7fea381f2cf0 2023-12-22T08:48:18.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.096+0000 7fea2e7fc640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea1c06a430 0x7fea1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:18.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.096+0000 7fea2e7fc640 1 -- 172.21.15.38:0/4280710332 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea28088fe0 con 0x7fea381f2cf0 2023-12-22T08:48:18.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.097+0000 7fea3da63640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea1c06a430 0x7fea1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:18.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.098+0000 7fea3da63640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea1c06a430 0x7fea1c06c8f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fea34036000 tx=0x7fea3402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:18.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.100+0000 7fea2e7fc640 1 -- 172.21.15.38:0/4280710332 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fea28054600 con 0x7fea381f2cf0 2023-12-22T08:48:18.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.336+0000 7fea3fcc7640 1 -- 172.21.15.38:0/4280710332 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea3806da10 con 0x7fea381f2cf0 2023-12-22T08:48:18.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.337+0000 7fea2e7fc640 1 -- 172.21.15.38:0/4280710332 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4650 (secure 0 0 0) 0x7fea28057c20 con 0x7fea381f2cf0 2023-12-22T08:48:18.339 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:18.339 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3891984223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3891984223},{"type":"v1","addr":"172.21.15.38:6834","nonce":3891984223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1561904072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1561904072},{"type":"v1","addr":"172.21.15.89:6836","nonce":1561904072}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4192516230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4192516230},{"type":"v1","addr":"172.21.15.89:6837","nonce":4192516230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:50.322298+0000","modified":"2023-12-22T08:47:53.343300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7716},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7716":{"gid":7716,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1276125280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1276125280},{"type":"v1","addr":"172.21.15.38:6835","nonce":1276125280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-22T08:48:18.339 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 62 2023-12-22T08:48:18.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.340+0000 7fea3fcc7640 1 -- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea1c06a430 msgr2=0x7fea1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:18.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.340+0000 7fea3fcc7640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea1c06a430 0x7fea1c06c8f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fea34036000 tx=0x7fea3402e000 comp rx=0 tx=0).stop 2023-12-22T08:48:18.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.340+0000 7fea3fcc7640 1 -- 172.21.15.38:0/4280710332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea381f2cf0 msgr2=0x7fea381f6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:18.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.340+0000 7fea3fcc7640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea381f2cf0 0x7fea381f6cb0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fea280108b0 tx=0x7fea28010d70 comp rx=0 tx=0).stop 2023-12-22T08:48:18.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.340+0000 7fea3fcc7640 1 -- 172.21.15.38:0/4280710332 shutdown_connections 2023-12-22T08:48:18.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.340+0000 7fea3fcc7640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea38150ef0 0x7fea380710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:18.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.340+0000 7fea3fcc7640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea1c06a430 0x7fea1c06c8f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:18.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.340+0000 7fea3fcc7640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea381f2cf0 0x7fea381f6cb0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:18.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.340+0000 7fea3fcc7640 1 --2- 172.21.15.38:0/4280710332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea24003970 0x7fea38155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:18.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.340+0000 7fea3fcc7640 1 -- 172.21.15.38:0/4280710332 >> 172.21.15.38:0/4280710332 conn(0x7fea380cfea0 msgr2=0x7fea380d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:18.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.341+0000 7fea3fcc7640 1 -- 172.21.15.38:0/4280710332 shutdown_connections 2023-12-22T08:48:18.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:18.341+0000 7fea3fcc7640 1 -- 172.21.15.38:0/4280710332 wait complete. 2023-12-22T08:48:18.360 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-22T08:48:18.369 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:48:18.413 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:48:18.602 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":7716,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":28.258006717000001,"mdsmap_epoch":62,"osdmap_epoch":145,"osdmap_epoch_barrier":144,"uptime":34.070859040000002} 2023-12-22T08:48:18.602 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 7716, "mdsmap_epoch": 62, "osdmap_epoch": 145, "osdmap_epoch_barrier": 144, "rank_uptime": 28.258006717, "state": "up:active", "uptime": 34.07085904, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:48:18.602 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-22T08:48:18.603 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:48:18.603 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:18.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:18.659 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-22T08:48:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records in 2023-12-22T08:48:19.074 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records out 2023-12-22T08:48:19.074 INFO:teuthology.orchestra.run.smithi038.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.357708 s, 147 MB/s 2023-12-22T08:48:19.075 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:48:19.075 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:48:19.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:48:19.298 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:48:19.298 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:48:19.299 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:19.363 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:48:19.363 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:19.420 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:48:19.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.650+0000 7f5b7f59e640 1 Processor -- start 2023-12-22T08:48:19.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.650+0000 7f5b7f59e640 1 -- start start 2023-12-22T08:48:19.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.651+0000 7f5b7f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b800a44a0 0x7f5b800708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:19.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.651+0000 7f5b7f59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b800cdae0 con 0x7f5b8015b420 2023-12-22T08:48:19.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.651+0000 7f5b7f59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b80071260 con 0x7f5b80070e30 2023-12-22T08:48:19.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.651+0000 7f5b7f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8015b800 con 0x7f5b800a44a0 2023-12-22T08:48:19.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.652+0000 7f5b7e59c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5b8015b420 0x7f5b8006d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51930/0 (socket says 172.21.15.38:51930) 2023-12-22T08:48:19.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.652+0000 7f5b7e59c640 1 -- 172.21.15.38:0/682898726 learned_addr learned my addr 172.21.15.38:0/682898726 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.652+0000 7f5b7dd9b640 1 --2- 172.21.15.38:0/682898726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b800a44a0 0x7f5b800708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.652+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176319133 0 0) 0x7f5b800cdae0 con 0x7f5b8015b420 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.652+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b68003520 con 0x7f5b8015b420 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1128145012 0 0) 0x7f5b68003520 con 0x7f5b8015b420 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b800a44a0 msgr2=0x7f5b800708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7d59a640 1 --2- 172.21.15.38:0/682898726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b800a44a0 0x7f5b800708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 >> v1:172.21.15.89:6789/0 conn(0x7f5b80070e30 legacy=0x7f5b8015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b800cdd30 con 0x7f5b8015b420 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f5b70001670 con 0x7f5b8015b420 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 >> v1:172.21.15.38:6789/0 conn(0x7f5b8015b420 legacy=0x7f5b8006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7d59a640 1 --2- 172.21.15.38:0/682898726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b680039a0 0x7f5b68003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7d59a640 1 --2- 172.21.15.38:0/682898726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b800a44a0 0x7f5b680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7d59a640 1 --2- 172.21.15.38:0/682898726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b68004d00 0x7f5b68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8015b800 con 0x7f5b680039a0 2023-12-22T08:48:19.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6800ba60 con 0x7f5b68004d00 2023-12-22T08:48:19.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6800bc20 con 0x7f5b800a44a0 2023-12-22T08:48:19.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7e59c640 1 --2- 172.21.15.38:0/682898726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b680039a0 0x7f5b68003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:19.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7ed9d640 1 --2- 172.21.15.38:0/682898726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b68004d00 0x7f5b68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:19.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7dd9b640 1 --2- 172.21.15.38:0/682898726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b800a44a0 0x7f5b680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:19.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7e59c640 1 -- 172.21.15.38:0/682898726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b800a44a0 msgr2=0x7f5b680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:19.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7e59c640 1 --2- 172.21.15.38:0/682898726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b800a44a0 0x7f5b680047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:19.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7e59c640 1 -- 172.21.15.38:0/682898726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b68004d00 msgr2=0x7f5b68005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:19.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.653+0000 7f5b7e59c640 1 --2- 172.21.15.38:0/682898726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b68004d00 0x7f5b68005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:19.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.654+0000 7f5b7e59c640 1 -- 172.21.15.38:0/682898726 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b68003520 con 0x7f5b680039a0 2023-12-22T08:48:19.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.655+0000 7f5b7e59c640 1 --2- 172.21.15.38:0/682898726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b680039a0 0x7f5b68003dc0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f5b70001eb0 tx=0x7f5b680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e848388a1b2472 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.655+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70005ad0 con 0x7f5b680039a0 2023-12-22T08:48:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.655+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70005c30 con 0x7f5b680039a0 2023-12-22T08:48:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.655+0000 7f5b7d59a640 1 -- 172.21.15.38:0/682898726 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7002c7c0 con 0x7f5b680039a0 2023-12-22T08:48:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.655+0000 7f5b7f59e640 1 -- 172.21.15.38:0/682898726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b680039a0 msgr2=0x7f5b68003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.655+0000 7f5b7f59e640 1 --2- 172.21.15.38:0/682898726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b680039a0 0x7f5b68003dc0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f5b70001eb0 tx=0x7f5b680057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.655+0000 7f5b7ed9d640 1 -- 172.21.15.38:0/682898726 reap_dead start 2023-12-22T08:48:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.656+0000 7f5b7f59e640 1 -- 172.21.15.38:0/682898726 shutdown_connections 2023-12-22T08:48:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.656+0000 7f5b7f59e640 1 -- 172.21.15.38:0/682898726 >> 172.21.15.38:0/682898726 conn(0x7f5b800b1f70 msgr2=0x7f5b800b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.656+0000 7f5b7f59e640 1 -- 172.21.15.38:0/682898726 shutdown_connections 2023-12-22T08:48:19.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.656+0000 7f5b7f59e640 1 -- 172.21.15.38:0/682898726 wait complete. 2023-12-22T08:48:19.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.657+0000 7f5b7f59e640 1 Processor -- start 2023-12-22T08:48:19.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.658+0000 7f5b7f59e640 1 -- start start 2023-12-22T08:48:19.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b80144e00 0x7f5b801473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:19.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b801478f0 0x7f5b801455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:19.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b80145af0 0x7f5b80145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:19.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7f59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b801451e0 con 0x7f5b801478f0 2023-12-22T08:48:19.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b80156960 con 0x7f5b80144e00 2023-12-22T08:48:19.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b80156c40 con 0x7f5b80145af0 2023-12-22T08:48:19.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b801478f0 0x7f5b801455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:19.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b801478f0 0x7f5b801455b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35136/0 (socket says 172.21.15.38:35136) 2023-12-22T08:48:19.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7dd9b640 1 -- 172.21.15.38:0/3380459604 learned_addr learned my addr 172.21.15.38:0/3380459604 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:19.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7e59c640 1 --2- 172.21.15.38:0/3380459604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b80144e00 0x7f5b801473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:19.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7dd9b640 1 -- 172.21.15.38:0/3380459604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b80145af0 msgr2=0x7f5b80145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:19.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7dd9b640 1 --2- 172.21.15.38:0/3380459604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b80145af0 0x7f5b80145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:19.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7dd9b640 1 -- 172.21.15.38:0/3380459604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b80144e00 msgr2=0x7f5b801473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:19.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7dd9b640 1 --2- 172.21.15.38:0/3380459604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b80144e00 0x7f5b801473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:19.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.659+0000 7f5b7dd9b640 1 -- 172.21.15.38:0/3380459604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b80156f20 con 0x7f5b801478f0 2023-12-22T08:48:19.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.660+0000 7f5b7dd9b640 1 --2- 172.21.15.38:0/3380459604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b801478f0 0x7f5b801455b0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f5b74010860 tx=0x7f5b74010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:19.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.663+0000 7f5b6effd640 1 -- 172.21.15.38:0/3380459604 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74009610 con 0x7f5b801478f0 2023-12-22T08:48:19.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.664+0000 7f5b6effd640 1 -- 172.21.15.38:0/3380459604 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7400eb60 con 0x7f5b801478f0 2023-12-22T08:48:19.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.664+0000 7f5b6effd640 1 -- 172.21.15.38:0/3380459604 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7401c400 con 0x7f5b801478f0 2023-12-22T08:48:19.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.664+0000 7f5b7f59e640 1 -- 172.21.15.38:0/3380459604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b80157200 con 0x7f5b801478f0 2023-12-22T08:48:19.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.664+0000 7f5b7f59e640 1 -- 172.21.15.38:0/3380459604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b80147d50 con 0x7f5b801478f0 2023-12-22T08:48:19.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.665+0000 7f5b7f59e640 1 -- 172.21.15.38:0/3380459604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b80061910 con 0x7f5b801478f0 2023-12-22T08:48:19.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.666+0000 7f5b6effd640 1 -- 172.21.15.38:0/3380459604 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5b7401c560 con 0x7f5b801478f0 2023-12-22T08:48:19.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.667+0000 7f5b6effd640 1 --2- 172.21.15.38:0/3380459604 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b6006a480 0x7f5b6006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:19.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.667+0000 7f5b6effd640 1 -- 172.21.15.38:0/3380459604 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b74088e80 con 0x7f5b801478f0 2023-12-22T08:48:19.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.667+0000 7f5b7e59c640 1 --2- 172.21.15.38:0/3380459604 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b6006a480 0x7f5b6006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:19.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.668+0000 7f5b7e59c640 1 --2- 172.21.15.38:0/3380459604 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b6006a480 0x7f5b6006c940 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5b70034000 tx=0x7f5b70009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:19.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.671+0000 7f5b6effd640 1 -- 172.21.15.38:0/3380459604 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5b74054470 con 0x7f5b801478f0 2023-12-22T08:48:19.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.868+0000 7f5b7f59e640 1 -- 172.21.15.38:0/3380459604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b800cb5c0 con 0x7f5b801478f0 2023-12-22T08:48:19.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.869+0000 7f5b6effd640 1 -- 172.21.15.38:0/3380459604 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+16075 (secure 0 0 0) 0x7f5b74057a90 con 0x7f5b801478f0 2023-12-22T08:48:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:19.870 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":145,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:48:16.278594+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:48.219096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:49.341846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:48:19.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.872+0000 7f5b7f59e640 1 -- 172.21.15.38:0/3380459604 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b6006a480 msgr2=0x7f5b6006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:19.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.872+0000 7f5b7f59e640 1 --2- 172.21.15.38:0/3380459604 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b6006a480 0x7f5b6006c940 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5b70034000 tx=0x7f5b70009030 comp rx=0 tx=0).stop 2023-12-22T08:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.872+0000 7f5b7f59e640 1 -- 172.21.15.38:0/3380459604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b801478f0 msgr2=0x7f5b801455b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.872+0000 7f5b7f59e640 1 --2- 172.21.15.38:0/3380459604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b801478f0 0x7f5b801455b0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f5b74010860 tx=0x7f5b74010d20 comp rx=0 tx=0).stop 2023-12-22T08:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.872+0000 7f5b7f59e640 1 -- 172.21.15.38:0/3380459604 shutdown_connections 2023-12-22T08:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.872+0000 7f5b7f59e640 1 --2- 172.21.15.38:0/3380459604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b80145af0 0x7f5b80145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.872+0000 7f5b7f59e640 1 --2- 172.21.15.38:0/3380459604 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b6006a480 0x7f5b6006c940 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.872+0000 7f5b7f59e640 1 --2- 172.21.15.38:0/3380459604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b801478f0 0x7f5b801455b0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.872+0000 7f5b7f59e640 1 --2- 172.21.15.38:0/3380459604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b80144e00 0x7f5b801473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.872+0000 7f5b7f59e640 1 -- 172.21.15.38:0/3380459604 >> 172.21.15.38:0/3380459604 conn(0x7f5b800b1f70 msgr2=0x7f5b8015d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.872+0000 7f5b7f59e640 1 -- 172.21.15.38:0/3380459604 shutdown_connections 2023-12-22T08:48:19.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:19.872+0000 7f5b7f59e640 1 -- 172.21.15.38:0/3380459604 wait complete. 2023-12-22T08:48:19.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:47:48.219096+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:47:49.341846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:48:19.893 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:48:20.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.121+0000 7f164d994640 1 Processor -- start 2023-12-22T08:48:20.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.122+0000 7f164d994640 1 -- start start 2023-12-22T08:48:20.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.123+0000 7f164d994640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f164815d1c0 0x7f1648070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:20.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.124+0000 7f164d994640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f164815d5a0 0x7f1648070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:20.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.124+0000 7f164d994640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164815de50 con 0x7f16480d0060 2023-12-22T08:48:20.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.124+0000 7f164d994640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16480d0be0 con 0x7f164815d5a0 2023-12-22T08:48:20.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.124+0000 7f164d994640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16480d0dd0 con 0x7f164815d1c0 2023-12-22T08:48:20.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.124+0000 7f163ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f164815d5a0 0x7f1648070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:20.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.124+0000 7f163ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f164815d5a0 0x7f1648070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35150/0 (socket says 172.21.15.38:35150) 2023-12-22T08:48:20.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.124+0000 7f163ffff640 1 -- 172.21.15.38:0/263602196 learned_addr learned my addr 172.21.15.38:0/263602196 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:20.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.124+0000 7f164c992640 1 --2- 172.21.15.38:0/263602196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f164815d1c0 0x7f1648070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:20.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.124+0000 7f163ffff640 1 -- 172.21.15.38:0/263602196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f164815d1c0 msgr2=0x7f1648070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:20.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.124+0000 7f163ffff640 1 --2- 172.21.15.38:0/263602196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f164815d1c0 0x7f1648070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.124+0000 7f163ffff640 1 -- 172.21.15.38:0/263602196 >> v1:172.21.15.89:6789/0 conn(0x7f16480d0060 legacy=0x7f16480d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:20.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.125+0000 7f163ffff640 1 -- 172.21.15.38:0/263602196 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480d10b0 con 0x7f164815d5a0 2023-12-22T08:48:20.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.125+0000 7f164c992640 1 --2- 172.21.15.38:0/263602196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f164815d1c0 0x7f1648070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:20.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.126+0000 7f163ffff640 1 --2- 172.21.15.38:0/263602196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f164815d5a0 0x7f1648070eb0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f1638009870 tx=0x7f163802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4a815e03bcdcd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:20.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.126+0000 7f163f7fe640 1 -- 172.21.15.38:0/263602196 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638031640 con 0x7f164815d5a0 2023-12-22T08:48:20.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.126+0000 7f163f7fe640 1 -- 172.21.15.38:0/263602196 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16380317a0 con 0x7f164815d5a0 2023-12-22T08:48:20.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.126+0000 7f163f7fe640 1 -- 172.21.15.38:0/263602196 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638031b30 con 0x7f164815d5a0 2023-12-22T08:48:20.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.127+0000 7f164d994640 1 -- 172.21.15.38:0/263602196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f164815d5a0 msgr2=0x7f1648070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:20.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.127+0000 7f164d994640 1 --2- 172.21.15.38:0/263602196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f164815d5a0 0x7f1648070eb0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f1638009870 tx=0x7f163802b8f0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.127+0000 7f164d994640 1 -- 172.21.15.38:0/263602196 shutdown_connections 2023-12-22T08:48:20.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.127+0000 7f164d994640 1 --2- 172.21.15.38:0/263602196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f164815d5a0 0x7f1648070eb0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.127+0000 7f164d994640 1 --2- 172.21.15.38:0/263602196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f164815d1c0 0x7f1648070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.127+0000 7f164d994640 1 -- 172.21.15.38:0/263602196 >> 172.21.15.38:0/263602196 conn(0x7f164806bf90 msgr2=0x7f164806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:20.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.127+0000 7f164d994640 1 -- 172.21.15.38:0/263602196 shutdown_connections 2023-12-22T08:48:20.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.127+0000 7f164d994640 1 -- 172.21.15.38:0/263602196 wait complete. 2023-12-22T08:48:20.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.129+0000 7f164d994640 1 Processor -- start 2023-12-22T08:48:20.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.129+0000 7f164d994640 1 -- start start 2023-12-22T08:48:20.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.130+0000 7f164d994640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480d0060 0x7f164815f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:20.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.130+0000 7f164d994640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f164815d1c0 0x7f1648152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:20.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.130+0000 7f164d994640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f164815d5a0 0x7f1648155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:20.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.130+0000 7f164d994640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1648151910 con 0x7f164815d1c0 2023-12-22T08:48:20.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.130+0000 7f164d994640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1648151290 con 0x7f16480d0060 2023-12-22T08:48:20.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.130+0000 7f164d994640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164815f6c0 con 0x7f164815d5a0 2023-12-22T08:48:20.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.130+0000 7f163ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f164815d1c0 0x7f1648152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:20.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.130+0000 7f163ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f164815d1c0 0x7f1648152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35166/0 (socket says 172.21.15.38:35166) 2023-12-22T08:48:20.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.130+0000 7f163ffff640 1 -- 172.21.15.38:0/1516695485 learned_addr learned my addr 172.21.15.38:0/1516695485 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:20.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.130+0000 7f164c992640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480d0060 0x7f164815f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:20.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.131+0000 7f164d193640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f164815d5a0 0x7f1648155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:20.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.131+0000 7f163ffff640 1 -- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f164815d5a0 msgr2=0x7f1648155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:20.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.131+0000 7f163ffff640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f164815d5a0 0x7f1648155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.131+0000 7f163ffff640 1 -- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480d0060 msgr2=0x7f164815f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:20.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.131+0000 7f163ffff640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480d0060 0x7f164815f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.131+0000 7f163ffff640 1 -- 172.21.15.38:0/1516695485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16380094d0 con 0x7f164815d1c0 2023-12-22T08:48:20.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.131+0000 7f164d193640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f164815d5a0 0x7f1648155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:20.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.131+0000 7f163ffff640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f164815d1c0 0x7f1648152d20 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1638000c00 tx=0x7f16380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:20.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.131+0000 7f163d7fa640 1 -- 172.21.15.38:0/1516695485 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163803ac60 con 0x7f164815d1c0 2023-12-22T08:48:20.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.132+0000 7f163d7fa640 1 -- 172.21.15.38:0/1516695485 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163803ade0 con 0x7f164815d1c0 2023-12-22T08:48:20.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.132+0000 7f163d7fa640 1 -- 172.21.15.38:0/1516695485 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638044630 con 0x7f164815d1c0 2023-12-22T08:48:20.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.132+0000 7f164d994640 1 -- 172.21.15.38:0/1516695485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1648151530 con 0x7f164815d1c0 2023-12-22T08:48:20.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.132+0000 7f164d994640 1 -- 172.21.15.38:0/1516695485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1648155c80 con 0x7f164815d1c0 2023-12-22T08:48:20.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.133+0000 7f164d994640 1 -- 172.21.15.38:0/1516695485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1648151a50 con 0x7f164815d1c0 2023-12-22T08:48:20.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.134+0000 7f163d7fa640 1 -- 172.21.15.38:0/1516695485 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f163802f050 con 0x7f164815d1c0 2023-12-22T08:48:20.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.135+0000 7f163d7fa640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f163406a430 0x7f163406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:20.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.135+0000 7f163d7fa640 1 -- 172.21.15.38:0/1516695485 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16380aaa30 con 0x7f164815d1c0 2023-12-22T08:48:20.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.135+0000 7f164c992640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f163406a430 0x7f163406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:20.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.136+0000 7f164c992640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f163406a430 0x7f163406c8f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f16440075b0 tx=0x7f1644007540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:20.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.139+0000 7f163d7fa640 1 -- 172.21.15.38:0/1516695485 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1648151a50 con 0x7f164815d1c0 2023-12-22T08:48:20.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.332+0000 7f164d994640 1 -- 172.21.15.38:0/1516695485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1648151a50 con 0x7f164815d1c0 2023-12-22T08:48:20.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.333+0000 7f163d7fa640 1 -- 172.21.15.38:0/1516695485 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1648151a50 con 0x7f164815d1c0 2023-12-22T08:48:20.333 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:48:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.336+0000 7f164d994640 1 -- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f163406a430 msgr2=0x7f163406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.336+0000 7f164d994640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f163406a430 0x7f163406c8f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f16440075b0 tx=0x7f1644007540 comp rx=0 tx=0).stop 2023-12-22T08:48:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.336+0000 7f164d994640 1 -- 172.21.15.38:0/1516695485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f164815d1c0 msgr2=0x7f1648152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.336+0000 7f164d994640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f164815d1c0 0x7f1648152d20 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1638000c00 tx=0x7f16380046c0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.336+0000 7f164d994640 1 -- 172.21.15.38:0/1516695485 shutdown_connections 2023-12-22T08:48:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.336+0000 7f164d994640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f164815d5a0 0x7f1648155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.336+0000 7f164d994640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f163406a430 0x7f163406c8f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.336+0000 7f164d994640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f164815d1c0 0x7f1648152d20 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.336+0000 7f164d994640 1 --2- 172.21.15.38:0/1516695485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480d0060 0x7f164815f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.336+0000 7f164d994640 1 -- 172.21.15.38:0/1516695485 >> 172.21.15.38:0/1516695485 conn(0x7f164806bf90 msgr2=0x7f16480709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.336+0000 7f164d994640 1 -- 172.21.15.38:0/1516695485 shutdown_connections 2023-12-22T08:48:20.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.336+0000 7f164d994640 1 -- 172.21.15.38:0/1516695485 wait complete. 2023-12-22T08:48:20.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:48:20.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.588+0000 7f188e147640 1 Processor -- start 2023-12-22T08:48:20.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.588+0000 7f188e147640 1 -- start start 2023-12-22T08:48:20.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.589+0000 7f188e147640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1888071b90 0x7f1888070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:20.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.589+0000 7f188e147640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1888154b80 0x7f18880ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:20.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.589+0000 7f188e147640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18880716a0 con 0x7f18881547a0 2023-12-22T08:48:20.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.589+0000 7f188e147640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18880710e0 con 0x7f1888154b80 2023-12-22T08:48:20.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.589+0000 7f188e147640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18880713c0 con 0x7f1888071b90 2023-12-22T08:48:20.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.590+0000 7f1887fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1888154b80 0x7f18880ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:20.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.590+0000 7f1887fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1888154b80 0x7f18880ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35172/0 (socket says 172.21.15.38:35172) 2023-12-22T08:48:20.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.590+0000 7f1887fff640 1 -- 172.21.15.38:0/1926140433 learned_addr learned my addr 172.21.15.38:0/1926140433 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:20.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.590+0000 7f1886ffd640 1 --2- 172.21.15.38:0/1926140433 >> v2:172.21.15.89:3300/0 conn(0x7f1888071b90 0x7f1888070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:20.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.590+0000 7f1887fff640 1 -- 172.21.15.38:0/1926140433 >> v2:172.21.15.89:3300/0 conn(0x7f1888071b90 msgr2=0x7f1888070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:20.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.590+0000 7f1887fff640 1 --2- 172.21.15.38:0/1926140433 >> v2:172.21.15.89:3300/0 conn(0x7f1888071b90 0x7f1888070770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.590+0000 7f1887fff640 1 -- 172.21.15.38:0/1926140433 >> v1:172.21.15.89:6789/0 conn(0x7f18881547a0 legacy=0x7f188815b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:20.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.590+0000 7f1887fff640 1 -- 172.21.15.38:0/1926140433 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188815ab00 con 0x7f1888154b80 2023-12-22T08:48:20.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.590+0000 7f1886ffd640 1 --2- 172.21.15.38:0/1926140433 >> v2:172.21.15.89:3300/0 conn(0x7f1888071b90 0x7f1888070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:20.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.591+0000 7f1887fff640 1 --2- 172.21.15.38:0/1926140433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888154b80 0x7f18880ce390 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f18880722d0 tx=0x7f188002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0642f54c19535 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:20.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.592+0000 7f18867fc640 1 -- 172.21.15.38:0/1926140433 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188002ca80 con 0x7f1888154b80 2023-12-22T08:48:20.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.592+0000 7f18867fc640 1 -- 172.21.15.38:0/1926140433 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188002cbe0 con 0x7f1888154b80 2023-12-22T08:48:20.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.592+0000 7f18867fc640 1 -- 172.21.15.38:0/1926140433 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18800343f0 con 0x7f1888154b80 2023-12-22T08:48:20.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.592+0000 7f188e147640 1 -- 172.21.15.38:0/1926140433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888154b80 msgr2=0x7f18880ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:20.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.592+0000 7f188e147640 1 --2- 172.21.15.38:0/1926140433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888154b80 0x7f18880ce390 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f18880722d0 tx=0x7f188002bee0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.592+0000 7f188e147640 1 -- 172.21.15.38:0/1926140433 shutdown_connections 2023-12-22T08:48:20.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.592+0000 7f188e147640 1 --2- 172.21.15.38:0/1926140433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888154b80 0x7f18880ce390 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.592+0000 7f188e147640 1 --2- 172.21.15.38:0/1926140433 >> v2:172.21.15.89:3300/0 conn(0x7f1888071b90 0x7f1888070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.592+0000 7f188e147640 1 -- 172.21.15.38:0/1926140433 >> 172.21.15.38:0/1926140433 conn(0x7f18880cf070 msgr2=0x7f18880cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:20.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.593+0000 7f188e147640 1 -- 172.21.15.38:0/1926140433 shutdown_connections 2023-12-22T08:48:20.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.593+0000 7f188e147640 1 -- 172.21.15.38:0/1926140433 wait complete. 2023-12-22T08:48:20.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.594+0000 7f188e147640 1 Processor -- start 2023-12-22T08:48:20.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.594+0000 7f188e147640 1 -- start start 2023-12-22T08:48:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.595+0000 7f188e147640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1888071b90 0x7f1888152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.595+0000 7f188e147640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18881547a0 0x7f18881532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.595+0000 7f188e147640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888154b80 0x7f1888167280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:20.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.595+0000 7f188e147640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18880b1bd0 con 0x7f1888154b80 2023-12-22T08:48:20.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.595+0000 7f188e147640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18880b0c70 con 0x7f18881547a0 2023-12-22T08:48:20.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.595+0000 7f188e147640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18880b0f50 con 0x7f1888071b90 2023-12-22T08:48:20.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.596+0000 7f1887fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888154b80 0x7f1888167280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:20.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.596+0000 7f1887fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888154b80 0x7f1888167280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35184/0 (socket says 172.21.15.38:35184) 2023-12-22T08:48:20.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.596+0000 7f1887fff640 1 -- 172.21.15.38:0/387853920 learned_addr learned my addr 172.21.15.38:0/387853920 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:20.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.596+0000 7f18877fe640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1888071b90 0x7f1888152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:20.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.596+0000 7f1886ffd640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18881547a0 0x7f18881532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.596+0000 7f1887fff640 1 -- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1888071b90 msgr2=0x7f1888152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.596+0000 7f1887fff640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1888071b90 0x7f1888152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.596+0000 7f1887fff640 1 -- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18881547a0 msgr2=0x7f18881532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.596+0000 7f1887fff640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18881547a0 0x7f18881532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.596+0000 7f1887fff640 1 -- 172.21.15.38:0/387853920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1880009b30 con 0x7f1888154b80 2023-12-22T08:48:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.596+0000 7f18877fe640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1888071b90 0x7f1888152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.597+0000 7f1887fff640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888154b80 0x7f1888167280 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f1880036040 tx=0x7f1880004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.597+0000 7f186ffff640 1 -- 172.21.15.38:0/387853920 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188003e450 con 0x7f1888154b80 2023-12-22T08:48:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.597+0000 7f186ffff640 1 -- 172.21.15.38:0/387853920 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188003e5d0 con 0x7f1888154b80 2023-12-22T08:48:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.597+0000 7f186ffff640 1 -- 172.21.15.38:0/387853920 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188003e980 con 0x7f1888154b80 2023-12-22T08:48:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.597+0000 7f188e147640 1 -- 172.21.15.38:0/387853920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18880b1230 con 0x7f1888154b80 2023-12-22T08:48:20.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.597+0000 7f188e147640 1 -- 172.21.15.38:0/387853920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18880b17f0 con 0x7f1888154b80 2023-12-22T08:48:20.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.598+0000 7f188e147640 1 -- 172.21.15.38:0/387853920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18880b19b0 con 0x7f1888154b80 2023-12-22T08:48:20.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.599+0000 7f186ffff640 1 -- 172.21.15.38:0/387853920 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f188002cd50 con 0x7f1888154b80 2023-12-22T08:48:20.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.600+0000 7f186ffff640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f187406a460 0x7f187406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:20.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.600+0000 7f186ffff640 1 -- 172.21.15.38:0/387853920 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18800ab2e0 con 0x7f1888154b80 2023-12-22T08:48:20.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.601+0000 7f18877fe640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f187406a460 0x7f187406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:20.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.602+0000 7f18877fe640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f187406a460 0x7f187406c920 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1878003eb0 tx=0x7f1878009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:20.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.604+0000 7f186ffff640 1 -- 172.21.15.38:0/387853920 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1880076830 con 0x7f1888154b80 2023-12-22T08:48:20.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.804+0000 7f188e147640 1 -- 172.21.15.38:0/387853920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18880b1d10 con 0x7f1888154b80 2023-12-22T08:48:20.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.805+0000 7f186ffff640 1 -- 172.21.15.38:0/387853920 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v145) v1 ==== 104+0+11 (secure 0 0 0) 0x7f18880b1d10 con 0x7f1888154b80 2023-12-22T08:48:20.806 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:48:20.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.808+0000 7f188e147640 1 -- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f187406a460 msgr2=0x7f187406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:20.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.808+0000 7f188e147640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f187406a460 0x7f187406c920 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1878003eb0 tx=0x7f1878009040 comp rx=0 tx=0).stop 2023-12-22T08:48:20.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.808+0000 7f188e147640 1 -- 172.21.15.38:0/387853920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888154b80 msgr2=0x7f1888167280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:20.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.808+0000 7f188e147640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888154b80 0x7f1888167280 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f1880036040 tx=0x7f1880004a40 comp rx=0 tx=0).stop 2023-12-22T08:48:20.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.808+0000 7f188e147640 1 -- 172.21.15.38:0/387853920 shutdown_connections 2023-12-22T08:48:20.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.808+0000 7f188e147640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f187406a460 0x7f187406c920 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.808+0000 7f188e147640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1888154b80 0x7f1888167280 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.808+0000 7f188e147640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18881547a0 0x7f18881532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.808+0000 7f188e147640 1 --2- 172.21.15.38:0/387853920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1888071b90 0x7f1888152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:20.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.808+0000 7f188e147640 1 -- 172.21.15.38:0/387853920 >> 172.21.15.38:0/387853920 conn(0x7f18880cf070 msgr2=0x7f188815b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:20.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.808+0000 7f188e147640 1 -- 172.21.15.38:0/387853920 shutdown_connections 2023-12-22T08:48:20.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:20.808+0000 7f188e147640 1 -- 172.21.15.38:0/387853920 wait complete. 2023-12-22T08:48:20.829 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:48:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.063+0000 7fc92b155640 1 Processor -- start 2023-12-22T08:48:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.063+0000 7fc92b155640 1 -- start start 2023-12-22T08:48:21.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.065+0000 7fc92b155640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc92415d4b0 0x7fc924071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.065+0000 7fc92b155640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc924072190 con 0x7fc9240b9110 2023-12-22T08:48:21.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.065+0000 7fc92b155640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92406d6c0 con 0x7fc924071cc0 2023-12-22T08:48:21.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.065+0000 7fc92b155640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92406d9a0 con 0x7fc92415d4b0 2023-12-22T08:48:21.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.065+0000 7fc9296f2640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc9240b9110 0x7fc92415d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57724/0 (socket says 172.21.15.38:57724) 2023-12-22T08:48:21.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.065+0000 7fc9296f2640 1 -- 172.21.15.38:0/4147022187 learned_addr learned my addr 172.21.15.38:0/4147022187 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:21.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc928ef1640 1 --2- 172.21.15.38:0/4147022187 >> v2:172.21.15.89:3300/0 conn(0x7fc92415d4b0 0x7fc924071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:21.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916649117 0 0) 0x7fc924072190 con 0x7fc9240b9110 2023-12-22T08:48:21.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc90c003520 con 0x7fc9240b9110 2023-12-22T08:48:21.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 971134762 0 0) 0x7fc90c003520 con 0x7fc9240b9110 2023-12-22T08:48:21.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 >> v2:172.21.15.89:3300/0 conn(0x7fc92415d4b0 msgr2=0x7fc924071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:21.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 --2- 172.21.15.38:0/4147022187 >> v2:172.21.15.89:3300/0 conn(0x7fc92415d4b0 0x7fc924071780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 >> v1:172.21.15.89:6789/0 conn(0x7fc924071cc0 legacy=0x7fc9240b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:21.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92406dc80 con 0x7fc9240b9110 2023-12-22T08:48:21.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fc91c0019f0 con 0x7fc9240b9110 2023-12-22T08:48:21.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 >> v1:172.21.15.38:6789/0 conn(0x7fc9240b9110 legacy=0x7fc92415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:21.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 --2- 172.21.15.38:0/4147022187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc90c003970 0x7fc90c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 --2- 172.21.15.38:0/4147022187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc90c0047c0 0x7fc90c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 --2- 172.21.15.38:0/4147022187 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc90c005180 0x7fc90c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92406d9a0 con 0x7fc90c003970 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c00c020 con 0x7fc90c0047c0 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.066+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c00c1e0 con 0x7fc90c005180 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.067+0000 7fc928ef1640 1 --2- 172.21.15.38:0/4147022187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc90c003970 0x7fc90c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.067+0000 7fc9296f2640 1 --2- 172.21.15.38:0/4147022187 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc90c005180 0x7fc90c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.067+0000 7fc928ef1640 1 -- 172.21.15.38:0/4147022187 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc90c005180 msgr2=0x7fc90c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.067+0000 7fc928ef1640 1 --2- 172.21.15.38:0/4147022187 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc90c005180 0x7fc90c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.067+0000 7fc928ef1640 1 -- 172.21.15.38:0/4147022187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc90c0047c0 msgr2=0x7fc90c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.067+0000 7fc928ef1640 1 --2- 172.21.15.38:0/4147022187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc90c0047c0 0x7fc90c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.067+0000 7fc928ef1640 1 -- 172.21.15.38:0/4147022187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c003520 con 0x7fc90c003970 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.067+0000 7fc9296f2640 1 --2- 172.21.15.38:0/4147022187 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc90c005180 0x7fc90c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.067+0000 7fc9296f2640 1 -- 172.21.15.38:0/4147022187 reap_dead start 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.068+0000 7fc928ef1640 1 --2- 172.21.15.38:0/4147022187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc90c003970 0x7fc90c003d90 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fc920009ac0 tx=0x7fc90c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b433b88691256e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:21.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.069+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92002c6b0 con 0x7fc90c003970 2023-12-22T08:48:21.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.069+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92002c810 con 0x7fc90c003970 2023-12-22T08:48:21.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.069+0000 7fc91b7fe640 1 -- 172.21.15.38:0/4147022187 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92002cba0 con 0x7fc90c003970 2023-12-22T08:48:21.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.069+0000 7fc92b155640 1 -- 172.21.15.38:0/4147022187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc90c003970 msgr2=0x7fc90c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:21.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.069+0000 7fc92b155640 1 --2- 172.21.15.38:0/4147022187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc90c003970 0x7fc90c003d90 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fc920009ac0 tx=0x7fc90c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.069+0000 7fc92b155640 1 -- 172.21.15.38:0/4147022187 shutdown_connections 2023-12-22T08:48:21.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.069+0000 7fc92b155640 1 --2- 172.21.15.38:0/4147022187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc90c003970 0x7fc90c003d90 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.069+0000 7fc92b155640 1 -- 172.21.15.38:0/4147022187 >> 172.21.15.38:0/4147022187 conn(0x7fc92406f250 msgr2=0x7fc92406f630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:21.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.069+0000 7fc92b155640 1 -- 172.21.15.38:0/4147022187 shutdown_connections 2023-12-22T08:48:21.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.070+0000 7fc92b155640 1 -- 172.21.15.38:0/4147022187 wait complete. 2023-12-22T08:48:21.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.071+0000 7fc92b155640 1 Processor -- start 2023-12-22T08:48:21.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.071+0000 7fc92b155640 1 -- start start 2023-12-22T08:48:21.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.072+0000 7fc92b155640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc90c003970 0x7fc924146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.072+0000 7fc92b155640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc92414c390 0x7fc9240b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.072+0000 7fc92b155640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc924147fa0 0x7fc92415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.072+0000 7fc92b155640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc924147b10 con 0x7fc90c003970 2023-12-22T08:48:21.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.072+0000 7fc92b155640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92414cc30 con 0x7fc92414c390 2023-12-22T08:48:21.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.072+0000 7fc92b155640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc924146f00 con 0x7fc924147fa0 2023-12-22T08:48:21.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.073+0000 7fc928ef1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc90c003970 0x7fc924146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:21.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.073+0000 7fc928ef1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc90c003970 0x7fc924146840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47590/0 (socket says 172.21.15.38:47590) 2023-12-22T08:48:21.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.073+0000 7fc928ef1640 1 -- 172.21.15.38:0/699202556 learned_addr learned my addr 172.21.15.38:0/699202556 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:21.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.073+0000 7fc9296f2640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc924147fa0 0x7fc92415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:21.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.073+0000 7fc91bfff640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc92414c390 0x7fc9240b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:21.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.073+0000 7fc928ef1640 1 -- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc924147fa0 msgr2=0x7fc92415b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:21.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.073+0000 7fc928ef1640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc924147fa0 0x7fc92415b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.073+0000 7fc928ef1640 1 -- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc92414c390 msgr2=0x7fc9240b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:21.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.073+0000 7fc928ef1640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc92414c390 0x7fc9240b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.073+0000 7fc928ef1640 1 -- 172.21.15.38:0/699202556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9241471e0 con 0x7fc90c003970 2023-12-22T08:48:21.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.073+0000 7fc91bfff640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc92414c390 0x7fc9240b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:21.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.073+0000 7fc928ef1640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc90c003970 0x7fc924146840 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fc920037040 tx=0x7fc920004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:21.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.074+0000 7fc9197fa640 1 -- 172.21.15.38:0/699202556 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920003810 con 0x7fc90c003970 2023-12-22T08:48:21.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.074+0000 7fc9197fa640 1 -- 172.21.15.38:0/699202556 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc920003970 con 0x7fc90c003970 2023-12-22T08:48:21.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.074+0000 7fc9197fa640 1 -- 172.21.15.38:0/699202556 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920003d00 con 0x7fc90c003970 2023-12-22T08:48:21.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.074+0000 7fc92b155640 1 -- 172.21.15.38:0/699202556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9241474c0 con 0x7fc90c003970 2023-12-22T08:48:21.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.074+0000 7fc92b155640 1 -- 172.21.15.38:0/699202556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9240b27a0 con 0x7fc90c003970 2023-12-22T08:48:21.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.075+0000 7fc92b155640 1 -- 172.21.15.38:0/699202556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc924061910 con 0x7fc90c003970 2023-12-22T08:48:21.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.076+0000 7fc9197fa640 1 -- 172.21.15.38:0/699202556 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc920034440 con 0x7fc90c003970 2023-12-22T08:48:21.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.077+0000 7fc9197fa640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc91006a430 0x7fc91006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.077+0000 7fc9197fa640 1 -- 172.21.15.38:0/699202556 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9200aac00 con 0x7fc90c003970 2023-12-22T08:48:21.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.078+0000 7fc91bfff640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc91006a430 0x7fc91006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:21.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.079+0000 7fc91bfff640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc91006a430 0x7fc91006c8f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc92414c890 tx=0x7fc914009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:21.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.081+0000 7fc9197fa640 1 -- 172.21.15.38:0/699202556 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc920076200 con 0x7fc90c003970 2023-12-22T08:48:21.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.274+0000 7fc92b155640 1 -- 172.21.15.38:0/699202556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc924070030 con 0x7fc90c003970 2023-12-22T08:48:21.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.275+0000 7fc9197fa640 1 -- 172.21.15.38:0/699202556 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v145) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc92004c0a0 con 0x7fc90c003970 2023-12-22T08:48:21.277 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:48:21.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.278+0000 7fc92b155640 1 -- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc91006a430 msgr2=0x7fc91006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:21.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.278+0000 7fc92b155640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc91006a430 0x7fc91006c8f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc92414c890 tx=0x7fc914009040 comp rx=0 tx=0).stop 2023-12-22T08:48:21.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.278+0000 7fc92b155640 1 -- 172.21.15.38:0/699202556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc90c003970 msgr2=0x7fc924146840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:21.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.278+0000 7fc92b155640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc90c003970 0x7fc924146840 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fc920037040 tx=0x7fc920004730 comp rx=0 tx=0).stop 2023-12-22T08:48:21.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.278+0000 7fc92b155640 1 -- 172.21.15.38:0/699202556 shutdown_connections 2023-12-22T08:48:21.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.278+0000 7fc92b155640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc924147fa0 0x7fc92415b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.278+0000 7fc92b155640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc92414c390 0x7fc9240b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.278+0000 7fc92b155640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc91006a430 0x7fc91006c8f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.278+0000 7fc92b155640 1 --2- 172.21.15.38:0/699202556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc90c003970 0x7fc924146840 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.278+0000 7fc92b155640 1 -- 172.21.15.38:0/699202556 >> 172.21.15.38:0/699202556 conn(0x7fc92406f250 msgr2=0x7fc924158780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:21.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.278+0000 7fc92b155640 1 -- 172.21.15.38:0/699202556 shutdown_connections 2023-12-22T08:48:21.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.278+0000 7fc92b155640 1 -- 172.21.15.38:0/699202556 wait complete. 2023-12-22T08:48:21.303 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:48:21.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.526+0000 7fe1e9e34640 1 Processor -- start 2023-12-22T08:48:21.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.526+0000 7fe1e9e34640 1 -- start start 2023-12-22T08:48:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.528+0000 7fe1e9e34640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe1e4071d80 0x7fe1e40a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.528+0000 7fe1e9e34640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe1e40a35a0 0x7fe1e4161040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.528+0000 7fe1e9e34640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e406c2a0 con 0x7fe1e4161580 2023-12-22T08:48:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.528+0000 7fe1e9e34640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40a44a0 con 0x7fe1e4071d80 2023-12-22T08:48:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.528+0000 7fe1e9e34640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40a3a00 con 0x7fe1e40a35a0 2023-12-22T08:48:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.528+0000 7fe1e8e32640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe1e4071d80 0x7fe1e40a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.528+0000 7fe1e9633640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe1e4161580 0x7fe1e415da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57728/0 (socket says 172.21.15.38:57728) 2023-12-22T08:48:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.528+0000 7fe1e9633640 1 -- 172.21.15.38:0/1086956535 learned_addr learned my addr 172.21.15.38:0/1086956535 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.529+0000 7fe1dbfff640 1 --2- 172.21.15.38:0/1086956535 >> v2:172.21.15.89:3300/0 conn(0x7fe1e40a35a0 0x7fe1e4161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.529+0000 7fe1e8e32640 1 -- 172.21.15.38:0/1086956535 >> v2:172.21.15.89:3300/0 conn(0x7fe1e40a35a0 msgr2=0x7fe1e4161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.529+0000 7fe1e8e32640 1 --2- 172.21.15.38:0/1086956535 >> v2:172.21.15.89:3300/0 conn(0x7fe1e40a35a0 0x7fe1e4161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.529+0000 7fe1e8e32640 1 -- 172.21.15.38:0/1086956535 >> v1:172.21.15.38:6789/0 conn(0x7fe1e4161580 legacy=0x7fe1e415da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.529+0000 7fe1e8e32640 1 -- 172.21.15.38:0/1086956535 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4072160 con 0x7fe1e4071d80 2023-12-22T08:48:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.529+0000 7fe1db7fe640 1 -- 172.21.15.38:0/1086956535 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969766931 0 0) 0x7fe1e406c2a0 con 0x7fe1e4161580 2023-12-22T08:48:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.530+0000 7fe1e8e32640 1 --2- 172.21.15.38:0/1086956535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1e4071d80 0x7fe1e40a3060 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40aeb50 tx=0x7fe1e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bef576a8d3d33 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.530+0000 7fe1db7fe640 1 -- 172.21.15.38:0/1086956535 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0031830 con 0x7fe1e4071d80 2023-12-22T08:48:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.531+0000 7fe1db7fe640 1 -- 172.21.15.38:0/1086956535 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e0031990 con 0x7fe1e4071d80 2023-12-22T08:48:21.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.531+0000 7fe1db7fe640 1 -- 172.21.15.38:0/1086956535 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0031d20 con 0x7fe1e4071d80 2023-12-22T08:48:21.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.531+0000 7fe1e9e34640 1 -- 172.21.15.38:0/1086956535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1e4071d80 msgr2=0x7fe1e40a3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:21.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.531+0000 7fe1e9e34640 1 --2- 172.21.15.38:0/1086956535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1e4071d80 0x7fe1e40a3060 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40aeb50 tx=0x7fe1e002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.531+0000 7fe1e9e34640 1 -- 172.21.15.38:0/1086956535 shutdown_connections 2023-12-22T08:48:21.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.531+0000 7fe1e9e34640 1 --2- 172.21.15.38:0/1086956535 >> v2:172.21.15.89:3300/0 conn(0x7fe1e40a35a0 0x7fe1e4161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.531+0000 7fe1e9e34640 1 --2- 172.21.15.38:0/1086956535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1e4071d80 0x7fe1e40a3060 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.531+0000 7fe1e9e34640 1 -- 172.21.15.38:0/1086956535 >> 172.21.15.38:0/1086956535 conn(0x7fe1e40cf000 msgr2=0x7fe1e40cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:21.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.531+0000 7fe1e9e34640 1 -- 172.21.15.38:0/1086956535 shutdown_connections 2023-12-22T08:48:21.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.531+0000 7fe1e9e34640 1 -- 172.21.15.38:0/1086956535 wait complete. 2023-12-22T08:48:21.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.533+0000 7fe1e9e34640 1 Processor -- start 2023-12-22T08:48:21.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.533+0000 7fe1e9e34640 1 -- start start 2023-12-22T08:48:21.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.534+0000 7fe1e9e34640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e4071d80 0x7fe1e41532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.534+0000 7fe1e9e34640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e40a35a0 0x7fe1e41568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.534+0000 7fe1e9e34640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1e4161580 0x7fe1e4154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.534+0000 7fe1e9e34640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4155830 con 0x7fe1e4161580 2023-12-22T08:48:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.534+0000 7fe1e9e34640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4155b10 con 0x7fe1e4071d80 2023-12-22T08:48:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.534+0000 7fe1e9e34640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4155df0 con 0x7fe1e40a35a0 2023-12-22T08:48:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.535+0000 7fe1e9633640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1e4161580 0x7fe1e4154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.535+0000 7fe1e9633640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1e4161580 0x7fe1e4154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47606/0 (socket says 172.21.15.38:47606) 2023-12-22T08:48:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.535+0000 7fe1e9633640 1 -- 172.21.15.38:0/563064632 learned_addr learned my addr 172.21.15.38:0/563064632 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.535+0000 7fe1e8e32640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e4071d80 0x7fe1e41532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.535+0000 7fe1dbfff640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e40a35a0 0x7fe1e41568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.535+0000 7fe1e9633640 1 -- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e40a35a0 msgr2=0x7fe1e41568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.535+0000 7fe1e9633640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e40a35a0 0x7fe1e41568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.535+0000 7fe1e9633640 1 -- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e4071d80 msgr2=0x7fe1e41532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.535+0000 7fe1e9633640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e4071d80 0x7fe1e41532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.535+0000 7fe1e9633640 1 -- 172.21.15.38:0/563064632 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e0009400 con 0x7fe1e4161580 2023-12-22T08:48:21.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.535+0000 7fe1dbfff640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e40a35a0 0x7fe1e41568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:21.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.536+0000 7fe1e9633640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1e4161580 0x7fe1e4154ec0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00c780 tx=0x7fe1dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:21.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.536+0000 7fe1d97fa640 1 -- 172.21.15.38:0/563064632 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc00ce90 con 0x7fe1e4161580 2023-12-22T08:48:21.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.536+0000 7fe1d97fa640 1 -- 172.21.15.38:0/563064632 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc00a640 con 0x7fe1e4161580 2023-12-22T08:48:21.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.536+0000 7fe1d97fa640 1 -- 172.21.15.38:0/563064632 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc00a9d0 con 0x7fe1e4161580 2023-12-22T08:48:21.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.536+0000 7fe1e9e34640 1 -- 172.21.15.38:0/563064632 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e41560d0 con 0x7fe1e4161580 2023-12-22T08:48:21.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.536+0000 7fe1e9e34640 1 -- 172.21.15.38:0/563064632 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e4153820 con 0x7fe1e4161580 2023-12-22T08:48:21.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.537+0000 7fe1e9e34640 1 -- 172.21.15.38:0/563064632 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e41565f0 con 0x7fe1e4161580 2023-12-22T08:48:21.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.538+0000 7fe1d97fa640 1 -- 172.21.15.38:0/563064632 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe1dc00ab30 con 0x7fe1e4161580 2023-12-22T08:48:21.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.540+0000 7fe1d97fa640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1d006a430 0x7fe1d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:21.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.540+0000 7fe1d97fa640 1 -- 172.21.15.38:0/563064632 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1dc087f30 con 0x7fe1e4161580 2023-12-22T08:48:21.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.541+0000 7fe1e8e32640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1d006a430 0x7fe1d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:21.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.542+0000 7fe1e8e32640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1d006a430 0x7fe1d006c8f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0036000 tx=0x7fe1e003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:21.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.545+0000 7fe1d97fa640 1 -- 172.21.15.38:0/563064632 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe1e41565f0 con 0x7fe1e4161580 2023-12-22T08:48:21.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.752+0000 7fe1e9e34640 1 -- 172.21.15.38:0/563064632 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe1e41565f0 con 0x7fe1e4161580 2023-12-22T08:48:21.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.753+0000 7fe1d97fa640 1 -- 172.21.15.38:0/563064632 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v145) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe1e41565f0 con 0x7fe1e4161580 2023-12-22T08:48:21.754 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:48:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.755+0000 7fe1e9e34640 1 -- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1d006a430 msgr2=0x7fe1d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.755+0000 7fe1e9e34640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1d006a430 0x7fe1d006c8f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0036000 tx=0x7fe1e003c040 comp rx=0 tx=0).stop 2023-12-22T08:48:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.756+0000 7fe1e9e34640 1 -- 172.21.15.38:0/563064632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1e4161580 msgr2=0x7fe1e4154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.756+0000 7fe1e9e34640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1e4161580 0x7fe1e4154ec0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00c780 tx=0x7fe1dc00cc40 comp rx=0 tx=0).stop 2023-12-22T08:48:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.756+0000 7fe1e9e34640 1 -- 172.21.15.38:0/563064632 shutdown_connections 2023-12-22T08:48:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.756+0000 7fe1e9e34640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe1d006a430 0x7fe1d006c8f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.756+0000 7fe1e9e34640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1e4161580 0x7fe1e4154ec0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.756+0000 7fe1e9e34640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1e40a35a0 0x7fe1e41568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.756+0000 7fe1e9e34640 1 --2- 172.21.15.38:0/563064632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1e4071d80 0x7fe1e41532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:21.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.756+0000 7fe1e9e34640 1 -- 172.21.15.38:0/563064632 >> 172.21.15.38:0/563064632 conn(0x7fe1e40cf000 msgr2=0x7fe1e4160dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:21.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.756+0000 7fe1e9e34640 1 -- 172.21.15.38:0/563064632 shutdown_connections 2023-12-22T08:48:21.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:21.756+0000 7fe1e9e34640 1 -- 172.21.15.38:0/563064632 wait complete. 2023-12-22T08:48:21.774 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T08:48:21.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:21.774 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-22T08:48:21.934 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:48:21.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:21.935 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T08:48:21.981 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:48:21.982 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:22.025 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:48:22.025 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:22.122 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:48:22.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.354+0000 7fc48ffff640 1 Processor -- start 2023-12-22T08:48:22.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.354+0000 7fc48ffff640 1 -- start start 2023-12-22T08:48:22.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.356+0000 7fc48ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc4900b52f0 0x7fc4900b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:22.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.356+0000 7fc48ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc490070f80 0x7fc490071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:22.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.356+0000 7fc48ffff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49006f2f0 con 0x7fc49015d380 2023-12-22T08:48:22.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.356+0000 7fc48ffff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc490071970 con 0x7fc4900b52f0 2023-12-22T08:48:22.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.356+0000 7fc48ffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900ae090 con 0x7fc490070f80 2023-12-22T08:48:22.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.357+0000 7fc48f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc490070f80 0x7fc490071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:22.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.357+0000 7fc48f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc490070f80 0x7fc490071430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:59324/0 (socket says 172.21.15.38:59324) 2023-12-22T08:48:22.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.357+0000 7fc48f7fe640 1 -- 172.21.15.38:0/1814572104 learned_addr learned my addr 172.21.15.38:0/1814572104 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:22.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.357+0000 7fc48e7fc640 1 --2- 172.21.15.38:0/1814572104 >> v2:172.21.15.89:3300/0 conn(0x7fc4900b52f0 0x7fc4900b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:22.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.358+0000 7fc48f7fe640 1 -- 172.21.15.38:0/1814572104 >> v2:172.21.15.89:3300/0 conn(0x7fc4900b52f0 msgr2=0x7fc4900b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:22.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.358+0000 7fc48f7fe640 1 --2- 172.21.15.38:0/1814572104 >> v2:172.21.15.89:3300/0 conn(0x7fc4900b52f0 0x7fc4900b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:22.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.358+0000 7fc48f7fe640 1 -- 172.21.15.38:0/1814572104 >> v1:172.21.15.89:6789/0 conn(0x7fc49015d380 legacy=0x7fc4900b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:22.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.358+0000 7fc48f7fe640 1 -- 172.21.15.38:0/1814572104 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4900ae370 con 0x7fc490070f80 2023-12-22T08:48:22.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.360+0000 7fc48f7fe640 1 --2- 172.21.15.38:0/1814572104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc490070f80 0x7fc490071430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc488009e50 tx=0x7fc48802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1217bbde5fff7e07 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:22.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.361+0000 7fc48dffb640 1 -- 172.21.15.38:0/1814572104 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48802cb00 con 0x7fc490070f80 2023-12-22T08:48:22.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.361+0000 7fc48dffb640 1 -- 172.21.15.38:0/1814572104 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48802cc60 con 0x7fc490070f80 2023-12-22T08:48:22.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.361+0000 7fc48dffb640 1 -- 172.21.15.38:0/1814572104 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4880343f0 con 0x7fc490070f80 2023-12-22T08:48:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.362+0000 7fc48ffff640 1 -- 172.21.15.38:0/1814572104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc490070f80 msgr2=0x7fc490071430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.362+0000 7fc48ffff640 1 --2- 172.21.15.38:0/1814572104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc490070f80 0x7fc490071430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc488009e50 tx=0x7fc48802bf60 comp rx=0 tx=0).stop 2023-12-22T08:48:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.362+0000 7fc48ffff640 1 -- 172.21.15.38:0/1814572104 shutdown_connections 2023-12-22T08:48:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.362+0000 7fc48ffff640 1 --2- 172.21.15.38:0/1814572104 >> v2:172.21.15.89:3300/0 conn(0x7fc4900b52f0 0x7fc4900b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.362+0000 7fc48ffff640 1 --2- 172.21.15.38:0/1814572104 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc490070f80 0x7fc490071430 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.362+0000 7fc48ffff640 1 -- 172.21.15.38:0/1814572104 >> 172.21.15.38:0/1814572104 conn(0x7fc4900b1c70 msgr2=0x7fc4900b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.362+0000 7fc48ffff640 1 -- 172.21.15.38:0/1814572104 shutdown_connections 2023-12-22T08:48:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.362+0000 7fc48ffff640 1 -- 172.21.15.38:0/1814572104 wait complete. 2023-12-22T08:48:22.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.364+0000 7fc48ffff640 1 Processor -- start 2023-12-22T08:48:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.364+0000 7fc48ffff640 1 -- start start 2023-12-22T08:48:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.365+0000 7fc48ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc490070f80 0x7fc490147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.365+0000 7fc48ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4900b52f0 0x7fc49015be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.365+0000 7fc48ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49015d380 0x7fc49015fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.365+0000 7fc48ffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc490160cf0 con 0x7fc49015d380 2023-12-22T08:48:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.365+0000 7fc48ffff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49015b3c0 con 0x7fc490070f80 2023-12-22T08:48:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.365+0000 7fc48ffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc490160730 con 0x7fc4900b52f0 2023-12-22T08:48:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.365+0000 7fc48f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49015d380 0x7fc49015fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.365+0000 7fc48f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49015d380 0x7fc49015fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47614/0 (socket says 172.21.15.38:47614) 2023-12-22T08:48:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.365+0000 7fc48f7fe640 1 -- 172.21.15.38:0/719333385 learned_addr learned my addr 172.21.15.38:0/719333385 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.365+0000 7fc48effd640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc490070f80 0x7fc490147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:22.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.365+0000 7fc48e7fc640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4900b52f0 0x7fc49015be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.366+0000 7fc48f7fe640 1 -- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4900b52f0 msgr2=0x7fc49015be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.366+0000 7fc48f7fe640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4900b52f0 0x7fc49015be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.366+0000 7fc48f7fe640 1 -- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc490070f80 msgr2=0x7fc490147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.366+0000 7fc48f7fe640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc490070f80 0x7fc490147820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.366+0000 7fc48f7fe640 1 -- 172.21.15.38:0/719333385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc488009b30 con 0x7fc49015d380 2023-12-22T08:48:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.366+0000 7fc48f7fe640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49015d380 0x7fc49015fbc0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fc488009e50 tx=0x7fc488004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.366+0000 7fc4777fe640 1 -- 172.21.15.38:0/719333385 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488009510 con 0x7fc49015d380 2023-12-22T08:48:22.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.366+0000 7fc4777fe640 1 -- 172.21.15.38:0/719333385 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48803e450 con 0x7fc49015d380 2023-12-22T08:48:22.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.366+0000 7fc48ffff640 1 -- 172.21.15.38:0/719333385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc490160a10 con 0x7fc49015d380 2023-12-22T08:48:22.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.366+0000 7fc4777fe640 1 -- 172.21.15.38:0/719333385 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48803e800 con 0x7fc49015d380 2023-12-22T08:48:22.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.367+0000 7fc48ffff640 1 -- 172.21.15.38:0/719333385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49015b960 con 0x7fc49015d380 2023-12-22T08:48:22.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.368+0000 7fc48ffff640 1 -- 172.21.15.38:0/719333385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc490061910 con 0x7fc49015d380 2023-12-22T08:48:22.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.369+0000 7fc4777fe640 1 -- 172.21.15.38:0/719333385 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc48803e960 con 0x7fc49015d380 2023-12-22T08:48:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.370+0000 7fc4777fe640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc47c06a460 0x7fc47c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.370+0000 7fc4777fe640 1 -- 172.21.15.38:0/719333385 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4880ab610 con 0x7fc49015d380 2023-12-22T08:48:22.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.371+0000 7fc48effd640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc47c06a460 0x7fc47c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:22.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.372+0000 7fc48effd640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc47c06a460 0x7fc47c06c920 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc480000f60 tx=0x7fc480009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:22.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.375+0000 7fc4777fe640 1 -- 172.21.15.38:0/719333385 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc488076c00 con 0x7fc49015d380 2023-12-22T08:48:22.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.570+0000 7fc48ffff640 1 -- 172.21.15.38:0/719333385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc490156130 con 0x7fc49015d380 2023-12-22T08:48:22.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.573+0000 7fc4777fe640 1 -- 172.21.15.38:0/719333385 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+16075 (secure 0 0 0) 0x7fc48807a220 con 0x7fc49015d380 2023-12-22T08:48:22.574 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:22.574 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":145,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:48:16.278594+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:48.219096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:49.341846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:48:22.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.576+0000 7fc48ffff640 1 -- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc47c06a460 msgr2=0x7fc47c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:22.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.576+0000 7fc48ffff640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc47c06a460 0x7fc47c06c920 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc480000f60 tx=0x7fc480009040 comp rx=0 tx=0).stop 2023-12-22T08:48:22.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.576+0000 7fc48ffff640 1 -- 172.21.15.38:0/719333385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49015d380 msgr2=0x7fc49015fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:22.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.576+0000 7fc48ffff640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49015d380 0x7fc49015fbc0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fc488009e50 tx=0x7fc488004a40 comp rx=0 tx=0).stop 2023-12-22T08:48:22.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.576+0000 7fc48ffff640 1 -- 172.21.15.38:0/719333385 shutdown_connections 2023-12-22T08:48:22.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.576+0000 7fc48ffff640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc47c06a460 0x7fc47c06c920 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:22.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.576+0000 7fc48ffff640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc49015d380 0x7fc49015fbc0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:22.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.576+0000 7fc48ffff640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4900b52f0 0x7fc49015be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:22.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.576+0000 7fc48ffff640 1 --2- 172.21.15.38:0/719333385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc490070f80 0x7fc490147820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:22.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.576+0000 7fc48ffff640 1 -- 172.21.15.38:0/719333385 >> 172.21.15.38:0/719333385 conn(0x7fc4900b1c70 msgr2=0x7fc4900b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:22.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.576+0000 7fc48ffff640 1 -- 172.21.15.38:0/719333385 shutdown_connections 2023-12-22T08:48:22.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.576+0000 7fc48ffff640 1 -- 172.21.15.38:0/719333385 wait complete. 2023-12-22T08:48:22.596 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:47:48.219096+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:47:49.341846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:48:22.597 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:48:22.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.824+0000 7fb08a577640 1 Processor -- start 2023-12-22T08:48:22.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.824+0000 7fb08a577640 1 -- start start 2023-12-22T08:48:22.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.826+0000 7fb08a577640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb084163d50 0x7fb084166140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:22.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.826+0000 7fb08a577640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08406d5f0 con 0x7fb084070f50 2023-12-22T08:48:22.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.826+0000 7fb08a577640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb084144fa0 con 0x7fb084070b70 2023-12-22T08:48:22.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.826+0000 7fb08a577640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08406da80 con 0x7fb084163d50 2023-12-22T08:48:22.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.826+0000 7fb088d74640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb084070f50 0x7fb0840713b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57744/0 (socket says 172.21.15.38:57744) 2023-12-22T08:48:22.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.826+0000 7fb088d74640 1 -- 172.21.15.38:0/2716101234 learned_addr learned my addr 172.21.15.38:0/2716101234 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:22.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.827+0000 7fb089d76640 1 --2- 172.21.15.38:0/2716101234 >> v2:172.21.15.38:3300/0 conn(0x7fb084163d50 0x7fb084166140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:22.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.827+0000 7fb07bfff640 1 -- 172.21.15.38:0/2716101234 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772320252 0 0) 0x7fb08406d5f0 con 0x7fb084070f50 2023-12-22T08:48:22.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.827+0000 7fb07bfff640 1 -- 172.21.15.38:0/2716101234 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb070003520 con 0x7fb084070f50 2023-12-22T08:48:22.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.827+0000 7fb089d76640 1 -- 172.21.15.38:0/2716101234 >> v1:172.21.15.89:6789/0 conn(0x7fb084070b70 legacy=0x7fb08406bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:22.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.827+0000 7fb089d76640 1 -- 172.21.15.38:0/2716101234 >> v1:172.21.15.38:6789/0 conn(0x7fb084070f50 legacy=0x7fb0840713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:22.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.827+0000 7fb089d76640 1 -- 172.21.15.38:0/2716101234 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08406c9e0 con 0x7fb084163d50 2023-12-22T08:48:22.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.828+0000 7fb089d76640 1 --2- 172.21.15.38:0/2716101234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb084163d50 0x7fb084166140 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009d90 tx=0x7fb07c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e5468c1b625f68 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:22.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.829+0000 7fb07bfff640 1 -- 172.21.15.38:0/2716101234 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c02cd00 con 0x7fb084163d50 2023-12-22T08:48:22.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.829+0000 7fb07bfff640 1 -- 172.21.15.38:0/2716101234 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c02ce60 con 0x7fb084163d50 2023-12-22T08:48:22.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.829+0000 7fb07bfff640 1 -- 172.21.15.38:0/2716101234 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c034660 con 0x7fb084163d50 2023-12-22T08:48:22.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.829+0000 7fb08a577640 1 -- 172.21.15.38:0/2716101234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb084163d50 msgr2=0x7fb084166140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:22.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.829+0000 7fb08a577640 1 --2- 172.21.15.38:0/2716101234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb084163d50 0x7fb084166140 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009d90 tx=0x7fb07c02bf50 comp rx=0 tx=0).stop 2023-12-22T08:48:22.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.830+0000 7fb08a577640 1 -- 172.21.15.38:0/2716101234 shutdown_connections 2023-12-22T08:48:22.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.830+0000 7fb08a577640 1 --2- 172.21.15.38:0/2716101234 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb084163d50 0x7fb084166140 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:22.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.830+0000 7fb08a577640 1 -- 172.21.15.38:0/2716101234 >> 172.21.15.38:0/2716101234 conn(0x7fb0840b0b60 msgr2=0x7fb0840b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:22.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.830+0000 7fb08a577640 1 -- 172.21.15.38:0/2716101234 shutdown_connections 2023-12-22T08:48:22.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.830+0000 7fb08a577640 1 -- 172.21.15.38:0/2716101234 wait complete. 2023-12-22T08:48:22.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.832+0000 7fb08a577640 1 Processor -- start 2023-12-22T08:48:22.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.832+0000 7fb08a577640 1 -- start start 2023-12-22T08:48:22.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.833+0000 7fb08a577640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb084070b70 0x7fb08409b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:22.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.833+0000 7fb08a577640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb084070f50 0x7fb0840af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.833+0000 7fb08a577640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb084163d50 0x7fb0840af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.833+0000 7fb08a577640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08409c910 con 0x7fb084070f50 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.833+0000 7fb08a577640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08409bd00 con 0x7fb084070b70 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.833+0000 7fb08a577640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08409bfe0 con 0x7fb084163d50 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.834+0000 7fb088d74640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb084070f50 0x7fb0840af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.834+0000 7fb088d74640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb084070f50 0x7fb0840af3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47640/0 (socket says 172.21.15.38:47640) 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.834+0000 7fb088d74640 1 -- 172.21.15.38:0/1942247172 learned_addr learned my addr 172.21.15.38:0/1942247172 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.834+0000 7fb089575640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb084070b70 0x7fb08409b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.834+0000 7fb089d76640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb084163d50 0x7fb0840af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.834+0000 7fb088d74640 1 -- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb084163d50 msgr2=0x7fb0840af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.834+0000 7fb088d74640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb084163d50 0x7fb0840af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.834+0000 7fb088d74640 1 -- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb084070b70 msgr2=0x7fb08409b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.834+0000 7fb088d74640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb084070b70 0x7fb08409b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:22.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.834+0000 7fb088d74640 1 -- 172.21.15.38:0/1942247172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c009a70 con 0x7fb084070f50 2023-12-22T08:48:22.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.834+0000 7fb089d76640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb084163d50 0x7fb0840af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:22.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.835+0000 7fb088d74640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb084070f50 0x7fb0840af3b0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fb07400c500 tx=0x7fb07400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:22.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.835+0000 7fb079ffb640 1 -- 172.21.15.38:0/1942247172 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074005ce0 con 0x7fb084070f50 2023-12-22T08:48:22.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.835+0000 7fb079ffb640 1 -- 172.21.15.38:0/1942247172 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb074005e40 con 0x7fb084070f50 2023-12-22T08:48:22.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.835+0000 7fb079ffb640 1 -- 172.21.15.38:0/1942247172 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074007330 con 0x7fb084070f50 2023-12-22T08:48:22.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.835+0000 7fb08a577640 1 -- 172.21.15.38:0/1942247172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08409c2c0 con 0x7fb084070f50 2023-12-22T08:48:22.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.835+0000 7fb08a577640 1 -- 172.21.15.38:0/1942247172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08409b9f0 con 0x7fb084070f50 2023-12-22T08:48:22.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.837+0000 7fb08a577640 1 -- 172.21.15.38:0/1942247172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08409ca80 con 0x7fb084070f50 2023-12-22T08:48:22.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.838+0000 7fb079ffb640 1 -- 172.21.15.38:0/1942247172 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb074007550 con 0x7fb084070f50 2023-12-22T08:48:22.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.839+0000 7fb079ffb640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb06806a430 0x7fb06806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:22.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.839+0000 7fb079ffb640 1 -- 172.21.15.38:0/1942247172 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb074087f70 con 0x7fb084070f50 2023-12-22T08:48:22.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.839+0000 7fb089575640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb06806a430 0x7fb06806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:22.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.841+0000 7fb089575640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb06806a430 0x7fb06806c8f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb080000f60 tx=0x7fb080009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:22.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:22.843+0000 7fb079ffb640 1 -- 172.21.15.38:0/1942247172 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb0740bac80 con 0x7fb084070f50 2023-12-22T08:48:23.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.040+0000 7fb08a577640 1 -- 172.21.15.38:0/1942247172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb084061910 con 0x7fb084070f50 2023-12-22T08:48:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.041+0000 7fb079ffb640 1 -- 172.21.15.38:0/1942247172 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0740170a0 con 0x7fb084070f50 2023-12-22T08:48:23.043 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:48:23.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.044+0000 7fb08a577640 1 -- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb06806a430 msgr2=0x7fb06806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:23.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.044+0000 7fb08a577640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb06806a430 0x7fb06806c8f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb080000f60 tx=0x7fb080009040 comp rx=0 tx=0).stop 2023-12-22T08:48:23.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.044+0000 7fb08a577640 1 -- 172.21.15.38:0/1942247172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb084070f50 msgr2=0x7fb0840af3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:23.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.044+0000 7fb08a577640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb084070f50 0x7fb0840af3b0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fb07400c500 tx=0x7fb07400c9c0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.044+0000 7fb08a577640 1 -- 172.21.15.38:0/1942247172 shutdown_connections 2023-12-22T08:48:23.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.044+0000 7fb08a577640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb084163d50 0x7fb0840af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.044+0000 7fb08a577640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb06806a430 0x7fb06806c8f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.044+0000 7fb08a577640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb084070f50 0x7fb0840af3b0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.044+0000 7fb08a577640 1 --2- 172.21.15.38:0/1942247172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb084070b70 0x7fb08409b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.045+0000 7fb08a577640 1 -- 172.21.15.38:0/1942247172 >> 172.21.15.38:0/1942247172 conn(0x7fb0840b0b60 msgr2=0x7fb08413ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:23.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.045+0000 7fb08a577640 1 -- 172.21.15.38:0/1942247172 shutdown_connections 2023-12-22T08:48:23.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.045+0000 7fb08a577640 1 -- 172.21.15.38:0/1942247172 wait complete. 2023-12-22T08:48:23.065 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:48:23.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.289+0000 7f45c13dc640 1 Processor -- start 2023-12-22T08:48:23.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.289+0000 7f45c13dc640 1 -- start start 2023-12-22T08:48:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.291+0000 7f45c13dc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f45bc0b2050 0x7f45bc0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.291+0000 7f45c13dc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc070800 0x7f45bc070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.291+0000 7f45c13dc640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc1450f0 con 0x7f45bc144d10 2023-12-22T08:48:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.291+0000 7f45c13dc640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc0cc840 con 0x7f45bc0b2050 2023-12-22T08:48:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.291+0000 7f45c13dc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0ce010 con 0x7f45bc070800 2023-12-22T08:48:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.291+0000 7f45b27fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f45bc0b2050 0x7f45bc0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.292+0000 7f45b27fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f45bc0b2050 0x7f45bc0b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47654/0 (socket says 172.21.15.38:47654) 2023-12-22T08:48:23.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.292+0000 7f45b27fc640 1 -- 172.21.15.38:0/3680441690 learned_addr learned my addr 172.21.15.38:0/3680441690 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:23.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.292+0000 7f45bb7fe640 1 --2- 172.21.15.38:0/3680441690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc070800 0x7f45bc070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:23.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.292+0000 7f45b27fc640 1 -- 172.21.15.38:0/3680441690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc070800 msgr2=0x7f45bc070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:23.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.292+0000 7f45b27fc640 1 --2- 172.21.15.38:0/3680441690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc070800 0x7f45bc070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.292+0000 7f45b27fc640 1 -- 172.21.15.38:0/3680441690 >> v1:172.21.15.89:6789/0 conn(0x7f45bc144d10 legacy=0x7f45bc0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:23.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.292+0000 7f45b27fc640 1 -- 172.21.15.38:0/3680441690 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc0b29f0 con 0x7f45bc0b2050 2023-12-22T08:48:23.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.293+0000 7f45b27fc640 1 --2- 172.21.15.38:0/3680441690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45bc0b2050 0x7f45bc0b24b0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f45a4009870 tx=0x7f45a402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7279980d4ff69a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:23.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.294+0000 7f45ba7fc640 1 -- 172.21.15.38:0/3680441690 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4030840 con 0x7f45bc0b2050 2023-12-22T08:48:23.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.294+0000 7f45ba7fc640 1 -- 172.21.15.38:0/3680441690 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a40309a0 con 0x7f45bc0b2050 2023-12-22T08:48:23.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.294+0000 7f45ba7fc640 1 -- 172.21.15.38:0/3680441690 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4030d30 con 0x7f45bc0b2050 2023-12-22T08:48:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.294+0000 7f45c13dc640 1 -- 172.21.15.38:0/3680441690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45bc0b2050 msgr2=0x7f45bc0b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.294+0000 7f45c13dc640 1 --2- 172.21.15.38:0/3680441690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45bc0b2050 0x7f45bc0b24b0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f45a4009870 tx=0x7f45a402b980 comp rx=0 tx=0).stop 2023-12-22T08:48:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.294+0000 7f45c13dc640 1 -- 172.21.15.38:0/3680441690 shutdown_connections 2023-12-22T08:48:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.294+0000 7f45c13dc640 1 --2- 172.21.15.38:0/3680441690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45bc0b2050 0x7f45bc0b24b0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.294+0000 7f45c13dc640 1 --2- 172.21.15.38:0/3680441690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc070800 0x7f45bc070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.294+0000 7f45c13dc640 1 -- 172.21.15.38:0/3680441690 >> 172.21.15.38:0/3680441690 conn(0x7f45bc0cf070 msgr2=0x7f45bc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.295+0000 7f45c13dc640 1 -- 172.21.15.38:0/3680441690 shutdown_connections 2023-12-22T08:48:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.295+0000 7f45c13dc640 1 -- 172.21.15.38:0/3680441690 wait complete. 2023-12-22T08:48:23.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.297+0000 7f45c13dc640 1 Processor -- start 2023-12-22T08:48:23.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.297+0000 7f45c13dc640 1 -- start start 2023-12-22T08:48:23.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.298+0000 7f45c13dc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc070800 0x7f45bc0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.298+0000 7f45c13dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45bc0b2050 0x7f45bc1383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.298+0000 7f45c13dc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45bc144d10 0x7f45bc0aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.298+0000 7f45c13dc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0b0150 con 0x7f45bc144d10 2023-12-22T08:48:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.298+0000 7f45c13dc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0b0ab0 con 0x7f45bc0b2050 2023-12-22T08:48:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.298+0000 7f45c13dc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc1388f0 con 0x7f45bc070800 2023-12-22T08:48:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.299+0000 7f45bb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45bc144d10 0x7f45bc0aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.299+0000 7f45bb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45bc144d10 0x7f45bc0aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47658/0 (socket says 172.21.15.38:47658) 2023-12-22T08:48:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.299+0000 7f45bb7fe640 1 -- 172.21.15.38:0/1938742757 learned_addr learned my addr 172.21.15.38:0/1938742757 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.299+0000 7f45b27fc640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45bc0b2050 0x7f45bc1383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:23.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.299+0000 7f45baffd640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc070800 0x7f45bc0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:23.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.299+0000 7f45bb7fe640 1 -- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc070800 msgr2=0x7f45bc0b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:23.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.299+0000 7f45bb7fe640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc070800 0x7f45bc0b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.299+0000 7f45bb7fe640 1 -- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45bc0b2050 msgr2=0x7f45bc1383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.299+0000 7f45bb7fe640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45bc0b2050 0x7f45bc1383b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.299+0000 7f45bb7fe640 1 -- 172.21.15.38:0/1938742757 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a40094d0 con 0x7f45bc144d10 2023-12-22T08:48:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.299+0000 7f45b27fc640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45bc0b2050 0x7f45bc1383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:48:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.299+0000 7f45bb7fe640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45bc144d10 0x7f45bc0aebd0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f45b400d800 tx=0x7f45b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.300+0000 7f45b3fff640 1 -- 172.21.15.38:0/1938742757 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400b6c0 con 0x7f45bc144d10 2023-12-22T08:48:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.300+0000 7f45b3fff640 1 -- 172.21.15.38:0/1938742757 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b400b840 con 0x7f45bc144d10 2023-12-22T08:48:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.300+0000 7f45c13dc640 1 -- 172.21.15.38:0/1938742757 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc0af4d0 con 0x7f45bc144d10 2023-12-22T08:48:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.300+0000 7f45b3fff640 1 -- 172.21.15.38:0/1938742757 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400bbf0 con 0x7f45bc144d10 2023-12-22T08:48:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.300+0000 7f45c13dc640 1 -- 172.21.15.38:0/1938742757 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc0afa90 con 0x7f45bc144d10 2023-12-22T08:48:23.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.301+0000 7f45c13dc640 1 -- 172.21.15.38:0/1938742757 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc0b0290 con 0x7f45bc144d10 2023-12-22T08:48:23.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.302+0000 7f45b3fff640 1 -- 172.21.15.38:0/1938742757 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f45b400bd50 con 0x7f45bc144d10 2023-12-22T08:48:23.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.303+0000 7f45b3fff640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f459c06a430 0x7f459c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:23.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.303+0000 7f45b3fff640 1 -- 172.21.15.38:0/1938742757 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45b4088e30 con 0x7f45bc144d10 2023-12-22T08:48:23.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.304+0000 7f45baffd640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f459c06a430 0x7f459c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:23.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.305+0000 7f45baffd640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f459c06a430 0x7f459c06c8f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f45ac007fd0 tx=0x7f45ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:23.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.308+0000 7f45b3fff640 1 -- 172.21.15.38:0/1938742757 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f45b4054410 con 0x7f45bc144d10 2023-12-22T08:48:23.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.506+0000 7f45c13dc640 1 -- 172.21.15.38:0/1938742757 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45bc061910 con 0x7f45bc144d10 2023-12-22T08:48:23.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.507+0000 7f45b3fff640 1 -- 172.21.15.38:0/1938742757 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v145) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45b4057a30 con 0x7f45bc144d10 2023-12-22T08:48:23.508 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:48:23.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.509+0000 7f45c13dc640 1 -- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f459c06a430 msgr2=0x7f459c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:23.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.509+0000 7f45c13dc640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f459c06a430 0x7f459c06c8f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f45ac007fd0 tx=0x7f45ac009040 comp rx=0 tx=0).stop 2023-12-22T08:48:23.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.510+0000 7f45c13dc640 1 -- 172.21.15.38:0/1938742757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45bc144d10 msgr2=0x7f45bc0aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:23.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.510+0000 7f45c13dc640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45bc144d10 0x7f45bc0aebd0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f45b400d800 tx=0x7f45b400dcc0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.510+0000 7f45c13dc640 1 -- 172.21.15.38:0/1938742757 shutdown_connections 2023-12-22T08:48:23.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.510+0000 7f45c13dc640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f459c06a430 0x7f459c06c8f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.510+0000 7f45c13dc640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45bc144d10 0x7f45bc0aebd0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.510+0000 7f45c13dc640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45bc0b2050 0x7f45bc1383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.510+0000 7f45c13dc640 1 --2- 172.21.15.38:0/1938742757 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45bc070800 0x7f45bc0b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.510+0000 7f45c13dc640 1 -- 172.21.15.38:0/1938742757 >> 172.21.15.38:0/1938742757 conn(0x7f45bc0cf070 msgr2=0x7f45bc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:23.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.510+0000 7f45c13dc640 1 -- 172.21.15.38:0/1938742757 shutdown_connections 2023-12-22T08:48:23.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.510+0000 7f45c13dc640 1 -- 172.21.15.38:0/1938742757 wait complete. 2023-12-22T08:48:23.531 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:48:23.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.755+0000 7f1e9f59e640 1 Processor -- start 2023-12-22T08:48:23.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.755+0000 7f1e9f59e640 1 -- start start 2023-12-22T08:48:23.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.757+0000 7f1e9f59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1ea015d3e0 0x7f1ea015b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:23.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.757+0000 7f1e9f59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1ea015d7c0 0x7f1ea006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:23.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.757+0000 7f1e9f59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea0070360 con 0x7f1ea015a7b0 2023-12-22T08:48:23.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.757+0000 7f1e9f59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea0070640 con 0x7f1ea015d3e0 2023-12-22T08:48:23.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.757+0000 7f1e9f59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea0070920 con 0x7f1ea015d7c0 2023-12-22T08:48:23.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.758+0000 7f1e9e59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1ea015d3e0 0x7f1ea015b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:23.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.758+0000 7f1e9e59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1ea015d3e0 0x7f1ea015b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47660/0 (socket says 172.21.15.38:47660) 2023-12-22T08:48:23.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.758+0000 7f1e9e59c640 1 -- 172.21.15.38:0/497954119 learned_addr learned my addr 172.21.15.38:0/497954119 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:23.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.758+0000 7f1e95d9b640 1 --2- 172.21.15.38:0/497954119 >> v2:172.21.15.89:3300/0 conn(0x7f1ea015d7c0 0x7f1ea006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:23.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.758+0000 7f1e9e59c640 1 -- 172.21.15.38:0/497954119 >> v2:172.21.15.89:3300/0 conn(0x7f1ea015d7c0 msgr2=0x7f1ea006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:23.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.758+0000 7f1e9e59c640 1 --2- 172.21.15.38:0/497954119 >> v2:172.21.15.89:3300/0 conn(0x7f1ea015d7c0 0x7f1ea006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.758+0000 7f1e9e59c640 1 -- 172.21.15.38:0/497954119 >> v1:172.21.15.89:6789/0 conn(0x7f1ea015a7b0 legacy=0x7f1ea006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:23.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.758+0000 7f1e9e59c640 1 -- 172.21.15.38:0/497954119 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea00abda0 con 0x7f1ea015d3e0 2023-12-22T08:48:23.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.758+0000 7f1e95d9b640 1 --2- 172.21.15.38:0/497954119 >> v2:172.21.15.89:3300/0 conn(0x7f1ea015d7c0 0x7f1ea006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:23.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.759+0000 7f1e9e59c640 1 --2- 172.21.15.38:0/497954119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea015d3e0 0x7f1ea015b820 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f1ea015b7d0 tx=0x7f1e9002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fd258b6764467d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:23.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.760+0000 7f1e9dd9b640 1 -- 172.21.15.38:0/497954119 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9002ca80 con 0x7f1ea015d3e0 2023-12-22T08:48:23.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.760+0000 7f1e9dd9b640 1 -- 172.21.15.38:0/497954119 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9002cbe0 con 0x7f1ea015d3e0 2023-12-22T08:48:23.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.760+0000 7f1e9dd9b640 1 -- 172.21.15.38:0/497954119 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e900343f0 con 0x7f1ea015d3e0 2023-12-22T08:48:23.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.760+0000 7f1e9f59e640 1 -- 172.21.15.38:0/497954119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea015d3e0 msgr2=0x7f1ea015b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:23.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.760+0000 7f1e9f59e640 1 --2- 172.21.15.38:0/497954119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea015d3e0 0x7f1ea015b820 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f1ea015b7d0 tx=0x7f1e9002bee0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.761+0000 7f1e9f59e640 1 -- 172.21.15.38:0/497954119 shutdown_connections 2023-12-22T08:48:23.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.761+0000 7f1e9f59e640 1 --2- 172.21.15.38:0/497954119 >> v2:172.21.15.89:3300/0 conn(0x7f1ea015d7c0 0x7f1ea006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.761+0000 7f1e9f59e640 1 --2- 172.21.15.38:0/497954119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea015d3e0 0x7f1ea015b820 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.761+0000 7f1e9f59e640 1 -- 172.21.15.38:0/497954119 >> 172.21.15.38:0/497954119 conn(0x7f1ea00b0b60 msgr2=0x7f1ea00b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:23.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.761+0000 7f1e9f59e640 1 -- 172.21.15.38:0/497954119 shutdown_connections 2023-12-22T08:48:23.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.761+0000 7f1e9f59e640 1 -- 172.21.15.38:0/497954119 wait complete. 2023-12-22T08:48:23.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.763+0000 7f1e9f59e640 1 Processor -- start 2023-12-22T08:48:23.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.763+0000 7f1e9f59e640 1 -- start start 2023-12-22T08:48:23.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.764+0000 7f1e9f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea015a7b0 0x7f1ea0154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.764+0000 7f1e9f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea015d3e0 0x7f1ea0141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.764+0000 7f1e9f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea015d7c0 0x7f1ea015bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.764+0000 7f1e9f59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea0141ff0 con 0x7f1ea015d7c0 2023-12-22T08:48:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.764+0000 7f1e9f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea0158ac0 con 0x7f1ea015a7b0 2023-12-22T08:48:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.764+0000 7f1e9f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea0158da0 con 0x7f1ea015d3e0 2023-12-22T08:48:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.764+0000 7f1e9ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea015d7c0 0x7f1ea015bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.764+0000 7f1e9ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea015d7c0 0x7f1ea015bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47668/0 (socket says 172.21.15.38:47668) 2023-12-22T08:48:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.764+0000 7f1e9ed9d640 1 -- 172.21.15.38:0/1652990321 learned_addr learned my addr 172.21.15.38:0/1652990321 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.764+0000 7f1e9e59c640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea015a7b0 0x7f1ea0154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.764+0000 7f1e95d9b640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea015d3e0 0x7f1ea0141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.765+0000 7f1e9ed9d640 1 -- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea015d3e0 msgr2=0x7f1ea0141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.765+0000 7f1e9ed9d640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea015d3e0 0x7f1ea0141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.765+0000 7f1e9ed9d640 1 -- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea015a7b0 msgr2=0x7f1ea0154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:23.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.765+0000 7f1e9ed9d640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea015a7b0 0x7f1ea0154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.765+0000 7f1e9ed9d640 1 -- 172.21.15.38:0/1652990321 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90009b30 con 0x7f1ea015d7c0 2023-12-22T08:48:23.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.765+0000 7f1e9ed9d640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea015d7c0 0x7f1ea015bda0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c410 tx=0x7f1e9800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:23.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.765+0000 7f1e977fe640 1 -- 172.21.15.38:0/1652990321 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98007230 con 0x7f1ea015d7c0 2023-12-22T08:48:23.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.765+0000 7f1e977fe640 1 -- 172.21.15.38:0/1652990321 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e98007390 con 0x7f1ea015d7c0 2023-12-22T08:48:23.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.765+0000 7f1e977fe640 1 -- 172.21.15.38:0/1652990321 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e980067d0 con 0x7f1ea015d7c0 2023-12-22T08:48:23.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.765+0000 7f1e9f59e640 1 -- 172.21.15.38:0/1652990321 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea0159080 con 0x7f1ea015d7c0 2023-12-22T08:48:23.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.765+0000 7f1e9f59e640 1 -- 172.21.15.38:0/1652990321 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea0159640 con 0x7f1ea015d7c0 2023-12-22T08:48:23.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.767+0000 7f1e9f59e640 1 -- 172.21.15.38:0/1652990321 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea0159860 con 0x7f1ea015d7c0 2023-12-22T08:48:23.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.768+0000 7f1e977fe640 1 -- 172.21.15.38:0/1652990321 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1e98006930 con 0x7f1ea015d7c0 2023-12-22T08:48:23.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.769+0000 7f1e977fe640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8006a430 0x7f1e8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:23.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.769+0000 7f1e977fe640 1 -- 172.21.15.38:0/1652990321 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e98087f00 con 0x7f1ea015d7c0 2023-12-22T08:48:23.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.769+0000 7f1e9e59c640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8006a430 0x7f1e8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:23.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.771+0000 7f1e9e59c640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8006a430 0x7f1e8006c8f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1e90035000 tx=0x7f1e90030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:23.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.773+0000 7f1e977fe640 1 -- 172.21.15.38:0/1652990321 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1e980533c0 con 0x7f1ea015d7c0 2023-12-22T08:48:23.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.967+0000 7f1e9f59e640 1 -- 172.21.15.38:0/1652990321 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ea0061910 con 0x7f1ea015d7c0 2023-12-22T08:48:23.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.968+0000 7f1e977fe640 1 -- 172.21.15.38:0/1652990321 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v145) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e98017030 con 0x7f1ea015d7c0 2023-12-22T08:48:23.969 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:48:23.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.970+0000 7f1e9f59e640 1 -- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8006a430 msgr2=0x7f1e8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:23.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.970+0000 7f1e9f59e640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8006a430 0x7f1e8006c8f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1e90035000 tx=0x7f1e90030000 comp rx=0 tx=0).stop 2023-12-22T08:48:23.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.971+0000 7f1e9f59e640 1 -- 172.21.15.38:0/1652990321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea015d7c0 msgr2=0x7f1ea015bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:23.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.971+0000 7f1e9f59e640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea015d7c0 0x7f1ea015bda0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c410 tx=0x7f1e9800c8d0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.971+0000 7f1e9f59e640 1 -- 172.21.15.38:0/1652990321 shutdown_connections 2023-12-22T08:48:23.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.971+0000 7f1e9f59e640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1e8006a430 0x7f1e8006c8f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.971+0000 7f1e9f59e640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ea015d7c0 0x7f1ea015bda0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.971+0000 7f1e9f59e640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ea015d3e0 0x7f1ea0141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.971+0000 7f1e9f59e640 1 --2- 172.21.15.38:0/1652990321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ea015a7b0 0x7f1ea0154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:23.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.971+0000 7f1e9f59e640 1 -- 172.21.15.38:0/1652990321 >> 172.21.15.38:0/1652990321 conn(0x7f1ea00b0b60 msgr2=0x7f1ea0159cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:23.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.971+0000 7f1e9f59e640 1 -- 172.21.15.38:0/1652990321 shutdown_connections 2023-12-22T08:48:23.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:23.971+0000 7f1e9f59e640 1 -- 172.21.15.38:0/1652990321 wait complete. 2023-12-22T08:48:23.991 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:48:24.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.212+0000 7f130cd81640 1 Processor -- start 2023-12-22T08:48:24.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.213+0000 7f130cd81640 1 -- start start 2023-12-22T08:48:24.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.214+0000 7f130cd81640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1308146d40 0x7f13080b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:24.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.214+0000 7f130cd81640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1308160fa0 0x7f13080c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:24.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.214+0000 7f130cd81640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f130806ced0 0x7f13080c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:24.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.214+0000 7f130cd81640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13080ce3f0 con 0x7f130806ced0 2023-12-22T08:48:24.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.214+0000 7f130cd81640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13080ce580 con 0x7f1308160fa0 2023-12-22T08:48:24.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.214+0000 7f130cd81640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080af990 con 0x7f1308146d40 2023-12-22T08:48:24.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.215+0000 7f1307fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f130806ced0 0x7f13080c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:24.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.215+0000 7f1307fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f130806ced0 0x7f13080c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47680/0 (socket says 172.21.15.38:47680) 2023-12-22T08:48:24.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.215+0000 7f1306ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1308160fa0 0x7f13080c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:24.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.215+0000 7f1307fff640 1 -- 172.21.15.38:0/3592417656 learned_addr learned my addr 172.21.15.38:0/3592417656 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:24.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.215+0000 7f13077fe640 1 --2- 172.21.15.38:0/3592417656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1308146d40 0x7f13080b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:24.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.216+0000 7f1307fff640 1 -- 172.21.15.38:0/3592417656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1308146d40 msgr2=0x7f13080b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:24.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.216+0000 7f1307fff640 1 --2- 172.21.15.38:0/3592417656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1308146d40 0x7f13080b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.216+0000 7f1307fff640 1 -- 172.21.15.38:0/3592417656 >> v2:172.21.15.89:3300/0 conn(0x7f1308160fa0 msgr2=0x7f13080c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:24.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.216+0000 7f1307fff640 1 --2- 172.21.15.38:0/3592417656 >> v2:172.21.15.89:3300/0 conn(0x7f1308160fa0 0x7f13080c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.216+0000 7f1307fff640 1 -- 172.21.15.38:0/3592417656 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1308161480 con 0x7f130806ced0 2023-12-22T08:48:24.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.217+0000 7f1307fff640 1 --2- 172.21.15.38:0/3592417656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f130806ced0 0x7f13080c9c00 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f1308061790 tx=0x7f130002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386d1f06266c088f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:24.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.217+0000 7f13067fc640 1 -- 172.21.15.38:0/3592417656 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130002c9e0 con 0x7f130806ced0 2023-12-22T08:48:24.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.217+0000 7f13067fc640 1 -- 172.21.15.38:0/3592417656 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130002cb40 con 0x7f130806ced0 2023-12-22T08:48:24.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.217+0000 7f13067fc640 1 -- 172.21.15.38:0/3592417656 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000343f0 con 0x7f130806ced0 2023-12-22T08:48:24.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.218+0000 7f130cd81640 1 -- 172.21.15.38:0/3592417656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f130806ced0 msgr2=0x7f13080c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:24.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.218+0000 7f130cd81640 1 --2- 172.21.15.38:0/3592417656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f130806ced0 0x7f13080c9c00 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f1308061790 tx=0x7f130002be40 comp rx=0 tx=0).stop 2023-12-22T08:48:24.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.218+0000 7f130cd81640 1 -- 172.21.15.38:0/3592417656 shutdown_connections 2023-12-22T08:48:24.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.218+0000 7f130cd81640 1 --2- 172.21.15.38:0/3592417656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f130806ced0 0x7f13080c9c00 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.218+0000 7f130cd81640 1 --2- 172.21.15.38:0/3592417656 >> v2:172.21.15.89:3300/0 conn(0x7f1308160fa0 0x7f13080c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.218+0000 7f130cd81640 1 --2- 172.21.15.38:0/3592417656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1308146d40 0x7f13080b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.218+0000 7f130cd81640 1 -- 172.21.15.38:0/3592417656 >> 172.21.15.38:0/3592417656 conn(0x7f13080d0050 msgr2=0x7f13080d0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:24.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.218+0000 7f130cd81640 1 -- 172.21.15.38:0/3592417656 shutdown_connections 2023-12-22T08:48:24.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.218+0000 7f130cd81640 1 -- 172.21.15.38:0/3592417656 wait complete. 2023-12-22T08:48:24.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.220+0000 7f130cd81640 1 Processor -- start 2023-12-22T08:48:24.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.220+0000 7f130cd81640 1 -- start start 2023-12-22T08:48:24.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.221+0000 7f130cd81640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f130806ced0 0x7f13080b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:24.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.221+0000 7f130cd81640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1308146d40 0x7f1308144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:24.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.221+0000 7f130cd81640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1308160fa0 0x7f130813fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:24.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.221+0000 7f130cd81640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1308160690 con 0x7f1308146d40 2023-12-22T08:48:24.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.221+0000 7f130cd81640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130815d9d0 con 0x7f1308160fa0 2023-12-22T08:48:24.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.221+0000 7f130cd81640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080b4530 con 0x7f130806ced0 2023-12-22T08:48:24.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.221+0000 7f1306ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1308146d40 0x7f1308144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:24.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.221+0000 7f1306ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1308146d40 0x7f1308144ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47692/0 (socket says 172.21.15.38:47692) 2023-12-22T08:48:24.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.221+0000 7f1306ffd640 1 -- 172.21.15.38:0/1857472041 learned_addr learned my addr 172.21.15.38:0/1857472041 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:24.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.222+0000 7f1307fff640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1308160fa0 0x7f130813fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:24.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.222+0000 7f13077fe640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f130806ced0 0x7f13080b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:24.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.222+0000 7f1306ffd640 1 -- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f130806ced0 msgr2=0x7f13080b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:24.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.222+0000 7f1306ffd640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f130806ced0 0x7f13080b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.222+0000 7f1306ffd640 1 -- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1308160fa0 msgr2=0x7f130813fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:24.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.222+0000 7f1306ffd640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1308160fa0 0x7f130813fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.222+0000 7f1306ffd640 1 -- 172.21.15.38:0/1857472041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1300009b30 con 0x7f1308146d40 2023-12-22T08:48:24.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.222+0000 7f1306ffd640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1308146d40 0x7f1308144ab0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00e9b0 tx=0x7f12fc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:24.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.223+0000 7f12effff640 1 -- 172.21.15.38:0/1857472041 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc009670 con 0x7f1308146d40 2023-12-22T08:48:24.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.223+0000 7f12effff640 1 -- 172.21.15.38:0/1857472041 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc00c9a0 con 0x7f1308146d40 2023-12-22T08:48:24.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.223+0000 7f12effff640 1 -- 172.21.15.38:0/1857472041 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc00cd50 con 0x7f1308146d40 2023-12-22T08:48:24.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.223+0000 7f130cd81640 1 -- 172.21.15.38:0/1857472041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13081f6230 con 0x7f1308146d40 2023-12-22T08:48:24.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.223+0000 7f130cd81640 1 -- 172.21.15.38:0/1857472041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13081f65c0 con 0x7f1308146d40 2023-12-22T08:48:24.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.224+0000 7f130cd81640 1 -- 172.21.15.38:0/1857472041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1308061910 con 0x7f1308146d40 2023-12-22T08:48:24.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.225+0000 7f12effff640 1 -- 172.21.15.38:0/1857472041 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f12fc013470 con 0x7f1308146d40 2023-12-22T08:48:24.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.226+0000 7f12effff640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12f406a430 0x7f12f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:24.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.226+0000 7f12effff640 1 -- 172.21.15.38:0/1857472041 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12fc088c80 con 0x7f1308146d40 2023-12-22T08:48:24.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.226+0000 7f13077fe640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12f406a430 0x7f12f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:24.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.228+0000 7f13077fe640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12f406a430 0x7f12f406c8f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f12f80098f0 tx=0x7f12f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:24.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.230+0000 7f12effff640 1 -- 172.21.15.38:0/1857472041 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f12fc0541d0 con 0x7f1308146d40 2023-12-22T08:48:24.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.437+0000 7f130cd81640 1 -- 172.21.15.38:0/1857472041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f13081f6b90 con 0x7f1308146d40 2023-12-22T08:48:24.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.438+0000 7f12effff640 1 -- 172.21.15.38:0/1857472041 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v145) v1 ==== 80+0+0 (secure 0 0 0) 0x7f12fc017080 con 0x7f1308146d40 2023-12-22T08:48:24.439 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:48:24.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.440+0000 7f130cd81640 1 -- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12f406a430 msgr2=0x7f12f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:24.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.440+0000 7f130cd81640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12f406a430 0x7f12f406c8f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f12f80098f0 tx=0x7f12f8008040 comp rx=0 tx=0).stop 2023-12-22T08:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.440+0000 7f130cd81640 1 -- 172.21.15.38:0/1857472041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1308146d40 msgr2=0x7f1308144ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.440+0000 7f130cd81640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1308146d40 0x7f1308144ab0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00e9b0 tx=0x7f12fc00ee70 comp rx=0 tx=0).stop 2023-12-22T08:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.440+0000 7f130cd81640 1 -- 172.21.15.38:0/1857472041 shutdown_connections 2023-12-22T08:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.440+0000 7f130cd81640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1308160fa0 0x7f130813fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.440+0000 7f130cd81640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12f406a430 0x7f12f406c8f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.440+0000 7f130cd81640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1308146d40 0x7f1308144ab0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.440+0000 7f130cd81640 1 --2- 172.21.15.38:0/1857472041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f130806ced0 0x7f13080b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.440+0000 7f130cd81640 1 -- 172.21.15.38:0/1857472041 >> 172.21.15.38:0/1857472041 conn(0x7f13080d0050 msgr2=0x7f1308145f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.440+0000 7f130cd81640 1 -- 172.21.15.38:0/1857472041 shutdown_connections 2023-12-22T08:48:24.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.441+0000 7f130cd81640 1 -- 172.21.15.38:0/1857472041 wait complete. 2023-12-22T08:48:24.460 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T08:48:24.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:24.460 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-22T08:48:24.574 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:48:24.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:24.574 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T08:48:24.623 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:48:24.623 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:24.686 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:48:24.686 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:48:24.686 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:24.749 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:48:24.749 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:48:24.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.982+0000 7f690844c640 1 Processor -- start 2023-12-22T08:48:24.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.982+0000 7f690844c640 1 -- start start 2023-12-22T08:48:24.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.984+0000 7f690844c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f69000b2050 0x7f69000b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:24.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.984+0000 7f690844c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69001450f0 con 0x7f6900070800 2023-12-22T08:48:24.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.984+0000 7f690844c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69000b29f0 con 0x7f6900144d10 2023-12-22T08:48:24.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.984+0000 7f690844c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69000cc840 con 0x7f69000b2050 2023-12-22T08:48:24.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.985+0000 7f69059e7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f69000b2050 0x7f69000b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:24.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.985+0000 7f69069e9640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6900070800 0x7f6900070be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57748/0 (socket says 172.21.15.38:57748) 2023-12-22T08:48:24.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.985+0000 7f69069e9640 1 -- 172.21.15.38:0/2701128253 learned_addr learned my addr 172.21.15.38:0/2701128253 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:24.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.985+0000 7f69059e7640 1 -- 172.21.15.38:0/2701128253 >> v1:172.21.15.89:6789/0 conn(0x7f6900144d10 legacy=0x7f69000cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:24.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.985+0000 7f69059e7640 1 -- 172.21.15.38:0/2701128253 >> v1:172.21.15.38:6789/0 conn(0x7f6900070800 legacy=0x7f6900070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:24.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.985+0000 7f69051e6640 1 -- 172.21.15.38:0/2701128253 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553212525 0 0) 0x7f69001450f0 con 0x7f6900070800 2023-12-22T08:48:24.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.985+0000 7f69059e7640 1 -- 172.21.15.38:0/2701128253 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69000ce010 con 0x7f69000b2050 2023-12-22T08:48:24.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.986+0000 7f69059e7640 1 --2- 172.21.15.38:0/2701128253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69000b2050 0x7f69000b24b0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f68f00097a0 tx=0x7f68f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6469602af2d5bf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:24.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.987+0000 7f69051e6640 1 -- 172.21.15.38:0/2701128253 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0031830 con 0x7f69000b2050 2023-12-22T08:48:24.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.987+0000 7f69051e6640 1 -- 172.21.15.38:0/2701128253 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f0031990 con 0x7f69000b2050 2023-12-22T08:48:24.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.987+0000 7f69051e6640 1 -- 172.21.15.38:0/2701128253 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0031d20 con 0x7f69000b2050 2023-12-22T08:48:24.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.987+0000 7f690844c640 1 -- 172.21.15.38:0/2701128253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69000b2050 msgr2=0x7f69000b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:24.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.987+0000 7f690844c640 1 --2- 172.21.15.38:0/2701128253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69000b2050 0x7f69000b24b0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f68f00097a0 tx=0x7f68f002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.987+0000 7f690844c640 1 -- 172.21.15.38:0/2701128253 shutdown_connections 2023-12-22T08:48:24.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.987+0000 7f690844c640 1 --2- 172.21.15.38:0/2701128253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69000b2050 0x7f69000b24b0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.987+0000 7f690844c640 1 -- 172.21.15.38:0/2701128253 >> 172.21.15.38:0/2701128253 conn(0x7f69000cf070 msgr2=0x7f69000cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:24.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.988+0000 7f690844c640 1 -- 172.21.15.38:0/2701128253 shutdown_connections 2023-12-22T08:48:24.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.988+0000 7f690844c640 1 -- 172.21.15.38:0/2701128253 wait complete. 2023-12-22T08:48:24.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.989+0000 7f690844c640 1 Processor -- start 2023-12-22T08:48:24.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.989+0000 7f690844c640 1 -- start start 2023-12-22T08:48:24.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.990+0000 7f690844c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6900070800 0x7f6900140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:24.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.990+0000 7f690844c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69000b2050 0x7f6900158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:24.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.990+0000 7f690844c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6900144d10 0x7f6900158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:24.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.990+0000 7f690844c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69000aecc0 con 0x7f69000b2050 2023-12-22T08:48:24.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.990+0000 7f690844c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6900158d90 con 0x7f6900144d10 2023-12-22T08:48:24.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.990+0000 7f690844c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690006ce80 con 0x7f6900070800 2023-12-22T08:48:24.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.991+0000 7f69059e7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69000b2050 0x7f6900158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:24.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.991+0000 7f69059e7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69000b2050 0x7f6900158310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47718/0 (socket says 172.21.15.38:47718) 2023-12-22T08:48:24.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.991+0000 7f69059e7640 1 -- 172.21.15.38:0/2834029273 learned_addr learned my addr 172.21.15.38:0/2834029273 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:24.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.991+0000 7f69061e8640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6900070800 0x7f6900140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:24.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.991+0000 7f69069e9640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6900144d10 0x7f6900158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:24.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.991+0000 7f69059e7640 1 -- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6900070800 msgr2=0x7f6900140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:24.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.991+0000 7f69059e7640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6900070800 0x7f6900140cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.991+0000 7f69059e7640 1 -- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6900144d10 msgr2=0x7f6900158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:24.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.991+0000 7f69059e7640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6900144d10 0x7f6900158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:24.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.991+0000 7f69059e7640 1 -- 172.21.15.38:0/2834029273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f0009400 con 0x7f69000b2050 2023-12-22T08:48:24.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.991+0000 7f69069e9640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6900144d10 0x7f6900158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:24.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.991+0000 7f69061e8640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6900070800 0x7f6900140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:24.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.992+0000 7f69059e7640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69000b2050 0x7f6900158310 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f68f00097a0 tx=0x7f68f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.992+0000 7f68f6ffd640 1 -- 172.21.15.38:0/2834029273 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f003ca80 con 0x7f69000b2050 2023-12-22T08:48:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.992+0000 7f68f6ffd640 1 -- 172.21.15.38:0/2834029273 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f003cbe0 con 0x7f69000b2050 2023-12-22T08:48:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.992+0000 7f690844c640 1 -- 172.21.15.38:0/2834029273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690006d160 con 0x7f69000b2050 2023-12-22T08:48:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.992+0000 7f68f6ffd640 1 -- 172.21.15.38:0/2834029273 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0004030 con 0x7f69000b2050 2023-12-22T08:48:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.992+0000 7f690844c640 1 -- 172.21.15.38:0/2834029273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690006d720 con 0x7f69000b2050 2023-12-22T08:48:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.994+0000 7f690844c640 1 -- 172.21.15.38:0/2834029273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6900061910 con 0x7f69000b2050 2023-12-22T08:48:24.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.995+0000 7f68f6ffd640 1 -- 172.21.15.38:0/2834029273 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f68f0004190 con 0x7f69000b2050 2023-12-22T08:48:24.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.996+0000 7f68f6ffd640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f68e406a430 0x7f68e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:24.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.996+0000 7f68f6ffd640 1 -- 172.21.15.38:0/2834029273 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68f00ab0c0 con 0x7f69000b2050 2023-12-22T08:48:24.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.996+0000 7f69061e8640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f68e406a430 0x7f68e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:24.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:24.998+0000 7f69061e8640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f68e406a430 0x7f68e406c8f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f68fc003eb0 tx=0x7f68fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:25.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.000+0000 7f68f6ffd640 1 -- 172.21.15.38:0/2834029273 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f68f00767c0 con 0x7f69000b2050 2023-12-22T08:48:25.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.231+0000 7f690844c640 1 -- 172.21.15.38:0/2834029273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6900061910 con 0x7f69000b2050 2023-12-22T08:48:25.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.232+0000 7f68f6ffd640 1 -- 172.21.15.38:0/2834029273 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f68f0079de0 con 0x7f69000b2050 2023-12-22T08:48:25.233 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:25.234 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3891984223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3891984223},{"type":"v1","addr":"172.21.15.38:6834","nonce":3891984223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1561904072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1561904072},{"type":"v1","addr":"172.21.15.89:6836","nonce":1561904072}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4192516230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4192516230},{"type":"v1","addr":"172.21.15.89:6837","nonce":4192516230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:50.322298+0000","modified":"2023-12-22T08:47:53.343300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7716},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7716":{"gid":7716,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1276125280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1276125280},{"type":"v1","addr":"172.21.15.38:6835","nonce":1276125280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-22T08:48:25.234 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 62 2023-12-22T08:48:25.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.235+0000 7f690844c640 1 -- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f68e406a430 msgr2=0x7f68e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:25.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.235+0000 7f690844c640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f68e406a430 0x7f68e406c8f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f68fc003eb0 tx=0x7f68fc009040 comp rx=0 tx=0).stop 2023-12-22T08:48:25.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.235+0000 7f690844c640 1 -- 172.21.15.38:0/2834029273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69000b2050 msgr2=0x7f6900158310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:25.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.235+0000 7f690844c640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69000b2050 0x7f6900158310 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f68f00097a0 tx=0x7f68f00046c0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.235+0000 7f690844c640 1 -- 172.21.15.38:0/2834029273 shutdown_connections 2023-12-22T08:48:25.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.235+0000 7f690844c640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6900144d10 0x7f6900158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.235+0000 7f690844c640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f68e406a430 0x7f68e406c8f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.235+0000 7f690844c640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69000b2050 0x7f6900158310 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.235+0000 7f690844c640 1 --2- 172.21.15.38:0/2834029273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6900070800 0x7f6900140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.235+0000 7f690844c640 1 -- 172.21.15.38:0/2834029273 >> 172.21.15.38:0/2834029273 conn(0x7f69000cf070 msgr2=0x7f69000ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:25.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.235+0000 7f690844c640 1 -- 172.21.15.38:0/2834029273 shutdown_connections 2023-12-22T08:48:25.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.235+0000 7f690844c640 1 -- 172.21.15.38:0/2834029273 wait complete. 2023-12-22T08:48:25.255 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:48:25.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.467+0000 7f928704c640 1 Processor -- start 2023-12-22T08:48:25.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.468+0000 7f928704c640 1 -- start start 2023-12-22T08:48:25.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.469+0000 7f928704c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928015e740 0x7f928015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.470+0000 7f928704c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928015eb20 con 0x7f92800b3f90 2023-12-22T08:48:25.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.470+0000 7f928704c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9280070770 con 0x7f928006ca50 2023-12-22T08:48:25.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.470+0000 7f928704c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928006e650 con 0x7f928015e740 2023-12-22T08:48:25.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.470+0000 7f92855e9640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f92800b3f90 0x7f9280070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57762/0 (socket says 172.21.15.38:57762) 2023-12-22T08:48:25.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.470+0000 7f92855e9640 1 -- 172.21.15.38:0/2870350032 learned_addr learned my addr 172.21.15.38:0/2870350032 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.470+0000 7f9284de8640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928015e740 0x7f928015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.470+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447360712 0 0) 0x7f928015eb20 con 0x7f92800b3f90 2023-12-22T08:48:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.470+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9270003520 con 0x7f92800b3f90 2023-12-22T08:48:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1755889114 0 0) 0x7f9270003520 con 0x7f92800b3f90 2023-12-22T08:48:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928015e740 msgr2=0x7f928015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f927f7fe640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928015e740 0x7f928015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 >> v1:172.21.15.89:6789/0 conn(0x7f928006ca50 legacy=0x7f92800b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928006d180 con 0x7f92800b3f90 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f92780019f0 con 0x7f92800b3f90 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 >> v1:172.21.15.38:6789/0 conn(0x7f92800b3f90 legacy=0x7f9280070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f927f7fe640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928015e740 0x7f92700039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f927f7fe640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9270003f20 0x7f92700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f927f7fe640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9270004d00 0x7f9270005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928006e650 con 0x7f9270004d00 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927000bbc0 con 0x7f9270003f20 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927000bd80 con 0x7f928015e740 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.471+0000 7f92855e9640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9270004d00 0x7f9270005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.472+0000 7f927ffff640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9270003f20 0x7f92700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.472+0000 7f9284de8640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928015e740 0x7f92700039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.472+0000 7f92855e9640 1 -- 172.21.15.38:0/2870350032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928015e740 msgr2=0x7f92700039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.472+0000 7f92855e9640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928015e740 0x7f92700039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.472+0000 7f92855e9640 1 -- 172.21.15.38:0/2870350032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9270003f20 msgr2=0x7f92700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:25.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.472+0000 7f92855e9640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9270003f20 0x7f92700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.472+0000 7f92855e9640 1 -- 172.21.15.38:0/2870350032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9270003520 con 0x7f9270004d00 2023-12-22T08:48:25.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.472+0000 7f9284de8640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f928015e740 0x7f92700039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:25.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.472+0000 7f927ffff640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9270003f20 0x7f92700047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.473+0000 7f92855e9640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9270004d00 0x7f9270005180 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f927800a800 tx=0x7f92700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44d083b497e3df5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.473+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780072d0 con 0x7f9270004d00 2023-12-22T08:48:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.473+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927802f070 con 0x7f9270004d00 2023-12-22T08:48:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.473+0000 7f927f7fe640 1 -- 172.21.15.38:0/2870350032 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278007690 con 0x7f9270004d00 2023-12-22T08:48:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.474+0000 7f928704c640 1 -- 172.21.15.38:0/2870350032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9270004d00 msgr2=0x7f9270005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.474+0000 7f928704c640 1 --2- 172.21.15.38:0/2870350032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9270004d00 0x7f9270005180 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f927800a800 tx=0x7f92700057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.474+0000 7f92855e9640 1 -- 172.21.15.38:0/2870350032 reap_dead start 2023-12-22T08:48:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.474+0000 7f928704c640 1 -- 172.21.15.38:0/2870350032 shutdown_connections 2023-12-22T08:48:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.474+0000 7f928704c640 1 -- 172.21.15.38:0/2870350032 >> 172.21.15.38:0/2870350032 conn(0x7f92800cfea0 msgr2=0x7f92800d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:25.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.474+0000 7f928704c640 1 -- 172.21.15.38:0/2870350032 shutdown_connections 2023-12-22T08:48:25.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.474+0000 7f928704c640 1 -- 172.21.15.38:0/2870350032 wait complete. 2023-12-22T08:48:25.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.476+0000 7f928704c640 1 Processor -- start 2023-12-22T08:48:25.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.476+0000 7f928704c640 1 -- start start 2023-12-22T08:48:25.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.477+0000 7f928704c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9270004d00 0x7f9280153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.477+0000 7f928704c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92800b6640 0x7f92800b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.477+0000 7f928704c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9280160090 0x7f9280160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.477+0000 7f928704c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9280160a80 con 0x7f9270004d00 2023-12-22T08:48:25.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.477+0000 7f928704c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9280159a40 con 0x7f9280160090 2023-12-22T08:48:25.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.477+0000 7f928704c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92800b6b40 con 0x7f92800b6640 2023-12-22T08:48:25.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.477+0000 7f9284de8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9270004d00 0x7f9280153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.478+0000 7f9284de8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9270004d00 0x7f9280153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47742/0 (socket says 172.21.15.38:47742) 2023-12-22T08:48:25.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.478+0000 7f9284de8640 1 -- 172.21.15.38:0/3071385638 learned_addr learned my addr 172.21.15.38:0/3071385638 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:25.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.478+0000 7f927ffff640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92800b6640 0x7f92800b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.478+0000 7f92855e9640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9280160090 0x7f9280160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.478+0000 7f9284de8640 1 -- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92800b6640 msgr2=0x7f92800b81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:25.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.478+0000 7f9284de8640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92800b6640 0x7f92800b81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.478+0000 7f9284de8640 1 -- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9280160090 msgr2=0x7f9280160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:25.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.478+0000 7f9284de8640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9280160090 0x7f9280160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.478+0000 7f9284de8640 1 -- 172.21.15.38:0/3071385638 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800b6e20 con 0x7f9270004d00 2023-12-22T08:48:25.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.478+0000 7f9284de8640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9270004d00 0x7f9280153810 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f92740108b0 tx=0x7f9274010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:25.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.479+0000 7f927d7fa640 1 -- 172.21.15.38:0/3071385638 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927400eb60 con 0x7f9270004d00 2023-12-22T08:48:25.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.479+0000 7f927d7fa640 1 -- 172.21.15.38:0/3071385638 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927400ecc0 con 0x7f9270004d00 2023-12-22T08:48:25.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.479+0000 7f927d7fa640 1 -- 172.21.15.38:0/3071385638 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927401c400 con 0x7f9270004d00 2023-12-22T08:48:25.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.479+0000 7f928704c640 1 -- 172.21.15.38:0/3071385638 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92800b7100 con 0x7f9270004d00 2023-12-22T08:48:25.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.479+0000 7f928704c640 1 -- 172.21.15.38:0/3071385638 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92800b8730 con 0x7f9270004d00 2023-12-22T08:48:25.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.480+0000 7f928704c640 1 -- 172.21.15.38:0/3071385638 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92800b7320 con 0x7f9270004d00 2023-12-22T08:48:25.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.481+0000 7f927d7fa640 1 -- 172.21.15.38:0/3071385638 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f927401c560 con 0x7f9270004d00 2023-12-22T08:48:25.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.482+0000 7f927d7fa640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f926406a460 0x7f926406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.482+0000 7f927d7fa640 1 -- 172.21.15.38:0/3071385638 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9274088fa0 con 0x7f9270004d00 2023-12-22T08:48:25.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.483+0000 7f927ffff640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f926406a460 0x7f926406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.484+0000 7f927ffff640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f926406a460 0x7f926406c920 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f92800cf9c0 tx=0x7f926c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:25.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.486+0000 7f927d7fa640 1 -- 172.21.15.38:0/3071385638 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f92800b7320 con 0x7f9270004d00 2023-12-22T08:48:25.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.679+0000 7f928704c640 1 -- 172.21.15.38:0/3071385638 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9280061910 con 0x7f9270004d00 2023-12-22T08:48:25.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.681+0000 7f927d7fa640 1 -- 172.21.15.38:0/3071385638 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+16075 (secure 0 0 0) 0x7f9274054630 con 0x7f9270004d00 2023-12-22T08:48:25.682 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:25.682 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":145,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:48:16.278594+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:48.219096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:49.341846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:48:25.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.684+0000 7f928704c640 1 -- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f926406a460 msgr2=0x7f926406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:25.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.684+0000 7f928704c640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f926406a460 0x7f926406c920 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f92800cf9c0 tx=0x7f926c009040 comp rx=0 tx=0).stop 2023-12-22T08:48:25.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.684+0000 7f928704c640 1 -- 172.21.15.38:0/3071385638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9270004d00 msgr2=0x7f9280153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:25.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.684+0000 7f928704c640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9270004d00 0x7f9280153810 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f92740108b0 tx=0x7f9274010d70 comp rx=0 tx=0).stop 2023-12-22T08:48:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.684+0000 7f928704c640 1 -- 172.21.15.38:0/3071385638 shutdown_connections 2023-12-22T08:48:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.684+0000 7f928704c640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9280160090 0x7f9280160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.684+0000 7f928704c640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92800b6640 0x7f92800b81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.684+0000 7f928704c640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f926406a460 0x7f926406c920 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.684+0000 7f928704c640 1 --2- 172.21.15.38:0/3071385638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9270004d00 0x7f9280153810 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.684+0000 7f928704c640 1 -- 172.21.15.38:0/3071385638 >> 172.21.15.38:0/3071385638 conn(0x7f92800cfea0 msgr2=0x7f92800d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.684+0000 7f928704c640 1 -- 172.21.15.38:0/3071385638 shutdown_connections 2023-12-22T08:48:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.684+0000 7f928704c640 1 -- 172.21.15.38:0/3071385638 wait complete. 2023-12-22T08:48:25.706 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:47:48.219096+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:47:49.341846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:48:25.706 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:48:25.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.942+0000 7ff14bfff640 1 Processor -- start 2023-12-22T08:48:25.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.942+0000 7ff14bfff640 1 -- start start 2023-12-22T08:48:25.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.944+0000 7ff14bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff14c070b70 0x7ff14c06bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.944+0000 7ff14bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff14c071660 0x7ff14c164d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.944+0000 7ff14bfff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c06d5f0 con 0x7ff14c06c4d0 2023-12-22T08:48:25.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.944+0000 7ff14bfff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c144fa0 con 0x7ff14c070b70 2023-12-22T08:48:25.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.944+0000 7ff14bfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c06da80 con 0x7ff14c071660 2023-12-22T08:48:25.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.945+0000 7ff14b7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff14c071660 0x7ff14c164d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.945+0000 7ff14b7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff14c071660 0x7ff14c164d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:59444/0 (socket says 172.21.15.38:59444) 2023-12-22T08:48:25.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.945+0000 7ff14affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff14c070b70 0x7ff14c06bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.945+0000 7ff14b7fe640 1 -- 172.21.15.38:0/178271744 learned_addr learned my addr 172.21.15.38:0/178271744 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:25.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.945+0000 7ff14a7fc640 1 --1- 172.21.15.38:0/178271744 >> v1:172.21.15.89:6789/0 conn(0x7ff14c06c4d0 0x7ff14c070f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:36090/0 (socket says 172.21.15.38:36090) 2023-12-22T08:48:25.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.946+0000 7ff14b7fe640 1 -- 172.21.15.38:0/178271744 >> v2:172.21.15.89:3300/0 conn(0x7ff14c070b70 msgr2=0x7ff14c06bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:25.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.946+0000 7ff14b7fe640 1 --2- 172.21.15.38:0/178271744 >> v2:172.21.15.89:3300/0 conn(0x7ff14c070b70 0x7ff14c06bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.946+0000 7ff14b7fe640 1 -- 172.21.15.38:0/178271744 >> v1:172.21.15.89:6789/0 conn(0x7ff14c06c4d0 legacy=0x7ff14c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:25.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.946+0000 7ff14b7fe640 1 -- 172.21.15.38:0/178271744 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c06c9e0 con 0x7ff14c071660 2023-12-22T08:48:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.947+0000 7ff14b7fe640 1 --2- 172.21.15.38:0/178271744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff14c071660 0x7ff14c164d50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff144009e50 tx=0x7ff14402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b2d3aeaa0539d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.948+0000 7ff149ffb640 1 -- 172.21.15.38:0/178271744 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14402ca70 con 0x7ff14c071660 2023-12-22T08:48:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.948+0000 7ff149ffb640 1 -- 172.21.15.38:0/178271744 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14402cbd0 con 0x7ff14c071660 2023-12-22T08:48:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.948+0000 7ff149ffb640 1 -- 172.21.15.38:0/178271744 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1440343f0 con 0x7ff14c071660 2023-12-22T08:48:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.948+0000 7ff14bfff640 1 -- 172.21.15.38:0/178271744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff14c071660 msgr2=0x7ff14c164d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.948+0000 7ff14bfff640 1 --2- 172.21.15.38:0/178271744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff14c071660 0x7ff14c164d50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff144009e50 tx=0x7ff14402bed0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.948+0000 7ff14bfff640 1 -- 172.21.15.38:0/178271744 shutdown_connections 2023-12-22T08:48:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.948+0000 7ff14bfff640 1 --2- 172.21.15.38:0/178271744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff14c071660 0x7ff14c164d50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.949+0000 7ff14bfff640 1 --2- 172.21.15.38:0/178271744 >> v2:172.21.15.89:3300/0 conn(0x7ff14c070b70 0x7ff14c06bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.949+0000 7ff14bfff640 1 -- 172.21.15.38:0/178271744 >> 172.21.15.38:0/178271744 conn(0x7ff14c0b0b60 msgr2=0x7ff14c0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.949+0000 7ff14bfff640 1 -- 172.21.15.38:0/178271744 shutdown_connections 2023-12-22T08:48:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.949+0000 7ff14bfff640 1 -- 172.21.15.38:0/178271744 wait complete. 2023-12-22T08:48:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.950+0000 7ff14bfff640 1 Processor -- start 2023-12-22T08:48:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.951+0000 7ff14bfff640 1 -- start start 2023-12-22T08:48:25.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.952+0000 7ff14bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff14c06c4d0 0x7ff14c143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.952+0000 7ff14bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff14c070b70 0x7ff14c1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.952+0000 7ff14bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff14c071660 0x7ff14c1e8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.952+0000 7ff14bfff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0c6620 con 0x7ff14c071660 2023-12-22T08:48:25.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.952+0000 7ff14bfff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0c6900 con 0x7ff14c06c4d0 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.952+0000 7ff14bfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0c6be0 con 0x7ff14c070b70 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.952+0000 7ff14b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff14c071660 0x7ff14c1e8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.952+0000 7ff14b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff14c071660 0x7ff14c1e8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47748/0 (socket says 172.21.15.38:47748) 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.952+0000 7ff14b7fe640 1 -- 172.21.15.38:0/1638406732 learned_addr learned my addr 172.21.15.38:0/1638406732 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.952+0000 7ff14affd640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff14c06c4d0 0x7ff14c143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.952+0000 7ff14a7fc640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff14c070b70 0x7ff14c1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.953+0000 7ff14b7fe640 1 -- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff14c070b70 msgr2=0x7ff14c1438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.953+0000 7ff14b7fe640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff14c070b70 0x7ff14c1438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.953+0000 7ff14b7fe640 1 -- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff14c06c4d0 msgr2=0x7ff14c143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.953+0000 7ff14b7fe640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff14c06c4d0 0x7ff14c143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.953+0000 7ff14b7fe640 1 -- 172.21.15.38:0/1638406732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff144009b30 con 0x7ff14c071660 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.953+0000 7ff14b7fe640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff14c071660 0x7ff14c1e8630 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7ff144009e50 tx=0x7ff144004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.953+0000 7ff133fff640 1 -- 172.21.15.38:0/1638406732 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144040670 con 0x7ff14c071660 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.953+0000 7ff133fff640 1 -- 172.21.15.38:0/1638406732 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1440407d0 con 0x7ff14c071660 2023-12-22T08:48:25.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.953+0000 7ff14bfff640 1 -- 172.21.15.38:0/1638406732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c0c6ec0 con 0x7ff14c071660 2023-12-22T08:48:25.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.953+0000 7ff133fff640 1 -- 172.21.15.38:0/1638406732 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144040b80 con 0x7ff14c071660 2023-12-22T08:48:25.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.953+0000 7ff14bfff640 1 -- 172.21.15.38:0/1638406732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c1f2580 con 0x7ff14c071660 2023-12-22T08:48:25.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.955+0000 7ff14bfff640 1 -- 172.21.15.38:0/1638406732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c0c70b0 con 0x7ff14c071660 2023-12-22T08:48:25.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.955+0000 7ff133fff640 1 -- 172.21.15.38:0/1638406732 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff144040ce0 con 0x7ff14c071660 2023-12-22T08:48:25.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.956+0000 7ff133fff640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff13806a430 0x7ff13806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:25.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.956+0000 7ff133fff640 1 -- 172.21.15.38:0/1638406732 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1440ab830 con 0x7ff14c071660 2023-12-22T08:48:25.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.957+0000 7ff14affd640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff13806a430 0x7ff13806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:25.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.958+0000 7ff14affd640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff13806a430 0x7ff13806c8f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0cb5b0 tx=0x7ff13c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:25.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:25.961+0000 7ff133fff640 1 -- 172.21.15.38:0/1638406732 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff144076f30 con 0x7ff14c071660 2023-12-22T08:48:26.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.153+0000 7ff14bfff640 1 -- 172.21.15.38:0/1638406732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff14c0c6760 con 0x7ff14c071660 2023-12-22T08:48:26.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.154+0000 7ff133fff640 1 -- 172.21.15.38:0/1638406732 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff14c0c6760 con 0x7ff14c071660 2023-12-22T08:48:26.155 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:48:26.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.157+0000 7ff14bfff640 1 -- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff13806a430 msgr2=0x7ff13806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.157+0000 7ff14bfff640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff13806a430 0x7ff13806c8f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0cb5b0 tx=0x7ff13c008040 comp rx=0 tx=0).stop 2023-12-22T08:48:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.157+0000 7ff14bfff640 1 -- 172.21.15.38:0/1638406732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff14c071660 msgr2=0x7ff14c1e8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.157+0000 7ff14bfff640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff14c071660 0x7ff14c1e8630 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7ff144009e50 tx=0x7ff144004a40 comp rx=0 tx=0).stop 2023-12-22T08:48:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.157+0000 7ff14bfff640 1 -- 172.21.15.38:0/1638406732 shutdown_connections 2023-12-22T08:48:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.157+0000 7ff14bfff640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff13806a430 0x7ff13806c8f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.157+0000 7ff14bfff640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff14c071660 0x7ff14c1e8630 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.157+0000 7ff14bfff640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff14c070b70 0x7ff14c1438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.157+0000 7ff14bfff640 1 --2- 172.21.15.38:0/1638406732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff14c06c4d0 0x7ff14c143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.157+0000 7ff14bfff640 1 -- 172.21.15.38:0/1638406732 >> 172.21.15.38:0/1638406732 conn(0x7ff14c0b0b60 msgr2=0x7ff14c070410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.157+0000 7ff14bfff640 1 -- 172.21.15.38:0/1638406732 shutdown_connections 2023-12-22T08:48:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.157+0000 7ff14bfff640 1 -- 172.21.15.38:0/1638406732 wait complete. 2023-12-22T08:48:26.177 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:48:26.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.407+0000 7f127219f640 1 Processor -- start 2023-12-22T08:48:26.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.407+0000 7f127219f640 1 -- start start 2023-12-22T08:48:26.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.409+0000 7f127219f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f126c15d470 0x7f126c0b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.409+0000 7f127219f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f126c071ea0 0x7f126c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.409+0000 7f127219f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c0ac8e0 con 0x7f126c15d850 2023-12-22T08:48:26.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.409+0000 7f127219f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0ada40 con 0x7f126c15d470 2023-12-22T08:48:26.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.409+0000 7f127219f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0b4550 con 0x7f126c071ea0 2023-12-22T08:48:26.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.409+0000 7f126affd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f126c15d850 0x7f126c0ad330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57764/0 (socket says 172.21.15.38:57764) 2023-12-22T08:48:26.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.409+0000 7f126b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f126c15d470 0x7f126c0b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.409+0000 7f126affd640 1 -- 172.21.15.38:0/128335744 learned_addr learned my addr 172.21.15.38:0/128335744 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:26.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.410+0000 7f126bfff640 1 --2- 172.21.15.38:0/128335744 >> v2:172.21.15.89:3300/0 conn(0x7f126c071ea0 0x7f126c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.410+0000 7f126b7fe640 1 -- 172.21.15.38:0/128335744 >> v2:172.21.15.89:3300/0 conn(0x7f126c071ea0 msgr2=0x7f126c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:26.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.410+0000 7f126b7fe640 1 --2- 172.21.15.38:0/128335744 >> v2:172.21.15.89:3300/0 conn(0x7f126c071ea0 0x7f126c0b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.410+0000 7f126b7fe640 1 -- 172.21.15.38:0/128335744 >> v1:172.21.15.38:6789/0 conn(0x7f126c15d850 legacy=0x7f126c0ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:26.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.410+0000 7f126b7fe640 1 -- 172.21.15.38:0/128335744 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0b4940 con 0x7f126c15d470 2023-12-22T08:48:26.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.411+0000 7f126b7fe640 1 --2- 172.21.15.38:0/128335744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f126c15d470 0x7f126c0b4010 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f126c162250 tx=0x7f125c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3f107b8facb42 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:26.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.411+0000 7f126a7fc640 1 -- 172.21.15.38:0/128335744 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c031830 con 0x7f126c15d470 2023-12-22T08:48:26.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.411+0000 7f126a7fc640 1 -- 172.21.15.38:0/128335744 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c031990 con 0x7f126c15d470 2023-12-22T08:48:26.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.412+0000 7f126a7fc640 1 -- 172.21.15.38:0/128335744 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c031d20 con 0x7f126c15d470 2023-12-22T08:48:26.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.412+0000 7f127219f640 1 -- 172.21.15.38:0/128335744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f126c15d470 msgr2=0x7f126c0b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:26.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.412+0000 7f127219f640 1 --2- 172.21.15.38:0/128335744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f126c15d470 0x7f126c0b4010 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f126c162250 tx=0x7f125c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.412+0000 7f127219f640 1 -- 172.21.15.38:0/128335744 shutdown_connections 2023-12-22T08:48:26.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.412+0000 7f127219f640 1 --2- 172.21.15.38:0/128335744 >> v2:172.21.15.89:3300/0 conn(0x7f126c071ea0 0x7f126c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.412+0000 7f127219f640 1 --2- 172.21.15.38:0/128335744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f126c15d470 0x7f126c0b4010 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.412+0000 7f127219f640 1 -- 172.21.15.38:0/128335744 >> 172.21.15.38:0/128335744 conn(0x7f126c0cf070 msgr2=0x7f126c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:26.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.412+0000 7f127219f640 1 -- 172.21.15.38:0/128335744 shutdown_connections 2023-12-22T08:48:26.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.412+0000 7f127219f640 1 -- 172.21.15.38:0/128335744 wait complete. 2023-12-22T08:48:26.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.414+0000 7f127219f640 1 Processor -- start 2023-12-22T08:48:26.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.414+0000 7f127219f640 1 -- start start 2023-12-22T08:48:26.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.415+0000 7f127219f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f126c071ea0 0x7f126c14a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.415+0000 7f127219f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f126c15d470 0x7f126c14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.415+0000 7f127219f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126c15d850 0x7f126c1fa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.415+0000 7f127219f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1f7d40 con 0x7f126c071ea0 2023-12-22T08:48:26.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.415+0000 7f127219f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1f7780 con 0x7f126c15d470 2023-12-22T08:48:26.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.415+0000 7f127219f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1f7a60 con 0x7f126c15d850 2023-12-22T08:48:26.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.416+0000 7f126b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f126c071ea0 0x7f126c14a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.416+0000 7f126b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f126c071ea0 0x7f126c14a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47768/0 (socket says 172.21.15.38:47768) 2023-12-22T08:48:26.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.416+0000 7f126b7fe640 1 -- 172.21.15.38:0/4288976331 learned_addr learned my addr 172.21.15.38:0/4288976331 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:26.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.416+0000 7f126bfff640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126c15d850 0x7f126c1fa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.416+0000 7f126affd640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f126c15d470 0x7f126c14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.416+0000 7f126b7fe640 1 -- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126c15d850 msgr2=0x7f126c1fa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:26.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.416+0000 7f126b7fe640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126c15d850 0x7f126c1fa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.416+0000 7f126b7fe640 1 -- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f126c15d470 msgr2=0x7f126c14af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:26.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.416+0000 7f126b7fe640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f126c15d470 0x7f126c14af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.416+0000 7f126b7fe640 1 -- 172.21.15.38:0/4288976331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c009400 con 0x7f126c071ea0 2023-12-22T08:48:26.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.416+0000 7f126bfff640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126c15d850 0x7f126c1fa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:26.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.416+0000 7f126affd640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f126c15d470 0x7f126c14af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:26.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.416+0000 7f126b7fe640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f126c071ea0 0x7f126c14a9f0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f125c000c00 tx=0x7f125c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:26.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.417+0000 7f1253fff640 1 -- 172.21.15.38:0/4288976331 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c0317d0 con 0x7f126c071ea0 2023-12-22T08:48:26.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.417+0000 7f1253fff640 1 -- 172.21.15.38:0/4288976331 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c03ba70 con 0x7f126c071ea0 2023-12-22T08:48:26.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.417+0000 7f127219f640 1 -- 172.21.15.38:0/4288976331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c15f8e0 con 0x7f126c071ea0 2023-12-22T08:48:26.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.417+0000 7f1253fff640 1 -- 172.21.15.38:0/4288976331 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c03be20 con 0x7f126c071ea0 2023-12-22T08:48:26.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.417+0000 7f127219f640 1 -- 172.21.15.38:0/4288976331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c153bc0 con 0x7f126c071ea0 2023-12-22T08:48:26.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.418+0000 7f127219f640 1 -- 172.21.15.38:0/4288976331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c15fe00 con 0x7f126c071ea0 2023-12-22T08:48:26.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.419+0000 7f1253fff640 1 -- 172.21.15.38:0/4288976331 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f125c0453f0 con 0x7f126c071ea0 2023-12-22T08:48:26.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.420+0000 7f1253fff640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f125806a430 0x7f125806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.420+0000 7f1253fff640 1 -- 172.21.15.38:0/4288976331 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f125c0aade0 con 0x7f126c071ea0 2023-12-22T08:48:26.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.420+0000 7f1253fff640 1 -- 172.21.15.38:0/4288976331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7f1258071f60 con 0x7f126c071ea0 2023-12-22T08:48:26.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.421+0000 7f126affd640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f125806a430 0x7f125806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.422+0000 7f126affd640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f125806a430 0x7f125806c8f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f126c0ac8b0 tx=0x7f1260009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:26.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.425+0000 7f1253fff640 1 -- 172.21.15.38:0/4288976331 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f125c035060 con 0x7f126c071ea0 2023-12-22T08:48:26.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.617+0000 7f127219f640 1 -- 172.21.15.38:0/4288976331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f126c061910 con 0x7f126c071ea0 2023-12-22T08:48:26.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.617+0000 7f1253fff640 1 -- 172.21.15.38:0/4288976331 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v146) v1 ==== 104+0+11 (secure 0 0 0) 0x7f126c15fe00 con 0x7f126c071ea0 2023-12-22T08:48:26.619 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:48:26.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.620+0000 7f127219f640 1 -- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f125806a430 msgr2=0x7f125806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:26.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.620+0000 7f127219f640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f125806a430 0x7f125806c8f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f126c0ac8b0 tx=0x7f1260009040 comp rx=0 tx=0).stop 2023-12-22T08:48:26.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.620+0000 7f127219f640 1 -- 172.21.15.38:0/4288976331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f126c071ea0 msgr2=0x7f126c14a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:26.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.620+0000 7f127219f640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f126c071ea0 0x7f126c14a9f0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f125c000c00 tx=0x7f125c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.621+0000 7f127219f640 1 -- 172.21.15.38:0/4288976331 shutdown_connections 2023-12-22T08:48:26.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.621+0000 7f127219f640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126c15d850 0x7f126c1fa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.621+0000 7f127219f640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f126c15d470 0x7f126c14af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.621+0000 7f127219f640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f125806a430 0x7f125806c8f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.621+0000 7f127219f640 1 --2- 172.21.15.38:0/4288976331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f126c071ea0 0x7f126c14a9f0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.621+0000 7f127219f640 1 -- 172.21.15.38:0/4288976331 >> 172.21.15.38:0/4288976331 conn(0x7f126c0cf070 msgr2=0x7f126c0710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:26.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.621+0000 7f127219f640 1 -- 172.21.15.38:0/4288976331 shutdown_connections 2023-12-22T08:48:26.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.621+0000 7f127219f640 1 -- 172.21.15.38:0/4288976331 wait complete. 2023-12-22T08:48:26.641 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:48:26.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.869+0000 7fb1ad077640 1 Processor -- start 2023-12-22T08:48:26.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.869+0000 7fb1ad077640 1 -- start start 2023-12-22T08:48:26.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.871+0000 7fb1ad077640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a8070e80 0x7fb1a80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.871+0000 7fb1ad077640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a80ce4b0 con 0x7fb1a815e870 2023-12-22T08:48:26.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.871+0000 7fb1ad077640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a815fea0 con 0x7fb1a815ec50 2023-12-22T08:48:26.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.871+0000 7fb1ad077640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a80cdb80 con 0x7fb1a8070e80 2023-12-22T08:48:26.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.871+0000 7fb1a6d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb1a815e870 0x7fb1a8070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57780/0 (socket says 172.21.15.38:57780) 2023-12-22T08:48:26.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.871+0000 7fb1a6d9d640 1 -- 172.21.15.38:0/2727738854 learned_addr learned my addr 172.21.15.38:0/2727738854 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:26.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.872+0000 7fb1a759e640 1 --2- 172.21.15.38:0/2727738854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a8070e80 0x7fb1a80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.872+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726680078 0 0) 0x7fb1a80ce4b0 con 0x7fb1a815e870 2023-12-22T08:48:26.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.872+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb190003520 con 0x7fb1a815e870 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.872+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260751773 0 0) 0x7fb1a815fea0 con 0x7fb1a815ec50 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.872+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a80ce4b0 con 0x7fb1a815ec50 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.872+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 62386349 0 0) 0x7fb190003520 con 0x7fb1a815e870 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.872+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a8070e80 msgr2=0x7fb1a80ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.872+0000 7fb1a5d9b640 1 --2- 172.21.15.38:0/2727738854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a8070e80 0x7fb1a80ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.872+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 >> v1:172.21.15.89:6789/0 conn(0x7fb1a815ec50 legacy=0x7fb1a806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.872+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a80cde60 con 0x7fb1a815e870 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.873+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fb198001670 con 0x7fb1a815e870 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.873+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 >> v1:172.21.15.38:6789/0 conn(0x7fb1a815e870 legacy=0x7fb1a8070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.873+0000 7fb1a5d9b640 1 --2- 172.21.15.38:0/2727738854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a8070e80 0x7fb190003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.873+0000 7fb1a5d9b640 1 --2- 172.21.15.38:0/2727738854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1900040e0 0x7fb1900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.873+0000 7fb1a5d9b640 1 --2- 172.21.15.38:0/2727738854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb190004d00 0x7fb190005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.873+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a80cdb80 con 0x7fb190004d00 2023-12-22T08:48:26.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.873+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19000bb40 con 0x7fb1900040e0 2023-12-22T08:48:26.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.873+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19000bd00 con 0x7fb1a8070e80 2023-12-22T08:48:26.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.873+0000 7fb1a759e640 1 --2- 172.21.15.38:0/2727738854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb190004d00 0x7fb190005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.873+0000 7fb1a6d9d640 1 --2- 172.21.15.38:0/2727738854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a8070e80 0x7fb190003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.873+0000 7fb1a659c640 1 --2- 172.21.15.38:0/2727738854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1900040e0 0x7fb1900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.874+0000 7fb1a759e640 1 -- 172.21.15.38:0/2727738854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a8070e80 msgr2=0x7fb190003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:26.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.874+0000 7fb1a759e640 1 --2- 172.21.15.38:0/2727738854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a8070e80 0x7fb190003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.874+0000 7fb1a759e640 1 -- 172.21.15.38:0/2727738854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1900040e0 msgr2=0x7fb1900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:26.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.874+0000 7fb1a759e640 1 --2- 172.21.15.38:0/2727738854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1900040e0 0x7fb1900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.874+0000 7fb1a759e640 1 -- 172.21.15.38:0/2727738854 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb190003520 con 0x7fb190004d00 2023-12-22T08:48:26.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.874+0000 7fb1a659c640 1 --2- 172.21.15.38:0/2727738854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1900040e0 0x7fb1900047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:48:26.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.875+0000 7fb1a759e640 1 --2- 172.21.15.38:0/2727738854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb190004d00 0x7fb190005180 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fb1a806c0d0 tx=0x7fb1900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cb4b970075eadb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:26.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.875+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a002cb90 con 0x7fb190004d00 2023-12-22T08:48:26.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.875+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a000f040 con 0x7fb190004d00 2023-12-22T08:48:26.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.875+0000 7fb1a5d9b640 1 -- 172.21.15.38:0/2727738854 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0034440 con 0x7fb190004d00 2023-12-22T08:48:26.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.876+0000 7fb1ad077640 1 -- 172.21.15.38:0/2727738854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb190004d00 msgr2=0x7fb190005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:26.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.876+0000 7fb1ad077640 1 --2- 172.21.15.38:0/2727738854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb190004d00 0x7fb190005180 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fb1a806c0d0 tx=0x7fb1900057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.876+0000 7fb1a759e640 1 -- 172.21.15.38:0/2727738854 reap_dead start 2023-12-22T08:48:26.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.876+0000 7fb1ad077640 1 -- 172.21.15.38:0/2727738854 shutdown_connections 2023-12-22T08:48:26.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.876+0000 7fb1ad077640 1 -- 172.21.15.38:0/2727738854 >> 172.21.15.38:0/2727738854 conn(0x7fb1a80b20c0 msgr2=0x7fb1a80b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:26.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.876+0000 7fb1ad077640 1 -- 172.21.15.38:0/2727738854 shutdown_connections 2023-12-22T08:48:26.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.876+0000 7fb1ad077640 1 -- 172.21.15.38:0/2727738854 wait complete. 2023-12-22T08:48:26.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.878+0000 7fb1ad077640 1 Processor -- start 2023-12-22T08:48:26.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.878+0000 7fb1ad077640 1 -- start start 2023-12-22T08:48:26.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.879+0000 7fb1ad077640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb190004d00 0x7fb1a81530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.879+0000 7fb1ad077640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a80cc250 0x7fb1a806c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.879+0000 7fb1ad077640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a806dab0 0x7fb1a8158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.879+0000 7fb1ad077640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a8153600 con 0x7fb190004d00 2023-12-22T08:48:26.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.879+0000 7fb1ad077640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a815ba10 con 0x7fb1a806dab0 2023-12-22T08:48:26.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.879+0000 7fb1ad077640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a806c660 con 0x7fb1a80cc250 2023-12-22T08:48:26.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.879+0000 7fb1a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb190004d00 0x7fb1a81530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.880+0000 7fb1a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb190004d00 0x7fb1a81530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47772/0 (socket says 172.21.15.38:47772) 2023-12-22T08:48:26.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.880+0000 7fb1a6d9d640 1 -- 172.21.15.38:0/2950137301 learned_addr learned my addr 172.21.15.38:0/2950137301 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:26.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.880+0000 7fb1a759e640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a806dab0 0x7fb1a8158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.880+0000 7fb1a659c640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a80cc250 0x7fb1a806c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.880+0000 7fb1a6d9d640 1 -- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a80cc250 msgr2=0x7fb1a806c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:26.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.880+0000 7fb1a6d9d640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a80cc250 0x7fb1a806c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.880+0000 7fb1a6d9d640 1 -- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a806dab0 msgr2=0x7fb1a8158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:26.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.880+0000 7fb1a6d9d640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a806dab0 0x7fb1a8158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:26.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.880+0000 7fb1a6d9d640 1 -- 172.21.15.38:0/2950137301 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a80ae4d0 con 0x7fb190004d00 2023-12-22T08:48:26.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.880+0000 7fb1a659c640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a80cc250 0x7fb1a806c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:26.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.880+0000 7fb1a6d9d640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb190004d00 0x7fb1a81530c0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb1980072f0 tx=0x7fb1980077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:26.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.881+0000 7fb18f7fe640 1 -- 172.21.15.38:0/2950137301 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb198001620 con 0x7fb190004d00 2023-12-22T08:48:26.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.881+0000 7fb18f7fe640 1 -- 172.21.15.38:0/2950137301 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19800f9c0 con 0x7fb190004d00 2023-12-22T08:48:26.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.881+0000 7fb1ad077640 1 -- 172.21.15.38:0/2950137301 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a80ad950 con 0x7fb190004d00 2023-12-22T08:48:26.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.881+0000 7fb18f7fe640 1 -- 172.21.15.38:0/2950137301 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19800fd30 con 0x7fb190004d00 2023-12-22T08:48:26.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.881+0000 7fb1ad077640 1 -- 172.21.15.38:0/2950137301 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a80adf10 con 0x7fb190004d00 2023-12-22T08:48:26.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.882+0000 7fb1ad077640 1 -- 172.21.15.38:0/2950137301 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a8061910 con 0x7fb190004d00 2023-12-22T08:48:26.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.883+0000 7fb18f7fe640 1 -- 172.21.15.38:0/2950137301 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb19801d360 con 0x7fb190004d00 2023-12-22T08:48:26.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.884+0000 7fb18f7fe640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb19406a460 0x7fb19406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:26.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.884+0000 7fb18f7fe640 1 -- 172.21.15.38:0/2950137301 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1980881c0 con 0x7fb190004d00 2023-12-22T08:48:26.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.884+0000 7fb18f7fe640 1 -- 172.21.15.38:0/2950137301 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7fb194071f90 con 0x7fb190004d00 2023-12-22T08:48:26.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.885+0000 7fb1a659c640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb19406a460 0x7fb19406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:26.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.886+0000 7fb1a659c640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb19406a460 0x7fb19406c920 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8071d50 tx=0x7fb19c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:26.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:26.889+0000 7fb18f7fe640 1 -- 172.21.15.38:0/2950137301 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb19801a060 con 0x7fb190004d00 2023-12-22T08:48:27.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.079+0000 7fb1ad077640 1 -- 172.21.15.38:0/2950137301 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1a80b2ce0 con 0x7fb190004d00 2023-12-22T08:48:27.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.080+0000 7fb18f7fe640 1 -- 172.21.15.38:0/2950137301 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v146) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb19801a070 con 0x7fb190004d00 2023-12-22T08:48:27.081 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:48:27.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.082+0000 7fb1ad077640 1 -- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb19406a460 msgr2=0x7fb19406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:27.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.082+0000 7fb1ad077640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb19406a460 0x7fb19406c920 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8071d50 tx=0x7fb19c009040 comp rx=0 tx=0).stop 2023-12-22T08:48:27.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.082+0000 7fb1ad077640 1 -- 172.21.15.38:0/2950137301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb190004d00 msgr2=0x7fb1a81530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:27.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.082+0000 7fb1ad077640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb190004d00 0x7fb1a81530c0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb1980072f0 tx=0x7fb1980077b0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.083+0000 7fb1ad077640 1 -- 172.21.15.38:0/2950137301 shutdown_connections 2023-12-22T08:48:27.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.083+0000 7fb1ad077640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a806dab0 0x7fb1a8158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.083+0000 7fb1ad077640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a80cc250 0x7fb1a806c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.083+0000 7fb1ad077640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb19406a460 0x7fb19406c920 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.083+0000 7fb1ad077640 1 --2- 172.21.15.38:0/2950137301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb190004d00 0x7fb1a81530c0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.083+0000 7fb1ad077640 1 -- 172.21.15.38:0/2950137301 >> 172.21.15.38:0/2950137301 conn(0x7fb1a80b20c0 msgr2=0x7fb1a80b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.083+0000 7fb1ad077640 1 -- 172.21.15.38:0/2950137301 shutdown_connections 2023-12-22T08:48:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.083+0000 7fb1ad077640 1 -- 172.21.15.38:0/2950137301 wait complete. 2023-12-22T08:48:27.104 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:48:27.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.323+0000 7f8b62487640 1 Processor -- start 2023-12-22T08:48:27.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.324+0000 7f8b62487640 1 -- start start 2023-12-22T08:48:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.325+0000 7f8b62487640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8b5c15e740 0x7f8b5c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.325+0000 7f8b62487640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8b5c06ca50 0x7f8b5c0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.325+0000 7f8b62487640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b5c0b3dc0 0x7f8b5c161120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.325+0000 7f8b62487640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5c06e650 con 0x7f8b5c15e740 2023-12-22T08:48:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.325+0000 7f8b62487640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5c0b4210 con 0x7f8b5c06ca50 2023-12-22T08:48:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.325+0000 7f8b62487640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c15eb20 con 0x7f8b5c0b3dc0 2023-12-22T08:48:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.326+0000 7f8b5bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8b5c15e740 0x7f8b5c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.326+0000 7f8b5bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8b5c15e740 0x7f8b5c15db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47776/0 (socket says 172.21.15.38:47776) 2023-12-22T08:48:27.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.326+0000 7f8b5bfff640 1 -- 172.21.15.38:0/2748163392 learned_addr learned my addr 172.21.15.38:0/2748163392 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.326+0000 7f8b60a24640 1 --2- 172.21.15.38:0/2748163392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b5c0b3dc0 0x7f8b5c161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.326+0000 7f8b5bfff640 1 -- 172.21.15.38:0/2748163392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b5c0b3dc0 msgr2=0x7f8b5c161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.326+0000 7f8b5b7fe640 1 --2- 172.21.15.38:0/2748163392 >> v2:172.21.15.89:3300/0 conn(0x7f8b5c06ca50 0x7f8b5c0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.326+0000 7f8b5bfff640 1 --2- 172.21.15.38:0/2748163392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b5c0b3dc0 0x7f8b5c161120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.326+0000 7f8b5bfff640 1 -- 172.21.15.38:0/2748163392 >> v2:172.21.15.89:3300/0 conn(0x7f8b5c06ca50 msgr2=0x7f8b5c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.326+0000 7f8b5bfff640 1 --2- 172.21.15.38:0/2748163392 >> v2:172.21.15.89:3300/0 conn(0x7f8b5c06ca50 0x7f8b5c0b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.326+0000 7f8b5bfff640 1 -- 172.21.15.38:0/2748163392 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c070770 con 0x7f8b5c15e740 2023-12-22T08:48:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.326+0000 7f8b60a24640 1 --2- 172.21.15.38:0/2748163392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b5c0b3dc0 0x7f8b5c161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.326+0000 7f8b5b7fe640 1 --2- 172.21.15.38:0/2748163392 >> v2:172.21.15.89:3300/0 conn(0x7f8b5c06ca50 0x7f8b5c0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.327+0000 7f8b5bfff640 1 --2- 172.21.15.38:0/2748163392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b5c15e740 0x7f8b5c15db30 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0d32d0 tx=0x7f8b4c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b0492626665c7d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.328+0000 7f8b5affd640 1 -- 172.21.15.38:0/2748163392 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c031750 con 0x7f8b5c15e740 2023-12-22T08:48:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.328+0000 7f8b5affd640 1 -- 172.21.15.38:0/2748163392 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c0318b0 con 0x7f8b5c15e740 2023-12-22T08:48:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.328+0000 7f8b5affd640 1 -- 172.21.15.38:0/2748163392 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c031c40 con 0x7f8b5c15e740 2023-12-22T08:48:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.328+0000 7f8b62487640 1 -- 172.21.15.38:0/2748163392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b5c15e740 msgr2=0x7f8b5c15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.328+0000 7f8b62487640 1 --2- 172.21.15.38:0/2748163392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b5c15e740 0x7f8b5c15db30 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0d32d0 tx=0x7f8b4c02b7f0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.329+0000 7f8b62487640 1 -- 172.21.15.38:0/2748163392 shutdown_connections 2023-12-22T08:48:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.329+0000 7f8b62487640 1 --2- 172.21.15.38:0/2748163392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b5c0b3dc0 0x7f8b5c161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.329+0000 7f8b62487640 1 --2- 172.21.15.38:0/2748163392 >> v2:172.21.15.89:3300/0 conn(0x7f8b5c06ca50 0x7f8b5c0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.329+0000 7f8b62487640 1 --2- 172.21.15.38:0/2748163392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b5c15e740 0x7f8b5c15db30 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.329+0000 7f8b62487640 1 -- 172.21.15.38:0/2748163392 >> 172.21.15.38:0/2748163392 conn(0x7f8b5c0cfea0 msgr2=0x7f8b5c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.329+0000 7f8b62487640 1 -- 172.21.15.38:0/2748163392 shutdown_connections 2023-12-22T08:48:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.329+0000 7f8b62487640 1 -- 172.21.15.38:0/2748163392 wait complete. 2023-12-22T08:48:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.330+0000 7f8b62487640 1 Processor -- start 2023-12-22T08:48:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.331+0000 7f8b62487640 1 -- start start 2023-12-22T08:48:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.331+0000 7f8b62487640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b5c06ca50 0x7f8b5c152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.331+0000 7f8b62487640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b5c0b3dc0 0x7f8b5c0b8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.331+0000 7f8b62487640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b5c15e740 0x7f8b5c1600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b62487640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c152cf0 con 0x7f8b5c15e740 2023-12-22T08:48:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b62487640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c152fd0 con 0x7f8b5c0b3dc0 2023-12-22T08:48:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b62487640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c1532b0 con 0x7f8b5c06ca50 2023-12-22T08:48:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b60a24640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b5c15e740 0x7f8b5c1600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b60a24640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b5c15e740 0x7f8b5c1600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47792/0 (socket says 172.21.15.38:47792) 2023-12-22T08:48:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b60a24640 1 -- 172.21.15.38:0/2029580044 learned_addr learned my addr 172.21.15.38:0/2029580044 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b5bfff640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b5c06ca50 0x7f8b5c152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b5b7fe640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b5c0b3dc0 0x7f8b5c0b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b60a24640 1 -- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b5c06ca50 msgr2=0x7f8b5c152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b60a24640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b5c06ca50 0x7f8b5c152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b60a24640 1 -- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b5c0b3dc0 msgr2=0x7f8b5c0b8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b60a24640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b5c0b3dc0 0x7f8b5c0b8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b60a24640 1 -- 172.21.15.38:0/2029580044 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c0094d0 con 0x7f8b5c15e740 2023-12-22T08:48:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.332+0000 7f8b5bfff640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b5c06ca50 0x7f8b5c152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:48:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.333+0000 7f8b60a24640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b5c15e740 0x7f8b5c1600d0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400cef0 tx=0x7f8b5400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.333+0000 7f8b58ff9640 1 -- 172.21.15.38:0/2029580044 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5400d840 con 0x7f8b5c15e740 2023-12-22T08:48:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.333+0000 7f8b58ff9640 1 -- 172.21.15.38:0/2029580044 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5400d9c0 con 0x7f8b5c15e740 2023-12-22T08:48:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.333+0000 7f8b58ff9640 1 -- 172.21.15.38:0/2029580044 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5400dd70 con 0x7f8b5c15e740 2023-12-22T08:48:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.333+0000 7f8b62487640 1 -- 172.21.15.38:0/2029580044 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5c153590 con 0x7f8b5c15e740 2023-12-22T08:48:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.333+0000 7f8b62487640 1 -- 172.21.15.38:0/2029580044 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5c160610 con 0x7f8b5c15e740 2023-12-22T08:48:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.334+0000 7f8b62487640 1 -- 172.21.15.38:0/2029580044 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5c061910 con 0x7f8b5c15e740 2023-12-22T08:48:27.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.335+0000 7f8b58ff9640 1 -- 172.21.15.38:0/2029580044 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8b5401e3b0 con 0x7f8b5c15e740 2023-12-22T08:48:27.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.336+0000 7f8b58ff9640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8b4806a460 0x7f8b4806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.336+0000 7f8b58ff9640 1 -- 172.21.15.38:0/2029580044 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b54089400 con 0x7f8b5c15e740 2023-12-22T08:48:27.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.337+0000 7f8b58ff9640 1 -- 172.21.15.38:0/2029580044 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7f8b48071f90 con 0x7f8b5c15e740 2023-12-22T08:48:27.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.337+0000 7f8b5bfff640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8b4806a460 0x7f8b4806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.338+0000 7f8b5bfff640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8b4806a460 0x7f8b4806c920 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c035000 tx=0x7f8b4c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:27.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.341+0000 7f8b58ff9640 1 -- 172.21.15.38:0/2029580044 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8b5401a060 con 0x7f8b5c15e740 2023-12-22T08:48:27.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.571+0000 7f8b62487640 1 -- 172.21.15.38:0/2029580044 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b5c071f90 con 0x7f8b5c15e740 2023-12-22T08:48:27.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.572+0000 7f8b58ff9640 1 -- 172.21.15.38:0/2029580044 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f8b54054a50 con 0x7f8b5c15e740 2023-12-22T08:48:27.573 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:27.573 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3891984223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3891984223},{"type":"v1","addr":"172.21.15.38:6834","nonce":3891984223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1561904072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1561904072},{"type":"v1","addr":"172.21.15.89:6836","nonce":1561904072}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4192516230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4192516230},{"type":"v1","addr":"172.21.15.89:6837","nonce":4192516230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:50.322298+0000","modified":"2023-12-22T08:47:53.343300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7716},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7716":{"gid":7716,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1276125280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1276125280},{"type":"v1","addr":"172.21.15.38:6835","nonce":1276125280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-22T08:48:27.573 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 62 2023-12-22T08:48:27.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.574+0000 7f8b62487640 1 -- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8b4806a460 msgr2=0x7f8b4806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:27.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.574+0000 7f8b62487640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8b4806a460 0x7f8b4806c920 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c035000 tx=0x7f8b4c008030 comp rx=0 tx=0).stop 2023-12-22T08:48:27.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.574+0000 7f8b62487640 1 -- 172.21.15.38:0/2029580044 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b5c15e740 msgr2=0x7f8b5c1600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:27.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.574+0000 7f8b62487640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b5c15e740 0x7f8b5c1600d0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400cef0 tx=0x7f8b5400a710 comp rx=0 tx=0).stop 2023-12-22T08:48:27.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.574+0000 7f8b62487640 1 -- 172.21.15.38:0/2029580044 shutdown_connections 2023-12-22T08:48:27.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.574+0000 7f8b62487640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8b4806a460 0x7f8b4806c920 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.574+0000 7f8b62487640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b5c15e740 0x7f8b5c1600d0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.574+0000 7f8b62487640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b5c0b3dc0 0x7f8b5c0b8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.574+0000 7f8b62487640 1 --2- 172.21.15.38:0/2029580044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b5c06ca50 0x7f8b5c152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.574+0000 7f8b62487640 1 -- 172.21.15.38:0/2029580044 >> 172.21.15.38:0/2029580044 conn(0x7f8b5c0cfea0 msgr2=0x7f8b5c154180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:27.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.574+0000 7f8b62487640 1 -- 172.21.15.38:0/2029580044 shutdown_connections 2023-12-22T08:48:27.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.574+0000 7f8b62487640 1 -- 172.21.15.38:0/2029580044 wait complete. 2023-12-22T08:48:27.594 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:48:27.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.817+0000 7f816bdd9640 1 Processor -- start 2023-12-22T08:48:27.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.817+0000 7f816bdd9640 1 -- start start 2023-12-22T08:48:27.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.819+0000 7f816bdd9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f816415d470 0x7f81640b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.819+0000 7f816bdd9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f816415d850 0x7f81640ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.819+0000 7f816bdd9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8164071ea0 0x7f81640b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.819+0000 7f816bdd9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81640ac8e0 con 0x7f8164071ea0 2023-12-22T08:48:27.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.819+0000 7f816bdd9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81640b4550 con 0x7f816415d470 2023-12-22T08:48:27.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.819+0000 7f816bdd9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81640b4940 con 0x7f816415d850 2023-12-22T08:48:27.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.820+0000 7f816a376640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8164071ea0 0x7f81640b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.820+0000 7f816a376640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8164071ea0 0x7f81640b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47806/0 (socket says 172.21.15.38:47806) 2023-12-22T08:48:27.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.820+0000 7f816a376640 1 -- 172.21.15.38:0/3364152411 learned_addr learned my addr 172.21.15.38:0/3364152411 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:27.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.820+0000 7f8169374640 1 --2- 172.21.15.38:0/3364152411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f816415d850 0x7f81640ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.820+0000 7f8169b75640 1 --2- 172.21.15.38:0/3364152411 >> v2:172.21.15.89:3300/0 conn(0x7f816415d470 0x7f81640b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.820+0000 7f816a376640 1 -- 172.21.15.38:0/3364152411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f816415d850 msgr2=0x7f81640ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:27.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.820+0000 7f816a376640 1 --2- 172.21.15.38:0/3364152411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f816415d850 0x7f81640ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.820+0000 7f816a376640 1 -- 172.21.15.38:0/3364152411 >> v2:172.21.15.89:3300/0 conn(0x7f816415d470 msgr2=0x7f81640b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:27.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.820+0000 7f816a376640 1 --2- 172.21.15.38:0/3364152411 >> v2:172.21.15.89:3300/0 conn(0x7f816415d470 0x7f81640b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.820+0000 7f816a376640 1 -- 172.21.15.38:0/3364152411 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81640b4c20 con 0x7f8164071ea0 2023-12-22T08:48:27.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.822+0000 7f816a376640 1 --2- 172.21.15.38:0/3364152411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8164071ea0 0x7f81640b2050 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f81640cfe80 tx=0x7f815c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc11cbc7f8a39fe server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:27.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.822+0000 7f8168b73640 1 -- 172.21.15.38:0/3364152411 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c031860 con 0x7f8164071ea0 2023-12-22T08:48:27.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.822+0000 7f8168b73640 1 -- 172.21.15.38:0/3364152411 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c0319c0 con 0x7f8164071ea0 2023-12-22T08:48:27.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.822+0000 7f8168b73640 1 -- 172.21.15.38:0/3364152411 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c031d50 con 0x7f8164071ea0 2023-12-22T08:48:27.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.823+0000 7f816bdd9640 1 -- 172.21.15.38:0/3364152411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8164071ea0 msgr2=0x7f81640b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:27.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.823+0000 7f816bdd9640 1 --2- 172.21.15.38:0/3364152411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8164071ea0 0x7f81640b2050 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f81640cfe80 tx=0x7f815c02b900 comp rx=0 tx=0).stop 2023-12-22T08:48:27.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.823+0000 7f816bdd9640 1 -- 172.21.15.38:0/3364152411 shutdown_connections 2023-12-22T08:48:27.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.823+0000 7f816bdd9640 1 --2- 172.21.15.38:0/3364152411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8164071ea0 0x7f81640b2050 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.823+0000 7f816bdd9640 1 --2- 172.21.15.38:0/3364152411 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f816415d850 0x7f81640ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.823+0000 7f816bdd9640 1 --2- 172.21.15.38:0/3364152411 >> v2:172.21.15.89:3300/0 conn(0x7f816415d470 0x7f81640b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.823+0000 7f816bdd9640 1 -- 172.21.15.38:0/3364152411 >> 172.21.15.38:0/3364152411 conn(0x7f81640cf070 msgr2=0x7f81640cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:27.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.823+0000 7f816bdd9640 1 -- 172.21.15.38:0/3364152411 shutdown_connections 2023-12-22T08:48:27.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.823+0000 7f816bdd9640 1 -- 172.21.15.38:0/3364152411 wait complete. 2023-12-22T08:48:27.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.825+0000 7f816bdd9640 1 Processor -- start 2023-12-22T08:48:27.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.825+0000 7f816bdd9640 1 -- start start 2023-12-22T08:48:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.826+0000 7f816bdd9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8164071ea0 0x7f816414e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.826+0000 7f816bdd9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f816415d470 0x7f8164153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.826+0000 7f816bdd9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f816415d850 0x7f81640cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.826+0000 7f816bdd9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81640cb9e0 con 0x7f816415d470 2023-12-22T08:48:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.826+0000 7f816bdd9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816415ea50 con 0x7f8164071ea0 2023-12-22T08:48:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.826+0000 7f816bdd9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816415dea0 con 0x7f816415d850 2023-12-22T08:48:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.826+0000 7f8169374640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f816415d470 0x7f8164153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.826+0000 7f8169374640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f816415d470 0x7f8164153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47814/0 (socket says 172.21.15.38:47814) 2023-12-22T08:48:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.826+0000 7f8169374640 1 -- 172.21.15.38:0/868510160 learned_addr learned my addr 172.21.15.38:0/868510160 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.826+0000 7f8169b75640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8164071ea0 0x7f816414e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.827+0000 7f816a376640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f816415d850 0x7f81640cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.827+0000 7f8169374640 1 -- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f816415d850 msgr2=0x7f81640cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:27.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.827+0000 7f8169374640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f816415d850 0x7f81640cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.827+0000 7f8169374640 1 -- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8164071ea0 msgr2=0x7f816414e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:27.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.827+0000 7f8169374640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8164071ea0 0x7f816414e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:27.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.827+0000 7f8169374640 1 -- 172.21.15.38:0/868510160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c0094d0 con 0x7f816415d470 2023-12-22T08:48:27.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.827+0000 7f816a376640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f816415d850 0x7f81640cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:27.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.827+0000 7f8169374640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f816415d470 0x7f8164153570 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f815400d830 tx=0x7f815400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:27.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.827+0000 7f815a7fc640 1 -- 172.21.15.38:0/868510160 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815400b6c0 con 0x7f816415d470 2023-12-22T08:48:27.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.827+0000 7f815a7fc640 1 -- 172.21.15.38:0/868510160 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815400b820 con 0x7f816415d470 2023-12-22T08:48:27.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.827+0000 7f815a7fc640 1 -- 172.21.15.38:0/868510160 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815400bbb0 con 0x7f816415d470 2023-12-22T08:48:27.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.827+0000 7f816bdd9640 1 -- 172.21.15.38:0/868510160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816415e120 con 0x7f816415d470 2023-12-22T08:48:27.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.828+0000 7f816bdd9640 1 -- 172.21.15.38:0/868510160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816415e6e0 con 0x7f816415d470 2023-12-22T08:48:27.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.829+0000 7f816bdd9640 1 -- 172.21.15.38:0/868510160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f816415ec00 con 0x7f816415d470 2023-12-22T08:48:27.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.830+0000 7f815a7fc640 1 -- 172.21.15.38:0/868510160 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f815401e460 con 0x7f816415d470 2023-12-22T08:48:27.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.831+0000 7f815a7fc640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f814806a460 0x7f814806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:27.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.831+0000 7f815a7fc640 1 -- 172.21.15.38:0/868510160 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8154088ff0 con 0x7f816415d470 2023-12-22T08:48:27.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.831+0000 7f815a7fc640 1 -- 172.21.15.38:0/868510160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7f8148071f90 con 0x7f816415d470 2023-12-22T08:48:27.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.831+0000 7f8169b75640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f814806a460 0x7f814806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:27.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.833+0000 7f8169b75640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f814806a460 0x7f814806c920 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f81640b2b00 tx=0x7f8160003a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:27.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:27.835+0000 7f815a7fc640 1 -- 172.21.15.38:0/868510160 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f81540bbc80 con 0x7f816415d470 2023-12-22T08:48:28.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.033+0000 7f816bdd9640 1 -- 172.21.15.38:0/868510160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8164061910 con 0x7f816415d470 2023-12-22T08:48:28.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.035+0000 7f815a7fc640 1 -- 172.21.15.38:0/868510160 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16094 (secure 0 0 0) 0x7f816415ec00 con 0x7f816415d470 2023-12-22T08:48:28.037 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:28.037 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":146,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:48:26.288077+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:48.219096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:49.341846+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:48:28.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.038+0000 7f816bdd9640 1 -- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f814806a460 msgr2=0x7f814806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:28.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.038+0000 7f816bdd9640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f814806a460 0x7f814806c920 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f81640b2b00 tx=0x7f8160003a10 comp rx=0 tx=0).stop 2023-12-22T08:48:28.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.038+0000 7f816bdd9640 1 -- 172.21.15.38:0/868510160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f816415d470 msgr2=0x7f8164153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:28.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.038+0000 7f816bdd9640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f816415d470 0x7f8164153570 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f815400d830 tx=0x7f815400dcf0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.039+0000 7f816bdd9640 1 -- 172.21.15.38:0/868510160 shutdown_connections 2023-12-22T08:48:28.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.039+0000 7f816bdd9640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f816415d850 0x7f81640cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.039+0000 7f816bdd9640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f814806a460 0x7f814806c920 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.039+0000 7f816bdd9640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f816415d470 0x7f8164153570 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.039+0000 7f816bdd9640 1 --2- 172.21.15.38:0/868510160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8164071ea0 0x7f816414e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.039+0000 7f816bdd9640 1 -- 172.21.15.38:0/868510160 >> 172.21.15.38:0/868510160 conn(0x7f81640cf070 msgr2=0x7f8164157fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:28.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.039+0000 7f816bdd9640 1 -- 172.21.15.38:0/868510160 shutdown_connections 2023-12-22T08:48:28.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.039+0000 7f816bdd9640 1 -- 172.21.15.38:0/868510160 wait complete. 2023-12-22T08:48:28.061 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:48:28.062 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:48:28.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.289+0000 7f0fa3229640 1 Processor -- start 2023-12-22T08:48:28.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.289+0000 7f0fa3229640 1 -- start start 2023-12-22T08:48:28.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.291+0000 7f0fa3229640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0f9c161340 0x7f0f9c071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:28.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.291+0000 7f0fa3229640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0f9c071fa0 0x7f0f9c0adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:28.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.291+0000 7f0fa3229640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9c0ce950 con 0x7f0f9c161720 2023-12-22T08:48:28.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.291+0000 7f0fa3229640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9c0cdd40 con 0x7f0f9c161340 2023-12-22T08:48:28.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.291+0000 7f0fa3229640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9c0ce020 con 0x7f0f9c071fa0 2023-12-22T08:48:28.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.292+0000 7f0fa2a28640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0f9c161720 0x7f0f9c0ae1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57796/0 (socket says 172.21.15.38:57796) 2023-12-22T08:48:28.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.292+0000 7f0fa2a28640 1 -- 172.21.15.38:0/3781534316 learned_addr learned my addr 172.21.15.38:0/3781534316 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.292+0000 7f0fa2227640 1 --2- 172.21.15.38:0/3781534316 >> v2:172.21.15.38:3300/0 conn(0x7f0f9c161340 0x7f0f9c071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.292+0000 7f0fa1a26640 1 --2- 172.21.15.38:0/3781534316 >> v2:172.21.15.89:3300/0 conn(0x7f0f9c071fa0 0x7f0f9c0adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.292+0000 7f0fa1225640 1 -- 172.21.15.38:0/3781534316 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595236292 0 0) 0x7f0f9c0ce950 con 0x7f0f9c161720 2023-12-22T08:48:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.292+0000 7f0fa1225640 1 -- 172.21.15.38:0/3781534316 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f88003520 con 0x7f0f9c161720 2023-12-22T08:48:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.292+0000 7f0fa2227640 1 -- 172.21.15.38:0/3781534316 >> v2:172.21.15.89:3300/0 conn(0x7f0f9c071fa0 msgr2=0x7f0f9c0adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.292+0000 7f0fa2227640 1 --2- 172.21.15.38:0/3781534316 >> v2:172.21.15.89:3300/0 conn(0x7f0f9c071fa0 0x7f0f9c0adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.292+0000 7f0fa2227640 1 -- 172.21.15.38:0/3781534316 >> v1:172.21.15.38:6789/0 conn(0x7f0f9c161720 legacy=0x7f0f9c0ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.293+0000 7f0fa2227640 1 -- 172.21.15.38:0/3781534316 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0ce300 con 0x7f0f9c161340 2023-12-22T08:48:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.294+0000 7f0fa2227640 1 --2- 172.21.15.38:0/3781534316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c161340 0x7f0f9c071a60 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0ce8c0 tx=0x7f0f9802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570a3a3f64c4b4bc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:28.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.294+0000 7f0fa1225640 1 -- 172.21.15.38:0/3781534316 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98031710 con 0x7f0f9c161340 2023-12-22T08:48:28.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.294+0000 7f0fa1225640 1 -- 172.21.15.38:0/3781534316 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9802f050 con 0x7f0f9c161340 2023-12-22T08:48:28.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.294+0000 7f0fa1225640 1 -- 172.21.15.38:0/3781534316 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98031a90 con 0x7f0f9c161340 2023-12-22T08:48:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.295+0000 7f0fa3229640 1 -- 172.21.15.38:0/3781534316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c161340 msgr2=0x7f0f9c071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.295+0000 7f0fa3229640 1 --2- 172.21.15.38:0/3781534316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c161340 0x7f0f9c071a60 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0ce8c0 tx=0x7f0f9802b7b0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.295+0000 7f0fa3229640 1 -- 172.21.15.38:0/3781534316 shutdown_connections 2023-12-22T08:48:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.295+0000 7f0fa3229640 1 --2- 172.21.15.38:0/3781534316 >> v2:172.21.15.89:3300/0 conn(0x7f0f9c071fa0 0x7f0f9c0adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.295+0000 7f0fa3229640 1 --2- 172.21.15.38:0/3781534316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c161340 0x7f0f9c071a60 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.295+0000 7f0fa3229640 1 -- 172.21.15.38:0/3781534316 >> 172.21.15.38:0/3781534316 conn(0x7f0f9c0b1f70 msgr2=0x7f0f9c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.295+0000 7f0fa3229640 1 -- 172.21.15.38:0/3781534316 shutdown_connections 2023-12-22T08:48:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.295+0000 7f0fa3229640 1 -- 172.21.15.38:0/3781534316 wait complete. 2023-12-22T08:48:28.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.297+0000 7f0fa3229640 1 Processor -- start 2023-12-22T08:48:28.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.297+0000 7f0fa3229640 1 -- start start 2023-12-22T08:48:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.298+0000 7f0fa3229640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c071fa0 0x7f0f9c1f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.298+0000 7f0fa3229640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f9c161340 0x7f0f9c159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.298+0000 7f0fa3229640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9c161720 0x7f0f9c155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.298+0000 7f0fa3229640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c141e40 con 0x7f0f9c071fa0 2023-12-22T08:48:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.298+0000 7f0fa3229640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c1418c0 con 0x7f0f9c161340 2023-12-22T08:48:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.298+0000 7f0fa3229640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c1f62e0 con 0x7f0f9c161720 2023-12-22T08:48:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.298+0000 7f0fa2227640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c071fa0 0x7f0f9c1f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.298+0000 7f0fa2227640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c071fa0 0x7f0f9c1f6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47826/0 (socket says 172.21.15.38:47826) 2023-12-22T08:48:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.298+0000 7f0fa2227640 1 -- 172.21.15.38:0/355388639 learned_addr learned my addr 172.21.15.38:0/355388639 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.299+0000 7f0fa1a26640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f9c161340 0x7f0f9c159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.299+0000 7f0fa2227640 1 -- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9c161720 msgr2=0x7f0f9c155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.299+0000 7f0fa2a28640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9c161720 0x7f0f9c155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.299+0000 7f0fa2227640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9c161720 0x7f0f9c155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.299+0000 7f0fa2227640 1 -- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f9c161340 msgr2=0x7f0f9c159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.299+0000 7f0fa2227640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f9c161340 0x7f0f9c159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.299+0000 7f0fa2227640 1 -- 172.21.15.38:0/355388639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f98009400 con 0x7f0f9c071fa0 2023-12-22T08:48:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.299+0000 7f0fa1a26640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f9c161340 0x7f0f9c159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.299+0000 7f0fa2a28640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9c161720 0x7f0f9c155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.299+0000 7f0fa2227640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c071fa0 0x7f0f9c1f6d80 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f0f98000c00 tx=0x7f0f980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.299+0000 7f0f92ffd640 1 -- 172.21.15.38:0/355388639 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9803c810 con 0x7f0f9c071fa0 2023-12-22T08:48:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.300+0000 7f0f92ffd640 1 -- 172.21.15.38:0/355388639 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9803c970 con 0x7f0f9c071fa0 2023-12-22T08:48:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.300+0000 7f0f92ffd640 1 -- 172.21.15.38:0/355388639 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9803cd20 con 0x7f0f9c071fa0 2023-12-22T08:48:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.300+0000 7f0fa3229640 1 -- 172.21.15.38:0/355388639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c156180 con 0x7f0f9c071fa0 2023-12-22T08:48:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.300+0000 7f0fa3229640 1 -- 172.21.15.38:0/355388639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c1f6580 con 0x7f0f9c071fa0 2023-12-22T08:48:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.301+0000 7f0fa3229640 1 -- 172.21.15.38:0/355388639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9c061910 con 0x7f0f9c071fa0 2023-12-22T08:48:28.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.302+0000 7f0f92ffd640 1 -- 172.21.15.38:0/355388639 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f9803a040 con 0x7f0f9c071fa0 2023-12-22T08:48:28.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.303+0000 7f0f92ffd640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f8006a430 0x7f0f8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:28.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.303+0000 7f0f92ffd640 1 -- 172.21.15.38:0/355388639 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f980a9ab0 con 0x7f0f9c071fa0 2023-12-22T08:48:28.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.303+0000 7f0f92ffd640 1 -- 172.21.15.38:0/355388639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7f0f80071f60 con 0x7f0f9c071fa0 2023-12-22T08:48:28.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.304+0000 7f0fa1a26640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f8006a430 0x7f0f8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:28.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.305+0000 7f0fa1a26640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f8006a430 0x7f0f8006c8f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c145580 tx=0x7f0f8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:28.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.307+0000 7f0f92ffd640 1 -- 172.21.15.38:0/355388639 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0f98075090 con 0x7f0f9c071fa0 2023-12-22T08:48:28.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.542+0000 7f0fa3229640 1 -- 172.21.15.38:0/355388639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f9c0a0130 con 0x7f0f9c071fa0 2023-12-22T08:48:28.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.543+0000 7f0f92ffd640 1 -- 172.21.15.38:0/355388639 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f0f9804c090 con 0x7f0f9c071fa0 2023-12-22T08:48:28.544 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:28.545 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3891984223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3891984223},{"type":"v1","addr":"172.21.15.38:6834","nonce":3891984223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1561904072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1561904072},{"type":"v1","addr":"172.21.15.89:6836","nonce":1561904072}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4192516230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4192516230},{"type":"v1","addr":"172.21.15.89:6837","nonce":4192516230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:50.322298+0000","modified":"2023-12-22T08:47:53.343300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7716},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7716":{"gid":7716,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1276125280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1276125280},{"type":"v1","addr":"172.21.15.38:6835","nonce":1276125280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-22T08:48:28.545 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 62 2023-12-22T08:48:28.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.546+0000 7f0fa3229640 1 -- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f8006a430 msgr2=0x7f0f8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:28.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.546+0000 7f0fa3229640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f8006a430 0x7f0f8006c8f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c145580 tx=0x7f0f8c008040 comp rx=0 tx=0).stop 2023-12-22T08:48:28.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.546+0000 7f0fa3229640 1 -- 172.21.15.38:0/355388639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c071fa0 msgr2=0x7f0f9c1f6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:28.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.546+0000 7f0fa3229640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c071fa0 0x7f0f9c1f6d80 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f0f98000c00 tx=0x7f0f980046c0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.546+0000 7f0fa3229640 1 -- 172.21.15.38:0/355388639 shutdown_connections 2023-12-22T08:48:28.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.546+0000 7f0fa3229640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9c161720 0x7f0f9c155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.546+0000 7f0fa3229640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f9c161340 0x7f0f9c159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.546+0000 7f0fa3229640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0f8006a430 0x7f0f8006c8f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.546+0000 7f0fa3229640 1 --2- 172.21.15.38:0/355388639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c071fa0 0x7f0f9c1f6d80 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.546+0000 7f0fa3229640 1 -- 172.21.15.38:0/355388639 >> 172.21.15.38:0/355388639 conn(0x7f0f9c0b1f70 msgr2=0x7f0f9c15bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:28.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.546+0000 7f0fa3229640 1 -- 172.21.15.38:0/355388639 shutdown_connections 2023-12-22T08:48:28.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.546+0000 7f0fa3229640 1 -- 172.21.15.38:0/355388639 wait complete. 2023-12-22T08:48:28.567 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:48:28.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.791+0000 7f4dadf0c640 1 Processor -- start 2023-12-22T08:48:28.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.791+0000 7f4dadf0c640 1 -- start start 2023-12-22T08:48:28.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.793+0000 7f4dadf0c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da8157980 0x7f4da815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:28.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.793+0000 7f4dadf0c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4da80b3ff0 0x7f4da806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:28.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.793+0000 7f4dadf0c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da80d1520 con 0x7f4da80b4470 2023-12-22T08:48:28.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.793+0000 7f4dadf0c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da80d1800 con 0x7f4da80b3ff0 2023-12-22T08:48:28.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.793+0000 7f4dadf0c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80d1ae0 con 0x7f4da8157980 2023-12-22T08:48:28.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.794+0000 7f4dacf0a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da8157980 0x7f4da815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:28.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.794+0000 7f4dacf0a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da8157980 0x7f4da815eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:59542/0 (socket says 172.21.15.38:59542) 2023-12-22T08:48:28.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.794+0000 7f4dacf0a640 1 -- 172.21.15.38:0/17427265 learned_addr learned my addr 172.21.15.38:0/17427265 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:28.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.794+0000 7f4da7fff640 1 --2- 172.21.15.38:0/17427265 >> v2:172.21.15.89:3300/0 conn(0x7f4da80b3ff0 0x7f4da806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:28.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.795+0000 7f4dacf0a640 1 -- 172.21.15.38:0/17427265 >> v2:172.21.15.89:3300/0 conn(0x7f4da80b3ff0 msgr2=0x7f4da806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:28.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.795+0000 7f4dacf0a640 1 --2- 172.21.15.38:0/17427265 >> v2:172.21.15.89:3300/0 conn(0x7f4da80b3ff0 0x7f4da806cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.795+0000 7f4dacf0a640 1 -- 172.21.15.38:0/17427265 >> v1:172.21.15.89:6789/0 conn(0x7f4da80b4470 legacy=0x7f4da80d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:28.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.795+0000 7f4dacf0a640 1 -- 172.21.15.38:0/17427265 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da80d1dc0 con 0x7f4da8157980 2023-12-22T08:48:28.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.796+0000 7f4dacf0a640 1 --2- 172.21.15.38:0/17427265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da8157980 0x7f4da815eb10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009870 tx=0x7f4d9c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ce04b18bf44f681 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:28.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.797+0000 7f4da77fe640 1 -- 172.21.15.38:0/17427265 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c030840 con 0x7f4da8157980 2023-12-22T08:48:28.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.797+0000 7f4da77fe640 1 -- 172.21.15.38:0/17427265 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c0309a0 con 0x7f4da8157980 2023-12-22T08:48:28.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.797+0000 7f4da77fe640 1 -- 172.21.15.38:0/17427265 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c030d30 con 0x7f4da8157980 2023-12-22T08:48:28.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.797+0000 7f4dadf0c640 1 -- 172.21.15.38:0/17427265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da8157980 msgr2=0x7f4da815eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:28.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.797+0000 7f4dadf0c640 1 --2- 172.21.15.38:0/17427265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da8157980 0x7f4da815eb10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009870 tx=0x7f4d9c02b980 comp rx=0 tx=0).stop 2023-12-22T08:48:28.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.797+0000 7f4dadf0c640 1 -- 172.21.15.38:0/17427265 shutdown_connections 2023-12-22T08:48:28.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.797+0000 7f4dadf0c640 1 --2- 172.21.15.38:0/17427265 >> v2:172.21.15.89:3300/0 conn(0x7f4da80b3ff0 0x7f4da806cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.798+0000 7f4dadf0c640 1 --2- 172.21.15.38:0/17427265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da8157980 0x7f4da815eb10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.798+0000 7f4dadf0c640 1 -- 172.21.15.38:0/17427265 >> 172.21.15.38:0/17427265 conn(0x7f4da80d31f0 msgr2=0x7f4da80d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:28.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.798+0000 7f4dadf0c640 1 -- 172.21.15.38:0/17427265 shutdown_connections 2023-12-22T08:48:28.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.798+0000 7f4dadf0c640 1 -- 172.21.15.38:0/17427265 wait complete. 2023-12-22T08:48:28.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.799+0000 7f4dadf0c640 1 Processor -- start 2023-12-22T08:48:28.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.800+0000 7f4dadf0c640 1 -- start start 2023-12-22T08:48:28.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.800+0000 7f4dadf0c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4da80b3ff0 0x7f4da80b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:28.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.800+0000 7f4dadf0c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da80b4470 0x7f4da815fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:28.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.800+0000 7f4dadf0c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da8157980 0x7f4da8141b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:28.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.800+0000 7f4dadf0c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80b8ca0 con 0x7f4da80b3ff0 2023-12-22T08:48:28.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.800+0000 7f4dadf0c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8160010 con 0x7f4da80b4470 2023-12-22T08:48:28.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.801+0000 7f4dadf0c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da81420d0 con 0x7f4da8157980 2023-12-22T08:48:28.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.801+0000 7f4dacf0a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4da80b3ff0 0x7f4da80b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:28.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.801+0000 7f4dacf0a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4da80b3ff0 0x7f4da80b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47830/0 (socket says 172.21.15.38:47830) 2023-12-22T08:48:28.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.801+0000 7f4dacf0a640 1 -- 172.21.15.38:0/3498787743 learned_addr learned my addr 172.21.15.38:0/3498787743 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:28.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.801+0000 7f4da7fff640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da80b4470 0x7f4da815fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:28.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.801+0000 7f4dad70b640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da8157980 0x7f4da8141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:28.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.801+0000 7f4dacf0a640 1 -- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da8157980 msgr2=0x7f4da8141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:28.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.801+0000 7f4dacf0a640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da8157980 0x7f4da8141b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.801+0000 7f4dacf0a640 1 -- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da80b4470 msgr2=0x7f4da815fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:28.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.801+0000 7f4dacf0a640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da80b4470 0x7f4da815fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:28.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.801+0000 7f4dacf0a640 1 -- 172.21.15.38:0/3498787743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c0094d0 con 0x7f4da80b3ff0 2023-12-22T08:48:28.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.802+0000 7f4dacf0a640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4da80b3ff0 0x7f4da80b85a0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0090b0 tx=0x7f4d9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:28.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.802+0000 7f4da57fa640 1 -- 172.21.15.38:0/3498787743 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c03e070 con 0x7f4da80b3ff0 2023-12-22T08:48:28.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.802+0000 7f4da57fa640 1 -- 172.21.15.38:0/3498787743 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c039a10 con 0x7f4da80b3ff0 2023-12-22T08:48:28.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.802+0000 7f4da57fa640 1 -- 172.21.15.38:0/3498787743 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c039de0 con 0x7f4da80b3ff0 2023-12-22T08:48:28.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.802+0000 7f4dadf0c640 1 -- 172.21.15.38:0/3498787743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da80b70b0 con 0x7f4da80b3ff0 2023-12-22T08:48:28.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.802+0000 7f4dadf0c640 1 -- 172.21.15.38:0/3498787743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da80b6780 con 0x7f4da80b3ff0 2023-12-22T08:48:28.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.803+0000 7f4dadf0c640 1 -- 172.21.15.38:0/3498787743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da8061910 con 0x7f4da80b3ff0 2023-12-22T08:48:28.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.804+0000 7f4da57fa640 1 -- 172.21.15.38:0/3498787743 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4d9c04b400 con 0x7f4da80b3ff0 2023-12-22T08:48:28.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.805+0000 7f4da57fa640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d8c06a430 0x7f4d8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:28.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.806+0000 7f4da57fa640 1 -- 172.21.15.38:0/3498787743 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d9c0aaee0 con 0x7f4da80b3ff0 2023-12-22T08:48:28.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.806+0000 7f4da57fa640 1 -- 172.21.15.38:0/3498787743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7f4d8c071f60 con 0x7f4da80b3ff0 2023-12-22T08:48:28.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.806+0000 7f4da7fff640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d8c06a430 0x7f4d8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:28.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.807+0000 7f4da7fff640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d8c06a430 0x7f4d8c06c8f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4da814c390 tx=0x7f4d94008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:28.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:28.810+0000 7f4da57fa640 1 -- 172.21.15.38:0/3498787743 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4d9c034060 con 0x7f4da80b3ff0 2023-12-22T08:48:29.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.041+0000 7f4dadf0c640 1 -- 172.21.15.38:0/3498787743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4da815c660 con 0x7f4da80b3ff0 2023-12-22T08:48:29.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.042+0000 7f4da57fa640 1 -- 172.21.15.38:0/3498787743 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4650 (secure 0 0 0) 0x7f4d9c076430 con 0x7f4da80b3ff0 2023-12-22T08:48:29.043 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:29.044 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3891984223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3891984223},{"type":"v1","addr":"172.21.15.38:6834","nonce":3891984223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1561904072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1561904072},{"type":"v1","addr":"172.21.15.89:6836","nonce":1561904072}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4192516230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4192516230},{"type":"v1","addr":"172.21.15.89:6837","nonce":4192516230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:47:50.322298+0000","modified":"2023-12-22T08:47:53.343300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7716},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7716":{"gid":7716,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/1276125280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1276125280},{"type":"v1","addr":"172.21.15.38:6835","nonce":1276125280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-22T08:48:29.044 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 62 2023-12-22T08:48:29.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.044+0000 7f4dadf0c640 1 -- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d8c06a430 msgr2=0x7f4d8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:29.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.044+0000 7f4dadf0c640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d8c06a430 0x7f4d8c06c8f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4da814c390 tx=0x7f4d94008040 comp rx=0 tx=0).stop 2023-12-22T08:48:29.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.044+0000 7f4dadf0c640 1 -- 172.21.15.38:0/3498787743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4da80b3ff0 msgr2=0x7f4da80b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:29.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.044+0000 7f4dadf0c640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4da80b3ff0 0x7f4da80b85a0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0090b0 tx=0x7f4d9c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.045+0000 7f4dadf0c640 1 -- 172.21.15.38:0/3498787743 shutdown_connections 2023-12-22T08:48:29.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.045+0000 7f4dadf0c640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4da8157980 0x7f4da8141b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.045+0000 7f4dadf0c640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4da80b4470 0x7f4da815fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.045+0000 7f4dadf0c640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4d8c06a430 0x7f4d8c06c8f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.045+0000 7f4dadf0c640 1 --2- 172.21.15.38:0/3498787743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4da80b3ff0 0x7f4da80b85a0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.045+0000 7f4dadf0c640 1 -- 172.21.15.38:0/3498787743 >> 172.21.15.38:0/3498787743 conn(0x7f4da80d31f0 msgr2=0x7f4da814dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:29.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.045+0000 7f4dadf0c640 1 -- 172.21.15.38:0/3498787743 shutdown_connections 2023-12-22T08:48:29.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.045+0000 7f4dadf0c640 1 -- 172.21.15.38:0/3498787743 wait complete. 2023-12-22T08:48:29.065 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:48:29.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.288+0000 7f7e2813c640 1 Processor -- start 2023-12-22T08:48:29.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.288+0000 7f7e2813c640 1 -- start start 2023-12-22T08:48:29.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.290+0000 7f7e2813c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e2015d470 0x7f7e200b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:29.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.290+0000 7f7e2813c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e2015d850 0x7f7e200ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:29.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.290+0000 7f7e2813c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e200ac8e0 con 0x7f7e20071ea0 2023-12-22T08:48:29.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.290+0000 7f7e2813c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e200b4550 con 0x7f7e2015d850 2023-12-22T08:48:29.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.290+0000 7f7e2813c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e200b4940 con 0x7f7e2015d470 2023-12-22T08:48:29.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.291+0000 7f7e266d9640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7e20071ea0 0x7f7e200b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:36118/0 (socket says 172.21.15.38:36118) 2023-12-22T08:48:29.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.291+0000 7f7e266d9640 1 -- 172.21.15.38:0/1008079661 learned_addr learned my addr 172.21.15.38:0/1008079661 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:29.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.291+0000 7f7e256d7640 1 --2- 172.21.15.38:0/1008079661 >> v2:172.21.15.89:3300/0 conn(0x7f7e2015d850 0x7f7e200ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:29.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.291+0000 7f7e25ed8640 1 --2- 172.21.15.38:0/1008079661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e2015d470 0x7f7e200b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:29.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.291+0000 7f7e24ed6640 1 -- 172.21.15.38:0/1008079661 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405883841 0 0) 0x7f7e200ac8e0 con 0x7f7e20071ea0 2023-12-22T08:48:29.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.291+0000 7f7e256d7640 1 -- 172.21.15.38:0/1008079661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e2015d470 msgr2=0x7f7e200b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:29.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.291+0000 7f7e256d7640 1 --2- 172.21.15.38:0/1008079661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e2015d470 0x7f7e200b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.291+0000 7f7e256d7640 1 -- 172.21.15.38:0/1008079661 >> v1:172.21.15.89:6789/0 conn(0x7f7e20071ea0 legacy=0x7f7e200b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:29.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.291+0000 7f7e256d7640 1 -- 172.21.15.38:0/1008079661 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e200b4c20 con 0x7f7e2015d850 2023-12-22T08:48:29.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.293+0000 7f7e256d7640 1 --2- 172.21.15.38:0/1008079661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e2015d850 0x7f7e200ad330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7e100097a0 tx=0x7f7e1002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a59fa5ea9225fbd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:29.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.294+0000 7f7e24ed6640 1 -- 172.21.15.38:0/1008079661 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10031830 con 0x7f7e2015d850 2023-12-22T08:48:29.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.294+0000 7f7e24ed6640 1 -- 172.21.15.38:0/1008079661 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e10031990 con 0x7f7e2015d850 2023-12-22T08:48:29.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.294+0000 7f7e24ed6640 1 -- 172.21.15.38:0/1008079661 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10031d20 con 0x7f7e2015d850 2023-12-22T08:48:29.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.294+0000 7f7e2813c640 1 -- 172.21.15.38:0/1008079661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e2015d850 msgr2=0x7f7e200ad330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:29.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.294+0000 7f7e2813c640 1 --2- 172.21.15.38:0/1008079661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e2015d850 0x7f7e200ad330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7e100097a0 tx=0x7f7e1002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.294+0000 7f7e2813c640 1 -- 172.21.15.38:0/1008079661 shutdown_connections 2023-12-22T08:48:29.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.294+0000 7f7e2813c640 1 --2- 172.21.15.38:0/1008079661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e2015d850 0x7f7e200ad330 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.294+0000 7f7e2813c640 1 --2- 172.21.15.38:0/1008079661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e2015d470 0x7f7e200b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.294+0000 7f7e2813c640 1 -- 172.21.15.38:0/1008079661 >> 172.21.15.38:0/1008079661 conn(0x7f7e200cf070 msgr2=0x7f7e200cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:29.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.295+0000 7f7e2813c640 1 -- 172.21.15.38:0/1008079661 shutdown_connections 2023-12-22T08:48:29.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.295+0000 7f7e2813c640 1 -- 172.21.15.38:0/1008079661 wait complete. 2023-12-22T08:48:29.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.297+0000 7f7e2813c640 1 Processor -- start 2023-12-22T08:48:29.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.297+0000 7f7e2813c640 1 -- start start 2023-12-22T08:48:29.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e2813c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e20071ea0 0x7f7e20153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:29.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e2813c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e2015d470 0x7f7e2015e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:29.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e2813c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e2015d850 0x7f7e20151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:29.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e2813c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e200cc510 con 0x7f7e2015d850 2023-12-22T08:48:29.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e2813c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e200cb620 con 0x7f7e20071ea0 2023-12-22T08:48:29.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e2813c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e200cb900 con 0x7f7e2015d470 2023-12-22T08:48:29.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e266d9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e2015d850 0x7f7e20151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:29.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e266d9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e2015d850 0x7f7e20151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47840/0 (socket says 172.21.15.38:47840) 2023-12-22T08:48:29.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e266d9640 1 -- 172.21.15.38:0/1153100425 learned_addr learned my addr 172.21.15.38:0/1153100425 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e25ed8640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e20071ea0 0x7f7e20153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e256d7640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e2015d470 0x7f7e2015e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e266d9640 1 -- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e2015d470 msgr2=0x7f7e2015e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e266d9640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e2015d470 0x7f7e2015e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e266d9640 1 -- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e20071ea0 msgr2=0x7f7e20153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.299+0000 7f7e266d9640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e20071ea0 0x7f7e20153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.300+0000 7f7e266d9640 1 -- 172.21.15.38:0/1153100425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e10009400 con 0x7f7e2015d850 2023-12-22T08:48:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.300+0000 7f7e266d9640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e2015d850 0x7f7e20151be0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800c7a0 tx=0x7f7e1800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.300+0000 7f7e167fc640 1 -- 172.21.15.38:0/1153100425 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800a640 con 0x7f7e2015d850 2023-12-22T08:48:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.300+0000 7f7e167fc640 1 -- 172.21.15.38:0/1153100425 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1800a7a0 con 0x7f7e2015d850 2023-12-22T08:48:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.300+0000 7f7e2813c640 1 -- 172.21.15.38:0/1153100425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e200cbbe0 con 0x7f7e2015d850 2023-12-22T08:48:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.300+0000 7f7e167fc640 1 -- 172.21.15.38:0/1153100425 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800abd0 con 0x7f7e2015d850 2023-12-22T08:48:29.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.300+0000 7f7e2813c640 1 -- 172.21.15.38:0/1153100425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e200cc1a0 con 0x7f7e2015d850 2023-12-22T08:48:29.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.301+0000 7f7e2813c640 1 -- 172.21.15.38:0/1153100425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e200cc680 con 0x7f7e2015d850 2023-12-22T08:48:29.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.302+0000 7f7e167fc640 1 -- 172.21.15.38:0/1153100425 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e1800ad30 con 0x7f7e2015d850 2023-12-22T08:48:29.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.304+0000 7f7e167fc640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e0406a430 0x7f7e0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:29.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.304+0000 7f7e167fc640 1 -- 172.21.15.38:0/1153100425 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e18088110 con 0x7f7e2015d850 2023-12-22T08:48:29.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.304+0000 7f7e167fc640 1 -- 172.21.15.38:0/1153100425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7f7e04071f60 con 0x7f7e2015d850 2023-12-22T08:48:29.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.304+0000 7f7e25ed8640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e0406a430 0x7f7e0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:29.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.306+0000 7f7e25ed8640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e0406a430 0x7f7e0406c8f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009ad0 tx=0x7f7e1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:29.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.311+0000 7f7e167fc640 1 -- 172.21.15.38:0/1153100425 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7e180536f0 con 0x7f7e2015d850 2023-12-22T08:48:29.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.509+0000 7f7e2813c640 1 -- 172.21.15.38:0/1153100425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e20061910 con 0x7f7e2015d850 2023-12-22T08:48:29.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.512+0000 7f7e167fc640 1 -- 172.21.15.38:0/1153100425 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16094 (secure 0 0 0) 0x7f7e18018030 con 0x7f7e2015d850 2023-12-22T08:48:29.513 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:29.514 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":146,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:48:26.288077+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:47:48.219096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-22T08:47:49.341846+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:48:29.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.515+0000 7f7e2813c640 1 -- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e0406a430 msgr2=0x7f7e0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:29.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.515+0000 7f7e2813c640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e0406a430 0x7f7e0406c8f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009ad0 tx=0x7f7e1c008040 comp rx=0 tx=0).stop 2023-12-22T08:48:29.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.515+0000 7f7e2813c640 1 -- 172.21.15.38:0/1153100425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e2015d850 msgr2=0x7f7e20151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:29.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.515+0000 7f7e2813c640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e2015d850 0x7f7e20151be0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800c7a0 tx=0x7f7e1800cc60 comp rx=0 tx=0).stop 2023-12-22T08:48:29.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.515+0000 7f7e2813c640 1 -- 172.21.15.38:0/1153100425 shutdown_connections 2023-12-22T08:48:29.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.515+0000 7f7e2813c640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7e0406a430 0x7f7e0406c8f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.515+0000 7f7e2813c640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7e2015d850 0x7f7e20151be0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.515+0000 7f7e2813c640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e2015d470 0x7f7e2015e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.515+0000 7f7e2813c640 1 --2- 172.21.15.38:0/1153100425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e20071ea0 0x7f7e20153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.515+0000 7f7e2813c640 1 -- 172.21.15.38:0/1153100425 >> 172.21.15.38:0/1153100425 conn(0x7f7e200cf070 msgr2=0x7f7e2006d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:29.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.515+0000 7f7e2813c640 1 -- 172.21.15.38:0/1153100425 shutdown_connections 2023-12-22T08:48:29.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.515+0000 7f7e2813c640 1 -- 172.21.15.38:0/1153100425 wait complete. 2023-12-22T08:48:29.537 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T08:48:29.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.767+0000 7fa8497d9640 1 Processor -- start 2023-12-22T08:48:29.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.767+0000 7fa8497d9640 1 -- start start 2023-12-22T08:48:29.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.769+0000 7fa8497d9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa844144d10 0x7fa8440cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:29.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.769+0000 7fa8497d9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8441450f0 con 0x7fa8440b2760 2023-12-22T08:48:29.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.769+0000 7fa8497d9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8440ce010 con 0x7fa8440cc670 2023-12-22T08:48:29.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.769+0000 7fa8497d9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8440ce2f0 con 0x7fa844144d10 2023-12-22T08:48:29.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.770+0000 7fa842ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa844144d10 0x7fa8440cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:29.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.770+0000 7fa842ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa844144d10 0x7fa8440cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47854/0 (socket says 172.21.15.38:47854) 2023-12-22T08:48:29.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.770+0000 7fa8437fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa8440b2760 0x7fa844070800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57800/0 (socket says 172.21.15.38:57800) 2023-12-22T08:48:29.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.770+0000 7fa842ffd640 1 -- 172.21.15.38:0/3663018189 learned_addr learned my addr 172.21.15.38:0/3663018189 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:29.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.770+0000 7fa842ffd640 1 -- 172.21.15.38:0/3663018189 >> v1:172.21.15.89:6789/0 conn(0x7fa8440cc670 legacy=0x7fa8440b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:29.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.770+0000 7fa842ffd640 1 -- 172.21.15.38:0/3663018189 >> v1:172.21.15.38:6789/0 conn(0x7fa8440b2760 legacy=0x7fa844070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:29.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.770+0000 7fa8427fc640 1 -- 172.21.15.38:0/3663018189 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430827647 0 0) 0x7fa8441450f0 con 0x7fa8440b2760 2023-12-22T08:48:29.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.770+0000 7fa842ffd640 1 -- 172.21.15.38:0/3663018189 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8440ce5d0 con 0x7fa844144d10 2023-12-22T08:48:29.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.772+0000 7fa842ffd640 1 --2- 172.21.15.38:0/3663018189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa844144d10 0x7fa8440cc130 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fa834009870 tx=0x7fa83402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df56d475fdd541b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:29.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.772+0000 7fa8427fc640 1 -- 172.21.15.38:0/3663018189 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83402f840 con 0x7fa844144d10 2023-12-22T08:48:29.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.772+0000 7fa8427fc640 1 -- 172.21.15.38:0/3663018189 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83402f9a0 con 0x7fa844144d10 2023-12-22T08:48:29.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.772+0000 7fa8427fc640 1 -- 172.21.15.38:0/3663018189 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83402fd30 con 0x7fa844144d10 2023-12-22T08:48:29.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.773+0000 7fa8497d9640 1 -- 172.21.15.38:0/3663018189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa844144d10 msgr2=0x7fa8440cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:29.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.773+0000 7fa8497d9640 1 --2- 172.21.15.38:0/3663018189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa844144d10 0x7fa8440cc130 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fa834009870 tx=0x7fa83402ba20 comp rx=0 tx=0).stop 2023-12-22T08:48:29.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.773+0000 7fa8497d9640 1 -- 172.21.15.38:0/3663018189 shutdown_connections 2023-12-22T08:48:29.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.773+0000 7fa8497d9640 1 --2- 172.21.15.38:0/3663018189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa844144d10 0x7fa8440cc130 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.773+0000 7fa8497d9640 1 -- 172.21.15.38:0/3663018189 >> 172.21.15.38:0/3663018189 conn(0x7fa8440cf070 msgr2=0x7fa8440cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:29.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.773+0000 7fa8497d9640 1 -- 172.21.15.38:0/3663018189 shutdown_connections 2023-12-22T08:48:29.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.773+0000 7fa8497d9640 1 -- 172.21.15.38:0/3663018189 wait complete. 2023-12-22T08:48:29.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.775+0000 7fa8497d9640 1 Processor -- start 2023-12-22T08:48:29.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.775+0000 7fa8497d9640 1 -- start start 2023-12-22T08:48:29.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.776+0000 7fa8497d9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8440b2760 0x7fa84413fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:29.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.776+0000 7fa8497d9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa844144d10 0x7fa844156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:29.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.776+0000 7fa8497d9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa84415a760 0x7fa84415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:29.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.776+0000 7fa8497d9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84415b130 con 0x7fa8440b2760 2023-12-22T08:48:29.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.776+0000 7fa8497d9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84415d9c0 con 0x7fa84415a760 2023-12-22T08:48:29.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.776+0000 7fa8497d9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84415dca0 con 0x7fa844144d10 2023-12-22T08:48:29.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.776+0000 7fa842ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8440b2760 0x7fa84413fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:29.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.776+0000 7fa842ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8440b2760 0x7fa84413fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47864/0 (socket says 172.21.15.38:47864) 2023-12-22T08:48:29.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.776+0000 7fa842ffd640 1 -- 172.21.15.38:0/1896637874 learned_addr learned my addr 172.21.15.38:0/1896637874 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:29.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.777+0000 7fa8437fe640 1 --2- 172.21.15.38:0/1896637874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa84415a760 0x7fa84415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:29.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.777+0000 7fa842ffd640 1 -- 172.21.15.38:0/1896637874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa844144d10 msgr2=0x7fa844156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:29.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.777+0000 7fa842ffd640 1 --2- 172.21.15.38:0/1896637874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa844144d10 0x7fa844156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.777+0000 7fa842ffd640 1 -- 172.21.15.38:0/1896637874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa84415a760 msgr2=0x7fa84415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:29.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.777+0000 7fa842ffd640 1 --2- 172.21.15.38:0/1896637874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa84415a760 0x7fa84415abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:29.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.777+0000 7fa842ffd640 1 -- 172.21.15.38:0/1896637874 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8340094d0 con 0x7fa8440b2760 2023-12-22T08:48:29.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.777+0000 7fa842ffd640 1 --2- 172.21.15.38:0/1896637874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8440b2760 0x7fa84413fd30 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fa8340097c0 tx=0x7fa834004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:29.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.777+0000 7fa83bfff640 1 -- 172.21.15.38:0/1896637874 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa834041400 con 0x7fa8440b2760 2023-12-22T08:48:29.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.777+0000 7fa83bfff640 1 -- 172.21.15.38:0/1896637874 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa834041560 con 0x7fa8440b2760 2023-12-22T08:48:29.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.777+0000 7fa83bfff640 1 -- 172.21.15.38:0/1896637874 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa834041910 con 0x7fa8440b2760 2023-12-22T08:48:29.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.777+0000 7fa8497d9640 1 -- 172.21.15.38:0/1896637874 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84415df80 con 0x7fa8440b2760 2023-12-22T08:48:29.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.778+0000 7fa8497d9640 1 -- 172.21.15.38:0/1896637874 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84415e540 con 0x7fa8440b2760 2023-12-22T08:48:29.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.779+0000 7fa8497d9640 1 -- 172.21.15.38:0/1896637874 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84415e730 con 0x7fa8440b2760 2023-12-22T08:48:29.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.780+0000 7fa83bfff640 1 -- 172.21.15.38:0/1896637874 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa834041a70 con 0x7fa8440b2760 2023-12-22T08:48:29.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.781+0000 7fa83bfff640 1 --2- 172.21.15.38:0/1896637874 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa82406a430 0x7fa82406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:29.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.781+0000 7fa83bfff640 1 -- 172.21.15.38:0/1896637874 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa83403c070 con 0x7fa8440b2760 2023-12-22T08:48:29.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.781+0000 7fa83bfff640 1 -- 172.21.15.38:0/1896637874 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=147}) v3 -- 0x7fa824071f60 con 0x7fa8440b2760 2023-12-22T08:48:29.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.782+0000 7fa83a7fc640 1 --2- 172.21.15.38:0/1896637874 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa82406a430 0x7fa82406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:29.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.783+0000 7fa83a7fc640 1 --2- 172.21.15.38:0/1896637874 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa82406a430 0x7fa82406c8f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0012e0 tx=0x7fa82c007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:29.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:29.786+0000 7fa83bfff640 1 -- 172.21.15.38:0/1896637874 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa834076e20 con 0x7fa8440b2760 2023-12-22T08:48:30.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.026+0000 7fa8497d9640 1 -- 172.21.15.38:0/1896637874 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa844061910 con 0x7fa8440b2760 2023-12-22T08:48:30.029 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:48:30.028+0000 7f0a26ee3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T08:48:30.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.038+0000 7fa83bfff640 1 -- 172.21.15.38:0/1896637874 <== mon.0 v2:172.21.15.38:3300/0 7 ==== osd_map(147..147 src has 1..147) v4 ==== 374+0+0 (secure 0 0 0) 0x7fa83407b1e0 con 0x7fa8440b2760 2023-12-22T08:48:30.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.038+0000 7fa83bfff640 1 -- 172.21.15.38:0/1896637874 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7fa824072810 con 0x7fa8440b2760 2023-12-22T08:48:30.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.049+0000 7fa83bfff640 1 -- 172.21.15.38:0/1896637874 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa83407a440 con 0x7fa8440b2760 2023-12-22T08:48:30.050 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T08:48:30.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.052+0000 7fa8497d9640 1 -- 172.21.15.38:0/1896637874 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa82406a430 msgr2=0x7fa82406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:30.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.052+0000 7fa8497d9640 1 --2- 172.21.15.38:0/1896637874 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa82406a430 0x7fa82406c8f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0012e0 tx=0x7fa82c007d30 comp rx=0 tx=0).stop 2023-12-22T08:48:30.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.052+0000 7fa8497d9640 1 -- 172.21.15.38:0/1896637874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8440b2760 msgr2=0x7fa84413fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:30.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.052+0000 7fa8497d9640 1 --2- 172.21.15.38:0/1896637874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8440b2760 0x7fa84413fd30 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fa8340097c0 tx=0x7fa834004730 comp rx=0 tx=0).stop 2023-12-22T08:48:30.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.052+0000 7fa8497d9640 1 -- 172.21.15.38:0/1896637874 shutdown_connections 2023-12-22T08:48:30.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.052+0000 7fa8497d9640 1 --2- 172.21.15.38:0/1896637874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa84415a760 0x7fa84415abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:30.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.052+0000 7fa8497d9640 1 --2- 172.21.15.38:0/1896637874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa844144d10 0x7fa844156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:30.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.052+0000 7fa8497d9640 1 --2- 172.21.15.38:0/1896637874 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa82406a430 0x7fa82406c8f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:30.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.052+0000 7fa8497d9640 1 --2- 172.21.15.38:0/1896637874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8440b2760 0x7fa84413fd30 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:30.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.052+0000 7fa8497d9640 1 -- 172.21.15.38:0/1896637874 >> 172.21.15.38:0/1896637874 conn(0x7fa8440cf070 msgr2=0x7fa84415bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:30.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.052+0000 7fa8497d9640 1 -- 172.21.15.38:0/1896637874 shutdown_connections 2023-12-22T08:48:30.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.052+0000 7fa8497d9640 1 -- 172.21.15.38:0/1896637874 wait complete. 2023-12-22T08:48:30.067 INFO:tasks.ceph.mds.c.smithi038.stderr: -8851> 2023-12-22T08:47:54.780+0000 7fe223c35640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:48:30.073 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T08:48:30.135 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:48:30.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.279+0000 7f29e0881640 1 Processor -- start 2023-12-22T08:48:30.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.279+0000 7f29e0881640 1 -- start start 2023-12-22T08:48:30.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.280+0000 7f29e0881640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29dc143050 0x7f29dc06de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:30.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.280+0000 7f29e0881640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f29dc143740 0x7f29dc0ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:30.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.280+0000 7f29e0881640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc0c9550 con 0x7f29dc0b1e90 2023-12-22T08:48:30.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.280+0000 7f29e0881640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc0c9830 con 0x7f29dc143050 2023-12-22T08:48:30.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.280+0000 7f29e0881640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc0c9b10 con 0x7f29dc143740 2023-12-22T08:48:30.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.281+0000 7f29da59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29dc143050 0x7f29dc06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:30.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.281+0000 7f29da59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29dc143050 0x7f29dc06de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47888/0 (socket says 172.21.15.38:47888) 2023-12-22T08:48:30.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.281+0000 7f29da59c640 1 -- 172.21.15.38:0/951636516 learned_addr learned my addr 172.21.15.38:0/951636516 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:30.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.281+0000 7f29d3fff640 1 --2- 172.21.15.38:0/951636516 >> v2:172.21.15.89:3300/0 conn(0x7f29dc143740 0x7f29dc0ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:30.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.281+0000 7f29da59c640 1 -- 172.21.15.38:0/951636516 >> v2:172.21.15.89:3300/0 conn(0x7f29dc143740 msgr2=0x7f29dc0ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:30.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.281+0000 7f29da59c640 1 --2- 172.21.15.38:0/951636516 >> v2:172.21.15.89:3300/0 conn(0x7f29dc143740 0x7f29dc0ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:30.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.281+0000 7f29da59c640 1 -- 172.21.15.38:0/951636516 >> v1:172.21.15.38:6789/0 conn(0x7f29dc0b1e90 legacy=0x7f29dc0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:30.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.281+0000 7f29da59c640 1 -- 172.21.15.38:0/951636516 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc0c9df0 con 0x7f29dc143050 2023-12-22T08:48:30.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.281+0000 7f29d9d9b640 1 -- 172.21.15.38:0/951636516 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216743434 0 0) 0x7f29dc0c9550 con 0x7f29dc0b1e90 2023-12-22T08:48:30.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.282+0000 7f29da59c640 1 --2- 172.21.15.38:0/951636516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29dc143050 0x7f29dc06de50 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f29dc144170 tx=0x7f29cc02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a536a1b3b68c4f0b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:30.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.283+0000 7f29d9d9b640 1 -- 172.21.15.38:0/951636516 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc02f850 con 0x7f29dc143050 2023-12-22T08:48:30.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.283+0000 7f29d9d9b640 1 -- 172.21.15.38:0/951636516 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc02f9b0 con 0x7f29dc143050 2023-12-22T08:48:30.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.283+0000 7f29d9d9b640 1 -- 172.21.15.38:0/951636516 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc02fd40 con 0x7f29dc143050 2023-12-22T08:48:30.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.283+0000 7f29e0881640 1 -- 172.21.15.38:0/951636516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29dc143050 msgr2=0x7f29dc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:30.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.283+0000 7f29e0881640 1 --2- 172.21.15.38:0/951636516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29dc143050 0x7f29dc06de50 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f29dc144170 tx=0x7f29cc02ba30 comp rx=0 tx=0).stop 2023-12-22T08:48:30.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.283+0000 7f29e0881640 1 -- 172.21.15.38:0/951636516 shutdown_connections 2023-12-22T08:48:30.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.283+0000 7f29e0881640 1 --2- 172.21.15.38:0/951636516 >> v2:172.21.15.89:3300/0 conn(0x7f29dc143740 0x7f29dc0ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:30.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.283+0000 7f29e0881640 1 --2- 172.21.15.38:0/951636516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29dc143050 0x7f29dc06de50 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:30.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.283+0000 7f29e0881640 1 -- 172.21.15.38:0/951636516 >> 172.21.15.38:0/951636516 conn(0x7f29dc0cba10 msgr2=0x7f29dc0cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:30.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.284+0000 7f29e0881640 1 -- 172.21.15.38:0/951636516 shutdown_connections 2023-12-22T08:48:30.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.284+0000 7f29e0881640 1 -- 172.21.15.38:0/951636516 wait complete. 2023-12-22T08:48:30.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.285+0000 7f29e0881640 1 Processor -- start 2023-12-22T08:48:30.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.286+0000 7f29e0881640 1 -- start start 2023-12-22T08:48:30.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29e0881640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29dc0b1e90 0x7f29dc13f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:30.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29e0881640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29dc143050 0x7f29dc13cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:30.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29e0881640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29dc143740 0x7f29dc1e6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:30.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29e0881640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc1e78f0 con 0x7f29dc0b1e90 2023-12-22T08:48:30.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29e0881640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc13d1c0 con 0x7f29dc143740 2023-12-22T08:48:30.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29e0881640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc071dc0 con 0x7f29dc143050 2023-12-22T08:48:30.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29da59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29dc0b1e90 0x7f29dc13f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:30.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29da59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29dc0b1e90 0x7f29dc13f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47896/0 (socket says 172.21.15.38:47896) 2023-12-22T08:48:30.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29da59c640 1 -- 172.21.15.38:0/1254832890 learned_addr learned my addr 172.21.15.38:0/1254832890 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29d3fff640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29dc143050 0x7f29dc13cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29dad9d640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29dc143740 0x7f29dc1e6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29da59c640 1 -- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29dc143050 msgr2=0x7f29dc13cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29da59c640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29dc143050 0x7f29dc13cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29da59c640 1 -- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29dc143740 msgr2=0x7f29dc1e6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29da59c640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29dc143740 0x7f29dc1e6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29da59c640 1 -- 172.21.15.38:0/1254832890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc0094d0 con 0x7f29dc0b1e90 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.287+0000 7f29dad9d640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29dc143740 0x7f29dc1e6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.288+0000 7f29da59c640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29dc0b1e90 0x7f29dc13f230 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0090b0 tx=0x7f29cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.288+0000 7f29d2ffd640 1 -- 172.21.15.38:0/1254832890 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc03b040 con 0x7f29dc0b1e90 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.288+0000 7f29d2ffd640 1 -- 172.21.15.38:0/1254832890 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc037c60 con 0x7f29dc0b1e90 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.288+0000 7f29d2ffd640 1 -- 172.21.15.38:0/1254832890 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc004030 con 0x7f29dc0b1e90 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.288+0000 7f29e0881640 1 -- 172.21.15.38:0/1254832890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc1e6f50 con 0x7f29dc0b1e90 2023-12-22T08:48:30.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.288+0000 7f29e0881640 1 -- 172.21.15.38:0/1254832890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc1e7510 con 0x7f29dc0b1e90 2023-12-22T08:48:30.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.289+0000 7f29e0881640 1 -- 172.21.15.38:0/1254832890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29dc072210 con 0x7f29dc0b1e90 2023-12-22T08:48:30.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.290+0000 7f29d2ffd640 1 -- 172.21.15.38:0/1254832890 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f29cc004190 con 0x7f29dc0b1e90 2023-12-22T08:48:30.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.292+0000 7f29d2ffd640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29bc06a430 0x7f29bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:30.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.292+0000 7f29d2ffd640 1 -- 172.21.15.38:0/1254832890 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f29cc0ab850 con 0x7f29dc0b1e90 2023-12-22T08:48:30.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.292+0000 7f29d2ffd640 1 -- 172.21.15.38:0/1254832890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f29bc072070 con 0x7f29dc0b1e90 2023-12-22T08:48:30.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.293+0000 7f29d3fff640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29bc06a430 0x7f29bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:30.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.294+0000 7f29d3fff640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29bc06a430 0x7f29bc06c8f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f29dc13f770 tx=0x7f29c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:30.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.296+0000 7f29d2ffd640 1 -- 172.21.15.38:0/1254832890 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f29cc076e60 con 0x7f29dc0b1e90 2023-12-22T08:48:30.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:30.526+0000 7f29e0881640 1 -- 172.21.15.38:0/1254832890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f29dc061910 con 0x7f29dc0b1e90 2023-12-22T08:48:31.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.062+0000 7f29d2ffd640 1 -- 172.21.15.38:0/1254832890 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7f29cc07a480 con 0x7f29dc0b1e90 2023-12-22T08:48:31.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.065+0000 7f29e0881640 1 -- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29bc06a430 msgr2=0x7f29bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:31.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.065+0000 7f29e0881640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29bc06a430 0x7f29bc06c8f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f29dc13f770 tx=0x7f29c4008040 comp rx=0 tx=0).stop 2023-12-22T08:48:31.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.065+0000 7f29e0881640 1 -- 172.21.15.38:0/1254832890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29dc0b1e90 msgr2=0x7f29dc13f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:31.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.065+0000 7f29e0881640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29dc0b1e90 0x7f29dc13f230 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0090b0 tx=0x7f29cc0046c0 comp rx=0 tx=0).stop 2023-12-22T08:48:31.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.065+0000 7f29e0881640 1 -- 172.21.15.38:0/1254832890 shutdown_connections 2023-12-22T08:48:31.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.065+0000 7f29e0881640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29dc143740 0x7f29dc1e6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:31.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.065+0000 7f29e0881640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29dc143050 0x7f29dc13cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:31.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.065+0000 7f29e0881640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29bc06a430 0x7f29bc06c8f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:31.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.065+0000 7f29e0881640 1 --2- 172.21.15.38:0/1254832890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29dc0b1e90 0x7f29dc13f230 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:31.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.065+0000 7f29e0881640 1 -- 172.21.15.38:0/1254832890 >> 172.21.15.38:0/1254832890 conn(0x7f29dc0cba10 msgr2=0x7f29dc141ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:31.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.066+0000 7f29e0881640 1 -- 172.21.15.38:0/1254832890 shutdown_connections 2023-12-22T08:48:31.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.066+0000 7f29e0881640 1 -- 172.21.15.38:0/1254832890 wait complete. 2023-12-22T08:48:31.087 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T08:48:31.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.307+0000 7fd04fd39640 1 Processor -- start 2023-12-22T08:48:31.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.307+0000 7fd04fd39640 1 -- start start 2023-12-22T08:48:31.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.309+0000 7fd04fd39640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd04815aee0 0x7fd0480b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:31.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.309+0000 7fd04fd39640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd04815b2c0 0x7fd0480b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:31.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.309+0000 7fd04fd39640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0480b36a0 con 0x7fd0480b43a0 2023-12-22T08:48:31.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.309+0000 7fd04fd39640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0480b3a40 con 0x7fd04815aee0 2023-12-22T08:48:31.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.309+0000 7fd04fd39640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480b56e0 con 0x7fd04815b2c0 2023-12-22T08:48:31.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.309+0000 7fd04e2d6640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd0480b43a0 0x7fd0480b8a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57670/0 (socket says 172.21.15.38:57670) 2023-12-22T08:48:31.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.310+0000 7fd04e2d6640 1 -- 172.21.15.38:0/467592445 learned_addr learned my addr 172.21.15.38:0/467592445 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:31.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.310+0000 7fd04dad5640 1 --2- 172.21.15.38:0/467592445 >> v2:172.21.15.89:3300/0 conn(0x7fd04815aee0 0x7fd0480b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:31.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.310+0000 7fd04d2d4640 1 --2- 172.21.15.38:0/467592445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd04815b2c0 0x7fd0480b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:31.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.310+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812903046 0 0) 0x7fd0480b36a0 con 0x7fd0480b43a0 2023-12-22T08:48:31.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.310+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd034003520 con 0x7fd0480b43a0 2023-12-22T08:48:31.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.310+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4012248774 0 0) 0x7fd034003520 con 0x7fd0480b43a0 2023-12-22T08:48:31.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.310+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd04815b2c0 msgr2=0x7fd0480b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:31.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.310+0000 7fd04cad3640 1 --2- 172.21.15.38:0/467592445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd04815b2c0 0x7fd0480b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:31.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.310+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 >> v2:172.21.15.89:3300/0 conn(0x7fd04815aee0 msgr2=0x7fd0480b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:31.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.310+0000 7fd04cad3640 1 --2- 172.21.15.38:0/467592445 >> v2:172.21.15.89:3300/0 conn(0x7fd04815aee0 0x7fd0480b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:31.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.310+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0480b59c0 con 0x7fd0480b43a0 2023-12-22T08:48:31.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.310+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fd0400019f0 con 0x7fd0480b43a0 2023-12-22T08:48:31.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.310+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 >> v1:172.21.15.38:6789/0 conn(0x7fd0480b43a0 legacy=0x7fd0480b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04cad3640 1 --2- 172.21.15.38:0/467592445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd034003970 0x7fd034003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04cad3640 1 --2- 172.21.15.38:0/467592445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0340047c0 0x7fd034004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04cad3640 1 --2- 172.21.15.38:0/467592445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd034005140 0x7fd03400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480b3a40 con 0x7fd034005140 2023-12-22T08:48:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480b56e0 con 0x7fd034003970 2023-12-22T08:48:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03400bec0 con 0x7fd0340047c0 2023-12-22T08:48:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04e2d6640 1 --2- 172.21.15.38:0/467592445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd034005140 0x7fd03400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04dad5640 1 --2- 172.21.15.38:0/467592445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd034003970 0x7fd034003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04d2d4640 1 --2- 172.21.15.38:0/467592445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0340047c0 0x7fd034004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04e2d6640 1 -- 172.21.15.38:0/467592445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0340047c0 msgr2=0x7fd034004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04e2d6640 1 --2- 172.21.15.38:0/467592445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0340047c0 0x7fd034004c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04e2d6640 1 -- 172.21.15.38:0/467592445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd034003970 msgr2=0x7fd034003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:31.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04e2d6640 1 --2- 172.21.15.38:0/467592445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd034003970 0x7fd034003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:31.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.311+0000 7fd04e2d6640 1 -- 172.21.15.38:0/467592445 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034003520 con 0x7fd034005140 2023-12-22T08:48:31.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.312+0000 7fd04e2d6640 1 --2- 172.21.15.38:0/467592445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd034005140 0x7fd03400b980 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fd04000a810 tx=0x7fd0340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf6fd13f8e7c8b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:31.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.313+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040034630 con 0x7fd034005140 2023-12-22T08:48:31.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.313+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04002f070 con 0x7fd034005140 2023-12-22T08:48:31.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.313+0000 7fd04cad3640 1 -- 172.21.15.38:0/467592445 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0400349f0 con 0x7fd034005140 2023-12-22T08:48:31.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.313+0000 7fd04fd39640 1 -- 172.21.15.38:0/467592445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd034005140 msgr2=0x7fd03400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:31.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.313+0000 7fd04fd39640 1 --2- 172.21.15.38:0/467592445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd034005140 0x7fd03400b980 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fd04000a810 tx=0x7fd0340057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:31.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.313+0000 7fd04e2d6640 1 -- 172.21.15.38:0/467592445 reap_dead start 2023-12-22T08:48:31.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.313+0000 7fd04fd39640 1 -- 172.21.15.38:0/467592445 shutdown_connections 2023-12-22T08:48:31.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.313+0000 7fd04fd39640 1 -- 172.21.15.38:0/467592445 >> 172.21.15.38:0/467592445 conn(0x7fd048070770 msgr2=0x7fd048070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:31.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.313+0000 7fd04fd39640 1 -- 172.21.15.38:0/467592445 shutdown_connections 2023-12-22T08:48:31.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.313+0000 7fd04fd39640 1 -- 172.21.15.38:0/467592445 wait complete. 2023-12-22T08:48:31.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.315+0000 7fd04fd39640 1 Processor -- start 2023-12-22T08:48:31.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.315+0000 7fd04fd39640 1 -- start start 2023-12-22T08:48:31.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.316+0000 7fd04fd39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0481f2400 0x7fd0481e5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:31.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.316+0000 7fd04fd39640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0481f27e0 0x7fd0481e61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:31.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.316+0000 7fd04fd39640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0481e6730 0x7fd0481424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:31.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.316+0000 7fd04fd39640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd048153630 con 0x7fd0481e6730 2023-12-22T08:48:31.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.316+0000 7fd04fd39640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0481419c0 con 0x7fd0481f2400 2023-12-22T08:48:31.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.316+0000 7fd04fd39640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd048141ca0 con 0x7fd0481f27e0 2023-12-22T08:48:31.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.317+0000 7fd04e2d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0481e6730 0x7fd0481424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:31.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.317+0000 7fd04e2d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0481e6730 0x7fd0481424a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33562/0 (socket says 172.21.15.38:33562) 2023-12-22T08:48:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.317+0000 7fd04e2d6640 1 -- 172.21.15.38:0/1178920664 learned_addr learned my addr 172.21.15.38:0/1178920664 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.317+0000 7fd04dad5640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0481f2400 0x7fd0481e5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.317+0000 7fd04d2d4640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0481f27e0 0x7fd0481e61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.317+0000 7fd04e2d6640 1 -- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0481f27e0 msgr2=0x7fd0481e61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.317+0000 7fd04e2d6640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0481f27e0 0x7fd0481e61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.317+0000 7fd04e2d6640 1 -- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0481f2400 msgr2=0x7fd0481e5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.317+0000 7fd04e2d6640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0481f2400 0x7fd0481e5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.317+0000 7fd04e2d6640 1 -- 172.21.15.38:0/1178920664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd048141f80 con 0x7fd0481e6730 2023-12-22T08:48:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.317+0000 7fd04d2d4640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0481f27e0 0x7fd0481e61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.317+0000 7fd04e2d6640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0481e6730 0x7fd0481424a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fd04002cad0 tx=0x7fd0480b3830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.318+0000 7fd03e7fc640 1 -- 172.21.15.38:0/1178920664 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040034840 con 0x7fd0481e6730 2023-12-22T08:48:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.318+0000 7fd03e7fc640 1 -- 172.21.15.38:0/1178920664 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0400349a0 con 0x7fd0481e6730 2023-12-22T08:48:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.318+0000 7fd03e7fc640 1 -- 172.21.15.38:0/1178920664 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040034d30 con 0x7fd0481e6730 2023-12-22T08:48:31.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.318+0000 7fd04fd39640 1 -- 172.21.15.38:0/1178920664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd048144610 con 0x7fd0481e6730 2023-12-22T08:48:31.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.318+0000 7fd04fd39640 1 -- 172.21.15.38:0/1178920664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd048142bc0 con 0x7fd0481e6730 2023-12-22T08:48:31.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.319+0000 7fd04fd39640 1 -- 172.21.15.38:0/1178920664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd048061910 con 0x7fd0481e6730 2023-12-22T08:48:31.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.320+0000 7fd03e7fc640 1 -- 172.21.15.38:0/1178920664 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd040031030 con 0x7fd0481e6730 2023-12-22T08:48:31.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.321+0000 7fd03e7fc640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd02c06a430 0x7fd02c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:31.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.321+0000 7fd03e7fc640 1 -- 172.21.15.38:0/1178920664 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd0400aaec0 con 0x7fd0481e6730 2023-12-22T08:48:31.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.321+0000 7fd03e7fc640 1 -- 172.21.15.38:0/1178920664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7fd02c072070 con 0x7fd0481e6730 2023-12-22T08:48:31.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.322+0000 7fd04dad5640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd02c06a430 0x7fd02c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:31.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.323+0000 7fd04dad5640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd02c06a430 0x7fd02c06c8f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd044009a10 tx=0x7fd044008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.326+0000 7fd03e7fc640 1 -- 172.21.15.38:0/1178920664 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd0400764d0 con 0x7fd0481e6730 2023-12-22T08:48:31.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:31.518+0000 7fd04fd39640 1 -- 172.21.15.38:0/1178920664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd048061910 con 0x7fd0481e6730 2023-12-22T08:48:32.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.298+0000 7fd03e7fc640 1 -- 172.21.15.38:0/1178920664 <== mon.0 v2:172.21.15.38:3300/0 7 ==== osd_map(148..148 src has 1..148) v4 ==== 296+0+0 (secure 0 0 0) 0x7fd040032380 con 0x7fd0481e6730 2023-12-22T08:48:32.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.298+0000 7fd03e7fc640 1 -- 172.21.15.38:0/1178920664 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7fd02c0704a0 con 0x7fd0481e6730 2023-12-22T08:48:32.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.305+0000 7fd03e7fc640 1 -- 172.21.15.38:0/1178920664 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v148) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd040001ef0 con 0x7fd0481e6730 2023-12-22T08:48:32.307 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2023-12-22T08:48:32.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.311+0000 7fd04fd39640 1 -- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd02c06a430 msgr2=0x7fd02c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:32.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.311+0000 7fd04fd39640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd02c06a430 0x7fd02c06c8f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd044009a10 tx=0x7fd044008040 comp rx=0 tx=0).stop 2023-12-22T08:48:32.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.311+0000 7fd04fd39640 1 -- 172.21.15.38:0/1178920664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0481e6730 msgr2=0x7fd0481424a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:32.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.311+0000 7fd04fd39640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0481e6730 0x7fd0481424a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fd04002cad0 tx=0x7fd0480b3830 comp rx=0 tx=0).stop 2023-12-22T08:48:32.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.311+0000 7fd04fd39640 1 -- 172.21.15.38:0/1178920664 shutdown_connections 2023-12-22T08:48:32.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.311+0000 7fd04fd39640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd02c06a430 0x7fd02c06c8f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:32.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.312+0000 7fd04fd39640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0481e6730 0x7fd0481424a0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:32.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.312+0000 7fd04fd39640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0481f27e0 0x7fd0481e61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:32.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.312+0000 7fd04fd39640 1 --2- 172.21.15.38:0/1178920664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0481f2400 0x7fd0481e5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:32.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.312+0000 7fd04fd39640 1 -- 172.21.15.38:0/1178920664 >> 172.21.15.38:0/1178920664 conn(0x7fd048070770 msgr2=0x7fd0481595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:32.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.312+0000 7fd04fd39640 1 -- 172.21.15.38:0/1178920664 shutdown_connections 2023-12-22T08:48:32.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.312+0000 7fd04fd39640 1 -- 172.21.15.38:0/1178920664 wait complete. 2023-12-22T08:48:32.336 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T08:48:32.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.555+0000 7fc68ec29640 1 Processor -- start 2023-12-22T08:48:32.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.555+0000 7fc68ec29640 1 -- start start 2023-12-22T08:48:32.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.557+0000 7fc68ec29640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6880cf110 0x7fc688070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:32.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.557+0000 7fc68ec29640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc688070bb0 0x7fc6880b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:32.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.557+0000 7fc68ec29640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6880b94d0 con 0x7fc68815d3b0 2023-12-22T08:48:32.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.557+0000 7fc68ec29640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc688071000 con 0x7fc688070bb0 2023-12-22T08:48:32.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.557+0000 7fc68ec29640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880b37a0 con 0x7fc6880cf110 2023-12-22T08:48:32.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.557+0000 7fc68dc27640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc68815d3b0 0x7fc6880b8a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57674/0 (socket says 172.21.15.38:57674) 2023-12-22T08:48:32.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.557+0000 7fc68e428640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc688070bb0 0x7fc6880b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:32.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.557+0000 7fc68dc27640 1 -- 172.21.15.38:0/2887798117 learned_addr learned my addr 172.21.15.38:0/2887798117 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.558+0000 7fc68d426640 1 --2- 172.21.15.38:0/2887798117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6880cf110 0x7fc688070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.558+0000 7fc68cc25640 1 -- 172.21.15.38:0/2887798117 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487542080 0 0) 0x7fc6880b94d0 con 0x7fc68815d3b0 2023-12-22T08:48:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.558+0000 7fc68cc25640 1 -- 172.21.15.38:0/2887798117 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc674003520 con 0x7fc68815d3b0 2023-12-22T08:48:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.558+0000 7fc68e428640 1 -- 172.21.15.38:0/2887798117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6880cf110 msgr2=0x7fc688070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.558+0000 7fc68e428640 1 --2- 172.21.15.38:0/2887798117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6880cf110 0x7fc688070670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.558+0000 7fc68e428640 1 -- 172.21.15.38:0/2887798117 >> v1:172.21.15.38:6789/0 conn(0x7fc68815d3b0 legacy=0x7fc6880b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:32.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.558+0000 7fc68e428640 1 -- 172.21.15.38:0/2887798117 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6880b3a80 con 0x7fc688070bb0 2023-12-22T08:48:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.559+0000 7fc68e428640 1 --2- 172.21.15.38:0/2887798117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc688070bb0 0x7fc6880b4ae0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc680009d90 tx=0x7fc68002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803164f7d4f42514 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.560+0000 7fc68cc25640 1 -- 172.21.15.38:0/2887798117 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68002cc50 con 0x7fc688070bb0 2023-12-22T08:48:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.560+0000 7fc68cc25640 1 -- 172.21.15.38:0/2887798117 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68002cdb0 con 0x7fc688070bb0 2023-12-22T08:48:32.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.560+0000 7fc68cc25640 1 -- 172.21.15.38:0/2887798117 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680034660 con 0x7fc688070bb0 2023-12-22T08:48:32.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.560+0000 7fc68ec29640 1 -- 172.21.15.38:0/2887798117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc688070bb0 msgr2=0x7fc6880b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:32.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.560+0000 7fc68ec29640 1 --2- 172.21.15.38:0/2887798117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc688070bb0 0x7fc6880b4ae0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc680009d90 tx=0x7fc68002bea0 comp rx=0 tx=0).stop 2023-12-22T08:48:32.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.560+0000 7fc68ec29640 1 -- 172.21.15.38:0/2887798117 shutdown_connections 2023-12-22T08:48:32.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.560+0000 7fc68ec29640 1 --2- 172.21.15.38:0/2887798117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc688070bb0 0x7fc6880b4ae0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:32.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.560+0000 7fc68ec29640 1 --2- 172.21.15.38:0/2887798117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6880cf110 0x7fc688070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:32.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.560+0000 7fc68ec29640 1 -- 172.21.15.38:0/2887798117 >> 172.21.15.38:0/2887798117 conn(0x7fc68806f250 msgr2=0x7fc6880d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:32.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.560+0000 7fc68ec29640 1 -- 172.21.15.38:0/2887798117 shutdown_connections 2023-12-22T08:48:32.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.560+0000 7fc68ec29640 1 -- 172.21.15.38:0/2887798117 wait complete. 2023-12-22T08:48:32.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.562+0000 7fc68ec29640 1 Processor -- start 2023-12-22T08:48:32.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.562+0000 7fc68ec29640 1 -- start start 2023-12-22T08:48:32.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.563+0000 7fc68ec29640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc688070bb0 0x7fc6880ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:32.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.563+0000 7fc68ec29640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6880cf110 0x7fc6880cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:32.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.563+0000 7fc68ec29640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc68815d3b0 0x7fc68806f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.563+0000 7fc68ec29640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880cb980 con 0x7fc688070bb0 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.563+0000 7fc68ec29640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880cad00 con 0x7fc6880cf110 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.563+0000 7fc68ec29640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880cafe0 con 0x7fc68815d3b0 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.564+0000 7fc68dc27640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc688070bb0 0x7fc6880ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.564+0000 7fc68dc27640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc688070bb0 0x7fc6880ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33570/0 (socket says 172.21.15.38:33570) 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.564+0000 7fc68dc27640 1 -- 172.21.15.38:0/858676752 learned_addr learned my addr 172.21.15.38:0/858676752 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.564+0000 7fc68d426640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6880cf110 0x7fc6880cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.564+0000 7fc68e428640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc68815d3b0 0x7fc68806f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.564+0000 7fc68dc27640 1 -- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc68815d3b0 msgr2=0x7fc68806f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.564+0000 7fc68dc27640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc68815d3b0 0x7fc68806f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.564+0000 7fc68dc27640 1 -- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6880cf110 msgr2=0x7fc6880cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.564+0000 7fc68dc27640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6880cf110 0x7fc6880cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.564+0000 7fc68dc27640 1 -- 172.21.15.38:0/858676752 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc680009a70 con 0x7fc688070bb0 2023-12-22T08:48:32.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.565+0000 7fc68dc27640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc688070bb0 0x7fc6880ca4b0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fc68400c410 tx=0x7fc68400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:32.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.565+0000 7fc67e7fc640 1 -- 172.21.15.38:0/858676752 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684005ce0 con 0x7fc688070bb0 2023-12-22T08:48:32.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.565+0000 7fc67e7fc640 1 -- 172.21.15.38:0/858676752 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc684005e40 con 0x7fc688070bb0 2023-12-22T08:48:32.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.565+0000 7fc67e7fc640 1 -- 172.21.15.38:0/858676752 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6840072f0 con 0x7fc688070bb0 2023-12-22T08:48:32.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.565+0000 7fc68ec29640 1 -- 172.21.15.38:0/858676752 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6880cb2c0 con 0x7fc688070bb0 2023-12-22T08:48:32.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.565+0000 7fc68ec29640 1 -- 172.21.15.38:0/858676752 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6880ca9f0 con 0x7fc688070bb0 2023-12-22T08:48:32.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.566+0000 7fc68ec29640 1 -- 172.21.15.38:0/858676752 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc688061910 con 0x7fc688070bb0 2023-12-22T08:48:32.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.567+0000 7fc67e7fc640 1 -- 172.21.15.38:0/858676752 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc684007510 con 0x7fc688070bb0 2023-12-22T08:48:32.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.568+0000 7fc67e7fc640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc66c06a430 0x7fc66c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:32.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.568+0000 7fc67e7fc640 1 -- 172.21.15.38:0/858676752 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fc684087e30 con 0x7fc688070bb0 2023-12-22T08:48:32.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.568+0000 7fc67e7fc640 1 -- 172.21.15.38:0/858676752 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7fc66c071200 con 0x7fc688070bb0 2023-12-22T08:48:32.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.569+0000 7fc68d426640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc66c06a430 0x7fc66c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:32.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.570+0000 7fc68d426640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc66c06a430 0x7fc66c06c8f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc678009ad0 tx=0x7fc678008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:32.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.572+0000 7fc67e7fc640 1 -- 172.21.15.38:0/858676752 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc68405be60 con 0x7fc688070bb0 2023-12-22T08:48:32.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:32.769+0000 7fc68ec29640 1 -- 172.21.15.38:0/858676752 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc6880cbbf0 con 0x7fc688070bb0 2023-12-22T08:48:33.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.309+0000 7fc67e7fc640 1 -- 172.21.15.38:0/858676752 <== mon.0 v2:172.21.15.38:3300/0 7 ==== osd_map(149..149 src has 1..149) v4 ==== 296+0+0 (secure 0 0 0) 0x7fc68408b030 con 0x7fc688070bb0 2023-12-22T08:48:33.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.309+0000 7fc67e7fc640 1 -- 172.21.15.38:0/858676752 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7fc66c06ff90 con 0x7fc688070bb0 2023-12-22T08:48:33.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.327+0000 7fc67e7fc640 1 -- 172.21.15.38:0/858676752 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v149) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc684017030 con 0x7fc688070bb0 2023-12-22T08:48:33.330 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2023-12-22T08:48:33.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.333+0000 7fc68ec29640 1 -- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc66c06a430 msgr2=0x7fc66c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:33.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.333+0000 7fc68ec29640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc66c06a430 0x7fc66c06c8f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc678009ad0 tx=0x7fc678008040 comp rx=0 tx=0).stop 2023-12-22T08:48:33.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.333+0000 7fc68ec29640 1 -- 172.21.15.38:0/858676752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc688070bb0 msgr2=0x7fc6880ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:33.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.333+0000 7fc68ec29640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc688070bb0 0x7fc6880ca4b0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fc68400c410 tx=0x7fc68400c8d0 comp rx=0 tx=0).stop 2023-12-22T08:48:33.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.333+0000 7fc68ec29640 1 -- 172.21.15.38:0/858676752 shutdown_connections 2023-12-22T08:48:33.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.333+0000 7fc68ec29640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc68815d3b0 0x7fc68806f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:33.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.333+0000 7fc68ec29640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6880cf110 0x7fc6880cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:33.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.333+0000 7fc68ec29640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc66c06a430 0x7fc66c06c8f0 secure :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc678009ad0 tx=0x7fc678008040 comp rx=0 tx=0).stop 2023-12-22T08:48:33.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.333+0000 7fc68ec29640 1 --2- 172.21.15.38:0/858676752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc688070bb0 0x7fc6880ca4b0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:33.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.333+0000 7fc68ec29640 1 -- 172.21.15.38:0/858676752 >> 172.21.15.38:0/858676752 conn(0x7fc68806f250 msgr2=0x7fc6880b6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:33.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.334+0000 7fc68ec29640 1 -- 172.21.15.38:0/858676752 shutdown_connections 2023-12-22T08:48:33.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.334+0000 7fc68ec29640 1 -- 172.21.15.38:0/858676752 wait complete. 2023-12-22T08:48:33.356 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-22T08:48:33.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.556+0000 7f1f4d23f640 1 Processor -- start 2023-12-22T08:48:33.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.556+0000 7f1f4d23f640 1 -- start start 2023-12-22T08:48:33.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.558+0000 7f1f4d23f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1f4806dc90 0x7f1f48162f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:33.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.558+0000 7f1f4d23f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f48162da0 con 0x7f1f4815f5e0 2023-12-22T08:48:33.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.558+0000 7f1f4d23f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f48162190 con 0x7f1f4815f200 2023-12-22T08:48:33.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.558+0000 7f1f4d23f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f48162470 con 0x7f1f4806dc90 2023-12-22T08:48:33.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.558+0000 7f1f477fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1f4815f5e0 0x7f1f480cab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57678/0 (socket says 172.21.15.38:57678) 2023-12-22T08:48:33.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.558+0000 7f1f477fe640 1 -- 172.21.15.38:0/3658272748 learned_addr learned my addr 172.21.15.38:0/3658272748 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:33.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.558+0000 7f1f4ca3e640 1 --2- 172.21.15.38:0/3658272748 >> v2:172.21.15.38:3300/0 conn(0x7f1f4806dc90 0x7f1f48162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:33.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.559+0000 7f1f4ca3e640 1 -- 172.21.15.38:0/3658272748 >> v1:172.21.15.89:6789/0 conn(0x7f1f4815f200 legacy=0x7f1f48070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:33.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.559+0000 7f1f46ffd640 1 -- 172.21.15.38:0/3658272748 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911319500 0 0) 0x7f1f48162da0 con 0x7f1f4815f5e0 2023-12-22T08:48:33.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.559+0000 7f1f4ca3e640 1 -- 172.21.15.38:0/3658272748 >> v1:172.21.15.38:6789/0 conn(0x7f1f4815f5e0 legacy=0x7f1f480cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:33.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.559+0000 7f1f4ca3e640 1 -- 172.21.15.38:0/3658272748 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f48162750 con 0x7f1f4806dc90 2023-12-22T08:48:33.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.560+0000 7f1f4ca3e640 1 --2- 172.21.15.38:0/3658272748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f4806dc90 0x7f1f48162f70 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f1f400097a0 tx=0x7f1f4002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db71ff85c4b8e052 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:33.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.560+0000 7f1f46ffd640 1 -- 172.21.15.38:0/3658272748 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40031830 con 0x7f1f4806dc90 2023-12-22T08:48:33.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.560+0000 7f1f46ffd640 1 -- 172.21.15.38:0/3658272748 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f40031990 con 0x7f1f4806dc90 2023-12-22T08:48:33.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.560+0000 7f1f46ffd640 1 -- 172.21.15.38:0/3658272748 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40031d20 con 0x7f1f4806dc90 2023-12-22T08:48:33.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.561+0000 7f1f4d23f640 1 -- 172.21.15.38:0/3658272748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f4806dc90 msgr2=0x7f1f48162f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:33.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.561+0000 7f1f4d23f640 1 --2- 172.21.15.38:0/3658272748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f4806dc90 0x7f1f48162f70 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f1f400097a0 tx=0x7f1f4002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:48:33.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.561+0000 7f1f4d23f640 1 -- 172.21.15.38:0/3658272748 shutdown_connections 2023-12-22T08:48:33.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.561+0000 7f1f4d23f640 1 --2- 172.21.15.38:0/3658272748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f4806dc90 0x7f1f48162f70 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:33.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.561+0000 7f1f4d23f640 1 -- 172.21.15.38:0/3658272748 >> 172.21.15.38:0/3658272748 conn(0x7f1f480cf000 msgr2=0x7f1f480cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:33.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.561+0000 7f1f4d23f640 1 -- 172.21.15.38:0/3658272748 shutdown_connections 2023-12-22T08:48:33.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.561+0000 7f1f4d23f640 1 -- 172.21.15.38:0/3658272748 wait complete. 2023-12-22T08:48:33.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.563+0000 7f1f4d23f640 1 Processor -- start 2023-12-22T08:48:33.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.564+0000 7f1f4d23f640 1 -- start start 2023-12-22T08:48:33.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.565+0000 7f1f4d23f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f4806dc90 0x7f1f48152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:33.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.565+0000 7f1f4d23f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f4815f200 0x7f1f4815f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:33.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.565+0000 7f1f4d23f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f481fa100 0x7f1f481fa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:33.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.565+0000 7f1f4d23f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4809aa60 con 0x7f1f481fa100 2023-12-22T08:48:33.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.565+0000 7f1f4d23f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f481fabc0 con 0x7f1f4806dc90 2023-12-22T08:48:33.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.565+0000 7f1f4d23f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f481faea0 con 0x7f1f4815f200 2023-12-22T08:48:33.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.565+0000 7f1f4ca3e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f481fa100 0x7f1f481fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:33.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.565+0000 7f1f4ca3e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f481fa100 0x7f1f481fa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33592/0 (socket says 172.21.15.38:33592) 2023-12-22T08:48:33.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.565+0000 7f1f4ca3e640 1 -- 172.21.15.38:0/301962712 learned_addr learned my addr 172.21.15.38:0/301962712 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:33.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.566+0000 7f1f477fe640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f4815f200 0x7f1f4815f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:33.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.566+0000 7f1f47fff640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f4806dc90 0x7f1f48152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.566+0000 7f1f4ca3e640 1 -- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f4815f200 msgr2=0x7f1f4815f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.566+0000 7f1f4ca3e640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f4815f200 0x7f1f4815f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.566+0000 7f1f4ca3e640 1 -- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f4806dc90 msgr2=0x7f1f48152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.566+0000 7f1f4ca3e640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f4806dc90 0x7f1f48152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.566+0000 7f1f4ca3e640 1 -- 172.21.15.38:0/301962712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40009400 con 0x7f1f481fa100 2023-12-22T08:48:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.566+0000 7f1f4ca3e640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f481fa100 0x7f1f481fa5b0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f1f400098c0 tx=0x7f1f400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.567+0000 7f1f44ff9640 1 -- 172.21.15.38:0/301962712 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4003b9f0 con 0x7f1f481fa100 2023-12-22T08:48:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.567+0000 7f1f44ff9640 1 -- 172.21.15.38:0/301962712 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4003bb50 con 0x7f1f481fa100 2023-12-22T08:48:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.567+0000 7f1f44ff9640 1 -- 172.21.15.38:0/301962712 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400453f0 con 0x7f1f481fa100 2023-12-22T08:48:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.567+0000 7f1f4d23f640 1 -- 172.21.15.38:0/301962712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4809ac90 con 0x7f1f481fa100 2023-12-22T08:48:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.567+0000 7f1f4d23f640 1 -- 172.21.15.38:0/301962712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4815ff10 con 0x7f1f481fa100 2023-12-22T08:48:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.568+0000 7f1f4d23f640 1 -- 172.21.15.38:0/301962712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4809b1b0 con 0x7f1f481fa100 2023-12-22T08:48:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.569+0000 7f1f44ff9640 1 -- 172.21.15.38:0/301962712 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1f40045550 con 0x7f1f481fa100 2023-12-22T08:48:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.570+0000 7f1f44ff9640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1f3406a460 0x7f1f3406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.570+0000 7f1f44ff9640 1 -- 172.21.15.38:0/301962712 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1f400aaa90 con 0x7f1f481fa100 2023-12-22T08:48:33.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.571+0000 7f1f47fff640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1f3406a460 0x7f1f3406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:33.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.572+0000 7f1f47fff640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1f3406a460 0x7f1f3406c920 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1f48161cf0 tx=0x7f1f38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:33.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.575+0000 7f1f44ff9640 1 -- 172.21.15.38:0/301962712 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1f4809b1b0 con 0x7f1f481fa100 2023-12-22T08:48:33.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.767+0000 7f1f4d23f640 1 -- 172.21.15.38:0/301962712 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1f4809b1b0 con 0x7f1f481fa100 2023-12-22T08:48:33.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.775+0000 7f1f44ff9640 1 -- 172.21.15.38:0/301962712 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1f4809b1b0 con 0x7f1f481fa100 2023-12-22T08:48:33.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.778+0000 7f1f4d23f640 1 -- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1f3406a460 msgr2=0x7f1f3406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:33.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.778+0000 7f1f4d23f640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1f3406a460 0x7f1f3406c920 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1f48161cf0 tx=0x7f1f38009040 comp rx=0 tx=0).stop 2023-12-22T08:48:33.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.778+0000 7f1f4d23f640 1 -- 172.21.15.38:0/301962712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f481fa100 msgr2=0x7f1f481fa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:33.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.778+0000 7f1f4d23f640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f481fa100 0x7f1f481fa5b0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f1f400098c0 tx=0x7f1f400046c0 comp rx=0 tx=0).stop 2023-12-22T08:48:33.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.779+0000 7f1f4d23f640 1 -- 172.21.15.38:0/301962712 shutdown_connections 2023-12-22T08:48:33.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.779+0000 7f1f4d23f640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1f3406a460 0x7f1f3406c920 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:33.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.779+0000 7f1f4d23f640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f481fa100 0x7f1f481fa5b0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:33.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.779+0000 7f1f4d23f640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f4815f200 0x7f1f4815f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:33.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.779+0000 7f1f4d23f640 1 --2- 172.21.15.38:0/301962712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f4806dc90 0x7f1f48152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:33.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.779+0000 7f1f4d23f640 1 -- 172.21.15.38:0/301962712 >> 172.21.15.38:0/301962712 conn(0x7f1f480cf000 msgr2=0x7f1f48154290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:33.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.779+0000 7f1f4d23f640 1 -- 172.21.15.38:0/301962712 shutdown_connections 2023-12-22T08:48:33.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:33.779+0000 7f1f4d23f640 1 -- 172.21.15.38:0/301962712 wait complete. 2023-12-22T08:48:33.799 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-12-22T08:48:34.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.022+0000 7f9f7a657640 1 Processor -- start 2023-12-22T08:48:34.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.022+0000 7f9f7a657640 1 -- start start 2023-12-22T08:48:34.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.024+0000 7f9f7a657640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9f7415b420 0x7f9f7406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:34.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.024+0000 7f9f7a657640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9f74071000 0x7f9f7415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:34.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.024+0000 7f9f7a657640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f740cdae0 con 0x7f9f740a44a0 2023-12-22T08:48:34.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.024+0000 7f9f7a657640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7406dec0 con 0x7f9f74071000 2023-12-22T08:48:34.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.024+0000 7f9f7a657640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7415b800 con 0x7f9f7415b420 2023-12-22T08:48:34.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.024+0000 7f9f79e56640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9f74071000 0x7f9f7415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:34.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.024+0000 7f9f78e54640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9f740a44a0 0x7f9f740708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57694/0 (socket says 172.21.15.38:57694) 2023-12-22T08:48:34.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.024+0000 7f9f78e54640 1 -- 172.21.15.38:0/3024915383 learned_addr learned my addr 172.21.15.38:0/3024915383 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:34.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.025+0000 7f9f79655640 1 --2- 172.21.15.38:0/3024915383 >> v2:172.21.15.89:3300/0 conn(0x7f9f7415b420 0x7f9f7406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:34.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.025+0000 7f9f79e56640 1 -- 172.21.15.38:0/3024915383 >> v2:172.21.15.89:3300/0 conn(0x7f9f7415b420 msgr2=0x7f9f7406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:34.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.025+0000 7f9f79e56640 1 --2- 172.21.15.38:0/3024915383 >> v2:172.21.15.89:3300/0 conn(0x7f9f7415b420 0x7f9f7406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:34.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.025+0000 7f9f79e56640 1 -- 172.21.15.38:0/3024915383 >> v1:172.21.15.38:6789/0 conn(0x7f9f740a44a0 legacy=0x7f9f740708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:34.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.025+0000 7f9f79e56640 1 -- 172.21.15.38:0/3024915383 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f740cdd30 con 0x7f9f74071000 2023-12-22T08:48:34.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.025+0000 7f9f6bfff640 1 -- 172.21.15.38:0/3024915383 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56906252 0 0) 0x7f9f740cdae0 con 0x7f9f740a44a0 2023-12-22T08:48:34.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.026+0000 7f9f79e56640 1 --2- 172.21.15.38:0/3024915383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f74071000 0x7f9f7415baa0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f9f740613e0 tx=0x7f9f6c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbf26785ff49db9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:34.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.026+0000 7f9f6bfff640 1 -- 172.21.15.38:0/3024915383 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c02cc80 con 0x7f9f74071000 2023-12-22T08:48:34.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.026+0000 7f9f6bfff640 1 -- 172.21.15.38:0/3024915383 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c02cde0 con 0x7f9f74071000 2023-12-22T08:48:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.026+0000 7f9f6bfff640 1 -- 172.21.15.38:0/3024915383 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c034660 con 0x7f9f74071000 2023-12-22T08:48:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.027+0000 7f9f7a657640 1 -- 172.21.15.38:0/3024915383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f74071000 msgr2=0x7f9f7415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.027+0000 7f9f7a657640 1 --2- 172.21.15.38:0/3024915383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f74071000 0x7f9f7415baa0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f9f740613e0 tx=0x7f9f6c02bed0 comp rx=0 tx=0).stop 2023-12-22T08:48:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.027+0000 7f9f7a657640 1 -- 172.21.15.38:0/3024915383 shutdown_connections 2023-12-22T08:48:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.027+0000 7f9f7a657640 1 --2- 172.21.15.38:0/3024915383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f74071000 0x7f9f7415baa0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.027+0000 7f9f7a657640 1 --2- 172.21.15.38:0/3024915383 >> v2:172.21.15.89:3300/0 conn(0x7f9f7415b420 0x7f9f7406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.027+0000 7f9f7a657640 1 -- 172.21.15.38:0/3024915383 >> 172.21.15.38:0/3024915383 conn(0x7f9f740b1f70 msgr2=0x7f9f740b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.027+0000 7f9f7a657640 1 -- 172.21.15.38:0/3024915383 shutdown_connections 2023-12-22T08:48:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.027+0000 7f9f7a657640 1 -- 172.21.15.38:0/3024915383 wait complete. 2023-12-22T08:48:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.029+0000 7f9f7a657640 1 Processor -- start 2023-12-22T08:48:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.029+0000 7f9f7a657640 1 -- start start 2023-12-22T08:48:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.030+0000 7f9f7a657640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f74071000 0x7f9f74152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.030+0000 7f9f7a657640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f740a44a0 0x7f9f741431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.030+0000 7f9f7a657640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f7415b420 0x7f9f74150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.030+0000 7f9f7a657640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f74151a60 con 0x7f9f74071000 2023-12-22T08:48:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.030+0000 7f9f7a657640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f74151d40 con 0x7f9f7415b420 2023-12-22T08:48:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.030+0000 7f9f7a657640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f74152020 con 0x7f9f740a44a0 2023-12-22T08:48:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.030+0000 7f9f79655640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f74071000 0x7f9f74152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.030+0000 7f9f79655640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f74071000 0x7f9f74152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33608/0 (socket says 172.21.15.38:33608) 2023-12-22T08:48:34.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.031+0000 7f9f79655640 1 -- 172.21.15.38:0/682065229 learned_addr learned my addr 172.21.15.38:0/682065229 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:34.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.031+0000 7f9f78e54640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f740a44a0 0x7f9f741431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:34.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.031+0000 7f9f79e56640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f7415b420 0x7f9f74150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:34.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.031+0000 7f9f79655640 1 -- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f740a44a0 msgr2=0x7f9f741431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:34.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.031+0000 7f9f79655640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f740a44a0 0x7f9f741431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:34.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.031+0000 7f9f79655640 1 -- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f7415b420 msgr2=0x7f9f74150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:34.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.031+0000 7f9f79655640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f7415b420 0x7f9f74150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:34.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.031+0000 7f9f79655640 1 -- 172.21.15.38:0/682065229 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c009a70 con 0x7f9f74071000 2023-12-22T08:48:34.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.031+0000 7f9f78e54640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f740a44a0 0x7f9f741431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:34.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.031+0000 7f9f79655640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f74071000 0x7f9f74152b00 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000d800 tx=0x7f9f7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:34.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.031+0000 7f9f69ffb640 1 -- 172.21.15.38:0/682065229 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000b6c0 con 0x7f9f74071000 2023-12-22T08:48:34.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.032+0000 7f9f69ffb640 1 -- 172.21.15.38:0/682065229 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7000b820 con 0x7f9f74071000 2023-12-22T08:48:34.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.032+0000 7f9f69ffb640 1 -- 172.21.15.38:0/682065229 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000bbb0 con 0x7f9f74071000 2023-12-22T08:48:34.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.032+0000 7f9f7a657640 1 -- 172.21.15.38:0/682065229 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f74152300 con 0x7f9f74071000 2023-12-22T08:48:34.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.032+0000 7f9f7a657640 1 -- 172.21.15.38:0/682065229 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f74157660 con 0x7f9f74071000 2023-12-22T08:48:34.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.033+0000 7f9f7a657640 1 -- 172.21.15.38:0/682065229 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f74061910 con 0x7f9f74071000 2023-12-22T08:48:34.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.034+0000 7f9f69ffb640 1 -- 172.21.15.38:0/682065229 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9f7000bd10 con 0x7f9f74071000 2023-12-22T08:48:34.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.035+0000 7f9f69ffb640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9f5806a430 0x7f9f5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:34.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.035+0000 7f9f69ffb640 1 -- 172.21.15.38:0/682065229 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9f70088c00 con 0x7f9f74071000 2023-12-22T08:48:34.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.035+0000 7f9f78e54640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9f5806a430 0x7f9f5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.036+0000 7f9f78e54640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9f5806a430 0x7f9f5806c8f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9f7406c8a0 tx=0x7f9f64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:34.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.039+0000 7f9f69ffb640 1 -- 172.21.15.38:0/682065229 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9f70054450 con 0x7f9f74071000 2023-12-22T08:48:34.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:34.307+0000 7f9f7a657640 1 -- 172.21.15.38:0/682065229 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f9f740cb5c0 con 0x7f9f74071000 2023-12-22T08:48:35.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.328+0000 7f9f69ffb640 1 -- 172.21.15.38:0/682065229 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v449) v1 ==== 140+0+0 (secure 0 0 0) 0x7f9f70057a70 con 0x7f9f74071000 2023-12-22T08:48:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.332+0000 7f9f7a657640 1 -- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9f5806a430 msgr2=0x7f9f5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.332+0000 7f9f7a657640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9f5806a430 0x7f9f5806c8f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9f7406c8a0 tx=0x7f9f64009040 comp rx=0 tx=0).stop 2023-12-22T08:48:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.332+0000 7f9f7a657640 1 -- 172.21.15.38:0/682065229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f74071000 msgr2=0x7f9f74152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.332+0000 7f9f7a657640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f74071000 0x7f9f74152b00 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000d800 tx=0x7f9f7000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.332+0000 7f9f7a657640 1 -- 172.21.15.38:0/682065229 shutdown_connections 2023-12-22T08:48:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.332+0000 7f9f7a657640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f7415b420 0x7f9f74150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.332+0000 7f9f7a657640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f740a44a0 0x7f9f741431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.332+0000 7f9f7a657640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9f5806a430 0x7f9f5806c8f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.332+0000 7f9f7a657640 1 --2- 172.21.15.38:0/682065229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f74071000 0x7f9f74152b00 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.332+0000 7f9f7a657640 1 -- 172.21.15.38:0/682065229 >> 172.21.15.38:0/682065229 conn(0x7f9f740b1f70 msgr2=0x7f9f7406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:35.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.333+0000 7f9f7a657640 1 -- 172.21.15.38:0/682065229 shutdown_connections 2023-12-22T08:48:35.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.333+0000 7f9f7a657640 1 -- 172.21.15.38:0/682065229 wait complete. 2023-12-22T08:48:35.357 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-22T08:48:35.358 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-12-22T08:48:35.358 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:48:35.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.583+0000 7fa81359e640 1 Processor -- start 2023-12-22T08:48:35.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.583+0000 7fa81359e640 1 -- start start 2023-12-22T08:48:35.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.584+0000 7fa81359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81415b420 0x7fa81406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:35.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.584+0000 7fa81359e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8140cdae0 con 0x7fa8140a44a0 2023-12-22T08:48:35.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.584+0000 7fa81359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81406dec0 con 0x7fa814071000 2023-12-22T08:48:35.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.584+0000 7fa81359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81415b800 con 0x7fa81415b420 2023-12-22T08:48:35.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.585+0000 7fa811d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa8140a44a0 0x7fa8140708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57698/0 (socket says 172.21.15.38:57698) 2023-12-22T08:48:35.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.585+0000 7fa811d9b640 1 -- 172.21.15.38:0/624744220 learned_addr learned my addr 172.21.15.38:0/624744220 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:35.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.585+0000 7fa81259c640 1 --2- 172.21.15.38:0/624744220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81415b420 0x7fa81406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:35.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.585+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399178266 0 0) 0x7fa8140cdae0 con 0x7fa8140a44a0 2023-12-22T08:48:35.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.585+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7fc003520 con 0x7fa8140a44a0 2023-12-22T08:48:35.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3382539974 0 0) 0x7fa7fc003520 con 0x7fa8140a44a0 2023-12-22T08:48:35.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81415b420 msgr2=0x7fa81406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:35.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa81159a640 1 --2- 172.21.15.38:0/624744220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81415b420 0x7fa81406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 >> v1:172.21.15.89:6789/0 conn(0x7fa814071000 legacy=0x7fa81415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140cdd30 con 0x7fa8140a44a0 2023-12-22T08:48:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fa808001670 con 0x7fa8140a44a0 2023-12-22T08:48:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 >> v1:172.21.15.38:6789/0 conn(0x7fa8140a44a0 legacy=0x7fa8140708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa81159a640 1 --2- 172.21.15.38:0/624744220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7fc0039a0 0x7fa7fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa81159a640 1 --2- 172.21.15.38:0/624744220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81415b420 0x7fa7fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa81159a640 1 --2- 172.21.15.38:0/624744220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7fc004d00 0x7fa7fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81415b800 con 0x7fa7fc004d00 2023-12-22T08:48:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc00ba30 con 0x7fa7fc0039a0 2023-12-22T08:48:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc00bbf0 con 0x7fa81415b420 2023-12-22T08:48:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.586+0000 7fa812d9d640 1 --2- 172.21.15.38:0/624744220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7fc004d00 0x7fa7fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.587+0000 7fa811d9b640 1 --2- 172.21.15.38:0/624744220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81415b420 0x7fa7fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:35.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.587+0000 7fa81259c640 1 --2- 172.21.15.38:0/624744220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7fc0039a0 0x7fa7fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:35.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.587+0000 7fa812d9d640 1 -- 172.21.15.38:0/624744220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81415b420 msgr2=0x7fa7fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:35.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.587+0000 7fa812d9d640 1 --2- 172.21.15.38:0/624744220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa81415b420 0x7fa7fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.587+0000 7fa812d9d640 1 -- 172.21.15.38:0/624744220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7fc0039a0 msgr2=0x7fa7fc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:35.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.587+0000 7fa812d9d640 1 --2- 172.21.15.38:0/624744220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7fc0039a0 0x7fa7fc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.587+0000 7fa812d9d640 1 -- 172.21.15.38:0/624744220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc003520 con 0x7fa7fc004d00 2023-12-22T08:48:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.588+0000 7fa812d9d640 1 --2- 172.21.15.38:0/624744220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7fc004d00 0x7fa7fc005180 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fa81404e350 tx=0x7fa7fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf24d9de5c519b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.588+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c003b70 con 0x7fa7fc004d00 2023-12-22T08:48:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.588+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c003cd0 con 0x7fa7fc004d00 2023-12-22T08:48:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.588+0000 7fa81159a640 1 -- 172.21.15.38:0/624744220 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c005310 con 0x7fa7fc004d00 2023-12-22T08:48:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.589+0000 7fa81359e640 1 -- 172.21.15.38:0/624744220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7fc004d00 msgr2=0x7fa7fc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.589+0000 7fa81359e640 1 --2- 172.21.15.38:0/624744220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7fc004d00 0x7fa7fc005180 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fa81404e350 tx=0x7fa7fc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.589+0000 7fa812d9d640 1 -- 172.21.15.38:0/624744220 reap_dead start 2023-12-22T08:48:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.589+0000 7fa81359e640 1 -- 172.21.15.38:0/624744220 shutdown_connections 2023-12-22T08:48:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.589+0000 7fa81359e640 1 -- 172.21.15.38:0/624744220 >> 172.21.15.38:0/624744220 conn(0x7fa8140b1f70 msgr2=0x7fa8140b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.589+0000 7fa81359e640 1 -- 172.21.15.38:0/624744220 shutdown_connections 2023-12-22T08:48:35.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.589+0000 7fa81359e640 1 -- 172.21.15.38:0/624744220 wait complete. 2023-12-22T08:48:35.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.591+0000 7fa81359e640 1 Processor -- start 2023-12-22T08:48:35.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.591+0000 7fa81359e640 1 -- start start 2023-12-22T08:48:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.592+0000 7fa81359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7fc004d00 0x7fa8141f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.592+0000 7fa81359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8141585d0 0x7fa814158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.592+0000 7fa81359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa81406d110 0x7fa81406d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:35.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.592+0000 7fa81359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81406dad0 con 0x7fa81406d110 2023-12-22T08:48:35.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.592+0000 7fa81359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa814159070 con 0x7fa8141585d0 2023-12-22T08:48:35.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.592+0000 7fa81359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa814159350 con 0x7fa7fc004d00 2023-12-22T08:48:35.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.592+0000 7fa812d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa81406d110 0x7fa81406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:35.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.593+0000 7fa812d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa81406d110 0x7fa81406d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33626/0 (socket says 172.21.15.38:33626) 2023-12-22T08:48:35.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.593+0000 7fa812d9d640 1 -- 172.21.15.38:0/1904773761 learned_addr learned my addr 172.21.15.38:0/1904773761 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:35.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.593+0000 7fa81259c640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7fc004d00 0x7fa8141f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:35.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.593+0000 7fa811d9b640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8141585d0 0x7fa814158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:35.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.593+0000 7fa812d9d640 1 -- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7fc004d00 msgr2=0x7fa8141f1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:35.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.593+0000 7fa812d9d640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7fc004d00 0x7fa8141f1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.593+0000 7fa812d9d640 1 -- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8141585d0 msgr2=0x7fa814158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:35.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.593+0000 7fa812d9d640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8141585d0 0x7fa814158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.593+0000 7fa812d9d640 1 -- 172.21.15.38:0/1904773761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814159630 con 0x7fa81406d110 2023-12-22T08:48:35.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.593+0000 7fa812d9d640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa81406d110 0x7fa81406d590 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fa80c02c000 tx=0x7fa80c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:35.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.594+0000 7fa802ffd640 1 -- 172.21.15.38:0/1904773761 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c03e070 con 0x7fa81406d110 2023-12-22T08:48:35.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.594+0000 7fa802ffd640 1 -- 172.21.15.38:0/1904773761 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c003e40 con 0x7fa81406d110 2023-12-22T08:48:35.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.594+0000 7fa802ffd640 1 -- 172.21.15.38:0/1904773761 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c005380 con 0x7fa81406d110 2023-12-22T08:48:35.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.594+0000 7fa81359e640 1 -- 172.21.15.38:0/1904773761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa814159910 con 0x7fa81406d110 2023-12-22T08:48:35.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.594+0000 7fa81359e640 1 -- 172.21.15.38:0/1904773761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8141f2490 con 0x7fa81406d110 2023-12-22T08:48:35.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.595+0000 7fa81359e640 1 -- 172.21.15.38:0/1904773761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa814159b30 con 0x7fa81406d110 2023-12-22T08:48:35.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.596+0000 7fa802ffd640 1 -- 172.21.15.38:0/1904773761 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa80c0054e0 con 0x7fa81406d110 2023-12-22T08:48:35.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.597+0000 7fa802ffd640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa7f406a460 0x7fa7f406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:35.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.597+0000 7fa802ffd640 1 -- 172.21.15.38:0/1904773761 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa80c0a9830 con 0x7fa81406d110 2023-12-22T08:48:35.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.598+0000 7fa81259c640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa7f406a460 0x7fa7f406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:35.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.599+0000 7fa81259c640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa7f406a460 0x7fa7f406c920 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa804009ac0 tx=0x7fa804008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:35.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.601+0000 7fa802ffd640 1 -- 172.21.15.38:0/1904773761 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa80c075130 con 0x7fa81406d110 2023-12-22T08:48:35.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.798+0000 7fa81359e640 1 -- 172.21.15.38:0/1904773761 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa814061910 con 0x7fa81406d110 2023-12-22T08:48:35.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.799+0000 7fa802ffd640 1 -- 172.21.15.38:0/1904773761 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+12481 (secure 0 0 0) 0x7fa80c078750 con 0x7fa81406d110 2023-12-22T08:48:35.801 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:35.801 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":149,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:48:33.297843+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6835/1276125280":"2023-12-23T08:48:30.028238+0000","172.21.15.38:6833/1276125280":"2023-12-23T08:48:30.028238+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:48:35.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.802+0000 7fa81359e640 1 -- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa7f406a460 msgr2=0x7fa7f406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:35.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.802+0000 7fa81359e640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa7f406a460 0x7fa7f406c920 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa804009ac0 tx=0x7fa804008040 comp rx=0 tx=0).stop 2023-12-22T08:48:35.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.802+0000 7fa81359e640 1 -- 172.21.15.38:0/1904773761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa81406d110 msgr2=0x7fa81406d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:35.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.802+0000 7fa81359e640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa81406d110 0x7fa81406d590 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fa80c02c000 tx=0x7fa80c0014a0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.802+0000 7fa81359e640 1 -- 172.21.15.38:0/1904773761 shutdown_connections 2023-12-22T08:48:35.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.802+0000 7fa81359e640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa7f406a460 0x7fa7f406c920 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.802+0000 7fa81359e640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa81406d110 0x7fa81406d590 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.802+0000 7fa81359e640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8141585d0 0x7fa814158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.802+0000 7fa81359e640 1 --2- 172.21.15.38:0/1904773761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7fc004d00 0x7fa8141f1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:35.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.802+0000 7fa81359e640 1 -- 172.21.15.38:0/1904773761 >> 172.21.15.38:0/1904773761 conn(0x7fa8140b1f70 msgr2=0x7fa81409e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:35.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.803+0000 7fa81359e640 1 -- 172.21.15.38:0/1904773761 shutdown_connections 2023-12-22T08:48:35.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:35.803+0000 7fa81359e640 1 -- 172.21.15.38:0/1904773761 wait complete. 2023-12-22T08:48:35.824 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:48:35.824 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:48:36.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.056+0000 7fe42b59e640 1 Processor -- start 2023-12-22T08:48:36.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.056+0000 7fe42b59e640 1 -- start start 2023-12-22T08:48:36.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.058+0000 7fe42b59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe42c070f10 0x7fe42c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:36.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.058+0000 7fe42b59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe42c06f790 0x7fe42c0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:36.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.058+0000 7fe42b59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c161ba0 con 0x7fe42c0ae6a0 2023-12-22T08:48:36.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.058+0000 7fe42b59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c0acc00 con 0x7fe42c06f790 2023-12-22T08:48:36.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.058+0000 7fe42b59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c0acea0 con 0x7fe42c070f10 2023-12-22T08:48:36.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.058+0000 7fe429d9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe42c06f790 0x7fe42c0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:36.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.058+0000 7fe429d9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe42c06f790 0x7fe42c0712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33642/0 (socket says 172.21.15.38:33642) 2023-12-22T08:48:36.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.058+0000 7fe429d9b640 1 -- 172.21.15.38:0/3781194069 learned_addr learned my addr 172.21.15.38:0/3781194069 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:36.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.058+0000 7fe42ad9d640 1 --1- 172.21.15.38:0/3781194069 >> v1:172.21.15.38:6789/0 conn(0x7fe42c0ae6a0 0x7fe42c06c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57714/0 (socket says 172.21.15.38:57714) 2023-12-22T08:48:36.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.058+0000 7fe42a59c640 1 --2- 172.21.15.38:0/3781194069 >> v2:172.21.15.89:3300/0 conn(0x7fe42c070f10 0x7fe42c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:36.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.059+0000 7fe429d9b640 1 -- 172.21.15.38:0/3781194069 >> v2:172.21.15.89:3300/0 conn(0x7fe42c070f10 msgr2=0x7fe42c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:36.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.059+0000 7fe429d9b640 1 --2- 172.21.15.38:0/3781194069 >> v2:172.21.15.89:3300/0 conn(0x7fe42c070f10 0x7fe42c06f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.059+0000 7fe429d9b640 1 -- 172.21.15.38:0/3781194069 >> v1:172.21.15.38:6789/0 conn(0x7fe42c0ae6a0 legacy=0x7fe42c06c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:36.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.059+0000 7fe429d9b640 1 -- 172.21.15.38:0/3781194069 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0ad180 con 0x7fe42c06f790 2023-12-22T08:48:36.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.059+0000 7fe42959a640 1 -- 172.21.15.38:0/3781194069 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060396345 0 0) 0x7fe424001490 con 0x7fe42c0ae6a0 2023-12-22T08:48:36.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.060+0000 7fe429d9b640 1 --2- 172.21.15.38:0/3781194069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c06f790 0x7fe42c0712f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fe42c06a420 tx=0x7fe41402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14042e23ecd21897 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:36.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.060+0000 7fe42959a640 1 -- 172.21.15.38:0/3781194069 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414031870 con 0x7fe42c06f790 2023-12-22T08:48:36.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.060+0000 7fe42959a640 1 -- 172.21.15.38:0/3781194069 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4140319d0 con 0x7fe42c06f790 2023-12-22T08:48:36.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.060+0000 7fe42959a640 1 -- 172.21.15.38:0/3781194069 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414031d60 con 0x7fe42c06f790 2023-12-22T08:48:36.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.061+0000 7fe42b59e640 1 -- 172.21.15.38:0/3781194069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c06f790 msgr2=0x7fe42c0712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:36.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.061+0000 7fe42b59e640 1 --2- 172.21.15.38:0/3781194069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c06f790 0x7fe42c0712f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fe42c06a420 tx=0x7fe41402b910 comp rx=0 tx=0).stop 2023-12-22T08:48:36.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.061+0000 7fe42b59e640 1 -- 172.21.15.38:0/3781194069 shutdown_connections 2023-12-22T08:48:36.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.061+0000 7fe42b59e640 1 --2- 172.21.15.38:0/3781194069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c06f790 0x7fe42c0712f0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.061+0000 7fe42b59e640 1 --2- 172.21.15.38:0/3781194069 >> v2:172.21.15.89:3300/0 conn(0x7fe42c070f10 0x7fe42c06f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.061+0000 7fe42b59e640 1 -- 172.21.15.38:0/3781194069 >> 172.21.15.38:0/3781194069 conn(0x7fe42c0b0b60 msgr2=0x7fe42c0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:36.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.061+0000 7fe42b59e640 1 -- 172.21.15.38:0/3781194069 shutdown_connections 2023-12-22T08:48:36.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.061+0000 7fe42b59e640 1 -- 172.21.15.38:0/3781194069 wait complete. 2023-12-22T08:48:36.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.063+0000 7fe42b59e640 1 Processor -- start 2023-12-22T08:48:36.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.063+0000 7fe42b59e640 1 -- start start 2023-12-22T08:48:36.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.064+0000 7fe42b59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c06f790 0x7fe42c09b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:36.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.064+0000 7fe42b59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe42c070f10 0x7fe42c159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:36.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.064+0000 7fe42b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe42c0ae6a0 0x7fe42c15d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:36.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.064+0000 7fe42b59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0c2860 con 0x7fe42c06f790 2023-12-22T08:48:36.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.064+0000 7fe42b59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c09c340 con 0x7fe42c070f10 2023-12-22T08:48:36.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.064+0000 7fe42b59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c09c060 con 0x7fe42c0ae6a0 2023-12-22T08:48:36.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.064+0000 7fe42a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c06f790 0x7fe42c09b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:36.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.064+0000 7fe42a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c06f790 0x7fe42c09b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33658/0 (socket says 172.21.15.38:33658) 2023-12-22T08:48:36.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.064+0000 7fe42a59c640 1 -- 172.21.15.38:0/3220058210 learned_addr learned my addr 172.21.15.38:0/3220058210 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:36.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.065+0000 7fe42ad9d640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe42c0ae6a0 0x7fe42c15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:36.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.065+0000 7fe429d9b640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe42c070f10 0x7fe42c159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:36.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.065+0000 7fe42a59c640 1 -- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe42c0ae6a0 msgr2=0x7fe42c15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:36.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.065+0000 7fe42a59c640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe42c0ae6a0 0x7fe42c15d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.065+0000 7fe42a59c640 1 -- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe42c070f10 msgr2=0x7fe42c159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:36.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.065+0000 7fe42a59c640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe42c070f10 0x7fe42c159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.065+0000 7fe42a59c640 1 -- 172.21.15.38:0/3220058210 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4140094d0 con 0x7fe42c06f790 2023-12-22T08:48:36.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.065+0000 7fe42ad9d640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe42c0ae6a0 0x7fe42c15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:36.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.065+0000 7fe429d9b640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe42c070f10 0x7fe42c159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:36.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.065+0000 7fe42a59c640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c06f790 0x7fe42c09b7a0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00d800 tx=0x7fe41c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:36.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.065+0000 7fe422ffd640 1 -- 172.21.15.38:0/3220058210 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c00b6c0 con 0x7fe42c06f790 2023-12-22T08:48:36.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.066+0000 7fe422ffd640 1 -- 172.21.15.38:0/3220058210 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c00b820 con 0x7fe42c06f790 2023-12-22T08:48:36.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.066+0000 7fe42b59e640 1 -- 172.21.15.38:0/3220058210 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c0c21a0 con 0x7fe42c06f790 2023-12-22T08:48:36.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.066+0000 7fe422ffd640 1 -- 172.21.15.38:0/3220058210 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c00bbb0 con 0x7fe42c06f790 2023-12-22T08:48:36.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.066+0000 7fe42b59e640 1 -- 172.21.15.38:0/3220058210 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c09bce0 con 0x7fe42c06f790 2023-12-22T08:48:36.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.067+0000 7fe42b59e640 1 -- 172.21.15.38:0/3220058210 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c0c2ad0 con 0x7fe42c06f790 2023-12-22T08:48:36.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.068+0000 7fe422ffd640 1 -- 172.21.15.38:0/3220058210 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe41c00bd10 con 0x7fe42c06f790 2023-12-22T08:48:36.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.069+0000 7fe422ffd640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe40c06a430 0x7fe40c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:36.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.069+0000 7fe422ffd640 1 -- 172.21.15.38:0/3220058210 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe41c088b70 con 0x7fe42c06f790 2023-12-22T08:48:36.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.069+0000 7fe429d9b640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe40c06a430 0x7fe40c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:36.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.070+0000 7fe429d9b640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe40c06a430 0x7fe40c06c8f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe414036000 tx=0x7fe41403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:36.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.073+0000 7fe422ffd640 1 -- 172.21.15.38:0/3220058210 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe41c054450 con 0x7fe42c06f790 2023-12-22T08:48:36.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.262+0000 7fe42b59e640 1 -- 172.21.15.38:0/3220058210 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe42c061910 con 0x7fe42c06f790 2023-12-22T08:48:36.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.263+0000 7fe422ffd640 1 -- 172.21.15.38:0/3220058210 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe41c057a70 con 0x7fe42c06f790 2023-12-22T08:48:36.264 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:48:36.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.265+0000 7fe42b59e640 1 -- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe40c06a430 msgr2=0x7fe40c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:36.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.265+0000 7fe42b59e640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe40c06a430 0x7fe40c06c8f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe414036000 tx=0x7fe41403c040 comp rx=0 tx=0).stop 2023-12-22T08:48:36.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.265+0000 7fe42b59e640 1 -- 172.21.15.38:0/3220058210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c06f790 msgr2=0x7fe42c09b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:36.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.265+0000 7fe42b59e640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c06f790 0x7fe42c09b7a0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00d800 tx=0x7fe41c00dcc0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.265+0000 7fe42b59e640 1 -- 172.21.15.38:0/3220058210 shutdown_connections 2023-12-22T08:48:36.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.265+0000 7fe42b59e640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe42c0ae6a0 0x7fe42c15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.265+0000 7fe42b59e640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe42c070f10 0x7fe42c159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.265+0000 7fe42b59e640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe40c06a430 0x7fe40c06c8f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.265+0000 7fe42b59e640 1 --2- 172.21.15.38:0/3220058210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c06f790 0x7fe42c09b7a0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.265+0000 7fe42b59e640 1 -- 172.21.15.38:0/3220058210 >> 172.21.15.38:0/3220058210 conn(0x7fe42c0b0b60 msgr2=0x7fe42c160bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:36.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.265+0000 7fe42b59e640 1 -- 172.21.15.38:0/3220058210 shutdown_connections 2023-12-22T08:48:36.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.265+0000 7fe42b59e640 1 -- 172.21.15.38:0/3220058210 wait complete. 2023-12-22T08:48:36.284 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-12-22T08:48:36.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.505+0000 7f740ef30640 1 Processor -- start 2023-12-22T08:48:36.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.505+0000 7f740ef30640 1 -- start start 2023-12-22T08:48:36.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.507+0000 7f740ef30640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7408071680 0x7f7408162f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:36.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.507+0000 7f740ef30640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f74080b2a90 0x7f74080ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:36.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.507+0000 7f740ef30640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74080cb1d0 con 0x7f74080cadc0 2023-12-22T08:48:36.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.507+0000 7f740ef30640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7408162ce0 con 0x7f7408071680 2023-12-22T08:48:36.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.507+0000 7f740ef30640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74080b2f40 con 0x7f74080b2a90 2023-12-22T08:48:36.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.507+0000 7f740df2e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7408071680 0x7f7408162f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:36.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.507+0000 7f740df2e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7408071680 0x7f7408162f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33664/0 (socket says 172.21.15.38:33664) 2023-12-22T08:48:36.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.507+0000 7f740df2e640 1 -- 172.21.15.38:0/2858557891 learned_addr learned my addr 172.21.15.38:0/2858557891 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:36.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.507+0000 7f740df2e640 1 -- 172.21.15.38:0/2858557891 >> v2:172.21.15.89:3300/0 conn(0x7f74080b2a90 msgr2=0x7f74080ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:36.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.507+0000 7f740df2e640 1 --2- 172.21.15.38:0/2858557891 >> v2:172.21.15.89:3300/0 conn(0x7f74080b2a90 0x7f74080ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.507+0000 7f740df2e640 1 -- 172.21.15.38:0/2858557891 >> v1:172.21.15.89:6789/0 conn(0x7f74080cadc0 legacy=0x7f740806d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:36.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.508+0000 7f740df2e640 1 -- 172.21.15.38:0/2858557891 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7408162160 con 0x7f7408071680 2023-12-22T08:48:36.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.509+0000 7f740df2e640 1 --2- 172.21.15.38:0/2858557891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7408071680 0x7f7408162f20 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f740804e330 tx=0x7f740402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2437d1290bdcd9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:36.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.509+0000 7f740cf2c640 1 -- 172.21.15.38:0/2858557891 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404031870 con 0x7f7408071680 2023-12-22T08:48:36.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.509+0000 7f740cf2c640 1 -- 172.21.15.38:0/2858557891 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74040319d0 con 0x7f7408071680 2023-12-22T08:48:36.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.509+0000 7f740cf2c640 1 -- 172.21.15.38:0/2858557891 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404031d60 con 0x7f7408071680 2023-12-22T08:48:36.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.510+0000 7f740ef30640 1 -- 172.21.15.38:0/2858557891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7408071680 msgr2=0x7f7408162f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:36.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.510+0000 7f740ef30640 1 --2- 172.21.15.38:0/2858557891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7408071680 0x7f7408162f20 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f740804e330 tx=0x7f740402b910 comp rx=0 tx=0).stop 2023-12-22T08:48:36.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.510+0000 7f740ef30640 1 -- 172.21.15.38:0/2858557891 shutdown_connections 2023-12-22T08:48:36.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.510+0000 7f740ef30640 1 --2- 172.21.15.38:0/2858557891 >> v2:172.21.15.89:3300/0 conn(0x7f74080b2a90 0x7f74080ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.510+0000 7f740ef30640 1 --2- 172.21.15.38:0/2858557891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7408071680 0x7f7408162f20 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.510+0000 7f740ef30640 1 -- 172.21.15.38:0/2858557891 >> 172.21.15.38:0/2858557891 conn(0x7f74080b1f70 msgr2=0x7f74080b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:36.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.510+0000 7f740ef30640 1 -- 172.21.15.38:0/2858557891 shutdown_connections 2023-12-22T08:48:36.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.510+0000 7f740ef30640 1 -- 172.21.15.38:0/2858557891 wait complete. 2023-12-22T08:48:36.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.511+0000 7f740ef30640 1 Processor -- start 2023-12-22T08:48:36.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.512+0000 7f740ef30640 1 -- start start 2023-12-22T08:48:36.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.512+0000 7f740ef30640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7408071680 0x7f7408156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:36.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.512+0000 7f740ef30640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74080b2a90 0x7f7408157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:36.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740ef30640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74080cadc0 0x7f740815a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:36.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740ef30640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7408159590 con 0x7f74080cadc0 2023-12-22T08:48:36.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740ef30640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7408159a20 con 0x7f74080b2a90 2023-12-22T08:48:36.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740ef30640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7408158980 con 0x7f7408071680 2023-12-22T08:48:36.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740e72f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74080cadc0 0x7f740815a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740e72f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74080cadc0 0x7f740815a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33678/0 (socket says 172.21.15.38:33678) 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740e72f640 1 -- 172.21.15.38:0/4242125692 learned_addr learned my addr 172.21.15.38:0/4242125692 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740df2e640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7408071680 0x7f7408156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740d72d640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74080b2a90 0x7f7408157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740e72f640 1 -- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7408071680 msgr2=0x7f7408156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740e72f640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7408071680 0x7f7408156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740e72f640 1 -- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74080b2a90 msgr2=0x7f7408157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740e72f640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74080b2a90 0x7f7408157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740e72f640 1 -- 172.21.15.38:0/4242125692 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74040094d0 con 0x7f74080cadc0 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.513+0000 7f740d72d640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74080b2a90 0x7f7408157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.514+0000 7f740e72f640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74080cadc0 0x7f740815a2d0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f740000b990 tx=0x7f740000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.514+0000 7f73fe7fc640 1 -- 172.21.15.38:0/4242125692 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740000cba0 con 0x7f74080cadc0 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.514+0000 7f73fe7fc640 1 -- 172.21.15.38:0/4242125692 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740000cd00 con 0x7f74080cadc0 2023-12-22T08:48:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.514+0000 7f73fe7fc640 1 -- 172.21.15.38:0/4242125692 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400014680 con 0x7f74080cadc0 2023-12-22T08:48:36.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.514+0000 7f740ef30640 1 -- 172.21.15.38:0/4242125692 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7408158c60 con 0x7f74080cadc0 2023-12-22T08:48:36.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.514+0000 7f740ef30640 1 -- 172.21.15.38:0/4242125692 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7408159220 con 0x7f74080cadc0 2023-12-22T08:48:36.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.515+0000 7f740ef30640 1 -- 172.21.15.38:0/4242125692 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7408159700 con 0x7f74080cadc0 2023-12-22T08:48:36.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.516+0000 7f73fe7fc640 1 -- 172.21.15.38:0/4242125692 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f74000147e0 con 0x7f74080cadc0 2023-12-22T08:48:36.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.517+0000 7f73fe7fc640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73ec06a430 0x7f73ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.517+0000 7f73fe7fc640 1 -- 172.21.15.38:0/4242125692 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7400088660 con 0x7f74080cadc0 2023-12-22T08:48:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.518+0000 7f740df2e640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73ec06a430 0x7f73ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:36.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.519+0000 7f740df2e640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73ec06a430 0x7f73ec06c8f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7404036000 tx=0x7f740403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:36.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.522+0000 7f73fe7fc640 1 -- 172.21.15.38:0/4242125692 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7400053eb0 con 0x7f74080cadc0 2023-12-22T08:48:36.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:36.787+0000 7f740ef30640 1 -- 172.21.15.38:0/4242125692 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f7408061910 con 0x7f74080cadc0 2023-12-22T08:48:37.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.337+0000 7f73fe7fc640 1 -- 172.21.15.38:0/4242125692 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v451) v1 ==== 135+0+0 (secure 0 0 0) 0x7f74000574d0 con 0x7f74080cadc0 2023-12-22T08:48:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.342+0000 7f740ef30640 1 -- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73ec06a430 msgr2=0x7f73ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.342+0000 7f740ef30640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73ec06a430 0x7f73ec06c8f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7404036000 tx=0x7f740403c040 comp rx=0 tx=0).stop 2023-12-22T08:48:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.342+0000 7f740ef30640 1 -- 172.21.15.38:0/4242125692 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74080cadc0 msgr2=0x7f740815a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.342+0000 7f740ef30640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74080cadc0 0x7f740815a2d0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f740000b990 tx=0x7f740000be50 comp rx=0 tx=0).stop 2023-12-22T08:48:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.342+0000 7f740ef30640 1 -- 172.21.15.38:0/4242125692 shutdown_connections 2023-12-22T08:48:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.342+0000 7f740ef30640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73ec06a430 0x7f73ec06c8f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.342+0000 7f740ef30640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74080cadc0 0x7f740815a2d0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.342+0000 7f740ef30640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74080b2a90 0x7f7408157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.342+0000 7f740ef30640 1 --2- 172.21.15.38:0/4242125692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7408071680 0x7f7408156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.342+0000 7f740ef30640 1 -- 172.21.15.38:0/4242125692 >> 172.21.15.38:0/4242125692 conn(0x7f74080b1f70 msgr2=0x7f74080cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.342+0000 7f740ef30640 1 -- 172.21.15.38:0/4242125692 shutdown_connections 2023-12-22T08:48:37.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.342+0000 7f740ef30640 1 -- 172.21.15.38:0/4242125692 wait complete. 2023-12-22T08:48:37.365 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T08:48:37.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.581+0000 7f85a49d8640 1 Processor -- start 2023-12-22T08:48:37.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.581+0000 7f85a49d8640 1 -- start start 2023-12-22T08:48:37.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.582+0000 7f85a49d8640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f85a0071080 0x7f85a00d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:37.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.583+0000 7f85a49d8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a015de50 con 0x7f85a015d5a0 2023-12-22T08:48:37.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.583+0000 7f85a49d8640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a00d0dd0 con 0x7f85a015d1c0 2023-12-22T08:48:37.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.583+0000 7f85a49d8640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a00d10b0 con 0x7f85a0071080 2023-12-22T08:48:37.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.583+0000 7f859f59e640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f85a015d5a0 0x7f85a00d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57726/0 (socket says 172.21.15.38:57726) 2023-12-22T08:48:37.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.583+0000 7f859f59e640 1 -- 172.21.15.38:0/2737483116 learned_addr learned my addr 172.21.15.38:0/2737483116 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:37.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.583+0000 7f859659c640 1 --2- 172.21.15.38:0/2737483116 >> v2:172.21.15.89:3300/0 conn(0x7f85a0071080 0x7f85a00d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:37.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.584+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752690704 0 0) 0x7f85a015de50 con 0x7f85a015d5a0 2023-12-22T08:48:37.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.584+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f858c003520 con 0x7f85a015d5a0 2023-12-22T08:48:37.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.584+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854929069 0 0) 0x7f85a00d0dd0 con 0x7f85a015d1c0 2023-12-22T08:48:37.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.584+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a015de50 con 0x7f85a015d1c0 2023-12-22T08:48:37.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.584+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3639448195 0 0) 0x7f858c003520 con 0x7f85a015d5a0 2023-12-22T08:48:37.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.584+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 >> v2:172.21.15.89:3300/0 conn(0x7f85a0071080 msgr2=0x7f85a00d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:37.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.584+0000 7f859e59c640 1 --2- 172.21.15.38:0/2737483116 >> v2:172.21.15.89:3300/0 conn(0x7f85a0071080 0x7f85a00d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.584+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 >> v1:172.21.15.89:6789/0 conn(0x7f85a015d1c0 legacy=0x7f85a0070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:37.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.584+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a015dae0 con 0x7f85a015d5a0 2023-12-22T08:48:37.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.584+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f8598001670 con 0x7f85a015d5a0 2023-12-22T08:48:37.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.584+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 >> v1:172.21.15.38:6789/0 conn(0x7f85a015d5a0 legacy=0x7f85a00d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:37.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.584+0000 7f859e59c640 1 --2- 172.21.15.38:0/2737483116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f858c003b00 0x7f858c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:37.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.584+0000 7f859e59c640 1 --2- 172.21.15.38:0/2737483116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c0047c0 0x7f858c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.585+0000 7f859e59c640 1 --2- 172.21.15.38:0/2737483116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f858c005180 0x7f858c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.585+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00d10b0 con 0x7f858c005180 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.585+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c00c000 con 0x7f858c0047c0 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.585+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c00c1c0 con 0x7f858c003b00 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.585+0000 7f859f59e640 1 --2- 172.21.15.38:0/2737483116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f858c005180 0x7f858c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.585+0000 7f859659c640 1 --2- 172.21.15.38:0/2737483116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c0047c0 0x7f858c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.585+0000 7f859ed9d640 1 --2- 172.21.15.38:0/2737483116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f858c003b00 0x7f858c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.585+0000 7f859f59e640 1 -- 172.21.15.38:0/2737483116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f858c003b00 msgr2=0x7f858c003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.585+0000 7f859f59e640 1 --2- 172.21.15.38:0/2737483116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f858c003b00 0x7f858c003f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.585+0000 7f859f59e640 1 -- 172.21.15.38:0/2737483116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c0047c0 msgr2=0x7f858c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.585+0000 7f859f59e640 1 --2- 172.21.15.38:0/2737483116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c0047c0 0x7f858c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.585+0000 7f859f59e640 1 -- 172.21.15.38:0/2737483116 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c003520 con 0x7f858c005180 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.585+0000 7f859659c640 1 --2- 172.21.15.38:0/2737483116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f858c0047c0 0x7f858c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:37.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.586+0000 7f859f59e640 1 -- 172.21.15.38:0/2737483116 reap_dead start 2023-12-22T08:48:37.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.586+0000 7f859f59e640 1 --2- 172.21.15.38:0/2737483116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f858c005180 0x7f858c00b980 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f8598007fd0 tx=0x7f858c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7de00d9c0dc227 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:37.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.587+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598005ad0 con 0x7f858c005180 2023-12-22T08:48:37.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.587+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8598005c30 con 0x7f858c005180 2023-12-22T08:48:37.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.587+0000 7f859e59c640 1 -- 172.21.15.38:0/2737483116 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859802c850 con 0x7f858c005180 2023-12-22T08:48:37.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.587+0000 7f85a49d8640 1 -- 172.21.15.38:0/2737483116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f858c005180 msgr2=0x7f858c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:37.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.587+0000 7f85a49d8640 1 --2- 172.21.15.38:0/2737483116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f858c005180 0x7f858c00b980 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f8598007fd0 tx=0x7f858c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.587+0000 7f85a49d8640 1 -- 172.21.15.38:0/2737483116 shutdown_connections 2023-12-22T08:48:37.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.587+0000 7f85a49d8640 1 --2- 172.21.15.38:0/2737483116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f858c005180 0x7f858c00b980 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.587+0000 7f85a49d8640 1 -- 172.21.15.38:0/2737483116 >> 172.21.15.38:0/2737483116 conn(0x7f85a006bf90 msgr2=0x7f85a006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:37.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.587+0000 7f85a49d8640 1 -- 172.21.15.38:0/2737483116 shutdown_connections 2023-12-22T08:48:37.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.587+0000 7f85a49d8640 1 -- 172.21.15.38:0/2737483116 wait complete. 2023-12-22T08:48:37.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.589+0000 7f85a49d8640 1 Processor -- start 2023-12-22T08:48:37.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.589+0000 7f85a49d8640 1 -- start start 2023-12-22T08:48:37.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.590+0000 7f85a49d8640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f858c005180 0x7f85a0151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.590+0000 7f85a49d8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85a01589f0 0x7f85a0158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.590+0000 7f85a49d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85a01598e0 0x7f85a0159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.590+0000 7f85a49d8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a015a610 con 0x7f85a01589f0 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.590+0000 7f85a49d8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a015a8f0 con 0x7f85a01598e0 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.590+0000 7f85a49d8640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a015abd0 con 0x7f858c005180 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.590+0000 7f859659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85a01589f0 0x7f85a0158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.590+0000 7f859659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85a01589f0 0x7f85a0158e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33698/0 (socket says 172.21.15.38:33698) 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.590+0000 7f859659c640 1 -- 172.21.15.38:0/3439898477 learned_addr learned my addr 172.21.15.38:0/3439898477 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.591+0000 7f859ed9d640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f858c005180 0x7f85a0151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.591+0000 7f859f59e640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85a01598e0 0x7f85a0159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.591+0000 7f859659c640 1 -- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f858c005180 msgr2=0x7f85a0151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.591+0000 7f859659c640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f858c005180 0x7f85a0151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.591+0000 7f859659c640 1 -- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85a01598e0 msgr2=0x7f85a0159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:37.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.591+0000 7f859659c640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85a01598e0 0x7f85a0159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.591+0000 7f859659c640 1 -- 172.21.15.38:0/3439898477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a015aeb0 con 0x7f85a01589f0 2023-12-22T08:48:37.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.591+0000 7f859ed9d640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f858c005180 0x7f85a0151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:37.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.591+0000 7f859659c640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85a01589f0 0x7f85a0158e70 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f85880108b0 tx=0x7f8588010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:37.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.591+0000 7f8597fff640 1 -- 172.21.15.38:0/3439898477 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858800eb60 con 0x7f85a01589f0 2023-12-22T08:48:37.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.592+0000 7f8597fff640 1 -- 172.21.15.38:0/3439898477 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858800ecc0 con 0x7f85a01589f0 2023-12-22T08:48:37.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.592+0000 7f85a49d8640 1 -- 172.21.15.38:0/3439898477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a01593b0 con 0x7f85a01589f0 2023-12-22T08:48:37.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.592+0000 7f8597fff640 1 -- 172.21.15.38:0/3439898477 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858801c400 con 0x7f85a01589f0 2023-12-22T08:48:37.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.592+0000 7f85a49d8640 1 -- 172.21.15.38:0/3439898477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a015a2d0 con 0x7f85a01589f0 2023-12-22T08:48:37.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.593+0000 7f85a49d8640 1 -- 172.21.15.38:0/3439898477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a0061910 con 0x7f85a01589f0 2023-12-22T08:48:37.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.594+0000 7f8597fff640 1 -- 172.21.15.38:0/3439898477 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f858801c560 con 0x7f85a01589f0 2023-12-22T08:48:37.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.595+0000 7f8597fff640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f858006a430 0x7f858006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:37.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.595+0000 7f8597fff640 1 -- 172.21.15.38:0/3439898477 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8588088ca0 con 0x7f85a01589f0 2023-12-22T08:48:37.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.596+0000 7f859ed9d640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f858006a430 0x7f858006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:37.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.597+0000 7f859ed9d640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f858006a430 0x7f858006c8f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f85900012e0 tx=0x7f8590009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:37.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.599+0000 7f8597fff640 1 -- 172.21.15.38:0/3439898477 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8588054630 con 0x7f85a01589f0 2023-12-22T08:48:37.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.791+0000 7f85a49d8640 1 -- 172.21.15.38:0/3439898477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f85a006ce60 con 0x7f85a01589f0 2023-12-22T08:48:37.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.800+0000 7f8597fff640 1 -- 172.21.15.38:0/3439898477 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8588057c50 con 0x7f85a01589f0 2023-12-22T08:48:37.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.803+0000 7f85a49d8640 1 -- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f858006a430 msgr2=0x7f858006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:37.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.803+0000 7f85a49d8640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f858006a430 0x7f858006c8f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f85900012e0 tx=0x7f8590009040 comp rx=0 tx=0).stop 2023-12-22T08:48:37.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.803+0000 7f85a49d8640 1 -- 172.21.15.38:0/3439898477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85a01589f0 msgr2=0x7f85a0158e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:37.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.803+0000 7f85a49d8640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85a01589f0 0x7f85a0158e70 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f85880108b0 tx=0x7f8588010d70 comp rx=0 tx=0).stop 2023-12-22T08:48:37.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.803+0000 7f85a49d8640 1 -- 172.21.15.38:0/3439898477 shutdown_connections 2023-12-22T08:48:37.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.803+0000 7f85a49d8640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85a01598e0 0x7f85a0159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.803+0000 7f85a49d8640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f858006a430 0x7f858006c8f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.803+0000 7f85a49d8640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85a01589f0 0x7f85a0158e70 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.803+0000 7f85a49d8640 1 --2- 172.21.15.38:0/3439898477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f858c005180 0x7f85a0151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:37.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.803+0000 7f85a49d8640 1 -- 172.21.15.38:0/3439898477 >> 172.21.15.38:0/3439898477 conn(0x7f85a006bf90 msgr2=0x7f85a006d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:37.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.804+0000 7f85a49d8640 1 -- 172.21.15.38:0/3439898477 shutdown_connections 2023-12-22T08:48:37.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:37.804+0000 7f85a49d8640 1 -- 172.21.15.38:0/3439898477 wait complete. 2023-12-22T08:48:37.824 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:48:37.824 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:48:37.948 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:48:38.069 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:48:38.070 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:48:38.070 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:38.134 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:48:38.134 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:48:38.134 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:38.195 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:48:38.195 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:48:38.195 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:38.260 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:48:38.260 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:48:38.260 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:38.320 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:48:38.321 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-22T08:48:38.321 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:48:38.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.546+0000 7f0868143640 1 Processor -- start 2023-12-22T08:48:38.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.547+0000 7f0868143640 1 -- start start 2023-12-22T08:48:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.548+0000 7f0868143640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f086015e740 0x7f086015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.548+0000 7f0868143640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f086006ca50 0x7f08600b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.548+0000 7f0868143640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086015eb20 con 0x7f08600b3dc0 2023-12-22T08:48:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.548+0000 7f0868143640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086006e650 con 0x7f086006ca50 2023-12-22T08:48:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.548+0000 7f0868143640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0860070770 con 0x7f086015e740 2023-12-22T08:48:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.548+0000 7f08656de640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f086006ca50 0x7f08600b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.549+0000 7f08656de640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f086006ca50 0x7f08600b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33710/0 (socket says 172.21.15.38:33710) 2023-12-22T08:48:38.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.549+0000 7f08656de640 1 -- 172.21.15.38:0/1276060520 learned_addr learned my addr 172.21.15.38:0/1276060520 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.549+0000 7f08656de640 1 -- 172.21.15.38:0/1276060520 >> v2:172.21.15.89:3300/0 conn(0x7f086015e740 msgr2=0x7f086015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.549+0000 7f0865edf640 1 --2- 172.21.15.38:0/1276060520 >> v2:172.21.15.89:3300/0 conn(0x7f086015e740 0x7f086015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.549+0000 7f08656de640 1 --2- 172.21.15.38:0/1276060520 >> v2:172.21.15.89:3300/0 conn(0x7f086015e740 0x7f086015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.549+0000 7f08656de640 1 -- 172.21.15.38:0/1276060520 >> v1:172.21.15.89:6789/0 conn(0x7f08600b3dc0 legacy=0x7f0860161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.549+0000 7f08656de640 1 -- 172.21.15.38:0/1276060520 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08600b41d0 con 0x7f086006ca50 2023-12-22T08:48:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.549+0000 7f0865edf640 1 --2- 172.21.15.38:0/1276060520 >> v2:172.21.15.89:3300/0 conn(0x7f086015e740 0x7f086015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:38.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.550+0000 7f08656de640 1 --2- 172.21.15.38:0/1276060520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086006ca50 0x7f08600b3880 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f086006ca20 tx=0x7f085002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4376b7c1408df9a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:38.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.551+0000 7f0864edd640 1 -- 172.21.15.38:0/1276060520 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850031750 con 0x7f086006ca50 2023-12-22T08:48:38.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.551+0000 7f0864edd640 1 -- 172.21.15.38:0/1276060520 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08500318b0 con 0x7f086006ca50 2023-12-22T08:48:38.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.551+0000 7f0864edd640 1 -- 172.21.15.38:0/1276060520 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850031c40 con 0x7f086006ca50 2023-12-22T08:48:38.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.551+0000 7f0868143640 1 -- 172.21.15.38:0/1276060520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086006ca50 msgr2=0x7f08600b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:38.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.551+0000 7f0868143640 1 --2- 172.21.15.38:0/1276060520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086006ca50 0x7f08600b3880 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f086006ca20 tx=0x7f085002b7f0 comp rx=0 tx=0).stop 2023-12-22T08:48:38.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.551+0000 7f0868143640 1 -- 172.21.15.38:0/1276060520 shutdown_connections 2023-12-22T08:48:38.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.551+0000 7f0868143640 1 --2- 172.21.15.38:0/1276060520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086006ca50 0x7f08600b3880 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:38.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.551+0000 7f0868143640 1 --2- 172.21.15.38:0/1276060520 >> v2:172.21.15.89:3300/0 conn(0x7f086015e740 0x7f086015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:38.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.551+0000 7f0868143640 1 -- 172.21.15.38:0/1276060520 >> 172.21.15.38:0/1276060520 conn(0x7f08600cfea0 msgr2=0x7f08600d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:38.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.551+0000 7f0868143640 1 -- 172.21.15.38:0/1276060520 shutdown_connections 2023-12-22T08:48:38.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.552+0000 7f0868143640 1 -- 172.21.15.38:0/1276060520 wait complete. 2023-12-22T08:48:38.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.553+0000 7f0868143640 1 Processor -- start 2023-12-22T08:48:38.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.553+0000 7f0868143640 1 -- start start 2023-12-22T08:48:38.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.554+0000 7f0868143640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f086006ca50 0x7f08600d1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:38.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.554+0000 7f0868143640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08600b3dc0 0x7f0860154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:38.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.554+0000 7f0868143640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086015e740 0x7f086013f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:38.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.554+0000 7f0868143640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08601f6ee0 con 0x7f086015e740 2023-12-22T08:48:38.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.554+0000 7f0868143640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08601f6260 con 0x7f086006ca50 2023-12-22T08:48:38.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.554+0000 7f0868143640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08601f6540 con 0x7f08600b3dc0 2023-12-22T08:48:38.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.555+0000 7f08666e0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086015e740 0x7f086013f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:38.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.555+0000 7f08666e0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086015e740 0x7f086013f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33716/0 (socket says 172.21.15.38:33716) 2023-12-22T08:48:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.555+0000 7f08666e0640 1 -- 172.21.15.38:0/1715642780 learned_addr learned my addr 172.21.15.38:0/1715642780 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.555+0000 7f08656de640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08600b3dc0 0x7f0860154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.555+0000 7f0865edf640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f086006ca50 0x7f08600d1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.555+0000 7f08666e0640 1 -- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08600b3dc0 msgr2=0x7f0860154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.555+0000 7f08666e0640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08600b3dc0 0x7f0860154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.555+0000 7f08666e0640 1 -- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f086006ca50 msgr2=0x7f08600d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.555+0000 7f08666e0640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f086006ca50 0x7f08600d1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.555+0000 7f08666e0640 1 -- 172.21.15.38:0/1715642780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08500094d0 con 0x7f086015e740 2023-12-22T08:48:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.555+0000 7f0865edf640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f086006ca50 0x7f08600d1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:48:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.556+0000 7f08666e0640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086015e740 0x7f086013f6b0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f085800c780 tx=0x7f085800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.556+0000 7f08567fc640 1 -- 172.21.15.38:0/1715642780 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858004b60 con 0x7f086015e740 2023-12-22T08:48:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.556+0000 7f08567fc640 1 -- 172.21.15.38:0/1715642780 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085800ce90 con 0x7f086015e740 2023-12-22T08:48:38.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.556+0000 7f08567fc640 1 -- 172.21.15.38:0/1715642780 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085800a850 con 0x7f086015e740 2023-12-22T08:48:38.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.556+0000 7f0868143640 1 -- 172.21.15.38:0/1715642780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08601f6820 con 0x7f086015e740 2023-12-22T08:48:38.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.556+0000 7f0868143640 1 -- 172.21.15.38:0/1715642780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0860140390 con 0x7f086015e740 2023-12-22T08:48:38.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.557+0000 7f0868143640 1 -- 172.21.15.38:0/1715642780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0860061910 con 0x7f086015e740 2023-12-22T08:48:38.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.558+0000 7f08567fc640 1 -- 172.21.15.38:0/1715642780 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f085800a9b0 con 0x7f086015e740 2023-12-22T08:48:38.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.559+0000 7f08567fc640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f084406a430 0x7f084406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:38.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.559+0000 7f08567fc640 1 -- 172.21.15.38:0/1715642780 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f08580887a0 con 0x7f086015e740 2023-12-22T08:48:38.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.560+0000 7f0865edf640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f084406a430 0x7f084406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:38.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.561+0000 7f0865edf640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f084406a430 0x7f084406c8f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f085c00aa30 tx=0x7f085c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:38.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.564+0000 7f08567fc640 1 -- 172.21.15.38:0/1715642780 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0858054080 con 0x7f086015e740 2023-12-22T08:48:38.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.796+0000 7f0868143640 1 -- 172.21.15.38:0/1715642780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f086015b430 con 0x7f086015e740 2023-12-22T08:48:38.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.798+0000 7f08567fc640 1 -- 172.21.15.38:0/1715642780 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f08580576a0 con 0x7f086015e740 2023-12-22T08:48:38.799 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:38.799 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/3891984223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3891984223},{"type":"v1","addr":"172.21.15.38:6834","nonce":3891984223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1561904072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1561904072},{"type":"v1","addr":"172.21.15.89:6836","nonce":1561904072}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4192516230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4192516230},{"type":"v1","addr":"172.21.15.89:6837","nonce":4192516230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8058,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/3881358548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3881358548},{"type":"v1","addr":"172.21.15.38:6835","nonce":3881358548}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[]} 2023-12-22T08:48:38.799 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 64 2023-12-22T08:48:38.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.800+0000 7f0868143640 1 -- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f084406a430 msgr2=0x7f084406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:38.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.800+0000 7f0868143640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f084406a430 0x7f084406c8f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f085c00aa30 tx=0x7f085c008040 comp rx=0 tx=0).stop 2023-12-22T08:48:38.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.800+0000 7f0868143640 1 -- 172.21.15.38:0/1715642780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086015e740 msgr2=0x7f086013f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:38.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.800+0000 7f0868143640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086015e740 0x7f086013f6b0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f085800c780 tx=0x7f085800cc40 comp rx=0 tx=0).stop 2023-12-22T08:48:38.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.801+0000 7f0868143640 1 -- 172.21.15.38:0/1715642780 shutdown_connections 2023-12-22T08:48:38.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.801+0000 7f0868143640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f084406a430 0x7f084406c8f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:38.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.801+0000 7f0868143640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f086015e740 0x7f086013f6b0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:38.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.801+0000 7f0868143640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f08600b3dc0 0x7f0860154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:38.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.801+0000 7f0868143640 1 --2- 172.21.15.38:0/1715642780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f086006ca50 0x7f08600d1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:38.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.801+0000 7f0868143640 1 -- 172.21.15.38:0/1715642780 >> 172.21.15.38:0/1715642780 conn(0x7f08600cfea0 msgr2=0x7f08600d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:38.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.801+0000 7f0868143640 1 -- 172.21.15.38:0/1715642780 shutdown_connections 2023-12-22T08:48:38.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:38.801+0000 7f0868143640 1 -- 172.21.15.38:0/1715642780 wait complete. 2023-12-22T08:48:38.823 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T08:48:38.823 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T08:48:38.823 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T08:48:38.823 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:48:38.823 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T08:48:38.823 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T08:48:38.823 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T08:48:38.824 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:48:38.824 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T08:48:38.824 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T08:48:38.824 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T08:48:38.824 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:48:38.824 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T08:48:38.824 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T08:48:38.824 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T08:48:38.825 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:48:38.841 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T08:48:38.841 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T08:48:38.843 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T08:48:38.843 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T08:48:38.848 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T08:48:38.848 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T08:48:38.851 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T08:48:38.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T08:48:38.890 INFO:tasks.ceph.mds.a:Started 2023-12-22T08:48:38.891 DEBUG:teuthology.parallel:result is None 2023-12-22T08:48:38.898 INFO:tasks.ceph.mds.c:Started 2023-12-22T08:48:38.898 DEBUG:teuthology.parallel:result is None 2023-12-22T08:48:38.899 INFO:tasks.ceph.mds.d:Started 2023-12-22T08:48:38.900 DEBUG:teuthology.parallel:result is None 2023-12-22T08:48:38.907 INFO:tasks.ceph.mds.b:Started 2023-12-22T08:48:38.907 DEBUG:teuthology.parallel:result is None 2023-12-22T08:48:38.908 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-22T08:48:39.058 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:48:39.062 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:48:39.066 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-12-22T08:48:39.067 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-22T08:48:39.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.108+0000 7f09eebc4640 1 Processor -- start 2023-12-22T08:48:39.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.108+0000 7f09eebc4640 1 -- start start 2023-12-22T08:48:39.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.109+0000 7f09eebc4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e80b2050 0x7f09e80b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:39.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.109+0000 7f09eebc4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e81450f0 con 0x7f09e8144d10 2023-12-22T08:48:39.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.109+0000 7f09eebc4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e80b29f0 con 0x7f09e8070800 2023-12-22T08:48:39.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.109+0000 7f09eebc4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e80cc840 con 0x7f09e80b2050 2023-12-22T08:48:39.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.109+0000 7f09ec960640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f09e8144d10 0x7f09e80cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57742/0 (socket says 172.21.15.38:57742) 2023-12-22T08:48:39.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.109+0000 7f09ec960640 1 -- 172.21.15.38:0/3937243688 learned_addr learned my addr 172.21.15.38:0/3937243688 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:39.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.110+0000 7f09dffff640 1 --2- 172.21.15.38:0/3937243688 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e80b2050 0x7f09e80b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.110+0000 7f09df7fe640 1 -- 172.21.15.38:0/3937243688 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681419069 0 0) 0x7f09e81450f0 con 0x7f09e8144d10 2023-12-22T08:48:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.110+0000 7f09df7fe640 1 -- 172.21.15.38:0/3937243688 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d0003520 con 0x7f09e8144d10 2023-12-22T08:48:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.110+0000 7f09df7fe640 1 -- 172.21.15.38:0/3937243688 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747301749 0 0) 0x7f09e80b29f0 con 0x7f09e8070800 2023-12-22T08:48:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.110+0000 7f09df7fe640 1 -- 172.21.15.38:0/3937243688 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09e81450f0 con 0x7f09e8070800 2023-12-22T08:48:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.110+0000 7f09dffff640 1 -- 172.21.15.38:0/3937243688 >> v1:172.21.15.89:6789/0 conn(0x7f09e8070800 legacy=0x7f09e8070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.110+0000 7f09dffff640 1 -- 172.21.15.38:0/3937243688 >> v1:172.21.15.38:6789/0 conn(0x7f09e8144d10 legacy=0x7f09e80cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.110+0000 7f09dffff640 1 -- 172.21.15.38:0/3937243688 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e80ce010 con 0x7f09e80b2050 2023-12-22T08:48:39.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.111+0000 7f09dffff640 1 --2- 172.21.15.38:0/3937243688 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e80b2050 0x7f09e80b24b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09d80097d0 tx=0x7f09d802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf90c802f6362b8e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:39.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.112+0000 7f09df7fe640 1 -- 172.21.15.38:0/3937243688 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8030800 con 0x7f09e80b2050 2023-12-22T08:48:39.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.112+0000 7f09df7fe640 1 -- 172.21.15.38:0/3937243688 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d8030960 con 0x7f09e80b2050 2023-12-22T08:48:39.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.112+0000 7f09df7fe640 1 -- 172.21.15.38:0/3937243688 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8030cf0 con 0x7f09e80b2050 2023-12-22T08:48:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.113+0000 7f09eebc4640 1 -- 172.21.15.38:0/3937243688 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e80b2050 msgr2=0x7f09e80b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.113+0000 7f09eebc4640 1 --2- 172.21.15.38:0/3937243688 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e80b2050 0x7f09e80b24b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09d80097d0 tx=0x7f09d802b940 comp rx=0 tx=0).stop 2023-12-22T08:48:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.113+0000 7f09eebc4640 1 -- 172.21.15.38:0/3937243688 shutdown_connections 2023-12-22T08:48:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.113+0000 7f09eebc4640 1 --2- 172.21.15.38:0/3937243688 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e80b2050 0x7f09e80b24b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.113+0000 7f09eebc4640 1 -- 172.21.15.38:0/3937243688 >> 172.21.15.38:0/3937243688 conn(0x7f09e80cf070 msgr2=0x7f09e80cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.113+0000 7f09eebc4640 1 -- 172.21.15.38:0/3937243688 shutdown_connections 2023-12-22T08:48:39.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.113+0000 7f09eebc4640 1 -- 172.21.15.38:0/3937243688 wait complete. 2023-12-22T08:48:39.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.115+0000 7f09eebc4640 1 Processor -- start 2023-12-22T08:48:39.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.115+0000 7f09eebc4640 1 -- start start 2023-12-22T08:48:39.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09eebc4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e8070800 0x7f09e806d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:39.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09eebc4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09e80b2050 0x7f09e8154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:39.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09eebc4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e8144d10 0x7f09e81e6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:39.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09eebc4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e80afe60 con 0x7f09e80b2050 2023-12-22T08:48:39.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09eebc4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e80b0a40 con 0x7f09e8144d10 2023-12-22T08:48:39.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09eebc4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e806de10 con 0x7f09e8070800 2023-12-22T08:48:39.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09dffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09e80b2050 0x7f09e8154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:39.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09dffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09e80b2050 0x7f09e8154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33762/0 (socket says 172.21.15.38:33762) 2023-12-22T08:48:39.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09dffff640 1 -- 172.21.15.38:0/2356908505 learned_addr learned my addr 172.21.15.38:0/2356908505 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:39.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09ec960640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e8070800 0x7f09e806d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:39.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09ed161640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e8144d10 0x7f09e81e6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:39.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09dffff640 1 -- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e8070800 msgr2=0x7f09e806d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:39.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09dffff640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e8070800 0x7f09e806d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:39.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09dffff640 1 -- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e8144d10 msgr2=0x7f09e81e6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:39.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.116+0000 7f09dffff640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e8144d10 0x7f09e81e6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:39.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.117+0000 7f09dffff640 1 -- 172.21.15.38:0/2356908505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d8009400 con 0x7f09e80b2050 2023-12-22T08:48:39.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.117+0000 7f09dffff640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09e80b2050 0x7f09e8154cd0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f09d80098f0 tx=0x7f09d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:39.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.117+0000 7f09dd7fa640 1 -- 172.21.15.38:0/2356908505 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d803e040 con 0x7f09e80b2050 2023-12-22T08:48:39.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.117+0000 7f09dd7fa640 1 -- 172.21.15.38:0/2356908505 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d8039cd0 con 0x7f09e80b2050 2023-12-22T08:48:39.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.117+0000 7f09dd7fa640 1 -- 172.21.15.38:0/2356908505 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8044630 con 0x7f09e80b2050 2023-12-22T08:48:39.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.117+0000 7f09eebc4640 1 -- 172.21.15.38:0/2356908505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e80af810 con 0x7f09e80b2050 2023-12-22T08:48:39.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.117+0000 7f09eebc4640 1 -- 172.21.15.38:0/2356908505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e8155210 con 0x7f09e80b2050 2023-12-22T08:48:39.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.119+0000 7f09eebc4640 1 -- 172.21.15.38:0/2356908505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e8061910 con 0x7f09e80b2050 2023-12-22T08:48:39.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.119+0000 7f09dd7fa640 1 -- 172.21.15.38:0/2356908505 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f09d8044790 con 0x7f09e80b2050 2023-12-22T08:48:39.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.120+0000 7f09dd7fa640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f09d406a430 0x7f09d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:39.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.120+0000 7f09dd7fa640 1 -- 172.21.15.38:0/2356908505 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f09d80aa7d0 con 0x7f09e80b2050 2023-12-22T08:48:39.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.121+0000 7f09ec960640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f09d406a430 0x7f09d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:39.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.121+0000 7f09ec960640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f09d406a430 0x7f09d406c8f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f09e4000f60 tx=0x7f09e4007d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:39.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.125+0000 7f09dd7fa640 1 -- 172.21.15.38:0/2356908505 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f09d80760e0 con 0x7f09e80b2050 2023-12-22T08:48:39.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:39.328+0000 7f09eebc4640 1 -- 172.21.15.38:0/2356908505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f09e80cb8e0 con 0x7f09e80b2050 2023-12-22T08:48:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.107+0000 7f09dd7fa640 1 -- 172.21.15.38:0/2356908505 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v154) v1 ==== 97+0+0 (secure 0 0 0) 0x7f09d8049080 con 0x7f09e80b2050 2023-12-22T08:48:40.109 INFO:teuthology.orchestra.run.smithi038.stderr: removed all blocklist entries 2023-12-22T08:48:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.111+0000 7f09eebc4640 1 -- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f09d406a430 msgr2=0x7f09d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.111+0000 7f09eebc4640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f09d406a430 0x7f09d406c8f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f09e4000f60 tx=0x7f09e4007d70 comp rx=0 tx=0).stop 2023-12-22T08:48:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.111+0000 7f09eebc4640 1 -- 172.21.15.38:0/2356908505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09e80b2050 msgr2=0x7f09e8154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.111+0000 7f09eebc4640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09e80b2050 0x7f09e8154cd0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f09d80098f0 tx=0x7f09d8004730 comp rx=0 tx=0).stop 2023-12-22T08:48:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.111+0000 7f09eebc4640 1 -- 172.21.15.38:0/2356908505 shutdown_connections 2023-12-22T08:48:40.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.111+0000 7f09eebc4640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09e8144d10 0x7f09e81e6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.111+0000 7f09eebc4640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f09d406a430 0x7f09d406c8f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.111+0000 7f09eebc4640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09e80b2050 0x7f09e8154cd0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.111+0000 7f09eebc4640 1 --2- 172.21.15.38:0/2356908505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09e8070800 0x7f09e806d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.111+0000 7f09eebc4640 1 -- 172.21.15.38:0/2356908505 >> 172.21.15.38:0/2356908505 conn(0x7f09e80cf070 msgr2=0x7f09e8141940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:40.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.111+0000 7f09eebc4640 1 -- 172.21.15.38:0/2356908505 shutdown_connections 2023-12-22T08:48:40.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.111+0000 7f09eebc4640 1 -- 172.21.15.38:0/2356908505 wait complete. 2023-12-22T08:48:40.132 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T08:48:40.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.354+0000 7f340b131640 1 Processor -- start 2023-12-22T08:48:40.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.354+0000 7f340b131640 1 -- start start 2023-12-22T08:48:40.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.355+0000 7f340b131640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f340415e740 0x7f340415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:40.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.355+0000 7f340b131640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f340406ca50 0x7f34040b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:40.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.355+0000 7f340b131640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34040b4210 con 0x7f34040b3dc0 2023-12-22T08:48:40.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.355+0000 7f340b131640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340406e650 con 0x7f340415e740 2023-12-22T08:48:40.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.355+0000 7f340b131640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340415eb20 con 0x7f340406ca50 2023-12-22T08:48:40.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.356+0000 7f34096ce640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f34040b3dc0 0x7f3404161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:48432/0 (socket says 172.21.15.38:48432) 2023-12-22T08:48:40.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.356+0000 7f34096ce640 1 -- 172.21.15.38:0/2665471430 learned_addr learned my addr 172.21.15.38:0/2665471430 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:40.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.356+0000 7f3408ecd640 1 --2- 172.21.15.38:0/2665471430 >> v2:172.21.15.38:3300/0 conn(0x7f340415e740 0x7f340415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:40.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.356+0000 7f33fbfff640 1 --2- 172.21.15.38:0/2665471430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f340406ca50 0x7f34040b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:40.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.357+0000 7f3408ecd640 1 -- 172.21.15.38:0/2665471430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f340406ca50 msgr2=0x7f34040b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:40.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.357+0000 7f3408ecd640 1 --2- 172.21.15.38:0/2665471430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f340406ca50 0x7f34040b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.357+0000 7f3408ecd640 1 -- 172.21.15.38:0/2665471430 >> v1:172.21.15.89:6789/0 conn(0x7f34040b3dc0 legacy=0x7f3404161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:40.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.357+0000 7f3408ecd640 1 -- 172.21.15.38:0/2665471430 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3404070770 con 0x7f340415e740 2023-12-22T08:48:40.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.357+0000 7f33fb7fe640 1 -- 172.21.15.38:0/2665471430 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706418855 0 0) 0x7f33fc001110 con 0x7f34040b3dc0 2023-12-22T08:48:40.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.358+0000 7f3408ecd640 1 --2- 172.21.15.38:0/2665471430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f340415e740 0x7f340415db30 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f3400009d90 tx=0x7f340002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbcad451138187a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:40.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.359+0000 7f33fb7fe640 1 -- 172.21.15.38:0/2665471430 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340002cb30 con 0x7f340415e740 2023-12-22T08:48:40.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.359+0000 7f33fb7fe640 1 -- 172.21.15.38:0/2665471430 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340002cc90 con 0x7f340415e740 2023-12-22T08:48:40.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.359+0000 7f33fb7fe640 1 -- 172.21.15.38:0/2665471430 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400034440 con 0x7f340415e740 2023-12-22T08:48:40.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.359+0000 7f340b131640 1 -- 172.21.15.38:0/2665471430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f340415e740 msgr2=0x7f340415db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:40.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.359+0000 7f340b131640 1 --2- 172.21.15.38:0/2665471430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f340415e740 0x7f340415db30 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f3400009d90 tx=0x7f340002bd80 comp rx=0 tx=0).stop 2023-12-22T08:48:40.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.360+0000 7f340b131640 1 -- 172.21.15.38:0/2665471430 shutdown_connections 2023-12-22T08:48:40.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.360+0000 7f340b131640 1 --2- 172.21.15.38:0/2665471430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f340406ca50 0x7f34040b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.360+0000 7f340b131640 1 --2- 172.21.15.38:0/2665471430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f340415e740 0x7f340415db30 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.360+0000 7f340b131640 1 -- 172.21.15.38:0/2665471430 >> 172.21.15.38:0/2665471430 conn(0x7f34040cfea0 msgr2=0x7f34040d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:40.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.360+0000 7f340b131640 1 -- 172.21.15.38:0/2665471430 shutdown_connections 2023-12-22T08:48:40.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.360+0000 7f340b131640 1 -- 172.21.15.38:0/2665471430 wait complete. 2023-12-22T08:48:40.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.361+0000 7f340b131640 1 Processor -- start 2023-12-22T08:48:40.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.362+0000 7f340b131640 1 -- start start 2023-12-22T08:48:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.362+0000 7f340b131640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f340406ca50 0x7f34041f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.362+0000 7f340b131640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34040b3dc0 0x7f34041402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.362+0000 7f340b131640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f340415e740 0x7f3404154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.362+0000 7f340b131640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34041559a0 con 0x7f340406ca50 2023-12-22T08:48:40.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.362+0000 7f340b131640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340415bab0 con 0x7f34040b3dc0 2023-12-22T08:48:40.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.362+0000 7f340b131640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34041f6c70 con 0x7f340415e740 2023-12-22T08:48:40.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.363+0000 7f3408ecd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f340406ca50 0x7f34041f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:40.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.363+0000 7f3408ecd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f340406ca50 0x7f34041f6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33776/0 (socket says 172.21.15.38:33776) 2023-12-22T08:48:40.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.363+0000 7f3408ecd640 1 -- 172.21.15.38:0/2862007556 learned_addr learned my addr 172.21.15.38:0/2862007556 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:40.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.363+0000 7f34096ce640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f340415e740 0x7f3404154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:40.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.363+0000 7f33fbfff640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34040b3dc0 0x7f34041402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:40.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.363+0000 7f3408ecd640 1 -- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f340415e740 msgr2=0x7f3404154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:40.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.363+0000 7f3408ecd640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f340415e740 0x7f3404154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.363+0000 7f3408ecd640 1 -- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34040b3dc0 msgr2=0x7f34041402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:40.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.363+0000 7f3408ecd640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34040b3dc0 0x7f34041402c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.363+0000 7f3408ecd640 1 -- 172.21.15.38:0/2862007556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3400009a70 con 0x7f340406ca50 2023-12-22T08:48:40.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.363+0000 7f3408ecd640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f340406ca50 0x7f34041f6690 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f3400009d90 tx=0x7f3400004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:40.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.364+0000 7f33f97fa640 1 -- 172.21.15.38:0/2862007556 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340003e410 con 0x7f340406ca50 2023-12-22T08:48:40.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.364+0000 7f33f97fa640 1 -- 172.21.15.38:0/2862007556 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340003e590 con 0x7f340406ca50 2023-12-22T08:48:40.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.364+0000 7f340b131640 1 -- 172.21.15.38:0/2862007556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34041f6f50 con 0x7f340406ca50 2023-12-22T08:48:40.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.364+0000 7f33f97fa640 1 -- 172.21.15.38:0/2862007556 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340003e940 con 0x7f340406ca50 2023-12-22T08:48:40.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.364+0000 7f340b131640 1 -- 172.21.15.38:0/2862007556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3404140800 con 0x7f340406ca50 2023-12-22T08:48:40.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.365+0000 7f340b131640 1 -- 172.21.15.38:0/2862007556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3404061910 con 0x7f340406ca50 2023-12-22T08:48:40.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.366+0000 7f33f97fa640 1 -- 172.21.15.38:0/2862007556 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f340003b050 con 0x7f340406ca50 2023-12-22T08:48:40.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.367+0000 7f33f97fa640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f33f006a430 0x7f33f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:40.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.367+0000 7f33f97fa640 1 -- 172.21.15.38:0/2862007556 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f34000aa6a0 con 0x7f340406ca50 2023-12-22T08:48:40.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.368+0000 7f33fbfff640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f33f006a430 0x7f33f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:40.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.369+0000 7f33fbfff640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f33f006a430 0x7f33f006c8f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f34041f65f0 tx=0x7f33f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:40.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.371+0000 7f33f97fa640 1 -- 172.21.15.38:0/2862007556 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3400075fd0 con 0x7f340406ca50 2023-12-22T08:48:40.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.629+0000 7f340b131640 1 -- 172.21.15.38:0/2862007556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f340415b450 con 0x7f340406ca50 2023-12-22T08:48:40.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.630+0000 7f33f97fa640 1 -- 172.21.15.38:0/2862007556 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f34000795f0 con 0x7f340406ca50 2023-12-22T08:48:40.631 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:40.631 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:48:40.631 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_dump": [ 2023-12-22T08:48:40.631 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.a", 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl57dkCBAAeliJIPc49iRBk2mp8WYv8A==", 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.b", 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl0C0+KhAAkCsjfyn19nOz1xTyhZkbPQ==", 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.632 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.c", 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl7poXGhAA+ZSohyj4dAOs6B5dZKTLAg==", 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.633 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.634 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.634 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.d", 2023-12-22T08:48:40.634 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4VlTBuoOhAArKX4AiOQRGawIyAnInIhCg==", 2023-12-22T08:48:40.634 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.634 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:48:40.634 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:48:40.634 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:48:40.634 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.634 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.634 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.635 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.0", 2023-12-22T08:48:40.635 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VlnVQaChAAxfWmPqwo5D4qBYkAP/6dHQ==", 2023-12-22T08:48:40.635 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.636 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:48:40.636 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:48:40.636 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.636 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.636 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.636 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.636 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.1", 2023-12-22T08:48:40.636 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4Vll2dlGxAAbqx4rxnz4FWIKl9OGqcwtw==", 2023-12-22T08:48:40.636 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.2", 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VljQ3HLRAAfyrtqD4n6Da8Rl/6UKmv7g==", 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.3", 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBCS4VlOat4AxAAIkAGRvGGWrrwx/ppMbexWQ==", 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.4", 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlwg7TDxAA+L504F+Hw/6FTJ63cV3ZXg==", 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.638 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:48:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:48:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.5", 2023-12-22T08:48:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx8zgHxAALBDm/sSYqw/fn4nLNQbu4A==", 2023-12-22T08:48:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:48:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:48:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.639 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.6", 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx5OdLxAAaMP09nYI3HKiuhPARgnCOw==", 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.7", 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBHS4Vl/15bBBAA4maatkcgA0axcZY/L9r/IA==", 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.640 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:48:40.641 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:48:40.641 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.641 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.641 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.641 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.641 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.0", 2023-12-22T08:48:40.641 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlgDspDhAA0TWGbk4AbuOhCNotPej29A==", 2023-12-22T08:48:40.641 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.641 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:48:40.641 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow r", 2023-12-22T08:48:40.641 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-22T08:48:40.641 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.1", 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlwSk/JhAAM3faae43p4/gw9BmyxLpJA==", 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.2", 2023-12-22T08:48:40.642 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VliOHMGhAARaM8FC/0maNMToLGhBR4Tg==", 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.3", 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlV/MVMRAAyN1643IAOTLOLuz4DqMZ8A==", 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:48:40.643 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:48:40.644 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:48:40.644 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.644 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.644 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.644 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.admin", 2023-12-22T08:48:40.644 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA2S4VlBhogNhAACBsSGP7kmhCSn+XAKkvgKQ==", 2023-12-22T08:48:40.644 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.644 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:48:40.644 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:48:40.644 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:48:40.644 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.644 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.645 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.645 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.x", 2023-12-22T08:48:40.645 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlTHG+NhAAUNkVtrDuoK2OEsy1HHkt2A==", 2023-12-22T08:48:40.645 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.645 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:48:40.645 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:48:40.645 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.645 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:48:40.645 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:40.645 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.y", 2023-12-22T08:48:40.645 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlED5ALBAAComDf9woKBt/IXcez+Udmg==", 2023-12-22T08:48:40.646 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:48:40.646 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:48:40.646 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:48:40.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:48:40.646 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.646 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:40.646 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:48:40.646 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:48:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.632+0000 7f340b131640 1 -- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f33f006a430 msgr2=0x7f33f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.632+0000 7f340b131640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f33f006a430 0x7f33f006c8f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f34041f65f0 tx=0x7f33f4008040 comp rx=0 tx=0).stop 2023-12-22T08:48:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.632+0000 7f340b131640 1 -- 172.21.15.38:0/2862007556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f340406ca50 msgr2=0x7f34041f6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.632+0000 7f340b131640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f340406ca50 0x7f34041f6690 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f3400009d90 tx=0x7f3400004a40 comp rx=0 tx=0).stop 2023-12-22T08:48:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.633+0000 7f340b131640 1 -- 172.21.15.38:0/2862007556 shutdown_connections 2023-12-22T08:48:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.633+0000 7f340b131640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f340415e740 0x7f3404154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.633+0000 7f340b131640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34040b3dc0 0x7f34041402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.633+0000 7f340b131640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f33f006a430 0x7f33f006c8f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.633+0000 7f340b131640 1 --2- 172.21.15.38:0/2862007556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f340406ca50 0x7f34041f6690 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.633+0000 7f340b131640 1 -- 172.21.15.38:0/2862007556 >> 172.21.15.38:0/2862007556 conn(0x7f34040cfea0 msgr2=0x7f3404070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.633+0000 7f340b131640 1 -- 172.21.15.38:0/2862007556 shutdown_connections 2023-12-22T08:48:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.633+0000 7f340b131640 1 -- 172.21.15.38:0/2862007556 wait complete. 2023-12-22T08:48:40.651 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:48:40.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.874+0000 7fcb7bf63640 1 Processor -- start 2023-12-22T08:48:40.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.874+0000 7fcb7bf63640 1 -- start start 2023-12-22T08:48:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.876+0000 7fcb7bf63640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb740b24b0 0x7fcb74070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.876+0000 7fcb7bf63640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb741450f0 con 0x7fcb74144d10 2023-12-22T08:48:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.876+0000 7fcb7bf63640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb740cc840 con 0x7fcb740b2050 2023-12-22T08:48:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.876+0000 7fcb7bf63640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb740ce010 con 0x7fcb740b24b0 2023-12-22T08:48:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.876+0000 7fcb79cff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcb74144d10 0x7fcb740cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57752/0 (socket says 172.21.15.38:57752) 2023-12-22T08:48:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.876+0000 7fcb79cff640 1 -- 172.21.15.38:0/1408837315 learned_addr learned my addr 172.21.15.38:0/1408837315 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.876+0000 7fcb7a500640 1 --2- 172.21.15.38:0/1408837315 >> v2:172.21.15.38:3300/0 conn(0x7fcb740b24b0 0x7fcb74070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:40.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.876+0000 7fcb78cfd640 1 -- 172.21.15.38:0/1408837315 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318870992 0 0) 0x7fcb741450f0 con 0x7fcb74144d10 2023-12-22T08:48:40.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.876+0000 7fcb78cfd640 1 -- 172.21.15.38:0/1408837315 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb60003520 con 0x7fcb74144d10 2023-12-22T08:48:40.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.877+0000 7fcb7a500640 1 -- 172.21.15.38:0/1408837315 >> v1:172.21.15.89:6789/0 conn(0x7fcb740b2050 legacy=0x7fcb74070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:40.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.877+0000 7fcb7a500640 1 -- 172.21.15.38:0/1408837315 >> v1:172.21.15.38:6789/0 conn(0x7fcb74144d10 legacy=0x7fcb740cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:40.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.877+0000 7fcb7a500640 1 -- 172.21.15.38:0/1408837315 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb740ce2f0 con 0x7fcb740b24b0 2023-12-22T08:48:40.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.878+0000 7fcb7a500640 1 --2- 172.21.15.38:0/1408837315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb740b24b0 0x7fcb74070f10 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0097a0 tx=0x7fcb6c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78925e33c0859af4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:40.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.878+0000 7fcb78cfd640 1 -- 172.21.15.38:0/1408837315 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c030610 con 0x7fcb740b24b0 2023-12-22T08:48:40.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.878+0000 7fcb78cfd640 1 -- 172.21.15.38:0/1408837315 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c030770 con 0x7fcb740b24b0 2023-12-22T08:48:40.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.878+0000 7fcb78cfd640 1 -- 172.21.15.38:0/1408837315 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c030ae0 con 0x7fcb740b24b0 2023-12-22T08:48:40.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.878+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1408837315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb740b24b0 msgr2=0x7fcb74070f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:40.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.878+0000 7fcb7bf63640 1 --2- 172.21.15.38:0/1408837315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb740b24b0 0x7fcb74070f10 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0097a0 tx=0x7fcb6c02b960 comp rx=0 tx=0).stop 2023-12-22T08:48:40.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.879+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1408837315 shutdown_connections 2023-12-22T08:48:40.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.879+0000 7fcb7bf63640 1 --2- 172.21.15.38:0/1408837315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb740b24b0 0x7fcb74070f10 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.879+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1408837315 >> 172.21.15.38:0/1408837315 conn(0x7fcb740cf070 msgr2=0x7fcb740cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:40.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.879+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1408837315 shutdown_connections 2023-12-22T08:48:40.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.879+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1408837315 wait complete. 2023-12-22T08:48:40.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.880+0000 7fcb7bf63640 1 Processor -- start 2023-12-22T08:48:40.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.881+0000 7fcb7bf63640 1 -- start start 2023-12-22T08:48:40.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.881+0000 7fcb7bf63640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb740b2050 0x7fcb74158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:40.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.881+0000 7fcb7bf63640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb740b24b0 0x7fcb74140660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb7bf63640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb74144d10 0x7fcb74143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb7bf63640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb741424a0 con 0x7fcb74144d10 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb7bf63640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb74142740 con 0x7fcb740b2050 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb7bf63640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb74142a20 con 0x7fcb740b24b0 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb7a500640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb74144d10 0x7fcb74143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb7a500640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb74144d10 0x7fcb74143500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33784/0 (socket says 172.21.15.38:33784) 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb7a500640 1 -- 172.21.15.38:0/1165941700 learned_addr learned my addr 172.21.15.38:0/1165941700 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb79cff640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb740b2050 0x7fcb74158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb794fe640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb740b24b0 0x7fcb74140660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb7a500640 1 -- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb740b24b0 msgr2=0x7fcb74140660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb7a500640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb740b24b0 0x7fcb74140660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb7a500640 1 -- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb740b2050 msgr2=0x7fcb74158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb7a500640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb740b2050 0x7fcb74158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb7a500640 1 -- 172.21.15.38:0/1165941700 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c009400 con 0x7fcb74144d10 2023-12-22T08:48:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.882+0000 7fcb794fe640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb740b24b0 0x7fcb74140660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.883+0000 7fcb7a500640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb74144d10 0x7fcb74143500 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0097a0 tx=0x7fcb6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:40.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.883+0000 7fcb6a7fc640 1 -- 172.21.15.38:0/1165941700 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c039c10 con 0x7fcb74144d10 2023-12-22T08:48:40.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.883+0000 7fcb6a7fc640 1 -- 172.21.15.38:0/1165941700 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c03f040 con 0x7fcb74144d10 2023-12-22T08:48:40.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.883+0000 7fcb6a7fc640 1 -- 172.21.15.38:0/1165941700 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c006e10 con 0x7fcb74144d10 2023-12-22T08:48:40.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.883+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1165941700 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb74142d00 con 0x7fcb74144d10 2023-12-22T08:48:40.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.883+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1165941700 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb74140ba0 con 0x7fcb74144d10 2023-12-22T08:48:40.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.884+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1165941700 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb741431c0 con 0x7fcb74144d10 2023-12-22T08:48:40.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.885+0000 7fcb6a7fc640 1 -- 172.21.15.38:0/1165941700 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcb6c004030 con 0x7fcb74144d10 2023-12-22T08:48:40.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.886+0000 7fcb6a7fc640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb5806a430 0x7fcb5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:40.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.886+0000 7fcb6a7fc640 1 -- 172.21.15.38:0/1165941700 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcb6c0aa450 con 0x7fcb74144d10 2023-12-22T08:48:40.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.887+0000 7fcb79cff640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb5806a430 0x7fcb5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:40.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.888+0000 7fcb79cff640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb5806a430 0x7fcb5806c8f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcb70001560 tx=0x7fcb70009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:40.890+0000 7fcb6a7fc640 1 -- 172.21.15.38:0/1165941700 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcb6c075da0 con 0x7fcb74144d10 2023-12-22T08:48:41.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.082+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1165941700 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb74061910 con 0x7fcb74144d10 2023-12-22T08:48:41.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.084+0000 7fcb6a7fc640 1 -- 172.21.15.38:0/1165941700 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+12352 (secure 0 0 0) 0x7fcb6c0793c0 con 0x7fcb74144d10 2023-12-22T08:48:41.085 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:41.085 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":154,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:48:40.098246+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:48:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.086+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb5806a430 msgr2=0x7fcb5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.086+0000 7fcb7bf63640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb5806a430 0x7fcb5806c8f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcb70001560 tx=0x7fcb70009040 comp rx=0 tx=0).stop 2023-12-22T08:48:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.086+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1165941700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb74144d10 msgr2=0x7fcb74143500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.086+0000 7fcb7bf63640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb74144d10 0x7fcb74143500 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0097a0 tx=0x7fcb6c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.086+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1165941700 shutdown_connections 2023-12-22T08:48:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.086+0000 7fcb7bf63640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb5806a430 0x7fcb5806c8f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.086+0000 7fcb7bf63640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb74144d10 0x7fcb74143500 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.086+0000 7fcb7bf63640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb740b24b0 0x7fcb74140660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.086+0000 7fcb7bf63640 1 --2- 172.21.15.38:0/1165941700 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb740b2050 0x7fcb74158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.086+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1165941700 >> 172.21.15.38:0/1165941700 conn(0x7fcb740cf070 msgr2=0x7fcb74070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:41.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.087+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1165941700 shutdown_connections 2023-12-22T08:48:41.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.087+0000 7fcb7bf63640 1 -- 172.21.15.38:0/1165941700 wait complete. 2023-12-22T08:48:41.105 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:48:41.105 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:48:41.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.328+0000 7f82923b9640 1 Processor -- start 2023-12-22T08:48:41.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.328+0000 7f82923b9640 1 -- start start 2023-12-22T08:48:41.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.330+0000 7f82923b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f828c15ec50 0x7f828c0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.330+0000 7f82923b9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f828c070e80 0x7f828c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.330+0000 7f82923b9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c0ce4b0 con 0x7f828c15e870 2023-12-22T08:48:41.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.330+0000 7f82923b9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c15fea0 con 0x7f828c070e80 2023-12-22T08:48:41.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.330+0000 7f82923b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0cdb80 con 0x7f828c15ec50 2023-12-22T08:48:41.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.330+0000 7f828bfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f828c15e870 0x7f828c070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45808/0 (socket says 172.21.15.38:45808) 2023-12-22T08:48:41.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.330+0000 7f828bfff640 1 -- 172.21.15.38:0/1212832598 learned_addr learned my addr 172.21.15.38:0/1212832598 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:41.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f8290956640 1 --2- 172.21.15.38:0/1212832598 >> v2:172.21.15.89:3300/0 conn(0x7f828c070e80 0x7f828c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828b7fe640 1 --2- 172.21.15.38:0/1212832598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f828c15ec50 0x7f828c0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403532099 0 0) 0x7f828c0ce4b0 con 0x7f828c15e870 2023-12-22T08:48:41.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8274003520 con 0x7f828c15e870 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2790973717 0 0) 0x7f8274003520 con 0x7f828c15e870 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f828c15ec50 msgr2=0x7f828c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 --2- 172.21.15.38:0/1212832598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f828c15ec50 0x7f828c0ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 >> v2:172.21.15.89:3300/0 conn(0x7f828c070e80 msgr2=0x7f828c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 --2- 172.21.15.38:0/1212832598 >> v2:172.21.15.89:3300/0 conn(0x7f828c070e80 0x7f828c06f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c0cde60 con 0x7f828c15e870 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f827c001670 con 0x7f828c15e870 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 >> v1:172.21.15.38:6789/0 conn(0x7f828c15e870 legacy=0x7f828c070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 --2- 172.21.15.38:0/1212832598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274003970 0x7f8274003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 --2- 172.21.15.38:0/1212832598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f828c15ec50 0x7f82740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 --2- 172.21.15.38:0/1212832598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8274004d00 0x7f8274005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c15fea0 con 0x7f8274003970 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0cdb80 con 0x7f8274004d00 2023-12-22T08:48:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.331+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827400b980 con 0x7f828c15ec50 2023-12-22T08:48:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.332+0000 7f828bfff640 1 --2- 172.21.15.38:0/1212832598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274003970 0x7f8274003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.332+0000 7f8290956640 1 --2- 172.21.15.38:0/1212832598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8274004d00 0x7f8274005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.332+0000 7f828b7fe640 1 --2- 172.21.15.38:0/1212832598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f828c15ec50 0x7f82740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.332+0000 7f828bfff640 1 -- 172.21.15.38:0/1212832598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f828c15ec50 msgr2=0x7f82740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.332+0000 7f828bfff640 1 --2- 172.21.15.38:0/1212832598 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f828c15ec50 0x7f82740047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.332+0000 7f828bfff640 1 -- 172.21.15.38:0/1212832598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8274004d00 msgr2=0x7f8274005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.332+0000 7f828bfff640 1 --2- 172.21.15.38:0/1212832598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8274004d00 0x7f8274005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.332+0000 7f828bfff640 1 -- 172.21.15.38:0/1212832598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8274003520 con 0x7f8274003970 2023-12-22T08:48:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.333+0000 7f828bfff640 1 --2- 172.21.15.38:0/1212832598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274003970 0x7f8274003d90 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f827c00c210 tx=0x7f82740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47527cc853b3b991 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.333+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c02cb00 con 0x7f8274003970 2023-12-22T08:48:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.333+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c02cc80 con 0x7f8274003970 2023-12-22T08:48:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.334+0000 7f828affd640 1 -- 172.21.15.38:0/1212832598 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0058d0 con 0x7f8274003970 2023-12-22T08:48:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.334+0000 7f82923b9640 1 -- 172.21.15.38:0/1212832598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274003970 msgr2=0x7f8274003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.334+0000 7f82923b9640 1 --2- 172.21.15.38:0/1212832598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274003970 0x7f8274003d90 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f827c00c210 tx=0x7f82740057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.334+0000 7f8290956640 1 -- 172.21.15.38:0/1212832598 reap_dead start 2023-12-22T08:48:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.334+0000 7f82923b9640 1 -- 172.21.15.38:0/1212832598 shutdown_connections 2023-12-22T08:48:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.334+0000 7f82923b9640 1 -- 172.21.15.38:0/1212832598 >> 172.21.15.38:0/1212832598 conn(0x7f828c0b20c0 msgr2=0x7f828c0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.334+0000 7f82923b9640 1 -- 172.21.15.38:0/1212832598 shutdown_connections 2023-12-22T08:48:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.334+0000 7f82923b9640 1 -- 172.21.15.38:0/1212832598 wait complete. 2023-12-22T08:48:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.336+0000 7f82923b9640 1 Processor -- start 2023-12-22T08:48:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.336+0000 7f82923b9640 1 -- start start 2023-12-22T08:48:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.337+0000 7f82923b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8274003970 0x7f828c15b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.337+0000 7f82923b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828c146f60 0x7f828c0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.337+0000 7f82923b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f828c071830 0x7f828c1f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.337+0000 7f82923b9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c071cb0 con 0x7f828c146f60 2023-12-22T08:48:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.337+0000 7f82923b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1f7130 con 0x7f828c071830 2023-12-22T08:48:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.337+0000 7f82923b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c146480 con 0x7f8274003970 2023-12-22T08:48:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.337+0000 7f828b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828c146f60 0x7f828c0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.337+0000 7f828b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828c146f60 0x7f828c0712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34794/0 (socket says 172.21.15.38:34794) 2023-12-22T08:48:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.337+0000 7f828b7fe640 1 -- 172.21.15.38:0/2533990578 learned_addr learned my addr 172.21.15.38:0/2533990578 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.338+0000 7f828bfff640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8274003970 0x7f828c15b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.338+0000 7f8290956640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f828c071830 0x7f828c1f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.338+0000 7f828b7fe640 1 -- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8274003970 msgr2=0x7f828c15b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.338+0000 7f828b7fe640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8274003970 0x7f828c15b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.338+0000 7f828b7fe640 1 -- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f828c071830 msgr2=0x7f828c1f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.338+0000 7f828b7fe640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f828c071830 0x7f828c1f6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.338+0000 7f828b7fe640 1 -- 172.21.15.38:0/2533990578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c146760 con 0x7f828c146f60 2023-12-22T08:48:41.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.338+0000 7f828b7fe640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828c146f60 0x7f828c0712f0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f8280010890 tx=0x7f8280010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:41.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.338+0000 7f8288ff9640 1 -- 172.21.15.38:0/2533990578 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82800095b0 con 0x7f828c146f60 2023-12-22T08:48:41.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.338+0000 7f8288ff9640 1 -- 172.21.15.38:0/2533990578 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828000eb80 con 0x7f828c146f60 2023-12-22T08:48:41.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.338+0000 7f82923b9640 1 -- 172.21.15.38:0/2533990578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c146a40 con 0x7f828c146f60 2023-12-22T08:48:41.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.339+0000 7f8288ff9640 1 -- 172.21.15.38:0/2533990578 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828001c400 con 0x7f828c146f60 2023-12-22T08:48:41.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.339+0000 7f82923b9640 1 -- 172.21.15.38:0/2533990578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c1f6940 con 0x7f828c146f60 2023-12-22T08:48:41.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.340+0000 7f82923b9640 1 -- 172.21.15.38:0/2533990578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c061910 con 0x7f828c146f60 2023-12-22T08:48:41.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.341+0000 7f8288ff9640 1 -- 172.21.15.38:0/2533990578 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f82800253f0 con 0x7f828c146f60 2023-12-22T08:48:41.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.342+0000 7f8288ff9640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f827806a430 0x7f827806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.342+0000 7f8288ff9640 1 -- 172.21.15.38:0/2533990578 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8280088bf0 con 0x7f828c146f60 2023-12-22T08:48:41.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.342+0000 7f828bfff640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f827806a430 0x7f827806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.343+0000 7f828bfff640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f827806a430 0x7f827806c8f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f827c034000 tx=0x7f827c007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:41.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.346+0000 7f8288ff9640 1 -- 172.21.15.38:0/2533990578 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8280054490 con 0x7f828c146f60 2023-12-22T08:48:41.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.540+0000 7f82923b9640 1 -- 172.21.15.38:0/2533990578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f828c0b2ce0 con 0x7f828c146f60 2023-12-22T08:48:41.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.541+0000 7f8288ff9640 1 -- 172.21.15.38:0/2533990578 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v154) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8280057ab0 con 0x7f828c146f60 2023-12-22T08:48:41.542 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:48:41.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.545+0000 7f82923b9640 1 -- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f827806a430 msgr2=0x7f827806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.545+0000 7f82923b9640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f827806a430 0x7f827806c8f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f827c034000 tx=0x7f827c007000 comp rx=0 tx=0).stop 2023-12-22T08:48:41.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.545+0000 7f82923b9640 1 -- 172.21.15.38:0/2533990578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828c146f60 msgr2=0x7f828c0712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.545+0000 7f82923b9640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828c146f60 0x7f828c0712f0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f8280010890 tx=0x7f8280010d50 comp rx=0 tx=0).stop 2023-12-22T08:48:41.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.545+0000 7f82923b9640 1 -- 172.21.15.38:0/2533990578 shutdown_connections 2023-12-22T08:48:41.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.545+0000 7f82923b9640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f828c071830 0x7f828c1f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.545+0000 7f82923b9640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f827806a430 0x7f827806c8f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.545+0000 7f82923b9640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f828c146f60 0x7f828c0712f0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.545+0000 7f82923b9640 1 --2- 172.21.15.38:0/2533990578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8274003970 0x7f828c15b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.545+0000 7f82923b9640 1 -- 172.21.15.38:0/2533990578 >> 172.21.15.38:0/2533990578 conn(0x7f828c0b20c0 msgr2=0x7f828c0adda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:41.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.545+0000 7f82923b9640 1 -- 172.21.15.38:0/2533990578 shutdown_connections 2023-12-22T08:48:41.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.546+0000 7f82923b9640 1 -- 172.21.15.38:0/2533990578 wait complete. 2023-12-22T08:48:41.565 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T08:48:41.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.773+0000 7fa48f59e640 1 Processor -- start 2023-12-22T08:48:41.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.774+0000 7fa48f59e640 1 -- start start 2023-12-22T08:48:41.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.775+0000 7fa48f59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa49015b0e0 0x7fa49015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.775+0000 7fa48f59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49015edf0 con 0x7fa49009c980 2023-12-22T08:48:41.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.775+0000 7fa48f59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49015bd90 con 0x7fa490071460 2023-12-22T08:48:41.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.775+0000 7fa48f59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49015d0d0 con 0x7fa49015b0e0 2023-12-22T08:48:41.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.775+0000 7fa48e59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa49015b0e0 0x7fa49015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.775+0000 7fa48e59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa49015b0e0 0x7fa49015b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34804/0 (socket says 172.21.15.38:34804) 2023-12-22T08:48:41.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.775+0000 7fa48e59c640 1 -- 172.21.15.38:0/201568882 learned_addr learned my addr 172.21.15.38:0/201568882 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:41.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.775+0000 7fa487fff640 1 --1- 172.21.15.38:0/201568882 >> v1:172.21.15.38:6789/0 conn(0x7fa49009c980 0x7fa49015c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45810/0 (socket says 172.21.15.38:45810) 2023-12-22T08:48:41.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.776+0000 7fa48e59c640 1 -- 172.21.15.38:0/201568882 >> v1:172.21.15.89:6789/0 conn(0x7fa490071460 legacy=0x7fa490071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:41.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.776+0000 7fa48e59c640 1 -- 172.21.15.38:0/201568882 >> v1:172.21.15.38:6789/0 conn(0x7fa49009c980 legacy=0x7fa49015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.776+0000 7fa48e59c640 1 -- 172.21.15.38:0/201568882 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49015c070 con 0x7fa49015b0e0 2023-12-22T08:48:41.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.776+0000 7fa48dd9b640 1 -- 172.21.15.38:0/201568882 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926686617 0 0) 0x7fa49015edf0 con 0x7fa49009c980 2023-12-22T08:48:41.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.777+0000 7fa48e59c640 1 --2- 172.21.15.38:0/201568882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa49015b0e0 0x7fa49015b4c0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fa480009870 tx=0x7fa48002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0182f52875e80f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:41.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.777+0000 7fa48dd9b640 1 -- 172.21.15.38:0/201568882 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800317d0 con 0x7fa49015b0e0 2023-12-22T08:48:41.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.778+0000 7fa48dd9b640 1 -- 172.21.15.38:0/201568882 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa480031930 con 0x7fa49015b0e0 2023-12-22T08:48:41.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.778+0000 7fa48dd9b640 1 -- 172.21.15.38:0/201568882 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480031cc0 con 0x7fa49015b0e0 2023-12-22T08:48:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.778+0000 7fa48f59e640 1 -- 172.21.15.38:0/201568882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa49015b0e0 msgr2=0x7fa49015b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.778+0000 7fa48f59e640 1 --2- 172.21.15.38:0/201568882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa49015b0e0 0x7fa49015b4c0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fa480009870 tx=0x7fa48002b870 comp rx=0 tx=0).stop 2023-12-22T08:48:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.778+0000 7fa48f59e640 1 -- 172.21.15.38:0/201568882 shutdown_connections 2023-12-22T08:48:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.778+0000 7fa48f59e640 1 --2- 172.21.15.38:0/201568882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa49015b0e0 0x7fa49015b4c0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.778+0000 7fa48f59e640 1 -- 172.21.15.38:0/201568882 >> 172.21.15.38:0/201568882 conn(0x7fa4900cf000 msgr2=0x7fa4900cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.778+0000 7fa48f59e640 1 -- 172.21.15.38:0/201568882 shutdown_connections 2023-12-22T08:48:41.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.778+0000 7fa48f59e640 1 -- 172.21.15.38:0/201568882 wait complete. 2023-12-22T08:48:41.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.780+0000 7fa48f59e640 1 Processor -- start 2023-12-22T08:48:41.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.780+0000 7fa48f59e640 1 -- start start 2023-12-22T08:48:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.781+0000 7fa48f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa490071460 0x7fa4901565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.781+0000 7fa48f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa49009c980 0x7fa4900c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.781+0000 7fa48f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa49015b0e0 0x7fa4900c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.781+0000 7fa48f59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900c42e0 con 0x7fa490071460 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.781+0000 7fa48f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900c45c0 con 0x7fa49009c980 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.781+0000 7fa48f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900c48a0 con 0x7fa49015b0e0 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.782+0000 7fa48e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa490071460 0x7fa4901565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.782+0000 7fa48e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa490071460 0x7fa4901565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34808/0 (socket says 172.21.15.38:34808) 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.782+0000 7fa48e59c640 1 -- 172.21.15.38:0/1323911615 learned_addr learned my addr 172.21.15.38:0/1323911615 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.782+0000 7fa487fff640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa49009c980 0x7fa4900c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.782+0000 7fa48ed9d640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa49015b0e0 0x7fa4900c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.782+0000 7fa48e59c640 1 -- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa49015b0e0 msgr2=0x7fa4900c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.782+0000 7fa48e59c640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa49015b0e0 0x7fa4900c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.782+0000 7fa48e59c640 1 -- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa49009c980 msgr2=0x7fa4900c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.782+0000 7fa48e59c640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa49009c980 0x7fa4900c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.782+0000 7fa48e59c640 1 -- 172.21.15.38:0/1323911615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800094d0 con 0x7fa490071460 2023-12-22T08:48:41.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.782+0000 7fa487fff640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa49009c980 0x7fa4900c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:41.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.782+0000 7fa48ed9d640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa49015b0e0 0x7fa4900c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:41.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.783+0000 7fa48e59c640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa490071460 0x7fa4901565e0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fa480034040 tx=0x7fa4800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:41.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.783+0000 7fa486ffd640 1 -- 172.21.15.38:0/1323911615 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480004220 con 0x7fa490071460 2023-12-22T08:48:41.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.783+0000 7fa486ffd640 1 -- 172.21.15.38:0/1323911615 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa480004380 con 0x7fa490071460 2023-12-22T08:48:41.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.783+0000 7fa486ffd640 1 -- 172.21.15.38:0/1323911615 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480003850 con 0x7fa490071460 2023-12-22T08:48:41.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.783+0000 7fa48f59e640 1 -- 172.21.15.38:0/1323911615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4900c4b80 con 0x7fa490071460 2023-12-22T08:48:41.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.783+0000 7fa48f59e640 1 -- 172.21.15.38:0/1323911615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa490156b20 con 0x7fa490071460 2023-12-22T08:48:41.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.784+0000 7fa48f59e640 1 -- 172.21.15.38:0/1323911615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49006dca0 con 0x7fa490071460 2023-12-22T08:48:41.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.785+0000 7fa486ffd640 1 -- 172.21.15.38:0/1323911615 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa480043070 con 0x7fa490071460 2023-12-22T08:48:41.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.786+0000 7fa486ffd640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa47006a430 0x7fa47006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:41.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.786+0000 7fa486ffd640 1 -- 172.21.15.38:0/1323911615 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa4800aa510 con 0x7fa490071460 2023-12-22T08:48:41.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.787+0000 7fa487fff640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa47006a430 0x7fa47006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:41.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.788+0000 7fa487fff640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa47006a430 0x7fa47006c8f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa49009bf70 tx=0x7fa478009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:41.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.790+0000 7fa486ffd640 1 -- 172.21.15.38:0/1323911615 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa480075db0 con 0x7fa490071460 2023-12-22T08:48:41.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.990+0000 7fa48f59e640 1 -- 172.21.15.38:0/1323911615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa49006dca0 con 0x7fa490071460 2023-12-22T08:48:41.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.991+0000 7fa486ffd640 1 -- 172.21.15.38:0/1323911615 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v154) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa4800793d0 con 0x7fa490071460 2023-12-22T08:48:41.992 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:41.992 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-12-22T08:48:41.992 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:48:41.992 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-12-22T08:48:41.992 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-12-22T08:48:41.993 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:48:41.993 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-12-22T08:48:41.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.994+0000 7fa48f59e640 1 -- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa47006a430 msgr2=0x7fa47006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.994+0000 7fa48f59e640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa47006a430 0x7fa47006c8f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa49009bf70 tx=0x7fa478009040 comp rx=0 tx=0).stop 2023-12-22T08:48:41.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.994+0000 7fa48f59e640 1 -- 172.21.15.38:0/1323911615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa490071460 msgr2=0x7fa4901565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:41.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.994+0000 7fa48f59e640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa490071460 0x7fa4901565e0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fa480034040 tx=0x7fa4800046c0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.994+0000 7fa48f59e640 1 -- 172.21.15.38:0/1323911615 shutdown_connections 2023-12-22T08:48:41.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.994+0000 7fa48f59e640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa49015b0e0 0x7fa4900c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.994+0000 7fa48f59e640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa49009c980 0x7fa4900c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.994+0000 7fa48f59e640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa47006a430 0x7fa47006c8f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.994+0000 7fa48f59e640 1 --2- 172.21.15.38:0/1323911615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa490071460 0x7fa4901565e0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:41.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.994+0000 7fa48f59e640 1 -- 172.21.15.38:0/1323911615 >> 172.21.15.38:0/1323911615 conn(0x7fa4900cf000 msgr2=0x7fa49015dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:41.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.994+0000 7fa48f59e640 1 -- 172.21.15.38:0/1323911615 shutdown_connections 2023-12-22T08:48:41.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:41.994+0000 7fa48f59e640 1 -- 172.21.15.38:0/1323911615 wait complete. 2023-12-22T08:48:42.015 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T08:48:42.015 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T08:48:42.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.230+0000 7f5f1906c640 1 Processor -- start 2023-12-22T08:48:42.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.230+0000 7f5f1906c640 1 -- start start 2023-12-22T08:48:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.232+0000 7f5f1906c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5f141431e0 0x7f5f1406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.232+0000 7f5f1906c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5f141435c0 0x7f5f14161070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.232+0000 7f5f1906c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f141615b0 0x7f5f1415da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.232+0000 7f5f1906c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f14140930 con 0x7f5f141431e0 2023-12-22T08:48:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.232+0000 7f5f1906c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f14161a40 con 0x7f5f141435c0 2023-12-22T08:48:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.232+0000 7f5f1906c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1406ce00 con 0x7f5f141615b0 2023-12-22T08:48:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.232+0000 7f5f13fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5f141431e0 0x7f5f1406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.233+0000 7f5f13fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5f141431e0 0x7f5f1406c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34818/0 (socket says 172.21.15.38:34818) 2023-12-22T08:48:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.233+0000 7f5f13fff640 1 -- 172.21.15.38:0/1821256914 learned_addr learned my addr 172.21.15.38:0/1821256914 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:42.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.233+0000 7f5f137fe640 1 --2- 172.21.15.38:0/1821256914 >> v2:172.21.15.89:3300/0 conn(0x7f5f141435c0 0x7f5f14161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:42.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.233+0000 7f5f1886b640 1 --2- 172.21.15.38:0/1821256914 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f141615b0 0x7f5f1415da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:42.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.233+0000 7f5f13fff640 1 -- 172.21.15.38:0/1821256914 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f141615b0 msgr2=0x7f5f1415da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:42.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.233+0000 7f5f13fff640 1 --2- 172.21.15.38:0/1821256914 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f141615b0 0x7f5f1415da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:42.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.233+0000 7f5f13fff640 1 -- 172.21.15.38:0/1821256914 >> v2:172.21.15.89:3300/0 conn(0x7f5f141435c0 msgr2=0x7f5f14161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:42.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.233+0000 7f5f13fff640 1 --2- 172.21.15.38:0/1821256914 >> v2:172.21.15.89:3300/0 conn(0x7f5f141435c0 0x7f5f14161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:42.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.233+0000 7f5f13fff640 1 -- 172.21.15.38:0/1821256914 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1406dc40 con 0x7f5f141431e0 2023-12-22T08:48:42.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.235+0000 7f5f13fff640 1 --2- 172.21.15.38:0/1821256914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f141431e0 0x7f5f1406c8c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f5f140b21b0 tx=0x7f5f0402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a59164a942aea7d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:42.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.235+0000 7f5f12ffd640 1 -- 172.21.15.38:0/1821256914 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0402ca70 con 0x7f5f141431e0 2023-12-22T08:48:42.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.235+0000 7f5f12ffd640 1 -- 172.21.15.38:0/1821256914 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0402cbd0 con 0x7f5f141431e0 2023-12-22T08:48:42.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.235+0000 7f5f12ffd640 1 -- 172.21.15.38:0/1821256914 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f040343f0 con 0x7f5f141431e0 2023-12-22T08:48:42.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.236+0000 7f5f1906c640 1 -- 172.21.15.38:0/1821256914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f141431e0 msgr2=0x7f5f1406c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:42.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.236+0000 7f5f1906c640 1 --2- 172.21.15.38:0/1821256914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f141431e0 0x7f5f1406c8c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f5f140b21b0 tx=0x7f5f0402bed0 comp rx=0 tx=0).stop 2023-12-22T08:48:42.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.236+0000 7f5f1906c640 1 -- 172.21.15.38:0/1821256914 shutdown_connections 2023-12-22T08:48:42.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.236+0000 7f5f1906c640 1 --2- 172.21.15.38:0/1821256914 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f141615b0 0x7f5f1415da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:42.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.236+0000 7f5f1906c640 1 --2- 172.21.15.38:0/1821256914 >> v2:172.21.15.89:3300/0 conn(0x7f5f141435c0 0x7f5f14161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:42.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.236+0000 7f5f1906c640 1 --2- 172.21.15.38:0/1821256914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f141431e0 0x7f5f1406c8c0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:42.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.236+0000 7f5f1906c640 1 -- 172.21.15.38:0/1821256914 >> 172.21.15.38:0/1821256914 conn(0x7f5f140b1500 msgr2=0x7f5f140b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:42.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.236+0000 7f5f1906c640 1 -- 172.21.15.38:0/1821256914 shutdown_connections 2023-12-22T08:48:42.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.236+0000 7f5f1906c640 1 -- 172.21.15.38:0/1821256914 wait complete. 2023-12-22T08:48:42.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.238+0000 7f5f1906c640 1 Processor -- start 2023-12-22T08:48:42.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.238+0000 7f5f1906c640 1 -- start start 2023-12-22T08:48:42.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.239+0000 7f5f1906c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f141431e0 0x7f5f1413e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:42.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.239+0000 7f5f1906c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f141435c0 0x7f5f141e7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:42.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.239+0000 7f5f1906c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f141615b0 0x7f5f141e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:42.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.239+0000 7f5f1906c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f141451b0 con 0x7f5f141431e0 2023-12-22T08:48:42.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.239+0000 7f5f1906c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1413e910 con 0x7f5f141615b0 2023-12-22T08:48:42.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.239+0000 7f5f1906c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f14144ed0 con 0x7f5f141435c0 2023-12-22T08:48:42.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.239+0000 7f5f13fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f141431e0 0x7f5f1413e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:42.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.239+0000 7f5f13fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f141431e0 0x7f5f1413e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34824/0 (socket says 172.21.15.38:34824) 2023-12-22T08:48:42.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.239+0000 7f5f13fff640 1 -- 172.21.15.38:0/77493999 learned_addr learned my addr 172.21.15.38:0/77493999 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:42.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.240+0000 7f5f13fff640 1 -- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f141435c0 msgr2=0x7f5f141e7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:42.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.240+0000 7f5f137fe640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f141435c0 0x7f5f141e7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:42.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.240+0000 7f5f1886b640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f141615b0 0x7f5f141e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:42.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.240+0000 7f5f13fff640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f141435c0 0x7f5f141e7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:42.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.240+0000 7f5f13fff640 1 -- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f141615b0 msgr2=0x7f5f141e83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:42.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.240+0000 7f5f13fff640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f141615b0 0x7f5f141e83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:42.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.240+0000 7f5f13fff640 1 -- 172.21.15.38:0/77493999 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f04009b30 con 0x7f5f141431e0 2023-12-22T08:48:42.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.240+0000 7f5f13fff640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f141431e0 0x7f5f1413e3d0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f5f04036040 tx=0x7f5f04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:42.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.240+0000 7f5f10ff9640 1 -- 172.21.15.38:0/77493999 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0403e450 con 0x7f5f141431e0 2023-12-22T08:48:42.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.240+0000 7f5f10ff9640 1 -- 172.21.15.38:0/77493999 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0403e5b0 con 0x7f5f141431e0 2023-12-22T08:48:42.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.240+0000 7f5f10ff9640 1 -- 172.21.15.38:0/77493999 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0403e960 con 0x7f5f141431e0 2023-12-22T08:48:42.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.241+0000 7f5f1906c640 1 -- 172.21.15.38:0/77493999 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f140aee30 con 0x7f5f141431e0 2023-12-22T08:48:42.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.241+0000 7f5f1906c640 1 -- 172.21.15.38:0/77493999 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f140af3f0 con 0x7f5f141431e0 2023-12-22T08:48:42.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.242+0000 7f5f1906c640 1 -- 172.21.15.38:0/77493999 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f140aec90 con 0x7f5f141431e0 2023-12-22T08:48:42.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.243+0000 7f5f10ff9640 1 -- 172.21.15.38:0/77493999 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5f0403eac0 con 0x7f5f141431e0 2023-12-22T08:48:42.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.244+0000 7f5f10ff9640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5ef406a430 0x7f5ef406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:42.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.244+0000 7f5f10ff9640 1 -- 172.21.15.38:0/77493999 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f040ab420 con 0x7f5f141431e0 2023-12-22T08:48:42.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.244+0000 7f5f137fe640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5ef406a430 0x7f5ef406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:42.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.246+0000 7f5f137fe640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5ef406a430 0x7f5ef406c8f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5f14154970 tx=0x7f5efc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:42.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.248+0000 7f5f10ff9640 1 -- 172.21.15.38:0/77493999 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5f140aec90 con 0x7f5f141431e0 2023-12-22T08:48:42.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:42.444+0000 7f5f1906c640 1 -- 172.21.15.38:0/77493999 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5f140aec90 con 0x7f5f141431e0 2023-12-22T08:48:43.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.393+0000 7f5f10ff9640 1 -- 172.21.15.38:0/77493999 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v155) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5f140aec90 con 0x7f5f141431e0 2023-12-22T08:48:43.395 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-12-22T08:48:43.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.398+0000 7f5f1906c640 1 -- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5ef406a430 msgr2=0x7f5ef406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:43.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.398+0000 7f5f1906c640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5ef406a430 0x7f5ef406c8f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5f14154970 tx=0x7f5efc008040 comp rx=0 tx=0).stop 2023-12-22T08:48:43.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.398+0000 7f5f1906c640 1 -- 172.21.15.38:0/77493999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f141431e0 msgr2=0x7f5f1413e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:43.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.398+0000 7f5f1906c640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f141431e0 0x7f5f1413e3d0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f5f04036040 tx=0x7f5f04004a40 comp rx=0 tx=0).stop 2023-12-22T08:48:43.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.398+0000 7f5f1906c640 1 -- 172.21.15.38:0/77493999 shutdown_connections 2023-12-22T08:48:43.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.398+0000 7f5f1906c640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f141615b0 0x7f5f141e83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:43.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.398+0000 7f5f1906c640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f141435c0 0x7f5f141e7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:43.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.398+0000 7f5f1906c640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5ef406a430 0x7f5ef406c8f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:43.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.398+0000 7f5f1906c640 1 --2- 172.21.15.38:0/77493999 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f141431e0 0x7f5f1413e3d0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:43.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.398+0000 7f5f1906c640 1 -- 172.21.15.38:0/77493999 >> 172.21.15.38:0/77493999 conn(0x7f5f140b1500 msgr2=0x7f5f1413eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:43.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.398+0000 7f5f1906c640 1 -- 172.21.15.38:0/77493999 shutdown_connections 2023-12-22T08:48:43.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.398+0000 7f5f1906c640 1 -- 172.21.15.38:0/77493999 wait complete. 2023-12-22T08:48:43.422 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T08:48:43.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.651+0000 7f60fbabd640 1 Processor -- start 2023-12-22T08:48:43.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.651+0000 7f60fbabd640 1 -- start start 2023-12-22T08:48:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.653+0000 7f60fbabd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60f40b26a0 0x7f60f406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.653+0000 7f60fbabd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60f406cf50 0x7f60f40cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.653+0000 7f60fbabd640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f40b3d10 con 0x7f60f40b22c0 2023-12-22T08:48:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.653+0000 7f60fbabd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f406c610 con 0x7f60f406cf50 2023-12-22T08:48:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.653+0000 7f60fbabd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40b4510 con 0x7f60f40b26a0 2023-12-22T08:48:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.654+0000 7f60f9859640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f60f40b22c0 0x7f60f40b3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45822/0 (socket says 172.21.15.38:45822) 2023-12-22T08:48:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.654+0000 7f60f9859640 1 -- 172.21.15.38:0/3932658570 learned_addr learned my addr 172.21.15.38:0/3932658570 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.654+0000 7f60fa05a640 1 --2- 172.21.15.38:0/3932658570 >> v2:172.21.15.89:3300/0 conn(0x7f60f406cf50 0x7f60f40cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:43.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.654+0000 7f60f9058640 1 --2- 172.21.15.38:0/3932658570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60f40b26a0 0x7f60f406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.654+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606046479 0 0) 0x7f60f0001110 con 0x7f60f40b22c0 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.654+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60e0003520 con 0x7f60f40b22c0 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1546918979 0 0) 0x7f60e0003520 con 0x7f60f40b22c0 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60f40b26a0 msgr2=0x7f60f406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 --2- 172.21.15.38:0/3932658570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60f40b26a0 0x7f60f406ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 >> v2:172.21.15.89:3300/0 conn(0x7f60f406cf50 msgr2=0x7f60f40cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 --2- 172.21.15.38:0/3932658570 >> v2:172.21.15.89:3300/0 conn(0x7f60f406cf50 0x7f60f40cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40b3f50 con 0x7f60f40b22c0 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f60f0001800 con 0x7f60f40b22c0 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 >> v1:172.21.15.38:6789/0 conn(0x7f60f40b22c0 legacy=0x7f60f40b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 --2- 172.21.15.38:0/3932658570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60f40b26a0 0x7f60e0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 --2- 172.21.15.38:0/3932658570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e0003ef0 0x7f60e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 --2- 172.21.15.38:0/3932658570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60e0004d00 0x7f60e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f406c610 con 0x7f60e0003ef0 2023-12-22T08:48:43.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40b4510 con 0x7f60e0004d00 2023-12-22T08:48:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e000b9d0 con 0x7f60f40b26a0 2023-12-22T08:48:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.655+0000 7f60f9058640 1 --2- 172.21.15.38:0/3932658570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e0003ef0 0x7f60e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.656+0000 7f60f9859640 1 --2- 172.21.15.38:0/3932658570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60f40b26a0 0x7f60e0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.656+0000 7f60fa05a640 1 --2- 172.21.15.38:0/3932658570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60e0004d00 0x7f60e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.656+0000 7f60f9058640 1 -- 172.21.15.38:0/3932658570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60f40b26a0 msgr2=0x7f60e0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.656+0000 7f60f9058640 1 --2- 172.21.15.38:0/3932658570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60f40b26a0 0x7f60e0003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.656+0000 7f60f9058640 1 -- 172.21.15.38:0/3932658570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60e0004d00 msgr2=0x7f60e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.656+0000 7f60f9058640 1 --2- 172.21.15.38:0/3932658570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60e0004d00 0x7f60e0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.656+0000 7f60f9058640 1 -- 172.21.15.38:0/3932658570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e0003520 con 0x7f60e0003ef0 2023-12-22T08:48:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.656+0000 7f60fa05a640 1 --2- 172.21.15.38:0/3932658570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60e0004d00 0x7f60e0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.657+0000 7f60f9058640 1 --2- 172.21.15.38:0/3932658570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e0003ef0 0x7f60e00047c0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009af0 tx=0x7f60e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8adc4ec4dfffeded server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.657+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e402c6b0 con 0x7f60e0003ef0 2023-12-22T08:48:43.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.657+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e402c810 con 0x7f60e0003ef0 2023-12-22T08:48:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.657+0000 7f60f8857640 1 -- 172.21.15.38:0/3932658570 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e402cba0 con 0x7f60e0003ef0 2023-12-22T08:48:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.658+0000 7f60fbabd640 1 -- 172.21.15.38:0/3932658570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e0003ef0 msgr2=0x7f60e00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.658+0000 7f60fbabd640 1 --2- 172.21.15.38:0/3932658570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60e0003ef0 0x7f60e00047c0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009af0 tx=0x7f60e00057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.658+0000 7f60fa05a640 1 -- 172.21.15.38:0/3932658570 reap_dead start 2023-12-22T08:48:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.658+0000 7f60fbabd640 1 -- 172.21.15.38:0/3932658570 shutdown_connections 2023-12-22T08:48:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.658+0000 7f60fbabd640 1 -- 172.21.15.38:0/3932658570 >> 172.21.15.38:0/3932658570 conn(0x7f60f40cf070 msgr2=0x7f60f40cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.658+0000 7f60fbabd640 1 -- 172.21.15.38:0/3932658570 shutdown_connections 2023-12-22T08:48:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.658+0000 7f60fbabd640 1 -- 172.21.15.38:0/3932658570 wait complete. 2023-12-22T08:48:43.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.660+0000 7f60fbabd640 1 Processor -- start 2023-12-22T08:48:43.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.660+0000 7f60fbabd640 1 -- start start 2023-12-22T08:48:43.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.661+0000 7f60fbabd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60e0003ef0 0x7f60f414ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:43.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.661+0000 7f60fbabd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60f4070c40 0x7f60f40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:43.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.661+0000 7f60fbabd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f414e000 0x7f60f414e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:43.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.661+0000 7f60fbabd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4071600 con 0x7f60f4070c40 2023-12-22T08:48:43.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.661+0000 7f60fbabd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4150e50 con 0x7f60f414e000 2023-12-22T08:48:43.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.661+0000 7f60fbabd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f414ed10 con 0x7f60e0003ef0 2023-12-22T08:48:43.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.661+0000 7f60f9058640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60f4070c40 0x7f60f40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.661+0000 7f60f9058640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60f4070c40 0x7f60f40710c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34852/0 (socket says 172.21.15.38:34852) 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.661+0000 7f60f9058640 1 -- 172.21.15.38:0/633123806 learned_addr learned my addr 172.21.15.38:0/633123806 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.662+0000 7f60f9859640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60e0003ef0 0x7f60f414ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.662+0000 7f60fa05a640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f414e000 0x7f60f414e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.662+0000 7f60f9058640 1 -- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60e0003ef0 msgr2=0x7f60f414ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.662+0000 7f60f9058640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60e0003ef0 0x7f60f414ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.662+0000 7f60f9058640 1 -- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f414e000 msgr2=0x7f60f414e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.662+0000 7f60f9058640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f414e000 0x7f60f414e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.662+0000 7f60f9058640 1 -- 172.21.15.38:0/633123806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f414eff0 con 0x7f60f4070c40 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.662+0000 7f60fa05a640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f414e000 0x7f60f414e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.662+0000 7f60f9058640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60f4070c40 0x7f60f40710c0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009af0 tx=0x7f60e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.662+0000 7f60ea7fc640 1 -- 172.21.15.38:0/633123806 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4003810 con 0x7f60f4070c40 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.662+0000 7f60ea7fc640 1 -- 172.21.15.38:0/633123806 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e4003970 con 0x7f60f4070c40 2023-12-22T08:48:43.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.662+0000 7f60ea7fc640 1 -- 172.21.15.38:0/633123806 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4003ce0 con 0x7f60f4070c40 2023-12-22T08:48:43.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.662+0000 7f60fbabd640 1 -- 172.21.15.38:0/633123806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f414f2d0 con 0x7f60f4070c40 2023-12-22T08:48:43.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.663+0000 7f60fbabd640 1 -- 172.21.15.38:0/633123806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f414e9c0 con 0x7f60f4070c40 2023-12-22T08:48:43.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.664+0000 7f60fbabd640 1 -- 172.21.15.38:0/633123806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f4061910 con 0x7f60f4070c40 2023-12-22T08:48:43.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.665+0000 7f60ea7fc640 1 -- 172.21.15.38:0/633123806 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f60e4034440 con 0x7f60f4070c40 2023-12-22T08:48:43.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.666+0000 7f60ea7fc640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f60d806a460 0x7f60d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:43.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.666+0000 7f60ea7fc640 1 -- 172.21.15.38:0/633123806 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f60e40aa660 con 0x7f60f4070c40 2023-12-22T08:48:43.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.667+0000 7f60f9859640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f60d806a460 0x7f60d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:43.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.668+0000 7f60f9859640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f60d806a460 0x7f60d806c920 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f60f0000f60 tx=0x7f60f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:43.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.671+0000 7f60ea7fc640 1 -- 172.21.15.38:0/633123806 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f60e4075e40 con 0x7f60f4070c40 2023-12-22T08:48:43.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:43.865+0000 7f60fbabd640 1 -- 172.21.15.38:0/633123806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f60f40b35e0 con 0x7f60f4070c40 2023-12-22T08:48:44.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.404+0000 7f60ea7fc640 1 -- 172.21.15.38:0/633123806 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v156) v1 ==== 170+0+0 (secure 0 0 0) 0x7f60e40044e0 con 0x7f60f4070c40 2023-12-22T08:48:44.406 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-12-22T08:48:44.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.414+0000 7f60fbabd640 1 -- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f60d806a460 msgr2=0x7f60d806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:44.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.414+0000 7f60fbabd640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f60d806a460 0x7f60d806c920 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f60f0000f60 tx=0x7f60f0009040 comp rx=0 tx=0).stop 2023-12-22T08:48:44.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.414+0000 7f60fbabd640 1 -- 172.21.15.38:0/633123806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60f4070c40 msgr2=0x7f60f40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:44.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.414+0000 7f60fbabd640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60f4070c40 0x7f60f40710c0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009af0 tx=0x7f60e4004730 comp rx=0 tx=0).stop 2023-12-22T08:48:44.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.414+0000 7f60fbabd640 1 -- 172.21.15.38:0/633123806 shutdown_connections 2023-12-22T08:48:44.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.414+0000 7f60fbabd640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60f414e000 0x7f60f414e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:44.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.414+0000 7f60fbabd640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f60d806a460 0x7f60d806c920 secure :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f60f0000f60 tx=0x7f60f0009040 comp rx=0 tx=0).stop 2023-12-22T08:48:44.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.414+0000 7f60fbabd640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60f4070c40 0x7f60f40710c0 secure :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009af0 tx=0x7f60e4004730 comp rx=0 tx=0).stop 2023-12-22T08:48:44.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.414+0000 7f60fbabd640 1 --2- 172.21.15.38:0/633123806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60e0003ef0 0x7f60f414ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:44.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.414+0000 7f60fbabd640 1 -- 172.21.15.38:0/633123806 >> 172.21.15.38:0/633123806 conn(0x7f60f40cf070 msgr2=0x7f60f40cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:44.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.417+0000 7f60fbabd640 1 -- 172.21.15.38:0/633123806 shutdown_connections 2023-12-22T08:48:44.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.417+0000 7f60fbabd640 1 -- 172.21.15.38:0/633123806 wait complete. 2023-12-22T08:48:44.440 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T08:48:44.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.641+0000 7fa307ebd640 1 Processor -- start 2023-12-22T08:48:44.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.642+0000 7fa307ebd640 1 -- start start 2023-12-22T08:48:44.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.643+0000 7fa307ebd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa30015e320 0x7fa300161e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:44.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.643+0000 7fa307ebd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa30015e700 0x7fa30006ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:44.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.643+0000 7fa307ebd640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30006b630 con 0x7fa30006d800 2023-12-22T08:48:44.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.643+0000 7fa307ebd640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa300161380 con 0x7fa30015e700 2023-12-22T08:48:44.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.643+0000 7fa307ebd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa300161660 con 0x7fa30015e320 2023-12-22T08:48:44.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.644+0000 7fa305458640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa30015e700 0x7fa30006ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:44.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.644+0000 7fa305458640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa30015e700 0x7fa30006ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34868/0 (socket says 172.21.15.38:34868) 2023-12-22T08:48:44.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.644+0000 7fa305458640 1 -- 172.21.15.38:0/3947797899 learned_addr learned my addr 172.21.15.38:0/3947797899 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:44.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.644+0000 7fa305c59640 1 --2- 172.21.15.38:0/3947797899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa30015e320 0x7fa300161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:44.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.644+0000 7fa305458640 1 -- 172.21.15.38:0/3947797899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa30015e320 msgr2=0x7fa300161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:44.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.644+0000 7fa305458640 1 --2- 172.21.15.38:0/3947797899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa30015e320 0x7fa300161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:44.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.644+0000 7fa305458640 1 -- 172.21.15.38:0/3947797899 >> v1:172.21.15.89:6789/0 conn(0x7fa30006d800 legacy=0x7fa3000cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:44.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.644+0000 7fa305458640 1 -- 172.21.15.38:0/3947797899 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa300161940 con 0x7fa30015e700 2023-12-22T08:48:44.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.645+0000 7fa305458640 1 --2- 172.21.15.38:0/3947797899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa30015e700 0x7fa30006ad50 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009870 tx=0x7fa2f402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e212b516ed6810 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:44.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.646+0000 7fa304c57640 1 -- 172.21.15.38:0/3947797899 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4031640 con 0x7fa30015e700 2023-12-22T08:48:44.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.646+0000 7fa304c57640 1 -- 172.21.15.38:0/3947797899 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f40317a0 con 0x7fa30015e700 2023-12-22T08:48:44.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.646+0000 7fa304c57640 1 -- 172.21.15.38:0/3947797899 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4031b30 con 0x7fa30015e700 2023-12-22T08:48:44.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.646+0000 7fa307ebd640 1 -- 172.21.15.38:0/3947797899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa30015e700 msgr2=0x7fa30006ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:44.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.646+0000 7fa307ebd640 1 --2- 172.21.15.38:0/3947797899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa30015e700 0x7fa30006ad50 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009870 tx=0x7fa2f402b8f0 comp rx=0 tx=0).stop 2023-12-22T08:48:44.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.647+0000 7fa307ebd640 1 -- 172.21.15.38:0/3947797899 shutdown_connections 2023-12-22T08:48:44.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.647+0000 7fa307ebd640 1 --2- 172.21.15.38:0/3947797899 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa30015e700 0x7fa30006ad50 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:44.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.647+0000 7fa307ebd640 1 --2- 172.21.15.38:0/3947797899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa30015e320 0x7fa300161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:44.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.647+0000 7fa307ebd640 1 -- 172.21.15.38:0/3947797899 >> 172.21.15.38:0/3947797899 conn(0x7fa30006c5e0 msgr2=0x7fa30006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:44.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.647+0000 7fa307ebd640 1 -- 172.21.15.38:0/3947797899 shutdown_connections 2023-12-22T08:48:44.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.647+0000 7fa307ebd640 1 -- 172.21.15.38:0/3947797899 wait complete. 2023-12-22T08:48:44.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.648+0000 7fa307ebd640 1 Processor -- start 2023-12-22T08:48:44.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.649+0000 7fa307ebd640 1 -- start start 2023-12-22T08:48:44.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.650+0000 7fa307ebd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa30006d800 0x7fa300154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:44.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.650+0000 7fa307ebd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa30015e320 0x7fa300143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:44.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.650+0000 7fa307ebd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa30015e700 0x7fa3000cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:44.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.650+0000 7fa307ebd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa300155fe0 con 0x7fa30015e700 2023-12-22T08:48:44.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.650+0000 7fa307ebd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3001443b0 con 0x7fa30015e320 2023-12-22T08:48:44.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.650+0000 7fa307ebd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa300155360 con 0x7fa30006d800 2023-12-22T08:48:44.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.650+0000 7fa30645a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa30015e700 0x7fa3000cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:44.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.650+0000 7fa30645a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa30015e700 0x7fa3000cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34878/0 (socket says 172.21.15.38:34878) 2023-12-22T08:48:44.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.650+0000 7fa30645a640 1 -- 172.21.15.38:0/842210953 learned_addr learned my addr 172.21.15.38:0/842210953 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:44.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.650+0000 7fa305c59640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa30006d800 0x7fa300154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:44.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.650+0000 7fa305458640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa30015e320 0x7fa300143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:44.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.651+0000 7fa30645a640 1 -- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa30006d800 msgr2=0x7fa300154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:44.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.651+0000 7fa30645a640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa30006d800 0x7fa300154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:44.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.651+0000 7fa30645a640 1 -- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa30015e320 msgr2=0x7fa300143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:44.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.651+0000 7fa30645a640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa30015e320 0x7fa300143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:44.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.651+0000 7fa30645a640 1 -- 172.21.15.38:0/842210953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f40094d0 con 0x7fa30015e700 2023-12-22T08:48:44.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.651+0000 7fa30645a640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa30015e700 0x7fa3000cc7c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800c410 tx=0x7fa2f800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:44.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.651+0000 7fa2fe7fc640 1 -- 172.21.15.38:0/842210953 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8011790 con 0x7fa30015e700 2023-12-22T08:48:44.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.651+0000 7fa2fe7fc640 1 -- 172.21.15.38:0/842210953 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f80118f0 con 0x7fa30015e700 2023-12-22T08:48:44.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.651+0000 7fa2fe7fc640 1 -- 172.21.15.38:0/842210953 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8011ce0 con 0x7fa30015e700 2023-12-22T08:48:44.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.651+0000 7fa307ebd640 1 -- 172.21.15.38:0/842210953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa300155640 con 0x7fa30015e700 2023-12-22T08:48:44.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.651+0000 7fa307ebd640 1 -- 172.21.15.38:0/842210953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa300155c00 con 0x7fa30015e700 2023-12-22T08:48:44.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.653+0000 7fa307ebd640 1 -- 172.21.15.38:0/842210953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3000b0b40 con 0x7fa30015e700 2023-12-22T08:48:44.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.654+0000 7fa2fe7fc640 1 -- 172.21.15.38:0/842210953 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa2f801c460 con 0x7fa30015e700 2023-12-22T08:48:44.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.655+0000 7fa2fe7fc640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2ec06a430 0x7fa2ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:44.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.655+0000 7fa2fe7fc640 1 -- 172.21.15.38:0/842210953 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa2f8088620 con 0x7fa30015e700 2023-12-22T08:48:44.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.656+0000 7fa305c59640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2ec06a430 0x7fa2ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:44.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.657+0000 7fa305c59640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2ec06a430 0x7fa2ec06c8f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009a60 tx=0x7fa2f0003990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:44.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.660+0000 7fa2fe7fc640 1 -- 172.21.15.38:0/842210953 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa2f8053bd0 con 0x7fa30015e700 2023-12-22T08:48:44.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.900+0000 7fa307ebd640 1 -- 172.21.15.38:0/842210953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa300156120 con 0x7fa30015e700 2023-12-22T08:48:44.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.914+0000 7fa2fe7fc640 1 -- 172.21.15.38:0/842210953 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa300156120 con 0x7fa30015e700 2023-12-22T08:48:44.916 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 18 and data pool 19 2023-12-22T08:48:44.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.920+0000 7fa307ebd640 1 -- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2ec06a430 msgr2=0x7fa2ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:44.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.920+0000 7fa307ebd640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2ec06a430 0x7fa2ec06c8f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009a60 tx=0x7fa2f0003990 comp rx=0 tx=0).stop 2023-12-22T08:48:44.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.920+0000 7fa307ebd640 1 -- 172.21.15.38:0/842210953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa30015e700 msgr2=0x7fa3000cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:44.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.920+0000 7fa307ebd640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa30015e700 0x7fa3000cc7c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800c410 tx=0x7fa2f800c8d0 comp rx=0 tx=0).stop 2023-12-22T08:48:44.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.922+0000 7fa307ebd640 1 -- 172.21.15.38:0/842210953 shutdown_connections 2023-12-22T08:48:44.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.922+0000 7fa307ebd640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2ec06a430 0x7fa2ec06c8f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:44.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.922+0000 7fa307ebd640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa30015e700 0x7fa3000cc7c0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:44.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.922+0000 7fa307ebd640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa30015e320 0x7fa300143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:44.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.922+0000 7fa307ebd640 1 --2- 172.21.15.38:0/842210953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa30006d800 0x7fa300154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:44.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.922+0000 7fa307ebd640 1 -- 172.21.15.38:0/842210953 >> 172.21.15.38:0/842210953 conn(0x7fa30006c5e0 msgr2=0x7fa3000cfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:44.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.922+0000 7fa307ebd640 1 -- 172.21.15.38:0/842210953 shutdown_connections 2023-12-22T08:48:44.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:44.922+0000 7fa307ebd640 1 -- 172.21.15.38:0/842210953 wait complete. 2023-12-22T08:48:44.949 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:48:45.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.136+0000 7f04d1d64640 1 Processor -- start 2023-12-22T08:48:45.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.137+0000 7f04d1d64640 1 -- start start 2023-12-22T08:48:45.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.138+0000 7f04d1d64640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04cc0b3ff0 0x7f04cc06cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.138+0000 7f04d1d64640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f04cc0b4470 0x7f04cc06d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.138+0000 7f04d1d64640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04cc15f220 con 0x7f04cc157980 2023-12-22T08:48:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.138+0000 7f04d1d64640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc0d1520 con 0x7f04cc0b4470 2023-12-22T08:48:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.138+0000 7f04d1d64640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0d1800 con 0x7f04cc0b3ff0 2023-12-22T08:48:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.139+0000 7f04d1563640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f04cc0b4470 0x7f04cc06d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.139+0000 7f04d1563640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f04cc0b4470 0x7f04cc06d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:42070/0 (socket says 172.21.15.38:42070) 2023-12-22T08:48:45.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.139+0000 7f04d1563640 1 -- 172.21.15.38:0/120597943 learned_addr learned my addr 172.21.15.38:0/120597943 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:45.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.139+0000 7f04cbfff640 1 --2- 172.21.15.38:0/120597943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04cc0b3ff0 0x7f04cc06cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:45.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.140+0000 7f04d1563640 1 -- 172.21.15.38:0/120597943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04cc0b3ff0 msgr2=0x7f04cc06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:45.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.140+0000 7f04d1563640 1 --2- 172.21.15.38:0/120597943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04cc0b3ff0 0x7f04cc06cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.140+0000 7f04d1563640 1 -- 172.21.15.38:0/120597943 >> v1:172.21.15.89:6789/0 conn(0x7f04cc157980 legacy=0x7f04cc15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:45.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.140+0000 7f04d1563640 1 -- 172.21.15.38:0/120597943 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc0d1ae0 con 0x7f04cc0b4470 2023-12-22T08:48:45.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.141+0000 7f04d1563640 1 --2- 172.21.15.38:0/120597943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04cc0b4470 0x7f04cc06d470 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009870 tx=0x7f04c402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4573c1a14f8ca960 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:45.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.142+0000 7f04cb7fe640 1 -- 172.21.15.38:0/120597943 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4030840 con 0x7f04cc0b4470 2023-12-22T08:48:45.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.142+0000 7f04cb7fe640 1 -- 172.21.15.38:0/120597943 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c40309a0 con 0x7f04cc0b4470 2023-12-22T08:48:45.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.142+0000 7f04cb7fe640 1 -- 172.21.15.38:0/120597943 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4030d30 con 0x7f04cc0b4470 2023-12-22T08:48:45.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.142+0000 7f04d1d64640 1 -- 172.21.15.38:0/120597943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04cc0b4470 msgr2=0x7f04cc06d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:45.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.142+0000 7f04d1d64640 1 --2- 172.21.15.38:0/120597943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04cc0b4470 0x7f04cc06d470 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009870 tx=0x7f04c402b980 comp rx=0 tx=0).stop 2023-12-22T08:48:45.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.142+0000 7f04d1d64640 1 -- 172.21.15.38:0/120597943 shutdown_connections 2023-12-22T08:48:45.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.142+0000 7f04d1d64640 1 --2- 172.21.15.38:0/120597943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04cc0b4470 0x7f04cc06d470 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.142+0000 7f04d1d64640 1 --2- 172.21.15.38:0/120597943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04cc0b3ff0 0x7f04cc06cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.142+0000 7f04d1d64640 1 -- 172.21.15.38:0/120597943 >> 172.21.15.38:0/120597943 conn(0x7f04cc0d31f0 msgr2=0x7f04cc0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:45.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.143+0000 7f04d1d64640 1 -- 172.21.15.38:0/120597943 shutdown_connections 2023-12-22T08:48:45.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.143+0000 7f04d1d64640 1 -- 172.21.15.38:0/120597943 wait complete. 2023-12-22T08:48:45.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.144+0000 7f04d1d64640 1 Processor -- start 2023-12-22T08:48:45.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.145+0000 7f04d1d64640 1 -- start start 2023-12-22T08:48:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04d1d64640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04cc0b3ff0 0x7f04cc0b80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04d1d64640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04cc0b4470 0x7f04cc0b8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04d1d64640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04cc157980 0x7f04cc14fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04d1d64640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc1594a0 con 0x7f04cc0b4470 2023-12-22T08:48:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04d1d64640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0b8b70 con 0x7f04cc157980 2023-12-22T08:48:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04d1d64640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc159170 con 0x7f04cc0b3ff0 2023-12-22T08:48:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04cc0b4470 0x7f04cc0b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04cc0b4470 0x7f04cc0b8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34890/0 (socket says 172.21.15.38:34890) 2023-12-22T08:48:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04cbfff640 1 -- 172.21.15.38:0/3766050805 learned_addr learned my addr 172.21.15.38:0/3766050805 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04d0d62640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04cc0b3ff0 0x7f04cc0b80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04d1563640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04cc157980 0x7f04cc14fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04cbfff640 1 -- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04cc0b3ff0 msgr2=0x7f04cc0b80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:45.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04cbfff640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04cc0b3ff0 0x7f04cc0b80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04cbfff640 1 -- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04cc157980 msgr2=0x7f04cc14fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:45.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.146+0000 7f04cbfff640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04cc157980 0x7f04cc14fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.147+0000 7f04cbfff640 1 -- 172.21.15.38:0/3766050805 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c40094d0 con 0x7f04cc0b4470 2023-12-22T08:48:45.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.147+0000 7f04cbfff640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04cc0b4470 0x7f04cc0b8630 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f04b400e9b0 tx=0x7f04b400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.147+0000 7f04c97fa640 1 -- 172.21.15.38:0/3766050805 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4009670 con 0x7f04cc0b4470 2023-12-22T08:48:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.147+0000 7f04c97fa640 1 -- 172.21.15.38:0/3766050805 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b400c9a0 con 0x7f04cc0b4470 2023-12-22T08:48:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.147+0000 7f04c97fa640 1 -- 172.21.15.38:0/3766050805 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b400cd50 con 0x7f04cc0b4470 2023-12-22T08:48:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.147+0000 7f04d1d64640 1 -- 172.21.15.38:0/3766050805 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc0b6620 con 0x7f04cc0b4470 2023-12-22T08:48:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.147+0000 7f04d1d64640 1 -- 172.21.15.38:0/3766050805 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc0b6be0 con 0x7f04cc0b4470 2023-12-22T08:48:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.149+0000 7f04d1d64640 1 -- 172.21.15.38:0/3766050805 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc061910 con 0x7f04cc0b4470 2023-12-22T08:48:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.150+0000 7f04c97fa640 1 -- 172.21.15.38:0/3766050805 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f04b4013470 con 0x7f04cc0b4470 2023-12-22T08:48:45.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.151+0000 7f04c97fa640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f04ac06a430 0x7f04ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.151+0000 7f04c97fa640 1 -- 172.21.15.38:0/3766050805 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04b4088e90 con 0x7f04cc0b4470 2023-12-22T08:48:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.152+0000 7f04d0d62640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f04ac06a430 0x7f04ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:45.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.153+0000 7f04d0d62640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f04ac06a430 0x7f04ac06c8f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f04bc001ca0 tx=0x7f04bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:45.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.156+0000 7f04c97fa640 1 -- 172.21.15.38:0/3766050805 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f04b4054470 con 0x7f04cc0b4470 2023-12-22T08:48:45.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.345+0000 7f04d1d64640 1 -- 172.21.15.38:0/3766050805 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04cc1592b0 con 0x7f04cc0b4470 2023-12-22T08:48:45.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.347+0000 7f04c97fa640 1 -- 172.21.15.38:0/3766050805 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+16025 (secure 0 0 0) 0x7f04b4057a90 con 0x7f04cc0b4470 2023-12-22T08:48:45.348 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:45.349 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":157,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:48:44.901903+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:48:42.499151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-22T08:48:43.921718+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:48:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.349+0000 7f04d1d64640 1 -- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f04ac06a430 msgr2=0x7f04ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.349+0000 7f04d1d64640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f04ac06a430 0x7f04ac06c8f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f04bc001ca0 tx=0x7f04bc009040 comp rx=0 tx=0).stop 2023-12-22T08:48:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.349+0000 7f04d1d64640 1 -- 172.21.15.38:0/3766050805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04cc0b4470 msgr2=0x7f04cc0b8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.349+0000 7f04d1d64640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04cc0b4470 0x7f04cc0b8630 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f04b400e9b0 tx=0x7f04b400ee70 comp rx=0 tx=0).stop 2023-12-22T08:48:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.349+0000 7f04d1d64640 1 -- 172.21.15.38:0/3766050805 shutdown_connections 2023-12-22T08:48:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.349+0000 7f04d1d64640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04cc157980 0x7f04cc14fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.349+0000 7f04d1d64640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f04ac06a430 0x7f04ac06c8f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.349+0000 7f04d1d64640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04cc0b4470 0x7f04cc0b8630 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.349+0000 7f04d1d64640 1 --2- 172.21.15.38:0/3766050805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f04cc0b3ff0 0x7f04cc0b80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.349+0000 7f04d1d64640 1 -- 172.21.15.38:0/3766050805 >> 172.21.15.38:0/3766050805 conn(0x7f04cc0d31f0 msgr2=0x7f04cc15d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.350+0000 7f04d1d64640 1 -- 172.21.15.38:0/3766050805 shutdown_connections 2023-12-22T08:48:45.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.350+0000 7f04d1d64640 1 -- 172.21.15.38:0/3766050805 wait complete. 2023-12-22T08:48:45.370 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:48:45.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.591+0000 7f6be6ba4640 1 Processor -- start 2023-12-22T08:48:45.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.592+0000 7f6be6ba4640 1 -- start start 2023-12-22T08:48:45.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.593+0000 7f6be6ba4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6be00b3f90 0x7f6be015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.593+0000 7f6be6ba4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be006ca50 0x7f6be0070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.593+0000 7f6be6ba4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be015eb20 con 0x7f6be015e740 2023-12-22T08:48:45.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.593+0000 7f6be6ba4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be006e650 con 0x7f6be00b3f90 2023-12-22T08:48:45.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.593+0000 7f6be6ba4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be0070770 con 0x7f6be006ca50 2023-12-22T08:48:45.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.594+0000 7f6be4940640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6be015e740 0x7f6be00b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45824/0 (socket says 172.21.15.38:45824) 2023-12-22T08:48:45.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.594+0000 7f6be4940640 1 -- 172.21.15.38:0/3821252865 learned_addr learned my addr 172.21.15.38:0/3821252865 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:45.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.594+0000 7f6bdffff640 1 --2- 172.21.15.38:0/3821252865 >> v2:172.21.15.89:3300/0 conn(0x7f6be00b3f90 0x7f6be015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:45.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.594+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317730729 0 0) 0x7f6be015eb20 con 0x7f6be015e740 2023-12-22T08:48:45.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.594+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd0003520 con 0x7f6be015e740 2023-12-22T08:48:45.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.594+0000 7f6be5141640 1 --2- 172.21.15.38:0/3821252865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be006ca50 0x7f6be0070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:45.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.594+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2800283350 0 0) 0x7f6bd0003520 con 0x7f6be015e740 2023-12-22T08:48:45.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.594+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be006ca50 msgr2=0x7f6be0070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:45.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.594+0000 7f6bdf7fe640 1 --2- 172.21.15.38:0/3821252865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be006ca50 0x7f6be0070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.594+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 >> v2:172.21.15.89:3300/0 conn(0x7f6be00b3f90 msgr2=0x7f6be015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:45.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.594+0000 7f6bdf7fe640 1 --2- 172.21.15.38:0/3821252865 >> v2:172.21.15.89:3300/0 conn(0x7f6be00b3f90 0x7f6be015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.594+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be006d180 con 0x7f6be015e740 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.595+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f6bd40019f0 con 0x7f6be015e740 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.595+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 >> v1:172.21.15.38:6789/0 conn(0x7f6be015e740 legacy=0x7f6be00b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.595+0000 7f6bdf7fe640 1 --2- 172.21.15.38:0/3821252865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be006ca50 0x7f6bd0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.595+0000 7f6bdf7fe640 1 --2- 172.21.15.38:0/3821252865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bd0003f40 0x7f6bd00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.595+0000 7f6bdf7fe640 1 --2- 172.21.15.38:0/3821252865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd0004d00 0x7f6bd0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.595+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be006e650 con 0x7f6bd0003f40 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.595+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be0070770 con 0x7f6bd0004d00 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.595+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd000bb60 con 0x7f6be006ca50 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.595+0000 7f6bdffff640 1 --2- 172.21.15.38:0/3821252865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bd0003f40 0x7f6bd00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.595+0000 7f6be4940640 1 --2- 172.21.15.38:0/3821252865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be006ca50 0x7f6bd0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.595+0000 7f6be5141640 1 --2- 172.21.15.38:0/3821252865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd0004d00 0x7f6bd0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.595+0000 7f6bdffff640 1 -- 172.21.15.38:0/3821252865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be006ca50 msgr2=0x7f6bd0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:45.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.595+0000 7f6bdffff640 1 --2- 172.21.15.38:0/3821252865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be006ca50 0x7f6bd0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.596+0000 7f6bdffff640 1 -- 172.21.15.38:0/3821252865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd0004d00 msgr2=0x7f6bd0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:45.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.596+0000 7f6bdffff640 1 --2- 172.21.15.38:0/3821252865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd0004d00 0x7f6bd0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.596+0000 7f6bdffff640 1 -- 172.21.15.38:0/3821252865 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0003520 con 0x7f6bd0003f40 2023-12-22T08:48:45.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.596+0000 7f6be5141640 1 --2- 172.21.15.38:0/3821252865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd0004d00 0x7f6bd0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:45.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.597+0000 7f6bdffff640 1 --2- 172.21.15.38:0/3821252865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bd0003f40 0x7f6bd00047c0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009ac0 tx=0x7f6bd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0da235c9f2a4704 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:45.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.597+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc02c710 con 0x7f6bd0003f40 2023-12-22T08:48:45.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.597+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc02c870 con 0x7f6bd0003f40 2023-12-22T08:48:45.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.597+0000 7f6bdf7fe640 1 -- 172.21.15.38:0/3821252865 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc02cc00 con 0x7f6bd0003f40 2023-12-22T08:48:45.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.598+0000 7f6be6ba4640 1 -- 172.21.15.38:0/3821252865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bd0003f40 msgr2=0x7f6bd00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:45.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.598+0000 7f6be6ba4640 1 --2- 172.21.15.38:0/3821252865 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6bd0003f40 0x7f6bd00047c0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009ac0 tx=0x7f6bd00057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.598+0000 7f6be5141640 1 -- 172.21.15.38:0/3821252865 reap_dead start 2023-12-22T08:48:45.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.598+0000 7f6be6ba4640 1 -- 172.21.15.38:0/3821252865 shutdown_connections 2023-12-22T08:48:45.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.598+0000 7f6be6ba4640 1 -- 172.21.15.38:0/3821252865 >> 172.21.15.38:0/3821252865 conn(0x7f6be00cfea0 msgr2=0x7f6be00d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:45.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.598+0000 7f6be6ba4640 1 -- 172.21.15.38:0/3821252865 shutdown_connections 2023-12-22T08:48:45.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.598+0000 7f6be6ba4640 1 -- 172.21.15.38:0/3821252865 wait complete. 2023-12-22T08:48:45.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.600+0000 7f6be6ba4640 1 Processor -- start 2023-12-22T08:48:45.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.600+0000 7f6be6ba4640 1 -- start start 2023-12-22T08:48:45.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6be6ba4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd0003f40 0x7f6be0158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6be6ba4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6be01f6f10 0x7f6be01f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6be6ba4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be00adb00 0x7f6be0160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6be6ba4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be01f3630 con 0x7f6be01f6f10 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6be6ba4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be01f3910 con 0x7f6bd0003f40 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6be6ba4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be01f3bf0 con 0x7f6be00adb00 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6bdffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6be01f6f10 0x7f6be01f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6bdffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6be01f6f10 0x7f6be01f2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34916/0 (socket says 172.21.15.38:34916) 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6bdffff640 1 -- 172.21.15.38:0/337871462 learned_addr learned my addr 172.21.15.38:0/337871462 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6bdffff640 1 -- 172.21.15.38:0/337871462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be00adb00 msgr2=0x7f6be0160f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6bdffff640 1 --2- 172.21.15.38:0/337871462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be00adb00 0x7f6be0160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6bdffff640 1 -- 172.21.15.38:0/337871462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd0003f40 msgr2=0x7f6be0158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6bdffff640 1 --2- 172.21.15.38:0/337871462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd0003f40 0x7f6be0158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.601+0000 7f6bdffff640 1 -- 172.21.15.38:0/337871462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be00ad300 con 0x7f6be01f6f10 2023-12-22T08:48:45.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.602+0000 7f6bdffff640 1 --2- 172.21.15.38:0/337871462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6be01f6f10 0x7f6be01f2cc0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc02c2b0 tx=0x7f6bcc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:45.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.602+0000 7f6bdd7fa640 1 -- 172.21.15.38:0/337871462 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc003810 con 0x7f6be01f6f10 2023-12-22T08:48:45.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.602+0000 7f6bdd7fa640 1 -- 172.21.15.38:0/337871462 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc02de90 con 0x7f6be01f6f10 2023-12-22T08:48:45.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.602+0000 7f6bdd7fa640 1 -- 172.21.15.38:0/337871462 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc003b70 con 0x7f6be01f6f10 2023-12-22T08:48:45.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.602+0000 7f6be6ba4640 1 -- 172.21.15.38:0/337871462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be00ad5e0 con 0x7f6be01f6f10 2023-12-22T08:48:45.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.602+0000 7f6be6ba4640 1 -- 172.21.15.38:0/337871462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be01f33e0 con 0x7f6be01f6f10 2023-12-22T08:48:45.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.603+0000 7f6be6ba4640 1 -- 172.21.15.38:0/337871462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be0061910 con 0x7f6be01f6f10 2023-12-22T08:48:45.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.604+0000 7f6bdd7fa640 1 -- 172.21.15.38:0/337871462 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6bcc003cd0 con 0x7f6be01f6f10 2023-12-22T08:48:45.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.605+0000 7f6bdd7fa640 1 --2- 172.21.15.38:0/337871462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6bc406a460 0x7f6bc406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:45.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.605+0000 7f6bdd7fa640 1 -- 172.21.15.38:0/337871462 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bcc0aa800 con 0x7f6be01f6f10 2023-12-22T08:48:45.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.606+0000 7f6be4940640 1 --2- 172.21.15.38:0/337871462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6bc406a460 0x7f6bc406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:45.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.607+0000 7f6be4940640 1 --2- 172.21.15.38:0/337871462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6bc406a460 0x7f6bc406c920 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40014a0 tx=0x7f6bd4001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:45.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.609+0000 7f6bdd7fa640 1 -- 172.21.15.38:0/337871462 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6bcc075de0 con 0x7f6be01f6f10 2023-12-22T08:48:45.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.794+0000 7f6be6ba4640 1 -- 172.21.15.38:0/337871462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6be00b4d80 con 0x7f6be01f6f10 2023-12-22T08:48:45.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.798+0000 7f6bdd7fa640 1 -- 172.21.15.38:0/337871462 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+16025 (secure 0 0 0) 0x7f6bcc0a2e60 con 0x7f6be01f6f10 2023-12-22T08:48:45.799 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:45.799 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":157,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:48:44.901903+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:48:42.499151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-22T08:48:43.921718+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:48:45.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.800+0000 7f6be6ba4640 1 -- 172.21.15.38:0/337871462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6bc406a460 msgr2=0x7f6bc406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:45.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.800+0000 7f6be6ba4640 1 --2- 172.21.15.38:0/337871462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6bc406a460 0x7f6bc406c920 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40014a0 tx=0x7f6bd4001330 comp rx=0 tx=0).stop 2023-12-22T08:48:45.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.800+0000 7f6be6ba4640 1 -- 172.21.15.38:0/337871462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6be01f6f10 msgr2=0x7f6be01f2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:45.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.800+0000 7f6be6ba4640 1 --2- 172.21.15.38:0/337871462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6be01f6f10 0x7f6be01f2cc0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc02c2b0 tx=0x7f6bcc004730 comp rx=0 tx=0).stop 2023-12-22T08:48:45.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.800+0000 7f6be6ba4640 1 -- 172.21.15.38:0/337871462 shutdown_connections 2023-12-22T08:48:45.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.800+0000 7f6be6ba4640 1 --2- 172.21.15.38:0/337871462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be00adb00 0x7f6be0160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.800+0000 7f6be6ba4640 1 --2- 172.21.15.38:0/337871462 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6bc406a460 0x7f6bc406c920 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.800+0000 7f6be6ba4640 1 --2- 172.21.15.38:0/337871462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6be01f6f10 0x7f6be01f2cc0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.800+0000 7f6be6ba4640 1 --2- 172.21.15.38:0/337871462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6bd0003f40 0x7f6be0158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:45.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.801+0000 7f6be6ba4640 1 -- 172.21.15.38:0/337871462 >> 172.21.15.38:0/337871462 conn(0x7f6be00cfea0 msgr2=0x7f6be01604c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:45.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.801+0000 7f6be6ba4640 1 -- 172.21.15.38:0/337871462 shutdown_connections 2023-12-22T08:48:45.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:45.801+0000 7f6be6ba4640 1 -- 172.21.15.38:0/337871462 wait complete. 2023-12-22T08:48:45.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T08:48:46.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.040+0000 7fe5b564c640 1 Processor -- start 2023-12-22T08:48:46.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.040+0000 7fe5b564c640 1 -- start start 2023-12-22T08:48:46.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.042+0000 7fe5b564c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b015d470 0x7fe5b00b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:46.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.042+0000 7fe5b564c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b00ac8e0 con 0x7fe5b015d850 2023-12-22T08:48:46.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.042+0000 7fe5b564c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b00b4550 con 0x7fe5b0071ea0 2023-12-22T08:48:46.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.042+0000 7fe5b564c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b00ada40 con 0x7fe5b015d470 2023-12-22T08:48:46.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.042+0000 7fe5a7fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe5b015d850 0x7fe5b00ad330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45836/0 (socket says 172.21.15.38:45836) 2023-12-22T08:48:46.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.042+0000 7fe5a7fff640 1 -- 172.21.15.38:0/667432771 learned_addr learned my addr 172.21.15.38:0/667432771 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:46.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.043+0000 7fe5aeffd640 1 --2- 172.21.15.38:0/667432771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b015d470 0x7fe5b00b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:46.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.043+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337783725 0 0) 0x7fe5b00ac8e0 con 0x7fe5b015d850 2023-12-22T08:48:46.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.043+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe59c003520 con 0x7fe5b015d850 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.043+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2368339179 0 0) 0x7fe59c003520 con 0x7fe5b015d850 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.043+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b015d470 msgr2=0x7fe5b00b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.043+0000 7fe5ae7fc640 1 --2- 172.21.15.38:0/667432771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b015d470 0x7fe5b00b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.043+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 >> v1:172.21.15.89:6789/0 conn(0x7fe5b0071ea0 legacy=0x7fe5b00b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.043+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b00b4940 con 0x7fe5b015d850 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.043+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fe598001670 con 0x7fe5b015d850 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.043+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 >> v1:172.21.15.38:6789/0 conn(0x7fe5b015d850 legacy=0x7fe5b00ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5ae7fc640 1 --2- 172.21.15.38:0/667432771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b015d470 0x7fe59c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5ae7fc640 1 --2- 172.21.15.38:0/667432771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59c003f20 0x7fe59c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5ae7fc640 1 --2- 172.21.15.38:0/667432771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe59c004d00 0x7fe59c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b00ada40 con 0x7fe59c004d00 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c00ba60 con 0x7fe59c003f20 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c00bc20 con 0x7fe5b015d470 2023-12-22T08:48:46.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5af7fe640 1 --2- 172.21.15.38:0/667432771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe59c004d00 0x7fe59c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:46.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5aeffd640 1 --2- 172.21.15.38:0/667432771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b015d470 0x7fe59c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:46.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5a7fff640 1 --2- 172.21.15.38:0/667432771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59c003f20 0x7fe59c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:46.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5af7fe640 1 -- 172.21.15.38:0/667432771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b015d470 msgr2=0x7fe59c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:46.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5af7fe640 1 --2- 172.21.15.38:0/667432771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b015d470 0x7fe59c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:46.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5af7fe640 1 -- 172.21.15.38:0/667432771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59c003f20 msgr2=0x7fe59c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:46.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5af7fe640 1 --2- 172.21.15.38:0/667432771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59c003f20 0x7fe59c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:46.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.044+0000 7fe5af7fe640 1 -- 172.21.15.38:0/667432771 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c003520 con 0x7fe59c004d00 2023-12-22T08:48:46.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.045+0000 7fe5af7fe640 1 --2- 172.21.15.38:0/667432771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe59c004d00 0x7fe59c005180 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8001e50 tx=0x7fe59c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add2c02d1744d04 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:46.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.046+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8003b70 con 0x7fe59c004d00 2023-12-22T08:48:46.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.046+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a8003cd0 con 0x7fe59c004d00 2023-12-22T08:48:46.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.046+0000 7fe5ae7fc640 1 -- 172.21.15.38:0/667432771 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8005310 con 0x7fe59c004d00 2023-12-22T08:48:46.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.046+0000 7fe5b564c640 1 -- 172.21.15.38:0/667432771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe59c004d00 msgr2=0x7fe59c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:46.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.046+0000 7fe5b564c640 1 --2- 172.21.15.38:0/667432771 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe59c004d00 0x7fe59c005180 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8001e50 tx=0x7fe59c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:46.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.046+0000 7fe5af7fe640 1 -- 172.21.15.38:0/667432771 reap_dead start 2023-12-22T08:48:46.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.046+0000 7fe5b564c640 1 -- 172.21.15.38:0/667432771 shutdown_connections 2023-12-22T08:48:46.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.046+0000 7fe5b564c640 1 -- 172.21.15.38:0/667432771 >> 172.21.15.38:0/667432771 conn(0x7fe5b00cf070 msgr2=0x7fe5b00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:46.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.046+0000 7fe5b564c640 1 -- 172.21.15.38:0/667432771 shutdown_connections 2023-12-22T08:48:46.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.046+0000 7fe5b564c640 1 -- 172.21.15.38:0/667432771 wait complete. 2023-12-22T08:48:46.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.048+0000 7fe5b564c640 1 Processor -- start 2023-12-22T08:48:46.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.048+0000 7fe5b564c640 1 -- start start 2023-12-22T08:48:46.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.049+0000 7fe5b564c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59c004d00 0x7fe5b0139ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:46.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.049+0000 7fe5b564c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5b01602f0 0x7fe5b00cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:46.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.049+0000 7fe5b564c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b0160770 0x7fe5b013a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:46.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.049+0000 7fe5b564c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b0139ff0 con 0x7fe5b01602f0 2023-12-22T08:48:46.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.049+0000 7fe5b564c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b015fe60 con 0x7fe59c004d00 2023-12-22T08:48:46.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.049+0000 7fe5b564c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b015f530 con 0x7fe5b0160770 2023-12-22T08:48:46.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.050+0000 7fe5a7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5b01602f0 0x7fe5b00cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:46.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.050+0000 7fe5a7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5b01602f0 0x7fe5b00cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34930/0 (socket says 172.21.15.38:34930) 2023-12-22T08:48:46.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.050+0000 7fe5a7fff640 1 -- 172.21.15.38:0/374802331 learned_addr learned my addr 172.21.15.38:0/374802331 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:46.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.050+0000 7fe5af7fe640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b0160770 0x7fe5b013a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:46.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.050+0000 7fe5aeffd640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59c004d00 0x7fe5b0139ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:46.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.050+0000 7fe5a7fff640 1 -- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b0160770 msgr2=0x7fe5b013a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:46.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.050+0000 7fe5a7fff640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b0160770 0x7fe5b013a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:46.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.050+0000 7fe5a7fff640 1 -- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59c004d00 msgr2=0x7fe5b0139ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:46.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.050+0000 7fe5a7fff640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59c004d00 0x7fe5b0139ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:46.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.050+0000 7fe5a7fff640 1 -- 172.21.15.38:0/374802331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b015f810 con 0x7fe5b01602f0 2023-12-22T08:48:46.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.050+0000 7fe5af7fe640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b0160770 0x7fe5b013a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:46.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.050+0000 7fe5aeffd640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59c004d00 0x7fe5b0139ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:46.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.051+0000 7fe5a7fff640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5b01602f0 0x7fe5b00cdb50 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fe59800e820 tx=0x7fe59800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:46.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.051+0000 7fe5a77fe640 1 -- 172.21.15.38:0/374802331 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59800c8d0 con 0x7fe5b01602f0 2023-12-22T08:48:46.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.051+0000 7fe5a77fe640 1 -- 172.21.15.38:0/374802331 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59800ca30 con 0x7fe5b01602f0 2023-12-22T08:48:46.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.051+0000 7fe5a77fe640 1 -- 172.21.15.38:0/374802331 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59800cdc0 con 0x7fe5b01602f0 2023-12-22T08:48:46.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.051+0000 7fe5b564c640 1 -- 172.21.15.38:0/374802331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b015faf0 con 0x7fe5b01602f0 2023-12-22T08:48:46.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.051+0000 7fe5b564c640 1 -- 172.21.15.38:0/374802331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b015f150 con 0x7fe5b01602f0 2023-12-22T08:48:46.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.052+0000 7fe5b564c640 1 -- 172.21.15.38:0/374802331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b0061910 con 0x7fe5b01602f0 2023-12-22T08:48:46.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.053+0000 7fe5a77fe640 1 -- 172.21.15.38:0/374802331 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe59801d460 con 0x7fe5b01602f0 2023-12-22T08:48:46.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.054+0000 7fe5a77fe640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe59006a460 0x7fe59006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:46.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.054+0000 7fe5a77fe640 1 -- 172.21.15.38:0/374802331 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe598088a10 con 0x7fe5b01602f0 2023-12-22T08:48:46.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.055+0000 7fe5aeffd640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe59006a460 0x7fe59006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:46.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.056+0000 7fe5aeffd640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe59006a460 0x7fe59006c920 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0151bd0 tx=0x7fe5a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:46.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.059+0000 7fe5a77fe640 1 -- 172.21.15.38:0/374802331 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe598053f60 con 0x7fe5b01602f0 2023-12-22T08:48:46.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:46.297+0000 7fe5b564c640 1 -- 172.21.15.38:0/374802331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe5b00ce980 con 0x7fe5b01602f0 2023-12-22T08:48:47.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.308+0000 7fe5a77fe640 1 -- 172.21.15.38:0/374802331 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe598057580 con 0x7fe5b01602f0 2023-12-22T08:48:47.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.312+0000 7fe5b564c640 1 -- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe59006a460 msgr2=0x7fe59006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.312+0000 7fe5b564c640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe59006a460 0x7fe59006c920 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0151bd0 tx=0x7fe5a0008040 comp rx=0 tx=0).stop 2023-12-22T08:48:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.312+0000 7fe5b564c640 1 -- 172.21.15.38:0/374802331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5b01602f0 msgr2=0x7fe5b00cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.312+0000 7fe5b564c640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5b01602f0 0x7fe5b00cdb50 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fe59800e820 tx=0x7fe59800ece0 comp rx=0 tx=0).stop 2023-12-22T08:48:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.312+0000 7fe5b564c640 1 -- 172.21.15.38:0/374802331 shutdown_connections 2023-12-22T08:48:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.312+0000 7fe5b564c640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5b0160770 0x7fe5b013a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.312+0000 7fe5b564c640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe59006a460 0x7fe59006c920 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.312+0000 7fe5b564c640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5b01602f0 0x7fe5b00cdb50 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.312+0000 7fe5b564c640 1 --2- 172.21.15.38:0/374802331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe59c004d00 0x7fe5b0139ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.312+0000 7fe5b564c640 1 -- 172.21.15.38:0/374802331 >> 172.21.15.38:0/374802331 conn(0x7fe5b00cf070 msgr2=0x7fe5b006ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.312+0000 7fe5b564c640 1 -- 172.21.15.38:0/374802331 shutdown_connections 2023-12-22T08:48:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.313+0000 7fe5b564c640 1 -- 172.21.15.38:0/374802331 wait complete. 2023-12-22T08:48:47.337 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T08:48:47.337 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T08:48:47.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.567+0000 7f4fa578f640 1 Processor -- start 2023-12-22T08:48:47.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.568+0000 7f4fa578f640 1 -- start start 2023-12-22T08:48:47.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.569+0000 7f4fa578f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4fa0071d80 0x7f4fa00a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:47.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.570+0000 7f4fa578f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fa0161750 0x7f4fa006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:47.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.570+0000 7f4fa578f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa006c2a0 con 0x7f4fa00a35a0 2023-12-22T08:48:47.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.570+0000 7f4fa578f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa00a44a0 con 0x7f4fa0161750 2023-12-22T08:48:47.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.570+0000 7f4fa578f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa00a3a00 con 0x7f4fa0071d80 2023-12-22T08:48:47.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.570+0000 7f4f9f7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4fa00a35a0 0x7f4fa0161040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45844/0 (socket says 172.21.15.38:45844) 2023-12-22T08:48:47.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.570+0000 7f4f9f7fe640 1 -- 172.21.15.38:0/3331454288 learned_addr learned my addr 172.21.15.38:0/3331454288 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:47.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.570+0000 7f4fa4f8e640 1 --2- 172.21.15.38:0/3331454288 >> v2:172.21.15.38:3300/0 conn(0x7f4fa0161750 0x7f4fa006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:47.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.570+0000 7f4f9ffff640 1 --2- 172.21.15.38:0/3331454288 >> v2:172.21.15.89:3300/0 conn(0x7f4fa0071d80 0x7f4fa00a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:47.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.570+0000 7f4f9effd640 1 -- 172.21.15.38:0/3331454288 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152730038 0 0) 0x7f4fa006c2a0 con 0x7f4fa00a35a0 2023-12-22T08:48:47.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.571+0000 7f4f9effd640 1 -- 172.21.15.38:0/3331454288 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f88003520 con 0x7f4fa00a35a0 2023-12-22T08:48:47.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.571+0000 7f4fa4f8e640 1 -- 172.21.15.38:0/3331454288 >> v2:172.21.15.89:3300/0 conn(0x7f4fa0071d80 msgr2=0x7f4fa00a3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:47.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.571+0000 7f4fa4f8e640 1 --2- 172.21.15.38:0/3331454288 >> v2:172.21.15.89:3300/0 conn(0x7f4fa0071d80 0x7f4fa00a3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:47.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.571+0000 7f4fa4f8e640 1 -- 172.21.15.38:0/3331454288 >> v1:172.21.15.38:6789/0 conn(0x7f4fa00a35a0 legacy=0x7f4fa0161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:47.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.571+0000 7f4fa4f8e640 1 -- 172.21.15.38:0/3331454288 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa0072160 con 0x7f4fa0161750 2023-12-22T08:48:47.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.572+0000 7f4fa4f8e640 1 --2- 172.21.15.38:0/3331454288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fa0161750 0x7f4fa006c730 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f4fa006e410 tx=0x7f4f9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58af10bbb82c6be9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:47.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.572+0000 7f4f9effd640 1 -- 172.21.15.38:0/3331454288 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98031830 con 0x7f4fa0161750 2023-12-22T08:48:47.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.572+0000 7f4f9effd640 1 -- 172.21.15.38:0/3331454288 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f98031990 con 0x7f4fa0161750 2023-12-22T08:48:47.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.572+0000 7f4f9effd640 1 -- 172.21.15.38:0/3331454288 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98031d00 con 0x7f4fa0161750 2023-12-22T08:48:47.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.573+0000 7f4fa578f640 1 -- 172.21.15.38:0/3331454288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fa0161750 msgr2=0x7f4fa006c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:47.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.573+0000 7f4fa578f640 1 --2- 172.21.15.38:0/3331454288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fa0161750 0x7f4fa006c730 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f4fa006e410 tx=0x7f4f9802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:48:47.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.573+0000 7f4fa578f640 1 -- 172.21.15.38:0/3331454288 shutdown_connections 2023-12-22T08:48:47.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.573+0000 7f4fa578f640 1 --2- 172.21.15.38:0/3331454288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fa0161750 0x7f4fa006c730 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:47.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.573+0000 7f4fa578f640 1 --2- 172.21.15.38:0/3331454288 >> v2:172.21.15.89:3300/0 conn(0x7f4fa0071d80 0x7f4fa00a3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:47.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.573+0000 7f4fa578f640 1 -- 172.21.15.38:0/3331454288 >> 172.21.15.38:0/3331454288 conn(0x7f4fa00cf000 msgr2=0x7f4fa00cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:47.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.573+0000 7f4fa578f640 1 -- 172.21.15.38:0/3331454288 shutdown_connections 2023-12-22T08:48:47.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.573+0000 7f4fa578f640 1 -- 172.21.15.38:0/3331454288 wait complete. 2023-12-22T08:48:47.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.575+0000 7f4fa578f640 1 Processor -- start 2023-12-22T08:48:47.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.575+0000 7f4fa578f640 1 -- start start 2023-12-22T08:48:47.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.576+0000 7f4fa578f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa0071d80 0x7f4fa0153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:47.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.576+0000 7f4fa578f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa00a35a0 0x7f4fa015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:47.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.576+0000 7f4fa578f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fa0161750 0x7f4fa015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:47.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.576+0000 7f4fa578f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa015a0d0 con 0x7f4fa0161750 2023-12-22T08:48:47.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.576+0000 7f4fa578f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0159450 con 0x7f4fa0071d80 2023-12-22T08:48:47.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.576+0000 7f4fa578f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0159730 con 0x7f4fa00a35a0 2023-12-22T08:48:47.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.576+0000 7f4fa4f8e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fa0161750 0x7f4fa015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:47.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.576+0000 7f4fa4f8e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fa0161750 0x7f4fa015aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34938/0 (socket says 172.21.15.38:34938) 2023-12-22T08:48:47.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.576+0000 7f4fa4f8e640 1 -- 172.21.15.38:0/1325904599 learned_addr learned my addr 172.21.15.38:0/1325904599 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:47.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.577+0000 7f4f9ffff640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa0071d80 0x7f4fa0153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:47.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.577+0000 7f4f9f7fe640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa00a35a0 0x7f4fa015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:47.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.577+0000 7f4fa4f8e640 1 -- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa00a35a0 msgr2=0x7f4fa015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:47.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.577+0000 7f4fa4f8e640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa00a35a0 0x7f4fa015a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:47.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.577+0000 7f4fa4f8e640 1 -- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa0071d80 msgr2=0x7f4fa0153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:47.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.577+0000 7f4fa4f8e640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa0071d80 0x7f4fa0153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:47.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.577+0000 7f4fa4f8e640 1 -- 172.21.15.38:0/1325904599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f98009400 con 0x7f4fa0161750 2023-12-22T08:48:47.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.577+0000 7f4f9f7fe640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa00a35a0 0x7f4fa015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:47.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.577+0000 7f4fa4f8e640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fa0161750 0x7f4fa015aa30 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f4f98034040 tx=0x7f4f980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:47.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.578+0000 7f4f9cff9640 1 -- 172.21.15.38:0/1325904599 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9803a830 con 0x7f4fa0161750 2023-12-22T08:48:47.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.578+0000 7f4f9cff9640 1 -- 172.21.15.38:0/1325904599 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9803a990 con 0x7f4fa0161750 2023-12-22T08:48:47.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.578+0000 7f4f9cff9640 1 -- 172.21.15.38:0/1325904599 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9803ad40 con 0x7f4fa0161750 2023-12-22T08:48:47.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.578+0000 7f4fa578f640 1 -- 172.21.15.38:0/1325904599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa0159a10 con 0x7f4fa0161750 2023-12-22T08:48:47.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.578+0000 7f4fa578f640 1 -- 172.21.15.38:0/1325904599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa00aff50 con 0x7f4fa0161750 2023-12-22T08:48:47.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.579+0000 7f4fa578f640 1 -- 172.21.15.38:0/1325904599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa015a210 con 0x7f4fa0161750 2023-12-22T08:48:47.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.580+0000 7f4f9cff9640 1 -- 172.21.15.38:0/1325904599 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f9804d440 con 0x7f4fa0161750 2023-12-22T08:48:47.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.581+0000 7f4f9cff9640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4f8c06a430 0x7f4f8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:47.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.581+0000 7f4f9cff9640 1 -- 172.21.15.38:0/1325904599 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f980aa9a0 con 0x7f4fa0161750 2023-12-22T08:48:47.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.582+0000 7f4f9ffff640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4f8c06a430 0x7f4f8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:47.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.583+0000 7f4f9ffff640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4f8c06a430 0x7f4f8c06c8f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4f900074a0 tx=0x7f4f9000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:47.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.586+0000 7f4f9cff9640 1 -- 172.21.15.38:0/1325904599 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4fa015a210 con 0x7f4fa0161750 2023-12-22T08:48:47.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:47.818+0000 7f4fa578f640 1 -- 172.21.15.38:0/1325904599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4fa015a210 con 0x7f4fa0161750 2023-12-22T08:48:48.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.449+0000 7f4f9cff9640 1 -- 172.21.15.38:0/1325904599 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4fa015a210 con 0x7f4fa0161750 2023-12-22T08:48:48.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.452+0000 7f4fa578f640 1 -- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4f8c06a430 msgr2=0x7f4f8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:48.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.452+0000 7f4fa578f640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4f8c06a430 0x7f4f8c06c8f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4f900074a0 tx=0x7f4f9000b040 comp rx=0 tx=0).stop 2023-12-22T08:48:48.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.452+0000 7f4fa578f640 1 -- 172.21.15.38:0/1325904599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fa0161750 msgr2=0x7f4fa015aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:48.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.452+0000 7f4fa578f640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fa0161750 0x7f4fa015aa30 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f4f98034040 tx=0x7f4f980046c0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.453+0000 7f4fa578f640 1 -- 172.21.15.38:0/1325904599 shutdown_connections 2023-12-22T08:48:48.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.453+0000 7f4fa578f640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4f8c06a430 0x7f4f8c06c8f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.453+0000 7f4fa578f640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fa0161750 0x7f4fa015aa30 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.453+0000 7f4fa578f640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fa00a35a0 0x7f4fa015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.453+0000 7f4fa578f640 1 --2- 172.21.15.38:0/1325904599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fa0071d80 0x7f4fa0153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.453+0000 7f4fa578f640 1 -- 172.21.15.38:0/1325904599 >> 172.21.15.38:0/1325904599 conn(0x7f4fa00cf000 msgr2=0x7f4fa00cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:48.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.453+0000 7f4fa578f640 1 -- 172.21.15.38:0/1325904599 shutdown_connections 2023-12-22T08:48:48.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.453+0000 7f4fa578f640 1 -- 172.21.15.38:0/1325904599 wait complete. 2023-12-22T08:48:48.476 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T08:48:48.476 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:48:48.541 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:48:48.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:48:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.699+0000 7fe387010640 1 Processor -- start 2023-12-22T08:48:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.699+0000 7fe387010640 1 -- start start 2023-12-22T08:48:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.700+0000 7fe387010640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe380144d10 0x7fe3800cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.700+0000 7fe387010640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe3800b2760 0x7fe380070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.700+0000 7fe387010640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3801450f0 con 0x7fe3800cc670 2023-12-22T08:48:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.700+0000 7fe387010640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3800ce010 con 0x7fe3800b2760 2023-12-22T08:48:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.700+0000 7fe387010640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800ce2f0 con 0x7fe380144d10 2023-12-22T08:48:48.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.701+0000 7fe3855ad640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe3800b2760 0x7fe380070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:48.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.701+0000 7fe37ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe3800cc670 0x7fe3800b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45860/0 (socket says 172.21.15.38:45860) 2023-12-22T08:48:48.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.701+0000 7fe37ffff640 1 -- 172.21.15.38:0/699588075 learned_addr learned my addr 172.21.15.38:0/699588075 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:48.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.701+0000 7fe384dac640 1 --2- 172.21.15.38:0/699588075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe380144d10 0x7fe3800cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:48.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.702+0000 7fe37f7fe640 1 -- 172.21.15.38:0/699588075 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429449305 0 0) 0x7fe3801450f0 con 0x7fe3800cc670 2023-12-22T08:48:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.702+0000 7fe37f7fe640 1 -- 172.21.15.38:0/699588075 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe370003520 con 0x7fe3800cc670 2023-12-22T08:48:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.702+0000 7fe3855ad640 1 -- 172.21.15.38:0/699588075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe380144d10 msgr2=0x7fe3800cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.702+0000 7fe3855ad640 1 --2- 172.21.15.38:0/699588075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe380144d10 0x7fe3800cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.702+0000 7fe3855ad640 1 -- 172.21.15.38:0/699588075 >> v1:172.21.15.38:6789/0 conn(0x7fe3800cc670 legacy=0x7fe3800b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.702+0000 7fe3855ad640 1 -- 172.21.15.38:0/699588075 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3800ce5d0 con 0x7fe3800b2760 2023-12-22T08:48:48.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.703+0000 7fe3855ad640 1 --2- 172.21.15.38:0/699588075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3800b2760 0x7fe380070800 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe378009d90 tx=0x7fe37802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b46364430398f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:48.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.703+0000 7fe37f7fe640 1 -- 172.21.15.38:0/699588075 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37802cc50 con 0x7fe3800b2760 2023-12-22T08:48:48.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.704+0000 7fe37f7fe640 1 -- 172.21.15.38:0/699588075 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37802cdb0 con 0x7fe3800b2760 2023-12-22T08:48:48.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.704+0000 7fe37f7fe640 1 -- 172.21.15.38:0/699588075 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378034640 con 0x7fe3800b2760 2023-12-22T08:48:48.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.704+0000 7fe387010640 1 -- 172.21.15.38:0/699588075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3800b2760 msgr2=0x7fe380070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:48.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.704+0000 7fe387010640 1 --2- 172.21.15.38:0/699588075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3800b2760 0x7fe380070800 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe378009d90 tx=0x7fe37802bea0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.704+0000 7fe387010640 1 -- 172.21.15.38:0/699588075 shutdown_connections 2023-12-22T08:48:48.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.704+0000 7fe387010640 1 --2- 172.21.15.38:0/699588075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3800b2760 0x7fe380070800 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.704+0000 7fe387010640 1 --2- 172.21.15.38:0/699588075 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe380144d10 0x7fe3800cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.704+0000 7fe387010640 1 -- 172.21.15.38:0/699588075 >> 172.21.15.38:0/699588075 conn(0x7fe3800cf070 msgr2=0x7fe3800cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:48.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.704+0000 7fe387010640 1 -- 172.21.15.38:0/699588075 shutdown_connections 2023-12-22T08:48:48.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.704+0000 7fe387010640 1 -- 172.21.15.38:0/699588075 wait complete. 2023-12-22T08:48:48.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.706+0000 7fe387010640 1 Processor -- start 2023-12-22T08:48:48.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.706+0000 7fe387010640 1 -- start start 2023-12-22T08:48:48.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.707+0000 7fe387010640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3800b2760 0x7fe38013f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:48.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.707+0000 7fe387010640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe380144d10 0x7fe3800ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:48.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.707+0000 7fe387010640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe38006d1e0 0x7fe38006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:48.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.707+0000 7fe387010640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38006dbd0 con 0x7fe380144d10 2023-12-22T08:48:48.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.707+0000 7fe387010640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38015de10 con 0x7fe38006d1e0 2023-12-22T08:48:48.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.707+0000 7fe387010640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38015f3a0 con 0x7fe3800b2760 2023-12-22T08:48:48.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.708+0000 7fe37ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe380144d10 0x7fe3800ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:48.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.708+0000 7fe37ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe380144d10 0x7fe3800ade90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34940/0 (socket says 172.21.15.38:34940) 2023-12-22T08:48:48.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.708+0000 7fe37ffff640 1 -- 172.21.15.38:0/2682942191 learned_addr learned my addr 172.21.15.38:0/2682942191 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:48.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.708+0000 7fe3855ad640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe38006d1e0 0x7fe38006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:48.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.708+0000 7fe384dac640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3800b2760 0x7fe38013f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:48.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.708+0000 7fe37ffff640 1 -- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3800b2760 msgr2=0x7fe38013f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:48.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.708+0000 7fe37ffff640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3800b2760 0x7fe38013f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.708+0000 7fe37ffff640 1 -- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe38006d1e0 msgr2=0x7fe38006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:48.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.708+0000 7fe37ffff640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe38006d1e0 0x7fe38006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.708+0000 7fe37ffff640 1 -- 172.21.15.38:0/2682942191 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378009a70 con 0x7fe380144d10 2023-12-22T08:48:48.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.708+0000 7fe37ffff640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe380144d10 0x7fe3800ade90 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00c4d0 tx=0x7fe36c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:48.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.709+0000 7fe37d7fa640 1 -- 172.21.15.38:0/2682942191 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c005ce0 con 0x7fe380144d10 2023-12-22T08:48:48.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.709+0000 7fe37d7fa640 1 -- 172.21.15.38:0/2682942191 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c005e40 con 0x7fe380144d10 2023-12-22T08:48:48.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.709+0000 7fe37d7fa640 1 -- 172.21.15.38:0/2682942191 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c007270 con 0x7fe380144d10 2023-12-22T08:48:48.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.709+0000 7fe387010640 1 -- 172.21.15.38:0/2682942191 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38015f680 con 0x7fe380144d10 2023-12-22T08:48:48.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.709+0000 7fe387010640 1 -- 172.21.15.38:0/2682942191 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38015fc40 con 0x7fe380144d10 2023-12-22T08:48:48.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.710+0000 7fe387010640 1 -- 172.21.15.38:0/2682942191 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3801e4ef0 con 0x7fe380144d10 2023-12-22T08:48:48.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.711+0000 7fe37d7fa640 1 -- 172.21.15.38:0/2682942191 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe36c0073d0 con 0x7fe380144d10 2023-12-22T08:48:48.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.712+0000 7fe37d7fa640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe36406a460 0x7fe36406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:48.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.712+0000 7fe37d7fa640 1 -- 172.21.15.38:0/2682942191 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe36c087d90 con 0x7fe380144d10 2023-12-22T08:48:48.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.713+0000 7fe384dac640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe36406a460 0x7fe36406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:48.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.714+0000 7fe384dac640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe36406a460 0x7fe36406c920 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe374009a10 tx=0x7fe374008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:48.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.717+0000 7fe37d7fa640 1 -- 172.21.15.38:0/2682942191 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe3801e4ef0 con 0x7fe380144d10 2023-12-22T08:48:48.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.950+0000 7fe387010640 1 -- 172.21.15.38:0/2682942191 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3801e4ef0 con 0x7fe380144d10 2023-12-22T08:48:48.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.951+0000 7fe37d7fa640 1 -- 172.21.15.38:0/2682942191 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4641 (secure 0 0 0) 0x7fe36c017090 con 0x7fe380144d10 2023-12-22T08:48:48.952 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:48.952 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/52711154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":52711154},{"type":"v1","addr":"172.21.15.89:6837","nonce":52711154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2264719173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2264719173},{"type":"v1","addr":"172.21.15.38:6835","nonce":2264719173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3546762659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3546762659},{"type":"v1","addr":"172.21.15.89:6836","nonce":3546762659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:48:44.902723+0000","modified":"2023-12-22T08:48:48.440490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8148":{"gid":8148,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/885304998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":885304998},{"type":"v1","addr":"172.21.15.38:6833","nonce":885304998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-22T08:48:48.952 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 70 2023-12-22T08:48:48.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.953+0000 7fe387010640 1 -- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe36406a460 msgr2=0x7fe36406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:48.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.953+0000 7fe387010640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe36406a460 0x7fe36406c920 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe374009a10 tx=0x7fe374008040 comp rx=0 tx=0).stop 2023-12-22T08:48:48.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.953+0000 7fe387010640 1 -- 172.21.15.38:0/2682942191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe380144d10 msgr2=0x7fe3800ade90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:48.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.953+0000 7fe387010640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe380144d10 0x7fe3800ade90 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00c4d0 tx=0x7fe36c00c990 comp rx=0 tx=0).stop 2023-12-22T08:48:48.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.953+0000 7fe387010640 1 -- 172.21.15.38:0/2682942191 shutdown_connections 2023-12-22T08:48:48.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.953+0000 7fe387010640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe38006d1e0 0x7fe38006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.953+0000 7fe387010640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe36406a460 0x7fe36406c920 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.953+0000 7fe387010640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe380144d10 0x7fe3800ade90 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.953+0000 7fe387010640 1 --2- 172.21.15.38:0/2682942191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3800b2760 0x7fe38013f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:48.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.954+0000 7fe387010640 1 -- 172.21.15.38:0/2682942191 >> 172.21.15.38:0/2682942191 conn(0x7fe3800cf070 msgr2=0x7fe38015a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:48.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.954+0000 7fe387010640 1 -- 172.21.15.38:0/2682942191 shutdown_connections 2023-12-22T08:48:48.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:48.954+0000 7fe387010640 1 -- 172.21.15.38:0/2682942191 wait complete. 2023-12-22T08:48:48.974 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:48:49.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.253+0000 7fd252268640 1 Processor -- start 2023-12-22T08:48:49.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.253+0000 7fd252268640 1 -- start start 2023-12-22T08:48:49.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.255+0000 7fd252268640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd24c06d210 0x7fd24c15e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.255+0000 7fd252268640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24c06d5f0 0x7fd24c070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.255+0000 7fd252268640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c0706d0 con 0x7fd24c0cb4c0 2023-12-22T08:48:49.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.255+0000 7fd252268640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c0cbf40 con 0x7fd24c06d210 2023-12-22T08:48:49.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.255+0000 7fd252268640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0ce840 con 0x7fd24c06d5f0 2023-12-22T08:48:49.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.255+0000 7fd250a65640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd24c0cb4c0 0x7fd24c159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45874/0 (socket says 172.21.15.38:45874) 2023-12-22T08:48:49.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.255+0000 7fd250a65640 1 -- 172.21.15.38:0/37536602 learned_addr learned my addr 172.21.15.38:0/37536602 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:49.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.256+0000 7fd251266640 1 --2- 172.21.15.38:0/37536602 >> v2:172.21.15.89:3300/0 conn(0x7fd24c06d210 0x7fd24c15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.256+0000 7fd251a67640 1 --2- 172.21.15.38:0/37536602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24c06d5f0 0x7fd24c070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.256+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083734585 0 0) 0x7fd24c0706d0 con 0x7fd24c0cb4c0 2023-12-22T08:48:49.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.256+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd238003520 con 0x7fd24c0cb4c0 2023-12-22T08:48:49.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.256+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4274197645 0 0) 0x7fd238003520 con 0x7fd24c0cb4c0 2023-12-22T08:48:49.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.256+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24c06d5f0 msgr2=0x7fd24c070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:49.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.256+0000 7fd243fff640 1 --2- 172.21.15.38:0/37536602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24c06d5f0 0x7fd24c070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.256+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 >> v2:172.21.15.89:3300/0 conn(0x7fd24c06d210 msgr2=0x7fd24c15e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:49.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.256+0000 7fd243fff640 1 --2- 172.21.15.38:0/37536602 >> v2:172.21.15.89:3300/0 conn(0x7fd24c06d210 0x7fd24c15e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.256+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0ceb20 con 0x7fd24c0cb4c0 2023-12-22T08:48:49.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.256+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fd23c001670 con 0x7fd24c0cb4c0 2023-12-22T08:48:49.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 >> v1:172.21.15.38:6789/0 conn(0x7fd24c0cb4c0 legacy=0x7fd24c159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:49.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd243fff640 1 --2- 172.21.15.38:0/37536602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238003970 0x7fd238003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd243fff640 1 --2- 172.21.15.38:0/37536602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2380047c0 0x7fd238004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd243fff640 1 --2- 172.21.15.38:0/37536602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24c06d5f0 0x7fd238005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0cbf40 con 0x7fd2380047c0 2023-12-22T08:48:49.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0ce840 con 0x7fd238003970 2023-12-22T08:48:49.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23800b980 con 0x7fd24c06d5f0 2023-12-22T08:48:49.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd250a65640 1 --2- 172.21.15.38:0/37536602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2380047c0 0x7fd238004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd251266640 1 --2- 172.21.15.38:0/37536602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238003970 0x7fd238003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd250a65640 1 -- 172.21.15.38:0/37536602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24c06d5f0 msgr2=0x7fd238005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd250a65640 1 --2- 172.21.15.38:0/37536602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24c06d5f0 0x7fd238005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd250a65640 1 -- 172.21.15.38:0/37536602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238003970 msgr2=0x7fd238003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd250a65640 1 --2- 172.21.15.38:0/37536602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd238003970 0x7fd238003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.257+0000 7fd250a65640 1 -- 172.21.15.38:0/37536602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd238003520 con 0x7fd2380047c0 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.258+0000 7fd250a65640 1 --2- 172.21.15.38:0/37536602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2380047c0 0x7fd238004c40 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c240 tx=0x7fd2380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405dfae8b290c954 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.259+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c02cb00 con 0x7fd2380047c0 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.259+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c02cc60 con 0x7fd2380047c0 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.259+0000 7fd243fff640 1 -- 172.21.15.38:0/37536602 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c005af0 con 0x7fd2380047c0 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.259+0000 7fd252268640 1 -- 172.21.15.38:0/37536602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2380047c0 msgr2=0x7fd238004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.259+0000 7fd252268640 1 --2- 172.21.15.38:0/37536602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2380047c0 0x7fd238004c40 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c240 tx=0x7fd2380057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.259+0000 7fd251a67640 1 -- 172.21.15.38:0/37536602 reap_dead start 2023-12-22T08:48:49.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.259+0000 7fd252268640 1 -- 172.21.15.38:0/37536602 shutdown_connections 2023-12-22T08:48:49.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.259+0000 7fd252268640 1 -- 172.21.15.38:0/37536602 >> 172.21.15.38:0/37536602 conn(0x7fd24c0b1f70 msgr2=0x7fd24c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:49.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.259+0000 7fd252268640 1 -- 172.21.15.38:0/37536602 shutdown_connections 2023-12-22T08:48:49.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.259+0000 7fd252268640 1 -- 172.21.15.38:0/37536602 wait complete. 2023-12-22T08:48:49.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.261+0000 7fd252268640 1 Processor -- start 2023-12-22T08:48:49.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.261+0000 7fd252268640 1 -- start start 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.262+0000 7fd252268640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2380047c0 0x7fd24c0a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.262+0000 7fd252268640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24c149620 0x7fd24c0a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.262+0000 7fd252268640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24c06f9d0 0x7fd24c06fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.262+0000 7fd252268640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c070390 con 0x7fd24c149620 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.262+0000 7fd252268640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0a31c0 con 0x7fd2380047c0 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.262+0000 7fd252268640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0a2330 con 0x7fd24c06f9d0 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.263+0000 7fd250a65640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24c149620 0x7fd24c0a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.263+0000 7fd250a65640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24c149620 0x7fd24c0a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34956/0 (socket says 172.21.15.38:34956) 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.263+0000 7fd250a65640 1 -- 172.21.15.38:0/905610469 learned_addr learned my addr 172.21.15.38:0/905610469 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.263+0000 7fd251a67640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24c06f9d0 0x7fd24c06fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.263+0000 7fd251266640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2380047c0 0x7fd24c0a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.263+0000 7fd250a65640 1 -- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24c06f9d0 msgr2=0x7fd24c06fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.263+0000 7fd250a65640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24c06f9d0 0x7fd24c06fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.263+0000 7fd250a65640 1 -- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2380047c0 msgr2=0x7fd24c0a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:49.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.263+0000 7fd250a65640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2380047c0 0x7fd24c0a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.263+0000 7fd250a65640 1 -- 172.21.15.38:0/905610469 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0a3650 con 0x7fd24c149620 2023-12-22T08:48:49.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.264+0000 7fd250a65640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24c149620 0x7fd24c0a1df0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c240 tx=0x7fd23c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:49.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.264+0000 7fd241ffb640 1 -- 172.21.15.38:0/905610469 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c039070 con 0x7fd24c149620 2023-12-22T08:48:49.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.264+0000 7fd241ffb640 1 -- 172.21.15.38:0/905610469 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c001630 con 0x7fd24c149620 2023-12-22T08:48:49.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.264+0000 7fd241ffb640 1 -- 172.21.15.38:0/905610469 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c03c040 con 0x7fd24c149620 2023-12-22T08:48:49.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.264+0000 7fd252268640 1 -- 172.21.15.38:0/905610469 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c0a25b0 con 0x7fd24c149620 2023-12-22T08:48:49.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.264+0000 7fd252268640 1 -- 172.21.15.38:0/905610469 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c0a2b70 con 0x7fd24c149620 2023-12-22T08:48:49.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.265+0000 7fd252268640 1 -- 172.21.15.38:0/905610469 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24c0a3350 con 0x7fd24c149620 2023-12-22T08:48:49.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.266+0000 7fd241ffb640 1 -- 172.21.15.38:0/905610469 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd23c032070 con 0x7fd24c149620 2023-12-22T08:48:49.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.267+0000 7fd241ffb640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd23006a430 0x7fd23006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.267+0000 7fd241ffb640 1 -- 172.21.15.38:0/905610469 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd23c0a9fd0 con 0x7fd24c149620 2023-12-22T08:48:49.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.268+0000 7fd251266640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd23006a430 0x7fd23006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.269+0000 7fd251266640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd23006a430 0x7fd23006c8f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd248003a50 tx=0x7fd24800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:49.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.271+0000 7fd241ffb640 1 -- 172.21.15.38:0/905610469 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd23c0756d0 con 0x7fd24c149620 2023-12-22T08:48:49.363 INFO:tasks.ceph.mds.a.smithi038.stderr:2023-12-22T08:48:49.362+0000 7f986d94f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:48:49.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.466+0000 7fd252268640 1 -- 172.21.15.38:0/905610469 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd24c061910 con 0x7fd24c149620 2023-12-22T08:48:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.469+0000 7fd241ffb640 1 -- 172.21.15.38:0/905610469 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+16012 (secure 0 0 0) 0x7fd23c046020 con 0x7fd24c149620 2023-12-22T08:48:49.470 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:49.471 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":158,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:48:45.906511+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:48:42.499151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-22T08:48:43.921718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:48:49.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.472+0000 7fd252268640 1 -- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd23006a430 msgr2=0x7fd23006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.472+0000 7fd252268640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd23006a430 0x7fd23006c8f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd248003a50 tx=0x7fd24800b040 comp rx=0 tx=0).stop 2023-12-22T08:48:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.472+0000 7fd252268640 1 -- 172.21.15.38:0/905610469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24c149620 msgr2=0x7fd24c0a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.472+0000 7fd252268640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24c149620 0x7fd24c0a1df0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c240 tx=0x7fd23c001a00 comp rx=0 tx=0).stop 2023-12-22T08:48:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.472+0000 7fd252268640 1 -- 172.21.15.38:0/905610469 shutdown_connections 2023-12-22T08:48:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.472+0000 7fd252268640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd24c06f9d0 0x7fd24c06fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.472+0000 7fd252268640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd23006a430 0x7fd23006c8f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.472+0000 7fd252268640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24c149620 0x7fd24c0a1df0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.472+0000 7fd252268640 1 --2- 172.21.15.38:0/905610469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2380047c0 0x7fd24c0a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.472+0000 7fd252268640 1 -- 172.21.15.38:0/905610469 >> 172.21.15.38:0/905610469 conn(0x7fd24c0b1f70 msgr2=0x7fd24c09de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.472+0000 7fd252268640 1 -- 172.21.15.38:0/905610469 shutdown_connections 2023-12-22T08:48:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.472+0000 7fd252268640 1 -- 172.21.15.38:0/905610469 wait complete. 2023-12-22T08:48:49.491 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T08:48:49.491 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:48:49.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.712+0000 7f462ae34640 1 Processor -- start 2023-12-22T08:48:49.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.712+0000 7f462ae34640 1 -- start start 2023-12-22T08:48:49.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.714+0000 7f462ae34640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f462415b420 0x7f462406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.714+0000 7f462ae34640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f46240a44a0 0x7f46240708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.714+0000 7f462ae34640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46240cdae0 con 0x7f4624070e30 2023-12-22T08:48:49.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.714+0000 7f462ae34640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4624071260 con 0x7f46240a44a0 2023-12-22T08:48:49.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.714+0000 7f462ae34640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462406dec0 con 0x7f462415b420 2023-12-22T08:48:49.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.714+0000 7f462a633640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4624070e30 0x7f462406f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45888/0 (socket says 172.21.15.38:45888) 2023-12-22T08:48:49.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.714+0000 7f462a633640 1 -- 172.21.15.38:0/751029629 learned_addr learned my addr 172.21.15.38:0/751029629 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:49.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.714+0000 7f4629e32640 1 --2- 172.21.15.38:0/751029629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f462415b420 0x7f462406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4629631640 1 --2- 172.21.15.38:0/751029629 >> v2:172.21.15.89:3300/0 conn(0x7f46240a44a0 0x7f46240708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970490857 0 0) 0x7f46240cdae0 con 0x7f4624070e30 2023-12-22T08:48:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4610003520 con 0x7f4624070e30 2023-12-22T08:48:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2046583541 0 0) 0x7f4610003520 con 0x7f4624070e30 2023-12-22T08:48:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f462415b420 msgr2=0x7f462406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 --2- 172.21.15.38:0/751029629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f462415b420 0x7f462406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 >> v2:172.21.15.89:3300/0 conn(0x7f46240a44a0 msgr2=0x7f46240708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 --2- 172.21.15.38:0/751029629 >> v2:172.21.15.89:3300/0 conn(0x7f46240a44a0 0x7f46240708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462415b800 con 0x7f4624070e30 2023-12-22T08:48:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f461c0019f0 con 0x7f4624070e30 2023-12-22T08:48:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 >> v1:172.21.15.38:6789/0 conn(0x7f4624070e30 legacy=0x7f462406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 --2- 172.21.15.38:0/751029629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f462415b420 0x7f4610003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 --2- 172.21.15.38:0/751029629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4610003ef0 0x7f46100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 --2- 172.21.15.38:0/751029629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4610004d00 0x7f4610005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4624071260 con 0x7f4610004d00 2023-12-22T08:48:49.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462406dec0 con 0x7f4610003ef0 2023-12-22T08:48:49.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.715+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461000b980 con 0x7f462415b420 2023-12-22T08:48:49.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.716+0000 7f462a633640 1 --2- 172.21.15.38:0/751029629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4610004d00 0x7f4610005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.716+0000 7f4629631640 1 --2- 172.21.15.38:0/751029629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4610003ef0 0x7f46100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.716+0000 7f4629e32640 1 --2- 172.21.15.38:0/751029629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f462415b420 0x7f4610003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.716+0000 7f462a633640 1 -- 172.21.15.38:0/751029629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f462415b420 msgr2=0x7f4610003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:49.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.716+0000 7f462a633640 1 --2- 172.21.15.38:0/751029629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f462415b420 0x7f4610003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.716+0000 7f462a633640 1 -- 172.21.15.38:0/751029629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4610003ef0 msgr2=0x7f46100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:49.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.716+0000 7f462a633640 1 --2- 172.21.15.38:0/751029629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4610003ef0 0x7f46100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.716+0000 7f462a633640 1 -- 172.21.15.38:0/751029629 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4610003520 con 0x7f4610004d00 2023-12-22T08:48:49.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.716+0000 7f4629e32640 1 --2- 172.21.15.38:0/751029629 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f462415b420 0x7f4610003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:49.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.717+0000 7f462a633640 1 --2- 172.21.15.38:0/751029629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4610004d00 0x7f4610005180 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f461c00a860 tx=0x7f46100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d333f336227c58bd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:49.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.717+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c034630 con 0x7f4610004d00 2023-12-22T08:48:49.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.718+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c02f070 con 0x7f4610004d00 2023-12-22T08:48:49.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.718+0000 7f4628e30640 1 -- 172.21.15.38:0/751029629 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c034a30 con 0x7f4610004d00 2023-12-22T08:48:49.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.718+0000 7f462ae34640 1 -- 172.21.15.38:0/751029629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4610004d00 msgr2=0x7f4610005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:49.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.718+0000 7f462ae34640 1 --2- 172.21.15.38:0/751029629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4610004d00 0x7f4610005180 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f461c00a860 tx=0x7f46100057f0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.718+0000 7f462a633640 1 -- 172.21.15.38:0/751029629 reap_dead start 2023-12-22T08:48:49.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.718+0000 7f462ae34640 1 -- 172.21.15.38:0/751029629 shutdown_connections 2023-12-22T08:48:49.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.718+0000 7f462ae34640 1 -- 172.21.15.38:0/751029629 >> 172.21.15.38:0/751029629 conn(0x7f46240b1f70 msgr2=0x7f46240b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:49.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.718+0000 7f462ae34640 1 -- 172.21.15.38:0/751029629 shutdown_connections 2023-12-22T08:48:49.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.718+0000 7f462ae34640 1 -- 172.21.15.38:0/751029629 wait complete. 2023-12-22T08:48:49.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.720+0000 7f462ae34640 1 Processor -- start 2023-12-22T08:48:49.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.720+0000 7f462ae34640 1 -- start start 2023-12-22T08:48:49.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.721+0000 7f462ae34640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4610004d00 0x7f462414f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.721+0000 7f462ae34640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f462415d230 0x7f46241f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.721+0000 7f462ae34640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f462415d670 0x7f4624150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.721+0000 7f462ae34640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46241f28c0 con 0x7f462415d230 2023-12-22T08:48:49.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.721+0000 7f462ae34640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46241f2ba0 con 0x7f462415d670 2023-12-22T08:48:49.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.721+0000 7f462ae34640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462414edc0 con 0x7f4610004d00 2023-12-22T08:48:49.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.721+0000 7f4629631640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f462415d230 0x7f46241f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.722+0000 7f4629631640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f462415d230 0x7f46241f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34972/0 (socket says 172.21.15.38:34972) 2023-12-22T08:48:49.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.722+0000 7f4629631640 1 -- 172.21.15.38:0/2716415081 learned_addr learned my addr 172.21.15.38:0/2716415081 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:49.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.722+0000 7f462a633640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f462415d670 0x7f4624150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.722+0000 7f4629e32640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4610004d00 0x7f462414f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.722+0000 7f4629631640 1 -- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4610004d00 msgr2=0x7f462414f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:49.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.722+0000 7f4629631640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4610004d00 0x7f462414f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.722+0000 7f4629631640 1 -- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f462415d670 msgr2=0x7f4624150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:49.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.722+0000 7f4629631640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f462415d670 0x7f4624150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.722+0000 7f4629631640 1 -- 172.21.15.38:0/2716415081 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462414f0a0 con 0x7f462415d230 2023-12-22T08:48:49.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.722+0000 7f4629631640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f462415d230 0x7f46241f1e40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f4614011600 tx=0x7f4614011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:49.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.723+0000 7f461a7fc640 1 -- 172.21.15.38:0/2716415081 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461400f920 con 0x7f462415d230 2023-12-22T08:48:49.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.723+0000 7f461a7fc640 1 -- 172.21.15.38:0/2716415081 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461400fa80 con 0x7f462415d230 2023-12-22T08:48:49.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.723+0000 7f461a7fc640 1 -- 172.21.15.38:0/2716415081 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461400fdf0 con 0x7f462415d230 2023-12-22T08:48:49.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.723+0000 7f462ae34640 1 -- 172.21.15.38:0/2716415081 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462414f380 con 0x7f462415d230 2023-12-22T08:48:49.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.723+0000 7f462ae34640 1 -- 172.21.15.38:0/2716415081 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46241f2380 con 0x7f462415d230 2023-12-22T08:48:49.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.724+0000 7f462ae34640 1 -- 172.21.15.38:0/2716415081 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4624061910 con 0x7f462415d230 2023-12-22T08:48:49.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.725+0000 7f461a7fc640 1 -- 172.21.15.38:0/2716415081 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4614015460 con 0x7f462415d230 2023-12-22T08:48:49.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.726+0000 7f461a7fc640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f460806a430 0x7f460806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:49.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.726+0000 7f461a7fc640 1 -- 172.21.15.38:0/2716415081 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4614088f10 con 0x7f462415d230 2023-12-22T08:48:49.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.727+0000 7f4629e32640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f460806a430 0x7f460806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:49.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.728+0000 7f4629e32640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f460806a430 0x7f460806c8f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f46200099c0 tx=0x7f4620008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:49.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.731+0000 7f461a7fc640 1 -- 172.21.15.38:0/2716415081 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4614054460 con 0x7f462415d230 2023-12-22T08:48:49.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.919+0000 7f462ae34640 1 -- 172.21.15.38:0/2716415081 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46240ce010 con 0x7f460806a430 2023-12-22T08:48:49.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.942+0000 7f461a7fc640 1 -- 172.21.15.38:0/2716415081 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283276 (secure 0 0 0) 0x7f46200118e0 con 0x7f460806a430 2023-12-22T08:48:49.948 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:49.949 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:48:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.949+0000 7f462ae34640 1 -- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f460806a430 msgr2=0x7f460806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.949+0000 7f462ae34640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f460806a430 0x7f460806c8f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f46200099c0 tx=0x7f4620008040 comp rx=0 tx=0).stop 2023-12-22T08:48:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.949+0000 7f462ae34640 1 -- 172.21.15.38:0/2716415081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f462415d230 msgr2=0x7f46241f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.949+0000 7f462ae34640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f462415d230 0x7f46241f1e40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f4614011600 tx=0x7f4614011ac0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.949+0000 7f462ae34640 1 -- 172.21.15.38:0/2716415081 shutdown_connections 2023-12-22T08:48:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.949+0000 7f462ae34640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f462415d670 0x7f4624150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.949+0000 7f462ae34640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f460806a430 0x7f460806c8f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.949+0000 7f462ae34640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f462415d230 0x7f46241f1e40 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.949+0000 7f462ae34640 1 --2- 172.21.15.38:0/2716415081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4610004d00 0x7f462414f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:49.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.949+0000 7f462ae34640 1 -- 172.21.15.38:0/2716415081 >> 172.21.15.38:0/2716415081 conn(0x7f46240b1f70 msgr2=0x7f462415c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:49.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.949+0000 7f462ae34640 1 -- 172.21.15.38:0/2716415081 shutdown_connections 2023-12-22T08:48:49.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:49.949+0000 7f462ae34640 1 -- 172.21.15.38:0/2716415081 wait complete. 2023-12-22T08:48:49.971 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":420,"stamp":"2023-12-22T08:48:48.549341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8042,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554457,"statfs":{"total":1600000000,"available":1591764983,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.166151"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424664+0000","last_change":"2023-12-22T08:48:44.931786+0000","last_active":"2023-12-22T08:48:46.424664+0000","last_peered":"2023-12-22T08:48:46.424664+0000","last_clean":"2023-12-22T08:48:46.424664+0000","last_became_active":"2023-12-22T08:48:44.931467+0000","last_became_peered":"2023-12-22T08:48:44.931467+0000","last_unstale":"2023-12-22T08:48:46.424664+0000","last_undegraded":"2023-12-22T08:48:46.424664+0000","last_fullsized":"2023-12-22T08:48:46.424664+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:25:17.766760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424347+0000","last_change":"2023-12-22T08:48:44.940861+0000","last_active":"2023-12-22T08:48:46.424347+0000","last_peered":"2023-12-22T08:48:46.424347+0000","last_clean":"2023-12-22T08:48:46.424347+0000","last_became_active":"2023-12-22T08:48:44.938008+0000","last_became_peered":"2023-12-22T08:48:44.938008+0000","last_unstale":"2023-12-22T08:48:46.424347+0000","last_undegraded":"2023-12-22T08:48:46.424347+0000","last_fullsized":"2023-12-22T08:48:46.424347+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:09:39.721906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916938+0000","last_change":"2023-12-22T08:48:44.930309+0000","last_active":"2023-12-22T08:48:45.916938+0000","last_peered":"2023-12-22T08:48:45.916938+0000","last_clean":"2023-12-22T08:48:45.916938+0000","last_became_active":"2023-12-22T08:48:44.929930+0000","last_became_peered":"2023-12-22T08:48:44.929930+0000","last_unstale":"2023-12-22T08:48:45.916938+0000","last_undegraded":"2023-12-22T08:48:45.916938+0000","last_fullsized":"2023-12-22T08:48:45.916938+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:06:16.584659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526633+0000","last_change":"2023-12-22T08:48:44.933183+0000","last_active":"2023-12-22T08:48:46.526633+0000","last_peered":"2023-12-22T08:48:46.526633+0000","last_clean":"2023-12-22T08:48:46.526633+0000","last_became_active":"2023-12-22T08:48:44.932452+0000","last_became_peered":"2023-12-22T08:48:44.932452+0000","last_unstale":"2023-12-22T08:48:46.526633+0000","last_undegraded":"2023-12-22T08:48:46.526633+0000","last_fullsized":"2023-12-22T08:48:46.526633+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:34:54.478829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527333+0000","last_change":"2023-12-22T08:48:44.923093+0000","last_active":"2023-12-22T08:48:46.527333+0000","last_peered":"2023-12-22T08:48:46.527333+0000","last_clean":"2023-12-22T08:48:46.527333+0000","last_became_active":"2023-12-22T08:48:44.922833+0000","last_became_peered":"2023-12-22T08:48:44.922833+0000","last_unstale":"2023-12-22T08:48:46.527333+0000","last_undegraded":"2023-12-22T08:48:46.527333+0000","last_fullsized":"2023-12-22T08:48:46.527333+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:13.916405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283426+0000","last_change":"2023-12-22T08:48:44.938310+0000","last_active":"2023-12-22T08:48:46.283426+0000","last_peered":"2023-12-22T08:48:46.283426+0000","last_clean":"2023-12-22T08:48:46.283426+0000","last_became_active":"2023-12-22T08:48:44.937481+0000","last_became_peered":"2023-12-22T08:48:44.937481+0000","last_unstale":"2023-12-22T08:48:46.283426+0000","last_undegraded":"2023-12-22T08:48:46.283426+0000","last_fullsized":"2023-12-22T08:48:46.283426+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:37:58.760061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526702+0000","last_change":"2023-12-22T08:48:44.930835+0000","last_active":"2023-12-22T08:48:46.526702+0000","last_peered":"2023-12-22T08:48:46.526702+0000","last_clean":"2023-12-22T08:48:46.526702+0000","last_became_active":"2023-12-22T08:48:44.925715+0000","last_became_peered":"2023-12-22T08:48:44.925715+0000","last_unstale":"2023-12-22T08:48:46.526702+0000","last_undegraded":"2023-12-22T08:48:46.526702+0000","last_fullsized":"2023-12-22T08:48:46.526702+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:54:01.511933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526493+0000","last_change":"2023-12-22T08:48:44.939794+0000","last_active":"2023-12-22T08:48:46.526493+0000","last_peered":"2023-12-22T08:48:46.526493+0000","last_clean":"2023-12-22T08:48:46.526493+0000","last_became_active":"2023-12-22T08:48:44.939583+0000","last_became_peered":"2023-12-22T08:48:44.939583+0000","last_unstale":"2023-12-22T08:48:46.526493+0000","last_undegraded":"2023-12-22T08:48:46.526493+0000","last_fullsized":"2023-12-22T08:48:46.526493+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:22:59.079738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.915942+0000","last_change":"2023-12-22T08:48:44.932007+0000","last_active":"2023-12-22T08:48:45.915942+0000","last_peered":"2023-12-22T08:48:45.915942+0000","last_clean":"2023-12-22T08:48:45.915942+0000","last_became_active":"2023-12-22T08:48:44.931799+0000","last_became_peered":"2023-12-22T08:48:44.931799+0000","last_unstale":"2023-12-22T08:48:45.915942+0000","last_undegraded":"2023-12-22T08:48:45.915942+0000","last_fullsized":"2023-12-22T08:48:45.915942+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:46:07.126570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424569+0000","last_change":"2023-12-22T08:48:44.934780+0000","last_active":"2023-12-22T08:48:46.424569+0000","last_peered":"2023-12-22T08:48:46.424569+0000","last_clean":"2023-12-22T08:48:46.424569+0000","last_became_active":"2023-12-22T08:48:44.933753+0000","last_became_peered":"2023-12-22T08:48:44.933753+0000","last_unstale":"2023-12-22T08:48:46.424569+0000","last_undegraded":"2023-12-22T08:48:46.424569+0000","last_fullsized":"2023-12-22T08:48:46.424569+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:55:25.534573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527149+0000","last_change":"2023-12-22T08:48:44.936295+0000","last_active":"2023-12-22T08:48:46.527149+0000","last_peered":"2023-12-22T08:48:46.527149+0000","last_clean":"2023-12-22T08:48:46.527149+0000","last_became_active":"2023-12-22T08:48:44.935898+0000","last_became_peered":"2023-12-22T08:48:44.935898+0000","last_unstale":"2023-12-22T08:48:46.527149+0000","last_undegraded":"2023-12-22T08:48:46.527149+0000","last_fullsized":"2023-12-22T08:48:46.527149+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:13.916405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283324+0000","last_change":"2023-12-22T08:48:44.933750+0000","last_active":"2023-12-22T08:48:46.283324+0000","last_peered":"2023-12-22T08:48:46.283324+0000","last_clean":"2023-12-22T08:48:46.283324+0000","last_became_active":"2023-12-22T08:48:44.933077+0000","last_became_peered":"2023-12-22T08:48:44.933077+0000","last_unstale":"2023-12-22T08:48:46.283324+0000","last_undegraded":"2023-12-22T08:48:46.283324+0000","last_fullsized":"2023-12-22T08:48:46.283324+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:15.679672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527297+0000","last_change":"2023-12-22T08:48:44.928866+0000","last_active":"2023-12-22T08:48:46.527297+0000","last_peered":"2023-12-22T08:48:46.527297+0000","last_clean":"2023-12-22T08:48:46.527297+0000","last_became_active":"2023-12-22T08:48:44.928563+0000","last_became_peered":"2023-12-22T08:48:44.928563+0000","last_unstale":"2023-12-22T08:48:46.527297+0000","last_undegraded":"2023-12-22T08:48:46.527297+0000","last_fullsized":"2023-12-22T08:48:46.527297+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:09:06.975620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914339+0000","last_change":"2023-12-22T08:48:44.935130+0000","last_active":"2023-12-22T08:48:45.914339+0000","last_peered":"2023-12-22T08:48:45.914339+0000","last_clean":"2023-12-22T08:48:45.914339+0000","last_became_active":"2023-12-22T08:48:44.934852+0000","last_became_peered":"2023-12-22T08:48:44.934852+0000","last_unstale":"2023-12-22T08:48:45.914339+0000","last_undegraded":"2023-12-22T08:48:45.914339+0000","last_fullsized":"2023-12-22T08:48:45.914339+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:35:20.883279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916004+0000","last_change":"2023-12-22T08:48:44.936516+0000","last_active":"2023-12-22T08:48:45.916004+0000","last_peered":"2023-12-22T08:48:45.916004+0000","last_clean":"2023-12-22T08:48:45.916004+0000","last_became_active":"2023-12-22T08:48:44.936244+0000","last_became_peered":"2023-12-22T08:48:44.936244+0000","last_unstale":"2023-12-22T08:48:45.916004+0000","last_undegraded":"2023-12-22T08:48:45.916004+0000","last_fullsized":"2023-12-22T08:48:45.916004+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:10:08.635288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916119+0000","last_change":"2023-12-22T08:48:44.929041+0000","last_active":"2023-12-22T08:48:45.916119+0000","last_peered":"2023-12-22T08:48:45.916119+0000","last_clean":"2023-12-22T08:48:45.916119+0000","last_became_active":"2023-12-22T08:48:44.927935+0000","last_became_peered":"2023-12-22T08:48:44.927935+0000","last_unstale":"2023-12-22T08:48:45.916119+0000","last_undegraded":"2023-12-22T08:48:45.916119+0000","last_fullsized":"2023-12-22T08:48:45.916119+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:03:58.757538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916161+0000","last_change":"2023-12-22T08:48:44.936244+0000","last_active":"2023-12-22T08:48:45.916161+0000","last_peered":"2023-12-22T08:48:45.916161+0000","last_clean":"2023-12-22T08:48:45.916161+0000","last_became_active":"2023-12-22T08:48:44.935964+0000","last_became_peered":"2023-12-22T08:48:44.935964+0000","last_unstale":"2023-12-22T08:48:45.916161+0000","last_undegraded":"2023-12-22T08:48:45.916161+0000","last_fullsized":"2023-12-22T08:48:45.916161+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:09:14.236053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914738+0000","last_change":"2023-12-22T08:48:44.929432+0000","last_active":"2023-12-22T08:48:45.914738+0000","last_peered":"2023-12-22T08:48:45.914738+0000","last_clean":"2023-12-22T08:48:45.914738+0000","last_became_active":"2023-12-22T08:48:44.929145+0000","last_became_peered":"2023-12-22T08:48:44.929145+0000","last_unstale":"2023-12-22T08:48:45.914738+0000","last_undegraded":"2023-12-22T08:48:45.914738+0000","last_fullsized":"2023-12-22T08:48:45.914738+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:23:24.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424444+0000","last_change":"2023-12-22T08:48:44.937565+0000","last_active":"2023-12-22T08:48:46.424444+0000","last_peered":"2023-12-22T08:48:46.424444+0000","last_clean":"2023-12-22T08:48:46.424444+0000","last_became_active":"2023-12-22T08:48:44.936810+0000","last_became_peered":"2023-12-22T08:48:44.936810+0000","last_unstale":"2023-12-22T08:48:46.424444+0000","last_undegraded":"2023-12-22T08:48:46.424444+0000","last_fullsized":"2023-12-22T08:48:46.424444+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:23.665486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916273+0000","last_change":"2023-12-22T08:48:44.940053+0000","last_active":"2023-12-22T08:48:45.916273+0000","last_peered":"2023-12-22T08:48:45.916273+0000","last_clean":"2023-12-22T08:48:45.916273+0000","last_became_active":"2023-12-22T08:48:44.939789+0000","last_became_peered":"2023-12-22T08:48:44.939789+0000","last_unstale":"2023-12-22T08:48:45.916273+0000","last_undegraded":"2023-12-22T08:48:45.916273+0000","last_fullsized":"2023-12-22T08:48:45.916273+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:07:35.009495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283699+0000","last_change":"2023-12-22T08:48:44.924324+0000","last_active":"2023-12-22T08:48:46.283699+0000","last_peered":"2023-12-22T08:48:46.283699+0000","last_clean":"2023-12-22T08:48:46.283699+0000","last_became_active":"2023-12-22T08:48:44.924103+0000","last_became_peered":"2023-12-22T08:48:44.924103+0000","last_unstale":"2023-12-22T08:48:46.283699+0000","last_undegraded":"2023-12-22T08:48:46.283699+0000","last_fullsized":"2023-12-22T08:48:46.283699+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:29:37.390473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424691+0000","last_change":"2023-12-22T08:48:44.941733+0000","last_active":"2023-12-22T08:48:46.424691+0000","last_peered":"2023-12-22T08:48:46.424691+0000","last_clean":"2023-12-22T08:48:46.424691+0000","last_became_active":"2023-12-22T08:48:44.939004+0000","last_became_peered":"2023-12-22T08:48:44.939004+0000","last_unstale":"2023-12-22T08:48:46.424691+0000","last_undegraded":"2023-12-22T08:48:46.424691+0000","last_fullsized":"2023-12-22T08:48:46.424691+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:49:28.091311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527012+0000","last_change":"2023-12-22T08:48:44.940873+0000","last_active":"2023-12-22T08:48:46.527012+0000","last_peered":"2023-12-22T08:48:46.527012+0000","last_clean":"2023-12-22T08:48:46.527012+0000","last_became_active":"2023-12-22T08:48:44.940395+0000","last_became_peered":"2023-12-22T08:48:44.940395+0000","last_unstale":"2023-12-22T08:48:46.527012+0000","last_undegraded":"2023-12-22T08:48:46.527012+0000","last_fullsized":"2023-12-22T08:48:46.527012+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:30:07.721084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914529+0000","last_change":"2023-12-22T08:48:44.937473+0000","last_active":"2023-12-22T08:48:45.914529+0000","last_peered":"2023-12-22T08:48:45.914529+0000","last_clean":"2023-12-22T08:48:45.914529+0000","last_became_active":"2023-12-22T08:48:44.934613+0000","last_became_peered":"2023-12-22T08:48:44.934613+0000","last_unstale":"2023-12-22T08:48:45.914529+0000","last_undegraded":"2023-12-22T08:48:45.914529+0000","last_fullsized":"2023-12-22T08:48:45.914529+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:33.513745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526841+0000","last_change":"2023-12-22T08:48:44.930050+0000","last_active":"2023-12-22T08:48:46.526841+0000","last_peered":"2023-12-22T08:48:46.526841+0000","last_clean":"2023-12-22T08:48:46.526841+0000","last_became_active":"2023-12-22T08:48:44.929798+0000","last_became_peered":"2023-12-22T08:48:44.929798+0000","last_unstale":"2023-12-22T08:48:46.526841+0000","last_undegraded":"2023-12-22T08:48:46.526841+0000","last_fullsized":"2023-12-22T08:48:46.526841+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:04:22.422858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424844+0000","last_change":"2023-12-22T08:48:44.939823+0000","last_active":"2023-12-22T08:48:46.424844+0000","last_peered":"2023-12-22T08:48:46.424844+0000","last_clean":"2023-12-22T08:48:46.424844+0000","last_became_active":"2023-12-22T08:48:44.938380+0000","last_became_peered":"2023-12-22T08:48:44.938380+0000","last_unstale":"2023-12-22T08:48:46.424844+0000","last_undegraded":"2023-12-22T08:48:46.424844+0000","last_fullsized":"2023-12-22T08:48:46.424844+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:04.596606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914502+0000","last_change":"2023-12-22T08:48:44.925010+0000","last_active":"2023-12-22T08:48:45.914502+0000","last_peered":"2023-12-22T08:48:45.914502+0000","last_clean":"2023-12-22T08:48:45.914502+0000","last_became_active":"2023-12-22T08:48:44.924432+0000","last_became_peered":"2023-12-22T08:48:44.924432+0000","last_unstale":"2023-12-22T08:48:45.914502+0000","last_undegraded":"2023-12-22T08:48:45.914502+0000","last_fullsized":"2023-12-22T08:48:45.914502+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:47:42.718315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526611+0000","last_change":"2023-12-22T08:48:44.940710+0000","last_active":"2023-12-22T08:48:46.526611+0000","last_peered":"2023-12-22T08:48:46.526611+0000","last_clean":"2023-12-22T08:48:46.526611+0000","last_became_active":"2023-12-22T08:48:44.939920+0000","last_became_peered":"2023-12-22T08:48:44.939920+0000","last_unstale":"2023-12-22T08:48:46.526611+0000","last_undegraded":"2023-12-22T08:48:46.526611+0000","last_fullsized":"2023-12-22T08:48:46.526611+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:10:08.635288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424198+0000","last_change":"2023-12-22T08:48:44.928381+0000","last_active":"2023-12-22T08:48:46.424198+0000","last_peered":"2023-12-22T08:48:46.424198+0000","last_clean":"2023-12-22T08:48:46.424198+0000","last_became_active":"2023-12-22T08:48:44.927954+0000","last_became_peered":"2023-12-22T08:48:44.927954+0000","last_unstale":"2023-12-22T08:48:46.424198+0000","last_undegraded":"2023-12-22T08:48:46.424198+0000","last_fullsized":"2023-12-22T08:48:46.424198+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:24:40.895405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.425010+0000","last_change":"2023-12-22T08:48:44.936738+0000","last_active":"2023-12-22T08:48:46.425010+0000","last_peered":"2023-12-22T08:48:46.425010+0000","last_clean":"2023-12-22T08:48:46.425010+0000","last_became_active":"2023-12-22T08:48:44.936410+0000","last_became_peered":"2023-12-22T08:48:44.936410+0000","last_unstale":"2023-12-22T08:48:46.425010+0000","last_undegraded":"2023-12-22T08:48:46.425010+0000","last_fullsized":"2023-12-22T08:48:46.425010+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:35:25.020152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527240+0000","last_change":"2023-12-22T08:48:44.935590+0000","last_active":"2023-12-22T08:48:46.527240+0000","last_peered":"2023-12-22T08:48:46.527240+0000","last_clean":"2023-12-22T08:48:46.527240+0000","last_became_active":"2023-12-22T08:48:44.934694+0000","last_became_peered":"2023-12-22T08:48:44.934694+0000","last_unstale":"2023-12-22T08:48:46.527240+0000","last_undegraded":"2023-12-22T08:48:46.527240+0000","last_fullsized":"2023-12-22T08:48:46.527240+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:30:49.812235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.915991+0000","last_change":"2023-12-22T08:48:44.942180+0000","last_active":"2023-12-22T08:48:45.915991+0000","last_peered":"2023-12-22T08:48:45.915991+0000","last_clean":"2023-12-22T08:48:45.915991+0000","last_became_active":"2023-12-22T08:48:44.941825+0000","last_became_peered":"2023-12-22T08:48:44.941825+0000","last_unstale":"2023-12-22T08:48:45.915991+0000","last_undegraded":"2023-12-22T08:48:45.915991+0000","last_fullsized":"2023-12-22T08:48:45.915991+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:41.593242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914592+0000","last_change":"2023-12-22T08:48:44.927900+0000","last_active":"2023-12-22T08:48:45.914592+0000","last_peered":"2023-12-22T08:48:45.914592+0000","last_clean":"2023-12-22T08:48:45.914592+0000","last_became_active":"2023-12-22T08:48:44.927491+0000","last_became_peered":"2023-12-22T08:48:44.927491+0000","last_unstale":"2023-12-22T08:48:45.914592+0000","last_undegraded":"2023-12-22T08:48:45.914592+0000","last_fullsized":"2023-12-22T08:48:45.914592+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:54:01.511933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"157'4","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.941466+0000","last_change":"2023-12-22T08:48:44.412930+0000","last_active":"2023-12-22T08:48:44.941466+0000","last_peered":"2023-12-22T08:48:44.941466+0000","last_clean":"2023-12-22T08:48:44.941466+0000","last_became_active":"2023-12-22T08:48:44.412529+0000","last_became_peered":"2023-12-22T08:48:44.412529+0000","last_unstale":"2023-12-22T08:48:44.941466+0000","last_undegraded":"2023-12-22T08:48:44.941466+0000","last_fullsized":"2023-12-22T08:48:44.941466+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:37:57.747287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.917188+0000","last_change":"2023-12-22T08:48:44.934515+0000","last_active":"2023-12-22T08:48:45.917188+0000","last_peered":"2023-12-22T08:48:45.917188+0000","last_clean":"2023-12-22T08:48:45.917188+0000","last_became_active":"2023-12-22T08:48:44.934232+0000","last_became_peered":"2023-12-22T08:48:44.934232+0000","last_unstale":"2023-12-22T08:48:45.917188+0000","last_undegraded":"2023-12-22T08:48:45.917188+0000","last_fullsized":"2023-12-22T08:48:45.917188+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:41:35.562020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.925354+0000","last_change":"2023-12-22T08:48:44.417585+0000","last_active":"2023-12-22T08:48:44.925354+0000","last_peered":"2023-12-22T08:48:44.925354+0000","last_clean":"2023-12-22T08:48:44.925354+0000","last_became_active":"2023-12-22T08:48:44.417031+0000","last_became_peered":"2023-12-22T08:48:44.417031+0000","last_unstale":"2023-12-22T08:48:44.925354+0000","last_undegraded":"2023-12-22T08:48:44.925354+0000","last_fullsized":"2023-12-22T08:48:44.925354+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:35:24.007378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916002+0000","last_change":"2023-12-22T08:48:44.926853+0000","last_active":"2023-12-22T08:48:45.916002+0000","last_peered":"2023-12-22T08:48:45.916002+0000","last_clean":"2023-12-22T08:48:45.916002+0000","last_became_active":"2023-12-22T08:48:44.926631+0000","last_became_peered":"2023-12-22T08:48:44.926631+0000","last_unstale":"2023-12-22T08:48:45.916002+0000","last_undegraded":"2023-12-22T08:48:45.916002+0000","last_fullsized":"2023-12-22T08:48:45.916002+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:19:30.413025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.935888+0000","last_change":"2023-12-22T08:48:44.410977+0000","last_active":"2023-12-22T08:48:44.935888+0000","last_peered":"2023-12-22T08:48:44.935888+0000","last_clean":"2023-12-22T08:48:44.935888+0000","last_became_active":"2023-12-22T08:48:44.410626+0000","last_became_peered":"2023-12-22T08:48:44.410626+0000","last_unstale":"2023-12-22T08:48:44.935888+0000","last_undegraded":"2023-12-22T08:48:44.935888+0000","last_fullsized":"2023-12-22T08:48:44.935888+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:51:42.413000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.284228+0000","last_change":"2023-12-22T08:48:44.932768+0000","last_active":"2023-12-22T08:48:46.284228+0000","last_peered":"2023-12-22T08:48:46.284228+0000","last_clean":"2023-12-22T08:48:46.284228+0000","last_became_active":"2023-12-22T08:48:44.932538+0000","last_became_peered":"2023-12-22T08:48:44.932538+0000","last_unstale":"2023-12-22T08:48:46.284228+0000","last_undegraded":"2023-12-22T08:48:46.284228+0000","last_fullsized":"2023-12-22T08:48:46.284228+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:51:43.425774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.942542+0000","last_change":"2023-12-22T08:48:44.414108+0000","last_active":"2023-12-22T08:48:44.942542+0000","last_peered":"2023-12-22T08:48:44.942542+0000","last_clean":"2023-12-22T08:48:44.942542+0000","last_became_active":"2023-12-22T08:48:44.413144+0000","last_became_peered":"2023-12-22T08:48:44.413144+0000","last_unstale":"2023-12-22T08:48:44.942542+0000","last_undegraded":"2023-12-22T08:48:44.942542+0000","last_fullsized":"2023-12-22T08:48:44.942542+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.594356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914984+0000","last_change":"2023-12-22T08:48:44.938251+0000","last_active":"2023-12-22T08:48:45.914984+0000","last_peered":"2023-12-22T08:48:45.914984+0000","last_clean":"2023-12-22T08:48:45.914984+0000","last_became_active":"2023-12-22T08:48:44.938008+0000","last_became_peered":"2023-12-22T08:48:44.938008+0000","last_unstale":"2023-12-22T08:48:45.914984+0000","last_undegraded":"2023-12-22T08:48:45.914984+0000","last_fullsized":"2023-12-22T08:48:45.914984+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:30:07.721084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.943115+0000","last_change":"2023-12-22T08:48:44.415222+0000","last_active":"2023-12-22T08:48:44.943115+0000","last_peered":"2023-12-22T08:48:44.943115+0000","last_clean":"2023-12-22T08:48:44.943115+0000","last_became_active":"2023-12-22T08:48:44.414733+0000","last_became_peered":"2023-12-22T08:48:44.414733+0000","last_unstale":"2023-12-22T08:48:44.943115+0000","last_undegraded":"2023-12-22T08:48:44.943115+0000","last_fullsized":"2023-12-22T08:48:44.943115+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:09:05.962845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283585+0000","last_change":"2023-12-22T08:48:44.933878+0000","last_active":"2023-12-22T08:48:46.283585+0000","last_peered":"2023-12-22T08:48:46.283585+0000","last_clean":"2023-12-22T08:48:46.283585+0000","last_became_active":"2023-12-22T08:48:44.933376+0000","last_became_peered":"2023-12-22T08:48:44.933376+0000","last_unstale":"2023-12-22T08:48:46.283585+0000","last_undegraded":"2023-12-22T08:48:46.283585+0000","last_fullsized":"2023-12-22T08:48:46.283585+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:46.037114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.937361+0000","last_change":"2023-12-22T08:48:44.408966+0000","last_active":"2023-12-22T08:48:44.937361+0000","last_peered":"2023-12-22T08:48:44.937361+0000","last_clean":"2023-12-22T08:48:44.937361+0000","last_became_active":"2023-12-22T08:48:44.408626+0000","last_became_peered":"2023-12-22T08:48:44.408626+0000","last_unstale":"2023-12-22T08:48:44.937361+0000","last_undegraded":"2023-12-22T08:48:44.937361+0000","last_fullsized":"2023-12-22T08:48:44.937361+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:00:32.922538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283646+0000","last_change":"2023-12-22T08:48:44.928951+0000","last_active":"2023-12-22T08:48:46.283646+0000","last_peered":"2023-12-22T08:48:46.283646+0000","last_clean":"2023-12-22T08:48:46.283646+0000","last_became_active":"2023-12-22T08:48:44.928738+0000","last_became_peered":"2023-12-22T08:48:44.928738+0000","last_unstale":"2023-12-22T08:48:46.283646+0000","last_undegraded":"2023-12-22T08:48:46.283646+0000","last_fullsized":"2023-12-22T08:48:46.283646+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:54:01.511933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.915163+0000","last_change":"2023-12-22T08:48:44.412865+0000","last_active":"2023-12-22T08:48:44.915163+0000","last_peered":"2023-12-22T08:48:44.915163+0000","last_clean":"2023-12-22T08:48:44.915163+0000","last_became_active":"2023-12-22T08:48:44.410542+0000","last_became_peered":"2023-12-22T08:48:44.410542+0000","last_unstale":"2023-12-22T08:48:44.915163+0000","last_undegraded":"2023-12-22T08:48:44.915163+0000","last_fullsized":"2023-12-22T08:48:44.915163+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:29.010120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424591+0000","last_change":"2023-12-22T08:48:44.941906+0000","last_active":"2023-12-22T08:48:46.424591+0000","last_peered":"2023-12-22T08:48:46.424591+0000","last_clean":"2023-12-22T08:48:46.424591+0000","last_became_active":"2023-12-22T08:48:44.941183+0000","last_became_peered":"2023-12-22T08:48:44.941183+0000","last_unstale":"2023-12-22T08:48:46.424591+0000","last_undegraded":"2023-12-22T08:48:46.424591+0000","last_fullsized":"2023-12-22T08:48:46.424591+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:16:51.643566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.930280+0000","last_change":"2023-12-22T08:48:44.415160+0000","last_active":"2023-12-22T08:48:44.930280+0000","last_peered":"2023-12-22T08:48:44.930280+0000","last_clean":"2023-12-22T08:48:44.930280+0000","last_became_active":"2023-12-22T08:48:44.414887+0000","last_became_peered":"2023-12-22T08:48:44.414887+0000","last_unstale":"2023-12-22T08:48:44.930280+0000","last_undegraded":"2023-12-22T08:48:44.930280+0000","last_fullsized":"2023-12-22T08:48:44.930280+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:34:53.466054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424967+0000","last_change":"2023-12-22T08:48:44.941964+0000","last_active":"2023-12-22T08:48:46.424967+0000","last_peered":"2023-12-22T08:48:46.424967+0000","last_clean":"2023-12-22T08:48:46.424967+0000","last_became_active":"2023-12-22T08:48:44.940620+0000","last_became_peered":"2023-12-22T08:48:44.940620+0000","last_unstale":"2023-12-22T08:48:46.424967+0000","last_undegraded":"2023-12-22T08:48:46.424967+0000","last_fullsized":"2023-12-22T08:48:46.424967+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:11:12.888926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.921211+0000","last_change":"2023-12-22T08:48:44.421025+0000","last_active":"2023-12-22T08:48:44.921211+0000","last_peered":"2023-12-22T08:48:44.921211+0000","last_clean":"2023-12-22T08:48:44.921211+0000","last_became_active":"2023-12-22T08:48:44.420756+0000","last_became_peered":"2023-12-22T08:48:44.420756+0000","last_unstale":"2023-12-22T08:48:44.921211+0000","last_undegraded":"2023-12-22T08:48:44.921211+0000","last_fullsized":"2023-12-22T08:48:44.921211+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:30:06.708309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526667+0000","last_change":"2023-12-22T08:48:44.936368+0000","last_active":"2023-12-22T08:48:46.526667+0000","last_peered":"2023-12-22T08:48:46.526667+0000","last_clean":"2023-12-22T08:48:46.526667+0000","last_became_active":"2023-12-22T08:48:44.936141+0000","last_became_peered":"2023-12-22T08:48:44.936141+0000","last_unstale":"2023-12-22T08:48:46.526667+0000","last_undegraded":"2023-12-22T08:48:46.526667+0000","last_fullsized":"2023-12-22T08:48:46.526667+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:22:07.648049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.920610+0000","last_change":"2023-12-22T08:48:44.410489+0000","last_active":"2023-12-22T08:48:44.920610+0000","last_peered":"2023-12-22T08:48:44.920610+0000","last_clean":"2023-12-22T08:48:44.920610+0000","last_became_active":"2023-12-22T08:48:44.409988+0000","last_became_peered":"2023-12-22T08:48:44.409988+0000","last_unstale":"2023-12-22T08:48:44.920610+0000","last_undegraded":"2023-12-22T08:48:44.920610+0000","last_fullsized":"2023-12-22T08:48:44.920610+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:10:49.400511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283478+0000","last_change":"2023-12-22T08:48:44.927817+0000","last_active":"2023-12-22T08:48:46.283478+0000","last_peered":"2023-12-22T08:48:46.283478+0000","last_clean":"2023-12-22T08:48:46.283478+0000","last_became_active":"2023-12-22T08:48:44.927338+0000","last_became_peered":"2023-12-22T08:48:44.927338+0000","last_unstale":"2023-12-22T08:48:46.283478+0000","last_undegraded":"2023-12-22T08:48:46.283478+0000","last_fullsized":"2023-12-22T08:48:46.283478+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:40.357452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"157'3","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.941383+0000","last_change":"2023-12-22T08:48:44.412766+0000","last_active":"2023-12-22T08:48:44.941383+0000","last_peered":"2023-12-22T08:48:44.941383+0000","last_clean":"2023-12-22T08:48:44.941383+0000","last_became_active":"2023-12-22T08:48:44.412135+0000","last_became_peered":"2023-12-22T08:48:44.412135+0000","last_unstale":"2023-12-22T08:48:44.941383+0000","last_undegraded":"2023-12-22T08:48:44.941383+0000","last_fullsized":"2023-12-22T08:48:44.941383+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:39.344677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527281+0000","last_change":"2023-12-22T08:48:44.935297+0000","last_active":"2023-12-22T08:48:46.527281+0000","last_peered":"2023-12-22T08:48:46.527281+0000","last_clean":"2023-12-22T08:48:46.527281+0000","last_became_active":"2023-12-22T08:48:44.934341+0000","last_became_peered":"2023-12-22T08:48:44.934341+0000","last_unstale":"2023-12-22T08:48:46.527281+0000","last_undegraded":"2023-12-22T08:48:46.527281+0000","last_fullsized":"2023-12-22T08:48:46.527281+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:07:35.009495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"157'6","reported_seq":17,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.944097+0000","last_change":"2023-12-22T08:48:44.421503+0000","last_active":"2023-12-22T08:48:44.944097+0000","last_peered":"2023-12-22T08:48:44.944097+0000","last_clean":"2023-12-22T08:48:44.944097+0000","last_became_active":"2023-12-22T08:48:44.421233+0000","last_became_peered":"2023-12-22T08:48:44.421233+0000","last_unstale":"2023-12-22T08:48:44.944097+0000","last_undegraded":"2023-12-22T08:48:44.944097+0000","last_fullsized":"2023-12-22T08:48:44.944097+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:14:43.362707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916362+0000","last_change":"2023-12-22T08:48:44.934459+0000","last_active":"2023-12-22T08:48:45.916362+0000","last_peered":"2023-12-22T08:48:45.916362+0000","last_clean":"2023-12-22T08:48:45.916362+0000","last_became_active":"2023-12-22T08:48:44.933968+0000","last_became_peered":"2023-12-22T08:48:44.933968+0000","last_unstale":"2023-12-22T08:48:45.916362+0000","last_undegraded":"2023-12-22T08:48:45.916362+0000","last_fullsized":"2023-12-22T08:48:45.916362+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:33:54.484505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.920676+0000","last_change":"2023-12-22T08:48:44.407582+0000","last_active":"2023-12-22T08:48:44.920676+0000","last_peered":"2023-12-22T08:48:44.920676+0000","last_clean":"2023-12-22T08:48:44.920676+0000","last_became_active":"2023-12-22T08:48:44.407221+0000","last_became_peered":"2023-12-22T08:48:44.407221+0000","last_unstale":"2023-12-22T08:48:44.920676+0000","last_undegraded":"2023-12-22T08:48:44.920676+0000","last_fullsized":"2023-12-22T08:48:44.920676+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:27.710366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916043+0000","last_change":"2023-12-22T08:48:44.932407+0000","last_active":"2023-12-22T08:48:45.916043+0000","last_peered":"2023-12-22T08:48:45.916043+0000","last_clean":"2023-12-22T08:48:45.916043+0000","last_became_active":"2023-12-22T08:48:44.931825+0000","last_became_peered":"2023-12-22T08:48:44.931825+0000","last_unstale":"2023-12-22T08:48:45.916043+0000","last_undegraded":"2023-12-22T08:48:45.916043+0000","last_fullsized":"2023-12-22T08:48:45.916043+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:51:43.425774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.917404+0000","last_change":"2023-12-22T08:48:44.420889+0000","last_active":"2023-12-22T08:48:44.917404+0000","last_peered":"2023-12-22T08:48:44.917404+0000","last_clean":"2023-12-22T08:48:44.917404+0000","last_became_active":"2023-12-22T08:48:44.420589+0000","last_became_peered":"2023-12-22T08:48:44.420589+0000","last_unstale":"2023-12-22T08:48:44.917404+0000","last_undegraded":"2023-12-22T08:48:44.917404+0000","last_fullsized":"2023-12-22T08:48:44.917404+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:45.024339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.284059+0000","last_change":"2023-12-22T08:48:44.933610+0000","last_active":"2023-12-22T08:48:46.284059+0000","last_peered":"2023-12-22T08:48:46.284059+0000","last_clean":"2023-12-22T08:48:46.284059+0000","last_became_active":"2023-12-22T08:48:44.932771+0000","last_became_peered":"2023-12-22T08:48:44.932771+0000","last_unstale":"2023-12-22T08:48:46.284059+0000","last_undegraded":"2023-12-22T08:48:46.284059+0000","last_fullsized":"2023-12-22T08:48:46.284059+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:09:25.230602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"157'8","reported_seq":19,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.937876+0000","last_change":"2023-12-22T08:48:44.410500+0000","last_active":"2023-12-22T08:48:44.937876+0000","last_peered":"2023-12-22T08:48:44.937876+0000","last_clean":"2023-12-22T08:48:44.937876+0000","last_became_active":"2023-12-22T08:48:44.409980+0000","last_became_peered":"2023-12-22T08:48:44.409980+0000","last_unstale":"2023-12-22T08:48:44.937876+0000","last_undegraded":"2023-12-22T08:48:44.937876+0000","last_fullsized":"2023-12-22T08:48:44.937876+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:30:48.799461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527570+0000","last_change":"2023-12-22T08:48:44.921948+0000","last_active":"2023-12-22T08:48:46.527570+0000","last_peered":"2023-12-22T08:48:46.527570+0000","last_clean":"2023-12-22T08:48:46.527570+0000","last_became_active":"2023-12-22T08:48:44.921647+0000","last_became_peered":"2023-12-22T08:48:44.921647+0000","last_unstale":"2023-12-22T08:48:46.527570+0000","last_undegraded":"2023-12-22T08:48:46.527570+0000","last_fullsized":"2023-12-22T08:48:46.527570+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:18:08.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.926662+0000","last_change":"2023-12-22T08:48:44.419969+0000","last_active":"2023-12-22T08:48:44.926662+0000","last_peered":"2023-12-22T08:48:44.926662+0000","last_clean":"2023-12-22T08:48:44.926662+0000","last_became_active":"2023-12-22T08:48:44.418228+0000","last_became_peered":"2023-12-22T08:48:44.418228+0000","last_unstale":"2023-12-22T08:48:44.926662+0000","last_undegraded":"2023-12-22T08:48:44.926662+0000","last_fullsized":"2023-12-22T08:48:44.926662+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:34.796899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526420+0000","last_change":"2023-12-22T08:48:44.937199+0000","last_active":"2023-12-22T08:48:46.526420+0000","last_peered":"2023-12-22T08:48:46.526420+0000","last_clean":"2023-12-22T08:48:46.526420+0000","last_became_active":"2023-12-22T08:48:44.935718+0000","last_became_peered":"2023-12-22T08:48:44.935718+0000","last_unstale":"2023-12-22T08:48:46.526420+0000","last_undegraded":"2023-12-22T08:48:46.526420+0000","last_fullsized":"2023-12-22T08:48:46.526420+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:47:42.718315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.937908+0000","last_change":"2023-12-22T08:48:44.413739+0000","last_active":"2023-12-22T08:48:44.937908+0000","last_peered":"2023-12-22T08:48:44.937908+0000","last_clean":"2023-12-22T08:48:44.937908+0000","last_became_active":"2023-12-22T08:48:44.413442+0000","last_became_peered":"2023-12-22T08:48:44.413442+0000","last_unstale":"2023-12-22T08:48:44.937908+0000","last_undegraded":"2023-12-22T08:48:44.937908+0000","last_fullsized":"2023-12-22T08:48:44.937908+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:03:57.744764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.425233+0000","last_change":"2023-12-22T08:48:44.941000+0000","last_active":"2023-12-22T08:48:46.425233+0000","last_peered":"2023-12-22T08:48:46.425233+0000","last_clean":"2023-12-22T08:48:46.425233+0000","last_became_active":"2023-12-22T08:48:44.938353+0000","last_became_peered":"2023-12-22T08:48:44.938353+0000","last_unstale":"2023-12-22T08:48:46.425233+0000","last_undegraded":"2023-12-22T08:48:46.425233+0000","last_fullsized":"2023-12-22T08:48:46.425233+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:02.936937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.933028+0000","last_change":"2023-12-22T08:48:44.418798+0000","last_active":"2023-12-22T08:48:44.933028+0000","last_peered":"2023-12-22T08:48:44.933028+0000","last_clean":"2023-12-22T08:48:44.933028+0000","last_became_active":"2023-12-22T08:48:44.418316+0000","last_became_peered":"2023-12-22T08:48:44.418316+0000","last_unstale":"2023-12-22T08:48:44.933028+0000","last_undegraded":"2023-12-22T08:48:44.933028+0000","last_fullsized":"2023-12-22T08:48:44.933028+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:02:00.737313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.425151+0000","last_change":"2023-12-22T08:48:44.940316+0000","last_active":"2023-12-22T08:48:46.425151+0000","last_peered":"2023-12-22T08:48:46.425151+0000","last_clean":"2023-12-22T08:48:46.425151+0000","last_became_active":"2023-12-22T08:48:44.938728+0000","last_became_peered":"2023-12-22T08:48:44.938728+0000","last_unstale":"2023-12-22T08:48:46.425151+0000","last_undegraded":"2023-12-22T08:48:46.425151+0000","last_fullsized":"2023-12-22T08:48:46.425151+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:02:01.750088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.918557+0000","last_change":"2023-12-22T08:48:44.414672+0000","last_active":"2023-12-22T08:48:44.918557+0000","last_peered":"2023-12-22T08:48:44.918557+0000","last_clean":"2023-12-22T08:48:44.918557+0000","last_became_active":"2023-12-22T08:48:44.414288+0000","last_became_peered":"2023-12-22T08:48:44.414288+0000","last_unstale":"2023-12-22T08:48:44.918557+0000","last_undegraded":"2023-12-22T08:48:44.918557+0000","last_fullsized":"2023-12-22T08:48:44.918557+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:09:24.217827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424724+0000","last_change":"2023-12-22T08:48:44.937730+0000","last_active":"2023-12-22T08:48:46.424724+0000","last_peered":"2023-12-22T08:48:46.424724+0000","last_clean":"2023-12-22T08:48:46.424724+0000","last_became_active":"2023-12-22T08:48:44.937282+0000","last_became_peered":"2023-12-22T08:48:44.937282+0000","last_unstale":"2023-12-22T08:48:46.424724+0000","last_undegraded":"2023-12-22T08:48:46.424724+0000","last_fullsized":"2023-12-22T08:48:46.424724+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:30.022895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.933950+0000","last_change":"2023-12-22T08:48:44.418017+0000","last_active":"2023-12-22T08:48:44.933950+0000","last_peered":"2023-12-22T08:48:44.933950+0000","last_clean":"2023-12-22T08:48:44.933950+0000","last_became_active":"2023-12-22T08:48:44.417776+0000","last_became_peered":"2023-12-22T08:48:44.417776+0000","last_unstale":"2023-12-22T08:48:44.933950+0000","last_undegraded":"2023-12-22T08:48:44.933950+0000","last_fullsized":"2023-12-22T08:48:44.933950+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:03.583831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527518+0000","last_change":"2023-12-22T08:48:44.928145+0000","last_active":"2023-12-22T08:48:46.527518+0000","last_peered":"2023-12-22T08:48:46.527518+0000","last_clean":"2023-12-22T08:48:46.527518+0000","last_became_active":"2023-12-22T08:48:44.927886+0000","last_became_peered":"2023-12-22T08:48:44.927886+0000","last_unstale":"2023-12-22T08:48:46.527518+0000","last_undegraded":"2023-12-22T08:48:46.527518+0000","last_fullsized":"2023-12-22T08:48:46.527518+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:35.809674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.927570+0000","last_change":"2023-12-22T08:48:44.402875+0000","last_active":"2023-12-22T08:48:44.927570+0000","last_peered":"2023-12-22T08:48:44.927570+0000","last_clean":"2023-12-22T08:48:44.927570+0000","last_became_active":"2023-12-22T08:48:44.402351+0000","last_became_peered":"2023-12-22T08:48:44.402351+0000","last_unstale":"2023-12-22T08:48:44.927570+0000","last_undegraded":"2023-12-22T08:48:44.927570+0000","last_fullsized":"2023-12-22T08:48:44.927570+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:18:39.092197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916368+0000","last_change":"2023-12-22T08:48:44.936175+0000","last_active":"2023-12-22T08:48:45.916368+0000","last_peered":"2023-12-22T08:48:45.916368+0000","last_clean":"2023-12-22T08:48:45.916368+0000","last_became_active":"2023-12-22T08:48:44.935939+0000","last_became_peered":"2023-12-22T08:48:44.935939+0000","last_unstale":"2023-12-22T08:48:45.916368+0000","last_undegraded":"2023-12-22T08:48:45.916368+0000","last_fullsized":"2023-12-22T08:48:45.916368+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:22:07.648049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.914844+0000","last_change":"2023-12-22T08:48:44.421234+0000","last_active":"2023-12-22T08:48:44.914844+0000","last_peered":"2023-12-22T08:48:44.914844+0000","last_clean":"2023-12-22T08:48:44.914844+0000","last_became_active":"2023-12-22T08:48:44.420788+0000","last_became_peered":"2023-12-22T08:48:44.420788+0000","last_unstale":"2023-12-22T08:48:44.914844+0000","last_undegraded":"2023-12-22T08:48:44.914844+0000","last_fullsized":"2023-12-22T08:48:44.914844+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:29.355449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283908+0000","last_change":"2023-12-22T08:48:44.930580+0000","last_active":"2023-12-22T08:48:46.283908+0000","last_peered":"2023-12-22T08:48:46.283908+0000","last_clean":"2023-12-22T08:48:46.283908+0000","last_became_active":"2023-12-22T08:48:44.930355+0000","last_became_peered":"2023-12-22T08:48:44.930355+0000","last_unstale":"2023-12-22T08:48:46.283908+0000","last_undegraded":"2023-12-22T08:48:46.283908+0000","last_fullsized":"2023-12-22T08:48:46.283908+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:33:54.484505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.923876+0000","last_change":"2023-12-22T08:48:44.410689+0000","last_active":"2023-12-22T08:48:44.923876+0000","last_peered":"2023-12-22T08:48:44.923876+0000","last_clean":"2023-12-22T08:48:44.923876+0000","last_became_active":"2023-12-22T08:48:44.410262+0000","last_became_peered":"2023-12-22T08:48:44.410262+0000","last_unstale":"2023-12-22T08:48:44.923876+0000","last_undegraded":"2023-12-22T08:48:44.923876+0000","last_fullsized":"2023-12-22T08:48:44.923876+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:33:53.471731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527748+0000","last_change":"2023-12-22T08:48:44.935139+0000","last_active":"2023-12-22T08:48:46.527748+0000","last_peered":"2023-12-22T08:48:46.527748+0000","last_clean":"2023-12-22T08:48:46.527748+0000","last_became_active":"2023-12-22T08:48:44.932941+0000","last_became_peered":"2023-12-22T08:48:44.932941+0000","last_unstale":"2023-12-22T08:48:46.527748+0000","last_undegraded":"2023-12-22T08:48:46.527748+0000","last_fullsized":"2023-12-22T08:48:46.527748+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:23:24.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.941395+0000","last_change":"2023-12-22T08:48:44.402084+0000","last_active":"2023-12-22T08:48:44.941395+0000","last_peered":"2023-12-22T08:48:44.941395+0000","last_clean":"2023-12-22T08:48:44.941395+0000","last_became_active":"2023-12-22T08:48:44.401587+0000","last_became_peered":"2023-12-22T08:48:44.401587+0000","last_unstale":"2023-12-22T08:48:44.941395+0000","last_undegraded":"2023-12-22T08:48:44.941395+0000","last_fullsized":"2023-12-22T08:48:44.941395+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:33:59.487564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.425391+0000","last_change":"2023-12-22T08:48:44.941374+0000","last_active":"2023-12-22T08:48:46.425391+0000","last_peered":"2023-12-22T08:48:46.425391+0000","last_clean":"2023-12-22T08:48:46.425391+0000","last_became_active":"2023-12-22T08:48:44.938691+0000","last_became_peered":"2023-12-22T08:48:44.938691+0000","last_unstale":"2023-12-22T08:48:46.425391+0000","last_undegraded":"2023-12-22T08:48:46.425391+0000","last_fullsized":"2023-12-22T08:48:46.425391+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:45:54.127065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.918521+0000","last_change":"2023-12-22T08:48:44.417247+0000","last_active":"2023-12-22T08:48:44.918521+0000","last_peered":"2023-12-22T08:48:44.918521+0000","last_clean":"2023-12-22T08:48:44.918521+0000","last_became_active":"2023-12-22T08:48:44.416982+0000","last_became_peered":"2023-12-22T08:48:44.416982+0000","last_unstale":"2023-12-22T08:48:44.918521+0000","last_undegraded":"2023-12-22T08:48:44.918521+0000","last_fullsized":"2023-12-22T08:48:44.918521+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:14.666898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916500+0000","last_change":"2023-12-22T08:48:44.939553+0000","last_active":"2023-12-22T08:48:45.916500+0000","last_peered":"2023-12-22T08:48:45.916500+0000","last_clean":"2023-12-22T08:48:45.916500+0000","last_became_active":"2023-12-22T08:48:44.939276+0000","last_became_peered":"2023-12-22T08:48:44.939276+0000","last_unstale":"2023-12-22T08:48:45.916500+0000","last_undegraded":"2023-12-22T08:48:45.916500+0000","last_fullsized":"2023-12-22T08:48:45.916500+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:46.037114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.927677+0000","last_change":"2023-12-22T08:48:44.421723+0000","last_active":"2023-12-22T08:48:44.927677+0000","last_peered":"2023-12-22T08:48:44.927677+0000","last_clean":"2023-12-22T08:48:44.927677+0000","last_became_active":"2023-12-22T08:48:44.421380+0000","last_became_peered":"2023-12-22T08:48:44.421380+0000","last_unstale":"2023-12-22T08:48:44.927677+0000","last_undegraded":"2023-12-22T08:48:44.927677+0000","last_fullsized":"2023-12-22T08:48:44.927677+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:14:43.362707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916103+0000","last_change":"2023-12-22T08:48:44.941477+0000","last_active":"2023-12-22T08:48:45.916103+0000","last_peered":"2023-12-22T08:48:45.916103+0000","last_clean":"2023-12-22T08:48:45.916103+0000","last_became_active":"2023-12-22T08:48:44.941203+0000","last_became_peered":"2023-12-22T08:48:44.941203+0000","last_unstale":"2023-12-22T08:48:45.916103+0000","last_undegraded":"2023-12-22T08:48:45.916103+0000","last_fullsized":"2023-12-22T08:48:45.916103+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:38:33.002937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.915119+0000","last_change":"2023-12-22T08:48:44.407665+0000","last_active":"2023-12-22T08:48:44.915119+0000","last_peered":"2023-12-22T08:48:44.915119+0000","last_clean":"2023-12-22T08:48:44.915119+0000","last_became_active":"2023-12-22T08:48:44.407334+0000","last_became_peered":"2023-12-22T08:48:44.407334+0000","last_unstale":"2023-12-22T08:48:44.915119+0000","last_undegraded":"2023-12-22T08:48:44.915119+0000","last_fullsized":"2023-12-22T08:48:44.915119+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:15:02.710245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.284251+0000","last_change":"2023-12-22T08:48:44.924014+0000","last_active":"2023-12-22T08:48:46.284251+0000","last_peered":"2023-12-22T08:48:46.284251+0000","last_clean":"2023-12-22T08:48:46.284251+0000","last_became_active":"2023-12-22T08:48:44.923191+0000","last_became_peered":"2023-12-22T08:48:44.923191+0000","last_unstale":"2023-12-22T08:48:46.284251+0000","last_undegraded":"2023-12-22T08:48:46.284251+0000","last_fullsized":"2023-12-22T08:48:46.284251+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:29.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.920965+0000","last_change":"2023-12-22T08:48:44.416913+0000","last_active":"2023-12-22T08:48:44.920965+0000","last_peered":"2023-12-22T08:48:44.920965+0000","last_clean":"2023-12-22T08:48:44.920965+0000","last_became_active":"2023-12-22T08:48:44.416099+0000","last_became_peered":"2023-12-22T08:48:44.416099+0000","last_unstale":"2023-12-22T08:48:44.920965+0000","last_undegraded":"2023-12-22T08:48:44.920965+0000","last_fullsized":"2023-12-22T08:48:44.920965+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:04:21.410084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283955+0000","last_change":"2023-12-22T08:48:44.937706+0000","last_active":"2023-12-22T08:48:46.283955+0000","last_peered":"2023-12-22T08:48:46.283955+0000","last_clean":"2023-12-22T08:48:46.283955+0000","last_became_active":"2023-12-22T08:48:44.937177+0000","last_became_peered":"2023-12-22T08:48:44.937177+0000","last_unstale":"2023-12-22T08:48:46.283955+0000","last_undegraded":"2023-12-22T08:48:46.283955+0000","last_fullsized":"2023-12-22T08:48:46.283955+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:03:58.757538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.920155+0000","last_change":"2023-12-22T08:48:44.417885+0000","last_active":"2023-12-22T08:48:44.920155+0000","last_peered":"2023-12-22T08:48:44.920155+0000","last_clean":"2023-12-22T08:48:44.920155+0000","last_became_active":"2023-12-22T08:48:44.417279+0000","last_became_peered":"2023-12-22T08:48:44.417279+0000","last_unstale":"2023-12-22T08:48:44.920155+0000","last_undegraded":"2023-12-22T08:48:44.920155+0000","last_fullsized":"2023-12-22T08:48:44.920155+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:01:05.200246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914784+0000","last_change":"2023-12-22T08:48:44.937656+0000","last_active":"2023-12-22T08:48:45.914784+0000","last_peered":"2023-12-22T08:48:45.914784+0000","last_clean":"2023-12-22T08:48:45.914784+0000","last_became_active":"2023-12-22T08:48:44.934921+0000","last_became_peered":"2023-12-22T08:48:44.934921+0000","last_unstale":"2023-12-22T08:48:45.914784+0000","last_undegraded":"2023-12-22T08:48:45.914784+0000","last_fullsized":"2023-12-22T08:48:45.914784+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:21.340538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.919784+0000","last_change":"2023-12-22T08:48:44.420946+0000","last_active":"2023-12-22T08:48:44.919784+0000","last_peered":"2023-12-22T08:48:44.919784+0000","last_clean":"2023-12-22T08:48:44.919784+0000","last_became_active":"2023-12-22T08:48:44.420713+0000","last_became_peered":"2023-12-22T08:48:44.420713+0000","last_unstale":"2023-12-22T08:48:44.919784+0000","last_undegraded":"2023-12-22T08:48:44.919784+0000","last_fullsized":"2023-12-22T08:48:44.919784+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:54:00.499158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916329+0000","last_change":"2023-12-22T08:48:44.932551+0000","last_active":"2023-12-22T08:48:45.916329+0000","last_peered":"2023-12-22T08:48:45.916329+0000","last_clean":"2023-12-22T08:48:45.916329+0000","last_became_active":"2023-12-22T08:48:44.932140+0000","last_became_peered":"2023-12-22T08:48:44.932140+0000","last_unstale":"2023-12-22T08:48:45.916329+0000","last_undegraded":"2023-12-22T08:48:45.916329+0000","last_fullsized":"2023-12-22T08:48:45.916329+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:18:08.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.921744+0000","last_change":"2023-12-22T08:48:44.408365+0000","last_active":"2023-12-22T08:48:44.921744+0000","last_peered":"2023-12-22T08:48:44.921744+0000","last_clean":"2023-12-22T08:48:44.921744+0000","last_became_active":"2023-12-22T08:48:44.408001+0000","last_became_peered":"2023-12-22T08:48:44.408001+0000","last_unstale":"2023-12-22T08:48:44.921744+0000","last_undegraded":"2023-12-22T08:48:44.921744+0000","last_fullsized":"2023-12-22T08:48:44.921744+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:25:32.965606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916127+0000","last_change":"2023-12-22T08:48:44.933557+0000","last_active":"2023-12-22T08:48:45.916127+0000","last_peered":"2023-12-22T08:48:45.916127+0000","last_clean":"2023-12-22T08:48:45.916127+0000","last_became_active":"2023-12-22T08:48:44.933313+0000","last_became_peered":"2023-12-22T08:48:44.933313+0000","last_unstale":"2023-12-22T08:48:45.916127+0000","last_undegraded":"2023-12-22T08:48:45.916127+0000","last_fullsized":"2023-12-22T08:48:45.916127+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:16:12.198481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.930132+0000","last_change":"2023-12-22T08:48:44.419546+0000","last_active":"2023-12-22T08:48:44.930132+0000","last_peered":"2023-12-22T08:48:44.930132+0000","last_clean":"2023-12-22T08:48:44.930132+0000","last_became_active":"2023-12-22T08:48:44.419284+0000","last_became_peered":"2023-12-22T08:48:44.419284+0000","last_unstale":"2023-12-22T08:48:44.930132+0000","last_undegraded":"2023-12-22T08:48:44.930132+0000","last_fullsized":"2023-12-22T08:48:44.930132+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:10:07.622514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":289,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.923653+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:48:44.923653+0000","last_peered":"2023-12-22T08:48:44.923653+0000","last_clean":"2023-12-22T08:48:44.923653+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:48:44.923653+0000","last_undegraded":"2023-12-22T08:48:44.923653+0000","last_fullsized":"2023-12-22T08:48:44.923653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":860,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194451,"statfs":{"total":200000000,"available":199118644,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0960000000000001,"15min":1.085},"min":{"1min":0.80200000000000005,"5min":0.60999999999999999,"15min":0.58199999999999996},"max":{"1min":1.488,"5min":1.6459999999999999,"15min":2.0249999999999999},"last":1.069},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.101,"15min":1.075},"min":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3400000000000001,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.468}]},{"osd":1,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.1910000000000001,"15min":1.171},"min":{"1min":0.85099999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6779999999999999,"5min":1.6839999999999999,"15min":1.905},"last":1.333},{"interface":"front","average":{"1min":1.22,"5min":1.2450000000000001,"15min":1.1739999999999999},"min":{"1min":0.80300000000000005,"5min":0.70699999999999996,"15min":0.67100000000000004},"max":{"1min":1.448,"5min":1.7709999999999999,"15min":1.865},"last":1.361}]},{"osd":2,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1619999999999999,"15min":1.0960000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.69799999999999995},"max":{"1min":1.74,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.262},{"interface":"front","average":{"1min":1.23,"5min":1.2010000000000001,"15min":1.22},"min":{"1min":0.92900000000000005,"5min":0.73099999999999998,"15min":0.68700000000000006},"max":{"1min":1.79,"5min":1.79,"15min":2.1379999999999999},"last":1.1459999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2270000000000001,"15min":1.141},"min":{"1min":0.89700000000000002,"5min":0.77500000000000002,"15min":0.71399999999999997},"max":{"1min":1.5629999999999999,"5min":1.635,"15min":2.0680000000000001},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3220000000000001,"15min":1.294},"min":{"1min":0.77700000000000002,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.873,"5min":1.873,"15min":2.2959999999999998},"last":1.2310000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2230000000000001,"15min":1.2030000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.48699999999999999},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.2729999999999999,"15min":1.2669999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.59399999999999997},"max":{"1min":1.6719999999999999,"5min":2.0840000000000001,"15min":2.2749999999999999},"last":1.107}]},{"osd":5,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3919999999999999,"15min":1.3759999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.51800000000000002},"max":{"1min":1.9530000000000001,"5min":2.0510000000000002,"15min":2.4300000000000002},"last":1.385},{"interface":"front","average":{"1min":1.421,"5min":1.3939999999999999,"15min":1.377},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.3410000000000002},"last":1.2989999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.52,"15min":1.4970000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.66900000000000004},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.591},{"interface":"front","average":{"1min":1.583,"5min":1.504,"15min":1.4910000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.71999999999999997},"max":{"1min":1.921,"5min":2.1379999999999999,"15min":2.4849999999999999},"last":1.421}]}]},{"osd":6,"up_from":13,"seq":55834574958,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":860,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194451,"statfs":{"total":200000000,"available":199118678,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":2.6070000000000002,"5min":1.4319999999999999,"15min":1.228},"min":{"1min":0.61899999999999999,"5min":0.55300000000000005,"15min":0.42099999999999999},"max":{"1min":28.361000000000001,"5min":28.361000000000001,"15min":28.361000000000001},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.1970000000000001,"15min":1.1200000000000001},"min":{"1min":0.79000000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":1.147}]},{"osd":1,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.1180000000000001,"15min":1.0549999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.871},{"interface":"front","average":{"1min":2.04,"5min":1.3240000000000001,"15min":1.2250000000000001},"min":{"1min":0.76200000000000001,"5min":0.64500000000000002,"15min":0.63100000000000001},"max":{"1min":15.324999999999999,"5min":15.324999999999999,"15min":15.324999999999999},"last":1.0229999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":1.3979999999999999,"15min":1.3109999999999999},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":15.422000000000001,"5min":15.422000000000001,"15min":15.422000000000001},"last":1.405},{"interface":"front","average":{"1min":1.746,"5min":1.3440000000000001,"15min":1.2170000000000001},"min":{"1min":0.94199999999999995,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":10.173999999999999,"5min":10.173999999999999,"15min":10.173999999999999},"last":1.0700000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":1.391,"15min":1.3320000000000001},"min":{"1min":0.99399999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":10.096,"5min":10.096,"15min":10.096},"last":1.216},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2490000000000001,"15min":1.2410000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.2509999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":2.0459999999999998,"5min":1.466,"15min":1.4279999999999999},"min":{"1min":0.81499999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":15.378,"5min":15.378,"15min":15.378},"last":1.1180000000000001},{"interface":"front","average":{"1min":2.0369999999999999,"5min":1.4970000000000001,"15min":1.4390000000000001},"min":{"1min":0.90900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":13.178000000000001,"5min":13.178000000000001,"15min":13.178000000000001},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2959999999999998,"5min":1.494,"15min":1.407},"min":{"1min":0.97899999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":19.995000000000001,"5min":19.995000000000001,"15min":19.995000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":2.2290000000000001,"5min":1.6259999999999999,"15min":1.6040000000000001},"min":{"1min":1.1399999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":15.679,"5min":15.679,"15min":15.679},"last":1.3360000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.5149999999999999,"15min":1.5669999999999999},"min":{"1min":1.05,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.46,"15min":1.5229999999999999},"min":{"1min":0.89200000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":4.6609999999999996,"5min":4.6609999999999996,"15min":4.6609999999999996},"last":1.359}]}]},{"osd":5,"up_from":13,"seq":55834574958,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1436,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193875,"statfs":{"total":200000000,"available":198528587,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0860000000000001,"15min":1.079},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.65300000000000002},"max":{"1min":1.4079999999999999,"5min":1.706,"15min":1.944},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0920000000000001,"15min":1.119},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":3.1379999999999999},"last":0.92400000000000004}]},{"osd":1,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.151,"15min":1.1200000000000001},"min":{"1min":0.73399999999999999,"5min":0.67900000000000005,"15min":0.63600000000000001},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.79},"last":1.129},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1040000000000001,"15min":1.046},"min":{"1min":0.747,"5min":0.73099999999999998,"15min":0.64500000000000002},"max":{"1min":1.5049999999999999,"5min":1.52,"15min":1.7509999999999999},"last":1.3260000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.171,"15min":1.1379999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.73899999999999999},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.2390000000000001,"15min":1.1859999999999999},"min":{"1min":0.83499999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.609,"5min":1.716,"15min":1.978},"last":1.4530000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.25,"15min":1.1879999999999999},"min":{"1min":0.94599999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.47,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.2989999999999999,"15min":1.2529999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.73299999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":2.1499999999999999},"last":1.482}]},{"osd":4,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.2609999999999999,"15min":1.25},"min":{"1min":0.60699999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4910000000000001,"5min":1.6879999999999999,"15min":1.853},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2689999999999999,"15min":1.2549999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.58399999999999996},"max":{"1min":1.6699999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.98899999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.3340000000000001,"15min":1.3169999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6279999999999999,"5min":1.788,"15min":1.821},"last":1.036},{"interface":"front","average":{"1min":1.331,"5min":1.393,"15min":1.4139999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.716,"5min":1.823,"15min":2.8780000000000001},"last":1.5569999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.4339999999999999,"15min":1.385},"min":{"1min":0.89100000000000001,"5min":0.84299999999999997,"15min":0.72499999999999998},"max":{"1min":1.595,"5min":1.873,"15min":2.2189999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.476,"15min":1.5369999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.782,"5min":1.8899999999999999,"15min":4.7249999999999996},"last":1.409}]}]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":860,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194451,"statfs":{"total":200000000,"available":199118678,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0469999999999999,"15min":1.0149999999999999},"min":{"1min":0.67800000000000005,"5min":0.67100000000000004,"15min":0.64000000000000001},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.139,"15min":1.1080000000000001},"min":{"1min":0.66000000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7410000000000001,"5min":1.796,"15min":1.796},"last":0.997}]},{"osd":1,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.119,"15min":1.0609999999999999},"min":{"1min":0.67400000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.734,"5min":1.76,"15min":1.76},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.1299999999999999,"15min":1.109},"min":{"1min":0.78100000000000003,"5min":0.65600000000000003,"15min":0.57399999999999995},"max":{"1min":1.5409999999999999,"5min":1.714,"15min":2.4249999999999998},"last":0.90700000000000003}]},{"osd":2,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.169,"15min":1.1479999999999999},"min":{"1min":0.755,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5089999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2490000000000001,"15min":1.208},"min":{"1min":0.79700000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.603,"5min":2.0830000000000002,"15min":2.1600000000000001},"last":1.26}]},{"osd":3,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2210000000000001,"15min":1.206},"min":{"1min":0.86299999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.208},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.323,"15min":1.2410000000000001},"min":{"1min":0.92800000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.591,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.353}]},{"osd":5,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.181,"15min":1.151},"min":{"1min":0.78200000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.575},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4390000000000001,"15min":1.395},"min":{"1min":1.0980000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8939999999999999,"5min":1.913,"15min":2.0979999999999999},"last":1.7629999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.3500000000000001,"15min":1.2709999999999999},"min":{"1min":0.91200000000000003,"5min":0.75,"15min":0.58599999999999997},"max":{"1min":1.74,"5min":2.141,"15min":2.141},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.333,"15min":1.2370000000000001},"min":{"1min":0.85699999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8169999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.677}]},{"osd":7,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.444,"15min":1.371},"min":{"1min":0.98899999999999999,"5min":0.875,"15min":0.67300000000000004},"max":{"1min":1.978,"5min":2.0089999999999999,"15min":2.1200000000000001},"last":1.627},{"interface":"front","average":{"1min":1.534,"5min":1.538,"15min":1.4510000000000001},"min":{"1min":1.1379999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8660000000000001,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.9550000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574958,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":860,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194451,"statfs":{"total":200000000,"available":199118608,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88100000000000001,"15min":0.93400000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.39800000000000002},"max":{"1min":1.2689999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.94599999999999995,"15min":0.93100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5369999999999999,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.0009999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.871},"min":{"1min":0.44800000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.431,"5min":1.528,"15min":1.6020000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.196,"15min":1.1359999999999999},"min":{"1min":0.63800000000000001,"5min":0.51100000000000001,"15min":0.46200000000000002},"max":{"1min":1.617,"5min":1.861,"15min":1.861},"last":1.4630000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.052,"15min":1.0369999999999999},"min":{"1min":0.56699999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.286,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.157,"15min":1.1379999999999999},"min":{"1min":0.55000000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.5820000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.073}]},{"osd":4,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.2390000000000001,"15min":1.212},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73199999999999998},"max":{"1min":1.411,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.3029999999999999,"15min":1.2509999999999999},"min":{"1min":0.93700000000000006,"5min":0.88200000000000001,"15min":0.745},"max":{"1min":1.8280000000000001,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.4279999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.343,"15min":1.2909999999999999},"min":{"1min":0.81899999999999995,"5min":0.754,"15min":0.66700000000000004},"max":{"1min":1.7330000000000001,"5min":1.9790000000000001,"15min":1.994},"last":1.542},{"interface":"front","average":{"1min":1.278,"5min":1.373,"15min":1.415},"min":{"1min":0.95699999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.6419999999999999,"5min":1.7969999999999999,"15min":2.3839999999999999},"last":1.663}]},{"osd":6,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.4430000000000001,"15min":1.4410000000000001},"min":{"1min":1.0660000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.647,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.784},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.3540000000000001,"15min":1.3740000000000001},"min":{"1min":0.83799999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6060000000000001,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.5009999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.4199999999999999,"15min":1.3819999999999999},"min":{"1min":0.81100000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7969999999999999,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.4450000000000001,"15min":1.4079999999999999},"min":{"1min":0.96599999999999997,"5min":0.81499999999999995,"15min":0.80600000000000005},"max":{"1min":1.7729999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.744}]}]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":861,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194451,"statfs":{"total":200000000,"available":199118006,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.86499999999999999,"15min":0.79800000000000004},"min":{"1min":0.40000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2150000000000001,"5min":2.6789999999999998,"15min":6.8879999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.88100000000000001,"15min":0.93200000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.35799999999999998},"max":{"1min":1.1879999999999999,"5min":1.5609999999999999,"15min":4.5510000000000002},"last":1.5549999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.90100000000000002,"15min":0.94599999999999995},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.34000000000000002},"max":{"1min":1.702,"5min":1.702,"15min":11.308999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0760000000000001,"15min":0.96999999999999997},"min":{"1min":0.51000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.7290000000000001,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.419}]},{"osd":3,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0640000000000001,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.47999999999999998,"15min":0.41099999999999998},"max":{"1min":1.462,"5min":1.6359999999999999,"15min":13.087999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.212,"15min":1.1459999999999999},"min":{"1min":0.55200000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.825,"5min":3.2959999999999998,"15min":12.289999999999999},"last":1.119}]},{"osd":4,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.381,"15min":1.2829999999999999},"min":{"1min":0.84299999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.8620000000000001,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.226,"15min":1.341},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.61499999999999999},"max":{"1min":1.6479999999999999,"5min":1.6890000000000001,"15min":13.927},"last":1.49}]},{"osd":5,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2929999999999999,"15min":1.3700000000000001},"min":{"1min":0.80100000000000005,"5min":0.76800000000000002,"15min":0.64000000000000001},"max":{"1min":1.8440000000000001,"5min":1.9530000000000001,"15min":11.003},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.292,"15min":1.294},"min":{"1min":0.879,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.7410000000000001,"5min":2.0470000000000002,"15min":13.129},"last":1.2529999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.3779999999999999,"15min":1.3120000000000001},"min":{"1min":0.98799999999999999,"5min":0.83999999999999997,"15min":0.751},"max":{"1min":1.9810000000000001,"5min":2.1240000000000001,"15min":8.1609999999999996},"last":1.335},{"interface":"front","average":{"1min":1.474,"5min":1.4750000000000001,"15min":1.403},"min":{"1min":0.93300000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9370000000000001,"5min":3.8959999999999999,"15min":6.8150000000000004},"last":1.528}]},{"osd":7,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.347,"15min":1.393},"min":{"1min":0.80900000000000005,"5min":0.753,"15min":0.61299999999999999},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":10.948},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.569,"15min":1.425},"min":{"1min":0.875,"5min":0.875,"15min":0.78200000000000003},"max":{"1min":2.254,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":1.458}]}]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1438,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193873,"statfs":{"total":200000000,"available":198526724,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.93899999999999995,"15min":0.90800000000000003},"min":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.36199999999999999},"max":{"1min":1.087,"5min":4.242,"15min":4.242},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.151,"15min":1.054},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.39900000000000002},"max":{"1min":1.3520000000000001,"5min":4.2030000000000003,"15min":4.2030000000000003},"last":1.119}]},{"osd":2,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.99099999999999999,"15min":0.95799999999999996},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.6000000000000001,"5min":1.732,"15min":1.732},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.0449999999999999,"15min":0.97399999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34999999999999998},"max":{"1min":1.3380000000000001,"5min":1.6499999999999999,"15min":2.254},"last":1.3520000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3260000000000001,"15min":1.21},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.655,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.514},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.091,"15min":0.997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.47799999999999998},"max":{"1min":1.599,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.5660000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.3120000000000001,"15min":1.2769999999999999},"min":{"1min":0.89900000000000002,"5min":0.71299999999999997,"15min":0.58699999999999997},"max":{"1min":1.635,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.415},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4419999999999999,"15min":1.357},"min":{"1min":0.97199999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.738,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.2430000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2969999999999999,"15min":1.2490000000000001},"min":{"1min":0.79900000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.538,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3799999999999999,"15min":1.351},"min":{"1min":0.84399999999999997,"5min":0.79400000000000004,"15min":0.66800000000000004},"max":{"1min":1.6599999999999999,"5min":2.3100000000000001,"15min":4.2130000000000001},"last":1.7549999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3779999999999999,"15min":1.2869999999999999},"min":{"1min":0.82199999999999995,"5min":0.81000000000000005,"15min":0.65200000000000002},"max":{"1min":1.788,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":1.631},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.4750000000000001,"15min":1.393},"min":{"1min":1.077,"5min":0.80600000000000005,"15min":0.67200000000000004},"max":{"1min":1.9059999999999999,"5min":2.2210000000000001,"15min":2.2229999999999999},"last":1.8320000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.4970000000000001,"15min":1.399},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.64400000000000002},"max":{"1min":1.722,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.597},{"interface":"front","average":{"1min":1.411,"5min":1.49,"15min":1.4219999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.66200000000000003},"max":{"1min":1.6950000000000001,"5min":4.508,"15min":4.508},"last":1.6930000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574958,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":862,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194450,"statfs":{"total":200000000,"available":199117058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.85999999999999999,"15min":0.76700000000000002},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2270000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.96499999999999997,"15min":0.91600000000000004},"min":{"1min":0.34599999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.6879999999999999,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.875,"15min":0.81499999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1779999999999999,"5min":1.5229999999999999,"15min":1.6739999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0680000000000001,"15min":0.97099999999999997},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.206}]},{"osd":3,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.177,"15min":1.0629999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0379999999999998,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.228,"15min":1.1060000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.39100000000000001},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.145},"last":1.6519999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.341,"15min":1.2869999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.70799999999999996},"max":{"1min":1.76,"5min":2.625,"15min":2.625},"last":1.234},{"interface":"front","average":{"1min":1.278,"5min":1.343,"15min":1.252},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.649,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.3640000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.425,"15min":1.302},"min":{"1min":0.69599999999999995,"5min":0.67600000000000005,"15min":0.59299999999999997},"max":{"1min":1.847,"5min":5.4290000000000003,"15min":5.4290000000000003},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.3660000000000001,"15min":1.29},"min":{"1min":0.83399999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8680000000000001,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.7509999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.3680000000000001,"15min":1.3049999999999999},"min":{"1min":0.82099999999999995,"5min":0.66900000000000004,"15min":0.64800000000000002},"max":{"1min":1.8,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4950000000000001,"15min":1.413},"min":{"1min":0.90700000000000003,"5min":0.88800000000000001,"15min":0.69099999999999995},"max":{"1min":1.9690000000000001,"5min":2.577,"15min":2.577},"last":1.9550000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.482,"15min":1.391},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.755},"max":{"1min":1.855,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.821},{"interface":"front","average":{"1min":1.363,"5min":1.4650000000000001,"15min":1.399},"min":{"1min":0.88800000000000001,"5min":0.78000000000000003,"15min":0.749},"max":{"1min":2.157,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.909}]}]}],"pool_statfs":[]}} 2023-12-22T08:48:49.976 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:48:50.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.234+0000 7f8a175b9640 1 Processor -- start 2023-12-22T08:48:50.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.235+0000 7f8a175b9640 1 -- start start 2023-12-22T08:48:50.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.236+0000 7f8a175b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a100b2050 0x7f8a100b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:50.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.236+0000 7f8a175b9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8a10070800 0x7f8a10070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:50.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.236+0000 7f8a175b9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a101450f0 con 0x7f8a10144d10 2023-12-22T08:48:50.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.236+0000 7f8a175b9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a100cc840 con 0x7f8a10070800 2023-12-22T08:48:50.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.236+0000 7f8a175b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100ce010 con 0x7f8a100b2050 2023-12-22T08:48:50.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.237+0000 7f8a15b56640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8a10070800 0x7f8a10070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:50.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.237+0000 7f8a15b56640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8a10070800 0x7f8a10070c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34978/0 (socket says 172.21.15.38:34978) 2023-12-22T08:48:50.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.237+0000 7f8a15b56640 1 -- 172.21.15.38:0/259243296 learned_addr learned my addr 172.21.15.38:0/259243296 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:50.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.237+0000 7f8a14b54640 1 --2- 172.21.15.38:0/259243296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a100b2050 0x7f8a100b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:50.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.237+0000 7f8a15b56640 1 -- 172.21.15.38:0/259243296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a100b2050 msgr2=0x7f8a100b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:50.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.237+0000 7f8a15b56640 1 --2- 172.21.15.38:0/259243296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a100b2050 0x7f8a100b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.237+0000 7f8a15b56640 1 -- 172.21.15.38:0/259243296 >> v1:172.21.15.89:6789/0 conn(0x7f8a10144d10 legacy=0x7f8a100cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:50.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.237+0000 7f8a15b56640 1 -- 172.21.15.38:0/259243296 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a100b29f0 con 0x7f8a10070800 2023-12-22T08:48:50.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.239+0000 7f8a15b56640 1 --2- 172.21.15.38:0/259243296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a10070800 0x7f8a10070c50 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009e50 tx=0x7f8a0802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ac80a897b6d0be server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:50.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.239+0000 7f8a07fff640 1 -- 172.21.15.38:0/259243296 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0802ca70 con 0x7f8a10070800 2023-12-22T08:48:50.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.239+0000 7f8a07fff640 1 -- 172.21.15.38:0/259243296 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0802cbd0 con 0x7f8a10070800 2023-12-22T08:48:50.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.239+0000 7f8a07fff640 1 -- 172.21.15.38:0/259243296 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a080343f0 con 0x7f8a10070800 2023-12-22T08:48:50.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.240+0000 7f8a175b9640 1 -- 172.21.15.38:0/259243296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a10070800 msgr2=0x7f8a10070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:50.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.240+0000 7f8a175b9640 1 --2- 172.21.15.38:0/259243296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a10070800 0x7f8a10070c50 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009e50 tx=0x7f8a0802bed0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.240+0000 7f8a175b9640 1 -- 172.21.15.38:0/259243296 shutdown_connections 2023-12-22T08:48:50.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.240+0000 7f8a175b9640 1 --2- 172.21.15.38:0/259243296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a10070800 0x7f8a10070c50 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.240+0000 7f8a175b9640 1 --2- 172.21.15.38:0/259243296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a100b2050 0x7f8a100b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.240+0000 7f8a175b9640 1 -- 172.21.15.38:0/259243296 >> 172.21.15.38:0/259243296 conn(0x7f8a100cf070 msgr2=0x7f8a100cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.240+0000 7f8a175b9640 1 -- 172.21.15.38:0/259243296 shutdown_connections 2023-12-22T08:48:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.240+0000 7f8a175b9640 1 -- 172.21.15.38:0/259243296 wait complete. 2023-12-22T08:48:50.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.242+0000 7f8a175b9640 1 Processor -- start 2023-12-22T08:48:50.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.242+0000 7f8a175b9640 1 -- start start 2023-12-22T08:48:50.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.243+0000 7f8a175b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a10070800 0x7f8a10143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:50.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.243+0000 7f8a175b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a100b2050 0x7f8a10143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:50.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.243+0000 7f8a175b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a10144d10 0x7f8a10136f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.243+0000 7f8a175b9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10158eb0 con 0x7f8a100b2050 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.243+0000 7f8a175b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101342f0 con 0x7f8a10144d10 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.244+0000 7f8a175b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10133a30 con 0x7f8a10070800 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.244+0000 7f8a14b54640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a100b2050 0x7f8a10143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.244+0000 7f8a14b54640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a100b2050 0x7f8a10143da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34984/0 (socket says 172.21.15.38:34984) 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.244+0000 7f8a14b54640 1 -- 172.21.15.38:0/1433124161 learned_addr learned my addr 172.21.15.38:0/1433124161 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.244+0000 7f8a15355640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a10070800 0x7f8a10143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.244+0000 7f8a15b56640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a10144d10 0x7f8a10136f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.244+0000 7f8a14b54640 1 -- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a10070800 msgr2=0x7f8a10143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.244+0000 7f8a14b54640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a10070800 0x7f8a10143860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.244+0000 7f8a14b54640 1 -- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a10144d10 msgr2=0x7f8a10136f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.244+0000 7f8a14b54640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a10144d10 0x7f8a10136f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.244+0000 7f8a14b54640 1 -- 172.21.15.38:0/1433124161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a08009b30 con 0x7f8a100b2050 2023-12-22T08:48:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.245+0000 7f8a14b54640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a100b2050 0x7f8a10143da0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000d800 tx=0x7f8a0000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:50.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.245+0000 7f8a05ffb640 1 -- 172.21.15.38:0/1433124161 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0000b6c0 con 0x7f8a100b2050 2023-12-22T08:48:50.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.245+0000 7f8a05ffb640 1 -- 172.21.15.38:0/1433124161 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0000b820 con 0x7f8a100b2050 2023-12-22T08:48:50.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.245+0000 7f8a175b9640 1 -- 172.21.15.38:0/1433124161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a101f2700 con 0x7f8a100b2050 2023-12-22T08:48:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.245+0000 7f8a05ffb640 1 -- 172.21.15.38:0/1433124161 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0000bbb0 con 0x7f8a100b2050 2023-12-22T08:48:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.245+0000 7f8a175b9640 1 -- 172.21.15.38:0/1433124161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a10133c30 con 0x7f8a100b2050 2023-12-22T08:48:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.246+0000 7f8a175b9640 1 -- 172.21.15.38:0/1433124161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a10061910 con 0x7f8a100b2050 2023-12-22T08:48:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.247+0000 7f8a05ffb640 1 -- 172.21.15.38:0/1433124161 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a0000bd10 con 0x7f8a100b2050 2023-12-22T08:48:50.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.248+0000 7f8a05ffb640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f89f406a480 0x7f89f406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:50.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.248+0000 7f8a05ffb640 1 -- 172.21.15.38:0/1433124161 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a00088db0 con 0x7f8a100b2050 2023-12-22T08:48:50.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.249+0000 7f8a15355640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f89f406a480 0x7f89f406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:50.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.250+0000 7f8a15355640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f89f406a480 0x7f89f406c940 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c006fd0 tx=0x7f8a0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:50.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.253+0000 7f8a05ffb640 1 -- 172.21.15.38:0/1433124161 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8a0008d070 con 0x7f8a100b2050 2023-12-22T08:48:50.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.443+0000 7f8a175b9640 1 -- 172.21.15.38:0/1433124161 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a100ce5d0 con 0x7f89f406a480 2023-12-22T08:48:50.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.466+0000 7f8a05ffb640 1 -- 172.21.15.38:0/1433124161 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283276 (secure 0 0 0) 0x7f8a0c00be30 con 0x7f89f406a480 2023-12-22T08:48:50.470 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:50.472 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:48:50.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.471+0000 7f8a175b9640 1 -- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f89f406a480 msgr2=0x7f89f406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:50.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.471+0000 7f8a175b9640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f89f406a480 0x7f89f406c940 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c006fd0 tx=0x7f8a0c008040 comp rx=0 tx=0).stop 2023-12-22T08:48:50.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.471+0000 7f8a175b9640 1 -- 172.21.15.38:0/1433124161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a100b2050 msgr2=0x7f8a10143da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:50.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.471+0000 7f8a175b9640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a100b2050 0x7f8a10143da0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000d800 tx=0x7f8a0000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.471+0000 7f8a175b9640 1 -- 172.21.15.38:0/1433124161 shutdown_connections 2023-12-22T08:48:50.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.471+0000 7f8a175b9640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a10144d10 0x7f8a10136f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.471+0000 7f8a175b9640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f89f406a480 0x7f89f406c940 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.471+0000 7f8a175b9640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a100b2050 0x7f8a10143da0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.471+0000 7f8a175b9640 1 --2- 172.21.15.38:0/1433124161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a10070800 0x7f8a10143860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.471+0000 7f8a175b9640 1 -- 172.21.15.38:0/1433124161 >> 172.21.15.38:0/1433124161 conn(0x7f8a100cf070 msgr2=0x7f8a10141ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:50.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.471+0000 7f8a175b9640 1 -- 172.21.15.38:0/1433124161 shutdown_connections 2023-12-22T08:48:50.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.472+0000 7f8a175b9640 1 -- 172.21.15.38:0/1433124161 wait complete. 2023-12-22T08:48:50.491 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":420,"stamp":"2023-12-22T08:48:48.549341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8042,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554457,"statfs":{"total":1600000000,"available":1591764983,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.166151"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424664+0000","last_change":"2023-12-22T08:48:44.931786+0000","last_active":"2023-12-22T08:48:46.424664+0000","last_peered":"2023-12-22T08:48:46.424664+0000","last_clean":"2023-12-22T08:48:46.424664+0000","last_became_active":"2023-12-22T08:48:44.931467+0000","last_became_peered":"2023-12-22T08:48:44.931467+0000","last_unstale":"2023-12-22T08:48:46.424664+0000","last_undegraded":"2023-12-22T08:48:46.424664+0000","last_fullsized":"2023-12-22T08:48:46.424664+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:25:17.766760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424347+0000","last_change":"2023-12-22T08:48:44.940861+0000","last_active":"2023-12-22T08:48:46.424347+0000","last_peered":"2023-12-22T08:48:46.424347+0000","last_clean":"2023-12-22T08:48:46.424347+0000","last_became_active":"2023-12-22T08:48:44.938008+0000","last_became_peered":"2023-12-22T08:48:44.938008+0000","last_unstale":"2023-12-22T08:48:46.424347+0000","last_undegraded":"2023-12-22T08:48:46.424347+0000","last_fullsized":"2023-12-22T08:48:46.424347+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:09:39.721906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916938+0000","last_change":"2023-12-22T08:48:44.930309+0000","last_active":"2023-12-22T08:48:45.916938+0000","last_peered":"2023-12-22T08:48:45.916938+0000","last_clean":"2023-12-22T08:48:45.916938+0000","last_became_active":"2023-12-22T08:48:44.929930+0000","last_became_peered":"2023-12-22T08:48:44.929930+0000","last_unstale":"2023-12-22T08:48:45.916938+0000","last_undegraded":"2023-12-22T08:48:45.916938+0000","last_fullsized":"2023-12-22T08:48:45.916938+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:06:16.584659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526633+0000","last_change":"2023-12-22T08:48:44.933183+0000","last_active":"2023-12-22T08:48:46.526633+0000","last_peered":"2023-12-22T08:48:46.526633+0000","last_clean":"2023-12-22T08:48:46.526633+0000","last_became_active":"2023-12-22T08:48:44.932452+0000","last_became_peered":"2023-12-22T08:48:44.932452+0000","last_unstale":"2023-12-22T08:48:46.526633+0000","last_undegraded":"2023-12-22T08:48:46.526633+0000","last_fullsized":"2023-12-22T08:48:46.526633+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:34:54.478829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527333+0000","last_change":"2023-12-22T08:48:44.923093+0000","last_active":"2023-12-22T08:48:46.527333+0000","last_peered":"2023-12-22T08:48:46.527333+0000","last_clean":"2023-12-22T08:48:46.527333+0000","last_became_active":"2023-12-22T08:48:44.922833+0000","last_became_peered":"2023-12-22T08:48:44.922833+0000","last_unstale":"2023-12-22T08:48:46.527333+0000","last_undegraded":"2023-12-22T08:48:46.527333+0000","last_fullsized":"2023-12-22T08:48:46.527333+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:13.916405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283426+0000","last_change":"2023-12-22T08:48:44.938310+0000","last_active":"2023-12-22T08:48:46.283426+0000","last_peered":"2023-12-22T08:48:46.283426+0000","last_clean":"2023-12-22T08:48:46.283426+0000","last_became_active":"2023-12-22T08:48:44.937481+0000","last_became_peered":"2023-12-22T08:48:44.937481+0000","last_unstale":"2023-12-22T08:48:46.283426+0000","last_undegraded":"2023-12-22T08:48:46.283426+0000","last_fullsized":"2023-12-22T08:48:46.283426+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:37:58.760061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526702+0000","last_change":"2023-12-22T08:48:44.930835+0000","last_active":"2023-12-22T08:48:46.526702+0000","last_peered":"2023-12-22T08:48:46.526702+0000","last_clean":"2023-12-22T08:48:46.526702+0000","last_became_active":"2023-12-22T08:48:44.925715+0000","last_became_peered":"2023-12-22T08:48:44.925715+0000","last_unstale":"2023-12-22T08:48:46.526702+0000","last_undegraded":"2023-12-22T08:48:46.526702+0000","last_fullsized":"2023-12-22T08:48:46.526702+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:54:01.511933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526493+0000","last_change":"2023-12-22T08:48:44.939794+0000","last_active":"2023-12-22T08:48:46.526493+0000","last_peered":"2023-12-22T08:48:46.526493+0000","last_clean":"2023-12-22T08:48:46.526493+0000","last_became_active":"2023-12-22T08:48:44.939583+0000","last_became_peered":"2023-12-22T08:48:44.939583+0000","last_unstale":"2023-12-22T08:48:46.526493+0000","last_undegraded":"2023-12-22T08:48:46.526493+0000","last_fullsized":"2023-12-22T08:48:46.526493+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:22:59.079738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.915942+0000","last_change":"2023-12-22T08:48:44.932007+0000","last_active":"2023-12-22T08:48:45.915942+0000","last_peered":"2023-12-22T08:48:45.915942+0000","last_clean":"2023-12-22T08:48:45.915942+0000","last_became_active":"2023-12-22T08:48:44.931799+0000","last_became_peered":"2023-12-22T08:48:44.931799+0000","last_unstale":"2023-12-22T08:48:45.915942+0000","last_undegraded":"2023-12-22T08:48:45.915942+0000","last_fullsized":"2023-12-22T08:48:45.915942+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:46:07.126570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424569+0000","last_change":"2023-12-22T08:48:44.934780+0000","last_active":"2023-12-22T08:48:46.424569+0000","last_peered":"2023-12-22T08:48:46.424569+0000","last_clean":"2023-12-22T08:48:46.424569+0000","last_became_active":"2023-12-22T08:48:44.933753+0000","last_became_peered":"2023-12-22T08:48:44.933753+0000","last_unstale":"2023-12-22T08:48:46.424569+0000","last_undegraded":"2023-12-22T08:48:46.424569+0000","last_fullsized":"2023-12-22T08:48:46.424569+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:55:25.534573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527149+0000","last_change":"2023-12-22T08:48:44.936295+0000","last_active":"2023-12-22T08:48:46.527149+0000","last_peered":"2023-12-22T08:48:46.527149+0000","last_clean":"2023-12-22T08:48:46.527149+0000","last_became_active":"2023-12-22T08:48:44.935898+0000","last_became_peered":"2023-12-22T08:48:44.935898+0000","last_unstale":"2023-12-22T08:48:46.527149+0000","last_undegraded":"2023-12-22T08:48:46.527149+0000","last_fullsized":"2023-12-22T08:48:46.527149+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:13.916405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283324+0000","last_change":"2023-12-22T08:48:44.933750+0000","last_active":"2023-12-22T08:48:46.283324+0000","last_peered":"2023-12-22T08:48:46.283324+0000","last_clean":"2023-12-22T08:48:46.283324+0000","last_became_active":"2023-12-22T08:48:44.933077+0000","last_became_peered":"2023-12-22T08:48:44.933077+0000","last_unstale":"2023-12-22T08:48:46.283324+0000","last_undegraded":"2023-12-22T08:48:46.283324+0000","last_fullsized":"2023-12-22T08:48:46.283324+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:15.679672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527297+0000","last_change":"2023-12-22T08:48:44.928866+0000","last_active":"2023-12-22T08:48:46.527297+0000","last_peered":"2023-12-22T08:48:46.527297+0000","last_clean":"2023-12-22T08:48:46.527297+0000","last_became_active":"2023-12-22T08:48:44.928563+0000","last_became_peered":"2023-12-22T08:48:44.928563+0000","last_unstale":"2023-12-22T08:48:46.527297+0000","last_undegraded":"2023-12-22T08:48:46.527297+0000","last_fullsized":"2023-12-22T08:48:46.527297+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:09:06.975620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914339+0000","last_change":"2023-12-22T08:48:44.935130+0000","last_active":"2023-12-22T08:48:45.914339+0000","last_peered":"2023-12-22T08:48:45.914339+0000","last_clean":"2023-12-22T08:48:45.914339+0000","last_became_active":"2023-12-22T08:48:44.934852+0000","last_became_peered":"2023-12-22T08:48:44.934852+0000","last_unstale":"2023-12-22T08:48:45.914339+0000","last_undegraded":"2023-12-22T08:48:45.914339+0000","last_fullsized":"2023-12-22T08:48:45.914339+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:35:20.883279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916004+0000","last_change":"2023-12-22T08:48:44.936516+0000","last_active":"2023-12-22T08:48:45.916004+0000","last_peered":"2023-12-22T08:48:45.916004+0000","last_clean":"2023-12-22T08:48:45.916004+0000","last_became_active":"2023-12-22T08:48:44.936244+0000","last_became_peered":"2023-12-22T08:48:44.936244+0000","last_unstale":"2023-12-22T08:48:45.916004+0000","last_undegraded":"2023-12-22T08:48:45.916004+0000","last_fullsized":"2023-12-22T08:48:45.916004+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:10:08.635288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916119+0000","last_change":"2023-12-22T08:48:44.929041+0000","last_active":"2023-12-22T08:48:45.916119+0000","last_peered":"2023-12-22T08:48:45.916119+0000","last_clean":"2023-12-22T08:48:45.916119+0000","last_became_active":"2023-12-22T08:48:44.927935+0000","last_became_peered":"2023-12-22T08:48:44.927935+0000","last_unstale":"2023-12-22T08:48:45.916119+0000","last_undegraded":"2023-12-22T08:48:45.916119+0000","last_fullsized":"2023-12-22T08:48:45.916119+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:03:58.757538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916161+0000","last_change":"2023-12-22T08:48:44.936244+0000","last_active":"2023-12-22T08:48:45.916161+0000","last_peered":"2023-12-22T08:48:45.916161+0000","last_clean":"2023-12-22T08:48:45.916161+0000","last_became_active":"2023-12-22T08:48:44.935964+0000","last_became_peered":"2023-12-22T08:48:44.935964+0000","last_unstale":"2023-12-22T08:48:45.916161+0000","last_undegraded":"2023-12-22T08:48:45.916161+0000","last_fullsized":"2023-12-22T08:48:45.916161+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:09:14.236053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914738+0000","last_change":"2023-12-22T08:48:44.929432+0000","last_active":"2023-12-22T08:48:45.914738+0000","last_peered":"2023-12-22T08:48:45.914738+0000","last_clean":"2023-12-22T08:48:45.914738+0000","last_became_active":"2023-12-22T08:48:44.929145+0000","last_became_peered":"2023-12-22T08:48:44.929145+0000","last_unstale":"2023-12-22T08:48:45.914738+0000","last_undegraded":"2023-12-22T08:48:45.914738+0000","last_fullsized":"2023-12-22T08:48:45.914738+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:23:24.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424444+0000","last_change":"2023-12-22T08:48:44.937565+0000","last_active":"2023-12-22T08:48:46.424444+0000","last_peered":"2023-12-22T08:48:46.424444+0000","last_clean":"2023-12-22T08:48:46.424444+0000","last_became_active":"2023-12-22T08:48:44.936810+0000","last_became_peered":"2023-12-22T08:48:44.936810+0000","last_unstale":"2023-12-22T08:48:46.424444+0000","last_undegraded":"2023-12-22T08:48:46.424444+0000","last_fullsized":"2023-12-22T08:48:46.424444+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:23.665486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916273+0000","last_change":"2023-12-22T08:48:44.940053+0000","last_active":"2023-12-22T08:48:45.916273+0000","last_peered":"2023-12-22T08:48:45.916273+0000","last_clean":"2023-12-22T08:48:45.916273+0000","last_became_active":"2023-12-22T08:48:44.939789+0000","last_became_peered":"2023-12-22T08:48:44.939789+0000","last_unstale":"2023-12-22T08:48:45.916273+0000","last_undegraded":"2023-12-22T08:48:45.916273+0000","last_fullsized":"2023-12-22T08:48:45.916273+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:07:35.009495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283699+0000","last_change":"2023-12-22T08:48:44.924324+0000","last_active":"2023-12-22T08:48:46.283699+0000","last_peered":"2023-12-22T08:48:46.283699+0000","last_clean":"2023-12-22T08:48:46.283699+0000","last_became_active":"2023-12-22T08:48:44.924103+0000","last_became_peered":"2023-12-22T08:48:44.924103+0000","last_unstale":"2023-12-22T08:48:46.283699+0000","last_undegraded":"2023-12-22T08:48:46.283699+0000","last_fullsized":"2023-12-22T08:48:46.283699+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:29:37.390473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424691+0000","last_change":"2023-12-22T08:48:44.941733+0000","last_active":"2023-12-22T08:48:46.424691+0000","last_peered":"2023-12-22T08:48:46.424691+0000","last_clean":"2023-12-22T08:48:46.424691+0000","last_became_active":"2023-12-22T08:48:44.939004+0000","last_became_peered":"2023-12-22T08:48:44.939004+0000","last_unstale":"2023-12-22T08:48:46.424691+0000","last_undegraded":"2023-12-22T08:48:46.424691+0000","last_fullsized":"2023-12-22T08:48:46.424691+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:49:28.091311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527012+0000","last_change":"2023-12-22T08:48:44.940873+0000","last_active":"2023-12-22T08:48:46.527012+0000","last_peered":"2023-12-22T08:48:46.527012+0000","last_clean":"2023-12-22T08:48:46.527012+0000","last_became_active":"2023-12-22T08:48:44.940395+0000","last_became_peered":"2023-12-22T08:48:44.940395+0000","last_unstale":"2023-12-22T08:48:46.527012+0000","last_undegraded":"2023-12-22T08:48:46.527012+0000","last_fullsized":"2023-12-22T08:48:46.527012+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:30:07.721084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914529+0000","last_change":"2023-12-22T08:48:44.937473+0000","last_active":"2023-12-22T08:48:45.914529+0000","last_peered":"2023-12-22T08:48:45.914529+0000","last_clean":"2023-12-22T08:48:45.914529+0000","last_became_active":"2023-12-22T08:48:44.934613+0000","last_became_peered":"2023-12-22T08:48:44.934613+0000","last_unstale":"2023-12-22T08:48:45.914529+0000","last_undegraded":"2023-12-22T08:48:45.914529+0000","last_fullsized":"2023-12-22T08:48:45.914529+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:33.513745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526841+0000","last_change":"2023-12-22T08:48:44.930050+0000","last_active":"2023-12-22T08:48:46.526841+0000","last_peered":"2023-12-22T08:48:46.526841+0000","last_clean":"2023-12-22T08:48:46.526841+0000","last_became_active":"2023-12-22T08:48:44.929798+0000","last_became_peered":"2023-12-22T08:48:44.929798+0000","last_unstale":"2023-12-22T08:48:46.526841+0000","last_undegraded":"2023-12-22T08:48:46.526841+0000","last_fullsized":"2023-12-22T08:48:46.526841+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:04:22.422858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424844+0000","last_change":"2023-12-22T08:48:44.939823+0000","last_active":"2023-12-22T08:48:46.424844+0000","last_peered":"2023-12-22T08:48:46.424844+0000","last_clean":"2023-12-22T08:48:46.424844+0000","last_became_active":"2023-12-22T08:48:44.938380+0000","last_became_peered":"2023-12-22T08:48:44.938380+0000","last_unstale":"2023-12-22T08:48:46.424844+0000","last_undegraded":"2023-12-22T08:48:46.424844+0000","last_fullsized":"2023-12-22T08:48:46.424844+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:04.596606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914502+0000","last_change":"2023-12-22T08:48:44.925010+0000","last_active":"2023-12-22T08:48:45.914502+0000","last_peered":"2023-12-22T08:48:45.914502+0000","last_clean":"2023-12-22T08:48:45.914502+0000","last_became_active":"2023-12-22T08:48:44.924432+0000","last_became_peered":"2023-12-22T08:48:44.924432+0000","last_unstale":"2023-12-22T08:48:45.914502+0000","last_undegraded":"2023-12-22T08:48:45.914502+0000","last_fullsized":"2023-12-22T08:48:45.914502+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:47:42.718315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526611+0000","last_change":"2023-12-22T08:48:44.940710+0000","last_active":"2023-12-22T08:48:46.526611+0000","last_peered":"2023-12-22T08:48:46.526611+0000","last_clean":"2023-12-22T08:48:46.526611+0000","last_became_active":"2023-12-22T08:48:44.939920+0000","last_became_peered":"2023-12-22T08:48:44.939920+0000","last_unstale":"2023-12-22T08:48:46.526611+0000","last_undegraded":"2023-12-22T08:48:46.526611+0000","last_fullsized":"2023-12-22T08:48:46.526611+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:10:08.635288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424198+0000","last_change":"2023-12-22T08:48:44.928381+0000","last_active":"2023-12-22T08:48:46.424198+0000","last_peered":"2023-12-22T08:48:46.424198+0000","last_clean":"2023-12-22T08:48:46.424198+0000","last_became_active":"2023-12-22T08:48:44.927954+0000","last_became_peered":"2023-12-22T08:48:44.927954+0000","last_unstale":"2023-12-22T08:48:46.424198+0000","last_undegraded":"2023-12-22T08:48:46.424198+0000","last_fullsized":"2023-12-22T08:48:46.424198+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:24:40.895405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.425010+0000","last_change":"2023-12-22T08:48:44.936738+0000","last_active":"2023-12-22T08:48:46.425010+0000","last_peered":"2023-12-22T08:48:46.425010+0000","last_clean":"2023-12-22T08:48:46.425010+0000","last_became_active":"2023-12-22T08:48:44.936410+0000","last_became_peered":"2023-12-22T08:48:44.936410+0000","last_unstale":"2023-12-22T08:48:46.425010+0000","last_undegraded":"2023-12-22T08:48:46.425010+0000","last_fullsized":"2023-12-22T08:48:46.425010+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:35:25.020152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527240+0000","last_change":"2023-12-22T08:48:44.935590+0000","last_active":"2023-12-22T08:48:46.527240+0000","last_peered":"2023-12-22T08:48:46.527240+0000","last_clean":"2023-12-22T08:48:46.527240+0000","last_became_active":"2023-12-22T08:48:44.934694+0000","last_became_peered":"2023-12-22T08:48:44.934694+0000","last_unstale":"2023-12-22T08:48:46.527240+0000","last_undegraded":"2023-12-22T08:48:46.527240+0000","last_fullsized":"2023-12-22T08:48:46.527240+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:30:49.812235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.915991+0000","last_change":"2023-12-22T08:48:44.942180+0000","last_active":"2023-12-22T08:48:45.915991+0000","last_peered":"2023-12-22T08:48:45.915991+0000","last_clean":"2023-12-22T08:48:45.915991+0000","last_became_active":"2023-12-22T08:48:44.941825+0000","last_became_peered":"2023-12-22T08:48:44.941825+0000","last_unstale":"2023-12-22T08:48:45.915991+0000","last_undegraded":"2023-12-22T08:48:45.915991+0000","last_fullsized":"2023-12-22T08:48:45.915991+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:41.593242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914592+0000","last_change":"2023-12-22T08:48:44.927900+0000","last_active":"2023-12-22T08:48:45.914592+0000","last_peered":"2023-12-22T08:48:45.914592+0000","last_clean":"2023-12-22T08:48:45.914592+0000","last_became_active":"2023-12-22T08:48:44.927491+0000","last_became_peered":"2023-12-22T08:48:44.927491+0000","last_unstale":"2023-12-22T08:48:45.914592+0000","last_undegraded":"2023-12-22T08:48:45.914592+0000","last_fullsized":"2023-12-22T08:48:45.914592+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:54:01.511933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"157'4","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.941466+0000","last_change":"2023-12-22T08:48:44.412930+0000","last_active":"2023-12-22T08:48:44.941466+0000","last_peered":"2023-12-22T08:48:44.941466+0000","last_clean":"2023-12-22T08:48:44.941466+0000","last_became_active":"2023-12-22T08:48:44.412529+0000","last_became_peered":"2023-12-22T08:48:44.412529+0000","last_unstale":"2023-12-22T08:48:44.941466+0000","last_undegraded":"2023-12-22T08:48:44.941466+0000","last_fullsized":"2023-12-22T08:48:44.941466+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:37:57.747287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.917188+0000","last_change":"2023-12-22T08:48:44.934515+0000","last_active":"2023-12-22T08:48:45.917188+0000","last_peered":"2023-12-22T08:48:45.917188+0000","last_clean":"2023-12-22T08:48:45.917188+0000","last_became_active":"2023-12-22T08:48:44.934232+0000","last_became_peered":"2023-12-22T08:48:44.934232+0000","last_unstale":"2023-12-22T08:48:45.917188+0000","last_undegraded":"2023-12-22T08:48:45.917188+0000","last_fullsized":"2023-12-22T08:48:45.917188+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:41:35.562020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.925354+0000","last_change":"2023-12-22T08:48:44.417585+0000","last_active":"2023-12-22T08:48:44.925354+0000","last_peered":"2023-12-22T08:48:44.925354+0000","last_clean":"2023-12-22T08:48:44.925354+0000","last_became_active":"2023-12-22T08:48:44.417031+0000","last_became_peered":"2023-12-22T08:48:44.417031+0000","last_unstale":"2023-12-22T08:48:44.925354+0000","last_undegraded":"2023-12-22T08:48:44.925354+0000","last_fullsized":"2023-12-22T08:48:44.925354+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:35:24.007378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916002+0000","last_change":"2023-12-22T08:48:44.926853+0000","last_active":"2023-12-22T08:48:45.916002+0000","last_peered":"2023-12-22T08:48:45.916002+0000","last_clean":"2023-12-22T08:48:45.916002+0000","last_became_active":"2023-12-22T08:48:44.926631+0000","last_became_peered":"2023-12-22T08:48:44.926631+0000","last_unstale":"2023-12-22T08:48:45.916002+0000","last_undegraded":"2023-12-22T08:48:45.916002+0000","last_fullsized":"2023-12-22T08:48:45.916002+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:19:30.413025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.935888+0000","last_change":"2023-12-22T08:48:44.410977+0000","last_active":"2023-12-22T08:48:44.935888+0000","last_peered":"2023-12-22T08:48:44.935888+0000","last_clean":"2023-12-22T08:48:44.935888+0000","last_became_active":"2023-12-22T08:48:44.410626+0000","last_became_peered":"2023-12-22T08:48:44.410626+0000","last_unstale":"2023-12-22T08:48:44.935888+0000","last_undegraded":"2023-12-22T08:48:44.935888+0000","last_fullsized":"2023-12-22T08:48:44.935888+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:51:42.413000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.284228+0000","last_change":"2023-12-22T08:48:44.932768+0000","last_active":"2023-12-22T08:48:46.284228+0000","last_peered":"2023-12-22T08:48:46.284228+0000","last_clean":"2023-12-22T08:48:46.284228+0000","last_became_active":"2023-12-22T08:48:44.932538+0000","last_became_peered":"2023-12-22T08:48:44.932538+0000","last_unstale":"2023-12-22T08:48:46.284228+0000","last_undegraded":"2023-12-22T08:48:46.284228+0000","last_fullsized":"2023-12-22T08:48:46.284228+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:51:43.425774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.942542+0000","last_change":"2023-12-22T08:48:44.414108+0000","last_active":"2023-12-22T08:48:44.942542+0000","last_peered":"2023-12-22T08:48:44.942542+0000","last_clean":"2023-12-22T08:48:44.942542+0000","last_became_active":"2023-12-22T08:48:44.413144+0000","last_became_peered":"2023-12-22T08:48:44.413144+0000","last_unstale":"2023-12-22T08:48:44.942542+0000","last_undegraded":"2023-12-22T08:48:44.942542+0000","last_fullsized":"2023-12-22T08:48:44.942542+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:27:56.594356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914984+0000","last_change":"2023-12-22T08:48:44.938251+0000","last_active":"2023-12-22T08:48:45.914984+0000","last_peered":"2023-12-22T08:48:45.914984+0000","last_clean":"2023-12-22T08:48:45.914984+0000","last_became_active":"2023-12-22T08:48:44.938008+0000","last_became_peered":"2023-12-22T08:48:44.938008+0000","last_unstale":"2023-12-22T08:48:45.914984+0000","last_undegraded":"2023-12-22T08:48:45.914984+0000","last_fullsized":"2023-12-22T08:48:45.914984+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:30:07.721084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.943115+0000","last_change":"2023-12-22T08:48:44.415222+0000","last_active":"2023-12-22T08:48:44.943115+0000","last_peered":"2023-12-22T08:48:44.943115+0000","last_clean":"2023-12-22T08:48:44.943115+0000","last_became_active":"2023-12-22T08:48:44.414733+0000","last_became_peered":"2023-12-22T08:48:44.414733+0000","last_unstale":"2023-12-22T08:48:44.943115+0000","last_undegraded":"2023-12-22T08:48:44.943115+0000","last_fullsized":"2023-12-22T08:48:44.943115+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:09:05.962845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283585+0000","last_change":"2023-12-22T08:48:44.933878+0000","last_active":"2023-12-22T08:48:46.283585+0000","last_peered":"2023-12-22T08:48:46.283585+0000","last_clean":"2023-12-22T08:48:46.283585+0000","last_became_active":"2023-12-22T08:48:44.933376+0000","last_became_peered":"2023-12-22T08:48:44.933376+0000","last_unstale":"2023-12-22T08:48:46.283585+0000","last_undegraded":"2023-12-22T08:48:46.283585+0000","last_fullsized":"2023-12-22T08:48:46.283585+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:46.037114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.937361+0000","last_change":"2023-12-22T08:48:44.408966+0000","last_active":"2023-12-22T08:48:44.937361+0000","last_peered":"2023-12-22T08:48:44.937361+0000","last_clean":"2023-12-22T08:48:44.937361+0000","last_became_active":"2023-12-22T08:48:44.408626+0000","last_became_peered":"2023-12-22T08:48:44.408626+0000","last_unstale":"2023-12-22T08:48:44.937361+0000","last_undegraded":"2023-12-22T08:48:44.937361+0000","last_fullsized":"2023-12-22T08:48:44.937361+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:00:32.922538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283646+0000","last_change":"2023-12-22T08:48:44.928951+0000","last_active":"2023-12-22T08:48:46.283646+0000","last_peered":"2023-12-22T08:48:46.283646+0000","last_clean":"2023-12-22T08:48:46.283646+0000","last_became_active":"2023-12-22T08:48:44.928738+0000","last_became_peered":"2023-12-22T08:48:44.928738+0000","last_unstale":"2023-12-22T08:48:46.283646+0000","last_undegraded":"2023-12-22T08:48:46.283646+0000","last_fullsized":"2023-12-22T08:48:46.283646+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:54:01.511933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.915163+0000","last_change":"2023-12-22T08:48:44.412865+0000","last_active":"2023-12-22T08:48:44.915163+0000","last_peered":"2023-12-22T08:48:44.915163+0000","last_clean":"2023-12-22T08:48:44.915163+0000","last_became_active":"2023-12-22T08:48:44.410542+0000","last_became_peered":"2023-12-22T08:48:44.410542+0000","last_unstale":"2023-12-22T08:48:44.915163+0000","last_undegraded":"2023-12-22T08:48:44.915163+0000","last_fullsized":"2023-12-22T08:48:44.915163+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:29.010120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424591+0000","last_change":"2023-12-22T08:48:44.941906+0000","last_active":"2023-12-22T08:48:46.424591+0000","last_peered":"2023-12-22T08:48:46.424591+0000","last_clean":"2023-12-22T08:48:46.424591+0000","last_became_active":"2023-12-22T08:48:44.941183+0000","last_became_peered":"2023-12-22T08:48:44.941183+0000","last_unstale":"2023-12-22T08:48:46.424591+0000","last_undegraded":"2023-12-22T08:48:46.424591+0000","last_fullsized":"2023-12-22T08:48:46.424591+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:16:51.643566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.930280+0000","last_change":"2023-12-22T08:48:44.415160+0000","last_active":"2023-12-22T08:48:44.930280+0000","last_peered":"2023-12-22T08:48:44.930280+0000","last_clean":"2023-12-22T08:48:44.930280+0000","last_became_active":"2023-12-22T08:48:44.414887+0000","last_became_peered":"2023-12-22T08:48:44.414887+0000","last_unstale":"2023-12-22T08:48:44.930280+0000","last_undegraded":"2023-12-22T08:48:44.930280+0000","last_fullsized":"2023-12-22T08:48:44.930280+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:34:53.466054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424967+0000","last_change":"2023-12-22T08:48:44.941964+0000","last_active":"2023-12-22T08:48:46.424967+0000","last_peered":"2023-12-22T08:48:46.424967+0000","last_clean":"2023-12-22T08:48:46.424967+0000","last_became_active":"2023-12-22T08:48:44.940620+0000","last_became_peered":"2023-12-22T08:48:44.940620+0000","last_unstale":"2023-12-22T08:48:46.424967+0000","last_undegraded":"2023-12-22T08:48:46.424967+0000","last_fullsized":"2023-12-22T08:48:46.424967+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:11:12.888926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.921211+0000","last_change":"2023-12-22T08:48:44.421025+0000","last_active":"2023-12-22T08:48:44.921211+0000","last_peered":"2023-12-22T08:48:44.921211+0000","last_clean":"2023-12-22T08:48:44.921211+0000","last_became_active":"2023-12-22T08:48:44.420756+0000","last_became_peered":"2023-12-22T08:48:44.420756+0000","last_unstale":"2023-12-22T08:48:44.921211+0000","last_undegraded":"2023-12-22T08:48:44.921211+0000","last_fullsized":"2023-12-22T08:48:44.921211+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:30:06.708309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526667+0000","last_change":"2023-12-22T08:48:44.936368+0000","last_active":"2023-12-22T08:48:46.526667+0000","last_peered":"2023-12-22T08:48:46.526667+0000","last_clean":"2023-12-22T08:48:46.526667+0000","last_became_active":"2023-12-22T08:48:44.936141+0000","last_became_peered":"2023-12-22T08:48:44.936141+0000","last_unstale":"2023-12-22T08:48:46.526667+0000","last_undegraded":"2023-12-22T08:48:46.526667+0000","last_fullsized":"2023-12-22T08:48:46.526667+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:22:07.648049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.920610+0000","last_change":"2023-12-22T08:48:44.410489+0000","last_active":"2023-12-22T08:48:44.920610+0000","last_peered":"2023-12-22T08:48:44.920610+0000","last_clean":"2023-12-22T08:48:44.920610+0000","last_became_active":"2023-12-22T08:48:44.409988+0000","last_became_peered":"2023-12-22T08:48:44.409988+0000","last_unstale":"2023-12-22T08:48:44.920610+0000","last_undegraded":"2023-12-22T08:48:44.920610+0000","last_fullsized":"2023-12-22T08:48:44.920610+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:10:49.400511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283478+0000","last_change":"2023-12-22T08:48:44.927817+0000","last_active":"2023-12-22T08:48:46.283478+0000","last_peered":"2023-12-22T08:48:46.283478+0000","last_clean":"2023-12-22T08:48:46.283478+0000","last_became_active":"2023-12-22T08:48:44.927338+0000","last_became_peered":"2023-12-22T08:48:44.927338+0000","last_unstale":"2023-12-22T08:48:46.283478+0000","last_undegraded":"2023-12-22T08:48:46.283478+0000","last_fullsized":"2023-12-22T08:48:46.283478+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:40.357452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"157'3","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.941383+0000","last_change":"2023-12-22T08:48:44.412766+0000","last_active":"2023-12-22T08:48:44.941383+0000","last_peered":"2023-12-22T08:48:44.941383+0000","last_clean":"2023-12-22T08:48:44.941383+0000","last_became_active":"2023-12-22T08:48:44.412135+0000","last_became_peered":"2023-12-22T08:48:44.412135+0000","last_unstale":"2023-12-22T08:48:44.941383+0000","last_undegraded":"2023-12-22T08:48:44.941383+0000","last_fullsized":"2023-12-22T08:48:44.941383+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:39.344677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527281+0000","last_change":"2023-12-22T08:48:44.935297+0000","last_active":"2023-12-22T08:48:46.527281+0000","last_peered":"2023-12-22T08:48:46.527281+0000","last_clean":"2023-12-22T08:48:46.527281+0000","last_became_active":"2023-12-22T08:48:44.934341+0000","last_became_peered":"2023-12-22T08:48:44.934341+0000","last_unstale":"2023-12-22T08:48:46.527281+0000","last_undegraded":"2023-12-22T08:48:46.527281+0000","last_fullsized":"2023-12-22T08:48:46.527281+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:07:35.009495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"157'6","reported_seq":17,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.944097+0000","last_change":"2023-12-22T08:48:44.421503+0000","last_active":"2023-12-22T08:48:44.944097+0000","last_peered":"2023-12-22T08:48:44.944097+0000","last_clean":"2023-12-22T08:48:44.944097+0000","last_became_active":"2023-12-22T08:48:44.421233+0000","last_became_peered":"2023-12-22T08:48:44.421233+0000","last_unstale":"2023-12-22T08:48:44.944097+0000","last_undegraded":"2023-12-22T08:48:44.944097+0000","last_fullsized":"2023-12-22T08:48:44.944097+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:14:43.362707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916362+0000","last_change":"2023-12-22T08:48:44.934459+0000","last_active":"2023-12-22T08:48:45.916362+0000","last_peered":"2023-12-22T08:48:45.916362+0000","last_clean":"2023-12-22T08:48:45.916362+0000","last_became_active":"2023-12-22T08:48:44.933968+0000","last_became_peered":"2023-12-22T08:48:44.933968+0000","last_unstale":"2023-12-22T08:48:45.916362+0000","last_undegraded":"2023-12-22T08:48:45.916362+0000","last_fullsized":"2023-12-22T08:48:45.916362+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:33:54.484505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.920676+0000","last_change":"2023-12-22T08:48:44.407582+0000","last_active":"2023-12-22T08:48:44.920676+0000","last_peered":"2023-12-22T08:48:44.920676+0000","last_clean":"2023-12-22T08:48:44.920676+0000","last_became_active":"2023-12-22T08:48:44.407221+0000","last_became_peered":"2023-12-22T08:48:44.407221+0000","last_unstale":"2023-12-22T08:48:44.920676+0000","last_undegraded":"2023-12-22T08:48:44.920676+0000","last_fullsized":"2023-12-22T08:48:44.920676+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:21:27.710366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916043+0000","last_change":"2023-12-22T08:48:44.932407+0000","last_active":"2023-12-22T08:48:45.916043+0000","last_peered":"2023-12-22T08:48:45.916043+0000","last_clean":"2023-12-22T08:48:45.916043+0000","last_became_active":"2023-12-22T08:48:44.931825+0000","last_became_peered":"2023-12-22T08:48:44.931825+0000","last_unstale":"2023-12-22T08:48:45.916043+0000","last_undegraded":"2023-12-22T08:48:45.916043+0000","last_fullsized":"2023-12-22T08:48:45.916043+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:51:43.425774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.917404+0000","last_change":"2023-12-22T08:48:44.420889+0000","last_active":"2023-12-22T08:48:44.917404+0000","last_peered":"2023-12-22T08:48:44.917404+0000","last_clean":"2023-12-22T08:48:44.917404+0000","last_became_active":"2023-12-22T08:48:44.420589+0000","last_became_peered":"2023-12-22T08:48:44.420589+0000","last_unstale":"2023-12-22T08:48:44.917404+0000","last_undegraded":"2023-12-22T08:48:44.917404+0000","last_fullsized":"2023-12-22T08:48:44.917404+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:45.024339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.284059+0000","last_change":"2023-12-22T08:48:44.933610+0000","last_active":"2023-12-22T08:48:46.284059+0000","last_peered":"2023-12-22T08:48:46.284059+0000","last_clean":"2023-12-22T08:48:46.284059+0000","last_became_active":"2023-12-22T08:48:44.932771+0000","last_became_peered":"2023-12-22T08:48:44.932771+0000","last_unstale":"2023-12-22T08:48:46.284059+0000","last_undegraded":"2023-12-22T08:48:46.284059+0000","last_fullsized":"2023-12-22T08:48:46.284059+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:09:25.230602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"157'8","reported_seq":19,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.937876+0000","last_change":"2023-12-22T08:48:44.410500+0000","last_active":"2023-12-22T08:48:44.937876+0000","last_peered":"2023-12-22T08:48:44.937876+0000","last_clean":"2023-12-22T08:48:44.937876+0000","last_became_active":"2023-12-22T08:48:44.409980+0000","last_became_peered":"2023-12-22T08:48:44.409980+0000","last_unstale":"2023-12-22T08:48:44.937876+0000","last_undegraded":"2023-12-22T08:48:44.937876+0000","last_fullsized":"2023-12-22T08:48:44.937876+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:30:48.799461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527570+0000","last_change":"2023-12-22T08:48:44.921948+0000","last_active":"2023-12-22T08:48:46.527570+0000","last_peered":"2023-12-22T08:48:46.527570+0000","last_clean":"2023-12-22T08:48:46.527570+0000","last_became_active":"2023-12-22T08:48:44.921647+0000","last_became_peered":"2023-12-22T08:48:44.921647+0000","last_unstale":"2023-12-22T08:48:46.527570+0000","last_undegraded":"2023-12-22T08:48:46.527570+0000","last_fullsized":"2023-12-22T08:48:46.527570+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:18:08.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.926662+0000","last_change":"2023-12-22T08:48:44.419969+0000","last_active":"2023-12-22T08:48:44.926662+0000","last_peered":"2023-12-22T08:48:44.926662+0000","last_clean":"2023-12-22T08:48:44.926662+0000","last_became_active":"2023-12-22T08:48:44.418228+0000","last_became_peered":"2023-12-22T08:48:44.418228+0000","last_unstale":"2023-12-22T08:48:44.926662+0000","last_undegraded":"2023-12-22T08:48:44.926662+0000","last_fullsized":"2023-12-22T08:48:44.926662+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:34.796899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.526420+0000","last_change":"2023-12-22T08:48:44.937199+0000","last_active":"2023-12-22T08:48:46.526420+0000","last_peered":"2023-12-22T08:48:46.526420+0000","last_clean":"2023-12-22T08:48:46.526420+0000","last_became_active":"2023-12-22T08:48:44.935718+0000","last_became_peered":"2023-12-22T08:48:44.935718+0000","last_unstale":"2023-12-22T08:48:46.526420+0000","last_undegraded":"2023-12-22T08:48:46.526420+0000","last_fullsized":"2023-12-22T08:48:46.526420+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:47:42.718315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.937908+0000","last_change":"2023-12-22T08:48:44.413739+0000","last_active":"2023-12-22T08:48:44.937908+0000","last_peered":"2023-12-22T08:48:44.937908+0000","last_clean":"2023-12-22T08:48:44.937908+0000","last_became_active":"2023-12-22T08:48:44.413442+0000","last_became_peered":"2023-12-22T08:48:44.413442+0000","last_unstale":"2023-12-22T08:48:44.937908+0000","last_undegraded":"2023-12-22T08:48:44.937908+0000","last_fullsized":"2023-12-22T08:48:44.937908+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:03:57.744764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.425233+0000","last_change":"2023-12-22T08:48:44.941000+0000","last_active":"2023-12-22T08:48:46.425233+0000","last_peered":"2023-12-22T08:48:46.425233+0000","last_clean":"2023-12-22T08:48:46.425233+0000","last_became_active":"2023-12-22T08:48:44.938353+0000","last_became_peered":"2023-12-22T08:48:44.938353+0000","last_unstale":"2023-12-22T08:48:46.425233+0000","last_undegraded":"2023-12-22T08:48:46.425233+0000","last_fullsized":"2023-12-22T08:48:46.425233+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:35:02.936937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"157'1","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.933028+0000","last_change":"2023-12-22T08:48:44.418798+0000","last_active":"2023-12-22T08:48:44.933028+0000","last_peered":"2023-12-22T08:48:44.933028+0000","last_clean":"2023-12-22T08:48:44.933028+0000","last_became_active":"2023-12-22T08:48:44.418316+0000","last_became_peered":"2023-12-22T08:48:44.418316+0000","last_unstale":"2023-12-22T08:48:44.933028+0000","last_undegraded":"2023-12-22T08:48:44.933028+0000","last_fullsized":"2023-12-22T08:48:44.933028+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:02:00.737313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.425151+0000","last_change":"2023-12-22T08:48:44.940316+0000","last_active":"2023-12-22T08:48:46.425151+0000","last_peered":"2023-12-22T08:48:46.425151+0000","last_clean":"2023-12-22T08:48:46.425151+0000","last_became_active":"2023-12-22T08:48:44.938728+0000","last_became_peered":"2023-12-22T08:48:44.938728+0000","last_unstale":"2023-12-22T08:48:46.425151+0000","last_undegraded":"2023-12-22T08:48:46.425151+0000","last_fullsized":"2023-12-22T08:48:46.425151+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:02:01.750088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.918557+0000","last_change":"2023-12-22T08:48:44.414672+0000","last_active":"2023-12-22T08:48:44.918557+0000","last_peered":"2023-12-22T08:48:44.918557+0000","last_clean":"2023-12-22T08:48:44.918557+0000","last_became_active":"2023-12-22T08:48:44.414288+0000","last_became_peered":"2023-12-22T08:48:44.414288+0000","last_unstale":"2023-12-22T08:48:44.918557+0000","last_undegraded":"2023-12-22T08:48:44.918557+0000","last_fullsized":"2023-12-22T08:48:44.918557+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:09:24.217827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.424724+0000","last_change":"2023-12-22T08:48:44.937730+0000","last_active":"2023-12-22T08:48:46.424724+0000","last_peered":"2023-12-22T08:48:46.424724+0000","last_clean":"2023-12-22T08:48:46.424724+0000","last_became_active":"2023-12-22T08:48:44.937282+0000","last_became_peered":"2023-12-22T08:48:44.937282+0000","last_unstale":"2023-12-22T08:48:46.424724+0000","last_undegraded":"2023-12-22T08:48:46.424724+0000","last_fullsized":"2023-12-22T08:48:46.424724+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:30.022895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.933950+0000","last_change":"2023-12-22T08:48:44.418017+0000","last_active":"2023-12-22T08:48:44.933950+0000","last_peered":"2023-12-22T08:48:44.933950+0000","last_clean":"2023-12-22T08:48:44.933950+0000","last_became_active":"2023-12-22T08:48:44.417776+0000","last_became_peered":"2023-12-22T08:48:44.417776+0000","last_unstale":"2023-12-22T08:48:44.933950+0000","last_undegraded":"2023-12-22T08:48:44.933950+0000","last_fullsized":"2023-12-22T08:48:44.933950+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:03.583831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527518+0000","last_change":"2023-12-22T08:48:44.928145+0000","last_active":"2023-12-22T08:48:46.527518+0000","last_peered":"2023-12-22T08:48:46.527518+0000","last_clean":"2023-12-22T08:48:46.527518+0000","last_became_active":"2023-12-22T08:48:44.927886+0000","last_became_peered":"2023-12-22T08:48:44.927886+0000","last_unstale":"2023-12-22T08:48:46.527518+0000","last_undegraded":"2023-12-22T08:48:46.527518+0000","last_fullsized":"2023-12-22T08:48:46.527518+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:35.809674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.927570+0000","last_change":"2023-12-22T08:48:44.402875+0000","last_active":"2023-12-22T08:48:44.927570+0000","last_peered":"2023-12-22T08:48:44.927570+0000","last_clean":"2023-12-22T08:48:44.927570+0000","last_became_active":"2023-12-22T08:48:44.402351+0000","last_became_peered":"2023-12-22T08:48:44.402351+0000","last_unstale":"2023-12-22T08:48:44.927570+0000","last_undegraded":"2023-12-22T08:48:44.927570+0000","last_fullsized":"2023-12-22T08:48:44.927570+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:18:39.092197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916368+0000","last_change":"2023-12-22T08:48:44.936175+0000","last_active":"2023-12-22T08:48:45.916368+0000","last_peered":"2023-12-22T08:48:45.916368+0000","last_clean":"2023-12-22T08:48:45.916368+0000","last_became_active":"2023-12-22T08:48:44.935939+0000","last_became_peered":"2023-12-22T08:48:44.935939+0000","last_unstale":"2023-12-22T08:48:45.916368+0000","last_undegraded":"2023-12-22T08:48:45.916368+0000","last_fullsized":"2023-12-22T08:48:45.916368+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:22:07.648049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.914844+0000","last_change":"2023-12-22T08:48:44.421234+0000","last_active":"2023-12-22T08:48:44.914844+0000","last_peered":"2023-12-22T08:48:44.914844+0000","last_clean":"2023-12-22T08:48:44.914844+0000","last_became_active":"2023-12-22T08:48:44.420788+0000","last_became_peered":"2023-12-22T08:48:44.420788+0000","last_unstale":"2023-12-22T08:48:44.914844+0000","last_undegraded":"2023-12-22T08:48:44.914844+0000","last_fullsized":"2023-12-22T08:48:44.914844+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:01:29.355449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283908+0000","last_change":"2023-12-22T08:48:44.930580+0000","last_active":"2023-12-22T08:48:46.283908+0000","last_peered":"2023-12-22T08:48:46.283908+0000","last_clean":"2023-12-22T08:48:46.283908+0000","last_became_active":"2023-12-22T08:48:44.930355+0000","last_became_peered":"2023-12-22T08:48:44.930355+0000","last_unstale":"2023-12-22T08:48:46.283908+0000","last_undegraded":"2023-12-22T08:48:46.283908+0000","last_fullsized":"2023-12-22T08:48:46.283908+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:33:54.484505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.923876+0000","last_change":"2023-12-22T08:48:44.410689+0000","last_active":"2023-12-22T08:48:44.923876+0000","last_peered":"2023-12-22T08:48:44.923876+0000","last_clean":"2023-12-22T08:48:44.923876+0000","last_became_active":"2023-12-22T08:48:44.410262+0000","last_became_peered":"2023-12-22T08:48:44.410262+0000","last_unstale":"2023-12-22T08:48:44.923876+0000","last_undegraded":"2023-12-22T08:48:44.923876+0000","last_fullsized":"2023-12-22T08:48:44.923876+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:33:53.471731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.527748+0000","last_change":"2023-12-22T08:48:44.935139+0000","last_active":"2023-12-22T08:48:46.527748+0000","last_peered":"2023-12-22T08:48:46.527748+0000","last_clean":"2023-12-22T08:48:46.527748+0000","last_became_active":"2023-12-22T08:48:44.932941+0000","last_became_peered":"2023-12-22T08:48:44.932941+0000","last_unstale":"2023-12-22T08:48:46.527748+0000","last_undegraded":"2023-12-22T08:48:46.527748+0000","last_fullsized":"2023-12-22T08:48:46.527748+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:23:24.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.941395+0000","last_change":"2023-12-22T08:48:44.402084+0000","last_active":"2023-12-22T08:48:44.941395+0000","last_peered":"2023-12-22T08:48:44.941395+0000","last_clean":"2023-12-22T08:48:44.941395+0000","last_became_active":"2023-12-22T08:48:44.401587+0000","last_became_peered":"2023-12-22T08:48:44.401587+0000","last_unstale":"2023-12-22T08:48:44.941395+0000","last_undegraded":"2023-12-22T08:48:44.941395+0000","last_fullsized":"2023-12-22T08:48:44.941395+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:33:59.487564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.425391+0000","last_change":"2023-12-22T08:48:44.941374+0000","last_active":"2023-12-22T08:48:46.425391+0000","last_peered":"2023-12-22T08:48:46.425391+0000","last_clean":"2023-12-22T08:48:46.425391+0000","last_became_active":"2023-12-22T08:48:44.938691+0000","last_became_peered":"2023-12-22T08:48:44.938691+0000","last_unstale":"2023-12-22T08:48:46.425391+0000","last_undegraded":"2023-12-22T08:48:46.425391+0000","last_fullsized":"2023-12-22T08:48:46.425391+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:45:54.127065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.918521+0000","last_change":"2023-12-22T08:48:44.417247+0000","last_active":"2023-12-22T08:48:44.918521+0000","last_peered":"2023-12-22T08:48:44.918521+0000","last_clean":"2023-12-22T08:48:44.918521+0000","last_became_active":"2023-12-22T08:48:44.416982+0000","last_became_peered":"2023-12-22T08:48:44.416982+0000","last_unstale":"2023-12-22T08:48:44.918521+0000","last_undegraded":"2023-12-22T08:48:44.918521+0000","last_fullsized":"2023-12-22T08:48:44.918521+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:05:14.666898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916500+0000","last_change":"2023-12-22T08:48:44.939553+0000","last_active":"2023-12-22T08:48:45.916500+0000","last_peered":"2023-12-22T08:48:45.916500+0000","last_clean":"2023-12-22T08:48:45.916500+0000","last_became_active":"2023-12-22T08:48:44.939276+0000","last_became_peered":"2023-12-22T08:48:44.939276+0000","last_unstale":"2023-12-22T08:48:45.916500+0000","last_undegraded":"2023-12-22T08:48:45.916500+0000","last_fullsized":"2023-12-22T08:48:45.916500+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:46.037114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.927677+0000","last_change":"2023-12-22T08:48:44.421723+0000","last_active":"2023-12-22T08:48:44.927677+0000","last_peered":"2023-12-22T08:48:44.927677+0000","last_clean":"2023-12-22T08:48:44.927677+0000","last_became_active":"2023-12-22T08:48:44.421380+0000","last_became_peered":"2023-12-22T08:48:44.421380+0000","last_unstale":"2023-12-22T08:48:44.927677+0000","last_undegraded":"2023-12-22T08:48:44.927677+0000","last_fullsized":"2023-12-22T08:48:44.927677+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:14:43.362707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916103+0000","last_change":"2023-12-22T08:48:44.941477+0000","last_active":"2023-12-22T08:48:45.916103+0000","last_peered":"2023-12-22T08:48:45.916103+0000","last_clean":"2023-12-22T08:48:45.916103+0000","last_became_active":"2023-12-22T08:48:44.941203+0000","last_became_peered":"2023-12-22T08:48:44.941203+0000","last_unstale":"2023-12-22T08:48:45.916103+0000","last_undegraded":"2023-12-22T08:48:45.916103+0000","last_fullsized":"2023-12-22T08:48:45.916103+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:38:33.002937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.915119+0000","last_change":"2023-12-22T08:48:44.407665+0000","last_active":"2023-12-22T08:48:44.915119+0000","last_peered":"2023-12-22T08:48:44.915119+0000","last_clean":"2023-12-22T08:48:44.915119+0000","last_became_active":"2023-12-22T08:48:44.407334+0000","last_became_peered":"2023-12-22T08:48:44.407334+0000","last_unstale":"2023-12-22T08:48:44.915119+0000","last_undegraded":"2023-12-22T08:48:44.915119+0000","last_fullsized":"2023-12-22T08:48:44.915119+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:15:02.710245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.284251+0000","last_change":"2023-12-22T08:48:44.924014+0000","last_active":"2023-12-22T08:48:46.284251+0000","last_peered":"2023-12-22T08:48:46.284251+0000","last_clean":"2023-12-22T08:48:46.284251+0000","last_became_active":"2023-12-22T08:48:44.923191+0000","last_became_peered":"2023-12-22T08:48:44.923191+0000","last_unstale":"2023-12-22T08:48:46.284251+0000","last_undegraded":"2023-12-22T08:48:46.284251+0000","last_fullsized":"2023-12-22T08:48:46.284251+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:08:29.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.920965+0000","last_change":"2023-12-22T08:48:44.416913+0000","last_active":"2023-12-22T08:48:44.920965+0000","last_peered":"2023-12-22T08:48:44.920965+0000","last_clean":"2023-12-22T08:48:44.920965+0000","last_became_active":"2023-12-22T08:48:44.416099+0000","last_became_peered":"2023-12-22T08:48:44.416099+0000","last_unstale":"2023-12-22T08:48:44.920965+0000","last_undegraded":"2023-12-22T08:48:44.920965+0000","last_fullsized":"2023-12-22T08:48:44.920965+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:04:21.410084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:46.283955+0000","last_change":"2023-12-22T08:48:44.937706+0000","last_active":"2023-12-22T08:48:46.283955+0000","last_peered":"2023-12-22T08:48:46.283955+0000","last_clean":"2023-12-22T08:48:46.283955+0000","last_became_active":"2023-12-22T08:48:44.937177+0000","last_became_peered":"2023-12-22T08:48:44.937177+0000","last_unstale":"2023-12-22T08:48:46.283955+0000","last_undegraded":"2023-12-22T08:48:46.283955+0000","last_fullsized":"2023-12-22T08:48:46.283955+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:03:58.757538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.920155+0000","last_change":"2023-12-22T08:48:44.417885+0000","last_active":"2023-12-22T08:48:44.920155+0000","last_peered":"2023-12-22T08:48:44.920155+0000","last_clean":"2023-12-22T08:48:44.920155+0000","last_became_active":"2023-12-22T08:48:44.417279+0000","last_became_peered":"2023-12-22T08:48:44.417279+0000","last_unstale":"2023-12-22T08:48:44.920155+0000","last_undegraded":"2023-12-22T08:48:44.920155+0000","last_fullsized":"2023-12-22T08:48:44.920155+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:01:05.200246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.914784+0000","last_change":"2023-12-22T08:48:44.937656+0000","last_active":"2023-12-22T08:48:45.914784+0000","last_peered":"2023-12-22T08:48:45.914784+0000","last_clean":"2023-12-22T08:48:45.914784+0000","last_became_active":"2023-12-22T08:48:44.934921+0000","last_became_peered":"2023-12-22T08:48:44.934921+0000","last_unstale":"2023-12-22T08:48:45.914784+0000","last_undegraded":"2023-12-22T08:48:45.914784+0000","last_fullsized":"2023-12-22T08:48:45.914784+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:30:21.340538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.919784+0000","last_change":"2023-12-22T08:48:44.420946+0000","last_active":"2023-12-22T08:48:44.919784+0000","last_peered":"2023-12-22T08:48:44.919784+0000","last_clean":"2023-12-22T08:48:44.919784+0000","last_became_active":"2023-12-22T08:48:44.420713+0000","last_became_peered":"2023-12-22T08:48:44.420713+0000","last_unstale":"2023-12-22T08:48:44.919784+0000","last_undegraded":"2023-12-22T08:48:44.919784+0000","last_fullsized":"2023-12-22T08:48:44.919784+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:54:00.499158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916329+0000","last_change":"2023-12-22T08:48:44.932551+0000","last_active":"2023-12-22T08:48:45.916329+0000","last_peered":"2023-12-22T08:48:45.916329+0000","last_clean":"2023-12-22T08:48:45.916329+0000","last_became_active":"2023-12-22T08:48:44.932140+0000","last_became_peered":"2023-12-22T08:48:44.932140+0000","last_unstale":"2023-12-22T08:48:45.916329+0000","last_undegraded":"2023-12-22T08:48:45.916329+0000","last_fullsized":"2023-12-22T08:48:45.916329+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:18:08.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.921744+0000","last_change":"2023-12-22T08:48:44.408365+0000","last_active":"2023-12-22T08:48:44.921744+0000","last_peered":"2023-12-22T08:48:44.921744+0000","last_clean":"2023-12-22T08:48:44.921744+0000","last_became_active":"2023-12-22T08:48:44.408001+0000","last_became_peered":"2023-12-22T08:48:44.408001+0000","last_unstale":"2023-12-22T08:48:44.921744+0000","last_undegraded":"2023-12-22T08:48:44.921744+0000","last_fullsized":"2023-12-22T08:48:44.921744+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:25:32.965606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-22T08:48:45.916127+0000","last_change":"2023-12-22T08:48:44.933557+0000","last_active":"2023-12-22T08:48:45.916127+0000","last_peered":"2023-12-22T08:48:45.916127+0000","last_clean":"2023-12-22T08:48:45.916127+0000","last_became_active":"2023-12-22T08:48:44.933313+0000","last_became_peered":"2023-12-22T08:48:44.933313+0000","last_unstale":"2023-12-22T08:48:45.916127+0000","last_undegraded":"2023-12-22T08:48:45.916127+0000","last_fullsized":"2023-12-22T08:48:45.916127+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:44.377984+0000","last_clean_scrub_stamp":"2023-12-22T08:48:44.377984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:16:12.198481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.930132+0000","last_change":"2023-12-22T08:48:44.419546+0000","last_active":"2023-12-22T08:48:44.930132+0000","last_peered":"2023-12-22T08:48:44.930132+0000","last_clean":"2023-12-22T08:48:44.930132+0000","last_became_active":"2023-12-22T08:48:44.419284+0000","last_became_peered":"2023-12-22T08:48:44.419284+0000","last_unstale":"2023-12-22T08:48:44.930132+0000","last_undegraded":"2023-12-22T08:48:44.930132+0000","last_fullsized":"2023-12-22T08:48:44.930132+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:48:43.365210+0000","last_clean_scrub_stamp":"2023-12-22T08:48:43.365210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:10:07.622514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":289,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-12-22T08:48:44.923653+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:48:44.923653+0000","last_peered":"2023-12-22T08:48:44.923653+0000","last_clean":"2023-12-22T08:48:44.923653+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:48:44.923653+0000","last_undegraded":"2023-12-22T08:48:44.923653+0000","last_fullsized":"2023-12-22T08:48:44.923653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":860,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194451,"statfs":{"total":200000000,"available":199118644,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0960000000000001,"15min":1.085},"min":{"1min":0.80200000000000005,"5min":0.60999999999999999,"15min":0.58199999999999996},"max":{"1min":1.488,"5min":1.6459999999999999,"15min":2.0249999999999999},"last":1.069},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.101,"15min":1.075},"min":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3400000000000001,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.468}]},{"osd":1,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.1910000000000001,"15min":1.171},"min":{"1min":0.85099999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6779999999999999,"5min":1.6839999999999999,"15min":1.905},"last":1.333},{"interface":"front","average":{"1min":1.22,"5min":1.2450000000000001,"15min":1.1739999999999999},"min":{"1min":0.80300000000000005,"5min":0.70699999999999996,"15min":0.67100000000000004},"max":{"1min":1.448,"5min":1.7709999999999999,"15min":1.865},"last":1.361}]},{"osd":2,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1619999999999999,"15min":1.0960000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.69799999999999995},"max":{"1min":1.74,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.262},{"interface":"front","average":{"1min":1.23,"5min":1.2010000000000001,"15min":1.22},"min":{"1min":0.92900000000000005,"5min":0.73099999999999998,"15min":0.68700000000000006},"max":{"1min":1.79,"5min":1.79,"15min":2.1379999999999999},"last":1.1459999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2270000000000001,"15min":1.141},"min":{"1min":0.89700000000000002,"5min":0.77500000000000002,"15min":0.71399999999999997},"max":{"1min":1.5629999999999999,"5min":1.635,"15min":2.0680000000000001},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3220000000000001,"15min":1.294},"min":{"1min":0.77700000000000002,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.873,"5min":1.873,"15min":2.2959999999999998},"last":1.2310000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2230000000000001,"15min":1.2030000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.48699999999999999},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.2729999999999999,"15min":1.2669999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.59399999999999997},"max":{"1min":1.6719999999999999,"5min":2.0840000000000001,"15min":2.2749999999999999},"last":1.107}]},{"osd":5,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3919999999999999,"15min":1.3759999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.51800000000000002},"max":{"1min":1.9530000000000001,"5min":2.0510000000000002,"15min":2.4300000000000002},"last":1.385},{"interface":"front","average":{"1min":1.421,"5min":1.3939999999999999,"15min":1.377},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.3410000000000002},"last":1.2989999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:48:03 2023","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.52,"15min":1.4970000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.66900000000000004},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.591},{"interface":"front","average":{"1min":1.583,"5min":1.504,"15min":1.4910000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.71999999999999997},"max":{"1min":1.921,"5min":2.1379999999999999,"15min":2.4849999999999999},"last":1.421}]}]},{"osd":6,"up_from":13,"seq":55834574958,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":860,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194451,"statfs":{"total":200000000,"available":199118678,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":2.6070000000000002,"5min":1.4319999999999999,"15min":1.228},"min":{"1min":0.61899999999999999,"5min":0.55300000000000005,"15min":0.42099999999999999},"max":{"1min":28.361000000000001,"5min":28.361000000000001,"15min":28.361000000000001},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.1970000000000001,"15min":1.1200000000000001},"min":{"1min":0.79000000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":1.147}]},{"osd":1,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.1180000000000001,"15min":1.0549999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.871},{"interface":"front","average":{"1min":2.04,"5min":1.3240000000000001,"15min":1.2250000000000001},"min":{"1min":0.76200000000000001,"5min":0.64500000000000002,"15min":0.63100000000000001},"max":{"1min":15.324999999999999,"5min":15.324999999999999,"15min":15.324999999999999},"last":1.0229999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":1.3979999999999999,"15min":1.3109999999999999},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":15.422000000000001,"5min":15.422000000000001,"15min":15.422000000000001},"last":1.405},{"interface":"front","average":{"1min":1.746,"5min":1.3440000000000001,"15min":1.2170000000000001},"min":{"1min":0.94199999999999995,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":10.173999999999999,"5min":10.173999999999999,"15min":10.173999999999999},"last":1.0700000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":1.391,"15min":1.3320000000000001},"min":{"1min":0.99399999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":10.096,"5min":10.096,"15min":10.096},"last":1.216},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2490000000000001,"15min":1.2410000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.2509999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":2.0459999999999998,"5min":1.466,"15min":1.4279999999999999},"min":{"1min":0.81499999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":15.378,"5min":15.378,"15min":15.378},"last":1.1180000000000001},{"interface":"front","average":{"1min":2.0369999999999999,"5min":1.4970000000000001,"15min":1.4390000000000001},"min":{"1min":0.90900000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":13.178000000000001,"5min":13.178000000000001,"15min":13.178000000000001},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2959999999999998,"5min":1.494,"15min":1.407},"min":{"1min":0.97899999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":19.995000000000001,"5min":19.995000000000001,"15min":19.995000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":2.2290000000000001,"5min":1.6259999999999999,"15min":1.6040000000000001},"min":{"1min":1.1399999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":15.679,"5min":15.679,"15min":15.679},"last":1.3360000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.5149999999999999,"15min":1.5669999999999999},"min":{"1min":1.05,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.46,"15min":1.5229999999999999},"min":{"1min":0.89200000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":4.6609999999999996,"5min":4.6609999999999996,"15min":4.6609999999999996},"last":1.359}]}]},{"osd":5,"up_from":13,"seq":55834574958,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1436,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193875,"statfs":{"total":200000000,"available":198528587,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.0860000000000001,"15min":1.079},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.65300000000000002},"max":{"1min":1.4079999999999999,"5min":1.706,"15min":1.944},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0920000000000001,"15min":1.119},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":3.1379999999999999},"last":0.92400000000000004}]},{"osd":1,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.151,"15min":1.1200000000000001},"min":{"1min":0.73399999999999999,"5min":0.67900000000000005,"15min":0.63600000000000001},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.79},"last":1.129},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1040000000000001,"15min":1.046},"min":{"1min":0.747,"5min":0.73099999999999998,"15min":0.64500000000000002},"max":{"1min":1.5049999999999999,"5min":1.52,"15min":1.7509999999999999},"last":1.3260000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.171,"15min":1.1379999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.73899999999999999},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.2390000000000001,"15min":1.1859999999999999},"min":{"1min":0.83499999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.609,"5min":1.716,"15min":1.978},"last":1.4530000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.25,"15min":1.1879999999999999},"min":{"1min":0.94599999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.47,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.2989999999999999,"15min":1.2529999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.73299999999999998},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":2.1499999999999999},"last":1.482}]},{"osd":4,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.2609999999999999,"15min":1.25},"min":{"1min":0.60699999999999998,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4910000000000001,"5min":1.6879999999999999,"15min":1.853},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2689999999999999,"15min":1.2549999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.58399999999999996},"max":{"1min":1.6699999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.98899999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.3340000000000001,"15min":1.3169999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6279999999999999,"5min":1.788,"15min":1.821},"last":1.036},{"interface":"front","average":{"1min":1.331,"5min":1.393,"15min":1.4139999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.716,"5min":1.823,"15min":2.8780000000000001},"last":1.5569999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:48:04 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.4339999999999999,"15min":1.385},"min":{"1min":0.89100000000000001,"5min":0.84299999999999997,"15min":0.72499999999999998},"max":{"1min":1.595,"5min":1.873,"15min":2.2189999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.476,"15min":1.5369999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.782,"5min":1.8899999999999999,"15min":4.7249999999999996},"last":1.409}]}]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":860,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194451,"statfs":{"total":200000000,"available":199118678,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0469999999999999,"15min":1.0149999999999999},"min":{"1min":0.67800000000000005,"5min":0.67100000000000004,"15min":0.64000000000000001},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.139,"15min":1.1080000000000001},"min":{"1min":0.66000000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7410000000000001,"5min":1.796,"15min":1.796},"last":0.997}]},{"osd":1,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.119,"15min":1.0609999999999999},"min":{"1min":0.67400000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.734,"5min":1.76,"15min":1.76},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.1299999999999999,"15min":1.109},"min":{"1min":0.78100000000000003,"5min":0.65600000000000003,"15min":0.57399999999999995},"max":{"1min":1.5409999999999999,"5min":1.714,"15min":2.4249999999999998},"last":0.90700000000000003}]},{"osd":2,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.169,"15min":1.1479999999999999},"min":{"1min":0.755,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5089999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2490000000000001,"15min":1.208},"min":{"1min":0.79700000000000004,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.603,"5min":2.0830000000000002,"15min":2.1600000000000001},"last":1.26}]},{"osd":3,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2210000000000001,"15min":1.206},"min":{"1min":0.86299999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.208},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.323,"15min":1.2410000000000001},"min":{"1min":0.92800000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.591,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.353}]},{"osd":5,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.181,"15min":1.151},"min":{"1min":0.78200000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.575},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4390000000000001,"15min":1.395},"min":{"1min":1.0980000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.8939999999999999,"5min":1.913,"15min":2.0979999999999999},"last":1.7629999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.3500000000000001,"15min":1.2709999999999999},"min":{"1min":0.91200000000000003,"5min":0.75,"15min":0.58599999999999997},"max":{"1min":1.74,"5min":2.141,"15min":2.141},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.333,"15min":1.2370000000000001},"min":{"1min":0.85699999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.8169999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.677}]},{"osd":7,"last update":"Fri Dec 22 08:48:01 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.444,"15min":1.371},"min":{"1min":0.98899999999999999,"5min":0.875,"15min":0.67300000000000004},"max":{"1min":1.978,"5min":2.0089999999999999,"15min":2.1200000000000001},"last":1.627},{"interface":"front","average":{"1min":1.534,"5min":1.538,"15min":1.4510000000000001},"min":{"1min":1.1379999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8660000000000001,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.9550000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574958,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":860,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194451,"statfs":{"total":200000000,"available":199118608,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88100000000000001,"15min":0.93400000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.39800000000000002},"max":{"1min":1.2689999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.94599999999999995,"15min":0.93100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5369999999999999,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":1.0009999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.871},"min":{"1min":0.44800000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.431,"5min":1.528,"15min":1.6020000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.196,"15min":1.1359999999999999},"min":{"1min":0.63800000000000001,"5min":0.51100000000000001,"15min":0.46200000000000002},"max":{"1min":1.617,"5min":1.861,"15min":1.861},"last":1.4630000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.052,"15min":1.0369999999999999},"min":{"1min":0.56699999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.286,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.157,"15min":1.1379999999999999},"min":{"1min":0.55000000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.5820000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.073}]},{"osd":4,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.2390000000000001,"15min":1.212},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73199999999999998},"max":{"1min":1.411,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.3029999999999999,"15min":1.2509999999999999},"min":{"1min":0.93700000000000006,"5min":0.88200000000000001,"15min":0.745},"max":{"1min":1.8280000000000001,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.4279999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.343,"15min":1.2909999999999999},"min":{"1min":0.81899999999999995,"5min":0.754,"15min":0.66700000000000004},"max":{"1min":1.7330000000000001,"5min":1.9790000000000001,"15min":1.994},"last":1.542},{"interface":"front","average":{"1min":1.278,"5min":1.373,"15min":1.415},"min":{"1min":0.95699999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.6419999999999999,"5min":1.7969999999999999,"15min":2.3839999999999999},"last":1.663}]},{"osd":6,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.4430000000000001,"15min":1.4410000000000001},"min":{"1min":1.0660000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.647,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.784},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.3540000000000001,"15min":1.3740000000000001},"min":{"1min":0.83799999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6060000000000001,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.5009999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:48:08 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.4199999999999999,"15min":1.3819999999999999},"min":{"1min":0.81100000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7969999999999999,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.4450000000000001,"15min":1.4079999999999999},"min":{"1min":0.96599999999999997,"5min":0.81499999999999995,"15min":0.80600000000000005},"max":{"1min":1.7729999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.744}]}]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":861,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194451,"statfs":{"total":200000000,"available":199118006,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.86499999999999999,"15min":0.79800000000000004},"min":{"1min":0.40000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2150000000000001,"5min":2.6789999999999998,"15min":6.8879999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.88100000000000001,"15min":0.93200000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.35799999999999998},"max":{"1min":1.1879999999999999,"5min":1.5609999999999999,"15min":4.5510000000000002},"last":1.5549999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.90100000000000002,"15min":0.94599999999999995},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.34000000000000002},"max":{"1min":1.702,"5min":1.702,"15min":11.308999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0760000000000001,"15min":0.96999999999999997},"min":{"1min":0.51000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.7290000000000001,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.419}]},{"osd":3,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0640000000000001,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.47999999999999998,"15min":0.41099999999999998},"max":{"1min":1.462,"5min":1.6359999999999999,"15min":13.087999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.212,"15min":1.1459999999999999},"min":{"1min":0.55200000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.825,"5min":3.2959999999999998,"15min":12.289999999999999},"last":1.119}]},{"osd":4,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.381,"15min":1.2829999999999999},"min":{"1min":0.84299999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.8620000000000001,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.226,"15min":1.341},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.61499999999999999},"max":{"1min":1.6479999999999999,"5min":1.6890000000000001,"15min":13.927},"last":1.49}]},{"osd":5,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2929999999999999,"15min":1.3700000000000001},"min":{"1min":0.80100000000000005,"5min":0.76800000000000002,"15min":0.64000000000000001},"max":{"1min":1.8440000000000001,"5min":1.9530000000000001,"15min":11.003},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.292,"15min":1.294},"min":{"1min":0.879,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.7410000000000001,"5min":2.0470000000000002,"15min":13.129},"last":1.2529999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.3779999999999999,"15min":1.3120000000000001},"min":{"1min":0.98799999999999999,"5min":0.83999999999999997,"15min":0.751},"max":{"1min":1.9810000000000001,"5min":2.1240000000000001,"15min":8.1609999999999996},"last":1.335},{"interface":"front","average":{"1min":1.474,"5min":1.4750000000000001,"15min":1.403},"min":{"1min":0.93300000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9370000000000001,"5min":3.8959999999999999,"15min":6.8150000000000004},"last":1.528}]},{"osd":7,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.347,"15min":1.393},"min":{"1min":0.80900000000000005,"5min":0.753,"15min":0.61299999999999999},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":10.948},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.569,"15min":1.425},"min":{"1min":0.875,"5min":0.875,"15min":0.78200000000000003},"max":{"1min":2.254,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":1.458}]}]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1438,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193873,"statfs":{"total":200000000,"available":198526724,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.93899999999999995,"15min":0.90800000000000003},"min":{"1min":0.42499999999999999,"5min":0.41299999999999998,"15min":0.36199999999999999},"max":{"1min":1.087,"5min":4.242,"15min":4.242},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.151,"15min":1.054},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.39900000000000002},"max":{"1min":1.3520000000000001,"5min":4.2030000000000003,"15min":4.2030000000000003},"last":1.119}]},{"osd":2,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.99099999999999999,"15min":0.95799999999999996},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.6000000000000001,"5min":1.732,"15min":1.732},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.0449999999999999,"15min":0.97399999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34999999999999998},"max":{"1min":1.3380000000000001,"5min":1.6499999999999999,"15min":2.254},"last":1.3520000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3260000000000001,"15min":1.21},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.655,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.514},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.091,"15min":0.997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.47799999999999998},"max":{"1min":1.599,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.5660000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.3120000000000001,"15min":1.2769999999999999},"min":{"1min":0.89900000000000002,"5min":0.71299999999999997,"15min":0.58699999999999997},"max":{"1min":1.635,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.415},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4419999999999999,"15min":1.357},"min":{"1min":0.97199999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.738,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.2430000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2969999999999999,"15min":1.2490000000000001},"min":{"1min":0.79900000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.538,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3799999999999999,"15min":1.351},"min":{"1min":0.84399999999999997,"5min":0.79400000000000004,"15min":0.66800000000000004},"max":{"1min":1.6599999999999999,"5min":2.3100000000000001,"15min":4.2130000000000001},"last":1.7549999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3779999999999999,"15min":1.2869999999999999},"min":{"1min":0.82199999999999995,"5min":0.81000000000000005,"15min":0.65200000000000002},"max":{"1min":1.788,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":1.631},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.4750000000000001,"15min":1.393},"min":{"1min":1.077,"5min":0.80600000000000005,"15min":0.67200000000000004},"max":{"1min":1.9059999999999999,"5min":2.2210000000000001,"15min":2.2229999999999999},"last":1.8320000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:48:05 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.4970000000000001,"15min":1.399},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.64400000000000002},"max":{"1min":1.722,"5min":2.4889999999999999,"15min":2.4889999999999999},"last":1.597},{"interface":"front","average":{"1min":1.411,"5min":1.49,"15min":1.4219999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.66200000000000003},"max":{"1min":1.6950000000000001,"5min":4.508,"15min":4.508},"last":1.6930000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574958,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":862,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194450,"statfs":{"total":200000000,"available":199117058,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.85999999999999999,"15min":0.76700000000000002},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2270000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.96499999999999997,"15min":0.91600000000000004},"min":{"1min":0.34599999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.6879999999999999,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.875,"15min":0.81499999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1779999999999999,"5min":1.5229999999999999,"15min":1.6739999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0680000000000001,"15min":0.97099999999999997},"min":{"1min":0.41699999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.206}]},{"osd":3,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.177,"15min":1.0629999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.0379999999999998,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.228,"15min":1.1060000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.39100000000000001},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.145},"last":1.6519999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.341,"15min":1.2869999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.70799999999999996},"max":{"1min":1.76,"5min":2.625,"15min":2.625},"last":1.234},{"interface":"front","average":{"1min":1.278,"5min":1.343,"15min":1.252},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.649,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":1.3640000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.425,"15min":1.302},"min":{"1min":0.69599999999999995,"5min":0.67600000000000005,"15min":0.59299999999999997},"max":{"1min":1.847,"5min":5.4290000000000003,"15min":5.4290000000000003},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.3660000000000001,"15min":1.29},"min":{"1min":0.83399999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.8680000000000001,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.7509999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.3680000000000001,"15min":1.3049999999999999},"min":{"1min":0.82099999999999995,"5min":0.66900000000000004,"15min":0.64800000000000002},"max":{"1min":1.8,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4950000000000001,"15min":1.413},"min":{"1min":0.90700000000000003,"5min":0.88800000000000001,"15min":0.69099999999999995},"max":{"1min":1.9690000000000001,"5min":2.577,"15min":2.577},"last":1.9550000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:48:12 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.482,"15min":1.391},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.755},"max":{"1min":1.855,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.821},{"interface":"front","average":{"1min":1.363,"5min":1.4650000000000001,"15min":1.399},"min":{"1min":0.88800000000000001,"5min":0.78000000000000003,"15min":0.749},"max":{"1min":2.157,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.909}]}]}],"pool_statfs":[]}} 2023-12-22T08:48:50.497 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T08:48:50.497 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T08:48:50.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.776+0000 7f9188d2c640 1 Processor -- start 2023-12-22T08:48:50.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.776+0000 7f9188d2c640 1 -- start start 2023-12-22T08:48:50.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.778+0000 7f9188d2c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9184146ab0 0x7f91840b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:50.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.778+0000 7f9188d2c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9184146e90 0x7f91840b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:50.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.778+0000 7f9188d2c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91840cfd50 con 0x7f91840b7230 2023-12-22T08:48:50.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.778+0000 7f9188d2c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91840cfff0 con 0x7f9184146e90 2023-12-22T08:48:50.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.778+0000 7f9188d2c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91840d02d0 con 0x7f9184146ab0 2023-12-22T08:48:50.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.778+0000 7f9182ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9184146e90 0x7f91840b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:50.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.779+0000 7f9182ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9184146e90 0x7f91840b6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34998/0 (socket says 172.21.15.38:34998) 2023-12-22T08:48:50.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.779+0000 7f9182ffd640 1 -- 172.21.15.38:0/1174589141 learned_addr learned my addr 172.21.15.38:0/1174589141 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:50.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.779+0000 7f91837fe640 1 --2- 172.21.15.38:0/1174589141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9184146ab0 0x7f91840b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:50.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.779+0000 7f9182ffd640 1 -- 172.21.15.38:0/1174589141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9184146ab0 msgr2=0x7f91840b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:50.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.779+0000 7f9182ffd640 1 --2- 172.21.15.38:0/1174589141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9184146ab0 0x7f91840b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.779+0000 7f9182ffd640 1 -- 172.21.15.38:0/1174589141 >> v1:172.21.15.89:6789/0 conn(0x7f91840b7230 legacy=0x7f91840d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:50.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.779+0000 7f9182ffd640 1 -- 172.21.15.38:0/1174589141 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91840d05b0 con 0x7f9184146e90 2023-12-22T08:48:50.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.780+0000 7f9182ffd640 1 --2- 172.21.15.38:0/1174589141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9184146e90 0x7f91840b6cf0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f91780098a0 tx=0x7f917802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856417eb472e7f4c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:50.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.781+0000 7f91827fc640 1 -- 172.21.15.38:0/1174589141 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178030840 con 0x7f9184146e90 2023-12-22T08:48:50.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.781+0000 7f91827fc640 1 -- 172.21.15.38:0/1174589141 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91780309a0 con 0x7f9184146e90 2023-12-22T08:48:50.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.781+0000 7f91827fc640 1 -- 172.21.15.38:0/1174589141 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178030d30 con 0x7f9184146e90 2023-12-22T08:48:50.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.781+0000 7f9188d2c640 1 -- 172.21.15.38:0/1174589141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9184146e90 msgr2=0x7f91840b6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:50.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.781+0000 7f9188d2c640 1 --2- 172.21.15.38:0/1174589141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9184146e90 0x7f91840b6cf0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f91780098a0 tx=0x7f917802b980 comp rx=0 tx=0).stop 2023-12-22T08:48:50.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.781+0000 7f9188d2c640 1 -- 172.21.15.38:0/1174589141 shutdown_connections 2023-12-22T08:48:50.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.781+0000 7f9188d2c640 1 --2- 172.21.15.38:0/1174589141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9184146e90 0x7f91840b6cf0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.781+0000 7f9188d2c640 1 --2- 172.21.15.38:0/1174589141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9184146ab0 0x7f91840b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.781+0000 7f9188d2c640 1 -- 172.21.15.38:0/1174589141 >> 172.21.15.38:0/1174589141 conn(0x7f918406cdc0 msgr2=0x7f9184071260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:50.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.781+0000 7f9188d2c640 1 -- 172.21.15.38:0/1174589141 shutdown_connections 2023-12-22T08:48:50.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.782+0000 7f9188d2c640 1 -- 172.21.15.38:0/1174589141 wait complete. 2023-12-22T08:48:50.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.783+0000 7f9188d2c640 1 Processor -- start 2023-12-22T08:48:50.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.783+0000 7f9188d2c640 1 -- start start 2023-12-22T08:48:50.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.784+0000 7f9188d2c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91840b7230 0x7f91841603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:50.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.784+0000 7f9188d2c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9184146ab0 0x7f9184140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:50.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.784+0000 7f9188d2c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9184146e90 0x7f9184160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:50.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.784+0000 7f9188d2c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9184160920 con 0x7f91840b7230 2023-12-22T08:48:50.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.784+0000 7f9188d2c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918415fa90 con 0x7f9184146e90 2023-12-22T08:48:50.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.784+0000 7f9188d2c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9184141150 con 0x7f9184146ab0 2023-12-22T08:48:50.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.785+0000 7f91837fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91840b7230 0x7f91841603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:50.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.785+0000 7f91837fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91840b7230 0x7f91841603e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35010/0 (socket says 172.21.15.38:35010) 2023-12-22T08:48:50.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.785+0000 7f91837fe640 1 -- 172.21.15.38:0/140179887 learned_addr learned my addr 172.21.15.38:0/140179887 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:50.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.785+0000 7f9182ffd640 1 --2- 172.21.15.38:0/140179887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9184146ab0 0x7f9184140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:50.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.785+0000 7f91837fe640 1 -- 172.21.15.38:0/140179887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9184146ab0 msgr2=0x7f9184140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:50.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.785+0000 7f91837fe640 1 --2- 172.21.15.38:0/140179887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9184146ab0 0x7f9184140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.785+0000 7f91837fe640 1 -- 172.21.15.38:0/140179887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9184146e90 msgr2=0x7f9184160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:50.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.785+0000 7f91837fe640 1 --2- 172.21.15.38:0/140179887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9184146e90 0x7f9184160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:50.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.785+0000 7f91837fe640 1 -- 172.21.15.38:0/140179887 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780094d0 con 0x7f91840b7230 2023-12-22T08:48:50.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.785+0000 7f91837fe640 1 --2- 172.21.15.38:0/140179887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91840b7230 0x7f91841603e0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f917400d800 tx=0x7f917400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:50.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.786+0000 7f916bfff640 1 -- 172.21.15.38:0/140179887 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917400b6c0 con 0x7f91840b7230 2023-12-22T08:48:50.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.786+0000 7f916bfff640 1 -- 172.21.15.38:0/140179887 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917400b820 con 0x7f91840b7230 2023-12-22T08:48:50.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.786+0000 7f916bfff640 1 -- 172.21.15.38:0/140179887 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917400bbd0 con 0x7f91840b7230 2023-12-22T08:48:50.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.786+0000 7f9188d2c640 1 -- 172.21.15.38:0/140179887 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918415f7b0 con 0x7f91840b7230 2023-12-22T08:48:50.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.786+0000 7f9188d2c640 1 -- 172.21.15.38:0/140179887 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91840acc60 con 0x7f91840b7230 2023-12-22T08:48:50.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.787+0000 7f9188d2c640 1 -- 172.21.15.38:0/140179887 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9184061910 con 0x7f91840b7230 2023-12-22T08:48:50.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.788+0000 7f916bfff640 1 -- 172.21.15.38:0/140179887 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f917400bd30 con 0x7f91840b7230 2023-12-22T08:48:50.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.789+0000 7f916bfff640 1 --2- 172.21.15.38:0/140179887 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f917006a430 0x7f917006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:50.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.789+0000 7f916bfff640 1 -- 172.21.15.38:0/140179887 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9174088f20 con 0x7f91840b7230 2023-12-22T08:48:50.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.790+0000 7f9182ffd640 1 --2- 172.21.15.38:0/140179887 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f917006a430 0x7f917006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:50.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.791+0000 7f9182ffd640 1 --2- 172.21.15.38:0/140179887 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f917006a430 0x7f917006c8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9178036000 tx=0x7f917803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:50.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:50.793+0000 7f916bfff640 1 -- 172.21.15.38:0/140179887 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9174054470 con 0x7f91840b7230 2023-12-22T08:48:51.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.058+0000 7f9188d2c640 1 -- 172.21.15.38:0/140179887 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f91840d20c0 con 0x7f91840b7230 2023-12-22T08:48:51.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.068+0000 7f916bfff640 1 -- 172.21.15.38:0/140179887 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9174057a90 con 0x7f91840b7230 2023-12-22T08:48:51.070 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.0 2023-12-22T08:48:51.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.071+0000 7f9188d2c640 1 -- 172.21.15.38:0/140179887 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f917006a430 msgr2=0x7f917006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:51.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.071+0000 7f9188d2c640 1 --2- 172.21.15.38:0/140179887 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f917006a430 0x7f917006c8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9178036000 tx=0x7f917803b040 comp rx=0 tx=0).stop 2023-12-22T08:48:51.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.071+0000 7f9188d2c640 1 -- 172.21.15.38:0/140179887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91840b7230 msgr2=0x7f91841603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:51.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.071+0000 7f9188d2c640 1 --2- 172.21.15.38:0/140179887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91840b7230 0x7f91841603e0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f917400d800 tx=0x7f917400dcc0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.071+0000 7f9188d2c640 1 -- 172.21.15.38:0/140179887 shutdown_connections 2023-12-22T08:48:51.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.071+0000 7f9188d2c640 1 --2- 172.21.15.38:0/140179887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9184146e90 0x7f9184160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.071+0000 7f9188d2c640 1 --2- 172.21.15.38:0/140179887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9184146ab0 0x7f9184140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.071+0000 7f9188d2c640 1 --2- 172.21.15.38:0/140179887 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f917006a430 0x7f917006c8f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.071+0000 7f9188d2c640 1 --2- 172.21.15.38:0/140179887 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91840b7230 0x7f91841603e0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.071+0000 7f9188d2c640 1 -- 172.21.15.38:0/140179887 >> 172.21.15.38:0/140179887 conn(0x7f918406cdc0 msgr2=0x7f9184145c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:51.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.072+0000 7f9188d2c640 1 -- 172.21.15.38:0/140179887 shutdown_connections 2023-12-22T08:48:51.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.072+0000 7f9188d2c640 1 -- 172.21.15.38:0/140179887 wait complete. 2023-12-22T08:48:51.093 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:48:51.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.312+0000 7f61803e3640 1 Processor -- start 2023-12-22T08:48:51.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.312+0000 7f61803e3640 1 -- start start 2023-12-22T08:48:51.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.314+0000 7f61803e3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6178144d10 0x7f61780cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:51.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.314+0000 7f61803e3640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f61780b2760 0x7f6178070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:51.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.314+0000 7f61803e3640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61781450f0 con 0x7f61780cc670 2023-12-22T08:48:51.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.314+0000 7f61803e3640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61780ce010 con 0x7f61780b2760 2023-12-22T08:48:51.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.314+0000 7f61803e3640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61780ce2f0 con 0x7f6178144d10 2023-12-22T08:48:51.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.314+0000 7f617d97e640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f61780cc670 0x7f61780b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36802/0 (socket says 172.21.15.38:36802) 2023-12-22T08:48:51.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.314+0000 7f617d97e640 1 -- 172.21.15.38:0/154842426 learned_addr learned my addr 172.21.15.38:0/154842426 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:51.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.314+0000 7f617e980640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f61780b2760 0x7f6178070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:51.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.315+0000 7f617e17f640 1 --2- 172.21.15.38:0/154842426 >> v2:172.21.15.89:3300/0 conn(0x7f6178144d10 0x7f61780cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:51.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.315+0000 7f617e980640 1 -- 172.21.15.38:0/154842426 >> v2:172.21.15.89:3300/0 conn(0x7f6178144d10 msgr2=0x7f61780cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:51.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.315+0000 7f617e980640 1 --2- 172.21.15.38:0/154842426 >> v2:172.21.15.89:3300/0 conn(0x7f6178144d10 0x7f61780cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.315+0000 7f617e980640 1 -- 172.21.15.38:0/154842426 >> v1:172.21.15.38:6789/0 conn(0x7f61780cc670 legacy=0x7f61780b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:51.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.315+0000 7f617e980640 1 -- 172.21.15.38:0/154842426 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61780ce5d0 con 0x7f61780b2760 2023-12-22T08:48:51.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.315+0000 7f617d17d640 1 -- 172.21.15.38:0/154842426 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123431855 0 0) 0x7f61781450f0 con 0x7f61780cc670 2023-12-22T08:48:51.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.316+0000 7f617e980640 1 --2- 172.21.15.38:0/154842426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61780b2760 0x7f6178070800 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f61780cfe00 tx=0x7f617002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6740a419ece4a5e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:51.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.316+0000 7f617d17d640 1 -- 172.21.15.38:0/154842426 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617002cc80 con 0x7f61780b2760 2023-12-22T08:48:51.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.316+0000 7f617d17d640 1 -- 172.21.15.38:0/154842426 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617002cde0 con 0x7f61780b2760 2023-12-22T08:48:51.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.316+0000 7f617d17d640 1 -- 172.21.15.38:0/154842426 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170034660 con 0x7f61780b2760 2023-12-22T08:48:51.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.317+0000 7f61803e3640 1 -- 172.21.15.38:0/154842426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61780b2760 msgr2=0x7f6178070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:51.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.317+0000 7f61803e3640 1 --2- 172.21.15.38:0/154842426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61780b2760 0x7f6178070800 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f61780cfe00 tx=0x7f617002bed0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.317+0000 7f61803e3640 1 -- 172.21.15.38:0/154842426 shutdown_connections 2023-12-22T08:48:51.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.317+0000 7f61803e3640 1 --2- 172.21.15.38:0/154842426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f61780b2760 0x7f6178070800 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.317+0000 7f61803e3640 1 --2- 172.21.15.38:0/154842426 >> v2:172.21.15.89:3300/0 conn(0x7f6178144d10 0x7f61780cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.317+0000 7f61803e3640 1 -- 172.21.15.38:0/154842426 >> 172.21.15.38:0/154842426 conn(0x7f61780cf070 msgr2=0x7f61780cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:51.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.317+0000 7f61803e3640 1 -- 172.21.15.38:0/154842426 shutdown_connections 2023-12-22T08:48:51.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.317+0000 7f61803e3640 1 -- 172.21.15.38:0/154842426 wait complete. 2023-12-22T08:48:51.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.319+0000 7f61803e3640 1 Processor -- start 2023-12-22T08:48:51.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.319+0000 7f61803e3640 1 -- start start 2023-12-22T08:48:51.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.320+0000 7f61803e3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61780b2760 0x7f617815cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.320+0000 7f61803e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6178144d10 0x7f617815a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.320+0000 7f61803e3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f617812e4f0 0x7f617815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.320+0000 7f61803e3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617806dbf0 con 0x7f617812e4f0 2023-12-22T08:48:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.320+0000 7f61803e3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617806ded0 con 0x7f6178144d10 2023-12-22T08:48:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.320+0000 7f61803e3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617806e1b0 con 0x7f61780b2760 2023-12-22T08:48:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.320+0000 7f617e980640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f617812e4f0 0x7f617815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.320+0000 7f617e980640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f617812e4f0 0x7f617815aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57854/0 (socket says 172.21.15.38:57854) 2023-12-22T08:48:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.320+0000 7f617e980640 1 -- 172.21.15.38:0/2978007265 learned_addr learned my addr 172.21.15.38:0/2978007265 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.321+0000 7f617d97e640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6178144d10 0x7f617815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.321+0000 7f617e17f640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61780b2760 0x7f617815cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.321+0000 7f617e980640 1 -- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61780b2760 msgr2=0x7f617815cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.321+0000 7f617e980640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61780b2760 0x7f617815cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.321+0000 7f617e980640 1 -- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6178144d10 msgr2=0x7f617815a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:51.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.321+0000 7f617e980640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6178144d10 0x7f617815a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.321+0000 7f617e980640 1 -- 172.21.15.38:0/2978007265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170009a70 con 0x7f617812e4f0 2023-12-22T08:48:51.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.321+0000 7f617d97e640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6178144d10 0x7f617815a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:51.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.321+0000 7f617e980640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f617812e4f0 0x7f617815aa60 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f6170037040 tx=0x7f6170004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:51.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.322+0000 7f616effd640 1 -- 172.21.15.38:0/2978007265 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170040650 con 0x7f617812e4f0 2023-12-22T08:48:51.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.322+0000 7f616effd640 1 -- 172.21.15.38:0/2978007265 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61700407d0 con 0x7f617812e4f0 2023-12-22T08:48:51.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.322+0000 7f616effd640 1 -- 172.21.15.38:0/2978007265 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170040b80 con 0x7f617812e4f0 2023-12-22T08:48:51.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.322+0000 7f61803e3640 1 -- 172.21.15.38:0/2978007265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617813f160 con 0x7f617812e4f0 2023-12-22T08:48:51.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.322+0000 7f61803e3640 1 -- 172.21.15.38:0/2978007265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617813ee60 con 0x7f617812e4f0 2023-12-22T08:48:51.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.323+0000 7f61803e3640 1 -- 172.21.15.38:0/2978007265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617813f380 con 0x7f617812e4f0 2023-12-22T08:48:51.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.324+0000 7f616effd640 1 -- 172.21.15.38:0/2978007265 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6170040ce0 con 0x7f617812e4f0 2023-12-22T08:48:51.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.325+0000 7f616effd640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f615c06a430 0x7f615c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:51.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.325+0000 7f616effd640 1 -- 172.21.15.38:0/2978007265 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61700ab790 con 0x7f617812e4f0 2023-12-22T08:48:51.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.326+0000 7f617e17f640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f615c06a430 0x7f615c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:51.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.327+0000 7f617e17f640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f615c06a430 0x7f615c06c8f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6174006fd0 tx=0x7f6174008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:51.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.330+0000 7f616effd640 1 -- 172.21.15.38:0/2978007265 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6170076ce0 con 0x7f617812e4f0 2023-12-22T08:48:51.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.566+0000 7f61803e3640 1 -- 172.21.15.38:0/2978007265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6178061910 con 0x7f617812e4f0 2023-12-22T08:48:51.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.568+0000 7f616effd640 1 -- 172.21.15.38:0/2978007265 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4641 (secure 0 0 0) 0x7f6170009450 con 0x7f617812e4f0 2023-12-22T08:48:51.569 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:51.569 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/52711154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":52711154},{"type":"v1","addr":"172.21.15.89:6837","nonce":52711154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2264719173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2264719173},{"type":"v1","addr":"172.21.15.38:6835","nonce":2264719173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3546762659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3546762659},{"type":"v1","addr":"172.21.15.89:6836","nonce":3546762659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:48:44.902723+0000","modified":"2023-12-22T08:48:48.440490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8148":{"gid":8148,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/885304998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":885304998},{"type":"v1","addr":"172.21.15.38:6833","nonce":885304998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-22T08:48:51.569 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 70 2023-12-22T08:48:51.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.570+0000 7f61803e3640 1 -- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f615c06a430 msgr2=0x7f615c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:51.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.570+0000 7f61803e3640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f615c06a430 0x7f615c06c8f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6174006fd0 tx=0x7f6174008040 comp rx=0 tx=0).stop 2023-12-22T08:48:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.571+0000 7f61803e3640 1 -- 172.21.15.38:0/2978007265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f617812e4f0 msgr2=0x7f617815aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.571+0000 7f61803e3640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f617812e4f0 0x7f617815aa60 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f6170037040 tx=0x7f6170004a40 comp rx=0 tx=0).stop 2023-12-22T08:48:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.571+0000 7f61803e3640 1 -- 172.21.15.38:0/2978007265 shutdown_connections 2023-12-22T08:48:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.571+0000 7f61803e3640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f615c06a430 0x7f615c06c8f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.571+0000 7f61803e3640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f617812e4f0 0x7f617815aa60 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.571+0000 7f61803e3640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6178144d10 0x7f617815a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.571+0000 7f61803e3640 1 --2- 172.21.15.38:0/2978007265 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61780b2760 0x7f617815cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:51.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.571+0000 7f61803e3640 1 -- 172.21.15.38:0/2978007265 >> 172.21.15.38:0/2978007265 conn(0x7f61780cf070 msgr2=0x7f61780b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:51.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.571+0000 7f61803e3640 1 -- 172.21.15.38:0/2978007265 shutdown_connections 2023-12-22T08:48:51.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:51.571+0000 7f61803e3640 1 -- 172.21.15.38:0/2978007265 wait complete. 2023-12-22T08:48:51.992 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T08:48:44.902723+0000', 'modified': '2023-12-22T08:48:48.440490+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8148}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8148': {'gid': 8148, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.38:6833/885304998', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6832', 'nonce': 885304998}, {'type': 'v1', 'addr': '172.21.15.38:6833', 'nonce': 885304998}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T08:48:51.993 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T08:48:51.993 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-22T08:48:52.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.234+0000 7f323a977640 1 Processor -- start 2023-12-22T08:48:52.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.234+0000 7f323a977640 1 -- start start 2023-12-22T08:48:52.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.236+0000 7f323a977640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3234144d10 0x7f32340cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.236+0000 7f323a977640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32340b2760 0x7f3234070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.236+0000 7f323a977640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32341450f0 con 0x7f32340cc670 2023-12-22T08:48:52.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.236+0000 7f323a977640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32340ce010 con 0x7f3234144d10 2023-12-22T08:48:52.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.236+0000 7f323a977640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32340ce2f0 con 0x7f32340b2760 2023-12-22T08:48:52.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.236+0000 7f3233fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3234144d10 0x7f32340cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.236+0000 7f322b7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f32340cc670 0x7f32340b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36810/0 (socket says 172.21.15.38:36810) 2023-12-22T08:48:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.236+0000 7f322b7fe640 1 -- 172.21.15.38:0/3763482912 learned_addr learned my addr 172.21.15.38:0/3763482912 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.236+0000 7f3238f14640 1 --2- 172.21.15.38:0/3763482912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32340b2760 0x7f3234070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.237+0000 7f3233fff640 1 -- 172.21.15.38:0/3763482912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32340b2760 msgr2=0x7f3234070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.237+0000 7f3233fff640 1 --2- 172.21.15.38:0/3763482912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32340b2760 0x7f3234070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.237+0000 7f3233fff640 1 -- 172.21.15.38:0/3763482912 >> v1:172.21.15.38:6789/0 conn(0x7f32340cc670 legacy=0x7f32340b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.237+0000 7f3233fff640 1 -- 172.21.15.38:0/3763482912 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32340ce5d0 con 0x7f3234144d10 2023-12-22T08:48:52.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.237+0000 7f32337fe640 1 -- 172.21.15.38:0/3763482912 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164855558 0 0) 0x7f32341450f0 con 0x7f32340cc670 2023-12-22T08:48:52.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.238+0000 7f3233fff640 1 --2- 172.21.15.38:0/3763482912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3234144d10 0x7f32340cc130 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f3224009d90 tx=0x7f322402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef632240ed6b1a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:52.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.239+0000 7f32337fe640 1 -- 172.21.15.38:0/3763482912 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322402cc50 con 0x7f3234144d10 2023-12-22T08:48:52.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.239+0000 7f32337fe640 1 -- 172.21.15.38:0/3763482912 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322402cdb0 con 0x7f3234144d10 2023-12-22T08:48:52.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.239+0000 7f32337fe640 1 -- 172.21.15.38:0/3763482912 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224034660 con 0x7f3234144d10 2023-12-22T08:48:52.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.239+0000 7f323a977640 1 -- 172.21.15.38:0/3763482912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3234144d10 msgr2=0x7f32340cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.239+0000 7f323a977640 1 --2- 172.21.15.38:0/3763482912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3234144d10 0x7f32340cc130 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f3224009d90 tx=0x7f322402bea0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.239+0000 7f323a977640 1 -- 172.21.15.38:0/3763482912 shutdown_connections 2023-12-22T08:48:52.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.239+0000 7f323a977640 1 --2- 172.21.15.38:0/3763482912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32340b2760 0x7f3234070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.239+0000 7f323a977640 1 --2- 172.21.15.38:0/3763482912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3234144d10 0x7f32340cc130 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.239+0000 7f323a977640 1 -- 172.21.15.38:0/3763482912 >> 172.21.15.38:0/3763482912 conn(0x7f32340cf070 msgr2=0x7f32340cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:52.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.240+0000 7f323a977640 1 -- 172.21.15.38:0/3763482912 shutdown_connections 2023-12-22T08:48:52.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.240+0000 7f323a977640 1 -- 172.21.15.38:0/3763482912 wait complete. 2023-12-22T08:48:52.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.241+0000 7f323a977640 1 Processor -- start 2023-12-22T08:48:52.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.242+0000 7f323a977640 1 -- start start 2023-12-22T08:48:52.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.242+0000 7f323a977640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32340b2760 0x7f32340afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f323a977640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3234144d10 0x7f32341585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f323a977640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3234156b70 0x7f3234158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f323a977640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32340afa80 con 0x7f32340b2760 2023-12-22T08:48:52.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f323a977640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32341580d0 con 0x7f3234156b70 2023-12-22T08:48:52.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f323a977640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3234159050 con 0x7f3234144d10 2023-12-22T08:48:52.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f3233fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32340b2760 0x7f32340afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f3233fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32340b2760 0x7f32340afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57868/0 (socket says 172.21.15.38:57868) 2023-12-22T08:48:52.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f3233fff640 1 -- 172.21.15.38:0/2068417706 learned_addr learned my addr 172.21.15.38:0/2068417706 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:52.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f322b7fe640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3234144d10 0x7f32341585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f3238f14640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3234156b70 0x7f3234158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f3233fff640 1 -- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3234144d10 msgr2=0x7f32341585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f3233fff640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3234144d10 0x7f32341585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f3233fff640 1 -- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3234156b70 msgr2=0x7f3234158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f3233fff640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3234156b70 0x7f3234158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f3233fff640 1 -- 172.21.15.38:0/2068417706 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3224009a70 con 0x7f32340b2760 2023-12-22T08:48:52.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.243+0000 7f3238f14640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3234156b70 0x7f3234158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:52.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.244+0000 7f3233fff640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32340b2760 0x7f32340afea0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f3224009d90 tx=0x7f3224004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:52.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.244+0000 7f32317fa640 1 -- 172.21.15.38:0/2068417706 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322403e610 con 0x7f32340b2760 2023-12-22T08:48:52.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.244+0000 7f32317fa640 1 -- 172.21.15.38:0/2068417706 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322403e770 con 0x7f32340b2760 2023-12-22T08:48:52.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.244+0000 7f323a977640 1 -- 172.21.15.38:0/2068417706 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32340aeb20 con 0x7f32340b2760 2023-12-22T08:48:52.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.244+0000 7f32317fa640 1 -- 172.21.15.38:0/2068417706 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322403eb00 con 0x7f32340b2760 2023-12-22T08:48:52.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.244+0000 7f323a977640 1 -- 172.21.15.38:0/2068417706 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32340af0e0 con 0x7f32340b2760 2023-12-22T08:48:52.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.247+0000 7f32317fa640 1 -- 172.21.15.38:0/2068417706 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f322403b050 con 0x7f32340b2760 2023-12-22T08:48:52.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.248+0000 7f32317fa640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f321406a460 0x7f321406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.248+0000 7f32317fa640 1 -- 172.21.15.38:0/2068417706 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32240aa900 con 0x7f32340b2760 2023-12-22T08:48:52.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.248+0000 7f323d5c1740 1 Processor -- start 2023-12-22T08:48:52.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.248+0000 7f322b7fe640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f321406a460 0x7f321406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.248+0000 7f323d5c1740 1 -- start start 2023-12-22T08:48:52.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.249+0000 7f323d5c1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 0x55846cf94110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.249+0000 7f323d5c1740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf63cb0 0x55846cf90fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.249+0000 7f323d5c1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf678b0 0x55846cf914e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.249+0000 7f323d5c1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846ced3f80 con 0x55846cf93d30 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.249+0000 7f323d5c1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846ced1710 con 0x55846cf678b0 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.249+0000 7f323d5c1740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55846cecd000 con 0x55846cf63cb0 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.250+0000 7f3233fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 0x55846cf94110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.250+0000 7f3233fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 0x55846cf94110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57878/0 (socket says 172.21.15.38:57878) 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.250+0000 7f3233fff640 1 -- 172.21.15.38:0/2693874624 learned_addr learned my addr 172.21.15.38:0/2693874624 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.250+0000 7f322b7fe640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f321406a460 0x7f321406c920 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f323415fc10 tx=0x7f321c007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.250+0000 7f322b7fe640 1 --2- 172.21.15.38:0/2693874624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf63cb0 0x55846cf90fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.250+0000 7f3238f14640 1 --2- 172.21.15.38:0/2693874624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf678b0 0x55846cf914e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.250+0000 7f3233fff640 1 -- 172.21.15.38:0/2693874624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf63cb0 msgr2=0x55846cf90fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.250+0000 7f3233fff640 1 --2- 172.21.15.38:0/2693874624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf63cb0 0x55846cf90fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.250+0000 7f3233fff640 1 -- 172.21.15.38:0/2693874624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf678b0 msgr2=0x55846cf914e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:52.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.250+0000 7f3233fff640 1 --2- 172.21.15.38:0/2693874624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf678b0 0x55846cf914e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.250+0000 7f3233fff640 1 -- 172.21.15.38:0/2693874624 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55846ce94690 con 0x55846cf93d30 2023-12-22T08:48:52.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.250+0000 7f3238f14640 1 --2- 172.21.15.38:0/2693874624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf678b0 0x55846cf914e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:52.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.250+0000 7f3233fff640 1 --2- 172.21.15.38:0/2693874624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 0x55846cf94110 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f3224081650 tx=0x7f32240795c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cabdb07dac3196f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:52.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.251+0000 7f3229ffb640 1 -- 172.21.15.38:0/2693874624 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32240911c0 con 0x55846cf93d30 2023-12-22T08:48:52.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.251+0000 7f3229ffb640 1 -- 172.21.15.38:0/2693874624 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322407d9d0 con 0x55846cf93d30 2023-12-22T08:48:52.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.251+0000 7f3229ffb640 1 -- 172.21.15.38:0/2693874624 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224081b80 con 0x55846cf93d30 2023-12-22T08:48:52.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.251+0000 7f323d5c1740 1 -- 172.21.15.38:0/2693874624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 msgr2=0x55846cf94110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.251+0000 7f323d5c1740 1 --2- 172.21.15.38:0/2693874624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 0x55846cf94110 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f3224081650 tx=0x7f32240795c0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.251+0000 7f323d5c1740 1 -- 172.21.15.38:0/2693874624 shutdown_connections 2023-12-22T08:48:52.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.251+0000 7f323d5c1740 1 --2- 172.21.15.38:0/2693874624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf678b0 0x55846cf914e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.251+0000 7f323d5c1740 1 --2- 172.21.15.38:0/2693874624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf63cb0 0x55846cf90fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.251+0000 7f323d5c1740 1 --2- 172.21.15.38:0/2693874624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 0x55846cf94110 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.251+0000 7f323d5c1740 1 -- 172.21.15.38:0/2693874624 >> 172.21.15.38:0/2693874624 conn(0x55846cf65fc0 msgr2=0x55846cfaeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:52.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.252+0000 7f323d5c1740 1 -- 172.21.15.38:0/2693874624 shutdown_connections 2023-12-22T08:48:52.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.252+0000 7f323d5c1740 1 -- 172.21.15.38:0/2693874624 wait complete. 2023-12-22T08:48:52.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.252+0000 7f323d5c1740 1 -- start start 2023-12-22T08:48:52.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.252+0000 7f323d5c1740 1 Processor -- start 2023-12-22T08:48:52.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.253+0000 7f323d5c1740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf678b0 0x55846cf8c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.253+0000 7f323d5c1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 0x55846cfbe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.253+0000 7f323d5c1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf96020 0x55846cfb2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.253+0000 7f323d5c1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846ce6e7d0 con 0x55846cf93d30 2023-12-22T08:48:52.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.253+0000 7f323d5c1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846ce6e470 con 0x55846cf96020 2023-12-22T08:48:52.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.253+0000 7f323d5c1740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55846cc34f20 con 0x55846cf678b0 2023-12-22T08:48:52.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.253+0000 7f323d5c1740 10 client.0 _ll_register_callbacks cb 0x55846cebd1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:48:52.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.254+0000 7f322b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 0x55846cfbe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.254+0000 7f322b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 0x55846cfbe8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57890/0 (socket says 172.21.15.38:57890) 2023-12-22T08:48:52.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.254+0000 7f322b7fe640 1 -- 172.21.15.38:0/4147449641 learned_addr learned my addr 172.21.15.38:0/4147449641 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:52.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.254+0000 7f3233fff640 1 --2- 172.21.15.38:0/4147449641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf678b0 0x55846cf8c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.254+0000 7f3238f14640 1 --2- 172.21.15.38:0/4147449641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf96020 0x55846cfb2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.254+0000 7f322b7fe640 1 -- 172.21.15.38:0/4147449641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf678b0 msgr2=0x55846cf8c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:52.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.254+0000 7f322b7fe640 1 --2- 172.21.15.38:0/4147449641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf678b0 0x55846cf8c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.254+0000 7f322b7fe640 1 -- 172.21.15.38:0/4147449641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf96020 msgr2=0x55846cfb2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:52.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.254+0000 7f322b7fe640 1 --2- 172.21.15.38:0/4147449641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf96020 0x55846cfb2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.254+0000 7f322b7fe640 1 -- 172.21.15.38:0/4147449641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32340af0e0 con 0x55846cf93d30 2023-12-22T08:48:52.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.255+0000 7f322b7fe640 1 --2- 172.21.15.38:0/4147449641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 0x55846cfbe8d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f321c001be0 tx=0x7f321c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a45a8009d56190 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.255+0000 7f3212ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:48:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.255+0000 7f3212ffd640 1 -- 172.21.15.38:0/4147449641 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c015110 con 0x55846cf93d30 2023-12-22T08:48:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.255+0000 7f3212ffd640 1 -- 172.21.15.38:0/4147449641 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f321c015270 con 0x55846cf93d30 2023-12-22T08:48:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.255+0000 7f323d5c1740 1 -- 172.21.15.38:0/4147449641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55846cef7550 con 0x55846cf93d30 2023-12-22T08:48:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.255+0000 7f3212ffd640 1 -- 172.21.15.38:0/4147449641 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f321c021470 con 0x55846cf93d30 2023-12-22T08:48:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.255+0000 7f323d5c1740 10 client.8289 fetch_fsmap learned FSMap version 70 2023-12-22T08:48:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.255+0000 7f323d5c1740 1 -- 172.21.15.38:0/4147449641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55846cecb680 con 0x55846cf93d30 2023-12-22T08:48:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.256+0000 7f3212ffd640 1 -- 172.21.15.38:0/4147449641 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55846cef7550 con 0x55846cf93d30 2023-12-22T08:48:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.256+0000 7f3212ffd640 1 -- 172.21.15.38:0/4147449641 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 70) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f321c02a050 con 0x55846cf93d30 2023-12-22T08:48:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.256+0000 7f323d5c1740 10 client.8289 fetch_fsmap finished waiting for FSMap version 70 2023-12-22T08:48:52.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.256+0000 7f323d5c1740 10 client.8289 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.256+0000 7f323d5c1740 20 client.8289 populate_metadata read hostname 'smithi038' 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.256+0000 7f323d5c1740 1 --2- 172.21.15.38:0/4147449641 >> [v2:172.21.15.38:6832/885304998,v1:172.21.15.38:6833/885304998] conn(0x55846cf8cd60 0x55846cf8d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.256+0000 7f323d5c1740 4 client.8289 mds_command: new command op to 8148 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.256+0000 7f323d5c1740 1 -- 172.21.15.38:0/4147449641 --> [v2:172.21.15.38:6832/885304998,v1:172.21.15.38:6833/885304998] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55846cebfb50 con 0x55846cf8cd60 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.256+0000 7f3233fff640 1 --2- 172.21.15.38:0/4147449641 >> [v2:172.21.15.38:6832/885304998,v1:172.21.15.38:6833/885304998] conn(0x55846cf8cd60 0x55846cf8d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.257+0000 7f3233fff640 1 --2- 172.21.15.38:0/4147449641 >> [v2:172.21.15.38:6832/885304998,v1:172.21.15.38:6833/885304998] conn(0x55846cf8cd60 0x55846cf8d140 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6c6c5536c72837e server_cookie=367186b0d4be3d4f in_seq=0 out_seq=0 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.257+0000 7f3212ffd640 10 client.8289 ms_handle_connect on v2:172.21.15.38:6832/885304998 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.257+0000 7f3212ffd640 1 -- 172.21.15.38:0/4147449641 <== mds.0 v2:172.21.15.38:6832/885304998 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55846cebfb50 con 0x55846cf8cd60 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.257+0000 7f3212ffd640 10 client.8289 handle_command_reply: tid=0 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.258+0000 7f323d5c1740 1 client.8289 shutdown 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.258+0000 7f323d5c1740 1 -- 172.21.15.38:0/4147449641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 msgr2=0x55846cfbe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.258+0000 7f323d5c1740 1 --2- 172.21.15.38:0/4147449641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 0x55846cfbe8d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f321c001be0 tx=0x7f321c011000 comp rx=0 tx=0).stop 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.258+0000 7f323d5c1740 1 -- 172.21.15.38:0/4147449641 shutdown_connections 2023-12-22T08:48:52.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.258+0000 7f323d5c1740 1 --2- 172.21.15.38:0/4147449641 >> [v2:172.21.15.38:6832/885304998,v1:172.21.15.38:6833/885304998] conn(0x55846cf8cd60 0x55846cf8d140 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.258+0000 7f323d5c1740 1 --2- 172.21.15.38:0/4147449641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf96020 0x55846cfb2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.258+0000 7f323d5c1740 1 --2- 172.21.15.38:0/4147449641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf93d30 0x55846cfbe8d0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.258+0000 7f323d5c1740 1 --2- 172.21.15.38:0/4147449641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf678b0 0x55846cf8c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.258+0000 7f3212ffd640 0 client.8289 ms_handle_reset on v2:172.21.15.38:6832/885304998 2023-12-22T08:48:52.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.258+0000 7f323d5c1740 1 -- 172.21.15.38:0/4147449641 >> 172.21.15.38:0/4147449641 conn(0x55846cf63cb0 msgr2=0x55846cf67e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:52.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.258+0000 7f323d5c1740 1 -- 172.21.15.38:0/4147449641 shutdown_connections 2023-12-22T08:48:52.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.258+0000 7f323d5c1740 1 -- 172.21.15.38:0/4147449641 wait complete. 2023-12-22T08:48:52.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.258+0000 7f323d5c1740 20 client.8289 trim_cache size 0 max 16384 2023-12-22T08:48:52.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.275+0000 7f323d5c1740 1 Processor -- start 2023-12-22T08:48:52.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.275+0000 7f323d5c1740 1 -- start start 2023-12-22T08:48:52.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.276+0000 7f323d5c1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf678b0 0x55846cfaf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.276+0000 7f323d5c1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf93d30 0x55846cfbe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.276+0000 7f323d5c1740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf96020 0x55846cfbddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.276+0000 7f323d5c1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846cfbe330 con 0x55846cf678b0 2023-12-22T08:48:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.276+0000 7f323d5c1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846cf94d30 con 0x55846cf93d30 2023-12-22T08:48:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.276+0000 7f323d5c1740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55846ce8dab0 con 0x55846cf96020 2023-12-22T08:48:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.276+0000 7f3233fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf678b0 0x55846cfaf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.276+0000 7f3233fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf678b0 0x55846cfaf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57900/0 (socket says 172.21.15.38:57900) 2023-12-22T08:48:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.276+0000 7f3233fff640 1 -- 172.21.15.38:0/2594624159 learned_addr learned my addr 172.21.15.38:0/2594624159 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.276+0000 7f3238f14640 1 --2- 172.21.15.38:0/2594624159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf96020 0x55846cfbddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.276+0000 7f322b7fe640 1 --2- 172.21.15.38:0/2594624159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf93d30 0x55846cfbe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.276+0000 7f3233fff640 1 -- 172.21.15.38:0/2594624159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf96020 msgr2=0x55846cfbddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.277+0000 7f3233fff640 1 --2- 172.21.15.38:0/2594624159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf96020 0x55846cfbddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.277+0000 7f3233fff640 1 -- 172.21.15.38:0/2594624159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf93d30 msgr2=0x55846cfbe7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.277+0000 7f3233fff640 1 --2- 172.21.15.38:0/2594624159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf93d30 0x55846cfbe7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.277+0000 7f3233fff640 1 -- 172.21.15.38:0/2594624159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55846ce6d9e0 con 0x55846cf678b0 2023-12-22T08:48:52.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.277+0000 7f3233fff640 1 --2- 172.21.15.38:0/2594624159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf678b0 0x55846cfaf360 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f3224040040 tx=0x7f322404a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf5ce7171b53579 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:52.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.277+0000 7f322a7fc640 1 -- 172.21.15.38:0/2594624159 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322409c070 con 0x55846cf678b0 2023-12-22T08:48:52.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.277+0000 7f322a7fc640 1 -- 172.21.15.38:0/2594624159 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3224081c00 con 0x55846cf678b0 2023-12-22T08:48:52.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.277+0000 7f322a7fc640 1 -- 172.21.15.38:0/2594624159 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224079970 con 0x55846cf678b0 2023-12-22T08:48:52.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.278+0000 7f323d5c1740 1 -- 172.21.15.38:0/2594624159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf678b0 msgr2=0x55846cfaf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.278+0000 7f323d5c1740 1 --2- 172.21.15.38:0/2594624159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf678b0 0x55846cfaf360 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f3224040040 tx=0x7f322404a000 comp rx=0 tx=0).stop 2023-12-22T08:48:52.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.278+0000 7f323d5c1740 1 -- 172.21.15.38:0/2594624159 shutdown_connections 2023-12-22T08:48:52.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.278+0000 7f323d5c1740 1 --2- 172.21.15.38:0/2594624159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf96020 0x55846cfbddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.278+0000 7f323d5c1740 1 --2- 172.21.15.38:0/2594624159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf93d30 0x55846cfbe7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.278+0000 7f323d5c1740 1 --2- 172.21.15.38:0/2594624159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf678b0 0x55846cfaf360 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.278+0000 7f323d5c1740 1 -- 172.21.15.38:0/2594624159 >> 172.21.15.38:0/2594624159 conn(0x55846cf63cb0 msgr2=0x55846cf8c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:52.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.278+0000 7f323d5c1740 1 -- 172.21.15.38:0/2594624159 shutdown_connections 2023-12-22T08:48:52.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.278+0000 7f323d5c1740 1 -- 172.21.15.38:0/2594624159 wait complete. 2023-12-22T08:48:52.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.279+0000 7f323d5c1740 1 -- start start 2023-12-22T08:48:52.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.279+0000 7f323d5c1740 1 Processor -- start 2023-12-22T08:48:52.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.280+0000 7f323d5c1740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf678b0 0x55846cfc79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.280+0000 7f323d5c1740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf93d30 0x55846cf8fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.280+0000 7f323d5c1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf96020 0x55846cf900a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.280+0000 7f323d5c1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846d014eb0 con 0x55846cf96020 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.280+0000 7f323d5c1740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846cf91760 con 0x55846cf93d30 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.280+0000 7f323d5c1740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55846cf8dcb0 con 0x55846cf678b0 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.280+0000 7f323d5c1740 10 client.0 _ll_register_callbacks cb 0x7f322402cce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.280+0000 7f3238f14640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf96020 0x55846cf900a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.280+0000 7f3238f14640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf96020 0x55846cf900a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57906/0 (socket says 172.21.15.38:57906) 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.280+0000 7f3238f14640 1 -- 172.21.15.38:0/220289277 learned_addr learned my addr 172.21.15.38:0/220289277 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.281+0000 7f3233fff640 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf678b0 0x55846cfc79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.281+0000 7f322b7fe640 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf93d30 0x55846cf8fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.281+0000 7f3238f14640 1 -- 172.21.15.38:0/220289277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf678b0 msgr2=0x55846cfc79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.281+0000 7f3238f14640 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf678b0 0x55846cfc79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.281+0000 7f3238f14640 1 -- 172.21.15.38:0/220289277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf93d30 msgr2=0x55846cf8fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.281+0000 7f3238f14640 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf93d30 0x55846cf8fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.281+0000 7f3238f14640 1 -- 172.21.15.38:0/220289277 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55846ce94690 con 0x55846cf96020 2023-12-22T08:48:52.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.281+0000 7f322b7fe640 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf93d30 0x55846cf8fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:48:52.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.281+0000 7f3238f14640 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf96020 0x55846cf900a0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f322c00fc50 tx=0x7f322c0136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb308ace73139efc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:52.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.281+0000 7f3212ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:48:52.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.281+0000 7f3212ffd640 1 -- 172.21.15.38:0/220289277 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c013ee0 con 0x55846cf96020 2023-12-22T08:48:52.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.281+0000 7f3212ffd640 1 -- 172.21.15.38:0/220289277 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f322c016460 con 0x55846cf96020 2023-12-22T08:48:52.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.281+0000 7f323d5c1740 1 -- 172.21.15.38:0/220289277 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f322407d9d0 con 0x55846cf96020 2023-12-22T08:48:52.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.282+0000 7f3212ffd640 1 -- 172.21.15.38:0/220289277 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f322c00f510 con 0x55846cf96020 2023-12-22T08:48:52.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.282+0000 7f323d5c1740 10 client.8295 fetch_fsmap learned FSMap version 70 2023-12-22T08:48:52.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.282+0000 7f323d5c1740 1 -- 172.21.15.38:0/220289277 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55846ce92ef0 con 0x55846cf96020 2023-12-22T08:48:52.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.282+0000 7f3212ffd640 1 -- 172.21.15.38:0/220289277 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322407d9d0 con 0x55846cf96020 2023-12-22T08:48:52.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.282+0000 7f3212ffd640 1 -- 172.21.15.38:0/220289277 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 70) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f322c016620 con 0x55846cf96020 2023-12-22T08:48:52.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.282+0000 7f323d5c1740 10 client.8295 fetch_fsmap finished waiting for FSMap version 70 2023-12-22T08:48:52.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.282+0000 7f323d5c1740 10 client.8295 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:48:52.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.282+0000 7f323d5c1740 20 client.8295 populate_metadata read hostname 'smithi038' 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.282+0000 7f323d5c1740 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.38:6832/885304998,v1:172.21.15.38:6833/885304998] conn(0x55846d014200 0x55846d0145e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.282+0000 7f323d5c1740 4 client.8295 mds_command: new command op to 8148 tid=0[{"prefix": "status"}] 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.282+0000 7f323d5c1740 1 -- 172.21.15.38:0/220289277 --> [v2:172.21.15.38:6832/885304998,v1:172.21.15.38:6833/885304998] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55846cec6080 con 0x55846d014200 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.283+0000 7f3233fff640 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.38:6832/885304998,v1:172.21.15.38:6833/885304998] conn(0x55846d014200 0x55846d0145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.283+0000 7f3233fff640 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.38:6832/885304998,v1:172.21.15.38:6833/885304998] conn(0x55846d014200 0x55846d0145e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a7ffc72e72e918c server_cookie=fa03196e5aecb807 in_seq=0 out_seq=0 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.283+0000 7f3212ffd640 10 client.8295 ms_handle_connect on v2:172.21.15.38:6832/885304998 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.283+0000 7f3212ffd640 1 -- 172.21.15.38:0/220289277 <== mds.0 v2:172.21.15.38:6832/885304998 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55846cec6080 con 0x55846d014200 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.283+0000 7f3212ffd640 10 client.8295 handle_command_reply: tid=0 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.283+0000 7f323d5c1740 1 client.8295 shutdown 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.283+0000 7f323d5c1740 1 -- 172.21.15.38:0/220289277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf96020 msgr2=0x55846cf900a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.284+0000 7f323d5c1740 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf96020 0x55846cf900a0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f322c00fc50 tx=0x7f322c0136b0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.284+0000 7f323d5c1740 1 -- 172.21.15.38:0/220289277 shutdown_connections 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.284+0000 7f323d5c1740 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.38:6832/885304998,v1:172.21.15.38:6833/885304998] conn(0x55846d014200 0x55846d0145e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.284+0000 7f323d5c1740 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55846cf96020 0x55846cf900a0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.284+0000 7f323d5c1740 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55846cf93d30 0x55846cf8fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.284+0000 7f323d5c1740 1 --2- 172.21.15.38:0/220289277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55846cf678b0 0x55846cfc79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.284+0000 7f3212ffd640 0 client.8295 ms_handle_reset on v2:172.21.15.38:6832/885304998 2023-12-22T08:48:52.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.284+0000 7f323d5c1740 1 -- 172.21.15.38:0/220289277 >> 172.21.15.38:0/220289277 conn(0x55846cf63cb0 msgr2=0x55846cf956a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:52.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.284+0000 7f323d5c1740 1 -- 172.21.15.38:0/220289277 shutdown_connections 2023-12-22T08:48:52.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.284+0000 7f323d5c1740 1 -- 172.21.15.38:0/220289277 wait complete. 2023-12-22T08:48:52.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.284+0000 7f323d5c1740 20 client.8295 trim_cache size 0 max 16384 2023-12-22T08:48:52.288 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:48:52.288 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:48:52.288 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-12-22T08:48:52.288 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 8148, 2023-12-22T08:48:52.288 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-12-22T08:48:52.289 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-12-22T08:48:52.289 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-12-22T08:48:52.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 7.376671494, 2023-12-22T08:48:52.289 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 70, 2023-12-22T08:48:52.289 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 158, 2023-12-22T08:48:52.289 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 158, 2023-12-22T08:48:52.289 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 13.222616006000001 2023-12-22T08:48:52.289 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:48:52.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.285+0000 7f323a977640 1 -- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f321406a460 msgr2=0x7f321406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.285+0000 7f323a977640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f321406a460 0x7f321406c920 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f323415fc10 tx=0x7f321c007b50 comp rx=0 tx=0).stop 2023-12-22T08:48:52.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.285+0000 7f323a977640 1 -- 172.21.15.38:0/2068417706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32340b2760 msgr2=0x7f32340afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.285+0000 7f323a977640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32340b2760 0x7f32340afea0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f3224009d90 tx=0x7f3224004a40 comp rx=0 tx=0).stop 2023-12-22T08:48:52.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.285+0000 7f323a977640 1 -- 172.21.15.38:0/2068417706 shutdown_connections 2023-12-22T08:48:52.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.285+0000 7f323a977640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3234156b70 0x7f3234158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.285+0000 7f323a977640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3234144d10 0x7f32341585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.285+0000 7f323a977640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f321406a460 0x7f321406c920 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.285+0000 7f323a977640 1 --2- 172.21.15.38:0/2068417706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32340b2760 0x7f32340afea0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.285+0000 7f323a977640 1 -- 172.21.15.38:0/2068417706 >> 172.21.15.38:0/2068417706 conn(0x7f32340cf070 msgr2=0x7f32340ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:52.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.285+0000 7f323a977640 1 -- 172.21.15.38:0/2068417706 shutdown_connections 2023-12-22T08:48:52.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.285+0000 7f323a977640 1 -- 172.21.15.38:0/2068417706 wait complete. 2023-12-22T08:48:52.303 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:48:52.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.523+0000 7f1d97451640 1 Processor -- start 2023-12-22T08:48:52.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.523+0000 7f1d97451640 1 -- start start 2023-12-22T08:48:52.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.524+0000 7f1d97451640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1d901547a0 0x7f1d9015b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.524+0000 7f1d97451640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d900716a0 con 0x7f1d90154b80 2023-12-22T08:48:52.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.524+0000 7f1d97451640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d90070e80 con 0x7f1d90071b90 2023-12-22T08:48:52.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.524+0000 7f1d97451640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d900710e0 con 0x7f1d901547a0 2023-12-22T08:48:52.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.525+0000 7f1d951ed640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1d901547a0 0x7f1d9015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.525+0000 7f1d959ee640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1d90154b80 0x7f1d900ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36826/0 (socket says 172.21.15.38:36826) 2023-12-22T08:48:52.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.525+0000 7f1d959ee640 1 -- 172.21.15.38:0/1489789951 learned_addr learned my addr 172.21.15.38:0/1489789951 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:52.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.525+0000 7f1d951ed640 1 -- 172.21.15.38:0/1489789951 >> v1:172.21.15.89:6789/0 conn(0x7f1d90071b90 legacy=0x7f1d90070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:52.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.525+0000 7f1d951ed640 1 -- 172.21.15.38:0/1489789951 >> v1:172.21.15.38:6789/0 conn(0x7f1d90154b80 legacy=0x7f1d900ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.525+0000 7f1d87fff640 1 -- 172.21.15.38:0/1489789951 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49207799 0 0) 0x7f1d900716a0 con 0x7f1d90154b80 2023-12-22T08:48:52.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.525+0000 7f1d951ed640 1 -- 172.21.15.38:0/1489789951 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d900713c0 con 0x7f1d901547a0 2023-12-22T08:48:52.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.526+0000 7f1d951ed640 1 --2- 172.21.15.38:0/1489789951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d901547a0 0x7f1d9015b300 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009d90 tx=0x7f1d8c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbf8421affaab81 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:52.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.527+0000 7f1d87fff640 1 -- 172.21.15.38:0/1489789951 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c02cc60 con 0x7f1d901547a0 2023-12-22T08:48:52.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.527+0000 7f1d87fff640 1 -- 172.21.15.38:0/1489789951 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c02cdc0 con 0x7f1d901547a0 2023-12-22T08:48:52.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.527+0000 7f1d87fff640 1 -- 172.21.15.38:0/1489789951 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c034660 con 0x7f1d901547a0 2023-12-22T08:48:52.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.527+0000 7f1d97451640 1 -- 172.21.15.38:0/1489789951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d901547a0 msgr2=0x7f1d9015b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.527+0000 7f1d97451640 1 --2- 172.21.15.38:0/1489789951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d901547a0 0x7f1d9015b300 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009d90 tx=0x7f1d8c02beb0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.527+0000 7f1d97451640 1 -- 172.21.15.38:0/1489789951 shutdown_connections 2023-12-22T08:48:52.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.527+0000 7f1d97451640 1 --2- 172.21.15.38:0/1489789951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d901547a0 0x7f1d9015b300 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.527+0000 7f1d97451640 1 -- 172.21.15.38:0/1489789951 >> 172.21.15.38:0/1489789951 conn(0x7f1d900cf070 msgr2=0x7f1d900cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:52.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.527+0000 7f1d97451640 1 -- 172.21.15.38:0/1489789951 shutdown_connections 2023-12-22T08:48:52.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.527+0000 7f1d97451640 1 -- 172.21.15.38:0/1489789951 wait complete. 2023-12-22T08:48:52.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.529+0000 7f1d97451640 1 Processor -- start 2023-12-22T08:48:52.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.529+0000 7f1d97451640 1 -- start start 2023-12-22T08:48:52.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.530+0000 7f1d97451640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d90071b90 0x7f1d9013a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.530+0000 7f1d97451640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d901547a0 0x7f1d900cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.530+0000 7f1d97451640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d90154b80 0x7f1d900b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.530+0000 7f1d97451640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9013f500 con 0x7f1d901547a0 2023-12-22T08:48:52.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.530+0000 7f1d97451640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d900b0c00 con 0x7f1d90071b90 2023-12-22T08:48:52.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.530+0000 7f1d97451640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d900b0ee0 con 0x7f1d90154b80 2023-12-22T08:48:52.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.530+0000 7f1d949ec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d901547a0 0x7f1d900cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.531+0000 7f1d949ec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d901547a0 0x7f1d900cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57920/0 (socket says 172.21.15.38:57920) 2023-12-22T08:48:52.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.531+0000 7f1d949ec640 1 -- 172.21.15.38:0/226363193 learned_addr learned my addr 172.21.15.38:0/226363193 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:52.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.531+0000 7f1d951ed640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d90071b90 0x7f1d9013a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.531+0000 7f1d949ec640 1 -- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d90154b80 msgr2=0x7f1d900b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.531+0000 7f1d949ec640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d90154b80 0x7f1d900b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.531+0000 7f1d949ec640 1 -- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d90071b90 msgr2=0x7f1d9013a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.531+0000 7f1d949ec640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d90071b90 0x7f1d9013a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.531+0000 7f1d949ec640 1 -- 172.21.15.38:0/226363193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c009a70 con 0x7f1d901547a0 2023-12-22T08:48:52.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.531+0000 7f1d951ed640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d90071b90 0x7f1d9013a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:52.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.531+0000 7f1d949ec640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d901547a0 0x7f1d900cd380 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c400 tx=0x7f1d8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:52.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.531+0000 7f1d85ffb640 1 -- 172.21.15.38:0/226363193 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80011790 con 0x7f1d901547a0 2023-12-22T08:48:52.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.532+0000 7f1d85ffb640 1 -- 172.21.15.38:0/226363193 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d80011930 con 0x7f1d901547a0 2023-12-22T08:48:52.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.532+0000 7f1d85ffb640 1 -- 172.21.15.38:0/226363193 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80011ce0 con 0x7f1d901547a0 2023-12-22T08:48:52.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.532+0000 7f1d97451640 1 -- 172.21.15.38:0/226363193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9013ee40 con 0x7f1d901547a0 2023-12-22T08:48:52.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.532+0000 7f1d97451640 1 -- 172.21.15.38:0/226363193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9013a930 con 0x7f1d901547a0 2023-12-22T08:48:52.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.533+0000 7f1d97451640 1 -- 172.21.15.38:0/226363193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9013f640 con 0x7f1d901547a0 2023-12-22T08:48:52.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.534+0000 7f1d85ffb640 1 -- 172.21.15.38:0/226363193 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1d8001c460 con 0x7f1d901547a0 2023-12-22T08:48:52.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.535+0000 7f1d85ffb640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d7406a430 0x7f1d7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:52.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.535+0000 7f1d85ffb640 1 -- 172.21.15.38:0/226363193 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d800888d0 con 0x7f1d901547a0 2023-12-22T08:48:52.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.535+0000 7f1d951ed640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d7406a430 0x7f1d7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:52.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.537+0000 7f1d951ed640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d7406a430 0x7f1d7406c8f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c036000 tx=0x7f1d8c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:52.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.539+0000 7f1d85ffb640 1 -- 172.21.15.38:0/226363193 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1d9013f640 con 0x7f1d901547a0 2023-12-22T08:48:52.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.776+0000 7f1d97451640 1 -- 172.21.15.38:0/226363193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1d9013f640 con 0x7f1d901547a0 2023-12-22T08:48:52.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.777+0000 7f1d85ffb640 1 -- 172.21.15.38:0/226363193 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1d9013f640 con 0x7f1d901547a0 2023-12-22T08:48:52.778 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:48:52.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.779+0000 7f1d97451640 1 -- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d7406a430 msgr2=0x7f1d7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.779+0000 7f1d97451640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d7406a430 0x7f1d7406c8f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c036000 tx=0x7f1d8c030000 comp rx=0 tx=0).stop 2023-12-22T08:48:52.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.779+0000 7f1d97451640 1 -- 172.21.15.38:0/226363193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d901547a0 msgr2=0x7f1d900cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:52.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.779+0000 7f1d97451640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d901547a0 0x7f1d900cd380 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c400 tx=0x7f1d8000c8c0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.780+0000 7f1d97451640 1 -- 172.21.15.38:0/226363193 shutdown_connections 2023-12-22T08:48:52.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.780+0000 7f1d97451640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d90154b80 0x7f1d900b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.780+0000 7f1d97451640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1d7406a430 0x7f1d7406c8f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.780+0000 7f1d97451640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d901547a0 0x7f1d900cd380 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.780+0000 7f1d97451640 1 --2- 172.21.15.38:0/226363193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d90071b90 0x7f1d9013a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:52.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.780+0000 7f1d97451640 1 -- 172.21.15.38:0/226363193 >> 172.21.15.38:0/226363193 conn(0x7f1d900cf070 msgr2=0x7f1d9006d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:52.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.780+0000 7f1d97451640 1 -- 172.21.15.38:0/226363193 shutdown_connections 2023-12-22T08:48:52.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:52.780+0000 7f1d97451640 1 -- 172.21.15.38:0/226363193 wait complete. 2023-12-22T08:48:52.800 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:48:52.801 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:48:52.801 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-12-22T08:48:52.801 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T08:48:52.801 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:48:52.801 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:48:52.801 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:48:52.801 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:48:52.801 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:48:52.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:52.802 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-12-22T08:48:52.860 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:48:52.861 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:48:52.861 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:48:52.861 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:52.861 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:48:52.861 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:52.861 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:48:52.861 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:48:52.861 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-12-22T08:48:52.861 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:48:52.861 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:48:52.861 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-12-22T08:48:52.861 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 41833sec preferred_lft 41833sec 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::5440:f6ff:fe40:85a/64 scope link 2023-12-22T08:48:52.862 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:52.863 INFO:teuthology.orchestra.run.smithi038.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:48:52.863 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:c3:65:6c:32:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:48:52.863 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::e4c3:65ff:fe6c:322e/64 scope link 2023-12-22T08:48:52.863 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:52.863 INFO:teuthology.orchestra.run.smithi038.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:48:52.863 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T08:48:52.863 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::34bf:8aff:fe68:3bf6/64 scope link 2023-12-22T08:48:52.863 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:52.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:52.864 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:48:52.964 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-12-22T08:48:52.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:52.968 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-12-22T08:48:53.027 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-12-22T08:48:53.027 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:48:53.027 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-22T08:48:53.027 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-22T08:48:53.028 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:48:53.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:53.028 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:48:53.028 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:48:53.028 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T08:48:53.028 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T08:48:53.028 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T08:48:53.028 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:48:53.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:53.219 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:48:53.277 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:48:53.277 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-22T08:48:53.281 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:48:53.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:53.281 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-12-22T08:48:53.392 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:48:53.392 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T08:48:53.456 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:48:53.456 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:48:53.456 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:48:53.513 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-22T08:48:53.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:53.514 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:48:53.670 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:48:53.670 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:48:53.702 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:48:53.703 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:48:53.703 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:48:53.703 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with new device syntax: 0@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:48:53.703 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:48:53.704 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T08:48:53.704 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:48:53.704 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:48:53.704 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:48:53.704 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:48:53.708 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:48:53.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:53.708 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:48:53.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:53.799 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:48:53.873 INFO:teuthology.orchestra.run.smithi038.stdout:client6760 2023-12-22T08:48:53.874 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:48:53.874 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:53.930 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:48:54.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.158+0000 7efd7157e640 1 Processor -- start 2023-12-22T08:48:54.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.158+0000 7efd7157e640 1 -- start start 2023-12-22T08:48:54.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.160+0000 7efd7157e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efd6c071000 0x7efd6c165f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:54.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.160+0000 7efd7157e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c0cdae0 con 0x7efd6c0a44a0 2023-12-22T08:48:54.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.160+0000 7efd7157e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c15b800 con 0x7efd6c15b420 2023-12-22T08:48:54.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.160+0000 7efd7157e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6c0cdd30 con 0x7efd6c071000 2023-12-22T08:48:54.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.160+0000 7efd63fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efd6c0a44a0 0x7efd6c0708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36840/0 (socket says 172.21.15.38:36840) 2023-12-22T08:48:54.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.160+0000 7efd63fff640 1 -- 172.21.15.38:0/4189381301 learned_addr learned my addr 172.21.15.38:0/4189381301 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:54.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.160+0000 7efd70d7d640 1 --2- 172.21.15.38:0/4189381301 >> v2:172.21.15.38:3300/0 conn(0x7efd6c071000 0x7efd6c165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:54.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.161+0000 7efd6b7fe640 1 -- 172.21.15.38:0/4189381301 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937742119 0 0) 0x7efd6c0cdae0 con 0x7efd6c0a44a0 2023-12-22T08:48:54.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.161+0000 7efd6b7fe640 1 -- 172.21.15.38:0/4189381301 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd58003520 con 0x7efd6c0a44a0 2023-12-22T08:48:54.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.161+0000 7efd70d7d640 1 -- 172.21.15.38:0/4189381301 >> v1:172.21.15.89:6789/0 conn(0x7efd6c15b420 legacy=0x7efd6c06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:54.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.161+0000 7efd70d7d640 1 -- 172.21.15.38:0/4189381301 >> v1:172.21.15.38:6789/0 conn(0x7efd6c0a44a0 legacy=0x7efd6c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:54.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.161+0000 7efd70d7d640 1 -- 172.21.15.38:0/4189381301 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c0ce010 con 0x7efd6c071000 2023-12-22T08:48:54.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.162+0000 7efd70d7d640 1 --2- 172.21.15.38:0/4189381301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd6c071000 0x7efd6c165f50 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7efd64009d90 tx=0x7efd6402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580b5abe42b9177a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:54.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.162+0000 7efd6b7fe640 1 -- 172.21.15.38:0/4189381301 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6402ccf0 con 0x7efd6c071000 2023-12-22T08:48:54.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.163+0000 7efd6b7fe640 1 -- 172.21.15.38:0/4189381301 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6402ce50 con 0x7efd6c071000 2023-12-22T08:48:54.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.163+0000 7efd6b7fe640 1 -- 172.21.15.38:0/4189381301 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64034640 con 0x7efd6c071000 2023-12-22T08:48:54.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.163+0000 7efd7157e640 1 -- 172.21.15.38:0/4189381301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd6c071000 msgr2=0x7efd6c165f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:54.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.163+0000 7efd7157e640 1 --2- 172.21.15.38:0/4189381301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd6c071000 0x7efd6c165f50 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7efd64009d90 tx=0x7efd6402bf40 comp rx=0 tx=0).stop 2023-12-22T08:48:54.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.163+0000 7efd7157e640 1 -- 172.21.15.38:0/4189381301 shutdown_connections 2023-12-22T08:48:54.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.163+0000 7efd7157e640 1 --2- 172.21.15.38:0/4189381301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd6c071000 0x7efd6c165f50 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:54.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.163+0000 7efd7157e640 1 -- 172.21.15.38:0/4189381301 >> 172.21.15.38:0/4189381301 conn(0x7efd6c0b1f70 msgr2=0x7efd6c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:54.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.163+0000 7efd7157e640 1 -- 172.21.15.38:0/4189381301 shutdown_connections 2023-12-22T08:48:54.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.163+0000 7efd7157e640 1 -- 172.21.15.38:0/4189381301 wait complete. 2023-12-22T08:48:54.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.165+0000 7efd7157e640 1 Processor -- start 2023-12-22T08:48:54.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.165+0000 7efd7157e640 1 -- start start 2023-12-22T08:48:54.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.166+0000 7efd7157e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd6c071000 0x7efd6c0a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:54.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.166+0000 7efd7157e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd6c0a44a0 0x7efd6c1f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:54.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.166+0000 7efd7157e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd6c15b420 0x7efd6c1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:54.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.166+0000 7efd7157e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c1544f0 con 0x7efd6c0a44a0 2023-12-22T08:48:54.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.166+0000 7efd7157e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0a33c0 con 0x7efd6c071000 2023-12-22T08:48:54.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.166+0000 7efd7157e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c154740 con 0x7efd6c15b420 2023-12-22T08:48:54.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.166+0000 7efd63fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd6c0a44a0 0x7efd6c1f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:54.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.166+0000 7efd63fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd6c0a44a0 0x7efd6c1f3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57936/0 (socket says 172.21.15.38:57936) 2023-12-22T08:48:54.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.167+0000 7efd63fff640 1 -- 172.21.15.38:0/967903579 learned_addr learned my addr 172.21.15.38:0/967903579 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:54.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.167+0000 7efd63fff640 1 -- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd6c15b420 msgr2=0x7efd6c1557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:54.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.167+0000 7efd6bfff640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd6c071000 0x7efd6c0a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:54.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.167+0000 7efd70d7d640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd6c15b420 0x7efd6c1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:54.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.167+0000 7efd63fff640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd6c15b420 0x7efd6c1557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:54.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.167+0000 7efd63fff640 1 -- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd6c071000 msgr2=0x7efd6c0a2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:54.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.167+0000 7efd63fff640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd6c071000 0x7efd6c0a2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:54.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.167+0000 7efd63fff640 1 -- 172.21.15.38:0/967903579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64009a70 con 0x7efd6c0a44a0 2023-12-22T08:48:54.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.167+0000 7efd6bfff640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd6c071000 0x7efd6c0a2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:54.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.167+0000 7efd63fff640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd6c0a44a0 0x7efd6c1f3380 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c450 tx=0x7efd5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:54.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.168+0000 7efd697fa640 1 -- 172.21.15.38:0/967903579 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54005ce0 con 0x7efd6c0a44a0 2023-12-22T08:48:54.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.168+0000 7efd697fa640 1 -- 172.21.15.38:0/967903579 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd54005e40 con 0x7efd6c0a44a0 2023-12-22T08:48:54.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.168+0000 7efd697fa640 1 -- 172.21.15.38:0/967903579 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd540072b0 con 0x7efd6c0a44a0 2023-12-22T08:48:54.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.168+0000 7efd7157e640 1 -- 172.21.15.38:0/967903579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c154a20 con 0x7efd6c0a44a0 2023-12-22T08:48:54.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.168+0000 7efd7157e640 1 -- 172.21.15.38:0/967903579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c154fe0 con 0x7efd6c0a44a0 2023-12-22T08:48:54.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.169+0000 7efd7157e640 1 -- 172.21.15.38:0/967903579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6c061910 con 0x7efd6c0a44a0 2023-12-22T08:48:54.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.170+0000 7efd697fa640 1 -- 172.21.15.38:0/967903579 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd540074d0 con 0x7efd6c0a44a0 2023-12-22T08:48:54.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.171+0000 7efd697fa640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd4c06a430 0x7efd4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:54.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.171+0000 7efd697fa640 1 -- 172.21.15.38:0/967903579 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd54087f20 con 0x7efd6c0a44a0 2023-12-22T08:48:54.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.172+0000 7efd6bfff640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd4c06a430 0x7efd4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:54.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.173+0000 7efd6bfff640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd4c06a430 0x7efd4c06c8f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efd5c000f60 tx=0x7efd5c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:54.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.175+0000 7efd697fa640 1 -- 172.21.15.38:0/967903579 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd540535c0 con 0x7efd6c0a44a0 2023-12-22T08:48:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.410+0000 7efd7157e640 1 -- 172.21.15.38:0/967903579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efd6c0cb5c0 con 0x7efd6c0a44a0 2023-12-22T08:48:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.411+0000 7efd697fa640 1 -- 172.21.15.38:0/967903579 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7efd54017070 con 0x7efd6c0a44a0 2023-12-22T08:48:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:48:54.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.414+0000 7efd7157e640 1 -- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd4c06a430 msgr2=0x7efd4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:54.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.414+0000 7efd7157e640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd4c06a430 0x7efd4c06c8f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efd5c000f60 tx=0x7efd5c009040 comp rx=0 tx=0).stop 2023-12-22T08:48:54.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.414+0000 7efd7157e640 1 -- 172.21.15.38:0/967903579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd6c0a44a0 msgr2=0x7efd6c1f3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:54.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.414+0000 7efd7157e640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd6c0a44a0 0x7efd6c1f3380 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c450 tx=0x7efd5400c910 comp rx=0 tx=0).stop 2023-12-22T08:48:54.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.414+0000 7efd7157e640 1 -- 172.21.15.38:0/967903579 shutdown_connections 2023-12-22T08:48:54.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.414+0000 7efd7157e640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd6c15b420 0x7efd6c1557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:54.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.414+0000 7efd7157e640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efd4c06a430 0x7efd4c06c8f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:54.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.414+0000 7efd7157e640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd6c0a44a0 0x7efd6c1f3380 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:54.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.414+0000 7efd7157e640 1 --2- 172.21.15.38:0/967903579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd6c071000 0x7efd6c0a2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:54.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.414+0000 7efd7157e640 1 -- 172.21.15.38:0/967903579 >> 172.21.15.38:0/967903579 conn(0x7efd6c0b1f70 msgr2=0x7efd6c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:54.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.414+0000 7efd7157e640 1 -- 172.21.15.38:0/967903579 shutdown_connections 2023-12-22T08:48:54.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:54.414+0000 7efd7157e640 1 -- 172.21.15.38:0/967903579 wait complete. 2023-12-22T08:48:54.433 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:48:54.434 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:48:54.434 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-22T08:48:54.434 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T08:48:54.434 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T08:48:54.434 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:48:54.434 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:48:54.434 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:48:54.434 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:48:54.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:54.434 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-22T08:48:54.496 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:48:54.496 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:48:54.497 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:48:54.497 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:54.497 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:48:54.497 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:54.497 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:48:54.497 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:48:54.497 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-22T08:48:54.497 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:48:54.497 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:48:54.497 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-22T08:48:54.497 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:48:54.497 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:48:54.497 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 41827sec preferred_lft 41827sec 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::9cc2:a9ff:fe75:e812/64 scope link 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8e:46:07:65:e3:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::8c46:7ff:fe65:e31f/64 scope link 2023-12-22T08:48:54.498 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:54.499 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:48:54.499 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T08:48:54.499 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2cc2:baff:fe6f:ea22/64 scope link 2023-12-22T08:48:54.499 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:48:54.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:54.500 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:48:54.592 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-22T08:48:54.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:54.596 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-22T08:48:54.648 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-22T08:48:54.649 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:48:54.649 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:48:54.649 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:48:54.649 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:48:54.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:54.649 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:48:54.649 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:48:54.649 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:48:54.649 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:48:54.649 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:48:54.650 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:48:54.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:54.829 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:48:54.881 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T08:48:54.881 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-22T08:48:54.882 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:48:54.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:54.882 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-22T08:48:54.980 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:48:54.980 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T08:48:55.032 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:48:55.033 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:48:55.033 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:48:55.084 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-22T08:48:55.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:55.085 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:48:55.227 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:48:55.228 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:48:55.261 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:48:55.261 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:48:55.261 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:48:55.261 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 1@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:48:55.261 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:48:55.263 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T08:48:55.263 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:48:55.263 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:48:55.263 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:48:55.263 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:48:55.266 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:48:55.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:55.267 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:48:55.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:48:55.343 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:48:55.395 INFO:teuthology.orchestra.run.smithi089.stdout:client6029 2023-12-22T08:48:55.396 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:48:55.396 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:48:55.444 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:48:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.680+0000 7fd4527a5640 1 Processor -- start 2023-12-22T08:48:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.680+0000 7fd4527a5640 1 -- start start 2023-12-22T08:48:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.682+0000 7fd4527a5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd44c0caf90 0x7fd44c162f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.682+0000 7fd4527a5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd44c0b2a90 0x7fd44c06d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.682+0000 7fd4527a5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c162ce0 con 0x7fd44c071680 2023-12-22T08:48:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.682+0000 7fd4527a5640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c162160 con 0x7fd44c0b2a90 2023-12-22T08:48:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.682+0000 7fd4527a5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c162440 con 0x7fd44c0caf90 2023-12-22T08:48:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.682+0000 7fd451fa4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd44c0b2a90 0x7fd44c06d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.682+0000 7fd4517a3640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd44c071680 0x7fd44c0ca880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36850/0 (socket says 172.21.15.38:36850) 2023-12-22T08:48:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.682+0000 7fd4517a3640 1 -- 172.21.15.38:0/386244363 learned_addr learned my addr 172.21.15.38:0/386244363 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.683+0000 7fd450fa2640 1 --2- 172.21.15.38:0/386244363 >> v2:172.21.15.89:3300/0 conn(0x7fd44c0caf90 0x7fd44c162f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.683+0000 7fd451fa4640 1 -- 172.21.15.38:0/386244363 >> v2:172.21.15.89:3300/0 conn(0x7fd44c0caf90 msgr2=0x7fd44c162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.683+0000 7fd451fa4640 1 --2- 172.21.15.38:0/386244363 >> v2:172.21.15.89:3300/0 conn(0x7fd44c0caf90 0x7fd44c162f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.683+0000 7fd451fa4640 1 -- 172.21.15.38:0/386244363 >> v1:172.21.15.38:6789/0 conn(0x7fd44c071680 legacy=0x7fd44c0ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.683+0000 7fd451fa4640 1 -- 172.21.15.38:0/386244363 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c162720 con 0x7fd44c0b2a90 2023-12-22T08:48:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.683+0000 7fd443fff640 1 -- 172.21.15.38:0/386244363 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770483897 0 0) 0x7fd44c162ce0 con 0x7fd44c071680 2023-12-22T08:48:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.684+0000 7fd451fa4640 1 --2- 172.21.15.38:0/386244363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c0b2a90 0x7fd44c06d280 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fd444009d90 tx=0x7fd44402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d4d28a8d436b35 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.684+0000 7fd443fff640 1 -- 172.21.15.38:0/386244363 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44402cbd0 con 0x7fd44c0b2a90 2023-12-22T08:48:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.685+0000 7fd443fff640 1 -- 172.21.15.38:0/386244363 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44402cd30 con 0x7fd44c0b2a90 2023-12-22T08:48:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.685+0000 7fd443fff640 1 -- 172.21.15.38:0/386244363 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44402cea0 con 0x7fd44c0b2a90 2023-12-22T08:48:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.685+0000 7fd4527a5640 1 -- 172.21.15.38:0/386244363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c0b2a90 msgr2=0x7fd44c06d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.685+0000 7fd4527a5640 1 --2- 172.21.15.38:0/386244363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c0b2a90 0x7fd44c06d280 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fd444009d90 tx=0x7fd44402be20 comp rx=0 tx=0).stop 2023-12-22T08:48:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.685+0000 7fd4527a5640 1 -- 172.21.15.38:0/386244363 shutdown_connections 2023-12-22T08:48:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.685+0000 7fd4527a5640 1 --2- 172.21.15.38:0/386244363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c0b2a90 0x7fd44c06d280 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.685+0000 7fd4527a5640 1 --2- 172.21.15.38:0/386244363 >> v2:172.21.15.89:3300/0 conn(0x7fd44c0caf90 0x7fd44c162f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.685+0000 7fd4527a5640 1 -- 172.21.15.38:0/386244363 >> 172.21.15.38:0/386244363 conn(0x7fd44c0b1f70 msgr2=0x7fd44c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.685+0000 7fd4527a5640 1 -- 172.21.15.38:0/386244363 shutdown_connections 2023-12-22T08:48:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.685+0000 7fd4527a5640 1 -- 172.21.15.38:0/386244363 wait complete. 2023-12-22T08:48:55.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.687+0000 7fd4527a5640 1 Processor -- start 2023-12-22T08:48:55.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.687+0000 7fd4527a5640 1 -- start start 2023-12-22T08:48:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.688+0000 7fd4527a5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd44c071680 0x7fd44c14d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.688+0000 7fd4527a5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c0b2a90 0x7fd44c0af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.688+0000 7fd4527a5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd44c0caf90 0x7fd44c0afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.688+0000 7fd4527a5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c159610 con 0x7fd44c0b2a90 2023-12-22T08:48:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.688+0000 7fd4527a5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c070700 con 0x7fd44c071680 2023-12-22T08:48:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.688+0000 7fd4527a5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c158990 con 0x7fd44c0caf90 2023-12-22T08:48:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.689+0000 7fd450fa2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c0b2a90 0x7fd44c0af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.689+0000 7fd450fa2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c0b2a90 0x7fd44c0af920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57960/0 (socket says 172.21.15.38:57960) 2023-12-22T08:48:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.689+0000 7fd450fa2640 1 -- 172.21.15.38:0/1133358522 learned_addr learned my addr 172.21.15.38:0/1133358522 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.689+0000 7fd451fa4640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd44c0caf90 0x7fd44c0afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.689+0000 7fd4517a3640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd44c071680 0x7fd44c14d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.689+0000 7fd450fa2640 1 -- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd44c0caf90 msgr2=0x7fd44c0afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.689+0000 7fd450fa2640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd44c0caf90 0x7fd44c0afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.689+0000 7fd450fa2640 1 -- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd44c071680 msgr2=0x7fd44c14d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.689+0000 7fd450fa2640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd44c071680 0x7fd44c14d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.689+0000 7fd450fa2640 1 -- 172.21.15.38:0/1133358522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd444009a70 con 0x7fd44c0b2a90 2023-12-22T08:48:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.689+0000 7fd4517a3640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd44c071680 0x7fd44c14d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:48:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.690+0000 7fd450fa2640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c0b2a90 0x7fd44c0af920 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00d5a0 tx=0x7fd43c00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.690+0000 7fd441ffb640 1 -- 172.21.15.38:0/1133358522 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c004240 con 0x7fd44c0b2a90 2023-12-22T08:48:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.690+0000 7fd441ffb640 1 -- 172.21.15.38:0/1133358522 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c0043a0 con 0x7fd44c0b2a90 2023-12-22T08:48:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.690+0000 7fd4527a5640 1 -- 172.21.15.38:0/1133358522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c158c70 con 0x7fd44c0b2a90 2023-12-22T08:48:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.690+0000 7fd441ffb640 1 -- 172.21.15.38:0/1133358522 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c003830 con 0x7fd44c0b2a90 2023-12-22T08:48:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.690+0000 7fd4527a5640 1 -- 172.21.15.38:0/1133358522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c159230 con 0x7fd44c0b2a90 2023-12-22T08:48:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.691+0000 7fd4527a5640 1 -- 172.21.15.38:0/1133358522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44c061910 con 0x7fd44c0b2a90 2023-12-22T08:48:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.692+0000 7fd441ffb640 1 -- 172.21.15.38:0/1133358522 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd43c003990 con 0x7fd44c0b2a90 2023-12-22T08:48:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.693+0000 7fd441ffb640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd43006a430 0x7fd43006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.693+0000 7fd441ffb640 1 -- 172.21.15.38:0/1133358522 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd43c0883d0 con 0x7fd44c0b2a90 2023-12-22T08:48:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.694+0000 7fd4517a3640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd43006a430 0x7fd43006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:55.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.695+0000 7fd4517a3640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd43006a430 0x7fd43006c8f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd448000f60 tx=0x7fd448009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:55.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.697+0000 7fd441ffb640 1 -- 172.21.15.38:0/1133358522 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd43c053a60 con 0x7fd44c0b2a90 2023-12-22T08:48:55.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.928+0000 7fd4527a5640 1 -- 172.21.15.38:0/1133358522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd44c0b2ee0 con 0x7fd44c0b2a90 2023-12-22T08:48:55.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.929+0000 7fd441ffb640 1 -- 172.21.15.38:0/1133358522 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4641 (secure 0 0 0) 0x7fd43c057080 con 0x7fd44c0b2a90 2023-12-22T08:48:55.931 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:48:55.931 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/52711154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":52711154},{"type":"v1","addr":"172.21.15.89:6837","nonce":52711154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2264719173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2264719173},{"type":"v1","addr":"172.21.15.38:6835","nonce":2264719173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3546762659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3546762659},{"type":"v1","addr":"172.21.15.89:6836","nonce":3546762659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:48:44.902723+0000","modified":"2023-12-22T08:48:48.440490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8148":{"gid":8148,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/885304998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":885304998},{"type":"v1","addr":"172.21.15.38:6833","nonce":885304998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-22T08:48:55.931 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 70 2023-12-22T08:48:55.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.932+0000 7fd4527a5640 1 -- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd43006a430 msgr2=0x7fd43006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:55.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.932+0000 7fd4527a5640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd43006a430 0x7fd43006c8f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd448000f60 tx=0x7fd448009040 comp rx=0 tx=0).stop 2023-12-22T08:48:55.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.932+0000 7fd4527a5640 1 -- 172.21.15.38:0/1133358522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c0b2a90 msgr2=0x7fd44c0af920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:55.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.932+0000 7fd4527a5640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c0b2a90 0x7fd44c0af920 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00d5a0 tx=0x7fd43c00da60 comp rx=0 tx=0).stop 2023-12-22T08:48:55.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.932+0000 7fd4527a5640 1 -- 172.21.15.38:0/1133358522 shutdown_connections 2023-12-22T08:48:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.932+0000 7fd4527a5640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd44c0caf90 0x7fd44c0afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.932+0000 7fd4527a5640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd43006a430 0x7fd43006c8f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.932+0000 7fd4527a5640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c0b2a90 0x7fd44c0af920 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.932+0000 7fd4527a5640 1 --2- 172.21.15.38:0/1133358522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd44c071680 0x7fd44c14d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.932+0000 7fd4527a5640 1 -- 172.21.15.38:0/1133358522 >> 172.21.15.38:0/1133358522 conn(0x7fd44c0b1f70 msgr2=0x7fd44c0cc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.932+0000 7fd4527a5640 1 -- 172.21.15.38:0/1133358522 shutdown_connections 2023-12-22T08:48:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:55.932+0000 7fd4527a5640 1 -- 172.21.15.38:0/1133358522 wait complete. 2023-12-22T08:48:55.953 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-22T08:48:56.194 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":8148,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.269391540999999,"mdsmap_epoch":70,"osdmap_epoch":158,"osdmap_epoch_barrier":158,"uptime":17.115351184000001} 2023-12-22T08:48:56.195 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 8148, "mdsmap_epoch": 70, "osdmap_epoch": 158, "osdmap_epoch_barrier": 158, "rank_uptime": 11.269391541, "state": "up:active", "uptime": 17.115351184, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:48:56.195 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-22T08:48:56.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.428+0000 7f346ffff640 1 Processor -- start 2023-12-22T08:48:56.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.428+0000 7f346ffff640 1 -- start start 2023-12-22T08:48:56.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.430+0000 7f346ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f347015b370 0x7f347006d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:56.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.430+0000 7f346ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f34700ae6c0 0x7f347006fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:56.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.430+0000 7f346ffff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347015ca20 con 0x7f347006d6a0 2023-12-22T08:48:56.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.430+0000 7f346ffff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347015b750 con 0x7f347015b370 2023-12-22T08:48:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.430+0000 7f346ffff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347006dc20 con 0x7f34700ae6c0 2023-12-22T08:48:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.430+0000 7f346effd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f347015b370 0x7f347006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.430+0000 7f346e7fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f347006d6a0 0x7f34700adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:36852/0 (socket says 172.21.15.38:36852) 2023-12-22T08:48:56.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.430+0000 7f346e7fc640 1 -- 172.21.15.38:0/2984505863 learned_addr learned my addr 172.21.15.38:0/2984505863 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:48:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.431+0000 7f346f7fe640 1 --2- 172.21.15.38:0/2984505863 >> v2:172.21.15.89:3300/0 conn(0x7f34700ae6c0 0x7f347006fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.431+0000 7f346effd640 1 -- 172.21.15.38:0/2984505863 >> v2:172.21.15.89:3300/0 conn(0x7f34700ae6c0 msgr2=0x7f347006fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:48:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.431+0000 7f346effd640 1 --2- 172.21.15.38:0/2984505863 >> v2:172.21.15.89:3300/0 conn(0x7f34700ae6c0 0x7f347006fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.431+0000 7f346effd640 1 -- 172.21.15.38:0/2984505863 >> v1:172.21.15.38:6789/0 conn(0x7f347006d6a0 legacy=0x7f34700adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.431+0000 7f346effd640 1 -- 172.21.15.38:0/2984505863 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347006df00 con 0x7f347015b370 2023-12-22T08:48:56.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.431+0000 7f346dffb640 1 -- 172.21.15.38:0/2984505863 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156387645 0 0) 0x7f347015ca20 con 0x7f347006d6a0 2023-12-22T08:48:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.432+0000 7f346effd640 1 --2- 172.21.15.38:0/2984505863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f347015b370 0x7f347006d160 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f34700b20e0 tx=0x7f346002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e19ddb6501bec8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.432+0000 7f346dffb640 1 -- 172.21.15.38:0/2984505863 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460031830 con 0x7f347015b370 2023-12-22T08:48:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.433+0000 7f346dffb640 1 -- 172.21.15.38:0/2984505863 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3460031990 con 0x7f347015b370 2023-12-22T08:48:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.433+0000 7f346dffb640 1 -- 172.21.15.38:0/2984505863 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460031d20 con 0x7f347015b370 2023-12-22T08:48:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.433+0000 7f346ffff640 1 -- 172.21.15.38:0/2984505863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f347015b370 msgr2=0x7f347006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.433+0000 7f346ffff640 1 --2- 172.21.15.38:0/2984505863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f347015b370 0x7f347006d160 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f34700b20e0 tx=0x7f346002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:48:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.433+0000 7f346ffff640 1 -- 172.21.15.38:0/2984505863 shutdown_connections 2023-12-22T08:48:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.433+0000 7f346ffff640 1 --2- 172.21.15.38:0/2984505863 >> v2:172.21.15.89:3300/0 conn(0x7f34700ae6c0 0x7f347006fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.433+0000 7f346ffff640 1 --2- 172.21.15.38:0/2984505863 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f347015b370 0x7f347006d160 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.433+0000 7f346ffff640 1 -- 172.21.15.38:0/2984505863 >> 172.21.15.38:0/2984505863 conn(0x7f34700b1110 msgr2=0x7f34700b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.433+0000 7f346ffff640 1 -- 172.21.15.38:0/2984505863 shutdown_connections 2023-12-22T08:48:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.433+0000 7f346ffff640 1 -- 172.21.15.38:0/2984505863 wait complete. 2023-12-22T08:48:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.435+0000 7f346ffff640 1 Processor -- start 2023-12-22T08:48:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.435+0000 7f346ffff640 1 -- start start 2023-12-22T08:48:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.436+0000 7f346ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f347006d6a0 0x7f34701564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.436+0000 7f346ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34700ae6c0 0x7f34700ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.436+0000 7f346ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f347015b370 0x7f34700c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:56.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.436+0000 7f346ffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34700ace60 con 0x7f347006d6a0 2023-12-22T08:48:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.436+0000 7f346ffff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34700addb0 con 0x7f347015b370 2023-12-22T08:48:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.436+0000 7f346ffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34700ac250 con 0x7f34700ae6c0 2023-12-22T08:48:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.436+0000 7f346effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f347006d6a0 0x7f34701564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.437+0000 7f346effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f347006d6a0 0x7f34701564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57978/0 (socket says 172.21.15.38:57978) 2023-12-22T08:48:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.437+0000 7f346effd640 1 -- 172.21.15.38:0/2014908173 learned_addr learned my addr 172.21.15.38:0/2014908173 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:48:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.437+0000 7f346f7fe640 1 --2- 172.21.15.38:0/2014908173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f347015b370 0x7f34700c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.437+0000 7f346effd640 1 -- 172.21.15.38:0/2014908173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34700ae6c0 msgr2=0x7f34700ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.437+0000 7f346effd640 1 --2- 172.21.15.38:0/2014908173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34700ae6c0 0x7f34700ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.437+0000 7f346effd640 1 -- 172.21.15.38:0/2014908173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f347015b370 msgr2=0x7f34700c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.437+0000 7f346effd640 1 --2- 172.21.15.38:0/2014908173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f347015b370 0x7f34700c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.437+0000 7f346effd640 1 -- 172.21.15.38:0/2014908173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3460009400 con 0x7f347006d6a0 2023-12-22T08:48:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.437+0000 7f346effd640 1 --2- 172.21.15.38:0/2014908173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f347006d6a0 0x7f34701564c0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f3460000c00 tx=0x7f34600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:56.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.438+0000 7f3457fff640 1 -- 172.21.15.38:0/2014908173 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346003a8f0 con 0x7f347006d6a0 2023-12-22T08:48:56.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.438+0000 7f3457fff640 1 -- 172.21.15.38:0/2014908173 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346003aa70 con 0x7f347006d6a0 2023-12-22T08:48:56.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.438+0000 7f3457fff640 1 -- 172.21.15.38:0/2014908173 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346003ae20 con 0x7f347006d6a0 2023-12-22T08:48:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.438+0000 7f346ffff640 1 -- 172.21.15.38:0/2014908173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34700ac530 con 0x7f347006d6a0 2023-12-22T08:48:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.438+0000 7f346ffff640 1 -- 172.21.15.38:0/2014908173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34700acaf0 con 0x7f347006d6a0 2023-12-22T08:48:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.439+0000 7f346ffff640 1 -- 172.21.15.38:0/2014908173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3470061910 con 0x7f347006d6a0 2023-12-22T08:48:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.440+0000 7f3457fff640 1 -- 172.21.15.38:0/2014908173 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f346004d450 con 0x7f347006d6a0 2023-12-22T08:48:56.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.441+0000 7f3457fff640 1 --2- 172.21.15.38:0/2014908173 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f345c06a430 0x7f345c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:48:56.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.441+0000 7f3457fff640 1 -- 172.21.15.38:0/2014908173 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34600aaa30 con 0x7f347006d6a0 2023-12-22T08:48:56.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.442+0000 7f346e7fc640 1 --2- 172.21.15.38:0/2014908173 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f345c06a430 0x7f345c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:48:56.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.443+0000 7f346e7fc640 1 --2- 172.21.15.38:0/2014908173 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f345c06a430 0x7f345c06c8f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3464007fd0 tx=0x7f3464007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:48:56.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.446+0000 7f3457fff640 1 -- 172.21.15.38:0/2014908173 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3460075f80 con 0x7f347006d6a0 2023-12-22T08:48:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:56.639+0000 7f346ffff640 1 -- 172.21.15.38:0/2014908173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f34700b3e00 con 0x7f347006d6a0 2023-12-22T08:48:57.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:57.522+0000 7f3457fff640 1 -- 172.21.15.38:0/2014908173 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v159) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3460035070 con 0x7f347006d6a0 2023-12-22T08:48:57.524 INFO:teuthology.orchestra.run.smithi038.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-22T08:48:57.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:57.526+0000 7f346ffff640 1 -- 172.21.15.38:0/2014908173 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f345c06a430 msgr2=0x7f345c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:57.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:57.526+0000 7f346ffff640 1 --2- 172.21.15.38:0/2014908173 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f345c06a430 0x7f345c06c8f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3464007fd0 tx=0x7f3464007920 comp rx=0 tx=0).stop 2023-12-22T08:48:57.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:57.526+0000 7f346ffff640 1 -- 172.21.15.38:0/2014908173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f347006d6a0 msgr2=0x7f34701564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:48:57.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:57.526+0000 7f346ffff640 1 --2- 172.21.15.38:0/2014908173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f347006d6a0 0x7f34701564c0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f3460000c00 tx=0x7f34600046c0 comp rx=0 tx=0).stop 2023-12-22T08:48:57.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:57.526+0000 7f346ffff640 1 -- 172.21.15.38:0/2014908173 shutdown_connections 2023-12-22T08:48:57.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:57.526+0000 7f346ffff640 1 --2- 172.21.15.38:0/2014908173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f347015b370 0x7f34700c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:57.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:57.526+0000 7f346ffff640 1 --2- 172.21.15.38:0/2014908173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34700ae6c0 0x7f34700ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:57.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:57.526+0000 7f346ffff640 1 --2- 172.21.15.38:0/2014908173 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f345c06a430 0x7f345c06c8f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:57.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:57.526+0000 7f346ffff640 1 --2- 172.21.15.38:0/2014908173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f347006d6a0 0x7f34701564c0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:48:57.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:57.526+0000 7f346ffff640 1 -- 172.21.15.38:0/2014908173 >> 172.21.15.38:0/2014908173 conn(0x7f34700b1110 msgr2=0x7f34700afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:48:57.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:57.526+0000 7f346ffff640 1 -- 172.21.15.38:0/2014908173 shutdown_connections 2023-12-22T08:48:57.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:48:57.526+0000 7f346ffff640 1 -- 172.21.15.38:0/2014908173 wait complete. 2023-12-22T08:48:57.549 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-22T08:48:57.789 INFO:teuthology.orchestra.run.smithi038.stdout:{"osd_mon_report_interval":"5"} 2023-12-22T08:48:57.790 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-22T08:48:57.790 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-22T08:48:58.006 INFO:teuthology.orchestra.run.smithi038.stdout:{"mon_tick_interval":"5"} 2023-12-22T08:48:58.006 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-22T08:48:58.006 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-12-22T08:48:58.006 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T08:48:58.006 DEBUG:teuthology.orchestra.run.smithi038:> import time 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> import datetime 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> import subprocess 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> import os 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> # Write some buffered data through before going full, all should be well 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> print("writing some data through which we expect to succeed") 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> bytes = 0 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(f) 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-22T08:48:58.007 DEBUG:teuthology.orchestra.run.smithi038:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> # buffered IO, the error should always only appear from fsync and not 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> # from write 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> full = False 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> for n in range(0, int(32 * 0.9)): 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> print("done writing {0} bytes".format(bytes)) 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> # OK, now we should sneak in under the full condition 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> # due to the time it takes the OSDs to report to the 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> # mons, and get a successful fsync on our full-making data 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(f) 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-12-22T08:48:58.008 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> # buffered write, add more dirty data to the buffer 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> print("starting buffered write") 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> try: 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> for n in range(0, int(32 * 0.2)): 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> time.sleep(15.0) 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> except OSError: 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> pass; 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> # Wait long enough for a background flush that should fail 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> time.sleep(30) 2023-12-22T08:48:58.009 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> if False: 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> # ...and check that the failed background flush is reflected in fclose 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> try: 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> os.close(f) 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> except OSError: 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> print("close() returned an error as expected") 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> else: 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> raise RuntimeError("close() failed to raise error") 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> else: 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> # The kernel cephfs client does not raise errors on fclose 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> os.close(f) 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-22T08:48:58.010 DEBUG:teuthology.orchestra.run.smithi038:> ' 2023-12-22T08:49:18.690 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:49:18.701 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:49:48.855 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:49:48.870 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:50:19.009 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:50:19.019 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:50:49.158 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:50:49.169 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:50:59.362 INFO:teuthology.orchestra.run.smithi038.stdout:writing some data through which we expect to succeed 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-12-22T08:50:59.363 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-12-22T08:50:59.364 INFO:teuthology.orchestra.run.smithi038.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-12-22T08:50:59.365 INFO:teuthology.orchestra.run.smithi038.stdout:done writing 29884416 bytes 2023-12-22T08:50:59.365 INFO:teuthology.orchestra.run.smithi038.stdout:successfully fsync'ed prior to getting full state reported 2023-12-22T08:50:59.365 INFO:teuthology.orchestra.run.smithi038.stdout:starting buffered write 2023-12-22T08:50:59.365 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:50:59.365 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:50:59.365 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:50:59.365 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:50:59.365 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:50:59.365 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:50:59.365 INFO:teuthology.orchestra.run.smithi038.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-12-22T08:50:59.545 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:50:59.546 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:50:59.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:50:59.801 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:50:59.801 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:50:59.801 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:50:59.867 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:50:59.867 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:50:59.927 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:51:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.156+0000 7fcf82622640 1 Processor -- start 2023-12-22T08:51:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.156+0000 7fcf82622640 1 -- start start 2023-12-22T08:51:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.157+0000 7fcf82622640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcf7c15b420 0x7fcf7c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.157+0000 7fcf82622640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf7c0a44a0 0x7fcf7c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.158+0000 7fcf82622640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7c0cdae0 con 0x7fcf7c070e30 2023-12-22T08:51:00.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.158+0000 7fcf82622640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7c071260 con 0x7fcf7c15b420 2023-12-22T08:51:00.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.158+0000 7fcf82622640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c06dec0 con 0x7fcf7c0a44a0 2023-12-22T08:51:00.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.158+0000 7fcf81e21640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcf7c070e30 0x7fcf7c06f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55188/0 (socket says 172.21.15.38:55188) 2023-12-22T08:51:00.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.158+0000 7fcf81e21640 1 -- 172.21.15.38:0/1233598696 learned_addr learned my addr 172.21.15.38:0/1233598696 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.158+0000 7fcf81620640 1 --2- 172.21.15.38:0/1233598696 >> v2:172.21.15.89:3300/0 conn(0x7fcf7c15b420 0x7fcf7c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.158+0000 7fcf80e1f640 1 --2- 172.21.15.38:0/1233598696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf7c0a44a0 0x7fcf7c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.158+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603050073 0 0) 0x7fcf7c0cdae0 con 0x7fcf7c070e30 2023-12-22T08:51:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.158+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf68003520 con 0x7fcf7c070e30 2023-12-22T08:51:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2417000167 0 0) 0x7fcf68003520 con 0x7fcf7c070e30 2023-12-22T08:51:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf7c0a44a0 msgr2=0x7fcf7c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 --2- 172.21.15.38:0/1233598696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf7c0a44a0 0x7fcf7c0708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 >> v2:172.21.15.89:3300/0 conn(0x7fcf7c15b420 msgr2=0x7fcf7c06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 --2- 172.21.15.38:0/1233598696 >> v2:172.21.15.89:3300/0 conn(0x7fcf7c15b420 0x7fcf7c06d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c15b800 con 0x7fcf7c070e30 2023-12-22T08:51:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fcf740019f0 con 0x7fcf7c070e30 2023-12-22T08:51:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 >> v1:172.21.15.38:6789/0 conn(0x7fcf7c070e30 legacy=0x7fcf7c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 --2- 172.21.15.38:0/1233598696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf68003970 0x7fcf68003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 --2- 172.21.15.38:0/1233598696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf680047c0 0x7fcf68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 --2- 172.21.15.38:0/1233598696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf7c0a44a0 0x7fcf68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c071260 con 0x7fcf68003970 2023-12-22T08:51:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c06dec0 con 0x7fcf680047c0 2023-12-22T08:51:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6800b980 con 0x7fcf7c0a44a0 2023-12-22T08:51:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.159+0000 7fcf81620640 1 --2- 172.21.15.38:0/1233598696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf68003970 0x7fcf68003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.160+0000 7fcf81e21640 1 --2- 172.21.15.38:0/1233598696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf7c0a44a0 0x7fcf68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.160+0000 7fcf80e1f640 1 --2- 172.21.15.38:0/1233598696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf680047c0 0x7fcf68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.160+0000 7fcf81620640 1 -- 172.21.15.38:0/1233598696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf7c0a44a0 msgr2=0x7fcf68005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.160+0000 7fcf81620640 1 --2- 172.21.15.38:0/1233598696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf7c0a44a0 0x7fcf68005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.160+0000 7fcf81620640 1 -- 172.21.15.38:0/1233598696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf680047c0 msgr2=0x7fcf68004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:00.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.160+0000 7fcf81620640 1 --2- 172.21.15.38:0/1233598696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf680047c0 0x7fcf68004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.160+0000 7fcf81620640 1 -- 172.21.15.38:0/1233598696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf68003520 con 0x7fcf68003970 2023-12-22T08:51:00.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.160+0000 7fcf80e1f640 1 --2- 172.21.15.38:0/1233598696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf680047c0 0x7fcf68004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:00.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.161+0000 7fcf81620640 1 --2- 172.21.15.38:0/1233598696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf68003970 0x7fcf68003d90 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009ac0 tx=0x7fcf680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad23f10470bbb797 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:00.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.161+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7802c6d0 con 0x7fcf68003970 2023-12-22T08:51:00.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.161+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7802c830 con 0x7fcf68003970 2023-12-22T08:51:00.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.161+0000 7fcf73fff640 1 -- 172.21.15.38:0/1233598696 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7802cbc0 con 0x7fcf68003970 2023-12-22T08:51:00.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.162+0000 7fcf82622640 1 -- 172.21.15.38:0/1233598696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf68003970 msgr2=0x7fcf68003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:00.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.162+0000 7fcf82622640 1 --2- 172.21.15.38:0/1233598696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf68003970 0x7fcf68003d90 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009ac0 tx=0x7fcf680057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.162+0000 7fcf81e21640 1 -- 172.21.15.38:0/1233598696 reap_dead start 2023-12-22T08:51:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.162+0000 7fcf82622640 1 -- 172.21.15.38:0/1233598696 shutdown_connections 2023-12-22T08:51:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.162+0000 7fcf82622640 1 -- 172.21.15.38:0/1233598696 >> 172.21.15.38:0/1233598696 conn(0x7fcf7c0b1f70 msgr2=0x7fcf7c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.162+0000 7fcf82622640 1 -- 172.21.15.38:0/1233598696 shutdown_connections 2023-12-22T08:51:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.162+0000 7fcf82622640 1 -- 172.21.15.38:0/1233598696 wait complete. 2023-12-22T08:51:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.164+0000 7fcf82622640 1 Processor -- start 2023-12-22T08:51:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.164+0000 7fcf82622640 1 -- start start 2023-12-22T08:51:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.165+0000 7fcf82622640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf68003970 0x7fcf7c0a27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.165+0000 7fcf82622640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf7c1556a0 0x7fcf7c14a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.165+0000 7fcf82622640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf7c06d110 0x7fcf7c06d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.165+0000 7fcf82622640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c06dad0 con 0x7fcf68003970 2023-12-22T08:51:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.165+0000 7fcf82622640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c153750 con 0x7fcf7c06d110 2023-12-22T08:51:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.165+0000 7fcf82622640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c155e10 con 0x7fcf7c1556a0 2023-12-22T08:51:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.165+0000 7fcf81620640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf68003970 0x7fcf7c0a27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.166+0000 7fcf81620640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf68003970 0x7fcf7c0a27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51858/0 (socket says 172.21.15.38:51858) 2023-12-22T08:51:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.166+0000 7fcf81620640 1 -- 172.21.15.38:0/2409307679 learned_addr learned my addr 172.21.15.38:0/2409307679 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.166+0000 7fcf81620640 1 -- 172.21.15.38:0/2409307679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf7c1556a0 msgr2=0x7fcf7c14a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.166+0000 7fcf81620640 1 --2- 172.21.15.38:0/2409307679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf7c1556a0 0x7fcf7c14a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.166+0000 7fcf81620640 1 -- 172.21.15.38:0/2409307679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf7c06d110 msgr2=0x7fcf7c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.166+0000 7fcf81620640 1 --2- 172.21.15.38:0/2409307679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf7c06d110 0x7fcf7c06d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.166+0000 7fcf81620640 1 -- 172.21.15.38:0/2409307679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c1539f0 con 0x7fcf68003970 2023-12-22T08:51:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.166+0000 7fcf81620640 1 --2- 172.21.15.38:0/2409307679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf68003970 0x7fcf7c0a27d0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fcf7802c2d0 tx=0x7fcf78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.167+0000 7fcf71ffb640 1 -- 172.21.15.38:0/2409307679 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78003810 con 0x7fcf68003970 2023-12-22T08:51:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.167+0000 7fcf71ffb640 1 -- 172.21.15.38:0/2409307679 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf78003970 con 0x7fcf68003970 2023-12-22T08:51:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.167+0000 7fcf71ffb640 1 -- 172.21.15.38:0/2409307679 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78003ce0 con 0x7fcf68003970 2023-12-22T08:51:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.167+0000 7fcf82622640 1 -- 172.21.15.38:0/2409307679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7c153cd0 con 0x7fcf68003970 2023-12-22T08:51:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.167+0000 7fcf82622640 1 -- 172.21.15.38:0/2409307679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7c155b00 con 0x7fcf68003970 2023-12-22T08:51:00.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.168+0000 7fcf82622640 1 -- 172.21.15.38:0/2409307679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7c061910 con 0x7fcf68003970 2023-12-22T08:51:00.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.169+0000 7fcf71ffb640 1 -- 172.21.15.38:0/2409307679 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcf78040660 con 0x7fcf68003970 2023-12-22T08:51:00.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.170+0000 7fcf71ffb640 1 --2- 172.21.15.38:0/2409307679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcf6006a460 0x7fcf6006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.170+0000 7fcf71ffb640 1 -- 172.21.15.38:0/2409307679 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf780aa9d0 con 0x7fcf68003970 2023-12-22T08:51:00.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.171+0000 7fcf71ffb640 1 -- 172.21.15.38:0/2409307679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fcf60071f90 con 0x7fcf68003970 2023-12-22T08:51:00.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.171+0000 7fcf80e1f640 1 --2- 172.21.15.38:0/2409307679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcf6006a460 0x7fcf6006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.172+0000 7fcf80e1f640 1 --2- 172.21.15.38:0/2409307679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcf6006a460 0x7fcf6006c920 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c1f5d10 tx=0x7fcf6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:00.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.175+0000 7fcf71ffb640 1 -- 172.21.15.38:0/2409307679 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcf78075f20 con 0x7fcf68003970 2023-12-22T08:51:00.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.378+0000 7fcf82622640 1 -- 172.21.15.38:0/2409307679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf7c0cb5c0 con 0x7fcf68003970 2023-12-22T08:51:00.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.381+0000 7fcf71ffb640 1 -- 172.21.15.38:0/2409307679 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fcf780044e0 con 0x7fcf68003970 2023-12-22T08:51:00.382 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:00.383 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":160,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:50:21.331381+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:48:42.499151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-22T08:48:43.921718+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:51:00.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.384+0000 7fcf82622640 1 -- 172.21.15.38:0/2409307679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcf6006a460 msgr2=0x7fcf6006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:00.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.384+0000 7fcf82622640 1 --2- 172.21.15.38:0/2409307679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcf6006a460 0x7fcf6006c920 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c1f5d10 tx=0x7fcf6c008040 comp rx=0 tx=0).stop 2023-12-22T08:51:00.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.384+0000 7fcf82622640 1 -- 172.21.15.38:0/2409307679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf68003970 msgr2=0x7fcf7c0a27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:00.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.384+0000 7fcf82622640 1 --2- 172.21.15.38:0/2409307679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf68003970 0x7fcf7c0a27d0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fcf7802c2d0 tx=0x7fcf78004730 comp rx=0 tx=0).stop 2023-12-22T08:51:00.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.384+0000 7fcf82622640 1 -- 172.21.15.38:0/2409307679 shutdown_connections 2023-12-22T08:51:00.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.384+0000 7fcf82622640 1 --2- 172.21.15.38:0/2409307679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf7c06d110 0x7fcf7c06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.384+0000 7fcf82622640 1 --2- 172.21.15.38:0/2409307679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf7c1556a0 0x7fcf7c14a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.384+0000 7fcf82622640 1 --2- 172.21.15.38:0/2409307679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcf6006a460 0x7fcf6006c920 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.384+0000 7fcf82622640 1 --2- 172.21.15.38:0/2409307679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf68003970 0x7fcf7c0a27d0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.384+0000 7fcf82622640 1 -- 172.21.15.38:0/2409307679 >> 172.21.15.38:0/2409307679 conn(0x7fcf7c0b1f70 msgr2=0x7fcf7c0cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:00.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.384+0000 7fcf82622640 1 -- 172.21.15.38:0/2409307679 shutdown_connections 2023-12-22T08:51:00.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.384+0000 7fcf82622640 1 -- 172.21.15.38:0/2409307679 wait complete. 2023-12-22T08:51:00.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:48:42.499151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:48:43.921718+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:51:00.407 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:51:00.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.630+0000 7fa2c13ce640 1 Processor -- start 2023-12-22T08:51:00.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.630+0000 7fa2c13ce640 1 -- start start 2023-12-22T08:51:00.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.632+0000 7fa2c13ce640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2bc15d3e0 0x7fa2bc15b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.632+0000 7fa2c13ce640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc070360 con 0x7fa2bc15d7c0 2023-12-22T08:51:00.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.632+0000 7fa2c13ce640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc070640 con 0x7fa2bc15a7b0 2023-12-22T08:51:00.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.632+0000 7fa2c13ce640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc070170 con 0x7fa2bc15d3e0 2023-12-22T08:51:00.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.632+0000 7fa2bb7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa2bc15d7c0 0x7fa2bc06fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55192/0 (socket says 172.21.15.38:55192) 2023-12-22T08:51:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.632+0000 7fa2bb7fe640 1 -- 172.21.15.38:0/3482950716 learned_addr learned my addr 172.21.15.38:0/3482950716 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.633+0000 7fa2bbfff640 1 --2- 172.21.15.38:0/3482950716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2bc15d3e0 0x7fa2bc15b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.633+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918543516 0 0) 0x7fa2bc070360 con 0x7fa2bc15d7c0 2023-12-22T08:51:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.633+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2a4003520 con 0x7fa2bc15d7c0 2023-12-22T08:51:00.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.633+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 654641762 0 0) 0x7fa2a4003520 con 0x7fa2bc15d7c0 2023-12-22T08:51:00.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.633+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2bc15d3e0 msgr2=0x7fa2bc15b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:00.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.633+0000 7fa2baffd640 1 --2- 172.21.15.38:0/3482950716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2bc15d3e0 0x7fa2bc15b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.633+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 >> v1:172.21.15.89:6789/0 conn(0x7fa2bc15a7b0 legacy=0x7fa2bc06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:00.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.633+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc070920 con 0x7fa2bc15d7c0 2023-12-22T08:51:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.633+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fa2b0001670 con 0x7fa2bc15d7c0 2023-12-22T08:51:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.633+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 >> v1:172.21.15.38:6789/0 conn(0x7fa2bc15d7c0 legacy=0x7fa2bc06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.633+0000 7fa2baffd640 1 --2- 172.21.15.38:0/3482950716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2a40039a0 0x7fa2a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.633+0000 7fa2baffd640 1 --2- 172.21.15.38:0/3482950716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a40047c0 0x7fa2a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.634+0000 7fa2baffd640 1 --2- 172.21.15.38:0/3482950716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2bc15d3e0 0x7fa2a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.634+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a400ba30 con 0x7fa2a40039a0 2023-12-22T08:51:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.634+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a400bba0 con 0x7fa2a40047c0 2023-12-22T08:51:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.634+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a400df70 con 0x7fa2bc15d3e0 2023-12-22T08:51:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.634+0000 7fa2bbfff640 1 --2- 172.21.15.38:0/3482950716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2a40039a0 0x7fa2a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.634+0000 7fa2bb7fe640 1 --2- 172.21.15.38:0/3482950716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a40047c0 0x7fa2a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.634+0000 7fa2bbfff640 1 -- 172.21.15.38:0/3482950716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2bc15d3e0 msgr2=0x7fa2a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.634+0000 7fa2c0bcd640 1 --2- 172.21.15.38:0/3482950716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2bc15d3e0 0x7fa2a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.634+0000 7fa2bbfff640 1 --2- 172.21.15.38:0/3482950716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2bc15d3e0 0x7fa2a4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.634+0000 7fa2bbfff640 1 -- 172.21.15.38:0/3482950716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a40047c0 msgr2=0x7fa2a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.634+0000 7fa2bbfff640 1 --2- 172.21.15.38:0/3482950716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a40047c0 0x7fa2a4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.634+0000 7fa2bbfff640 1 -- 172.21.15.38:0/3482950716 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a4003520 con 0x7fa2a40039a0 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.634+0000 7fa2bb7fe640 1 --2- 172.21.15.38:0/3482950716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2a40047c0 0x7fa2a4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.635+0000 7fa2bbfff640 1 --2- 172.21.15.38:0/3482950716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2a40039a0 0x7fa2a4003dc0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009a90 tx=0x7fa2a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eecd638e216e1ea server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.636+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac02c680 con 0x7fa2a40039a0 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.636+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac02c7e0 con 0x7fa2a40039a0 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.636+0000 7fa2baffd640 1 -- 172.21.15.38:0/3482950716 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac02cb70 con 0x7fa2a40039a0 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.636+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3482950716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2a40039a0 msgr2=0x7fa2a4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.636+0000 7fa2c13ce640 1 --2- 172.21.15.38:0/3482950716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2a40039a0 0x7fa2a4003dc0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009a90 tx=0x7fa2a40057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.636+0000 7fa2c0bcd640 1 -- 172.21.15.38:0/3482950716 reap_dead start 2023-12-22T08:51:00.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.636+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3482950716 shutdown_connections 2023-12-22T08:51:00.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.636+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3482950716 >> 172.21.15.38:0/3482950716 conn(0x7fa2bc0b0b60 msgr2=0x7fa2bc0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:00.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.636+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3482950716 shutdown_connections 2023-12-22T08:51:00.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.636+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3482950716 wait complete. 2023-12-22T08:51:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.638+0000 7fa2c13ce640 1 Processor -- start 2023-12-22T08:51:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.638+0000 7fa2c13ce640 1 -- start start 2023-12-22T08:51:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.639+0000 7fa2c13ce640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2a40039a0 0x7fa2bc1e4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.639+0000 7fa2c13ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2bc1e72f0 0x7fa2bc1521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.639+0000 7fa2c13ce640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2bc06ca30 0x7fa2bc06cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.639+0000 7fa2c13ce640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc1e5f60 con 0x7fa2a40039a0 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.639+0000 7fa2c13ce640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc06d420 con 0x7fa2bc1e72f0 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.639+0000 7fa2c13ce640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc1e52e0 con 0x7fa2bc06ca30 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.640+0000 7fa2bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2a40039a0 0x7fa2bc1e4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.640+0000 7fa2bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2a40039a0 0x7fa2bc1e4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51870/0 (socket says 172.21.15.38:51870) 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.640+0000 7fa2bbfff640 1 -- 172.21.15.38:0/3620197242 learned_addr learned my addr 172.21.15.38:0/3620197242 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.640+0000 7fa2bbfff640 1 -- 172.21.15.38:0/3620197242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2bc06ca30 msgr2=0x7fa2bc06cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.640+0000 7fa2bbfff640 1 --2- 172.21.15.38:0/3620197242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2bc06ca30 0x7fa2bc06cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.640+0000 7fa2bbfff640 1 -- 172.21.15.38:0/3620197242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2bc1e72f0 msgr2=0x7fa2bc1521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.640+0000 7fa2bb7fe640 1 --2- 172.21.15.38:0/3620197242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2bc1e72f0 0x7fa2bc1521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.640+0000 7fa2bbfff640 1 --2- 172.21.15.38:0/3620197242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2bc1e72f0 0x7fa2bc1521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.640+0000 7fa2bbfff640 1 -- 172.21.15.38:0/3620197242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc1e55c0 con 0x7fa2a40039a0 2023-12-22T08:51:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.640+0000 7fa2bbfff640 1 --2- 172.21.15.38:0/3620197242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2a40039a0 0x7fa2bc1e4c50 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac02c220 tx=0x7fa2ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.641+0000 7fa2b8ff9640 1 -- 172.21.15.38:0/3620197242 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac003810 con 0x7fa2a40039a0 2023-12-22T08:51:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.641+0000 7fa2b8ff9640 1 -- 172.21.15.38:0/3620197242 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac003970 con 0x7fa2a40039a0 2023-12-22T08:51:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.641+0000 7fa2b8ff9640 1 -- 172.21.15.38:0/3620197242 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac003ce0 con 0x7fa2a40039a0 2023-12-22T08:51:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.641+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3620197242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc1e58a0 con 0x7fa2a40039a0 2023-12-22T08:51:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.641+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3620197242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc1e7770 con 0x7fa2a40039a0 2023-12-22T08:51:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.642+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3620197242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2bc1e5f60 con 0x7fa2a40039a0 2023-12-22T08:51:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.643+0000 7fa2b8ff9640 1 -- 172.21.15.38:0/3620197242 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa2ac034440 con 0x7fa2a40039a0 2023-12-22T08:51:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.644+0000 7fa2b8ff9640 1 --2- 172.21.15.38:0/3620197242 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2a806a460 0x7fa2a806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.644+0000 7fa2b8ff9640 1 -- 172.21.15.38:0/3620197242 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2ac0aa780 con 0x7fa2a40039a0 2023-12-22T08:51:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.644+0000 7fa2b8ff9640 1 -- 172.21.15.38:0/3620197242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fa2a8071f90 con 0x7fa2a40039a0 2023-12-22T08:51:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.645+0000 7fa2bb7fe640 1 --2- 172.21.15.38:0/3620197242 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2a806a460 0x7fa2a806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:00.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.646+0000 7fa2bb7fe640 1 --2- 172.21.15.38:0/3620197242 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2a806a460 0x7fa2a806c920 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0b0860 tx=0x7fa2b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:00.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.649+0000 7fa2b8ff9640 1 -- 172.21.15.38:0/3620197242 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa2ac04c060 con 0x7fa2a40039a0 2023-12-22T08:51:00.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.844+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3620197242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2bc061910 con 0x7fa2a40039a0 2023-12-22T08:51:00.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.845+0000 7fa2b8ff9640 1 -- 172.21.15.38:0/3620197242 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v160) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2ac0390a0 con 0x7fa2a40039a0 2023-12-22T08:51:00.846 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:51:00.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.848+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3620197242 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2a806a460 msgr2=0x7fa2a806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:00.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.848+0000 7fa2c13ce640 1 --2- 172.21.15.38:0/3620197242 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2a806a460 0x7fa2a806c920 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0b0860 tx=0x7fa2b0009040 comp rx=0 tx=0).stop 2023-12-22T08:51:00.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.848+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3620197242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2a40039a0 msgr2=0x7fa2bc1e4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:00.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.848+0000 7fa2c13ce640 1 --2- 172.21.15.38:0/3620197242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2a40039a0 0x7fa2bc1e4c50 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac02c220 tx=0x7fa2ac004730 comp rx=0 tx=0).stop 2023-12-22T08:51:00.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.848+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3620197242 shutdown_connections 2023-12-22T08:51:00.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.848+0000 7fa2c13ce640 1 --2- 172.21.15.38:0/3620197242 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa2bc06ca30 0x7fa2bc06cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.848+0000 7fa2c13ce640 1 --2- 172.21.15.38:0/3620197242 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2bc1e72f0 0x7fa2bc1521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.848+0000 7fa2c13ce640 1 --2- 172.21.15.38:0/3620197242 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa2a806a460 0x7fa2a806c920 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.848+0000 7fa2c13ce640 1 --2- 172.21.15.38:0/3620197242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2a40039a0 0x7fa2bc1e4c50 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:00.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.848+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3620197242 >> 172.21.15.38:0/3620197242 conn(0x7fa2bc0b0b60 msgr2=0x7fa2bc15abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:00.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.848+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3620197242 shutdown_connections 2023-12-22T08:51:00.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:00.849+0000 7fa2c13ce640 1 -- 172.21.15.38:0/3620197242 wait complete. 2023-12-22T08:51:00.869 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:51:01.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.101+0000 7f1d07631640 1 Processor -- start 2023-12-22T08:51:01.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.101+0000 7f1d07631640 1 -- start start 2023-12-22T08:51:01.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.103+0000 7f1d07631640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1d0015e740 0x7f1d0015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:01.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.103+0000 7f1d07631640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1d0006ca50 0x7f1d000b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:01.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.103+0000 7f1d07631640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d0015eb20 con 0x7f1d000b3dc0 2023-12-22T08:51:01.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.103+0000 7f1d07631640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0006e650 con 0x7f1d0006ca50 2023-12-22T08:51:01.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.103+0000 7f1d07631640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d00070770 con 0x7f1d0015e740 2023-12-22T08:51:01.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.103+0000 7f1d04bcc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1d0006ca50 0x7f1d000b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:01.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.103+0000 7f1d05bce640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1d000b3dc0 0x7f1d00161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46488/0 (socket says 172.21.15.38:46488) 2023-12-22T08:51:01.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.103+0000 7f1d05bce640 1 -- 172.21.15.38:0/1333325043 learned_addr learned my addr 172.21.15.38:0/1333325043 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:01.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.104+0000 7f1d053cd640 1 --2- 172.21.15.38:0/1333325043 >> v2:172.21.15.89:3300/0 conn(0x7f1d0015e740 0x7f1d0015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:01.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.104+0000 7f1d04bcc640 1 -- 172.21.15.38:0/1333325043 >> v2:172.21.15.89:3300/0 conn(0x7f1d0015e740 msgr2=0x7f1d0015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.104+0000 7f1d04bcc640 1 --2- 172.21.15.38:0/1333325043 >> v2:172.21.15.89:3300/0 conn(0x7f1d0015e740 0x7f1d0015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.104+0000 7f1d04bcc640 1 -- 172.21.15.38:0/1333325043 >> v1:172.21.15.38:6789/0 conn(0x7f1d000b3dc0 legacy=0x7f1d00161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.104+0000 7f1d04bcc640 1 -- 172.21.15.38:0/1333325043 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d000b41d0 con 0x7f1d0006ca50 2023-12-22T08:51:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.104+0000 7f1cf7fff640 1 -- 172.21.15.38:0/1333325043 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484409747 0 0) 0x7f1d0015eb20 con 0x7f1d000b3dc0 2023-12-22T08:51:01.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.104+0000 7f1d053cd640 1 --2- 172.21.15.38:0/1333325043 >> v2:172.21.15.89:3300/0 conn(0x7f1d0015e740 0x7f1d0015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:01.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.105+0000 7f1d04bcc640 1 --2- 172.21.15.38:0/1333325043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0006ca50 0x7f1d000b3880 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f1d0006ca20 tx=0x7f1cf002b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d362a70a960211da server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:01.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.105+0000 7f1cf7fff640 1 -- 172.21.15.38:0/1333325043 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0031520 con 0x7f1d0006ca50 2023-12-22T08:51:01.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.105+0000 7f1cf7fff640 1 -- 172.21.15.38:0/1333325043 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf0031680 con 0x7f1d0006ca50 2023-12-22T08:51:01.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.105+0000 7f1cf7fff640 1 -- 172.21.15.38:0/1333325043 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0031a10 con 0x7f1d0006ca50 2023-12-22T08:51:01.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.106+0000 7f1d07631640 1 -- 172.21.15.38:0/1333325043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0006ca50 msgr2=0x7f1d000b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:01.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.106+0000 7f1d07631640 1 --2- 172.21.15.38:0/1333325043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0006ca50 0x7f1d000b3880 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f1d0006ca20 tx=0x7f1cf002b7c0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.106+0000 7f1d07631640 1 -- 172.21.15.38:0/1333325043 shutdown_connections 2023-12-22T08:51:01.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.106+0000 7f1d07631640 1 --2- 172.21.15.38:0/1333325043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0006ca50 0x7f1d000b3880 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.106+0000 7f1d07631640 1 --2- 172.21.15.38:0/1333325043 >> v2:172.21.15.89:3300/0 conn(0x7f1d0015e740 0x7f1d0015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.106+0000 7f1d07631640 1 -- 172.21.15.38:0/1333325043 >> 172.21.15.38:0/1333325043 conn(0x7f1d000cfea0 msgr2=0x7f1d000d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.106+0000 7f1d07631640 1 -- 172.21.15.38:0/1333325043 shutdown_connections 2023-12-22T08:51:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.106+0000 7f1d07631640 1 -- 172.21.15.38:0/1333325043 wait complete. 2023-12-22T08:51:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.108+0000 7f1d07631640 1 Processor -- start 2023-12-22T08:51:01.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.108+0000 7f1d07631640 1 -- start start 2023-12-22T08:51:01.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.109+0000 7f1d07631640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0006ca50 0x7f1d001f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.109+0000 7f1d07631640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d000b3dc0 0x7f1d00156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.109+0000 7f1d07631640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d0015e740 0x7f1d00159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.109+0000 7f1d07631640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d00142870 con 0x7f1d0006ca50 2023-12-22T08:51:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.109+0000 7f1d07631640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d00142ac0 con 0x7f1d0015e740 2023-12-22T08:51:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.109+0000 7f1d07631640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d00142da0 con 0x7f1d000b3dc0 2023-12-22T08:51:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.109+0000 7f1d053cd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0006ca50 0x7f1d001f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.109+0000 7f1d053cd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0006ca50 0x7f1d001f27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35340/0 (socket says 172.21.15.38:35340) 2023-12-22T08:51:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.109+0000 7f1d053cd640 1 -- 172.21.15.38:0/2519190737 learned_addr learned my addr 172.21.15.38:0/2519190737 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.110+0000 7f1d04bcc640 1 --2- 172.21.15.38:0/2519190737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d000b3dc0 0x7f1d00156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.110+0000 7f1d053cd640 1 -- 172.21.15.38:0/2519190737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d000b3dc0 msgr2=0x7f1d00156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.110+0000 7f1d053cd640 1 --2- 172.21.15.38:0/2519190737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d000b3dc0 0x7f1d00156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.110+0000 7f1d053cd640 1 -- 172.21.15.38:0/2519190737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d0015e740 msgr2=0x7f1d00159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:01.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.110+0000 7f1d053cd640 1 --2- 172.21.15.38:0/2519190737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d0015e740 0x7f1d00159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.110+0000 7f1d053cd640 1 -- 172.21.15.38:0/2519190737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf0009400 con 0x7f1d0006ca50 2023-12-22T08:51:01.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.110+0000 7f1d053cd640 1 --2- 172.21.15.38:0/2519190737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0006ca50 0x7f1d001f27e0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00cf60 tx=0x7f1cfc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:01.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.110+0000 7f1cf5ffb640 1 -- 172.21.15.38:0/2519190737 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00d840 con 0x7f1d0006ca50 2023-12-22T08:51:01.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.110+0000 7f1cf5ffb640 1 -- 172.21.15.38:0/2519190737 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc00d9a0 con 0x7f1d0006ca50 2023-12-22T08:51:01.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.110+0000 7f1cf5ffb640 1 -- 172.21.15.38:0/2519190737 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00dd30 con 0x7f1d0006ca50 2023-12-22T08:51:01.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.110+0000 7f1d07631640 1 -- 172.21.15.38:0/2519190737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d00143080 con 0x7f1d0006ca50 2023-12-22T08:51:01.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.111+0000 7f1d07631640 1 -- 172.21.15.38:0/2519190737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d00143640 con 0x7f1d0006ca50 2023-12-22T08:51:01.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.112+0000 7f1d07631640 1 -- 172.21.15.38:0/2519190737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d00061910 con 0x7f1d0006ca50 2023-12-22T08:51:01.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.113+0000 7f1cf5ffb640 1 -- 172.21.15.38:0/2519190737 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1cfc015440 con 0x7f1d0006ca50 2023-12-22T08:51:01.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.114+0000 7f1cf5ffb640 1 --2- 172.21.15.38:0/2519190737 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ce406a430 0x7f1ce406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:01.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.114+0000 7f1cf5ffb640 1 -- 172.21.15.38:0/2519190737 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cfc0893b0 con 0x7f1d0006ca50 2023-12-22T08:51:01.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.114+0000 7f1cf5ffb640 1 -- 172.21.15.38:0/2519190737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f1ce4071f60 con 0x7f1d0006ca50 2023-12-22T08:51:01.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.114+0000 7f1d04bcc640 1 --2- 172.21.15.38:0/2519190737 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ce406a430 0x7f1ce406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:01.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.115+0000 7f1d04bcc640 1 --2- 172.21.15.38:0/2519190737 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ce406a430 0x7f1ce406c8f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0035000 tx=0x7f1cf0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:01.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.119+0000 7f1cf5ffb640 1 -- 172.21.15.38:0/2519190737 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1cfc01a060 con 0x7f1d0006ca50 2023-12-22T08:51:01.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.311+0000 7f1d07631640 1 -- 172.21.15.38:0/2519190737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d00143830 con 0x7f1d0006ca50 2023-12-22T08:51:01.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.312+0000 7f1cf5ffb640 1 -- 172.21.15.38:0/2519190737 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v160) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1cfc0549b0 con 0x7f1d0006ca50 2023-12-22T08:51:01.313 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:51:01.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.314+0000 7f1d07631640 1 -- 172.21.15.38:0/2519190737 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ce406a430 msgr2=0x7f1ce406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:01.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.314+0000 7f1d07631640 1 --2- 172.21.15.38:0/2519190737 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ce406a430 0x7f1ce406c8f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0035000 tx=0x7f1cf0030000 comp rx=0 tx=0).stop 2023-12-22T08:51:01.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.314+0000 7f1d07631640 1 -- 172.21.15.38:0/2519190737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0006ca50 msgr2=0x7f1d001f27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:01.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.314+0000 7f1d07631640 1 --2- 172.21.15.38:0/2519190737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0006ca50 0x7f1d001f27e0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00cf60 tx=0x7f1cfc00cf90 comp rx=0 tx=0).stop 2023-12-22T08:51:01.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.315+0000 7f1d07631640 1 -- 172.21.15.38:0/2519190737 shutdown_connections 2023-12-22T08:51:01.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.315+0000 7f1d07631640 1 --2- 172.21.15.38:0/2519190737 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d0015e740 0x7f1d00159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.315+0000 7f1d07631640 1 --2- 172.21.15.38:0/2519190737 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d000b3dc0 0x7f1d00156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.315+0000 7f1d07631640 1 --2- 172.21.15.38:0/2519190737 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1ce406a430 0x7f1ce406c8f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.315+0000 7f1d07631640 1 --2- 172.21.15.38:0/2519190737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0006ca50 0x7f1d001f27e0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.315+0000 7f1d07631640 1 -- 172.21.15.38:0/2519190737 >> 172.21.15.38:0/2519190737 conn(0x7f1d000cfea0 msgr2=0x7f1d0015f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:01.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.315+0000 7f1d07631640 1 -- 172.21.15.38:0/2519190737 shutdown_connections 2023-12-22T08:51:01.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.315+0000 7f1d07631640 1 -- 172.21.15.38:0/2519190737 wait complete. 2023-12-22T08:51:01.336 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:51:01.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.573+0000 7fe858363640 1 Processor -- start 2023-12-22T08:51:01.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.573+0000 7fe858363640 1 -- start start 2023-12-22T08:51:01.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.574+0000 7fe858363640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe8500cea50 0x7fe8500ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:01.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.574+0000 7fe858363640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe850140f70 con 0x7fe85006d590 2023-12-22T08:51:01.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.574+0000 7fe858363640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85006c300 con 0x7fe850143600 2023-12-22T08:51:01.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.574+0000 7fe858363640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8500cf410 con 0x7fe8500cea50 2023-12-22T08:51:01.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.575+0000 7fe8558fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe8500cea50 0x7fe8500ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:01.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.575+0000 7fe856900640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe85006d590 0x7fe85006da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46494/0 (socket says 172.21.15.38:46494) 2023-12-22T08:51:01.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.575+0000 7fe856900640 1 -- 172.21.15.38:0/3619421799 learned_addr learned my addr 172.21.15.38:0/3619421799 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:01.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.575+0000 7fe8558fe640 1 -- 172.21.15.38:0/3619421799 >> v1:172.21.15.89:6789/0 conn(0x7fe850143600 legacy=0x7fe85015e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:01.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.575+0000 7fe8558fe640 1 -- 172.21.15.38:0/3619421799 >> v1:172.21.15.38:6789/0 conn(0x7fe85006d590 legacy=0x7fe85006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:01.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.575+0000 7fe8558fe640 1 -- 172.21.15.38:0/3619421799 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85006c5e0 con 0x7fe8500cea50 2023-12-22T08:51:01.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.575+0000 7fe8550fd640 1 -- 172.21.15.38:0/3619421799 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774339810 0 0) 0x7fe850140f70 con 0x7fe85006d590 2023-12-22T08:51:01.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.577+0000 7fe8558fe640 1 --2- 172.21.15.38:0/3619421799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8500cea50 0x7fe8500ceed0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fe8400097a0 tx=0x7fe84002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894f7fb55f57235b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:01.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.577+0000 7fe8550fd640 1 -- 172.21.15.38:0/3619421799 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe840030610 con 0x7fe8500cea50 2023-12-22T08:51:01.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.577+0000 7fe8550fd640 1 -- 172.21.15.38:0/3619421799 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe840030770 con 0x7fe8500cea50 2023-12-22T08:51:01.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.577+0000 7fe8550fd640 1 -- 172.21.15.38:0/3619421799 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe840030b00 con 0x7fe8500cea50 2023-12-22T08:51:01.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.578+0000 7fe858363640 1 -- 172.21.15.38:0/3619421799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8500cea50 msgr2=0x7fe8500ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:01.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.578+0000 7fe858363640 1 --2- 172.21.15.38:0/3619421799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8500cea50 0x7fe8500ceed0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fe8400097a0 tx=0x7fe84002b960 comp rx=0 tx=0).stop 2023-12-22T08:51:01.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.578+0000 7fe858363640 1 -- 172.21.15.38:0/3619421799 shutdown_connections 2023-12-22T08:51:01.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.578+0000 7fe858363640 1 --2- 172.21.15.38:0/3619421799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe8500cea50 0x7fe8500ceed0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.578+0000 7fe858363640 1 -- 172.21.15.38:0/3619421799 >> 172.21.15.38:0/3619421799 conn(0x7fe8500cfe70 msgr2=0x7fe8500d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:01.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.578+0000 7fe858363640 1 -- 172.21.15.38:0/3619421799 shutdown_connections 2023-12-22T08:51:01.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.578+0000 7fe858363640 1 -- 172.21.15.38:0/3619421799 wait complete. 2023-12-22T08:51:01.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.580+0000 7fe858363640 1 Processor -- start 2023-12-22T08:51:01.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.580+0000 7fe858363640 1 -- start start 2023-12-22T08:51:01.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.581+0000 7fe858363640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe85006d590 0x7fe85015f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:01.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.581+0000 7fe858363640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8500cea50 0x7fe85015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:01.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.581+0000 7fe858363640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe850143600 0x7fe8501f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:01.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.581+0000 7fe858363640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe850160420 con 0x7fe850143600 2023-12-22T08:51:01.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.581+0000 7fe858363640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe850160700 con 0x7fe8500cea50 2023-12-22T08:51:01.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.581+0000 7fe858363640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8501f3d70 con 0x7fe85006d590 2023-12-22T08:51:01.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.581+0000 7fe856900640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe850143600 0x7fe8501f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:01.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.581+0000 7fe856900640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe850143600 0x7fe8501f2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35352/0 (socket says 172.21.15.38:35352) 2023-12-22T08:51:01.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.581+0000 7fe856900640 1 -- 172.21.15.38:0/1191727272 learned_addr learned my addr 172.21.15.38:0/1191727272 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:01.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.582+0000 7fe8560ff640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe85006d590 0x7fe85015f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:01.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.582+0000 7fe8558fe640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8500cea50 0x7fe85015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:01.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.582+0000 7fe856900640 1 -- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe85006d590 msgr2=0x7fe85015f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:01.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.582+0000 7fe856900640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe85006d590 0x7fe85015f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.582+0000 7fe856900640 1 -- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8500cea50 msgr2=0x7fe85015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:01.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.582+0000 7fe856900640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8500cea50 0x7fe85015fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.582+0000 7fe856900640 1 -- 172.21.15.38:0/1191727272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe840009400 con 0x7fe850143600 2023-12-22T08:51:01.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.582+0000 7fe856900640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe850143600 0x7fe8501f2a30 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fe848001eb0 tx=0x7fe84800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:01.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.583+0000 7fe846ffd640 1 -- 172.21.15.38:0/1191727272 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8480074e0 con 0x7fe850143600 2023-12-22T08:51:01.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.583+0000 7fe846ffd640 1 -- 172.21.15.38:0/1191727272 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe848007640 con 0x7fe850143600 2023-12-22T08:51:01.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.583+0000 7fe846ffd640 1 -- 172.21.15.38:0/1191727272 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848004a00 con 0x7fe850143600 2023-12-22T08:51:01.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.583+0000 7fe858363640 1 -- 172.21.15.38:0/1191727272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8501f4050 con 0x7fe850143600 2023-12-22T08:51:01.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.583+0000 7fe858363640 1 -- 172.21.15.38:0/1191727272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8501601a0 con 0x7fe850143600 2023-12-22T08:51:01.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.584+0000 7fe858363640 1 -- 172.21.15.38:0/1191727272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8501f4290 con 0x7fe850143600 2023-12-22T08:51:01.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.585+0000 7fe846ffd640 1 -- 172.21.15.38:0/1191727272 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe848004b60 con 0x7fe850143600 2023-12-22T08:51:01.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.586+0000 7fe846ffd640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe83406a430 0x7fe83406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:01.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.586+0000 7fe846ffd640 1 -- 172.21.15.38:0/1191727272 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8480886d0 con 0x7fe850143600 2023-12-22T08:51:01.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.586+0000 7fe846ffd640 1 -- 172.21.15.38:0/1191727272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fe834071f60 con 0x7fe850143600 2023-12-22T08:51:01.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.587+0000 7fe8560ff640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe83406a430 0x7fe83406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:01.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.588+0000 7fe8560ff640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe83406a430 0x7fe83406c8f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe850153de0 tx=0x7fe84c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:01.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.591+0000 7fe846ffd640 1 -- 172.21.15.38:0/1191727272 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe8501f4290 con 0x7fe850143600 2023-12-22T08:51:01.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.784+0000 7fe858363640 1 -- 172.21.15.38:0/1191727272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8501f4290 con 0x7fe850143600 2023-12-22T08:51:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.786+0000 7fe846ffd640 1 -- 172.21.15.38:0/1191727272 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v160) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8501f4290 con 0x7fe850143600 2023-12-22T08:51:01.787 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:51:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.788+0000 7fe858363640 1 -- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe83406a430 msgr2=0x7fe83406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.788+0000 7fe858363640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe83406a430 0x7fe83406c8f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe850153de0 tx=0x7fe84c009040 comp rx=0 tx=0).stop 2023-12-22T08:51:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.788+0000 7fe858363640 1 -- 172.21.15.38:0/1191727272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe850143600 msgr2=0x7fe8501f2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.788+0000 7fe858363640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe850143600 0x7fe8501f2a30 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fe848001eb0 tx=0x7fe84800c870 comp rx=0 tx=0).stop 2023-12-22T08:51:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.789+0000 7fe858363640 1 -- 172.21.15.38:0/1191727272 shutdown_connections 2023-12-22T08:51:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.789+0000 7fe858363640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe83406a430 0x7fe83406c8f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.789+0000 7fe858363640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe850143600 0x7fe8501f2a30 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.789+0000 7fe858363640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8500cea50 0x7fe85015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.789+0000 7fe858363640 1 --2- 172.21.15.38:0/1191727272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe85006d590 0x7fe85015f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:01.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.789+0000 7fe858363640 1 -- 172.21.15.38:0/1191727272 >> 172.21.15.38:0/1191727272 conn(0x7fe8500cfe70 msgr2=0x7fe8500d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:01.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.789+0000 7fe858363640 1 -- 172.21.15.38:0/1191727272 shutdown_connections 2023-12-22T08:51:01.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:01.789+0000 7fe858363640 1 -- 172.21.15.38:0/1191727272 wait complete. 2023-12-22T08:51:01.808 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:51:02.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.028+0000 7f8943fff640 1 Processor -- start 2023-12-22T08:51:02.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.028+0000 7f8943fff640 1 -- start start 2023-12-22T08:51:02.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.030+0000 7f8943fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f894415ad90 0x7f89440caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:02.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.030+0000 7f8943fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8944161bb0 0x7f89440cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:02.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.030+0000 7f8943fff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894415e630 con 0x7f894415d940 2023-12-22T08:51:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.030+0000 7f8943fff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89440ce2c0 con 0x7f8944161bb0 2023-12-22T08:51:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.030+0000 7f8943fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894415e910 con 0x7f894415ad90 2023-12-22T08:51:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.030+0000 7f89427fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8944161bb0 0x7f89440cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.030+0000 7f89427fc640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8944161bb0 0x7f89440cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35368/0 (socket says 172.21.15.38:35368) 2023-12-22T08:51:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.030+0000 7f89427fc640 1 -- 172.21.15.38:0/3894726289 learned_addr learned my addr 172.21.15.38:0/3894726289 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.031+0000 7f8942ffd640 1 --2- 172.21.15.38:0/3894726289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f894415ad90 0x7f89440caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.031+0000 7f89427fc640 1 -- 172.21.15.38:0/3894726289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f894415ad90 msgr2=0x7f89440caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.031+0000 7f89427fc640 1 --2- 172.21.15.38:0/3894726289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f894415ad90 0x7f89440caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.031+0000 7f89427fc640 1 -- 172.21.15.38:0/3894726289 >> v1:172.21.15.89:6789/0 conn(0x7f894415d940 legacy=0x7f894415ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.031+0000 7f89427fc640 1 -- 172.21.15.38:0/3894726289 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89441610d0 con 0x7f8944161bb0 2023-12-22T08:51:02.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.032+0000 7f89427fc640 1 --2- 172.21.15.38:0/3894726289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8944161bb0 0x7f89440cb410 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f892c009870 tx=0x7f892c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e208c63253f89a71 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:02.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.032+0000 7f8941ffb640 1 -- 172.21.15.38:0/3894726289 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c031640 con 0x7f8944161bb0 2023-12-22T08:51:02.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.032+0000 7f8941ffb640 1 -- 172.21.15.38:0/3894726289 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c0317a0 con 0x7f8944161bb0 2023-12-22T08:51:02.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.032+0000 7f8941ffb640 1 -- 172.21.15.38:0/3894726289 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c031b30 con 0x7f8944161bb0 2023-12-22T08:51:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.033+0000 7f8943fff640 1 -- 172.21.15.38:0/3894726289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8944161bb0 msgr2=0x7f89440cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.033+0000 7f8943fff640 1 --2- 172.21.15.38:0/3894726289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8944161bb0 0x7f89440cb410 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f892c009870 tx=0x7f892c02b8f0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.033+0000 7f8943fff640 1 -- 172.21.15.38:0/3894726289 shutdown_connections 2023-12-22T08:51:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.033+0000 7f8943fff640 1 --2- 172.21.15.38:0/3894726289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8944161bb0 0x7f89440cb410 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.033+0000 7f8943fff640 1 --2- 172.21.15.38:0/3894726289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f894415ad90 0x7f89440caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.033+0000 7f8943fff640 1 -- 172.21.15.38:0/3894726289 >> 172.21.15.38:0/3894726289 conn(0x7f89440d31c0 msgr2=0x7f89440d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.033+0000 7f8943fff640 1 -- 172.21.15.38:0/3894726289 shutdown_connections 2023-12-22T08:51:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.033+0000 7f8943fff640 1 -- 172.21.15.38:0/3894726289 wait complete. 2023-12-22T08:51:02.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.035+0000 7f8943fff640 1 Processor -- start 2023-12-22T08:51:02.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.035+0000 7f8943fff640 1 -- start start 2023-12-22T08:51:02.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8943fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f894415ad90 0x7f89441f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:02.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8943fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f894415d940 0x7f89440c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:02.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8943fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8944161bb0 0x7f89440ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:02.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8943fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440c8c80 con 0x7f894415ad90 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8943fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440aa0d0 con 0x7f8944161bb0 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8943fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894414e0e0 con 0x7f894415d940 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8942ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f894415ad90 0x7f89441f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8942ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f894415ad90 0x7f89441f26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35382/0 (socket says 172.21.15.38:35382) 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8942ffd640 1 -- 172.21.15.38:0/2993693641 learned_addr learned my addr 172.21.15.38:0/2993693641 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f89427fc640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f894415d940 0x7f89440c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f89437fe640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8944161bb0 0x7f89440ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8942ffd640 1 -- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f894415d940 msgr2=0x7f89440c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8942ffd640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f894415d940 0x7f89440c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8942ffd640 1 -- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8944161bb0 msgr2=0x7f89440ac400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8942ffd640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8944161bb0 0x7f89440ac400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f8942ffd640 1 -- 172.21.15.38:0/2993693641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c0094d0 con 0x7f894415ad90 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.037+0000 7f89437fe640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8944161bb0 0x7f89440ac400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.038+0000 7f8942ffd640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f894415ad90 0x7f89441f26c0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f8934007f50 tx=0x7f893400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.038+0000 7f893b7fe640 1 -- 172.21.15.38:0/2993693641 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934014620 con 0x7f894415ad90 2023-12-22T08:51:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.038+0000 7f893b7fe640 1 -- 172.21.15.38:0/2993693641 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8934014780 con 0x7f894415ad90 2023-12-22T08:51:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.038+0000 7f893b7fe640 1 -- 172.21.15.38:0/2993693641 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934014b30 con 0x7f894415ad90 2023-12-22T08:51:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.038+0000 7f8943fff640 1 -- 172.21.15.38:0/2993693641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89440c86c0 con 0x7f894415ad90 2023-12-22T08:51:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.038+0000 7f8943fff640 1 -- 172.21.15.38:0/2993693641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89440a9d60 con 0x7f894415ad90 2023-12-22T08:51:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.039+0000 7f8943fff640 1 -- 172.21.15.38:0/2993693641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89440a9bc0 con 0x7f894415ad90 2023-12-22T08:51:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.040+0000 7f893b7fe640 1 -- 172.21.15.38:0/2993693641 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8934014c90 con 0x7f894415ad90 2023-12-22T08:51:02.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.041+0000 7f893b7fe640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f892406a430 0x7f892406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:02.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.042+0000 7f893b7fe640 1 -- 172.21.15.38:0/2993693641 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8934089380 con 0x7f894415ad90 2023-12-22T08:51:02.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.042+0000 7f893b7fe640 1 -- 172.21.15.38:0/2993693641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f8924071f60 con 0x7f894415ad90 2023-12-22T08:51:02.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.042+0000 7f89427fc640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f892406a430 0x7f892406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:02.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.043+0000 7f89427fc640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f892406a430 0x7f892406c8f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f892c036000 tx=0x7f892c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:02.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.046+0000 7f893b7fe640 1 -- 172.21.15.38:0/2993693641 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f89440a9bc0 con 0x7f894415ad90 2023-12-22T08:51:02.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.253+0000 7f8943fff640 1 -- 172.21.15.38:0/2993693641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f89440a9bc0 con 0x7f894415ad90 2023-12-22T08:51:02.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.254+0000 7f893b7fe640 1 -- 172.21.15.38:0/2993693641 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v160) v1 ==== 80+0+0 (secure 0 0 0) 0x7f89440a9bc0 con 0x7f894415ad90 2023-12-22T08:51:02.255 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:51:02.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.256+0000 7f8943fff640 1 -- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f892406a430 msgr2=0x7f892406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:02.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.256+0000 7f8943fff640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f892406a430 0x7f892406c8f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f892c036000 tx=0x7f892c03c040 comp rx=0 tx=0).stop 2023-12-22T08:51:02.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.256+0000 7f8943fff640 1 -- 172.21.15.38:0/2993693641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f894415ad90 msgr2=0x7f89441f26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:02.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.256+0000 7f8943fff640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f894415ad90 0x7f89441f26c0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f8934007f50 tx=0x7f893400e570 comp rx=0 tx=0).stop 2023-12-22T08:51:02.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.256+0000 7f8943fff640 1 -- 172.21.15.38:0/2993693641 shutdown_connections 2023-12-22T08:51:02.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.256+0000 7f8943fff640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8944161bb0 0x7f89440ac400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.256+0000 7f8943fff640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f894415d940 0x7f89440c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.256+0000 7f8943fff640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f892406a430 0x7f892406c8f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.256+0000 7f8943fff640 1 --2- 172.21.15.38:0/2993693641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f894415ad90 0x7f89441f26c0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.256+0000 7f8943fff640 1 -- 172.21.15.38:0/2993693641 >> 172.21.15.38:0/2993693641 conn(0x7f89440d31c0 msgr2=0x7f894415a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:02.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.256+0000 7f8943fff640 1 -- 172.21.15.38:0/2993693641 shutdown_connections 2023-12-22T08:51:02.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.257+0000 7f8943fff640 1 -- 172.21.15.38:0/2993693641 wait complete. 2023-12-22T08:51:02.276 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T08:51:02.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:02.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-22T08:51:02.404 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:51:02.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:02.404 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T08:51:02.459 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:51:02.460 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:51:02.521 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:51:02.521 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:51:02.575 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:51:02.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.803+0000 7fda3659e640 1 Processor -- start 2023-12-22T08:51:02.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.804+0000 7fda3659e640 1 -- start start 2023-12-22T08:51:02.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.805+0000 7fda3659e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fda3015b420 0x7fda3006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:02.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.805+0000 7fda3659e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fda300a44a0 0x7fda300708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:02.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.805+0000 7fda3659e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda300cdae0 con 0x7fda30070e30 2023-12-22T08:51:02.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.805+0000 7fda3659e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3006dec0 con 0x7fda300a44a0 2023-12-22T08:51:02.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.805+0000 7fda3659e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda30071250 con 0x7fda3015b420 2023-12-22T08:51:02.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.805+0000 7fda34d9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fda300a44a0 0x7fda300708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:02.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.805+0000 7fda34d9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fda300a44a0 0x7fda300708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35386/0 (socket says 172.21.15.38:35386) 2023-12-22T08:51:02.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.805+0000 7fda34d9b640 1 -- 172.21.15.38:0/2645003521 learned_addr learned my addr 172.21.15.38:0/2645003521 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:02.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.805+0000 7fda3559c640 1 --2- 172.21.15.38:0/2645003521 >> v2:172.21.15.89:3300/0 conn(0x7fda3015b420 0x7fda3006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:02.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.806+0000 7fda34d9b640 1 -- 172.21.15.38:0/2645003521 >> v2:172.21.15.89:3300/0 conn(0x7fda3015b420 msgr2=0x7fda3006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:02.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.806+0000 7fda34d9b640 1 --2- 172.21.15.38:0/2645003521 >> v2:172.21.15.89:3300/0 conn(0x7fda3015b420 0x7fda3006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.806+0000 7fda34d9b640 1 -- 172.21.15.38:0/2645003521 >> v1:172.21.15.89:6789/0 conn(0x7fda30070e30 legacy=0x7fda3006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:02.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.806+0000 7fda34d9b640 1 -- 172.21.15.38:0/2645003521 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3015b800 con 0x7fda300a44a0 2023-12-22T08:51:02.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.806+0000 7fda3559c640 1 --2- 172.21.15.38:0/2645003521 >> v2:172.21.15.89:3300/0 conn(0x7fda3015b420 0x7fda3006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:02.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.807+0000 7fda34d9b640 1 --2- 172.21.15.38:0/2645003521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda300a44a0 0x7fda300708f0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fda300613e0 tx=0x7fda2002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c378f70b676b8ac server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:02.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.807+0000 7fda27fff640 1 -- 172.21.15.38:0/2645003521 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20031870 con 0x7fda300a44a0 2023-12-22T08:51:02.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.807+0000 7fda27fff640 1 -- 172.21.15.38:0/2645003521 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda200319d0 con 0x7fda300a44a0 2023-12-22T08:51:02.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.807+0000 7fda27fff640 1 -- 172.21.15.38:0/2645003521 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20031d60 con 0x7fda300a44a0 2023-12-22T08:51:02.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.808+0000 7fda3659e640 1 -- 172.21.15.38:0/2645003521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda300a44a0 msgr2=0x7fda300708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:02.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.808+0000 7fda3659e640 1 --2- 172.21.15.38:0/2645003521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda300a44a0 0x7fda300708f0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fda300613e0 tx=0x7fda2002b910 comp rx=0 tx=0).stop 2023-12-22T08:51:02.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.808+0000 7fda3659e640 1 -- 172.21.15.38:0/2645003521 shutdown_connections 2023-12-22T08:51:02.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.808+0000 7fda3659e640 1 --2- 172.21.15.38:0/2645003521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda300a44a0 0x7fda300708f0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.808+0000 7fda3659e640 1 --2- 172.21.15.38:0/2645003521 >> v2:172.21.15.89:3300/0 conn(0x7fda3015b420 0x7fda3006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.808+0000 7fda3659e640 1 -- 172.21.15.38:0/2645003521 >> 172.21.15.38:0/2645003521 conn(0x7fda300b1f70 msgr2=0x7fda300b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:02.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.808+0000 7fda3659e640 1 -- 172.21.15.38:0/2645003521 shutdown_connections 2023-12-22T08:51:02.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.808+0000 7fda3659e640 1 -- 172.21.15.38:0/2645003521 wait complete. 2023-12-22T08:51:02.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.810+0000 7fda3659e640 1 Processor -- start 2023-12-22T08:51:02.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.810+0000 7fda3659e640 1 -- start start 2023-12-22T08:51:02.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.811+0000 7fda3659e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda30070e30 0x7fda3014b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:02.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.811+0000 7fda3659e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda300a44a0 0x7fda301f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:02.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.811+0000 7fda3659e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3015b420 0x7fda3014c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:02.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.811+0000 7fda3659e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda30149be0 con 0x7fda3015b420 2023-12-22T08:51:02.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.811+0000 7fda3659e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda300c23a0 con 0x7fda300a44a0 2023-12-22T08:51:02.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.811+0000 7fda3659e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda30148fd0 con 0x7fda30070e30 2023-12-22T08:51:02.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.811+0000 7fda35d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3015b420 0x7fda3014c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:02.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.811+0000 7fda35d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3015b420 0x7fda3014c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35400/0 (socket says 172.21.15.38:35400) 2023-12-22T08:51:02.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.811+0000 7fda35d9d640 1 -- 172.21.15.38:0/2941814646 learned_addr learned my addr 172.21.15.38:0/2941814646 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:02.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.811+0000 7fda3559c640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda30070e30 0x7fda3014b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:02.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.811+0000 7fda34d9b640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda300a44a0 0x7fda301f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:02.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.812+0000 7fda35d9d640 1 -- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda30070e30 msgr2=0x7fda3014b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:02.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.812+0000 7fda35d9d640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda30070e30 0x7fda3014b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.812+0000 7fda35d9d640 1 -- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda300a44a0 msgr2=0x7fda301f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:02.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.812+0000 7fda35d9d640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda300a44a0 0x7fda301f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:02.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.812+0000 7fda35d9d640 1 -- 172.21.15.38:0/2941814646 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda200094d0 con 0x7fda3015b420 2023-12-22T08:51:02.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.812+0000 7fda35d9d640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3015b420 0x7fda3014c000 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fda2800b990 tx=0x7fda2800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:02.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.812+0000 7fda25ffb640 1 -- 172.21.15.38:0/2941814646 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2800cba0 con 0x7fda3015b420 2023-12-22T08:51:02.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.812+0000 7fda25ffb640 1 -- 172.21.15.38:0/2941814646 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2800cd00 con 0x7fda3015b420 2023-12-22T08:51:02.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.812+0000 7fda25ffb640 1 -- 172.21.15.38:0/2941814646 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28014680 con 0x7fda3015b420 2023-12-22T08:51:02.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.812+0000 7fda3659e640 1 -- 172.21.15.38:0/2941814646 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda301492b0 con 0x7fda3015b420 2023-12-22T08:51:02.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.812+0000 7fda3659e640 1 -- 172.21.15.38:0/2941814646 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda30149870 con 0x7fda3015b420 2023-12-22T08:51:02.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.813+0000 7fda3659e640 1 -- 172.21.15.38:0/2941814646 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda300ce2d0 con 0x7fda3015b420 2023-12-22T08:51:02.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.815+0000 7fda25ffb640 1 -- 172.21.15.38:0/2941814646 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fda2801d3b0 con 0x7fda3015b420 2023-12-22T08:51:02.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.816+0000 7fda25ffb640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1406a460 0x7fda1406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:02.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.816+0000 7fda25ffb640 1 -- 172.21.15.38:0/2941814646 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda28088870 con 0x7fda3015b420 2023-12-22T08:51:02.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.817+0000 7fda25ffb640 1 -- 172.21.15.38:0/2941814646 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fda14071f90 con 0x7fda3015b420 2023-12-22T08:51:02.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.817+0000 7fda3559c640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1406a460 0x7fda1406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:02.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.818+0000 7fda3559c640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1406a460 0x7fda1406c920 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00a990 tx=0x7fda2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:02.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:02.821+0000 7fda25ffb640 1 -- 172.21.15.38:0/2941814646 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fda28019020 con 0x7fda3015b420 2023-12-22T08:51:03.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.013+0000 7fda3659e640 1 -- 172.21.15.38:0/2941814646 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda30061910 con 0x7fda3015b420 2023-12-22T08:51:03.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.015+0000 7fda25ffb640 1 -- 172.21.15.38:0/2941814646 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fda300ce2d0 con 0x7fda3015b420 2023-12-22T08:51:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:03.016 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":160,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:50:21.331381+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:48:42.499151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-22T08:48:43.921718+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:51:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.017+0000 7fda3659e640 1 -- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1406a460 msgr2=0x7fda1406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.017+0000 7fda3659e640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1406a460 0x7fda1406c920 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00a990 tx=0x7fda2c008040 comp rx=0 tx=0).stop 2023-12-22T08:51:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.017+0000 7fda3659e640 1 -- 172.21.15.38:0/2941814646 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3015b420 msgr2=0x7fda3014c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.017+0000 7fda3659e640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3015b420 0x7fda3014c000 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fda2800b990 tx=0x7fda2800be50 comp rx=0 tx=0).stop 2023-12-22T08:51:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.018+0000 7fda3659e640 1 -- 172.21.15.38:0/2941814646 shutdown_connections 2023-12-22T08:51:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.018+0000 7fda3659e640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1406a460 0x7fda1406c920 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.018+0000 7fda3659e640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3015b420 0x7fda3014c000 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.018+0000 7fda3659e640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda300a44a0 0x7fda301f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.018+0000 7fda3659e640 1 --2- 172.21.15.38:0/2941814646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda30070e30 0x7fda3014b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.018+0000 7fda3659e640 1 -- 172.21.15.38:0/2941814646 >> 172.21.15.38:0/2941814646 conn(0x7fda300b1f70 msgr2=0x7fda3006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.018+0000 7fda3659e640 1 -- 172.21.15.38:0/2941814646 shutdown_connections 2023-12-22T08:51:03.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.018+0000 7fda3659e640 1 -- 172.21.15.38:0/2941814646 wait complete. 2023-12-22T08:51:03.039 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:48:42.499151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:48:43.921718+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:51:03.040 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:51:03.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.274+0000 7fb3e759e640 1 Processor -- start 2023-12-22T08:51:03.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.274+0000 7fb3e759e640 1 -- start start 2023-12-22T08:51:03.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.276+0000 7fb3e759e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb3e8070b70 0x7fb3e806bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:03.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.276+0000 7fb3e759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3e806c4d0 0x7fb3e8070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:03.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.276+0000 7fb3e759e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e806d5f0 con 0x7fb3e8071490 2023-12-22T08:51:03.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.276+0000 7fb3e759e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e8144fa0 con 0x7fb3e8070b70 2023-12-22T08:51:03.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.276+0000 7fb3e759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e806da80 con 0x7fb3e806c4d0 2023-12-22T08:51:03.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.276+0000 7fb3e659c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb3e8070b70 0x7fb3e806bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:03.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.276+0000 7fb3e659c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb3e8070b70 0x7fb3e806bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35402/0 (socket says 172.21.15.38:35402) 2023-12-22T08:51:03.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.276+0000 7fb3e659c640 1 -- 172.21.15.38:0/4094309318 learned_addr learned my addr 172.21.15.38:0/4094309318 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:03.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.277+0000 7fb3e5d9b640 1 --2- 172.21.15.38:0/4094309318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3e806c4d0 0x7fb3e8070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:03.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.277+0000 7fb3e659c640 1 -- 172.21.15.38:0/4094309318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3e806c4d0 msgr2=0x7fb3e8070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:03.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.277+0000 7fb3e659c640 1 --2- 172.21.15.38:0/4094309318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3e806c4d0 0x7fb3e8070f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.277+0000 7fb3e659c640 1 -- 172.21.15.38:0/4094309318 >> v1:172.21.15.89:6789/0 conn(0x7fb3e8071490 legacy=0x7fb3e80cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:03.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.277+0000 7fb3e659c640 1 -- 172.21.15.38:0/4094309318 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e806c9e0 con 0x7fb3e8070b70 2023-12-22T08:51:03.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.279+0000 7fb3e659c640 1 --2- 172.21.15.38:0/4094309318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3e8070b70 0x7fb3e806bf90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009870 tx=0x7fb3d802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd3a32aebae98dd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:03.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.279+0000 7fb3e559a640 1 -- 172.21.15.38:0/4094309318 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8030840 con 0x7fb3e8070b70 2023-12-22T08:51:03.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.279+0000 7fb3e559a640 1 -- 172.21.15.38:0/4094309318 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d80309a0 con 0x7fb3e8070b70 2023-12-22T08:51:03.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.279+0000 7fb3e559a640 1 -- 172.21.15.38:0/4094309318 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8030d30 con 0x7fb3e8070b70 2023-12-22T08:51:03.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.280+0000 7fb3e759e640 1 -- 172.21.15.38:0/4094309318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3e8070b70 msgr2=0x7fb3e806bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:03.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.280+0000 7fb3e759e640 1 --2- 172.21.15.38:0/4094309318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3e8070b70 0x7fb3e806bf90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009870 tx=0x7fb3d802b980 comp rx=0 tx=0).stop 2023-12-22T08:51:03.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.280+0000 7fb3e759e640 1 -- 172.21.15.38:0/4094309318 shutdown_connections 2023-12-22T08:51:03.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.280+0000 7fb3e759e640 1 --2- 172.21.15.38:0/4094309318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3e806c4d0 0x7fb3e8070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.280+0000 7fb3e759e640 1 --2- 172.21.15.38:0/4094309318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3e8070b70 0x7fb3e806bf90 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.280+0000 7fb3e759e640 1 -- 172.21.15.38:0/4094309318 >> 172.21.15.38:0/4094309318 conn(0x7fb3e80b0b60 msgr2=0x7fb3e80b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:03.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.280+0000 7fb3e759e640 1 -- 172.21.15.38:0/4094309318 shutdown_connections 2023-12-22T08:51:03.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.280+0000 7fb3e759e640 1 -- 172.21.15.38:0/4094309318 wait complete. 2023-12-22T08:51:03.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.282+0000 7fb3e759e640 1 Processor -- start 2023-12-22T08:51:03.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.282+0000 7fb3e759e640 1 -- start start 2023-12-22T08:51:03.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.283+0000 7fb3e759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e806c4d0 0x7fb3e80cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:03.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.283+0000 7fb3e759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3e8070b70 0x7fb3e80af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:03.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.283+0000 7fb3e759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3e8071490 0x7fb3e80afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:03.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.283+0000 7fb3e759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8134780 con 0x7fb3e8071490 2023-12-22T08:51:03.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.283+0000 7fb3e759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8134a50 con 0x7fb3e806c4d0 2023-12-22T08:51:03.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.283+0000 7fb3e759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8134d30 con 0x7fb3e8070b70 2023-12-22T08:51:03.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.284+0000 7fb3e6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3e8071490 0x7fb3e80afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:03.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.284+0000 7fb3e6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3e8071490 0x7fb3e80afeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35404/0 (socket says 172.21.15.38:35404) 2023-12-22T08:51:03.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.284+0000 7fb3e6d9d640 1 -- 172.21.15.38:0/2323272824 learned_addr learned my addr 172.21.15.38:0/2323272824 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:03.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.284+0000 7fb3e659c640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e806c4d0 0x7fb3e80cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:03.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.284+0000 7fb3e5d9b640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3e8070b70 0x7fb3e80af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:03.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.284+0000 7fb3e6d9d640 1 -- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3e8070b70 msgr2=0x7fb3e80af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:03.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.284+0000 7fb3e6d9d640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3e8070b70 0x7fb3e80af970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.284+0000 7fb3e6d9d640 1 -- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e806c4d0 msgr2=0x7fb3e80cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:03.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.284+0000 7fb3e6d9d640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e806c4d0 0x7fb3e80cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.284+0000 7fb3e6d9d640 1 -- 172.21.15.38:0/2323272824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d80094d0 con 0x7fb3e8071490 2023-12-22T08:51:03.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.284+0000 7fb3e659c640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e806c4d0 0x7fb3e80cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:03.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.284+0000 7fb3e6d9d640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3e8071490 0x7fb3e80afeb0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000c730 tx=0x7fb3e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:03.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.285+0000 7fb3d6ffd640 1 -- 172.21.15.38:0/2323272824 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0003b70 con 0x7fb3e8071490 2023-12-22T08:51:03.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.285+0000 7fb3d6ffd640 1 -- 172.21.15.38:0/2323272824 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e0003cf0 con 0x7fb3e8071490 2023-12-22T08:51:03.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.285+0000 7fb3d6ffd640 1 -- 172.21.15.38:0/2323272824 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0003ea0 con 0x7fb3e8071490 2023-12-22T08:51:03.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.285+0000 7fb3e759e640 1 -- 172.21.15.38:0/2323272824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e8135010 con 0x7fb3e8071490 2023-12-22T08:51:03.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.285+0000 7fb3e759e640 1 -- 172.21.15.38:0/2323272824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e815c820 con 0x7fb3e8071490 2023-12-22T08:51:03.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.286+0000 7fb3e759e640 1 -- 172.21.15.38:0/2323272824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e8135530 con 0x7fb3e8071490 2023-12-22T08:51:03.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.287+0000 7fb3d6ffd640 1 -- 172.21.15.38:0/2323272824 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb3e0005310 con 0x7fb3e8071490 2023-12-22T08:51:03.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.288+0000 7fb3d6ffd640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb3c806a430 0x7fb3c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:03.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.288+0000 7fb3d6ffd640 1 -- 172.21.15.38:0/2323272824 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3e0088700 con 0x7fb3e8071490 2023-12-22T08:51:03.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.289+0000 7fb3d6ffd640 1 -- 172.21.15.38:0/2323272824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fb3c8071f60 con 0x7fb3e8071490 2023-12-22T08:51:03.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.289+0000 7fb3e659c640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb3c806a430 0x7fb3c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:03.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.290+0000 7fb3e659c640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb3c806a430 0x7fb3c806c8f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8036000 tx=0x7fb3d803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:03.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.293+0000 7fb3d6ffd640 1 -- 172.21.15.38:0/2323272824 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb3e8135530 con 0x7fb3e8071490 2023-12-22T08:51:03.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.486+0000 7fb3e759e640 1 -- 172.21.15.38:0/2323272824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3e8135530 con 0x7fb3e8071490 2023-12-22T08:51:03.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.487+0000 7fb3d6ffd640 1 -- 172.21.15.38:0/2323272824 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v160) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3e8135530 con 0x7fb3e8071490 2023-12-22T08:51:03.488 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:51:03.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.490+0000 7fb3e759e640 1 -- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb3c806a430 msgr2=0x7fb3c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:03.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.490+0000 7fb3e759e640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb3c806a430 0x7fb3c806c8f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8036000 tx=0x7fb3d803b040 comp rx=0 tx=0).stop 2023-12-22T08:51:03.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.490+0000 7fb3e759e640 1 -- 172.21.15.38:0/2323272824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3e8071490 msgr2=0x7fb3e80afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:03.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.490+0000 7fb3e759e640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3e8071490 0x7fb3e80afeb0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000c730 tx=0x7fb3e000cbf0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.490+0000 7fb3e759e640 1 -- 172.21.15.38:0/2323272824 shutdown_connections 2023-12-22T08:51:03.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.490+0000 7fb3e759e640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb3c806a430 0x7fb3c806c8f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.490+0000 7fb3e759e640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3e8071490 0x7fb3e80afeb0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.490+0000 7fb3e759e640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3e8070b70 0x7fb3e80af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.490+0000 7fb3e759e640 1 --2- 172.21.15.38:0/2323272824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e806c4d0 0x7fb3e80cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.490+0000 7fb3e759e640 1 -- 172.21.15.38:0/2323272824 >> 172.21.15.38:0/2323272824 conn(0x7fb3e80b0b60 msgr2=0x7fb3e80b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:03.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.490+0000 7fb3e759e640 1 -- 172.21.15.38:0/2323272824 shutdown_connections 2023-12-22T08:51:03.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.491+0000 7fb3e759e640 1 -- 172.21.15.38:0/2323272824 wait complete. 2023-12-22T08:51:03.509 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:51:03.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.738+0000 7f1737fff640 1 Processor -- start 2023-12-22T08:51:03.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.739+0000 7f1737fff640 1 -- start start 2023-12-22T08:51:03.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.740+0000 7f1737fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f173815ad90 0x7f17380caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:03.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.740+0000 7f1737fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1738161bb0 0x7f17380cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:03.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.740+0000 7f1737fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f173815d940 0x7f173815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:03.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.740+0000 7f1737fff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17380ce2c0 con 0x7f173815ad90 2023-12-22T08:51:03.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.740+0000 7f1737fff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173815e910 con 0x7f1738161bb0 2023-12-22T08:51:03.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.740+0000 7f1737fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173815e630 con 0x7f173815d940 2023-12-22T08:51:03.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.741+0000 7f1736ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f173815ad90 0x7f17380caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:03.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.741+0000 7f1736ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f173815ad90 0x7f17380caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35408/0 (socket says 172.21.15.38:35408) 2023-12-22T08:51:03.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.741+0000 7f1736ffd640 1 -- 172.21.15.38:0/3336963048 learned_addr learned my addr 172.21.15.38:0/3336963048 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:03.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.741+0000 7f17367fc640 1 --2- 172.21.15.38:0/3336963048 >> v2:172.21.15.89:3300/0 conn(0x7f1738161bb0 0x7f17380cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:03.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.741+0000 7f17377fe640 1 --2- 172.21.15.38:0/3336963048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f173815d940 0x7f173815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:03.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.741+0000 7f1736ffd640 1 -- 172.21.15.38:0/3336963048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f173815d940 msgr2=0x7f173815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:03.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.741+0000 7f1736ffd640 1 --2- 172.21.15.38:0/3336963048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f173815d940 0x7f173815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.741+0000 7f1736ffd640 1 -- 172.21.15.38:0/3336963048 >> v2:172.21.15.89:3300/0 conn(0x7f1738161bb0 msgr2=0x7f17380cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:03.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.741+0000 7f1736ffd640 1 --2- 172.21.15.38:0/3336963048 >> v2:172.21.15.89:3300/0 conn(0x7f1738161bb0 0x7f17380cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.741+0000 7f1736ffd640 1 -- 172.21.15.38:0/3336963048 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17381610d0 con 0x7f173815ad90 2023-12-22T08:51:03.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.743+0000 7f1736ffd640 1 --2- 172.21.15.38:0/3336963048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f173815ad90 0x7f17380caed0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f17380d0d40 tx=0x7f172802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5583aff31f586 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:03.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.743+0000 7f1735ffb640 1 -- 172.21.15.38:0/3336963048 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172802ca70 con 0x7f173815ad90 2023-12-22T08:51:03.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.743+0000 7f1735ffb640 1 -- 172.21.15.38:0/3336963048 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172802cbd0 con 0x7f173815ad90 2023-12-22T08:51:03.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.743+0000 7f1735ffb640 1 -- 172.21.15.38:0/3336963048 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17280343f0 con 0x7f173815ad90 2023-12-22T08:51:03.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.744+0000 7f1737fff640 1 -- 172.21.15.38:0/3336963048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f173815ad90 msgr2=0x7f17380caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:03.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.744+0000 7f1737fff640 1 --2- 172.21.15.38:0/3336963048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f173815ad90 0x7f17380caed0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f17380d0d40 tx=0x7f172802bed0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.744+0000 7f1737fff640 1 -- 172.21.15.38:0/3336963048 shutdown_connections 2023-12-22T08:51:03.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.744+0000 7f1737fff640 1 --2- 172.21.15.38:0/3336963048 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f173815d940 0x7f173815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.744+0000 7f1737fff640 1 --2- 172.21.15.38:0/3336963048 >> v2:172.21.15.89:3300/0 conn(0x7f1738161bb0 0x7f17380cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.744+0000 7f1737fff640 1 --2- 172.21.15.38:0/3336963048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f173815ad90 0x7f17380caed0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.744+0000 7f1737fff640 1 -- 172.21.15.38:0/3336963048 >> 172.21.15.38:0/3336963048 conn(0x7f17380d31c0 msgr2=0x7f17380d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:03.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.745+0000 7f1737fff640 1 -- 172.21.15.38:0/3336963048 shutdown_connections 2023-12-22T08:51:03.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.745+0000 7f1737fff640 1 -- 172.21.15.38:0/3336963048 wait complete. 2023-12-22T08:51:03.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.747+0000 7f1737fff640 1 Processor -- start 2023-12-22T08:51:03.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.747+0000 7f1737fff640 1 -- start start 2023-12-22T08:51:03.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.748+0000 7f1737fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f173815ad90 0x7f1738156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:03.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.748+0000 7f1737fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f173815d940 0x7f173815c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:03.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.748+0000 7f1737fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1738161bb0 0x7f173815c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:03.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.748+0000 7f1737fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1738157820 con 0x7f173815d940 2023-12-22T08:51:03.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.748+0000 7f1737fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1738157b00 con 0x7f173815ad90 2023-12-22T08:51:03.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.748+0000 7f1737fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1738157de0 con 0x7f1738161bb0 2023-12-22T08:51:03.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.749+0000 7f17367fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f173815d940 0x7f173815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:03.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.749+0000 7f17367fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f173815d940 0x7f173815c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35422/0 (socket says 172.21.15.38:35422) 2023-12-22T08:51:03.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.749+0000 7f17367fc640 1 -- 172.21.15.38:0/3932364946 learned_addr learned my addr 172.21.15.38:0/3932364946 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:03.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.749+0000 7f1736ffd640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f173815ad90 0x7f1738156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:03.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.749+0000 7f17377fe640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1738161bb0 0x7f173815c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:03.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.749+0000 7f17367fc640 1 -- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1738161bb0 msgr2=0x7f173815c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:03.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.749+0000 7f17367fc640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1738161bb0 0x7f173815c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.749+0000 7f17367fc640 1 -- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f173815ad90 msgr2=0x7f1738156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:03.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.749+0000 7f17367fc640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f173815ad90 0x7f1738156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.749+0000 7f17367fc640 1 -- 172.21.15.38:0/3932364946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1728009b30 con 0x7f173815d940 2023-12-22T08:51:03.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.749+0000 7f17367fc640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f173815d940 0x7f173815c080 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f172000e870 tx=0x7f172000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:03.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.750+0000 7f172f7fe640 1 -- 172.21.15.38:0/3932364946 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200094f0 con 0x7f173815d940 2023-12-22T08:51:03.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.750+0000 7f172f7fe640 1 -- 172.21.15.38:0/3932364946 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172000c940 con 0x7f173815d940 2023-12-22T08:51:03.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.750+0000 7f172f7fe640 1 -- 172.21.15.38:0/3932364946 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172000ccf0 con 0x7f173815d940 2023-12-22T08:51:03.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.750+0000 7f1737fff640 1 -- 172.21.15.38:0/3932364946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17381580c0 con 0x7f173815d940 2023-12-22T08:51:03.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.750+0000 7f1737fff640 1 -- 172.21.15.38:0/3932364946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1738140170 con 0x7f173815d940 2023-12-22T08:51:03.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.751+0000 7f1737fff640 1 -- 172.21.15.38:0/3932364946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1738158250 con 0x7f173815d940 2023-12-22T08:51:03.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.753+0000 7f172f7fe640 1 -- 172.21.15.38:0/3932364946 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1720013470 con 0x7f173815d940 2023-12-22T08:51:03.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.753+0000 7f172f7fe640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f171806a430 0x7f171806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:03.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.754+0000 7f172f7fe640 1 -- 172.21.15.38:0/3932364946 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1720088a90 con 0x7f173815d940 2023-12-22T08:51:03.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.754+0000 7f172f7fe640 1 -- 172.21.15.38:0/3932364946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f1718071f60 con 0x7f173815d940 2023-12-22T08:51:03.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.754+0000 7f1736ffd640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f171806a430 0x7f171806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:03.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.755+0000 7f1736ffd640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f171806a430 0x7f171806c8f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1728035000 tx=0x7f1728030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:03.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.758+0000 7f172f7fe640 1 -- 172.21.15.38:0/3932364946 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1720021060 con 0x7f173815d940 2023-12-22T08:51:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.956+0000 7f1737fff640 1 -- 172.21.15.38:0/3932364946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1738061910 con 0x7f173815d940 2023-12-22T08:51:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.956+0000 7f172f7fe640 1 -- 172.21.15.38:0/3932364946 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v160) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1720053fe0 con 0x7f173815d940 2023-12-22T08:51:03.957 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:51:03.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.959+0000 7f1737fff640 1 -- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f171806a430 msgr2=0x7f171806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:03.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.959+0000 7f1737fff640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f171806a430 0x7f171806c8f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1728035000 tx=0x7f1728030000 comp rx=0 tx=0).stop 2023-12-22T08:51:03.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.959+0000 7f1737fff640 1 -- 172.21.15.38:0/3932364946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f173815d940 msgr2=0x7f173815c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:03.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.959+0000 7f1737fff640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f173815d940 0x7f173815c080 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f172000e870 tx=0x7f172000ed30 comp rx=0 tx=0).stop 2023-12-22T08:51:03.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.959+0000 7f1737fff640 1 -- 172.21.15.38:0/3932364946 shutdown_connections 2023-12-22T08:51:03.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.959+0000 7f1737fff640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1738161bb0 0x7f173815c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.959+0000 7f1737fff640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f171806a430 0x7f171806c8f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.959+0000 7f1737fff640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f173815d940 0x7f173815c080 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.959+0000 7f1737fff640 1 --2- 172.21.15.38:0/3932364946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f173815ad90 0x7f1738156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:03.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.959+0000 7f1737fff640 1 -- 172.21.15.38:0/3932364946 >> 172.21.15.38:0/3932364946 conn(0x7f17380d31c0 msgr2=0x7f17380d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:03.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.960+0000 7f1737fff640 1 -- 172.21.15.38:0/3932364946 shutdown_connections 2023-12-22T08:51:03.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:03.960+0000 7f1737fff640 1 -- 172.21.15.38:0/3932364946 wait complete. 2023-12-22T08:51:03.979 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:51:04.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.211+0000 7ff3d2087640 1 Processor -- start 2023-12-22T08:51:04.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.211+0000 7ff3d2087640 1 -- start start 2023-12-22T08:51:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.213+0000 7ff3d2087640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff3cc15e870 0x7ff3cc0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.213+0000 7ff3d2087640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff3cc15ec50 0x7ff3cc070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.213+0000 7ff3d2087640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc071310 0x7ff3cc070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.213+0000 7ff3d2087640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc0ce4b0 con 0x7ff3cc15e870 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.213+0000 7ff3d2087640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc15fea0 con 0x7ff3cc15ec50 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.213+0000 7ff3d2087640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0cdb80 con 0x7ff3cc071310 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.213+0000 7ff3cb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff3cc15e870 0x7ff3cc0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.213+0000 7ff3cb7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff3cc15e870 0x7ff3cc0ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35430/0 (socket says 172.21.15.38:35430) 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.213+0000 7ff3cb7fe640 1 -- 172.21.15.38:0/17345096 learned_addr learned my addr 172.21.15.38:0/17345096 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.214+0000 7ff3caffd640 1 --2- 172.21.15.38:0/17345096 >> v2:172.21.15.89:3300/0 conn(0x7ff3cc15ec50 0x7ff3cc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.214+0000 7ff3cbfff640 1 --2- 172.21.15.38:0/17345096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc071310 0x7ff3cc070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.214+0000 7ff3cb7fe640 1 -- 172.21.15.38:0/17345096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc071310 msgr2=0x7ff3cc070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.214+0000 7ff3cb7fe640 1 --2- 172.21.15.38:0/17345096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc071310 0x7ff3cc070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.214+0000 7ff3cb7fe640 1 -- 172.21.15.38:0/17345096 >> v2:172.21.15.89:3300/0 conn(0x7ff3cc15ec50 msgr2=0x7ff3cc070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.214+0000 7ff3cb7fe640 1 --2- 172.21.15.38:0/17345096 >> v2:172.21.15.89:3300/0 conn(0x7ff3cc15ec50 0x7ff3cc070770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.214+0000 7ff3cb7fe640 1 -- 172.21.15.38:0/17345096 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc0cde60 con 0x7ff3cc15e870 2023-12-22T08:51:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.215+0000 7ff3cb7fe640 1 --2- 172.21.15.38:0/17345096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc15e870 0x7ff3cc0ce940 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc067750 tx=0x7ff3bc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575c5a7b030078c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.215+0000 7ff3ca7fc640 1 -- 172.21.15.38:0/17345096 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc02c9e0 con 0x7ff3cc15e870 2023-12-22T08:51:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.215+0000 7ff3ca7fc640 1 -- 172.21.15.38:0/17345096 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc02cb40 con 0x7ff3cc15e870 2023-12-22T08:51:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.215+0000 7ff3ca7fc640 1 -- 172.21.15.38:0/17345096 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc0343f0 con 0x7ff3cc15e870 2023-12-22T08:51:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.216+0000 7ff3d2087640 1 -- 172.21.15.38:0/17345096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc15e870 msgr2=0x7ff3cc0ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.216+0000 7ff3d2087640 1 --2- 172.21.15.38:0/17345096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc15e870 0x7ff3cc0ce940 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc067750 tx=0x7ff3bc02be40 comp rx=0 tx=0).stop 2023-12-22T08:51:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.216+0000 7ff3d2087640 1 -- 172.21.15.38:0/17345096 shutdown_connections 2023-12-22T08:51:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.216+0000 7ff3d2087640 1 --2- 172.21.15.38:0/17345096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc071310 0x7ff3cc070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.216+0000 7ff3d2087640 1 --2- 172.21.15.38:0/17345096 >> v2:172.21.15.89:3300/0 conn(0x7ff3cc15ec50 0x7ff3cc070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.216+0000 7ff3d2087640 1 --2- 172.21.15.38:0/17345096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc15e870 0x7ff3cc0ce940 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.216+0000 7ff3d2087640 1 -- 172.21.15.38:0/17345096 >> 172.21.15.38:0/17345096 conn(0x7ff3cc0b20c0 msgr2=0x7ff3cc0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.216+0000 7ff3d2087640 1 -- 172.21.15.38:0/17345096 shutdown_connections 2023-12-22T08:51:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.216+0000 7ff3d2087640 1 -- 172.21.15.38:0/17345096 wait complete. 2023-12-22T08:51:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.219+0000 7ff3d2087640 1 Processor -- start 2023-12-22T08:51:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.219+0000 7ff3d2087640 1 -- start start 2023-12-22T08:51:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.220+0000 7ff3d2087640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3cc071310 0x7ff3cc0c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.220+0000 7ff3d2087640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc15e870 0x7ff3cc0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.220+0000 7ff3d2087640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc15ec50 0x7ff3cc0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.220+0000 7ff3d2087640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0ad360 con 0x7ff3cc15ec50 2023-12-22T08:51:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.220+0000 7ff3d2087640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0ae170 con 0x7ff3cc071310 2023-12-22T08:51:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.220+0000 7ff3d2087640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0ad560 con 0x7ff3cc15e870 2023-12-22T08:51:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.221+0000 7ff3cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc15ec50 0x7ff3cc0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.221+0000 7ff3cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc15ec50 0x7ff3cc0ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35446/0 (socket says 172.21.15.38:35446) 2023-12-22T08:51:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.221+0000 7ff3cbfff640 1 -- 172.21.15.38:0/3258814929 learned_addr learned my addr 172.21.15.38:0/3258814929 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.221+0000 7ff3cb7fe640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3cc071310 0x7ff3cc0c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.221+0000 7ff3caffd640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc15e870 0x7ff3cc0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.221+0000 7ff3cbfff640 1 -- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc15e870 msgr2=0x7ff3cc0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.221+0000 7ff3cbfff640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc15e870 0x7ff3cc0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.221+0000 7ff3cbfff640 1 -- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3cc071310 msgr2=0x7ff3cc0c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.221+0000 7ff3cbfff640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3cc071310 0x7ff3cc0c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.221+0000 7ff3cbfff640 1 -- 172.21.15.38:0/3258814929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc009b30 con 0x7ff3cc15ec50 2023-12-22T08:51:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.221+0000 7ff3caffd640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc15e870 0x7ff3cc0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.222+0000 7ff3cbfff640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc15ec50 0x7ff3cc0ace20 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400c4c0 tx=0x7ff3c400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.222+0000 7ff3b3fff640 1 -- 172.21.15.38:0/3258814929 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4004220 con 0x7ff3cc15ec50 2023-12-22T08:51:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.222+0000 7ff3b3fff640 1 -- 172.21.15.38:0/3258814929 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c4004380 con 0x7ff3cc15ec50 2023-12-22T08:51:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.222+0000 7ff3b3fff640 1 -- 172.21.15.38:0/3258814929 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4003810 con 0x7ff3cc15ec50 2023-12-22T08:51:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.222+0000 7ff3d2087640 1 -- 172.21.15.38:0/3258814929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3cc0ad840 con 0x7ff3cc15ec50 2023-12-22T08:51:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.222+0000 7ff3d2087640 1 -- 172.21.15.38:0/3258814929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3cc0ade00 con 0x7ff3cc15ec50 2023-12-22T08:51:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.223+0000 7ff3d2087640 1 -- 172.21.15.38:0/3258814929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3cc0cd750 con 0x7ff3cc15ec50 2023-12-22T08:51:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.224+0000 7ff3b3fff640 1 -- 172.21.15.38:0/3258814929 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff3c4003970 con 0x7ff3cc15ec50 2023-12-22T08:51:04.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.225+0000 7ff3b3fff640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3b806a430 0x7ff3b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:04.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.226+0000 7ff3b3fff640 1 -- 172.21.15.38:0/3258814929 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3c40885c0 con 0x7ff3cc15ec50 2023-12-22T08:51:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.226+0000 7ff3b3fff640 1 -- 172.21.15.38:0/3258814929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7ff3b8071f60 con 0x7ff3cc15ec50 2023-12-22T08:51:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.226+0000 7ff3cb7fe640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3b806a430 0x7ff3b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.227+0000 7ff3cb7fe640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3b806a430 0x7ff3b806c8f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc035000 tx=0x7ff3bc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:04.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.230+0000 7ff3b3fff640 1 -- 172.21.15.38:0/3258814929 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff3c401e060 con 0x7ff3cc15ec50 2023-12-22T08:51:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.422+0000 7ff3d2087640 1 -- 172.21.15.38:0/3258814929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3cc061910 con 0x7ff3cc15ec50 2023-12-22T08:51:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.423+0000 7ff3b3fff640 1 -- 172.21.15.38:0/3258814929 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v160) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff3c4053b10 con 0x7ff3cc15ec50 2023-12-22T08:51:04.424 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:51:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.426+0000 7ff3d2087640 1 -- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3b806a430 msgr2=0x7ff3b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.426+0000 7ff3d2087640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3b806a430 0x7ff3b806c8f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc035000 tx=0x7ff3bc030000 comp rx=0 tx=0).stop 2023-12-22T08:51:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.426+0000 7ff3d2087640 1 -- 172.21.15.38:0/3258814929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc15ec50 msgr2=0x7ff3cc0ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.426+0000 7ff3d2087640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc15ec50 0x7ff3cc0ace20 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400c4c0 tx=0x7ff3c400c980 comp rx=0 tx=0).stop 2023-12-22T08:51:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.426+0000 7ff3d2087640 1 -- 172.21.15.38:0/3258814929 shutdown_connections 2023-12-22T08:51:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.426+0000 7ff3d2087640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3b806a430 0x7ff3b806c8f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.426+0000 7ff3d2087640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc15ec50 0x7ff3cc0ace20 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.426+0000 7ff3d2087640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc15e870 0x7ff3cc0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.426+0000 7ff3d2087640 1 --2- 172.21.15.38:0/3258814929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3cc071310 0x7ff3cc0c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.426+0000 7ff3d2087640 1 -- 172.21.15.38:0/3258814929 >> 172.21.15.38:0/3258814929 conn(0x7ff3cc0b20c0 msgr2=0x7ff3cc06c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.427+0000 7ff3d2087640 1 -- 172.21.15.38:0/3258814929 shutdown_connections 2023-12-22T08:51:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.427+0000 7ff3d2087640 1 -- 172.21.15.38:0/3258814929 wait complete. 2023-12-22T08:51:04.446 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:51:04.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.661+0000 7f2f249e9640 1 Processor -- start 2023-12-22T08:51:04.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.662+0000 7f2f249e9640 1 -- start start 2023-12-22T08:51:04.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.663+0000 7f2f249e9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f20151fd0 0x7f2f200b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:04.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.663+0000 7f2f249e9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2f201523b0 0x7f2f200b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:04.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.663+0000 7f2f249e9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f200b4880 con 0x7f2f200b4410 2023-12-22T08:51:04.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.663+0000 7f2f249e9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f200ce8e0 con 0x7f2f201523b0 2023-12-22T08:51:04.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.663+0000 7f2f249e9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200b6080 con 0x7f2f20151fd0 2023-12-22T08:51:04.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.664+0000 7f2f1f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f20151fd0 0x7f2f200b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:04.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.664+0000 7f2f1effd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2f201523b0 0x7f2f200b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:04.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.664+0000 7f2f1f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f20151fd0 0x7f2f200b6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:45018/0 (socket says 172.21.15.38:45018) 2023-12-22T08:51:04.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.664+0000 7f2f1f7fe640 1 -- 172.21.15.38:0/661199719 learned_addr learned my addr 172.21.15.38:0/661199719 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:04.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.664+0000 7f2f1ffff640 1 --1- 172.21.15.38:0/661199719 >> v1:172.21.15.89:6789/0 conn(0x7f2f200b4410 0x7f2f200cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:33848/0 (socket says 172.21.15.38:33848) 2023-12-22T08:51:04.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.665+0000 7f2f1f7fe640 1 -- 172.21.15.38:0/661199719 >> v2:172.21.15.89:3300/0 conn(0x7f2f201523b0 msgr2=0x7f2f200b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:04.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.665+0000 7f2f1f7fe640 1 --2- 172.21.15.38:0/661199719 >> v2:172.21.15.89:3300/0 conn(0x7f2f201523b0 0x7f2f200b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.665+0000 7f2f1f7fe640 1 -- 172.21.15.38:0/661199719 >> v1:172.21.15.89:6789/0 conn(0x7f2f200b4410 legacy=0x7f2f200cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:04.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.665+0000 7f2f1e7fc640 1 -- 172.21.15.38:0/661199719 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749268409 0 0) 0x7f2f200b4880 con 0x7f2f200b4410 2023-12-22T08:51:04.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.665+0000 7f2f1f7fe640 1 -- 172.21.15.38:0/661199719 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200b6360 con 0x7f2f20151fd0 2023-12-22T08:51:04.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.667+0000 7f2f1f7fe640 1 --2- 172.21.15.38:0/661199719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f20151fd0 0x7f2f200b6b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009870 tx=0x7f2f1002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32fbe0d020da23b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:04.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.667+0000 7f2f1e7fc640 1 -- 172.21.15.38:0/661199719 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10030840 con 0x7f2f20151fd0 2023-12-22T08:51:04.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.667+0000 7f2f1e7fc640 1 -- 172.21.15.38:0/661199719 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f100309a0 con 0x7f2f20151fd0 2023-12-22T08:51:04.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.667+0000 7f2f1e7fc640 1 -- 172.21.15.38:0/661199719 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10030d30 con 0x7f2f20151fd0 2023-12-22T08:51:04.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.668+0000 7f2f249e9640 1 -- 172.21.15.38:0/661199719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f20151fd0 msgr2=0x7f2f200b6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:04.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.668+0000 7f2f249e9640 1 --2- 172.21.15.38:0/661199719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f20151fd0 0x7f2f200b6b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009870 tx=0x7f2f1002b980 comp rx=0 tx=0).stop 2023-12-22T08:51:04.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.668+0000 7f2f249e9640 1 -- 172.21.15.38:0/661199719 shutdown_connections 2023-12-22T08:51:04.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.668+0000 7f2f249e9640 1 --2- 172.21.15.38:0/661199719 >> v2:172.21.15.89:3300/0 conn(0x7f2f201523b0 0x7f2f200b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.668+0000 7f2f249e9640 1 --2- 172.21.15.38:0/661199719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f20151fd0 0x7f2f200b6b60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.668+0000 7f2f249e9640 1 -- 172.21.15.38:0/661199719 >> 172.21.15.38:0/661199719 conn(0x7f2f20071460 msgr2=0x7f2f20071870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:04.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.668+0000 7f2f249e9640 1 -- 172.21.15.38:0/661199719 shutdown_connections 2023-12-22T08:51:04.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.668+0000 7f2f249e9640 1 -- 172.21.15.38:0/661199719 wait complete. 2023-12-22T08:51:04.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.670+0000 7f2f249e9640 1 Processor -- start 2023-12-22T08:51:04.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.670+0000 7f2f249e9640 1 -- start start 2023-12-22T08:51:04.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.671+0000 7f2f249e9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f200b4410 0x7f2f20143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.671+0000 7f2f249e9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f20151fd0 0x7f2f20154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.671+0000 7f2f249e9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f201523b0 0x7f2f201553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.671+0000 7f2f249e9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20143770 con 0x7f2f201523b0 2023-12-22T08:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.671+0000 7f2f249e9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f201438e0 con 0x7f2f200b4410 2023-12-22T08:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.671+0000 7f2f249e9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20143bc0 con 0x7f2f20151fd0 2023-12-22T08:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.671+0000 7f2f1ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f201523b0 0x7f2f201553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.671+0000 7f2f1ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f201523b0 0x7f2f201553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35454/0 (socket says 172.21.15.38:35454) 2023-12-22T08:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.671+0000 7f2f1ffff640 1 -- 172.21.15.38:0/283008123 learned_addr learned my addr 172.21.15.38:0/283008123 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f1f7fe640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f200b4410 0x7f2f20143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f1effd640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f20151fd0 0x7f2f20154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f1ffff640 1 -- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f20151fd0 msgr2=0x7f2f20154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f1ffff640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f20151fd0 0x7f2f20154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f1ffff640 1 -- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f200b4410 msgr2=0x7f2f20143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:04.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f1ffff640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f200b4410 0x7f2f20143230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f1ffff640 1 -- 172.21.15.38:0/283008123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f100094d0 con 0x7f2f201523b0 2023-12-22T08:51:04.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f1f7fe640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f200b4410 0x7f2f20143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:04.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f1effd640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f20151fd0 0x7f2f20154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:04.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f1ffff640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f201523b0 0x7f2f201553a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800c780 tx=0x7f2f1800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:04.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f17fff640 1 -- 172.21.15.38:0/283008123 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800ce30 con 0x7f2f201523b0 2023-12-22T08:51:04.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f17fff640 1 -- 172.21.15.38:0/283008123 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1800a640 con 0x7f2f201523b0 2023-12-22T08:51:04.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f17fff640 1 -- 172.21.15.38:0/283008123 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800a9f0 con 0x7f2f201523b0 2023-12-22T08:51:04.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.672+0000 7f2f249e9640 1 -- 172.21.15.38:0/283008123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f20143ea0 con 0x7f2f201523b0 2023-12-22T08:51:04.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.673+0000 7f2f249e9640 1 -- 172.21.15.38:0/283008123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f20144460 con 0x7f2f201523b0 2023-12-22T08:51:04.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.674+0000 7f2f249e9640 1 -- 172.21.15.38:0/283008123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f20144680 con 0x7f2f201523b0 2023-12-22T08:51:04.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.675+0000 7f2f17fff640 1 -- 172.21.15.38:0/283008123 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2f1800ab50 con 0x7f2f201523b0 2023-12-22T08:51:04.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.676+0000 7f2f17fff640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2f0006a460 0x7f2f0006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:04.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.676+0000 7f2f17fff640 1 -- 172.21.15.38:0/283008123 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f18087c40 con 0x7f2f201523b0 2023-12-22T08:51:04.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.676+0000 7f2f17fff640 1 -- 172.21.15.38:0/283008123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f2f00071f90 con 0x7f2f201523b0 2023-12-22T08:51:04.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.677+0000 7f2f1f7fe640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2f0006a460 0x7f2f0006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:04.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.678+0000 7f2f1f7fe640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2f0006a460 0x7f2f0006c920 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2f10036000 tx=0x7f2f1003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:04.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.680+0000 7f2f17fff640 1 -- 172.21.15.38:0/283008123 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2f18018020 con 0x7f2f201523b0 2023-12-22T08:51:04.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.885+0000 7f2f249e9640 1 -- 172.21.15.38:0/283008123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2f20061910 con 0x7f2f201523b0 2023-12-22T08:51:04.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.886+0000 7f2f17fff640 1 -- 172.21.15.38:0/283008123 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v160) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2f18053220 con 0x7f2f201523b0 2023-12-22T08:51:04.886 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:51:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.888+0000 7f2f249e9640 1 -- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2f0006a460 msgr2=0x7f2f0006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.888+0000 7f2f249e9640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2f0006a460 0x7f2f0006c920 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2f10036000 tx=0x7f2f1003b040 comp rx=0 tx=0).stop 2023-12-22T08:51:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.888+0000 7f2f249e9640 1 -- 172.21.15.38:0/283008123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f201523b0 msgr2=0x7f2f201553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.888+0000 7f2f249e9640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f201523b0 0x7f2f201553a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800c780 tx=0x7f2f1800cc40 comp rx=0 tx=0).stop 2023-12-22T08:51:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.888+0000 7f2f249e9640 1 -- 172.21.15.38:0/283008123 shutdown_connections 2023-12-22T08:51:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.888+0000 7f2f249e9640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2f0006a460 0x7f2f0006c920 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.888+0000 7f2f249e9640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2f201523b0 0x7f2f201553a0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.888+0000 7f2f249e9640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f20151fd0 0x7f2f20154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.888+0000 7f2f249e9640 1 --2- 172.21.15.38:0/283008123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f200b4410 0x7f2f20143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.888+0000 7f2f249e9640 1 -- 172.21.15.38:0/283008123 >> 172.21.15.38:0/283008123 conn(0x7f2f20071460 msgr2=0x7f2f2014cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.889+0000 7f2f249e9640 1 -- 172.21.15.38:0/283008123 shutdown_connections 2023-12-22T08:51:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:04.889+0000 7f2f249e9640 1 -- 172.21.15.38:0/283008123 wait complete. 2023-12-22T08:51:04.909 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T08:51:04.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:04.909 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-22T08:51:05.025 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:51:05.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:05.025 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T08:51:05.074 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:51:05.075 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:51:05.138 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:51:05.138 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:51:05.138 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:51:05.198 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:51:05.198 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:51:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.438+0000 7f53ee18b640 1 Processor -- start 2023-12-22T08:51:05.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.439+0000 7f53ee18b640 1 -- start start 2023-12-22T08:51:05.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.440+0000 7f53ee18b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e80cb830 0x7f53e80cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:05.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.440+0000 7f53ee18b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e80b3d10 con 0x7f53e80b26a0 2023-12-22T08:51:05.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.440+0000 7f53ee18b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e80cc200 con 0x7f53e80b22c0 2023-12-22T08:51:05.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.440+0000 7f53ee18b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e806c610 con 0x7f53e80cb830 2023-12-22T08:51:05.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.441+0000 7f53dffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f53e80b26a0 0x7f53e806ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46510/0 (socket says 172.21.15.38:46510) 2023-12-22T08:51:05.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.441+0000 7f53dffff640 1 -- 172.21.15.38:0/1052913794 learned_addr learned my addr 172.21.15.38:0/1052913794 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:05.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.441+0000 7f53e7fff640 1 --2- 172.21.15.38:0/1052913794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e80cb830 0x7f53e80cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:05.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.441+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755144715 0 0) 0x7f53d0001110 con 0x7f53e80b26a0 2023-12-22T08:51:05.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.441+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d4003520 con 0x7f53e80b26a0 2023-12-22T08:51:05.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 127031941 0 0) 0x7f53d4003520 con 0x7f53e80b26a0 2023-12-22T08:51:05.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e80cb830 msgr2=0x7f53e80cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:05.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e6ffd640 1 --2- 172.21.15.38:0/1052913794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e80cb830 0x7f53e80cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 >> v1:172.21.15.89:6789/0 conn(0x7f53e80b22c0 legacy=0x7f53e80b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:05.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e80b4510 con 0x7f53e80b26a0 2023-12-22T08:51:05.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f53d0001800 con 0x7f53e80b26a0 2023-12-22T08:51:05.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 >> v1:172.21.15.38:6789/0 conn(0x7f53e80b26a0 legacy=0x7f53e806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:05.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e6ffd640 1 --2- 172.21.15.38:0/1052913794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e80cb830 0x7f53d40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:05.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e6ffd640 1 --2- 172.21.15.38:0/1052913794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53d4003f70 0x7f53d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:05.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e6ffd640 1 --2- 172.21.15.38:0/1052913794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d4004d00 0x7f53d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:05.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e806c610 con 0x7f53d4003f70 2023-12-22T08:51:05.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d400bb70 con 0x7f53d4004d00 2023-12-22T08:51:05.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d400bd30 con 0x7f53e80cb830 2023-12-22T08:51:05.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53dffff640 1 --2- 172.21.15.38:0/1052913794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53d4003f70 0x7f53d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:05.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.442+0000 7f53e77fe640 1 --2- 172.21.15.38:0/1052913794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e80cb830 0x7f53d40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:05.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.443+0000 7f53e7fff640 1 --2- 172.21.15.38:0/1052913794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d4004d00 0x7f53d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:05.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.443+0000 7f53dffff640 1 -- 172.21.15.38:0/1052913794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e80cb830 msgr2=0x7f53d40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:05.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.443+0000 7f53dffff640 1 --2- 172.21.15.38:0/1052913794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e80cb830 0x7f53d40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.443+0000 7f53dffff640 1 -- 172.21.15.38:0/1052913794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d4004d00 msgr2=0x7f53d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:05.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.443+0000 7f53dffff640 1 --2- 172.21.15.38:0/1052913794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d4004d00 0x7f53d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.443+0000 7f53dffff640 1 -- 172.21.15.38:0/1052913794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d4003520 con 0x7f53d4003f70 2023-12-22T08:51:05.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.443+0000 7f53e7fff640 1 --2- 172.21.15.38:0/1052913794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53d4004d00 0x7f53d4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:05.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.444+0000 7f53dffff640 1 --2- 172.21.15.38:0/1052913794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53d4003f70 0x7f53d40047c0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f53d0007fc0 tx=0x7f53d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c08242ce4df332 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:05.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.444+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0005ad0 con 0x7f53d4003f70 2023-12-22T08:51:05.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.444+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0005c50 con 0x7f53d4003f70 2023-12-22T08:51:05.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.444+0000 7f53e6ffd640 1 -- 172.21.15.38:0/1052913794 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d002c7e0 con 0x7f53d4003f70 2023-12-22T08:51:05.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.445+0000 7f53ee18b640 1 -- 172.21.15.38:0/1052913794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53d4003f70 msgr2=0x7f53d40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:05.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.445+0000 7f53ee18b640 1 --2- 172.21.15.38:0/1052913794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53d4003f70 0x7f53d40047c0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f53d0007fc0 tx=0x7f53d40057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.445+0000 7f53e7fff640 1 -- 172.21.15.38:0/1052913794 reap_dead start 2023-12-22T08:51:05.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.445+0000 7f53ee18b640 1 -- 172.21.15.38:0/1052913794 shutdown_connections 2023-12-22T08:51:05.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.445+0000 7f53ee18b640 1 -- 172.21.15.38:0/1052913794 >> 172.21.15.38:0/1052913794 conn(0x7f53e80cf070 msgr2=0x7f53e80cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:05.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.445+0000 7f53ee18b640 1 -- 172.21.15.38:0/1052913794 shutdown_connections 2023-12-22T08:51:05.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.445+0000 7f53ee18b640 1 -- 172.21.15.38:0/1052913794 wait complete. 2023-12-22T08:51:05.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.447+0000 7f53ee18b640 1 Processor -- start 2023-12-22T08:51:05.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.447+0000 7f53ee18b640 1 -- start start 2023-12-22T08:51:05.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.448+0000 7f53ee18b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53d4003f70 0x7f53e815a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:05.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.448+0000 7f53ee18b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e8163370 0x7f53e814b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:05.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.448+0000 7f53ee18b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e8164910 0x7f53e815d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:05.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.448+0000 7f53ee18b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e8163870 con 0x7f53d4003f70 2023-12-22T08:51:05.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.448+0000 7f53ee18b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e8163b50 con 0x7f53e8164910 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.448+0000 7f53ee18b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e8163e30 con 0x7f53e8163370 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.448+0000 7f53e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53d4003f70 0x7f53e815a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.448+0000 7f53e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53d4003f70 0x7f53e815a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35480/0 (socket says 172.21.15.38:35480) 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.448+0000 7f53e77fe640 1 -- 172.21.15.38:0/2729531768 learned_addr learned my addr 172.21.15.38:0/2729531768 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.449+0000 7f53dffff640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e8163370 0x7f53e814b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.449+0000 7f53e77fe640 1 -- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e8163370 msgr2=0x7f53e814b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.449+0000 7f53e7fff640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e8164910 0x7f53e815d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.449+0000 7f53e77fe640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e8163370 0x7f53e814b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.449+0000 7f53e77fe640 1 -- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e8164910 msgr2=0x7f53e815d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.449+0000 7f53e77fe640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e8164910 0x7f53e815d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.449+0000 7f53e77fe640 1 -- 172.21.15.38:0/2729531768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e8164110 con 0x7f53d4003f70 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.449+0000 7f53e77fe640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53d4003f70 0x7f53e815a700 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f53d800e490 tx=0x7f53d800e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.449+0000 7f53e4ff9640 1 -- 172.21.15.38:0/2729531768 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d80052e0 con 0x7f53d4003f70 2023-12-22T08:51:05.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.449+0000 7f53e4ff9640 1 -- 172.21.15.38:0/2729531768 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d8005440 con 0x7f53d4003f70 2023-12-22T08:51:05.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.449+0000 7f53e4ff9640 1 -- 172.21.15.38:0/2729531768 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8003830 con 0x7f53d4003f70 2023-12-22T08:51:05.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.449+0000 7f53ee18b640 1 -- 172.21.15.38:0/2729531768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e81643f0 con 0x7f53d4003f70 2023-12-22T08:51:05.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.449+0000 7f53ee18b640 1 -- 172.21.15.38:0/2729531768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e814b6d0 con 0x7f53d4003f70 2023-12-22T08:51:05.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.450+0000 7f53ee18b640 1 -- 172.21.15.38:0/2729531768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e8061910 con 0x7f53d4003f70 2023-12-22T08:51:05.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.452+0000 7f53e4ff9640 1 -- 172.21.15.38:0/2729531768 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f53d8003990 con 0x7f53d4003f70 2023-12-22T08:51:05.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.452+0000 7f53e4ff9640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f53c806a460 0x7f53c806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:05.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.453+0000 7f53e4ff9640 1 -- 172.21.15.38:0/2729531768 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53d8088690 con 0x7f53d4003f70 2023-12-22T08:51:05.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.453+0000 7f53e4ff9640 1 -- 172.21.15.38:0/2729531768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f53c8071f90 con 0x7f53d4003f70 2023-12-22T08:51:05.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.453+0000 7f53dffff640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f53c806a460 0x7f53c806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:05.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.454+0000 7f53dffff640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f53c806a460 0x7f53c806c920 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f53d0034000 tx=0x7f53d0009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:05.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.457+0000 7f53e4ff9640 1 -- 172.21.15.38:0/2729531768 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f53d8053d40 con 0x7f53d4003f70 2023-12-22T08:51:05.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.687+0000 7f53ee18b640 1 -- 172.21.15.38:0/2729531768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53e8072260 con 0x7f53d4003f70 2023-12-22T08:51:05.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.688+0000 7f53e4ff9640 1 -- 172.21.15.38:0/2729531768 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4641 (secure 0 0 0) 0x7f53d8057360 con 0x7f53d4003f70 2023-12-22T08:51:05.689 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:05.689 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/52711154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":52711154},{"type":"v1","addr":"172.21.15.89:6837","nonce":52711154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2264719173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2264719173},{"type":"v1","addr":"172.21.15.38:6835","nonce":2264719173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3546762659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3546762659},{"type":"v1","addr":"172.21.15.89:6836","nonce":3546762659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:48:44.902723+0000","modified":"2023-12-22T08:48:48.440490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8148":{"gid":8148,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/885304998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":885304998},{"type":"v1","addr":"172.21.15.38:6833","nonce":885304998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-22T08:51:05.690 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 70 2023-12-22T08:51:05.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.691+0000 7f53ee18b640 1 -- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f53c806a460 msgr2=0x7f53c806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:05.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.691+0000 7f53ee18b640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f53c806a460 0x7f53c806c920 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f53d0034000 tx=0x7f53d0009030 comp rx=0 tx=0).stop 2023-12-22T08:51:05.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.691+0000 7f53ee18b640 1 -- 172.21.15.38:0/2729531768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53d4003f70 msgr2=0x7f53e815a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:05.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.691+0000 7f53ee18b640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53d4003f70 0x7f53e815a700 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f53d800e490 tx=0x7f53d800e950 comp rx=0 tx=0).stop 2023-12-22T08:51:05.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.691+0000 7f53ee18b640 1 -- 172.21.15.38:0/2729531768 shutdown_connections 2023-12-22T08:51:05.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.691+0000 7f53ee18b640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53e8164910 0x7f53e815d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.691+0000 7f53ee18b640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53e8163370 0x7f53e814b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.691+0000 7f53ee18b640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f53c806a460 0x7f53c806c920 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.691+0000 7f53ee18b640 1 --2- 172.21.15.38:0/2729531768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53d4003f70 0x7f53e815a700 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.691+0000 7f53ee18b640 1 -- 172.21.15.38:0/2729531768 >> 172.21.15.38:0/2729531768 conn(0x7f53e80cf070 msgr2=0x7f53e80cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:05.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.691+0000 7f53ee18b640 1 -- 172.21.15.38:0/2729531768 shutdown_connections 2023-12-22T08:51:05.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.691+0000 7f53ee18b640 1 -- 172.21.15.38:0/2729531768 wait complete. 2023-12-22T08:51:05.710 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:51:05.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.923+0000 7f0842b57640 1 Processor -- start 2023-12-22T08:51:05.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.924+0000 7f0842b57640 1 -- start start 2023-12-22T08:51:05.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.925+0000 7f0842b57640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f083c0ce170 0x7f083c15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:05.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.925+0000 7f0842b57640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083c0d0a10 con 0x7f083c0b3e80 2023-12-22T08:51:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.926+0000 7f0842b57640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083c0b43b0 con 0x7f083c144e60 2023-12-22T08:51:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.926+0000 7f0842b57640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083c15b930 con 0x7f083c0ce170 2023-12-22T08:51:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.926+0000 7f0841b55640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f083c0ce170 0x7f083c15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.926+0000 7f0841354640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f083c0b3e80 0x7f083c144750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46512/0 (socket says 172.21.15.38:46512) 2023-12-22T08:51:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.926+0000 7f0841354640 1 -- 172.21.15.38:0/422820368 learned_addr learned my addr 172.21.15.38:0/422820368 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.926+0000 7f0841b55640 1 -- 172.21.15.38:0/422820368 >> v1:172.21.15.89:6789/0 conn(0x7f083c144e60 legacy=0x7f083c0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.926+0000 7f0841b55640 1 -- 172.21.15.38:0/422820368 >> v1:172.21.15.38:6789/0 conn(0x7f083c0b3e80 legacy=0x7f083c144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:05.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.926+0000 7f0841b55640 1 -- 172.21.15.38:0/422820368 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c15bb10 con 0x7f083c0ce170 2023-12-22T08:51:05.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.927+0000 7f0841b55640 1 --2- 172.21.15.38:0/422820368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083c0ce170 0x7f083c15c5f0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f0830009d90 tx=0x7f083002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993a7939b6f2217c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:05.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.928+0000 7f0840b53640 1 -- 172.21.15.38:0/422820368 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083002cc60 con 0x7f083c0ce170 2023-12-22T08:51:05.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.928+0000 7f0840b53640 1 -- 172.21.15.38:0/422820368 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083002cdc0 con 0x7f083c0ce170 2023-12-22T08:51:05.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.928+0000 7f0840b53640 1 -- 172.21.15.38:0/422820368 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830034660 con 0x7f083c0ce170 2023-12-22T08:51:05.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.928+0000 7f0842b57640 1 -- 172.21.15.38:0/422820368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083c0ce170 msgr2=0x7f083c15c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:05.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.928+0000 7f0842b57640 1 --2- 172.21.15.38:0/422820368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083c0ce170 0x7f083c15c5f0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f0830009d90 tx=0x7f083002beb0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.929+0000 7f0842b57640 1 -- 172.21.15.38:0/422820368 shutdown_connections 2023-12-22T08:51:05.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.929+0000 7f0842b57640 1 --2- 172.21.15.38:0/422820368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083c0ce170 0x7f083c15c5f0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.929+0000 7f0842b57640 1 -- 172.21.15.38:0/422820368 >> 172.21.15.38:0/422820368 conn(0x7f083c0d14b0 msgr2=0x7f083c0d18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:05.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.929+0000 7f0842b57640 1 -- 172.21.15.38:0/422820368 shutdown_connections 2023-12-22T08:51:05.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.929+0000 7f0842b57640 1 -- 172.21.15.38:0/422820368 wait complete. 2023-12-22T08:51:05.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.930+0000 7f0842b57640 1 Processor -- start 2023-12-22T08:51:05.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.931+0000 7f0842b57640 1 -- start start 2023-12-22T08:51:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0842b57640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083c0b3e80 0x7f083c15afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0842b57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083c0ce170 0x7f083c0a8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0842b57640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083c144e60 0x7f083c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:05.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0842b57640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c0a8c40 con 0x7f083c0b3e80 2023-12-22T08:51:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0842b57640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c06b8d0 con 0x7f083c0ce170 2023-12-22T08:51:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0842b57640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c06cb80 con 0x7f083c144e60 2023-12-22T08:51:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0841b55640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083c0b3e80 0x7f083c15afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0841b55640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083c0b3e80 0x7f083c15afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35508/0 (socket says 172.21.15.38:35508) 2023-12-22T08:51:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0841b55640 1 -- 172.21.15.38:0/2274577503 learned_addr learned my addr 172.21.15.38:0/2274577503 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0841354640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083c0ce170 0x7f083c0a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0842356640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083c144e60 0x7f083c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0841b55640 1 -- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083c144e60 msgr2=0x7f083c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0841b55640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083c144e60 0x7f083c06b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0841b55640 1 -- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083c0ce170 msgr2=0x7f083c0a8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0841b55640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083c0ce170 0x7f083c0a8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.932+0000 7f0841b55640 1 -- 172.21.15.38:0/2274577503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0830009a70 con 0x7f083c0b3e80 2023-12-22T08:51:05.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.933+0000 7f0841b55640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083c0b3e80 0x7f083c15afa0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f0830037040 tx=0x7f0830004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:05.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.933+0000 7f083a7fc640 1 -- 172.21.15.38:0/2274577503 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830040650 con 0x7f083c0b3e80 2023-12-22T08:51:05.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.933+0000 7f083a7fc640 1 -- 172.21.15.38:0/2274577503 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08300407b0 con 0x7f083c0b3e80 2023-12-22T08:51:05.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.933+0000 7f083a7fc640 1 -- 172.21.15.38:0/2274577503 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830040b60 con 0x7f083c0b3e80 2023-12-22T08:51:05.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.933+0000 7f0842b57640 1 -- 172.21.15.38:0/2274577503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083c06bae0 con 0x7f083c0b3e80 2023-12-22T08:51:05.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.933+0000 7f0842b57640 1 -- 172.21.15.38:0/2274577503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083c06c0a0 con 0x7f083c0b3e80 2023-12-22T08:51:05.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.934+0000 7f0842b57640 1 -- 172.21.15.38:0/2274577503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083c061910 con 0x7f083c0b3e80 2023-12-22T08:51:05.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.935+0000 7f083a7fc640 1 -- 172.21.15.38:0/2274577503 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0830040cc0 con 0x7f083c0b3e80 2023-12-22T08:51:05.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.936+0000 7f083a7fc640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f082006a430 0x7f082006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:05.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.936+0000 7f083a7fc640 1 -- 172.21.15.38:0/2274577503 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08300ab900 con 0x7f083c0b3e80 2023-12-22T08:51:05.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.936+0000 7f083a7fc640 1 -- 172.21.15.38:0/2274577503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f0820071f60 con 0x7f083c0b3e80 2023-12-22T08:51:05.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.937+0000 7f0841354640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f082006a430 0x7f082006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:05.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.938+0000 7f0841354640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f082006a430 0x7f082006c8f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f083c0cd720 tx=0x7f0828009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:05.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:05.940+0000 7f083a7fc640 1 -- 172.21.15.38:0/2274577503 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0830076ee0 con 0x7f083c0b3e80 2023-12-22T08:51:06.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.135+0000 7f0842b57640 1 -- 172.21.15.38:0/2274577503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f083c0b1340 con 0x7f083c0b3e80 2023-12-22T08:51:06.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.138+0000 7f083a7fc640 1 -- 172.21.15.38:0/2274577503 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f0830044070 con 0x7f083c0b3e80 2023-12-22T08:51:06.140 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:06.140 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":160,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:50:21.331381+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:48:42.499151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-22T08:48:43.921718+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:51:06.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.141+0000 7f0842b57640 1 -- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f082006a430 msgr2=0x7f082006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.141+0000 7f0842b57640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f082006a430 0x7f082006c8f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f083c0cd720 tx=0x7f0828009040 comp rx=0 tx=0).stop 2023-12-22T08:51:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.141+0000 7f0842b57640 1 -- 172.21.15.38:0/2274577503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083c0b3e80 msgr2=0x7f083c15afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.141+0000 7f0842b57640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083c0b3e80 0x7f083c15afa0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f0830037040 tx=0x7f0830004a40 comp rx=0 tx=0).stop 2023-12-22T08:51:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.141+0000 7f0842b57640 1 -- 172.21.15.38:0/2274577503 shutdown_connections 2023-12-22T08:51:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.141+0000 7f0842b57640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083c144e60 0x7f083c06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.141+0000 7f0842b57640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083c0ce170 0x7f083c0a8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.141+0000 7f0842b57640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f082006a430 0x7f082006c8f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.141+0000 7f0842b57640 1 --2- 172.21.15.38:0/2274577503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f083c0b3e80 0x7f083c15afa0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.141+0000 7f0842b57640 1 -- 172.21.15.38:0/2274577503 >> 172.21.15.38:0/2274577503 conn(0x7f083c0d14b0 msgr2=0x7f083c143c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:06.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.141+0000 7f0842b57640 1 -- 172.21.15.38:0/2274577503 shutdown_connections 2023-12-22T08:51:06.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.141+0000 7f0842b57640 1 -- 172.21.15.38:0/2274577503 wait complete. 2023-12-22T08:51:06.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:48:42.499151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:48:43.921718+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:51:06.164 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:51:06.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.402+0000 7f4b9dcb9640 1 Processor -- start 2023-12-22T08:51:06.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.403+0000 7f4b9dcb9640 1 -- start start 2023-12-22T08:51:06.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.404+0000 7f4b9dcb9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b9815d5a0 0x7f4b980d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.404+0000 7f4b9dcb9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9815de50 con 0x7f4b9815d1c0 2023-12-22T08:51:06.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.404+0000 7f4b9dcb9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b980d0dd0 con 0x7f4b98071080 2023-12-22T08:51:06.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.404+0000 7f4b9dcb9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980d10b0 con 0x7f4b9815d5a0 2023-12-22T08:51:06.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.405+0000 7f4b9ccb7640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4b9815d1c0 0x7f4b98070970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46522/0 (socket says 172.21.15.38:46522) 2023-12-22T08:51:06.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.405+0000 7f4b9ccb7640 1 -- 172.21.15.38:0/1425313670 learned_addr learned my addr 172.21.15.38:0/1425313670 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:06.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.405+0000 7f4b9d4b8640 1 --2- 172.21.15.38:0/1425313670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b9815d5a0 0x7f4b980d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.405+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741758991 0 0) 0x7f4b9815de50 con 0x7f4b9815d1c0 2023-12-22T08:51:06.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.405+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b84003520 con 0x7f4b9815d1c0 2023-12-22T08:51:06.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 332712449 0 0) 0x7f4b84003520 con 0x7f4b9815d1c0 2023-12-22T08:51:06.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b9815d5a0 msgr2=0x7f4b980d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:06.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b977fe640 1 --2- 172.21.15.38:0/1425313670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b9815d5a0 0x7f4b980d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 >> v1:172.21.15.89:6789/0 conn(0x7f4b98071080 legacy=0x7f4b980d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:06.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9815dae0 con 0x7f4b9815d1c0 2023-12-22T08:51:06.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f4b880019f0 con 0x7f4b9815d1c0 2023-12-22T08:51:06.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 >> v1:172.21.15.38:6789/0 conn(0x7f4b9815d1c0 legacy=0x7f4b98070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:06.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b977fe640 1 --2- 172.21.15.38:0/1425313670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b840039a0 0x7f4b84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b977fe640 1 --2- 172.21.15.38:0/1425313670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b9815d5a0 0x7f4b840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b977fe640 1 --2- 172.21.15.38:0/1425313670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b84004d00 0x7f4b84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980d10b0 con 0x7f4b840039a0 2023-12-22T08:51:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8400ba60 con 0x7f4b84004d00 2023-12-22T08:51:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8400bc20 con 0x7f4b9815d5a0 2023-12-22T08:51:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b9ccb7640 1 --2- 172.21.15.38:0/1425313670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b840039a0 0x7f4b84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b97fff640 1 --2- 172.21.15.38:0/1425313670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b9815d5a0 0x7f4b840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.406+0000 7f4b9ccb7640 1 -- 172.21.15.38:0/1425313670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b9815d5a0 msgr2=0x7f4b840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.407+0000 7f4b9ccb7640 1 --2- 172.21.15.38:0/1425313670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b9815d5a0 0x7f4b840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.407+0000 7f4b9ccb7640 1 -- 172.21.15.38:0/1425313670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b84004d00 msgr2=0x7f4b84005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.407+0000 7f4b9d4b8640 1 --2- 172.21.15.38:0/1425313670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b84004d00 0x7f4b84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.407+0000 7f4b9ccb7640 1 --2- 172.21.15.38:0/1425313670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b84004d00 0x7f4b84005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.407+0000 7f4b9ccb7640 1 -- 172.21.15.38:0/1425313670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84003520 con 0x7f4b840039a0 2023-12-22T08:51:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.407+0000 7f4b97fff640 1 --2- 172.21.15.38:0/1425313670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b9815d5a0 0x7f4b840047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.408+0000 7f4b9ccb7640 1 --2- 172.21.15.38:0/1425313670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b840039a0 0x7f4b84003dc0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f4b88002230 tx=0x7f4b840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402ebe5378e8c56c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.408+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88034630 con 0x7f4b840039a0 2023-12-22T08:51:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.408+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8802f070 con 0x7f4b840039a0 2023-12-22T08:51:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.408+0000 7f4b977fe640 1 -- 172.21.15.38:0/1425313670 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88034a10 con 0x7f4b840039a0 2023-12-22T08:51:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.409+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/1425313670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b840039a0 msgr2=0x7f4b84003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.409+0000 7f4b9dcb9640 1 --2- 172.21.15.38:0/1425313670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b840039a0 0x7f4b84003dc0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f4b88002230 tx=0x7f4b840057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.409+0000 7f4b9d4b8640 1 -- 172.21.15.38:0/1425313670 reap_dead start 2023-12-22T08:51:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.409+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/1425313670 shutdown_connections 2023-12-22T08:51:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.409+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/1425313670 >> 172.21.15.38:0/1425313670 conn(0x7f4b9806bf90 msgr2=0x7f4b9806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.409+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/1425313670 shutdown_connections 2023-12-22T08:51:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.409+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/1425313670 wait complete. 2023-12-22T08:51:06.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.411+0000 7f4b9dcb9640 1 Processor -- start 2023-12-22T08:51:06.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.411+0000 7f4b9dcb9640 1 -- start start 2023-12-22T08:51:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.413+0000 7f4b9dcb9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b840039a0 0x7f4b981f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.413+0000 7f4b9dcb9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b98157680 0x7f4b98157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.413+0000 7f4b9dcb9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b980b7d50 0x7f4b980b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.413+0000 7f4b9dcb9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98142c40 con 0x7f4b98157680 2023-12-22T08:51:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.413+0000 7f4b9dcb9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98142f20 con 0x7f4b980b7d50 2023-12-22T08:51:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.413+0000 7f4b9dcb9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98143200 con 0x7f4b840039a0 2023-12-22T08:51:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.413+0000 7f4b97fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b98157680 0x7f4b98157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.413+0000 7f4b97fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b98157680 0x7f4b98157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35512/0 (socket says 172.21.15.38:35512) 2023-12-22T08:51:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.413+0000 7f4b97fff640 1 -- 172.21.15.38:0/3302135619 learned_addr learned my addr 172.21.15.38:0/3302135619 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.414+0000 7f4b9d4b8640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b980b7d50 0x7f4b980b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.414+0000 7f4b9ccb7640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b840039a0 0x7f4b981f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.414+0000 7f4b97fff640 1 -- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b840039a0 msgr2=0x7f4b981f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.414+0000 7f4b97fff640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b840039a0 0x7f4b981f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.414+0000 7f4b97fff640 1 -- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b980b7d50 msgr2=0x7f4b980b81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.414+0000 7f4b97fff640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b980b7d50 0x7f4b980b81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.414+0000 7f4b97fff640 1 -- 172.21.15.38:0/3302135619 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b981434e0 con 0x7f4b98157680 2023-12-22T08:51:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.414+0000 7f4b97fff640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b98157680 0x7f4b98157b00 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000d770 tx=0x7f4b8000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.415+0000 7f4b957fa640 1 -- 172.21.15.38:0/3302135619 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80005270 con 0x7f4b98157680 2023-12-22T08:51:06.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.415+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/3302135619 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b981428d0 con 0x7f4b98157680 2023-12-22T08:51:06.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.415+0000 7f4b957fa640 1 -- 172.21.15.38:0/3302135619 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b800053d0 con 0x7f4b98157680 2023-12-22T08:51:06.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.415+0000 7f4b957fa640 1 -- 172.21.15.38:0/3302135619 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000b8d0 con 0x7f4b98157680 2023-12-22T08:51:06.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.415+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/3302135619 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b981555f0 con 0x7f4b98157680 2023-12-22T08:51:06.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.416+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/3302135619 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b98143670 con 0x7f4b98157680 2023-12-22T08:51:06.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.417+0000 7f4b957fa640 1 -- 172.21.15.38:0/3302135619 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b8000ba30 con 0x7f4b98157680 2023-12-22T08:51:06.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.418+0000 7f4b957fa640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b7806a460 0x7f4b7806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.419+0000 7f4b957fa640 1 -- 172.21.15.38:0/3302135619 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b800889a0 con 0x7f4b98157680 2023-12-22T08:51:06.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.419+0000 7f4b9ccb7640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b7806a460 0x7f4b7806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.420+0000 7f4b9ccb7640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b7806a460 0x7f4b7806c920 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4b88034000 tx=0x7f4b8802f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.424+0000 7f4b957fa640 1 -- 172.21.15.38:0/3302135619 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4b80053e70 con 0x7f4b98157680 2023-12-22T08:51:06.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.619+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/3302135619 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4b98061910 con 0x7f4b98157680 2023-12-22T08:51:06.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.620+0000 7f4b957fa640 1 -- 172.21.15.38:0/3302135619 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v161) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4b80057490 con 0x7f4b98157680 2023-12-22T08:51:06.621 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:51:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.623+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b7806a460 msgr2=0x7f4b7806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.623+0000 7f4b9dcb9640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b7806a460 0x7f4b7806c920 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4b88034000 tx=0x7f4b8802f000 comp rx=0 tx=0).stop 2023-12-22T08:51:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.623+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/3302135619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b98157680 msgr2=0x7f4b98157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.623+0000 7f4b9dcb9640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b98157680 0x7f4b98157b00 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000d770 tx=0x7f4b8000dc30 comp rx=0 tx=0).stop 2023-12-22T08:51:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.623+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/3302135619 shutdown_connections 2023-12-22T08:51:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.623+0000 7f4b9dcb9640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b980b7d50 0x7f4b980b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.623+0000 7f4b9dcb9640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4b7806a460 0x7f4b7806c920 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.623+0000 7f4b9dcb9640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b98157680 0x7f4b98157b00 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.623+0000 7f4b9dcb9640 1 --2- 172.21.15.38:0/3302135619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4b840039a0 0x7f4b981f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.623+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/3302135619 >> 172.21.15.38:0/3302135619 conn(0x7f4b9806bf90 msgr2=0x7f4b980d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:06.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.623+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/3302135619 shutdown_connections 2023-12-22T08:51:06.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.623+0000 7f4b9dcb9640 1 -- 172.21.15.38:0/3302135619 wait complete. 2023-12-22T08:51:06.642 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:51:06.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.871+0000 7f65b3da4640 1 Processor -- start 2023-12-22T08:51:06.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.872+0000 7f65b3da4640 1 -- start start 2023-12-22T08:51:06.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.873+0000 7f65b3da4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65ac15e740 0x7f65ac15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.873+0000 7f65b3da4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac0b3f90 0x7f65ac070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.873+0000 7f65b3da4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac15eb20 con 0x7f65ac06ca50 2023-12-22T08:51:06.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.873+0000 7f65b3da4640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac06e650 con 0x7f65ac15e740 2023-12-22T08:51:06.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.873+0000 7f65b3da4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac070770 con 0x7f65ac0b3f90 2023-12-22T08:51:06.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.874+0000 7f65b1b40640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65ac15e740 0x7f65ac15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.874+0000 7f65b1b40640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f65ac15e740 0x7f65ac15db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35526/0 (socket says 172.21.15.38:35526) 2023-12-22T08:51:06.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.874+0000 7f65b1b40640 1 -- 172.21.15.38:0/4189713975 learned_addr learned my addr 172.21.15.38:0/4189713975 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:06.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.874+0000 7f65b2341640 1 --2- 172.21.15.38:0/4189713975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac0b3f90 0x7f65ac070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.874+0000 7f65b1b40640 1 -- 172.21.15.38:0/4189713975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac0b3f90 msgr2=0x7f65ac070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:06.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.874+0000 7f65b1b40640 1 --2- 172.21.15.38:0/4189713975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac0b3f90 0x7f65ac070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.874+0000 7f65b1b40640 1 -- 172.21.15.38:0/4189713975 >> v1:172.21.15.89:6789/0 conn(0x7f65ac06ca50 legacy=0x7f65ac0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:06.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.874+0000 7f65b1b40640 1 -- 172.21.15.38:0/4189713975 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac06cec0 con 0x7f65ac15e740 2023-12-22T08:51:06.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.876+0000 7f65b1b40640 1 --2- 172.21.15.38:0/4189713975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac15e740 0x7f65ac15db30 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f659c009e50 tx=0x7f659c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a347d12272c98e80 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:06.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.876+0000 7f65b0b3e640 1 -- 172.21.15.38:0/4189713975 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c02c9f0 con 0x7f65ac15e740 2023-12-22T08:51:06.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.876+0000 7f65b0b3e640 1 -- 172.21.15.38:0/4189713975 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c02cb50 con 0x7f65ac15e740 2023-12-22T08:51:06.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.876+0000 7f65b0b3e640 1 -- 172.21.15.38:0/4189713975 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c0343f0 con 0x7f65ac15e740 2023-12-22T08:51:06.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.876+0000 7f65b3da4640 1 -- 172.21.15.38:0/4189713975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac15e740 msgr2=0x7f65ac15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:06.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.876+0000 7f65b3da4640 1 --2- 172.21.15.38:0/4189713975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac15e740 0x7f65ac15db30 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f659c009e50 tx=0x7f659c02be50 comp rx=0 tx=0).stop 2023-12-22T08:51:06.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.877+0000 7f65b3da4640 1 -- 172.21.15.38:0/4189713975 shutdown_connections 2023-12-22T08:51:06.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.877+0000 7f65b3da4640 1 --2- 172.21.15.38:0/4189713975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac0b3f90 0x7f65ac070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.877+0000 7f65b3da4640 1 --2- 172.21.15.38:0/4189713975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac15e740 0x7f65ac15db30 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.877+0000 7f65b3da4640 1 -- 172.21.15.38:0/4189713975 >> 172.21.15.38:0/4189713975 conn(0x7f65ac0cfea0 msgr2=0x7f65ac0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:06.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.877+0000 7f65b3da4640 1 -- 172.21.15.38:0/4189713975 shutdown_connections 2023-12-22T08:51:06.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.877+0000 7f65b3da4640 1 -- 172.21.15.38:0/4189713975 wait complete. 2023-12-22T08:51:06.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.878+0000 7f65b3da4640 1 Processor -- start 2023-12-22T08:51:06.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.879+0000 7f65b3da4640 1 -- start start 2023-12-22T08:51:06.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.879+0000 7f65b3da4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65ac06ca50 0x7f65ac151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.879+0000 7f65b3da4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac0b3f90 0x7f65ac0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b3da4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac15e740 0x7f65ac0b8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b3da4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac1f3020 con 0x7f65ac0b3f90 2023-12-22T08:51:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b3da4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac0b7690 con 0x7f65ac06ca50 2023-12-22T08:51:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b3da4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac151770 con 0x7f65ac15e740 2023-12-22T08:51:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b133f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac0b3f90 0x7f65ac0b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b133f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac0b3f90 0x7f65ac0b6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35532/0 (socket says 172.21.15.38:35532) 2023-12-22T08:51:06.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b133f640 1 -- 172.21.15.38:0/2018775961 learned_addr learned my addr 172.21.15.38:0/2018775961 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:06.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b2341640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac15e740 0x7f65ac0b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b1b40640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65ac06ca50 0x7f65ac151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b133f640 1 -- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac15e740 msgr2=0x7f65ac0b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:06.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b133f640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac15e740 0x7f65ac0b8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b133f640 1 -- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65ac06ca50 msgr2=0x7f65ac151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:06.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b133f640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65ac06ca50 0x7f65ac151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:06.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b133f640 1 -- 172.21.15.38:0/2018775961 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c009b30 con 0x7f65ac0b3f90 2023-12-22T08:51:06.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b1b40640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65ac06ca50 0x7f65ac151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:06.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.880+0000 7f65b2341640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac15e740 0x7f65ac0b8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:06.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.881+0000 7f65b133f640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac0b3f90 0x7f65ac0b6450 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f65a000c400 tx=0x7f65a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:06.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.881+0000 7f65aa7fc640 1 -- 172.21.15.38:0/2018775961 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a00052d0 con 0x7f65ac0b3f90 2023-12-22T08:51:06.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.881+0000 7f65aa7fc640 1 -- 172.21.15.38:0/2018775961 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a0005430 con 0x7f65ac0b3f90 2023-12-22T08:51:06.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.881+0000 7f65aa7fc640 1 -- 172.21.15.38:0/2018775961 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a0003830 con 0x7f65ac0b3f90 2023-12-22T08:51:06.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.881+0000 7f65b3da4640 1 -- 172.21.15.38:0/2018775961 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac0b6df0 con 0x7f65ac0b3f90 2023-12-22T08:51:06.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.881+0000 7f65b3da4640 1 -- 172.21.15.38:0/2018775961 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac0b73b0 con 0x7f65ac0b3f90 2023-12-22T08:51:06.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.882+0000 7f65b3da4640 1 -- 172.21.15.38:0/2018775961 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ac061910 con 0x7f65ac0b3f90 2023-12-22T08:51:06.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.883+0000 7f65aa7fc640 1 -- 172.21.15.38:0/2018775961 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f65a0003990 con 0x7f65ac0b3f90 2023-12-22T08:51:06.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.884+0000 7f65aa7fc640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f659806a430 0x7f659806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:06.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.884+0000 7f65aa7fc640 1 -- 172.21.15.38:0/2018775961 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65a0087e80 con 0x7f65ac0b3f90 2023-12-22T08:51:06.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.885+0000 7f65b1b40640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f659806a430 0x7f659806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:06.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.886+0000 7f65b1b40640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f659806a430 0x7f659806c8f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f659c035000 tx=0x7f659c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:06.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:06.889+0000 7f65aa7fc640 1 -- 172.21.15.38:0/2018775961 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f65a0053470 con 0x7f65ac0b3f90 2023-12-22T08:51:07.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.082+0000 7f65b3da4640 1 -- 172.21.15.38:0/2018775961 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65ac066010 con 0x7f65ac0b3f90 2023-12-22T08:51:07.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.083+0000 7f65aa7fc640 1 -- 172.21.15.38:0/2018775961 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v161) v1 ==== 104+0+11 (secure 0 0 0) 0x7f65a0056a90 con 0x7f65ac0b3f90 2023-12-22T08:51:07.084 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:51:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.086+0000 7f65b3da4640 1 -- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f659806a430 msgr2=0x7f659806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.086+0000 7f65b3da4640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f659806a430 0x7f659806c8f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f659c035000 tx=0x7f659c030000 comp rx=0 tx=0).stop 2023-12-22T08:51:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.086+0000 7f65b3da4640 1 -- 172.21.15.38:0/2018775961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac0b3f90 msgr2=0x7f65ac0b6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.086+0000 7f65b3da4640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac0b3f90 0x7f65ac0b6450 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f65a000c400 tx=0x7f65a000c8c0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.086+0000 7f65b3da4640 1 -- 172.21.15.38:0/2018775961 shutdown_connections 2023-12-22T08:51:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.086+0000 7f65b3da4640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65ac15e740 0x7f65ac0b8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.086+0000 7f65b3da4640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f659806a430 0x7f659806c8f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.086+0000 7f65b3da4640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65ac0b3f90 0x7f65ac0b6450 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.086+0000 7f65b3da4640 1 --2- 172.21.15.38:0/2018775961 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65ac06ca50 0x7f65ac151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.086+0000 7f65b3da4640 1 -- 172.21.15.38:0/2018775961 >> 172.21.15.38:0/2018775961 conn(0x7f65ac0cfea0 msgr2=0x7f65ac0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:07.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.086+0000 7f65b3da4640 1 -- 172.21.15.38:0/2018775961 shutdown_connections 2023-12-22T08:51:07.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.086+0000 7f65b3da4640 1 -- 172.21.15.38:0/2018775961 wait complete. 2023-12-22T08:51:07.105 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:51:07.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.332+0000 7f923359e640 1 Processor -- start 2023-12-22T08:51:07.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.332+0000 7f923359e640 1 -- start start 2023-12-22T08:51:07.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.334+0000 7f923359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92340701e0 0x7f923415f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:07.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.334+0000 7f923359e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9234144750 0x7f92340ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:07.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.334+0000 7f923359e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92340ce020 con 0x7f9234144040 2023-12-22T08:51:07.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.334+0000 7f923359e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9234072330 con 0x7f9234144750 2023-12-22T08:51:07.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.334+0000 7f923359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9234071ad0 con 0x7f92340701e0 2023-12-22T08:51:07.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.335+0000 7f923259c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9234144040 0x7f923406fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46538/0 (socket says 172.21.15.38:46538) 2023-12-22T08:51:07.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.335+0000 7f9232d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9234144750 0x7f92340ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:07.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.335+0000 7f923259c640 1 -- 172.21.15.38:0/1321223685 learned_addr learned my addr 172.21.15.38:0/1321223685 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:07.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.335+0000 7f9231d9b640 1 --2- 172.21.15.38:0/1321223685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92340701e0 0x7f923415f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:07.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.335+0000 7f923159a640 1 -- 172.21.15.38:0/1321223685 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495843721 0 0) 0x7f92340ce020 con 0x7f9234144040 2023-12-22T08:51:07.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.335+0000 7f9232d9d640 1 -- 172.21.15.38:0/1321223685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92340701e0 msgr2=0x7f923415f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:07.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.335+0000 7f9232d9d640 1 --2- 172.21.15.38:0/1321223685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92340701e0 0x7f923415f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.335+0000 7f9232d9d640 1 -- 172.21.15.38:0/1321223685 >> v1:172.21.15.38:6789/0 conn(0x7f9234144040 legacy=0x7f923406fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:07.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.335+0000 7f9232d9d640 1 -- 172.21.15.38:0/1321223685 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9234071d70 con 0x7f9234144750 2023-12-22T08:51:07.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.336+0000 7f9232d9d640 1 --2- 172.21.15.38:0/1321223685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9234144750 0x7f92340ce4b0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f922c009d90 tx=0x7f922c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fcbd36a5e45c17 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:07.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.337+0000 7f923159a640 1 -- 172.21.15.38:0/1321223685 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c02cc60 con 0x7f9234144750 2023-12-22T08:51:07.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.337+0000 7f923159a640 1 -- 172.21.15.38:0/1321223685 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922c02cdc0 con 0x7f9234144750 2023-12-22T08:51:07.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.337+0000 7f923159a640 1 -- 172.21.15.38:0/1321223685 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c034660 con 0x7f9234144750 2023-12-22T08:51:07.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.337+0000 7f923359e640 1 -- 172.21.15.38:0/1321223685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9234144750 msgr2=0x7f92340ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:07.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.337+0000 7f923359e640 1 --2- 172.21.15.38:0/1321223685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9234144750 0x7f92340ce4b0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f922c009d90 tx=0x7f922c02beb0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.337+0000 7f923359e640 1 -- 172.21.15.38:0/1321223685 shutdown_connections 2023-12-22T08:51:07.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.337+0000 7f923359e640 1 --2- 172.21.15.38:0/1321223685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9234144750 0x7f92340ce4b0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.337+0000 7f923359e640 1 --2- 172.21.15.38:0/1321223685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92340701e0 0x7f923415f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.337+0000 7f923359e640 1 -- 172.21.15.38:0/1321223685 >> 172.21.15.38:0/1321223685 conn(0x7f92340cfef0 msgr2=0x7f92340d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:07.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.338+0000 7f923359e640 1 -- 172.21.15.38:0/1321223685 shutdown_connections 2023-12-22T08:51:07.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.338+0000 7f923359e640 1 -- 172.21.15.38:0/1321223685 wait complete. 2023-12-22T08:51:07.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.340+0000 7f923359e640 1 Processor -- start 2023-12-22T08:51:07.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.340+0000 7f923359e640 1 -- start start 2023-12-22T08:51:07.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.341+0000 7f923359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92340701e0 0x7f9234138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:07.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.341+0000 7f923359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9234144040 0x7f923415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:07.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.341+0000 7f923359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9234144750 0x7f92340aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:07.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.341+0000 7f923359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9234137c70 con 0x7f92340701e0 2023-12-22T08:51:07.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.341+0000 7f923359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9234137f50 con 0x7f9234144040 2023-12-22T08:51:07.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.341+0000 7f923359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9234138230 con 0x7f9234144750 2023-12-22T08:51:07.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.341+0000 7f923259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92340701e0 0x7f9234138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:07.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.341+0000 7f923259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92340701e0 0x7f9234138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35552/0 (socket says 172.21.15.38:35552) 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.341+0000 7f923259c640 1 -- 172.21.15.38:0/946028324 learned_addr learned my addr 172.21.15.38:0/946028324 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.342+0000 7f923259c640 1 -- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9234144750 msgr2=0x7f92340aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.342+0000 7f9232d9d640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9234144750 0x7f92340aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.342+0000 7f9231d9b640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9234144040 0x7f923415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.342+0000 7f923259c640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9234144750 0x7f92340aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.342+0000 7f923259c640 1 -- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9234144040 msgr2=0x7f923415adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.342+0000 7f923259c640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9234144040 0x7f923415adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.342+0000 7f923259c640 1 -- 172.21.15.38:0/946028324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c009a70 con 0x7f92340701e0 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.342+0000 7f923259c640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92340701e0 0x7f9234138d10 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f922400c430 tx=0x7f922400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.342+0000 7f9222ffd640 1 -- 172.21.15.38:0/946028324 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92240074e0 con 0x7f92340701e0 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.342+0000 7f9222ffd640 1 -- 172.21.15.38:0/946028324 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9224007660 con 0x7f92340701e0 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.342+0000 7f9222ffd640 1 -- 172.21.15.38:0/946028324 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224004a20 con 0x7f92340701e0 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.342+0000 7f923359e640 1 -- 172.21.15.38:0/946028324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9234138510 con 0x7f92340701e0 2023-12-22T08:51:07.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.343+0000 7f923359e640 1 -- 172.21.15.38:0/946028324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923415b2f0 con 0x7f92340701e0 2023-12-22T08:51:07.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.344+0000 7f923359e640 1 -- 172.21.15.38:0/946028324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9234061910 con 0x7f92340701e0 2023-12-22T08:51:07.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.345+0000 7f9222ffd640 1 -- 172.21.15.38:0/946028324 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9224004b80 con 0x7f92340701e0 2023-12-22T08:51:07.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.346+0000 7f9222ffd640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f921406a430 0x7f921406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:07.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.346+0000 7f9222ffd640 1 -- 172.21.15.38:0/946028324 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92240887f0 con 0x7f92340701e0 2023-12-22T08:51:07.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.346+0000 7f9231d9b640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f921406a430 0x7f921406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:07.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.347+0000 7f9231d9b640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f921406a430 0x7f921406c8f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f92340aa450 tx=0x7f9228008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:07.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.350+0000 7f9222ffd640 1 -- 172.21.15.38:0/946028324 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9224053d40 con 0x7f92340701e0 2023-12-22T08:51:07.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.543+0000 7f923359e640 1 -- 172.21.15.38:0/946028324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f92340d0ab0 con 0x7f92340701e0 2023-12-22T08:51:07.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.544+0000 7f9222ffd640 1 -- 172.21.15.38:0/946028324 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v161) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9224057360 con 0x7f92340701e0 2023-12-22T08:51:07.545 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:51:07.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.547+0000 7f923359e640 1 -- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f921406a430 msgr2=0x7f921406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:07.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.547+0000 7f923359e640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f921406a430 0x7f921406c8f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f92340aa450 tx=0x7f9228008040 comp rx=0 tx=0).stop 2023-12-22T08:51:07.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.547+0000 7f923359e640 1 -- 172.21.15.38:0/946028324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92340701e0 msgr2=0x7f9234138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:07.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.547+0000 7f923359e640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92340701e0 0x7f9234138d10 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f922400c430 tx=0x7f922400c8f0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.547+0000 7f923359e640 1 -- 172.21.15.38:0/946028324 shutdown_connections 2023-12-22T08:51:07.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.547+0000 7f923359e640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9234144750 0x7f92340aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.547+0000 7f923359e640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9234144040 0x7f923415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.547+0000 7f923359e640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f921406a430 0x7f921406c8f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.547+0000 7f923359e640 1 --2- 172.21.15.38:0/946028324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92340701e0 0x7f9234138d10 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.547+0000 7f923359e640 1 -- 172.21.15.38:0/946028324 >> 172.21.15.38:0/946028324 conn(0x7f92340cfef0 msgr2=0x7f92340a9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:07.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.547+0000 7f923359e640 1 -- 172.21.15.38:0/946028324 shutdown_connections 2023-12-22T08:51:07.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.547+0000 7f923359e640 1 -- 172.21.15.38:0/946028324 wait complete. 2023-12-22T08:51:07.567 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:51:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.785+0000 7ffbdd32e640 1 Processor -- start 2023-12-22T08:51:07.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.785+0000 7ffbdd32e640 1 -- start start 2023-12-22T08:51:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.787+0000 7ffbdd32e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd815e740 0x7ffbd815db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.787+0000 7ffbdd32e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffbd80b3f90 0x7ffbd8070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.787+0000 7ffbdd32e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd815eb20 con 0x7ffbd806ca50 2023-12-22T08:51:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.787+0000 7ffbdd32e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd806e650 con 0x7ffbd80b3f90 2023-12-22T08:51:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.787+0000 7ffbdd32e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8070770 con 0x7ffbd815e740 2023-12-22T08:51:07.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.788+0000 7ffbd77fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffbd80b3f90 0x7ffbd8070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.788+0000 7ffbd77fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffbd80b3f90 0x7ffbd8070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:56148/0 (socket says 172.21.15.38:56148) 2023-12-22T08:51:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.788+0000 7ffbd77fe640 1 -- 172.21.15.38:0/1207771539 learned_addr learned my addr 172.21.15.38:0/1207771539 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.788+0000 7ffbd6ffd640 1 --2- 172.21.15.38:0/1207771539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd815e740 0x7ffbd815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.789+0000 7ffbd77fe640 1 -- 172.21.15.38:0/1207771539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd815e740 msgr2=0x7ffbd815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.789+0000 7ffbd77fe640 1 --2- 172.21.15.38:0/1207771539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd815e740 0x7ffbd815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.789+0000 7ffbd77fe640 1 -- 172.21.15.38:0/1207771539 >> v1:172.21.15.89:6789/0 conn(0x7ffbd806ca50 legacy=0x7ffbd80b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:07.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.789+0000 7ffbd77fe640 1 -- 172.21.15.38:0/1207771539 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd806d180 con 0x7ffbd80b3f90 2023-12-22T08:51:07.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.789+0000 7ffbd6ffd640 1 --2- 172.21.15.38:0/1207771539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd815e740 0x7ffbd815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:51:07.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.790+0000 7ffbd77fe640 1 --2- 172.21.15.38:0/1207771539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd80b3f90 0x7ffbd8070c00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009870 tx=0x7ffbd002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2f867b438e1ca63 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:07.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.791+0000 7ffbd5ffb640 1 -- 172.21.15.38:0/1207771539 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00317c0 con 0x7ffbd80b3f90 2023-12-22T08:51:07.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.791+0000 7ffbd5ffb640 1 -- 172.21.15.38:0/1207771539 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd0031920 con 0x7ffbd80b3f90 2023-12-22T08:51:07.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.791+0000 7ffbd5ffb640 1 -- 172.21.15.38:0/1207771539 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0031cb0 con 0x7ffbd80b3f90 2023-12-22T08:51:07.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.791+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1207771539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd80b3f90 msgr2=0x7ffbd8070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.791+0000 7ffbdd32e640 1 --2- 172.21.15.38:0/1207771539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd80b3f90 0x7ffbd8070c00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009870 tx=0x7ffbd002b860 comp rx=0 tx=0).stop 2023-12-22T08:51:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.792+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1207771539 shutdown_connections 2023-12-22T08:51:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.792+0000 7ffbdd32e640 1 --2- 172.21.15.38:0/1207771539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd80b3f90 0x7ffbd8070c00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.792+0000 7ffbdd32e640 1 --2- 172.21.15.38:0/1207771539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd815e740 0x7ffbd815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.792+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1207771539 >> 172.21.15.38:0/1207771539 conn(0x7ffbd80cfea0 msgr2=0x7ffbd80d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.792+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1207771539 shutdown_connections 2023-12-22T08:51:07.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.792+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1207771539 wait complete. 2023-12-22T08:51:07.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.793+0000 7ffbdd32e640 1 Processor -- start 2023-12-22T08:51:07.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.794+0000 7ffbdd32e640 1 -- start start 2023-12-22T08:51:07.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.795+0000 7ffbdd32e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd806ca50 0x7ffbd81531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:07.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.795+0000 7ffbdd32e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd80b3f90 0x7ffbd81592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:07.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.795+0000 7ffbdd32e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbd815e740 0x7ffbd8159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:07.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.795+0000 7ffbdd32e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80b6450 con 0x7ffbd815e740 2023-12-22T08:51:07.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.795+0000 7ffbdd32e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd815b580 con 0x7ffbd80b3f90 2023-12-22T08:51:07.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.795+0000 7ffbdd32e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd815a200 con 0x7ffbd806ca50 2023-12-22T08:51:07.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.795+0000 7ffbd77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbd815e740 0x7ffbd8159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:07.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.795+0000 7ffbd77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbd815e740 0x7ffbd8159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35556/0 (socket says 172.21.15.38:35556) 2023-12-22T08:51:07.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.795+0000 7ffbd77fe640 1 -- 172.21.15.38:0/1716553858 learned_addr learned my addr 172.21.15.38:0/1716553858 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:07.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.795+0000 7ffbd6ffd640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd806ca50 0x7ffbd81531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:07.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.795+0000 7ffbd67fc640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd80b3f90 0x7ffbd81592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:07.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.796+0000 7ffbd77fe640 1 -- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd806ca50 msgr2=0x7ffbd81531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:07.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.796+0000 7ffbd77fe640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd806ca50 0x7ffbd81531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.796+0000 7ffbd77fe640 1 -- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd80b3f90 msgr2=0x7ffbd81592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:07.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.796+0000 7ffbd77fe640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd80b3f90 0x7ffbd81592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:07.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.796+0000 7ffbd77fe640 1 -- 172.21.15.38:0/1716553858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc8009a70 con 0x7ffbd815e740 2023-12-22T08:51:07.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.796+0000 7ffbd77fe640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbd815e740 0x7ffbd8159830 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00090b0 tx=0x7ffbd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:07.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.796+0000 7ffbcf7fe640 1 -- 172.21.15.38:0/1716553858 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0032860 con 0x7ffbd815e740 2023-12-22T08:51:07.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.796+0000 7ffbcf7fe640 1 -- 172.21.15.38:0/1716553858 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd00329e0 con 0x7ffbd815e740 2023-12-22T08:51:07.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.796+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1716553858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd00094d0 con 0x7ffbd815e740 2023-12-22T08:51:07.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.796+0000 7ffbcf7fe640 1 -- 172.21.15.38:0/1716553858 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0032d90 con 0x7ffbd815e740 2023-12-22T08:51:07.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.797+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1716553858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd80b6070 con 0x7ffbd815e740 2023-12-22T08:51:07.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.798+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1716553858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd815a720 con 0x7ffbd815e740 2023-12-22T08:51:07.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.799+0000 7ffbcf7fe640 1 -- 172.21.15.38:0/1716553858 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffbd004e450 con 0x7ffbd815e740 2023-12-22T08:51:07.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.799+0000 7ffbcf7fe640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffbb806a430 0x7ffbb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:07.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.800+0000 7ffbcf7fe640 1 -- 172.21.15.38:0/1716553858 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbd00aa9e0 con 0x7ffbd815e740 2023-12-22T08:51:07.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.800+0000 7ffbd6ffd640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffbb806a430 0x7ffbb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:07.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.801+0000 7ffbd6ffd640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffbb806a430 0x7ffbb806c8f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009fd0 tx=0x7ffbc800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:07.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:07.804+0000 7ffbcf7fe640 1 -- 172.21.15.38:0/1716553858 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffbd815a720 con 0x7ffbd815e740 2023-12-22T08:51:08.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.040+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1716553858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbd80b5ed0 con 0x7ffbd815e740 2023-12-22T08:51:08.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.041+0000 7ffbcf7fe640 1 -- 172.21.15.38:0/1716553858 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4641 (secure 0 0 0) 0x7ffbd80b5ed0 con 0x7ffbd815e740 2023-12-22T08:51:08.042 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:08.042 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/52711154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":52711154},{"type":"v1","addr":"172.21.15.89:6837","nonce":52711154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2264719173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2264719173},{"type":"v1","addr":"172.21.15.38:6835","nonce":2264719173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3546762659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3546762659},{"type":"v1","addr":"172.21.15.89:6836","nonce":3546762659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:48:44.902723+0000","modified":"2023-12-22T08:48:48.440490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8148":{"gid":8148,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/885304998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":885304998},{"type":"v1","addr":"172.21.15.38:6833","nonce":885304998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-22T08:51:08.042 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 70 2023-12-22T08:51:08.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.043+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffbb806a430 msgr2=0x7ffbb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:08.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.043+0000 7ffbdd32e640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffbb806a430 0x7ffbb806c8f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009fd0 tx=0x7ffbc800b040 comp rx=0 tx=0).stop 2023-12-22T08:51:08.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.043+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1716553858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbd815e740 msgr2=0x7ffbd8159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:08.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.043+0000 7ffbdd32e640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbd815e740 0x7ffbd8159830 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00090b0 tx=0x7ffbd00046c0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.044+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1716553858 shutdown_connections 2023-12-22T08:51:08.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.044+0000 7ffbdd32e640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffbb806a430 0x7ffbb806c8f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.044+0000 7ffbdd32e640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbd815e740 0x7ffbd8159830 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.044+0000 7ffbdd32e640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffbd80b3f90 0x7ffbd81592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.044+0000 7ffbdd32e640 1 --2- 172.21.15.38:0/1716553858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffbd806ca50 0x7ffbd81531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.044+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1716553858 >> 172.21.15.38:0/1716553858 conn(0x7ffbd80cfea0 msgr2=0x7ffbd8160f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:08.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.044+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1716553858 shutdown_connections 2023-12-22T08:51:08.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.044+0000 7ffbdd32e640 1 -- 172.21.15.38:0/1716553858 wait complete. 2023-12-22T08:51:08.065 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:51:08.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.272+0000 7fc68e948640 1 Processor -- start 2023-12-22T08:51:08.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.272+0000 7fc68e948640 1 -- start start 2023-12-22T08:51:08.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.274+0000 7fc68e948640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc688144d10 0x7fc6880cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.274+0000 7fc68e948640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6880cc670 0x7fc6880b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.274+0000 7fc68e948640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6881450f0 con 0x7fc6880b2590 2023-12-22T08:51:08.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.274+0000 7fc68e948640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6880b2a20 con 0x7fc688144d10 2023-12-22T08:51:08.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.274+0000 7fc68e948640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880ce010 con 0x7fc6880cc670 2023-12-22T08:51:08.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.274+0000 7fc68cee5640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc6880b2590 0x7fc68815f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46546/0 (socket says 172.21.15.38:46546) 2023-12-22T08:51:08.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.274+0000 7fc68cee5640 1 -- 172.21.15.38:0/582839602 learned_addr learned my addr 172.21.15.38:0/582839602 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:08.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc687fff640 1 --2- 172.21.15.38:0/582839602 >> v2:172.21.15.89:3300/0 conn(0x7fc688144d10 0x7fc6880cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:08.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc6877fe640 1 --2- 172.21.15.38:0/582839602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6880cc670 0x7fc6880b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:08.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135868148 0 0) 0x7fc6881450f0 con 0x7fc6880b2590 2023-12-22T08:51:08.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc670003520 con 0x7fc6880b2590 2023-12-22T08:51:08.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1667514540 0 0) 0x7fc670003520 con 0x7fc6880b2590 2023-12-22T08:51:08.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6880cc670 msgr2=0x7fc6880b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:08.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 --2- 172.21.15.38:0/582839602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6880cc670 0x7fc6880b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 >> v2:172.21.15.89:3300/0 conn(0x7fc688144d10 msgr2=0x7fc6880cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 --2- 172.21.15.38:0/582839602 >> v2:172.21.15.89:3300/0 conn(0x7fc688144d10 0x7fc6880cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6880ce2f0 con 0x7fc6880b2590 2023-12-22T08:51:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fc6800019f0 con 0x7fc6880b2590 2023-12-22T08:51:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 >> v1:172.21.15.38:6789/0 conn(0x7fc6880b2590 legacy=0x7fc68815f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 --2- 172.21.15.38:0/582839602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc670003970 0x7fc670003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 --2- 172.21.15.38:0/582839602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6700042d0 0x7fc6700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 --2- 172.21.15.38:0/582839602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc670004e10 0x7fc670005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.275+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880b2a20 con 0x7fc670004e10 2023-12-22T08:51:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.276+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880ce010 con 0x7fc6700042d0 2023-12-22T08:51:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.276+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67000bd00 con 0x7fc670003970 2023-12-22T08:51:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.276+0000 7fc68cee5640 1 --2- 172.21.15.38:0/582839602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc670004e10 0x7fc670005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.276+0000 7fc687fff640 1 --2- 172.21.15.38:0/582839602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc670003970 0x7fc670003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:08.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.276+0000 7fc6877fe640 1 --2- 172.21.15.38:0/582839602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6700042d0 0x7fc6700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:08.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.276+0000 7fc68cee5640 1 -- 172.21.15.38:0/582839602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc670003970 msgr2=0x7fc670003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:08.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.276+0000 7fc68cee5640 1 --2- 172.21.15.38:0/582839602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc670003970 0x7fc670003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.276+0000 7fc68cee5640 1 -- 172.21.15.38:0/582839602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6700042d0 msgr2=0x7fc6700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:08.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.276+0000 7fc68cee5640 1 --2- 172.21.15.38:0/582839602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6700042d0 0x7fc6700047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.276+0000 7fc68cee5640 1 -- 172.21.15.38:0/582839602 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc670003520 con 0x7fc670004e10 2023-12-22T08:51:08.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.277+0000 7fc68cee5640 1 --2- 172.21.15.38:0/582839602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc670004e10 0x7fc670005290 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fc68000a830 tx=0x7fc6700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc9c2b24ef5fe22 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:08.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.278+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680034630 con 0x7fc670004e10 2023-12-22T08:51:08.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.278+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68002f070 con 0x7fc670004e10 2023-12-22T08:51:08.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.278+0000 7fc686ffd640 1 -- 172.21.15.38:0/582839602 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680034a30 con 0x7fc670004e10 2023-12-22T08:51:08.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.278+0000 7fc68e948640 1 -- 172.21.15.38:0/582839602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc670004e10 msgr2=0x7fc670005290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:08.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.278+0000 7fc68e948640 1 --2- 172.21.15.38:0/582839602 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc670004e10 0x7fc670005290 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fc68000a830 tx=0x7fc6700057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.278+0000 7fc68cee5640 1 -- 172.21.15.38:0/582839602 reap_dead start 2023-12-22T08:51:08.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.278+0000 7fc68e948640 1 -- 172.21.15.38:0/582839602 shutdown_connections 2023-12-22T08:51:08.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.278+0000 7fc68e948640 1 -- 172.21.15.38:0/582839602 >> 172.21.15.38:0/582839602 conn(0x7fc6880cf070 msgr2=0x7fc6880cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:08.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.278+0000 7fc68e948640 1 -- 172.21.15.38:0/582839602 shutdown_connections 2023-12-22T08:51:08.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.278+0000 7fc68e948640 1 -- 172.21.15.38:0/582839602 wait complete. 2023-12-22T08:51:08.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.280+0000 7fc68e948640 1 Processor -- start 2023-12-22T08:51:08.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.280+0000 7fc68e948640 1 -- start start 2023-12-22T08:51:08.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.281+0000 7fc68e948640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc670004e10 0x7fc6880af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.281+0000 7fc68e948640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6881580b0 0x7fc68815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.281+0000 7fc68e948640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc688156e10 0x7fc688157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.281+0000 7fc68e948640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68815da50 con 0x7fc6881580b0 2023-12-22T08:51:08.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.281+0000 7fc68e948640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880b0560 con 0x7fc688156e10 2023-12-22T08:51:08.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.281+0000 7fc68e948640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880afcc0 con 0x7fc670004e10 2023-12-22T08:51:08.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.281+0000 7fc6877fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6881580b0 0x7fc68815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:08.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.281+0000 7fc6877fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6881580b0 0x7fc68815baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35564/0 (socket says 172.21.15.38:35564) 2023-12-22T08:51:08.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.281+0000 7fc6877fe640 1 -- 172.21.15.38:0/891946163 learned_addr learned my addr 172.21.15.38:0/891946163 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.282+0000 7fc68cee5640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc688156e10 0x7fc688157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.282+0000 7fc687fff640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc670004e10 0x7fc6880af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.282+0000 7fc6877fe640 1 -- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc670004e10 msgr2=0x7fc6880af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.282+0000 7fc6877fe640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc670004e10 0x7fc6880af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.282+0000 7fc6877fe640 1 -- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc688156e10 msgr2=0x7fc688157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.282+0000 7fc6877fe640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc688156e10 0x7fc688157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.282+0000 7fc6877fe640 1 -- 172.21.15.38:0/891946163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6880affa0 con 0x7fc6881580b0 2023-12-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.282+0000 7fc68cee5640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc688156e10 0x7fc688157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.282+0000 7fc6877fe640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6881580b0 0x7fc68815baa0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fc67c010890 tx=0x7fc67c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.282+0000 7fc684ff9640 1 -- 172.21.15.38:0/891946163 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0095b0 con 0x7fc6881580b0 2023-12-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.282+0000 7fc684ff9640 1 -- 172.21.15.38:0/891946163 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c00eb80 con 0x7fc6881580b0 2023-12-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.282+0000 7fc68e948640 1 -- 172.21.15.38:0/891946163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6880b0280 con 0x7fc6881580b0 2023-12-22T08:51:08.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.283+0000 7fc684ff9640 1 -- 172.21.15.38:0/891946163 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c01c400 con 0x7fc6881580b0 2023-12-22T08:51:08.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.283+0000 7fc68e948640 1 -- 172.21.15.38:0/891946163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc688158530 con 0x7fc6881580b0 2023-12-22T08:51:08.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.284+0000 7fc68e948640 1 -- 172.21.15.38:0/891946163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc688061910 con 0x7fc6881580b0 2023-12-22T08:51:08.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.285+0000 7fc684ff9640 1 -- 172.21.15.38:0/891946163 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc67c0253f0 con 0x7fc6881580b0 2023-12-22T08:51:08.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.286+0000 7fc684ff9640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc67406a430 0x7fc67406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.286+0000 7fc684ff9640 1 -- 172.21.15.38:0/891946163 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc67c088fd0 con 0x7fc6881580b0 2023-12-22T08:51:08.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.287+0000 7fc687fff640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc67406a430 0x7fc67406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:08.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.288+0000 7fc687fff640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc67406a430 0x7fc67406c8f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc6780099b0 tx=0x7fc678008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:08.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.290+0000 7fc684ff9640 1 -- 172.21.15.38:0/891946163 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc67c054520 con 0x7fc6881580b0 2023-12-22T08:51:08.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.486+0000 7fc68e948640 1 -- 172.21.15.38:0/891946163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6880cb8e0 con 0x7fc6881580b0 2023-12-22T08:51:08.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.489+0000 7fc684ff9640 1 -- 172.21.15.38:0/891946163 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+16019 (secure 0 0 0) 0x7fc67c057b40 con 0x7fc6881580b0 2023-12-22T08:51:08.490 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:08.490 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":161,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:51:06.348916+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:48:42.499151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-22T08:48:43.921718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:51:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.491+0000 7fc68e948640 1 -- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc67406a430 msgr2=0x7fc67406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.491+0000 7fc68e948640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc67406a430 0x7fc67406c8f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc6780099b0 tx=0x7fc678008040 comp rx=0 tx=0).stop 2023-12-22T08:51:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.491+0000 7fc68e948640 1 -- 172.21.15.38:0/891946163 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6881580b0 msgr2=0x7fc68815baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.491+0000 7fc68e948640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6881580b0 0x7fc68815baa0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fc67c010890 tx=0x7fc67c010d50 comp rx=0 tx=0).stop 2023-12-22T08:51:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.491+0000 7fc68e948640 1 -- 172.21.15.38:0/891946163 shutdown_connections 2023-12-22T08:51:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.491+0000 7fc68e948640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc688156e10 0x7fc688157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.491+0000 7fc68e948640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc67406a430 0x7fc67406c8f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.491+0000 7fc68e948640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6881580b0 0x7fc68815baa0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.491+0000 7fc68e948640 1 --2- 172.21.15.38:0/891946163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc670004e10 0x7fc6880af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.491+0000 7fc68e948640 1 -- 172.21.15.38:0/891946163 >> 172.21.15.38:0/891946163 conn(0x7fc6880cf070 msgr2=0x7fc688070670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.492+0000 7fc68e948640 1 -- 172.21.15.38:0/891946163 shutdown_connections 2023-12-22T08:51:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.492+0000 7fc68e948640 1 -- 172.21.15.38:0/891946163 wait complete. 2023-12-22T08:51:08.511 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:51:08.511 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:51:08.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.734+0000 7f02dbfff640 1 Processor -- start 2023-12-22T08:51:08.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.734+0000 7f02dbfff640 1 -- start start 2023-12-22T08:51:08.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.735+0000 7f02dbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f02dc0cc250 0x7f02dc06d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.735+0000 7f02dbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f02dc15a6c0 0x7f02dc156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.735+0000 7f02dbfff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02dc0cc630 con 0x7f02dc06dd70 2023-12-22T08:51:08.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.735+0000 7f02dbfff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc06e200 con 0x7f02dc15a6c0 2023-12-22T08:51:08.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.736+0000 7f02dbfff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc071740 con 0x7f02dc0cc250 2023-12-22T08:51:08.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.736+0000 7f02db7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f02dc15a6c0 0x7f02dc156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:08.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.736+0000 7f02db7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f02dc15a6c0 0x7f02dc156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35574/0 (socket says 172.21.15.38:35574) 2023-12-22T08:51:08.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.736+0000 7f02db7fe640 1 -- 172.21.15.38:0/2916381074 learned_addr learned my addr 172.21.15.38:0/2916381074 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:08.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.736+0000 7f02daffd640 1 --2- 172.21.15.38:0/2916381074 >> v2:172.21.15.89:3300/0 conn(0x7f02dc0cc250 0x7f02dc06d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:08.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.736+0000 7f02db7fe640 1 -- 172.21.15.38:0/2916381074 >> v2:172.21.15.89:3300/0 conn(0x7f02dc0cc250 msgr2=0x7f02dc06d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:08.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.736+0000 7f02db7fe640 1 --2- 172.21.15.38:0/2916381074 >> v2:172.21.15.89:3300/0 conn(0x7f02dc0cc250 0x7f02dc06d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.736+0000 7f02db7fe640 1 -- 172.21.15.38:0/2916381074 >> v1:172.21.15.89:6789/0 conn(0x7f02dc06dd70 legacy=0x7f02dc159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:08.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.736+0000 7f02db7fe640 1 -- 172.21.15.38:0/2916381074 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc15ad20 con 0x7f02dc15a6c0 2023-12-22T08:51:08.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.738+0000 7f02db7fe640 1 --2- 172.21.15.38:0/2916381074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc15a6c0 0x7f02dc156a80 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f02dc06ee00 tx=0x7f02d402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79318d37639b10f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:08.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.738+0000 7f02da7fc640 1 -- 172.21.15.38:0/2916381074 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d402ca80 con 0x7f02dc15a6c0 2023-12-22T08:51:08.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.738+0000 7f02da7fc640 1 -- 172.21.15.38:0/2916381074 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d402cbe0 con 0x7f02dc15a6c0 2023-12-22T08:51:08.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.738+0000 7f02da7fc640 1 -- 172.21.15.38:0/2916381074 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d40343f0 con 0x7f02dc15a6c0 2023-12-22T08:51:08.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.738+0000 7f02dbfff640 1 -- 172.21.15.38:0/2916381074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc15a6c0 msgr2=0x7f02dc156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:08.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.738+0000 7f02dbfff640 1 --2- 172.21.15.38:0/2916381074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc15a6c0 0x7f02dc156a80 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f02dc06ee00 tx=0x7f02d402bee0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.739+0000 7f02dbfff640 1 -- 172.21.15.38:0/2916381074 shutdown_connections 2023-12-22T08:51:08.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.739+0000 7f02dbfff640 1 --2- 172.21.15.38:0/2916381074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc15a6c0 0x7f02dc156a80 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.739+0000 7f02dbfff640 1 --2- 172.21.15.38:0/2916381074 >> v2:172.21.15.89:3300/0 conn(0x7f02dc0cc250 0x7f02dc06d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.739+0000 7f02dbfff640 1 -- 172.21.15.38:0/2916381074 >> 172.21.15.38:0/2916381074 conn(0x7f02dc0b1f70 msgr2=0x7f02dc0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:08.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.739+0000 7f02dbfff640 1 -- 172.21.15.38:0/2916381074 shutdown_connections 2023-12-22T08:51:08.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.739+0000 7f02dbfff640 1 -- 172.21.15.38:0/2916381074 wait complete. 2023-12-22T08:51:08.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.740+0000 7f02dbfff640 1 Processor -- start 2023-12-22T08:51:08.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.741+0000 7f02dbfff640 1 -- start start 2023-12-22T08:51:08.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.741+0000 7f02dbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc06dd70 0x7f02dc0ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.741+0000 7f02dbfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0cc250 0x7f02dc15b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.742+0000 7f02dbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02dc15a6c0 0x7f02dc06cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.742+0000 7f02dbfff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0caf20 con 0x7f02dc06dd70 2023-12-22T08:51:08.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.742+0000 7f02dbfff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc15ce80 con 0x7f02dc15a6c0 2023-12-22T08:51:08.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.742+0000 7f02dbfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc15d160 con 0x7f02dc0cc250 2023-12-22T08:51:08.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.742+0000 7f02daffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc06dd70 0x7f02dc0ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:08.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.742+0000 7f02daffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc06dd70 0x7f02dc0ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35582/0 (socket says 172.21.15.38:35582) 2023-12-22T08:51:08.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.742+0000 7f02daffd640 1 -- 172.21.15.38:0/2806212219 learned_addr learned my addr 172.21.15.38:0/2806212219 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:08.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.742+0000 7f02daffd640 1 -- 172.21.15.38:0/2806212219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0cc250 msgr2=0x7f02dc15b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:08.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.742+0000 7f02daffd640 1 --2- 172.21.15.38:0/2806212219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0cc250 0x7f02dc15b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.742+0000 7f02daffd640 1 -- 172.21.15.38:0/2806212219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02dc15a6c0 msgr2=0x7f02dc06cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:08.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.742+0000 7f02daffd640 1 --2- 172.21.15.38:0/2806212219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02dc15a6c0 0x7f02dc06cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.742+0000 7f02daffd640 1 -- 172.21.15.38:0/2806212219 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d4009b30 con 0x7f02dc06dd70 2023-12-22T08:51:08.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.743+0000 7f02daffd640 1 --2- 172.21.15.38:0/2806212219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc06dd70 0x7f02dc0ca9e0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00d800 tx=0x7f02cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:08.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.743+0000 7f02d37fe640 1 -- 172.21.15.38:0/2806212219 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc00b6c0 con 0x7f02dc06dd70 2023-12-22T08:51:08.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.743+0000 7f02d37fe640 1 -- 172.21.15.38:0/2806212219 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc00b820 con 0x7f02dc06dd70 2023-12-22T08:51:08.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.743+0000 7f02d37fe640 1 -- 172.21.15.38:0/2806212219 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc00bbb0 con 0x7f02dc06dd70 2023-12-22T08:51:08.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.743+0000 7f02dbfff640 1 -- 172.21.15.38:0/2806212219 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02dc15d440 con 0x7f02dc06dd70 2023-12-22T08:51:08.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.743+0000 7f02dbfff640 1 -- 172.21.15.38:0/2806212219 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc15da00 con 0x7f02dc06dd70 2023-12-22T08:51:08.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.744+0000 7f02dbfff640 1 -- 172.21.15.38:0/2806212219 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02dc15dbc0 con 0x7f02dc06dd70 2023-12-22T08:51:08.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.745+0000 7f02d37fe640 1 -- 172.21.15.38:0/2806212219 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f02cc00bd10 con 0x7f02dc06dd70 2023-12-22T08:51:08.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.746+0000 7f02d37fe640 1 --2- 172.21.15.38:0/2806212219 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02bc06a430 0x7f02bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:08.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.746+0000 7f02d37fe640 1 -- 172.21.15.38:0/2806212219 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02cc088f00 con 0x7f02dc06dd70 2023-12-22T08:51:08.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.747+0000 7f02d3fff640 1 --2- 172.21.15.38:0/2806212219 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02bc06a430 0x7f02bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:08.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.748+0000 7f02d3fff640 1 --2- 172.21.15.38:0/2806212219 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02bc06a430 0x7f02bc06c8f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f02dc151d30 tx=0x7f02c40079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:08.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.751+0000 7f02d37fe640 1 -- 172.21.15.38:0/2806212219 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f02cc054450 con 0x7f02dc06dd70 2023-12-22T08:51:08.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.987+0000 7f02dbfff640 1 -- 172.21.15.38:0/2806212219 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02dc0cd720 con 0x7f02dc06dd70 2023-12-22T08:51:08.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.989+0000 7f02d37fe640 1 -- 172.21.15.38:0/2806212219 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4641 (secure 0 0 0) 0x7f02cc057a70 con 0x7f02dc06dd70 2023-12-22T08:51:08.990 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:08.990 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/52711154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":52711154},{"type":"v1","addr":"172.21.15.89:6837","nonce":52711154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2264719173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2264719173},{"type":"v1","addr":"172.21.15.38:6835","nonce":2264719173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3546762659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3546762659},{"type":"v1","addr":"172.21.15.89:6836","nonce":3546762659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:48:44.902723+0000","modified":"2023-12-22T08:48:48.440490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8148":{"gid":8148,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/885304998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":885304998},{"type":"v1","addr":"172.21.15.38:6833","nonce":885304998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-22T08:51:08.990 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 70 2023-12-22T08:51:08.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.991+0000 7f02dbfff640 1 -- 172.21.15.38:0/2806212219 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02bc06a430 msgr2=0x7f02bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:08.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.991+0000 7f02dbfff640 1 --2- 172.21.15.38:0/2806212219 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02bc06a430 0x7f02bc06c8f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f02dc151d30 tx=0x7f02c40079b0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.991+0000 7f02dbfff640 1 -- 172.21.15.38:0/2806212219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc06dd70 msgr2=0x7f02dc0ca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:08.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.991+0000 7f02dbfff640 1 --2- 172.21.15.38:0/2806212219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc06dd70 0x7f02dc0ca9e0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00d800 tx=0x7f02cc00dcc0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.991+0000 7f02dbfff640 1 -- 172.21.15.38:0/2806212219 shutdown_connections 2023-12-22T08:51:08.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.991+0000 7f02dbfff640 1 --2- 172.21.15.38:0/2806212219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02dc15a6c0 0x7f02dc06cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.992+0000 7f02dbfff640 1 --2- 172.21.15.38:0/2806212219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02dc0cc250 0x7f02dc15b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.992+0000 7f02dbfff640 1 --2- 172.21.15.38:0/2806212219 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f02bc06a430 0x7f02bc06c8f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.992+0000 7f02dbfff640 1 --2- 172.21.15.38:0/2806212219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02dc06dd70 0x7f02dc0ca9e0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:08.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.992+0000 7f02dbfff640 1 -- 172.21.15.38:0/2806212219 >> 172.21.15.38:0/2806212219 conn(0x7f02dc0b1f70 msgr2=0x7f02dc0af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:08.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.992+0000 7f02dbfff640 1 -- 172.21.15.38:0/2806212219 shutdown_connections 2023-12-22T08:51:08.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:08.992+0000 7f02dbfff640 1 -- 172.21.15.38:0/2806212219 wait complete. 2023-12-22T08:51:09.013 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:51:09.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.239+0000 7fe3f359e640 1 Processor -- start 2023-12-22T08:51:09.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.239+0000 7fe3f359e640 1 -- start start 2023-12-22T08:51:09.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.241+0000 7fe3f359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f415d350 0x7fe3f40d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:09.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.241+0000 7fe3f359e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3f40ce560 0x7fe3f40ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:09.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.241+0000 7fe3f359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f40cd970 con 0x7fe3f40d0c00 2023-12-22T08:51:09.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.241+0000 7fe3f359e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f40cf320 con 0x7fe3f40ce560 2023-12-22T08:51:09.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.241+0000 7fe3f359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f40cf600 con 0x7fe3f415d350 2023-12-22T08:51:09.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.241+0000 7fe3f2d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3f40ce560 0x7fe3f40ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:09.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.241+0000 7fe3f2d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe3f40ce560 0x7fe3f40ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35598/0 (socket says 172.21.15.38:35598) 2023-12-22T08:51:09.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.241+0000 7fe3f2d9d640 1 -- 172.21.15.38:0/1862584213 learned_addr learned my addr 172.21.15.38:0/1862584213 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:09.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.241+0000 7fe3f259c640 1 --2- 172.21.15.38:0/1862584213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f415d350 0x7fe3f40d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:09.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.242+0000 7fe3f2d9d640 1 -- 172.21.15.38:0/1862584213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f415d350 msgr2=0x7fe3f40d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:09.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.242+0000 7fe3f2d9d640 1 --2- 172.21.15.38:0/1862584213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f415d350 0x7fe3f40d06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.242+0000 7fe3f2d9d640 1 -- 172.21.15.38:0/1862584213 >> v1:172.21.15.89:6789/0 conn(0x7fe3f40d0c00 legacy=0x7fe3f40cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:09.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.242+0000 7fe3f2d9d640 1 -- 172.21.15.38:0/1862584213 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f40cf8e0 con 0x7fe3f40ce560 2023-12-22T08:51:09.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.243+0000 7fe3f2d9d640 1 --2- 172.21.15.38:0/1862584213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3f40ce560 0x7fe3f40ca770 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009e80 tx=0x7fe3ec02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648c98a882c40997 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:09.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.243+0000 7fe3f1d9b640 1 -- 172.21.15.38:0/1862584213 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec02ca50 con 0x7fe3f40ce560 2023-12-22T08:51:09.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.243+0000 7fe3f1d9b640 1 -- 172.21.15.38:0/1862584213 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec02cbb0 con 0x7fe3f40ce560 2023-12-22T08:51:09.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.243+0000 7fe3f1d9b640 1 -- 172.21.15.38:0/1862584213 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec0343f0 con 0x7fe3f40ce560 2023-12-22T08:51:09.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.244+0000 7fe3f359e640 1 -- 172.21.15.38:0/1862584213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3f40ce560 msgr2=0x7fe3f40ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:09.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.244+0000 7fe3f359e640 1 --2- 172.21.15.38:0/1862584213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3f40ce560 0x7fe3f40ca770 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009e80 tx=0x7fe3ec02beb0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.244+0000 7fe3f359e640 1 -- 172.21.15.38:0/1862584213 shutdown_connections 2023-12-22T08:51:09.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.244+0000 7fe3f359e640 1 --2- 172.21.15.38:0/1862584213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3f40ce560 0x7fe3f40ca770 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.244+0000 7fe3f359e640 1 --2- 172.21.15.38:0/1862584213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f415d350 0x7fe3f40d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.244+0000 7fe3f359e640 1 -- 172.21.15.38:0/1862584213 >> 172.21.15.38:0/1862584213 conn(0x7fe3f40d14b0 msgr2=0x7fe3f40d18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:09.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.244+0000 7fe3f359e640 1 -- 172.21.15.38:0/1862584213 shutdown_connections 2023-12-22T08:51:09.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.244+0000 7fe3f359e640 1 -- 172.21.15.38:0/1862584213 wait complete. 2023-12-22T08:51:09.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.246+0000 7fe3f359e640 1 Processor -- start 2023-12-22T08:51:09.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.246+0000 7fe3f359e640 1 -- start start 2023-12-22T08:51:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.247+0000 7fe3f359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f40ce560 0x7fe3f41f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.247+0000 7fe3f359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3f40d0c00 0x7fe3f4160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.247+0000 7fe3f359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3f415d350 0x7fe3f4159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.247+0000 7fe3f359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f4158c80 con 0x7fe3f40d0c00 2023-12-22T08:51:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.247+0000 7fe3f359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f4158f60 con 0x7fe3f415d350 2023-12-22T08:51:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.247+0000 7fe3f359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f4159240 con 0x7fe3f40ce560 2023-12-22T08:51:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.247+0000 7fe3ebfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3f40d0c00 0x7fe3f4160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.247+0000 7fe3ebfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3f40d0c00 0x7fe3f4160070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35606/0 (socket says 172.21.15.38:35606) 2023-12-22T08:51:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.247+0000 7fe3ebfff640 1 -- 172.21.15.38:0/1719646687 learned_addr learned my addr 172.21.15.38:0/1719646687 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.248+0000 7fe3ebfff640 1 -- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f40ce560 msgr2=0x7fe3f41f31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.248+0000 7fe3f259c640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f40ce560 0x7fe3f41f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.248+0000 7fe3f2d9d640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3f415d350 0x7fe3f4159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.248+0000 7fe3ebfff640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f40ce560 0x7fe3f41f31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.248+0000 7fe3ebfff640 1 -- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3f415d350 msgr2=0x7fe3f4159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.248+0000 7fe3ebfff640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3f415d350 0x7fe3f4159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.248+0000 7fe3ebfff640 1 -- 172.21.15.38:0/1719646687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec009b30 con 0x7fe3f40d0c00 2023-12-22T08:51:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.248+0000 7fe3ebfff640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3f40d0c00 0x7fe3f4160070 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00c400 tx=0x7fe3dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.248+0000 7fe3eaffd640 1 -- 172.21.15.38:0/1719646687 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc011790 con 0x7fe3f40d0c00 2023-12-22T08:51:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.248+0000 7fe3eaffd640 1 -- 172.21.15.38:0/1719646687 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc011930 con 0x7fe3f40d0c00 2023-12-22T08:51:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.248+0000 7fe3f359e640 1 -- 172.21.15.38:0/1719646687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f4159520 con 0x7fe3f40d0c00 2023-12-22T08:51:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.248+0000 7fe3eaffd640 1 -- 172.21.15.38:0/1719646687 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc011ce0 con 0x7fe3f40d0c00 2023-12-22T08:51:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.248+0000 7fe3f359e640 1 -- 172.21.15.38:0/1719646687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f41f36f0 con 0x7fe3f40d0c00 2023-12-22T08:51:09.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.250+0000 7fe3f359e640 1 -- 172.21.15.38:0/1719646687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f4061910 con 0x7fe3f40d0c00 2023-12-22T08:51:09.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.250+0000 7fe3eaffd640 1 -- 172.21.15.38:0/1719646687 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe3dc01c460 con 0x7fe3f40d0c00 2023-12-22T08:51:09.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.251+0000 7fe3eaffd640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe3d406a460 0x7fe3d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:09.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.252+0000 7fe3eaffd640 1 -- 172.21.15.38:0/1719646687 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3dc088850 con 0x7fe3f40d0c00 2023-12-22T08:51:09.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.252+0000 7fe3f259c640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe3d406a460 0x7fe3d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:09.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.253+0000 7fe3f259c640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe3d406a460 0x7fe3d406c920 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4006fd0 tx=0x7fe3e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:09.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.256+0000 7fe3eaffd640 1 -- 172.21.15.38:0/1719646687 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe3dc053e40 con 0x7fe3f40d0c00 2023-12-22T08:51:09.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.495+0000 7fe3f359e640 1 -- 172.21.15.38:0/1719646687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3f4158dc0 con 0x7fe3f40d0c00 2023-12-22T08:51:09.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.496+0000 7fe3eaffd640 1 -- 172.21.15.38:0/1719646687 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4641 (secure 0 0 0) 0x7fe3f4158dc0 con 0x7fe3f40d0c00 2023-12-22T08:51:09.497 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:09.497 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/52711154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":52711154},{"type":"v1","addr":"172.21.15.89:6837","nonce":52711154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2264719173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2264719173},{"type":"v1","addr":"172.21.15.38:6835","nonce":2264719173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3546762659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3546762659},{"type":"v1","addr":"172.21.15.89:6836","nonce":3546762659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:48:44.902723+0000","modified":"2023-12-22T08:48:48.440490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8148":{"gid":8148,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6833/885304998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":885304998},{"type":"v1","addr":"172.21.15.38:6833","nonce":885304998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-22T08:51:09.497 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 70 2023-12-22T08:51:09.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.499+0000 7fe3f359e640 1 -- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe3d406a460 msgr2=0x7fe3d406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:09.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.499+0000 7fe3f359e640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe3d406a460 0x7fe3d406c920 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4006fd0 tx=0x7fe3e4008040 comp rx=0 tx=0).stop 2023-12-22T08:51:09.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.499+0000 7fe3f359e640 1 -- 172.21.15.38:0/1719646687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3f40d0c00 msgr2=0x7fe3f4160070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:09.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.499+0000 7fe3f359e640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3f40d0c00 0x7fe3f4160070 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00c400 tx=0x7fe3dc00c8c0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.499+0000 7fe3f359e640 1 -- 172.21.15.38:0/1719646687 shutdown_connections 2023-12-22T08:51:09.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.499+0000 7fe3f359e640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3f415d350 0x7fe3f4159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.499+0000 7fe3f359e640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe3d406a460 0x7fe3d406c920 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.499+0000 7fe3f359e640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3f40d0c00 0x7fe3f4160070 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.499+0000 7fe3f359e640 1 --2- 172.21.15.38:0/1719646687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3f40ce560 0x7fe3f41f31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.499+0000 7fe3f359e640 1 -- 172.21.15.38:0/1719646687 >> 172.21.15.38:0/1719646687 conn(0x7fe3f40d14b0 msgr2=0x7fe3f41567c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:09.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.499+0000 7fe3f359e640 1 -- 172.21.15.38:0/1719646687 shutdown_connections 2023-12-22T08:51:09.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.499+0000 7fe3f359e640 1 -- 172.21.15.38:0/1719646687 wait complete. 2023-12-22T08:51:09.520 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:51:09.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.744+0000 7efcc1e73640 1 Processor -- start 2023-12-22T08:51:09.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.744+0000 7efcc1e73640 1 -- start start 2023-12-22T08:51:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.746+0000 7efcc1e73640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcbc06d210 0x7efcbc15e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.746+0000 7efcc1e73640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efcbc0cb4c0 0x7efcbc159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.746+0000 7efcc1e73640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcbc0706d0 con 0x7efcbc06d5f0 2023-12-22T08:51:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.746+0000 7efcc1e73640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcbc0cbf40 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.746+0000 7efcc1e73640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0ce840 con 0x7efcbc06d210 2023-12-22T08:51:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.747+0000 7efcb3fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efcbc0cb4c0 0x7efcbc159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.747+0000 7efcc1672640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efcbc06d5f0 0x7efcbc0cc150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46558/0 (socket says 172.21.15.38:46558) 2023-12-22T08:51:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.747+0000 7efcc1672640 1 -- 172.21.15.38:0/3832677216 learned_addr learned my addr 172.21.15.38:0/3832677216 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.747+0000 7efcc0e71640 1 --2- 172.21.15.38:0/3832677216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcbc06d210 0x7efcbc15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:09.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.747+0000 7efcb3fff640 1 -- 172.21.15.38:0/3832677216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcbc06d210 msgr2=0x7efcbc15e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.747+0000 7efcb3fff640 1 --2- 172.21.15.38:0/3832677216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcbc06d210 0x7efcbc15e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.747+0000 7efcb3fff640 1 -- 172.21.15.38:0/3832677216 >> v1:172.21.15.38:6789/0 conn(0x7efcbc06d5f0 legacy=0x7efcbc0cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.747+0000 7efcb3fff640 1 -- 172.21.15.38:0/3832677216 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc0ceb20 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.748+0000 7efcb3fff640 1 --2- 172.21.15.38:0/3832677216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcbc0cb4c0 0x7efcbc159ce0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7efcac0097a0 tx=0x7efcac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8efe038751728d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:09.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.749+0000 7efcb37fe640 1 -- 172.21.15.38:0/3832677216 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac031830 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.749+0000 7efcb37fe640 1 -- 172.21.15.38:0/3832677216 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac031990 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.749+0000 7efcb37fe640 1 -- 172.21.15.38:0/3832677216 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac031d20 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.749+0000 7efcc1e73640 1 -- 172.21.15.38:0/3832677216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcbc0cb4c0 msgr2=0x7efcbc159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.749+0000 7efcc1e73640 1 --2- 172.21.15.38:0/3832677216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcbc0cb4c0 0x7efcbc159ce0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7efcac0097a0 tx=0x7efcac02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.749+0000 7efcc1e73640 1 -- 172.21.15.38:0/3832677216 shutdown_connections 2023-12-22T08:51:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.749+0000 7efcc1e73640 1 --2- 172.21.15.38:0/3832677216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcbc0cb4c0 0x7efcbc159ce0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.749+0000 7efcc1e73640 1 --2- 172.21.15.38:0/3832677216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcbc06d210 0x7efcbc15e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.749+0000 7efcc1e73640 1 -- 172.21.15.38:0/3832677216 >> 172.21.15.38:0/3832677216 conn(0x7efcbc0b1f70 msgr2=0x7efcbc0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.749+0000 7efcc1e73640 1 -- 172.21.15.38:0/3832677216 shutdown_connections 2023-12-22T08:51:09.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.749+0000 7efcc1e73640 1 -- 172.21.15.38:0/3832677216 wait complete. 2023-12-22T08:51:09.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.751+0000 7efcc1e73640 1 Processor -- start 2023-12-22T08:51:09.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.751+0000 7efcc1e73640 1 -- start start 2023-12-22T08:51:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.752+0000 7efcc1e73640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcbc06d210 0x7efcbc0c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.752+0000 7efcc1e73640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc06d5f0 0x7efcbc0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:09.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.752+0000 7efcc1e73640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcbc0cb4c0 0x7efcbc150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:09.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.752+0000 7efcc1e73640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0c3f30 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.752+0000 7efcc1e73640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0c9d50 con 0x7efcbc06d5f0 2023-12-22T08:51:09.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.752+0000 7efcc1e73640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0ca030 con 0x7efcbc06d210 2023-12-22T08:51:09.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.753+0000 7efcc1672640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcbc0cb4c0 0x7efcbc150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:09.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.753+0000 7efcc1672640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcbc0cb4c0 0x7efcbc150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35618/0 (socket says 172.21.15.38:35618) 2023-12-22T08:51:09.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.753+0000 7efcc1672640 1 -- 172.21.15.38:0/3479783330 learned_addr learned my addr 172.21.15.38:0/3479783330 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:09.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.753+0000 7efcc0e71640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcbc06d210 0x7efcbc0c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:09.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.753+0000 7efcb3fff640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc06d5f0 0x7efcbc0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:09.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.753+0000 7efcc1672640 1 -- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcbc06d210 msgr2=0x7efcbc0c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.753+0000 7efcc1672640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcbc06d210 0x7efcbc0c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.753+0000 7efcc1672640 1 -- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc06d5f0 msgr2=0x7efcbc0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.753+0000 7efcc1672640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc06d5f0 0x7efcbc0c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.753+0000 7efcc1672640 1 -- 172.21.15.38:0/3479783330 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac009400 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.753+0000 7efcc0e71640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcbc06d210 0x7efcbc0c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.754+0000 7efcc1672640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcbc0cb4c0 0x7efcbc150c90 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7efcb400c420 tx=0x7efcb400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.754+0000 7efcb17fa640 1 -- 172.21.15.38:0/3479783330 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb4005ce0 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.754+0000 7efcb17fa640 1 -- 172.21.15.38:0/3479783330 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb4005e40 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.754+0000 7efcb17fa640 1 -- 172.21.15.38:0/3479783330 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40072d0 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.754+0000 7efcc1e73640 1 -- 172.21.15.38:0/3479783330 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcbc0ca310 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.754+0000 7efcc1e73640 1 -- 172.21.15.38:0/3479783330 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc0ca8d0 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.755+0000 7efcc1e73640 1 -- 172.21.15.38:0/3479783330 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcbc061910 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.756+0000 7efcb17fa640 1 -- 172.21.15.38:0/3479783330 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efcb40074f0 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.757+0000 7efcb17fa640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efca806a430 0x7efca806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.757+0000 7efcb17fa640 1 -- 172.21.15.38:0/3479783330 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcb4087dd0 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.758+0000 7efcc0e71640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efca806a430 0x7efca806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:09.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.759+0000 7efcc0e71640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efca806a430 0x7efca806c8f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efcb8007330 tx=0x7efcb800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:09.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.762+0000 7efcb17fa640 1 -- 172.21.15.38:0/3479783330 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efcb4053470 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.956+0000 7efcc1e73640 1 -- 172.21.15.38:0/3479783330 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcbc0caac0 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.958+0000 7efcb17fa640 1 -- 172.21.15.38:0/3479783330 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+16019 (secure 0 0 0) 0x7efcb4017090 con 0x7efcbc0cb4c0 2023-12-22T08:51:09.959 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:09.959 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":161,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:51:06.348916+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:48:42.499151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-22T08:48:43.921718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:51:09.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.960+0000 7efcc1e73640 1 -- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efca806a430 msgr2=0x7efca806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:09.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.960+0000 7efcc1e73640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efca806a430 0x7efca806c8f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efcb8007330 tx=0x7efcb800b040 comp rx=0 tx=0).stop 2023-12-22T08:51:09.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.960+0000 7efcc1e73640 1 -- 172.21.15.38:0/3479783330 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcbc0cb4c0 msgr2=0x7efcbc150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:09.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.960+0000 7efcc1e73640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcbc0cb4c0 0x7efcbc150c90 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7efcb400c420 tx=0x7efcb400c8e0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.960+0000 7efcc1e73640 1 -- 172.21.15.38:0/3479783330 shutdown_connections 2023-12-22T08:51:09.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.960+0000 7efcc1e73640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efca806a430 0x7efca806c8f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.960+0000 7efcc1e73640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcbc0cb4c0 0x7efcbc150c90 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.960+0000 7efcc1e73640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcbc06d5f0 0x7efcbc0c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.961+0000 7efcc1e73640 1 --2- 172.21.15.38:0/3479783330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcbc06d210 0x7efcbc0c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:09.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.961+0000 7efcc1e73640 1 -- 172.21.15.38:0/3479783330 >> 172.21.15.38:0/3479783330 conn(0x7efcbc0b1f70 msgr2=0x7efcbc070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:09.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.961+0000 7efcc1e73640 1 -- 172.21.15.38:0/3479783330 shutdown_connections 2023-12-22T08:51:09.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:09.961+0000 7efcc1e73640 1 -- 172.21.15.38:0/3479783330 wait complete. 2023-12-22T08:51:09.982 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T08:51:10.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.211+0000 7feae0cee640 1 Processor -- start 2023-12-22T08:51:10.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.211+0000 7feae0cee640 1 -- start start 2023-12-22T08:51:10.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.213+0000 7feae0cee640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feadc0b24b0 0x7feadc070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.213+0000 7feae0cee640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc1450f0 con 0x7feadc0b2050 2023-12-22T08:51:10.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.213+0000 7feae0cee640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc0cc840 con 0x7feadc144d10 2023-12-22T08:51:10.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.213+0000 7feae0cee640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc0ce010 con 0x7feadc0b24b0 2023-12-22T08:51:10.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.213+0000 7fead1d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7feadc0b2050 0x7feadc070800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46574/0 (socket says 172.21.15.38:46574) 2023-12-22T08:51:10.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.213+0000 7fead1d9b640 1 -- 172.21.15.38:0/2277522730 learned_addr learned my addr 172.21.15.38:0/2277522730 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:10.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.214+0000 7feadad9d640 1 --2- 172.21.15.38:0/2277522730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feadc0b24b0 0x7feadc070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.214+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290573144 0 0) 0x7feadc1450f0 con 0x7feadc0b2050 2023-12-22T08:51:10.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.214+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feac8003520 con 0x7feadc0b2050 2023-12-22T08:51:10.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.214+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2989947331 0 0) 0x7feac8003520 con 0x7feadc0b2050 2023-12-22T08:51:10.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.214+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feadc0b24b0 msgr2=0x7feadc070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:10.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.214+0000 7fead9d9b640 1 --2- 172.21.15.38:0/2277522730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feadc0b24b0 0x7feadc070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.214+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 >> v1:172.21.15.89:6789/0 conn(0x7feadc144d10 legacy=0x7feadc0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.214+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc0ce2f0 con 0x7feadc0b2050 2023-12-22T08:51:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.214+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7feac4001690 con 0x7feadc0b2050 2023-12-22T08:51:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.214+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 >> v1:172.21.15.38:6789/0 conn(0x7feadc0b2050 legacy=0x7feadc070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.214+0000 7fead9d9b640 1 --2- 172.21.15.38:0/2277522730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feac80039a0 0x7feac8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.214+0000 7fead9d9b640 1 --2- 172.21.15.38:0/2277522730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feadc0b24b0 0x7feac80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.214+0000 7fead9d9b640 1 --2- 172.21.15.38:0/2277522730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feac8004d00 0x7feac8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.215+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc0ce010 con 0x7feac8004d00 2023-12-22T08:51:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.215+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac800ba60 con 0x7feac80039a0 2023-12-22T08:51:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.215+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac800bc20 con 0x7feadc0b24b0 2023-12-22T08:51:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.215+0000 7feadad9d640 1 --2- 172.21.15.38:0/2277522730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feac8004d00 0x7feac8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.215+0000 7fead1d9b640 1 --2- 172.21.15.38:0/2277522730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feadc0b24b0 0x7feac80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.215+0000 7feada59c640 1 --2- 172.21.15.38:0/2277522730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feac80039a0 0x7feac8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.215+0000 7feadad9d640 1 -- 172.21.15.38:0/2277522730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feadc0b24b0 msgr2=0x7feac80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:10.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.215+0000 7feadad9d640 1 --2- 172.21.15.38:0/2277522730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feadc0b24b0 0x7feac80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.215+0000 7feadad9d640 1 -- 172.21.15.38:0/2277522730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feac80039a0 msgr2=0x7feac8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:10.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.215+0000 7feadad9d640 1 --2- 172.21.15.38:0/2277522730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feac80039a0 0x7feac8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.215+0000 7feadad9d640 1 -- 172.21.15.38:0/2277522730 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac8003520 con 0x7feac8004d00 2023-12-22T08:51:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.216+0000 7feadad9d640 1 --2- 172.21.15.38:0/2277522730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feac8004d00 0x7feac8005180 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fead4009a90 tx=0x7feac80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f3c05921e68b8c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.217+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead402c680 con 0x7feac8004d00 2023-12-22T08:51:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.217+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead402c7e0 con 0x7feac8004d00 2023-12-22T08:51:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.217+0000 7fead9d9b640 1 -- 172.21.15.38:0/2277522730 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead402cb70 con 0x7feac8004d00 2023-12-22T08:51:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.217+0000 7feae0cee640 1 -- 172.21.15.38:0/2277522730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feac8004d00 msgr2=0x7feac8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.217+0000 7feae0cee640 1 --2- 172.21.15.38:0/2277522730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feac8004d00 0x7feac8005180 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fead4009a90 tx=0x7feac80057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.217+0000 7feadad9d640 1 -- 172.21.15.38:0/2277522730 reap_dead start 2023-12-22T08:51:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.217+0000 7feae0cee640 1 -- 172.21.15.38:0/2277522730 shutdown_connections 2023-12-22T08:51:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.217+0000 7feae0cee640 1 -- 172.21.15.38:0/2277522730 >> 172.21.15.38:0/2277522730 conn(0x7feadc0cf070 msgr2=0x7feadc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.217+0000 7feae0cee640 1 -- 172.21.15.38:0/2277522730 shutdown_connections 2023-12-22T08:51:10.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.217+0000 7feae0cee640 1 -- 172.21.15.38:0/2277522730 wait complete. 2023-12-22T08:51:10.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.219+0000 7feae0cee640 1 Processor -- start 2023-12-22T08:51:10.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.219+0000 7feae0cee640 1 -- start start 2023-12-22T08:51:10.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.220+0000 7feae0cee640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feac8004d00 0x7feadc1385e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.220+0000 7feae0cee640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feadc06cdd0 0x7feadc06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.220+0000 7feae0cee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feadc070c10 0x7feadc071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.220+0000 7feae0cee640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc0715d0 con 0x7feadc06cdd0 2023-12-22T08:51:10.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.220+0000 7feae0cee640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc13b8b0 con 0x7feadc070c10 2023-12-22T08:51:10.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.220+0000 7feae0cee640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc13bd40 con 0x7feac8004d00 2023-12-22T08:51:10.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.221+0000 7fead1d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feadc06cdd0 0x7feadc06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.221+0000 7fead1d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feadc06cdd0 0x7feadc06d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35636/0 (socket says 172.21.15.38:35636) 2023-12-22T08:51:10.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.221+0000 7fead1d9b640 1 -- 172.21.15.38:0/1877076454 learned_addr learned my addr 172.21.15.38:0/1877076454 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:10.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.221+0000 7feadad9d640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feadc070c10 0x7feadc071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.221+0000 7feada59c640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feac8004d00 0x7feadc1385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.221+0000 7fead1d9b640 1 -- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feac8004d00 msgr2=0x7feadc1385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:10.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.221+0000 7fead1d9b640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feac8004d00 0x7feadc1385e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.221+0000 7fead1d9b640 1 -- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feadc070c10 msgr2=0x7feadc071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:10.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.221+0000 7fead1d9b640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feadc070c10 0x7feadc071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.221+0000 7fead1d9b640 1 -- 172.21.15.38:0/1877076454 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc138b20 con 0x7feadc06cdd0 2023-12-22T08:51:10.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.222+0000 7fead1d9b640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feadc06cdd0 0x7feadc06d720 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7feac400e7b0 tx=0x7feac400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:10.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.222+0000 7fead37fe640 1 -- 172.21.15.38:0/1877076454 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac400ee60 con 0x7feadc06cdd0 2023-12-22T08:51:10.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.222+0000 7fead37fe640 1 -- 172.21.15.38:0/1877076454 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac400c870 con 0x7feadc06cdd0 2023-12-22T08:51:10.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.222+0000 7fead37fe640 1 -- 172.21.15.38:0/1877076454 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac400cc00 con 0x7feadc06cdd0 2023-12-22T08:51:10.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.222+0000 7feae0cee640 1 -- 172.21.15.38:0/1877076454 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc13aca0 con 0x7feadc06cdd0 2023-12-22T08:51:10.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.222+0000 7feae0cee640 1 -- 172.21.15.38:0/1877076454 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc13b260 con 0x7feadc06cdd0 2023-12-22T08:51:10.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.223+0000 7feae0cee640 1 -- 172.21.15.38:0/1877076454 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc061910 con 0x7feadc06cdd0 2023-12-22T08:51:10.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.224+0000 7fead37fe640 1 -- 172.21.15.38:0/1877076454 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feac401d460 con 0x7feadc06cdd0 2023-12-22T08:51:10.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.225+0000 7fead37fe640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feabc06a430 0x7feabc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.226+0000 7fead37fe640 1 -- 172.21.15.38:0/1877076454 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feac40888e0 con 0x7feadc06cdd0 2023-12-22T08:51:10.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.226+0000 7feada59c640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feabc06a430 0x7feabc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.227+0000 7feada59c640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feabc06a430 0x7feabc06c8f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7feacc007fd0 tx=0x7feacc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:10.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.230+0000 7fead37fe640 1 -- 172.21.15.38:0/1877076454 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feac4053ef0 con 0x7feadc06cdd0 2023-12-22T08:51:10.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.465+0000 7feae0cee640 1 -- 172.21.15.38:0/1877076454 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feadc0cb8e0 con 0x7feadc06cdd0 2023-12-22T08:51:10.468 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:51:10.467+0000 7f0a26ee3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T08:51:10.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.486+0000 7fead37fe640 1 -- 172.21.15.38:0/1877076454 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7feac4057510 con 0x7feadc06cdd0 2023-12-22T08:51:10.489 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T08:51:10.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.489+0000 7feae0cee640 1 -- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feabc06a430 msgr2=0x7feabc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:10.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.489+0000 7feae0cee640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feabc06a430 0x7feabc06c8f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7feacc007fd0 tx=0x7feacc009040 comp rx=0 tx=0).stop 2023-12-22T08:51:10.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.489+0000 7feae0cee640 1 -- 172.21.15.38:0/1877076454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feadc06cdd0 msgr2=0x7feadc06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:10.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.489+0000 7feae0cee640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feadc06cdd0 0x7feadc06d720 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7feac400e7b0 tx=0x7feac400ec70 comp rx=0 tx=0).stop 2023-12-22T08:51:10.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.489+0000 7feae0cee640 1 -- 172.21.15.38:0/1877076454 shutdown_connections 2023-12-22T08:51:10.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.489+0000 7feae0cee640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feadc070c10 0x7feadc071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.489+0000 7feae0cee640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feabc06a430 0x7feabc06c8f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.489+0000 7feae0cee640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feadc06cdd0 0x7feadc06d720 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.489+0000 7feae0cee640 1 --2- 172.21.15.38:0/1877076454 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feac8004d00 0x7feadc1385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.489+0000 7feae0cee640 1 -- 172.21.15.38:0/1877076454 >> 172.21.15.38:0/1877076454 conn(0x7feadc0cf070 msgr2=0x7feadc0cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:10.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.489+0000 7feae0cee640 1 -- 172.21.15.38:0/1877076454 shutdown_connections 2023-12-22T08:51:10.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.489+0000 7feae0cee640 1 -- 172.21.15.38:0/1877076454 wait complete. 2023-12-22T08:51:10.511 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T08:51:10.565 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:51:10.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.709+0000 7f7019e51640 1 Processor -- start 2023-12-22T08:51:10.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.709+0000 7f7019e51640 1 -- start start 2023-12-22T08:51:10.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.711+0000 7f7019e51640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f701415b7b0 0x7f70140ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.711+0000 7f7019e51640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f70140ce740 0x7f7014070520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.711+0000 7f7019e51640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70140ceb70 con 0x7f701415b3d0 2023-12-22T08:51:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.711+0000 7f7019e51640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7014070100 con 0x7f70140ce740 2023-12-22T08:51:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.711+0000 7f7019e51640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701406c1e0 con 0x7f701415b7b0 2023-12-22T08:51:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.711+0000 7f7013fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f70140ce740 0x7f7014070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.711+0000 7f700bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f701415b7b0 0x7f70140ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.712+0000 7f7013fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f70140ce740 0x7f7014070520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:56260/0 (socket says 172.21.15.38:56260) 2023-12-22T08:51:10.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.712+0000 7f7013fff640 1 -- 172.21.15.38:0/3455573469 learned_addr learned my addr 172.21.15.38:0/3455573469 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:10.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.712+0000 7f7013fff640 1 -- 172.21.15.38:0/3455573469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f701415b7b0 msgr2=0x7f70140ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:10.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.712+0000 7f7013fff640 1 --2- 172.21.15.38:0/3455573469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f701415b7b0 0x7f70140ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.712+0000 7f7013fff640 1 -- 172.21.15.38:0/3455573469 >> v1:172.21.15.89:6789/0 conn(0x7f701415b3d0 legacy=0x7f70140ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:10.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.712+0000 7f7013fff640 1 -- 172.21.15.38:0/3455573469 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140cd620 con 0x7f70140ce740 2023-12-22T08:51:10.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.714+0000 7f7013fff640 1 --2- 172.21.15.38:0/3455573469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70140ce740 0x7f7014070520 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f700c009e50 tx=0x7f700c02be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f483b56413f2eb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:10.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.714+0000 7f7012ffd640 1 -- 172.21.15.38:0/3455573469 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c02c9d0 con 0x7f70140ce740 2023-12-22T08:51:10.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.714+0000 7f7012ffd640 1 -- 172.21.15.38:0/3455573469 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c02cb30 con 0x7f70140ce740 2023-12-22T08:51:10.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.714+0000 7f7012ffd640 1 -- 172.21.15.38:0/3455573469 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c0343f0 con 0x7f70140ce740 2023-12-22T08:51:10.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.715+0000 7f7019e51640 1 -- 172.21.15.38:0/3455573469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70140ce740 msgr2=0x7f7014070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:10.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.715+0000 7f7019e51640 1 --2- 172.21.15.38:0/3455573469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70140ce740 0x7f7014070520 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f700c009e50 tx=0x7f700c02be30 comp rx=0 tx=0).stop 2023-12-22T08:51:10.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.715+0000 7f7019e51640 1 -- 172.21.15.38:0/3455573469 shutdown_connections 2023-12-22T08:51:10.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.715+0000 7f7019e51640 1 --2- 172.21.15.38:0/3455573469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70140ce740 0x7f7014070520 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.715+0000 7f7019e51640 1 --2- 172.21.15.38:0/3455573469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f701415b7b0 0x7f70140ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.715+0000 7f7019e51640 1 -- 172.21.15.38:0/3455573469 >> 172.21.15.38:0/3455573469 conn(0x7f70140cba10 msgr2=0x7f70140cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:10.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.715+0000 7f7019e51640 1 -- 172.21.15.38:0/3455573469 shutdown_connections 2023-12-22T08:51:10.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.715+0000 7f7019e51640 1 -- 172.21.15.38:0/3455573469 wait complete. 2023-12-22T08:51:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.717+0000 7f7019e51640 1 Processor -- start 2023-12-22T08:51:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.718+0000 7f7019e51640 1 -- start start 2023-12-22T08:51:10.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.719+0000 7f7019e51640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70140ce740 0x7f70141550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.719+0000 7f7019e51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f701415b3d0 0x7f70140c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.719+0000 7f7019e51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f701415b7b0 0x7f70140afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.719+0000 7f7019e51640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140c2a10 con 0x7f701415b3d0 2023-12-22T08:51:10.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.719+0000 7f7019e51640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140c2ba0 con 0x7f701415b7b0 2023-12-22T08:51:10.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.719+0000 7f7019e51640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70140c78b0 con 0x7f70140ce740 2023-12-22T08:51:10.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.719+0000 7f700bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f701415b3d0 0x7f70140c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.719+0000 7f700bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f701415b3d0 0x7f70140c6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35664/0 (socket says 172.21.15.38:35664) 2023-12-22T08:51:10.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.719+0000 7f700bfff640 1 -- 172.21.15.38:0/2936707701 learned_addr learned my addr 172.21.15.38:0/2936707701 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:10.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.720+0000 7f7013fff640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f701415b7b0 0x7f70140afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.720+0000 7f70137fe640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70140ce740 0x7f70141550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.720+0000 7f700bfff640 1 -- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70140ce740 msgr2=0x7f70141550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:10.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.720+0000 7f700bfff640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70140ce740 0x7f70141550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.720+0000 7f700bfff640 1 -- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f701415b7b0 msgr2=0x7f70140afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:10.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.720+0000 7f700bfff640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f701415b7b0 0x7f70140afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.720+0000 7f700bfff640 1 -- 172.21.15.38:0/2936707701 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c009b30 con 0x7f701415b3d0 2023-12-22T08:51:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.720+0000 7f7013fff640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f701415b7b0 0x7f70140afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.720+0000 7f700bfff640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f701415b3d0 0x7f70140c6ec0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00e900 tx=0x7f6ffc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.720+0000 7f7010ff9640 1 -- 172.21.15.38:0/2936707701 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc009660 con 0x7f701415b3d0 2023-12-22T08:51:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.721+0000 7f7010ff9640 1 -- 172.21.15.38:0/2936707701 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc00ca00 con 0x7f701415b3d0 2023-12-22T08:51:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.721+0000 7f7019e51640 1 -- 172.21.15.38:0/2936707701 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70140c7b90 con 0x7f701415b3d0 2023-12-22T08:51:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.721+0000 7f7010ff9640 1 -- 172.21.15.38:0/2936707701 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc00cdb0 con 0x7f701415b3d0 2023-12-22T08:51:10.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.721+0000 7f7019e51640 1 -- 172.21.15.38:0/2936707701 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70140c8150 con 0x7f701415b3d0 2023-12-22T08:51:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.722+0000 7f7019e51640 1 -- 172.21.15.38:0/2936707701 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7014061910 con 0x7f701415b3d0 2023-12-22T08:51:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.723+0000 7f7010ff9640 1 -- 172.21.15.38:0/2936707701 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ffc013470 con 0x7f701415b3d0 2023-12-22T08:51:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.724+0000 7f7010ff9640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ff406a430 0x7f6ff406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:10.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.724+0000 7f7010ff9640 1 -- 172.21.15.38:0/2936707701 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6ffc088e80 con 0x7f701415b3d0 2023-12-22T08:51:10.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.724+0000 7f70137fe640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ff406a430 0x7f6ff406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:10.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.726+0000 7f70137fe640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ff406a430 0x7f6ff406c8f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7004000f60 tx=0x7f7004009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:10.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.728+0000 7f7010ff9640 1 -- 172.21.15.38:0/2936707701 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6ffc0544a0 con 0x7f701415b3d0 2023-12-22T08:51:10.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:10.958+0000 7f7019e51640 1 -- 172.21.15.38:0/2936707701 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7014072120 con 0x7f701415b3d0 2023-12-22T08:51:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.498+0000 7f7010ff9640 1 -- 172.21.15.38:0/2936707701 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6ffc057ac0 con 0x7f701415b3d0 2023-12-22T08:51:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.502+0000 7f7019e51640 1 -- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ff406a430 msgr2=0x7f6ff406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.502+0000 7f7019e51640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ff406a430 0x7f6ff406c8f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7004000f60 tx=0x7f7004009040 comp rx=0 tx=0).stop 2023-12-22T08:51:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.502+0000 7f7019e51640 1 -- 172.21.15.38:0/2936707701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f701415b3d0 msgr2=0x7f70140c6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.502+0000 7f7019e51640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f701415b3d0 0x7f70140c6ec0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00e900 tx=0x7f6ffc00edc0 comp rx=0 tx=0).stop 2023-12-22T08:51:11.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.502+0000 7f7019e51640 1 -- 172.21.15.38:0/2936707701 shutdown_connections 2023-12-22T08:51:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.502+0000 7f7019e51640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f701415b7b0 0x7f70140afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.502+0000 7f7019e51640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ff406a430 0x7f6ff406c8f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.502+0000 7f7019e51640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f701415b3d0 0x7f70140c6ec0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.502+0000 7f7019e51640 1 --2- 172.21.15.38:0/2936707701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f70140ce740 0x7f70141550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.502+0000 7f7019e51640 1 -- 172.21.15.38:0/2936707701 >> 172.21.15.38:0/2936707701 conn(0x7f70140cba10 msgr2=0x7f70140adc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.502+0000 7f7019e51640 1 -- 172.21.15.38:0/2936707701 shutdown_connections 2023-12-22T08:51:11.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.503+0000 7f7019e51640 1 -- 172.21.15.38:0/2936707701 wait complete. 2023-12-22T08:51:11.526 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T08:51:11.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.758+0000 7f4e911cf640 1 Processor -- start 2023-12-22T08:51:11.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.758+0000 7f4e911cf640 1 -- start start 2023-12-22T08:51:11.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.760+0000 7f4e911cf640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4e8c15b370 0x7f4e8c06d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:11.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.760+0000 7f4e911cf640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c15ca20 con 0x7f4e8c06d6a0 2023-12-22T08:51:11.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.760+0000 7f4e911cf640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c06dc20 con 0x7f4e8c0ae6c0 2023-12-22T08:51:11.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.760+0000 7f4e911cf640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c15b750 con 0x7f4e8c15b370 2023-12-22T08:51:11.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.760+0000 7f4e8bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4e8c15b370 0x7f4e8c06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:11.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.760+0000 7f4e8b7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4e8c06d6a0 0x7f4e8c0adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45936/0 (socket says 172.21.15.38:45936) 2023-12-22T08:51:11.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.760+0000 7f4e8b7fe640 1 -- 172.21.15.38:0/4197056354 learned_addr learned my addr 172.21.15.38:0/4197056354 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:11.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.761+0000 7f4e8affd640 1 -- 172.21.15.38:0/4197056354 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3220090051 0 0) 0x7f4e8c15ca20 con 0x7f4e8c06d6a0 2023-12-22T08:51:11.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.761+0000 7f4e8affd640 1 -- 172.21.15.38:0/4197056354 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e78003520 con 0x7f4e8c06d6a0 2023-12-22T08:51:11.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.761+0000 7f4e8bfff640 1 -- 172.21.15.38:0/4197056354 >> v1:172.21.15.89:6789/0 conn(0x7f4e8c0ae6c0 legacy=0x7f4e8c06fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:11.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.761+0000 7f4e8bfff640 1 -- 172.21.15.38:0/4197056354 >> v1:172.21.15.38:6789/0 conn(0x7f4e8c06d6a0 legacy=0x7f4e8c0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:11.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.761+0000 7f4e8bfff640 1 -- 172.21.15.38:0/4197056354 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c06df00 con 0x7f4e8c15b370 2023-12-22T08:51:11.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.762+0000 7f4e8bfff640 1 --2- 172.21.15.38:0/4197056354 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e8c15b370 0x7f4e8c06d160 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009d90 tx=0x7f4e7c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ca299dedc1a7a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:11.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.763+0000 7f4e8affd640 1 -- 172.21.15.38:0/4197056354 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c02cd00 con 0x7f4e8c15b370 2023-12-22T08:51:11.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.763+0000 7f4e8affd640 1 -- 172.21.15.38:0/4197056354 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c02ce60 con 0x7f4e8c15b370 2023-12-22T08:51:11.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.763+0000 7f4e8affd640 1 -- 172.21.15.38:0/4197056354 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c034660 con 0x7f4e8c15b370 2023-12-22T08:51:11.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.763+0000 7f4e911cf640 1 -- 172.21.15.38:0/4197056354 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e8c15b370 msgr2=0x7f4e8c06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:11.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.763+0000 7f4e911cf640 1 --2- 172.21.15.38:0/4197056354 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e8c15b370 0x7f4e8c06d160 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009d90 tx=0x7f4e7c02bf50 comp rx=0 tx=0).stop 2023-12-22T08:51:11.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.763+0000 7f4e911cf640 1 -- 172.21.15.38:0/4197056354 shutdown_connections 2023-12-22T08:51:11.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.763+0000 7f4e911cf640 1 --2- 172.21.15.38:0/4197056354 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e8c15b370 0x7f4e8c06d160 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:11.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.763+0000 7f4e911cf640 1 -- 172.21.15.38:0/4197056354 >> 172.21.15.38:0/4197056354 conn(0x7f4e8c0b1110 msgr2=0x7f4e8c0b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:11.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.764+0000 7f4e911cf640 1 -- 172.21.15.38:0/4197056354 shutdown_connections 2023-12-22T08:51:11.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.764+0000 7f4e911cf640 1 -- 172.21.15.38:0/4197056354 wait complete. 2023-12-22T08:51:11.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.765+0000 7f4e911cf640 1 Processor -- start 2023-12-22T08:51:11.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.766+0000 7f4e911cf640 1 -- start start 2023-12-22T08:51:11.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.766+0000 7f4e911cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e8c06d6a0 0x7f4e8c153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:11.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.766+0000 7f4e911cf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e8c0ae6c0 0x7f4e8c1e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:11.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e911cf640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e8c15b370 0x7f4e8c0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:11.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e911cf640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c1f2b90 con 0x7f4e8c0ae6c0 2023-12-22T08:51:11.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e911cf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c154ce0 con 0x7f4e8c06d6a0 2023-12-22T08:51:11.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e911cf640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c0ad4e0 con 0x7f4e8c15b370 2023-12-22T08:51:11.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e8b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e8c0ae6c0 0x7f4e8c1e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:11.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e8b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e8c0ae6c0 0x7f4e8c1e44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37156/0 (socket says 172.21.15.38:37156) 2023-12-22T08:51:11.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e8b7fe640 1 -- 172.21.15.38:0/3415711250 learned_addr learned my addr 172.21.15.38:0/3415711250 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:11.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e8bfff640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e8c06d6a0 0x7f4e8c153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e909ce640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e8c15b370 0x7f4e8c0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e8b7fe640 1 -- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e8c15b370 msgr2=0x7f4e8c0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e8b7fe640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e8c15b370 0x7f4e8c0c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e8b7fe640 1 -- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e8c06d6a0 msgr2=0x7f4e8c153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e8b7fe640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e8c06d6a0 0x7f4e8c153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.767+0000 7f4e8b7fe640 1 -- 172.21.15.38:0/3415711250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c009a70 con 0x7f4e8c0ae6c0 2023-12-22T08:51:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.768+0000 7f4e8b7fe640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e8c0ae6c0 0x7f4e8c1e44b0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400c500 tx=0x7f4e7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.768+0000 7f4e88ff9640 1 -- 172.21.15.38:0/3415711250 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74005ce0 con 0x7f4e8c0ae6c0 2023-12-22T08:51:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.768+0000 7f4e88ff9640 1 -- 172.21.15.38:0/3415711250 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e74005e40 con 0x7f4e8c0ae6c0 2023-12-22T08:51:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.768+0000 7f4e88ff9640 1 -- 172.21.15.38:0/3415711250 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e740072f0 con 0x7f4e8c0ae6c0 2023-12-22T08:51:11.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.768+0000 7f4e911cf640 1 -- 172.21.15.38:0/3415711250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c0add50 con 0x7f4e8c0ae6c0 2023-12-22T08:51:11.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.768+0000 7f4e911cf640 1 -- 172.21.15.38:0/3415711250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c0ada10 con 0x7f4e8c0ae6c0 2023-12-22T08:51:11.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.769+0000 7f4e911cf640 1 -- 172.21.15.38:0/3415711250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c0adba0 con 0x7f4e8c0ae6c0 2023-12-22T08:51:11.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.770+0000 7f4e88ff9640 1 -- 172.21.15.38:0/3415711250 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4e74007510 con 0x7f4e8c0ae6c0 2023-12-22T08:51:11.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.772+0000 7f4e88ff9640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4e6c06a430 0x7f4e6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:11.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.772+0000 7f4e88ff9640 1 -- 172.21.15.38:0/3415711250 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4e74087eb0 con 0x7f4e8c0ae6c0 2023-12-22T08:51:11.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.772+0000 7f4e8bfff640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4e6c06a430 0x7f4e6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:11.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.774+0000 7f4e8bfff640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4e6c06a430 0x7f4e6c06c8f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c036000 tx=0x7f4e7c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:11.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.777+0000 7f4e88ff9640 1 -- 172.21.15.38:0/3415711250 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4e740534e0 con 0x7f4e8c0ae6c0 2023-12-22T08:51:11.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:11.971+0000 7f4e911cf640 1 -- 172.21.15.38:0/3415711250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4e8c061910 con 0x7f4e8c0ae6c0 2023-12-22T08:51:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.502+0000 7f4e88ff9640 1 -- 172.21.15.38:0/3415711250 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v163) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4e740170d0 con 0x7f4e8c0ae6c0 2023-12-22T08:51:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2023-12-22T08:51:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.506+0000 7f4e911cf640 1 -- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4e6c06a430 msgr2=0x7f4e6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.506+0000 7f4e911cf640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4e6c06a430 0x7f4e6c06c8f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c036000 tx=0x7f4e7c030000 comp rx=0 tx=0).stop 2023-12-22T08:51:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.506+0000 7f4e911cf640 1 -- 172.21.15.38:0/3415711250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e8c0ae6c0 msgr2=0x7f4e8c1e44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.506+0000 7f4e911cf640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e8c0ae6c0 0x7f4e8c1e44b0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400c500 tx=0x7f4e7400c9c0 comp rx=0 tx=0).stop 2023-12-22T08:51:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.506+0000 7f4e911cf640 1 -- 172.21.15.38:0/3415711250 shutdown_connections 2023-12-22T08:51:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.506+0000 7f4e911cf640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e8c15b370 0x7f4e8c0c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.506+0000 7f4e911cf640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4e6c06a430 0x7f4e6c06c8f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.506+0000 7f4e911cf640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e8c0ae6c0 0x7f4e8c1e44b0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.506+0000 7f4e911cf640 1 --2- 172.21.15.38:0/3415711250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e8c06d6a0 0x7f4e8c153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.506+0000 7f4e911cf640 1 -- 172.21.15.38:0/3415711250 >> 172.21.15.38:0/3415711250 conn(0x7f4e8c0b1110 msgr2=0x7f4e8c156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.506+0000 7f4e911cf640 1 -- 172.21.15.38:0/3415711250 shutdown_connections 2023-12-22T08:51:12.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.506+0000 7f4e911cf640 1 -- 172.21.15.38:0/3415711250 wait complete. 2023-12-22T08:51:12.531 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T08:51:12.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.761+0000 7fa1e2226640 1 Processor -- start 2023-12-22T08:51:12.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.761+0000 7fa1e2226640 1 -- start start 2023-12-22T08:51:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.763+0000 7fa1e2226640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa1dc0b2050 0x7fa1dc0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.763+0000 7fa1e2226640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1dc070800 0x7fa1dc070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:12.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.763+0000 7fa1e2226640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1dc1450f0 con 0x7fa1dc144d10 2023-12-22T08:51:12.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.763+0000 7fa1e2226640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc0cc840 con 0x7fa1dc0b2050 2023-12-22T08:51:12.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.763+0000 7fa1e2226640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0ce010 con 0x7fa1dc070800 2023-12-22T08:51:12.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.764+0000 7fa1d2ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa1dc0b2050 0x7fa1dc0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:12.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.764+0000 7fa1d2ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa1dc0b2050 0x7fa1dc0b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37166/0 (socket says 172.21.15.38:37166) 2023-12-22T08:51:12.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.764+0000 7fa1d2ffd640 1 -- 172.21.15.38:0/401543440 learned_addr learned my addr 172.21.15.38:0/401543440 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.764+0000 7fa1dbfff640 1 --2- 172.21.15.38:0/401543440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1dc070800 0x7fa1dc070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.764+0000 7fa1d2ffd640 1 -- 172.21.15.38:0/401543440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1dc070800 msgr2=0x7fa1dc070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.764+0000 7fa1d2ffd640 1 --2- 172.21.15.38:0/401543440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1dc070800 0x7fa1dc070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.764+0000 7fa1d2ffd640 1 -- 172.21.15.38:0/401543440 >> v1:172.21.15.89:6789/0 conn(0x7fa1dc144d10 legacy=0x7fa1dc0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.764+0000 7fa1d2ffd640 1 -- 172.21.15.38:0/401543440 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc0b29f0 con 0x7fa1dc0b2050 2023-12-22T08:51:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.766+0000 7fa1d2ffd640 1 --2- 172.21.15.38:0/401543440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1dc0b2050 0x7fa1dc0b24b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0b32f0 tx=0x7fa1c402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc1bf6512f515ba server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.766+0000 7fa1daffd640 1 -- 172.21.15.38:0/401543440 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4031830 con 0x7fa1dc0b2050 2023-12-22T08:51:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.766+0000 7fa1daffd640 1 -- 172.21.15.38:0/401543440 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c4031990 con 0x7fa1dc0b2050 2023-12-22T08:51:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.766+0000 7fa1daffd640 1 -- 172.21.15.38:0/401543440 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4031d20 con 0x7fa1dc0b2050 2023-12-22T08:51:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.767+0000 7fa1e2226640 1 -- 172.21.15.38:0/401543440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1dc0b2050 msgr2=0x7fa1dc0b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.767+0000 7fa1e2226640 1 --2- 172.21.15.38:0/401543440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1dc0b2050 0x7fa1dc0b24b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0b32f0 tx=0x7fa1c402b8d0 comp rx=0 tx=0).stop 2023-12-22T08:51:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.767+0000 7fa1e2226640 1 -- 172.21.15.38:0/401543440 shutdown_connections 2023-12-22T08:51:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.767+0000 7fa1e2226640 1 --2- 172.21.15.38:0/401543440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1dc0b2050 0x7fa1dc0b24b0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.767+0000 7fa1e2226640 1 --2- 172.21.15.38:0/401543440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1dc070800 0x7fa1dc070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.767+0000 7fa1e2226640 1 -- 172.21.15.38:0/401543440 >> 172.21.15.38:0/401543440 conn(0x7fa1dc0cf070 msgr2=0x7fa1dc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.767+0000 7fa1e2226640 1 -- 172.21.15.38:0/401543440 shutdown_connections 2023-12-22T08:51:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.767+0000 7fa1e2226640 1 -- 172.21.15.38:0/401543440 wait complete. 2023-12-22T08:51:12.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.769+0000 7fa1e2226640 1 Processor -- start 2023-12-22T08:51:12.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.769+0000 7fa1e2226640 1 -- start start 2023-12-22T08:51:12.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.770+0000 7fa1e2226640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1dc070800 0x7fa1dc0b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.770+0000 7fa1e2226640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1dc0b2050 0x7fa1dc13f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.770+0000 7fa1e2226640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1dc144d10 0x7fa1dc159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.770+0000 7fa1e2226640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0af530 con 0x7fa1dc070800 2023-12-22T08:51:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.770+0000 7fa1e2226640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0af780 con 0x7fa1dc144d10 2023-12-22T08:51:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.770+0000 7fa1e2226640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0afa60 con 0x7fa1dc0b2050 2023-12-22T08:51:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.770+0000 7fa1db7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1dc070800 0x7fa1dc0b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.770+0000 7fa1db7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1dc070800 0x7fa1dc0b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37172/0 (socket says 172.21.15.38:37172) 2023-12-22T08:51:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.770+0000 7fa1db7fe640 1 -- 172.21.15.38:0/3962733010 learned_addr learned my addr 172.21.15.38:0/3962733010 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.771+0000 7fa1d2ffd640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1dc0b2050 0x7fa1dc13f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.771+0000 7fa1dbfff640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1dc144d10 0x7fa1dc159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.771+0000 7fa1db7fe640 1 -- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1dc0b2050 msgr2=0x7fa1dc13f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.771+0000 7fa1db7fe640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1dc0b2050 0x7fa1dc13f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.771+0000 7fa1db7fe640 1 -- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1dc144d10 msgr2=0x7fa1dc159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:12.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.771+0000 7fa1db7fe640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1dc144d10 0x7fa1dc159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:12.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.771+0000 7fa1db7fe640 1 -- 172.21.15.38:0/3962733010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c40094d0 con 0x7fa1dc070800 2023-12-22T08:51:12.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.771+0000 7fa1db7fe640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1dc070800 0x7fa1dc0b02b0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00ba50 tx=0x7fa1cc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:12.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.771+0000 7fa1d8ff9640 1 -- 172.21.15.38:0/3962733010 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc00cbe0 con 0x7fa1dc070800 2023-12-22T08:51:12.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.771+0000 7fa1d8ff9640 1 -- 172.21.15.38:0/3962733010 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc00cd80 con 0x7fa1dc070800 2023-12-22T08:51:12.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.771+0000 7fa1e2226640 1 -- 172.21.15.38:0/3962733010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc0afd40 con 0x7fa1dc070800 2023-12-22T08:51:12.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.771+0000 7fa1d8ff9640 1 -- 172.21.15.38:0/3962733010 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc014680 con 0x7fa1dc070800 2023-12-22T08:51:12.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.772+0000 7fa1e2226640 1 -- 172.21.15.38:0/3962733010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc0b07f0 con 0x7fa1dc070800 2023-12-22T08:51:12.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.773+0000 7fa1e2226640 1 -- 172.21.15.38:0/3962733010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc1571b0 con 0x7fa1dc070800 2023-12-22T08:51:12.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.774+0000 7fa1d8ff9640 1 -- 172.21.15.38:0/3962733010 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa1cc0147e0 con 0x7fa1dc070800 2023-12-22T08:51:12.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.775+0000 7fa1d8ff9640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa1bc06a430 0x7fa1bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:12.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.775+0000 7fa1d8ff9640 1 -- 172.21.15.38:0/3962733010 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fa1cc0886f0 con 0x7fa1dc070800 2023-12-22T08:51:12.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.776+0000 7fa1d2ffd640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa1bc06a430 0x7fa1bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:12.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.777+0000 7fa1d2ffd640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa1bc06a430 0x7fa1bc06c8f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4036000 tx=0x7fa1c403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:12.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.780+0000 7fa1d8ff9640 1 -- 172.21.15.38:0/3962733010 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa1dc1571b0 con 0x7fa1dc070800 2023-12-22T08:51:12.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:12.972+0000 7fa1e2226640 1 -- 172.21.15.38:0/3962733010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa1dc1571b0 con 0x7fa1dc070800 2023-12-22T08:51:13.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.517+0000 7fa1d8ff9640 1 -- 172.21.15.38:0/3962733010 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v164) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa1dc1571b0 con 0x7fa1dc070800 2023-12-22T08:51:13.519 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2023-12-22T08:51:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.523+0000 7fa1e2226640 1 -- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa1bc06a430 msgr2=0x7fa1bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.523+0000 7fa1e2226640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa1bc06a430 0x7fa1bc06c8f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4036000 tx=0x7fa1c403c040 comp rx=0 tx=0).stop 2023-12-22T08:51:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.523+0000 7fa1e2226640 1 -- 172.21.15.38:0/3962733010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1dc070800 msgr2=0x7fa1dc0b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.523+0000 7fa1e2226640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1dc070800 0x7fa1dc0b02b0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00ba50 tx=0x7fa1cc00bf10 comp rx=0 tx=0).stop 2023-12-22T08:51:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.523+0000 7fa1e2226640 1 -- 172.21.15.38:0/3962733010 shutdown_connections 2023-12-22T08:51:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.523+0000 7fa1e2226640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1dc144d10 0x7fa1dc159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.523+0000 7fa1e2226640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa1dc0b2050 0x7fa1dc13f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.523+0000 7fa1e2226640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa1bc06a430 0x7fa1bc06c8f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.523+0000 7fa1e2226640 1 --2- 172.21.15.38:0/3962733010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1dc070800 0x7fa1dc0b02b0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.523+0000 7fa1e2226640 1 -- 172.21.15.38:0/3962733010 >> 172.21.15.38:0/3962733010 conn(0x7fa1dc0cf070 msgr2=0x7fa1dc141b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.523+0000 7fa1e2226640 1 -- 172.21.15.38:0/3962733010 shutdown_connections 2023-12-22T08:51:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.523+0000 7fa1e2226640 1 -- 172.21.15.38:0/3962733010 wait complete. 2023-12-22T08:51:13.544 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-22T08:51:13.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.765+0000 7f9054522640 1 Processor -- start 2023-12-22T08:51:13.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.765+0000 7f9054522640 1 -- start start 2023-12-22T08:51:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.766+0000 7f9054522640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f904c0ccad0 0x7f904c159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.767+0000 7f9054522640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f904c0ce7a0 0x7f904c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.767+0000 7f9054522640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c06e310 con 0x7f904c0cb050 2023-12-22T08:51:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.767+0000 7f9054522640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904c15b020 con 0x7f904c0ccad0 2023-12-22T08:51:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.767+0000 7f9054522640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c072070 con 0x7f904c0ce7a0 2023-12-22T08:51:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.767+0000 7f9052abf640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f904c0ce7a0 0x7f904c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.767+0000 7f9051abd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f904c0ccad0 0x7f904c159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.767+0000 7f9052abf640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f904c0ce7a0 0x7f904c0c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:59616/0 (socket says 172.21.15.38:59616) 2023-12-22T08:51:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.767+0000 7f9052abf640 1 -- 172.21.15.38:0/152870220 learned_addr learned my addr 172.21.15.38:0/152870220 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.767+0000 7f9051abd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f904c0ccad0 0x7f904c159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:45808/0 (socket says 172.21.15.38:45808) 2023-12-22T08:51:13.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.768+0000 7f9052abf640 1 -- 172.21.15.38:0/152870220 >> v2:172.21.15.89:3300/0 conn(0x7f904c0ccad0 msgr2=0x7f904c159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:13.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.768+0000 7f9052abf640 1 --2- 172.21.15.38:0/152870220 >> v2:172.21.15.89:3300/0 conn(0x7f904c0ccad0 0x7f904c159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.768+0000 7f9052abf640 1 -- 172.21.15.38:0/152870220 >> v1:172.21.15.89:6789/0 conn(0x7f904c0cb050 legacy=0x7f904c159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:13.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.768+0000 7f9052abf640 1 -- 172.21.15.38:0/152870220 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c15a0d0 con 0x7f904c0ce7a0 2023-12-22T08:51:13.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.768+0000 7f9051abd640 1 --2- 172.21.15.38:0/152870220 >> v2:172.21.15.89:3300/0 conn(0x7f904c0ccad0 0x7f904c159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:51:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.770+0000 7f9052abf640 1 --2- 172.21.15.38:0/152870220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f904c0ce7a0 0x7f904c0c9700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9044009e50 tx=0x7f904402bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec02ed50384c4d59 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.770+0000 7f90512bc640 1 -- 172.21.15.38:0/152870220 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904402ca80 con 0x7f904c0ce7a0 2023-12-22T08:51:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.770+0000 7f90512bc640 1 -- 172.21.15.38:0/152870220 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904402cbe0 con 0x7f904c0ce7a0 2023-12-22T08:51:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.770+0000 7f90512bc640 1 -- 172.21.15.38:0/152870220 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90440343f0 con 0x7f904c0ce7a0 2023-12-22T08:51:13.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.771+0000 7f9054522640 1 -- 172.21.15.38:0/152870220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f904c0ce7a0 msgr2=0x7f904c0c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:13.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.771+0000 7f9054522640 1 --2- 172.21.15.38:0/152870220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f904c0ce7a0 0x7f904c0c9700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9044009e50 tx=0x7f904402bee0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.771+0000 7f9054522640 1 -- 172.21.15.38:0/152870220 shutdown_connections 2023-12-22T08:51:13.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.771+0000 7f9054522640 1 --2- 172.21.15.38:0/152870220 >> v2:172.21.15.89:3300/0 conn(0x7f904c0ccad0 0x7f904c159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.771+0000 7f9054522640 1 --2- 172.21.15.38:0/152870220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f904c0ce7a0 0x7f904c0c9700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.771+0000 7f9054522640 1 -- 172.21.15.38:0/152870220 >> 172.21.15.38:0/152870220 conn(0x7f904c0cba10 msgr2=0x7f904c0cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.771+0000 7f9054522640 1 -- 172.21.15.38:0/152870220 shutdown_connections 2023-12-22T08:51:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.771+0000 7f9054522640 1 -- 172.21.15.38:0/152870220 wait complete. 2023-12-22T08:51:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.773+0000 7f9054522640 1 Processor -- start 2023-12-22T08:51:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.773+0000 7f9054522640 1 -- start start 2023-12-22T08:51:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.774+0000 7f9054522640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f904c0cb050 0x7f904c14f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.774+0000 7f9054522640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c0ccad0 0x7f904c1541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.774+0000 7f9054522640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f904c0ce7a0 0x7f904c1519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.774+0000 7f9054522640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0b1a00 con 0x7f904c0ccad0 2023-12-22T08:51:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.774+0000 7f9054522640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c152b00 con 0x7f904c0cb050 2023-12-22T08:51:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.774+0000 7f9054522640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c152de0 con 0x7f904c0ce7a0 2023-12-22T08:51:13.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.775+0000 7f9051abd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c0ccad0 0x7f904c1541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:13.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.775+0000 7f9051abd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c0ccad0 0x7f904c1541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37186/0 (socket says 172.21.15.38:37186) 2023-12-22T08:51:13.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.775+0000 7f9051abd640 1 -- 172.21.15.38:0/651747726 learned_addr learned my addr 172.21.15.38:0/651747726 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:13.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.775+0000 7f9052abf640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f904c0ce7a0 0x7f904c1519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:13.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.775+0000 7f90522be640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f904c0cb050 0x7f904c14f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:13.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.775+0000 7f9051abd640 1 -- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f904c0ce7a0 msgr2=0x7f904c1519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:13.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.775+0000 7f9051abd640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f904c0ce7a0 0x7f904c1519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.775+0000 7f9051abd640 1 -- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f904c0cb050 msgr2=0x7f904c14f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.775+0000 7f9051abd640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f904c0cb050 0x7f904c14f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.775+0000 7f9051abd640 1 -- 172.21.15.38:0/651747726 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c00a540 con 0x7f904c0ccad0 2023-12-22T08:51:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.776+0000 7f9051abd640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c0ccad0 0x7f904c1541c0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f903c00e920 tx=0x7f903c00ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.776+0000 7f9042ffd640 1 -- 172.21.15.38:0/651747726 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00cd00 con 0x7f904c0ccad0 2023-12-22T08:51:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.776+0000 7f9042ffd640 1 -- 172.21.15.38:0/651747726 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c00ce60 con 0x7f904c0ccad0 2023-12-22T08:51:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.776+0000 7f9042ffd640 1 -- 172.21.15.38:0/651747726 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c005bb0 con 0x7f904c0ccad0 2023-12-22T08:51:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.776+0000 7f9054522640 1 -- 172.21.15.38:0/651747726 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9044009b30 con 0x7f904c0ccad0 2023-12-22T08:51:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.776+0000 7f9054522640 1 -- 172.21.15.38:0/651747726 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c0b01b0 con 0x7f904c0ccad0 2023-12-22T08:51:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.777+0000 7f9054522640 1 -- 172.21.15.38:0/651747726 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904c152c40 con 0x7f904c0ccad0 2023-12-22T08:51:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.778+0000 7f9042ffd640 1 -- 172.21.15.38:0/651747726 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f903c005d10 con 0x7f904c0ccad0 2023-12-22T08:51:13.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.780+0000 7f9042ffd640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f903006a430 0x7f903006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:13.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.780+0000 7f9042ffd640 1 -- 172.21.15.38:0/651747726 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f903c088750 con 0x7f904c0ccad0 2023-12-22T08:51:13.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.780+0000 7f90522be640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f903006a430 0x7f903006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:13.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.781+0000 7f90522be640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f903006a430 0x7f903006c8f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f904c0aea10 tx=0x7f9048009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:13.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.784+0000 7f9042ffd640 1 -- 172.21.15.38:0/651747726 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f904c152c40 con 0x7f904c0ccad0 2023-12-22T08:51:13.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.975+0000 7f9054522640 1 -- 172.21.15.38:0/651747726 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f904c152c40 con 0x7f904c0ccad0 2023-12-22T08:51:13.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.981+0000 7f9042ffd640 1 -- 172.21.15.38:0/651747726 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f904c152c40 con 0x7f904c0ccad0 2023-12-22T08:51:13.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.984+0000 7f9054522640 1 -- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f903006a430 msgr2=0x7f903006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:13.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.984+0000 7f9054522640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f903006a430 0x7f903006c8f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f904c0aea10 tx=0x7f9048009040 comp rx=0 tx=0).stop 2023-12-22T08:51:13.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.984+0000 7f9054522640 1 -- 172.21.15.38:0/651747726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c0ccad0 msgr2=0x7f904c1541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:13.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.984+0000 7f9054522640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c0ccad0 0x7f904c1541c0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f903c00e920 tx=0x7f903c00ede0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.984+0000 7f9054522640 1 -- 172.21.15.38:0/651747726 shutdown_connections 2023-12-22T08:51:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.984+0000 7f9054522640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f904c0ce7a0 0x7f904c1519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.984+0000 7f9054522640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f903006a430 0x7f903006c8f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.984+0000 7f9054522640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f904c0ccad0 0x7f904c1541c0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.984+0000 7f9054522640 1 --2- 172.21.15.38:0/651747726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f904c0cb050 0x7f904c14f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.984+0000 7f9054522640 1 -- 172.21.15.38:0/651747726 >> 172.21.15.38:0/651747726 conn(0x7f904c0cba10 msgr2=0x7f904c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.984+0000 7f9054522640 1 -- 172.21.15.38:0/651747726 shutdown_connections 2023-12-22T08:51:13.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:13.984+0000 7f9054522640 1 -- 172.21.15.38:0/651747726 wait complete. 2023-12-22T08:51:14.005 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-12-22T08:51:14.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.238+0000 7fd948ac7640 1 Processor -- start 2023-12-22T08:51:14.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.238+0000 7fd948ac7640 1 -- start start 2023-12-22T08:51:14.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.240+0000 7fd948ac7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd9440b24b0 0x7fd944070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:14.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.240+0000 7fd948ac7640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9441450f0 con 0x7fd9440b2050 2023-12-22T08:51:14.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.240+0000 7fd948ac7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9440cc840 con 0x7fd944144d10 2023-12-22T08:51:14.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.240+0000 7fd948ac7640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9440ce010 con 0x7fd9440b24b0 2023-12-22T08:51:14.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.240+0000 7fd942d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd9440b24b0 0x7fd944070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:14.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.240+0000 7fd941d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd9440b2050 0x7fd944070800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45948/0 (socket says 172.21.15.38:45948) 2023-12-22T08:51:14.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.240+0000 7fd941d9b640 1 -- 172.21.15.38:0/3784094252 learned_addr learned my addr 172.21.15.38:0/3784094252 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:14.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.241+0000 7fd942d9d640 1 -- 172.21.15.38:0/3784094252 >> v1:172.21.15.89:6789/0 conn(0x7fd944144d10 legacy=0x7fd9440cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:14.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.241+0000 7fd942d9d640 1 -- 172.21.15.38:0/3784094252 >> v1:172.21.15.38:6789/0 conn(0x7fd9440b2050 legacy=0x7fd944070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:14.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.241+0000 7fd942d9d640 1 -- 172.21.15.38:0/3784094252 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9440ce2f0 con 0x7fd9440b24b0 2023-12-22T08:51:14.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.242+0000 7fd942d9d640 1 --2- 172.21.15.38:0/3784094252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9440b24b0 0x7fd944070f10 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009d90 tx=0x7fd93c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f524fa54c8e70c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:14.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.242+0000 7fd94159a640 1 -- 172.21.15.38:0/3784094252 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c02cc60 con 0x7fd9440b24b0 2023-12-22T08:51:14.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.242+0000 7fd94159a640 1 -- 172.21.15.38:0/3784094252 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c02cdc0 con 0x7fd9440b24b0 2023-12-22T08:51:14.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.242+0000 7fd94159a640 1 -- 172.21.15.38:0/3784094252 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c034660 con 0x7fd9440b24b0 2023-12-22T08:51:14.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.243+0000 7fd948ac7640 1 -- 172.21.15.38:0/3784094252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9440b24b0 msgr2=0x7fd944070f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:14.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.243+0000 7fd948ac7640 1 --2- 172.21.15.38:0/3784094252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9440b24b0 0x7fd944070f10 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009d90 tx=0x7fd93c02beb0 comp rx=0 tx=0).stop 2023-12-22T08:51:14.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.243+0000 7fd948ac7640 1 -- 172.21.15.38:0/3784094252 shutdown_connections 2023-12-22T08:51:14.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.243+0000 7fd948ac7640 1 --2- 172.21.15.38:0/3784094252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9440b24b0 0x7fd944070f10 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:14.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.243+0000 7fd948ac7640 1 -- 172.21.15.38:0/3784094252 >> 172.21.15.38:0/3784094252 conn(0x7fd9440cf070 msgr2=0x7fd9440cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:14.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.243+0000 7fd948ac7640 1 -- 172.21.15.38:0/3784094252 shutdown_connections 2023-12-22T08:51:14.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.243+0000 7fd948ac7640 1 -- 172.21.15.38:0/3784094252 wait complete. 2023-12-22T08:51:14.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.245+0000 7fd948ac7640 1 Processor -- start 2023-12-22T08:51:14.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.245+0000 7fd948ac7640 1 -- start start 2023-12-22T08:51:14.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.246+0000 7fd948ac7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9440b2050 0x7fd9440b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:14.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.246+0000 7fd948ac7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9440b24b0 0x7fd944141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:14.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.246+0000 7fd948ac7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd944144d10 0x7fd944143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:14.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.246+0000 7fd948ac7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd944142fe0 con 0x7fd9440b2050 2023-12-22T08:51:14.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.246+0000 7fd948ac7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9441423a0 con 0x7fd944144d10 2023-12-22T08:51:14.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.246+0000 7fd948ac7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd944142640 con 0x7fd9440b24b0 2023-12-22T08:51:14.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.246+0000 7fd94259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9440b2050 0x7fd9440b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:14.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.246+0000 7fd94259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9440b2050 0x7fd9440b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37202/0 (socket says 172.21.15.38:37202) 2023-12-22T08:51:14.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.246+0000 7fd94259c640 1 -- 172.21.15.38:0/2597587647 learned_addr learned my addr 172.21.15.38:0/2597587647 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:14.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.247+0000 7fd94259c640 1 -- 172.21.15.38:0/2597587647 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9440b24b0 msgr2=0x7fd944141440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:14.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.247+0000 7fd94259c640 1 --2- 172.21.15.38:0/2597587647 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9440b24b0 0x7fd944141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:14.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.247+0000 7fd942d9d640 1 --2- 172.21.15.38:0/2597587647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd944144d10 0x7fd944143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:14.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.247+0000 7fd94259c640 1 -- 172.21.15.38:0/2597587647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd944144d10 msgr2=0x7fd944143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:14.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.247+0000 7fd94259c640 1 --2- 172.21.15.38:0/2597587647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd944144d10 0x7fd944143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:14.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.247+0000 7fd94259c640 1 -- 172.21.15.38:0/2597587647 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c009a70 con 0x7fd9440b2050 2023-12-22T08:51:14.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.247+0000 7fd94259c640 1 --2- 172.21.15.38:0/2597587647 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9440b2050 0x7fd9440b00a0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fd93400b3f0 tx=0x7fd93400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:14.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.248+0000 7fd932ffd640 1 -- 172.21.15.38:0/2597587647 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934011830 con 0x7fd9440b2050 2023-12-22T08:51:14.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.248+0000 7fd932ffd640 1 -- 172.21.15.38:0/2597587647 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd934011990 con 0x7fd9440b2050 2023-12-22T08:51:14.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.248+0000 7fd948ac7640 1 -- 172.21.15.38:0/2597587647 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd944142920 con 0x7fd9440b2050 2023-12-22T08:51:14.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.248+0000 7fd932ffd640 1 -- 172.21.15.38:0/2597587647 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934011d40 con 0x7fd9440b2050 2023-12-22T08:51:14.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.248+0000 7fd948ac7640 1 -- 172.21.15.38:0/2597587647 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9440b05e0 con 0x7fd9440b2050 2023-12-22T08:51:14.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.249+0000 7fd948ac7640 1 -- 172.21.15.38:0/2597587647 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd944143120 con 0x7fd9440b2050 2023-12-22T08:51:14.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.250+0000 7fd932ffd640 1 -- 172.21.15.38:0/2597587647 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd93401a400 con 0x7fd9440b2050 2023-12-22T08:51:14.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.251+0000 7fd932ffd640 1 --2- 172.21.15.38:0/2597587647 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd92406a430 0x7fd92406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:14.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.251+0000 7fd932ffd640 1 -- 172.21.15.38:0/2597587647 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd9340884b0 con 0x7fd9440b2050 2023-12-22T08:51:14.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.251+0000 7fd941d9b640 1 --2- 172.21.15.38:0/2597587647 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd92406a430 0x7fd92406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:14.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.253+0000 7fd941d9b640 1 --2- 172.21.15.38:0/2597587647 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd92406a430 0x7fd92406c8f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd938000f60 tx=0x7fd938007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:14.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.255+0000 7fd932ffd640 1 -- 172.21.15.38:0/2597587647 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd944143120 con 0x7fd9440b2050 2023-12-22T08:51:14.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:14.527+0000 7fd948ac7640 1 -- 172.21.15.38:0/2597587647 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7fd944143120 con 0x7fd9440b2050 2023-12-22T08:51:15.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.527+0000 7fd932ffd640 1 -- 172.21.15.38:0/2597587647 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v548) v1 ==== 132+0+0 (secure 0 0 0) 0x7fd934053d90 con 0x7fd9440b2050 2023-12-22T08:51:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.530+0000 7fd948ac7640 1 -- 172.21.15.38:0/2597587647 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd92406a430 msgr2=0x7fd92406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.530+0000 7fd948ac7640 1 --2- 172.21.15.38:0/2597587647 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd92406a430 0x7fd92406c8f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd938000f60 tx=0x7fd938007a80 comp rx=0 tx=0).stop 2023-12-22T08:51:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.530+0000 7fd948ac7640 1 -- 172.21.15.38:0/2597587647 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9440b2050 msgr2=0x7fd9440b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.530+0000 7fd948ac7640 1 --2- 172.21.15.38:0/2597587647 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9440b2050 0x7fd9440b00a0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fd93400b3f0 tx=0x7fd93400b8b0 comp rx=0 tx=0).stop 2023-12-22T08:51:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.531+0000 7fd948ac7640 1 -- 172.21.15.38:0/2597587647 shutdown_connections 2023-12-22T08:51:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.531+0000 7fd948ac7640 1 --2- 172.21.15.38:0/2597587647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd944144d10 0x7fd944143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.531+0000 7fd948ac7640 1 --2- 172.21.15.38:0/2597587647 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9440b24b0 0x7fd944141440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.531+0000 7fd948ac7640 1 --2- 172.21.15.38:0/2597587647 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd92406a430 0x7fd92406c8f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.531+0000 7fd948ac7640 1 --2- 172.21.15.38:0/2597587647 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9440b2050 0x7fd9440b00a0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:15.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.531+0000 7fd948ac7640 1 -- 172.21.15.38:0/2597587647 >> 172.21.15.38:0/2597587647 conn(0x7fd9440cf070 msgr2=0x7fd9440adad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:15.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.531+0000 7fd948ac7640 1 -- 172.21.15.38:0/2597587647 shutdown_connections 2023-12-22T08:51:15.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.531+0000 7fd948ac7640 1 -- 172.21.15.38:0/2597587647 wait complete. 2023-12-22T08:51:15.557 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-22T08:51:15.557 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-12-22T08:51:15.557 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-12-22T08:51:15.558 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:51:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.791+0000 7fbad570a640 1 Processor -- start 2023-12-22T08:51:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.791+0000 7fbad570a640 1 -- start start 2023-12-22T08:51:15.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.793+0000 7fbad570a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbad00b2050 0x7fbad00b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:15.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.793+0000 7fbad570a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad01450f0 con 0x7fbad0144d10 2023-12-22T08:51:15.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.793+0000 7fbad570a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad00b29f0 con 0x7fbad0070800 2023-12-22T08:51:15.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.793+0000 7fbad570a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad00cc840 con 0x7fbad00b2050 2023-12-22T08:51:15.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.793+0000 7fbaceffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbad0144d10 0x7fbad00cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45956/0 (socket says 172.21.15.38:45956) 2023-12-22T08:51:15.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.793+0000 7fbaceffd640 1 -- 172.21.15.38:0/1759653208 learned_addr learned my addr 172.21.15.38:0/1759653208 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.793+0000 7fbace7fc640 1 --2- 172.21.15.38:0/1759653208 >> v2:172.21.15.89:3300/0 conn(0x7fbad00b2050 0x7fbad00b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.793+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059402497 0 0) 0x7fbad01450f0 con 0x7fbad0144d10 2023-12-22T08:51:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab8003520 con 0x7fbad0144d10 2023-12-22T08:51:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1446915856 0 0) 0x7fbab8003520 con 0x7fbad0144d10 2023-12-22T08:51:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 >> v2:172.21.15.89:3300/0 conn(0x7fbad00b2050 msgr2=0x7fbad00b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 --2- 172.21.15.38:0/1759653208 >> v2:172.21.15.89:3300/0 conn(0x7fbad00b2050 0x7fbad00b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 >> v1:172.21.15.89:6789/0 conn(0x7fbad0070800 legacy=0x7fbad0070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad00ce010 con 0x7fbad0144d10 2023-12-22T08:51:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fbac0001670 con 0x7fbad0144d10 2023-12-22T08:51:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 >> v1:172.21.15.38:6789/0 conn(0x7fbad0144d10 legacy=0x7fbad00cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 --2- 172.21.15.38:0/1759653208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbab8003970 0x7fbab8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 --2- 172.21.15.38:0/1759653208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbab80047c0 0x7fbab8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 --2- 172.21.15.38:0/1759653208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8005180 0x7fbab800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00cc840 con 0x7fbab8005180 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab800c020 con 0x7fbab80047c0 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.794+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab800c1e0 con 0x7fbab8003970 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.795+0000 7fbacf7fe640 1 --2- 172.21.15.38:0/1759653208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8005180 0x7fbab800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.795+0000 7fbace7fc640 1 --2- 172.21.15.38:0/1759653208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbab80047c0 0x7fbab8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.795+0000 7fbaceffd640 1 --2- 172.21.15.38:0/1759653208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbab8003970 0x7fbab8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.795+0000 7fbacf7fe640 1 -- 172.21.15.38:0/1759653208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbab8003970 msgr2=0x7fbab8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.795+0000 7fbacf7fe640 1 --2- 172.21.15.38:0/1759653208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbab8003970 0x7fbab8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.795+0000 7fbacf7fe640 1 -- 172.21.15.38:0/1759653208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbab80047c0 msgr2=0x7fbab8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.795+0000 7fbacf7fe640 1 --2- 172.21.15.38:0/1759653208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbab80047c0 0x7fbab8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.795+0000 7fbacf7fe640 1 -- 172.21.15.38:0/1759653208 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8003520 con 0x7fbab8005180 2023-12-22T08:51:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.796+0000 7fbacf7fe640 1 -- 172.21.15.38:0/1759653208 reap_dead start 2023-12-22T08:51:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.796+0000 7fbacf7fe640 1 --2- 172.21.15.38:0/1759653208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8005180 0x7fbab800b980 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fbac8001e50 tx=0x7fbab80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204b3456d18608ed server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.796+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8003b70 con 0x7fbab8005180 2023-12-22T08:51:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.796+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac8003d10 con 0x7fbab8005180 2023-12-22T08:51:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.796+0000 7fbacdffb640 1 -- 172.21.15.38:0/1759653208 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8005310 con 0x7fbab8005180 2023-12-22T08:51:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.797+0000 7fbad570a640 1 -- 172.21.15.38:0/1759653208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8005180 msgr2=0x7fbab800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.797+0000 7fbad570a640 1 --2- 172.21.15.38:0/1759653208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8005180 0x7fbab800b980 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fbac8001e50 tx=0x7fbab80057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.797+0000 7fbad570a640 1 -- 172.21.15.38:0/1759653208 shutdown_connections 2023-12-22T08:51:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.797+0000 7fbad570a640 1 --2- 172.21.15.38:0/1759653208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbab8005180 0x7fbab800b980 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.797+0000 7fbad570a640 1 -- 172.21.15.38:0/1759653208 >> 172.21.15.38:0/1759653208 conn(0x7fbad00cf070 msgr2=0x7fbad00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.797+0000 7fbad570a640 1 -- 172.21.15.38:0/1759653208 shutdown_connections 2023-12-22T08:51:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.797+0000 7fbad570a640 1 -- 172.21.15.38:0/1759653208 wait complete. 2023-12-22T08:51:15.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.799+0000 7fbad570a640 1 Processor -- start 2023-12-22T08:51:15.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.799+0000 7fbad570a640 1 -- start start 2023-12-22T08:51:15.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.800+0000 7fbad570a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbab8005180 0x7fbad01383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:15.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.800+0000 7fbad570a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbad01e5b20 0x7fbad01e5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:15.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.800+0000 7fbad570a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbad00aeb20 0x7fbad00aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:15.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.800+0000 7fbad570a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00af9c0 con 0x7fbad01e5b20 2023-12-22T08:51:15.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.800+0000 7fbad570a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00af4e0 con 0x7fbad00aeb20 2023-12-22T08:51:15.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.800+0000 7fbad570a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad0138f30 con 0x7fbab8005180 2023-12-22T08:51:15.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.801+0000 7fbace7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbad01e5b20 0x7fbad01e5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:15.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.801+0000 7fbace7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbad01e5b20 0x7fbad01e5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37224/0 (socket says 172.21.15.38:37224) 2023-12-22T08:51:15.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.801+0000 7fbace7fc640 1 -- 172.21.15.38:0/2967641851 learned_addr learned my addr 172.21.15.38:0/2967641851 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:15.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.801+0000 7fbace7fc640 1 -- 172.21.15.38:0/2967641851 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbab8005180 msgr2=0x7fbad01383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:15.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.801+0000 7fbace7fc640 1 --2- 172.21.15.38:0/2967641851 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbab8005180 0x7fbad01383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:15.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.801+0000 7fbace7fc640 1 -- 172.21.15.38:0/2967641851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbad00aeb20 msgr2=0x7fbad00aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:15.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.801+0000 7fbace7fc640 1 --2- 172.21.15.38:0/2967641851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbad00aeb20 0x7fbad00aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:15.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.801+0000 7fbace7fc640 1 -- 172.21.15.38:0/2967641851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad00af6e0 con 0x7fbad01e5b20 2023-12-22T08:51:15.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.801+0000 7fbace7fc640 1 --2- 172.21.15.38:0/2967641851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbad01e5b20 0x7fbad01e5fa0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fbac40115a0 tx=0x7fbac4011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:15.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.802+0000 7fbab77fe640 1 -- 172.21.15.38:0/2967641851 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4015930 con 0x7fbad01e5b20 2023-12-22T08:51:15.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.802+0000 7fbab77fe640 1 -- 172.21.15.38:0/2967641851 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac4015a90 con 0x7fbad01e5b20 2023-12-22T08:51:15.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.802+0000 7fbab77fe640 1 -- 172.21.15.38:0/2967641851 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4015e20 con 0x7fbad01e5b20 2023-12-22T08:51:15.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.802+0000 7fbad570a640 1 -- 172.21.15.38:0/2967641851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad0157400 con 0x7fbad01e5b20 2023-12-22T08:51:15.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.802+0000 7fbad570a640 1 -- 172.21.15.38:0/2967641851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad01579c0 con 0x7fbad01e5b20 2023-12-22T08:51:15.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.803+0000 7fbad570a640 1 -- 172.21.15.38:0/2967641851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad0157b80 con 0x7fbad01e5b20 2023-12-22T08:51:15.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.804+0000 7fbab77fe640 1 -- 172.21.15.38:0/2967641851 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbac400f480 con 0x7fbad01e5b20 2023-12-22T08:51:15.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.805+0000 7fbab77fe640 1 --2- 172.21.15.38:0/2967641851 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbabc06a430 0x7fbabc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:15.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.805+0000 7fbab77fe640 1 -- 172.21.15.38:0/2967641851 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbac4088be0 con 0x7fbad01e5b20 2023-12-22T08:51:15.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.806+0000 7fbaceffd640 1 --2- 172.21.15.38:0/2967641851 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbabc06a430 0x7fbabc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:15.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.807+0000 7fbaceffd640 1 --2- 172.21.15.38:0/2967641851 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbabc06a430 0x7fbabc06c8f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbac0000f60 tx=0x7fbac0001c10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:15.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:15.809+0000 7fbab77fe640 1 -- 172.21.15.38:0/2967641851 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbac4054430 con 0x7fbad01e5b20 2023-12-22T08:51:16.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.003+0000 7fbad570a640 1 -- 172.21.15.38:0/2967641851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbad0157260 con 0x7fbad01e5b20 2023-12-22T08:51:16.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.005+0000 7fbab77fe640 1 -- 172.21.15.38:0/2967641851 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+12479 (secure 0 0 0) 0x7fbad0157260 con 0x7fbad01e5b20 2023-12-22T08:51:16.006 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:16.007 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":164,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:51:13.498759+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6833/885304998":"2023-12-23T08:51:10.467293+0000","172.21.15.38:6832/885304998":"2023-12-23T08:51:10.467293+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:51:16.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.009+0000 7fbad570a640 1 -- 172.21.15.38:0/2967641851 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbabc06a430 msgr2=0x7fbabc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:16.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.009+0000 7fbad570a640 1 --2- 172.21.15.38:0/2967641851 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbabc06a430 0x7fbabc06c8f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbac0000f60 tx=0x7fbac0001c10 comp rx=0 tx=0).stop 2023-12-22T08:51:16.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.009+0000 7fbad570a640 1 -- 172.21.15.38:0/2967641851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbad01e5b20 msgr2=0x7fbad01e5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:16.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.009+0000 7fbad570a640 1 --2- 172.21.15.38:0/2967641851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbad01e5b20 0x7fbad01e5fa0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fbac40115a0 tx=0x7fbac4011a60 comp rx=0 tx=0).stop 2023-12-22T08:51:16.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.009+0000 7fbad570a640 1 -- 172.21.15.38:0/2967641851 shutdown_connections 2023-12-22T08:51:16.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.009+0000 7fbad570a640 1 --2- 172.21.15.38:0/2967641851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbad00aeb20 0x7fbad00aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.009+0000 7fbad570a640 1 --2- 172.21.15.38:0/2967641851 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbabc06a430 0x7fbabc06c8f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.009+0000 7fbad570a640 1 --2- 172.21.15.38:0/2967641851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbad01e5b20 0x7fbad01e5fa0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.009+0000 7fbad570a640 1 --2- 172.21.15.38:0/2967641851 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbab8005180 0x7fbad01383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.009+0000 7fbad570a640 1 -- 172.21.15.38:0/2967641851 >> 172.21.15.38:0/2967641851 conn(0x7fbad00cf070 msgr2=0x7fbad006d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:16.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.009+0000 7fbad570a640 1 -- 172.21.15.38:0/2967641851 shutdown_connections 2023-12-22T08:51:16.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.009+0000 7fbad570a640 1 -- 172.21.15.38:0/2967641851 wait complete. 2023-12-22T08:51:16.029 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:51:16.029 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:51:16.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.258+0000 7f7d9179f640 1 Processor -- start 2023-12-22T08:51:16.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.258+0000 7f7d9179f640 1 -- start start 2023-12-22T08:51:16.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.260+0000 7f7d9179f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d8c15cf10 0x7f7d8c0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.260+0000 7f7d9179f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d8c0701f0 0x7f7d8c0b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.260+0000 7f7d9179f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c0ccee0 con 0x7f7d8c15d2f0 2023-12-22T08:51:16.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.260+0000 7f7d9179f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c15e130 con 0x7f7d8c15cf10 2023-12-22T08:51:16.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.260+0000 7f7d9179f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c15e650 con 0x7f7d8c0701f0 2023-12-22T08:51:16.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.260+0000 7f7d8a7fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7d8c15d2f0 0x7f7d8c06fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45968/0 (socket says 172.21.15.38:45968) 2023-12-22T08:51:16.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.260+0000 7f7d8a7fc640 1 -- 172.21.15.38:0/3236407209 learned_addr learned my addr 172.21.15.38:0/3236407209 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:16.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.260+0000 7f7d8affd640 1 --2- 172.21.15.38:0/3236407209 >> v2:172.21.15.89:3300/0 conn(0x7f7d8c15cf10 0x7f7d8c0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.260+0000 7f7d8b7fe640 1 --2- 172.21.15.38:0/3236407209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d8c0701f0 0x7f7d8c0b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879040880 0 0) 0x7f7d8c0ccee0 con 0x7f7d8c15d2f0 2023-12-22T08:51:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d78005730 con 0x7f7d8c15d2f0 2023-12-22T08:51:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2333119587 0 0) 0x7f7d78005730 con 0x7f7d8c15d2f0 2023-12-22T08:51:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d8c0701f0 msgr2=0x7f7d8c0b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 --2- 172.21.15.38:0/3236407209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d8c0701f0 0x7f7d8c0b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 >> v2:172.21.15.89:3300/0 conn(0x7f7d8c15cf10 msgr2=0x7f7d8c0b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 --2- 172.21.15.38:0/3236407209 >> v2:172.21.15.89:3300/0 conn(0x7f7d8c15cf10 0x7f7d8c0b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c15e320 con 0x7f7d8c15d2f0 2023-12-22T08:51:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f7d74001670 con 0x7f7d8c15d2f0 2023-12-22T08:51:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 >> v1:172.21.15.38:6789/0 conn(0x7f7d8c15d2f0 legacy=0x7f7d8c06fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:16.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 --2- 172.21.15.38:0/3236407209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d8c0701f0 0x7f7d78005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 --2- 172.21.15.38:0/3236407209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d78006150 0x7f7d780069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 --2- 172.21.15.38:0/3236407209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d78006f10 0x7f7d78007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c15e650 con 0x7f7d78006f10 2023-12-22T08:51:16.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7800dc40 con 0x7f7d78006150 2023-12-22T08:51:16.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.261+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7800de00 con 0x7f7d8c0701f0 2023-12-22T08:51:16.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.262+0000 7f7d8b7fe640 1 --2- 172.21.15.38:0/3236407209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d78006f10 0x7f7d78007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.262+0000 7f7d8affd640 1 --2- 172.21.15.38:0/3236407209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d8c0701f0 0x7f7d78005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.262+0000 7f7d8a7fc640 1 --2- 172.21.15.38:0/3236407209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d78006150 0x7f7d780069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.262+0000 7f7d8b7fe640 1 -- 172.21.15.38:0/3236407209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d8c0701f0 msgr2=0x7f7d78005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:16.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.262+0000 7f7d8b7fe640 1 --2- 172.21.15.38:0/3236407209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d8c0701f0 0x7f7d78005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.262+0000 7f7d8b7fe640 1 -- 172.21.15.38:0/3236407209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d78006150 msgr2=0x7f7d780069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:16.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.262+0000 7f7d8b7fe640 1 --2- 172.21.15.38:0/3236407209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d78006150 0x7f7d780069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.262+0000 7f7d8b7fe640 1 -- 172.21.15.38:0/3236407209 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d78005730 con 0x7f7d78006f10 2023-12-22T08:51:16.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.262+0000 7f7d8a7fc640 1 --2- 172.21.15.38:0/3236407209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d78006150 0x7f7d780069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:51:16.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.263+0000 7f7d8b7fe640 1 --2- 172.21.15.38:0/3236407209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d78006f10 0x7f7d78007390 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0b32c0 tx=0x7f7d78007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46537e3c8dbcc1b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:16.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.264+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8402c660 con 0x7f7d78006f10 2023-12-22T08:51:16.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.264+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8402c7c0 con 0x7f7d78006f10 2023-12-22T08:51:16.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.264+0000 7f7d89ffb640 1 -- 172.21.15.38:0/3236407209 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8402cb50 con 0x7f7d78006f10 2023-12-22T08:51:16.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.264+0000 7f7d9179f640 1 -- 172.21.15.38:0/3236407209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d78006f10 msgr2=0x7f7d78007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:16.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.264+0000 7f7d9179f640 1 --2- 172.21.15.38:0/3236407209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d78006f10 0x7f7d78007390 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0b32c0 tx=0x7f7d78007a00 comp rx=0 tx=0).stop 2023-12-22T08:51:16.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.264+0000 7f7d8b7fe640 1 -- 172.21.15.38:0/3236407209 reap_dead start 2023-12-22T08:51:16.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.264+0000 7f7d9179f640 1 -- 172.21.15.38:0/3236407209 shutdown_connections 2023-12-22T08:51:16.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.264+0000 7f7d9179f640 1 -- 172.21.15.38:0/3236407209 >> 172.21.15.38:0/3236407209 conn(0x7f7d8c0b20c0 msgr2=0x7f7d8c0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:16.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.264+0000 7f7d9179f640 1 -- 172.21.15.38:0/3236407209 shutdown_connections 2023-12-22T08:51:16.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.264+0000 7f7d9179f640 1 -- 172.21.15.38:0/3236407209 wait complete. 2023-12-22T08:51:16.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.266+0000 7f7d9179f640 1 Processor -- start 2023-12-22T08:51:16.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.266+0000 7f7d9179f640 1 -- start start 2023-12-22T08:51:16.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.267+0000 7f7d9179f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d78006f10 0x7f7d8c14fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.267+0000 7f7d9179f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c148e80 0x7f7d8c06e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.267+0000 7f7d9179f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d8c1555d0 0x7f7d8c152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.267+0000 7f7d9179f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c06e5f0 con 0x7f7d8c148e80 2023-12-22T08:51:16.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.267+0000 7f7d9179f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c155140 con 0x7f7d78006f10 2023-12-22T08:51:16.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.267+0000 7f7d9179f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c154530 con 0x7f7d8c1555d0 2023-12-22T08:51:16.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.268+0000 7f7d8a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c148e80 0x7f7d8c06e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.268+0000 7f7d8a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c148e80 0x7f7d8c06e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37236/0 (socket says 172.21.15.38:37236) 2023-12-22T08:51:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.268+0000 7f7d8a7fc640 1 -- 172.21.15.38:0/3434072675 learned_addr learned my addr 172.21.15.38:0/3434072675 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.268+0000 7f7d8affd640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d78006f10 0x7f7d8c14fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.268+0000 7f7d8b7fe640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d8c1555d0 0x7f7d8c152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.268+0000 7f7d8a7fc640 1 -- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d8c1555d0 msgr2=0x7f7d8c152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.268+0000 7f7d8a7fc640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d8c1555d0 0x7f7d8c152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.268+0000 7f7d8a7fc640 1 -- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d78006f10 msgr2=0x7f7d8c14fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.268+0000 7f7d8a7fc640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d78006f10 0x7f7d8c14fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.268+0000 7f7d8a7fc640 1 -- 172.21.15.38:0/3434072675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c154810 con 0x7f7d8c148e80 2023-12-22T08:51:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.268+0000 7f7d8affd640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d78006f10 0x7f7d8c14fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:51:16.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.269+0000 7f7d8a7fc640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c148e80 0x7f7d8c06e0b0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400e780 tx=0x7f7d7400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:16.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.269+0000 7f7d837fe640 1 -- 172.21.15.38:0/3434072675 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7400ee30 con 0x7f7d8c148e80 2023-12-22T08:51:16.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.269+0000 7f7d837fe640 1 -- 172.21.15.38:0/3434072675 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7400c870 con 0x7f7d8c148e80 2023-12-22T08:51:16.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.269+0000 7f7d837fe640 1 -- 172.21.15.38:0/3434072675 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7400cc00 con 0x7f7d8c148e80 2023-12-22T08:51:16.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.269+0000 7f7d9179f640 1 -- 172.21.15.38:0/3434072675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c154af0 con 0x7f7d8c148e80 2023-12-22T08:51:16.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.269+0000 7f7d9179f640 1 -- 172.21.15.38:0/3434072675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c0adab0 con 0x7f7d8c148e80 2023-12-22T08:51:16.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.270+0000 7f7d9179f640 1 -- 172.21.15.38:0/3434072675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c061910 con 0x7f7d8c148e80 2023-12-22T08:51:16.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.271+0000 7f7d837fe640 1 -- 172.21.15.38:0/3434072675 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7d7401d460 con 0x7f7d8c148e80 2023-12-22T08:51:16.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.273+0000 7f7d837fe640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d6c06a460 0x7f7d6c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.273+0000 7f7d837fe640 1 -- 172.21.15.38:0/3434072675 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7d74088550 con 0x7f7d8c148e80 2023-12-22T08:51:16.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.273+0000 7f7d8affd640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d6c06a460 0x7f7d6c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.274+0000 7f7d8affd640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d6c06a460 0x7f7d6c06c920 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00a490 tx=0x7f7d7c00a040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:16.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.277+0000 7f7d837fe640 1 -- 172.21.15.38:0/3434072675 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7d74053da0 con 0x7f7d8c148e80 2023-12-22T08:51:16.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.473+0000 7f7d9179f640 1 -- 172.21.15.38:0/3434072675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d8c155280 con 0x7f7d8c148e80 2023-12-22T08:51:16.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.473+0000 7f7d837fe640 1 -- 172.21.15.38:0/3434072675 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v164) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d740573c0 con 0x7f7d8c148e80 2023-12-22T08:51:16.474 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:51:16.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.476+0000 7f7d9179f640 1 -- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d6c06a460 msgr2=0x7f7d6c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:16.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.477+0000 7f7d9179f640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d6c06a460 0x7f7d6c06c920 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00a490 tx=0x7f7d7c00a040 comp rx=0 tx=0).stop 2023-12-22T08:51:16.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.477+0000 7f7d9179f640 1 -- 172.21.15.38:0/3434072675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c148e80 msgr2=0x7f7d8c06e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:16.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.477+0000 7f7d9179f640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c148e80 0x7f7d8c06e0b0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400e780 tx=0x7f7d7400ec40 comp rx=0 tx=0).stop 2023-12-22T08:51:16.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.477+0000 7f7d9179f640 1 -- 172.21.15.38:0/3434072675 shutdown_connections 2023-12-22T08:51:16.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.477+0000 7f7d9179f640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d8c1555d0 0x7f7d8c152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.477+0000 7f7d9179f640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7d6c06a460 0x7f7d6c06c920 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.477+0000 7f7d9179f640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c148e80 0x7f7d8c06e0b0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.477+0000 7f7d9179f640 1 --2- 172.21.15.38:0/3434072675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d78006f10 0x7f7d8c14fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.477+0000 7f7d9179f640 1 -- 172.21.15.38:0/3434072675 >> 172.21.15.38:0/3434072675 conn(0x7f7d8c0b20c0 msgr2=0x7f7d8c0af610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:16.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.477+0000 7f7d9179f640 1 -- 172.21.15.38:0/3434072675 shutdown_connections 2023-12-22T08:51:16.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.477+0000 7f7d9179f640 1 -- 172.21.15.38:0/3434072675 wait complete. 2023-12-22T08:51:16.496 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-12-22T08:51:16.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.718+0000 7f227b59e640 1 Processor -- start 2023-12-22T08:51:16.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.718+0000 7f227b59e640 1 -- start start 2023-12-22T08:51:16.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.720+0000 7f227b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f227c0a44a0 0x7f227c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.720+0000 7f227b59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f227c070e30 0x7f227c15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.720+0000 7f227b59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c0cdae0 con 0x7f227c15b420 2023-12-22T08:51:16.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.720+0000 7f227b59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c071260 con 0x7f227c070e30 2023-12-22T08:51:16.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.720+0000 7f227b59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c15b800 con 0x7f227c0a44a0 2023-12-22T08:51:16.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.720+0000 7f227a59c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f227c15b420 0x7f227c06d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45980/0 (socket says 172.21.15.38:45980) 2023-12-22T08:51:16.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.720+0000 7f227a59c640 1 -- 172.21.15.38:0/435398066 learned_addr learned my addr 172.21.15.38:0/435398066 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:16.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f227ad9d640 1 --2- 172.21.15.38:0/435398066 >> v2:172.21.15.89:3300/0 conn(0x7f227c070e30 0x7f227c15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201092337 0 0) 0x7f227c0cdae0 con 0x7f227c15b420 2023-12-22T08:51:16.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2268003520 con 0x7f227c15b420 2023-12-22T08:51:16.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2271d9b640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f227c0a44a0 0x7f227c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 449566531 0 0) 0x7f2268003520 con 0x7f227c15b420 2023-12-22T08:51:16.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f227c0a44a0 msgr2=0x7f227c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:16.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f227c0a44a0 0x7f227c0708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 >> v2:172.21.15.89:3300/0 conn(0x7f227c070e30 msgr2=0x7f227c15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 --2- 172.21.15.38:0/435398066 >> v2:172.21.15.89:3300/0 conn(0x7f227c070e30 0x7f227c15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c0cdd30 con 0x7f227c15b420 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f226c001670 con 0x7f227c15b420 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 >> v1:172.21.15.38:6789/0 conn(0x7f227c15b420 legacy=0x7f227c06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2268003970 0x7f2268003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22680047c0 0x7f2268004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2268005180 0x7f226800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c071260 con 0x7f2268003970 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c15b800 con 0x7f22680047c0 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226800bff0 con 0x7f2268005180 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f227ad9d640 1 --2- 172.21.15.38:0/435398066 >> v2:172.21.15.89:3300/0 conn(0x7f227c070e30 0x7f227c15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f2271d9b640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f227c0a44a0 0x7f227c0708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.721+0000 7f227a59c640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2268003970 0x7f2268003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.722+0000 7f227ad9d640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2268005180 0x7f226800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.722+0000 7f2271d9b640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22680047c0 0x7f2268004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.722+0000 7f227a59c640 1 -- 172.21.15.38:0/435398066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2268005180 msgr2=0x7f226800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.722+0000 7f227a59c640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2268005180 0x7f226800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.722+0000 7f227a59c640 1 -- 172.21.15.38:0/435398066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22680047c0 msgr2=0x7f2268004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.722+0000 7f227a59c640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22680047c0 0x7f2268004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.722+0000 7f227a59c640 1 -- 172.21.15.38:0/435398066 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2268003520 con 0x7f2268003970 2023-12-22T08:51:16.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.722+0000 7f2271d9b640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22680047c0 0x7f2268004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:16.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.723+0000 7f227a59c640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2268003970 0x7f2268003d90 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c110 tx=0x7f22680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf76a81eb057999c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:16.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.724+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c005ad0 con 0x7f2268003970 2023-12-22T08:51:16.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.724+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c005c50 con 0x7f2268003970 2023-12-22T08:51:16.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.724+0000 7f2279d9b640 1 -- 172.21.15.38:0/435398066 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c02c830 con 0x7f2268003970 2023-12-22T08:51:16.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.724+0000 7f227b59e640 1 -- 172.21.15.38:0/435398066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2268003970 msgr2=0x7f2268003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:16.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.724+0000 7f227b59e640 1 --2- 172.21.15.38:0/435398066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2268003970 0x7f2268003d90 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c110 tx=0x7f22680057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.724+0000 7f227ad9d640 1 -- 172.21.15.38:0/435398066 reap_dead start 2023-12-22T08:51:16.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.724+0000 7f227b59e640 1 -- 172.21.15.38:0/435398066 shutdown_connections 2023-12-22T08:51:16.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.724+0000 7f227b59e640 1 -- 172.21.15.38:0/435398066 >> 172.21.15.38:0/435398066 conn(0x7f227c0b1f70 msgr2=0x7f227c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:16.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.724+0000 7f227b59e640 1 -- 172.21.15.38:0/435398066 shutdown_connections 2023-12-22T08:51:16.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.724+0000 7f227b59e640 1 -- 172.21.15.38:0/435398066 wait complete. 2023-12-22T08:51:16.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.726+0000 7f227b59e640 1 Processor -- start 2023-12-22T08:51:16.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.726+0000 7f227b59e640 1 -- start start 2023-12-22T08:51:16.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.727+0000 7f227b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2268003970 0x7f227c155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.727+0000 7f227b59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f227c0b03b0 0x7f227c1e7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.727+0000 7f227b59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227c1e8500 0x7f227c0cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.727+0000 7f227b59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c155b90 con 0x7f227c1e8500 2023-12-22T08:51:16.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.727+0000 7f227b59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c1e8980 con 0x7f227c0b03b0 2023-12-22T08:51:16.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.727+0000 7f227b59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c0a2180 con 0x7f2268003970 2023-12-22T08:51:16.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.728+0000 7f227ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227c1e8500 0x7f227c0cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.728+0000 7f227ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227c1e8500 0x7f227c0cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37258/0 (socket says 172.21.15.38:37258) 2023-12-22T08:51:16.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.728+0000 7f227ad9d640 1 -- 172.21.15.38:0/2501813587 learned_addr learned my addr 172.21.15.38:0/2501813587 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:16.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.728+0000 7f227a59c640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2268003970 0x7f227c155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.728+0000 7f2271d9b640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f227c0b03b0 0x7f227c1e7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.728+0000 7f227ad9d640 1 -- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2268003970 msgr2=0x7f227c155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:16.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.728+0000 7f227ad9d640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2268003970 0x7f227c155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.728+0000 7f227ad9d640 1 -- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f227c0b03b0 msgr2=0x7f227c1e7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:16.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.728+0000 7f227ad9d640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f227c0b03b0 0x7f227c1e7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:16.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.728+0000 7f227ad9d640 1 -- 172.21.15.38:0/2501813587 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c0a23f0 con 0x7f227c1e8500 2023-12-22T08:51:16.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.729+0000 7f227ad9d640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227c1e8500 0x7f227c0cb8d0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f227c06bbc0 tx=0x7f2274004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:16.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.729+0000 7f22737fe640 1 -- 172.21.15.38:0/2501813587 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274007ca0 con 0x7f227c1e8500 2023-12-22T08:51:16.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.729+0000 7f22737fe640 1 -- 172.21.15.38:0/2501813587 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2274007e00 con 0x7f227c1e8500 2023-12-22T08:51:16.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.729+0000 7f227b59e640 1 -- 172.21.15.38:0/2501813587 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c0a26d0 con 0x7f227c1e8500 2023-12-22T08:51:16.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.729+0000 7f22737fe640 1 -- 172.21.15.38:0/2501813587 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2274014640 con 0x7f227c1e8500 2023-12-22T08:51:16.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.729+0000 7f227b59e640 1 -- 172.21.15.38:0/2501813587 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c0b0830 con 0x7f227c1e8500 2023-12-22T08:51:16.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.730+0000 7f227b59e640 1 -- 172.21.15.38:0/2501813587 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c0a2bf0 con 0x7f227c1e8500 2023-12-22T08:51:16.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.731+0000 7f22737fe640 1 -- 172.21.15.38:0/2501813587 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f227401e440 con 0x7f227c1e8500 2023-12-22T08:51:16.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.732+0000 7f22737fe640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f225c06a460 0x7f225c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:16.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.732+0000 7f22737fe640 1 -- 172.21.15.38:0/2501813587 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f22740882b0 con 0x7f227c1e8500 2023-12-22T08:51:16.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.733+0000 7f227a59c640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f225c06a460 0x7f225c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:16.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.734+0000 7f227a59c640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f225c06a460 0x7f225c06c920 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c110 tx=0x7f226c007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:16.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:16.737+0000 7f22737fe640 1 -- 172.21.15.38:0/2501813587 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f227c0a2bf0 con 0x7f227c1e8500 2023-12-22T08:51:17.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.005+0000 7f227b59e640 1 -- 172.21.15.38:0/2501813587 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f227c0a2bf0 con 0x7f227c1e8500 2023-12-22T08:51:17.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.538+0000 7f22737fe640 1 -- 172.21.15.38:0/2501813587 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v550) v1 ==== 134+0+0 (secure 0 0 0) 0x7f227c0a2bf0 con 0x7f227c1e8500 2023-12-22T08:51:17.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.541+0000 7f227b59e640 1 -- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f225c06a460 msgr2=0x7f225c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:17.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.541+0000 7f227b59e640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f225c06a460 0x7f225c06c920 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c110 tx=0x7f226c007000 comp rx=0 tx=0).stop 2023-12-22T08:51:17.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.541+0000 7f227b59e640 1 -- 172.21.15.38:0/2501813587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227c1e8500 msgr2=0x7f227c0cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:17.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.541+0000 7f227b59e640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227c1e8500 0x7f227c0cb8d0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f227c06bbc0 tx=0x7f2274004770 comp rx=0 tx=0).stop 2023-12-22T08:51:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.542+0000 7f227b59e640 1 -- 172.21.15.38:0/2501813587 shutdown_connections 2023-12-22T08:51:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.542+0000 7f227b59e640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f225c06a460 0x7f225c06c920 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.542+0000 7f227b59e640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f227c1e8500 0x7f227c0cb8d0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:17.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.542+0000 7f227b59e640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f227c0b03b0 0x7f227c1e7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.542+0000 7f227b59e640 1 --2- 172.21.15.38:0/2501813587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2268003970 0x7f227c155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.542+0000 7f227b59e640 1 -- 172.21.15.38:0/2501813587 >> 172.21.15.38:0/2501813587 conn(0x7f227c0b1f70 msgr2=0x7f227c15ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.542+0000 7f227b59e640 1 -- 172.21.15.38:0/2501813587 shutdown_connections 2023-12-22T08:51:17.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.542+0000 7f227b59e640 1 -- 172.21.15.38:0/2501813587 wait complete. 2023-12-22T08:51:17.563 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T08:51:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.784+0000 7f76dec2d640 1 Processor -- start 2023-12-22T08:51:17.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.784+0000 7f76dec2d640 1 -- start start 2023-12-22T08:51:17.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.786+0000 7f76dec2d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f76d8070f10 0x7f76d806f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:17.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.786+0000 7f76dec2d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76d806f790 0x7f76d80712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:17.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.786+0000 7f76dec2d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d8161ba0 con 0x7f76d80ae6a0 2023-12-22T08:51:17.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.786+0000 7f76dec2d640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d80acc00 con 0x7f76d8070f10 2023-12-22T08:51:17.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.786+0000 7f76dec2d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80acea0 con 0x7f76d806f790 2023-12-22T08:51:17.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.786+0000 7f76de42c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f76d80ae6a0 0x7f76d806c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:45988/0 (socket says 172.21.15.38:45988) 2023-12-22T08:51:17.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.786+0000 7f76de42c640 1 -- 172.21.15.38:0/1714689795 learned_addr learned my addr 172.21.15.38:0/1714689795 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:17.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.787+0000 7f76ddc2b640 1 --2- 172.21.15.38:0/1714689795 >> v2:172.21.15.89:3300/0 conn(0x7f76d8070f10 0x7f76d806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:17.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.787+0000 7f76dd42a640 1 --2- 172.21.15.38:0/1714689795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76d806f790 0x7f76d80712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.787+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131061057 0 0) 0x7f76d0001490 con 0x7f76d80ae6a0 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.787+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c4003520 con 0x7f76d80ae6a0 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.787+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3923417855 0 0) 0x7f76c4003520 con 0x7f76d80ae6a0 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.787+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76d806f790 msgr2=0x7f76d80712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.787+0000 7f76dcc29640 1 --2- 172.21.15.38:0/1714689795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76d806f790 0x7f76d80712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.787+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 >> v2:172.21.15.89:3300/0 conn(0x7f76d8070f10 msgr2=0x7f76d806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.787+0000 7f76dcc29640 1 --2- 172.21.15.38:0/1714689795 >> v2:172.21.15.89:3300/0 conn(0x7f76d8070f10 0x7f76d806f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.787+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d80ad180 con 0x7f76d80ae6a0 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.787+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f76d0001b80 con 0x7f76d80ae6a0 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.787+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 >> v1:172.21.15.38:6789/0 conn(0x7f76d80ae6a0 legacy=0x7f76d806c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76dcc29640 1 --2- 172.21.15.38:0/1714689795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c4003970 0x7f76c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76dcc29640 1 --2- 172.21.15.38:0/1714689795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76c40047c0 0x7f76c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76dcc29640 1 --2- 172.21.15.38:0/1714689795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76d806f790 0x7f76c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:17.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80acc00 con 0x7f76c4003970 2023-12-22T08:51:17.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80acea0 con 0x7f76c40047c0 2023-12-22T08:51:17.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c400b980 con 0x7f76d806f790 2023-12-22T08:51:17.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76ddc2b640 1 --2- 172.21.15.38:0/1714689795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c4003970 0x7f76c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:17.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76dd42a640 1 --2- 172.21.15.38:0/1714689795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76c40047c0 0x7f76c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:17.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76ddc2b640 1 -- 172.21.15.38:0/1714689795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76d806f790 msgr2=0x7f76c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:17.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76ddc2b640 1 --2- 172.21.15.38:0/1714689795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76d806f790 0x7f76c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:17.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76ddc2b640 1 -- 172.21.15.38:0/1714689795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76c40047c0 msgr2=0x7f76c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:17.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76ddc2b640 1 --2- 172.21.15.38:0/1714689795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76c40047c0 0x7f76c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:17.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76ddc2b640 1 -- 172.21.15.38:0/1714689795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4003520 con 0x7f76c4003970 2023-12-22T08:51:17.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.788+0000 7f76dd42a640 1 --2- 172.21.15.38:0/1714689795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76c40047c0 0x7f76c4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:17.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.789+0000 7f76ddc2b640 1 --2- 172.21.15.38:0/1714689795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c4003970 0x7f76c4003d90 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009af0 tx=0x7f76c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930a3b043d2abf2c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:17.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.790+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d402c710 con 0x7f76c4003970 2023-12-22T08:51:17.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.790+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d402c870 con 0x7f76c4003970 2023-12-22T08:51:17.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.790+0000 7f76dcc29640 1 -- 172.21.15.38:0/1714689795 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d402cc00 con 0x7f76c4003970 2023-12-22T08:51:17.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.790+0000 7f76dec2d640 1 -- 172.21.15.38:0/1714689795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c4003970 msgr2=0x7f76c4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:17.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.790+0000 7f76dec2d640 1 --2- 172.21.15.38:0/1714689795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76c4003970 0x7f76c4003d90 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009af0 tx=0x7f76c40057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:17.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.790+0000 7f76de42c640 1 -- 172.21.15.38:0/1714689795 reap_dead start 2023-12-22T08:51:17.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.790+0000 7f76dec2d640 1 -- 172.21.15.38:0/1714689795 shutdown_connections 2023-12-22T08:51:17.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.790+0000 7f76dec2d640 1 -- 172.21.15.38:0/1714689795 >> 172.21.15.38:0/1714689795 conn(0x7f76d80b0b60 msgr2=0x7f76d80b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:17.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.790+0000 7f76dec2d640 1 -- 172.21.15.38:0/1714689795 shutdown_connections 2023-12-22T08:51:17.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.790+0000 7f76dec2d640 1 -- 172.21.15.38:0/1714689795 wait complete. 2023-12-22T08:51:17.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.792+0000 7f76dec2d640 1 Processor -- start 2023-12-22T08:51:17.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.792+0000 7f76dec2d640 1 -- start start 2023-12-22T08:51:17.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.793+0000 7f76dec2d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76c4003970 0x7f76d81f7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:17.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.793+0000 7f76dec2d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d809c960 0x7f76d814b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:17.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.793+0000 7f76dec2d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d81fa0b0 0x7f76d81fa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:17.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.793+0000 7f76dec2d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d81faaa0 con 0x7f76d81fa0b0 2023-12-22T08:51:17.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.793+0000 7f76dec2d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d81f7a80 con 0x7f76d809c960 2023-12-22T08:51:17.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.793+0000 7f76dec2d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d809ce90 con 0x7f76c4003970 2023-12-22T08:51:17.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.794+0000 7f76de42c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d81fa0b0 0x7f76d81fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:17.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.794+0000 7f76de42c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d81fa0b0 0x7f76d81fa560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37286/0 (socket says 172.21.15.38:37286) 2023-12-22T08:51:17.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.794+0000 7f76de42c640 1 -- 172.21.15.38:0/938527594 learned_addr learned my addr 172.21.15.38:0/938527594 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:17.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.794+0000 7f76ddc2b640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76c4003970 0x7f76d81f7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:17.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.794+0000 7f76dd42a640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d809c960 0x7f76d814b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:17.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.794+0000 7f76de42c640 1 -- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76c4003970 msgr2=0x7f76d81f7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:17.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.794+0000 7f76de42c640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76c4003970 0x7f76d81f7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:17.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.794+0000 7f76de42c640 1 -- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d809c960 msgr2=0x7f76d814b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:17.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.794+0000 7f76de42c640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d809c960 0x7f76d814b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:17.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.794+0000 7f76de42c640 1 -- 172.21.15.38:0/938527594 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8159b40 con 0x7f76d81fa0b0 2023-12-22T08:51:17.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.794+0000 7f76dd42a640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d809c960 0x7f76d814b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:17.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.794+0000 7f76de42c640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d81fa0b0 0x7f76d81fa560 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f76d80ac100 tx=0x7f76d000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:17.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.795+0000 7f76ce7fc640 1 -- 172.21.15.38:0/938527594 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0004d60 con 0x7f76d81fa0b0 2023-12-22T08:51:17.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.795+0000 7f76ce7fc640 1 -- 172.21.15.38:0/938527594 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d000a610 con 0x7f76d81fa0b0 2023-12-22T08:51:17.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.795+0000 7f76ce7fc640 1 -- 172.21.15.38:0/938527594 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d000a9c0 con 0x7f76d81fa0b0 2023-12-22T08:51:17.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.795+0000 7f76dec2d640 1 -- 172.21.15.38:0/938527594 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d8159e20 con 0x7f76d81fa0b0 2023-12-22T08:51:17.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.795+0000 7f76dec2d640 1 -- 172.21.15.38:0/938527594 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d815a3e0 con 0x7f76d81fa0b0 2023-12-22T08:51:17.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.796+0000 7f76dec2d640 1 -- 172.21.15.38:0/938527594 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d815a600 con 0x7f76d81fa0b0 2023-12-22T08:51:17.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.797+0000 7f76ce7fc640 1 -- 172.21.15.38:0/938527594 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f76d000ab20 con 0x7f76d81fa0b0 2023-12-22T08:51:17.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.798+0000 7f76ce7fc640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76bc06a460 0x7f76bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:17.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.798+0000 7f76ce7fc640 1 -- 172.21.15.38:0/938527594 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f76d0088090 con 0x7f76d81fa0b0 2023-12-22T08:51:17.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.798+0000 7f76ddc2b640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76bc06a460 0x7f76bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:17.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.799+0000 7f76ddc2b640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76bc06a460 0x7f76bc06c920 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f76d4036000 tx=0x7f76d4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:17.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.802+0000 7f76ce7fc640 1 -- 172.21.15.38:0/938527594 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f76d0053970 con 0x7f76d81fa0b0 2023-12-22T08:51:17.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:17.996+0000 7f76dec2d640 1 -- 172.21.15.38:0/938527594 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f76d8161ba0 con 0x7f76d81fa0b0 2023-12-22T08:51:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.005+0000 7f76ce7fc640 1 -- 172.21.15.38:0/938527594 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f76d8161ba0 con 0x7f76d81fa0b0 2023-12-22T08:51:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.008+0000 7f76dec2d640 1 -- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76bc06a460 msgr2=0x7f76bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.008+0000 7f76dec2d640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76bc06a460 0x7f76bc06c920 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f76d4036000 tx=0x7f76d4030000 comp rx=0 tx=0).stop 2023-12-22T08:51:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.008+0000 7f76dec2d640 1 -- 172.21.15.38:0/938527594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d81fa0b0 msgr2=0x7f76d81fa560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.008+0000 7f76dec2d640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d81fa0b0 0x7f76d81fa560 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f76d80ac100 tx=0x7f76d000cb90 comp rx=0 tx=0).stop 2023-12-22T08:51:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.008+0000 7f76dec2d640 1 -- 172.21.15.38:0/938527594 shutdown_connections 2023-12-22T08:51:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.008+0000 7f76dec2d640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76bc06a460 0x7f76bc06c920 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.008+0000 7f76dec2d640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d81fa0b0 0x7f76d81fa560 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.008+0000 7f76dec2d640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d809c960 0x7f76d814b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.008+0000 7f76dec2d640 1 --2- 172.21.15.38:0/938527594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76c4003970 0x7f76d81f7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.008+0000 7f76dec2d640 1 -- 172.21.15.38:0/938527594 >> 172.21.15.38:0/938527594 conn(0x7f76d80b0b60 msgr2=0x7f76d815f670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.008+0000 7f76dec2d640 1 -- 172.21.15.38:0/938527594 shutdown_connections 2023-12-22T08:51:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.008+0000 7f76dec2d640 1 -- 172.21.15.38:0/938527594 wait complete. 2023-12-22T08:51:18.029 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:51:18.029 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:51:18.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:51:18.288 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:51:18.289 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:51:18.289 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:51:18.354 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:51:18.355 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:51:18.355 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:51:18.414 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:51:18.415 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:51:18.415 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:51:18.479 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:51:18.479 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:51:18.479 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:51:18.539 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:51:18.539 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-22T08:51:18.540 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:51:18.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.776+0000 7fc49c7ae640 1 Processor -- start 2023-12-22T08:51:18.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.776+0000 7fc49c7ae640 1 -- start start 2023-12-22T08:51:18.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.778+0000 7fc49c7ae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4941547a0 0x7fc49415b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:18.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.778+0000 7fc49c7ae640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc494071b90 0x7fc494070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:18.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.778+0000 7fc49c7ae640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc494154b80 0x7fc4940ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:18.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.778+0000 7fc49c7ae640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4940716a0 con 0x7fc494071b90 2023-12-22T08:51:18.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.778+0000 7fc49c7ae640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4940710e0 con 0x7fc494154b80 2023-12-22T08:51:18.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.778+0000 7fc49c7ae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4940713c0 con 0x7fc4941547a0 2023-12-22T08:51:18.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.778+0000 7fc499d49640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc494071b90 0x7fc494070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:18.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.778+0000 7fc499d49640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc494071b90 0x7fc494070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37300/0 (socket says 172.21.15.38:37300) 2023-12-22T08:51:18.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.778+0000 7fc499d49640 1 -- 172.21.15.38:0/2860609392 learned_addr learned my addr 172.21.15.38:0/2860609392 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:18.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.779+0000 7fc49a54a640 1 --2- 172.21.15.38:0/2860609392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4941547a0 0x7fc49415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:18.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.779+0000 7fc49ad4b640 1 --2- 172.21.15.38:0/2860609392 >> v2:172.21.15.89:3300/0 conn(0x7fc494154b80 0x7fc4940ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:18.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.779+0000 7fc499d49640 1 -- 172.21.15.38:0/2860609392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4941547a0 msgr2=0x7fc49415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:18.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.779+0000 7fc499d49640 1 --2- 172.21.15.38:0/2860609392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4941547a0 0x7fc49415b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:18.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.779+0000 7fc499d49640 1 -- 172.21.15.38:0/2860609392 >> v2:172.21.15.89:3300/0 conn(0x7fc494154b80 msgr2=0x7fc4940ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:18.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.779+0000 7fc499d49640 1 --2- 172.21.15.38:0/2860609392 >> v2:172.21.15.89:3300/0 conn(0x7fc494154b80 0x7fc4940ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:18.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.779+0000 7fc499d49640 1 -- 172.21.15.38:0/2860609392 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49415ab00 con 0x7fc494071b90 2023-12-22T08:51:18.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.780+0000 7fc499d49640 1 --2- 172.21.15.38:0/2860609392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc494071b90 0x7fc494070770 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc4940b4a30 tx=0x7fc48402b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ffca06a852b9e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:18.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.780+0000 7fc499548640 1 -- 172.21.15.38:0/2860609392 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484031880 con 0x7fc494071b90 2023-12-22T08:51:18.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.780+0000 7fc499548640 1 -- 172.21.15.38:0/2860609392 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4840319e0 con 0x7fc494071b90 2023-12-22T08:51:18.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.780+0000 7fc499548640 1 -- 172.21.15.38:0/2860609392 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484031d70 con 0x7fc494071b90 2023-12-22T08:51:18.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.781+0000 7fc49c7ae640 1 -- 172.21.15.38:0/2860609392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc494071b90 msgr2=0x7fc494070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:18.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.781+0000 7fc49c7ae640 1 --2- 172.21.15.38:0/2860609392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc494071b90 0x7fc494070770 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc4940b4a30 tx=0x7fc48402b920 comp rx=0 tx=0).stop 2023-12-22T08:51:18.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.781+0000 7fc49c7ae640 1 -- 172.21.15.38:0/2860609392 shutdown_connections 2023-12-22T08:51:18.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.781+0000 7fc49c7ae640 1 --2- 172.21.15.38:0/2860609392 >> v2:172.21.15.89:3300/0 conn(0x7fc494154b80 0x7fc4940ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:18.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.781+0000 7fc49c7ae640 1 --2- 172.21.15.38:0/2860609392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc494071b90 0x7fc494070770 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:18.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.781+0000 7fc49c7ae640 1 --2- 172.21.15.38:0/2860609392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4941547a0 0x7fc49415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:18.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.781+0000 7fc49c7ae640 1 -- 172.21.15.38:0/2860609392 >> 172.21.15.38:0/2860609392 conn(0x7fc4940cf070 msgr2=0x7fc4940cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:18.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.781+0000 7fc49c7ae640 1 -- 172.21.15.38:0/2860609392 shutdown_connections 2023-12-22T08:51:18.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.781+0000 7fc49c7ae640 1 -- 172.21.15.38:0/2860609392 wait complete. 2023-12-22T08:51:18.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.783+0000 7fc49c7ae640 1 Processor -- start 2023-12-22T08:51:18.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.783+0000 7fc49c7ae640 1 -- start start 2023-12-22T08:51:18.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.784+0000 7fc49c7ae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc494071b90 0x7fc494141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:18.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.784+0000 7fc49c7ae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4941547a0 0x7fc49414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:18.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.784+0000 7fc49c7ae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc494154b80 0x7fc494159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:18.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.784+0000 7fc49c7ae640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4940aefc0 con 0x7fc494154b80 2023-12-22T08:51:18.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.784+0000 7fc49c7ae640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49414f2d0 con 0x7fc4941547a0 2023-12-22T08:51:18.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.784+0000 7fc49c7ae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4940af210 con 0x7fc494071b90 2023-12-22T08:51:18.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.784+0000 7fc49ad4b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc494154b80 0x7fc494159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:18.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.784+0000 7fc49ad4b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc494154b80 0x7fc494159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37306/0 (socket says 172.21.15.38:37306) 2023-12-22T08:51:18.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.784+0000 7fc49ad4b640 1 -- 172.21.15.38:0/58112742 learned_addr learned my addr 172.21.15.38:0/58112742 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:18.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc49a54a640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc494071b90 0x7fc494141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:18.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc499d49640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4941547a0 0x7fc49414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:18.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc49ad4b640 1 -- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc494071b90 msgr2=0x7fc494141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:18.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc49ad4b640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc494071b90 0x7fc494141ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:18.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc49ad4b640 1 -- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4941547a0 msgr2=0x7fc49414e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:18.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc49ad4b640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4941547a0 0x7fc49414e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:18.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc49ad4b640 1 -- 172.21.15.38:0/58112742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840094d0 con 0x7fc494154b80 2023-12-22T08:51:18.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc499d49640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4941547a0 0x7fc49414e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:18.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc49a54a640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc494071b90 0x7fc494141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:18.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc49ad4b640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc494154b80 0x7fc494159430 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00cc30 tx=0x7fc48c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:18.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc48affd640 1 -- 172.21.15.38:0/58112742 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c00ce40 con 0x7fc494154b80 2023-12-22T08:51:18.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc48affd640 1 -- 172.21.15.38:0/58112742 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c003990 con 0x7fc494154b80 2023-12-22T08:51:18.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc48affd640 1 -- 172.21.15.38:0/58112742 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c003d20 con 0x7fc494154b80 2023-12-22T08:51:18.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.785+0000 7fc49c7ae640 1 -- 172.21.15.38:0/58112742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4940af4f0 con 0x7fc494154b80 2023-12-22T08:51:18.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.786+0000 7fc49c7ae640 1 -- 172.21.15.38:0/58112742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc494142000 con 0x7fc494154b80 2023-12-22T08:51:18.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.787+0000 7fc49c7ae640 1 -- 172.21.15.38:0/58112742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4940afa10 con 0x7fc494154b80 2023-12-22T08:51:18.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.788+0000 7fc48affd640 1 -- 172.21.15.38:0/58112742 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc48c003e80 con 0x7fc494154b80 2023-12-22T08:51:18.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.789+0000 7fc48affd640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc47806a430 0x7fc47806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:18.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.789+0000 7fc48affd640 1 -- 172.21.15.38:0/58112742 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc48c088a80 con 0x7fc494154b80 2023-12-22T08:51:18.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.790+0000 7fc49a54a640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc47806a430 0x7fc47806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:18.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.791+0000 7fc49a54a640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc47806a430 0x7fc47806c8f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc490006fd0 tx=0x7fc490008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:18.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:18.793+0000 7fc48affd640 1 -- 172.21.15.38:0/58112742 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc4940afa10 con 0x7fc494154b80 2023-12-22T08:51:19.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.021+0000 7fc49c7ae640 1 -- 172.21.15.38:0/58112742 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4940afa10 con 0x7fc494154b80 2023-12-22T08:51:19.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.022+0000 7fc48affd640 1 -- 172.21.15.38:0/58112742 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+3523 (secure 0 0 0) 0x7fc4940afa10 con 0x7fc494154b80 2023-12-22T08:51:19.023 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:19.024 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/52711154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":52711154},{"type":"v1","addr":"172.21.15.89:6837","nonce":52711154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/2264719173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":2264719173},{"type":"v1","addr":"172.21.15.38:6835","nonce":2264719173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":6673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/3546762659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3546762659},{"type":"v1","addr":"172.21.15.89:6836","nonce":3546762659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8475,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/1077060377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1077060377},{"type":"v1","addr":"172.21.15.38:6833","nonce":1077060377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[]} 2023-12-22T08:51:19.024 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 72 2023-12-22T08:51:19.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.025+0000 7fc49c7ae640 1 -- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc47806a430 msgr2=0x7fc47806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:19.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.025+0000 7fc49c7ae640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc47806a430 0x7fc47806c8f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc490006fd0 tx=0x7fc490008040 comp rx=0 tx=0).stop 2023-12-22T08:51:19.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.025+0000 7fc49c7ae640 1 -- 172.21.15.38:0/58112742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc494154b80 msgr2=0x7fc494159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:19.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.025+0000 7fc49c7ae640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc494154b80 0x7fc494159430 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00cc30 tx=0x7fc48c00a5c0 comp rx=0 tx=0).stop 2023-12-22T08:51:19.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.025+0000 7fc49c7ae640 1 -- 172.21.15.38:0/58112742 shutdown_connections 2023-12-22T08:51:19.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.025+0000 7fc49c7ae640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc47806a430 0x7fc47806c8f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:19.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.025+0000 7fc49c7ae640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc494154b80 0x7fc494159430 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:19.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.025+0000 7fc49c7ae640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4941547a0 0x7fc49414e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:19.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.025+0000 7fc49c7ae640 1 --2- 172.21.15.38:0/58112742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc494071b90 0x7fc494141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:19.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.025+0000 7fc49c7ae640 1 -- 172.21.15.38:0/58112742 >> 172.21.15.38:0/58112742 conn(0x7fc4940cf070 msgr2=0x7fc4940cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:19.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.025+0000 7fc49c7ae640 1 -- 172.21.15.38:0/58112742 shutdown_connections 2023-12-22T08:51:19.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.025+0000 7fc49c7ae640 1 -- 172.21.15.38:0/58112742 wait complete. 2023-12-22T08:51:19.050 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T08:51:19.050 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T08:51:19.050 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T08:51:19.051 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:51:19.051 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T08:51:19.051 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T08:51:19.051 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T08:51:19.051 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:51:19.051 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T08:51:19.051 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T08:51:19.052 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T08:51:19.052 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:51:19.052 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T08:51:19.052 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T08:51:19.052 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T08:51:19.052 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:51:19.069 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T08:51:19.070 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T08:51:19.076 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T08:51:19.076 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T08:51:19.077 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T08:51:19.077 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T08:51:19.078 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T08:51:19.078 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T08:51:19.126 INFO:tasks.ceph.mds.b:Started 2023-12-22T08:51:19.126 DEBUG:teuthology.parallel:result is None 2023-12-22T08:51:19.127 INFO:tasks.ceph.mds.a:Started 2023-12-22T08:51:19.127 DEBUG:teuthology.parallel:result is None 2023-12-22T08:51:19.133 INFO:tasks.ceph.mds.d:Started 2023-12-22T08:51:19.133 DEBUG:teuthology.parallel:result is None 2023-12-22T08:51:19.135 INFO:tasks.ceph.mds.c:Started 2023-12-22T08:51:19.135 DEBUG:teuthology.parallel:result is None 2023-12-22T08:51:19.135 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-22T08:51:19.290 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-22T08:51:19.291 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:51:19.292 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-12-22T08:51:19.295 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:51:19.305 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:51:19.310 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:51:19.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.338+0000 7f9b6911b640 1 Processor -- start 2023-12-22T08:51:19.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.338+0000 7f9b6911b640 1 -- start start 2023-12-22T08:51:19.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.339+0000 7f9b6911b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b641547a0 0x7f9b6415b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:19.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.340+0000 7f9b6911b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b640716a0 con 0x7f9b64071b90 2023-12-22T08:51:19.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.340+0000 7f9b6911b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b64070e80 con 0x7f9b64154b80 2023-12-22T08:51:19.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.340+0000 7f9b6911b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b640710e0 con 0x7f9b641547a0 2023-12-22T08:51:19.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.340+0000 7f9b5bfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9b64071b90 0x7f9b64070770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46004/0 (socket says 172.21.15.38:46004) 2023-12-22T08:51:19.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.340+0000 7f9b5bfff640 1 -- 172.21.15.38:0/3214163799 learned_addr learned my addr 172.21.15.38:0/3214163799 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:19.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.340+0000 7f9b62d9d640 1 --2- 172.21.15.38:0/3214163799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b641547a0 0x7f9b6415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:19.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.340+0000 7f9b6259c640 1 -- 172.21.15.38:0/3214163799 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446481366 0 0) 0x7f9b640716a0 con 0x7f9b64071b90 2023-12-22T08:51:19.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.341+0000 7f9b6259c640 1 -- 172.21.15.38:0/3214163799 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b50003520 con 0x7f9b64071b90 2023-12-22T08:51:19.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.341+0000 7f9b62d9d640 1 -- 172.21.15.38:0/3214163799 >> v1:172.21.15.89:6789/0 conn(0x7f9b64154b80 legacy=0x7f9b640ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:19.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.341+0000 7f9b6259c640 1 -- 172.21.15.38:0/3214163799 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886694107 0 0) 0x7f9b64070e80 con 0x7f9b64154b80 2023-12-22T08:51:19.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.341+0000 7f9b62d9d640 1 -- 172.21.15.38:0/3214163799 >> v1:172.21.15.38:6789/0 conn(0x7f9b64071b90 legacy=0x7f9b64070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:19.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.341+0000 7f9b62d9d640 1 -- 172.21.15.38:0/3214163799 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b640713c0 con 0x7f9b641547a0 2023-12-22T08:51:19.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.342+0000 7f9b62d9d640 1 --2- 172.21.15.38:0/3214163799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b641547a0 0x7f9b6415b300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9b540097d0 tx=0x7f9b5402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=249d05f6ef71c75 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:19.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.342+0000 7f9b6259c640 1 -- 172.21.15.38:0/3214163799 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54030710 con 0x7f9b641547a0 2023-12-22T08:51:19.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.343+0000 7f9b6259c640 1 -- 172.21.15.38:0/3214163799 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5402e050 con 0x7f9b641547a0 2023-12-22T08:51:19.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.343+0000 7f9b6259c640 1 -- 172.21.15.38:0/3214163799 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54030710 con 0x7f9b641547a0 2023-12-22T08:51:19.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.343+0000 7f9b6911b640 1 -- 172.21.15.38:0/3214163799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b641547a0 msgr2=0x7f9b6415b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:19.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.343+0000 7f9b6911b640 1 --2- 172.21.15.38:0/3214163799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b641547a0 0x7f9b6415b300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9b540097d0 tx=0x7f9b5402b800 comp rx=0 tx=0).stop 2023-12-22T08:51:19.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.343+0000 7f9b6911b640 1 -- 172.21.15.38:0/3214163799 shutdown_connections 2023-12-22T08:51:19.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.343+0000 7f9b6911b640 1 --2- 172.21.15.38:0/3214163799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b641547a0 0x7f9b6415b300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:19.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.343+0000 7f9b6911b640 1 -- 172.21.15.38:0/3214163799 >> 172.21.15.38:0/3214163799 conn(0x7f9b640cf070 msgr2=0x7f9b640cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:19.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.343+0000 7f9b6911b640 1 -- 172.21.15.38:0/3214163799 shutdown_connections 2023-12-22T08:51:19.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.343+0000 7f9b6911b640 1 -- 172.21.15.38:0/3214163799 wait complete. 2023-12-22T08:51:19.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.345+0000 7f9b6911b640 1 Processor -- start 2023-12-22T08:51:19.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.345+0000 7f9b6911b640 1 -- start start 2023-12-22T08:51:19.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.346+0000 7f9b6911b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b64071b90 0x7f9b64153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:19.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.346+0000 7f9b6911b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b641547a0 0x7f9b6406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:19.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.346+0000 7f9b6911b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b64154b80 0x7f9b64136670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:19.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.346+0000 7f9b6911b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64143490 con 0x7f9b64071b90 2023-12-22T08:51:19.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.346+0000 7f9b6911b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64142880 con 0x7f9b64154b80 2023-12-22T08:51:19.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.346+0000 7f9b6911b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b64142b60 con 0x7f9b641547a0 2023-12-22T08:51:19.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.347+0000 7f9b62d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b64071b90 0x7f9b64153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:19.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.347+0000 7f9b62d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b64071b90 0x7f9b64153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37350/0 (socket says 172.21.15.38:37350) 2023-12-22T08:51:19.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.347+0000 7f9b62d9d640 1 -- 172.21.15.38:0/1378190076 learned_addr learned my addr 172.21.15.38:0/1378190076 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:19.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.347+0000 7f9b5bfff640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b641547a0 0x7f9b6406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:19.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.347+0000 7f9b6359e640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b64154b80 0x7f9b64136670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:19.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.347+0000 7f9b62d9d640 1 -- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b641547a0 msgr2=0x7f9b6406d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:19.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.347+0000 7f9b62d9d640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b641547a0 0x7f9b6406d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:19.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.347+0000 7f9b62d9d640 1 -- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b64154b80 msgr2=0x7f9b64136670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:19.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.347+0000 7f9b62d9d640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b64154b80 0x7f9b64136670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:19.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.347+0000 7f9b62d9d640 1 -- 172.21.15.38:0/1378190076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009400 con 0x7f9b64071b90 2023-12-22T08:51:19.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.347+0000 7f9b5bfff640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b641547a0 0x7f9b6406d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:51:19.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.348+0000 7f9b62d9d640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b64071b90 0x7f9b64153d80 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f9b54035040 tx=0x7f9b540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:19.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.348+0000 7f9b5b7fe640 1 -- 172.21.15.38:0/1378190076 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54030710 con 0x7f9b64071b90 2023-12-22T08:51:19.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.348+0000 7f9b5b7fe640 1 -- 172.21.15.38:0/1378190076 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b54030890 con 0x7f9b64071b90 2023-12-22T08:51:19.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.348+0000 7f9b5b7fe640 1 -- 172.21.15.38:0/1378190076 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54030c40 con 0x7f9b64071b90 2023-12-22T08:51:19.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.348+0000 7f9b6911b640 1 -- 172.21.15.38:0/1378190076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b64142e40 con 0x7f9b64071b90 2023-12-22T08:51:19.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.348+0000 7f9b6911b640 1 -- 172.21.15.38:0/1378190076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b641542c0 con 0x7f9b64071b90 2023-12-22T08:51:19.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.349+0000 7f9b6911b640 1 -- 172.21.15.38:0/1378190076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b64061910 con 0x7f9b64071b90 2023-12-22T08:51:19.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.350+0000 7f9b5b7fe640 1 -- 172.21.15.38:0/1378190076 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9b54039050 con 0x7f9b64071b90 2023-12-22T08:51:19.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.352+0000 7f9b5b7fe640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9b4406a430 0x7f9b4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:19.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.352+0000 7f9b5b7fe640 1 -- 172.21.15.38:0/1378190076 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9b540aa0f0 con 0x7f9b64071b90 2023-12-22T08:51:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.352+0000 7f9b5bfff640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9b4406a430 0x7f9b4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.353+0000 7f9b5bfff640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9b4406a430 0x7f9b4406c8f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c007ac0 tx=0x7f9b4c007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:19.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.356+0000 7f9b5b7fe640 1 -- 172.21.15.38:0/1378190076 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9b540759f0 con 0x7f9b64071b90 2023-12-22T08:51:19.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:19.567+0000 7f9b6911b640 1 -- 172.21.15.38:0/1378190076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9b640cb950 con 0x7f9b64071b90 2023-12-22T08:51:20.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.563+0000 7f9b5b7fe640 1 -- 172.21.15.38:0/1378190076 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v169) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9b54037080 con 0x7f9b64071b90 2023-12-22T08:51:20.565 INFO:teuthology.orchestra.run.smithi038.stderr: removed all blocklist entries 2023-12-22T08:51:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.567+0000 7f9b6911b640 1 -- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9b4406a430 msgr2=0x7f9b4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.567+0000 7f9b6911b640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9b4406a430 0x7f9b4406c8f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c007ac0 tx=0x7f9b4c007a30 comp rx=0 tx=0).stop 2023-12-22T08:51:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.568+0000 7f9b6911b640 1 -- 172.21.15.38:0/1378190076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b64071b90 msgr2=0x7f9b64153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.568+0000 7f9b6911b640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b64071b90 0x7f9b64153d80 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f9b54035040 tx=0x7f9b540046c0 comp rx=0 tx=0).stop 2023-12-22T08:51:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.568+0000 7f9b6911b640 1 -- 172.21.15.38:0/1378190076 shutdown_connections 2023-12-22T08:51:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.568+0000 7f9b6911b640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b64154b80 0x7f9b64136670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.568+0000 7f9b6911b640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b641547a0 0x7f9b6406d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.568+0000 7f9b6911b640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9b4406a430 0x7f9b4406c8f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.568+0000 7f9b6911b640 1 --2- 172.21.15.38:0/1378190076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b64071b90 0x7f9b64153d80 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.568+0000 7f9b6911b640 1 -- 172.21.15.38:0/1378190076 >> 172.21.15.38:0/1378190076 conn(0x7f9b640cf070 msgr2=0x7f9b64145f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:20.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.568+0000 7f9b6911b640 1 -- 172.21.15.38:0/1378190076 shutdown_connections 2023-12-22T08:51:20.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.568+0000 7f9b6911b640 1 -- 172.21.15.38:0/1378190076 wait complete. 2023-12-22T08:51:20.591 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T08:51:20.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.810+0000 7f015759e640 1 Processor -- start 2023-12-22T08:51:20.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.810+0000 7f015759e640 1 -- start start 2023-12-22T08:51:20.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.811+0000 7f015759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f015806d210 0x7f015815e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:20.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.812+0000 7f015759e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01580706d0 con 0x7f015806d5f0 2023-12-22T08:51:20.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.812+0000 7f015759e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01580cbf40 con 0x7f01580cb4c0 2023-12-22T08:51:20.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.812+0000 7f015759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01580ce840 con 0x7f015806d210 2023-12-22T08:51:20.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.812+0000 7f0156d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f015806d5f0 0x7f0158070b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46010/0 (socket says 172.21.15.38:46010) 2023-12-22T08:51:20.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.812+0000 7f0156d9d640 1 -- 172.21.15.38:0/1354589820 learned_addr learned my addr 172.21.15.38:0/1354589820 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:20.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.812+0000 7f015659c640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f015806d210 0x7f015815e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:20.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.812+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721114789 0 0) 0x7f01580706d0 con 0x7f015806d5f0 2023-12-22T08:51:20.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0144003520 con 0x7f015806d5f0 2023-12-22T08:51:20.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3297359068 0 0) 0x7f0144003520 con 0x7f015806d5f0 2023-12-22T08:51:20.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f015806d210 msgr2=0x7f015815e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:20.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f015806d210 0x7f015815e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 >> v1:172.21.15.89:6789/0 conn(0x7f01580cb4c0 legacy=0x7f0158159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01580ceb20 con 0x7f015806d5f0 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f01500019f0 con 0x7f015806d5f0 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 >> v1:172.21.15.38:6789/0 conn(0x7f015806d5f0 legacy=0x7f0158070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01440039a0 0x7f0144003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f015806d210 0x7f01440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0144004d00 0x7f0144005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01580ce840 con 0x7f01440039a0 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014400ba60 con 0x7f0144004d00 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014400bc20 con 0x7f015806d210 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.813+0000 7f015659c640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01440039a0 0x7f0144003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.814+0000 7f014ffff640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f015806d210 0x7f01440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.814+0000 7f0156d9d640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0144004d00 0x7f0144005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.814+0000 7f015659c640 1 -- 172.21.15.38:0/1354589820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f015806d210 msgr2=0x7f01440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.814+0000 7f015659c640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f015806d210 0x7f01440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:20.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.814+0000 7f015659c640 1 -- 172.21.15.38:0/1354589820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0144004d00 msgr2=0x7f0144005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:20.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.814+0000 7f015659c640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0144004d00 0x7f0144005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:20.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.814+0000 7f015659c640 1 -- 172.21.15.38:0/1354589820 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0144003520 con 0x7f01440039a0 2023-12-22T08:51:20.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.814+0000 7f014ffff640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f015806d210 0x7f01440047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:20.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.814+0000 7f0156d9d640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0144004d00 0x7f0144005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.815+0000 7f015659c640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01440039a0 0x7f0144003dc0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f0148009a90 tx=0x7f01440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f739d9f2139af3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.815+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014802c680 con 0x7f01440039a0 2023-12-22T08:51:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.815+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014802c7e0 con 0x7f01440039a0 2023-12-22T08:51:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.815+0000 7f0155d9b640 1 -- 172.21.15.38:0/1354589820 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014802cb70 con 0x7f01440039a0 2023-12-22T08:51:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.816+0000 7f015759e640 1 -- 172.21.15.38:0/1354589820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01440039a0 msgr2=0x7f0144003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.816+0000 7f015759e640 1 --2- 172.21.15.38:0/1354589820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01440039a0 0x7f0144003dc0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f0148009a90 tx=0x7f01440057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.816+0000 7f0156d9d640 1 -- 172.21.15.38:0/1354589820 reap_dead start 2023-12-22T08:51:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.816+0000 7f015759e640 1 -- 172.21.15.38:0/1354589820 shutdown_connections 2023-12-22T08:51:20.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.816+0000 7f015759e640 1 -- 172.21.15.38:0/1354589820 >> 172.21.15.38:0/1354589820 conn(0x7f01580b1f70 msgr2=0x7f01580b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:20.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.816+0000 7f015759e640 1 -- 172.21.15.38:0/1354589820 shutdown_connections 2023-12-22T08:51:20.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.816+0000 7f015759e640 1 -- 172.21.15.38:0/1354589820 wait complete. 2023-12-22T08:51:20.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.818+0000 7f015759e640 1 Processor -- start 2023-12-22T08:51:20.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.818+0000 7f015759e640 1 -- start start 2023-12-22T08:51:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.819+0000 7f015759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01440039a0 0x7f0158156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.819+0000 7f015759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01580a1240 0x7f01580a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.819+0000 7f015759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f015815cd90 0x7f015815d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.819+0000 7f015759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015815d750 con 0x7f015815cd90 2023-12-22T08:51:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.819+0000 7f015759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015815b140 con 0x7f01580a1240 2023-12-22T08:51:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.819+0000 7f015759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0158156660 con 0x7f01440039a0 2023-12-22T08:51:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.819+0000 7f0156d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f015815cd90 0x7f015815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.819+0000 7f0156d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f015815cd90 0x7f015815d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37368/0 (socket says 172.21.15.38:37368) 2023-12-22T08:51:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.819+0000 7f0156d9d640 1 -- 172.21.15.38:0/1251476518 learned_addr learned my addr 172.21.15.38:0/1251476518 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.820+0000 7f014ffff640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01580a1240 0x7f01580a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.820+0000 7f015659c640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01440039a0 0x7f0158156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:20.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.820+0000 7f0156d9d640 1 -- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01440039a0 msgr2=0x7f0158156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:20.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.820+0000 7f0156d9d640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01440039a0 0x7f0158156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:20.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.820+0000 7f0156d9d640 1 -- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01580a1240 msgr2=0x7f01580a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:20.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.820+0000 7f0156d9d640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01580a1240 0x7f01580a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:20.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.820+0000 7f0156d9d640 1 -- 172.21.15.38:0/1251476518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01580a1cf0 con 0x7f015815cd90 2023-12-22T08:51:20.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.820+0000 7f014ffff640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01580a1240 0x7f01580a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:20.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.820+0000 7f015659c640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01440039a0 0x7f0158156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:20.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.820+0000 7f0156d9d640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f015815cd90 0x7f015815d210 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f015000dc00 tx=0x7f015000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:20.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.820+0000 7f014effd640 1 -- 172.21.15.38:0/1251476518 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000bdb0 con 0x7f015815cd90 2023-12-22T08:51:20.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.821+0000 7f014effd640 1 -- 172.21.15.38:0/1251476518 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0150004b60 con 0x7f015815cd90 2023-12-22T08:51:20.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.821+0000 7f014effd640 1 -- 172.21.15.38:0/1251476518 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0150007110 con 0x7f015815cd90 2023-12-22T08:51:20.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.821+0000 7f015759e640 1 -- 172.21.15.38:0/1251476518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015815a810 con 0x7f015815cd90 2023-12-22T08:51:20.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.821+0000 7f015759e640 1 -- 172.21.15.38:0/1251476518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015815add0 con 0x7f015815cd90 2023-12-22T08:51:20.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.822+0000 7f015759e640 1 -- 172.21.15.38:0/1251476518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015815b2f0 con 0x7f015815cd90 2023-12-22T08:51:20.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.823+0000 7f014effd640 1 -- 172.21.15.38:0/1251476518 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0150007270 con 0x7f015815cd90 2023-12-22T08:51:20.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.824+0000 7f014effd640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f013806a460 0x7f013806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:20.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.824+0000 7f014effd640 1 -- 172.21.15.38:0/1251476518 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f01500889a0 con 0x7f015815cd90 2023-12-22T08:51:20.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.825+0000 7f015659c640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f013806a460 0x7f013806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:20.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.826+0000 7f015659c640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f013806a460 0x7f013806c920 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0148036000 tx=0x7f0148030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:20.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:20.829+0000 7f014effd640 1 -- 172.21.15.38:0/1251476518 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f015815b2f0 con 0x7f015815cd90 2023-12-22T08:51:21.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.094+0000 7f015759e640 1 -- 172.21.15.38:0/1251476518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f015815b2f0 con 0x7f015815cd90 2023-12-22T08:51:21.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.095+0000 7f014effd640 1 -- 172.21.15.38:0/1251476518 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f015815b2f0 con 0x7f015815cd90 2023-12-22T08:51:21.096 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:21.096 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:51:21.096 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_dump": [ 2023-12-22T08:51:21.096 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.096 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.a", 2023-12-22T08:51:21.096 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl57dkCBAAeliJIPc49iRBk2mp8WYv8A==", 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.b", 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl0C0+KhAAkCsjfyn19nOz1xTyhZkbPQ==", 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:51:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.098 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.098 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.098 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.098 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.c", 2023-12-22T08:51:21.098 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl7poXGhAA+ZSohyj4dAOs6B5dZKTLAg==", 2023-12-22T08:51:21.098 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.098 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:51:21.098 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:51:21.098 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:51:21.098 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.098 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.098 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.098 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.d", 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4VlTBuoOhAArKX4AiOQRGawIyAnInIhCg==", 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.0", 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VlnVQaChAAxfWmPqwo5D4qBYkAP/6dHQ==", 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:51:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.1", 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4Vll2dlGxAAbqx4rxnz4FWIKl9OGqcwtw==", 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.2", 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VljQ3HLRAAfyrtqD4n6Da8Rl/6UKmv7g==", 2023-12-22T08:51:21.100 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.3", 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBCS4VlOat4AxAAIkAGRvGGWrrwx/ppMbexWQ==", 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.4", 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlwg7TDxAA+L504F+Hw/6FTJ63cV3ZXg==", 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.5", 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx8zgHxAALBDm/sSYqw/fn4nLNQbu4A==", 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:51:21.102 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:51:21.103 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.103 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.103 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.103 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.103 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.6", 2023-12-22T08:51:21.103 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx5OdLxAAaMP09nYI3HKiuhPARgnCOw==", 2023-12-22T08:51:21.103 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.103 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:51:21.103 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:51:21.103 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.7", 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBHS4Vl/15bBBAA4maatkcgA0axcZY/L9r/IA==", 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.0", 2023-12-22T08:51:21.104 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlgDspDhAA0TWGbk4AbuOhCNotPej29A==", 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow r", 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.1", 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlwSk/JhAAM3faae43p4/gw9BmyxLpJA==", 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:51:21.105 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.2", 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VliOHMGhAARaM8FC/0maNMToLGhBR4Tg==", 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.3", 2023-12-22T08:51:21.106 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlV/MVMRAAyN1643IAOTLOLuz4DqMZ8A==", 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.admin", 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA2S4VlBhogNhAACBsSGP7kmhCSn+XAKkvgKQ==", 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:51:21.107 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.x", 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlTHG+NhAAUNkVtrDuoK2OEsy1HHkt2A==", 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.y", 2023-12-22T08:51:21.108 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlED5ALBAAComDf9woKBt/IXcez+Udmg==", 2023-12-22T08:51:21.109 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:51:21.109 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:51:21.109 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:51:21.110 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:51:21.110 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.110 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:21.110 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:51:21.110 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:51:21.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.098+0000 7f015759e640 1 -- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f013806a460 msgr2=0x7f013806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.098+0000 7f015759e640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f013806a460 0x7f013806c920 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0148036000 tx=0x7f0148030000 comp rx=0 tx=0).stop 2023-12-22T08:51:21.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.098+0000 7f015759e640 1 -- 172.21.15.38:0/1251476518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f015815cd90 msgr2=0x7f015815d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.098+0000 7f015759e640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f015815cd90 0x7f015815d210 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f015000dc00 tx=0x7f015000b4a0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.098+0000 7f015759e640 1 -- 172.21.15.38:0/1251476518 shutdown_connections 2023-12-22T08:51:21.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.098+0000 7f015759e640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f013806a460 0x7f013806c920 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.098+0000 7f015759e640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f015815cd90 0x7f015815d210 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.098+0000 7f015759e640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01580a1240 0x7f01580a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.098+0000 7f015759e640 1 --2- 172.21.15.38:0/1251476518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01440039a0 0x7f0158156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.098+0000 7f015759e640 1 -- 172.21.15.38:0/1251476518 >> 172.21.15.38:0/1251476518 conn(0x7f01580b1f70 msgr2=0x7f015809f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:21.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.098+0000 7f015759e640 1 -- 172.21.15.38:0/1251476518 shutdown_connections 2023-12-22T08:51:21.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.098+0000 7f015759e640 1 -- 172.21.15.38:0/1251476518 wait complete. 2023-12-22T08:51:21.119 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:51:21.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.340+0000 7f6b86f81640 1 Processor -- start 2023-12-22T08:51:21.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.340+0000 7f6b86f81640 1 -- start start 2023-12-22T08:51:21.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.342+0000 7f6b86f81640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b80161720 0x7f6b800adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.342+0000 7f6b86f81640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b800ce950 con 0x7f6b80161340 2023-12-22T08:51:21.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.342+0000 7f6b86f81640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b80072170 con 0x7f6b800ae1e0 2023-12-22T08:51:21.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.342+0000 7f6b86f81640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800cdd40 con 0x7f6b80161720 2023-12-22T08:51:21.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.342+0000 7f6b85f7f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6b80161340 0x7f6b80071a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58304/0 (socket says 172.21.15.38:58304) 2023-12-22T08:51:21.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.342+0000 7f6b85f7f640 1 -- 172.21.15.38:0/291956312 learned_addr learned my addr 172.21.15.38:0/291956312 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b8577e640 1 --2- 172.21.15.38:0/291956312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b80161720 0x7f6b800adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186866536 0 0) 0x7f6b800ce950 con 0x7f6b80161340 2023-12-22T08:51:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b6c003520 con 0x7f6b80161340 2023-12-22T08:51:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1024270968 0 0) 0x7f6b6c003520 con 0x7f6b80161340 2023-12-22T08:51:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b80161720 msgr2=0x7f6b800adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 --2- 172.21.15.38:0/291956312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b80161720 0x7f6b800adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 >> v1:172.21.15.89:6789/0 conn(0x7f6b800ae1e0 legacy=0x7f6b8006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b800ce020 con 0x7f6b80161340 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f6b7c001670 con 0x7f6b80161340 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 >> v1:172.21.15.38:6789/0 conn(0x7f6b80161340 legacy=0x7f6b80071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 --2- 172.21.15.38:0/291956312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b6c0039a0 0x7f6b6c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 --2- 172.21.15.38:0/291956312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b6c0047c0 0x7f6b6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 --2- 172.21.15.38:0/291956312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b80161720 0x7f6b6c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800cdd40 con 0x7f6b6c0047c0 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c00bb10 con 0x7f6b6c0039a0 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.343+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c00bcd0 con 0x7f6b80161720 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.344+0000 7f6b8577e640 1 --2- 172.21.15.38:0/291956312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b6c0047c0 0x7f6b6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.344+0000 7f6b85f7f640 1 --2- 172.21.15.38:0/291956312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b6c0039a0 0x7f6b6c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.344+0000 7f6b86780640 1 --2- 172.21.15.38:0/291956312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b80161720 0x7f6b6c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:21.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.344+0000 7f6b8577e640 1 -- 172.21.15.38:0/291956312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b80161720 msgr2=0x7f6b6c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.344+0000 7f6b8577e640 1 --2- 172.21.15.38:0/291956312 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b80161720 0x7f6b6c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.344+0000 7f6b8577e640 1 -- 172.21.15.38:0/291956312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b6c0039a0 msgr2=0x7f6b6c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.344+0000 7f6b8577e640 1 --2- 172.21.15.38:0/291956312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b6c0039a0 0x7f6b6c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.344+0000 7f6b8577e640 1 -- 172.21.15.38:0/291956312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c003520 con 0x7f6b6c0047c0 2023-12-22T08:51:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.344+0000 7f6b85f7f640 1 --2- 172.21.15.38:0/291956312 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b6c0039a0 0x7f6b6c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:51:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.346+0000 7f6b8577e640 1 --2- 172.21.15.38:0/291956312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b6c0047c0 0x7f6b6c004c40 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009a90 tx=0x7f6b6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f976b4cbdd55ba server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.346+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7002c680 con 0x7f6b6c0047c0 2023-12-22T08:51:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.346+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7002c7e0 con 0x7f6b6c0047c0 2023-12-22T08:51:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.346+0000 7f6b84f7d640 1 -- 172.21.15.38:0/291956312 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7002cb90 con 0x7f6b6c0047c0 2023-12-22T08:51:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.347+0000 7f6b86f81640 1 -- 172.21.15.38:0/291956312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b6c0047c0 msgr2=0x7f6b6c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.347+0000 7f6b86f81640 1 --2- 172.21.15.38:0/291956312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b6c0047c0 0x7f6b6c004c40 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009a90 tx=0x7f6b6c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.347+0000 7f6b86780640 1 -- 172.21.15.38:0/291956312 reap_dead start 2023-12-22T08:51:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.347+0000 7f6b86f81640 1 -- 172.21.15.38:0/291956312 shutdown_connections 2023-12-22T08:51:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.347+0000 7f6b86f81640 1 -- 172.21.15.38:0/291956312 >> 172.21.15.38:0/291956312 conn(0x7f6b800b1f70 msgr2=0x7f6b800b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.347+0000 7f6b86f81640 1 -- 172.21.15.38:0/291956312 shutdown_connections 2023-12-22T08:51:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.347+0000 7f6b86f81640 1 -- 172.21.15.38:0/291956312 wait complete. 2023-12-22T08:51:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.349+0000 7f6b86f81640 1 Processor -- start 2023-12-22T08:51:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.349+0000 7f6b86f81640 1 -- start start 2023-12-22T08:51:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b86f81640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b80151ca0 0x7f6b80099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b86f81640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b80152080 0x7f6b801f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b86f81640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b801f6850 0x7f6b80157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b86f81640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80159120 con 0x7f6b80151ca0 2023-12-22T08:51:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b86f81640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b801f6ce0 con 0x7f6b80152080 2023-12-22T08:51:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b86f81640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80099fb0 con 0x7f6b801f6850 2023-12-22T08:51:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b85f7f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b80151ca0 0x7f6b80099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b85f7f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b80151ca0 0x7f6b80099a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51188/0 (socket says 172.21.15.38:51188) 2023-12-22T08:51:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b85f7f640 1 -- 172.21.15.38:0/1421637866 learned_addr learned my addr 172.21.15.38:0/1421637866 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b85f7f640 1 -- 172.21.15.38:0/1421637866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b801f6850 msgr2=0x7f6b80157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b85f7f640 1 --2- 172.21.15.38:0/1421637866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b801f6850 0x7f6b80157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b85f7f640 1 -- 172.21.15.38:0/1421637866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b80152080 msgr2=0x7f6b801f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b85f7f640 1 --2- 172.21.15.38:0/1421637866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b80152080 0x7f6b801f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.350+0000 7f6b85f7f640 1 -- 172.21.15.38:0/1421637866 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b80158e40 con 0x7f6b80151ca0 2023-12-22T08:51:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.351+0000 7f6b85f7f640 1 --2- 172.21.15.38:0/1421637866 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b80151ca0 0x7f6b80099a70 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00eaf0 tx=0x7f6b7c005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.351+0000 7f6b767fc640 1 -- 172.21.15.38:0/1421637866 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00c990 con 0x7f6b80151ca0 2023-12-22T08:51:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.351+0000 7f6b767fc640 1 -- 172.21.15.38:0/1421637866 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c00caf0 con 0x7f6b80151ca0 2023-12-22T08:51:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.351+0000 7f6b767fc640 1 -- 172.21.15.38:0/1421637866 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00ce60 con 0x7f6b80151ca0 2023-12-22T08:51:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.351+0000 7f6b86f81640 1 -- 172.21.15.38:0/1421637866 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b80156670 con 0x7f6b80151ca0 2023-12-22T08:51:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.351+0000 7f6b86f81640 1 -- 172.21.15.38:0/1421637866 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b80156c30 con 0x7f6b80151ca0 2023-12-22T08:51:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.352+0000 7f6b86f81640 1 -- 172.21.15.38:0/1421637866 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b801564d0 con 0x7f6b80151ca0 2023-12-22T08:51:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.353+0000 7f6b767fc640 1 -- 172.21.15.38:0/1421637866 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6b7c01d460 con 0x7f6b80151ca0 2023-12-22T08:51:21.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.354+0000 7f6b767fc640 1 --2- 172.21.15.38:0/1421637866 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6b6406a430 0x7f6b6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.354+0000 7f6b767fc640 1 -- 172.21.15.38:0/1421637866 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6b7c088800 con 0x7f6b80151ca0 2023-12-22T08:51:21.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.355+0000 7f6b8577e640 1 --2- 172.21.15.38:0/1421637866 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6b6406a430 0x7f6b6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:21.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.356+0000 7f6b8577e640 1 --2- 172.21.15.38:0/1421637866 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6b6406a430 0x7f6b6406c8f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009a90 tx=0x7f6b7002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:21.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.358+0000 7f6b767fc640 1 -- 172.21.15.38:0/1421637866 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6b801564d0 con 0x7f6b80151ca0 2023-12-22T08:51:21.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.545+0000 7f6b86f81640 1 -- 172.21.15.38:0/1421637866 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b801564d0 con 0x7f6b80151ca0 2023-12-22T08:51:21.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.547+0000 7f6b767fc640 1 -- 172.21.15.38:0/1421637866 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+12352 (secure 0 0 0) 0x7f6b801564d0 con 0x7f6b80151ca0 2023-12-22T08:51:21.548 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:21.548 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":169,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:51:20.552115+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:51:21.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.549+0000 7f6b86f81640 1 -- 172.21.15.38:0/1421637866 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6b6406a430 msgr2=0x7f6b6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.549+0000 7f6b86f81640 1 --2- 172.21.15.38:0/1421637866 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6b6406a430 0x7f6b6406c8f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009a90 tx=0x7f6b7002e000 comp rx=0 tx=0).stop 2023-12-22T08:51:21.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.549+0000 7f6b86f81640 1 -- 172.21.15.38:0/1421637866 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b80151ca0 msgr2=0x7f6b80099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.549+0000 7f6b86f81640 1 --2- 172.21.15.38:0/1421637866 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b80151ca0 0x7f6b80099a70 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00eaf0 tx=0x7f6b7c005e30 comp rx=0 tx=0).stop 2023-12-22T08:51:21.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.549+0000 7f6b86f81640 1 -- 172.21.15.38:0/1421637866 shutdown_connections 2023-12-22T08:51:21.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.549+0000 7f6b86f81640 1 --2- 172.21.15.38:0/1421637866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b801f6850 0x7f6b80157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.549+0000 7f6b86f81640 1 --2- 172.21.15.38:0/1421637866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b80152080 0x7f6b801f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.549+0000 7f6b86f81640 1 --2- 172.21.15.38:0/1421637866 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6b6406a430 0x7f6b6406c8f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.549+0000 7f6b86f81640 1 --2- 172.21.15.38:0/1421637866 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b80151ca0 0x7f6b80099a70 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.549+0000 7f6b86f81640 1 -- 172.21.15.38:0/1421637866 >> 172.21.15.38:0/1421637866 conn(0x7f6b800b1f70 msgr2=0x7f6b8006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:21.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.549+0000 7f6b86f81640 1 -- 172.21.15.38:0/1421637866 shutdown_connections 2023-12-22T08:51:21.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.550+0000 7f6b86f81640 1 -- 172.21.15.38:0/1421637866 wait complete. 2023-12-22T08:51:21.569 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:51:21.570 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:51:21.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.772+0000 7f47a98e5640 1 Processor -- start 2023-12-22T08:51:21.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.773+0000 7f47a98e5640 1 -- start start 2023-12-22T08:51:21.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.774+0000 7f47a98e5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47a4070b70 0x7f47a406bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.774+0000 7f47a98e5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f47a406c4d0 0x7f47a4070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.774+0000 7f47a98e5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f47a4071490 0x7f47a40cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.774+0000 7f47a98e5640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a406d5f0 con 0x7f47a406c4d0 2023-12-22T08:51:21.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.774+0000 7f47a98e5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a4144fa0 con 0x7f47a4071490 2023-12-22T08:51:21.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.774+0000 7f47a98e5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a406da80 con 0x7f47a4070b70 2023-12-22T08:51:21.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.775+0000 7f479bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f47a406c4d0 0x7f47a4070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:21.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.775+0000 7f479bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f47a406c4d0 0x7f47a4070f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51198/0 (socket says 172.21.15.38:51198) 2023-12-22T08:51:21.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.775+0000 7f479bfff640 1 -- 172.21.15.38:0/3559600431 learned_addr learned my addr 172.21.15.38:0/3559600431 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:21.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.775+0000 7f479bfff640 1 -- 172.21.15.38:0/3559600431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47a4070b70 msgr2=0x7f47a406bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:21.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.775+0000 7f479bfff640 1 --2- 172.21.15.38:0/3559600431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47a4070b70 0x7f47a406bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.775+0000 7f479bfff640 1 -- 172.21.15.38:0/3559600431 >> v2:172.21.15.89:3300/0 conn(0x7f47a4071490 msgr2=0x7f47a40cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:21.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.775+0000 7f47a90e4640 1 --2- 172.21.15.38:0/3559600431 >> v2:172.21.15.89:3300/0 conn(0x7f47a4071490 0x7f47a40cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:21.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.775+0000 7f479bfff640 1 --2- 172.21.15.38:0/3559600431 >> v2:172.21.15.89:3300/0 conn(0x7f47a4071490 0x7f47a40cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.775+0000 7f479bfff640 1 -- 172.21.15.38:0/3559600431 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a406c9e0 con 0x7f47a406c4d0 2023-12-22T08:51:21.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.775+0000 7f47a90e4640 1 --2- 172.21.15.38:0/3559600431 >> v2:172.21.15.89:3300/0 conn(0x7f47a4071490 0x7f47a40cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:21.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.777+0000 7f479bfff640 1 --2- 172.21.15.38:0/3559600431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47a406c4d0 0x7f47a4070f50 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f47a4070540 tx=0x7f479402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353e81436037a1ed server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:21.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.777+0000 7f479b7fe640 1 -- 172.21.15.38:0/3559600431 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794031860 con 0x7f47a406c4d0 2023-12-22T08:51:21.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.777+0000 7f479b7fe640 1 -- 172.21.15.38:0/3559600431 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47940319c0 con 0x7f47a406c4d0 2023-12-22T08:51:21.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.777+0000 7f479b7fe640 1 -- 172.21.15.38:0/3559600431 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794031d50 con 0x7f47a406c4d0 2023-12-22T08:51:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.777+0000 7f47a98e5640 1 -- 172.21.15.38:0/3559600431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47a406c4d0 msgr2=0x7f47a4070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.777+0000 7f47a98e5640 1 --2- 172.21.15.38:0/3559600431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47a406c4d0 0x7f47a4070f50 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f47a4070540 tx=0x7f479402b900 comp rx=0 tx=0).stop 2023-12-22T08:51:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.778+0000 7f47a98e5640 1 -- 172.21.15.38:0/3559600431 shutdown_connections 2023-12-22T08:51:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.778+0000 7f47a98e5640 1 --2- 172.21.15.38:0/3559600431 >> v2:172.21.15.89:3300/0 conn(0x7f47a4071490 0x7f47a40cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.778+0000 7f47a98e5640 1 --2- 172.21.15.38:0/3559600431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47a406c4d0 0x7f47a4070f50 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.778+0000 7f47a98e5640 1 --2- 172.21.15.38:0/3559600431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47a4070b70 0x7f47a406bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.778+0000 7f47a98e5640 1 -- 172.21.15.38:0/3559600431 >> 172.21.15.38:0/3559600431 conn(0x7f47a40b0b60 msgr2=0x7f47a40b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.778+0000 7f47a98e5640 1 -- 172.21.15.38:0/3559600431 shutdown_connections 2023-12-22T08:51:21.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.778+0000 7f47a98e5640 1 -- 172.21.15.38:0/3559600431 wait complete. 2023-12-22T08:51:21.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.780+0000 7f47a98e5640 1 Processor -- start 2023-12-22T08:51:21.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.780+0000 7f47a98e5640 1 -- start start 2023-12-22T08:51:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f47a98e5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47a406c4d0 0x7f47a4138a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f47a98e5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47a4070b70 0x7f47a41f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f47a98e5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a4071490 0x7f47a41f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f47a98e5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a413ae20 con 0x7f47a4070b70 2023-12-22T08:51:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f47a98e5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4139290 con 0x7f47a4071490 2023-12-22T08:51:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f47a98e5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4139570 con 0x7f47a406c4d0 2023-12-22T08:51:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f479bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47a4070b70 0x7f47a41f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f479bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47a4070b70 0x7f47a41f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51210/0 (socket says 172.21.15.38:51210) 2023-12-22T08:51:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f479bfff640 1 -- 172.21.15.38:0/2614033725 learned_addr learned my addr 172.21.15.38:0/2614033725 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f479bfff640 1 -- 172.21.15.38:0/2614033725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47a406c4d0 msgr2=0x7f47a4138a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f479bfff640 1 --2- 172.21.15.38:0/2614033725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47a406c4d0 0x7f47a4138a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f479bfff640 1 -- 172.21.15.38:0/2614033725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a4071490 msgr2=0x7f47a41f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f479bfff640 1 --2- 172.21.15.38:0/2614033725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a4071490 0x7f47a41f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.781+0000 7f479bfff640 1 -- 172.21.15.38:0/2614033725 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47940094d0 con 0x7f47a4070b70 2023-12-22T08:51:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.782+0000 7f479bfff640 1 --2- 172.21.15.38:0/2614033725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47a4070b70 0x7f47a41f5cc0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f479402b940 tx=0x7f47940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:21.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.782+0000 7f47997fa640 1 -- 172.21.15.38:0/2614033725 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794031850 con 0x7f47a4070b70 2023-12-22T08:51:21.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.782+0000 7f47997fa640 1 -- 172.21.15.38:0/2614033725 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47940443f0 con 0x7f47a4070b70 2023-12-22T08:51:21.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.782+0000 7f47997fa640 1 -- 172.21.15.38:0/2614033725 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47940447a0 con 0x7f47a4070b70 2023-12-22T08:51:21.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.782+0000 7f47a98e5640 1 -- 172.21.15.38:0/2614033725 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a4139850 con 0x7f47a4070b70 2023-12-22T08:51:21.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.782+0000 7f47a98e5640 1 -- 172.21.15.38:0/2614033725 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a4139e10 con 0x7f47a4070b70 2023-12-22T08:51:21.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.783+0000 7f47a98e5640 1 -- 172.21.15.38:0/2614033725 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a413a000 con 0x7f47a4070b70 2023-12-22T08:51:21.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.784+0000 7f47997fa640 1 -- 172.21.15.38:0/2614033725 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f479404d450 con 0x7f47a4070b70 2023-12-22T08:51:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.785+0000 7f47997fa640 1 --2- 172.21.15.38:0/2614033725 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f479006a430 0x7f479006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.785+0000 7f47997fa640 1 -- 172.21.15.38:0/2614033725 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f47940aae10 con 0x7f47a4070b70 2023-12-22T08:51:21.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.786+0000 7f47a88e3640 1 --2- 172.21.15.38:0/2614033725 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f479006a430 0x7f479006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:21.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.787+0000 7f47a88e3640 1 --2- 172.21.15.38:0/2614033725 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f479006a430 0x7f479006c8f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009710 tx=0x7f47a0006c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:21.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.790+0000 7f47997fa640 1 -- 172.21.15.38:0/2614033725 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f47940ae030 con 0x7f47a4070b70 2023-12-22T08:51:21.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.984+0000 7f47a98e5640 1 -- 172.21.15.38:0/2614033725 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47a4061910 con 0x7f47a4070b70 2023-12-22T08:51:21.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.985+0000 7f47997fa640 1 -- 172.21.15.38:0/2614033725 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v169) v1 ==== 93+0+10 (secure 0 0 0) 0x7f47940350a0 con 0x7f47a4070b70 2023-12-22T08:51:21.986 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:51:21.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.987+0000 7f47a98e5640 1 -- 172.21.15.38:0/2614033725 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f479006a430 msgr2=0x7f479006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.987+0000 7f47a98e5640 1 --2- 172.21.15.38:0/2614033725 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f479006a430 0x7f479006c8f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009710 tx=0x7f47a0006c90 comp rx=0 tx=0).stop 2023-12-22T08:51:21.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.987+0000 7f47a98e5640 1 -- 172.21.15.38:0/2614033725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47a4070b70 msgr2=0x7f47a41f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:21.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.987+0000 7f47a98e5640 1 --2- 172.21.15.38:0/2614033725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47a4070b70 0x7f47a41f5cc0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f479402b940 tx=0x7f47940046c0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.988+0000 7f47a98e5640 1 -- 172.21.15.38:0/2614033725 shutdown_connections 2023-12-22T08:51:21.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.988+0000 7f47a98e5640 1 --2- 172.21.15.38:0/2614033725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a4071490 0x7f47a41f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.988+0000 7f47a98e5640 1 --2- 172.21.15.38:0/2614033725 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f479006a430 0x7f479006c8f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.988+0000 7f47a98e5640 1 --2- 172.21.15.38:0/2614033725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47a4070b70 0x7f47a41f5cc0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.988+0000 7f47a98e5640 1 --2- 172.21.15.38:0/2614033725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47a406c4d0 0x7f47a4138a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:21.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.988+0000 7f47a98e5640 1 -- 172.21.15.38:0/2614033725 >> 172.21.15.38:0/2614033725 conn(0x7f47a40b0b60 msgr2=0x7f47a40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:21.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.988+0000 7f47a98e5640 1 -- 172.21.15.38:0/2614033725 shutdown_connections 2023-12-22T08:51:21.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:21.988+0000 7f47a98e5640 1 -- 172.21.15.38:0/2614033725 wait complete. 2023-12-22T08:51:22.008 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T08:51:22.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.228+0000 7ff8b9c15640 1 Processor -- start 2023-12-22T08:51:22.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.229+0000 7ff8b9c15640 1 -- start start 2023-12-22T08:51:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.230+0000 7ff8b9c15640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff8b415ad90 0x7ff8b40caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.230+0000 7ff8b9c15640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b415e050 0x7ff8b40cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.230+0000 7ff8b9c15640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b415e630 con 0x7ff8b4161bb0 2023-12-22T08:51:22.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.230+0000 7ff8b9c15640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b40ce2c0 con 0x7ff8b415ad90 2023-12-22T08:51:22.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.230+0000 7ff8b9c15640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b415e910 con 0x7ff8b415e050 2023-12-22T08:51:22.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.231+0000 7ff8b8c13640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff8b415ad90 0x7ff8b40caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:22.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.231+0000 7ff8b8c13640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff8b415ad90 0x7ff8b40caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51224/0 (socket says 172.21.15.38:51224) 2023-12-22T08:51:22.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.231+0000 7ff8b8c13640 1 -- 172.21.15.38:0/1803517791 learned_addr learned my addr 172.21.15.38:0/1803517791 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:22.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.231+0000 7ff8b9414640 1 --2- 172.21.15.38:0/1803517791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b415e050 0x7ff8b40cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:22.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.231+0000 7ff8b8c13640 1 -- 172.21.15.38:0/1803517791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b415e050 msgr2=0x7ff8b40cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:22.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.231+0000 7ff8b8c13640 1 --2- 172.21.15.38:0/1803517791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b415e050 0x7ff8b40cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.231+0000 7ff8b8c13640 1 -- 172.21.15.38:0/1803517791 >> v1:172.21.15.89:6789/0 conn(0x7ff8b4161bb0 legacy=0x7ff8b415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:22.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.231+0000 7ff8b8c13640 1 -- 172.21.15.38:0/1803517791 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b41610d0 con 0x7ff8b415ad90 2023-12-22T08:51:22.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.233+0000 7ff8b8c13640 1 --2- 172.21.15.38:0/1803517791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415ad90 0x7ff8b40caed0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80098a0 tx=0x7ff8a802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50234f2f3bbb4962 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:22.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.233+0000 7ff8b37fe640 1 -- 172.21.15.38:0/1803517791 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8030840 con 0x7ff8b415ad90 2023-12-22T08:51:22.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.233+0000 7ff8b37fe640 1 -- 172.21.15.38:0/1803517791 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a80309a0 con 0x7ff8b415ad90 2023-12-22T08:51:22.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.234+0000 7ff8b37fe640 1 -- 172.21.15.38:0/1803517791 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8030d30 con 0x7ff8b415ad90 2023-12-22T08:51:22.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.234+0000 7ff8b9c15640 1 -- 172.21.15.38:0/1803517791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415ad90 msgr2=0x7ff8b40caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:22.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.234+0000 7ff8b9c15640 1 --2- 172.21.15.38:0/1803517791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415ad90 0x7ff8b40caed0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80098a0 tx=0x7ff8a802b980 comp rx=0 tx=0).stop 2023-12-22T08:51:22.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.234+0000 7ff8b9c15640 1 -- 172.21.15.38:0/1803517791 shutdown_connections 2023-12-22T08:51:22.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.234+0000 7ff8b9c15640 1 --2- 172.21.15.38:0/1803517791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b415e050 0x7ff8b40cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.234+0000 7ff8b9c15640 1 --2- 172.21.15.38:0/1803517791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415ad90 0x7ff8b40caed0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.234+0000 7ff8b9c15640 1 -- 172.21.15.38:0/1803517791 >> 172.21.15.38:0/1803517791 conn(0x7ff8b40d31c0 msgr2=0x7ff8b40d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:22.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.234+0000 7ff8b9c15640 1 -- 172.21.15.38:0/1803517791 shutdown_connections 2023-12-22T08:51:22.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.234+0000 7ff8b9c15640 1 -- 172.21.15.38:0/1803517791 wait complete. 2023-12-22T08:51:22.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.236+0000 7ff8b9c15640 1 Processor -- start 2023-12-22T08:51:22.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.236+0000 7ff8b9c15640 1 -- start start 2023-12-22T08:51:22.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.237+0000 7ff8b9c15640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415ad90 0x7ff8b414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.237+0000 7ff8b9c15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8b415e050 0x7ff8b40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.237+0000 7ff8b9c15640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b4161bb0 0x7ff8b40d0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.237+0000 7ff8b9c15640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40d01d0 con 0x7ff8b415ad90 2023-12-22T08:51:22.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.237+0000 7ff8b9c15640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4150290 con 0x7ff8b415e050 2023-12-22T08:51:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.237+0000 7ff8b9c15640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40cf7c0 con 0x7ff8b4161bb0 2023-12-22T08:51:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.238+0000 7ff8b8c13640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415ad90 0x7ff8b414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.238+0000 7ff8b8c13640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415ad90 0x7ff8b414ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51234/0 (socket says 172.21.15.38:51234) 2023-12-22T08:51:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.238+0000 7ff8b8c13640 1 -- 172.21.15.38:0/3857099732 learned_addr learned my addr 172.21.15.38:0/3857099732 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.238+0000 7ff8b9414640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b4161bb0 0x7ff8b40d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.238+0000 7ff8b3fff640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8b415e050 0x7ff8b40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.238+0000 7ff8b8c13640 1 -- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b4161bb0 msgr2=0x7ff8b40d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.238+0000 7ff8b8c13640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b4161bb0 0x7ff8b40d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.238+0000 7ff8b8c13640 1 -- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8b415e050 msgr2=0x7ff8b40ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:22.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.238+0000 7ff8b8c13640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8b415e050 0x7ff8b40ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.238+0000 7ff8b8c13640 1 -- 172.21.15.38:0/3857099732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a80094d0 con 0x7ff8b415ad90 2023-12-22T08:51:22.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.239+0000 7ff8b8c13640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415ad90 0x7ff8b414ebd0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80098a0 tx=0x7ff8a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:22.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.239+0000 7ff8b17fa640 1 -- 172.21.15.38:0/3857099732 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8039c90 con 0x7ff8b415ad90 2023-12-22T08:51:22.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.239+0000 7ff8b17fa640 1 -- 172.21.15.38:0/3857099732 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a8039df0 con 0x7ff8b415ad90 2023-12-22T08:51:22.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.239+0000 7ff8b17fa640 1 -- 172.21.15.38:0/3857099732 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80446c0 con 0x7ff8b415ad90 2023-12-22T08:51:22.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.239+0000 7ff8b9c15640 1 -- 172.21.15.38:0/3857099732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b4150550 con 0x7ff8b415ad90 2023-12-22T08:51:22.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.239+0000 7ff8b9c15640 1 -- 172.21.15.38:0/3857099732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b40cf200 con 0x7ff8b415ad90 2023-12-22T08:51:22.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.240+0000 7ff8b9c15640 1 -- 172.21.15.38:0/3857099732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b4061910 con 0x7ff8b415ad90 2023-12-22T08:51:22.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.241+0000 7ff8b17fa640 1 -- 172.21.15.38:0/3857099732 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff8a802f390 con 0x7ff8b415ad90 2023-12-22T08:51:22.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.242+0000 7ff8b17fa640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff89806a430 0x7ff89806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.242+0000 7ff8b17fa640 1 -- 172.21.15.38:0/3857099732 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff8a803e070 con 0x7ff8b415ad90 2023-12-22T08:51:22.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.243+0000 7ff8b3fff640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff89806a430 0x7ff89806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:22.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.244+0000 7ff8b3fff640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff89806a430 0x7ff89806c8f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0007fd0 tx=0x7ff8a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:22.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.247+0000 7ff8b17fa640 1 -- 172.21.15.38:0/3857099732 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff8a8076700 con 0x7ff8b415ad90 2023-12-22T08:51:22.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.445+0000 7ff8b9c15640 1 -- 172.21.15.38:0/3857099732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff8b415d370 con 0x7ff8b415ad90 2023-12-22T08:51:22.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.446+0000 7ff8b17fa640 1 -- 172.21.15.38:0/3857099732 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v169) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff8a8034060 con 0x7ff8b415ad90 2023-12-22T08:51:22.448 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:22.448 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-12-22T08:51:22.448 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:51:22.448 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-12-22T08:51:22.448 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-12-22T08:51:22.448 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:51:22.448 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-12-22T08:51:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.449+0000 7ff8b9c15640 1 -- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff89806a430 msgr2=0x7ff89806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.449+0000 7ff8b9c15640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff89806a430 0x7ff89806c8f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0007fd0 tx=0x7ff8a0009040 comp rx=0 tx=0).stop 2023-12-22T08:51:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.449+0000 7ff8b9c15640 1 -- 172.21.15.38:0/3857099732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415ad90 msgr2=0x7ff8b414ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.449+0000 7ff8b9c15640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415ad90 0x7ff8b414ebd0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80098a0 tx=0x7ff8a8004730 comp rx=0 tx=0).stop 2023-12-22T08:51:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.449+0000 7ff8b9c15640 1 -- 172.21.15.38:0/3857099732 shutdown_connections 2023-12-22T08:51:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.449+0000 7ff8b9c15640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b4161bb0 0x7ff8b40d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.449+0000 7ff8b9c15640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8b415e050 0x7ff8b40ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.449+0000 7ff8b9c15640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff89806a430 0x7ff89806c8f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.449+0000 7ff8b9c15640 1 --2- 172.21.15.38:0/3857099732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415ad90 0x7ff8b414ebd0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.449+0000 7ff8b9c15640 1 -- 172.21.15.38:0/3857099732 >> 172.21.15.38:0/3857099732 conn(0x7ff8b40d31c0 msgr2=0x7ff8b40cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:22.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.449+0000 7ff8b9c15640 1 -- 172.21.15.38:0/3857099732 shutdown_connections 2023-12-22T08:51:22.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.450+0000 7ff8b9c15640 1 -- 172.21.15.38:0/3857099732 wait complete. 2023-12-22T08:51:22.471 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T08:51:22.471 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T08:51:22.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.706+0000 7fa917404640 1 Processor -- start 2023-12-22T08:51:22.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.706+0000 7fa917404640 1 -- start start 2023-12-22T08:51:22.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.707+0000 7fa917404640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa9100b3c50 0x7fa910071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.707+0000 7fa917404640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa91015a7b0 0x7fa91015d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.707+0000 7fa917404640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91006dee0 con 0x7fa9100b3870 2023-12-22T08:51:22.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.707+0000 7fa917404640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91006e1c0 con 0x7fa9100b3c50 2023-12-22T08:51:22.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.708+0000 7fa917404640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91006e4a0 con 0x7fa91015a7b0 2023-12-22T08:51:22.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.708+0000 7fa9151a0640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa9100b3870 0x7fa91006d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58310/0 (socket says 172.21.15.38:58310) 2023-12-22T08:51:22.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.708+0000 7fa9151a0640 1 -- 172.21.15.38:0/3322156440 learned_addr learned my addr 172.21.15.38:0/3322156440 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:22.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.708+0000 7fa91499f640 1 --2- 172.21.15.38:0/3322156440 >> v2:172.21.15.89:3300/0 conn(0x7fa9100b3c50 0x7fa910071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:22.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.708+0000 7fa9159a1640 1 --2- 172.21.15.38:0/3322156440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa91015a7b0 0x7fa91015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:22.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.708+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268352996 0 0) 0x7fa91006dee0 con 0x7fa9100b3870 2023-12-22T08:51:22.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.708+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8fc003520 con 0x7fa9100b3870 2023-12-22T08:51:22.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2779272618 0 0) 0x7fa8fc003520 con 0x7fa9100b3870 2023-12-22T08:51:22.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa91015a7b0 msgr2=0x7fa91015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:22.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 --2- 172.21.15.38:0/3322156440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa91015a7b0 0x7fa91015d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 >> v2:172.21.15.89:3300/0 conn(0x7fa9100b3c50 msgr2=0x7fa910071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:22.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 --2- 172.21.15.38:0/3322156440 >> v2:172.21.15.89:3300/0 conn(0x7fa9100b3c50 0x7fa910071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91015a290 con 0x7fa9100b3870 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fa90c001670 con 0x7fa9100b3870 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 >> v1:172.21.15.38:6789/0 conn(0x7fa9100b3870 legacy=0x7fa91006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 --2- 172.21.15.38:0/3322156440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8fc003970 0x7fa8fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 --2- 172.21.15.38:0/3322156440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa91015a7b0 0x7fa8fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 --2- 172.21.15.38:0/3322156440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc004d00 0x7fa8fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91006e1c0 con 0x7fa8fc004d00 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91006e4a0 con 0x7fa8fc003970 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc00b980 con 0x7fa91015a7b0 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.709+0000 7fa9159a1640 1 --2- 172.21.15.38:0/3322156440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc004d00 0x7fa8fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.710+0000 7fa9151a0640 1 --2- 172.21.15.38:0/3322156440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8fc003970 0x7fa8fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.710+0000 7fa9159a1640 1 -- 172.21.15.38:0/3322156440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa91015a7b0 msgr2=0x7fa8fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.710+0000 7fa9159a1640 1 --2- 172.21.15.38:0/3322156440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa91015a7b0 0x7fa8fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.710+0000 7fa9159a1640 1 -- 172.21.15.38:0/3322156440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8fc003970 msgr2=0x7fa8fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:22.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.710+0000 7fa9159a1640 1 --2- 172.21.15.38:0/3322156440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8fc003970 0x7fa8fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.710+0000 7fa9159a1640 1 -- 172.21.15.38:0/3322156440 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc003520 con 0x7fa8fc004d00 2023-12-22T08:51:22.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.710+0000 7fa9151a0640 1 --2- 172.21.15.38:0/3322156440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8fc003970 0x7fa8fc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:22.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.711+0000 7fa9159a1640 1 --2- 172.21.15.38:0/3322156440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc004d00 0x7fa8fc005180 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fa908009ac0 tx=0x7fa8fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce761b001df83244 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:22.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.711+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90802c710 con 0x7fa8fc004d00 2023-12-22T08:51:22.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.711+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90802c870 con 0x7fa8fc004d00 2023-12-22T08:51:22.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.711+0000 7fa907fff640 1 -- 172.21.15.38:0/3322156440 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90802cc00 con 0x7fa8fc004d00 2023-12-22T08:51:22.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.712+0000 7fa917404640 1 -- 172.21.15.38:0/3322156440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc004d00 msgr2=0x7fa8fc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:22.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.712+0000 7fa917404640 1 --2- 172.21.15.38:0/3322156440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc004d00 0x7fa8fc005180 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fa908009ac0 tx=0x7fa8fc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.712+0000 7fa9159a1640 1 -- 172.21.15.38:0/3322156440 reap_dead start 2023-12-22T08:51:22.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.712+0000 7fa917404640 1 -- 172.21.15.38:0/3322156440 shutdown_connections 2023-12-22T08:51:22.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.712+0000 7fa917404640 1 -- 172.21.15.38:0/3322156440 >> 172.21.15.38:0/3322156440 conn(0x7fa91006f880 msgr2=0x7fa9100b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:22.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.712+0000 7fa917404640 1 -- 172.21.15.38:0/3322156440 shutdown_connections 2023-12-22T08:51:22.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.712+0000 7fa917404640 1 -- 172.21.15.38:0/3322156440 wait complete. 2023-12-22T08:51:22.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.714+0000 7fa917404640 1 Processor -- start 2023-12-22T08:51:22.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.714+0000 7fa917404640 1 -- start start 2023-12-22T08:51:22.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.715+0000 7fa917404640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc004d00 0x7fa9100aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.715+0000 7fa917404640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa910140080 0x7fa9100af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.715+0000 7fa917404640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9100afb80 0x7fa9100b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.715+0000 7fa917404640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91014c620 con 0x7fa8fc004d00 2023-12-22T08:51:22.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.715+0000 7fa917404640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa910168cc0 con 0x7fa9100afb80 2023-12-22T08:51:22.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.715+0000 7fa917404640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa910168390 con 0x7fa910140080 2023-12-22T08:51:22.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.715+0000 7fa9151a0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc004d00 0x7fa9100aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:22.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.715+0000 7fa9151a0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc004d00 0x7fa9100aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51248/0 (socket says 172.21.15.38:51248) 2023-12-22T08:51:22.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.715+0000 7fa9151a0640 1 -- 172.21.15.38:0/2541894786 learned_addr learned my addr 172.21.15.38:0/2541894786 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.716+0000 7fa9151a0640 1 -- 172.21.15.38:0/2541894786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa910140080 msgr2=0x7fa9100af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.716+0000 7fa9151a0640 1 --2- 172.21.15.38:0/2541894786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa910140080 0x7fa9100af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.716+0000 7fa9151a0640 1 -- 172.21.15.38:0/2541894786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9100afb80 msgr2=0x7fa9100b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.716+0000 7fa9151a0640 1 --2- 172.21.15.38:0/2541894786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9100afb80 0x7fa9100b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.716+0000 7fa9151a0640 1 -- 172.21.15.38:0/2541894786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa910168670 con 0x7fa8fc004d00 2023-12-22T08:51:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.716+0000 7fa9151a0640 1 --2- 172.21.15.38:0/2541894786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc004d00 0x7fa9100aece0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00dae0 tx=0x7fa90c007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.716+0000 7fa905ffb640 1 -- 172.21.15.38:0/2541894786 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c004bf0 con 0x7fa8fc004d00 2023-12-22T08:51:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.716+0000 7fa905ffb640 1 -- 172.21.15.38:0/2541894786 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90c004d50 con 0x7fa8fc004d00 2023-12-22T08:51:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.716+0000 7fa917404640 1 -- 172.21.15.38:0/2541894786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa910168950 con 0x7fa8fc004d00 2023-12-22T08:51:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.716+0000 7fa905ffb640 1 -- 172.21.15.38:0/2541894786 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c007310 con 0x7fa8fc004d00 2023-12-22T08:51:22.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.716+0000 7fa917404640 1 -- 172.21.15.38:0/2541894786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa910140500 con 0x7fa8fc004d00 2023-12-22T08:51:22.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.717+0000 7fa917404640 1 -- 172.21.15.38:0/2541894786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa910061910 con 0x7fa8fc004d00 2023-12-22T08:51:22.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.718+0000 7fa905ffb640 1 -- 172.21.15.38:0/2541894786 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa90c007470 con 0x7fa8fc004d00 2023-12-22T08:51:22.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.719+0000 7fa905ffb640 1 --2- 172.21.15.38:0/2541894786 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa8f406a460 0x7fa8f406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:22.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.719+0000 7fa905ffb640 1 -- 172.21.15.38:0/2541894786 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa90c088350 con 0x7fa8fc004d00 2023-12-22T08:51:22.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.720+0000 7fa91499f640 1 --2- 172.21.15.38:0/2541894786 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa8f406a460 0x7fa8f406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:22.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.721+0000 7fa91499f640 1 --2- 172.21.15.38:0/2541894786 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa8f406a460 0x7fa8f406c920 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa900004b30 tx=0x7fa90000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:22.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.723+0000 7fa905ffb640 1 -- 172.21.15.38:0/2541894786 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa90c053bf0 con 0x7fa8fc004d00 2023-12-22T08:51:22.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:22.924+0000 7fa917404640 1 -- 172.21.15.38:0/2541894786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa910168ae0 con 0x7fa8fc004d00 2023-12-22T08:51:23.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.603+0000 7fa905ffb640 1 -- 172.21.15.38:0/2541894786 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v170) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa90c057210 con 0x7fa8fc004d00 2023-12-22T08:51:23.605 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-12-22T08:51:23.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.608+0000 7fa917404640 1 -- 172.21.15.38:0/2541894786 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa8f406a460 msgr2=0x7fa8f406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:23.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.608+0000 7fa917404640 1 --2- 172.21.15.38:0/2541894786 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa8f406a460 0x7fa8f406c920 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa900004b30 tx=0x7fa90000b040 comp rx=0 tx=0).stop 2023-12-22T08:51:23.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.608+0000 7fa917404640 1 -- 172.21.15.38:0/2541894786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc004d00 msgr2=0x7fa9100aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:23.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.608+0000 7fa917404640 1 --2- 172.21.15.38:0/2541894786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc004d00 0x7fa9100aece0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00dae0 tx=0x7fa90c007e90 comp rx=0 tx=0).stop 2023-12-22T08:51:23.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.610+0000 7fa917404640 1 -- 172.21.15.38:0/2541894786 shutdown_connections 2023-12-22T08:51:23.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.610+0000 7fa917404640 1 --2- 172.21.15.38:0/2541894786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9100afb80 0x7fa9100b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:23.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.610+0000 7fa917404640 1 --2- 172.21.15.38:0/2541894786 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa910140080 0x7fa9100af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:23.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.610+0000 7fa917404640 1 --2- 172.21.15.38:0/2541894786 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa8f406a460 0x7fa8f406c920 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:23.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.610+0000 7fa917404640 1 --2- 172.21.15.38:0/2541894786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8fc004d00 0x7fa9100aece0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:23.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.610+0000 7fa917404640 1 -- 172.21.15.38:0/2541894786 >> 172.21.15.38:0/2541894786 conn(0x7fa91006f880 msgr2=0x7fa9100adb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:23.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.610+0000 7fa917404640 1 -- 172.21.15.38:0/2541894786 shutdown_connections 2023-12-22T08:51:23.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.611+0000 7fa917404640 1 -- 172.21.15.38:0/2541894786 wait complete. 2023-12-22T08:51:23.635 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T08:51:23.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.860+0000 7f1c0ef30640 1 Processor -- start 2023-12-22T08:51:23.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.861+0000 7f1c0ef30640 1 -- start start 2023-12-22T08:51:23.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.862+0000 7f1c0ef30640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1c08071d80 0x7f1c080a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:23.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.862+0000 7f1c0ef30640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1c080a35a0 0x7f1c08161040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:23.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.862+0000 7f1c0ef30640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0806c2a0 con 0x7f1c08161580 2023-12-22T08:51:23.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.862+0000 7f1c0ef30640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c080a44a0 con 0x7f1c08071d80 2023-12-22T08:51:23.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.862+0000 7f1c0ef30640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c080a3a00 con 0x7f1c080a35a0 2023-12-22T08:51:23.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.863+0000 7f1c0df2e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1c08071d80 0x7f1c080a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:23.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.863+0000 7f1c0df2e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1c08071d80 0x7f1c080a3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51262/0 (socket says 172.21.15.38:51262) 2023-12-22T08:51:23.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.863+0000 7f1c0df2e640 1 -- 172.21.15.38:0/2320915325 learned_addr learned my addr 172.21.15.38:0/2320915325 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:23.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.863+0000 7f1c0d72d640 1 --2- 172.21.15.38:0/2320915325 >> v2:172.21.15.89:3300/0 conn(0x7f1c080a35a0 0x7f1c08161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:23.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.864+0000 7f1c0df2e640 1 -- 172.21.15.38:0/2320915325 >> v2:172.21.15.89:3300/0 conn(0x7f1c080a35a0 msgr2=0x7f1c08161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:23.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.864+0000 7f1c0df2e640 1 --2- 172.21.15.38:0/2320915325 >> v2:172.21.15.89:3300/0 conn(0x7f1c080a35a0 0x7f1c08161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:23.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.864+0000 7f1c0df2e640 1 -- 172.21.15.38:0/2320915325 >> v1:172.21.15.89:6789/0 conn(0x7f1c08161580 legacy=0x7f1c0815da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:23.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.864+0000 7f1c0df2e640 1 -- 172.21.15.38:0/2320915325 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c08072160 con 0x7f1c08071d80 2023-12-22T08:51:23.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.865+0000 7f1c0df2e640 1 --2- 172.21.15.38:0/2320915325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c08071d80 0x7f1c080a3060 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f1c080aeb50 tx=0x7f1c0402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0f344e8429faaf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:23.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.865+0000 7f1c0cf2c640 1 -- 172.21.15.38:0/2320915325 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04031870 con 0x7f1c08071d80 2023-12-22T08:51:23.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.865+0000 7f1c0cf2c640 1 -- 172.21.15.38:0/2320915325 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c040319d0 con 0x7f1c08071d80 2023-12-22T08:51:23.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.865+0000 7f1c0cf2c640 1 -- 172.21.15.38:0/2320915325 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04031d60 con 0x7f1c08071d80 2023-12-22T08:51:23.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.866+0000 7f1c0ef30640 1 -- 172.21.15.38:0/2320915325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c08071d80 msgr2=0x7f1c080a3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:23.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.866+0000 7f1c0ef30640 1 --2- 172.21.15.38:0/2320915325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c08071d80 0x7f1c080a3060 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f1c080aeb50 tx=0x7f1c0402b910 comp rx=0 tx=0).stop 2023-12-22T08:51:23.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.866+0000 7f1c0ef30640 1 -- 172.21.15.38:0/2320915325 shutdown_connections 2023-12-22T08:51:23.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.866+0000 7f1c0ef30640 1 --2- 172.21.15.38:0/2320915325 >> v2:172.21.15.89:3300/0 conn(0x7f1c080a35a0 0x7f1c08161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:23.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.866+0000 7f1c0ef30640 1 --2- 172.21.15.38:0/2320915325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c08071d80 0x7f1c080a3060 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:23.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.866+0000 7f1c0ef30640 1 -- 172.21.15.38:0/2320915325 >> 172.21.15.38:0/2320915325 conn(0x7f1c080cf000 msgr2=0x7f1c080cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:23.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.866+0000 7f1c0ef30640 1 -- 172.21.15.38:0/2320915325 shutdown_connections 2023-12-22T08:51:23.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.866+0000 7f1c0ef30640 1 -- 172.21.15.38:0/2320915325 wait complete. 2023-12-22T08:51:23.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.868+0000 7f1c0ef30640 1 Processor -- start 2023-12-22T08:51:23.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.868+0000 7f1c0ef30640 1 -- start start 2023-12-22T08:51:23.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.869+0000 7f1c0ef30640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c08071d80 0x7f1c081f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:23.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.869+0000 7f1c0ef30640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c080a35a0 0x7f1c0809c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:23.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.869+0000 7f1c0ef30640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c08161580 0x7f1c0815bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:23.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.869+0000 7f1c0ef30640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c081f2ed0 con 0x7f1c08071d80 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.869+0000 7f1c0ef30640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c081425f0 con 0x7f1c08161580 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.869+0000 7f1c0ef30640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c08099e50 con 0x7f1c080a35a0 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.869+0000 7f1c0df2e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c08071d80 0x7f1c081f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.869+0000 7f1c0df2e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c08071d80 0x7f1c081f2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51270/0 (socket says 172.21.15.38:51270) 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.869+0000 7f1c0df2e640 1 -- 172.21.15.38:0/811667296 learned_addr learned my addr 172.21.15.38:0/811667296 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.870+0000 7f1c0e72f640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c08161580 0x7f1c0815bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.870+0000 7f1c0d72d640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c080a35a0 0x7f1c0809c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.870+0000 7f1c0df2e640 1 -- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c080a35a0 msgr2=0x7f1c0809c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.870+0000 7f1c0df2e640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c080a35a0 0x7f1c0809c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.870+0000 7f1c0df2e640 1 -- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c08161580 msgr2=0x7f1c0815bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.870+0000 7f1c0df2e640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c08161580 0x7f1c0815bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.870+0000 7f1c0df2e640 1 -- 172.21.15.38:0/811667296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c040094d0 con 0x7f1c08071d80 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.870+0000 7f1c0e72f640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c08161580 0x7f1c0815bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:23.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.870+0000 7f1c0df2e640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c08071d80 0x7f1c081f2990 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f1c04000c00 tx=0x7f1c040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:23.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.870+0000 7f1bfe7fc640 1 -- 172.21.15.38:0/811667296 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0403abe0 con 0x7f1c08071d80 2023-12-22T08:51:23.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.871+0000 7f1bfe7fc640 1 -- 172.21.15.38:0/811667296 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0403ad40 con 0x7f1c08071d80 2023-12-22T08:51:23.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.871+0000 7f1bfe7fc640 1 -- 172.21.15.38:0/811667296 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04044610 con 0x7f1c08071d80 2023-12-22T08:51:23.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.871+0000 7f1c0ef30640 1 -- 172.21.15.38:0/811667296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c08141fa0 con 0x7f1c08071d80 2023-12-22T08:51:23.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.871+0000 7f1c0ef30640 1 -- 172.21.15.38:0/811667296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0809a130 con 0x7f1c08071d80 2023-12-22T08:51:23.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.872+0000 7f1c0ef30640 1 -- 172.21.15.38:0/811667296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0809a2c0 con 0x7f1c08071d80 2023-12-22T08:51:23.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.874+0000 7f1bfe7fc640 1 -- 172.21.15.38:0/811667296 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c0404d450 con 0x7f1c08071d80 2023-12-22T08:51:23.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.875+0000 7f1bfe7fc640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1bec06a430 0x7f1bec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:23.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.876+0000 7f1bfe7fc640 1 -- 172.21.15.38:0/811667296 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1c0402d040 con 0x7f1c08071d80 2023-12-22T08:51:23.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.876+0000 7f1c0d72d640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1bec06a430 0x7f1bec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:23.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.877+0000 7f1c0d72d640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1bec06a430 0x7f1bec06c8f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1c0815bd10 tx=0x7f1bf8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:23.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:23.880+0000 7f1bfe7fc640 1 -- 172.21.15.38:0/811667296 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1c04076820 con 0x7f1c08071d80 2023-12-22T08:51:24.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.078+0000 7f1c0ef30640 1 -- 172.21.15.38:0/811667296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1c0809a2c0 con 0x7f1c08071d80 2023-12-22T08:51:24.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.618+0000 7f1bfe7fc640 1 -- 172.21.15.38:0/811667296 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v171) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1c0809a2c0 con 0x7f1c08071d80 2023-12-22T08:51:24.620 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-12-22T08:51:24.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.629+0000 7f1c0ef30640 1 -- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1bec06a430 msgr2=0x7f1bec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:24.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.629+0000 7f1c0ef30640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1bec06a430 0x7f1bec06c8f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1c0815bd10 tx=0x7f1bf8008040 comp rx=0 tx=0).stop 2023-12-22T08:51:24.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.629+0000 7f1c0ef30640 1 -- 172.21.15.38:0/811667296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c08071d80 msgr2=0x7f1c081f2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:24.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.629+0000 7f1c0ef30640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c08071d80 0x7f1c081f2990 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f1c04000c00 tx=0x7f1c040046c0 comp rx=0 tx=0).stop 2023-12-22T08:51:24.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.631+0000 7f1c0ef30640 1 -- 172.21.15.38:0/811667296 shutdown_connections 2023-12-22T08:51:24.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.631+0000 7f1c0ef30640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c08161580 0x7f1c0815bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:24.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.631+0000 7f1c0ef30640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1c080a35a0 0x7f1c0809c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:24.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.631+0000 7f1c0ef30640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f1bec06a430 0x7f1bec06c8f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:24.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.631+0000 7f1c0ef30640 1 --2- 172.21.15.38:0/811667296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c08071d80 0x7f1c081f2990 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:24.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.631+0000 7f1c0ef30640 1 -- 172.21.15.38:0/811667296 >> 172.21.15.38:0/811667296 conn(0x7f1c080cf000 msgr2=0x7f1c08160dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:24.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.632+0000 7f1c0ef30640 1 -- 172.21.15.38:0/811667296 shutdown_connections 2023-12-22T08:51:24.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.633+0000 7f1c0ef30640 1 -- 172.21.15.38:0/811667296 wait complete. 2023-12-22T08:51:24.656 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T08:51:24.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.855+0000 7f76f46e2640 1 Processor -- start 2023-12-22T08:51:24.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.855+0000 7f76f46e2640 1 -- start start 2023-12-22T08:51:24.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.857+0000 7f76f46e2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec15a370 0x7f76ec071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:24.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.857+0000 7f76f46e2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76ec15b3c0 0x7f76ec071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:24.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.857+0000 7f76f46e2640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ec0cd080 con 0x7f76ec06c260 2023-12-22T08:51:24.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.857+0000 7f76f46e2640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ec15b940 con 0x7f76ec15b3c0 2023-12-22T08:51:24.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.857+0000 7f76f46e2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0cd320 con 0x7f76ec15a370 2023-12-22T08:51:24.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.857+0000 7f76f2c7f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f76ec06c260 0x7f76ec06f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58322/0 (socket says 172.21.15.38:58322) 2023-12-22T08:51:24.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.857+0000 7f76f2c7f640 1 -- 172.21.15.38:0/517824503 learned_addr learned my addr 172.21.15.38:0/517824503 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:24.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.857+0000 7f76f1c7d640 1 --2- 172.21.15.38:0/517824503 >> v2:172.21.15.38:3300/0 conn(0x7f76ec15b3c0 0x7f76ec071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:24.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f247e640 1 --2- 172.21.15.38:0/517824503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec15a370 0x7f76ec071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:24.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033127906 0 0) 0x7f76ec0cd080 con 0x7f76ec06c260 2023-12-22T08:51:24.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76d8005730 con 0x7f76ec06c260 2023-12-22T08:51:24.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1992472770 0 0) 0x7f76d8005730 con 0x7f76ec06c260 2023-12-22T08:51:24.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec15a370 msgr2=0x7f76ec071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:24.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 --2- 172.21.15.38:0/517824503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec15a370 0x7f76ec071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 >> v2:172.21.15.38:3300/0 conn(0x7f76ec15b3c0 msgr2=0x7f76ec071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 --2- 172.21.15.38:0/517824503 >> v2:172.21.15.38:3300/0 conn(0x7f76ec15b3c0 0x7f76ec071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec0cd600 con 0x7f76ec06c260 2023-12-22T08:51:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f76e40019f0 con 0x7f76ec06c260 2023-12-22T08:51:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 >> v1:172.21.15.38:6789/0 conn(0x7f76ec06c260 legacy=0x7f76ec06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 --2- 172.21.15.38:0/517824503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec15a370 0x7f76d8005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 --2- 172.21.15.38:0/517824503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d8006150 0x7f76d80069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 --2- 172.21.15.38:0/517824503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d8006f10 0x7f76d8007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec15b940 con 0x7f76d8006f10 2023-12-22T08:51:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0cd320 con 0x7f76d8006150 2023-12-22T08:51:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.858+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d800dc40 con 0x7f76ec15a370 2023-12-22T08:51:24.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.859+0000 7f76f1c7d640 1 --2- 172.21.15.38:0/517824503 >> v2:172.21.15.38:3300/0 conn(0x7f76ec15b3c0 0x7f76ec071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:51:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.859+0000 7f76f2c7f640 1 --2- 172.21.15.38:0/517824503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d8006f10 0x7f76d8007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.859+0000 7f76f247e640 1 --2- 172.21.15.38:0/517824503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec15a370 0x7f76d8005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.859+0000 7f76f2c7f640 1 -- 172.21.15.38:0/517824503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec15a370 msgr2=0x7f76d8005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.859+0000 7f76f2c7f640 1 --2- 172.21.15.38:0/517824503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec15a370 0x7f76d8005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.859+0000 7f76f1c7d640 1 --2- 172.21.15.38:0/517824503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d8006150 0x7f76d80069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.859+0000 7f76f2c7f640 1 -- 172.21.15.38:0/517824503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d8006150 msgr2=0x7f76d80069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.859+0000 7f76f2c7f640 1 --2- 172.21.15.38:0/517824503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d8006150 0x7f76d80069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.859+0000 7f76f2c7f640 1 -- 172.21.15.38:0/517824503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8005730 con 0x7f76d8006f10 2023-12-22T08:51:24.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.860+0000 7f76f2c7f640 1 --2- 172.21.15.38:0/517824503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d8006f10 0x7f76d8007390 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f76e400a7b0 tx=0x7f76d8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead3f683586e4f86 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:24.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.861+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4034630 con 0x7f76d8006f10 2023-12-22T08:51:24.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.861+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e402f070 con 0x7f76d8006f10 2023-12-22T08:51:24.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.861+0000 7f76f147c640 1 -- 172.21.15.38:0/517824503 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e40349f0 con 0x7f76d8006f10 2023-12-22T08:51:24.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.861+0000 7f76f46e2640 1 -- 172.21.15.38:0/517824503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d8006f10 msgr2=0x7f76d8007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:24.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.861+0000 7f76f46e2640 1 --2- 172.21.15.38:0/517824503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d8006f10 0x7f76d8007390 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f76e400a7b0 tx=0x7f76d8007a00 comp rx=0 tx=0).stop 2023-12-22T08:51:24.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.861+0000 7f76f2c7f640 1 -- 172.21.15.38:0/517824503 reap_dead start 2023-12-22T08:51:24.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.861+0000 7f76f46e2640 1 -- 172.21.15.38:0/517824503 shutdown_connections 2023-12-22T08:51:24.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.861+0000 7f76f46e2640 1 -- 172.21.15.38:0/517824503 >> 172.21.15.38:0/517824503 conn(0x7f76ec0b20c0 msgr2=0x7f76ec0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:24.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.861+0000 7f76f46e2640 1 -- 172.21.15.38:0/517824503 shutdown_connections 2023-12-22T08:51:24.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.861+0000 7f76f46e2640 1 -- 172.21.15.38:0/517824503 wait complete. 2023-12-22T08:51:24.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.863+0000 7f76f46e2640 1 Processor -- start 2023-12-22T08:51:24.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.863+0000 7f76f46e2640 1 -- start start 2023-12-22T08:51:24.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.864+0000 7f76f46e2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d8006f10 0x7f76ec152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.864+0000 7f76f46e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec156f80 0x7f76ec157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.864+0000 7f76f46e2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0714d0 0x7f76ec071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.864+0000 7f76f46e2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0ae190 con 0x7f76d8006f10 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.864+0000 7f76f46e2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec071e90 con 0x7f76ec156f80 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.864+0000 7f76f46e2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0ad690 con 0x7f76ec0714d0 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.865+0000 7f76f247e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d8006f10 0x7f76ec152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.865+0000 7f76f247e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d8006f10 0x7f76ec152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51290/0 (socket says 172.21.15.38:51290) 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.865+0000 7f76f247e640 1 -- 172.21.15.38:0/1461963291 learned_addr learned my addr 172.21.15.38:0/1461963291 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.865+0000 7f76f1c7d640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec156f80 0x7f76ec157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.865+0000 7f76f247e640 1 -- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0714d0 msgr2=0x7f76ec071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.865+0000 7f76f2c7f640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0714d0 0x7f76ec071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.865+0000 7f76f247e640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0714d0 0x7f76ec071950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.865+0000 7f76f247e640 1 -- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec156f80 msgr2=0x7f76ec157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:24.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.865+0000 7f76f247e640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec156f80 0x7f76ec157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:24.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.865+0000 7f76f247e640 1 -- 172.21.15.38:0/1461963291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec0aca80 con 0x7f76d8006f10 2023-12-22T08:51:24.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.866+0000 7f76f247e640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d8006f10 0x7f76ec152120 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f76e8011600 tx=0x7f76e8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:24.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.866+0000 7f76e2ffd640 1 -- 172.21.15.38:0/1461963291 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e800f920 con 0x7f76d8006f10 2023-12-22T08:51:24.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.866+0000 7f76e2ffd640 1 -- 172.21.15.38:0/1461963291 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e800fa80 con 0x7f76d8006f10 2023-12-22T08:51:24.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.866+0000 7f76e2ffd640 1 -- 172.21.15.38:0/1461963291 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e800fdf0 con 0x7f76d8006f10 2023-12-22T08:51:24.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.866+0000 7f76f46e2640 1 -- 172.21.15.38:0/1461963291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ec0acd60 con 0x7f76d8006f10 2023-12-22T08:51:24.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.866+0000 7f76f46e2640 1 -- 172.21.15.38:0/1461963291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec0ad320 con 0x7f76d8006f10 2023-12-22T08:51:24.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.867+0000 7f76f46e2640 1 -- 172.21.15.38:0/1461963291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ec061910 con 0x7f76d8006f10 2023-12-22T08:51:24.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.868+0000 7f76e2ffd640 1 -- 172.21.15.38:0/1461963291 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f76e8015460 con 0x7f76d8006f10 2023-12-22T08:51:24.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.869+0000 7f76e2ffd640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76d006a430 0x7f76d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:24.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.869+0000 7f76e2ffd640 1 -- 172.21.15.38:0/1461963291 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f76e8088e30 con 0x7f76d8006f10 2023-12-22T08:51:24.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.870+0000 7f76f1c7d640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76d006a430 0x7f76d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:24.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.871+0000 7f76f1c7d640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76d006a430 0x7f76d006c8f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0720c0 tx=0x7f76dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:24.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:24.874+0000 7f76e2ffd640 1 -- 172.21.15.38:0/1461963291 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f76e8054470 con 0x7f76d8006f10 2023-12-22T08:51:25.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.109+0000 7f76f46e2640 1 -- 172.21.15.38:0/1461963291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f76ec0b4b30 con 0x7f76d8006f10 2023-12-22T08:51:25.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.120+0000 7f76e2ffd640 1 -- 172.21.15.38:0/1461963291 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v74) v1 ==== 174+0+0 (secure 0 0 0) 0x7f76e8057a90 con 0x7f76d8006f10 2023-12-22T08:51:25.122 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 20 and data pool 21 2023-12-22T08:51:25.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.124+0000 7f76f46e2640 1 -- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76d006a430 msgr2=0x7f76d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:25.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.124+0000 7f76f46e2640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76d006a430 0x7f76d006c8f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0720c0 tx=0x7f76dc008040 comp rx=0 tx=0).stop 2023-12-22T08:51:25.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.124+0000 7f76f46e2640 1 -- 172.21.15.38:0/1461963291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d8006f10 msgr2=0x7f76ec152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:25.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.124+0000 7f76f46e2640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d8006f10 0x7f76ec152120 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f76e8011600 tx=0x7f76e8011ac0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.124+0000 7f76f46e2640 1 -- 172.21.15.38:0/1461963291 shutdown_connections 2023-12-22T08:51:25.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.124+0000 7f76f46e2640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0714d0 0x7f76ec071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.124+0000 7f76f46e2640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec156f80 0x7f76ec157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.124+0000 7f76f46e2640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f76d006a430 0x7f76d006c8f0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.124+0000 7f76f46e2640 1 --2- 172.21.15.38:0/1461963291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76d8006f10 0x7f76ec152120 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.124+0000 7f76f46e2640 1 -- 172.21.15.38:0/1461963291 >> 172.21.15.38:0/1461963291 conn(0x7f76ec0b20c0 msgr2=0x7f76ec06c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:25.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.125+0000 7f76f46e2640 1 -- 172.21.15.38:0/1461963291 shutdown_connections 2023-12-22T08:51:25.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.125+0000 7f76f46e2640 1 -- 172.21.15.38:0/1461963291 wait complete. 2023-12-22T08:51:25.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:51:25.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.345+0000 7f350edab640 1 Processor -- start 2023-12-22T08:51:25.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.345+0000 7f350edab640 1 -- start start 2023-12-22T08:51:25.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.347+0000 7f350edab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35081547a0 0x7f350815b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:25.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.347+0000 7f350edab640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3508071b90 0x7f3508070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:25.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.347+0000 7f350edab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3508154b80 0x7f35080ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:25.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.347+0000 7f350edab640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35080716a0 con 0x7f3508071b90 2023-12-22T08:51:25.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.347+0000 7f350edab640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35080710e0 con 0x7f3508154b80 2023-12-22T08:51:25.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.347+0000 7f350edab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35080713c0 con 0x7f35081547a0 2023-12-22T08:51:25.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.347+0000 7f3507fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3508071b90 0x7f3508070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:25.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.347+0000 7f3507fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3508071b90 0x7f3508070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51304/0 (socket says 172.21.15.38:51304) 2023-12-22T08:51:25.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.347+0000 7f3507fff640 1 -- 172.21.15.38:0/3233743333 learned_addr learned my addr 172.21.15.38:0/3233743333 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:25.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.348+0000 7f350d348640 1 --2- 172.21.15.38:0/3233743333 >> v2:172.21.15.89:3300/0 conn(0x7f3508154b80 0x7f35080ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:25.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.348+0000 7f350cb47640 1 --2- 172.21.15.38:0/3233743333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35081547a0 0x7f350815b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:25.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.348+0000 7f3507fff640 1 -- 172.21.15.38:0/3233743333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35081547a0 msgr2=0x7f350815b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:25.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.348+0000 7f3507fff640 1 --2- 172.21.15.38:0/3233743333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35081547a0 0x7f350815b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.348+0000 7f3507fff640 1 -- 172.21.15.38:0/3233743333 >> v2:172.21.15.89:3300/0 conn(0x7f3508154b80 msgr2=0x7f35080ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:25.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.348+0000 7f3507fff640 1 --2- 172.21.15.38:0/3233743333 >> v2:172.21.15.89:3300/0 conn(0x7f3508154b80 0x7f35080ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.348+0000 7f3507fff640 1 -- 172.21.15.38:0/3233743333 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350815ab00 con 0x7f3508071b90 2023-12-22T08:51:25.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.349+0000 7f3507fff640 1 --2- 172.21.15.38:0/3233743333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3508071b90 0x7f3508070770 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f35080b4a30 tx=0x7f34f402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19739b55841a462 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:25.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.349+0000 7f35077fe640 1 -- 172.21.15.38:0/3233743333 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f402ee90 con 0x7f3508071b90 2023-12-22T08:51:25.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.349+0000 7f35077fe640 1 -- 172.21.15.38:0/3233743333 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f4036440 con 0x7f3508071b90 2023-12-22T08:51:25.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.349+0000 7f35077fe640 1 -- 172.21.15.38:0/3233743333 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f40367d0 con 0x7f3508071b90 2023-12-22T08:51:25.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.350+0000 7f350edab640 1 -- 172.21.15.38:0/3233743333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3508071b90 msgr2=0x7f3508070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:25.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.350+0000 7f350edab640 1 --2- 172.21.15.38:0/3233743333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3508071b90 0x7f3508070770 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f35080b4a30 tx=0x7f34f402e0e0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.350+0000 7f350edab640 1 -- 172.21.15.38:0/3233743333 shutdown_connections 2023-12-22T08:51:25.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.350+0000 7f350edab640 1 --2- 172.21.15.38:0/3233743333 >> v2:172.21.15.89:3300/0 conn(0x7f3508154b80 0x7f35080ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.350+0000 7f350edab640 1 --2- 172.21.15.38:0/3233743333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3508071b90 0x7f3508070770 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.350+0000 7f350edab640 1 --2- 172.21.15.38:0/3233743333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35081547a0 0x7f350815b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.350+0000 7f350edab640 1 -- 172.21.15.38:0/3233743333 >> 172.21.15.38:0/3233743333 conn(0x7f35080cf070 msgr2=0x7f35080cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:25.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.350+0000 7f350edab640 1 -- 172.21.15.38:0/3233743333 shutdown_connections 2023-12-22T08:51:25.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.350+0000 7f350edab640 1 -- 172.21.15.38:0/3233743333 wait complete. 2023-12-22T08:51:25.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.353+0000 7f350edab640 1 Processor -- start 2023-12-22T08:51:25.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.353+0000 7f350edab640 1 -- start start 2023-12-22T08:51:25.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.354+0000 7f350edab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3508071b90 0x7f350806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:25.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.354+0000 7f350edab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35081547a0 0x7f3508147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:25.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.354+0000 7f350edab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3508154b80 0x7f35080b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:25.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.354+0000 7f350edab640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3508148380 con 0x7f3508071b90 2023-12-22T08:51:25.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.354+0000 7f350edab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35080b0530 con 0x7f3508154b80 2023-12-22T08:51:25.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.354+0000 7f350edab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3508148db0 con 0x7f35081547a0 2023-12-22T08:51:25.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.354+0000 7f350cb47640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3508071b90 0x7f350806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:25.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.354+0000 7f350cb47640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3508071b90 0x7f350806d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51308/0 (socket says 172.21.15.38:51308) 2023-12-22T08:51:25.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.354+0000 7f350cb47640 1 -- 172.21.15.38:0/1585419260 learned_addr learned my addr 172.21.15.38:0/1585419260 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:25.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.355+0000 7f350d348640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3508154b80 0x7f35080b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:25.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.355+0000 7f3507fff640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35081547a0 0x7f3508147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:25.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.355+0000 7f350cb47640 1 -- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35081547a0 msgr2=0x7f3508147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:25.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.355+0000 7f350cb47640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35081547a0 0x7f3508147e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.355+0000 7f350cb47640 1 -- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3508154b80 msgr2=0x7f35080b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:25.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.355+0000 7f350cb47640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3508154b80 0x7f35080b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.355+0000 7f350cb47640 1 -- 172.21.15.38:0/1585419260 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f400b770 con 0x7f3508071b90 2023-12-22T08:51:25.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.355+0000 7f350cb47640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3508071b90 0x7f350806d1e0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00d800 tx=0x7f34fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:25.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.355+0000 7f35057fa640 1 -- 172.21.15.38:0/1585419260 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0096a0 con 0x7f3508071b90 2023-12-22T08:51:25.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.356+0000 7f35057fa640 1 -- 172.21.15.38:0/1585419260 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc009800 con 0x7f3508071b90 2023-12-22T08:51:25.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.356+0000 7f35057fa640 1 -- 172.21.15.38:0/1585419260 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc009b90 con 0x7f3508071b90 2023-12-22T08:51:25.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.356+0000 7f350edab640 1 -- 172.21.15.38:0/1585419260 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350806d8c0 con 0x7f3508071b90 2023-12-22T08:51:25.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.356+0000 7f350edab640 1 -- 172.21.15.38:0/1585419260 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350806de80 con 0x7f3508071b90 2023-12-22T08:51:25.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.357+0000 7f350edab640 1 -- 172.21.15.38:0/1585419260 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3508061910 con 0x7f3508071b90 2023-12-22T08:51:25.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.358+0000 7f35057fa640 1 -- 172.21.15.38:0/1585419260 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f34fc009cf0 con 0x7f3508071b90 2023-12-22T08:51:25.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.359+0000 7f35057fa640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f34ec06a480 0x7f34ec06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:25.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.359+0000 7f35057fa640 1 -- 172.21.15.38:0/1585419260 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34fc088da0 con 0x7f3508071b90 2023-12-22T08:51:25.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.360+0000 7f3507fff640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f34ec06a480 0x7f34ec06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:25.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.361+0000 7f3507fff640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f34ec06a480 0x7f34ec06c940 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f34f4038000 tx=0x7f34f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:25.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.363+0000 7f35057fa640 1 -- 172.21.15.38:0/1585419260 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f34fc054400 con 0x7f3508071b90 2023-12-22T08:51:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.559+0000 7f350edab640 1 -- 172.21.15.38:0/1585419260 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35080cb950 con 0x7f3508071b90 2023-12-22T08:51:25.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.561+0000 7f35057fa640 1 -- 172.21.15.38:0/1585419260 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+16077 (secure 0 0 0) 0x7f34fc00b440 con 0x7f3508071b90 2023-12-22T08:51:25.562 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:25.562 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":172,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:51:25.110891+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:51:22.983948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-22T08:51:24.133013+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:51:25.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.563+0000 7f350edab640 1 -- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f34ec06a480 msgr2=0x7f34ec06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:25.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.563+0000 7f350edab640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f34ec06a480 0x7f34ec06c940 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f34f4038000 tx=0x7f34f4008040 comp rx=0 tx=0).stop 2023-12-22T08:51:25.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.563+0000 7f350edab640 1 -- 172.21.15.38:0/1585419260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3508071b90 msgr2=0x7f350806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:25.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.563+0000 7f350edab640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3508071b90 0x7f350806d1e0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00d800 tx=0x7f34fc00dcc0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.564+0000 7f350edab640 1 -- 172.21.15.38:0/1585419260 shutdown_connections 2023-12-22T08:51:25.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.564+0000 7f350edab640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3508154b80 0x7f35080b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.564+0000 7f350edab640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35081547a0 0x7f3508147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.564+0000 7f350edab640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f34ec06a480 0x7f34ec06c940 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.564+0000 7f350edab640 1 --2- 172.21.15.38:0/1585419260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3508071b90 0x7f350806d1e0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.564+0000 7f350edab640 1 -- 172.21.15.38:0/1585419260 >> 172.21.15.38:0/1585419260 conn(0x7f35080cf070 msgr2=0x7f35080ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:25.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.564+0000 7f350edab640 1 -- 172.21.15.38:0/1585419260 shutdown_connections 2023-12-22T08:51:25.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.564+0000 7f350edab640 1 -- 172.21.15.38:0/1585419260 wait complete. 2023-12-22T08:51:25.585 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:51:25.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.813+0000 7f3df8038640 1 Processor -- start 2023-12-22T08:51:25.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.813+0000 7f3df8038640 1 -- start start 2023-12-22T08:51:25.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.814+0000 7f3df8038640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00b3f90 0x7f3df015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:25.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.814+0000 7f3df8038640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3df006ca50 0x7f3df0070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:25.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.815+0000 7f3df8038640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df015eb20 con 0x7f3df015e740 2023-12-22T08:51:25.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.815+0000 7f3df8038640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df006e650 con 0x7f3df006ca50 2023-12-22T08:51:25.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.815+0000 7f3df8038640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df0070770 con 0x7f3df00b3f90 2023-12-22T08:51:25.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.815+0000 7f3df65d5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3df006ca50 0x7f3df0070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:25.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.815+0000 7f3df65d5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3df006ca50 0x7f3df0070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51316/0 (socket says 172.21.15.38:51316) 2023-12-22T08:51:25.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.815+0000 7f3df65d5640 1 -- 172.21.15.38:0/3473506018 learned_addr learned my addr 172.21.15.38:0/3473506018 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:25.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.815+0000 7f3df55d3640 1 --2- 172.21.15.38:0/3473506018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00b3f90 0x7f3df015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:25.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.815+0000 7f3df65d5640 1 -- 172.21.15.38:0/3473506018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00b3f90 msgr2=0x7f3df015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:25.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.815+0000 7f3df65d5640 1 --2- 172.21.15.38:0/3473506018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00b3f90 0x7f3df015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.815+0000 7f3df65d5640 1 -- 172.21.15.38:0/3473506018 >> v1:172.21.15.89:6789/0 conn(0x7f3df015e740 legacy=0x7f3df00b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:25.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.815+0000 7f3df65d5640 1 -- 172.21.15.38:0/3473506018 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df006cec0 con 0x7f3df006ca50 2023-12-22T08:51:25.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.817+0000 7f3df65d5640 1 --2- 172.21.15.38:0/3473506018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df006ca50 0x7f3df0070c00 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009e50 tx=0x7f3de802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463648a212dd3372 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:25.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.817+0000 7f3df4dd2640 1 -- 172.21.15.38:0/3473506018 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de802c950 con 0x7f3df006ca50 2023-12-22T08:51:25.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.817+0000 7f3df4dd2640 1 -- 172.21.15.38:0/3473506018 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de802cab0 con 0x7f3df006ca50 2023-12-22T08:51:25.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.817+0000 7f3df4dd2640 1 -- 172.21.15.38:0/3473506018 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de802ce40 con 0x7f3df006ca50 2023-12-22T08:51:25.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.818+0000 7f3df8038640 1 -- 172.21.15.38:0/3473506018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df006ca50 msgr2=0x7f3df0070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:25.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.818+0000 7f3df8038640 1 --2- 172.21.15.38:0/3473506018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df006ca50 0x7f3df0070c00 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009e50 tx=0x7f3de802bdb0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.818+0000 7f3df8038640 1 -- 172.21.15.38:0/3473506018 shutdown_connections 2023-12-22T08:51:25.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.818+0000 7f3df8038640 1 --2- 172.21.15.38:0/3473506018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df006ca50 0x7f3df0070c00 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.818+0000 7f3df8038640 1 --2- 172.21.15.38:0/3473506018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00b3f90 0x7f3df015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.818+0000 7f3df8038640 1 -- 172.21.15.38:0/3473506018 >> 172.21.15.38:0/3473506018 conn(0x7f3df00cfea0 msgr2=0x7f3df00d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:25.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.818+0000 7f3df8038640 1 -- 172.21.15.38:0/3473506018 shutdown_connections 2023-12-22T08:51:25.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.818+0000 7f3df8038640 1 -- 172.21.15.38:0/3473506018 wait complete. 2023-12-22T08:51:25.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.820+0000 7f3df8038640 1 Processor -- start 2023-12-22T08:51:25.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.821+0000 7f3df8038640 1 -- start start 2023-12-22T08:51:25.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.822+0000 7f3df8038640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df006ca50 0x7f3df0156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:25.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.822+0000 7f3df8038640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00b3f90 0x7f3df0159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:25.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.822+0000 7f3df8038640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df015e740 0x7f3df015ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:25.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.822+0000 7f3df8038640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df0157720 con 0x7f3df015e740 2023-12-22T08:51:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.822+0000 7f3df8038640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df01f6140 con 0x7f3df006ca50 2023-12-22T08:51:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.822+0000 7f3df8038640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df01f63e0 con 0x7f3df00b3f90 2023-12-22T08:51:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.822+0000 7f3df65d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df015e740 0x7f3df015ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.822+0000 7f3df65d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df015e740 0x7f3df015ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51318/0 (socket says 172.21.15.38:51318) 2023-12-22T08:51:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.822+0000 7f3df65d5640 1 -- 172.21.15.38:0/2837306225 learned_addr learned my addr 172.21.15.38:0/2837306225 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.822+0000 7f3df55d3640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00b3f90 0x7f3df0159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.822+0000 7f3df5dd4640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df006ca50 0x7f3df0156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.823+0000 7f3df65d5640 1 -- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00b3f90 msgr2=0x7f3df0159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.823+0000 7f3df65d5640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00b3f90 0x7f3df0159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.823+0000 7f3df65d5640 1 -- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df006ca50 msgr2=0x7f3df0156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.823+0000 7f3df65d5640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df006ca50 0x7f3df0156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.823+0000 7f3df65d5640 1 -- 172.21.15.38:0/2837306225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de8009b30 con 0x7f3df015e740 2023-12-22T08:51:25.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.823+0000 7f3df65d5640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df015e740 0x7f3df015ed40 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009e50 tx=0x7f3de8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:25.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.823+0000 7f3de67fc640 1 -- 172.21.15.38:0/2837306225 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8009510 con 0x7f3df015e740 2023-12-22T08:51:25.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.823+0000 7f3de67fc640 1 -- 172.21.15.38:0/2837306225 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de803e450 con 0x7f3df015e740 2023-12-22T08:51:25.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.823+0000 7f3de67fc640 1 -- 172.21.15.38:0/2837306225 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de803e800 con 0x7f3df015e740 2023-12-22T08:51:25.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.823+0000 7f3df8038640 1 -- 172.21.15.38:0/2837306225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df01f66c0 con 0x7f3df015e740 2023-12-22T08:51:25.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.824+0000 7f3df8038640 1 -- 172.21.15.38:0/2837306225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df0157410 con 0x7f3df015e740 2023-12-22T08:51:25.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.825+0000 7f3df8038640 1 -- 172.21.15.38:0/2837306225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df0061910 con 0x7f3df015e740 2023-12-22T08:51:25.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.826+0000 7f3de67fc640 1 -- 172.21.15.38:0/2837306225 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3de803e960 con 0x7f3df015e740 2023-12-22T08:51:25.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.827+0000 7f3de67fc640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3dd406a430 0x7f3dd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:25.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.827+0000 7f3de67fc640 1 -- 172.21.15.38:0/2837306225 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3de80ab6f0 con 0x7f3df015e740 2023-12-22T08:51:25.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.827+0000 7f3df5dd4640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3dd406a430 0x7f3dd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:25.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.829+0000 7f3df5dd4640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3dd406a430 0x7f3dd406c8f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3df00cf570 tx=0x7f3dec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:25.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:25.832+0000 7f3de67fc640 1 -- 172.21.15.38:0/2837306225 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3de8076c40 con 0x7f3df015e740 2023-12-22T08:51:26.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.030+0000 7f3df8038640 1 -- 172.21.15.38:0/2837306225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3df0161170 con 0x7f3df015e740 2023-12-22T08:51:26.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.033+0000 7f3de67fc640 1 -- 172.21.15.38:0/2837306225 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+16077 (secure 0 0 0) 0x7f3de807a260 con 0x7f3df015e740 2023-12-22T08:51:26.034 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:26.035 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":172,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:51:25.110891+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:51:22.983948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-22T08:51:24.133013+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:51:26.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.036+0000 7f3df8038640 1 -- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3dd406a430 msgr2=0x7f3dd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:26.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.036+0000 7f3df8038640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3dd406a430 0x7f3dd406c8f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3df00cf570 tx=0x7f3dec009040 comp rx=0 tx=0).stop 2023-12-22T08:51:26.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.036+0000 7f3df8038640 1 -- 172.21.15.38:0/2837306225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df015e740 msgr2=0x7f3df015ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:26.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.036+0000 7f3df8038640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df015e740 0x7f3df015ed40 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009e50 tx=0x7f3de8004a40 comp rx=0 tx=0).stop 2023-12-22T08:51:26.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.036+0000 7f3df8038640 1 -- 172.21.15.38:0/2837306225 shutdown_connections 2023-12-22T08:51:26.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.036+0000 7f3df8038640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3dd406a430 0x7f3dd406c8f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:26.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.036+0000 7f3df8038640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3df015e740 0x7f3df015ed40 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:26.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.036+0000 7f3df8038640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3df00b3f90 0x7f3df0159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:26.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.036+0000 7f3df8038640 1 --2- 172.21.15.38:0/2837306225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3df006ca50 0x7f3df0156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:26.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.036+0000 7f3df8038640 1 -- 172.21.15.38:0/2837306225 >> 172.21.15.38:0/2837306225 conn(0x7f3df00cfea0 msgr2=0x7f3df0161970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:26.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.036+0000 7f3df8038640 1 -- 172.21.15.38:0/2837306225 shutdown_connections 2023-12-22T08:51:26.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.036+0000 7f3df8038640 1 -- 172.21.15.38:0/2837306225 wait complete. 2023-12-22T08:51:26.057 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T08:51:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.282+0000 7f33241b9640 1 Processor -- start 2023-12-22T08:51:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.282+0000 7f33241b9640 1 -- start start 2023-12-22T08:51:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.284+0000 7f33241b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331c144d10 0x7f331c0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.284+0000 7f33241b9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f331c0cc670 0x7f331c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.284+0000 7f33241b9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f331c0b2590 0x7f331c15f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.284+0000 7f33241b9640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331c0b2a20 con 0x7f331c0cc670 2023-12-22T08:51:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.284+0000 7f33241b9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331c1450f0 con 0x7f331c0b2590 2023-12-22T08:51:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.284+0000 7f33241b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331c0ce010 con 0x7f331c144d10 2023-12-22T08:51:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.285+0000 7f3321754640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f331c0cc670 0x7f331c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.285+0000 7f3321754640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f331c0cc670 0x7f331c0b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51330/0 (socket says 172.21.15.38:51330) 2023-12-22T08:51:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.285+0000 7f3321754640 1 -- 172.21.15.38:0/586291190 learned_addr learned my addr 172.21.15.38:0/586291190 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.285+0000 7f3321f55640 1 --2- 172.21.15.38:0/586291190 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331c144d10 0x7f331c0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.285+0000 7f3322756640 1 --2- 172.21.15.38:0/586291190 >> v2:172.21.15.89:3300/0 conn(0x7f331c0b2590 0x7f331c15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.285+0000 7f3321754640 1 -- 172.21.15.38:0/586291190 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331c144d10 msgr2=0x7f331c0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.285+0000 7f3321754640 1 --2- 172.21.15.38:0/586291190 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331c144d10 0x7f331c0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.285+0000 7f3321754640 1 -- 172.21.15.38:0/586291190 >> v2:172.21.15.89:3300/0 conn(0x7f331c0b2590 msgr2=0x7f331c15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.285+0000 7f3321754640 1 --2- 172.21.15.38:0/586291190 >> v2:172.21.15.89:3300/0 conn(0x7f331c0b2590 0x7f331c15f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.285+0000 7f3321754640 1 -- 172.21.15.38:0/586291190 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c0ce2f0 con 0x7f331c0cc670 2023-12-22T08:51:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.287+0000 7f3321754640 1 --2- 172.21.15.38:0/586291190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f331c0cc670 0x7f331c0b2050 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f331c159590 tx=0x7f330c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e759e2efdf32e13 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.287+0000 7f3320f53640 1 -- 172.21.15.38:0/586291190 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c031860 con 0x7f331c0cc670 2023-12-22T08:51:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.287+0000 7f3320f53640 1 -- 172.21.15.38:0/586291190 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c0319c0 con 0x7f331c0cc670 2023-12-22T08:51:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.287+0000 7f3320f53640 1 -- 172.21.15.38:0/586291190 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c031d50 con 0x7f331c0cc670 2023-12-22T08:51:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.288+0000 7f33241b9640 1 -- 172.21.15.38:0/586291190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f331c0cc670 msgr2=0x7f331c0b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.288+0000 7f33241b9640 1 --2- 172.21.15.38:0/586291190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f331c0cc670 0x7f331c0b2050 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f331c159590 tx=0x7f330c02b900 comp rx=0 tx=0).stop 2023-12-22T08:51:26.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.288+0000 7f33241b9640 1 -- 172.21.15.38:0/586291190 shutdown_connections 2023-12-22T08:51:26.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.288+0000 7f33241b9640 1 --2- 172.21.15.38:0/586291190 >> v2:172.21.15.89:3300/0 conn(0x7f331c0b2590 0x7f331c15f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:26.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.288+0000 7f33241b9640 1 --2- 172.21.15.38:0/586291190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f331c0cc670 0x7f331c0b2050 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:26.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.288+0000 7f33241b9640 1 --2- 172.21.15.38:0/586291190 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331c144d10 0x7f331c0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.288+0000 7f33241b9640 1 -- 172.21.15.38:0/586291190 >> 172.21.15.38:0/586291190 conn(0x7f331c0cf070 msgr2=0x7f331c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.288+0000 7f33241b9640 1 -- 172.21.15.38:0/586291190 shutdown_connections 2023-12-22T08:51:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.288+0000 7f33241b9640 1 -- 172.21.15.38:0/586291190 wait complete. 2023-12-22T08:51:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.290+0000 7f33241b9640 1 Processor -- start 2023-12-22T08:51:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.290+0000 7f33241b9640 1 -- start start 2023-12-22T08:51:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.291+0000 7f33241b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331c0b2590 0x7f331c1f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.291+0000 7f33241b9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331c144d10 0x7f331c1f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.291+0000 7f33241b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f331c15a630 0x7f331c15aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.291+0000 7f33241b9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c15aff0 con 0x7f331c15a630 2023-12-22T08:51:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.291+0000 7f33241b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c1f8180 con 0x7f331c0b2590 2023-12-22T08:51:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.291+0000 7f33241b9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331c0aee30 con 0x7f331c144d10 2023-12-22T08:51:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.291+0000 7f3322756640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f331c15a630 0x7f331c15aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.291+0000 7f3322756640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f331c15a630 0x7f331c15aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51334/0 (socket says 172.21.15.38:51334) 2023-12-22T08:51:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.291+0000 7f3322756640 1 -- 172.21.15.38:0/3692837679 learned_addr learned my addr 172.21.15.38:0/3692837679 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.291+0000 7f3321754640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331c144d10 0x7f331c1f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.291+0000 7f3322756640 1 -- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331c144d10 msgr2=0x7f331c1f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.292+0000 7f3322756640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331c144d10 0x7f331c1f44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.292+0000 7f3322756640 1 -- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331c0b2590 msgr2=0x7f331c1f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.292+0000 7f3321f55640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331c0b2590 0x7f331c1f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.292+0000 7f3322756640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331c0b2590 0x7f331c1f7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.292+0000 7f3322756640 1 -- 172.21.15.38:0/3692837679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c0094d0 con 0x7f331c15a630 2023-12-22T08:51:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.292+0000 7f3322756640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f331c15a630 0x7f331c15aab0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f3314007e60 tx=0x7f331400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.292+0000 7f33127fc640 1 -- 172.21.15.38:0/3692837679 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314014620 con 0x7f331c15a630 2023-12-22T08:51:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.292+0000 7f33127fc640 1 -- 172.21.15.38:0/3692837679 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331400ee90 con 0x7f331c15a630 2023-12-22T08:51:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.292+0000 7f33127fc640 1 -- 172.21.15.38:0/3692837679 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33140149e0 con 0x7f331c15a630 2023-12-22T08:51:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.292+0000 7f33241b9640 1 -- 172.21.15.38:0/3692837679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331c0af110 con 0x7f331c15a630 2023-12-22T08:51:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.292+0000 7f33241b9640 1 -- 172.21.15.38:0/3692837679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331c0af6d0 con 0x7f331c15a630 2023-12-22T08:51:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.293+0000 7f33241b9640 1 -- 172.21.15.38:0/3692837679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331c1f8380 con 0x7f331c15a630 2023-12-22T08:51:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.295+0000 7f33127fc640 1 -- 172.21.15.38:0/3692837679 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3314014b40 con 0x7f331c15a630 2023-12-22T08:51:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.295+0000 7f33127fc640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f330006a430 0x7f330006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.296+0000 7f33127fc640 1 -- 172.21.15.38:0/3692837679 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3314089260 con 0x7f331c15a630 2023-12-22T08:51:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.296+0000 7f3321f55640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f330006a430 0x7f330006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.297+0000 7f3321f55640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f330006a430 0x7f330006c8f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3318009970 tx=0x7f3318008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.300+0000 7f33127fc640 1 -- 172.21.15.38:0/3692837679 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3314054850 con 0x7f331c15a630 2023-12-22T08:51:26.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:26.533+0000 7f33241b9640 1 -- 172.21.15.38:0/3692837679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f331c061910 con 0x7f331c15a630 2023-12-22T08:51:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.378+0000 7f33127fc640 1 -- 172.21.15.38:0/3692837679 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3314057e70 con 0x7f331c15a630 2023-12-22T08:51:27.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.382+0000 7f33241b9640 1 -- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f330006a430 msgr2=0x7f330006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:27.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.382+0000 7f33241b9640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f330006a430 0x7f330006c8f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3318009970 tx=0x7f3318008040 comp rx=0 tx=0).stop 2023-12-22T08:51:27.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.382+0000 7f33241b9640 1 -- 172.21.15.38:0/3692837679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f331c15a630 msgr2=0x7f331c15aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:27.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.382+0000 7f33241b9640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f331c15a630 0x7f331c15aab0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f3314007e60 tx=0x7f331400e4b0 comp rx=0 tx=0).stop 2023-12-22T08:51:27.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.382+0000 7f33241b9640 1 -- 172.21.15.38:0/3692837679 shutdown_connections 2023-12-22T08:51:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.382+0000 7f33241b9640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f330006a430 0x7f330006c8f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.382+0000 7f33241b9640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f331c15a630 0x7f331c15aab0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.382+0000 7f33241b9640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331c144d10 0x7f331c1f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.382+0000 7f33241b9640 1 --2- 172.21.15.38:0/3692837679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331c0b2590 0x7f331c1f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.382+0000 7f33241b9640 1 -- 172.21.15.38:0/3692837679 >> 172.21.15.38:0/3692837679 conn(0x7f331c0cf070 msgr2=0x7f331c0ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.382+0000 7f33241b9640 1 -- 172.21.15.38:0/3692837679 shutdown_connections 2023-12-22T08:51:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.382+0000 7f33241b9640 1 -- 172.21.15.38:0/3692837679 wait complete. 2023-12-22T08:51:27.405 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T08:51:27.406 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T08:51:27.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.622+0000 7f87d6e5f640 1 Processor -- start 2023-12-22T08:51:27.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.623+0000 7f87d6e5f640 1 -- start start 2023-12-22T08:51:27.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.624+0000 7f87d6e5f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87d00c5bf0 0x7f87d00d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:27.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.624+0000 7f87d6e5f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d00d0f60 con 0x7f87d0144c70 2023-12-22T08:51:27.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.624+0000 7f87d6e5f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d0070a30 con 0x7f87d00d0b10 2023-12-22T08:51:27.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.624+0000 7f87d6e5f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d0070750 con 0x7f87d00c5bf0 2023-12-22T08:51:27.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.625+0000 7f87d4bfb640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f87d0144c70 0x7f87d006fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58326/0 (socket says 172.21.15.38:58326) 2023-12-22T08:51:27.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.625+0000 7f87d4bfb640 1 -- 172.21.15.38:0/1926770977 learned_addr learned my addr 172.21.15.38:0/1926770977 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:27.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.625+0000 7f87cffff640 1 --2- 172.21.15.38:0/1926770977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87d00c5bf0 0x7f87d00d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:27.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.625+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474323495 0 0) 0x7f87c4001110 con 0x7f87d0144c70 2023-12-22T08:51:27.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.625+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87c0003520 con 0x7f87d0144c70 2023-12-22T08:51:27.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3180826254 0 0) 0x7f87c0003520 con 0x7f87d0144c70 2023-12-22T08:51:27.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87d00c5bf0 msgr2=0x7f87d00d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:27.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cf7fe640 1 --2- 172.21.15.38:0/1926770977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87d00c5bf0 0x7f87d00d05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:27.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 >> v1:172.21.15.89:6789/0 conn(0x7f87d00d0b10 legacy=0x7f87d015c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:27.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d015bc20 con 0x7f87d0144c70 2023-12-22T08:51:27.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f87c4001800 con 0x7f87d0144c70 2023-12-22T08:51:27.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 >> v1:172.21.15.38:6789/0 conn(0x7f87d0144c70 legacy=0x7f87d006fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:27.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cf7fe640 1 --2- 172.21.15.38:0/1926770977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87c00039a0 0x7f87c0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:27.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cf7fe640 1 --2- 172.21.15.38:0/1926770977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c00047c0 0x7f87c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:27.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cf7fe640 1 --2- 172.21.15.38:0/1926770977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c00052a0 0x7f87c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:27.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d0070750 con 0x7f87c00047c0 2023-12-22T08:51:27.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c000c0d0 con 0x7f87c00039a0 2023-12-22T08:51:27.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c000c290 con 0x7f87c00052a0 2023-12-22T08:51:27.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cffff640 1 --2- 172.21.15.38:0/1926770977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87d00c5bf0 0x7f87d00d05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:51:27.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87cffff640 1 --2- 172.21.15.38:0/1926770977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c00047c0 0x7f87c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:27.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.626+0000 7f87d4bfb640 1 --2- 172.21.15.38:0/1926770977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87c00039a0 0x7f87c0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:27.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.627+0000 7f87d53fc640 1 --2- 172.21.15.38:0/1926770977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c00052a0 0x7f87c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:27.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.627+0000 7f87cffff640 1 -- 172.21.15.38:0/1926770977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c00052a0 msgr2=0x7f87c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:27.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.627+0000 7f87cffff640 1 --2- 172.21.15.38:0/1926770977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87c00052a0 0x7f87c000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:27.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.627+0000 7f87cffff640 1 -- 172.21.15.38:0/1926770977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87c00039a0 msgr2=0x7f87c0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:27.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.627+0000 7f87cffff640 1 --2- 172.21.15.38:0/1926770977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87c00039a0 0x7f87c0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:27.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.627+0000 7f87cffff640 1 -- 172.21.15.38:0/1926770977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c0003520 con 0x7f87c00047c0 2023-12-22T08:51:27.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.628+0000 7f87cffff640 1 --2- 172.21.15.38:0/1926770977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c00047c0 0x7f87c0004c40 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f87bc006fd0 tx=0x7f87c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a13f63500ca376 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:27.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.628+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc033600 con 0x7f87c00047c0 2023-12-22T08:51:27.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.628+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc02f050 con 0x7f87c00047c0 2023-12-22T08:51:27.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.628+0000 7f87cf7fe640 1 -- 172.21.15.38:0/1926770977 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc033980 con 0x7f87c00047c0 2023-12-22T08:51:27.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.629+0000 7f87d6e5f640 1 -- 172.21.15.38:0/1926770977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c00047c0 msgr2=0x7f87c0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:27.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.629+0000 7f87d6e5f640 1 --2- 172.21.15.38:0/1926770977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c00047c0 0x7f87c0004c40 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f87bc006fd0 tx=0x7f87c00057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:27.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.629+0000 7f87d53fc640 1 -- 172.21.15.38:0/1926770977 reap_dead start 2023-12-22T08:51:27.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.629+0000 7f87d6e5f640 1 -- 172.21.15.38:0/1926770977 shutdown_connections 2023-12-22T08:51:27.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.629+0000 7f87d6e5f640 1 -- 172.21.15.38:0/1926770977 >> 172.21.15.38:0/1926770977 conn(0x7f87d0071840 msgr2=0x7f87d0071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:27.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.629+0000 7f87d6e5f640 1 -- 172.21.15.38:0/1926770977 shutdown_connections 2023-12-22T08:51:27.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.629+0000 7f87d6e5f640 1 -- 172.21.15.38:0/1926770977 wait complete. 2023-12-22T08:51:27.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.631+0000 7f87d6e5f640 1 Processor -- start 2023-12-22T08:51:27.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.631+0000 7f87d6e5f640 1 -- start start 2023-12-22T08:51:27.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.632+0000 7f87d6e5f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c00047c0 0x7f87d015a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:27.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.632+0000 7f87d6e5f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87d00b46a0 0x7f87d00b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:27.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.632+0000 7f87d6e5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87d01415d0 0x7f87d0141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:27.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.632+0000 7f87d6e5f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d00b5040 con 0x7f87c00047c0 2023-12-22T08:51:27.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.632+0000 7f87d6e5f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d01f5df0 con 0x7f87d01415d0 2023-12-22T08:51:27.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.632+0000 7f87d6e5f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d01f39f0 con 0x7f87d00b46a0 2023-12-22T08:51:27.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.633+0000 7f87d4bfb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c00047c0 0x7f87d015a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:27.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.633+0000 7f87d4bfb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c00047c0 0x7f87d015a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51350/0 (socket says 172.21.15.38:51350) 2023-12-22T08:51:27.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.633+0000 7f87d4bfb640 1 -- 172.21.15.38:0/678756734 learned_addr learned my addr 172.21.15.38:0/678756734 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:27.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.633+0000 7f87d4bfb640 1 -- 172.21.15.38:0/678756734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87d00b46a0 msgr2=0x7f87d00b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:27.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.633+0000 7f87d4bfb640 1 --2- 172.21.15.38:0/678756734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87d00b46a0 0x7f87d00b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:27.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.633+0000 7f87d4bfb640 1 -- 172.21.15.38:0/678756734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87d01415d0 msgr2=0x7f87d0141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:27.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.633+0000 7f87d53fc640 1 --2- 172.21.15.38:0/678756734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87d01415d0 0x7f87d0141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:27.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.633+0000 7f87d4bfb640 1 --2- 172.21.15.38:0/678756734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87d01415d0 0x7f87d0141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:27.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.633+0000 7f87d4bfb640 1 -- 172.21.15.38:0/678756734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d01f2de0 con 0x7f87c00047c0 2023-12-22T08:51:27.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.633+0000 7f87d4bfb640 1 --2- 172.21.15.38:0/678756734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c00047c0 0x7f87d015a940 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f87c400e780 tx=0x7f87c400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:27.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.634+0000 7f87cd7fa640 1 -- 172.21.15.38:0/678756734 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c400ee90 con 0x7f87c00047c0 2023-12-22T08:51:27.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.634+0000 7f87cd7fa640 1 -- 172.21.15.38:0/678756734 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c400c8d0 con 0x7f87c00047c0 2023-12-22T08:51:27.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.634+0000 7f87cd7fa640 1 -- 172.21.15.38:0/678756734 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c400cc80 con 0x7f87c00047c0 2023-12-22T08:51:27.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.634+0000 7f87d6e5f640 1 -- 172.21.15.38:0/678756734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d01f30c0 con 0x7f87c00047c0 2023-12-22T08:51:27.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.634+0000 7f87d6e5f640 1 -- 172.21.15.38:0/678756734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d01f3680 con 0x7f87c00047c0 2023-12-22T08:51:27.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.635+0000 7f87d6e5f640 1 -- 172.21.15.38:0/678756734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d0061910 con 0x7f87c00047c0 2023-12-22T08:51:27.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.636+0000 7f87cd7fa640 1 -- 172.21.15.38:0/678756734 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f87c401d460 con 0x7f87c00047c0 2023-12-22T08:51:27.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.637+0000 7f87cd7fa640 1 --2- 172.21.15.38:0/678756734 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87b406a430 0x7f87b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:27.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.637+0000 7f87cd7fa640 1 -- 172.21.15.38:0/678756734 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87c40886e0 con 0x7f87c00047c0 2023-12-22T08:51:27.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.638+0000 7f87cffff640 1 --2- 172.21.15.38:0/678756734 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87b406a430 0x7f87b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:27.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.639+0000 7f87cffff640 1 --2- 172.21.15.38:0/678756734 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87b406a430 0x7f87b406c8f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f87bc036000 tx=0x7f87bc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:27.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.642+0000 7f87cd7fa640 1 -- 172.21.15.38:0/678756734 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f87c4053cd0 con 0x7f87c00047c0 2023-12-22T08:51:27.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:27.876+0000 7f87d6e5f640 1 -- 172.21.15.38:0/678756734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f87d00d0f60 con 0x7f87c00047c0 2023-12-22T08:51:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.659+0000 7f87cd7fa640 1 -- 172.21.15.38:0/678756734 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v78) v1 ==== 122+0+0 (secure 0 0 0) 0x7f87d00d0f60 con 0x7f87c00047c0 2023-12-22T08:51:28.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.663+0000 7f87d6e5f640 1 -- 172.21.15.38:0/678756734 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87b406a430 msgr2=0x7f87b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:28.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.663+0000 7f87d6e5f640 1 --2- 172.21.15.38:0/678756734 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87b406a430 0x7f87b406c8f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f87bc036000 tx=0x7f87bc030000 comp rx=0 tx=0).stop 2023-12-22T08:51:28.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.663+0000 7f87d6e5f640 1 -- 172.21.15.38:0/678756734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c00047c0 msgr2=0x7f87d015a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:28.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.663+0000 7f87d6e5f640 1 --2- 172.21.15.38:0/678756734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c00047c0 0x7f87d015a940 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f87c400e780 tx=0x7f87c400ec40 comp rx=0 tx=0).stop 2023-12-22T08:51:28.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.663+0000 7f87d6e5f640 1 -- 172.21.15.38:0/678756734 shutdown_connections 2023-12-22T08:51:28.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.663+0000 7f87d6e5f640 1 --2- 172.21.15.38:0/678756734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87d01415d0 0x7f87d0141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:28.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.663+0000 7f87d6e5f640 1 --2- 172.21.15.38:0/678756734 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87d00b46a0 0x7f87d00b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:28.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.663+0000 7f87d6e5f640 1 --2- 172.21.15.38:0/678756734 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87b406a430 0x7f87b406c8f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:28.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.663+0000 7f87d6e5f640 1 --2- 172.21.15.38:0/678756734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c00047c0 0x7f87d015a940 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:28.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.663+0000 7f87d6e5f640 1 -- 172.21.15.38:0/678756734 >> 172.21.15.38:0/678756734 conn(0x7f87d0071840 msgr2=0x7f87d00ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:28.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.663+0000 7f87d6e5f640 1 -- 172.21.15.38:0/678756734 shutdown_connections 2023-12-22T08:51:28.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.663+0000 7f87d6e5f640 1 -- 172.21.15.38:0/678756734 wait complete. 2023-12-22T08:51:28.686 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T08:51:28.686 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:51:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.910+0000 7fe609fbf640 1 Processor -- start 2023-12-22T08:51:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.910+0000 7fe609fbf640 1 -- start start 2023-12-22T08:51:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.912+0000 7fe609fbf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe60415b420 0x7fe60406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.912+0000 7fe609fbf640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe6040a44a0 0x7fe6040708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.912+0000 7fe609fbf640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe604070e30 0x7fe60406f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.912+0000 7fe609fbf640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6040cdae0 con 0x7fe6040a44a0 2023-12-22T08:51:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.912+0000 7fe609fbf640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60406dec0 con 0x7fe60415b420 2023-12-22T08:51:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.912+0000 7fe609fbf640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe604071250 con 0x7fe604070e30 2023-12-22T08:51:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.912+0000 7fe603fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe6040a44a0 0x7fe6040708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.913+0000 7fe603fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe6040a44a0 0x7fe6040708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51352/0 (socket says 172.21.15.38:51352) 2023-12-22T08:51:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.913+0000 7fe603fff640 1 -- 172.21.15.38:0/2581610143 learned_addr learned my addr 172.21.15.38:0/2581610143 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.913+0000 7fe608fbd640 1 --2- 172.21.15.38:0/2581610143 >> v2:172.21.15.89:3300/0 conn(0x7fe60415b420 0x7fe60406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.913+0000 7fe6097be640 1 --2- 172.21.15.38:0/2581610143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe604070e30 0x7fe60406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.913+0000 7fe603fff640 1 -- 172.21.15.38:0/2581610143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe604070e30 msgr2=0x7fe60406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.913+0000 7fe603fff640 1 --2- 172.21.15.38:0/2581610143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe604070e30 0x7fe60406f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.913+0000 7fe603fff640 1 -- 172.21.15.38:0/2581610143 >> v2:172.21.15.89:3300/0 conn(0x7fe60415b420 msgr2=0x7fe60406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.913+0000 7fe603fff640 1 --2- 172.21.15.38:0/2581610143 >> v2:172.21.15.89:3300/0 conn(0x7fe60415b420 0x7fe60406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.913+0000 7fe603fff640 1 -- 172.21.15.38:0/2581610143 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60415b800 con 0x7fe6040a44a0 2023-12-22T08:51:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.915+0000 7fe603fff640 1 --2- 172.21.15.38:0/2581610143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6040a44a0 0x7fe6040708f0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fe6040613e0 tx=0x7fe5f002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6cbd0be62d925e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.915+0000 7fe6037fe640 1 -- 172.21.15.38:0/2581610143 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0031860 con 0x7fe6040a44a0 2023-12-22T08:51:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.915+0000 7fe6037fe640 1 -- 172.21.15.38:0/2581610143 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f00319c0 con 0x7fe6040a44a0 2023-12-22T08:51:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.915+0000 7fe6037fe640 1 -- 172.21.15.38:0/2581610143 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0031d50 con 0x7fe6040a44a0 2023-12-22T08:51:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.916+0000 7fe609fbf640 1 -- 172.21.15.38:0/2581610143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6040a44a0 msgr2=0x7fe6040708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.916+0000 7fe609fbf640 1 --2- 172.21.15.38:0/2581610143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6040a44a0 0x7fe6040708f0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fe6040613e0 tx=0x7fe5f002b900 comp rx=0 tx=0).stop 2023-12-22T08:51:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.916+0000 7fe609fbf640 1 -- 172.21.15.38:0/2581610143 shutdown_connections 2023-12-22T08:51:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.916+0000 7fe609fbf640 1 --2- 172.21.15.38:0/2581610143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe604070e30 0x7fe60406f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.916+0000 7fe609fbf640 1 --2- 172.21.15.38:0/2581610143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6040a44a0 0x7fe6040708f0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.916+0000 7fe609fbf640 1 --2- 172.21.15.38:0/2581610143 >> v2:172.21.15.89:3300/0 conn(0x7fe60415b420 0x7fe60406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.916+0000 7fe609fbf640 1 -- 172.21.15.38:0/2581610143 >> 172.21.15.38:0/2581610143 conn(0x7fe6040b1f70 msgr2=0x7fe6040b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:28.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.916+0000 7fe609fbf640 1 -- 172.21.15.38:0/2581610143 shutdown_connections 2023-12-22T08:51:28.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.916+0000 7fe609fbf640 1 -- 172.21.15.38:0/2581610143 wait complete. 2023-12-22T08:51:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.918+0000 7fe609fbf640 1 Processor -- start 2023-12-22T08:51:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.919+0000 7fe609fbf640 1 -- start start 2023-12-22T08:51:28.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.920+0000 7fe609fbf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe604070e30 0x7fe6041477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.920+0000 7fe609fbf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6040a44a0 0x7fe6040a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.920+0000 7fe609fbf640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe60415b420 0x7fe60415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.920+0000 7fe609fbf640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040a1320 con 0x7fe604070e30 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.920+0000 7fe609fbf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040a35a0 con 0x7fe6040a44a0 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.920+0000 7fe609fbf640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040a32c0 con 0x7fe60415b420 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.920+0000 7fe608fbd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe604070e30 0x7fe6041477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.920+0000 7fe608fbd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe604070e30 0x7fe6041477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51354/0 (socket says 172.21.15.38:51354) 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.920+0000 7fe608fbd640 1 -- 172.21.15.38:0/1324277656 learned_addr learned my addr 172.21.15.38:0/1324277656 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.921+0000 7fe603fff640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6040a44a0 0x7fe6040a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.921+0000 7fe6097be640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe60415b420 0x7fe60415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.921+0000 7fe608fbd640 1 -- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe60415b420 msgr2=0x7fe60415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.921+0000 7fe608fbd640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe60415b420 0x7fe60415cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.921+0000 7fe608fbd640 1 -- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6040a44a0 msgr2=0x7fe6040a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.921+0000 7fe608fbd640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6040a44a0 0x7fe6040a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:28.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.921+0000 7fe608fbd640 1 -- 172.21.15.38:0/1324277656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f00094d0 con 0x7fe604070e30 2023-12-22T08:51:28.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.921+0000 7fe608fbd640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe604070e30 0x7fe6041477c0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800d800 tx=0x7fe5f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:28.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.921+0000 7fe6017fa640 1 -- 172.21.15.38:0/1324277656 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800b6c0 con 0x7fe604070e30 2023-12-22T08:51:28.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.921+0000 7fe6017fa640 1 -- 172.21.15.38:0/1324277656 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800b820 con 0x7fe604070e30 2023-12-22T08:51:28.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.921+0000 7fe609fbf640 1 -- 172.21.15.38:0/1324277656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6040a0c60 con 0x7fe604070e30 2023-12-22T08:51:28.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.921+0000 7fe6017fa640 1 -- 172.21.15.38:0/1324277656 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800bbb0 con 0x7fe604070e30 2023-12-22T08:51:28.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.922+0000 7fe609fbf640 1 -- 172.21.15.38:0/1324277656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe604147d00 con 0x7fe604070e30 2023-12-22T08:51:28.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.923+0000 7fe609fbf640 1 -- 172.21.15.38:0/1324277656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6040a1590 con 0x7fe604070e30 2023-12-22T08:51:28.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.924+0000 7fe6017fa640 1 -- 172.21.15.38:0/1324277656 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe5f800bd10 con 0x7fe604070e30 2023-12-22T08:51:28.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.925+0000 7fe6017fa640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5e806a430 0x7fe5e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:28.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.925+0000 7fe6017fa640 1 -- 172.21.15.38:0/1324277656 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5f8088f10 con 0x7fe604070e30 2023-12-22T08:51:28.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.925+0000 7fe603fff640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5e806a430 0x7fe5e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:28.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.926+0000 7fe603fff640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5e806a430 0x7fe5e806c8f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0036000 tx=0x7fe5f003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:28.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:28.929+0000 7fe6017fa640 1 -- 172.21.15.38:0/1324277656 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe5f8054460 con 0x7fe604070e30 2023-12-22T08:51:29.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.159+0000 7fe609fbf640 1 -- 172.21.15.38:0/1324277656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6040a0ac0 con 0x7fe604070e30 2023-12-22T08:51:29.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.160+0000 7fe6017fa640 1 -- 172.21.15.38:0/1324277656 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4649 (secure 0 0 0) 0x7fe6040a0ac0 con 0x7fe604070e30 2023-12-22T08:51:29.162 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:29.162 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1443382612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1443382612},{"type":"v1","addr":"172.21.15.38:6835","nonce":1443382612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1913310975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1913310975},{"type":"v1","addr":"172.21.15.89:6836","nonce":1913310975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/218839128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":218839128},{"type":"v1","addr":"172.21.15.89:6837","nonce":218839128}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:51:25.111775+0000","modified":"2023-12-22T08:51:28.645925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8553":{"gid":8553,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6834/1387101372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1387101372},{"type":"v1","addr":"172.21.15.38:6834","nonce":1387101372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-22T08:51:29.162 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 78 2023-12-22T08:51:29.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.163+0000 7fe609fbf640 1 -- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5e806a430 msgr2=0x7fe5e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:29.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.163+0000 7fe609fbf640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5e806a430 0x7fe5e806c8f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0036000 tx=0x7fe5f003c040 comp rx=0 tx=0).stop 2023-12-22T08:51:29.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.163+0000 7fe609fbf640 1 -- 172.21.15.38:0/1324277656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe604070e30 msgr2=0x7fe6041477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:29.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.163+0000 7fe609fbf640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe604070e30 0x7fe6041477c0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800d800 tx=0x7fe5f800dcc0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.163+0000 7fe609fbf640 1 -- 172.21.15.38:0/1324277656 shutdown_connections 2023-12-22T08:51:29.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.163+0000 7fe609fbf640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe60415b420 0x7fe60415cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.163+0000 7fe609fbf640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6040a44a0 0x7fe6040a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.163+0000 7fe609fbf640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe5e806a430 0x7fe5e806c8f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.163+0000 7fe609fbf640 1 --2- 172.21.15.38:0/1324277656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe604070e30 0x7fe6041477c0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.163+0000 7fe609fbf640 1 -- 172.21.15.38:0/1324277656 >> 172.21.15.38:0/1324277656 conn(0x7fe6040b1f70 msgr2=0x7fe6040cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:29.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.163+0000 7fe609fbf640 1 -- 172.21.15.38:0/1324277656 shutdown_connections 2023-12-22T08:51:29.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.163+0000 7fe609fbf640 1 -- 172.21.15.38:0/1324277656 wait complete. 2023-12-22T08:51:29.183 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:51:29.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.403+0000 7ff51d4b2640 1 Processor -- start 2023-12-22T08:51:29.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.403+0000 7ff51d4b2640 1 -- start start 2023-12-22T08:51:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.405+0000 7ff51d4b2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff518144d10 0x7ff5180cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.405+0000 7ff51d4b2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5180b2760 0x7ff518070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.405+0000 7ff51d4b2640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5181450f0 con 0x7ff5180cc670 2023-12-22T08:51:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.405+0000 7ff51d4b2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5180ce010 con 0x7ff518144d10 2023-12-22T08:51:29.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.405+0000 7ff51d4b2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5180ce2f0 con 0x7ff5180b2760 2023-12-22T08:51:29.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.406+0000 7ff50ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff5180cc670 0x7ff5180b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58328/0 (socket says 172.21.15.38:58328) 2023-12-22T08:51:29.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.406+0000 7ff50ffff640 1 -- 172.21.15.38:0/2553284929 learned_addr learned my addr 172.21.15.38:0/2553284929 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:29.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.406+0000 7ff516ffd640 1 --2- 172.21.15.38:0/2553284929 >> v2:172.21.15.89:3300/0 conn(0x7ff518144d10 0x7ff5180cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.406+0000 7ff5177fe640 1 --2- 172.21.15.38:0/2553284929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5180b2760 0x7ff518070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.406+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793270907 0 0) 0x7ff5181450f0 con 0x7ff5180cc670 2023-12-22T08:51:29.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.406+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff504003520 con 0x7ff5180cc670 2023-12-22T08:51:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2111233857 0 0) 0x7ff504003520 con 0x7ff5180cc670 2023-12-22T08:51:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5180b2760 msgr2=0x7ff518070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 --2- 172.21.15.38:0/2553284929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5180b2760 0x7ff518070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 >> v2:172.21.15.89:3300/0 conn(0x7ff518144d10 msgr2=0x7ff5180cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 --2- 172.21.15.38:0/2553284929 >> v2:172.21.15.89:3300/0 conn(0x7ff518144d10 0x7ff5180cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5180ce5d0 con 0x7ff5180cc670 2023-12-22T08:51:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7ff500001670 con 0x7ff5180cc670 2023-12-22T08:51:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 >> v1:172.21.15.38:6789/0 conn(0x7ff5180cc670 legacy=0x7ff5180b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 --2- 172.21.15.38:0/2553284929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5180b2760 0x7ff504003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 --2- 172.21.15.38:0/2553284929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff504003ef0 0x7ff5040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 --2- 172.21.15.38:0/2553284929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff504004d00 0x7ff504005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5180ce010 con 0x7ff504003ef0 2023-12-22T08:51:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5180ce2f0 con 0x7ff504004d00 2023-12-22T08:51:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50400b980 con 0x7ff5180b2760 2023-12-22T08:51:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff50ffff640 1 --2- 172.21.15.38:0/2553284929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff504003ef0 0x7ff5040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff516ffd640 1 --2- 172.21.15.38:0/2553284929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5180b2760 0x7ff504003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.407+0000 7ff5177fe640 1 --2- 172.21.15.38:0/2553284929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff504004d00 0x7ff504005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.408+0000 7ff50ffff640 1 -- 172.21.15.38:0/2553284929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5180b2760 msgr2=0x7ff504003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.408+0000 7ff50ffff640 1 --2- 172.21.15.38:0/2553284929 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5180b2760 0x7ff504003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.408+0000 7ff50ffff640 1 -- 172.21.15.38:0/2553284929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff504004d00 msgr2=0x7ff504005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.408+0000 7ff50ffff640 1 --2- 172.21.15.38:0/2553284929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff504004d00 0x7ff504005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.408+0000 7ff50ffff640 1 -- 172.21.15.38:0/2553284929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5180ce5d0 con 0x7ff504003ef0 2023-12-22T08:51:29.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.409+0000 7ff50ffff640 1 --2- 172.21.15.38:0/2553284929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff504003ef0 0x7ff5040047c0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c340 tx=0x7ff5040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a24027bbbb0b66 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:29.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.409+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50002cbf0 con 0x7ff504003ef0 2023-12-22T08:51:29.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.409+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50002cd50 con 0x7ff504003ef0 2023-12-22T08:51:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.409+0000 7ff5167fc640 1 -- 172.21.15.38:0/2553284929 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500005af0 con 0x7ff504003ef0 2023-12-22T08:51:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.409+0000 7ff51d4b2640 1 -- 172.21.15.38:0/2553284929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff504003ef0 msgr2=0x7ff5040047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.409+0000 7ff51d4b2640 1 --2- 172.21.15.38:0/2553284929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff504003ef0 0x7ff5040047c0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c340 tx=0x7ff5040057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.410+0000 7ff5177fe640 1 -- 172.21.15.38:0/2553284929 reap_dead start 2023-12-22T08:51:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.410+0000 7ff51d4b2640 1 -- 172.21.15.38:0/2553284929 shutdown_connections 2023-12-22T08:51:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.410+0000 7ff51d4b2640 1 -- 172.21.15.38:0/2553284929 >> 172.21.15.38:0/2553284929 conn(0x7ff5180cf070 msgr2=0x7ff5180cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.410+0000 7ff51d4b2640 1 -- 172.21.15.38:0/2553284929 shutdown_connections 2023-12-22T08:51:29.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.410+0000 7ff51d4b2640 1 -- 172.21.15.38:0/2553284929 wait complete. 2023-12-22T08:51:29.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.412+0000 7ff51d4b2640 1 Processor -- start 2023-12-22T08:51:29.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.412+0000 7ff51d4b2640 1 -- start start 2023-12-22T08:51:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff51d4b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff504003ef0 0x7ff518141700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff51d4b2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5180adc60 0x7ff51815a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff51d4b2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5180ae0e0 0x7ff51815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff51d4b2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51806c190 con 0x7ff5180adc60 2023-12-22T08:51:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff51d4b2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5180a9c70 con 0x7ff504003ef0 2023-12-22T08:51:29.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff51d4b2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5180a9130 con 0x7ff5180ae0e0 2023-12-22T08:51:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff50ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5180adc60 0x7ff51815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff50ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5180adc60 0x7ff51815a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51376/0 (socket says 172.21.15.38:51376) 2023-12-22T08:51:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff50ffff640 1 -- 172.21.15.38:0/1882729662 learned_addr learned my addr 172.21.15.38:0/1882729662 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff516ffd640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff504003ef0 0x7ff518141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff5177fe640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5180ae0e0 0x7ff51815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff50ffff640 1 -- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5180ae0e0 msgr2=0x7ff51815a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff50ffff640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5180ae0e0 0x7ff51815a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff50ffff640 1 -- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff504003ef0 msgr2=0x7ff518141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff50ffff640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff504003ef0 0x7ff518141700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.413+0000 7ff50ffff640 1 -- 172.21.15.38:0/1882729662 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5180a93d0 con 0x7ff5180adc60 2023-12-22T08:51:29.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.414+0000 7ff50ffff640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5180adc60 0x7ff51815a490 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c460 tx=0x7ff500001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:29.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.414+0000 7ff50f7fe640 1 -- 172.21.15.38:0/1882729662 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500000ed0 con 0x7ff5180adc60 2023-12-22T08:51:29.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.414+0000 7ff50f7fe640 1 -- 172.21.15.38:0/1882729662 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff500007070 con 0x7ff5180adc60 2023-12-22T08:51:29.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.414+0000 7ff50f7fe640 1 -- 172.21.15.38:0/1882729662 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000073e0 con 0x7ff5180adc60 2023-12-22T08:51:29.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.414+0000 7ff51d4b2640 1 -- 172.21.15.38:0/1882729662 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5180a96b0 con 0x7ff5180adc60 2023-12-22T08:51:29.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.414+0000 7ff51d4b2640 1 -- 172.21.15.38:0/1882729662 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5180a8690 con 0x7ff5180adc60 2023-12-22T08:51:29.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.415+0000 7ff51d4b2640 1 -- 172.21.15.38:0/1882729662 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5180ce890 con 0x7ff5180adc60 2023-12-22T08:51:29.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.416+0000 7ff50f7fe640 1 -- 172.21.15.38:0/1882729662 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff500032070 con 0x7ff5180adc60 2023-12-22T08:51:29.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.417+0000 7ff50f7fe640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff4f806a460 0x7ff4f806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.417+0000 7ff50f7fe640 1 -- 172.21.15.38:0/1882729662 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5000a98f0 con 0x7ff5180adc60 2023-12-22T08:51:29.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.418+0000 7ff516ffd640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff4f806a460 0x7ff4f806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.419+0000 7ff516ffd640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff4f806a460 0x7ff4f806c920 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff508009a10 tx=0x7ff508008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:29.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.422+0000 7ff50f7fe640 1 -- 172.21.15.38:0/1882729662 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff5180ce890 con 0x7ff5180adc60 2023-12-22T08:51:29.567 INFO:tasks.ceph.mds.a.smithi038.stderr:2023-12-22T08:51:29.566+0000 7f1a49abf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:51:29.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.616+0000 7ff51d4b2640 1 -- 172.21.15.38:0/1882729662 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5180ce890 con 0x7ff5180adc60 2023-12-22T08:51:29.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.619+0000 7ff50f7fe640 1 -- 172.21.15.38:0/1882729662 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16064 (secure 0 0 0) 0x7ff5180ce890 con 0x7ff5180adc60 2023-12-22T08:51:29.620 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:29.620 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":173,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:51:26.118593+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:51:22.983948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-22T08:51:24.133013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:51:29.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.622+0000 7ff51d4b2640 1 -- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff4f806a460 msgr2=0x7ff4f806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:29.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.622+0000 7ff51d4b2640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff4f806a460 0x7ff4f806c920 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff508009a10 tx=0x7ff508008040 comp rx=0 tx=0).stop 2023-12-22T08:51:29.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.622+0000 7ff51d4b2640 1 -- 172.21.15.38:0/1882729662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5180adc60 msgr2=0x7ff51815a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:29.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.622+0000 7ff51d4b2640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5180adc60 0x7ff51815a490 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c460 tx=0x7ff500001a00 comp rx=0 tx=0).stop 2023-12-22T08:51:29.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.622+0000 7ff51d4b2640 1 -- 172.21.15.38:0/1882729662 shutdown_connections 2023-12-22T08:51:29.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.622+0000 7ff51d4b2640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5180ae0e0 0x7ff51815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.622+0000 7ff51d4b2640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff4f806a460 0x7ff4f806c920 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.622+0000 7ff51d4b2640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff5180adc60 0x7ff51815a490 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.622+0000 7ff51d4b2640 1 --2- 172.21.15.38:0/1882729662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff504003ef0 0x7ff518141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.622+0000 7ff51d4b2640 1 -- 172.21.15.38:0/1882729662 >> 172.21.15.38:0/1882729662 conn(0x7ff5180cf070 msgr2=0x7ff518155900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:29.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.622+0000 7ff51d4b2640 1 -- 172.21.15.38:0/1882729662 shutdown_connections 2023-12-22T08:51:29.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.622+0000 7ff51d4b2640 1 -- 172.21.15.38:0/1882729662 wait complete. 2023-12-22T08:51:29.644 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T08:51:29.644 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:51:29.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.877+0000 7fb5f8a21640 1 Processor -- start 2023-12-22T08:51:29.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.877+0000 7fb5f8a21640 1 -- start start 2023-12-22T08:51:29.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.879+0000 7fb5f8a21640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb5f40b2050 0x7fb5f40b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.879+0000 7fb5f8a21640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5f4070800 0x7fb5f4070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.879+0000 7fb5f8a21640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f41450f0 con 0x7fb5f4144d10 2023-12-22T08:51:29.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.879+0000 7fb5f8a21640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f40cc840 con 0x7fb5f40b2050 2023-12-22T08:51:29.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.879+0000 7fb5f8a21640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f40ce010 con 0x7fb5f4070800 2023-12-22T08:51:29.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.880+0000 7fb5f259c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb5f4144d10 0x7fb5f40cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58336/0 (socket says 172.21.15.38:58336) 2023-12-22T08:51:29.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.880+0000 7fb5e9d9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb5f40b2050 0x7fb5f40b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.880+0000 7fb5f259c640 1 -- 172.21.15.38:0/154230497 learned_addr learned my addr 172.21.15.38:0/154230497 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:29.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.880+0000 7fb5f2d9d640 1 --2- 172.21.15.38:0/154230497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5f4070800 0x7fb5f4070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.880+0000 7fb5e9d9b640 1 -- 172.21.15.38:0/154230497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5f4070800 msgr2=0x7fb5f4070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:29.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.880+0000 7fb5e9d9b640 1 --2- 172.21.15.38:0/154230497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5f4070800 0x7fb5f4070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.880+0000 7fb5e9d9b640 1 -- 172.21.15.38:0/154230497 >> v1:172.21.15.38:6789/0 conn(0x7fb5f4144d10 legacy=0x7fb5f40cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:29.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.880+0000 7fb5f1d9b640 1 -- 172.21.15.38:0/154230497 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530120736 0 0) 0x7fb5f41450f0 con 0x7fb5f4144d10 2023-12-22T08:51:29.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.880+0000 7fb5e9d9b640 1 -- 172.21.15.38:0/154230497 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f40b29f0 con 0x7fb5f40b2050 2023-12-22T08:51:29.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.881+0000 7fb5e9d9b640 1 --2- 172.21.15.38:0/154230497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5f40b2050 0x7fb5f40b24b0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0097a0 tx=0x7fb5dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587000416082f8bf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:29.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.882+0000 7fb5f1d9b640 1 -- 172.21.15.38:0/154230497 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc031830 con 0x7fb5f40b2050 2023-12-22T08:51:29.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.882+0000 7fb5f1d9b640 1 -- 172.21.15.38:0/154230497 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc031990 con 0x7fb5f40b2050 2023-12-22T08:51:29.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.882+0000 7fb5f1d9b640 1 -- 172.21.15.38:0/154230497 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc031d20 con 0x7fb5f40b2050 2023-12-22T08:51:29.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.882+0000 7fb5f8a21640 1 -- 172.21.15.38:0/154230497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5f40b2050 msgr2=0x7fb5f40b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:29.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.882+0000 7fb5f8a21640 1 --2- 172.21.15.38:0/154230497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5f40b2050 0x7fb5f40b24b0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0097a0 tx=0x7fb5dc02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.883+0000 7fb5f8a21640 1 -- 172.21.15.38:0/154230497 shutdown_connections 2023-12-22T08:51:29.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.883+0000 7fb5f8a21640 1 --2- 172.21.15.38:0/154230497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5f4070800 0x7fb5f4070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.883+0000 7fb5f8a21640 1 --2- 172.21.15.38:0/154230497 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5f40b2050 0x7fb5f40b24b0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.883+0000 7fb5f8a21640 1 -- 172.21.15.38:0/154230497 >> 172.21.15.38:0/154230497 conn(0x7fb5f40cf070 msgr2=0x7fb5f40cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:29.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.883+0000 7fb5f8a21640 1 -- 172.21.15.38:0/154230497 shutdown_connections 2023-12-22T08:51:29.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.883+0000 7fb5f8a21640 1 -- 172.21.15.38:0/154230497 wait complete. 2023-12-22T08:51:29.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.884+0000 7fb5f8a21640 1 Processor -- start 2023-12-22T08:51:29.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.885+0000 7fb5f8a21640 1 -- start start 2023-12-22T08:51:29.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f8a21640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5f4070800 0x7fb5f406d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f8a21640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5f40b2050 0x7fb5f41412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f8a21640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5f4144d10 0x7fb5f4159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f8a21640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f406d080 con 0x7fb5f4144d10 2023-12-22T08:51:29.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f8a21640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f41417f0 con 0x7fb5f4070800 2023-12-22T08:51:29.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f8a21640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f406c190 con 0x7fb5f40b2050 2023-12-22T08:51:29.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5f4144d10 0x7fb5f4159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5f4144d10 0x7fb5f4159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51392/0 (socket says 172.21.15.38:51392) 2023-12-22T08:51:29.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f2d9d640 1 -- 172.21.15.38:0/1716935931 learned_addr learned my addr 172.21.15.38:0/1716935931 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:29.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5e9d9b640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5f40b2050 0x7fb5f41412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f259c640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5f4070800 0x7fb5f406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f2d9d640 1 -- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5f40b2050 msgr2=0x7fb5f41412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:29.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f2d9d640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5f40b2050 0x7fb5f41412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f2d9d640 1 -- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5f4070800 msgr2=0x7fb5f406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:29.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.886+0000 7fb5f2d9d640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5f4070800 0x7fb5f406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:29.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.887+0000 7fb5f2d9d640 1 -- 172.21.15.38:0/1716935931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc009400 con 0x7fb5f4144d10 2023-12-22T08:51:29.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.887+0000 7fb5f2d9d640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5f4144d10 0x7fb5f4159eb0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00d800 tx=0x7fb5ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:29.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.887+0000 7fb5eb7fe640 1 -- 172.21.15.38:0/1716935931 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec00b6c0 con 0x7fb5f4144d10 2023-12-22T08:51:29.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.887+0000 7fb5eb7fe640 1 -- 172.21.15.38:0/1716935931 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec00b840 con 0x7fb5f4144d10 2023-12-22T08:51:29.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.887+0000 7fb5eb7fe640 1 -- 172.21.15.38:0/1716935931 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec00bbf0 con 0x7fb5f4144d10 2023-12-22T08:51:29.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.887+0000 7fb5f8a21640 1 -- 172.21.15.38:0/1716935931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f406c470 con 0x7fb5f4144d10 2023-12-22T08:51:29.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.887+0000 7fb5f8a21640 1 -- 172.21.15.38:0/1716935931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f406ca30 con 0x7fb5f4144d10 2023-12-22T08:51:29.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.888+0000 7fb5f8a21640 1 -- 172.21.15.38:0/1716935931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f406d1f0 con 0x7fb5f4144d10 2023-12-22T08:51:29.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.890+0000 7fb5eb7fe640 1 -- 172.21.15.38:0/1716935931 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb5ec00bd50 con 0x7fb5f4144d10 2023-12-22T08:51:29.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.890+0000 7fb5eb7fe640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5d406a460 0x7fb5d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:29.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.891+0000 7fb5eb7fe640 1 -- 172.21.15.38:0/1716935931 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5ec088ea0 con 0x7fb5f4144d10 2023-12-22T08:51:29.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.891+0000 7fb5f259c640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5d406a460 0x7fb5d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:29.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.892+0000 7fb5f259c640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5d406a460 0x7fb5d406c920 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40012e0 tx=0x7fb5e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:29.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:29.897+0000 7fb5eb7fe640 1 -- 172.21.15.38:0/1716935931 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb5ec0543f0 con 0x7fb5f4144d10 2023-12-22T08:51:30.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.088+0000 7fb5f8a21640 1 -- 172.21.15.38:0/1716935931 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5f40ce5d0 con 0x7fb5d406a460 2023-12-22T08:51:30.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.112+0000 7fb5eb7fe640 1 -- 172.21.15.38:0/1716935931 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282986 (secure 0 0 0) 0x7fb5e400ec40 con 0x7fb5d406a460 2023-12-22T08:51:30.115 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:30.120 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:51:30.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.120+0000 7fb5f8a21640 1 -- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5d406a460 msgr2=0x7fb5d406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:30.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.120+0000 7fb5f8a21640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5d406a460 0x7fb5d406c920 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40012e0 tx=0x7fb5e4009040 comp rx=0 tx=0).stop 2023-12-22T08:51:30.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.120+0000 7fb5f8a21640 1 -- 172.21.15.38:0/1716935931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5f4144d10 msgr2=0x7fb5f4159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:30.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.120+0000 7fb5f8a21640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5f4144d10 0x7fb5f4159eb0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00d800 tx=0x7fb5ec00dcc0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.120+0000 7fb5f8a21640 1 -- 172.21.15.38:0/1716935931 shutdown_connections 2023-12-22T08:51:30.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.120+0000 7fb5f8a21640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5d406a460 0x7fb5d406c920 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.120+0000 7fb5f8a21640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5f4144d10 0x7fb5f4159eb0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.120+0000 7fb5f8a21640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5f40b2050 0x7fb5f41412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.120+0000 7fb5f8a21640 1 --2- 172.21.15.38:0/1716935931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5f4070800 0x7fb5f406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.120+0000 7fb5f8a21640 1 -- 172.21.15.38:0/1716935931 >> 172.21.15.38:0/1716935931 conn(0x7fb5f40cf070 msgr2=0x7fb5f40b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:30.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.121+0000 7fb5f8a21640 1 -- 172.21.15.38:0/1716935931 shutdown_connections 2023-12-22T08:51:30.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.121+0000 7fb5f8a21640 1 -- 172.21.15.38:0/1716935931 wait complete. 2023-12-22T08:51:30.144 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":515,"stamp":"2023-12-22T08:51:28.610644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8724,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553775,"statfs":{"total":1600000000,"available":1591065663,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.012690"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.261524+0000","last_change":"2023-12-22T08:51:25.151363+0000","last_active":"2023-12-22T08:51:27.261524+0000","last_peered":"2023-12-22T08:51:27.261524+0000","last_clean":"2023-12-22T08:51:27.261524+0000","last_became_active":"2023-12-22T08:51:25.148596+0000","last_became_peered":"2023-12-22T08:51:25.148596+0000","last_unstale":"2023-12-22T08:51:27.261524+0000","last_undegraded":"2023-12-22T08:51:27.261524+0000","last_fullsized":"2023-12-22T08:51:27.261524+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:13:30.131595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257937+0000","last_change":"2023-12-22T08:51:25.156697+0000","last_active":"2023-12-22T08:51:27.257937+0000","last_peered":"2023-12-22T08:51:27.257937+0000","last_clean":"2023-12-22T08:51:27.257937+0000","last_became_active":"2023-12-22T08:51:25.154323+0000","last_became_peered":"2023-12-22T08:51:25.154323+0000","last_unstale":"2023-12-22T08:51:27.257937+0000","last_undegraded":"2023-12-22T08:51:27.257937+0000","last_fullsized":"2023-12-22T08:51:27.257937+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:05:06.736300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.135787+0000","last_change":"2023-12-22T08:51:25.131748+0000","last_active":"2023-12-22T08:51:26.135787+0000","last_peered":"2023-12-22T08:51:26.135787+0000","last_clean":"2023-12-22T08:51:26.135787+0000","last_became_active":"2023-12-22T08:51:25.131520+0000","last_became_peered":"2023-12-22T08:51:25.131520+0000","last_unstale":"2023-12-22T08:51:26.135787+0000","last_undegraded":"2023-12-22T08:51:26.135787+0000","last_fullsized":"2023-12-22T08:51:26.135787+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:36:11.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133617+0000","last_change":"2023-12-22T08:51:25.143521+0000","last_active":"2023-12-22T08:51:26.133617+0000","last_peered":"2023-12-22T08:51:26.133617+0000","last_clean":"2023-12-22T08:51:26.133617+0000","last_became_active":"2023-12-22T08:51:25.143218+0000","last_became_peered":"2023-12-22T08:51:25.143218+0000","last_unstale":"2023-12-22T08:51:26.133617+0000","last_undegraded":"2023-12-22T08:51:26.133617+0000","last_fullsized":"2023-12-22T08:51:26.133617+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:23:47.489292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.132878+0000","last_change":"2023-12-22T08:51:25.153334+0000","last_active":"2023-12-22T08:51:26.132878+0000","last_peered":"2023-12-22T08:51:26.132878+0000","last_clean":"2023-12-22T08:51:26.132878+0000","last_became_active":"2023-12-22T08:51:25.153001+0000","last_became_peered":"2023-12-22T08:51:25.153001+0000","last_unstale":"2023-12-22T08:51:26.132878+0000","last_undegraded":"2023-12-22T08:51:26.132878+0000","last_fullsized":"2023-12-22T08:51:26.132878+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:17:05.789079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259643+0000","last_change":"2023-12-22T08:51:25.136705+0000","last_active":"2023-12-22T08:51:27.259643+0000","last_peered":"2023-12-22T08:51:27.259643+0000","last_clean":"2023-12-22T08:51:27.259643+0000","last_became_active":"2023-12-22T08:51:25.135576+0000","last_became_peered":"2023-12-22T08:51:25.135576+0000","last_unstale":"2023-12-22T08:51:27.259643+0000","last_undegraded":"2023-12-22T08:51:27.259643+0000","last_fullsized":"2023-12-22T08:51:27.259643+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:52:14.407348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259894+0000","last_change":"2023-12-22T08:51:25.143375+0000","last_active":"2023-12-22T08:51:27.259894+0000","last_peered":"2023-12-22T08:51:27.259894+0000","last_clean":"2023-12-22T08:51:27.259894+0000","last_became_active":"2023-12-22T08:51:25.143009+0000","last_became_peered":"2023-12-22T08:51:25.143009+0000","last_unstale":"2023-12-22T08:51:27.259894+0000","last_undegraded":"2023-12-22T08:51:27.259894+0000","last_fullsized":"2023-12-22T08:51:27.259894+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:36:05.621843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258122+0000","last_change":"2023-12-22T08:51:25.145085+0000","last_active":"2023-12-22T08:51:27.258122+0000","last_peered":"2023-12-22T08:51:27.258122+0000","last_clean":"2023-12-22T08:51:27.258122+0000","last_became_active":"2023-12-22T08:51:25.144580+0000","last_became_peered":"2023-12-22T08:51:25.144580+0000","last_unstale":"2023-12-22T08:51:27.258122+0000","last_undegraded":"2023-12-22T08:51:27.258122+0000","last_fullsized":"2023-12-22T08:51:27.258122+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:18:41.238462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258745+0000","last_change":"2023-12-22T08:51:25.153510+0000","last_active":"2023-12-22T08:51:27.258745+0000","last_peered":"2023-12-22T08:51:27.258745+0000","last_clean":"2023-12-22T08:51:27.258745+0000","last_became_active":"2023-12-22T08:51:25.153258+0000","last_became_peered":"2023-12-22T08:51:25.153258+0000","last_unstale":"2023-12-22T08:51:27.258745+0000","last_undegraded":"2023-12-22T08:51:27.258745+0000","last_fullsized":"2023-12-22T08:51:27.258745+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:59.244745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136374+0000","last_change":"2023-12-22T08:51:25.133573+0000","last_active":"2023-12-22T08:51:26.136374+0000","last_peered":"2023-12-22T08:51:26.136374+0000","last_clean":"2023-12-22T08:51:26.136374+0000","last_became_active":"2023-12-22T08:51:25.133319+0000","last_became_peered":"2023-12-22T08:51:25.133319+0000","last_unstale":"2023-12-22T08:51:26.136374+0000","last_undegraded":"2023-12-22T08:51:26.136374+0000","last_fullsized":"2023-12-22T08:51:26.136374+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:21.785565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258849+0000","last_change":"2023-12-22T08:51:25.136212+0000","last_active":"2023-12-22T08:51:27.258849+0000","last_peered":"2023-12-22T08:51:27.258849+0000","last_clean":"2023-12-22T08:51:27.258849+0000","last_became_active":"2023-12-22T08:51:25.134748+0000","last_became_peered":"2023-12-22T08:51:25.134748+0000","last_unstale":"2023-12-22T08:51:27.258849+0000","last_undegraded":"2023-12-22T08:51:27.258849+0000","last_fullsized":"2023-12-22T08:51:27.258849+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:26:23.903003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257088+0000","last_change":"2023-12-22T08:51:25.145340+0000","last_active":"2023-12-22T08:51:27.257088+0000","last_peered":"2023-12-22T08:51:27.257088+0000","last_clean":"2023-12-22T08:51:27.257088+0000","last_became_active":"2023-12-22T08:51:25.145001+0000","last_became_peered":"2023-12-22T08:51:25.145001+0000","last_unstale":"2023-12-22T08:51:27.257088+0000","last_undegraded":"2023-12-22T08:51:27.257088+0000","last_fullsized":"2023-12-22T08:51:27.257088+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:59.244745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.132946+0000","last_change":"2023-12-22T08:51:25.149310+0000","last_active":"2023-12-22T08:51:26.132946+0000","last_peered":"2023-12-22T08:51:26.132946+0000","last_clean":"2023-12-22T08:51:26.132946+0000","last_became_active":"2023-12-22T08:51:25.149084+0000","last_became_peered":"2023-12-22T08:51:25.149084+0000","last_unstale":"2023-12-22T08:51:26.132946+0000","last_undegraded":"2023-12-22T08:51:26.132946+0000","last_fullsized":"2023-12-22T08:51:26.132946+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:18:41.523806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257333+0000","last_change":"2023-12-22T08:51:25.141215+0000","last_active":"2023-12-22T08:51:27.257333+0000","last_peered":"2023-12-22T08:51:27.257333+0000","last_clean":"2023-12-22T08:51:27.257333+0000","last_became_active":"2023-12-22T08:51:25.139746+0000","last_became_peered":"2023-12-22T08:51:25.139746+0000","last_unstale":"2023-12-22T08:51:27.257333+0000","last_undegraded":"2023-12-22T08:51:27.257333+0000","last_fullsized":"2023-12-22T08:51:27.257333+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:31.505338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133000+0000","last_change":"2023-12-22T08:51:25.138613+0000","last_active":"2023-12-22T08:51:26.133000+0000","last_peered":"2023-12-22T08:51:26.133000+0000","last_clean":"2023-12-22T08:51:26.133000+0000","last_became_active":"2023-12-22T08:51:25.138396+0000","last_became_peered":"2023-12-22T08:51:25.138396+0000","last_unstale":"2023-12-22T08:51:26.133000+0000","last_undegraded":"2023-12-22T08:51:26.133000+0000","last_fullsized":"2023-12-22T08:51:26.133000+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:05.116308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260386+0000","last_change":"2023-12-22T08:51:25.154527+0000","last_active":"2023-12-22T08:51:27.260386+0000","last_peered":"2023-12-22T08:51:27.260386+0000","last_clean":"2023-12-22T08:51:27.260386+0000","last_became_active":"2023-12-22T08:51:25.154207+0000","last_became_peered":"2023-12-22T08:51:25.154207+0000","last_unstale":"2023-12-22T08:51:27.260386+0000","last_undegraded":"2023-12-22T08:51:27.260386+0000","last_fullsized":"2023-12-22T08:51:27.260386+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:46.814446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.135861+0000","last_change":"2023-12-22T08:51:25.141509+0000","last_active":"2023-12-22T08:51:26.135861+0000","last_peered":"2023-12-22T08:51:26.135861+0000","last_clean":"2023-12-22T08:51:26.135861+0000","last_became_active":"2023-12-22T08:51:25.141208+0000","last_became_peered":"2023-12-22T08:51:25.141208+0000","last_unstale":"2023-12-22T08:51:26.135861+0000","last_undegraded":"2023-12-22T08:51:26.135861+0000","last_fullsized":"2023-12-22T08:51:26.135861+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:21:06.829510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133228+0000","last_change":"2023-12-22T08:51:25.138109+0000","last_active":"2023-12-22T08:51:26.133228+0000","last_peered":"2023-12-22T08:51:26.133228+0000","last_clean":"2023-12-22T08:51:26.133228+0000","last_became_active":"2023-12-22T08:51:25.137843+0000","last_became_peered":"2023-12-22T08:51:25.137843+0000","last_unstale":"2023-12-22T08:51:26.133228+0000","last_undegraded":"2023-12-22T08:51:26.133228+0000","last_fullsized":"2023-12-22T08:51:26.133228+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:57:45.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.261543+0000","last_change":"2023-12-22T08:51:25.132936+0000","last_active":"2023-12-22T08:51:27.261543+0000","last_peered":"2023-12-22T08:51:27.261543+0000","last_clean":"2023-12-22T08:51:27.261543+0000","last_became_active":"2023-12-22T08:51:25.132004+0000","last_became_peered":"2023-12-22T08:51:25.132004+0000","last_unstale":"2023-12-22T08:51:27.261543+0000","last_undegraded":"2023-12-22T08:51:27.261543+0000","last_fullsized":"2023-12-22T08:51:27.261543+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:33.240418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258224+0000","last_change":"2023-12-22T08:51:25.158489+0000","last_active":"2023-12-22T08:51:27.258224+0000","last_peered":"2023-12-22T08:51:27.258224+0000","last_clean":"2023-12-22T08:51:27.258224+0000","last_became_active":"2023-12-22T08:51:25.158001+0000","last_became_peered":"2023-12-22T08:51:25.158001+0000","last_unstale":"2023-12-22T08:51:27.258224+0000","last_undegraded":"2023-12-22T08:51:27.258224+0000","last_fullsized":"2023-12-22T08:51:27.258224+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:25.266312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136186+0000","last_change":"2023-12-22T08:51:25.147893+0000","last_active":"2023-12-22T08:51:26.136186+0000","last_peered":"2023-12-22T08:51:26.136186+0000","last_clean":"2023-12-22T08:51:26.136186+0000","last_became_active":"2023-12-22T08:51:25.147671+0000","last_became_peered":"2023-12-22T08:51:25.147671+0000","last_unstale":"2023-12-22T08:51:26.136186+0000","last_undegraded":"2023-12-22T08:51:26.136186+0000","last_fullsized":"2023-12-22T08:51:26.136186+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:03:48.535916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257233+0000","last_change":"2023-12-22T08:51:25.152823+0000","last_active":"2023-12-22T08:51:27.257233+0000","last_peered":"2023-12-22T08:51:27.257233+0000","last_clean":"2023-12-22T08:51:27.257233+0000","last_became_active":"2023-12-22T08:51:25.152528+0000","last_became_peered":"2023-12-22T08:51:25.152528+0000","last_unstale":"2023-12-22T08:51:27.257233+0000","last_undegraded":"2023-12-22T08:51:27.257233+0000","last_fullsized":"2023-12-22T08:51:27.257233+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:11.212100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133789+0000","last_change":"2023-12-22T08:51:25.149794+0000","last_active":"2023-12-22T08:51:26.133789+0000","last_peered":"2023-12-22T08:51:26.133789+0000","last_clean":"2023-12-22T08:51:26.133789+0000","last_became_active":"2023-12-22T08:51:25.149156+0000","last_became_peered":"2023-12-22T08:51:25.149156+0000","last_unstale":"2023-12-22T08:51:26.133789+0000","last_undegraded":"2023-12-22T08:51:26.133789+0000","last_fullsized":"2023-12-22T08:51:26.133789+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:25:53.865883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.132665+0000","last_change":"2023-12-22T08:51:25.141816+0000","last_active":"2023-12-22T08:51:26.132665+0000","last_peered":"2023-12-22T08:51:26.132665+0000","last_clean":"2023-12-22T08:51:26.132665+0000","last_became_active":"2023-12-22T08:51:25.141560+0000","last_became_peered":"2023-12-22T08:51:25.141560+0000","last_unstale":"2023-12-22T08:51:26.132665+0000","last_undegraded":"2023-12-22T08:51:26.132665+0000","last_fullsized":"2023-12-22T08:51:26.132665+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:05:22.379726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.261425+0000","last_change":"2023-12-22T08:51:25.157468+0000","last_active":"2023-12-22T08:51:27.261425+0000","last_peered":"2023-12-22T08:51:27.261425+0000","last_clean":"2023-12-22T08:51:27.261425+0000","last_became_active":"2023-12-22T08:51:25.156920+0000","last_became_peered":"2023-12-22T08:51:25.156920+0000","last_unstale":"2023-12-22T08:51:27.261425+0000","last_undegraded":"2023-12-22T08:51:27.261425+0000","last_fullsized":"2023-12-22T08:51:27.261425+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:31.505338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.261295+0000","last_change":"2023-12-22T08:51:25.152406+0000","last_active":"2023-12-22T08:51:27.261295+0000","last_peered":"2023-12-22T08:51:27.261295+0000","last_clean":"2023-12-22T08:51:27.261295+0000","last_became_active":"2023-12-22T08:51:25.152146+0000","last_became_peered":"2023-12-22T08:51:25.152146+0000","last_unstale":"2023-12-22T08:51:27.261295+0000","last_undegraded":"2023-12-22T08:51:27.261295+0000","last_fullsized":"2023-12-22T08:51:27.261295+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:49:20.887153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258215+0000","last_change":"2023-12-22T08:51:25.154524+0000","last_active":"2023-12-22T08:51:27.258215+0000","last_peered":"2023-12-22T08:51:27.258215+0000","last_clean":"2023-12-22T08:51:27.258215+0000","last_became_active":"2023-12-22T08:51:25.154006+0000","last_became_peered":"2023-12-22T08:51:25.154006+0000","last_unstale":"2023-12-22T08:51:27.258215+0000","last_undegraded":"2023-12-22T08:51:27.258215+0000","last_fullsized":"2023-12-22T08:51:27.258215+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:11.212100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258714+0000","last_change":"2023-12-22T08:51:25.154447+0000","last_active":"2023-12-22T08:51:27.258714+0000","last_peered":"2023-12-22T08:51:27.258714+0000","last_clean":"2023-12-22T08:51:27.258714+0000","last_became_active":"2023-12-22T08:51:25.154181+0000","last_became_peered":"2023-12-22T08:51:25.154181+0000","last_unstale":"2023-12-22T08:51:27.258714+0000","last_undegraded":"2023-12-22T08:51:27.258714+0000","last_fullsized":"2023-12-22T08:51:27.258714+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:50.293804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260733+0000","last_change":"2023-12-22T08:51:25.147668+0000","last_active":"2023-12-22T08:51:27.260733+0000","last_peered":"2023-12-22T08:51:27.260733+0000","last_clean":"2023-12-22T08:51:27.260733+0000","last_became_active":"2023-12-22T08:51:25.145464+0000","last_became_peered":"2023-12-22T08:51:25.145464+0000","last_unstale":"2023-12-22T08:51:27.260733+0000","last_undegraded":"2023-12-22T08:51:27.260733+0000","last_fullsized":"2023-12-22T08:51:27.260733+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:44:24.130512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257715+0000","last_change":"2023-12-22T08:51:25.153718+0000","last_active":"2023-12-22T08:51:27.257715+0000","last_peered":"2023-12-22T08:51:27.257715+0000","last_clean":"2023-12-22T08:51:27.257715+0000","last_became_active":"2023-12-22T08:51:25.153443+0000","last_became_peered":"2023-12-22T08:51:25.153443+0000","last_unstale":"2023-12-22T08:51:27.257715+0000","last_undegraded":"2023-12-22T08:51:27.257715+0000","last_fullsized":"2023-12-22T08:51:27.257715+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:05.039852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257978+0000","last_change":"2023-12-22T08:51:25.155270+0000","last_active":"2023-12-22T08:51:27.257978+0000","last_peered":"2023-12-22T08:51:27.257978+0000","last_clean":"2023-12-22T08:51:27.257978+0000","last_became_active":"2023-12-22T08:51:25.154997+0000","last_became_peered":"2023-12-22T08:51:25.154997+0000","last_unstale":"2023-12-22T08:51:27.257978+0000","last_undegraded":"2023-12-22T08:51:27.257978+0000","last_fullsized":"2023-12-22T08:51:27.257978+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:03:57.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258473+0000","last_change":"2023-12-22T08:51:25.150973+0000","last_active":"2023-12-22T08:51:27.258473+0000","last_peered":"2023-12-22T08:51:27.258473+0000","last_clean":"2023-12-22T08:51:27.258473+0000","last_became_active":"2023-12-22T08:51:25.150721+0000","last_became_peered":"2023-12-22T08:51:25.150721+0000","last_unstale":"2023-12-22T08:51:27.258473+0000","last_undegraded":"2023-12-22T08:51:27.258473+0000","last_fullsized":"2023-12-22T08:51:27.258473+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:08:00.991901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.132802+0000","last_change":"2023-12-22T08:51:25.144198+0000","last_active":"2023-12-22T08:51:26.132802+0000","last_peered":"2023-12-22T08:51:26.132802+0000","last_clean":"2023-12-22T08:51:26.132802+0000","last_became_active":"2023-12-22T08:51:25.143966+0000","last_became_peered":"2023-12-22T08:51:25.143966+0000","last_unstale":"2023-12-22T08:51:26.132802+0000","last_undegraded":"2023-12-22T08:51:26.132802+0000","last_fullsized":"2023-12-22T08:51:26.132802+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:34:49.597153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"172'4","reported_seq":15,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136162+0000","last_change":"2023-12-22T08:51:24.628381+0000","last_active":"2023-12-22T08:51:26.136162+0000","last_peered":"2023-12-22T08:51:26.136162+0000","last_clean":"2023-12-22T08:51:26.136162+0000","last_became_active":"2023-12-22T08:51:24.628019+0000","last_became_peered":"2023-12-22T08:51:24.628019+0000","last_unstale":"2023-12-22T08:51:26.136162+0000","last_undegraded":"2023-12-22T08:51:26.136162+0000","last_fullsized":"2023-12-22T08:51:26.136162+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:44:23.116657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258511+0000","last_change":"2023-12-22T08:51:25.135959+0000","last_active":"2023-12-22T08:51:27.258511+0000","last_peered":"2023-12-22T08:51:27.258511+0000","last_clean":"2023-12-22T08:51:27.258511+0000","last_became_active":"2023-12-22T08:51:25.135441+0000","last_became_peered":"2023-12-22T08:51:25.135441+0000","last_unstale":"2023-12-22T08:51:27.258511+0000","last_undegraded":"2023-12-22T08:51:27.258511+0000","last_fullsized":"2023-12-22T08:51:27.258511+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:21.686274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"172'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258986+0000","last_change":"2023-12-22T08:51:24.629870+0000","last_active":"2023-12-22T08:51:27.258986+0000","last_peered":"2023-12-22T08:51:27.258986+0000","last_clean":"2023-12-22T08:51:27.258986+0000","last_became_active":"2023-12-22T08:51:24.626672+0000","last_became_peered":"2023-12-22T08:51:24.626672+0000","last_unstale":"2023-12-22T08:51:27.258986+0000","last_undegraded":"2023-12-22T08:51:27.258986+0000","last_fullsized":"2023-12-22T08:51:27.258986+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:30.491483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259145+0000","last_change":"2023-12-22T08:51:25.151547+0000","last_active":"2023-12-22T08:51:27.259145+0000","last_peered":"2023-12-22T08:51:27.259145+0000","last_clean":"2023-12-22T08:51:27.259145+0000","last_became_active":"2023-12-22T08:51:25.148655+0000","last_became_peered":"2023-12-22T08:51:25.148655+0000","last_unstale":"2023-12-22T08:51:27.259145+0000","last_undegraded":"2023-12-22T08:51:27.259145+0000","last_fullsized":"2023-12-22T08:51:27.259145+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:11:49.130381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"172'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136475+0000","last_change":"2023-12-22T08:51:24.626910+0000","last_active":"2023-12-22T08:51:26.136475+0000","last_peered":"2023-12-22T08:51:26.136475+0000","last_clean":"2023-12-22T08:51:26.136475+0000","last_became_active":"2023-12-22T08:51:24.623830+0000","last_became_peered":"2023-12-22T08:51:24.623830+0000","last_unstale":"2023-12-22T08:51:26.136475+0000","last_undegraded":"2023-12-22T08:51:26.136475+0000","last_fullsized":"2023-12-22T08:51:26.136475+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:18:40.224607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134468+0000","last_change":"2023-12-22T08:51:25.154616+0000","last_active":"2023-12-22T08:51:26.134468+0000","last_peered":"2023-12-22T08:51:26.134468+0000","last_clean":"2023-12-22T08:51:26.134468+0000","last_became_active":"2023-12-22T08:51:25.154066+0000","last_became_peered":"2023-12-22T08:51:25.154066+0000","last_unstale":"2023-12-22T08:51:26.134468+0000","last_undegraded":"2023-12-22T08:51:26.134468+0000","last_fullsized":"2023-12-22T08:51:26.134468+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:40.481488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"172'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136369+0000","last_change":"2023-12-22T08:51:24.626306+0000","last_active":"2023-12-22T08:51:26.136369+0000","last_peered":"2023-12-22T08:51:26.136369+0000","last_clean":"2023-12-22T08:51:26.136369+0000","last_became_active":"2023-12-22T08:51:24.625997+0000","last_became_peered":"2023-12-22T08:51:24.625997+0000","last_unstale":"2023-12-22T08:51:26.136369+0000","last_undegraded":"2023-12-22T08:51:26.136369+0000","last_fullsized":"2023-12-22T08:51:26.136369+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:34:00.898666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258957+0000","last_change":"2023-12-22T08:51:25.153240+0000","last_active":"2023-12-22T08:51:27.258957+0000","last_peered":"2023-12-22T08:51:27.258957+0000","last_clean":"2023-12-22T08:51:27.258957+0000","last_became_active":"2023-12-22T08:51:25.152989+0000","last_became_peered":"2023-12-22T08:51:25.152989+0000","last_unstale":"2023-12-22T08:51:27.258957+0000","last_undegraded":"2023-12-22T08:51:27.258957+0000","last_fullsized":"2023-12-22T08:51:27.258957+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:05.116308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"172'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260985+0000","last_change":"2023-12-22T08:51:24.631730+0000","last_active":"2023-12-22T08:51:27.260985+0000","last_peered":"2023-12-22T08:51:27.260985+0000","last_clean":"2023-12-22T08:51:27.260985+0000","last_became_active":"2023-12-22T08:51:24.631456+0000","last_became_peered":"2023-12-22T08:51:24.631456+0000","last_unstale":"2023-12-22T08:51:27.260985+0000","last_undegraded":"2023-12-22T08:51:27.260985+0000","last_fullsized":"2023-12-22T08:51:27.260985+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:39.467633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133724+0000","last_change":"2023-12-22T08:51:25.144313+0000","last_active":"2023-12-22T08:51:26.133724+0000","last_peered":"2023-12-22T08:51:26.133724+0000","last_clean":"2023-12-22T08:51:26.133724+0000","last_became_active":"2023-12-22T08:51:25.143916+0000","last_became_peered":"2023-12-22T08:51:25.143916+0000","last_unstale":"2023-12-22T08:51:26.133724+0000","last_undegraded":"2023-12-22T08:51:26.133724+0000","last_fullsized":"2023-12-22T08:51:26.133724+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:54.987846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"172'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133461+0000","last_change":"2023-12-22T08:51:24.634766+0000","last_active":"2023-12-22T08:51:26.133461+0000","last_peered":"2023-12-22T08:51:26.133461+0000","last_clean":"2023-12-22T08:51:26.133461+0000","last_became_active":"2023-12-22T08:51:24.634528+0000","last_became_peered":"2023-12-22T08:51:24.634528+0000","last_unstale":"2023-12-22T08:51:26.133461+0000","last_undegraded":"2023-12-22T08:51:26.133461+0000","last_fullsized":"2023-12-22T08:51:26.133461+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:10:29.876673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.262027+0000","last_change":"2023-12-22T08:51:25.157142+0000","last_active":"2023-12-22T08:51:27.262027+0000","last_peered":"2023-12-22T08:51:27.262027+0000","last_clean":"2023-12-22T08:51:27.262027+0000","last_became_active":"2023-12-22T08:51:25.156278+0000","last_became_peered":"2023-12-22T08:51:25.156278+0000","last_unstale":"2023-12-22T08:51:27.262027+0000","last_undegraded":"2023-12-22T08:51:27.262027+0000","last_fullsized":"2023-12-22T08:51:27.262027+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:36:15.071191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259232+0000","last_change":"2023-12-22T08:51:24.630127+0000","last_active":"2023-12-22T08:51:27.259232+0000","last_peered":"2023-12-22T08:51:27.259232+0000","last_clean":"2023-12-22T08:51:27.259232+0000","last_became_active":"2023-12-22T08:51:24.629439+0000","last_became_peered":"2023-12-22T08:51:24.629439+0000","last_unstale":"2023-12-22T08:51:27.259232+0000","last_undegraded":"2023-12-22T08:51:27.259232+0000","last_fullsized":"2023-12-22T08:51:27.259232+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:10.198245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133726+0000","last_change":"2023-12-22T08:51:25.149426+0000","last_active":"2023-12-22T08:51:26.133726+0000","last_peered":"2023-12-22T08:51:26.133726+0000","last_clean":"2023-12-22T08:51:26.133726+0000","last_became_active":"2023-12-22T08:51:25.148986+0000","last_became_peered":"2023-12-22T08:51:25.148986+0000","last_unstale":"2023-12-22T08:51:26.133726+0000","last_undegraded":"2023-12-22T08:51:26.133726+0000","last_fullsized":"2023-12-22T08:51:26.133726+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:05.939199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136561+0000","last_change":"2023-12-22T08:51:24.632943+0000","last_active":"2023-12-22T08:51:26.136561+0000","last_peered":"2023-12-22T08:51:26.136561+0000","last_clean":"2023-12-22T08:51:26.136561+0000","last_became_active":"2023-12-22T08:51:24.632171+0000","last_became_peered":"2023-12-22T08:51:24.632171+0000","last_unstale":"2023-12-22T08:51:26.136561+0000","last_undegraded":"2023-12-22T08:51:26.136561+0000","last_fullsized":"2023-12-22T08:51:26.136561+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:37:36.947764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133847+0000","last_change":"2023-12-22T08:51:25.148919+0000","last_active":"2023-12-22T08:51:26.133847+0000","last_peered":"2023-12-22T08:51:26.133847+0000","last_clean":"2023-12-22T08:51:26.133847+0000","last_became_active":"2023-12-22T08:51:25.146478+0000","last_became_peered":"2023-12-22T08:51:25.146478+0000","last_unstale":"2023-12-22T08:51:26.133847+0000","last_undegraded":"2023-12-22T08:51:26.133847+0000","last_fullsized":"2023-12-22T08:51:26.133847+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:07:11.093866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260202+0000","last_change":"2023-12-22T08:51:24.629889+0000","last_active":"2023-12-22T08:51:27.260202+0000","last_peered":"2023-12-22T08:51:27.260202+0000","last_clean":"2023-12-22T08:51:27.260202+0000","last_became_active":"2023-12-22T08:51:24.627608+0000","last_became_peered":"2023-12-22T08:51:24.627608+0000","last_unstale":"2023-12-22T08:51:27.260202+0000","last_undegraded":"2023-12-22T08:51:27.260202+0000","last_fullsized":"2023-12-22T08:51:27.260202+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:03:56.090601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257684+0000","last_change":"2023-12-22T08:51:25.148806+0000","last_active":"2023-12-22T08:51:27.257684+0000","last_peered":"2023-12-22T08:51:27.257684+0000","last_clean":"2023-12-22T08:51:27.257684+0000","last_became_active":"2023-12-22T08:51:25.148576+0000","last_became_peered":"2023-12-22T08:51:25.148576+0000","last_unstale":"2023-12-22T08:51:27.257684+0000","last_undegraded":"2023-12-22T08:51:27.257684+0000","last_fullsized":"2023-12-22T08:51:27.257684+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:03:57.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.132991+0000","last_change":"2023-12-22T08:51:24.630692+0000","last_active":"2023-12-22T08:51:26.132991+0000","last_peered":"2023-12-22T08:51:26.132991+0000","last_clean":"2023-12-22T08:51:26.132991+0000","last_became_active":"2023-12-22T08:51:24.630314+0000","last_became_peered":"2023-12-22T08:51:24.630314+0000","last_unstale":"2023-12-22T08:51:26.132991+0000","last_undegraded":"2023-12-22T08:51:26.132991+0000","last_fullsized":"2023-12-22T08:51:26.132991+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:28:00.357146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258742+0000","last_change":"2023-12-22T08:51:25.154627+0000","last_active":"2023-12-22T08:51:27.258742+0000","last_peered":"2023-12-22T08:51:27.258742+0000","last_clean":"2023-12-22T08:51:27.258742+0000","last_became_active":"2023-12-22T08:51:25.153724+0000","last_became_peered":"2023-12-22T08:51:25.153724+0000","last_unstale":"2023-12-22T08:51:27.258742+0000","last_undegraded":"2023-12-22T08:51:27.258742+0000","last_fullsized":"2023-12-22T08:51:27.258742+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:16.622370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"172'6","reported_seq":17,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259209+0000","last_change":"2023-12-22T08:51:24.626031+0000","last_active":"2023-12-22T08:51:27.259209+0000","last_peered":"2023-12-22T08:51:27.259209+0000","last_clean":"2023-12-22T08:51:27.259209+0000","last_became_active":"2023-12-22T08:51:24.625288+0000","last_became_peered":"2023-12-22T08:51:24.625288+0000","last_unstale":"2023-12-22T08:51:27.259209+0000","last_undegraded":"2023-12-22T08:51:27.259209+0000","last_fullsized":"2023-12-22T08:51:27.259209+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:16.492318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134685+0000","last_change":"2023-12-22T08:51:25.148021+0000","last_active":"2023-12-22T08:51:26.134685+0000","last_peered":"2023-12-22T08:51:26.134685+0000","last_clean":"2023-12-22T08:51:26.134685+0000","last_became_active":"2023-12-22T08:51:25.147706+0000","last_became_peered":"2023-12-22T08:51:25.147706+0000","last_unstale":"2023-12-22T08:51:26.134685+0000","last_undegraded":"2023-12-22T08:51:26.134685+0000","last_fullsized":"2023-12-22T08:51:26.134685+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:15.464504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"172'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136651+0000","last_change":"2023-12-22T08:51:24.631821+0000","last_active":"2023-12-22T08:51:26.136651+0000","last_peered":"2023-12-22T08:51:26.136651+0000","last_clean":"2023-12-22T08:51:26.136651+0000","last_became_active":"2023-12-22T08:51:24.626626+0000","last_became_peered":"2023-12-22T08:51:24.626626+0000","last_unstale":"2023-12-22T08:51:26.136651+0000","last_undegraded":"2023-12-22T08:51:26.136651+0000","last_fullsized":"2023-12-22T08:51:26.136651+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:24.252458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259859+0000","last_change":"2023-12-22T08:51:25.149955+0000","last_active":"2023-12-22T08:51:27.259859+0000","last_peered":"2023-12-22T08:51:27.259859+0000","last_clean":"2023-12-22T08:51:27.259859+0000","last_became_active":"2023-12-22T08:51:25.149625+0000","last_became_peered":"2023-12-22T08:51:25.149625+0000","last_unstale":"2023-12-22T08:51:27.259859+0000","last_undegraded":"2023-12-22T08:51:27.259859+0000","last_fullsized":"2023-12-22T08:51:27.259859+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:34:01.912521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257920+0000","last_change":"2023-12-22T08:51:24.614483+0000","last_active":"2023-12-22T08:51:27.257920+0000","last_peered":"2023-12-22T08:51:27.257920+0000","last_clean":"2023-12-22T08:51:27.257920+0000","last_became_active":"2023-12-22T08:51:24.613774+0000","last_became_peered":"2023-12-22T08:51:24.613774+0000","last_unstale":"2023-12-22T08:51:27.257920+0000","last_undegraded":"2023-12-22T08:51:27.257920+0000","last_fullsized":"2023-12-22T08:51:27.257920+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:18:40.509951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134128+0000","last_change":"2023-12-22T08:51:25.155950+0000","last_active":"2023-12-22T08:51:26.134128+0000","last_peered":"2023-12-22T08:51:26.134128+0000","last_clean":"2023-12-22T08:51:26.134128+0000","last_became_active":"2023-12-22T08:51:25.154570+0000","last_became_peered":"2023-12-22T08:51:25.154570+0000","last_unstale":"2023-12-22T08:51:26.134128+0000","last_undegraded":"2023-12-22T08:51:26.134128+0000","last_fullsized":"2023-12-22T08:51:26.134128+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:17:48.079004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258694+0000","last_change":"2023-12-22T08:51:24.632996+0000","last_active":"2023-12-22T08:51:27.258694+0000","last_peered":"2023-12-22T08:51:27.258694+0000","last_clean":"2023-12-22T08:51:27.258694+0000","last_became_active":"2023-12-22T08:51:24.632729+0000","last_became_peered":"2023-12-22T08:51:24.632729+0000","last_unstale":"2023-12-22T08:51:27.258694+0000","last_undegraded":"2023-12-22T08:51:27.258694+0000","last_fullsized":"2023-12-22T08:51:27.258694+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:11:05.770465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133963+0000","last_change":"2023-12-22T08:51:25.148580+0000","last_active":"2023-12-22T08:51:26.133963+0000","last_peered":"2023-12-22T08:51:26.133963+0000","last_clean":"2023-12-22T08:51:26.133963+0000","last_became_active":"2023-12-22T08:51:25.144847+0000","last_became_peered":"2023-12-22T08:51:25.144847+0000","last_unstale":"2023-12-22T08:51:26.133963+0000","last_undegraded":"2023-12-22T08:51:26.133963+0000","last_fullsized":"2023-12-22T08:51:26.133963+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:38.613584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"172'8","reported_seq":19,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258530+0000","last_change":"2023-12-22T08:51:24.633162+0000","last_active":"2023-12-22T08:51:27.258530+0000","last_peered":"2023-12-22T08:51:27.258530+0000","last_clean":"2023-12-22T08:51:27.258530+0000","last_became_active":"2023-12-22T08:51:24.630593+0000","last_became_peered":"2023-12-22T08:51:24.630593+0000","last_unstale":"2023-12-22T08:51:27.258530+0000","last_undegraded":"2023-12-22T08:51:27.258530+0000","last_fullsized":"2023-12-22T08:51:27.258530+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:36:18.983418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133106+0000","last_change":"2023-12-22T08:51:25.149991+0000","last_active":"2023-12-22T08:51:26.133106+0000","last_peered":"2023-12-22T08:51:26.133106+0000","last_clean":"2023-12-22T08:51:26.133106+0000","last_became_active":"2023-12-22T08:51:25.149743+0000","last_became_peered":"2023-12-22T08:51:25.149743+0000","last_unstale":"2023-12-22T08:51:26.133106+0000","last_undegraded":"2023-12-22T08:51:26.133106+0000","last_fullsized":"2023-12-22T08:51:26.133106+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:04.340297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"172'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133959+0000","last_change":"2023-12-22T08:51:24.631087+0000","last_active":"2023-12-22T08:51:26.133959+0000","last_peered":"2023-12-22T08:51:26.133959+0000","last_clean":"2023-12-22T08:51:26.133959+0000","last_became_active":"2023-12-22T08:51:24.629140+0000","last_became_peered":"2023-12-22T08:51:24.629140+0000","last_unstale":"2023-12-22T08:51:26.133959+0000","last_undegraded":"2023-12-22T08:51:26.133959+0000","last_fullsized":"2023-12-22T08:51:26.133959+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:16.492318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257663+0000","last_change":"2023-12-22T08:51:25.152564+0000","last_active":"2023-12-22T08:51:27.257663+0000","last_peered":"2023-12-22T08:51:27.257663+0000","last_clean":"2023-12-22T08:51:27.257663+0000","last_became_active":"2023-12-22T08:51:25.152326+0000","last_became_peered":"2023-12-22T08:51:25.152326+0000","last_unstale":"2023-12-22T08:51:27.257663+0000","last_undegraded":"2023-12-22T08:51:27.257663+0000","last_fullsized":"2023-12-22T08:51:27.257663+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:17:05.789079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"172'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260495+0000","last_change":"2023-12-22T08:51:24.630259+0000","last_active":"2023-12-22T08:51:27.260495+0000","last_peered":"2023-12-22T08:51:27.260495+0000","last_clean":"2023-12-22T08:51:27.260495+0000","last_became_active":"2023-12-22T08:51:24.625859+0000","last_became_peered":"2023-12-22T08:51:24.625859+0000","last_unstale":"2023-12-22T08:51:27.260495+0000","last_undegraded":"2023-12-22T08:51:27.260495+0000","last_fullsized":"2023-12-22T08:51:27.260495+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:17:47.065149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.132588+0000","last_change":"2023-12-22T08:51:25.148262+0000","last_active":"2023-12-22T08:51:26.132588+0000","last_peered":"2023-12-22T08:51:26.132588+0000","last_clean":"2023-12-22T08:51:26.132588+0000","last_became_active":"2023-12-22T08:51:25.148028+0000","last_became_peered":"2023-12-22T08:51:25.148028+0000","last_unstale":"2023-12-22T08:51:26.132588+0000","last_undegraded":"2023-12-22T08:51:26.132588+0000","last_fullsized":"2023-12-22T08:51:26.132588+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:04:31.379449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"172'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260498+0000","last_change":"2023-12-22T08:51:24.634028+0000","last_active":"2023-12-22T08:51:27.260498+0000","last_peered":"2023-12-22T08:51:27.260498+0000","last_clean":"2023-12-22T08:51:27.260498+0000","last_became_active":"2023-12-22T08:51:24.633037+0000","last_became_peered":"2023-12-22T08:51:24.633037+0000","last_unstale":"2023-12-22T08:51:27.260498+0000","last_undegraded":"2023-12-22T08:51:27.260498+0000","last_fullsized":"2023-12-22T08:51:27.260498+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:04.025997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259408+0000","last_change":"2023-12-22T08:51:25.149282+0000","last_active":"2023-12-22T08:51:27.259408+0000","last_peered":"2023-12-22T08:51:27.259408+0000","last_clean":"2023-12-22T08:51:27.259408+0000","last_became_active":"2023-12-22T08:51:25.147959+0000","last_became_peered":"2023-12-22T08:51:25.147959+0000","last_unstale":"2023-12-22T08:51:27.259408+0000","last_undegraded":"2023-12-22T08:51:27.259408+0000","last_fullsized":"2023-12-22T08:51:27.259408+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:39.917953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258916+0000","last_change":"2023-12-22T08:51:24.632454+0000","last_active":"2023-12-22T08:51:27.258916+0000","last_peered":"2023-12-22T08:51:27.258916+0000","last_clean":"2023-12-22T08:51:27.258916+0000","last_became_active":"2023-12-22T08:51:24.631944+0000","last_became_peered":"2023-12-22T08:51:24.631944+0000","last_unstale":"2023-12-22T08:51:27.258916+0000","last_undegraded":"2023-12-22T08:51:27.258916+0000","last_fullsized":"2023-12-22T08:51:27.258916+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:16:52.121762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257585+0000","last_change":"2023-12-22T08:51:25.137406+0000","last_active":"2023-12-22T08:51:27.257585+0000","last_peered":"2023-12-22T08:51:27.257585+0000","last_clean":"2023-12-22T08:51:27.257585+0000","last_became_active":"2023-12-22T08:51:25.137007+0000","last_became_peered":"2023-12-22T08:51:25.137007+0000","last_unstale":"2023-12-22T08:51:27.257585+0000","last_undegraded":"2023-12-22T08:51:27.257585+0000","last_fullsized":"2023-12-22T08:51:27.257585+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:17.506173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"172'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.261929+0000","last_change":"2023-12-22T08:51:24.631566+0000","last_active":"2023-12-22T08:51:27.261929+0000","last_peered":"2023-12-22T08:51:27.261929+0000","last_clean":"2023-12-22T08:51:27.261929+0000","last_became_active":"2023-12-22T08:51:24.631251+0000","last_became_peered":"2023-12-22T08:51:24.631251+0000","last_unstale":"2023-12-22T08:51:27.261929+0000","last_undegraded":"2023-12-22T08:51:27.261929+0000","last_fullsized":"2023-12-22T08:51:27.261929+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:05:05.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259228+0000","last_change":"2023-12-22T08:51:25.156045+0000","last_active":"2023-12-22T08:51:27.259228+0000","last_peered":"2023-12-22T08:51:27.259228+0000","last_clean":"2023-12-22T08:51:27.259228+0000","last_became_active":"2023-12-22T08:51:25.155642+0000","last_became_peered":"2023-12-22T08:51:25.155642+0000","last_unstale":"2023-12-22T08:51:27.259228+0000","last_undegraded":"2023-12-22T08:51:27.259228+0000","last_fullsized":"2023-12-22T08:51:27.259228+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:24.550061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134089+0000","last_change":"2023-12-22T08:51:24.631388+0000","last_active":"2023-12-22T08:51:26.134089+0000","last_peered":"2023-12-22T08:51:26.134089+0000","last_clean":"2023-12-22T08:51:26.134089+0000","last_became_active":"2023-12-22T08:51:24.629698+0000","last_became_peered":"2023-12-22T08:51:24.629698+0000","last_unstale":"2023-12-22T08:51:26.134089+0000","last_undegraded":"2023-12-22T08:51:26.134089+0000","last_fullsized":"2023-12-22T08:51:26.134089+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:58.230890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257810+0000","last_change":"2023-12-22T08:51:25.146673+0000","last_active":"2023-12-22T08:51:27.257810+0000","last_peered":"2023-12-22T08:51:27.257810+0000","last_clean":"2023-12-22T08:51:27.257810+0000","last_became_active":"2023-12-22T08:51:25.146072+0000","last_became_peered":"2023-12-22T08:51:25.146072+0000","last_unstale":"2023-12-22T08:51:27.257810+0000","last_undegraded":"2023-12-22T08:51:27.257810+0000","last_fullsized":"2023-12-22T08:51:27.257810+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:08.279843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134663+0000","last_change":"2023-12-22T08:51:24.628990+0000","last_active":"2023-12-22T08:51:26.134663+0000","last_peered":"2023-12-22T08:51:26.134663+0000","last_clean":"2023-12-22T08:51:26.134663+0000","last_became_active":"2023-12-22T08:51:24.628584+0000","last_became_peered":"2023-12-22T08:51:24.628584+0000","last_unstale":"2023-12-22T08:51:26.134663+0000","last_undegraded":"2023-12-22T08:51:26.134663+0000","last_fullsized":"2023-12-22T08:51:26.134663+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:04.025997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.262287+0000","last_change":"2023-12-22T08:51:25.157321+0000","last_active":"2023-12-22T08:51:27.262287+0000","last_peered":"2023-12-22T08:51:27.262287+0000","last_clean":"2023-12-22T08:51:27.262287+0000","last_became_active":"2023-12-22T08:51:25.156617+0000","last_became_peered":"2023-12-22T08:51:25.156617+0000","last_unstale":"2023-12-22T08:51:27.262287+0000","last_undegraded":"2023-12-22T08:51:27.262287+0000","last_fullsized":"2023-12-22T08:51:27.262287+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:31:00.697159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134898+0000","last_change":"2023-12-22T08:51:24.631068+0000","last_active":"2023-12-22T08:51:26.134898+0000","last_peered":"2023-12-22T08:51:26.134898+0000","last_clean":"2023-12-22T08:51:26.134898+0000","last_became_active":"2023-12-22T08:51:24.630067+0000","last_became_peered":"2023-12-22T08:51:24.630067+0000","last_unstale":"2023-12-22T08:51:26.134898+0000","last_undegraded":"2023-12-22T08:51:26.134898+0000","last_fullsized":"2023-12-22T08:51:26.134898+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:30.491483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133912+0000","last_change":"2023-12-22T08:51:25.156142+0000","last_active":"2023-12-22T08:51:26.133912+0000","last_peered":"2023-12-22T08:51:26.133912+0000","last_clean":"2023-12-22T08:51:26.133912+0000","last_became_active":"2023-12-22T08:51:25.155061+0000","last_became_peered":"2023-12-22T08:51:25.155061+0000","last_unstale":"2023-12-22T08:51:26.133912+0000","last_undegraded":"2023-12-22T08:51:26.133912+0000","last_fullsized":"2023-12-22T08:51:26.133912+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:36:19.997273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"172'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134708+0000","last_change":"2023-12-22T08:51:24.631288+0000","last_active":"2023-12-22T08:51:26.134708+0000","last_peered":"2023-12-22T08:51:26.134708+0000","last_clean":"2023-12-22T08:51:26.134708+0000","last_became_active":"2023-12-22T08:51:24.631029+0000","last_became_peered":"2023-12-22T08:51:24.631029+0000","last_unstale":"2023-12-22T08:51:26.134708+0000","last_undegraded":"2023-12-22T08:51:26.134708+0000","last_fullsized":"2023-12-22T08:51:26.134708+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:07.265988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134265+0000","last_change":"2023-12-22T08:51:25.144184+0000","last_active":"2023-12-22T08:51:26.134265+0000","last_peered":"2023-12-22T08:51:26.134265+0000","last_clean":"2023-12-22T08:51:26.134265+0000","last_became_active":"2023-12-22T08:51:25.143606+0000","last_became_peered":"2023-12-22T08:51:25.143606+0000","last_unstale":"2023-12-22T08:51:26.134265+0000","last_undegraded":"2023-12-22T08:51:26.134265+0000","last_fullsized":"2023-12-22T08:51:26.134265+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:17.811614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259447+0000","last_change":"2023-12-22T08:51:24.629702+0000","last_active":"2023-12-22T08:51:27.259447+0000","last_peered":"2023-12-22T08:51:27.259447+0000","last_clean":"2023-12-22T08:51:27.259447+0000","last_became_active":"2023-12-22T08:51:24.627686+0000","last_became_peered":"2023-12-22T08:51:24.627686+0000","last_unstale":"2023-12-22T08:51:27.259447+0000","last_undegraded":"2023-12-22T08:51:27.259447+0000","last_fullsized":"2023-12-22T08:51:27.259447+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:38.295970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260110+0000","last_change":"2023-12-22T08:51:25.158268+0000","last_active":"2023-12-22T08:51:27.260110+0000","last_peered":"2023-12-22T08:51:27.260110+0000","last_clean":"2023-12-22T08:51:27.260110+0000","last_became_active":"2023-12-22T08:51:25.157650+0000","last_became_peered":"2023-12-22T08:51:25.157650+0000","last_unstale":"2023-12-22T08:51:27.260110+0000","last_undegraded":"2023-12-22T08:51:27.260110+0000","last_fullsized":"2023-12-22T08:51:27.260110+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:02:27.221373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259605+0000","last_change":"2023-12-22T08:51:24.625772+0000","last_active":"2023-12-22T08:51:27.259605+0000","last_peered":"2023-12-22T08:51:27.259605+0000","last_clean":"2023-12-22T08:51:27.259605+0000","last_became_active":"2023-12-22T08:51:24.624346+0000","last_became_peered":"2023-12-22T08:51:24.624346+0000","last_unstale":"2023-12-22T08:51:27.259605+0000","last_undegraded":"2023-12-22T08:51:27.259605+0000","last_fullsized":"2023-12-22T08:51:27.259605+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:30.491483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260975+0000","last_change":"2023-12-22T08:51:25.148039+0000","last_active":"2023-12-22T08:51:27.260975+0000","last_peered":"2023-12-22T08:51:27.260975+0000","last_clean":"2023-12-22T08:51:27.260975+0000","last_became_active":"2023-12-22T08:51:25.146404+0000","last_became_peered":"2023-12-22T08:51:25.146404+0000","last_unstale":"2023-12-22T08:51:27.260975+0000","last_undegraded":"2023-12-22T08:51:27.260975+0000","last_fullsized":"2023-12-22T08:51:27.260975+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:37:37.961619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260041+0000","last_change":"2023-12-22T08:51:24.628325+0000","last_active":"2023-12-22T08:51:27.260041+0000","last_peered":"2023-12-22T08:51:27.260041+0000","last_clean":"2023-12-22T08:51:27.260041+0000","last_became_active":"2023-12-22T08:51:24.627960+0000","last_became_peered":"2023-12-22T08:51:24.627960+0000","last_unstale":"2023-12-22T08:51:27.260041+0000","last_undegraded":"2023-12-22T08:51:27.260041+0000","last_fullsized":"2023-12-22T08:51:27.260041+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:07.265988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260148+0000","last_change":"2023-12-22T08:51:25.152725+0000","last_active":"2023-12-22T08:51:27.260148+0000","last_peered":"2023-12-22T08:51:27.260148+0000","last_clean":"2023-12-22T08:51:27.260148+0000","last_became_active":"2023-12-22T08:51:25.150440+0000","last_became_peered":"2023-12-22T08:51:25.150440+0000","last_unstale":"2023-12-22T08:51:27.260148+0000","last_undegraded":"2023-12-22T08:51:27.260148+0000","last_fullsized":"2023-12-22T08:51:27.260148+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:42:51.621693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258234+0000","last_change":"2023-12-22T08:51:24.630464+0000","last_active":"2023-12-22T08:51:27.258234+0000","last_peered":"2023-12-22T08:51:27.258234+0000","last_clean":"2023-12-22T08:51:27.258234+0000","last_became_active":"2023-12-22T08:51:24.629151+0000","last_became_peered":"2023-12-22T08:51:24.629151+0000","last_unstale":"2023-12-22T08:51:27.258234+0000","last_undegraded":"2023-12-22T08:51:27.258234+0000","last_fullsized":"2023-12-22T08:51:27.258234+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:10.198739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134804+0000","last_change":"2023-12-22T08:51:25.153531+0000","last_active":"2023-12-22T08:51:26.134804+0000","last_peered":"2023-12-22T08:51:26.134804+0000","last_clean":"2023-12-22T08:51:26.134804+0000","last_became_active":"2023-12-22T08:51:25.152448+0000","last_became_peered":"2023-12-22T08:51:25.152448+0000","last_unstale":"2023-12-22T08:51:26.134804+0000","last_undegraded":"2023-12-22T08:51:26.134804+0000","last_fullsized":"2023-12-22T08:51:26.134804+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:37.291802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.135967+0000","last_change":"2023-12-22T08:51:24.633573+0000","last_active":"2023-12-22T08:51:26.135967+0000","last_peered":"2023-12-22T08:51:26.135967+0000","last_clean":"2023-12-22T08:51:26.135967+0000","last_became_active":"2023-12-22T08:51:24.633243+0000","last_became_peered":"2023-12-22T08:51:24.633243+0000","last_unstale":"2023-12-22T08:51:26.135967+0000","last_undegraded":"2023-12-22T08:51:26.135967+0000","last_fullsized":"2023-12-22T08:51:26.135967+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:02:26.207519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133847+0000","last_change":"2023-12-22T08:51:25.146789+0000","last_active":"2023-12-22T08:51:26.133847+0000","last_peered":"2023-12-22T08:51:26.133847+0000","last_clean":"2023-12-22T08:51:26.133847+0000","last_became_active":"2023-12-22T08:51:25.146379+0000","last_became_peered":"2023-12-22T08:51:25.146379+0000","last_unstale":"2023-12-22T08:51:26.133847+0000","last_undegraded":"2023-12-22T08:51:26.133847+0000","last_fullsized":"2023-12-22T08:51:26.133847+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:53.912298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257158+0000","last_change":"2023-12-22T08:51:24.619772+0000","last_active":"2023-12-22T08:51:27.257158+0000","last_peered":"2023-12-22T08:51:27.257158+0000","last_clean":"2023-12-22T08:51:27.257158+0000","last_became_active":"2023-12-22T08:51:24.618745+0000","last_became_peered":"2023-12-22T08:51:24.618745+0000","last_unstale":"2023-12-22T08:51:27.257158+0000","last_undegraded":"2023-12-22T08:51:27.257158+0000","last_fullsized":"2023-12-22T08:51:27.257158+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:57:44.252052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.135669+0000","last_change":"2023-12-22T08:51:25.129101+0000","last_active":"2023-12-22T08:51:26.135669+0000","last_peered":"2023-12-22T08:51:26.135669+0000","last_clean":"2023-12-22T08:51:26.135669+0000","last_became_active":"2023-12-22T08:51:25.128841+0000","last_became_peered":"2023-12-22T08:51:25.128841+0000","last_unstale":"2023-12-22T08:51:26.135669+0000","last_undegraded":"2023-12-22T08:51:26.135669+0000","last_fullsized":"2023-12-22T08:51:26.135669+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:55:29.761988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259451+0000","last_change":"2023-12-22T08:51:24.624965+0000","last_active":"2023-12-22T08:51:27.259451+0000","last_peered":"2023-12-22T08:51:27.259451+0000","last_clean":"2023-12-22T08:51:27.259451+0000","last_became_active":"2023-12-22T08:51:24.623983+0000","last_became_peered":"2023-12-22T08:51:24.623983+0000","last_unstale":"2023-12-22T08:51:27.259451+0000","last_undegraded":"2023-12-22T08:51:27.259451+0000","last_fullsized":"2023-12-22T08:51:27.259451+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:23.536206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259852+0000","last_change":"2023-12-22T08:51:25.132265+0000","last_active":"2023-12-22T08:51:27.259852+0000","last_peered":"2023-12-22T08:51:27.259852+0000","last_clean":"2023-12-22T08:51:27.259852+0000","last_became_active":"2023-12-22T08:51:25.131588+0000","last_became_peered":"2023-12-22T08:51:25.131588+0000","last_unstale":"2023-12-22T08:51:27.259852+0000","last_undegraded":"2023-12-22T08:51:27.259852+0000","last_fullsized":"2023-12-22T08:51:27.259852+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:26:23.903003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"172'3","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.256979+0000","last_change":"2023-12-22T08:51:24.619390+0000","last_active":"2023-12-22T08:51:27.256979+0000","last_peered":"2023-12-22T08:51:27.256979+0000","last_clean":"2023-12-22T08:51:27.256979+0000","last_became_active":"2023-12-22T08:51:24.617911+0000","last_became_peered":"2023-12-22T08:51:24.617911+0000","last_unstale":"2023-12-22T08:51:27.256979+0000","last_undegraded":"2023-12-22T08:51:27.256979+0000","last_fullsized":"2023-12-22T08:51:27.256979+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:03.326442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":302,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-22T08:51:25.131232+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:51:25.131232+0000","last_peered":"2023-12-22T08:51:25.131232+0000","last_clean":"2023-12-22T08:51:25.131232+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:51:25.131232+0000","last_undegraded":"2023-12-22T08:51:25.131232+0000","last_fullsized":"2023-12-22T08:51:25.131232+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":946,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194366,"statfs":{"total":200000000,"available":199031263,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.0920000000000001,"15min":1.0860000000000001},"min":{"1min":0.79000000000000004,"5min":0.67500000000000004,"15min":0.58199999999999996},"max":{"1min":1.5880000000000001,"5min":1.8700000000000001,"15min":2.0249999999999999},"last":1.052},{"interface":"front","average":{"1min":1.101,"5min":1.0800000000000001,"15min":1.085},"min":{"1min":0.71299999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6499999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.81000000000000005}]},{"osd":1,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2210000000000001,"15min":1.1930000000000001},"min":{"1min":0.747,"5min":0.70899999999999996,"15min":0.64200000000000002},"max":{"1min":1.554,"5min":1.6839999999999999,"15min":1.905},"last":1.177},{"interface":"front","average":{"1min":1.23,"5min":1.2529999999999999,"15min":1.2070000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.67100000000000004},"max":{"1min":1.506,"5min":1.7709999999999999,"15min":1.865},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1950000000000001,"15min":1.127},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.083},{"interface":"front","average":{"1min":1.26,"5min":1.2310000000000001,"15min":1.2250000000000001},"min":{"1min":0.94299999999999995,"5min":0.79900000000000004,"15min":0.68700000000000006},"max":{"1min":1.6870000000000001,"5min":1.79,"15min":2.1379999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.248,"15min":1.1739999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.71399999999999997},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":2.0680000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3280000000000001,"15min":1.3069999999999999},"min":{"1min":0.78000000000000003,"5min":0.77700000000000002,"15min":0.71799999999999997},"max":{"1min":1.778,"5min":1.873,"15min":2.2959999999999998},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.21,"15min":1.1970000000000001},"min":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.48699999999999999},"max":{"1min":1.7430000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.3109999999999999,"15min":1.272},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.899,"5min":2.0840000000000001,"15min":2.2749999999999999},"last":1.476}]},{"osd":5,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3819999999999999,"15min":1.3720000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.51800000000000002},"max":{"1min":1.6879999999999999,"5min":1.9530000000000001,"15min":2.4300000000000002},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3560000000000001,"15min":1.3660000000000001},"min":{"1min":0.627,"5min":0.623,"15min":0.623},"max":{"1min":1.887,"5min":2.2480000000000002,"15min":2.3410000000000002},"last":1.016}]},{"osd":6,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.522,"15min":1.5},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9199999999999999,"5min":2.355,"15min":2.355},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.512,"15min":1.4870000000000001},"min":{"1min":0.69999999999999996,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.879,"5min":2.1379999999999999,"15min":2.4849999999999999},"last":1.673}]}]},{"osd":6,"up_from":13,"seq":55834574990,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":946,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194366,"statfs":{"total":200000000,"available":199031263,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.4019999999999999,"15min":1.2250000000000001},"min":{"1min":0.83199999999999996,"5min":0.61499999999999999,"15min":0.42099999999999999},"max":{"1min":1.534,"5min":28.361000000000001,"15min":28.361000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.2110000000000001,"15min":1.143},"min":{"1min":1.0860000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.675,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":1.016}]},{"osd":1,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.0920000000000001,"15min":1.0740000000000001},"min":{"1min":0.86399999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.377,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.135},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3720000000000001,"15min":1.244},"min":{"1min":0.84599999999999997,"5min":0.69699999999999995,"15min":0.63100000000000001},"max":{"1min":1.556,"5min":15.324999999999999,"15min":15.324999999999999},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.361,"15min":1.2989999999999999},"min":{"1min":0.97299999999999998,"5min":0.69699999999999995,"15min":0.65700000000000003},"max":{"1min":1.464,"5min":15.422000000000001,"15min":15.422000000000001},"last":1.206},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3540000000000001,"15min":1.236},"min":{"1min":0.94199999999999995,"5min":0.748,"15min":0.58599999999999997},"max":{"1min":1.53,"5min":10.173999999999999,"15min":10.173999999999999},"last":0.90500000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.401,"15min":1.3340000000000001},"min":{"1min":1.0589999999999999,"5min":0.79200000000000004,"15min":0.72899999999999998},"max":{"1min":1.587,"5min":10.096,"15min":10.096},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.264,"15min":1.2490000000000001},"min":{"1min":0.90900000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.627,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.2470000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.427,"15min":1.3899999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.52000000000000002},"max":{"1min":1.623,"5min":15.378,"15min":15.378},"last":1.327},{"interface":"front","average":{"1min":1.296,"5min":1.484,"15min":1.421},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.68999999999999995},"max":{"1min":1.673,"5min":13.178000000000001,"15min":13.178000000000001},"last":1.1819999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.4630000000000001,"15min":1.3819999999999999},"min":{"1min":0.93400000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.603,"5min":19.995000000000001,"15min":19.995000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.587,"15min":1.5640000000000001},"min":{"1min":1.1830000000000001,"5min":1.0369999999999999,"15min":0.67600000000000005},"max":{"1min":1.714,"5min":15.679,"15min":15.679},"last":1.585}]},{"osd":7,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.4910000000000001,"15min":1.5349999999999999},"min":{"1min":1.163,"5min":0.93300000000000005,"15min":0.77200000000000002},"max":{"1min":1.845,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4730000000000001,"15min":1.5},"min":{"1min":1.0700000000000001,"5min":0.89200000000000002,"15min":0.79900000000000004},"max":{"1min":1.8700000000000001,"5min":4.6609999999999996,"15min":4.6609999999999996},"last":1.7070000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1523,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193789,"statfs":{"total":200000000,"available":198440156,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0609999999999999,"15min":1.081},"min":{"1min":0.77300000000000002,"5min":0.69299999999999995,"15min":0.65300000000000002},"max":{"1min":1.5429999999999999,"5min":1.706,"15min":1.944},"last":1.256},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.125,"15min":1.123},"min":{"1min":0.74199999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4119999999999999,"5min":1.7629999999999999,"15min":3.1379999999999999},"last":1.01}]},{"osd":1,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1870000000000001,"15min":1.137},"min":{"1min":0.77300000000000002,"5min":0.73399999999999999,"15min":0.63600000000000001},"max":{"1min":1.4730000000000001,"5min":2.3319999999999999,"15min":2.79},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.204,"5min":1.137,"15min":1.0800000000000001},"min":{"1min":0.93400000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.704,"5min":1.704,"15min":1.7509999999999999},"last":1.175}]},{"osd":2,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1779999999999999,"15min":1.1519999999999999},"min":{"1min":0.77100000000000002,"5min":0.76100000000000001,"15min":0.73899999999999999},"max":{"1min":1.5840000000000001,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.28,"15min":1.2190000000000001},"min":{"1min":1.1160000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.6200000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":0.85799999999999998}]},{"osd":3,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.258,"15min":1.2150000000000001},"min":{"1min":0.84799999999999998,"5min":0.80200000000000005,"15min":0.72799999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.306,"15min":1.2729999999999999},"min":{"1min":1.0920000000000001,"5min":0.77200000000000002,"15min":0.73299999999999998},"max":{"1min":1.6439999999999999,"5min":1.6990000000000001,"15min":2.1499999999999999},"last":1.4990000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.2589999999999999,"15min":1.256},"min":{"1min":0.80200000000000005,"5min":0.60699999999999998,"15min":0.57899999999999996},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.853},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.278,"15min":1.264},"min":{"1min":0.98899999999999999,"5min":0.69999999999999996,"15min":0.58399999999999996},"max":{"1min":1.764,"5min":1.768,"15min":1.768},"last":1.323}]},{"osd":6,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.3400000000000001,"15min":1.3260000000000001},"min":{"1min":1.2470000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.605,"5min":1.7350000000000001,"15min":1.821},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.415,"15min":1.4159999999999999},"min":{"1min":1.0860000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.732,"5min":1.7789999999999999,"15min":2.8780000000000001},"last":1.411}]},{"osd":7,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4059999999999999,"15min":1.3959999999999999},"min":{"1min":1.1879999999999999,"5min":0.84299999999999997,"15min":0.72499999999999998},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":2.2189999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.454,"15min":1.5109999999999999},"min":{"1min":1.3160000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.694,"5min":1.8500000000000001,"15min":4.7249999999999996},"last":1.696}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":948,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194364,"statfs":{"total":200000000,"available":199029095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.129,"15min":1.052},"min":{"1min":0.76800000000000002,"5min":0.67100000000000004,"15min":0.64000000000000001},"max":{"1min":1.6160000000000001,"5min":6.4969999999999999,"15min":6.4969999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.141,"5min":1.109,"15min":1.1160000000000001},"min":{"1min":0.80200000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.542,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":1.2989999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1639999999999999,"15min":1.101},"min":{"1min":0.89500000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.476,"5min":6.2999999999999998,"15min":6.2999999999999998},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.3160000000000001,"15min":1.179},"min":{"1min":0.90500000000000003,"5min":0.66900000000000004,"15min":0.57399999999999995},"max":{"1min":1.3899999999999999,"5min":17.562999999999999,"15min":17.562999999999999},"last":1.2030000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2470000000000001,"15min":1.1879999999999999},"min":{"1min":0.89000000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3220000000000001,"5min":9.0329999999999995,"15min":9.0329999999999995},"last":1.155},{"interface":"front","average":{"1min":1.212,"5min":1.306,"15min":1.246},"min":{"1min":0.83599999999999997,"5min":0.748,"15min":0.748},"max":{"1min":1.5529999999999999,"5min":8.2029999999999994,"15min":8.2029999999999994},"last":1.3380000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3400000000000001,"15min":1.25},"min":{"1min":1.0069999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6100000000000001,"5min":8.8160000000000007,"15min":8.8160000000000007},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3859999999999999,"15min":1.294},"min":{"1min":0.877,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.651,"5min":10.157999999999999,"15min":10.157999999999999},"last":1.2470000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.26,"15min":1.1919999999999999},"min":{"1min":0.79600000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5609999999999999,"5min":7.056,"15min":7.056},"last":1.022},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.4910000000000001,"15min":1.4299999999999999},"min":{"1min":0.91900000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.637,"5min":9.0700000000000003,"15min":9.0700000000000003},"last":1.5600000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.381,"15min":1.3069999999999999},"min":{"1min":0.88100000000000001,"5min":0.62,"15min":0.58599999999999997},"max":{"1min":1.482,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3600000000000001,"15min":1.2809999999999999},"min":{"1min":0.91400000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6679999999999999,"5min":5.2089999999999996,"15min":5.2089999999999996},"last":1.45}]},{"osd":7,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.494,"15min":1.417},"min":{"1min":0.97899999999999998,"5min":0.70199999999999996,"15min":0.67300000000000004},"max":{"1min":1.772,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.5760000000000001,"15min":1.498},"min":{"1min":0.91600000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.714,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.53}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":946,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194365,"statfs":{"total":200000000,"available":199030647,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90500000000000003,"15min":0.92200000000000004},"min":{"1min":0.66800000000000004,"5min":0.48499999999999999,"15min":0.39800000000000002},"max":{"1min":1.2410000000000001,"5min":1.4770000000000001,"15min":1.8340000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.94399999999999995,"15min":0.94099999999999995},"min":{"1min":0.68000000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.413,"5min":1.5369999999999999,"15min":2.5270000000000001},"last":1.012}]},{"osd":1,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.95699999999999996,"15min":0.90100000000000002},"min":{"1min":0.76600000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.361,"5min":1.772,"15min":1.772},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.2010000000000001,"15min":1.167},"min":{"1min":0.73399999999999999,"5min":0.51100000000000001,"15min":0.46200000000000002},"max":{"1min":1.6040000000000001,"5min":1.7749999999999999,"15min":1.861},"last":1.423}]},{"osd":2,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.083,"15min":1.0580000000000001},"min":{"1min":0.755,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4370000000000001,"5min":1.659,"15min":1.7350000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.155,"15min":1.1479999999999999},"min":{"1min":0.86899999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.9570000000000001},"last":1.1859999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.21,"15min":1.218},"min":{"1min":0.92000000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5680000000000001,"5min":2.2839999999999998,"15min":2.7210000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.306,"15min":1.274},"min":{"1min":1.0600000000000001,"5min":0.873,"15min":0.745},"max":{"1min":1.6240000000000001,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.2689999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.3660000000000001,"15min":1.325},"min":{"1min":1.1559999999999999,"5min":0.754,"15min":0.66700000000000004},"max":{"1min":1.635,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.371},{"interface":"front","average":{"1min":1.351,"5min":1.349,"15min":1.397},"min":{"1min":1.0069999999999999,"5min":0.78600000000000003,"15min":0.73699999999999999},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.3839999999999999},"last":1.536}]},{"osd":6,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4550000000000001,"15min":1.448},"min":{"1min":1.0640000000000001,"5min":1.008,"15min":0.88100000000000001},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.3400000000000001,"15min":1.373},"min":{"1min":0.84899999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.708,"5min":1.968,"15min":2.8250000000000002},"last":1.6160000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.409,"15min":1.399},"min":{"1min":0.96599999999999997,"5min":0.81100000000000005,"15min":0.77100000000000002},"max":{"1min":1.7749999999999999,"5min":2.056,"15min":2.7850000000000001},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.464,"15min":1.4299999999999999},"min":{"1min":1.155,"5min":0.81499999999999995,"15min":0.80600000000000005},"max":{"1min":1.944,"5min":2.2290000000000001,"15min":2.3740000000000001},"last":1.492}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":946,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194366,"statfs":{"total":200000000,"available":199031241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.85099999999999998,"15min":0.83199999999999996},"min":{"1min":0.63300000000000001,"5min":0.40000000000000002,"15min":0.32000000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":6.8879999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93000000000000005,"15min":0.94099999999999995},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.35799999999999998},"max":{"1min":1.696,"5min":1.7589999999999999,"15min":4.5510000000000002},"last":0.82199999999999995}]},{"osd":1,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.94799999999999995},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.34000000000000002},"max":{"1min":1.506,"5min":1.702,"15min":11.308999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.135,"5min":1.0860000000000001,"15min":1.0129999999999999},"min":{"1min":0.80200000000000005,"5min":0.51000000000000001,"15min":0.44600000000000001},"max":{"1min":1.6160000000000001,"5min":1.7290000000000001,"15min":2.9889999999999999},"last":0.98499999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.099,"15min":1.101},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.41099999999999998},"max":{"1min":1.772,"5min":1.772,"15min":13.087999999999999},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.2190000000000001,"15min":1.1919999999999999},"min":{"1min":0.90300000000000002,"5min":0.55200000000000005,"15min":0.52300000000000002},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":12.289999999999999},"last":1.0980000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.363,"15min":1.3149999999999999},"min":{"1min":0.86099999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.9319999999999999,"5min":2.3159999999999998,"15min":3.5249999999999999},"last":1.196},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.276,"15min":1.3360000000000001},"min":{"1min":0.80500000000000005,"5min":0.71599999999999997,"15min":0.61499999999999999},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":13.927},"last":1.3939999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3420000000000001,"15min":1.371},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.64000000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":11.003},"last":1.472},{"interface":"front","average":{"1min":1.383,"5min":1.323,"15min":1.325},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.825,"5min":1.9370000000000001,"15min":13.129},"last":1.3460000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.3819999999999999,"15min":1.3480000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.978,"5min":1.9810000000000001,"15min":8.1609999999999996},"last":1.446},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.4730000000000001,"15min":1.4350000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.69999999999999996},"max":{"1min":2.0089999999999999,"5min":2.0939999999999999,"15min":6.8150000000000004},"last":1.611}]},{"osd":7,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.3779999999999999,"15min":1.4099999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.61299999999999999},"max":{"1min":1.9630000000000001,"5min":2.1440000000000001,"15min":10.948},"last":1.548},{"interface":"front","average":{"1min":1.49,"5min":1.556,"15min":1.4630000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8959999999999999,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":1.5289999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193789,"statfs":{"total":200000000,"available":198440825,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.1140000000000001,"15min":0.97799999999999998},"min":{"1min":0.625,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":1.321,"5min":23.059000000000001,"15min":23.059000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.1930000000000001,"15min":1.1000000000000001},"min":{"1min":0.75900000000000001,"5min":0.41099999999999998,"15min":0.39900000000000002},"max":{"1min":1.625,"5min":9.9749999999999996,"15min":9.9749999999999996},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.1930000000000001,"15min":1.0429999999999999},"min":{"1min":0.71899999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1950000000000001,"5min":22.977,"15min":22.977},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.01,"15min":0.996},"min":{"1min":0.80900000000000005,"5min":0.35899999999999999,"15min":0.34999999999999998},"max":{"1min":1.5329999999999999,"5min":1.6499999999999999,"15min":2.254},"last":1.2589999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3220000000000001,"15min":1.256},"min":{"1min":0.89200000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.778,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.099,"15min":1.03},"min":{"1min":0.70299999999999996,"5min":0.53400000000000003,"15min":0.47799999999999998},"max":{"1min":1.732,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.155}]},{"osd":4,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.4770000000000001,"15min":1.353},"min":{"1min":1.018,"5min":0.71299999999999997,"15min":0.58699999999999997},"max":{"1min":1.5629999999999999,"5min":23.145,"15min":23.145},"last":1.47},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.5,"15min":1.4119999999999999},"min":{"1min":1.0820000000000001,"5min":0.747,"15min":0.747},"max":{"1min":1.7150000000000001,"5min":9.9299999999999997,"15min":9.9299999999999997},"last":1.611}]},{"osd":5,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.2669999999999999,"15min":1.264},"min":{"1min":1.008,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.8149999999999999,"5min":2.8109999999999999,"15min":4.6399999999999997},"last":1.9790000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.54,"15min":1.4319999999999999},"min":{"1min":1.056,"5min":0.71699999999999997,"15min":0.66800000000000004},"max":{"1min":1.6519999999999999,"5min":23.105,"15min":23.105},"last":1.806}]},{"osd":6,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.333,"15min":1.3100000000000001},"min":{"1min":0.996,"5min":0.82199999999999995,"15min":0.65200000000000002},"max":{"1min":1.889,"5min":2.71,"15min":4.5819999999999999},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.6599999999999999,"15min":1.4910000000000001},"min":{"1min":1.1830000000000001,"5min":0.80300000000000005,"15min":0.67200000000000004},"max":{"1min":1.732,"5min":24.341999999999999,"15min":24.341999999999999},"last":1.901}]},{"osd":7,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.407,"15min":1.417},"min":{"1min":1.165,"5min":0.78800000000000003,"15min":0.64400000000000002},"max":{"1min":1.8160000000000001,"5min":2.0870000000000002,"15min":2.4889999999999999},"last":1.923},{"interface":"front","average":{"1min":1.452,"5min":1.4179999999999999,"15min":1.429},"min":{"1min":1.071,"5min":0.76800000000000002,"15min":0.66200000000000003},"max":{"1min":1.6439999999999999,"5min":1.7649999999999999,"15min":4.508},"last":1.8560000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574990,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":946,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194366,"statfs":{"total":200000000,"available":199031173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.83999999999999997,"15min":0.79100000000000004},"min":{"1min":0.66600000000000004,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.077,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.121,"5min":0.997,"15min":0.95099999999999996},"min":{"1min":0.629,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.5189999999999999,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.86599999999999999,"15min":0.83799999999999997},"min":{"1min":0.71999999999999997,"5min":0.373,"15min":0.373},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.6739999999999999},"last":1.246},{"interface":"front","average":{"1min":1.141,"5min":1.034,"15min":1.0049999999999999},"min":{"1min":0.92600000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.377,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.071}]},{"osd":3,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.163,"15min":1.1060000000000001},"min":{"1min":0.85699999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7609999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.093},{"interface":"front","average":{"1min":1.363,"5min":1.27,"15min":1.1719999999999999},"min":{"1min":0.83699999999999997,"5min":0.45500000000000002,"15min":0.39100000000000001},"max":{"1min":1.6639999999999999,"5min":2.0659999999999998,"15min":2.145},"last":1.353}]},{"osd":4,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.333,"15min":1.3120000000000001},"min":{"1min":1,"5min":0.79300000000000004,"15min":0.70799999999999996},"max":{"1min":1.663,"5min":2.0910000000000002,"15min":2.625},"last":1.181},{"interface":"front","average":{"1min":1.452,"5min":1.3680000000000001,"15min":1.2949999999999999},"min":{"1min":1.1279999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.694,"5min":1.964,"15min":2.5550000000000002},"last":1.1379999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.385,"15min":1.321},"min":{"1min":1.1499999999999999,"5min":0.69599999999999995,"15min":0.59299999999999997},"max":{"1min":1.6859999999999999,"5min":5.4290000000000003,"15min":5.4290000000000003},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3520000000000001,"15min":1.3129999999999999},"min":{"1min":1.0900000000000001,"5min":0.79500000000000004,"15min":0.73599999999999999},"max":{"1min":1.6379999999999999,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.2909999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.375,"15min":1.3380000000000001},"min":{"1min":1.1259999999999999,"5min":0.66900000000000004,"15min":0.64800000000000002},"max":{"1min":1.675,"5min":1.9330000000000001,"15min":2.4420000000000002},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.494,"15min":1.4490000000000001},"min":{"1min":1.3799999999999999,"5min":0.88800000000000001,"15min":0.69099999999999995},"max":{"1min":1.847,"5min":2.109,"15min":2.577},"last":1.3220000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.4570000000000001,"15min":1.4219999999999999},"min":{"1min":1.2969999999999999,"5min":0.80000000000000004,"15min":0.755},"max":{"1min":1.8560000000000001,"5min":1.982,"15min":2.3069999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.476,"15min":1.429},"min":{"1min":1.1639999999999999,"5min":0.88800000000000001,"15min":0.749},"max":{"1min":1.9099999999999999,"5min":2.1680000000000001,"15min":2.2650000000000001},"last":1.397}]}]}],"pool_statfs":[]}} 2023-12-22T08:51:30.151 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:51:30.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.414+0000 7f1528e5f640 1 Processor -- start 2023-12-22T08:51:30.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.415+0000 7f1528e5f640 1 -- start start 2023-12-22T08:51:30.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.416+0000 7f1528e5f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f15240b6b20 0x7f15240b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.416+0000 7f1528e5f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15240b5c80 con 0x7f15240d1620 2023-12-22T08:51:30.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.416+0000 7f1528e5f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15240b7490 con 0x7f15240d1240 2023-12-22T08:51:30.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.416+0000 7f1528e5f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15240d0760 con 0x7f15240b6b20 2023-12-22T08:51:30.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.417+0000 7f1521d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f15240d1620 0x7f15240cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58340/0 (socket says 172.21.15.38:58340) 2023-12-22T08:51:30.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.417+0000 7f1521d9b640 1 -- 172.21.15.38:0/1826648579 learned_addr learned my addr 172.21.15.38:0/1826648579 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:30.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.417+0000 7f1522d9d640 1 --2- 172.21.15.38:0/1826648579 >> v2:172.21.15.89:3300/0 conn(0x7f15240b6b20 0x7f15240b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:30.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.417+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791001615 0 0) 0x7f15240b5c80 con 0x7f15240d1620 2023-12-22T08:51:30.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.417+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1510003520 con 0x7f15240d1620 2023-12-22T08:51:30.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1182974931 0 0) 0x7f1510003520 con 0x7f15240d1620 2023-12-22T08:51:30.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 >> v2:172.21.15.89:3300/0 conn(0x7f15240b6b20 msgr2=0x7f15240b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:30.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152159a640 1 --2- 172.21.15.38:0/1826648579 >> v2:172.21.15.89:3300/0 conn(0x7f15240b6b20 0x7f15240b6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 >> v1:172.21.15.89:6789/0 conn(0x7f15240d1240 legacy=0x7f15240b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:30.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15240d01a0 con 0x7f15240d1620 2023-12-22T08:51:30.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f150c001670 con 0x7f15240d1620 2023-12-22T08:51:30.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 >> v1:172.21.15.38:6789/0 conn(0x7f15240d1620 legacy=0x7f15240cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:30.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152159a640 1 --2- 172.21.15.38:0/1826648579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1510003970 0x7f1510003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152159a640 1 --2- 172.21.15.38:0/1826648579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15100047c0 0x7f1510004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152159a640 1 --2- 172.21.15.38:0/1826648579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1510005180 0x7f151000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15240d0760 con 0x7f15100047c0 2023-12-22T08:51:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151000c020 con 0x7f1510003970 2023-12-22T08:51:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151000c1e0 con 0x7f1510005180 2023-12-22T08:51:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f1521d9b640 1 --2- 172.21.15.38:0/1826648579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15100047c0 0x7f1510004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.418+0000 7f152259c640 1 --2- 172.21.15.38:0/1826648579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1510003970 0x7f1510003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.419+0000 7f1521d9b640 1 -- 172.21.15.38:0/1826648579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1510005180 msgr2=0x7f151000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.419+0000 7f1521d9b640 1 --2- 172.21.15.38:0/1826648579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1510005180 0x7f151000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.419+0000 7f1521d9b640 1 -- 172.21.15.38:0/1826648579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1510003970 msgr2=0x7f1510003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.419+0000 7f1521d9b640 1 --2- 172.21.15.38:0/1826648579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1510003970 0x7f1510003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.419+0000 7f1521d9b640 1 -- 172.21.15.38:0/1826648579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1510003520 con 0x7f15100047c0 2023-12-22T08:51:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.419+0000 7f1522d9d640 1 -- 172.21.15.38:0/1826648579 reap_dead start 2023-12-22T08:51:30.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.420+0000 7f1521d9b640 1 --2- 172.21.15.38:0/1826648579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15100047c0 0x7f1510004c40 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f150c00c240 tx=0x7f15100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb56720543937e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:30.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.420+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c005ad0 con 0x7f15100047c0 2023-12-22T08:51:30.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.420+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c005c30 con 0x7f15100047c0 2023-12-22T08:51:30.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.420+0000 7f152159a640 1 -- 172.21.15.38:0/1826648579 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c02cab0 con 0x7f15100047c0 2023-12-22T08:51:30.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.421+0000 7f1528e5f640 1 -- 172.21.15.38:0/1826648579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15100047c0 msgr2=0x7f1510004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:30.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.421+0000 7f1528e5f640 1 --2- 172.21.15.38:0/1826648579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15100047c0 0x7f1510004c40 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f150c00c240 tx=0x7f15100057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.421+0000 7f1528e5f640 1 -- 172.21.15.38:0/1826648579 shutdown_connections 2023-12-22T08:51:30.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.421+0000 7f1528e5f640 1 --2- 172.21.15.38:0/1826648579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15100047c0 0x7f1510004c40 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.421+0000 7f1528e5f640 1 -- 172.21.15.38:0/1826648579 >> 172.21.15.38:0/1826648579 conn(0x7f152406c5e0 msgr2=0x7f152406c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:30.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.421+0000 7f1528e5f640 1 -- 172.21.15.38:0/1826648579 shutdown_connections 2023-12-22T08:51:30.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.421+0000 7f1528e5f640 1 -- 172.21.15.38:0/1826648579 wait complete. 2023-12-22T08:51:30.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.423+0000 7f1528e5f640 1 Processor -- start 2023-12-22T08:51:30.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.423+0000 7f1528e5f640 1 -- start start 2023-12-22T08:51:30.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.424+0000 7f1528e5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15100047c0 0x7f15240a9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.424+0000 7f1528e5f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f152415f380 0x7f152415f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.424+0000 7f1528e5f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15241542e0 0x7f1524154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.424+0000 7f1528e5f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1524155bb0 con 0x7f15241542e0 2023-12-22T08:51:30.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.424+0000 7f1528e5f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15240a8810 con 0x7f15100047c0 2023-12-22T08:51:30.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.424+0000 7f1528e5f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152415fd40 con 0x7f152415f380 2023-12-22T08:51:30.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.424+0000 7f1522d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15241542e0 0x7f1524154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:30.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.424+0000 7f1522d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15241542e0 0x7f1524154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51404/0 (socket says 172.21.15.38:51404) 2023-12-22T08:51:30.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.424+0000 7f1522d9d640 1 -- 172.21.15.38:0/3352617037 learned_addr learned my addr 172.21.15.38:0/3352617037 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:30.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.425+0000 7f1522d9d640 1 -- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f152415f380 msgr2=0x7f152415f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:30.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.425+0000 7f1521d9b640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f152415f380 0x7f152415f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.425+0000 7f152259c640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15100047c0 0x7f15240a9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.425+0000 7f1522d9d640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f152415f380 0x7f152415f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.425+0000 7f1522d9d640 1 -- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15100047c0 msgr2=0x7f15240a9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.425+0000 7f1522d9d640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15100047c0 0x7f15240a9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.425+0000 7f1522d9d640 1 -- 172.21.15.38:0/3352617037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1524154ca0 con 0x7f15241542e0 2023-12-22T08:51:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.425+0000 7f1521d9b640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f152415f380 0x7f152415f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.425+0000 7f1522d9d640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15241542e0 0x7f1524154760 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f152406d3f0 tx=0x7f151c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.425+0000 7f151affd640 1 -- 172.21.15.38:0/3352617037 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00c680 con 0x7f15241542e0 2023-12-22T08:51:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.426+0000 7f151affd640 1 -- 172.21.15.38:0/3352617037 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00c7e0 con 0x7f15241542e0 2023-12-22T08:51:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.426+0000 7f151affd640 1 -- 172.21.15.38:0/3352617037 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00cb90 con 0x7f15241542e0 2023-12-22T08:51:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.426+0000 7f1528e5f640 1 -- 172.21.15.38:0/3352617037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1524154f30 con 0x7f15241542e0 2023-12-22T08:51:30.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.426+0000 7f1528e5f640 1 -- 172.21.15.38:0/3352617037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15241554f0 con 0x7f15241542e0 2023-12-22T08:51:30.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.427+0000 7f1528e5f640 1 -- 172.21.15.38:0/3352617037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1524155cf0 con 0x7f15241542e0 2023-12-22T08:51:30.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.428+0000 7f151affd640 1 -- 172.21.15.38:0/3352617037 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f151c00ccf0 con 0x7f15241542e0 2023-12-22T08:51:30.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.429+0000 7f151affd640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f150406a460 0x7f150406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.429+0000 7f151affd640 1 -- 172.21.15.38:0/3352617037 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f151c088430 con 0x7f15241542e0 2023-12-22T08:51:30.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.430+0000 7f152259c640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f150406a460 0x7f150406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:30.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.431+0000 7f152259c640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f150406a460 0x7f150406c920 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1514000f80 tx=0x7f1514009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:30.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.433+0000 7f151affd640 1 -- 172.21.15.38:0/3352617037 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1524155cf0 con 0x7f15241542e0 2023-12-22T08:51:30.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.625+0000 7f1528e5f640 1 -- 172.21.15.38:0/3352617037 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1524155fd0 con 0x7f150406a460 2023-12-22T08:51:30.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.648+0000 7f151affd640 1 -- 172.21.15.38:0/3352617037 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282986 (secure 0 0 0) 0x7f151400d040 con 0x7f150406a460 2023-12-22T08:51:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:30.655 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:51:30.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.653+0000 7f1528e5f640 1 -- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f150406a460 msgr2=0x7f150406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:30.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.653+0000 7f1528e5f640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f150406a460 0x7f150406c920 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1514000f80 tx=0x7f1514009040 comp rx=0 tx=0).stop 2023-12-22T08:51:30.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.653+0000 7f1528e5f640 1 -- 172.21.15.38:0/3352617037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15241542e0 msgr2=0x7f1524154760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:30.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.653+0000 7f1528e5f640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15241542e0 0x7f1524154760 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f152406d3f0 tx=0x7f151c00ec00 comp rx=0 tx=0).stop 2023-12-22T08:51:30.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.654+0000 7f1528e5f640 1 -- 172.21.15.38:0/3352617037 shutdown_connections 2023-12-22T08:51:30.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.654+0000 7f1528e5f640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f150406a460 0x7f150406c920 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.654+0000 7f1528e5f640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15241542e0 0x7f1524154760 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.654+0000 7f1528e5f640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f152415f380 0x7f152415f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.654+0000 7f1528e5f640 1 --2- 172.21.15.38:0/3352617037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15100047c0 0x7f15240a9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.654+0000 7f1528e5f640 1 -- 172.21.15.38:0/3352617037 >> 172.21.15.38:0/3352617037 conn(0x7f152406c5e0 msgr2=0x7f15240b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:30.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.654+0000 7f1528e5f640 1 -- 172.21.15.38:0/3352617037 shutdown_connections 2023-12-22T08:51:30.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.654+0000 7f1528e5f640 1 -- 172.21.15.38:0/3352617037 wait complete. 2023-12-22T08:51:30.674 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":516,"stamp":"2023-12-22T08:51:30.611491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8724,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553775,"statfs":{"total":1600000000,"available":1591065663,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.006836"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.261524+0000","last_change":"2023-12-22T08:51:25.151363+0000","last_active":"2023-12-22T08:51:27.261524+0000","last_peered":"2023-12-22T08:51:27.261524+0000","last_clean":"2023-12-22T08:51:27.261524+0000","last_became_active":"2023-12-22T08:51:25.148596+0000","last_became_peered":"2023-12-22T08:51:25.148596+0000","last_unstale":"2023-12-22T08:51:27.261524+0000","last_undegraded":"2023-12-22T08:51:27.261524+0000","last_fullsized":"2023-12-22T08:51:27.261524+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:13:30.131595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257937+0000","last_change":"2023-12-22T08:51:25.156697+0000","last_active":"2023-12-22T08:51:27.257937+0000","last_peered":"2023-12-22T08:51:27.257937+0000","last_clean":"2023-12-22T08:51:27.257937+0000","last_became_active":"2023-12-22T08:51:25.154323+0000","last_became_peered":"2023-12-22T08:51:25.154323+0000","last_unstale":"2023-12-22T08:51:27.257937+0000","last_undegraded":"2023-12-22T08:51:27.257937+0000","last_fullsized":"2023-12-22T08:51:27.257937+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:05:06.736300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.135787+0000","last_change":"2023-12-22T08:51:25.131748+0000","last_active":"2023-12-22T08:51:26.135787+0000","last_peered":"2023-12-22T08:51:26.135787+0000","last_clean":"2023-12-22T08:51:26.135787+0000","last_became_active":"2023-12-22T08:51:25.131520+0000","last_became_peered":"2023-12-22T08:51:25.131520+0000","last_unstale":"2023-12-22T08:51:26.135787+0000","last_undegraded":"2023-12-22T08:51:26.135787+0000","last_fullsized":"2023-12-22T08:51:26.135787+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:36:11.428733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133617+0000","last_change":"2023-12-22T08:51:25.143521+0000","last_active":"2023-12-22T08:51:26.133617+0000","last_peered":"2023-12-22T08:51:26.133617+0000","last_clean":"2023-12-22T08:51:26.133617+0000","last_became_active":"2023-12-22T08:51:25.143218+0000","last_became_peered":"2023-12-22T08:51:25.143218+0000","last_unstale":"2023-12-22T08:51:26.133617+0000","last_undegraded":"2023-12-22T08:51:26.133617+0000","last_fullsized":"2023-12-22T08:51:26.133617+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:23:47.489292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.132878+0000","last_change":"2023-12-22T08:51:25.153334+0000","last_active":"2023-12-22T08:51:26.132878+0000","last_peered":"2023-12-22T08:51:26.132878+0000","last_clean":"2023-12-22T08:51:26.132878+0000","last_became_active":"2023-12-22T08:51:25.153001+0000","last_became_peered":"2023-12-22T08:51:25.153001+0000","last_unstale":"2023-12-22T08:51:26.132878+0000","last_undegraded":"2023-12-22T08:51:26.132878+0000","last_fullsized":"2023-12-22T08:51:26.132878+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:17:05.789079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259643+0000","last_change":"2023-12-22T08:51:25.136705+0000","last_active":"2023-12-22T08:51:27.259643+0000","last_peered":"2023-12-22T08:51:27.259643+0000","last_clean":"2023-12-22T08:51:27.259643+0000","last_became_active":"2023-12-22T08:51:25.135576+0000","last_became_peered":"2023-12-22T08:51:25.135576+0000","last_unstale":"2023-12-22T08:51:27.259643+0000","last_undegraded":"2023-12-22T08:51:27.259643+0000","last_fullsized":"2023-12-22T08:51:27.259643+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:52:14.407348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259894+0000","last_change":"2023-12-22T08:51:25.143375+0000","last_active":"2023-12-22T08:51:27.259894+0000","last_peered":"2023-12-22T08:51:27.259894+0000","last_clean":"2023-12-22T08:51:27.259894+0000","last_became_active":"2023-12-22T08:51:25.143009+0000","last_became_peered":"2023-12-22T08:51:25.143009+0000","last_unstale":"2023-12-22T08:51:27.259894+0000","last_undegraded":"2023-12-22T08:51:27.259894+0000","last_fullsized":"2023-12-22T08:51:27.259894+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:36:05.621843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258122+0000","last_change":"2023-12-22T08:51:25.145085+0000","last_active":"2023-12-22T08:51:27.258122+0000","last_peered":"2023-12-22T08:51:27.258122+0000","last_clean":"2023-12-22T08:51:27.258122+0000","last_became_active":"2023-12-22T08:51:25.144580+0000","last_became_peered":"2023-12-22T08:51:25.144580+0000","last_unstale":"2023-12-22T08:51:27.258122+0000","last_undegraded":"2023-12-22T08:51:27.258122+0000","last_fullsized":"2023-12-22T08:51:27.258122+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:18:41.238462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258745+0000","last_change":"2023-12-22T08:51:25.153510+0000","last_active":"2023-12-22T08:51:27.258745+0000","last_peered":"2023-12-22T08:51:27.258745+0000","last_clean":"2023-12-22T08:51:27.258745+0000","last_became_active":"2023-12-22T08:51:25.153258+0000","last_became_peered":"2023-12-22T08:51:25.153258+0000","last_unstale":"2023-12-22T08:51:27.258745+0000","last_undegraded":"2023-12-22T08:51:27.258745+0000","last_fullsized":"2023-12-22T08:51:27.258745+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:59.244745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136374+0000","last_change":"2023-12-22T08:51:25.133573+0000","last_active":"2023-12-22T08:51:26.136374+0000","last_peered":"2023-12-22T08:51:26.136374+0000","last_clean":"2023-12-22T08:51:26.136374+0000","last_became_active":"2023-12-22T08:51:25.133319+0000","last_became_peered":"2023-12-22T08:51:25.133319+0000","last_unstale":"2023-12-22T08:51:26.136374+0000","last_undegraded":"2023-12-22T08:51:26.136374+0000","last_fullsized":"2023-12-22T08:51:26.136374+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:34:21.785565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258849+0000","last_change":"2023-12-22T08:51:25.136212+0000","last_active":"2023-12-22T08:51:27.258849+0000","last_peered":"2023-12-22T08:51:27.258849+0000","last_clean":"2023-12-22T08:51:27.258849+0000","last_became_active":"2023-12-22T08:51:25.134748+0000","last_became_peered":"2023-12-22T08:51:25.134748+0000","last_unstale":"2023-12-22T08:51:27.258849+0000","last_undegraded":"2023-12-22T08:51:27.258849+0000","last_fullsized":"2023-12-22T08:51:27.258849+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:26:23.903003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257088+0000","last_change":"2023-12-22T08:51:25.145340+0000","last_active":"2023-12-22T08:51:27.257088+0000","last_peered":"2023-12-22T08:51:27.257088+0000","last_clean":"2023-12-22T08:51:27.257088+0000","last_became_active":"2023-12-22T08:51:25.145001+0000","last_became_peered":"2023-12-22T08:51:25.145001+0000","last_unstale":"2023-12-22T08:51:27.257088+0000","last_undegraded":"2023-12-22T08:51:27.257088+0000","last_fullsized":"2023-12-22T08:51:27.257088+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:59.244745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.132946+0000","last_change":"2023-12-22T08:51:25.149310+0000","last_active":"2023-12-22T08:51:26.132946+0000","last_peered":"2023-12-22T08:51:26.132946+0000","last_clean":"2023-12-22T08:51:26.132946+0000","last_became_active":"2023-12-22T08:51:25.149084+0000","last_became_peered":"2023-12-22T08:51:25.149084+0000","last_unstale":"2023-12-22T08:51:26.132946+0000","last_undegraded":"2023-12-22T08:51:26.132946+0000","last_fullsized":"2023-12-22T08:51:26.132946+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:18:41.523806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257333+0000","last_change":"2023-12-22T08:51:25.141215+0000","last_active":"2023-12-22T08:51:27.257333+0000","last_peered":"2023-12-22T08:51:27.257333+0000","last_clean":"2023-12-22T08:51:27.257333+0000","last_became_active":"2023-12-22T08:51:25.139746+0000","last_became_peered":"2023-12-22T08:51:25.139746+0000","last_unstale":"2023-12-22T08:51:27.257333+0000","last_undegraded":"2023-12-22T08:51:27.257333+0000","last_fullsized":"2023-12-22T08:51:27.257333+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:31.505338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133000+0000","last_change":"2023-12-22T08:51:25.138613+0000","last_active":"2023-12-22T08:51:26.133000+0000","last_peered":"2023-12-22T08:51:26.133000+0000","last_clean":"2023-12-22T08:51:26.133000+0000","last_became_active":"2023-12-22T08:51:25.138396+0000","last_became_peered":"2023-12-22T08:51:25.138396+0000","last_unstale":"2023-12-22T08:51:26.133000+0000","last_undegraded":"2023-12-22T08:51:26.133000+0000","last_fullsized":"2023-12-22T08:51:26.133000+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:05.116308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260386+0000","last_change":"2023-12-22T08:51:25.154527+0000","last_active":"2023-12-22T08:51:27.260386+0000","last_peered":"2023-12-22T08:51:27.260386+0000","last_clean":"2023-12-22T08:51:27.260386+0000","last_became_active":"2023-12-22T08:51:25.154207+0000","last_became_peered":"2023-12-22T08:51:25.154207+0000","last_unstale":"2023-12-22T08:51:27.260386+0000","last_undegraded":"2023-12-22T08:51:27.260386+0000","last_fullsized":"2023-12-22T08:51:27.260386+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:46.814446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.135861+0000","last_change":"2023-12-22T08:51:25.141509+0000","last_active":"2023-12-22T08:51:26.135861+0000","last_peered":"2023-12-22T08:51:26.135861+0000","last_clean":"2023-12-22T08:51:26.135861+0000","last_became_active":"2023-12-22T08:51:25.141208+0000","last_became_peered":"2023-12-22T08:51:25.141208+0000","last_unstale":"2023-12-22T08:51:26.135861+0000","last_undegraded":"2023-12-22T08:51:26.135861+0000","last_fullsized":"2023-12-22T08:51:26.135861+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:21:06.829510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133228+0000","last_change":"2023-12-22T08:51:25.138109+0000","last_active":"2023-12-22T08:51:26.133228+0000","last_peered":"2023-12-22T08:51:26.133228+0000","last_clean":"2023-12-22T08:51:26.133228+0000","last_became_active":"2023-12-22T08:51:25.137843+0000","last_became_peered":"2023-12-22T08:51:25.137843+0000","last_unstale":"2023-12-22T08:51:26.133228+0000","last_undegraded":"2023-12-22T08:51:26.133228+0000","last_fullsized":"2023-12-22T08:51:26.133228+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:57:45.265907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.261543+0000","last_change":"2023-12-22T08:51:25.132936+0000","last_active":"2023-12-22T08:51:27.261543+0000","last_peered":"2023-12-22T08:51:27.261543+0000","last_clean":"2023-12-22T08:51:27.261543+0000","last_became_active":"2023-12-22T08:51:25.132004+0000","last_became_peered":"2023-12-22T08:51:25.132004+0000","last_unstale":"2023-12-22T08:51:27.261543+0000","last_undegraded":"2023-12-22T08:51:27.261543+0000","last_fullsized":"2023-12-22T08:51:27.261543+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:21:33.240418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258224+0000","last_change":"2023-12-22T08:51:25.158489+0000","last_active":"2023-12-22T08:51:27.258224+0000","last_peered":"2023-12-22T08:51:27.258224+0000","last_clean":"2023-12-22T08:51:27.258224+0000","last_became_active":"2023-12-22T08:51:25.158001+0000","last_became_peered":"2023-12-22T08:51:25.158001+0000","last_unstale":"2023-12-22T08:51:27.258224+0000","last_undegraded":"2023-12-22T08:51:27.258224+0000","last_fullsized":"2023-12-22T08:51:27.258224+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:25.266312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136186+0000","last_change":"2023-12-22T08:51:25.147893+0000","last_active":"2023-12-22T08:51:26.136186+0000","last_peered":"2023-12-22T08:51:26.136186+0000","last_clean":"2023-12-22T08:51:26.136186+0000","last_became_active":"2023-12-22T08:51:25.147671+0000","last_became_peered":"2023-12-22T08:51:25.147671+0000","last_unstale":"2023-12-22T08:51:26.136186+0000","last_undegraded":"2023-12-22T08:51:26.136186+0000","last_fullsized":"2023-12-22T08:51:26.136186+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:03:48.535916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257233+0000","last_change":"2023-12-22T08:51:25.152823+0000","last_active":"2023-12-22T08:51:27.257233+0000","last_peered":"2023-12-22T08:51:27.257233+0000","last_clean":"2023-12-22T08:51:27.257233+0000","last_became_active":"2023-12-22T08:51:25.152528+0000","last_became_peered":"2023-12-22T08:51:25.152528+0000","last_unstale":"2023-12-22T08:51:27.257233+0000","last_undegraded":"2023-12-22T08:51:27.257233+0000","last_fullsized":"2023-12-22T08:51:27.257233+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:11.212100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133789+0000","last_change":"2023-12-22T08:51:25.149794+0000","last_active":"2023-12-22T08:51:26.133789+0000","last_peered":"2023-12-22T08:51:26.133789+0000","last_clean":"2023-12-22T08:51:26.133789+0000","last_became_active":"2023-12-22T08:51:25.149156+0000","last_became_peered":"2023-12-22T08:51:25.149156+0000","last_unstale":"2023-12-22T08:51:26.133789+0000","last_undegraded":"2023-12-22T08:51:26.133789+0000","last_fullsized":"2023-12-22T08:51:26.133789+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:25:53.865883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.132665+0000","last_change":"2023-12-22T08:51:25.141816+0000","last_active":"2023-12-22T08:51:26.132665+0000","last_peered":"2023-12-22T08:51:26.132665+0000","last_clean":"2023-12-22T08:51:26.132665+0000","last_became_active":"2023-12-22T08:51:25.141560+0000","last_became_peered":"2023-12-22T08:51:25.141560+0000","last_unstale":"2023-12-22T08:51:26.132665+0000","last_undegraded":"2023-12-22T08:51:26.132665+0000","last_fullsized":"2023-12-22T08:51:26.132665+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:05:22.379726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.261425+0000","last_change":"2023-12-22T08:51:25.157468+0000","last_active":"2023-12-22T08:51:27.261425+0000","last_peered":"2023-12-22T08:51:27.261425+0000","last_clean":"2023-12-22T08:51:27.261425+0000","last_became_active":"2023-12-22T08:51:25.156920+0000","last_became_peered":"2023-12-22T08:51:25.156920+0000","last_unstale":"2023-12-22T08:51:27.261425+0000","last_undegraded":"2023-12-22T08:51:27.261425+0000","last_fullsized":"2023-12-22T08:51:27.261425+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:31.505338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.261295+0000","last_change":"2023-12-22T08:51:25.152406+0000","last_active":"2023-12-22T08:51:27.261295+0000","last_peered":"2023-12-22T08:51:27.261295+0000","last_clean":"2023-12-22T08:51:27.261295+0000","last_became_active":"2023-12-22T08:51:25.152146+0000","last_became_peered":"2023-12-22T08:51:25.152146+0000","last_unstale":"2023-12-22T08:51:27.261295+0000","last_undegraded":"2023-12-22T08:51:27.261295+0000","last_fullsized":"2023-12-22T08:51:27.261295+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:49:20.887153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258215+0000","last_change":"2023-12-22T08:51:25.154524+0000","last_active":"2023-12-22T08:51:27.258215+0000","last_peered":"2023-12-22T08:51:27.258215+0000","last_clean":"2023-12-22T08:51:27.258215+0000","last_became_active":"2023-12-22T08:51:25.154006+0000","last_became_peered":"2023-12-22T08:51:25.154006+0000","last_unstale":"2023-12-22T08:51:27.258215+0000","last_undegraded":"2023-12-22T08:51:27.258215+0000","last_fullsized":"2023-12-22T08:51:27.258215+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:11.212100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258714+0000","last_change":"2023-12-22T08:51:25.154447+0000","last_active":"2023-12-22T08:51:27.258714+0000","last_peered":"2023-12-22T08:51:27.258714+0000","last_clean":"2023-12-22T08:51:27.258714+0000","last_became_active":"2023-12-22T08:51:25.154181+0000","last_became_peered":"2023-12-22T08:51:25.154181+0000","last_unstale":"2023-12-22T08:51:27.258714+0000","last_undegraded":"2023-12-22T08:51:27.258714+0000","last_fullsized":"2023-12-22T08:51:27.258714+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:50.293804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260733+0000","last_change":"2023-12-22T08:51:25.147668+0000","last_active":"2023-12-22T08:51:27.260733+0000","last_peered":"2023-12-22T08:51:27.260733+0000","last_clean":"2023-12-22T08:51:27.260733+0000","last_became_active":"2023-12-22T08:51:25.145464+0000","last_became_peered":"2023-12-22T08:51:25.145464+0000","last_unstale":"2023-12-22T08:51:27.260733+0000","last_undegraded":"2023-12-22T08:51:27.260733+0000","last_fullsized":"2023-12-22T08:51:27.260733+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:44:24.130512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257715+0000","last_change":"2023-12-22T08:51:25.153718+0000","last_active":"2023-12-22T08:51:27.257715+0000","last_peered":"2023-12-22T08:51:27.257715+0000","last_clean":"2023-12-22T08:51:27.257715+0000","last_became_active":"2023-12-22T08:51:25.153443+0000","last_became_peered":"2023-12-22T08:51:25.153443+0000","last_unstale":"2023-12-22T08:51:27.257715+0000","last_undegraded":"2023-12-22T08:51:27.257715+0000","last_fullsized":"2023-12-22T08:51:27.257715+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:05.039852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257978+0000","last_change":"2023-12-22T08:51:25.155270+0000","last_active":"2023-12-22T08:51:27.257978+0000","last_peered":"2023-12-22T08:51:27.257978+0000","last_clean":"2023-12-22T08:51:27.257978+0000","last_became_active":"2023-12-22T08:51:25.154997+0000","last_became_peered":"2023-12-22T08:51:25.154997+0000","last_unstale":"2023-12-22T08:51:27.257978+0000","last_undegraded":"2023-12-22T08:51:27.257978+0000","last_fullsized":"2023-12-22T08:51:27.257978+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:03:57.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258473+0000","last_change":"2023-12-22T08:51:25.150973+0000","last_active":"2023-12-22T08:51:27.258473+0000","last_peered":"2023-12-22T08:51:27.258473+0000","last_clean":"2023-12-22T08:51:27.258473+0000","last_became_active":"2023-12-22T08:51:25.150721+0000","last_became_peered":"2023-12-22T08:51:25.150721+0000","last_unstale":"2023-12-22T08:51:27.258473+0000","last_undegraded":"2023-12-22T08:51:27.258473+0000","last_fullsized":"2023-12-22T08:51:27.258473+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:08:00.991901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.132802+0000","last_change":"2023-12-22T08:51:25.144198+0000","last_active":"2023-12-22T08:51:26.132802+0000","last_peered":"2023-12-22T08:51:26.132802+0000","last_clean":"2023-12-22T08:51:26.132802+0000","last_became_active":"2023-12-22T08:51:25.143966+0000","last_became_peered":"2023-12-22T08:51:25.143966+0000","last_unstale":"2023-12-22T08:51:26.132802+0000","last_undegraded":"2023-12-22T08:51:26.132802+0000","last_fullsized":"2023-12-22T08:51:26.132802+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:34:49.597153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"172'4","reported_seq":15,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136162+0000","last_change":"2023-12-22T08:51:24.628381+0000","last_active":"2023-12-22T08:51:26.136162+0000","last_peered":"2023-12-22T08:51:26.136162+0000","last_clean":"2023-12-22T08:51:26.136162+0000","last_became_active":"2023-12-22T08:51:24.628019+0000","last_became_peered":"2023-12-22T08:51:24.628019+0000","last_unstale":"2023-12-22T08:51:26.136162+0000","last_undegraded":"2023-12-22T08:51:26.136162+0000","last_fullsized":"2023-12-22T08:51:26.136162+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:44:23.116657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258511+0000","last_change":"2023-12-22T08:51:25.135959+0000","last_active":"2023-12-22T08:51:27.258511+0000","last_peered":"2023-12-22T08:51:27.258511+0000","last_clean":"2023-12-22T08:51:27.258511+0000","last_became_active":"2023-12-22T08:51:25.135441+0000","last_became_peered":"2023-12-22T08:51:25.135441+0000","last_unstale":"2023-12-22T08:51:27.258511+0000","last_undegraded":"2023-12-22T08:51:27.258511+0000","last_fullsized":"2023-12-22T08:51:27.258511+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:21.686274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"172'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258986+0000","last_change":"2023-12-22T08:51:24.629870+0000","last_active":"2023-12-22T08:51:27.258986+0000","last_peered":"2023-12-22T08:51:27.258986+0000","last_clean":"2023-12-22T08:51:27.258986+0000","last_became_active":"2023-12-22T08:51:24.626672+0000","last_became_peered":"2023-12-22T08:51:24.626672+0000","last_unstale":"2023-12-22T08:51:27.258986+0000","last_undegraded":"2023-12-22T08:51:27.258986+0000","last_fullsized":"2023-12-22T08:51:27.258986+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:30.491483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259145+0000","last_change":"2023-12-22T08:51:25.151547+0000","last_active":"2023-12-22T08:51:27.259145+0000","last_peered":"2023-12-22T08:51:27.259145+0000","last_clean":"2023-12-22T08:51:27.259145+0000","last_became_active":"2023-12-22T08:51:25.148655+0000","last_became_peered":"2023-12-22T08:51:25.148655+0000","last_unstale":"2023-12-22T08:51:27.259145+0000","last_undegraded":"2023-12-22T08:51:27.259145+0000","last_fullsized":"2023-12-22T08:51:27.259145+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:11:49.130381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"172'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136475+0000","last_change":"2023-12-22T08:51:24.626910+0000","last_active":"2023-12-22T08:51:26.136475+0000","last_peered":"2023-12-22T08:51:26.136475+0000","last_clean":"2023-12-22T08:51:26.136475+0000","last_became_active":"2023-12-22T08:51:24.623830+0000","last_became_peered":"2023-12-22T08:51:24.623830+0000","last_unstale":"2023-12-22T08:51:26.136475+0000","last_undegraded":"2023-12-22T08:51:26.136475+0000","last_fullsized":"2023-12-22T08:51:26.136475+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:18:40.224607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134468+0000","last_change":"2023-12-22T08:51:25.154616+0000","last_active":"2023-12-22T08:51:26.134468+0000","last_peered":"2023-12-22T08:51:26.134468+0000","last_clean":"2023-12-22T08:51:26.134468+0000","last_became_active":"2023-12-22T08:51:25.154066+0000","last_became_peered":"2023-12-22T08:51:25.154066+0000","last_unstale":"2023-12-22T08:51:26.134468+0000","last_undegraded":"2023-12-22T08:51:26.134468+0000","last_fullsized":"2023-12-22T08:51:26.134468+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:40.481488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"172'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136369+0000","last_change":"2023-12-22T08:51:24.626306+0000","last_active":"2023-12-22T08:51:26.136369+0000","last_peered":"2023-12-22T08:51:26.136369+0000","last_clean":"2023-12-22T08:51:26.136369+0000","last_became_active":"2023-12-22T08:51:24.625997+0000","last_became_peered":"2023-12-22T08:51:24.625997+0000","last_unstale":"2023-12-22T08:51:26.136369+0000","last_undegraded":"2023-12-22T08:51:26.136369+0000","last_fullsized":"2023-12-22T08:51:26.136369+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:34:00.898666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258957+0000","last_change":"2023-12-22T08:51:25.153240+0000","last_active":"2023-12-22T08:51:27.258957+0000","last_peered":"2023-12-22T08:51:27.258957+0000","last_clean":"2023-12-22T08:51:27.258957+0000","last_became_active":"2023-12-22T08:51:25.152989+0000","last_became_peered":"2023-12-22T08:51:25.152989+0000","last_unstale":"2023-12-22T08:51:27.258957+0000","last_undegraded":"2023-12-22T08:51:27.258957+0000","last_fullsized":"2023-12-22T08:51:27.258957+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:05.116308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"172'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260985+0000","last_change":"2023-12-22T08:51:24.631730+0000","last_active":"2023-12-22T08:51:27.260985+0000","last_peered":"2023-12-22T08:51:27.260985+0000","last_clean":"2023-12-22T08:51:27.260985+0000","last_became_active":"2023-12-22T08:51:24.631456+0000","last_became_peered":"2023-12-22T08:51:24.631456+0000","last_unstale":"2023-12-22T08:51:27.260985+0000","last_undegraded":"2023-12-22T08:51:27.260985+0000","last_fullsized":"2023-12-22T08:51:27.260985+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:39.467633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133724+0000","last_change":"2023-12-22T08:51:25.144313+0000","last_active":"2023-12-22T08:51:26.133724+0000","last_peered":"2023-12-22T08:51:26.133724+0000","last_clean":"2023-12-22T08:51:26.133724+0000","last_became_active":"2023-12-22T08:51:25.143916+0000","last_became_peered":"2023-12-22T08:51:25.143916+0000","last_unstale":"2023-12-22T08:51:26.133724+0000","last_undegraded":"2023-12-22T08:51:26.133724+0000","last_fullsized":"2023-12-22T08:51:26.133724+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:54.987846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"172'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133461+0000","last_change":"2023-12-22T08:51:24.634766+0000","last_active":"2023-12-22T08:51:26.133461+0000","last_peered":"2023-12-22T08:51:26.133461+0000","last_clean":"2023-12-22T08:51:26.133461+0000","last_became_active":"2023-12-22T08:51:24.634528+0000","last_became_peered":"2023-12-22T08:51:24.634528+0000","last_unstale":"2023-12-22T08:51:26.133461+0000","last_undegraded":"2023-12-22T08:51:26.133461+0000","last_fullsized":"2023-12-22T08:51:26.133461+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:10:29.876673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.262027+0000","last_change":"2023-12-22T08:51:25.157142+0000","last_active":"2023-12-22T08:51:27.262027+0000","last_peered":"2023-12-22T08:51:27.262027+0000","last_clean":"2023-12-22T08:51:27.262027+0000","last_became_active":"2023-12-22T08:51:25.156278+0000","last_became_peered":"2023-12-22T08:51:25.156278+0000","last_unstale":"2023-12-22T08:51:27.262027+0000","last_undegraded":"2023-12-22T08:51:27.262027+0000","last_fullsized":"2023-12-22T08:51:27.262027+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:36:15.071191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259232+0000","last_change":"2023-12-22T08:51:24.630127+0000","last_active":"2023-12-22T08:51:27.259232+0000","last_peered":"2023-12-22T08:51:27.259232+0000","last_clean":"2023-12-22T08:51:27.259232+0000","last_became_active":"2023-12-22T08:51:24.629439+0000","last_became_peered":"2023-12-22T08:51:24.629439+0000","last_unstale":"2023-12-22T08:51:27.259232+0000","last_undegraded":"2023-12-22T08:51:27.259232+0000","last_fullsized":"2023-12-22T08:51:27.259232+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:57:10.198245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133726+0000","last_change":"2023-12-22T08:51:25.149426+0000","last_active":"2023-12-22T08:51:26.133726+0000","last_peered":"2023-12-22T08:51:26.133726+0000","last_clean":"2023-12-22T08:51:26.133726+0000","last_became_active":"2023-12-22T08:51:25.148986+0000","last_became_peered":"2023-12-22T08:51:25.148986+0000","last_unstale":"2023-12-22T08:51:26.133726+0000","last_undegraded":"2023-12-22T08:51:26.133726+0000","last_fullsized":"2023-12-22T08:51:26.133726+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:05.939199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136561+0000","last_change":"2023-12-22T08:51:24.632943+0000","last_active":"2023-12-22T08:51:26.136561+0000","last_peered":"2023-12-22T08:51:26.136561+0000","last_clean":"2023-12-22T08:51:26.136561+0000","last_became_active":"2023-12-22T08:51:24.632171+0000","last_became_peered":"2023-12-22T08:51:24.632171+0000","last_unstale":"2023-12-22T08:51:26.136561+0000","last_undegraded":"2023-12-22T08:51:26.136561+0000","last_fullsized":"2023-12-22T08:51:26.136561+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:37:36.947764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133847+0000","last_change":"2023-12-22T08:51:25.148919+0000","last_active":"2023-12-22T08:51:26.133847+0000","last_peered":"2023-12-22T08:51:26.133847+0000","last_clean":"2023-12-22T08:51:26.133847+0000","last_became_active":"2023-12-22T08:51:25.146478+0000","last_became_peered":"2023-12-22T08:51:25.146478+0000","last_unstale":"2023-12-22T08:51:26.133847+0000","last_undegraded":"2023-12-22T08:51:26.133847+0000","last_fullsized":"2023-12-22T08:51:26.133847+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:07:11.093866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260202+0000","last_change":"2023-12-22T08:51:24.629889+0000","last_active":"2023-12-22T08:51:27.260202+0000","last_peered":"2023-12-22T08:51:27.260202+0000","last_clean":"2023-12-22T08:51:27.260202+0000","last_became_active":"2023-12-22T08:51:24.627608+0000","last_became_peered":"2023-12-22T08:51:24.627608+0000","last_unstale":"2023-12-22T08:51:27.260202+0000","last_undegraded":"2023-12-22T08:51:27.260202+0000","last_fullsized":"2023-12-22T08:51:27.260202+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:03:56.090601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257684+0000","last_change":"2023-12-22T08:51:25.148806+0000","last_active":"2023-12-22T08:51:27.257684+0000","last_peered":"2023-12-22T08:51:27.257684+0000","last_clean":"2023-12-22T08:51:27.257684+0000","last_became_active":"2023-12-22T08:51:25.148576+0000","last_became_peered":"2023-12-22T08:51:25.148576+0000","last_unstale":"2023-12-22T08:51:27.257684+0000","last_undegraded":"2023-12-22T08:51:27.257684+0000","last_fullsized":"2023-12-22T08:51:27.257684+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:03:57.104456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.132991+0000","last_change":"2023-12-22T08:51:24.630692+0000","last_active":"2023-12-22T08:51:26.132991+0000","last_peered":"2023-12-22T08:51:26.132991+0000","last_clean":"2023-12-22T08:51:26.132991+0000","last_became_active":"2023-12-22T08:51:24.630314+0000","last_became_peered":"2023-12-22T08:51:24.630314+0000","last_unstale":"2023-12-22T08:51:26.132991+0000","last_undegraded":"2023-12-22T08:51:26.132991+0000","last_fullsized":"2023-12-22T08:51:26.132991+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:28:00.357146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258742+0000","last_change":"2023-12-22T08:51:25.154627+0000","last_active":"2023-12-22T08:51:27.258742+0000","last_peered":"2023-12-22T08:51:27.258742+0000","last_clean":"2023-12-22T08:51:27.258742+0000","last_became_active":"2023-12-22T08:51:25.153724+0000","last_became_peered":"2023-12-22T08:51:25.153724+0000","last_unstale":"2023-12-22T08:51:27.258742+0000","last_undegraded":"2023-12-22T08:51:27.258742+0000","last_fullsized":"2023-12-22T08:51:27.258742+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:16.622370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"172'6","reported_seq":17,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259209+0000","last_change":"2023-12-22T08:51:24.626031+0000","last_active":"2023-12-22T08:51:27.259209+0000","last_peered":"2023-12-22T08:51:27.259209+0000","last_clean":"2023-12-22T08:51:27.259209+0000","last_became_active":"2023-12-22T08:51:24.625288+0000","last_became_peered":"2023-12-22T08:51:24.625288+0000","last_unstale":"2023-12-22T08:51:27.259209+0000","last_undegraded":"2023-12-22T08:51:27.259209+0000","last_fullsized":"2023-12-22T08:51:27.259209+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:16.492318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134685+0000","last_change":"2023-12-22T08:51:25.148021+0000","last_active":"2023-12-22T08:51:26.134685+0000","last_peered":"2023-12-22T08:51:26.134685+0000","last_clean":"2023-12-22T08:51:26.134685+0000","last_became_active":"2023-12-22T08:51:25.147706+0000","last_became_peered":"2023-12-22T08:51:25.147706+0000","last_unstale":"2023-12-22T08:51:26.134685+0000","last_undegraded":"2023-12-22T08:51:26.134685+0000","last_fullsized":"2023-12-22T08:51:26.134685+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:19:15.464504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"172'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.136651+0000","last_change":"2023-12-22T08:51:24.631821+0000","last_active":"2023-12-22T08:51:26.136651+0000","last_peered":"2023-12-22T08:51:26.136651+0000","last_clean":"2023-12-22T08:51:26.136651+0000","last_became_active":"2023-12-22T08:51:24.626626+0000","last_became_peered":"2023-12-22T08:51:24.626626+0000","last_unstale":"2023-12-22T08:51:26.136651+0000","last_undegraded":"2023-12-22T08:51:26.136651+0000","last_fullsized":"2023-12-22T08:51:26.136651+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:24.252458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259859+0000","last_change":"2023-12-22T08:51:25.149955+0000","last_active":"2023-12-22T08:51:27.259859+0000","last_peered":"2023-12-22T08:51:27.259859+0000","last_clean":"2023-12-22T08:51:27.259859+0000","last_became_active":"2023-12-22T08:51:25.149625+0000","last_became_peered":"2023-12-22T08:51:25.149625+0000","last_unstale":"2023-12-22T08:51:27.259859+0000","last_undegraded":"2023-12-22T08:51:27.259859+0000","last_fullsized":"2023-12-22T08:51:27.259859+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:34:01.912521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257920+0000","last_change":"2023-12-22T08:51:24.614483+0000","last_active":"2023-12-22T08:51:27.257920+0000","last_peered":"2023-12-22T08:51:27.257920+0000","last_clean":"2023-12-22T08:51:27.257920+0000","last_became_active":"2023-12-22T08:51:24.613774+0000","last_became_peered":"2023-12-22T08:51:24.613774+0000","last_unstale":"2023-12-22T08:51:27.257920+0000","last_undegraded":"2023-12-22T08:51:27.257920+0000","last_fullsized":"2023-12-22T08:51:27.257920+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:18:40.509951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134128+0000","last_change":"2023-12-22T08:51:25.155950+0000","last_active":"2023-12-22T08:51:26.134128+0000","last_peered":"2023-12-22T08:51:26.134128+0000","last_clean":"2023-12-22T08:51:26.134128+0000","last_became_active":"2023-12-22T08:51:25.154570+0000","last_became_peered":"2023-12-22T08:51:25.154570+0000","last_unstale":"2023-12-22T08:51:26.134128+0000","last_undegraded":"2023-12-22T08:51:26.134128+0000","last_fullsized":"2023-12-22T08:51:26.134128+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:17:48.079004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258694+0000","last_change":"2023-12-22T08:51:24.632996+0000","last_active":"2023-12-22T08:51:27.258694+0000","last_peered":"2023-12-22T08:51:27.258694+0000","last_clean":"2023-12-22T08:51:27.258694+0000","last_became_active":"2023-12-22T08:51:24.632729+0000","last_became_peered":"2023-12-22T08:51:24.632729+0000","last_unstale":"2023-12-22T08:51:27.258694+0000","last_undegraded":"2023-12-22T08:51:27.258694+0000","last_fullsized":"2023-12-22T08:51:27.258694+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:11:05.770465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133963+0000","last_change":"2023-12-22T08:51:25.148580+0000","last_active":"2023-12-22T08:51:26.133963+0000","last_peered":"2023-12-22T08:51:26.133963+0000","last_clean":"2023-12-22T08:51:26.133963+0000","last_became_active":"2023-12-22T08:51:25.144847+0000","last_became_peered":"2023-12-22T08:51:25.144847+0000","last_unstale":"2023-12-22T08:51:26.133963+0000","last_undegraded":"2023-12-22T08:51:26.133963+0000","last_fullsized":"2023-12-22T08:51:26.133963+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:38.613584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"172'8","reported_seq":19,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258530+0000","last_change":"2023-12-22T08:51:24.633162+0000","last_active":"2023-12-22T08:51:27.258530+0000","last_peered":"2023-12-22T08:51:27.258530+0000","last_clean":"2023-12-22T08:51:27.258530+0000","last_became_active":"2023-12-22T08:51:24.630593+0000","last_became_peered":"2023-12-22T08:51:24.630593+0000","last_unstale":"2023-12-22T08:51:27.258530+0000","last_undegraded":"2023-12-22T08:51:27.258530+0000","last_fullsized":"2023-12-22T08:51:27.258530+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:36:18.983418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133106+0000","last_change":"2023-12-22T08:51:25.149991+0000","last_active":"2023-12-22T08:51:26.133106+0000","last_peered":"2023-12-22T08:51:26.133106+0000","last_clean":"2023-12-22T08:51:26.133106+0000","last_became_active":"2023-12-22T08:51:25.149743+0000","last_became_peered":"2023-12-22T08:51:25.149743+0000","last_unstale":"2023-12-22T08:51:26.133106+0000","last_undegraded":"2023-12-22T08:51:26.133106+0000","last_fullsized":"2023-12-22T08:51:26.133106+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:04.340297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"172'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133959+0000","last_change":"2023-12-22T08:51:24.631087+0000","last_active":"2023-12-22T08:51:26.133959+0000","last_peered":"2023-12-22T08:51:26.133959+0000","last_clean":"2023-12-22T08:51:26.133959+0000","last_became_active":"2023-12-22T08:51:24.629140+0000","last_became_peered":"2023-12-22T08:51:24.629140+0000","last_unstale":"2023-12-22T08:51:26.133959+0000","last_undegraded":"2023-12-22T08:51:26.133959+0000","last_fullsized":"2023-12-22T08:51:26.133959+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:16.492318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257663+0000","last_change":"2023-12-22T08:51:25.152564+0000","last_active":"2023-12-22T08:51:27.257663+0000","last_peered":"2023-12-22T08:51:27.257663+0000","last_clean":"2023-12-22T08:51:27.257663+0000","last_became_active":"2023-12-22T08:51:25.152326+0000","last_became_peered":"2023-12-22T08:51:25.152326+0000","last_unstale":"2023-12-22T08:51:27.257663+0000","last_undegraded":"2023-12-22T08:51:27.257663+0000","last_fullsized":"2023-12-22T08:51:27.257663+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:17:05.789079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"172'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260495+0000","last_change":"2023-12-22T08:51:24.630259+0000","last_active":"2023-12-22T08:51:27.260495+0000","last_peered":"2023-12-22T08:51:27.260495+0000","last_clean":"2023-12-22T08:51:27.260495+0000","last_became_active":"2023-12-22T08:51:24.625859+0000","last_became_peered":"2023-12-22T08:51:24.625859+0000","last_unstale":"2023-12-22T08:51:27.260495+0000","last_undegraded":"2023-12-22T08:51:27.260495+0000","last_fullsized":"2023-12-22T08:51:27.260495+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:17:47.065149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.132588+0000","last_change":"2023-12-22T08:51:25.148262+0000","last_active":"2023-12-22T08:51:26.132588+0000","last_peered":"2023-12-22T08:51:26.132588+0000","last_clean":"2023-12-22T08:51:26.132588+0000","last_became_active":"2023-12-22T08:51:25.148028+0000","last_became_peered":"2023-12-22T08:51:25.148028+0000","last_unstale":"2023-12-22T08:51:26.132588+0000","last_undegraded":"2023-12-22T08:51:26.132588+0000","last_fullsized":"2023-12-22T08:51:26.132588+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:04:31.379449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"172'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260498+0000","last_change":"2023-12-22T08:51:24.634028+0000","last_active":"2023-12-22T08:51:27.260498+0000","last_peered":"2023-12-22T08:51:27.260498+0000","last_clean":"2023-12-22T08:51:27.260498+0000","last_became_active":"2023-12-22T08:51:24.633037+0000","last_became_peered":"2023-12-22T08:51:24.633037+0000","last_unstale":"2023-12-22T08:51:27.260498+0000","last_undegraded":"2023-12-22T08:51:27.260498+0000","last_fullsized":"2023-12-22T08:51:27.260498+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:04.025997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259408+0000","last_change":"2023-12-22T08:51:25.149282+0000","last_active":"2023-12-22T08:51:27.259408+0000","last_peered":"2023-12-22T08:51:27.259408+0000","last_clean":"2023-12-22T08:51:27.259408+0000","last_became_active":"2023-12-22T08:51:25.147959+0000","last_became_peered":"2023-12-22T08:51:25.147959+0000","last_unstale":"2023-12-22T08:51:27.259408+0000","last_undegraded":"2023-12-22T08:51:27.259408+0000","last_fullsized":"2023-12-22T08:51:27.259408+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:48:39.917953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258916+0000","last_change":"2023-12-22T08:51:24.632454+0000","last_active":"2023-12-22T08:51:27.258916+0000","last_peered":"2023-12-22T08:51:27.258916+0000","last_clean":"2023-12-22T08:51:27.258916+0000","last_became_active":"2023-12-22T08:51:24.631944+0000","last_became_peered":"2023-12-22T08:51:24.631944+0000","last_unstale":"2023-12-22T08:51:27.258916+0000","last_undegraded":"2023-12-22T08:51:27.258916+0000","last_fullsized":"2023-12-22T08:51:27.258916+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:16:52.121762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257585+0000","last_change":"2023-12-22T08:51:25.137406+0000","last_active":"2023-12-22T08:51:27.257585+0000","last_peered":"2023-12-22T08:51:27.257585+0000","last_clean":"2023-12-22T08:51:27.257585+0000","last_became_active":"2023-12-22T08:51:25.137007+0000","last_became_peered":"2023-12-22T08:51:25.137007+0000","last_unstale":"2023-12-22T08:51:27.257585+0000","last_undegraded":"2023-12-22T08:51:27.257585+0000","last_fullsized":"2023-12-22T08:51:27.257585+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:16:17.506173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"172'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.261929+0000","last_change":"2023-12-22T08:51:24.631566+0000","last_active":"2023-12-22T08:51:27.261929+0000","last_peered":"2023-12-22T08:51:27.261929+0000","last_clean":"2023-12-22T08:51:27.261929+0000","last_became_active":"2023-12-22T08:51:24.631251+0000","last_became_peered":"2023-12-22T08:51:24.631251+0000","last_unstale":"2023-12-22T08:51:27.261929+0000","last_undegraded":"2023-12-22T08:51:27.261929+0000","last_fullsized":"2023-12-22T08:51:27.261929+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:05:05.722445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259228+0000","last_change":"2023-12-22T08:51:25.156045+0000","last_active":"2023-12-22T08:51:27.259228+0000","last_peered":"2023-12-22T08:51:27.259228+0000","last_clean":"2023-12-22T08:51:27.259228+0000","last_became_active":"2023-12-22T08:51:25.155642+0000","last_became_peered":"2023-12-22T08:51:25.155642+0000","last_unstale":"2023-12-22T08:51:27.259228+0000","last_undegraded":"2023-12-22T08:51:27.259228+0000","last_fullsized":"2023-12-22T08:51:27.259228+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:24.550061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134089+0000","last_change":"2023-12-22T08:51:24.631388+0000","last_active":"2023-12-22T08:51:26.134089+0000","last_peered":"2023-12-22T08:51:26.134089+0000","last_clean":"2023-12-22T08:51:26.134089+0000","last_became_active":"2023-12-22T08:51:24.629698+0000","last_became_peered":"2023-12-22T08:51:24.629698+0000","last_unstale":"2023-12-22T08:51:26.134089+0000","last_undegraded":"2023-12-22T08:51:26.134089+0000","last_fullsized":"2023-12-22T08:51:26.134089+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:58:58.230890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257810+0000","last_change":"2023-12-22T08:51:25.146673+0000","last_active":"2023-12-22T08:51:27.257810+0000","last_peered":"2023-12-22T08:51:27.257810+0000","last_clean":"2023-12-22T08:51:27.257810+0000","last_became_active":"2023-12-22T08:51:25.146072+0000","last_became_peered":"2023-12-22T08:51:25.146072+0000","last_unstale":"2023-12-22T08:51:27.257810+0000","last_undegraded":"2023-12-22T08:51:27.257810+0000","last_fullsized":"2023-12-22T08:51:27.257810+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:08.279843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134663+0000","last_change":"2023-12-22T08:51:24.628990+0000","last_active":"2023-12-22T08:51:26.134663+0000","last_peered":"2023-12-22T08:51:26.134663+0000","last_clean":"2023-12-22T08:51:26.134663+0000","last_became_active":"2023-12-22T08:51:24.628584+0000","last_became_peered":"2023-12-22T08:51:24.628584+0000","last_unstale":"2023-12-22T08:51:26.134663+0000","last_undegraded":"2023-12-22T08:51:26.134663+0000","last_fullsized":"2023-12-22T08:51:26.134663+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:04.025997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.262287+0000","last_change":"2023-12-22T08:51:25.157321+0000","last_active":"2023-12-22T08:51:27.262287+0000","last_peered":"2023-12-22T08:51:27.262287+0000","last_clean":"2023-12-22T08:51:27.262287+0000","last_became_active":"2023-12-22T08:51:25.156617+0000","last_became_peered":"2023-12-22T08:51:25.156617+0000","last_unstale":"2023-12-22T08:51:27.262287+0000","last_undegraded":"2023-12-22T08:51:27.262287+0000","last_fullsized":"2023-12-22T08:51:27.262287+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:31:00.697159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134898+0000","last_change":"2023-12-22T08:51:24.631068+0000","last_active":"2023-12-22T08:51:26.134898+0000","last_peered":"2023-12-22T08:51:26.134898+0000","last_clean":"2023-12-22T08:51:26.134898+0000","last_became_active":"2023-12-22T08:51:24.630067+0000","last_became_peered":"2023-12-22T08:51:24.630067+0000","last_unstale":"2023-12-22T08:51:26.134898+0000","last_undegraded":"2023-12-22T08:51:26.134898+0000","last_fullsized":"2023-12-22T08:51:26.134898+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:30.491483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133912+0000","last_change":"2023-12-22T08:51:25.156142+0000","last_active":"2023-12-22T08:51:26.133912+0000","last_peered":"2023-12-22T08:51:26.133912+0000","last_clean":"2023-12-22T08:51:26.133912+0000","last_became_active":"2023-12-22T08:51:25.155061+0000","last_became_peered":"2023-12-22T08:51:25.155061+0000","last_unstale":"2023-12-22T08:51:26.133912+0000","last_undegraded":"2023-12-22T08:51:26.133912+0000","last_fullsized":"2023-12-22T08:51:26.133912+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:36:19.997273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"172'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134708+0000","last_change":"2023-12-22T08:51:24.631288+0000","last_active":"2023-12-22T08:51:26.134708+0000","last_peered":"2023-12-22T08:51:26.134708+0000","last_clean":"2023-12-22T08:51:26.134708+0000","last_became_active":"2023-12-22T08:51:24.631029+0000","last_became_peered":"2023-12-22T08:51:24.631029+0000","last_unstale":"2023-12-22T08:51:26.134708+0000","last_undegraded":"2023-12-22T08:51:26.134708+0000","last_fullsized":"2023-12-22T08:51:26.134708+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:07.265988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134265+0000","last_change":"2023-12-22T08:51:25.144184+0000","last_active":"2023-12-22T08:51:26.134265+0000","last_peered":"2023-12-22T08:51:26.134265+0000","last_clean":"2023-12-22T08:51:26.134265+0000","last_became_active":"2023-12-22T08:51:25.143606+0000","last_became_peered":"2023-12-22T08:51:25.143606+0000","last_unstale":"2023-12-22T08:51:26.134265+0000","last_undegraded":"2023-12-22T08:51:26.134265+0000","last_fullsized":"2023-12-22T08:51:26.134265+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:17.811614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259447+0000","last_change":"2023-12-22T08:51:24.629702+0000","last_active":"2023-12-22T08:51:27.259447+0000","last_peered":"2023-12-22T08:51:27.259447+0000","last_clean":"2023-12-22T08:51:27.259447+0000","last_became_active":"2023-12-22T08:51:24.627686+0000","last_became_peered":"2023-12-22T08:51:24.627686+0000","last_unstale":"2023-12-22T08:51:27.259447+0000","last_undegraded":"2023-12-22T08:51:27.259447+0000","last_fullsized":"2023-12-22T08:51:27.259447+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:07:38.295970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260110+0000","last_change":"2023-12-22T08:51:25.158268+0000","last_active":"2023-12-22T08:51:27.260110+0000","last_peered":"2023-12-22T08:51:27.260110+0000","last_clean":"2023-12-22T08:51:27.260110+0000","last_became_active":"2023-12-22T08:51:25.157650+0000","last_became_peered":"2023-12-22T08:51:25.157650+0000","last_unstale":"2023-12-22T08:51:27.260110+0000","last_undegraded":"2023-12-22T08:51:27.260110+0000","last_fullsized":"2023-12-22T08:51:27.260110+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:02:27.221373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259605+0000","last_change":"2023-12-22T08:51:24.625772+0000","last_active":"2023-12-22T08:51:27.259605+0000","last_peered":"2023-12-22T08:51:27.259605+0000","last_clean":"2023-12-22T08:51:27.259605+0000","last_became_active":"2023-12-22T08:51:24.624346+0000","last_became_peered":"2023-12-22T08:51:24.624346+0000","last_unstale":"2023-12-22T08:51:27.259605+0000","last_undegraded":"2023-12-22T08:51:27.259605+0000","last_fullsized":"2023-12-22T08:51:27.259605+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:43:30.491483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260975+0000","last_change":"2023-12-22T08:51:25.148039+0000","last_active":"2023-12-22T08:51:27.260975+0000","last_peered":"2023-12-22T08:51:27.260975+0000","last_clean":"2023-12-22T08:51:27.260975+0000","last_became_active":"2023-12-22T08:51:25.146404+0000","last_became_peered":"2023-12-22T08:51:25.146404+0000","last_unstale":"2023-12-22T08:51:27.260975+0000","last_undegraded":"2023-12-22T08:51:27.260975+0000","last_fullsized":"2023-12-22T08:51:27.260975+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:37:37.961619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260041+0000","last_change":"2023-12-22T08:51:24.628325+0000","last_active":"2023-12-22T08:51:27.260041+0000","last_peered":"2023-12-22T08:51:27.260041+0000","last_clean":"2023-12-22T08:51:27.260041+0000","last_became_active":"2023-12-22T08:51:24.627960+0000","last_became_peered":"2023-12-22T08:51:24.627960+0000","last_unstale":"2023-12-22T08:51:27.260041+0000","last_undegraded":"2023-12-22T08:51:27.260041+0000","last_fullsized":"2023-12-22T08:51:27.260041+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:20:07.265988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.260148+0000","last_change":"2023-12-22T08:51:25.152725+0000","last_active":"2023-12-22T08:51:27.260148+0000","last_peered":"2023-12-22T08:51:27.260148+0000","last_clean":"2023-12-22T08:51:27.260148+0000","last_became_active":"2023-12-22T08:51:25.150440+0000","last_became_peered":"2023-12-22T08:51:25.150440+0000","last_unstale":"2023-12-22T08:51:27.260148+0000","last_undegraded":"2023-12-22T08:51:27.260148+0000","last_fullsized":"2023-12-22T08:51:27.260148+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:42:51.621693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.258234+0000","last_change":"2023-12-22T08:51:24.630464+0000","last_active":"2023-12-22T08:51:27.258234+0000","last_peered":"2023-12-22T08:51:27.258234+0000","last_clean":"2023-12-22T08:51:27.258234+0000","last_became_active":"2023-12-22T08:51:24.629151+0000","last_became_peered":"2023-12-22T08:51:24.629151+0000","last_unstale":"2023-12-22T08:51:27.258234+0000","last_undegraded":"2023-12-22T08:51:27.258234+0000","last_fullsized":"2023-12-22T08:51:27.258234+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:20:10.198739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.134804+0000","last_change":"2023-12-22T08:51:25.153531+0000","last_active":"2023-12-22T08:51:26.134804+0000","last_peered":"2023-12-22T08:51:26.134804+0000","last_clean":"2023-12-22T08:51:26.134804+0000","last_became_active":"2023-12-22T08:51:25.152448+0000","last_became_peered":"2023-12-22T08:51:25.152448+0000","last_unstale":"2023-12-22T08:51:26.134804+0000","last_undegraded":"2023-12-22T08:51:26.134804+0000","last_fullsized":"2023-12-22T08:51:26.134804+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:32:37.291802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.135967+0000","last_change":"2023-12-22T08:51:24.633573+0000","last_active":"2023-12-22T08:51:26.135967+0000","last_peered":"2023-12-22T08:51:26.135967+0000","last_clean":"2023-12-22T08:51:26.135967+0000","last_became_active":"2023-12-22T08:51:24.633243+0000","last_became_peered":"2023-12-22T08:51:24.633243+0000","last_unstale":"2023-12-22T08:51:26.135967+0000","last_undegraded":"2023-12-22T08:51:26.135967+0000","last_fullsized":"2023-12-22T08:51:26.135967+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:02:26.207519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.133847+0000","last_change":"2023-12-22T08:51:25.146789+0000","last_active":"2023-12-22T08:51:26.133847+0000","last_peered":"2023-12-22T08:51:26.133847+0000","last_clean":"2023-12-22T08:51:26.133847+0000","last_became_active":"2023-12-22T08:51:25.146379+0000","last_became_peered":"2023-12-22T08:51:25.146379+0000","last_unstale":"2023-12-22T08:51:26.133847+0000","last_undegraded":"2023-12-22T08:51:26.133847+0000","last_fullsized":"2023-12-22T08:51:26.133847+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:53.912298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.257158+0000","last_change":"2023-12-22T08:51:24.619772+0000","last_active":"2023-12-22T08:51:27.257158+0000","last_peered":"2023-12-22T08:51:27.257158+0000","last_clean":"2023-12-22T08:51:27.257158+0000","last_became_active":"2023-12-22T08:51:24.618745+0000","last_became_peered":"2023-12-22T08:51:24.618745+0000","last_unstale":"2023-12-22T08:51:27.257158+0000","last_undegraded":"2023-12-22T08:51:27.257158+0000","last_fullsized":"2023-12-22T08:51:27.257158+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:57:44.252052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:26.135669+0000","last_change":"2023-12-22T08:51:25.129101+0000","last_active":"2023-12-22T08:51:26.135669+0000","last_peered":"2023-12-22T08:51:26.135669+0000","last_clean":"2023-12-22T08:51:26.135669+0000","last_became_active":"2023-12-22T08:51:25.128841+0000","last_became_peered":"2023-12-22T08:51:25.128841+0000","last_unstale":"2023-12-22T08:51:26.135669+0000","last_undegraded":"2023-12-22T08:51:26.135669+0000","last_fullsized":"2023-12-22T08:51:26.135669+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:55:29.761988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259451+0000","last_change":"2023-12-22T08:51:24.624965+0000","last_active":"2023-12-22T08:51:27.259451+0000","last_peered":"2023-12-22T08:51:27.259451+0000","last_clean":"2023-12-22T08:51:27.259451+0000","last_became_active":"2023-12-22T08:51:24.623983+0000","last_became_peered":"2023-12-22T08:51:24.623983+0000","last_unstale":"2023-12-22T08:51:27.259451+0000","last_undegraded":"2023-12-22T08:51:27.259451+0000","last_fullsized":"2023-12-22T08:51:27.259451+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:44:23.536206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.259852+0000","last_change":"2023-12-22T08:51:25.132265+0000","last_active":"2023-12-22T08:51:27.259852+0000","last_peered":"2023-12-22T08:51:27.259852+0000","last_clean":"2023-12-22T08:51:27.259852+0000","last_became_active":"2023-12-22T08:51:25.131588+0000","last_became_peered":"2023-12-22T08:51:25.131588+0000","last_unstale":"2023-12-22T08:51:27.259852+0000","last_undegraded":"2023-12-22T08:51:27.259852+0000","last_fullsized":"2023-12-22T08:51:27.259852+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:24.596475+0000","last_clean_scrub_stamp":"2023-12-22T08:51:24.596475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:26:23.903003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"172'3","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-12-22T08:51:27.256979+0000","last_change":"2023-12-22T08:51:24.619390+0000","last_active":"2023-12-22T08:51:27.256979+0000","last_peered":"2023-12-22T08:51:27.256979+0000","last_clean":"2023-12-22T08:51:27.256979+0000","last_became_active":"2023-12-22T08:51:24.617911+0000","last_became_peered":"2023-12-22T08:51:24.617911+0000","last_unstale":"2023-12-22T08:51:27.256979+0000","last_undegraded":"2023-12-22T08:51:27.256979+0000","last_fullsized":"2023-12-22T08:51:27.256979+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:51:23.582620+0000","last_clean_scrub_stamp":"2023-12-22T08:51:23.582620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:03.326442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":302,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-12-22T08:51:25.131232+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:51:25.131232+0000","last_peered":"2023-12-22T08:51:25.131232+0000","last_clean":"2023-12-22T08:51:25.131232+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:51:25.131232+0000","last_undegraded":"2023-12-22T08:51:25.131232+0000","last_fullsized":"2023-12-22T08:51:25.131232+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":946,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194366,"statfs":{"total":200000000,"available":199031263,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.0920000000000001,"15min":1.0860000000000001},"min":{"1min":0.79000000000000004,"5min":0.67500000000000004,"15min":0.58199999999999996},"max":{"1min":1.5880000000000001,"5min":1.8700000000000001,"15min":2.0249999999999999},"last":1.052},{"interface":"front","average":{"1min":1.101,"5min":1.0800000000000001,"15min":1.085},"min":{"1min":0.71299999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6499999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.81000000000000005}]},{"osd":1,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2210000000000001,"15min":1.1930000000000001},"min":{"1min":0.747,"5min":0.70899999999999996,"15min":0.64200000000000002},"max":{"1min":1.554,"5min":1.6839999999999999,"15min":1.905},"last":1.177},{"interface":"front","average":{"1min":1.23,"5min":1.2529999999999999,"15min":1.2070000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.67100000000000004},"max":{"1min":1.506,"5min":1.7709999999999999,"15min":1.865},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1950000000000001,"15min":1.127},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.7150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":1.083},{"interface":"front","average":{"1min":1.26,"5min":1.2310000000000001,"15min":1.2250000000000001},"min":{"1min":0.94299999999999995,"5min":0.79900000000000004,"15min":0.68700000000000006},"max":{"1min":1.6870000000000001,"5min":1.79,"15min":2.1379999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.248,"15min":1.1739999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.71399999999999997},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":2.0680000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3280000000000001,"15min":1.3069999999999999},"min":{"1min":0.78000000000000003,"5min":0.77700000000000002,"15min":0.71799999999999997},"max":{"1min":1.778,"5min":1.873,"15min":2.2959999999999998},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.21,"15min":1.1970000000000001},"min":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.48699999999999999},"max":{"1min":1.7430000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.3109999999999999,"15min":1.272},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.899,"5min":2.0840000000000001,"15min":2.2749999999999999},"last":1.476}]},{"osd":5,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3819999999999999,"15min":1.3720000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.51800000000000002},"max":{"1min":1.6879999999999999,"5min":1.9530000000000001,"15min":2.4300000000000002},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3560000000000001,"15min":1.3660000000000001},"min":{"1min":0.627,"5min":0.623,"15min":0.623},"max":{"1min":1.887,"5min":2.2480000000000002,"15min":2.3410000000000002},"last":1.016}]},{"osd":6,"last update":"Fri Dec 22 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.522,"15min":1.5},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9199999999999999,"5min":2.355,"15min":2.355},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.512,"15min":1.4870000000000001},"min":{"1min":0.69999999999999996,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.879,"5min":2.1379999999999999,"15min":2.4849999999999999},"last":1.673}]}]},{"osd":6,"up_from":13,"seq":55834574990,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":946,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194366,"statfs":{"total":200000000,"available":199031263,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.4019999999999999,"15min":1.2250000000000001},"min":{"1min":0.83199999999999996,"5min":0.61499999999999999,"15min":0.42099999999999999},"max":{"1min":1.534,"5min":28.361000000000001,"15min":28.361000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.2110000000000001,"15min":1.143},"min":{"1min":1.0860000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.675,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":1.016}]},{"osd":1,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.0920000000000001,"15min":1.0740000000000001},"min":{"1min":0.86399999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.377,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.135},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3720000000000001,"15min":1.244},"min":{"1min":0.84599999999999997,"5min":0.69699999999999995,"15min":0.63100000000000001},"max":{"1min":1.556,"5min":15.324999999999999,"15min":15.324999999999999},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.361,"15min":1.2989999999999999},"min":{"1min":0.97299999999999998,"5min":0.69699999999999995,"15min":0.65700000000000003},"max":{"1min":1.464,"5min":15.422000000000001,"15min":15.422000000000001},"last":1.206},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3540000000000001,"15min":1.236},"min":{"1min":0.94199999999999995,"5min":0.748,"15min":0.58599999999999997},"max":{"1min":1.53,"5min":10.173999999999999,"15min":10.173999999999999},"last":0.90500000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.401,"15min":1.3340000000000001},"min":{"1min":1.0589999999999999,"5min":0.79200000000000004,"15min":0.72899999999999998},"max":{"1min":1.587,"5min":10.096,"15min":10.096},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.264,"15min":1.2490000000000001},"min":{"1min":0.90900000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.627,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.2470000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.427,"15min":1.3899999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.52000000000000002},"max":{"1min":1.623,"5min":15.378,"15min":15.378},"last":1.327},{"interface":"front","average":{"1min":1.296,"5min":1.484,"15min":1.421},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.68999999999999995},"max":{"1min":1.673,"5min":13.178000000000001,"15min":13.178000000000001},"last":1.1819999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.4630000000000001,"15min":1.3819999999999999},"min":{"1min":0.93400000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.603,"5min":19.995000000000001,"15min":19.995000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.587,"15min":1.5640000000000001},"min":{"1min":1.1830000000000001,"5min":1.0369999999999999,"15min":0.67600000000000005},"max":{"1min":1.714,"5min":15.679,"15min":15.679},"last":1.585}]},{"osd":7,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.4910000000000001,"15min":1.5349999999999999},"min":{"1min":1.163,"5min":0.93300000000000005,"15min":0.77200000000000002},"max":{"1min":1.845,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4730000000000001,"15min":1.5},"min":{"1min":1.0700000000000001,"5min":0.89200000000000002,"15min":0.79900000000000004},"max":{"1min":1.8700000000000001,"5min":4.6609999999999996,"15min":4.6609999999999996},"last":1.7070000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1523,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193789,"statfs":{"total":200000000,"available":198440156,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0609999999999999,"15min":1.081},"min":{"1min":0.77300000000000002,"5min":0.69299999999999995,"15min":0.65300000000000002},"max":{"1min":1.5429999999999999,"5min":1.706,"15min":1.944},"last":1.256},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.125,"15min":1.123},"min":{"1min":0.74199999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.4119999999999999,"5min":1.7629999999999999,"15min":3.1379999999999999},"last":1.01}]},{"osd":1,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1870000000000001,"15min":1.137},"min":{"1min":0.77300000000000002,"5min":0.73399999999999999,"15min":0.63600000000000001},"max":{"1min":1.4730000000000001,"5min":2.3319999999999999,"15min":2.79},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.204,"5min":1.137,"15min":1.0800000000000001},"min":{"1min":0.93400000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.704,"5min":1.704,"15min":1.7509999999999999},"last":1.175}]},{"osd":2,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1779999999999999,"15min":1.1519999999999999},"min":{"1min":0.77100000000000002,"5min":0.76100000000000001,"15min":0.73899999999999999},"max":{"1min":1.5840000000000001,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.28,"15min":1.2190000000000001},"min":{"1min":1.1160000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.6200000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":0.85799999999999998}]},{"osd":3,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.258,"15min":1.2150000000000001},"min":{"1min":0.84799999999999998,"5min":0.80200000000000005,"15min":0.72799999999999998},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.306,"15min":1.2729999999999999},"min":{"1min":1.0920000000000001,"5min":0.77200000000000002,"15min":0.73299999999999998},"max":{"1min":1.6439999999999999,"5min":1.6990000000000001,"15min":2.1499999999999999},"last":1.4990000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.2589999999999999,"15min":1.256},"min":{"1min":0.80200000000000005,"5min":0.60699999999999998,"15min":0.57899999999999996},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.853},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.278,"15min":1.264},"min":{"1min":0.98899999999999999,"5min":0.69999999999999996,"15min":0.58399999999999996},"max":{"1min":1.764,"5min":1.768,"15min":1.768},"last":1.323}]},{"osd":6,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.3400000000000001,"15min":1.3260000000000001},"min":{"1min":1.2470000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.605,"5min":1.7350000000000001,"15min":1.821},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.415,"15min":1.4159999999999999},"min":{"1min":1.0860000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.732,"5min":1.7789999999999999,"15min":2.8780000000000001},"last":1.411}]},{"osd":7,"last update":"Fri Dec 22 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.4059999999999999,"15min":1.3959999999999999},"min":{"1min":1.1879999999999999,"5min":0.84299999999999997,"15min":0.72499999999999998},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":2.2189999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.454,"15min":1.5109999999999999},"min":{"1min":1.3160000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.694,"5min":1.8500000000000001,"15min":4.7249999999999996},"last":1.696}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":948,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194364,"statfs":{"total":200000000,"available":199029095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.129,"15min":1.052},"min":{"1min":0.76800000000000002,"5min":0.67100000000000004,"15min":0.64000000000000001},"max":{"1min":1.6160000000000001,"5min":6.4969999999999999,"15min":6.4969999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.141,"5min":1.109,"15min":1.1160000000000001},"min":{"1min":0.80200000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.542,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":1.2989999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1639999999999999,"15min":1.101},"min":{"1min":0.89500000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.476,"5min":6.2999999999999998,"15min":6.2999999999999998},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.3160000000000001,"15min":1.179},"min":{"1min":0.90500000000000003,"5min":0.66900000000000004,"15min":0.57399999999999995},"max":{"1min":1.3899999999999999,"5min":17.562999999999999,"15min":17.562999999999999},"last":1.2030000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2470000000000001,"15min":1.1879999999999999},"min":{"1min":0.89000000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3220000000000001,"5min":9.0329999999999995,"15min":9.0329999999999995},"last":1.155},{"interface":"front","average":{"1min":1.212,"5min":1.306,"15min":1.246},"min":{"1min":0.83599999999999997,"5min":0.748,"15min":0.748},"max":{"1min":1.5529999999999999,"5min":8.2029999999999994,"15min":8.2029999999999994},"last":1.3380000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3400000000000001,"15min":1.25},"min":{"1min":1.0069999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6100000000000001,"5min":8.8160000000000007,"15min":8.8160000000000007},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3859999999999999,"15min":1.294},"min":{"1min":0.877,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.651,"5min":10.157999999999999,"15min":10.157999999999999},"last":1.2470000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.26,"15min":1.1919999999999999},"min":{"1min":0.79600000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5609999999999999,"5min":7.056,"15min":7.056},"last":1.022},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.4910000000000001,"15min":1.4299999999999999},"min":{"1min":0.91900000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.637,"5min":9.0700000000000003,"15min":9.0700000000000003},"last":1.5600000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.381,"15min":1.3069999999999999},"min":{"1min":0.88100000000000001,"5min":0.62,"15min":0.58599999999999997},"max":{"1min":1.482,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3600000000000001,"15min":1.2809999999999999},"min":{"1min":0.91400000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6679999999999999,"5min":5.2089999999999996,"15min":5.2089999999999996},"last":1.45}]},{"osd":7,"last update":"Fri Dec 22 08:51:05 2023","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.494,"15min":1.417},"min":{"1min":0.97899999999999998,"5min":0.70199999999999996,"15min":0.67300000000000004},"max":{"1min":1.772,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.5760000000000001,"15min":1.498},"min":{"1min":0.91600000000000004,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.714,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.53}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":946,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194365,"statfs":{"total":200000000,"available":199030647,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90500000000000003,"15min":0.92200000000000004},"min":{"1min":0.66800000000000004,"5min":0.48499999999999999,"15min":0.39800000000000002},"max":{"1min":1.2410000000000001,"5min":1.4770000000000001,"15min":1.8340000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.94399999999999995,"15min":0.94099999999999995},"min":{"1min":0.68000000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.413,"5min":1.5369999999999999,"15min":2.5270000000000001},"last":1.012}]},{"osd":1,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.95699999999999996,"15min":0.90100000000000002},"min":{"1min":0.76600000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.361,"5min":1.772,"15min":1.772},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.2010000000000001,"15min":1.167},"min":{"1min":0.73399999999999999,"5min":0.51100000000000001,"15min":0.46200000000000002},"max":{"1min":1.6040000000000001,"5min":1.7749999999999999,"15min":1.861},"last":1.423}]},{"osd":2,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.083,"15min":1.0580000000000001},"min":{"1min":0.755,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.4370000000000001,"5min":1.659,"15min":1.7350000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.155,"15min":1.1479999999999999},"min":{"1min":0.86899999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.9570000000000001},"last":1.1859999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.21,"15min":1.218},"min":{"1min":0.92000000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5680000000000001,"5min":2.2839999999999998,"15min":2.7210000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.306,"15min":1.274},"min":{"1min":1.0600000000000001,"5min":0.873,"15min":0.745},"max":{"1min":1.6240000000000001,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.2689999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.3660000000000001,"15min":1.325},"min":{"1min":1.1559999999999999,"5min":0.754,"15min":0.66700000000000004},"max":{"1min":1.635,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.371},{"interface":"front","average":{"1min":1.351,"5min":1.349,"15min":1.397},"min":{"1min":1.0069999999999999,"5min":0.78600000000000003,"15min":0.73699999999999999},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.3839999999999999},"last":1.536}]},{"osd":6,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4550000000000001,"15min":1.448},"min":{"1min":1.0640000000000001,"5min":1.008,"15min":0.88100000000000001},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.3400000000000001,"15min":1.373},"min":{"1min":0.84899999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.708,"5min":1.968,"15min":2.8250000000000002},"last":1.6160000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:51:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.409,"15min":1.399},"min":{"1min":0.96599999999999997,"5min":0.81100000000000005,"15min":0.77100000000000002},"max":{"1min":1.7749999999999999,"5min":2.056,"15min":2.7850000000000001},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.464,"15min":1.4299999999999999},"min":{"1min":1.155,"5min":0.81499999999999995,"15min":0.80600000000000005},"max":{"1min":1.944,"5min":2.2290000000000001,"15min":2.3740000000000001},"last":1.492}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":946,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194366,"statfs":{"total":200000000,"available":199031241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.85099999999999998,"15min":0.83199999999999996},"min":{"1min":0.63300000000000001,"5min":0.40000000000000002,"15min":0.32000000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":6.8879999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93000000000000005,"15min":0.94099999999999995},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.35799999999999998},"max":{"1min":1.696,"5min":1.7589999999999999,"15min":4.5510000000000002},"last":0.82199999999999995}]},{"osd":1,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.94799999999999995},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.34000000000000002},"max":{"1min":1.506,"5min":1.702,"15min":11.308999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.135,"5min":1.0860000000000001,"15min":1.0129999999999999},"min":{"1min":0.80200000000000005,"5min":0.51000000000000001,"15min":0.44600000000000001},"max":{"1min":1.6160000000000001,"5min":1.7290000000000001,"15min":2.9889999999999999},"last":0.98499999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.099,"15min":1.101},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.41099999999999998},"max":{"1min":1.772,"5min":1.772,"15min":13.087999999999999},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.2190000000000001,"15min":1.1919999999999999},"min":{"1min":0.90300000000000002,"5min":0.55200000000000005,"15min":0.52300000000000002},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":12.289999999999999},"last":1.0980000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.363,"15min":1.3149999999999999},"min":{"1min":0.86099999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.9319999999999999,"5min":2.3159999999999998,"15min":3.5249999999999999},"last":1.196},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.276,"15min":1.3360000000000001},"min":{"1min":0.80500000000000005,"5min":0.71599999999999997,"15min":0.61499999999999999},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":13.927},"last":1.3939999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3420000000000001,"15min":1.371},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.64000000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":11.003},"last":1.472},{"interface":"front","average":{"1min":1.383,"5min":1.323,"15min":1.325},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.825,"5min":1.9370000000000001,"15min":13.129},"last":1.3460000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.3819999999999999,"15min":1.3480000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.978,"5min":1.9810000000000001,"15min":8.1609999999999996},"last":1.446},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.4730000000000001,"15min":1.4350000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.69999999999999996},"max":{"1min":2.0089999999999999,"5min":2.0939999999999999,"15min":6.8150000000000004},"last":1.611}]},{"osd":7,"last update":"Fri Dec 22 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.3779999999999999,"15min":1.4099999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.61299999999999999},"max":{"1min":1.9630000000000001,"5min":2.1440000000000001,"15min":10.948},"last":1.548},{"interface":"front","average":{"1min":1.49,"5min":1.556,"15min":1.4630000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8959999999999999,"5min":9.0239999999999991,"15min":9.0239999999999991},"last":1.5289999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193789,"statfs":{"total":200000000,"available":198440825,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.1140000000000001,"15min":0.97799999999999998},"min":{"1min":0.625,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":1.321,"5min":23.059000000000001,"15min":23.059000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.1930000000000001,"15min":1.1000000000000001},"min":{"1min":0.75900000000000001,"5min":0.41099999999999998,"15min":0.39900000000000002},"max":{"1min":1.625,"5min":9.9749999999999996,"15min":9.9749999999999996},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.1930000000000001,"15min":1.0429999999999999},"min":{"1min":0.71899999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1950000000000001,"5min":22.977,"15min":22.977},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.01,"15min":0.996},"min":{"1min":0.80900000000000005,"5min":0.35899999999999999,"15min":0.34999999999999998},"max":{"1min":1.5329999999999999,"5min":1.6499999999999999,"15min":2.254},"last":1.2589999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.3220000000000001,"15min":1.256},"min":{"1min":0.89200000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.778,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.099,"15min":1.03},"min":{"1min":0.70299999999999996,"5min":0.53400000000000003,"15min":0.47799999999999998},"max":{"1min":1.732,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.155}]},{"osd":4,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.4770000000000001,"15min":1.353},"min":{"1min":1.018,"5min":0.71299999999999997,"15min":0.58699999999999997},"max":{"1min":1.5629999999999999,"5min":23.145,"15min":23.145},"last":1.47},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.5,"15min":1.4119999999999999},"min":{"1min":1.0820000000000001,"5min":0.747,"15min":0.747},"max":{"1min":1.7150000000000001,"5min":9.9299999999999997,"15min":9.9299999999999997},"last":1.611}]},{"osd":5,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.2669999999999999,"15min":1.264},"min":{"1min":1.008,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.8149999999999999,"5min":2.8109999999999999,"15min":4.6399999999999997},"last":1.9790000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.54,"15min":1.4319999999999999},"min":{"1min":1.056,"5min":0.71699999999999997,"15min":0.66800000000000004},"max":{"1min":1.6519999999999999,"5min":23.105,"15min":23.105},"last":1.806}]},{"osd":6,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.333,"15min":1.3100000000000001},"min":{"1min":0.996,"5min":0.82199999999999995,"15min":0.65200000000000002},"max":{"1min":1.889,"5min":2.71,"15min":4.5819999999999999},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.6599999999999999,"15min":1.4910000000000001},"min":{"1min":1.1830000000000001,"5min":0.80300000000000005,"15min":0.67200000000000004},"max":{"1min":1.732,"5min":24.341999999999999,"15min":24.341999999999999},"last":1.901}]},{"osd":7,"last update":"Fri Dec 22 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.407,"15min":1.417},"min":{"1min":1.165,"5min":0.78800000000000003,"15min":0.64400000000000002},"max":{"1min":1.8160000000000001,"5min":2.0870000000000002,"15min":2.4889999999999999},"last":1.923},{"interface":"front","average":{"1min":1.452,"5min":1.4179999999999999,"15min":1.429},"min":{"1min":1.071,"5min":0.76800000000000002,"15min":0.66200000000000003},"max":{"1min":1.6439999999999999,"5min":1.7649999999999999,"15min":4.508},"last":1.8560000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574990,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":946,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194366,"statfs":{"total":200000000,"available":199031173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.83999999999999997,"15min":0.79100000000000004},"min":{"1min":0.66600000000000004,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.077,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.121,"5min":0.997,"15min":0.95099999999999996},"min":{"1min":0.629,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.5189999999999999,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.86599999999999999,"15min":0.83799999999999997},"min":{"1min":0.71999999999999997,"5min":0.373,"15min":0.373},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.6739999999999999},"last":1.246},{"interface":"front","average":{"1min":1.141,"5min":1.034,"15min":1.0049999999999999},"min":{"1min":0.92600000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.377,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.071}]},{"osd":3,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.163,"15min":1.1060000000000001},"min":{"1min":0.85699999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.7609999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.093},{"interface":"front","average":{"1min":1.363,"5min":1.27,"15min":1.1719999999999999},"min":{"1min":0.83699999999999997,"5min":0.45500000000000002,"15min":0.39100000000000001},"max":{"1min":1.6639999999999999,"5min":2.0659999999999998,"15min":2.145},"last":1.353}]},{"osd":4,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.333,"15min":1.3120000000000001},"min":{"1min":1,"5min":0.79300000000000004,"15min":0.70799999999999996},"max":{"1min":1.663,"5min":2.0910000000000002,"15min":2.625},"last":1.181},{"interface":"front","average":{"1min":1.452,"5min":1.3680000000000001,"15min":1.2949999999999999},"min":{"1min":1.1279999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.694,"5min":1.964,"15min":2.5550000000000002},"last":1.1379999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.385,"15min":1.321},"min":{"1min":1.1499999999999999,"5min":0.69599999999999995,"15min":0.59299999999999997},"max":{"1min":1.6859999999999999,"5min":5.4290000000000003,"15min":5.4290000000000003},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3520000000000001,"15min":1.3129999999999999},"min":{"1min":1.0900000000000001,"5min":0.79500000000000004,"15min":0.73599999999999999},"max":{"1min":1.6379999999999999,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.2909999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.375,"15min":1.3380000000000001},"min":{"1min":1.1259999999999999,"5min":0.66900000000000004,"15min":0.64800000000000002},"max":{"1min":1.675,"5min":1.9330000000000001,"15min":2.4420000000000002},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.494,"15min":1.4490000000000001},"min":{"1min":1.3799999999999999,"5min":0.88800000000000001,"15min":0.69099999999999995},"max":{"1min":1.847,"5min":2.109,"15min":2.577},"last":1.3220000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:51:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.4570000000000001,"15min":1.4219999999999999},"min":{"1min":1.2969999999999999,"5min":0.80000000000000004,"15min":0.755},"max":{"1min":1.8560000000000001,"5min":1.982,"15min":2.3069999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.476,"15min":1.429},"min":{"1min":1.1639999999999999,"5min":0.88800000000000001,"15min":0.749},"max":{"1min":1.9099999999999999,"5min":2.1680000000000001,"15min":2.2650000000000001},"last":1.397}]}]}],"pool_statfs":[]}} 2023-12-22T08:51:30.680 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T08:51:30.680 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T08:51:30.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.955+0000 7f86c8fab640 1 Processor -- start 2023-12-22T08:51:30.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.955+0000 7f86c8fab640 1 -- start start 2023-12-22T08:51:30.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.957+0000 7f86c8fab640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f86c4143c50 0x7f86c406d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.957+0000 7f86c8fab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c406da80 0x7f86c40b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.957+0000 7f86c8fab640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c406df20 con 0x7f86c4143870 2023-12-22T08:51:30.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.957+0000 7f86c8fab640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c4144ae0 con 0x7f86c4143c50 2023-12-22T08:51:30.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.957+0000 7f86c8fab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c406e200 con 0x7f86c406da80 2023-12-22T08:51:30.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.957+0000 7f86bbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f86c4143c50 0x7f86c406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:30.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.957+0000 7f86bbfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f86c4143c50 0x7f86c406d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51414/0 (socket says 172.21.15.38:51414) 2023-12-22T08:51:30.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.957+0000 7f86bbfff640 1 -- 172.21.15.38:0/847497685 learned_addr learned my addr 172.21.15.38:0/847497685 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:30.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.957+0000 7f86c2d9d640 1 --2- 172.21.15.38:0/847497685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c406da80 0x7f86c40b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:30.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.957+0000 7f86bbfff640 1 -- 172.21.15.38:0/847497685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c406da80 msgr2=0x7f86c40b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:30.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.957+0000 7f86bbfff640 1 --2- 172.21.15.38:0/847497685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c406da80 0x7f86c40b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.958+0000 7f86bbfff640 1 -- 172.21.15.38:0/847497685 >> v1:172.21.15.89:6789/0 conn(0x7f86c4143870 legacy=0x7f86c41443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:30.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.958+0000 7f86bbfff640 1 -- 172.21.15.38:0/847497685 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c406e4e0 con 0x7f86c4143c50 2023-12-22T08:51:30.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.959+0000 7f86bbfff640 1 --2- 172.21.15.38:0/847497685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c4143c50 0x7f86c406d540 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009870 tx=0x7f86ac02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b710f79499b0a04 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:30.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.959+0000 7f86c1d9b640 1 -- 172.21.15.38:0/847497685 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac031640 con 0x7f86c4143c50 2023-12-22T08:51:30.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.959+0000 7f86c1d9b640 1 -- 172.21.15.38:0/847497685 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac0317a0 con 0x7f86c4143c50 2023-12-22T08:51:30.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.959+0000 7f86c1d9b640 1 -- 172.21.15.38:0/847497685 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac031b30 con 0x7f86c4143c50 2023-12-22T08:51:30.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.960+0000 7f86c8fab640 1 -- 172.21.15.38:0/847497685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c4143c50 msgr2=0x7f86c406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:30.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.960+0000 7f86c8fab640 1 --2- 172.21.15.38:0/847497685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c4143c50 0x7f86c406d540 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009870 tx=0x7f86ac02b8f0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.960+0000 7f86c8fab640 1 -- 172.21.15.38:0/847497685 shutdown_connections 2023-12-22T08:51:30.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.960+0000 7f86c8fab640 1 --2- 172.21.15.38:0/847497685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c4143c50 0x7f86c406d540 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.960+0000 7f86c8fab640 1 --2- 172.21.15.38:0/847497685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c406da80 0x7f86c40b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.960+0000 7f86c8fab640 1 -- 172.21.15.38:0/847497685 >> 172.21.15.38:0/847497685 conn(0x7f86c406f880 msgr2=0x7f86c40b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:30.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.960+0000 7f86c8fab640 1 -- 172.21.15.38:0/847497685 shutdown_connections 2023-12-22T08:51:30.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.960+0000 7f86c8fab640 1 -- 172.21.15.38:0/847497685 wait complete. 2023-12-22T08:51:30.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.962+0000 7f86c8fab640 1 Processor -- start 2023-12-22T08:51:30.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.962+0000 7f86c8fab640 1 -- start start 2023-12-22T08:51:30.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.963+0000 7f86c8fab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c406da80 0x7f86c40cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.963+0000 7f86c8fab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c4143870 0x7f86c40ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.963+0000 7f86c8fab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86c4143c50 0x7f86c4160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.963+0000 7f86c8fab640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40ce730 con 0x7f86c4143870 2023-12-22T08:51:30.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.963+0000 7f86c8fab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c4160670 con 0x7f86c4143c50 2023-12-22T08:51:30.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.963+0000 7f86c8fab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40cce60 con 0x7f86c406da80 2023-12-22T08:51:30.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.963+0000 7f86bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c4143870 0x7f86c40ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.963+0000 7f86bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c4143870 0x7f86c40ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51430/0 (socket says 172.21.15.38:51430) 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.963+0000 7f86bbfff640 1 -- 172.21.15.38:0/1670563099 learned_addr learned my addr 172.21.15.38:0/1670563099 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.963+0000 7f86c259c640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c406da80 0x7f86c40cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.963+0000 7f86c2d9d640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86c4143c50 0x7f86c4160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.964+0000 7f86bbfff640 1 -- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c406da80 msgr2=0x7f86c40cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.964+0000 7f86bbfff640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c406da80 0x7f86c40cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.964+0000 7f86bbfff640 1 -- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86c4143c50 msgr2=0x7f86c4160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.964+0000 7f86bbfff640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86c4143c50 0x7f86c4160130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.964+0000 7f86bbfff640 1 -- 172.21.15.38:0/1670563099 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac0094d0 con 0x7f86c4143870 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.964+0000 7f86bbfff640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c4143870 0x7f86c40ce1f0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009870 tx=0x7f86ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.964+0000 7f86baffd640 1 -- 172.21.15.38:0/1670563099 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac03ac60 con 0x7f86c4143870 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.964+0000 7f86baffd640 1 -- 172.21.15.38:0/1670563099 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac03ade0 con 0x7f86c4143870 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.964+0000 7f86baffd640 1 -- 172.21.15.38:0/1670563099 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac044630 con 0x7f86c4143870 2023-12-22T08:51:30.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.964+0000 7f86c8fab640 1 -- 172.21.15.38:0/1670563099 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c40cd140 con 0x7f86c4143870 2023-12-22T08:51:30.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.964+0000 7f86c8fab640 1 -- 172.21.15.38:0/1670563099 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c40cd700 con 0x7f86c4143870 2023-12-22T08:51:30.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.966+0000 7f86c8fab640 1 -- 172.21.15.38:0/1670563099 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c40706f0 con 0x7f86c4143870 2023-12-22T08:51:30.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.967+0000 7f86baffd640 1 -- 172.21.15.38:0/1670563099 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f86ac02f050 con 0x7f86c4143870 2023-12-22T08:51:30.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.968+0000 7f86baffd640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86a406a430 0x7f86a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:30.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.968+0000 7f86baffd640 1 -- 172.21.15.38:0/1670563099 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86ac0aaa40 con 0x7f86c4143870 2023-12-22T08:51:30.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.969+0000 7f86c259c640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86a406a430 0x7f86a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:30.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.970+0000 7f86c259c640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86a406a430 0x7f86a406c8f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f86b4004ea0 tx=0x7f86b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:30.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:30.973+0000 7f86baffd640 1 -- 172.21.15.38:0/1670563099 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f86ac076140 con 0x7f86c4143870 2023-12-22T08:51:31.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.237+0000 7f86c8fab640 1 -- 172.21.15.38:0/1670563099 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f86c4061910 con 0x7f86c4143870 2023-12-22T08:51:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.243+0000 7f86baffd640 1 -- 172.21.15.38:0/1670563099 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f86ac04e020 con 0x7f86c4143870 2023-12-22T08:51:31.244 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.0 2023-12-22T08:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.247+0000 7f86c8fab640 1 -- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86a406a430 msgr2=0x7f86a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.247+0000 7f86c8fab640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86a406a430 0x7f86a406c8f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f86b4004ea0 tx=0x7f86b4009040 comp rx=0 tx=0).stop 2023-12-22T08:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.247+0000 7f86c8fab640 1 -- 172.21.15.38:0/1670563099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c4143870 msgr2=0x7f86c40ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.247+0000 7f86c8fab640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c4143870 0x7f86c40ce1f0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009870 tx=0x7f86ac0046c0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.247+0000 7f86c8fab640 1 -- 172.21.15.38:0/1670563099 shutdown_connections 2023-12-22T08:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.247+0000 7f86c8fab640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86c4143c50 0x7f86c4160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.247+0000 7f86c8fab640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86a406a430 0x7f86a406c8f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.247+0000 7f86c8fab640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86c4143870 0x7f86c40ce1f0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.247+0000 7f86c8fab640 1 --2- 172.21.15.38:0/1670563099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86c406da80 0x7f86c40cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.247+0000 7f86c8fab640 1 -- 172.21.15.38:0/1670563099 >> 172.21.15.38:0/1670563099 conn(0x7f86c406f880 msgr2=0x7f86c4142a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.247+0000 7f86c8fab640 1 -- 172.21.15.38:0/1670563099 shutdown_connections 2023-12-22T08:51:31.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.247+0000 7f86c8fab640 1 -- 172.21.15.38:0/1670563099 wait complete. 2023-12-22T08:51:31.265 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:51:31.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.479+0000 7f9e7c55c640 1 Processor -- start 2023-12-22T08:51:31.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.480+0000 7f9e7c55c640 1 -- start start 2023-12-22T08:51:31.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.481+0000 7f9e7c55c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9e741547a0 0x7f9e7415b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:31.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.481+0000 7f9e7c55c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e74154b80 0x7f9e740ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:31.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.481+0000 7f9e7c55c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e740716a0 con 0x7f9e74071b90 2023-12-22T08:51:31.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.481+0000 7f9e7c55c640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e74070e80 con 0x7f9e741547a0 2023-12-22T08:51:31.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.481+0000 7f9e7c55c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740710e0 con 0x7f9e74154b80 2023-12-22T08:51:31.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.482+0000 7f9e7a2f8640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9e741547a0 0x7f9e7415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:31.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.482+0000 7f9e7a2f8640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9e741547a0 0x7f9e7415b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56004/0 (socket says 172.21.15.38:56004) 2023-12-22T08:51:31.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.482+0000 7f9e7a2f8640 1 -- 172.21.15.38:0/972752424 learned_addr learned my addr 172.21.15.38:0/972752424 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:31.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.482+0000 7f9e7aaf9640 1 --2- 172.21.15.38:0/972752424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e74154b80 0x7f9e740ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:31.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.482+0000 7f9e7a2f8640 1 -- 172.21.15.38:0/972752424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e74154b80 msgr2=0x7f9e740ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:31.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.482+0000 7f9e7a2f8640 1 --2- 172.21.15.38:0/972752424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e74154b80 0x7f9e740ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.482+0000 7f9e7a2f8640 1 -- 172.21.15.38:0/972752424 >> v1:172.21.15.89:6789/0 conn(0x7f9e74071b90 legacy=0x7f9e74070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:31.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.482+0000 7f9e7a2f8640 1 -- 172.21.15.38:0/972752424 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e740713c0 con 0x7f9e741547a0 2023-12-22T08:51:31.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.483+0000 7f9e7a2f8640 1 --2- 172.21.15.38:0/972752424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e741547a0 0x7f9e7415b300 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000bb10 tx=0x7f9e7002e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0c603fdad857ca server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:31.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.484+0000 7f9e792f6640 1 -- 172.21.15.38:0/972752424 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70036440 con 0x7f9e741547a0 2023-12-22T08:51:31.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.484+0000 7f9e792f6640 1 -- 172.21.15.38:0/972752424 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e700365a0 con 0x7f9e741547a0 2023-12-22T08:51:31.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.484+0000 7f9e792f6640 1 -- 172.21.15.38:0/972752424 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70036930 con 0x7f9e741547a0 2023-12-22T08:51:31.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.484+0000 7f9e7c55c640 1 -- 172.21.15.38:0/972752424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e741547a0 msgr2=0x7f9e7415b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:31.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.484+0000 7f9e7c55c640 1 --2- 172.21.15.38:0/972752424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e741547a0 0x7f9e7415b300 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000bb10 tx=0x7f9e7002e150 comp rx=0 tx=0).stop 2023-12-22T08:51:31.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.484+0000 7f9e7c55c640 1 -- 172.21.15.38:0/972752424 shutdown_connections 2023-12-22T08:51:31.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.485+0000 7f9e7c55c640 1 --2- 172.21.15.38:0/972752424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e74154b80 0x7f9e740ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.485+0000 7f9e7c55c640 1 --2- 172.21.15.38:0/972752424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e741547a0 0x7f9e7415b300 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.485+0000 7f9e7c55c640 1 -- 172.21.15.38:0/972752424 >> 172.21.15.38:0/972752424 conn(0x7f9e740cf070 msgr2=0x7f9e740cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:31.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.485+0000 7f9e7c55c640 1 -- 172.21.15.38:0/972752424 shutdown_connections 2023-12-22T08:51:31.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.485+0000 7f9e7c55c640 1 -- 172.21.15.38:0/972752424 wait complete. 2023-12-22T08:51:31.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.486+0000 7f9e7c55c640 1 Processor -- start 2023-12-22T08:51:31.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.487+0000 7f9e7c55c640 1 -- start start 2023-12-22T08:51:31.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.487+0000 7f9e7c55c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e74071b90 0x7f9e740ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:31.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7c55c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e741547a0 0x7f9e74150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:31.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7c55c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e74154b80 0x7f9e741514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:31.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7c55c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7414b490 con 0x7f9e74154b80 2023-12-22T08:51:31.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7c55c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740cada0 con 0x7f9e741547a0 2023-12-22T08:51:31.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7c55c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740c4100 con 0x7f9e74071b90 2023-12-22T08:51:31.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7aaf9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e74154b80 0x7f9e741514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:31.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7aaf9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e74154b80 0x7f9e741514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56010/0 (socket says 172.21.15.38:56010) 2023-12-22T08:51:31.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7aaf9640 1 -- 172.21.15.38:0/2140857057 learned_addr learned my addr 172.21.15.38:0/2140857057 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:31.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7a2f8640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e74071b90 0x7f9e740ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:31.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e79af7640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e741547a0 0x7f9e74150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:31.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7aaf9640 1 -- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e74071b90 msgr2=0x7f9e740ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:31.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7aaf9640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e74071b90 0x7f9e740ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7aaf9640 1 -- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e741547a0 msgr2=0x7f9e74150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:31.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7aaf9640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e741547a0 0x7f9e74150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.488+0000 7f9e7aaf9640 1 -- 172.21.15.38:0/2140857057 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7000b770 con 0x7f9e74154b80 2023-12-22T08:51:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.489+0000 7f9e7aaf9640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e74154b80 0x7f9e741514a0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c007e60 tx=0x7f9e6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.489+0000 7f9e6affd640 1 -- 172.21.15.38:0/2140857057 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c014420 con 0x7f9e74154b80 2023-12-22T08:51:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.489+0000 7f9e6affd640 1 -- 172.21.15.38:0/2140857057 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6c0145a0 con 0x7f9e74154b80 2023-12-22T08:51:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.489+0000 7f9e7c55c640 1 -- 172.21.15.38:0/2140857057 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e740c43e0 con 0x7f9e74154b80 2023-12-22T08:51:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.489+0000 7f9e6affd640 1 -- 172.21.15.38:0/2140857057 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c014950 con 0x7f9e74154b80 2023-12-22T08:51:31.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.489+0000 7f9e7c55c640 1 -- 172.21.15.38:0/2140857057 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e740c49a0 con 0x7f9e74154b80 2023-12-22T08:51:31.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.491+0000 7f9e7c55c640 1 -- 172.21.15.38:0/2140857057 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e74150470 con 0x7f9e74154b80 2023-12-22T08:51:31.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.492+0000 7f9e6affd640 1 -- 172.21.15.38:0/2140857057 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9e6c014ab0 con 0x7f9e74154b80 2023-12-22T08:51:31.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.493+0000 7f9e6affd640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9e5806a430 0x7f9e5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:31.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.493+0000 7f9e6affd640 1 -- 172.21.15.38:0/2140857057 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e6c0891a0 con 0x7f9e74154b80 2023-12-22T08:51:31.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.494+0000 7f9e7a2f8640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9e5806a430 0x7f9e5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:31.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.495+0000 7f9e7a2f8640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9e5806a430 0x7f9e5806c8f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9e70038000 tx=0x7f9e70008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:31.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.498+0000 7f9e6affd640 1 -- 172.21.15.38:0/2140857057 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9e6c054820 con 0x7f9e74154b80 2023-12-22T08:51:31.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.732+0000 7f9e7c55c640 1 -- 172.21.15.38:0/2140857057 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e74061910 con 0x7f9e74154b80 2023-12-22T08:51:31.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.733+0000 7f9e6affd640 1 -- 172.21.15.38:0/2140857057 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4649 (secure 0 0 0) 0x7f9e6c057e40 con 0x7f9e74154b80 2023-12-22T08:51:31.734 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:31.734 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1443382612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1443382612},{"type":"v1","addr":"172.21.15.38:6835","nonce":1443382612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1913310975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1913310975},{"type":"v1","addr":"172.21.15.89:6836","nonce":1913310975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/218839128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":218839128},{"type":"v1","addr":"172.21.15.89:6837","nonce":218839128}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:51:25.111775+0000","modified":"2023-12-22T08:51:28.645925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8553":{"gid":8553,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6834/1387101372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1387101372},{"type":"v1","addr":"172.21.15.38:6834","nonce":1387101372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-22T08:51:31.734 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 78 2023-12-22T08:51:31.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.736+0000 7f9e7c55c640 1 -- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9e5806a430 msgr2=0x7f9e5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:31.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.736+0000 7f9e7c55c640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9e5806a430 0x7f9e5806c8f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9e70038000 tx=0x7f9e70008040 comp rx=0 tx=0).stop 2023-12-22T08:51:31.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.736+0000 7f9e7c55c640 1 -- 172.21.15.38:0/2140857057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e74154b80 msgr2=0x7f9e741514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:31.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.736+0000 7f9e7c55c640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e74154b80 0x7f9e741514a0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c007e60 tx=0x7f9e6c00e4b0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.736+0000 7f9e7c55c640 1 -- 172.21.15.38:0/2140857057 shutdown_connections 2023-12-22T08:51:31.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.736+0000 7f9e7c55c640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f9e5806a430 0x7f9e5806c8f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.736+0000 7f9e7c55c640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e74154b80 0x7f9e741514a0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.736+0000 7f9e7c55c640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e741547a0 0x7f9e74150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.736+0000 7f9e7c55c640 1 --2- 172.21.15.38:0/2140857057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e74071b90 0x7f9e740ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:31.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.736+0000 7f9e7c55c640 1 -- 172.21.15.38:0/2140857057 >> 172.21.15.38:0/2140857057 conn(0x7f9e740cf070 msgr2=0x7f9e7406c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:31.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.736+0000 7f9e7c55c640 1 -- 172.21.15.38:0/2140857057 shutdown_connections 2023-12-22T08:51:31.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:31.736+0000 7f9e7c55c640 1 -- 172.21.15.38:0/2140857057 wait complete. 2023-12-22T08:51:32.156 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T08:51:25.111775+0000', 'modified': '2023-12-22T08:51:28.645925+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8553}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8553': {'gid': 8553, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.38:6834/1387101372', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6832', 'nonce': 1387101372}, {'type': 'v1', 'addr': '172.21.15.38:6834', 'nonce': 1387101372}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T08:51:32.157 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T08:51:32.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-22T08:51:32.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.397+0000 7fbd15ac4640 1 Processor -- start 2023-12-22T08:51:32.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.397+0000 7fbd15ac4640 1 -- start start 2023-12-22T08:51:32.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.399+0000 7fbd15ac4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbd100b26a0 0x7fbd1006ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.399+0000 7fbd15ac4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd100b3d10 con 0x7fbd100b22c0 2023-12-22T08:51:32.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.399+0000 7fbd15ac4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd100b4510 con 0x7fbd1006cf50 2023-12-22T08:51:32.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.399+0000 7fbd15ac4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1006c610 con 0x7fbd100b26a0 2023-12-22T08:51:32.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.399+0000 7fbd0f7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbd100b22c0 0x7fbd100b3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:32988/0 (socket says 172.21.15.38:32988) 2023-12-22T08:51:32.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.399+0000 7fbd0f7fe640 1 -- 172.21.15.38:0/435543088 learned_addr learned my addr 172.21.15.38:0/435543088 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:32.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd07fff640 1 --2- 172.21.15.38:0/435543088 >> v2:172.21.15.89:3300/0 conn(0x7fbd100b26a0 0x7fbd1006ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242770855 0 0) 0x7fbd00001110 con 0x7fbd100b22c0 2023-12-22T08:51:32.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcfc003520 con 0x7fbd100b22c0 2023-12-22T08:51:32.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3503674814 0 0) 0x7fbcfc003520 con 0x7fbd100b22c0 2023-12-22T08:51:32.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 >> v2:172.21.15.89:3300/0 conn(0x7fbd100b26a0 msgr2=0x7fbd1006ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:32.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 --2- 172.21.15.38:0/435543088 >> v2:172.21.15.89:3300/0 conn(0x7fbd100b26a0 0x7fbd1006ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 >> v1:172.21.15.89:6789/0 conn(0x7fbd1006cf50 legacy=0x7fbd100cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd100b3f50 con 0x7fbd100b22c0 2023-12-22T08:51:32.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fbd00001800 con 0x7fbd100b22c0 2023-12-22T08:51:32.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 >> v1:172.21.15.38:6789/0 conn(0x7fbd100b22c0 legacy=0x7fbd100b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 --2- 172.21.15.38:0/435543088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc0039c0 0x7fbcfc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 --2- 172.21.15.38:0/435543088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcfc0047c0 0x7fbcfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 --2- 172.21.15.38:0/435543088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0051d0 0x7fbcfc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1006c610 con 0x7fbcfc0039c0 2023-12-22T08:51:32.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc00c120 con 0x7fbcfc0051d0 2023-12-22T08:51:32.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc00c2e0 con 0x7fbcfc0047c0 2023-12-22T08:51:32.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.400+0000 7fbd07fff640 1 --2- 172.21.15.38:0/435543088 >> v2:172.21.15.89:3300/0 conn(0x7fbd100b26a0 0x7fbd1006ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:51:32.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.401+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/435543088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc0039c0 0x7fbcfc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.401+0000 7fbd0ffff640 1 --2- 172.21.15.38:0/435543088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0051d0 0x7fbcfc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.401+0000 7fbd07fff640 1 --2- 172.21.15.38:0/435543088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcfc0047c0 0x7fbcfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.401+0000 7fbd0f7fe640 1 -- 172.21.15.38:0/435543088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcfc0047c0 msgr2=0x7fbcfc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:32.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.401+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/435543088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcfc0047c0 0x7fbcfc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.401+0000 7fbd0f7fe640 1 -- 172.21.15.38:0/435543088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0051d0 msgr2=0x7fbcfc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:32.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.401+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/435543088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0051d0 0x7fbcfc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.401+0000 7fbd0f7fe640 1 -- 172.21.15.38:0/435543088 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc003520 con 0x7fbcfc0039c0 2023-12-22T08:51:32.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.401+0000 7fbd0ffff640 1 -- 172.21.15.38:0/435543088 reap_dead start 2023-12-22T08:51:32.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.403+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/435543088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc0039c0 0x7fbcfc003de0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fbd00001eb0 tx=0x7fbcfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11713d8cfd3b454d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:32.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.403+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00005ad0 con 0x7fbcfc0039c0 2023-12-22T08:51:32.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.403+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd00005c50 con 0x7fbcfc0039c0 2023-12-22T08:51:32.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.404+0000 7fbd0effd640 1 -- 172.21.15.38:0/435543088 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0002c790 con 0x7fbcfc0039c0 2023-12-22T08:51:32.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.404+0000 7fbd15ac4640 1 -- 172.21.15.38:0/435543088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc0039c0 msgr2=0x7fbcfc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.404+0000 7fbd15ac4640 1 --2- 172.21.15.38:0/435543088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc0039c0 0x7fbcfc003de0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fbd00001eb0 tx=0x7fbcfc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.404+0000 7fbd15ac4640 1 -- 172.21.15.38:0/435543088 shutdown_connections 2023-12-22T08:51:32.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.404+0000 7fbd15ac4640 1 --2- 172.21.15.38:0/435543088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc0039c0 0x7fbcfc003de0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.404+0000 7fbd15ac4640 1 -- 172.21.15.38:0/435543088 >> 172.21.15.38:0/435543088 conn(0x7fbd100cf070 msgr2=0x7fbd100cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:32.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.404+0000 7fbd15ac4640 1 -- 172.21.15.38:0/435543088 shutdown_connections 2023-12-22T08:51:32.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.404+0000 7fbd15ac4640 1 -- 172.21.15.38:0/435543088 wait complete. 2023-12-22T08:51:32.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.406+0000 7fbd15ac4640 1 Processor -- start 2023-12-22T08:51:32.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.406+0000 7fbd15ac4640 1 -- start start 2023-12-22T08:51:32.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.407+0000 7fbd15ac4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0039c0 0x7fbd101559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.407+0000 7fbd15ac4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd100b0cd0 0x7fbd100b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.407+0000 7fbd15ac4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd10159770 0x7fbd10159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.407+0000 7fbd15ac4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd100b1690 con 0x7fbd100b0cd0 2023-12-22T08:51:32.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.407+0000 7fbd15ac4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd10155f10 con 0x7fbcfc0039c0 2023-12-22T08:51:32.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.407+0000 7fbd15ac4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1015a4a0 con 0x7fbd10159770 2023-12-22T08:51:32.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.407+0000 7fbd07fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd100b0cd0 0x7fbd100b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.408+0000 7fbd07fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd100b0cd0 0x7fbd100b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56014/0 (socket says 172.21.15.38:56014) 2023-12-22T08:51:32.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.408+0000 7fbd07fff640 1 -- 172.21.15.38:0/1154512573 learned_addr learned my addr 172.21.15.38:0/1154512573 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:32.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.408+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0039c0 0x7fbd101559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.408+0000 7fbd0ffff640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd10159770 0x7fbd10159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.408+0000 7fbd07fff640 1 -- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd10159770 msgr2=0x7fbd10159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.408+0000 7fbd07fff640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd10159770 0x7fbd10159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.408+0000 7fbd07fff640 1 -- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0039c0 msgr2=0x7fbd101559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.408+0000 7fbd07fff640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0039c0 0x7fbd101559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.408+0000 7fbd07fff640 1 -- 172.21.15.38:0/1154512573 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1015a780 con 0x7fbd100b0cd0 2023-12-22T08:51:32.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.408+0000 7fbd0ffff640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd10159770 0x7fbd10159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:32.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.408+0000 7fbd07fff640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd100b0cd0 0x7fbd100b1150 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8011800 tx=0x7fbcf8011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:32.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.409+0000 7fbd0cff9640 1 -- 172.21.15.38:0/1154512573 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf800f9c0 con 0x7fbd100b0cd0 2023-12-22T08:51:32.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.409+0000 7fbd0cff9640 1 -- 172.21.15.38:0/1154512573 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf800fb20 con 0x7fbd100b0cd0 2023-12-22T08:51:32.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.409+0000 7fbd15ac4640 1 -- 172.21.15.38:0/1154512573 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1015aa60 con 0x7fbd100b0cd0 2023-12-22T08:51:32.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.409+0000 7fbd0cff9640 1 -- 172.21.15.38:0/1154512573 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf800fe90 con 0x7fbd100b0cd0 2023-12-22T08:51:32.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.409+0000 7fbd15ac4640 1 -- 172.21.15.38:0/1154512573 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1015a130 con 0x7fbd100b0cd0 2023-12-22T08:51:32.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.411+0000 7fbd0cff9640 1 -- 172.21.15.38:0/1154512573 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbcf8015460 con 0x7fbd100b0cd0 2023-12-22T08:51:32.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.412+0000 7fbd0cff9640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbcf006a430 0x7fbcf006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.412+0000 7fbd0cff9640 1 -- 172.21.15.38:0/1154512573 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbcf8088ef0 con 0x7fbd100b0cd0 2023-12-22T08:51:32.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.413+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbcf006a430 0x7fbcf006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.413+0000 7fbd18632740 1 Processor -- start 2023-12-22T08:51:32.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.413+0000 7fbd18632740 1 -- start start 2023-12-22T08:51:32.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.414+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbcf006a430 0x7fbcf006c8f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbd00034000 tx=0x7fbd00009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.414+0000 7fbd18632740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 0x55dba18a3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.414+0000 7fbd18632740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba1872cb0 0x55dba189ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.414+0000 7fbd18632740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba18a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.414+0000 7fbd18632740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba17e2f80 con 0x55dba18768b0 2023-12-22T08:51:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.414+0000 7fbd18632740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba17e0710 con 0x55dba18a2d30 2023-12-22T08:51:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.414+0000 7fbd18632740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dba17dc000 con 0x55dba1872cb0 2023-12-22T08:51:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.415+0000 7fbd0ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba18a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.415+0000 7fbd0ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba18a04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56030/0 (socket says 172.21.15.38:56030) 2023-12-22T08:51:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.415+0000 7fbd0ffff640 1 -- 172.21.15.38:0/3398046277 learned_addr learned my addr 172.21.15.38:0/3398046277 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.415+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/3398046277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 0x55dba18a3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.415+0000 7fbd07fff640 1 --2- 172.21.15.38:0/3398046277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba1872cb0 0x55dba189ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.415+0000 7fbd0ffff640 1 -- 172.21.15.38:0/3398046277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba1872cb0 msgr2=0x55dba189ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:32.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.415+0000 7fbd0ffff640 1 --2- 172.21.15.38:0/3398046277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba1872cb0 0x55dba189ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.415+0000 7fbd0ffff640 1 -- 172.21.15.38:0/3398046277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 msgr2=0x55dba18a3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:32.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.415+0000 7fbd0ffff640 1 --2- 172.21.15.38:0/3398046277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 0x55dba18a3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.415+0000 7fbd0ffff640 1 -- 172.21.15.38:0/3398046277 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dba17a3690 con 0x55dba18768b0 2023-12-22T08:51:32.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.416+0000 7fbd0ffff640 1 --2- 172.21.15.38:0/3398046277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba18a04e0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fbd08007fd0 tx=0x7fbd08001ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc07ebc7082dcf9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:32.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.416+0000 7fbd057fa640 1 -- 172.21.15.38:0/3398046277 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080020f0 con 0x55dba18768b0 2023-12-22T08:51:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.416+0000 7fbd057fa640 1 -- 172.21.15.38:0/3398046277 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0800d050 con 0x55dba18768b0 2023-12-22T08:51:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.416+0000 7fbd057fa640 1 -- 172.21.15.38:0/3398046277 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08003da0 con 0x55dba18768b0 2023-12-22T08:51:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.416+0000 7fbd18632740 1 -- 172.21.15.38:0/3398046277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 msgr2=0x55dba18a04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.416+0000 7fbd18632740 1 --2- 172.21.15.38:0/3398046277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba18a04e0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fbd08007fd0 tx=0x7fbd08001ea0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.417+0000 7fbd18632740 1 -- 172.21.15.38:0/3398046277 shutdown_connections 2023-12-22T08:51:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.417+0000 7fbd18632740 1 --2- 172.21.15.38:0/3398046277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba18a04e0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.417+0000 7fbd18632740 1 --2- 172.21.15.38:0/3398046277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba1872cb0 0x55dba189ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.417+0000 7fbd18632740 1 --2- 172.21.15.38:0/3398046277 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 0x55dba18a3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.417+0000 7fbd18632740 1 -- 172.21.15.38:0/3398046277 >> 172.21.15.38:0/3398046277 conn(0x55dba1874fc0 msgr2=0x55dba18bdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.417+0000 7fbd18632740 1 -- 172.21.15.38:0/3398046277 shutdown_connections 2023-12-22T08:51:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.417+0000 7fbd18632740 1 -- 172.21.15.38:0/3398046277 wait complete. 2023-12-22T08:51:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.417+0000 7fbd18632740 1 -- start start 2023-12-22T08:51:32.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.418+0000 7fbd18632740 1 Processor -- start 2023-12-22T08:51:32.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd18632740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba18cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd18632740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 0x55dba18a3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd18632740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba18a5dc0 0x55dba18a6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd18632740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba177d7d0 con 0x55dba18768b0 2023-12-22T08:51:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd18632740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba177d470 con 0x55dba18a2d30 2023-12-22T08:51:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd18632740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dba1543f20 con 0x55dba18a5dc0 2023-12-22T08:51:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd18632740 10 client.0 _ll_register_callbacks cb 0x55dba17cc1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:51:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd0f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba18cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd0f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba18cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56036/0 (socket says 172.21.15.38:56036) 2023-12-22T08:51:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd0f7fe640 1 -- 172.21.15.38:0/1357506660 learned_addr learned my addr 172.21.15.38:0/1357506660 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd0ffff640 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba18a5dc0 0x55dba18a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd07fff640 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 0x55dba18a3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd0f7fe640 1 -- 172.21.15.38:0/1357506660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba18a5dc0 msgr2=0x55dba18a6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba18a5dc0 0x55dba18a6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd0f7fe640 1 -- 172.21.15.38:0/1357506660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 msgr2=0x55dba18a3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:32.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 0x55dba18a3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd0f7fe640 1 -- 172.21.15.38:0/1357506660 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf8009400 con 0x55dba18768b0 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.419+0000 7fbd07fff640 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 0x55dba18a3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.420+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba18cc8e0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fbd00001dd0 tx=0x7fbd0002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6defd731827441d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.420+0000 7fbcee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.420+0000 7fbcee7fc640 1 -- 172.21.15.38:0/1357506660 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0003c040 con 0x55dba18768b0 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.420+0000 7fbcee7fc640 1 -- 172.21.15.38:0/1357506660 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd00007070 con 0x55dba18768b0 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.420+0000 7fbd18632740 1 -- 172.21.15.38:0/1357506660 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dba1806550 con 0x55dba18768b0 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.420+0000 7fbcee7fc640 1 -- 172.21.15.38:0/1357506660 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd00007230 con 0x55dba18768b0 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.420+0000 7fbd18632740 10 client.8682 fetch_fsmap learned FSMap version 78 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.420+0000 7fbd18632740 1 -- 172.21.15.38:0/1357506660 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55dba17da680 con 0x55dba18768b0 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.421+0000 7fbcee7fc640 1 -- 172.21.15.38:0/1357506660 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dba1806550 con 0x55dba18768b0 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.421+0000 7fbcee7fc640 1 -- 172.21.15.38:0/1357506660 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 78) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fbd0003f030 con 0x55dba18768b0 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.421+0000 7fbd18632740 10 client.8682 fetch_fsmap finished waiting for FSMap version 78 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.421+0000 7fbd18632740 10 client.8682 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:51:32.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.421+0000 7fbd18632740 20 client.8682 populate_metadata read hostname 'smithi038' 2023-12-22T08:51:32.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.421+0000 7fbd18632740 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.38:6832/1387101372,v1:172.21.15.38:6834/1387101372] conn(0x55dba18b4780 0x55dba18b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.421+0000 7fbd18632740 4 client.8682 mds_command: new command op to 8553 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T08:51:32.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.421+0000 7fbd18632740 1 -- 172.21.15.38:0/1357506660 --> [v2:172.21.15.38:6832/1387101372,v1:172.21.15.38:6834/1387101372] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dba17ceb50 con 0x55dba18b4780 2023-12-22T08:51:32.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.421+0000 7fbd07fff640 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.38:6832/1387101372,v1:172.21.15.38:6834/1387101372] conn(0x55dba18b4780 0x55dba18b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.422+0000 7fbd07fff640 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.38:6832/1387101372,v1:172.21.15.38:6834/1387101372] conn(0x55dba18b4780 0x55dba18b4b60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b2bdf446def46e2 server_cookie=4c6fa8e4bbb5148d in_seq=0 out_seq=0 2023-12-22T08:51:32.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.422+0000 7fbcee7fc640 10 client.8682 ms_handle_connect on v2:172.21.15.38:6832/1387101372 2023-12-22T08:51:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.422+0000 7fbcee7fc640 1 -- 172.21.15.38:0/1357506660 <== mds.0 v2:172.21.15.38:6832/1387101372 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55dba17ceb50 con 0x55dba18b4780 2023-12-22T08:51:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.422+0000 7fbcee7fc640 10 client.8682 handle_command_reply: tid=0 2023-12-22T08:51:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.423+0000 7fbd18632740 1 client.8682 shutdown 2023-12-22T08:51:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.423+0000 7fbd18632740 1 -- 172.21.15.38:0/1357506660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 msgr2=0x55dba18cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.423+0000 7fbd18632740 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba18cc8e0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fbd00001dd0 tx=0x7fbd0002e000 comp rx=0 tx=0).stop 2023-12-22T08:51:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.423+0000 7fbd18632740 1 -- 172.21.15.38:0/1357506660 shutdown_connections 2023-12-22T08:51:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.423+0000 7fbd18632740 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.38:6832/1387101372,v1:172.21.15.38:6834/1387101372] conn(0x55dba18b4780 0x55dba18b4b60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.423+0000 7fbd18632740 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba18a5dc0 0x55dba18a6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.423+0000 7fbd18632740 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 0x55dba18a3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.423+0000 7fbd18632740 1 --2- 172.21.15.38:0/1357506660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba18cc8e0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.423+0000 7fbd18632740 1 -- 172.21.15.38:0/1357506660 >> 172.21.15.38:0/1357506660 conn(0x55dba1872cb0 msgr2=0x55dba1877120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.423+0000 7fbcee7fc640 0 client.8682 ms_handle_reset on v2:172.21.15.38:6832/1387101372 2023-12-22T08:51:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.423+0000 7fbd18632740 1 -- 172.21.15.38:0/1357506660 shutdown_connections 2023-12-22T08:51:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.423+0000 7fbd18632740 1 -- 172.21.15.38:0/1357506660 wait complete. 2023-12-22T08:51:32.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.423+0000 7fbd18632740 20 client.8682 trim_cache size 0 max 16384 2023-12-22T08:51:32.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.440+0000 7fbd18632740 1 Processor -- start 2023-12-22T08:51:32.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.440+0000 7fbd18632740 1 -- start start 2023-12-22T08:51:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.441+0000 7fbd18632740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba18768b0 0x55dba18c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.441+0000 7fbd18632740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 0x55dba18a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.441+0000 7fbd18632740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18a5dc0 0x55dba18a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.441+0000 7fbd18632740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba18a6470 con 0x55dba18a5dc0 2023-12-22T08:51:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.441+0000 7fbd18632740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba18a4e30 con 0x55dba18a2d30 2023-12-22T08:51:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.441+0000 7fbd18632740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dba18dfba0 con 0x55dba18768b0 2023-12-22T08:51:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.441+0000 7fbd0ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18a5dc0 0x55dba18a55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.441+0000 7fbd0ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18a5dc0 0x55dba18a55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56052/0 (socket says 172.21.15.38:56052) 2023-12-22T08:51:32.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.441+0000 7fbd0ffff640 1 -- 172.21.15.38:0/1198466727 learned_addr learned my addr 172.21.15.38:0/1198466727 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:32.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.442+0000 7fbd0ffff640 1 -- 172.21.15.38:0/1198466727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba18768b0 msgr2=0x55dba18c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:32.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.442+0000 7fbd0ffff640 1 --2- 172.21.15.38:0/1198466727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba18768b0 0x55dba18c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.442+0000 7fbd0ffff640 1 -- 172.21.15.38:0/1198466727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 msgr2=0x55dba18a50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:32.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.442+0000 7fbd0ffff640 1 --2- 172.21.15.38:0/1198466727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 0x55dba18a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.442+0000 7fbd0ffff640 1 -- 172.21.15.38:0/1198466727 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dba177c9e0 con 0x55dba18a5dc0 2023-12-22T08:51:32.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.442+0000 7fbd0ffff640 1 --2- 172.21.15.38:0/1198466727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18a5dc0 0x55dba18a55e0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fbd08001ee0 tx=0x7fbd0800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb58e80ea699f8d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:32.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.442+0000 7fbd05ffb640 1 -- 172.21.15.38:0/1198466727 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08003d80 con 0x55dba18a5dc0 2023-12-22T08:51:32.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.442+0000 7fbd05ffb640 1 -- 172.21.15.38:0/1198466727 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0800f780 con 0x55dba18a5dc0 2023-12-22T08:51:32.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.442+0000 7fbd05ffb640 1 -- 172.21.15.38:0/1198466727 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0800fb70 con 0x55dba18a5dc0 2023-12-22T08:51:32.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.443+0000 7fbd18632740 1 -- 172.21.15.38:0/1198466727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18a5dc0 msgr2=0x55dba18a55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.443+0000 7fbd18632740 1 --2- 172.21.15.38:0/1198466727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18a5dc0 0x55dba18a55e0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fbd08001ee0 tx=0x7fbd0800a000 comp rx=0 tx=0).stop 2023-12-22T08:51:32.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.443+0000 7fbd18632740 1 -- 172.21.15.38:0/1198466727 shutdown_connections 2023-12-22T08:51:32.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.443+0000 7fbd18632740 1 --2- 172.21.15.38:0/1198466727 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18a5dc0 0x55dba18a55e0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.443+0000 7fbd18632740 1 --2- 172.21.15.38:0/1198466727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a2d30 0x55dba18a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.443+0000 7fbd18632740 1 --2- 172.21.15.38:0/1198466727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba18768b0 0x55dba18c19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.443+0000 7fbd18632740 1 -- 172.21.15.38:0/1198466727 >> 172.21.15.38:0/1198466727 conn(0x55dba1872cb0 msgr2=0x55dba1873140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:32.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.443+0000 7fbd18632740 1 -- 172.21.15.38:0/1198466727 shutdown_connections 2023-12-22T08:51:32.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.443+0000 7fbd18632740 1 -- 172.21.15.38:0/1198466727 wait complete. 2023-12-22T08:51:32.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.444+0000 7fbd18632740 1 -- start start 2023-12-22T08:51:32.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.444+0000 7fbd18632740 1 Processor -- start 2023-12-22T08:51:32.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.445+0000 7fbd18632740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba1872740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.445+0000 7fbd18632740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba18a2d30 0x55dba191d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.445+0000 7fbd18632740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a5dc0 0x55dba18a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.445+0000 7fbd18632740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba1877be0 con 0x55dba18768b0 2023-12-22T08:51:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.445+0000 7fbd18632740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba18b34d0 con 0x55dba18a5dc0 2023-12-22T08:51:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.445+0000 7fbd18632740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dba18a3f60 con 0x55dba18a2d30 2023-12-22T08:51:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.445+0000 7fbd18632740 10 client.0 _ll_register_callbacks cb 0x7fbd08001610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:51:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.445+0000 7fbd0f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba1872740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.445+0000 7fbd0f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba1872740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56066/0 (socket says 172.21.15.38:56066) 2023-12-22T08:51:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.445+0000 7fbd0f7fe640 1 -- 172.21.15.38:0/4045110343 learned_addr learned my addr 172.21.15.38:0/4045110343 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.446+0000 7fbd0f7fe640 1 -- 172.21.15.38:0/4045110343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba18a2d30 msgr2=0x55dba191d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.446+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/4045110343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba18a2d30 0x55dba191d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.446+0000 7fbd0ffff640 1 --2- 172.21.15.38:0/4045110343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a5dc0 0x55dba18a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.446+0000 7fbd0f7fe640 1 -- 172.21.15.38:0/4045110343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a5dc0 msgr2=0x55dba18a00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.446+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/4045110343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a5dc0 0x55dba18a00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.446+0000 7fbd0f7fe640 1 -- 172.21.15.38:0/4045110343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dba17a3690 con 0x55dba18768b0 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.446+0000 7fbd0f7fe640 1 --2- 172.21.15.38:0/4045110343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba1872740 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fbd00007860 tx=0x7fbd00001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ecc2d8aa25d4a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.446+0000 7fbcee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.446+0000 7fbcee7fc640 1 -- 172.21.15.38:0/4045110343 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0003c070 con 0x55dba18768b0 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.447+0000 7fbcee7fc640 1 -- 172.21.15.38:0/4045110343 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd00007610 con 0x55dba18768b0 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.447+0000 7fbd18632740 1 -- 172.21.15.38:0/4045110343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dba1874330 con 0x55dba18768b0 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.447+0000 7fbcee7fc640 1 -- 172.21.15.38:0/4045110343 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd00007280 con 0x55dba18768b0 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.447+0000 7fbd18632740 10 client.8688 fetch_fsmap learned FSMap version 78 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.447+0000 7fbd18632740 1 -- 172.21.15.38:0/4045110343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55dba17a1ef0 con 0x55dba18768b0 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.447+0000 7fbcee7fc640 1 -- 172.21.15.38:0/4045110343 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dba1874330 con 0x55dba18768b0 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.447+0000 7fbcee7fc640 1 -- 172.21.15.38:0/4045110343 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 78) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fbd0003f040 con 0x55dba18768b0 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.447+0000 7fbd18632740 10 client.8688 fetch_fsmap finished waiting for FSMap version 78 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.447+0000 7fbd18632740 10 client.8688 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.447+0000 7fbd18632740 20 client.8688 populate_metadata read hostname 'smithi038' 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.447+0000 7fbd18632740 1 --2- 172.21.15.38:0/4045110343 >> [v2:172.21.15.38:6832/1387101372,v1:172.21.15.38:6834/1387101372] conn(0x55dba18a4f70 0x55dba18a5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.447+0000 7fbd18632740 4 client.8688 mds_command: new command op to 8553 tid=0[{"prefix": "status"}] 2023-12-22T08:51:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.447+0000 7fbd18632740 1 -- 172.21.15.38:0/4045110343 --> [v2:172.21.15.38:6832/1387101372,v1:172.21.15.38:6834/1387101372] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fbd0800d050 con 0x55dba18a4f70 2023-12-22T08:51:32.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.448+0000 7fbd07fff640 1 --2- 172.21.15.38:0/4045110343 >> [v2:172.21.15.38:6832/1387101372,v1:172.21.15.38:6834/1387101372] conn(0x55dba18a4f70 0x55dba18a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.448+0000 7fbd07fff640 1 --2- 172.21.15.38:0/4045110343 >> [v2:172.21.15.38:6832/1387101372,v1:172.21.15.38:6834/1387101372] conn(0x55dba18a4f70 0x55dba18a5350 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d804e602f336fe7 server_cookie=b6a7f6e53fe79764 in_seq=0 out_seq=0 2023-12-22T08:51:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.448+0000 7fbcee7fc640 10 client.8688 ms_handle_connect on v2:172.21.15.38:6832/1387101372 2023-12-22T08:51:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.448+0000 7fbcee7fc640 1 -- 172.21.15.38:0/4045110343 <== mds.0 v2:172.21.15.38:6832/1387101372 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7fbd0800d050 con 0x55dba18a4f70 2023-12-22T08:51:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.448+0000 7fbcee7fc640 10 client.8688 handle_command_reply: tid=0 2023-12-22T08:51:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.448+0000 7fbd18632740 1 client.8688 shutdown 2023-12-22T08:51:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.449+0000 7fbd18632740 1 -- 172.21.15.38:0/4045110343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 msgr2=0x55dba1872740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.449+0000 7fbd18632740 1 --2- 172.21.15.38:0/4045110343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba1872740 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fbd00007860 tx=0x7fbd00001ac0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.449+0000 7fbd18632740 1 -- 172.21.15.38:0/4045110343 shutdown_connections 2023-12-22T08:51:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.449+0000 7fbd18632740 1 --2- 172.21.15.38:0/4045110343 >> [v2:172.21.15.38:6832/1387101372,v1:172.21.15.38:6834/1387101372] conn(0x55dba18a4f70 0x55dba18a5350 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.449+0000 7fbd18632740 1 --2- 172.21.15.38:0/4045110343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dba18a5dc0 0x55dba18a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.449+0000 7fbd18632740 1 --2- 172.21.15.38:0/4045110343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55dba18a2d30 0x55dba191d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.449+0000 7fbd18632740 1 --2- 172.21.15.38:0/4045110343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dba18768b0 0x55dba1872740 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.449+0000 7fbcee7fc640 0 client.8688 ms_handle_reset on v2:172.21.15.38:6832/1387101372 2023-12-22T08:51:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.449+0000 7fbd18632740 1 -- 172.21.15.38:0/4045110343 >> 172.21.15.38:0/4045110343 conn(0x55dba1872cb0 msgr2=0x55dba18a6700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.449+0000 7fbd18632740 1 -- 172.21.15.38:0/4045110343 shutdown_connections 2023-12-22T08:51:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.449+0000 7fbd18632740 1 -- 172.21.15.38:0/4045110343 wait complete. 2023-12-22T08:51:32.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.449+0000 7fbd18632740 20 client.8688 trim_cache size 0 max 16384 2023-12-22T08:51:32.453 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:51:32.453 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:51:32.453 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-12-22T08:51:32.453 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 8553, 2023-12-22T08:51:32.453 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-12-22T08:51:32.454 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-12-22T08:51:32.454 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-12-22T08:51:32.454 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 7.3304282440000001, 2023-12-22T08:51:32.454 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 78, 2023-12-22T08:51:32.454 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 173, 2023-12-22T08:51:32.454 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 173, 2023-12-22T08:51:32.454 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 13.151157908 2023-12-22T08:51:32.454 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:51:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.450+0000 7fbd15ac4640 1 -- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbcf006a430 msgr2=0x7fbcf006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.450+0000 7fbd15ac4640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbcf006a430 0x7fbcf006c8f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbd00034000 tx=0x7fbd00009030 comp rx=0 tx=0).stop 2023-12-22T08:51:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.450+0000 7fbd15ac4640 1 -- 172.21.15.38:0/1154512573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd100b0cd0 msgr2=0x7fbd100b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.450+0000 7fbd15ac4640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd100b0cd0 0x7fbd100b1150 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8011800 tx=0x7fbcf8011cc0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.450+0000 7fbd15ac4640 1 -- 172.21.15.38:0/1154512573 shutdown_connections 2023-12-22T08:51:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.450+0000 7fbd15ac4640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd10159770 0x7fbd10159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.450+0000 7fbd15ac4640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbcf006a430 0x7fbcf006c8f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.450+0000 7fbd15ac4640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd100b0cd0 0x7fbd100b1150 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.450+0000 7fbd15ac4640 1 --2- 172.21.15.38:0/1154512573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0039c0 0x7fbd101559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.450+0000 7fbd15ac4640 1 -- 172.21.15.38:0/1154512573 >> 172.21.15.38:0/1154512573 conn(0x7fbd100cf070 msgr2=0x7fbd100cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:32.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.450+0000 7fbd15ac4640 1 -- 172.21.15.38:0/1154512573 shutdown_connections 2023-12-22T08:51:32.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.450+0000 7fbd15ac4640 1 -- 172.21.15.38:0/1154512573 wait complete. 2023-12-22T08:51:32.467 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:51:32.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.685+0000 7f715ed15640 1 Processor -- start 2023-12-22T08:51:32.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.685+0000 7f715ed15640 1 -- start start 2023-12-22T08:51:32.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.687+0000 7f715ed15640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f71580b3ff0 0x7f715806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.687+0000 7f715ed15640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71580b44a0 0x7f715806d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.687+0000 7f715ed15640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715815f220 con 0x7f7158157980 2023-12-22T08:51:32.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.687+0000 7f715ed15640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71580d1520 con 0x7f71580b3ff0 2023-12-22T08:51:32.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.687+0000 7f715ed15640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71580d1800 con 0x7f71580b44a0 2023-12-22T08:51:32.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.688+0000 7f715dd13640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7158157980 0x7f715815eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:32990/0 (socket says 172.21.15.38:32990) 2023-12-22T08:51:32.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.688+0000 7f715dd13640 1 -- 172.21.15.38:0/3921749913 learned_addr learned my addr 172.21.15.38:0/3921749913 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:32.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.688+0000 7f715d512640 1 --2- 172.21.15.38:0/3921749913 >> v2:172.21.15.38:3300/0 conn(0x7f71580b3ff0 0x7f715806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.688+0000 7f715e514640 1 --2- 172.21.15.38:0/3921749913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71580b44a0 0x7f715806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.688+0000 7f715d512640 1 -- 172.21.15.38:0/3921749913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71580b44a0 msgr2=0x7f715806d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:32.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.688+0000 7f715d512640 1 --2- 172.21.15.38:0/3921749913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71580b44a0 0x7f715806d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.688+0000 7f715d512640 1 -- 172.21.15.38:0/3921749913 >> v1:172.21.15.38:6789/0 conn(0x7f7158157980 legacy=0x7f715815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.688+0000 7f715d512640 1 -- 172.21.15.38:0/3921749913 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71580d1ae0 con 0x7f71580b3ff0 2023-12-22T08:51:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.690+0000 7f715d512640 1 --2- 172.21.15.38:0/3921749913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71580b3ff0 0x7f715806cf30 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f714c0097a0 tx=0x7f714c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e6ea634ab3c30d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.690+0000 7f715cd11640 1 -- 172.21.15.38:0/3921749913 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c02d040 con 0x7f71580b3ff0 2023-12-22T08:51:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.690+0000 7f715cd11640 1 -- 172.21.15.38:0/3921749913 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c031810 con 0x7f71580b3ff0 2023-12-22T08:51:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.690+0000 7f715cd11640 1 -- 172.21.15.38:0/3921749913 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c031ba0 con 0x7f71580b3ff0 2023-12-22T08:51:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.691+0000 7f715ed15640 1 -- 172.21.15.38:0/3921749913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71580b3ff0 msgr2=0x7f715806cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.691+0000 7f715ed15640 1 --2- 172.21.15.38:0/3921749913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71580b3ff0 0x7f715806cf30 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f714c0097a0 tx=0x7f714c02b8b0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.691+0000 7f715ed15640 1 -- 172.21.15.38:0/3921749913 shutdown_connections 2023-12-22T08:51:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.691+0000 7f715ed15640 1 --2- 172.21.15.38:0/3921749913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71580b44a0 0x7f715806d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.691+0000 7f715ed15640 1 --2- 172.21.15.38:0/3921749913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71580b3ff0 0x7f715806cf30 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.691+0000 7f715ed15640 1 -- 172.21.15.38:0/3921749913 >> 172.21.15.38:0/3921749913 conn(0x7f71580d31f0 msgr2=0x7f71580d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.691+0000 7f715ed15640 1 -- 172.21.15.38:0/3921749913 shutdown_connections 2023-12-22T08:51:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.691+0000 7f715ed15640 1 -- 172.21.15.38:0/3921749913 wait complete. 2023-12-22T08:51:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.693+0000 7f715ed15640 1 Processor -- start 2023-12-22T08:51:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.693+0000 7f715ed15640 1 -- start start 2023-12-22T08:51:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.694+0000 7f715ed15640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71580b3ff0 0x7f715814d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.694+0000 7f715ed15640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71580b44a0 0x7f715814fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.694+0000 7f715ed15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7158157980 0x7f71581503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.694+0000 7f715ed15640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71581559b0 con 0x7f71580b44a0 2023-12-22T08:51:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.694+0000 7f715ed15640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7158155010 con 0x7f7158157980 2023-12-22T08:51:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.694+0000 7f715ed15640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71581552f0 con 0x7f71580b3ff0 2023-12-22T08:51:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.694+0000 7f715d512640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71580b44a0 0x7f715814fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.694+0000 7f715d512640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71580b44a0 0x7f715814fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56088/0 (socket says 172.21.15.38:56088) 2023-12-22T08:51:32.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.694+0000 7f715d512640 1 -- 172.21.15.38:0/2677114739 learned_addr learned my addr 172.21.15.38:0/2677114739 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:32.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.694+0000 7f715d512640 1 -- 172.21.15.38:0/2677114739 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71580b3ff0 msgr2=0x7f715814d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.694+0000 7f715d512640 1 --2- 172.21.15.38:0/2677114739 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71580b3ff0 0x7f715814d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.694+0000 7f715d512640 1 -- 172.21.15.38:0/2677114739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7158157980 msgr2=0x7f71581503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.694+0000 7f715d512640 1 --2- 172.21.15.38:0/2677114739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7158157980 0x7f71581503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.695+0000 7f715d512640 1 -- 172.21.15.38:0/2677114739 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c009400 con 0x7f71580b44a0 2023-12-22T08:51:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.695+0000 7f715d512640 1 --2- 172.21.15.38:0/2677114739 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71580b44a0 0x7f715814fe60 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f714c000c00 tx=0x7f714c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.695+0000 7f71567fc640 1 -- 172.21.15.38:0/2677114739 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c006e10 con 0x7f71580b44a0 2023-12-22T08:51:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.695+0000 7f71567fc640 1 -- 172.21.15.38:0/2677114739 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c03ace0 con 0x7f71580b44a0 2023-12-22T08:51:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.695+0000 7f71567fc640 1 -- 172.21.15.38:0/2677114739 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c044630 con 0x7f71580b44a0 2023-12-22T08:51:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.695+0000 7f715ed15640 1 -- 172.21.15.38:0/2677114739 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71581555d0 con 0x7f71580b44a0 2023-12-22T08:51:32.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.695+0000 7f715ed15640 1 -- 172.21.15.38:0/2677114739 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71581570f0 con 0x7f71580b44a0 2023-12-22T08:51:32.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.697+0000 7f715ed15640 1 -- 172.21.15.38:0/2677114739 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7158155790 con 0x7f71580b44a0 2023-12-22T08:51:32.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.698+0000 7f71567fc640 1 -- 172.21.15.38:0/2677114739 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f714c04d450 con 0x7f71580b44a0 2023-12-22T08:51:32.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.698+0000 7f71567fc640 1 --2- 172.21.15.38:0/2677114739 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f714406a430 0x7f714406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:32.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.699+0000 7f71567fc640 1 -- 172.21.15.38:0/2677114739 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f714c0aab50 con 0x7f71580b44a0 2023-12-22T08:51:32.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.699+0000 7f715dd13640 1 --2- 172.21.15.38:0/2677114739 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f714406a430 0x7f714406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:32.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.700+0000 7f715dd13640 1 --2- 172.21.15.38:0/2677114739 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f714406a430 0x7f714406c8f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f71480015f0 tx=0x7f7148007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:32.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.703+0000 7f71567fc640 1 -- 172.21.15.38:0/2677114739 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f714c076010 con 0x7f71580b44a0 2023-12-22T08:51:32.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.936+0000 7f715ed15640 1 -- 172.21.15.38:0/2677114739 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7158061910 con 0x7f71580b44a0 2023-12-22T08:51:32.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.937+0000 7f71567fc640 1 -- 172.21.15.38:0/2677114739 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7f714c035070 con 0x7f71580b44a0 2023-12-22T08:51:32.938 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:51:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.940+0000 7f715ed15640 1 -- 172.21.15.38:0/2677114739 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f714406a430 msgr2=0x7f714406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.940+0000 7f715ed15640 1 --2- 172.21.15.38:0/2677114739 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f714406a430 0x7f714406c8f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f71480015f0 tx=0x7f7148007a40 comp rx=0 tx=0).stop 2023-12-22T08:51:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.940+0000 7f715ed15640 1 -- 172.21.15.38:0/2677114739 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71580b44a0 msgr2=0x7f715814fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.940+0000 7f715ed15640 1 --2- 172.21.15.38:0/2677114739 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71580b44a0 0x7f715814fe60 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f714c000c00 tx=0x7f714c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.940+0000 7f715ed15640 1 -- 172.21.15.38:0/2677114739 shutdown_connections 2023-12-22T08:51:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.940+0000 7f715ed15640 1 --2- 172.21.15.38:0/2677114739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7158157980 0x7f71581503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.940+0000 7f715ed15640 1 --2- 172.21.15.38:0/2677114739 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f714406a430 0x7f714406c8f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.940+0000 7f715ed15640 1 --2- 172.21.15.38:0/2677114739 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71580b44a0 0x7f715814fe60 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.940+0000 7f715ed15640 1 --2- 172.21.15.38:0/2677114739 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71580b3ff0 0x7f715814d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.940+0000 7f715ed15640 1 -- 172.21.15.38:0/2677114739 >> 172.21.15.38:0/2677114739 conn(0x7f71580d31f0 msgr2=0x7f715815e070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.940+0000 7f715ed15640 1 -- 172.21.15.38:0/2677114739 shutdown_connections 2023-12-22T08:51:32.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:32.940+0000 7f715ed15640 1 -- 172.21.15.38:0/2677114739 wait complete. 2023-12-22T08:51:32.960 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:51:32.960 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:51:32.960 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-12-22T08:51:32.960 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T08:51:32.960 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:51:32.960 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:51:32.961 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:51:32.961 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:51:32.961 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:51:32.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:32.961 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-12-22T08:51:33.012 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:51:33.012 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:51:33.012 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:51:33.012 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:33.012 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:51:33.012 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:33.012 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 41673sec preferred_lft 41673sec 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:51:33.013 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::5440:f6ff:fe40:85a/64 scope link 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:c3:65:6c:32:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::e4c3:65ff:fe6c:322e/64 scope link 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::34bf:8aff:fe68:3bf6/64 scope link 2023-12-22T08:51:33.014 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:33.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:33.016 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:51:33.103 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-12-22T08:51:33.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:33.108 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-12-22T08:51:33.169 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-12-22T08:51:33.169 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:51:33.169 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-22T08:51:33.169 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-22T08:51:33.169 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:51:33.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:33.170 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:51:33.171 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:51:33.171 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T08:51:33.171 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T08:51:33.171 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T08:51:33.171 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:51:33.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:33.365 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:51:33.419 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:51:33.420 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-22T08:51:33.421 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:51:33.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:33.421 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-12-22T08:51:33.524 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:51:33.524 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T08:51:33.582 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:51:33.583 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:51:33.583 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:51:33.637 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-22T08:51:33.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:33.637 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:51:33.789 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:51:33.789 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:51:33.821 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:51:33.821 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:51:33.822 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:51:33.822 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with new device syntax: 0@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:51:33.822 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:51:33.823 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T08:51:33.823 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:51:33.823 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:51:33.823 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:51:33.824 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:51:33.827 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:51:33.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:33.827 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:51:33.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:33.913 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:51:33.994 INFO:teuthology.orchestra.run.smithi038.stdout:client8697 2023-12-22T08:51:33.994 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:51:33.994 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:51:34.055 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:51:34.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.278+0000 7f8934e50640 1 Processor -- start 2023-12-22T08:51:34.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.279+0000 7f8934e50640 1 -- start start 2023-12-22T08:51:34.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.280+0000 7f8934e50640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930157980 0x7f893015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:34.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.280+0000 7f8934e50640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f893006d640 0x7f89300d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:34.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.280+0000 7f8934e50640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89300d1520 con 0x7f89300b3ff0 2023-12-22T08:51:34.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.280+0000 7f8934e50640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89300d1800 con 0x7f893006d640 2023-12-22T08:51:34.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.280+0000 7f8934e50640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89300d1ae0 con 0x7f8930157980 2023-12-22T08:51:34.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.281+0000 7f892effd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f89300b3ff0 0x7f893006cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:32998/0 (socket says 172.21.15.38:32998) 2023-12-22T08:51:34.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.281+0000 7f892effd640 1 -- 172.21.15.38:0/4264656228 learned_addr learned my addr 172.21.15.38:0/4264656228 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:34.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.281+0000 7f892f7fe640 1 --2- 172.21.15.38:0/4264656228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930157980 0x7f893015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:34.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.281+0000 7f892ffff640 1 --2- 172.21.15.38:0/4264656228 >> v2:172.21.15.89:3300/0 conn(0x7f893006d640 0x7f89300d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:34.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.281+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137253272 0 0) 0x7f89300d1520 con 0x7f89300b3ff0 2023-12-22T08:51:34.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.281+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8918003520 con 0x7f89300b3ff0 2023-12-22T08:51:34.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 873261025 0 0) 0x7f8918003520 con 0x7f89300b3ff0 2023-12-22T08:51:34.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930157980 msgr2=0x7f893015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:34.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 --2- 172.21.15.38:0/4264656228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930157980 0x7f893015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:34.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 >> v2:172.21.15.89:3300/0 conn(0x7f893006d640 msgr2=0x7f89300d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:34.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 --2- 172.21.15.38:0/4264656228 >> v2:172.21.15.89:3300/0 conn(0x7f893006d640 0x7f89300d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:34.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89300d1dc0 con 0x7f89300b3ff0 2023-12-22T08:51:34.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f8924001670 con 0x7f89300b3ff0 2023-12-22T08:51:34.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 >> v1:172.21.15.38:6789/0 conn(0x7f89300b3ff0 legacy=0x7f893006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:34.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 --2- 172.21.15.38:0/4264656228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930157980 0x7f8918003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:34.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 --2- 172.21.15.38:0/4264656228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8918003ef0 0x7f89180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:34.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 --2- 172.21.15.38:0/4264656228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8918004d00 0x7f8918005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:34.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89300d1800 con 0x7f8918003ef0 2023-12-22T08:51:34.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89300d1ae0 con 0x7f8918004d00 2023-12-22T08:51:34.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891800b980 con 0x7f8930157980 2023-12-22T08:51:34.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892effd640 1 --2- 172.21.15.38:0/4264656228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8918003ef0 0x7f89180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:34.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892f7fe640 1 --2- 172.21.15.38:0/4264656228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930157980 0x7f8918003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:34.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.282+0000 7f892ffff640 1 --2- 172.21.15.38:0/4264656228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8918004d00 0x7f8918005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:34.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.283+0000 7f892effd640 1 -- 172.21.15.38:0/4264656228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930157980 msgr2=0x7f8918003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:34.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.283+0000 7f892effd640 1 --2- 172.21.15.38:0/4264656228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930157980 0x7f8918003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:34.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.283+0000 7f892effd640 1 -- 172.21.15.38:0/4264656228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8918004d00 msgr2=0x7f8918005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:34.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.283+0000 7f892effd640 1 --2- 172.21.15.38:0/4264656228 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8918004d00 0x7f8918005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:34.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.283+0000 7f892effd640 1 -- 172.21.15.38:0/4264656228 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918003520 con 0x7f8918003ef0 2023-12-22T08:51:34.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.284+0000 7f892effd640 1 --2- 172.21.15.38:0/4264656228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8918003ef0 0x7f89180047c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f892400c290 tx=0x7f89180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a678b999e87ceb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:34.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.284+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924005ad0 con 0x7f8918003ef0 2023-12-22T08:51:34.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.284+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8924005c30 con 0x7f8918003ef0 2023-12-22T08:51:34.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.284+0000 7f892e7fc640 1 -- 172.21.15.38:0/4264656228 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892402c8c0 con 0x7f8918003ef0 2023-12-22T08:51:34.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.285+0000 7f8934e50640 1 -- 172.21.15.38:0/4264656228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8918003ef0 msgr2=0x7f89180047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:34.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.285+0000 7f8934e50640 1 --2- 172.21.15.38:0/4264656228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8918003ef0 0x7f89180047c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f892400c290 tx=0x7f89180057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:34.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.285+0000 7f892ffff640 1 -- 172.21.15.38:0/4264656228 reap_dead start 2023-12-22T08:51:34.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.285+0000 7f8934e50640 1 -- 172.21.15.38:0/4264656228 shutdown_connections 2023-12-22T08:51:34.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.285+0000 7f8934e50640 1 -- 172.21.15.38:0/4264656228 >> 172.21.15.38:0/4264656228 conn(0x7f89300d31f0 msgr2=0x7f89300d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:34.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.285+0000 7f8934e50640 1 -- 172.21.15.38:0/4264656228 shutdown_connections 2023-12-22T08:51:34.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.285+0000 7f8934e50640 1 -- 172.21.15.38:0/4264656228 wait complete. 2023-12-22T08:51:34.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.287+0000 7f8934e50640 1 Processor -- start 2023-12-22T08:51:34.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.287+0000 7f8934e50640 1 -- start start 2023-12-22T08:51:34.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.288+0000 7f8934e50640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8918003ef0 0x7f893014b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:34.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.288+0000 7f8934e50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8930154190 0x7f8930154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:34.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.288+0000 7f8934e50640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930156450 0x7f89300b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:34.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.288+0000 7f8934e50640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893014bab0 con 0x7f8918003ef0 2023-12-22T08:51:34.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.288+0000 7f8934e50640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89301553b0 con 0x7f8930154190 2023-12-22T08:51:34.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.288+0000 7f8934e50640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8930155690 con 0x7f8930156450 2023-12-22T08:51:34.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.288+0000 7f892f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8918003ef0 0x7f893014b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:34.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.288+0000 7f892f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8918003ef0 0x7f893014b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56116/0 (socket says 172.21.15.38:56116) 2023-12-22T08:51:34.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.288+0000 7f892f7fe640 1 -- 172.21.15.38:0/2499998483 learned_addr learned my addr 172.21.15.38:0/2499998483 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:34.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.289+0000 7f892ffff640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930156450 0x7f89300b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:34.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.289+0000 7f892effd640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8930154190 0x7f8930154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:34.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.289+0000 7f892f7fe640 1 -- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930156450 msgr2=0x7f89300b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:34.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.289+0000 7f892f7fe640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930156450 0x7f89300b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:34.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.289+0000 7f892f7fe640 1 -- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8930154190 msgr2=0x7f8930154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:34.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.289+0000 7f892f7fe640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8930154190 0x7f8930154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:34.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.289+0000 7f892f7fe640 1 -- 172.21.15.38:0/2499998483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8930155970 con 0x7f8918003ef0 2023-12-22T08:51:34.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.289+0000 7f892ffff640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930156450 0x7f89300b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:34.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.289+0000 7f892f7fe640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8918003ef0 0x7f893014b570 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f8920011600 tx=0x7f8920011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:34.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.289+0000 7f8917fff640 1 -- 172.21.15.38:0/2499998483 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000f920 con 0x7f8918003ef0 2023-12-22T08:51:34.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.289+0000 7f8917fff640 1 -- 172.21.15.38:0/2499998483 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892000fa80 con 0x7f8918003ef0 2023-12-22T08:51:34.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.289+0000 7f8917fff640 1 -- 172.21.15.38:0/2499998483 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000fdf0 con 0x7f8918003ef0 2023-12-22T08:51:34.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.289+0000 7f8934e50640 1 -- 172.21.15.38:0/2499998483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8930155c50 con 0x7f8918003ef0 2023-12-22T08:51:34.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.290+0000 7f8934e50640 1 -- 172.21.15.38:0/2499998483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8930154fc0 con 0x7f8918003ef0 2023-12-22T08:51:34.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.291+0000 7f8934e50640 1 -- 172.21.15.38:0/2499998483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8930061910 con 0x7f8918003ef0 2023-12-22T08:51:34.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.292+0000 7f8917fff640 1 -- 172.21.15.38:0/2499998483 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8920015460 con 0x7f8918003ef0 2023-12-22T08:51:34.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.293+0000 7f8917fff640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f891c06a460 0x7f891c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:34.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.293+0000 7f8917fff640 1 -- 172.21.15.38:0/2499998483 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8920088de0 con 0x7f8918003ef0 2023-12-22T08:51:34.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.294+0000 7f892effd640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f891c06a460 0x7f891c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:34.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.295+0000 7f892effd640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f891c06a460 0x7f891c06c920 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8924034000 tx=0x7f8924007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:34.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.297+0000 7f8917fff640 1 -- 172.21.15.38:0/2499998483 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8920054330 con 0x7f8918003ef0 2023-12-22T08:51:34.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.540+0000 7f8934e50640 1 -- 172.21.15.38:0/2499998483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f893006dcf0 con 0x7f8918003ef0 2023-12-22T08:51:34.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.541+0000 7f8917fff640 1 -- 172.21.15.38:0/2499998483 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8920057950 con 0x7f8918003ef0 2023-12-22T08:51:34.542 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:51:34.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.544+0000 7f8934e50640 1 -- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f891c06a460 msgr2=0x7f891c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:34.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.544+0000 7f8934e50640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f891c06a460 0x7f891c06c920 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8924034000 tx=0x7f8924007000 comp rx=0 tx=0).stop 2023-12-22T08:51:34.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.544+0000 7f8934e50640 1 -- 172.21.15.38:0/2499998483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8918003ef0 msgr2=0x7f893014b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:34.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.544+0000 7f8934e50640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8918003ef0 0x7f893014b570 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f8920011600 tx=0x7f8920011ac0 comp rx=0 tx=0).stop 2023-12-22T08:51:34.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.544+0000 7f8934e50640 1 -- 172.21.15.38:0/2499998483 shutdown_connections 2023-12-22T08:51:34.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.544+0000 7f8934e50640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8930156450 0x7f89300b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:34.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.544+0000 7f8934e50640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8930154190 0x7f8930154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:34.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.544+0000 7f8934e50640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f891c06a460 0x7f891c06c920 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:34.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.544+0000 7f8934e50640 1 --2- 172.21.15.38:0/2499998483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8918003ef0 0x7f893014b570 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:34.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.544+0000 7f8934e50640 1 -- 172.21.15.38:0/2499998483 >> 172.21.15.38:0/2499998483 conn(0x7f89300d31f0 msgr2=0x7f893015b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:34.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.544+0000 7f8934e50640 1 -- 172.21.15.38:0/2499998483 shutdown_connections 2023-12-22T08:51:34.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:34.544+0000 7f8934e50640 1 -- 172.21.15.38:0/2499998483 wait complete. 2023-12-22T08:51:34.565 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:51:34.565 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:51:34.565 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-22T08:51:34.565 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T08:51:34.565 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T08:51:34.565 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:51:34.565 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:51:34.565 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:51:34.566 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:51:34.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:34.566 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-22T08:51:34.628 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:51:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:51:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:51:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:51:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:34.628 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:51:34.628 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:51:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-22T08:51:34.629 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:51:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:51:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-22T08:51:34.629 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:51:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:51:34.629 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:51:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:51:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:51:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 41667sec preferred_lft 41667sec 2023-12-22T08:51:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-22T08:51:34.629 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::9cc2:a9ff:fe75:e812/64 scope link 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8e:46:07:65:e3:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::8c46:7ff:fe65:e31f/64 scope link 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2cc2:baff:fe6f:ea22/64 scope link 2023-12-22T08:51:34.630 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:51:34.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:34.632 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:51:34.725 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-22T08:51:34.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:34.729 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-22T08:51:34.783 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-22T08:51:34.783 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:51:34.783 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:51:34.783 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:51:34.783 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:51:34.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:34.784 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:51:34.784 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:51:34.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:51:34.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:51:34.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:51:34.784 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:51:34.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:34.958 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:51:35.011 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T08:51:35.011 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-22T08:51:35.011 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:51:35.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:35.012 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-22T08:51:35.108 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:51:35.122 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T08:51:35.181 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:51:35.181 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:51:35.182 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:51:35.235 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-22T08:51:35.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:35.235 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:51:35.373 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:51:35.374 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:51:35.406 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:51:35.407 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:51:35.407 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:51:35.407 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 1@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:51:35.407 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:51:35.408 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T08:51:35.408 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:51:35.409 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:51:35.409 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:51:35.409 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:51:35.412 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:51:35.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:35.412 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:51:35.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:51:35.489 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:51:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:client6218 2023-12-22T08:51:35.547 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:51:35.547 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:51:35.594 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:51:35.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.830+0000 7fc46e342640 1 Processor -- start 2023-12-22T08:51:35.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.831+0000 7fc46e342640 1 -- start start 2023-12-22T08:51:35.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.832+0000 7fc46e342640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc46806d640 0x7fc4680d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:35.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.832+0000 7fc46e342640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46815f220 con 0x7fc4680b3ff0 2023-12-22T08:51:35.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.832+0000 7fc46e342640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4680d1520 con 0x7fc468157980 2023-12-22T08:51:35.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.832+0000 7fc46e342640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4680d1800 con 0x7fc46806d640 2023-12-22T08:51:35.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.833+0000 7fc46cb3f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc4680b3ff0 0x7fc46806cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33010/0 (socket says 172.21.15.38:33010) 2023-12-22T08:51:35.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.833+0000 7fc46cb3f640 1 -- 172.21.15.38:0/3049977402 learned_addr learned my addr 172.21.15.38:0/3049977402 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:51:35.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.833+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559737971 0 0) 0x7fc46815f220 con 0x7fc4680b3ff0 2023-12-22T08:51:35.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.833+0000 7fc46db41640 1 --2- 172.21.15.38:0/3049977402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc46806d640 0x7fc4680d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.833+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc454003520 con 0x7fc4680b3ff0 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2997322176 0 0) 0x7fc454003520 con 0x7fc4680b3ff0 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc46806d640 msgr2=0x7fc4680d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc45ffff640 1 --2- 172.21.15.38:0/3049977402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc46806d640 0x7fc4680d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 >> v1:172.21.15.89:6789/0 conn(0x7fc468157980 legacy=0x7fc46815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4680d1ae0 con 0x7fc4680b3ff0 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fc458001670 con 0x7fc4680b3ff0 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 >> v1:172.21.15.38:6789/0 conn(0x7fc4680b3ff0 legacy=0x7fc46806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc45ffff640 1 --2- 172.21.15.38:0/3049977402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc46806d640 0x7fc4540039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc45ffff640 1 --2- 172.21.15.38:0/3049977402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc454004020 0x7fc4540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc45ffff640 1 --2- 172.21.15.38:0/3049977402 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc454004d00 0x7fc454005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4680d1800 con 0x7fc454004d00 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45400bbc0 con 0x7fc454004020 2023-12-22T08:51:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45400bd80 con 0x7fc46806d640 2023-12-22T08:51:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc46db41640 1 --2- 172.21.15.38:0/3049977402 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc454004d00 0x7fc454005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc46cb3f640 1 --2- 172.21.15.38:0/3049977402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc454004020 0x7fc4540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc46d340640 1 --2- 172.21.15.38:0/3049977402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc46806d640 0x7fc4540039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.834+0000 7fc46db41640 1 -- 172.21.15.38:0/3049977402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc46806d640 msgr2=0x7fc4540039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.835+0000 7fc46db41640 1 --2- 172.21.15.38:0/3049977402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc46806d640 0x7fc4540039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.835+0000 7fc46db41640 1 -- 172.21.15.38:0/3049977402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc454004020 msgr2=0x7fc4540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.835+0000 7fc46db41640 1 --2- 172.21.15.38:0/3049977402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc454004020 0x7fc4540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.835+0000 7fc46db41640 1 -- 172.21.15.38:0/3049977402 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc454003520 con 0x7fc454004d00 2023-12-22T08:51:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.835+0000 7fc46cb3f640 1 --2- 172.21.15.38:0/3049977402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc454004020 0x7fc4540047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:35.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.836+0000 7fc46db41640 1 --2- 172.21.15.38:0/3049977402 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc454004d00 0x7fc454005180 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fc46806e610 tx=0x7fc4540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b1c42b70c76eb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:35.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.836+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4600325f0 con 0x7fc454004d00 2023-12-22T08:51:35.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.836+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc460032750 con 0x7fc454004d00 2023-12-22T08:51:35.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.836+0000 7fc45ffff640 1 -- 172.21.15.38:0/3049977402 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460032ae0 con 0x7fc454004d00 2023-12-22T08:51:35.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.836+0000 7fc46e342640 1 -- 172.21.15.38:0/3049977402 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc454004d00 msgr2=0x7fc454005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.836+0000 7fc46e342640 1 --2- 172.21.15.38:0/3049977402 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc454004d00 0x7fc454005180 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fc46806e610 tx=0x7fc4540057f0 comp rx=0 tx=0).stop 2023-12-22T08:51:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.836+0000 7fc46db41640 1 -- 172.21.15.38:0/3049977402 reap_dead start 2023-12-22T08:51:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.837+0000 7fc46e342640 1 -- 172.21.15.38:0/3049977402 shutdown_connections 2023-12-22T08:51:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.837+0000 7fc46e342640 1 -- 172.21.15.38:0/3049977402 >> 172.21.15.38:0/3049977402 conn(0x7fc4680d31f0 msgr2=0x7fc4680d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.837+0000 7fc46e342640 1 -- 172.21.15.38:0/3049977402 shutdown_connections 2023-12-22T08:51:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.837+0000 7fc46e342640 1 -- 172.21.15.38:0/3049977402 wait complete. 2023-12-22T08:51:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.838+0000 7fc46e342640 1 Processor -- start 2023-12-22T08:51:35.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.839+0000 7fc46e342640 1 -- start start 2023-12-22T08:51:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46e342640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc454004d00 0x7fc4681f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46e342640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc46815fbe0 0x7fc46814c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46e342640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc46814c9e0 0x7fc4681f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46e342640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc468148740 con 0x7fc454004d00 2023-12-22T08:51:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46e342640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46814ce60 con 0x7fc46814c9e0 2023-12-22T08:51:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46e342640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4680b79f0 con 0x7fc46815fbe0 2023-12-22T08:51:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46d340640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc454004d00 0x7fc4681f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46d340640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc454004d00 0x7fc4681f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56140/0 (socket says 172.21.15.38:56140) 2023-12-22T08:51:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46d340640 1 -- 172.21.15.38:0/459823145 learned_addr learned my addr 172.21.15.38:0/459823145 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46db41640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc46814c9e0 0x7fc4681f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46cb3f640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc46815fbe0 0x7fc46814c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46d340640 1 -- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc46815fbe0 msgr2=0x7fc46814c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46d340640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc46815fbe0 0x7fc46814c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46d340640 1 -- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc46814c9e0 msgr2=0x7fc4681f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46d340640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc46814c9e0 0x7fc4681f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.840+0000 7fc46d340640 1 -- 172.21.15.38:0/459823145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46814c150 con 0x7fc454004d00 2023-12-22T08:51:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.841+0000 7fc46d340640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc454004d00 0x7fc4681f2580 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fc46400d860 tx=0x7fc46400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.841+0000 7fc45dffb640 1 -- 172.21.15.38:0/459823145 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464003da0 con 0x7fc454004d00 2023-12-22T08:51:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.841+0000 7fc45dffb640 1 -- 172.21.15.38:0/459823145 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc464005070 con 0x7fc454004d00 2023-12-22T08:51:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.841+0000 7fc45dffb640 1 -- 172.21.15.38:0/459823145 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464005460 con 0x7fc454004d00 2023-12-22T08:51:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.841+0000 7fc46e342640 1 -- 172.21.15.38:0/459823145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4680b6950 con 0x7fc454004d00 2023-12-22T08:51:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.841+0000 7fc46e342640 1 -- 172.21.15.38:0/459823145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4680b6f10 con 0x7fc454004d00 2023-12-22T08:51:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.842+0000 7fc46e342640 1 -- 172.21.15.38:0/459823145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc468061910 con 0x7fc454004d00 2023-12-22T08:51:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.843+0000 7fc45dffb640 1 -- 172.21.15.38:0/459823145 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc4640055c0 con 0x7fc454004d00 2023-12-22T08:51:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.844+0000 7fc45dffb640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc44c06a480 0x7fc44c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.844+0000 7fc45dffb640 1 -- 172.21.15.38:0/459823145 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc464088ac0 con 0x7fc454004d00 2023-12-22T08:51:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.845+0000 7fc46cb3f640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc44c06a480 0x7fc44c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.846+0000 7fc46cb3f640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc44c06a480 0x7fc44c06c940 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc468160400 tx=0x7fc458009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:35.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:35.849+0000 7fc45dffb640 1 -- 172.21.15.38:0/459823145 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc464054120 con 0x7fc454004d00 2023-12-22T08:51:36.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.079+0000 7fc46e342640 1 -- 172.21.15.38:0/459823145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4680d0f20 con 0x7fc454004d00 2023-12-22T08:51:36.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.080+0000 7fc45dffb640 1 -- 172.21.15.38:0/459823145 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4649 (secure 0 0 0) 0x7fc464057740 con 0x7fc454004d00 2023-12-22T08:51:36.081 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:51:36.082 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1443382612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1443382612},{"type":"v1","addr":"172.21.15.38:6835","nonce":1443382612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1913310975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1913310975},{"type":"v1","addr":"172.21.15.89:6836","nonce":1913310975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/218839128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":218839128},{"type":"v1","addr":"172.21.15.89:6837","nonce":218839128}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:51:25.111775+0000","modified":"2023-12-22T08:51:28.645925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8553":{"gid":8553,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6834/1387101372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1387101372},{"type":"v1","addr":"172.21.15.38:6834","nonce":1387101372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-22T08:51:36.082 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 78 2023-12-22T08:51:36.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.083+0000 7fc46e342640 1 -- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc44c06a480 msgr2=0x7fc44c06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:36.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.083+0000 7fc46e342640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc44c06a480 0x7fc44c06c940 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc468160400 tx=0x7fc458009040 comp rx=0 tx=0).stop 2023-12-22T08:51:36.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.083+0000 7fc46e342640 1 -- 172.21.15.38:0/459823145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc454004d00 msgr2=0x7fc4681f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:36.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.083+0000 7fc46e342640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc454004d00 0x7fc4681f2580 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fc46400d860 tx=0x7fc46400dd20 comp rx=0 tx=0).stop 2023-12-22T08:51:36.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.083+0000 7fc46e342640 1 -- 172.21.15.38:0/459823145 shutdown_connections 2023-12-22T08:51:36.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.083+0000 7fc46e342640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc46814c9e0 0x7fc4681f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:36.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.083+0000 7fc46e342640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc46815fbe0 0x7fc46814c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:36.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.083+0000 7fc46e342640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc44c06a480 0x7fc44c06c940 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:36.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.083+0000 7fc46e342640 1 --2- 172.21.15.38:0/459823145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc454004d00 0x7fc4681f2580 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:36.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.083+0000 7fc46e342640 1 -- 172.21.15.38:0/459823145 >> 172.21.15.38:0/459823145 conn(0x7fc4680d31f0 msgr2=0x7fc46815e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:36.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.083+0000 7fc46e342640 1 -- 172.21.15.38:0/459823145 shutdown_connections 2023-12-22T08:51:36.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.083+0000 7fc46e342640 1 -- 172.21.15.38:0/459823145 wait complete. 2023-12-22T08:51:36.105 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-22T08:51:36.345 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":8553,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.209204185999999,"mdsmap_epoch":78,"osdmap_epoch":173,"osdmap_epoch_barrier":173,"uptime":17.029947557} 2023-12-22T08:51:36.346 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 8553, "mdsmap_epoch": 78, "osdmap_epoch": 173, "osdmap_epoch_barrier": 173, "rank_uptime": 11.209204186, "state": "up:active", "uptime": 17.029947557, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:51:36.346 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-22T08:51:36.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.581+0000 7f5010f42640 1 Processor -- start 2023-12-22T08:51:36.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.581+0000 7f5010f42640 1 -- start start 2023-12-22T08:51:36.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.583+0000 7f5010f42640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f500c1437f0 0x7f500c0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:36.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.583+0000 7f5010f42640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500c143bd0 0x7f500c0b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:36.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.583+0000 7f5010f42640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500c072010 con 0x7f500c06f250 2023-12-22T08:51:36.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.583+0000 7f5010f42640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500c0b4490 con 0x7f500c1437f0 2023-12-22T08:51:36.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.583+0000 7f5010f42640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c15ece0 con 0x7f500c143bd0 2023-12-22T08:51:36.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.583+0000 7f500b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f500c1437f0 0x7f500c0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:36.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.583+0000 7f500bfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f500c06f250 0x7f500c06d180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:33026/0 (socket says 172.21.15.38:33026) 2023-12-22T08:51:36.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.583+0000 7f500b7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f500c1437f0 0x7f500c0b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56156/0 (socket says 172.21.15.38:56156) 2023-12-22T08:51:36.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.584+0000 7f500b7fe640 1 -- 172.21.15.38:0/2677979972 learned_addr learned my addr 172.21.15.38:0/2677979972 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:36.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.584+0000 7f500affd640 1 --2- 172.21.15.38:0/2677979972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500c143bd0 0x7f500c0b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:36.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.584+0000 7f500b7fe640 1 -- 172.21.15.38:0/2677979972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500c143bd0 msgr2=0x7f500c0b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:51:36.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.584+0000 7f500b7fe640 1 --2- 172.21.15.38:0/2677979972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500c143bd0 0x7f500c0b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:36.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.584+0000 7f500b7fe640 1 -- 172.21.15.38:0/2677979972 >> v1:172.21.15.38:6789/0 conn(0x7f500c06f250 legacy=0x7f500c06d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:36.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.584+0000 7f500b7fe640 1 -- 172.21.15.38:0/2677979972 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c15df20 con 0x7f500c1437f0 2023-12-22T08:51:36.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.584+0000 7f500a7fc640 1 -- 172.21.15.38:0/2677979972 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914043322 0 0) 0x7f500c072010 con 0x7f500c06f250 2023-12-22T08:51:36.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.585+0000 7f500b7fe640 1 --2- 172.21.15.38:0/2677979972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f500c1437f0 0x7f500c0b3920 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0098a0 tx=0x7f4ffc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c2adb333296963 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:36.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.586+0000 7f500a7fc640 1 -- 172.21.15.38:0/2677979972 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc030840 con 0x7f500c1437f0 2023-12-22T08:51:36.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.586+0000 7f500a7fc640 1 -- 172.21.15.38:0/2677979972 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc0309a0 con 0x7f500c1437f0 2023-12-22T08:51:36.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.586+0000 7f500a7fc640 1 -- 172.21.15.38:0/2677979972 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc030d30 con 0x7f500c1437f0 2023-12-22T08:51:36.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.586+0000 7f5010f42640 1 -- 172.21.15.38:0/2677979972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f500c1437f0 msgr2=0x7f500c0b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:36.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.586+0000 7f5010f42640 1 --2- 172.21.15.38:0/2677979972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f500c1437f0 0x7f500c0b3920 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0098a0 tx=0x7f4ffc02b980 comp rx=0 tx=0).stop 2023-12-22T08:51:36.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.587+0000 7f5010f42640 1 -- 172.21.15.38:0/2677979972 shutdown_connections 2023-12-22T08:51:36.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.587+0000 7f5010f42640 1 --2- 172.21.15.38:0/2677979972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500c143bd0 0x7f500c0b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:36.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.587+0000 7f5010f42640 1 --2- 172.21.15.38:0/2677979972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f500c1437f0 0x7f500c0b3920 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:36.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.587+0000 7f5010f42640 1 -- 172.21.15.38:0/2677979972 >> 172.21.15.38:0/2677979972 conn(0x7f500c0b1110 msgr2=0x7f500c0b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:36.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.587+0000 7f5010f42640 1 -- 172.21.15.38:0/2677979972 shutdown_connections 2023-12-22T08:51:36.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.587+0000 7f5010f42640 1 -- 172.21.15.38:0/2677979972 wait complete. 2023-12-22T08:51:36.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.589+0000 7f5010f42640 1 Processor -- start 2023-12-22T08:51:36.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.589+0000 7f5010f42640 1 -- start start 2023-12-22T08:51:36.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.590+0000 7f5010f42640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f500c06f250 0x7f500c140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:36.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.590+0000 7f5010f42640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f500c1437f0 0x7f500c1f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:36.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.590+0000 7f5010f42640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500c143bd0 0x7f500c1f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:36.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.590+0000 7f5010f42640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c13f880 con 0x7f500c1437f0 2023-12-22T08:51:36.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.590+0000 7f5010f42640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c13fb60 con 0x7f500c06f250 2023-12-22T08:51:36.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.590+0000 7f5010f42640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c13fe40 con 0x7f500c143bd0 2023-12-22T08:51:36.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.590+0000 7f500affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f500c1437f0 0x7f500c1f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:36.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.590+0000 7f500affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f500c1437f0 0x7f500c1f6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56166/0 (socket says 172.21.15.38:56166) 2023-12-22T08:51:36.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.590+0000 7f500affd640 1 -- 172.21.15.38:0/1432626450 learned_addr learned my addr 172.21.15.38:0/1432626450 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:51:36.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.591+0000 7f500affd640 1 -- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500c143bd0 msgr2=0x7f500c1f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:36.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.591+0000 7f500affd640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500c143bd0 0x7f500c1f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:36.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.591+0000 7f500affd640 1 -- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f500c06f250 msgr2=0x7f500c140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:36.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.591+0000 7f500b7fe640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f500c06f250 0x7f500c140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:36.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.591+0000 7f500affd640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f500c06f250 0x7f500c140c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:36.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.591+0000 7f500affd640 1 -- 172.21.15.38:0/1432626450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc0094d0 con 0x7f500c1437f0 2023-12-22T08:51:36.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.591+0000 7f500b7fe640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f500c06f250 0x7f500c140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:51:36.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.591+0000 7f500affd640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f500c1437f0 0x7f500c1f6220 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f500000d5f0 tx=0x7f500000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:36.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.592+0000 7f4ff3fff640 1 -- 172.21.15.38:0/1432626450 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50000125f0 con 0x7f500c1437f0 2023-12-22T08:51:36.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.592+0000 7f4ff3fff640 1 -- 172.21.15.38:0/1432626450 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5000012750 con 0x7f500c1437f0 2023-12-22T08:51:36.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.592+0000 7f5010f42640 1 -- 172.21.15.38:0/1432626450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500c140120 con 0x7f500c1437f0 2023-12-22T08:51:36.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.592+0000 7f4ff3fff640 1 -- 172.21.15.38:0/1432626450 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000012b00 con 0x7f500c1437f0 2023-12-22T08:51:36.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.592+0000 7f5010f42640 1 -- 172.21.15.38:0/1432626450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c1406e0 con 0x7f500c1437f0 2023-12-22T08:51:36.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.593+0000 7f5010f42640 1 -- 172.21.15.38:0/1432626450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500c1408a0 con 0x7f500c1437f0 2023-12-22T08:51:36.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.594+0000 7f4ff3fff640 1 -- 172.21.15.38:0/1432626450 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5000012c60 con 0x7f500c1437f0 2023-12-22T08:51:36.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.595+0000 7f4ff3fff640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ff806a430 0x7f4ff806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:51:36.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.595+0000 7f4ff3fff640 1 -- 172.21.15.38:0/1432626450 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5000089950 con 0x7f500c1437f0 2023-12-22T08:51:36.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.596+0000 7f500b7fe640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ff806a430 0x7f4ff806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:51:36.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.597+0000 7f500b7fe640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ff806a430 0x7f4ff806c8f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc036000 tx=0x7f4ffc03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:51:36.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.599+0000 7f4ff3fff640 1 -- 172.21.15.38:0/1432626450 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5000054f20 con 0x7f500c1437f0 2023-12-22T08:51:36.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:36.797+0000 7f5010f42640 1 -- 172.21.15.38:0/1432626450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f500c061910 con 0x7f500c1437f0 2023-12-22T08:51:37.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:37.743+0000 7f4ff3fff640 1 -- 172.21.15.38:0/1432626450 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v174) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5000058540 con 0x7f500c1437f0 2023-12-22T08:51:37.744 INFO:teuthology.orchestra.run.smithi038.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-22T08:51:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:37.747+0000 7f5010f42640 1 -- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ff806a430 msgr2=0x7f4ff806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:37.747+0000 7f5010f42640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ff806a430 0x7f4ff806c8f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc036000 tx=0x7f4ffc03b040 comp rx=0 tx=0).stop 2023-12-22T08:51:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:37.747+0000 7f5010f42640 1 -- 172.21.15.38:0/1432626450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f500c1437f0 msgr2=0x7f500c1f6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:51:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:37.747+0000 7f5010f42640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f500c1437f0 0x7f500c1f6220 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f500000d5f0 tx=0x7f500000dab0 comp rx=0 tx=0).stop 2023-12-22T08:51:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:37.747+0000 7f5010f42640 1 -- 172.21.15.38:0/1432626450 shutdown_connections 2023-12-22T08:51:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:37.747+0000 7f5010f42640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f500c143bd0 0x7f500c1f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:37.747+0000 7f5010f42640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4ff806a430 0x7f4ff806c8f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:37.747+0000 7f5010f42640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f500c1437f0 0x7f500c1f6220 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:37.747+0000 7f5010f42640 1 --2- 172.21.15.38:0/1432626450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f500c06f250 0x7f500c140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:51:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:37.747+0000 7f5010f42640 1 -- 172.21.15.38:0/1432626450 >> 172.21.15.38:0/1432626450 conn(0x7f500c0b1110 msgr2=0x7f500c0b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:51:37.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:37.747+0000 7f5010f42640 1 -- 172.21.15.38:0/1432626450 shutdown_connections 2023-12-22T08:51:37.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:51:37.747+0000 7f5010f42640 1 -- 172.21.15.38:0/1432626450 wait complete. 2023-12-22T08:51:37.768 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-22T08:51:38.010 INFO:teuthology.orchestra.run.smithi038.stdout:{"osd_mon_report_interval":"5"} 2023-12-22T08:51:38.011 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-22T08:51:38.011 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-22T08:51:38.248 INFO:teuthology.orchestra.run.smithi038.stdout:{"mon_tick_interval":"5"} 2023-12-22T08:51:38.249 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-22T08:51:38.249 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-12-22T08:51:38.249 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T08:51:38.249 DEBUG:teuthology.orchestra.run.smithi038:> import time 2023-12-22T08:51:38.249 DEBUG:teuthology.orchestra.run.smithi038:> import datetime 2023-12-22T08:51:38.249 DEBUG:teuthology.orchestra.run.smithi038:> import subprocess 2023-12-22T08:51:38.249 DEBUG:teuthology.orchestra.run.smithi038:> import os 2023-12-22T08:51:38.249 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:51:38.249 DEBUG:teuthology.orchestra.run.smithi038:> # Write some buffered data through before going full, all should be well 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> print("writing some data through which we expect to succeed") 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> bytes = 0 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(f) 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> # buffered IO, the error should always only appear from fsync and not 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> # from write 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> full = False 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:51:38.250 DEBUG:teuthology.orchestra.run.smithi038:> for n in range(0, int(32 * 1.1)): 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> try: 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> print("wrote bytes via buffered write, moving on to fsync") 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> except OSError as e: 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> if False: 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> raise 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> else: 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> full = True 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> break 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> try: 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> os.fsync(f) 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> print("fsync'"'"'ed successfully") 2023-12-22T08:51:38.251 DEBUG:teuthology.orchestra.run.smithi038:> except OSError as e: 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> full = True 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> break 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> else: 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> if n > 32 * 0.9: 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> # Be cautious in the last region where we expect to hit 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> time.sleep(15.0) 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> if not full: 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:51:38.252 DEBUG:teuthology.orchestra.run.smithi038:> # close() should not raise an error because we already caught it in 2023-12-22T08:51:38.253 DEBUG:teuthology.orchestra.run.smithi038:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-12-22T08:51:38.253 DEBUG:teuthology.orchestra.run.smithi038:> # since then because all IOs got cancelled on the full flag. 2023-12-22T08:51:38.253 DEBUG:teuthology.orchestra.run.smithi038:> print("calling close") 2023-12-22T08:51:38.253 DEBUG:teuthology.orchestra.run.smithi038:> os.close(f) 2023-12-22T08:51:38.253 DEBUG:teuthology.orchestra.run.smithi038:> print("close() did not raise error") 2023-12-22T08:51:38.253 DEBUG:teuthology.orchestra.run.smithi038:> 2023-12-22T08:51:38.253 DEBUG:teuthology.orchestra.run.smithi038:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-22T08:51:38.253 DEBUG:teuthology.orchestra.run.smithi038:> ' 2023-12-22T08:51:49.427 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:51:49.438 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:52:19.595 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:52:19.606 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:52:39.800 INFO:teuthology.orchestra.run.smithi038.stdout:writing some data through which we expect to succeed 2023-12-22T08:52:39.800 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-22T08:52:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 1.00 MB 2023-12-22T08:52:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 2.00 MB 2023-12-22T08:52:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 3.00 MB 2023-12-22T08:52:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 4.00 MB 2023-12-22T08:52:39.801 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.802 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.802 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 5.00 MB 2023-12-22T08:52:39.802 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.802 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.802 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 6.00 MB 2023-12-22T08:52:39.802 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.802 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.802 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 7.00 MB 2023-12-22T08:52:39.802 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.802 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.802 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 8.00 MB 2023-12-22T08:52:39.802 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.802 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 9.00 MB 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 10.00 MB 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 11.00 MB 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 12.00 MB 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 13.00 MB 2023-12-22T08:52:39.803 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.804 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.804 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 14.00 MB 2023-12-22T08:52:39.804 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.804 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.804 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 15.00 MB 2023-12-22T08:52:39.804 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.804 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.804 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 16.00 MB 2023-12-22T08:52:39.804 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.805 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.805 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 17.00 MB 2023-12-22T08:52:39.805 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.805 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.805 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 18.00 MB 2023-12-22T08:52:39.805 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.805 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.805 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 19.00 MB 2023-12-22T08:52:39.805 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.805 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.805 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 20.00 MB 2023-12-22T08:52:39.805 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.806 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.806 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 21.00 MB 2023-12-22T08:52:39.806 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.806 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.806 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 22.00 MB 2023-12-22T08:52:39.806 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.806 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.806 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 23.00 MB 2023-12-22T08:52:39.806 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.806 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.807 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 24.00 MB 2023-12-22T08:52:39.807 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.807 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.807 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 25.00 MB 2023-12-22T08:52:39.807 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.807 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.807 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 26.00 MB 2023-12-22T08:52:39.807 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.807 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.807 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 27.00 MB 2023-12-22T08:52:39.807 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.808 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.808 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 28.00 MB 2023-12-22T08:52:39.808 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.808 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.808 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 29.00 MB 2023-12-22T08:52:39.808 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.808 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.808 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 30.00 MB 2023-12-22T08:52:39.808 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:52:39.808 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.809 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.809 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 31.00 MB 2023-12-22T08:52:39.809 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:52:39.809 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.809 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.809 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 32.00 MB 2023-12-22T08:52:39.809 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:52:39.809 INFO:teuthology.orchestra.run.smithi038.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-22T08:52:39.809 INFO:teuthology.orchestra.run.smithi038.stdout:fsync'ed successfully 2023-12-22T08:52:39.809 INFO:teuthology.orchestra.run.smithi038.stdout:Not full yet after 33.00 MB 2023-12-22T08:52:39.809 INFO:teuthology.orchestra.run.smithi038.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-22T08:52:39.809 INFO:teuthology.orchestra.run.smithi038.stdout:Reached fullness after 33.00 MB 2023-12-22T08:52:39.809 INFO:teuthology.orchestra.run.smithi038.stdout:calling close 2023-12-22T08:52:39.810 INFO:teuthology.orchestra.run.smithi038.stdout:close() did not raise error 2023-12-22T08:52:39.898 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:52:39.898 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:52:40.026 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:52:40.152 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:52:40.152 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:52:40.152 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:52:40.214 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:52:40.214 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:52:40.266 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:52:40.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.492+0000 7f2407fff640 1 Processor -- start 2023-12-22T08:52:40.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.492+0000 7f2407fff640 1 -- start start 2023-12-22T08:52:40.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.494+0000 7f2407fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24080caf90 0x7f2408162f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:40.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.494+0000 7f2407fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f24080b2a90 0x7f240806d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:40.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.494+0000 7f2407fff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2408162ce0 con 0x7f2408071680 2023-12-22T08:52:40.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.494+0000 7f2407fff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2408162160 con 0x7f24080b2a90 2023-12-22T08:52:40.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.494+0000 7f2407fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2408162440 con 0x7f24080caf90 2023-12-22T08:52:40.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.495+0000 7f23fffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24080caf90 0x7f2408162f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:40.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.495+0000 7f23fffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24080caf90 0x7f2408162f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:38066/0 (socket says 172.21.15.38:38066) 2023-12-22T08:52:40.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.495+0000 7f23fffff640 1 -- 172.21.15.38:0/807608343 learned_addr learned my addr 172.21.15.38:0/807608343 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:40.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.495+0000 7f24077fe640 1 --2- 172.21.15.38:0/807608343 >> v2:172.21.15.89:3300/0 conn(0x7f24080b2a90 0x7f240806d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:40.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.496+0000 7f23fffff640 1 -- 172.21.15.38:0/807608343 >> v2:172.21.15.89:3300/0 conn(0x7f24080b2a90 msgr2=0x7f240806d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:40.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.496+0000 7f23fffff640 1 --2- 172.21.15.38:0/807608343 >> v2:172.21.15.89:3300/0 conn(0x7f24080b2a90 0x7f240806d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.496+0000 7f23fffff640 1 -- 172.21.15.38:0/807608343 >> v1:172.21.15.89:6789/0 conn(0x7f2408071680 legacy=0x7f24080ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:40.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.496+0000 7f23fffff640 1 -- 172.21.15.38:0/807608343 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2408162720 con 0x7f24080caf90 2023-12-22T08:52:40.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.497+0000 7f23fffff640 1 --2- 172.21.15.38:0/807608343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24080caf90 0x7f2408162f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009870 tx=0x7f23f002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1d7c40651b0c0fe server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:40.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.497+0000 7f24067fc640 1 -- 172.21.15.38:0/807608343 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0030840 con 0x7f24080caf90 2023-12-22T08:52:40.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.498+0000 7f24067fc640 1 -- 172.21.15.38:0/807608343 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f00309a0 con 0x7f24080caf90 2023-12-22T08:52:40.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.498+0000 7f24067fc640 1 -- 172.21.15.38:0/807608343 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0030d30 con 0x7f24080caf90 2023-12-22T08:52:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.498+0000 7f2407fff640 1 -- 172.21.15.38:0/807608343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24080caf90 msgr2=0x7f2408162f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.498+0000 7f2407fff640 1 --2- 172.21.15.38:0/807608343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24080caf90 0x7f2408162f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009870 tx=0x7f23f002b980 comp rx=0 tx=0).stop 2023-12-22T08:52:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.498+0000 7f2407fff640 1 -- 172.21.15.38:0/807608343 shutdown_connections 2023-12-22T08:52:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.498+0000 7f2407fff640 1 --2- 172.21.15.38:0/807608343 >> v2:172.21.15.89:3300/0 conn(0x7f24080b2a90 0x7f240806d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.498+0000 7f2407fff640 1 --2- 172.21.15.38:0/807608343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24080caf90 0x7f2408162f20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.498+0000 7f2407fff640 1 -- 172.21.15.38:0/807608343 >> 172.21.15.38:0/807608343 conn(0x7f24080b1f70 msgr2=0x7f24080b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.498+0000 7f2407fff640 1 -- 172.21.15.38:0/807608343 shutdown_connections 2023-12-22T08:52:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.499+0000 7f2407fff640 1 -- 172.21.15.38:0/807608343 wait complete. 2023-12-22T08:52:40.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.500+0000 7f2407fff640 1 Processor -- start 2023-12-22T08:52:40.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.500+0000 7f2407fff640 1 -- start start 2023-12-22T08:52:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.501+0000 7f2407fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2408071680 0x7f240815c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.501+0000 7f2407fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24080b2a90 0x7f240809c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.501+0000 7f2407fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24080caf90 0x7f24080ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.501+0000 7f2407fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240809d140 con 0x7f24080b2a90 2023-12-22T08:52:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.501+0000 7f2407fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2408099b10 con 0x7f2408071680 2023-12-22T08:52:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.501+0000 7f2407fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2408099df0 con 0x7f24080caf90 2023-12-22T08:52:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.502+0000 7f23fffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24080b2a90 0x7f240809c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.502+0000 7f23fffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24080b2a90 0x7f240809c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37120/0 (socket says 172.21.15.38:37120) 2023-12-22T08:52:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.502+0000 7f23fffff640 1 -- 172.21.15.38:0/997090806 learned_addr learned my addr 172.21.15.38:0/997090806 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.502+0000 7f24077fe640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24080caf90 0x7f24080ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.502+0000 7f2406ffd640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2408071680 0x7f240815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.502+0000 7f23fffff640 1 -- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24080caf90 msgr2=0x7f24080ad110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.502+0000 7f23fffff640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24080caf90 0x7f24080ad110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.502+0000 7f23fffff640 1 -- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2408071680 msgr2=0x7f240815c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.502+0000 7f23fffff640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2408071680 0x7f240815c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.502+0000 7f23fffff640 1 -- 172.21.15.38:0/997090806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f00094d0 con 0x7f24080b2a90 2023-12-22T08:52:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.503+0000 7f23fffff640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24080b2a90 0x7f240809c860 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f23f0000c00 tx=0x7f23f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:40.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.503+0000 7f23ff7fe640 1 -- 172.21.15.38:0/997090806 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0039a90 con 0x7f24080b2a90 2023-12-22T08:52:40.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.503+0000 7f23ff7fe640 1 -- 172.21.15.38:0/997090806 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f0039bf0 con 0x7f24080b2a90 2023-12-22T08:52:40.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.503+0000 7f23ff7fe640 1 -- 172.21.15.38:0/997090806 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0043410 con 0x7f24080b2a90 2023-12-22T08:52:40.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.503+0000 7f2407fff640 1 -- 172.21.15.38:0/997090806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240809a0d0 con 0x7f24080b2a90 2023-12-22T08:52:40.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.503+0000 7f2407fff640 1 -- 172.21.15.38:0/997090806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240809cda0 con 0x7f24080b2a90 2023-12-22T08:52:40.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.504+0000 7f2407fff640 1 -- 172.21.15.38:0/997090806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2408061910 con 0x7f24080b2a90 2023-12-22T08:52:40.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.505+0000 7f23ff7fe640 1 -- 172.21.15.38:0/997090806 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f23f002f390 con 0x7f24080b2a90 2023-12-22T08:52:40.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.506+0000 7f23ff7fe640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23e806a430 0x7f23e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:40.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.507+0000 7f23ff7fe640 1 -- 172.21.15.38:0/997090806 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f23f00aab60 con 0x7f24080b2a90 2023-12-22T08:52:40.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.507+0000 7f23ff7fe640 1 -- 172.21.15.38:0/997090806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f23e8072020 con 0x7f24080b2a90 2023-12-22T08:52:40.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.507+0000 7f2406ffd640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23e806a430 0x7f23e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:40.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.508+0000 7f2406ffd640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23e806a430 0x7f23e806c8f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f23f8000f60 tx=0x7f23f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:40.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.511+0000 7f23ff7fe640 1 -- 172.21.15.38:0/997090806 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f23f0034060 con 0x7f24080b2a90 2023-12-22T08:52:40.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.707+0000 7f2407fff640 1 -- 172.21.15.38:0/997090806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2408070a70 con 0x7f24080b2a90 2023-12-22T08:52:40.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.710+0000 7f23ff7fe640 1 -- 172.21.15.38:0/997090806 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+16187 (secure 0 0 0) 0x7f23f0048070 con 0x7f24080b2a90 2023-12-22T08:52:40.711 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:52:40.711 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":177,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:52:16.380719+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:51:22.983948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-22T08:51:24.133013+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3","mappings":[{"from":2,"to":6}]},{"pgid":"21.29","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:52:40.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.713+0000 7f2407fff640 1 -- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23e806a430 msgr2=0x7f23e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:40.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.713+0000 7f2407fff640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23e806a430 0x7f23e806c8f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f23f8000f60 tx=0x7f23f8009040 comp rx=0 tx=0).stop 2023-12-22T08:52:40.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.713+0000 7f2407fff640 1 -- 172.21.15.38:0/997090806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24080b2a90 msgr2=0x7f240809c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:40.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.713+0000 7f2407fff640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24080b2a90 0x7f240809c860 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f23f0000c00 tx=0x7f23f0004730 comp rx=0 tx=0).stop 2023-12-22T08:52:40.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.713+0000 7f2407fff640 1 -- 172.21.15.38:0/997090806 shutdown_connections 2023-12-22T08:52:40.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.713+0000 7f2407fff640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f24080caf90 0x7f24080ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.713+0000 7f2407fff640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f23e806a430 0x7f23e806c8f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.713+0000 7f2407fff640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24080b2a90 0x7f240809c860 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.713+0000 7f2407fff640 1 --2- 172.21.15.38:0/997090806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2408071680 0x7f240815c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.713+0000 7f2407fff640 1 -- 172.21.15.38:0/997090806 >> 172.21.15.38:0/997090806 conn(0x7f24080b1f70 msgr2=0x7f240806c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:40.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.713+0000 7f2407fff640 1 -- 172.21.15.38:0/997090806 shutdown_connections 2023-12-22T08:52:40.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.713+0000 7f2407fff640 1 -- 172.21.15.38:0/997090806 wait complete. 2023-12-22T08:52:40.733 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:51:22.983948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:51:24.133013+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:52:40.733 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:52:40.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.967+0000 7f8b18e70640 1 Processor -- start 2023-12-22T08:52:40.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.967+0000 7f8b18e70640 1 -- start start 2023-12-22T08:52:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.969+0000 7f8b18e70640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8b1415ec50 0x7f8b140ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.969+0000 7f8b18e70640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b14070e80 0x7f8b1406f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.969+0000 7f8b18e70640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b140ce4b0 con 0x7f8b1415e870 2023-12-22T08:52:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.969+0000 7f8b18e70640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1415fea0 con 0x7f8b1415ec50 2023-12-22T08:52:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.969+0000 7f8b18e70640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b140cdb80 con 0x7f8b14070e80 2023-12-22T08:52:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.969+0000 7f8b11d9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8b1415ec50 0x7f8b140ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.970+0000 7f8b11d9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8b1415ec50 0x7f8b140ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37134/0 (socket says 172.21.15.38:37134) 2023-12-22T08:52:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.970+0000 7f8b11d9b640 1 -- 172.21.15.38:0/1964008311 learned_addr learned my addr 172.21.15.38:0/1964008311 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.970+0000 7f8b12d9d640 1 --2- 172.21.15.38:0/1964008311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b14070e80 0x7f8b1406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.970+0000 7f8b11d9b640 1 -- 172.21.15.38:0/1964008311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b14070e80 msgr2=0x7f8b1406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.970+0000 7f8b11d9b640 1 --2- 172.21.15.38:0/1964008311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b14070e80 0x7f8b1406f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.970+0000 7f8b11d9b640 1 -- 172.21.15.38:0/1964008311 >> v1:172.21.15.89:6789/0 conn(0x7f8b1415e870 legacy=0x7f8b14070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.970+0000 7f8b11d9b640 1 -- 172.21.15.38:0/1964008311 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b140cde60 con 0x7f8b1415ec50 2023-12-22T08:52:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.971+0000 7f8b11d9b640 1 --2- 172.21.15.38:0/1964008311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1415ec50 0x7f8b140ce940 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009870 tx=0x7f8b0802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b14947a5c37d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.972+0000 7f8b1159a640 1 -- 172.21.15.38:0/1964008311 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080317c0 con 0x7f8b1415ec50 2023-12-22T08:52:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.972+0000 7f8b1159a640 1 -- 172.21.15.38:0/1964008311 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b08031920 con 0x7f8b1415ec50 2023-12-22T08:52:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.972+0000 7f8b1159a640 1 -- 172.21.15.38:0/1964008311 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08031cb0 con 0x7f8b1415ec50 2023-12-22T08:52:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.972+0000 7f8b18e70640 1 -- 172.21.15.38:0/1964008311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1415ec50 msgr2=0x7f8b140ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.972+0000 7f8b18e70640 1 --2- 172.21.15.38:0/1964008311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1415ec50 0x7f8b140ce940 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009870 tx=0x7f8b0802b860 comp rx=0 tx=0).stop 2023-12-22T08:52:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.973+0000 7f8b18e70640 1 -- 172.21.15.38:0/1964008311 shutdown_connections 2023-12-22T08:52:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.973+0000 7f8b18e70640 1 --2- 172.21.15.38:0/1964008311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1415ec50 0x7f8b140ce940 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.973+0000 7f8b18e70640 1 --2- 172.21.15.38:0/1964008311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b14070e80 0x7f8b1406f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.973+0000 7f8b18e70640 1 -- 172.21.15.38:0/1964008311 >> 172.21.15.38:0/1964008311 conn(0x7f8b140b20c0 msgr2=0x7f8b140b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.973+0000 7f8b18e70640 1 -- 172.21.15.38:0/1964008311 shutdown_connections 2023-12-22T08:52:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.973+0000 7f8b18e70640 1 -- 172.21.15.38:0/1964008311 wait complete. 2023-12-22T08:52:40.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.974+0000 7f8b18e70640 1 Processor -- start 2023-12-22T08:52:40.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.975+0000 7f8b18e70640 1 -- start start 2023-12-22T08:52:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b18e70640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b14070e80 0x7f8b141f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b18e70640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1415e870 0x7f8b14157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b18e70640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b1415ec50 0x7f8b14146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b18e70640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1415d710 con 0x7f8b1415e870 2023-12-22T08:52:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b18e70640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b141f4e50 con 0x7f8b14070e80 2023-12-22T08:52:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b18e70640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1415cb00 con 0x7f8b1415ec50 2023-12-22T08:52:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b11d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1415e870 0x7f8b14157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b11d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1415e870 0x7f8b14157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37144/0 (socket says 172.21.15.38:37144) 2023-12-22T08:52:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b11d9b640 1 -- 172.21.15.38:0/1822894524 learned_addr learned my addr 172.21.15.38:0/1822894524 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:40.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b12d9d640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b1415ec50 0x7f8b14146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b11d9b640 1 -- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b1415ec50 msgr2=0x7f8b14146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b11d9b640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b1415ec50 0x7f8b14146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b11d9b640 1 -- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b14070e80 msgr2=0x7f8b141f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b1259c640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b14070e80 0x7f8b141f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b11d9b640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b14070e80 0x7f8b141f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b11d9b640 1 -- 172.21.15.38:0/1822894524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b080094d0 con 0x7f8b1415e870 2023-12-22T08:52:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b12d9d640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b1415ec50 0x7f8b14146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.976+0000 7f8b1259c640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b14070e80 0x7f8b141f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.977+0000 7f8b11d9b640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1415e870 0x7f8b14157340 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f8b08000c00 tx=0x7f8b080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.977+0000 7f8b02ffd640 1 -- 172.21.15.38:0/1822894524 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08032860 con 0x7f8b1415e870 2023-12-22T08:52:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.977+0000 7f8b02ffd640 1 -- 172.21.15.38:0/1822894524 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b080329e0 con 0x7f8b1415e870 2023-12-22T08:52:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.977+0000 7f8b02ffd640 1 -- 172.21.15.38:0/1822894524 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08032d90 con 0x7f8b1415e870 2023-12-22T08:52:40.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.977+0000 7f8b18e70640 1 -- 172.21.15.38:0/1822894524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1415cde0 con 0x7f8b1415e870 2023-12-22T08:52:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.977+0000 7f8b18e70640 1 -- 172.21.15.38:0/1822894524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1415d3a0 con 0x7f8b1415e870 2023-12-22T08:52:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.979+0000 7f8b18e70640 1 -- 172.21.15.38:0/1822894524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b14061910 con 0x7f8b1415e870 2023-12-22T08:52:40.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.979+0000 7f8b02ffd640 1 -- 172.21.15.38:0/1822894524 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8b0804d3f0 con 0x7f8b1415e870 2023-12-22T08:52:40.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.981+0000 7f8b02ffd640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8af406a430 0x7f8af406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:40.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.981+0000 7f8b02ffd640 1 -- 172.21.15.38:0/1822894524 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8b080aa840 con 0x7f8b1415e870 2023-12-22T08:52:40.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.981+0000 7f8b02ffd640 1 -- 172.21.15.38:0/1822894524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f8af4072020 con 0x7f8b1415e870 2023-12-22T08:52:40.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.982+0000 7f8b1259c640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8af406a430 0x7f8af406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:40.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.983+0000 7f8b1259c640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8af406a430 0x7f8af406c8f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8b04003eb0 tx=0x7f8b04009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:40.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:40.986+0000 7f8b02ffd640 1 -- 172.21.15.38:0/1822894524 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8b08075d50 con 0x7f8b1415e870 2023-12-22T08:52:41.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.178+0000 7f8b18e70640 1 -- 172.21.15.38:0/1822894524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b140b2ce0 con 0x7f8b1415e870 2023-12-22T08:52:41.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.179+0000 7f8b02ffd640 1 -- 172.21.15.38:0/1822894524 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v177) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b08079370 con 0x7f8b1415e870 2023-12-22T08:52:41.180 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:52:41.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.182+0000 7f8b18e70640 1 -- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8af406a430 msgr2=0x7f8af406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.182+0000 7f8b18e70640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8af406a430 0x7f8af406c8f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8b04003eb0 tx=0x7f8b04009040 comp rx=0 tx=0).stop 2023-12-22T08:52:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.182+0000 7f8b18e70640 1 -- 172.21.15.38:0/1822894524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1415e870 msgr2=0x7f8b14157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.182+0000 7f8b18e70640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1415e870 0x7f8b14157340 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f8b08000c00 tx=0x7f8b080046c0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.182+0000 7f8b18e70640 1 -- 172.21.15.38:0/1822894524 shutdown_connections 2023-12-22T08:52:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.182+0000 7f8b18e70640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b1415ec50 0x7f8b14146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.182+0000 7f8b18e70640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8af406a430 0x7f8af406c8f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.182+0000 7f8b18e70640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1415e870 0x7f8b14157340 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.182+0000 7f8b18e70640 1 --2- 172.21.15.38:0/1822894524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b14070e80 0x7f8b141f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.182+0000 7f8b18e70640 1 -- 172.21.15.38:0/1822894524 >> 172.21.15.38:0/1822894524 conn(0x7f8b140b20c0 msgr2=0x7f8b14158470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.182+0000 7f8b18e70640 1 -- 172.21.15.38:0/1822894524 shutdown_connections 2023-12-22T08:52:41.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.182+0000 7f8b18e70640 1 -- 172.21.15.38:0/1822894524 wait complete. 2023-12-22T08:52:41.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:52:41.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.417+0000 7fcfc5314640 1 Processor -- start 2023-12-22T08:52:41.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.417+0000 7fcfc5314640 1 -- start start 2023-12-22T08:52:41.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.419+0000 7fcfc5314640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015e740 0x7fcfc015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.419+0000 7fcfc5314640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcfc006ca50 0x7fcfc00b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.419+0000 7fcfc5314640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc00b4210 con 0x7fcfc00b3dc0 2023-12-22T08:52:41.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.419+0000 7fcfc5314640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc006e650 con 0x7fcfc006ca50 2023-12-22T08:52:41.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.419+0000 7fcfc5314640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc015eb20 con 0x7fcfc015e740 2023-12-22T08:52:41.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.420+0000 7fcfbf7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcfc00b3dc0 0x7fcfc0161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43398/0 (socket says 172.21.15.38:43398) 2023-12-22T08:52:41.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.420+0000 7fcfbf7fe640 1 -- 172.21.15.38:0/1296668606 learned_addr learned my addr 172.21.15.38:0/1296668606 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:41.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.420+0000 7fcfb67fc640 1 --2- 172.21.15.38:0/1296668606 >> v2:172.21.15.89:3300/0 conn(0x7fcfc006ca50 0x7fcfc00b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.420+0000 7fcfbeffd640 1 --2- 172.21.15.38:0/1296668606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015e740 0x7fcfc015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.420+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822136854 0 0) 0x7fcfb8001490 con 0x7fcfc00b3dc0 2023-12-22T08:52:41.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.420+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfac003520 con 0x7fcfc00b3dc0 2023-12-22T08:52:41.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.420+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1994633422 0 0) 0x7fcfac003520 con 0x7fcfc00b3dc0 2023-12-22T08:52:41.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.420+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015e740 msgr2=0x7fcfc015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:41.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.420+0000 7fcfbe7fc640 1 --2- 172.21.15.38:0/1296668606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015e740 0x7fcfc015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 >> v2:172.21.15.89:3300/0 conn(0x7fcfc006ca50 msgr2=0x7fcfc00b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbe7fc640 1 --2- 172.21.15.38:0/1296668606 >> v2:172.21.15.89:3300/0 conn(0x7fcfc006ca50 0x7fcfc00b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0070770 con 0x7fcfc00b3dc0 2023-12-22T08:52:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fcfb8001b80 con 0x7fcfc00b3dc0 2023-12-22T08:52:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbeffd640 1 --2- 172.21.15.38:0/1296668606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015e740 0x7fcfc015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:52:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 >> v1:172.21.15.38:6789/0 conn(0x7fcfc00b3dc0 legacy=0x7fcfc0161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbe7fc640 1 --2- 172.21.15.38:0/1296668606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfac003970 0x7fcfac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbe7fc640 1 --2- 172.21.15.38:0/1296668606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015e740 0x7fcfac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbe7fc640 1 --2- 172.21.15.38:0/1296668606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfac004d00 0x7fcfac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc006e650 con 0x7fcfac004d00 2023-12-22T08:52:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc015eb20 con 0x7fcfac003970 2023-12-22T08:52:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac00b9d0 con 0x7fcfc015e740 2023-12-22T08:52:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbf7fe640 1 --2- 172.21.15.38:0/1296668606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfac004d00 0x7fcfac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfbeffd640 1 --2- 172.21.15.38:0/1296668606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfac003970 0x7fcfac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.421+0000 7fcfb67fc640 1 --2- 172.21.15.38:0/1296668606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015e740 0x7fcfac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.422+0000 7fcfbf7fe640 1 -- 172.21.15.38:0/1296668606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015e740 msgr2=0x7fcfac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.422+0000 7fcfbf7fe640 1 --2- 172.21.15.38:0/1296668606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfc015e740 0x7fcfac0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.422+0000 7fcfbf7fe640 1 -- 172.21.15.38:0/1296668606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfac003970 msgr2=0x7fcfac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.422+0000 7fcfbf7fe640 1 --2- 172.21.15.38:0/1296668606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfac003970 0x7fcfac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.422+0000 7fcfbf7fe640 1 -- 172.21.15.38:0/1296668606 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0009400 con 0x7fcfac004d00 2023-12-22T08:52:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.423+0000 7fcfbf7fe640 1 --2- 172.21.15.38:0/1296668606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfac004d00 0x7fcfac005180 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800a860 tx=0x7fcfac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40875925e9fc04d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.423+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8034630 con 0x7fcfac004d00 2023-12-22T08:52:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.423+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb802f070 con 0x7fcfac004d00 2023-12-22T08:52:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.423+0000 7fcfbe7fc640 1 -- 172.21.15.38:0/1296668606 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80349f0 con 0x7fcfac004d00 2023-12-22T08:52:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.423+0000 7fcfc5314640 1 -- 172.21.15.38:0/1296668606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfac004d00 msgr2=0x7fcfac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:41.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.423+0000 7fcfc5314640 1 --2- 172.21.15.38:0/1296668606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfac004d00 0x7fcfac005180 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800a860 tx=0x7fcfac0057f0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.423+0000 7fcfbf7fe640 1 -- 172.21.15.38:0/1296668606 reap_dead start 2023-12-22T08:52:41.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.423+0000 7fcfc5314640 1 -- 172.21.15.38:0/1296668606 shutdown_connections 2023-12-22T08:52:41.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.423+0000 7fcfc5314640 1 -- 172.21.15.38:0/1296668606 >> 172.21.15.38:0/1296668606 conn(0x7fcfc00cfea0 msgr2=0x7fcfc00d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:41.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.424+0000 7fcfc5314640 1 -- 172.21.15.38:0/1296668606 shutdown_connections 2023-12-22T08:52:41.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.424+0000 7fcfc5314640 1 -- 172.21.15.38:0/1296668606 wait complete. 2023-12-22T08:52:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.425+0000 7fcfc5314640 1 Processor -- start 2023-12-22T08:52:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.426+0000 7fcfc5314640 1 -- start start 2023-12-22T08:52:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.426+0000 7fcfc5314640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfac004d00 0x7fcfc00b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.426+0000 7fcfc5314640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfc015c8d0 0x7fcfc015cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfc5314640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0147930 0x7fcfc0147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfc5314640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc015d290 con 0x7fcfc0147930 2023-12-22T08:52:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfc5314640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc01486b0 con 0x7fcfc015c8d0 2023-12-22T08:52:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfc5314640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0148990 con 0x7fcfac004d00 2023-12-22T08:52:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfbf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0147930 0x7fcfc0147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfbf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0147930 0x7fcfc0147db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53960/0 (socket says 172.21.15.38:53960) 2023-12-22T08:52:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfbf7fe640 1 -- 172.21.15.38:0/3184148657 learned_addr learned my addr 172.21.15.38:0/3184148657 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfb67fc640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfc015c8d0 0x7fcfc015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfbeffd640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfac004d00 0x7fcfc00b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfbf7fe640 1 -- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfac004d00 msgr2=0x7fcfc00b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfbf7fe640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfac004d00 0x7fcfc00b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfbf7fe640 1 -- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfc015c8d0 msgr2=0x7fcfc015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfbf7fe640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfc015c8d0 0x7fcfc015cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.427+0000 7fcfbf7fe640 1 -- 172.21.15.38:0/3184148657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0148c70 con 0x7fcfc0147930 2023-12-22T08:52:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.428+0000 7fcfbf7fe640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0147930 0x7fcfc0147db0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fcfb802cb70 tx=0x7fcfb8001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:41.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.428+0000 7fcfb7fff640 1 -- 172.21.15.38:0/3184148657 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8034630 con 0x7fcfc0147930 2023-12-22T08:52:41.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.428+0000 7fcfb7fff640 1 -- 172.21.15.38:0/3184148657 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb8034790 con 0x7fcfc0147930 2023-12-22T08:52:41.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.428+0000 7fcfb7fff640 1 -- 172.21.15.38:0/3184148657 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8034b00 con 0x7fcfc0147930 2023-12-22T08:52:41.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.428+0000 7fcfc5314640 1 -- 172.21.15.38:0/3184148657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc0148f50 con 0x7fcfc0147930 2023-12-22T08:52:41.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.428+0000 7fcfc5314640 1 -- 172.21.15.38:0/3184148657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc00b0c40 con 0x7fcfc0147930 2023-12-22T08:52:41.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.429+0000 7fcfc5314640 1 -- 172.21.15.38:0/3184148657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc0061910 con 0x7fcfc0147930 2023-12-22T08:52:41.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.430+0000 7fcfb7fff640 1 -- 172.21.15.38:0/3184148657 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcfb8031030 con 0x7fcfc0147930 2023-12-22T08:52:41.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.431+0000 7fcfb7fff640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfa006a430 0x7fcfa006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.431+0000 7fcfb7fff640 1 -- 172.21.15.38:0/3184148657 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcfb80aac10 con 0x7fcfc0147930 2023-12-22T08:52:41.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.431+0000 7fcfb7fff640 1 -- 172.21.15.38:0/3184148657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7fcfa0072020 con 0x7fcfc0147930 2023-12-22T08:52:41.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.432+0000 7fcfbeffd640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfa006a430 0x7fcfa006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.433+0000 7fcfbeffd640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfa006a430 0x7fcfa006c8f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009b20 tx=0x7fcfb0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:41.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.436+0000 7fcfb7fff640 1 -- 172.21.15.38:0/3184148657 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcfb8076130 con 0x7fcfc0147930 2023-12-22T08:52:41.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.630+0000 7fcfc5314640 1 -- 172.21.15.38:0/3184148657 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcfc0061910 con 0x7fcfc0147930 2023-12-22T08:52:41.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.631+0000 7fcfb7fff640 1 -- 172.21.15.38:0/3184148657 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v177) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcfb8079750 con 0x7fcfc0147930 2023-12-22T08:52:41.632 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:52:41.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.633+0000 7fcfc5314640 1 -- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfa006a430 msgr2=0x7fcfa006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:41.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.633+0000 7fcfc5314640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfa006a430 0x7fcfa006c8f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009b20 tx=0x7fcfb0008040 comp rx=0 tx=0).stop 2023-12-22T08:52:41.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.633+0000 7fcfc5314640 1 -- 172.21.15.38:0/3184148657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0147930 msgr2=0x7fcfc0147db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:41.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.633+0000 7fcfc5314640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0147930 0x7fcfc0147db0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fcfb802cb70 tx=0x7fcfb8001f10 comp rx=0 tx=0).stop 2023-12-22T08:52:41.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.633+0000 7fcfc5314640 1 -- 172.21.15.38:0/3184148657 shutdown_connections 2023-12-22T08:52:41.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.633+0000 7fcfc5314640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcfa006a430 0x7fcfa006c8f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.633+0000 7fcfc5314640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcfc0147930 0x7fcfc0147db0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.633+0000 7fcfc5314640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfc015c8d0 0x7fcfc015cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.634+0000 7fcfc5314640 1 --2- 172.21.15.38:0/3184148657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfac004d00 0x7fcfc00b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.634+0000 7fcfc5314640 1 -- 172.21.15.38:0/3184148657 >> 172.21.15.38:0/3184148657 conn(0x7fcfc00cfea0 msgr2=0x7fcfc015fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:41.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.634+0000 7fcfc5314640 1 -- 172.21.15.38:0/3184148657 shutdown_connections 2023-12-22T08:52:41.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.634+0000 7fcfc5314640 1 -- 172.21.15.38:0/3184148657 wait complete. 2023-12-22T08:52:41.651 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:52:41.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.877+0000 7f71f759e640 1 Processor -- start 2023-12-22T08:52:41.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.877+0000 7f71f759e640 1 -- start start 2023-12-22T08:52:41.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.878+0000 7f71f759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f815d5a0 0x7f71f80d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.879+0000 7f71f759e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f815de50 con 0x7f71f815d1c0 2023-12-22T08:52:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.879+0000 7f71f759e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f80d0dd0 con 0x7f71f8071080 2023-12-22T08:52:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.879+0000 7f71f759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80d10b0 con 0x7f71f815d5a0 2023-12-22T08:52:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.879+0000 7f71f659c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f71f815d1c0 0x7f71f8070970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43400/0 (socket says 172.21.15.38:43400) 2023-12-22T08:52:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.879+0000 7f71f659c640 1 -- 172.21.15.38:0/3275037630 learned_addr learned my addr 172.21.15.38:0/3275037630 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:41.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.879+0000 7f71f6d9d640 1 --2- 172.21.15.38:0/3275037630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f815d5a0 0x7f71f80d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.879+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804377446 0 0) 0x7f71f815de50 con 0x7f71f815d1c0 2023-12-22T08:52:41.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.879+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e4003520 con 0x7f71f815d1c0 2023-12-22T08:52:41.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3972285687 0 0) 0x7f71e4003520 con 0x7f71f815d1c0 2023-12-22T08:52:41.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f815d5a0 msgr2=0x7f71f80d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:41.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f559a640 1 --2- 172.21.15.38:0/3275037630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f815d5a0 0x7f71f80d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 >> v1:172.21.15.89:6789/0 conn(0x7f71f8071080 legacy=0x7f71f80d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:41.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f815dae0 con 0x7f71f815d1c0 2023-12-22T08:52:41.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f71e80019f0 con 0x7f71f815d1c0 2023-12-22T08:52:41.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 >> v1:172.21.15.38:6789/0 conn(0x7f71f815d1c0 legacy=0x7f71f8070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:41.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f559a640 1 --2- 172.21.15.38:0/3275037630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71e40039a0 0x7f71e4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f559a640 1 --2- 172.21.15.38:0/3275037630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f815d5a0 0x7f71e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f559a640 1 --2- 172.21.15.38:0/3275037630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e4004d00 0x7f71e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80d10b0 con 0x7f71e40039a0 2023-12-22T08:52:41.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e400ba30 con 0x7f71e4004d00 2023-12-22T08:52:41.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e400bbf0 con 0x7f71f815d5a0 2023-12-22T08:52:41.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.880+0000 7f71f659c640 1 --2- 172.21.15.38:0/3275037630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71e40039a0 0x7f71e4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.881+0000 7f71f5d9b640 1 --2- 172.21.15.38:0/3275037630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f815d5a0 0x7f71e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.881+0000 7f71f6d9d640 1 --2- 172.21.15.38:0/3275037630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e4004d00 0x7f71e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.881+0000 7f71f659c640 1 -- 172.21.15.38:0/3275037630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f815d5a0 msgr2=0x7f71e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:41.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.881+0000 7f71f659c640 1 --2- 172.21.15.38:0/3275037630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f815d5a0 0x7f71e40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.881+0000 7f71f659c640 1 -- 172.21.15.38:0/3275037630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e4004d00 msgr2=0x7f71e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:41.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.881+0000 7f71f659c640 1 --2- 172.21.15.38:0/3275037630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e4004d00 0x7f71e4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.881+0000 7f71f659c640 1 -- 172.21.15.38:0/3275037630 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4003520 con 0x7f71e40039a0 2023-12-22T08:52:41.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.882+0000 7f71f659c640 1 --2- 172.21.15.38:0/3275037630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71e40039a0 0x7f71e4003dc0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f71e800a800 tx=0x7f71e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54484d5c5c7e0f4a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:41.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.882+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e80072d0 con 0x7f71e40039a0 2023-12-22T08:52:41.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.882+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e802f070 con 0x7f71e40039a0 2023-12-22T08:52:41.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.882+0000 7f71f559a640 1 -- 172.21.15.38:0/3275037630 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8007650 con 0x7f71e40039a0 2023-12-22T08:52:41.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.883+0000 7f71f759e640 1 -- 172.21.15.38:0/3275037630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71e40039a0 msgr2=0x7f71e4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:41.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.883+0000 7f71f759e640 1 --2- 172.21.15.38:0/3275037630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71e40039a0 0x7f71e4003dc0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f71e800a800 tx=0x7f71e40057f0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.883+0000 7f71f6d9d640 1 -- 172.21.15.38:0/3275037630 reap_dead start 2023-12-22T08:52:41.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.883+0000 7f71f759e640 1 -- 172.21.15.38:0/3275037630 shutdown_connections 2023-12-22T08:52:41.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.883+0000 7f71f759e640 1 -- 172.21.15.38:0/3275037630 >> 172.21.15.38:0/3275037630 conn(0x7f71f806bf90 msgr2=0x7f71f806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:41.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.883+0000 7f71f759e640 1 -- 172.21.15.38:0/3275037630 shutdown_connections 2023-12-22T08:52:41.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.883+0000 7f71f759e640 1 -- 172.21.15.38:0/3275037630 wait complete. 2023-12-22T08:52:41.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.885+0000 7f71f759e640 1 Processor -- start 2023-12-22T08:52:41.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.885+0000 7f71f759e640 1 -- start start 2023-12-22T08:52:41.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.886+0000 7f71f759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e40039a0 0x7f71f81422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.886+0000 7f71f759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f8142af0 0x7f71f80b7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.886+0000 7f71f759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71f8142f50 0x7f71f8155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.886+0000 7f71f759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f81427e0 con 0x7f71f8142f50 2023-12-22T08:52:41.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.886+0000 7f71f759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f8157b90 con 0x7f71e40039a0 2023-12-22T08:52:41.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.886+0000 7f71f759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f8157e70 con 0x7f71f8142af0 2023-12-22T08:52:41.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.887+0000 7f71f6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71f8142f50 0x7f71f8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.887+0000 7f71f6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71f8142f50 0x7f71f8155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53986/0 (socket says 172.21.15.38:53986) 2023-12-22T08:52:41.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.887+0000 7f71f6d9d640 1 -- 172.21.15.38:0/1276865288 learned_addr learned my addr 172.21.15.38:0/1276865288 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:41.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.887+0000 7f71f659c640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e40039a0 0x7f71f81422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.887+0000 7f71f5d9b640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f8142af0 0x7f71f80b7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.887+0000 7f71f6d9d640 1 -- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f8142af0 msgr2=0x7f71f80b7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:41.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.887+0000 7f71f6d9d640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f8142af0 0x7f71f80b7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.887+0000 7f71f6d9d640 1 -- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e40039a0 msgr2=0x7f71f81422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:41.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.887+0000 7f71f6d9d640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e40039a0 0x7f71f81422a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:41.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.887+0000 7f71f6d9d640 1 -- 172.21.15.38:0/1276865288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f8158150 con 0x7f71f8142f50 2023-12-22T08:52:41.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.887+0000 7f71f6d9d640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71f8142f50 0x7f71f8155750 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f71f80b3300 tx=0x7f71f0011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:41.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.888+0000 7f71eeffd640 1 -- 172.21.15.38:0/1276865288 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0004500 con 0x7f71f8142f50 2023-12-22T08:52:41.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.888+0000 7f71eeffd640 1 -- 172.21.15.38:0/1276865288 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f0003610 con 0x7f71f8142f50 2023-12-22T08:52:41.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.888+0000 7f71eeffd640 1 -- 172.21.15.38:0/1276865288 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f00039c0 con 0x7f71f8142f50 2023-12-22T08:52:41.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.888+0000 7f71f759e640 1 -- 172.21.15.38:0/1276865288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f8158430 con 0x7f71f8142f50 2023-12-22T08:52:41.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.888+0000 7f71f759e640 1 -- 172.21.15.38:0/1276865288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f81577b0 con 0x7f71f8142f50 2023-12-22T08:52:41.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.889+0000 7f71f759e640 1 -- 172.21.15.38:0/1276865288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f8061910 con 0x7f71f8142f50 2023-12-22T08:52:41.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.890+0000 7f71eeffd640 1 -- 172.21.15.38:0/1276865288 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f71f0003b20 con 0x7f71f8142f50 2023-12-22T08:52:41.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.891+0000 7f71eeffd640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f71d806a460 0x7f71d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:41.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.891+0000 7f71eeffd640 1 -- 172.21.15.38:0/1276865288 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f71f00887b0 con 0x7f71f8142f50 2023-12-22T08:52:41.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.891+0000 7f71eeffd640 1 -- 172.21.15.38:0/1276865288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f71d8072050 con 0x7f71f8142f50 2023-12-22T08:52:41.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.892+0000 7f71f659c640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f71d806a460 0x7f71d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:41.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.893+0000 7f71f659c640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f71d806a460 0x7f71d806c920 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f71e8034000 tx=0x7f71e8007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:41.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:41.895+0000 7f71eeffd640 1 -- 172.21.15.38:0/1276865288 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f71f0053c30 con 0x7f71f8142f50 2023-12-22T08:52:42.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.087+0000 7f71f759e640 1 -- 172.21.15.38:0/1276865288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71f8070890 con 0x7f71f8142f50 2023-12-22T08:52:42.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.088+0000 7f71eeffd640 1 -- 172.21.15.38:0/1276865288 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v177) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71f0057250 con 0x7f71f8142f50 2023-12-22T08:52:42.089 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:52:42.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.091+0000 7f71f759e640 1 -- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f71d806a460 msgr2=0x7f71d806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:42.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.091+0000 7f71f759e640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f71d806a460 0x7f71d806c920 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f71e8034000 tx=0x7f71e8007000 comp rx=0 tx=0).stop 2023-12-22T08:52:42.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.091+0000 7f71f759e640 1 -- 172.21.15.38:0/1276865288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71f8142f50 msgr2=0x7f71f8155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:42.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.091+0000 7f71f759e640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71f8142f50 0x7f71f8155750 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f71f80b3300 tx=0x7f71f0011920 comp rx=0 tx=0).stop 2023-12-22T08:52:42.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.091+0000 7f71f759e640 1 -- 172.21.15.38:0/1276865288 shutdown_connections 2023-12-22T08:52:42.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.091+0000 7f71f759e640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f71d806a460 0x7f71d806c920 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.091+0000 7f71f759e640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71f8142f50 0x7f71f8155750 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.091+0000 7f71f759e640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f8142af0 0x7f71f80b7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.091+0000 7f71f759e640 1 --2- 172.21.15.38:0/1276865288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71e40039a0 0x7f71f81422a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.091+0000 7f71f759e640 1 -- 172.21.15.38:0/1276865288 >> 172.21.15.38:0/1276865288 conn(0x7f71f806bf90 msgr2=0x7f71f806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:42.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.091+0000 7f71f759e640 1 -- 172.21.15.38:0/1276865288 shutdown_connections 2023-12-22T08:52:42.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.091+0000 7f71f759e640 1 -- 172.21.15.38:0/1276865288 wait complete. 2023-12-22T08:52:42.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:52:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.337+0000 7f187854e640 1 Processor -- start 2023-12-22T08:52:42.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.337+0000 7f187854e640 1 -- start start 2023-12-22T08:52:42.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.339+0000 7f187854e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18701547a0 0x7f187015b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.339+0000 7f187854e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1870071b90 0x7f1870070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.339+0000 7f187854e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870154b80 0x7f18700ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.339+0000 7f187854e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18700716a0 con 0x7f18701547a0 2023-12-22T08:52:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.339+0000 7f187854e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18700710e0 con 0x7f1870071b90 2023-12-22T08:52:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.339+0000 7f187854e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18700713c0 con 0x7f1870154b80 2023-12-22T08:52:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.339+0000 7f18762ea640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18701547a0 0x7f187015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.339+0000 7f18762ea640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f18701547a0 0x7f187015b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53998/0 (socket says 172.21.15.38:53998) 2023-12-22T08:52:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.339+0000 7f18762ea640 1 -- 172.21.15.38:0/1157987666 learned_addr learned my addr 172.21.15.38:0/1157987666 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.339+0000 7f1876aeb640 1 --2- 172.21.15.38:0/1157987666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870154b80 0x7f18700ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.340+0000 7f18762ea640 1 -- 172.21.15.38:0/1157987666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870154b80 msgr2=0x7f18700ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.339+0000 7f1875ae9640 1 --2- 172.21.15.38:0/1157987666 >> v2:172.21.15.89:3300/0 conn(0x7f1870071b90 0x7f1870070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.340+0000 7f18762ea640 1 --2- 172.21.15.38:0/1157987666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870154b80 0x7f18700ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.340+0000 7f18762ea640 1 -- 172.21.15.38:0/1157987666 >> v2:172.21.15.89:3300/0 conn(0x7f1870071b90 msgr2=0x7f1870070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:42.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.340+0000 7f18762ea640 1 --2- 172.21.15.38:0/1157987666 >> v2:172.21.15.89:3300/0 conn(0x7f1870071b90 0x7f1870070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.340+0000 7f18762ea640 1 -- 172.21.15.38:0/1157987666 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187015ab00 con 0x7f18701547a0 2023-12-22T08:52:42.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.340+0000 7f1876aeb640 1 --2- 172.21.15.38:0/1157987666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870154b80 0x7f18700ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.341+0000 7f18762ea640 1 --2- 172.21.15.38:0/1157987666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18701547a0 0x7f187015b300 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f18700722d0 tx=0x7f186c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180aa7e7670059bb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.341+0000 7f18752e8640 1 -- 172.21.15.38:0/1157987666 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c031870 con 0x7f18701547a0 2023-12-22T08:52:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.341+0000 7f18752e8640 1 -- 172.21.15.38:0/1157987666 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c0319d0 con 0x7f18701547a0 2023-12-22T08:52:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.341+0000 7f18752e8640 1 -- 172.21.15.38:0/1157987666 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c031d60 con 0x7f18701547a0 2023-12-22T08:52:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.342+0000 7f187854e640 1 -- 172.21.15.38:0/1157987666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18701547a0 msgr2=0x7f187015b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.342+0000 7f187854e640 1 --2- 172.21.15.38:0/1157987666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18701547a0 0x7f187015b300 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f18700722d0 tx=0x7f186c02b910 comp rx=0 tx=0).stop 2023-12-22T08:52:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.342+0000 7f187854e640 1 -- 172.21.15.38:0/1157987666 shutdown_connections 2023-12-22T08:52:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.342+0000 7f187854e640 1 --2- 172.21.15.38:0/1157987666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870154b80 0x7f18700ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.342+0000 7f187854e640 1 --2- 172.21.15.38:0/1157987666 >> v2:172.21.15.89:3300/0 conn(0x7f1870071b90 0x7f1870070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.342+0000 7f187854e640 1 --2- 172.21.15.38:0/1157987666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18701547a0 0x7f187015b300 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.342+0000 7f187854e640 1 -- 172.21.15.38:0/1157987666 >> 172.21.15.38:0/1157987666 conn(0x7f18700cf070 msgr2=0x7f18700cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:42.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.342+0000 7f187854e640 1 -- 172.21.15.38:0/1157987666 shutdown_connections 2023-12-22T08:52:42.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.342+0000 7f187854e640 1 -- 172.21.15.38:0/1157987666 wait complete. 2023-12-22T08:52:42.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.344+0000 7f187854e640 1 Processor -- start 2023-12-22T08:52:42.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.344+0000 7f187854e640 1 -- start start 2023-12-22T08:52:42.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.345+0000 7f187854e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1870071b90 0x7f187014cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:42.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.345+0000 7f187854e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18701547a0 0x7f1870150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:42.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.345+0000 7f187854e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870154b80 0x7f18701514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:42.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.345+0000 7f187854e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187014c700 con 0x7f18701547a0 2023-12-22T08:52:42.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.345+0000 7f187854e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18700afe00 con 0x7f1870071b90 2023-12-22T08:52:42.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.345+0000 7f187854e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187014ba80 con 0x7f1870154b80 2023-12-22T08:52:42.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.345+0000 7f1875ae9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18701547a0 0x7f1870150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:42.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.345+0000 7f1875ae9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18701547a0 0x7f1870150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54008/0 (socket says 172.21.15.38:54008) 2023-12-22T08:52:42.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.345+0000 7f1875ae9640 1 -- 172.21.15.38:0/3672624828 learned_addr learned my addr 172.21.15.38:0/3672624828 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:42.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.346+0000 7f1876aeb640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870154b80 0x7f18701514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:42.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.346+0000 7f18762ea640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1870071b90 0x7f187014cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:42.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.346+0000 7f1875ae9640 1 -- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870154b80 msgr2=0x7f18701514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:42.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.346+0000 7f1875ae9640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870154b80 0x7f18701514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.346+0000 7f1875ae9640 1 -- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1870071b90 msgr2=0x7f187014cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:42.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.346+0000 7f1875ae9640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1870071b90 0x7f187014cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.346+0000 7f1875ae9640 1 -- 172.21.15.38:0/3672624828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c0094d0 con 0x7f18701547a0 2023-12-22T08:52:42.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.346+0000 7f1875ae9640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18701547a0 0x7f1870150fb0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f186000c570 tx=0x7f186000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:42.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.346+0000 7f1866ffd640 1 -- 172.21.15.38:0/3672624828 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860011800 con 0x7f18701547a0 2023-12-22T08:52:42.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.346+0000 7f1866ffd640 1 -- 172.21.15.38:0/3672624828 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860011960 con 0x7f18701547a0 2023-12-22T08:52:42.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.346+0000 7f1866ffd640 1 -- 172.21.15.38:0/3672624828 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860011cd0 con 0x7f18701547a0 2023-12-22T08:52:42.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.347+0000 7f187854e640 1 -- 172.21.15.38:0/3672624828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187014bd60 con 0x7f18701547a0 2023-12-22T08:52:42.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.347+0000 7f187854e640 1 -- 172.21.15.38:0/3672624828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187014c320 con 0x7f18701547a0 2023-12-22T08:52:42.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.348+0000 7f187854e640 1 -- 172.21.15.38:0/3672624828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187014c840 con 0x7f18701547a0 2023-12-22T08:52:42.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.349+0000 7f1866ffd640 1 -- 172.21.15.38:0/3672624828 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1860022350 con 0x7f18701547a0 2023-12-22T08:52:42.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.350+0000 7f1866ffd640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f185406a460 0x7f185406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:42.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.350+0000 7f1866ffd640 1 -- 172.21.15.38:0/3672624828 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1860088950 con 0x7f18701547a0 2023-12-22T08:52:42.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.351+0000 7f1866ffd640 1 -- 172.21.15.38:0/3672624828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f1854072050 con 0x7f18701547a0 2023-12-22T08:52:42.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.351+0000 7f18762ea640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f185406a460 0x7f185406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:42.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.352+0000 7f18762ea640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f185406a460 0x7f185406c920 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f186c036000 tx=0x7f186c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:42.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.355+0000 7f1866ffd640 1 -- 172.21.15.38:0/3672624828 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f186001f060 con 0x7f18701547a0 2023-12-22T08:52:42.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.563+0000 7f187854e640 1 -- 172.21.15.38:0/3672624828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1870061910 con 0x7f18701547a0 2023-12-22T08:52:42.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.564+0000 7f1866ffd640 1 -- 172.21.15.38:0/3672624828 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v177) v1 ==== 80+0+0 (secure 0 0 0) 0x7f187014c840 con 0x7f18701547a0 2023-12-22T08:52:42.565 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:52:42.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.566+0000 7f187854e640 1 -- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f185406a460 msgr2=0x7f185406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:42.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.566+0000 7f187854e640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f185406a460 0x7f185406c920 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f186c036000 tx=0x7f186c03c040 comp rx=0 tx=0).stop 2023-12-22T08:52:42.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.566+0000 7f187854e640 1 -- 172.21.15.38:0/3672624828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18701547a0 msgr2=0x7f1870150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:42.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.566+0000 7f187854e640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18701547a0 0x7f1870150fb0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f186000c570 tx=0x7f186000ca30 comp rx=0 tx=0).stop 2023-12-22T08:52:42.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.566+0000 7f187854e640 1 -- 172.21.15.38:0/3672624828 shutdown_connections 2023-12-22T08:52:42.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.566+0000 7f187854e640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870154b80 0x7f18701514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.566+0000 7f187854e640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f185406a460 0x7f185406c920 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.566+0000 7f187854e640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18701547a0 0x7f1870150fb0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.566+0000 7f187854e640 1 --2- 172.21.15.38:0/3672624828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1870071b90 0x7f187014cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:42.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.566+0000 7f187854e640 1 -- 172.21.15.38:0/3672624828 >> 172.21.15.38:0/3672624828 conn(0x7f18700cf070 msgr2=0x7f18700b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:42.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.566+0000 7f187854e640 1 -- 172.21.15.38:0/3672624828 shutdown_connections 2023-12-22T08:52:42.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:42.566+0000 7f187854e640 1 -- 172.21.15.38:0/3672624828 wait complete. 2023-12-22T08:52:42.585 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T08:52:42.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:52:42.585 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-22T08:52:42.696 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:52:42.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:52:42.697 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T08:52:42.753 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:52:42.753 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:52:42.813 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:52:42.813 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:52:42.864 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:52:43.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.104+0000 7f4059e79640 1 Processor -- start 2023-12-22T08:52:43.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.104+0000 7f4059e79640 1 -- start start 2023-12-22T08:52:43.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.106+0000 7f4059e79640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f405415d480 0x7f40540d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:43.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.106+0000 7f4059e79640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40540a5140 0x7f4054160f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:43.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.106+0000 7f4059e79640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4054161480 0x7f40541618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:43.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.106+0000 7f4059e79640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40540d1eb0 con 0x7f405415d480 2023-12-22T08:52:43.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.106+0000 7f4059e79640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40540d2150 con 0x7f4054161480 2023-12-22T08:52:43.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.106+0000 7f4059e79640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40540d2430 con 0x7f40540a5140 2023-12-22T08:52:43.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.106+0000 7f4058e77640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f405415d480 0x7f40540d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:43.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.106+0000 7f4058e77640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f405415d480 0x7f40540d2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54016/0 (socket says 172.21.15.38:54016) 2023-12-22T08:52:43.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.106+0000 7f4058e77640 1 -- 172.21.15.38:0/3169295801 learned_addr learned my addr 172.21.15.38:0/3169295801 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:43.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.107+0000 7f4053fff640 1 --2- 172.21.15.38:0/3169295801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40540a5140 0x7f4054160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:43.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.107+0000 7f4059678640 1 --2- 172.21.15.38:0/3169295801 >> v2:172.21.15.89:3300/0 conn(0x7f4054161480 0x7f40541618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:43.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.107+0000 7f4058e77640 1 -- 172.21.15.38:0/3169295801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40540a5140 msgr2=0x7f4054160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:43.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.107+0000 7f4058e77640 1 --2- 172.21.15.38:0/3169295801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40540a5140 0x7f4054160f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.107+0000 7f4058e77640 1 -- 172.21.15.38:0/3169295801 >> v2:172.21.15.89:3300/0 conn(0x7f4054161480 msgr2=0x7f40541618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:43.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.107+0000 7f4058e77640 1 --2- 172.21.15.38:0/3169295801 >> v2:172.21.15.89:3300/0 conn(0x7f4054161480 0x7f40541618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.107+0000 7f4058e77640 1 -- 172.21.15.38:0/3169295801 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40540d2710 con 0x7f405415d480 2023-12-22T08:52:43.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.108+0000 7f4058e77640 1 --2- 172.21.15.38:0/3169295801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405415d480 0x7f40540d2c30 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f4054160ea0 tx=0x7f404402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6360a4542e082a76 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:43.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.108+0000 7f40537fe640 1 -- 172.21.15.38:0/3169295801 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404402c9e0 con 0x7f405415d480 2023-12-22T08:52:43.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.108+0000 7f40537fe640 1 -- 172.21.15.38:0/3169295801 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404402cb40 con 0x7f405415d480 2023-12-22T08:52:43.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.108+0000 7f40537fe640 1 -- 172.21.15.38:0/3169295801 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40440343f0 con 0x7f405415d480 2023-12-22T08:52:43.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.109+0000 7f4059e79640 1 -- 172.21.15.38:0/3169295801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405415d480 msgr2=0x7f40540d2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:43.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.109+0000 7f4059e79640 1 --2- 172.21.15.38:0/3169295801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405415d480 0x7f40540d2c30 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f4054160ea0 tx=0x7f404402be40 comp rx=0 tx=0).stop 2023-12-22T08:52:43.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.109+0000 7f4059e79640 1 -- 172.21.15.38:0/3169295801 shutdown_connections 2023-12-22T08:52:43.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.109+0000 7f4059e79640 1 --2- 172.21.15.38:0/3169295801 >> v2:172.21.15.89:3300/0 conn(0x7f4054161480 0x7f40541618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.109+0000 7f4059e79640 1 --2- 172.21.15.38:0/3169295801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40540a5140 0x7f4054160f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.109+0000 7f4059e79640 1 --2- 172.21.15.38:0/3169295801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405415d480 0x7f40540d2c30 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.109+0000 7f4059e79640 1 -- 172.21.15.38:0/3169295801 >> 172.21.15.38:0/3169295801 conn(0x7f405406ced0 msgr2=0x7f4054071260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:43.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.109+0000 7f4059e79640 1 -- 172.21.15.38:0/3169295801 shutdown_connections 2023-12-22T08:52:43.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.109+0000 7f4059e79640 1 -- 172.21.15.38:0/3169295801 wait complete. 2023-12-22T08:52:43.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.111+0000 7f4059e79640 1 Processor -- start 2023-12-22T08:52:43.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.111+0000 7f4059e79640 1 -- start start 2023-12-22T08:52:43.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.112+0000 7f4059e79640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40540a5140 0x7f4054159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:43.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.112+0000 7f4059e79640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405415d480 0x7f405415b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:43.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.112+0000 7f4059e79640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4054161480 0x7f405415b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:43.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.112+0000 7f4059e79640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40541f5050 con 0x7f405415d480 2023-12-22T08:52:43.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.112+0000 7f4059e79640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40541f5330 con 0x7f4054161480 2023-12-22T08:52:43.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.112+0000 7f4059e79640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40541f5610 con 0x7f40540a5140 2023-12-22T08:52:43.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.112+0000 7f4053fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405415d480 0x7f405415b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:43.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.112+0000 7f4053fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405415d480 0x7f405415b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54020/0 (socket says 172.21.15.38:54020) 2023-12-22T08:52:43.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.112+0000 7f4053fff640 1 -- 172.21.15.38:0/4115614232 learned_addr learned my addr 172.21.15.38:0/4115614232 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:43.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.113+0000 7f4058e77640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40540a5140 0x7f4054159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:43.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.113+0000 7f4059678640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4054161480 0x7f405415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:43.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.113+0000 7f4053fff640 1 -- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40540a5140 msgr2=0x7f4054159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:43.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.113+0000 7f4053fff640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40540a5140 0x7f4054159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.113+0000 7f4053fff640 1 -- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4054161480 msgr2=0x7f405415b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:43.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.113+0000 7f4053fff640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4054161480 0x7f405415b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.113+0000 7f4053fff640 1 -- 172.21.15.38:0/4115614232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4044009b30 con 0x7f405415d480 2023-12-22T08:52:43.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.113+0000 7f4058e77640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40540a5140 0x7f4054159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:43.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.113+0000 7f4053fff640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405415d480 0x7f405415b330 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f403c00d800 tx=0x7f403c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:43.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.114+0000 7f40517fa640 1 -- 172.21.15.38:0/4115614232 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0096a0 con 0x7f405415d480 2023-12-22T08:52:43.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.114+0000 7f40517fa640 1 -- 172.21.15.38:0/4115614232 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c009800 con 0x7f405415d480 2023-12-22T08:52:43.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.114+0000 7f40517fa640 1 -- 172.21.15.38:0/4115614232 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c009b90 con 0x7f405415d480 2023-12-22T08:52:43.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.114+0000 7f4059e79640 1 -- 172.21.15.38:0/4115614232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40541f58f0 con 0x7f405415d480 2023-12-22T08:52:43.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.114+0000 7f4059e79640 1 -- 172.21.15.38:0/4115614232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40541f60f0 con 0x7f405415d480 2023-12-22T08:52:43.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.115+0000 7f4059e79640 1 -- 172.21.15.38:0/4115614232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405406a1c0 con 0x7f405415d480 2023-12-22T08:52:43.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.116+0000 7f40517fa640 1 -- 172.21.15.38:0/4115614232 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f403c009cf0 con 0x7f405415d480 2023-12-22T08:52:43.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.117+0000 7f40517fa640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f403406a430 0x7f403406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:43.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.118+0000 7f40517fa640 1 -- 172.21.15.38:0/4115614232 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f403c088ec0 con 0x7f405415d480 2023-12-22T08:52:43.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.118+0000 7f40517fa640 1 -- 172.21.15.38:0/4115614232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f4034072020 con 0x7f405415d480 2023-12-22T08:52:43.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.118+0000 7f4058e77640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f403406a430 0x7f403406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:43.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.119+0000 7f4058e77640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f403406a430 0x7f403406c8f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4044035000 tx=0x7f4044030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:43.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.121+0000 7f40517fa640 1 -- 172.21.15.38:0/4115614232 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f403c0543d0 con 0x7f405415d480 2023-12-22T08:52:43.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.331+0000 7f4059e79640 1 -- 172.21.15.38:0/4115614232 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40541612a0 con 0x7f405415d480 2023-12-22T08:52:43.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.334+0000 7f40517fa640 1 -- 172.21.15.38:0/4115614232 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+16187 (secure 0 0 0) 0x7f403c00b440 con 0x7f405415d480 2023-12-22T08:52:43.335 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:52:43.335 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":177,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:52:16.380719+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:51:22.983948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-22T08:51:24.133013+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3","mappings":[{"from":2,"to":6}]},{"pgid":"21.29","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:52:43.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.336+0000 7f4059e79640 1 -- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f403406a430 msgr2=0x7f403406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:43.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.336+0000 7f4059e79640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f403406a430 0x7f403406c8f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4044035000 tx=0x7f4044030000 comp rx=0 tx=0).stop 2023-12-22T08:52:43.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.336+0000 7f4059e79640 1 -- 172.21.15.38:0/4115614232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405415d480 msgr2=0x7f405415b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:43.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.336+0000 7f4059e79640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405415d480 0x7f405415b330 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f403c00d800 tx=0x7f403c00dcc0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.336+0000 7f4059e79640 1 -- 172.21.15.38:0/4115614232 shutdown_connections 2023-12-22T08:52:43.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.336+0000 7f4059e79640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4054161480 0x7f405415b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.336+0000 7f4059e79640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f403406a430 0x7f403406c8f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.336+0000 7f4059e79640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f405415d480 0x7f405415b330 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.336+0000 7f4059e79640 1 --2- 172.21.15.38:0/4115614232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40540a5140 0x7f4054159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.336+0000 7f4059e79640 1 -- 172.21.15.38:0/4115614232 >> 172.21.15.38:0/4115614232 conn(0x7f405406ced0 msgr2=0x7f405415d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:43.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.336+0000 7f4059e79640 1 -- 172.21.15.38:0/4115614232 shutdown_connections 2023-12-22T08:52:43.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.336+0000 7f4059e79640 1 -- 172.21.15.38:0/4115614232 wait complete. 2023-12-22T08:52:43.354 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:51:22.983948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:51:24.133013+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:52:43.355 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:52:43.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.569+0000 7f5157311640 1 Processor -- start 2023-12-22T08:52:43.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.569+0000 7f5157311640 1 -- start start 2023-12-22T08:52:43.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.571+0000 7f5157311640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f515015d3e0 0x7f515015b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:43.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.571+0000 7f5157311640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5150070360 con 0x7f515015a7b0 2023-12-22T08:52:43.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.571+0000 7f5157311640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5150070640 con 0x7f515015d7c0 2023-12-22T08:52:43.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.571+0000 7f5157311640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5150070170 con 0x7f515015d3e0 2023-12-22T08:52:43.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.571+0000 7f515630f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f515015d3e0 0x7f515015b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:43.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.571+0000 7f5156b10640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f515015a7b0 0x7f515006d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43416/0 (socket says 172.21.15.38:43416) 2023-12-22T08:52:43.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.571+0000 7f5156b10640 1 -- 172.21.15.38:0/400760000 learned_addr learned my addr 172.21.15.38:0/400760000 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.572+0000 7f515630f640 1 -- 172.21.15.38:0/400760000 >> v1:172.21.15.89:6789/0 conn(0x7f515015d7c0 legacy=0x7f515006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.572+0000 7f515630f640 1 -- 172.21.15.38:0/400760000 >> v1:172.21.15.38:6789/0 conn(0x7f515015a7b0 legacy=0x7f515006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.572+0000 7f515630f640 1 -- 172.21.15.38:0/400760000 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5150070920 con 0x7f515015d3e0 2023-12-22T08:52:43.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.572+0000 7f515530d640 1 -- 172.21.15.38:0/400760000 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349955296 0 0) 0x7f5150070360 con 0x7f515015a7b0 2023-12-22T08:52:43.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.573+0000 7f515630f640 1 --2- 172.21.15.38:0/400760000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f515015d3e0 0x7f515015b820 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f514c0097a0 tx=0x7f514c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3559e5506c5534cb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:43.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.573+0000 7f515530d640 1 -- 172.21.15.38:0/400760000 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c031830 con 0x7f515015d3e0 2023-12-22T08:52:43.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.573+0000 7f515530d640 1 -- 172.21.15.38:0/400760000 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c031990 con 0x7f515015d3e0 2023-12-22T08:52:43.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.573+0000 7f515530d640 1 -- 172.21.15.38:0/400760000 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c031d20 con 0x7f515015d3e0 2023-12-22T08:52:43.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.574+0000 7f5157311640 1 -- 172.21.15.38:0/400760000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f515015d3e0 msgr2=0x7f515015b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:43.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.574+0000 7f5157311640 1 --2- 172.21.15.38:0/400760000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f515015d3e0 0x7f515015b820 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f514c0097a0 tx=0x7f514c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.574+0000 7f5157311640 1 -- 172.21.15.38:0/400760000 shutdown_connections 2023-12-22T08:52:43.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.574+0000 7f5157311640 1 --2- 172.21.15.38:0/400760000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f515015d3e0 0x7f515015b820 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.574+0000 7f5157311640 1 -- 172.21.15.38:0/400760000 >> 172.21.15.38:0/400760000 conn(0x7f51500b0b60 msgr2=0x7f51500b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:43.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.574+0000 7f5157311640 1 -- 172.21.15.38:0/400760000 shutdown_connections 2023-12-22T08:52:43.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.574+0000 7f5157311640 1 -- 172.21.15.38:0/400760000 wait complete. 2023-12-22T08:52:43.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.576+0000 7f5157311640 1 Processor -- start 2023-12-22T08:52:43.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.576+0000 7f5157311640 1 -- start start 2023-12-22T08:52:43.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.577+0000 7f5157311640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515015a7b0 0x7f5150156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:43.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.577+0000 7f5157311640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f515015d3e0 0x7f5150142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:43.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.577+0000 7f5157311640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f515015d7c0 0x7f51501f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:43.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.577+0000 7f5157311640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5150155e70 con 0x7f515015d3e0 2023-12-22T08:52:43.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.577+0000 7f5157311640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5150142f70 con 0x7f515015a7b0 2023-12-22T08:52:43.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.577+0000 7f5157311640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5150099eb0 con 0x7f515015d7c0 2023-12-22T08:52:43.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.577+0000 7f5155b0e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f515015d3e0 0x7f5150142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:43.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.577+0000 7f5155b0e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f515015d3e0 0x7f5150142a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54048/0 (socket says 172.21.15.38:54048) 2023-12-22T08:52:43.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.577+0000 7f5155b0e640 1 -- 172.21.15.38:0/2935241414 learned_addr learned my addr 172.21.15.38:0/2935241414 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:43.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.578+0000 7f515630f640 1 --2- 172.21.15.38:0/2935241414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515015a7b0 0x7f5150156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:43.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.578+0000 7f5155b0e640 1 -- 172.21.15.38:0/2935241414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f515015d7c0 msgr2=0x7f51501f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:43.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.578+0000 7f5155b0e640 1 --2- 172.21.15.38:0/2935241414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f515015d7c0 0x7f51501f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.578+0000 7f5155b0e640 1 -- 172.21.15.38:0/2935241414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515015a7b0 msgr2=0x7f5150156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:43.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.578+0000 7f5155b0e640 1 --2- 172.21.15.38:0/2935241414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515015a7b0 0x7f5150156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.578+0000 7f5155b0e640 1 -- 172.21.15.38:0/2935241414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c009400 con 0x7f515015d3e0 2023-12-22T08:52:43.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.578+0000 7f5155b0e640 1 --2- 172.21.15.38:0/2935241414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f515015d3e0 0x7f5150142a30 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f514000b420 tx=0x7f514000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:43.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.578+0000 7f5146ffd640 1 -- 172.21.15.38:0/2935241414 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140011830 con 0x7f515015d3e0 2023-12-22T08:52:43.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.578+0000 7f5146ffd640 1 -- 172.21.15.38:0/2935241414 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5140011990 con 0x7f515015d3e0 2023-12-22T08:52:43.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.578+0000 7f5157311640 1 -- 172.21.15.38:0/2935241414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5150155860 con 0x7f515015d3e0 2023-12-22T08:52:43.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.578+0000 7f5146ffd640 1 -- 172.21.15.38:0/2935241414 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140011d40 con 0x7f515015d3e0 2023-12-22T08:52:43.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.579+0000 7f5157311640 1 -- 172.21.15.38:0/2935241414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5150155b00 con 0x7f515015d3e0 2023-12-22T08:52:43.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.580+0000 7f5157311640 1 -- 172.21.15.38:0/2935241414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5150156020 con 0x7f515015d3e0 2023-12-22T08:52:43.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.581+0000 7f5146ffd640 1 -- 172.21.15.38:0/2935241414 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f514001b460 con 0x7f515015d3e0 2023-12-22T08:52:43.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.582+0000 7f5146ffd640 1 --2- 172.21.15.38:0/2935241414 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f513406a460 0x7f513406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:43.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.582+0000 7f5146ffd640 1 -- 172.21.15.38:0/2935241414 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5140088400 con 0x7f515015d3e0 2023-12-22T08:52:43.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.582+0000 7f5146ffd640 1 -- 172.21.15.38:0/2935241414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f5134072050 con 0x7f515015d3e0 2023-12-22T08:52:43.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.583+0000 7f515630f640 1 --2- 172.21.15.38:0/2935241414 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f513406a460 0x7f513406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:43.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.584+0000 7f515630f640 1 --2- 172.21.15.38:0/2935241414 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f513406a460 0x7f513406c920 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f514c036000 tx=0x7f514c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:43.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.587+0000 7f5146ffd640 1 -- 172.21.15.38:0/2935241414 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5150156020 con 0x7f515015d3e0 2023-12-22T08:52:43.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.780+0000 7f5157311640 1 -- 172.21.15.38:0/2935241414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5150156020 con 0x7f515015d3e0 2023-12-22T08:52:43.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.781+0000 7f5146ffd640 1 -- 172.21.15.38:0/2935241414 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v177) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5150156020 con 0x7f515015d3e0 2023-12-22T08:52:43.781 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:52:43.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.783+0000 7f5157311640 1 -- 172.21.15.38:0/2935241414 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f513406a460 msgr2=0x7f513406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:43.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.783+0000 7f5157311640 1 --2- 172.21.15.38:0/2935241414 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f513406a460 0x7f513406c920 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f514c036000 tx=0x7f514c008030 comp rx=0 tx=0).stop 2023-12-22T08:52:43.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.783+0000 7f5157311640 1 -- 172.21.15.38:0/2935241414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f515015d3e0 msgr2=0x7f5150142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:43.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.783+0000 7f5157311640 1 --2- 172.21.15.38:0/2935241414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f515015d3e0 0x7f5150142a30 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f514000b420 tx=0x7f514000b8e0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.783+0000 7f5157311640 1 -- 172.21.15.38:0/2935241414 shutdown_connections 2023-12-22T08:52:43.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.783+0000 7f5157311640 1 --2- 172.21.15.38:0/2935241414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f515015d7c0 0x7f51501f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.783+0000 7f5157311640 1 --2- 172.21.15.38:0/2935241414 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f513406a460 0x7f513406c920 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.783+0000 7f5157311640 1 --2- 172.21.15.38:0/2935241414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f515015d3e0 0x7f5150142a30 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.783+0000 7f5157311640 1 --2- 172.21.15.38:0/2935241414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515015a7b0 0x7f5150156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:43.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.783+0000 7f5157311640 1 -- 172.21.15.38:0/2935241414 >> 172.21.15.38:0/2935241414 conn(0x7f51500b0b60 msgr2=0x7f5150159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:43.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.783+0000 7f5157311640 1 -- 172.21.15.38:0/2935241414 shutdown_connections 2023-12-22T08:52:43.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:43.783+0000 7f5157311640 1 -- 172.21.15.38:0/2935241414 wait complete. 2023-12-22T08:52:43.803 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:52:44.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.026+0000 7f451c226640 1 Processor -- start 2023-12-22T08:52:44.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.026+0000 7f451c226640 1 -- start start 2023-12-22T08:52:44.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.028+0000 7f451c226640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45140b22c0 0x7f45140b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.028+0000 7f451c226640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f45140b26a0 0x7f451406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.028+0000 7f451c226640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45140b4510 con 0x7f451406cf50 2023-12-22T08:52:44.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.028+0000 7f451c226640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451406c610 con 0x7f45140b26a0 2023-12-22T08:52:44.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.028+0000 7f451c226640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45140b3f50 con 0x7f45140b22c0 2023-12-22T08:52:44.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.028+0000 7f451a7c3640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f451406cf50 0x7f45140cb830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43428/0 (socket says 172.21.15.38:43428) 2023-12-22T08:52:44.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.028+0000 7f451a7c3640 1 -- 172.21.15.38:0/1097749380 learned_addr learned my addr 172.21.15.38:0/1097749380 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:44.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.029+0000 7f4519fc2640 1 --2- 172.21.15.38:0/1097749380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45140b22c0 0x7f45140b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.029+0000 7f45197c1640 1 --2- 172.21.15.38:0/1097749380 >> v2:172.21.15.89:3300/0 conn(0x7f45140b26a0 0x7f451406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.029+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720755839 0 0) 0x7f45140b4510 con 0x7f451406cf50 2023-12-22T08:52:44.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.029+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44fc003520 con 0x7f451406cf50 2023-12-22T08:52:44.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.029+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 637502884 0 0) 0x7f44fc003520 con 0x7f451406cf50 2023-12-22T08:52:44.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.029+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45140b22c0 msgr2=0x7f45140b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:44.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.029+0000 7f4518fc0640 1 --2- 172.21.15.38:0/1097749380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45140b22c0 0x7f45140b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.029+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 >> v2:172.21.15.89:3300/0 conn(0x7f45140b26a0 msgr2=0x7f451406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:44.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.029+0000 7f4518fc0640 1 --2- 172.21.15.38:0/1097749380 >> v2:172.21.15.89:3300/0 conn(0x7f45140b26a0 0x7f451406ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.029+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45140b4230 con 0x7f451406cf50 2023-12-22T08:52:44.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.029+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f450c001670 con 0x7f451406cf50 2023-12-22T08:52:44.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.029+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 >> v1:172.21.15.38:6789/0 conn(0x7f451406cf50 legacy=0x7f45140cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.030+0000 7f4518fc0640 1 --2- 172.21.15.38:0/1097749380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44fc003970 0x7f44fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.030+0000 7f4518fc0640 1 --2- 172.21.15.38:0/1097749380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45140b22c0 0x7f44fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.030+0000 7f4518fc0640 1 --2- 172.21.15.38:0/1097749380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44fc004d00 0x7f44fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.030+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451406c610 con 0x7f44fc003970 2023-12-22T08:52:44.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.030+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45140b3f50 con 0x7f44fc004d00 2023-12-22T08:52:44.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.030+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc00b9b0 con 0x7f45140b22c0 2023-12-22T08:52:44.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.030+0000 7f4519fc2640 1 --2- 172.21.15.38:0/1097749380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44fc003970 0x7f44fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.030+0000 7f45197c1640 1 --2- 172.21.15.38:0/1097749380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45140b22c0 0x7f44fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.030+0000 7f4519fc2640 1 -- 172.21.15.38:0/1097749380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45140b22c0 msgr2=0x7f44fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:44.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.030+0000 7f4519fc2640 1 --2- 172.21.15.38:0/1097749380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45140b22c0 0x7f44fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.030+0000 7f4519fc2640 1 -- 172.21.15.38:0/1097749380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44fc004d00 msgr2=0x7f44fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:44.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.030+0000 7f4519fc2640 1 --2- 172.21.15.38:0/1097749380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44fc004d00 0x7f44fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.030+0000 7f4519fc2640 1 -- 172.21.15.38:0/1097749380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc003520 con 0x7f44fc003970 2023-12-22T08:52:44.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.032+0000 7f4519fc2640 1 --2- 172.21.15.38:0/1097749380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44fc003970 0x7f44fc003d90 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f4504009fc0 tx=0x7f44fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91014ae593e6306 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:44.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.032+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450402cc20 con 0x7f44fc003970 2023-12-22T08:52:44.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.032+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450400f040 con 0x7f44fc003970 2023-12-22T08:52:44.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.032+0000 7f4518fc0640 1 -- 172.21.15.38:0/1097749380 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4504034440 con 0x7f44fc003970 2023-12-22T08:52:44.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.032+0000 7f451c226640 1 -- 172.21.15.38:0/1097749380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44fc003970 msgr2=0x7f44fc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.032+0000 7f451c226640 1 --2- 172.21.15.38:0/1097749380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44fc003970 0x7f44fc003d90 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f4504009fc0 tx=0x7f44fc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.033+0000 7f451a7c3640 1 -- 172.21.15.38:0/1097749380 reap_dead start 2023-12-22T08:52:44.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.033+0000 7f451c226640 1 -- 172.21.15.38:0/1097749380 shutdown_connections 2023-12-22T08:52:44.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.033+0000 7f451c226640 1 -- 172.21.15.38:0/1097749380 >> 172.21.15.38:0/1097749380 conn(0x7f45140cf070 msgr2=0x7f45140cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:44.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.033+0000 7f451c226640 1 -- 172.21.15.38:0/1097749380 shutdown_connections 2023-12-22T08:52:44.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.033+0000 7f451c226640 1 -- 172.21.15.38:0/1097749380 wait complete. 2023-12-22T08:52:44.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.035+0000 7f451c226640 1 Processor -- start 2023-12-22T08:52:44.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.035+0000 7f451c226640 1 -- start start 2023-12-22T08:52:44.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f451c226640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44fc003970 0x7f45140adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f451c226640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45140cd270 0x7f45141fa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f451c226640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45140cd6f0 0x7f45141502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f451c226640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45140adae0 con 0x7f45140cd270 2023-12-22T08:52:44.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f451c226640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45141fb280 con 0x7f44fc003970 2023-12-22T08:52:44.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f451c226640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45141fb560 con 0x7f45140cd6f0 2023-12-22T08:52:44.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f45197c1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45140cd270 0x7f45141fa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f45197c1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45140cd270 0x7f45141fa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54076/0 (socket says 172.21.15.38:54076) 2023-12-22T08:52:44.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f45197c1640 1 -- 172.21.15.38:0/3072331917 learned_addr learned my addr 172.21.15.38:0/3072331917 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:44.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f451a7c3640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45140cd6f0 0x7f45141502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f4519fc2640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44fc003970 0x7f45140adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f45197c1640 1 -- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45140cd6f0 msgr2=0x7f45141502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f45197c1640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45140cd6f0 0x7f45141502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f45197c1640 1 -- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44fc003970 msgr2=0x7f45140adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.036+0000 7f45197c1640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44fc003970 0x7f45140adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.037+0000 7f45197c1640 1 -- 172.21.15.38:0/3072331917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45140ad700 con 0x7f45140cd270 2023-12-22T08:52:44.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.037+0000 7f45197c1640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45140cd270 0x7f45141fa7e0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f45080116d0 tx=0x7f4508011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:44.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.037+0000 7f45127fc640 1 -- 172.21.15.38:0/3072331917 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450800f9c0 con 0x7f45140cd270 2023-12-22T08:52:44.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.037+0000 7f45127fc640 1 -- 172.21.15.38:0/3072331917 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450800fb20 con 0x7f45140cd270 2023-12-22T08:52:44.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.037+0000 7f45127fc640 1 -- 172.21.15.38:0/3072331917 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450800fe90 con 0x7f45140cd270 2023-12-22T08:52:44.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.037+0000 7f451c226640 1 -- 172.21.15.38:0/3072331917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45140ae440 con 0x7f45140cd270 2023-12-22T08:52:44.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.037+0000 7f451c226640 1 -- 172.21.15.38:0/3072331917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45140ad3f0 con 0x7f45140cd270 2023-12-22T08:52:44.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.038+0000 7f451c226640 1 -- 172.21.15.38:0/3072331917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45141fb720 con 0x7f45140cd270 2023-12-22T08:52:44.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.039+0000 7f45127fc640 1 -- 172.21.15.38:0/3072331917 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4508015460 con 0x7f45140cd270 2023-12-22T08:52:44.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.040+0000 7f45127fc640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f450006a430 0x7f450006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.040+0000 7f45127fc640 1 -- 172.21.15.38:0/3072331917 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4508088e20 con 0x7f45140cd270 2023-12-22T08:52:44.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.041+0000 7f45127fc640 1 -- 172.21.15.38:0/3072331917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f4500072020 con 0x7f45140cd270 2023-12-22T08:52:44.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.041+0000 7f4519fc2640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f450006a430 0x7f450006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.042+0000 7f4519fc2640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f450006a430 0x7f450006c8f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4504036000 tx=0x7f450402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:44.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.045+0000 7f45127fc640 1 -- 172.21.15.38:0/3072331917 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f45080543c0 con 0x7f45140cd270 2023-12-22T08:52:44.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.242+0000 7f451c226640 1 -- 172.21.15.38:0/3072331917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4514061910 con 0x7f45140cd270 2023-12-22T08:52:44.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.242+0000 7f45127fc640 1 -- 172.21.15.38:0/3072331917 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v177) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4508022070 con 0x7f45140cd270 2023-12-22T08:52:44.243 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:52:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.245+0000 7f451c226640 1 -- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f450006a430 msgr2=0x7f450006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.245+0000 7f451c226640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f450006a430 0x7f450006c8f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4504036000 tx=0x7f450402e000 comp rx=0 tx=0).stop 2023-12-22T08:52:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.245+0000 7f451c226640 1 -- 172.21.15.38:0/3072331917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45140cd270 msgr2=0x7f45141fa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.245+0000 7f451c226640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45140cd270 0x7f45141fa7e0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f45080116d0 tx=0x7f4508011b90 comp rx=0 tx=0).stop 2023-12-22T08:52:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.245+0000 7f451c226640 1 -- 172.21.15.38:0/3072331917 shutdown_connections 2023-12-22T08:52:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.245+0000 7f451c226640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45140cd6f0 0x7f45141502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.245+0000 7f451c226640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f450006a430 0x7f450006c8f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.245+0000 7f451c226640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45140cd270 0x7f45141fa7e0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.245+0000 7f451c226640 1 --2- 172.21.15.38:0/3072331917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44fc003970 0x7f45140adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.245+0000 7f451c226640 1 -- 172.21.15.38:0/3072331917 >> 172.21.15.38:0/3072331917 conn(0x7f45140cf070 msgr2=0x7f451415f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.245+0000 7f451c226640 1 -- 172.21.15.38:0/3072331917 shutdown_connections 2023-12-22T08:52:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.245+0000 7f451c226640 1 -- 172.21.15.38:0/3072331917 wait complete. 2023-12-22T08:52:44.266 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:52:44.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.498+0000 7f3ec0a22640 1 Processor -- start 2023-12-22T08:52:44.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.499+0000 7f3ec0a22640 1 -- start start 2023-12-22T08:52:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.500+0000 7f3ec0a22640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc071080 0x7f3ebc0d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.500+0000 7f3ec0a22640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ebc15de50 con 0x7f3ebc15d1c0 2023-12-22T08:52:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.500+0000 7f3ec0a22640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ebc0d0dd0 con 0x7f3ebc15d5a0 2023-12-22T08:52:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.500+0000 7f3ec0a22640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0d10b0 con 0x7f3ebc071080 2023-12-22T08:52:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.501+0000 7f3ebad9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3ebc15d1c0 0x7f3ebc070970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43430/0 (socket says 172.21.15.38:43430) 2023-12-22T08:52:44.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.501+0000 7f3ebad9d640 1 -- 172.21.15.38:0/4105776867 learned_addr learned my addr 172.21.15.38:0/4105776867 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:44.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.501+0000 7f3eba59c640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc071080 0x7f3ebc0d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.501+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910451575 0 0) 0x7f3ebc15de50 con 0x7f3ebc15d1c0 2023-12-22T08:52:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.501+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ea8003520 con 0x7f3ebc15d1c0 2023-12-22T08:52:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3903635152 0 0) 0x7f3ea8003520 con 0x7f3ebc15d1c0 2023-12-22T08:52:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc071080 msgr2=0x7f3ebc0d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eb9d9b640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc071080 0x7f3ebc0d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 >> v1:172.21.15.89:6789/0 conn(0x7f3ebc15d5a0 legacy=0x7f3ebc0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc15dae0 con 0x7f3ebc15d1c0 2023-12-22T08:52:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f3eac0019f0 con 0x7f3ebc15d1c0 2023-12-22T08:52:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 >> v1:172.21.15.38:6789/0 conn(0x7f3ebc15d1c0 legacy=0x7f3ebc070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eb9d9b640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80039a0 0x7f3ea8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eb9d9b640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ea80047c0 0x7f3ea8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eb9d9b640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc071080 0x7f3ea8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0d10b0 con 0x7f3ea80047c0 2023-12-22T08:52:44.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea800ba30 con 0x7f3ea80039a0 2023-12-22T08:52:44.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea800bbf0 con 0x7f3ebc071080 2023-12-22T08:52:44.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3eba59c640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ea80047c0 0x7f3ea8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.502+0000 7f3ebb59e640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc071080 0x7f3ea8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.503+0000 7f3eba59c640 1 -- 172.21.15.38:0/4105776867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc071080 msgr2=0x7f3ea8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:44.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.503+0000 7f3ebad9d640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80039a0 0x7f3ea8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.503+0000 7f3eba59c640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc071080 0x7f3ea8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.503+0000 7f3eba59c640 1 -- 172.21.15.38:0/4105776867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80039a0 msgr2=0x7f3ea8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:44.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.503+0000 7f3eba59c640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80039a0 0x7f3ea8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.503+0000 7f3eba59c640 1 -- 172.21.15.38:0/4105776867 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea8003520 con 0x7f3ea80047c0 2023-12-22T08:52:44.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.503+0000 7f3ebb59e640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc071080 0x7f3ea8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:44.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.503+0000 7f3ebad9d640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80039a0 0x7f3ea8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:44.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.504+0000 7f3eba59c640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ea80047c0 0x7f3ea8004c40 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009a90 tx=0x7f3ea80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a699fcd8f87529 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:44.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.504+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea402c660 con 0x7f3ea80047c0 2023-12-22T08:52:44.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.504+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea402c7c0 con 0x7f3ea80047c0 2023-12-22T08:52:44.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.504+0000 7f3eb9d9b640 1 -- 172.21.15.38:0/4105776867 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea402cb50 con 0x7f3ea80047c0 2023-12-22T08:52:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.505+0000 7f3ec0a22640 1 -- 172.21.15.38:0/4105776867 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ea80047c0 msgr2=0x7f3ea8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.505+0000 7f3ec0a22640 1 --2- 172.21.15.38:0/4105776867 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ea80047c0 0x7f3ea8004c40 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009a90 tx=0x7f3ea80057f0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.505+0000 7f3ebb59e640 1 -- 172.21.15.38:0/4105776867 reap_dead start 2023-12-22T08:52:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.505+0000 7f3ec0a22640 1 -- 172.21.15.38:0/4105776867 shutdown_connections 2023-12-22T08:52:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.505+0000 7f3ec0a22640 1 -- 172.21.15.38:0/4105776867 >> 172.21.15.38:0/4105776867 conn(0x7f3ebc06bf90 msgr2=0x7f3ebc06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.505+0000 7f3ec0a22640 1 -- 172.21.15.38:0/4105776867 shutdown_connections 2023-12-22T08:52:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.505+0000 7f3ec0a22640 1 -- 172.21.15.38:0/4105776867 wait complete. 2023-12-22T08:52:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.507+0000 7f3ec0a22640 1 Processor -- start 2023-12-22T08:52:44.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.507+0000 7f3ec0a22640 1 -- start start 2023-12-22T08:52:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.508+0000 7f3ec0a22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80047c0 0x7f3ebc155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.508+0000 7f3ec0a22640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc1425d0 0x7f3ebc1592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.508+0000 7f3ec0a22640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ebc157a40 0x7f3ebc144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.508+0000 7f3ec0a22640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc158e80 con 0x7f3ebc157a40 2023-12-22T08:52:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.508+0000 7f3ec0a22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc1597e0 con 0x7f3ea80047c0 2023-12-22T08:52:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.508+0000 7f3ec0a22640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc142a50 con 0x7f3ebc1425d0 2023-12-22T08:52:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.508+0000 7f3ebb59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ebc157a40 0x7f3ebc144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.508+0000 7f3ebb59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ebc157a40 0x7f3ebc144d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54090/0 (socket says 172.21.15.38:54090) 2023-12-22T08:52:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.508+0000 7f3ebb59e640 1 -- 172.21.15.38:0/2922218297 learned_addr learned my addr 172.21.15.38:0/2922218297 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3eba59c640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc1425d0 0x7f3ebc1592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3ebad9d640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80047c0 0x7f3ebc155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3ebb59e640 1 -- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc1425d0 msgr2=0x7f3ebc1592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3ebb59e640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc1425d0 0x7f3ebc1592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3ebb59e640 1 -- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80047c0 msgr2=0x7f3ebc155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3ebb59e640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80047c0 0x7f3ebc155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3ebb59e640 1 -- 172.21.15.38:0/2922218297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc158200 con 0x7f3ebc157a40 2023-12-22T08:52:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3eba59c640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc1425d0 0x7f3ebc1592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3ebad9d640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80047c0 0x7f3ebc155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3ebb59e640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ebc157a40 0x7f3ebc144d60 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc15d980 tx=0x7f3eb400d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3eb37fe640 1 -- 172.21.15.38:0/2922218297 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400b070 con 0x7f3ebc157a40 2023-12-22T08:52:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3eb37fe640 1 -- 172.21.15.38:0/2922218297 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb4007030 con 0x7f3ebc157a40 2023-12-22T08:52:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3ec0a22640 1 -- 172.21.15.38:0/2922218297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc1584e0 con 0x7f3ebc157a40 2023-12-22T08:52:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.509+0000 7f3eb37fe640 1 -- 172.21.15.38:0/2922218297 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40073e0 con 0x7f3ebc157a40 2023-12-22T08:52:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.510+0000 7f3ec0a22640 1 -- 172.21.15.38:0/2922218297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ebc158aa0 con 0x7f3ebc157a40 2023-12-22T08:52:44.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.511+0000 7f3ec0a22640 1 -- 172.21.15.38:0/2922218297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ebc158c60 con 0x7f3ebc157a40 2023-12-22T08:52:44.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.512+0000 7f3eb37fe640 1 -- 172.21.15.38:0/2922218297 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3eb4007540 con 0x7f3ebc157a40 2023-12-22T08:52:44.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.512+0000 7f3eb37fe640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e9c06a460 0x7f3e9c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.513+0000 7f3eb37fe640 1 -- 172.21.15.38:0/2922218297 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3eb40881f0 con 0x7f3ebc157a40 2023-12-22T08:52:44.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.513+0000 7f3eb37fe640 1 -- 172.21.15.38:0/2922218297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f3e9c072050 con 0x7f3ebc157a40 2023-12-22T08:52:44.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.513+0000 7f3ebad9d640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e9c06a460 0x7f3e9c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.514+0000 7f3ebad9d640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e9c06a460 0x7f3e9c06c920 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f3eac002230 tx=0x7f3eac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:44.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.517+0000 7f3eb37fe640 1 -- 172.21.15.38:0/2922218297 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3eb4053790 con 0x7f3ebc157a40 2023-12-22T08:52:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.713+0000 7f3ec0a22640 1 -- 172.21.15.38:0/2922218297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ebc158fc0 con 0x7f3ebc157a40 2023-12-22T08:52:44.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.714+0000 7f3eb37fe640 1 -- 172.21.15.38:0/2922218297 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v177) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ebc158fc0 con 0x7f3ebc157a40 2023-12-22T08:52:44.715 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:52:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.717+0000 7f3ec0a22640 1 -- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e9c06a460 msgr2=0x7f3e9c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.717+0000 7f3ec0a22640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e9c06a460 0x7f3e9c06c920 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f3eac002230 tx=0x7f3eac009040 comp rx=0 tx=0).stop 2023-12-22T08:52:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.717+0000 7f3ec0a22640 1 -- 172.21.15.38:0/2922218297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ebc157a40 msgr2=0x7f3ebc144d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.717+0000 7f3ec0a22640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ebc157a40 0x7f3ebc144d60 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc15d980 tx=0x7f3eb400d890 comp rx=0 tx=0).stop 2023-12-22T08:52:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.717+0000 7f3ec0a22640 1 -- 172.21.15.38:0/2922218297 shutdown_connections 2023-12-22T08:52:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.717+0000 7f3ec0a22640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3e9c06a460 0x7f3e9c06c920 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.717+0000 7f3ec0a22640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ebc157a40 0x7f3ebc144d60 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.717+0000 7f3ec0a22640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ebc1425d0 0x7f3ebc1592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.717+0000 7f3ec0a22640 1 --2- 172.21.15.38:0/2922218297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80047c0 0x7f3ebc155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.717+0000 7f3ec0a22640 1 -- 172.21.15.38:0/2922218297 >> 172.21.15.38:0/2922218297 conn(0x7f3ebc06bf90 msgr2=0x7f3ebc0d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.718+0000 7f3ec0a22640 1 -- 172.21.15.38:0/2922218297 shutdown_connections 2023-12-22T08:52:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.718+0000 7f3ec0a22640 1 -- 172.21.15.38:0/2922218297 wait complete. 2023-12-22T08:52:44.739 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:52:44.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.963+0000 7f2ec6d15640 1 Processor -- start 2023-12-22T08:52:44.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.963+0000 7f2ec6d15640 1 -- start start 2023-12-22T08:52:44.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.965+0000 7f2ec6d15640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2ec01523b0 0x7f2ec00b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.965+0000 7f2ec6d15640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2ec00b4410 0x7f2ec00cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.965+0000 7f2ec6d15640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec00ce8e0 con 0x7f2ec0151fd0 2023-12-22T08:52:44.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.965+0000 7f2ec6d15640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec00b6080 con 0x7f2ec01523b0 2023-12-22T08:52:44.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.965+0000 7f2ec6d15640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec00b6360 con 0x7f2ec00b4410 2023-12-22T08:52:44.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.965+0000 7f2ec5d13640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2ec0151fd0 0x7f2ec00b6b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43432/0 (socket says 172.21.15.38:43432) 2023-12-22T08:52:44.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.965+0000 7f2ec5d13640 1 -- 172.21.15.38:0/2949531080 learned_addr learned my addr 172.21.15.38:0/2949531080 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:44.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.966+0000 7f2ec5512640 1 --2- 172.21.15.38:0/2949531080 >> v2:172.21.15.38:3300/0 conn(0x7f2ec01523b0 0x7f2ec00b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.966+0000 7f2ec6514640 1 --2- 172.21.15.38:0/2949531080 >> v2:172.21.15.89:3300/0 conn(0x7f2ec00b4410 0x7f2ec00cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.966+0000 7f2ec4d11640 1 -- 172.21.15.38:0/2949531080 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145508021 0 0) 0x7f2ec00ce8e0 con 0x7f2ec0151fd0 2023-12-22T08:52:44.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.966+0000 7f2ec4d11640 1 -- 172.21.15.38:0/2949531080 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eac003520 con 0x7f2ec0151fd0 2023-12-22T08:52:44.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.966+0000 7f2ec5512640 1 -- 172.21.15.38:0/2949531080 >> v2:172.21.15.89:3300/0 conn(0x7f2ec00b4410 msgr2=0x7f2ec00cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:44.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.966+0000 7f2ec5512640 1 --2- 172.21.15.38:0/2949531080 >> v2:172.21.15.89:3300/0 conn(0x7f2ec00b4410 0x7f2ec00cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.966+0000 7f2ec5512640 1 -- 172.21.15.38:0/2949531080 >> v1:172.21.15.38:6789/0 conn(0x7f2ec0151fd0 legacy=0x7f2ec00b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.966+0000 7f2ec5512640 1 -- 172.21.15.38:0/2949531080 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec00b6640 con 0x7f2ec01523b0 2023-12-22T08:52:44.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.967+0000 7f2ec5512640 1 --2- 172.21.15.38:0/2949531080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ec01523b0 0x7f2ec00b3ed0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00b58a0 tx=0x7f2eb002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764b71f2cd200ad4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:44.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.968+0000 7f2ec4d11640 1 -- 172.21.15.38:0/2949531080 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb002e070 con 0x7f2ec01523b0 2023-12-22T08:52:44.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.968+0000 7f2ec4d11640 1 -- 172.21.15.38:0/2949531080 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb00315a0 con 0x7f2ec01523b0 2023-12-22T08:52:44.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.968+0000 7f2ec4d11640 1 -- 172.21.15.38:0/2949531080 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0031930 con 0x7f2ec01523b0 2023-12-22T08:52:44.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.968+0000 7f2ec6d15640 1 -- 172.21.15.38:0/2949531080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ec01523b0 msgr2=0x7f2ec00b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.968+0000 7f2ec6d15640 1 --2- 172.21.15.38:0/2949531080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ec01523b0 0x7f2ec00b3ed0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00b58a0 tx=0x7f2eb002b840 comp rx=0 tx=0).stop 2023-12-22T08:52:44.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.968+0000 7f2ec6d15640 1 -- 172.21.15.38:0/2949531080 shutdown_connections 2023-12-22T08:52:44.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.968+0000 7f2ec6d15640 1 --2- 172.21.15.38:0/2949531080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ec01523b0 0x7f2ec00b3ed0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.968+0000 7f2ec6d15640 1 --2- 172.21.15.38:0/2949531080 >> v2:172.21.15.89:3300/0 conn(0x7f2ec00b4410 0x7f2ec00cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.968+0000 7f2ec6d15640 1 -- 172.21.15.38:0/2949531080 >> 172.21.15.38:0/2949531080 conn(0x7f2ec0071460 msgr2=0x7f2ec0071870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:44.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.968+0000 7f2ec6d15640 1 -- 172.21.15.38:0/2949531080 shutdown_connections 2023-12-22T08:52:44.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.968+0000 7f2ec6d15640 1 -- 172.21.15.38:0/2949531080 wait complete. 2023-12-22T08:52:44.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.970+0000 7f2ec6d15640 1 Processor -- start 2023-12-22T08:52:44.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.970+0000 7f2ec6d15640 1 -- start start 2023-12-22T08:52:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.971+0000 7f2ec6d15640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ec00b4410 0x7f2ec013d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.971+0000 7f2ec6d15640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ec0151fd0 0x7f2ec013d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.971+0000 7f2ec6d15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ec01523b0 0x7f2ec00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.971+0000 7f2ec6d15640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec0070b10 con 0x7f2ec00b4410 2023-12-22T08:52:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.971+0000 7f2ec6d15640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec006fc40 con 0x7f2ec01523b0 2023-12-22T08:52:44.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.971+0000 7f2ec6d15640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec006ff00 con 0x7f2ec0151fd0 2023-12-22T08:52:44.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.971+0000 7f2ec5d13640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ec00b4410 0x7f2ec013d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.972+0000 7f2ec5d13640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ec00b4410 0x7f2ec013d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54102/0 (socket says 172.21.15.38:54102) 2023-12-22T08:52:44.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.972+0000 7f2ec5d13640 1 -- 172.21.15.38:0/3256559489 learned_addr learned my addr 172.21.15.38:0/3256559489 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.972+0000 7f2ec6514640 1 --2- 172.21.15.38:0/3256559489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ec01523b0 0x7f2ec00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.972+0000 7f2ec5d13640 1 -- 172.21.15.38:0/3256559489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ec0151fd0 msgr2=0x7f2ec013d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.972+0000 7f2ec5d13640 1 --2- 172.21.15.38:0/3256559489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ec0151fd0 0x7f2ec013d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.972+0000 7f2ec5d13640 1 -- 172.21.15.38:0/3256559489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ec01523b0 msgr2=0x7f2ec00cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.972+0000 7f2ec5d13640 1 --2- 172.21.15.38:0/3256559489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ec01523b0 0x7f2ec00cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.972+0000 7f2ec5d13640 1 -- 172.21.15.38:0/3256559489 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb0009400 con 0x7f2ec00b4410 2023-12-22T08:52:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.972+0000 7f2ec5d13640 1 --2- 172.21.15.38:0/3256559489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ec00b4410 0x7f2ec013d2f0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00c500 tx=0x7f2ebc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.973+0000 7f2eb67fc640 1 -- 172.21.15.38:0/3256559489 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc005ce0 con 0x7f2ec00b4410 2023-12-22T08:52:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.973+0000 7f2eb67fc640 1 -- 172.21.15.38:0/3256559489 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc005e40 con 0x7f2ec00b4410 2023-12-22T08:52:44.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.973+0000 7f2eb67fc640 1 -- 172.21.15.38:0/3256559489 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc007330 con 0x7f2ec00b4410 2023-12-22T08:52:44.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.973+0000 7f2ec6d15640 1 -- 172.21.15.38:0/3256559489 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec00701e0 con 0x7f2ec00b4410 2023-12-22T08:52:44.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.973+0000 7f2ec6d15640 1 -- 172.21.15.38:0/3256559489 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec00707a0 con 0x7f2ec00b4410 2023-12-22T08:52:44.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.974+0000 7f2ec6d15640 1 -- 172.21.15.38:0/3256559489 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec0061910 con 0x7f2ec00b4410 2023-12-22T08:52:44.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.975+0000 7f2eb67fc640 1 -- 172.21.15.38:0/3256559489 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2ebc007490 con 0x7f2ec00b4410 2023-12-22T08:52:44.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.976+0000 7f2eb67fc640 1 --2- 172.21.15.38:0/3256559489 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ea406a430 0x7f2ea406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:44.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.976+0000 7f2eb67fc640 1 -- 172.21.15.38:0/3256559489 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2ebc088110 con 0x7f2ec00b4410 2023-12-22T08:52:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.976+0000 7f2eb67fc640 1 -- 172.21.15.38:0/3256559489 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f2ea4072020 con 0x7f2ec00b4410 2023-12-22T08:52:44.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.976+0000 7f2ec5512640 1 --2- 172.21.15.38:0/3256559489 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ea406a430 0x7f2ea406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:44.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.978+0000 7f2ec5512640 1 --2- 172.21.15.38:0/3256559489 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ea406a430 0x7f2ea406c8f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0036000 tx=0x7f2eb0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:44.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:44.980+0000 7f2eb67fc640 1 -- 172.21.15.38:0/3256559489 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2ebc057170 con 0x7f2ec00b4410 2023-12-22T08:52:45.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.191+0000 7f2ec6d15640 1 -- 172.21.15.38:0/3256559489 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2ec0065ad0 con 0x7f2ec00b4410 2023-12-22T08:52:45.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.192+0000 7f2eb67fc640 1 -- 172.21.15.38:0/3256559489 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v177) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2ebc017070 con 0x7f2ec00b4410 2023-12-22T08:52:45.193 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:52:45.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.195+0000 7f2ec6d15640 1 -- 172.21.15.38:0/3256559489 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ea406a430 msgr2=0x7f2ea406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:45.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.195+0000 7f2ec6d15640 1 --2- 172.21.15.38:0/3256559489 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ea406a430 0x7f2ea406c8f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0036000 tx=0x7f2eb0030000 comp rx=0 tx=0).stop 2023-12-22T08:52:45.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.195+0000 7f2ec6d15640 1 -- 172.21.15.38:0/3256559489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ec00b4410 msgr2=0x7f2ec013d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:45.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.195+0000 7f2ec6d15640 1 --2- 172.21.15.38:0/3256559489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ec00b4410 0x7f2ec013d2f0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00c500 tx=0x7f2ebc00c9c0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.195+0000 7f2ec6d15640 1 -- 172.21.15.38:0/3256559489 shutdown_connections 2023-12-22T08:52:45.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.195+0000 7f2ec6d15640 1 --2- 172.21.15.38:0/3256559489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ec01523b0 0x7f2ec00cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.195+0000 7f2ec6d15640 1 --2- 172.21.15.38:0/3256559489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ec0151fd0 0x7f2ec013d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.195+0000 7f2ec6d15640 1 --2- 172.21.15.38:0/3256559489 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ea406a430 0x7f2ea406c8f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.195+0000 7f2ec6d15640 1 --2- 172.21.15.38:0/3256559489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ec00b4410 0x7f2ec013d2f0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.195+0000 7f2ec6d15640 1 -- 172.21.15.38:0/3256559489 >> 172.21.15.38:0/3256559489 conn(0x7f2ec0071460 msgr2=0x7f2ec014ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:45.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.195+0000 7f2ec6d15640 1 -- 172.21.15.38:0/3256559489 shutdown_connections 2023-12-22T08:52:45.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.195+0000 7f2ec6d15640 1 -- 172.21.15.38:0/3256559489 wait complete. 2023-12-22T08:52:45.214 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T08:52:45.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:52:45.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-22T08:52:45.327 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:52:45.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:52:45.328 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T08:52:45.380 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:52:45.381 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:52:45.445 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:52:45.445 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:52:45.445 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:52:45.504 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:52:45.504 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:52:45.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.741+0000 7fdbb62a1640 1 Processor -- start 2023-12-22T08:52:45.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.741+0000 7fdbb62a1640 1 -- start start 2023-12-22T08:52:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.742+0000 7fdbb62a1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdbb0144d10 0x7fdbb00cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.742+0000 7fdbb62a1640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdbb00cc670 0x7fdbb00b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.742+0000 7fdbb62a1640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb01450f0 con 0x7fdbb00b2590 2023-12-22T08:52:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.742+0000 7fdbb62a1640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb00b2a00 con 0x7fdbb00cc670 2023-12-22T08:52:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.742+0000 7fdbb62a1640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb00ce010 con 0x7fdbb0144d10 2023-12-22T08:52:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.743+0000 7fdba7fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdbb00cc670 0x7fdbb00b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.743+0000 7fdba7fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdbb00cc670 0x7fdbb00b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54110/0 (socket says 172.21.15.38:54110) 2023-12-22T08:52:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.743+0000 7fdba7fff640 1 -- 172.21.15.38:0/783006782 learned_addr learned my addr 172.21.15.38:0/783006782 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.743+0000 7fdba7fff640 1 -- 172.21.15.38:0/783006782 >> v2:172.21.15.89:3300/0 conn(0x7fdbb0144d10 msgr2=0x7fdbb00cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.743+0000 7fdba7fff640 1 --2- 172.21.15.38:0/783006782 >> v2:172.21.15.89:3300/0 conn(0x7fdbb0144d10 0x7fdbb00cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.743+0000 7fdba7fff640 1 -- 172.21.15.38:0/783006782 >> v1:172.21.15.89:6789/0 conn(0x7fdbb00b2590 legacy=0x7fdbb015f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:45.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.743+0000 7fdba7fff640 1 -- 172.21.15.38:0/783006782 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb00ce2f0 con 0x7fdbb00cc670 2023-12-22T08:52:45.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.744+0000 7fdba7fff640 1 --2- 172.21.15.38:0/783006782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbb00cc670 0x7fdbb00b2050 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00cfe00 tx=0x7fdb9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4fc53160f8a9af server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:45.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.745+0000 7fdbaf7fe640 1 -- 172.21.15.38:0/783006782 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98031870 con 0x7fdbb00cc670 2023-12-22T08:52:45.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.745+0000 7fdbaf7fe640 1 -- 172.21.15.38:0/783006782 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb980319d0 con 0x7fdbb00cc670 2023-12-22T08:52:45.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.745+0000 7fdbaf7fe640 1 -- 172.21.15.38:0/783006782 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98031d60 con 0x7fdbb00cc670 2023-12-22T08:52:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.745+0000 7fdbb62a1640 1 -- 172.21.15.38:0/783006782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbb00cc670 msgr2=0x7fdbb00b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.745+0000 7fdbb62a1640 1 --2- 172.21.15.38:0/783006782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbb00cc670 0x7fdbb00b2050 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00cfe00 tx=0x7fdb9802b910 comp rx=0 tx=0).stop 2023-12-22T08:52:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.745+0000 7fdbb62a1640 1 -- 172.21.15.38:0/783006782 shutdown_connections 2023-12-22T08:52:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.745+0000 7fdbb62a1640 1 --2- 172.21.15.38:0/783006782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbb00cc670 0x7fdbb00b2050 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.745+0000 7fdbb62a1640 1 --2- 172.21.15.38:0/783006782 >> v2:172.21.15.89:3300/0 conn(0x7fdbb0144d10 0x7fdbb00cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.745+0000 7fdbb62a1640 1 -- 172.21.15.38:0/783006782 >> 172.21.15.38:0/783006782 conn(0x7fdbb00cf070 msgr2=0x7fdbb00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.746+0000 7fdbb62a1640 1 -- 172.21.15.38:0/783006782 shutdown_connections 2023-12-22T08:52:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.746+0000 7fdbb62a1640 1 -- 172.21.15.38:0/783006782 wait complete. 2023-12-22T08:52:45.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.747+0000 7fdbb62a1640 1 Processor -- start 2023-12-22T08:52:45.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.748+0000 7fdbb62a1640 1 -- start start 2023-12-22T08:52:45.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.748+0000 7fdbb62a1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbb00b2590 0x7fdbb0154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:45.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.748+0000 7fdbb62a1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbb0144d10 0x7fdbb013ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:45.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.748+0000 7fdbb62a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbb00ad0e0 0x7fdbb00b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:45.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.748+0000 7fdbb62a1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb013f8a0 con 0x7fdbb00b2590 2023-12-22T08:52:45.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.748+0000 7fdbb62a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb013fb80 con 0x7fdbb00ad0e0 2023-12-22T08:52:45.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.748+0000 7fdbb62a1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb006c230 con 0x7fdbb0144d10 2023-12-22T08:52:45.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.749+0000 7fdbaffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbb00b2590 0x7fdbb0154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:45.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.749+0000 7fdbaffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbb00b2590 0x7fdbb0154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54114/0 (socket says 172.21.15.38:54114) 2023-12-22T08:52:45.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.749+0000 7fdbaffff640 1 -- 172.21.15.38:0/607298720 learned_addr learned my addr 172.21.15.38:0/607298720 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:45.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.749+0000 7fdba7fff640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbb0144d10 0x7fdbb013ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:45.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.749+0000 7fdbaffff640 1 -- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbb0144d10 msgr2=0x7fdbb013ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:45.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.749+0000 7fdbaffff640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbb0144d10 0x7fdbb013ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.749+0000 7fdbaffff640 1 -- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbb00ad0e0 msgr2=0x7fdbb00b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:45.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.749+0000 7fdbb483e640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbb00ad0e0 0x7fdbb00b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:45.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.749+0000 7fdbaffff640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbb00ad0e0 0x7fdbb00b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.749+0000 7fdbaffff640 1 -- 172.21.15.38:0/607298720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980094d0 con 0x7fdbb00b2590 2023-12-22T08:52:45.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.749+0000 7fdbb483e640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbb00ad0e0 0x7fdbb00b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:45.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.750+0000 7fdbaffff640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbb00b2590 0x7fdbb0154e80 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fdba000b410 tx=0x7fdba000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:45.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.750+0000 7fdbad7fa640 1 -- 172.21.15.38:0/607298720 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0011830 con 0x7fdbb00b2590 2023-12-22T08:52:45.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.750+0000 7fdbad7fa640 1 -- 172.21.15.38:0/607298720 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba00119b0 con 0x7fdbb00b2590 2023-12-22T08:52:45.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.750+0000 7fdbad7fa640 1 -- 172.21.15.38:0/607298720 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0011d60 con 0x7fdbb00b2590 2023-12-22T08:52:45.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.750+0000 7fdbb62a1640 1 -- 172.21.15.38:0/607298720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb006c510 con 0x7fdbb00b2590 2023-12-22T08:52:45.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.750+0000 7fdbb62a1640 1 -- 172.21.15.38:0/607298720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb013f390 con 0x7fdbb00b2590 2023-12-22T08:52:45.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.751+0000 7fdbb62a1640 1 -- 172.21.15.38:0/607298720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb00cd640 con 0x7fdbb00b2590 2023-12-22T08:52:45.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.752+0000 7fdbad7fa640 1 -- 172.21.15.38:0/607298720 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdba001a400 con 0x7fdbb00b2590 2023-12-22T08:52:45.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.753+0000 7fdbad7fa640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdb9006a430 0x7fdb9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:45.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.753+0000 7fdbad7fa640 1 -- 172.21.15.38:0/607298720 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdba0088bc0 con 0x7fdbb00b2590 2023-12-22T08:52:45.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.753+0000 7fdbad7fa640 1 -- 172.21.15.38:0/607298720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7fdb90072020 con 0x7fdbb00b2590 2023-12-22T08:52:45.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.754+0000 7fdba7fff640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdb9006a430 0x7fdb9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:45.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.755+0000 7fdba7fff640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdb9006a430 0x7fdb9006c8f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fdb98036000 tx=0x7fdb9803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:45.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.758+0000 7fdbad7fa640 1 -- 172.21.15.38:0/607298720 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdba0015020 con 0x7fdbb00b2590 2023-12-22T08:52:45.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.989+0000 7fdbb62a1640 1 -- 172.21.15.38:0/607298720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbb006c700 con 0x7fdbb00b2590 2023-12-22T08:52:45.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.990+0000 7fdbad7fa640 1 -- 172.21.15.38:0/607298720 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4649 (secure 0 0 0) 0x7fdba00540d0 con 0x7fdbb00b2590 2023-12-22T08:52:45.991 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:52:45.991 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1443382612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1443382612},{"type":"v1","addr":"172.21.15.38:6835","nonce":1443382612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1913310975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1913310975},{"type":"v1","addr":"172.21.15.89:6836","nonce":1913310975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/218839128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":218839128},{"type":"v1","addr":"172.21.15.89:6837","nonce":218839128}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:51:25.111775+0000","modified":"2023-12-22T08:51:28.645925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8553":{"gid":8553,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6834/1387101372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1387101372},{"type":"v1","addr":"172.21.15.38:6834","nonce":1387101372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-22T08:52:45.991 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 78 2023-12-22T08:52:45.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.993+0000 7fdbb62a1640 1 -- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdb9006a430 msgr2=0x7fdb9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:45.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.993+0000 7fdbb62a1640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdb9006a430 0x7fdb9006c8f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fdb98036000 tx=0x7fdb9803c040 comp rx=0 tx=0).stop 2023-12-22T08:52:45.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.993+0000 7fdbb62a1640 1 -- 172.21.15.38:0/607298720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbb00b2590 msgr2=0x7fdbb0154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:45.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.993+0000 7fdbb62a1640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbb00b2590 0x7fdbb0154e80 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fdba000b410 tx=0x7fdba000b8d0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.993+0000 7fdbb62a1640 1 -- 172.21.15.38:0/607298720 shutdown_connections 2023-12-22T08:52:45.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.993+0000 7fdbb62a1640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbb00ad0e0 0x7fdbb00b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.993+0000 7fdbb62a1640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbb0144d10 0x7fdbb013ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.993+0000 7fdbb62a1640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fdb9006a430 0x7fdb9006c8f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.993+0000 7fdbb62a1640 1 --2- 172.21.15.38:0/607298720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbb00b2590 0x7fdbb0154e80 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:45.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.993+0000 7fdbb62a1640 1 -- 172.21.15.38:0/607298720 >> 172.21.15.38:0/607298720 conn(0x7fdbb00cf070 msgr2=0x7fdbb00cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:45.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.993+0000 7fdbb62a1640 1 -- 172.21.15.38:0/607298720 shutdown_connections 2023-12-22T08:52:45.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:45.993+0000 7fdbb62a1640 1 -- 172.21.15.38:0/607298720 wait complete. 2023-12-22T08:52:46.012 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:52:46.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.223+0000 7fbb81e9e640 1 Processor -- start 2023-12-22T08:52:46.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.224+0000 7fbb81e9e640 1 -- start start 2023-12-22T08:52:46.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.225+0000 7fbb81e9e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbb7c06d640 0x7fbb7c0d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.226+0000 7fbb81e9e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c15f220 con 0x7fbb7c0b3ff0 2023-12-22T08:52:46.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.226+0000 7fbb81e9e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c0d1520 con 0x7fbb7c157980 2023-12-22T08:52:46.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.226+0000 7fbb81e9e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb7c0d1800 con 0x7fbb7c06d640 2023-12-22T08:52:46.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.226+0000 7fbb73fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbb7c0b3ff0 0x7fbb7c06cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43434/0 (socket says 172.21.15.38:43434) 2023-12-22T08:52:46.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.226+0000 7fbb73fff640 1 -- 172.21.15.38:0/4208957592 learned_addr learned my addr 172.21.15.38:0/4208957592 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:46.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.226+0000 7fbb8169d640 1 --2- 172.21.15.38:0/4208957592 >> v2:172.21.15.89:3300/0 conn(0x7fbb7c06d640 0x7fbb7c0d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:46.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.226+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445527800 0 0) 0x7fbb7c15f220 con 0x7fbb7c0b3ff0 2023-12-22T08:52:46.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb64003520 con 0x7fbb7c0b3ff0 2023-12-22T08:52:46.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1000457547 0 0) 0x7fbb64003520 con 0x7fbb7c0b3ff0 2023-12-22T08:52:46.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 >> v2:172.21.15.89:3300/0 conn(0x7fbb7c06d640 msgr2=0x7fbb7c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:46.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 --2- 172.21.15.38:0/4208957592 >> v2:172.21.15.89:3300/0 conn(0x7fbb7c06d640 0x7fbb7c0d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 >> v1:172.21.15.89:6789/0 conn(0x7fbb7c157980 legacy=0x7fbb7c15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:46.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0d1ae0 con 0x7fbb7c0b3ff0 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fbb6c001670 con 0x7fbb7c0b3ff0 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 >> v1:172.21.15.38:6789/0 conn(0x7fbb7c0b3ff0 legacy=0x7fbb7c06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 --2- 172.21.15.38:0/4208957592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb640039c0 0x7fbb64003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 --2- 172.21.15.38:0/4208957592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb640047c0 0x7fbb64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 --2- 172.21.15.38:0/4208957592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb64005180 0x7fbb6400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0d1800 con 0x7fbb640039c0 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6400c080 con 0x7fbb640047c0 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6400c240 con 0x7fbb64005180 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.227+0000 7fbb80e9c640 1 --2- 172.21.15.38:0/4208957592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb640039c0 0x7fbb64003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.228+0000 7fbb80e9c640 1 -- 172.21.15.38:0/4208957592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb64005180 msgr2=0x7fbb6400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.228+0000 7fbb80e9c640 1 --2- 172.21.15.38:0/4208957592 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb64005180 0x7fbb6400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.228+0000 7fbb80e9c640 1 -- 172.21.15.38:0/4208957592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb640047c0 msgr2=0x7fbb64004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.228+0000 7fbb73fff640 1 --2- 172.21.15.38:0/4208957592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb640047c0 0x7fbb64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.228+0000 7fbb80e9c640 1 --2- 172.21.15.38:0/4208957592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb640047c0 0x7fbb64004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.228+0000 7fbb80e9c640 1 -- 172.21.15.38:0/4208957592 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb64003520 con 0x7fbb640039c0 2023-12-22T08:52:46.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.228+0000 7fbb8169d640 1 -- 172.21.15.38:0/4208957592 reap_dead start 2023-12-22T08:52:46.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.228+0000 7fbb73fff640 1 --2- 172.21.15.38:0/4208957592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb640047c0 0x7fbb64004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:46.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.229+0000 7fbb80e9c640 1 --2- 172.21.15.38:0/4208957592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb640039c0 0x7fbb64003de0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fbb78001e50 tx=0x7fbb640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fbd38ac20c02e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:46.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.229+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78003b70 con 0x7fbb640039c0 2023-12-22T08:52:46.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.229+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb78003cd0 con 0x7fbb640039c0 2023-12-22T08:52:46.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.229+0000 7fbb737fe640 1 -- 172.21.15.38:0/4208957592 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78005310 con 0x7fbb640039c0 2023-12-22T08:52:46.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.230+0000 7fbb81e9e640 1 -- 172.21.15.38:0/4208957592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb640039c0 msgr2=0x7fbb64003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:46.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.230+0000 7fbb81e9e640 1 --2- 172.21.15.38:0/4208957592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb640039c0 0x7fbb64003de0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fbb78001e50 tx=0x7fbb640057f0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.230+0000 7fbb81e9e640 1 -- 172.21.15.38:0/4208957592 shutdown_connections 2023-12-22T08:52:46.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.230+0000 7fbb81e9e640 1 --2- 172.21.15.38:0/4208957592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb640039c0 0x7fbb64003de0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.230+0000 7fbb81e9e640 1 -- 172.21.15.38:0/4208957592 >> 172.21.15.38:0/4208957592 conn(0x7fbb7c0d31f0 msgr2=0x7fbb7c0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:46.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.230+0000 7fbb81e9e640 1 -- 172.21.15.38:0/4208957592 shutdown_connections 2023-12-22T08:52:46.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.230+0000 7fbb81e9e640 1 -- 172.21.15.38:0/4208957592 wait complete. 2023-12-22T08:52:46.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.232+0000 7fbb81e9e640 1 Processor -- start 2023-12-22T08:52:46.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.232+0000 7fbb81e9e640 1 -- start start 2023-12-22T08:52:46.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.233+0000 7fbb81e9e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb640039c0 0x7fbb7c147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.233+0000 7fbb81e9e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb7c0ac8e0 0x7fbb7c0acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.233+0000 7fbb81e9e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb7c0b7670 0x7fbb7c0b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.233+0000 7fbb81e9e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0b8610 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.233+0000 7fbb81e9e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0ad2a0 con 0x7fbb640039c0 2023-12-22T08:52:46.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.233+0000 7fbb81e9e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c1481a0 con 0x7fbb7c0b7670 2023-12-22T08:52:46.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.234+0000 7fbb73fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb7c0ac8e0 0x7fbb7c0acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:46.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.234+0000 7fbb73fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb7c0ac8e0 0x7fbb7c0acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54128/0 (socket says 172.21.15.38:54128) 2023-12-22T08:52:46.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.234+0000 7fbb73fff640 1 -- 172.21.15.38:0/207731824 learned_addr learned my addr 172.21.15.38:0/207731824 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:46.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.234+0000 7fbb80e9c640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb640039c0 0x7fbb7c147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:46.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.234+0000 7fbb8169d640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb7c0b7670 0x7fbb7c0b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:46.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.234+0000 7fbb73fff640 1 -- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb7c0b7670 msgr2=0x7fbb7c0b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:46.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.234+0000 7fbb73fff640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb7c0b7670 0x7fbb7c0b7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.234+0000 7fbb73fff640 1 -- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb640039c0 msgr2=0x7fbb7c147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:46.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.234+0000 7fbb73fff640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb640039c0 0x7fbb7c147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.234+0000 7fbb73fff640 1 -- 172.21.15.38:0/207731824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0b8330 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.234+0000 7fbb73fff640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb7c0ac8e0 0x7fbb7c0acd60 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00d770 tx=0x7fbb6c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:46.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.235+0000 7fbb717fa640 1 -- 172.21.15.38:0/207731824 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0072d0 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.235+0000 7fbb717fa640 1 -- 172.21.15.38:0/207731824 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c007430 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.235+0000 7fbb717fa640 1 -- 172.21.15.38:0/207731824 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0047e0 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.235+0000 7fbb81e9e640 1 -- 172.21.15.38:0/207731824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7c148850 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.235+0000 7fbb81e9e640 1 -- 172.21.15.38:0/207731824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c148e10 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.236+0000 7fbb81e9e640 1 -- 172.21.15.38:0/207731824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7c1486b0 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.237+0000 7fbb717fa640 1 -- 172.21.15.38:0/207731824 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbb6c004940 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.238+0000 7fbb717fa640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb6806a430 0x7fbb6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.238+0000 7fbb717fa640 1 -- 172.21.15.38:0/207731824 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbb6c088140 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.239+0000 7fbb717fa640 1 -- 172.21.15.38:0/207731824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7fbb68072020 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.239+0000 7fbb80e9c640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb6806a430 0x7fbb6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:46.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.240+0000 7fbb80e9c640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb6806a430 0x7fbb6806c8f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fbb78034000 tx=0x7fbb78009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:46.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.243+0000 7fbb717fa640 1 -- 172.21.15.38:0/207731824 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbb7c1486b0 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.397+0000 7fbb717fa640 1 -- 172.21.15.38:0/207731824 <== mon.0 v2:172.21.15.38:3300/0 7 ==== osd_map(178..178 src has 1..178) v4 ==== 679+0+0 (secure 0 0 0) 0x7fbb6c057aa0 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.397+0000 7fbb717fa640 1 -- 172.21.15.38:0/207731824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fbb68072bb0 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.443+0000 7fbb81e9e640 1 -- 172.21.15.38:0/207731824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb7c1486b0 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.445+0000 7fbb717fa640 1 -- 172.21.15.38:0/207731824 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+16168 (secure 0 0 0) 0x7fbb7c1486b0 con 0x7fbb7c0ac8e0 2023-12-22T08:52:46.446 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:52:46.446 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":178,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:52:46.392689+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:51:22.983948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-22T08:51:24.133013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3","mappings":[{"from":2,"to":6}]},{"pgid":"21.29","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:52:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.447+0000 7fbb81e9e640 1 -- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb6806a430 msgr2=0x7fbb6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.447+0000 7fbb81e9e640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb6806a430 0x7fbb6806c8f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fbb78034000 tx=0x7fbb78009030 comp rx=0 tx=0).stop 2023-12-22T08:52:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.447+0000 7fbb81e9e640 1 -- 172.21.15.38:0/207731824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb7c0ac8e0 msgr2=0x7fbb7c0acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.447+0000 7fbb81e9e640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb7c0ac8e0 0x7fbb7c0acd60 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00d770 tx=0x7fbb6c00dc30 comp rx=0 tx=0).stop 2023-12-22T08:52:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.447+0000 7fbb81e9e640 1 -- 172.21.15.38:0/207731824 shutdown_connections 2023-12-22T08:52:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.447+0000 7fbb81e9e640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb7c0b7670 0x7fbb7c0b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.447+0000 7fbb81e9e640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb6806a430 0x7fbb6806c8f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.447+0000 7fbb81e9e640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb7c0ac8e0 0x7fbb7c0acd60 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.447+0000 7fbb81e9e640 1 --2- 172.21.15.38:0/207731824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb640039c0 0x7fbb7c147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.447+0000 7fbb81e9e640 1 -- 172.21.15.38:0/207731824 >> 172.21.15.38:0/207731824 conn(0x7fbb7c0d31f0 msgr2=0x7fbb7c15e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.448+0000 7fbb81e9e640 1 -- 172.21.15.38:0/207731824 shutdown_connections 2023-12-22T08:52:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.448+0000 7fbb81e9e640 1 -- 172.21.15.38:0/207731824 wait complete. 2023-12-22T08:52:46.466 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:51:22.983948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:51:24.133013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '178', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:52:46.466 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:52:46.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.685+0000 7f3f6ed16640 1 Processor -- start 2023-12-22T08:52:46.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.685+0000 7f3f6ed16640 1 -- start start 2023-12-22T08:52:46.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.686+0000 7f3f6ed16640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3f68071f90 0x7f3f680b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.686+0000 7f3f6ed16640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f6815b3c0 0x7f3f680b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.686+0000 7f3f6ed16640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f680cd080 con 0x7f3f6815a370 2023-12-22T08:52:46.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.686+0000 7f3f6ed16640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6815b940 con 0x7f3f68071f90 2023-12-22T08:52:46.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.686+0000 7f3f6ed16640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680cd320 con 0x7f3f6815b3c0 2023-12-22T08:52:46.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.687+0000 7f3f5ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3f68071f90 0x7f3f680b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:46.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.687+0000 7f3f5ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3f68071f90 0x7f3f680b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54144/0 (socket says 172.21.15.38:54144) 2023-12-22T08:52:46.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.687+0000 7f3f5ffff640 1 -- 172.21.15.38:0/2899387563 learned_addr learned my addr 172.21.15.38:0/2899387563 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:46.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.687+0000 7f3f6d2b3640 1 --2- 172.21.15.38:0/2899387563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f6815b3c0 0x7f3f680b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:46.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.687+0000 7f3f5ffff640 1 -- 172.21.15.38:0/2899387563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f6815b3c0 msgr2=0x7f3f680b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:46.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.687+0000 7f3f5ffff640 1 --2- 172.21.15.38:0/2899387563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f6815b3c0 0x7f3f680b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.687+0000 7f3f5ffff640 1 -- 172.21.15.38:0/2899387563 >> v1:172.21.15.89:6789/0 conn(0x7f3f6815a370 legacy=0x7f3f68071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:46.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.687+0000 7f3f5ffff640 1 -- 172.21.15.38:0/2899387563 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f680cd600 con 0x7f3f68071f90 2023-12-22T08:52:46.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.689+0000 7f3f5ffff640 1 --2- 172.21.15.38:0/2899387563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f68071f90 0x7f3f680b3700 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f3f680672e0 tx=0x7f3f5802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d88b8fe004c8c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:46.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.689+0000 7f3f5f7fe640 1 -- 172.21.15.38:0/2899387563 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5802d040 con 0x7f3f68071f90 2023-12-22T08:52:46.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.689+0000 7f3f5f7fe640 1 -- 172.21.15.38:0/2899387563 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58031810 con 0x7f3f68071f90 2023-12-22T08:52:46.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.689+0000 7f3f5f7fe640 1 -- 172.21.15.38:0/2899387563 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58031ba0 con 0x7f3f68071f90 2023-12-22T08:52:46.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.690+0000 7f3f6ed16640 1 -- 172.21.15.38:0/2899387563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f68071f90 msgr2=0x7f3f680b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:46.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.690+0000 7f3f6ed16640 1 --2- 172.21.15.38:0/2899387563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f68071f90 0x7f3f680b3700 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f3f680672e0 tx=0x7f3f5802b8b0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.690+0000 7f3f6ed16640 1 -- 172.21.15.38:0/2899387563 shutdown_connections 2023-12-22T08:52:46.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.690+0000 7f3f6ed16640 1 --2- 172.21.15.38:0/2899387563 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f68071f90 0x7f3f680b3700 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.690+0000 7f3f6ed16640 1 --2- 172.21.15.38:0/2899387563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f6815b3c0 0x7f3f680b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.690+0000 7f3f6ed16640 1 -- 172.21.15.38:0/2899387563 >> 172.21.15.38:0/2899387563 conn(0x7f3f680b20c0 msgr2=0x7f3f680b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:46.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.690+0000 7f3f6ed16640 1 -- 172.21.15.38:0/2899387563 shutdown_connections 2023-12-22T08:52:46.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.690+0000 7f3f6ed16640 1 -- 172.21.15.38:0/2899387563 wait complete. 2023-12-22T08:52:46.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.692+0000 7f3f6ed16640 1 Processor -- start 2023-12-22T08:52:46.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.692+0000 7f3f6ed16640 1 -- start start 2023-12-22T08:52:46.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.693+0000 7f3f6ed16640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f68071f90 0x7f3f68145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.693+0000 7f3f6ed16640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f6815a370 0x7f3f68141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.693+0000 7f3f6ed16640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f6815b3c0 0x7f3f6815bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.693+0000 7f3f6ed16640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f68070770 con 0x7f3f6815a370 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.693+0000 7f3f6ed16640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f68145ed0 con 0x7f3f6815b3c0 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.693+0000 7f3f6ed16640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f68071540 con 0x7f3f68071f90 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.693+0000 7f3f5ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f6815a370 0x7f3f68141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.693+0000 7f3f5ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f6815a370 0x7f3f68141b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54152/0 (socket says 172.21.15.38:54152) 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.693+0000 7f3f5ffff640 1 -- 172.21.15.38:0/3573508616 learned_addr learned my addr 172.21.15.38:0/3573508616 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.693+0000 7f3f6cab2640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f68071f90 0x7f3f68145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.693+0000 7f3f6d2b3640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f6815b3c0 0x7f3f6815bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.693+0000 7f3f5ffff640 1 -- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f68071f90 msgr2=0x7f3f68145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.693+0000 7f3f5ffff640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f68071f90 0x7f3f68145990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.694+0000 7f3f5ffff640 1 -- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f6815b3c0 msgr2=0x7f3f6815bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.694+0000 7f3f5ffff640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f6815b3c0 0x7f3f6815bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.694+0000 7f3f5ffff640 1 -- 172.21.15.38:0/3573508616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580094d0 con 0x7f3f6815a370 2023-12-22T08:52:46.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.694+0000 7f3f5ffff640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f6815a370 0x7f3f68141b80 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f3f5802b8f0 tx=0x7f3f580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:46.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.694+0000 7f3f5d7fa640 1 -- 172.21.15.38:0/3573508616 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5803ad60 con 0x7f3f6815a370 2023-12-22T08:52:46.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.694+0000 7f3f5d7fa640 1 -- 172.21.15.38:0/3573508616 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f580443f0 con 0x7f3f6815a370 2023-12-22T08:52:46.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.694+0000 7f3f5d7fa640 1 -- 172.21.15.38:0/3573508616 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580447a0 con 0x7f3f6815a370 2023-12-22T08:52:46.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.694+0000 7f3f6ed16640 1 -- 172.21.15.38:0/3573508616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f680709c0 con 0x7f3f6815a370 2023-12-22T08:52:46.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.695+0000 7f3f6ed16640 1 -- 172.21.15.38:0/3573508616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f68070f80 con 0x7f3f6815a370 2023-12-22T08:52:46.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.696+0000 7f3f6ed16640 1 -- 172.21.15.38:0/3573508616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f68061910 con 0x7f3f6815a370 2023-12-22T08:52:46.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.696+0000 7f3f5d7fa640 1 -- 172.21.15.38:0/3573508616 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f58044900 con 0x7f3f6815a370 2023-12-22T08:52:46.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.697+0000 7f3f5d7fa640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3f5406a430 0x7f3f5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:46.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.697+0000 7f3f5d7fa640 1 -- 172.21.15.38:0/3573508616 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3f580aae20 con 0x7f3f6815a370 2023-12-22T08:52:46.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.698+0000 7f3f6cab2640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3f5406a430 0x7f3f5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:46.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.699+0000 7f3f6cab2640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3f5406a430 0x7f3f5406c8f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3f64004ea0 tx=0x7f3f64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:46.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.705+0000 7f3f5d7fa640 1 -- 172.21.15.38:0/3573508616 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3f58076450 con 0x7f3f6815a370 2023-12-22T08:52:46.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.907+0000 7f3f6ed16640 1 -- 172.21.15.38:0/3573508616 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f68069ec0 con 0x7f3f6815a370 2023-12-22T08:52:46.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.908+0000 7f3f5d7fa640 1 -- 172.21.15.38:0/3573508616 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v178) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f58035020 con 0x7f3f6815a370 2023-12-22T08:52:46.909 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:52:46.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.911+0000 7f3f6ed16640 1 -- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3f5406a430 msgr2=0x7f3f5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:46.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.911+0000 7f3f6ed16640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3f5406a430 0x7f3f5406c8f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3f64004ea0 tx=0x7f3f64009040 comp rx=0 tx=0).stop 2023-12-22T08:52:46.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.911+0000 7f3f6ed16640 1 -- 172.21.15.38:0/3573508616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f6815a370 msgr2=0x7f3f68141b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:46.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.911+0000 7f3f6ed16640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f6815a370 0x7f3f68141b80 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f3f5802b8f0 tx=0x7f3f580046c0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.911+0000 7f3f6ed16640 1 -- 172.21.15.38:0/3573508616 shutdown_connections 2023-12-22T08:52:46.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.911+0000 7f3f6ed16640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f6815b3c0 0x7f3f6815bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.911+0000 7f3f6ed16640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3f5406a430 0x7f3f5406c8f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.911+0000 7f3f6ed16640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f6815a370 0x7f3f68141b80 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.911+0000 7f3f6ed16640 1 --2- 172.21.15.38:0/3573508616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f68071f90 0x7f3f68145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:46.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.911+0000 7f3f6ed16640 1 -- 172.21.15.38:0/3573508616 >> 172.21.15.38:0/3573508616 conn(0x7f3f680b20c0 msgr2=0x7f3f6814e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:46.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.911+0000 7f3f6ed16640 1 -- 172.21.15.38:0/3573508616 shutdown_connections 2023-12-22T08:52:46.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:46.911+0000 7f3f6ed16640 1 -- 172.21.15.38:0/3573508616 wait complete. 2023-12-22T08:52:46.931 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:52:47.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.156+0000 7fd53ab77640 1 Processor -- start 2023-12-22T08:52:47.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.156+0000 7fd53ab77640 1 -- start start 2023-12-22T08:52:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.158+0000 7fd53ab77640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd534071d80 0x7fd5340a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.158+0000 7fd53ab77640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd5340a35a0 0x7fd534161040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.158+0000 7fd53ab77640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53406c2a0 con 0x7fd534161580 2023-12-22T08:52:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.158+0000 7fd53ab77640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5340a44a0 con 0x7fd534071d80 2023-12-22T08:52:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.158+0000 7fd53ab77640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5340a3a00 con 0x7fd5340a35a0 2023-12-22T08:52:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.158+0000 7fd539b75640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd534071d80 0x7fd5340a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.158+0000 7fd539b75640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd534071d80 0x7fd5340a3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54162/0 (socket says 172.21.15.38:54162) 2023-12-22T08:52:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.158+0000 7fd539b75640 1 -- 172.21.15.38:0/3495114270 learned_addr learned my addr 172.21.15.38:0/3495114270 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:47.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.159+0000 7fd539b75640 1 -- 172.21.15.38:0/3495114270 >> v2:172.21.15.89:3300/0 conn(0x7fd5340a35a0 msgr2=0x7fd534161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:47.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.159+0000 7fd539b75640 1 --2- 172.21.15.38:0/3495114270 >> v2:172.21.15.89:3300/0 conn(0x7fd5340a35a0 0x7fd534161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.159+0000 7fd539b75640 1 -- 172.21.15.38:0/3495114270 >> v1:172.21.15.89:6789/0 conn(0x7fd534161580 legacy=0x7fd53415da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:47.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.159+0000 7fd539b75640 1 -- 172.21.15.38:0/3495114270 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534072160 con 0x7fd534071d80 2023-12-22T08:52:47.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.160+0000 7fd539b75640 1 --2- 172.21.15.38:0/3495114270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd534071d80 0x7fd5340a3060 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fd5340aeb50 tx=0x7fd53002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a243b5340d4eb0aa server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:47.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.160+0000 7fd538b73640 1 -- 172.21.15.38:0/3495114270 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530031870 con 0x7fd534071d80 2023-12-22T08:52:47.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.160+0000 7fd538b73640 1 -- 172.21.15.38:0/3495114270 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5300319d0 con 0x7fd534071d80 2023-12-22T08:52:47.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.160+0000 7fd538b73640 1 -- 172.21.15.38:0/3495114270 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530031d60 con 0x7fd534071d80 2023-12-22T08:52:47.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.161+0000 7fd53ab77640 1 -- 172.21.15.38:0/3495114270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd534071d80 msgr2=0x7fd5340a3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:47.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.161+0000 7fd53ab77640 1 --2- 172.21.15.38:0/3495114270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd534071d80 0x7fd5340a3060 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fd5340aeb50 tx=0x7fd53002b910 comp rx=0 tx=0).stop 2023-12-22T08:52:47.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.161+0000 7fd53ab77640 1 -- 172.21.15.38:0/3495114270 shutdown_connections 2023-12-22T08:52:47.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.161+0000 7fd53ab77640 1 --2- 172.21.15.38:0/3495114270 >> v2:172.21.15.89:3300/0 conn(0x7fd5340a35a0 0x7fd534161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.161+0000 7fd53ab77640 1 --2- 172.21.15.38:0/3495114270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd534071d80 0x7fd5340a3060 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.161+0000 7fd53ab77640 1 -- 172.21.15.38:0/3495114270 >> 172.21.15.38:0/3495114270 conn(0x7fd5340cf000 msgr2=0x7fd5340cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:47.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.161+0000 7fd53ab77640 1 -- 172.21.15.38:0/3495114270 shutdown_connections 2023-12-22T08:52:47.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.161+0000 7fd53ab77640 1 -- 172.21.15.38:0/3495114270 wait complete. 2023-12-22T08:52:47.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.163+0000 7fd53ab77640 1 Processor -- start 2023-12-22T08:52:47.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.163+0000 7fd53ab77640 1 -- start start 2023-12-22T08:52:47.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.164+0000 7fd53ab77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd534071d80 0x7fd534153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.164+0000 7fd53ab77640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5340a35a0 0x7fd5340cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.164+0000 7fd53ab77640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd534161580 0x7fd5340cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.164+0000 7fd53ab77640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5341537d0 con 0x7fd5340a35a0 2023-12-22T08:52:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.164+0000 7fd53ab77640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340cc9d0 con 0x7fd534071d80 2023-12-22T08:52:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.164+0000 7fd53ab77640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340cccb0 con 0x7fd534161580 2023-12-22T08:52:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.164+0000 7fd539374640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5340a35a0 0x7fd5340cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.164+0000 7fd539374640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5340a35a0 0x7fd5340cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54168/0 (socket says 172.21.15.38:54168) 2023-12-22T08:52:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.164+0000 7fd539374640 1 -- 172.21.15.38:0/2248341890 learned_addr learned my addr 172.21.15.38:0/2248341890 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.165+0000 7fd539b75640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd534071d80 0x7fd534153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.165+0000 7fd53a376640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd534161580 0x7fd5340cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.165+0000 7fd539374640 1 -- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd534161580 msgr2=0x7fd5340cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.165+0000 7fd539374640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd534161580 0x7fd5340cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.165+0000 7fd539374640 1 -- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd534071d80 msgr2=0x7fd534153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:47.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.165+0000 7fd539374640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd534071d80 0x7fd534153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.165+0000 7fd539374640 1 -- 172.21.15.38:0/2248341890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5300094d0 con 0x7fd5340a35a0 2023-12-22T08:52:47.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.165+0000 7fd539374640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5340a35a0 0x7fd5340cc050 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fd52400b4a0 tx=0x7fd52400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:47.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.166+0000 7fd52a7fc640 1 -- 172.21.15.38:0/2248341890 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524010610 con 0x7fd5340a35a0 2023-12-22T08:52:47.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.166+0000 7fd52a7fc640 1 -- 172.21.15.38:0/2248341890 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd524010770 con 0x7fd5340a35a0 2023-12-22T08:52:47.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.166+0000 7fd52a7fc640 1 -- 172.21.15.38:0/2248341890 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524010b20 con 0x7fd5340a35a0 2023-12-22T08:52:47.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.166+0000 7fd53ab77640 1 -- 172.21.15.38:0/2248341890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5340ccf90 con 0x7fd5340a35a0 2023-12-22T08:52:47.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.166+0000 7fd53ab77640 1 -- 172.21.15.38:0/2248341890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5340cd550 con 0x7fd5340a35a0 2023-12-22T08:52:47.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.167+0000 7fd53ab77640 1 -- 172.21.15.38:0/2248341890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5340cd770 con 0x7fd5340a35a0 2023-12-22T08:52:47.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.168+0000 7fd52a7fc640 1 -- 172.21.15.38:0/2248341890 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd524010c80 con 0x7fd5340a35a0 2023-12-22T08:52:47.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.169+0000 7fd52a7fc640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd51806a430 0x7fd51806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:47.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.169+0000 7fd52a7fc640 1 -- 172.21.15.38:0/2248341890 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd5240885e0 con 0x7fd5340a35a0 2023-12-22T08:52:47.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.169+0000 7fd539b75640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd51806a430 0x7fd51806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:47.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.170+0000 7fd539b75640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd51806a430 0x7fd51806c8f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd530036000 tx=0x7fd53003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:47.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.173+0000 7fd52a7fc640 1 -- 172.21.15.38:0/2248341890 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd524053b90 con 0x7fd5340a35a0 2023-12-22T08:52:47.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.358+0000 7fd53ab77640 1 -- 172.21.15.38:0/2248341890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd534061910 con 0x7fd5340a35a0 2023-12-22T08:52:47.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.359+0000 7fd52a7fc640 1 -- 172.21.15.38:0/2248341890 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v178) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd5240571b0 con 0x7fd5340a35a0 2023-12-22T08:52:47.359 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:52:47.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.361+0000 7fd53ab77640 1 -- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd51806a430 msgr2=0x7fd51806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:47.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.361+0000 7fd53ab77640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd51806a430 0x7fd51806c8f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd530036000 tx=0x7fd53003c040 comp rx=0 tx=0).stop 2023-12-22T08:52:47.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.361+0000 7fd53ab77640 1 -- 172.21.15.38:0/2248341890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5340a35a0 msgr2=0x7fd5340cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:47.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.361+0000 7fd53ab77640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5340a35a0 0x7fd5340cc050 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fd52400b4a0 tx=0x7fd52400b960 comp rx=0 tx=0).stop 2023-12-22T08:52:47.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.361+0000 7fd53ab77640 1 -- 172.21.15.38:0/2248341890 shutdown_connections 2023-12-22T08:52:47.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.361+0000 7fd53ab77640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd534161580 0x7fd5340cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.361+0000 7fd53ab77640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd51806a430 0x7fd51806c8f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.361+0000 7fd53ab77640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5340a35a0 0x7fd5340cc050 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.361+0000 7fd53ab77640 1 --2- 172.21.15.38:0/2248341890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd534071d80 0x7fd534153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.361+0000 7fd53ab77640 1 -- 172.21.15.38:0/2248341890 >> 172.21.15.38:0/2248341890 conn(0x7fd5340cf000 msgr2=0x7fd5340cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:47.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.361+0000 7fd53ab77640 1 -- 172.21.15.38:0/2248341890 shutdown_connections 2023-12-22T08:52:47.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.361+0000 7fd53ab77640 1 -- 172.21.15.38:0/2248341890 wait complete. 2023-12-22T08:52:47.379 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:52:47.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.591+0000 7f5d63900640 1 Processor -- start 2023-12-22T08:52:47.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.591+0000 7f5d63900640 1 -- start start 2023-12-22T08:52:47.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.593+0000 7f5d63900640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5d5c15e870 0x7f5d5c0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:47.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.593+0000 7f5d63900640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5d5c15ec50 0x7f5d5c070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:47.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.593+0000 7f5d63900640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5c0ce4b0 con 0x7f5d5c071310 2023-12-22T08:52:47.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.593+0000 7f5d63900640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5c15fea0 con 0x7f5d5c15ec50 2023-12-22T08:52:47.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.593+0000 7f5d63900640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5c0cdb80 con 0x7f5d5c15e870 2023-12-22T08:52:47.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.593+0000 7f5d60e9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5d5c15ec50 0x7f5d5c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:47.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.593+0000 7f5d60e9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5d5c15ec50 0x7f5d5c070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54174/0 (socket says 172.21.15.38:54174) 2023-12-22T08:52:47.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.593+0000 7f5d60e9b640 1 -- 172.21.15.38:0/3756698095 learned_addr learned my addr 172.21.15.38:0/3756698095 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:47.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.594+0000 7f5d6169c640 1 --2- 172.21.15.38:0/3756698095 >> v2:172.21.15.89:3300/0 conn(0x7f5d5c15e870 0x7f5d5c0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:47.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.594+0000 7f5d60e9b640 1 -- 172.21.15.38:0/3756698095 >> v2:172.21.15.89:3300/0 conn(0x7f5d5c15e870 msgr2=0x7f5d5c0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:47.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.594+0000 7f5d60e9b640 1 --2- 172.21.15.38:0/3756698095 >> v2:172.21.15.89:3300/0 conn(0x7f5d5c15e870 0x7f5d5c0ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.594+0000 7f5d60e9b640 1 -- 172.21.15.38:0/3756698095 >> v1:172.21.15.89:6789/0 conn(0x7f5d5c071310 legacy=0x7f5d5c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:47.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.594+0000 7f5d60e9b640 1 -- 172.21.15.38:0/3756698095 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c0cde60 con 0x7f5d5c15ec50 2023-12-22T08:52:47.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.595+0000 7f5d60e9b640 1 --2- 172.21.15.38:0/3756698095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d5c15ec50 0x7f5d5c070770 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c06a7f0 tx=0x7f5d4c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892555ee3fc5f904 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:47.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.595+0000 7f5d53fff640 1 -- 172.21.15.38:0/3756698095 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0317e0 con 0x7f5d5c15ec50 2023-12-22T08:52:47.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.596+0000 7f5d53fff640 1 -- 172.21.15.38:0/3756698095 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c031940 con 0x7f5d5c15ec50 2023-12-22T08:52:47.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.596+0000 7f5d53fff640 1 -- 172.21.15.38:0/3756698095 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c031cd0 con 0x7f5d5c15ec50 2023-12-22T08:52:47.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.596+0000 7f5d63900640 1 -- 172.21.15.38:0/3756698095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d5c15ec50 msgr2=0x7f5d5c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:47.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.596+0000 7f5d63900640 1 --2- 172.21.15.38:0/3756698095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d5c15ec50 0x7f5d5c070770 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c06a7f0 tx=0x7f5d4c02b880 comp rx=0 tx=0).stop 2023-12-22T08:52:47.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.596+0000 7f5d63900640 1 -- 172.21.15.38:0/3756698095 shutdown_connections 2023-12-22T08:52:47.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.596+0000 7f5d63900640 1 --2- 172.21.15.38:0/3756698095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d5c15ec50 0x7f5d5c070770 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.596+0000 7f5d63900640 1 --2- 172.21.15.38:0/3756698095 >> v2:172.21.15.89:3300/0 conn(0x7f5d5c15e870 0x7f5d5c0ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.596+0000 7f5d63900640 1 -- 172.21.15.38:0/3756698095 >> 172.21.15.38:0/3756698095 conn(0x7f5d5c0b20c0 msgr2=0x7f5d5c0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:47.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.597+0000 7f5d63900640 1 -- 172.21.15.38:0/3756698095 shutdown_connections 2023-12-22T08:52:47.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.597+0000 7f5d63900640 1 -- 172.21.15.38:0/3756698095 wait complete. 2023-12-22T08:52:47.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.598+0000 7f5d63900640 1 Processor -- start 2023-12-22T08:52:47.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.598+0000 7f5d63900640 1 -- start start 2023-12-22T08:52:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.599+0000 7f5d63900640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d5c071310 0x7f5d5c0c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.599+0000 7f5d63900640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d5c15e870 0x7f5d5c06cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.599+0000 7f5d63900640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d5c15ec50 0x7f5d5c06d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.599+0000 7f5d63900640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c06d5f0 con 0x7f5d5c071310 2023-12-22T08:52:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.599+0000 7f5d63900640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c06d8d0 con 0x7f5d5c15e870 2023-12-22T08:52:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.599+0000 7f5d63900640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c06dbb0 con 0x7f5d5c15ec50 2023-12-22T08:52:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.600+0000 7f5d6169c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d5c071310 0x7f5d5c0c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:47.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.600+0000 7f5d6169c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d5c071310 0x7f5d5c0c4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54180/0 (socket says 172.21.15.38:54180) 2023-12-22T08:52:47.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.600+0000 7f5d6169c640 1 -- 172.21.15.38:0/1945382505 learned_addr learned my addr 172.21.15.38:0/1945382505 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:47.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.600+0000 7f5d61e9d640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d5c15ec50 0x7f5d5c06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:47.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.600+0000 7f5d6169c640 1 -- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d5c15ec50 msgr2=0x7f5d5c06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:47.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.600+0000 7f5d60e9b640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d5c15e870 0x7f5d5c06cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:47.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.600+0000 7f5d6169c640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d5c15ec50 0x7f5d5c06d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.600+0000 7f5d6169c640 1 -- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d5c15e870 msgr2=0x7f5d5c06cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:47.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.600+0000 7f5d6169c640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d5c15e870 0x7f5d5c06cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.600+0000 7f5d6169c640 1 -- 172.21.15.38:0/1945382505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c0094d0 con 0x7f5d5c071310 2023-12-22T08:52:47.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.600+0000 7f5d61e9d640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d5c15ec50 0x7f5d5c06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:47.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.600+0000 7f5d60e9b640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d5c15e870 0x7f5d5c06cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:47.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.601+0000 7f5d6169c640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d5c071310 0x7f5d5c0c4e80 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800d800 tx=0x7f5d5800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:47.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.601+0000 7f5d51ffb640 1 -- 172.21.15.38:0/1945382505 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5800b6c0 con 0x7f5d5c071310 2023-12-22T08:52:47.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.601+0000 7f5d51ffb640 1 -- 172.21.15.38:0/1945382505 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5800b820 con 0x7f5d5c071310 2023-12-22T08:52:47.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.601+0000 7f5d63900640 1 -- 172.21.15.38:0/1945382505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5c1569d0 con 0x7f5d5c071310 2023-12-22T08:52:47.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.601+0000 7f5d51ffb640 1 -- 172.21.15.38:0/1945382505 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5800bbb0 con 0x7f5d5c071310 2023-12-22T08:52:47.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.601+0000 7f5d63900640 1 -- 172.21.15.38:0/1945382505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5c14de50 con 0x7f5d5c071310 2023-12-22T08:52:47.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.602+0000 7f5d63900640 1 -- 172.21.15.38:0/1945382505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5c061910 con 0x7f5d5c071310 2023-12-22T08:52:47.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.603+0000 7f5d51ffb640 1 -- 172.21.15.38:0/1945382505 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5d5800bd10 con 0x7f5d5c071310 2023-12-22T08:52:47.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.604+0000 7f5d51ffb640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5d4006a480 0x7f5d4006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:47.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.604+0000 7f5d51ffb640 1 -- 172.21.15.38:0/1945382505 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5d58088ec0 con 0x7f5d5c071310 2023-12-22T08:52:47.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.605+0000 7f5d60e9b640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5d4006a480 0x7f5d4006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:47.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.606+0000 7f5d60e9b640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5d4006a480 0x7f5d4006c940 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c036000 tx=0x7f5d4c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:47.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.608+0000 7f5d51ffb640 1 -- 172.21.15.38:0/1945382505 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5d58054450 con 0x7f5d5c071310 2023-12-22T08:52:47.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.805+0000 7f5d63900640 1 -- 172.21.15.38:0/1945382505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d5c0ce110 con 0x7f5d5c071310 2023-12-22T08:52:47.807 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:52:47.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.806+0000 7f5d51ffb640 1 -- 172.21.15.38:0/1945382505 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v178) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d58057a70 con 0x7f5d5c071310 2023-12-22T08:52:47.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.809+0000 7f5d63900640 1 -- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5d4006a480 msgr2=0x7f5d4006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:47.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.809+0000 7f5d63900640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5d4006a480 0x7f5d4006c940 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c036000 tx=0x7f5d4c03d040 comp rx=0 tx=0).stop 2023-12-22T08:52:47.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.809+0000 7f5d63900640 1 -- 172.21.15.38:0/1945382505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d5c071310 msgr2=0x7f5d5c0c4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:47.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.809+0000 7f5d63900640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d5c071310 0x7f5d5c0c4e80 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800d800 tx=0x7f5d5800dcc0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.809+0000 7f5d63900640 1 -- 172.21.15.38:0/1945382505 shutdown_connections 2023-12-22T08:52:47.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.809+0000 7f5d63900640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d5c15ec50 0x7f5d5c06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.809+0000 7f5d63900640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d5c15e870 0x7f5d5c06cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.809+0000 7f5d63900640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5d4006a480 0x7f5d4006c940 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.809+0000 7f5d63900640 1 --2- 172.21.15.38:0/1945382505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d5c071310 0x7f5d5c0c4e80 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:47.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.809+0000 7f5d63900640 1 -- 172.21.15.38:0/1945382505 >> 172.21.15.38:0/1945382505 conn(0x7f5d5c0b20c0 msgr2=0x7f5d5c0afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:47.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.809+0000 7f5d63900640 1 -- 172.21.15.38:0/1945382505 shutdown_connections 2023-12-22T08:52:47.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:47.810+0000 7f5d63900640 1 -- 172.21.15.38:0/1945382505 wait complete. 2023-12-22T08:52:47.828 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:52:48.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.058+0000 7f5a54ad5640 1 Processor -- start 2023-12-22T08:52:48.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.059+0000 7f5a54ad5640 1 -- start start 2023-12-22T08:52:48.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.060+0000 7f5a54ad5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a5015e740 0x7f5a5015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:48.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.060+0000 7f5a54ad5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5a5006ca50 0x7f5a500b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:48.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.060+0000 7f5a54ad5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a500b4210 con 0x7f5a500b3dc0 2023-12-22T08:52:48.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.060+0000 7f5a54ad5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5006e650 con 0x7f5a5006ca50 2023-12-22T08:52:48.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.060+0000 7f5a54ad5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5015eb20 con 0x7f5a5015e740 2023-12-22T08:52:48.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.061+0000 7f5a4dd9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5a5006ca50 0x7f5a500b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:48.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.061+0000 7f5a4dd9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5a5006ca50 0x7f5a500b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:43454/0 (socket says 172.21.15.38:43454) 2023-12-22T08:52:48.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.061+0000 7f5a4dd9b640 1 -- 172.21.15.38:0/471266321 learned_addr learned my addr 172.21.15.38:0/471266321 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:48.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.061+0000 7f5a4e59c640 1 --2- 172.21.15.38:0/471266321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a5015e740 0x7f5a5015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.062+0000 7f5a4dd9b640 1 -- 172.21.15.38:0/471266321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a5015e740 msgr2=0x7f5a5015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.062+0000 7f5a4dd9b640 1 --2- 172.21.15.38:0/471266321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a5015e740 0x7f5a5015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.062+0000 7f5a4dd9b640 1 -- 172.21.15.38:0/471266321 >> v1:172.21.15.89:6789/0 conn(0x7f5a500b3dc0 legacy=0x7f5a50161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:48.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.062+0000 7f5a4dd9b640 1 -- 172.21.15.38:0/471266321 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a50070770 con 0x7f5a5006ca50 2023-12-22T08:52:48.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.063+0000 7f5a4dd9b640 1 --2- 172.21.15.38:0/471266321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a5006ca50 0x7f5a500b3880 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009870 tx=0x7f5a4402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc08195f7f56022b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:48.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.064+0000 7f5a4d59a640 1 -- 172.21.15.38:0/471266321 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a440317c0 con 0x7f5a5006ca50 2023-12-22T08:52:48.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.064+0000 7f5a4d59a640 1 -- 172.21.15.38:0/471266321 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a44031920 con 0x7f5a5006ca50 2023-12-22T08:52:48.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.064+0000 7f5a4d59a640 1 -- 172.21.15.38:0/471266321 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a44031cb0 con 0x7f5a5006ca50 2023-12-22T08:52:48.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.065+0000 7f5a54ad5640 1 -- 172.21.15.38:0/471266321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a5006ca50 msgr2=0x7f5a500b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:48.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.065+0000 7f5a54ad5640 1 --2- 172.21.15.38:0/471266321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a5006ca50 0x7f5a500b3880 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009870 tx=0x7f5a4402b860 comp rx=0 tx=0).stop 2023-12-22T08:52:48.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.065+0000 7f5a54ad5640 1 -- 172.21.15.38:0/471266321 shutdown_connections 2023-12-22T08:52:48.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.065+0000 7f5a54ad5640 1 --2- 172.21.15.38:0/471266321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a5006ca50 0x7f5a500b3880 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.065+0000 7f5a54ad5640 1 --2- 172.21.15.38:0/471266321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a5015e740 0x7f5a5015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.065+0000 7f5a54ad5640 1 -- 172.21.15.38:0/471266321 >> 172.21.15.38:0/471266321 conn(0x7f5a500cfea0 msgr2=0x7f5a500d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:48.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.065+0000 7f5a54ad5640 1 -- 172.21.15.38:0/471266321 shutdown_connections 2023-12-22T08:52:48.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.065+0000 7f5a54ad5640 1 -- 172.21.15.38:0/471266321 wait complete. 2023-12-22T08:52:48.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.067+0000 7f5a54ad5640 1 Processor -- start 2023-12-22T08:52:48.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.067+0000 7f5a54ad5640 1 -- start start 2023-12-22T08:52:48.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.068+0000 7f5a54ad5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a5006ca50 0x7f5a5013bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:48.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.068+0000 7f5a54ad5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a500b3dc0 0x7f5a501397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:48.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.068+0000 7f5a54ad5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a5015e740 0x7f5a500b8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:48.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.068+0000 7f5a54ad5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a501516b0 con 0x7f5a5006ca50 2023-12-22T08:52:48.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.068+0000 7f5a54ad5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a50151990 con 0x7f5a500b3dc0 2023-12-22T08:52:48.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.068+0000 7f5a54ad5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a50151c70 con 0x7f5a5015e740 2023-12-22T08:52:48.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.069+0000 7f5a4e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a5006ca50 0x7f5a5013bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:48.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.069+0000 7f5a4e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a5006ca50 0x7f5a5013bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54184/0 (socket says 172.21.15.38:54184) 2023-12-22T08:52:48.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.069+0000 7f5a4e59c640 1 -- 172.21.15.38:0/1844757339 learned_addr learned my addr 172.21.15.38:0/1844757339 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:48.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.069+0000 7f5a4ed9d640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a5015e740 0x7f5a500b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:48.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.069+0000 7f5a4dd9b640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a500b3dc0 0x7f5a501397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:48.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.069+0000 7f5a4e59c640 1 -- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a5015e740 msgr2=0x7f5a500b8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:48.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.069+0000 7f5a4e59c640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a5015e740 0x7f5a500b8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.069+0000 7f5a4e59c640 1 -- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a500b3dc0 msgr2=0x7f5a501397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:48.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.069+0000 7f5a4e59c640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a500b3dc0 0x7f5a501397e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.070+0000 7f5a4e59c640 1 -- 172.21.15.38:0/1844757339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a440094d0 con 0x7f5a5006ca50 2023-12-22T08:52:48.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.070+0000 7f5a4e59c640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a5006ca50 0x7f5a5013bae0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000e870 tx=0x7f5a4000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:48.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.070+0000 7f5a3effd640 1 -- 172.21.15.38:0/1844757339 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400094f0 con 0x7f5a5006ca50 2023-12-22T08:52:48.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.070+0000 7f5a3effd640 1 -- 172.21.15.38:0/1844757339 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4000c940 con 0x7f5a5006ca50 2023-12-22T08:52:48.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.070+0000 7f5a54ad5640 1 -- 172.21.15.38:0/1844757339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a50151f50 con 0x7f5a5006ca50 2023-12-22T08:52:48.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.070+0000 7f5a3effd640 1 -- 172.21.15.38:0/1844757339 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000ccf0 con 0x7f5a5006ca50 2023-12-22T08:52:48.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.070+0000 7f5a54ad5640 1 -- 172.21.15.38:0/1844757339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5013c020 con 0x7f5a5006ca50 2023-12-22T08:52:48.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.071+0000 7f5a54ad5640 1 -- 172.21.15.38:0/1844757339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5013c210 con 0x7f5a5006ca50 2023-12-22T08:52:48.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.072+0000 7f5a3effd640 1 -- 172.21.15.38:0/1844757339 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5a40013470 con 0x7f5a5006ca50 2023-12-22T08:52:48.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.073+0000 7f5a3effd640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5a3006a460 0x7f5a3006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:48.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.074+0000 7f5a3effd640 1 -- 172.21.15.38:0/1844757339 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5a400888c0 con 0x7f5a5006ca50 2023-12-22T08:52:48.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.074+0000 7f5a4dd9b640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5a3006a460 0x7f5a3006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:48.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.075+0000 7f5a4dd9b640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5a3006a460 0x7f5a3006c920 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5a44036000 tx=0x7f5a4403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:48.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.078+0000 7f5a3effd640 1 -- 172.21.15.38:0/1844757339 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5a40053fb0 con 0x7f5a5006ca50 2023-12-22T08:52:48.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.309+0000 7f5a54ad5640 1 -- 172.21.15.38:0/1844757339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a50061910 con 0x7f5a5006ca50 2023-12-22T08:52:48.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.311+0000 7f5a3effd640 1 -- 172.21.15.38:0/1844757339 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4649 (secure 0 0 0) 0x7f5a40017090 con 0x7f5a5006ca50 2023-12-22T08:52:48.311 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:52:48.311 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1443382612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1443382612},{"type":"v1","addr":"172.21.15.38:6835","nonce":1443382612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1913310975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1913310975},{"type":"v1","addr":"172.21.15.89:6836","nonce":1913310975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/218839128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":218839128},{"type":"v1","addr":"172.21.15.89:6837","nonce":218839128}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:51:25.111775+0000","modified":"2023-12-22T08:51:28.645925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8553":{"gid":8553,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6834/1387101372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1387101372},{"type":"v1","addr":"172.21.15.38:6834","nonce":1387101372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-22T08:52:48.312 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 78 2023-12-22T08:52:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.313+0000 7f5a54ad5640 1 -- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5a3006a460 msgr2=0x7f5a3006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.314+0000 7f5a54ad5640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5a3006a460 0x7f5a3006c920 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5a44036000 tx=0x7f5a4403d040 comp rx=0 tx=0).stop 2023-12-22T08:52:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.314+0000 7f5a54ad5640 1 -- 172.21.15.38:0/1844757339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a5006ca50 msgr2=0x7f5a5013bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.314+0000 7f5a54ad5640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a5006ca50 0x7f5a5013bae0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000e870 tx=0x7f5a4000ed30 comp rx=0 tx=0).stop 2023-12-22T08:52:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.314+0000 7f5a54ad5640 1 -- 172.21.15.38:0/1844757339 shutdown_connections 2023-12-22T08:52:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.314+0000 7f5a54ad5640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a5015e740 0x7f5a500b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.314+0000 7f5a54ad5640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a500b3dc0 0x7f5a501397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.314+0000 7f5a54ad5640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5a3006a460 0x7f5a3006c920 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.314+0000 7f5a54ad5640 1 --2- 172.21.15.38:0/1844757339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a5006ca50 0x7f5a5013bae0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.314+0000 7f5a54ad5640 1 -- 172.21.15.38:0/1844757339 >> 172.21.15.38:0/1844757339 conn(0x7f5a500cfea0 msgr2=0x7f5a500659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:48.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.314+0000 7f5a54ad5640 1 -- 172.21.15.38:0/1844757339 shutdown_connections 2023-12-22T08:52:48.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.314+0000 7f5a54ad5640 1 -- 172.21.15.38:0/1844757339 wait complete. 2023-12-22T08:52:48.335 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:52:48.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.565+0000 7ff0629ab640 1 Processor -- start 2023-12-22T08:52:48.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.566+0000 7ff0629ab640 1 -- start start 2023-12-22T08:52:48.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.567+0000 7ff0629ab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c15e740 0x7ff05c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:48.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.567+0000 7ff0629ab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff05c06ca50 0x7ff05c0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:48.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.567+0000 7ff0629ab640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c0b4210 con 0x7ff05c0b3dc0 2023-12-22T08:52:48.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.567+0000 7ff0629ab640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c06e650 con 0x7ff05c06ca50 2023-12-22T08:52:48.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.567+0000 7ff0629ab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c15eb20 con 0x7ff05c15e740 2023-12-22T08:52:48.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.568+0000 7ff060f48640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff05c0b3dc0 0x7ff05c161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43436/0 (socket says 172.21.15.38:43436) 2023-12-22T08:52:48.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.568+0000 7ff060f48640 1 -- 172.21.15.38:0/947106697 learned_addr learned my addr 172.21.15.38:0/947106697 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:48.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.568+0000 7ff05b7fe640 1 --2- 172.21.15.38:0/947106697 >> v2:172.21.15.89:3300/0 conn(0x7ff05c06ca50 0x7ff05c0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:48.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.568+0000 7ff05bfff640 1 --2- 172.21.15.38:0/947106697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c15e740 0x7ff05c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:48.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.568+0000 7ff05affd640 1 -- 172.21.15.38:0/947106697 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908733047 0 0) 0x7ff054001110 con 0x7ff05c0b3dc0 2023-12-22T08:52:48.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.568+0000 7ff05affd640 1 -- 172.21.15.38:0/947106697 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff048003520 con 0x7ff05c0b3dc0 2023-12-22T08:52:48.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.569+0000 7ff05bfff640 1 -- 172.21.15.38:0/947106697 >> v2:172.21.15.89:3300/0 conn(0x7ff05c06ca50 msgr2=0x7ff05c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:48.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.569+0000 7ff05bfff640 1 --2- 172.21.15.38:0/947106697 >> v2:172.21.15.89:3300/0 conn(0x7ff05c06ca50 0x7ff05c0b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.569+0000 7ff05bfff640 1 -- 172.21.15.38:0/947106697 >> v1:172.21.15.38:6789/0 conn(0x7ff05c0b3dc0 legacy=0x7ff05c161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:48.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.569+0000 7ff05bfff640 1 -- 172.21.15.38:0/947106697 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c070770 con 0x7ff05c15e740 2023-12-22T08:52:48.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.570+0000 7ff05bfff640 1 --2- 172.21.15.38:0/947106697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c15e740 0x7ff05c15db30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009d90 tx=0x7ff04c02bd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ce79f55e17e76c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:48.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.570+0000 7ff05affd640 1 -- 172.21.15.38:0/947106697 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c02cb40 con 0x7ff05c15e740 2023-12-22T08:52:48.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.571+0000 7ff05affd640 1 -- 172.21.15.38:0/947106697 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c02cca0 con 0x7ff05c15e740 2023-12-22T08:52:48.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.571+0000 7ff05affd640 1 -- 172.21.15.38:0/947106697 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c034640 con 0x7ff05c15e740 2023-12-22T08:52:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.571+0000 7ff0629ab640 1 -- 172.21.15.38:0/947106697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c15e740 msgr2=0x7ff05c15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.571+0000 7ff0629ab640 1 --2- 172.21.15.38:0/947106697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c15e740 0x7ff05c15db30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009d90 tx=0x7ff04c02bd90 comp rx=0 tx=0).stop 2023-12-22T08:52:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.571+0000 7ff0629ab640 1 -- 172.21.15.38:0/947106697 shutdown_connections 2023-12-22T08:52:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.571+0000 7ff0629ab640 1 --2- 172.21.15.38:0/947106697 >> v2:172.21.15.89:3300/0 conn(0x7ff05c06ca50 0x7ff05c0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.571+0000 7ff0629ab640 1 --2- 172.21.15.38:0/947106697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c15e740 0x7ff05c15db30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.571+0000 7ff0629ab640 1 -- 172.21.15.38:0/947106697 >> 172.21.15.38:0/947106697 conn(0x7ff05c0cfea0 msgr2=0x7ff05c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:48.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.572+0000 7ff0629ab640 1 -- 172.21.15.38:0/947106697 shutdown_connections 2023-12-22T08:52:48.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.572+0000 7ff0629ab640 1 -- 172.21.15.38:0/947106697 wait complete. 2023-12-22T08:52:48.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.573+0000 7ff0629ab640 1 Processor -- start 2023-12-22T08:52:48.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.573+0000 7ff0629ab640 1 -- start start 2023-12-22T08:52:48.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.574+0000 7ff0629ab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c06ca50 0x7ff05c0d2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:48.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.574+0000 7ff0629ab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c0b3dc0 0x7ff05c0b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:48.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.574+0000 7ff0629ab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff05c15e740 0x7ff05c0b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:48.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.574+0000 7ff0629ab640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0acc30 con 0x7ff05c0b3dc0 2023-12-22T08:52:48.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.574+0000 7ff0629ab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0b80a0 con 0x7ff05c15e740 2023-12-22T08:52:48.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.574+0000 7ff0629ab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0b7490 con 0x7ff05c06ca50 2023-12-22T08:52:48.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.575+0000 7ff05bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c06ca50 0x7ff05c0d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:48.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.575+0000 7ff05bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c06ca50 0x7ff05c0d2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:42422/0 (socket says 172.21.15.38:42422) 2023-12-22T08:52:48.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.575+0000 7ff05bfff640 1 -- 172.21.15.38:0/872150613 learned_addr learned my addr 172.21.15.38:0/872150613 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:48.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.575+0000 7ff05b7fe640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c0b3dc0 0x7ff05c0b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:48.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.575+0000 7ff060f48640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff05c15e740 0x7ff05c0b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:48.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.576+0000 7ff05bfff640 1 -- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff05c15e740 msgr2=0x7ff05c0b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:48.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.576+0000 7ff05bfff640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff05c15e740 0x7ff05c0b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.576+0000 7ff05bfff640 1 -- 172.21.15.38:0/872150613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c0b3dc0 msgr2=0x7ff05c0b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:48.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.576+0000 7ff05bfff640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c0b3dc0 0x7ff05c0b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.576+0000 7ff05bfff640 1 -- 172.21.15.38:0/872150613 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c009a70 con 0x7ff05c06ca50 2023-12-22T08:52:48.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.576+0000 7ff05b7fe640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c0b3dc0 0x7ff05c0b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:52:48.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.576+0000 7ff05bfff640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c06ca50 0x7ff05c0d2610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009eb0 tx=0x7ff04c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:48.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.577+0000 7ff058ff9640 1 -- 172.21.15.38:0/872150613 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c03e610 con 0x7ff05c06ca50 2023-12-22T08:52:48.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.577+0000 7ff058ff9640 1 -- 172.21.15.38:0/872150613 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c03e770 con 0x7ff05c06ca50 2023-12-22T08:52:48.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.577+0000 7ff0629ab640 1 -- 172.21.15.38:0/872150613 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c0b7770 con 0x7ff05c06ca50 2023-12-22T08:52:48.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.577+0000 7ff058ff9640 1 -- 172.21.15.38:0/872150613 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c03eb20 con 0x7ff05c06ca50 2023-12-22T08:52:48.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.577+0000 7ff0629ab640 1 -- 172.21.15.38:0/872150613 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c0b7d30 con 0x7ff05c06ca50 2023-12-22T08:52:48.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.578+0000 7ff0629ab640 1 -- 172.21.15.38:0/872150613 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c061910 con 0x7ff05c06ca50 2023-12-22T08:52:48.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.580+0000 7ff058ff9640 1 -- 172.21.15.38:0/872150613 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff04c03b050 con 0x7ff05c06ca50 2023-12-22T08:52:48.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.581+0000 7ff058ff9640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff03c06a480 0x7ff03c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:48.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.581+0000 7ff058ff9640 1 -- 172.21.15.38:0/872150613 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff04c0ab640 con 0x7ff05c06ca50 2023-12-22T08:52:48.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.582+0000 7ff05b7fe640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff03c06a480 0x7ff03c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:48.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.583+0000 7ff05b7fe640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff03c06a480 0x7ff03c06c940 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff05c1f5ff0 tx=0x7ff044009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:48.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.591+0000 7ff058ff9640 1 -- 172.21.15.38:0/872150613 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff04c076c80 con 0x7ff05c06ca50 2023-12-22T08:52:48.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.792+0000 7ff0629ab640 1 -- 172.21.15.38:0/872150613 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff05c15f640 con 0x7ff05c06ca50 2023-12-22T08:52:48.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.795+0000 7ff058ff9640 1 -- 172.21.15.38:0/872150613 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+16168 (secure 0 0 0) 0x7ff04c04e090 con 0x7ff05c06ca50 2023-12-22T08:52:48.796 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:52:48.797 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":178,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:52:46.392689+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:51:22.983948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-22T08:51:24.133013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3","mappings":[{"from":2,"to":6}]},{"pgid":"21.29","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:52:48.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.798+0000 7ff0629ab640 1 -- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff03c06a480 msgr2=0x7ff03c06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:48.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.798+0000 7ff0629ab640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff03c06a480 0x7ff03c06c940 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff05c1f5ff0 tx=0x7ff044009190 comp rx=0 tx=0).stop 2023-12-22T08:52:48.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.798+0000 7ff0629ab640 1 -- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c06ca50 msgr2=0x7ff05c0d2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:48.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.798+0000 7ff0629ab640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c06ca50 0x7ff05c0d2610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009eb0 tx=0x7ff04c004a40 comp rx=0 tx=0).stop 2023-12-22T08:52:48.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.798+0000 7ff0629ab640 1 -- 172.21.15.38:0/872150613 shutdown_connections 2023-12-22T08:52:48.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.798+0000 7ff0629ab640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff05c15e740 0x7ff05c0b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.799+0000 7ff0629ab640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff03c06a480 0x7ff03c06c940 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.799+0000 7ff0629ab640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff05c0b3dc0 0x7ff05c0b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.799+0000 7ff0629ab640 1 --2- 172.21.15.38:0/872150613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c06ca50 0x7ff05c0d2610 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:48.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.799+0000 7ff0629ab640 1 -- 172.21.15.38:0/872150613 >> 172.21.15.38:0/872150613 conn(0x7ff05c0cfea0 msgr2=0x7ff05c15fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:48.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.799+0000 7ff0629ab640 1 -- 172.21.15.38:0/872150613 shutdown_connections 2023-12-22T08:52:48.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:48.799+0000 7ff0629ab640 1 -- 172.21.15.38:0/872150613 wait complete. 2023-12-22T08:52:48.818 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:52:48.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:52:49.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.043+0000 7f8c0d1d0640 1 Processor -- start 2023-12-22T08:52:49.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.043+0000 7f8c0d1d0640 1 -- start start 2023-12-22T08:52:49.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.045+0000 7f8c0d1d0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c080b24b0 0x7f8c08070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.045+0000 7f8c0d1d0640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c081450f0 con 0x7f8c080b2050 2023-12-22T08:52:49.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.045+0000 7f8c0d1d0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c080cc840 con 0x7f8c08144d10 2023-12-22T08:52:49.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.045+0000 7f8c0d1d0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080ce010 con 0x7f8c080b24b0 2023-12-22T08:52:49.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.045+0000 7f8c0659c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8c080b2050 0x7f8c08070800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43448/0 (socket says 172.21.15.38:43448) 2023-12-22T08:52:49.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.045+0000 7f8c0659c640 1 -- 172.21.15.38:0/1999402825 learned_addr learned my addr 172.21.15.38:0/1999402825 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:49.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.046+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177984991 0 0) 0x7f8c081450f0 con 0x7f8c080b2050 2023-12-22T08:52:49.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.046+0000 7f8c0759e640 1 --2- 172.21.15.38:0/1999402825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c080b24b0 0x7f8c08070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.046+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf0003520 con 0x7f8c080b2050 2023-12-22T08:52:49.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.046+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3891657250 0 0) 0x7f8bf0003520 con 0x7f8c080b2050 2023-12-22T08:52:49.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.046+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c080b24b0 msgr2=0x7f8c08070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:49.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.046+0000 7f8c05d9b640 1 --2- 172.21.15.38:0/1999402825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c080b24b0 0x7f8c08070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.046+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 >> v1:172.21.15.89:6789/0 conn(0x7f8c08144d10 legacy=0x7f8c080cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:49.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.046+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c080ce2f0 con 0x7f8c080b2050 2023-12-22T08:52:49.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.046+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f8bfc001690 con 0x7f8c080b2050 2023-12-22T08:52:49.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.046+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 >> v1:172.21.15.38:6789/0 conn(0x7f8c080b2050 legacy=0x7f8c08070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.046+0000 7f8c05d9b640 1 --2- 172.21.15.38:0/1999402825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf00039a0 0x7f8bf0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.047+0000 7f8c05d9b640 1 --2- 172.21.15.38:0/1999402825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bf00047c0 0x7f8bf0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.047+0000 7f8c05d9b640 1 --2- 172.21.15.38:0/1999402825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c080b24b0 0x7f8bf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.047+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080ce010 con 0x7f8bf00047c0 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.047+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf000bab0 con 0x7f8bf00039a0 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.047+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf000bc70 con 0x7f8c080b24b0 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.047+0000 7f8c0659c640 1 --2- 172.21.15.38:0/1999402825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bf00047c0 0x7f8bf0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.047+0000 7f8c06d9d640 1 --2- 172.21.15.38:0/1999402825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf00039a0 0x7f8bf0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.047+0000 7f8c0659c640 1 -- 172.21.15.38:0/1999402825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c080b24b0 msgr2=0x7f8bf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.047+0000 7f8c0759e640 1 --2- 172.21.15.38:0/1999402825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c080b24b0 0x7f8bf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.047+0000 7f8c0659c640 1 --2- 172.21.15.38:0/1999402825 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c080b24b0 0x7f8bf00051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.047+0000 7f8c0659c640 1 -- 172.21.15.38:0/1999402825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf00039a0 msgr2=0x7f8bf0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.047+0000 7f8c0659c640 1 --2- 172.21.15.38:0/1999402825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf00039a0 0x7f8bf0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.047+0000 7f8c0659c640 1 -- 172.21.15.38:0/1999402825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0003520 con 0x7f8bf00047c0 2023-12-22T08:52:49.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.048+0000 7f8c0659c640 1 --2- 172.21.15.38:0/1999402825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bf00047c0 0x7f8bf0004c40 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00c210 tx=0x7f8bf00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bcecd5d1cdef62d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:49.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.049+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc005ad0 con 0x7f8bf00047c0 2023-12-22T08:52:49.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.049+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc005c30 con 0x7f8bf00047c0 2023-12-22T08:52:49.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.049+0000 7f8c05d9b640 1 -- 172.21.15.38:0/1999402825 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc02c870 con 0x7f8bf00047c0 2023-12-22T08:52:49.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.049+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/1999402825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bf00047c0 msgr2=0x7f8bf0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:49.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.049+0000 7f8c0d1d0640 1 --2- 172.21.15.38:0/1999402825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bf00047c0 0x7f8bf0004c40 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00c210 tx=0x7f8bf00057f0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.049+0000 7f8c0759e640 1 -- 172.21.15.38:0/1999402825 reap_dead start 2023-12-22T08:52:49.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.049+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/1999402825 shutdown_connections 2023-12-22T08:52:49.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.049+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/1999402825 >> 172.21.15.38:0/1999402825 conn(0x7f8c080cf070 msgr2=0x7f8c080cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:49.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.049+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/1999402825 shutdown_connections 2023-12-22T08:52:49.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.049+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/1999402825 wait complete. 2023-12-22T08:52:49.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.051+0000 7f8c0d1d0640 1 Processor -- start 2023-12-22T08:52:49.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.051+0000 7f8c0d1d0640 1 -- start start 2023-12-22T08:52:49.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.052+0000 7f8c0d1d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c0815cb80 0x7f8c081f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.052+0000 7f8c0d1d0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c0815e610 0x7f8c08156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.052+0000 7f8c0d1d0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c0815cf60 0x7f8c0815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.052+0000 7f8c0d1d0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080b1a50 con 0x7f8c0815e610 2023-12-22T08:52:49.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.052+0000 7f8c0d1d0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c081f3f30 con 0x7f8c0815cb80 2023-12-22T08:52:49.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.052+0000 7f8c0d1d0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c081f4210 con 0x7f8c0815cf60 2023-12-22T08:52:49.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.053+0000 7f8c0659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c0815e610 0x7f8c08156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.053+0000 7f8c0659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c0815e610 0x7f8c08156080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54212/0 (socket says 172.21.15.38:54212) 2023-12-22T08:52:49.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.053+0000 7f8c0659c640 1 -- 172.21.15.38:0/2632238173 learned_addr learned my addr 172.21.15.38:0/2632238173 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.053+0000 7f8c06d9d640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c0815cb80 0x7f8c081f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.053+0000 7f8c0759e640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c0815cf60 0x7f8c0815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.053+0000 7f8c0659c640 1 -- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c0815cf60 msgr2=0x7f8c0815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.053+0000 7f8c0659c640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c0815cf60 0x7f8c0815d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.053+0000 7f8c0659c640 1 -- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c0815cb80 msgr2=0x7f8c081f3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.053+0000 7f8c0659c640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c0815cb80 0x7f8c081f3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.053+0000 7f8c0659c640 1 -- 172.21.15.38:0/2632238173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c081f44f0 con 0x7f8c0815e610 2023-12-22T08:52:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.053+0000 7f8c06d9d640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c0815cb80 0x7f8c081f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.053+0000 7f8c0759e640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c0815cf60 0x7f8c0815d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.053+0000 7f8c0659c640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c0815e610 0x7f8c08156080 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00c210 tx=0x7f8c08156010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.054+0000 7f8bef7fe640 1 -- 172.21.15.38:0/2632238173 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc03c070 con 0x7f8c0815e610 2023-12-22T08:52:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.054+0000 7f8bef7fe640 1 -- 172.21.15.38:0/2632238173 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc001660 con 0x7f8c0815e610 2023-12-22T08:52:49.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.054+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/2632238173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c081f47d0 con 0x7f8c0815e610 2023-12-22T08:52:49.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.054+0000 7f8bef7fe640 1 -- 172.21.15.38:0/2632238173 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc004aa0 con 0x7f8c0815e610 2023-12-22T08:52:49.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.054+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/2632238173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0815d920 con 0x7f8c0815e610 2023-12-22T08:52:49.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.055+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/2632238173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c08061910 con 0x7f8c0815e610 2023-12-22T08:52:49.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.056+0000 7f8bef7fe640 1 -- 172.21.15.38:0/2632238173 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8bfc032070 con 0x7f8c0815e610 2023-12-22T08:52:49.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.057+0000 7f8bef7fe640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8bf406a430 0x7f8bf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.057+0000 7f8bef7fe640 1 -- 172.21.15.38:0/2632238173 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8bfc0a9500 con 0x7f8c0815e610 2023-12-22T08:52:49.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.058+0000 7f8c06d9d640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8bf406a430 0x7f8bf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.059+0000 7f8c06d9d640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8bf406a430 0x7f8bf406c8f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80016b0 tx=0x7f8bf8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:49.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.062+0000 7f8bef7fe640 1 -- 172.21.15.38:0/2632238173 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8bfc074aa0 con 0x7f8c0815e610 2023-12-22T08:52:49.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.291+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/2632238173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c080cc0a0 con 0x7f8c0815e610 2023-12-22T08:52:49.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.292+0000 7f8bef7fe640 1 -- 172.21.15.38:0/2632238173 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4649 (secure 0 0 0) 0x7f8bfc0780c0 con 0x7f8c0815e610 2023-12-22T08:52:49.293 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:52:49.293 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1443382612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1443382612},{"type":"v1","addr":"172.21.15.38:6835","nonce":1443382612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1913310975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1913310975},{"type":"v1","addr":"172.21.15.89:6836","nonce":1913310975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/218839128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":218839128},{"type":"v1","addr":"172.21.15.89:6837","nonce":218839128}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:51:25.111775+0000","modified":"2023-12-22T08:51:28.645925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8553":{"gid":8553,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6834/1387101372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1387101372},{"type":"v1","addr":"172.21.15.38:6834","nonce":1387101372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-22T08:52:49.293 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 78 2023-12-22T08:52:49.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.295+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8bf406a430 msgr2=0x7f8bf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:49.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.295+0000 7f8c0d1d0640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8bf406a430 0x7f8bf406c8f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80016b0 tx=0x7f8bf8009040 comp rx=0 tx=0).stop 2023-12-22T08:52:49.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.295+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/2632238173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c0815e610 msgr2=0x7f8c08156080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:49.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.295+0000 7f8c0d1d0640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c0815e610 0x7f8c08156080 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00c210 tx=0x7f8c08156010 comp rx=0 tx=0).stop 2023-12-22T08:52:49.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.295+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/2632238173 shutdown_connections 2023-12-22T08:52:49.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.295+0000 7f8c0d1d0640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c0815cf60 0x7f8c0815d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.295+0000 7f8c0d1d0640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8bf406a430 0x7f8bf406c8f0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.295+0000 7f8c0d1d0640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c0815e610 0x7f8c08156080 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.295+0000 7f8c0d1d0640 1 --2- 172.21.15.38:0/2632238173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c0815cb80 0x7f8c081f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.295+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/2632238173 >> 172.21.15.38:0/2632238173 conn(0x7f8c080cf070 msgr2=0x7f8c080713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:49.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.295+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/2632238173 shutdown_connections 2023-12-22T08:52:49.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.295+0000 7f8c0d1d0640 1 -- 172.21.15.38:0/2632238173 wait complete. 2023-12-22T08:52:49.317 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:52:49.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.527+0000 7f55ab407640 1 Processor -- start 2023-12-22T08:52:49.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.528+0000 7f55ab407640 1 -- start start 2023-12-22T08:52:49.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.529+0000 7f55ab407640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55a415d470 0x7f55a40b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.529+0000 7f55ab407640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55a4071ea0 0x7f55a40b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.529+0000 7f55ab407640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a40ac8e0 con 0x7f55a415d850 2023-12-22T08:52:49.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.529+0000 7f55ab407640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40ada40 con 0x7f55a415d470 2023-12-22T08:52:49.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.529+0000 7f55ab407640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a40b4550 con 0x7f55a4071ea0 2023-12-22T08:52:49.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.530+0000 7f55a99a4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55a4071ea0 0x7f55a40b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.530+0000 7f55a91a3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55a415d470 0x7f55a40b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.530+0000 7f55a99a4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55a4071ea0 0x7f55a40b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:42448/0 (socket says 172.21.15.38:42448) 2023-12-22T08:52:49.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.530+0000 7f55a91a3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55a415d470 0x7f55a40b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:43510/0 (socket says 172.21.15.38:43510) 2023-12-22T08:52:49.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.530+0000 7f55a99a4640 1 -- 172.21.15.38:0/4285281848 learned_addr learned my addr 172.21.15.38:0/4285281848 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:49.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.531+0000 7f55a99a4640 1 -- 172.21.15.38:0/4285281848 >> v2:172.21.15.89:3300/0 conn(0x7f55a415d470 msgr2=0x7f55a40b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:49.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.531+0000 7f55a99a4640 1 --2- 172.21.15.38:0/4285281848 >> v2:172.21.15.89:3300/0 conn(0x7f55a415d470 0x7f55a40b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.531+0000 7f55a99a4640 1 -- 172.21.15.38:0/4285281848 >> v1:172.21.15.89:6789/0 conn(0x7f55a415d850 legacy=0x7f55a40ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:49.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.531+0000 7f55a99a4640 1 -- 172.21.15.38:0/4285281848 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a40b4940 con 0x7f55a4071ea0 2023-12-22T08:52:49.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.531+0000 7f55a91a3640 1 --2- 172.21.15.38:0/4285281848 >> v2:172.21.15.89:3300/0 conn(0x7f55a415d470 0x7f55a40b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:52:49.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.532+0000 7f55a99a4640 1 --2- 172.21.15.38:0/4285281848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55a4071ea0 0x7f55a40b2050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f559c009e50 tx=0x7f559c02bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1b25ea624011172 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:49.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.533+0000 7f559bfff640 1 -- 172.21.15.38:0/4285281848 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c02caf0 con 0x7f55a4071ea0 2023-12-22T08:52:49.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.533+0000 7f559bfff640 1 -- 172.21.15.38:0/4285281848 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c02cc50 con 0x7f55a4071ea0 2023-12-22T08:52:49.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.533+0000 7f559bfff640 1 -- 172.21.15.38:0/4285281848 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c0343f0 con 0x7f55a4071ea0 2023-12-22T08:52:49.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.534+0000 7f55ab407640 1 -- 172.21.15.38:0/4285281848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55a4071ea0 msgr2=0x7f55a40b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:49.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.534+0000 7f55ab407640 1 --2- 172.21.15.38:0/4285281848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55a4071ea0 0x7f55a40b2050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f559c009e50 tx=0x7f559c02bf50 comp rx=0 tx=0).stop 2023-12-22T08:52:49.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.534+0000 7f55ab407640 1 -- 172.21.15.38:0/4285281848 shutdown_connections 2023-12-22T08:52:49.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.534+0000 7f55ab407640 1 --2- 172.21.15.38:0/4285281848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55a4071ea0 0x7f55a40b2050 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.534+0000 7f55ab407640 1 --2- 172.21.15.38:0/4285281848 >> v2:172.21.15.89:3300/0 conn(0x7f55a415d470 0x7f55a40b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.534+0000 7f55ab407640 1 -- 172.21.15.38:0/4285281848 >> 172.21.15.38:0/4285281848 conn(0x7f55a40cf070 msgr2=0x7f55a40cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:49.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.534+0000 7f55ab407640 1 -- 172.21.15.38:0/4285281848 shutdown_connections 2023-12-22T08:52:49.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.534+0000 7f55ab407640 1 -- 172.21.15.38:0/4285281848 wait complete. 2023-12-22T08:52:49.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.536+0000 7f55ab407640 1 Processor -- start 2023-12-22T08:52:49.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.536+0000 7f55ab407640 1 -- start start 2023-12-22T08:52:49.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55ab407640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55a4071ea0 0x7f55a4160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55ab407640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55a415d470 0x7f55a41f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55ab407640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a415d850 0x7f55a41f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55ab407640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a40ce920 con 0x7f55a4071ea0 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55ab407640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a40cdda0 con 0x7f55a415d850 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55ab407640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a40ce080 con 0x7f55a415d470 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55a91a3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55a4071ea0 0x7f55a4160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55a91a3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55a4071ea0 0x7f55a4160370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54220/0 (socket says 172.21.15.38:54220) 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55a91a3640 1 -- 172.21.15.38:0/879877366 learned_addr learned my addr 172.21.15.38:0/879877366 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55a89a2640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55a415d470 0x7f55a41f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55a99a4640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a415d850 0x7f55a41f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55a91a3640 1 -- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55a415d470 msgr2=0x7f55a41f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55a91a3640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55a415d470 0x7f55a41f24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55a91a3640 1 -- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a415d850 msgr2=0x7f55a41f2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.538+0000 7f55a91a3640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a415d850 0x7f55a41f2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.539+0000 7f55a91a3640 1 -- 172.21.15.38:0/879877366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a0009400 con 0x7f55a4071ea0 2023-12-22T08:52:49.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.539+0000 7f55a89a2640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55a415d470 0x7f55a41f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:49.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.539+0000 7f55a91a3640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55a4071ea0 0x7f55a4160370 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f55a000ebe0 tx=0x7f55a000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:49.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.539+0000 7f5599ffb640 1 -- 172.21.15.38:0/879877366 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0009760 con 0x7f55a4071ea0 2023-12-22T08:52:49.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.539+0000 7f5599ffb640 1 -- 172.21.15.38:0/879877366 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a000cc30 con 0x7f55a4071ea0 2023-12-22T08:52:49.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.539+0000 7f5599ffb640 1 -- 172.21.15.38:0/879877366 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a000eee0 con 0x7f55a4071ea0 2023-12-22T08:52:49.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.539+0000 7f55ab407640 1 -- 172.21.15.38:0/879877366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c009b30 con 0x7f55a4071ea0 2023-12-22T08:52:49.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.539+0000 7f55ab407640 1 -- 172.21.15.38:0/879877366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a40ce640 con 0x7f55a4071ea0 2023-12-22T08:52:49.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.541+0000 7f55ab407640 1 -- 172.21.15.38:0/879877366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a4061910 con 0x7f55a4071ea0 2023-12-22T08:52:49.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.541+0000 7f5599ffb640 1 -- 172.21.15.38:0/879877366 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f55a0013470 con 0x7f55a4071ea0 2023-12-22T08:52:49.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.543+0000 7f5599ffb640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f558806a430 0x7f558806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:49.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.543+0000 7f5599ffb640 1 -- 172.21.15.38:0/879877366 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f55a0088db0 con 0x7f55a4071ea0 2023-12-22T08:52:49.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.543+0000 7f55a89a2640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f558806a430 0x7f558806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:49.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.545+0000 7f55a89a2640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f558806a430 0x7f558806c8f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f55a40b3380 tx=0x7f5594009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:49.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.547+0000 7f5599ffb640 1 -- 172.21.15.38:0/879877366 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f55a008d070 con 0x7f55a4071ea0 2023-12-22T08:52:49.746 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:52:49.756 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:52:49.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.785+0000 7f55ab407640 1 -- 172.21.15.38:0/879877366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55a4160f20 con 0x7f55a4071ea0 2023-12-22T08:52:49.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.786+0000 7f5599ffb640 1 -- 172.21.15.38:0/879877366 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4649 (secure 0 0 0) 0x7f55a0021090 con 0x7f55a4071ea0 2023-12-22T08:52:49.787 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:52:49.787 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1443382612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1443382612},{"type":"v1","addr":"172.21.15.38:6835","nonce":1443382612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1913310975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1913310975},{"type":"v1","addr":"172.21.15.89:6836","nonce":1913310975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/218839128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":218839128},{"type":"v1","addr":"172.21.15.89:6837","nonce":218839128}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:51:25.111775+0000","modified":"2023-12-22T08:51:28.645925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8553":{"gid":8553,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6834/1387101372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":1387101372},{"type":"v1","addr":"172.21.15.38:6834","nonce":1387101372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-22T08:52:49.787 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 78 2023-12-22T08:52:49.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.789+0000 7f55ab407640 1 -- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f558806a430 msgr2=0x7f558806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:49.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.789+0000 7f55ab407640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f558806a430 0x7f558806c8f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f55a40b3380 tx=0x7f5594009040 comp rx=0 tx=0).stop 2023-12-22T08:52:49.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.789+0000 7f55ab407640 1 -- 172.21.15.38:0/879877366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55a4071ea0 msgr2=0x7f55a4160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:49.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.789+0000 7f55ab407640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55a4071ea0 0x7f55a4160370 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f55a000ebe0 tx=0x7f55a000c520 comp rx=0 tx=0).stop 2023-12-22T08:52:49.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.789+0000 7f55ab407640 1 -- 172.21.15.38:0/879877366 shutdown_connections 2023-12-22T08:52:49.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.789+0000 7f55ab407640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55a415d850 0x7f55a41f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.789+0000 7f55ab407640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55a415d470 0x7f55a41f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.789+0000 7f55ab407640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f558806a430 0x7f558806c8f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.789+0000 7f55ab407640 1 --2- 172.21.15.38:0/879877366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55a4071ea0 0x7f55a4160370 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:49.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.789+0000 7f55ab407640 1 -- 172.21.15.38:0/879877366 >> 172.21.15.38:0/879877366 conn(0x7f55a40cf070 msgr2=0x7f55a40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:49.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.789+0000 7f55ab407640 1 -- 172.21.15.38:0/879877366 shutdown_connections 2023-12-22T08:52:49.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:49.789+0000 7f55ab407640 1 -- 172.21.15.38:0/879877366 wait complete. 2023-12-22T08:52:49.809 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:52:50.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.078+0000 7ff3d2a95640 1 Processor -- start 2023-12-22T08:52:50.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.078+0000 7ff3d2a95640 1 -- start start 2023-12-22T08:52:50.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.079+0000 7ff3d2a95640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff3cc0b3ff0 0x7ff3cc06cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:50.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.079+0000 7ff3d2a95640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3cc15f220 con 0x7ff3cc0b44a0 2023-12-22T08:52:50.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.079+0000 7ff3d2a95640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3cc0d1520 con 0x7ff3cc157980 2023-12-22T08:52:50.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.079+0000 7ff3d2a95640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc0d1800 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.079+0000 7ff3d2294640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff3cc0b44a0 0x7ff3cc0d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43452/0 (socket says 172.21.15.38:43452) 2023-12-22T08:52:50.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.079+0000 7ff3d2294640 1 -- 172.21.15.38:0/2887721509 learned_addr learned my addr 172.21.15.38:0/2887721509 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:50.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.080+0000 7ff3d1292640 1 --2- 172.21.15.38:0/2887721509 >> v2:172.21.15.38:3300/0 conn(0x7ff3cc0b3ff0 0x7ff3cc06cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.080+0000 7ff3d0a91640 1 -- 172.21.15.38:0/2887721509 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771503085 0 0) 0x7ff3cc15f220 con 0x7ff3cc0b44a0 2023-12-22T08:52:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.080+0000 7ff3d0a91640 1 -- 172.21.15.38:0/2887721509 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b8003520 con 0x7ff3cc0b44a0 2023-12-22T08:52:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.080+0000 7ff3d0a91640 1 -- 172.21.15.38:0/2887721509 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1653234457 0 0) 0x7ff3b8003520 con 0x7ff3cc0b44a0 2023-12-22T08:52:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.080+0000 7ff3d1292640 1 -- 172.21.15.38:0/2887721509 >> v1:172.21.15.89:6789/0 conn(0x7ff3cc157980 legacy=0x7ff3cc15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.080+0000 7ff3d1292640 1 -- 172.21.15.38:0/2887721509 >> v1:172.21.15.38:6789/0 conn(0x7ff3cc0b44a0 legacy=0x7ff3cc0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.080+0000 7ff3d1292640 1 -- 172.21.15.38:0/2887721509 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc0d1ae0 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.081+0000 7ff3d1292640 1 --2- 172.21.15.38:0/2887721509 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc0b3ff0 0x7ff3cc06cf30 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00097a0 tx=0x7ff3c002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8b816a178f0466 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.082+0000 7ff3d0a91640 1 -- 172.21.15.38:0/2887721509 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c002f050 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.082+0000 7ff3d0a91640 1 -- 172.21.15.38:0/2887721509 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c0031500 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.082+0000 7ff3d0a91640 1 -- 172.21.15.38:0/2887721509 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40019f0 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.082+0000 7ff3d2a95640 1 -- 172.21.15.38:0/2887721509 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc0b3ff0 msgr2=0x7ff3cc06cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.082+0000 7ff3d2a95640 1 --2- 172.21.15.38:0/2887721509 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc0b3ff0 0x7ff3cc06cf30 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00097a0 tx=0x7ff3c002b820 comp rx=0 tx=0).stop 2023-12-22T08:52:50.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.082+0000 7ff3d2a95640 1 -- 172.21.15.38:0/2887721509 shutdown_connections 2023-12-22T08:52:50.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.082+0000 7ff3d2a95640 1 --2- 172.21.15.38:0/2887721509 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc0b3ff0 0x7ff3cc06cf30 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.082+0000 7ff3d2a95640 1 -- 172.21.15.38:0/2887721509 >> 172.21.15.38:0/2887721509 conn(0x7ff3cc0d31f0 msgr2=0x7ff3cc0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:50.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.083+0000 7ff3d2a95640 1 -- 172.21.15.38:0/2887721509 shutdown_connections 2023-12-22T08:52:50.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.083+0000 7ff3d2a95640 1 -- 172.21.15.38:0/2887721509 wait complete. 2023-12-22T08:52:50.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.084+0000 7ff3d2a95640 1 Processor -- start 2023-12-22T08:52:50.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.085+0000 7ff3d2a95640 1 -- start start 2023-12-22T08:52:50.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.085+0000 7ff3d2a95640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc0b3ff0 0x7ff3cc1f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:50.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d2a95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3cc0b44a0 0x7ff3cc1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:50.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d2a95640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc157980 0x7ff3cc14d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:50.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d2a95640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc151b80 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d2a95640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc156930 con 0x7ff3cc0b44a0 2023-12-22T08:52:50.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d2a95640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc155350 con 0x7ff3cc157980 2023-12-22T08:52:50.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d1a93640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc0b3ff0 0x7ff3cc1f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:50.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d1a93640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc0b3ff0 0x7ff3cc1f2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54234/0 (socket says 172.21.15.38:54234) 2023-12-22T08:52:50.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d1a93640 1 -- 172.21.15.38:0/178002560 learned_addr learned my addr 172.21.15.38:0/178002560 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:50.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d2294640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc157980 0x7ff3cc14d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:50.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d1292640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3cc0b44a0 0x7ff3cc1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:50.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d1a93640 1 -- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc157980 msgr2=0x7ff3cc14d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d1a93640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc157980 0x7ff3cc14d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d1a93640 1 -- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3cc0b44a0 msgr2=0x7ff3cc1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d1a93640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3cc0b44a0 0x7ff3cc1563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d1a93640 1 -- 172.21.15.38:0/178002560 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c0009400 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.086+0000 7ff3d1292640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3cc0b44a0 0x7ff3cc1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:50.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.087+0000 7ff3d1a93640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc0b3ff0 0x7ff3cc1f2980 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800c430 tx=0x7ff3c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:50.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.087+0000 7ff3be7fc640 1 -- 172.21.15.38:0/178002560 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80052d0 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.087+0000 7ff3be7fc640 1 -- 172.21.15.38:0/178002560 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c8005430 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.087+0000 7ff3be7fc640 1 -- 172.21.15.38:0/178002560 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8003830 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.087+0000 7ff3d2a95640 1 -- 172.21.15.38:0/178002560 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3cc155630 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.087+0000 7ff3d2a95640 1 -- 172.21.15.38:0/178002560 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3cc155bf0 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.088+0000 7ff3d2a95640 1 -- 172.21.15.38:0/178002560 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3cc061910 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.089+0000 7ff3be7fc640 1 -- 172.21.15.38:0/178002560 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff3c8003990 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.090+0000 7ff3be7fc640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3b006a430 0x7ff3b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:50.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.090+0000 7ff3be7fc640 1 -- 172.21.15.38:0/178002560 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff3c8087f90 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.091+0000 7ff3d1292640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3b006a430 0x7ff3b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:50.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.092+0000 7ff3d1292640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3b006a430 0x7ff3b006c8f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0035000 tx=0x7ff3c0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:50.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.095+0000 7ff3be7fc640 1 -- 172.21.15.38:0/178002560 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff3c80534a0 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.289+0000 7ff3d2a95640 1 -- 172.21.15.38:0/178002560 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3cc0d0f20 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.292+0000 7ff3be7fc640 1 -- 172.21.15.38:0/178002560 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+16168 (secure 0 0 0) 0x7ff3c8056ac0 con 0x7ff3cc0b3ff0 2023-12-22T08:52:50.294 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:52:50.294 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":178,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:52:46.392689+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:51:22.983948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-22T08:51:24.133013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.3","mappings":[{"from":2,"to":6}]},{"pgid":"21.29","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:52:50.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.294+0000 7ff3d2a95640 1 -- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3b006a430 msgr2=0x7ff3b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.295+0000 7ff3d2a95640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3b006a430 0x7ff3b006c8f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0035000 tx=0x7ff3c0008030 comp rx=0 tx=0).stop 2023-12-22T08:52:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.295+0000 7ff3d2a95640 1 -- 172.21.15.38:0/178002560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc0b3ff0 msgr2=0x7ff3cc1f2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.295+0000 7ff3d2a95640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc0b3ff0 0x7ff3cc1f2980 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800c430 tx=0x7ff3c800c8f0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.295+0000 7ff3d2a95640 1 -- 172.21.15.38:0/178002560 shutdown_connections 2023-12-22T08:52:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.295+0000 7ff3d2a95640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3cc157980 0x7ff3cc14d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.295+0000 7ff3d2a95640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3cc0b44a0 0x7ff3cc1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.295+0000 7ff3d2a95640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff3b006a430 0x7ff3b006c8f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.295+0000 7ff3d2a95640 1 --2- 172.21.15.38:0/178002560 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3cc0b3ff0 0x7ff3cc1f2980 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.295+0000 7ff3d2a95640 1 -- 172.21.15.38:0/178002560 >> 172.21.15.38:0/178002560 conn(0x7ff3cc0d31f0 msgr2=0x7ff3cc15eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:50.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.295+0000 7ff3d2a95640 1 -- 172.21.15.38:0/178002560 shutdown_connections 2023-12-22T08:52:50.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.295+0000 7ff3d2a95640 1 -- 172.21.15.38:0/178002560 wait complete. 2023-12-22T08:52:50.316 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T08:52:50.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.548+0000 7fef75b51640 1 Processor -- start 2023-12-22T08:52:50.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.548+0000 7fef75b51640 1 -- start start 2023-12-22T08:52:50.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.549+0000 7fef75b51640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fef7015e740 0x7fef7015db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:50.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.550+0000 7fef75b51640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7015eb20 con 0x7fef700b3f90 2023-12-22T08:52:50.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.550+0000 7fef75b51640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef70070770 con 0x7fef7006ca50 2023-12-22T08:52:50.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.550+0000 7fef75b51640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7006e650 con 0x7fef7015e740 2023-12-22T08:52:50.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.550+0000 7fef6ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fef700b3f90 0x7fef70070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43460/0 (socket says 172.21.15.38:43460) 2023-12-22T08:52:50.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.550+0000 7fef6ffff640 1 -- 172.21.15.38:0/3482040971 learned_addr learned my addr 172.21.15.38:0/3482040971 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:50.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.550+0000 7fef6f7fe640 1 --2- 172.21.15.38:0/3482040971 >> v2:172.21.15.89:3300/0 conn(0x7fef7015e740 0x7fef7015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:50.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.550+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369963569 0 0) 0x7fef7015eb20 con 0x7fef700b3f90 2023-12-22T08:52:50.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.550+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef58003520 con 0x7fef700b3f90 2023-12-22T08:52:50.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 864338449 0 0) 0x7fef58003520 con 0x7fef700b3f90 2023-12-22T08:52:50.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 >> v2:172.21.15.89:3300/0 conn(0x7fef7015e740 msgr2=0x7fef7015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:50.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6e7fc640 1 --2- 172.21.15.38:0/3482040971 >> v2:172.21.15.89:3300/0 conn(0x7fef7015e740 0x7fef7015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 >> v1:172.21.15.89:6789/0 conn(0x7fef7006ca50 legacy=0x7fef700b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7006cec0 con 0x7fef700b3f90 2023-12-22T08:52:50.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fef68001670 con 0x7fef700b3f90 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 >> v1:172.21.15.38:6789/0 conn(0x7fef700b3f90 legacy=0x7fef70070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6e7fc640 1 --2- 172.21.15.38:0/3482040971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef580039c0 0x7fef58003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6e7fc640 1 --2- 172.21.15.38:0/3482040971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef580047c0 0x7fef58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6e7fc640 1 --2- 172.21.15.38:0/3482040971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580052a0 0x7fef5800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7006e650 con 0x7fef580052a0 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5800c1a0 con 0x7fef580047c0 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5800c360 con 0x7fef580039c0 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.551+0000 7fef6ffff640 1 --2- 172.21.15.38:0/3482040971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580052a0 0x7fef5800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.552+0000 7fef6f7fe640 1 --2- 172.21.15.38:0/3482040971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef580039c0 0x7fef58003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.552+0000 7fef6effd640 1 --2- 172.21.15.38:0/3482040971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef580047c0 0x7fef58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.552+0000 7fef6ffff640 1 -- 172.21.15.38:0/3482040971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef580039c0 msgr2=0x7fef58003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.552+0000 7fef6ffff640 1 --2- 172.21.15.38:0/3482040971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef580039c0 0x7fef58003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.552+0000 7fef6ffff640 1 -- 172.21.15.38:0/3482040971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef580047c0 msgr2=0x7fef58004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.552+0000 7fef6ffff640 1 --2- 172.21.15.38:0/3482040971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef580047c0 0x7fef58004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.552+0000 7fef6ffff640 1 -- 172.21.15.38:0/3482040971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef58003520 con 0x7fef580052a0 2023-12-22T08:52:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.553+0000 7fef6ffff640 1 -- 172.21.15.38:0/3482040971 reap_dead start 2023-12-22T08:52:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.553+0000 7fef6ffff640 1 --2- 172.21.15.38:0/3482040971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580052a0 0x7fef5800b980 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c0e0 tx=0x7fef580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677fca434f7272c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.553+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68005ad0 con 0x7fef580052a0 2023-12-22T08:52:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.553+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef68005c70 con 0x7fef580052a0 2023-12-22T08:52:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.553+0000 7fef6e7fc640 1 -- 172.21.15.38:0/3482040971 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6802c810 con 0x7fef580052a0 2023-12-22T08:52:50.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.554+0000 7fef75b51640 1 -- 172.21.15.38:0/3482040971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580052a0 msgr2=0x7fef5800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.554+0000 7fef75b51640 1 --2- 172.21.15.38:0/3482040971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580052a0 0x7fef5800b980 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c0e0 tx=0x7fef580057f0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.554+0000 7fef75b51640 1 -- 172.21.15.38:0/3482040971 shutdown_connections 2023-12-22T08:52:50.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.554+0000 7fef75b51640 1 --2- 172.21.15.38:0/3482040971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580052a0 0x7fef5800b980 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.554+0000 7fef75b51640 1 -- 172.21.15.38:0/3482040971 >> 172.21.15.38:0/3482040971 conn(0x7fef700cfea0 msgr2=0x7fef700d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:50.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.554+0000 7fef75b51640 1 -- 172.21.15.38:0/3482040971 shutdown_connections 2023-12-22T08:52:50.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.554+0000 7fef75b51640 1 -- 172.21.15.38:0/3482040971 wait complete. 2023-12-22T08:52:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.556+0000 7fef75b51640 1 Processor -- start 2023-12-22T08:52:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.556+0000 7fef75b51640 1 -- start start 2023-12-22T08:52:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.557+0000 7fef75b51640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef580052a0 0x7fef700b7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.557+0000 7fef75b51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef70158310 0x7fef70144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.557+0000 7fef75b51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef7015d420 0x7fef7015d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.557+0000 7fef75b51640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef700b8590 con 0x7fef70158310 2023-12-22T08:52:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.557+0000 7fef75b51640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7015dde0 con 0x7fef7015d420 2023-12-22T08:52:50.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.557+0000 7fef75b51640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef70145390 con 0x7fef580052a0 2023-12-22T08:52:50.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.558+0000 7fef6effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef70158310 0x7fef70144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:50.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.558+0000 7fef6effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef70158310 0x7fef70144e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54248/0 (socket says 172.21.15.38:54248) 2023-12-22T08:52:50.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.558+0000 7fef6effd640 1 -- 172.21.15.38:0/1120869189 learned_addr learned my addr 172.21.15.38:0/1120869189 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:50.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.558+0000 7fef6ffff640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef7015d420 0x7fef7015d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.558+0000 7fef6f7fe640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef580052a0 0x7fef700b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.558+0000 7fef6effd640 1 -- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef580052a0 msgr2=0x7fef700b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.558+0000 7fef6effd640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef580052a0 0x7fef700b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.558+0000 7fef6effd640 1 -- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef7015d420 msgr2=0x7fef7015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.558+0000 7fef6effd640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef7015d420 0x7fef7015d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.558+0000 7fef6effd640 1 -- 172.21.15.38:0/1120869189 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700b7910 con 0x7fef70158310 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.558+0000 7fef6ffff640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef7015d420 0x7fef7015d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.558+0000 7fef6f7fe640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef580052a0 0x7fef700b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.559+0000 7fef6effd640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef70158310 0x7fef70144e50 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fef6400e4d0 tx=0x7fef6400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.559+0000 7fef57fff640 1 -- 172.21.15.38:0/1120869189 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef640052e0 con 0x7fef70158310 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.559+0000 7fef57fff640 1 -- 172.21.15.38:0/1120869189 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef64005440 con 0x7fef70158310 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.559+0000 7fef57fff640 1 -- 172.21.15.38:0/1120869189 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64003810 con 0x7fef70158310 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.559+0000 7fef75b51640 1 -- 172.21.15.38:0/1120869189 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef700b7bf0 con 0x7fef70158310 2023-12-22T08:52:50.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.559+0000 7fef75b51640 1 -- 172.21.15.38:0/1120869189 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef700b81b0 con 0x7fef70158310 2023-12-22T08:52:50.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.560+0000 7fef75b51640 1 -- 172.21.15.38:0/1120869189 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef70061910 con 0x7fef70158310 2023-12-22T08:52:50.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.561+0000 7fef57fff640 1 -- 172.21.15.38:0/1120869189 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fef64003970 con 0x7fef70158310 2023-12-22T08:52:50.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.563+0000 7fef57fff640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fef5c06a460 0x7fef5c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.563+0000 7fef57fff640 1 -- 172.21.15.38:0/1120869189 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fef64088610 con 0x7fef70158310 2023-12-22T08:52:50.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.564+0000 7fef6f7fe640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fef5c06a460 0x7fef5c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:50.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.565+0000 7fef6f7fe640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fef5c06a460 0x7fef5c06c920 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fef60007440 tx=0x7fef6000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:50.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.567+0000 7fef57fff640 1 -- 172.21.15.38:0/1120869189 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fef64053bb0 con 0x7fef70158310 2023-12-22T08:52:50.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.803+0000 7fef75b51640 1 -- 172.21.15.38:0/1120869189 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fef70072040 con 0x7fef70158310 2023-12-22T08:52:50.805 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:52:50.805+0000 7f0a26ee3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T08:52:50.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.821+0000 7fef57fff640 1 -- 172.21.15.38:0/1120869189 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7fef640571d0 con 0x7fef70158310 2023-12-22T08:52:50.822 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T08:52:50.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.824+0000 7fef75b51640 1 -- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fef5c06a460 msgr2=0x7fef5c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.824+0000 7fef75b51640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fef5c06a460 0x7fef5c06c920 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fef60007440 tx=0x7fef6000b040 comp rx=0 tx=0).stop 2023-12-22T08:52:50.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.824+0000 7fef75b51640 1 -- 172.21.15.38:0/1120869189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef70158310 msgr2=0x7fef70144e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:50.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.824+0000 7fef75b51640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef70158310 0x7fef70144e50 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fef6400e4d0 tx=0x7fef6400e990 comp rx=0 tx=0).stop 2023-12-22T08:52:50.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.824+0000 7fef75b51640 1 -- 172.21.15.38:0/1120869189 shutdown_connections 2023-12-22T08:52:50.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.824+0000 7fef75b51640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef7015d420 0x7fef7015d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.824+0000 7fef75b51640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fef5c06a460 0x7fef5c06c920 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.824+0000 7fef75b51640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef70158310 0x7fef70144e50 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.824+0000 7fef75b51640 1 --2- 172.21.15.38:0/1120869189 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef580052a0 0x7fef700b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:50.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.824+0000 7fef75b51640 1 -- 172.21.15.38:0/1120869189 >> 172.21.15.38:0/1120869189 conn(0x7fef700cfea0 msgr2=0x7fef70153d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:50.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.824+0000 7fef75b51640 1 -- 172.21.15.38:0/1120869189 shutdown_connections 2023-12-22T08:52:50.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:50.824+0000 7fef75b51640 1 -- 172.21.15.38:0/1120869189 wait complete. 2023-12-22T08:52:50.845 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T08:52:50.890 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:52:51.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.045+0000 7f87ed939640 1 Processor -- start 2023-12-22T08:52:51.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.046+0000 7f87ed939640 1 -- start start 2023-12-22T08:52:51.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.048+0000 7f87ed939640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87e815b7b0 0x7f87e80ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:51.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.048+0000 7f87ed939640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f87e80ce740 0x7f87e8070520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:51.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.048+0000 7f87ed939640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e80ceb70 con 0x7f87e815b3d0 2023-12-22T08:52:51.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.048+0000 7f87ed939640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e8070100 con 0x7f87e80ce740 2023-12-22T08:52:51.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.048+0000 7f87ed939640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e806c1e0 con 0x7f87e815b7b0 2023-12-22T08:52:51.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.048+0000 7f87e77fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f87e80ce740 0x7f87e8070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:51.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.048+0000 7f87e77fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f87e80ce740 0x7f87e8070520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34564/0 (socket says 172.21.15.38:34564) 2023-12-22T08:52:51.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.048+0000 7f87e77fe640 1 -- 172.21.15.38:0/706479879 learned_addr learned my addr 172.21.15.38:0/706479879 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:51.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.048+0000 7f87de7fc640 1 --2- 172.21.15.38:0/706479879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87e815b7b0 0x7f87e80ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:51.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.049+0000 7f87e77fe640 1 -- 172.21.15.38:0/706479879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87e815b7b0 msgr2=0x7f87e80ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:51.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.049+0000 7f87e77fe640 1 --2- 172.21.15.38:0/706479879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87e815b7b0 0x7f87e80ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:51.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.049+0000 7f87e77fe640 1 -- 172.21.15.38:0/706479879 >> v1:172.21.15.89:6789/0 conn(0x7f87e815b3d0 legacy=0x7f87e80ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:51.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.049+0000 7f87e77fe640 1 -- 172.21.15.38:0/706479879 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80cd620 con 0x7f87e80ce740 2023-12-22T08:52:51.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.050+0000 7f87e77fe640 1 --2- 172.21.15.38:0/706479879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87e80ce740 0x7f87e8070520 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009870 tx=0x7f87e002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b666545b17e176 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:51.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.050+0000 7f87e67fc640 1 -- 172.21.15.38:0/706479879 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0031740 con 0x7f87e80ce740 2023-12-22T08:52:51.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.050+0000 7f87e67fc640 1 -- 172.21.15.38:0/706479879 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e00318a0 con 0x7f87e80ce740 2023-12-22T08:52:51.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.050+0000 7f87e67fc640 1 -- 172.21.15.38:0/706479879 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0031c30 con 0x7f87e80ce740 2023-12-22T08:52:51.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.051+0000 7f87ed939640 1 -- 172.21.15.38:0/706479879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87e80ce740 msgr2=0x7f87e8070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:51.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.051+0000 7f87ed939640 1 --2- 172.21.15.38:0/706479879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87e80ce740 0x7f87e8070520 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009870 tx=0x7f87e002b7e0 comp rx=0 tx=0).stop 2023-12-22T08:52:51.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.051+0000 7f87ed939640 1 -- 172.21.15.38:0/706479879 shutdown_connections 2023-12-22T08:52:51.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.051+0000 7f87ed939640 1 --2- 172.21.15.38:0/706479879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87e80ce740 0x7f87e8070520 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:51.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.051+0000 7f87ed939640 1 --2- 172.21.15.38:0/706479879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87e815b7b0 0x7f87e80ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:51.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.051+0000 7f87ed939640 1 -- 172.21.15.38:0/706479879 >> 172.21.15.38:0/706479879 conn(0x7f87e80cba10 msgr2=0x7f87e80cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:51.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.051+0000 7f87ed939640 1 -- 172.21.15.38:0/706479879 shutdown_connections 2023-12-22T08:52:51.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.051+0000 7f87ed939640 1 -- 172.21.15.38:0/706479879 wait complete. 2023-12-22T08:52:51.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.053+0000 7f87ed939640 1 Processor -- start 2023-12-22T08:52:51.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.053+0000 7f87ed939640 1 -- start start 2023-12-22T08:52:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.054+0000 7f87ed939640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87e80ce740 0x7f87e80c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.054+0000 7f87ed939640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87e815b3d0 0x7f87e8071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.054+0000 7f87ed939640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87e815b7b0 0x7f87e8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.054+0000 7f87ed939640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80ad8d0 con 0x7f87e80ce740 2023-12-22T08:52:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.054+0000 7f87ed939640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80acc50 con 0x7f87e815b7b0 2023-12-22T08:52:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.054+0000 7f87ed939640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80acf30 con 0x7f87e815b3d0 2023-12-22T08:52:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.054+0000 7f87e6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87e80ce740 0x7f87e80c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.054+0000 7f87e6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87e80ce740 0x7f87e80c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34566/0 (socket says 172.21.15.38:34566) 2023-12-22T08:52:51.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.054+0000 7f87e6ffd640 1 -- 172.21.15.38:0/86006443 learned_addr learned my addr 172.21.15.38:0/86006443 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:51.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.055+0000 7f87e77fe640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87e815b7b0 0x7f87e8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:51.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.055+0000 7f87de7fc640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87e815b3d0 0x7f87e8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:51.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.055+0000 7f87e6ffd640 1 -- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87e815b3d0 msgr2=0x7f87e8071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:51.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.055+0000 7f87e6ffd640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87e815b3d0 0x7f87e8071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:51.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.055+0000 7f87e6ffd640 1 -- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87e815b7b0 msgr2=0x7f87e8071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:51.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.055+0000 7f87e6ffd640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87e815b7b0 0x7f87e8071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:51.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.055+0000 7f87e6ffd640 1 -- 172.21.15.38:0/86006443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e00094d0 con 0x7f87e80ce740 2023-12-22T08:52:51.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.055+0000 7f87e6ffd640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87e80ce740 0x7f87e80c85d0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f87d800ba50 tx=0x7f87d800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:51.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.055+0000 7f87e4ff9640 1 -- 172.21.15.38:0/86006443 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d800cbe0 con 0x7f87e80ce740 2023-12-22T08:52:51.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.055+0000 7f87e4ff9640 1 -- 172.21.15.38:0/86006443 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d800cd80 con 0x7f87e80ce740 2023-12-22T08:52:51.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.055+0000 7f87e4ff9640 1 -- 172.21.15.38:0/86006443 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8014680 con 0x7f87e80ce740 2023-12-22T08:52:51.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.055+0000 7f87ed939640 1 -- 172.21.15.38:0/86006443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e80ad210 con 0x7f87e80ce740 2023-12-22T08:52:51.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.056+0000 7f87ed939640 1 -- 172.21.15.38:0/86006443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e80ac8e0 con 0x7f87e80ce740 2023-12-22T08:52:51.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.057+0000 7f87ed939640 1 -- 172.21.15.38:0/86006443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e80ada10 con 0x7f87e80ce740 2023-12-22T08:52:51.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.058+0000 7f87e4ff9640 1 -- 172.21.15.38:0/86006443 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f87d80147e0 con 0x7f87e80ce740 2023-12-22T08:52:51.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.059+0000 7f87e4ff9640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87c806a430 0x7f87c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:51.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.059+0000 7f87e4ff9640 1 -- 172.21.15.38:0/86006443 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f87d80888e0 con 0x7f87e80ce740 2023-12-22T08:52:51.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.059+0000 7f87de7fc640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87c806a430 0x7f87c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:51.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.061+0000 7f87de7fc640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87c806a430 0x7f87c806c8f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f87e81f3f30 tx=0x7f87d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:51.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.063+0000 7f87e4ff9640 1 -- 172.21.15.38:0/86006443 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f87e80ada10 con 0x7f87e80ce740 2023-12-22T08:52:51.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.290+0000 7f87ed939640 1 -- 172.21.15.38:0/86006443 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f87e80ada10 con 0x7f87e80ce740 2023-12-22T08:52:51.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.827+0000 7f87e4ff9640 1 -- 172.21.15.38:0/86006443 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 104+0+0 (secure 0 0 0) 0x7f87e80ada10 con 0x7f87e80ce740 2023-12-22T08:52:51.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.830+0000 7f87ed939640 1 -- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87c806a430 msgr2=0x7f87c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:51.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.830+0000 7f87ed939640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87c806a430 0x7f87c806c8f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f87e81f3f30 tx=0x7f87d0008040 comp rx=0 tx=0).stop 2023-12-22T08:52:51.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.831+0000 7f87ed939640 1 -- 172.21.15.38:0/86006443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87e80ce740 msgr2=0x7f87e80c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:51.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.831+0000 7f87ed939640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87e80ce740 0x7f87e80c85d0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f87d800ba50 tx=0x7f87d800bf10 comp rx=0 tx=0).stop 2023-12-22T08:52:51.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.831+0000 7f87ed939640 1 -- 172.21.15.38:0/86006443 shutdown_connections 2023-12-22T08:52:51.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.831+0000 7f87ed939640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87e815b7b0 0x7f87e8071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:51.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.831+0000 7f87ed939640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87e815b3d0 0x7f87e8071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:51.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.831+0000 7f87ed939640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f87c806a430 0x7f87c806c8f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:51.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.831+0000 7f87ed939640 1 --2- 172.21.15.38:0/86006443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87e80ce740 0x7f87e80c85d0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:51.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.831+0000 7f87ed939640 1 -- 172.21.15.38:0/86006443 >> 172.21.15.38:0/86006443 conn(0x7f87e80cba10 msgr2=0x7f87e815bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:51.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.831+0000 7f87ed939640 1 -- 172.21.15.38:0/86006443 shutdown_connections 2023-12-22T08:52:51.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:51.831+0000 7f87ed939640 1 -- 172.21.15.38:0/86006443 wait complete. 2023-12-22T08:52:51.855 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T08:52:52.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.134+0000 7f3bad084640 1 Processor -- start 2023-12-22T08:52:52.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.134+0000 7f3bad084640 1 -- start start 2023-12-22T08:52:52.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.136+0000 7f3bad084640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ba80cc580 0x7f3ba80cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:52.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.136+0000 7f3bad084640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ba80b3600 0x7f3ba80b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:52.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.136+0000 7f3bad084640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba8071b70 con 0x7f3ba815b480 2023-12-22T08:52:52.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.136+0000 7f3bad084640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba80b3fd0 con 0x7f3ba80cc580 2023-12-22T08:52:52.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.136+0000 7f3bad084640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba8070770 con 0x7f3ba80b3600 2023-12-22T08:52:52.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.136+0000 7f3b9ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ba80cc580 0x7f3ba80cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:52.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.136+0000 7f3b9ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ba80cc580 0x7f3ba80cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34570/0 (socket says 172.21.15.38:34570) 2023-12-22T08:52:52.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.136+0000 7f3b9ffff640 1 -- 172.21.15.38:0/1511250446 learned_addr learned my addr 172.21.15.38:0/1511250446 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:52.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.136+0000 7f3ba759e640 1 --2- 172.21.15.38:0/1511250446 >> v2:172.21.15.89:3300/0 conn(0x7f3ba80b3600 0x7f3ba80b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:52.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.136+0000 7f3b9ffff640 1 -- 172.21.15.38:0/1511250446 >> v2:172.21.15.89:3300/0 conn(0x7f3ba80b3600 msgr2=0x7f3ba80b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:52.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.137+0000 7f3b9ffff640 1 --2- 172.21.15.38:0/1511250446 >> v2:172.21.15.89:3300/0 conn(0x7f3ba80b3600 0x7f3ba80b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:52.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.137+0000 7f3b9ffff640 1 -- 172.21.15.38:0/1511250446 >> v1:172.21.15.89:6789/0 conn(0x7f3ba815b480 legacy=0x7f3ba8071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:52.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.137+0000 7f3b9ffff640 1 -- 172.21.15.38:0/1511250446 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba80b17a0 con 0x7f3ba80cc580 2023-12-22T08:52:52.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.137+0000 7f3ba759e640 1 --2- 172.21.15.38:0/1511250446 >> v2:172.21.15.89:3300/0 conn(0x7f3ba80b3600 0x7f3ba80b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:52.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.138+0000 7f3b9ffff640 1 --2- 172.21.15.38:0/1511250446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ba80cc580 0x7f3ba80cd420 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80b20e0 tx=0x7f3b9002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c06fc524d3dbe5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:52.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.138+0000 7f3ba659c640 1 -- 172.21.15.38:0/1511250446 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90031870 con 0x7f3ba80cc580 2023-12-22T08:52:52.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.138+0000 7f3ba659c640 1 -- 172.21.15.38:0/1511250446 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b900319d0 con 0x7f3ba80cc580 2023-12-22T08:52:52.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.138+0000 7f3ba659c640 1 -- 172.21.15.38:0/1511250446 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90031d60 con 0x7f3ba80cc580 2023-12-22T08:52:52.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.139+0000 7f3bad084640 1 -- 172.21.15.38:0/1511250446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ba80cc580 msgr2=0x7f3ba80cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:52.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.139+0000 7f3bad084640 1 --2- 172.21.15.38:0/1511250446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ba80cc580 0x7f3ba80cd420 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80b20e0 tx=0x7f3b9002b910 comp rx=0 tx=0).stop 2023-12-22T08:52:52.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.139+0000 7f3bad084640 1 -- 172.21.15.38:0/1511250446 shutdown_connections 2023-12-22T08:52:52.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.139+0000 7f3bad084640 1 --2- 172.21.15.38:0/1511250446 >> v2:172.21.15.89:3300/0 conn(0x7f3ba80b3600 0x7f3ba80b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:52.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.139+0000 7f3bad084640 1 --2- 172.21.15.38:0/1511250446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ba80cc580 0x7f3ba80cd420 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:52.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.139+0000 7f3bad084640 1 -- 172.21.15.38:0/1511250446 >> 172.21.15.38:0/1511250446 conn(0x7f3ba806f880 msgr2=0x7f3ba80b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:52.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.139+0000 7f3bad084640 1 -- 172.21.15.38:0/1511250446 shutdown_connections 2023-12-22T08:52:52.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.139+0000 7f3bad084640 1 -- 172.21.15.38:0/1511250446 wait complete. 2023-12-22T08:52:52.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.141+0000 7f3bad084640 1 Processor -- start 2023-12-22T08:52:52.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.141+0000 7f3bad084640 1 -- start start 2023-12-22T08:52:52.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.142+0000 7f3bad084640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba80b3600 0x7f3ba8157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:52.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.142+0000 7f3bad084640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ba80cc580 0x7f3ba80afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:52.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.142+0000 7f3bad084640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ba815b480 0x7f3ba80b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:52.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.142+0000 7f3bad084640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba81565e0 con 0x7f3ba80cc580 2023-12-22T08:52:52.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.142+0000 7f3bad084640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba8156880 con 0x7f3ba80b3600 2023-12-22T08:52:52.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.142+0000 7f3bad084640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba8156b60 con 0x7f3ba815b480 2023-12-22T08:52:52.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.142+0000 7f3b9ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ba80cc580 0x7f3ba80afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:52.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.142+0000 7f3b9ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ba80cc580 0x7f3ba80afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34574/0 (socket says 172.21.15.38:34574) 2023-12-22T08:52:52.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.142+0000 7f3b9ffff640 1 -- 172.21.15.38:0/3556247997 learned_addr learned my addr 172.21.15.38:0/3556247997 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:52.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3b9ffff640 1 -- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ba815b480 msgr2=0x7f3ba80b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:52.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3ba759e640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ba815b480 0x7f3ba80b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:52.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3ba6d9d640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba80b3600 0x7f3ba8157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:52.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3b9ffff640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ba815b480 0x7f3ba80b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:52.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3b9ffff640 1 -- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba80b3600 msgr2=0x7f3ba8157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:52.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3b9ffff640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba80b3600 0x7f3ba8157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:52.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3b9ffff640 1 -- 172.21.15.38:0/3556247997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b900094d0 con 0x7f3ba80cc580 2023-12-22T08:52:52.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3ba6d9d640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba80b3600 0x7f3ba8157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:52.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3b9ffff640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ba80cc580 0x7f3ba80afe80 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f3b9002b950 tx=0x7f3b900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:52.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3b9f7fe640 1 -- 172.21.15.38:0/3556247997 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90031860 con 0x7f3ba80cc580 2023-12-22T08:52:52.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3b9f7fe640 1 -- 172.21.15.38:0/3556247997 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b900443f0 con 0x7f3ba80cc580 2023-12-22T08:52:52.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3bad084640 1 -- 172.21.15.38:0/3556247997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba8156e40 con 0x7f3ba80cc580 2023-12-22T08:52:52.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3b9f7fe640 1 -- 172.21.15.38:0/3556247997 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900447a0 con 0x7f3ba80cc580 2023-12-22T08:52:52.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.143+0000 7f3bad084640 1 -- 172.21.15.38:0/3556247997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba81582e0 con 0x7f3ba80cc580 2023-12-22T08:52:52.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.145+0000 7f3bad084640 1 -- 172.21.15.38:0/3556247997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba8157360 con 0x7f3ba80cc580 2023-12-22T08:52:52.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.146+0000 7f3b9f7fe640 1 -- 172.21.15.38:0/3556247997 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3b9004d450 con 0x7f3ba80cc580 2023-12-22T08:52:52.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.147+0000 7f3b9f7fe640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3b8806a430 0x7f3b8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:52.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.147+0000 7f3b9f7fe640 1 -- 172.21.15.38:0/3556247997 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3b9002d040 con 0x7f3ba80cc580 2023-12-22T08:52:52.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.147+0000 7f3ba6d9d640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3b8806a430 0x7f3b8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:52.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.149+0000 7f3ba6d9d640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3b8806a430 0x7f3b8806c8f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800a810 tx=0x7f3b98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:52.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.152+0000 7f3b9f7fe640 1 -- 172.21.15.38:0/3556247997 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3b900ddc80 con 0x7f3ba80cc580 2023-12-22T08:52:52.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.344+0000 7f3bad084640 1 -- 172.21.15.38:0/3556247997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3ba8061910 con 0x7f3ba80cc580 2023-12-22T08:52:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.836+0000 7f3b9f7fe640 1 -- 172.21.15.38:0/3556247997 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v180) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3ba8157360 con 0x7f3ba80cc580 2023-12-22T08:52:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2023-12-22T08:52:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.840+0000 7f3bad084640 1 -- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3b8806a430 msgr2=0x7f3b8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.840+0000 7f3bad084640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3b8806a430 0x7f3b8806c8f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800a810 tx=0x7f3b98008040 comp rx=0 tx=0).stop 2023-12-22T08:52:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.840+0000 7f3bad084640 1 -- 172.21.15.38:0/3556247997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ba80cc580 msgr2=0x7f3ba80afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.840+0000 7f3bad084640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ba80cc580 0x7f3ba80afe80 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f3b9002b950 tx=0x7f3b900046c0 comp rx=0 tx=0).stop 2023-12-22T08:52:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.840+0000 7f3bad084640 1 -- 172.21.15.38:0/3556247997 shutdown_connections 2023-12-22T08:52:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.840+0000 7f3bad084640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ba815b480 0x7f3ba80b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.840+0000 7f3bad084640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f3b8806a430 0x7f3b8806c8f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.840+0000 7f3bad084640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ba80cc580 0x7f3ba80afe80 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.840+0000 7f3bad084640 1 --2- 172.21.15.38:0/3556247997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ba80b3600 0x7f3ba8157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.840+0000 7f3bad084640 1 -- 172.21.15.38:0/3556247997 >> 172.21.15.38:0/3556247997 conn(0x7f3ba806f880 msgr2=0x7f3ba80cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.840+0000 7f3bad084640 1 -- 172.21.15.38:0/3556247997 shutdown_connections 2023-12-22T08:52:52.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:52.840+0000 7f3bad084640 1 -- 172.21.15.38:0/3556247997 wait complete. 2023-12-22T08:52:52.863 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T08:52:53.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.092+0000 7f9890d1b640 1 Processor -- start 2023-12-22T08:52:53.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.092+0000 7f9890d1b640 1 -- start start 2023-12-22T08:52:53.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.094+0000 7f9890d1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f988c146e40 0x7f988c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:53.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.094+0000 7f9890d1b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f988c161df0 0x7f988c1611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:53.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.094+0000 7f9890d1b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988c161b60 con 0x7f988c161700 2023-12-22T08:52:53.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.094+0000 7f9890d1b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988c0b4da0 con 0x7f988c161df0 2023-12-22T08:52:53.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.094+0000 7f9890d1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c0b4120 con 0x7f988c146e40 2023-12-22T08:52:53.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.095+0000 7f988ad9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f988c161700 0x7f988c06cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37822/0 (socket says 172.21.15.38:37822) 2023-12-22T08:52:53.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.095+0000 7f9889d9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f988c161df0 0x7f988c1611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:53.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.095+0000 7f988ad9d640 1 -- 172.21.15.38:0/2586029465 learned_addr learned my addr 172.21.15.38:0/2586029465 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:53.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.095+0000 7f988a59c640 1 --2- 172.21.15.38:0/2586029465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f988c146e40 0x7f988c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:53.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.095+0000 7f9889d9b640 1 -- 172.21.15.38:0/2586029465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f988c146e40 msgr2=0x7f988c0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:53.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.095+0000 7f9889d9b640 1 --2- 172.21.15.38:0/2586029465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f988c146e40 0x7f988c0cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:53.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.095+0000 7f9889d9b640 1 -- 172.21.15.38:0/2586029465 >> v1:172.21.15.38:6789/0 conn(0x7f988c161700 legacy=0x7f988c06cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:53.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.095+0000 7f9889d9b640 1 -- 172.21.15.38:0/2586029465 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c0b4400 con 0x7f988c161df0 2023-12-22T08:52:53.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.095+0000 7f988959a640 1 -- 172.21.15.38:0/2586029465 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430928701 0 0) 0x7f988c161b60 con 0x7f988c161700 2023-12-22T08:52:53.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.097+0000 7f9889d9b640 1 --2- 172.21.15.38:0/2586029465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f988c161df0 0x7f988c1611c0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f9880009790 tx=0x7f988002b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1c058780f0bed6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:53.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.098+0000 7f988959a640 1 -- 172.21.15.38:0/2586029465 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98800316f0 con 0x7f988c161df0 2023-12-22T08:52:53.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.098+0000 7f988959a640 1 -- 172.21.15.38:0/2586029465 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9880031850 con 0x7f988c161df0 2023-12-22T08:52:53.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.098+0000 7f988959a640 1 -- 172.21.15.38:0/2586029465 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880031be0 con 0x7f988c161df0 2023-12-22T08:52:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.098+0000 7f9890d1b640 1 -- 172.21.15.38:0/2586029465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f988c161df0 msgr2=0x7f988c1611c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.098+0000 7f9890d1b640 1 --2- 172.21.15.38:0/2586029465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f988c161df0 0x7f988c1611c0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f9880009790 tx=0x7f988002b790 comp rx=0 tx=0).stop 2023-12-22T08:52:53.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.098+0000 7f9890d1b640 1 -- 172.21.15.38:0/2586029465 shutdown_connections 2023-12-22T08:52:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.098+0000 7f9890d1b640 1 --2- 172.21.15.38:0/2586029465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f988c161df0 0x7f988c1611c0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.099+0000 7f9890d1b640 1 --2- 172.21.15.38:0/2586029465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f988c146e40 0x7f988c0cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.099+0000 7f9890d1b640 1 -- 172.21.15.38:0/2586029465 >> 172.21.15.38:0/2586029465 conn(0x7f988c0cff10 msgr2=0x7f988c0d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.099+0000 7f9890d1b640 1 -- 172.21.15.38:0/2586029465 shutdown_connections 2023-12-22T08:52:53.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.099+0000 7f9890d1b640 1 -- 172.21.15.38:0/2586029465 wait complete. 2023-12-22T08:52:53.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.100+0000 7f9890d1b640 1 Processor -- start 2023-12-22T08:52:53.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.101+0000 7f9890d1b640 1 -- start start 2023-12-22T08:52:53.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.102+0000 7f9890d1b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f988c146e40 0x7f988c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:53.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.102+0000 7f9890d1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f988c161700 0x7f988c15e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:53.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.102+0000 7f9890d1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f988c161df0 0x7f988c0d3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:53.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.102+0000 7f9890d1b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c141f50 con 0x7f988c146e40 2023-12-22T08:52:53.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.102+0000 7f9890d1b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c0b8d30 con 0x7f988c161700 2023-12-22T08:52:53.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.102+0000 7f9890d1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c15ebe0 con 0x7f988c161df0 2023-12-22T08:52:53.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.102+0000 7f988a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f988c146e40 0x7f988c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:53.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.102+0000 7f988a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f988c146e40 0x7f988c15e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34590/0 (socket says 172.21.15.38:34590) 2023-12-22T08:52:53.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.102+0000 7f988a59c640 1 -- 172.21.15.38:0/2588038399 learned_addr learned my addr 172.21.15.38:0/2588038399 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:53.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.102+0000 7f9889d9b640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f988c161700 0x7f988c15e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:53.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.102+0000 7f988ad9d640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f988c161df0 0x7f988c0d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:53.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.103+0000 7f988a59c640 1 -- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f988c161df0 msgr2=0x7f988c0d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:53.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.103+0000 7f988a59c640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f988c161df0 0x7f988c0d3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:53.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.103+0000 7f988a59c640 1 -- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f988c161700 msgr2=0x7f988c15e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:53.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.103+0000 7f988a59c640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f988c161700 0x7f988c15e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:53.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.103+0000 7f988a59c640 1 -- 172.21.15.38:0/2588038399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98800093a0 con 0x7f988c146e40 2023-12-22T08:52:53.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.103+0000 7f988a59c640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f988c146e40 0x7f988c15e040 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f987c00d5f0 tx=0x7f987c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:53.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.103+0000 7f987affd640 1 -- 172.21.15.38:0/2588038399 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c0125f0 con 0x7f988c146e40 2023-12-22T08:52:53.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.103+0000 7f987affd640 1 -- 172.21.15.38:0/2588038399 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c012750 con 0x7f988c146e40 2023-12-22T08:52:53.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.103+0000 7f987affd640 1 -- 172.21.15.38:0/2588038399 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c012b00 con 0x7f988c146e40 2023-12-22T08:52:53.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.103+0000 7f9890d1b640 1 -- 172.21.15.38:0/2588038399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988c15eec0 con 0x7f988c146e40 2023-12-22T08:52:53.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.104+0000 7f9890d1b640 1 -- 172.21.15.38:0/2588038399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988c141b70 con 0x7f988c146e40 2023-12-22T08:52:53.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.105+0000 7f9890d1b640 1 -- 172.21.15.38:0/2588038399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988c1421c0 con 0x7f988c146e40 2023-12-22T08:52:53.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.106+0000 7f987affd640 1 -- 172.21.15.38:0/2588038399 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f987c012c60 con 0x7f988c146e40 2023-12-22T08:52:53.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.107+0000 7f987affd640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f986c06a430 0x7f986c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:53.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.107+0000 7f987affd640 1 -- 172.21.15.38:0/2588038399 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f987c088cd0 con 0x7f988c146e40 2023-12-22T08:52:53.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.107+0000 7f9889d9b640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f986c06a430 0x7f986c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:53.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.108+0000 7f9889d9b640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f986c06a430 0x7f986c06c8f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9880036000 tx=0x7f9880008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:53.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.111+0000 7f987affd640 1 -- 172.21.15.38:0/2588038399 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f987c0543d0 con 0x7f988c146e40 2023-12-22T08:52:53.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.313+0000 7f9890d1b640 1 -- 172.21.15.38:0/2588038399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f988c15f3e0 con 0x7f988c146e40 2023-12-22T08:52:53.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.842+0000 7f987affd640 1 -- 172.21.15.38:0/2588038399 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v181) v1 ==== 169+0+0 (secure 0 0 0) 0x7f988c15f3e0 con 0x7f988c146e40 2023-12-22T08:52:53.846 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2023-12-22T08:52:53.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.847+0000 7f9890d1b640 1 -- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f986c06a430 msgr2=0x7f986c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:53.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.847+0000 7f9890d1b640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f986c06a430 0x7f986c06c8f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9880036000 tx=0x7f9880008030 comp rx=0 tx=0).stop 2023-12-22T08:52:53.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.848+0000 7f9890d1b640 1 -- 172.21.15.38:0/2588038399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f988c146e40 msgr2=0x7f988c15e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:53.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.848+0000 7f9890d1b640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f988c146e40 0x7f988c15e040 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f987c00d5f0 tx=0x7f987c00dab0 comp rx=0 tx=0).stop 2023-12-22T08:52:53.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.848+0000 7f9890d1b640 1 -- 172.21.15.38:0/2588038399 shutdown_connections 2023-12-22T08:52:53.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.848+0000 7f9890d1b640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f988c161df0 0x7f988c0d3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:53.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.848+0000 7f9890d1b640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f988c161700 0x7f988c15e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:53.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.848+0000 7f9890d1b640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f986c06a430 0x7f986c06c8f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:53.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.848+0000 7f9890d1b640 1 --2- 172.21.15.38:0/2588038399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f988c146e40 0x7f988c15e040 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:53.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.848+0000 7f9890d1b640 1 -- 172.21.15.38:0/2588038399 >> 172.21.15.38:0/2588038399 conn(0x7f988c0cff10 msgr2=0x7f988c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:53.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.849+0000 7f9890d1b640 1 -- 172.21.15.38:0/2588038399 shutdown_connections 2023-12-22T08:52:53.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:53.849+0000 7f9890d1b640 1 -- 172.21.15.38:0/2588038399 wait complete. 2023-12-22T08:52:53.873 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-22T08:52:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.082+0000 7f5bb47ab640 1 Processor -- start 2023-12-22T08:52:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.082+0000 7f5bb47ab640 1 -- start start 2023-12-22T08:52:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.084+0000 7f5bb47ab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bac0cb050 0x7f5bac159480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.084+0000 7f5bb47ab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5bac0ccad0 0x7f5bac1599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.084+0000 7f5bb47ab640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bac06e310 con 0x7f5bac159f00 2023-12-22T08:52:54.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.084+0000 7f5bb47ab640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bac15b020 con 0x7f5bac0ccad0 2023-12-22T08:52:54.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.084+0000 7f5bb47ab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac072070 con 0x7f5bac0cb050 2023-12-22T08:52:54.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.084+0000 7f5bb2d48640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5bac159f00 0x7f5bac15d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37836/0 (socket says 172.21.15.38:37836) 2023-12-22T08:52:54.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.084+0000 7f5bb2d48640 1 -- 172.21.15.38:0/861002284 learned_addr learned my addr 172.21.15.38:0/861002284 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb2547640 1 --2- 172.21.15.38:0/861002284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bac0cb050 0x7f5bac159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1d46640 1 --2- 172.21.15.38:0/861002284 >> v2:172.21.15.89:3300/0 conn(0x7f5bac0ccad0 0x7f5bac1599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772149236 0 0) 0x7f5bac06e310 con 0x7f5bac159f00 2023-12-22T08:52:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b98005730 con 0x7f5bac159f00 2023-12-22T08:52:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1471369190 0 0) 0x7f5b98005730 con 0x7f5bac159f00 2023-12-22T08:52:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bac0cb050 msgr2=0x7f5bac159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 --2- 172.21.15.38:0/861002284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bac0cb050 0x7f5bac159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 >> v2:172.21.15.89:3300/0 conn(0x7f5bac0ccad0 msgr2=0x7f5bac1599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 --2- 172.21.15.38:0/861002284 >> v2:172.21.15.89:3300/0 conn(0x7f5bac0ccad0 0x7f5bac1599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac15a3a0 con 0x7f5bac159f00 2023-12-22T08:52:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f5ba4001670 con 0x7f5bac159f00 2023-12-22T08:52:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 >> v1:172.21.15.38:6789/0 conn(0x7f5bac159f00 legacy=0x7f5bac15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 --2- 172.21.15.38:0/861002284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b98005b80 0x7f5b98005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 --2- 172.21.15.38:0/861002284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b980069d0 0x7f5b98006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 --2- 172.21.15.38:0/861002284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bac0cb050 0x7f5b98007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac15b020 con 0x7f5b980069d0 2023-12-22T08:52:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac072070 con 0x7f5b98005b80 2023-12-22T08:52:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.085+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9800dbe0 con 0x7f5bac0cb050 2023-12-22T08:52:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.086+0000 7f5bb1d46640 1 --2- 172.21.15.38:0/861002284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b980069d0 0x7f5b98006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.086+0000 7f5bb2547640 1 --2- 172.21.15.38:0/861002284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b98005b80 0x7f5b98005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.086+0000 7f5bb2d48640 1 --2- 172.21.15.38:0/861002284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bac0cb050 0x7f5b98007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.086+0000 7f5bb1d46640 1 -- 172.21.15.38:0/861002284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bac0cb050 msgr2=0x7f5b98007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.086+0000 7f5bb1d46640 1 --2- 172.21.15.38:0/861002284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bac0cb050 0x7f5b98007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.086+0000 7f5bb1d46640 1 -- 172.21.15.38:0/861002284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b98005b80 msgr2=0x7f5b98005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.086+0000 7f5bb1d46640 1 --2- 172.21.15.38:0/861002284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b98005b80 0x7f5b98005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.086+0000 7f5bb1d46640 1 -- 172.21.15.38:0/861002284 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b98005730 con 0x7f5b980069d0 2023-12-22T08:52:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.087+0000 7f5bb1d46640 1 --2- 172.21.15.38:0/861002284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b980069d0 0x7f5b98006e50 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c009ae0 tx=0x7f5b98007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc2e0ddb368b57b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.088+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c005990 con 0x7f5b980069d0 2023-12-22T08:52:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.088+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9c005af0 con 0x7f5b980069d0 2023-12-22T08:52:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.088+0000 7f5bb1545640 1 -- 172.21.15.38:0/861002284 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c005ea0 con 0x7f5b980069d0 2023-12-22T08:52:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.088+0000 7f5bb47ab640 1 -- 172.21.15.38:0/861002284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b980069d0 msgr2=0x7f5b98006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.088+0000 7f5bb47ab640 1 --2- 172.21.15.38:0/861002284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b980069d0 0x7f5b98006e50 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c009ae0 tx=0x7f5b98007a00 comp rx=0 tx=0).stop 2023-12-22T08:52:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.088+0000 7f5bb2d48640 1 -- 172.21.15.38:0/861002284 reap_dead start 2023-12-22T08:52:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.088+0000 7f5bb47ab640 1 -- 172.21.15.38:0/861002284 shutdown_connections 2023-12-22T08:52:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.088+0000 7f5bb47ab640 1 -- 172.21.15.38:0/861002284 >> 172.21.15.38:0/861002284 conn(0x7f5bac0cba10 msgr2=0x7f5bac0cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.088+0000 7f5bb47ab640 1 -- 172.21.15.38:0/861002284 shutdown_connections 2023-12-22T08:52:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.088+0000 7f5bb47ab640 1 -- 172.21.15.38:0/861002284 wait complete. 2023-12-22T08:52:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.090+0000 7f5bb47ab640 1 Processor -- start 2023-12-22T08:52:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.090+0000 7f5bb47ab640 1 -- start start 2023-12-22T08:52:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.091+0000 7f5bb47ab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b980069d0 0x7f5bac0acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb47ab640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bac0c88c0 0x7f5bac0c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb47ab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bac0c73a0 0x7f5bac149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb47ab640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac0c8430 con 0x7f5bac0c73a0 2023-12-22T08:52:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb47ab640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac0c7820 con 0x7f5b980069d0 2023-12-22T08:52:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb47ab640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bac0c7b00 con 0x7f5bac0c88c0 2023-12-22T08:52:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb2d48640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bac0c73a0 0x7f5bac149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb2d48640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bac0c73a0 0x7f5bac149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34610/0 (socket says 172.21.15.38:34610) 2023-12-22T08:52:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb2d48640 1 -- 172.21.15.38:0/1361515366 learned_addr learned my addr 172.21.15.38:0/1361515366 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb2547640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b980069d0 0x7f5bac0acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb1d46640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bac0c88c0 0x7f5bac0c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb2d48640 1 -- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bac0c88c0 msgr2=0x7f5bac0c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb2d48640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bac0c88c0 0x7f5bac0c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb2d48640 1 -- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b980069d0 msgr2=0x7f5bac0acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.092+0000 7f5bb2d48640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b980069d0 0x7f5bac0acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.093+0000 7f5bb2d48640 1 -- 172.21.15.38:0/1361515366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac0c7de0 con 0x7f5bac0c73a0 2023-12-22T08:52:54.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.093+0000 7f5bb2d48640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bac0c73a0 0x7f5bac149860 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f5bac06ce20 tx=0x7f5ba400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.093+0000 7f5ba2ffd640 1 -- 172.21.15.38:0/1361515366 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4007440 con 0x7f5bac0c73a0 2023-12-22T08:52:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.093+0000 7f5ba2ffd640 1 -- 172.21.15.38:0/1361515366 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba40075a0 con 0x7f5bac0c73a0 2023-12-22T08:52:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.093+0000 7f5ba2ffd640 1 -- 172.21.15.38:0/1361515366 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4004a20 con 0x7f5bac0c73a0 2023-12-22T08:52:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.093+0000 7f5bb47ab640 1 -- 172.21.15.38:0/1361515366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bac0c80c0 con 0x7f5bac0c73a0 2023-12-22T08:52:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.093+0000 7f5bb47ab640 1 -- 172.21.15.38:0/1361515366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bac0ad270 con 0x7f5bac0c73a0 2023-12-22T08:52:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.095+0000 7f5bb47ab640 1 -- 172.21.15.38:0/1361515366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bac061910 con 0x7f5bac0c73a0 2023-12-22T08:52:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.095+0000 7f5ba2ffd640 1 -- 172.21.15.38:0/1361515366 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5ba4004b80 con 0x7f5bac0c73a0 2023-12-22T08:52:54.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.096+0000 7f5ba2ffd640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b9006a430 0x7f5b9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.096+0000 7f5ba2ffd640 1 -- 172.21.15.38:0/1361515366 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5ba4088180 con 0x7f5bac0c73a0 2023-12-22T08:52:54.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.097+0000 7f5bb2547640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b9006a430 0x7f5b9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.098+0000 7f5bb2547640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b9006a430 0x7f5b9006c8f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8008330 tx=0x7f5ba800a040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:54.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.101+0000 7f5ba2ffd640 1 -- 172.21.15.38:0/1361515366 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5ba4053a70 con 0x7f5bac0c73a0 2023-12-22T08:52:54.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.301+0000 7f5bb47ab640 1 -- 172.21.15.38:0/1361515366 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5bac0ad270 con 0x7f5bac0c73a0 2023-12-22T08:52:54.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.310+0000 7f5ba2ffd640 1 -- 172.21.15.38:0/1361515366 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5bac0ad270 con 0x7f5bac0c73a0 2023-12-22T08:52:54.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.312+0000 7f5bb47ab640 1 -- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b9006a430 msgr2=0x7f5b9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:54.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.312+0000 7f5bb47ab640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b9006a430 0x7f5b9006c8f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8008330 tx=0x7f5ba800a040 comp rx=0 tx=0).stop 2023-12-22T08:52:54.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.312+0000 7f5bb47ab640 1 -- 172.21.15.38:0/1361515366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bac0c73a0 msgr2=0x7f5bac149860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:54.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.312+0000 7f5bb47ab640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bac0c73a0 0x7f5bac149860 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f5bac06ce20 tx=0x7f5ba400d9d0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.313+0000 7f5bb47ab640 1 -- 172.21.15.38:0/1361515366 shutdown_connections 2023-12-22T08:52:54.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.313+0000 7f5bb47ab640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5b9006a430 0x7f5b9006c8f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.313+0000 7f5bb47ab640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bac0c73a0 0x7f5bac149860 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.313+0000 7f5bb47ab640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bac0c88c0 0x7f5bac0c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.313+0000 7f5bb47ab640 1 --2- 172.21.15.38:0/1361515366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b980069d0 0x7f5bac0acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.313+0000 7f5bb47ab640 1 -- 172.21.15.38:0/1361515366 >> 172.21.15.38:0/1361515366 conn(0x7f5bac0cba10 msgr2=0x7f5bac0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:54.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.313+0000 7f5bb47ab640 1 -- 172.21.15.38:0/1361515366 shutdown_connections 2023-12-22T08:52:54.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.313+0000 7f5bb47ab640 1 -- 172.21.15.38:0/1361515366 wait complete. 2023-12-22T08:52:54.334 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-12-22T08:52:54.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.544+0000 7f5f3028f640 1 Processor -- start 2023-12-22T08:52:54.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.545+0000 7f5f3028f640 1 -- start start 2023-12-22T08:52:54.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.546+0000 7f5f3028f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5f280b2050 0x7f5f280b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.546+0000 7f5f3028f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f28070800 0x7f5f28070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.546+0000 7f5f3028f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f281450f0 con 0x7f5f28144d10 2023-12-22T08:52:54.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.546+0000 7f5f3028f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f280cc840 con 0x7f5f280b2050 2023-12-22T08:52:54.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.546+0000 7f5f3028f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f280ce010 con 0x7f5f28070800 2023-12-22T08:52:54.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.547+0000 7f5f2e02b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5f28144d10 0x7f5f280cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37852/0 (socket says 172.21.15.38:37852) 2023-12-22T08:52:54.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.547+0000 7f5f2e02b640 1 -- 172.21.15.38:0/3957032725 learned_addr learned my addr 172.21.15.38:0/3957032725 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:54.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.547+0000 7f5f2d82a640 1 --2- 172.21.15.38:0/3957032725 >> v2:172.21.15.89:3300/0 conn(0x7f5f280b2050 0x7f5f280b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.547+0000 7f5f2e82c640 1 --2- 172.21.15.38:0/3957032725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f28070800 0x7f5f28070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.547+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894709104 0 0) 0x7f5f281450f0 con 0x7f5f28144d10 2023-12-22T08:52:54.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.547+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f10003520 con 0x7f5f28144d10 2023-12-22T08:52:54.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.547+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3136368991 0 0) 0x7f5f10003520 con 0x7f5f28144d10 2023-12-22T08:52:54.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f28070800 msgr2=0x7f5f28070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:54.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d029640 1 --2- 172.21.15.38:0/3957032725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f28070800 0x7f5f28070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 >> v2:172.21.15.89:3300/0 conn(0x7f5f280b2050 msgr2=0x7f5f280b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:54.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d029640 1 --2- 172.21.15.38:0/3957032725 >> v2:172.21.15.89:3300/0 conn(0x7f5f280b2050 0x7f5f280b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f280b29f0 con 0x7f5f28144d10 2023-12-22T08:52:54.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f5f18001a10 con 0x7f5f28144d10 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 >> v1:172.21.15.38:6789/0 conn(0x7f5f28144d10 legacy=0x7f5f280cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d029640 1 --2- 172.21.15.38:0/3957032725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f28070800 0x7f5f10003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d029640 1 --2- 172.21.15.38:0/3957032725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f10003f40 0x7f5f100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d029640 1 --2- 172.21.15.38:0/3957032725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f10004d00 0x7f5f10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f280cc840 con 0x7f5f10003f40 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f280ce010 con 0x7f5f10004d00 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1000b980 con 0x7f5f28070800 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2d82a640 1 --2- 172.21.15.38:0/3957032725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f10003f40 0x7f5f100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.548+0000 7f5f2e82c640 1 --2- 172.21.15.38:0/3957032725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f10004d00 0x7f5f10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.549+0000 7f5f2e02b640 1 --2- 172.21.15.38:0/3957032725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f28070800 0x7f5f10003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.549+0000 7f5f2d82a640 1 -- 172.21.15.38:0/3957032725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f28070800 msgr2=0x7f5f10003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.549+0000 7f5f2d82a640 1 --2- 172.21.15.38:0/3957032725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f28070800 0x7f5f10003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.549+0000 7f5f2d82a640 1 -- 172.21.15.38:0/3957032725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f10004d00 msgr2=0x7f5f10005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:54.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.549+0000 7f5f2d82a640 1 --2- 172.21.15.38:0/3957032725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f10004d00 0x7f5f10005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.549+0000 7f5f2d82a640 1 -- 172.21.15.38:0/3957032725 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f10003520 con 0x7f5f10003f40 2023-12-22T08:52:54.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.549+0000 7f5f2e82c640 1 --2- 172.21.15.38:0/3957032725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f10004d00 0x7f5f10005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:54.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.550+0000 7f5f2d82a640 1 --2- 172.21.15.38:0/3957032725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f10003f40 0x7f5f100047c0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009af0 tx=0x7f5f100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419da89424d7c0af server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:54.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.550+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c02c710 con 0x7f5f10003f40 2023-12-22T08:52:54.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.550+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c02c870 con 0x7f5f10003f40 2023-12-22T08:52:54.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.550+0000 7f5f2d029640 1 -- 172.21.15.38:0/3957032725 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c02cc00 con 0x7f5f10003f40 2023-12-22T08:52:54.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.551+0000 7f5f3028f640 1 -- 172.21.15.38:0/3957032725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f10003f40 msgr2=0x7f5f100047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:54.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.551+0000 7f5f3028f640 1 --2- 172.21.15.38:0/3957032725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f10003f40 0x7f5f100047c0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009af0 tx=0x7f5f100057f0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.551+0000 7f5f2e82c640 1 -- 172.21.15.38:0/3957032725 reap_dead start 2023-12-22T08:52:54.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.551+0000 7f5f3028f640 1 -- 172.21.15.38:0/3957032725 shutdown_connections 2023-12-22T08:52:54.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.551+0000 7f5f3028f640 1 -- 172.21.15.38:0/3957032725 >> 172.21.15.38:0/3957032725 conn(0x7f5f280cf070 msgr2=0x7f5f280cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:54.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.551+0000 7f5f3028f640 1 -- 172.21.15.38:0/3957032725 shutdown_connections 2023-12-22T08:52:54.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.551+0000 7f5f3028f640 1 -- 172.21.15.38:0/3957032725 wait complete. 2023-12-22T08:52:54.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.553+0000 7f5f3028f640 1 Processor -- start 2023-12-22T08:52:54.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.553+0000 7f5f3028f640 1 -- start start 2023-12-22T08:52:54.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.554+0000 7f5f3028f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f10003f40 0x7f5f2806cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.554+0000 7f5f3028f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f28157000 0x7f5f2806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.554+0000 7f5f3028f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f280af290 0x7f5f280af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.554+0000 7f5f3028f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f28158410 con 0x7f5f10003f40 2023-12-22T08:52:54.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.554+0000 7f5f3028f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f28157890 con 0x7f5f28157000 2023-12-22T08:52:54.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.554+0000 7f5f3028f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f28157b70 con 0x7f5f280af290 2023-12-22T08:52:54.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.554+0000 7f5f2e02b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f10003f40 0x7f5f2806cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.554+0000 7f5f2e02b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f10003f40 0x7f5f2806cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34620/0 (socket says 172.21.15.38:34620) 2023-12-22T08:52:54.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.554+0000 7f5f2e02b640 1 -- 172.21.15.38:0/3958025717 learned_addr learned my addr 172.21.15.38:0/3958025717 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:54.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.555+0000 7f5f2e02b640 1 -- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f280af290 msgr2=0x7f5f280af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:54.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.555+0000 7f5f2e02b640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f280af290 0x7f5f280af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.555+0000 7f5f2d82a640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f28157000 0x7f5f2806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.555+0000 7f5f2e02b640 1 -- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f28157000 msgr2=0x7f5f2806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:54.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.555+0000 7f5f2e02b640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f28157000 0x7f5f2806d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.555+0000 7f5f2e02b640 1 -- 172.21.15.38:0/3958025717 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28157e50 con 0x7f5f10003f40 2023-12-22T08:52:54.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.555+0000 7f5f2d82a640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f28157000 0x7f5f2806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:54.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.555+0000 7f5f2e02b640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f10003f40 0x7f5f2806cf10 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f5f18001fe0 tx=0x7f5f1800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:54.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.555+0000 7f5f26ffd640 1 -- 172.21.15.38:0/3958025717 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18004b60 con 0x7f5f10003f40 2023-12-22T08:52:54.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.555+0000 7f5f26ffd640 1 -- 172.21.15.38:0/3958025717 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f18004cc0 con 0x7f5f10003f40 2023-12-22T08:52:54.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.555+0000 7f5f26ffd640 1 -- 172.21.15.38:0/3958025717 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f180072d0 con 0x7f5f10003f40 2023-12-22T08:52:54.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.555+0000 7f5f3028f640 1 -- 172.21.15.38:0/3958025717 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f28158130 con 0x7f5f10003f40 2023-12-22T08:52:54.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.556+0000 7f5f3028f640 1 -- 172.21.15.38:0/3958025717 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f28157660 con 0x7f5f10003f40 2023-12-22T08:52:54.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.557+0000 7f5f3028f640 1 -- 172.21.15.38:0/3958025717 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f28138480 con 0x7f5f10003f40 2023-12-22T08:52:54.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.558+0000 7f5f26ffd640 1 -- 172.21.15.38:0/3958025717 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5f18007430 con 0x7f5f10003f40 2023-12-22T08:52:54.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.559+0000 7f5f26ffd640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5f1406a430 0x7f5f1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:54.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.559+0000 7f5f26ffd640 1 -- 172.21.15.38:0/3958025717 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5f18088550 con 0x7f5f10003f40 2023-12-22T08:52:54.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.560+0000 7f5f2d82a640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5f1406a430 0x7f5f1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:54.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.561+0000 7f5f2d82a640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5f1406a430 0x7f5f1406c8f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c036000 tx=0x7f5f1c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:54.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.563+0000 7f5f26ffd640 1 -- 172.21.15.38:0/3958025717 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5f28138480 con 0x7f5f10003f40 2023-12-22T08:52:54.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.826+0000 7f5f3028f640 1 -- 172.21.15.38:0/3958025717 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f5f28138480 con 0x7f5f10003f40 2023-12-22T08:52:54.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.864+0000 7f5f26ffd640 1 -- 172.21.15.38:0/3958025717 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v618) v1 ==== 131+0+0 (secure 0 0 0) 0x7f5f28138480 con 0x7f5f10003f40 2023-12-22T08:52:54.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.867+0000 7f5f3028f640 1 -- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5f1406a430 msgr2=0x7f5f1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:54.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.867+0000 7f5f3028f640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5f1406a430 0x7f5f1406c8f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c036000 tx=0x7f5f1c030000 comp rx=0 tx=0).stop 2023-12-22T08:52:54.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.867+0000 7f5f3028f640 1 -- 172.21.15.38:0/3958025717 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f10003f40 msgr2=0x7f5f2806cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:54.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.867+0000 7f5f3028f640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f10003f40 0x7f5f2806cf10 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f5f18001fe0 tx=0x7f5f1800b4a0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.867+0000 7f5f3028f640 1 -- 172.21.15.38:0/3958025717 shutdown_connections 2023-12-22T08:52:54.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.867+0000 7f5f3028f640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5f280af290 0x7f5f280af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.867+0000 7f5f3028f640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5f28157000 0x7f5f2806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.867+0000 7f5f3028f640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5f1406a430 0x7f5f1406c8f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.867+0000 7f5f3028f640 1 --2- 172.21.15.38:0/3958025717 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f10003f40 0x7f5f2806cf10 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:54.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.867+0000 7f5f3028f640 1 -- 172.21.15.38:0/3958025717 >> 172.21.15.38:0/3958025717 conn(0x7f5f280cf070 msgr2=0x7f5f280b3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:54.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.867+0000 7f5f3028f640 1 -- 172.21.15.38:0/3958025717 shutdown_connections 2023-12-22T08:52:54.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:54.867+0000 7f5f3028f640 1 -- 172.21.15.38:0/3958025717 wait complete. 2023-12-22T08:52:54.886 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-12-22T08:52:54.887 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-12-22T08:52:54.887 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:52:55.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.094+0000 7f6517fff640 1 Processor -- start 2023-12-22T08:52:55.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.095+0000 7f6517fff640 1 -- start start 2023-12-22T08:52:55.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.096+0000 7f6517fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f651815d480 0x7f65180d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:55.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.096+0000 7f6517fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6518161650 0x7f65180cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:55.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.096+0000 7f6517fff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651815e870 con 0x7f65180a5140 2023-12-22T08:52:55.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.096+0000 7f6517fff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65180d1eb0 con 0x7f6518161650 2023-12-22T08:52:55.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.096+0000 7f6517fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65180d2150 con 0x7f651815d480 2023-12-22T08:52:55.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.097+0000 7f65177fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6518161650 0x7f65180cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:55.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.097+0000 7f650ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f65180a5140 0x7f6518160f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37868/0 (socket says 172.21.15.38:37868) 2023-12-22T08:52:55.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.097+0000 7f650ffff640 1 -- 172.21.15.38:0/3487885753 learned_addr learned my addr 172.21.15.38:0/3487885753 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:55.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.097+0000 7f6516ffd640 1 --2- 172.21.15.38:0/3487885753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f651815d480 0x7f65180d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:55.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.097+0000 7f65167fc640 1 -- 172.21.15.38:0/3487885753 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318206494 0 0) 0x7f651815e870 con 0x7f65180a5140 2023-12-22T08:52:55.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.097+0000 7f65167fc640 1 -- 172.21.15.38:0/3487885753 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6504003520 con 0x7f65180a5140 2023-12-22T08:52:55.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.097+0000 7f65177fe640 1 -- 172.21.15.38:0/3487885753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f651815d480 msgr2=0x7f65180d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:55.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.097+0000 7f65177fe640 1 --2- 172.21.15.38:0/3487885753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f651815d480 0x7f65180d2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.097+0000 7f65177fe640 1 -- 172.21.15.38:0/3487885753 >> v1:172.21.15.38:6789/0 conn(0x7f65180a5140 legacy=0x7f6518160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:55.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.097+0000 7f65177fe640 1 -- 172.21.15.38:0/3487885753 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65180d2430 con 0x7f6518161650 2023-12-22T08:52:55.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.098+0000 7f65177fe640 1 --2- 172.21.15.38:0/3487885753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6518161650 0x7f65180cfc60 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f6510009d90 tx=0x7f651002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f650cf629044fc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:55.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.099+0000 7f65167fc640 1 -- 172.21.15.38:0/3487885753 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651002cbc0 con 0x7f6518161650 2023-12-22T08:52:55.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.099+0000 7f65167fc640 1 -- 172.21.15.38:0/3487885753 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651002cd20 con 0x7f6518161650 2023-12-22T08:52:55.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.099+0000 7f65167fc640 1 -- 172.21.15.38:0/3487885753 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6510034640 con 0x7f6518161650 2023-12-22T08:52:55.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.099+0000 7f6517fff640 1 -- 172.21.15.38:0/3487885753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6518161650 msgr2=0x7f65180cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:55.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.099+0000 7f6517fff640 1 --2- 172.21.15.38:0/3487885753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6518161650 0x7f65180cfc60 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f6510009d90 tx=0x7f651002be10 comp rx=0 tx=0).stop 2023-12-22T08:52:55.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.100+0000 7f6517fff640 1 -- 172.21.15.38:0/3487885753 shutdown_connections 2023-12-22T08:52:55.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.100+0000 7f6517fff640 1 --2- 172.21.15.38:0/3487885753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6518161650 0x7f65180cfc60 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.100+0000 7f6517fff640 1 --2- 172.21.15.38:0/3487885753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f651815d480 0x7f65180d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.100+0000 7f6517fff640 1 -- 172.21.15.38:0/3487885753 >> 172.21.15.38:0/3487885753 conn(0x7f651806ced0 msgr2=0x7f6518071260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:55.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.100+0000 7f6517fff640 1 -- 172.21.15.38:0/3487885753 shutdown_connections 2023-12-22T08:52:55.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.100+0000 7f6517fff640 1 -- 172.21.15.38:0/3487885753 wait complete. 2023-12-22T08:52:55.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.101+0000 7f6517fff640 1 Processor -- start 2023-12-22T08:52:55.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.101+0000 7f6517fff640 1 -- start start 2023-12-22T08:52:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.102+0000 7f6517fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65180a5140 0x7f651815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.102+0000 7f6517fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f651815d480 0x7f65181561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.102+0000 7f6517fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6518161650 0x7f65181f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.102+0000 7f6517fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6518154e60 con 0x7f6518161650 2023-12-22T08:52:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.102+0000 7f6517fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6518155100 con 0x7f65180a5140 2023-12-22T08:52:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.102+0000 7f6517fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65181553e0 con 0x7f651815d480 2023-12-22T08:52:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.103+0000 7f65177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6518161650 0x7f65181f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.103+0000 7f65177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6518161650 0x7f65181f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34640/0 (socket says 172.21.15.38:34640) 2023-12-22T08:52:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.103+0000 7f65177fe640 1 -- 172.21.15.38:0/4049711416 learned_addr learned my addr 172.21.15.38:0/4049711416 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.103+0000 7f6516ffd640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65180a5140 0x7f651815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.103+0000 7f650ffff640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f651815d480 0x7f65181561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.103+0000 7f65177fe640 1 -- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f651815d480 msgr2=0x7f65181561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:55.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.103+0000 7f65177fe640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f651815d480 0x7f65181561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.103+0000 7f65177fe640 1 -- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65180a5140 msgr2=0x7f651815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:55.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.103+0000 7f65177fe640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65180a5140 0x7f651815bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.103+0000 7f65177fe640 1 -- 172.21.15.38:0/4049711416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6510009a70 con 0x7f6518161650 2023-12-22T08:52:55.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.104+0000 7f65177fe640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6518161650 0x7f65181f1e10 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f6510009eb0 tx=0x7f6510004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:55.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.104+0000 7f6514ff9640 1 -- 172.21.15.38:0/4049711416 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651003e610 con 0x7f6518161650 2023-12-22T08:52:55.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.104+0000 7f6514ff9640 1 -- 172.21.15.38:0/4049711416 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651002ce90 con 0x7f6518161650 2023-12-22T08:52:55.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.104+0000 7f6514ff9640 1 -- 172.21.15.38:0/4049711416 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651003e9f0 con 0x7f6518161650 2023-12-22T08:52:55.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.104+0000 7f6517fff640 1 -- 172.21.15.38:0/4049711416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65181556c0 con 0x7f6518161650 2023-12-22T08:52:55.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.104+0000 7f6517fff640 1 -- 172.21.15.38:0/4049711416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6518155c80 con 0x7f6518161650 2023-12-22T08:52:55.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.105+0000 7f6517fff640 1 -- 172.21.15.38:0/4049711416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6518061910 con 0x7f6518161650 2023-12-22T08:52:55.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.106+0000 7f6514ff9640 1 -- 172.21.15.38:0/4049711416 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f651003b050 con 0x7f6518161650 2023-12-22T08:52:55.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.107+0000 7f6514ff9640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f64f806a430 0x7f64f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:55.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.107+0000 7f6514ff9640 1 -- 172.21.15.38:0/4049711416 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f65100aa770 con 0x7f6518161650 2023-12-22T08:52:55.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.107+0000 7f6516ffd640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f64f806a430 0x7f64f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:55.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.109+0000 7f6516ffd640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f64f806a430 0x7f64f806c8f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6508009ad0 tx=0x7f6508008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:55.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.111+0000 7f6514ff9640 1 -- 172.21.15.38:0/4049711416 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6510075fc0 con 0x7f6518161650 2023-12-22T08:52:55.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.303+0000 7f6517fff640 1 -- 172.21.15.38:0/4049711416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6518071e30 con 0x7f6518161650 2023-12-22T08:52:55.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.304+0000 7f6514ff9640 1 -- 172.21.15.38:0/4049711416 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+12481 (secure 0 0 0) 0x7f6510009450 con 0x7f6518161650 2023-12-22T08:52:55.305 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:52:55.306 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":181,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:52:53.832793+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6834/1387101372":"2023-12-23T08:52:50.804874+0000","172.21.15.38:6832/1387101372":"2023-12-23T08:52:50.804874+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:52:55.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.307+0000 7f6517fff640 1 -- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f64f806a430 msgr2=0x7f64f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:55.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.307+0000 7f6517fff640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f64f806a430 0x7f64f806c8f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6508009ad0 tx=0x7f6508008040 comp rx=0 tx=0).stop 2023-12-22T08:52:55.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.307+0000 7f6517fff640 1 -- 172.21.15.38:0/4049711416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6518161650 msgr2=0x7f65181f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:55.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.307+0000 7f6517fff640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6518161650 0x7f65181f1e10 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f6510009eb0 tx=0x7f6510004a40 comp rx=0 tx=0).stop 2023-12-22T08:52:55.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.307+0000 7f6517fff640 1 -- 172.21.15.38:0/4049711416 shutdown_connections 2023-12-22T08:52:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.307+0000 7f6517fff640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f64f806a430 0x7f64f806c8f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.307+0000 7f6517fff640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6518161650 0x7f65181f1e10 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.307+0000 7f6517fff640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f651815d480 0x7f65181561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.307+0000 7f6517fff640 1 --2- 172.21.15.38:0/4049711416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65180a5140 0x7f651815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.307+0000 7f6517fff640 1 -- 172.21.15.38:0/4049711416 >> 172.21.15.38:0/4049711416 conn(0x7f651806ced0 msgr2=0x7f6518071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.308+0000 7f6517fff640 1 -- 172.21.15.38:0/4049711416 shutdown_connections 2023-12-22T08:52:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.308+0000 7f6517fff640 1 -- 172.21.15.38:0/4049711416 wait complete. 2023-12-22T08:52:55.328 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:52:55.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:52:55.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.547+0000 7fd88dd55640 1 Processor -- start 2023-12-22T08:52:55.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.547+0000 7fd88dd55640 1 -- start start 2023-12-22T08:52:55.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.549+0000 7fd88dd55640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd88815e870 0x7fd8880ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:55.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.549+0000 7fd88dd55640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd88815ec50 0x7fd888070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:55.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.549+0000 7fd88dd55640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8880ce4b0 con 0x7fd888071310 2023-12-22T08:52:55.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.549+0000 7fd88dd55640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88815fea0 con 0x7fd88815e870 2023-12-22T08:52:55.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.549+0000 7fd88dd55640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8880cdb80 con 0x7fd88815ec50 2023-12-22T08:52:55.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.549+0000 7fd8877fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd88815e870 0x7fd8880ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:55.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.549+0000 7fd887fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd888071310 0x7fd88806f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37870/0 (socket says 172.21.15.38:37870) 2023-12-22T08:52:55.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.549+0000 7fd887fff640 1 -- 172.21.15.38:0/2543158446 learned_addr learned my addr 172.21.15.38:0/2543158446 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:55.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.550+0000 7fd87effd640 1 --2- 172.21.15.38:0/2543158446 >> v2:172.21.15.89:3300/0 conn(0x7fd88815ec50 0x7fd888070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:55.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.550+0000 7fd886ffd640 1 -- 172.21.15.38:0/2543158446 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435315910 0 0) 0x7fd8880ce4b0 con 0x7fd888071310 2023-12-22T08:52:55.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.550+0000 7fd886ffd640 1 -- 172.21.15.38:0/2543158446 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd874003520 con 0x7fd888071310 2023-12-22T08:52:55.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.550+0000 7fd8877fe640 1 -- 172.21.15.38:0/2543158446 >> v2:172.21.15.89:3300/0 conn(0x7fd88815ec50 msgr2=0x7fd888070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:55.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.550+0000 7fd8877fe640 1 --2- 172.21.15.38:0/2543158446 >> v2:172.21.15.89:3300/0 conn(0x7fd88815ec50 0x7fd888070770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.550+0000 7fd8877fe640 1 -- 172.21.15.38:0/2543158446 >> v1:172.21.15.38:6789/0 conn(0x7fd888071310 legacy=0x7fd88806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:55.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.550+0000 7fd8877fe640 1 -- 172.21.15.38:0/2543158446 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880cde60 con 0x7fd88815e870 2023-12-22T08:52:55.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.551+0000 7fd8877fe640 1 --2- 172.21.15.38:0/2543158446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd88815e870 0x7fd8880ce940 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fd888067750 tx=0x7fd87802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d04a6b2e4be539 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:55.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.552+0000 7fd886ffd640 1 -- 172.21.15.38:0/2543158446 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87802e070 con 0x7fd88815e870 2023-12-22T08:52:55.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.552+0000 7fd886ffd640 1 -- 172.21.15.38:0/2543158446 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8780315a0 con 0x7fd88815e870 2023-12-22T08:52:55.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.552+0000 7fd886ffd640 1 -- 172.21.15.38:0/2543158446 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878031910 con 0x7fd88815e870 2023-12-22T08:52:55.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.552+0000 7fd88dd55640 1 -- 172.21.15.38:0/2543158446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd88815e870 msgr2=0x7fd8880ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:55.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.552+0000 7fd88dd55640 1 --2- 172.21.15.38:0/2543158446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd88815e870 0x7fd8880ce940 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fd888067750 tx=0x7fd87802b840 comp rx=0 tx=0).stop 2023-12-22T08:52:55.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.553+0000 7fd88dd55640 1 -- 172.21.15.38:0/2543158446 shutdown_connections 2023-12-22T08:52:55.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.553+0000 7fd88dd55640 1 --2- 172.21.15.38:0/2543158446 >> v2:172.21.15.89:3300/0 conn(0x7fd88815ec50 0x7fd888070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.553+0000 7fd88dd55640 1 --2- 172.21.15.38:0/2543158446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd88815e870 0x7fd8880ce940 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.553+0000 7fd88dd55640 1 -- 172.21.15.38:0/2543158446 >> 172.21.15.38:0/2543158446 conn(0x7fd8880b20c0 msgr2=0x7fd8880b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:55.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.553+0000 7fd88dd55640 1 -- 172.21.15.38:0/2543158446 shutdown_connections 2023-12-22T08:52:55.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.553+0000 7fd88dd55640 1 -- 172.21.15.38:0/2543158446 wait complete. 2023-12-22T08:52:55.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.554+0000 7fd88dd55640 1 Processor -- start 2023-12-22T08:52:55.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.555+0000 7fd88dd55640 1 -- start start 2023-12-22T08:52:55.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.555+0000 7fd88dd55640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd888071310 0x7fd8881555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:55.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd88dd55640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd88815e870 0x7fd888156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:55.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd88dd55640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd88815ec50 0x7fd888148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:55.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd88dd55640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880ac9a0 con 0x7fd888071310 2023-12-22T08:52:55.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd88dd55640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88806d7e0 con 0x7fd88815e870 2023-12-22T08:52:55.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd88dd55640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88806dac0 con 0x7fd88815ec50 2023-12-22T08:52:55.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd8877fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd888071310 0x7fd8881555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:55.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd8877fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd888071310 0x7fd8881555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34654/0 (socket says 172.21.15.38:34654) 2023-12-22T08:52:55.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd8877fe640 1 -- 172.21.15.38:0/2014355627 learned_addr learned my addr 172.21.15.38:0/2014355627 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:55.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd8877fe640 1 -- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd88815ec50 msgr2=0x7fd888148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:55.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd87effd640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd88815e870 0x7fd888156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:55.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd887fff640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd88815ec50 0x7fd888148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:55.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd8877fe640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd88815ec50 0x7fd888148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd8877fe640 1 -- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd88815e870 msgr2=0x7fd888156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:55.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd8877fe640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd88815e870 0x7fd888156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd8877fe640 1 -- 172.21.15.38:0/2014355627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878009400 con 0x7fd888071310 2023-12-22T08:52:55.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd87effd640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd88815e870 0x7fd888156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:55.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.556+0000 7fd887fff640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd88815ec50 0x7fd888148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:55.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.557+0000 7fd8877fe640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd888071310 0x7fd8881555d0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fd87802b880 tx=0x7fd8780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:55.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.557+0000 7fd884ff9640 1 -- 172.21.15.38:0/2014355627 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878003810 con 0x7fd888071310 2023-12-22T08:52:55.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.557+0000 7fd884ff9640 1 -- 172.21.15.38:0/2014355627 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878040070 con 0x7fd888071310 2023-12-22T08:52:55.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.557+0000 7fd88dd55640 1 -- 172.21.15.38:0/2014355627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88806dda0 con 0x7fd888071310 2023-12-22T08:52:55.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.557+0000 7fd884ff9640 1 -- 172.21.15.38:0/2014355627 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878003b70 con 0x7fd888071310 2023-12-22T08:52:55.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.557+0000 7fd88dd55640 1 -- 172.21.15.38:0/2014355627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88806d400 con 0x7fd888071310 2023-12-22T08:52:55.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.559+0000 7fd88dd55640 1 -- 172.21.15.38:0/2014355627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd888061910 con 0x7fd888071310 2023-12-22T08:52:55.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.559+0000 7fd884ff9640 1 -- 172.21.15.38:0/2014355627 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd878003cd0 con 0x7fd888071310 2023-12-22T08:52:55.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.560+0000 7fd884ff9640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd86806a430 0x7fd86806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:55.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.561+0000 7fd884ff9640 1 -- 172.21.15.38:0/2014355627 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd878042070 con 0x7fd888071310 2023-12-22T08:52:55.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.561+0000 7fd87effd640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd86806a430 0x7fd86806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:55.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.562+0000 7fd87effd640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd86806a430 0x7fd86806c8f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd8880ae640 tx=0x7fd87000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:55.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.565+0000 7fd884ff9640 1 -- 172.21.15.38:0/2014355627 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd878076730 con 0x7fd888071310 2023-12-22T08:52:55.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.759+0000 7fd88dd55640 1 -- 172.21.15.38:0/2014355627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8880b2ce0 con 0x7fd888071310 2023-12-22T08:52:55.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.760+0000 7fd884ff9640 1 -- 172.21.15.38:0/2014355627 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v181) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd878006e10 con 0x7fd888071310 2023-12-22T08:52:55.761 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:52:55.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.763+0000 7fd88dd55640 1 -- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd86806a430 msgr2=0x7fd86806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:55.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.763+0000 7fd88dd55640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd86806a430 0x7fd86806c8f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd8880ae640 tx=0x7fd87000b040 comp rx=0 tx=0).stop 2023-12-22T08:52:55.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.763+0000 7fd88dd55640 1 -- 172.21.15.38:0/2014355627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd888071310 msgr2=0x7fd8881555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:55.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.763+0000 7fd88dd55640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd888071310 0x7fd8881555d0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fd87802b880 tx=0x7fd8780046c0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.763+0000 7fd88dd55640 1 -- 172.21.15.38:0/2014355627 shutdown_connections 2023-12-22T08:52:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.763+0000 7fd88dd55640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd88815ec50 0x7fd888148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.763+0000 7fd88dd55640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd88815e870 0x7fd888156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.763+0000 7fd88dd55640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd86806a430 0x7fd86806c8f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.763+0000 7fd88dd55640 1 --2- 172.21.15.38:0/2014355627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd888071310 0x7fd8881555d0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.763+0000 7fd88dd55640 1 -- 172.21.15.38:0/2014355627 >> 172.21.15.38:0/2014355627 conn(0x7fd8880b20c0 msgr2=0x7fd888157e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.763+0000 7fd88dd55640 1 -- 172.21.15.38:0/2014355627 shutdown_connections 2023-12-22T08:52:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:55.763+0000 7fd88dd55640 1 -- 172.21.15.38:0/2014355627 wait complete. 2023-12-22T08:52:55.783 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-12-22T08:52:56.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.007+0000 7f7a665ef640 1 Processor -- start 2023-12-22T08:52:56.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.007+0000 7f7a665ef640 1 -- start start 2023-12-22T08:52:56.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.009+0000 7f7a665ef640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a60157980 0x7f7a6015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:56.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.009+0000 7f7a665ef640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7a6006d640 0x7f7a600d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:56.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.009+0000 7f7a665ef640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a600d1520 con 0x7f7a600b3ff0 2023-12-22T08:52:56.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.009+0000 7f7a665ef640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a600d1800 con 0x7f7a6006d640 2023-12-22T08:52:56.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.009+0000 7f7a665ef640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a600d1ae0 con 0x7f7a60157980 2023-12-22T08:52:56.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.010+0000 7f7a65dee640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7a6006d640 0x7f7a600d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:56.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.010+0000 7f7a64dec640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7a600b3ff0 0x7f7a6006cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37884/0 (socket says 172.21.15.38:37884) 2023-12-22T08:52:56.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.010+0000 7f7a64dec640 1 -- 172.21.15.38:0/2429412085 learned_addr learned my addr 172.21.15.38:0/2429412085 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:56.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.010+0000 7f7a655ed640 1 --2- 172.21.15.38:0/2429412085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a60157980 0x7f7a6015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:56.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.010+0000 7f7a65dee640 1 -- 172.21.15.38:0/2429412085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a60157980 msgr2=0x7f7a6015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:56.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.010+0000 7f7a65dee640 1 --2- 172.21.15.38:0/2429412085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a60157980 0x7f7a6015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:56.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.010+0000 7f7a65dee640 1 -- 172.21.15.38:0/2429412085 >> v1:172.21.15.38:6789/0 conn(0x7f7a600b3ff0 legacy=0x7f7a6006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:56.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.010+0000 7f7a65dee640 1 -- 172.21.15.38:0/2429412085 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a600d1dc0 con 0x7f7a6006d640 2023-12-22T08:52:56.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.011+0000 7f7a65dee640 1 --2- 172.21.15.38:0/2429412085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a6006d640 0x7f7a600d25c0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f7a580097a0 tx=0x7f7a5802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e59cfe7db5a83e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:56.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.012+0000 7f7a5ffff640 1 -- 172.21.15.38:0/2429412085 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5802d040 con 0x7f7a6006d640 2023-12-22T08:52:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.012+0000 7f7a5ffff640 1 -- 172.21.15.38:0/2429412085 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a58031810 con 0x7f7a6006d640 2023-12-22T08:52:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.012+0000 7f7a5ffff640 1 -- 172.21.15.38:0/2429412085 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a58031ba0 con 0x7f7a6006d640 2023-12-22T08:52:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.012+0000 7f7a665ef640 1 -- 172.21.15.38:0/2429412085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a6006d640 msgr2=0x7f7a600d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.012+0000 7f7a665ef640 1 --2- 172.21.15.38:0/2429412085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a6006d640 0x7f7a600d25c0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f7a580097a0 tx=0x7f7a5802b8b0 comp rx=0 tx=0).stop 2023-12-22T08:52:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.012+0000 7f7a665ef640 1 -- 172.21.15.38:0/2429412085 shutdown_connections 2023-12-22T08:52:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.012+0000 7f7a665ef640 1 --2- 172.21.15.38:0/2429412085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a6006d640 0x7f7a600d25c0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.012+0000 7f7a665ef640 1 --2- 172.21.15.38:0/2429412085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a60157980 0x7f7a6015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.012+0000 7f7a665ef640 1 -- 172.21.15.38:0/2429412085 >> 172.21.15.38:0/2429412085 conn(0x7f7a600d31f0 msgr2=0x7f7a600d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.012+0000 7f7a665ef640 1 -- 172.21.15.38:0/2429412085 shutdown_connections 2023-12-22T08:52:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.013+0000 7f7a665ef640 1 -- 172.21.15.38:0/2429412085 wait complete. 2023-12-22T08:52:56.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.014+0000 7f7a665ef640 1 Processor -- start 2023-12-22T08:52:56.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.015+0000 7f7a665ef640 1 -- start start 2023-12-22T08:52:56.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.015+0000 7f7a665ef640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a6006d640 0x7f7a6015a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:56.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a665ef640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a600b3ff0 0x7f7a60157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:56.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a665ef640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a60157980 0x7f7a6014a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:56.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a665ef640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a600b6750 con 0x7f7a600b3ff0 2023-12-22T08:52:56.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a665ef640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a60158800 con 0x7f7a60157980 2023-12-22T08:52:56.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a665ef640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a600b5db0 con 0x7f7a6006d640 2023-12-22T08:52:56.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a64dec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a600b3ff0 0x7f7a60157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:56.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a64dec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a600b3ff0 0x7f7a60157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34682/0 (socket says 172.21.15.38:34682) 2023-12-22T08:52:56.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a64dec640 1 -- 172.21.15.38:0/2450809915 learned_addr learned my addr 172.21.15.38:0/2450809915 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:56.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a655ed640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a6006d640 0x7f7a6015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a65dee640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a60157980 0x7f7a6014a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a64dec640 1 -- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a6006d640 msgr2=0x7f7a6015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a64dec640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a6006d640 0x7f7a6015a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a64dec640 1 -- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a60157980 msgr2=0x7f7a6014a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a64dec640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a60157980 0x7f7a6014a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.016+0000 7f7a64dec640 1 -- 172.21.15.38:0/2450809915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a58009400 con 0x7f7a600b3ff0 2023-12-22T08:52:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.017+0000 7f7a64dec640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a600b3ff0 0x7f7a60157f50 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400c4a0 tx=0x7f7a5400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.017+0000 7f7a5dffb640 1 -- 172.21.15.38:0/2450809915 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54005ce0 con 0x7f7a600b3ff0 2023-12-22T08:52:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.017+0000 7f7a5dffb640 1 -- 172.21.15.38:0/2450809915 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a54005e40 con 0x7f7a600b3ff0 2023-12-22T08:52:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.017+0000 7f7a5dffb640 1 -- 172.21.15.38:0/2450809915 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54007270 con 0x7f7a600b3ff0 2023-12-22T08:52:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.017+0000 7f7a665ef640 1 -- 172.21.15.38:0/2450809915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a600b6090 con 0x7f7a600b3ff0 2023-12-22T08:52:56.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.017+0000 7f7a665ef640 1 -- 172.21.15.38:0/2450809915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a60158490 con 0x7f7a600b3ff0 2023-12-22T08:52:56.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.018+0000 7f7a665ef640 1 -- 172.21.15.38:0/2450809915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a600b6890 con 0x7f7a600b3ff0 2023-12-22T08:52:56.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.019+0000 7f7a5dffb640 1 -- 172.21.15.38:0/2450809915 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7a540073d0 con 0x7f7a600b3ff0 2023-12-22T08:52:56.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.020+0000 7f7a5dffb640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7a4c06a430 0x7f7a4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:56.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.020+0000 7f7a5dffb640 1 -- 172.21.15.38:0/2450809915 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7a54087bd0 con 0x7f7a600b3ff0 2023-12-22T08:52:56.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.021+0000 7f7a655ed640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7a4c06a430 0x7f7a4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:56.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.022+0000 7f7a655ed640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7a4c06a430 0x7f7a4c06c8f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009e90 tx=0x7f7a5000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:56.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.025+0000 7f7a5dffb640 1 -- 172.21.15.38:0/2450809915 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7a600b6890 con 0x7f7a600b3ff0 2023-12-22T08:52:56.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.287+0000 7f7a665ef640 1 -- 172.21.15.38:0/2450809915 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f7a600b6890 con 0x7f7a600b3ff0 2023-12-22T08:52:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.870+0000 7f7a5dffb640 1 -- 172.21.15.38:0/2450809915 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v620) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7a600b6890 con 0x7f7a600b3ff0 2023-12-22T08:52:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.875+0000 7f7a665ef640 1 -- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7a4c06a430 msgr2=0x7f7a4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.875+0000 7f7a665ef640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7a4c06a430 0x7f7a4c06c8f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009e90 tx=0x7f7a5000b040 comp rx=0 tx=0).stop 2023-12-22T08:52:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.875+0000 7f7a665ef640 1 -- 172.21.15.38:0/2450809915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a600b3ff0 msgr2=0x7f7a60157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.875+0000 7f7a665ef640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a600b3ff0 0x7f7a60157f50 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400c4a0 tx=0x7f7a5400c960 comp rx=0 tx=0).stop 2023-12-22T08:52:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.875+0000 7f7a665ef640 1 -- 172.21.15.38:0/2450809915 shutdown_connections 2023-12-22T08:52:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.875+0000 7f7a665ef640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a60157980 0x7f7a6014a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.875+0000 7f7a665ef640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7a4c06a430 0x7f7a4c06c8f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.875+0000 7f7a665ef640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a600b3ff0 0x7f7a60157f50 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.875+0000 7f7a665ef640 1 --2- 172.21.15.38:0/2450809915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a6006d640 0x7f7a6015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.875+0000 7f7a665ef640 1 -- 172.21.15.38:0/2450809915 >> 172.21.15.38:0/2450809915 conn(0x7f7a600d31f0 msgr2=0x7f7a6006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.875+0000 7f7a665ef640 1 -- 172.21.15.38:0/2450809915 shutdown_connections 2023-12-22T08:52:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:56.875+0000 7f7a665ef640 1 -- 172.21.15.38:0/2450809915 wait complete. 2023-12-22T08:52:56.901 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T08:52:57.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.138+0000 7f60c6526640 1 Processor -- start 2023-12-22T08:52:57.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.138+0000 7f60c6526640 1 -- start start 2023-12-22T08:52:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.140+0000 7f60c6526640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f60c0146c00 0x7f60c006f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.140+0000 7f60c6526640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60c01613d0 0x7f60c015e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.140+0000 7f60c6526640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c00abda0 con 0x7f60c0160f60 2023-12-22T08:52:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.140+0000 7f60c6526640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c0161db0 con 0x7f60c0146c00 2023-12-22T08:52:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.140+0000 7f60c6526640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c0146fe0 con 0x7f60c01613d0 2023-12-22T08:52:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.140+0000 7f60c5524640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f60c0146c00 0x7f60c006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.140+0000 7f60c5524640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f60c0146c00 0x7f60c006f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34694/0 (socket says 172.21.15.38:34694) 2023-12-22T08:52:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.140+0000 7f60c5524640 1 -- 172.21.15.38:0/3352632164 learned_addr learned my addr 172.21.15.38:0/3352632164 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.141+0000 7f60c5d25640 1 --2- 172.21.15.38:0/3352632164 >> v2:172.21.15.89:3300/0 conn(0x7f60c01613d0 0x7f60c015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.141+0000 7f60c5524640 1 -- 172.21.15.38:0/3352632164 >> v2:172.21.15.89:3300/0 conn(0x7f60c01613d0 msgr2=0x7f60c015e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.141+0000 7f60c5524640 1 --2- 172.21.15.38:0/3352632164 >> v2:172.21.15.89:3300/0 conn(0x7f60c01613d0 0x7f60c015e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.141+0000 7f60c5524640 1 -- 172.21.15.38:0/3352632164 >> v1:172.21.15.89:6789/0 conn(0x7f60c0160f60 legacy=0x7f60c015d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.141+0000 7f60c5524640 1 -- 172.21.15.38:0/3352632164 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c0071c70 con 0x7f60c0146c00 2023-12-22T08:52:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.142+0000 7f60c5524640 1 --2- 172.21.15.38:0/3352632164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c0146c00 0x7f60c006f250 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f60c006a7d0 tx=0x7f60bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1271e7019e5d576 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.142+0000 7f60b7fff640 1 -- 172.21.15.38:0/3352632164 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc031870 con 0x7f60c0146c00 2023-12-22T08:52:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.142+0000 7f60b7fff640 1 -- 172.21.15.38:0/3352632164 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc0319d0 con 0x7f60c0146c00 2023-12-22T08:52:57.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.142+0000 7f60b7fff640 1 -- 172.21.15.38:0/3352632164 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc031d60 con 0x7f60c0146c00 2023-12-22T08:52:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.143+0000 7f60c6526640 1 -- 172.21.15.38:0/3352632164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c0146c00 msgr2=0x7f60c006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.143+0000 7f60c6526640 1 --2- 172.21.15.38:0/3352632164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c0146c00 0x7f60c006f250 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f60c006a7d0 tx=0x7f60bc02b910 comp rx=0 tx=0).stop 2023-12-22T08:52:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.143+0000 7f60c6526640 1 -- 172.21.15.38:0/3352632164 shutdown_connections 2023-12-22T08:52:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.143+0000 7f60c6526640 1 --2- 172.21.15.38:0/3352632164 >> v2:172.21.15.89:3300/0 conn(0x7f60c01613d0 0x7f60c015e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.143+0000 7f60c6526640 1 --2- 172.21.15.38:0/3352632164 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c0146c00 0x7f60c006f250 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.143+0000 7f60c6526640 1 -- 172.21.15.38:0/3352632164 >> 172.21.15.38:0/3352632164 conn(0x7f60c00b0b60 msgr2=0x7f60c00b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.143+0000 7f60c6526640 1 -- 172.21.15.38:0/3352632164 shutdown_connections 2023-12-22T08:52:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.143+0000 7f60c6526640 1 -- 172.21.15.38:0/3352632164 wait complete. 2023-12-22T08:52:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.145+0000 7f60c6526640 1 Processor -- start 2023-12-22T08:52:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.145+0000 7f60c6526640 1 -- start start 2023-12-22T08:52:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.146+0000 7f60c6526640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c0146c00 0x7f60c01f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.146+0000 7f60c6526640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c0160f60 0x7f60c0145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.146+0000 7f60c6526640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c01613d0 0x7f60c0142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.146+0000 7f60c6526640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0133110 con 0x7f60c01613d0 2023-12-22T08:52:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.146+0000 7f60c6526640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0132e30 con 0x7f60c0146c00 2023-12-22T08:52:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.146+0000 7f60c6526640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c01f2b60 con 0x7f60c0160f60 2023-12-22T08:52:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.147+0000 7f60c5d25640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c01613d0 0x7f60c0142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:57.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.147+0000 7f60c5d25640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c01613d0 0x7f60c0142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34708/0 (socket says 172.21.15.38:34708) 2023-12-22T08:52:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.147+0000 7f60c5d25640 1 -- 172.21.15.38:0/459208271 learned_addr learned my addr 172.21.15.38:0/459208271 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.147+0000 7f60c5524640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c0146c00 0x7f60c01f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.147+0000 7f60c4d23640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c0160f60 0x7f60c0145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.147+0000 7f60c5d25640 1 -- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c0160f60 msgr2=0x7f60c0145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.147+0000 7f60c5d25640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c0160f60 0x7f60c0145d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.147+0000 7f60c5d25640 1 -- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c0146c00 msgr2=0x7f60c01f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.147+0000 7f60c5d25640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c0146c00 0x7f60c01f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.147+0000 7f60c5d25640 1 -- 172.21.15.38:0/459208271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc0094d0 con 0x7f60c01613d0 2023-12-22T08:52:57.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.147+0000 7f60c4d23640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c0160f60 0x7f60c0145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:52:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.147+0000 7f60c5d25640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c01613d0 0x7f60c0142db0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f60b800cd20 tx=0x7f60b800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.148+0000 7f60b5ffb640 1 -- 172.21.15.38:0/459208271 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b8003b90 con 0x7f60c01613d0 2023-12-22T08:52:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.148+0000 7f60b5ffb640 1 -- 172.21.15.38:0/459208271 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b8003cf0 con 0x7f60c01613d0 2023-12-22T08:52:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.148+0000 7f60b5ffb640 1 -- 172.21.15.38:0/459208271 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b8004240 con 0x7f60c01613d0 2023-12-22T08:52:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.148+0000 7f60c6526640 1 -- 172.21.15.38:0/459208271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c01f2e40 con 0x7f60c01613d0 2023-12-22T08:52:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.148+0000 7f60c6526640 1 -- 172.21.15.38:0/459208271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c01462c0 con 0x7f60c01613d0 2023-12-22T08:52:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.149+0000 7f60c6526640 1 -- 172.21.15.38:0/459208271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c01f3360 con 0x7f60c01613d0 2023-12-22T08:52:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.150+0000 7f60b5ffb640 1 -- 172.21.15.38:0/459208271 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f60b80043a0 con 0x7f60c01613d0 2023-12-22T08:52:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.151+0000 7f60b5ffb640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f60a406a430 0x7f60a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.151+0000 7f60b5ffb640 1 -- 172.21.15.38:0/459208271 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f60b8012070 con 0x7f60c01613d0 2023-12-22T08:52:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.152+0000 7f60c5524640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f60a406a430 0x7f60a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.153+0000 7f60c5524640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f60a406a430 0x7f60a406c8f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f60bc036000 tx=0x7f60bc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:57.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.156+0000 7f60b5ffb640 1 -- 172.21.15.38:0/459208271 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f60b8054880 con 0x7f60c01613d0 2023-12-22T08:52:57.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.355+0000 7f60c6526640 1 -- 172.21.15.38:0/459208271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f60c0061910 con 0x7f60c01613d0 2023-12-22T08:52:57.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.365+0000 7f60b5ffb640 1 -- 172.21.15.38:0/459208271 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f60b8057ea0 con 0x7f60c01613d0 2023-12-22T08:52:57.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.367+0000 7f60c6526640 1 -- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f60a406a430 msgr2=0x7f60a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:57.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.367+0000 7f60c6526640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f60a406a430 0x7f60a406c8f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f60bc036000 tx=0x7f60bc03c040 comp rx=0 tx=0).stop 2023-12-22T08:52:57.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.367+0000 7f60c6526640 1 -- 172.21.15.38:0/459208271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c01613d0 msgr2=0x7f60c0142db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:57.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.367+0000 7f60c6526640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c01613d0 0x7f60c0142db0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f60b800cd20 tx=0x7f60b800a660 comp rx=0 tx=0).stop 2023-12-22T08:52:57.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.367+0000 7f60c6526640 1 -- 172.21.15.38:0/459208271 shutdown_connections 2023-12-22T08:52:57.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.367+0000 7f60c6526640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f60a406a430 0x7f60a406c8f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:57.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.367+0000 7f60c6526640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60c01613d0 0x7f60c0142db0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:57.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.367+0000 7f60c6526640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60c0160f60 0x7f60c0145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:57.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.367+0000 7f60c6526640 1 --2- 172.21.15.38:0/459208271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60c0146c00 0x7f60c01f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:57.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.367+0000 7f60c6526640 1 -- 172.21.15.38:0/459208271 >> 172.21.15.38:0/459208271 conn(0x7f60c00b0b60 msgr2=0x7f60c00ad560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:57.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.368+0000 7f60c6526640 1 -- 172.21.15.38:0/459208271 shutdown_connections 2023-12-22T08:52:57.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:57.368+0000 7f60c6526640 1 -- 172.21.15.38:0/459208271 wait complete. 2023-12-22T08:52:57.390 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:52:57.390 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:52:57.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:52:57.636 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:52:57.636 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:52:57.636 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:52:57.699 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:52:57.700 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:52:57.700 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:52:57.757 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:52:57.757 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:52:57.757 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:52:57.822 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:52:57.822 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:52:57.822 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:52:57.882 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:52:57.883 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-22T08:52:57.883 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:52:58.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.122+0000 7f099dc79640 1 Processor -- start 2023-12-22T08:52:58.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.122+0000 7f099dc79640 1 -- start start 2023-12-22T08:52:58.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.124+0000 7f099dc79640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0998157980 0x7f099815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.124+0000 7f099dc79640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09980b3ff0 0x7f099806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.124+0000 7f099dc79640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09980d1520 con 0x7f09980b4470 2023-12-22T08:52:58.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.124+0000 7f099dc79640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09980d1800 con 0x7f0998157980 2023-12-22T08:52:58.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.124+0000 7f099dc79640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09980d1ae0 con 0x7f09980b3ff0 2023-12-22T08:52:58.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.125+0000 7f099d478640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f09980b4470 0x7f09980d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37892/0 (socket says 172.21.15.38:37892) 2023-12-22T08:52:58.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.125+0000 7f099d478640 1 -- 172.21.15.38:0/2442020715 learned_addr learned my addr 172.21.15.38:0/2442020715 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:58.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.125+0000 7f0997fff640 1 --2- 172.21.15.38:0/2442020715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09980b3ff0 0x7f099806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.125+0000 7f099cc77640 1 --2- 172.21.15.38:0/2442020715 >> v2:172.21.15.89:3300/0 conn(0x7f0998157980 0x7f099815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.125+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937404220 0 0) 0x7f09980d1520 con 0x7f09980b4470 2023-12-22T08:52:58.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.125+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0988003520 con 0x7f09980b4470 2023-12-22T08:52:58.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.125+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2254966830 0 0) 0x7f0988003520 con 0x7f09980b4470 2023-12-22T08:52:58.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.125+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09980b3ff0 msgr2=0x7f099806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.125+0000 7f09977fe640 1 --2- 172.21.15.38:0/2442020715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09980b3ff0 0x7f099806cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.125+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 >> v2:172.21.15.89:3300/0 conn(0x7f0998157980 msgr2=0x7f099815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.125+0000 7f09977fe640 1 --2- 172.21.15.38:0/2442020715 >> v2:172.21.15.89:3300/0 conn(0x7f0998157980 0x7f099815eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.125+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09980d1dc0 con 0x7f09980b4470 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.125+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f09900019f0 con 0x7f09980b4470 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.126+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 >> v1:172.21.15.38:6789/0 conn(0x7f09980b4470 legacy=0x7f09980d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.126+0000 7f09977fe640 1 --2- 172.21.15.38:0/2442020715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0988003970 0x7f0988003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.126+0000 7f09977fe640 1 --2- 172.21.15.38:0/2442020715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09980b3ff0 0x7f09880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.126+0000 7f09977fe640 1 --2- 172.21.15.38:0/2442020715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0988004d00 0x7f0988005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.126+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09980d1800 con 0x7f0988004d00 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.126+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09980d1ae0 con 0x7f0988003970 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.126+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098800b980 con 0x7f09980b3ff0 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.126+0000 7f099d478640 1 --2- 172.21.15.38:0/2442020715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0988004d00 0x7f0988005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.126+0000 7f099cc77640 1 --2- 172.21.15.38:0/2442020715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0988003970 0x7f0988003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.126+0000 7f0997fff640 1 --2- 172.21.15.38:0/2442020715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09980b3ff0 0x7f09880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.127+0000 7f099d478640 1 -- 172.21.15.38:0/2442020715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09980b3ff0 msgr2=0x7f09880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:58.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.127+0000 7f099d478640 1 --2- 172.21.15.38:0/2442020715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09980b3ff0 0x7f09880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.127+0000 7f099d478640 1 -- 172.21.15.38:0/2442020715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0988003970 msgr2=0x7f0988003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:58.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.127+0000 7f099d478640 1 --2- 172.21.15.38:0/2442020715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0988003970 0x7f0988003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.127+0000 7f099d478640 1 -- 172.21.15.38:0/2442020715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988003520 con 0x7f0988004d00 2023-12-22T08:52:58.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.127+0000 7f099cc77640 1 --2- 172.21.15.38:0/2442020715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0988003970 0x7f0988003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:52:58.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.128+0000 7f099d478640 1 --2- 172.21.15.38:0/2442020715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0988004d00 0x7f0988005180 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f099000a790 tx=0x7f09880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d1542224920888 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:58.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.128+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990034630 con 0x7f0988004d00 2023-12-22T08:52:58.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.128+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099002f070 con 0x7f0988004d00 2023-12-22T08:52:58.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.128+0000 7f09977fe640 1 -- 172.21.15.38:0/2442020715 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09900349f0 con 0x7f0988004d00 2023-12-22T08:52:58.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.129+0000 7f099dc79640 1 -- 172.21.15.38:0/2442020715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0988004d00 msgr2=0x7f0988005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:58.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.129+0000 7f099dc79640 1 --2- 172.21.15.38:0/2442020715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0988004d00 0x7f0988005180 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f099000a790 tx=0x7f09880057f0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.129+0000 7f099d478640 1 -- 172.21.15.38:0/2442020715 reap_dead start 2023-12-22T08:52:58.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.129+0000 7f099dc79640 1 -- 172.21.15.38:0/2442020715 shutdown_connections 2023-12-22T08:52:58.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.129+0000 7f099dc79640 1 -- 172.21.15.38:0/2442020715 >> 172.21.15.38:0/2442020715 conn(0x7f09980d31f0 msgr2=0x7f09980d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:58.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.129+0000 7f099dc79640 1 -- 172.21.15.38:0/2442020715 shutdown_connections 2023-12-22T08:52:58.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.129+0000 7f099dc79640 1 -- 172.21.15.38:0/2442020715 wait complete. 2023-12-22T08:52:58.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.131+0000 7f099dc79640 1 Processor -- start 2023-12-22T08:52:58.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.131+0000 7f099dc79640 1 -- start start 2023-12-22T08:52:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.132+0000 7f099dc79640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0988004d00 0x7f0998159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.132+0000 7f099dc79640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f099815ac20 0x7f099813daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.132+0000 7f099dc79640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09980b85c0 0x7f09981f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.132+0000 7f099dc79640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099815b080 con 0x7f099815ac20 2023-12-22T08:52:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.132+0000 7f099dc79640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099815a790 con 0x7f0988004d00 2023-12-22T08:52:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.132+0000 7f099dc79640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0998159b80 con 0x7f09980b85c0 2023-12-22T08:52:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.132+0000 7f0997fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f099815ac20 0x7f099813daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.132+0000 7f0997fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f099815ac20 0x7f099813daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34728/0 (socket says 172.21.15.38:34728) 2023-12-22T08:52:58.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.132+0000 7f0997fff640 1 -- 172.21.15.38:0/1402972055 learned_addr learned my addr 172.21.15.38:0/1402972055 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:58.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.133+0000 7f099cc77640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0988004d00 0x7f0998159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.133+0000 7f099d478640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09980b85c0 0x7f09981f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.133+0000 7f0997fff640 1 -- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09980b85c0 msgr2=0x7f09981f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:58.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.133+0000 7f0997fff640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09980b85c0 0x7f09981f60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.133+0000 7f0997fff640 1 -- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0988004d00 msgr2=0x7f0998159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:58.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.133+0000 7f0997fff640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0988004d00 0x7f0998159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.133+0000 7f0997fff640 1 -- 172.21.15.38:0/1402972055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0998159e60 con 0x7f099815ac20 2023-12-22T08:52:58.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.133+0000 7f0997fff640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f099815ac20 0x7f099813daa0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f0984011600 tx=0x7f0984011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:58.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.133+0000 7f09957fa640 1 -- 172.21.15.38:0/1402972055 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098400f920 con 0x7f099815ac20 2023-12-22T08:52:58.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.134+0000 7f09957fa640 1 -- 172.21.15.38:0/1402972055 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098400fa80 con 0x7f099815ac20 2023-12-22T08:52:58.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.134+0000 7f099dc79640 1 -- 172.21.15.38:0/1402972055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099815a140 con 0x7f099815ac20 2023-12-22T08:52:58.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.134+0000 7f09957fa640 1 -- 172.21.15.38:0/1402972055 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098400fdf0 con 0x7f099815ac20 2023-12-22T08:52:58.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.134+0000 7f099dc79640 1 -- 172.21.15.38:0/1402972055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099813dfe0 con 0x7f099815ac20 2023-12-22T08:52:58.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.135+0000 7f099dc79640 1 -- 172.21.15.38:0/1402972055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099815a900 con 0x7f099815ac20 2023-12-22T08:52:58.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.136+0000 7f09957fa640 1 -- 172.21.15.38:0/1402972055 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0984015460 con 0x7f099815ac20 2023-12-22T08:52:58.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.137+0000 7f09957fa640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f097c06a460 0x7f097c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.138+0000 7f09957fa640 1 -- 172.21.15.38:0/1402972055 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0984088af0 con 0x7f099815ac20 2023-12-22T08:52:58.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.138+0000 7f099cc77640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f097c06a460 0x7f097c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.139+0000 7f099cc77640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f097c06a460 0x7f097c06c920 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f098c009a10 tx=0x7f098c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.142+0000 7f09957fa640 1 -- 172.21.15.38:0/1402972055 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f09840543d0 con 0x7f099815ac20 2023-12-22T08:52:58.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.374+0000 7f099dc79640 1 -- 172.21.15.38:0/1402972055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0998157d60 con 0x7f099815ac20 2023-12-22T08:52:58.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.375+0000 7f09957fa640 1 -- 172.21.15.38:0/1402972055 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f0984022de0 con 0x7f099815ac20 2023-12-22T08:52:58.376 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:52:58.376 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":80,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1443382612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":1443382612},{"type":"v1","addr":"172.21.15.38:6835","nonce":1443382612}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1913310975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1913310975},{"type":"v1","addr":"172.21.15.89:6836","nonce":1913310975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/218839128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":218839128},{"type":"v1","addr":"172.21.15.89:6837","nonce":218839128}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/208787013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":208787013},{"type":"v1","addr":"172.21.15.38:6834","nonce":208787013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[]} 2023-12-22T08:52:58.376 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 80 2023-12-22T08:52:58.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.377+0000 7f099dc79640 1 -- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f097c06a460 msgr2=0x7f097c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:58.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.377+0000 7f099dc79640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f097c06a460 0x7f097c06c920 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f098c009a10 tx=0x7f098c008040 comp rx=0 tx=0).stop 2023-12-22T08:52:58.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.377+0000 7f099dc79640 1 -- 172.21.15.38:0/1402972055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f099815ac20 msgr2=0x7f099813daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:58.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.377+0000 7f099dc79640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f099815ac20 0x7f099813daa0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f0984011600 tx=0x7f0984011ac0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.378+0000 7f099dc79640 1 -- 172.21.15.38:0/1402972055 shutdown_connections 2023-12-22T08:52:58.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.378+0000 7f099dc79640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09980b85c0 0x7f09981f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.378+0000 7f099dc79640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f097c06a460 0x7f097c06c920 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.378+0000 7f099dc79640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f099815ac20 0x7f099813daa0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.378+0000 7f099dc79640 1 --2- 172.21.15.38:0/1402972055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0988004d00 0x7f0998159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.378+0000 7f099dc79640 1 -- 172.21.15.38:0/1402972055 >> 172.21.15.38:0/1402972055 conn(0x7f09980d31f0 msgr2=0x7f09980d2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:58.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.378+0000 7f099dc79640 1 -- 172.21.15.38:0/1402972055 shutdown_connections 2023-12-22T08:52:58.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.378+0000 7f099dc79640 1 -- 172.21.15.38:0/1402972055 wait complete. 2023-12-22T08:52:58.398 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T08:52:58.398 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T08:52:58.398 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T08:52:58.398 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:52:58.398 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T08:52:58.399 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T08:52:58.399 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T08:52:58.399 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:52:58.399 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T08:52:58.399 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T08:52:58.399 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T08:52:58.399 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:52:58.400 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T08:52:58.400 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T08:52:58.400 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T08:52:58.400 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:52:58.417 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T08:52:58.418 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T08:52:58.422 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T08:52:58.422 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T08:52:58.429 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T08:52:58.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T08:52:58.434 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T08:52:58.434 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T08:52:58.470 INFO:tasks.ceph.mds.a:Started 2023-12-22T08:52:58.471 DEBUG:teuthology.parallel:result is None 2023-12-22T08:52:58.478 INFO:tasks.ceph.mds.c:Started 2023-12-22T08:52:58.479 DEBUG:teuthology.parallel:result is None 2023-12-22T08:52:58.482 INFO:tasks.ceph.mds.b:Started 2023-12-22T08:52:58.483 DEBUG:teuthology.parallel:result is None 2023-12-22T08:52:58.490 INFO:tasks.ceph.mds.d:Started 2023-12-22T08:52:58.490 DEBUG:teuthology.parallel:result is None 2023-12-22T08:52:58.491 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-22T08:52:58.634 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-12-22T08:52:58.635 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:52:58.643 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-12-22T08:52:58.648 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-12-22T08:52:58.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.685+0000 7f86d0838640 1 Processor -- start 2023-12-22T08:52:58.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.685+0000 7f86d0838640 1 -- start start 2023-12-22T08:52:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.686+0000 7f86d0838640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f86cc0b2050 0x7f86cc0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.687+0000 7f86d0838640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86cc070800 0x7f86cc070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.687+0000 7f86d0838640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86cc1450f0 con 0x7f86cc144d10 2023-12-22T08:52:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.687+0000 7f86d0838640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86cc0cc840 con 0x7f86cc0b2050 2023-12-22T08:52:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.687+0000 7f86d0838640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc0ce010 con 0x7f86cc070800 2023-12-22T08:52:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.687+0000 7f86cad9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86cc070800 0x7f86cc070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.687+0000 7f86ca59c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f86cc144d10 0x7f86cc0cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:56018/0 (socket says 172.21.15.38:56018) 2023-12-22T08:52:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.687+0000 7f86ca59c640 1 -- 172.21.15.38:0/1953198668 learned_addr learned my addr 172.21.15.38:0/1953198668 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:52:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.687+0000 7f86c9d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f86cc0b2050 0x7f86cc0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.687+0000 7f86cad9d640 1 -- 172.21.15.38:0/1953198668 >> v2:172.21.15.89:3300/0 conn(0x7f86cc0b2050 msgr2=0x7f86cc0b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:52:58.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.687+0000 7f86cad9d640 1 --2- 172.21.15.38:0/1953198668 >> v2:172.21.15.89:3300/0 conn(0x7f86cc0b2050 0x7f86cc0b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.687+0000 7f86cad9d640 1 -- 172.21.15.38:0/1953198668 >> v1:172.21.15.89:6789/0 conn(0x7f86cc144d10 legacy=0x7f86cc0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:58.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.687+0000 7f86cad9d640 1 -- 172.21.15.38:0/1953198668 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc0b29f0 con 0x7f86cc070800 2023-12-22T08:52:58.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.687+0000 7f86c959a640 1 -- 172.21.15.38:0/1953198668 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819167621 0 0) 0x7f86cc1450f0 con 0x7f86cc144d10 2023-12-22T08:52:58.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.688+0000 7f86cad9d640 1 --2- 172.21.15.38:0/1953198668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86cc070800 0x7f86cc070c30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009d90 tx=0x7f86c402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50e43e322dceea06 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:58.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.689+0000 7f86c959a640 1 -- 172.21.15.38:0/1953198668 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c402cc50 con 0x7f86cc070800 2023-12-22T08:52:58.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.689+0000 7f86c959a640 1 -- 172.21.15.38:0/1953198668 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c402cdb0 con 0x7f86cc070800 2023-12-22T08:52:58.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.689+0000 7f86c959a640 1 -- 172.21.15.38:0/1953198668 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4034660 con 0x7f86cc070800 2023-12-22T08:52:58.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.689+0000 7f86d0838640 1 -- 172.21.15.38:0/1953198668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86cc070800 msgr2=0x7f86cc070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:58.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.689+0000 7f86d0838640 1 --2- 172.21.15.38:0/1953198668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86cc070800 0x7f86cc070c30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009d90 tx=0x7f86c402bea0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.690+0000 7f86d0838640 1 -- 172.21.15.38:0/1953198668 shutdown_connections 2023-12-22T08:52:58.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.690+0000 7f86d0838640 1 --2- 172.21.15.38:0/1953198668 >> v2:172.21.15.89:3300/0 conn(0x7f86cc0b2050 0x7f86cc0b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.690+0000 7f86d0838640 1 --2- 172.21.15.38:0/1953198668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86cc070800 0x7f86cc070c30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.690+0000 7f86d0838640 1 -- 172.21.15.38:0/1953198668 >> 172.21.15.38:0/1953198668 conn(0x7f86cc0cf070 msgr2=0x7f86cc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:58.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.690+0000 7f86d0838640 1 -- 172.21.15.38:0/1953198668 shutdown_connections 2023-12-22T08:52:58.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.690+0000 7f86d0838640 1 -- 172.21.15.38:0/1953198668 wait complete. 2023-12-22T08:52:58.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.691+0000 7f86d0838640 1 Processor -- start 2023-12-22T08:52:58.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.691+0000 7f86d0838640 1 -- start start 2023-12-22T08:52:58.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.692+0000 7f86d0838640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86cc070800 0x7f86cc15f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.692+0000 7f86d0838640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86cc0b2050 0x7f86cc139cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.692+0000 7f86d0838640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86cc144d10 0x7f86cc1424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.692+0000 7f86d0838640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc142a30 con 0x7f86cc144d10 2023-12-22T08:52:58.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.692+0000 7f86d0838640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc142cd0 con 0x7f86cc070800 2023-12-22T08:52:58.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.692+0000 7f86d0838640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc142fb0 con 0x7f86cc0b2050 2023-12-22T08:52:58.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.693+0000 7f86cad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86cc144d10 0x7f86cc1424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.693+0000 7f86cad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86cc144d10 0x7f86cc1424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34748/0 (socket says 172.21.15.38:34748) 2023-12-22T08:52:58.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.693+0000 7f86cad9d640 1 -- 172.21.15.38:0/863190111 learned_addr learned my addr 172.21.15.38:0/863190111 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:52:58.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.693+0000 7f86ca59c640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86cc070800 0x7f86cc15f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.693+0000 7f86c9d9b640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86cc0b2050 0x7f86cc139cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.693+0000 7f86cad9d640 1 -- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86cc0b2050 msgr2=0x7f86cc139cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:58.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.693+0000 7f86cad9d640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86cc0b2050 0x7f86cc139cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.693+0000 7f86cad9d640 1 -- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86cc070800 msgr2=0x7f86cc15f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:58.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.693+0000 7f86cad9d640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86cc070800 0x7f86cc15f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:58.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.693+0000 7f86cad9d640 1 -- 172.21.15.38:0/863190111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c4009a70 con 0x7f86cc144d10 2023-12-22T08:52:58.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.694+0000 7f86cad9d640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86cc144d10 0x7f86cc1424f0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009d90 tx=0x7f86c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:58.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.694+0000 7f86baffd640 1 -- 172.21.15.38:0/863190111 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4040650 con 0x7f86cc144d10 2023-12-22T08:52:58.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.694+0000 7f86baffd640 1 -- 172.21.15.38:0/863190111 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c40407b0 con 0x7f86cc144d10 2023-12-22T08:52:58.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.694+0000 7f86baffd640 1 -- 172.21.15.38:0/863190111 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4040b60 con 0x7f86cc144d10 2023-12-22T08:52:58.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.694+0000 7f86d0838640 1 -- 172.21.15.38:0/863190111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86cc143290 con 0x7f86cc144d10 2023-12-22T08:52:58.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.694+0000 7f86d0838640 1 -- 172.21.15.38:0/863190111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86cc143850 con 0x7f86cc144d10 2023-12-22T08:52:58.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.695+0000 7f86d0838640 1 -- 172.21.15.38:0/863190111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86cc061910 con 0x7f86cc144d10 2023-12-22T08:52:58.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.696+0000 7f86baffd640 1 -- 172.21.15.38:0/863190111 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f86c4040cc0 con 0x7f86cc144d10 2023-12-22T08:52:58.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.697+0000 7f86baffd640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86ac06a430 0x7f86ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:52:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.697+0000 7f86baffd640 1 -- 172.21.15.38:0/863190111 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f86c40ab330 con 0x7f86cc144d10 2023-12-22T08:52:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.698+0000 7f86ca59c640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86ac06a430 0x7f86ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:52:58.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.699+0000 7f86ca59c640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86ac06a430 0x7f86ac06c8f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f86bc000f60 tx=0x7f86bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:52:58.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.701+0000 7f86baffd640 1 -- 172.21.15.38:0/863190111 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f86c4076c30 con 0x7f86cc144d10 2023-12-22T08:52:58.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:58.912+0000 7f86d0838640 1 -- 172.21.15.38:0/863190111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f86cc0cc0a0 con 0x7f86cc144d10 2023-12-22T08:52:59.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:59.903+0000 7f86baffd640 1 -- 172.21.15.38:0/863190111 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v186) v1 ==== 97+0+0 (secure 0 0 0) 0x7f86c4009450 con 0x7f86cc144d10 2023-12-22T08:52:59.904 INFO:teuthology.orchestra.run.smithi038.stderr: removed all blocklist entries 2023-12-22T08:52:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:59.906+0000 7f86d0838640 1 -- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86ac06a430 msgr2=0x7f86ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:59.906+0000 7f86d0838640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86ac06a430 0x7f86ac06c8f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f86bc000f60 tx=0x7f86bc009040 comp rx=0 tx=0).stop 2023-12-22T08:52:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:59.907+0000 7f86d0838640 1 -- 172.21.15.38:0/863190111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86cc144d10 msgr2=0x7f86cc1424f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:52:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:59.907+0000 7f86d0838640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86cc144d10 0x7f86cc1424f0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009d90 tx=0x7f86c4004a40 comp rx=0 tx=0).stop 2023-12-22T08:52:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:59.907+0000 7f86d0838640 1 -- 172.21.15.38:0/863190111 shutdown_connections 2023-12-22T08:52:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:59.907+0000 7f86d0838640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f86ac06a430 0x7f86ac06c8f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:59.907+0000 7f86d0838640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86cc144d10 0x7f86cc1424f0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:59.907+0000 7f86d0838640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86cc0b2050 0x7f86cc139cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:59.907+0000 7f86d0838640 1 --2- 172.21.15.38:0/863190111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86cc070800 0x7f86cc15f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:52:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:59.907+0000 7f86d0838640 1 -- 172.21.15.38:0/863190111 >> 172.21.15.38:0/863190111 conn(0x7f86cc0cf070 msgr2=0x7f86cc0b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:52:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:59.907+0000 7f86d0838640 1 -- 172.21.15.38:0/863190111 shutdown_connections 2023-12-22T08:52:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:52:59.907+0000 7f86d0838640 1 -- 172.21.15.38:0/863190111 wait complete. 2023-12-22T08:52:59.932 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T08:53:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.163+0000 7fbb56d01640 1 Processor -- start 2023-12-22T08:53:00.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.163+0000 7fbb56d01640 1 -- start start 2023-12-22T08:53:00.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.165+0000 7fbb56d01640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb50070260 0x7fbb500ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:00.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.165+0000 7fbb56d01640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb500ce950 con 0x7fbb50161340 2023-12-22T08:53:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.165+0000 7fbb56d01640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb50072170 con 0x7fbb50161720 2023-12-22T08:53:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.165+0000 7fbb56d01640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb500cdd40 con 0x7fbb50070260 2023-12-22T08:53:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.165+0000 7fbb56500640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbb50070260 0x7fbb500ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.165+0000 7fbb55cff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fbb50161340 0x7fbb50071a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37926/0 (socket says 172.21.15.38:37926) 2023-12-22T08:53:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.165+0000 7fbb55cff640 1 -- 172.21.15.38:0/4187358804 learned_addr learned my addr 172.21.15.38:0/4187358804 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.166+0000 7fbb56500640 1 -- 172.21.15.38:0/4187358804 >> v1:172.21.15.89:6789/0 conn(0x7fbb50161720 legacy=0x7fbb500adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.166+0000 7fbb54cfd640 1 -- 172.21.15.38:0/4187358804 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858855338 0 0) 0x7fbb500ce950 con 0x7fbb50161340 2023-12-22T08:53:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.166+0000 7fbb56500640 1 -- 172.21.15.38:0/4187358804 >> v1:172.21.15.38:6789/0 conn(0x7fbb50161340 legacy=0x7fbb50071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:00.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.166+0000 7fbb56500640 1 -- 172.21.15.38:0/4187358804 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb500ce020 con 0x7fbb50070260 2023-12-22T08:53:00.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.167+0000 7fbb56500640 1 --2- 172.21.15.38:0/4187358804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb50070260 0x7fbb500ae3b0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009d90 tx=0x7fbb4802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7938c6cf1851797 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.167+0000 7fbb54cfd640 1 -- 172.21.15.38:0/4187358804 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4802cbd0 con 0x7fbb50070260 2023-12-22T08:53:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.167+0000 7fbb54cfd640 1 -- 172.21.15.38:0/4187358804 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4802cd30 con 0x7fbb50070260 2023-12-22T08:53:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.167+0000 7fbb54cfd640 1 -- 172.21.15.38:0/4187358804 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4802cea0 con 0x7fbb50070260 2023-12-22T08:53:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.168+0000 7fbb56d01640 1 -- 172.21.15.38:0/4187358804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb50070260 msgr2=0x7fbb500ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.168+0000 7fbb56d01640 1 --2- 172.21.15.38:0/4187358804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb50070260 0x7fbb500ae3b0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009d90 tx=0x7fbb4802be20 comp rx=0 tx=0).stop 2023-12-22T08:53:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.168+0000 7fbb56d01640 1 -- 172.21.15.38:0/4187358804 shutdown_connections 2023-12-22T08:53:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.168+0000 7fbb56d01640 1 --2- 172.21.15.38:0/4187358804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb50070260 0x7fbb500ae3b0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.168+0000 7fbb56d01640 1 -- 172.21.15.38:0/4187358804 >> 172.21.15.38:0/4187358804 conn(0x7fbb500b1f70 msgr2=0x7fbb500b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.168+0000 7fbb56d01640 1 -- 172.21.15.38:0/4187358804 shutdown_connections 2023-12-22T08:53:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.168+0000 7fbb56d01640 1 -- 172.21.15.38:0/4187358804 wait complete. 2023-12-22T08:53:00.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.170+0000 7fbb56d01640 1 Processor -- start 2023-12-22T08:53:00.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.170+0000 7fbb56d01640 1 -- start start 2023-12-22T08:53:00.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.171+0000 7fbb56d01640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb50070260 0x7fbb50153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:00.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.171+0000 7fbb56d01640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb50161340 0x7fbb501f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:00.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.171+0000 7fbb56d01640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb50161720 0x7fbb501e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:00.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.171+0000 7fbb56d01640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb501e8ae0 con 0x7fbb50161720 2023-12-22T08:53:00.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.171+0000 7fbb56d01640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb50153eb0 con 0x7fbb50161340 2023-12-22T08:53:00.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.171+0000 7fbb56d01640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb501e87b0 con 0x7fbb50070260 2023-12-22T08:53:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.172+0000 7fbb56500640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb50161720 0x7fbb501e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.172+0000 7fbb55cff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb50070260 0x7fbb50153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.172+0000 7fbb56500640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb50161720 0x7fbb501e8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34756/0 (socket says 172.21.15.38:34756) 2023-12-22T08:53:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.172+0000 7fbb56500640 1 -- 172.21.15.38:0/424743090 learned_addr learned my addr 172.21.15.38:0/424743090 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.172+0000 7fbb554fe640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb50161340 0x7fbb501f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.172+0000 7fbb56500640 1 -- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb50070260 msgr2=0x7fbb50153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.172+0000 7fbb56500640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb50070260 0x7fbb50153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.172+0000 7fbb56500640 1 -- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb50161340 msgr2=0x7fbb501f2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.172+0000 7fbb56500640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb50161340 0x7fbb501f2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.172+0000 7fbb56500640 1 -- 172.21.15.38:0/424743090 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb48009a70 con 0x7fbb50161720 2023-12-22T08:53:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.172+0000 7fbb554fe640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb50161340 0x7fbb501f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:53:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.173+0000 7fbb56500640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb50161720 0x7fbb501e8f70 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009d90 tx=0x7fbb48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.173+0000 7fbb467fc640 1 -- 172.21.15.38:0/424743090 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4802cea0 con 0x7fbb50161720 2023-12-22T08:53:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.173+0000 7fbb467fc640 1 -- 172.21.15.38:0/424743090 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb48040650 con 0x7fbb50161720 2023-12-22T08:53:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.173+0000 7fbb467fc640 1 -- 172.21.15.38:0/424743090 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48040a00 con 0x7fbb50161720 2023-12-22T08:53:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.173+0000 7fbb56d01640 1 -- 172.21.15.38:0/424743090 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb501f2a90 con 0x7fbb50161720 2023-12-22T08:53:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.173+0000 7fbb56d01640 1 -- 172.21.15.38:0/424743090 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb50153310 con 0x7fbb50161720 2023-12-22T08:53:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.174+0000 7fbb56d01640 1 -- 172.21.15.38:0/424743090 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb501e8c90 con 0x7fbb50161720 2023-12-22T08:53:00.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.175+0000 7fbb467fc640 1 -- 172.21.15.38:0/424743090 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbb48040b60 con 0x7fbb50161720 2023-12-22T08:53:00.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.176+0000 7fbb467fc640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb3406a430 0x7fbb3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:00.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.176+0000 7fbb467fc640 1 -- 172.21.15.38:0/424743090 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbb480ab360 con 0x7fbb50161720 2023-12-22T08:53:00.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.177+0000 7fbb55cff640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb3406a430 0x7fbb3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:00.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.178+0000 7fbb55cff640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb3406a430 0x7fbb3406c8f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c007f70 tx=0x7fbb4c007f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:00.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.181+0000 7fbb467fc640 1 -- 172.21.15.38:0/424743090 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbb501e8c90 con 0x7fbb50161720 2023-12-22T08:53:00.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.446+0000 7fbb56d01640 1 -- 172.21.15.38:0/424743090 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbb50061910 con 0x7fbb50161720 2023-12-22T08:53:00.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.447+0000 7fbb467fc640 1 -- 172.21.15.38:0/424743090 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbb48076c90 con 0x7fbb50161720 2023-12-22T08:53:00.448 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:00.448 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:53:00.448 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_dump": [ 2023-12-22T08:53:00.448 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.448 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.a", 2023-12-22T08:53:00.448 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl57dkCBAAeliJIPc49iRBk2mp8WYv8A==", 2023-12-22T08:53:00.448 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.448 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:53:00.448 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:53:00.448 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:53:00.448 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.449 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.449 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.449 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.449 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.b", 2023-12-22T08:53:00.449 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl0C0+KhAAkCsjfyn19nOz1xTyhZkbPQ==", 2023-12-22T08:53:00.449 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.449 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:53:00.449 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:53:00.449 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:53:00.449 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.449 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.449 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.449 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.450 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.c", 2023-12-22T08:53:00.450 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4Vl7poXGhAA+ZSohyj4dAOs6B5dZKTLAg==", 2023-12-22T08:53:00.450 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.450 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:53:00.450 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:53:00.450 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:53:00.450 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.450 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.450 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.450 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.450 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mds.d", 2023-12-22T08:53:00.450 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA4S4VlTBuoOhAArKX4AiOQRGawIyAnInIhCg==", 2023-12-22T08:53:00.450 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.0", 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VlnVQaChAAxfWmPqwo5D4qBYkAP/6dHQ==", 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.452 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.452 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.452 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.1", 2023-12-22T08:53:00.452 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4Vll2dlGxAAbqx4rxnz4FWIKl9OGqcwtw==", 2023-12-22T08:53:00.452 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.452 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:53:00.452 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:53:00.452 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.453 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.453 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.453 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.453 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.2", 2023-12-22T08:53:00.453 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBBS4VljQ3HLRAAfyrtqD4n6Da8Rl/6UKmv7g==", 2023-12-22T08:53:00.453 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.453 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:53:00.453 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:53:00.454 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.454 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.454 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.454 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.454 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.3", 2023-12-22T08:53:00.454 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBCS4VlOat4AxAAIkAGRvGGWrrwx/ppMbexWQ==", 2023-12-22T08:53:00.454 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.454 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:53:00.454 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:53:00.454 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.454 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.4", 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlwg7TDxAA+L504F+Hw/6FTJ63cV3ZXg==", 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.5", 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx8zgHxAALBDm/sSYqw/fn4nLNQbu4A==", 2023-12-22T08:53:00.455 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.6", 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBGS4Vlx5OdLxAAaMP09nYI3HKiuhPARgnCOw==", 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.456 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "osd.7", 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQBHS4Vl/15bBBAA4maatkcgA0axcZY/L9r/IA==", 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow profile osd", 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile osd", 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.0", 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlgDspDhAA0TWGbk4AbuOhCNotPej29A==", 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.457 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow r", 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.1", 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlwSk/JhAAM3faae43p4/gw9BmyxLpJA==", 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.458 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.2", 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VliOHMGhAARaM8FC/0maNMToLGhBR4Tg==", 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.3", 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA5S4VlV/MVMRAAyN1643IAOTLOLuz4DqMZ8A==", 2023-12-22T08:53:00.459 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow", 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow r", 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow rw", 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow rwx" 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "client.admin", 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA2S4VlBhogNhAACBsSGP7kmhCSn+XAKkvgKQ==", 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": "allow *", 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow *", 2023-12-22T08:53:00.460 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.x", 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlTHG+NhAAUNkVtrDuoK2OEsy1HHkt2A==", 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: "entity": "mgr.y", 2023-12-22T08:53:00.461 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "AQA3S4VlED5ALBAAComDf9woKBt/IXcez+Udmg==", 2023-12-22T08:53:00.462 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": { 2023-12-22T08:53:00.462 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": "allow *", 2023-12-22T08:53:00.462 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": "allow profile mgr", 2023-12-22T08:53:00.462 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": "allow *" 2023-12-22T08:53:00.462 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.462 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:00.462 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:00.462 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:53:00.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.449+0000 7fbb56d01640 1 -- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb3406a430 msgr2=0x7fbb3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:00.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.449+0000 7fbb56d01640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb3406a430 0x7fbb3406c8f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c007f70 tx=0x7fbb4c007f00 comp rx=0 tx=0).stop 2023-12-22T08:53:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.449+0000 7fbb56d01640 1 -- 172.21.15.38:0/424743090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb50161720 msgr2=0x7fbb501e8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.449+0000 7fbb56d01640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb50161720 0x7fbb501e8f70 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009d90 tx=0x7fbb48004a40 comp rx=0 tx=0).stop 2023-12-22T08:53:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.449+0000 7fbb56d01640 1 -- 172.21.15.38:0/424743090 shutdown_connections 2023-12-22T08:53:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.449+0000 7fbb56d01640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fbb3406a430 0x7fbb3406c8f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.449+0000 7fbb56d01640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb50161720 0x7fbb501e8f70 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.449+0000 7fbb56d01640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb50161340 0x7fbb501f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.449+0000 7fbb56d01640 1 --2- 172.21.15.38:0/424743090 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb50070260 0x7fbb50153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.449+0000 7fbb56d01640 1 -- 172.21.15.38:0/424743090 >> 172.21.15.38:0/424743090 conn(0x7fbb500b1f70 msgr2=0x7fbb500ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.450+0000 7fbb56d01640 1 -- 172.21.15.38:0/424743090 shutdown_connections 2023-12-22T08:53:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.450+0000 7fbb56d01640 1 -- 172.21.15.38:0/424743090 wait complete. 2023-12-22T08:53:00.469 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:53:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.692+0000 7f680359e640 1 Processor -- start 2023-12-22T08:53:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.693+0000 7f680359e640 1 -- start start 2023-12-22T08:53:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.694+0000 7f680359e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6804157980 0x7f680415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.694+0000 7f680359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f680406d640 0x7f68040d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.694+0000 7f680359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040d1520 con 0x7f68040b3ff0 2023-12-22T08:53:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.694+0000 7f680359e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040d1800 con 0x7f6804157980 2023-12-22T08:53:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.694+0000 7f680359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68040d1ae0 con 0x7f680406d640 2023-12-22T08:53:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.695+0000 7f680259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6804157980 0x7f680415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.695+0000 7f680259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6804157980 0x7f680415eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34764/0 (socket says 172.21.15.38:34764) 2023-12-22T08:53:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.695+0000 7f680259c640 1 -- 172.21.15.38:0/3206242028 learned_addr learned my addr 172.21.15.38:0/3206242028 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.695+0000 7f680259c640 1 -- 172.21.15.38:0/3206242028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f680406d640 msgr2=0x7f68040d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.695+0000 7f680259c640 1 --2- 172.21.15.38:0/3206242028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f680406d640 0x7f68040d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.695+0000 7f680259c640 1 -- 172.21.15.38:0/3206242028 >> v1:172.21.15.89:6789/0 conn(0x7f68040b3ff0 legacy=0x7f680406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.695+0000 7f680259c640 1 -- 172.21.15.38:0/3206242028 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040d1dc0 con 0x7f6804157980 2023-12-22T08:53:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.696+0000 7f680259c640 1 --2- 172.21.15.38:0/3206242028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6804157980 0x7f680415eb10 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009e50 tx=0x7f67f402bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139a0c337ec63725 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.697+0000 7f680159a640 1 -- 172.21.15.38:0/3206242028 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f402caa0 con 0x7f6804157980 2023-12-22T08:53:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.697+0000 7f680159a640 1 -- 172.21.15.38:0/3206242028 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f402cc00 con 0x7f6804157980 2023-12-22T08:53:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.697+0000 7f680159a640 1 -- 172.21.15.38:0/3206242028 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f40343f0 con 0x7f6804157980 2023-12-22T08:53:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.697+0000 7f680359e640 1 -- 172.21.15.38:0/3206242028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6804157980 msgr2=0x7f680415eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.697+0000 7f680359e640 1 --2- 172.21.15.38:0/3206242028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6804157980 0x7f680415eb10 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009e50 tx=0x7f67f402bf00 comp rx=0 tx=0).stop 2023-12-22T08:53:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.698+0000 7f680359e640 1 -- 172.21.15.38:0/3206242028 shutdown_connections 2023-12-22T08:53:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.698+0000 7f680359e640 1 --2- 172.21.15.38:0/3206242028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f680406d640 0x7f68040d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.698+0000 7f680359e640 1 --2- 172.21.15.38:0/3206242028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6804157980 0x7f680415eb10 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.698+0000 7f680359e640 1 -- 172.21.15.38:0/3206242028 >> 172.21.15.38:0/3206242028 conn(0x7f68040d31f0 msgr2=0x7f68040d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.698+0000 7f680359e640 1 -- 172.21.15.38:0/3206242028 shutdown_connections 2023-12-22T08:53:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.698+0000 7f680359e640 1 -- 172.21.15.38:0/3206242028 wait complete. 2023-12-22T08:53:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.699+0000 7f680359e640 1 Processor -- start 2023-12-22T08:53:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.700+0000 7f680359e640 1 -- start start 2023-12-22T08:53:00.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f680359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f680406d640 0x7f68041f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:00.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f680359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68040b3ff0 0x7f680415a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:00.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f680359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6804157980 0x7f6804140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:00.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f680359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680415ebc0 con 0x7f6804157980 2023-12-22T08:53:00.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f680359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68041f2b80 con 0x7f68040b3ff0 2023-12-22T08:53:00.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f680359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680415dfb0 con 0x7f680406d640 2023-12-22T08:53:00.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f6802d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6804157980 0x7f6804140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:00.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f6802d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6804157980 0x7f6804140ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34772/0 (socket says 172.21.15.38:34772) 2023-12-22T08:53:00.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f6802d9d640 1 -- 172.21.15.38:0/1291243199 learned_addr learned my addr 172.21.15.38:0/1291243199 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:00.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f680259c640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f680406d640 0x7f68041f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:00.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f6801d9b640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68040b3ff0 0x7f680415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:00.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f6802d9d640 1 -- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f680406d640 msgr2=0x7f68041f2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:00.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f6802d9d640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f680406d640 0x7f68041f2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f6802d9d640 1 -- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68040b3ff0 msgr2=0x7f680415a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:00.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f6802d9d640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68040b3ff0 0x7f680415a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.701+0000 7f6802d9d640 1 -- 172.21.15.38:0/1291243199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f4009b30 con 0x7f6804157980 2023-12-22T08:53:00.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.702+0000 7f6802d9d640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6804157980 0x7f6804140ad0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00b3c0 tx=0x7f67fc00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:00.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.702+0000 7f67f2ffd640 1 -- 172.21.15.38:0/1291243199 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc011830 con 0x7f6804157980 2023-12-22T08:53:00.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.702+0000 7f67f2ffd640 1 -- 172.21.15.38:0/1291243199 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc0119b0 con 0x7f6804157980 2023-12-22T08:53:00.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.702+0000 7f67f2ffd640 1 -- 172.21.15.38:0/1291243199 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc011d60 con 0x7f6804157980 2023-12-22T08:53:00.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.702+0000 7f680359e640 1 -- 172.21.15.38:0/1291243199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680415e290 con 0x7f6804157980 2023-12-22T08:53:00.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.702+0000 7f680359e640 1 -- 172.21.15.38:0/1291243199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680415e850 con 0x7f6804157980 2023-12-22T08:53:00.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.704+0000 7f680359e640 1 -- 172.21.15.38:0/1291243199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680415ed70 con 0x7f6804157980 2023-12-22T08:53:00.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.705+0000 7f67f2ffd640 1 -- 172.21.15.38:0/1291243199 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f67fc01b460 con 0x7f6804157980 2023-12-22T08:53:00.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.705+0000 7f67f2ffd640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f67e406a430 0x7f67e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:00.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.705+0000 7f67f2ffd640 1 -- 172.21.15.38:0/1291243199 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f67fc088430 con 0x7f6804157980 2023-12-22T08:53:00.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.706+0000 7f680259c640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f67e406a430 0x7f67e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:00.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.707+0000 7f680259c640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f67e406a430 0x7f67e406c8f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f67f4035000 tx=0x7f67f4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:00.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.711+0000 7f67f2ffd640 1 -- 172.21.15.38:0/1291243199 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f67fc053ce0 con 0x7f6804157980 2023-12-22T08:53:00.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.905+0000 7f680359e640 1 -- 172.21.15.38:0/1291243199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6804061910 con 0x7f6804157980 2023-12-22T08:53:00.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.910+0000 7f67f2ffd640 1 -- 172.21.15.38:0/1291243199 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+12352 (secure 0 0 0) 0x7f67fc057300 con 0x7f6804157980 2023-12-22T08:53:00.911 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:00.911 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":186,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:52:59.885602+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:53:00.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.913+0000 7f680359e640 1 -- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f67e406a430 msgr2=0x7f67e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:00.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.913+0000 7f680359e640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f67e406a430 0x7f67e406c8f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f67f4035000 tx=0x7f67f4030000 comp rx=0 tx=0).stop 2023-12-22T08:53:00.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.913+0000 7f680359e640 1 -- 172.21.15.38:0/1291243199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6804157980 msgr2=0x7f6804140ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:00.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.913+0000 7f680359e640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6804157980 0x7f6804140ad0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00b3c0 tx=0x7f67fc00b880 comp rx=0 tx=0).stop 2023-12-22T08:53:00.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.913+0000 7f680359e640 1 -- 172.21.15.38:0/1291243199 shutdown_connections 2023-12-22T08:53:00.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.913+0000 7f680359e640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f67e406a430 0x7f67e406c8f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.913+0000 7f680359e640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6804157980 0x7f6804140ad0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.913+0000 7f680359e640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68040b3ff0 0x7f680415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.913+0000 7f680359e640 1 --2- 172.21.15.38:0/1291243199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f680406d640 0x7f68041f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:00.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.913+0000 7f680359e640 1 -- 172.21.15.38:0/1291243199 >> 172.21.15.38:0/1291243199 conn(0x7f68040d31f0 msgr2=0x7f68040d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:00.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.913+0000 7f680359e640 1 -- 172.21.15.38:0/1291243199 shutdown_connections 2023-12-22T08:53:00.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:00.913+0000 7f680359e640 1 -- 172.21.15.38:0/1291243199 wait complete. 2023-12-22T08:53:00.931 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:53:00.931 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:53:01.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.152+0000 7feec4de0640 1 Processor -- start 2023-12-22T08:53:01.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.153+0000 7feec4de0640 1 -- start start 2023-12-22T08:53:01.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.154+0000 7feec4de0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec0144b80 0x7feec00d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:01.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.154+0000 7feec4de0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feec006d800 0x7feec006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:01.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.154+0000 7feec4de0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec006e190 con 0x7feec0144f60 2023-12-22T08:53:01.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.155+0000 7feec4de0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec00d0920 con 0x7feec006d800 2023-12-22T08:53:01.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.155+0000 7feec4de0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec00b48d0 con 0x7feec0144b80 2023-12-22T08:53:01.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.155+0000 7feebe59c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec0144b80 0x7feec00d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:01.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.155+0000 7feebe59c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec0144b80 0x7feec00d03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:34002/0 (socket says 172.21.15.38:34002) 2023-12-22T08:53:01.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.155+0000 7feebe59c640 1 -- 172.21.15.38:0/2955900950 learned_addr learned my addr 172.21.15.38:0/2955900950 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:01.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.156+0000 7feebed9d640 1 --2- 172.21.15.38:0/2955900950 >> v2:172.21.15.89:3300/0 conn(0x7feec006d800 0x7feec006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:01.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.156+0000 7feebe59c640 1 -- 172.21.15.38:0/2955900950 >> v2:172.21.15.89:3300/0 conn(0x7feec006d800 msgr2=0x7feec006dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:01.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.156+0000 7feebe59c640 1 --2- 172.21.15.38:0/2955900950 >> v2:172.21.15.89:3300/0 conn(0x7feec006d800 0x7feec006dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.156+0000 7feebe59c640 1 -- 172.21.15.38:0/2955900950 >> v1:172.21.15.89:6789/0 conn(0x7feec0144f60 legacy=0x7feec00b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:01.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.156+0000 7feebe59c640 1 -- 172.21.15.38:0/2955900950 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec00cf900 con 0x7feec0144b80 2023-12-22T08:53:01.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.157+0000 7feebe59c640 1 --2- 172.21.15.38:0/2955900950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec0144b80 0x7feec00d03e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009870 tx=0x7feeb002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=358fca7e902ffe4e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:01.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.158+0000 7feebdd9b640 1 -- 172.21.15.38:0/2955900950 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0030840 con 0x7feec0144b80 2023-12-22T08:53:01.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.158+0000 7feebdd9b640 1 -- 172.21.15.38:0/2955900950 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb00309a0 con 0x7feec0144b80 2023-12-22T08:53:01.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.158+0000 7feebdd9b640 1 -- 172.21.15.38:0/2955900950 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0030d30 con 0x7feec0144b80 2023-12-22T08:53:01.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.158+0000 7feec4de0640 1 -- 172.21.15.38:0/2955900950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec0144b80 msgr2=0x7feec00d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:01.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.158+0000 7feec4de0640 1 --2- 172.21.15.38:0/2955900950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec0144b80 0x7feec00d03e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009870 tx=0x7feeb002b980 comp rx=0 tx=0).stop 2023-12-22T08:53:01.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.158+0000 7feec4de0640 1 -- 172.21.15.38:0/2955900950 shutdown_connections 2023-12-22T08:53:01.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.158+0000 7feec4de0640 1 --2- 172.21.15.38:0/2955900950 >> v2:172.21.15.89:3300/0 conn(0x7feec006d800 0x7feec006dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.158+0000 7feec4de0640 1 --2- 172.21.15.38:0/2955900950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec0144b80 0x7feec00d03e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.159+0000 7feec4de0640 1 -- 172.21.15.38:0/2955900950 >> 172.21.15.38:0/2955900950 conn(0x7feec006c5e0 msgr2=0x7feec006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:01.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.159+0000 7feec4de0640 1 -- 172.21.15.38:0/2955900950 shutdown_connections 2023-12-22T08:53:01.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.159+0000 7feec4de0640 1 -- 172.21.15.38:0/2955900950 wait complete. 2023-12-22T08:53:01.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.160+0000 7feec4de0640 1 Processor -- start 2023-12-22T08:53:01.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.161+0000 7feec4de0640 1 -- start start 2023-12-22T08:53:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feec4de0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec006d800 0x7feec01f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feec4de0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec0144b80 0x7feec00b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feec4de0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec0144f60 0x7feec00b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feec4de0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec01f3f50 con 0x7feec0144f60 2023-12-22T08:53:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feec4de0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec01f3810 con 0x7feec0144b80 2023-12-22T08:53:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feec4de0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec00c71c0 con 0x7feec006d800 2023-12-22T08:53:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feebed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec0144f60 0x7feec00b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:01.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feebed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec0144f60 0x7feec00b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38692/0 (socket says 172.21.15.38:38692) 2023-12-22T08:53:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feebed9d640 1 -- 172.21.15.38:0/1282487613 learned_addr learned my addr 172.21.15.38:0/1282487613 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feebe59c640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec006d800 0x7feec01f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feeb7fff640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec0144b80 0x7feec00b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feebed9d640 1 -- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec006d800 msgr2=0x7feec01f32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feebed9d640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec006d800 0x7feec01f32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feebed9d640 1 -- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec0144b80 msgr2=0x7feec00b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feebed9d640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec0144b80 0x7feec00b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feebed9d640 1 -- 172.21.15.38:0/1282487613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00094d0 con 0x7feec0144f60 2023-12-22T08:53:01.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.162+0000 7feeb7fff640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec0144b80 0x7feec00b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.163+0000 7feebed9d640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec0144f60 0x7feec00b18b0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7feeb800cd70 tx=0x7feeb800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.163+0000 7feeb6ffd640 1 -- 172.21.15.38:0/1282487613 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8003b90 con 0x7feec0144f60 2023-12-22T08:53:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.163+0000 7feeb6ffd640 1 -- 172.21.15.38:0/1282487613 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb8003cf0 con 0x7feec0144f60 2023-12-22T08:53:01.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.163+0000 7feeb6ffd640 1 -- 172.21.15.38:0/1282487613 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8004240 con 0x7feec0144f60 2023-12-22T08:53:01.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.163+0000 7feec4de0640 1 -- 172.21.15.38:0/1282487613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec00c6640 con 0x7feec0144f60 2023-12-22T08:53:01.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.163+0000 7feec4de0640 1 -- 172.21.15.38:0/1282487613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec00c6c00 con 0x7feec0144f60 2023-12-22T08:53:01.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.164+0000 7feec4de0640 1 -- 172.21.15.38:0/1282487613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec01f3d20 con 0x7feec0144f60 2023-12-22T08:53:01.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.165+0000 7feeb6ffd640 1 -- 172.21.15.38:0/1282487613 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feeb80043a0 con 0x7feec0144f60 2023-12-22T08:53:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.167+0000 7feeb6ffd640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feea006a430 0x7feea006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:01.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.167+0000 7feeb6ffd640 1 -- 172.21.15.38:0/1282487613 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feeb8012070 con 0x7feec0144f60 2023-12-22T08:53:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.167+0000 7feebe59c640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feea006a430 0x7feea006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:01.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.169+0000 7feebe59c640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feea006a430 0x7feea006c8f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7feeb0036000 tx=0x7feeb0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:01.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.171+0000 7feeb6ffd640 1 -- 172.21.15.38:0/1282487613 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feec01f3d20 con 0x7feec0144f60 2023-12-22T08:53:01.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.367+0000 7feec4de0640 1 -- 172.21.15.38:0/1282487613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feec01f3d20 con 0x7feec0144f60 2023-12-22T08:53:01.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.368+0000 7feeb6ffd640 1 -- 172.21.15.38:0/1282487613 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v186) v1 ==== 93+0+10 (secure 0 0 0) 0x7feec01f3d20 con 0x7feec0144f60 2023-12-22T08:53:01.368 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:53:01.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.370+0000 7feec4de0640 1 -- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feea006a430 msgr2=0x7feea006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:01.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.370+0000 7feec4de0640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feea006a430 0x7feea006c8f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7feeb0036000 tx=0x7feeb0008030 comp rx=0 tx=0).stop 2023-12-22T08:53:01.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.370+0000 7feec4de0640 1 -- 172.21.15.38:0/1282487613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec0144f60 msgr2=0x7feec00b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:01.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.370+0000 7feec4de0640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec0144f60 0x7feec00b18b0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7feeb800cd70 tx=0x7feeb800a660 comp rx=0 tx=0).stop 2023-12-22T08:53:01.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.370+0000 7feec4de0640 1 -- 172.21.15.38:0/1282487613 shutdown_connections 2023-12-22T08:53:01.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.370+0000 7feec4de0640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feea006a430 0x7feea006c8f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.370+0000 7feec4de0640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec0144f60 0x7feec00b18b0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.370+0000 7feec4de0640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec0144b80 0x7feec00b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.370+0000 7feec4de0640 1 --2- 172.21.15.38:0/1282487613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec006d800 0x7feec01f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.370+0000 7feec4de0640 1 -- 172.21.15.38:0/1282487613 >> 172.21.15.38:0/1282487613 conn(0x7feec006c5e0 msgr2=0x7feec006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:01.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.370+0000 7feec4de0640 1 -- 172.21.15.38:0/1282487613 shutdown_connections 2023-12-22T08:53:01.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.370+0000 7feec4de0640 1 -- 172.21.15.38:0/1282487613 wait complete. 2023-12-22T08:53:01.392 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T08:53:01.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.618+0000 7fe0472b6640 1 Processor -- start 2023-12-22T08:53:01.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.618+0000 7fe0472b6640 1 -- start start 2023-12-22T08:53:01.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.620+0000 7fe0472b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe04009c980 0x7fe04015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:01.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.620+0000 7fe0472b6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe040071460 0x7fe0400718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:01.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.620+0000 7fe0472b6640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe040071df0 con 0x7fe04015b0e0 2023-12-22T08:53:01.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.620+0000 7fe0472b6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04015edf0 con 0x7fe040071460 2023-12-22T08:53:01.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.620+0000 7fe0472b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04015bd90 con 0x7fe04009c980 2023-12-22T08:53:01.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.620+0000 7fe046ab5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe040071460 0x7fe0400718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:01.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.621+0000 7fe046ab5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe040071460 0x7fe0400718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38698/0 (socket says 172.21.15.38:38698) 2023-12-22T08:53:01.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.621+0000 7fe046ab5640 1 -- 172.21.15.38:0/425456443 learned_addr learned my addr 172.21.15.38:0/425456443 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:01.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.621+0000 7fe045ab3640 1 --2- 172.21.15.38:0/425456443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe04009c980 0x7fe04015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:01.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.621+0000 7fe046ab5640 1 -- 172.21.15.38:0/425456443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe04009c980 msgr2=0x7fe04015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:01.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.621+0000 7fe046ab5640 1 --2- 172.21.15.38:0/425456443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe04009c980 0x7fe04015c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.621+0000 7fe046ab5640 1 -- 172.21.15.38:0/425456443 >> v1:172.21.15.89:6789/0 conn(0x7fe04015b0e0 legacy=0x7fe04015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:01.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.621+0000 7fe046ab5640 1 -- 172.21.15.38:0/425456443 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04015c070 con 0x7fe040071460 2023-12-22T08:53:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.622+0000 7fe046ab5640 1 --2- 172.21.15.38:0/425456443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe040071460 0x7fe0400718b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fe038009e50 tx=0x7fe03802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930b1ea931eb85d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.623+0000 7fe0452b2640 1 -- 172.21.15.38:0/425456443 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03802c9e0 con 0x7fe040071460 2023-12-22T08:53:01.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.623+0000 7fe0452b2640 1 -- 172.21.15.38:0/425456443 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03802cb40 con 0x7fe040071460 2023-12-22T08:53:01.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.623+0000 7fe0452b2640 1 -- 172.21.15.38:0/425456443 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0380343f0 con 0x7fe040071460 2023-12-22T08:53:01.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.623+0000 7fe0472b6640 1 -- 172.21.15.38:0/425456443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe040071460 msgr2=0x7fe0400718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:01.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.623+0000 7fe0472b6640 1 --2- 172.21.15.38:0/425456443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe040071460 0x7fe0400718b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fe038009e50 tx=0x7fe03802be40 comp rx=0 tx=0).stop 2023-12-22T08:53:01.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.624+0000 7fe0472b6640 1 -- 172.21.15.38:0/425456443 shutdown_connections 2023-12-22T08:53:01.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.624+0000 7fe0472b6640 1 --2- 172.21.15.38:0/425456443 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe040071460 0x7fe0400718b0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.624+0000 7fe0472b6640 1 --2- 172.21.15.38:0/425456443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe04009c980 0x7fe04015c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.624+0000 7fe0472b6640 1 -- 172.21.15.38:0/425456443 >> 172.21.15.38:0/425456443 conn(0x7fe0400cf000 msgr2=0x7fe0400cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:01.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.624+0000 7fe0472b6640 1 -- 172.21.15.38:0/425456443 shutdown_connections 2023-12-22T08:53:01.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.624+0000 7fe0472b6640 1 -- 172.21.15.38:0/425456443 wait complete. 2023-12-22T08:53:01.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.626+0000 7fe0472b6640 1 Processor -- start 2023-12-22T08:53:01.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.626+0000 7fe0472b6640 1 -- start start 2023-12-22T08:53:01.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe0472b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe040071460 0x7fe04009b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:01.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe0472b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe04009c980 0x7fe040157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:01.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe0472b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe04015b0e0 0x7fe040149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:01.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe0472b6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04014a7f0 con 0x7fe04009c980 2023-12-22T08:53:01.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe0472b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0400a17e0 con 0x7fe040071460 2023-12-22T08:53:01.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe0472b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0400a1ac0 con 0x7fe04015b0e0 2023-12-22T08:53:01.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe045ab3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe04009c980 0x7fe040157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:01.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe045ab3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe04009c980 0x7fe040157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38712/0 (socket says 172.21.15.38:38712) 2023-12-22T08:53:01.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe045ab3640 1 -- 172.21.15.38:0/2537804145 learned_addr learned my addr 172.21.15.38:0/2537804145 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:01.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe0462b4640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe040071460 0x7fe04009b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:01.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe046ab5640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe04015b0e0 0x7fe040149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:01.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe045ab3640 1 -- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe04015b0e0 msgr2=0x7fe040149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:01.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe045ab3640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe04015b0e0 0x7fe040149eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe045ab3640 1 -- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe040071460 msgr2=0x7fe04009b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:01.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.628+0000 7fe045ab3640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe040071460 0x7fe04009b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.629+0000 7fe045ab3640 1 -- 172.21.15.38:0/2537804145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe038009b30 con 0x7fe04009c980 2023-12-22T08:53:01.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.629+0000 7fe045ab3640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe04009c980 0x7fe040157500 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fe03000d800 tx=0x7fe03000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:01.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.629+0000 7fe036ffd640 1 -- 172.21.15.38:0/2537804145 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03000b6c0 con 0x7fe04009c980 2023-12-22T08:53:01.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.629+0000 7fe036ffd640 1 -- 172.21.15.38:0/2537804145 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03000b820 con 0x7fe04009c980 2023-12-22T08:53:01.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.629+0000 7fe036ffd640 1 -- 172.21.15.38:0/2537804145 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03000bbb0 con 0x7fe04009c980 2023-12-22T08:53:01.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.629+0000 7fe0472b6640 1 -- 172.21.15.38:0/2537804145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0400a1da0 con 0x7fe04009c980 2023-12-22T08:53:01.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.629+0000 7fe0472b6640 1 -- 172.21.15.38:0/2537804145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0400a2360 con 0x7fe04009c980 2023-12-22T08:53:01.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.631+0000 7fe0472b6640 1 -- 172.21.15.38:0/2537804145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0400a2520 con 0x7fe04009c980 2023-12-22T08:53:01.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.632+0000 7fe036ffd640 1 -- 172.21.15.38:0/2537804145 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe03000bd10 con 0x7fe04009c980 2023-12-22T08:53:01.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.633+0000 7fe036ffd640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe02406a430 0x7fe02406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:01.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.633+0000 7fe036ffd640 1 -- 172.21.15.38:0/2537804145 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe030088b20 con 0x7fe04009c980 2023-12-22T08:53:01.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.633+0000 7fe0462b4640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe02406a430 0x7fe02406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:01.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.634+0000 7fe0462b4640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe02406a430 0x7fe02406c8f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe03c000f60 tx=0x7fe03c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:01.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.637+0000 7fe036ffd640 1 -- 172.21.15.38:0/2537804145 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe030054450 con 0x7fe04009c980 2023-12-22T08:53:01.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.831+0000 7fe0472b6640 1 -- 172.21.15.38:0/2537804145 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe040061910 con 0x7fe04009c980 2023-12-22T08:53:01.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.832+0000 7fe036ffd640 1 -- 172.21.15.38:0/2537804145 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v186) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe030057a70 con 0x7fe04009c980 2023-12-22T08:53:01.833 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:01.833 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-12-22T08:53:01.833 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:01.833 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-12-22T08:53:01.833 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2023-12-22T08:53:01.833 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:01.833 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-12-22T08:53:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.835+0000 7fe0472b6640 1 -- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe02406a430 msgr2=0x7fe02406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.835+0000 7fe0472b6640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe02406a430 0x7fe02406c8f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe03c000f60 tx=0x7fe03c009040 comp rx=0 tx=0).stop 2023-12-22T08:53:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.835+0000 7fe0472b6640 1 -- 172.21.15.38:0/2537804145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe04009c980 msgr2=0x7fe040157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.835+0000 7fe0472b6640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe04009c980 0x7fe040157500 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fe03000d800 tx=0x7fe03000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.835+0000 7fe0472b6640 1 -- 172.21.15.38:0/2537804145 shutdown_connections 2023-12-22T08:53:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.835+0000 7fe0472b6640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe04015b0e0 0x7fe040149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.835+0000 7fe0472b6640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe02406a430 0x7fe02406c8f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.835+0000 7fe0472b6640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe04009c980 0x7fe040157500 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.835+0000 7fe0472b6640 1 --2- 172.21.15.38:0/2537804145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe040071460 0x7fe04009b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:01.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.835+0000 7fe0472b6640 1 -- 172.21.15.38:0/2537804145 >> 172.21.15.38:0/2537804145 conn(0x7fe0400cf000 msgr2=0x7fe0400b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:01.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.835+0000 7fe0472b6640 1 -- 172.21.15.38:0/2537804145 shutdown_connections 2023-12-22T08:53:01.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:01.835+0000 7fe0472b6640 1 -- 172.21.15.38:0/2537804145 wait complete. 2023-12-22T08:53:01.855 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T08:53:01.856 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T08:53:02.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.087+0000 7fd1c28bd640 1 Processor -- start 2023-12-22T08:53:02.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.088+0000 7fd1c28bd640 1 -- start start 2023-12-22T08:53:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.089+0000 7fd1c28bd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1bc15b2c0 0x7fd1bc0b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.089+0000 7fd1c28bd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd1bc0b43a0 0x7fd1bc0b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.089+0000 7fd1c28bd640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc0b5480 con 0x7fd1bc15aee0 2023-12-22T08:53:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.089+0000 7fd1c28bd640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0b3a40 con 0x7fd1bc0b43a0 2023-12-22T08:53:02.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.089+0000 7fd1c28bd640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0b36a0 con 0x7fd1bc15b2c0 2023-12-22T08:53:02.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.090+0000 7fd1bbfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd1bc15aee0 0x7fd1bc0b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52868/0 (socket says 172.21.15.38:52868) 2023-12-22T08:53:02.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.090+0000 7fd1bbfff640 1 -- 172.21.15.38:0/1291630243 learned_addr learned my addr 172.21.15.38:0/1291630243 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:02.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.090+0000 7fd1c0e5a640 1 --2- 172.21.15.38:0/1291630243 >> v2:172.21.15.38:3300/0 conn(0x7fd1bc0b43a0 0x7fd1bc0b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:02.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.090+0000 7fd1b3fff640 1 --2- 172.21.15.38:0/1291630243 >> v2:172.21.15.89:3300/0 conn(0x7fd1bc15b2c0 0x7fd1bc0b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:02.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.090+0000 7fd1bb7fe640 1 -- 172.21.15.38:0/1291630243 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427418139 0 0) 0x7fd1bc0b5480 con 0x7fd1bc15aee0 2023-12-22T08:53:02.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.090+0000 7fd1bb7fe640 1 -- 172.21.15.38:0/1291630243 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a8003520 con 0x7fd1bc15aee0 2023-12-22T08:53:02.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.090+0000 7fd1c0e5a640 1 -- 172.21.15.38:0/1291630243 >> v2:172.21.15.89:3300/0 conn(0x7fd1bc15b2c0 msgr2=0x7fd1bc0b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:02.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.090+0000 7fd1c0e5a640 1 --2- 172.21.15.38:0/1291630243 >> v2:172.21.15.89:3300/0 conn(0x7fd1bc15b2c0 0x7fd1bc0b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:02.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.090+0000 7fd1c0e5a640 1 -- 172.21.15.38:0/1291630243 >> v1:172.21.15.38:6789/0 conn(0x7fd1bc15aee0 legacy=0x7fd1bc0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:02.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.090+0000 7fd1c0e5a640 1 -- 172.21.15.38:0/1291630243 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0b56e0 con 0x7fd1bc0b43a0 2023-12-22T08:53:02.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.092+0000 7fd1c0e5a640 1 --2- 172.21.15.38:0/1291630243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1bc0b43a0 0x7fd1bc0b8a00 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0d2410 tx=0x7fd1b402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba6b3828c0c6bb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:02.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.092+0000 7fd1bb7fe640 1 -- 172.21.15.38:0/1291630243 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b402cbe0 con 0x7fd1bc0b43a0 2023-12-22T08:53:02.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.092+0000 7fd1bb7fe640 1 -- 172.21.15.38:0/1291630243 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b402cd40 con 0x7fd1bc0b43a0 2023-12-22T08:53:02.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.092+0000 7fd1bb7fe640 1 -- 172.21.15.38:0/1291630243 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4034640 con 0x7fd1bc0b43a0 2023-12-22T08:53:02.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.093+0000 7fd1c28bd640 1 -- 172.21.15.38:0/1291630243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1bc0b43a0 msgr2=0x7fd1bc0b8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:02.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.093+0000 7fd1c28bd640 1 --2- 172.21.15.38:0/1291630243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1bc0b43a0 0x7fd1bc0b8a00 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0d2410 tx=0x7fd1b402be30 comp rx=0 tx=0).stop 2023-12-22T08:53:02.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.093+0000 7fd1c28bd640 1 -- 172.21.15.38:0/1291630243 shutdown_connections 2023-12-22T08:53:02.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.093+0000 7fd1c28bd640 1 --2- 172.21.15.38:0/1291630243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1bc0b43a0 0x7fd1bc0b8a00 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:02.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.093+0000 7fd1c28bd640 1 --2- 172.21.15.38:0/1291630243 >> v2:172.21.15.89:3300/0 conn(0x7fd1bc15b2c0 0x7fd1bc0b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:02.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.093+0000 7fd1c28bd640 1 -- 172.21.15.38:0/1291630243 >> 172.21.15.38:0/1291630243 conn(0x7fd1bc070770 msgr2=0x7fd1bc070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:02.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.093+0000 7fd1c28bd640 1 -- 172.21.15.38:0/1291630243 shutdown_connections 2023-12-22T08:53:02.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.093+0000 7fd1c28bd640 1 -- 172.21.15.38:0/1291630243 wait complete. 2023-12-22T08:53:02.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.095+0000 7fd1c28bd640 1 Processor -- start 2023-12-22T08:53:02.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.095+0000 7fd1c28bd640 1 -- start start 2023-12-22T08:53:02.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.096+0000 7fd1c28bd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1bc15aee0 0x7fd1bc0b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:02.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.096+0000 7fd1c28bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1bc1499c0 0x7fd1bc15c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:02.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.096+0000 7fd1c28bd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1bc15cdd0 0x7fd1bc0d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:02.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.096+0000 7fd1c28bd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0b2810 con 0x7fd1bc15aee0 2023-12-22T08:53:02.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.096+0000 7fd1c28bd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0acc60 con 0x7fd1bc1499c0 2023-12-22T08:53:02.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.096+0000 7fd1c28bd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0acf40 con 0x7fd1bc15cdd0 2023-12-22T08:53:02.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.096+0000 7fd1bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1bc15aee0 0x7fd1bc0b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:02.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.096+0000 7fd1bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1bc15aee0 0x7fd1bc0b22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38736/0 (socket says 172.21.15.38:38736) 2023-12-22T08:53:02.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.096+0000 7fd1bbfff640 1 -- 172.21.15.38:0/3037258782 learned_addr learned my addr 172.21.15.38:0/3037258782 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:02.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.097+0000 7fd1b3fff640 1 --2- 172.21.15.38:0/3037258782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1bc1499c0 0x7fd1bc15c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:02.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.097+0000 7fd1bbfff640 1 -- 172.21.15.38:0/3037258782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1bc15cdd0 msgr2=0x7fd1bc0d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:02.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.097+0000 7fd1bbfff640 1 --2- 172.21.15.38:0/3037258782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1bc15cdd0 0x7fd1bc0d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:02.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.097+0000 7fd1bbfff640 1 -- 172.21.15.38:0/3037258782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1bc1499c0 msgr2=0x7fd1bc15c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:02.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.097+0000 7fd1bbfff640 1 --2- 172.21.15.38:0/3037258782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1bc1499c0 0x7fd1bc15c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:02.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.097+0000 7fd1bbfff640 1 -- 172.21.15.38:0/3037258782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4009a70 con 0x7fd1bc15aee0 2023-12-22T08:53:02.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.097+0000 7fd1bbfff640 1 --2- 172.21.15.38:0/3037258782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1bc15aee0 0x7fd1bc0b22d0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0010e0 tx=0x7fd1ac00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:02.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.098+0000 7fd1b97fa640 1 -- 172.21.15.38:0/3037258782 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac005ce0 con 0x7fd1bc15aee0 2023-12-22T08:53:02.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.098+0000 7fd1b97fa640 1 -- 172.21.15.38:0/3037258782 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac005e60 con 0x7fd1bc15aee0 2023-12-22T08:53:02.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.098+0000 7fd1b97fa640 1 -- 172.21.15.38:0/3037258782 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0072b0 con 0x7fd1bc15aee0 2023-12-22T08:53:02.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.098+0000 7fd1c28bd640 1 -- 172.21.15.38:0/3037258782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc0ad220 con 0x7fd1bc15aee0 2023-12-22T08:53:02.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.098+0000 7fd1c28bd640 1 -- 172.21.15.38:0/3037258782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc0ad7e0 con 0x7fd1bc15aee0 2023-12-22T08:53:02.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.099+0000 7fd1c28bd640 1 -- 172.21.15.38:0/3037258782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc061910 con 0x7fd1bc15aee0 2023-12-22T08:53:02.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.100+0000 7fd1b97fa640 1 -- 172.21.15.38:0/3037258782 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1ac007410 con 0x7fd1bc15aee0 2023-12-22T08:53:02.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.101+0000 7fd1b97fa640 1 --2- 172.21.15.38:0/3037258782 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd19c06a430 0x7fd19c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:02.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.101+0000 7fd1b97fa640 1 -- 172.21.15.38:0/3037258782 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd1ac087d10 con 0x7fd1bc15aee0 2023-12-22T08:53:02.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.102+0000 7fd1b3fff640 1 --2- 172.21.15.38:0/3037258782 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd19c06a430 0x7fd19c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:02.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.103+0000 7fd1b3fff640 1 --2- 172.21.15.38:0/3037258782 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd19c06a430 0x7fd19c06c8f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc15d340 tx=0x7fd1a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:02.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.105+0000 7fd1b97fa640 1 -- 172.21.15.38:0/3037258782 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd1ac057040 con 0x7fd1bc15aee0 2023-12-22T08:53:02.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.296+0000 7fd1c28bd640 1 -- 172.21.15.38:0/3037258782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd1bc0ad9a0 con 0x7fd1bc15aee0 2023-12-22T08:53:02.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.946+0000 7fd1b97fa640 1 -- 172.21.15.38:0/3037258782 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v187) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd1ac0170b0 con 0x7fd1bc15aee0 2023-12-22T08:53:02.948 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-12-22T08:53:02.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.951+0000 7fd1c28bd640 1 -- 172.21.15.38:0/3037258782 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd19c06a430 msgr2=0x7fd19c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:02.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.951+0000 7fd1c28bd640 1 --2- 172.21.15.38:0/3037258782 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd19c06a430 0x7fd19c06c8f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc15d340 tx=0x7fd1a4008040 comp rx=0 tx=0).stop 2023-12-22T08:53:02.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.951+0000 7fd1c28bd640 1 -- 172.21.15.38:0/3037258782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1bc15aee0 msgr2=0x7fd1bc0b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:02.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.951+0000 7fd1c28bd640 1 --2- 172.21.15.38:0/3037258782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1bc15aee0 0x7fd1bc0b22d0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0010e0 tx=0x7fd1ac00c960 comp rx=0 tx=0).stop 2023-12-22T08:53:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.954+0000 7fd1c28bd640 1 -- 172.21.15.38:0/3037258782 shutdown_connections 2023-12-22T08:53:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.954+0000 7fd1c28bd640 1 --2- 172.21.15.38:0/3037258782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1bc15cdd0 0x7fd1bc0d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.954+0000 7fd1c28bd640 1 --2- 172.21.15.38:0/3037258782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1bc1499c0 0x7fd1bc15c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.954+0000 7fd1c28bd640 1 --2- 172.21.15.38:0/3037258782 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd19c06a430 0x7fd19c06c8f0 secure :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc15d340 tx=0x7fd1a4008040 comp rx=0 tx=0).stop 2023-12-22T08:53:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.954+0000 7fd1c28bd640 1 --2- 172.21.15.38:0/3037258782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd1bc15aee0 0x7fd1bc0b22d0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.954+0000 7fd1c28bd640 1 -- 172.21.15.38:0/3037258782 >> 172.21.15.38:0/3037258782 conn(0x7fd1bc070770 msgr2=0x7fd1bc15ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.955+0000 7fd1c28bd640 1 -- 172.21.15.38:0/3037258782 shutdown_connections 2023-12-22T08:53:02.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:02.955+0000 7fd1c28bd640 1 -- 172.21.15.38:0/3037258782 wait complete. 2023-12-22T08:53:02.979 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T08:53:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.193+0000 7fa62c500640 1 Processor -- start 2023-12-22T08:53:03.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.193+0000 7fa62c500640 1 -- start start 2023-12-22T08:53:03.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.195+0000 7fa62c500640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6240d1800 0x7fa62415dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:03.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.195+0000 7fa62c500640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa624162200 con 0x7fa624146fc0 2023-12-22T08:53:03.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.195+0000 7fa62c500640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa624161440 con 0x7fa624146be0 2023-12-22T08:53:03.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.195+0000 7fa62c500640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62415ed10 con 0x7fa6240d1800 2023-12-22T08:53:03.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.195+0000 7fa62aa9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa624146fc0 0x7fa62415e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52882/0 (socket says 172.21.15.38:52882) 2023-12-22T08:53:03.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.195+0000 7fa62aa9d640 1 -- 172.21.15.38:0/2939460685 learned_addr learned my addr 172.21.15.38:0/2939460685 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:03.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.196+0000 7fa629a9b640 1 --2- 172.21.15.38:0/2939460685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6240d1800 0x7fa62415dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.196+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952943524 0 0) 0x7fa624162200 con 0x7fa624146fc0 2023-12-22T08:53:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.196+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa610003520 con 0x7fa624146fc0 2023-12-22T08:53:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.196+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3458414426 0 0) 0x7fa610003520 con 0x7fa624146fc0 2023-12-22T08:53:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.196+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6240d1800 msgr2=0x7fa62415dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.196+0000 7fa62929a640 1 --2- 172.21.15.38:0/2939460685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6240d1800 0x7fa62415dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:03.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.196+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 >> v1:172.21.15.89:6789/0 conn(0x7fa624146be0 legacy=0x7fa6240d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.196+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624161720 con 0x7fa624146fc0 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.196+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fa61c0019f0 con 0x7fa624146fc0 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.196+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 >> v1:172.21.15.38:6789/0 conn(0x7fa624146fc0 legacy=0x7fa62415e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa62929a640 1 --2- 172.21.15.38:0/2939460685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6100039a0 0x7fa610003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa62929a640 1 --2- 172.21.15.38:0/2939460685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa610004350 0x7fa610004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa62929a640 1 --2- 172.21.15.38:0/2939460685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6240d1800 0x7fa610005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62415ed10 con 0x7fa610004350 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61000b9b0 con 0x7fa6100039a0 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61000bb70 con 0x7fa6240d1800 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa629a9b640 1 --2- 172.21.15.38:0/2939460685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa610004350 0x7fa610004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa62a29c640 1 --2- 172.21.15.38:0/2939460685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6100039a0 0x7fa610003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa62aa9d640 1 --2- 172.21.15.38:0/2939460685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6240d1800 0x7fa610005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa629a9b640 1 -- 172.21.15.38:0/2939460685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6240d1800 msgr2=0x7fa610005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa629a9b640 1 --2- 172.21.15.38:0/2939460685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6240d1800 0x7fa610005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:03.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa629a9b640 1 -- 172.21.15.38:0/2939460685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6100039a0 msgr2=0x7fa610003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:03.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa629a9b640 1 --2- 172.21.15.38:0/2939460685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6100039a0 0x7fa610003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:03.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.197+0000 7fa629a9b640 1 -- 172.21.15.38:0/2939460685 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa610003520 con 0x7fa610004350 2023-12-22T08:53:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.199+0000 7fa629a9b640 1 --2- 172.21.15.38:0/2939460685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa610004350 0x7fa610004820 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fa614009ac0 tx=0x7fa6100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bcc89e6f3b7fa0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.199+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61402c6b0 con 0x7fa610004350 2023-12-22T08:53:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.199+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61402c810 con 0x7fa610004350 2023-12-22T08:53:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.199+0000 7fa62929a640 1 -- 172.21.15.38:0/2939460685 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61402cba0 con 0x7fa610004350 2023-12-22T08:53:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.199+0000 7fa62c500640 1 -- 172.21.15.38:0/2939460685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa610004350 msgr2=0x7fa610004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.199+0000 7fa62c500640 1 --2- 172.21.15.38:0/2939460685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa610004350 0x7fa610004820 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fa614009ac0 tx=0x7fa6100057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.199+0000 7fa62aa9d640 1 -- 172.21.15.38:0/2939460685 reap_dead start 2023-12-22T08:53:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.200+0000 7fa62c500640 1 -- 172.21.15.38:0/2939460685 shutdown_connections 2023-12-22T08:53:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.200+0000 7fa62c500640 1 -- 172.21.15.38:0/2939460685 >> 172.21.15.38:0/2939460685 conn(0x7fa62406c5e0 msgr2=0x7fa62406c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:03.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.200+0000 7fa62c500640 1 -- 172.21.15.38:0/2939460685 shutdown_connections 2023-12-22T08:53:03.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.200+0000 7fa62c500640 1 -- 172.21.15.38:0/2939460685 wait complete. 2023-12-22T08:53:03.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.201+0000 7fa62c500640 1 Processor -- start 2023-12-22T08:53:03.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.202+0000 7fa62c500640 1 -- start start 2023-12-22T08:53:03.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62c500640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610004350 0x7fa62415cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:03.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62c500640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6240b3740 0x7fa6240ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:03.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62c500640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6240ce680 0x7fa6240b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:03.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62c500640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62415d470 con 0x7fa6240ce680 2023-12-22T08:53:03.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62c500640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6241f3f00 con 0x7fa610004350 2023-12-22T08:53:03.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62c500640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6241f41e0 con 0x7fa6240b3740 2023-12-22T08:53:03.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62aa9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6240ce680 0x7fa6240b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:03.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62aa9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6240ce680 0x7fa6240b6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38750/0 (socket says 172.21.15.38:38750) 2023-12-22T08:53:03.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62aa9d640 1 -- 172.21.15.38:0/3511089038 learned_addr learned my addr 172.21.15.38:0/3511089038 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:03.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa629a9b640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6240b3740 0x7fa6240ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:03.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62a29c640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610004350 0x7fa62415cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:03.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62aa9d640 1 -- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6240b3740 msgr2=0x7fa6240ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:03.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62aa9d640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6240b3740 0x7fa6240ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:03.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62aa9d640 1 -- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610004350 msgr2=0x7fa62415cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:03.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62aa9d640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610004350 0x7fa62415cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:03.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.203+0000 7fa62aa9d640 1 -- 172.21.15.38:0/3511089038 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6241f44c0 con 0x7fa6240ce680 2023-12-22T08:53:03.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.204+0000 7fa62aa9d640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6240ce680 0x7fa6240b6070 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fa62406bef0 tx=0x7fa61c007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:03.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.204+0000 7fa61affd640 1 -- 172.21.15.38:0/3511089038 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c00eb00 con 0x7fa6240ce680 2023-12-22T08:53:03.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.204+0000 7fa61affd640 1 -- 172.21.15.38:0/3511089038 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c00ec60 con 0x7fa6240ce680 2023-12-22T08:53:03.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.204+0000 7fa61affd640 1 -- 172.21.15.38:0/3511089038 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c013420 con 0x7fa6240ce680 2023-12-22T08:53:03.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.204+0000 7fa62c500640 1 -- 172.21.15.38:0/3511089038 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6241f47a0 con 0x7fa6240ce680 2023-12-22T08:53:03.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.204+0000 7fa62c500640 1 -- 172.21.15.38:0/3511089038 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6241f4d60 con 0x7fa6240ce680 2023-12-22T08:53:03.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.205+0000 7fa62c500640 1 -- 172.21.15.38:0/3511089038 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa624061910 con 0x7fa6240ce680 2023-12-22T08:53:03.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.207+0000 7fa61affd640 1 -- 172.21.15.38:0/3511089038 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa61c013580 con 0x7fa6240ce680 2023-12-22T08:53:03.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.207+0000 7fa61affd640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa60806a430 0x7fa60806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:03.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.208+0000 7fa61affd640 1 -- 172.21.15.38:0/3511089038 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa61c088ae0 con 0x7fa6240ce680 2023-12-22T08:53:03.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.208+0000 7fa62a29c640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa60806a430 0x7fa60806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:03.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.209+0000 7fa62a29c640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa60806a430 0x7fa60806c8f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa620005500 tx=0x7fa620000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:03.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.212+0000 7fa61affd640 1 -- 172.21.15.38:0/3511089038 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa61c054360 con 0x7fa6240ce680 2023-12-22T08:53:03.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.407+0000 7fa62c500640 1 -- 172.21.15.38:0/3511089038 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa624145490 con 0x7fa6240ce680 2023-12-22T08:53:03.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.971+0000 7fa61affd640 1 -- 172.21.15.38:0/3511089038 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v188) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa61c057980 con 0x7fa6240ce680 2023-12-22T08:53:03.974 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-12-22T08:53:03.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.978+0000 7fa62c500640 1 -- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa60806a430 msgr2=0x7fa60806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:03.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.978+0000 7fa62c500640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa60806a430 0x7fa60806c8f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa620005500 tx=0x7fa620000bc0 comp rx=0 tx=0).stop 2023-12-22T08:53:03.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.978+0000 7fa62c500640 1 -- 172.21.15.38:0/3511089038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6240ce680 msgr2=0x7fa6240b6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:03.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.978+0000 7fa62c500640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6240ce680 0x7fa6240b6070 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fa62406bef0 tx=0x7fa61c007bc0 comp rx=0 tx=0).stop 2023-12-22T08:53:03.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.979+0000 7fa62c500640 1 -- 172.21.15.38:0/3511089038 shutdown_connections 2023-12-22T08:53:03.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.979+0000 7fa62c500640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa60806a430 0x7fa60806c8f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:03.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.979+0000 7fa62c500640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6240ce680 0x7fa6240b6070 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:03.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.979+0000 7fa62c500640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6240b3740 0x7fa6240ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:03.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.979+0000 7fa62c500640 1 --2- 172.21.15.38:0/3511089038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa610004350 0x7fa62415cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:03.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.979+0000 7fa62c500640 1 -- 172.21.15.38:0/3511089038 >> 172.21.15.38:0/3511089038 conn(0x7fa62406c5e0 msgr2=0x7fa624160a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:03.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.980+0000 7fa62c500640 1 -- 172.21.15.38:0/3511089038 shutdown_connections 2023-12-22T08:53:03.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:03.980+0000 7fa62c500640 1 -- 172.21.15.38:0/3511089038 wait complete. 2023-12-22T08:53:04.005 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T08:53:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.203+0000 7f9099bae640 1 Processor -- start 2023-12-22T08:53:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.203+0000 7f9099bae640 1 -- start start 2023-12-22T08:53:04.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.205+0000 7f9099bae640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f909415e870 0x7f90940ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.205+0000 7f9099bae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9094070e80 0x7f909406f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.205+0000 7f9099bae640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90940ce4b0 con 0x7f909415ec50 2023-12-22T08:53:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.205+0000 7f9099bae640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909415fea0 con 0x7f909415e870 2023-12-22T08:53:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.205+0000 7f9099bae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90940cdb80 con 0x7f9094070e80 2023-12-22T08:53:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.206+0000 7f9093fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9094070e80 0x7f909406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.206+0000 7f9093fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9094070e80 0x7f909406f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:34072/0 (socket says 172.21.15.38:34072) 2023-12-22T08:53:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.206+0000 7f9093fff640 1 -- 172.21.15.38:0/1751038627 learned_addr learned my addr 172.21.15.38:0/1751038627 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.206+0000 7f90937fe640 1 --2- 172.21.15.38:0/1751038627 >> v2:172.21.15.89:3300/0 conn(0x7f909415e870 0x7f90940ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:04.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.207+0000 7f9093fff640 1 -- 172.21.15.38:0/1751038627 >> v2:172.21.15.89:3300/0 conn(0x7f909415e870 msgr2=0x7f90940ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:04.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.207+0000 7f9093fff640 1 --2- 172.21.15.38:0/1751038627 >> v2:172.21.15.89:3300/0 conn(0x7f909415e870 0x7f90940ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.207+0000 7f9093fff640 1 -- 172.21.15.38:0/1751038627 >> v1:172.21.15.89:6789/0 conn(0x7f909415ec50 legacy=0x7f9094070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:04.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.207+0000 7f9093fff640 1 -- 172.21.15.38:0/1751038627 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90940cde60 con 0x7f9094070e80 2023-12-22T08:53:04.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.208+0000 7f9093fff640 1 --2- 172.21.15.38:0/1751038627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9094070e80 0x7f909406f250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f908c009870 tx=0x7f908c02b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7778154a7b9d09d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:04.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.208+0000 7f9092ffd640 1 -- 172.21.15.38:0/1751038627 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c031860 con 0x7f9094070e80 2023-12-22T08:53:04.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.209+0000 7f9092ffd640 1 -- 172.21.15.38:0/1751038627 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c0319c0 con 0x7f9094070e80 2023-12-22T08:53:04.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.209+0000 7f9092ffd640 1 -- 172.21.15.38:0/1751038627 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c031d50 con 0x7f9094070e80 2023-12-22T08:53:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.209+0000 7f9099bae640 1 -- 172.21.15.38:0/1751038627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9094070e80 msgr2=0x7f909406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.209+0000 7f9099bae640 1 --2- 172.21.15.38:0/1751038627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9094070e80 0x7f909406f250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f908c009870 tx=0x7f908c02b900 comp rx=0 tx=0).stop 2023-12-22T08:53:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.209+0000 7f9099bae640 1 -- 172.21.15.38:0/1751038627 shutdown_connections 2023-12-22T08:53:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.209+0000 7f9099bae640 1 --2- 172.21.15.38:0/1751038627 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9094070e80 0x7f909406f250 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.209+0000 7f9099bae640 1 --2- 172.21.15.38:0/1751038627 >> v2:172.21.15.89:3300/0 conn(0x7f909415e870 0x7f90940ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.209+0000 7f9099bae640 1 -- 172.21.15.38:0/1751038627 >> 172.21.15.38:0/1751038627 conn(0x7f90940b20c0 msgr2=0x7f90940b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.209+0000 7f9099bae640 1 -- 172.21.15.38:0/1751038627 shutdown_connections 2023-12-22T08:53:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.209+0000 7f9099bae640 1 -- 172.21.15.38:0/1751038627 wait complete. 2023-12-22T08:53:04.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.211+0000 7f9099bae640 1 Processor -- start 2023-12-22T08:53:04.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.211+0000 7f9099bae640 1 -- start start 2023-12-22T08:53:04.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.212+0000 7f9099bae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9094070e80 0x7f9094154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.212+0000 7f9099bae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f909415e870 0x7f90941f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.212+0000 7f9099bae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f909415ec50 0x7f90941f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.212+0000 7f9099bae640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90940aca80 con 0x7f909415ec50 2023-12-22T08:53:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.212+0000 7f9099bae640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9094156a00 con 0x7f9094070e80 2023-12-22T08:53:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.212+0000 7f9099bae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90941553f0 con 0x7f909415e870 2023-12-22T08:53:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.213+0000 7f9093fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f909415ec50 0x7f90941f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.213+0000 7f9093fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f909415ec50 0x7f90941f3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38754/0 (socket says 172.21.15.38:38754) 2023-12-22T08:53:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.213+0000 7f9093fff640 1 -- 172.21.15.38:0/2902987941 learned_addr learned my addr 172.21.15.38:0/2902987941 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.213+0000 7f90937fe640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9094070e80 0x7f9094154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.213+0000 7f908affd640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f909415e870 0x7f90941f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.213+0000 7f9093fff640 1 -- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f909415e870 msgr2=0x7f90941f30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.213+0000 7f9093fff640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f909415e870 0x7f90941f30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.213+0000 7f9093fff640 1 -- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9094070e80 msgr2=0x7f9094154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.213+0000 7f9093fff640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9094070e80 0x7f9094154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.213+0000 7f9093fff640 1 -- 172.21.15.38:0/2902987941 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c0094d0 con 0x7f909415ec50 2023-12-22T08:53:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.213+0000 7f90937fe640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9094070e80 0x7f9094154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:53:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.214+0000 7f9093fff640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f909415ec50 0x7f90941f3620 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f908c009870 tx=0x7f908c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.214+0000 7f9090ff9640 1 -- 172.21.15.38:0/2902987941 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c03ac60 con 0x7f909415ec50 2023-12-22T08:53:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.214+0000 7f9090ff9640 1 -- 172.21.15.38:0/2902987941 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c03ade0 con 0x7f909415ec50 2023-12-22T08:53:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.214+0000 7f9099bae640 1 -- 172.21.15.38:0/2902987941 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9094156c50 con 0x7f909415ec50 2023-12-22T08:53:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.214+0000 7f9090ff9640 1 -- 172.21.15.38:0/2902987941 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c044630 con 0x7f909415ec50 2023-12-22T08:53:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.214+0000 7f9099bae640 1 -- 172.21.15.38:0/2902987941 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9094157210 con 0x7f909415ec50 2023-12-22T08:53:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.216+0000 7f9099bae640 1 -- 172.21.15.38:0/2902987941 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90940acbc0 con 0x7f909415ec50 2023-12-22T08:53:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.217+0000 7f9090ff9640 1 -- 172.21.15.38:0/2902987941 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f908c04d450 con 0x7f909415ec50 2023-12-22T08:53:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.218+0000 7f9090ff9640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f907406a430 0x7f907406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.218+0000 7f9090ff9640 1 -- 172.21.15.38:0/2902987941 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f908c0aae00 con 0x7f909415ec50 2023-12-22T08:53:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.219+0000 7f90937fe640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f907406a430 0x7f907406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.220+0000 7f90937fe640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f907406a430 0x7f907406c8f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f90941e7f30 tx=0x7f908400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.223+0000 7f9090ff9640 1 -- 172.21.15.38:0/2902987941 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f90940acbc0 con 0x7f909415ec50 2023-12-22T08:53:04.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.460+0000 7f9099bae640 1 -- 172.21.15.38:0/2902987941 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f90940acbc0 con 0x7f909415ec50 2023-12-22T08:53:04.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.475+0000 7f9090ff9640 1 -- 172.21.15.38:0/2902987941 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v82) v1 ==== 174+0+0 (secure 0 0 0) 0x7f90940acbc0 con 0x7f909415ec50 2023-12-22T08:53:04.476 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 22 and data pool 23 2023-12-22T08:53:04.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.479+0000 7f9099bae640 1 -- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f907406a430 msgr2=0x7f907406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:04.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.479+0000 7f9099bae640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f907406a430 0x7f907406c8f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f90941e7f30 tx=0x7f908400b040 comp rx=0 tx=0).stop 2023-12-22T08:53:04.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.479+0000 7f9099bae640 1 -- 172.21.15.38:0/2902987941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f909415ec50 msgr2=0x7f90941f3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:04.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.479+0000 7f9099bae640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f909415ec50 0x7f90941f3620 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f908c009870 tx=0x7f908c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.481+0000 7f9099bae640 1 -- 172.21.15.38:0/2902987941 shutdown_connections 2023-12-22T08:53:04.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.481+0000 7f9099bae640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f907406a430 0x7f907406c8f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.481+0000 7f9099bae640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f909415ec50 0x7f90941f3620 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.481+0000 7f9099bae640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f909415e870 0x7f90941f30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.481+0000 7f9099bae640 1 --2- 172.21.15.38:0/2902987941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9094070e80 0x7f9094154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.481+0000 7f9099bae640 1 -- 172.21.15.38:0/2902987941 >> 172.21.15.38:0/2902987941 conn(0x7f90940b20c0 msgr2=0x7f909415a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:04.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.483+0000 7f9099bae640 1 -- 172.21.15.38:0/2902987941 shutdown_connections 2023-12-22T08:53:04.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.483+0000 7f9099bae640 1 -- 172.21.15.38:0/2902987941 wait complete. 2023-12-22T08:53:04.510 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:53:04.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.696+0000 7ff8b98d4640 1 Processor -- start 2023-12-22T08:53:04.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.696+0000 7ff8b98d4640 1 -- start start 2023-12-22T08:53:04.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.697+0000 7ff8b98d4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff8b415e740 0x7ff8b415db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:04.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.697+0000 7ff8b98d4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff8b40b3f90 0x7ff8b4070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:04.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.697+0000 7ff8b98d4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b415eb20 con 0x7ff8b406ca50 2023-12-22T08:53:04.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.697+0000 7ff8b98d4640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b406e650 con 0x7ff8b415e740 2023-12-22T08:53:04.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.697+0000 7ff8b98d4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b4070770 con 0x7ff8b40b3f90 2023-12-22T08:53:04.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.698+0000 7ff8b2ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff8b415e740 0x7ff8b415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:04.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.698+0000 7ff8b2ffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff8b415e740 0x7ff8b415db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38758/0 (socket says 172.21.15.38:38758) 2023-12-22T08:53:04.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.698+0000 7ff8b2ffd640 1 -- 172.21.15.38:0/1065571333 learned_addr learned my addr 172.21.15.38:0/1065571333 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:04.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.698+0000 7ff8b37fe640 1 --2- 172.21.15.38:0/1065571333 >> v2:172.21.15.89:3300/0 conn(0x7ff8b40b3f90 0x7ff8b4070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:04.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.698+0000 7ff8b2ffd640 1 -- 172.21.15.38:0/1065571333 >> v2:172.21.15.89:3300/0 conn(0x7ff8b40b3f90 msgr2=0x7ff8b4070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:04.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.698+0000 7ff8b2ffd640 1 --2- 172.21.15.38:0/1065571333 >> v2:172.21.15.89:3300/0 conn(0x7ff8b40b3f90 0x7ff8b4070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.698+0000 7ff8b2ffd640 1 -- 172.21.15.38:0/1065571333 >> v1:172.21.15.38:6789/0 conn(0x7ff8b406ca50 legacy=0x7ff8b40b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:04.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.698+0000 7ff8b2ffd640 1 -- 172.21.15.38:0/1065571333 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b406cec0 con 0x7ff8b415e740 2023-12-22T08:53:04.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.698+0000 7ff8b1ffb640 1 -- 172.21.15.38:0/1065571333 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886636260 0 0) 0x7ff8b415eb20 con 0x7ff8b406ca50 2023-12-22T08:53:04.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.700+0000 7ff8b2ffd640 1 --2- 172.21.15.38:0/1065571333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415e740 0x7ff8b415db30 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7ff8b415b700 tx=0x7ff89c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2390e5766d4e5de3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:04.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.700+0000 7ff8b1ffb640 1 -- 172.21.15.38:0/1065571333 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0317e0 con 0x7ff8b415e740 2023-12-22T08:53:04.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.700+0000 7ff8b1ffb640 1 -- 172.21.15.38:0/1065571333 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c031940 con 0x7ff8b415e740 2023-12-22T08:53:04.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.700+0000 7ff8b1ffb640 1 -- 172.21.15.38:0/1065571333 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c031cd0 con 0x7ff8b415e740 2023-12-22T08:53:04.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.701+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1065571333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415e740 msgr2=0x7ff8b415db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:04.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.701+0000 7ff8b98d4640 1 --2- 172.21.15.38:0/1065571333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415e740 0x7ff8b415db30 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7ff8b415b700 tx=0x7ff89c02b880 comp rx=0 tx=0).stop 2023-12-22T08:53:04.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.701+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1065571333 shutdown_connections 2023-12-22T08:53:04.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.701+0000 7ff8b98d4640 1 --2- 172.21.15.38:0/1065571333 >> v2:172.21.15.89:3300/0 conn(0x7ff8b40b3f90 0x7ff8b4070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.701+0000 7ff8b98d4640 1 --2- 172.21.15.38:0/1065571333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b415e740 0x7ff8b415db30 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.701+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1065571333 >> 172.21.15.38:0/1065571333 conn(0x7ff8b40cfea0 msgr2=0x7ff8b40d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:04.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.701+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1065571333 shutdown_connections 2023-12-22T08:53:04.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.701+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1065571333 wait complete. 2023-12-22T08:53:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.703+0000 7ff8b98d4640 1 Processor -- start 2023-12-22T08:53:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.703+0000 7ff8b98d4640 1 -- start start 2023-12-22T08:53:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.704+0000 7ff8b98d4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b406ca50 0x7ff8b4153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.704+0000 7ff8b98d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b40b3f90 0x7ff8b415a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.704+0000 7ff8b98d4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8b415e740 0x7ff8b415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.704+0000 7ff8b98d4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4158a00 con 0x7ff8b40b3f90 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.704+0000 7ff8b98d4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4157330 con 0x7ff8b415e740 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.704+0000 7ff8b98d4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4157610 con 0x7ff8b406ca50 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.705+0000 7ff8b27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b40b3f90 0x7ff8b415a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.705+0000 7ff8b27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b40b3f90 0x7ff8b415a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38768/0 (socket says 172.21.15.38:38768) 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.705+0000 7ff8b27fc640 1 -- 172.21.15.38:0/1797879368 learned_addr learned my addr 172.21.15.38:0/1797879368 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.705+0000 7ff8b37fe640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8b415e740 0x7ff8b415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.705+0000 7ff8b2ffd640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b406ca50 0x7ff8b4153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.705+0000 7ff8b27fc640 1 -- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b406ca50 msgr2=0x7ff8b4153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.705+0000 7ff8b27fc640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b406ca50 0x7ff8b4153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.705+0000 7ff8b27fc640 1 -- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8b415e740 msgr2=0x7ff8b415ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.705+0000 7ff8b27fc640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8b415e740 0x7ff8b415ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.705+0000 7ff8b27fc640 1 -- 172.21.15.38:0/1797879368 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c0094d0 con 0x7ff8b40b3f90 2023-12-22T08:53:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.705+0000 7ff8b2ffd640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b406ca50 0x7ff8b4153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.706+0000 7ff8b27fc640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b40b3f90 0x7ff8b415a8f0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400c890 tx=0x7ff8a400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.706+0000 7ff8abfff640 1 -- 172.21.15.38:0/1797879368 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4003da0 con 0x7ff8b40b3f90 2023-12-22T08:53:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.706+0000 7ff8abfff640 1 -- 172.21.15.38:0/1797879368 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a4005070 con 0x7ff8b40b3f90 2023-12-22T08:53:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.706+0000 7ff8abfff640 1 -- 172.21.15.38:0/1797879368 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4005420 con 0x7ff8b40b3f90 2023-12-22T08:53:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.706+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1797879368 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b41583b0 con 0x7ff8b40b3f90 2023-12-22T08:53:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.706+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1797879368 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b4153570 con 0x7ff8b40b3f90 2023-12-22T08:53:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.707+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1797879368 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b4061910 con 0x7ff8b40b3f90 2023-12-22T08:53:04.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.708+0000 7ff8abfff640 1 -- 172.21.15.38:0/1797879368 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff8a4005580 con 0x7ff8b40b3f90 2023-12-22T08:53:04.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.709+0000 7ff8abfff640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff89406a430 0x7ff89406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:04.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.709+0000 7ff8abfff640 1 -- 172.21.15.38:0/1797879368 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8a40882f0 con 0x7ff8b40b3f90 2023-12-22T08:53:04.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.710+0000 7ff8b2ffd640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff89406a430 0x7ff89406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.711+0000 7ff8b2ffd640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff89406a430 0x7ff89406c8f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff89c036000 tx=0x7ff89c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:04.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.714+0000 7ff8abfff640 1 -- 172.21.15.38:0/1797879368 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff8a4053840 con 0x7ff8b40b3f90 2023-12-22T08:53:04.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.910+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1797879368 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8b41600b0 con 0x7ff8b40b3f90 2023-12-22T08:53:04.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.912+0000 7ff8abfff640 1 -- 172.21.15.38:0/1797879368 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+16077 (secure 0 0 0) 0x7ff8a4017090 con 0x7ff8b40b3f90 2023-12-22T08:53:04.914 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:04.914 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":189,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:53:04.461781+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:53:02.354802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-22T08:53:03.461583+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:53:04.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.915+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff89406a430 msgr2=0x7ff89406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.915+0000 7ff8b98d4640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff89406a430 0x7ff89406c8f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff89c036000 tx=0x7ff89c03d040 comp rx=0 tx=0).stop 2023-12-22T08:53:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.915+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1797879368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b40b3f90 msgr2=0x7ff8b415a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.915+0000 7ff8b98d4640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b40b3f90 0x7ff8b415a8f0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400c890 tx=0x7ff8a400cd50 comp rx=0 tx=0).stop 2023-12-22T08:53:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.915+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1797879368 shutdown_connections 2023-12-22T08:53:04.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.915+0000 7ff8b98d4640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8b415e740 0x7ff8b415ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.915+0000 7ff8b98d4640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff89406a430 0x7ff89406c8f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.915+0000 7ff8b98d4640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8b40b3f90 0x7ff8b415a8f0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.915+0000 7ff8b98d4640 1 --2- 172.21.15.38:0/1797879368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8b406ca50 0x7ff8b4153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:04.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.915+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1797879368 >> 172.21.15.38:0/1797879368 conn(0x7ff8b40cfea0 msgr2=0x7ff8b415f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:04.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.915+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1797879368 shutdown_connections 2023-12-22T08:53:04.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:04.916+0000 7ff8b98d4640 1 -- 172.21.15.38:0/1797879368 wait complete. 2023-12-22T08:53:04.934 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:53:05.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.146+0000 7efce23ae640 1 Processor -- start 2023-12-22T08:53:05.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.147+0000 7efce23ae640 1 -- start start 2023-12-22T08:53:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.148+0000 7efce23ae640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efcdc157980 0x7efcdc15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.148+0000 7efce23ae640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0d1520 con 0x7efcdc06d640 2023-12-22T08:53:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.148+0000 7efce23ae640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0d1800 con 0x7efcdc0b3ff0 2023-12-22T08:53:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.148+0000 7efce23ae640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc0d1ae0 con 0x7efcdc157980 2023-12-22T08:53:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.149+0000 7efce1bad640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efcdc06d640 0x7efcdc0d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52910/0 (socket says 172.21.15.38:52910) 2023-12-22T08:53:05.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.149+0000 7efce1bad640 1 -- 172.21.15.38:0/2882697067 learned_addr learned my addr 172.21.15.38:0/2882697067 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:05.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.149+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74265345 0 0) 0x7efcdc0d1520 con 0x7efcdc06d640 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.149+0000 7efce13ac640 1 --2- 172.21.15.38:0/2882697067 >> v2:172.21.15.89:3300/0 conn(0x7efcdc157980 0x7efcdc15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.149+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efccc003520 con 0x7efcdc06d640 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3587038462 0 0) 0x7efccc003520 con 0x7efcdc06d640 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 >> v2:172.21.15.89:3300/0 conn(0x7efcdc157980 msgr2=0x7efcdc15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efcdbfff640 1 --2- 172.21.15.38:0/2882697067 >> v2:172.21.15.89:3300/0 conn(0x7efcdc157980 0x7efcdc15eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 >> v1:172.21.15.89:6789/0 conn(0x7efcdc0b3ff0 legacy=0x7efcdc06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0d1dc0 con 0x7efcdc06d640 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7efcd4001670 con 0x7efcdc06d640 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 >> v1:172.21.15.38:6789/0 conn(0x7efcdc06d640 legacy=0x7efcdc0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efcdbfff640 1 --2- 172.21.15.38:0/2882697067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efccc003970 0x7efccc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efcdbfff640 1 --2- 172.21.15.38:0/2882697067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efccc0047c0 0x7efccc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efcdbfff640 1 --2- 172.21.15.38:0/2882697067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efccc005180 0x7efccc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0d1ae0 con 0x7efccc003970 2023-12-22T08:53:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc00c0d0 con 0x7efccc0047c0 2023-12-22T08:53:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc00c290 con 0x7efccc005180 2023-12-22T08:53:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efce13ac640 1 --2- 172.21.15.38:0/2882697067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efccc003970 0x7efccc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efce0bab640 1 --2- 172.21.15.38:0/2882697067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efccc0047c0 0x7efccc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efce13ac640 1 -- 172.21.15.38:0/2882697067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efccc005180 msgr2=0x7efccc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.150+0000 7efce1bad640 1 --2- 172.21.15.38:0/2882697067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efccc005180 0x7efccc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.151+0000 7efce13ac640 1 --2- 172.21.15.38:0/2882697067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efccc005180 0x7efccc00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.151+0000 7efce13ac640 1 -- 172.21.15.38:0/2882697067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efccc0047c0 msgr2=0x7efccc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.151+0000 7efce13ac640 1 --2- 172.21.15.38:0/2882697067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efccc0047c0 0x7efccc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.151+0000 7efce13ac640 1 -- 172.21.15.38:0/2882697067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc003520 con 0x7efccc003970 2023-12-22T08:53:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.151+0000 7efce0bab640 1 --2- 172.21.15.38:0/2882697067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efccc0047c0 0x7efccc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.151+0000 7efce1bad640 1 -- 172.21.15.38:0/2882697067 reap_dead start 2023-12-22T08:53:05.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.152+0000 7efce13ac640 1 --2- 172.21.15.38:0/2882697067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efccc003970 0x7efccc003d90 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7efcd0007360 tx=0x7efccc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a110e567b448f8d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:05.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.152+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd002ccd0 con 0x7efccc003970 2023-12-22T08:53:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.152+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd002ce30 con 0x7efccc003970 2023-12-22T08:53:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.152+0000 7efcdbfff640 1 -- 172.21.15.38:0/2882697067 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0034660 con 0x7efccc003970 2023-12-22T08:53:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.152+0000 7efce23ae640 1 -- 172.21.15.38:0/2882697067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efccc003970 msgr2=0x7efccc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.152+0000 7efce23ae640 1 --2- 172.21.15.38:0/2882697067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efccc003970 0x7efccc003d90 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7efcd0007360 tx=0x7efccc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.153+0000 7efce23ae640 1 -- 172.21.15.38:0/2882697067 shutdown_connections 2023-12-22T08:53:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.153+0000 7efce23ae640 1 --2- 172.21.15.38:0/2882697067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efccc003970 0x7efccc003d90 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.153+0000 7efce23ae640 1 -- 172.21.15.38:0/2882697067 >> 172.21.15.38:0/2882697067 conn(0x7efcdc0d31f0 msgr2=0x7efcdc0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.153+0000 7efce23ae640 1 -- 172.21.15.38:0/2882697067 shutdown_connections 2023-12-22T08:53:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.153+0000 7efce23ae640 1 -- 172.21.15.38:0/2882697067 wait complete. 2023-12-22T08:53:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.154+0000 7efce23ae640 1 Processor -- start 2023-12-22T08:53:05.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.155+0000 7efce23ae640 1 -- start start 2023-12-22T08:53:05.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.155+0000 7efce23ae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efccc003970 0x7efcdc150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.155+0000 7efce23ae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc1512a0 0x7efcdc0b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce23ae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcdc15a360 0x7efcdc15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce23ae640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc15ad30 con 0x7efcdc15a360 2023-12-22T08:53:05.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce23ae640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc154170 con 0x7efccc003970 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce23ae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc151000 con 0x7efcdc1512a0 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce1bad640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcdc15a360 0x7efcdc15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce1bad640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcdc15a360 0x7efcdc15a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38788/0 (socket says 172.21.15.38:38788) 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce1bad640 1 -- 172.21.15.38:0/1122570834 learned_addr learned my addr 172.21.15.38:0/1122570834 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce13ac640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efccc003970 0x7efcdc150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce0bab640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc1512a0 0x7efcdc0b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce1bad640 1 -- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc1512a0 msgr2=0x7efcdc0b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce1bad640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc1512a0 0x7efcdc0b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce1bad640 1 -- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efccc003970 msgr2=0x7efcdc150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce1bad640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efccc003970 0x7efcdc150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce1bad640 1 -- 172.21.15.38:0/1122570834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0b6540 con 0x7efcdc15a360 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.156+0000 7efce13ac640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efccc003970 0x7efcdc150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.157+0000 7efce1bad640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcdc15a360 0x7efcdc15a7f0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7efcd4000c00 tx=0x7efcd400d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:05.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.157+0000 7efcd9ffb640 1 -- 172.21.15.38:0/1122570834 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4007440 con 0x7efcdc15a360 2023-12-22T08:53:05.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.157+0000 7efcd9ffb640 1 -- 172.21.15.38:0/1122570834 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd40075c0 con 0x7efcdc15a360 2023-12-22T08:53:05.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.157+0000 7efce23ae640 1 -- 172.21.15.38:0/1122570834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc0b6820 con 0x7efcdc15a360 2023-12-22T08:53:05.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.157+0000 7efcd9ffb640 1 -- 172.21.15.38:0/1122570834 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4004a20 con 0x7efcdc15a360 2023-12-22T08:53:05.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.157+0000 7efce23ae640 1 -- 172.21.15.38:0/1122570834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc158080 con 0x7efcdc15a360 2023-12-22T08:53:05.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.158+0000 7efce23ae640 1 -- 172.21.15.38:0/1122570834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc0b6d40 con 0x7efcdc15a360 2023-12-22T08:53:05.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.159+0000 7efcd9ffb640 1 -- 172.21.15.38:0/1122570834 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efcd4004b80 con 0x7efcdc15a360 2023-12-22T08:53:05.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.160+0000 7efcd9ffb640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efcc006a460 0x7efcc006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.160+0000 7efcd9ffb640 1 -- 172.21.15.38:0/1122570834 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcd4088430 con 0x7efcdc15a360 2023-12-22T08:53:05.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.161+0000 7efce13ac640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efcc006a460 0x7efcc006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.162+0000 7efce13ac640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efcc006a460 0x7efcc006c920 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7efcd0036000 tx=0x7efcd0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:05.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.164+0000 7efcd9ffb640 1 -- 172.21.15.38:0/1122570834 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efcdc0b6d40 con 0x7efcdc15a360 2023-12-22T08:53:05.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.355+0000 7efce23ae640 1 -- 172.21.15.38:0/1122570834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcdc0b6d40 con 0x7efcdc15a360 2023-12-22T08:53:05.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.357+0000 7efcd9ffb640 1 -- 172.21.15.38:0/1122570834 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+16077 (secure 0 0 0) 0x7efcdc0b6d40 con 0x7efcdc15a360 2023-12-22T08:53:05.358 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:05.358 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":189,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:53:04.461781+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:53:02.354802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-22T08:53:03.461583+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:53:05.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.359+0000 7efce23ae640 1 -- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efcc006a460 msgr2=0x7efcc006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:05.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.359+0000 7efce23ae640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efcc006a460 0x7efcc006c920 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7efcd0036000 tx=0x7efcd0030000 comp rx=0 tx=0).stop 2023-12-22T08:53:05.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.359+0000 7efce23ae640 1 -- 172.21.15.38:0/1122570834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcdc15a360 msgr2=0x7efcdc15a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:05.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.359+0000 7efce23ae640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcdc15a360 0x7efcdc15a7f0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7efcd4000c00 tx=0x7efcd400d8a0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.359+0000 7efce23ae640 1 -- 172.21.15.38:0/1122570834 shutdown_connections 2023-12-22T08:53:05.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.359+0000 7efce23ae640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7efcc006a460 0x7efcc006c920 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.359+0000 7efce23ae640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcdc15a360 0x7efcdc15a7f0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.359+0000 7efce23ae640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcdc1512a0 0x7efcdc0b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.359+0000 7efce23ae640 1 --2- 172.21.15.38:0/1122570834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efccc003970 0x7efcdc150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.359+0000 7efce23ae640 1 -- 172.21.15.38:0/1122570834 >> 172.21.15.38:0/1122570834 conn(0x7efcdc0d31f0 msgr2=0x7efcdc06ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:05.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.360+0000 7efce23ae640 1 -- 172.21.15.38:0/1122570834 shutdown_connections 2023-12-22T08:53:05.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.360+0000 7efce23ae640 1 -- 172.21.15.38:0/1122570834 wait complete. 2023-12-22T08:53:05.379 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T08:53:05.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.603+0000 7fc635e1b640 1 Processor -- start 2023-12-22T08:53:05.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.603+0000 7fc635e1b640 1 -- start start 2023-12-22T08:53:05.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.605+0000 7fc635e1b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc630071d80 0x7fc6300a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.605+0000 7fc635e1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6300a35a0 0x7fc630161040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.605+0000 7fc635e1b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc630161580 0x7fc63015da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.605+0000 7fc635e1b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6300a44a0 con 0x7fc630161580 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.605+0000 7fc635e1b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6300a3a00 con 0x7fc630071d80 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.605+0000 7fc635e1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc630161a10 con 0x7fc6300a35a0 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.605+0000 7fc63561a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc630161580 0x7fc63015da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.606+0000 7fc63561a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc630161580 0x7fc63015da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38798/0 (socket says 172.21.15.38:38798) 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.606+0000 7fc63561a640 1 -- 172.21.15.38:0/744141764 learned_addr learned my addr 172.21.15.38:0/744141764 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.606+0000 7fc634e19640 1 --2- 172.21.15.38:0/744141764 >> v2:172.21.15.89:3300/0 conn(0x7fc630071d80 0x7fc6300a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.606+0000 7fc62ffff640 1 --2- 172.21.15.38:0/744141764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6300a35a0 0x7fc630161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.606+0000 7fc63561a640 1 -- 172.21.15.38:0/744141764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6300a35a0 msgr2=0x7fc630161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.606+0000 7fc63561a640 1 --2- 172.21.15.38:0/744141764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6300a35a0 0x7fc630161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.606+0000 7fc63561a640 1 -- 172.21.15.38:0/744141764 >> v2:172.21.15.89:3300/0 conn(0x7fc630071d80 msgr2=0x7fc6300a3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:05.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.606+0000 7fc63561a640 1 --2- 172.21.15.38:0/744141764 >> v2:172.21.15.89:3300/0 conn(0x7fc630071d80 0x7fc6300a3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.606+0000 7fc63561a640 1 -- 172.21.15.38:0/744141764 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63006c2a0 con 0x7fc630161580 2023-12-22T08:53:05.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.607+0000 7fc63561a640 1 --2- 172.21.15.38:0/744141764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc630161580 0x7fc63015da50 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fc63006e410 tx=0x7fc62802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf3fd8d434a8a08 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:05.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.608+0000 7fc62f7fe640 1 -- 172.21.15.38:0/744141764 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62802ca70 con 0x7fc630161580 2023-12-22T08:53:05.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.608+0000 7fc62f7fe640 1 -- 172.21.15.38:0/744141764 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62802cbd0 con 0x7fc630161580 2023-12-22T08:53:05.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.608+0000 7fc62f7fe640 1 -- 172.21.15.38:0/744141764 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6280343f0 con 0x7fc630161580 2023-12-22T08:53:05.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.608+0000 7fc635e1b640 1 -- 172.21.15.38:0/744141764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc630161580 msgr2=0x7fc63015da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:05.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.608+0000 7fc635e1b640 1 --2- 172.21.15.38:0/744141764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc630161580 0x7fc63015da50 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fc63006e410 tx=0x7fc62802bed0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.608+0000 7fc635e1b640 1 -- 172.21.15.38:0/744141764 shutdown_connections 2023-12-22T08:53:05.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.608+0000 7fc635e1b640 1 --2- 172.21.15.38:0/744141764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc630161580 0x7fc63015da50 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.608+0000 7fc635e1b640 1 --2- 172.21.15.38:0/744141764 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6300a35a0 0x7fc630161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.608+0000 7fc635e1b640 1 --2- 172.21.15.38:0/744141764 >> v2:172.21.15.89:3300/0 conn(0x7fc630071d80 0x7fc6300a3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.608+0000 7fc635e1b640 1 -- 172.21.15.38:0/744141764 >> 172.21.15.38:0/744141764 conn(0x7fc6300cf000 msgr2=0x7fc6300cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:05.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.609+0000 7fc635e1b640 1 -- 172.21.15.38:0/744141764 shutdown_connections 2023-12-22T08:53:05.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.609+0000 7fc635e1b640 1 -- 172.21.15.38:0/744141764 wait complete. 2023-12-22T08:53:05.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.610+0000 7fc635e1b640 1 Processor -- start 2023-12-22T08:53:05.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.611+0000 7fc635e1b640 1 -- start start 2023-12-22T08:53:05.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.611+0000 7fc635e1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc630071d80 0x7fc630141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.611+0000 7fc635e1b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6300a35a0 0x7fc6301f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.611+0000 7fc635e1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc630161580 0x7fc63015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.611+0000 7fc635e1b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6301f6c20 con 0x7fc6300a35a0 2023-12-22T08:53:05.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.611+0000 7fc635e1b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6301f25d0 con 0x7fc630161580 2023-12-22T08:53:05.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.611+0000 7fc635e1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc630143ce0 con 0x7fc630071d80 2023-12-22T08:53:05.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.612+0000 7fc62ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6300a35a0 0x7fc6301f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.612+0000 7fc62ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6300a35a0 0x7fc6301f66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38808/0 (socket says 172.21.15.38:38808) 2023-12-22T08:53:05.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.612+0000 7fc62ffff640 1 -- 172.21.15.38:0/3940180960 learned_addr learned my addr 172.21.15.38:0/3940180960 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:05.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.612+0000 7fc62ffff640 1 -- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc630071d80 msgr2=0x7fc630141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.612+0000 7fc634e19640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc630071d80 0x7fc630141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.612+0000 7fc63561a640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc630161580 0x7fc63015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.612+0000 7fc62ffff640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc630071d80 0x7fc630141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.612+0000 7fc62ffff640 1 -- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc630161580 msgr2=0x7fc63015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.612+0000 7fc62ffff640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc630161580 0x7fc63015d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.612+0000 7fc62ffff640 1 -- 172.21.15.38:0/3940180960 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc628009b30 con 0x7fc6300a35a0 2023-12-22T08:53:05.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.613+0000 7fc62ffff640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6300a35a0 0x7fc6301f66e0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00d800 tx=0x7fc61c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:05.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.613+0000 7fc62d7fa640 1 -- 172.21.15.38:0/3940180960 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00b6c0 con 0x7fc6300a35a0 2023-12-22T08:53:05.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.613+0000 7fc62d7fa640 1 -- 172.21.15.38:0/3940180960 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c00b820 con 0x7fc6300a35a0 2023-12-22T08:53:05.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.613+0000 7fc62d7fa640 1 -- 172.21.15.38:0/3940180960 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00bbb0 con 0x7fc6300a35a0 2023-12-22T08:53:05.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.613+0000 7fc635e1b640 1 -- 172.21.15.38:0/3940180960 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc630143fc0 con 0x7fc6300a35a0 2023-12-22T08:53:05.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.613+0000 7fc635e1b640 1 -- 172.21.15.38:0/3940180960 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc630144580 con 0x7fc6300a35a0 2023-12-22T08:53:05.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.614+0000 7fc635e1b640 1 -- 172.21.15.38:0/3940180960 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc630061910 con 0x7fc6300a35a0 2023-12-22T08:53:05.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.616+0000 7fc62d7fa640 1 -- 172.21.15.38:0/3940180960 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc61c00bd10 con 0x7fc6300a35a0 2023-12-22T08:53:05.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.616+0000 7fc62d7fa640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc61406a430 0x7fc61406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:05.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.617+0000 7fc62d7fa640 1 -- 172.21.15.38:0/3940180960 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc61c088e30 con 0x7fc6300a35a0 2023-12-22T08:53:05.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.617+0000 7fc634e19640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc61406a430 0x7fc61406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:05.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.618+0000 7fc634e19640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc61406a430 0x7fc61406c8f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc624006fd0 tx=0x7fc624008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:05.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.621+0000 7fc62d7fa640 1 -- 172.21.15.38:0/3940180960 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc61c054410 con 0x7fc6300a35a0 2023-12-22T08:53:05.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:05.843+0000 7fc635e1b640 1 -- 172.21.15.38:0/3940180960 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc6300718f0 con 0x7fc6300a35a0 2023-12-22T08:53:06.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.486+0000 7fc62d7fa640 1 -- 172.21.15.38:0/3940180960 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v85) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc61c057a30 con 0x7fc6300a35a0 2023-12-22T08:53:06.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.489+0000 7fc635e1b640 1 -- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc61406a430 msgr2=0x7fc61406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:06.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.489+0000 7fc635e1b640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc61406a430 0x7fc61406c8f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc624006fd0 tx=0x7fc624008040 comp rx=0 tx=0).stop 2023-12-22T08:53:06.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.489+0000 7fc635e1b640 1 -- 172.21.15.38:0/3940180960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6300a35a0 msgr2=0x7fc6301f66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:06.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.489+0000 7fc635e1b640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6300a35a0 0x7fc6301f66e0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00d800 tx=0x7fc61c00dcc0 comp rx=0 tx=0).stop 2023-12-22T08:53:06.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.489+0000 7fc635e1b640 1 -- 172.21.15.38:0/3940180960 shutdown_connections 2023-12-22T08:53:06.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.489+0000 7fc635e1b640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc630161580 0x7fc63015d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:06.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.489+0000 7fc635e1b640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc61406a430 0x7fc61406c8f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:06.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.489+0000 7fc635e1b640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6300a35a0 0x7fc6301f66e0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:06.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.489+0000 7fc635e1b640 1 --2- 172.21.15.38:0/3940180960 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc630071d80 0x7fc630141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:06.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.489+0000 7fc635e1b640 1 -- 172.21.15.38:0/3940180960 >> 172.21.15.38:0/3940180960 conn(0x7fc6300cf000 msgr2=0x7fc630071130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:06.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.489+0000 7fc635e1b640 1 -- 172.21.15.38:0/3940180960 shutdown_connections 2023-12-22T08:53:06.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.489+0000 7fc635e1b640 1 -- 172.21.15.38:0/3940180960 wait complete. 2023-12-22T08:53:06.512 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T08:53:06.512 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T08:53:06.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.741+0000 7f5d6ffff640 1 Processor -- start 2023-12-22T08:53:06.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.742+0000 7f5d6ffff640 1 -- start start 2023-12-22T08:53:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.743+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d70144a20 0x7f5d700b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.743+0000 7f5d6ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5d700cf9a0 0x7f5d700b4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.744+0000 7f5d6ffff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d700b4690 con 0x7f5d700b3cf0 2023-12-22T08:53:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.744+0000 7f5d6ffff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d700b65a0 con 0x7f5d700cf9a0 2023-12-22T08:53:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.744+0000 7f5d6ffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700b5c80 con 0x7f5d70144a20 2023-12-22T08:53:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.744+0000 7f5d6f7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5d700cf9a0 0x7f5d700b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.744+0000 7f5d6f7fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5d700cf9a0 0x7f5d700b4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38822/0 (socket says 172.21.15.38:38822) 2023-12-22T08:53:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.744+0000 7f5d6f7fe640 1 -- 172.21.15.38:0/4211675396 learned_addr learned my addr 172.21.15.38:0/4211675396 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.744+0000 7f5d6effd640 1 --2- 172.21.15.38:0/4211675396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d70144a20 0x7f5d700b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.744+0000 7f5d6f7fe640 1 -- 172.21.15.38:0/4211675396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d70144a20 msgr2=0x7f5d700b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.744+0000 7f5d6f7fe640 1 --2- 172.21.15.38:0/4211675396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d70144a20 0x7f5d700b69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.744+0000 7f5d6f7fe640 1 -- 172.21.15.38:0/4211675396 >> v1:172.21.15.89:6789/0 conn(0x7f5d700b3cf0 legacy=0x7f5d700cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.744+0000 7f5d6f7fe640 1 -- 172.21.15.38:0/4211675396 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d700b5f00 con 0x7f5d700cf9a0 2023-12-22T08:53:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.745+0000 7f5d6f7fe640 1 --2- 172.21.15.38:0/4211675396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d700cf9a0 0x7f5d700b4150 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f5d700b60f0 tx=0x7f5d6802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300e31b12788a4c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.746+0000 7f5d6dffb640 1 -- 172.21.15.38:0/4211675396 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d680317c0 con 0x7f5d700cf9a0 2023-12-22T08:53:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.746+0000 7f5d6dffb640 1 -- 172.21.15.38:0/4211675396 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d68031920 con 0x7f5d700cf9a0 2023-12-22T08:53:06.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.746+0000 7f5d6dffb640 1 -- 172.21.15.38:0/4211675396 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68031cb0 con 0x7f5d700cf9a0 2023-12-22T08:53:06.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.746+0000 7f5d6ffff640 1 -- 172.21.15.38:0/4211675396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d700cf9a0 msgr2=0x7f5d700b4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:06.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.746+0000 7f5d6ffff640 1 --2- 172.21.15.38:0/4211675396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d700cf9a0 0x7f5d700b4150 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f5d700b60f0 tx=0x7f5d6802b860 comp rx=0 tx=0).stop 2023-12-22T08:53:06.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.747+0000 7f5d6ffff640 1 -- 172.21.15.38:0/4211675396 shutdown_connections 2023-12-22T08:53:06.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.747+0000 7f5d6ffff640 1 --2- 172.21.15.38:0/4211675396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d700cf9a0 0x7f5d700b4150 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:06.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.747+0000 7f5d6ffff640 1 --2- 172.21.15.38:0/4211675396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d70144a20 0x7f5d700b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:06.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.747+0000 7f5d6ffff640 1 -- 172.21.15.38:0/4211675396 >> 172.21.15.38:0/4211675396 conn(0x7f5d70060720 msgr2=0x7f5d70060b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:06.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.747+0000 7f5d6ffff640 1 -- 172.21.15.38:0/4211675396 shutdown_connections 2023-12-22T08:53:06.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.747+0000 7f5d6ffff640 1 -- 172.21.15.38:0/4211675396 wait complete. 2023-12-22T08:53:06.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.749+0000 7f5d6ffff640 1 Processor -- start 2023-12-22T08:53:06.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.749+0000 7f5d6ffff640 1 -- start start 2023-12-22T08:53:06.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d700b3cf0 0x7f5d7015a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:06.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d700cf9a0 0x7f5d7013d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:06.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d70144a20 0x7f5d7013da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:06.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6ffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7013d130 con 0x7f5d70144a20 2023-12-22T08:53:06.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6ffff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7013cb00 con 0x7f5d700b3cf0 2023-12-22T08:53:06.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6ffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7015ab50 con 0x7f5d700cf9a0 2023-12-22T08:53:06.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d70144a20 0x7f5d7013da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:06.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d70144a20 0x7f5d7013da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38830/0 (socket says 172.21.15.38:38830) 2023-12-22T08:53:06.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6f7fe640 1 -- 172.21.15.38:0/3190707595 learned_addr learned my addr 172.21.15.38:0/3190707595 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:06.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6e7fc640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d700cf9a0 0x7f5d7013d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:06.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6f7fe640 1 -- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d700cf9a0 msgr2=0x7f5d7013d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:06.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6f7fe640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d700cf9a0 0x7f5d7013d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:06.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6f7fe640 1 -- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d700b3cf0 msgr2=0x7f5d7015a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:06.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6f7fe640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d700b3cf0 0x7f5d7015a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:06.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6f7fe640 1 -- 172.21.15.38:0/3190707595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d680094d0 con 0x7f5d70144a20 2023-12-22T08:53:06.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.750+0000 7f5d6e7fc640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d700cf9a0 0x7f5d7013d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.751+0000 7f5d6f7fe640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d70144a20 0x7f5d7013da90 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f5d680090b0 tx=0x7f5d680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.751+0000 7f5d677fe640 1 -- 172.21.15.38:0/3190707595 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68032920 con 0x7f5d70144a20 2023-12-22T08:53:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.751+0000 7f5d677fe640 1 -- 172.21.15.38:0/3190707595 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d68032aa0 con 0x7f5d70144a20 2023-12-22T08:53:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.751+0000 7f5d677fe640 1 -- 172.21.15.38:0/3190707595 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68032e50 con 0x7f5d70144a20 2023-12-22T08:53:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.751+0000 7f5d6ffff640 1 -- 172.21.15.38:0/3190707595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d70070120 con 0x7f5d70144a20 2023-12-22T08:53:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.751+0000 7f5d6ffff640 1 -- 172.21.15.38:0/3190707595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7013cd50 con 0x7f5d70144a20 2023-12-22T08:53:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.752+0000 7f5d6ffff640 1 -- 172.21.15.38:0/3190707595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7013d270 con 0x7f5d70144a20 2023-12-22T08:53:06.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.753+0000 7f5d677fe640 1 -- 172.21.15.38:0/3190707595 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5d680453f0 con 0x7f5d70144a20 2023-12-22T08:53:06.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.754+0000 7f5d677fe640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5d5006a430 0x7f5d5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:06.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.754+0000 7f5d677fe640 1 -- 172.21.15.38:0/3190707595 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d680aadf0 con 0x7f5d70144a20 2023-12-22T08:53:06.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.755+0000 7f5d6effd640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5d5006a430 0x7f5d5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:06.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.757+0000 7f5d6effd640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5d5006a430 0x7f5d5006c8f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5d60007e60 tx=0x7f5d60007390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:06.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.760+0000 7f5d677fe640 1 -- 172.21.15.38:0/3190707595 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5d7013d270 con 0x7f5d70144a20 2023-12-22T08:53:06.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:06.991+0000 7f5d6ffff640 1 -- 172.21.15.38:0/3190707595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5d7013d270 con 0x7f5d70144a20 2023-12-22T08:53:07.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.498+0000 7f5d677fe640 1 -- 172.21.15.38:0/3190707595 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v86) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5d7013d270 con 0x7f5d70144a20 2023-12-22T08:53:07.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.501+0000 7f5d6ffff640 1 -- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5d5006a430 msgr2=0x7f5d5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:07.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.501+0000 7f5d6ffff640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5d5006a430 0x7f5d5006c8f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5d60007e60 tx=0x7f5d60007390 comp rx=0 tx=0).stop 2023-12-22T08:53:07.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.501+0000 7f5d6ffff640 1 -- 172.21.15.38:0/3190707595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d70144a20 msgr2=0x7f5d7013da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:07.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.501+0000 7f5d6ffff640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d70144a20 0x7f5d7013da90 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f5d680090b0 tx=0x7f5d680046c0 comp rx=0 tx=0).stop 2023-12-22T08:53:07.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.502+0000 7f5d6ffff640 1 -- 172.21.15.38:0/3190707595 shutdown_connections 2023-12-22T08:53:07.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.502+0000 7f5d6ffff640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5d5006a430 0x7f5d5006c8f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:07.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.502+0000 7f5d6ffff640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d70144a20 0x7f5d7013da90 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:07.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.502+0000 7f5d6ffff640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d700cf9a0 0x7f5d7013d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:07.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.502+0000 7f5d6ffff640 1 --2- 172.21.15.38:0/3190707595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d700b3cf0 0x7f5d7015a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:07.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.502+0000 7f5d6ffff640 1 -- 172.21.15.38:0/3190707595 >> 172.21.15.38:0/3190707595 conn(0x7f5d70060720 msgr2=0x7f5d7015eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:07.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.502+0000 7f5d6ffff640 1 -- 172.21.15.38:0/3190707595 shutdown_connections 2023-12-22T08:53:07.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.502+0000 7f5d6ffff640 1 -- 172.21.15.38:0/3190707595 wait complete. 2023-12-22T08:53:07.523 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T08:53:07.524 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:53:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.755+0000 7fae0faec640 1 Processor -- start 2023-12-22T08:53:07.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.755+0000 7fae0faec640 1 -- start start 2023-12-22T08:53:07.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.756+0000 7fae0faec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae081547a0 0x7fae0815b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:07.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.756+0000 7fae0faec640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fae08154b80 0x7fae080ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:07.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.757+0000 7fae0faec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae080716a0 con 0x7fae08071b90 2023-12-22T08:53:07.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.757+0000 7fae0faec640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae08070e80 con 0x7fae08154b80 2023-12-22T08:53:07.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.757+0000 7fae0faec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae080710e0 con 0x7fae081547a0 2023-12-22T08:53:07.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.757+0000 7fae0d888640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae081547a0 0x7fae0815b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:07.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.757+0000 7fae0d888640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae081547a0 0x7fae0815b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:34140/0 (socket says 172.21.15.38:34140) 2023-12-22T08:53:07.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.757+0000 7fae0d888640 1 -- 172.21.15.38:0/1600377941 learned_addr learned my addr 172.21.15.38:0/1600377941 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.758+0000 7fae0e089640 1 --2- 172.21.15.38:0/1600377941 >> v2:172.21.15.89:3300/0 conn(0x7fae08154b80 0x7fae080ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.758+0000 7fae0d888640 1 -- 172.21.15.38:0/1600377941 >> v2:172.21.15.89:3300/0 conn(0x7fae08154b80 msgr2=0x7fae080ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.758+0000 7fae0d888640 1 --2- 172.21.15.38:0/1600377941 >> v2:172.21.15.89:3300/0 conn(0x7fae08154b80 0x7fae080ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.758+0000 7fae0d888640 1 -- 172.21.15.38:0/1600377941 >> v1:172.21.15.89:6789/0 conn(0x7fae08071b90 legacy=0x7fae08070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.758+0000 7fae0d888640 1 -- 172.21.15.38:0/1600377941 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae080713c0 con 0x7fae081547a0 2023-12-22T08:53:07.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.758+0000 7fae0c886640 1 -- 172.21.15.38:0/1600377941 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216593566 0 0) 0x7fae080716a0 con 0x7fae08071b90 2023-12-22T08:53:07.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.760+0000 7fae0d888640 1 --2- 172.21.15.38:0/1600377941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae081547a0 0x7fae0815b300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fae04009870 tx=0x7fae0402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b96703534e7d7c01 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:07.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.760+0000 7fae0c886640 1 -- 172.21.15.38:0/1600377941 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04030840 con 0x7fae081547a0 2023-12-22T08:53:07.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.760+0000 7fae0c886640 1 -- 172.21.15.38:0/1600377941 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae040309a0 con 0x7fae081547a0 2023-12-22T08:53:07.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.760+0000 7fae0c886640 1 -- 172.21.15.38:0/1600377941 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04030d30 con 0x7fae081547a0 2023-12-22T08:53:07.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.761+0000 7fae0faec640 1 -- 172.21.15.38:0/1600377941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae081547a0 msgr2=0x7fae0815b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:07.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.761+0000 7fae0faec640 1 --2- 172.21.15.38:0/1600377941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae081547a0 0x7fae0815b300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fae04009870 tx=0x7fae0402b980 comp rx=0 tx=0).stop 2023-12-22T08:53:07.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.761+0000 7fae0faec640 1 -- 172.21.15.38:0/1600377941 shutdown_connections 2023-12-22T08:53:07.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.761+0000 7fae0faec640 1 --2- 172.21.15.38:0/1600377941 >> v2:172.21.15.89:3300/0 conn(0x7fae08154b80 0x7fae080ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:07.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.761+0000 7fae0faec640 1 --2- 172.21.15.38:0/1600377941 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae081547a0 0x7fae0815b300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:07.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.761+0000 7fae0faec640 1 -- 172.21.15.38:0/1600377941 >> 172.21.15.38:0/1600377941 conn(0x7fae080cf070 msgr2=0x7fae080cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:07.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.761+0000 7fae0faec640 1 -- 172.21.15.38:0/1600377941 shutdown_connections 2023-12-22T08:53:07.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.761+0000 7fae0faec640 1 -- 172.21.15.38:0/1600377941 wait complete. 2023-12-22T08:53:07.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.763+0000 7fae0faec640 1 Processor -- start 2023-12-22T08:53:07.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.763+0000 7fae0faec640 1 -- start start 2023-12-22T08:53:07.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.764+0000 7fae0faec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae08071b90 0x7fae0814ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.764+0000 7fae0faec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae081547a0 0x7fae0815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.764+0000 7fae0faec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae08154b80 0x7fae0815c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.764+0000 7fae0faec640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae08152020 con 0x7fae081547a0 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.764+0000 7fae0faec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0814bf50 con 0x7fae08071b90 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.764+0000 7fae0faec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae08154320 con 0x7fae08154b80 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.764+0000 7fae0d087640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae081547a0 0x7fae0815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.764+0000 7fae0d087640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae081547a0 0x7fae0815bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38842/0 (socket says 172.21.15.38:38842) 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.764+0000 7fae0d087640 1 -- 172.21.15.38:0/1022874194 learned_addr learned my addr 172.21.15.38:0/1022874194 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.765+0000 7fae0d888640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae08071b90 0x7fae0814ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.765+0000 7fae0e089640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae08154b80 0x7fae0815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.765+0000 7fae0d087640 1 -- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae08154b80 msgr2=0x7fae0815c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.765+0000 7fae0d087640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae08154b80 0x7fae0815c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.765+0000 7fae0d087640 1 -- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae08071b90 msgr2=0x7fae0814ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:07.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.765+0000 7fae0d087640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae08071b90 0x7fae0814ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:07.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.765+0000 7fae0d087640 1 -- 172.21.15.38:0/1022874194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae040094d0 con 0x7fae081547a0 2023-12-22T08:53:07.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.765+0000 7fae0d087640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae081547a0 0x7fae0815bae0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c4e0 tx=0x7fadf800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:07.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.765+0000 7fadfe7fc640 1 -- 172.21.15.38:0/1022874194 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8005480 con 0x7fae081547a0 2023-12-22T08:53:07.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.765+0000 7fadfe7fc640 1 -- 172.21.15.38:0/1022874194 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf80035f0 con 0x7fae081547a0 2023-12-22T08:53:07.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.765+0000 7fadfe7fc640 1 -- 172.21.15.38:0/1022874194 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf80039c0 con 0x7fae081547a0 2023-12-22T08:53:07.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.765+0000 7fae0faec640 1 -- 172.21.15.38:0/1022874194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae08151780 con 0x7fae081547a0 2023-12-22T08:53:07.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.766+0000 7fae0faec640 1 -- 172.21.15.38:0/1022874194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae08151d40 con 0x7fae081547a0 2023-12-22T08:53:07.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.767+0000 7fae0faec640 1 -- 172.21.15.38:0/1022874194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae080cc7f0 con 0x7fae081547a0 2023-12-22T08:53:07.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.768+0000 7fadfe7fc640 1 -- 172.21.15.38:0/1022874194 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fadf8003b20 con 0x7fae081547a0 2023-12-22T08:53:07.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.769+0000 7fadfe7fc640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fadec06a430 0x7fadec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:07.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.769+0000 7fadfe7fc640 1 -- 172.21.15.38:0/1022874194 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadf8087ce0 con 0x7fae081547a0 2023-12-22T08:53:07.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.770+0000 7fae0d888640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fadec06a430 0x7fadec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:07.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.771+0000 7fae0d888640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fadec06a430 0x7fadec06c8f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fae04036000 tx=0x7fae04008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:07.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:07.778+0000 7fadfe7fc640 1 -- 172.21.15.38:0/1022874194 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fadf8053410 con 0x7fae081547a0 2023-12-22T08:53:08.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.011+0000 7fae0faec640 1 -- 172.21.15.38:0/1022874194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae08061910 con 0x7fae081547a0 2023-12-22T08:53:08.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.014+0000 7fadfe7fc640 1 -- 172.21.15.38:0/1022874194 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4649 (secure 0 0 0) 0x7fadf8017020 con 0x7fae081547a0 2023-12-22T08:53:08.015 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:08.015 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2952705616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2952705616},{"type":"v1","addr":"172.21.15.89:6835","nonce":2952705616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/3842752964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":3842752964},{"type":"v1","addr":"172.21.15.89:6837","nonce":3842752964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/261655608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":261655608},{"type":"v1","addr":"172.21.15.38:6834","nonce":261655608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:53:04.462294+0000","modified":"2023-12-22T08:53:07.483358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8940":{"gid":8940,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3350465616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3350465616},{"type":"v1","addr":"172.21.15.38:6835","nonce":3350465616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-22T08:53:08.015 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 86 2023-12-22T08:53:08.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.017+0000 7fae0faec640 1 -- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fadec06a430 msgr2=0x7fadec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.017+0000 7fae0faec640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fadec06a430 0x7fadec06c8f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fae04036000 tx=0x7fae04008030 comp rx=0 tx=0).stop 2023-12-22T08:53:08.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.017+0000 7fae0faec640 1 -- 172.21.15.38:0/1022874194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae081547a0 msgr2=0x7fae0815bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.017+0000 7fae0faec640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae081547a0 0x7fae0815bae0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c4e0 tx=0x7fadf800c9a0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.017+0000 7fae0faec640 1 -- 172.21.15.38:0/1022874194 shutdown_connections 2023-12-22T08:53:08.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.017+0000 7fae0faec640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae08154b80 0x7fae0815c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.017+0000 7fae0faec640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fadec06a430 0x7fadec06c8f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.017+0000 7fae0faec640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae081547a0 0x7fae0815bae0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.017+0000 7fae0faec640 1 --2- 172.21.15.38:0/1022874194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae08071b90 0x7fae0814ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.017+0000 7fae0faec640 1 -- 172.21.15.38:0/1022874194 >> 172.21.15.38:0/1022874194 conn(0x7fae080cf070 msgr2=0x7fae08070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:08.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.017+0000 7fae0faec640 1 -- 172.21.15.38:0/1022874194 shutdown_connections 2023-12-22T08:53:08.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.017+0000 7fae0faec640 1 -- 172.21.15.38:0/1022874194 wait complete. 2023-12-22T08:53:08.037 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:53:08.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.260+0000 7f5e6759e640 1 Processor -- start 2023-12-22T08:53:08.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.261+0000 7f5e6759e640 1 -- start start 2023-12-22T08:53:08.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.262+0000 7f5e6759e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5e6815b420 0x7f5e6806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:08.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.262+0000 7f5e6759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e680a44a0 0x7f5e680708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:08.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.262+0000 7f5e6759e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e680cdae0 con 0x7f5e68070e30 2023-12-22T08:53:08.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.262+0000 7f5e6759e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e68071260 con 0x7f5e6815b420 2023-12-22T08:53:08.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.262+0000 7f5e6759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6806dec0 con 0x7f5e680a44a0 2023-12-22T08:53:08.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.263+0000 7f5e6659c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5e6815b420 0x7f5e6806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:08.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.263+0000 7f5e6659c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5e6815b420 0x7f5e6806d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38854/0 (socket says 172.21.15.38:38854) 2023-12-22T08:53:08.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.263+0000 7f5e6659c640 1 -- 172.21.15.38:0/3849464137 learned_addr learned my addr 172.21.15.38:0/3849464137 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:08.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.263+0000 7f5e65d9b640 1 --2- 172.21.15.38:0/3849464137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e680a44a0 0x7f5e680708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:08.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.263+0000 7f5e6659c640 1 -- 172.21.15.38:0/3849464137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e680a44a0 msgr2=0x7f5e680708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:08.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.263+0000 7f5e6659c640 1 --2- 172.21.15.38:0/3849464137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e680a44a0 0x7f5e680708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.264+0000 7f5e6659c640 1 -- 172.21.15.38:0/3849464137 >> v1:172.21.15.89:6789/0 conn(0x7f5e68070e30 legacy=0x7f5e6806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.264+0000 7f5e6659c640 1 -- 172.21.15.38:0/3849464137 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6815b800 con 0x7f5e6815b420 2023-12-22T08:53:08.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.264+0000 7f5e65d9b640 1 --2- 172.21.15.38:0/3849464137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e680a44a0 0x7f5e680708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:53:08.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.265+0000 7f5e6659c640 1 --2- 172.21.15.38:0/3849464137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e6815b420 0x7f5e6806d980 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009e50 tx=0x7f5e5802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d4c77d599a52b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:08.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.265+0000 7f5e6559a640 1 -- 172.21.15.38:0/3849464137 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5802cb00 con 0x7f5e6815b420 2023-12-22T08:53:08.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.266+0000 7f5e6559a640 1 -- 172.21.15.38:0/3849464137 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5802cc60 con 0x7f5e6815b420 2023-12-22T08:53:08.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.266+0000 7f5e6559a640 1 -- 172.21.15.38:0/3849464137 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580343f0 con 0x7f5e6815b420 2023-12-22T08:53:08.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.266+0000 7f5e6759e640 1 -- 172.21.15.38:0/3849464137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e6815b420 msgr2=0x7f5e6806d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.266+0000 7f5e6759e640 1 --2- 172.21.15.38:0/3849464137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e6815b420 0x7f5e6806d980 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009e50 tx=0x7f5e5802bf60 comp rx=0 tx=0).stop 2023-12-22T08:53:08.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.266+0000 7f5e6759e640 1 -- 172.21.15.38:0/3849464137 shutdown_connections 2023-12-22T08:53:08.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.266+0000 7f5e6759e640 1 --2- 172.21.15.38:0/3849464137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e680a44a0 0x7f5e680708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.266+0000 7f5e6759e640 1 --2- 172.21.15.38:0/3849464137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e6815b420 0x7f5e6806d980 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.266+0000 7f5e6759e640 1 -- 172.21.15.38:0/3849464137 >> 172.21.15.38:0/3849464137 conn(0x7f5e680b1f70 msgr2=0x7f5e680b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:08.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.267+0000 7f5e6759e640 1 -- 172.21.15.38:0/3849464137 shutdown_connections 2023-12-22T08:53:08.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.267+0000 7f5e6759e640 1 -- 172.21.15.38:0/3849464137 wait complete. 2023-12-22T08:53:08.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.268+0000 7f5e6759e640 1 Processor -- start 2023-12-22T08:53:08.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.269+0000 7f5e6759e640 1 -- start start 2023-12-22T08:53:08.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.269+0000 7f5e6759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e68070e30 0x7f5e6809eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:08.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e6759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e680a44a0 0x7f5e680cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:08.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e6759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e6815b420 0x7f5e68148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:08.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e6759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68151190 con 0x7f5e6815b420 2023-12-22T08:53:08.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e6759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6809f6a0 con 0x7f5e680a44a0 2023-12-22T08:53:08.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e6759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68151430 con 0x7f5e68070e30 2023-12-22T08:53:08.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e66d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e6815b420 0x7f5e68148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:08.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e66d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e6815b420 0x7f5e68148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38860/0 (socket says 172.21.15.38:38860) 2023-12-22T08:53:08.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e66d9d640 1 -- 172.21.15.38:0/390907949 learned_addr learned my addr 172.21.15.38:0/390907949 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:08.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e6659c640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e68070e30 0x7f5e6809eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:08.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e65d9b640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e680a44a0 0x7f5e680cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:08.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e66d9d640 1 -- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e68070e30 msgr2=0x7f5e6809eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e66d9d640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e68070e30 0x7f5e6809eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e66d9d640 1 -- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e680a44a0 msgr2=0x7f5e680cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e66d9d640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e680a44a0 0x7f5e680cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.270+0000 7f5e66d9d640 1 -- 172.21.15.38:0/390907949 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58009b30 con 0x7f5e6815b420 2023-12-22T08:53:08.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.271+0000 7f5e66d9d640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e6815b420 0x7f5e68148dd0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000c390 tx=0x7f5e6000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:08.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.271+0000 7f5e56ffd640 1 -- 172.21.15.38:0/390907949 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e600052d0 con 0x7f5e6815b420 2023-12-22T08:53:08.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.271+0000 7f5e56ffd640 1 -- 172.21.15.38:0/390907949 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e60005430 con 0x7f5e6815b420 2023-12-22T08:53:08.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.271+0000 7f5e56ffd640 1 -- 172.21.15.38:0/390907949 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60003810 con 0x7f5e6815b420 2023-12-22T08:53:08.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.271+0000 7f5e6759e640 1 -- 172.21.15.38:0/390907949 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e68151710 con 0x7f5e6815b420 2023-12-22T08:53:08.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.271+0000 7f5e6759e640 1 -- 172.21.15.38:0/390907949 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6809f2e0 con 0x7f5e6815b420 2023-12-22T08:53:08.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.272+0000 7f5e6759e640 1 -- 172.21.15.38:0/390907949 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e68151c30 con 0x7f5e6815b420 2023-12-22T08:53:08.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.273+0000 7f5e56ffd640 1 -- 172.21.15.38:0/390907949 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5e60003970 con 0x7f5e6815b420 2023-12-22T08:53:08.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.274+0000 7f5e56ffd640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5e4806a430 0x7f5e4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:08.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.275+0000 7f5e56ffd640 1 -- 172.21.15.38:0/390907949 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e60087e40 con 0x7f5e6815b420 2023-12-22T08:53:08.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.275+0000 7f5e6659c640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5e4806a430 0x7f5e4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:08.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.276+0000 7f5e6659c640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5e4806a430 0x7f5e4806c8f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5e58035000 tx=0x7f5e58030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:08.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.279+0000 7f5e56ffd640 1 -- 172.21.15.38:0/390907949 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5e68151c30 con 0x7f5e6815b420 2023-12-22T08:53:08.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.472+0000 7f5e6759e640 1 -- 172.21.15.38:0/390907949 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e68151c30 con 0x7f5e6815b420 2023-12-22T08:53:08.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.473+0000 7f5e56ffd640 1 -- 172.21.15.38:0/390907949 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+16064 (secure 0 0 0) 0x7f5e68151c30 con 0x7f5e6815b420 2023-12-22T08:53:08.475 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:08.475 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":190,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:53:05.467364+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:53:02.354802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-22T08:53:03.461583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:53:08.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.476+0000 7f5e6759e640 1 -- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5e4806a430 msgr2=0x7f5e4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.476+0000 7f5e6759e640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5e4806a430 0x7f5e4806c8f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5e58035000 tx=0x7f5e58030000 comp rx=0 tx=0).stop 2023-12-22T08:53:08.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.476+0000 7f5e6759e640 1 -- 172.21.15.38:0/390907949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e6815b420 msgr2=0x7f5e68148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.476+0000 7f5e6759e640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e6815b420 0x7f5e68148dd0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000c390 tx=0x7f5e6000c850 comp rx=0 tx=0).stop 2023-12-22T08:53:08.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.476+0000 7f5e6759e640 1 -- 172.21.15.38:0/390907949 shutdown_connections 2023-12-22T08:53:08.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.476+0000 7f5e6759e640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5e4806a430 0x7f5e4806c8f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.476+0000 7f5e6759e640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e6815b420 0x7f5e68148dd0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.476+0000 7f5e6759e640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e680a44a0 0x7f5e680cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.476+0000 7f5e6759e640 1 --2- 172.21.15.38:0/390907949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e68070e30 0x7f5e6809eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.476+0000 7f5e6759e640 1 -- 172.21.15.38:0/390907949 >> 172.21.15.38:0/390907949 conn(0x7f5e680b1f70 msgr2=0x7f5e6815c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:08.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.476+0000 7f5e6759e640 1 -- 172.21.15.38:0/390907949 shutdown_connections 2023-12-22T08:53:08.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.477+0000 7f5e6759e640 1 -- 172.21.15.38:0/390907949 wait complete. 2023-12-22T08:53:08.494 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T08:53:08.494 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:53:08.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.709+0000 7f8d1b9f6640 1 Processor -- start 2023-12-22T08:53:08.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.710+0000 7f8d1b9f6640 1 -- start start 2023-12-22T08:53:08.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.711+0000 7f8d1b9f6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8d14146e40 0x7f8d140cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:08.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.711+0000 7f8d1b9f6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8d141618d0 0x7f8d14070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:08.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.711+0000 7f8d1b9f6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d140b4120 con 0x7f8d14161df0 2023-12-22T08:53:08.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.711+0000 7f8d1b9f6640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d140b4da0 con 0x7f8d141618d0 2023-12-22T08:53:08.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.711+0000 7f8d1b9f6640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d140b4400 con 0x7f8d14146e40 2023-12-22T08:53:08.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.711+0000 7f8d18f91640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8d14161df0 0x7f8d141611c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52924/0 (socket says 172.21.15.38:52924) 2023-12-22T08:53:08.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.712+0000 7f8d18f91640 1 -- 172.21.15.38:0/2687354341 learned_addr learned my addr 172.21.15.38:0/2687354341 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:08.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.712+0000 7f8d19f93640 1 --2- 172.21.15.38:0/2687354341 >> v2:172.21.15.38:3300/0 conn(0x7f8d141618d0 0x7f8d14070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:08.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.712+0000 7f8d19792640 1 --2- 172.21.15.38:0/2687354341 >> v2:172.21.15.89:3300/0 conn(0x7f8d14146e40 0x7f8d140cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:08.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.712+0000 7f8d19f93640 1 -- 172.21.15.38:0/2687354341 >> v2:172.21.15.89:3300/0 conn(0x7f8d14146e40 msgr2=0x7f8d140cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:08.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.712+0000 7f8d19f93640 1 --2- 172.21.15.38:0/2687354341 >> v2:172.21.15.89:3300/0 conn(0x7f8d14146e40 0x7f8d140cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.712+0000 7f8d19f93640 1 -- 172.21.15.38:0/2687354341 >> v1:172.21.15.38:6789/0 conn(0x7f8d14161df0 legacy=0x7f8d141611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.712+0000 7f8d19f93640 1 -- 172.21.15.38:0/2687354341 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d140b46e0 con 0x7f8d141618d0 2023-12-22T08:53:08.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.712+0000 7f8d19792640 1 --2- 172.21.15.38:0/2687354341 >> v2:172.21.15.89:3300/0 conn(0x7f8d14146e40 0x7f8d140cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:08.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.713+0000 7f8d19f93640 1 --2- 172.21.15.38:0/2687354341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d141618d0 0x7f8d14070ae0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f8d1406c620 tx=0x7f8d0c02bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e8a436f748ea2e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:08.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.713+0000 7f8d0bfff640 1 -- 172.21.15.38:0/2687354341 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c02cb50 con 0x7f8d141618d0 2023-12-22T08:53:08.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.714+0000 7f8d0bfff640 1 -- 172.21.15.38:0/2687354341 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c02ccb0 con 0x7f8d141618d0 2023-12-22T08:53:08.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.714+0000 7f8d0bfff640 1 -- 172.21.15.38:0/2687354341 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c034660 con 0x7f8d141618d0 2023-12-22T08:53:08.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.714+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/2687354341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d141618d0 msgr2=0x7f8d14070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.714+0000 7f8d1b9f6640 1 --2- 172.21.15.38:0/2687354341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d141618d0 0x7f8d14070ae0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f8d1406c620 tx=0x7f8d0c02bda0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.714+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/2687354341 shutdown_connections 2023-12-22T08:53:08.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.714+0000 7f8d1b9f6640 1 --2- 172.21.15.38:0/2687354341 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d141618d0 0x7f8d14070ae0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.714+0000 7f8d1b9f6640 1 --2- 172.21.15.38:0/2687354341 >> v2:172.21.15.89:3300/0 conn(0x7f8d14146e40 0x7f8d140cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.714+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/2687354341 >> 172.21.15.38:0/2687354341 conn(0x7f8d140cff10 msgr2=0x7f8d140d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:08.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.714+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/2687354341 shutdown_connections 2023-12-22T08:53:08.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.714+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/2687354341 wait complete. 2023-12-22T08:53:08.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.716+0000 7f8d1b9f6640 1 Processor -- start 2023-12-22T08:53:08.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.716+0000 7f8d1b9f6640 1 -- start start 2023-12-22T08:53:08.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.717+0000 7f8d1b9f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d14146e40 0x7f8d1413ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:08.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.717+0000 7f8d1b9f6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d141618d0 0x7f8d141438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:08.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.717+0000 7f8d1b9f6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d14161df0 0x7f8d1415feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:08.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.717+0000 7f8d1b9f6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14142af0 con 0x7f8d141618d0 2023-12-22T08:53:08.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.717+0000 7f8d1b9f6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14142dd0 con 0x7f8d14146e40 2023-12-22T08:53:08.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.717+0000 7f8d1b9f6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d141430b0 con 0x7f8d14161df0 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.718+0000 7f8d18f91640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d141618d0 0x7f8d141438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.718+0000 7f8d18f91640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d141618d0 0x7f8d141438b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38876/0 (socket says 172.21.15.38:38876) 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.718+0000 7f8d18f91640 1 -- 172.21.15.38:0/846729054 learned_addr learned my addr 172.21.15.38:0/846729054 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.718+0000 7f8d19792640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d14146e40 0x7f8d1413ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.718+0000 7f8d19f93640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d14161df0 0x7f8d1415feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.718+0000 7f8d18f91640 1 -- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d14161df0 msgr2=0x7f8d1415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.718+0000 7f8d18f91640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d14161df0 0x7f8d1415feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.718+0000 7f8d18f91640 1 -- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d14146e40 msgr2=0x7f8d1413ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.718+0000 7f8d18f91640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d14146e40 0x7f8d1413ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.718+0000 7f8d18f91640 1 -- 172.21.15.38:0/846729054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c009a70 con 0x7f8d141618d0 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.718+0000 7f8d19792640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d14146e40 0x7f8d1413ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.718+0000 7f8d18f91640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d141618d0 0x7f8d141438b0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400c430 tx=0x7f8d0400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.719+0000 7f8d09ffb640 1 -- 172.21.15.38:0/846729054 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d040074e0 con 0x7f8d141618d0 2023-12-22T08:53:08.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.719+0000 7f8d09ffb640 1 -- 172.21.15.38:0/846729054 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d04007640 con 0x7f8d141618d0 2023-12-22T08:53:08.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.719+0000 7f8d09ffb640 1 -- 172.21.15.38:0/846729054 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d040059a0 con 0x7f8d141618d0 2023-12-22T08:53:08.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.719+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/846729054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d14143390 con 0x7f8d141618d0 2023-12-22T08:53:08.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.719+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/846729054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d14143df0 con 0x7f8d141618d0 2023-12-22T08:53:08.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.720+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/846729054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d14142c30 con 0x7f8d141618d0 2023-12-22T08:53:08.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.721+0000 7f8d09ffb640 1 -- 172.21.15.38:0/846729054 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8d04005bc0 con 0x7f8d141618d0 2023-12-22T08:53:08.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.722+0000 7f8d09ffb640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8cf806a430 0x7f8cf806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:08.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.722+0000 7f8d09ffb640 1 -- 172.21.15.38:0/846729054 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d04087f20 con 0x7f8d141618d0 2023-12-22T08:53:08.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.722+0000 7f8d19792640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8cf806a430 0x7f8cf806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:08.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.723+0000 7f8d19792640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8cf806a430 0x7f8cf806c8f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8d140b9100 tx=0x7f8d10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:08.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.726+0000 7f8d09ffb640 1 -- 172.21.15.38:0/846729054 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8d14142c30 con 0x7f8d141618d0 2023-12-22T08:53:08.888 INFO:tasks.ceph.mds.c.smithi038.stderr:2023-12-22T08:53:08.887+0000 7f59c1137640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:53:08.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.911+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/846729054 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d140b49c0 con 0x7f8cf806a430 2023-12-22T08:53:08.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.935+0000 7f8d09ffb640 1 -- 172.21.15.38:0/846729054 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282898 (secure 0 0 0) 0x7f8d1000c040 con 0x7f8cf806a430 2023-12-22T08:53:08.940 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:08.941 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:53:08.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.941+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8cf806a430 msgr2=0x7f8cf806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.941+0000 7f8d1b9f6640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8cf806a430 0x7f8cf806c8f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8d140b9100 tx=0x7f8d10008040 comp rx=0 tx=0).stop 2023-12-22T08:53:08.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.941+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/846729054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d141618d0 msgr2=0x7f8d141438b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:08.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.941+0000 7f8d1b9f6640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d141618d0 0x7f8d141438b0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400c430 tx=0x7f8d0400c8f0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.941+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/846729054 shutdown_connections 2023-12-22T08:53:08.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.941+0000 7f8d1b9f6640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d14161df0 0x7f8d1415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.941+0000 7f8d1b9f6640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f8cf806a430 0x7f8cf806c8f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.941+0000 7f8d1b9f6640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d141618d0 0x7f8d141438b0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.941+0000 7f8d1b9f6640 1 --2- 172.21.15.38:0/846729054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d14146e40 0x7f8d1413ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:08.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.941+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/846729054 >> 172.21.15.38:0/846729054 conn(0x7f8d140cff10 msgr2=0x7f8d1406df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:08.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.941+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/846729054 shutdown_connections 2023-12-22T08:53:08.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:08.941+0000 7f8d1b9f6640 1 -- 172.21.15.38:0/846729054 wait complete. 2023-12-22T08:53:08.961 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":582,"stamp":"2023-12-22T08:53:08.647161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9491,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553008,"statfs":{"total":1600000000,"available":1590280751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.703571"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015266+0000","last_change":"2023-12-22T08:53:04.482739+0000","last_active":"2023-12-22T08:53:08.015266+0000","last_peered":"2023-12-22T08:53:08.015266+0000","last_clean":"2023-12-22T08:53:08.015266+0000","last_became_active":"2023-12-22T08:53:04.482517+0000","last_became_peered":"2023-12-22T08:53:04.482517+0000","last_unstale":"2023-12-22T08:53:08.015266+0000","last_undegraded":"2023-12-22T08:53:08.015266+0000","last_fullsized":"2023-12-22T08:53:08.015266+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:45.576446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014907+0000","last_change":"2023-12-22T08:53:04.485413+0000","last_active":"2023-12-22T08:53:08.014907+0000","last_peered":"2023-12-22T08:53:08.014907+0000","last_clean":"2023-12-22T08:53:08.014907+0000","last_became_active":"2023-12-22T08:53:04.484419+0000","last_became_peered":"2023-12-22T08:53:04.484419+0000","last_unstale":"2023-12-22T08:53:08.014907+0000","last_undegraded":"2023-12-22T08:53:08.014907+0000","last_fullsized":"2023-12-22T08:53:08.014907+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:39:49.783107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015538+0000","last_change":"2023-12-22T08:53:04.486214+0000","last_active":"2023-12-22T08:53:08.015538+0000","last_peered":"2023-12-22T08:53:08.015538+0000","last_clean":"2023-12-22T08:53:08.015538+0000","last_became_active":"2023-12-22T08:53:04.485139+0000","last_became_peered":"2023-12-22T08:53:04.485139+0000","last_unstale":"2023-12-22T08:53:08.015538+0000","last_undegraded":"2023-12-22T08:53:08.015538+0000","last_fullsized":"2023-12-22T08:53:08.015538+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:01.571929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.488266+0000","last_change":"2023-12-22T08:53:04.506742+0000","last_active":"2023-12-22T08:53:05.488266+0000","last_peered":"2023-12-22T08:53:05.488266+0000","last_clean":"2023-12-22T08:53:05.488266+0000","last_became_active":"2023-12-22T08:53:04.506197+0000","last_became_peered":"2023-12-22T08:53:04.506197+0000","last_unstale":"2023-12-22T08:53:05.488266+0000","last_undegraded":"2023-12-22T08:53:05.488266+0000","last_fullsized":"2023-12-22T08:53:05.488266+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:03:13.596128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014449+0000","last_change":"2023-12-22T08:53:04.489940+0000","last_active":"2023-12-22T08:53:08.014449+0000","last_peered":"2023-12-22T08:53:08.014449+0000","last_clean":"2023-12-22T08:53:08.014449+0000","last_became_active":"2023-12-22T08:53:04.488477+0000","last_became_peered":"2023-12-22T08:53:04.488477+0000","last_unstale":"2023-12-22T08:53:08.014449+0000","last_undegraded":"2023-12-22T08:53:08.014449+0000","last_fullsized":"2023-12-22T08:53:08.014449+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:40.049193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015794+0000","last_change":"2023-12-22T08:53:04.500999+0000","last_active":"2023-12-22T08:53:08.015794+0000","last_peered":"2023-12-22T08:53:08.015794+0000","last_clean":"2023-12-22T08:53:08.015794+0000","last_became_active":"2023-12-22T08:53:04.500756+0000","last_became_peered":"2023-12-22T08:53:04.500756+0000","last_unstale":"2023-12-22T08:53:08.015794+0000","last_undegraded":"2023-12-22T08:53:08.015794+0000","last_fullsized":"2023-12-22T08:53:08.015794+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:51:03.123178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.485591+0000","last_change":"2023-12-22T08:53:04.500497+0000","last_active":"2023-12-22T08:53:05.485591+0000","last_peered":"2023-12-22T08:53:05.485591+0000","last_clean":"2023-12-22T08:53:05.485591+0000","last_became_active":"2023-12-22T08:53:04.500045+0000","last_became_peered":"2023-12-22T08:53:04.500045+0000","last_unstale":"2023-12-22T08:53:05.485591+0000","last_undegraded":"2023-12-22T08:53:05.485591+0000","last_fullsized":"2023-12-22T08:53:05.485591+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:46:22.997124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.144806+0000","last_change":"2023-12-22T08:53:04.482729+0000","last_active":"2023-12-22T08:53:06.144806+0000","last_peered":"2023-12-22T08:53:06.144806+0000","last_clean":"2023-12-22T08:53:06.144806+0000","last_became_active":"2023-12-22T08:53:04.482491+0000","last_became_peered":"2023-12-22T08:53:04.482491+0000","last_unstale":"2023-12-22T08:53:06.144806+0000","last_undegraded":"2023-12-22T08:53:06.144806+0000","last_fullsized":"2023-12-22T08:53:06.144806+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:57.481784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.144779+0000","last_change":"2023-12-22T08:53:04.498365+0000","last_active":"2023-12-22T08:53:06.144779+0000","last_peered":"2023-12-22T08:53:06.144779+0000","last_clean":"2023-12-22T08:53:06.144779+0000","last_became_active":"2023-12-22T08:53:04.498095+0000","last_became_peered":"2023-12-22T08:53:04.498095+0000","last_unstale":"2023-12-22T08:53:06.144779+0000","last_undegraded":"2023-12-22T08:53:06.144779+0000","last_fullsized":"2023-12-22T08:53:06.144779+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:29:11.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.144766+0000","last_change":"2023-12-22T08:53:04.495409+0000","last_active":"2023-12-22T08:53:06.144766+0000","last_peered":"2023-12-22T08:53:06.144766+0000","last_clean":"2023-12-22T08:53:06.144766+0000","last_became_active":"2023-12-22T08:53:04.495187+0000","last_became_peered":"2023-12-22T08:53:04.495187+0000","last_unstale":"2023-12-22T08:53:06.144766+0000","last_undegraded":"2023-12-22T08:53:06.144766+0000","last_fullsized":"2023-12-22T08:53:06.144766+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:28:58.532934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014910+0000","last_change":"2023-12-22T08:53:04.497546+0000","last_active":"2023-12-22T08:53:08.014910+0000","last_peered":"2023-12-22T08:53:08.014910+0000","last_clean":"2023-12-22T08:53:08.014910+0000","last_became_active":"2023-12-22T08:53:04.497301+0000","last_became_peered":"2023-12-22T08:53:04.497301+0000","last_unstale":"2023-12-22T08:53:08.014910+0000","last_undegraded":"2023-12-22T08:53:08.014910+0000","last_fullsized":"2023-12-22T08:53:08.014910+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:40:31.348198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:07.987928+0000","last_change":"2023-12-22T08:53:04.501994+0000","last_active":"2023-12-22T08:53:07.987928+0000","last_peered":"2023-12-22T08:53:07.987928+0000","last_clean":"2023-12-22T08:53:07.987928+0000","last_became_active":"2023-12-22T08:53:04.501692+0000","last_became_peered":"2023-12-22T08:53:04.501692+0000","last_unstale":"2023-12-22T08:53:07.987928+0000","last_undegraded":"2023-12-22T08:53:07.987928+0000","last_fullsized":"2023-12-22T08:53:07.987928+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:43:54.623048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:07.987695+0000","last_change":"2023-12-22T08:53:04.479107+0000","last_active":"2023-12-22T08:53:07.987695+0000","last_peered":"2023-12-22T08:53:07.987695+0000","last_clean":"2023-12-22T08:53:07.987695+0000","last_became_active":"2023-12-22T08:53:04.478861+0000","last_became_peered":"2023-12-22T08:53:04.478861+0000","last_unstale":"2023-12-22T08:53:07.987695+0000","last_undegraded":"2023-12-22T08:53:07.987695+0000","last_fullsized":"2023-12-22T08:53:07.987695+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:44:08.516182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.145095+0000","last_change":"2023-12-22T08:53:04.490882+0000","last_active":"2023-12-22T08:53:06.145095+0000","last_peered":"2023-12-22T08:53:06.145095+0000","last_clean":"2023-12-22T08:53:06.145095+0000","last_became_active":"2023-12-22T08:53:04.490650+0000","last_became_peered":"2023-12-22T08:53:04.490650+0000","last_unstale":"2023-12-22T08:53:06.145095+0000","last_undegraded":"2023-12-22T08:53:06.145095+0000","last_fullsized":"2023-12-22T08:53:06.145095+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:28:14.952524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.145022+0000","last_change":"2023-12-22T08:53:04.502197+0000","last_active":"2023-12-22T08:53:06.145022+0000","last_peered":"2023-12-22T08:53:06.145022+0000","last_clean":"2023-12-22T08:53:06.145022+0000","last_became_active":"2023-12-22T08:53:04.501958+0000","last_became_peered":"2023-12-22T08:53:04.501958+0000","last_unstale":"2023-12-22T08:53:06.145022+0000","last_undegraded":"2023-12-22T08:53:06.145022+0000","last_fullsized":"2023-12-22T08:53:06.145022+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:50:10.521323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.486466+0000","last_change":"2023-12-22T08:53:04.492740+0000","last_active":"2023-12-22T08:53:05.486466+0000","last_peered":"2023-12-22T08:53:05.486466+0000","last_clean":"2023-12-22T08:53:05.486466+0000","last_became_active":"2023-12-22T08:53:04.491820+0000","last_became_peered":"2023-12-22T08:53:04.491820+0000","last_unstale":"2023-12-22T08:53:05.486466+0000","last_undegraded":"2023-12-22T08:53:05.486466+0000","last_fullsized":"2023-12-22T08:53:05.486466+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:50:10.886197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.016189+0000","last_change":"2023-12-22T08:53:04.499864+0000","last_active":"2023-12-22T08:53:08.016189+0000","last_peered":"2023-12-22T08:53:08.016189+0000","last_clean":"2023-12-22T08:53:08.016189+0000","last_became_active":"2023-12-22T08:53:04.499635+0000","last_became_peered":"2023-12-22T08:53:04.499635+0000","last_unstale":"2023-12-22T08:53:08.016189+0000","last_undegraded":"2023-12-22T08:53:08.016189+0000","last_fullsized":"2023-12-22T08:53:08.016189+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:28:58.532934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.487978+0000","last_change":"2023-12-22T08:53:04.504371+0000","last_active":"2023-12-22T08:53:05.487978+0000","last_peered":"2023-12-22T08:53:05.487978+0000","last_clean":"2023-12-22T08:53:05.487978+0000","last_became_active":"2023-12-22T08:53:04.503669+0000","last_became_peered":"2023-12-22T08:53:04.503669+0000","last_unstale":"2023-12-22T08:53:05.487978+0000","last_undegraded":"2023-12-22T08:53:05.487978+0000","last_fullsized":"2023-12-22T08:53:05.487978+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:34:15.547023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.483855+0000","last_change":"2023-12-22T08:53:04.494018+0000","last_active":"2023-12-22T08:53:05.483855+0000","last_peered":"2023-12-22T08:53:05.483855+0000","last_clean":"2023-12-22T08:53:05.483855+0000","last_became_active":"2023-12-22T08:53:04.493702+0000","last_became_peered":"2023-12-22T08:53:04.493702+0000","last_unstale":"2023-12-22T08:53:05.483855+0000","last_undegraded":"2023-12-22T08:53:05.483855+0000","last_fullsized":"2023-12-22T08:53:05.483855+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:04:29.093854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:07.987679+0000","last_change":"2023-12-22T08:53:04.489395+0000","last_active":"2023-12-22T08:53:07.987679+0000","last_peered":"2023-12-22T08:53:07.987679+0000","last_clean":"2023-12-22T08:53:07.987679+0000","last_became_active":"2023-12-22T08:53:04.489195+0000","last_became_peered":"2023-12-22T08:53:04.489195+0000","last_unstale":"2023-12-22T08:53:07.987679+0000","last_undegraded":"2023-12-22T08:53:07.987679+0000","last_fullsized":"2023-12-22T08:53:07.987679+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:23:25.758708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015929+0000","last_change":"2023-12-22T08:53:04.504200+0000","last_active":"2023-12-22T08:53:08.015929+0000","last_peered":"2023-12-22T08:53:08.015929+0000","last_clean":"2023-12-22T08:53:08.015929+0000","last_became_active":"2023-12-22T08:53:04.503828+0000","last_became_peered":"2023-12-22T08:53:04.503828+0000","last_unstale":"2023-12-22T08:53:08.015929+0000","last_undegraded":"2023-12-22T08:53:08.015929+0000","last_fullsized":"2023-12-22T08:53:08.015929+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:28:14.952524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.013875+0000","last_change":"2023-12-22T08:53:04.494791+0000","last_active":"2023-12-22T08:53:08.013875+0000","last_peered":"2023-12-22T08:53:08.013875+0000","last_clean":"2023-12-22T08:53:08.013875+0000","last_became_active":"2023-12-22T08:53:04.494579+0000","last_became_peered":"2023-12-22T08:53:04.494579+0000","last_unstale":"2023-12-22T08:53:08.013875+0000","last_undegraded":"2023-12-22T08:53:08.013875+0000","last_fullsized":"2023-12-22T08:53:08.013875+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:43.149858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.486994+0000","last_change":"2023-12-22T08:53:04.497224+0000","last_active":"2023-12-22T08:53:05.486994+0000","last_peered":"2023-12-22T08:53:05.486994+0000","last_clean":"2023-12-22T08:53:05.486994+0000","last_became_active":"2023-12-22T08:53:04.495885+0000","last_became_peered":"2023-12-22T08:53:04.495885+0000","last_unstale":"2023-12-22T08:53:05.486994+0000","last_undegraded":"2023-12-22T08:53:05.486994+0000","last_fullsized":"2023-12-22T08:53:05.486994+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:19:15.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014141+0000","last_change":"2023-12-22T08:53:04.487613+0000","last_active":"2023-12-22T08:53:08.014141+0000","last_peered":"2023-12-22T08:53:08.014141+0000","last_clean":"2023-12-22T08:53:08.014141+0000","last_became_active":"2023-12-22T08:53:04.487238+0000","last_became_peered":"2023-12-22T08:53:04.487238+0000","last_unstale":"2023-12-22T08:53:08.014141+0000","last_undegraded":"2023-12-22T08:53:08.014141+0000","last_fullsized":"2023-12-22T08:53:08.014141+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:29:11.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014549+0000","last_change":"2023-12-22T08:53:04.498772+0000","last_active":"2023-12-22T08:53:08.014549+0000","last_peered":"2023-12-22T08:53:08.014549+0000","last_clean":"2023-12-22T08:53:08.014549+0000","last_became_active":"2023-12-22T08:53:04.498430+0000","last_became_peered":"2023-12-22T08:53:04.498430+0000","last_unstale":"2023-12-22T08:53:08.014549+0000","last_undegraded":"2023-12-22T08:53:08.014549+0000","last_fullsized":"2023-12-22T08:53:08.014549+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:57.481784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.485191+0000","last_change":"2023-12-22T08:53:04.503546+0000","last_active":"2023-12-22T08:53:05.485191+0000","last_peered":"2023-12-22T08:53:05.485191+0000","last_clean":"2023-12-22T08:53:05.485191+0000","last_became_active":"2023-12-22T08:53:04.503308+0000","last_became_peered":"2023-12-22T08:53:04.503308+0000","last_unstale":"2023-12-22T08:53:05.485191+0000","last_undegraded":"2023-12-22T08:53:05.485191+0000","last_fullsized":"2023-12-22T08:53:05.485191+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:47:05.201083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.013981+0000","last_change":"2023-12-22T08:53:04.501581+0000","last_active":"2023-12-22T08:53:08.013981+0000","last_peered":"2023-12-22T08:53:08.013981+0000","last_clean":"2023-12-22T08:53:08.013981+0000","last_became_active":"2023-12-22T08:53:04.501306+0000","last_became_peered":"2023-12-22T08:53:04.501306+0000","last_unstale":"2023-12-22T08:53:08.013981+0000","last_undegraded":"2023-12-22T08:53:08.013981+0000","last_fullsized":"2023-12-22T08:53:08.013981+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:29:26.355639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.484355+0000","last_change":"2023-12-22T08:53:04.495363+0000","last_active":"2023-12-22T08:53:05.484355+0000","last_peered":"2023-12-22T08:53:05.484355+0000","last_clean":"2023-12-22T08:53:05.484355+0000","last_became_active":"2023-12-22T08:53:04.495030+0000","last_became_peered":"2023-12-22T08:53:04.495030+0000","last_unstale":"2023-12-22T08:53:05.484355+0000","last_undegraded":"2023-12-22T08:53:05.484355+0000","last_fullsized":"2023-12-22T08:53:05.484355+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:52.778810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014764+0000","last_change":"2023-12-22T08:53:04.485173+0000","last_active":"2023-12-22T08:53:08.014764+0000","last_peered":"2023-12-22T08:53:08.014764+0000","last_clean":"2023-12-22T08:53:08.014764+0000","last_became_active":"2023-12-22T08:53:04.484945+0000","last_became_peered":"2023-12-22T08:53:04.484945+0000","last_unstale":"2023-12-22T08:53:08.014764+0000","last_undegraded":"2023-12-22T08:53:08.014764+0000","last_fullsized":"2023-12-22T08:53:08.014764+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:55:03.965312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.145304+0000","last_change":"2023-12-22T08:53:04.491694+0000","last_active":"2023-12-22T08:53:06.145304+0000","last_peered":"2023-12-22T08:53:06.145304+0000","last_clean":"2023-12-22T08:53:06.145304+0000","last_became_active":"2023-12-22T08:53:04.491481+0000","last_became_peered":"2023-12-22T08:53:04.491481+0000","last_unstale":"2023-12-22T08:53:06.145304+0000","last_undegraded":"2023-12-22T08:53:06.145304+0000","last_fullsized":"2023-12-22T08:53:06.145304+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:51:03.123178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015506+0000","last_change":"2023-12-22T08:53:04.488894+0000","last_active":"2023-12-22T08:53:08.015506+0000","last_peered":"2023-12-22T08:53:08.015506+0000","last_clean":"2023-12-22T08:53:08.015506+0000","last_became_active":"2023-12-22T08:53:04.488661+0000","last_became_peered":"2023-12-22T08:53:04.488661+0000","last_unstale":"2023-12-22T08:53:08.015506+0000","last_undegraded":"2023-12-22T08:53:08.015506+0000","last_fullsized":"2023-12-22T08:53:08.015506+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:23:01.132204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015481+0000","last_change":"2023-12-22T08:53:04.507020+0000","last_active":"2023-12-22T08:53:08.015481+0000","last_peered":"2023-12-22T08:53:08.015481+0000","last_clean":"2023-12-22T08:53:08.015481+0000","last_became_active":"2023-12-22T08:53:04.505243+0000","last_became_peered":"2023-12-22T08:53:04.505243+0000","last_unstale":"2023-12-22T08:53:08.015481+0000","last_undegraded":"2023-12-22T08:53:08.015481+0000","last_fullsized":"2023-12-22T08:53:08.015481+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:50:10.521323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.488759+0000","last_change":"2023-12-22T08:53:04.506564+0000","last_active":"2023-12-22T08:53:05.488759+0000","last_peered":"2023-12-22T08:53:05.488759+0000","last_clean":"2023-12-22T08:53:05.488759+0000","last_became_active":"2023-12-22T08:53:04.505898+0000","last_became_peered":"2023-12-22T08:53:04.505898+0000","last_unstale":"2023-12-22T08:53:05.488759+0000","last_undegraded":"2023-12-22T08:53:05.488759+0000","last_fullsized":"2023-12-22T08:53:05.488759+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:34:50.910598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"189'4","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.494003+0000","last_change":"2023-12-22T08:53:03.980022+0000","last_active":"2023-12-22T08:53:04.494003+0000","last_peered":"2023-12-22T08:53:04.494003+0000","last_clean":"2023-12-22T08:53:04.494003+0000","last_became_active":"2023-12-22T08:53:03.978314+0000","last_became_peered":"2023-12-22T08:53:03.978314+0000","last_unstale":"2023-12-22T08:53:04.494003+0000","last_undegraded":"2023-12-22T08:53:04.494003+0000","last_fullsized":"2023-12-22T08:53:04.494003+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:56:19.161221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015074+0000","last_change":"2023-12-22T08:53:04.476765+0000","last_active":"2023-12-22T08:53:08.015074+0000","last_peered":"2023-12-22T08:53:08.015074+0000","last_clean":"2023-12-22T08:53:08.015074+0000","last_became_active":"2023-12-22T08:53:04.476473+0000","last_became_peered":"2023-12-22T08:53:04.476473+0000","last_unstale":"2023-12-22T08:53:08.015074+0000","last_undegraded":"2023-12-22T08:53:08.015074+0000","last_fullsized":"2023-12-22T08:53:08.015074+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:13.597102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.486294+0000","last_change":"2023-12-22T08:53:03.970342+0000","last_active":"2023-12-22T08:53:04.486294+0000","last_peered":"2023-12-22T08:53:04.486294+0000","last_clean":"2023-12-22T08:53:04.486294+0000","last_became_active":"2023-12-22T08:53:03.969697+0000","last_became_peered":"2023-12-22T08:53:03.969697+0000","last_unstale":"2023-12-22T08:53:04.486294+0000","last_undegraded":"2023-12-22T08:53:04.486294+0000","last_fullsized":"2023-12-22T08:53:04.486294+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:49.021917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.016051+0000","last_change":"2023-12-22T08:53:04.506195+0000","last_active":"2023-12-22T08:53:08.016051+0000","last_peered":"2023-12-22T08:53:08.016051+0000","last_clean":"2023-12-22T08:53:08.016051+0000","last_became_active":"2023-12-22T08:53:04.505877+0000","last_became_peered":"2023-12-22T08:53:04.505877+0000","last_unstale":"2023-12-22T08:53:08.016051+0000","last_undegraded":"2023-12-22T08:53:08.016051+0000","last_fullsized":"2023-12-22T08:53:08.016051+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:04:26.313796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.506851+0000","last_change":"2023-12-22T08:53:03.982442+0000","last_active":"2023-12-22T08:53:04.506851+0000","last_peered":"2023-12-22T08:53:04.506851+0000","last_clean":"2023-12-22T08:53:04.506851+0000","last_became_active":"2023-12-22T08:53:03.982146+0000","last_became_peered":"2023-12-22T08:53:03.982146+0000","last_unstale":"2023-12-22T08:53:04.506851+0000","last_undegraded":"2023-12-22T08:53:04.506851+0000","last_fullsized":"2023-12-22T08:53:04.506851+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:49.021917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.145471+0000","last_change":"2023-12-22T08:53:04.494265+0000","last_active":"2023-12-22T08:53:06.145471+0000","last_peered":"2023-12-22T08:53:06.145471+0000","last_clean":"2023-12-22T08:53:06.145471+0000","last_became_active":"2023-12-22T08:53:04.493850+0000","last_became_peered":"2023-12-22T08:53:04.493850+0000","last_unstale":"2023-12-22T08:53:06.145471+0000","last_undegraded":"2023-12-22T08:53:06.145471+0000","last_fullsized":"2023-12-22T08:53:06.145471+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:57:21.069519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.503054+0000","last_change":"2023-12-22T08:53:03.974738+0000","last_active":"2023-12-22T08:53:04.503054+0000","last_peered":"2023-12-22T08:53:04.503054+0000","last_clean":"2023-12-22T08:53:04.503054+0000","last_became_active":"2023-12-22T08:53:03.973356+0000","last_became_peered":"2023-12-22T08:53:03.973356+0000","last_unstale":"2023-12-22T08:53:04.503054+0000","last_undegraded":"2023-12-22T08:53:04.503054+0000","last_fullsized":"2023-12-22T08:53:04.503054+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:53:53.524420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.488281+0000","last_change":"2023-12-22T08:53:04.504527+0000","last_active":"2023-12-22T08:53:05.488281+0000","last_peered":"2023-12-22T08:53:05.488281+0000","last_clean":"2023-12-22T08:53:05.488281+0000","last_became_active":"2023-12-22T08:53:04.504004+0000","last_became_peered":"2023-12-22T08:53:04.504004+0000","last_unstale":"2023-12-22T08:53:05.488281+0000","last_undegraded":"2023-12-22T08:53:05.488281+0000","last_fullsized":"2023-12-22T08:53:05.488281+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:23:25.758708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.485494+0000","last_change":"2023-12-22T08:53:03.984475+0000","last_active":"2023-12-22T08:53:04.485494+0000","last_peered":"2023-12-22T08:53:04.485494+0000","last_clean":"2023-12-22T08:53:04.485494+0000","last_became_active":"2023-12-22T08:53:03.984233+0000","last_became_peered":"2023-12-22T08:53:03.984233+0000","last_unstale":"2023-12-22T08:53:04.485494+0000","last_undegraded":"2023-12-22T08:53:04.485494+0000","last_fullsized":"2023-12-22T08:53:04.485494+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:51.754987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015748+0000","last_change":"2023-12-22T08:53:04.507313+0000","last_active":"2023-12-22T08:53:08.015748+0000","last_peered":"2023-12-22T08:53:08.015748+0000","last_clean":"2023-12-22T08:53:08.015748+0000","last_became_active":"2023-12-22T08:53:04.505559+0000","last_became_peered":"2023-12-22T08:53:04.505559+0000","last_unstale":"2023-12-22T08:53:08.015748+0000","last_undegraded":"2023-12-22T08:53:08.015748+0000","last_fullsized":"2023-12-22T08:53:08.015748+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:57:21.069519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.504197+0000","last_change":"2023-12-22T08:53:03.988662+0000","last_active":"2023-12-22T08:53:04.504197+0000","last_peered":"2023-12-22T08:53:04.504197+0000","last_clean":"2023-12-22T08:53:04.504197+0000","last_became_active":"2023-12-22T08:53:03.988358+0000","last_became_peered":"2023-12-22T08:53:03.988358+0000","last_unstale":"2023-12-22T08:53:04.504197+0000","last_undegraded":"2023-12-22T08:53:04.504197+0000","last_fullsized":"2023-12-22T08:53:04.504197+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:59.943306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.485023+0000","last_change":"2023-12-22T08:53:04.502446+0000","last_active":"2023-12-22T08:53:05.485023+0000","last_peered":"2023-12-22T08:53:05.485023+0000","last_clean":"2023-12-22T08:53:05.485023+0000","last_became_active":"2023-12-22T08:53:04.500745+0000","last_became_peered":"2023-12-22T08:53:04.500745+0000","last_unstale":"2023-12-22T08:53:05.485023+0000","last_undegraded":"2023-12-22T08:53:05.485023+0000","last_fullsized":"2023-12-22T08:53:05.485023+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:11:42.467867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.471393+0000","last_change":"2023-12-22T08:53:03.985665+0000","last_active":"2023-12-22T08:53:04.471393+0000","last_peered":"2023-12-22T08:53:04.471393+0000","last_clean":"2023-12-22T08:53:04.471393+0000","last_became_active":"2023-12-22T08:53:03.985169+0000","last_became_peered":"2023-12-22T08:53:03.985169+0000","last_unstale":"2023-12-22T08:53:04.471393+0000","last_undegraded":"2023-12-22T08:53:04.471393+0000","last_fullsized":"2023-12-22T08:53:04.471393+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:04:28.070031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.489014+0000","last_change":"2023-12-22T08:53:04.506411+0000","last_active":"2023-12-22T08:53:05.489014+0000","last_peered":"2023-12-22T08:53:05.489014+0000","last_clean":"2023-12-22T08:53:05.489014+0000","last_became_active":"2023-12-22T08:53:04.505588+0000","last_became_peered":"2023-12-22T08:53:04.505588+0000","last_unstale":"2023-12-22T08:53:05.489014+0000","last_undegraded":"2023-12-22T08:53:05.489014+0000","last_fullsized":"2023-12-22T08:53:05.489014+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:13:12.906947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.474655+0000","last_change":"2023-12-22T08:53:03.967403+0000","last_active":"2023-12-22T08:53:04.474655+0000","last_peered":"2023-12-22T08:53:04.474655+0000","last_clean":"2023-12-22T08:53:04.474655+0000","last_became_active":"2023-12-22T08:53:03.966738+0000","last_became_peered":"2023-12-22T08:53:03.966738+0000","last_unstale":"2023-12-22T08:53:04.474655+0000","last_undegraded":"2023-12-22T08:53:04.474655+0000","last_fullsized":"2023-12-22T08:53:04.474655+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:33:10.086096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.486695+0000","last_change":"2023-12-22T08:53:04.500869+0000","last_active":"2023-12-22T08:53:05.486695+0000","last_peered":"2023-12-22T08:53:05.486695+0000","last_clean":"2023-12-22T08:53:05.486695+0000","last_became_active":"2023-12-22T08:53:04.500648+0000","last_became_peered":"2023-12-22T08:53:04.500648+0000","last_unstale":"2023-12-22T08:53:05.486695+0000","last_undegraded":"2023-12-22T08:53:05.486695+0000","last_fullsized":"2023-12-22T08:53:05.486695+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:28:06.680179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.491910+0000","last_change":"2023-12-22T08:53:03.988770+0000","last_active":"2023-12-22T08:53:04.491910+0000","last_peered":"2023-12-22T08:53:04.491910+0000","last_clean":"2023-12-22T08:53:04.491910+0000","last_became_active":"2023-12-22T08:53:03.988510+0000","last_became_peered":"2023-12-22T08:53:03.988510+0000","last_unstale":"2023-12-22T08:53:04.491910+0000","last_undegraded":"2023-12-22T08:53:04.491910+0000","last_fullsized":"2023-12-22T08:53:04.491910+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:15:41.337661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.484129+0000","last_change":"2023-12-22T08:53:04.494579+0000","last_active":"2023-12-22T08:53:05.484129+0000","last_peered":"2023-12-22T08:53:05.484129+0000","last_clean":"2023-12-22T08:53:05.484129+0000","last_became_active":"2023-12-22T08:53:04.494320+0000","last_became_peered":"2023-12-22T08:53:04.494320+0000","last_unstale":"2023-12-22T08:53:05.484129+0000","last_undegraded":"2023-12-22T08:53:05.484129+0000","last_fullsized":"2023-12-22T08:53:05.484129+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:02:43.017969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"189'3","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.505340+0000","last_change":"2023-12-22T08:53:03.985696+0000","last_active":"2023-12-22T08:53:04.505340+0000","last_peered":"2023-12-22T08:53:04.505340+0000","last_clean":"2023-12-22T08:53:04.505340+0000","last_became_active":"2023-12-22T08:53:03.985344+0000","last_became_peered":"2023-12-22T08:53:03.985344+0000","last_unstale":"2023-12-22T08:53:04.505340+0000","last_undegraded":"2023-12-22T08:53:04.505340+0000","last_fullsized":"2023-12-22T08:53:04.505340+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:37:36.464687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015312+0000","last_change":"2023-12-22T08:53:04.486364+0000","last_active":"2023-12-22T08:53:08.015312+0000","last_peered":"2023-12-22T08:53:08.015312+0000","last_clean":"2023-12-22T08:53:08.015312+0000","last_became_active":"2023-12-22T08:53:04.485943+0000","last_became_peered":"2023-12-22T08:53:04.485943+0000","last_unstale":"2023-12-22T08:53:08.015312+0000","last_undegraded":"2023-12-22T08:53:08.015312+0000","last_fullsized":"2023-12-22T08:53:08.015312+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:34:15.547023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"189'6","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.497571+0000","last_change":"2023-12-22T08:53:03.983653+0000","last_active":"2023-12-22T08:53:04.497571+0000","last_peered":"2023-12-22T08:53:04.497571+0000","last_clean":"2023-12-22T08:53:04.497571+0000","last_became_active":"2023-12-22T08:53:03.983226+0000","last_became_peered":"2023-12-22T08:53:03.983226+0000","last_unstale":"2023-12-22T08:53:04.497571+0000","last_undegraded":"2023-12-22T08:53:04.497571+0000","last_fullsized":"2023-12-22T08:53:04.497571+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:30:42.429204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.486929+0000","last_change":"2023-12-22T08:53:04.492395+0000","last_active":"2023-12-22T08:53:05.486929+0000","last_peered":"2023-12-22T08:53:05.486929+0000","last_clean":"2023-12-22T08:53:05.486929+0000","last_became_active":"2023-12-22T08:53:04.491054+0000","last_became_peered":"2023-12-22T08:53:04.491054+0000","last_unstale":"2023-12-22T08:53:05.486929+0000","last_undegraded":"2023-12-22T08:53:05.486929+0000","last_fullsized":"2023-12-22T08:53:05.486929+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:37:37.488510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.506518+0000","last_change":"2023-12-22T08:53:03.973860+0000","last_active":"2023-12-22T08:53:04.506518+0000","last_peered":"2023-12-22T08:53:04.506518+0000","last_clean":"2023-12-22T08:53:04.506518+0000","last_became_active":"2023-12-22T08:53:03.973263+0000","last_became_peered":"2023-12-22T08:53:03.973263+0000","last_unstale":"2023-12-22T08:53:04.506518+0000","last_undegraded":"2023-12-22T08:53:04.506518+0000","last_fullsized":"2023-12-22T08:53:04.506518+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:04:44.406516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.485267+0000","last_change":"2023-12-22T08:53:04.478485+0000","last_active":"2023-12-22T08:53:05.485267+0000","last_peered":"2023-12-22T08:53:05.485267+0000","last_clean":"2023-12-22T08:53:05.485267+0000","last_became_active":"2023-12-22T08:53:04.476999+0000","last_became_peered":"2023-12-22T08:53:04.476999+0000","last_unstale":"2023-12-22T08:53:05.485267+0000","last_undegraded":"2023-12-22T08:53:05.485267+0000","last_fullsized":"2023-12-22T08:53:05.485267+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:04:29.093854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.499442+0000","last_change":"2023-12-22T08:53:03.977844+0000","last_active":"2023-12-22T08:53:04.499442+0000","last_peered":"2023-12-22T08:53:04.499442+0000","last_clean":"2023-12-22T08:53:04.499442+0000","last_became_active":"2023-12-22T08:53:03.977499+0000","last_became_peered":"2023-12-22T08:53:03.977499+0000","last_unstale":"2023-12-22T08:53:04.499442+0000","last_undegraded":"2023-12-22T08:53:04.499442+0000","last_fullsized":"2023-12-22T08:53:04.499442+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:42:36.847387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015756+0000","last_change":"2023-12-22T08:53:04.502967+0000","last_active":"2023-12-22T08:53:08.015756+0000","last_peered":"2023-12-22T08:53:08.015756+0000","last_clean":"2023-12-22T08:53:08.015756+0000","last_became_active":"2023-12-22T08:53:04.501817+0000","last_became_peered":"2023-12-22T08:53:04.501817+0000","last_unstale":"2023-12-22T08:53:08.015756+0000","last_undegraded":"2023-12-22T08:53:08.015756+0000","last_fullsized":"2023-12-22T08:53:08.015756+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:40:31.348198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.496332+0000","last_change":"2023-12-22T08:53:03.972092+0000","last_active":"2023-12-22T08:53:04.496332+0000","last_peered":"2023-12-22T08:53:04.496332+0000","last_clean":"2023-12-22T08:53:04.496332+0000","last_became_active":"2023-12-22T08:53:03.971696+0000","last_became_peered":"2023-12-22T08:53:03.971696+0000","last_unstale":"2023-12-22T08:53:04.496332+0000","last_undegraded":"2023-12-22T08:53:04.496332+0000","last_fullsized":"2023-12-22T08:53:04.496332+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:50:09.497500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.144919+0000","last_change":"2023-12-22T08:53:04.502098+0000","last_active":"2023-12-22T08:53:06.144919+0000","last_peered":"2023-12-22T08:53:06.144919+0000","last_clean":"2023-12-22T08:53:06.144919+0000","last_became_active":"2023-12-22T08:53:04.501616+0000","last_became_peered":"2023-12-22T08:53:04.501616+0000","last_unstale":"2023-12-22T08:53:06.144919+0000","last_undegraded":"2023-12-22T08:53:06.144919+0000","last_fullsized":"2023-12-22T08:53:06.144919+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:45:30.644108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"189'8","reported_seq":19,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.493919+0000","last_change":"2023-12-22T08:53:03.984269+0000","last_active":"2023-12-22T08:53:04.493919+0000","last_peered":"2023-12-22T08:53:04.493919+0000","last_clean":"2023-12-22T08:53:04.493919+0000","last_became_active":"2023-12-22T08:53:03.983614+0000","last_became_peered":"2023-12-22T08:53:03.983614+0000","last_unstale":"2023-12-22T08:53:04.493919+0000","last_undegraded":"2023-12-22T08:53:04.493919+0000","last_fullsized":"2023-12-22T08:53:04.493919+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:08.997028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.487559+0000","last_change":"2023-12-22T08:53:04.502869+0000","last_active":"2023-12-22T08:53:05.487559+0000","last_peered":"2023-12-22T08:53:05.487559+0000","last_clean":"2023-12-22T08:53:05.487559+0000","last_became_active":"2023-12-22T08:53:04.502629+0000","last_became_peered":"2023-12-22T08:53:04.502629+0000","last_unstale":"2023-12-22T08:53:05.487559+0000","last_undegraded":"2023-12-22T08:53:05.487559+0000","last_fullsized":"2023-12-22T08:53:05.487559+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:31.962620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.493165+0000","last_change":"2023-12-22T08:53:03.983481+0000","last_active":"2023-12-22T08:53:04.493165+0000","last_peered":"2023-12-22T08:53:04.493165+0000","last_clean":"2023-12-22T08:53:04.493165+0000","last_became_active":"2023-12-22T08:53:03.982472+0000","last_became_peered":"2023-12-22T08:53:03.982472+0000","last_unstale":"2023-12-22T08:53:04.493165+0000","last_undegraded":"2023-12-22T08:53:04.493165+0000","last_fullsized":"2023-12-22T08:53:04.493165+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:00.906919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.489269+0000","last_change":"2023-12-22T08:53:04.495550+0000","last_active":"2023-12-22T08:53:05.489269+0000","last_peered":"2023-12-22T08:53:05.489269+0000","last_clean":"2023-12-22T08:53:05.489269+0000","last_became_active":"2023-12-22T08:53:04.488661+0000","last_became_peered":"2023-12-22T08:53:04.488661+0000","last_unstale":"2023-12-22T08:53:05.489269+0000","last_undegraded":"2023-12-22T08:53:05.489269+0000","last_fullsized":"2023-12-22T08:53:05.489269+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:24.730706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.499580+0000","last_change":"2023-12-22T08:53:03.978023+0000","last_active":"2023-12-22T08:53:04.499580+0000","last_peered":"2023-12-22T08:53:04.499580+0000","last_clean":"2023-12-22T08:53:04.499580+0000","last_became_active":"2023-12-22T08:53:03.977484+0000","last_became_peered":"2023-12-22T08:53:03.977484+0000","last_unstale":"2023-12-22T08:53:04.499580+0000","last_undegraded":"2023-12-22T08:53:04.499580+0000","last_fullsized":"2023-12-22T08:53:04.499580+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:42:36.847387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.489012+0000","last_change":"2023-12-22T08:53:04.499962+0000","last_active":"2023-12-22T08:53:05.489012+0000","last_peered":"2023-12-22T08:53:05.489012+0000","last_clean":"2023-12-22T08:53:05.489012+0000","last_became_active":"2023-12-22T08:53:04.499571+0000","last_became_peered":"2023-12-22T08:53:04.499571+0000","last_unstale":"2023-12-22T08:53:05.489012+0000","last_undegraded":"2023-12-22T08:53:05.489012+0000","last_fullsized":"2023-12-22T08:53:05.489012+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:59:57.353028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.491075+0000","last_change":"2023-12-22T08:53:03.985998+0000","last_active":"2023-12-22T08:53:04.491075+0000","last_peered":"2023-12-22T08:53:04.491075+0000","last_clean":"2023-12-22T08:53:04.491075+0000","last_became_active":"2023-12-22T08:53:03.985456+0000","last_became_peered":"2023-12-22T08:53:03.985456+0000","last_unstale":"2023-12-22T08:53:04.491075+0000","last_undegraded":"2023-12-22T08:53:04.491075+0000","last_fullsized":"2023-12-22T08:53:04.491075+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:02:35.293874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.484929+0000","last_change":"2023-12-22T08:53:04.478199+0000","last_active":"2023-12-22T08:53:05.484929+0000","last_peered":"2023-12-22T08:53:05.484929+0000","last_clean":"2023-12-22T08:53:05.484929+0000","last_became_active":"2023-12-22T08:53:04.477323+0000","last_became_peered":"2023-12-22T08:53:04.477323+0000","last_unstale":"2023-12-22T08:53:05.484929+0000","last_undegraded":"2023-12-22T08:53:05.484929+0000","last_fullsized":"2023-12-22T08:53:05.484929+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:32:27.840400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.474357+0000","last_change":"2023-12-22T08:53:03.973534+0000","last_active":"2023-12-22T08:53:04.474357+0000","last_peered":"2023-12-22T08:53:04.474357+0000","last_clean":"2023-12-22T08:53:04.474357+0000","last_became_active":"2023-12-22T08:53:03.971408+0000","last_became_peered":"2023-12-22T08:53:03.971408+0000","last_unstale":"2023-12-22T08:53:04.474357+0000","last_undegraded":"2023-12-22T08:53:04.474357+0000","last_fullsized":"2023-12-22T08:53:04.474357+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:03:07.276355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014867+0000","last_change":"2023-12-22T08:53:04.494668+0000","last_active":"2023-12-22T08:53:08.014867+0000","last_peered":"2023-12-22T08:53:08.014867+0000","last_clean":"2023-12-22T08:53:08.014867+0000","last_became_active":"2023-12-22T08:53:04.494430+0000","last_became_peered":"2023-12-22T08:53:04.494430+0000","last_unstale":"2023-12-22T08:53:08.014867+0000","last_undegraded":"2023-12-22T08:53:08.014867+0000","last_fullsized":"2023-12-22T08:53:08.014867+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:03:08.300178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.505012+0000","last_change":"2023-12-22T08:53:03.964376+0000","last_active":"2023-12-22T08:53:04.505012+0000","last_peered":"2023-12-22T08:53:04.505012+0000","last_clean":"2023-12-22T08:53:04.505012+0000","last_became_active":"2023-12-22T08:53:03.963629+0000","last_became_peered":"2023-12-22T08:53:03.963629+0000","last_unstale":"2023-12-22T08:53:04.505012+0000","last_undegraded":"2023-12-22T08:53:04.505012+0000","last_fullsized":"2023-12-22T08:53:04.505012+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:55:01.991275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.487257+0000","last_change":"2023-12-22T08:53:04.488564+0000","last_active":"2023-12-22T08:53:05.487257+0000","last_peered":"2023-12-22T08:53:05.487257+0000","last_clean":"2023-12-22T08:53:05.487257+0000","last_became_active":"2023-12-22T08:53:04.487998+0000","last_became_peered":"2023-12-22T08:53:04.487998+0000","last_unstale":"2023-12-22T08:53:05.487257+0000","last_undegraded":"2023-12-22T08:53:05.487257+0000","last_fullsized":"2023-12-22T08:53:05.487257+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:52.778810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.474222+0000","last_change":"2023-12-22T08:53:03.977918+0000","last_active":"2023-12-22T08:53:04.474222+0000","last_peered":"2023-12-22T08:53:04.474222+0000","last_clean":"2023-12-22T08:53:04.474222+0000","last_became_active":"2023-12-22T08:53:03.977686+0000","last_became_peered":"2023-12-22T08:53:03.977686+0000","last_unstale":"2023-12-22T08:53:04.474222+0000","last_undegraded":"2023-12-22T08:53:04.474222+0000","last_fullsized":"2023-12-22T08:53:04.474222+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:44.552623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015742+0000","last_change":"2023-12-22T08:53:04.476189+0000","last_active":"2023-12-22T08:53:08.015742+0000","last_peered":"2023-12-22T08:53:08.015742+0000","last_clean":"2023-12-22T08:53:08.015742+0000","last_became_active":"2023-12-22T08:53:04.475588+0000","last_became_peered":"2023-12-22T08:53:04.475588+0000","last_unstale":"2023-12-22T08:53:08.015742+0000","last_undegraded":"2023-12-22T08:53:08.015742+0000","last_fullsized":"2023-12-22T08:53:08.015742+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:23.329652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.490165+0000","last_change":"2023-12-22T08:53:03.988676+0000","last_active":"2023-12-22T08:53:04.490165+0000","last_peered":"2023-12-22T08:53:04.490165+0000","last_clean":"2023-12-22T08:53:04.490165+0000","last_became_active":"2023-12-22T08:53:03.988231+0000","last_became_peered":"2023-12-22T08:53:03.988231+0000","last_unstale":"2023-12-22T08:53:04.490165+0000","last_undegraded":"2023-12-22T08:53:04.490165+0000","last_fullsized":"2023-12-22T08:53:04.490165+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:58:58.406886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.487759+0000","last_change":"2023-12-22T08:53:04.495882+0000","last_active":"2023-12-22T08:53:05.487759+0000","last_peered":"2023-12-22T08:53:05.487759+0000","last_clean":"2023-12-22T08:53:05.487759+0000","last_became_active":"2023-12-22T08:53:04.495333+0000","last_became_peered":"2023-12-22T08:53:04.495333+0000","last_unstale":"2023-12-22T08:53:05.487759+0000","last_undegraded":"2023-12-22T08:53:05.487759+0000","last_fullsized":"2023-12-22T08:53:05.487759+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:22:22.225863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.474714+0000","last_change":"2023-12-22T08:53:03.972851+0000","last_active":"2023-12-22T08:53:04.474714+0000","last_peered":"2023-12-22T08:53:04.474714+0000","last_clean":"2023-12-22T08:53:04.474714+0000","last_became_active":"2023-12-22T08:53:03.972343+0000","last_became_peered":"2023-12-22T08:53:03.972343+0000","last_unstale":"2023-12-22T08:53:04.474714+0000","last_undegraded":"2023-12-22T08:53:04.474714+0000","last_fullsized":"2023-12-22T08:53:04.474714+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:22.305829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.487501+0000","last_change":"2023-12-22T08:53:04.502967+0000","last_active":"2023-12-22T08:53:05.487501+0000","last_peered":"2023-12-22T08:53:05.487501+0000","last_clean":"2023-12-22T08:53:05.487501+0000","last_became_active":"2023-12-22T08:53:04.502625+0000","last_became_peered":"2023-12-22T08:53:04.502625+0000","last_unstale":"2023-12-22T08:53:05.487501+0000","last_undegraded":"2023-12-22T08:53:05.487501+0000","last_fullsized":"2023-12-22T08:53:05.487501+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:22:22.225863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.506179+0000","last_change":"2023-12-22T08:53:03.979033+0000","last_active":"2023-12-22T08:53:04.506179+0000","last_peered":"2023-12-22T08:53:04.506179+0000","last_clean":"2023-12-22T08:53:04.506179+0000","last_became_active":"2023-12-22T08:53:03.978666+0000","last_became_peered":"2023-12-22T08:53:03.978666+0000","last_unstale":"2023-12-22T08:53:04.506179+0000","last_undegraded":"2023-12-22T08:53:04.506179+0000","last_fullsized":"2023-12-22T08:53:04.506179+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:39:10.007236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.488690+0000","last_change":"2023-12-22T08:53:04.492842+0000","last_active":"2023-12-22T08:53:05.488690+0000","last_peered":"2023-12-22T08:53:05.488690+0000","last_clean":"2023-12-22T08:53:05.488690+0000","last_became_active":"2023-12-22T08:53:04.492503+0000","last_became_peered":"2023-12-22T08:53:04.492503+0000","last_unstale":"2023-12-22T08:53:05.488690+0000","last_undegraded":"2023-12-22T08:53:05.488690+0000","last_fullsized":"2023-12-22T08:53:05.488690+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:44:08.516182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.474880+0000","last_change":"2023-12-22T08:53:03.983723+0000","last_active":"2023-12-22T08:53:04.474880+0000","last_peered":"2023-12-22T08:53:04.474880+0000","last_clean":"2023-12-22T08:53:04.474880+0000","last_became_active":"2023-12-22T08:53:03.983486+0000","last_became_peered":"2023-12-22T08:53:03.983486+0000","last_unstale":"2023-12-22T08:53:04.474880+0000","last_undegraded":"2023-12-22T08:53:04.474880+0000","last_fullsized":"2023-12-22T08:53:04.474880+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:12.573279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.488515+0000","last_change":"2023-12-22T08:53:04.496603+0000","last_active":"2023-12-22T08:53:05.488515+0000","last_peered":"2023-12-22T08:53:05.488515+0000","last_clean":"2023-12-22T08:53:05.488515+0000","last_became_active":"2023-12-22T08:53:04.496242+0000","last_became_peered":"2023-12-22T08:53:04.496242+0000","last_unstale":"2023-12-22T08:53:05.488515+0000","last_undegraded":"2023-12-22T08:53:05.488515+0000","last_fullsized":"2023-12-22T08:53:05.488515+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:48:23.020493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.471069+0000","last_change":"2023-12-22T08:53:03.986800+0000","last_active":"2023-12-22T08:53:04.471069+0000","last_peered":"2023-12-22T08:53:04.471069+0000","last_clean":"2023-12-22T08:53:04.471069+0000","last_became_active":"2023-12-22T08:53:03.986566+0000","last_became_peered":"2023-12-22T08:53:03.986566+0000","last_unstale":"2023-12-22T08:53:04.471069+0000","last_undegraded":"2023-12-22T08:53:04.471069+0000","last_fullsized":"2023-12-22T08:53:04.471069+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:28:05.656356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.489563+0000","last_change":"2023-12-22T08:53:04.496281+0000","last_active":"2023-12-22T08:53:05.489563+0000","last_peered":"2023-12-22T08:53:05.489563+0000","last_clean":"2023-12-22T08:53:05.489563+0000","last_became_active":"2023-12-22T08:53:04.492596+0000","last_became_peered":"2023-12-22T08:53:04.492596+0000","last_unstale":"2023-12-22T08:53:05.489563+0000","last_undegraded":"2023-12-22T08:53:05.489563+0000","last_fullsized":"2023-12-22T08:53:05.489563+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:43:54.623048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.474902+0000","last_change":"2023-12-22T08:53:03.964888+0000","last_active":"2023-12-22T08:53:04.474902+0000","last_peered":"2023-12-22T08:53:04.474902+0000","last_clean":"2023-12-22T08:53:04.474902+0000","last_became_active":"2023-12-22T08:53:03.964278+0000","last_became_peered":"2023-12-22T08:53:03.964278+0000","last_unstale":"2023-12-22T08:53:04.474902+0000","last_undegraded":"2023-12-22T08:53:04.474902+0000","last_fullsized":"2023-12-22T08:53:04.474902+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:28:04.088914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015921+0000","last_change":"2023-12-22T08:53:04.507477+0000","last_active":"2023-12-22T08:53:08.015921+0000","last_peered":"2023-12-22T08:53:08.015921+0000","last_clean":"2023-12-22T08:53:08.015921+0000","last_became_active":"2023-12-22T08:53:04.505847+0000","last_became_peered":"2023-12-22T08:53:04.505847+0000","last_unstale":"2023-12-22T08:53:08.015921+0000","last_undegraded":"2023-12-22T08:53:08.015921+0000","last_fullsized":"2023-12-22T08:53:08.015921+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:45:30.644108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.484855+0000","last_change":"2023-12-22T08:53:03.985799+0000","last_active":"2023-12-22T08:53:04.484855+0000","last_peered":"2023-12-22T08:53:04.484855+0000","last_clean":"2023-12-22T08:53:04.484855+0000","last_became_active":"2023-12-22T08:53:03.985026+0000","last_became_peered":"2023-12-22T08:53:03.985026+0000","last_unstale":"2023-12-22T08:53:04.484855+0000","last_undegraded":"2023-12-22T08:53:04.484855+0000","last_fullsized":"2023-12-22T08:53:04.484855+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:32:19.479817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015962+0000","last_change":"2023-12-22T08:53:04.491057+0000","last_active":"2023-12-22T08:53:08.015962+0000","last_peered":"2023-12-22T08:53:08.015962+0000","last_clean":"2023-12-22T08:53:08.015962+0000","last_became_active":"2023-12-22T08:53:04.490813+0000","last_became_peered":"2023-12-22T08:53:04.490813+0000","last_unstale":"2023-12-22T08:53:08.015962+0000","last_undegraded":"2023-12-22T08:53:08.015962+0000","last_fullsized":"2023-12-22T08:53:08.015962+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:48.612334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.496460+0000","last_change":"2023-12-22T08:53:03.964773+0000","last_active":"2023-12-22T08:53:04.496460+0000","last_peered":"2023-12-22T08:53:04.496460+0000","last_clean":"2023-12-22T08:53:04.496460+0000","last_became_active":"2023-12-22T08:53:03.964190+0000","last_became_peered":"2023-12-22T08:53:03.964190+0000","last_unstale":"2023-12-22T08:53:04.496460+0000","last_undegraded":"2023-12-22T08:53:04.496460+0000","last_fullsized":"2023-12-22T08:53:04.496460+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:57:20.045696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.484366+0000","last_change":"2023-12-22T08:53:04.489992+0000","last_active":"2023-12-22T08:53:05.484366+0000","last_peered":"2023-12-22T08:53:05.484366+0000","last_clean":"2023-12-22T08:53:05.484366+0000","last_became_active":"2023-12-22T08:53:04.489327+0000","last_became_peered":"2023-12-22T08:53:04.489327+0000","last_unstale":"2023-12-22T08:53:05.484366+0000","last_undegraded":"2023-12-22T08:53:05.484366+0000","last_fullsized":"2023-12-22T08:53:05.484366+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:36:57.213715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.472025+0000","last_change":"2023-12-22T08:53:03.980320+0000","last_active":"2023-12-22T08:53:04.472025+0000","last_peered":"2023-12-22T08:53:04.472025+0000","last_clean":"2023-12-22T08:53:04.472025+0000","last_became_active":"2023-12-22T08:53:03.979641+0000","last_became_peered":"2023-12-22T08:53:03.979641+0000","last_unstale":"2023-12-22T08:53:04.472025+0000","last_undegraded":"2023-12-22T08:53:04.472025+0000","last_fullsized":"2023-12-22T08:53:04.472025+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:02:41.994146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015907+0000","last_change":"2023-12-22T08:53:04.499863+0000","last_active":"2023-12-22T08:53:08.015907+0000","last_peered":"2023-12-22T08:53:08.015907+0000","last_clean":"2023-12-22T08:53:08.015907+0000","last_became_active":"2023-12-22T08:53:04.499619+0000","last_became_peered":"2023-12-22T08:53:04.499619+0000","last_unstale":"2023-12-22T08:53:08.015907+0000","last_undegraded":"2023-12-22T08:53:08.015907+0000","last_fullsized":"2023-12-22T08:53:08.015907+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:27:46.503292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.471238+0000","last_change":"2023-12-22T08:53:03.980627+0000","last_active":"2023-12-22T08:53:04.471238+0000","last_peered":"2023-12-22T08:53:04.471238+0000","last_clean":"2023-12-22T08:53:04.471238+0000","last_became_active":"2023-12-22T08:53:03.980375+0000","last_became_peered":"2023-12-22T08:53:03.980375+0000","last_unstale":"2023-12-22T08:53:04.471238+0000","last_undegraded":"2023-12-22T08:53:04.471238+0000","last_fullsized":"2023-12-22T08:53:04.471238+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:22:21.202040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.485351+0000","last_change":"2023-12-22T08:53:04.503260+0000","last_active":"2023-12-22T08:53:05.485351+0000","last_peered":"2023-12-22T08:53:05.485351+0000","last_clean":"2023-12-22T08:53:05.485351+0000","last_became_active":"2023-12-22T08:53:04.502696+0000","last_became_peered":"2023-12-22T08:53:04.502696+0000","last_unstale":"2023-12-22T08:53:05.485351+0000","last_undegraded":"2023-12-22T08:53:05.485351+0000","last_fullsized":"2023-12-22T08:53:05.485351+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:50:05.891865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.483988+0000","last_change":"2023-12-22T08:53:03.983109+0000","last_active":"2023-12-22T08:53:04.483988+0000","last_peered":"2023-12-22T08:53:04.483988+0000","last_clean":"2023-12-22T08:53:04.483988+0000","last_became_active":"2023-12-22T08:53:03.982844+0000","last_became_peered":"2023-12-22T08:53:03.982844+0000","last_unstale":"2023-12-22T08:53:04.483988+0000","last_undegraded":"2023-12-22T08:53:04.483988+0000","last_fullsized":"2023-12-22T08:53:04.483988+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:23:16.455112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":317,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.483518+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:53:04.483518+0000","last_peered":"2023-12-22T08:53:04.483518+0000","last_clean":"2023-12-22T08:53:04.483518+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:53:04.483518+0000","last_undegraded":"2023-12-22T08:53:04.483518+0000","last_fullsized":"2023-12-22T08:53:04.483518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1037,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194275,"statfs":{"total":200000000,"available":198937874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1020000000000001,"15min":1.0920000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.58199999999999996},"max":{"1min":1.8069999999999999,"5min":1.8700000000000001,"15min":2.0249999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.0940000000000001,"15min":1.0920000000000001},"min":{"1min":0.72399999999999998,"5min":0.71299999999999997,"15min":0.70099999999999996},"max":{"1min":1.524,"5min":1.6499999999999999,"15min":1.6819999999999999},"last":0.71799999999999997}]},{"osd":1,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.254,"15min":1.202},"min":{"1min":0.95399999999999996,"5min":0.70899999999999996,"15min":0.64200000000000002},"max":{"1min":1.613,"5min":1.6779999999999999,"15min":1.905},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.262,"15min":1.216},"min":{"1min":0.85899999999999999,"5min":0.78800000000000003,"15min":0.67100000000000004},"max":{"1min":1.758,"5min":1.758,"15min":1.865},"last":0.83399999999999996}]},{"osd":2,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.1930000000000001,"15min":1.139},"min":{"1min":0.90100000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.538,"5min":1.74,"15min":2.0150000000000001},"last":1.395},{"interface":"front","average":{"1min":1.202,"5min":1.238,"15min":1.2230000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.68700000000000006},"max":{"1min":1.6759999999999999,"5min":1.79,"15min":2.1379999999999999},"last":0.86599999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.25,"15min":1.1919999999999999},"min":{"1min":0.89300000000000002,"5min":0.875,"15min":0.71399999999999997},"max":{"1min":1.766,"5min":1.766,"15min":2.0680000000000001},"last":1.296},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.319,"15min":1.3069999999999999},"min":{"1min":0.86699999999999999,"5min":0.77700000000000002,"15min":0.71799999999999997},"max":{"1min":1.488,"5min":1.873,"15min":2.2959999999999998},"last":1.0089999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.194,"15min":1.1990000000000001},"min":{"1min":0.875,"5min":0.53400000000000003,"15min":0.48699999999999999},"max":{"1min":1.639,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.28,"5min":1.2929999999999999,"15min":1.274},"min":{"1min":0.90800000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.857,"5min":1.899,"15min":2.2749999999999999},"last":1.478}]},{"osd":5,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.319,"15min":1.359},"min":{"1min":0.96199999999999997,"5min":0.60699999999999998,"15min":0.51800000000000002},"max":{"1min":1.5529999999999999,"5min":1.9530000000000001,"15min":2.4300000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.331,"15min":1.3600000000000001},"min":{"1min":1.016,"5min":0.623,"15min":0.623},"max":{"1min":1.5860000000000001,"5min":2.2480000000000002,"15min":2.3410000000000002},"last":1.359}]},{"osd":6,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.506,"15min":1.498},"min":{"1min":1.1279999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.873,"5min":2.355,"15min":2.355},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.486,"15min":1.486},"min":{"1min":1.038,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.956,"5min":1.968,"15min":2.4849999999999999},"last":1.5349999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575010,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1043,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194269,"statfs":{"total":200000000,"available":198931540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.4279999999999999,"15min":1.2270000000000001},"min":{"1min":0.77100000000000002,"5min":0.61899999999999999,"15min":0.42099999999999999},"max":{"1min":1.4670000000000001,"5min":28.361000000000001,"15min":28.361000000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.1950000000000001,"15min":1.145},"min":{"1min":0.80900000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.5149999999999999,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.94999999999999996}]},{"osd":1,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0920000000000001,"15min":1.079},"min":{"1min":0.78100000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.472,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.877},{"interface":"front","average":{"1min":1.157,"5min":1.393,"15min":1.244},"min":{"1min":0.78100000000000003,"5min":0.74299999999999999,"15min":0.63100000000000001},"max":{"1min":1.6120000000000001,"5min":15.324999999999999,"15min":15.324999999999999},"last":1.234}]},{"osd":2,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3740000000000001,"15min":1.2989999999999999},"min":{"1min":0.998,"5min":0.69699999999999995,"15min":0.65700000000000003},"max":{"1min":1.9259999999999999,"5min":15.422000000000001,"15min":15.422000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.3400000000000001,"15min":1.2450000000000001},"min":{"1min":0.90500000000000003,"5min":0.81100000000000005,"15min":0.58599999999999997},"max":{"1min":1.5800000000000001,"5min":10.173999999999999,"15min":10.173999999999999},"last":1.0800000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.403,"15min":1.3380000000000001},"min":{"1min":0.95199999999999996,"5min":0.877,"15min":0.72899999999999998},"max":{"1min":1.671,"5min":10.096,"15min":10.096},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.2749999999999999,"15min":1.254},"min":{"1min":0.83199999999999996,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6200000000000001,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.29}]},{"osd":4,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.3999999999999999,"15min":1.381},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.52000000000000002},"max":{"1min":1.7370000000000001,"5min":15.378,"15min":15.378},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4710000000000001,"15min":1.419},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.68999999999999995},"max":{"1min":1.7470000000000001,"5min":13.178000000000001,"15min":13.178000000000001},"last":1.3480000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.431,"15min":1.367},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.651,"5min":19.995000000000001,"15min":19.995000000000001},"last":1.413},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.581,"15min":1.552},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.67600000000000005},"max":{"1min":2.1989999999999998,"5min":15.679,"15min":15.679},"last":1.819}]},{"osd":7,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.474,"15min":1.528},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8320000000000001,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.452,"5min":1.478,"15min":1.4930000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.972,"5min":4.6609999999999996,"15min":4.6609999999999996},"last":1.496}]}]},{"osd":5,"up_from":13,"seq":55834575010,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1619,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193692,"statfs":{"total":200000000,"available":198341553,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.119,"15min":1.095},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.944},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.129,"15min":1.1240000000000001},"min":{"1min":0.78300000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":3.1379999999999999},"last":1.216}]},{"osd":1,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.1870000000000001,"15min":1.1399999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.603,"5min":2.3319999999999999,"15min":2.79},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1759999999999999,"15min":1.0980000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7509999999999999},"last":1.1870000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1839999999999999,"15min":1.157},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6399999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2869999999999999,"15min":1.2250000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.74299999999999999},"max":{"1min":1.6950000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.3799999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.26,"15min":1.2190000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.587,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.431},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3089999999999999,"15min":1.282},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.875,"5min":1.875,"15min":2.1499999999999999},"last":1.3300000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2529999999999999,"15min":1.2569999999999999},"min":{"1min":0.67000000000000004,"5min":0.60699999999999998,"15min":0.57899999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.853},"last":1.472},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2869999999999999,"15min":1.27},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.58399999999999996},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.0680000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3260000000000001,"15min":1.329},"min":{"1min":0.55300000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.792,"5min":1.792,"15min":1.821},"last":1.504},{"interface":"front","average":{"1min":1.462,"5min":1.421,"15min":1.4179999999999999},"min":{"1min":0.70799999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.952,"5min":1.952,"15min":2.8780000000000001},"last":1.2709999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4079999999999999,"15min":1.4019999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.72499999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.2189999999999999},"last":1.552},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.458,"15min":1.5089999999999999},"min":{"1min":0.68300000000000005,"5min":0.629,"15min":0.629},"max":{"1min":2.056,"5min":2.056,"15min":4.7249999999999996},"last":1.6259999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1043,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194269,"statfs":{"total":200000000,"available":198931540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.1379999999999999,"15min":1.0529999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.504,"5min":6.4969999999999999,"15min":6.4969999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.143,"15min":1.125},"min":{"1min":0.74299999999999999,"5min":0.66000000000000003,"15min":0.58199999999999996},"max":{"1min":1.7869999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.1579999999999999,"15min":1.101},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.54100000000000004},"max":{"1min":1.639,"5min":6.2999999999999998,"15min":6.2999999999999998},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.3280000000000001,"15min":1.181},"min":{"1min":0.81299999999999994,"5min":0.78100000000000003,"15min":0.57399999999999995},"max":{"1min":1.4910000000000001,"5min":17.562999999999999,"15min":17.562999999999999},"last":0.97299999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.266,"15min":1.1919999999999999},"min":{"1min":0.86799999999999999,"5min":0.755,"15min":0.65700000000000003},"max":{"1min":1.464,"5min":9.0329999999999995,"15min":9.0329999999999995},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.155,"5min":1.3009999999999999,"15min":1.244},"min":{"1min":0.82899999999999996,"5min":0.748,"15min":0.748},"max":{"1min":1.371,"5min":8.2029999999999994,"15min":8.2029999999999994},"last":1.1819999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3560000000000001,"15min":1.2569999999999999},"min":{"1min":0.92600000000000005,"5min":0.86299999999999999,"15min":0.68500000000000005},"max":{"1min":1.9890000000000001,"5min":8.8160000000000007,"15min":8.8160000000000007},"last":1.03},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.371,"15min":1.298},"min":{"1min":0.86199999999999999,"5min":0.82299999999999995,"15min":0.82099999999999995},"max":{"1min":1.8129999999999999,"5min":10.157999999999999,"15min":10.157999999999999},"last":1.512}]},{"osd":5,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.2629999999999999,"15min":1.1950000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.52400000000000002},"max":{"1min":1.7450000000000001,"5min":7.056,"15min":7.056},"last":1.073},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.5129999999999999,"15min":1.4379999999999999},"min":{"1min":1.1879999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.867,"5min":9.0700000000000003,"15min":9.0700000000000003},"last":1.3129999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3720000000000001,"15min":1.3120000000000001},"min":{"1min":0.80700000000000005,"5min":0.62,"15min":0.58599999999999997},"max":{"1min":1.6950000000000001,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3680000000000001,"15min":1.29},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.59199999999999997},"max":{"1min":1.9379999999999999,"5min":5.2089999999999996,"15min":5.2089999999999996},"last":1.1619999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.496,"15min":1.4259999999999999},"min":{"1min":1.2110000000000001,"5min":0.70199999999999996,"15min":0.67300000000000004},"max":{"1min":2.1040000000000001,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.5740000000000001,"15min":1.5029999999999999},"min":{"1min":1.0229999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.8919999999999999,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.5669999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1044,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90500000000000003,"15min":0.91500000000000004},"min":{"1min":0.70599999999999996,"5min":0.48499999999999999,"15min":0.39800000000000002},"max":{"1min":1.2609999999999999,"5min":1.4770000000000001,"15min":1.8340000000000001},"last":1.056},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.98299999999999998,"15min":0.94799999999999995},"min":{"1min":0.68500000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5249999999999999,"5min":1.5369999999999999,"15min":2.5270000000000001},"last":0.72899999999999998}]},{"osd":1,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.99399999999999999,"15min":0.91400000000000003},"min":{"1min":0.73599999999999999,"5min":0.44800000000000001,"15min":0.34499999999999997},"max":{"1min":1.556,"5min":1.772,"15min":1.772},"last":0.755},{"interface":"front","average":{"1min":1.242,"5min":1.236,"15min":1.175},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.46200000000000002},"max":{"1min":1.825,"5min":1.825,"15min":1.861},"last":1.5900000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1259999999999999,"15min":1.071},"min":{"1min":0.83199999999999996,"5min":0.56699999999999995,"15min":0.41899999999999998},"max":{"1min":1.5309999999999999,"5min":1.659,"15min":1.7350000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.222,"5min":1.1739999999999999,"15min":1.155},"min":{"1min":0.69799999999999995,"5min":0.55000000000000004,"15min":0.45100000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.9570000000000001},"last":1.4910000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.216,"15min":1.226},"min":{"1min":0.94999999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.671,"5min":1.6870000000000001,"15min":2.7210000000000001},"last":1.127},{"interface":"front","average":{"1min":1.456,"5min":1.345,"15min":1.29},"min":{"1min":1.129,"5min":0.873,"15min":0.745},"max":{"1min":1.7509999999999999,"5min":1.9850000000000001,"15min":2.3999999999999999},"last":1.4550000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.4199999999999999,"15min":1.343},"min":{"1min":1.153,"5min":0.81899999999999995,"15min":0.66700000000000004},"max":{"1min":1.9119999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.339},{"interface":"front","average":{"1min":1.506,"5min":1.379,"15min":1.3999999999999999},"min":{"1min":1.236,"5min":0.78600000000000003,"15min":0.73699999999999999},"max":{"1min":1.9139999999999999,"5min":2.2629999999999999,"15min":2.3839999999999999},"last":1.762}]},{"osd":6,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.4710000000000001,"15min":1.4550000000000001},"min":{"1min":1.1839999999999999,"5min":1.008,"15min":0.88100000000000001},"max":{"1min":1.7729999999999999,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.677},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.3720000000000001,"15min":1.379},"min":{"1min":1.079,"5min":0.83799999999999997,"15min":0.75900000000000001},"max":{"1min":1.6919999999999999,"5min":1.968,"15min":2.8250000000000002},"last":0.99199999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.444,"15min":1.413},"min":{"1min":1.181,"5min":0.81100000000000005,"15min":0.77100000000000002},"max":{"1min":1.8660000000000001,"5min":2.056,"15min":2.7850000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.633,"5min":1.508,"15min":1.446},"min":{"1min":1.296,"5min":0.96599999999999997,"15min":0.80600000000000005},"max":{"1min":1.99,"5min":2.2290000000000001,"15min":2.3740000000000001},"last":1.234}]}]},{"osd":2,"up_from":13,"seq":55834575010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1043,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194268,"statfs":{"total":200000000,"available":198930992,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.86899999999999999,"15min":0.84899999999999998},"min":{"1min":0.71599999999999997,"5min":0.40000000000000002,"15min":0.32000000000000001},"max":{"1min":1.54,"5min":1.8340000000000001,"15min":6.8879999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.94899999999999995,"15min":0.94299999999999995},"min":{"1min":0.58099999999999996,"5min":0.376,"15min":0.35799999999999998},"max":{"1min":1.3700000000000001,"5min":1.7589999999999999,"15min":4.5510000000000002},"last":0.92800000000000005}]},{"osd":1,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.92700000000000005,"15min":0.94999999999999996},"min":{"1min":0.65000000000000002,"5min":0.38300000000000001,"15min":0.34000000000000002},"max":{"1min":1.232,"5min":1.702,"15min":11.308999999999999},"last":1.006},{"interface":"front","average":{"1min":1.169,"5min":1.105,"15min":1.032},"min":{"1min":0.80700000000000005,"5min":0.51000000000000001,"15min":0.44600000000000001},"max":{"1min":1.738,"5min":1.738,"15min":2.9889999999999999},"last":1.2090000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1539999999999999,"15min":1.1200000000000001},"min":{"1min":0.68000000000000005,"5min":0.55000000000000004,"15min":0.41099999999999998},"max":{"1min":1.581,"5min":1.772,"15min":13.087999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.234,"15min":1.21},"min":{"1min":0.91500000000000004,"5min":0.55200000000000005,"15min":0.52300000000000002},"max":{"1min":1.512,"5min":2.0720000000000001,"15min":12.289999999999999},"last":1.3580000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.359,"15min":1.3280000000000001},"min":{"1min":1.0820000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.7470000000000001,"5min":1.9319999999999999,"15min":3.5249999999999999},"last":1.532},{"interface":"front","average":{"1min":1.355,"5min":1.286,"15min":1.3380000000000001},"min":{"1min":0.89900000000000002,"5min":0.71599999999999997,"15min":0.61499999999999999},"max":{"1min":1.8999999999999999,"5min":2.0539999999999998,"15min":13.927},"last":1.4039999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3600000000000001,"15min":1.3740000000000001},"min":{"1min":0.83999999999999997,"5min":0.70299999999999996,"15min":0.64000000000000001},"max":{"1min":1.871,"5min":1.9750000000000001,"15min":11.003},"last":1.296},{"interface":"front","average":{"1min":1.353,"5min":1.349,"15min":1.3360000000000001},"min":{"1min":0.86599999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.6579999999999999,"5min":1.9370000000000001,"15min":13.129},"last":1.4470000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.401,"15min":1.3620000000000001},"min":{"1min":1.0409999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.724,"5min":1.9810000000000001,"15min":8.1609999999999996},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.486,"15min":1.4490000000000001},"min":{"1min":1.1339999999999999,"5min":0.89900000000000002,"15min":0.69999999999999996},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":6.8150000000000004},"last":1.6539999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.417,"15min":1.421},"min":{"1min":0.98899999999999999,"5min":0.76200000000000001,"15min":0.61299999999999999},"max":{"1min":2.1309999999999998,"5min":2.1440000000000001,"15min":10.948},"last":1.079},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.486,"15min":1.478},"min":{"1min":0.95899999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8009999999999999,"5min":2.254,"15min":9.0239999999999991},"last":1.5860000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193697,"statfs":{"total":200000000,"available":198345760,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.1100000000000001,"15min":0.98199999999999998},"min":{"1min":0.54800000000000004,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":1.3149999999999999,"5min":23.059000000000001,"15min":23.059000000000001},"last":2.5680000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1819999999999999,"15min":1.113},"min":{"1min":0.83099999999999996,"5min":0.41099999999999998,"15min":0.39900000000000002},"max":{"1min":1.625,"5min":9.9749999999999996,"15min":9.9749999999999996},"last":1.2649999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.2130000000000001,"15min":1.0449999999999999},"min":{"1min":0.67800000000000005,"5min":0.46200000000000002,"15min":0.45500000000000002},"max":{"1min":1.274,"5min":22.977,"15min":22.977},"last":7.9880000000000004},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.038,"15min":1.0069999999999999},"min":{"1min":0.876,"5min":0.35899999999999999,"15min":0.34999999999999998},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":2.254},"last":9.4440000000000008}]},{"osd":3,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.351,"15min":1.272},"min":{"1min":0.76300000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.7569999999999999,"5min":1.9770000000000001,"15min":2.5169999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.125,"5min":1.107,"15min":1.0409999999999999},"min":{"1min":0.58699999999999997,"5min":0.53400000000000003,"15min":0.47799999999999998},"max":{"1min":1.6479999999999999,"5min":1.8480000000000001,"15min":2.6760000000000002},"last":5.3470000000000004}]},{"osd":4,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.5109999999999999,"15min":1.357},"min":{"1min":1.103,"5min":0.73999999999999999,"15min":0.58699999999999997},"max":{"1min":1.5700000000000001,"5min":23.145,"15min":23.145},"last":2.7069999999999999},{"interface":"front","average":{"1min":1.54,"5min":1.536,"15min":1.4279999999999999},"min":{"1min":1.1899999999999999,"5min":0.747,"15min":0.747},"max":{"1min":1.9570000000000001,"5min":9.9299999999999997,"15min":9.9299999999999997},"last":0.997}]},{"osd":5,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3029999999999999,"15min":1.2709999999999999},"min":{"1min":1.091,"5min":0.77700000000000002,"15min":0.58699999999999997},"max":{"1min":1.9790000000000001,"5min":2.8109999999999999,"15min":4.6399999999999997},"last":3.2799999999999998},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.5920000000000001,"15min":1.4430000000000001},"min":{"1min":1.0449999999999999,"5min":0.71699999999999997,"15min":0.66800000000000004},"max":{"1min":1.8360000000000001,"5min":23.105,"15min":23.105},"last":2.758}]},{"osd":6,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.3839999999999999,"15min":1.3280000000000001},"min":{"1min":1.0780000000000001,"5min":0.82199999999999995,"15min":0.65200000000000002},"max":{"1min":2.1139999999999999,"5min":2.71,"15min":4.5819999999999999},"last":3.3380000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.708,"15min":1.5069999999999999},"min":{"1min":0.97499999999999998,"5min":0.80300000000000005,"15min":0.67200000000000004},"max":{"1min":1.9450000000000001,"5min":24.341999999999999,"15min":24.341999999999999},"last":2.657}]},{"osd":7,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.4399999999999999,"15min":1.429},"min":{"1min":1.091,"5min":0.78800000000000003,"15min":0.64400000000000002},"max":{"1min":1.923,"5min":2.0870000000000002,"15min":2.4889999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.4510000000000001,"15min":1.4359999999999999},"min":{"1min":0.97899999999999998,"5min":0.76800000000000002,"15min":0.66200000000000003},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":4.508},"last":3.4140000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575010,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1043,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194269,"statfs":{"total":200000000,"available":198931504,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.82799999999999996,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.39700000000000002,"15min":0.36599999999999999},"max":{"1min":1.552,"5min":1.552,"15min":2.9470000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.014,"15min":0.95599999999999996},"min":{"1min":0.60399999999999998,"5min":0.34599999999999997,"15min":0.33700000000000002},"max":{"1min":1.2829999999999999,"5min":1.8109999999999999,"15min":1.8360000000000001},"last":0.90900000000000003}]},{"osd":2,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.88200000000000001,"15min":0.84699999999999998},"min":{"1min":0.65000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.246,"5min":1.4870000000000001,"15min":1.6739999999999999},"last":1.002},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.054,"15min":1.012},"min":{"1min":0.59499999999999997,"5min":0.41699999999999998,"15min":0.40000000000000002},"max":{"1min":1.4399999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.2210000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2010000000000001,"15min":1.1240000000000001},"min":{"1min":0.63400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.712,"5min":2.0379999999999998,"15min":2.1339999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3160000000000001,"15min":1.194},"min":{"1min":0.69399999999999995,"5min":0.45500000000000002,"15min":0.39100000000000001},"max":{"1min":1.7230000000000001,"5min":2.0659999999999998,"15min":2.145},"last":1.8680000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.339,"15min":1.3169999999999999},"min":{"1min":0.90700000000000003,"5min":0.79300000000000004,"15min":0.70799999999999996},"max":{"1min":1.667,"5min":1.804,"15min":2.625},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.3700000000000001,"15min":1.3069999999999999},"min":{"1min":0.93600000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6910000000000001,"5min":1.736,"15min":2.5550000000000002},"last":1.7569999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.337,"15min":1.3280000000000001},"min":{"1min":0.91700000000000004,"5min":0.69599999999999995,"15min":0.59299999999999997},"max":{"1min":1.883,"5min":1.883,"15min":5.4290000000000003},"last":1.335},{"interface":"front","average":{"1min":1.379,"5min":1.347,"15min":1.3220000000000001},"min":{"1min":0.85799999999999998,"5min":0.83399999999999996,"15min":0.73599999999999999},"max":{"1min":1.6699999999999999,"5min":1.9039999999999999,"15min":3.0910000000000002},"last":1.819}]},{"osd":6,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.381,"15min":1.345},"min":{"1min":0.89000000000000001,"5min":0.82099999999999995,"15min":0.64800000000000002},"max":{"1min":1.5269999999999999,"5min":1.9330000000000001,"15min":2.4420000000000002},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.512,"15min":1.4550000000000001},"min":{"1min":0.95799999999999996,"5min":0.90700000000000003,"15min":0.69099999999999995},"max":{"1min":2.004,"5min":2.109,"15min":2.577},"last":1.8009999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.466,"15min":1.4279999999999999},"min":{"1min":0.875,"5min":0.80000000000000004,"15min":0.755},"max":{"1min":1.956,"5min":1.982,"15min":2.3069999999999999},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.472,"15min":1.4359999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.749},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2650000000000001},"last":2.0649999999999999}]}]}],"pool_statfs":[]}} 2023-12-22T08:53:09.006 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:53:09.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.237+0000 7fa86f59e640 1 Processor -- start 2023-12-22T08:53:09.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.237+0000 7fa86f59e640 1 -- start start 2023-12-22T08:53:09.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.239+0000 7fa86f59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa87006d210 0x7fa87015e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:09.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.239+0000 7fa86f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8700cb4c0 0x7fa870159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:09.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.239+0000 7fa86f59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8700706d0 con 0x7fa87006d5f0 2023-12-22T08:53:09.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.239+0000 7fa86f59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8700cbf40 con 0x7fa87006d210 2023-12-22T08:53:09.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.239+0000 7fa86f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700ce840 con 0x7fa8700cb4c0 2023-12-22T08:53:09.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.239+0000 7fa86e59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa87006d210 0x7fa87015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:09.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.239+0000 7fa86e59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa87006d210 0x7fa87015e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38882/0 (socket says 172.21.15.38:38882) 2023-12-22T08:53:09.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.239+0000 7fa86ed9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa87006d5f0 0x7fa8700cc150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52934/0 (socket says 172.21.15.38:52934) 2023-12-22T08:53:09.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.239+0000 7fa86e59c640 1 -- 172.21.15.38:0/3386741205 learned_addr learned my addr 172.21.15.38:0/3386741205 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:09.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.240+0000 7fa86dd9b640 1 --2- 172.21.15.38:0/3386741205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8700cb4c0 0x7fa870159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:09.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.240+0000 7fa86e59c640 1 -- 172.21.15.38:0/3386741205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8700cb4c0 msgr2=0x7fa870159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:09.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.240+0000 7fa86e59c640 1 --2- 172.21.15.38:0/3386741205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8700cb4c0 0x7fa870159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.240+0000 7fa86e59c640 1 -- 172.21.15.38:0/3386741205 >> v1:172.21.15.38:6789/0 conn(0x7fa87006d5f0 legacy=0x7fa8700cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:09.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.240+0000 7fa86e59c640 1 -- 172.21.15.38:0/3386741205 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8700ceb20 con 0x7fa87006d210 2023-12-22T08:53:09.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.240+0000 7fa86d59a640 1 -- 172.21.15.38:0/3386741205 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882062791 0 0) 0x7fa8700706d0 con 0x7fa87006d5f0 2023-12-22T08:53:09.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.240+0000 7fa86dd9b640 1 --2- 172.21.15.38:0/3386741205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8700cb4c0 0x7fa870159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:09.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.241+0000 7fa86e59c640 1 --2- 172.21.15.38:0/3386741205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa87006d210 0x7fa87015e830 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fa860009870 tx=0x7fa86002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e36529d07fce7dc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:09.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.241+0000 7fa86d59a640 1 -- 172.21.15.38:0/3386741205 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860030840 con 0x7fa87006d210 2023-12-22T08:53:09.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.241+0000 7fa86d59a640 1 -- 172.21.15.38:0/3386741205 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8600309a0 con 0x7fa87006d210 2023-12-22T08:53:09.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.241+0000 7fa86d59a640 1 -- 172.21.15.38:0/3386741205 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860030d30 con 0x7fa87006d210 2023-12-22T08:53:09.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.242+0000 7fa86f59e640 1 -- 172.21.15.38:0/3386741205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa87006d210 msgr2=0x7fa87015e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:09.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.242+0000 7fa86f59e640 1 --2- 172.21.15.38:0/3386741205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa87006d210 0x7fa87015e830 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fa860009870 tx=0x7fa86002b980 comp rx=0 tx=0).stop 2023-12-22T08:53:09.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.242+0000 7fa86f59e640 1 -- 172.21.15.38:0/3386741205 shutdown_connections 2023-12-22T08:53:09.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.242+0000 7fa86f59e640 1 --2- 172.21.15.38:0/3386741205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8700cb4c0 0x7fa870159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.242+0000 7fa86f59e640 1 --2- 172.21.15.38:0/3386741205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa87006d210 0x7fa87015e830 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.242+0000 7fa86f59e640 1 -- 172.21.15.38:0/3386741205 >> 172.21.15.38:0/3386741205 conn(0x7fa8700b1f70 msgr2=0x7fa8700b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:09.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.242+0000 7fa86f59e640 1 -- 172.21.15.38:0/3386741205 shutdown_connections 2023-12-22T08:53:09.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.242+0000 7fa86f59e640 1 -- 172.21.15.38:0/3386741205 wait complete. 2023-12-22T08:53:09.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.244+0000 7fa86f59e640 1 Processor -- start 2023-12-22T08:53:09.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.244+0000 7fa86f59e640 1 -- start start 2023-12-22T08:53:09.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.245+0000 7fa86f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa87006d210 0x7fa870154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:09.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.245+0000 7fa86f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa87006d5f0 0x7fa87014f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:09.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.245+0000 7fa86f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8700cb4c0 0x7fa8700a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:09.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.245+0000 7fa86f59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa870152f40 con 0x7fa8700cb4c0 2023-12-22T08:53:09.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.245+0000 7fa86f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700a26c0 con 0x7fa87006d210 2023-12-22T08:53:09.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.245+0000 7fa86f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700a3930 con 0x7fa87006d5f0 2023-12-22T08:53:09.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.245+0000 7fa86ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8700cb4c0 0x7fa8700a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.245+0000 7fa86ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8700cb4c0 0x7fa8700a2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38896/0 (socket says 172.21.15.38:38896) 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.245+0000 7fa86ed9d640 1 -- 172.21.15.38:0/227596385 learned_addr learned my addr 172.21.15.38:0/227596385 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.246+0000 7fa86dd9b640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa87006d5f0 0x7fa87014f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.246+0000 7fa86e59c640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa87006d210 0x7fa870154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.246+0000 7fa86ed9d640 1 -- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa87006d5f0 msgr2=0x7fa87014f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.246+0000 7fa86ed9d640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa87006d5f0 0x7fa87014f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.246+0000 7fa86ed9d640 1 -- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa87006d210 msgr2=0x7fa870154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.246+0000 7fa86ed9d640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa87006d210 0x7fa870154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.246+0000 7fa86ed9d640 1 -- 172.21.15.38:0/227596385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600094d0 con 0x7fa8700cb4c0 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.246+0000 7fa86e59c640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa87006d210 0x7fa870154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.246+0000 7fa86ed9d640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8700cb4c0 0x7fa8700a2180 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fa86800c810 tx=0x7fa86800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.246+0000 7fa85effd640 1 -- 172.21.15.38:0/227596385 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86800a640 con 0x7fa8700cb4c0 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.246+0000 7fa85effd640 1 -- 172.21.15.38:0/227596385 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86800a7c0 con 0x7fa8700cb4c0 2023-12-22T08:53:09.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.246+0000 7fa85effd640 1 -- 172.21.15.38:0/227596385 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86800ab70 con 0x7fa8700cb4c0 2023-12-22T08:53:09.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.246+0000 7fa86f59e640 1 -- 172.21.15.38:0/227596385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8700a3650 con 0x7fa8700cb4c0 2023-12-22T08:53:09.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.247+0000 7fa86f59e640 1 -- 172.21.15.38:0/227596385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa870152bd0 con 0x7fa8700cb4c0 2023-12-22T08:53:09.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.248+0000 7fa86f59e640 1 -- 172.21.15.38:0/227596385 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8700a1ea0 con 0x7fa8700cb4c0 2023-12-22T08:53:09.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.249+0000 7fa85effd640 1 -- 172.21.15.38:0/227596385 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa86800acd0 con 0x7fa8700cb4c0 2023-12-22T08:53:09.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.250+0000 7fa85effd640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa85006a430 0x7fa85006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:09.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.250+0000 7fa85effd640 1 -- 172.21.15.38:0/227596385 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa868087d80 con 0x7fa8700cb4c0 2023-12-22T08:53:09.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.251+0000 7fa86e59c640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa85006a430 0x7fa85006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:09.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.252+0000 7fa86e59c640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa85006a430 0x7fa85006c8f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa860036000 tx=0x7fa86003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:09.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.254+0000 7fa85effd640 1 -- 172.21.15.38:0/227596385 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa8700a1ea0 con 0x7fa8700cb4c0 2023-12-22T08:53:09.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.445+0000 7fa86f59e640 1 -- 172.21.15.38:0/227596385 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa870071b70 con 0x7fa85006a430 2023-12-22T08:53:09.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.468+0000 7fa85effd640 1 -- 172.21.15.38:0/227596385 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282898 (secure 0 0 0) 0x7fa860030be0 con 0x7fa85006a430 2023-12-22T08:53:09.471 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:09.474 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:53:09.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.475+0000 7fa86f59e640 1 -- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa85006a430 msgr2=0x7fa85006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:09.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.475+0000 7fa86f59e640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa85006a430 0x7fa85006c8f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa860036000 tx=0x7fa86003b040 comp rx=0 tx=0).stop 2023-12-22T08:53:09.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.475+0000 7fa86f59e640 1 -- 172.21.15.38:0/227596385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8700cb4c0 msgr2=0x7fa8700a2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:09.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.475+0000 7fa86f59e640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8700cb4c0 0x7fa8700a2180 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fa86800c810 tx=0x7fa86800ccd0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.475+0000 7fa86f59e640 1 -- 172.21.15.38:0/227596385 shutdown_connections 2023-12-22T08:53:09.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.475+0000 7fa86f59e640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa85006a430 0x7fa85006c8f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.475+0000 7fa86f59e640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8700cb4c0 0x7fa8700a2180 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.475+0000 7fa86f59e640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa87006d5f0 0x7fa87014f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.475+0000 7fa86f59e640 1 --2- 172.21.15.38:0/227596385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa87006d210 0x7fa870154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.475+0000 7fa86f59e640 1 -- 172.21.15.38:0/227596385 >> 172.21.15.38:0/227596385 conn(0x7fa8700b1f70 msgr2=0x7fa870070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:09.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.476+0000 7fa86f59e640 1 -- 172.21.15.38:0/227596385 shutdown_connections 2023-12-22T08:53:09.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.476+0000 7fa86f59e640 1 -- 172.21.15.38:0/227596385 wait complete. 2023-12-22T08:53:09.498 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":582,"stamp":"2023-12-22T08:53:08.647161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9491,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553008,"statfs":{"total":1600000000,"available":1590280751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.703571"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015266+0000","last_change":"2023-12-22T08:53:04.482739+0000","last_active":"2023-12-22T08:53:08.015266+0000","last_peered":"2023-12-22T08:53:08.015266+0000","last_clean":"2023-12-22T08:53:08.015266+0000","last_became_active":"2023-12-22T08:53:04.482517+0000","last_became_peered":"2023-12-22T08:53:04.482517+0000","last_unstale":"2023-12-22T08:53:08.015266+0000","last_undegraded":"2023-12-22T08:53:08.015266+0000","last_fullsized":"2023-12-22T08:53:08.015266+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:45.576446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014907+0000","last_change":"2023-12-22T08:53:04.485413+0000","last_active":"2023-12-22T08:53:08.014907+0000","last_peered":"2023-12-22T08:53:08.014907+0000","last_clean":"2023-12-22T08:53:08.014907+0000","last_became_active":"2023-12-22T08:53:04.484419+0000","last_became_peered":"2023-12-22T08:53:04.484419+0000","last_unstale":"2023-12-22T08:53:08.014907+0000","last_undegraded":"2023-12-22T08:53:08.014907+0000","last_fullsized":"2023-12-22T08:53:08.014907+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:39:49.783107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015538+0000","last_change":"2023-12-22T08:53:04.486214+0000","last_active":"2023-12-22T08:53:08.015538+0000","last_peered":"2023-12-22T08:53:08.015538+0000","last_clean":"2023-12-22T08:53:08.015538+0000","last_became_active":"2023-12-22T08:53:04.485139+0000","last_became_peered":"2023-12-22T08:53:04.485139+0000","last_unstale":"2023-12-22T08:53:08.015538+0000","last_undegraded":"2023-12-22T08:53:08.015538+0000","last_fullsized":"2023-12-22T08:53:08.015538+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:47:01.571929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.488266+0000","last_change":"2023-12-22T08:53:04.506742+0000","last_active":"2023-12-22T08:53:05.488266+0000","last_peered":"2023-12-22T08:53:05.488266+0000","last_clean":"2023-12-22T08:53:05.488266+0000","last_became_active":"2023-12-22T08:53:04.506197+0000","last_became_peered":"2023-12-22T08:53:04.506197+0000","last_unstale":"2023-12-22T08:53:05.488266+0000","last_undegraded":"2023-12-22T08:53:05.488266+0000","last_fullsized":"2023-12-22T08:53:05.488266+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:03:13.596128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014449+0000","last_change":"2023-12-22T08:53:04.489940+0000","last_active":"2023-12-22T08:53:08.014449+0000","last_peered":"2023-12-22T08:53:08.014449+0000","last_clean":"2023-12-22T08:53:08.014449+0000","last_became_active":"2023-12-22T08:53:04.488477+0000","last_became_peered":"2023-12-22T08:53:04.488477+0000","last_unstale":"2023-12-22T08:53:08.014449+0000","last_undegraded":"2023-12-22T08:53:08.014449+0000","last_fullsized":"2023-12-22T08:53:08.014449+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:35:40.049193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015794+0000","last_change":"2023-12-22T08:53:04.500999+0000","last_active":"2023-12-22T08:53:08.015794+0000","last_peered":"2023-12-22T08:53:08.015794+0000","last_clean":"2023-12-22T08:53:08.015794+0000","last_became_active":"2023-12-22T08:53:04.500756+0000","last_became_peered":"2023-12-22T08:53:04.500756+0000","last_unstale":"2023-12-22T08:53:08.015794+0000","last_undegraded":"2023-12-22T08:53:08.015794+0000","last_fullsized":"2023-12-22T08:53:08.015794+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:51:03.123178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.485591+0000","last_change":"2023-12-22T08:53:04.500497+0000","last_active":"2023-12-22T08:53:05.485591+0000","last_peered":"2023-12-22T08:53:05.485591+0000","last_clean":"2023-12-22T08:53:05.485591+0000","last_became_active":"2023-12-22T08:53:04.500045+0000","last_became_peered":"2023-12-22T08:53:04.500045+0000","last_unstale":"2023-12-22T08:53:05.485591+0000","last_undegraded":"2023-12-22T08:53:05.485591+0000","last_fullsized":"2023-12-22T08:53:05.485591+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:46:22.997124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.144806+0000","last_change":"2023-12-22T08:53:04.482729+0000","last_active":"2023-12-22T08:53:06.144806+0000","last_peered":"2023-12-22T08:53:06.144806+0000","last_clean":"2023-12-22T08:53:06.144806+0000","last_became_active":"2023-12-22T08:53:04.482491+0000","last_became_peered":"2023-12-22T08:53:04.482491+0000","last_unstale":"2023-12-22T08:53:06.144806+0000","last_undegraded":"2023-12-22T08:53:06.144806+0000","last_fullsized":"2023-12-22T08:53:06.144806+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:57.481784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.144779+0000","last_change":"2023-12-22T08:53:04.498365+0000","last_active":"2023-12-22T08:53:06.144779+0000","last_peered":"2023-12-22T08:53:06.144779+0000","last_clean":"2023-12-22T08:53:06.144779+0000","last_became_active":"2023-12-22T08:53:04.498095+0000","last_became_peered":"2023-12-22T08:53:04.498095+0000","last_unstale":"2023-12-22T08:53:06.144779+0000","last_undegraded":"2023-12-22T08:53:06.144779+0000","last_fullsized":"2023-12-22T08:53:06.144779+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:29:11.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.144766+0000","last_change":"2023-12-22T08:53:04.495409+0000","last_active":"2023-12-22T08:53:06.144766+0000","last_peered":"2023-12-22T08:53:06.144766+0000","last_clean":"2023-12-22T08:53:06.144766+0000","last_became_active":"2023-12-22T08:53:04.495187+0000","last_became_peered":"2023-12-22T08:53:04.495187+0000","last_unstale":"2023-12-22T08:53:06.144766+0000","last_undegraded":"2023-12-22T08:53:06.144766+0000","last_fullsized":"2023-12-22T08:53:06.144766+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:28:58.532934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014910+0000","last_change":"2023-12-22T08:53:04.497546+0000","last_active":"2023-12-22T08:53:08.014910+0000","last_peered":"2023-12-22T08:53:08.014910+0000","last_clean":"2023-12-22T08:53:08.014910+0000","last_became_active":"2023-12-22T08:53:04.497301+0000","last_became_peered":"2023-12-22T08:53:04.497301+0000","last_unstale":"2023-12-22T08:53:08.014910+0000","last_undegraded":"2023-12-22T08:53:08.014910+0000","last_fullsized":"2023-12-22T08:53:08.014910+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:40:31.348198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:07.987928+0000","last_change":"2023-12-22T08:53:04.501994+0000","last_active":"2023-12-22T08:53:07.987928+0000","last_peered":"2023-12-22T08:53:07.987928+0000","last_clean":"2023-12-22T08:53:07.987928+0000","last_became_active":"2023-12-22T08:53:04.501692+0000","last_became_peered":"2023-12-22T08:53:04.501692+0000","last_unstale":"2023-12-22T08:53:07.987928+0000","last_undegraded":"2023-12-22T08:53:07.987928+0000","last_fullsized":"2023-12-22T08:53:07.987928+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:43:54.623048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:07.987695+0000","last_change":"2023-12-22T08:53:04.479107+0000","last_active":"2023-12-22T08:53:07.987695+0000","last_peered":"2023-12-22T08:53:07.987695+0000","last_clean":"2023-12-22T08:53:07.987695+0000","last_became_active":"2023-12-22T08:53:04.478861+0000","last_became_peered":"2023-12-22T08:53:04.478861+0000","last_unstale":"2023-12-22T08:53:07.987695+0000","last_undegraded":"2023-12-22T08:53:07.987695+0000","last_fullsized":"2023-12-22T08:53:07.987695+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:44:08.516182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.145095+0000","last_change":"2023-12-22T08:53:04.490882+0000","last_active":"2023-12-22T08:53:06.145095+0000","last_peered":"2023-12-22T08:53:06.145095+0000","last_clean":"2023-12-22T08:53:06.145095+0000","last_became_active":"2023-12-22T08:53:04.490650+0000","last_became_peered":"2023-12-22T08:53:04.490650+0000","last_unstale":"2023-12-22T08:53:06.145095+0000","last_undegraded":"2023-12-22T08:53:06.145095+0000","last_fullsized":"2023-12-22T08:53:06.145095+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:28:14.952524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.145022+0000","last_change":"2023-12-22T08:53:04.502197+0000","last_active":"2023-12-22T08:53:06.145022+0000","last_peered":"2023-12-22T08:53:06.145022+0000","last_clean":"2023-12-22T08:53:06.145022+0000","last_became_active":"2023-12-22T08:53:04.501958+0000","last_became_peered":"2023-12-22T08:53:04.501958+0000","last_unstale":"2023-12-22T08:53:06.145022+0000","last_undegraded":"2023-12-22T08:53:06.145022+0000","last_fullsized":"2023-12-22T08:53:06.145022+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:50:10.521323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.486466+0000","last_change":"2023-12-22T08:53:04.492740+0000","last_active":"2023-12-22T08:53:05.486466+0000","last_peered":"2023-12-22T08:53:05.486466+0000","last_clean":"2023-12-22T08:53:05.486466+0000","last_became_active":"2023-12-22T08:53:04.491820+0000","last_became_peered":"2023-12-22T08:53:04.491820+0000","last_unstale":"2023-12-22T08:53:05.486466+0000","last_undegraded":"2023-12-22T08:53:05.486466+0000","last_fullsized":"2023-12-22T08:53:05.486466+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:50:10.886197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.016189+0000","last_change":"2023-12-22T08:53:04.499864+0000","last_active":"2023-12-22T08:53:08.016189+0000","last_peered":"2023-12-22T08:53:08.016189+0000","last_clean":"2023-12-22T08:53:08.016189+0000","last_became_active":"2023-12-22T08:53:04.499635+0000","last_became_peered":"2023-12-22T08:53:04.499635+0000","last_unstale":"2023-12-22T08:53:08.016189+0000","last_undegraded":"2023-12-22T08:53:08.016189+0000","last_fullsized":"2023-12-22T08:53:08.016189+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:28:58.532934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.487978+0000","last_change":"2023-12-22T08:53:04.504371+0000","last_active":"2023-12-22T08:53:05.487978+0000","last_peered":"2023-12-22T08:53:05.487978+0000","last_clean":"2023-12-22T08:53:05.487978+0000","last_became_active":"2023-12-22T08:53:04.503669+0000","last_became_peered":"2023-12-22T08:53:04.503669+0000","last_unstale":"2023-12-22T08:53:05.487978+0000","last_undegraded":"2023-12-22T08:53:05.487978+0000","last_fullsized":"2023-12-22T08:53:05.487978+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:34:15.547023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.483855+0000","last_change":"2023-12-22T08:53:04.494018+0000","last_active":"2023-12-22T08:53:05.483855+0000","last_peered":"2023-12-22T08:53:05.483855+0000","last_clean":"2023-12-22T08:53:05.483855+0000","last_became_active":"2023-12-22T08:53:04.493702+0000","last_became_peered":"2023-12-22T08:53:04.493702+0000","last_unstale":"2023-12-22T08:53:05.483855+0000","last_undegraded":"2023-12-22T08:53:05.483855+0000","last_fullsized":"2023-12-22T08:53:05.483855+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:04:29.093854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:07.987679+0000","last_change":"2023-12-22T08:53:04.489395+0000","last_active":"2023-12-22T08:53:07.987679+0000","last_peered":"2023-12-22T08:53:07.987679+0000","last_clean":"2023-12-22T08:53:07.987679+0000","last_became_active":"2023-12-22T08:53:04.489195+0000","last_became_peered":"2023-12-22T08:53:04.489195+0000","last_unstale":"2023-12-22T08:53:07.987679+0000","last_undegraded":"2023-12-22T08:53:07.987679+0000","last_fullsized":"2023-12-22T08:53:07.987679+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:23:25.758708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015929+0000","last_change":"2023-12-22T08:53:04.504200+0000","last_active":"2023-12-22T08:53:08.015929+0000","last_peered":"2023-12-22T08:53:08.015929+0000","last_clean":"2023-12-22T08:53:08.015929+0000","last_became_active":"2023-12-22T08:53:04.503828+0000","last_became_peered":"2023-12-22T08:53:04.503828+0000","last_unstale":"2023-12-22T08:53:08.015929+0000","last_undegraded":"2023-12-22T08:53:08.015929+0000","last_fullsized":"2023-12-22T08:53:08.015929+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:28:14.952524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.013875+0000","last_change":"2023-12-22T08:53:04.494791+0000","last_active":"2023-12-22T08:53:08.013875+0000","last_peered":"2023-12-22T08:53:08.013875+0000","last_clean":"2023-12-22T08:53:08.013875+0000","last_became_active":"2023-12-22T08:53:04.494579+0000","last_became_peered":"2023-12-22T08:53:04.494579+0000","last_unstale":"2023-12-22T08:53:08.013875+0000","last_undegraded":"2023-12-22T08:53:08.013875+0000","last_fullsized":"2023-12-22T08:53:08.013875+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:12:43.149858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.486994+0000","last_change":"2023-12-22T08:53:04.497224+0000","last_active":"2023-12-22T08:53:05.486994+0000","last_peered":"2023-12-22T08:53:05.486994+0000","last_clean":"2023-12-22T08:53:05.486994+0000","last_became_active":"2023-12-22T08:53:04.495885+0000","last_became_peered":"2023-12-22T08:53:04.495885+0000","last_unstale":"2023-12-22T08:53:05.486994+0000","last_undegraded":"2023-12-22T08:53:05.486994+0000","last_fullsized":"2023-12-22T08:53:05.486994+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:19:15.765703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014141+0000","last_change":"2023-12-22T08:53:04.487613+0000","last_active":"2023-12-22T08:53:08.014141+0000","last_peered":"2023-12-22T08:53:08.014141+0000","last_clean":"2023-12-22T08:53:08.014141+0000","last_became_active":"2023-12-22T08:53:04.487238+0000","last_became_peered":"2023-12-22T08:53:04.487238+0000","last_unstale":"2023-12-22T08:53:08.014141+0000","last_undegraded":"2023-12-22T08:53:08.014141+0000","last_fullsized":"2023-12-22T08:53:08.014141+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:29:11.597300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014549+0000","last_change":"2023-12-22T08:53:04.498772+0000","last_active":"2023-12-22T08:53:08.014549+0000","last_peered":"2023-12-22T08:53:08.014549+0000","last_clean":"2023-12-22T08:53:08.014549+0000","last_became_active":"2023-12-22T08:53:04.498430+0000","last_became_peered":"2023-12-22T08:53:04.498430+0000","last_unstale":"2023-12-22T08:53:08.014549+0000","last_undegraded":"2023-12-22T08:53:08.014549+0000","last_fullsized":"2023-12-22T08:53:08.014549+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:49:57.481784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.485191+0000","last_change":"2023-12-22T08:53:04.503546+0000","last_active":"2023-12-22T08:53:05.485191+0000","last_peered":"2023-12-22T08:53:05.485191+0000","last_clean":"2023-12-22T08:53:05.485191+0000","last_became_active":"2023-12-22T08:53:04.503308+0000","last_became_peered":"2023-12-22T08:53:04.503308+0000","last_unstale":"2023-12-22T08:53:05.485191+0000","last_undegraded":"2023-12-22T08:53:05.485191+0000","last_fullsized":"2023-12-22T08:53:05.485191+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:47:05.201083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.013981+0000","last_change":"2023-12-22T08:53:04.501581+0000","last_active":"2023-12-22T08:53:08.013981+0000","last_peered":"2023-12-22T08:53:08.013981+0000","last_clean":"2023-12-22T08:53:08.013981+0000","last_became_active":"2023-12-22T08:53:04.501306+0000","last_became_peered":"2023-12-22T08:53:04.501306+0000","last_unstale":"2023-12-22T08:53:08.013981+0000","last_undegraded":"2023-12-22T08:53:08.013981+0000","last_fullsized":"2023-12-22T08:53:08.013981+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:29:26.355639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.484355+0000","last_change":"2023-12-22T08:53:04.495363+0000","last_active":"2023-12-22T08:53:05.484355+0000","last_peered":"2023-12-22T08:53:05.484355+0000","last_clean":"2023-12-22T08:53:05.484355+0000","last_became_active":"2023-12-22T08:53:04.495030+0000","last_became_peered":"2023-12-22T08:53:04.495030+0000","last_unstale":"2023-12-22T08:53:05.484355+0000","last_undegraded":"2023-12-22T08:53:05.484355+0000","last_fullsized":"2023-12-22T08:53:05.484355+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:52.778810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014764+0000","last_change":"2023-12-22T08:53:04.485173+0000","last_active":"2023-12-22T08:53:08.014764+0000","last_peered":"2023-12-22T08:53:08.014764+0000","last_clean":"2023-12-22T08:53:08.014764+0000","last_became_active":"2023-12-22T08:53:04.484945+0000","last_became_peered":"2023-12-22T08:53:04.484945+0000","last_unstale":"2023-12-22T08:53:08.014764+0000","last_undegraded":"2023-12-22T08:53:08.014764+0000","last_fullsized":"2023-12-22T08:53:08.014764+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:55:03.965312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.145304+0000","last_change":"2023-12-22T08:53:04.491694+0000","last_active":"2023-12-22T08:53:06.145304+0000","last_peered":"2023-12-22T08:53:06.145304+0000","last_clean":"2023-12-22T08:53:06.145304+0000","last_became_active":"2023-12-22T08:53:04.491481+0000","last_became_peered":"2023-12-22T08:53:04.491481+0000","last_unstale":"2023-12-22T08:53:06.145304+0000","last_undegraded":"2023-12-22T08:53:06.145304+0000","last_fullsized":"2023-12-22T08:53:06.145304+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:51:03.123178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015506+0000","last_change":"2023-12-22T08:53:04.488894+0000","last_active":"2023-12-22T08:53:08.015506+0000","last_peered":"2023-12-22T08:53:08.015506+0000","last_clean":"2023-12-22T08:53:08.015506+0000","last_became_active":"2023-12-22T08:53:04.488661+0000","last_became_peered":"2023-12-22T08:53:04.488661+0000","last_unstale":"2023-12-22T08:53:08.015506+0000","last_undegraded":"2023-12-22T08:53:08.015506+0000","last_fullsized":"2023-12-22T08:53:08.015506+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:23:01.132204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015481+0000","last_change":"2023-12-22T08:53:04.507020+0000","last_active":"2023-12-22T08:53:08.015481+0000","last_peered":"2023-12-22T08:53:08.015481+0000","last_clean":"2023-12-22T08:53:08.015481+0000","last_became_active":"2023-12-22T08:53:04.505243+0000","last_became_peered":"2023-12-22T08:53:04.505243+0000","last_unstale":"2023-12-22T08:53:08.015481+0000","last_undegraded":"2023-12-22T08:53:08.015481+0000","last_fullsized":"2023-12-22T08:53:08.015481+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:50:10.521323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.488759+0000","last_change":"2023-12-22T08:53:04.506564+0000","last_active":"2023-12-22T08:53:05.488759+0000","last_peered":"2023-12-22T08:53:05.488759+0000","last_clean":"2023-12-22T08:53:05.488759+0000","last_became_active":"2023-12-22T08:53:04.505898+0000","last_became_peered":"2023-12-22T08:53:04.505898+0000","last_unstale":"2023-12-22T08:53:05.488759+0000","last_undegraded":"2023-12-22T08:53:05.488759+0000","last_fullsized":"2023-12-22T08:53:05.488759+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:34:50.910598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"189'4","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.494003+0000","last_change":"2023-12-22T08:53:03.980022+0000","last_active":"2023-12-22T08:53:04.494003+0000","last_peered":"2023-12-22T08:53:04.494003+0000","last_clean":"2023-12-22T08:53:04.494003+0000","last_became_active":"2023-12-22T08:53:03.978314+0000","last_became_peered":"2023-12-22T08:53:03.978314+0000","last_unstale":"2023-12-22T08:53:04.494003+0000","last_undegraded":"2023-12-22T08:53:04.494003+0000","last_fullsized":"2023-12-22T08:53:04.494003+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:56:19.161221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015074+0000","last_change":"2023-12-22T08:53:04.476765+0000","last_active":"2023-12-22T08:53:08.015074+0000","last_peered":"2023-12-22T08:53:08.015074+0000","last_clean":"2023-12-22T08:53:08.015074+0000","last_became_active":"2023-12-22T08:53:04.476473+0000","last_became_peered":"2023-12-22T08:53:04.476473+0000","last_unstale":"2023-12-22T08:53:08.015074+0000","last_undegraded":"2023-12-22T08:53:08.015074+0000","last_fullsized":"2023-12-22T08:53:08.015074+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:13.597102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.486294+0000","last_change":"2023-12-22T08:53:03.970342+0000","last_active":"2023-12-22T08:53:04.486294+0000","last_peered":"2023-12-22T08:53:04.486294+0000","last_clean":"2023-12-22T08:53:04.486294+0000","last_became_active":"2023-12-22T08:53:03.969697+0000","last_became_peered":"2023-12-22T08:53:03.969697+0000","last_unstale":"2023-12-22T08:53:04.486294+0000","last_undegraded":"2023-12-22T08:53:04.486294+0000","last_fullsized":"2023-12-22T08:53:04.486294+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:49.021917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.016051+0000","last_change":"2023-12-22T08:53:04.506195+0000","last_active":"2023-12-22T08:53:08.016051+0000","last_peered":"2023-12-22T08:53:08.016051+0000","last_clean":"2023-12-22T08:53:08.016051+0000","last_became_active":"2023-12-22T08:53:04.505877+0000","last_became_peered":"2023-12-22T08:53:04.505877+0000","last_unstale":"2023-12-22T08:53:08.016051+0000","last_undegraded":"2023-12-22T08:53:08.016051+0000","last_fullsized":"2023-12-22T08:53:08.016051+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:04:26.313796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.506851+0000","last_change":"2023-12-22T08:53:03.982442+0000","last_active":"2023-12-22T08:53:04.506851+0000","last_peered":"2023-12-22T08:53:04.506851+0000","last_clean":"2023-12-22T08:53:04.506851+0000","last_became_active":"2023-12-22T08:53:03.982146+0000","last_became_peered":"2023-12-22T08:53:03.982146+0000","last_unstale":"2023-12-22T08:53:04.506851+0000","last_undegraded":"2023-12-22T08:53:04.506851+0000","last_fullsized":"2023-12-22T08:53:04.506851+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:56:49.021917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.145471+0000","last_change":"2023-12-22T08:53:04.494265+0000","last_active":"2023-12-22T08:53:06.145471+0000","last_peered":"2023-12-22T08:53:06.145471+0000","last_clean":"2023-12-22T08:53:06.145471+0000","last_became_active":"2023-12-22T08:53:04.493850+0000","last_became_peered":"2023-12-22T08:53:04.493850+0000","last_unstale":"2023-12-22T08:53:06.145471+0000","last_undegraded":"2023-12-22T08:53:06.145471+0000","last_fullsized":"2023-12-22T08:53:06.145471+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:57:21.069519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.503054+0000","last_change":"2023-12-22T08:53:03.974738+0000","last_active":"2023-12-22T08:53:04.503054+0000","last_peered":"2023-12-22T08:53:04.503054+0000","last_clean":"2023-12-22T08:53:04.503054+0000","last_became_active":"2023-12-22T08:53:03.973356+0000","last_became_peered":"2023-12-22T08:53:03.973356+0000","last_unstale":"2023-12-22T08:53:04.503054+0000","last_undegraded":"2023-12-22T08:53:04.503054+0000","last_fullsized":"2023-12-22T08:53:04.503054+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:53:53.524420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.488281+0000","last_change":"2023-12-22T08:53:04.504527+0000","last_active":"2023-12-22T08:53:05.488281+0000","last_peered":"2023-12-22T08:53:05.488281+0000","last_clean":"2023-12-22T08:53:05.488281+0000","last_became_active":"2023-12-22T08:53:04.504004+0000","last_became_peered":"2023-12-22T08:53:04.504004+0000","last_unstale":"2023-12-22T08:53:05.488281+0000","last_undegraded":"2023-12-22T08:53:05.488281+0000","last_fullsized":"2023-12-22T08:53:05.488281+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:23:25.758708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.485494+0000","last_change":"2023-12-22T08:53:03.984475+0000","last_active":"2023-12-22T08:53:04.485494+0000","last_peered":"2023-12-22T08:53:04.485494+0000","last_clean":"2023-12-22T08:53:04.485494+0000","last_became_active":"2023-12-22T08:53:03.984233+0000","last_became_peered":"2023-12-22T08:53:03.984233+0000","last_unstale":"2023-12-22T08:53:04.485494+0000","last_undegraded":"2023-12-22T08:53:04.485494+0000","last_fullsized":"2023-12-22T08:53:04.485494+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:51.754987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015748+0000","last_change":"2023-12-22T08:53:04.507313+0000","last_active":"2023-12-22T08:53:08.015748+0000","last_peered":"2023-12-22T08:53:08.015748+0000","last_clean":"2023-12-22T08:53:08.015748+0000","last_became_active":"2023-12-22T08:53:04.505559+0000","last_became_peered":"2023-12-22T08:53:04.505559+0000","last_unstale":"2023-12-22T08:53:08.015748+0000","last_undegraded":"2023-12-22T08:53:08.015748+0000","last_fullsized":"2023-12-22T08:53:08.015748+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:57:21.069519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.504197+0000","last_change":"2023-12-22T08:53:03.988662+0000","last_active":"2023-12-22T08:53:04.504197+0000","last_peered":"2023-12-22T08:53:04.504197+0000","last_clean":"2023-12-22T08:53:04.504197+0000","last_became_active":"2023-12-22T08:53:03.988358+0000","last_became_peered":"2023-12-22T08:53:03.988358+0000","last_unstale":"2023-12-22T08:53:04.504197+0000","last_undegraded":"2023-12-22T08:53:04.504197+0000","last_fullsized":"2023-12-22T08:53:04.504197+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:59.943306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.485023+0000","last_change":"2023-12-22T08:53:04.502446+0000","last_active":"2023-12-22T08:53:05.485023+0000","last_peered":"2023-12-22T08:53:05.485023+0000","last_clean":"2023-12-22T08:53:05.485023+0000","last_became_active":"2023-12-22T08:53:04.500745+0000","last_became_peered":"2023-12-22T08:53:04.500745+0000","last_unstale":"2023-12-22T08:53:05.485023+0000","last_undegraded":"2023-12-22T08:53:05.485023+0000","last_fullsized":"2023-12-22T08:53:05.485023+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:11:42.467867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.471393+0000","last_change":"2023-12-22T08:53:03.985665+0000","last_active":"2023-12-22T08:53:04.471393+0000","last_peered":"2023-12-22T08:53:04.471393+0000","last_clean":"2023-12-22T08:53:04.471393+0000","last_became_active":"2023-12-22T08:53:03.985169+0000","last_became_peered":"2023-12-22T08:53:03.985169+0000","last_unstale":"2023-12-22T08:53:04.471393+0000","last_undegraded":"2023-12-22T08:53:04.471393+0000","last_fullsized":"2023-12-22T08:53:04.471393+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:04:28.070031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.489014+0000","last_change":"2023-12-22T08:53:04.506411+0000","last_active":"2023-12-22T08:53:05.489014+0000","last_peered":"2023-12-22T08:53:05.489014+0000","last_clean":"2023-12-22T08:53:05.489014+0000","last_became_active":"2023-12-22T08:53:04.505588+0000","last_became_peered":"2023-12-22T08:53:04.505588+0000","last_unstale":"2023-12-22T08:53:05.489014+0000","last_undegraded":"2023-12-22T08:53:05.489014+0000","last_fullsized":"2023-12-22T08:53:05.489014+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:13:12.906947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.474655+0000","last_change":"2023-12-22T08:53:03.967403+0000","last_active":"2023-12-22T08:53:04.474655+0000","last_peered":"2023-12-22T08:53:04.474655+0000","last_clean":"2023-12-22T08:53:04.474655+0000","last_became_active":"2023-12-22T08:53:03.966738+0000","last_became_peered":"2023-12-22T08:53:03.966738+0000","last_unstale":"2023-12-22T08:53:04.474655+0000","last_undegraded":"2023-12-22T08:53:04.474655+0000","last_fullsized":"2023-12-22T08:53:04.474655+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:33:10.086096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.486695+0000","last_change":"2023-12-22T08:53:04.500869+0000","last_active":"2023-12-22T08:53:05.486695+0000","last_peered":"2023-12-22T08:53:05.486695+0000","last_clean":"2023-12-22T08:53:05.486695+0000","last_became_active":"2023-12-22T08:53:04.500648+0000","last_became_peered":"2023-12-22T08:53:04.500648+0000","last_unstale":"2023-12-22T08:53:05.486695+0000","last_undegraded":"2023-12-22T08:53:05.486695+0000","last_fullsized":"2023-12-22T08:53:05.486695+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:28:06.680179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.491910+0000","last_change":"2023-12-22T08:53:03.988770+0000","last_active":"2023-12-22T08:53:04.491910+0000","last_peered":"2023-12-22T08:53:04.491910+0000","last_clean":"2023-12-22T08:53:04.491910+0000","last_became_active":"2023-12-22T08:53:03.988510+0000","last_became_peered":"2023-12-22T08:53:03.988510+0000","last_unstale":"2023-12-22T08:53:04.491910+0000","last_undegraded":"2023-12-22T08:53:04.491910+0000","last_fullsized":"2023-12-22T08:53:04.491910+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:15:41.337661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.484129+0000","last_change":"2023-12-22T08:53:04.494579+0000","last_active":"2023-12-22T08:53:05.484129+0000","last_peered":"2023-12-22T08:53:05.484129+0000","last_clean":"2023-12-22T08:53:05.484129+0000","last_became_active":"2023-12-22T08:53:04.494320+0000","last_became_peered":"2023-12-22T08:53:04.494320+0000","last_unstale":"2023-12-22T08:53:05.484129+0000","last_undegraded":"2023-12-22T08:53:05.484129+0000","last_fullsized":"2023-12-22T08:53:05.484129+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:02:43.017969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"189'3","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.505340+0000","last_change":"2023-12-22T08:53:03.985696+0000","last_active":"2023-12-22T08:53:04.505340+0000","last_peered":"2023-12-22T08:53:04.505340+0000","last_clean":"2023-12-22T08:53:04.505340+0000","last_became_active":"2023-12-22T08:53:03.985344+0000","last_became_peered":"2023-12-22T08:53:03.985344+0000","last_unstale":"2023-12-22T08:53:04.505340+0000","last_undegraded":"2023-12-22T08:53:04.505340+0000","last_fullsized":"2023-12-22T08:53:04.505340+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:37:36.464687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015312+0000","last_change":"2023-12-22T08:53:04.486364+0000","last_active":"2023-12-22T08:53:08.015312+0000","last_peered":"2023-12-22T08:53:08.015312+0000","last_clean":"2023-12-22T08:53:08.015312+0000","last_became_active":"2023-12-22T08:53:04.485943+0000","last_became_peered":"2023-12-22T08:53:04.485943+0000","last_unstale":"2023-12-22T08:53:08.015312+0000","last_undegraded":"2023-12-22T08:53:08.015312+0000","last_fullsized":"2023-12-22T08:53:08.015312+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:34:15.547023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"189'6","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.497571+0000","last_change":"2023-12-22T08:53:03.983653+0000","last_active":"2023-12-22T08:53:04.497571+0000","last_peered":"2023-12-22T08:53:04.497571+0000","last_clean":"2023-12-22T08:53:04.497571+0000","last_became_active":"2023-12-22T08:53:03.983226+0000","last_became_peered":"2023-12-22T08:53:03.983226+0000","last_unstale":"2023-12-22T08:53:04.497571+0000","last_undegraded":"2023-12-22T08:53:04.497571+0000","last_fullsized":"2023-12-22T08:53:04.497571+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:30:42.429204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.486929+0000","last_change":"2023-12-22T08:53:04.492395+0000","last_active":"2023-12-22T08:53:05.486929+0000","last_peered":"2023-12-22T08:53:05.486929+0000","last_clean":"2023-12-22T08:53:05.486929+0000","last_became_active":"2023-12-22T08:53:04.491054+0000","last_became_peered":"2023-12-22T08:53:04.491054+0000","last_unstale":"2023-12-22T08:53:05.486929+0000","last_undegraded":"2023-12-22T08:53:05.486929+0000","last_fullsized":"2023-12-22T08:53:05.486929+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:37:37.488510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.506518+0000","last_change":"2023-12-22T08:53:03.973860+0000","last_active":"2023-12-22T08:53:04.506518+0000","last_peered":"2023-12-22T08:53:04.506518+0000","last_clean":"2023-12-22T08:53:04.506518+0000","last_became_active":"2023-12-22T08:53:03.973263+0000","last_became_peered":"2023-12-22T08:53:03.973263+0000","last_unstale":"2023-12-22T08:53:04.506518+0000","last_undegraded":"2023-12-22T08:53:04.506518+0000","last_fullsized":"2023-12-22T08:53:04.506518+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:04:44.406516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.485267+0000","last_change":"2023-12-22T08:53:04.478485+0000","last_active":"2023-12-22T08:53:05.485267+0000","last_peered":"2023-12-22T08:53:05.485267+0000","last_clean":"2023-12-22T08:53:05.485267+0000","last_became_active":"2023-12-22T08:53:04.476999+0000","last_became_peered":"2023-12-22T08:53:04.476999+0000","last_unstale":"2023-12-22T08:53:05.485267+0000","last_undegraded":"2023-12-22T08:53:05.485267+0000","last_fullsized":"2023-12-22T08:53:05.485267+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:04:29.093854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.499442+0000","last_change":"2023-12-22T08:53:03.977844+0000","last_active":"2023-12-22T08:53:04.499442+0000","last_peered":"2023-12-22T08:53:04.499442+0000","last_clean":"2023-12-22T08:53:04.499442+0000","last_became_active":"2023-12-22T08:53:03.977499+0000","last_became_peered":"2023-12-22T08:53:03.977499+0000","last_unstale":"2023-12-22T08:53:04.499442+0000","last_undegraded":"2023-12-22T08:53:04.499442+0000","last_fullsized":"2023-12-22T08:53:04.499442+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:42:36.847387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015756+0000","last_change":"2023-12-22T08:53:04.502967+0000","last_active":"2023-12-22T08:53:08.015756+0000","last_peered":"2023-12-22T08:53:08.015756+0000","last_clean":"2023-12-22T08:53:08.015756+0000","last_became_active":"2023-12-22T08:53:04.501817+0000","last_became_peered":"2023-12-22T08:53:04.501817+0000","last_unstale":"2023-12-22T08:53:08.015756+0000","last_undegraded":"2023-12-22T08:53:08.015756+0000","last_fullsized":"2023-12-22T08:53:08.015756+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:40:31.348198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.496332+0000","last_change":"2023-12-22T08:53:03.972092+0000","last_active":"2023-12-22T08:53:04.496332+0000","last_peered":"2023-12-22T08:53:04.496332+0000","last_clean":"2023-12-22T08:53:04.496332+0000","last_became_active":"2023-12-22T08:53:03.971696+0000","last_became_peered":"2023-12-22T08:53:03.971696+0000","last_unstale":"2023-12-22T08:53:04.496332+0000","last_undegraded":"2023-12-22T08:53:04.496332+0000","last_fullsized":"2023-12-22T08:53:04.496332+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:50:09.497500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:06.144919+0000","last_change":"2023-12-22T08:53:04.502098+0000","last_active":"2023-12-22T08:53:06.144919+0000","last_peered":"2023-12-22T08:53:06.144919+0000","last_clean":"2023-12-22T08:53:06.144919+0000","last_became_active":"2023-12-22T08:53:04.501616+0000","last_became_peered":"2023-12-22T08:53:04.501616+0000","last_unstale":"2023-12-22T08:53:06.144919+0000","last_undegraded":"2023-12-22T08:53:06.144919+0000","last_fullsized":"2023-12-22T08:53:06.144919+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:45:30.644108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"189'8","reported_seq":19,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.493919+0000","last_change":"2023-12-22T08:53:03.984269+0000","last_active":"2023-12-22T08:53:04.493919+0000","last_peered":"2023-12-22T08:53:04.493919+0000","last_clean":"2023-12-22T08:53:04.493919+0000","last_became_active":"2023-12-22T08:53:03.983614+0000","last_became_peered":"2023-12-22T08:53:03.983614+0000","last_unstale":"2023-12-22T08:53:04.493919+0000","last_undegraded":"2023-12-22T08:53:04.493919+0000","last_fullsized":"2023-12-22T08:53:04.493919+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:08.997028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.487559+0000","last_change":"2023-12-22T08:53:04.502869+0000","last_active":"2023-12-22T08:53:05.487559+0000","last_peered":"2023-12-22T08:53:05.487559+0000","last_clean":"2023-12-22T08:53:05.487559+0000","last_became_active":"2023-12-22T08:53:04.502629+0000","last_became_peered":"2023-12-22T08:53:04.502629+0000","last_unstale":"2023-12-22T08:53:05.487559+0000","last_undegraded":"2023-12-22T08:53:05.487559+0000","last_fullsized":"2023-12-22T08:53:05.487559+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:00:31.962620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.493165+0000","last_change":"2023-12-22T08:53:03.983481+0000","last_active":"2023-12-22T08:53:04.493165+0000","last_peered":"2023-12-22T08:53:04.493165+0000","last_clean":"2023-12-22T08:53:04.493165+0000","last_became_active":"2023-12-22T08:53:03.982472+0000","last_became_peered":"2023-12-22T08:53:03.982472+0000","last_unstale":"2023-12-22T08:53:04.493165+0000","last_undegraded":"2023-12-22T08:53:04.493165+0000","last_fullsized":"2023-12-22T08:53:04.493165+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:28:00.906919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.489269+0000","last_change":"2023-12-22T08:53:04.495550+0000","last_active":"2023-12-22T08:53:05.489269+0000","last_peered":"2023-12-22T08:53:05.489269+0000","last_clean":"2023-12-22T08:53:05.489269+0000","last_became_active":"2023-12-22T08:53:04.488661+0000","last_became_peered":"2023-12-22T08:53:04.488661+0000","last_unstale":"2023-12-22T08:53:05.489269+0000","last_undegraded":"2023-12-22T08:53:05.489269+0000","last_fullsized":"2023-12-22T08:53:05.489269+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:39:24.730706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.499580+0000","last_change":"2023-12-22T08:53:03.978023+0000","last_active":"2023-12-22T08:53:04.499580+0000","last_peered":"2023-12-22T08:53:04.499580+0000","last_clean":"2023-12-22T08:53:04.499580+0000","last_became_active":"2023-12-22T08:53:03.977484+0000","last_became_peered":"2023-12-22T08:53:03.977484+0000","last_unstale":"2023-12-22T08:53:04.499580+0000","last_undegraded":"2023-12-22T08:53:04.499580+0000","last_fullsized":"2023-12-22T08:53:04.499580+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:42:36.847387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.489012+0000","last_change":"2023-12-22T08:53:04.499962+0000","last_active":"2023-12-22T08:53:05.489012+0000","last_peered":"2023-12-22T08:53:05.489012+0000","last_clean":"2023-12-22T08:53:05.489012+0000","last_became_active":"2023-12-22T08:53:04.499571+0000","last_became_peered":"2023-12-22T08:53:04.499571+0000","last_unstale":"2023-12-22T08:53:05.489012+0000","last_undegraded":"2023-12-22T08:53:05.489012+0000","last_fullsized":"2023-12-22T08:53:05.489012+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:59:57.353028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.491075+0000","last_change":"2023-12-22T08:53:03.985998+0000","last_active":"2023-12-22T08:53:04.491075+0000","last_peered":"2023-12-22T08:53:04.491075+0000","last_clean":"2023-12-22T08:53:04.491075+0000","last_became_active":"2023-12-22T08:53:03.985456+0000","last_became_peered":"2023-12-22T08:53:03.985456+0000","last_unstale":"2023-12-22T08:53:04.491075+0000","last_undegraded":"2023-12-22T08:53:04.491075+0000","last_fullsized":"2023-12-22T08:53:04.491075+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:02:35.293874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.484929+0000","last_change":"2023-12-22T08:53:04.478199+0000","last_active":"2023-12-22T08:53:05.484929+0000","last_peered":"2023-12-22T08:53:05.484929+0000","last_clean":"2023-12-22T08:53:05.484929+0000","last_became_active":"2023-12-22T08:53:04.477323+0000","last_became_peered":"2023-12-22T08:53:04.477323+0000","last_unstale":"2023-12-22T08:53:05.484929+0000","last_undegraded":"2023-12-22T08:53:05.484929+0000","last_fullsized":"2023-12-22T08:53:05.484929+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:32:27.840400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.474357+0000","last_change":"2023-12-22T08:53:03.973534+0000","last_active":"2023-12-22T08:53:04.474357+0000","last_peered":"2023-12-22T08:53:04.474357+0000","last_clean":"2023-12-22T08:53:04.474357+0000","last_became_active":"2023-12-22T08:53:03.971408+0000","last_became_peered":"2023-12-22T08:53:03.971408+0000","last_unstale":"2023-12-22T08:53:04.474357+0000","last_undegraded":"2023-12-22T08:53:04.474357+0000","last_fullsized":"2023-12-22T08:53:04.474357+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:03:07.276355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.014867+0000","last_change":"2023-12-22T08:53:04.494668+0000","last_active":"2023-12-22T08:53:08.014867+0000","last_peered":"2023-12-22T08:53:08.014867+0000","last_clean":"2023-12-22T08:53:08.014867+0000","last_became_active":"2023-12-22T08:53:04.494430+0000","last_became_peered":"2023-12-22T08:53:04.494430+0000","last_unstale":"2023-12-22T08:53:08.014867+0000","last_undegraded":"2023-12-22T08:53:08.014867+0000","last_fullsized":"2023-12-22T08:53:08.014867+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:03:08.300178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.505012+0000","last_change":"2023-12-22T08:53:03.964376+0000","last_active":"2023-12-22T08:53:04.505012+0000","last_peered":"2023-12-22T08:53:04.505012+0000","last_clean":"2023-12-22T08:53:04.505012+0000","last_became_active":"2023-12-22T08:53:03.963629+0000","last_became_peered":"2023-12-22T08:53:03.963629+0000","last_unstale":"2023-12-22T08:53:04.505012+0000","last_undegraded":"2023-12-22T08:53:04.505012+0000","last_fullsized":"2023-12-22T08:53:04.505012+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:55:01.991275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.487257+0000","last_change":"2023-12-22T08:53:04.488564+0000","last_active":"2023-12-22T08:53:05.487257+0000","last_peered":"2023-12-22T08:53:05.487257+0000","last_clean":"2023-12-22T08:53:05.487257+0000","last_became_active":"2023-12-22T08:53:04.487998+0000","last_became_peered":"2023-12-22T08:53:04.487998+0000","last_unstale":"2023-12-22T08:53:05.487257+0000","last_undegraded":"2023-12-22T08:53:05.487257+0000","last_fullsized":"2023-12-22T08:53:05.487257+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:08:52.778810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.474222+0000","last_change":"2023-12-22T08:53:03.977918+0000","last_active":"2023-12-22T08:53:04.474222+0000","last_peered":"2023-12-22T08:53:04.474222+0000","last_clean":"2023-12-22T08:53:04.474222+0000","last_became_active":"2023-12-22T08:53:03.977686+0000","last_became_peered":"2023-12-22T08:53:03.977686+0000","last_unstale":"2023-12-22T08:53:04.474222+0000","last_undegraded":"2023-12-22T08:53:04.474222+0000","last_fullsized":"2023-12-22T08:53:04.474222+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:29:44.552623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015742+0000","last_change":"2023-12-22T08:53:04.476189+0000","last_active":"2023-12-22T08:53:08.015742+0000","last_peered":"2023-12-22T08:53:08.015742+0000","last_clean":"2023-12-22T08:53:08.015742+0000","last_became_active":"2023-12-22T08:53:04.475588+0000","last_became_peered":"2023-12-22T08:53:04.475588+0000","last_unstale":"2023-12-22T08:53:08.015742+0000","last_undegraded":"2023-12-22T08:53:08.015742+0000","last_fullsized":"2023-12-22T08:53:08.015742+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:23.329652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.490165+0000","last_change":"2023-12-22T08:53:03.988676+0000","last_active":"2023-12-22T08:53:04.490165+0000","last_peered":"2023-12-22T08:53:04.490165+0000","last_clean":"2023-12-22T08:53:04.490165+0000","last_became_active":"2023-12-22T08:53:03.988231+0000","last_became_peered":"2023-12-22T08:53:03.988231+0000","last_unstale":"2023-12-22T08:53:04.490165+0000","last_undegraded":"2023-12-22T08:53:04.490165+0000","last_fullsized":"2023-12-22T08:53:04.490165+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:58:58.406886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.487759+0000","last_change":"2023-12-22T08:53:04.495882+0000","last_active":"2023-12-22T08:53:05.487759+0000","last_peered":"2023-12-22T08:53:05.487759+0000","last_clean":"2023-12-22T08:53:05.487759+0000","last_became_active":"2023-12-22T08:53:04.495333+0000","last_became_peered":"2023-12-22T08:53:04.495333+0000","last_unstale":"2023-12-22T08:53:05.487759+0000","last_undegraded":"2023-12-22T08:53:05.487759+0000","last_fullsized":"2023-12-22T08:53:05.487759+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:22:22.225863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.474714+0000","last_change":"2023-12-22T08:53:03.972851+0000","last_active":"2023-12-22T08:53:04.474714+0000","last_peered":"2023-12-22T08:53:04.474714+0000","last_clean":"2023-12-22T08:53:04.474714+0000","last_became_active":"2023-12-22T08:53:03.972343+0000","last_became_peered":"2023-12-22T08:53:03.972343+0000","last_unstale":"2023-12-22T08:53:04.474714+0000","last_undegraded":"2023-12-22T08:53:04.474714+0000","last_fullsized":"2023-12-22T08:53:04.474714+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:24:22.305829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.487501+0000","last_change":"2023-12-22T08:53:04.502967+0000","last_active":"2023-12-22T08:53:05.487501+0000","last_peered":"2023-12-22T08:53:05.487501+0000","last_clean":"2023-12-22T08:53:05.487501+0000","last_became_active":"2023-12-22T08:53:04.502625+0000","last_became_peered":"2023-12-22T08:53:04.502625+0000","last_unstale":"2023-12-22T08:53:05.487501+0000","last_undegraded":"2023-12-22T08:53:05.487501+0000","last_fullsized":"2023-12-22T08:53:05.487501+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:22:22.225863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.506179+0000","last_change":"2023-12-22T08:53:03.979033+0000","last_active":"2023-12-22T08:53:04.506179+0000","last_peered":"2023-12-22T08:53:04.506179+0000","last_clean":"2023-12-22T08:53:04.506179+0000","last_became_active":"2023-12-22T08:53:03.978666+0000","last_became_peered":"2023-12-22T08:53:03.978666+0000","last_unstale":"2023-12-22T08:53:04.506179+0000","last_undegraded":"2023-12-22T08:53:04.506179+0000","last_fullsized":"2023-12-22T08:53:04.506179+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:39:10.007236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.488690+0000","last_change":"2023-12-22T08:53:04.492842+0000","last_active":"2023-12-22T08:53:05.488690+0000","last_peered":"2023-12-22T08:53:05.488690+0000","last_clean":"2023-12-22T08:53:05.488690+0000","last_became_active":"2023-12-22T08:53:04.492503+0000","last_became_peered":"2023-12-22T08:53:04.492503+0000","last_unstale":"2023-12-22T08:53:05.488690+0000","last_undegraded":"2023-12-22T08:53:05.488690+0000","last_fullsized":"2023-12-22T08:53:05.488690+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:44:08.516182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.474880+0000","last_change":"2023-12-22T08:53:03.983723+0000","last_active":"2023-12-22T08:53:04.474880+0000","last_peered":"2023-12-22T08:53:04.474880+0000","last_clean":"2023-12-22T08:53:04.474880+0000","last_became_active":"2023-12-22T08:53:03.983486+0000","last_became_peered":"2023-12-22T08:53:03.983486+0000","last_unstale":"2023-12-22T08:53:04.474880+0000","last_undegraded":"2023-12-22T08:53:04.474880+0000","last_fullsized":"2023-12-22T08:53:04.474880+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:37:12.573279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.488515+0000","last_change":"2023-12-22T08:53:04.496603+0000","last_active":"2023-12-22T08:53:05.488515+0000","last_peered":"2023-12-22T08:53:05.488515+0000","last_clean":"2023-12-22T08:53:05.488515+0000","last_became_active":"2023-12-22T08:53:04.496242+0000","last_became_peered":"2023-12-22T08:53:04.496242+0000","last_unstale":"2023-12-22T08:53:05.488515+0000","last_undegraded":"2023-12-22T08:53:05.488515+0000","last_fullsized":"2023-12-22T08:53:05.488515+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:48:23.020493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.471069+0000","last_change":"2023-12-22T08:53:03.986800+0000","last_active":"2023-12-22T08:53:04.471069+0000","last_peered":"2023-12-22T08:53:04.471069+0000","last_clean":"2023-12-22T08:53:04.471069+0000","last_became_active":"2023-12-22T08:53:03.986566+0000","last_became_peered":"2023-12-22T08:53:03.986566+0000","last_unstale":"2023-12-22T08:53:04.471069+0000","last_undegraded":"2023-12-22T08:53:04.471069+0000","last_fullsized":"2023-12-22T08:53:04.471069+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:28:05.656356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.489563+0000","last_change":"2023-12-22T08:53:04.496281+0000","last_active":"2023-12-22T08:53:05.489563+0000","last_peered":"2023-12-22T08:53:05.489563+0000","last_clean":"2023-12-22T08:53:05.489563+0000","last_became_active":"2023-12-22T08:53:04.492596+0000","last_became_peered":"2023-12-22T08:53:04.492596+0000","last_unstale":"2023-12-22T08:53:05.489563+0000","last_undegraded":"2023-12-22T08:53:05.489563+0000","last_fullsized":"2023-12-22T08:53:05.489563+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:43:54.623048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.474902+0000","last_change":"2023-12-22T08:53:03.964888+0000","last_active":"2023-12-22T08:53:04.474902+0000","last_peered":"2023-12-22T08:53:04.474902+0000","last_clean":"2023-12-22T08:53:04.474902+0000","last_became_active":"2023-12-22T08:53:03.964278+0000","last_became_peered":"2023-12-22T08:53:03.964278+0000","last_unstale":"2023-12-22T08:53:04.474902+0000","last_undegraded":"2023-12-22T08:53:04.474902+0000","last_fullsized":"2023-12-22T08:53:04.474902+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:28:04.088914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015921+0000","last_change":"2023-12-22T08:53:04.507477+0000","last_active":"2023-12-22T08:53:08.015921+0000","last_peered":"2023-12-22T08:53:08.015921+0000","last_clean":"2023-12-22T08:53:08.015921+0000","last_became_active":"2023-12-22T08:53:04.505847+0000","last_became_peered":"2023-12-22T08:53:04.505847+0000","last_unstale":"2023-12-22T08:53:08.015921+0000","last_undegraded":"2023-12-22T08:53:08.015921+0000","last_fullsized":"2023-12-22T08:53:08.015921+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:45:30.644108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.484855+0000","last_change":"2023-12-22T08:53:03.985799+0000","last_active":"2023-12-22T08:53:04.484855+0000","last_peered":"2023-12-22T08:53:04.484855+0000","last_clean":"2023-12-22T08:53:04.484855+0000","last_became_active":"2023-12-22T08:53:03.985026+0000","last_became_peered":"2023-12-22T08:53:03.985026+0000","last_unstale":"2023-12-22T08:53:04.484855+0000","last_undegraded":"2023-12-22T08:53:04.484855+0000","last_fullsized":"2023-12-22T08:53:04.484855+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:32:19.479817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015962+0000","last_change":"2023-12-22T08:53:04.491057+0000","last_active":"2023-12-22T08:53:08.015962+0000","last_peered":"2023-12-22T08:53:08.015962+0000","last_clean":"2023-12-22T08:53:08.015962+0000","last_became_active":"2023-12-22T08:53:04.490813+0000","last_became_peered":"2023-12-22T08:53:04.490813+0000","last_unstale":"2023-12-22T08:53:08.015962+0000","last_undegraded":"2023-12-22T08:53:08.015962+0000","last_fullsized":"2023-12-22T08:53:08.015962+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:48.612334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.496460+0000","last_change":"2023-12-22T08:53:03.964773+0000","last_active":"2023-12-22T08:53:04.496460+0000","last_peered":"2023-12-22T08:53:04.496460+0000","last_clean":"2023-12-22T08:53:04.496460+0000","last_became_active":"2023-12-22T08:53:03.964190+0000","last_became_peered":"2023-12-22T08:53:03.964190+0000","last_unstale":"2023-12-22T08:53:04.496460+0000","last_undegraded":"2023-12-22T08:53:04.496460+0000","last_fullsized":"2023-12-22T08:53:04.496460+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:57:20.045696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.484366+0000","last_change":"2023-12-22T08:53:04.489992+0000","last_active":"2023-12-22T08:53:05.484366+0000","last_peered":"2023-12-22T08:53:05.484366+0000","last_clean":"2023-12-22T08:53:05.484366+0000","last_became_active":"2023-12-22T08:53:04.489327+0000","last_became_peered":"2023-12-22T08:53:04.489327+0000","last_unstale":"2023-12-22T08:53:05.484366+0000","last_undegraded":"2023-12-22T08:53:05.484366+0000","last_fullsized":"2023-12-22T08:53:05.484366+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:36:57.213715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.472025+0000","last_change":"2023-12-22T08:53:03.980320+0000","last_active":"2023-12-22T08:53:04.472025+0000","last_peered":"2023-12-22T08:53:04.472025+0000","last_clean":"2023-12-22T08:53:04.472025+0000","last_became_active":"2023-12-22T08:53:03.979641+0000","last_became_peered":"2023-12-22T08:53:03.979641+0000","last_unstale":"2023-12-22T08:53:04.472025+0000","last_undegraded":"2023-12-22T08:53:04.472025+0000","last_fullsized":"2023-12-22T08:53:04.472025+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:02:41.994146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:08.015907+0000","last_change":"2023-12-22T08:53:04.499863+0000","last_active":"2023-12-22T08:53:08.015907+0000","last_peered":"2023-12-22T08:53:08.015907+0000","last_clean":"2023-12-22T08:53:08.015907+0000","last_became_active":"2023-12-22T08:53:04.499619+0000","last_became_peered":"2023-12-22T08:53:04.499619+0000","last_unstale":"2023-12-22T08:53:08.015907+0000","last_undegraded":"2023-12-22T08:53:08.015907+0000","last_fullsized":"2023-12-22T08:53:08.015907+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:27:46.503292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.471238+0000","last_change":"2023-12-22T08:53:03.980627+0000","last_active":"2023-12-22T08:53:04.471238+0000","last_peered":"2023-12-22T08:53:04.471238+0000","last_clean":"2023-12-22T08:53:04.471238+0000","last_became_active":"2023-12-22T08:53:03.980375+0000","last_became_peered":"2023-12-22T08:53:03.980375+0000","last_unstale":"2023-12-22T08:53:04.471238+0000","last_undegraded":"2023-12-22T08:53:04.471238+0000","last_fullsized":"2023-12-22T08:53:04.471238+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:22:21.202040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-22T08:53:05.485351+0000","last_change":"2023-12-22T08:53:04.503260+0000","last_active":"2023-12-22T08:53:05.485351+0000","last_peered":"2023-12-22T08:53:05.485351+0000","last_clean":"2023-12-22T08:53:05.485351+0000","last_became_active":"2023-12-22T08:53:04.502696+0000","last_became_peered":"2023-12-22T08:53:04.502696+0000","last_unstale":"2023-12-22T08:53:05.485351+0000","last_undegraded":"2023-12-22T08:53:05.485351+0000","last_fullsized":"2023-12-22T08:53:05.485351+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:03.941944+0000","last_clean_scrub_stamp":"2023-12-22T08:53:03.941944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:50:05.891865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.483988+0000","last_change":"2023-12-22T08:53:03.983109+0000","last_active":"2023-12-22T08:53:04.483988+0000","last_peered":"2023-12-22T08:53:04.483988+0000","last_clean":"2023-12-22T08:53:04.483988+0000","last_became_active":"2023-12-22T08:53:03.982844+0000","last_became_peered":"2023-12-22T08:53:03.982844+0000","last_unstale":"2023-12-22T08:53:04.483988+0000","last_undegraded":"2023-12-22T08:53:04.483988+0000","last_fullsized":"2023-12-22T08:53:04.483988+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:53:02.918121+0000","last_clean_scrub_stamp":"2023-12-22T08:53:02.918121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:23:16.455112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":317,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-22T08:53:04.483518+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:53:04.483518+0000","last_peered":"2023-12-22T08:53:04.483518+0000","last_clean":"2023-12-22T08:53:04.483518+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:53:04.483518+0000","last_undegraded":"2023-12-22T08:53:04.483518+0000","last_fullsized":"2023-12-22T08:53:04.483518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1037,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194275,"statfs":{"total":200000000,"available":198937874,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1020000000000001,"15min":1.0920000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.58199999999999996},"max":{"1min":1.8069999999999999,"5min":1.8700000000000001,"15min":2.0249999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.0940000000000001,"15min":1.0920000000000001},"min":{"1min":0.72399999999999998,"5min":0.71299999999999997,"15min":0.70099999999999996},"max":{"1min":1.524,"5min":1.6499999999999999,"15min":1.6819999999999999},"last":0.71799999999999997}]},{"osd":1,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.254,"15min":1.202},"min":{"1min":0.95399999999999996,"5min":0.70899999999999996,"15min":0.64200000000000002},"max":{"1min":1.613,"5min":1.6779999999999999,"15min":1.905},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.262,"15min":1.216},"min":{"1min":0.85899999999999999,"5min":0.78800000000000003,"15min":0.67100000000000004},"max":{"1min":1.758,"5min":1.758,"15min":1.865},"last":0.83399999999999996}]},{"osd":2,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.1930000000000001,"15min":1.139},"min":{"1min":0.90100000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.538,"5min":1.74,"15min":2.0150000000000001},"last":1.395},{"interface":"front","average":{"1min":1.202,"5min":1.238,"15min":1.2230000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.68700000000000006},"max":{"1min":1.6759999999999999,"5min":1.79,"15min":2.1379999999999999},"last":0.86599999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.25,"15min":1.1919999999999999},"min":{"1min":0.89300000000000002,"5min":0.875,"15min":0.71399999999999997},"max":{"1min":1.766,"5min":1.766,"15min":2.0680000000000001},"last":1.296},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.319,"15min":1.3069999999999999},"min":{"1min":0.86699999999999999,"5min":0.77700000000000002,"15min":0.71799999999999997},"max":{"1min":1.488,"5min":1.873,"15min":2.2959999999999998},"last":1.0089999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.194,"15min":1.1990000000000001},"min":{"1min":0.875,"5min":0.53400000000000003,"15min":0.48699999999999999},"max":{"1min":1.639,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.28,"5min":1.2929999999999999,"15min":1.274},"min":{"1min":0.90800000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.857,"5min":1.899,"15min":2.2749999999999999},"last":1.478}]},{"osd":5,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.319,"15min":1.359},"min":{"1min":0.96199999999999997,"5min":0.60699999999999998,"15min":0.51800000000000002},"max":{"1min":1.5529999999999999,"5min":1.9530000000000001,"15min":2.4300000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.331,"15min":1.3600000000000001},"min":{"1min":1.016,"5min":0.623,"15min":0.623},"max":{"1min":1.5860000000000001,"5min":2.2480000000000002,"15min":2.3410000000000002},"last":1.359}]},{"osd":6,"last update":"Fri Dec 22 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.506,"15min":1.498},"min":{"1min":1.1279999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.873,"5min":2.355,"15min":2.355},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.486,"15min":1.486},"min":{"1min":1.038,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.956,"5min":1.968,"15min":2.4849999999999999},"last":1.5349999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575010,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1043,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194269,"statfs":{"total":200000000,"available":198931540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.4279999999999999,"15min":1.2270000000000001},"min":{"1min":0.77100000000000002,"5min":0.61899999999999999,"15min":0.42099999999999999},"max":{"1min":1.4670000000000001,"5min":28.361000000000001,"15min":28.361000000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.1950000000000001,"15min":1.145},"min":{"1min":0.80900000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.5149999999999999,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.94999999999999996}]},{"osd":1,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0920000000000001,"15min":1.079},"min":{"1min":0.78100000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.472,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.877},{"interface":"front","average":{"1min":1.157,"5min":1.393,"15min":1.244},"min":{"1min":0.78100000000000003,"5min":0.74299999999999999,"15min":0.63100000000000001},"max":{"1min":1.6120000000000001,"5min":15.324999999999999,"15min":15.324999999999999},"last":1.234}]},{"osd":2,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3740000000000001,"15min":1.2989999999999999},"min":{"1min":0.998,"5min":0.69699999999999995,"15min":0.65700000000000003},"max":{"1min":1.9259999999999999,"5min":15.422000000000001,"15min":15.422000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.3400000000000001,"15min":1.2450000000000001},"min":{"1min":0.90500000000000003,"5min":0.81100000000000005,"15min":0.58599999999999997},"max":{"1min":1.5800000000000001,"5min":10.173999999999999,"15min":10.173999999999999},"last":1.0800000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.403,"15min":1.3380000000000001},"min":{"1min":0.95199999999999996,"5min":0.877,"15min":0.72899999999999998},"max":{"1min":1.671,"5min":10.096,"15min":10.096},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.2749999999999999,"15min":1.254},"min":{"1min":0.83199999999999996,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6200000000000001,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.29}]},{"osd":4,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.3999999999999999,"15min":1.381},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.52000000000000002},"max":{"1min":1.7370000000000001,"5min":15.378,"15min":15.378},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4710000000000001,"15min":1.419},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.68999999999999995},"max":{"1min":1.7470000000000001,"5min":13.178000000000001,"15min":13.178000000000001},"last":1.3480000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.431,"15min":1.367},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.651,"5min":19.995000000000001,"15min":19.995000000000001},"last":1.413},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.581,"15min":1.552},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.67600000000000005},"max":{"1min":2.1989999999999998,"5min":15.679,"15min":15.679},"last":1.819}]},{"osd":7,"last update":"Fri Dec 22 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.474,"15min":1.528},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8320000000000001,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.452,"5min":1.478,"15min":1.4930000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.972,"5min":4.6609999999999996,"15min":4.6609999999999996},"last":1.496}]}]},{"osd":5,"up_from":13,"seq":55834575010,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1619,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193692,"statfs":{"total":200000000,"available":198341553,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.119,"15min":1.095},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.944},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.129,"15min":1.1240000000000001},"min":{"1min":0.78300000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":3.1379999999999999},"last":1.216}]},{"osd":1,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.1870000000000001,"15min":1.1399999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.603,"5min":2.3319999999999999,"15min":2.79},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1759999999999999,"15min":1.0980000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7509999999999999},"last":1.1870000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1839999999999999,"15min":1.157},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6399999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2869999999999999,"15min":1.2250000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.74299999999999999},"max":{"1min":1.6950000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.3799999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.26,"15min":1.2190000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.587,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.431},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3089999999999999,"15min":1.282},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.875,"5min":1.875,"15min":2.1499999999999999},"last":1.3300000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2529999999999999,"15min":1.2569999999999999},"min":{"1min":0.67000000000000004,"5min":0.60699999999999998,"15min":0.57899999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.853},"last":1.472},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2869999999999999,"15min":1.27},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.58399999999999996},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.0680000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3260000000000001,"15min":1.329},"min":{"1min":0.55300000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.792,"5min":1.792,"15min":1.821},"last":1.504},{"interface":"front","average":{"1min":1.462,"5min":1.421,"15min":1.4179999999999999},"min":{"1min":0.70799999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.952,"5min":1.952,"15min":2.8780000000000001},"last":1.2709999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4079999999999999,"15min":1.4019999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.72499999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.2189999999999999},"last":1.552},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.458,"15min":1.5089999999999999},"min":{"1min":0.68300000000000005,"5min":0.629,"15min":0.629},"max":{"1min":2.056,"5min":2.056,"15min":4.7249999999999996},"last":1.6259999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1043,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194269,"statfs":{"total":200000000,"available":198931540,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.1379999999999999,"15min":1.0529999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.504,"5min":6.4969999999999999,"15min":6.4969999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.143,"15min":1.125},"min":{"1min":0.74299999999999999,"5min":0.66000000000000003,"15min":0.58199999999999996},"max":{"1min":1.7869999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.1579999999999999,"15min":1.101},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.54100000000000004},"max":{"1min":1.639,"5min":6.2999999999999998,"15min":6.2999999999999998},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.3280000000000001,"15min":1.181},"min":{"1min":0.81299999999999994,"5min":0.78100000000000003,"15min":0.57399999999999995},"max":{"1min":1.4910000000000001,"5min":17.562999999999999,"15min":17.562999999999999},"last":0.97299999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.266,"15min":1.1919999999999999},"min":{"1min":0.86799999999999999,"5min":0.755,"15min":0.65700000000000003},"max":{"1min":1.464,"5min":9.0329999999999995,"15min":9.0329999999999995},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.155,"5min":1.3009999999999999,"15min":1.244},"min":{"1min":0.82899999999999996,"5min":0.748,"15min":0.748},"max":{"1min":1.371,"5min":8.2029999999999994,"15min":8.2029999999999994},"last":1.1819999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.3560000000000001,"15min":1.2569999999999999},"min":{"1min":0.92600000000000005,"5min":0.86299999999999999,"15min":0.68500000000000005},"max":{"1min":1.9890000000000001,"5min":8.8160000000000007,"15min":8.8160000000000007},"last":1.03},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.371,"15min":1.298},"min":{"1min":0.86199999999999999,"5min":0.82299999999999995,"15min":0.82099999999999995},"max":{"1min":1.8129999999999999,"5min":10.157999999999999,"15min":10.157999999999999},"last":1.512}]},{"osd":5,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.2629999999999999,"15min":1.1950000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.52400000000000002},"max":{"1min":1.7450000000000001,"5min":7.056,"15min":7.056},"last":1.073},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.5129999999999999,"15min":1.4379999999999999},"min":{"1min":1.1879999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.867,"5min":9.0700000000000003,"15min":9.0700000000000003},"last":1.3129999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3720000000000001,"15min":1.3120000000000001},"min":{"1min":0.80700000000000005,"5min":0.62,"15min":0.58599999999999997},"max":{"1min":1.6950000000000001,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3680000000000001,"15min":1.29},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.59199999999999997},"max":{"1min":1.9379999999999999,"5min":5.2089999999999996,"15min":5.2089999999999996},"last":1.1619999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:52:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.496,"15min":1.4259999999999999},"min":{"1min":1.2110000000000001,"5min":0.70199999999999996,"15min":0.67300000000000004},"max":{"1min":2.1040000000000001,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.5740000000000001,"15min":1.5029999999999999},"min":{"1min":1.0229999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.8919999999999999,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.5669999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1044,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194267,"statfs":{"total":200000000,"available":198929988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90500000000000003,"15min":0.91500000000000004},"min":{"1min":0.70599999999999996,"5min":0.48499999999999999,"15min":0.39800000000000002},"max":{"1min":1.2609999999999999,"5min":1.4770000000000001,"15min":1.8340000000000001},"last":1.056},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.98299999999999998,"15min":0.94799999999999995},"min":{"1min":0.68500000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5249999999999999,"5min":1.5369999999999999,"15min":2.5270000000000001},"last":0.72899999999999998}]},{"osd":1,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.99399999999999999,"15min":0.91400000000000003},"min":{"1min":0.73599999999999999,"5min":0.44800000000000001,"15min":0.34499999999999997},"max":{"1min":1.556,"5min":1.772,"15min":1.772},"last":0.755},{"interface":"front","average":{"1min":1.242,"5min":1.236,"15min":1.175},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.46200000000000002},"max":{"1min":1.825,"5min":1.825,"15min":1.861},"last":1.5900000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1259999999999999,"15min":1.071},"min":{"1min":0.83199999999999996,"5min":0.56699999999999995,"15min":0.41899999999999998},"max":{"1min":1.5309999999999999,"5min":1.659,"15min":1.7350000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.222,"5min":1.1739999999999999,"15min":1.155},"min":{"1min":0.69799999999999995,"5min":0.55000000000000004,"15min":0.45100000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.9570000000000001},"last":1.4910000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.216,"15min":1.226},"min":{"1min":0.94999999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.671,"5min":1.6870000000000001,"15min":2.7210000000000001},"last":1.127},{"interface":"front","average":{"1min":1.456,"5min":1.345,"15min":1.29},"min":{"1min":1.129,"5min":0.873,"15min":0.745},"max":{"1min":1.7509999999999999,"5min":1.9850000000000001,"15min":2.3999999999999999},"last":1.4550000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.4199999999999999,"15min":1.343},"min":{"1min":1.153,"5min":0.81899999999999995,"15min":0.66700000000000004},"max":{"1min":1.9119999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.339},{"interface":"front","average":{"1min":1.506,"5min":1.379,"15min":1.3999999999999999},"min":{"1min":1.236,"5min":0.78600000000000003,"15min":0.73699999999999999},"max":{"1min":1.9139999999999999,"5min":2.2629999999999999,"15min":2.3839999999999999},"last":1.762}]},{"osd":6,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.4710000000000001,"15min":1.4550000000000001},"min":{"1min":1.1839999999999999,"5min":1.008,"15min":0.88100000000000001},"max":{"1min":1.7729999999999999,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.677},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.3720000000000001,"15min":1.379},"min":{"1min":1.079,"5min":0.83799999999999997,"15min":0.75900000000000001},"max":{"1min":1.6919999999999999,"5min":1.968,"15min":2.8250000000000002},"last":0.99199999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.444,"15min":1.413},"min":{"1min":1.181,"5min":0.81100000000000005,"15min":0.77100000000000002},"max":{"1min":1.8660000000000001,"5min":2.056,"15min":2.7850000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.633,"5min":1.508,"15min":1.446},"min":{"1min":1.296,"5min":0.96599999999999997,"15min":0.80600000000000005},"max":{"1min":1.99,"5min":2.2290000000000001,"15min":2.3740000000000001},"last":1.234}]}]},{"osd":2,"up_from":13,"seq":55834575010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1043,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194268,"statfs":{"total":200000000,"available":198930992,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.86899999999999999,"15min":0.84899999999999998},"min":{"1min":0.71599999999999997,"5min":0.40000000000000002,"15min":0.32000000000000001},"max":{"1min":1.54,"5min":1.8340000000000001,"15min":6.8879999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.94899999999999995,"15min":0.94299999999999995},"min":{"1min":0.58099999999999996,"5min":0.376,"15min":0.35799999999999998},"max":{"1min":1.3700000000000001,"5min":1.7589999999999999,"15min":4.5510000000000002},"last":0.92800000000000005}]},{"osd":1,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.92700000000000005,"15min":0.94999999999999996},"min":{"1min":0.65000000000000002,"5min":0.38300000000000001,"15min":0.34000000000000002},"max":{"1min":1.232,"5min":1.702,"15min":11.308999999999999},"last":1.006},{"interface":"front","average":{"1min":1.169,"5min":1.105,"15min":1.032},"min":{"1min":0.80700000000000005,"5min":0.51000000000000001,"15min":0.44600000000000001},"max":{"1min":1.738,"5min":1.738,"15min":2.9889999999999999},"last":1.2090000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1539999999999999,"15min":1.1200000000000001},"min":{"1min":0.68000000000000005,"5min":0.55000000000000004,"15min":0.41099999999999998},"max":{"1min":1.581,"5min":1.772,"15min":13.087999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.234,"15min":1.21},"min":{"1min":0.91500000000000004,"5min":0.55200000000000005,"15min":0.52300000000000002},"max":{"1min":1.512,"5min":2.0720000000000001,"15min":12.289999999999999},"last":1.3580000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.359,"15min":1.3280000000000001},"min":{"1min":1.0820000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.7470000000000001,"5min":1.9319999999999999,"15min":3.5249999999999999},"last":1.532},{"interface":"front","average":{"1min":1.355,"5min":1.286,"15min":1.3380000000000001},"min":{"1min":0.89900000000000002,"5min":0.71599999999999997,"15min":0.61499999999999999},"max":{"1min":1.8999999999999999,"5min":2.0539999999999998,"15min":13.927},"last":1.4039999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3600000000000001,"15min":1.3740000000000001},"min":{"1min":0.83999999999999997,"5min":0.70299999999999996,"15min":0.64000000000000001},"max":{"1min":1.871,"5min":1.9750000000000001,"15min":11.003},"last":1.296},{"interface":"front","average":{"1min":1.353,"5min":1.349,"15min":1.3360000000000001},"min":{"1min":0.86599999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.6579999999999999,"5min":1.9370000000000001,"15min":13.129},"last":1.4470000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.401,"15min":1.3620000000000001},"min":{"1min":1.0409999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.724,"5min":1.9810000000000001,"15min":8.1609999999999996},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.526,"5min":1.486,"15min":1.4490000000000001},"min":{"1min":1.1339999999999999,"5min":0.89900000000000002,"15min":0.69999999999999996},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":6.8150000000000004},"last":1.6539999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:52:21 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.417,"15min":1.421},"min":{"1min":0.98899999999999999,"5min":0.76200000000000001,"15min":0.61299999999999999},"max":{"1min":2.1309999999999998,"5min":2.1440000000000001,"15min":10.948},"last":1.079},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.486,"15min":1.478},"min":{"1min":0.95899999999999996,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8009999999999999,"5min":2.254,"15min":9.0239999999999991},"last":1.5860000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1615,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193697,"statfs":{"total":200000000,"available":198345760,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.1100000000000001,"15min":0.98199999999999998},"min":{"1min":0.54800000000000004,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":1.3149999999999999,"5min":23.059000000000001,"15min":23.059000000000001},"last":2.5680000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1819999999999999,"15min":1.113},"min":{"1min":0.83099999999999996,"5min":0.41099999999999998,"15min":0.39900000000000002},"max":{"1min":1.625,"5min":9.9749999999999996,"15min":9.9749999999999996},"last":1.2649999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.2130000000000001,"15min":1.0449999999999999},"min":{"1min":0.67800000000000005,"5min":0.46200000000000002,"15min":0.45500000000000002},"max":{"1min":1.274,"5min":22.977,"15min":22.977},"last":7.9880000000000004},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.038,"15min":1.0069999999999999},"min":{"1min":0.876,"5min":0.35899999999999999,"15min":0.34999999999999998},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":2.254},"last":9.4440000000000008}]},{"osd":3,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.351,"15min":1.272},"min":{"1min":0.76300000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.7569999999999999,"5min":1.9770000000000001,"15min":2.5169999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.125,"5min":1.107,"15min":1.0409999999999999},"min":{"1min":0.58699999999999997,"5min":0.53400000000000003,"15min":0.47799999999999998},"max":{"1min":1.6479999999999999,"5min":1.8480000000000001,"15min":2.6760000000000002},"last":5.3470000000000004}]},{"osd":4,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.5109999999999999,"15min":1.357},"min":{"1min":1.103,"5min":0.73999999999999999,"15min":0.58699999999999997},"max":{"1min":1.5700000000000001,"5min":23.145,"15min":23.145},"last":2.7069999999999999},{"interface":"front","average":{"1min":1.54,"5min":1.536,"15min":1.4279999999999999},"min":{"1min":1.1899999999999999,"5min":0.747,"15min":0.747},"max":{"1min":1.9570000000000001,"5min":9.9299999999999997,"15min":9.9299999999999997},"last":0.997}]},{"osd":5,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3029999999999999,"15min":1.2709999999999999},"min":{"1min":1.091,"5min":0.77700000000000002,"15min":0.58699999999999997},"max":{"1min":1.9790000000000001,"5min":2.8109999999999999,"15min":4.6399999999999997},"last":3.2799999999999998},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.5920000000000001,"15min":1.4430000000000001},"min":{"1min":1.0449999999999999,"5min":0.71699999999999997,"15min":0.66800000000000004},"max":{"1min":1.8360000000000001,"5min":23.105,"15min":23.105},"last":2.758}]},{"osd":6,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.3839999999999999,"15min":1.3280000000000001},"min":{"1min":1.0780000000000001,"5min":0.82199999999999995,"15min":0.65200000000000002},"max":{"1min":2.1139999999999999,"5min":2.71,"15min":4.5819999999999999},"last":3.3380000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.708,"15min":1.5069999999999999},"min":{"1min":0.97499999999999998,"5min":0.80300000000000005,"15min":0.67200000000000004},"max":{"1min":1.9450000000000001,"5min":24.341999999999999,"15min":24.341999999999999},"last":2.657}]},{"osd":7,"last update":"Fri Dec 22 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.4399999999999999,"15min":1.429},"min":{"1min":1.091,"5min":0.78800000000000003,"15min":0.64400000000000002},"max":{"1min":1.923,"5min":2.0870000000000002,"15min":2.4889999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.4510000000000001,"15min":1.4359999999999999},"min":{"1min":0.97899999999999998,"5min":0.76800000000000002,"15min":0.66200000000000003},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":4.508},"last":3.4140000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575010,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1043,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194269,"statfs":{"total":200000000,"available":198931504,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.82799999999999996,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.39700000000000002,"15min":0.36599999999999999},"max":{"1min":1.552,"5min":1.552,"15min":2.9470000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.014,"15min":0.95599999999999996},"min":{"1min":0.60399999999999998,"5min":0.34599999999999997,"15min":0.33700000000000002},"max":{"1min":1.2829999999999999,"5min":1.8109999999999999,"15min":1.8360000000000001},"last":0.90900000000000003}]},{"osd":2,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.88200000000000001,"15min":0.84699999999999998},"min":{"1min":0.65000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.246,"5min":1.4870000000000001,"15min":1.6739999999999999},"last":1.002},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.054,"15min":1.012},"min":{"1min":0.59499999999999997,"5min":0.41699999999999998,"15min":0.40000000000000002},"max":{"1min":1.4399999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.2210000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2010000000000001,"15min":1.1240000000000001},"min":{"1min":0.63400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.712,"5min":2.0379999999999998,"15min":2.1339999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3160000000000001,"15min":1.194},"min":{"1min":0.69399999999999995,"5min":0.45500000000000002,"15min":0.39100000000000001},"max":{"1min":1.7230000000000001,"5min":2.0659999999999998,"15min":2.145},"last":1.8680000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.339,"15min":1.3169999999999999},"min":{"1min":0.90700000000000003,"5min":0.79300000000000004,"15min":0.70799999999999996},"max":{"1min":1.667,"5min":1.804,"15min":2.625},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.3700000000000001,"15min":1.3069999999999999},"min":{"1min":0.93600000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6910000000000001,"5min":1.736,"15min":2.5550000000000002},"last":1.7569999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.337,"15min":1.3280000000000001},"min":{"1min":0.91700000000000004,"5min":0.69599999999999995,"15min":0.59299999999999997},"max":{"1min":1.883,"5min":1.883,"15min":5.4290000000000003},"last":1.335},{"interface":"front","average":{"1min":1.379,"5min":1.347,"15min":1.3220000000000001},"min":{"1min":0.85799999999999998,"5min":0.83399999999999996,"15min":0.73599999999999999},"max":{"1min":1.6699999999999999,"5min":1.9039999999999999,"15min":3.0910000000000002},"last":1.819}]},{"osd":6,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.381,"15min":1.345},"min":{"1min":0.89000000000000001,"5min":0.82099999999999995,"15min":0.64800000000000002},"max":{"1min":1.5269999999999999,"5min":1.9330000000000001,"15min":2.4420000000000002},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.512,"15min":1.4550000000000001},"min":{"1min":0.95799999999999996,"5min":0.90700000000000003,"15min":0.69099999999999995},"max":{"1min":2.004,"5min":2.109,"15min":2.577},"last":1.8009999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:52:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.466,"15min":1.4279999999999999},"min":{"1min":0.875,"5min":0.80000000000000004,"15min":0.755},"max":{"1min":1.956,"5min":1.982,"15min":2.3069999999999999},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.472,"15min":1.4359999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.749},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2650000000000001},"last":2.0649999999999999}]}]}],"pool_statfs":[]}} 2023-12-22T08:53:09.503 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T08:53:09.503 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T08:53:09.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.785+0000 7fcb5e6e5640 1 Processor -- start 2023-12-22T08:53:09.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.786+0000 7fcb5e6e5640 1 -- start start 2023-12-22T08:53:09.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.787+0000 7fcb5e6e5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb580cdce0 0x7fcb5813fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:09.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.787+0000 7fcb5e6e5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb5813ff50 0x7fcb58070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:09.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.788+0000 7fcb5e6e5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb58070770 con 0x7fcb5813d2c0 2023-12-22T08:53:09.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.788+0000 7fcb5e6e5640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb581403e0 con 0x7fcb5813ff50 2023-12-22T08:53:09.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.788+0000 7fcb5e6e5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5815b870 con 0x7fcb580cdce0 2023-12-22T08:53:09.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.788+0000 7fcb57fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcb5813d2c0 0x7fcb5815b160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52944/0 (socket says 172.21.15.38:52944) 2023-12-22T08:53:09.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.788+0000 7fcb57fff640 1 -- 172.21.15.38:0/529900872 learned_addr learned my addr 172.21.15.38:0/529900872 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:09.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.788+0000 7fcb5cc82640 1 --2- 172.21.15.38:0/529900872 >> v2:172.21.15.38:3300/0 conn(0x7fcb5813ff50 0x7fcb58070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:09.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.788+0000 7fcb577fe640 1 --2- 172.21.15.38:0/529900872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb580cdce0 0x7fcb5813fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:09.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.789+0000 7fcb56ffd640 1 -- 172.21.15.38:0/529900872 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10827150 0 0) 0x7fcb58070770 con 0x7fcb5813d2c0 2023-12-22T08:53:09.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.789+0000 7fcb56ffd640 1 -- 172.21.15.38:0/529900872 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb40005730 con 0x7fcb5813d2c0 2023-12-22T08:53:09.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.789+0000 7fcb5cc82640 1 -- 172.21.15.38:0/529900872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb580cdce0 msgr2=0x7fcb5813fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:09.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.789+0000 7fcb5cc82640 1 --2- 172.21.15.38:0/529900872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb580cdce0 0x7fcb5813fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.789+0000 7fcb5cc82640 1 -- 172.21.15.38:0/529900872 >> v1:172.21.15.38:6789/0 conn(0x7fcb5813d2c0 legacy=0x7fcb5815b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:09.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.789+0000 7fcb5cc82640 1 -- 172.21.15.38:0/529900872 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb580ce140 con 0x7fcb5813ff50 2023-12-22T08:53:09.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.790+0000 7fcb5cc82640 1 --2- 172.21.15.38:0/529900872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb5813ff50 0x7fcb58070c00 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009d90 tx=0x7fcb5002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dab9666c1914365 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:09.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.790+0000 7fcb56ffd640 1 -- 172.21.15.38:0/529900872 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5002cc60 con 0x7fcb5813ff50 2023-12-22T08:53:09.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.790+0000 7fcb56ffd640 1 -- 172.21.15.38:0/529900872 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5002cdc0 con 0x7fcb5813ff50 2023-12-22T08:53:09.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.790+0000 7fcb56ffd640 1 -- 172.21.15.38:0/529900872 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50034640 con 0x7fcb5813ff50 2023-12-22T08:53:09.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.791+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/529900872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb5813ff50 msgr2=0x7fcb58070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:09.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.791+0000 7fcb5e6e5640 1 --2- 172.21.15.38:0/529900872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb5813ff50 0x7fcb58070c00 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009d90 tx=0x7fcb5002beb0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.791+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/529900872 shutdown_connections 2023-12-22T08:53:09.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.791+0000 7fcb5e6e5640 1 --2- 172.21.15.38:0/529900872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb5813ff50 0x7fcb58070c00 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.791+0000 7fcb5e6e5640 1 --2- 172.21.15.38:0/529900872 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb580cdce0 0x7fcb5813fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.791+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/529900872 >> 172.21.15.38:0/529900872 conn(0x7fcb5806f880 msgr2=0x7fcb580b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:09.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.791+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/529900872 shutdown_connections 2023-12-22T08:53:09.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.791+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/529900872 wait complete. 2023-12-22T08:53:09.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.793+0000 7fcb5e6e5640 1 Processor -- start 2023-12-22T08:53:09.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.793+0000 7fcb5e6e5640 1 -- start start 2023-12-22T08:53:09.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.794+0000 7fcb5e6e5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb580cdce0 0x7fcb581503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:09.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.794+0000 7fcb5e6e5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb5813d2c0 0x7fcb5813dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:09.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.794+0000 7fcb5e6e5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb5813ff50 0x7fcb5813e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:09.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.794+0000 7fcb5e6e5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5815e710 con 0x7fcb5813d2c0 2023-12-22T08:53:09.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.794+0000 7fcb5e6e5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5815db00 con 0x7fcb580cdce0 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.794+0000 7fcb5e6e5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5815dde0 con 0x7fcb5813ff50 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.795+0000 7fcb577fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb5813d2c0 0x7fcb5813dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.795+0000 7fcb577fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb5813d2c0 0x7fcb5813dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38908/0 (socket says 172.21.15.38:38908) 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.795+0000 7fcb577fe640 1 -- 172.21.15.38:0/3881212741 learned_addr learned my addr 172.21.15.38:0/3881212741 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.795+0000 7fcb5cc82640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb5813ff50 0x7fcb5813e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.795+0000 7fcb57fff640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb580cdce0 0x7fcb581503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.795+0000 7fcb577fe640 1 -- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb5813ff50 msgr2=0x7fcb5813e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.795+0000 7fcb577fe640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb5813ff50 0x7fcb5813e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.795+0000 7fcb577fe640 1 -- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb580cdce0 msgr2=0x7fcb581503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.795+0000 7fcb577fe640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb580cdce0 0x7fcb581503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.795+0000 7fcb577fe640 1 -- 172.21.15.38:0/3881212741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb50009a70 con 0x7fcb5813d2c0 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.795+0000 7fcb5cc82640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb5813ff50 0x7fcb5813e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.795+0000 7fcb57fff640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb580cdce0 0x7fcb581503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:09.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.795+0000 7fcb577fe640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb5813d2c0 0x7fcb5813dad0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00d800 tx=0x7fcb4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:09.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.796+0000 7fcb54ff9640 1 -- 172.21.15.38:0/3881212741 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00b6c0 con 0x7fcb5813d2c0 2023-12-22T08:53:09.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.796+0000 7fcb54ff9640 1 -- 172.21.15.38:0/3881212741 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c00b820 con 0x7fcb5813d2c0 2023-12-22T08:53:09.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.796+0000 7fcb54ff9640 1 -- 172.21.15.38:0/3881212741 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00bbb0 con 0x7fcb5813d2c0 2023-12-22T08:53:09.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.796+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/3881212741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5815e0c0 con 0x7fcb5813d2c0 2023-12-22T08:53:09.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.796+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/3881212741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5815eba0 con 0x7fcb5813d2c0 2023-12-22T08:53:09.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.797+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/3881212741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb58061910 con 0x7fcb5813d2c0 2023-12-22T08:53:09.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.799+0000 7fcb54ff9640 1 -- 172.21.15.38:0/3881212741 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcb4c00bd10 con 0x7fcb5813d2c0 2023-12-22T08:53:09.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.800+0000 7fcb54ff9640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb4406a430 0x7fcb4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:09.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.800+0000 7fcb54ff9640 1 -- 172.21.15.38:0/3881212741 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb4c088f50 con 0x7fcb5813d2c0 2023-12-22T08:53:09.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.800+0000 7fcb57fff640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb4406a430 0x7fcb4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:09.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.802+0000 7fcb57fff640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb4406a430 0x7fcb4406c8f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcb48005880 tx=0x7fcb48009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:09.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:09.804+0000 7fcb54ff9640 1 -- 172.21.15.38:0/3881212741 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcb4c054410 con 0x7fcb5813d2c0 2023-12-22T08:53:10.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.062+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/3881212741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcb5806a240 con 0x7fcb5813d2c0 2023-12-22T08:53:10.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.071+0000 7fcb54ff9640 1 -- 172.21.15.38:0/3881212741 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7fcb4c057a30 con 0x7fcb5813d2c0 2023-12-22T08:53:10.072 INFO:teuthology.orchestra.run.smithi038.stderr:updated caps for client.0 2023-12-22T08:53:10.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.073+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb4406a430 msgr2=0x7fcb4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:10.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.073+0000 7fcb5e6e5640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb4406a430 0x7fcb4406c8f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcb48005880 tx=0x7fcb48009040 comp rx=0 tx=0).stop 2023-12-22T08:53:10.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.073+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/3881212741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb5813d2c0 msgr2=0x7fcb5813dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:10.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.073+0000 7fcb5e6e5640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb5813d2c0 0x7fcb5813dad0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00d800 tx=0x7fcb4c00dcc0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.074+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/3881212741 shutdown_connections 2023-12-22T08:53:10.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.074+0000 7fcb5e6e5640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb5813ff50 0x7fcb5813e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.074+0000 7fcb5e6e5640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb4406a430 0x7fcb4406c8f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.074+0000 7fcb5e6e5640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb5813d2c0 0x7fcb5813dad0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.074+0000 7fcb5e6e5640 1 --2- 172.21.15.38:0/3881212741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb580cdce0 0x7fcb581503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.074+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/3881212741 >> 172.21.15.38:0/3881212741 conn(0x7fcb5806f880 msgr2=0x7fcb580b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:10.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.074+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/3881212741 shutdown_connections 2023-12-22T08:53:10.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.074+0000 7fcb5e6e5640 1 -- 172.21.15.38:0/3881212741 wait complete. 2023-12-22T08:53:10.091 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:53:10.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.302+0000 7fb14ce3f640 1 Processor -- start 2023-12-22T08:53:10.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.302+0000 7fb14ce3f640 1 -- start start 2023-12-22T08:53:10.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.304+0000 7fb14ce3f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb14815b420 0x7fb14806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:10.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.304+0000 7fb14ce3f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1480a44a0 0x7fb1480708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:10.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.304+0000 7fb14ce3f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1480cdae0 con 0x7fb148070e30 2023-12-22T08:53:10.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.304+0000 7fb14ce3f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb148071260 con 0x7fb14815b420 2023-12-22T08:53:10.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.304+0000 7fb14ce3f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14806dec0 con 0x7fb1480a44a0 2023-12-22T08:53:10.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.304+0000 7fb147fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb148070e30 0x7fb14806f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52948/0 (socket says 172.21.15.38:52948) 2023-12-22T08:53:10.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.305+0000 7fb147fff640 1 -- 172.21.15.38:0/1773448956 learned_addr learned my addr 172.21.15.38:0/1773448956 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:10.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.305+0000 7fb1477fe640 1 --2- 172.21.15.38:0/1773448956 >> v2:172.21.15.89:3300/0 conn(0x7fb14815b420 0x7fb14806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:10.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.305+0000 7fb13ffff640 1 --2- 172.21.15.38:0/1773448956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1480a44a0 0x7fb1480708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:10.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.305+0000 7fb146ffd640 1 -- 172.21.15.38:0/1773448956 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631059882 0 0) 0x7fb1480cdae0 con 0x7fb148070e30 2023-12-22T08:53:10.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.305+0000 7fb146ffd640 1 -- 172.21.15.38:0/1773448956 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb134003520 con 0x7fb148070e30 2023-12-22T08:53:10.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.305+0000 7fb146ffd640 1 -- 172.21.15.38:0/1773448956 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1760130966 0 0) 0x7fb134003520 con 0x7fb148070e30 2023-12-22T08:53:10.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.305+0000 7fb1477fe640 1 -- 172.21.15.38:0/1773448956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1480a44a0 msgr2=0x7fb1480708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:10.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.305+0000 7fb1477fe640 1 --2- 172.21.15.38:0/1773448956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1480a44a0 0x7fb1480708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.305+0000 7fb1477fe640 1 -- 172.21.15.38:0/1773448956 >> v1:172.21.15.38:6789/0 conn(0x7fb148070e30 legacy=0x7fb14806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:10.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.305+0000 7fb1477fe640 1 -- 172.21.15.38:0/1773448956 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14815b800 con 0x7fb14815b420 2023-12-22T08:53:10.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.307+0000 7fb1477fe640 1 --2- 172.21.15.38:0/1773448956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb14815b420 0x7fb14806d980 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb1380097a0 tx=0x7fb13802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26f7db3218d09db9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:10.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.307+0000 7fb146ffd640 1 -- 172.21.15.38:0/1773448956 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1400019f0 con 0x7fb14815b420 2023-12-22T08:53:10.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.307+0000 7fb146ffd640 1 -- 172.21.15.38:0/1773448956 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13802e050 con 0x7fb14815b420 2023-12-22T08:53:10.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.307+0000 7fb146ffd640 1 -- 172.21.15.38:0/1773448956 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138030730 con 0x7fb14815b420 2023-12-22T08:53:10.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.308+0000 7fb14ce3f640 1 -- 172.21.15.38:0/1773448956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb14815b420 msgr2=0x7fb14806d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:10.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.308+0000 7fb14ce3f640 1 --2- 172.21.15.38:0/1773448956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb14815b420 0x7fb14806d980 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb1380097a0 tx=0x7fb13802b790 comp rx=0 tx=0).stop 2023-12-22T08:53:10.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.308+0000 7fb14ce3f640 1 -- 172.21.15.38:0/1773448956 shutdown_connections 2023-12-22T08:53:10.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.308+0000 7fb14ce3f640 1 --2- 172.21.15.38:0/1773448956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1480a44a0 0x7fb1480708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.308+0000 7fb14ce3f640 1 --2- 172.21.15.38:0/1773448956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb14815b420 0x7fb14806d980 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.308+0000 7fb14ce3f640 1 -- 172.21.15.38:0/1773448956 >> 172.21.15.38:0/1773448956 conn(0x7fb1480b1f70 msgr2=0x7fb1480b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:10.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.308+0000 7fb14ce3f640 1 -- 172.21.15.38:0/1773448956 shutdown_connections 2023-12-22T08:53:10.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.308+0000 7fb14ce3f640 1 -- 172.21.15.38:0/1773448956 wait complete. 2023-12-22T08:53:10.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.311+0000 7fb14ce3f640 1 Processor -- start 2023-12-22T08:53:10.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.311+0000 7fb14ce3f640 1 -- start start 2023-12-22T08:53:10.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.312+0000 7fb14ce3f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb148070e30 0x7fb14814a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:10.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.312+0000 7fb14ce3f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1480a44a0 0x7fb1481590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:10.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.312+0000 7fb14ce3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb14815b420 0x7fb1481595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:10.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.312+0000 7fb14ce3f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb148154530 con 0x7fb148070e30 2023-12-22T08:53:10.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.312+0000 7fb14ce3f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb148154810 con 0x7fb14815b420 2023-12-22T08:53:10.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.312+0000 7fb14ce3f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb148154af0 con 0x7fb1480a44a0 2023-12-22T08:53:10.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.313+0000 7fb1477fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb148070e30 0x7fb14814a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:10.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.313+0000 7fb1477fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb148070e30 0x7fb14814a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38916/0 (socket says 172.21.15.38:38916) 2023-12-22T08:53:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.313+0000 7fb1477fe640 1 -- 172.21.15.38:0/464609794 learned_addr learned my addr 172.21.15.38:0/464609794 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.313+0000 7fb13ffff640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1480a44a0 0x7fb1481590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.313+0000 7fb147fff640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb14815b420 0x7fb1481595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.313+0000 7fb1477fe640 1 -- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1480a44a0 msgr2=0x7fb1481590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.313+0000 7fb1477fe640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1480a44a0 0x7fb1481590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.313+0000 7fb1477fe640 1 -- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb14815b420 msgr2=0x7fb1481595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.313+0000 7fb1477fe640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb14815b420 0x7fb1481595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.313+0000 7fb1477fe640 1 -- 172.21.15.38:0/464609794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138009400 con 0x7fb148070e30 2023-12-22T08:53:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.314+0000 7fb1477fe640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb148070e30 0x7fb14814a590 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fb138000c00 tx=0x7fb1380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.314+0000 7fb144ff9640 1 -- 172.21.15.38:0/464609794 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13803b810 con 0x7fb148070e30 2023-12-22T08:53:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.314+0000 7fb144ff9640 1 -- 172.21.15.38:0/464609794 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13803b970 con 0x7fb148070e30 2023-12-22T08:53:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.314+0000 7fb144ff9640 1 -- 172.21.15.38:0/464609794 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13803bd20 con 0x7fb148070e30 2023-12-22T08:53:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.314+0000 7fb14ce3f640 1 -- 172.21.15.38:0/464609794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb148154dd0 con 0x7fb148070e30 2023-12-22T08:53:10.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.314+0000 7fb14ce3f640 1 -- 172.21.15.38:0/464609794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14814aad0 con 0x7fb148070e30 2023-12-22T08:53:10.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.316+0000 7fb14ce3f640 1 -- 172.21.15.38:0/464609794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb148147d50 con 0x7fb148070e30 2023-12-22T08:53:10.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.316+0000 7fb144ff9640 1 -- 172.21.15.38:0/464609794 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb138039040 con 0x7fb148070e30 2023-12-22T08:53:10.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.317+0000 7fb144ff9640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb12806a430 0x7fb12806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:10.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.317+0000 7fb144ff9640 1 -- 172.21.15.38:0/464609794 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1380a9fc0 con 0x7fb148070e30 2023-12-22T08:53:10.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.318+0000 7fb13ffff640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb12806a430 0x7fb12806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:10.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.319+0000 7fb13ffff640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb12806a430 0x7fb12806c8f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb148152a80 tx=0x7fb130009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:10.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.322+0000 7fb144ff9640 1 -- 172.21.15.38:0/464609794 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb148147d50 con 0x7fb148070e30 2023-12-22T08:53:10.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.553+0000 7fb14ce3f640 1 -- 172.21.15.38:0/464609794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb148147d50 con 0x7fb148070e30 2023-12-22T08:53:10.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.555+0000 7fb144ff9640 1 -- 172.21.15.38:0/464609794 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4649 (secure 0 0 0) 0x7fb148147d50 con 0x7fb148070e30 2023-12-22T08:53:10.556 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:10.556 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2952705616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2952705616},{"type":"v1","addr":"172.21.15.89:6835","nonce":2952705616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/3842752964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":3842752964},{"type":"v1","addr":"172.21.15.89:6837","nonce":3842752964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/261655608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":261655608},{"type":"v1","addr":"172.21.15.38:6834","nonce":261655608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:53:04.462294+0000","modified":"2023-12-22T08:53:07.483358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8940":{"gid":8940,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3350465616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3350465616},{"type":"v1","addr":"172.21.15.38:6835","nonce":3350465616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-22T08:53:10.556 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 86 2023-12-22T08:53:10.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.557+0000 7fb14ce3f640 1 -- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb12806a430 msgr2=0x7fb12806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:10.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.557+0000 7fb14ce3f640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb12806a430 0x7fb12806c8f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb148152a80 tx=0x7fb130009190 comp rx=0 tx=0).stop 2023-12-22T08:53:10.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.557+0000 7fb14ce3f640 1 -- 172.21.15.38:0/464609794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb148070e30 msgr2=0x7fb14814a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:10.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.557+0000 7fb14ce3f640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb148070e30 0x7fb14814a590 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fb138000c00 tx=0x7fb1380046c0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.558+0000 7fb14ce3f640 1 -- 172.21.15.38:0/464609794 shutdown_connections 2023-12-22T08:53:10.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.558+0000 7fb14ce3f640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb14815b420 0x7fb1481595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.558+0000 7fb14ce3f640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1480a44a0 0x7fb1481590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.558+0000 7fb14ce3f640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb12806a430 0x7fb12806c8f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.558+0000 7fb14ce3f640 1 --2- 172.21.15.38:0/464609794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb148070e30 0x7fb14814a590 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:10.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.558+0000 7fb14ce3f640 1 -- 172.21.15.38:0/464609794 >> 172.21.15.38:0/464609794 conn(0x7fb1480b1f70 msgr2=0x7fb14815dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:10.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.558+0000 7fb14ce3f640 1 -- 172.21.15.38:0/464609794 shutdown_connections 2023-12-22T08:53:10.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:10.558+0000 7fb14ce3f640 1 -- 172.21.15.38:0/464609794 wait complete. 2023-12-22T08:53:10.980 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T08:53:04.462294+0000', 'modified': '2023-12-22T08:53:07.483358+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8940}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8940': {'gid': 8940, 'name': 'c', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.38:6835/3350465616', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6833', 'nonce': 3350465616}, {'type': 'v1', 'addr': '172.21.15.38:6835', 'nonce': 3350465616}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T08:53:10.981 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T08:53:10.981 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-22T08:53:11.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.216+0000 7fde49e9e640 1 Processor -- start 2023-12-22T08:53:11.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.217+0000 7fde49e9e640 1 -- start start 2023-12-22T08:53:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.218+0000 7fde49e9e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fde44071460 0x7fde44071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.218+0000 7fde49e9e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4415edf0 con 0x7fde4415b0e0 2023-12-22T08:53:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.218+0000 7fde49e9e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde44071db0 con 0x7fde4409c980 2023-12-22T08:53:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.218+0000 7fde49e9e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4415d0d0 con 0x7fde44071460 2023-12-22T08:53:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.219+0000 7fde48e9c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fde4415b0e0 0x7fde4415b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42724/0 (socket says 172.21.15.38:42724) 2023-12-22T08:53:11.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.219+0000 7fde48e9c640 1 -- 172.21.15.38:0/2001371607 learned_addr learned my addr 172.21.15.38:0/2001371607 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.219+0000 7fde4969d640 1 --2- 172.21.15.38:0/2001371607 >> v2:172.21.15.89:3300/0 conn(0x7fde44071460 0x7fde44071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.219+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052793590 0 0) 0x7fde4415edf0 con 0x7fde4415b0e0 2023-12-22T08:53:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.219+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde34003520 con 0x7fde4415b0e0 2023-12-22T08:53:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.219+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1590852789 0 0) 0x7fde34003520 con 0x7fde4415b0e0 2023-12-22T08:53:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 >> v2:172.21.15.89:3300/0 conn(0x7fde44071460 msgr2=0x7fde44071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde437fe640 1 --2- 172.21.15.38:0/2001371607 >> v2:172.21.15.89:3300/0 conn(0x7fde44071460 0x7fde44071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 >> v1:172.21.15.89:6789/0 conn(0x7fde4409c980 legacy=0x7fde4415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4415bd90 con 0x7fde4415b0e0 2023-12-22T08:53:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fde38001670 con 0x7fde4415b0e0 2023-12-22T08:53:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 >> v1:172.21.15.38:6789/0 conn(0x7fde4415b0e0 legacy=0x7fde4415b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde437fe640 1 --2- 172.21.15.38:0/2001371607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde340039c0 0x7fde34003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde437fe640 1 --2- 172.21.15.38:0/2001371607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde340047c0 0x7fde34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde437fe640 1 --2- 172.21.15.38:0/2001371607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde34005380 0x7fde3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4415d0d0 con 0x7fde34005380 2023-12-22T08:53:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3400c260 con 0x7fde340039c0 2023-12-22T08:53:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3400c420 con 0x7fde340047c0 2023-12-22T08:53:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde4969d640 1 --2- 172.21.15.38:0/2001371607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde34005380 0x7fde3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde48e9c640 1 --2- 172.21.15.38:0/2001371607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde340039c0 0x7fde34003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.220+0000 7fde43fff640 1 --2- 172.21.15.38:0/2001371607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde340047c0 0x7fde34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.221+0000 7fde4969d640 1 -- 172.21.15.38:0/2001371607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde340047c0 msgr2=0x7fde34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.221+0000 7fde4969d640 1 --2- 172.21.15.38:0/2001371607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde340047c0 0x7fde34004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.221+0000 7fde4969d640 1 -- 172.21.15.38:0/2001371607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde340039c0 msgr2=0x7fde34003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.221+0000 7fde4969d640 1 --2- 172.21.15.38:0/2001371607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde340039c0 0x7fde34003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.221+0000 7fde4969d640 1 -- 172.21.15.38:0/2001371607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde34003520 con 0x7fde34005380 2023-12-22T08:53:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.221+0000 7fde43fff640 1 --2- 172.21.15.38:0/2001371607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde340047c0 0x7fde34004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.222+0000 7fde4969d640 1 -- 172.21.15.38:0/2001371607 reap_dead start 2023-12-22T08:53:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.222+0000 7fde4969d640 1 --2- 172.21.15.38:0/2001371607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde34005380 0x7fde3400b980 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fde3c007360 tx=0x7fde340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963afe739d450d87 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.222+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c02ccf0 con 0x7fde34005380 2023-12-22T08:53:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.222+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c02ce90 con 0x7fde34005380 2023-12-22T08:53:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.222+0000 7fde437fe640 1 -- 172.21.15.38:0/2001371607 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c003bd0 con 0x7fde34005380 2023-12-22T08:53:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.222+0000 7fde49e9e640 1 -- 172.21.15.38:0/2001371607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde34005380 msgr2=0x7fde3400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.222+0000 7fde49e9e640 1 --2- 172.21.15.38:0/2001371607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde34005380 0x7fde3400b980 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fde3c007360 tx=0x7fde340057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.223+0000 7fde49e9e640 1 -- 172.21.15.38:0/2001371607 shutdown_connections 2023-12-22T08:53:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.223+0000 7fde49e9e640 1 --2- 172.21.15.38:0/2001371607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde34005380 0x7fde3400b980 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.223+0000 7fde49e9e640 1 -- 172.21.15.38:0/2001371607 >> 172.21.15.38:0/2001371607 conn(0x7fde440cf000 msgr2=0x7fde440cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:11.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.223+0000 7fde49e9e640 1 -- 172.21.15.38:0/2001371607 shutdown_connections 2023-12-22T08:53:11.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.223+0000 7fde49e9e640 1 -- 172.21.15.38:0/2001371607 wait complete. 2023-12-22T08:53:11.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.224+0000 7fde49e9e640 1 Processor -- start 2023-12-22T08:53:11.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.225+0000 7fde49e9e640 1 -- start start 2023-12-22T08:53:11.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.225+0000 7fde49e9e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde34005380 0x7fde441f0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.225+0000 7fde49e9e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde441f3750 0x7fde440c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde49e9e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde440c3310 0x7fde440a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde49e9e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde440a1000 con 0x7fde440c3310 2023-12-22T08:53:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde49e9e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde440a4250 con 0x7fde441f3750 2023-12-22T08:53:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde49e9e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde440c3790 con 0x7fde34005380 2023-12-22T08:53:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde4969d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde440c3310 0x7fde440a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde4969d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde440c3310 0x7fde440a34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46182/0 (socket says 172.21.15.38:46182) 2023-12-22T08:53:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde4969d640 1 -- 172.21.15.38:0/3543324759 learned_addr learned my addr 172.21.15.38:0/3543324759 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde48e9c640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde34005380 0x7fde441f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde43fff640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde441f3750 0x7fde440c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde4969d640 1 -- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde34005380 msgr2=0x7fde441f0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde4969d640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde34005380 0x7fde441f0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde4969d640 1 -- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde441f3750 msgr2=0x7fde440c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde4969d640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde441f3750 0x7fde440c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.226+0000 7fde4969d640 1 -- 172.21.15.38:0/3543324759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde441f0e70 con 0x7fde440c3310 2023-12-22T08:53:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.227+0000 7fde4969d640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde440c3310 0x7fde440a34e0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fde3c02c760 tx=0x7fde3c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.227+0000 7fde417fa640 1 -- 172.21.15.38:0/3543324759 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c004450 con 0x7fde440c3310 2023-12-22T08:53:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.227+0000 7fde417fa640 1 -- 172.21.15.38:0/3543324759 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c0045b0 con 0x7fde440c3310 2023-12-22T08:53:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.227+0000 7fde49e9e640 1 -- 172.21.15.38:0/3543324759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde440a0660 con 0x7fde440c3310 2023-12-22T08:53:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.227+0000 7fde417fa640 1 -- 172.21.15.38:0/3543324759 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c03f470 con 0x7fde440c3310 2023-12-22T08:53:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.227+0000 7fde49e9e640 1 -- 172.21.15.38:0/3543324759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde440a0c20 con 0x7fde440c3310 2023-12-22T08:53:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.229+0000 7fde417fa640 1 -- 172.21.15.38:0/3543324759 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fde3c034440 con 0x7fde440c3310 2023-12-22T08:53:11.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.230+0000 7fde417fa640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fde2806a460 0x7fde2806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.230+0000 7fde417fa640 1 -- 172.21.15.38:0/3543324759 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde3c03b070 con 0x7fde440c3310 2023-12-22T08:53:11.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.231+0000 7fde48e9c640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fde2806a460 0x7fde2806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.231+0000 7fde4dc6e740 1 Processor -- start 2023-12-22T08:53:11.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.231+0000 7fde4dc6e740 1 -- start start 2023-12-22T08:53:11.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.232+0000 7fde4dc6e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc924320 0x55c6bc924700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.232+0000 7fde4dc6e740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc8f42a0 0x55c6bc921590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.232+0000 7fde4dc6e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc921ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.232+0000 7fde4dc6e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6bc85ff80 con 0x55c6bc8f7ea0 2023-12-22T08:53:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.232+0000 7fde4dc6e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6bc85d710 con 0x55c6bc924320 2023-12-22T08:53:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.232+0000 7fde4dc6e740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6bc859000 con 0x55c6bc8f42a0 2023-12-22T08:53:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.232+0000 7fde48e9c640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fde2806a460 0x7fde2806c920 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fde380058b0 tx=0x7fde38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.232+0000 7fde4969d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc921ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.232+0000 7fde4969d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc921ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46196/0 (socket says 172.21.15.38:46196) 2023-12-22T08:53:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.232+0000 7fde4969d640 1 -- 172.21.15.38:0/1680372452 learned_addr learned my addr 172.21.15.38:0/1680372452 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.232+0000 7fde48e9c640 1 --2- 172.21.15.38:0/1680372452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc924320 0x55c6bc924700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.232+0000 7fde43fff640 1 --2- 172.21.15.38:0/1680372452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc8f42a0 0x55c6bc921590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.233+0000 7fde4969d640 1 -- 172.21.15.38:0/1680372452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc8f42a0 msgr2=0x55c6bc921590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.233+0000 7fde4969d640 1 --2- 172.21.15.38:0/1680372452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc8f42a0 0x55c6bc921590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.233+0000 7fde4969d640 1 -- 172.21.15.38:0/1680372452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc924320 msgr2=0x55c6bc924700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.233+0000 7fde4969d640 1 --2- 172.21.15.38:0/1680372452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc924320 0x55c6bc924700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.233+0000 7fde4969d640 1 -- 172.21.15.38:0/1680372452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6bc820690 con 0x55c6bc8f7ea0 2023-12-22T08:53:11.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.233+0000 7fde4969d640 1 --2- 172.21.15.38:0/1680372452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc921ad0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fde3c03b040 tx=0x7fde3c078d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912a8090b6157bb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:11.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.233+0000 7fde2e7fc640 1 -- 172.21.15.38:0/1680372452 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c07d260 con 0x55c6bc8f7ea0 2023-12-22T08:53:11.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.233+0000 7fde2e7fc640 1 -- 172.21.15.38:0/1680372452 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c081410 con 0x55c6bc8f7ea0 2023-12-22T08:53:11.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.233+0000 7fde2e7fc640 1 -- 172.21.15.38:0/1680372452 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c009be0 con 0x55c6bc8f7ea0 2023-12-22T08:53:11.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.234+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1680372452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc8f7ea0 msgr2=0x55c6bc921ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.234+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1680372452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc921ad0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fde3c03b040 tx=0x7fde3c078d90 comp rx=0 tx=0).stop 2023-12-22T08:53:11.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.234+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1680372452 shutdown_connections 2023-12-22T08:53:11.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.234+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1680372452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc921ad0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.234+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1680372452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc8f42a0 0x55c6bc921590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.234+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1680372452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc924320 0x55c6bc924700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.234+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1680372452 >> 172.21.15.38:0/1680372452 conn(0x55c6bc8f65b0 msgr2=0x55c6bc93f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:11.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.234+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1680372452 shutdown_connections 2023-12-22T08:53:11.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.234+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1680372452 wait complete. 2023-12-22T08:53:11.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.235+0000 7fde4dc6e740 1 -- start start 2023-12-22T08:53:11.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.235+0000 7fde4dc6e740 1 Processor -- start 2023-12-22T08:53:11.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.236+0000 7fde4dc6e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc8fa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.236+0000 7fde4dc6e740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 0x55c6bc9225e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.236+0000 7fde4dc6e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc922b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.236+0000 7fde4dc6e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6bc7fa7d0 con 0x55c6bc951420 2023-12-22T08:53:11.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.236+0000 7fde4dc6e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6bc7fa470 con 0x55c6bc8f7ea0 2023-12-22T08:53:11.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.236+0000 7fde4dc6e740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6bc5c0f20 con 0x55c6bc924320 2023-12-22T08:53:11.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.236+0000 7fde4dc6e740 10 client.0 _ll_register_callbacks cb 0x55c6bc8491b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:53:11.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.236+0000 7fde4969d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc922b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.236+0000 7fde4969d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc922b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46206/0 (socket says 172.21.15.38:46206) 2023-12-22T08:53:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.236+0000 7fde4969d640 1 -- 172.21.15.38:0/907619998 learned_addr learned my addr 172.21.15.38:0/907619998 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.236+0000 7fde48e9c640 1 --2- 172.21.15.38:0/907619998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc8fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.236+0000 7fde43fff640 1 --2- 172.21.15.38:0/907619998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 0x55c6bc9225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.237+0000 7fde4969d640 1 -- 172.21.15.38:0/907619998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 msgr2=0x55c6bc9225e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.237+0000 7fde4969d640 1 --2- 172.21.15.38:0/907619998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 0x55c6bc9225e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.237+0000 7fde4969d640 1 -- 172.21.15.38:0/907619998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 msgr2=0x55c6bc8fa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.237+0000 7fde4969d640 1 --2- 172.21.15.38:0/907619998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc8fa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.237+0000 7fde4969d640 1 -- 172.21.15.38:0/907619998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde440a0c20 con 0x55c6bc951420 2023-12-22T08:53:11.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.237+0000 7fde4969d640 1 --2- 172.21.15.38:0/907619998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc922b20 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fde3c042040 tx=0x7fde3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df38dda69ff89b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:11.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.237+0000 7fde237fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:53:11.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.237+0000 7fde237fe640 1 -- 172.21.15.38:0/907619998 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c078920 con 0x55c6bc951420 2023-12-22T08:53:11.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.237+0000 7fde237fe640 1 -- 172.21.15.38:0/907619998 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde3c078a80 con 0x55c6bc951420 2023-12-22T08:53:11.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.237+0000 7fde4dc6e740 1 -- 172.21.15.38:0/907619998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c6bc883550 con 0x55c6bc951420 2023-12-22T08:53:11.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.237+0000 7fde237fe640 1 -- 172.21.15.38:0/907619998 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde3c0a8260 con 0x55c6bc951420 2023-12-22T08:53:11.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.237+0000 7fde4dc6e740 10 client.9072 fetch_fsmap learned FSMap version 86 2023-12-22T08:53:11.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.237+0000 7fde4dc6e740 1 -- 172.21.15.38:0/907619998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x55c6bc857680 con 0x55c6bc951420 2023-12-22T08:53:11.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.238+0000 7fde237fe640 1 -- 172.21.15.38:0/907619998 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c6bc883550 con 0x55c6bc951420 2023-12-22T08:53:11.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.238+0000 7fde237fe640 1 -- 172.21.15.38:0/907619998 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 86) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fde3c080f80 con 0x55c6bc951420 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.238+0000 7fde4dc6e740 10 client.9072 fetch_fsmap finished waiting for FSMap version 86 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.238+0000 7fde4dc6e740 10 client.9072 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.238+0000 7fde4dc6e740 20 client.9072 populate_metadata read hostname 'smithi038' 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.238+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/907619998 >> [v2:172.21.15.38:6833/3350465616,v1:172.21.15.38:6835/3350465616] conn(0x55c6bc8f8bf0 0x55c6bc8f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.238+0000 7fde4dc6e740 4 client.9072 mds_command: new command op to 8940 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.238+0000 7fde4dc6e740 1 -- 172.21.15.38:0/907619998 --> [v2:172.21.15.38:6833/3350465616,v1:172.21.15.38:6835/3350465616] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c6bc84bb50 con 0x55c6bc8f8bf0 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.238+0000 7fde48e9c640 1 --2- 172.21.15.38:0/907619998 >> [v2:172.21.15.38:6833/3350465616,v1:172.21.15.38:6835/3350465616] conn(0x55c6bc8f8bf0 0x55c6bc8f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.239+0000 7fde48e9c640 1 --2- 172.21.15.38:0/907619998 >> [v2:172.21.15.38:6833/3350465616,v1:172.21.15.38:6835/3350465616] conn(0x55c6bc8f8bf0 0x55c6bc8f8fd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e0b7f65f18662bb server_cookie=1bae88c9507304cb in_seq=0 out_seq=0 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.239+0000 7fde237fe640 10 client.9072 ms_handle_connect on v2:172.21.15.38:6833/3350465616 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.239+0000 7fde237fe640 1 -- 172.21.15.38:0/907619998 <== mds.0 v2:172.21.15.38:6833/3350465616 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55c6bc84bb50 con 0x55c6bc8f8bf0 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.239+0000 7fde237fe640 10 client.9072 handle_command_reply: tid=0 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.239+0000 7fde4dc6e740 1 client.9072 shutdown 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.240+0000 7fde4dc6e740 1 -- 172.21.15.38:0/907619998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 msgr2=0x55c6bc922b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.240+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/907619998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc922b20 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fde3c042040 tx=0x7fde3c00b040 comp rx=0 tx=0).stop 2023-12-22T08:53:11.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.240+0000 7fde4dc6e740 1 -- 172.21.15.38:0/907619998 shutdown_connections 2023-12-22T08:53:11.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.240+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/907619998 >> [v2:172.21.15.38:6833/3350465616,v1:172.21.15.38:6835/3350465616] conn(0x55c6bc8f8bf0 0x55c6bc8f8fd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.240+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/907619998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc922b20 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.240+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/907619998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 0x55c6bc9225e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.240+0000 7fde237fe640 0 client.9072 ms_handle_reset on v2:172.21.15.38:6833/3350465616 2023-12-22T08:53:11.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.240+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/907619998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc8fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.240+0000 7fde4dc6e740 1 -- 172.21.15.38:0/907619998 >> 172.21.15.38:0/907619998 conn(0x55c6bc8f42a0 msgr2=0x55c6bc920a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:11.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.240+0000 7fde4dc6e740 1 -- 172.21.15.38:0/907619998 shutdown_connections 2023-12-22T08:53:11.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.240+0000 7fde4dc6e740 1 -- 172.21.15.38:0/907619998 wait complete. 2023-12-22T08:53:11.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.240+0000 7fde4dc6e740 20 client.9072 trim_cache size 0 max 16384 2023-12-22T08:53:11.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.256+0000 7fde4dc6e740 1 Processor -- start 2023-12-22T08:53:11.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.256+0000 7fde4dc6e740 1 -- start start 2023-12-22T08:53:11.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.257+0000 7fde4dc6e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc8f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.257+0000 7fde4dc6e740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 0x55c6bc93fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.257+0000 7fde4dc6e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc91c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.257+0000 7fde4dc6e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6bc8f7910 con 0x55c6bc951420 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.257+0000 7fde4dc6e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6bc8fae80 con 0x55c6bc8f7ea0 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.257+0000 7fde4dc6e740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6bc8ef5a0 con 0x55c6bc924320 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.258+0000 7fde4969d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc91c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.258+0000 7fde4969d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc91c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46220/0 (socket says 172.21.15.38:46220) 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.258+0000 7fde4969d640 1 -- 172.21.15.38:0/1616259435 learned_addr learned my addr 172.21.15.38:0/1616259435 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.258+0000 7fde48e9c640 1 --2- 172.21.15.38:0/1616259435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc8f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.258+0000 7fde4969d640 1 -- 172.21.15.38:0/1616259435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 msgr2=0x55c6bc93fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.258+0000 7fde4969d640 1 --2- 172.21.15.38:0/1616259435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 0x55c6bc93fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.258+0000 7fde4969d640 1 -- 172.21.15.38:0/1616259435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 msgr2=0x55c6bc8f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.258+0000 7fde4969d640 1 --2- 172.21.15.38:0/1616259435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc8f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.258+0000 7fde4969d640 1 -- 172.21.15.38:0/1616259435 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6bc8efcb0 con 0x55c6bc951420 2023-12-22T08:53:11.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.258+0000 7fde48e9c640 1 --2- 172.21.15.38:0/1616259435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc8f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:11.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.258+0000 7fde4969d640 1 --2- 172.21.15.38:0/1616259435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc91c280 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fde3c075930 tx=0x7fde3c038070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245631089c022e87 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:11.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.259+0000 7fde2effd640 1 -- 172.21.15.38:0/1616259435 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c080f80 con 0x55c6bc951420 2023-12-22T08:53:11.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.259+0000 7fde2effd640 1 -- 172.21.15.38:0/1616259435 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c0810e0 con 0x55c6bc951420 2023-12-22T08:53:11.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.259+0000 7fde2effd640 1 -- 172.21.15.38:0/1616259435 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c07f070 con 0x55c6bc951420 2023-12-22T08:53:11.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.259+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1616259435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 msgr2=0x55c6bc91c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.259+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1616259435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc91c280 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fde3c075930 tx=0x7fde3c038070 comp rx=0 tx=0).stop 2023-12-22T08:53:11.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.259+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1616259435 shutdown_connections 2023-12-22T08:53:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.259+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1616259435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc91c280 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.259+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1616259435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 0x55c6bc93fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.259+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1616259435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc8f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.259+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1616259435 >> 172.21.15.38:0/1616259435 conn(0x55c6bc8f42a0 msgr2=0x55c6bc8fa200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.259+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1616259435 shutdown_connections 2023-12-22T08:53:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.259+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1616259435 wait complete. 2023-12-22T08:53:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.260+0000 7fde4dc6e740 1 -- start start 2023-12-22T08:53:11.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.260+0000 7fde4dc6e740 1 Processor -- start 2023-12-22T08:53:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.261+0000 7fde4dc6e740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc9a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.261+0000 7fde4dc6e740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 0x55c6bc942640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.261+0000 7fde4dc6e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc942b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.261+0000 7fde4dc6e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6bc922d70 con 0x55c6bc951420 2023-12-22T08:53:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.261+0000 7fde4dc6e740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6bc943670 con 0x55c6bc8f7ea0 2023-12-22T08:53:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.261+0000 7fde4dc6e740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6bc935910 con 0x55c6bc924320 2023-12-22T08:53:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.261+0000 7fde4dc6e740 10 client.0 _ll_register_callbacks cb 0x7fde3c0792b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:53:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde4969d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc942b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde4969d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc942b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46228/0 (socket says 172.21.15.38:46228) 2023-12-22T08:53:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde4969d640 1 -- 172.21.15.38:0/1289146105 learned_addr learned my addr 172.21.15.38:0/1289146105 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:11.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde48e9c640 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc9a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde43fff640 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 0x55c6bc942640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde4969d640 1 -- 172.21.15.38:0/1289146105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 msgr2=0x55c6bc942640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde4969d640 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 0x55c6bc942640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde4969d640 1 -- 172.21.15.38:0/1289146105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 msgr2=0x55c6bc9a36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde4969d640 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc9a36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde4969d640 1 -- 172.21.15.38:0/1289146105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde440a0c20 con 0x55c6bc951420 2023-12-22T08:53:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde48e9c640 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc9a36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:53:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde43fff640 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 0x55c6bc942640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde4969d640 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc942b80 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0a86b0 tx=0x7fde3c02c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41463349ca8ab94c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.262+0000 7fde237fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-12-22T08:53:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde237fe640 1 -- 172.21.15.38:0/1289146105 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c07f070 con 0x55c6bc951420 2023-12-22T08:53:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde237fe640 1 -- 172.21.15.38:0/1289146105 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde3c07f1d0 con 0x55c6bc951420 2023-12-22T08:53:11.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1289146105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c6bc852080 con 0x55c6bc951420 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde237fe640 1 -- 172.21.15.38:0/1289146105 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde3c0a3ea0 con 0x55c6bc951420 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde4dc6e740 10 client.9078 fetch_fsmap learned FSMap version 86 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1289146105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x55c6bc7f99e0 con 0x55c6bc951420 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde237fe640 1 -- 172.21.15.38:0/1289146105 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c6bc852080 con 0x55c6bc951420 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde237fe640 1 -- 172.21.15.38:0/1289146105 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 86) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fde3c078920 con 0x55c6bc951420 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde4dc6e740 10 client.9078 fetch_fsmap finished waiting for FSMap version 86 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde4dc6e740 10 client.9078 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde4dc6e740 20 client.9078 populate_metadata read hostname 'smithi038' 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.38:6833/3350465616,v1:172.21.15.38:6835/3350465616] conn(0x55c6bc923d10 0x55c6bc934ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde4dc6e740 4 client.9078 mds_command: new command op to 8940 tid=0[{"prefix": "status"}] 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.263+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1289146105 --> [v2:172.21.15.38:6833/3350465616,v1:172.21.15.38:6835/3350465616] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c6bc851da0 con 0x55c6bc923d10 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.264+0000 7fde48e9c640 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.38:6833/3350465616,v1:172.21.15.38:6835/3350465616] conn(0x55c6bc923d10 0x55c6bc934ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.264+0000 7fde48e9c640 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.38:6833/3350465616,v1:172.21.15.38:6835/3350465616] conn(0x55c6bc923d10 0x55c6bc934ac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3118d63c66cf98a6 server_cookie=582a4ab7a0772239 in_seq=0 out_seq=0 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.264+0000 7fde237fe640 10 client.9078 ms_handle_connect on v2:172.21.15.38:6833/3350465616 2023-12-22T08:53:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.264+0000 7fde237fe640 1 -- 172.21.15.38:0/1289146105 <== mds.0 v2:172.21.15.38:6833/3350465616 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55c6bc851da0 con 0x55c6bc923d10 2023-12-22T08:53:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.264+0000 7fde237fe640 10 client.9078 handle_command_reply: tid=0 2023-12-22T08:53:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.264+0000 7fde4dc6e740 1 client.9078 shutdown 2023-12-22T08:53:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.265+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1289146105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 msgr2=0x55c6bc942b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.265+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc942b80 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0a86b0 tx=0x7fde3c02c670 comp rx=0 tx=0).stop 2023-12-22T08:53:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.265+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1289146105 shutdown_connections 2023-12-22T08:53:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.265+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.38:6833/3350465616,v1:172.21.15.38:6835/3350465616] conn(0x55c6bc923d10 0x55c6bc934ac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.265+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6bc951420 0x55c6bc942b80 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.265+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55c6bc924320 0x55c6bc942640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.265+0000 7fde4dc6e740 1 --2- 172.21.15.38:0/1289146105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c6bc8f7ea0 0x55c6bc9a36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.265+0000 7fde237fe640 0 client.9078 ms_handle_reset on v2:172.21.15.38:6833/3350465616 2023-12-22T08:53:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.265+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1289146105 >> 172.21.15.38:0/1289146105 conn(0x55c6bc8f42a0 msgr2=0x55c6bc923600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.265+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1289146105 shutdown_connections 2023-12-22T08:53:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.265+0000 7fde4dc6e740 1 -- 172.21.15.38:0/1289146105 wait complete. 2023-12-22T08:53:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.265+0000 7fde4dc6e740 20 client.9078 trim_cache size 0 max 16384 2023-12-22T08:53:11.270 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:53:11.270 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:53:11.270 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-12-22T08:53:11.270 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 8940, 2023-12-22T08:53:11.270 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-12-22T08:53:11.270 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-12-22T08:53:11.270 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-12-22T08:53:11.271 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 6.797152015, 2023-12-22T08:53:11.271 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 86, 2023-12-22T08:53:11.271 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 190, 2023-12-22T08:53:11.271 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 190, 2023-12-22T08:53:11.271 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 12.623694327999999 2023-12-22T08:53:11.271 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:53:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.266+0000 7fde49e9e640 1 -- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fde2806a460 msgr2=0x7fde2806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.266+0000 7fde49e9e640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fde2806a460 0x7fde2806c920 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fde380058b0 tx=0x7fde38009040 comp rx=0 tx=0).stop 2023-12-22T08:53:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.266+0000 7fde49e9e640 1 -- 172.21.15.38:0/3543324759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde440c3310 msgr2=0x7fde440a34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.266+0000 7fde49e9e640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde440c3310 0x7fde440a34e0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fde3c02c760 tx=0x7fde3c004ab0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.266+0000 7fde49e9e640 1 -- 172.21.15.38:0/3543324759 shutdown_connections 2023-12-22T08:53:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.266+0000 7fde49e9e640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fde2806a460 0x7fde2806c920 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.266+0000 7fde49e9e640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde440c3310 0x7fde440a34e0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.266+0000 7fde49e9e640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde441f3750 0x7fde440c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.266+0000 7fde49e9e640 1 --2- 172.21.15.38:0/3543324759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde34005380 0x7fde441f0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.266+0000 7fde49e9e640 1 -- 172.21.15.38:0/3543324759 >> 172.21.15.38:0/3543324759 conn(0x7fde440cf000 msgr2=0x7fde4415d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.266+0000 7fde49e9e640 1 -- 172.21.15.38:0/3543324759 shutdown_connections 2023-12-22T08:53:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.266+0000 7fde49e9e640 1 -- 172.21.15.38:0/3543324759 wait complete. 2023-12-22T08:53:11.282 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:53:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.486+0000 7feeceacc640 1 Processor -- start 2023-12-22T08:53:11.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.486+0000 7feeceacc640 1 -- start start 2023-12-22T08:53:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.488+0000 7feeceacc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feec80a44a0 0x7feec80708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.488+0000 7feeceacc640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec80cdae0 con 0x7feec8070e30 2023-12-22T08:53:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.488+0000 7feeceacc640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec8071250 con 0x7feec815b420 2023-12-22T08:53:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.488+0000 7feeceacc640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec815b800 con 0x7feec80a44a0 2023-12-22T08:53:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.488+0000 7feece2cb640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7feec8070e30 0x7feec815baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42736/0 (socket says 172.21.15.38:42736) 2023-12-22T08:53:11.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.488+0000 7feece2cb640 1 -- 172.21.15.38:0/2686916541 learned_addr learned my addr 172.21.15.38:0/2686916541 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.488+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382279425 0 0) 0x7feec80cdae0 con 0x7feec8070e30 2023-12-22T08:53:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb4003520 con 0x7feec8070e30 2023-12-22T08:53:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feecd2c9640 1 --2- 172.21.15.38:0/2686916541 >> v2:172.21.15.89:3300/0 conn(0x7feec80a44a0 0x7feec80708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3264855147 0 0) 0x7feeb4003520 con 0x7feec8070e30 2023-12-22T08:53:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 >> v2:172.21.15.89:3300/0 conn(0x7feec80a44a0 msgr2=0x7feec80708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 --2- 172.21.15.38:0/2686916541 >> v2:172.21.15.89:3300/0 conn(0x7feec80a44a0 0x7feec80708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 >> v1:172.21.15.89:6789/0 conn(0x7feec815b420 legacy=0x7feec806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec80cdd30 con 0x7feec8070e30 2023-12-22T08:53:11.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7feec00019f0 con 0x7feec8070e30 2023-12-22T08:53:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 >> v1:172.21.15.38:6789/0 conn(0x7feec8070e30 legacy=0x7feec815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 --2- 172.21.15.38:0/2686916541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb4003970 0x7feeb4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 --2- 172.21.15.38:0/2686916541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feeb40047c0 0x7feeb4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 --2- 172.21.15.38:0/2686916541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feeb4005180 0x7feeb400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec815b800 con 0x7feeb40047c0 2023-12-22T08:53:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb400c0d0 con 0x7feeb4005180 2023-12-22T08:53:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb400c290 con 0x7feeb4003970 2023-12-22T08:53:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.489+0000 7feecd2c9640 1 --2- 172.21.15.38:0/2686916541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feeb40047c0 0x7feeb4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.490+0000 7feece2cb640 1 --2- 172.21.15.38:0/2686916541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feeb4005180 0x7feeb400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.490+0000 7feecd2c9640 1 -- 172.21.15.38:0/2686916541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb4003970 msgr2=0x7feeb4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.490+0000 7feecdaca640 1 --2- 172.21.15.38:0/2686916541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb4003970 0x7feeb4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.490+0000 7feecd2c9640 1 --2- 172.21.15.38:0/2686916541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb4003970 0x7feeb4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.490+0000 7feecd2c9640 1 -- 172.21.15.38:0/2686916541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feeb4005180 msgr2=0x7feeb400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.490+0000 7feecd2c9640 1 --2- 172.21.15.38:0/2686916541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feeb4005180 0x7feeb400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.490+0000 7feecd2c9640 1 -- 172.21.15.38:0/2686916541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4003520 con 0x7feeb40047c0 2023-12-22T08:53:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.490+0000 7feece2cb640 1 --2- 172.21.15.38:0/2686916541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feeb4005180 0x7feeb400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:11.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.490+0000 7feece2cb640 1 -- 172.21.15.38:0/2686916541 reap_dead start 2023-12-22T08:53:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.491+0000 7feecd2c9640 1 --2- 172.21.15.38:0/2686916541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feeb40047c0 0x7feeb4004c40 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7feec80b1f40 tx=0x7feeb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49abeb84c53833f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.491+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8033680 con 0x7feeb40047c0 2023-12-22T08:53:11.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.492+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb80337e0 con 0x7feeb40047c0 2023-12-22T08:53:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.492+0000 7feeccac8640 1 -- 172.21.15.38:0/2686916541 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8033b70 con 0x7feeb40047c0 2023-12-22T08:53:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.492+0000 7feeceacc640 1 -- 172.21.15.38:0/2686916541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feeb40047c0 msgr2=0x7feeb4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.492+0000 7feeceacc640 1 --2- 172.21.15.38:0/2686916541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feeb40047c0 0x7feeb4004c40 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7feec80b1f40 tx=0x7feeb40057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.492+0000 7feeceacc640 1 -- 172.21.15.38:0/2686916541 shutdown_connections 2023-12-22T08:53:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.492+0000 7feeceacc640 1 --2- 172.21.15.38:0/2686916541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feeb40047c0 0x7feeb4004c40 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.492+0000 7feeceacc640 1 -- 172.21.15.38:0/2686916541 >> 172.21.15.38:0/2686916541 conn(0x7feec80b1f70 msgr2=0x7feec80b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.492+0000 7feeceacc640 1 -- 172.21.15.38:0/2686916541 shutdown_connections 2023-12-22T08:53:11.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.492+0000 7feeceacc640 1 -- 172.21.15.38:0/2686916541 wait complete. 2023-12-22T08:53:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.494+0000 7feeceacc640 1 Processor -- start 2023-12-22T08:53:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.494+0000 7feeceacc640 1 -- start start 2023-12-22T08:53:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.495+0000 7feeceacc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb40047c0 0x7feec81f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.495+0000 7feeceacc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec814ffb0 0x7feec8153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.495+0000 7feeceacc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec8158dc0 0x7feec814f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.495+0000 7feeceacc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec81f3580 con 0x7feec814ffb0 2023-12-22T08:53:11.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.495+0000 7feeceacc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec8154020 con 0x7feec8158dc0 2023-12-22T08:53:11.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.495+0000 7feeceacc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec8150800 con 0x7feeb40047c0 2023-12-22T08:53:11.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.496+0000 7feecd2c9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec814ffb0 0x7feec8153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.496+0000 7feecd2c9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec814ffb0 0x7feec8153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46250/0 (socket says 172.21.15.38:46250) 2023-12-22T08:53:11.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.496+0000 7feecd2c9640 1 -- 172.21.15.38:0/2495931258 learned_addr learned my addr 172.21.15.38:0/2495931258 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.496+0000 7feece2cb640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec8158dc0 0x7feec814f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.496+0000 7feecd2c9640 1 -- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb40047c0 msgr2=0x7feec81f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.496+0000 7feecd2c9640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb40047c0 0x7feec81f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.496+0000 7feecd2c9640 1 -- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec8158dc0 msgr2=0x7feec814f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.496+0000 7feecd2c9640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec8158dc0 0x7feec814f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.496+0000 7feecd2c9640 1 -- 172.21.15.38:0/2495931258 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8154270 con 0x7feec814ffb0 2023-12-22T08:53:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.496+0000 7feece2cb640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec8158dc0 0x7feec814f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.497+0000 7feecd2c9640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec814ffb0 0x7feec8153ae0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7feeb8035040 tx=0x7feeb8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:11.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.497+0000 7feebe7fc640 1 -- 172.21.15.38:0/2495931258 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb803c800 con 0x7feec814ffb0 2023-12-22T08:53:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.497+0000 7feebe7fc640 1 -- 172.21.15.38:0/2495931258 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb8040070 con 0x7feec814ffb0 2023-12-22T08:53:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.497+0000 7feebe7fc640 1 -- 172.21.15.38:0/2495931258 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb803cb60 con 0x7feec814ffb0 2023-12-22T08:53:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.497+0000 7feeceacc640 1 -- 172.21.15.38:0/2495931258 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec80a2700 con 0x7feec814ffb0 2023-12-22T08:53:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.497+0000 7feeceacc640 1 -- 172.21.15.38:0/2495931258 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec80a2cc0 con 0x7feec814ffb0 2023-12-22T08:53:11.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.498+0000 7feeceacc640 1 -- 172.21.15.38:0/2495931258 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec80ce2d0 con 0x7feec814ffb0 2023-12-22T08:53:11.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.499+0000 7feebe7fc640 1 -- 172.21.15.38:0/2495931258 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feeb803ccc0 con 0x7feec814ffb0 2023-12-22T08:53:11.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.500+0000 7feebe7fc640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feeac06a480 0x7feeac06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:11.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.500+0000 7feebe7fc640 1 -- 172.21.15.38:0/2495931258 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feeb80aab10 con 0x7feec814ffb0 2023-12-22T08:53:11.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.501+0000 7feecdaca640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feeac06a480 0x7feeac06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:11.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.502+0000 7feecdaca640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feeac06a480 0x7feeac06c940 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7feec4000c00 tx=0x7feec4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:11.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.505+0000 7feebe7fc640 1 -- 172.21.15.38:0/2495931258 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feec80ce2d0 con 0x7feec814ffb0 2023-12-22T08:53:11.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.744+0000 7feeceacc640 1 -- 172.21.15.38:0/2495931258 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feec80ce2d0 con 0x7feec814ffb0 2023-12-22T08:53:11.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.745+0000 7feebe7fc640 1 -- 172.21.15.38:0/2495931258 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) v1 ==== 53+0+73 (secure 0 0 0) 0x7feec80ce2d0 con 0x7feec814ffb0 2023-12-22T08:53:11.746 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:53:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.748+0000 7feeceacc640 1 -- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feeac06a480 msgr2=0x7feeac06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.748+0000 7feeceacc640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feeac06a480 0x7feeac06c940 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7feec4000c00 tx=0x7feec4009040 comp rx=0 tx=0).stop 2023-12-22T08:53:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.748+0000 7feeceacc640 1 -- 172.21.15.38:0/2495931258 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec814ffb0 msgr2=0x7feec8153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.748+0000 7feeceacc640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec814ffb0 0x7feec8153ae0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7feeb8035040 tx=0x7feeb8004730 comp rx=0 tx=0).stop 2023-12-22T08:53:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.748+0000 7feeceacc640 1 -- 172.21.15.38:0/2495931258 shutdown_connections 2023-12-22T08:53:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.748+0000 7feeceacc640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec8158dc0 0x7feec814f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.748+0000 7feeceacc640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7feeac06a480 0x7feeac06c940 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.748+0000 7feeceacc640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feec814ffb0 0x7feec8153ae0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.748+0000 7feeceacc640 1 --2- 172.21.15.38:0/2495931258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feeb40047c0 0x7feec81f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.748+0000 7feeceacc640 1 -- 172.21.15.38:0/2495931258 >> 172.21.15.38:0/2495931258 conn(0x7feec80b1f70 msgr2=0x7feec806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:11.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.748+0000 7feeceacc640 1 -- 172.21.15.38:0/2495931258 shutdown_connections 2023-12-22T08:53:11.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:11.748+0000 7feeceacc640 1 -- 172.21.15.38:0/2495931258 wait complete. 2023-12-22T08:53:11.768 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:53:11.768 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:53:11.768 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-12-22T08:53:11.768 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T08:53:11.768 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:53:11.768 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:53:11.768 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:53:11.768 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:53:11.768 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:53:11.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:11.769 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-12-22T08:53:11.820 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:53:11.820 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:53:11.820 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:53:11.820 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:11.820 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-12-22T08:53:11.820 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:11.820 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:53:11.820 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 41574sec preferred_lft 41574sec 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link noprefixroute 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-12-22T08:53:11.821 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::5440:f6ff:fe40:85a/64 scope link 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether e6:c3:65:6c:32:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::e4c3:65ff:fe6c:322e/64 scope link 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 36:bf:8a:68:3b:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::34bf:8aff:fe68:3bf6/64 scope link 2023-12-22T08:53:11.822 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:11.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:11.823 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:53:11.915 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-12-22T08:53:11.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:11.919 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-12-22T08:53:11.977 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-12-22T08:53:11.977 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:53:11.977 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-22T08:53:11.977 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-22T08:53:11.977 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:53:11.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:11.978 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-12-22T08:53:11.978 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-12-22T08:53:11.978 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T08:53:11.978 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T08:53:11.978 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T08:53:11.978 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-12-22T08:53:12.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:12.173 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:53:12.228 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:53:12.228 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-22T08:53:12.228 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:53:12.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:12.229 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-12-22T08:53:12.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:53:12.326 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T08:53:12.383 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:53:12.383 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:53:12.383 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:53:12.439 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-22T08:53:12.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:12.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:53:12.591 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:53:12.591 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:53:12.623 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:53:12.623 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:53:12.623 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:53:12.623 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with new device syntax: 0@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:53:12.623 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:53:12.626 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T08:53:12.626 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:53:12.626 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:53:12.626 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:53:12.626 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:53:12.631 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:53:12.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:12.631 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:53:12.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:12.716 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:53:12.786 INFO:teuthology.orchestra.run.smithi038.stdout:client7243 2023-12-22T08:53:12.787 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:53:12.787 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:12.839 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:53:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.055+0000 7fb9615f5640 1 Processor -- start 2023-12-22T08:53:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.055+0000 7fb9615f5640 1 -- start start 2023-12-22T08:53:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.057+0000 7fb9615f5640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb95c06d210 0x7fb95c15e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.057+0000 7fb9615f5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb95c0706d0 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.057+0000 7fb9615f5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb95c0cbf40 con 0x7fb95c06d5f0 2023-12-22T08:53:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.057+0000 7fb9615f5640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95c0ce840 con 0x7fb95c06d210 2023-12-22T08:53:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.057+0000 7fb95bfff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb95c06d210 0x7fb95c15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.057+0000 7fb9537fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb95c0cb4c0 0x7fb95c159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42746/0 (socket says 172.21.15.38:42746) 2023-12-22T08:53:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.057+0000 7fb9537fe640 1 -- 172.21.15.38:0/3588537218 learned_addr learned my addr 172.21.15.38:0/3588537218 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.057+0000 7fb95bfff640 1 -- 172.21.15.38:0/3588537218 >> v1:172.21.15.89:6789/0 conn(0x7fb95c06d5f0 legacy=0x7fb95c070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.057+0000 7fb95bfff640 1 -- 172.21.15.38:0/3588537218 >> v1:172.21.15.38:6789/0 conn(0x7fb95c0cb4c0 legacy=0x7fb95c159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.057+0000 7fb95bfff640 1 -- 172.21.15.38:0/3588537218 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c0ceb20 con 0x7fb95c06d210 2023-12-22T08:53:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.059+0000 7fb95bfff640 1 --2- 172.21.15.38:0/3588537218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb95c06d210 0x7fb95c15e830 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0097a0 tx=0x7fb94c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1046f98306327b37 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.059+0000 7fb95b7fe640 1 -- 172.21.15.38:0/3588537218 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c031830 con 0x7fb95c06d210 2023-12-22T08:53:13.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.059+0000 7fb95b7fe640 1 -- 172.21.15.38:0/3588537218 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c031990 con 0x7fb95c06d210 2023-12-22T08:53:13.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.059+0000 7fb95b7fe640 1 -- 172.21.15.38:0/3588537218 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c031d20 con 0x7fb95c06d210 2023-12-22T08:53:13.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.059+0000 7fb9615f5640 1 -- 172.21.15.38:0/3588537218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb95c06d210 msgr2=0x7fb95c15e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.059+0000 7fb9615f5640 1 --2- 172.21.15.38:0/3588537218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb95c06d210 0x7fb95c15e830 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0097a0 tx=0x7fb94c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:53:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.060+0000 7fb9615f5640 1 -- 172.21.15.38:0/3588537218 shutdown_connections 2023-12-22T08:53:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.060+0000 7fb9615f5640 1 --2- 172.21.15.38:0/3588537218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb95c06d210 0x7fb95c15e830 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.060+0000 7fb9615f5640 1 -- 172.21.15.38:0/3588537218 >> 172.21.15.38:0/3588537218 conn(0x7fb95c0b1f70 msgr2=0x7fb95c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.060+0000 7fb9615f5640 1 -- 172.21.15.38:0/3588537218 shutdown_connections 2023-12-22T08:53:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.060+0000 7fb9615f5640 1 -- 172.21.15.38:0/3588537218 wait complete. 2023-12-22T08:53:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.061+0000 7fb9615f5640 1 Processor -- start 2023-12-22T08:53:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.062+0000 7fb9615f5640 1 -- start start 2023-12-22T08:53:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.062+0000 7fb9615f5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb95c06d210 0x7fb95c1562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb9615f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb95c06d5f0 0x7fb95c1525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb9615f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb95c0cb4c0 0x7fb95c1f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb9615f5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c06f7d0 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb9615f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c152af0 con 0x7fb95c06d5f0 2023-12-22T08:53:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb9615f5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c157dd0 con 0x7fb95c06d210 2023-12-22T08:53:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb960df4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb95c0cb4c0 0x7fb95c1f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb960df4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb95c0cb4c0 0x7fb95c1f36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46256/0 (socket says 172.21.15.38:46256) 2023-12-22T08:53:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb960df4640 1 -- 172.21.15.38:0/1034396410 learned_addr learned my addr 172.21.15.38:0/1034396410 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb95bfff640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb95c06d210 0x7fb95c1562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb9537fe640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb95c06d5f0 0x7fb95c1525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb960df4640 1 -- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb95c06d210 msgr2=0x7fb95c1562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb960df4640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb95c06d210 0x7fb95c1562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb960df4640 1 -- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb95c06d5f0 msgr2=0x7fb95c1525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.063+0000 7fb960df4640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb95c06d5f0 0x7fb95c1525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:13.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.064+0000 7fb960df4640 1 -- 172.21.15.38:0/1034396410 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c009400 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.064+0000 7fb960df4640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb95c0cb4c0 0x7fb95c1f36c0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c780 tx=0x7fb95400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.064+0000 7fb9597fa640 1 -- 172.21.15.38:0/1034396410 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954004b60 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.064+0000 7fb9597fa640 1 -- 172.21.15.38:0/1034396410 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95400ce90 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.064+0000 7fb9615f5640 1 -- 172.21.15.38:0/1034396410 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95c1569a0 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.064+0000 7fb9597fa640 1 -- 172.21.15.38:0/1034396410 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95400a850 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.064+0000 7fb9615f5640 1 -- 172.21.15.38:0/1034396410 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95c06ff70 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.066+0000 7fb9615f5640 1 -- 172.21.15.38:0/1034396410 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95c061910 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.067+0000 7fb9597fa640 1 -- 172.21.15.38:0/1034396410 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb95400a9b0 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.068+0000 7fb9597fa640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb93c06a430 0x7fb93c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:13.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.068+0000 7fb9597fa640 1 -- 172.21.15.38:0/1034396410 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb954088bb0 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.069+0000 7fb95bfff640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb93c06a430 0x7fb93c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.070+0000 7fb95bfff640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb93c06a430 0x7fb93c06c8f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb94c036000 tx=0x7fb94c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:13.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.073+0000 7fb9597fa640 1 -- 172.21.15.38:0/1034396410 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb954054100 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.306+0000 7fb9615f5640 1 -- 172.21.15.38:0/1034396410 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb95c0a4050 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.307+0000 7fb9597fa640 1 -- 172.21.15.38:0/1034396410 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb954057720 con 0x7fb95c0cb4c0 2023-12-22T08:53:13.308 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:53:13.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.309+0000 7fb9615f5640 1 -- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb93c06a430 msgr2=0x7fb93c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:13.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.309+0000 7fb9615f5640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb93c06a430 0x7fb93c06c8f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb94c036000 tx=0x7fb94c03c040 comp rx=0 tx=0).stop 2023-12-22T08:53:13.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.309+0000 7fb9615f5640 1 -- 172.21.15.38:0/1034396410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb95c0cb4c0 msgr2=0x7fb95c1f36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.309+0000 7fb9615f5640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb95c0cb4c0 0x7fb95c1f36c0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c780 tx=0x7fb95400cc40 comp rx=0 tx=0).stop 2023-12-22T08:53:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.310+0000 7fb9615f5640 1 -- 172.21.15.38:0/1034396410 shutdown_connections 2023-12-22T08:53:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.310+0000 7fb9615f5640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb93c06a430 0x7fb93c06c8f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.310+0000 7fb9615f5640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb95c0cb4c0 0x7fb95c1f36c0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.310+0000 7fb9615f5640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb95c06d5f0 0x7fb95c1525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.310+0000 7fb9615f5640 1 --2- 172.21.15.38:0/1034396410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb95c06d210 0x7fb95c1562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.310+0000 7fb9615f5640 1 -- 172.21.15.38:0/1034396410 >> 172.21.15.38:0/1034396410 conn(0x7fb95c0b1f70 msgr2=0x7fb95c070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.310+0000 7fb9615f5640 1 -- 172.21.15.38:0/1034396410 shutdown_connections 2023-12-22T08:53:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:13.310+0000 7fb9615f5640 1 -- 172.21.15.38:0/1034396410 wait complete. 2023-12-22T08:53:13.329 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:53:13.329 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:53:13.329 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-12-22T08:53:13.329 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T08:53:13.329 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T08:53:13.329 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:53:13.329 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:53:13.329 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:53:13.329 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:53:13.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:13.330 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-12-22T08:53:13.390 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:53:13.390 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:53:13.390 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:53:13.390 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:13.390 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-12-22T08:53:13.390 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:13.390 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:53:13.390 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 41568sec preferred_lft 41568sec 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:53:13.391 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:53:13.392 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:13.392 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::9cc2:a9ff:fe75:e812/64 scope link 2023-12-22T08:53:13.392 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:13.392 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:53:13.392 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8e:46:07:65:e3:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T08:53:13.392 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::8c46:7ff:fe65:e31f/64 scope link 2023-12-22T08:53:13.392 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:13.392 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:53:13.392 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 2e:c2:ba:6f:ea:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T08:53:13.392 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2cc2:baff:fe6f:ea22/64 scope link 2023-12-22T08:53:13.392 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:53:13.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:13.393 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:53:13.485 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-12-22T08:53:13.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:13.490 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-12-22T08:53:13.542 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-12-22T08:53:13.542 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:53:13.542 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:53:13.542 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:53:13.542 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:53:13.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:13.543 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-12-22T08:53:13.543 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-12-22T08:53:13.543 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:53:13.543 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:53:13.543 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:53:13.543 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-12-22T08:53:13.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:13.719 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:53:13.771 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T08:53:13.771 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-22T08:53:13.772 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:53:13.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:13.772 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-12-22T08:53:13.865 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:53:13.865 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T08:53:13.918 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T08:53:13.918 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:53:13.918 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:53:13.963 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-22T08:53:13.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:13.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:53:14.151 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:53:14.151 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:53:14.184 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-22T08:53:14.184 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-22T08:53:14.184 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-12-22T08:53:14.184 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 1@893856d7-5d01-4896-9127-f971dbad2b97.cephfs=/ 2023-12-22T08:53:14.184 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.38:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-12-22T08:53:14.186 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-22T08:53:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:53:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:53:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:53:14.186 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:53:14.190 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:53:14.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:14.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T08:53:14.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:14.265 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:53:14.320 INFO:teuthology.orchestra.run.smithi089.stdout:client9096 2023-12-22T08:53:14.321 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:53:14.321 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:14.370 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:53:14.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.613+0000 7f4165d1b640 1 Processor -- start 2023-12-22T08:53:14.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.613+0000 7f4165d1b640 1 -- start start 2023-12-22T08:53:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.614+0000 7f4165d1b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4160144d10 0x7f41600cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.614+0000 7f4165d1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41600cc670 0x7f41600b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:14.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.615+0000 7f4165d1b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41601450f0 con 0x7f41600b2590 2023-12-22T08:53:14.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.615+0000 7f4165d1b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41600b2a20 con 0x7f4160144d10 2023-12-22T08:53:14.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.615+0000 7f4165d1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41600ce010 con 0x7f41600cc670 2023-12-22T08:53:14.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.615+0000 7f415ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f41600b2590 0x7f416015f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42758/0 (socket says 172.21.15.38:42758) 2023-12-22T08:53:14.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.615+0000 7f415ffff640 1 -- 172.21.15.38:0/3419912055 learned_addr learned my addr 172.21.15.38:0/3419912055 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:14.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.615+0000 7f415f7fe640 1 --2- 172.21.15.38:0/3419912055 >> v2:172.21.15.89:3300/0 conn(0x7f4160144d10 0x7f41600cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:14.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.615+0000 7f4157fff640 1 --2- 172.21.15.38:0/3419912055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41600cc670 0x7f41600b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:14.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.615+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652596056 0 0) 0x7f41601450f0 con 0x7f41600b2590 2023-12-22T08:53:14.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.615+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f414c003520 con 0x7f41600b2590 2023-12-22T08:53:14.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 215598434 0 0) 0x7f414c003520 con 0x7f41600b2590 2023-12-22T08:53:14.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41600cc670 msgr2=0x7f41600b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:14.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 --2- 172.21.15.38:0/3419912055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41600cc670 0x7f41600b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:14.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 >> v2:172.21.15.89:3300/0 conn(0x7f4160144d10 msgr2=0x7f41600cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 --2- 172.21.15.38:0/3419912055 >> v2:172.21.15.89:3300/0 conn(0x7f4160144d10 0x7f41600cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41600ce2f0 con 0x7f41600b2590 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f41580019f0 con 0x7f41600b2590 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 >> v1:172.21.15.38:6789/0 conn(0x7f41600b2590 legacy=0x7f416015f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 --2- 172.21.15.38:0/3419912055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f414c003970 0x7f414c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 --2- 172.21.15.38:0/3419912055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0047c0 0x7f414c004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 --2- 172.21.15.38:0/3419912055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414c005140 0x7f414c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41600b2a20 con 0x7f414c005140 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41600ce010 con 0x7f414c003970 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0045c0 con 0x7f414c0047c0 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.616+0000 7f415ffff640 1 --2- 172.21.15.38:0/3419912055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414c005140 0x7f414c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.617+0000 7f415f7fe640 1 --2- 172.21.15.38:0/3419912055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f414c003970 0x7f414c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.617+0000 7f4157fff640 1 --2- 172.21.15.38:0/3419912055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0047c0 0x7f414c004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.617+0000 7f415ffff640 1 -- 172.21.15.38:0/3419912055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0047c0 msgr2=0x7f414c004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.617+0000 7f415ffff640 1 --2- 172.21.15.38:0/3419912055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0047c0 0x7f414c004c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:14.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.617+0000 7f415ffff640 1 -- 172.21.15.38:0/3419912055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f414c003970 msgr2=0x7f414c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:14.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.617+0000 7f415ffff640 1 --2- 172.21.15.38:0/3419912055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f414c003970 0x7f414c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:14.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.617+0000 7f415ffff640 1 -- 172.21.15.38:0/3419912055 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c003520 con 0x7f414c005140 2023-12-22T08:53:14.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.617+0000 7f4157fff640 1 --2- 172.21.15.38:0/3419912055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f414c0047c0 0x7f414c004c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:14.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.618+0000 7f415ffff640 1 --2- 172.21.15.38:0/3419912055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414c005140 0x7f414c00b980 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f415800a830 tx=0x7f414c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970063e4593d33fc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:14.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.618+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4158034630 con 0x7f414c005140 2023-12-22T08:53:14.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.618+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415802f070 con 0x7f414c005140 2023-12-22T08:53:14.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.618+0000 7f415effd640 1 -- 172.21.15.38:0/3419912055 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580349f0 con 0x7f414c005140 2023-12-22T08:53:14.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.619+0000 7f4165d1b640 1 -- 172.21.15.38:0/3419912055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414c005140 msgr2=0x7f414c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:14.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.619+0000 7f4165d1b640 1 --2- 172.21.15.38:0/3419912055 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414c005140 0x7f414c00b980 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f415800a830 tx=0x7f414c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:14.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.619+0000 7f415ffff640 1 -- 172.21.15.38:0/3419912055 reap_dead start 2023-12-22T08:53:14.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.619+0000 7f4165d1b640 1 -- 172.21.15.38:0/3419912055 shutdown_connections 2023-12-22T08:53:14.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.619+0000 7f4165d1b640 1 -- 172.21.15.38:0/3419912055 >> 172.21.15.38:0/3419912055 conn(0x7f41600cf070 msgr2=0x7f41600cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:14.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.619+0000 7f4165d1b640 1 -- 172.21.15.38:0/3419912055 shutdown_connections 2023-12-22T08:53:14.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.619+0000 7f4165d1b640 1 -- 172.21.15.38:0/3419912055 wait complete. 2023-12-22T08:53:14.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.621+0000 7f4165d1b640 1 Processor -- start 2023-12-22T08:53:14.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.621+0000 7f4165d1b640 1 -- start start 2023-12-22T08:53:14.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.622+0000 7f4165d1b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414c005140 0x7f41601328b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:14.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.622+0000 7f4165d1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41600af2b0 0x7f41600709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:14.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.622+0000 7f4165d1b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41600af730 0x7f4160070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:14.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.622+0000 7f4165d1b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4160132df0 con 0x7f414c005140 2023-12-22T08:53:14.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.622+0000 7f4165d1b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416013fb20 con 0x7f41600af2b0 2023-12-22T08:53:14.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.622+0000 7f4165d1b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4160156a90 con 0x7f41600af730 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.623+0000 7f415f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414c005140 0x7f41601328b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.623+0000 7f415f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414c005140 0x7f41601328b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46266/0 (socket says 172.21.15.38:46266) 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.623+0000 7f415f7fe640 1 -- 172.21.15.38:0/230356370 learned_addr learned my addr 172.21.15.38:0/230356370 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.623+0000 7f415ffff640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41600af730 0x7f4160070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.623+0000 7f4157fff640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41600af2b0 0x7f41600709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.623+0000 7f415f7fe640 1 -- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41600af730 msgr2=0x7f4160070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.623+0000 7f415f7fe640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41600af730 0x7f4160070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.623+0000 7f415f7fe640 1 -- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41600af2b0 msgr2=0x7f41600709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.623+0000 7f415f7fe640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41600af2b0 0x7f41600709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.623+0000 7f415f7fe640 1 -- 172.21.15.38:0/230356370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160156d70 con 0x7f414c005140 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.623+0000 7f4157fff640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41600af2b0 0x7f41600709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.623+0000 7f415f7fe640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414c005140 0x7f41601328b0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f4150011600 tx=0x7f4150011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.624+0000 7f415cff9640 1 -- 172.21.15.38:0/230356370 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000f920 con 0x7f414c005140 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.624+0000 7f415cff9640 1 -- 172.21.15.38:0/230356370 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415000fa80 con 0x7f414c005140 2023-12-22T08:53:14.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.624+0000 7f415cff9640 1 -- 172.21.15.38:0/230356370 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000fdf0 con 0x7f414c005140 2023-12-22T08:53:14.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.624+0000 7f4165d1b640 1 -- 172.21.15.38:0/230356370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4160157050 con 0x7f414c005140 2023-12-22T08:53:14.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.624+0000 7f4165d1b640 1 -- 172.21.15.38:0/230356370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4160157610 con 0x7f414c005140 2023-12-22T08:53:14.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.625+0000 7f4165d1b640 1 -- 172.21.15.38:0/230356370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4160061910 con 0x7f414c005140 2023-12-22T08:53:14.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.626+0000 7f415cff9640 1 -- 172.21.15.38:0/230356370 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4150015460 con 0x7f414c005140 2023-12-22T08:53:14.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.627+0000 7f415cff9640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f414006a460 0x7f414006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:14.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.627+0000 7f415cff9640 1 -- 172.21.15.38:0/230356370 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4150088ed0 con 0x7f414c005140 2023-12-22T08:53:14.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.628+0000 7f4157fff640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f414006a460 0x7f414006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:14.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.629+0000 7f4157fff640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f414006a460 0x7f414006c920 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f41600719c0 tx=0x7f4148008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:14.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.631+0000 7f415cff9640 1 -- 172.21.15.38:0/230356370 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4150054420 con 0x7f414c005140 2023-12-22T08:53:14.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.868+0000 7f4165d1b640 1 -- 172.21.15.38:0/230356370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41600cb8e0 con 0x7f414c005140 2023-12-22T08:53:14.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.869+0000 7f415cff9640 1 -- 172.21.15.38:0/230356370 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4649 (secure 0 0 0) 0x7f4150057a40 con 0x7f414c005140 2023-12-22T08:53:14.870 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:14.870 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2952705616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2952705616},{"type":"v1","addr":"172.21.15.89:6835","nonce":2952705616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/3842752964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":3842752964},{"type":"v1","addr":"172.21.15.89:6837","nonce":3842752964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/261655608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":261655608},{"type":"v1","addr":"172.21.15.38:6834","nonce":261655608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:53:04.462294+0000","modified":"2023-12-22T08:53:07.483358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8940":{"gid":8940,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3350465616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3350465616},{"type":"v1","addr":"172.21.15.38:6835","nonce":3350465616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-22T08:53:14.871 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 86 2023-12-22T08:53:14.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.872+0000 7f4165d1b640 1 -- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f414006a460 msgr2=0x7f414006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:14.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.872+0000 7f4165d1b640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f414006a460 0x7f414006c920 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f41600719c0 tx=0x7f4148008040 comp rx=0 tx=0).stop 2023-12-22T08:53:14.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.872+0000 7f4165d1b640 1 -- 172.21.15.38:0/230356370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414c005140 msgr2=0x7f41601328b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:14.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.872+0000 7f4165d1b640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414c005140 0x7f41601328b0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f4150011600 tx=0x7f4150011ac0 comp rx=0 tx=0).stop 2023-12-22T08:53:14.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.872+0000 7f4165d1b640 1 -- 172.21.15.38:0/230356370 shutdown_connections 2023-12-22T08:53:14.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.872+0000 7f4165d1b640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41600af730 0x7f4160070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:14.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.872+0000 7f4165d1b640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41600af2b0 0x7f41600709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:14.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.872+0000 7f4165d1b640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f414006a460 0x7f414006c920 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:14.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.872+0000 7f4165d1b640 1 --2- 172.21.15.38:0/230356370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f414c005140 0x7f41601328b0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:14.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.872+0000 7f4165d1b640 1 -- 172.21.15.38:0/230356370 >> 172.21.15.38:0/230356370 conn(0x7f41600cf070 msgr2=0x7f41601595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:14.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.872+0000 7f4165d1b640 1 -- 172.21.15.38:0/230356370 shutdown_connections 2023-12-22T08:53:14.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:14.872+0000 7f4165d1b640 1 -- 172.21.15.38:0/230356370 wait complete. 2023-12-22T08:53:14.894 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-22T08:53:15.137 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":8940,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.652685212,"mdsmap_epoch":86,"osdmap_epoch":190,"osdmap_epoch_barrier":190,"uptime":16.479241993999999} 2023-12-22T08:53:15.137 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 8940, "mdsmap_epoch": 86, "osdmap_epoch": 190, "osdmap_epoch_barrier": 190, "rank_uptime": 10.652685212, "state": "up:active", "uptime": 16.479241994, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:53:15.137 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-22T08:53:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.363+0000 7feab359e640 1 Processor -- start 2023-12-22T08:53:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.363+0000 7feab359e640 1 -- start start 2023-12-22T08:53:15.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.365+0000 7feab359e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feab41437f0 0x7feab40b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:15.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.365+0000 7feab359e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab4072010 con 0x7feab4143bd0 2023-12-22T08:53:15.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.365+0000 7feab359e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab415df20 con 0x7feab406f960 2023-12-22T08:53:15.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.365+0000 7feab359e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab40b4490 con 0x7feab41437f0 2023-12-22T08:53:15.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.365+0000 7feab259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feab41437f0 0x7feab40b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:15.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.366+0000 7feab259c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7feab41437f0 0x7feab40b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46280/0 (socket says 172.21.15.38:46280) 2023-12-22T08:53:15.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.366+0000 7feab259c640 1 -- 172.21.15.38:0/3768353780 learned_addr learned my addr 172.21.15.38:0/3768353780 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:15.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.366+0000 7feab259c640 1 -- 172.21.15.38:0/3768353780 >> v1:172.21.15.89:6789/0 conn(0x7feab406f960 legacy=0x7feab40ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:15.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.366+0000 7feab259c640 1 -- 172.21.15.38:0/3768353780 >> v1:172.21.15.38:6789/0 conn(0x7feab4143bd0 legacy=0x7feab406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:15.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.366+0000 7feab259c640 1 -- 172.21.15.38:0/3768353780 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab415e200 con 0x7feab41437f0 2023-12-22T08:53:15.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.367+0000 7feab259c640 1 --2- 172.21.15.38:0/3768353780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab41437f0 0x7feab40b3920 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009870 tx=0x7feaa402b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d21f9710e78f7e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:15.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.368+0000 7feab1d9b640 1 -- 172.21.15.38:0/3768353780 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4030850 con 0x7feab41437f0 2023-12-22T08:53:15.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.368+0000 7feab1d9b640 1 -- 172.21.15.38:0/3768353780 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa40309b0 con 0x7feab41437f0 2023-12-22T08:53:15.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.368+0000 7feab1d9b640 1 -- 172.21.15.38:0/3768353780 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4030d40 con 0x7feab41437f0 2023-12-22T08:53:15.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.368+0000 7feab359e640 1 -- 172.21.15.38:0/3768353780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab41437f0 msgr2=0x7feab40b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:15.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.368+0000 7feab359e640 1 --2- 172.21.15.38:0/3768353780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab41437f0 0x7feab40b3920 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009870 tx=0x7feaa402b990 comp rx=0 tx=0).stop 2023-12-22T08:53:15.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.368+0000 7feab359e640 1 -- 172.21.15.38:0/3768353780 shutdown_connections 2023-12-22T08:53:15.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.368+0000 7feab359e640 1 --2- 172.21.15.38:0/3768353780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab41437f0 0x7feab40b3920 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:15.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.368+0000 7feab359e640 1 -- 172.21.15.38:0/3768353780 >> 172.21.15.38:0/3768353780 conn(0x7feab40b1110 msgr2=0x7feab40b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:15.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.369+0000 7feab359e640 1 -- 172.21.15.38:0/3768353780 shutdown_connections 2023-12-22T08:53:15.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.369+0000 7feab359e640 1 -- 172.21.15.38:0/3768353780 wait complete. 2023-12-22T08:53:15.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.370+0000 7feab359e640 1 Processor -- start 2023-12-22T08:53:15.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.370+0000 7feab359e640 1 -- start start 2023-12-22T08:53:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.371+0000 7feab359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feab406f960 0x7feab40c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.371+0000 7feab359e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feab41437f0 0x7feab41f6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.371+0000 7feab359e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4143bd0 0x7feab413fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.371+0000 7feab359e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab40aeaf0 con 0x7feab4143bd0 2023-12-22T08:53:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.371+0000 7feab359e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab40aed90 con 0x7feab41437f0 2023-12-22T08:53:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.371+0000 7feab359e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab41401b0 con 0x7feab406f960 2023-12-22T08:53:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.372+0000 7feab2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4143bd0 0x7feab413fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.372+0000 7feab2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4143bd0 0x7feab413fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46286/0 (socket says 172.21.15.38:46286) 2023-12-22T08:53:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.372+0000 7feab2d9d640 1 -- 172.21.15.38:0/3849437690 learned_addr learned my addr 172.21.15.38:0/3849437690 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.372+0000 7feab259c640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feab406f960 0x7feab40c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.372+0000 7feaa9d9b640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feab41437f0 0x7feab41f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.372+0000 7feab2d9d640 1 -- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feab406f960 msgr2=0x7feab40c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.372+0000 7feab2d9d640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feab406f960 0x7feab40c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.372+0000 7feab2d9d640 1 -- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feab41437f0 msgr2=0x7feab41f6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.372+0000 7feab2d9d640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feab41437f0 0x7feab41f6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.372+0000 7feab2d9d640 1 -- 172.21.15.38:0/3849437690 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40094d0 con 0x7feab4143bd0 2023-12-22T08:53:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.372+0000 7feab259c640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feab406f960 0x7feab40c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:15.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.373+0000 7feab2d9d640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4143bd0 0x7feab413fc70 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7feaac00c780 tx=0x7feaac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:15.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.373+0000 7feaab7fe640 1 -- 172.21.15.38:0/3849437690 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac004b60 con 0x7feab4143bd0 2023-12-22T08:53:15.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.373+0000 7feaab7fe640 1 -- 172.21.15.38:0/3849437690 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac00ce90 con 0x7feab4143bd0 2023-12-22T08:53:15.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.373+0000 7feaab7fe640 1 -- 172.21.15.38:0/3849437690 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac00a850 con 0x7feab4143bd0 2023-12-22T08:53:15.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.373+0000 7feab359e640 1 -- 172.21.15.38:0/3849437690 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab40c8a70 con 0x7feab4143bd0 2023-12-22T08:53:15.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.373+0000 7feab359e640 1 -- 172.21.15.38:0/3849437690 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab409b8d0 con 0x7feab4143bd0 2023-12-22T08:53:15.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.375+0000 7feab359e640 1 -- 172.21.15.38:0/3849437690 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab409baf0 con 0x7feab4143bd0 2023-12-22T08:53:15.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.376+0000 7feaab7fe640 1 -- 172.21.15.38:0/3849437690 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feaac00a9b0 con 0x7feab4143bd0 2023-12-22T08:53:15.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.377+0000 7feaab7fe640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea9406a460 0x7fea9406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:15.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.377+0000 7feaab7fe640 1 -- 172.21.15.38:0/3849437690 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feaac088a70 con 0x7feab4143bd0 2023-12-22T08:53:15.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.378+0000 7feab259c640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea9406a460 0x7fea9406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:15.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.379+0000 7feab259c640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea9406a460 0x7fea9406c920 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7feaa4036000 tx=0x7feaa403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:15.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.382+0000 7feaab7fe640 1 -- 172.21.15.38:0/3849437690 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feaac054060 con 0x7feab4143bd0 2023-12-22T08:53:15.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.583+0000 7feab359e640 1 -- 172.21.15.38:0/3849437690 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7feab4061910 con 0x7feab4143bd0 2023-12-22T08:53:15.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.734+0000 7feaab7fe640 1 -- 172.21.15.38:0/3849437690 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v191) v1 ==== 181+0+0 (secure 0 0 0) 0x7feaac057680 con 0x7feab4143bd0 2023-12-22T08:53:15.735 INFO:teuthology.orchestra.run.smithi038.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-22T08:53:15.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.737+0000 7feab359e640 1 -- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea9406a460 msgr2=0x7fea9406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:15.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.737+0000 7feab359e640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea9406a460 0x7fea9406c920 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7feaa4036000 tx=0x7feaa403b040 comp rx=0 tx=0).stop 2023-12-22T08:53:15.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.737+0000 7feab359e640 1 -- 172.21.15.38:0/3849437690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4143bd0 msgr2=0x7feab413fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:15.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.737+0000 7feab359e640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4143bd0 0x7feab413fc70 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7feaac00c780 tx=0x7feaac00cc40 comp rx=0 tx=0).stop 2023-12-22T08:53:15.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.737+0000 7feab359e640 1 -- 172.21.15.38:0/3849437690 shutdown_connections 2023-12-22T08:53:15.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.738+0000 7feab359e640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fea9406a460 0x7fea9406c920 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:15.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.738+0000 7feab359e640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feab4143bd0 0x7feab413fc70 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:15.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.738+0000 7feab359e640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feab41437f0 0x7feab41f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:15.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.738+0000 7feab359e640 1 --2- 172.21.15.38:0/3849437690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feab406f960 0x7feab40c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:15.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.738+0000 7feab359e640 1 -- 172.21.15.38:0/3849437690 >> 172.21.15.38:0/3849437690 conn(0x7feab40b1110 msgr2=0x7feab40adda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:15.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.738+0000 7feab359e640 1 -- 172.21.15.38:0/3849437690 shutdown_connections 2023-12-22T08:53:15.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:15.738+0000 7feab359e640 1 -- 172.21.15.38:0/3849437690 wait complete. 2023-12-22T08:53:15.761 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-22T08:53:16.004 INFO:teuthology.orchestra.run.smithi038.stdout:{"osd_mon_report_interval":"5"} 2023-12-22T08:53:16.004 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-22T08:53:16.004 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-12-22T08:53:16.004 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:53:16.004 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:16.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:16.060 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-12-22T08:53:16.307 INFO:teuthology.orchestra.run.smithi038.stderr:16+0 records in 2023-12-22T08:53:16.307 INFO:teuthology.orchestra.run.smithi038.stderr:16+0 records out 2023-12-22T08:53:16.307 INFO:teuthology.orchestra.run.smithi038.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.181189 s, 92.6 MB/s 2023-12-22T08:53:16.309 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:53:16.309 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:16.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:16.366 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-12-22T08:53:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:17+0 records in 2023-12-22T08:53:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:17+0 records out 2023-12-22T08:53:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.190928 s, 93.4 MB/s 2023-12-22T08:53:16.616 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-22T08:53:16.616 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:53:16.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.829+0000 7fcb6ffff640 1 Processor -- start 2023-12-22T08:53:16.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.830+0000 7fcb6ffff640 1 -- start start 2023-12-22T08:53:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.831+0000 7fcb6ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb700a44a0 0x7fcb700708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.831+0000 7fcb6ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb70070e30 0x7fcb7015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.831+0000 7fcb6ffff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb700cdae0 con 0x7fcb7015b420 2023-12-22T08:53:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.831+0000 7fcb6ffff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb70071250 con 0x7fcb700a44a0 2023-12-22T08:53:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.831+0000 7fcb6ffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7015b800 con 0x7fcb70070e30 2023-12-22T08:53:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.831+0000 7fcb67fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb700a44a0 0x7fcb700708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.831+0000 7fcb67fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcb700a44a0 0x7fcb700708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46300/0 (socket says 172.21.15.38:46300) 2023-12-22T08:53:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.832+0000 7fcb67fff640 1 -- 172.21.15.38:0/38027415 learned_addr learned my addr 172.21.15.38:0/38027415 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.832+0000 7fcb67fff640 1 -- 172.21.15.38:0/38027415 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb70070e30 msgr2=0x7fcb7015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.832+0000 7fcb6f7fe640 1 --2- 172.21.15.38:0/38027415 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb70070e30 0x7fcb7015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.832+0000 7fcb67fff640 1 --2- 172.21.15.38:0/38027415 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb70070e30 0x7fcb7015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.832+0000 7fcb67fff640 1 -- 172.21.15.38:0/38027415 >> v1:172.21.15.89:6789/0 conn(0x7fcb7015b420 legacy=0x7fcb7006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.832+0000 7fcb67fff640 1 -- 172.21.15.38:0/38027415 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700cdd30 con 0x7fcb700a44a0 2023-12-22T08:53:16.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.832+0000 7fcb6f7fe640 1 --2- 172.21.15.38:0/38027415 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb70070e30 0x7fcb7015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.833+0000 7fcb67fff640 1 --2- 172.21.15.38:0/38027415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb700a44a0 0x7fcb700708f0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009870 tx=0x7fcb5802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8262fbf4d78d4376 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.833+0000 7fcb6e7fc640 1 -- 172.21.15.38:0/38027415 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58031640 con 0x7fcb700a44a0 2023-12-22T08:53:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.834+0000 7fcb6e7fc640 1 -- 172.21.15.38:0/38027415 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb580317a0 con 0x7fcb700a44a0 2023-12-22T08:53:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.834+0000 7fcb6e7fc640 1 -- 172.21.15.38:0/38027415 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58031b30 con 0x7fcb700a44a0 2023-12-22T08:53:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.834+0000 7fcb6ffff640 1 -- 172.21.15.38:0/38027415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb700a44a0 msgr2=0x7fcb700708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.834+0000 7fcb6ffff640 1 --2- 172.21.15.38:0/38027415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb700a44a0 0x7fcb700708f0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009870 tx=0x7fcb5802b8f0 comp rx=0 tx=0).stop 2023-12-22T08:53:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.834+0000 7fcb6ffff640 1 -- 172.21.15.38:0/38027415 shutdown_connections 2023-12-22T08:53:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.834+0000 7fcb6ffff640 1 --2- 172.21.15.38:0/38027415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb700a44a0 0x7fcb700708f0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.834+0000 7fcb6ffff640 1 --2- 172.21.15.38:0/38027415 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb70070e30 0x7fcb7015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.834+0000 7fcb6ffff640 1 -- 172.21.15.38:0/38027415 >> 172.21.15.38:0/38027415 conn(0x7fcb700b1f70 msgr2=0x7fcb700b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.834+0000 7fcb6ffff640 1 -- 172.21.15.38:0/38027415 shutdown_connections 2023-12-22T08:53:16.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.834+0000 7fcb6ffff640 1 -- 172.21.15.38:0/38027415 wait complete. 2023-12-22T08:53:16.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.836+0000 7fcb6ffff640 1 Processor -- start 2023-12-22T08:53:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.836+0000 7fcb6ffff640 1 -- start start 2023-12-22T08:53:16.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.837+0000 7fcb6ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb70070e30 0x7fcb7014b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:16.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.837+0000 7fcb6ffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb700a44a0 0x7fcb700a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:16.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.837+0000 7fcb6ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb7015b420 0x7fcb701f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:16.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.837+0000 7fcb6ffff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb701f3b60 con 0x7fcb70070e30 2023-12-22T08:53:16.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.837+0000 7fcb6ffff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7014b5c0 con 0x7fcb7015b420 2023-12-22T08:53:16.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.837+0000 7fcb6ffff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700a41c0 con 0x7fcb700a44a0 2023-12-22T08:53:16.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.837+0000 7fcb6effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb70070e30 0x7fcb7014b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:16.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.837+0000 7fcb6effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb70070e30 0x7fcb7014b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46302/0 (socket says 172.21.15.38:46302) 2023-12-22T08:53:16.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.837+0000 7fcb6effd640 1 -- 172.21.15.38:0/2878594579 learned_addr learned my addr 172.21.15.38:0/2878594579 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:16.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.838+0000 7fcb6f7fe640 1 --2- 172.21.15.38:0/2878594579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb7015b420 0x7fcb701f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:16.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.838+0000 7fcb6effd640 1 -- 172.21.15.38:0/2878594579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb700a44a0 msgr2=0x7fcb700a3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:16.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.838+0000 7fcb6effd640 1 --2- 172.21.15.38:0/2878594579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb700a44a0 0x7fcb700a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:16.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.838+0000 7fcb6effd640 1 -- 172.21.15.38:0/2878594579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb7015b420 msgr2=0x7fcb701f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:16.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.838+0000 7fcb6effd640 1 --2- 172.21.15.38:0/2878594579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb7015b420 0x7fcb701f2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:16.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.838+0000 7fcb6effd640 1 -- 172.21.15.38:0/2878594579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb580094d0 con 0x7fcb70070e30 2023-12-22T08:53:16.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.838+0000 7fcb6effd640 1 --2- 172.21.15.38:0/2878594579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb70070e30 0x7fcb7014b080 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000c430 tx=0x7fcb6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:16.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.838+0000 7fcb6cff9640 1 -- 172.21.15.38:0/2878594579 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60011790 con 0x7fcb70070e30 2023-12-22T08:53:16.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.838+0000 7fcb6cff9640 1 -- 172.21.15.38:0/2878594579 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb600118f0 con 0x7fcb70070e30 2023-12-22T08:53:16.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.838+0000 7fcb6cff9640 1 -- 172.21.15.38:0/2878594579 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60011ce0 con 0x7fcb70070e30 2023-12-22T08:53:16.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.838+0000 7fcb6ffff640 1 -- 172.21.15.38:0/2878594579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb70154970 con 0x7fcb70070e30 2023-12-22T08:53:16.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.839+0000 7fcb6ffff640 1 -- 172.21.15.38:0/2878594579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb70154f30 con 0x7fcb70070e30 2023-12-22T08:53:16.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.840+0000 7fcb6ffff640 1 -- 172.21.15.38:0/2878594579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb70061910 con 0x7fcb70070e30 2023-12-22T08:53:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.841+0000 7fcb6cff9640 1 -- 172.21.15.38:0/2878594579 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcb6001c460 con 0x7fcb70070e30 2023-12-22T08:53:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.842+0000 7fcb6cff9640 1 --2- 172.21.15.38:0/2878594579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb5006a460 0x7fcb5006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.842+0000 7fcb6cff9640 1 -- 172.21.15.38:0/2878594579 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb60088820 con 0x7fcb70070e30 2023-12-22T08:53:16.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.842+0000 7fcb67fff640 1 --2- 172.21.15.38:0/2878594579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb5006a460 0x7fcb5006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:16.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.844+0000 7fcb67fff640 1 --2- 172.21.15.38:0/2878594579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb5006a460 0x7fcb5006c920 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcb58036000 tx=0x7fcb58030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:16.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:16.846+0000 7fcb6cff9640 1 -- 172.21.15.38:0/2878594579 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcb60053e00 con 0x7fcb70070e30 2023-12-22T08:53:17.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.042+0000 7fcb6ffff640 1 -- 172.21.15.38:0/2878594579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcb700cb5c0 con 0x7fcb70070e30 2023-12-22T08:53:17.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.046+0000 7fcb6cff9640 1 -- 172.21.15.38:0/2878594579 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v191) v1 ==== 81+0+33506 (secure 0 0 0) 0x7fcb60057420 con 0x7fcb70070e30 2023-12-22T08:53:17.047 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:17.047 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:53:17.047 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 191, 2023-12-22T08:53:17.047 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:53:17.047 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:53:17.047 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:53:15.708014+0000", 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:53:17.048 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 23, 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:17.049 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:53:17.050 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:17.051 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:17.052 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:17.053 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:17.054 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:17.055 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.055 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.055 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.055 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 22, 2023-12-22T08:53:17.055 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:53:17.055 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:02.354802+0000", 2023-12-22T08:53:17.055 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:17.055 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:17.055 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:17.055 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:17.055 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:17.056 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "189", 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:17.057 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:17.058 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:17.059 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:17.060 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 23, 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:03.461583+0000", 2023-12-22T08:53:17.061 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:53:17.062 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "191", 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:17.063 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 33554432, 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:17.064 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:17.065 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.067 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.068 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:53:17.069 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:17.069 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.069 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.069 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.069 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:53:17.069 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:17.069 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.069 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.069 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.069 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:17.069 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.069 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.069 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.070 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:53:17.070 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:17.070 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.070 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.070 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.070 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:53:17.070 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:17.070 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.070 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.070 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.070 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:17.070 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.070 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.071 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:53:17.072 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:17.073 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:53:17.074 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:53:17.075 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:17.076 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:17.078 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:53:17.079 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:17.080 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.081 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.081 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.081 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:53:17.081 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:17.081 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.081 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.081 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.081 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:17.081 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.081 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.081 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.081 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:53:17.081 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:53:17.082 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:17.083 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:17.084 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.085 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:17.086 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.087 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:53:17.088 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:17.089 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.090 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.091 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.092 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.093 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:17.094 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.095 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.096 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:53:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:53:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.099 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.100 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.101 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.102 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:53:17.103 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:17.104 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:17.105 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.106 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.107 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:17.108 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:53:17.109 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:17.110 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.111 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:17.114 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.115 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:53:17.116 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:17.117 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:53:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.048+0000 7fcb6ffff640 1 -- 172.21.15.38:0/2878594579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb5006a460 msgr2=0x7fcb5006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.048+0000 7fcb6ffff640 1 --2- 172.21.15.38:0/2878594579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb5006a460 0x7fcb5006c920 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcb58036000 tx=0x7fcb58030000 comp rx=0 tx=0).stop 2023-12-22T08:53:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.048+0000 7fcb6ffff640 1 -- 172.21.15.38:0/2878594579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb70070e30 msgr2=0x7fcb7014b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.048+0000 7fcb6ffff640 1 --2- 172.21.15.38:0/2878594579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb70070e30 0x7fcb7014b080 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000c430 tx=0x7fcb6000c8f0 comp rx=0 tx=0).stop 2023-12-22T08:53:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.048+0000 7fcb6ffff640 1 -- 172.21.15.38:0/2878594579 shutdown_connections 2023-12-22T08:53:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.048+0000 7fcb6ffff640 1 --2- 172.21.15.38:0/2878594579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb7015b420 0x7fcb701f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.048+0000 7fcb6ffff640 1 --2- 172.21.15.38:0/2878594579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb700a44a0 0x7fcb700a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.048+0000 7fcb6ffff640 1 --2- 172.21.15.38:0/2878594579 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fcb5006a460 0x7fcb5006c920 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.048+0000 7fcb6ffff640 1 --2- 172.21.15.38:0/2878594579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb70070e30 0x7fcb7014b080 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.048+0000 7fcb6ffff640 1 -- 172.21.15.38:0/2878594579 >> 172.21.15.38:0/2878594579 conn(0x7fcb700b1f70 msgr2=0x7fcb7006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.049+0000 7fcb6ffff640 1 -- 172.21.15.38:0/2878594579 shutdown_connections 2023-12-22T08:53:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:17.049+0000 7fcb6ffff640 1 -- 172.21.15.38:0/2878594579 wait complete. 2023-12-22T08:53:17.121 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-22T08:53:19.896 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:53:19.906 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:53:22.121 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:53:22.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.358+0000 7fda921a2640 1 Processor -- start 2023-12-22T08:53:22.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.358+0000 7fda921a2640 1 -- start start 2023-12-22T08:53:22.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.360+0000 7fda921a2640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fda8c15b420 0x7fda8c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:22.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.360+0000 7fda921a2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda8c071000 0x7fda8c15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:22.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.360+0000 7fda921a2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8c0cdae0 con 0x7fda8c0a44a0 2023-12-22T08:53:22.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.360+0000 7fda921a2640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8c06dec0 con 0x7fda8c15b420 2023-12-22T08:53:22.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.360+0000 7fda921a2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c15b800 con 0x7fda8c071000 2023-12-22T08:53:22.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.360+0000 7fda911a0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fda8c15b420 0x7fda8c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:22.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.360+0000 7fda911a0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fda8c15b420 0x7fda8c06d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58718/0 (socket says 172.21.15.38:58718) 2023-12-22T08:53:22.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.360+0000 7fda911a0640 1 -- 172.21.15.38:0/3700901195 learned_addr learned my addr 172.21.15.38:0/3700901195 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:22.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.360+0000 7fda919a1640 1 --2- 172.21.15.38:0/3700901195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda8c071000 0x7fda8c15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:22.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.361+0000 7fda911a0640 1 -- 172.21.15.38:0/3700901195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda8c071000 msgr2=0x7fda8c15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:22.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.361+0000 7fda911a0640 1 --2- 172.21.15.38:0/3700901195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda8c071000 0x7fda8c15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:22.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.361+0000 7fda911a0640 1 -- 172.21.15.38:0/3700901195 >> v1:172.21.15.89:6789/0 conn(0x7fda8c0a44a0 legacy=0x7fda8c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:22.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.361+0000 7fda911a0640 1 -- 172.21.15.38:0/3700901195 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0cdd30 con 0x7fda8c15b420 2023-12-22T08:53:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.363+0000 7fda911a0640 1 --2- 172.21.15.38:0/3700901195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda8c15b420 0x7fda8c06d980 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fda88009870 tx=0x7fda8802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a6f8053f31fc18 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.363+0000 7fda83fff640 1 -- 172.21.15.38:0/3700901195 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88030840 con 0x7fda8c15b420 2023-12-22T08:53:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.363+0000 7fda83fff640 1 -- 172.21.15.38:0/3700901195 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda880309a0 con 0x7fda8c15b420 2023-12-22T08:53:22.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.363+0000 7fda83fff640 1 -- 172.21.15.38:0/3700901195 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88030d30 con 0x7fda8c15b420 2023-12-22T08:53:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.364+0000 7fda921a2640 1 -- 172.21.15.38:0/3700901195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda8c15b420 msgr2=0x7fda8c06d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.364+0000 7fda921a2640 1 --2- 172.21.15.38:0/3700901195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda8c15b420 0x7fda8c06d980 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fda88009870 tx=0x7fda8802b980 comp rx=0 tx=0).stop 2023-12-22T08:53:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.364+0000 7fda921a2640 1 -- 172.21.15.38:0/3700901195 shutdown_connections 2023-12-22T08:53:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.364+0000 7fda921a2640 1 --2- 172.21.15.38:0/3700901195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda8c071000 0x7fda8c15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.364+0000 7fda921a2640 1 --2- 172.21.15.38:0/3700901195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda8c15b420 0x7fda8c06d980 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.364+0000 7fda921a2640 1 -- 172.21.15.38:0/3700901195 >> 172.21.15.38:0/3700901195 conn(0x7fda8c0b1f70 msgr2=0x7fda8c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.364+0000 7fda921a2640 1 -- 172.21.15.38:0/3700901195 shutdown_connections 2023-12-22T08:53:22.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.364+0000 7fda921a2640 1 -- 172.21.15.38:0/3700901195 wait complete. 2023-12-22T08:53:22.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.366+0000 7fda921a2640 1 Processor -- start 2023-12-22T08:53:22.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.366+0000 7fda921a2640 1 -- start start 2023-12-22T08:53:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.367+0000 7fda921a2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda8c071000 0x7fda8c14a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.367+0000 7fda921a2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda8c0a44a0 0x7fda8c1e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.367+0000 7fda921a2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda8c15b420 0x7fda8c0a2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.367+0000 7fda921a2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c1e44b0 con 0x7fda8c071000 2023-12-22T08:53:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.367+0000 7fda921a2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c1e4790 con 0x7fda8c15b420 2023-12-22T08:53:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.367+0000 7fda921a2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c1e4a70 con 0x7fda8c0a44a0 2023-12-22T08:53:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.367+0000 7fda911a0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda8c071000 0x7fda8c14a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.367+0000 7fda911a0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda8c071000 0x7fda8c14a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58732/0 (socket says 172.21.15.38:58732) 2023-12-22T08:53:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.367+0000 7fda911a0640 1 -- 172.21.15.38:0/3373098184 learned_addr learned my addr 172.21.15.38:0/3373098184 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.368+0000 7fda919a1640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda8c15b420 0x7fda8c0a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:22.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.368+0000 7fda9099f640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda8c0a44a0 0x7fda8c1e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.368+0000 7fda911a0640 1 -- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda8c0a44a0 msgr2=0x7fda8c1e3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.368+0000 7fda911a0640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda8c0a44a0 0x7fda8c1e3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.368+0000 7fda911a0640 1 -- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda8c15b420 msgr2=0x7fda8c0a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.368+0000 7fda911a0640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda8c15b420 0x7fda8c0a2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.368+0000 7fda911a0640 1 -- 172.21.15.38:0/3373098184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda880094d0 con 0x7fda8c071000 2023-12-22T08:53:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.368+0000 7fda9099f640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda8c0a44a0 0x7fda8c1e3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:53:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.369+0000 7fda911a0640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda8c071000 0x7fda8c14a210 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fda88000c00 tx=0x7fda88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.369+0000 7fda81ffb640 1 -- 172.21.15.38:0/3373098184 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88039c90 con 0x7fda8c071000 2023-12-22T08:53:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.369+0000 7fda921a2640 1 -- 172.21.15.38:0/3373098184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8c1e4d50 con 0x7fda8c071000 2023-12-22T08:53:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.369+0000 7fda81ffb640 1 -- 172.21.15.38:0/3373098184 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda88039df0 con 0x7fda8c071000 2023-12-22T08:53:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.369+0000 7fda81ffb640 1 -- 172.21.15.38:0/3373098184 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88043640 con 0x7fda8c071000 2023-12-22T08:53:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.369+0000 7fda921a2640 1 -- 172.21.15.38:0/3373098184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8c14a750 con 0x7fda8c071000 2023-12-22T08:53:22.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.370+0000 7fda921a2640 1 -- 172.21.15.38:0/3373098184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8c0a0610 con 0x7fda8c071000 2023-12-22T08:53:22.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.372+0000 7fda81ffb640 1 -- 172.21.15.38:0/3373098184 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fda880437a0 con 0x7fda8c071000 2023-12-22T08:53:22.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.373+0000 7fda81ffb640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda7006a430 0x7fda7006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:22.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.373+0000 7fda81ffb640 1 -- 172.21.15.38:0/3373098184 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda8803e070 con 0x7fda8c071000 2023-12-22T08:53:22.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.373+0000 7fda81ffb640 1 -- 172.21.15.38:0/3373098184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7fda70071f60 con 0x7fda8c071000 2023-12-22T08:53:22.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.373+0000 7fda9099f640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda7006a430 0x7fda7006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:22.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.374+0000 7fda9099f640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda7006a430 0x7fda7006c8f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0a3980 tx=0x7fda7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:22.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.377+0000 7fda81ffb640 1 -- 172.21.15.38:0/3373098184 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fda88076f50 con 0x7fda8c071000 2023-12-22T08:53:22.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.575+0000 7fda921a2640 1 -- 172.21.15.38:0/3373098184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fda8c0ce2c0 con 0x7fda8c071000 2023-12-22T08:53:22.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.577+0000 7fda81ffb640 1 -- 172.21.15.38:0/3373098184 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v192) v1 ==== 81+0+33525 (secure 0 0 0) 0x7fda88034020 con 0x7fda8c071000 2023-12-22T08:53:22.579 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:22.579 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:53:22.579 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 192, 2023-12-22T08:53:22.579 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:53:22.580 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:53:22.580 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:53:21.407773+0000", 2023-12-22T08:53:22.580 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:53:22.580 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:53:22.580 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:53:22.580 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:53:22.580 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:53:22.580 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:53:22.580 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:53:22.580 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:53:22.580 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:53:22.580 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 23, 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.581 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:53:22.582 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:53:22.582 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:53:22.582 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:22.582 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:22.629 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:22.629 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:22.629 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:22.629 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:22.629 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:22.629 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:22.629 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:22.629 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:22.630 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:22.630 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:22.630 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:53:22.630 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:53:22.630 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:53:22.630 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:53:22.630 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:53:22.630 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:22.630 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:22.630 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:22.630 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:22.631 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:22.631 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:22.631 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:22.631 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.631 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:53:22.631 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:22.631 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:22.631 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:22.631 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:22.631 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:22.631 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:22.631 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:22.631 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:22.632 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:22.632 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:22.632 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:22.632 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:22.632 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:22.632 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:22.632 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:22.632 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:22.632 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:22.633 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:22.633 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:22.633 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:22.633 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:22.633 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:22.633 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:22.633 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:22.633 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:22.633 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:22.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.634 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:22.634 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:22.634 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:22.634 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:22.634 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:22.634 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:22.634 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:22.634 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:22.634 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:22.634 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:22.634 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:22.635 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:22.635 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:53:22.635 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:53:22.635 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.635 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:22.635 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:53:22.635 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.635 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:22.635 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:53:22.635 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:53:22.635 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:53:22.635 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:53:22.636 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:53:22.636 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:22.636 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:22.636 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:22.636 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.636 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.636 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.636 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 22, 2023-12-22T08:53:22.636 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:53:22.636 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:02.354802+0000", 2023-12-22T08:53:22.636 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:22.636 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:22.636 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:22.637 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:22.637 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:22.637 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:22.637 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:22.637 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:22.637 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:22.637 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:22.637 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:22.637 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:22.637 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:53:22.637 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:53:22.637 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:53:22.638 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:53:22.638 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:53:22.638 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:22.638 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:22.638 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:22.638 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:22.638 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:22.638 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:22.638 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:22.638 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.638 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "189", 2023-12-22T08:53:22.638 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:22.638 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:22.639 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:22.639 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:22.639 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:22.639 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:22.639 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:22.639 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:22.639 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:22.639 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:22.639 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:22.639 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:22.639 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:22.639 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.640 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:22.641 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:22.641 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:22.641 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:22.641 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:22.641 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:22.641 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:22.641 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:22.641 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:22.641 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:22.641 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:22.641 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:22.641 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:53:22.641 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:53:22.642 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:53:22.642 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.642 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:22.642 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:22.642 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:53:22.642 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.642 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.642 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:22.642 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:53:22.642 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:53:22.643 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:22.643 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:53:22.643 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:53:22.643 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:22.643 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:22.643 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:22.643 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.643 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.643 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.643 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 23, 2023-12-22T08:53:22.643 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:53:22.643 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:03.461583+0000", 2023-12-22T08:53:22.644 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1027, 2023-12-22T08:53:22.644 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-22T08:53:22.644 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:22.644 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:22.644 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:22.644 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:22.644 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:22.645 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:22.645 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:22.645 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:22.645 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:22.645 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:22.645 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:53:22.646 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:53:22.646 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:53:22.646 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:53:22.646 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:53:22.646 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:22.646 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:22.646 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:22.646 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:22.647 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:22.647 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:22.647 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:22.647 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.647 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "192", 2023-12-22T08:53:22.647 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:22.647 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:22.647 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:22.647 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:22.648 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:22.648 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:22.648 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:22.648 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:22.648 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:22.648 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 33554432, 2023-12-22T08:53:22.648 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:22.648 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:22.648 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:22.649 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:22.649 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:22.649 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:22.649 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:22.649 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:22.649 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:22.649 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:22.649 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:22.650 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:22.650 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:22.650 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:22.650 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:22.650 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:22.650 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.650 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:22.650 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:22.650 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:22.650 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:22.651 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:22.651 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:22.651 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:22.651 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:22.651 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:22.651 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:22.651 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:22.651 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:22.651 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:53:22.651 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:53:22.651 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.652 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:22.652 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:22.652 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:53:22.652 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.652 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.652 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:22.652 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:53:22.652 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:22.653 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:22.654 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:22.654 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:22.654 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:22.654 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:22.654 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:22.654 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:22.655 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:22.655 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:22.655 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:22.655 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:22.655 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.655 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.655 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.655 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:53:22.655 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.656 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.657 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.657 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:53:22.657 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:22.657 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.657 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.657 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.657 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:22.657 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.657 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.658 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.658 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:53:22.658 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:22.658 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.658 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.658 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.658 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:53:22.658 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:22.658 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.658 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.659 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.660 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:53:22.660 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:53:22.660 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:53:22.660 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:53:22.660 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:22.660 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:22.660 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:22.660 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.660 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.660 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.660 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:22.660 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:22.661 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:22.661 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:22.661 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:22.661 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:22.661 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:22.661 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:22.661 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:22.661 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:22.661 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:22.661 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:22.661 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:22.661 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.661 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.662 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:53:22.663 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:53:22.664 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:22.665 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:22.666 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.667 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:53:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:53:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:22.668 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:22.669 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.670 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:22.671 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:22.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:22.673 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.674 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.674 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.674 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:53:22.674 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:22.674 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.674 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.674 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.674 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:22.674 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.674 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.674 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.674 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:53:22.674 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:22.675 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.676 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.676 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.676 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:53:22.676 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:22.676 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.676 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.676 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.676 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:53:22.676 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:53:22.676 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:53:22.676 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:53:22.677 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:22.677 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:22.677 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:22.677 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.677 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.677 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.677 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:22.677 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:22.677 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:22.677 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:22.677 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:22.677 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:22.678 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:22.678 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:22.678 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:22.678 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:22.678 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:22.678 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:22.679 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:22.679 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.679 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.679 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.679 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:53:22.679 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:22.679 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.679 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.679 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.679 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:53:22.679 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:22.679 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.679 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.680 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.680 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:22.680 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.680 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.680 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.680 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:53:22.680 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:22.680 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.680 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.680 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.680 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:53:22.680 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:22.681 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.681 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.681 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.681 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:22.681 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.681 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.681 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.681 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:53:22.682 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:22.682 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.682 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.682 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.682 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:53:22.682 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:22.682 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.682 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.682 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.683 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:22.683 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.683 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.683 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.683 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:53:22.683 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:22.683 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.683 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.684 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.684 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:53:22.684 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:22.684 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.684 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.684 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.684 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:53:22.685 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:53:22.685 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:53:22.685 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:53:22.685 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:22.685 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:22.685 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:22.685 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.686 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.686 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.686 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:22.686 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:22.686 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:22.686 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:22.686 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:22.687 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:22.687 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:22.687 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:22.687 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:22.687 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:22.687 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:22.687 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:22.688 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:22.688 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.688 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.688 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.688 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:53:22.688 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:22.688 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.688 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.688 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.689 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:53:22.689 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:22.689 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.689 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.689 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.689 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:22.690 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.690 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.690 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.690 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:53:22.690 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:22.690 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.690 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.691 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.691 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:53:22.691 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:22.691 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.691 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.691 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.691 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:22.692 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.692 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.692 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.692 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:53:22.692 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:22.692 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.692 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.692 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.693 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:53:22.693 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:22.693 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.693 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.693 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.693 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:22.693 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.693 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.694 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.694 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:53:22.694 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:22.694 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.694 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.694 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.695 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:22.696 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.697 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.697 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.697 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:53:22.697 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:22.697 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.697 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.697 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.697 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:53:22.697 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:22.697 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.697 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.698 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.699 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.699 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:22.699 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.699 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.699 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.699 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:53:22.699 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:22.699 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.699 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.699 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.699 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:53:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:53:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.700 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:22.701 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:22.702 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.703 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.704 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:22.705 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.706 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:22.706 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:53:22.706 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:22.706 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.706 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.706 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:22.706 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:53:22.706 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:22.706 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.706 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.706 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.706 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:22.707 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:22.708 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:22.708 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:22.708 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:53:22.708 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:22.708 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.708 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.708 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:22.708 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:22.708 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:22.709 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:22.709 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:22.709 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:22.709 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:53:22.709 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:22.709 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.709 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.709 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:22.709 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:22.709 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:22.709 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:22.709 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:22.709 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:22.710 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:53:22.710 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:22.710 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.710 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.710 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:22.710 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:22.710 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:22.710 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:22.710 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:22.710 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:22.710 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:53:22.710 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:22.711 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:22.712 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:53:22.713 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:53:22.714 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:53:22.715 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:53:22.715 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:53:22.715 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:53:22.715 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:53:22.715 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:53:22.715 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:53:22.715 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:53:22.715 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:53:22.715 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:22.715 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:53:22.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.580+0000 7fda921a2640 1 -- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda7006a430 msgr2=0x7fda7006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:22.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.580+0000 7fda921a2640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda7006a430 0x7fda7006c8f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0a3980 tx=0x7fda7c009040 comp rx=0 tx=0).stop 2023-12-22T08:53:22.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.580+0000 7fda921a2640 1 -- 172.21.15.38:0/3373098184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda8c071000 msgr2=0x7fda8c14a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:22.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.580+0000 7fda921a2640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda8c071000 0x7fda8c14a210 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fda88000c00 tx=0x7fda88004730 comp rx=0 tx=0).stop 2023-12-22T08:53:22.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.580+0000 7fda921a2640 1 -- 172.21.15.38:0/3373098184 shutdown_connections 2023-12-22T08:53:22.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.580+0000 7fda921a2640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda8c15b420 0x7fda8c0a2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.580+0000 7fda921a2640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda8c0a44a0 0x7fda8c1e3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.580+0000 7fda921a2640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda7006a430 0x7fda7006c8f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.580+0000 7fda921a2640 1 --2- 172.21.15.38:0/3373098184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda8c071000 0x7fda8c14a210 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.580+0000 7fda921a2640 1 -- 172.21.15.38:0/3373098184 >> 172.21.15.38:0/3373098184 conn(0x7fda8c0b1f70 msgr2=0x7fda8c09de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.581+0000 7fda921a2640 1 -- 172.21.15.38:0/3373098184 shutdown_connections 2023-12-22T08:53:22.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:22.581+0000 7fda921a2640 1 -- 172.21.15.38:0/3373098184 wait complete. 2023-12-22T08:53:22.718 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-22T08:53:22.719 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:53:22.719 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:22.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:22.783 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-12-22T08:53:23.172 INFO:teuthology.orchestra.run.smithi038.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-12-22T08:53:23.172 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records in 2023-12-22T08:53:23.172 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records out 2023-12-22T08:53:23.172 INFO:teuthology.orchestra.run.smithi038.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.321179 s, 163 MB/s 2023-12-22T08:53:23.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:53:23.174 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:53:23.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.395+0000 7f5c52c79640 1 Processor -- start 2023-12-22T08:53:23.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.395+0000 7f5c52c79640 1 -- start start 2023-12-22T08:53:23.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.397+0000 7f5c52c79640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5c4c15b420 0x7f5c4c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:23.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.397+0000 7f5c52c79640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5c4c0a44a0 0x7f5c4c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:23.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.397+0000 7f5c52c79640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c0cdae0 con 0x7f5c4c070e30 2023-12-22T08:53:23.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.397+0000 7f5c52c79640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c06dec0 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.397+0000 7f5c52c79640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c071250 con 0x7f5c4c15b420 2023-12-22T08:53:23.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.397+0000 7f5c51476640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5c4c0a44a0 0x7f5c4c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:23.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.397+0000 7f5c51476640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5c4c0a44a0 0x7f5c4c0708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58738/0 (socket says 172.21.15.38:58738) 2023-12-22T08:53:23.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.397+0000 7f5c51476640 1 -- 172.21.15.38:0/1773913983 learned_addr learned my addr 172.21.15.38:0/1773913983 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:23.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.398+0000 7f5c51c77640 1 --2- 172.21.15.38:0/1773913983 >> v2:172.21.15.89:3300/0 conn(0x7f5c4c15b420 0x7f5c4c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:23.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.398+0000 7f5c51476640 1 -- 172.21.15.38:0/1773913983 >> v2:172.21.15.89:3300/0 conn(0x7f5c4c15b420 msgr2=0x7f5c4c06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:23.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.398+0000 7f5c51476640 1 --2- 172.21.15.38:0/1773913983 >> v2:172.21.15.89:3300/0 conn(0x7f5c4c15b420 0x7f5c4c06d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:23.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.398+0000 7f5c51476640 1 -- 172.21.15.38:0/1773913983 >> v1:172.21.15.89:6789/0 conn(0x7f5c4c070e30 legacy=0x7f5c4c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:23.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.398+0000 7f5c51476640 1 -- 172.21.15.38:0/1773913983 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c15b800 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.399+0000 7f5c51476640 1 --2- 172.21.15.38:0/1773913983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c0a44a0 0x7f5c4c0708f0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0613e0 tx=0x7f5c3c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3905f75e894f9a9b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:23.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.399+0000 7f5c50c75640 1 -- 172.21.15.38:0/1773913983 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c031870 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.400+0000 7f5c50c75640 1 -- 172.21.15.38:0/1773913983 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c0319d0 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.400+0000 7f5c50c75640 1 -- 172.21.15.38:0/1773913983 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c031d60 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.400+0000 7f5c52c79640 1 -- 172.21.15.38:0/1773913983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c0a44a0 msgr2=0x7f5c4c0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:23.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.400+0000 7f5c52c79640 1 --2- 172.21.15.38:0/1773913983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c0a44a0 0x7f5c4c0708f0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0613e0 tx=0x7f5c3c02b910 comp rx=0 tx=0).stop 2023-12-22T08:53:23.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.400+0000 7f5c52c79640 1 -- 172.21.15.38:0/1773913983 shutdown_connections 2023-12-22T08:53:23.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.400+0000 7f5c52c79640 1 --2- 172.21.15.38:0/1773913983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c0a44a0 0x7f5c4c0708f0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:23.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.400+0000 7f5c52c79640 1 --2- 172.21.15.38:0/1773913983 >> v2:172.21.15.89:3300/0 conn(0x7f5c4c15b420 0x7f5c4c06d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:23.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.400+0000 7f5c52c79640 1 -- 172.21.15.38:0/1773913983 >> 172.21.15.38:0/1773913983 conn(0x7f5c4c0b1f70 msgr2=0x7f5c4c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:23.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.400+0000 7f5c52c79640 1 -- 172.21.15.38:0/1773913983 shutdown_connections 2023-12-22T08:53:23.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.401+0000 7f5c52c79640 1 -- 172.21.15.38:0/1773913983 wait complete. 2023-12-22T08:53:23.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.402+0000 7f5c52c79640 1 Processor -- start 2023-12-22T08:53:23.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.402+0000 7f5c52c79640 1 -- start start 2023-12-22T08:53:23.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.403+0000 7f5c52c79640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c4c070e30 0x7f5c4c0c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:23.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.403+0000 7f5c52c79640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c0a44a0 0x7f5c4c158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:23.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.403+0000 7f5c52c79640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c4c15b420 0x7f5c4c159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:23.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.403+0000 7f5c52c79640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c3650 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.403+0000 7f5c52c79640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c3930 con 0x7f5c4c070e30 2023-12-22T08:53:23.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.403+0000 7f5c52c79640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c3c10 con 0x7f5c4c15b420 2023-12-22T08:53:23.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.404+0000 7f5c51476640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c0a44a0 0x7f5c4c158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:23.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.404+0000 7f5c51476640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c0a44a0 0x7f5c4c158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58754/0 (socket says 172.21.15.38:58754) 2023-12-22T08:53:23.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.404+0000 7f5c51476640 1 -- 172.21.15.38:0/3015440122 learned_addr learned my addr 172.21.15.38:0/3015440122 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.404+0000 7f5c51c77640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c4c070e30 0x7f5c4c0c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.404+0000 7f5c51476640 1 -- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c4c15b420 msgr2=0x7f5c4c159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.404+0000 7f5c52478640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c4c15b420 0x7f5c4c159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.404+0000 7f5c51476640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c4c15b420 0x7f5c4c159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.404+0000 7f5c51476640 1 -- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c4c070e30 msgr2=0x7f5c4c0c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:23.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.404+0000 7f5c51476640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c4c070e30 0x7f5c4c0c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.404+0000 7f5c51476640 1 -- 172.21.15.38:0/3015440122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c0094d0 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.404+0000 7f5c51c77640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c4c070e30 0x7f5c4c0c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.405+0000 7f5c51476640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c0a44a0 0x7f5c4c158fd0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c000c00 tx=0x7f5c3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.405+0000 7f5c427fc640 1 -- 172.21.15.38:0/3015440122 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c03abe0 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.405+0000 7f5c427fc640 1 -- 172.21.15.38:0/3015440122 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c03ad40 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.405+0000 7f5c427fc640 1 -- 172.21.15.38:0/3015440122 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c044610 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.405+0000 7f5c52c79640 1 -- 172.21.15.38:0/3015440122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c0c3ef0 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.405+0000 7f5c52c79640 1 -- 172.21.15.38:0/3015440122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c0c5630 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.406+0000 7f5c52c79640 1 -- 172.21.15.38:0/3015440122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c0c5820 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.407+0000 7f5c427fc640 1 -- 172.21.15.38:0/3015440122 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c3c04d450 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.408+0000 7f5c427fc640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5c3006a430 0x7f5c3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.408+0000 7f5c427fc640 1 -- 172.21.15.38:0/3015440122 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c3c02d040 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.408+0000 7f5c427fc640 1 -- 172.21.15.38:0/3015440122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f5c30071f60 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.409+0000 7f5c51c77640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5c3006a430 0x7f5c3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:23.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.410+0000 7f5c51c77640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5c3006a430 0x7f5c3006c8f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5c48006fd0 tx=0x7f5c48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:23.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.413+0000 7f5c427fc640 1 -- 172.21.15.38:0/3015440122 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5c3c035060 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.607+0000 7f5c52c79640 1 -- 172.21.15.38:0/3015440122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5c4c0cb8d0 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.609+0000 7f5c427fc640 1 -- 172.21.15.38:0/3015440122 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v192) v1 ==== 81+0+33525 (secure 0 0 0) 0x7f5c4c0cb8d0 con 0x7f5c4c0a44a0 2023-12-22T08:53:23.615 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:23.615 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:53:23.615 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 192, 2023-12-22T08:53:23.615 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:53:23.615 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:53:23.615 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:53:21.407773+0000", 2023-12-22T08:53:23.615 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:53:23.616 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 23, 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:23.617 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:53:23.618 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:23.619 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:23.620 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:23.621 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:53:23.622 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 22, 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:02.354802+0000", 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:23.623 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "189", 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:23.625 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:23.626 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:23.627 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:23.628 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 23, 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:03.461583+0000", 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1027, 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:23.629 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:23.630 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "192", 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:23.631 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:23.632 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:23.632 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 33554432, 2023-12-22T08:53:23.632 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:23.632 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:23.632 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:23.632 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:23.632 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:23.632 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:23.632 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:23.632 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:23.632 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:23.632 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:23.632 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:23.633 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:53:23.634 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:53:23.635 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:23.635 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:53:23.635 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:53:23.635 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:23.635 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:23.635 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:23.635 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.635 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.635 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:23.635 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:53:23.635 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.635 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.636 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.637 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.638 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:53:23.639 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:23.640 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:23.641 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.642 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.643 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:23.644 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:53:23.645 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:23.646 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:53:23.647 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:53:23.648 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:53:23.649 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:23.650 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:23.651 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.652 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:53:23.653 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:23.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:23.655 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.656 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.656 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.656 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:53:23.656 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:23.656 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.656 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.656 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.656 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:53:23.656 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:53:23.656 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:53:23.656 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:53:23.656 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:23.656 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:23.661 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:23.661 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.661 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.661 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.661 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:23.661 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:23.661 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:23.661 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:23.662 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:23.662 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:23.662 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:23.662 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:23.662 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:23.662 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:23.662 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:23.662 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:23.662 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:23.662 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.662 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.663 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.664 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.665 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:23.666 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:23.667 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.668 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.670 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.671 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:23.672 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.674 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.675 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:53:23.676 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:23.677 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.677 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.677 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.677 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:53:23.677 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:53:23.677 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:53:23.677 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:53:23.677 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:23.677 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:23.677 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:23.677 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.677 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.677 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.678 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.679 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.680 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:23.681 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:23.682 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:53:23.683 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:23.684 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:23.685 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:23.686 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:23.687 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:23.688 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:53:23.689 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:23.690 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:53:23.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.612+0000 7f5c52c79640 1 -- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5c3006a430 msgr2=0x7f5c3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:23.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.612+0000 7f5c52c79640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5c3006a430 0x7f5c3006c8f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5c48006fd0 tx=0x7f5c48008040 comp rx=0 tx=0).stop 2023-12-22T08:53:23.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.612+0000 7f5c52c79640 1 -- 172.21.15.38:0/3015440122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c0a44a0 msgr2=0x7f5c4c158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:23.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.612+0000 7f5c52c79640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c0a44a0 0x7f5c4c158fd0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c000c00 tx=0x7f5c3c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:53:23.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.612+0000 7f5c52c79640 1 -- 172.21.15.38:0/3015440122 shutdown_connections 2023-12-22T08:53:23.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.612+0000 7f5c52c79640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c4c15b420 0x7f5c4c159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:23.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.612+0000 7f5c52c79640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5c3006a430 0x7f5c3006c8f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:23.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.612+0000 7f5c52c79640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5c4c0a44a0 0x7f5c4c158fd0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:23.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.612+0000 7f5c52c79640 1 --2- 172.21.15.38:0/3015440122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c4c070e30 0x7f5c4c0c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:23.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.612+0000 7f5c52c79640 1 -- 172.21.15.38:0/3015440122 >> 172.21.15.38:0/3015440122 conn(0x7f5c4c0b1f70 msgr2=0x7f5c4c15db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:23.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.612+0000 7f5c52c79640 1 -- 172.21.15.38:0/3015440122 shutdown_connections 2023-12-22T08:53:23.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.612+0000 7f5c52c79640 1 -- 172.21.15.38:0/3015440122 wait complete. 2023-12-22T08:53:23.693 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:53:23.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.928+0000 7f7a23079640 1 Processor -- start 2023-12-22T08:53:23.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.928+0000 7f7a23079640 1 -- start start 2023-12-22T08:53:23.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.929+0000 7f7a23079640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7a1c0a44a0 0x7f7a1c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:23.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.929+0000 7f7a23079640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c0cdae0 con 0x7f7a1c070e30 2023-12-22T08:53:23.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.929+0000 7f7a23079640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c071250 con 0x7f7a1c15b420 2023-12-22T08:53:23.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.929+0000 7f7a23079640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c15b800 con 0x7f7a1c0a44a0 2023-12-22T08:53:23.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.930+0000 7f7a21876640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7a1c0a44a0 0x7f7a1c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:23.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.930+0000 7f7a21876640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7a1c0a44a0 0x7f7a1c0708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58762/0 (socket says 172.21.15.38:58762) 2023-12-22T08:53:23.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.930+0000 7f7a21876640 1 -- 172.21.15.38:0/2439196962 learned_addr learned my addr 172.21.15.38:0/2439196962 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:23.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.930+0000 7f7a21876640 1 -- 172.21.15.38:0/2439196962 >> v1:172.21.15.89:6789/0 conn(0x7f7a1c15b420 legacy=0x7f7a1c06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:23.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.930+0000 7f7a21876640 1 -- 172.21.15.38:0/2439196962 >> v1:172.21.15.38:6789/0 conn(0x7f7a1c070e30 legacy=0x7f7a1c15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:23.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.930+0000 7f7a21876640 1 -- 172.21.15.38:0/2439196962 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0cdd30 con 0x7f7a1c0a44a0 2023-12-22T08:53:23.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.931+0000 7f7a21876640 1 --2- 172.21.15.38:0/2439196962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a1c0a44a0 0x7f7a1c0708f0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009870 tx=0x7f7a0c02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53801659ae779e9e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:23.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.932+0000 7f7a21075640 1 -- 172.21.15.38:0/2439196962 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c02f850 con 0x7f7a1c0a44a0 2023-12-22T08:53:23.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.932+0000 7f7a21075640 1 -- 172.21.15.38:0/2439196962 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c02f9b0 con 0x7f7a1c0a44a0 2023-12-22T08:53:23.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.932+0000 7f7a21075640 1 -- 172.21.15.38:0/2439196962 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c02fd40 con 0x7f7a1c0a44a0 2023-12-22T08:53:23.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.932+0000 7f7a23079640 1 -- 172.21.15.38:0/2439196962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a1c0a44a0 msgr2=0x7f7a1c0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:23.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.932+0000 7f7a23079640 1 --2- 172.21.15.38:0/2439196962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a1c0a44a0 0x7f7a1c0708f0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009870 tx=0x7f7a0c02ba30 comp rx=0 tx=0).stop 2023-12-22T08:53:23.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.933+0000 7f7a23079640 1 -- 172.21.15.38:0/2439196962 shutdown_connections 2023-12-22T08:53:23.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.933+0000 7f7a23079640 1 --2- 172.21.15.38:0/2439196962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a1c0a44a0 0x7f7a1c0708f0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:23.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.933+0000 7f7a23079640 1 -- 172.21.15.38:0/2439196962 >> 172.21.15.38:0/2439196962 conn(0x7f7a1c0b1f70 msgr2=0x7f7a1c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:23.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.933+0000 7f7a23079640 1 -- 172.21.15.38:0/2439196962 shutdown_connections 2023-12-22T08:53:23.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.933+0000 7f7a23079640 1 -- 172.21.15.38:0/2439196962 wait complete. 2023-12-22T08:53:23.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.934+0000 7f7a23079640 1 Processor -- start 2023-12-22T08:53:23.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.935+0000 7f7a23079640 1 -- start start 2023-12-22T08:53:23.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.936+0000 7f7a23079640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a1c070e30 0x7f7a1c149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:23.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.936+0000 7f7a23079640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a1c0a44a0 0x7f7a1c159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:23.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.936+0000 7f7a23079640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a1c15b420 0x7f7a1c09f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:23.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.936+0000 7f7a23079640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0a2b50 con 0x7f7a1c15b420 2023-12-22T08:53:23.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.936+0000 7f7a23079640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c14a300 con 0x7f7a1c070e30 2023-12-22T08:53:23.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.936+0000 7f7a23079640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0a1f40 con 0x7f7a1c0a44a0 2023-12-22T08:53:23.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.936+0000 7f7a22878640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a1c15b420 0x7f7a1c09f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:23.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.936+0000 7f7a22878640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a1c15b420 0x7f7a1c09f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58776/0 (socket says 172.21.15.38:58776) 2023-12-22T08:53:23.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.936+0000 7f7a22878640 1 -- 172.21.15.38:0/3893609052 learned_addr learned my addr 172.21.15.38:0/3893609052 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:23.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.936+0000 7f7a22077640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a1c070e30 0x7f7a1c149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:23.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.936+0000 7f7a21876640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a1c0a44a0 0x7f7a1c159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:23.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.937+0000 7f7a22878640 1 -- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a1c0a44a0 msgr2=0x7f7a1c159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:23.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.937+0000 7f7a22878640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a1c0a44a0 0x7f7a1c159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:23.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.937+0000 7f7a22878640 1 -- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a1c070e30 msgr2=0x7f7a1c149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:23.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.937+0000 7f7a22878640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a1c070e30 0x7f7a1c149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:23.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.937+0000 7f7a22878640 1 -- 172.21.15.38:0/3893609052 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c0094d0 con 0x7f7a1c15b420 2023-12-22T08:53:23.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.937+0000 7f7a22878640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a1c15b420 0x7f7a1c09f000 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400c6e0 tx=0x7f7a1400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:23.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.937+0000 7f7a12ffd640 1 -- 172.21.15.38:0/3893609052 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14003b70 con 0x7f7a1c15b420 2023-12-22T08:53:23.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.937+0000 7f7a12ffd640 1 -- 172.21.15.38:0/3893609052 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14003cf0 con 0x7f7a1c15b420 2023-12-22T08:53:23.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.937+0000 7f7a12ffd640 1 -- 172.21.15.38:0/3893609052 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14005310 con 0x7f7a1c15b420 2023-12-22T08:53:23.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.937+0000 7f7a23079640 1 -- 172.21.15.38:0/3893609052 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c0a2220 con 0x7f7a1c15b420 2023-12-22T08:53:23.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.937+0000 7f7a23079640 1 -- 172.21.15.38:0/3893609052 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c0a27e0 con 0x7f7a1c15b420 2023-12-22T08:53:23.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.938+0000 7f7a23079640 1 -- 172.21.15.38:0/3893609052 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c0a2d00 con 0x7f7a1c15b420 2023-12-22T08:53:23.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.939+0000 7f7a12ffd640 1 -- 172.21.15.38:0/3893609052 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7a14005470 con 0x7f7a1c15b420 2023-12-22T08:53:23.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.940+0000 7f7a12ffd640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7a0006a460 0x7f7a0006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:23.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.940+0000 7f7a12ffd640 1 -- 172.21.15.38:0/3893609052 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a140886a0 con 0x7f7a1c15b420 2023-12-22T08:53:23.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.941+0000 7f7a12ffd640 1 -- 172.21.15.38:0/3893609052 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f7a00071f90 con 0x7f7a1c15b420 2023-12-22T08:53:23.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.941+0000 7f7a22077640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7a0006a460 0x7f7a0006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:23.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.942+0000 7f7a22077640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7a0006a460 0x7f7a0006c920 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f7a18000f60 tx=0x7f7a18009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:23.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:23.945+0000 7f7a12ffd640 1 -- 172.21.15.38:0/3893609052 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7a14003e60 con 0x7f7a1c15b420 2023-12-22T08:53:24.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.175+0000 7f7a23079640 1 -- 172.21.15.38:0/3893609052 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a1c061910 con 0x7f7a1c15b420 2023-12-22T08:53:24.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.176+0000 7f7a12ffd640 1 -- 172.21.15.38:0/3893609052 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4649 (secure 0 0 0) 0x7f7a14003e60 con 0x7f7a1c15b420 2023-12-22T08:53:24.177 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:24.177 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2952705616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2952705616},{"type":"v1","addr":"172.21.15.89:6835","nonce":2952705616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/3842752964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":3842752964},{"type":"v1","addr":"172.21.15.89:6837","nonce":3842752964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/261655608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":261655608},{"type":"v1","addr":"172.21.15.38:6834","nonce":261655608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:53:04.462294+0000","modified":"2023-12-22T08:53:07.483358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8940":{"gid":8940,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3350465616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3350465616},{"type":"v1","addr":"172.21.15.38:6835","nonce":3350465616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-22T08:53:24.177 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 86 2023-12-22T08:53:24.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.179+0000 7f7a23079640 1 -- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7a0006a460 msgr2=0x7f7a0006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:24.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.179+0000 7f7a23079640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7a0006a460 0x7f7a0006c920 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f7a18000f60 tx=0x7f7a18009040 comp rx=0 tx=0).stop 2023-12-22T08:53:24.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.179+0000 7f7a23079640 1 -- 172.21.15.38:0/3893609052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a1c15b420 msgr2=0x7f7a1c09f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:24.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.179+0000 7f7a23079640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a1c15b420 0x7f7a1c09f000 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400c6e0 tx=0x7f7a1400cba0 comp rx=0 tx=0).stop 2023-12-22T08:53:24.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.179+0000 7f7a23079640 1 -- 172.21.15.38:0/3893609052 shutdown_connections 2023-12-22T08:53:24.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.179+0000 7f7a23079640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7a0006a460 0x7f7a0006c920 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:24.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.179+0000 7f7a23079640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a1c15b420 0x7f7a1c09f000 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:24.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.179+0000 7f7a23079640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a1c0a44a0 0x7f7a1c159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:24.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.179+0000 7f7a23079640 1 --2- 172.21.15.38:0/3893609052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a1c070e30 0x7f7a1c149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:24.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.179+0000 7f7a23079640 1 -- 172.21.15.38:0/3893609052 >> 172.21.15.38:0/3893609052 conn(0x7f7a1c0b1f70 msgr2=0x7f7a1c0a3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:24.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.179+0000 7f7a23079640 1 -- 172.21.15.38:0/3893609052 shutdown_connections 2023-12-22T08:53:24.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.179+0000 7f7a23079640 1 -- 172.21.15.38:0/3893609052 wait complete. 2023-12-22T08:53:24.198 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-22T08:53:24.442 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":8940,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":19.958568516,"mdsmap_epoch":86,"osdmap_epoch":192,"osdmap_epoch_barrier":192,"uptime":25.785124452000002} 2023-12-22T08:53:24.443 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 8940, "mdsmap_epoch": 86, "osdmap_epoch": 192, "osdmap_epoch_barrier": 192, "rank_uptime": 19.958568516, "state": "up:active", "uptime": 25.785124452, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:53:24.443 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-22T08:53:24.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:24.443 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-22T08:53:24.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:24.502 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-22T08:53:24.581 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:53:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.803+0000 7f091f2d7640 1 Processor -- start 2023-12-22T08:53:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.804+0000 7f091f2d7640 1 -- start start 2023-12-22T08:53:24.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.806+0000 7f091f2d7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f091814b320 0x7f09180b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:24.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.806+0000 7f091f2d7640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0918070370 con 0x7f09180cc560 2023-12-22T08:53:24.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.806+0000 7f091f2d7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09180b3730 con 0x7f09180cc940 2023-12-22T08:53:24.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.806+0000 7f091f2d7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09180b3a10 con 0x7f091814b320 2023-12-22T08:53:24.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.806+0000 7f091e2d5640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f09180cc560 0x7f091806fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56116/0 (socket says 172.21.15.38:56116) 2023-12-22T08:53:24.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.806+0000 7f091e2d5640 1 -- 172.21.15.38:0/4243608186 learned_addr learned my addr 172.21.15.38:0/4243608186 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:24.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.806+0000 7f091dad4640 1 --2- 172.21.15.38:0/4243608186 >> v2:172.21.15.89:3300/0 conn(0x7f091814b320 0x7f09180b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:24.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.806+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753762253 0 0) 0x7f0918070370 con 0x7f09180cc560 2023-12-22T08:53:24.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.806+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0904003520 con 0x7f09180cc560 2023-12-22T08:53:24.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2226892456 0 0) 0x7f0904003520 con 0x7f09180cc560 2023-12-22T08:53:24.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 >> v2:172.21.15.89:3300/0 conn(0x7f091814b320 msgr2=0x7f09180b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:24.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091d2d3640 1 --2- 172.21.15.38:0/4243608186 >> v2:172.21.15.89:3300/0 conn(0x7f091814b320 0x7f09180b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:24.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 >> v1:172.21.15.89:6789/0 conn(0x7f09180cc940 legacy=0x7f09180cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:24.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09180b3cf0 con 0x7f09180cc560 2023-12-22T08:53:24.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f0914001670 con 0x7f09180cc560 2023-12-22T08:53:24.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091dad4640 1 --2- 172.21.15.38:0/4243608186 >> v2:172.21.15.89:3300/0 conn(0x7f091814b320 0x7f09180b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:53:24.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 >> v1:172.21.15.38:6789/0 conn(0x7f09180cc560 legacy=0x7f091806fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:24.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091d2d3640 1 --2- 172.21.15.38:0/4243608186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0904003970 0x7f0904003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:24.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091d2d3640 1 --2- 172.21.15.38:0/4243608186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09040047c0 0x7f0904004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:24.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091d2d3640 1 --2- 172.21.15.38:0/4243608186 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0904005380 0x7f090400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:24.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09180b3a10 con 0x7f0904003970 2023-12-22T08:53:24.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090400c210 con 0x7f09040047c0 2023-12-22T08:53:24.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090400c3d0 con 0x7f0904005380 2023-12-22T08:53:24.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.807+0000 7f091e2d5640 1 --2- 172.21.15.38:0/4243608186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0904003970 0x7f0904003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:24.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.808+0000 7f091ead6640 1 --2- 172.21.15.38:0/4243608186 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0904005380 0x7f090400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:24.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.808+0000 7f091e2d5640 1 -- 172.21.15.38:0/4243608186 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0904005380 msgr2=0x7f090400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:24.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.808+0000 7f091dad4640 1 --2- 172.21.15.38:0/4243608186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09040047c0 0x7f0904004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:24.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.808+0000 7f091e2d5640 1 --2- 172.21.15.38:0/4243608186 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0904005380 0x7f090400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:24.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.808+0000 7f091e2d5640 1 -- 172.21.15.38:0/4243608186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09040047c0 msgr2=0x7f0904004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:24.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.808+0000 7f091e2d5640 1 --2- 172.21.15.38:0/4243608186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09040047c0 0x7f0904004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:24.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.808+0000 7f091e2d5640 1 -- 172.21.15.38:0/4243608186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0904003520 con 0x7f0904003970 2023-12-22T08:53:24.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.808+0000 7f091ead6640 1 --2- 172.21.15.38:0/4243608186 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0904005380 0x7f090400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:24.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.808+0000 7f091ead6640 1 -- 172.21.15.38:0/4243608186 reap_dead start 2023-12-22T08:53:24.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.809+0000 7f091e2d5640 1 --2- 172.21.15.38:0/4243608186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0904003970 0x7f0904003d90 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f091400c240 tx=0x7f09040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183f2e3956eb23a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:24.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.809+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0914005ad0 con 0x7f0904003970 2023-12-22T08:53:24.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.809+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0914005c30 con 0x7f0904003970 2023-12-22T08:53:24.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.809+0000 7f091d2d3640 1 -- 172.21.15.38:0/4243608186 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091402caf0 con 0x7f0904003970 2023-12-22T08:53:24.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.810+0000 7f091f2d7640 1 -- 172.21.15.38:0/4243608186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0904003970 msgr2=0x7f0904003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:24.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.810+0000 7f091f2d7640 1 --2- 172.21.15.38:0/4243608186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0904003970 0x7f0904003d90 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f091400c240 tx=0x7f09040057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:24.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.810+0000 7f091f2d7640 1 -- 172.21.15.38:0/4243608186 shutdown_connections 2023-12-22T08:53:24.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.810+0000 7f091f2d7640 1 --2- 172.21.15.38:0/4243608186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0904003970 0x7f0904003d90 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:24.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.810+0000 7f091f2d7640 1 -- 172.21.15.38:0/4243608186 >> 172.21.15.38:0/4243608186 conn(0x7f09180b1c70 msgr2=0x7f09180b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:24.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.810+0000 7f091f2d7640 1 -- 172.21.15.38:0/4243608186 shutdown_connections 2023-12-22T08:53:24.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.810+0000 7f091f2d7640 1 -- 172.21.15.38:0/4243608186 wait complete. 2023-12-22T08:53:24.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.812+0000 7f091f2d7640 1 Processor -- start 2023-12-22T08:53:24.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.812+0000 7f091f2d7640 1 -- start start 2023-12-22T08:53:24.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.813+0000 7f091f2d7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0904003970 0x7f09180cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.813+0000 7f091f2d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0918160b10 0x7f0918160f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.813+0000 7f091f2d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09181f6e30 0x7f09181f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.813+0000 7f091f2d7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09181fa400 con 0x7f09181f6e30 2023-12-22T08:53:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.813+0000 7f091f2d7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09181faca0 con 0x7f0918160b10 2023-12-22T08:53:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.813+0000 7f091f2d7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09181f7bd0 con 0x7f0904003970 2023-12-22T08:53:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.814+0000 7f091ead6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09181f6e30 0x7f09181f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.814+0000 7f091ead6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09181f6e30 0x7f09181f72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58794/0 (socket says 172.21.15.38:58794) 2023-12-22T08:53:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.814+0000 7f091ead6640 1 -- 172.21.15.38:0/3451366829 learned_addr learned my addr 172.21.15.38:0/3451366829 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.814+0000 7f091dad4640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0918160b10 0x7f0918160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.814+0000 7f091e2d5640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0904003970 0x7f09180cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.814+0000 7f091ead6640 1 -- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0904003970 msgr2=0x7f09180cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.814+0000 7f091ead6640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0904003970 0x7f09180cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.814+0000 7f091ead6640 1 -- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0918160b10 msgr2=0x7f0918160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:24.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.814+0000 7f091ead6640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0918160b10 0x7f0918160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:24.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.814+0000 7f091ead6640 1 -- 172.21.15.38:0/3451366829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09181fa650 con 0x7f09181f6e30 2023-12-22T08:53:24.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.815+0000 7f091ead6640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09181f6e30 0x7f09181f72c0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f09180b5520 tx=0x7f091000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:24.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.815+0000 7f090effd640 1 -- 172.21.15.38:0/3451366829 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910003b70 con 0x7f09181f6e30 2023-12-22T08:53:24.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.815+0000 7f090effd640 1 -- 172.21.15.38:0/3451366829 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0910003cf0 con 0x7f09181f6e30 2023-12-22T08:53:24.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.815+0000 7f091f2d7640 1 -- 172.21.15.38:0/3451366829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09181fa930 con 0x7f09181f6e30 2023-12-22T08:53:24.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.815+0000 7f090effd640 1 -- 172.21.15.38:0/3451366829 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910003ea0 con 0x7f09181f6e30 2023-12-22T08:53:24.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.815+0000 7f091f2d7640 1 -- 172.21.15.38:0/3451366829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09181f7800 con 0x7f09181f6e30 2023-12-22T08:53:24.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.816+0000 7f091f2d7640 1 -- 172.21.15.38:0/3451366829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09181fae30 con 0x7f09181f6e30 2023-12-22T08:53:24.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.818+0000 7f090effd640 1 -- 172.21.15.38:0/3451366829 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f09100052b0 con 0x7f09181f6e30 2023-12-22T08:53:24.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.818+0000 7f090effd640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f08fc06a460 0x7f08fc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:24.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.819+0000 7f090effd640 1 -- 172.21.15.38:0/3451366829 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0910088170 con 0x7f09181f6e30 2023-12-22T08:53:24.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.819+0000 7f090effd640 1 -- 172.21.15.38:0/3451366829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f08fc071f90 con 0x7f09181f6e30 2023-12-22T08:53:24.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.819+0000 7f091e2d5640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f08fc06a460 0x7f08fc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.820+0000 7f091e2d5640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f08fc06a460 0x7f08fc06c920 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0914034000 tx=0x7f0914009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:24.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:24.823+0000 7f090effd640 1 -- 172.21.15.38:0/3451366829 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0910018020 con 0x7f09181f6e30 2023-12-22T08:53:25.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.014+0000 7f091f2d7640 1 -- 172.21.15.38:0/3451366829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0918061910 con 0x7f09181f6e30 2023-12-22T08:53:25.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.016+0000 7f090effd640 1 -- 172.21.15.38:0/3451366829 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v192) v1 ==== 81+0+33525 (secure 0 0 0) 0x7f0910053810 con 0x7f09181f6e30 2023-12-22T08:53:25.018 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:25.019 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:53:25.019 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 192, 2023-12-22T08:53:25.019 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:53:25.019 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:53:25.019 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:53:21.407773+0000", 2023-12-22T08:53:25.019 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:53:25.020 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:53:25.020 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:53:25.020 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:53:25.020 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:53:25.020 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:53:25.021 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:53:25.021 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:53:25.021 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:53:25.021 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:25.021 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:53:25.021 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:53:25.022 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:53:25.022 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:53:25.022 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:53:25.022 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 23, 2023-12-22T08:53:25.022 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:53:25.022 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:53:25.023 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:53:25.023 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:53:25.023 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:53:25.023 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:53:25.023 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.023 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:53:25.023 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:53:25.024 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:53:25.024 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:25.024 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:25.024 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:25.024 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:25.024 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:25.025 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:25.025 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:25.025 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:25.025 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:25.025 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:25.025 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:25.026 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:25.026 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:53:25.026 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:53:25.026 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:53:25.026 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:53:25.026 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:53:25.026 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:25.027 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:25.027 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:25.027 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:25.027 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:25.027 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:25.027 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:25.027 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.027 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:53:25.028 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:25.028 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:25.028 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:25.028 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:25.028 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:25.028 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:25.028 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:25.028 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:25.029 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:25.029 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:25.029 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:25.029 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:25.029 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:25.029 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:25.030 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:25.030 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:25.030 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:25.030 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:25.030 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:25.030 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:25.031 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:25.031 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:25.031 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:25.031 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:25.031 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:25.031 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:25.032 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.032 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:25.032 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:25.032 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:25.032 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:25.032 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:25.032 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:25.032 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:25.033 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:25.033 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:25.033 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:25.033 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:25.033 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:25.033 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:53:25.033 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:53:25.034 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.034 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:25.034 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:53:25.034 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.034 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:25.034 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:53:25.034 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:53:25.035 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:53:25.035 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:53:25.035 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:53:25.035 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:25.035 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:25.035 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:25.035 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.036 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.036 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.036 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 22, 2023-12-22T08:53:25.036 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:53:25.036 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:02.354802+0000", 2023-12-22T08:53:25.036 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:25.036 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:25.037 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:25.037 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:25.037 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:25.037 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:25.037 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:25.038 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:25.038 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:25.038 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:25.038 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:25.038 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:25.038 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:53:25.038 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:53:25.039 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:53:25.039 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:53:25.039 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:53:25.039 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:25.039 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:25.039 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:25.040 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:25.040 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:25.040 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:25.040 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:25.040 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.040 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "189", 2023-12-22T08:53:25.041 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:25.041 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:25.041 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:25.041 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:25.041 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:25.041 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:25.042 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:25.042 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:25.042 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:25.042 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:25.042 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:25.042 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:25.042 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:25.043 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:25.043 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:25.043 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:25.043 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:25.043 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:25.043 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:25.044 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:25.044 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:25.044 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:25.044 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:25.044 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:25.044 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:25.044 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:25.045 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.045 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:25.045 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:25.045 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:25.045 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:25.045 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:25.045 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:25.045 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:25.046 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:25.046 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:25.046 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:25.046 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:25.046 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:25.046 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:53:25.046 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:53:25.046 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:53:25.046 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.046 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:25.046 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:25.046 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:53:25.046 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 23, 2023-12-22T08:53:25.047 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:53:25.048 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:03.461583+0000", 2023-12-22T08:53:25.048 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1027, 2023-12-22T08:53:25.048 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-22T08:53:25.048 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:25.048 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:25.048 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:25.048 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:25.048 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:25.048 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:25.048 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:25.048 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:25.049 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:25.049 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:25.049 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:53:25.049 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:53:25.049 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:53:25.049 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:53:25.049 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:53:25.049 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:25.049 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:25.049 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:25.049 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:25.049 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:25.053 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:25.053 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:25.053 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.053 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "192", 2023-12-22T08:53:25.053 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:25.053 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:25.054 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:25.054 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:25.054 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:25.054 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:25.054 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:25.054 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:25.054 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:25.054 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 33554432, 2023-12-22T08:53:25.054 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:25.054 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:25.054 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:25.054 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:25.055 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:25.055 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:25.055 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:25.055 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:25.055 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:25.055 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:25.055 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:25.055 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:25.055 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:25.055 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:25.055 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:25.055 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:25.056 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.056 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:25.056 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:25.056 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:25.056 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:25.056 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:25.057 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:25.057 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:25.057 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:25.057 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:25.057 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:25.057 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:25.058 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:25.058 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:53:25.058 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:53:25.058 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.058 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:25.058 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:25.059 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:53:25.059 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.059 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.059 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:25.059 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:53:25.059 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:53:25.060 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:25.060 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:53:25.060 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:53:25.060 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:25.060 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:25.061 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:25.061 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.061 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.061 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:25.061 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:53:25.061 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.062 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:25.062 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:25.062 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:25.062 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:25.062 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:25.062 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:25.063 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:25.063 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:25.063 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:25.063 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:25.063 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:25.063 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:25.064 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:25.064 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.064 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.064 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.064 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:53:25.064 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:25.065 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.065 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.065 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.065 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:53:25.065 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:25.065 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.066 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.066 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.066 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:25.066 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.066 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.066 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.066 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:53:25.067 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:25.067 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.067 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.067 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.067 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:53:25.067 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:25.067 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.068 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.068 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.068 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:25.068 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.068 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.068 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.068 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:53:25.069 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:25.069 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.069 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.069 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.069 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:53:25.069 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:25.069 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.070 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.070 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.070 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:25.070 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.070 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.070 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.070 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:53:25.070 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:25.071 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.071 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.071 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.071 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:53:25.071 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:25.071 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.071 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.071 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.072 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:53:25.072 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:53:25.072 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:53:25.072 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:53:25.072 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:25.072 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:25.073 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:25.073 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.073 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.073 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.073 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:25.073 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:25.074 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:25.074 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:25.074 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:25.074 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:25.074 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:25.074 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:25.075 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:25.075 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:25.075 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:25.075 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:25.075 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:25.075 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.076 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.076 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.076 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:53:25.076 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:25.076 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.076 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.076 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.076 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:53:25.077 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:25.077 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.077 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.077 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.077 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:25.077 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.077 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.078 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.078 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:53:25.078 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:25.078 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.078 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.078 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.078 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:53:25.079 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:25.079 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.079 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.079 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.079 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:25.079 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.080 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.080 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.080 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:53:25.080 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:25.080 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.080 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.080 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.081 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:53:25.081 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:25.081 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.081 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.081 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.081 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:25.082 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.082 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.082 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.082 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:53:25.082 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:25.082 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.082 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.082 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.082 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:53:25.082 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:25.082 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.082 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.082 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:25.083 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:53:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:53:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.086 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.086 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.086 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:25.086 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.086 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.086 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.086 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:53:25.086 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:25.086 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.086 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.086 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.086 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:53:25.087 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:25.088 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.088 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.088 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.088 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:25.088 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.088 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.088 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.088 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:53:25.088 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:25.088 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.088 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.089 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.089 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:53:25.089 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:25.089 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.089 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.089 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.089 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:53:25.089 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:53:25.089 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:53:25.089 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:53:25.089 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:25.089 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:25.089 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:25.090 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.090 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.090 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.090 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:25.090 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:25.090 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:25.090 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:25.090 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:25.090 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:25.090 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:25.090 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:25.090 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:25.090 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:25.091 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.092 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.092 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.092 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:25.092 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.092 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.092 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.092 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:53:25.092 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:25.093 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.093 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.093 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.093 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:53:25.093 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:25.093 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.093 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.093 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.093 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:25.093 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.093 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.093 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.093 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.094 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:53:25.095 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:25.096 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:25.096 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:25.096 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.096 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.096 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.096 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:25.096 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:25.096 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:25.097 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:25.097 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:25.097 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:25.097 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:25.097 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:25.097 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:25.097 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:25.097 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:25.097 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:25.097 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:25.097 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.097 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.097 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.098 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.099 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:53:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:53:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:53:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:53:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:53:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:53:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:25.102 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:25.103 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:25.103 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:25.103 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:25.103 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.103 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.103 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.103 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:53:25.103 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:25.104 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.105 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.106 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.106 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:53:25.106 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:25.106 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.106 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.106 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.106 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:25.107 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.107 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.107 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.107 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:53:25.107 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:25.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.107 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.107 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.108 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.109 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:25.109 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:25.109 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:25.109 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:25.109 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:25.109 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:25.109 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:25.109 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:25.109 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:25.109 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:25.109 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:25.109 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.110 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.111 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.112 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:25.113 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.113 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.113 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.113 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:53:25.113 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:25.113 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.113 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.113 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.113 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:53:25.113 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:25.114 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.114 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.114 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.114 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:53:25.114 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:53:25.114 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:53:25.114 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:53:25.114 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:25.114 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:25.114 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:25.115 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.115 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.115 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.115 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:25.115 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:25.115 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:25.115 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:25.115 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:25.115 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:25.115 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:25.115 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:25.115 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:25.115 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:25.116 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:25.116 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:25.116 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:25.116 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.116 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.116 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.116 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:53:25.116 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:25.116 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.116 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.116 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.117 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:53:25.117 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:25.117 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.117 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.117 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.117 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:25.117 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.117 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.117 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.117 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:53:25.118 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:25.118 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.118 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.118 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.118 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:53:25.118 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:25.118 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.118 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.118 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.119 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.120 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:53:25.121 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:53:25.121 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:53:25.121 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:53:25.121 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:25.121 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:25.121 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:25.121 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:25.121 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.121 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:25.121 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:53:25.121 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.121 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:25.121 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:25.122 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:25.122 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:25.122 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:25.122 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:25.122 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:53:25.122 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:25.122 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.122 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.122 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:25.122 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:25.122 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:25.122 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:25.122 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.123 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.124 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:25.124 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:25.124 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:25.124 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:25.124 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:25.124 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:25.124 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:53:25.124 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:25.124 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.124 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.124 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:25.125 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:25.125 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:25.125 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:25.125 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:25.125 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:25.125 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:53:25.125 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:25.125 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.125 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.125 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:25.125 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:25.126 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:53:25.127 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:25.127 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.127 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:25.127 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:25.127 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:25.127 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:25.127 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:25.127 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:25.127 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:25.127 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:53:25.128 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:25.128 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.128 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:25.128 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:53:25.128 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:53:25.128 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:53:25.128 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:53:25.128 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:53:25.128 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:53:25.128 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:53:25.128 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:53:25.129 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:53:25.129 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:53:25.129 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:53:25.129 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:53:25.129 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:53:25.129 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:53:25.129 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.129 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:25.129 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:53:25.129 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:53:25.130 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:53:25.130 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:53:25.130 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:53:25.130 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:53:25.130 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:53:25.130 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:53:25.130 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:53:25.130 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:53:25.130 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:53:25.130 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:25.130 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:53:25.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.019+0000 7f091f2d7640 1 -- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f08fc06a460 msgr2=0x7f08fc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:25.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.019+0000 7f091f2d7640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f08fc06a460 0x7f08fc06c920 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0914034000 tx=0x7f0914009030 comp rx=0 tx=0).stop 2023-12-22T08:53:25.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.019+0000 7f091f2d7640 1 -- 172.21.15.38:0/3451366829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09181f6e30 msgr2=0x7f09181f72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:25.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.019+0000 7f091f2d7640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09181f6e30 0x7f09181f72c0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f09180b5520 tx=0x7f091000db80 comp rx=0 tx=0).stop 2023-12-22T08:53:25.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.019+0000 7f091f2d7640 1 -- 172.21.15.38:0/3451366829 shutdown_connections 2023-12-22T08:53:25.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.019+0000 7f091f2d7640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f08fc06a460 0x7f08fc06c920 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:25.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.019+0000 7f091f2d7640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09181f6e30 0x7f09181f72c0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:25.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.019+0000 7f091f2d7640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0918160b10 0x7f0918160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:25.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.019+0000 7f091f2d7640 1 --2- 172.21.15.38:0/3451366829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0904003970 0x7f09180cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:25.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.019+0000 7f091f2d7640 1 -- 172.21.15.38:0/3451366829 >> 172.21.15.38:0/3451366829 conn(0x7f09180b1c70 msgr2=0x7f0918149e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:25.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.019+0000 7f091f2d7640 1 -- 172.21.15.38:0/3451366829 shutdown_connections 2023-12-22T08:53:25.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:25.019+0000 7f091f2d7640 1 -- 172.21.15.38:0/3451366829 wait complete. 2023-12-22T08:53:25.133 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-22T08:53:30.134 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:53:30.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.369+0000 7fc44df11640 1 Processor -- start 2023-12-22T08:53:30.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.370+0000 7fc44df11640 1 -- start start 2023-12-22T08:53:30.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.371+0000 7fc44df11640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc44815b420 0x7fc44806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:30.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.372+0000 7fc44df11640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4480cdae0 con 0x7fc4480a44a0 2023-12-22T08:53:30.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.372+0000 7fc44df11640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44806dec0 con 0x7fc448071000 2023-12-22T08:53:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.372+0000 7fc44df11640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44815b800 con 0x7fc44815b420 2023-12-22T08:53:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.372+0000 7fc44cf0f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc44815b420 0x7fc44806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.372+0000 7fc447fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc4480a44a0 0x7fc4480708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56130/0 (socket says 172.21.15.38:56130) 2023-12-22T08:53:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.372+0000 7fc447fff640 1 -- 172.21.15.38:0/2334194170 learned_addr learned my addr 172.21.15.38:0/2334194170 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.372+0000 7fc44cf0f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc44815b420 0x7fc44806d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58796/0 (socket says 172.21.15.38:58796) 2023-12-22T08:53:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.373+0000 7fc44cf0f640 1 -- 172.21.15.38:0/2334194170 >> v1:172.21.15.89:6789/0 conn(0x7fc448071000 legacy=0x7fc44815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.373+0000 7fc44cf0f640 1 -- 172.21.15.38:0/2334194170 >> v1:172.21.15.38:6789/0 conn(0x7fc4480a44a0 legacy=0x7fc4480708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:30.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.373+0000 7fc4477fe640 1 -- 172.21.15.38:0/2334194170 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697001738 0 0) 0x7fc4480cdae0 con 0x7fc4480a44a0 2023-12-22T08:53:30.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.373+0000 7fc44cf0f640 1 -- 172.21.15.38:0/2334194170 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4480cdd30 con 0x7fc44815b420 2023-12-22T08:53:30.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.374+0000 7fc44cf0f640 1 --2- 172.21.15.38:0/2334194170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc44815b420 0x7fc44806d980 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0097a0 tx=0x7fc43c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa6303bd0bb66b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:30.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.374+0000 7fc4477fe640 1 -- 172.21.15.38:0/2334194170 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c031830 con 0x7fc44815b420 2023-12-22T08:53:30.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.374+0000 7fc4477fe640 1 -- 172.21.15.38:0/2334194170 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c031990 con 0x7fc44815b420 2023-12-22T08:53:30.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.374+0000 7fc4477fe640 1 -- 172.21.15.38:0/2334194170 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c031d20 con 0x7fc44815b420 2023-12-22T08:53:30.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.374+0000 7fc44df11640 1 -- 172.21.15.38:0/2334194170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc44815b420 msgr2=0x7fc44806d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:30.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.374+0000 7fc44df11640 1 --2- 172.21.15.38:0/2334194170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc44815b420 0x7fc44806d980 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0097a0 tx=0x7fc43c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:53:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.375+0000 7fc44df11640 1 -- 172.21.15.38:0/2334194170 shutdown_connections 2023-12-22T08:53:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.375+0000 7fc44df11640 1 --2- 172.21.15.38:0/2334194170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc44815b420 0x7fc44806d980 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.375+0000 7fc44df11640 1 -- 172.21.15.38:0/2334194170 >> 172.21.15.38:0/2334194170 conn(0x7fc4480b1f70 msgr2=0x7fc4480b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.375+0000 7fc44df11640 1 -- 172.21.15.38:0/2334194170 shutdown_connections 2023-12-22T08:53:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.375+0000 7fc44df11640 1 -- 172.21.15.38:0/2334194170 wait complete. 2023-12-22T08:53:30.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.376+0000 7fc44df11640 1 Processor -- start 2023-12-22T08:53:30.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.377+0000 7fc44df11640 1 -- start start 2023-12-22T08:53:30.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.378+0000 7fc44df11640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc448071000 0x7fc4480cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:30.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.378+0000 7fc44df11640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4480a44a0 0x7fc448151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:30.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.378+0000 7fc44df11640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc44815b420 0x7fc448156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:30.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.378+0000 7fc44df11640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4481f3bc0 con 0x7fc44815b420 2023-12-22T08:53:30.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.378+0000 7fc44df11640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc448151d30 con 0x7fc4480a44a0 2023-12-22T08:53:30.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.378+0000 7fc44df11640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc448152010 con 0x7fc448071000 2023-12-22T08:53:30.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.378+0000 7fc44d710640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc44815b420 0x7fc448156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:30.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.378+0000 7fc44d710640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc44815b420 0x7fc448156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58808/0 (socket says 172.21.15.38:58808) 2023-12-22T08:53:30.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.378+0000 7fc44d710640 1 -- 172.21.15.38:0/1335310047 learned_addr learned my addr 172.21.15.38:0/1335310047 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:30.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.378+0000 7fc447fff640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4480a44a0 0x7fc448151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:30.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.378+0000 7fc44cf0f640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc448071000 0x7fc4480cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:30.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.379+0000 7fc44d710640 1 -- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc448071000 msgr2=0x7fc4480cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:30.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.379+0000 7fc44d710640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc448071000 0x7fc4480cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:30.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.379+0000 7fc44d710640 1 -- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4480a44a0 msgr2=0x7fc448151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:30.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.379+0000 7fc44d710640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4480a44a0 0x7fc448151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:30.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.379+0000 7fc44d710640 1 -- 172.21.15.38:0/1335310047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c009400 con 0x7fc44815b420 2023-12-22T08:53:30.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.379+0000 7fc44d710640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc44815b420 0x7fc448156f00 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fc44000b970 tx=0x7fc44000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:30.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.379+0000 7fc4457fa640 1 -- 172.21.15.38:0/1335310047 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44000cb40 con 0x7fc44815b420 2023-12-22T08:53:30.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.379+0000 7fc4457fa640 1 -- 172.21.15.38:0/1335310047 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44000cca0 con 0x7fc44815b420 2023-12-22T08:53:30.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.379+0000 7fc4457fa640 1 -- 172.21.15.38:0/1335310047 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440014680 con 0x7fc44815b420 2023-12-22T08:53:30.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.379+0000 7fc44df11640 1 -- 172.21.15.38:0/1335310047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4481522f0 con 0x7fc44815b420 2023-12-22T08:53:30.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.379+0000 7fc44df11640 1 -- 172.21.15.38:0/1335310047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc448157440 con 0x7fc44815b420 2023-12-22T08:53:30.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.380+0000 7fc44df11640 1 -- 172.21.15.38:0/1335310047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4481f3d70 con 0x7fc44815b420 2023-12-22T08:53:30.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.381+0000 7fc4457fa640 1 -- 172.21.15.38:0/1335310047 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc44001d3b0 con 0x7fc44815b420 2023-12-22T08:53:30.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.383+0000 7fc4457fa640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc42c06a430 0x7fc42c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:30.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.383+0000 7fc4457fa640 1 -- 172.21.15.38:0/1335310047 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc440088750 con 0x7fc44815b420 2023-12-22T08:53:30.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.383+0000 7fc4457fa640 1 -- 172.21.15.38:0/1335310047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7fc42c071f60 con 0x7fc44815b420 2023-12-22T08:53:30.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.384+0000 7fc44cf0f640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc42c06a430 0x7fc42c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:30.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.385+0000 7fc44cf0f640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc42c06a430 0x7fc42c06c8f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc43c036000 tx=0x7fc43c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:30.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.388+0000 7fc4457fa640 1 -- 172.21.15.38:0/1335310047 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc440019060 con 0x7fc44815b420 2023-12-22T08:53:30.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.582+0000 7fc44df11640 1 -- 172.21.15.38:0/1335310047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc4480ce5a0 con 0x7fc44815b420 2023-12-22T08:53:30.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.586+0000 7fc4457fa640 1 -- 172.21.15.38:0/1335310047 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v192) v1 ==== 81+0+33525 (secure 0 0 0) 0x7fc4481f3d70 con 0x7fc44815b420 2023-12-22T08:53:30.587 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:30.587 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:53:30.587 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 192, 2023-12-22T08:53:30.587 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:53:30.587 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:53:30.587 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:53:21.407773+0000", 2023-12-22T08:53:30.587 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:53:30.588 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 23, 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:30.589 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:30.590 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:30.591 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:30.592 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:30.593 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:53:30.594 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 22, 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:02.354802+0000", 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:30.595 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:30.596 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "189", 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:30.597 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:30.598 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:53:30.599 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:30.600 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 23, 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:03.461583+0000", 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1027, 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:30.601 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:30.602 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:30.602 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:30.602 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:30.602 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:30.602 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:30.602 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:53:30.602 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:53:30.602 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:53:30.602 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:53:30.602 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:53:30.603 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:30.603 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:30.603 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:30.603 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:30.603 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:30.603 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:30.603 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:30.603 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.603 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "192", 2023-12-22T08:53:30.603 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:30.603 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:30.603 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 33554432, 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:30.604 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:30.605 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.606 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.607 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.608 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.609 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.610 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:53:30.611 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:30.612 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.614 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.615 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.616 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.617 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:30.617 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.617 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.617 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.617 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:53:30.617 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:30.617 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.617 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.617 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.617 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:53:30.617 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:30.617 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.617 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:30.618 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.619 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:53:30.620 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:30.620 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.620 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.620 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.620 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:53:30.620 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:30.621 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.621 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.621 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.621 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:30.621 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.621 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.621 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.621 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:53:30.621 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:30.621 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.621 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.622 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.622 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:53:30.622 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:30.622 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.622 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.622 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.622 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:30.622 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.622 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.622 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.623 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:53:30.623 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:30.623 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.623 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.623 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.623 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:53:30.623 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:30.623 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.623 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.623 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.623 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:30.623 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:53:30.624 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:30.625 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.626 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:53:30.627 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:53:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:30.629 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:30.630 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:30.631 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:30.631 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:30.631 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:30.631 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:30.631 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:30.631 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:30.631 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:30.631 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:30.631 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:30.631 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.631 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.631 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.632 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:53:30.632 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:30.632 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.632 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.632 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.632 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:53:30.632 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:30.632 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.632 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.632 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.632 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:30.632 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:30.633 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.634 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:53:30.635 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:30.636 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:53:30.637 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:53:30.638 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:30.639 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.640 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.640 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.640 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:30.640 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.640 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.640 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.640 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:53:30.640 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:30.640 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.640 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.640 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.640 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:53:30.640 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.641 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.643 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.644 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:53:30.645 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:30.646 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:30.647 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.648 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.650 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:53:30.651 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:30.652 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:53:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:53:30.653 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:30.654 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:30.655 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:30.656 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:53:30.657 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:53:30.658 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:53:30.659 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:53:30.660 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:30.660 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:53:30.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.588+0000 7fc44df11640 1 -- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc42c06a430 msgr2=0x7fc42c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:30.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.589+0000 7fc44df11640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc42c06a430 0x7fc42c06c8f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc43c036000 tx=0x7fc43c03c040 comp rx=0 tx=0).stop 2023-12-22T08:53:30.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.589+0000 7fc44df11640 1 -- 172.21.15.38:0/1335310047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc44815b420 msgr2=0x7fc448156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:30.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.589+0000 7fc44df11640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc44815b420 0x7fc448156f00 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fc44000b970 tx=0x7fc44000be30 comp rx=0 tx=0).stop 2023-12-22T08:53:30.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.589+0000 7fc44df11640 1 -- 172.21.15.38:0/1335310047 shutdown_connections 2023-12-22T08:53:30.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.589+0000 7fc44df11640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc42c06a430 0x7fc42c06c8f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:30.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.589+0000 7fc44df11640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc44815b420 0x7fc448156f00 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:30.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.589+0000 7fc44df11640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4480a44a0 0x7fc448151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:30.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.589+0000 7fc44df11640 1 --2- 172.21.15.38:0/1335310047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc448071000 0x7fc4480cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:30.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.589+0000 7fc44df11640 1 -- 172.21.15.38:0/1335310047 >> 172.21.15.38:0/1335310047 conn(0x7fc4480b1f70 msgr2=0x7fc44815c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:30.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.589+0000 7fc44df11640 1 -- 172.21.15.38:0/1335310047 shutdown_connections 2023-12-22T08:53:30.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:30.589+0000 7fc44df11640 1 -- 172.21.15.38:0/1335310047 wait complete. 2023-12-22T08:53:30.663 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-22T08:53:35.664 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:53:35.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.906+0000 7f11c8fae640 1 Processor -- start 2023-12-22T08:53:35.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.906+0000 7f11c8fae640 1 -- start start 2023-12-22T08:53:35.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.907+0000 7f11c8fae640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f11c40cc250 0x7f11c406d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:35.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.907+0000 7f11c8fae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c406dd70 0x7f11c4159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:35.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.907+0000 7f11c8fae640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c406e1d0 con 0x7f11c415a4f0 2023-12-22T08:53:35.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.907+0000 7f11c8fae640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c4071740 con 0x7f11c40cc250 2023-12-22T08:53:35.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.907+0000 7f11c8fae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c40cc630 con 0x7f11c406dd70 2023-12-22T08:53:35.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.908+0000 7f11c37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f11c40cc250 0x7f11c406d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:35.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.908+0000 7f11c37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f11c40cc250 0x7f11c406d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41212/0 (socket says 172.21.15.38:41212) 2023-12-22T08:53:35.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.908+0000 7f11c37fe640 1 -- 172.21.15.38:0/697120697 learned_addr learned my addr 172.21.15.38:0/697120697 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:35.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.908+0000 7f11bbfff640 1 --2- 172.21.15.38:0/697120697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c406dd70 0x7f11c4159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:35.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.908+0000 7f11c37fe640 1 -- 172.21.15.38:0/697120697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c406dd70 msgr2=0x7f11c4159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:35.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.908+0000 7f11c37fe640 1 --2- 172.21.15.38:0/697120697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c406dd70 0x7f11c4159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:35.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.908+0000 7f11c37fe640 1 -- 172.21.15.38:0/697120697 >> v1:172.21.15.89:6789/0 conn(0x7f11c415a4f0 legacy=0x7f11c4156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:35.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.908+0000 7f11c37fe640 1 -- 172.21.15.38:0/697120697 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c415ad20 con 0x7f11c40cc250 2023-12-22T08:53:35.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.908+0000 7f11bbfff640 1 --2- 172.21.15.38:0/697120697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c406dd70 0x7f11c4159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:35.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.909+0000 7f11c37fe640 1 --2- 172.21.15.38:0/697120697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c40cc250 0x7f11c406d830 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009870 tx=0x7f11b402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36680c30f886ab3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:35.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.910+0000 7f11c2ffd640 1 -- 172.21.15.38:0/697120697 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4031640 con 0x7f11c40cc250 2023-12-22T08:53:35.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.910+0000 7f11c2ffd640 1 -- 172.21.15.38:0/697120697 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b40317a0 con 0x7f11c40cc250 2023-12-22T08:53:35.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.910+0000 7f11c2ffd640 1 -- 172.21.15.38:0/697120697 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4031b30 con 0x7f11c40cc250 2023-12-22T08:53:35.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.911+0000 7f11c8fae640 1 -- 172.21.15.38:0/697120697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c40cc250 msgr2=0x7f11c406d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:35.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.911+0000 7f11c8fae640 1 --2- 172.21.15.38:0/697120697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c40cc250 0x7f11c406d830 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009870 tx=0x7f11b402b8f0 comp rx=0 tx=0).stop 2023-12-22T08:53:35.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.911+0000 7f11c8fae640 1 -- 172.21.15.38:0/697120697 shutdown_connections 2023-12-22T08:53:35.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.911+0000 7f11c8fae640 1 --2- 172.21.15.38:0/697120697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c406dd70 0x7f11c4159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:35.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.911+0000 7f11c8fae640 1 --2- 172.21.15.38:0/697120697 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c40cc250 0x7f11c406d830 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:35.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.911+0000 7f11c8fae640 1 -- 172.21.15.38:0/697120697 >> 172.21.15.38:0/697120697 conn(0x7f11c40b1f70 msgr2=0x7f11c40b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:35.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.911+0000 7f11c8fae640 1 -- 172.21.15.38:0/697120697 shutdown_connections 2023-12-22T08:53:35.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.911+0000 7f11c8fae640 1 -- 172.21.15.38:0/697120697 wait complete. 2023-12-22T08:53:35.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.913+0000 7f11c8fae640 1 Processor -- start 2023-12-22T08:53:35.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.913+0000 7f11c8fae640 1 -- start start 2023-12-22T08:53:35.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.914+0000 7f11c8fae640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c406dd70 0x7f11c414f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:35.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.914+0000 7f11c8fae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c40cc250 0x7f11c415d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:35.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.914+0000 7f11c8fae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c415a4f0 0x7f11c4158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:35.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.914+0000 7f11c8fae640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c415af60 con 0x7f11c415a4f0 2023-12-22T08:53:35.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.914+0000 7f11c8fae640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c414ff90 con 0x7f11c40cc250 2023-12-22T08:53:35.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.914+0000 7f11c8fae640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c415b170 con 0x7f11c406dd70 2023-12-22T08:53:35.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.914+0000 7f11c3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c415a4f0 0x7f11c4158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:35.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.914+0000 7f11c3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c415a4f0 0x7f11c4158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41220/0 (socket says 172.21.15.38:41220) 2023-12-22T08:53:35.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.914+0000 7f11c3fff640 1 -- 172.21.15.38:0/2860188813 learned_addr learned my addr 172.21.15.38:0/2860188813 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.915+0000 7f11c37fe640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c406dd70 0x7f11c414f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.915+0000 7f11bbfff640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c40cc250 0x7f11c415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.915+0000 7f11c3fff640 1 -- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c406dd70 msgr2=0x7f11c414f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.915+0000 7f11c3fff640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c406dd70 0x7f11c414f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.915+0000 7f11c3fff640 1 -- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c40cc250 msgr2=0x7f11c415d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.915+0000 7f11c3fff640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c40cc250 0x7f11c415d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.915+0000 7f11c3fff640 1 -- 172.21.15.38:0/2860188813 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b40094d0 con 0x7f11c415a4f0 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.915+0000 7f11bbfff640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c40cc250 0x7f11c415d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.915+0000 7f11c3fff640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c415a4f0 0x7f11c4158530 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00b970 tx=0x7f11bc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.915+0000 7f11c0ff9640 1 -- 172.21.15.38:0/2860188813 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc00cb40 con 0x7f11c415a4f0 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.915+0000 7f11c0ff9640 1 -- 172.21.15.38:0/2860188813 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc00cca0 con 0x7f11c415a4f0 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.915+0000 7f11c8fae640 1 -- 172.21.15.38:0/2860188813 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c415b450 con 0x7f11c415a4f0 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.915+0000 7f11c0ff9640 1 -- 172.21.15.38:0/2860188813 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc014680 con 0x7f11c415a4f0 2023-12-22T08:53:35.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.916+0000 7f11c8fae640 1 -- 172.21.15.38:0/2860188813 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c415b730 con 0x7f11c415a4f0 2023-12-22T08:53:35.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.917+0000 7f11c8fae640 1 -- 172.21.15.38:0/2860188813 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c4150470 con 0x7f11c415a4f0 2023-12-22T08:53:35.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.918+0000 7f11c0ff9640 1 -- 172.21.15.38:0/2860188813 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f11bc01d3b0 con 0x7f11c415a4f0 2023-12-22T08:53:35.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.918+0000 7f11c0ff9640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f11a406a430 0x7f11a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:35.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.919+0000 7f11c0ff9640 1 -- 172.21.15.38:0/2860188813 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11bc088780 con 0x7f11c415a4f0 2023-12-22T08:53:35.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.919+0000 7f11c37fe640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f11a406a430 0x7f11a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:35.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.920+0000 7f11c37fe640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f11a406a430 0x7f11a406c8f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f11b4036000 tx=0x7f11b403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:35.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:35.923+0000 7f11c0ff9640 1 -- 172.21.15.38:0/2860188813 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f11c4150470 con 0x7f11c415a4f0 2023-12-22T08:53:36.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.127+0000 7f11c8fae640 1 -- 172.21.15.38:0/2860188813 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f11c4150470 con 0x7f11c415a4f0 2023-12-22T08:53:36.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.129+0000 7f11c0ff9640 1 -- 172.21.15.38:0/2860188813 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v193) v1 ==== 81+0+33506 (secure 0 0 0) 0x7f11c4150470 con 0x7f11c415a4f0 2023-12-22T08:53:36.130 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:36.131 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:53:36.131 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 193, 2023-12-22T08:53:36.131 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:53:36.131 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:53:36.131 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:53:31.412421+0000", 2023-12-22T08:53:36.131 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:53:36.131 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:53:36.131 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:53:36.131 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:53:36.131 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:53:36.131 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:53:36.131 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 23, 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:53:36.132 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:53:36.133 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.133 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:53:36.133 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:53:36.133 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:53:36.133 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:36.133 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:36.133 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:36.133 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:36.133 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:36.133 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:36.133 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:36.133 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:36.133 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:36.134 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:36.135 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.136 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:36.137 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:36.137 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:36.137 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:36.137 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:36.137 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:36.137 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:36.137 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:36.137 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:36.137 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:36.137 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:36.137 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:36.138 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:53:36.138 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:53:36.138 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.138 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:36.138 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:53:36.138 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.138 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:36.138 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:53:36.138 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:53:36.138 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:53:36.138 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:53:36.138 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:53:36.138 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:36.139 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:36.139 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:36.139 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.139 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.139 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.139 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 22, 2023-12-22T08:53:36.139 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:53:36.139 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:02.354802+0000", 2023-12-22T08:53:36.139 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:36.139 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:36.140 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:36.140 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:36.140 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:36.140 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:36.140 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:36.140 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:36.140 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:36.140 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:36.140 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:36.140 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:36.140 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:53:36.140 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:53:36.141 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:53:36.141 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:53:36.141 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:53:36.141 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:36.141 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:36.141 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:36.141 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:36.141 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:36.141 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:36.141 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:36.141 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.141 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "189", 2023-12-22T08:53:36.141 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:36.142 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:36.143 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:36.144 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:53:36.145 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.145 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.145 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:36.145 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:53:36.145 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:53:36.145 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:36.145 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:53:36.145 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:53:36.145 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:36.145 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:36.145 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 23, 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:03.461583+0000", 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:36.146 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:36.147 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:36.148 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:36.148 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.148 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "193", 2023-12-22T08:53:36.148 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:36.148 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:36.148 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:36.148 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:36.148 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:36.148 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 33554432, 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:36.149 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:36.150 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:36.151 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:36.152 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.153 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:53:36.154 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:53:36.155 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.156 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.157 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.158 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.159 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.162 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.163 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.164 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.165 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.166 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.168 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.169 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.170 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.171 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:53:36.172 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.173 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.174 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.175 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.176 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.177 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:53:36.178 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.179 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.180 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:53:36.181 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.182 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.183 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.184 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:53:36.185 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.186 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.187 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.188 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.189 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.190 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.191 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.192 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.193 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:53:36.194 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:53:36.195 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.196 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:53:36.197 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:36.198 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.199 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:53:36.200 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.201 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:53:36.202 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:53:36.202 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:53:36.202 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:53:36.202 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:53:36.202 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:53:36.202 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:53:36.202 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:53:36.202 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:53:36.202 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:53:36.202 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:53:36.202 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.202 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:53:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.132+0000 7f11c8fae640 1 -- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f11a406a430 msgr2=0x7f11a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.132+0000 7f11c8fae640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f11a406a430 0x7f11a406c8f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f11b4036000 tx=0x7f11b403c040 comp rx=0 tx=0).stop 2023-12-22T08:53:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.132+0000 7f11c8fae640 1 -- 172.21.15.38:0/2860188813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c415a4f0 msgr2=0x7f11c4158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.132+0000 7f11c8fae640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c415a4f0 0x7f11c4158530 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00b970 tx=0x7f11bc00be30 comp rx=0 tx=0).stop 2023-12-22T08:53:36.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.132+0000 7f11c8fae640 1 -- 172.21.15.38:0/2860188813 shutdown_connections 2023-12-22T08:53:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.132+0000 7f11c8fae640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f11a406a430 0x7f11a406c8f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.132+0000 7f11c8fae640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11c415a4f0 0x7f11c4158530 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.132+0000 7f11c8fae640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c40cc250 0x7f11c415d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.132+0000 7f11c8fae640 1 --2- 172.21.15.38:0/2860188813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c406dd70 0x7f11c414f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.132+0000 7f11c8fae640 1 -- 172.21.15.38:0/2860188813 >> 172.21.15.38:0/2860188813 conn(0x7f11c40b1f70 msgr2=0x7f11c40b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.132+0000 7f11c8fae640 1 -- 172.21.15.38:0/2860188813 shutdown_connections 2023-12-22T08:53:36.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.132+0000 7f11c8fae640 1 -- 172.21.15.38:0/2860188813 wait complete. 2023-12-22T08:53:36.206 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-22T08:53:36.206 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T08:53:36.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.437+0000 7f13e828b640 1 Processor -- start 2023-12-22T08:53:36.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.437+0000 7f13e828b640 1 -- start start 2023-12-22T08:53:36.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.439+0000 7f13e828b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f13e01547a0 0x7f13e015b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:36.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.439+0000 7f13e828b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e0071b90 0x7f13e0070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:36.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.439+0000 7f13e828b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f13e0154b80 0x7f13e00ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:36.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.439+0000 7f13e828b640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e00716a0 con 0x7f13e01547a0 2023-12-22T08:53:36.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.439+0000 7f13e828b640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e00710e0 con 0x7f13e0154b80 2023-12-22T08:53:36.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.439+0000 7f13e828b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00713c0 con 0x7f13e0071b90 2023-12-22T08:53:36.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.439+0000 7f13e6027640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f13e01547a0 0x7f13e015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:36.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.439+0000 7f13e6027640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f13e01547a0 0x7f13e015b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41236/0 (socket says 172.21.15.38:41236) 2023-12-22T08:53:36.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.439+0000 7f13e6027640 1 -- 172.21.15.38:0/3644649233 learned_addr learned my addr 172.21.15.38:0/3644649233 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:36.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.440+0000 7f13e5826640 1 --2- 172.21.15.38:0/3644649233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e0071b90 0x7f13e0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:36.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.440+0000 7f13e6027640 1 -- 172.21.15.38:0/3644649233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e0071b90 msgr2=0x7f13e0070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:36.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.440+0000 7f13e6027640 1 --2- 172.21.15.38:0/3644649233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e0071b90 0x7f13e0070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.440+0000 7f13e6027640 1 -- 172.21.15.38:0/3644649233 >> v2:172.21.15.89:3300/0 conn(0x7f13e0154b80 msgr2=0x7f13e00ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:36.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.440+0000 7f13e6828640 1 --2- 172.21.15.38:0/3644649233 >> v2:172.21.15.89:3300/0 conn(0x7f13e0154b80 0x7f13e00ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:36.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.440+0000 7f13e6027640 1 --2- 172.21.15.38:0/3644649233 >> v2:172.21.15.89:3300/0 conn(0x7f13e0154b80 0x7f13e00ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.440+0000 7f13e6027640 1 -- 172.21.15.38:0/3644649233 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e015ab00 con 0x7f13e01547a0 2023-12-22T08:53:36.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.441+0000 7f13e6027640 1 --2- 172.21.15.38:0/3644649233 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13e01547a0 0x7f13e015b300 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f13e00b4a30 tx=0x7f13dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ceae3050e3f333 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:36.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.441+0000 7f13e5025640 1 -- 172.21.15.38:0/3644649233 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc031870 con 0x7f13e01547a0 2023-12-22T08:53:36.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.442+0000 7f13e5025640 1 -- 172.21.15.38:0/3644649233 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc0319d0 con 0x7f13e01547a0 2023-12-22T08:53:36.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.442+0000 7f13e5025640 1 -- 172.21.15.38:0/3644649233 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc031d60 con 0x7f13e01547a0 2023-12-22T08:53:36.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.442+0000 7f13e828b640 1 -- 172.21.15.38:0/3644649233 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13e01547a0 msgr2=0x7f13e015b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:36.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.442+0000 7f13e828b640 1 --2- 172.21.15.38:0/3644649233 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13e01547a0 0x7f13e015b300 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f13e00b4a30 tx=0x7f13dc02b910 comp rx=0 tx=0).stop 2023-12-22T08:53:36.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.442+0000 7f13e828b640 1 -- 172.21.15.38:0/3644649233 shutdown_connections 2023-12-22T08:53:36.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.442+0000 7f13e828b640 1 --2- 172.21.15.38:0/3644649233 >> v2:172.21.15.89:3300/0 conn(0x7f13e0154b80 0x7f13e00ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.442+0000 7f13e828b640 1 --2- 172.21.15.38:0/3644649233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e0071b90 0x7f13e0070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.442+0000 7f13e828b640 1 --2- 172.21.15.38:0/3644649233 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13e01547a0 0x7f13e015b300 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.442+0000 7f13e828b640 1 -- 172.21.15.38:0/3644649233 >> 172.21.15.38:0/3644649233 conn(0x7f13e00cf070 msgr2=0x7f13e00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:36.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.443+0000 7f13e828b640 1 -- 172.21.15.38:0/3644649233 shutdown_connections 2023-12-22T08:53:36.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.443+0000 7f13e828b640 1 -- 172.21.15.38:0/3644649233 wait complete. 2023-12-22T08:53:36.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.445+0000 7f13e828b640 1 Processor -- start 2023-12-22T08:53:36.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.445+0000 7f13e828b640 1 -- start start 2023-12-22T08:53:36.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.446+0000 7f13e828b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e0071b90 0x7f13e00b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:36.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.446+0000 7f13e828b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e01547a0 0x7f13e0150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:36.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.446+0000 7f13e828b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13e0154b80 0x7f13e014a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:36.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.446+0000 7f13e828b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00aec60 con 0x7f13e0154b80 2023-12-22T08:53:36.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.446+0000 7f13e828b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0150860 con 0x7f13e01547a0 2023-12-22T08:53:36.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.446+0000 7f13e828b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00b47f0 con 0x7f13e0071b90 2023-12-22T08:53:36.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.447+0000 7f13e6828640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13e0154b80 0x7f13e014a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:36.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.447+0000 7f13e6828640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13e0154b80 0x7f13e014a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41240/0 (socket says 172.21.15.38:41240) 2023-12-22T08:53:36.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.447+0000 7f13e6828640 1 -- 172.21.15.38:0/3553582703 learned_addr learned my addr 172.21.15.38:0/3553582703 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:36.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.447+0000 7f13e5826640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e01547a0 0x7f13e0150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:36.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.447+0000 7f13e6027640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e0071b90 0x7f13e00b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:36.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.447+0000 7f13e6828640 1 -- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e0071b90 msgr2=0x7f13e00b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:36.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.447+0000 7f13e6828640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e0071b90 0x7f13e00b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.447+0000 7f13e6828640 1 -- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e01547a0 msgr2=0x7f13e0150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:36.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.447+0000 7f13e6828640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e01547a0 0x7f13e0150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.447+0000 7f13e6828640 1 -- 172.21.15.38:0/3553582703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc0094d0 con 0x7f13e0154b80 2023-12-22T08:53:36.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.448+0000 7f13e6828640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13e0154b80 0x7f13e014a3e0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f13d800cd70 tx=0x7f13d800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:36.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.448+0000 7f13d2ffd640 1 -- 172.21.15.38:0/3553582703 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8003b90 con 0x7f13e0154b80 2023-12-22T08:53:36.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.448+0000 7f13d2ffd640 1 -- 172.21.15.38:0/3553582703 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d8003cf0 con 0x7f13e0154b80 2023-12-22T08:53:36.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.448+0000 7f13d2ffd640 1 -- 172.21.15.38:0/3553582703 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8004240 con 0x7f13e0154b80 2023-12-22T08:53:36.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.448+0000 7f13e828b640 1 -- 172.21.15.38:0/3553582703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e014fc50 con 0x7f13e0154b80 2023-12-22T08:53:36.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.448+0000 7f13e828b640 1 -- 172.21.15.38:0/3553582703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e0150210 con 0x7f13e0154b80 2023-12-22T08:53:36.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.449+0000 7f13e828b640 1 -- 172.21.15.38:0/3553582703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e0061910 con 0x7f13e0154b80 2023-12-22T08:53:36.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.450+0000 7f13d2ffd640 1 -- 172.21.15.38:0/3553582703 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f13d80043a0 con 0x7f13e0154b80 2023-12-22T08:53:36.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.451+0000 7f13d2ffd640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f13c406a460 0x7f13c406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:36.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.451+0000 7f13d2ffd640 1 -- 172.21.15.38:0/3553582703 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13d8012070 con 0x7f13e0154b80 2023-12-22T08:53:36.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.452+0000 7f13e6027640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f13c406a460 0x7f13c406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:36.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.453+0000 7f13e6027640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f13c406a460 0x7f13c406c920 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f13dc036000 tx=0x7f13dc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:36.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.455+0000 7f13d2ffd640 1 -- 172.21.15.38:0/3553582703 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f13d80548d0 con 0x7f13e0154b80 2023-12-22T08:53:36.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.659+0000 7f13e828b640 1 -- 172.21.15.38:0/3553582703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f13e01509a0 con 0x7f13e0154b80 2023-12-22T08:53:36.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.663+0000 7f13d2ffd640 1 -- 172.21.15.38:0/3553582703 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v193) v1 ==== 81+0+33506 (secure 0 0 0) 0x7f13e01509a0 con 0x7f13e0154b80 2023-12-22T08:53:36.664 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:36.664 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:53:36.664 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 193, 2023-12-22T08:53:36.664 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "893856d7-5d01-4896-9127-f971dbad2b97", 2023-12-22T08:53:36.664 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2023-12-22T08:39:41.088557+0000", 2023-12-22T08:53:36.664 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2023-12-22T08:53:31.412421+0000", 2023-12-22T08:53:36.665 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2023-12-22T08:39:47.815671+0000", 2023-12-22T08:53:36.665 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2023-12-22T08:39:44.806169+0000", 2023-12-22T08:53:36.665 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T08:53:36.665 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5799936, 2023-12-22T08:53:36.665 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2023-12-22T08:53:36.665 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2023-12-22T08:53:36.665 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2023-12-22T08:53:36.665 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2023-12-22T08:53:36.665 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2023-12-22T08:53:36.665 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:36.665 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2023-12-22T08:53:36.665 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.69999998807907104, 2023-12-22T08:53:36.666 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-22T08:53:36.666 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-22T08:53:36.666 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2023-12-22T08:53:36.666 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 23, 2023-12-22T08:53:36.666 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 8, 2023-12-22T08:53:36.666 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2023-12-22T08:53:36.666 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2023-12-22T08:53:36.666 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2023-12-22T08:53:36.666 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2023-12-22T08:53:36.666 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2023-12-22T08:53:36.666 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:39:48.429113+0000", 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:36.667 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "115", 2023-12-22T08:53:36.668 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:36.669 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:36.670 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:36.670 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:36.670 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:36.670 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:36.670 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:36.670 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:36.670 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:36.670 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:36.670 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:36.670 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:36.670 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:36.670 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.670 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:36.671 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:36.671 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:36.671 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:36.671 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:36.671 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:36.671 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:36.671 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:36.671 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:36.671 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:36.671 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:36.671 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:36.671 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 8, 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 8, 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.25, 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:36.672 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.673 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.673 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.673 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 22, 2023-12-22T08:53:36.673 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2023-12-22T08:53:36.673 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:02.354802+0000", 2023-12-22T08:53:36.673 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:36.673 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:36.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:36.673 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:36.673 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:36.673 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:36.673 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:36.674 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "189", 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:36.675 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:36.676 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:36.676 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:36.676 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:36.676 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:36.676 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:36.676 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:36.676 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:36.676 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:36.676 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:36.676 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:36.677 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:36.677 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:36.677 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:36.677 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:36.677 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.677 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:36.677 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:36.677 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:36.677 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:36.677 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:36.677 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:36.677 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.678 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 23, 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2023-12-22T08:53:36.679 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2023-12-22T08:53:03.461583+0000", 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2023-12-22T08:53:36.680 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2023-12-22T08:53:36.681 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2023-12-22T08:53:36.681 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2023-12-22T08:53:36.681 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2023-12-22T08:53:36.681 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2023-12-22T08:53:36.681 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2023-12-22T08:53:36.681 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2023-12-22T08:53:36.681 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2023-12-22T08:53:36.681 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "193", 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 33554432, 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2023-12-22T08:53:36.682 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2023-12-22T08:53:36.683 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.684 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2023-12-22T08:53:36.684 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2023-12-22T08:53:36.684 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2023-12-22T08:53:36.684 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2023-12-22T08:53:36.684 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2023-12-22T08:53:36.684 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T08:53:36.684 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2023-12-22T08:53:36.684 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2023-12-22T08:53:36.684 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2023-12-22T08:53:36.684 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2023-12-22T08:53:36.684 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2023-12-22T08:53:36.685 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2023-12-22T08:53:36.685 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2023-12-22T08:53:36.685 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2023-12-22T08:53:36.685 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.685 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2023-12-22T08:53:36.685 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2023-12-22T08:53:36.685 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2023-12-22T08:53:36.685 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.685 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.685 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2023-12-22T08:53:36.685 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.3799999952316284, 2023-12-22T08:53:36.685 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.3799999952316284, 2023-12-22T08:53:36.685 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.686 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.687 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6802", 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.688 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6803", 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6806", 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.689 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6807", 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6804", 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.690 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6805", 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84128 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6801/84128", 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6803/84128", 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6807/84128", 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6805/84128", 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.691 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.692 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.693 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.693 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.693 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.693 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6808", 2023-12-22T08:53:36.693 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.693 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.693 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.693 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.693 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6809", 2023-12-22T08:53:36.694 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.694 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.694 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.694 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.694 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.694 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.694 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.694 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.694 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6810", 2023-12-22T08:53:36.694 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.694 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6811", 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6814", 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.695 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6815", 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6812", 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.696 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6813", 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84127 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6809/84127", 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6811/84127", 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6815/84127", 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6813/84127", 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.697 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.698 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6824", 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6825", 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.699 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6826", 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6827", 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.700 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6830", 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6831", 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.701 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6828", 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6829", 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84132 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6825/84132", 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6827/84132", 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6831/84132", 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6829/84132", 2023-12-22T08:53:36.702 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.703 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6816", 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6817", 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.704 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6818", 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6819", 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.705 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6822", 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6823", 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.706 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6820", 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6821", 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84138 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.38:6817/84138", 2023-12-22T08:53:36.707 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.38:6819/84138", 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.38:6823/84138", 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.38:6821/84138", 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.708 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6800", 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.709 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6801", 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6802", 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.710 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6803", 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6806", 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6807", 2023-12-22T08:53:36.711 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6804", 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6805", 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84338 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.712 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.713 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.713 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6801/84338", 2023-12-22T08:53:36.713 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6803/84338", 2023-12-22T08:53:36.713 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6807/84338", 2023-12-22T08:53:36.713 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6805/84338", 2023-12-22T08:53:36.713 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.713 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.713 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.713 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.713 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.714 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.714 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:36.714 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.714 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.714 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.714 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.714 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.714 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.714 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.714 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.714 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6816", 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6817", 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.715 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6818", 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6819", 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.716 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6825", 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6827", 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.717 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6820", 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6822", 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84339 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.718 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6817/84339", 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6819/84339", 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6827/84339", 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6822/84339", 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.719 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.720 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.720 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.720 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.720 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.720 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.720 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.720 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.720 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.720 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.720 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.720 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.720 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6808", 2023-12-22T08:53:36.720 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.721 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.721 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.721 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.721 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6809", 2023-12-22T08:53:36.721 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.721 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.721 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.721 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.721 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.721 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.721 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.721 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.721 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6810", 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6811", 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6814", 2023-12-22T08:53:36.722 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6815", 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6812", 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.723 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6813", 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84337 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6809/84337", 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6811/84337", 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6815/84337", 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6813/84337", 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.724 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 13, 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 188, 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2023-12-22T08:53:36.725 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6821", 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6823", 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2023-12-22T08:53:36.726 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6824", 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6826", 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.727 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6830", 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6831", 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.728 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6828", 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.89:6829", 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 84340 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.89:6823/84340", 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.89:6826/84340", 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.89:6831/84340", 2023-12-22T08:53:36.729 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.89:6829/84340", 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.730 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.095888+0000", 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.129399+0000", 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2023-12-22T08:53:36.731 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.068810+0000", 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 3, 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100385+0000", 2023-12-22T08:53:36.732 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 4, 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.100183+0000", 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 5, 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.733 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.060442+0000", 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 6, 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.072683+0000", 2023-12-22T08:53:36.734 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 7, 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2023-12-22T08:39:46.127969+0000", 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2023-12-22T08:53:36.735 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2023-12-22T08:53:36.736 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2023-12-22T08:53:36.736 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2023-12-22T08:53:36.736 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2023-12-22T08:53:36.736 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2023-12-22T08:53:36.736 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2023-12-22T08:53:36.736 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2023-12-22T08:53:36.736 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2023-12-22T08:53:36.737 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2023-12-22T08:53:36.738 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2023-12-22T08:53:36.738 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2023-12-22T08:53:36.738 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2023-12-22T08:53:36.738 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-12-22T08:53:36.738 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:53:36.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.666+0000 7f13e828b640 1 -- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f13c406a460 msgr2=0x7f13c406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:36.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.666+0000 7f13e828b640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f13c406a460 0x7f13c406c920 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f13dc036000 tx=0x7f13dc03c040 comp rx=0 tx=0).stop 2023-12-22T08:53:36.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.666+0000 7f13e828b640 1 -- 172.21.15.38:0/3553582703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13e0154b80 msgr2=0x7f13e014a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:36.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.666+0000 7f13e828b640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13e0154b80 0x7f13e014a3e0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f13d800cd70 tx=0x7f13d800a660 comp rx=0 tx=0).stop 2023-12-22T08:53:36.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.666+0000 7f13e828b640 1 -- 172.21.15.38:0/3553582703 shutdown_connections 2023-12-22T08:53:36.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.666+0000 7f13e828b640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f13c406a460 0x7f13c406c920 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.666+0000 7f13e828b640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13e0154b80 0x7f13e014a3e0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.666+0000 7f13e828b640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13e01547a0 0x7f13e0150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.666+0000 7f13e828b640 1 --2- 172.21.15.38:0/3553582703 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13e0071b90 0x7f13e00b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.666+0000 7f13e828b640 1 -- 172.21.15.38:0/3553582703 >> 172.21.15.38:0/3553582703 conn(0x7f13e00cf070 msgr2=0x7f13e015a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:36.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.666+0000 7f13e828b640 1 -- 172.21.15.38:0/3553582703 shutdown_connections 2023-12-22T08:53:36.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.666+0000 7f13e828b640 1 -- 172.21.15.38:0/3553582703 wait complete. 2023-12-22T08:53:36.741 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:53:36.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.974+0000 7fe0cbfff640 1 Processor -- start 2023-12-22T08:53:36.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.975+0000 7fe0cbfff640 1 -- start start 2023-12-22T08:53:36.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.976+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0cc157980 0x7fe0cc15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:36.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.976+0000 7fe0cbfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe0cc06d640 0x7fe0cc0d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:36.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.976+0000 7fe0cbfff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0cc0d1520 con 0x7fe0cc0b3ff0 2023-12-22T08:53:36.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.976+0000 7fe0cbfff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0cc0d1800 con 0x7fe0cc06d640 2023-12-22T08:53:36.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.976+0000 7fe0cbfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0d1ae0 con 0x7fe0cc157980 2023-12-22T08:53:36.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.977+0000 7fe0cb7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe0cc06d640 0x7fe0cc0d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:36.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.977+0000 7fe0caffd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0cc157980 0x7fe0cc15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:36.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.977+0000 7fe0cb7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe0cc06d640 0x7fe0cc0d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:47680/0 (socket says 172.21.15.38:47680) 2023-12-22T08:53:36.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.977+0000 7fe0cb7fe640 1 -- 172.21.15.38:0/3454094108 learned_addr learned my addr 172.21.15.38:0/3454094108 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:36.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.978+0000 7fe0cb7fe640 1 -- 172.21.15.38:0/3454094108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0cc157980 msgr2=0x7fe0cc15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:36.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.978+0000 7fe0cb7fe640 1 --2- 172.21.15.38:0/3454094108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0cc157980 0x7fe0cc15eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.978+0000 7fe0cb7fe640 1 -- 172.21.15.38:0/3454094108 >> v1:172.21.15.89:6789/0 conn(0x7fe0cc0b3ff0 legacy=0x7fe0cc06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:36.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.978+0000 7fe0cb7fe640 1 -- 172.21.15.38:0/3454094108 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc0d1dc0 con 0x7fe0cc06d640 2023-12-22T08:53:36.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.980+0000 7fe0cb7fe640 1 --2- 172.21.15.38:0/3454094108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0cc06d640 0x7fe0cc0d25c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009e50 tx=0x7fe0c402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d173e5f0da3a812 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:36.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.980+0000 7fe0ca7fc640 1 -- 172.21.15.38:0/3454094108 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c402cb00 con 0x7fe0cc06d640 2023-12-22T08:53:36.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.980+0000 7fe0ca7fc640 1 -- 172.21.15.38:0/3454094108 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c402cc60 con 0x7fe0cc06d640 2023-12-22T08:53:36.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.980+0000 7fe0ca7fc640 1 -- 172.21.15.38:0/3454094108 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40343f0 con 0x7fe0cc06d640 2023-12-22T08:53:36.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.981+0000 7fe0cbfff640 1 -- 172.21.15.38:0/3454094108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0cc06d640 msgr2=0x7fe0cc0d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:36.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.981+0000 7fe0cbfff640 1 --2- 172.21.15.38:0/3454094108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0cc06d640 0x7fe0cc0d25c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009e50 tx=0x7fe0c402bf60 comp rx=0 tx=0).stop 2023-12-22T08:53:36.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.981+0000 7fe0cbfff640 1 -- 172.21.15.38:0/3454094108 shutdown_connections 2023-12-22T08:53:36.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.981+0000 7fe0cbfff640 1 --2- 172.21.15.38:0/3454094108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0cc06d640 0x7fe0cc0d25c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.981+0000 7fe0cbfff640 1 --2- 172.21.15.38:0/3454094108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0cc157980 0x7fe0cc15eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.981+0000 7fe0cbfff640 1 -- 172.21.15.38:0/3454094108 >> 172.21.15.38:0/3454094108 conn(0x7fe0cc0d31f0 msgr2=0x7fe0cc0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:36.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.981+0000 7fe0cbfff640 1 -- 172.21.15.38:0/3454094108 shutdown_connections 2023-12-22T08:53:36.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.981+0000 7fe0cbfff640 1 -- 172.21.15.38:0/3454094108 wait complete. 2023-12-22T08:53:36.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.983+0000 7fe0cbfff640 1 Processor -- start 2023-12-22T08:53:36.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.983+0000 7fe0cbfff640 1 -- start start 2023-12-22T08:53:36.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.984+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0cc06d640 0x7fe0cc1f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:36.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.984+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0cc0b3ff0 0x7fe0cc14c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:36.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.984+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0cc157980 0x7fe0cc1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:36.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.984+0000 7fe0cbfff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc1f2d60 con 0x7fe0cc0b3ff0 2023-12-22T08:53:36.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.984+0000 7fe0cbfff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc1f3b80 con 0x7fe0cc06d640 2023-12-22T08:53:36.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.984+0000 7fe0cbfff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc1f72a0 con 0x7fe0cc157980 2023-12-22T08:53:36.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.984+0000 7fe0c27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0cc0b3ff0 0x7fe0cc14c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:36.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.985+0000 7fe0c27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0cc0b3ff0 0x7fe0cc14c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41254/0 (socket says 172.21.15.38:41254) 2023-12-22T08:53:36.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.985+0000 7fe0c27fc640 1 -- 172.21.15.38:0/2888117718 learned_addr learned my addr 172.21.15.38:0/2888117718 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:36.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.985+0000 7fe0cb7fe640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0cc157980 0x7fe0cc1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:36.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.985+0000 7fe0caffd640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0cc06d640 0x7fe0cc1f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:36.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.985+0000 7fe0c27fc640 1 -- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0cc157980 msgr2=0x7fe0cc1564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:36.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.985+0000 7fe0c27fc640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0cc157980 0x7fe0cc1564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.985+0000 7fe0c27fc640 1 -- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0cc06d640 msgr2=0x7fe0cc1f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:36.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.985+0000 7fe0c27fc640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0cc06d640 0x7fe0cc1f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:36.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.985+0000 7fe0c27fc640 1 -- 172.21.15.38:0/2888117718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c4009b30 con 0x7fe0cc0b3ff0 2023-12-22T08:53:36.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.985+0000 7fe0caffd640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0cc06d640 0x7fe0cc1f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:36.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.985+0000 7fe0c27fc640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0cc0b3ff0 0x7fe0cc14c5f0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c480 tx=0x7fe0b400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:36.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.986+0000 7fe0c8ff9640 1 -- 172.21.15.38:0/2888117718 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40052d0 con 0x7fe0cc0b3ff0 2023-12-22T08:53:36.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.986+0000 7fe0c8ff9640 1 -- 172.21.15.38:0/2888117718 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b4005430 con 0x7fe0cc0b3ff0 2023-12-22T08:53:36.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.986+0000 7fe0c8ff9640 1 -- 172.21.15.38:0/2888117718 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4012870 con 0x7fe0cc0b3ff0 2023-12-22T08:53:36.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.986+0000 7fe0cbfff640 1 -- 172.21.15.38:0/2888117718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc14cb30 con 0x7fe0cc0b3ff0 2023-12-22T08:53:36.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.986+0000 7fe0cbfff640 1 -- 172.21.15.38:0/2888117718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc1f3250 con 0x7fe0cc0b3ff0 2023-12-22T08:53:36.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.987+0000 7fe0cbfff640 1 -- 172.21.15.38:0/2888117718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc061910 con 0x7fe0cc0b3ff0 2023-12-22T08:53:36.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.988+0000 7fe0c8ff9640 1 -- 172.21.15.38:0/2888117718 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe0b40129d0 con 0x7fe0cc0b3ff0 2023-12-22T08:53:36.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.989+0000 7fe0c8ff9640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0ac06a430 0x7fe0ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:36.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.989+0000 7fe0c8ff9640 1 -- 172.21.15.38:0/2888117718 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0b4088490 con 0x7fe0cc0b3ff0 2023-12-22T08:53:36.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.990+0000 7fe0caffd640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0ac06a430 0x7fe0ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:36.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.991+0000 7fe0caffd640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0ac06a430 0x7fe0ac06c8f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009a20 tx=0x7fe0bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:36.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:36.994+0000 7fe0c8ff9640 1 -- 172.21.15.38:0/2888117718 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe0b4053a70 con 0x7fe0cc0b3ff0 2023-12-22T08:53:37.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.227+0000 7fe0cbfff640 1 -- 172.21.15.38:0/2888117718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0cc1f3cc0 con 0x7fe0cc0b3ff0 2023-12-22T08:53:37.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.228+0000 7fe0c8ff9640 1 -- 172.21.15.38:0/2888117718 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4649 (secure 0 0 0) 0x7fe0b4057090 con 0x7fe0cc0b3ff0 2023-12-22T08:53:37.229 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:37.230 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2952705616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2952705616},{"type":"v1","addr":"172.21.15.89:6835","nonce":2952705616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/3842752964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":3842752964},{"type":"v1","addr":"172.21.15.89:6837","nonce":3842752964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/261655608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":261655608},{"type":"v1","addr":"172.21.15.38:6834","nonce":261655608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:53:04.462294+0000","modified":"2023-12-22T08:53:07.483358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8940":{"gid":8940,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3350465616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3350465616},{"type":"v1","addr":"172.21.15.38:6835","nonce":3350465616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-22T08:53:37.230 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 86 2023-12-22T08:53:37.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.231+0000 7fe0cbfff640 1 -- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0ac06a430 msgr2=0x7fe0ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:37.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.231+0000 7fe0cbfff640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0ac06a430 0x7fe0ac06c8f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009a20 tx=0x7fe0bc008040 comp rx=0 tx=0).stop 2023-12-22T08:53:37.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.231+0000 7fe0cbfff640 1 -- 172.21.15.38:0/2888117718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0cc0b3ff0 msgr2=0x7fe0cc14c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:37.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.231+0000 7fe0cbfff640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0cc0b3ff0 0x7fe0cc14c5f0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c480 tx=0x7fe0b400c940 comp rx=0 tx=0).stop 2023-12-22T08:53:37.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.231+0000 7fe0cbfff640 1 -- 172.21.15.38:0/2888117718 shutdown_connections 2023-12-22T08:53:37.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.231+0000 7fe0cbfff640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0cc157980 0x7fe0cc1564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:37.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.231+0000 7fe0cbfff640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fe0ac06a430 0x7fe0ac06c8f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:37.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.231+0000 7fe0cbfff640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0cc0b3ff0 0x7fe0cc14c5f0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:37.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.231+0000 7fe0cbfff640 1 --2- 172.21.15.38:0/2888117718 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0cc06d640 0x7fe0cc1f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:37.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.231+0000 7fe0cbfff640 1 -- 172.21.15.38:0/2888117718 >> 172.21.15.38:0/2888117718 conn(0x7fe0cc0d31f0 msgr2=0x7fe0cc15b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:37.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.231+0000 7fe0cbfff640 1 -- 172.21.15.38:0/2888117718 shutdown_connections 2023-12-22T08:53:37.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:37.232+0000 7fe0cbfff640 1 -- 172.21.15.38:0/2888117718 wait complete. 2023-12-22T08:53:37.251 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-22T08:53:37.500 INFO:teuthology.orchestra.run.smithi038.stdout:{"cluster_fsid":"893856d7-5d01-4896-9127-f971dbad2b97","whoami":0,"id":8940,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":33.014654299,"mdsmap_epoch":86,"osdmap_epoch":193,"osdmap_epoch_barrier":192,"uptime":38.841198341000002} 2023-12-22T08:53:37.501 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "893856d7-5d01-4896-9127-f971dbad2b97", "fs_name": "cephfs", "id": 8940, "mdsmap_epoch": 86, "osdmap_epoch": 193, "osdmap_epoch_barrier": 192, "rank_uptime": 33.014654299, "state": "up:active", "uptime": 38.841198341, "want_state": "up:active", "whoami": 0 } 2023-12-22T08:53:37.501 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-22T08:53:37.501 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:53:37.501 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:37.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:37.560 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-22T08:53:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records in 2023-12-22T08:53:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:50+0 records out 2023-12-22T08:53:37.990 INFO:teuthology.orchestra.run.smithi038.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.371839 s, 141 MB/s 2023-12-22T08:53:37.991 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:53:37.991 DEBUG:teuthology.orchestra.run.smithi038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:53:38.089 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:53:38.214 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:53:38.215 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:53:38.215 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:38.278 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:53:38.279 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:38.335 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:53:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.571+0000 7fd647fff640 1 Processor -- start 2023-12-22T08:53:38.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.572+0000 7fd647fff640 1 -- start start 2023-12-22T08:53:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.573+0000 7fd647fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd6480b3ff0 0x7fd64806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.573+0000 7fd647fff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd64815f220 con 0x7fd648157980 2023-12-22T08:53:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.573+0000 7fd647fff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6480d1520 con 0x7fd6480b44a0 2023-12-22T08:53:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.573+0000 7fd647fff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6480d1800 con 0x7fd6480b3ff0 2023-12-22T08:53:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.573+0000 7fd646ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd648157980 0x7fd64815eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41938/0 (socket says 172.21.15.38:41938) 2023-12-22T08:53:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.574+0000 7fd646ffd640 1 -- 172.21.15.38:0/2815687676 learned_addr learned my addr 172.21.15.38:0/2815687676 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.574+0000 7fd63e7fc640 1 --2- 172.21.15.38:0/2815687676 >> v2:172.21.15.38:3300/0 conn(0x7fd6480b3ff0 0x7fd64806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.574+0000 7fd63e7fc640 1 -- 172.21.15.38:0/2815687676 >> v1:172.21.15.89:6789/0 conn(0x7fd6480b44a0 legacy=0x7fd6480d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.574+0000 7fd63e7fc640 1 -- 172.21.15.38:0/2815687676 >> v1:172.21.15.38:6789/0 conn(0x7fd648157980 legacy=0x7fd64815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:38.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.574+0000 7fd63e7fc640 1 -- 172.21.15.38:0/2815687676 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6480d1ae0 con 0x7fd6480b3ff0 2023-12-22T08:53:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.575+0000 7fd63e7fc640 1 --2- 172.21.15.38:0/2815687676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6480b3ff0 0x7fd64806cf30 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fd6300097a0 tx=0x7fd63002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1b6e2b1d513d55 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.575+0000 7fd6467fc640 1 -- 172.21.15.38:0/2815687676 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630031830 con 0x7fd6480b3ff0 2023-12-22T08:53:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.575+0000 7fd6467fc640 1 -- 172.21.15.38:0/2815687676 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd630031990 con 0x7fd6480b3ff0 2023-12-22T08:53:38.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.575+0000 7fd6467fc640 1 -- 172.21.15.38:0/2815687676 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630031d20 con 0x7fd6480b3ff0 2023-12-22T08:53:38.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.576+0000 7fd647fff640 1 -- 172.21.15.38:0/2815687676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6480b3ff0 msgr2=0x7fd64806cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:38.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.576+0000 7fd647fff640 1 --2- 172.21.15.38:0/2815687676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6480b3ff0 0x7fd64806cf30 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fd6300097a0 tx=0x7fd63002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:53:38.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.576+0000 7fd647fff640 1 -- 172.21.15.38:0/2815687676 shutdown_connections 2023-12-22T08:53:38.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.576+0000 7fd647fff640 1 --2- 172.21.15.38:0/2815687676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6480b3ff0 0x7fd64806cf30 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:38.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.576+0000 7fd647fff640 1 -- 172.21.15.38:0/2815687676 >> 172.21.15.38:0/2815687676 conn(0x7fd6480d31f0 msgr2=0x7fd6480d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:38.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.576+0000 7fd647fff640 1 -- 172.21.15.38:0/2815687676 shutdown_connections 2023-12-22T08:53:38.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.576+0000 7fd647fff640 1 -- 172.21.15.38:0/2815687676 wait complete. 2023-12-22T08:53:38.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.578+0000 7fd647fff640 1 Processor -- start 2023-12-22T08:53:38.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.578+0000 7fd647fff640 1 -- start start 2023-12-22T08:53:38.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.579+0000 7fd647fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6480b3ff0 0x7fd64814d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:38.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.579+0000 7fd647fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6480b44a0 0x7fd648153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:38.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.579+0000 7fd647fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd648157980 0x7fd648160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:38.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.579+0000 7fd647fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64814d830 con 0x7fd6480b44a0 2023-12-22T08:53:38.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.579+0000 7fd647fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64814f920 con 0x7fd6480b3ff0 2023-12-22T08:53:38.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.579+0000 7fd647fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64814fc00 con 0x7fd648157980 2023-12-22T08:53:38.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.579+0000 7fd63e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6480b44a0 0x7fd648153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:38.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.579+0000 7fd63e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6480b44a0 0x7fd648153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41264/0 (socket says 172.21.15.38:41264) 2023-12-22T08:53:38.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.579+0000 7fd63e7fc640 1 -- 172.21.15.38:0/2771294348 learned_addr learned my addr 172.21.15.38:0/2771294348 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:38.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.580+0000 7fd646ffd640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6480b3ff0 0x7fd64814d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:38.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.580+0000 7fd63e7fc640 1 -- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd648157980 msgr2=0x7fd648160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:38.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.580+0000 7fd6477fe640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd648157980 0x7fd648160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:38.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.580+0000 7fd63e7fc640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd648157980 0x7fd648160fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:38.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.580+0000 7fd63e7fc640 1 -- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6480b3ff0 msgr2=0x7fd64814d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:38.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.580+0000 7fd63e7fc640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6480b3ff0 0x7fd64814d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:38.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.580+0000 7fd63e7fc640 1 -- 172.21.15.38:0/2771294348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd630009400 con 0x7fd6480b44a0 2023-12-22T08:53:38.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.580+0000 7fd646ffd640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6480b3ff0 0x7fd64814d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:38.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.580+0000 7fd63e7fc640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6480b44a0 0x7fd648153330 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fd6300098c0 tx=0x7fd6300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:38.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.581+0000 7fd63ffff640 1 -- 172.21.15.38:0/2771294348 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63003ba70 con 0x7fd6480b44a0 2023-12-22T08:53:38.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.581+0000 7fd63ffff640 1 -- 172.21.15.38:0/2771294348 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63003bbf0 con 0x7fd6480b44a0 2023-12-22T08:53:38.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.581+0000 7fd63ffff640 1 -- 172.21.15.38:0/2771294348 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6300453f0 con 0x7fd6480b44a0 2023-12-22T08:53:38.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.581+0000 7fd647fff640 1 -- 172.21.15.38:0/2771294348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64814fee0 con 0x7fd6480b44a0 2023-12-22T08:53:38.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.581+0000 7fd647fff640 1 -- 172.21.15.38:0/2771294348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6481504a0 con 0x7fd6480b44a0 2023-12-22T08:53:38.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.582+0000 7fd647fff640 1 -- 172.21.15.38:0/2771294348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd648150690 con 0x7fd6480b44a0 2023-12-22T08:53:38.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.583+0000 7fd63ffff640 1 -- 172.21.15.38:0/2771294348 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd63004e450 con 0x7fd6480b44a0 2023-12-22T08:53:38.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.584+0000 7fd63ffff640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd62806a430 0x7fd62806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:38.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.584+0000 7fd63ffff640 1 -- 172.21.15.38:0/2771294348 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6300aadb0 con 0x7fd6480b44a0 2023-12-22T08:53:38.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.584+0000 7fd646ffd640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd62806a430 0x7fd62806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:38.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.585+0000 7fd646ffd640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd62806a430 0x7fd62806c8f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd638005c00 tx=0x7fd638009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:38.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.588+0000 7fd63ffff640 1 -- 172.21.15.38:0/2771294348 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd6300af070 con 0x7fd6480b44a0 2023-12-22T08:53:38.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.787+0000 7fd647fff640 1 -- 172.21.15.38:0/2771294348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd648061910 con 0x7fd6480b44a0 2023-12-22T08:53:38.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.789+0000 7fd63ffff640 1 -- 172.21.15.38:0/2771294348 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+16071 (secure 0 0 0) 0x7fd630076420 con 0x7fd6480b44a0 2023-12-22T08:53:38.790 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:38.790 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":193,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:53:31.412421+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:53:02.354802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-22T08:53:03.461583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:53:38.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.792+0000 7fd647fff640 1 -- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd62806a430 msgr2=0x7fd62806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:38.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.792+0000 7fd647fff640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd62806a430 0x7fd62806c8f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd638005c00 tx=0x7fd638009040 comp rx=0 tx=0).stop 2023-12-22T08:53:38.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.792+0000 7fd647fff640 1 -- 172.21.15.38:0/2771294348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6480b44a0 msgr2=0x7fd648153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:38.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.792+0000 7fd647fff640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6480b44a0 0x7fd648153330 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fd6300098c0 tx=0x7fd6300046c0 comp rx=0 tx=0).stop 2023-12-22T08:53:38.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.792+0000 7fd647fff640 1 -- 172.21.15.38:0/2771294348 shutdown_connections 2023-12-22T08:53:38.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.792+0000 7fd647fff640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd648157980 0x7fd648160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:38.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.792+0000 7fd647fff640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd62806a430 0x7fd62806c8f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:38.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.792+0000 7fd647fff640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6480b44a0 0x7fd648153330 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:38.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.792+0000 7fd647fff640 1 --2- 172.21.15.38:0/2771294348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6480b3ff0 0x7fd64814d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:38.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.792+0000 7fd647fff640 1 -- 172.21.15.38:0/2771294348 >> 172.21.15.38:0/2771294348 conn(0x7fd6480d31f0 msgr2=0x7fd64815d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:38.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.792+0000 7fd647fff640 1 -- 172.21.15.38:0/2771294348 shutdown_connections 2023-12-22T08:53:38.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:38.792+0000 7fd647fff640 1 -- 172.21.15.38:0/2771294348 wait complete. 2023-12-22T08:53:38.813 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:53:02.354802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '189', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:53:03.461583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '193', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:53:38.814 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:53:39.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.042+0000 7f0af7fff640 1 Processor -- start 2023-12-22T08:53:39.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.043+0000 7f0af7fff640 1 -- start start 2023-12-22T08:53:39.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.044+0000 7f0af7fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af8071080 0x7f0af80d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.044+0000 7f0af7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0af815d5a0 0x7f0af80d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.044+0000 7f0af7fff640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af815de50 con 0x7f0af815d1c0 2023-12-22T08:53:39.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.044+0000 7f0af7fff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af80d0dd0 con 0x7f0af815d5a0 2023-12-22T08:53:39.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.044+0000 7f0af7fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80d10b0 con 0x7f0af8071080 2023-12-22T08:53:39.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.045+0000 7f0af77fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0af815d5a0 0x7f0af80d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.046+0000 7f0af6ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0af815d1c0 0x7f0af8070970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:48398/0 (socket says 172.21.15.38:48398) 2023-12-22T08:53:39.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.046+0000 7f0af6ffd640 1 -- 172.21.15.38:0/2246211922 learned_addr learned my addr 172.21.15.38:0/2246211922 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:39.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.046+0000 7f0af67fc640 1 --2- 172.21.15.38:0/2246211922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af8071080 0x7f0af80d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.046+0000 7f0af77fe640 1 -- 172.21.15.38:0/2246211922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af8071080 msgr2=0x7f0af80d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:39.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.047+0000 7f0af77fe640 1 --2- 172.21.15.38:0/2246211922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af8071080 0x7f0af80d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.047+0000 7f0af77fe640 1 -- 172.21.15.38:0/2246211922 >> v1:172.21.15.89:6789/0 conn(0x7f0af815d1c0 legacy=0x7f0af8070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.047+0000 7f0af77fe640 1 -- 172.21.15.38:0/2246211922 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af815dae0 con 0x7f0af815d5a0 2023-12-22T08:53:39.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.048+0000 7f0af77fe640 1 --2- 172.21.15.38:0/2246211922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af815d5a0 0x7f0af80d05a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0af00097a0 tx=0x7f0af002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb25fad088570585 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:39.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.049+0000 7f0af5ffb640 1 -- 172.21.15.38:0/2246211922 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0031830 con 0x7f0af815d5a0 2023-12-22T08:53:39.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.049+0000 7f0af5ffb640 1 -- 172.21.15.38:0/2246211922 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af0031990 con 0x7f0af815d5a0 2023-12-22T08:53:39.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.049+0000 7f0af5ffb640 1 -- 172.21.15.38:0/2246211922 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0031d20 con 0x7f0af815d5a0 2023-12-22T08:53:39.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.050+0000 7f0af7fff640 1 -- 172.21.15.38:0/2246211922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af815d5a0 msgr2=0x7f0af80d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.050+0000 7f0af7fff640 1 --2- 172.21.15.38:0/2246211922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af815d5a0 0x7f0af80d05a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0af00097a0 tx=0x7f0af002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.050+0000 7f0af7fff640 1 -- 172.21.15.38:0/2246211922 shutdown_connections 2023-12-22T08:53:39.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.050+0000 7f0af7fff640 1 --2- 172.21.15.38:0/2246211922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af815d5a0 0x7f0af80d05a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.050+0000 7f0af7fff640 1 --2- 172.21.15.38:0/2246211922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af8071080 0x7f0af80d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.050+0000 7f0af7fff640 1 -- 172.21.15.38:0/2246211922 >> 172.21.15.38:0/2246211922 conn(0x7f0af806bf90 msgr2=0x7f0af806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:39.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.050+0000 7f0af7fff640 1 -- 172.21.15.38:0/2246211922 shutdown_connections 2023-12-22T08:53:39.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.050+0000 7f0af7fff640 1 -- 172.21.15.38:0/2246211922 wait complete. 2023-12-22T08:53:39.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.052+0000 7f0af7fff640 1 Processor -- start 2023-12-22T08:53:39.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.052+0000 7f0af7fff640 1 -- start start 2023-12-22T08:53:39.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.053+0000 7f0af7fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af8071080 0x7f0af8158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.053+0000 7f0af7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af815d1c0 0x7f0af81f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.053+0000 7f0af7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af815d5a0 0x7f0af81f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.053+0000 7f0af7fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8154f10 con 0x7f0af815d1c0 2023-12-22T08:53:39.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.053+0000 7f0af7fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8154300 con 0x7f0af815d5a0 2023-12-22T08:53:39.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.053+0000 7f0af7fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af81545e0 con 0x7f0af8071080 2023-12-22T08:53:39.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.053+0000 7f0af67fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af815d1c0 0x7f0af81f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.053+0000 7f0af67fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af815d1c0 0x7f0af81f5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41278/0 (socket says 172.21.15.38:41278) 2023-12-22T08:53:39.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.053+0000 7f0af67fc640 1 -- 172.21.15.38:0/2866268696 learned_addr learned my addr 172.21.15.38:0/2866268696 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:39.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.054+0000 7f0af6ffd640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af8071080 0x7f0af8158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.054+0000 7f0af77fe640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af815d5a0 0x7f0af81f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.054+0000 7f0af67fc640 1 -- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af8071080 msgr2=0x7f0af8158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.054+0000 7f0af67fc640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af8071080 0x7f0af8158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.054+0000 7f0af67fc640 1 -- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af815d5a0 msgr2=0x7f0af81f64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.054+0000 7f0af67fc640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af815d5a0 0x7f0af81f64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.054+0000 7f0af67fc640 1 -- 172.21.15.38:0/2866268696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af0009400 con 0x7f0af815d1c0 2023-12-22T08:53:39.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.054+0000 7f0af67fc640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af815d1c0 0x7f0af81f5fb0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000e9b0 tx=0x7f0ae000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:39.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.055+0000 7f0aef7fe640 1 -- 172.21.15.38:0/2866268696 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0009670 con 0x7f0af815d1c0 2023-12-22T08:53:39.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.055+0000 7f0aef7fe640 1 -- 172.21.15.38:0/2866268696 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae000c9a0 con 0x7f0af815d1c0 2023-12-22T08:53:39.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.055+0000 7f0aef7fe640 1 -- 172.21.15.38:0/2866268696 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae000cd50 con 0x7f0af815d1c0 2023-12-22T08:53:39.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.055+0000 7f0af7fff640 1 -- 172.21.15.38:0/2866268696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af81548c0 con 0x7f0af815d1c0 2023-12-22T08:53:39.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.055+0000 7f0af7fff640 1 -- 172.21.15.38:0/2866268696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af8159500 con 0x7f0af815d1c0 2023-12-22T08:53:39.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.056+0000 7f0af7fff640 1 -- 172.21.15.38:0/2866268696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af81550c0 con 0x7f0af815d1c0 2023-12-22T08:53:39.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.057+0000 7f0aef7fe640 1 -- 172.21.15.38:0/2866268696 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ae0013470 con 0x7f0af815d1c0 2023-12-22T08:53:39.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.058+0000 7f0aef7fe640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0ad806a430 0x7f0ad806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.058+0000 7f0aef7fe640 1 -- 172.21.15.38:0/2866268696 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ae0088c80 con 0x7f0af815d1c0 2023-12-22T08:53:39.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.059+0000 7f0af6ffd640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0ad806a430 0x7f0ad806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.060+0000 7f0af6ffd640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0ad806a430 0x7f0ad806c8f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8005c00 tx=0x7f0ae8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:39.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.062+0000 7f0aef7fe640 1 -- 172.21.15.38:0/2866268696 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0af81550c0 con 0x7f0af815d1c0 2023-12-22T08:53:39.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.253+0000 7f0af7fff640 1 -- 172.21.15.38:0/2866268696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0af81550c0 con 0x7f0af815d1c0 2023-12-22T08:53:39.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.254+0000 7f0aef7fe640 1 -- 172.21.15.38:0/2866268696 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v193) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0af81550c0 con 0x7f0af815d1c0 2023-12-22T08:53:39.255 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:53:39.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.257+0000 7f0af7fff640 1 -- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0ad806a430 msgr2=0x7f0ad806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.257+0000 7f0af7fff640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0ad806a430 0x7f0ad806c8f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8005c00 tx=0x7f0ae8009040 comp rx=0 tx=0).stop 2023-12-22T08:53:39.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.257+0000 7f0af7fff640 1 -- 172.21.15.38:0/2866268696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af815d1c0 msgr2=0x7f0af81f5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.257+0000 7f0af7fff640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af815d1c0 0x7f0af81f5fb0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000e9b0 tx=0x7f0ae000ee70 comp rx=0 tx=0).stop 2023-12-22T08:53:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.257+0000 7f0af7fff640 1 -- 172.21.15.38:0/2866268696 shutdown_connections 2023-12-22T08:53:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.257+0000 7f0af7fff640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0af815d5a0 0x7f0af81f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.257+0000 7f0af7fff640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0ad806a430 0x7f0ad806c8f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.257+0000 7f0af7fff640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0af815d1c0 0x7f0af81f5fb0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.257+0000 7f0af7fff640 1 --2- 172.21.15.38:0/2866268696 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0af8071080 0x7f0af8158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.257+0000 7f0af7fff640 1 -- 172.21.15.38:0/2866268696 >> 172.21.15.38:0/2866268696 conn(0x7f0af806bf90 msgr2=0x7f0af80708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:39.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.257+0000 7f0af7fff640 1 -- 172.21.15.38:0/2866268696 shutdown_connections 2023-12-22T08:53:39.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.258+0000 7f0af7fff640 1 -- 172.21.15.38:0/2866268696 wait complete. 2023-12-22T08:53:39.276 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:53:39.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.510+0000 7f911759e640 1 Processor -- start 2023-12-22T08:53:39.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.510+0000 7f911759e640 1 -- start start 2023-12-22T08:53:39.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.512+0000 7f911759e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f91180cb5e0 0x7f911815d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.512+0000 7f911759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9118161bb0 0x7f911815de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.512+0000 7f911759e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911815e3c0 con 0x7f911815ad90 2023-12-22T08:53:39.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.512+0000 7f911759e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91180ce2c0 con 0x7f91180cb5e0 2023-12-22T08:53:39.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.512+0000 7f911759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911815e910 con 0x7f9118161bb0 2023-12-22T08:53:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.512+0000 7f9115d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f91180cb5e0 0x7f911815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.512+0000 7f9115d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f91180cb5e0 0x7f911815d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.38:47730/0 (socket says 172.21.15.38:47730) 2023-12-22T08:53:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.512+0000 7f9115d9b640 1 -- 172.21.15.38:0/2083629831 learned_addr learned my addr 172.21.15.38:0/2083629831 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.512+0000 7f911659c640 1 --1- 172.21.15.38:0/2083629831 >> v1:172.21.15.89:6789/0 conn(0x7f911815ad90 0x7f91180caed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:48400/0 (socket says 172.21.15.38:48400) 2023-12-22T08:53:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.512+0000 7f9116d9d640 1 --2- 172.21.15.38:0/2083629831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9118161bb0 0x7f911815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.513+0000 7f9115d9b640 1 -- 172.21.15.38:0/2083629831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9118161bb0 msgr2=0x7f911815de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.513+0000 7f9115d9b640 1 --2- 172.21.15.38:0/2083629831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9118161bb0 0x7f911815de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.513+0000 7f9115d9b640 1 -- 172.21.15.38:0/2083629831 >> v1:172.21.15.89:6789/0 conn(0x7f911815ad90 legacy=0x7f91180caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.513+0000 7f9115d9b640 1 -- 172.21.15.38:0/2083629831 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911815e630 con 0x7f91180cb5e0 2023-12-22T08:53:39.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.514+0000 7f9115d9b640 1 --2- 172.21.15.38:0/2083629831 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91180cb5e0 0x7f911815d940 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9100009870 tx=0x7f910002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81af6ef042a781f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:39.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.515+0000 7f911559a640 1 -- 172.21.15.38:0/2083629831 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100030840 con 0x7f91180cb5e0 2023-12-22T08:53:39.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.515+0000 7f911559a640 1 -- 172.21.15.38:0/2083629831 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91000309a0 con 0x7f91180cb5e0 2023-12-22T08:53:39.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.515+0000 7f911559a640 1 -- 172.21.15.38:0/2083629831 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100030d30 con 0x7f91180cb5e0 2023-12-22T08:53:39.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.515+0000 7f911759e640 1 -- 172.21.15.38:0/2083629831 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91180cb5e0 msgr2=0x7f911815d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.515+0000 7f911759e640 1 --2- 172.21.15.38:0/2083629831 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91180cb5e0 0x7f911815d940 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9100009870 tx=0x7f910002b980 comp rx=0 tx=0).stop 2023-12-22T08:53:39.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.516+0000 7f911759e640 1 -- 172.21.15.38:0/2083629831 shutdown_connections 2023-12-22T08:53:39.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.516+0000 7f911759e640 1 --2- 172.21.15.38:0/2083629831 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91180cb5e0 0x7f911815d940 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.516+0000 7f911759e640 1 --2- 172.21.15.38:0/2083629831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9118161bb0 0x7f911815de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.516+0000 7f911759e640 1 -- 172.21.15.38:0/2083629831 >> 172.21.15.38:0/2083629831 conn(0x7f91180d31c0 msgr2=0x7f91180d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:39.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.516+0000 7f911759e640 1 -- 172.21.15.38:0/2083629831 shutdown_connections 2023-12-22T08:53:39.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.516+0000 7f911759e640 1 -- 172.21.15.38:0/2083629831 wait complete. 2023-12-22T08:53:39.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.518+0000 7f911759e640 1 Processor -- start 2023-12-22T08:53:39.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.518+0000 7f911759e640 1 -- start start 2023-12-22T08:53:39.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.519+0000 7f911759e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91180cb5e0 0x7f91181f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.519+0000 7f911759e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f911815ad90 0x7f9118151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.519+0000 7f911759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9118161bb0 0x7f91180cf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.519+0000 7f911759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91181f6e80 con 0x7f9118161bb0 2023-12-22T08:53:39.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.519+0000 7f911759e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91181583b0 con 0x7f911815ad90 2023-12-22T08:53:39.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.519+0000 7f911759e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91181f6100 con 0x7f91180cb5e0 2023-12-22T08:53:39.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.519+0000 7f9116d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9118161bb0 0x7f91180cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.519+0000 7f9116d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9118161bb0 0x7f91180cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41280/0 (socket says 172.21.15.38:41280) 2023-12-22T08:53:39.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.519+0000 7f9116d9d640 1 -- 172.21.15.38:0/1124814704 learned_addr learned my addr 172.21.15.38:0/1124814704 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:39.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.519+0000 7f911659c640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91180cb5e0 0x7f91181f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.519+0000 7f9115d9b640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f911815ad90 0x7f9118151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.520+0000 7f9116d9d640 1 -- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91180cb5e0 msgr2=0x7f91181f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.520+0000 7f9116d9d640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91180cb5e0 0x7f91181f22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.520+0000 7f9116d9d640 1 -- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f911815ad90 msgr2=0x7f9118151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.520+0000 7f9116d9d640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f911815ad90 0x7f9118151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.520+0000 7f9116d9d640 1 -- 172.21.15.38:0/1124814704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91000094d0 con 0x7f9118161bb0 2023-12-22T08:53:39.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.520+0000 7f9116d9d640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9118161bb0 0x7f91180cf920 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f911000e7f0 tx=0x7f911000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:39.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.520+0000 7f910effd640 1 -- 172.21.15.38:0/1124814704 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100094b0 con 0x7f9118161bb0 2023-12-22T08:53:39.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.520+0000 7f910effd640 1 -- 172.21.15.38:0/1124814704 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911000c6d0 con 0x7f9118161bb0 2023-12-22T08:53:39.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.520+0000 7f910effd640 1 -- 172.21.15.38:0/1124814704 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911000ca80 con 0x7f9118161bb0 2023-12-22T08:53:39.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.520+0000 7f911759e640 1 -- 172.21.15.38:0/1124814704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9118152350 con 0x7f9118161bb0 2023-12-22T08:53:39.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.520+0000 7f911759e640 1 -- 172.21.15.38:0/1124814704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91181f6680 con 0x7f9118161bb0 2023-12-22T08:53:39.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.522+0000 7f911759e640 1 -- 172.21.15.38:0/1124814704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9118061910 con 0x7f9118161bb0 2023-12-22T08:53:39.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.523+0000 7f910effd640 1 -- 172.21.15.38:0/1124814704 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f911000cbe0 con 0x7f9118161bb0 2023-12-22T08:53:39.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.524+0000 7f910effd640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f90f806a430 0x7f90f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.524+0000 7f910effd640 1 -- 172.21.15.38:0/1124814704 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91100889c0 con 0x7f9118161bb0 2023-12-22T08:53:39.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.524+0000 7f911659c640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f90f806a430 0x7f90f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.525+0000 7f911659c640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f90f806a430 0x7f90f806c8f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9108007ef0 tx=0x7f9108007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:39.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.528+0000 7f910effd640 1 -- 172.21.15.38:0/1124814704 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9110053fa0 con 0x7f9118161bb0 2023-12-22T08:53:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.723+0000 7f911759e640 1 -- 172.21.15.38:0/1124814704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91180c6ad0 con 0x7f9118161bb0 2023-12-22T08:53:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.727+0000 7f910effd640 1 -- 172.21.15.38:0/1124814704 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v193) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9110017020 con 0x7f9118161bb0 2023-12-22T08:53:39.728 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:53:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.729+0000 7f911759e640 1 -- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f90f806a430 msgr2=0x7f90f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.729+0000 7f911759e640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f90f806a430 0x7f90f806c8f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9108007ef0 tx=0x7f9108007e80 comp rx=0 tx=0).stop 2023-12-22T08:53:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.729+0000 7f911759e640 1 -- 172.21.15.38:0/1124814704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9118161bb0 msgr2=0x7f91180cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.729+0000 7f911759e640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9118161bb0 0x7f91180cf920 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f911000e7f0 tx=0x7f911000ecb0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.729+0000 7f911759e640 1 -- 172.21.15.38:0/1124814704 shutdown_connections 2023-12-22T08:53:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.729+0000 7f911759e640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f90f806a430 0x7f90f806c8f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.730+0000 7f911759e640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9118161bb0 0x7f91180cf920 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.730+0000 7f911759e640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f911815ad90 0x7f9118151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.730+0000 7f911759e640 1 --2- 172.21.15.38:0/1124814704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91180cb5e0 0x7f91181f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.730+0000 7f911759e640 1 -- 172.21.15.38:0/1124814704 >> 172.21.15.38:0/1124814704 conn(0x7f91180d31c0 msgr2=0x7f911815b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.730+0000 7f911759e640 1 -- 172.21.15.38:0/1124814704 shutdown_connections 2023-12-22T08:53:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.730+0000 7f911759e640 1 -- 172.21.15.38:0/1124814704 wait complete. 2023-12-22T08:53:39.749 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:53:39.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.978+0000 7f12da8da640 1 Processor -- start 2023-12-22T08:53:39.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.979+0000 7f12da8da640 1 -- start start 2023-12-22T08:53:39.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.980+0000 7f12da8da640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f12d4071080 0x7f12d40d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.980+0000 7f12da8da640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d415de50 con 0x7f12d415d5a0 2023-12-22T08:53:39.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.980+0000 7f12da8da640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d40d0dd0 con 0x7f12d415d1c0 2023-12-22T08:53:39.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.980+0000 7f12da8da640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d40d10b0 con 0x7f12d4071080 2023-12-22T08:53:39.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.981+0000 7f12d90d7640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f12d4071080 0x7f12d40d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.981+0000 7f12da0d9640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f12d415d5a0 0x7f12d40d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41940/0 (socket says 172.21.15.38:41940) 2023-12-22T08:53:39.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.981+0000 7f12da0d9640 1 -- 172.21.15.38:0/171227498 learned_addr learned my addr 172.21.15.38:0/171227498 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:39.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.981+0000 7f12d90d7640 1 -- 172.21.15.38:0/171227498 >> v1:172.21.15.89:6789/0 conn(0x7f12d415d1c0 legacy=0x7f12d4070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:39.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.981+0000 7f12d90d7640 1 -- 172.21.15.38:0/171227498 >> v1:172.21.15.38:6789/0 conn(0x7f12d415d5a0 legacy=0x7f12d40d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.981+0000 7f12d90d7640 1 -- 172.21.15.38:0/171227498 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d415dae0 con 0x7f12d4071080 2023-12-22T08:53:39.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.981+0000 7f12d88d6640 1 -- 172.21.15.38:0/171227498 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430924363 0 0) 0x7f12d415de50 con 0x7f12d415d5a0 2023-12-22T08:53:39.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.982+0000 7f12d90d7640 1 --2- 172.21.15.38:0/171227498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12d4071080 0x7f12d40d0060 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f12c80097a0 tx=0x7f12c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428b7f499e76b29a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:39.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.983+0000 7f12d88d6640 1 -- 172.21.15.38:0/171227498 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8031830 con 0x7f12d4071080 2023-12-22T08:53:39.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.983+0000 7f12d88d6640 1 -- 172.21.15.38:0/171227498 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c8031990 con 0x7f12d4071080 2023-12-22T08:53:39.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.983+0000 7f12d88d6640 1 -- 172.21.15.38:0/171227498 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8031d20 con 0x7f12d4071080 2023-12-22T08:53:39.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.983+0000 7f12da8da640 1 -- 172.21.15.38:0/171227498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12d4071080 msgr2=0x7f12d40d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.983+0000 7f12da8da640 1 --2- 172.21.15.38:0/171227498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12d4071080 0x7f12d40d0060 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f12c80097a0 tx=0x7f12c802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.983+0000 7f12da8da640 1 -- 172.21.15.38:0/171227498 shutdown_connections 2023-12-22T08:53:39.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.983+0000 7f12da8da640 1 --2- 172.21.15.38:0/171227498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12d4071080 0x7f12d40d0060 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.983+0000 7f12da8da640 1 -- 172.21.15.38:0/171227498 >> 172.21.15.38:0/171227498 conn(0x7f12d406bf90 msgr2=0x7f12d406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:39.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.983+0000 7f12da8da640 1 -- 172.21.15.38:0/171227498 shutdown_connections 2023-12-22T08:53:39.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.983+0000 7f12da8da640 1 -- 172.21.15.38:0/171227498 wait complete. 2023-12-22T08:53:39.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.985+0000 7f12da8da640 1 Processor -- start 2023-12-22T08:53:39.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.985+0000 7f12da8da640 1 -- start start 2023-12-22T08:53:39.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.986+0000 7f12da8da640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12d4071080 0x7f12d41f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.986+0000 7f12da8da640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d415d1c0 0x7f12d4148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.986+0000 7f12da8da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12d415d5a0 0x7f12d4158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.986+0000 7f12da8da640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d41f2760 con 0x7f12d4071080 2023-12-22T08:53:39.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.986+0000 7f12da8da640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d41497d0 con 0x7f12d415d5a0 2023-12-22T08:53:39.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.986+0000 7f12da8da640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4149210 con 0x7f12d415d1c0 2023-12-22T08:53:39.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.987+0000 7f12d98d8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12d4071080 0x7f12d41f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.987+0000 7f12d98d8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12d4071080 0x7f12d41f2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41306/0 (socket says 172.21.15.38:41306) 2023-12-22T08:53:39.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.987+0000 7f12d98d8640 1 -- 172.21.15.38:0/2756786541 learned_addr learned my addr 172.21.15.38:0/2756786541 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:39.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.987+0000 7f12d90d7640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d415d1c0 0x7f12d4148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.987+0000 7f12da0d9640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12d415d5a0 0x7f12d4158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.987+0000 7f12d98d8640 1 -- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d415d1c0 msgr2=0x7f12d4148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.987+0000 7f12d98d8640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d415d1c0 0x7f12d4148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.987+0000 7f12d98d8640 1 -- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12d415d5a0 msgr2=0x7f12d4158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:39.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.987+0000 7f12d98d8640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12d415d5a0 0x7f12d4158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:39.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.987+0000 7f12d98d8640 1 -- 172.21.15.38:0/2756786541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c8009400 con 0x7f12d4071080 2023-12-22T08:53:39.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.987+0000 7f12d90d7640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d415d1c0 0x7f12d4148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:39.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.988+0000 7f12d98d8640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12d4071080 0x7f12d41f2220 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c430 tx=0x7f12c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:39.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.988+0000 7f12d27fc640 1 -- 172.21.15.38:0/2756786541 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4011790 con 0x7f12d4071080 2023-12-22T08:53:39.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.988+0000 7f12d27fc640 1 -- 172.21.15.38:0/2756786541 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c40118f0 con 0x7f12d4071080 2023-12-22T08:53:39.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.988+0000 7f12d27fc640 1 -- 172.21.15.38:0/2756786541 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4011ce0 con 0x7f12d4071080 2023-12-22T08:53:39.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.988+0000 7f12da8da640 1 -- 172.21.15.38:0/2756786541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d41494f0 con 0x7f12d4071080 2023-12-22T08:53:39.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.988+0000 7f12da8da640 1 -- 172.21.15.38:0/2756786541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d41f3dc0 con 0x7f12d4071080 2023-12-22T08:53:39.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.989+0000 7f12da8da640 1 -- 172.21.15.38:0/2756786541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d4061910 con 0x7f12d4071080 2023-12-22T08:53:39.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.991+0000 7f12d27fc640 1 -- 172.21.15.38:0/2756786541 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f12c401c460 con 0x7f12d4071080 2023-12-22T08:53:39.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.991+0000 7f12d27fc640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12c006a430 0x7f12c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:39.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.991+0000 7f12d27fc640 1 -- 172.21.15.38:0/2756786541 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12c40887e0 con 0x7f12d4071080 2023-12-22T08:53:39.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.992+0000 7f12d90d7640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12c006a430 0x7f12c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:39.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.993+0000 7f12d90d7640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12c006a430 0x7f12c006c8f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f12c8036000 tx=0x7f12c8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:39.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:39.996+0000 7f12d27fc640 1 -- 172.21.15.38:0/2756786541 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f12c4053e60 con 0x7f12d4071080 2023-12-22T08:53:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.197+0000 7f12da8da640 1 -- 172.21.15.38:0/2756786541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12d40b2be0 con 0x7f12d4071080 2023-12-22T08:53:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.198+0000 7f12d27fc640 1 -- 172.21.15.38:0/2756786541 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v193) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12c4057480 con 0x7f12d4071080 2023-12-22T08:53:40.199 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:53:40.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.201+0000 7f12da8da640 1 -- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12c006a430 msgr2=0x7f12c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:40.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.201+0000 7f12da8da640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12c006a430 0x7f12c006c8f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f12c8036000 tx=0x7f12c8008030 comp rx=0 tx=0).stop 2023-12-22T08:53:40.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.201+0000 7f12da8da640 1 -- 172.21.15.38:0/2756786541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12d4071080 msgr2=0x7f12d41f2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:40.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.201+0000 7f12da8da640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12d4071080 0x7f12d41f2220 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c430 tx=0x7f12c400c8f0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.201+0000 7f12da8da640 1 -- 172.21.15.38:0/2756786541 shutdown_connections 2023-12-22T08:53:40.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.201+0000 7f12da8da640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12d415d5a0 0x7f12d4158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.201+0000 7f12da8da640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12d415d1c0 0x7f12d4148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.201+0000 7f12da8da640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f12c006a430 0x7f12c006c8f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.201+0000 7f12da8da640 1 --2- 172.21.15.38:0/2756786541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12d4071080 0x7f12d41f2220 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.201+0000 7f12da8da640 1 -- 172.21.15.38:0/2756786541 >> 172.21.15.38:0/2756786541 conn(0x7f12d406bf90 msgr2=0x7f12d406f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.201+0000 7f12da8da640 1 -- 172.21.15.38:0/2756786541 shutdown_connections 2023-12-22T08:53:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.201+0000 7f12da8da640 1 -- 172.21.15.38:0/2756786541 wait complete. 2023-12-22T08:53:40.222 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:53:40.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.448+0000 7f88df029640 1 Processor -- start 2023-12-22T08:53:40.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.448+0000 7f88df029640 1 -- start start 2023-12-22T08:53:40.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.449+0000 7f88df029640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f88d815b0e0 0x7f88d815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:40.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.449+0000 7f88df029640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d8071460 0x7f88d8071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:40.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.449+0000 7f88df029640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d815edf0 con 0x7f88d809c980 2023-12-22T08:53:40.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.449+0000 7f88df029640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d815d0d0 con 0x7f88d815b0e0 2023-12-22T08:53:40.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.449+0000 7f88df029640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d8071db0 con 0x7f88d8071460 2023-12-22T08:53:40.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.450+0000 7f88dd826640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f88d809c980 0x7f88d815c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41950/0 (socket says 172.21.15.38:41950) 2023-12-22T08:53:40.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.450+0000 7f88dd826640 1 -- 172.21.15.38:0/2486124800 learned_addr learned my addr 172.21.15.38:0/2486124800 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:40.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.450+0000 7f88de027640 1 --2- 172.21.15.38:0/2486124800 >> v2:172.21.15.38:3300/0 conn(0x7f88d815b0e0 0x7f88d815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:40.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.450+0000 7f88de828640 1 --2- 172.21.15.38:0/2486124800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d8071460 0x7f88d8071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:40.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.450+0000 7f88dd025640 1 -- 172.21.15.38:0/2486124800 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623341628 0 0) 0x7f88d815edf0 con 0x7f88d809c980 2023-12-22T08:53:40.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.450+0000 7f88dd025640 1 -- 172.21.15.38:0/2486124800 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88c4003520 con 0x7f88d809c980 2023-12-22T08:53:40.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.451+0000 7f88de027640 1 -- 172.21.15.38:0/2486124800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d8071460 msgr2=0x7f88d8071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:40.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.451+0000 7f88de027640 1 --2- 172.21.15.38:0/2486124800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d8071460 0x7f88d8071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.451+0000 7f88de027640 1 -- 172.21.15.38:0/2486124800 >> v1:172.21.15.38:6789/0 conn(0x7f88d809c980 legacy=0x7f88d815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:40.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.451+0000 7f88de027640 1 -- 172.21.15.38:0/2486124800 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d815bd90 con 0x7f88d815b0e0 2023-12-22T08:53:40.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.452+0000 7f88de027640 1 --2- 172.21.15.38:0/2486124800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88d815b0e0 0x7f88d815b4c0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f88d40097a0 tx=0x7f88d402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790ceab299d6f382 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:40.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.452+0000 7f88dd025640 1 -- 172.21.15.38:0/2486124800 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d402f050 con 0x7f88d815b0e0 2023-12-22T08:53:40.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.452+0000 7f88dd025640 1 -- 172.21.15.38:0/2486124800 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d4031700 con 0x7f88d815b0e0 2023-12-22T08:53:40.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.452+0000 7f88dd025640 1 -- 172.21.15.38:0/2486124800 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4031a90 con 0x7f88d815b0e0 2023-12-22T08:53:40.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.453+0000 7f88df029640 1 -- 172.21.15.38:0/2486124800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88d815b0e0 msgr2=0x7f88d815b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:40.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.453+0000 7f88df029640 1 --2- 172.21.15.38:0/2486124800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88d815b0e0 0x7f88d815b4c0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f88d40097a0 tx=0x7f88d402b7a0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.453+0000 7f88df029640 1 -- 172.21.15.38:0/2486124800 shutdown_connections 2023-12-22T08:53:40.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.453+0000 7f88df029640 1 --2- 172.21.15.38:0/2486124800 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d8071460 0x7f88d8071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.453+0000 7f88df029640 1 --2- 172.21.15.38:0/2486124800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88d815b0e0 0x7f88d815b4c0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.453+0000 7f88df029640 1 -- 172.21.15.38:0/2486124800 >> 172.21.15.38:0/2486124800 conn(0x7f88d80cf000 msgr2=0x7f88d80cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:40.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.453+0000 7f88df029640 1 -- 172.21.15.38:0/2486124800 shutdown_connections 2023-12-22T08:53:40.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.453+0000 7f88df029640 1 -- 172.21.15.38:0/2486124800 wait complete. 2023-12-22T08:53:40.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.455+0000 7f88df029640 1 Processor -- start 2023-12-22T08:53:40.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.455+0000 7f88df029640 1 -- start start 2023-12-22T08:53:40.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.457+0000 7f88df029640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d8071460 0x7f88d814ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:40.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.457+0000 7f88df029640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d809c980 0x7f88d814d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:40.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.457+0000 7f88df029640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88d815b0e0 0x7f88d809b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:40.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.457+0000 7f88df029640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d814f4d0 con 0x7f88d815b0e0 2023-12-22T08:53:40.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.457+0000 7f88df029640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d814eb00 con 0x7f88d8071460 2023-12-22T08:53:40.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.457+0000 7f88df029640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d814df00 con 0x7f88d809c980 2023-12-22T08:53:40.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.457+0000 7f88de828640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88d815b0e0 0x7f88d809b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:40.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.457+0000 7f88de828640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88d815b0e0 0x7f88d809b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41322/0 (socket says 172.21.15.38:41322) 2023-12-22T08:53:40.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.457+0000 7f88de828640 1 -- 172.21.15.38:0/497841021 learned_addr learned my addr 172.21.15.38:0/497841021 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:40.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.457+0000 7f88de027640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d8071460 0x7f88d814ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:40.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.457+0000 7f88dd826640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d809c980 0x7f88d814d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:40.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.458+0000 7f88de828640 1 -- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d809c980 msgr2=0x7f88d814d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:40.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.458+0000 7f88de828640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d809c980 0x7f88d814d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.458+0000 7f88de828640 1 -- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d8071460 msgr2=0x7f88d814ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:40.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.458+0000 7f88de828640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d8071460 0x7f88d814ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.458+0000 7f88de828640 1 -- 172.21.15.38:0/497841021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4009400 con 0x7f88d815b0e0 2023-12-22T08:53:40.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.458+0000 7f88de828640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88d815b0e0 0x7f88d809b220 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f88d0007e40 tx=0x7f88d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:40.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.458+0000 7f88ceffd640 1 -- 172.21.15.38:0/497841021 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0014620 con 0x7f88d815b0e0 2023-12-22T08:53:40.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.458+0000 7f88ceffd640 1 -- 172.21.15.38:0/497841021 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d000ee90 con 0x7f88d815b0e0 2023-12-22T08:53:40.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.458+0000 7f88ceffd640 1 -- 172.21.15.38:0/497841021 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d00149e0 con 0x7f88d815b0e0 2023-12-22T08:53:40.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.458+0000 7f88df029640 1 -- 172.21.15.38:0/497841021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d815a890 con 0x7f88d815b0e0 2023-12-22T08:53:40.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.459+0000 7f88df029640 1 -- 172.21.15.38:0/497841021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d814e4b0 con 0x7f88d815b0e0 2023-12-22T08:53:40.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.460+0000 7f88df029640 1 -- 172.21.15.38:0/497841021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d8061910 con 0x7f88d815b0e0 2023-12-22T08:53:40.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.461+0000 7f88ceffd640 1 -- 172.21.15.38:0/497841021 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f88d0014b40 con 0x7f88d815b0e0 2023-12-22T08:53:40.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.462+0000 7f88ceffd640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88bc06a460 0x7f88bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:40.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.462+0000 7f88ceffd640 1 -- 172.21.15.38:0/497841021 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88d0089290 con 0x7f88d815b0e0 2023-12-22T08:53:40.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.463+0000 7f88de027640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88bc06a460 0x7f88bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:40.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.464+0000 7f88de027640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88bc06a460 0x7f88bc06c920 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f88d4035000 tx=0x7f88d4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:40.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.468+0000 7f88ceffd640 1 -- 172.21.15.38:0/497841021 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f88d00547e0 con 0x7f88d815b0e0 2023-12-22T08:53:40.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.676+0000 7f88df029640 1 -- 172.21.15.38:0/497841021 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f88d806d7d0 con 0x7f88d815b0e0 2023-12-22T08:53:40.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.677+0000 7f88ceffd640 1 -- 172.21.15.38:0/497841021 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v193) v1 ==== 80+0+0 (secure 0 0 0) 0x7f88d0057e00 con 0x7f88d815b0e0 2023-12-22T08:53:40.677 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:53:40.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.679+0000 7f88df029640 1 -- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88bc06a460 msgr2=0x7f88bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:40.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.679+0000 7f88df029640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88bc06a460 0x7f88bc06c920 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f88d4035000 tx=0x7f88d4008030 comp rx=0 tx=0).stop 2023-12-22T08:53:40.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.679+0000 7f88df029640 1 -- 172.21.15.38:0/497841021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88d815b0e0 msgr2=0x7f88d809b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:40.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.679+0000 7f88df029640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88d815b0e0 0x7f88d809b220 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f88d0007e40 tx=0x7f88d000e4b0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.680+0000 7f88df029640 1 -- 172.21.15.38:0/497841021 shutdown_connections 2023-12-22T08:53:40.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.680+0000 7f88df029640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f88bc06a460 0x7f88bc06c920 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.680+0000 7f88df029640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88d815b0e0 0x7f88d809b220 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.680+0000 7f88df029640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88d809c980 0x7f88d814d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.680+0000 7f88df029640 1 --2- 172.21.15.38:0/497841021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d8071460 0x7f88d814ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:40.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.680+0000 7f88df029640 1 -- 172.21.15.38:0/497841021 >> 172.21.15.38:0/497841021 conn(0x7f88d80cf000 msgr2=0x7f88d815e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:40.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.680+0000 7f88df029640 1 -- 172.21.15.38:0/497841021 shutdown_connections 2023-12-22T08:53:40.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:40.680+0000 7f88df029640 1 -- 172.21.15.38:0/497841021 wait complete. 2023-12-22T08:53:40.700 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T08:53:40.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:40.701 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-22T08:53:40.831 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:53:40.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:40.831 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T08:53:40.887 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:53:40.887 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:40.931 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:53:40.931 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:41.027 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:53:41.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.260+0000 7f29f6cfa640 1 Processor -- start 2023-12-22T08:53:41.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.260+0000 7f29f6cfa640 1 -- start start 2023-12-22T08:53:41.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.262+0000 7f29f6cfa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f29f0157980 0x7f29f015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:41.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.262+0000 7f29f6cfa640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29f006d640 0x7f29f00d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:41.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.262+0000 7f29f6cfa640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f00d1520 con 0x7f29f00b3ff0 2023-12-22T08:53:41.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.262+0000 7f29f6cfa640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f00d1800 con 0x7f29f006d640 2023-12-22T08:53:41.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.262+0000 7f29f6cfa640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f00d1ae0 con 0x7f29f0157980 2023-12-22T08:53:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.263+0000 7f29f64f9640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29f006d640 0x7f29f00d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.263+0000 7f29f54f7640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f29f00b3ff0 0x7f29f006cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46772/0 (socket says 172.21.15.38:46772) 2023-12-22T08:53:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.263+0000 7f29f54f7640 1 -- 172.21.15.38:0/1397554562 learned_addr learned my addr 172.21.15.38:0/1397554562 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.263+0000 7f29f5cf8640 1 --2- 172.21.15.38:0/1397554562 >> v2:172.21.15.89:3300/0 conn(0x7f29f0157980 0x7f29f015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.263+0000 7f29f64f9640 1 -- 172.21.15.38:0/1397554562 >> v2:172.21.15.89:3300/0 conn(0x7f29f0157980 msgr2=0x7f29f015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.263+0000 7f29f64f9640 1 --2- 172.21.15.38:0/1397554562 >> v2:172.21.15.89:3300/0 conn(0x7f29f0157980 0x7f29f015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.263+0000 7f29f64f9640 1 -- 172.21.15.38:0/1397554562 >> v1:172.21.15.38:6789/0 conn(0x7f29f00b3ff0 legacy=0x7f29f006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.263+0000 7f29f64f9640 1 -- 172.21.15.38:0/1397554562 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f00d1dc0 con 0x7f29f006d640 2023-12-22T08:53:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.263+0000 7f29f4cf6640 1 -- 172.21.15.38:0/1397554562 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002749803 0 0) 0x7f29f00d1520 con 0x7f29f00b3ff0 2023-12-22T08:53:41.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.264+0000 7f29f64f9640 1 --2- 172.21.15.38:0/1397554562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f006d640 0x7f29f00d25c0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f29f00d3df0 tx=0x7f29e802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc9622b7d7367cd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:41.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.265+0000 7f29f4cf6640 1 -- 172.21.15.38:0/1397554562 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e802cc80 con 0x7f29f006d640 2023-12-22T08:53:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.265+0000 7f29f4cf6640 1 -- 172.21.15.38:0/1397554562 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e802cde0 con 0x7f29f006d640 2023-12-22T08:53:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.265+0000 7f29f4cf6640 1 -- 172.21.15.38:0/1397554562 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8034660 con 0x7f29f006d640 2023-12-22T08:53:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.265+0000 7f29f6cfa640 1 -- 172.21.15.38:0/1397554562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f006d640 msgr2=0x7f29f00d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.265+0000 7f29f6cfa640 1 --2- 172.21.15.38:0/1397554562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f006d640 0x7f29f00d25c0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f29f00d3df0 tx=0x7f29e802bed0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.266+0000 7f29f6cfa640 1 -- 172.21.15.38:0/1397554562 shutdown_connections 2023-12-22T08:53:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.266+0000 7f29f6cfa640 1 --2- 172.21.15.38:0/1397554562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f006d640 0x7f29f00d25c0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.266+0000 7f29f6cfa640 1 --2- 172.21.15.38:0/1397554562 >> v2:172.21.15.89:3300/0 conn(0x7f29f0157980 0x7f29f015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.266+0000 7f29f6cfa640 1 -- 172.21.15.38:0/1397554562 >> 172.21.15.38:0/1397554562 conn(0x7f29f00d31f0 msgr2=0x7f29f00d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.266+0000 7f29f6cfa640 1 -- 172.21.15.38:0/1397554562 shutdown_connections 2023-12-22T08:53:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.266+0000 7f29f6cfa640 1 -- 172.21.15.38:0/1397554562 wait complete. 2023-12-22T08:53:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.268+0000 7f29f6cfa640 1 Processor -- start 2023-12-22T08:53:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.268+0000 7f29f6cfa640 1 -- start start 2023-12-22T08:53:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.269+0000 7f29f6cfa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29f006d640 0x7f29f0070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.269+0000 7f29f6cfa640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29f00b3ff0 0x7f29f01f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.269+0000 7f29f6cfa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f0157980 0x7f29f014ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.269+0000 7f29f6cfa640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f0150300 con 0x7f29f0157980 2023-12-22T08:53:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.269+0000 7f29f6cfa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f0150790 con 0x7f29f006d640 2023-12-22T08:53:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.269+0000 7f29f6cfa640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f01f2ae0 con 0x7f29f00b3ff0 2023-12-22T08:53:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.269+0000 7f29f64f9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f0157980 0x7f29f014ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.269+0000 7f29f64f9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f0157980 0x7f29f014ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60134/0 (socket says 172.21.15.38:60134) 2023-12-22T08:53:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.269+0000 7f29f64f9640 1 -- 172.21.15.38:0/3374806222 learned_addr learned my addr 172.21.15.38:0/3374806222 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.269+0000 7f29f5cf8640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29f006d640 0x7f29f0070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.269+0000 7f29f54f7640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29f00b3ff0 0x7f29f01f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.270+0000 7f29f64f9640 1 -- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29f00b3ff0 msgr2=0x7f29f01f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.270+0000 7f29f64f9640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29f00b3ff0 0x7f29f01f25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.270+0000 7f29f64f9640 1 -- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29f006d640 msgr2=0x7f29f0070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.270+0000 7f29f64f9640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29f006d640 0x7f29f0070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.270+0000 7f29f64f9640 1 -- 172.21.15.38:0/3374806222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e8009a70 con 0x7f29f0157980 2023-12-22T08:53:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.270+0000 7f29f64f9640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f0157980 0x7f29f014ef10 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009e80 tx=0x7f29e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:41.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.270+0000 7f29e67fc640 1 -- 172.21.15.38:0/3374806222 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8040650 con 0x7f29f0157980 2023-12-22T08:53:41.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.270+0000 7f29e67fc640 1 -- 172.21.15.38:0/3374806222 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e80407b0 con 0x7f29f0157980 2023-12-22T08:53:41.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.270+0000 7f29e67fc640 1 -- 172.21.15.38:0/3374806222 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8040b60 con 0x7f29f0157980 2023-12-22T08:53:41.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.270+0000 7f29f6cfa640 1 -- 172.21.15.38:0/3374806222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f014f450 con 0x7f29f0157980 2023-12-22T08:53:41.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.271+0000 7f29f6cfa640 1 -- 172.21.15.38:0/3374806222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f014f9d0 con 0x7f29f0157980 2023-12-22T08:53:41.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.272+0000 7f29f6cfa640 1 -- 172.21.15.38:0/3374806222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f0150470 con 0x7f29f0157980 2023-12-22T08:53:41.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.273+0000 7f29e67fc640 1 -- 172.21.15.38:0/3374806222 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f29e8040cc0 con 0x7f29f0157980 2023-12-22T08:53:41.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.274+0000 7f29e67fc640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29d406a430 0x7f29d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:41.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.274+0000 7f29e67fc640 1 -- 172.21.15.38:0/3374806222 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29e80ab7b0 con 0x7f29f0157980 2023-12-22T08:53:41.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.275+0000 7f29f5cf8640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29d406a430 0x7f29d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:41.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.276+0000 7f29f5cf8640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29d406a430 0x7f29d406c8f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f29ec006fd0 tx=0x7f29ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.279+0000 7f29e67fc640 1 -- 172.21.15.38:0/3374806222 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f29e8076d00 con 0x7f29f0157980 2023-12-22T08:53:41.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.478+0000 7f29f6cfa640 1 -- 172.21.15.38:0/3374806222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29f0061910 con 0x7f29f0157980 2023-12-22T08:53:41.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.480+0000 7f29e67fc640 1 -- 172.21.15.38:0/3374806222 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+16090 (secure 0 0 0) 0x7f29e8009450 con 0x7f29f0157980 2023-12-22T08:53:41.481 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:41.482 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":194,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:53:41.417147+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:53:02.354802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-22T08:53:03.461583+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:53:41.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.483+0000 7f29f6cfa640 1 -- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29d406a430 msgr2=0x7f29d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.483+0000 7f29f6cfa640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29d406a430 0x7f29d406c8f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f29ec006fd0 tx=0x7f29ec008040 comp rx=0 tx=0).stop 2023-12-22T08:53:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.484+0000 7f29f6cfa640 1 -- 172.21.15.38:0/3374806222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f0157980 msgr2=0x7f29f014ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.484+0000 7f29f6cfa640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f0157980 0x7f29f014ef10 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009e80 tx=0x7f29e8004a40 comp rx=0 tx=0).stop 2023-12-22T08:53:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.484+0000 7f29f6cfa640 1 -- 172.21.15.38:0/3374806222 shutdown_connections 2023-12-22T08:53:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.484+0000 7f29f6cfa640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f29d406a430 0x7f29d406c8f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.484+0000 7f29f6cfa640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f0157980 0x7f29f014ef10 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.484+0000 7f29f6cfa640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29f00b3ff0 0x7f29f01f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.484+0000 7f29f6cfa640 1 --2- 172.21.15.38:0/3374806222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29f006d640 0x7f29f0070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.484+0000 7f29f6cfa640 1 -- 172.21.15.38:0/3374806222 >> 172.21.15.38:0/3374806222 conn(0x7f29f00d31f0 msgr2=0x7f29f00d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.484+0000 7f29f6cfa640 1 -- 172.21.15.38:0/3374806222 shutdown_connections 2023-12-22T08:53:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.484+0000 7f29f6cfa640 1 -- 172.21.15.38:0/3374806222 wait complete. 2023-12-22T08:53:41.504 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:53:02.354802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '189', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:53:03.461583+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '194', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:53:41.505 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:53:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.734+0000 7f4776862640 1 Processor -- start 2023-12-22T08:53:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.734+0000 7f4776862640 1 -- start start 2023-12-22T08:53:41.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.736+0000 7f4776862640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f47701508e0 0x7f4770071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:41.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.736+0000 7f4776862640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47700ae600 0x7f4770071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:41.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.736+0000 7f4776862640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477015ac10 con 0x7f477006c820 2023-12-22T08:53:41.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.736+0000 7f4776862640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477015a000 con 0x7f47701508e0 2023-12-22T08:53:41.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.736+0000 7f4776862640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477015a2e0 con 0x7f47700ae600 2023-12-22T08:53:41.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.737+0000 7f4775860640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f47701508e0 0x7f4770071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:41.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.737+0000 7f4775860640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f47701508e0 0x7f4770071a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60150/0 (socket says 172.21.15.38:60150) 2023-12-22T08:53:41.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.737+0000 7f4775860640 1 -- 172.21.15.38:0/3911384096 learned_addr learned my addr 172.21.15.38:0/3911384096 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:41.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.737+0000 7f4776061640 1 --2- 172.21.15.38:0/3911384096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47700ae600 0x7f4770071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:41.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.737+0000 7f4775860640 1 -- 172.21.15.38:0/3911384096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47700ae600 msgr2=0x7f4770071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.737+0000 7f4775860640 1 --2- 172.21.15.38:0/3911384096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47700ae600 0x7f4770071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.737+0000 7f4775860640 1 -- 172.21.15.38:0/3911384096 >> v1:172.21.15.38:6789/0 conn(0x7f477006c820 legacy=0x7f47700adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.737+0000 7f4775860640 1 -- 172.21.15.38:0/3911384096 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477015a5c0 con 0x7f47701508e0 2023-12-22T08:53:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.737+0000 7f4776061640 1 --2- 172.21.15.38:0/3911384096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47700ae600 0x7f4770071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.739+0000 7f4775860640 1 --2- 172.21.15.38:0/3911384096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47701508e0 0x7f4770071a20 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f476c00bb00 tx=0x7f476c02dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3086afdcf325061 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.740+0000 7f477485e640 1 -- 172.21.15.38:0/3911384096 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c02ec50 con 0x7f47701508e0 2023-12-22T08:53:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.740+0000 7f477485e640 1 -- 172.21.15.38:0/3911384096 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c032070 con 0x7f47701508e0 2023-12-22T08:53:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.740+0000 7f477485e640 1 -- 172.21.15.38:0/3911384096 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c038400 con 0x7f47701508e0 2023-12-22T08:53:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.741+0000 7f4776862640 1 -- 172.21.15.38:0/3911384096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47701508e0 msgr2=0x7f4770071a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.741+0000 7f4776862640 1 --2- 172.21.15.38:0/3911384096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47701508e0 0x7f4770071a20 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f476c00bb00 tx=0x7f476c02dea0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.741+0000 7f4776862640 1 -- 172.21.15.38:0/3911384096 shutdown_connections 2023-12-22T08:53:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.741+0000 7f4776862640 1 --2- 172.21.15.38:0/3911384096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47700ae600 0x7f4770071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.741+0000 7f4776862640 1 --2- 172.21.15.38:0/3911384096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47701508e0 0x7f4770071a20 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.741+0000 7f4776862640 1 -- 172.21.15.38:0/3911384096 >> 172.21.15.38:0/3911384096 conn(0x7f47700b0b60 msgr2=0x7f47700b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.741+0000 7f4776862640 1 -- 172.21.15.38:0/3911384096 shutdown_connections 2023-12-22T08:53:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.741+0000 7f4776862640 1 -- 172.21.15.38:0/3911384096 wait complete. 2023-12-22T08:53:41.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.743+0000 7f4776862640 1 Processor -- start 2023-12-22T08:53:41.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.743+0000 7f4776862640 1 -- start start 2023-12-22T08:53:41.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.744+0000 7f4776862640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f477006c820 0x7f4770158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:41.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.744+0000 7f4776862640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47700ae600 0x7f4770158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:41.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.744+0000 7f4776862640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47701508e0 0x7f4770150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:41.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.744+0000 7f4776862640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477009a540 con 0x7f477006c820 2023-12-22T08:53:41.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.744+0000 7f4776862640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4770099ba0 con 0x7f47700ae600 2023-12-22T08:53:41.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.744+0000 7f4776862640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4770099e80 con 0x7f47701508e0 2023-12-22T08:53:41.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.744+0000 7f4775860640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f477006c820 0x7f4770158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:41.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.744+0000 7f4775860640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f477006c820 0x7f4770158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60152/0 (socket says 172.21.15.38:60152) 2023-12-22T08:53:41.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.745+0000 7f4775860640 1 -- 172.21.15.38:0/3859825953 learned_addr learned my addr 172.21.15.38:0/3859825953 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:41.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.745+0000 7f4775860640 1 -- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47701508e0 msgr2=0x7f4770150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:41.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.745+0000 7f4776061640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47701508e0 0x7f4770150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:41.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.745+0000 7f4775860640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47701508e0 0x7f4770150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.745+0000 7f4775860640 1 -- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47700ae600 msgr2=0x7f4770158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:41.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.745+0000 7f477505f640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47700ae600 0x7f4770158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:41.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.745+0000 7f4775860640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47700ae600 0x7f4770158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.745+0000 7f4775860640 1 -- 172.21.15.38:0/3859825953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c00b760 con 0x7f477006c820 2023-12-22T08:53:41.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.745+0000 7f4775860640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f477006c820 0x7f4770158940 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f476c03a040 tx=0x7f476c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:41.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.746+0000 7f47667fc640 1 -- 172.21.15.38:0/3859825953 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c041440 con 0x7f477006c820 2023-12-22T08:53:41.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.746+0000 7f47667fc640 1 -- 172.21.15.38:0/3859825953 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c0415a0 con 0x7f477006c820 2023-12-22T08:53:41.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.746+0000 7f47667fc640 1 -- 172.21.15.38:0/3859825953 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c041950 con 0x7f477006c820 2023-12-22T08:53:41.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.746+0000 7f4776862640 1 -- 172.21.15.38:0/3859825953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477009a160 con 0x7f477006c820 2023-12-22T08:53:41.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.746+0000 7f4776862640 1 -- 172.21.15.38:0/3859825953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477014fb70 con 0x7f477006c820 2023-12-22T08:53:41.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.747+0000 7f4776862640 1 -- 172.21.15.38:0/3859825953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4770061910 con 0x7f477006c820 2023-12-22T08:53:41.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.748+0000 7f47667fc640 1 -- 172.21.15.38:0/3859825953 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f476c041ab0 con 0x7f477006c820 2023-12-22T08:53:41.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.749+0000 7f47667fc640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f475406a430 0x7f475406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:41.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.749+0000 7f47667fc640 1 -- 172.21.15.38:0/3859825953 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f476c0ad390 con 0x7f477006c820 2023-12-22T08:53:41.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.750+0000 7f47667fc640 1 -- 172.21.15.38:0/3859825953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f4754071f60 con 0x7f477006c820 2023-12-22T08:53:41.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.750+0000 7f477505f640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f475406a430 0x7f475406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:41.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.751+0000 7f477505f640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f475406a430 0x7f475406c8f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f47701f2090 tx=0x7f4760009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:41.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.755+0000 7f47667fc640 1 -- 172.21.15.38:0/3859825953 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f476c078970 con 0x7f477006c820 2023-12-22T08:53:41.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.949+0000 7f4776862640 1 -- 172.21.15.38:0/3859825953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47700ac4f0 con 0x7f477006c820 2023-12-22T08:53:41.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.950+0000 7f47667fc640 1 -- 172.21.15.38:0/3859825953 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v194) v1 ==== 93+0+10 (secure 0 0 0) 0x7f476c046020 con 0x7f477006c820 2023-12-22T08:53:41.950 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:53:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.952+0000 7f4776862640 1 -- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f475406a430 msgr2=0x7f475406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.953+0000 7f4776862640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f475406a430 0x7f475406c8f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f47701f2090 tx=0x7f4760009040 comp rx=0 tx=0).stop 2023-12-22T08:53:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.953+0000 7f4776862640 1 -- 172.21.15.38:0/3859825953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f477006c820 msgr2=0x7f4770158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.953+0000 7f4776862640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f477006c820 0x7f4770158940 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f476c03a040 tx=0x7f476c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.953+0000 7f4776862640 1 -- 172.21.15.38:0/3859825953 shutdown_connections 2023-12-22T08:53:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.953+0000 7f4776862640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47701508e0 0x7f4770150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.953+0000 7f4776862640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47700ae600 0x7f4770158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.953+0000 7f4776862640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f475406a430 0x7f475406c8f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.953+0000 7f4776862640 1 --2- 172.21.15.38:0/3859825953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f477006c820 0x7f4770158940 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.953+0000 7f4776862640 1 -- 172.21.15.38:0/3859825953 >> 172.21.15.38:0/3859825953 conn(0x7f47700b0b60 msgr2=0x7f477015c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.953+0000 7f4776862640 1 -- 172.21.15.38:0/3859825953 shutdown_connections 2023-12-22T08:53:41.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:41.953+0000 7f4776862640 1 -- 172.21.15.38:0/3859825953 wait complete. 2023-12-22T08:53:41.972 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:53:42.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.205+0000 7f7838840640 1 Processor -- start 2023-12-22T08:53:42.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.205+0000 7f7838840640 1 -- start start 2023-12-22T08:53:42.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.206+0000 7f7838840640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415ad90 0x7f78340caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.206+0000 7f7838840640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783415e630 con 0x7f783415e050 2023-12-22T08:53:42.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.207+0000 7f7838840640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78341610d0 con 0x7f7834161bb0 2023-12-22T08:53:42.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.207+0000 7f7838840640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78340ce2c0 con 0x7f783415ad90 2023-12-22T08:53:42.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.207+0000 7f783359e640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f783415e050 0x7f78340d0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46784/0 (socket says 172.21.15.38:46784) 2023-12-22T08:53:42.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.207+0000 7f783359e640 1 -- 172.21.15.38:0/2917709170 learned_addr learned my addr 172.21.15.38:0/2917709170 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:42.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.207+0000 7f7832d9d640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415ad90 0x7f78340caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697144257 0 0) 0x7f783415e630 con 0x7f783415e050 2023-12-22T08:53:42.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7820003520 con 0x7f783415e050 2023-12-22T08:53:42.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3999096132 0 0) 0x7f7820003520 con 0x7f783415e050 2023-12-22T08:53:42.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415ad90 msgr2=0x7f78340caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:42.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415ad90 0x7f78340caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 >> v1:172.21.15.89:6789/0 conn(0x7f7834161bb0 legacy=0x7f783415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:42.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78341613b0 con 0x7f783415e050 2023-12-22T08:53:42.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f782c0019f0 con 0x7f783415e050 2023-12-22T08:53:42.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 >> v1:172.21.15.38:6789/0 conn(0x7f783415e050 legacy=0x7f78340d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:42.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78200039a0 0x7f7820003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78200047c0 0x7f7820004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415ad90 0x7f7820005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782000ba30 con 0x7f78200039a0 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782000bba0 con 0x7f78200047c0 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782000bd60 con 0x7f783415ad90 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.208+0000 7f7832d9d640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78200039a0 0x7f7820003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.209+0000 7f782a59c640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78200047c0 0x7f7820004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.209+0000 7f7832d9d640 1 -- 172.21.15.38:0/2917709170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415ad90 msgr2=0x7f7820005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.209+0000 7f783359e640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415ad90 0x7f7820005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.209+0000 7f7832d9d640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415ad90 0x7f7820005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.209+0000 7f7832d9d640 1 -- 172.21.15.38:0/2917709170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78200047c0 msgr2=0x7f7820004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.209+0000 7f7832d9d640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78200047c0 0x7f7820004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.209+0000 7f7832d9d640 1 -- 172.21.15.38:0/2917709170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7820003520 con 0x7f78200039a0 2023-12-22T08:53:42.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.209+0000 7f783359e640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f783415ad90 0x7f7820005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:42.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.209+0000 7f782a59c640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78200047c0 0x7f7820004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:42.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.210+0000 7f7832d9d640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78200039a0 0x7f7820003dc0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f7824009a90 tx=0x7f78200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb723b9d4389f38e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:42.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.211+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782402c660 con 0x7f78200039a0 2023-12-22T08:53:42.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.211+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782402c7c0 con 0x7f78200039a0 2023-12-22T08:53:42.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.211+0000 7f783259c640 1 -- 172.21.15.38:0/2917709170 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782402cb50 con 0x7f78200039a0 2023-12-22T08:53:42.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.211+0000 7f7838840640 1 -- 172.21.15.38:0/2917709170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78200039a0 msgr2=0x7f7820003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:42.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.211+0000 7f7838840640 1 --2- 172.21.15.38:0/2917709170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78200039a0 0x7f7820003dc0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f7824009a90 tx=0x7f78200057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.211+0000 7f783359e640 1 -- 172.21.15.38:0/2917709170 reap_dead start 2023-12-22T08:53:42.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.211+0000 7f7838840640 1 -- 172.21.15.38:0/2917709170 shutdown_connections 2023-12-22T08:53:42.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.211+0000 7f7838840640 1 -- 172.21.15.38:0/2917709170 >> 172.21.15.38:0/2917709170 conn(0x7f78340d31c0 msgr2=0x7f78340d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:42.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.211+0000 7f7838840640 1 -- 172.21.15.38:0/2917709170 shutdown_connections 2023-12-22T08:53:42.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.211+0000 7f7838840640 1 -- 172.21.15.38:0/2917709170 wait complete. 2023-12-22T08:53:42.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.213+0000 7f7838840640 1 Processor -- start 2023-12-22T08:53:42.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.213+0000 7f7838840640 1 -- start start 2023-12-22T08:53:42.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.214+0000 7f7838840640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78200039a0 0x7f78340c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.214+0000 7f7838840640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78340c7e20 0x7f78340c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.214+0000 7f7838840640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f783415c060 0x7f783415c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.214+0000 7f7838840640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78340c9560 con 0x7f78340c7e20 2023-12-22T08:53:42.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.214+0000 7f7838840640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783415ca20 con 0x7f783415c060 2023-12-22T08:53:42.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.214+0000 7f7838840640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78340c88e0 con 0x7f78200039a0 2023-12-22T08:53:42.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.215+0000 7f782a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78340c7e20 0x7f78340c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.215+0000 7f782a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78340c7e20 0x7f78340c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60178/0 (socket says 172.21.15.38:60178) 2023-12-22T08:53:42.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.215+0000 7f782a59c640 1 -- 172.21.15.38:0/2057380254 learned_addr learned my addr 172.21.15.38:0/2057380254 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:42.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.215+0000 7f7832d9d640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78200039a0 0x7f78340c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.215+0000 7f782a59c640 1 -- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78200039a0 msgr2=0x7f78340c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:42.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.215+0000 7f783359e640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f783415c060 0x7f783415c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.215+0000 7f782a59c640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78200039a0 0x7f78340c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.215+0000 7f782a59c640 1 -- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f783415c060 msgr2=0x7f783415c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:42.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.215+0000 7f782a59c640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f783415c060 0x7f783415c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.215+0000 7f782a59c640 1 -- 172.21.15.38:0/2057380254 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78340c8bc0 con 0x7f78340c7e20 2023-12-22T08:53:42.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.215+0000 7f7832d9d640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78200039a0 0x7f78340c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:42.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.215+0000 7f782a59c640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78340c7e20 0x7f78340c82a0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f781c000f60 tx=0x7f781c00d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:42.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.216+0000 7f782bfff640 1 -- 172.21.15.38:0/2057380254 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c005480 con 0x7f78340c7e20 2023-12-22T08:53:42.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.216+0000 7f782bfff640 1 -- 172.21.15.38:0/2057380254 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c003610 con 0x7f78340c7e20 2023-12-22T08:53:42.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.216+0000 7f782bfff640 1 -- 172.21.15.38:0/2057380254 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c0039c0 con 0x7f78340c7e20 2023-12-22T08:53:42.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.216+0000 7f7838840640 1 -- 172.21.15.38:0/2057380254 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78340c8ea0 con 0x7f78340c7e20 2023-12-22T08:53:42.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.216+0000 7f7838840640 1 -- 172.21.15.38:0/2057380254 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78340bb2a0 con 0x7f78340c7e20 2023-12-22T08:53:42.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.217+0000 7f7838840640 1 -- 172.21.15.38:0/2057380254 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7834061910 con 0x7f78340c7e20 2023-12-22T08:53:42.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.218+0000 7f782bfff640 1 -- 172.21.15.38:0/2057380254 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f781c003b20 con 0x7f78340c7e20 2023-12-22T08:53:42.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.219+0000 7f782bfff640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f781406a430 0x7f781406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.219+0000 7f782bfff640 1 -- 172.21.15.38:0/2057380254 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f781c0887d0 con 0x7f78340c7e20 2023-12-22T08:53:42.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.219+0000 7f782bfff640 1 -- 172.21.15.38:0/2057380254 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f7814071f60 con 0x7f78340c7e20 2023-12-22T08:53:42.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.220+0000 7f7832d9d640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f781406a430 0x7f781406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.221+0000 7f7832d9d640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f781406a430 0x7f781406c8f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f7824036000 tx=0x7f7824030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:42.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.223+0000 7f782bfff640 1 -- 172.21.15.38:0/2057380254 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f781c053e60 con 0x7f78340c7e20 2023-12-22T08:53:42.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.414+0000 7f7838840640 1 -- 172.21.15.38:0/2057380254 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78340ce130 con 0x7f78340c7e20 2023-12-22T08:53:42.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.415+0000 7f782bfff640 1 -- 172.21.15.38:0/2057380254 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v194) v1 ==== 104+0+11 (secure 0 0 0) 0x7f781c001230 con 0x7f78340c7e20 2023-12-22T08:53:42.416 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:53:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.418+0000 7f7838840640 1 -- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f781406a430 msgr2=0x7f781406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.418+0000 7f7838840640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f781406a430 0x7f781406c8f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f7824036000 tx=0x7f7824030000 comp rx=0 tx=0).stop 2023-12-22T08:53:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.418+0000 7f7838840640 1 -- 172.21.15.38:0/2057380254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78340c7e20 msgr2=0x7f78340c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.418+0000 7f7838840640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78340c7e20 0x7f78340c82a0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f781c000f60 tx=0x7f781c00d9f0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.418+0000 7f7838840640 1 -- 172.21.15.38:0/2057380254 shutdown_connections 2023-12-22T08:53:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.418+0000 7f7838840640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f783415c060 0x7f783415c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.418+0000 7f7838840640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f781406a430 0x7f781406c8f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.418+0000 7f7838840640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78340c7e20 0x7f78340c82a0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.418+0000 7f7838840640 1 --2- 172.21.15.38:0/2057380254 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78200039a0 0x7f78340c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.418+0000 7f7838840640 1 -- 172.21.15.38:0/2057380254 >> 172.21.15.38:0/2057380254 conn(0x7f78340d31c0 msgr2=0x7f78340cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.418+0000 7f7838840640 1 -- 172.21.15.38:0/2057380254 shutdown_connections 2023-12-22T08:53:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.418+0000 7f7838840640 1 -- 172.21.15.38:0/2057380254 wait complete. 2023-12-22T08:53:42.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:53:42.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.665+0000 7f597998e640 1 Processor -- start 2023-12-22T08:53:42.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.666+0000 7f597998e640 1 -- start start 2023-12-22T08:53:42.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.667+0000 7f597998e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59740cea50 0x7f59740ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.667+0000 7f597998e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f597406d590 0x7f597406da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.667+0000 7f597998e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5974140f70 con 0x7f5974143600 2023-12-22T08:53:42.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.667+0000 7f597998e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59740cf410 con 0x7f597406d590 2023-12-22T08:53:42.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.667+0000 7f597998e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597406c300 con 0x7f59740cea50 2023-12-22T08:53:42.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.668+0000 7f596bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59740cea50 0x7f59740ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.668+0000 7f596bfff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59740cea50 0x7f59740ceed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:49638/0 (socket says 172.21.15.38:49638) 2023-12-22T08:53:42.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.668+0000 7f596bfff640 1 -- 172.21.15.38:0/4222366356 learned_addr learned my addr 172.21.15.38:0/4222366356 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:42.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.668+0000 7f59737fe640 1 --2- 172.21.15.38:0/4222366356 >> v2:172.21.15.89:3300/0 conn(0x7f597406d590 0x7f597406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.669+0000 7f596bfff640 1 -- 172.21.15.38:0/4222366356 >> v2:172.21.15.89:3300/0 conn(0x7f597406d590 msgr2=0x7f597406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:42.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.669+0000 7f596bfff640 1 --2- 172.21.15.38:0/4222366356 >> v2:172.21.15.89:3300/0 conn(0x7f597406d590 0x7f597406da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.669+0000 7f596bfff640 1 -- 172.21.15.38:0/4222366356 >> v1:172.21.15.89:6789/0 conn(0x7f5974143600 legacy=0x7f597415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:42.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.669+0000 7f596bfff640 1 -- 172.21.15.38:0/4222366356 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597406c5e0 con 0x7f59740cea50 2023-12-22T08:53:42.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.671+0000 7f596bfff640 1 --2- 172.21.15.38:0/4222366356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59740cea50 0x7f59740ceed0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f595c009870 tx=0x7f595c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cbdc2dc49923ce8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:42.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.671+0000 7f59727fc640 1 -- 172.21.15.38:0/4222366356 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c030840 con 0x7f59740cea50 2023-12-22T08:53:42.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.672+0000 7f59727fc640 1 -- 172.21.15.38:0/4222366356 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c0309a0 con 0x7f59740cea50 2023-12-22T08:53:42.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.672+0000 7f59727fc640 1 -- 172.21.15.38:0/4222366356 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c030d30 con 0x7f59740cea50 2023-12-22T08:53:42.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.672+0000 7f597998e640 1 -- 172.21.15.38:0/4222366356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59740cea50 msgr2=0x7f59740ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:42.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.672+0000 7f597998e640 1 --2- 172.21.15.38:0/4222366356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59740cea50 0x7f59740ceed0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f595c009870 tx=0x7f595c02b980 comp rx=0 tx=0).stop 2023-12-22T08:53:42.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.672+0000 7f597998e640 1 -- 172.21.15.38:0/4222366356 shutdown_connections 2023-12-22T08:53:42.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.672+0000 7f597998e640 1 --2- 172.21.15.38:0/4222366356 >> v2:172.21.15.89:3300/0 conn(0x7f597406d590 0x7f597406da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.672+0000 7f597998e640 1 --2- 172.21.15.38:0/4222366356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59740cea50 0x7f59740ceed0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.672+0000 7f597998e640 1 -- 172.21.15.38:0/4222366356 >> 172.21.15.38:0/4222366356 conn(0x7f59740cfe70 msgr2=0x7f59740d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:42.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.672+0000 7f597998e640 1 -- 172.21.15.38:0/4222366356 shutdown_connections 2023-12-22T08:53:42.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.673+0000 7f597998e640 1 -- 172.21.15.38:0/4222366356 wait complete. 2023-12-22T08:53:42.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.674+0000 7f597998e640 1 Processor -- start 2023-12-22T08:53:42.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.675+0000 7f597998e640 1 -- start start 2023-12-22T08:53:42.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.675+0000 7f597998e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f597406d590 0x7f59740b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.675+0000 7f597998e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59740cea50 0x7f59741f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.675+0000 7f597998e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5974143600 0x7f59741f6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.675+0000 7f597998e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59741f32c0 con 0x7f597406d590 2023-12-22T08:53:42.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.675+0000 7f597998e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59741f2a10 con 0x7f59740cea50 2023-12-22T08:53:42.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.675+0000 7f597998e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59741f6a80 con 0x7f5974143600 2023-12-22T08:53:42.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.676+0000 7f5972ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f597406d590 0x7f59740b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.676+0000 7f5972ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f597406d590 0x7f59740b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60186/0 (socket says 172.21.15.38:60186) 2023-12-22T08:53:42.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.676+0000 7f5972ffd640 1 -- 172.21.15.38:0/2800172704 learned_addr learned my addr 172.21.15.38:0/2800172704 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:42.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.676+0000 7f596bfff640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59740cea50 0x7f59741f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.676+0000 7f59737fe640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5974143600 0x7f59741f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.676+0000 7f5972ffd640 1 -- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5974143600 msgr2=0x7f59741f6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:42.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.676+0000 7f5972ffd640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5974143600 0x7f59741f6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.676+0000 7f5972ffd640 1 -- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59740cea50 msgr2=0x7f59741f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:42.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.676+0000 7f5972ffd640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59740cea50 0x7f59741f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.676+0000 7f5972ffd640 1 -- 172.21.15.38:0/2800172704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c0094d0 con 0x7f597406d590 2023-12-22T08:53:42.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.676+0000 7f596bfff640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59740cea50 0x7f59741f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:42.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.677+0000 7f5972ffd640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f597406d590 0x7f59740b19e0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f596400c450 tx=0x7f596400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:42.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.677+0000 7f5970ff9640 1 -- 172.21.15.38:0/2800172704 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59640052d0 con 0x7f597406d590 2023-12-22T08:53:42.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.677+0000 7f5970ff9640 1 -- 172.21.15.38:0/2800172704 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5964005430 con 0x7f597406d590 2023-12-22T08:53:42.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.677+0000 7f5970ff9640 1 -- 172.21.15.38:0/2800172704 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964003830 con 0x7f597406d590 2023-12-22T08:53:42.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.677+0000 7f597998e640 1 -- 172.21.15.38:0/2800172704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59741f6cc0 con 0x7f597406d590 2023-12-22T08:53:42.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.677+0000 7f597998e640 1 -- 172.21.15.38:0/2800172704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59741f2ee0 con 0x7f597406d590 2023-12-22T08:53:42.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.678+0000 7f597998e640 1 -- 172.21.15.38:0/2800172704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59741f3400 con 0x7f597406d590 2023-12-22T08:53:42.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.679+0000 7f5970ff9640 1 -- 172.21.15.38:0/2800172704 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5964003990 con 0x7f597406d590 2023-12-22T08:53:42.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.681+0000 7f5970ff9640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f595406a430 0x7f595406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:42.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.681+0000 7f5970ff9640 1 -- 172.21.15.38:0/2800172704 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5964087f30 con 0x7f597406d590 2023-12-22T08:53:42.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.681+0000 7f5970ff9640 1 -- 172.21.15.38:0/2800172704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f5954071f60 con 0x7f597406d590 2023-12-22T08:53:42.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.682+0000 7f596bfff640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f595406a430 0x7f595406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:42.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.683+0000 7f596bfff640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f595406a430 0x7f595406c8f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f595c036000 tx=0x7f595c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:42.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.685+0000 7f5970ff9640 1 -- 172.21.15.38:0/2800172704 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f59741f3400 con 0x7f597406d590 2023-12-22T08:53:42.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.889+0000 7f597998e640 1 -- 172.21.15.38:0/2800172704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5974061910 con 0x7f597406d590 2023-12-22T08:53:42.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.890+0000 7f5970ff9640 1 -- 172.21.15.38:0/2800172704 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v194) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5964017070 con 0x7f597406d590 2023-12-22T08:53:42.891 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:53:42.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.893+0000 7f597998e640 1 -- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f595406a430 msgr2=0x7f595406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:42.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.893+0000 7f597998e640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f595406a430 0x7f595406c8f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f595c036000 tx=0x7f595c03b040 comp rx=0 tx=0).stop 2023-12-22T08:53:42.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.893+0000 7f597998e640 1 -- 172.21.15.38:0/2800172704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f597406d590 msgr2=0x7f59740b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:42.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.893+0000 7f597998e640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f597406d590 0x7f59740b19e0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f596400c450 tx=0x7f596400c910 comp rx=0 tx=0).stop 2023-12-22T08:53:42.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.893+0000 7f597998e640 1 -- 172.21.15.38:0/2800172704 shutdown_connections 2023-12-22T08:53:42.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.893+0000 7f597998e640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5974143600 0x7f59741f6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.893+0000 7f597998e640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59740cea50 0x7f59741f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.893+0000 7f597998e640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f595406a430 0x7f595406c8f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.893+0000 7f597998e640 1 --2- 172.21.15.38:0/2800172704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f597406d590 0x7f59740b19e0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:42.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.893+0000 7f597998e640 1 -- 172.21.15.38:0/2800172704 >> 172.21.15.38:0/2800172704 conn(0x7f59740cfe70 msgr2=0x7f59740b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:42.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.893+0000 7f597998e640 1 -- 172.21.15.38:0/2800172704 shutdown_connections 2023-12-22T08:53:42.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:42.893+0000 7f597998e640 1 -- 172.21.15.38:0/2800172704 wait complete. 2023-12-22T08:53:42.912 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:53:43.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.139+0000 7f62f9e23640 1 Processor -- start 2023-12-22T08:53:43.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.139+0000 7f62f9e23640 1 -- start start 2023-12-22T08:53:43.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.141+0000 7f62f9e23640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f41547a0 0x7f62f415b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.141+0000 7f62f9e23640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f62f4071b90 0x7f62f4070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.141+0000 7f62f9e23640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f40716a0 con 0x7f62f4154b80 2023-12-22T08:53:43.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.141+0000 7f62f9e23640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f40710e0 con 0x7f62f4071b90 2023-12-22T08:53:43.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.141+0000 7f62f9e23640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40713c0 con 0x7f62f41547a0 2023-12-22T08:53:43.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.142+0000 7f62eaffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f62f4071b90 0x7f62f4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.142+0000 7f62eaffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f62f4071b90 0x7f62f4070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60202/0 (socket says 172.21.15.38:60202) 2023-12-22T08:53:43.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.142+0000 7f62f3fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f62f4154b80 0x7f62f40ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.38:45142/0 (socket says 172.21.15.38:45142) 2023-12-22T08:53:43.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.142+0000 7f62eaffd640 1 -- 172.21.15.38:0/345040425 learned_addr learned my addr 172.21.15.38:0/345040425 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:43.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.142+0000 7f62f37fe640 1 --2- 172.21.15.38:0/345040425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f41547a0 0x7f62f415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.142+0000 7f62eaffd640 1 -- 172.21.15.38:0/345040425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f41547a0 msgr2=0x7f62f415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:43.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.142+0000 7f62eaffd640 1 --2- 172.21.15.38:0/345040425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f41547a0 0x7f62f415b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.142+0000 7f62eaffd640 1 -- 172.21.15.38:0/345040425 >> v1:172.21.15.89:6789/0 conn(0x7f62f4154b80 legacy=0x7f62f40ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:43.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.142+0000 7f62eaffd640 1 -- 172.21.15.38:0/345040425 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f415ab00 con 0x7f62f4071b90 2023-12-22T08:53:43.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.144+0000 7f62eaffd640 1 --2- 172.21.15.38:0/345040425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4071b90 0x7f62f4070770 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009870 tx=0x7f62dc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8a160b95350e5b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:43.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.144+0000 7f62f2ffd640 1 -- 172.21.15.38:0/345040425 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc030840 con 0x7f62f4071b90 2023-12-22T08:53:43.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.144+0000 7f62f2ffd640 1 -- 172.21.15.38:0/345040425 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc0309a0 con 0x7f62f4071b90 2023-12-22T08:53:43.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.144+0000 7f62f2ffd640 1 -- 172.21.15.38:0/345040425 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc030d30 con 0x7f62f4071b90 2023-12-22T08:53:43.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.145+0000 7f62f9e23640 1 -- 172.21.15.38:0/345040425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4071b90 msgr2=0x7f62f4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:43.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.145+0000 7f62f9e23640 1 --2- 172.21.15.38:0/345040425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4071b90 0x7f62f4070770 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009870 tx=0x7f62dc02b980 comp rx=0 tx=0).stop 2023-12-22T08:53:43.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.145+0000 7f62f9e23640 1 -- 172.21.15.38:0/345040425 shutdown_connections 2023-12-22T08:53:43.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.145+0000 7f62f9e23640 1 --2- 172.21.15.38:0/345040425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4071b90 0x7f62f4070770 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.145+0000 7f62f9e23640 1 --2- 172.21.15.38:0/345040425 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f41547a0 0x7f62f415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.145+0000 7f62f9e23640 1 -- 172.21.15.38:0/345040425 >> 172.21.15.38:0/345040425 conn(0x7f62f40cf070 msgr2=0x7f62f40cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:43.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.145+0000 7f62f9e23640 1 -- 172.21.15.38:0/345040425 shutdown_connections 2023-12-22T08:53:43.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.145+0000 7f62f9e23640 1 -- 172.21.15.38:0/345040425 wait complete. 2023-12-22T08:53:43.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.147+0000 7f62f9e23640 1 Processor -- start 2023-12-22T08:53:43.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.147+0000 7f62f9e23640 1 -- start start 2023-12-22T08:53:43.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.148+0000 7f62f9e23640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f4071b90 0x7f62f414b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.148+0000 7f62f9e23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f41547a0 0x7f62f414bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.148+0000 7f62f9e23640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4154b80 0x7f62f41534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.148+0000 7f62f9e23640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40ce460 con 0x7f62f4154b80 2023-12-22T08:53:43.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.148+0000 7f62f9e23640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f414d480 con 0x7f62f41547a0 2023-12-22T08:53:43.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.148+0000 7f62f9e23640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f414c400 con 0x7f62f4071b90 2023-12-22T08:53:43.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.148+0000 7f62f3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4154b80 0x7f62f41534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.148+0000 7f62f3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4154b80 0x7f62f41534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60218/0 (socket says 172.21.15.38:60218) 2023-12-22T08:53:43.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.148+0000 7f62f3fff640 1 -- 172.21.15.38:0/4131676272 learned_addr learned my addr 172.21.15.38:0/4131676272 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.149+0000 7f62f37fe640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f4071b90 0x7f62f414b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.149+0000 7f62eaffd640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f41547a0 0x7f62f414bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.149+0000 7f62f3fff640 1 -- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f4071b90 msgr2=0x7f62f414b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.149+0000 7f62f3fff640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f4071b90 0x7f62f414b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.149+0000 7f62f3fff640 1 -- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f41547a0 msgr2=0x7f62f414bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.149+0000 7f62f3fff640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f41547a0 0x7f62f414bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.149+0000 7f62f3fff640 1 -- 172.21.15.38:0/4131676272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc0094d0 con 0x7f62f4154b80 2023-12-22T08:53:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.149+0000 7f62f37fe640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f4071b90 0x7f62f414b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.149+0000 7f62eaffd640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f41547a0 0x7f62f414bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.149+0000 7f62f3fff640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4154b80 0x7f62f41534a0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f62ec001eb0 tx=0x7f62ec00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.149+0000 7f62f0ff9640 1 -- 172.21.15.38:0/4131676272 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0074e0 con 0x7f62f4154b80 2023-12-22T08:53:43.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.150+0000 7f62f0ff9640 1 -- 172.21.15.38:0/4131676272 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec007640 con 0x7f62f4154b80 2023-12-22T08:53:43.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.150+0000 7f62f0ff9640 1 -- 172.21.15.38:0/4131676272 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0049e0 con 0x7f62f4154b80 2023-12-22T08:53:43.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.150+0000 7f62f9e23640 1 -- 172.21.15.38:0/4131676272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f40afce0 con 0x7f62f4154b80 2023-12-22T08:53:43.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.150+0000 7f62f9e23640 1 -- 172.21.15.38:0/4131676272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f40aff50 con 0x7f62f4154b80 2023-12-22T08:53:43.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.151+0000 7f62f9e23640 1 -- 172.21.15.38:0/4131676272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f40b0140 con 0x7f62f4154b80 2023-12-22T08:53:43.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.152+0000 7f62f0ff9640 1 -- 172.21.15.38:0/4131676272 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f62ec004b40 con 0x7f62f4154b80 2023-12-22T08:53:43.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.153+0000 7f62f0ff9640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62d406a430 0x7f62d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.153+0000 7f62f0ff9640 1 -- 172.21.15.38:0/4131676272 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62ec088330 con 0x7f62f4154b80 2023-12-22T08:53:43.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.153+0000 7f62f0ff9640 1 -- 172.21.15.38:0/4131676272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f62d4071f60 con 0x7f62f4154b80 2023-12-22T08:53:43.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.153+0000 7f62f37fe640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62d406a430 0x7f62d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.154+0000 7f62f37fe640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62d406a430 0x7f62d406c8f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f62e4007520 tx=0x7f62e400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:43.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.157+0000 7f62f0ff9640 1 -- 172.21.15.38:0/4131676272 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f62ec053880 con 0x7f62f4154b80 2023-12-22T08:53:43.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.361+0000 7f62f9e23640 1 -- 172.21.15.38:0/4131676272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f62f415adb0 con 0x7f62f4154b80 2023-12-22T08:53:43.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.361+0000 7f62f0ff9640 1 -- 172.21.15.38:0/4131676272 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v194) v1 ==== 80+0+0 (secure 0 0 0) 0x7f62ec056ea0 con 0x7f62f4154b80 2023-12-22T08:53:43.362 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2023-12-22T08:53:43.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.364+0000 7f62f9e23640 1 -- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62d406a430 msgr2=0x7f62d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:43.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.364+0000 7f62f9e23640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62d406a430 0x7f62d406c8f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f62e4007520 tx=0x7f62e400b040 comp rx=0 tx=0).stop 2023-12-22T08:53:43.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.364+0000 7f62f9e23640 1 -- 172.21.15.38:0/4131676272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4154b80 msgr2=0x7f62f41534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:43.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.364+0000 7f62f9e23640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4154b80 0x7f62f41534a0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f62ec001eb0 tx=0x7f62ec00c820 comp rx=0 tx=0).stop 2023-12-22T08:53:43.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.364+0000 7f62f9e23640 1 -- 172.21.15.38:0/4131676272 shutdown_connections 2023-12-22T08:53:43.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.364+0000 7f62f9e23640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f62d406a430 0x7f62d406c8f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.364+0000 7f62f9e23640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f4154b80 0x7f62f41534a0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.364+0000 7f62f9e23640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62f41547a0 0x7f62f414bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.364+0000 7f62f9e23640 1 --2- 172.21.15.38:0/4131676272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62f4071b90 0x7f62f414b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.364+0000 7f62f9e23640 1 -- 172.21.15.38:0/4131676272 >> 172.21.15.38:0/4131676272 conn(0x7f62f40cf070 msgr2=0x7f62f40cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:43.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.364+0000 7f62f9e23640 1 -- 172.21.15.38:0/4131676272 shutdown_connections 2023-12-22T08:53:43.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.364+0000 7f62f9e23640 1 -- 172.21.15.38:0/4131676272 wait complete. 2023-12-22T08:53:43.385 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-22T08:53:43.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:43.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-22T08:53:43.501 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:53:43.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:43.502 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T08:53:43.554 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:53:43.554 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:43.618 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:53:43.619 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:53:43.619 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:43.677 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:53:43.677 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:53:43.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.915+0000 7f6cafee7640 1 Processor -- start 2023-12-22T08:53:43.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.915+0000 7f6cafee7640 1 -- start start 2023-12-22T08:53:43.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.917+0000 7f6cafee7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ca80c5bf0 0x7f6ca80d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.917+0000 7f6cafee7640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca80d0f60 con 0x7f6ca8144c70 2023-12-22T08:53:43.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.917+0000 7f6cafee7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca8070a30 con 0x7f6ca80d0b10 2023-12-22T08:53:43.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.917+0000 7f6cafee7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8070750 con 0x7f6ca80c5bf0 2023-12-22T08:53:43.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.918+0000 7f6cadc83640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6ca8144c70 0x7f6ca806fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46788/0 (socket says 172.21.15.38:46788) 2023-12-22T08:53:43.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.918+0000 7f6cadc83640 1 -- 172.21.15.38:0/1388775344 learned_addr learned my addr 172.21.15.38:0/1388775344 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:43.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.918+0000 7f6cad482640 1 --2- 172.21.15.38:0/1388775344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ca80c5bf0 0x7f6ca80d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.918+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199770718 0 0) 0x7f6ca4001490 con 0x7f6ca8144c70 2023-12-22T08:53:43.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.918+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c94003520 con 0x7f6ca8144c70 2023-12-22T08:53:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 637029518 0 0) 0x7f6c94003520 con 0x7f6ca8144c70 2023-12-22T08:53:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ca80c5bf0 msgr2=0x7f6ca80d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cacc81640 1 --2- 172.21.15.38:0/1388775344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ca80c5bf0 0x7f6ca80d05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 >> v1:172.21.15.89:6789/0 conn(0x7f6ca80d0b10 legacy=0x7f6ca815c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca815bc20 con 0x7f6ca8144c70 2023-12-22T08:53:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f6ca4001b80 con 0x7f6ca8144c70 2023-12-22T08:53:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 >> v1:172.21.15.38:6789/0 conn(0x7f6ca8144c70 legacy=0x7f6ca806fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cacc81640 1 --2- 172.21.15.38:0/1388775344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ca80c5bf0 0x7f6c940039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cacc81640 1 --2- 172.21.15.38:0/1388775344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c94003f70 0x7f6c940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cacc81640 1 --2- 172.21.15.38:0/1388775344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c94004d00 0x7f6c94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8070750 con 0x7f6c94003f70 2023-12-22T08:53:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9400bb70 con 0x7f6c94004d00 2023-12-22T08:53:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9400bd30 con 0x7f6ca80c5bf0 2023-12-22T08:53:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.919+0000 7f6cad482640 1 --2- 172.21.15.38:0/1388775344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c94003f70 0x7f6c940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.920+0000 7f6cadc83640 1 --2- 172.21.15.38:0/1388775344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ca80c5bf0 0x7f6c940039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.920+0000 7f6cae484640 1 --2- 172.21.15.38:0/1388775344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c94004d00 0x7f6c94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.920+0000 7f6cad482640 1 -- 172.21.15.38:0/1388775344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ca80c5bf0 msgr2=0x7f6c940039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.920+0000 7f6cad482640 1 --2- 172.21.15.38:0/1388775344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ca80c5bf0 0x7f6c940039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.920+0000 7f6cad482640 1 -- 172.21.15.38:0/1388775344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c94004d00 msgr2=0x7f6c94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.920+0000 7f6cad482640 1 --2- 172.21.15.38:0/1388775344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c94004d00 0x7f6c94005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.920+0000 7f6cad482640 1 -- 172.21.15.38:0/1388775344 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c94003520 con 0x7f6c94003f70 2023-12-22T08:53:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.921+0000 7f6cad482640 1 --2- 172.21.15.38:0/1388775344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c94003f70 0x7f6c940047c0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009ac0 tx=0x7f6c940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c41f3eb6ae26336 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.922+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9802c6b0 con 0x7f6c94003f70 2023-12-22T08:53:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.922+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9802c810 con 0x7f6c94003f70 2023-12-22T08:53:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.922+0000 7f6cacc81640 1 -- 172.21.15.38:0/1388775344 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9802cba0 con 0x7f6c94003f70 2023-12-22T08:53:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.922+0000 7f6cafee7640 1 -- 172.21.15.38:0/1388775344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c94003f70 msgr2=0x7f6c940047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:43.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.922+0000 7f6cafee7640 1 --2- 172.21.15.38:0/1388775344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c94003f70 0x7f6c940047c0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009ac0 tx=0x7f6c940057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.922+0000 7f6cae484640 1 -- 172.21.15.38:0/1388775344 reap_dead start 2023-12-22T08:53:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.923+0000 7f6cafee7640 1 -- 172.21.15.38:0/1388775344 shutdown_connections 2023-12-22T08:53:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.923+0000 7f6cafee7640 1 -- 172.21.15.38:0/1388775344 >> 172.21.15.38:0/1388775344 conn(0x7f6ca8071840 msgr2=0x7f6ca8071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.923+0000 7f6cafee7640 1 -- 172.21.15.38:0/1388775344 shutdown_connections 2023-12-22T08:53:43.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.923+0000 7f6cafee7640 1 -- 172.21.15.38:0/1388775344 wait complete. 2023-12-22T08:53:43.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.925+0000 7f6cafee7640 1 Processor -- start 2023-12-22T08:53:43.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.925+0000 7f6cafee7640 1 -- start start 2023-12-22T08:53:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.926+0000 7f6cafee7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c94003f70 0x7f6ca806f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.926+0000 7f6cafee7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ca80ab290 0x7f6ca80ab710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.926+0000 7f6cafee7640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ca81438f0 0x7f6ca8143d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.926+0000 7f6cafee7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80a8ff0 con 0x7f6ca80ab290 2023-12-22T08:53:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.926+0000 7f6cafee7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80abc50 con 0x7f6c94003f70 2023-12-22T08:53:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.926+0000 7f6cafee7640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80a8650 con 0x7f6ca81438f0 2023-12-22T08:53:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.926+0000 7f6cad482640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ca80ab290 0x7f6ca80ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.926+0000 7f6cad482640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ca80ab290 0x7f6ca80ab710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60240/0 (socket says 172.21.15.38:60240) 2023-12-22T08:53:43.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.926+0000 7f6cad482640 1 -- 172.21.15.38:0/1462787694 learned_addr learned my addr 172.21.15.38:0/1462787694 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:43.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.927+0000 7f6cae484640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ca81438f0 0x7f6ca8143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.927+0000 7f6cadc83640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c94003f70 0x7f6ca806f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.927+0000 7f6cad482640 1 -- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ca81438f0 msgr2=0x7f6ca8143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.927+0000 7f6cad482640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ca81438f0 0x7f6ca8143d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.927+0000 7f6cad482640 1 -- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c94003f70 msgr2=0x7f6ca806f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.927+0000 7f6cad482640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c94003f70 0x7f6ca806f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.927+0000 7f6cad482640 1 -- 172.21.15.38:0/1462787694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80a8930 con 0x7f6ca80ab290 2023-12-22T08:53:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.927+0000 7f6cad482640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ca80ab290 0x7f6ca80ab710 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f6c9802c250 tx=0x7f6c98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.927+0000 7f6c9e7fc640 1 -- 172.21.15.38:0/1462787694 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98003810 con 0x7f6ca80ab290 2023-12-22T08:53:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.927+0000 7f6c9e7fc640 1 -- 172.21.15.38:0/1462787694 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98003970 con 0x7f6ca80ab290 2023-12-22T08:53:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.927+0000 7f6cafee7640 1 -- 172.21.15.38:0/1462787694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca80a8c10 con 0x7f6ca80ab290 2023-12-22T08:53:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.927+0000 7f6c9e7fc640 1 -- 172.21.15.38:0/1462787694 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98003ce0 con 0x7f6ca80ab290 2023-12-22T08:53:43.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.927+0000 7f6cafee7640 1 -- 172.21.15.38:0/1462787694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca806fc10 con 0x7f6ca80ab290 2023-12-22T08:53:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.929+0000 7f6cafee7640 1 -- 172.21.15.38:0/1462787694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca8061910 con 0x7f6ca80ab290 2023-12-22T08:53:43.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.930+0000 7f6c9e7fc640 1 -- 172.21.15.38:0/1462787694 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6c98047450 con 0x7f6ca80ab290 2023-12-22T08:53:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.931+0000 7f6c9e7fc640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6c8c06a430 0x7f6c8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.931+0000 7f6c9e7fc640 1 -- 172.21.15.38:0/1462787694 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c980aac90 con 0x7f6ca80ab290 2023-12-22T08:53:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.932+0000 7f6c9e7fc640 1 -- 172.21.15.38:0/1462787694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f6c8c071f60 con 0x7f6ca80ab290 2023-12-22T08:53:43.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.932+0000 7f6cadc83640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6c8c06a430 0x7f6c8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:43.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.933+0000 7f6cadc83640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6c8c06a430 0x7f6c8c06c8f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4001630 tx=0x7f6ca40021b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:43.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:43.936+0000 7f6c9e7fc640 1 -- 172.21.15.38:0/1462787694 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6c980763b0 con 0x7f6ca80ab290 2023-12-22T08:53:44.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.169+0000 7f6cafee7640 1 -- 172.21.15.38:0/1462787694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ca80a8790 con 0x7f6ca80ab290 2023-12-22T08:53:44.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.170+0000 7f6c9e7fc640 1 -- 172.21.15.38:0/1462787694 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4649 (secure 0 0 0) 0x7f6ca80a8790 con 0x7f6ca80ab290 2023-12-22T08:53:44.171 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:44.171 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2952705616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2952705616},{"type":"v1","addr":"172.21.15.89:6835","nonce":2952705616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/3842752964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":3842752964},{"type":"v1","addr":"172.21.15.89:6837","nonce":3842752964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/261655608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":261655608},{"type":"v1","addr":"172.21.15.38:6834","nonce":261655608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:53:04.462294+0000","modified":"2023-12-22T08:53:07.483358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8940":{"gid":8940,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3350465616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3350465616},{"type":"v1","addr":"172.21.15.38:6835","nonce":3350465616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-22T08:53:44.171 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 86 2023-12-22T08:53:44.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.172+0000 7f6cafee7640 1 -- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6c8c06a430 msgr2=0x7f6c8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:44.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.172+0000 7f6cafee7640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6c8c06a430 0x7f6c8c06c8f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4001630 tx=0x7f6ca40021b0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.173+0000 7f6cafee7640 1 -- 172.21.15.38:0/1462787694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ca80ab290 msgr2=0x7f6ca80ab710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:44.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.173+0000 7f6cafee7640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ca80ab290 0x7f6ca80ab710 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f6c9802c250 tx=0x7f6c98004730 comp rx=0 tx=0).stop 2023-12-22T08:53:44.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.173+0000 7f6cafee7640 1 -- 172.21.15.38:0/1462787694 shutdown_connections 2023-12-22T08:53:44.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.173+0000 7f6cafee7640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ca81438f0 0x7f6ca8143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.173+0000 7f6cafee7640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6c8c06a430 0x7f6c8c06c8f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.173+0000 7f6cafee7640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ca80ab290 0x7f6ca80ab710 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.173+0000 7f6cafee7640 1 --2- 172.21.15.38:0/1462787694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c94003f70 0x7f6ca806f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.173+0000 7f6cafee7640 1 -- 172.21.15.38:0/1462787694 >> 172.21.15.38:0/1462787694 conn(0x7f6ca8071840 msgr2=0x7f6ca8142bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:44.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.173+0000 7f6cafee7640 1 -- 172.21.15.38:0/1462787694 shutdown_connections 2023-12-22T08:53:44.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.173+0000 7f6cafee7640 1 -- 172.21.15.38:0/1462787694 wait complete. 2023-12-22T08:53:44.193 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:53:44.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.417+0000 7f2429e73640 1 Processor -- start 2023-12-22T08:53:44.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.417+0000 7f2429e73640 1 -- start start 2023-12-22T08:53:44.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.419+0000 7f2429e73640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f242415b420 0x7f242406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:44.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.419+0000 7f2429e73640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f24240a44a0 0x7f24240708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:44.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.419+0000 7f2429e73640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24240cdae0 con 0x7f2424070e30 2023-12-22T08:53:44.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.419+0000 7f2429e73640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242406dec0 con 0x7f242415b420 2023-12-22T08:53:44.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.419+0000 7f2429e73640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2424071250 con 0x7f24240a44a0 2023-12-22T08:53:44.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.419+0000 7f2428e71640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f242415b420 0x7f242406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:44.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.420+0000 7f2428e71640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f242415b420 0x7f242406d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60256/0 (socket says 172.21.15.38:60256) 2023-12-22T08:53:44.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.420+0000 7f2428e71640 1 -- 172.21.15.38:0/3861112949 learned_addr learned my addr 172.21.15.38:0/3861112949 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:44.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.420+0000 7f241bfff640 1 --2- 172.21.15.38:0/3861112949 >> v2:172.21.15.89:3300/0 conn(0x7f24240a44a0 0x7f24240708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:44.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.420+0000 7f2428e71640 1 -- 172.21.15.38:0/3861112949 >> v2:172.21.15.89:3300/0 conn(0x7f24240a44a0 msgr2=0x7f24240708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:44.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.420+0000 7f2428e71640 1 --2- 172.21.15.38:0/3861112949 >> v2:172.21.15.89:3300/0 conn(0x7f24240a44a0 0x7f24240708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.420+0000 7f2428e71640 1 -- 172.21.15.38:0/3861112949 >> v1:172.21.15.89:6789/0 conn(0x7f2424070e30 legacy=0x7f242406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:44.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.420+0000 7f2428e71640 1 -- 172.21.15.38:0/3861112949 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242415b800 con 0x7f242415b420 2023-12-22T08:53:44.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.420+0000 7f241bfff640 1 --2- 172.21.15.38:0/3861112949 >> v2:172.21.15.89:3300/0 conn(0x7f24240a44a0 0x7f24240708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:53:44.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.421+0000 7f2428e71640 1 --2- 172.21.15.38:0/3861112949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f242415b420 0x7f242406d980 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f242406bb90 tx=0x7f242002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719e97d5ff8c22a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:44.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.422+0000 7f241b7fe640 1 -- 172.21.15.38:0/3861112949 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242002cb20 con 0x7f242415b420 2023-12-22T08:53:44.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.422+0000 7f241b7fe640 1 -- 172.21.15.38:0/3861112949 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242002cc80 con 0x7f242415b420 2023-12-22T08:53:44.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.422+0000 7f241b7fe640 1 -- 172.21.15.38:0/3861112949 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24200343f0 con 0x7f242415b420 2023-12-22T08:53:44.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.422+0000 7f2429e73640 1 -- 172.21.15.38:0/3861112949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f242415b420 msgr2=0x7f242406d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:44.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.422+0000 7f2429e73640 1 --2- 172.21.15.38:0/3861112949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f242415b420 0x7f242406d980 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f242406bb90 tx=0x7f242002bf80 comp rx=0 tx=0).stop 2023-12-22T08:53:44.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.423+0000 7f2429e73640 1 -- 172.21.15.38:0/3861112949 shutdown_connections 2023-12-22T08:53:44.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.423+0000 7f2429e73640 1 --2- 172.21.15.38:0/3861112949 >> v2:172.21.15.89:3300/0 conn(0x7f24240a44a0 0x7f24240708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.423+0000 7f2429e73640 1 --2- 172.21.15.38:0/3861112949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f242415b420 0x7f242406d980 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.423+0000 7f2429e73640 1 -- 172.21.15.38:0/3861112949 >> 172.21.15.38:0/3861112949 conn(0x7f24240b1f70 msgr2=0x7f24240b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:44.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.423+0000 7f2429e73640 1 -- 172.21.15.38:0/3861112949 shutdown_connections 2023-12-22T08:53:44.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.423+0000 7f2429e73640 1 -- 172.21.15.38:0/3861112949 wait complete. 2023-12-22T08:53:44.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.424+0000 7f2429e73640 1 Processor -- start 2023-12-22T08:53:44.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.425+0000 7f2429e73640 1 -- start start 2023-12-22T08:53:44.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f2429e73640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2424070e30 0x7f24241f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:44.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f2429e73640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24240a44a0 0x7f24240cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f2429e73640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f242415b420 0x7f24240cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f2429e73640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24241f2e60 con 0x7f24240a44a0 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f2429e73640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24241f3120 con 0x7f242415b420 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f2429e73640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24241f3400 con 0x7f2424070e30 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f241bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24240a44a0 0x7f24240cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f241bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24240a44a0 0x7f24240cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60258/0 (socket says 172.21.15.38:60258) 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f241bfff640 1 -- 172.21.15.38:0/3851073904 learned_addr learned my addr 172.21.15.38:0/3851073904 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f241bfff640 1 -- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2424070e30 msgr2=0x7f24241f6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f2429672640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f242415b420 0x7f24240cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f2428e71640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2424070e30 0x7f24241f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f241bfff640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2424070e30 0x7f24241f6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f241bfff640 1 -- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f242415b420 msgr2=0x7f24240cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f241bfff640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f242415b420 0x7f24240cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f241bfff640 1 -- 172.21.15.38:0/3851073904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420009b30 con 0x7f24240a44a0 2023-12-22T08:53:44.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.426+0000 7f2429672640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f242415b420 0x7f24240cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:44.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.427+0000 7f241bfff640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24240a44a0 0x7f24240cc920 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f241400e810 tx=0x7f241400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:44.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.427+0000 7f24197fa640 1 -- 172.21.15.38:0/3851073904 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241400c6d0 con 0x7f24240a44a0 2023-12-22T08:53:44.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.427+0000 7f24197fa640 1 -- 172.21.15.38:0/3851073904 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241400c830 con 0x7f24240a44a0 2023-12-22T08:53:44.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.427+0000 7f2429e73640 1 -- 172.21.15.38:0/3851073904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24241f36e0 con 0x7f24240a44a0 2023-12-22T08:53:44.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.427+0000 7f24197fa640 1 -- 172.21.15.38:0/3851073904 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241400cbe0 con 0x7f24240a44a0 2023-12-22T08:53:44.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.427+0000 7f2429e73640 1 -- 172.21.15.38:0/3851073904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24241f71d0 con 0x7f24240a44a0 2023-12-22T08:53:44.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.428+0000 7f2429e73640 1 -- 172.21.15.38:0/3851073904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24241f73f0 con 0x7f24240a44a0 2023-12-22T08:53:44.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.429+0000 7f24197fa640 1 -- 172.21.15.38:0/3851073904 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f241400cd40 con 0x7f24240a44a0 2023-12-22T08:53:44.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.430+0000 7f24197fa640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f241006a430 0x7f241006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:44.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.430+0000 7f24197fa640 1 -- 172.21.15.38:0/3851073904 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2414088750 con 0x7f24240a44a0 2023-12-22T08:53:44.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.431+0000 7f24197fa640 1 -- 172.21.15.38:0/3851073904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f2410071f60 con 0x7f24240a44a0 2023-12-22T08:53:44.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.431+0000 7f2428e71640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f241006a430 0x7f241006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:44.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.432+0000 7f2428e71640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f241006a430 0x7f241006c8f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2420035000 tx=0x7f2420030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:44.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.434+0000 7f24197fa640 1 -- 172.21.15.38:0/3851073904 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2414053ca0 con 0x7f24240a44a0 2023-12-22T08:53:44.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.635+0000 7f2429e73640 1 -- 172.21.15.38:0/3851073904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2424061910 con 0x7f24240a44a0 2023-12-22T08:53:44.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.636+0000 7f24197fa640 1 -- 172.21.15.38:0/3851073904 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+16090 (secure 0 0 0) 0x7f2414021090 con 0x7f24240a44a0 2023-12-22T08:53:44.637 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:44.637 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":194,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:53:41.417147+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:53:02.354802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-22T08:53:03.461583+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:53:44.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.639+0000 7f2429e73640 1 -- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f241006a430 msgr2=0x7f241006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:44.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.639+0000 7f2429e73640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f241006a430 0x7f241006c8f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2420035000 tx=0x7f2420030000 comp rx=0 tx=0).stop 2023-12-22T08:53:44.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.639+0000 7f2429e73640 1 -- 172.21.15.38:0/3851073904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24240a44a0 msgr2=0x7f24240cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:44.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.639+0000 7f2429e73640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24240a44a0 0x7f24240cc920 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f241400e810 tx=0x7f241400ecd0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.639+0000 7f2429e73640 1 -- 172.21.15.38:0/3851073904 shutdown_connections 2023-12-22T08:53:44.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.639+0000 7f2429e73640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f242415b420 0x7f24240cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.639+0000 7f2429e73640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f241006a430 0x7f241006c8f0 secure :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2420035000 tx=0x7f2420030000 comp rx=0 tx=0).stop 2023-12-22T08:53:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.639+0000 7f2429e73640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f24240a44a0 0x7f24240cc920 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.639+0000 7f2429e73640 1 --2- 172.21.15.38:0/3851073904 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2424070e30 0x7f24241f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.639+0000 7f2429e73640 1 -- 172.21.15.38:0/3851073904 >> 172.21.15.38:0/3851073904 conn(0x7f24240b1f70 msgr2=0x7f242415d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.640+0000 7f2429e73640 1 -- 172.21.15.38:0/3851073904 shutdown_connections 2023-12-22T08:53:44.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.640+0000 7f2429e73640 1 -- 172.21.15.38:0/3851073904 wait complete. 2023-12-22T08:53:44.658 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:39:48.429113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:53:02.354802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '189', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:53:03.461583+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '194', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:53:44.659 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:53:44.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.877+0000 7f2aeefea640 1 Processor -- start 2023-12-22T08:53:44.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.877+0000 7f2aeefea640 1 -- start start 2023-12-22T08:53:44.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.878+0000 7f2aeefea640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2ae80cea50 0x7f2ae80ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:44.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.879+0000 7f2aeefea640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ae806d590 0x7f2ae806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:44.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.879+0000 7f2aeefea640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae8140f70 con 0x7f2ae8143600 2023-12-22T08:53:44.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.879+0000 7f2aeefea640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae80cf410 con 0x7f2ae80cea50 2023-12-22T08:53:44.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.879+0000 7f2aeefea640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae806c300 con 0x7f2ae806d590 2023-12-22T08:53:44.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.879+0000 7f2aed587640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ae806d590 0x7f2ae806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:44.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.880+0000 7f2aed587640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ae806d590 0x7f2ae806d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:49726/0 (socket says 172.21.15.38:49726) 2023-12-22T08:53:44.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.880+0000 7f2aed587640 1 -- 172.21.15.38:0/1601741139 learned_addr learned my addr 172.21.15.38:0/1601741139 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:44.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.880+0000 7f2ae7fff640 1 --2- 172.21.15.38:0/1601741139 >> v2:172.21.15.89:3300/0 conn(0x7f2ae80cea50 0x7f2ae80ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:44.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.880+0000 7f2ae7fff640 1 -- 172.21.15.38:0/1601741139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ae806d590 msgr2=0x7f2ae806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:44.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.880+0000 7f2ae7fff640 1 --2- 172.21.15.38:0/1601741139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ae806d590 0x7f2ae806d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.880+0000 7f2ae7fff640 1 -- 172.21.15.38:0/1601741139 >> v1:172.21.15.89:6789/0 conn(0x7f2ae8143600 legacy=0x7f2ae815e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:44.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.880+0000 7f2ae7fff640 1 -- 172.21.15.38:0/1601741139 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae806c5e0 con 0x7f2ae80cea50 2023-12-22T08:53:44.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.880+0000 7f2aed587640 1 --2- 172.21.15.38:0/1601741139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ae806d590 0x7f2ae806d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:53:44.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.882+0000 7f2ae7fff640 1 --2- 172.21.15.38:0/1601741139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ae80cea50 0x7f2ae80ceed0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009d90 tx=0x7f2ad802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5554d857153c6c46 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:44.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.882+0000 7f2ae77fe640 1 -- 172.21.15.38:0/1601741139 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad802cc50 con 0x7f2ae80cea50 2023-12-22T08:53:44.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.882+0000 7f2ae77fe640 1 -- 172.21.15.38:0/1601741139 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad802cdb0 con 0x7f2ae80cea50 2023-12-22T08:53:44.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.882+0000 7f2ae77fe640 1 -- 172.21.15.38:0/1601741139 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8034660 con 0x7f2ae80cea50 2023-12-22T08:53:44.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.883+0000 7f2aeefea640 1 -- 172.21.15.38:0/1601741139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ae80cea50 msgr2=0x7f2ae80ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:44.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.883+0000 7f2aeefea640 1 --2- 172.21.15.38:0/1601741139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ae80cea50 0x7f2ae80ceed0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009d90 tx=0x7f2ad802bea0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.883+0000 7f2aeefea640 1 -- 172.21.15.38:0/1601741139 shutdown_connections 2023-12-22T08:53:44.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.883+0000 7f2aeefea640 1 --2- 172.21.15.38:0/1601741139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ae80cea50 0x7f2ae80ceed0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.883+0000 7f2aeefea640 1 --2- 172.21.15.38:0/1601741139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ae806d590 0x7f2ae806d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.883+0000 7f2aeefea640 1 -- 172.21.15.38:0/1601741139 >> 172.21.15.38:0/1601741139 conn(0x7f2ae80cfe70 msgr2=0x7f2ae80d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:44.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.883+0000 7f2aeefea640 1 -- 172.21.15.38:0/1601741139 shutdown_connections 2023-12-22T08:53:44.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.883+0000 7f2aeefea640 1 -- 172.21.15.38:0/1601741139 wait complete. 2023-12-22T08:53:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.885+0000 7f2aeefea640 1 Processor -- start 2023-12-22T08:53:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.886+0000 7f2aeefea640 1 -- start start 2023-12-22T08:53:44.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.887+0000 7f2aeefea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ae806d590 0x7f2ae813deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:44.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.887+0000 7f2aeefea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ae80cea50 0x7f2ae81605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:44.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.887+0000 7f2aeefea640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ae8143600 0x7f2ae809f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:44.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.887+0000 7f2aeefea640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae815e3c0 con 0x7f2ae806d590 2023-12-22T08:53:44.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.887+0000 7f2aeefea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae813e3f0 con 0x7f2ae80cea50 2023-12-22T08:53:44.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.887+0000 7f2aeefea640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae809ede0 con 0x7f2ae8143600 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.887+0000 7f2aecd86640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ae806d590 0x7f2ae813deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.887+0000 7f2aecd86640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ae806d590 0x7f2ae813deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60272/0 (socket says 172.21.15.38:60272) 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.887+0000 7f2aecd86640 1 -- 172.21.15.38:0/156883711 learned_addr learned my addr 172.21.15.38:0/156883711 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.888+0000 7f2aed587640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ae8143600 0x7f2ae809f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.888+0000 7f2ae7fff640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ae80cea50 0x7f2ae81605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.888+0000 7f2aecd86640 1 -- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ae8143600 msgr2=0x7f2ae809f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.888+0000 7f2aecd86640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ae8143600 0x7f2ae809f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.888+0000 7f2aecd86640 1 -- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ae80cea50 msgr2=0x7f2ae81605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.888+0000 7f2aecd86640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ae80cea50 0x7f2ae81605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.888+0000 7f2aecd86640 1 -- 172.21.15.38:0/156883711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae00094d0 con 0x7f2ae806d590 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.888+0000 7f2ae7fff640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ae80cea50 0x7f2ae81605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.888+0000 7f2aecd86640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ae806d590 0x7f2ae813deb0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c450 tx=0x7f2ad000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.889+0000 7f2ae57fa640 1 -- 172.21.15.38:0/156883711 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00052d0 con 0x7f2ae806d590 2023-12-22T08:53:44.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.889+0000 7f2ae57fa640 1 -- 172.21.15.38:0/156883711 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad0005430 con 0x7f2ae806d590 2023-12-22T08:53:44.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.889+0000 7f2ae57fa640 1 -- 172.21.15.38:0/156883711 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0012870 con 0x7f2ae806d590 2023-12-22T08:53:44.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.889+0000 7f2aeefea640 1 -- 172.21.15.38:0/156883711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad8009a70 con 0x7f2ae806d590 2023-12-22T08:53:44.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.889+0000 7f2aeefea640 1 -- 172.21.15.38:0/156883711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae815dd00 con 0x7f2ae806d590 2023-12-22T08:53:44.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.890+0000 7f2aeefea640 1 -- 172.21.15.38:0/156883711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae815e500 con 0x7f2ae806d590 2023-12-22T08:53:44.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.891+0000 7f2ae57fa640 1 -- 172.21.15.38:0/156883711 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2ad00129d0 con 0x7f2ae806d590 2023-12-22T08:53:44.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.892+0000 7f2ae57fa640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ac806a430 0x7f2ac806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:44.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.892+0000 7f2ae57fa640 1 -- 172.21.15.38:0/156883711 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ad00883f0 con 0x7f2ae806d590 2023-12-22T08:53:44.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.892+0000 7f2ae57fa640 1 -- 172.21.15.38:0/156883711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f2ac8071f60 con 0x7f2ae806d590 2023-12-22T08:53:44.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.893+0000 7f2ae7fff640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ac806a430 0x7f2ac806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:44.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.894+0000 7f2ae7fff640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ac806a430 0x7f2ac806c8f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8036000 tx=0x7f2ad8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:44.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:44.896+0000 7f2ae57fa640 1 -- 172.21.15.38:0/156883711 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2ae815e500 con 0x7f2ae806d590 2023-12-22T08:53:45.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.095+0000 7f2aeefea640 1 -- 172.21.15.38:0/156883711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ae815e500 con 0x7f2ae806d590 2023-12-22T08:53:45.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.096+0000 7f2ae57fa640 1 -- 172.21.15.38:0/156883711 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v194) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ae815e500 con 0x7f2ae806d590 2023-12-22T08:53:45.096 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-12-22T08:53:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.098+0000 7f2aeefea640 1 -- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ac806a430 msgr2=0x7f2ac806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.098+0000 7f2aeefea640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ac806a430 0x7f2ac806c8f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8036000 tx=0x7f2ad8030000 comp rx=0 tx=0).stop 2023-12-22T08:53:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.098+0000 7f2aeefea640 1 -- 172.21.15.38:0/156883711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ae806d590 msgr2=0x7f2ae813deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.098+0000 7f2aeefea640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ae806d590 0x7f2ae813deb0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c450 tx=0x7f2ad000c910 comp rx=0 tx=0).stop 2023-12-22T08:53:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.098+0000 7f2aeefea640 1 -- 172.21.15.38:0/156883711 shutdown_connections 2023-12-22T08:53:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.098+0000 7f2aeefea640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ae8143600 0x7f2ae809f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.098+0000 7f2aeefea640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ae80cea50 0x7f2ae81605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.098+0000 7f2aeefea640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f2ac806a430 0x7f2ac806c8f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.098+0000 7f2aeefea640 1 --2- 172.21.15.38:0/156883711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ae806d590 0x7f2ae813deb0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.098+0000 7f2aeefea640 1 -- 172.21.15.38:0/156883711 >> 172.21.15.38:0/156883711 conn(0x7f2ae80cfe70 msgr2=0x7f2ae80b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.099+0000 7f2aeefea640 1 -- 172.21.15.38:0/156883711 shutdown_connections 2023-12-22T08:53:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.099+0000 7f2aeefea640 1 -- 172.21.15.38:0/156883711 wait complete. 2023-12-22T08:53:45.120 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:53:45.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.348+0000 7ff47b59e640 1 Processor -- start 2023-12-22T08:53:45.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.349+0000 7ff47b59e640 1 -- start start 2023-12-22T08:53:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.350+0000 7ff47b59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff47c15ad90 0x7ff47c0caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.350+0000 7ff47b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff47c15e050 0x7ff47c0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.350+0000 7ff47b59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c15e630 con 0x7ff47c161bb0 2023-12-22T08:53:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.350+0000 7ff47b59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47c0ce2c0 con 0x7ff47c15ad90 2023-12-22T08:53:45.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.350+0000 7ff47b59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c15e910 con 0x7ff47c15e050 2023-12-22T08:53:45.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.351+0000 7ff47a59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff47c15ad90 0x7ff47c0caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:45.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.351+0000 7ff47a59c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff47c15ad90 0x7ff47c0caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60280/0 (socket says 172.21.15.38:60280) 2023-12-22T08:53:45.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.351+0000 7ff47a59c640 1 -- 172.21.15.38:0/898407553 learned_addr learned my addr 172.21.15.38:0/898407553 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:45.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.351+0000 7ff47ad9d640 1 --2- 172.21.15.38:0/898407553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff47c15e050 0x7ff47c0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:45.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.351+0000 7ff47a59c640 1 -- 172.21.15.38:0/898407553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff47c15e050 msgr2=0x7ff47c0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:45.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.351+0000 7ff47a59c640 1 --2- 172.21.15.38:0/898407553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff47c15e050 0x7ff47c0cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.351+0000 7ff47a59c640 1 -- 172.21.15.38:0/898407553 >> v1:172.21.15.38:6789/0 conn(0x7ff47c161bb0 legacy=0x7ff47c15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:45.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.351+0000 7ff47a59c640 1 -- 172.21.15.38:0/898407553 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c1610d0 con 0x7ff47c15ad90 2023-12-22T08:53:45.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.351+0000 7ff47ad9d640 1 --2- 172.21.15.38:0/898407553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff47c15e050 0x7ff47c0cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:45.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.352+0000 7ff47a59c640 1 --2- 172.21.15.38:0/898407553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff47c15ad90 0x7ff47c0caed0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7ff46c009e80 tx=0x7ff46c02bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea35091cd725e0f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:45.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.353+0000 7ff47959a640 1 -- 172.21.15.38:0/898407553 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c02cae0 con 0x7ff47c15ad90 2023-12-22T08:53:45.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.353+0000 7ff47959a640 1 -- 172.21.15.38:0/898407553 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c02cc40 con 0x7ff47c15ad90 2023-12-22T08:53:45.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.353+0000 7ff47959a640 1 -- 172.21.15.38:0/898407553 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c0343f0 con 0x7ff47c15ad90 2023-12-22T08:53:45.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.353+0000 7ff47b59e640 1 -- 172.21.15.38:0/898407553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff47c15ad90 msgr2=0x7ff47c0caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:45.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.353+0000 7ff47b59e640 1 --2- 172.21.15.38:0/898407553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff47c15ad90 0x7ff47c0caed0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7ff46c009e80 tx=0x7ff46c02bf40 comp rx=0 tx=0).stop 2023-12-22T08:53:45.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.353+0000 7ff47b59e640 1 -- 172.21.15.38:0/898407553 shutdown_connections 2023-12-22T08:53:45.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.353+0000 7ff47b59e640 1 --2- 172.21.15.38:0/898407553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff47c15e050 0x7ff47c0cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.353+0000 7ff47b59e640 1 --2- 172.21.15.38:0/898407553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff47c15ad90 0x7ff47c0caed0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.353+0000 7ff47b59e640 1 -- 172.21.15.38:0/898407553 >> 172.21.15.38:0/898407553 conn(0x7ff47c0d31c0 msgr2=0x7ff47c0d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:45.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.353+0000 7ff47b59e640 1 -- 172.21.15.38:0/898407553 shutdown_connections 2023-12-22T08:53:45.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.353+0000 7ff47b59e640 1 -- 172.21.15.38:0/898407553 wait complete. 2023-12-22T08:53:45.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.355+0000 7ff47b59e640 1 Processor -- start 2023-12-22T08:53:45.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.355+0000 7ff47b59e640 1 -- start start 2023-12-22T08:53:45.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.356+0000 7ff47b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff47c15ad90 0x7ff47c14e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:45.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.356+0000 7ff47b59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff47c15e050 0x7ff47c1574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:45.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.356+0000 7ff47b59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff47c161bb0 0x7ff47c157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:45.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.356+0000 7ff47b59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c1538a0 con 0x7ff47c15e050 2023-12-22T08:53:45.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.356+0000 7ff47b59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0c9db0 con 0x7ff47c161bb0 2023-12-22T08:53:45.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.356+0000 7ff47b59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c1551e0 con 0x7ff47c15ad90 2023-12-22T08:53:45.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.356+0000 7ff479d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff47c15e050 0x7ff47c1574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:45.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.357+0000 7ff479d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff47c15e050 0x7ff47c1574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60290/0 (socket says 172.21.15.38:60290) 2023-12-22T08:53:45.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.357+0000 7ff479d9b640 1 -- 172.21.15.38:0/601725834 learned_addr learned my addr 172.21.15.38:0/601725834 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:45.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.357+0000 7ff47a59c640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff47c15ad90 0x7ff47c14e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:45.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.357+0000 7ff47ad9d640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff47c161bb0 0x7ff47c157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:45.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.357+0000 7ff479d9b640 1 -- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff47c15ad90 msgr2=0x7ff47c14e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:45.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.357+0000 7ff479d9b640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff47c15ad90 0x7ff47c14e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.357+0000 7ff479d9b640 1 -- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff47c161bb0 msgr2=0x7ff47c157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:45.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.357+0000 7ff479d9b640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff47c161bb0 0x7ff47c157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.357+0000 7ff479d9b640 1 -- 172.21.15.38:0/601725834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c009b30 con 0x7ff47c15e050 2023-12-22T08:53:45.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.357+0000 7ff47ad9d640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff47c161bb0 0x7ff47c157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:45.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.357+0000 7ff479d9b640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff47c15e050 0x7ff47c1574d0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7ff46400c400 tx=0x7ff46400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:45.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.358+0000 7ff472ffd640 1 -- 172.21.15.38:0/601725834 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4640052d0 con 0x7ff47c15e050 2023-12-22T08:53:45.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.358+0000 7ff472ffd640 1 -- 172.21.15.38:0/601725834 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff464005430 con 0x7ff47c15e050 2023-12-22T08:53:45.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.358+0000 7ff472ffd640 1 -- 172.21.15.38:0/601725834 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464003830 con 0x7ff47c15e050 2023-12-22T08:53:45.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.358+0000 7ff47b59e640 1 -- 172.21.15.38:0/601725834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c152f00 con 0x7ff47c15e050 2023-12-22T08:53:45.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.358+0000 7ff47b59e640 1 -- 172.21.15.38:0/601725834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c1534c0 con 0x7ff47c15e050 2023-12-22T08:53:45.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.359+0000 7ff47b59e640 1 -- 172.21.15.38:0/601725834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c061910 con 0x7ff47c15e050 2023-12-22T08:53:45.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.360+0000 7ff472ffd640 1 -- 172.21.15.38:0/601725834 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff464003990 con 0x7ff47c15e050 2023-12-22T08:53:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.361+0000 7ff472ffd640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff45c06a430 0x7ff45c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.361+0000 7ff472ffd640 1 -- 172.21.15.38:0/601725834 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff464087f60 con 0x7ff47c15e050 2023-12-22T08:53:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.361+0000 7ff472ffd640 1 -- 172.21.15.38:0/601725834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7ff45c071f60 con 0x7ff47c15e050 2023-12-22T08:53:45.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.362+0000 7ff47a59c640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff45c06a430 0x7ff45c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:45.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.363+0000 7ff47a59c640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff45c06a430 0x7ff45c06c8f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff46c035000 tx=0x7ff46c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:45.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.366+0000 7ff472ffd640 1 -- 172.21.15.38:0/601725834 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff4640534b0 con 0x7ff47c15e050 2023-12-22T08:53:45.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.558+0000 7ff47b59e640 1 -- 172.21.15.38:0/601725834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff47c0cb9b0 con 0x7ff47c15e050 2023-12-22T08:53:45.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.559+0000 7ff472ffd640 1 -- 172.21.15.38:0/601725834 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v194) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff464017030 con 0x7ff47c15e050 2023-12-22T08:53:45.560 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-12-22T08:53:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.562+0000 7ff47b59e640 1 -- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff45c06a430 msgr2=0x7ff45c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.562+0000 7ff47b59e640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff45c06a430 0x7ff45c06c8f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff46c035000 tx=0x7ff46c030000 comp rx=0 tx=0).stop 2023-12-22T08:53:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.562+0000 7ff47b59e640 1 -- 172.21.15.38:0/601725834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff47c15e050 msgr2=0x7ff47c1574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.562+0000 7ff47b59e640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff47c15e050 0x7ff47c1574d0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7ff46400c400 tx=0x7ff46400c8c0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.562+0000 7ff47b59e640 1 -- 172.21.15.38:0/601725834 shutdown_connections 2023-12-22T08:53:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.562+0000 7ff47b59e640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff47c161bb0 0x7ff47c157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.562+0000 7ff47b59e640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff45c06a430 0x7ff45c06c8f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.562+0000 7ff47b59e640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff47c15e050 0x7ff47c1574d0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.562+0000 7ff47b59e640 1 --2- 172.21.15.38:0/601725834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff47c15ad90 0x7ff47c14e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.562+0000 7ff47b59e640 1 -- 172.21.15.38:0/601725834 >> 172.21.15.38:0/601725834 conn(0x7ff47c0d31c0 msgr2=0x7ff47c0cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.562+0000 7ff47b59e640 1 -- 172.21.15.38:0/601725834 shutdown_connections 2023-12-22T08:53:45.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.562+0000 7ff47b59e640 1 -- 172.21.15.38:0/601725834 wait complete. 2023-12-22T08:53:45.580 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:53:45.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.809+0000 7f667743f640 1 Processor -- start 2023-12-22T08:53:45.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.809+0000 7f667743f640 1 -- start start 2023-12-22T08:53:45.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.811+0000 7f667743f640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6670070b70 0x7f667006bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:45.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.811+0000 7f667743f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f667006c4d0 0x7f6670070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:45.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.811+0000 7f667743f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667006d5f0 con 0x7f6670071490 2023-12-22T08:53:45.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.811+0000 7f667743f640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6670144fa0 con 0x7f6670070b70 2023-12-22T08:53:45.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.811+0000 7f667743f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667006da80 con 0x7f667006c4d0 2023-12-22T08:53:45.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.812+0000 7f667643d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6670070b70 0x7f667006bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:45.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.812+0000 7f6676c3e640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6670071490 0x7f66700cc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46792/0 (socket says 172.21.15.38:46792) 2023-12-22T08:53:45.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.812+0000 7f6676c3e640 1 -- 172.21.15.38:0/4249234572 learned_addr learned my addr 172.21.15.38:0/4249234572 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:45.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.812+0000 7f6675c3c640 1 --2- 172.21.15.38:0/4249234572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f667006c4d0 0x7f6670070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:45.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.812+0000 7f667643d640 1 -- 172.21.15.38:0/4249234572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f667006c4d0 msgr2=0x7f6670070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:45.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.812+0000 7f667643d640 1 --2- 172.21.15.38:0/4249234572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f667006c4d0 0x7f6670070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.812+0000 7f667643d640 1 -- 172.21.15.38:0/4249234572 >> v1:172.21.15.38:6789/0 conn(0x7f6670071490 legacy=0x7f66700cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:45.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.812+0000 7f667643d640 1 -- 172.21.15.38:0/4249234572 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667006c9e0 con 0x7f6670070b70 2023-12-22T08:53:45.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.813+0000 7f667643d640 1 --2- 172.21.15.38:0/4249234572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6670070b70 0x7f667006bf90 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f666c0097a0 tx=0x7f666c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5a5a605a60f1dc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:45.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.814+0000 7f667543b640 1 -- 172.21.15.38:0/4249234572 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c02d040 con 0x7f6670070b70 2023-12-22T08:53:45.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.814+0000 7f667543b640 1 -- 172.21.15.38:0/4249234572 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c031810 con 0x7f6670070b70 2023-12-22T08:53:45.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.814+0000 7f667543b640 1 -- 172.21.15.38:0/4249234572 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c031ba0 con 0x7f6670070b70 2023-12-22T08:53:45.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.814+0000 7f667743f640 1 -- 172.21.15.38:0/4249234572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6670070b70 msgr2=0x7f667006bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:45.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.814+0000 7f667743f640 1 --2- 172.21.15.38:0/4249234572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6670070b70 0x7f667006bf90 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f666c0097a0 tx=0x7f666c02b8b0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.814+0000 7f667743f640 1 -- 172.21.15.38:0/4249234572 shutdown_connections 2023-12-22T08:53:45.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.814+0000 7f667743f640 1 --2- 172.21.15.38:0/4249234572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f667006c4d0 0x7f6670070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.815+0000 7f667743f640 1 --2- 172.21.15.38:0/4249234572 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6670070b70 0x7f667006bf90 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.815+0000 7f667743f640 1 -- 172.21.15.38:0/4249234572 >> 172.21.15.38:0/4249234572 conn(0x7f66700b0b60 msgr2=0x7f66700b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:45.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.815+0000 7f667743f640 1 -- 172.21.15.38:0/4249234572 shutdown_connections 2023-12-22T08:53:45.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.815+0000 7f667743f640 1 -- 172.21.15.38:0/4249234572 wait complete. 2023-12-22T08:53:45.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.817+0000 7f667743f640 1 Processor -- start 2023-12-22T08:53:45.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.817+0000 7f667743f640 1 -- start start 2023-12-22T08:53:45.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.818+0000 7f667743f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f667006c4d0 0x7f66700c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:45.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.818+0000 7f667743f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6670070b70 0x7f6670153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:45.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.818+0000 7f667743f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6670071490 0x7f667009bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:45.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.818+0000 7f667743f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c3d20 con 0x7f6670071490 2023-12-22T08:53:45.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.818+0000 7f667743f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c30a0 con 0x7f667006c4d0 2023-12-22T08:53:45.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.818+0000 7f667743f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c3380 con 0x7f6670070b70 2023-12-22T08:53:45.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.819+0000 7f6676c3e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6670071490 0x7f667009bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:45.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.819+0000 7f6676c3e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6670071490 0x7f667009bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60304/0 (socket says 172.21.15.38:60304) 2023-12-22T08:53:45.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.819+0000 7f6676c3e640 1 -- 172.21.15.38:0/3846294087 learned_addr learned my addr 172.21.15.38:0/3846294087 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.819+0000 7f6675c3c640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6670070b70 0x7f6670153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.819+0000 7f667643d640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f667006c4d0 0x7f66700c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.819+0000 7f6676c3e640 1 -- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6670070b70 msgr2=0x7f6670153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.819+0000 7f6676c3e640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6670070b70 0x7f6670153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.819+0000 7f6676c3e640 1 -- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f667006c4d0 msgr2=0x7f66700c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.819+0000 7f6676c3e640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f667006c4d0 0x7f66700c2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.819+0000 7f6676c3e640 1 -- 172.21.15.38:0/3846294087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c009400 con 0x7f6670071490 2023-12-22T08:53:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.819+0000 7f667643d640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f667006c4d0 0x7f66700c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.819+0000 7f6676c3e640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6670071490 0x7f667009bd70 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f666800caa0 tx=0x7f666800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.820+0000 7f6666ffd640 1 -- 172.21.15.38:0/3846294087 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666800ab40 con 0x7f6670071490 2023-12-22T08:53:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.820+0000 7f6666ffd640 1 -- 172.21.15.38:0/3846294087 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666800aca0 con 0x7f6670071490 2023-12-22T08:53:45.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.820+0000 7f6666ffd640 1 -- 172.21.15.38:0/3846294087 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668012600 con 0x7f6670071490 2023-12-22T08:53:45.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.820+0000 7f667743f640 1 -- 172.21.15.38:0/3846294087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66700c3660 con 0x7f6670071490 2023-12-22T08:53:45.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.820+0000 7f667743f640 1 -- 172.21.15.38:0/3846294087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66701542b0 con 0x7f6670071490 2023-12-22T08:53:45.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.821+0000 7f667743f640 1 -- 172.21.15.38:0/3846294087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66700c3e60 con 0x7f6670071490 2023-12-22T08:53:45.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.822+0000 7f6666ffd640 1 -- 172.21.15.38:0/3846294087 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6668007070 con 0x7f6670071490 2023-12-22T08:53:45.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.823+0000 7f6666ffd640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f665406a430 0x7f665406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:45.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.823+0000 7f6666ffd640 1 -- 172.21.15.38:0/3846294087 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6668088690 con 0x7f6670071490 2023-12-22T08:53:45.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.824+0000 7f6666ffd640 1 -- 172.21.15.38:0/3846294087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f6654071f60 con 0x7f6670071490 2023-12-22T08:53:45.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.824+0000 7f667643d640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f665406a430 0x7f665406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:45.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.825+0000 7f667643d640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f665406a430 0x7f665406c8f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f666c036000 tx=0x7f666c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:45.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:45.828+0000 7f6666ffd640 1 -- 172.21.15.38:0/3846294087 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6668017060 con 0x7f6670071490 2023-12-22T08:53:46.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.026+0000 7f667743f640 1 -- 172.21.15.38:0/3846294087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6670061910 con 0x7f6670071490 2023-12-22T08:53:46.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.027+0000 7f6666ffd640 1 -- 172.21.15.38:0/3846294087 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v194) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66700c3e60 con 0x7f6670071490 2023-12-22T08:53:46.027 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-12-22T08:53:46.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.029+0000 7f667743f640 1 -- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f665406a430 msgr2=0x7f665406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.029+0000 7f667743f640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f665406a430 0x7f665406c8f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f666c036000 tx=0x7f666c03c040 comp rx=0 tx=0).stop 2023-12-22T08:53:46.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.029+0000 7f667743f640 1 -- 172.21.15.38:0/3846294087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6670071490 msgr2=0x7f667009bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.029+0000 7f667743f640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6670071490 0x7f667009bd70 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f666800caa0 tx=0x7f666800cf60 comp rx=0 tx=0).stop 2023-12-22T08:53:46.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.030+0000 7f667743f640 1 -- 172.21.15.38:0/3846294087 shutdown_connections 2023-12-22T08:53:46.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.030+0000 7f667743f640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f665406a430 0x7f665406c8f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.030+0000 7f667743f640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6670071490 0x7f667009bd70 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.030+0000 7f667743f640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6670070b70 0x7f6670153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.030+0000 7f667743f640 1 --2- 172.21.15.38:0/3846294087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f667006c4d0 0x7f66700c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.030+0000 7f667743f640 1 -- 172.21.15.38:0/3846294087 >> 172.21.15.38:0/3846294087 conn(0x7f66700b0b60 msgr2=0x7f667015e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:46.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.030+0000 7f667743f640 1 -- 172.21.15.38:0/3846294087 shutdown_connections 2023-12-22T08:53:46.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.030+0000 7f667743f640 1 -- 172.21.15.38:0/3846294087 wait complete. 2023-12-22T08:53:46.050 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:53:46.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.270+0000 7fed9241b640 1 Processor -- start 2023-12-22T08:53:46.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.270+0000 7fed9241b640 1 -- start start 2023-12-22T08:53:46.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.272+0000 7fed9241b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed8c071680 0x7fed8c162f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.272+0000 7fed9241b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c162ce0 con 0x7fed8c0b2a90 2023-12-22T08:53:46.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.272+0000 7fed9241b640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c162160 con 0x7fed8c0caf90 2023-12-22T08:53:46.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.272+0000 7fed9241b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c162440 con 0x7fed8c071680 2023-12-22T08:53:46.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.272+0000 7fed90c18640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fed8c0b2a90 0x7fed8c0ca880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46796/0 (socket says 172.21.15.38:46796) 2023-12-22T08:53:46.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.272+0000 7fed90c18640 1 -- 172.21.15.38:0/3477782541 learned_addr learned my addr 172.21.15.38:0/3477782541 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:46.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.272+0000 7fed91419640 1 --2- 172.21.15.38:0/3477782541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed8c071680 0x7fed8c162f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815396616 0 0) 0x7fed8c162ce0 con 0x7fed8c0b2a90 2023-12-22T08:53:46.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed78003520 con 0x7fed8c0b2a90 2023-12-22T08:53:46.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 556216853 0 0) 0x7fed78003520 con 0x7fed8c0b2a90 2023-12-22T08:53:46.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed8c071680 msgr2=0x7fed8c162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:46.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 --2- 172.21.15.38:0/3477782541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed8c071680 0x7fed8c162f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 >> v1:172.21.15.89:6789/0 conn(0x7fed8c0caf90 legacy=0x7fed8c06d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c162720 con 0x7fed8c0b2a90 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fed7c001670 con 0x7fed8c0b2a90 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 >> v1:172.21.15.38:6789/0 conn(0x7fed8c0b2a90 legacy=0x7fed8c0ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 --2- 172.21.15.38:0/3477782541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed780039a0 0x7fed78003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 --2- 172.21.15.38:0/3477782541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed780047c0 0x7fed78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 --2- 172.21.15.38:0/3477782541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed8c071680 0x7fed78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c162440 con 0x7fed780047c0 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7800ba30 con 0x7fed780039a0 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.273+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7800bbf0 con 0x7fed8c071680 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.274+0000 7fed90c18640 1 --2- 172.21.15.38:0/3477782541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed780047c0 0x7fed78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.274+0000 7fed91c1a640 1 --2- 172.21.15.38:0/3477782541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed8c071680 0x7fed78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.274+0000 7fed91419640 1 --2- 172.21.15.38:0/3477782541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed780039a0 0x7fed78003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.274+0000 7fed90c18640 1 -- 172.21.15.38:0/3477782541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed8c071680 msgr2=0x7fed78005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:46.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.274+0000 7fed90c18640 1 --2- 172.21.15.38:0/3477782541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed8c071680 0x7fed78005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.274+0000 7fed90c18640 1 -- 172.21.15.38:0/3477782541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed780039a0 msgr2=0x7fed78003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:46.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.274+0000 7fed90c18640 1 --2- 172.21.15.38:0/3477782541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed780039a0 0x7fed78003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.274+0000 7fed90c18640 1 -- 172.21.15.38:0/3477782541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed78003520 con 0x7fed780047c0 2023-12-22T08:53:46.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.274+0000 7fed91419640 1 --2- 172.21.15.38:0/3477782541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed780039a0 0x7fed78003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:46.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.275+0000 7fed90c18640 1 --2- 172.21.15.38:0/3477782541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed780047c0 0x7fed78004c40 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c210 tx=0x7fed780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbf5c65999b56e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:46.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.275+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c005ad0 con 0x7fed780047c0 2023-12-22T08:53:46.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.276+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c005c50 con 0x7fed780047c0 2023-12-22T08:53:46.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.276+0000 7fed83fff640 1 -- 172.21.15.38:0/3477782541 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c02c870 con 0x7fed780047c0 2023-12-22T08:53:46.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.276+0000 7fed9241b640 1 -- 172.21.15.38:0/3477782541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed780047c0 msgr2=0x7fed78004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.276+0000 7fed9241b640 1 --2- 172.21.15.38:0/3477782541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed780047c0 0x7fed78004c40 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c210 tx=0x7fed780057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.276+0000 7fed91c1a640 1 -- 172.21.15.38:0/3477782541 reap_dead start 2023-12-22T08:53:46.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.276+0000 7fed9241b640 1 -- 172.21.15.38:0/3477782541 shutdown_connections 2023-12-22T08:53:46.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.276+0000 7fed9241b640 1 -- 172.21.15.38:0/3477782541 >> 172.21.15.38:0/3477782541 conn(0x7fed8c0b1f70 msgr2=0x7fed8c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:46.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.276+0000 7fed9241b640 1 -- 172.21.15.38:0/3477782541 shutdown_connections 2023-12-22T08:53:46.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.276+0000 7fed9241b640 1 -- 172.21.15.38:0/3477782541 wait complete. 2023-12-22T08:53:46.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.278+0000 7fed9241b640 1 Processor -- start 2023-12-22T08:53:46.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.278+0000 7fed9241b640 1 -- start start 2023-12-22T08:53:46.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.279+0000 7fed9241b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed780047c0 0x7fed8c149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.279+0000 7fed9241b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed8c15e420 0x7fed8c157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.279+0000 7fed9241b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed8c159a30 0x7fed8c159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.279+0000 7fed9241b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c15b1e0 con 0x7fed8c15e420 2023-12-22T08:53:46.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.279+0000 7fed9241b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c15a940 con 0x7fed8c159a30 2023-12-22T08:53:46.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.279+0000 7fed9241b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c15ac20 con 0x7fed780047c0 2023-12-22T08:53:46.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.280+0000 7fed90c18640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed8c15e420 0x7fed8c157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.280+0000 7fed90c18640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed8c15e420 0x7fed8c157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60318/0 (socket says 172.21.15.38:60318) 2023-12-22T08:53:46.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.280+0000 7fed90c18640 1 -- 172.21.15.38:0/846420093 learned_addr learned my addr 172.21.15.38:0/846420093 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:46.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.280+0000 7fed91419640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed780047c0 0x7fed8c149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.280+0000 7fed90c18640 1 -- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed780047c0 msgr2=0x7fed8c149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.280+0000 7fed90c18640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed780047c0 0x7fed8c149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.280+0000 7fed90c18640 1 -- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed8c159a30 msgr2=0x7fed8c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.280+0000 7fed91c1a640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed8c159a30 0x7fed8c159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.280+0000 7fed90c18640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed8c159a30 0x7fed8c159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.280+0000 7fed90c18640 1 -- 172.21.15.38:0/846420093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c15af00 con 0x7fed8c15e420 2023-12-22T08:53:46.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.280+0000 7fed91c1a640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed8c159a30 0x7fed8c159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:46.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.280+0000 7fed90c18640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed8c15e420 0x7fed8c157e70 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c330 tx=0x7fed7c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:46.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.281+0000 7fed81ffb640 1 -- 172.21.15.38:0/846420093 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c02cc80 con 0x7fed8c15e420 2023-12-22T08:53:46.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.281+0000 7fed81ffb640 1 -- 172.21.15.38:0/846420093 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c02ce00 con 0x7fed8c15e420 2023-12-22T08:53:46.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.281+0000 7fed9241b640 1 -- 172.21.15.38:0/846420093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c1583b0 con 0x7fed8c15e420 2023-12-22T08:53:46.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.281+0000 7fed81ffb640 1 -- 172.21.15.38:0/846420093 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c0072b0 con 0x7fed8c15e420 2023-12-22T08:53:46.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.281+0000 7fed9241b640 1 -- 172.21.15.38:0/846420093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c15a600 con 0x7fed8c15e420 2023-12-22T08:53:46.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.282+0000 7fed9241b640 1 -- 172.21.15.38:0/846420093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c061910 con 0x7fed8c15e420 2023-12-22T08:53:46.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.283+0000 7fed81ffb640 1 -- 172.21.15.38:0/846420093 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fed7c032070 con 0x7fed8c15e420 2023-12-22T08:53:46.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.284+0000 7fed81ffb640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fed7006a460 0x7fed7006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.284+0000 7fed81ffb640 1 -- 172.21.15.38:0/846420093 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed7c03c040 con 0x7fed8c15e420 2023-12-22T08:53:46.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.284+0000 7fed81ffb640 1 -- 172.21.15.38:0/846420093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7fed70071f90 con 0x7fed8c15e420 2023-12-22T08:53:46.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.285+0000 7fed91419640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fed7006a460 0x7fed7006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.286+0000 7fed91419640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fed7006a460 0x7fed7006c920 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fed880099c0 tx=0x7fed88008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:46.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.288+0000 7fed81ffb640 1 -- 172.21.15.38:0/846420093 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fed7c075340 con 0x7fed8c15e420 2023-12-22T08:53:46.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.517+0000 7fed9241b640 1 -- 172.21.15.38:0/846420093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed8c070a70 con 0x7fed8c15e420 2023-12-22T08:53:46.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.519+0000 7fed81ffb640 1 -- 172.21.15.38:0/846420093 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4649 (secure 0 0 0) 0x7fed7c045030 con 0x7fed8c15e420 2023-12-22T08:53:46.519 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:46.520 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2952705616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2952705616},{"type":"v1","addr":"172.21.15.89:6835","nonce":2952705616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/3842752964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":3842752964},{"type":"v1","addr":"172.21.15.89:6837","nonce":3842752964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/261655608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":261655608},{"type":"v1","addr":"172.21.15.38:6834","nonce":261655608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:53:04.462294+0000","modified":"2023-12-22T08:53:07.483358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8940":{"gid":8940,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3350465616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3350465616},{"type":"v1","addr":"172.21.15.38:6835","nonce":3350465616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-22T08:53:46.520 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 86 2023-12-22T08:53:46.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.521+0000 7fed9241b640 1 -- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fed7006a460 msgr2=0x7fed7006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.521+0000 7fed9241b640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fed7006a460 0x7fed7006c920 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fed880099c0 tx=0x7fed88008040 comp rx=0 tx=0).stop 2023-12-22T08:53:46.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.521+0000 7fed9241b640 1 -- 172.21.15.38:0/846420093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed8c15e420 msgr2=0x7fed8c157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.521+0000 7fed9241b640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed8c15e420 0x7fed8c157e70 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c330 tx=0x7fed7c001a00 comp rx=0 tx=0).stop 2023-12-22T08:53:46.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.522+0000 7fed9241b640 1 -- 172.21.15.38:0/846420093 shutdown_connections 2023-12-22T08:53:46.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.522+0000 7fed9241b640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed8c159a30 0x7fed8c159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.522+0000 7fed9241b640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fed7006a460 0x7fed7006c920 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.522+0000 7fed9241b640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed8c15e420 0x7fed8c157e70 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.522+0000 7fed9241b640 1 --2- 172.21.15.38:0/846420093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed780047c0 0x7fed8c149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.522+0000 7fed9241b640 1 -- 172.21.15.38:0/846420093 >> 172.21.15.38:0/846420093 conn(0x7fed8c0b1f70 msgr2=0x7fed8c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:46.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.522+0000 7fed9241b640 1 -- 172.21.15.38:0/846420093 shutdown_connections 2023-12-22T08:53:46.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.522+0000 7fed9241b640 1 -- 172.21.15.38:0/846420093 wait complete. 2023-12-22T08:53:46.543 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:53:46.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.768+0000 7f4e1ec68640 1 Processor -- start 2023-12-22T08:53:46.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.768+0000 7f4e1ec68640 1 -- start start 2023-12-22T08:53:46.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.770+0000 7f4e1ec68640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4e1815b420 0x7f4e1806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.770+0000 7f4e1ec68640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4e180a44a0 0x7f4e180708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.770+0000 7f4e1ec68640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e18070e30 0x7f4e1806f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.770+0000 7f4e1ec68640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e180cdae0 con 0x7f4e1815b420 2023-12-22T08:53:46.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.770+0000 7f4e1ec68640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1806dec0 con 0x7f4e180a44a0 2023-12-22T08:53:46.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.770+0000 7f4e1ec68640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e18071250 con 0x7f4e18070e30 2023-12-22T08:53:46.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.770+0000 7f4e1dc66640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4e1815b420 0x7f4e1806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.770+0000 7f4e1dc66640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4e1815b420 0x7f4e1806d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60322/0 (socket says 172.21.15.38:60322) 2023-12-22T08:53:46.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.770+0000 7f4e1dc66640 1 -- 172.21.15.38:0/2449547103 learned_addr learned my addr 172.21.15.38:0/2449547103 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:46.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.771+0000 7f4e1dc66640 1 -- 172.21.15.38:0/2449547103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e18070e30 msgr2=0x7f4e1806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.771+0000 7f4e1e467640 1 --2- 172.21.15.38:0/2449547103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e18070e30 0x7f4e1806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.771+0000 7f4e1d465640 1 --2- 172.21.15.38:0/2449547103 >> v2:172.21.15.89:3300/0 conn(0x7f4e180a44a0 0x7f4e180708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.771+0000 7f4e1dc66640 1 --2- 172.21.15.38:0/2449547103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e18070e30 0x7f4e1806f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.771+0000 7f4e1dc66640 1 -- 172.21.15.38:0/2449547103 >> v2:172.21.15.89:3300/0 conn(0x7f4e180a44a0 msgr2=0x7f4e180708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.771+0000 7f4e1dc66640 1 --2- 172.21.15.38:0/2449547103 >> v2:172.21.15.89:3300/0 conn(0x7f4e180a44a0 0x7f4e180708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.771+0000 7f4e1dc66640 1 -- 172.21.15.38:0/2449547103 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1815b800 con 0x7f4e1815b420 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.771+0000 7f4e1d465640 1 --2- 172.21.15.38:0/2449547103 >> v2:172.21.15.89:3300/0 conn(0x7f4e180a44a0 0x7f4e180708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.772+0000 7f4e1dc66640 1 --2- 172.21.15.38:0/2449547103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e1815b420 0x7f4e1806d980 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f4e1806bb90 tx=0x7f4e1402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724c7bbfad708157 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.772+0000 7f4e1cc64640 1 -- 172.21.15.38:0/2449547103 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1402ca70 con 0x7f4e1815b420 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.772+0000 7f4e1cc64640 1 -- 172.21.15.38:0/2449547103 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1402cbd0 con 0x7f4e1815b420 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.772+0000 7f4e1cc64640 1 -- 172.21.15.38:0/2449547103 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140343f0 con 0x7f4e1815b420 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.773+0000 7f4e1ec68640 1 -- 172.21.15.38:0/2449547103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e1815b420 msgr2=0x7f4e1806d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.773+0000 7f4e1ec68640 1 --2- 172.21.15.38:0/2449547103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e1815b420 0x7f4e1806d980 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f4e1806bb90 tx=0x7f4e1402bed0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.773+0000 7f4e1ec68640 1 -- 172.21.15.38:0/2449547103 shutdown_connections 2023-12-22T08:53:46.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.773+0000 7f4e1ec68640 1 --2- 172.21.15.38:0/2449547103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e18070e30 0x7f4e1806f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.773+0000 7f4e1ec68640 1 --2- 172.21.15.38:0/2449547103 >> v2:172.21.15.89:3300/0 conn(0x7f4e180a44a0 0x7f4e180708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.773+0000 7f4e1ec68640 1 --2- 172.21.15.38:0/2449547103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e1815b420 0x7f4e1806d980 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.773+0000 7f4e1ec68640 1 -- 172.21.15.38:0/2449547103 >> 172.21.15.38:0/2449547103 conn(0x7f4e180b1f70 msgr2=0x7f4e180b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:46.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.773+0000 7f4e1ec68640 1 -- 172.21.15.38:0/2449547103 shutdown_connections 2023-12-22T08:53:46.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.773+0000 7f4e1ec68640 1 -- 172.21.15.38:0/2449547103 wait complete. 2023-12-22T08:53:46.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.775+0000 7f4e1ec68640 1 Processor -- start 2023-12-22T08:53:46.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.775+0000 7f4e1ec68640 1 -- start start 2023-12-22T08:53:46.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.776+0000 7f4e1ec68640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e18070e30 0x7f4e1809f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.776+0000 7f4e1ec68640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e180a44a0 0x7f4e18151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.776+0000 7f4e1ec68640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e1815b420 0x7f4e18151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.776+0000 7f4e1ec68640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1809ee50 con 0x7f4e18070e30 2023-12-22T08:53:46.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.776+0000 7f4e1ec68640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e181508f0 con 0x7f4e180a44a0 2023-12-22T08:53:46.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.776+0000 7f4e1ec68640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1809f7b0 con 0x7f4e1815b420 2023-12-22T08:53:46.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.776+0000 7f4e1dc66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e18070e30 0x7f4e1809f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.776+0000 7f4e1dc66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e18070e30 0x7f4e1809f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60328/0 (socket says 172.21.15.38:60328) 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.776+0000 7f4e1dc66640 1 -- 172.21.15.38:0/1417651478 learned_addr learned my addr 172.21.15.38:0/1417651478 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.777+0000 7f4e1e467640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e1815b420 0x7f4e18151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.777+0000 7f4e1dc66640 1 -- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e1815b420 msgr2=0x7f4e18151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.777+0000 7f4e1d465640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e180a44a0 0x7f4e18151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.777+0000 7f4e1dc66640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e1815b420 0x7f4e18151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.777+0000 7f4e1dc66640 1 -- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e180a44a0 msgr2=0x7f4e18151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.777+0000 7f4e1dc66640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e180a44a0 0x7f4e18151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.777+0000 7f4e1dc66640 1 -- 172.21.15.38:0/1417651478 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14009b30 con 0x7f4e18070e30 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.777+0000 7f4e1dc66640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e18070e30 0x7f4e1809f270 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f4e14036040 tx=0x7f4e14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.778+0000 7f4e0e7fc640 1 -- 172.21.15.38:0/1417651478 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1403e450 con 0x7f4e18070e30 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.778+0000 7f4e0e7fc640 1 -- 172.21.15.38:0/1417651478 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1403e5d0 con 0x7f4e18070e30 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.778+0000 7f4e0e7fc640 1 -- 172.21.15.38:0/1417651478 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1403e980 con 0x7f4e18070e30 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.778+0000 7f4e1ec68640 1 -- 172.21.15.38:0/1417651478 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1809e1d0 con 0x7f4e18070e30 2023-12-22T08:53:46.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.778+0000 7f4e1ec68640 1 -- 172.21.15.38:0/1417651478 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1809e790 con 0x7f4e18070e30 2023-12-22T08:53:46.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.779+0000 7f4e1ec68640 1 -- 172.21.15.38:0/1417651478 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1809ef90 con 0x7f4e18070e30 2023-12-22T08:53:46.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.780+0000 7f4e0e7fc640 1 -- 172.21.15.38:0/1417651478 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4e1403eae0 con 0x7f4e18070e30 2023-12-22T08:53:46.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.782+0000 7f4e0e7fc640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4dfc06a430 0x7f4dfc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:46.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.782+0000 7f4e0e7fc640 1 -- 172.21.15.38:0/1417651478 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e140ab970 con 0x7f4e18070e30 2023-12-22T08:53:46.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.782+0000 7f4e0e7fc640 1 -- 172.21.15.38:0/1417651478 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f4dfc071f60 con 0x7f4e18070e30 2023-12-22T08:53:46.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.782+0000 7f4e1d465640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4dfc06a430 0x7f4dfc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:46.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.783+0000 7f4e1d465640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4dfc06a430 0x7f4dfc06c8f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4e18157450 tx=0x7f4e08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:46.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.787+0000 7f4e0e7fc640 1 -- 172.21.15.38:0/1417651478 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4e1809ef90 con 0x7f4e18070e30 2023-12-22T08:53:46.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.982+0000 7f4e1ec68640 1 -- 172.21.15.38:0/1417651478 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e1809ef90 con 0x7f4e18070e30 2023-12-22T08:53:46.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.985+0000 7f4e0e7fc640 1 -- 172.21.15.38:0/1417651478 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+16090 (secure 0 0 0) 0x7f4e1809ef90 con 0x7f4e18070e30 2023-12-22T08:53:46.986 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:46.986 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":194,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:53:41.417147+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:53:02.354802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-22T08:53:03.461583+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:53:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.988+0000 7f4e1ec68640 1 -- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4dfc06a430 msgr2=0x7f4dfc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.988+0000 7f4e1ec68640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4dfc06a430 0x7f4dfc06c8f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4e18157450 tx=0x7f4e08008040 comp rx=0 tx=0).stop 2023-12-22T08:53:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.988+0000 7f4e1ec68640 1 -- 172.21.15.38:0/1417651478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e18070e30 msgr2=0x7f4e1809f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.988+0000 7f4e1ec68640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e18070e30 0x7f4e1809f270 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f4e14036040 tx=0x7f4e14004a40 comp rx=0 tx=0).stop 2023-12-22T08:53:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.988+0000 7f4e1ec68640 1 -- 172.21.15.38:0/1417651478 shutdown_connections 2023-12-22T08:53:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.988+0000 7f4e1ec68640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e1815b420 0x7f4e18151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.988+0000 7f4e1ec68640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e180a44a0 0x7f4e18151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.988+0000 7f4e1ec68640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4dfc06a430 0x7f4dfc06c8f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.988+0000 7f4e1ec68640 1 --2- 172.21.15.38:0/1417651478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e18070e30 0x7f4e1809f270 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:46.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.988+0000 7f4e1ec68640 1 -- 172.21.15.38:0/1417651478 >> 172.21.15.38:0/1417651478 conn(0x7f4e180b1f70 msgr2=0x7f4e1815d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:46.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.988+0000 7f4e1ec68640 1 -- 172.21.15.38:0/1417651478 shutdown_connections 2023-12-22T08:53:46.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:46.988+0000 7f4e1ec68640 1 -- 172.21.15.38:0/1417651478 wait complete. 2023-12-22T08:53:47.008 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:53:47.008 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:53:47.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.230+0000 7fac83fff640 1 Processor -- start 2023-12-22T08:53:47.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.231+0000 7fac83fff640 1 -- start start 2023-12-22T08:53:47.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.232+0000 7fac83fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac84161340 0x7fac84071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.233+0000 7fac83fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fac84161720 0x7fac840ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.233+0000 7fac83fff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac840ce950 con 0x7fac84071fa0 2023-12-22T08:53:47.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.233+0000 7fac83fff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac840cdd40 con 0x7fac84161720 2023-12-22T08:53:47.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.233+0000 7fac83fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac840ce020 con 0x7fac84161340 2023-12-22T08:53:47.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.233+0000 7fac7bfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fac84071fa0 0x7fac840adca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46808/0 (socket says 172.21.15.38:46808) 2023-12-22T08:53:47.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.233+0000 7fac7bfff640 1 -- 172.21.15.38:0/1035527398 learned_addr learned my addr 172.21.15.38:0/1035527398 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:47.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.233+0000 7fac82ffd640 1 --2- 172.21.15.38:0/1035527398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac84161340 0x7fac84071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.233+0000 7fac837fe640 1 --2- 172.21.15.38:0/1035527398 >> v2:172.21.15.89:3300/0 conn(0x7fac84161720 0x7fac840ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.233+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543173217 0 0) 0x7fac840ce950 con 0x7fac84071fa0 2023-12-22T08:53:47.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.233+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac70003520 con 0x7fac84071fa0 2023-12-22T08:53:47.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3883500538 0 0) 0x7fac70003520 con 0x7fac84071fa0 2023-12-22T08:53:47.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac84161340 msgr2=0x7fac84071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:47.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 --2- 172.21.15.38:0/1035527398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac84161340 0x7fac84071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 >> v2:172.21.15.89:3300/0 conn(0x7fac84161720 msgr2=0x7fac840ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:47.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 --2- 172.21.15.38:0/1035527398 >> v2:172.21.15.89:3300/0 conn(0x7fac84161720 0x7fac840ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac840ce300 con 0x7fac84071fa0 2023-12-22T08:53:47.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fac6c001670 con 0x7fac84071fa0 2023-12-22T08:53:47.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 >> v1:172.21.15.38:6789/0 conn(0x7fac84071fa0 legacy=0x7fac840adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:47.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 --2- 172.21.15.38:0/1035527398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac84161340 0x7fac70003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 --2- 172.21.15.38:0/1035527398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac70003ef0 0x7fac700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 --2- 172.21.15.38:0/1035527398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70004d00 0x7fac70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac840cdd40 con 0x7fac70003ef0 2023-12-22T08:53:47.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac840ce020 con 0x7fac70004d00 2023-12-22T08:53:47.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7000b9d0 con 0x7fac84161340 2023-12-22T08:53:47.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.234+0000 7fac7bfff640 1 --2- 172.21.15.38:0/1035527398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac70003ef0 0x7fac700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.235+0000 7fac82ffd640 1 --2- 172.21.15.38:0/1035527398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac84161340 0x7fac70003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.235+0000 7fac837fe640 1 --2- 172.21.15.38:0/1035527398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70004d00 0x7fac70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.235+0000 7fac7bfff640 1 -- 172.21.15.38:0/1035527398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac84161340 msgr2=0x7fac70003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:47.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.235+0000 7fac7bfff640 1 --2- 172.21.15.38:0/1035527398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac84161340 0x7fac70003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.235+0000 7fac7bfff640 1 -- 172.21.15.38:0/1035527398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70004d00 msgr2=0x7fac70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:47.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.235+0000 7fac7bfff640 1 --2- 172.21.15.38:0/1035527398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70004d00 0x7fac70005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.235+0000 7fac7bfff640 1 -- 172.21.15.38:0/1035527398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac70003520 con 0x7fac70003ef0 2023-12-22T08:53:47.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.235+0000 7fac837fe640 1 --2- 172.21.15.38:0/1035527398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70004d00 0x7fac70005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:47.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.236+0000 7fac7bfff640 1 --2- 172.21.15.38:0/1035527398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac70003ef0 0x7fac700047c0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00c270 tx=0x7fac700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3774486e88ae379f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:47.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.236+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c02cae0 con 0x7fac70003ef0 2023-12-22T08:53:47.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.236+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c02cc40 con 0x7fac70003ef0 2023-12-22T08:53:47.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.236+0000 7fac827fc640 1 -- 172.21.15.38:0/1035527398 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c005af0 con 0x7fac70003ef0 2023-12-22T08:53:47.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.237+0000 7fac83fff640 1 -- 172.21.15.38:0/1035527398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac70003ef0 msgr2=0x7fac700047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:47.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.237+0000 7fac83fff640 1 --2- 172.21.15.38:0/1035527398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac70003ef0 0x7fac700047c0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00c270 tx=0x7fac700057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.237+0000 7fac837fe640 1 -- 172.21.15.38:0/1035527398 reap_dead start 2023-12-22T08:53:47.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.237+0000 7fac83fff640 1 -- 172.21.15.38:0/1035527398 shutdown_connections 2023-12-22T08:53:47.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.237+0000 7fac83fff640 1 -- 172.21.15.38:0/1035527398 >> 172.21.15.38:0/1035527398 conn(0x7fac840b1f70 msgr2=0x7fac840b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:47.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.237+0000 7fac83fff640 1 -- 172.21.15.38:0/1035527398 shutdown_connections 2023-12-22T08:53:47.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.237+0000 7fac83fff640 1 -- 172.21.15.38:0/1035527398 wait complete. 2023-12-22T08:53:47.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.239+0000 7fac83fff640 1 Processor -- start 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.239+0000 7fac83fff640 1 -- start start 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac83fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70003ef0 0x7fac84152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac83fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac84155c50 0x7fac841f6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac83fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac841f8120 0x7fac84071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac83fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac84155730 con 0x7fac841f8120 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac83fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac841f74a0 con 0x7fac70003ef0 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac83fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac841f7740 con 0x7fac84155c50 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac837fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac841f8120 0x7fac84071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac837fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac841f8120 0x7fac84071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60344/0 (socket says 172.21.15.38:60344) 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac837fe640 1 -- 172.21.15.38:0/2655647516 learned_addr learned my addr 172.21.15.38:0/2655647516 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac82ffd640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70003ef0 0x7fac84152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac837fe640 1 -- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac84155c50 msgr2=0x7fac841f6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac837fe640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac84155c50 0x7fac841f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac837fe640 1 -- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70003ef0 msgr2=0x7fac84152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:47.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac837fe640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70003ef0 0x7fac84152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac837fe640 1 -- 172.21.15.38:0/2655647516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac841f7a20 con 0x7fac841f8120 2023-12-22T08:53:47.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.240+0000 7fac82ffd640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70003ef0 0x7fac84152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:47.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.241+0000 7fac837fe640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac841f8120 0x7fac84071060 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fac840ce8c0 tx=0x7fac7c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:47.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.241+0000 7fac80ff9640 1 -- 172.21.15.38:0/2655647516 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c016620 con 0x7fac841f8120 2023-12-22T08:53:47.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.241+0000 7fac80ff9640 1 -- 172.21.15.38:0/2655647516 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c016780 con 0x7fac841f8120 2023-12-22T08:53:47.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.241+0000 7fac80ff9640 1 -- 172.21.15.38:0/2655647516 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c016b10 con 0x7fac841f8120 2023-12-22T08:53:47.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.241+0000 7fac83fff640 1 -- 172.21.15.38:0/2655647516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac841f7d00 con 0x7fac841f8120 2023-12-22T08:53:47.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.241+0000 7fac83fff640 1 -- 172.21.15.38:0/2655647516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac841f85d0 con 0x7fac841f8120 2023-12-22T08:53:47.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.242+0000 7fac83fff640 1 -- 172.21.15.38:0/2655647516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac84154360 con 0x7fac841f8120 2023-12-22T08:53:47.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.243+0000 7fac80ff9640 1 -- 172.21.15.38:0/2655647516 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fac7c016c70 con 0x7fac841f8120 2023-12-22T08:53:47.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.244+0000 7fac80ff9640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fac6406a430 0x7fac6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.244+0000 7fac80ff9640 1 -- 172.21.15.38:0/2655647516 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac7c089970 con 0x7fac841f8120 2023-12-22T08:53:47.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.244+0000 7fac80ff9640 1 -- 172.21.15.38:0/2655647516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7fac64071f60 con 0x7fac841f8120 2023-12-22T08:53:47.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.245+0000 7fac82ffd640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fac6406a430 0x7fac6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.246+0000 7fac82ffd640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fac6406a430 0x7fac6406c8f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fac74006ce0 tx=0x7fac74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:47.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.249+0000 7fac80ff9640 1 -- 172.21.15.38:0/2655647516 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fac84154360 con 0x7fac841f8120 2023-12-22T08:53:47.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.484+0000 7fac83fff640 1 -- 172.21.15.38:0/2655647516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac84154360 con 0x7fac841f8120 2023-12-22T08:53:47.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.485+0000 7fac80ff9640 1 -- 172.21.15.38:0/2655647516 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4649 (secure 0 0 0) 0x7fac84154360 con 0x7fac841f8120 2023-12-22T08:53:47.485 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:47.486 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2952705616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2952705616},{"type":"v1","addr":"172.21.15.89:6835","nonce":2952705616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/3842752964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":3842752964},{"type":"v1","addr":"172.21.15.89:6837","nonce":3842752964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/261655608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":261655608},{"type":"v1","addr":"172.21.15.38:6834","nonce":261655608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:53:04.462294+0000","modified":"2023-12-22T08:53:07.483358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8940":{"gid":8940,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3350465616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3350465616},{"type":"v1","addr":"172.21.15.38:6835","nonce":3350465616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-22T08:53:47.486 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 86 2023-12-22T08:53:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.488+0000 7fac83fff640 1 -- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fac6406a430 msgr2=0x7fac6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.488+0000 7fac83fff640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fac6406a430 0x7fac6406c8f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fac74006ce0 tx=0x7fac74008040 comp rx=0 tx=0).stop 2023-12-22T08:53:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.488+0000 7fac83fff640 1 -- 172.21.15.38:0/2655647516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac841f8120 msgr2=0x7fac84071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.488+0000 7fac83fff640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac841f8120 0x7fac84071060 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fac840ce8c0 tx=0x7fac7c00f520 comp rx=0 tx=0).stop 2023-12-22T08:53:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.488+0000 7fac83fff640 1 -- 172.21.15.38:0/2655647516 shutdown_connections 2023-12-22T08:53:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.488+0000 7fac83fff640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fac6406a430 0x7fac6406c8f0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.488+0000 7fac83fff640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac841f8120 0x7fac84071060 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.488+0000 7fac83fff640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac84155c50 0x7fac841f6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.488+0000 7fac83fff640 1 --2- 172.21.15.38:0/2655647516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac70003ef0 0x7fac84152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.488+0000 7fac83fff640 1 -- 172.21.15.38:0/2655647516 >> 172.21.15.38:0/2655647516 conn(0x7fac840b1f70 msgr2=0x7fac8415f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:47.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.488+0000 7fac83fff640 1 -- 172.21.15.38:0/2655647516 shutdown_connections 2023-12-22T08:53:47.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.488+0000 7fac83fff640 1 -- 172.21.15.38:0/2655647516 wait complete. 2023-12-22T08:53:47.509 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:53:47.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.711+0000 7f0d6b59e640 1 Processor -- start 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.711+0000 7f0d6b59e640 1 -- start start 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.712+0000 7f0d6b59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0d6c0cb4c0 0x7f0d6c15e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.712+0000 7f0d6b59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0d6c06d5f0 0x7f0d6c070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.712+0000 7f0d6b59e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6c0706d0 con 0x7f0d6c06d210 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.713+0000 7f0d6b59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6c0cbf40 con 0x7f0d6c0cb4c0 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.713+0000 7f0d6b59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6c0ce840 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.713+0000 7f0d69d9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0d6c0cb4c0 0x7f0d6c15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.713+0000 7f0d6a59c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0d6c06d210 0x7f0d6c159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46810/0 (socket says 172.21.15.38:46810) 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.713+0000 7f0d6a59c640 1 -- 172.21.15.38:0/4144072347 learned_addr learned my addr 172.21.15.38:0/4144072347 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.714+0000 7f0d6ad9d640 1 --2- 172.21.15.38:0/4144072347 >> v2:172.21.15.89:3300/0 conn(0x7f0d6c06d5f0 0x7f0d6c070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.714+0000 7f0d69d9b640 1 -- 172.21.15.38:0/4144072347 >> v2:172.21.15.89:3300/0 conn(0x7f0d6c06d5f0 msgr2=0x7f0d6c070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.714+0000 7f0d69d9b640 1 --2- 172.21.15.38:0/4144072347 >> v2:172.21.15.89:3300/0 conn(0x7f0d6c06d5f0 0x7f0d6c070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.714+0000 7f0d69d9b640 1 -- 172.21.15.38:0/4144072347 >> v1:172.21.15.38:6789/0 conn(0x7f0d6c06d210 legacy=0x7f0d6c159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:47.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.714+0000 7f0d69d9b640 1 -- 172.21.15.38:0/4144072347 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c0ceb20 con 0x7f0d6c0cb4c0 2023-12-22T08:53:47.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.714+0000 7f0d6959a640 1 -- 172.21.15.38:0/4144072347 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571931608 0 0) 0x7f0d6c0706d0 con 0x7f0d6c06d210 2023-12-22T08:53:47.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.714+0000 7f0d6ad9d640 1 --2- 172.21.15.38:0/4144072347 >> v2:172.21.15.89:3300/0 conn(0x7f0d6c06d5f0 0x7f0d6c070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.715+0000 7f0d69d9b640 1 --2- 172.21.15.38:0/4144072347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c0cb4c0 0x7f0d6c15e830 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0b1f00 tx=0x7f0d6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a8e1d3ce6338c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.716+0000 7f0d6959a640 1 -- 172.21.15.38:0/4144072347 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60031830 con 0x7f0d6c0cb4c0 2023-12-22T08:53:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.716+0000 7f0d6959a640 1 -- 172.21.15.38:0/4144072347 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d60031990 con 0x7f0d6c0cb4c0 2023-12-22T08:53:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.716+0000 7f0d6959a640 1 -- 172.21.15.38:0/4144072347 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60031d20 con 0x7f0d6c0cb4c0 2023-12-22T08:53:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.716+0000 7f0d6b59e640 1 -- 172.21.15.38:0/4144072347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c0cb4c0 msgr2=0x7f0d6c15e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.716+0000 7f0d6b59e640 1 --2- 172.21.15.38:0/4144072347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c0cb4c0 0x7f0d6c15e830 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0b1f00 tx=0x7f0d6002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.716+0000 7f0d6b59e640 1 -- 172.21.15.38:0/4144072347 shutdown_connections 2023-12-22T08:53:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.716+0000 7f0d6b59e640 1 --2- 172.21.15.38:0/4144072347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c0cb4c0 0x7f0d6c15e830 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.716+0000 7f0d6b59e640 1 --2- 172.21.15.38:0/4144072347 >> v2:172.21.15.89:3300/0 conn(0x7f0d6c06d5f0 0x7f0d6c070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.716+0000 7f0d6b59e640 1 -- 172.21.15.38:0/4144072347 >> 172.21.15.38:0/4144072347 conn(0x7f0d6c0b1f70 msgr2=0x7f0d6c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:47.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.716+0000 7f0d6b59e640 1 -- 172.21.15.38:0/4144072347 shutdown_connections 2023-12-22T08:53:47.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.716+0000 7f0d6b59e640 1 -- 172.21.15.38:0/4144072347 wait complete. 2023-12-22T08:53:47.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.718+0000 7f0d6b59e640 1 Processor -- start 2023-12-22T08:53:47.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.718+0000 7f0d6b59e640 1 -- start start 2023-12-22T08:53:47.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.719+0000 7f0d6b59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d6c06d210 0x7f0d6c155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.719+0000 7f0d6b59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c06d5f0 0x7f0d6c1f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.719+0000 7f0d6b59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d6c0cb4c0 0x7f0d6c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.719+0000 7f0d6b59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c1562c0 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.719+0000 7f0d6b59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c1e6820 con 0x7f0d6c0cb4c0 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.719+0000 7f0d6b59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c1f5d90 con 0x7f0d6c06d210 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.719+0000 7f0d69d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c06d5f0 0x7f0d6c1f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.720+0000 7f0d69d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c06d5f0 0x7f0d6c1f6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60364/0 (socket says 172.21.15.38:60364) 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.720+0000 7f0d69d9b640 1 -- 172.21.15.38:0/3576044078 learned_addr learned my addr 172.21.15.38:0/3576044078 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.720+0000 7f0d6ad9d640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d6c0cb4c0 0x7f0d6c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.720+0000 7f0d6a59c640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d6c06d210 0x7f0d6c155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.720+0000 7f0d69d9b640 1 -- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d6c06d210 msgr2=0x7f0d6c155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.720+0000 7f0d69d9b640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d6c06d210 0x7f0d6c155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.720+0000 7f0d69d9b640 1 -- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d6c0cb4c0 msgr2=0x7f0d6c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.720+0000 7f0d69d9b640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d6c0cb4c0 0x7f0d6c06f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.720+0000 7f0d69d9b640 1 -- 172.21.15.38:0/3576044078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d60009400 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.720+0000 7f0d69d9b640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c06d5f0 0x7f0d6c1f6590 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f0d60000c00 tx=0x7f0d600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:47.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.721+0000 7f0d5affd640 1 -- 172.21.15.38:0/3576044078 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60004230 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.721+0000 7f0d5affd640 1 -- 172.21.15.38:0/3576044078 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d60004390 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.721+0000 7f0d5affd640 1 -- 172.21.15.38:0/3576044078 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6003a8f0 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.721+0000 7f0d6b59e640 1 -- 172.21.15.38:0/3576044078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6c1f6070 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.721+0000 7f0d6b59e640 1 -- 172.21.15.38:0/3576044078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6c1f6ad0 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.722+0000 7f0d6b59e640 1 -- 172.21.15.38:0/3576044078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6c1f6290 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.723+0000 7f0d5affd640 1 -- 172.21.15.38:0/3576044078 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0d6003aa50 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.724+0000 7f0d5affd640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d4c06a430 0x7f0d4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:47.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.724+0000 7f0d5affd640 1 -- 172.21.15.38:0/3576044078 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d600aac80 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.724+0000 7f0d5affd640 1 -- 172.21.15.38:0/3576044078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f0d4c071f60 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.725+0000 7f0d6a59c640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d4c06a430 0x7f0d4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:47.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.726+0000 7f0d6a59c640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d4c06a430 0x7f0d4c06c8f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c007fd0 tx=0x7f0d5c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:47.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.728+0000 7f0d5affd640 1 -- 172.21.15.38:0/3576044078 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0d60035020 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.959+0000 7f0d6b59e640 1 -- 172.21.15.38:0/3576044078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d6c061910 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.961+0000 7f0d5affd640 1 -- 172.21.15.38:0/3576044078 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4649 (secure 0 0 0) 0x7f0d600761d0 con 0x7f0d6c06d5f0 2023-12-22T08:53:47.962 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:47.962 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2952705616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2952705616},{"type":"v1","addr":"172.21.15.89:6835","nonce":2952705616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/3842752964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":3842752964},{"type":"v1","addr":"172.21.15.89:6837","nonce":3842752964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/261655608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":261655608},{"type":"v1","addr":"172.21.15.38:6834","nonce":261655608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:53:04.462294+0000","modified":"2023-12-22T08:53:07.483358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8940":{"gid":8940,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6835/3350465616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":3350465616},{"type":"v1","addr":"172.21.15.38:6835","nonce":3350465616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-22T08:53:47.962 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 86 2023-12-22T08:53:47.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.963+0000 7f0d6b59e640 1 -- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d4c06a430 msgr2=0x7f0d4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.963+0000 7f0d6b59e640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d4c06a430 0x7f0d4c06c8f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c007fd0 tx=0x7f0d5c009040 comp rx=0 tx=0).stop 2023-12-22T08:53:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.963+0000 7f0d6b59e640 1 -- 172.21.15.38:0/3576044078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c06d5f0 msgr2=0x7f0d6c1f6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.963+0000 7f0d6b59e640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c06d5f0 0x7f0d6c1f6590 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f0d60000c00 tx=0x7f0d600046c0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.963+0000 7f0d6b59e640 1 -- 172.21.15.38:0/3576044078 shutdown_connections 2023-12-22T08:53:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.963+0000 7f0d6b59e640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d6c0cb4c0 0x7f0d6c06f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.963+0000 7f0d6b59e640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d4c06a430 0x7f0d4c06c8f0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.963+0000 7f0d6b59e640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d6c06d5f0 0x7f0d6c1f6590 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.963+0000 7f0d6b59e640 1 --2- 172.21.15.38:0/3576044078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d6c06d210 0x7f0d6c155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:47.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.963+0000 7f0d6b59e640 1 -- 172.21.15.38:0/3576044078 >> 172.21.15.38:0/3576044078 conn(0x7f0d6c0b1f70 msgr2=0x7f0d6c09e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:47.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.963+0000 7f0d6b59e640 1 -- 172.21.15.38:0/3576044078 shutdown_connections 2023-12-22T08:53:47.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:47.964+0000 7f0d6b59e640 1 -- 172.21.15.38:0/3576044078 wait complete. 2023-12-22T08:53:47.982 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:53:48.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.199+0000 7fc5e5d1c640 1 Processor -- start 2023-12-22T08:53:48.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.199+0000 7fc5e5d1c640 1 -- start start 2023-12-22T08:53:48.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.201+0000 7fc5e5d1c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5e0162f20 0x7fc5e00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:48.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.201+0000 7fc5e5d1c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e00b2fd0 con 0x7fc5e0071680 2023-12-22T08:53:48.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.201+0000 7fc5e5d1c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e0163370 con 0x7fc5e00caf90 2023-12-22T08:53:48.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.201+0000 7fc5e5d1c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e0162ce0 con 0x7fc5e0162f20 2023-12-22T08:53:48.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.201+0000 7fc5e4d1a640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc5e0071680 0x7fc5e00ca880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46826/0 (socket says 172.21.15.38:46826) 2023-12-22T08:53:48.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.201+0000 7fc5e4d1a640 1 -- 172.21.15.38:0/2031230956 learned_addr learned my addr 172.21.15.38:0/2031230956 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:48.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.202+0000 7fc5e551b640 1 --2- 172.21.15.38:0/2031230956 >> v2:172.21.15.89:3300/0 conn(0x7fc5e0162f20 0x7fc5e00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:48.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.202+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984546327 0 0) 0x7fc5dc001110 con 0x7fc5e0071680 2023-12-22T08:53:48.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.202+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5c8003520 con 0x7fc5e0071680 2023-12-22T08:53:48.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.202+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3403767843 0 0) 0x7fc5c8003520 con 0x7fc5e0071680 2023-12-22T08:53:48.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.202+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 >> v2:172.21.15.89:3300/0 conn(0x7fc5e0162f20 msgr2=0x7fc5e00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:48.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.202+0000 7fc5d77fe640 1 --2- 172.21.15.38:0/2031230956 >> v2:172.21.15.89:3300/0 conn(0x7fc5e0162f20 0x7fc5e00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.202+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 >> v1:172.21.15.89:6789/0 conn(0x7fc5e00caf90 legacy=0x7fc5e006d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.202+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e0162160 con 0x7fc5e0071680 2023-12-22T08:53:48.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.202+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fc5dc001800 con 0x7fc5e0071680 2023-12-22T08:53:48.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.202+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 >> v1:172.21.15.38:6789/0 conn(0x7fc5e0071680 legacy=0x7fc5e00ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.202+0000 7fc5d77fe640 1 --2- 172.21.15.38:0/2031230956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c80039c0 0x7fc5c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:48.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.202+0000 7fc5d77fe640 1 --2- 172.21.15.38:0/2031230956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5c80047c0 0x7fc5c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:48.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.203+0000 7fc5d77fe640 1 --2- 172.21.15.38:0/2031230956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5c80051d0 0x7fc5c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:48.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.203+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e0162ce0 con 0x7fc5c80039c0 2023-12-22T08:53:48.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.203+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c800c120 con 0x7fc5c80051d0 2023-12-22T08:53:48.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.203+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c800c2e0 con 0x7fc5c80047c0 2023-12-22T08:53:48.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.203+0000 7fc5e4d1a640 1 --2- 172.21.15.38:0/2031230956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c80039c0 0x7fc5c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:48.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.203+0000 7fc5e551b640 1 --2- 172.21.15.38:0/2031230956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5c80051d0 0x7fc5c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:48.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.203+0000 7fc5d7fff640 1 --2- 172.21.15.38:0/2031230956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5c80047c0 0x7fc5c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:48.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.203+0000 7fc5e4d1a640 1 -- 172.21.15.38:0/2031230956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5c80047c0 msgr2=0x7fc5c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:48.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.203+0000 7fc5e4d1a640 1 --2- 172.21.15.38:0/2031230956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5c80047c0 0x7fc5c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.203+0000 7fc5e4d1a640 1 -- 172.21.15.38:0/2031230956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5c80051d0 msgr2=0x7fc5c800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:48.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.203+0000 7fc5e4d1a640 1 --2- 172.21.15.38:0/2031230956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5c80051d0 0x7fc5c800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.203+0000 7fc5e4d1a640 1 -- 172.21.15.38:0/2031230956 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c8003520 con 0x7fc5c80039c0 2023-12-22T08:53:48.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.203+0000 7fc5e551b640 1 -- 172.21.15.38:0/2031230956 reap_dead start 2023-12-22T08:53:48.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.204+0000 7fc5e4d1a640 1 --2- 172.21.15.38:0/2031230956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c80039c0 0x7fc5c8003de0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc007fa0 tx=0x7fc5c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e8538a77eb925 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:48.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.205+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc005ad0 con 0x7fc5c80039c0 2023-12-22T08:53:48.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.205+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc005c30 con 0x7fc5c80039c0 2023-12-22T08:53:48.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.205+0000 7fc5d77fe640 1 -- 172.21.15.38:0/2031230956 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc02c980 con 0x7fc5c80039c0 2023-12-22T08:53:48.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.205+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/2031230956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c80039c0 msgr2=0x7fc5c8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.205+0000 7fc5e5d1c640 1 --2- 172.21.15.38:0/2031230956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c80039c0 0x7fc5c8003de0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc007fa0 tx=0x7fc5c80057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.205+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/2031230956 shutdown_connections 2023-12-22T08:53:48.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.205+0000 7fc5e5d1c640 1 --2- 172.21.15.38:0/2031230956 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c80039c0 0x7fc5c8003de0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.206+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/2031230956 >> 172.21.15.38:0/2031230956 conn(0x7fc5e00b1f70 msgr2=0x7fc5e00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:48.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.206+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/2031230956 shutdown_connections 2023-12-22T08:53:48.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.206+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/2031230956 wait complete. 2023-12-22T08:53:48.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.208+0000 7fc5e5d1c640 1 Processor -- start 2023-12-22T08:53:48.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.208+0000 7fc5e5d1c640 1 -- start start 2023-12-22T08:53:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.209+0000 7fc5e5d1c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5c80039c0 0x7fc5e01f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.209+0000 7fc5e5d1c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5e0099a70 0x7fc5e015b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:48.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.209+0000 7fc5e5d1c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5e009b9e0 0x7fc5e009be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.209+0000 7fc5e5d1c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e009c3b0 con 0x7fc5e009b9e0 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.209+0000 7fc5e5d1c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e01f8130 con 0x7fc5c80039c0 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.209+0000 7fc5e5d1c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e015ebe0 con 0x7fc5e0099a70 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.209+0000 7fc5e551b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5e009b9e0 0x7fc5e009be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.209+0000 7fc5e551b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5e009b9e0 0x7fc5e009be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60372/0 (socket says 172.21.15.38:60372) 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.209+0000 7fc5e551b640 1 -- 172.21.15.38:0/1447220423 learned_addr learned my addr 172.21.15.38:0/1447220423 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.209+0000 7fc5e4d1a640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5c80039c0 0x7fc5e01f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.209+0000 7fc5d7fff640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5e0099a70 0x7fc5e015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.210+0000 7fc5e551b640 1 -- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5e0099a70 msgr2=0x7fc5e015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.210+0000 7fc5e551b640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5e0099a70 0x7fc5e015b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.210+0000 7fc5e551b640 1 -- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5c80039c0 msgr2=0x7fc5e01f7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.210+0000 7fc5e551b640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5c80039c0 0x7fc5e01f7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.210+0000 7fc5e551b640 1 -- 172.21.15.38:0/1447220423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e0099f50 con 0x7fc5e009b9e0 2023-12-22T08:53:48.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.210+0000 7fc5e551b640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5e009b9e0 0x7fc5e009be70 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00ae400 tx=0x7fc5d80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.210+0000 7fc5d57fa640 1 -- 172.21.15.38:0/1447220423 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800e070 con 0x7fc5e009b9e0 2023-12-22T08:53:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.210+0000 7fc5d57fa640 1 -- 172.21.15.38:0/1447220423 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d8011db0 con 0x7fc5e009b9e0 2023-12-22T08:53:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.210+0000 7fc5d57fa640 1 -- 172.21.15.38:0/1447220423 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8003990 con 0x7fc5e009b9e0 2023-12-22T08:53:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.210+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/1447220423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e009a230 con 0x7fc5e009b9e0 2023-12-22T08:53:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.210+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/1447220423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e009a7f0 con 0x7fc5e009b9e0 2023-12-22T08:53:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.211+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/1447220423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e0061910 con 0x7fc5e009b9e0 2023-12-22T08:53:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.212+0000 7fc5d57fa640 1 -- 172.21.15.38:0/1447220423 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc5d8003af0 con 0x7fc5e009b9e0 2023-12-22T08:53:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.214+0000 7fc5d57fa640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc5cc06a430 0x7fc5cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.214+0000 7fc5d57fa640 1 -- 172.21.15.38:0/1447220423 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5d8089150 con 0x7fc5e009b9e0 2023-12-22T08:53:48.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.214+0000 7fc5d57fa640 1 -- 172.21.15.38:0/1447220423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7fc5cc071f60 con 0x7fc5e009b9e0 2023-12-22T08:53:48.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.214+0000 7fc5e4d1a640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc5cc06a430 0x7fc5cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:48.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.215+0000 7fc5e4d1a640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc5cc06a430 0x7fc5cc06c8f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc034000 tx=0x7fc5dc009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:48.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.218+0000 7fc5d57fa640 1 -- 172.21.15.38:0/1447220423 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc5d80546a0 con 0x7fc5e009b9e0 2023-12-22T08:53:48.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.417+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/1447220423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5e00b0880 con 0x7fc5e009b9e0 2023-12-22T08:53:48.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.420+0000 7fc5d57fa640 1 -- 172.21.15.38:0/1447220423 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+16090 (secure 0 0 0) 0x7fc5d8057cc0 con 0x7fc5e009b9e0 2023-12-22T08:53:48.421 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:48.421 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":194,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:53:41.417147+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:53:02.354802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-22T08:53:03.461583+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:53:48.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.423+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc5cc06a430 msgr2=0x7fc5cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.423+0000 7fc5e5d1c640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc5cc06a430 0x7fc5cc06c8f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc034000 tx=0x7fc5dc009030 comp rx=0 tx=0).stop 2023-12-22T08:53:48.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.423+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/1447220423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5e009b9e0 msgr2=0x7fc5e009be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.423+0000 7fc5e5d1c640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5e009b9e0 0x7fc5e009be70 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00ae400 tx=0x7fc5d80115a0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.423+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/1447220423 shutdown_connections 2023-12-22T08:53:48.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.423+0000 7fc5e5d1c640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fc5cc06a430 0x7fc5cc06c8f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.423+0000 7fc5e5d1c640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5e009b9e0 0x7fc5e009be70 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.423+0000 7fc5e5d1c640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5e0099a70 0x7fc5e015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.423+0000 7fc5e5d1c640 1 --2- 172.21.15.38:0/1447220423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5c80039c0 0x7fc5e01f7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.423+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/1447220423 >> 172.21.15.38:0/1447220423 conn(0x7fc5e00b1f70 msgr2=0x7fc5e00cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:48.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.423+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/1447220423 shutdown_connections 2023-12-22T08:53:48.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.423+0000 7fc5e5d1c640 1 -- 172.21.15.38:0/1447220423 wait complete. 2023-12-22T08:53:48.443 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T08:53:48.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.662+0000 7ff728b77640 1 Processor -- start 2023-12-22T08:53:48.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.662+0000 7ff728b77640 1 -- start start 2023-12-22T08:53:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.664+0000 7ff728b77640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff724161bb0 0x7ff72415e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.664+0000 7ff728b77640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72415e630 con 0x7ff7240cb5e0 2023-12-22T08:53:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.664+0000 7ff728b77640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7241610d0 con 0x7ff72415ad90 2023-12-22T08:53:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.664+0000 7ff728b77640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7240ce2c0 con 0x7ff724161bb0 2023-12-22T08:53:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.664+0000 7ff723fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff724161bb0 0x7ff72415e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.664+0000 7ff723fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff724161bb0 0x7ff72415e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60384/0 (socket says 172.21.15.38:60384) 2023-12-22T08:53:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.664+0000 7ff722ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff7240cb5e0 0x7ff72415d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46828/0 (socket says 172.21.15.38:46828) 2023-12-22T08:53:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.664+0000 7ff723fff640 1 -- 172.21.15.38:0/3414917506 learned_addr learned my addr 172.21.15.38:0/3414917506 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.664+0000 7ff723fff640 1 -- 172.21.15.38:0/3414917506 >> v1:172.21.15.89:6789/0 conn(0x7ff72415ad90 legacy=0x7ff7240caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.665+0000 7ff723fff640 1 -- 172.21.15.38:0/3414917506 >> v1:172.21.15.38:6789/0 conn(0x7ff7240cb5e0 legacy=0x7ff72415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.665+0000 7ff723fff640 1 -- 172.21.15.38:0/3414917506 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7241613b0 con 0x7ff724161bb0 2023-12-22T08:53:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.665+0000 7ff7227fc640 1 -- 172.21.15.38:0/3414917506 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623582006 0 0) 0x7ff72415e630 con 0x7ff7240cb5e0 2023-12-22T08:53:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.666+0000 7ff723fff640 1 --2- 172.21.15.38:0/3414917506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff724161bb0 0x7ff72415e050 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009870 tx=0x7ff71c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2afec544cd248c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.666+0000 7ff7227fc640 1 -- 172.21.15.38:0/3414917506 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c02f840 con 0x7ff724161bb0 2023-12-22T08:53:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.666+0000 7ff7227fc640 1 -- 172.21.15.38:0/3414917506 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c02f9a0 con 0x7ff724161bb0 2023-12-22T08:53:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.666+0000 7ff7227fc640 1 -- 172.21.15.38:0/3414917506 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c02fd30 con 0x7ff724161bb0 2023-12-22T08:53:48.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.667+0000 7ff728b77640 1 -- 172.21.15.38:0/3414917506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff724161bb0 msgr2=0x7ff72415e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.667+0000 7ff728b77640 1 --2- 172.21.15.38:0/3414917506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff724161bb0 0x7ff72415e050 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009870 tx=0x7ff71c02ba20 comp rx=0 tx=0).stop 2023-12-22T08:53:48.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.667+0000 7ff728b77640 1 -- 172.21.15.38:0/3414917506 shutdown_connections 2023-12-22T08:53:48.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.667+0000 7ff728b77640 1 --2- 172.21.15.38:0/3414917506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff724161bb0 0x7ff72415e050 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.667+0000 7ff728b77640 1 -- 172.21.15.38:0/3414917506 >> 172.21.15.38:0/3414917506 conn(0x7ff7240d31c0 msgr2=0x7ff7240d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:48.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.667+0000 7ff728b77640 1 -- 172.21.15.38:0/3414917506 shutdown_connections 2023-12-22T08:53:48.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.667+0000 7ff728b77640 1 -- 172.21.15.38:0/3414917506 wait complete. 2023-12-22T08:53:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.669+0000 7ff728b77640 1 Processor -- start 2023-12-22T08:53:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.669+0000 7ff728b77640 1 -- start start 2023-12-22T08:53:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.670+0000 7ff728b77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7240cb5e0 0x7ff7240c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.670+0000 7ff728b77640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff72415ad90 0x7ff7240c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.670+0000 7ff728b77640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff724161bb0 0x7ff72415e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.670+0000 7ff728b77640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7241532e0 con 0x7ff72415ad90 2023-12-22T08:53:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.670+0000 7ff728b77640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240c7af0 con 0x7ff7240cb5e0 2023-12-22T08:53:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.670+0000 7ff728b77640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff724152f90 con 0x7ff724161bb0 2023-12-22T08:53:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.670+0000 7ff722ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff72415ad90 0x7ff7240c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.670+0000 7ff722ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff72415ad90 0x7ff7240c6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60388/0 (socket says 172.21.15.38:60388) 2023-12-22T08:53:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.670+0000 7ff722ffd640 1 -- 172.21.15.38:0/2793670423 learned_addr learned my addr 172.21.15.38:0/2793670423 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff723fff640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff724161bb0 0x7ff72415e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff7237fe640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7240cb5e0 0x7ff7240c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff722ffd640 1 -- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff724161bb0 msgr2=0x7ff72415e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff722ffd640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff724161bb0 0x7ff72415e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff722ffd640 1 -- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7240cb5e0 msgr2=0x7ff7240c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff722ffd640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7240cb5e0 0x7ff7240c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff722ffd640 1 -- 172.21.15.38:0/2793670423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c0094d0 con 0x7ff72415ad90 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff7237fe640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7240cb5e0 0x7ff7240c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff723fff640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff724161bb0 0x7ff72415e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff722ffd640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff72415ad90 0x7ff7240c6060 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00c4a0 tx=0x7ff70c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff71bfff640 1 -- 172.21.15.38:0/2793670423 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0074e0 con 0x7ff72415ad90 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff71bfff640 1 -- 172.21.15.38:0/2793670423 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c007640 con 0x7ff72415ad90 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff71bfff640 1 -- 172.21.15.38:0/2793670423 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c004a00 con 0x7ff72415ad90 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.671+0000 7ff728b77640 1 -- 172.21.15.38:0/2793670423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7240c65a0 con 0x7ff72415ad90 2023-12-22T08:53:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.672+0000 7ff728b77640 1 -- 172.21.15.38:0/2793670423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72415f5b0 con 0x7ff72415ad90 2023-12-22T08:53:48.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.673+0000 7ff728b77640 1 -- 172.21.15.38:0/2793670423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff724061910 con 0x7ff72415ad90 2023-12-22T08:53:48.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.674+0000 7ff71bfff640 1 -- 172.21.15.38:0/2793670423 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff70c004b60 con 0x7ff72415ad90 2023-12-22T08:53:48.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.675+0000 7ff71bfff640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff70406a460 0x7ff70406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:48.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.675+0000 7ff71bfff640 1 -- 172.21.15.38:0/2793670423 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff70c087ae0 con 0x7ff72415ad90 2023-12-22T08:53:48.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.675+0000 7ff71bfff640 1 -- 172.21.15.38:0/2793670423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7ff704071f90 con 0x7ff72415ad90 2023-12-22T08:53:48.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.676+0000 7ff7237fe640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff70406a460 0x7ff70406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.677+0000 7ff7237fe640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff70406a460 0x7ff70406c920 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff7140012e0 tx=0x7ff714009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:48.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.679+0000 7ff71bfff640 1 -- 172.21.15.38:0/2793670423 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff70c018020 con 0x7ff72415ad90 2023-12-22T08:53:48.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.917+0000 7ff728b77640 1 -- 172.21.15.38:0/2793670423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff7240c6ad0 con 0x7ff72415ad90 2023-12-22T08:53:48.920 INFO:tasks.ceph.mon.a.smithi038.stderr:2023-12-22T08:53:48.919+0000 7f0a26ee3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T08:53:48.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.928+0000 7ff71bfff640 1 -- 172.21.15.38:0/2793670423 <== mon.0 v2:172.21.15.38:3300/0 7 ==== osd_map(195..195 src has 1..195) v4 ==== 374+0+0 (secure 0 0 0) 0x7ff70c089e40 con 0x7ff72415ad90 2023-12-22T08:53:48.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.928+0000 7ff71bfff640 1 -- 172.21.15.38:0/2793670423 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7ff704072840 con 0x7ff72415ad90 2023-12-22T08:53:48.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.939+0000 7ff71bfff640 1 -- 172.21.15.38:0/2793670423 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff70c053030 con 0x7ff72415ad90 2023-12-22T08:53:48.940 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T08:53:48.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.942+0000 7ff728b77640 1 -- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff70406a460 msgr2=0x7ff70406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.942+0000 7ff728b77640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff70406a460 0x7ff70406c920 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff7140012e0 tx=0x7ff714009040 comp rx=0 tx=0).stop 2023-12-22T08:53:48.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.942+0000 7ff728b77640 1 -- 172.21.15.38:0/2793670423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff72415ad90 msgr2=0x7ff7240c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:48.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.942+0000 7ff728b77640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff72415ad90 0x7ff7240c6060 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00c4a0 tx=0x7ff70c00c960 comp rx=0 tx=0).stop 2023-12-22T08:53:48.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.942+0000 7ff728b77640 1 -- 172.21.15.38:0/2793670423 shutdown_connections 2023-12-22T08:53:48.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.942+0000 7ff728b77640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff724161bb0 0x7ff72415e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.942+0000 7ff728b77640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff70406a460 0x7ff70406c920 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.942+0000 7ff728b77640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff72415ad90 0x7ff7240c6060 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.942+0000 7ff728b77640 1 --2- 172.21.15.38:0/2793670423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7240cb5e0 0x7ff7240c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:48.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.942+0000 7ff728b77640 1 -- 172.21.15.38:0/2793670423 >> 172.21.15.38:0/2793670423 conn(0x7ff7240d31c0 msgr2=0x7ff7240d35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:48.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.942+0000 7ff728b77640 1 -- 172.21.15.38:0/2793670423 shutdown_connections 2023-12-22T08:53:48.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:48.943+0000 7ff728b77640 1 -- 172.21.15.38:0/2793670423 wait complete. 2023-12-22T08:53:48.950 INFO:tasks.ceph.mds.c.smithi038.stderr: -9098> 2023-12-22T08:53:08.887+0000 7f59c1137640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:53:48.964 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T08:53:49.008 INFO:tasks.ceph.mds.c.smithi038.stdout:starting mds.c at 2023-12-22T08:53:49.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.158+0000 7fb3adc41640 1 Processor -- start 2023-12-22T08:53:49.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.159+0000 7fb3adc41640 1 -- start start 2023-12-22T08:53:49.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.160+0000 7fb3adc41640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a80ce910 0x7fb3a8166100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:49.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.160+0000 7fb3adc41640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a806c1e0 con 0x7fb3a815b7b0 2023-12-22T08:53:49.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.160+0000 7fb3adc41640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a80cd620 con 0x7fb3a815b3d0 2023-12-22T08:53:49.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.160+0000 7fb3adc41640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a8070100 con 0x7fb3a80ce910 2023-12-22T08:53:49.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.161+0000 7fb3a6ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb3a815b7b0 0x7fb3a80ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:46832/0 (socket says 172.21.15.38:46832) 2023-12-22T08:53:49.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.161+0000 7fb3a6ffd640 1 -- 172.21.15.38:0/2210385324 learned_addr learned my addr 172.21.15.38:0/2210385324 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.161+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497401691 0 0) 0x7fb3a806c1e0 con 0x7fb3a815b7b0 2023-12-22T08:53:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.161+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb394003520 con 0x7fb3a815b7b0 2023-12-22T08:53:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.161+0000 7fb3a7fff640 1 --2- 172.21.15.38:0/2210385324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a80ce910 0x7fb3a8166100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3157018685 0 0) 0x7fb394003520 con 0x7fb3a815b7b0 2023-12-22T08:53:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a80ce910 msgr2=0x7fb3a8166100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a67fc640 1 --2- 172.21.15.38:0/2210385324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a80ce910 0x7fb3a8166100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 >> v1:172.21.15.89:6789/0 conn(0x7fb3a815b3d0 legacy=0x7fb3a80ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80cd900 con 0x7fb3a815b7b0 2023-12-22T08:53:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fb390001810 con 0x7fb3a815b7b0 2023-12-22T08:53:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 >> v1:172.21.15.38:6789/0 conn(0x7fb3a815b7b0 legacy=0x7fb3a80ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a67fc640 1 --2- 172.21.15.38:0/2210385324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3940039a0 0x7fb394003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:49.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a67fc640 1 --2- 172.21.15.38:0/2210385324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3940047c0 0x7fb394004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a67fc640 1 --2- 172.21.15.38:0/2210385324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a80ce910 0x7fb39400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a8070100 con 0x7fb3940039a0 2023-12-22T08:53:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb394005530 con 0x7fb3940047c0 2023-12-22T08:53:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39400bec0 con 0x7fb3a80ce910 2023-12-22T08:53:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a77fe640 1 --2- 172.21.15.38:0/2210385324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3940039a0 0x7fb394003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.162+0000 7fb3a7fff640 1 --2- 172.21.15.38:0/2210385324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a80ce910 0x7fb39400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.163+0000 7fb3a6ffd640 1 --2- 172.21.15.38:0/2210385324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3940047c0 0x7fb394004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.163+0000 7fb3a77fe640 1 -- 172.21.15.38:0/2210385324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a80ce910 msgr2=0x7fb39400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.163+0000 7fb3a77fe640 1 --2- 172.21.15.38:0/2210385324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a80ce910 0x7fb39400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.163+0000 7fb3a77fe640 1 -- 172.21.15.38:0/2210385324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3940047c0 msgr2=0x7fb394004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.163+0000 7fb3a77fe640 1 --2- 172.21.15.38:0/2210385324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3940047c0 0x7fb394004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.163+0000 7fb3a77fe640 1 -- 172.21.15.38:0/2210385324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb394003520 con 0x7fb3940039a0 2023-12-22T08:53:49.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.163+0000 7fb3a6ffd640 1 --2- 172.21.15.38:0/2210385324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3940047c0 0x7fb394004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.164+0000 7fb3a77fe640 1 --2- 172.21.15.38:0/2210385324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3940039a0 0x7fb394003dc0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fb398001e50 tx=0x7fb3940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77548bb941f212c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.164+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb398003b70 con 0x7fb3940039a0 2023-12-22T08:53:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.164+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb398003cd0 con 0x7fb3940039a0 2023-12-22T08:53:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.164+0000 7fb3a67fc640 1 -- 172.21.15.38:0/2210385324 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb398005310 con 0x7fb3940039a0 2023-12-22T08:53:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.165+0000 7fb3adc41640 1 -- 172.21.15.38:0/2210385324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3940039a0 msgr2=0x7fb394003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.165+0000 7fb3adc41640 1 --2- 172.21.15.38:0/2210385324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3940039a0 0x7fb394003dc0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fb398001e50 tx=0x7fb3940057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.165+0000 7fb3a7fff640 1 -- 172.21.15.38:0/2210385324 reap_dead start 2023-12-22T08:53:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.165+0000 7fb3adc41640 1 -- 172.21.15.38:0/2210385324 shutdown_connections 2023-12-22T08:53:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.165+0000 7fb3adc41640 1 -- 172.21.15.38:0/2210385324 >> 172.21.15.38:0/2210385324 conn(0x7fb3a80cba10 msgr2=0x7fb3a80cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.165+0000 7fb3adc41640 1 -- 172.21.15.38:0/2210385324 shutdown_connections 2023-12-22T08:53:49.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.165+0000 7fb3adc41640 1 -- 172.21.15.38:0/2210385324 wait complete. 2023-12-22T08:53:49.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.167+0000 7fb3adc41640 1 Processor -- start 2023-12-22T08:53:49.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.167+0000 7fb3adc41640 1 -- start start 2023-12-22T08:53:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.168+0000 7fb3adc41640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3940039a0 0x7fb3a806d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.168+0000 7fb3adc41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3a80caf50 0x7fb3a8148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.168+0000 7fb3adc41640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a814fb90 0x7fb3a8148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.168+0000 7fb3adc41640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80c70c0 con 0x7fb3940039a0 2023-12-22T08:53:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.168+0000 7fb3adc41640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80c73a0 con 0x7fb3a80caf50 2023-12-22T08:53:49.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.168+0000 7fb3adc41640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80c7680 con 0x7fb3a814fb90 2023-12-22T08:53:49.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.169+0000 7fb3a77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3940039a0 0x7fb3a806d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:49.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.169+0000 7fb3a77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3940039a0 0x7fb3a806d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60422/0 (socket says 172.21.15.38:60422) 2023-12-22T08:53:49.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.169+0000 7fb3a77fe640 1 -- 172.21.15.38:0/483487184 learned_addr learned my addr 172.21.15.38:0/483487184 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.169+0000 7fb3a77fe640 1 -- 172.21.15.38:0/483487184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a814fb90 msgr2=0x7fb3a8148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.169+0000 7fb3a77fe640 1 --2- 172.21.15.38:0/483487184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a814fb90 0x7fb3a8148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.169+0000 7fb3a77fe640 1 -- 172.21.15.38:0/483487184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3a80caf50 msgr2=0x7fb3a8148730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.169+0000 7fb3a77fe640 1 --2- 172.21.15.38:0/483487184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3a80caf50 0x7fb3a8148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.169+0000 7fb3a77fe640 1 -- 172.21.15.38:0/483487184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80c7960 con 0x7fb3940039a0 2023-12-22T08:53:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.169+0000 7fb3a77fe640 1 --2- 172.21.15.38:0/483487184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3940039a0 0x7fb3a806d5e0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fb39802bf90 tx=0x7fb3980014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.170+0000 7fb39ffff640 1 -- 172.21.15.38:0/483487184 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39803e070 con 0x7fb3940039a0 2023-12-22T08:53:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.170+0000 7fb39ffff640 1 -- 172.21.15.38:0/483487184 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb398006b50 con 0x7fb3940039a0 2023-12-22T08:53:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.170+0000 7fb3adc41640 1 -- 172.21.15.38:0/483487184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a80c7e80 con 0x7fb3940039a0 2023-12-22T08:53:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.170+0000 7fb39ffff640 1 -- 172.21.15.38:0/483487184 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb398007030 con 0x7fb3940039a0 2023-12-22T08:53:49.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.170+0000 7fb3adc41640 1 -- 172.21.15.38:0/483487184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a806db20 con 0x7fb3940039a0 2023-12-22T08:53:49.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.171+0000 7fb3adc41640 1 -- 172.21.15.38:0/483487184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a806dd10 con 0x7fb3940039a0 2023-12-22T08:53:49.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.172+0000 7fb39ffff640 1 -- 172.21.15.38:0/483487184 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb398007190 con 0x7fb3940039a0 2023-12-22T08:53:49.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.173+0000 7fb39ffff640 1 --2- 172.21.15.38:0/483487184 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb38806a460 0x7fb38806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:49.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.173+0000 7fb39ffff640 1 -- 172.21.15.38:0/483487184 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb3980aa5c0 con 0x7fb3940039a0 2023-12-22T08:53:49.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.173+0000 7fb39ffff640 1 -- 172.21.15.38:0/483487184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7fb3880720a0 con 0x7fb3940039a0 2023-12-22T08:53:49.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.174+0000 7fb3a6ffd640 1 --2- 172.21.15.38:0/483487184 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb38806a460 0x7fb38806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:49.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.175+0000 7fb3a6ffd640 1 --2- 172.21.15.38:0/483487184 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb38806a460 0x7fb38806c920 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb390000ef0 tx=0x7fb390009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:49.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.177+0000 7fb39ffff640 1 -- 172.21.15.38:0/483487184 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb398075ab0 con 0x7fb3940039a0 2023-12-22T08:53:49.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.412+0000 7fb3adc41640 1 -- 172.21.15.38:0/483487184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb3a80cb5c0 con 0x7fb3940039a0 2023-12-22T08:53:49.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.945+0000 7fb39ffff640 1 -- 172.21.15.38:0/483487184 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v88) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb3a80cb5c0 con 0x7fb3940039a0 2023-12-22T08:53:49.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.949+0000 7fb3adc41640 1 -- 172.21.15.38:0/483487184 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb38806a460 msgr2=0x7fb38806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:49.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.949+0000 7fb3adc41640 1 --2- 172.21.15.38:0/483487184 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb38806a460 0x7fb38806c920 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb390000ef0 tx=0x7fb390009040 comp rx=0 tx=0).stop 2023-12-22T08:53:49.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.949+0000 7fb3adc41640 1 -- 172.21.15.38:0/483487184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3940039a0 msgr2=0x7fb3a806d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:49.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.949+0000 7fb3adc41640 1 --2- 172.21.15.38:0/483487184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3940039a0 0x7fb3a806d5e0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fb39802bf90 tx=0x7fb3980014a0 comp rx=0 tx=0).stop 2023-12-22T08:53:49.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.949+0000 7fb3adc41640 1 -- 172.21.15.38:0/483487184 shutdown_connections 2023-12-22T08:53:49.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.949+0000 7fb3adc41640 1 --2- 172.21.15.38:0/483487184 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3a814fb90 0x7fb3a8148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.949+0000 7fb3adc41640 1 --2- 172.21.15.38:0/483487184 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3a80caf50 0x7fb3a8148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.949+0000 7fb3adc41640 1 --2- 172.21.15.38:0/483487184 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb38806a460 0x7fb38806c920 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.949+0000 7fb3adc41640 1 --2- 172.21.15.38:0/483487184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3940039a0 0x7fb3a806d5e0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.949+0000 7fb3adc41640 1 -- 172.21.15.38:0/483487184 >> 172.21.15.38:0/483487184 conn(0x7fb3a80cba10 msgr2=0x7fb3a80659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.949+0000 7fb3adc41640 1 -- 172.21.15.38:0/483487184 shutdown_connections 2023-12-22T08:53:49.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:49.949+0000 7fb3adc41640 1 -- 172.21.15.38:0/483487184 wait complete. 2023-12-22T08:53:49.971 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T08:53:50.095 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:53:50.102 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:53:50.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.238+0000 7ff914641640 1 Processor -- start 2023-12-22T08:53:50.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.238+0000 7ff914641640 1 -- start start 2023-12-22T08:53:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.240+0000 7ff914641640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff90c15aee0 0x7ff90c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.240+0000 7ff914641640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff90c15dbe0 0x7ff90c0b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.240+0000 7ff914641640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff90c0b36a0 con 0x7ff90c15b2c0 2023-12-22T08:53:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.240+0000 7ff914641640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff90c0b3a40 con 0x7ff90c15dbe0 2023-12-22T08:53:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.240+0000 7ff914641640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff90c0b4570 con 0x7ff90c15aee0 2023-12-22T08:53:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.240+0000 7ff912bde640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff90c15dbe0 0x7ff90c0b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.240+0000 7ff912bde640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff90c15dbe0 0x7ff90c0b8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60436/0 (socket says 172.21.15.38:60436) 2023-12-22T08:53:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.240+0000 7ff912bde640 1 -- 172.21.15.38:0/3660479869 learned_addr learned my addr 172.21.15.38:0/3660479869 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.241+0000 7ff912bde640 1 -- 172.21.15.38:0/3660479869 >> v2:172.21.15.89:3300/0 conn(0x7ff90c15aee0 msgr2=0x7ff90c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.241+0000 7ff9123dd640 1 --2- 172.21.15.38:0/3660479869 >> v2:172.21.15.89:3300/0 conn(0x7ff90c15aee0 0x7ff90c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.241+0000 7ff912bde640 1 --2- 172.21.15.38:0/3660479869 >> v2:172.21.15.89:3300/0 conn(0x7ff90c15aee0 0x7ff90c0b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.241+0000 7ff912bde640 1 -- 172.21.15.38:0/3660479869 >> v1:172.21.15.89:6789/0 conn(0x7ff90c15b2c0 legacy=0x7ff90c0b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:50.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.241+0000 7ff912bde640 1 -- 172.21.15.38:0/3660479869 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c0b56e0 con 0x7ff90c15dbe0 2023-12-22T08:53:50.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.242+0000 7ff912bde640 1 --2- 172.21.15.38:0/3660479869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff90c15dbe0 0x7ff90c0b8a00 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0d2e10 tx=0x7ff90402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2954e7b66545483 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:50.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.243+0000 7ff9113db640 1 -- 172.21.15.38:0/3660479869 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff904031870 con 0x7ff90c15dbe0 2023-12-22T08:53:50.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.243+0000 7ff9113db640 1 -- 172.21.15.38:0/3660479869 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9040319d0 con 0x7ff90c15dbe0 2023-12-22T08:53:50.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.243+0000 7ff9113db640 1 -- 172.21.15.38:0/3660479869 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff904031d60 con 0x7ff90c15dbe0 2023-12-22T08:53:50.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.243+0000 7ff914641640 1 -- 172.21.15.38:0/3660479869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff90c15dbe0 msgr2=0x7ff90c0b8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:50.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.243+0000 7ff914641640 1 --2- 172.21.15.38:0/3660479869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff90c15dbe0 0x7ff90c0b8a00 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0d2e10 tx=0x7ff90402b910 comp rx=0 tx=0).stop 2023-12-22T08:53:50.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.244+0000 7ff914641640 1 -- 172.21.15.38:0/3660479869 shutdown_connections 2023-12-22T08:53:50.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.244+0000 7ff914641640 1 --2- 172.21.15.38:0/3660479869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff90c15dbe0 0x7ff90c0b8a00 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:50.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.244+0000 7ff914641640 1 --2- 172.21.15.38:0/3660479869 >> v2:172.21.15.89:3300/0 conn(0x7ff90c15aee0 0x7ff90c0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:50.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.244+0000 7ff914641640 1 -- 172.21.15.38:0/3660479869 >> 172.21.15.38:0/3660479869 conn(0x7ff90c070770 msgr2=0x7ff90c070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:50.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.244+0000 7ff914641640 1 -- 172.21.15.38:0/3660479869 shutdown_connections 2023-12-22T08:53:50.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.244+0000 7ff914641640 1 -- 172.21.15.38:0/3660479869 wait complete. 2023-12-22T08:53:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.245+0000 7ff914641640 1 Processor -- start 2023-12-22T08:53:50.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.246+0000 7ff914641640 1 -- start start 2023-12-22T08:53:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.246+0000 7ff914641640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff90c15aee0 0x7ff90c148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.246+0000 7ff914641640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff90c15dbe0 0x7ff90c14b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff914641640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff90c0ada30 0x7ff90c1f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff914641640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c1f6fa0 con 0x7ff90c0ada30 2023-12-22T08:53:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff914641640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c1489a0 con 0x7ff90c15dbe0 2023-12-22T08:53:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff914641640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c1f69e0 con 0x7ff90c15aee0 2023-12-22T08:53:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff912bde640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff90c0ada30 0x7ff90c1f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff912bde640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff90c0ada30 0x7ff90c1f6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60444/0 (socket says 172.21.15.38:60444) 2023-12-22T08:53:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff912bde640 1 -- 172.21.15.38:0/3301459879 learned_addr learned my addr 172.21.15.38:0/3301459879 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:50.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff911bdc640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff90c15dbe0 0x7ff90c14b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:50.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff9123dd640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff90c15aee0 0x7ff90c148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:50.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff912bde640 1 -- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff90c15aee0 msgr2=0x7ff90c148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:50.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff912bde640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff90c15aee0 0x7ff90c148460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:50.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff912bde640 1 -- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff90c15dbe0 msgr2=0x7ff90c14b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:50.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff912bde640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff90c15dbe0 0x7ff90c14b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:50.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff912bde640 1 -- 172.21.15.38:0/3301459879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9040094d0 con 0x7ff90c0ada30 2023-12-22T08:53:50.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.247+0000 7ff911bdc640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff90c15dbe0 0x7ff90c14b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:50.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.248+0000 7ff912bde640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff90c0ada30 0x7ff90c1f6000 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7ff90402b950 tx=0x7ff9040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:50.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.248+0000 7ff90affd640 1 -- 172.21.15.38:0/3301459879 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff904031800 con 0x7ff90c0ada30 2023-12-22T08:53:50.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.248+0000 7ff90affd640 1 -- 172.21.15.38:0/3301459879 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9040443f0 con 0x7ff90c0ada30 2023-12-22T08:53:50.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.248+0000 7ff90affd640 1 -- 172.21.15.38:0/3301459879 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9040447a0 con 0x7ff90c0ada30 2023-12-22T08:53:50.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.248+0000 7ff914641640 1 -- 172.21.15.38:0/3301459879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90c1f6cc0 con 0x7ff90c0ada30 2023-12-22T08:53:50.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.248+0000 7ff914641640 1 -- 172.21.15.38:0/3301459879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90c14b0f0 con 0x7ff90c0ada30 2023-12-22T08:53:50.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.249+0000 7ff914641640 1 -- 172.21.15.38:0/3301459879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90c14b310 con 0x7ff90c0ada30 2023-12-22T08:53:50.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.250+0000 7ff90affd640 1 -- 172.21.15.38:0/3301459879 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff904044900 con 0x7ff90c0ada30 2023-12-22T08:53:50.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.251+0000 7ff90affd640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff8f806a430 0x7ff8f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:50.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.251+0000 7ff90affd640 1 -- 172.21.15.38:0/3301459879 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff90402d040 con 0x7ff90c0ada30 2023-12-22T08:53:50.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.252+0000 7ff90affd640 1 -- 172.21.15.38:0/3301459879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7ff8f8072070 con 0x7ff90c0ada30 2023-12-22T08:53:50.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.252+0000 7ff9123dd640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff8f806a430 0x7ff8f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:50.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.253+0000 7ff9123dd640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff8f806a430 0x7ff8f806c8f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc008ef0 tx=0x7ff8fc008440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:50.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.255+0000 7ff90affd640 1 -- 172.21.15.38:0/3301459879 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff904052060 con 0x7ff90c0ada30 2023-12-22T08:53:50.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.447+0000 7ff914641640 1 -- 172.21.15.38:0/3301459879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff90c061910 con 0x7ff90c0ada30 2023-12-22T08:53:50.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.964+0000 7ff90affd640 1 -- 172.21.15.38:0/3301459879 <== mon.0 v2:172.21.15.38:3300/0 7 ==== osd_map(196..196 src has 1..196) v4 ==== 354+0+0 (secure 0 0 0) 0x7ff90407a890 con 0x7ff90c0ada30 2023-12-22T08:53:50.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.964+0000 7ff90affd640 1 -- 172.21.15.38:0/3301459879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7ff8f80704a0 con 0x7ff90c0ada30 2023-12-22T08:53:50.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.966+0000 7ff90affd640 1 -- 172.21.15.38:0/3301459879 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v196) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff90407a660 con 0x7ff90c0ada30 2023-12-22T08:53:50.967 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2023-12-22T08:53:50.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.973+0000 7ff914641640 1 -- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff8f806a430 msgr2=0x7ff8f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:50.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.973+0000 7ff914641640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff8f806a430 0x7ff8f806c8f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc008ef0 tx=0x7ff8fc008440 comp rx=0 tx=0).stop 2023-12-22T08:53:50.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.973+0000 7ff914641640 1 -- 172.21.15.38:0/3301459879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff90c0ada30 msgr2=0x7ff90c1f6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:50.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.973+0000 7ff914641640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff90c0ada30 0x7ff90c1f6000 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7ff90402b950 tx=0x7ff9040046c0 comp rx=0 tx=0).stop 2023-12-22T08:53:50.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.973+0000 7ff914641640 1 -- 172.21.15.38:0/3301459879 shutdown_connections 2023-12-22T08:53:50.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.973+0000 7ff914641640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ff8f806a430 0x7ff8f806c8f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:50.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.973+0000 7ff914641640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff90c0ada30 0x7ff90c1f6000 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:50.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.973+0000 7ff914641640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff90c15dbe0 0x7ff90c14b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:50.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.973+0000 7ff914641640 1 --2- 172.21.15.38:0/3301459879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff90c15aee0 0x7ff90c148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:50.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.973+0000 7ff914641640 1 -- 172.21.15.38:0/3301459879 >> 172.21.15.38:0/3301459879 conn(0x7ff90c070770 msgr2=0x7ff90c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:50.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.973+0000 7ff914641640 1 -- 172.21.15.38:0/3301459879 shutdown_connections 2023-12-22T08:53:50.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:50.973+0000 7ff914641640 1 -- 172.21.15.38:0/3301459879 wait complete. 2023-12-22T08:53:50.996 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T08:53:51.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.269+0000 7f6acb8ca640 1 Processor -- start 2023-12-22T08:53:51.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.270+0000 7f6acb8ca640 1 -- start start 2023-12-22T08:53:51.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.271+0000 7f6acb8ca640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ac40b2050 0x7f6ac40b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:51.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.271+0000 7f6acb8ca640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6ac4070800 0x7f6ac4070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:51.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.271+0000 7f6acb8ca640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac41450f0 con 0x7f6ac4144d10 2023-12-22T08:53:51.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.271+0000 7f6acb8ca640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac40cc840 con 0x7f6ac40b2050 2023-12-22T08:53:51.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.271+0000 7f6acb8ca640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac40ce010 con 0x7f6ac4070800 2023-12-22T08:53:51.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.272+0000 7f6ac8e65640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ac40b2050 0x7f6ac40b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:51.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.272+0000 7f6ac9666640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6ac4144d10 0x7f6ac40cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58400/0 (socket says 172.21.15.38:58400) 2023-12-22T08:53:51.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.272+0000 7f6ac9666640 1 -- 172.21.15.38:0/854813869 learned_addr learned my addr 172.21.15.38:0/854813869 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:51.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.272+0000 7f6ac9e67640 1 --2- 172.21.15.38:0/854813869 >> v2:172.21.15.89:3300/0 conn(0x7f6ac4070800 0x7f6ac4070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:51.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.272+0000 7f6ac8e65640 1 -- 172.21.15.38:0/854813869 >> v2:172.21.15.89:3300/0 conn(0x7f6ac4070800 msgr2=0x7f6ac4070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:51.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.272+0000 7f6ac8e65640 1 --2- 172.21.15.38:0/854813869 >> v2:172.21.15.89:3300/0 conn(0x7f6ac4070800 0x7f6ac4070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:51.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.272+0000 7f6ac8e65640 1 -- 172.21.15.38:0/854813869 >> v1:172.21.15.38:6789/0 conn(0x7f6ac4144d10 legacy=0x7f6ac40cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:51.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.272+0000 7f6ac8e65640 1 -- 172.21.15.38:0/854813869 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac40b29f0 con 0x7f6ac40b2050 2023-12-22T08:53:51.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.272+0000 7f6ac3fff640 1 -- 172.21.15.38:0/854813869 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326313521 0 0) 0x7f6ac41450f0 con 0x7f6ac4144d10 2023-12-22T08:53:51.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.273+0000 7f6ac8e65640 1 --2- 172.21.15.38:0/854813869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac40b2050 0x7f6ac40b24b0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f6ac406e740 tx=0x7f6ab802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f322a697070819 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:51.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.274+0000 7f6ac3fff640 1 -- 172.21.15.38:0/854813869 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8031830 con 0x7f6ac40b2050 2023-12-22T08:53:51.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.274+0000 7f6ac3fff640 1 -- 172.21.15.38:0/854813869 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab8031990 con 0x7f6ac40b2050 2023-12-22T08:53:51.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.274+0000 7f6ac3fff640 1 -- 172.21.15.38:0/854813869 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8031d20 con 0x7f6ac40b2050 2023-12-22T08:53:51.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.274+0000 7f6acb8ca640 1 -- 172.21.15.38:0/854813869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac40b2050 msgr2=0x7f6ac40b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:51.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.274+0000 7f6acb8ca640 1 --2- 172.21.15.38:0/854813869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac40b2050 0x7f6ac40b24b0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f6ac406e740 tx=0x7f6ab802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:53:51.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.274+0000 7f6acb8ca640 1 -- 172.21.15.38:0/854813869 shutdown_connections 2023-12-22T08:53:51.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.274+0000 7f6acb8ca640 1 --2- 172.21.15.38:0/854813869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac40b2050 0x7f6ac40b24b0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:51.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.274+0000 7f6acb8ca640 1 --2- 172.21.15.38:0/854813869 >> v2:172.21.15.89:3300/0 conn(0x7f6ac4070800 0x7f6ac4070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:51.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.274+0000 7f6acb8ca640 1 -- 172.21.15.38:0/854813869 >> 172.21.15.38:0/854813869 conn(0x7f6ac40cf070 msgr2=0x7f6ac40cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:51.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.275+0000 7f6acb8ca640 1 -- 172.21.15.38:0/854813869 shutdown_connections 2023-12-22T08:53:51.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.275+0000 7f6acb8ca640 1 -- 172.21.15.38:0/854813869 wait complete. 2023-12-22T08:53:51.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.277+0000 7f6acb8ca640 1 Processor -- start 2023-12-22T08:53:51.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.277+0000 7f6acb8ca640 1 -- start start 2023-12-22T08:53:51.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.278+0000 7f6acb8ca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ac4070800 0x7f6ac4141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:51.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.278+0000 7f6acb8ca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac40b2050 0x7f6ac4142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:51.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.278+0000 7f6acb8ca640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ac4144d10 0x7f6ac4156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:51.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.278+0000 7f6acb8ca640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac4143940 con 0x7f6ac40b2050 2023-12-22T08:53:51.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.278+0000 7f6acb8ca640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac41418d0 con 0x7f6ac4070800 2023-12-22T08:53:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.278+0000 7f6acb8ca640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac4142dc0 con 0x7f6ac4144d10 2023-12-22T08:53:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.278+0000 7f6ac8e65640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac40b2050 0x7f6ac4142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.279+0000 7f6ac8e65640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac40b2050 0x7f6ac4142300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57580/0 (socket says 172.21.15.38:57580) 2023-12-22T08:53:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.279+0000 7f6ac8e65640 1 -- 172.21.15.38:0/2891532414 learned_addr learned my addr 172.21.15.38:0/2891532414 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.279+0000 7f6ac9666640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ac4070800 0x7f6ac4141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.279+0000 7f6ac8e65640 1 -- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ac4144d10 msgr2=0x7f6ac4156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.279+0000 7f6ac8e65640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ac4144d10 0x7f6ac4156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.279+0000 7f6ac8e65640 1 -- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ac4070800 msgr2=0x7f6ac4141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.279+0000 7f6ac8e65640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ac4070800 0x7f6ac4141390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.279+0000 7f6ac8e65640 1 -- 172.21.15.38:0/2891532414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8009400 con 0x7f6ac40b2050 2023-12-22T08:53:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.279+0000 7f6ac9666640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ac4070800 0x7f6ac4141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.279+0000 7f6ac8e65640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac40b2050 0x7f6ac4142300 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009890 tx=0x7f6ab80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.280+0000 7f6ac1ffb640 1 -- 172.21.15.38:0/2891532414 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab803ba70 con 0x7f6ac40b2050 2023-12-22T08:53:51.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.280+0000 7f6ac1ffb640 1 -- 172.21.15.38:0/2891532414 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab803bbf0 con 0x7f6ac40b2050 2023-12-22T08:53:51.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.280+0000 7f6ac1ffb640 1 -- 172.21.15.38:0/2891532414 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8045400 con 0x7f6ac40b2050 2023-12-22T08:53:51.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.280+0000 7f6acb8ca640 1 -- 172.21.15.38:0/2891532414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac41430a0 con 0x7f6ac40b2050 2023-12-22T08:53:51.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.280+0000 7f6acb8ca640 1 -- 172.21.15.38:0/2891532414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac4143660 con 0x7f6ac40b2050 2023-12-22T08:53:51.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.281+0000 7f6acb8ca640 1 -- 172.21.15.38:0/2891532414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac4061910 con 0x7f6ac40b2050 2023-12-22T08:53:51.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.282+0000 7f6ac1ffb640 1 -- 172.21.15.38:0/2891532414 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ab804e440 con 0x7f6ac40b2050 2023-12-22T08:53:51.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.283+0000 7f6ac1ffb640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ab006a430 0x7f6ab006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:51.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.283+0000 7f6ac1ffb640 1 -- 172.21.15.38:0/2891532414 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f6ab80aac30 con 0x7f6ac40b2050 2023-12-22T08:53:51.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.283+0000 7f6ac1ffb640 1 -- 172.21.15.38:0/2891532414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7f6ab00712c0 con 0x7f6ac40b2050 2023-12-22T08:53:51.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.284+0000 7f6ac9666640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ab006a430 0x7f6ab006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:51.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.285+0000 7f6ac9666640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ab006a430 0x7f6ab006c8f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4007fd0 tx=0x7f6ab4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:51.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.287+0000 7f6ac1ffb640 1 -- 172.21.15.38:0/2891532414 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6ab80762a0 con 0x7f6ac40b2050 2023-12-22T08:53:51.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.472+0000 7f6acb8ca640 1 -- 172.21.15.38:0/2891532414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ac415fee0 con 0x7f6ac40b2050 2023-12-22T08:53:51.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.974+0000 7f6ac1ffb640 1 -- 172.21.15.38:0/2891532414 <== mon.0 v2:172.21.15.38:3300/0 7 ==== osd_map(197..197 src has 1..197) v4 ==== 346+0+0 (secure 0 0 0) 0x7f6ab8079f60 con 0x7f6ac40b2050 2023-12-22T08:53:51.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.974+0000 7f6ac1ffb640 1 -- 172.21.15.38:0/2891532414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=198}) v3 -- 0x7f6ab0070050 con 0x7f6ac40b2050 2023-12-22T08:53:51.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.979+0000 7f6ac1ffb640 1 -- 172.21.15.38:0/2891532414 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v197) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6ab8035030 con 0x7f6ac40b2050 2023-12-22T08:53:51.984 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2023-12-22T08:53:51.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.990+0000 7f6acb8ca640 1 -- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ab006a430 msgr2=0x7f6ab006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:51.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.990+0000 7f6acb8ca640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ab006a430 0x7f6ab006c8f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4007fd0 tx=0x7f6ab4009040 comp rx=0 tx=0).stop 2023-12-22T08:53:51.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.990+0000 7f6acb8ca640 1 -- 172.21.15.38:0/2891532414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac40b2050 msgr2=0x7f6ac4142300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:51.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.990+0000 7f6acb8ca640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac40b2050 0x7f6ac4142300 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009890 tx=0x7f6ab80046c0 comp rx=0 tx=0).stop 2023-12-22T08:53:51.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.990+0000 7f6acb8ca640 1 -- 172.21.15.38:0/2891532414 shutdown_connections 2023-12-22T08:53:51.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.990+0000 7f6acb8ca640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ac4144d10 0x7f6ac4156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:51.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.990+0000 7f6acb8ca640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ab006a430 0x7f6ab006c8f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:51.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.990+0000 7f6acb8ca640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac40b2050 0x7f6ac4142300 secure :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009890 tx=0x7f6ab80046c0 comp rx=0 tx=0).stop 2023-12-22T08:53:51.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.990+0000 7f6acb8ca640 1 --2- 172.21.15.38:0/2891532414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ac4070800 0x7f6ac4141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:51.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.990+0000 7f6acb8ca640 1 -- 172.21.15.38:0/2891532414 >> 172.21.15.38:0/2891532414 conn(0x7f6ac40cf070 msgr2=0x7f6ac415b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:51.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.991+0000 7f6acb8ca640 1 -- 172.21.15.38:0/2891532414 shutdown_connections 2023-12-22T08:53:51.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:51.991+0000 7f6acb8ca640 1 -- 172.21.15.38:0/2891532414 wait complete. 2023-12-22T08:53:52.014 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-22T08:53:52.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.221+0000 7f4fb341a640 1 Processor -- start 2023-12-22T08:53:52.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.221+0000 7f4fb341a640 1 -- start start 2023-12-22T08:53:52.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.223+0000 7f4fb341a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4fac15b7b0 0x7f4fac0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:52.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.223+0000 7f4fb341a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fac0ce740 0x7f4fac070520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:52.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.223+0000 7f4fb341a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fac0ceb90 con 0x7f4fac15b3d0 2023-12-22T08:53:52.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.223+0000 7f4fb341a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fac070100 con 0x7f4fac15b7b0 2023-12-22T08:53:52.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.223+0000 7f4fb341a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac06c1e0 con 0x7f4fac0ce740 2023-12-22T08:53:52.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.224+0000 7f4fb11b6640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4fac15b3d0 0x7f4fac0ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58404/0 (socket says 172.21.15.38:58404) 2023-12-22T08:53:52.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.224+0000 7f4fb11b6640 1 -- 172.21.15.38:0/4088677495 learned_addr learned my addr 172.21.15.38:0/4088677495 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:52.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.224+0000 7f4fb09b5640 1 --2- 172.21.15.38:0/4088677495 >> v2:172.21.15.38:3300/0 conn(0x7f4fac15b7b0 0x7f4fac0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:52.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.224+0000 7f4fb19b7640 1 --2- 172.21.15.38:0/4088677495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fac0ce740 0x7f4fac070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:52.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.224+0000 7f4fa3fff640 1 -- 172.21.15.38:0/4088677495 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020570436 0 0) 0x7f4fa8001110 con 0x7f4fac15b3d0 2023-12-22T08:53:52.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.224+0000 7f4fa3fff640 1 -- 172.21.15.38:0/4088677495 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f98003520 con 0x7f4fac15b3d0 2023-12-22T08:53:52.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.224+0000 7f4fb09b5640 1 -- 172.21.15.38:0/4088677495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fac0ce740 msgr2=0x7f4fac070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:52.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.224+0000 7f4fb09b5640 1 --2- 172.21.15.38:0/4088677495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fac0ce740 0x7f4fac070520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:52.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.224+0000 7f4fb09b5640 1 -- 172.21.15.38:0/4088677495 >> v1:172.21.15.38:6789/0 conn(0x7f4fac15b3d0 legacy=0x7f4fac0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:52.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.224+0000 7f4fb09b5640 1 -- 172.21.15.38:0/4088677495 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac0cd620 con 0x7f4fac15b7b0 2023-12-22T08:53:52.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.225+0000 7f4fb09b5640 1 --2- 172.21.15.38:0/4088677495 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fac15b7b0 0x7f4fac0ce200 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009790 tx=0x7f4f9c02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e6bc9589345f59 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:52.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.226+0000 7f4fa3fff640 1 -- 172.21.15.38:0/4088677495 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c0316f0 con 0x7f4fac15b7b0 2023-12-22T08:53:52.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.226+0000 7f4fa3fff640 1 -- 172.21.15.38:0/4088677495 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c031850 con 0x7f4fac15b7b0 2023-12-22T08:53:52.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.226+0000 7f4fa3fff640 1 -- 172.21.15.38:0/4088677495 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c031be0 con 0x7f4fac15b7b0 2023-12-22T08:53:52.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.226+0000 7f4fb341a640 1 -- 172.21.15.38:0/4088677495 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fac15b7b0 msgr2=0x7f4fac0ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:52.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.226+0000 7f4fb341a640 1 --2- 172.21.15.38:0/4088677495 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fac15b7b0 0x7f4fac0ce200 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009790 tx=0x7f4f9c02b790 comp rx=0 tx=0).stop 2023-12-22T08:53:52.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.227+0000 7f4fb341a640 1 -- 172.21.15.38:0/4088677495 shutdown_connections 2023-12-22T08:53:52.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.227+0000 7f4fb341a640 1 --2- 172.21.15.38:0/4088677495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fac0ce740 0x7f4fac070520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:52.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.227+0000 7f4fb341a640 1 --2- 172.21.15.38:0/4088677495 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fac15b7b0 0x7f4fac0ce200 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:52.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.227+0000 7f4fb341a640 1 -- 172.21.15.38:0/4088677495 >> 172.21.15.38:0/4088677495 conn(0x7f4fac0cba10 msgr2=0x7f4fac0cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:52.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.227+0000 7f4fb341a640 1 -- 172.21.15.38:0/4088677495 shutdown_connections 2023-12-22T08:53:52.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.227+0000 7f4fb341a640 1 -- 172.21.15.38:0/4088677495 wait complete. 2023-12-22T08:53:52.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.229+0000 7f4fb341a640 1 Processor -- start 2023-12-22T08:53:52.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.229+0000 7f4fb341a640 1 -- start start 2023-12-22T08:53:52.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb341a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fac0ce740 0x7f4fac14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:52.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb341a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fac15b3d0 0x7f4fac1f0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:52.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb341a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fac15b7b0 0x7f4fac1f1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:52.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb341a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac0b0580 con 0x7f4fac15b3d0 2023-12-22T08:53:52.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb341a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac0b09a0 con 0x7f4fac15b7b0 2023-12-22T08:53:52.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb341a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac0af900 con 0x7f4fac0ce740 2023-12-22T08:53:52.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb09b5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fac15b3d0 0x7f4fac1f0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:52.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb09b5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fac15b3d0 0x7f4fac1f0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57592/0 (socket says 172.21.15.38:57592) 2023-12-22T08:53:52.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb09b5640 1 -- 172.21.15.38:0/1919404760 learned_addr learned my addr 172.21.15.38:0/1919404760 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:52.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb09b5640 1 -- 172.21.15.38:0/1919404760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fac0ce740 msgr2=0x7f4fac14a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:52.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb09b5640 1 --2- 172.21.15.38:0/1919404760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fac0ce740 0x7f4fac14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:52.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb09b5640 1 -- 172.21.15.38:0/1919404760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fac15b7b0 msgr2=0x7f4fac1f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:52.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb09b5640 1 --2- 172.21.15.38:0/1919404760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fac15b7b0 0x7f4fac1f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:52.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.230+0000 7f4fb09b5640 1 -- 172.21.15.38:0/1919404760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c0093a0 con 0x7f4fac15b3d0 2023-12-22T08:53:52.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.231+0000 7f4fb09b5640 1 --2- 172.21.15.38:0/1919404760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fac15b3d0 0x7f4fac1f0f30 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c000c00 tx=0x7f4f9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:52.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.231+0000 7f4fa1ffb640 1 -- 172.21.15.38:0/1919404760 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c034680 con 0x7f4fac15b3d0 2023-12-22T08:53:52.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.231+0000 7f4fa1ffb640 1 -- 172.21.15.38:0/1919404760 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c0347e0 con 0x7f4fac15b3d0 2023-12-22T08:53:52.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.231+0000 7f4fa1ffb640 1 -- 172.21.15.38:0/1919404760 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c034b90 con 0x7f4fac15b3d0 2023-12-22T08:53:52.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.231+0000 7f4fb341a640 1 -- 172.21.15.38:0/1919404760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fac0afbe0 con 0x7f4fac15b3d0 2023-12-22T08:53:52.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.231+0000 7f4fb341a640 1 -- 172.21.15.38:0/1919404760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac0b01a0 con 0x7f4fac15b3d0 2023-12-22T08:53:52.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.232+0000 7f4fb341a640 1 -- 172.21.15.38:0/1919404760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fac061910 con 0x7f4fac15b3d0 2023-12-22T08:53:52.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.233+0000 7f4fa1ffb640 1 -- 172.21.15.38:0/1919404760 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f9c03b040 con 0x7f4fac15b3d0 2023-12-22T08:53:52.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.235+0000 7f4fa1ffb640 1 --2- 172.21.15.38:0/1919404760 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4f9006a430 0x7f4f9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:52.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.235+0000 7f4fa1ffb640 1 -- 172.21.15.38:0/1919404760 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4f9c0a9f30 con 0x7f4fac15b3d0 2023-12-22T08:53:52.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.235+0000 7f4fb11b6640 1 --2- 172.21.15.38:0/1919404760 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4f9006a430 0x7f4f9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:52.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.237+0000 7f4fb11b6640 1 --2- 172.21.15.38:0/1919404760 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4f9006a430 0x7f4f9006c8f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8005880 tx=0x7f4fa8001150 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:52.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.241+0000 7f4fa1ffb640 1 -- 172.21.15.38:0/1919404760 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4f9c075780 con 0x7f4fac15b3d0 2023-12-22T08:53:52.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.439+0000 7f4fb341a640 1 -- 172.21.15.38:0/1919404760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4fac0cdbb0 con 0x7f4fac15b3d0 2023-12-22T08:53:52.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.448+0000 7f4fa1ffb640 1 -- 172.21.15.38:0/1919404760 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4f9c078da0 con 0x7f4fac15b3d0 2023-12-22T08:53:52.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.450+0000 7f4fb341a640 1 -- 172.21.15.38:0/1919404760 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4f9006a430 msgr2=0x7f4f9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:52.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.450+0000 7f4fb341a640 1 --2- 172.21.15.38:0/1919404760 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4f9006a430 0x7f4f9006c8f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8005880 tx=0x7f4fa8001150 comp rx=0 tx=0).stop 2023-12-22T08:53:52.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.451+0000 7f4fb341a640 1 -- 172.21.15.38:0/1919404760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fac15b3d0 msgr2=0x7f4fac1f0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:52.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.451+0000 7f4fb341a640 1 --2- 172.21.15.38:0/1919404760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fac15b3d0 0x7f4fac1f0f30 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c000c00 tx=0x7f4f9c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:53:52.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.451+0000 7f4fb341a640 1 -- 172.21.15.38:0/1919404760 shutdown_connections 2023-12-22T08:53:52.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.451+0000 7f4fb341a640 1 --2- 172.21.15.38:0/1919404760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4fac15b7b0 0x7f4fac1f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:52.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.451+0000 7f4fb341a640 1 --2- 172.21.15.38:0/1919404760 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f4f9006a430 0x7f4f9006c8f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:52.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.451+0000 7f4fb341a640 1 --2- 172.21.15.38:0/1919404760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4fac15b3d0 0x7f4fac1f0f30 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:52.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.451+0000 7f4fb341a640 1 --2- 172.21.15.38:0/1919404760 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4fac0ce740 0x7f4fac14a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:52.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.451+0000 7f4fb341a640 1 -- 172.21.15.38:0/1919404760 >> 172.21.15.38:0/1919404760 conn(0x7f4fac0cba10 msgr2=0x7f4fac0cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:52.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.451+0000 7f4fb341a640 1 -- 172.21.15.38:0/1919404760 shutdown_connections 2023-12-22T08:53:52.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.451+0000 7f4fb341a640 1 -- 172.21.15.38:0/1919404760 wait complete. 2023-12-22T08:53:52.471 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-12-22T08:53:52.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.693+0000 7fb1548ec640 1 Processor -- start 2023-12-22T08:53:52.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.694+0000 7fb1548ec640 1 -- start start 2023-12-22T08:53:52.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.695+0000 7fb1548ec640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb1500cb4c0 0x7fb15015e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:52.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.695+0000 7fb1548ec640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1500706d0 con 0x7fb15006d210 2023-12-22T08:53:52.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.695+0000 7fb1548ec640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1500cbf40 con 0x7fb15006d5f0 2023-12-22T08:53:52.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.695+0000 7fb1548ec640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1500ce840 con 0x7fb1500cb4c0 2023-12-22T08:53:52.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.696+0000 7fb14f7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb15006d210 0x7fb150159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58410/0 (socket says 172.21.15.38:58410) 2023-12-22T08:53:52.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.696+0000 7fb14f7fe640 1 -- 172.21.15.38:0/469620779 learned_addr learned my addr 172.21.15.38:0/469620779 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:52.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.696+0000 7fb147fff640 1 --2- 172.21.15.38:0/469620779 >> v2:172.21.15.38:3300/0 conn(0x7fb1500cb4c0 0x7fb15015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:52.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.696+0000 7fb14effd640 1 -- 172.21.15.38:0/469620779 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195787453 0 0) 0x7fb1500706d0 con 0x7fb15006d210 2023-12-22T08:53:52.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.696+0000 7fb14effd640 1 -- 172.21.15.38:0/469620779 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb13c003520 con 0x7fb15006d210 2023-12-22T08:53:52.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.696+0000 7fb147fff640 1 -- 172.21.15.38:0/469620779 >> v1:172.21.15.89:6789/0 conn(0x7fb15006d5f0 legacy=0x7fb150070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:52.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.696+0000 7fb147fff640 1 -- 172.21.15.38:0/469620779 >> v1:172.21.15.38:6789/0 conn(0x7fb15006d210 legacy=0x7fb150159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:52.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.696+0000 7fb147fff640 1 -- 172.21.15.38:0/469620779 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500ceb20 con 0x7fb1500cb4c0 2023-12-22T08:53:52.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.698+0000 7fb147fff640 1 --2- 172.21.15.38:0/469620779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1500cb4c0 0x7fb15015e830 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fb1380097a0 tx=0x7fb13802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ef1b1a51ffe181 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:52.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.698+0000 7fb14effd640 1 -- 172.21.15.38:0/469620779 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138030610 con 0x7fb1500cb4c0 2023-12-22T08:53:52.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.698+0000 7fb14effd640 1 -- 172.21.15.38:0/469620779 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb138030770 con 0x7fb1500cb4c0 2023-12-22T08:53:52.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.698+0000 7fb14effd640 1 -- 172.21.15.38:0/469620779 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138030b00 con 0x7fb1500cb4c0 2023-12-22T08:53:52.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.699+0000 7fb1548ec640 1 -- 172.21.15.38:0/469620779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1500cb4c0 msgr2=0x7fb15015e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:52.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.699+0000 7fb1548ec640 1 --2- 172.21.15.38:0/469620779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1500cb4c0 0x7fb15015e830 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fb1380097a0 tx=0x7fb13802b960 comp rx=0 tx=0).stop 2023-12-22T08:53:52.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.699+0000 7fb1548ec640 1 -- 172.21.15.38:0/469620779 shutdown_connections 2023-12-22T08:53:52.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.699+0000 7fb1548ec640 1 --2- 172.21.15.38:0/469620779 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1500cb4c0 0x7fb15015e830 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:52.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.699+0000 7fb1548ec640 1 -- 172.21.15.38:0/469620779 >> 172.21.15.38:0/469620779 conn(0x7fb1500b1f70 msgr2=0x7fb1500b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:52.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.699+0000 7fb1548ec640 1 -- 172.21.15.38:0/469620779 shutdown_connections 2023-12-22T08:53:52.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.699+0000 7fb1548ec640 1 -- 172.21.15.38:0/469620779 wait complete. 2023-12-22T08:53:52.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.701+0000 7fb1548ec640 1 Processor -- start 2023-12-22T08:53:52.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.701+0000 7fb1548ec640 1 -- start start 2023-12-22T08:53:52.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.702+0000 7fb1548ec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15006d210 0x7fb15009e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.702+0000 7fb1548ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb15006d5f0 0x7fb15009eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.702+0000 7fb1548ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1501e3c20 0x7fb1501e40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.702+0000 7fb1548ec640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1501f44e0 con 0x7fb15006d210 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.702+0000 7fb1548ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb150155400 con 0x7fb15006d5f0 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.702+0000 7fb1548ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1501556e0 con 0x7fb1501e3c20 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.702+0000 7fb14f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15006d210 0x7fb15009e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.702+0000 7fb14f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15006d210 0x7fb15009e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57602/0 (socket says 172.21.15.38:57602) 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.702+0000 7fb14f7fe640 1 -- 172.21.15.38:0/1570902507 learned_addr learned my addr 172.21.15.38:0/1570902507 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.703+0000 7fb14f7fe640 1 -- 172.21.15.38:0/1570902507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1501e3c20 msgr2=0x7fb1501e40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.703+0000 7fb14f7fe640 1 --2- 172.21.15.38:0/1570902507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1501e3c20 0x7fb1501e40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.703+0000 7fb14f7fe640 1 -- 172.21.15.38:0/1570902507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb15006d5f0 msgr2=0x7fb15009eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.703+0000 7fb14f7fe640 1 --2- 172.21.15.38:0/1570902507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb15006d5f0 0x7fb15009eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.703+0000 7fb14f7fe640 1 -- 172.21.15.38:0/1570902507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138009400 con 0x7fb15006d210 2023-12-22T08:53:52.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.703+0000 7fb14f7fe640 1 --2- 172.21.15.38:0/1570902507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15006d210 0x7fb15009e970 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c500 tx=0x7fb14000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:52.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.704+0000 7fb14cff9640 1 -- 172.21.15.38:0/1570902507 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140005ce0 con 0x7fb15006d210 2023-12-22T08:53:52.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.704+0000 7fb14cff9640 1 -- 172.21.15.38:0/1570902507 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb140005e40 con 0x7fb15006d210 2023-12-22T08:53:52.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.704+0000 7fb14cff9640 1 -- 172.21.15.38:0/1570902507 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140007330 con 0x7fb15006d210 2023-12-22T08:53:52.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.704+0000 7fb1548ec640 1 -- 172.21.15.38:0/1570902507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1501559c0 con 0x7fb15006d210 2023-12-22T08:53:52.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.704+0000 7fb1548ec640 1 -- 172.21.15.38:0/1570902507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1501e45f0 con 0x7fb15006d210 2023-12-22T08:53:52.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.705+0000 7fb1548ec640 1 -- 172.21.15.38:0/1570902507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb150061910 con 0x7fb15006d210 2023-12-22T08:53:52.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.706+0000 7fb14cff9640 1 -- 172.21.15.38:0/1570902507 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb140007550 con 0x7fb15006d210 2023-12-22T08:53:52.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.707+0000 7fb14cff9640 1 --2- 172.21.15.38:0/1570902507 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb13006a430 0x7fb13006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:52.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.707+0000 7fb14cff9640 1 -- 172.21.15.38:0/1570902507 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb140087c30 con 0x7fb15006d210 2023-12-22T08:53:52.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.707+0000 7fb147fff640 1 --2- 172.21.15.38:0/1570902507 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb13006a430 0x7fb13006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:52.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.709+0000 7fb147fff640 1 --2- 172.21.15.38:0/1570902507 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb13006a430 0x7fb13006c8f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb138036000 tx=0x7fb13803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:52.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.711+0000 7fb14cff9640 1 -- 172.21.15.38:0/1570902507 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb140053670 con 0x7fb15006d210 2023-12-22T08:53:52.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:52.969+0000 7fb1548ec640 1 -- 172.21.15.38:0/1570902507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7fb1500b2e10 con 0x7fb15006d210 2023-12-22T08:53:53.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:53.972+0000 7fb14cff9640 1 -- 172.21.15.38:0/1570902507 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v667) v1 ==== 135+0+0 (secure 0 0 0) 0x7fb1400170c0 con 0x7fb15006d210 2023-12-22T08:53:53.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:53.977+0000 7fb1548ec640 1 -- 172.21.15.38:0/1570902507 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb13006a430 msgr2=0x7fb13006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:53.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:53.977+0000 7fb1548ec640 1 --2- 172.21.15.38:0/1570902507 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb13006a430 0x7fb13006c8f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb138036000 tx=0x7fb13803b040 comp rx=0 tx=0).stop 2023-12-22T08:53:53.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:53.977+0000 7fb1548ec640 1 -- 172.21.15.38:0/1570902507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15006d210 msgr2=0x7fb15009e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:53.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:53.977+0000 7fb1548ec640 1 --2- 172.21.15.38:0/1570902507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15006d210 0x7fb15009e970 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c500 tx=0x7fb14000c9c0 comp rx=0 tx=0).stop 2023-12-22T08:53:53.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:53.977+0000 7fb1548ec640 1 -- 172.21.15.38:0/1570902507 shutdown_connections 2023-12-22T08:53:53.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:53.977+0000 7fb1548ec640 1 --2- 172.21.15.38:0/1570902507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1501e3c20 0x7fb1501e40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:53.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:53.977+0000 7fb1548ec640 1 --2- 172.21.15.38:0/1570902507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb15006d5f0 0x7fb15009eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:53.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:53.977+0000 7fb1548ec640 1 --2- 172.21.15.38:0/1570902507 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb13006a430 0x7fb13006c8f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:53.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:53.977+0000 7fb1548ec640 1 --2- 172.21.15.38:0/1570902507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb15006d210 0x7fb15009e970 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:53.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:53.977+0000 7fb1548ec640 1 -- 172.21.15.38:0/1570902507 >> 172.21.15.38:0/1570902507 conn(0x7fb1500b1f70 msgr2=0x7fb1501e4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:53.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:53.977+0000 7fb1548ec640 1 -- 172.21.15.38:0/1570902507 shutdown_connections 2023-12-22T08:53:53.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:53.977+0000 7fb1548ec640 1 -- 172.21.15.38:0/1570902507 wait complete. 2023-12-22T08:53:53.999 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-22T08:53:53.999 INFO:tasks.cephfs_test_runner: 2023-12-22T08:53:54.000 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-22T08:53:54.000 INFO:tasks.cephfs_test_runner:Ran 10 tests in 791.358s 2023-12-22T08:53:54.000 INFO:tasks.cephfs_test_runner: 2023-12-22T08:53:54.000 INFO:tasks.cephfs_test_runner:OK 2023-12-22T08:53:54.000 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-22T08:53:54.009 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-22T08:53:54.022 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-22T08:53:54.022 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:53:54.022 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:54.083 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:53:54.083 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-12-22T08:53:54.083 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:54.140 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-22T08:53:54.140 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:53:54.140 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:54.199 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:53:54.200 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-22T08:53:54.200 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:53:54.253 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-22T08:53:54.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:54.253 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:53:54.316 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:53:54.316 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-22T08:53:54.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:54.318 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:53:54.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:54.423 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T08:53:54.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:54.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2023-12-22T08:53:54.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:54.651 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-12-22T08:53:54.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:54.701 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2023-12-22T08:53:54.779 INFO:teuthology.orchestra.run.smithi038.stderr:Cannot find device "ceph-brx" 2023-12-22T08:53:54.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:53:54.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:54.782 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:53:54.844 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T08:53:54.844 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-22T08:53:54.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:54.844 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T08:53:54.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:54.942 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T08:53:55.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:55.045 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-12-22T08:53:55.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:55.198 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-12-22T08:53:55.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:53:55.243 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-12-22T08:53:55.381 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2023-12-22T08:53:55.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:53:55.385 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-22T08:53:55.395 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-22T08:53:55.396 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:53:55.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.631+0000 7f6aea10a640 1 Processor -- start 2023-12-22T08:53:55.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.631+0000 7f6aea10a640 1 -- start start 2023-12-22T08:53:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.632+0000 7f6aea10a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ae4146be0 0x7f6ae40d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.632+0000 7f6aea10a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6ae4146fc0 0x7f6ae40d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.633+0000 7f6aea10a640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae415eac0 con 0x7f6ae415dfb0 2023-12-22T08:53:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.633+0000 7f6aea10a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae40d1b70 con 0x7f6ae4146be0 2023-12-22T08:53:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.633+0000 7f6aea10a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae415ed10 con 0x7f6ae4146fc0 2023-12-22T08:53:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.633+0000 7f6ae37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ae4146be0 0x7f6ae40d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.633+0000 7f6ae37fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ae4146be0 0x7f6ae40d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57608/0 (socket says 172.21.15.38:57608) 2023-12-22T08:53:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.633+0000 7f6ae37fe640 1 -- 172.21.15.38:0/3144649428 learned_addr learned my addr 172.21.15.38:0/3144649428 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.633+0000 7f6ae37fe640 1 -- 172.21.15.38:0/3144649428 >> v2:172.21.15.89:3300/0 conn(0x7f6ae4146fc0 msgr2=0x7f6ae40d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.633+0000 7f6ae2ffd640 1 --2- 172.21.15.38:0/3144649428 >> v2:172.21.15.89:3300/0 conn(0x7f6ae4146fc0 0x7f6ae40d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:55.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.634+0000 7f6ae37fe640 1 --2- 172.21.15.38:0/3144649428 >> v2:172.21.15.89:3300/0 conn(0x7f6ae4146fc0 0x7f6ae40d1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:55.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.634+0000 7f6ae37fe640 1 -- 172.21.15.38:0/3144649428 >> v1:172.21.15.89:6789/0 conn(0x7f6ae415dfb0 legacy=0x7f6ae415e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:55.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.634+0000 7f6ae37fe640 1 -- 172.21.15.38:0/3144649428 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4162200 con 0x7f6ae4146be0 2023-12-22T08:53:55.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.635+0000 7f6ae37fe640 1 --2- 172.21.15.38:0/3144649428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ae4146be0 0x7f6ae40d10f0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f6ae406d590 tx=0x7f6ad402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fcef34018711e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.635+0000 7f6ae27fc640 1 -- 172.21.15.38:0/3144649428 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad402ca80 con 0x7f6ae4146be0 2023-12-22T08:53:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.635+0000 7f6ae27fc640 1 -- 172.21.15.38:0/3144649428 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad402cbe0 con 0x7f6ae4146be0 2023-12-22T08:53:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.635+0000 7f6ae27fc640 1 -- 172.21.15.38:0/3144649428 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40343f0 con 0x7f6ae4146be0 2023-12-22T08:53:55.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.636+0000 7f6aea10a640 1 -- 172.21.15.38:0/3144649428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ae4146be0 msgr2=0x7f6ae40d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:55.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.636+0000 7f6aea10a640 1 --2- 172.21.15.38:0/3144649428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ae4146be0 0x7f6ae40d10f0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f6ae406d590 tx=0x7f6ad402bee0 comp rx=0 tx=0).stop 2023-12-22T08:53:55.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.636+0000 7f6aea10a640 1 -- 172.21.15.38:0/3144649428 shutdown_connections 2023-12-22T08:53:55.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.636+0000 7f6aea10a640 1 --2- 172.21.15.38:0/3144649428 >> v2:172.21.15.89:3300/0 conn(0x7f6ae4146fc0 0x7f6ae40d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:55.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.636+0000 7f6aea10a640 1 --2- 172.21.15.38:0/3144649428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ae4146be0 0x7f6ae40d10f0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:55.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.636+0000 7f6aea10a640 1 -- 172.21.15.38:0/3144649428 >> 172.21.15.38:0/3144649428 conn(0x7f6ae406c5e0 msgr2=0x7f6ae406c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:55.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.636+0000 7f6aea10a640 1 -- 172.21.15.38:0/3144649428 shutdown_connections 2023-12-22T08:53:55.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.636+0000 7f6aea10a640 1 -- 172.21.15.38:0/3144649428 wait complete. 2023-12-22T08:53:55.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.639+0000 7f6aea10a640 1 Processor -- start 2023-12-22T08:53:55.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.639+0000 7f6aea10a640 1 -- start start 2023-12-22T08:53:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.640+0000 7f6aea10a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ae4146be0 0x7f6ae41433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.640+0000 7f6aea10a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ae4146fc0 0x7f6ae413df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.640+0000 7f6aea10a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ae415dfb0 0x7f6ae413e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.640+0000 7f6aea10a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae413f950 con 0x7f6ae4146fc0 2023-12-22T08:53:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.640+0000 7f6aea10a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae413ea80 con 0x7f6ae4146be0 2023-12-22T08:53:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.640+0000 7f6aea10a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae413ecd0 con 0x7f6ae415dfb0 2023-12-22T08:53:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.640+0000 7f6ae2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ae4146fc0 0x7f6ae413df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.640+0000 7f6ae2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ae4146fc0 0x7f6ae413df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57610/0 (socket says 172.21.15.38:57610) 2023-12-22T08:53:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.640+0000 7f6ae2ffd640 1 -- 172.21.15.38:0/1408518286 learned_addr learned my addr 172.21.15.38:0/1408518286 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.641+0000 7f6ae37fe640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ae4146be0 0x7f6ae41433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.641+0000 7f6ae3fff640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ae415dfb0 0x7f6ae413e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.641+0000 7f6ae2ffd640 1 -- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ae415dfb0 msgr2=0x7f6ae413e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.641+0000 7f6ae2ffd640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ae415dfb0 0x7f6ae413e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.641+0000 7f6ae2ffd640 1 -- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ae4146be0 msgr2=0x7f6ae41433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.641+0000 7f6ae2ffd640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ae4146be0 0x7f6ae41433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.641+0000 7f6ae2ffd640 1 -- 172.21.15.38:0/1408518286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad4009b30 con 0x7f6ae4146fc0 2023-12-22T08:53:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.641+0000 7f6ae3fff640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ae415dfb0 0x7f6ae413e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.641+0000 7f6ae2ffd640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ae4146fc0 0x7f6ae413df00 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c7f0 tx=0x7f6ad800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.642+0000 7f6acbfff640 1 -- 172.21.15.38:0/1408518286 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8004220 con 0x7f6ae4146fc0 2023-12-22T08:53:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.642+0000 7f6acbfff640 1 -- 172.21.15.38:0/1408518286 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad80043a0 con 0x7f6ae4146fc0 2023-12-22T08:53:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.642+0000 7f6acbfff640 1 -- 172.21.15.38:0/1408518286 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8007860 con 0x7f6ae4146fc0 2023-12-22T08:53:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.642+0000 7f6aea10a640 1 -- 172.21.15.38:0/1408518286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae413efb0 con 0x7f6ae4146fc0 2023-12-22T08:53:55.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.642+0000 7f6aea10a640 1 -- 172.21.15.38:0/1408518286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae413f570 con 0x7f6ae4146fc0 2023-12-22T08:53:55.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.643+0000 7f6aea10a640 1 -- 172.21.15.38:0/1408518286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae413fa90 con 0x7f6ae4146fc0 2023-12-22T08:53:55.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.644+0000 7f6acbfff640 1 -- 172.21.15.38:0/1408518286 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ad8007bd0 con 0x7f6ae4146fc0 2023-12-22T08:53:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.645+0000 7f6acbfff640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ad006a430 0x7f6ad006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.645+0000 7f6acbfff640 1 -- 172.21.15.38:0/1408518286 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6ad80885e0 con 0x7f6ae4146fc0 2023-12-22T08:53:55.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.645+0000 7f6ae37fe640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ad006a430 0x7f6ad006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:55.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.647+0000 7f6ae37fe640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ad006a430 0x7f6ad006c8f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4035000 tx=0x7f6ad4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:55.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.651+0000 7f6acbfff640 1 -- 172.21.15.38:0/1408518286 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6ae413fa90 con 0x7f6ae4146fc0 2023-12-22T08:53:55.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.843+0000 7f6aea10a640 1 -- 172.21.15.38:0/1408518286 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ae4161720 con 0x7f6ad006a430 2023-12-22T08:53:55.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.850+0000 7f6acbfff640 1 -- 172.21.15.38:0/1408518286 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47462 (secure 0 0 0) 0x7f6ad4034470 con 0x7f6ad006a430 2023-12-22T08:53:55.851 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:55.852 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:53:55.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.852+0000 7f6aea10a640 1 -- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ad006a430 msgr2=0x7f6ad006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:55.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.852+0000 7f6aea10a640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ad006a430 0x7f6ad006c8f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4035000 tx=0x7f6ad4030000 comp rx=0 tx=0).stop 2023-12-22T08:53:55.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.852+0000 7f6aea10a640 1 -- 172.21.15.38:0/1408518286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ae4146fc0 msgr2=0x7f6ae413df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:55.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.852+0000 7f6aea10a640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ae4146fc0 0x7f6ae413df00 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c7f0 tx=0x7f6ad800ccb0 comp rx=0 tx=0).stop 2023-12-22T08:53:55.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.853+0000 7f6aea10a640 1 -- 172.21.15.38:0/1408518286 shutdown_connections 2023-12-22T08:53:55.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.853+0000 7f6aea10a640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ae415dfb0 0x7f6ae413e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:55.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.853+0000 7f6aea10a640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f6ad006a430 0x7f6ad006c8f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:55.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.853+0000 7f6aea10a640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ae4146fc0 0x7f6ae413df00 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:55.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.853+0000 7f6aea10a640 1 --2- 172.21.15.38:0/1408518286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ae4146be0 0x7f6ae41433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:55.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.853+0000 7f6aea10a640 1 -- 172.21.15.38:0/1408518286 >> 172.21.15.38:0/1408518286 conn(0x7f6ae406c5e0 msgr2=0x7f6ae415cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:55.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.853+0000 7f6aea10a640 1 -- 172.21.15.38:0/1408518286 shutdown_connections 2023-12-22T08:53:55.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:55.853+0000 7f6aea10a640 1 -- 172.21.15.38:0/1408518286 wait complete. 2023-12-22T08:53:55.874 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":612,"stamp":"2023-12-22T08:53:54.664861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9835,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552664,"statfs":{"total":1600000000,"available":1589928755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490837,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002138"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":325,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-12-22T08:53:51.978298+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:53:51.978298+0000","last_peered":"2023-12-22T08:53:51.978298+0000","last_clean":"2023-12-22T08:53:51.978298+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:53:51.978298+0000","last_undegraded":"2023-12-22T08:53:51.978298+0000","last_fullsized":"2023-12-22T08:53:51.978298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575019,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0900000000000001,"15min":1.0880000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58199999999999996},"max":{"1min":1.5309999999999999,"5min":1.8700000000000001,"15min":2.0249999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.1100000000000001,"15min":1.095},"min":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.70099999999999996},"max":{"1min":1.3600000000000001,"5min":1.6499999999999999,"15min":1.6819999999999999},"last":1.0609999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2709999999999999,"15min":1.212},"min":{"1min":0.85599999999999998,"5min":0.70899999999999996,"15min":0.64200000000000002},"max":{"1min":1.671,"5min":1.6779999999999999,"15min":1.905},"last":1.55},{"interface":"front","average":{"1min":1.294,"5min":1.2769999999999999,"15min":1.228},"min":{"1min":0.83399999999999996,"5min":0.78800000000000003,"15min":0.67100000000000004},"max":{"1min":1.5289999999999999,"5min":1.758,"15min":1.865},"last":1.45}]},{"osd":2,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.204,"15min":1.151},"min":{"1min":0.79400000000000004,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5309999999999999,"5min":1.7150000000000001,"15min":2.0150000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.177,"5min":1.2270000000000001,"15min":1.22},"min":{"1min":0.81699999999999995,"5min":0.76100000000000001,"15min":0.68700000000000006},"max":{"1min":1.5640000000000001,"5min":1.7030000000000001,"15min":2.1379999999999999},"last":0.96199999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2649999999999999,"15min":1.2050000000000001},"min":{"1min":0.92800000000000005,"5min":0.875,"15min":0.71399999999999997},"max":{"1min":1.5900000000000001,"5min":1.766,"15min":2.0680000000000001},"last":1.014},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3100000000000001},"min":{"1min":0.98999999999999999,"5min":0.78000000000000003,"15min":0.71799999999999997},"max":{"1min":1.633,"5min":1.778,"15min":2.2959999999999998},"last":1.484}]},{"osd":4,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1879999999999999,"15min":1.2},"min":{"1min":0.79800000000000004,"5min":0.56699999999999995,"15min":0.48699999999999999},"max":{"1min":1.5349999999999999,"5min":1.7430000000000001,"15min":2.0760000000000001},"last":1.222},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.282,"15min":1.274},"min":{"1min":0.82399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6279999999999999,"5min":1.899,"15min":2.2749999999999999},"last":1.3149999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.304,"15min":1.355},"min":{"1min":0.99399999999999999,"5min":0.60699999999999998,"15min":0.51800000000000002},"max":{"1min":1.76,"5min":1.8280000000000001,"15min":2.4300000000000002},"last":1.258},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3260000000000001,"15min":1.3620000000000001},"min":{"1min":1.0089999999999999,"5min":0.627,"15min":0.623},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.3410000000000002},"last":1.1499999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.4990000000000001},"min":{"1min":0.98699999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":2.355},"last":1.367},{"interface":"front","average":{"1min":1.427,"5min":1.4550000000000001,"15min":1.482},"min":{"1min":1.097,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.137,"5min":2.137,"15min":2.4849999999999999},"last":1.421}]}]},{"osd":6,"up_from":13,"seq":55834575019,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.123,"15min":1.2230000000000001},"min":{"1min":0.70699999999999996,"5min":0.66000000000000003,"15min":0.42099999999999999},"max":{"1min":1.3799999999999999,"5min":1.6519999999999999,"15min":28.361000000000001},"last":1.609},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1759999999999999,"15min":1.1519999999999999},"min":{"1min":0.90700000000000003,"5min":0.629,"15min":0.629},"max":{"1min":1.5629999999999999,"5min":1.675,"15min":3.0670000000000002},"last":1.361}]},{"osd":1,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.113,"15min":1.0900000000000001},"min":{"1min":0.85299999999999998,"5min":0.71499999999999997,"15min":0.58999999999999997},"max":{"1min":1.655,"5min":1.655,"15min":2.1150000000000002},"last":1.323},{"interface":"front","average":{"1min":1.248,"5min":1.234,"15min":1.25},"min":{"1min":0.93200000000000005,"5min":0.74299999999999999,"15min":0.63100000000000001},"max":{"1min":1.762,"5min":1.762,"15min":15.324999999999999},"last":1.129}]},{"osd":2,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.246,"15min":1.2989999999999999},"min":{"1min":0.94899999999999995,"5min":0.79800000000000004,"15min":0.65700000000000003},"max":{"1min":1.8899999999999999,"5min":1.9259999999999999,"15min":15.422000000000001},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.23,"15min":1.2490000000000001},"min":{"1min":0.90500000000000003,"5min":0.81100000000000005,"15min":0.58599999999999997},"max":{"1min":1.5620000000000001,"5min":1.7,"15min":10.173999999999999},"last":1.6930000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.29,"15min":1.3320000000000001},"min":{"1min":0.90400000000000003,"5min":0.877,"15min":0.72899999999999998},"max":{"1min":1.6379999999999999,"5min":1.671,"15min":10.096},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.276,"15min":1.258},"min":{"1min":0.86499999999999999,"5min":0.83199999999999996,"15min":0.71399999999999997},"max":{"1min":1.7010000000000001,"5min":1.702,"15min":2.3889999999999998},"last":1.262}]},{"osd":4,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2470000000000001,"15min":1.3720000000000001},"min":{"1min":0.83199999999999996,"5min":0.64200000000000002,"15min":0.52000000000000002},"max":{"1min":1.794,"5min":1.794,"15min":15.378},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.3400000000000001,"15min":1.4179999999999999},"min":{"1min":1.071,"5min":0.80700000000000005,"15min":0.68999999999999995},"max":{"1min":1.802,"5min":1.802,"15min":13.178000000000001},"last":1.5609999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.2410000000000001,"15min":1.365},"min":{"1min":0.83399999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.855,"5min":1.855,"15min":19.995000000000001},"last":1.177},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4339999999999999,"15min":1.5449999999999999},"min":{"1min":1.125,"5min":0.98499999999999999,"15min":0.67600000000000005},"max":{"1min":1.9850000000000001,"5min":2.1989999999999998,"15min":15.679},"last":1.675}]},{"osd":7,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.46,"15min":1.522},"min":{"1min":1.0900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.746,"5min":1.845,"15min":3.2429999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.4610000000000001,"15min":1.4890000000000001},"min":{"1min":1.046,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.927,"5min":1.972,"15min":4.6609999999999996},"last":1.496}]}]},{"osd":5,"up_from":13,"seq":55834575019,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1660,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193651,"statfs":{"total":200000000,"available":198299210,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.155,"15min":1.105},"min":{"1min":0.80200000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6850000000000001,"5min":1.8939999999999999,"15min":1.944},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.1479999999999999,"15min":1.121},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.65300000000000002},"max":{"1min":1.51,"5min":1.9279999999999999,"15min":3.1379999999999999},"last":1.464}]},{"osd":1,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1739999999999999,"15min":1.139},"min":{"1min":0.67400000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.4159999999999999,"5min":1.714,"15min":2.79},"last":1.49},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1950000000000001,"15min":1.109},"min":{"1min":0.82299999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.462,"5min":1.7430000000000001,"15min":1.7509999999999999},"last":0.98299999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1850000000000001,"15min":1.1579999999999999},"min":{"1min":0.77200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.403,"5min":1.675,"15min":1.8819999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2949999999999999,"15min":1.2330000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.74299999999999999},"max":{"1min":1.552,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.425}]},{"osd":3,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2549999999999999,"15min":1.222},"min":{"1min":0.85899999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5920000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.327,"15min":1.284},"min":{"1min":0.74199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.772,"5min":1.875,"15min":2.1499999999999999},"last":1.407}]},{"osd":4,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.57899999999999996},"max":{"1min":1.583,"5min":1.8380000000000001,"15min":1.853},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2769999999999999,"15min":1.2629999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"max":{"1min":1.5600000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.86799999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3420000000000001,"15min":1.3280000000000001},"min":{"1min":0.65200000000000002,"5min":0.55300000000000005,"15min":0.54600000000000004},"max":{"1min":1.663,"5min":1.792,"15min":1.821},"last":1.042},{"interface":"front","average":{"1min":1.337,"5min":1.4219999999999999,"15min":1.4119999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.601,"5min":1.952,"15min":2.8780000000000001},"last":1.554}]},{"osd":7,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.4079999999999999,"15min":1.3999999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.673,"5min":2.0960000000000001,"15min":2.2189999999999999},"last":1.169},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4770000000000001,"15min":1.498},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9139999999999999,"5min":2.056,"15min":4.7249999999999996},"last":1.323}]}]},{"osd":4,"up_from":13,"seq":55834575019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.1180000000000001,"15min":1.0529999999999999},"min":{"1min":0.66600000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3540000000000001,"5min":6.4969999999999999,"15min":6.4969999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1499999999999999,"15min":1.1279999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.58199999999999996},"max":{"1min":1.4910000000000001,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":1.119}]},{"osd":1,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.171,"15min":1.111},"min":{"1min":0.86599999999999999,"5min":0.63200000000000001,"15min":0.54100000000000004},"max":{"1min":1.679,"5min":6.2999999999999998,"15min":6.2999999999999998},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.3280000000000001,"15min":1.1819999999999999},"min":{"1min":0.82199999999999995,"5min":0.79100000000000004,"15min":0.57399999999999995},"max":{"1min":1.4430000000000001,"5min":17.562999999999999,"15min":17.562999999999999},"last":1.238}]},{"osd":2,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.262,"15min":1.1899999999999999},"min":{"1min":0.86299999999999999,"5min":0.78600000000000003,"15min":0.65700000000000003},"max":{"1min":1.4770000000000001,"5min":9.0329999999999995,"15min":9.0329999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.224,"5min":1.3049999999999999,"15min":1.246},"min":{"1min":0.85099999999999998,"5min":0.748,"15min":0.748},"max":{"1min":1.6180000000000001,"5min":8.2029999999999994,"15min":8.2029999999999994},"last":1.5409999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3400000000000001,"15min":1.256},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.68500000000000005},"max":{"1min":1.5469999999999999,"5min":8.8160000000000007,"15min":8.8160000000000007},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.385,"15min":1.3100000000000001},"min":{"1min":1.0620000000000001,"5min":0.82299999999999995,"15min":0.82099999999999995},"max":{"1min":1.714,"5min":10.157999999999999,"15min":10.157999999999999},"last":1.427}]},{"osd":5,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.266,"15min":1.2010000000000001},"min":{"1min":0.79400000000000004,"5min":0.67900000000000005,"15min":0.52400000000000002},"max":{"1min":1.6899999999999999,"5min":7.056,"15min":7.056},"last":1.069},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.4990000000000001,"15min":1.4399999999999999},"min":{"1min":1.0449999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5920000000000001,"5min":9.0700000000000003,"15min":9.0700000000000003},"last":1.2809999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.363,"15min":1.3200000000000001},"min":{"1min":0.82499999999999996,"5min":0.62,"15min":0.58599999999999997},"max":{"1min":1.8049999999999999,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.3600000000000001,"15min":1.302},"min":{"1min":0.95899999999999996,"5min":0.82399999999999995,"15min":0.59199999999999997},"max":{"1min":2.052,"5min":5.2089999999999996,"15min":5.2089999999999996},"last":1.3140000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4910000000000001,"15min":1.4339999999999999},"min":{"1min":1.022,"5min":0.70199999999999996,"15min":0.67300000000000004},"max":{"1min":1.7170000000000001,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.581,"15min":1.5149999999999999},"min":{"1min":1.3680000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.8740000000000001,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.4910000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575019,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.39800000000000002},"max":{"1min":1.4139999999999999,"5min":1.4770000000000001,"15min":1.8340000000000001},"last":1.042},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.999,"15min":0.95099999999999996},"min":{"1min":0.65900000000000003,"5min":0.44,"15min":0.38900000000000001},"max":{"1min":1.482,"5min":1.5249999999999999,"15min":2.5270000000000001},"last":0.98899999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.002,"15min":0.91900000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.34499999999999997},"max":{"1min":1.3999999999999999,"5min":1.772,"15min":1.772},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.252,"15min":1.1830000000000001},"min":{"1min":0.754,"5min":0.53700000000000003,"15min":0.46200000000000002},"max":{"1min":1.6619999999999999,"5min":1.825,"15min":1.861},"last":1.137}]},{"osd":2,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1619999999999999,"15min":1.079},"min":{"1min":0.64400000000000002,"5min":0.625,"15min":0.41899999999999998},"max":{"1min":1.619,"5min":1.659,"15min":1.7350000000000001},"last":1.554},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.1990000000000001,"15min":1.165},"min":{"1min":0.77600000000000002,"5min":0.69799999999999995,"15min":0.45100000000000001},"max":{"1min":1.6859999999999999,"5min":1.8120000000000001,"15min":1.9570000000000001},"last":0.91700000000000004}]},{"osd":4,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2450000000000001,"15min":1.2290000000000001},"min":{"1min":0.83299999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5900000000000001,"5min":1.6870000000000001,"15min":2.7210000000000001},"last":1.3},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.351,"15min":1.296},"min":{"1min":0.96799999999999997,"5min":0.873,"15min":0.745},"max":{"1min":1.546,"5min":1.9850000000000001,"15min":2.3999999999999999},"last":1.8899999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4259999999999999,"15min":1.349},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.66700000000000004},"max":{"1min":1.6950000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.411,"15min":1.399},"min":{"1min":1.0009999999999999,"5min":0.78600000000000003,"15min":0.73699999999999999},"max":{"1min":1.762,"5min":2.2629999999999999,"15min":2.3839999999999999},"last":1.24}]},{"osd":6,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4890000000000001,"15min":1.4550000000000001},"min":{"1min":1.099,"5min":1.008,"15min":0.88100000000000001},"max":{"1min":1.768,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.4059999999999999,"15min":1.379},"min":{"1min":0.97299999999999998,"5min":0.84899999999999998,"15min":0.75900000000000001},"max":{"1min":1.9590000000000001,"5min":1.968,"15min":2.8250000000000002},"last":1.181}]},{"osd":7,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4770000000000001,"15min":1.419},"min":{"1min":1.0409999999999999,"5min":0.91600000000000004,"15min":0.77100000000000002},"max":{"1min":1.891,"5min":2.056,"15min":2.7850000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.5189999999999999,"15min":1.452},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.80600000000000005},"max":{"1min":1.869,"5min":2.2290000000000001,"15min":2.3740000000000001},"last":1.804}]}]},{"osd":2,"up_from":13,"seq":55834575019,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88400000000000001,"15min":0.86199999999999999},"min":{"1min":0.57299999999999995,"5min":0.432,"15min":0.32000000000000001},"max":{"1min":1.278,"5min":1.8340000000000001,"15min":6.8879999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.03,"5min":0.98899999999999999,"15min":0.94899999999999995},"min":{"1min":0.64700000000000002,"5min":0.39100000000000001,"15min":0.35799999999999998},"max":{"1min":1.5389999999999999,"5min":1.7589999999999999,"15min":4.5510000000000002},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.92600000000000005,"15min":0.95599999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":11.308999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.111,"15min":1.046},"min":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.44600000000000001},"max":{"1min":1.4650000000000001,"5min":1.738,"15min":2.9889999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.179,"15min":1.135},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":1.6439999999999999,"5min":1.772,"15min":13.087999999999999},"last":1.145},{"interface":"front","average":{"1min":1.288,"5min":1.246,"15min":1.23},"min":{"1min":0.71899999999999997,"5min":0.61299999999999999,"15min":0.52300000000000002},"max":{"1min":1.585,"5min":2.0720000000000001,"15min":12.289999999999999},"last":1.117}]},{"osd":4,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.369,"15min":1.3420000000000001},"min":{"1min":1.0660000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":3.5249999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.337},"min":{"1min":0.83799999999999997,"5min":0.80500000000000005,"15min":0.61499999999999999},"max":{"1min":1.871,"5min":2.0539999999999998,"15min":13.927},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3819999999999999,"15min":1.3759999999999999},"min":{"1min":1.0489999999999999,"5min":0.70299999999999996,"15min":0.64000000000000001},"max":{"1min":1.724,"5min":1.9750000000000001,"15min":11.003},"last":1.345},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":1.002,"5min":0.504,"15min":0.504},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":13.129},"last":1.2669999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.389,"15min":1.371},"min":{"1min":0.88500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.8999999999999999,"5min":1.978,"15min":8.1609999999999996},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.498,"15min":1.464},"min":{"1min":0.93899999999999995,"5min":0.89900000000000002,"15min":0.69999999999999996},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":6.8150000000000004},"last":1.4350000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4419999999999999,"15min":1.425},"min":{"1min":0.78600000000000003,"5min":0.76200000000000001,"15min":0.61299999999999999},"max":{"1min":2.0270000000000001,"5min":2.1309999999999998,"15min":10.948},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.4950000000000001,"15min":1.496},"min":{"1min":1.0780000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":9.0239999999999991},"last":1.4119999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575019,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1661,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193650,"statfs":{"total":200000000,"available":198298191,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":0.98499999999999999},"min":{"1min":0.56499999999999995,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":2.5680000000000001,"5min":23.059000000000001,"15min":23.059000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.026,"5min":1.1819999999999999,"15min":1.1140000000000001},"min":{"1min":0.59799999999999998,"5min":0.41099999999999998,"15min":0.39900000000000002},"max":{"1min":1.3939999999999999,"5min":9.9749999999999996,"15min":9.9749999999999996},"last":1.0269999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.286,"15min":1.0700000000000001},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.45500000000000002},"max":{"1min":7.9880000000000004,"5min":22.977,"15min":22.977},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.117,"15min":1.034},"min":{"1min":0.52300000000000002,"5min":0.48999999999999999,"15min":0.34999999999999998},"max":{"1min":9.4440000000000008,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.92300000000000004}]},{"osd":3,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.3400000000000001,"15min":1.274},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.51800000000000002},"max":{"1min":1.7050000000000001,"5min":1.9770000000000001,"15min":2.5169999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1499999999999999,"15min":1.0580000000000001},"min":{"1min":0.622,"5min":0.58699999999999997,"15min":0.47799999999999998},"max":{"1min":5.3470000000000004,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":1.5449999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.5229999999999999,"15min":1.3600000000000001},"min":{"1min":0.82399999999999995,"5min":0.73999999999999999,"15min":0.58699999999999997},"max":{"1min":2.7069999999999999,"5min":23.145,"15min":23.145},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.5209999999999999,"15min":1.431},"min":{"1min":0.89200000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.6699999999999999,"5min":9.9299999999999997,"15min":9.9299999999999997},"last":1.264}]},{"osd":5,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.323,"15min":1.278},"min":{"1min":0.80300000000000005,"5min":0.77700000000000002,"15min":0.58699999999999997},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":4.6399999999999997},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.431,"5min":1.6180000000000001,"15min":1.4510000000000001},"min":{"1min":0.90400000000000003,"5min":0.71699999999999997,"15min":0.66800000000000004},"max":{"1min":2.758,"5min":23.105,"15min":23.105},"last":1.2969999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.381,"15min":1.3340000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.65200000000000002},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":4.5819999999999999},"last":1.329},{"interface":"front","average":{"1min":1.486,"5min":1.726,"15min":1.516},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.67200000000000004},"max":{"1min":2.657,"5min":24.341999999999999,"15min":24.341999999999999},"last":1.518}]},{"osd":7,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4390000000000001,"15min":1.4339999999999999},"min":{"1min":0.88400000000000001,"5min":0.78800000000000003,"15min":0.64400000000000002},"max":{"1min":1.732,"5min":2.0870000000000002,"15min":2.4889999999999999},"last":1.373},{"interface":"front","average":{"1min":1.514,"5min":1.472,"15min":1.4430000000000001},"min":{"1min":0.96199999999999997,"5min":0.82099999999999995,"15min":0.66200000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":4.508},"last":1.423}]}]},{"osd":0,"up_from":13,"seq":55834575019,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":0.94699999999999995,"15min":0.84699999999999998},"min":{"1min":0.61399999999999999,"5min":0.432,"15min":0.36599999999999999},"max":{"1min":7.3499999999999996,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.042,"15min":0.96399999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.33700000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.95499999999999996}]},{"osd":2,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90300000000000002,"15min":0.85599999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.373},"max":{"1min":1.617,"5min":1.617,"15min":1.6739999999999999},"last":1.212},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.056,"15min":1.02},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.40000000000000002},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":2.1219999999999999},"last":1.304}]},{"osd":3,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.288,"15min":1.1599999999999999},"min":{"1min":0.65200000000000002,"5min":0.56299999999999994,"15min":0.44500000000000001},"max":{"1min":7.6550000000000002,"5min":7.6550000000000002,"15min":7.6550000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.24,"5min":1.3280000000000001,"15min":1.2090000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.39100000000000001},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":2.145},"last":1.0489999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0049999999999999,"5min":1.4910000000000001,"15min":1.367},"min":{"1min":0.88,"5min":0.81200000000000006,"15min":0.70799999999999996},"max":{"1min":7.7370000000000001,"5min":7.7370000000000001,"15min":7.7370000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.4370000000000001,"15min":1.335},"min":{"1min":0.93500000000000005,"5min":0.82999999999999996,"15min":0.70599999999999996},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":1.48}]},{"osd":5,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.335},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.59299999999999997},"max":{"1min":2.843,"5min":2.843,"15min":5.4290000000000003},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.831,"5min":1.46,"15min":1.361},"min":{"1min":1.048,"5min":0.85799999999999998,"15min":0.73599999999999999},"max":{"1min":7.8579999999999997,"5min":7.8579999999999997,"15min":7.8579999999999997},"last":1.25}]},{"osd":6,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.4019999999999999,"15min":1.353},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.64800000000000002},"max":{"1min":1.7609999999999999,"5min":1.9330000000000001,"15min":2.4420000000000002},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.52,"15min":1.4610000000000001},"min":{"1min":0.97099999999999997,"5min":0.95799999999999996,"15min":0.69099999999999995},"max":{"1min":2.1070000000000002,"5min":2.109,"15min":2.577},"last":1.4530000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.508,"15min":1.4430000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.755},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.9810000000000001,"5min":1.595,"15min":1.4770000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":7.8029999999999999,"5min":7.8029999999999999,"15min":7.8029999999999999},"last":1.425}]}]}],"pool_statfs":[]}} 2023-12-22T08:53:55.876 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:53:56.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.098+0000 7fca9c972640 1 Processor -- start 2023-12-22T08:53:56.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.099+0000 7fca9c972640 1 -- start start 2023-12-22T08:53:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.100+0000 7fca9c972640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca98157980 0x7fca9815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.100+0000 7fca9c972640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fca980b3ff0 0x7fca9806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.100+0000 7fca9c972640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca980d1520 con 0x7fca980b44a0 2023-12-22T08:53:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.100+0000 7fca9c972640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca980d1800 con 0x7fca98157980 2023-12-22T08:53:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.100+0000 7fca9c972640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca980d1ae0 con 0x7fca980b3ff0 2023-12-22T08:53:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.100+0000 7fca96d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca98157980 0x7fca9815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.101+0000 7fca96d9d640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca98157980 0x7fca9815eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57622/0 (socket says 172.21.15.38:57622) 2023-12-22T08:53:56.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.101+0000 7fca96d9d640 1 -- 172.21.15.38:0/3002146211 learned_addr learned my addr 172.21.15.38:0/3002146211 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:56.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.101+0000 7fca8e59c640 1 --2- 172.21.15.38:0/3002146211 >> v2:172.21.15.89:3300/0 conn(0x7fca980b3ff0 0x7fca9806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:56.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.101+0000 7fca96d9d640 1 -- 172.21.15.38:0/3002146211 >> v2:172.21.15.89:3300/0 conn(0x7fca980b3ff0 msgr2=0x7fca9806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:56.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.101+0000 7fca96d9d640 1 --2- 172.21.15.38:0/3002146211 >> v2:172.21.15.89:3300/0 conn(0x7fca980b3ff0 0x7fca9806cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.101+0000 7fca96d9d640 1 -- 172.21.15.38:0/3002146211 >> v1:172.21.15.38:6789/0 conn(0x7fca980b44a0 legacy=0x7fca980d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:56.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.101+0000 7fca96d9d640 1 -- 172.21.15.38:0/3002146211 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca980d1dc0 con 0x7fca98157980 2023-12-22T08:53:56.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.102+0000 7fca96d9d640 1 --2- 172.21.15.38:0/3002146211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca98157980 0x7fca9815eb10 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fca980d3f10 tx=0x7fca8802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf7c03d52ffd740 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:56.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.103+0000 7fca9659c640 1 -- 172.21.15.38:0/3002146211 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88030870 con 0x7fca98157980 2023-12-22T08:53:56.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.103+0000 7fca9659c640 1 -- 172.21.15.38:0/3002146211 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca880309d0 con 0x7fca98157980 2023-12-22T08:53:56.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.103+0000 7fca9659c640 1 -- 172.21.15.38:0/3002146211 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88030d60 con 0x7fca98157980 2023-12-22T08:53:56.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.103+0000 7fca9c972640 1 -- 172.21.15.38:0/3002146211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca98157980 msgr2=0x7fca9815eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:56.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.103+0000 7fca9c972640 1 --2- 172.21.15.38:0/3002146211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca98157980 0x7fca9815eb10 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fca980d3f10 tx=0x7fca8802b9b0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.103+0000 7fca9c972640 1 -- 172.21.15.38:0/3002146211 shutdown_connections 2023-12-22T08:53:56.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.103+0000 7fca9c972640 1 --2- 172.21.15.38:0/3002146211 >> v2:172.21.15.89:3300/0 conn(0x7fca980b3ff0 0x7fca9806cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.103+0000 7fca9c972640 1 --2- 172.21.15.38:0/3002146211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca98157980 0x7fca9815eb10 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.103+0000 7fca9c972640 1 -- 172.21.15.38:0/3002146211 >> 172.21.15.38:0/3002146211 conn(0x7fca980d31f0 msgr2=0x7fca980d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:56.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.103+0000 7fca9c972640 1 -- 172.21.15.38:0/3002146211 shutdown_connections 2023-12-22T08:53:56.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.103+0000 7fca9c972640 1 -- 172.21.15.38:0/3002146211 wait complete. 2023-12-22T08:53:56.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.105+0000 7fca9c972640 1 Processor -- start 2023-12-22T08:53:56.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.105+0000 7fca9c972640 1 -- start start 2023-12-22T08:53:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.106+0000 7fca9c972640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca980b3ff0 0x7fca981485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.106+0000 7fca9c972640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca980b44a0 0x7fca9806cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.106+0000 7fca9c972640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca98157980 0x7fca9806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.106+0000 7fca9c972640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca980ac9f0 con 0x7fca980b44a0 2023-12-22T08:53:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.106+0000 7fca9c972640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca980b2670 con 0x7fca980b3ff0 2023-12-22T08:53:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.106+0000 7fca9c972640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca981593c0 con 0x7fca98157980 2023-12-22T08:53:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.107+0000 7fca8e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca980b44a0 0x7fca9806cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.107+0000 7fca8e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca980b44a0 0x7fca9806cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57632/0 (socket says 172.21.15.38:57632) 2023-12-22T08:53:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.107+0000 7fca8e59c640 1 -- 172.21.15.38:0/1085813420 learned_addr learned my addr 172.21.15.38:0/1085813420 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.107+0000 7fca96d9d640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca980b3ff0 0x7fca981485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:56.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.107+0000 7fca8e59c640 1 -- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca98157980 msgr2=0x7fca9806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:56.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.107+0000 7fca9759e640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca98157980 0x7fca9806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:56.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.107+0000 7fca8e59c640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca98157980 0x7fca9806d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.107+0000 7fca8e59c640 1 -- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca980b3ff0 msgr2=0x7fca981485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:56.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.107+0000 7fca8e59c640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca980b3ff0 0x7fca981485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.107+0000 7fca8e59c640 1 -- 172.21.15.38:0/1085813420 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca880094d0 con 0x7fca980b44a0 2023-12-22T08:53:56.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.107+0000 7fca9759e640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca98157980 0x7fca9806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:56.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.107+0000 7fca8e59c640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca980b44a0 0x7fca9806cba0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fca8000c7f0 tx=0x7fca8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:56.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.108+0000 7fca8ffff640 1 -- 172.21.15.38:0/1085813420 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80004220 con 0x7fca980b44a0 2023-12-22T08:53:56.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.108+0000 7fca8ffff640 1 -- 172.21.15.38:0/1085813420 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca80004380 con 0x7fca980b44a0 2023-12-22T08:53:56.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.108+0000 7fca8ffff640 1 -- 172.21.15.38:0/1085813420 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80007840 con 0x7fca980b44a0 2023-12-22T08:53:56.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.108+0000 7fca9c972640 1 -- 172.21.15.38:0/1085813420 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca981596a0 con 0x7fca980b44a0 2023-12-22T08:53:56.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.108+0000 7fca9c972640 1 -- 172.21.15.38:0/1085813420 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca98159c60 con 0x7fca980b44a0 2023-12-22T08:53:56.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.109+0000 7fca9c972640 1 -- 172.21.15.38:0/1085813420 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca98061910 con 0x7fca980b44a0 2023-12-22T08:53:56.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.110+0000 7fca8ffff640 1 -- 172.21.15.38:0/1085813420 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca80007bb0 con 0x7fca980b44a0 2023-12-22T08:53:56.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.111+0000 7fca8ffff640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca7806a430 0x7fca7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:56.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.111+0000 7fca8ffff640 1 -- 172.21.15.38:0/1085813420 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fca800885c0 con 0x7fca980b44a0 2023-12-22T08:53:56.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.112+0000 7fca96d9d640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca7806a430 0x7fca7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:56.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.113+0000 7fca96d9d640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca7806a430 0x7fca7806c8f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fca88036000 tx=0x7fca88008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:56.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.115+0000 7fca8ffff640 1 -- 172.21.15.38:0/1085813420 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fca80053e10 con 0x7fca980b44a0 2023-12-22T08:53:56.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.308+0000 7fca9c972640 1 -- 172.21.15.38:0/1085813420 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca98157d60 con 0x7fca7806a430 2023-12-22T08:53:56.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.315+0000 7fca8ffff640 1 -- 172.21.15.38:0/1085813420 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47462 (secure 0 0 0) 0x7fca88030810 con 0x7fca7806a430 2023-12-22T08:53:56.316 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:56.316 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:53:56.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.317+0000 7fca9c972640 1 -- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca7806a430 msgr2=0x7fca7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:56.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.317+0000 7fca9c972640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca7806a430 0x7fca7806c8f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fca88036000 tx=0x7fca88008030 comp rx=0 tx=0).stop 2023-12-22T08:53:56.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.317+0000 7fca9c972640 1 -- 172.21.15.38:0/1085813420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca980b44a0 msgr2=0x7fca9806cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:56.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.317+0000 7fca9c972640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca980b44a0 0x7fca9806cba0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fca8000c7f0 tx=0x7fca8000ccb0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.317+0000 7fca9c972640 1 -- 172.21.15.38:0/1085813420 shutdown_connections 2023-12-22T08:53:56.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.317+0000 7fca9c972640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca98157980 0x7fca9806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.317+0000 7fca9c972640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fca7806a430 0x7fca7806c8f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.317+0000 7fca9c972640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca980b44a0 0x7fca9806cba0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.317+0000 7fca9c972640 1 --2- 172.21.15.38:0/1085813420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca980b3ff0 0x7fca981485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.317+0000 7fca9c972640 1 -- 172.21.15.38:0/1085813420 >> 172.21.15.38:0/1085813420 conn(0x7fca980d31f0 msgr2=0x7fca9806f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:56.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.318+0000 7fca9c972640 1 -- 172.21.15.38:0/1085813420 shutdown_connections 2023-12-22T08:53:56.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.318+0000 7fca9c972640 1 -- 172.21.15.38:0/1085813420 wait complete. 2023-12-22T08:53:56.337 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":612,"stamp":"2023-12-22T08:53:54.664861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9835,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552664,"statfs":{"total":1600000000,"available":1589928755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490837,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002138"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":325,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-12-22T08:53:51.978298+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:53:51.978298+0000","last_peered":"2023-12-22T08:53:51.978298+0000","last_clean":"2023-12-22T08:53:51.978298+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:53:51.978298+0000","last_undegraded":"2023-12-22T08:53:51.978298+0000","last_fullsized":"2023-12-22T08:53:51.978298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575019,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0900000000000001,"15min":1.0880000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58199999999999996},"max":{"1min":1.5309999999999999,"5min":1.8700000000000001,"15min":2.0249999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.1100000000000001,"15min":1.095},"min":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.70099999999999996},"max":{"1min":1.3600000000000001,"5min":1.6499999999999999,"15min":1.6819999999999999},"last":1.0609999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2709999999999999,"15min":1.212},"min":{"1min":0.85599999999999998,"5min":0.70899999999999996,"15min":0.64200000000000002},"max":{"1min":1.671,"5min":1.6779999999999999,"15min":1.905},"last":1.55},{"interface":"front","average":{"1min":1.294,"5min":1.2769999999999999,"15min":1.228},"min":{"1min":0.83399999999999996,"5min":0.78800000000000003,"15min":0.67100000000000004},"max":{"1min":1.5289999999999999,"5min":1.758,"15min":1.865},"last":1.45}]},{"osd":2,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.204,"15min":1.151},"min":{"1min":0.79400000000000004,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5309999999999999,"5min":1.7150000000000001,"15min":2.0150000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.177,"5min":1.2270000000000001,"15min":1.22},"min":{"1min":0.81699999999999995,"5min":0.76100000000000001,"15min":0.68700000000000006},"max":{"1min":1.5640000000000001,"5min":1.7030000000000001,"15min":2.1379999999999999},"last":0.96199999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2649999999999999,"15min":1.2050000000000001},"min":{"1min":0.92800000000000005,"5min":0.875,"15min":0.71399999999999997},"max":{"1min":1.5900000000000001,"5min":1.766,"15min":2.0680000000000001},"last":1.014},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3100000000000001},"min":{"1min":0.98999999999999999,"5min":0.78000000000000003,"15min":0.71799999999999997},"max":{"1min":1.633,"5min":1.778,"15min":2.2959999999999998},"last":1.484}]},{"osd":4,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1879999999999999,"15min":1.2},"min":{"1min":0.79800000000000004,"5min":0.56699999999999995,"15min":0.48699999999999999},"max":{"1min":1.5349999999999999,"5min":1.7430000000000001,"15min":2.0760000000000001},"last":1.222},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.282,"15min":1.274},"min":{"1min":0.82399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6279999999999999,"5min":1.899,"15min":2.2749999999999999},"last":1.3149999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.304,"15min":1.355},"min":{"1min":0.99399999999999999,"5min":0.60699999999999998,"15min":0.51800000000000002},"max":{"1min":1.76,"5min":1.8280000000000001,"15min":2.4300000000000002},"last":1.258},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3260000000000001,"15min":1.3620000000000001},"min":{"1min":1.0089999999999999,"5min":0.627,"15min":0.623},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.3410000000000002},"last":1.1499999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.4990000000000001},"min":{"1min":0.98699999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":2.355},"last":1.367},{"interface":"front","average":{"1min":1.427,"5min":1.4550000000000001,"15min":1.482},"min":{"1min":1.097,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.137,"5min":2.137,"15min":2.4849999999999999},"last":1.421}]}]},{"osd":6,"up_from":13,"seq":55834575019,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.123,"15min":1.2230000000000001},"min":{"1min":0.70699999999999996,"5min":0.66000000000000003,"15min":0.42099999999999999},"max":{"1min":1.3799999999999999,"5min":1.6519999999999999,"15min":28.361000000000001},"last":1.609},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1759999999999999,"15min":1.1519999999999999},"min":{"1min":0.90700000000000003,"5min":0.629,"15min":0.629},"max":{"1min":1.5629999999999999,"5min":1.675,"15min":3.0670000000000002},"last":1.361}]},{"osd":1,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.113,"15min":1.0900000000000001},"min":{"1min":0.85299999999999998,"5min":0.71499999999999997,"15min":0.58999999999999997},"max":{"1min":1.655,"5min":1.655,"15min":2.1150000000000002},"last":1.323},{"interface":"front","average":{"1min":1.248,"5min":1.234,"15min":1.25},"min":{"1min":0.93200000000000005,"5min":0.74299999999999999,"15min":0.63100000000000001},"max":{"1min":1.762,"5min":1.762,"15min":15.324999999999999},"last":1.129}]},{"osd":2,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.246,"15min":1.2989999999999999},"min":{"1min":0.94899999999999995,"5min":0.79800000000000004,"15min":0.65700000000000003},"max":{"1min":1.8899999999999999,"5min":1.9259999999999999,"15min":15.422000000000001},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.23,"15min":1.2490000000000001},"min":{"1min":0.90500000000000003,"5min":0.81100000000000005,"15min":0.58599999999999997},"max":{"1min":1.5620000000000001,"5min":1.7,"15min":10.173999999999999},"last":1.6930000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.29,"15min":1.3320000000000001},"min":{"1min":0.90400000000000003,"5min":0.877,"15min":0.72899999999999998},"max":{"1min":1.6379999999999999,"5min":1.671,"15min":10.096},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.276,"15min":1.258},"min":{"1min":0.86499999999999999,"5min":0.83199999999999996,"15min":0.71399999999999997},"max":{"1min":1.7010000000000001,"5min":1.702,"15min":2.3889999999999998},"last":1.262}]},{"osd":4,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2470000000000001,"15min":1.3720000000000001},"min":{"1min":0.83199999999999996,"5min":0.64200000000000002,"15min":0.52000000000000002},"max":{"1min":1.794,"5min":1.794,"15min":15.378},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.3400000000000001,"15min":1.4179999999999999},"min":{"1min":1.071,"5min":0.80700000000000005,"15min":0.68999999999999995},"max":{"1min":1.802,"5min":1.802,"15min":13.178000000000001},"last":1.5609999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.2410000000000001,"15min":1.365},"min":{"1min":0.83399999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.855,"5min":1.855,"15min":19.995000000000001},"last":1.177},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4339999999999999,"15min":1.5449999999999999},"min":{"1min":1.125,"5min":0.98499999999999999,"15min":0.67600000000000005},"max":{"1min":1.9850000000000001,"5min":2.1989999999999998,"15min":15.679},"last":1.675}]},{"osd":7,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.46,"15min":1.522},"min":{"1min":1.0900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.746,"5min":1.845,"15min":3.2429999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.4610000000000001,"15min":1.4890000000000001},"min":{"1min":1.046,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.927,"5min":1.972,"15min":4.6609999999999996},"last":1.496}]}]},{"osd":5,"up_from":13,"seq":55834575019,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1660,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193651,"statfs":{"total":200000000,"available":198299210,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.155,"15min":1.105},"min":{"1min":0.80200000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6850000000000001,"5min":1.8939999999999999,"15min":1.944},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.1479999999999999,"15min":1.121},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.65300000000000002},"max":{"1min":1.51,"5min":1.9279999999999999,"15min":3.1379999999999999},"last":1.464}]},{"osd":1,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1739999999999999,"15min":1.139},"min":{"1min":0.67400000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.4159999999999999,"5min":1.714,"15min":2.79},"last":1.49},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1950000000000001,"15min":1.109},"min":{"1min":0.82299999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.462,"5min":1.7430000000000001,"15min":1.7509999999999999},"last":0.98299999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1850000000000001,"15min":1.1579999999999999},"min":{"1min":0.77200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.403,"5min":1.675,"15min":1.8819999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2949999999999999,"15min":1.2330000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.74299999999999999},"max":{"1min":1.552,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.425}]},{"osd":3,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2549999999999999,"15min":1.222},"min":{"1min":0.85899999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5920000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.327,"15min":1.284},"min":{"1min":0.74199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.772,"5min":1.875,"15min":2.1499999999999999},"last":1.407}]},{"osd":4,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.57899999999999996},"max":{"1min":1.583,"5min":1.8380000000000001,"15min":1.853},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2769999999999999,"15min":1.2629999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"max":{"1min":1.5600000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.86799999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3420000000000001,"15min":1.3280000000000001},"min":{"1min":0.65200000000000002,"5min":0.55300000000000005,"15min":0.54600000000000004},"max":{"1min":1.663,"5min":1.792,"15min":1.821},"last":1.042},{"interface":"front","average":{"1min":1.337,"5min":1.4219999999999999,"15min":1.4119999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.601,"5min":1.952,"15min":2.8780000000000001},"last":1.554}]},{"osd":7,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.4079999999999999,"15min":1.3999999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.673,"5min":2.0960000000000001,"15min":2.2189999999999999},"last":1.169},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4770000000000001,"15min":1.498},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9139999999999999,"5min":2.056,"15min":4.7249999999999996},"last":1.323}]}]},{"osd":4,"up_from":13,"seq":55834575019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.1180000000000001,"15min":1.0529999999999999},"min":{"1min":0.66600000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3540000000000001,"5min":6.4969999999999999,"15min":6.4969999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1499999999999999,"15min":1.1279999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.58199999999999996},"max":{"1min":1.4910000000000001,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":1.119}]},{"osd":1,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.171,"15min":1.111},"min":{"1min":0.86599999999999999,"5min":0.63200000000000001,"15min":0.54100000000000004},"max":{"1min":1.679,"5min":6.2999999999999998,"15min":6.2999999999999998},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.3280000000000001,"15min":1.1819999999999999},"min":{"1min":0.82199999999999995,"5min":0.79100000000000004,"15min":0.57399999999999995},"max":{"1min":1.4430000000000001,"5min":17.562999999999999,"15min":17.562999999999999},"last":1.238}]},{"osd":2,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.262,"15min":1.1899999999999999},"min":{"1min":0.86299999999999999,"5min":0.78600000000000003,"15min":0.65700000000000003},"max":{"1min":1.4770000000000001,"5min":9.0329999999999995,"15min":9.0329999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.224,"5min":1.3049999999999999,"15min":1.246},"min":{"1min":0.85099999999999998,"5min":0.748,"15min":0.748},"max":{"1min":1.6180000000000001,"5min":8.2029999999999994,"15min":8.2029999999999994},"last":1.5409999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3400000000000001,"15min":1.256},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.68500000000000005},"max":{"1min":1.5469999999999999,"5min":8.8160000000000007,"15min":8.8160000000000007},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.385,"15min":1.3100000000000001},"min":{"1min":1.0620000000000001,"5min":0.82299999999999995,"15min":0.82099999999999995},"max":{"1min":1.714,"5min":10.157999999999999,"15min":10.157999999999999},"last":1.427}]},{"osd":5,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.266,"15min":1.2010000000000001},"min":{"1min":0.79400000000000004,"5min":0.67900000000000005,"15min":0.52400000000000002},"max":{"1min":1.6899999999999999,"5min":7.056,"15min":7.056},"last":1.069},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.4990000000000001,"15min":1.4399999999999999},"min":{"1min":1.0449999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5920000000000001,"5min":9.0700000000000003,"15min":9.0700000000000003},"last":1.2809999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.363,"15min":1.3200000000000001},"min":{"1min":0.82499999999999996,"5min":0.62,"15min":0.58599999999999997},"max":{"1min":1.8049999999999999,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.3600000000000001,"15min":1.302},"min":{"1min":0.95899999999999996,"5min":0.82399999999999995,"15min":0.59199999999999997},"max":{"1min":2.052,"5min":5.2089999999999996,"15min":5.2089999999999996},"last":1.3140000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4910000000000001,"15min":1.4339999999999999},"min":{"1min":1.022,"5min":0.70199999999999996,"15min":0.67300000000000004},"max":{"1min":1.7170000000000001,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.581,"15min":1.5149999999999999},"min":{"1min":1.3680000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.8740000000000001,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.4910000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575019,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.39800000000000002},"max":{"1min":1.4139999999999999,"5min":1.4770000000000001,"15min":1.8340000000000001},"last":1.042},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.999,"15min":0.95099999999999996},"min":{"1min":0.65900000000000003,"5min":0.44,"15min":0.38900000000000001},"max":{"1min":1.482,"5min":1.5249999999999999,"15min":2.5270000000000001},"last":0.98899999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.002,"15min":0.91900000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.34499999999999997},"max":{"1min":1.3999999999999999,"5min":1.772,"15min":1.772},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.252,"15min":1.1830000000000001},"min":{"1min":0.754,"5min":0.53700000000000003,"15min":0.46200000000000002},"max":{"1min":1.6619999999999999,"5min":1.825,"15min":1.861},"last":1.137}]},{"osd":2,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1619999999999999,"15min":1.079},"min":{"1min":0.64400000000000002,"5min":0.625,"15min":0.41899999999999998},"max":{"1min":1.619,"5min":1.659,"15min":1.7350000000000001},"last":1.554},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.1990000000000001,"15min":1.165},"min":{"1min":0.77600000000000002,"5min":0.69799999999999995,"15min":0.45100000000000001},"max":{"1min":1.6859999999999999,"5min":1.8120000000000001,"15min":1.9570000000000001},"last":0.91700000000000004}]},{"osd":4,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2450000000000001,"15min":1.2290000000000001},"min":{"1min":0.83299999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5900000000000001,"5min":1.6870000000000001,"15min":2.7210000000000001},"last":1.3},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.351,"15min":1.296},"min":{"1min":0.96799999999999997,"5min":0.873,"15min":0.745},"max":{"1min":1.546,"5min":1.9850000000000001,"15min":2.3999999999999999},"last":1.8899999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4259999999999999,"15min":1.349},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.66700000000000004},"max":{"1min":1.6950000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.411,"15min":1.399},"min":{"1min":1.0009999999999999,"5min":0.78600000000000003,"15min":0.73699999999999999},"max":{"1min":1.762,"5min":2.2629999999999999,"15min":2.3839999999999999},"last":1.24}]},{"osd":6,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4890000000000001,"15min":1.4550000000000001},"min":{"1min":1.099,"5min":1.008,"15min":0.88100000000000001},"max":{"1min":1.768,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.4059999999999999,"15min":1.379},"min":{"1min":0.97299999999999998,"5min":0.84899999999999998,"15min":0.75900000000000001},"max":{"1min":1.9590000000000001,"5min":1.968,"15min":2.8250000000000002},"last":1.181}]},{"osd":7,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4770000000000001,"15min":1.419},"min":{"1min":1.0409999999999999,"5min":0.91600000000000004,"15min":0.77100000000000002},"max":{"1min":1.891,"5min":2.056,"15min":2.7850000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.5189999999999999,"15min":1.452},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.80600000000000005},"max":{"1min":1.869,"5min":2.2290000000000001,"15min":2.3740000000000001},"last":1.804}]}]},{"osd":2,"up_from":13,"seq":55834575019,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88400000000000001,"15min":0.86199999999999999},"min":{"1min":0.57299999999999995,"5min":0.432,"15min":0.32000000000000001},"max":{"1min":1.278,"5min":1.8340000000000001,"15min":6.8879999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.03,"5min":0.98899999999999999,"15min":0.94899999999999995},"min":{"1min":0.64700000000000002,"5min":0.39100000000000001,"15min":0.35799999999999998},"max":{"1min":1.5389999999999999,"5min":1.7589999999999999,"15min":4.5510000000000002},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.92600000000000005,"15min":0.95599999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":11.308999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.111,"15min":1.046},"min":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.44600000000000001},"max":{"1min":1.4650000000000001,"5min":1.738,"15min":2.9889999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.179,"15min":1.135},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":1.6439999999999999,"5min":1.772,"15min":13.087999999999999},"last":1.145},{"interface":"front","average":{"1min":1.288,"5min":1.246,"15min":1.23},"min":{"1min":0.71899999999999997,"5min":0.61299999999999999,"15min":0.52300000000000002},"max":{"1min":1.585,"5min":2.0720000000000001,"15min":12.289999999999999},"last":1.117}]},{"osd":4,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.369,"15min":1.3420000000000001},"min":{"1min":1.0660000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":3.5249999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.337},"min":{"1min":0.83799999999999997,"5min":0.80500000000000005,"15min":0.61499999999999999},"max":{"1min":1.871,"5min":2.0539999999999998,"15min":13.927},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3819999999999999,"15min":1.3759999999999999},"min":{"1min":1.0489999999999999,"5min":0.70299999999999996,"15min":0.64000000000000001},"max":{"1min":1.724,"5min":1.9750000000000001,"15min":11.003},"last":1.345},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":1.002,"5min":0.504,"15min":0.504},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":13.129},"last":1.2669999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.389,"15min":1.371},"min":{"1min":0.88500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.8999999999999999,"5min":1.978,"15min":8.1609999999999996},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.498,"15min":1.464},"min":{"1min":0.93899999999999995,"5min":0.89900000000000002,"15min":0.69999999999999996},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":6.8150000000000004},"last":1.4350000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4419999999999999,"15min":1.425},"min":{"1min":0.78600000000000003,"5min":0.76200000000000001,"15min":0.61299999999999999},"max":{"1min":2.0270000000000001,"5min":2.1309999999999998,"15min":10.948},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.4950000000000001,"15min":1.496},"min":{"1min":1.0780000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":9.0239999999999991},"last":1.4119999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575019,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1661,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193650,"statfs":{"total":200000000,"available":198298191,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":0.98499999999999999},"min":{"1min":0.56499999999999995,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":2.5680000000000001,"5min":23.059000000000001,"15min":23.059000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.026,"5min":1.1819999999999999,"15min":1.1140000000000001},"min":{"1min":0.59799999999999998,"5min":0.41099999999999998,"15min":0.39900000000000002},"max":{"1min":1.3939999999999999,"5min":9.9749999999999996,"15min":9.9749999999999996},"last":1.0269999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.286,"15min":1.0700000000000001},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.45500000000000002},"max":{"1min":7.9880000000000004,"5min":22.977,"15min":22.977},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.117,"15min":1.034},"min":{"1min":0.52300000000000002,"5min":0.48999999999999999,"15min":0.34999999999999998},"max":{"1min":9.4440000000000008,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.92300000000000004}]},{"osd":3,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.3400000000000001,"15min":1.274},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.51800000000000002},"max":{"1min":1.7050000000000001,"5min":1.9770000000000001,"15min":2.5169999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1499999999999999,"15min":1.0580000000000001},"min":{"1min":0.622,"5min":0.58699999999999997,"15min":0.47799999999999998},"max":{"1min":5.3470000000000004,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":1.5449999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.5229999999999999,"15min":1.3600000000000001},"min":{"1min":0.82399999999999995,"5min":0.73999999999999999,"15min":0.58699999999999997},"max":{"1min":2.7069999999999999,"5min":23.145,"15min":23.145},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.5209999999999999,"15min":1.431},"min":{"1min":0.89200000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.6699999999999999,"5min":9.9299999999999997,"15min":9.9299999999999997},"last":1.264}]},{"osd":5,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.323,"15min":1.278},"min":{"1min":0.80300000000000005,"5min":0.77700000000000002,"15min":0.58699999999999997},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":4.6399999999999997},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.431,"5min":1.6180000000000001,"15min":1.4510000000000001},"min":{"1min":0.90400000000000003,"5min":0.71699999999999997,"15min":0.66800000000000004},"max":{"1min":2.758,"5min":23.105,"15min":23.105},"last":1.2969999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.381,"15min":1.3340000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.65200000000000002},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":4.5819999999999999},"last":1.329},{"interface":"front","average":{"1min":1.486,"5min":1.726,"15min":1.516},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.67200000000000004},"max":{"1min":2.657,"5min":24.341999999999999,"15min":24.341999999999999},"last":1.518}]},{"osd":7,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4390000000000001,"15min":1.4339999999999999},"min":{"1min":0.88400000000000001,"5min":0.78800000000000003,"15min":0.64400000000000002},"max":{"1min":1.732,"5min":2.0870000000000002,"15min":2.4889999999999999},"last":1.373},{"interface":"front","average":{"1min":1.514,"5min":1.472,"15min":1.4430000000000001},"min":{"1min":0.96199999999999997,"5min":0.82099999999999995,"15min":0.66200000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":4.508},"last":1.423}]}]},{"osd":0,"up_from":13,"seq":55834575019,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":0.94699999999999995,"15min":0.84699999999999998},"min":{"1min":0.61399999999999999,"5min":0.432,"15min":0.36599999999999999},"max":{"1min":7.3499999999999996,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.042,"15min":0.96399999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.33700000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.95499999999999996}]},{"osd":2,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90300000000000002,"15min":0.85599999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.373},"max":{"1min":1.617,"5min":1.617,"15min":1.6739999999999999},"last":1.212},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.056,"15min":1.02},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.40000000000000002},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":2.1219999999999999},"last":1.304}]},{"osd":3,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.288,"15min":1.1599999999999999},"min":{"1min":0.65200000000000002,"5min":0.56299999999999994,"15min":0.44500000000000001},"max":{"1min":7.6550000000000002,"5min":7.6550000000000002,"15min":7.6550000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.24,"5min":1.3280000000000001,"15min":1.2090000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.39100000000000001},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":2.145},"last":1.0489999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0049999999999999,"5min":1.4910000000000001,"15min":1.367},"min":{"1min":0.88,"5min":0.81200000000000006,"15min":0.70799999999999996},"max":{"1min":7.7370000000000001,"5min":7.7370000000000001,"15min":7.7370000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.4370000000000001,"15min":1.335},"min":{"1min":0.93500000000000005,"5min":0.82999999999999996,"15min":0.70599999999999996},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":1.48}]},{"osd":5,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.335},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.59299999999999997},"max":{"1min":2.843,"5min":2.843,"15min":5.4290000000000003},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.831,"5min":1.46,"15min":1.361},"min":{"1min":1.048,"5min":0.85799999999999998,"15min":0.73599999999999999},"max":{"1min":7.8579999999999997,"5min":7.8579999999999997,"15min":7.8579999999999997},"last":1.25}]},{"osd":6,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.4019999999999999,"15min":1.353},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.64800000000000002},"max":{"1min":1.7609999999999999,"5min":1.9330000000000001,"15min":2.4420000000000002},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.52,"15min":1.4610000000000001},"min":{"1min":0.97099999999999997,"5min":0.95799999999999996,"15min":0.69099999999999995},"max":{"1min":2.1070000000000002,"5min":2.109,"15min":2.577},"last":1.4530000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.508,"15min":1.4430000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.755},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.9810000000000001,"5min":1.595,"15min":1.4770000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":7.8029999999999999,"5min":7.8029999999999999,"15min":7.8029999999999999},"last":1.425}]}]}],"pool_statfs":[]}} 2023-12-22T08:53:56.339 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-22T08:53:56.339 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:53:56.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.562+0000 7f710790a640 1 Processor -- start 2023-12-22T08:53:56.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.562+0000 7f710790a640 1 -- start start 2023-12-22T08:53:56.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.564+0000 7f710790a640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f71000b2170 0x7f71000b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:56.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.564+0000 7f710790a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71000720b0 0x7f710015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:56.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.564+0000 7f710790a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f710015b460 0x7f710015f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:56.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.564+0000 7f710790a640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71000af850 con 0x7f71000b2170 2023-12-22T08:53:56.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.564+0000 7f710790a640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710006c270 con 0x7f71000720b0 2023-12-22T08:53:56.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.564+0000 7f710790a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71000b2a90 con 0x7f710015b460 2023-12-22T08:53:56.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.564+0000 7f71056a6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f71000b2170 0x7f71000b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:56.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.564+0000 7f71056a6640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f71000b2170 0x7f71000b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57642/0 (socket says 172.21.15.38:57642) 2023-12-22T08:53:56.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.564+0000 7f71056a6640 1 -- 172.21.15.38:0/2511874082 learned_addr learned my addr 172.21.15.38:0/2511874082 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:56.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.565+0000 7f71056a6640 1 -- 172.21.15.38:0/2511874082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f710015b460 msgr2=0x7f710015f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:56.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.565+0000 7f7104ea5640 1 --2- 172.21.15.38:0/2511874082 >> v2:172.21.15.89:3300/0 conn(0x7f71000720b0 0x7f710015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:56.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.565+0000 7f7105ea7640 1 --2- 172.21.15.38:0/2511874082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f710015b460 0x7f710015f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:56.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.565+0000 7f71056a6640 1 --2- 172.21.15.38:0/2511874082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f710015b460 0x7f710015f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.565+0000 7f71056a6640 1 -- 172.21.15.38:0/2511874082 >> v2:172.21.15.89:3300/0 conn(0x7f71000720b0 msgr2=0x7f710015ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:56.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.565+0000 7f71056a6640 1 --2- 172.21.15.38:0/2511874082 >> v2:172.21.15.89:3300/0 conn(0x7f71000720b0 0x7f710015ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.565+0000 7f71056a6640 1 -- 172.21.15.38:0/2511874082 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71000708a0 con 0x7f71000b2170 2023-12-22T08:53:56.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.565+0000 7f7105ea7640 1 --2- 172.21.15.38:0/2511874082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f710015b460 0x7f710015f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:56.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.566+0000 7f71056a6640 1 --2- 172.21.15.38:0/2511874082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71000b2170 0x7f71000b2550 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f71000b0cc0 tx=0x7f70fc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6555510bf34c013 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:56.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.566+0000 7f70f7fff640 1 -- 172.21.15.38:0/2511874082 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0317e0 con 0x7f71000b2170 2023-12-22T08:53:56.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.566+0000 7f70f7fff640 1 -- 172.21.15.38:0/2511874082 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc031940 con 0x7f71000b2170 2023-12-22T08:53:56.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.566+0000 7f70f7fff640 1 -- 172.21.15.38:0/2511874082 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc031cd0 con 0x7f71000b2170 2023-12-22T08:53:56.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.567+0000 7f710790a640 1 -- 172.21.15.38:0/2511874082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71000b2170 msgr2=0x7f71000b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:56.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.567+0000 7f710790a640 1 --2- 172.21.15.38:0/2511874082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71000b2170 0x7f71000b2550 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f71000b0cc0 tx=0x7f70fc02b880 comp rx=0 tx=0).stop 2023-12-22T08:53:56.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.567+0000 7f710790a640 1 -- 172.21.15.38:0/2511874082 shutdown_connections 2023-12-22T08:53:56.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.567+0000 7f710790a640 1 --2- 172.21.15.38:0/2511874082 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f710015b460 0x7f710015f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.567+0000 7f710790a640 1 --2- 172.21.15.38:0/2511874082 >> v2:172.21.15.89:3300/0 conn(0x7f71000720b0 0x7f710015ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.567+0000 7f710790a640 1 --2- 172.21.15.38:0/2511874082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71000b2170 0x7f71000b2550 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.567+0000 7f710790a640 1 -- 172.21.15.38:0/2511874082 >> 172.21.15.38:0/2511874082 conn(0x7f71000cf010 msgr2=0x7f71000cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:56.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.568+0000 7f710790a640 1 -- 172.21.15.38:0/2511874082 shutdown_connections 2023-12-22T08:53:56.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.568+0000 7f710790a640 1 -- 172.21.15.38:0/2511874082 wait complete. 2023-12-22T08:53:56.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.569+0000 7f710790a640 1 Processor -- start 2023-12-22T08:53:56.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.569+0000 7f710790a640 1 -- start start 2023-12-22T08:53:56.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.570+0000 7f710790a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71000720b0 0x7f710015a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:56.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.570+0000 7f710790a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71000b2170 0x7f710015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:56.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.570+0000 7f710790a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f710015b460 0x7f71001f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:56.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.570+0000 7f710790a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71001f2e20 con 0x7f71000b2170 2023-12-22T08:53:56.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.570+0000 7f710790a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71001598f0 con 0x7f71000720b0 2023-12-22T08:53:56.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.570+0000 7f710790a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7100158d70 con 0x7f710015b460 2023-12-22T08:53:56.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.571+0000 7f7104ea5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71000b2170 0x7f710015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:56.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.571+0000 7f7104ea5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71000b2170 0x7f710015a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57644/0 (socket says 172.21.15.38:57644) 2023-12-22T08:53:56.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.571+0000 7f7104ea5640 1 -- 172.21.15.38:0/3814247396 learned_addr learned my addr 172.21.15.38:0/3814247396 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:56.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.571+0000 7f7105ea7640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f710015b460 0x7f71001f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:56.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.571+0000 7f71056a6640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71000720b0 0x7f710015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:56.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.571+0000 7f7104ea5640 1 -- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f710015b460 msgr2=0x7f71001f3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:56.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.571+0000 7f7104ea5640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f710015b460 0x7f71001f3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.571+0000 7f7104ea5640 1 -- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71000720b0 msgr2=0x7f710015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:56.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.571+0000 7f7104ea5640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71000720b0 0x7f710015a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.571+0000 7f7104ea5640 1 -- 172.21.15.38:0/3814247396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0094d0 con 0x7f71000b2170 2023-12-22T08:53:56.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.571+0000 7f71056a6640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71000720b0 0x7f710015a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:56.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.572+0000 7f7104ea5640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71000b2170 0x7f710015a8b0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c7f0 tx=0x7f70f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:56.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.572+0000 7f70f5ffb640 1 -- 172.21.15.38:0/3814247396 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0004220 con 0x7f71000b2170 2023-12-22T08:53:56.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.572+0000 7f70f5ffb640 1 -- 172.21.15.38:0/3814247396 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f0004380 con 0x7f71000b2170 2023-12-22T08:53:56.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.572+0000 7f70f5ffb640 1 -- 172.21.15.38:0/3814247396 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0007860 con 0x7f71000b2170 2023-12-22T08:53:56.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.572+0000 7f710790a640 1 -- 172.21.15.38:0/3814247396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7100159050 con 0x7f71000b2170 2023-12-22T08:53:56.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.572+0000 7f710790a640 1 -- 172.21.15.38:0/3814247396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7100159610 con 0x7f71000b2170 2023-12-22T08:53:56.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.573+0000 7f710790a640 1 -- 172.21.15.38:0/3814247396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71001f2f90 con 0x7f71000b2170 2023-12-22T08:53:56.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.574+0000 7f70f5ffb640 1 -- 172.21.15.38:0/3814247396 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f70f0007bd0 con 0x7f71000b2170 2023-12-22T08:53:56.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.576+0000 7f70f5ffb640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f70e406a430 0x7f70e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:56.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.576+0000 7f70f5ffb640 1 -- 172.21.15.38:0/3814247396 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f70f0088600 con 0x7f71000b2170 2023-12-22T08:53:56.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.576+0000 7f71056a6640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f70e406a430 0x7f70e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:56.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.577+0000 7f71056a6640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f70e406a430 0x7f70e406c8f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f70fc036000 tx=0x7f70fc03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:56.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.581+0000 7f70f5ffb640 1 -- 172.21.15.38:0/3814247396 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f71001f2f90 con 0x7f71000b2170 2023-12-22T08:53:56.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.768+0000 7f710790a640 1 -- 172.21.15.38:0/3814247396 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7100070e60 con 0x7f70e406a430 2023-12-22T08:53:56.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.775+0000 7f70f5ffb640 1 -- 172.21.15.38:0/3814247396 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47462 (secure 0 0 0) 0x7f70fc031c30 con 0x7f70e406a430 2023-12-22T08:53:56.776 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:56.776 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:53:56.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.777+0000 7f710790a640 1 -- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f70e406a430 msgr2=0x7f70e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:56.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.777+0000 7f710790a640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f70e406a430 0x7f70e406c8f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f70fc036000 tx=0x7f70fc03d040 comp rx=0 tx=0).stop 2023-12-22T08:53:56.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.777+0000 7f710790a640 1 -- 172.21.15.38:0/3814247396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71000b2170 msgr2=0x7f710015a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:56.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.777+0000 7f710790a640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71000b2170 0x7f710015a8b0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c7f0 tx=0x7f70f000ccb0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.777+0000 7f710790a640 1 -- 172.21.15.38:0/3814247396 shutdown_connections 2023-12-22T08:53:56.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.777+0000 7f710790a640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f710015b460 0x7f71001f3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.777+0000 7f710790a640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f70e406a430 0x7f70e406c8f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.777+0000 7f710790a640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71000b2170 0x7f710015a8b0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.777+0000 7f710790a640 1 --2- 172.21.15.38:0/3814247396 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71000720b0 0x7f710015a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:56.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.777+0000 7f710790a640 1 -- 172.21.15.38:0/3814247396 >> 172.21.15.38:0/3814247396 conn(0x7f71000cf010 msgr2=0x7f71000b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:56.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.777+0000 7f710790a640 1 -- 172.21.15.38:0/3814247396 shutdown_connections 2023-12-22T08:53:56.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:56.777+0000 7f710790a640 1 -- 172.21.15.38:0/3814247396 wait complete. 2023-12-22T08:53:56.796 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":613,"stamp":"2023-12-22T08:53:56.665475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9835,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552664,"statfs":{"total":1600000000,"available":1589928755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490837,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.735788"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":325,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-12-22T08:53:51.978298+0000","last_change":"2023-12-22T08:39:49.860856+0000","last_active":"2023-12-22T08:53:51.978298+0000","last_peered":"2023-12-22T08:53:51.978298+0000","last_clean":"2023-12-22T08:53:51.978298+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:53:51.978298+0000","last_undegraded":"2023-12-22T08:53:51.978298+0000","last_fullsized":"2023-12-22T08:53:51.978298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:39:48.822667+0000","last_clean_scrub_stamp":"2023-12-22T08:39:48.822667+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:53:44.474555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575019,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0900000000000001,"15min":1.0880000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58199999999999996},"max":{"1min":1.5309999999999999,"5min":1.8700000000000001,"15min":2.0249999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.1100000000000001,"15min":1.095},"min":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.70099999999999996},"max":{"1min":1.3600000000000001,"5min":1.6499999999999999,"15min":1.6819999999999999},"last":1.0609999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2709999999999999,"15min":1.212},"min":{"1min":0.85599999999999998,"5min":0.70899999999999996,"15min":0.64200000000000002},"max":{"1min":1.671,"5min":1.6779999999999999,"15min":1.905},"last":1.55},{"interface":"front","average":{"1min":1.294,"5min":1.2769999999999999,"15min":1.228},"min":{"1min":0.83399999999999996,"5min":0.78800000000000003,"15min":0.67100000000000004},"max":{"1min":1.5289999999999999,"5min":1.758,"15min":1.865},"last":1.45}]},{"osd":2,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.204,"15min":1.151},"min":{"1min":0.79400000000000004,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5309999999999999,"5min":1.7150000000000001,"15min":2.0150000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.177,"5min":1.2270000000000001,"15min":1.22},"min":{"1min":0.81699999999999995,"5min":0.76100000000000001,"15min":0.68700000000000006},"max":{"1min":1.5640000000000001,"5min":1.7030000000000001,"15min":2.1379999999999999},"last":0.96199999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2649999999999999,"15min":1.2050000000000001},"min":{"1min":0.92800000000000005,"5min":0.875,"15min":0.71399999999999997},"max":{"1min":1.5900000000000001,"5min":1.766,"15min":2.0680000000000001},"last":1.014},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3100000000000001},"min":{"1min":0.98999999999999999,"5min":0.78000000000000003,"15min":0.71799999999999997},"max":{"1min":1.633,"5min":1.778,"15min":2.2959999999999998},"last":1.484}]},{"osd":4,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1879999999999999,"15min":1.2},"min":{"1min":0.79800000000000004,"5min":0.56699999999999995,"15min":0.48699999999999999},"max":{"1min":1.5349999999999999,"5min":1.7430000000000001,"15min":2.0760000000000001},"last":1.222},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.282,"15min":1.274},"min":{"1min":0.82399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6279999999999999,"5min":1.899,"15min":2.2749999999999999},"last":1.3149999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.304,"15min":1.355},"min":{"1min":0.99399999999999999,"5min":0.60699999999999998,"15min":0.51800000000000002},"max":{"1min":1.76,"5min":1.8280000000000001,"15min":2.4300000000000002},"last":1.258},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3260000000000001,"15min":1.3620000000000001},"min":{"1min":1.0089999999999999,"5min":0.627,"15min":0.623},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.3410000000000002},"last":1.1499999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.4990000000000001},"min":{"1min":0.98699999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":2.355},"last":1.367},{"interface":"front","average":{"1min":1.427,"5min":1.4550000000000001,"15min":1.482},"min":{"1min":1.097,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.137,"5min":2.137,"15min":2.4849999999999999},"last":1.421}]}]},{"osd":6,"up_from":13,"seq":55834575019,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.123,"15min":1.2230000000000001},"min":{"1min":0.70699999999999996,"5min":0.66000000000000003,"15min":0.42099999999999999},"max":{"1min":1.3799999999999999,"5min":1.6519999999999999,"15min":28.361000000000001},"last":1.609},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1759999999999999,"15min":1.1519999999999999},"min":{"1min":0.90700000000000003,"5min":0.629,"15min":0.629},"max":{"1min":1.5629999999999999,"5min":1.675,"15min":3.0670000000000002},"last":1.361}]},{"osd":1,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.113,"15min":1.0900000000000001},"min":{"1min":0.85299999999999998,"5min":0.71499999999999997,"15min":0.58999999999999997},"max":{"1min":1.655,"5min":1.655,"15min":2.1150000000000002},"last":1.323},{"interface":"front","average":{"1min":1.248,"5min":1.234,"15min":1.25},"min":{"1min":0.93200000000000005,"5min":0.74299999999999999,"15min":0.63100000000000001},"max":{"1min":1.762,"5min":1.762,"15min":15.324999999999999},"last":1.129}]},{"osd":2,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.246,"15min":1.2989999999999999},"min":{"1min":0.94899999999999995,"5min":0.79800000000000004,"15min":0.65700000000000003},"max":{"1min":1.8899999999999999,"5min":1.9259999999999999,"15min":15.422000000000001},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.23,"15min":1.2490000000000001},"min":{"1min":0.90500000000000003,"5min":0.81100000000000005,"15min":0.58599999999999997},"max":{"1min":1.5620000000000001,"5min":1.7,"15min":10.173999999999999},"last":1.6930000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.29,"15min":1.3320000000000001},"min":{"1min":0.90400000000000003,"5min":0.877,"15min":0.72899999999999998},"max":{"1min":1.6379999999999999,"5min":1.671,"15min":10.096},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.276,"15min":1.258},"min":{"1min":0.86499999999999999,"5min":0.83199999999999996,"15min":0.71399999999999997},"max":{"1min":1.7010000000000001,"5min":1.702,"15min":2.3889999999999998},"last":1.262}]},{"osd":4,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2470000000000001,"15min":1.3720000000000001},"min":{"1min":0.83199999999999996,"5min":0.64200000000000002,"15min":0.52000000000000002},"max":{"1min":1.794,"5min":1.794,"15min":15.378},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.3400000000000001,"15min":1.4179999999999999},"min":{"1min":1.071,"5min":0.80700000000000005,"15min":0.68999999999999995},"max":{"1min":1.802,"5min":1.802,"15min":13.178000000000001},"last":1.5609999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.2410000000000001,"15min":1.365},"min":{"1min":0.83399999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.855,"5min":1.855,"15min":19.995000000000001},"last":1.177},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4339999999999999,"15min":1.5449999999999999},"min":{"1min":1.125,"5min":0.98499999999999999,"15min":0.67600000000000005},"max":{"1min":1.9850000000000001,"5min":2.1989999999999998,"15min":15.679},"last":1.675}]},{"osd":7,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.46,"15min":1.522},"min":{"1min":1.0900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.746,"5min":1.845,"15min":3.2429999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.4610000000000001,"15min":1.4890000000000001},"min":{"1min":1.046,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.927,"5min":1.972,"15min":4.6609999999999996},"last":1.496}]}]},{"osd":5,"up_from":13,"seq":55834575019,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1660,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193651,"statfs":{"total":200000000,"available":198299210,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.155,"15min":1.105},"min":{"1min":0.80200000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6850000000000001,"5min":1.8939999999999999,"15min":1.944},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.1479999999999999,"15min":1.121},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.65300000000000002},"max":{"1min":1.51,"5min":1.9279999999999999,"15min":3.1379999999999999},"last":1.464}]},{"osd":1,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1739999999999999,"15min":1.139},"min":{"1min":0.67400000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.4159999999999999,"5min":1.714,"15min":2.79},"last":1.49},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1950000000000001,"15min":1.109},"min":{"1min":0.82299999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.462,"5min":1.7430000000000001,"15min":1.7509999999999999},"last":0.98299999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1850000000000001,"15min":1.1579999999999999},"min":{"1min":0.77200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.403,"5min":1.675,"15min":1.8819999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2949999999999999,"15min":1.2330000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.74299999999999999},"max":{"1min":1.552,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.425}]},{"osd":3,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2549999999999999,"15min":1.222},"min":{"1min":0.85899999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5920000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.327,"15min":1.284},"min":{"1min":0.74199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.772,"5min":1.875,"15min":2.1499999999999999},"last":1.407}]},{"osd":4,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.57899999999999996},"max":{"1min":1.583,"5min":1.8380000000000001,"15min":1.853},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2769999999999999,"15min":1.2629999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"max":{"1min":1.5600000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.86799999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3420000000000001,"15min":1.3280000000000001},"min":{"1min":0.65200000000000002,"5min":0.55300000000000005,"15min":0.54600000000000004},"max":{"1min":1.663,"5min":1.792,"15min":1.821},"last":1.042},{"interface":"front","average":{"1min":1.337,"5min":1.4219999999999999,"15min":1.4119999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.601,"5min":1.952,"15min":2.8780000000000001},"last":1.554}]},{"osd":7,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.4079999999999999,"15min":1.3999999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.673,"5min":2.0960000000000001,"15min":2.2189999999999999},"last":1.169},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4770000000000001,"15min":1.498},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9139999999999999,"5min":2.056,"15min":4.7249999999999996},"last":1.323}]}]},{"osd":4,"up_from":13,"seq":55834575019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.1180000000000001,"15min":1.0529999999999999},"min":{"1min":0.66600000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3540000000000001,"5min":6.4969999999999999,"15min":6.4969999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1499999999999999,"15min":1.1279999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.58199999999999996},"max":{"1min":1.4910000000000001,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":1.119}]},{"osd":1,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.171,"15min":1.111},"min":{"1min":0.86599999999999999,"5min":0.63200000000000001,"15min":0.54100000000000004},"max":{"1min":1.679,"5min":6.2999999999999998,"15min":6.2999999999999998},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.3280000000000001,"15min":1.1819999999999999},"min":{"1min":0.82199999999999995,"5min":0.79100000000000004,"15min":0.57399999999999995},"max":{"1min":1.4430000000000001,"5min":17.562999999999999,"15min":17.562999999999999},"last":1.238}]},{"osd":2,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.262,"15min":1.1899999999999999},"min":{"1min":0.86299999999999999,"5min":0.78600000000000003,"15min":0.65700000000000003},"max":{"1min":1.4770000000000001,"5min":9.0329999999999995,"15min":9.0329999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.224,"5min":1.3049999999999999,"15min":1.246},"min":{"1min":0.85099999999999998,"5min":0.748,"15min":0.748},"max":{"1min":1.6180000000000001,"5min":8.2029999999999994,"15min":8.2029999999999994},"last":1.5409999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3400000000000001,"15min":1.256},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.68500000000000005},"max":{"1min":1.5469999999999999,"5min":8.8160000000000007,"15min":8.8160000000000007},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.385,"15min":1.3100000000000001},"min":{"1min":1.0620000000000001,"5min":0.82299999999999995,"15min":0.82099999999999995},"max":{"1min":1.714,"5min":10.157999999999999,"15min":10.157999999999999},"last":1.427}]},{"osd":5,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.266,"15min":1.2010000000000001},"min":{"1min":0.79400000000000004,"5min":0.67900000000000005,"15min":0.52400000000000002},"max":{"1min":1.6899999999999999,"5min":7.056,"15min":7.056},"last":1.069},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.4990000000000001,"15min":1.4399999999999999},"min":{"1min":1.0449999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5920000000000001,"5min":9.0700000000000003,"15min":9.0700000000000003},"last":1.2809999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.363,"15min":1.3200000000000001},"min":{"1min":0.82499999999999996,"5min":0.62,"15min":0.58599999999999997},"max":{"1min":1.8049999999999999,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.3600000000000001,"15min":1.302},"min":{"1min":0.95899999999999996,"5min":0.82399999999999995,"15min":0.59199999999999997},"max":{"1min":2.052,"5min":5.2089999999999996,"15min":5.2089999999999996},"last":1.3140000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4910000000000001,"15min":1.4339999999999999},"min":{"1min":1.022,"5min":0.70199999999999996,"15min":0.67300000000000004},"max":{"1min":1.7170000000000001,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.581,"15min":1.5149999999999999},"min":{"1min":1.3680000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.8740000000000001,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.4910000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575019,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.39800000000000002},"max":{"1min":1.4139999999999999,"5min":1.4770000000000001,"15min":1.8340000000000001},"last":1.042},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.999,"15min":0.95099999999999996},"min":{"1min":0.65900000000000003,"5min":0.44,"15min":0.38900000000000001},"max":{"1min":1.482,"5min":1.5249999999999999,"15min":2.5270000000000001},"last":0.98899999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.002,"15min":0.91900000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.34499999999999997},"max":{"1min":1.3999999999999999,"5min":1.772,"15min":1.772},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.252,"15min":1.1830000000000001},"min":{"1min":0.754,"5min":0.53700000000000003,"15min":0.46200000000000002},"max":{"1min":1.6619999999999999,"5min":1.825,"15min":1.861},"last":1.137}]},{"osd":2,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1619999999999999,"15min":1.079},"min":{"1min":0.64400000000000002,"5min":0.625,"15min":0.41899999999999998},"max":{"1min":1.619,"5min":1.659,"15min":1.7350000000000001},"last":1.554},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.1990000000000001,"15min":1.165},"min":{"1min":0.77600000000000002,"5min":0.69799999999999995,"15min":0.45100000000000001},"max":{"1min":1.6859999999999999,"5min":1.8120000000000001,"15min":1.9570000000000001},"last":0.91700000000000004}]},{"osd":4,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2450000000000001,"15min":1.2290000000000001},"min":{"1min":0.83299999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5900000000000001,"5min":1.6870000000000001,"15min":2.7210000000000001},"last":1.3},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.351,"15min":1.296},"min":{"1min":0.96799999999999997,"5min":0.873,"15min":0.745},"max":{"1min":1.546,"5min":1.9850000000000001,"15min":2.3999999999999999},"last":1.8899999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4259999999999999,"15min":1.349},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.66700000000000004},"max":{"1min":1.6950000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.411,"15min":1.399},"min":{"1min":1.0009999999999999,"5min":0.78600000000000003,"15min":0.73699999999999999},"max":{"1min":1.762,"5min":2.2629999999999999,"15min":2.3839999999999999},"last":1.24}]},{"osd":6,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4890000000000001,"15min":1.4550000000000001},"min":{"1min":1.099,"5min":1.008,"15min":0.88100000000000001},"max":{"1min":1.768,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.4059999999999999,"15min":1.379},"min":{"1min":0.97299999999999998,"5min":0.84899999999999998,"15min":0.75900000000000001},"max":{"1min":1.9590000000000001,"5min":1.968,"15min":2.8250000000000002},"last":1.181}]},{"osd":7,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4770000000000001,"15min":1.419},"min":{"1min":1.0409999999999999,"5min":0.91600000000000004,"15min":0.77100000000000002},"max":{"1min":1.891,"5min":2.056,"15min":2.7850000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.5189999999999999,"15min":1.452},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.80600000000000005},"max":{"1min":1.869,"5min":2.2290000000000001,"15min":2.3740000000000001},"last":1.804}]}]},{"osd":2,"up_from":13,"seq":55834575019,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88400000000000001,"15min":0.86199999999999999},"min":{"1min":0.57299999999999995,"5min":0.432,"15min":0.32000000000000001},"max":{"1min":1.278,"5min":1.8340000000000001,"15min":6.8879999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.03,"5min":0.98899999999999999,"15min":0.94899999999999995},"min":{"1min":0.64700000000000002,"5min":0.39100000000000001,"15min":0.35799999999999998},"max":{"1min":1.5389999999999999,"5min":1.7589999999999999,"15min":4.5510000000000002},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.92600000000000005,"15min":0.95599999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":11.308999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.111,"15min":1.046},"min":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.44600000000000001},"max":{"1min":1.4650000000000001,"5min":1.738,"15min":2.9889999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.179,"15min":1.135},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":1.6439999999999999,"5min":1.772,"15min":13.087999999999999},"last":1.145},{"interface":"front","average":{"1min":1.288,"5min":1.246,"15min":1.23},"min":{"1min":0.71899999999999997,"5min":0.61299999999999999,"15min":0.52300000000000002},"max":{"1min":1.585,"5min":2.0720000000000001,"15min":12.289999999999999},"last":1.117}]},{"osd":4,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.369,"15min":1.3420000000000001},"min":{"1min":1.0660000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":3.5249999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.337},"min":{"1min":0.83799999999999997,"5min":0.80500000000000005,"15min":0.61499999999999999},"max":{"1min":1.871,"5min":2.0539999999999998,"15min":13.927},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3819999999999999,"15min":1.3759999999999999},"min":{"1min":1.0489999999999999,"5min":0.70299999999999996,"15min":0.64000000000000001},"max":{"1min":1.724,"5min":1.9750000000000001,"15min":11.003},"last":1.345},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":1.002,"5min":0.504,"15min":0.504},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":13.129},"last":1.2669999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.389,"15min":1.371},"min":{"1min":0.88500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.8999999999999999,"5min":1.978,"15min":8.1609999999999996},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.498,"15min":1.464},"min":{"1min":0.93899999999999995,"5min":0.89900000000000002,"15min":0.69999999999999996},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":6.8150000000000004},"last":1.4350000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4419999999999999,"15min":1.425},"min":{"1min":0.78600000000000003,"5min":0.76200000000000001,"15min":0.61299999999999999},"max":{"1min":2.0270000000000001,"5min":2.1309999999999998,"15min":10.948},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.4950000000000001,"15min":1.496},"min":{"1min":1.0780000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":9.0239999999999991},"last":1.4119999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575019,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1661,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193650,"statfs":{"total":200000000,"available":198298191,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":0.98499999999999999},"min":{"1min":0.56499999999999995,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":2.5680000000000001,"5min":23.059000000000001,"15min":23.059000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.026,"5min":1.1819999999999999,"15min":1.1140000000000001},"min":{"1min":0.59799999999999998,"5min":0.41099999999999998,"15min":0.39900000000000002},"max":{"1min":1.3939999999999999,"5min":9.9749999999999996,"15min":9.9749999999999996},"last":1.0269999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.286,"15min":1.0700000000000001},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.45500000000000002},"max":{"1min":7.9880000000000004,"5min":22.977,"15min":22.977},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.117,"15min":1.034},"min":{"1min":0.52300000000000002,"5min":0.48999999999999999,"15min":0.34999999999999998},"max":{"1min":9.4440000000000008,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.92300000000000004}]},{"osd":3,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.3400000000000001,"15min":1.274},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.51800000000000002},"max":{"1min":1.7050000000000001,"5min":1.9770000000000001,"15min":2.5169999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1499999999999999,"15min":1.0580000000000001},"min":{"1min":0.622,"5min":0.58699999999999997,"15min":0.47799999999999998},"max":{"1min":5.3470000000000004,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":1.5449999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.5229999999999999,"15min":1.3600000000000001},"min":{"1min":0.82399999999999995,"5min":0.73999999999999999,"15min":0.58699999999999997},"max":{"1min":2.7069999999999999,"5min":23.145,"15min":23.145},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.5209999999999999,"15min":1.431},"min":{"1min":0.89200000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.6699999999999999,"5min":9.9299999999999997,"15min":9.9299999999999997},"last":1.264}]},{"osd":5,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.323,"15min":1.278},"min":{"1min":0.80300000000000005,"5min":0.77700000000000002,"15min":0.58699999999999997},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":4.6399999999999997},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.431,"5min":1.6180000000000001,"15min":1.4510000000000001},"min":{"1min":0.90400000000000003,"5min":0.71699999999999997,"15min":0.66800000000000004},"max":{"1min":2.758,"5min":23.105,"15min":23.105},"last":1.2969999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.381,"15min":1.3340000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.65200000000000002},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":4.5819999999999999},"last":1.329},{"interface":"front","average":{"1min":1.486,"5min":1.726,"15min":1.516},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.67200000000000004},"max":{"1min":2.657,"5min":24.341999999999999,"15min":24.341999999999999},"last":1.518}]},{"osd":7,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4390000000000001,"15min":1.4339999999999999},"min":{"1min":0.88400000000000001,"5min":0.78800000000000003,"15min":0.64400000000000002},"max":{"1min":1.732,"5min":2.0870000000000002,"15min":2.4889999999999999},"last":1.373},{"interface":"front","average":{"1min":1.514,"5min":1.472,"15min":1.4430000000000001},"min":{"1min":0.96199999999999997,"5min":0.82099999999999995,"15min":0.66200000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":4.508},"last":1.423}]}]},{"osd":0,"up_from":13,"seq":55834575019,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":0.94699999999999995,"15min":0.84699999999999998},"min":{"1min":0.61399999999999999,"5min":0.432,"15min":0.36599999999999999},"max":{"1min":7.3499999999999996,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.042,"15min":0.96399999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.33700000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.95499999999999996}]},{"osd":2,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90300000000000002,"15min":0.85599999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.373},"max":{"1min":1.617,"5min":1.617,"15min":1.6739999999999999},"last":1.212},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.056,"15min":1.02},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.40000000000000002},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":2.1219999999999999},"last":1.304}]},{"osd":3,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.288,"15min":1.1599999999999999},"min":{"1min":0.65200000000000002,"5min":0.56299999999999994,"15min":0.44500000000000001},"max":{"1min":7.6550000000000002,"5min":7.6550000000000002,"15min":7.6550000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.24,"5min":1.3280000000000001,"15min":1.2090000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.39100000000000001},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":2.145},"last":1.0489999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0049999999999999,"5min":1.4910000000000001,"15min":1.367},"min":{"1min":0.88,"5min":0.81200000000000006,"15min":0.70799999999999996},"max":{"1min":7.7370000000000001,"5min":7.7370000000000001,"15min":7.7370000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.4370000000000001,"15min":1.335},"min":{"1min":0.93500000000000005,"5min":0.82999999999999996,"15min":0.70599999999999996},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":1.48}]},{"osd":5,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.335},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.59299999999999997},"max":{"1min":2.843,"5min":2.843,"15min":5.4290000000000003},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.831,"5min":1.46,"15min":1.361},"min":{"1min":1.048,"5min":0.85799999999999998,"15min":0.73599999999999999},"max":{"1min":7.8579999999999997,"5min":7.8579999999999997,"15min":7.8579999999999997},"last":1.25}]},{"osd":6,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.4019999999999999,"15min":1.353},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.64800000000000002},"max":{"1min":1.7609999999999999,"5min":1.9330000000000001,"15min":2.4420000000000002},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.52,"15min":1.4610000000000001},"min":{"1min":0.97099999999999997,"5min":0.95799999999999996,"15min":0.69099999999999995},"max":{"1min":2.1070000000000002,"5min":2.109,"15min":2.577},"last":1.4530000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.508,"15min":1.4430000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.755},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.9810000000000001,"5min":1.595,"15min":1.4770000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":7.8029999999999999,"5min":7.8029999999999999,"15min":7.8029999999999999},"last":1.425}]}]}],"pool_statfs":[]}} 2023-12-22T08:53:56.797 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:53:57.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.026+0000 7f230d5d0640 1 Processor -- start 2023-12-22T08:53:57.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.026+0000 7f230d5d0640 1 -- start start 2023-12-22T08:53:57.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.028+0000 7f230d5d0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23080b2050 0x7f23080b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:57.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.028+0000 7f230d5d0640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2308070800 0x7f2308070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:57.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.028+0000 7f230d5d0640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23081450f0 con 0x7f2308144d10 2023-12-22T08:53:57.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.028+0000 7f230d5d0640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23080cc840 con 0x7f2308070800 2023-12-22T08:53:57.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.028+0000 7f230d5d0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23080ce010 con 0x7f23080b2050 2023-12-22T08:53:57.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.028+0000 7f23077fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2308070800 0x7f2308070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:57.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.028+0000 7f2306ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2308144d10 0x7f23080cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58430/0 (socket says 172.21.15.38:58430) 2023-12-22T08:53:57.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.028+0000 7f2306ffd640 1 -- 172.21.15.38:0/2725097320 learned_addr learned my addr 172.21.15.38:0/2725097320 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:57.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.029+0000 7f23067fc640 1 --2- 172.21.15.38:0/2725097320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23080b2050 0x7f23080b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:57.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.029+0000 7f23077fe640 1 -- 172.21.15.38:0/2725097320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23080b2050 msgr2=0x7f23080b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:57.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.029+0000 7f23077fe640 1 --2- 172.21.15.38:0/2725097320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23080b2050 0x7f23080b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:57.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.029+0000 7f23077fe640 1 -- 172.21.15.38:0/2725097320 >> v1:172.21.15.38:6789/0 conn(0x7f2308144d10 legacy=0x7f23080cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:57.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.029+0000 7f23077fe640 1 -- 172.21.15.38:0/2725097320 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23080b29f0 con 0x7f2308070800 2023-12-22T08:53:57.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.030+0000 7f23077fe640 1 --2- 172.21.15.38:0/2725097320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308070800 0x7f2308070c50 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f2300009d90 tx=0x7f230002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1371aba0c9e3e72 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:57.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.030+0000 7f2305ffb640 1 -- 172.21.15.38:0/2725097320 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230002cc60 con 0x7f2308070800 2023-12-22T08:53:57.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.030+0000 7f2305ffb640 1 -- 172.21.15.38:0/2725097320 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230002cdc0 con 0x7f2308070800 2023-12-22T08:53:57.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.030+0000 7f2305ffb640 1 -- 172.21.15.38:0/2725097320 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300034660 con 0x7f2308070800 2023-12-22T08:53:57.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.031+0000 7f230d5d0640 1 -- 172.21.15.38:0/2725097320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308070800 msgr2=0x7f2308070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:57.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.031+0000 7f230d5d0640 1 --2- 172.21.15.38:0/2725097320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308070800 0x7f2308070c50 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f2300009d90 tx=0x7f230002beb0 comp rx=0 tx=0).stop 2023-12-22T08:53:57.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.031+0000 7f230d5d0640 1 -- 172.21.15.38:0/2725097320 shutdown_connections 2023-12-22T08:53:57.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.031+0000 7f230d5d0640 1 --2- 172.21.15.38:0/2725097320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308070800 0x7f2308070c50 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:57.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.031+0000 7f230d5d0640 1 --2- 172.21.15.38:0/2725097320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23080b2050 0x7f23080b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:57.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.031+0000 7f230d5d0640 1 -- 172.21.15.38:0/2725097320 >> 172.21.15.38:0/2725097320 conn(0x7f23080cf070 msgr2=0x7f23080cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:57.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.031+0000 7f230d5d0640 1 -- 172.21.15.38:0/2725097320 shutdown_connections 2023-12-22T08:53:57.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.031+0000 7f230d5d0640 1 -- 172.21.15.38:0/2725097320 wait complete. 2023-12-22T08:53:57.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.033+0000 7f230d5d0640 1 Processor -- start 2023-12-22T08:53:57.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.033+0000 7f230d5d0640 1 -- start start 2023-12-22T08:53:57.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.034+0000 7f230d5d0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308070800 0x7f23081f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:57.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.034+0000 7f230d5d0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23080b2050 0x7f23080b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:57.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.034+0000 7f230d5d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2308144d10 0x7f23080b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.034+0000 7f230d5d0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2308158020 con 0x7f2308070800 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.034+0000 7f230d5d0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2308158270 con 0x7f2308144d10 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.034+0000 7f230d5d0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2308158550 con 0x7f23080b2050 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.034+0000 7f2306ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308070800 0x7f23081f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.034+0000 7f2306ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308070800 0x7f23081f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57668/0 (socket says 172.21.15.38:57668) 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.034+0000 7f2306ffd640 1 -- 172.21.15.38:0/386038157 learned_addr learned my addr 172.21.15.38:0/386038157 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.035+0000 7f23077fe640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2308144d10 0x7f23080b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.035+0000 7f23067fc640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23080b2050 0x7f23080b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.035+0000 7f2306ffd640 1 -- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23080b2050 msgr2=0x7f23080b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.035+0000 7f2306ffd640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23080b2050 0x7f23080b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.035+0000 7f2306ffd640 1 -- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2308144d10 msgr2=0x7f23080b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.035+0000 7f2306ffd640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2308144d10 0x7f23080b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.035+0000 7f2306ffd640 1 -- 172.21.15.38:0/386038157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2300009a70 con 0x7f2308070800 2023-12-22T08:53:57.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.035+0000 7f23077fe640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2308144d10 0x7f23080b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:57.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.035+0000 7f23067fc640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23080b2050 0x7f23080b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:57.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.035+0000 7f2306ffd640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308070800 0x7f23081f57f0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f22f800c480 tx=0x7f22f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:57.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.035+0000 7f22ef7fe640 1 -- 172.21.15.38:0/386038157 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8005ce0 con 0x7f2308070800 2023-12-22T08:53:57.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.036+0000 7f22ef7fe640 1 -- 172.21.15.38:0/386038157 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f8005e40 con 0x7f2308070800 2023-12-22T08:53:57.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.036+0000 7f22ef7fe640 1 -- 172.21.15.38:0/386038157 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f80072f0 con 0x7f2308070800 2023-12-22T08:53:57.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.036+0000 7f230d5d0640 1 -- 172.21.15.38:0/386038157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2308158830 con 0x7f2308070800 2023-12-22T08:53:57.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.036+0000 7f230d5d0640 1 -- 172.21.15.38:0/386038157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2308159230 con 0x7f2308070800 2023-12-22T08:53:57.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.037+0000 7f230d5d0640 1 -- 172.21.15.38:0/386038157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230806e1f0 con 0x7f2308070800 2023-12-22T08:53:57.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.038+0000 7f22ef7fe640 1 -- 172.21.15.38:0/386038157 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f22f8007450 con 0x7f2308070800 2023-12-22T08:53:57.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.039+0000 7f22ef7fe640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f22f406a460 0x7f22f406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:57.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.039+0000 7f22ef7fe640 1 -- 172.21.15.38:0/386038157 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f22f8087a70 con 0x7f2308070800 2023-12-22T08:53:57.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.039+0000 7f23067fc640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f22f406a460 0x7f22f406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:57.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.041+0000 7f23067fc640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f22f406a460 0x7f22f406c920 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2308141440 tx=0x7f22fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:57.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.043+0000 7f22ef7fe640 1 -- 172.21.15.38:0/386038157 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f22f8053400 con 0x7f2308070800 2023-12-22T08:53:57.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.242+0000 7f230d5d0640 1 -- 172.21.15.38:0/386038157 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2308061910 con 0x7f2308070800 2023-12-22T08:53:57.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.243+0000 7f22ef7fe640 1 -- 172.21.15.38:0/386038157 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+12481 (secure 0 0 0) 0x7f22f8017090 con 0x7f2308070800 2023-12-22T08:53:57.244 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:53:57.244 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":197,"fsid":"893856d7-5d01-4896-9127-f971dbad2b97","created":"2023-12-22T08:39:41.088557+0000","modified":"2023-12-22T08:53:51.954802+0000","last_up_change":"2023-12-22T08:39:47.815671+0000","last_in_change":"2023-12-22T08:39:44.806169+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:39:48.429113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":84128},{"type":"v1","addr":"172.21.15.38:6801","nonce":84128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":84128},{"type":"v1","addr":"172.21.15.38:6803","nonce":84128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":84128},{"type":"v1","addr":"172.21.15.38:6807","nonce":84128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":84128},{"type":"v1","addr":"172.21.15.38:6805","nonce":84128}]},"public_addr":"172.21.15.38:6801/84128","cluster_addr":"172.21.15.38:6803/84128","heartbeat_back_addr":"172.21.15.38:6807/84128","heartbeat_front_addr":"172.21.15.38:6805/84128","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":84127},{"type":"v1","addr":"172.21.15.38:6809","nonce":84127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":84127},{"type":"v1","addr":"172.21.15.38:6811","nonce":84127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":84127},{"type":"v1","addr":"172.21.15.38:6815","nonce":84127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":84127},{"type":"v1","addr":"172.21.15.38:6813","nonce":84127}]},"public_addr":"172.21.15.38:6809/84127","cluster_addr":"172.21.15.38:6811/84127","heartbeat_back_addr":"172.21.15.38:6815/84127","heartbeat_front_addr":"172.21.15.38:6813/84127","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":84132},{"type":"v1","addr":"172.21.15.38:6825","nonce":84132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":84132},{"type":"v1","addr":"172.21.15.38:6827","nonce":84132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":84132},{"type":"v1","addr":"172.21.15.38:6831","nonce":84132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":84132},{"type":"v1","addr":"172.21.15.38:6829","nonce":84132}]},"public_addr":"172.21.15.38:6825/84132","cluster_addr":"172.21.15.38:6827/84132","heartbeat_back_addr":"172.21.15.38:6831/84132","heartbeat_front_addr":"172.21.15.38:6829/84132","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":84138},{"type":"v1","addr":"172.21.15.38:6817","nonce":84138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":84138},{"type":"v1","addr":"172.21.15.38:6819","nonce":84138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":84138},{"type":"v1","addr":"172.21.15.38:6823","nonce":84138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":84138},{"type":"v1","addr":"172.21.15.38:6821","nonce":84138}]},"public_addr":"172.21.15.38:6817/84138","cluster_addr":"172.21.15.38:6819/84138","heartbeat_back_addr":"172.21.15.38:6823/84138","heartbeat_front_addr":"172.21.15.38:6821/84138","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":84338},{"type":"v1","addr":"172.21.15.89:6801","nonce":84338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":84338},{"type":"v1","addr":"172.21.15.89:6803","nonce":84338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":84338},{"type":"v1","addr":"172.21.15.89:6807","nonce":84338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":84338},{"type":"v1","addr":"172.21.15.89:6805","nonce":84338}]},"public_addr":"172.21.15.89:6801/84338","cluster_addr":"172.21.15.89:6803/84338","heartbeat_back_addr":"172.21.15.89:6807/84338","heartbeat_front_addr":"172.21.15.89:6805/84338","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":84339},{"type":"v1","addr":"172.21.15.89:6817","nonce":84339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":84339},{"type":"v1","addr":"172.21.15.89:6819","nonce":84339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6825","nonce":84339},{"type":"v1","addr":"172.21.15.89:6827","nonce":84339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":84339},{"type":"v1","addr":"172.21.15.89:6822","nonce":84339}]},"public_addr":"172.21.15.89:6817/84339","cluster_addr":"172.21.15.89:6819/84339","heartbeat_back_addr":"172.21.15.89:6827/84339","heartbeat_front_addr":"172.21.15.89:6822/84339","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":84337},{"type":"v1","addr":"172.21.15.89:6809","nonce":84337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":84337},{"type":"v1","addr":"172.21.15.89:6811","nonce":84337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":84337},{"type":"v1","addr":"172.21.15.89:6815","nonce":84337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":84337},{"type":"v1","addr":"172.21.15.89:6813","nonce":84337}]},"public_addr":"172.21.15.89:6809/84337","cluster_addr":"172.21.15.89:6811/84337","heartbeat_back_addr":"172.21.15.89:6815/84337","heartbeat_front_addr":"172.21.15.89:6813/84337","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6821","nonce":84340},{"type":"v1","addr":"172.21.15.89:6823","nonce":84340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":84340},{"type":"v1","addr":"172.21.15.89:6826","nonce":84340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":84340},{"type":"v1","addr":"172.21.15.89:6831","nonce":84340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":84340},{"type":"v1","addr":"172.21.15.89:6829","nonce":84340}]},"public_addr":"172.21.15.89:6823/84340","cluster_addr":"172.21.15.89:6826/84340","heartbeat_back_addr":"172.21.15.89:6831/84340","heartbeat_front_addr":"172.21.15.89:6829/84340","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.095888+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.129399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.068810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100385+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.100183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.060442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.072683+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:39:46.127969+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6835/3350465616":"2023-12-23T08:53:48.919328+0000","172.21.15.38:6833/3350465616":"2023-12-23T08:53:48.919328+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:53:57.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.245+0000 7f230d5d0640 1 -- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f22f406a460 msgr2=0x7f22f406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:57.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.245+0000 7f230d5d0640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f22f406a460 0x7f22f406c920 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2308141440 tx=0x7f22fc008040 comp rx=0 tx=0).stop 2023-12-22T08:53:57.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.245+0000 7f230d5d0640 1 -- 172.21.15.38:0/386038157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308070800 msgr2=0x7f23081f57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:57.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.245+0000 7f230d5d0640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308070800 0x7f23081f57f0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f22f800c480 tx=0x7f22f800c940 comp rx=0 tx=0).stop 2023-12-22T08:53:57.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.245+0000 7f230d5d0640 1 -- 172.21.15.38:0/386038157 shutdown_connections 2023-12-22T08:53:57.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.245+0000 7f230d5d0640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2308144d10 0x7f23080b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:57.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.245+0000 7f230d5d0640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23080b2050 0x7f23080b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:57.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.245+0000 7f230d5d0640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f22f406a460 0x7f22f406c920 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:57.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.245+0000 7f230d5d0640 1 --2- 172.21.15.38:0/386038157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2308070800 0x7f23081f57f0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:57.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.245+0000 7f230d5d0640 1 -- 172.21.15.38:0/386038157 >> 172.21.15.38:0/386038157 conn(0x7f23080cf070 msgr2=0x7f2308141b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:57.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.246+0000 7f230d5d0640 1 -- 172.21.15.38:0/386038157 shutdown_connections 2023-12-22T08:53:57.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:57.246+0000 7f230d5d0640 1 -- 172.21.15.38:0/386038157 wait complete. 2023-12-22T08:53:58.267 INFO:tasks.ceph:Scrubbing osd.0 2023-12-22T08:53:58.268 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:53:58.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.514+0000 7f0d24b49640 1 Processor -- start 2023-12-22T08:53:58.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.515+0000 7f0d24b49640 1 -- start start 2023-12-22T08:53:58.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.516+0000 7f0d24b49640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d20146ad0 0x7f0d20070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.516+0000 7f0d24b49640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0d20146eb0 0x7f0d200d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.516+0000 7f0d24b49640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d20070a70 con 0x7f0d2006f2c0 2023-12-22T08:53:58.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.516+0000 7f0d24b49640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2009ed10 con 0x7f0d20146eb0 2023-12-22T08:53:58.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.516+0000 7f0d24b49640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2009eff0 con 0x7f0d20146ad0 2023-12-22T08:53:58.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.517+0000 7f0d1ffff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0d2006f2c0 0x7f0d20161010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58446/0 (socket says 172.21.15.38:58446) 2023-12-22T08:53:58.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.517+0000 7f0d1ffff640 1 -- 172.21.15.38:0/3711423314 learned_addr learned my addr 172.21.15.38:0/3711423314 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:58.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.517+0000 7f0d1f7fe640 1 --2- 172.21.15.38:0/3711423314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d20146ad0 0x7f0d20070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.517+0000 7f0d1effd640 1 --2- 172.21.15.38:0/3711423314 >> v2:172.21.15.89:3300/0 conn(0x7f0d20146eb0 0x7f0d200d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.517+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928688969 0 0) 0x7f0d20070a70 con 0x7f0d2006f2c0 2023-12-22T08:53:58.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.517+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d08003520 con 0x7f0d2006f2c0 2023-12-22T08:53:58.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1415825891 0 0) 0x7f0d08003520 con 0x7f0d2006f2c0 2023-12-22T08:53:58.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d20146ad0 msgr2=0x7f0d20070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:58.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 --2- 172.21.15.38:0/3711423314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d20146ad0 0x7f0d20070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 >> v2:172.21.15.89:3300/0 conn(0x7f0d20146eb0 msgr2=0x7f0d200d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:58.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 --2- 172.21.15.38:0/3711423314 >> v2:172.21.15.89:3300/0 conn(0x7f0d20146eb0 0x7f0d200d1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2009f2d0 con 0x7f0d2006f2c0 2023-12-22T08:53:58.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f0d180019f0 con 0x7f0d2006f2c0 2023-12-22T08:53:58.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 >> v1:172.21.15.38:6789/0 conn(0x7f0d2006f2c0 legacy=0x7f0d20161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:58.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 --2- 172.21.15.38:0/3711423314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d08003970 0x7f0d08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 --2- 172.21.15.38:0/3711423314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d20146ad0 0x7f0d080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 --2- 172.21.15.38:0/3711423314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d08004d00 0x7f0d08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2009ed10 con 0x7f0d08004d00 2023-12-22T08:53:58.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2009eff0 con 0x7f0d08003970 2023-12-22T08:53:58.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0800b980 con 0x7f0d20146ad0 2023-12-22T08:53:58.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.518+0000 7f0d1ffff640 1 --2- 172.21.15.38:0/3711423314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d08004d00 0x7f0d08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.519+0000 7f0d1f7fe640 1 --2- 172.21.15.38:0/3711423314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d08003970 0x7f0d08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.519+0000 7f0d1effd640 1 --2- 172.21.15.38:0/3711423314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d20146ad0 0x7f0d080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.519+0000 7f0d1ffff640 1 -- 172.21.15.38:0/3711423314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d20146ad0 msgr2=0x7f0d080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:58.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.519+0000 7f0d1ffff640 1 --2- 172.21.15.38:0/3711423314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d20146ad0 0x7f0d080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.519+0000 7f0d1ffff640 1 -- 172.21.15.38:0/3711423314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d08003970 msgr2=0x7f0d08003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:58.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.519+0000 7f0d1ffff640 1 --2- 172.21.15.38:0/3711423314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d08003970 0x7f0d08003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.519+0000 7f0d1ffff640 1 -- 172.21.15.38:0/3711423314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08003520 con 0x7f0d08004d00 2023-12-22T08:53:58.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.519+0000 7f0d1effd640 1 --2- 172.21.15.38:0/3711423314 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d20146ad0 0x7f0d080047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:58.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.520+0000 7f0d1ffff640 1 --2- 172.21.15.38:0/3711423314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d08004d00 0x7f0d08005180 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f0d200b9780 tx=0x7f0d080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd227750cf08c634 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:58.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.520+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18034630 con 0x7f0d08004d00 2023-12-22T08:53:58.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.520+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1802f070 con 0x7f0d08004d00 2023-12-22T08:53:58.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.520+0000 7f0d1e7fc640 1 -- 172.21.15.38:0/3711423314 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d180349f0 con 0x7f0d08004d00 2023-12-22T08:53:58.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.521+0000 7f0d24b49640 1 -- 172.21.15.38:0/3711423314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d08004d00 msgr2=0x7f0d08005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:58.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.521+0000 7f0d24b49640 1 --2- 172.21.15.38:0/3711423314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d08004d00 0x7f0d08005180 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f0d200b9780 tx=0x7f0d080057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.521+0000 7f0d1ffff640 1 -- 172.21.15.38:0/3711423314 reap_dead start 2023-12-22T08:53:58.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.521+0000 7f0d24b49640 1 -- 172.21.15.38:0/3711423314 shutdown_connections 2023-12-22T08:53:58.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.521+0000 7f0d24b49640 1 -- 172.21.15.38:0/3711423314 >> 172.21.15.38:0/3711423314 conn(0x7f0d2006cf30 msgr2=0x7f0d200b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:58.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.521+0000 7f0d24b49640 1 -- 172.21.15.38:0/3711423314 shutdown_connections 2023-12-22T08:53:58.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.521+0000 7f0d24b49640 1 -- 172.21.15.38:0/3711423314 wait complete. 2023-12-22T08:53:58.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.523+0000 7f0d24b49640 1 Processor -- start 2023-12-22T08:53:58.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.523+0000 7f0d24b49640 1 -- start start 2023-12-22T08:53:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.524+0000 7f0d24b49640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d08004d00 0x7f0d201f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.524+0000 7f0d24b49640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d201372f0 0x7f0d200d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.524+0000 7f0d24b49640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d200b6110 0x7f0d200b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.524+0000 7f0d24b49640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200b7960 con 0x7f0d201372f0 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.524+0000 7f0d24b49640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200b9150 con 0x7f0d08004d00 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.524+0000 7f0d24b49640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d201f61e0 con 0x7f0d200b6110 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.524+0000 7f0d1effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d201372f0 0x7f0d200d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.525+0000 7f0d1effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d201372f0 0x7f0d200d1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57678/0 (socket says 172.21.15.38:57678) 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.525+0000 7f0d1effd640 1 -- 172.21.15.38:0/4101401952 learned_addr learned my addr 172.21.15.38:0/4101401952 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.525+0000 7f0d1f7fe640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d08004d00 0x7f0d201f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.525+0000 7f0d1ffff640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d200b6110 0x7f0d200b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.525+0000 7f0d1effd640 1 -- 172.21.15.38:0/4101401952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d200b6110 msgr2=0x7f0d200b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.525+0000 7f0d1effd640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d200b6110 0x7f0d200b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.525+0000 7f0d1effd640 1 -- 172.21.15.38:0/4101401952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d08004d00 msgr2=0x7f0d201f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.525+0000 7f0d1effd640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d08004d00 0x7f0d201f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.525+0000 7f0d1effd640 1 -- 172.21.15.38:0/4101401952 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d200b4580 con 0x7f0d201372f0 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.525+0000 7f0d1ffff640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d200b6110 0x7f0d200b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:58.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.525+0000 7f0d1effd640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d201372f0 0x7f0d200d1a00 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f0d14010a30 tx=0x7f0d14010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:58.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.526+0000 7f0d07fff640 1 -- 172.21.15.38:0/4101401952 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400ece0 con 0x7f0d201372f0 2023-12-22T08:53:58.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.526+0000 7f0d07fff640 1 -- 172.21.15.38:0/4101401952 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1400ee40 con 0x7f0d201372f0 2023-12-22T08:53:58.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.526+0000 7f0d24b49640 1 -- 172.21.15.38:0/4101401952 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d201f6410 con 0x7f0d201372f0 2023-12-22T08:53:58.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.526+0000 7f0d07fff640 1 -- 172.21.15.38:0/4101401952 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1401c620 con 0x7f0d201372f0 2023-12-22T08:53:58.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.526+0000 7f0d24b49640 1 -- 172.21.15.38:0/4101401952 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d201f69d0 con 0x7f0d201372f0 2023-12-22T08:53:58.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.527+0000 7f0d24b49640 1 -- 172.21.15.38:0/4101401952 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d2009ea00 con 0x7f0d201372f0 2023-12-22T08:53:58.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.528+0000 7f0d07fff640 1 -- 172.21.15.38:0/4101401952 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0d1401c780 con 0x7f0d201372f0 2023-12-22T08:53:58.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.529+0000 7f0d07fff640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d0c06a430 0x7f0d0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.529+0000 7f0d07fff640 1 -- 172.21.15.38:0/4101401952 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0d14088bb0 con 0x7f0d201372f0 2023-12-22T08:53:58.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.529+0000 7f0d07fff640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] conn(0x7f0d0c070290 0x7f0d0c0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.529+0000 7f0d07fff640 1 -- 172.21.15.38:0/4101401952 --> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d0c072d60 con 0x7f0d0c070290 2023-12-22T08:53:58.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.529+0000 7f0d07fff640 1 -- 172.21.15.38:0/4101401952 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d1408d2c0 con 0x7f0d201372f0 2023-12-22T08:53:58.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.529+0000 7f0d1f7fe640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d0c06a430 0x7f0d0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.529+0000 7f0d1ffff640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] conn(0x7f0d0c070290 0x7f0d0c0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.530+0000 7f0d1ffff640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] conn(0x7f0d0c070290 0x7f0d0c0726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:58.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.531+0000 7f0d1f7fe640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d0c06a430 0x7f0d0c06c8f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009990 tx=0x7f0d10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:58.531 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.531+0000 7f0d07fff640 1 -- 172.21.15.38:0/4101401952 <== osd.0 v2:172.21.15.38:6800/84128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f0d0c072d60 con 0x7f0d0c070290 2023-12-22T08:53:58.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.544+0000 7f0d24b49640 1 -- 172.21.15.38:0/4101401952 --> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0d200b4330 con 0x7f0d0c070290 2023-12-22T08:53:58.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.544+0000 7f0d07fff640 1 -- 172.21.15.38:0/4101401952 <== osd.0 v2:172.21.15.38:6800/84128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f0d200b4330 con 0x7f0d0c070290 2023-12-22T08:53:58.545 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:53:58.545 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-22T08:53:58.545 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:53:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.544+0000 7f0d24b49640 1 -- 172.21.15.38:0/4101401952 >> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] conn(0x7f0d0c070290 msgr2=0x7f0d0c0726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.544+0000 7f0d24b49640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.38:6800/84128,v1:172.21.15.38:6801/84128] conn(0x7f0d0c070290 0x7f0d0c0726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.545+0000 7f0d24b49640 1 -- 172.21.15.38:0/4101401952 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d0c06a430 msgr2=0x7f0d0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.545+0000 7f0d24b49640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f0d0c06a430 0x7f0d0c06c8f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009990 tx=0x7f0d10008040 comp rx=0 tx=0).stop 2023-12-22T08:53:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.545+0000 7f0d24b49640 1 -- 172.21.15.38:0/4101401952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d201372f0 msgr2=0x7f0d200d1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.545+0000 7f0d24b49640 1 --2- 172.21.15.38:0/4101401952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d201372f0 0x7f0d200d1a00 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f0d14010a30 tx=0x7f0d14010ef0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.545+0000 7f0d1ffff640 1 -- 172.21.15.38:0/4101401952 reap_dead start 2023-12-22T08:53:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.545+0000 7f0d24b49640 1 -- 172.21.15.38:0/4101401952 shutdown_connections 2023-12-22T08:53:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.545+0000 7f0d24b49640 1 -- 172.21.15.38:0/4101401952 >> 172.21.15.38:0/4101401952 conn(0x7f0d2006cf30 msgr2=0x7f0d201607c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:58.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.545+0000 7f0d24b49640 1 -- 172.21.15.38:0/4101401952 shutdown_connections 2023-12-22T08:53:58.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.545+0000 7f0d24b49640 1 -- 172.21.15.38:0/4101401952 wait complete. 2023-12-22T08:53:58.564 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-22T08:53:58.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.781+0000 7fb3b5b22640 1 Processor -- start 2023-12-22T08:53:58.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.781+0000 7fb3b5b22640 1 -- start start 2023-12-22T08:53:58.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.782+0000 7fb3b5b22640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb3b015b420 0x7fb3b006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.783+0000 7fb3b5b22640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb3b0071000 0x7fb3b015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.783+0000 7fb3b5b22640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b00cdae0 con 0x7fb3b00a44a0 2023-12-22T08:53:58.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.783+0000 7fb3b5b22640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b006dec0 con 0x7fb3b0071000 2023-12-22T08:53:58.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.783+0000 7fb3b5b22640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b015b800 con 0x7fb3b015b420 2023-12-22T08:53:58.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.783+0000 7fb3b5321640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb3b0071000 0x7fb3b015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.783+0000 7fb3b5321640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb3b0071000 0x7fb3b015baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57686/0 (socket says 172.21.15.38:57686) 2023-12-22T08:53:58.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.783+0000 7fb3a7fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb3b00a44a0 0x7fb3b00708f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58456/0 (socket says 172.21.15.38:58456) 2023-12-22T08:53:58.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.783+0000 7fb3b5321640 1 -- 172.21.15.38:0/2654741604 learned_addr learned my addr 172.21.15.38:0/2654741604 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:58.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.783+0000 7fb3b4b20640 1 --2- 172.21.15.38:0/2654741604 >> v2:172.21.15.89:3300/0 conn(0x7fb3b015b420 0x7fb3b006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.784+0000 7fb3b5321640 1 -- 172.21.15.38:0/2654741604 >> v2:172.21.15.89:3300/0 conn(0x7fb3b015b420 msgr2=0x7fb3b006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:58.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.784+0000 7fb3b5321640 1 --2- 172.21.15.38:0/2654741604 >> v2:172.21.15.89:3300/0 conn(0x7fb3b015b420 0x7fb3b006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.784+0000 7fb3b5321640 1 -- 172.21.15.38:0/2654741604 >> v1:172.21.15.38:6789/0 conn(0x7fb3b00a44a0 legacy=0x7fb3b00708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:58.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.784+0000 7fb3b5321640 1 -- 172.21.15.38:0/2654741604 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b00cdd30 con 0x7fb3b0071000 2023-12-22T08:53:58.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.784+0000 7fb3a77fe640 1 -- 172.21.15.38:0/2654741604 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268355652 0 0) 0x7fb3b00cdae0 con 0x7fb3b00a44a0 2023-12-22T08:53:58.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.785+0000 7fb3b5321640 1 --2- 172.21.15.38:0/2654741604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3b0071000 0x7fb3b015baa0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00613e0 tx=0x7fb3a802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d27bfc524bc876 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:58.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.785+0000 7fb3a77fe640 1 -- 172.21.15.38:0/2654741604 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a802cb20 con 0x7fb3b0071000 2023-12-22T08:53:58.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.785+0000 7fb3a77fe640 1 -- 172.21.15.38:0/2654741604 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a802cc80 con 0x7fb3b0071000 2023-12-22T08:53:58.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.785+0000 7fb3a77fe640 1 -- 172.21.15.38:0/2654741604 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a80343f0 con 0x7fb3b0071000 2023-12-22T08:53:58.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.786+0000 7fb3b5b22640 1 -- 172.21.15.38:0/2654741604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3b0071000 msgr2=0x7fb3b015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:58.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.786+0000 7fb3b5b22640 1 --2- 172.21.15.38:0/2654741604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3b0071000 0x7fb3b015baa0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00613e0 tx=0x7fb3a802bf80 comp rx=0 tx=0).stop 2023-12-22T08:53:58.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.786+0000 7fb3b5b22640 1 -- 172.21.15.38:0/2654741604 shutdown_connections 2023-12-22T08:53:58.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.786+0000 7fb3b5b22640 1 --2- 172.21.15.38:0/2654741604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3b0071000 0x7fb3b015baa0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.786+0000 7fb3b5b22640 1 --2- 172.21.15.38:0/2654741604 >> v2:172.21.15.89:3300/0 conn(0x7fb3b015b420 0x7fb3b006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.786+0000 7fb3b5b22640 1 -- 172.21.15.38:0/2654741604 >> 172.21.15.38:0/2654741604 conn(0x7fb3b00b1f70 msgr2=0x7fb3b00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:58.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.786+0000 7fb3b5b22640 1 -- 172.21.15.38:0/2654741604 shutdown_connections 2023-12-22T08:53:58.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.786+0000 7fb3b5b22640 1 -- 172.21.15.38:0/2654741604 wait complete. 2023-12-22T08:53:58.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.788+0000 7fb3b5b22640 1 Processor -- start 2023-12-22T08:53:58.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.788+0000 7fb3b5b22640 1 -- start start 2023-12-22T08:53:58.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.789+0000 7fb3b5b22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3b0071000 0x7fb3b0157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.789+0000 7fb3b5b22640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3b00a44a0 0x7fb3b0145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.789+0000 7fb3b5b22640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3b015b420 0x7fb3b0145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.789+0000 7fb3b5b22640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b0159070 con 0x7fb3b015b420 2023-12-22T08:53:58.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.789+0000 7fb3b5b22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b0158d90 con 0x7fb3b0071000 2023-12-22T08:53:58.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.789+0000 7fb3b5b22640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b01559e0 con 0x7fb3b00a44a0 2023-12-22T08:53:58.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.790+0000 7fb3b5321640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3b015b420 0x7fb3b0145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.790+0000 7fb3b5321640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3b015b420 0x7fb3b0145880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57688/0 (socket says 172.21.15.38:57688) 2023-12-22T08:53:58.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.790+0000 7fb3b5321640 1 -- 172.21.15.38:0/3652653828 learned_addr learned my addr 172.21.15.38:0/3652653828 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:58.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.790+0000 7fb3b4b20640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3b0071000 0x7fb3b0157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.790+0000 7fb3a7fff640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3b00a44a0 0x7fb3b0145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.790+0000 7fb3b5321640 1 -- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3b00a44a0 msgr2=0x7fb3b0145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:58.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.790+0000 7fb3b5321640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3b00a44a0 0x7fb3b0145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.790+0000 7fb3b5321640 1 -- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3b0071000 msgr2=0x7fb3b0157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:58.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.790+0000 7fb3b5321640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3b0071000 0x7fb3b0157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:58.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.790+0000 7fb3b5321640 1 -- 172.21.15.38:0/3652653828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a8009b30 con 0x7fb3b015b420 2023-12-22T08:53:58.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.790+0000 7fb3a7fff640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3b00a44a0 0x7fb3b0145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:58.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.790+0000 7fb3b5321640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3b015b420 0x7fb3b0145880 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8036040 tx=0x7fb3a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:58.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.791+0000 7fb3a57fa640 1 -- 172.21.15.38:0/3652653828 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8009510 con 0x7fb3b015b420 2023-12-22T08:53:58.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.791+0000 7fb3a57fa640 1 -- 172.21.15.38:0/3652653828 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a8007e50 con 0x7fb3b015b420 2023-12-22T08:53:58.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.791+0000 7fb3a57fa640 1 -- 172.21.15.38:0/3652653828 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a803e670 con 0x7fb3b015b420 2023-12-22T08:53:58.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.791+0000 7fb3b5b22640 1 -- 172.21.15.38:0/3652653828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b0155cc0 con 0x7fb3b015b420 2023-12-22T08:53:58.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.791+0000 7fb3b5b22640 1 -- 172.21.15.38:0/3652653828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b0158a60 con 0x7fb3b015b420 2023-12-22T08:53:58.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.792+0000 7fb3b5b22640 1 -- 172.21.15.38:0/3652653828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b0061910 con 0x7fb3b015b420 2023-12-22T08:53:58.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.793+0000 7fb3a57fa640 1 -- 172.21.15.38:0/3652653828 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb3a803e7d0 con 0x7fb3b015b420 2023-12-22T08:53:58.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.794+0000 7fb3a57fa640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb39c06a430 0x7fb39c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:58.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.794+0000 7fb3a57fa640 1 -- 172.21.15.38:0/3652653828 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb3a80ab2a0 con 0x7fb3b015b420 2023-12-22T08:53:58.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.795+0000 7fb3b4b20640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb39c06a430 0x7fb39c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:58.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.796+0000 7fb3b4b20640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb39c06a430 0x7fb39c06c8f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac006fd0 tx=0x7fb3ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:58.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.799+0000 7fb3a57fa640 1 -- 172.21.15.38:0/3652653828 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb3a8076af0 con 0x7fb3b015b420 2023-12-22T08:53:58.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.995+0000 7fb3b5b22640 1 -- 172.21.15.38:0/3652653828 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3b0155860 con 0x7fb39c06a430 2023-12-22T08:53:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.996+0000 7fb3a57fa640 1 -- 172.21.15.38:0/3652653828 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb3ac00b200 con 0x7fb39c06a430 2023-12-22T08:53:58.996 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 0 to deep-scrub 2023-12-22T08:53:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.998+0000 7fb3b5b22640 1 -- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb39c06a430 msgr2=0x7fb39c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.998+0000 7fb3b5b22640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb39c06a430 0x7fb39c06c8f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac006fd0 tx=0x7fb3ac008040 comp rx=0 tx=0).stop 2023-12-22T08:53:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.998+0000 7fb3b5b22640 1 -- 172.21.15.38:0/3652653828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3b015b420 msgr2=0x7fb3b0145880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.998+0000 7fb3b5b22640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3b015b420 0x7fb3b0145880 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8036040 tx=0x7fb3a8004a40 comp rx=0 tx=0).stop 2023-12-22T08:53:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.998+0000 7fb3b5b22640 1 -- 172.21.15.38:0/3652653828 shutdown_connections 2023-12-22T08:53:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.998+0000 7fb3b5b22640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb39c06a430 0x7fb39c06c8f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.998+0000 7fb3b5b22640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb3b015b420 0x7fb3b0145880 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.998+0000 7fb3b5b22640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb3b00a44a0 0x7fb3b0145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.998+0000 7fb3b5b22640 1 --2- 172.21.15.38:0/3652653828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3b0071000 0x7fb3b0157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.998+0000 7fb3b5b22640 1 -- 172.21.15.38:0/3652653828 >> 172.21.15.38:0/3652653828 conn(0x7fb3b00b1f70 msgr2=0x7fb3b006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.998+0000 7fb3b5b22640 1 -- 172.21.15.38:0/3652653828 shutdown_connections 2023-12-22T08:53:59.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:58.998+0000 7fb3b5b22640 1 -- 172.21.15.38:0/3652653828 wait complete. 2023-12-22T08:53:59.018 INFO:tasks.ceph:Scrubbing osd.1 2023-12-22T08:53:59.018 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:53:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.256+0000 7f7b7cf38640 1 Processor -- start 2023-12-22T08:53:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.256+0000 7f7b7cf38640 1 -- start start 2023-12-22T08:53:59.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.258+0000 7f7b7cf38640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7b7813fb30 0x7f7b7813ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.258+0000 7f7b7cf38640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b780ced50 con 0x7f7b7813d050 2023-12-22T08:53:59.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.258+0000 7f7b7cf38640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b78070c10 con 0x7f7b780710a0 2023-12-22T08:53:59.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.258+0000 7f7b7cf38640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7813d8a0 con 0x7f7b7813fb30 2023-12-22T08:53:59.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.258+0000 7f7b75d9b640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7b7813d050 0x7f7b780cdc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58472/0 (socket says 172.21.15.38:58472) 2023-12-22T08:53:59.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.258+0000 7f7b75d9b640 1 -- 172.21.15.38:0/1810506336 learned_addr learned my addr 172.21.15.38:0/1810506336 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:53:59.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.259+0000 7f7b7659c640 1 --2- 172.21.15.38:0/1810506336 >> v2:172.21.15.89:3300/0 conn(0x7f7b7813fb30 0x7f7b7813ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.259+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447504804 0 0) 0x7f7b780ced50 con 0x7f7b7813d050 2023-12-22T08:53:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.259+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b60003520 con 0x7f7b7813d050 2023-12-22T08:53:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.259+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2027818779 0 0) 0x7f7b60003520 con 0x7f7b7813d050 2023-12-22T08:53:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.259+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 >> v2:172.21.15.89:3300/0 conn(0x7f7b7813fb30 msgr2=0x7f7b7813ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.259+0000 7f7b7559a640 1 --2- 172.21.15.38:0/1810506336 >> v2:172.21.15.89:3300/0 conn(0x7f7b7813fb30 0x7f7b7813ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.259+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 >> v1:172.21.15.89:6789/0 conn(0x7f7b780710a0 legacy=0x7f7b780714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.259+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b780ce790 con 0x7f7b7813d050 2023-12-22T08:53:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.259+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f7b6c001670 con 0x7f7b7813d050 2023-12-22T08:53:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.260+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 >> v1:172.21.15.38:6789/0 conn(0x7f7b7813d050 legacy=0x7f7b780cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.260+0000 7f7b7559a640 1 --2- 172.21.15.38:0/1810506336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b600039c0 0x7f7b60003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.260+0000 7f7b7559a640 1 --2- 172.21.15.38:0/1810506336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b600047c0 0x7f7b60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.260+0000 7f7b7559a640 1 --2- 172.21.15.38:0/1810506336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b600051d0 0x7f7b6000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.260+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7813d8a0 con 0x7f7b600047c0 2023-12-22T08:53:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.260+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6000c120 con 0x7f7b600039c0 2023-12-22T08:53:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.260+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6000c2e0 con 0x7f7b600051d0 2023-12-22T08:53:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.260+0000 7f7b75d9b640 1 --2- 172.21.15.38:0/1810506336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b600047c0 0x7f7b60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.260+0000 7f7b7659c640 1 --2- 172.21.15.38:0/1810506336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b600039c0 0x7f7b60003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.260+0000 7f7b76d9d640 1 --2- 172.21.15.38:0/1810506336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b600051d0 0x7f7b6000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.260+0000 7f7b75d9b640 1 -- 172.21.15.38:0/1810506336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b600051d0 msgr2=0x7f7b6000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.260+0000 7f7b75d9b640 1 --2- 172.21.15.38:0/1810506336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b600051d0 0x7f7b6000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.260+0000 7f7b75d9b640 1 -- 172.21.15.38:0/1810506336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b600039c0 msgr2=0x7f7b60003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.261+0000 7f7b75d9b640 1 --2- 172.21.15.38:0/1810506336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b600039c0 0x7f7b60003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.261+0000 7f7b75d9b640 1 -- 172.21.15.38:0/1810506336 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b60003520 con 0x7f7b600047c0 2023-12-22T08:53:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.261+0000 7f7b76d9d640 1 --2- 172.21.15.38:0/1810506336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b600051d0 0x7f7b6000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.261+0000 7f7b76d9d640 1 -- 172.21.15.38:0/1810506336 reap_dead start 2023-12-22T08:53:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.262+0000 7f7b75d9b640 1 --2- 172.21.15.38:0/1810506336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b600047c0 0x7f7b60004c40 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00c160 tx=0x7f7b600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0f5286d3aa44a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.262+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c005ad0 con 0x7f7b600047c0 2023-12-22T08:53:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.262+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c005c50 con 0x7f7b600047c0 2023-12-22T08:53:59.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.262+0000 7f7b7559a640 1 -- 172.21.15.38:0/1810506336 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c02c7c0 con 0x7f7b600047c0 2023-12-22T08:53:59.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.262+0000 7f7b7cf38640 1 -- 172.21.15.38:0/1810506336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b600047c0 msgr2=0x7f7b60004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.262+0000 7f7b7cf38640 1 --2- 172.21.15.38:0/1810506336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b600047c0 0x7f7b60004c40 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00c160 tx=0x7f7b600057f0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.263+0000 7f7b7cf38640 1 -- 172.21.15.38:0/1810506336 shutdown_connections 2023-12-22T08:53:59.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.263+0000 7f7b7cf38640 1 --2- 172.21.15.38:0/1810506336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b600047c0 0x7f7b60004c40 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.263+0000 7f7b7cf38640 1 -- 172.21.15.38:0/1810506336 >> 172.21.15.38:0/1810506336 conn(0x7f7b7806f880 msgr2=0x7f7b780b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:59.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.263+0000 7f7b7cf38640 1 -- 172.21.15.38:0/1810506336 shutdown_connections 2023-12-22T08:53:59.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.263+0000 7f7b7cf38640 1 -- 172.21.15.38:0/1810506336 wait complete. 2023-12-22T08:53:59.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.264+0000 7f7b7cf38640 1 Processor -- start 2023-12-22T08:53:59.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.265+0000 7f7b7cf38640 1 -- start start 2023-12-22T08:53:59.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b7cf38640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b600047c0 0x7f7b781540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b7cf38640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b7813de90 0x7f7b7815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b7cf38640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b7813e310 0x7f7b7815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b7cf38640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b78154600 con 0x7f7b7813e310 2023-12-22T08:53:59.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b7cf38640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780ae070 con 0x7f7b7813de90 2023-12-22T08:53:59.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b7cf38640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b78159da0 con 0x7f7b600047c0 2023-12-22T08:53:59.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b76d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b7813e310 0x7f7b7815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b76d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b7813e310 0x7f7b7815cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57698/0 (socket says 172.21.15.38:57698) 2023-12-22T08:53:59.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b76d9d640 1 -- 172.21.15.38:0/2180445918 learned_addr learned my addr 172.21.15.38:0/2180445918 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:59.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b75d9b640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b7813de90 0x7f7b7815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b7659c640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b600047c0 0x7f7b781540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b76d9d640 1 -- 172.21.15.38:0/2180445918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b600047c0 msgr2=0x7f7b781540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b76d9d640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b600047c0 0x7f7b781540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b76d9d640 1 -- 172.21.15.38:0/2180445918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b7813de90 msgr2=0x7f7b7815c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b76d9d640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b7813de90 0x7f7b7815c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b76d9d640 1 -- 172.21.15.38:0/2180445918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78159220 con 0x7f7b7813e310 2023-12-22T08:53:59.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.266+0000 7f7b7659c640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b600047c0 0x7f7b781540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:59.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.267+0000 7f7b76d9d640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b7813e310 0x7f7b7815cdb0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f7b7806c200 tx=0x7f7b7000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:59.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.267+0000 7f7b66ffd640 1 -- 172.21.15.38:0/2180445918 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b70003b70 con 0x7f7b7813e310 2023-12-22T08:53:59.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.267+0000 7f7b66ffd640 1 -- 172.21.15.38:0/2180445918 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70003cf0 con 0x7f7b7813e310 2023-12-22T08:53:59.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.267+0000 7f7b66ffd640 1 -- 172.21.15.38:0/2180445918 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700052b0 con 0x7f7b7813e310 2023-12-22T08:53:59.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.267+0000 7f7b7cf38640 1 -- 172.21.15.38:0/2180445918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b78159500 con 0x7f7b7813e310 2023-12-22T08:53:59.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.267+0000 7f7b7cf38640 1 -- 172.21.15.38:0/2180445918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b78159ac0 con 0x7f7b7813e310 2023-12-22T08:53:59.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.268+0000 7f7b7cf38640 1 -- 172.21.15.38:0/2180445918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b780708a0 con 0x7f7b7813e310 2023-12-22T08:53:59.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.269+0000 7f7b66ffd640 1 -- 172.21.15.38:0/2180445918 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7b70005410 con 0x7f7b7813e310 2023-12-22T08:53:59.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.270+0000 7f7b66ffd640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b5806a460 0x7f7b5806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.270+0000 7f7b66ffd640 1 -- 172.21.15.38:0/2180445918 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7b70087ec0 con 0x7f7b7813e310 2023-12-22T08:53:59.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.270+0000 7f7b66ffd640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] conn(0x7f7b580702c0 0x7f7b580726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.270+0000 7f7b66ffd640 1 -- 172.21.15.38:0/2180445918 --> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b58072d90 con 0x7f7b580702c0 2023-12-22T08:53:59.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.270+0000 7f7b66ffd640 1 -- 172.21.15.38:0/2180445918 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b7008a4a0 con 0x7f7b7813e310 2023-12-22T08:53:59.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.271+0000 7f7b75d9b640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] conn(0x7f7b580702c0 0x7f7b580726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.271+0000 7f7b7659c640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b5806a460 0x7f7b5806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.271+0000 7f7b75d9b640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] conn(0x7f7b580702c0 0x7f7b580726e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:59.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.272+0000 7f7b7659c640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b5806a460 0x7f7b5806c920 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009a80 tx=0x7f7b68008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:59.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.272+0000 7f7b66ffd640 1 -- 172.21.15.38:0/2180445918 <== osd.1 v2:172.21.15.38:6808/84127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f7b58072d90 con 0x7f7b580702c0 2023-12-22T08:53:59.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.285+0000 7f7b7cf38640 1 -- 172.21.15.38:0/2180445918 --> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7b780cea70 con 0x7f7b580702c0 2023-12-22T08:53:59.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.286+0000 7f7b66ffd640 1 -- 172.21.15.38:0/2180445918 <== osd.1 v2:172.21.15.38:6808/84127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f7b6c03d040 con 0x7f7b580702c0 2023-12-22T08:53:59.287 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:53:59.287 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-22T08:53:59.287 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:53:59.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.286+0000 7f7b7cf38640 1 -- 172.21.15.38:0/2180445918 >> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] conn(0x7f7b580702c0 msgr2=0x7f7b580726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.286+0000 7f7b7cf38640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.38:6808/84127,v1:172.21.15.38:6809/84127] conn(0x7f7b580702c0 0x7f7b580726e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.286+0000 7f7b7cf38640 1 -- 172.21.15.38:0/2180445918 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b5806a460 msgr2=0x7f7b5806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.286+0000 7f7b7cf38640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f7b5806a460 0x7f7b5806c920 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009a80 tx=0x7f7b68008040 comp rx=0 tx=0).stop 2023-12-22T08:53:59.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.286+0000 7f7b7cf38640 1 -- 172.21.15.38:0/2180445918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b7813e310 msgr2=0x7f7b7815cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.286+0000 7f7b7cf38640 1 --2- 172.21.15.38:0/2180445918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b7813e310 0x7f7b7815cdb0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f7b7806c200 tx=0x7f7b7000dc00 comp rx=0 tx=0).stop 2023-12-22T08:53:59.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.286+0000 7f7b76d9d640 1 -- 172.21.15.38:0/2180445918 reap_dead start 2023-12-22T08:53:59.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.287+0000 7f7b7cf38640 1 -- 172.21.15.38:0/2180445918 shutdown_connections 2023-12-22T08:53:59.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.287+0000 7f7b7cf38640 1 -- 172.21.15.38:0/2180445918 >> 172.21.15.38:0/2180445918 conn(0x7f7b7806f880 msgr2=0x7f7b7813e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:59.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.287+0000 7f7b7cf38640 1 -- 172.21.15.38:0/2180445918 shutdown_connections 2023-12-22T08:53:59.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.287+0000 7f7b7cf38640 1 -- 172.21.15.38:0/2180445918 wait complete. 2023-12-22T08:53:59.308 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-22T08:53:59.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.534+0000 7fda3d638640 1 Processor -- start 2023-12-22T08:53:59.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.534+0000 7fda3d638640 1 -- start start 2023-12-22T08:53:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.536+0000 7fda3d638640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda3815d470 0x7fda380b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.537+0000 7fda3d638640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fda3815d850 0x7fda380ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.537+0000 7fda3d638640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fda38071ea0 0x7fda380b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.537+0000 7fda3d638640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda380ac8e0 con 0x7fda38071ea0 2023-12-22T08:53:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.537+0000 7fda3d638640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda380b4550 con 0x7fda3815d850 2023-12-22T08:53:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.537+0000 7fda3d638640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda380b4940 con 0x7fda3815d470 2023-12-22T08:53:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.537+0000 7fda377fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fda38071ea0 0x7fda380b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.537+0000 7fda377fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fda38071ea0 0x7fda380b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57710/0 (socket says 172.21.15.38:57710) 2023-12-22T08:53:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.537+0000 7fda377fe640 1 -- 172.21.15.38:0/4118711932 learned_addr learned my addr 172.21.15.38:0/4118711932 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.537+0000 7fda2ffff640 1 --2- 172.21.15.38:0/4118711932 >> v2:172.21.15.89:3300/0 conn(0x7fda3815d850 0x7fda380ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.537+0000 7fda36ffd640 1 --2- 172.21.15.38:0/4118711932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda3815d470 0x7fda380b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.538+0000 7fda377fe640 1 -- 172.21.15.38:0/4118711932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda3815d470 msgr2=0x7fda380b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:59.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.538+0000 7fda377fe640 1 --2- 172.21.15.38:0/4118711932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda3815d470 0x7fda380b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.538+0000 7fda377fe640 1 -- 172.21.15.38:0/4118711932 >> v2:172.21.15.89:3300/0 conn(0x7fda3815d850 msgr2=0x7fda380ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:53:59.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.538+0000 7fda377fe640 1 --2- 172.21.15.38:0/4118711932 >> v2:172.21.15.89:3300/0 conn(0x7fda3815d850 0x7fda380ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.538+0000 7fda377fe640 1 -- 172.21.15.38:0/4118711932 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda380b4c20 con 0x7fda38071ea0 2023-12-22T08:53:59.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.538+0000 7fda2ffff640 1 --2- 172.21.15.38:0/4118711932 >> v2:172.21.15.89:3300/0 conn(0x7fda3815d850 0x7fda380ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:53:59.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.539+0000 7fda377fe640 1 --2- 172.21.15.38:0/4118711932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda38071ea0 0x7fda380b2050 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fda380cff70 tx=0x7fda3002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01df14c3b256c67 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:59.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.540+0000 7fda367fc640 1 -- 172.21.15.38:0/4118711932 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3002ca70 con 0x7fda38071ea0 2023-12-22T08:53:59.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.540+0000 7fda367fc640 1 -- 172.21.15.38:0/4118711932 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3002cbd0 con 0x7fda38071ea0 2023-12-22T08:53:59.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.540+0000 7fda367fc640 1 -- 172.21.15.38:0/4118711932 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300343f0 con 0x7fda38071ea0 2023-12-22T08:53:59.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.540+0000 7fda3d638640 1 -- 172.21.15.38:0/4118711932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda38071ea0 msgr2=0x7fda380b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.540+0000 7fda3d638640 1 --2- 172.21.15.38:0/4118711932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda38071ea0 0x7fda380b2050 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fda380cff70 tx=0x7fda3002bed0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.541+0000 7fda3d638640 1 -- 172.21.15.38:0/4118711932 shutdown_connections 2023-12-22T08:53:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.541+0000 7fda3d638640 1 --2- 172.21.15.38:0/4118711932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda38071ea0 0x7fda380b2050 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.541+0000 7fda3d638640 1 --2- 172.21.15.38:0/4118711932 >> v2:172.21.15.89:3300/0 conn(0x7fda3815d850 0x7fda380ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.541+0000 7fda3d638640 1 --2- 172.21.15.38:0/4118711932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda3815d470 0x7fda380b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.541+0000 7fda3d638640 1 -- 172.21.15.38:0/4118711932 >> 172.21.15.38:0/4118711932 conn(0x7fda380cf070 msgr2=0x7fda380cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.541+0000 7fda3d638640 1 -- 172.21.15.38:0/4118711932 shutdown_connections 2023-12-22T08:53:59.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.541+0000 7fda3d638640 1 -- 172.21.15.38:0/4118711932 wait complete. 2023-12-22T08:53:59.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.543+0000 7fda3d638640 1 Processor -- start 2023-12-22T08:53:59.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.543+0000 7fda3d638640 1 -- start start 2023-12-22T08:53:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.544+0000 7fda3d638640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda38071ea0 0x7fda3814f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.544+0000 7fda3d638640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3815d470 0x7fda38150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.544+0000 7fda3d638640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3815d850 0x7fda380b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.544+0000 7fda3d638640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda38150ea0 con 0x7fda3815d470 2023-12-22T08:53:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.544+0000 7fda3d638640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda380cb620 con 0x7fda3815d850 2023-12-22T08:53:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.544+0000 7fda3d638640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3814fd90 con 0x7fda38071ea0 2023-12-22T08:53:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.544+0000 7fda2ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3815d470 0x7fda38150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.544+0000 7fda2ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3815d470 0x7fda38150070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57712/0 (socket says 172.21.15.38:57712) 2023-12-22T08:53:59.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.544+0000 7fda2ffff640 1 -- 172.21.15.38:0/778559917 learned_addr learned my addr 172.21.15.38:0/778559917 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:53:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda36ffd640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda38071ea0 0x7fda3814f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda2ffff640 1 -- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda38071ea0 msgr2=0x7fda3814f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda2ffff640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda38071ea0 0x7fda3814f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda2ffff640 1 -- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3815d850 msgr2=0x7fda380b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda377fe640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3815d850 0x7fda380b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda2ffff640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3815d850 0x7fda380b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda2ffff640 1 -- 172.21.15.38:0/778559917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda30009b30 con 0x7fda3815d470 2023-12-22T08:53:59.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda377fe640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3815d850 0x7fda380b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:53:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda2ffff640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3815d470 0x7fda38150070 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fda2000e7e0 tx=0x7fda2000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda2f7fe640 1 -- 172.21.15.38:0/778559917 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20004030 con 0x7fda3815d470 2023-12-22T08:53:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda2f7fe640 1 -- 172.21.15.38:0/778559917 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda20004190 con 0x7fda3815d470 2023-12-22T08:53:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda3d638640 1 -- 172.21.15.38:0/778559917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda38160520 con 0x7fda3815d470 2023-12-22T08:53:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda2f7fe640 1 -- 172.21.15.38:0/778559917 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20004520 con 0x7fda3815d470 2023-12-22T08:53:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.545+0000 7fda3d638640 1 -- 172.21.15.38:0/778559917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda380cb870 con 0x7fda3815d470 2023-12-22T08:53:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.547+0000 7fda3d638640 1 -- 172.21.15.38:0/778559917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda38061910 con 0x7fda3815d470 2023-12-22T08:53:59.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.548+0000 7fda2f7fe640 1 -- 172.21.15.38:0/778559917 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fda2000c6d0 con 0x7fda3815d470 2023-12-22T08:53:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.548+0000 7fda2f7fe640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1806a430 0x7fda1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:53:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.549+0000 7fda2f7fe640 1 -- 172.21.15.38:0/778559917 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fda20088290 con 0x7fda3815d470 2023-12-22T08:53:59.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.549+0000 7fda36ffd640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1806a430 0x7fda1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:53:59.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.550+0000 7fda36ffd640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1806a430 0x7fda1806c8f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fda28006fd0 tx=0x7fda28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:53:59.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.553+0000 7fda2f7fe640 1 -- 172.21.15.38:0/778559917 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fda20053c10 con 0x7fda3815d470 2023-12-22T08:53:59.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.746+0000 7fda3d638640 1 -- 172.21.15.38:0/778559917 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fda380ace10 con 0x7fda1806a430 2023-12-22T08:53:59.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.747+0000 7fda2f7fe640 1 -- 172.21.15.38:0/778559917 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fda2800e510 con 0x7fda1806a430 2023-12-22T08:53:59.748 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 1 to deep-scrub 2023-12-22T08:53:59.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.749+0000 7fda3d638640 1 -- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1806a430 msgr2=0x7fda1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.749+0000 7fda3d638640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1806a430 0x7fda1806c8f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fda28006fd0 tx=0x7fda28008040 comp rx=0 tx=0).stop 2023-12-22T08:53:59.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.749+0000 7fda3d638640 1 -- 172.21.15.38:0/778559917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3815d470 msgr2=0x7fda38150070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:53:59.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.749+0000 7fda3d638640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3815d470 0x7fda38150070 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fda2000e7e0 tx=0x7fda2000eca0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.750+0000 7fda3d638640 1 -- 172.21.15.38:0/778559917 shutdown_connections 2023-12-22T08:53:59.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.750+0000 7fda3d638640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda3815d850 0x7fda380b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.750+0000 7fda3d638640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fda1806a430 0x7fda1806c8f0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.750+0000 7fda3d638640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda3815d470 0x7fda38150070 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.750+0000 7fda3d638640 1 --2- 172.21.15.38:0/778559917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda38071ea0 0x7fda3814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:53:59.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.750+0000 7fda3d638640 1 -- 172.21.15.38:0/778559917 >> 172.21.15.38:0/778559917 conn(0x7fda380cf070 msgr2=0x7fda38156dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:53:59.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.750+0000 7fda3d638640 1 -- 172.21.15.38:0/778559917 shutdown_connections 2023-12-22T08:53:59.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.750+0000 7fda3d638640 1 -- 172.21.15.38:0/778559917 wait complete. 2023-12-22T08:53:59.769 INFO:tasks.ceph:Scrubbing osd.2 2023-12-22T08:53:59.769 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:53:59.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.998+0000 7f25e5e17640 1 Processor -- start 2023-12-22T08:53:59.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:53:59.998+0000 7f25e5e17640 1 -- start start 2023-12-22T08:54:00.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.000+0000 7f25e5e17640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f25e013fb30 0x7f25e013ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.000+0000 7f25e5e17640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25e00710a0 0x7f25e00714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.000+0000 7f25e5e17640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e00ced50 con 0x7f25e013d050 2023-12-22T08:54:00.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.000+0000 7f25e5e17640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e0070c10 con 0x7f25e00710a0 2023-12-22T08:54:00.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.000+0000 7f25e5e17640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e013d8a0 con 0x7f25e013fb30 2023-12-22T08:54:00.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.000+0000 7f25dffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25e00710a0 0x7f25e00714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.000+0000 7f25dffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f25e00710a0 0x7f25e00714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57720/0 (socket says 172.21.15.38:57720) 2023-12-22T08:54:00.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.000+0000 7f25dffff640 1 -- 172.21.15.38:0/3549206326 learned_addr learned my addr 172.21.15.38:0/3549206326 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:00.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.000+0000 7f25df7fe640 1 --2- 172.21.15.38:0/3549206326 >> v2:172.21.15.89:3300/0 conn(0x7f25e013fb30 0x7f25e013ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.001+0000 7f25dffff640 1 -- 172.21.15.38:0/3549206326 >> v2:172.21.15.89:3300/0 conn(0x7f25e013fb30 msgr2=0x7f25e013ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:00.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.001+0000 7f25dffff640 1 --2- 172.21.15.38:0/3549206326 >> v2:172.21.15.89:3300/0 conn(0x7f25e013fb30 0x7f25e013ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.001+0000 7f25dffff640 1 -- 172.21.15.38:0/3549206326 >> v1:172.21.15.38:6789/0 conn(0x7f25e013d050 legacy=0x7f25e00cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.001+0000 7f25dffff640 1 -- 172.21.15.38:0/3549206326 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e00ce790 con 0x7f25e00710a0 2023-12-22T08:54:00.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.001+0000 7f25deffd640 1 -- 172.21.15.38:0/3549206326 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985658452 0 0) 0x7f25e00ced50 con 0x7f25e013d050 2023-12-22T08:54:00.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.002+0000 7f25dffff640 1 --2- 172.21.15.38:0/3549206326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e00710a0 0x7f25e00714b0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f25e0070140 tx=0x7f25d802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241b5b776fb73f61 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:00.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.002+0000 7f25deffd640 1 -- 172.21.15.38:0/3549206326 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d802ca80 con 0x7f25e00710a0 2023-12-22T08:54:00.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.002+0000 7f25deffd640 1 -- 172.21.15.38:0/3549206326 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d802cbe0 con 0x7f25e00710a0 2023-12-22T08:54:00.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.002+0000 7f25deffd640 1 -- 172.21.15.38:0/3549206326 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d80343f0 con 0x7f25e00710a0 2023-12-22T08:54:00.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.003+0000 7f25e5e17640 1 -- 172.21.15.38:0/3549206326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e00710a0 msgr2=0x7f25e00714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.003+0000 7f25e5e17640 1 --2- 172.21.15.38:0/3549206326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e00710a0 0x7f25e00714b0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f25e0070140 tx=0x7f25d802bee0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.003+0000 7f25e5e17640 1 -- 172.21.15.38:0/3549206326 shutdown_connections 2023-12-22T08:54:00.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.003+0000 7f25e5e17640 1 --2- 172.21.15.38:0/3549206326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e00710a0 0x7f25e00714b0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.003+0000 7f25e5e17640 1 --2- 172.21.15.38:0/3549206326 >> v2:172.21.15.89:3300/0 conn(0x7f25e013fb30 0x7f25e013ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.003+0000 7f25e5e17640 1 -- 172.21.15.38:0/3549206326 >> 172.21.15.38:0/3549206326 conn(0x7f25e006f880 msgr2=0x7f25e00b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:00.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.003+0000 7f25e5e17640 1 -- 172.21.15.38:0/3549206326 shutdown_connections 2023-12-22T08:54:00.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.003+0000 7f25e5e17640 1 -- 172.21.15.38:0/3549206326 wait complete. 2023-12-22T08:54:00.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.005+0000 7f25e5e17640 1 Processor -- start 2023-12-22T08:54:00.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.006+0000 7f25e5e17640 1 -- start start 2023-12-22T08:54:00.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.007+0000 7f25e5e17640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e00710a0 0x7f25e01444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.007+0000 7f25e5e17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e013d050 0x7f25e0159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.007+0000 7f25e5e17640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25e013fb30 0x7f25e01f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.007+0000 7f25e5e17640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01f6000 con 0x7f25e00710a0 2023-12-22T08:54:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.007+0000 7f25e5e17640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01f6e60 con 0x7f25e013d050 2023-12-22T08:54:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.007+0000 7f25e5e17640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0159fb0 con 0x7f25e013fb30 2023-12-22T08:54:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.007+0000 7f25df7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e00710a0 0x7f25e01444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.007+0000 7f25df7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e00710a0 0x7f25e01444c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57722/0 (socket says 172.21.15.38:57722) 2023-12-22T08:54:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.007+0000 7f25df7fe640 1 -- 172.21.15.38:0/2110266666 learned_addr learned my addr 172.21.15.38:0/2110266666 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.007+0000 7f25df7fe640 1 -- 172.21.15.38:0/2110266666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25e013fb30 msgr2=0x7f25e01f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.007+0000 7f25d7fff640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e013d050 0x7f25e0159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.007+0000 7f25df7fe640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25e013fb30 0x7f25e01f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.007+0000 7f25df7fe640 1 -- 172.21.15.38:0/2110266666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e013d050 msgr2=0x7f25e0159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.008+0000 7f25df7fe640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e013d050 0x7f25e0159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.008+0000 7f25df7fe640 1 -- 172.21.15.38:0/2110266666 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d8009b30 con 0x7f25e00710a0 2023-12-22T08:54:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.008+0000 7f25d7fff640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25e013d050 0x7f25e0159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.008+0000 7f25df7fe640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e00710a0 0x7f25e01444c0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f25d000d800 tx=0x7f25d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.008+0000 7f25dcff9640 1 -- 172.21.15.38:0/2110266666 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d000b6c0 con 0x7f25e00710a0 2023-12-22T08:54:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.008+0000 7f25dcff9640 1 -- 172.21.15.38:0/2110266666 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d000b820 con 0x7f25e00710a0 2023-12-22T08:54:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.008+0000 7f25dcff9640 1 -- 172.21.15.38:0/2110266666 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d000bbb0 con 0x7f25e00710a0 2023-12-22T08:54:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.008+0000 7f25e5e17640 1 -- 172.21.15.38:0/2110266666 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e01f6250 con 0x7f25e00710a0 2023-12-22T08:54:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.008+0000 7f25e5e17640 1 -- 172.21.15.38:0/2110266666 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e01f6810 con 0x7f25e00710a0 2023-12-22T08:54:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.009+0000 7f25e5e17640 1 -- 172.21.15.38:0/2110266666 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25e00708a0 con 0x7f25e00710a0 2023-12-22T08:54:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.011+0000 7f25dcff9640 1 -- 172.21.15.38:0/2110266666 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f25d000bd10 con 0x7f25e00710a0 2023-12-22T08:54:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.012+0000 7f25dcff9640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25c006a430 0x7f25c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.012+0000 7f25dcff9640 1 -- 172.21.15.38:0/2110266666 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f25d0088b20 con 0x7f25e00710a0 2023-12-22T08:54:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.012+0000 7f25dcff9640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] conn(0x7f25c0070290 0x7f25c00726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.012+0000 7f25dcff9640 1 -- 172.21.15.38:0/2110266666 --> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25c0072d60 con 0x7f25c0070290 2023-12-22T08:54:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.012+0000 7f25dcff9640 1 -- 172.21.15.38:0/2110266666 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25d008d2c0 con 0x7f25e00710a0 2023-12-22T08:54:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.012+0000 7f25d7fff640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25c006a430 0x7f25c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.012+0000 7f25dffff640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] conn(0x7f25c0070290 0x7f25c00726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.013+0000 7f25dffff640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] conn(0x7f25c0070290 0x7f25c00726b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:00.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.013+0000 7f25d7fff640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25c006a430 0x7f25c006c8f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f25e015da70 tx=0x7f25c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:00.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.014+0000 7f25dcff9640 1 -- 172.21.15.38:0/2110266666 <== osd.2 v2:172.21.15.38:6824/84132 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f25c0072d60 con 0x7f25c0070290 2023-12-22T08:54:00.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.027+0000 7f25e5e17640 1 -- 172.21.15.38:0/2110266666 --> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f25e00cea70 con 0x7f25c0070290 2023-12-22T08:54:00.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.027+0000 7f25dcff9640 1 -- 172.21.15.38:0/2110266666 <== osd.2 v2:172.21.15.38:6824/84132 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f25d8009510 con 0x7f25c0070290 2023-12-22T08:54:00.028 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:54:00.028 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-22T08:54:00.028 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:54:00.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.027+0000 7f25e5e17640 1 -- 172.21.15.38:0/2110266666 >> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] conn(0x7f25c0070290 msgr2=0x7f25c00726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.028+0000 7f25e5e17640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.38:6824/84132,v1:172.21.15.38:6825/84132] conn(0x7f25c0070290 0x7f25c00726b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.028+0000 7f25e5e17640 1 -- 172.21.15.38:0/2110266666 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25c006a430 msgr2=0x7f25c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.028+0000 7f25e5e17640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f25c006a430 0x7f25c006c8f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f25e015da70 tx=0x7f25c8009040 comp rx=0 tx=0).stop 2023-12-22T08:54:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.028+0000 7f25e5e17640 1 -- 172.21.15.38:0/2110266666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e00710a0 msgr2=0x7f25e01444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.028+0000 7f25e5e17640 1 --2- 172.21.15.38:0/2110266666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f25e00710a0 0x7f25e01444c0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f25d000d800 tx=0x7f25d000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.028+0000 7f25dffff640 1 -- 172.21.15.38:0/2110266666 reap_dead start 2023-12-22T08:54:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.028+0000 7f25e5e17640 1 -- 172.21.15.38:0/2110266666 shutdown_connections 2023-12-22T08:54:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.028+0000 7f25e5e17640 1 -- 172.21.15.38:0/2110266666 >> 172.21.15.38:0/2110266666 conn(0x7f25e006f880 msgr2=0x7f25e00b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.028+0000 7f25e5e17640 1 -- 172.21.15.38:0/2110266666 shutdown_connections 2023-12-22T08:54:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.028+0000 7f25e5e17640 1 -- 172.21.15.38:0/2110266666 wait complete. 2023-12-22T08:54:00.049 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-22T08:54:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.274+0000 7f73f736e640 1 Processor -- start 2023-12-22T08:54:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.274+0000 7f73f736e640 1 -- start start 2023-12-22T08:54:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.276+0000 7f73f736e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73f006d210 0x7f73f015e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.276+0000 7f73f736e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f73f00cb4c0 0x7f73f0159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.276+0000 7f73f736e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f00706d0 con 0x7f73f006d5f0 2023-12-22T08:54:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.276+0000 7f73f736e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f00cbf40 con 0x7f73f00cb4c0 2023-12-22T08:54:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.276+0000 7f73f736e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00ce840 con 0x7f73f006d210 2023-12-22T08:54:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.276+0000 7f73f6b6d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f73f006d5f0 0x7f73f00cc150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58498/0 (socket says 172.21.15.38:58498) 2023-12-22T08:54:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.276+0000 7f73f6b6d640 1 -- 172.21.15.38:0/3414956328 learned_addr learned my addr 172.21.15.38:0/3414956328 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:54:00.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f5b6b640 1 --2- 172.21.15.38:0/3414956328 >> v2:172.21.15.89:3300/0 conn(0x7f73f00cb4c0 0x7f73f0159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f636c640 1 --2- 172.21.15.38:0/3414956328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73f006d210 0x7f73f015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131790976 0 0) 0x7f73f00706d0 con 0x7f73f006d5f0 2023-12-22T08:54:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73dc003520 con 0x7f73f006d5f0 2023-12-22T08:54:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3956347158 0 0) 0x7f73dc003520 con 0x7f73f006d5f0 2023-12-22T08:54:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73f006d210 msgr2=0x7f73f015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 --2- 172.21.15.38:0/3414956328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73f006d210 0x7f73f015e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 >> v2:172.21.15.89:3300/0 conn(0x7f73f00cb4c0 msgr2=0x7f73f0159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 --2- 172.21.15.38:0/3414956328 >> v2:172.21.15.89:3300/0 conn(0x7f73f00cb4c0 0x7f73f0159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f00ceb20 con 0x7f73f006d5f0 2023-12-22T08:54:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f73e80019f0 con 0x7f73f006d5f0 2023-12-22T08:54:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 >> v1:172.21.15.38:6789/0 conn(0x7f73f006d5f0 legacy=0x7f73f00cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 --2- 172.21.15.38:0/3414956328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73dc003970 0x7f73dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 --2- 172.21.15.38:0/3414956328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73f006d210 0x7f73dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 --2- 172.21.15.38:0/3414956328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73dc004d00 0x7f73dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00cbf40 con 0x7f73dc004d00 2023-12-22T08:54:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00ce840 con 0x7f73dc003970 2023-12-22T08:54:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.277+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc00b980 con 0x7f73f006d210 2023-12-22T08:54:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.278+0000 7f73f6b6d640 1 --2- 172.21.15.38:0/3414956328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73dc004d00 0x7f73dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.278+0000 7f73f636c640 1 --2- 172.21.15.38:0/3414956328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73dc003970 0x7f73dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.278+0000 7f73f5b6b640 1 --2- 172.21.15.38:0/3414956328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73f006d210 0x7f73dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.278+0000 7f73f6b6d640 1 -- 172.21.15.38:0/3414956328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73f006d210 msgr2=0x7f73dc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.278+0000 7f73f6b6d640 1 --2- 172.21.15.38:0/3414956328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73f006d210 0x7f73dc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.278+0000 7f73f6b6d640 1 -- 172.21.15.38:0/3414956328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73dc003970 msgr2=0x7f73dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.278+0000 7f73f6b6d640 1 --2- 172.21.15.38:0/3414956328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73dc003970 0x7f73dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.278+0000 7f73f6b6d640 1 -- 172.21.15.38:0/3414956328 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc003520 con 0x7f73dc004d00 2023-12-22T08:54:00.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.278+0000 7f73f636c640 1 --2- 172.21.15.38:0/3414956328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73dc003970 0x7f73dc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:54:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.279+0000 7f73f6b6d640 1 --2- 172.21.15.38:0/3414956328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73dc004d00 0x7f73dc005180 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f73e800a8d0 tx=0x7f73dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfbae22b0dc474ef server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.280+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8034630 con 0x7f73dc004d00 2023-12-22T08:54:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.280+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e802f070 con 0x7f73dc004d00 2023-12-22T08:54:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.280+0000 7f73f536a640 1 -- 172.21.15.38:0/3414956328 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e80349d0 con 0x7f73dc004d00 2023-12-22T08:54:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.280+0000 7f73f736e640 1 -- 172.21.15.38:0/3414956328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73dc004d00 msgr2=0x7f73dc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.280+0000 7f73f736e640 1 --2- 172.21.15.38:0/3414956328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73dc004d00 0x7f73dc005180 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f73e800a8d0 tx=0x7f73dc0057f0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.280+0000 7f73f6b6d640 1 -- 172.21.15.38:0/3414956328 reap_dead start 2023-12-22T08:54:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.280+0000 7f73f736e640 1 -- 172.21.15.38:0/3414956328 shutdown_connections 2023-12-22T08:54:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.280+0000 7f73f736e640 1 -- 172.21.15.38:0/3414956328 >> 172.21.15.38:0/3414956328 conn(0x7f73f00b1f70 msgr2=0x7f73f00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.280+0000 7f73f736e640 1 -- 172.21.15.38:0/3414956328 shutdown_connections 2023-12-22T08:54:00.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.281+0000 7f73f736e640 1 -- 172.21.15.38:0/3414956328 wait complete. 2023-12-22T08:54:00.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.282+0000 7f73f736e640 1 Processor -- start 2023-12-22T08:54:00.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.283+0000 7f73f736e640 1 -- start start 2023-12-22T08:54:00.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.283+0000 7f73f736e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73dc004d00 0x7f73f01464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.283+0000 7f73f736e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73f0146dd0 0x7f73f0147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.283+0000 7f73f736e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73f00a3660 0x7f73f00a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.284+0000 7f73f736e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00a4020 con 0x7f73f0146dd0 2023-12-22T08:54:00.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.284+0000 7f73f736e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f0147940 con 0x7f73dc004d00 2023-12-22T08:54:00.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.284+0000 7f73f736e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f0147c20 con 0x7f73f00a3660 2023-12-22T08:54:00.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.284+0000 7f73f5b6b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73f0146dd0 0x7f73f0147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.284+0000 7f73f5b6b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73f0146dd0 0x7f73f0147250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57736/0 (socket says 172.21.15.38:57736) 2023-12-22T08:54:00.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.284+0000 7f73f5b6b640 1 -- 172.21.15.38:0/453484802 learned_addr learned my addr 172.21.15.38:0/453484802 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:00.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.284+0000 7f73f636c640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73dc004d00 0x7f73f01464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.284+0000 7f73f5b6b640 1 -- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73f00a3660 msgr2=0x7f73f00a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.284+0000 7f73f6b6d640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73f00a3660 0x7f73f00a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.284+0000 7f73f5b6b640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73f00a3660 0x7f73f00a3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.284+0000 7f73f5b6b640 1 -- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73dc004d00 msgr2=0x7f73f01464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.284+0000 7f73f5b6b640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73dc004d00 0x7f73f01464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.284+0000 7f73f5b6b640 1 -- 172.21.15.38:0/453484802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f0147f00 con 0x7f73f0146dd0 2023-12-22T08:54:00.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.285+0000 7f73f5b6b640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73f0146dd0 0x7f73f0147250 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f73e00116d0 tx=0x7f73e0011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:00.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.285+0000 7f73e6ffd640 1 -- 172.21.15.38:0/453484802 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000f9c0 con 0x7f73f0146dd0 2023-12-22T08:54:00.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.285+0000 7f73e6ffd640 1 -- 172.21.15.38:0/453484802 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e000fb20 con 0x7f73f0146dd0 2023-12-22T08:54:00.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.285+0000 7f73e6ffd640 1 -- 172.21.15.38:0/453484802 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000fe90 con 0x7f73f0146dd0 2023-12-22T08:54:00.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.285+0000 7f73f736e640 1 -- 172.21.15.38:0/453484802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f01481e0 con 0x7f73f0146dd0 2023-12-22T08:54:00.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.285+0000 7f73f736e640 1 -- 172.21.15.38:0/453484802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f0159180 con 0x7f73f0146dd0 2023-12-22T08:54:00.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.286+0000 7f73f736e640 1 -- 172.21.15.38:0/453484802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f0061910 con 0x7f73f0146dd0 2023-12-22T08:54:00.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.287+0000 7f73e6ffd640 1 -- 172.21.15.38:0/453484802 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f73e0015460 con 0x7f73f0146dd0 2023-12-22T08:54:00.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.288+0000 7f73e6ffd640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73d406a3f0 0x7f73d406c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.288+0000 7f73e6ffd640 1 -- 172.21.15.38:0/453484802 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f73e0088c50 con 0x7f73f0146dd0 2023-12-22T08:54:00.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.289+0000 7f73f636c640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73d406a3f0 0x7f73d406c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.290+0000 7f73f636c640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73d406a3f0 0x7f73d406c8b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009990 tx=0x7f73ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:00.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.292+0000 7f73e6ffd640 1 -- 172.21.15.38:0/453484802 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f73e0054550 con 0x7f73f0146dd0 2023-12-22T08:54:00.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.489+0000 7f73f736e640 1 -- 172.21.15.38:0/453484802 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f73f0071b70 con 0x7f73d406a3f0 2023-12-22T08:54:00.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.490+0000 7f73e6ffd640 1 -- 172.21.15.38:0/453484802 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f73ec004030 con 0x7f73d406a3f0 2023-12-22T08:54:00.491 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 2 to deep-scrub 2023-12-22T08:54:00.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.493+0000 7f73f736e640 1 -- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73d406a3f0 msgr2=0x7f73d406c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.493+0000 7f73f736e640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73d406a3f0 0x7f73d406c8b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009990 tx=0x7f73ec008040 comp rx=0 tx=0).stop 2023-12-22T08:54:00.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.493+0000 7f73f736e640 1 -- 172.21.15.38:0/453484802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73f0146dd0 msgr2=0x7f73f0147250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.493+0000 7f73f736e640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73f0146dd0 0x7f73f0147250 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f73e00116d0 tx=0x7f73e0011b90 comp rx=0 tx=0).stop 2023-12-22T08:54:00.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.493+0000 7f73f736e640 1 -- 172.21.15.38:0/453484802 shutdown_connections 2023-12-22T08:54:00.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.493+0000 7f73f736e640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73f00a3660 0x7f73f00a3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.493+0000 7f73f736e640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f73d406a3f0 0x7f73d406c8b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.493+0000 7f73f736e640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73f0146dd0 0x7f73f0147250 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.493+0000 7f73f736e640 1 --2- 172.21.15.38:0/453484802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73dc004d00 0x7f73f01464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.493+0000 7f73f736e640 1 -- 172.21.15.38:0/453484802 >> 172.21.15.38:0/453484802 conn(0x7f73f00b1f70 msgr2=0x7f73f015ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:00.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.493+0000 7f73f736e640 1 -- 172.21.15.38:0/453484802 shutdown_connections 2023-12-22T08:54:00.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.493+0000 7f73f736e640 1 -- 172.21.15.38:0/453484802 wait complete. 2023-12-22T08:54:00.514 INFO:tasks.ceph:Scrubbing osd.3 2023-12-22T08:54:00.514 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:54:00.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.746+0000 7fb5def9e640 1 Processor -- start 2023-12-22T08:54:00.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.746+0000 7fb5def9e640 1 -- start start 2023-12-22T08:54:00.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.747+0000 7fb5def9e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb5d815b370 0x7fb5d806d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.747+0000 7fb5def9e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb5d80ae6c0 0x7fb5d806fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.747+0000 7fb5def9e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d815ca20 con 0x7fb5d806d6a0 2023-12-22T08:54:00.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.747+0000 7fb5def9e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d815b750 con 0x7fb5d815b370 2023-12-22T08:54:00.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.747+0000 7fb5def9e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d806dc20 con 0x7fb5d80ae6c0 2023-12-22T08:54:00.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.748+0000 7fb5ddf9c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb5d815b370 0x7fb5d806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.748+0000 7fb5ddf9c640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb5d815b370 0x7fb5d806d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57752/0 (socket says 172.21.15.38:57752) 2023-12-22T08:54:00.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.748+0000 7fb5ddf9c640 1 -- 172.21.15.38:0/93737071 learned_addr learned my addr 172.21.15.38:0/93737071 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:00.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.748+0000 7fb5de79d640 1 --2- 172.21.15.38:0/93737071 >> v2:172.21.15.89:3300/0 conn(0x7fb5d80ae6c0 0x7fb5d806fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.748+0000 7fb5ddf9c640 1 -- 172.21.15.38:0/93737071 >> v2:172.21.15.89:3300/0 conn(0x7fb5d80ae6c0 msgr2=0x7fb5d806fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:00.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.748+0000 7fb5ddf9c640 1 --2- 172.21.15.38:0/93737071 >> v2:172.21.15.89:3300/0 conn(0x7fb5d80ae6c0 0x7fb5d806fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.749+0000 7fb5ddf9c640 1 -- 172.21.15.38:0/93737071 >> v1:172.21.15.89:6789/0 conn(0x7fb5d806d6a0 legacy=0x7fb5d80adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.749+0000 7fb5ddf9c640 1 -- 172.21.15.38:0/93737071 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d806df00 con 0x7fb5d815b370 2023-12-22T08:54:00.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.750+0000 7fb5ddf9c640 1 --2- 172.21.15.38:0/93737071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5d815b370 0x7fb5d806d160 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80b20e0 tx=0x7fb5d402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944bdf1db12091d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:00.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.751+0000 7fb5dcf9a640 1 -- 172.21.15.38:0/93737071 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4030860 con 0x7fb5d815b370 2023-12-22T08:54:00.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.751+0000 7fb5dcf9a640 1 -- 172.21.15.38:0/93737071 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d40309c0 con 0x7fb5d815b370 2023-12-22T08:54:00.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.751+0000 7fb5dcf9a640 1 -- 172.21.15.38:0/93737071 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4030d50 con 0x7fb5d815b370 2023-12-22T08:54:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.751+0000 7fb5def9e640 1 -- 172.21.15.38:0/93737071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5d815b370 msgr2=0x7fb5d806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.751+0000 7fb5def9e640 1 --2- 172.21.15.38:0/93737071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5d815b370 0x7fb5d806d160 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80b20e0 tx=0x7fb5d402b9a0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.751+0000 7fb5def9e640 1 -- 172.21.15.38:0/93737071 shutdown_connections 2023-12-22T08:54:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.751+0000 7fb5def9e640 1 --2- 172.21.15.38:0/93737071 >> v2:172.21.15.89:3300/0 conn(0x7fb5d80ae6c0 0x7fb5d806fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.751+0000 7fb5def9e640 1 --2- 172.21.15.38:0/93737071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5d815b370 0x7fb5d806d160 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.751+0000 7fb5def9e640 1 -- 172.21.15.38:0/93737071 >> 172.21.15.38:0/93737071 conn(0x7fb5d80b1110 msgr2=0x7fb5d80b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.752+0000 7fb5def9e640 1 -- 172.21.15.38:0/93737071 shutdown_connections 2023-12-22T08:54:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.752+0000 7fb5def9e640 1 -- 172.21.15.38:0/93737071 wait complete. 2023-12-22T08:54:00.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.753+0000 7fb5def9e640 1 Processor -- start 2023-12-22T08:54:00.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.753+0000 7fb5def9e640 1 -- start start 2023-12-22T08:54:00.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.754+0000 7fb5def9e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5d806d6a0 0x7fb5d8141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.754+0000 7fb5def9e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5d80ae6c0 0x7fb5d809c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.754+0000 7fb5def9e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5d815b370 0x7fb5d80addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.754+0000 7fb5def9e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80ad000 con 0x7fb5d815b370 2023-12-22T08:54:00.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.754+0000 7fb5def9e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80ad2e0 con 0x7fb5d806d6a0 2023-12-22T08:54:00.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.754+0000 7fb5def9e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80ad5c0 con 0x7fb5d80ae6c0 2023-12-22T08:54:00.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.755+0000 7fb5de79d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5d815b370 0x7fb5d80addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.755+0000 7fb5de79d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5d815b370 0x7fb5d80addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57766/0 (socket says 172.21.15.38:57766) 2023-12-22T08:54:00.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.755+0000 7fb5de79d640 1 -- 172.21.15.38:0/383369821 learned_addr learned my addr 172.21.15.38:0/383369821 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:00.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.755+0000 7fb5de79d640 1 -- 172.21.15.38:0/383369821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5d80ae6c0 msgr2=0x7fb5d809c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.755+0000 7fb5de79d640 1 --2- 172.21.15.38:0/383369821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5d80ae6c0 0x7fb5d809c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.755+0000 7fb5de79d640 1 -- 172.21.15.38:0/383369821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5d806d6a0 msgr2=0x7fb5d8141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.755+0000 7fb5de79d640 1 --2- 172.21.15.38:0/383369821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5d806d6a0 0x7fb5d8141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.755+0000 7fb5de79d640 1 -- 172.21.15.38:0/383369821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d40094d0 con 0x7fb5d815b370 2023-12-22T08:54:00.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.755+0000 7fb5de79d640 1 --2- 172.21.15.38:0/383369821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5d815b370 0x7fb5d80addc0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0007de0 tx=0x7fb5d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:00.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.756+0000 7fb5ce7fc640 1 -- 172.21.15.38:0/383369821 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0014620 con 0x7fb5d815b370 2023-12-22T08:54:00.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.756+0000 7fb5ce7fc640 1 -- 172.21.15.38:0/383369821 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d000ee90 con 0x7fb5d815b370 2023-12-22T08:54:00.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.756+0000 7fb5ce7fc640 1 -- 172.21.15.38:0/383369821 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00149e0 con 0x7fb5d815b370 2023-12-22T08:54:00.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.756+0000 7fb5def9e640 1 -- 172.21.15.38:0/383369821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d80ad8a0 con 0x7fb5d815b370 2023-12-22T08:54:00.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.756+0000 7fb5def9e640 1 -- 172.21.15.38:0/383369821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d809c6e0 con 0x7fb5d815b370 2023-12-22T08:54:00.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.757+0000 7fb5def9e640 1 -- 172.21.15.38:0/383369821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5d806f4f0 con 0x7fb5d815b370 2023-12-22T08:54:00.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.758+0000 7fb5ce7fc640 1 -- 172.21.15.38:0/383369821 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb5d0014b40 con 0x7fb5d815b370 2023-12-22T08:54:00.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.759+0000 7fb5ce7fc640 1 --2- 172.21.15.38:0/383369821 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5bc06a430 0x7fb5bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.759+0000 7fb5ce7fc640 1 -- 172.21.15.38:0/383369821 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb5d0088fc0 con 0x7fb5d815b370 2023-12-22T08:54:00.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.759+0000 7fb5ce7fc640 1 --2- 172.21.15.38:0/383369821 >> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] conn(0x7fb5bc070290 0x7fb5bc0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:00.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.759+0000 7fb5ce7fc640 1 -- 172.21.15.38:0/383369821 --> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5bc072d60 con 0x7fb5bc070290 2023-12-22T08:54:00.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.759+0000 7fb5ce7fc640 1 -- 172.21.15.38:0/383369821 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5d008b620 con 0x7fb5d815b370 2023-12-22T08:54:00.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.759+0000 7fb5ddf9c640 1 --2- 172.21.15.38:0/383369821 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5bc06a430 0x7fb5bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.759+0000 7fb5dd79b640 1 --2- 172.21.15.38:0/383369821 >> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] conn(0x7fb5bc070290 0x7fb5bc0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:00.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.760+0000 7fb5dd79b640 1 --2- 172.21.15.38:0/383369821 >> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] conn(0x7fb5bc070290 0x7fb5bc0726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:00.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.761+0000 7fb5ddf9c640 1 --2- 172.21.15.38:0/383369821 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5bc06a430 0x7fb5bc06c8f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4036000 tx=0x7fb5d403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:00.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.761+0000 7fb5ce7fc640 1 -- 172.21.15.38:0/383369821 <== osd.3 v2:172.21.15.38:6816/84138 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fb5bc072d60 con 0x7fb5bc070290 2023-12-22T08:54:00.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.774+0000 7fb5def9e640 1 -- 172.21.15.38:0/383369821 --> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb5d80ad730 con 0x7fb5bc070290 2023-12-22T08:54:00.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.774+0000 7fb5ce7fc640 1 -- 172.21.15.38:0/383369821 <== osd.3 v2:172.21.15.38:6816/84138 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fb5d80ad730 con 0x7fb5bc070290 2023-12-22T08:54:00.775 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:54:00.775 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-22T08:54:00.775 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:54:00.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.775+0000 7fb5def9e640 1 -- 172.21.15.38:0/383369821 >> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] conn(0x7fb5bc070290 msgr2=0x7fb5bc0726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.775+0000 7fb5def9e640 1 --2- 172.21.15.38:0/383369821 >> [v2:172.21.15.38:6816/84138,v1:172.21.15.38:6817/84138] conn(0x7fb5bc070290 0x7fb5bc0726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.775+0000 7fb5def9e640 1 -- 172.21.15.38:0/383369821 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5bc06a430 msgr2=0x7fb5bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.775+0000 7fb5def9e640 1 --2- 172.21.15.38:0/383369821 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fb5bc06a430 0x7fb5bc06c8f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4036000 tx=0x7fb5d403b040 comp rx=0 tx=0).stop 2023-12-22T08:54:00.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.775+0000 7fb5def9e640 1 -- 172.21.15.38:0/383369821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5d815b370 msgr2=0x7fb5d80addc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:00.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.775+0000 7fb5def9e640 1 --2- 172.21.15.38:0/383369821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5d815b370 0x7fb5d80addc0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0007de0 tx=0x7fb5d000e4b0 comp rx=0 tx=0).stop 2023-12-22T08:54:00.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.775+0000 7fb5de79d640 1 -- 172.21.15.38:0/383369821 reap_dead start 2023-12-22T08:54:00.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.775+0000 7fb5def9e640 1 -- 172.21.15.38:0/383369821 shutdown_connections 2023-12-22T08:54:00.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.775+0000 7fb5def9e640 1 -- 172.21.15.38:0/383369821 >> 172.21.15.38:0/383369821 conn(0x7fb5d80b1110 msgr2=0x7fb5d80b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:00.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.775+0000 7fb5def9e640 1 -- 172.21.15.38:0/383369821 shutdown_connections 2023-12-22T08:54:00.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:00.775+0000 7fb5def9e640 1 -- 172.21.15.38:0/383369821 wait complete. 2023-12-22T08:54:00.793 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-22T08:54:01.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.010+0000 7fa383fff640 1 Processor -- start 2023-12-22T08:54:01.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.010+0000 7fa383fff640 1 -- start start 2023-12-22T08:54:01.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.011+0000 7fa383fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa38415b420 0x7fa38406d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.011+0000 7fa383fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa3840a44a0 0x7fa3840708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.011+0000 7fa383fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa384070e30 0x7fa38406f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.011+0000 7fa383fff640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3840cdae0 con 0x7fa384070e30 2023-12-22T08:54:01.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.011+0000 7fa383fff640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa384071260 con 0x7fa3840a44a0 2023-12-22T08:54:01.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.011+0000 7fa383fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38406dec0 con 0x7fa38415b420 2023-12-22T08:54:01.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.011+0000 7fa3837fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa384070e30 0x7fa38406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.011+0000 7fa3837fe640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa384070e30 0x7fa38406f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33038/0 (socket says 172.21.15.38:33038) 2023-12-22T08:54:01.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.011+0000 7fa3837fe640 1 -- 172.21.15.38:0/3543587046 learned_addr learned my addr 172.21.15.38:0/3543587046 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:01.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.012+0000 7fa37bfff640 1 --2- 172.21.15.38:0/3543587046 >> v2:172.21.15.89:3300/0 conn(0x7fa3840a44a0 0x7fa3840708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.012+0000 7fa382ffd640 1 --2- 172.21.15.38:0/3543587046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa38415b420 0x7fa38406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.012+0000 7fa3837fe640 1 -- 172.21.15.38:0/3543587046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa38415b420 msgr2=0x7fa38406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:01.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.012+0000 7fa3837fe640 1 --2- 172.21.15.38:0/3543587046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa38415b420 0x7fa38406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.012+0000 7fa3837fe640 1 -- 172.21.15.38:0/3543587046 >> v2:172.21.15.89:3300/0 conn(0x7fa3840a44a0 msgr2=0x7fa3840708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:01.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.012+0000 7fa3837fe640 1 --2- 172.21.15.38:0/3543587046 >> v2:172.21.15.89:3300/0 conn(0x7fa3840a44a0 0x7fa3840708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.012+0000 7fa3837fe640 1 -- 172.21.15.38:0/3543587046 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38415b800 con 0x7fa384070e30 2023-12-22T08:54:01.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.012+0000 7fa382ffd640 1 --2- 172.21.15.38:0/3543587046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa38415b420 0x7fa38406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:01.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.012+0000 7fa37bfff640 1 --2- 172.21.15.38:0/3543587046 >> v2:172.21.15.89:3300/0 conn(0x7fa3840a44a0 0x7fa3840708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:01.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.013+0000 7fa3837fe640 1 --2- 172.21.15.38:0/3543587046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa384070e30 0x7fa38406f250 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fa38406a7f0 tx=0x7fa37c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4903d78a12693d62 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:01.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.013+0000 7fa3827fc640 1 -- 172.21.15.38:0/3543587046 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c02ca80 con 0x7fa384070e30 2023-12-22T08:54:01.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.013+0000 7fa3827fc640 1 -- 172.21.15.38:0/3543587046 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c02cbe0 con 0x7fa384070e30 2023-12-22T08:54:01.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.014+0000 7fa3827fc640 1 -- 172.21.15.38:0/3543587046 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c0343f0 con 0x7fa384070e30 2023-12-22T08:54:01.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.014+0000 7fa383fff640 1 -- 172.21.15.38:0/3543587046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa384070e30 msgr2=0x7fa38406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.014+0000 7fa383fff640 1 --2- 172.21.15.38:0/3543587046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa384070e30 0x7fa38406f250 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fa38406a7f0 tx=0x7fa37c02bee0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.014+0000 7fa383fff640 1 -- 172.21.15.38:0/3543587046 shutdown_connections 2023-12-22T08:54:01.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.014+0000 7fa383fff640 1 --2- 172.21.15.38:0/3543587046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa384070e30 0x7fa38406f250 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.014+0000 7fa383fff640 1 --2- 172.21.15.38:0/3543587046 >> v2:172.21.15.89:3300/0 conn(0x7fa3840a44a0 0x7fa3840708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.014+0000 7fa383fff640 1 --2- 172.21.15.38:0/3543587046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa38415b420 0x7fa38406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.014+0000 7fa383fff640 1 -- 172.21.15.38:0/3543587046 >> 172.21.15.38:0/3543587046 conn(0x7fa3840b1f70 msgr2=0x7fa3840b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:01.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.014+0000 7fa383fff640 1 -- 172.21.15.38:0/3543587046 shutdown_connections 2023-12-22T08:54:01.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.014+0000 7fa383fff640 1 -- 172.21.15.38:0/3543587046 wait complete. 2023-12-22T08:54:01.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.016+0000 7fa383fff640 1 Processor -- start 2023-12-22T08:54:01.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.016+0000 7fa383fff640 1 -- start start 2023-12-22T08:54:01.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.017+0000 7fa383fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa384070e30 0x7fa38414a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.017+0000 7fa383fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3840a44a0 0x7fa3840cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.017+0000 7fa383fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa38415b420 0x7fa3840ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.017+0000 7fa383fff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa384155230 con 0x7fa384070e30 2023-12-22T08:54:01.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.017+0000 7fa383fff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38414a7e0 con 0x7fa38415b420 2023-12-22T08:54:01.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.017+0000 7fa383fff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38409f6c0 con 0x7fa3840a44a0 2023-12-22T08:54:01.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.018+0000 7fa382ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa384070e30 0x7fa38414a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.018+0000 7fa382ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa384070e30 0x7fa38414a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33046/0 (socket says 172.21.15.38:33046) 2023-12-22T08:54:01.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.018+0000 7fa382ffd640 1 -- 172.21.15.38:0/357620026 learned_addr learned my addr 172.21.15.38:0/357620026 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:01.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.018+0000 7fa3837fe640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa38415b420 0x7fa3840ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.018+0000 7fa37bfff640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3840a44a0 0x7fa3840cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.018+0000 7fa382ffd640 1 -- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3840a44a0 msgr2=0x7fa3840cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.018+0000 7fa382ffd640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3840a44a0 0x7fa3840cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.018+0000 7fa382ffd640 1 -- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa38415b420 msgr2=0x7fa3840ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.018+0000 7fa382ffd640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa38415b420 0x7fa3840ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.018+0000 7fa382ffd640 1 -- 172.21.15.38:0/357620026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c009b30 con 0x7fa384070e30 2023-12-22T08:54:01.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.018+0000 7fa37bfff640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3840a44a0 0x7fa3840cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:01.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.019+0000 7fa382ffd640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa384070e30 0x7fa38414a2a0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fa37400c7f0 tx=0x7fa37400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:01.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.019+0000 7fa37b7fe640 1 -- 172.21.15.38:0/357620026 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374007820 con 0x7fa384070e30 2023-12-22T08:54:01.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.019+0000 7fa37b7fe640 1 -- 172.21.15.38:0/357620026 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa374007980 con 0x7fa384070e30 2023-12-22T08:54:01.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.019+0000 7fa37b7fe640 1 -- 172.21.15.38:0/357620026 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374007cf0 con 0x7fa384070e30 2023-12-22T08:54:01.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.019+0000 7fa383fff640 1 -- 172.21.15.38:0/357620026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa384155480 con 0x7fa384070e30 2023-12-22T08:54:01.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.019+0000 7fa383fff640 1 -- 172.21.15.38:0/357620026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa384155a40 con 0x7fa384070e30 2023-12-22T08:54:01.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.020+0000 7fa383fff640 1 -- 172.21.15.38:0/357620026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa384061910 con 0x7fa384070e30 2023-12-22T08:54:01.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.021+0000 7fa37b7fe640 1 -- 172.21.15.38:0/357620026 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa3740113f0 con 0x7fa384070e30 2023-12-22T08:54:01.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.023+0000 7fa37b7fe640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa36406a430 0x7fa36406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.023+0000 7fa37b7fe640 1 -- 172.21.15.38:0/357620026 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa374088980 con 0x7fa384070e30 2023-12-22T08:54:01.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.023+0000 7fa37bfff640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa36406a430 0x7fa36406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.024+0000 7fa37bfff640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa36406a430 0x7fa36406c8f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa38406d6e0 tx=0x7fa36c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:01.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.028+0000 7fa37b7fe640 1 -- 172.21.15.38:0/357620026 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa374054260 con 0x7fa384070e30 2023-12-22T08:54:01.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.223+0000 7fa383fff640 1 -- 172.21.15.38:0/357620026 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3840ce010 con 0x7fa36406a430 2023-12-22T08:54:01.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.224+0000 7fa37b7fe640 1 -- 172.21.15.38:0/357620026 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa36c00c040 con 0x7fa36406a430 2023-12-22T08:54:01.225 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 3 to deep-scrub 2023-12-22T08:54:01.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.226+0000 7fa383fff640 1 -- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa36406a430 msgr2=0x7fa36406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.227+0000 7fa383fff640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa36406a430 0x7fa36406c8f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa38406d6e0 tx=0x7fa36c008040 comp rx=0 tx=0).stop 2023-12-22T08:54:01.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.227+0000 7fa383fff640 1 -- 172.21.15.38:0/357620026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa384070e30 msgr2=0x7fa38414a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.227+0000 7fa383fff640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa384070e30 0x7fa38414a2a0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fa37400c7f0 tx=0x7fa37400ccb0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.227+0000 7fa383fff640 1 -- 172.21.15.38:0/357620026 shutdown_connections 2023-12-22T08:54:01.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.227+0000 7fa383fff640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa38415b420 0x7fa3840ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.227+0000 7fa383fff640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3840a44a0 0x7fa3840cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.227+0000 7fa383fff640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa36406a430 0x7fa36406c8f0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.227+0000 7fa383fff640 1 --2- 172.21.15.38:0/357620026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa384070e30 0x7fa38414a2a0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.227+0000 7fa383fff640 1 -- 172.21.15.38:0/357620026 >> 172.21.15.38:0/357620026 conn(0x7fa3840b1f70 msgr2=0x7fa38415d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:01.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.227+0000 7fa383fff640 1 -- 172.21.15.38:0/357620026 shutdown_connections 2023-12-22T08:54:01.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.227+0000 7fa383fff640 1 -- 172.21.15.38:0/357620026 wait complete. 2023-12-22T08:54:01.246 INFO:tasks.ceph:Scrubbing osd.4 2023-12-22T08:54:01.246 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:54:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.478+0000 7f908ced5640 1 Processor -- start 2023-12-22T08:54:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.478+0000 7f908ced5640 1 -- start start 2023-12-22T08:54:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.479+0000 7f908ced5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9088144d30 0x7f908815b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.479+0000 7f908ced5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90880d02b0 0x7f90880b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.479+0000 7f908ced5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908815ccb0 con 0x7f90880b5510 2023-12-22T08:54:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.479+0000 7f908ced5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90880b59a0 con 0x7f9088144d30 2023-12-22T08:54:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.479+0000 7f908ced5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90880b5ea0 con 0x7f90880d02b0 2023-12-22T08:54:01.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.480+0000 7f9085d9b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90880d02b0 0x7f90880b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.480+0000 7f9085d9b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90880d02b0 0x7f90880b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.38:54890/0 (socket says 172.21.15.38:54890) 2023-12-22T08:54:01.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.480+0000 7f9085d9b640 1 -- 172.21.15.38:0/1599675950 learned_addr learned my addr 172.21.15.38:0/1599675950 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:01.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.480+0000 7f908659c640 1 --2- 172.21.15.38:0/1599675950 >> v2:172.21.15.89:3300/0 conn(0x7f9088144d30 0x7f908815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.481+0000 7f908559a640 1 -- 172.21.15.38:0/1599675950 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180600092 0 0) 0x7f908815ccb0 con 0x7f90880b5510 2023-12-22T08:54:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.481+0000 7f908559a640 1 -- 172.21.15.38:0/1599675950 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9070003520 con 0x7f90880b5510 2023-12-22T08:54:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.481+0000 7f9085d9b640 1 -- 172.21.15.38:0/1599675950 >> v2:172.21.15.89:3300/0 conn(0x7f9088144d30 msgr2=0x7f908815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.481+0000 7f9085d9b640 1 --2- 172.21.15.38:0/1599675950 >> v2:172.21.15.89:3300/0 conn(0x7f9088144d30 0x7f908815b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.481+0000 7f9085d9b640 1 -- 172.21.15.38:0/1599675950 >> v1:172.21.15.89:6789/0 conn(0x7f90880b5510 legacy=0x7f90880b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.481+0000 7f9085d9b640 1 -- 172.21.15.38:0/1599675950 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908815cf90 con 0x7f90880d02b0 2023-12-22T08:54:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.482+0000 7f9085d9b640 1 --2- 172.21.15.38:0/1599675950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90880d02b0 0x7f90880b4fd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f907c009870 tx=0x7f907c02ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84783fc453660e14 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.483+0000 7f908559a640 1 -- 172.21.15.38:0/1599675950 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c02f840 con 0x7f90880d02b0 2023-12-22T08:54:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.483+0000 7f908559a640 1 -- 172.21.15.38:0/1599675950 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c02f9a0 con 0x7f90880d02b0 2023-12-22T08:54:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.483+0000 7f908559a640 1 -- 172.21.15.38:0/1599675950 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c02fd30 con 0x7f90880d02b0 2023-12-22T08:54:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.484+0000 7f908ced5640 1 -- 172.21.15.38:0/1599675950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90880d02b0 msgr2=0x7f90880b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.484+0000 7f908ced5640 1 --2- 172.21.15.38:0/1599675950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90880d02b0 0x7f90880b4fd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f907c009870 tx=0x7f907c02ba20 comp rx=0 tx=0).stop 2023-12-22T08:54:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.484+0000 7f908ced5640 1 -- 172.21.15.38:0/1599675950 shutdown_connections 2023-12-22T08:54:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.484+0000 7f908ced5640 1 --2- 172.21.15.38:0/1599675950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90880d02b0 0x7f90880b4fd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.484+0000 7f908ced5640 1 --2- 172.21.15.38:0/1599675950 >> v2:172.21.15.89:3300/0 conn(0x7f9088144d30 0x7f908815b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.484+0000 7f908ced5640 1 -- 172.21.15.38:0/1599675950 >> 172.21.15.38:0/1599675950 conn(0x7f908806c5e0 msgr2=0x7f908806c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.484+0000 7f908ced5640 1 -- 172.21.15.38:0/1599675950 shutdown_connections 2023-12-22T08:54:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.484+0000 7f908ced5640 1 -- 172.21.15.38:0/1599675950 wait complete. 2023-12-22T08:54:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.486+0000 7f908ced5640 1 Processor -- start 2023-12-22T08:54:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.486+0000 7f908ced5640 1 -- start start 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.487+0000 7f908ced5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90880b5510 0x7f908813d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.487+0000 7f908ced5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90880d02b0 0x7f9088158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.487+0000 7f908ced5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9088144d30 0x7f9088141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.487+0000 7f908ced5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908813e9d0 con 0x7f90880d02b0 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.487+0000 7f908ced5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9088138fd0 con 0x7f9088144d30 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.487+0000 7f908ced5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908813dd50 con 0x7f90880b5510 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.487+0000 7f9085d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90880d02b0 0x7f9088158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.487+0000 7f9085d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90880d02b0 0x7f9088158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33054/0 (socket says 172.21.15.38:33054) 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.487+0000 7f9085d9b640 1 -- 172.21.15.38:0/2354039843 learned_addr learned my addr 172.21.15.38:0/2354039843 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.488+0000 7f908659c640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90880b5510 0x7f908813d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.488+0000 7f9085d9b640 1 -- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90880b5510 msgr2=0x7f908813d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.488+0000 7f9085d9b640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90880b5510 0x7f908813d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.488+0000 7f9085d9b640 1 -- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9088144d30 msgr2=0x7f9088141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.488+0000 7f9086d9d640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9088144d30 0x7f9088141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.488+0000 7f9085d9b640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9088144d30 0x7f9088141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.488+0000 7f9085d9b640 1 -- 172.21.15.38:0/2354039843 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c0094d0 con 0x7f90880d02b0 2023-12-22T08:54:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.488+0000 7f908659c640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90880b5510 0x7f908813d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.488+0000 7f9086d9d640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9088144d30 0x7f9088141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.488+0000 7f9085d9b640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90880d02b0 0x7f9088158390 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f907c000c00 tx=0x7f907c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.489+0000 7f9076ffd640 1 -- 172.21.15.38:0/2354039843 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c037c40 con 0x7f90880d02b0 2023-12-22T08:54:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.489+0000 7f9076ffd640 1 -- 172.21.15.38:0/2354039843 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c037da0 con 0x7f90880d02b0 2023-12-22T08:54:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.489+0000 7f9076ffd640 1 -- 172.21.15.38:0/2354039843 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c041640 con 0x7f90880d02b0 2023-12-22T08:54:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.489+0000 7f908ced5640 1 -- 172.21.15.38:0/2354039843 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908813e030 con 0x7f90880d02b0 2023-12-22T08:54:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.489+0000 7f908ced5640 1 -- 172.21.15.38:0/2354039843 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908813e5f0 con 0x7f90880d02b0 2023-12-22T08:54:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.490+0000 7f908ced5640 1 -- 172.21.15.38:0/2354039843 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f908815d550 con 0x7f90880d02b0 2023-12-22T08:54:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.491+0000 7f9076ffd640 1 -- 172.21.15.38:0/2354039843 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f907c0417a0 con 0x7f90880d02b0 2023-12-22T08:54:01.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.492+0000 7f9076ffd640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f906806a430 0x7f906806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.492+0000 7f9076ffd640 1 -- 172.21.15.38:0/2354039843 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f907c03c070 con 0x7f90880d02b0 2023-12-22T08:54:01.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.492+0000 7f9076ffd640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] conn(0x7f9068070290 0x7f90680726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.492+0000 7f9076ffd640 1 -- 172.21.15.38:0/2354039843 --> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9068072d60 con 0x7f9068070290 2023-12-22T08:54:01.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.492+0000 7f9076ffd640 1 -- 172.21.15.38:0/2354039843 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f907c0ad6a0 con 0x7f90880d02b0 2023-12-22T08:54:01.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.493+0000 7f908659c640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f906806a430 0x7f906806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.493+0000 7f9086d9d640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] conn(0x7f9068070290 0x7f90680726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.494+0000 7f908659c640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f906806a430 0x7f906806c8f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9078009ac0 tx=0x7f9078008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:01.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.494+0000 7f9086d9d640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] conn(0x7f9068070290 0x7f90680726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.496+0000 7f9076ffd640 1 -- 172.21.15.38:0/2354039843 <== osd.4 v2:172.21.15.89:6800/84338 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f9068072d60 con 0x7f9068070290 2023-12-22T08:54:01.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.509+0000 7f908ced5640 1 -- 172.21.15.38:0/2354039843 --> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f908815d270 con 0x7f9068070290 2023-12-22T08:54:01.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.511+0000 7f9076ffd640 1 -- 172.21.15.38:0/2354039843 <== osd.4 v2:172.21.15.89:6800/84338 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f9080001a20 con 0x7f9068070290 2023-12-22T08:54:01.511 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:54:01.511 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-22T08:54:01.511 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:54:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.511+0000 7f908ced5640 1 -- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] conn(0x7f9068070290 msgr2=0x7f90680726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.511+0000 7f908ced5640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:6800/84338,v1:172.21.15.89:6801/84338] conn(0x7f9068070290 0x7f90680726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.511+0000 7f908ced5640 1 -- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f906806a430 msgr2=0x7f906806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.511+0000 7f908ced5640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f906806a430 0x7f906806c8f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9078009ac0 tx=0x7f9078008040 comp rx=0 tx=0).stop 2023-12-22T08:54:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.511+0000 7f908ced5640 1 -- 172.21.15.38:0/2354039843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90880d02b0 msgr2=0x7f9088158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.511+0000 7f908ced5640 1 --2- 172.21.15.38:0/2354039843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90880d02b0 0x7f9088158390 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f907c000c00 tx=0x7f907c004730 comp rx=0 tx=0).stop 2023-12-22T08:54:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.511+0000 7f9086d9d640 1 -- 172.21.15.38:0/2354039843 reap_dead start 2023-12-22T08:54:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.511+0000 7f908ced5640 1 -- 172.21.15.38:0/2354039843 shutdown_connections 2023-12-22T08:54:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.511+0000 7f908ced5640 1 -- 172.21.15.38:0/2354039843 >> 172.21.15.38:0/2354039843 conn(0x7f908806c5e0 msgr2=0x7f90880b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.511+0000 7f908ced5640 1 -- 172.21.15.38:0/2354039843 shutdown_connections 2023-12-22T08:54:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.511+0000 7f908ced5640 1 -- 172.21.15.38:0/2354039843 wait complete. 2023-12-22T08:54:01.532 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-22T08:54:01.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.761+0000 7fd70f59e640 1 Processor -- start 2023-12-22T08:54:01.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.761+0000 7fd70f59e640 1 -- start start 2023-12-22T08:54:01.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.763+0000 7fd70f59e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd7100a44a0 0x7fd7100708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.763+0000 7fd70f59e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd710070e30 0x7fd71015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.763+0000 7fd70f59e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7100cdae0 con 0x7fd71015b420 2023-12-22T08:54:01.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.763+0000 7fd70f59e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd710071250 con 0x7fd7100a44a0 2023-12-22T08:54:01.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.763+0000 7fd70f59e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71015b800 con 0x7fd710070e30 2023-12-22T08:54:01.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.763+0000 7fd70dd9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd7100a44a0 0x7fd7100708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.763+0000 7fd70dd9b640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd7100a44a0 0x7fd7100708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33058/0 (socket says 172.21.15.38:33058) 2023-12-22T08:54:01.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.763+0000 7fd70dd9b640 1 -- 172.21.15.38:0/4160080080 learned_addr learned my addr 172.21.15.38:0/4160080080 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:01.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.764+0000 7fd70ed9d640 1 --2- 172.21.15.38:0/4160080080 >> v2:172.21.15.89:3300/0 conn(0x7fd710070e30 0x7fd71015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.764+0000 7fd70dd9b640 1 -- 172.21.15.38:0/4160080080 >> v2:172.21.15.89:3300/0 conn(0x7fd710070e30 msgr2=0x7fd71015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:01.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.764+0000 7fd70dd9b640 1 --2- 172.21.15.38:0/4160080080 >> v2:172.21.15.89:3300/0 conn(0x7fd710070e30 0x7fd71015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.764+0000 7fd70dd9b640 1 -- 172.21.15.38:0/4160080080 >> v1:172.21.15.89:6789/0 conn(0x7fd71015b420 legacy=0x7fd71006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:01.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.764+0000 7fd70dd9b640 1 -- 172.21.15.38:0/4160080080 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7100cdd30 con 0x7fd7100a44a0 2023-12-22T08:54:01.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.764+0000 7fd70ed9d640 1 --2- 172.21.15.38:0/4160080080 >> v2:172.21.15.89:3300/0 conn(0x7fd710070e30 0x7fd71015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:01.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.765+0000 7fd70dd9b640 1 --2- 172.21.15.38:0/4160080080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7100a44a0 0x7fd7100708f0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fd710070670 tx=0x7fd70402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990f688920f4fccb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:01.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.765+0000 7fd70d59a640 1 -- 172.21.15.38:0/4160080080 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704031870 con 0x7fd7100a44a0 2023-12-22T08:54:01.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.765+0000 7fd70d59a640 1 -- 172.21.15.38:0/4160080080 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7040319d0 con 0x7fd7100a44a0 2023-12-22T08:54:01.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.766+0000 7fd70d59a640 1 -- 172.21.15.38:0/4160080080 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704031d60 con 0x7fd7100a44a0 2023-12-22T08:54:01.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.766+0000 7fd70f59e640 1 -- 172.21.15.38:0/4160080080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7100a44a0 msgr2=0x7fd7100708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.766+0000 7fd70f59e640 1 --2- 172.21.15.38:0/4160080080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7100a44a0 0x7fd7100708f0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fd710070670 tx=0x7fd70402b910 comp rx=0 tx=0).stop 2023-12-22T08:54:01.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.766+0000 7fd70f59e640 1 -- 172.21.15.38:0/4160080080 shutdown_connections 2023-12-22T08:54:01.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.766+0000 7fd70f59e640 1 --2- 172.21.15.38:0/4160080080 >> v2:172.21.15.89:3300/0 conn(0x7fd710070e30 0x7fd71015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.766+0000 7fd70f59e640 1 --2- 172.21.15.38:0/4160080080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7100a44a0 0x7fd7100708f0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.766+0000 7fd70f59e640 1 -- 172.21.15.38:0/4160080080 >> 172.21.15.38:0/4160080080 conn(0x7fd7100b1f70 msgr2=0x7fd7100b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:01.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.766+0000 7fd70f59e640 1 -- 172.21.15.38:0/4160080080 shutdown_connections 2023-12-22T08:54:01.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.766+0000 7fd70f59e640 1 -- 172.21.15.38:0/4160080080 wait complete. 2023-12-22T08:54:01.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.768+0000 7fd70f59e640 1 Processor -- start 2023-12-22T08:54:01.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.768+0000 7fd70f59e640 1 -- start start 2023-12-22T08:54:01.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.769+0000 7fd70f59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd710070e30 0x7fd7101534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.769+0000 7fd70f59e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7100a44a0 0x7fd7100a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.769+0000 7fd70f59e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd71015b420 0x7fd71015ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.769+0000 7fd70f59e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710155120 con 0x7fd710070e30 2023-12-22T08:54:01.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.769+0000 7fd70f59e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100a3bb0 con 0x7fd71015b420 2023-12-22T08:54:01.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.769+0000 7fd70f59e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100a3e90 con 0x7fd7100a44a0 2023-12-22T08:54:01.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.769+0000 7fd70e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd710070e30 0x7fd7101534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.770+0000 7fd70e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd710070e30 0x7fd7101534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33074/0 (socket says 172.21.15.38:33074) 2023-12-22T08:54:01.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.770+0000 7fd70e59c640 1 -- 172.21.15.38:0/1967744323 learned_addr learned my addr 172.21.15.38:0/1967744323 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:01.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.770+0000 7fd70e59c640 1 -- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7100a44a0 msgr2=0x7fd7100a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.770+0000 7fd70dd9b640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7100a44a0 0x7fd7100a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.770+0000 7fd70ed9d640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd71015b420 0x7fd71015ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.770+0000 7fd70e59c640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7100a44a0 0x7fd7100a1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.770+0000 7fd70e59c640 1 -- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd71015b420 msgr2=0x7fd71015ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.770+0000 7fd70e59c640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd71015b420 0x7fd71015ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.770+0000 7fd70e59c640 1 -- 172.21.15.38:0/1967744323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7040094d0 con 0x7fd710070e30 2023-12-22T08:54:01.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.770+0000 7fd70e59c640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd710070e30 0x7fd7101534c0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fd70000c430 tx=0x7fd70000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.771+0000 7fd6feffd640 1 -- 172.21.15.38:0/1967744323 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700011790 con 0x7fd710070e30 2023-12-22T08:54:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.771+0000 7fd6feffd640 1 -- 172.21.15.38:0/1967744323 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7000118f0 con 0x7fd710070e30 2023-12-22T08:54:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.771+0000 7fd6feffd640 1 -- 172.21.15.38:0/1967744323 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700011ce0 con 0x7fd710070e30 2023-12-22T08:54:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.771+0000 7fd70f59e640 1 -- 172.21.15.38:0/1967744323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7100a4170 con 0x7fd710070e30 2023-12-22T08:54:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.771+0000 7fd70f59e640 1 -- 172.21.15.38:0/1967744323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7101e96a0 con 0x7fd710070e30 2023-12-22T08:54:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.772+0000 7fd70f59e640 1 -- 172.21.15.38:0/1967744323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7101e9890 con 0x7fd710070e30 2023-12-22T08:54:01.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.773+0000 7fd6feffd640 1 -- 172.21.15.38:0/1967744323 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd70001c460 con 0x7fd710070e30 2023-12-22T08:54:01.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.774+0000 7fd6feffd640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6f006a460 0x7fd6f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:01.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.774+0000 7fd6feffd640 1 -- 172.21.15.38:0/1967744323 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd700088510 con 0x7fd710070e30 2023-12-22T08:54:01.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.774+0000 7fd70dd9b640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6f006a460 0x7fd6f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:01.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.775+0000 7fd70dd9b640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6f006a460 0x7fd6f006c920 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd704036000 tx=0x7fd70403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:01.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.778+0000 7fd6feffd640 1 -- 172.21.15.38:0/1967744323 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd700053e00 con 0x7fd710070e30 2023-12-22T08:54:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.971+0000 7fd70f59e640 1 -- 172.21.15.38:0/1967744323 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7100ce2f0 con 0x7fd6f006a460 2023-12-22T08:54:01.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.972+0000 7fd6feffd640 1 -- 172.21.15.38:0/1967744323 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd704031cc0 con 0x7fd6f006a460 2023-12-22T08:54:01.972 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 4 to deep-scrub 2023-12-22T08:54:01.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.974+0000 7fd70f59e640 1 -- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6f006a460 msgr2=0x7fd6f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.974+0000 7fd70f59e640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6f006a460 0x7fd6f006c920 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd704036000 tx=0x7fd70403c040 comp rx=0 tx=0).stop 2023-12-22T08:54:01.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.974+0000 7fd70f59e640 1 -- 172.21.15.38:0/1967744323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd710070e30 msgr2=0x7fd7101534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:01.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.974+0000 7fd70f59e640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd710070e30 0x7fd7101534c0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fd70000c430 tx=0x7fd70000c8f0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.974+0000 7fd70f59e640 1 -- 172.21.15.38:0/1967744323 shutdown_connections 2023-12-22T08:54:01.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.974+0000 7fd70f59e640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd71015b420 0x7fd71015ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.974+0000 7fd70f59e640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7100a44a0 0x7fd7100a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.974+0000 7fd70f59e640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fd6f006a460 0x7fd6f006c920 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.974+0000 7fd70f59e640 1 --2- 172.21.15.38:0/1967744323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd710070e30 0x7fd7101534c0 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:01.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.974+0000 7fd70f59e640 1 -- 172.21.15.38:0/1967744323 >> 172.21.15.38:0/1967744323 conn(0x7fd7100b1f70 msgr2=0x7fd7100cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:01.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.974+0000 7fd70f59e640 1 -- 172.21.15.38:0/1967744323 shutdown_connections 2023-12-22T08:54:01.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:01.975+0000 7fd70f59e640 1 -- 172.21.15.38:0/1967744323 wait complete. 2023-12-22T08:54:01.996 INFO:tasks.ceph:Scrubbing osd.5 2023-12-22T08:54:01.996 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:54:02.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.228+0000 7f52e23c9640 1 Processor -- start 2023-12-22T08:54:02.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.228+0000 7f52e23c9640 1 -- start start 2023-12-22T08:54:02.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.230+0000 7f52e23c9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f52dc0b3d10 0x7f52dc0cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.230+0000 7f52e23c9640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc071b70 con 0x7f52dc0cc580 2023-12-22T08:54:02.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.230+0000 7f52e23c9640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc0b17a0 con 0x7f52dc15b480 2023-12-22T08:54:02.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.230+0000 7f52e23c9640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52dc070770 con 0x7f52dc0b3d10 2023-12-22T08:54:02.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.230+0000 7f52d3fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f52dc0cc580 0x7f52dc0b3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52846/0 (socket says 172.21.15.38:52846) 2023-12-22T08:54:02.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.230+0000 7f52d3fff640 1 -- 172.21.15.38:0/260089083 learned_addr learned my addr 172.21.15.38:0/260089083 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:54:02.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.231+0000 7f52e0966640 1 --2- 172.21.15.38:0/260089083 >> v2:172.21.15.89:3300/0 conn(0x7f52dc0b3d10 0x7f52dc0cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.231+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553240658 0 0) 0x7f52dc071b70 con 0x7f52dc0cc580 2023-12-22T08:54:02.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.231+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c8003520 con 0x7f52dc0cc580 2023-12-22T08:54:02.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.231+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3893858340 0 0) 0x7f52c8003520 con 0x7f52dc0cc580 2023-12-22T08:54:02.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.231+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 >> v2:172.21.15.89:3300/0 conn(0x7f52dc0b3d10 msgr2=0x7f52dc0cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:02.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.231+0000 7f52db7fe640 1 --2- 172.21.15.38:0/260089083 >> v2:172.21.15.89:3300/0 conn(0x7f52dc0b3d10 0x7f52dc0cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.231+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 >> v1:172.21.15.89:6789/0 conn(0x7f52dc15b480 legacy=0x7f52dc071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.231+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc070980 con 0x7f52dc0cc580 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.231+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f52c4001670 con 0x7f52dc0cc580 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.231+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 >> v1:172.21.15.38:6789/0 conn(0x7f52dc0cc580 legacy=0x7f52dc0b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.231+0000 7f52db7fe640 1 --2- 172.21.15.38:0/260089083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52c80039c0 0x7f52c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.231+0000 7f52db7fe640 1 --2- 172.21.15.38:0/260089083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52c80047c0 0x7f52c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.232+0000 7f52db7fe640 1 --2- 172.21.15.38:0/260089083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c8005180 0x7f52c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.232+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc070770 con 0x7f52c8005180 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.232+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c800c080 con 0x7f52c80039c0 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.232+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c800c240 con 0x7f52c80047c0 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.232+0000 7f52e0966640 1 --2- 172.21.15.38:0/260089083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c8005180 0x7f52c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.232+0000 7f52d3fff640 1 --2- 172.21.15.38:0/260089083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52c80047c0 0x7f52c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.232+0000 7f52dbfff640 1 --2- 172.21.15.38:0/260089083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52c80039c0 0x7f52c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.232+0000 7f52e0966640 1 -- 172.21.15.38:0/260089083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52c80047c0 msgr2=0x7f52c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.232+0000 7f52e0966640 1 --2- 172.21.15.38:0/260089083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52c80047c0 0x7f52c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.232+0000 7f52e0966640 1 -- 172.21.15.38:0/260089083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52c80039c0 msgr2=0x7f52c8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.232+0000 7f52e0966640 1 --2- 172.21.15.38:0/260089083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52c80039c0 0x7f52c8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.232+0000 7f52e0966640 1 -- 172.21.15.38:0/260089083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c8003520 con 0x7f52c8005180 2023-12-22T08:54:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.233+0000 7f52e0966640 1 -- 172.21.15.38:0/260089083 reap_dead start 2023-12-22T08:54:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.234+0000 7f52e0966640 1 --2- 172.21.15.38:0/260089083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c8005180 0x7f52c800b980 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0b0ca0 tx=0x7f52c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c3762c2dfb569b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.234+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d402cbd0 con 0x7f52c8005180 2023-12-22T08:54:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.234+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d400f040 con 0x7f52c8005180 2023-12-22T08:54:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.234+0000 7f52db7fe640 1 -- 172.21.15.38:0/260089083 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d4003990 con 0x7f52c8005180 2023-12-22T08:54:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.235+0000 7f52e23c9640 1 -- 172.21.15.38:0/260089083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c8005180 msgr2=0x7f52c800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.235+0000 7f52e23c9640 1 --2- 172.21.15.38:0/260089083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c8005180 0x7f52c800b980 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0b0ca0 tx=0x7f52c80057f0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.235+0000 7f52e23c9640 1 -- 172.21.15.38:0/260089083 shutdown_connections 2023-12-22T08:54:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.235+0000 7f52e23c9640 1 --2- 172.21.15.38:0/260089083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c8005180 0x7f52c800b980 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.235+0000 7f52e23c9640 1 -- 172.21.15.38:0/260089083 >> 172.21.15.38:0/260089083 conn(0x7f52dc06f880 msgr2=0x7f52dc0b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.235+0000 7f52e23c9640 1 -- 172.21.15.38:0/260089083 shutdown_connections 2023-12-22T08:54:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.235+0000 7f52e23c9640 1 -- 172.21.15.38:0/260089083 wait complete. 2023-12-22T08:54:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.237+0000 7f52e23c9640 1 Processor -- start 2023-12-22T08:54:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.237+0000 7f52e23c9640 1 -- start start 2023-12-22T08:54:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52e23c9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c8005180 0x7f52dc15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52e23c9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52dc15f630 0x7f52dc1f44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52e23c9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52dc0af020 0x7f52dc146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52e23c9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0a84d0 con 0x7f52c8005180 2023-12-22T08:54:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52e23c9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc15bf50 con 0x7f52dc0af020 2023-12-22T08:54:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52e23c9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0a8720 con 0x7f52dc15f630 2023-12-22T08:54:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52dbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c8005180 0x7f52dc15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52dbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c8005180 0x7f52dc15c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33102/0 (socket says 172.21.15.38:33102) 2023-12-22T08:54:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52dbfff640 1 -- 172.21.15.38:0/1821957552 learned_addr learned my addr 172.21.15.38:0/1821957552 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52d3fff640 1 --2- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52dc15f630 0x7f52dc1f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52dbfff640 1 -- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52dc15f630 msgr2=0x7f52dc1f44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52dbfff640 1 --2- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52dc15f630 0x7f52dc1f44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52dbfff640 1 -- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52dc0af020 msgr2=0x7f52dc146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52dbfff640 1 --2- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52dc0af020 0x7f52dc146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.238+0000 7f52dbfff640 1 -- 172.21.15.38:0/1821957552 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc15b900 con 0x7f52c8005180 2023-12-22T08:54:02.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.239+0000 7f52dbfff640 1 --2- 172.21.15.38:0/1821957552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c8005180 0x7f52dc15c3e0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00e410 tx=0x7f52cc00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:02.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.239+0000 7f52d97fa640 1 -- 172.21.15.38:0/1821957552 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc0052e0 con 0x7f52c8005180 2023-12-22T08:54:02.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.239+0000 7f52d97fa640 1 -- 172.21.15.38:0/1821957552 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc005440 con 0x7f52c8005180 2023-12-22T08:54:02.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.239+0000 7f52d97fa640 1 -- 172.21.15.38:0/1821957552 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc0037f0 con 0x7f52c8005180 2023-12-22T08:54:02.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.239+0000 7f52e23c9640 1 -- 172.21.15.38:0/1821957552 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52dc15bbe0 con 0x7f52c8005180 2023-12-22T08:54:02.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.239+0000 7f52e23c9640 1 -- 172.21.15.38:0/1821957552 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52dc0a8a00 con 0x7f52c8005180 2023-12-22T08:54:02.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.240+0000 7f52e23c9640 1 -- 172.21.15.38:0/1821957552 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f52dc070f40 con 0x7f52c8005180 2023-12-22T08:54:02.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.241+0000 7f52d97fa640 1 -- 172.21.15.38:0/1821957552 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f52cc003950 con 0x7f52c8005180 2023-12-22T08:54:02.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.242+0000 7f52d97fa640 1 --2- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f52bc06a430 0x7f52bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.242+0000 7f52d97fa640 1 -- 172.21.15.38:0/1821957552 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f52cc087d20 con 0x7f52c8005180 2023-12-22T08:54:02.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.242+0000 7f52d97fa640 1 --2- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] conn(0x7f52bc070290 0x7f52bc0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.242+0000 7f52d97fa640 1 -- 172.21.15.38:0/1821957552 --> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52bc072d60 con 0x7f52bc070290 2023-12-22T08:54:02.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.243+0000 7f52d97fa640 1 -- 172.21.15.38:0/1821957552 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52cc08c030 con 0x7f52c8005180 2023-12-22T08:54:02.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.243+0000 7f52d3fff640 1 --2- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f52bc06a430 0x7f52bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.243+0000 7f52e0966640 1 --2- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] conn(0x7f52bc070290 0x7f52bc0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.244+0000 7f52d3fff640 1 --2- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f52bc06a430 0x7f52bc06c8f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0afbf0 tx=0x7f52c4000f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:02.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.245+0000 7f52e0966640 1 --2- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] conn(0x7f52bc070290 0x7f52bc0726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:02.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.246+0000 7f52d97fa640 1 -- 172.21.15.38:0/1821957552 <== osd.5 v2:172.21.15.89:6816/84339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f52bc072d60 con 0x7f52bc070290 2023-12-22T08:54:02.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.259+0000 7f52e23c9640 1 -- 172.21.15.38:0/1821957552 --> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f52dc070c60 con 0x7f52bc070290 2023-12-22T08:54:02.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.261+0000 7f52d97fa640 1 -- 172.21.15.38:0/1821957552 <== osd.5 v2:172.21.15.89:6816/84339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f52d402c9d0 con 0x7f52bc070290 2023-12-22T08:54:02.261 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:54:02.261 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-22T08:54:02.261 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:54:02.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.261+0000 7f52e23c9640 1 -- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] conn(0x7f52bc070290 msgr2=0x7f52bc0726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.261+0000 7f52e23c9640 1 --2- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:6816/84339,v1:172.21.15.89:6817/84339] conn(0x7f52bc070290 0x7f52bc0726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.261+0000 7f52e23c9640 1 -- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f52bc06a430 msgr2=0x7f52bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.261+0000 7f52e23c9640 1 --2- 172.21.15.38:0/1821957552 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f52bc06a430 0x7f52bc06c8f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0afbf0 tx=0x7f52c4000f30 comp rx=0 tx=0).stop 2023-12-22T08:54:02.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.261+0000 7f52e23c9640 1 -- 172.21.15.38:0/1821957552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c8005180 msgr2=0x7f52dc15c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.261+0000 7f52e23c9640 1 --2- 172.21.15.38:0/1821957552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52c8005180 0x7f52dc15c3e0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00e410 tx=0x7f52cc00e8d0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.261+0000 7f52e0966640 1 -- 172.21.15.38:0/1821957552 reap_dead start 2023-12-22T08:54:02.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.261+0000 7f52e23c9640 1 -- 172.21.15.38:0/1821957552 shutdown_connections 2023-12-22T08:54:02.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.261+0000 7f52e23c9640 1 -- 172.21.15.38:0/1821957552 >> 172.21.15.38:0/1821957552 conn(0x7f52dc06f880 msgr2=0x7f52dc154e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:02.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.261+0000 7f52e23c9640 1 -- 172.21.15.38:0/1821957552 shutdown_connections 2023-12-22T08:54:02.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.261+0000 7f52e23c9640 1 -- 172.21.15.38:0/1821957552 wait complete. 2023-12-22T08:54:02.281 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-22T08:54:02.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.507+0000 7fa65d83f640 1 Processor -- start 2023-12-22T08:54:02.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.507+0000 7fa65d83f640 1 -- start start 2023-12-22T08:54:02.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.509+0000 7fa65d83f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa658157980 0x7fa65815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.509+0000 7fa65d83f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6580d1520 con 0x7fa6580b3ff0 2023-12-22T08:54:02.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.509+0000 7fa65d83f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6580d1800 con 0x7fa65806d640 2023-12-22T08:54:02.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.509+0000 7fa65d83f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580d1ae0 con 0x7fa658157980 2023-12-22T08:54:02.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.510+0000 7fa657fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa6580b3ff0 0x7fa65806cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52848/0 (socket says 172.21.15.38:52848) 2023-12-22T08:54:02.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.510+0000 7fa657fff640 1 -- 172.21.15.38:0/3742747489 learned_addr learned my addr 172.21.15.38:0/3742747489 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:54:02.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.510+0000 7fa65c83d640 1 --2- 172.21.15.38:0/3742747489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa658157980 0x7fa65815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.510+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753571952 0 0) 0x7fa6580d1520 con 0x7fa6580b3ff0 2023-12-22T08:54:02.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.510+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa648003520 con 0x7fa6580b3ff0 2023-12-22T08:54:02.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.510+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1083720998 0 0) 0x7fa648003520 con 0x7fa6580b3ff0 2023-12-22T08:54:02.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.510+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa658157980 msgr2=0x7fa65815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:02.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa6577fe640 1 --2- 172.21.15.38:0/3742747489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa658157980 0x7fa65815eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 >> v1:172.21.15.89:6789/0 conn(0x7fa65806d640 legacy=0x7fa6580d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6580d1dc0 con 0x7fa6580b3ff0 2023-12-22T08:54:02.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7fa644001670 con 0x7fa6580b3ff0 2023-12-22T08:54:02.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 >> v1:172.21.15.38:6789/0 conn(0x7fa6580b3ff0 legacy=0x7fa65806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa6577fe640 1 --2- 172.21.15.38:0/3742747489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa658157980 0x7fa6480039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa6577fe640 1 --2- 172.21.15.38:0/3742747489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa648003f70 0x7fa6480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa6577fe640 1 --2- 172.21.15.38:0/3742747489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa648004d00 0x7fa648005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580d1ae0 con 0x7fa648004d00 2023-12-22T08:54:02.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64800bac0 con 0x7fa648003f70 2023-12-22T08:54:02.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64800bc80 con 0x7fa658157980 2023-12-22T08:54:02.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa65d03e640 1 --2- 172.21.15.38:0/3742747489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa648004d00 0x7fa648005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa65c83d640 1 --2- 172.21.15.38:0/3742747489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa658157980 0x7fa6480039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.511+0000 7fa657fff640 1 --2- 172.21.15.38:0/3742747489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa648003f70 0x7fa6480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.512+0000 7fa65d03e640 1 -- 172.21.15.38:0/3742747489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa658157980 msgr2=0x7fa6480039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:02.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.512+0000 7fa65d03e640 1 --2- 172.21.15.38:0/3742747489 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa658157980 0x7fa6480039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.512+0000 7fa65d03e640 1 -- 172.21.15.38:0/3742747489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa648003f70 msgr2=0x7fa6480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:02.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.512+0000 7fa65d03e640 1 --2- 172.21.15.38:0/3742747489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa648003f70 0x7fa6480047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.512+0000 7fa65d03e640 1 -- 172.21.15.38:0/3742747489 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa648003520 con 0x7fa648004d00 2023-12-22T08:54:02.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.513+0000 7fa65d03e640 1 --2- 172.21.15.38:0/3742747489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa648004d00 0x7fa648005180 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fa65806e610 tx=0x7fa6480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5221c363079952 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:02.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.513+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650003b70 con 0x7fa648004d00 2023-12-22T08:54:02.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.513+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa650003cd0 con 0x7fa648004d00 2023-12-22T08:54:02.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.513+0000 7fa6577fe640 1 -- 172.21.15.38:0/3742747489 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650005310 con 0x7fa648004d00 2023-12-22T08:54:02.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.513+0000 7fa65d83f640 1 -- 172.21.15.38:0/3742747489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa648004d00 msgr2=0x7fa648005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.513+0000 7fa65d83f640 1 --2- 172.21.15.38:0/3742747489 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa648004d00 0x7fa648005180 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fa65806e610 tx=0x7fa6480057f0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.514+0000 7fa65d03e640 1 -- 172.21.15.38:0/3742747489 reap_dead start 2023-12-22T08:54:02.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.514+0000 7fa65d83f640 1 -- 172.21.15.38:0/3742747489 shutdown_connections 2023-12-22T08:54:02.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.514+0000 7fa65d83f640 1 -- 172.21.15.38:0/3742747489 >> 172.21.15.38:0/3742747489 conn(0x7fa6580d31f0 msgr2=0x7fa6580d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:02.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.514+0000 7fa65d83f640 1 -- 172.21.15.38:0/3742747489 shutdown_connections 2023-12-22T08:54:02.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.514+0000 7fa65d83f640 1 -- 172.21.15.38:0/3742747489 wait complete. 2023-12-22T08:54:02.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.516+0000 7fa65d83f640 1 Processor -- start 2023-12-22T08:54:02.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.516+0000 7fa65d83f640 1 -- start start 2023-12-22T08:54:02.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.517+0000 7fa65d83f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa648004d00 0x7fa65814aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.517+0000 7fa65d83f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa65814c470 0x7fa65815c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.517+0000 7fa65d83f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa65815cd60 0x7fa658159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.517+0000 7fa65d83f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65815d1e0 con 0x7fa65815cd60 2023-12-22T08:54:02.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.517+0000 7fa65d83f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa658158db0 con 0x7fa648004d00 2023-12-22T08:54:02.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.517+0000 7fa65d83f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa658157ee0 con 0x7fa65814c470 2023-12-22T08:54:02.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.517+0000 7fa65d03e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa65815cd60 0x7fa658159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.517+0000 7fa65d03e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa65815cd60 0x7fa658159240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33108/0 (socket says 172.21.15.38:33108) 2023-12-22T08:54:02.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.517+0000 7fa65d03e640 1 -- 172.21.15.38:0/3740963908 learned_addr learned my addr 172.21.15.38:0/3740963908 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:02.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.517+0000 7fa65c83d640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa648004d00 0x7fa65814aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.517+0000 7fa657fff640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa65814c470 0x7fa65815c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.518+0000 7fa65d03e640 1 -- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa65814c470 msgr2=0x7fa65815c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.518+0000 7fa65d03e640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa65814c470 0x7fa65815c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.518+0000 7fa65d03e640 1 -- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa648004d00 msgr2=0x7fa65814aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.518+0000 7fa65d03e640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa648004d00 0x7fa65814aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.518+0000 7fa65d03e640 1 -- 172.21.15.38:0/3740963908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6581581a0 con 0x7fa65815cd60 2023-12-22T08:54:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.518+0000 7fa657fff640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa65814c470 0x7fa65815c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.518+0000 7fa65d03e640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa65815cd60 0x7fa658159240 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fa650001ee0 tx=0x7fa6500014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.518+0000 7fa6557fa640 1 -- 172.21.15.38:0/3740963908 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65003e070 con 0x7fa65815cd60 2023-12-22T08:54:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.518+0000 7fa6557fa640 1 -- 172.21.15.38:0/3740963908 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa650003e40 con 0x7fa65815cd60 2023-12-22T08:54:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.518+0000 7fa6557fa640 1 -- 172.21.15.38:0/3740963908 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650006d50 con 0x7fa65815cd60 2023-12-22T08:54:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.518+0000 7fa65d83f640 1 -- 172.21.15.38:0/3740963908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa658158480 con 0x7fa65815cd60 2023-12-22T08:54:02.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.518+0000 7fa65d83f640 1 -- 172.21.15.38:0/3740963908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa658158a40 con 0x7fa65815cd60 2023-12-22T08:54:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.520+0000 7fa65d83f640 1 -- 172.21.15.38:0/3740963908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa658158c00 con 0x7fa65815cd60 2023-12-22T08:54:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.521+0000 7fa6557fa640 1 -- 172.21.15.38:0/3740963908 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa650041070 con 0x7fa65815cd60 2023-12-22T08:54:02.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.521+0000 7fa6557fa640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa63c06a430 0x7fa63c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.522+0000 7fa6557fa640 1 -- 172.21.15.38:0/3740963908 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa6500a9400 con 0x7fa65815cd60 2023-12-22T08:54:02.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.522+0000 7fa65c83d640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa63c06a430 0x7fa63c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.523+0000 7fa65c83d640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa63c06a430 0x7fa63c06c8f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009a10 tx=0x7fa64c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:02.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.526+0000 7fa6557fa640 1 -- 172.21.15.38:0/3740963908 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa650074dd0 con 0x7fa65815cd60 2023-12-22T08:54:02.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.721+0000 7fa65d83f640 1 -- 172.21.15.38:0/3740963908 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa65815d1e0 con 0x7fa63c06a430 2023-12-22T08:54:02.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.722+0000 7fa6557fa640 1 -- 172.21.15.38:0/3740963908 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa65815d1e0 con 0x7fa63c06a430 2023-12-22T08:54:02.723 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 5 to deep-scrub 2023-12-22T08:54:02.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.725+0000 7fa65d83f640 1 -- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa63c06a430 msgr2=0x7fa63c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.725+0000 7fa65d83f640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa63c06a430 0x7fa63c06c8f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009a10 tx=0x7fa64c008040 comp rx=0 tx=0).stop 2023-12-22T08:54:02.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.725+0000 7fa65d83f640 1 -- 172.21.15.38:0/3740963908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa65815cd60 msgr2=0x7fa658159240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.725+0000 7fa65d83f640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa65815cd60 0x7fa658159240 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fa650001ee0 tx=0x7fa6500014a0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.725+0000 7fa65d83f640 1 -- 172.21.15.38:0/3740963908 shutdown_connections 2023-12-22T08:54:02.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.725+0000 7fa65d83f640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7fa63c06a430 0x7fa63c06c8f0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.725+0000 7fa65d83f640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa65815cd60 0x7fa658159240 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.725+0000 7fa65d83f640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa65814c470 0x7fa65815c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.725+0000 7fa65d83f640 1 --2- 172.21.15.38:0/3740963908 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa648004d00 0x7fa65814aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.725+0000 7fa65d83f640 1 -- 172.21.15.38:0/3740963908 >> 172.21.15.38:0/3740963908 conn(0x7fa6580d31f0 msgr2=0x7fa658070810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:02.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.725+0000 7fa65d83f640 1 -- 172.21.15.38:0/3740963908 shutdown_connections 2023-12-22T08:54:02.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.725+0000 7fa65d83f640 1 -- 172.21.15.38:0/3740963908 wait complete. 2023-12-22T08:54:02.745 INFO:tasks.ceph:Scrubbing osd.6 2023-12-22T08:54:02.745 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:54:02.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.974+0000 7f5533426640 1 Processor -- start 2023-12-22T08:54:02.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.974+0000 7f5533426640 1 -- start start 2023-12-22T08:54:02.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.975+0000 7f5533426640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f552c0d0de0 0x7f552c15e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.975+0000 7f5533426640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c0cc180 con 0x7f552c1406a0 2023-12-22T08:54:02.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.975+0000 7f5533426640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c0cd5a0 con 0x7f552c142d10 2023-12-22T08:54:02.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.975+0000 7f5533426640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c0ca6d0 con 0x7f552c0d0de0 2023-12-22T08:54:02.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.975+0000 7f55311c2640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f552c1406a0 0x7f552c0cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52852/0 (socket says 172.21.15.38:52852) 2023-12-22T08:54:02.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.975+0000 7f55311c2640 1 -- 172.21.15.38:0/312059553 learned_addr learned my addr 172.21.15.38:0/312059553 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:54:02.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.976+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354277188 0 0) 0x7f552c0cc180 con 0x7f552c1406a0 2023-12-22T08:54:02.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.976+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5518003520 con 0x7f552c1406a0 2023-12-22T08:54:02.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.976+0000 7f55309c1640 1 --2- 172.21.15.38:0/312059553 >> v2:172.21.15.89:3300/0 conn(0x7f552c0d0de0 0x7f552c15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.976+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3683618954 0 0) 0x7f5518003520 con 0x7f552c1406a0 2023-12-22T08:54:02.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.976+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 >> v2:172.21.15.89:3300/0 conn(0x7f552c0d0de0 msgr2=0x7f552c15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:02.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.976+0000 7f5523fff640 1 --2- 172.21.15.38:0/312059553 >> v2:172.21.15.89:3300/0 conn(0x7f552c0d0de0 0x7f552c15e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.976+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 >> v1:172.21.15.89:6789/0 conn(0x7f552c142d10 legacy=0x7f552c1431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.976+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c0ca970 con 0x7f552c1406a0 2023-12-22T08:54:02.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.976+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f5528001670 con 0x7f552c1406a0 2023-12-22T08:54:02.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.976+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 >> v1:172.21.15.38:6789/0 conn(0x7f552c1406a0 legacy=0x7f552c0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.976+0000 7f5523fff640 1 --2- 172.21.15.38:0/312059553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55180039c0 0x7f5518003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.976+0000 7f5523fff640 1 --2- 172.21.15.38:0/312059553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55180047c0 0x7f5518004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.977+0000 7f5523fff640 1 --2- 172.21.15.38:0/312059553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55180051d0 0x7f551800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.977+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0ca6d0 con 0x7f55180047c0 2023-12-22T08:54:02.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.977+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551800c120 con 0x7f55180039c0 2023-12-22T08:54:02.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.977+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551800c2e0 con 0x7f55180051d0 2023-12-22T08:54:02.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.977+0000 7f55309c1640 1 --2- 172.21.15.38:0/312059553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55180047c0 0x7f5518004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.977+0000 7f55309c1640 1 -- 172.21.15.38:0/312059553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55180051d0 msgr2=0x7f551800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:02.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.977+0000 7f55309c1640 1 --2- 172.21.15.38:0/312059553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55180051d0 0x7f551800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.977+0000 7f55311c2640 1 --2- 172.21.15.38:0/312059553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55180039c0 0x7f5518003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.977+0000 7f55309c1640 1 -- 172.21.15.38:0/312059553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55180039c0 msgr2=0x7f5518003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:02.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.977+0000 7f55309c1640 1 --2- 172.21.15.38:0/312059553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55180039c0 0x7f5518003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.977+0000 7f55309c1640 1 -- 172.21.15.38:0/312059553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5518003520 con 0x7f55180047c0 2023-12-22T08:54:02.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.977+0000 7f55319c3640 1 -- 172.21.15.38:0/312059553 reap_dead start 2023-12-22T08:54:02.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.978+0000 7f55309c1640 1 --2- 172.21.15.38:0/312059553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55180047c0 0x7f5518004c40 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f551c00ba30 tx=0x7f55180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b5517e1920d79e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:02.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.979+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c032640 con 0x7f55180047c0 2023-12-22T08:54:02.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.979+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c0327a0 con 0x7f55180047c0 2023-12-22T08:54:02.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.979+0000 7f5523fff640 1 -- 172.21.15.38:0/312059553 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c032b30 con 0x7f55180047c0 2023-12-22T08:54:02.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.979+0000 7f5533426640 1 -- 172.21.15.38:0/312059553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55180047c0 msgr2=0x7f5518004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.979+0000 7f5533426640 1 --2- 172.21.15.38:0/312059553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55180047c0 0x7f5518004c40 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f551c00ba30 tx=0x7f55180057f0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.979+0000 7f5533426640 1 -- 172.21.15.38:0/312059553 shutdown_connections 2023-12-22T08:54:02.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.979+0000 7f5533426640 1 --2- 172.21.15.38:0/312059553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55180047c0 0x7f5518004c40 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.979+0000 7f5533426640 1 -- 172.21.15.38:0/312059553 >> 172.21.15.38:0/312059553 conn(0x7f552c06c5e0 msgr2=0x7f552c06c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:02.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.980+0000 7f5533426640 1 -- 172.21.15.38:0/312059553 shutdown_connections 2023-12-22T08:54:02.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.980+0000 7f5533426640 1 -- 172.21.15.38:0/312059553 wait complete. 2023-12-22T08:54:02.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.981+0000 7f5533426640 1 Processor -- start 2023-12-22T08:54:02.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.982+0000 7f5533426640 1 -- start start 2023-12-22T08:54:02.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f5533426640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55180047c0 0x7f552c157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f5533426640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f552c155d00 0x7f552c144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f5533426640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c145310 0x7f552c06aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f5533426640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c144660 con 0x7f55180047c0 2023-12-22T08:54:02.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f5533426640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c144940 con 0x7f552c155d00 2023-12-22T08:54:02.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f5533426640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c156510 con 0x7f552c145310 2023-12-22T08:54:02.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f55311c2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55180047c0 0x7f552c157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f55311c2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55180047c0 0x7f552c157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33120/0 (socket says 172.21.15.38:33120) 2023-12-22T08:54:02.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f55311c2640 1 -- 172.21.15.38:0/1095492693 learned_addr learned my addr 172.21.15.38:0/1095492693 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:02.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f55309c1640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f552c155d00 0x7f552c144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f55311c2640 1 -- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c145310 msgr2=0x7f552c06aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f55311c2640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f552c145310 0x7f552c06aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f55311c2640 1 -- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f552c155d00 msgr2=0x7f552c144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:02.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f55311c2640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f552c155d00 0x7f552c144dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:02.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f55311c2640 1 -- 172.21.15.38:0/1095492693 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c1567f0 con 0x7f55180047c0 2023-12-22T08:54:02.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.983+0000 7f55309c1640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f552c155d00 0x7f552c144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:02.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.984+0000 7f55311c2640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55180047c0 0x7f552c157960 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f552800d7a0 tx=0x7f552800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:02.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.984+0000 7f5521ffb640 1 -- 172.21.15.38:0/1095492693 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280074e0 con 0x7f55180047c0 2023-12-22T08:54:02.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.984+0000 7f5521ffb640 1 -- 172.21.15.38:0/1095492693 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5528007640 con 0x7f55180047c0 2023-12-22T08:54:02.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.984+0000 7f5521ffb640 1 -- 172.21.15.38:0/1095492693 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280049e0 con 0x7f55180047c0 2023-12-22T08:54:02.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.984+0000 7f5533426640 1 -- 172.21.15.38:0/1095492693 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c156ad0 con 0x7f55180047c0 2023-12-22T08:54:02.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.984+0000 7f5533426640 1 -- 172.21.15.38:0/1095492693 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c06b020 con 0x7f55180047c0 2023-12-22T08:54:02.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.985+0000 7f5533426640 1 -- 172.21.15.38:0/1095492693 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f552c156cc0 con 0x7f55180047c0 2023-12-22T08:54:02.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.986+0000 7f5521ffb640 1 -- 172.21.15.38:0/1095492693 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5528004b40 con 0x7f55180047c0 2023-12-22T08:54:02.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.987+0000 7f5521ffb640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f551006a430 0x7f551006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.987+0000 7f5521ffb640 1 -- 172.21.15.38:0/1095492693 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5528087f60 con 0x7f55180047c0 2023-12-22T08:54:02.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.987+0000 7f5521ffb640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] conn(0x7f5510070290 0x7f55100726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:02.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.987+0000 7f5521ffb640 1 -- 172.21.15.38:0/1095492693 --> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5510072d60 con 0x7f5510070290 2023-12-22T08:54:02.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.987+0000 7f5521ffb640 1 -- 172.21.15.38:0/1095492693 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f552808a540 con 0x7f55180047c0 2023-12-22T08:54:02.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.988+0000 7f55309c1640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f551006a430 0x7f551006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.988+0000 7f55319c3640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] conn(0x7f5510070290 0x7f55100726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:02.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.989+0000 7f55319c3640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] conn(0x7f5510070290 0x7f55100726b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:02.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.989+0000 7f55309c1640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f551006a430 0x7f551006c8f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f551c00ba00 tx=0x7f551c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:02.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:02.991+0000 7f5521ffb640 1 -- 172.21.15.38:0/1095492693 <== osd.6 v2:172.21.15.89:6808/84337 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f5510072d60 con 0x7f5510070290 2023-12-22T08:54:03.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.004+0000 7f5533426640 1 -- 172.21.15.38:0/1095492693 --> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f552c1456f0 con 0x7f5510070290 2023-12-22T08:54:03.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.005+0000 7f5521ffb640 1 -- 172.21.15.38:0/1095492693 <== osd.6 v2:172.21.15.89:6808/84337 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f552c1456f0 con 0x7f5510070290 2023-12-22T08:54:03.006 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:54:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-22T08:54:03.006 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:54:03.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.005+0000 7f5533426640 1 -- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] conn(0x7f5510070290 msgr2=0x7f55100726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.005+0000 7f5533426640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:6808/84337,v1:172.21.15.89:6809/84337] conn(0x7f5510070290 0x7f55100726b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.006+0000 7f5533426640 1 -- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f551006a430 msgr2=0x7f551006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.006+0000 7f5533426640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f551006a430 0x7f551006c8f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f551c00ba00 tx=0x7f551c03d040 comp rx=0 tx=0).stop 2023-12-22T08:54:03.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.006+0000 7f5533426640 1 -- 172.21.15.38:0/1095492693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55180047c0 msgr2=0x7f552c157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.006+0000 7f5533426640 1 --2- 172.21.15.38:0/1095492693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55180047c0 0x7f552c157960 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f552800d7a0 tx=0x7f552800dc60 comp rx=0 tx=0).stop 2023-12-22T08:54:03.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.006+0000 7f55319c3640 1 -- 172.21.15.38:0/1095492693 reap_dead start 2023-12-22T08:54:03.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.006+0000 7f5533426640 1 -- 172.21.15.38:0/1095492693 shutdown_connections 2023-12-22T08:54:03.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.006+0000 7f5533426640 1 -- 172.21.15.38:0/1095492693 >> 172.21.15.38:0/1095492693 conn(0x7f552c06c5e0 msgr2=0x7f552c0b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:03.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.006+0000 7f5533426640 1 -- 172.21.15.38:0/1095492693 shutdown_connections 2023-12-22T08:54:03.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.006+0000 7f5533426640 1 -- 172.21.15.38:0/1095492693 wait complete. 2023-12-22T08:54:03.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-22T08:54:03.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.249+0000 7f592cd77640 1 Processor -- start 2023-12-22T08:54:03.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.249+0000 7f592cd77640 1 -- start start 2023-12-22T08:54:03.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.251+0000 7f592cd77640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5928161720 0x7f59280adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:03.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.251+0000 7f592cd77640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f59280ae1e0 0x7f592806f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:03.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.251+0000 7f592cd77640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59280ce950 con 0x7f5928161340 2023-12-22T08:54:03.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.251+0000 7f592cd77640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5928072170 con 0x7f59280ae1e0 2023-12-22T08:54:03.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.251+0000 7f592cd77640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59280cdd40 con 0x7f5928161720 2023-12-22T08:54:03.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.251+0000 7f5927fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f59280ae1e0 0x7f592806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:03.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.251+0000 7f5927fff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f59280ae1e0 0x7f592806f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33136/0 (socket says 172.21.15.38:33136) 2023-12-22T08:54:03.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.251+0000 7f5927fff640 1 -- 172.21.15.38:0/2449583301 learned_addr learned my addr 172.21.15.38:0/2449583301 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:03.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.251+0000 7f591ffff640 1 --2- 172.21.15.38:0/2449583301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5928161720 0x7f59280adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:03.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.252+0000 7f5927fff640 1 -- 172.21.15.38:0/2449583301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5928161720 msgr2=0x7f59280adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:03.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.252+0000 7f5927fff640 1 --2- 172.21.15.38:0/2449583301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5928161720 0x7f59280adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.252+0000 7f5927fff640 1 -- 172.21.15.38:0/2449583301 >> v1:172.21.15.38:6789/0 conn(0x7f5928161340 legacy=0x7f5928071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.252+0000 7f5927fff640 1 -- 172.21.15.38:0/2449583301 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59280ce020 con 0x7f59280ae1e0 2023-12-22T08:54:03.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.253+0000 7f5927fff640 1 --2- 172.21.15.38:0/2449583301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59280ae1e0 0x7f592806f250 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f5920009e80 tx=0x7f592002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a999b3462d2d5f64 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:03.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.253+0000 7f5926ffd640 1 -- 172.21.15.38:0/2449583301 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592002ca50 con 0x7f59280ae1e0 2023-12-22T08:54:03.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.253+0000 7f5926ffd640 1 -- 172.21.15.38:0/2449583301 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592002cbb0 con 0x7f59280ae1e0 2023-12-22T08:54:03.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.253+0000 7f5926ffd640 1 -- 172.21.15.38:0/2449583301 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59200343f0 con 0x7f59280ae1e0 2023-12-22T08:54:03.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.254+0000 7f592cd77640 1 -- 172.21.15.38:0/2449583301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59280ae1e0 msgr2=0x7f592806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.254+0000 7f592cd77640 1 --2- 172.21.15.38:0/2449583301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59280ae1e0 0x7f592806f250 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f5920009e80 tx=0x7f592002beb0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.254+0000 7f592cd77640 1 -- 172.21.15.38:0/2449583301 shutdown_connections 2023-12-22T08:54:03.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.254+0000 7f592cd77640 1 --2- 172.21.15.38:0/2449583301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59280ae1e0 0x7f592806f250 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.254+0000 7f592cd77640 1 --2- 172.21.15.38:0/2449583301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5928161720 0x7f59280adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.254+0000 7f592cd77640 1 -- 172.21.15.38:0/2449583301 >> 172.21.15.38:0/2449583301 conn(0x7f59280b1f70 msgr2=0x7f59280b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:03.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.254+0000 7f592cd77640 1 -- 172.21.15.38:0/2449583301 shutdown_connections 2023-12-22T08:54:03.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.254+0000 7f592cd77640 1 -- 172.21.15.38:0/2449583301 wait complete. 2023-12-22T08:54:03.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.256+0000 7f592cd77640 1 Processor -- start 2023-12-22T08:54:03.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.256+0000 7f592cd77640 1 -- start start 2023-12-22T08:54:03.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.257+0000 7f592cd77640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59280ae1e0 0x7f592814d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:03.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.257+0000 7f592cd77640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5928161340 0x7f59281f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:03.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.257+0000 7f592cd77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5928161720 0x7f59280cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:03.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.257+0000 7f592cd77640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592809efa0 con 0x7f59280ae1e0 2023-12-22T08:54:03.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.257+0000 7f592cd77640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592809afa0 con 0x7f5928161720 2023-12-22T08:54:03.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.257+0000 7f592cd77640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592809b280 con 0x7f5928161340 2023-12-22T08:54:03.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.257+0000 7f59277fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59280ae1e0 0x7f592814d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:03.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.257+0000 7f59277fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59280ae1e0 0x7f592814d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33150/0 (socket says 172.21.15.38:33150) 2023-12-22T08:54:03.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.257+0000 7f59277fe640 1 -- 172.21.15.38:0/132281196 learned_addr learned my addr 172.21.15.38:0/132281196 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:03.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.258+0000 7f591ffff640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5928161340 0x7f59281f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:03.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.258+0000 7f5927fff640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5928161720 0x7f59280cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:03.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.258+0000 7f59277fe640 1 -- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5928161340 msgr2=0x7f59281f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.258+0000 7f59277fe640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5928161340 0x7f59281f2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.258+0000 7f59277fe640 1 -- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5928161720 msgr2=0x7f59280cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.258+0000 7f59277fe640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5928161720 0x7f59280cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.258+0000 7f59277fe640 1 -- 172.21.15.38:0/132281196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009b30 con 0x7f59280ae1e0 2023-12-22T08:54:03.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.258+0000 7f59277fe640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59280ae1e0 0x7f592814d740 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f591800c450 tx=0x7f591800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:03.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.258+0000 7f5924ff9640 1 -- 172.21.15.38:0/132281196 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180052d0 con 0x7f59280ae1e0 2023-12-22T08:54:03.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.259+0000 7f5924ff9640 1 -- 172.21.15.38:0/132281196 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5918005430 con 0x7f59280ae1e0 2023-12-22T08:54:03.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.259+0000 7f5924ff9640 1 -- 172.21.15.38:0/132281196 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918012870 con 0x7f59280ae1e0 2023-12-22T08:54:03.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.259+0000 7f592cd77640 1 -- 172.21.15.38:0/132281196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592809b560 con 0x7f59280ae1e0 2023-12-22T08:54:03.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.259+0000 7f592cd77640 1 -- 172.21.15.38:0/132281196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592814dc80 con 0x7f59280ae1e0 2023-12-22T08:54:03.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.260+0000 7f592cd77640 1 -- 172.21.15.38:0/132281196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592814acf0 con 0x7f59280ae1e0 2023-12-22T08:54:03.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.261+0000 7f5924ff9640 1 -- 172.21.15.38:0/132281196 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f59180129d0 con 0x7f59280ae1e0 2023-12-22T08:54:03.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.262+0000 7f5924ff9640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f590806a430 0x7f590806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:03.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.262+0000 7f5924ff9640 1 -- 172.21.15.38:0/132281196 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f59180880f0 con 0x7f59280ae1e0 2023-12-22T08:54:03.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.262+0000 7f591ffff640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f590806a430 0x7f590806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:03.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.264+0000 7f591ffff640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f590806a430 0x7f590806c8f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f5910006fd0 tx=0x7f5910008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:03.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.267+0000 7f5924ff9640 1 -- 172.21.15.38:0/132281196 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5918053a70 con 0x7f59280ae1e0 2023-12-22T08:54:03.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.464+0000 7f592cd77640 1 -- 172.21.15.38:0/132281196 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f59280ce5e0 con 0x7f590806a430 2023-12-22T08:54:03.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.465+0000 7f5924ff9640 1 -- 172.21.15.38:0/132281196 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5910004030 con 0x7f590806a430 2023-12-22T08:54:03.466 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 6 to deep-scrub 2023-12-22T08:54:03.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.468+0000 7f592cd77640 1 -- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f590806a430 msgr2=0x7f590806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.468+0000 7f592cd77640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f590806a430 0x7f590806c8f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f5910006fd0 tx=0x7f5910008040 comp rx=0 tx=0).stop 2023-12-22T08:54:03.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.468+0000 7f592cd77640 1 -- 172.21.15.38:0/132281196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59280ae1e0 msgr2=0x7f592814d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.468+0000 7f592cd77640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59280ae1e0 0x7f592814d740 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f591800c450 tx=0x7f591800c910 comp rx=0 tx=0).stop 2023-12-22T08:54:03.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.468+0000 7f592cd77640 1 -- 172.21.15.38:0/132281196 shutdown_connections 2023-12-22T08:54:03.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.468+0000 7f592cd77640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5928161720 0x7f59280cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.468+0000 7f592cd77640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5928161340 0x7f59281f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.468+0000 7f592cd77640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f590806a430 0x7f590806c8f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.468+0000 7f592cd77640 1 --2- 172.21.15.38:0/132281196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59280ae1e0 0x7f592814d740 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.468+0000 7f592cd77640 1 -- 172.21.15.38:0/132281196 >> 172.21.15.38:0/132281196 conn(0x7f59280b1f70 msgr2=0x7f59280af270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:03.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.468+0000 7f592cd77640 1 -- 172.21.15.38:0/132281196 shutdown_connections 2023-12-22T08:54:03.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.468+0000 7f592cd77640 1 -- 172.21.15.38:0/132281196 wait complete. 2023-12-22T08:54:03.490 INFO:tasks.ceph:Scrubbing osd.7 2023-12-22T08:54:03.490 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:54:03.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.723+0000 7f81aa083640 1 Processor -- start 2023-12-22T08:54:03.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.723+0000 7f81aa083640 1 -- start start 2023-12-22T08:54:03.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.725+0000 7f81aa083640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81a40adfb0 0x7f81a40ae460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:03.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.725+0000 7f81aa083640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f81a406fcf0 0x7f81a4070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:03.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.725+0000 7f81aa083640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a415ca20 con 0x7f81a415b370 2023-12-22T08:54:03.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.725+0000 7f81aa083640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40ae9a0 con 0x7f81a406fcf0 2023-12-22T08:54:03.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.725+0000 7f81aa083640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a415b750 con 0x7f81a40adfb0 2023-12-22T08:54:03.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.726+0000 7f81a9882640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f81a406fcf0 0x7f81a4070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:03.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.726+0000 7f81a9882640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f81a406fcf0 0x7f81a4070180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33152/0 (socket says 172.21.15.38:33152) 2023-12-22T08:54:03.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.726+0000 7f81a9882640 1 -- 172.21.15.38:0/2093597348 learned_addr learned my addr 172.21.15.38:0/2093597348 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:03.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.726+0000 7f81a8880640 1 --2- 172.21.15.38:0/2093597348 >> v2:172.21.15.89:3300/0 conn(0x7f81a40adfb0 0x7f81a40ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:03.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.726+0000 7f81a9882640 1 -- 172.21.15.38:0/2093597348 >> v2:172.21.15.89:3300/0 conn(0x7f81a40adfb0 msgr2=0x7f81a40ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:03.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.726+0000 7f81a9882640 1 --2- 172.21.15.38:0/2093597348 >> v2:172.21.15.89:3300/0 conn(0x7f81a40adfb0 0x7f81a40ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.726+0000 7f81a9882640 1 -- 172.21.15.38:0/2093597348 >> v1:172.21.15.89:6789/0 conn(0x7f81a415b370 legacy=0x7f81a406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:03.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.726+0000 7f81a9882640 1 -- 172.21.15.38:0/2093597348 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a406dc20 con 0x7f81a406fcf0 2023-12-22T08:54:03.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.726+0000 7f81a8880640 1 --2- 172.21.15.38:0/2093597348 >> v2:172.21.15.89:3300/0 conn(0x7f81a40adfb0 0x7f81a40ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:03.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.728+0000 7f81a9882640 1 --2- 172.21.15.38:0/2093597348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a406fcf0 0x7f81a4070180 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f81a406a7b0 tx=0x7f819c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1193f765cccb83 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:03.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.728+0000 7f819bfff640 1 -- 172.21.15.38:0/2093597348 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c02ca70 con 0x7f81a406fcf0 2023-12-22T08:54:03.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.728+0000 7f819bfff640 1 -- 172.21.15.38:0/2093597348 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c02cbd0 con 0x7f81a406fcf0 2023-12-22T08:54:03.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.728+0000 7f819bfff640 1 -- 172.21.15.38:0/2093597348 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c0343f0 con 0x7f81a406fcf0 2023-12-22T08:54:03.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.728+0000 7f81aa083640 1 -- 172.21.15.38:0/2093597348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a406fcf0 msgr2=0x7f81a4070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.728+0000 7f81aa083640 1 --2- 172.21.15.38:0/2093597348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a406fcf0 0x7f81a4070180 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f81a406a7b0 tx=0x7f819c02bed0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.729+0000 7f81aa083640 1 -- 172.21.15.38:0/2093597348 shutdown_connections 2023-12-22T08:54:03.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.729+0000 7f81aa083640 1 --2- 172.21.15.38:0/2093597348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a406fcf0 0x7f81a4070180 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.729+0000 7f81aa083640 1 --2- 172.21.15.38:0/2093597348 >> v2:172.21.15.89:3300/0 conn(0x7f81a40adfb0 0x7f81a40ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.729+0000 7f81aa083640 1 -- 172.21.15.38:0/2093597348 >> 172.21.15.38:0/2093597348 conn(0x7f81a40b1110 msgr2=0x7f81a40b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:03.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.729+0000 7f81aa083640 1 -- 172.21.15.38:0/2093597348 shutdown_connections 2023-12-22T08:54:03.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.729+0000 7f81aa083640 1 -- 172.21.15.38:0/2093597348 wait complete. 2023-12-22T08:54:03.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.731+0000 7f81aa083640 1 Processor -- start 2023-12-22T08:54:03.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.731+0000 7f81aa083640 1 -- start start 2023-12-22T08:54:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81aa083640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a406fcf0 0x7f81a414b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81aa083640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a40adfb0 0x7f81a4154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81aa083640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81a415b370 0x7f81a415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81aa083640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a40c83e0 con 0x7f81a40adfb0 2023-12-22T08:54:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81aa083640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4099a70 con 0x7f81a415b370 2023-12-22T08:54:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81aa083640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a40c8630 con 0x7f81a406fcf0 2023-12-22T08:54:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81a8880640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a40adfb0 0x7f81a4154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81a8880640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a40adfb0 0x7f81a4154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33158/0 (socket says 172.21.15.38:33158) 2023-12-22T08:54:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81a8880640 1 -- 172.21.15.38:0/2370247707 learned_addr learned my addr 172.21.15.38:0/2370247707 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81a9081640 1 --2- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a406fcf0 0x7f81a414b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81a8880640 1 -- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a406fcf0 msgr2=0x7f81a414b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81a8880640 1 --2- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81a406fcf0 0x7f81a414b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81a8880640 1 -- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81a415b370 msgr2=0x7f81a415dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81a8880640 1 --2- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81a415b370 0x7f81a415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.732+0000 7f81a8880640 1 -- 172.21.15.38:0/2370247707 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c009b30 con 0x7f81a40adfb0 2023-12-22T08:54:03.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.733+0000 7f81a8880640 1 --2- 172.21.15.38:0/2370247707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a40adfb0 0x7f81a4154720 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f819400c7f0 tx=0x7f819400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:03.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.733+0000 7f8199ffb640 1 -- 172.21.15.38:0/2370247707 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194007a30 con 0x7f81a40adfb0 2023-12-22T08:54:03.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.733+0000 7f8199ffb640 1 -- 172.21.15.38:0/2370247707 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8194007b90 con 0x7f81a40adfb0 2023-12-22T08:54:03.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.733+0000 7f81aa083640 1 -- 172.21.15.38:0/2370247707 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a40c8910 con 0x7f81a40adfb0 2023-12-22T08:54:03.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.733+0000 7f8199ffb640 1 -- 172.21.15.38:0/2370247707 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819400ce40 con 0x7f81a40adfb0 2023-12-22T08:54:03.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.733+0000 7f81aa083640 1 -- 172.21.15.38:0/2370247707 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a40c8ed0 con 0x7f81a40adfb0 2023-12-22T08:54:03.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.734+0000 7f81aa083640 1 -- 172.21.15.38:0/2370247707 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81a406e1e0 con 0x7f81a40adfb0 2023-12-22T08:54:03.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.735+0000 7f8199ffb640 1 -- 172.21.15.38:0/2370247707 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f81940113f0 con 0x7f81a40adfb0 2023-12-22T08:54:03.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.736+0000 7f8199ffb640 1 --2- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f818806a430 0x7f818806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:03.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.737+0000 7f8199ffb640 1 -- 172.21.15.38:0/2370247707 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8194088850 con 0x7f81a40adfb0 2023-12-22T08:54:03.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.737+0000 7f8199ffb640 1 --2- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] conn(0x7f8188070290 0x7f81880726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:03.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.737+0000 7f8199ffb640 1 -- 172.21.15.38:0/2370247707 --> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8188072d60 con 0x7f8188070290 2023-12-22T08:54:03.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.737+0000 7f8199ffb640 1 -- 172.21.15.38:0/2370247707 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f819408ae30 con 0x7f81a40adfb0 2023-12-22T08:54:03.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.737+0000 7f81a9081640 1 --2- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f818806a430 0x7f818806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:03.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.738+0000 7f81a9882640 1 --2- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] conn(0x7f8188070290 0x7f81880726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:03.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.738+0000 7f81a9081640 1 --2- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f818806a430 0x7f818806c8f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f81a0006fd0 tx=0x7f81a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:03.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.739+0000 7f81a9882640 1 --2- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] conn(0x7f8188070290 0x7f81880726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:03.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.740+0000 7f8199ffb640 1 -- 172.21.15.38:0/2370247707 <== osd.7 v2:172.21.15.89:6821/84340 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f8188072d60 con 0x7f8188070290 2023-12-22T08:54:03.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.753+0000 7f81aa083640 1 -- 172.21.15.38:0/2370247707 --> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f81a406df00 con 0x7f8188070290 2023-12-22T08:54:03.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.755+0000 7f8199ffb640 1 -- 172.21.15.38:0/2370247707 <== osd.7 v2:172.21.15.89:6821/84340 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f819c02c8f0 con 0x7f8188070290 2023-12-22T08:54:03.755 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-12-22T08:54:03.755 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-22T08:54:03.755 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-12-22T08:54:03.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.755+0000 7f81aa083640 1 -- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] conn(0x7f8188070290 msgr2=0x7f81880726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.755+0000 7f81aa083640 1 --2- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:6821/84340,v1:172.21.15.89:6823/84340] conn(0x7f8188070290 0x7f81880726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.755+0000 7f81aa083640 1 -- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f818806a430 msgr2=0x7f818806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.755+0000 7f81aa083640 1 --2- 172.21.15.38:0/2370247707 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f818806a430 0x7f818806c8f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f81a0006fd0 tx=0x7f81a0008040 comp rx=0 tx=0).stop 2023-12-22T08:54:03.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.755+0000 7f81aa083640 1 -- 172.21.15.38:0/2370247707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a40adfb0 msgr2=0x7f81a4154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:03.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.755+0000 7f81aa083640 1 --2- 172.21.15.38:0/2370247707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81a40adfb0 0x7f81a4154720 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f819400c7f0 tx=0x7f819400cbf0 comp rx=0 tx=0).stop 2023-12-22T08:54:03.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.755+0000 7f81a9882640 1 -- 172.21.15.38:0/2370247707 reap_dead start 2023-12-22T08:54:03.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.755+0000 7f81aa083640 1 -- 172.21.15.38:0/2370247707 shutdown_connections 2023-12-22T08:54:03.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.755+0000 7f81aa083640 1 -- 172.21.15.38:0/2370247707 >> 172.21.15.38:0/2370247707 conn(0x7f81a40b1110 msgr2=0x7f81a40b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:03.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.755+0000 7f81aa083640 1 -- 172.21.15.38:0/2370247707 shutdown_connections 2023-12-22T08:54:03.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.755+0000 7f81aa083640 1 -- 172.21.15.38:0/2370247707 wait complete. 2023-12-22T08:54:03.773 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-22T08:54:04.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.999+0000 7ffb7a3c4640 1 Processor -- start 2023-12-22T08:54:04.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:03.999+0000 7ffb7a3c4640 1 -- start start 2023-12-22T08:54:04.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.000+0000 7ffb7a3c4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffb74071000 0x7ffb74165f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.000+0000 7ffb7a3c4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb740cdae0 con 0x7ffb7415b420 2023-12-22T08:54:04.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.000+0000 7ffb7a3c4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7415b800 con 0x7ffb740a44a0 2023-12-22T08:54:04.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.000+0000 7ffb7a3c4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb740cdd30 con 0x7ffb74071000 2023-12-22T08:54:04.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.001+0000 7ffb793c2640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ffb7415b420 0x7ffb7406d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52868/0 (socket says 172.21.15.38:52868) 2023-12-22T08:54:04.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.001+0000 7ffb793c2640 1 -- 172.21.15.38:0/36501722 learned_addr learned my addr 172.21.15.38:0/36501722 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:54:04.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.001+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937637047 0 0) 0x7ffb740cdae0 con 0x7ffb7415b420 2023-12-22T08:54:04.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.001+0000 7ffb79bc3640 1 --2- 172.21.15.38:0/36501722 >> v2:172.21.15.89:3300/0 conn(0x7ffb74071000 0x7ffb74165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.001+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb60003520 con 0x7ffb7415b420 2023-12-22T08:54:04.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2161064951 0 0) 0x7ffb60003520 con 0x7ffb7415b420 2023-12-22T08:54:04.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 >> v2:172.21.15.89:3300/0 conn(0x7ffb74071000 msgr2=0x7ffb74165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:04.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb6bfff640 1 --2- 172.21.15.38:0/36501722 >> v2:172.21.15.89:3300/0 conn(0x7ffb74071000 0x7ffb74165f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 >> v1:172.21.15.89:6789/0 conn(0x7ffb740a44a0 legacy=0x7ffb740708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb740ce010 con 0x7ffb7415b420 2023-12-22T08:54:04.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7ffb70001670 con 0x7ffb7415b420 2023-12-22T08:54:04.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 >> v1:172.21.15.38:6789/0 conn(0x7ffb7415b420 legacy=0x7ffb7406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb6bfff640 1 --2- 172.21.15.38:0/36501722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb60003970 0x7ffb60003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb6bfff640 1 --2- 172.21.15.38:0/36501722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb600047c0 0x7ffb60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb6bfff640 1 --2- 172.21.15.38:0/36501722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb60005180 0x7ffb6000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740cdd30 con 0x7ffb600047c0 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6000c020 con 0x7ffb60003970 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6000c1e0 con 0x7ffb60005180 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb78bc1640 1 --2- 172.21.15.38:0/36501722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb600047c0 0x7ffb60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb78bc1640 1 -- 172.21.15.38:0/36501722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb60005180 msgr2=0x7ffb6000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb78bc1640 1 --2- 172.21.15.38:0/36501722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb60005180 0x7ffb6000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb793c2640 1 --2- 172.21.15.38:0/36501722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb60003970 0x7ffb60003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.002+0000 7ffb78bc1640 1 -- 172.21.15.38:0/36501722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb60003970 msgr2=0x7ffb60003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.003+0000 7ffb78bc1640 1 --2- 172.21.15.38:0/36501722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb60003970 0x7ffb60003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.003+0000 7ffb78bc1640 1 -- 172.21.15.38:0/36501722 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60003520 con 0x7ffb600047c0 2023-12-22T08:54:04.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.003+0000 7ffb79bc3640 1 -- 172.21.15.38:0/36501722 reap_dead start 2023-12-22T08:54:04.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.004+0000 7ffb78bc1640 1 --2- 172.21.15.38:0/36501722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb600047c0 0x7ffb60004c40 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7ffb740b1f40 tx=0x7ffb600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668b10fb4de50afb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:04.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.004+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb640052d0 con 0x7ffb600047c0 2023-12-22T08:54:04.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.004+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6402e050 con 0x7ffb600047c0 2023-12-22T08:54:04.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.004+0000 7ffb6bfff640 1 -- 172.21.15.38:0/36501722 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64003830 con 0x7ffb600047c0 2023-12-22T08:54:04.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.005+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/36501722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb600047c0 msgr2=0x7ffb60004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.005+0000 7ffb7a3c4640 1 --2- 172.21.15.38:0/36501722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb600047c0 0x7ffb60004c40 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7ffb740b1f40 tx=0x7ffb600057f0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.005+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/36501722 shutdown_connections 2023-12-22T08:54:04.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.005+0000 7ffb7a3c4640 1 --2- 172.21.15.38:0/36501722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb600047c0 0x7ffb60004c40 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.005+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/36501722 >> 172.21.15.38:0/36501722 conn(0x7ffb740b1f70 msgr2=0x7ffb740b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:04.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.005+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/36501722 shutdown_connections 2023-12-22T08:54:04.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.005+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/36501722 wait complete. 2023-12-22T08:54:04.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.007+0000 7ffb7a3c4640 1 Processor -- start 2023-12-22T08:54:04.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.007+0000 7ffb7a3c4640 1 -- start start 2023-12-22T08:54:04.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb7a3c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb600047c0 0x7ffb74159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb7a3c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb740c2380 0x7ffb740c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb7a3c4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb741f62a0 0x7ffb741f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb7a3c4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740c5940 con 0x7ffb741f62a0 2023-12-22T08:54:04.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb7a3c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb741f6c60 con 0x7ffb600047c0 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb7a3c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740c36c0 con 0x7ffb740c2380 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb79bc3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb741f62a0 0x7ffb741f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb79bc3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb741f62a0 0x7ffb741f6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33188/0 (socket says 172.21.15.38:33188) 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb79bc3640 1 -- 172.21.15.38:0/1410635220 learned_addr learned my addr 172.21.15.38:0/1410635220 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb793c2640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb600047c0 0x7ffb74159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb78bc1640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb740c2380 0x7ffb740c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb79bc3640 1 -- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb740c2380 msgr2=0x7ffb740c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb79bc3640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb740c2380 0x7ffb740c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb79bc3640 1 -- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb600047c0 msgr2=0x7ffb74159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.008+0000 7ffb79bc3640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb600047c0 0x7ffb74159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.009+0000 7ffb79bc3640 1 -- 172.21.15.38:0/1410635220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb740c3b50 con 0x7ffb741f62a0 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.009+0000 7ffb79bc3640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb741f62a0 0x7ffb741f6720 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7ffb74071770 tx=0x7ffb6c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.009+0000 7ffb69ffb640 1 -- 172.21.15.38:0/1410635220 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c010040 con 0x7ffb741f62a0 2023-12-22T08:54:04.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.009+0000 7ffb69ffb640 1 -- 172.21.15.38:0/1410635220 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c00bb40 con 0x7ffb741f62a0 2023-12-22T08:54:04.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.009+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/1410635220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb740c2800 con 0x7ffb741f62a0 2023-12-22T08:54:04.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.009+0000 7ffb69ffb640 1 -- 172.21.15.38:0/1410635220 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c014400 con 0x7ffb741f62a0 2023-12-22T08:54:04.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.009+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/1410635220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb740c2d90 con 0x7ffb741f62a0 2023-12-22T08:54:04.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.011+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/1410635220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb74061910 con 0x7ffb741f62a0 2023-12-22T08:54:04.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.011+0000 7ffb69ffb640 1 -- 172.21.15.38:0/1410635220 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffb6c014560 con 0x7ffb741f62a0 2023-12-22T08:54:04.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.013+0000 7ffb69ffb640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb5806a430 0x7ffb5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.013+0000 7ffb69ffb640 1 -- 172.21.15.38:0/1410635220 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffb6c088d40 con 0x7ffb741f62a0 2023-12-22T08:54:04.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.014+0000 7ffb793c2640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb5806a430 0x7ffb5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.015+0000 7ffb793c2640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb5806a430 0x7ffb5806c8f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ffb70001200 tx=0x7ffb70009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:04.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.018+0000 7ffb69ffb640 1 -- 172.21.15.38:0/1410635220 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffb6c054620 con 0x7ffb741f62a0 2023-12-22T08:54:04.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.211+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/1410635220 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb740ce5d0 con 0x7ffb5806a430 2023-12-22T08:54:04.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.212+0000 7ffb69ffb640 1 -- 172.21.15.38:0/1410635220 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffb7000d070 con 0x7ffb5806a430 2023-12-22T08:54:04.213 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 7 to deep-scrub 2023-12-22T08:54:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.214+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb5806a430 msgr2=0x7ffb5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.214+0000 7ffb7a3c4640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb5806a430 0x7ffb5806c8f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ffb70001200 tx=0x7ffb70009040 comp rx=0 tx=0).stop 2023-12-22T08:54:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.214+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/1410635220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb741f62a0 msgr2=0x7ffb741f6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.214+0000 7ffb7a3c4640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb741f62a0 0x7ffb741f6720 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7ffb74071770 tx=0x7ffb6c00ef30 comp rx=0 tx=0).stop 2023-12-22T08:54:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.215+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/1410635220 shutdown_connections 2023-12-22T08:54:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.215+0000 7ffb7a3c4640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7ffb5806a430 0x7ffb5806c8f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.215+0000 7ffb7a3c4640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb741f62a0 0x7ffb741f6720 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.215+0000 7ffb7a3c4640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb740c2380 0x7ffb740c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.215+0000 7ffb7a3c4640 1 --2- 172.21.15.38:0/1410635220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb600047c0 0x7ffb74159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.215+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/1410635220 >> 172.21.15.38:0/1410635220 conn(0x7ffb740b1f70 msgr2=0x7ffb740a30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.215+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/1410635220 shutdown_connections 2023-12-22T08:54:04.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.215+0000 7ffb7a3c4640 1 -- 172.21.15.38:0/1410635220 wait complete. 2023-12-22T08:54:04.235 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:54:04.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.462+0000 7f5be192e640 1 Processor -- start 2023-12-22T08:54:04.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.462+0000 7f5be192e640 1 -- start start 2023-12-22T08:54:04.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.463+0000 7f5be192e640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5bdc159a80 0x7f5bdc071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.463+0000 7f5be192e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b4280 0x7f5bdc06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.463+0000 7f5be192e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bdc06c5a0 con 0x7f5bdc06d810 2023-12-22T08:54:04.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.464+0000 7f5be192e640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bdc071760 con 0x7f5bdc159a80 2023-12-22T08:54:04.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.464+0000 7f5be192e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc06c7f0 con 0x7f5bdc0b4280 2023-12-22T08:54:04.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.464+0000 7f5bdaffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5bdc159a80 0x7f5bdc071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.464+0000 7f5bdaffd640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5bdc159a80 0x7f5bdc071180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33198/0 (socket says 172.21.15.38:33198) 2023-12-22T08:54:04.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.464+0000 7f5bdaffd640 1 -- 172.21.15.38:0/3455604313 learned_addr learned my addr 172.21.15.38:0/3455604313 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:04.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.464+0000 7f5bda7fc640 1 --2- 172.21.15.38:0/3455604313 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b4280 0x7f5bdc06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.465+0000 7f5bdaffd640 1 -- 172.21.15.38:0/3455604313 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b4280 msgr2=0x7f5bdc06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:04.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.465+0000 7f5bdaffd640 1 --2- 172.21.15.38:0/3455604313 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b4280 0x7f5bdc06d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.465+0000 7f5bdaffd640 1 -- 172.21.15.38:0/3455604313 >> v1:172.21.15.89:6789/0 conn(0x7f5bdc06d810 legacy=0x7f5bdc0b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.465+0000 7f5bdaffd640 1 -- 172.21.15.38:0/3455604313 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc06cad0 con 0x7f5bdc159a80 2023-12-22T08:54:04.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.466+0000 7f5bdaffd640 1 --2- 172.21.15.38:0/3455604313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bdc159a80 0x7f5bdc071180 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00af60 tx=0x7f5bcc02d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8167b97f7db11a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:04.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.466+0000 7f5bd9ffb640 1 -- 172.21.15.38:0/3455604313 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc02da10 con 0x7f5bdc159a80 2023-12-22T08:54:04.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.466+0000 7f5bd9ffb640 1 -- 172.21.15.38:0/3455604313 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc02db70 con 0x7f5bdc159a80 2023-12-22T08:54:04.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.466+0000 7f5bd9ffb640 1 -- 172.21.15.38:0/3455604313 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc008500 con 0x7f5bdc159a80 2023-12-22T08:54:04.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.467+0000 7f5be192e640 1 -- 172.21.15.38:0/3455604313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bdc159a80 msgr2=0x7f5bdc071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.467+0000 7f5be192e640 1 --2- 172.21.15.38:0/3455604313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bdc159a80 0x7f5bdc071180 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00af60 tx=0x7f5bcc02d070 comp rx=0 tx=0).stop 2023-12-22T08:54:04.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.467+0000 7f5be192e640 1 -- 172.21.15.38:0/3455604313 shutdown_connections 2023-12-22T08:54:04.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.467+0000 7f5be192e640 1 --2- 172.21.15.38:0/3455604313 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0b4280 0x7f5bdc06d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.467+0000 7f5be192e640 1 --2- 172.21.15.38:0/3455604313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bdc159a80 0x7f5bdc071180 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.467+0000 7f5be192e640 1 -- 172.21.15.38:0/3455604313 >> 172.21.15.38:0/3455604313 conn(0x7f5bdc0cf070 msgr2=0x7f5bdc0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:04.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.467+0000 7f5be192e640 1 -- 172.21.15.38:0/3455604313 shutdown_connections 2023-12-22T08:54:04.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.467+0000 7f5be192e640 1 -- 172.21.15.38:0/3455604313 wait complete. 2023-12-22T08:54:04.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.469+0000 7f5be192e640 1 Processor -- start 2023-12-22T08:54:04.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.469+0000 7f5be192e640 1 -- start start 2023-12-22T08:54:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.470+0000 7f5be192e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bdc0b4280 0x7f5bdc143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.470+0000 7f5be192e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bdc159a80 0x7f5bdc0c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.470+0000 7f5be192e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0c9970 0x7f5bdc149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.470+0000 7f5be192e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0a9530 con 0x7f5bdc0b4280 2023-12-22T08:54:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.470+0000 7f5be192e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0c9de0 con 0x7f5bdc159a80 2023-12-22T08:54:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.470+0000 7f5be192e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0aea30 con 0x7f5bdc0c9970 2023-12-22T08:54:04.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.470+0000 7f5bdaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bdc0b4280 0x7f5bdc143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.470+0000 7f5bdaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bdc0b4280 0x7f5bdc143e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33200/0 (socket says 172.21.15.38:33200) 2023-12-22T08:54:04.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.470+0000 7f5bdaffd640 1 -- 172.21.15.38:0/3751349484 learned_addr learned my addr 172.21.15.38:0/3751349484 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:04.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.471+0000 7f5bda7fc640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bdc159a80 0x7f5bdc0c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.471+0000 7f5bdaffd640 1 -- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0c9970 msgr2=0x7f5bdc149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.471+0000 7f5bdb7fe640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0c9970 0x7f5bdc149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.471+0000 7f5bdaffd640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0c9970 0x7f5bdc149350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.471+0000 7f5bdaffd640 1 -- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bdc159a80 msgr2=0x7f5bdc0c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.471+0000 7f5bdaffd640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bdc159a80 0x7f5bdc0c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.471+0000 7f5bdaffd640 1 -- 172.21.15.38:0/3751349484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc00ac40 con 0x7f5bdc0b4280 2023-12-22T08:54:04.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.471+0000 7f5bda7fc640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bdc159a80 0x7f5bdc0c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:04.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.471+0000 7f5bdaffd640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bdc0b4280 0x7f5bdc143e40 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc037040 tx=0x7f5bcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:04.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.471+0000 7f5bd3fff640 1 -- 172.21.15.38:0/3751349484 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc040880 con 0x7f5bdc0b4280 2023-12-22T08:54:04.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.472+0000 7f5bd3fff640 1 -- 172.21.15.38:0/3751349484 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc0409e0 con 0x7f5bdc0b4280 2023-12-22T08:54:04.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.472+0000 7f5bd3fff640 1 -- 172.21.15.38:0/3751349484 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc040d90 con 0x7f5bdc0b4280 2023-12-22T08:54:04.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.472+0000 7f5be192e640 1 -- 172.21.15.38:0/3751349484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bdc0a9250 con 0x7f5bdc0b4280 2023-12-22T08:54:04.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.472+0000 7f5be192e640 1 -- 172.21.15.38:0/3751349484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bdc0aefb0 con 0x7f5bdc0b4280 2023-12-22T08:54:04.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.473+0000 7f5be192e640 1 -- 172.21.15.38:0/3751349484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bdc061910 con 0x7f5bdc0b4280 2023-12-22T08:54:04.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.474+0000 7f5bd3fff640 1 -- 172.21.15.38:0/3751349484 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5bcc03e440 con 0x7f5bdc0b4280 2023-12-22T08:54:04.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.475+0000 7f5bd3fff640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5bbc06a430 0x7f5bbc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.475+0000 7f5bd3fff640 1 -- 172.21.15.38:0/3751349484 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5bcc0abb70 con 0x7f5bdc0b4280 2023-12-22T08:54:04.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.476+0000 7f5bda7fc640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5bbc06a430 0x7f5bbc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.477+0000 7f5bda7fc640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5bbc06a430 0x7f5bbc06c8f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc150300 tx=0x7f5bc4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:04.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.483+0000 7f5bd3fff640 1 -- 172.21.15.38:0/3751349484 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5bcc077460 con 0x7f5bdc0b4280 2023-12-22T08:54:04.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.671+0000 7f5be192e640 1 -- 172.21.15.38:0/3751349484 --> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5bdc159e60 con 0x7f5bbc06a430 2023-12-22T08:54:04.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.678+0000 7f5bd3fff640 1 -- 172.21.15.38:0/3751349484 <== mgr.4101 v2:172.21.15.89:6832/83768 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47601 (secure 0 0 0) 0x7f5bc4009e10 con 0x7f5bbc06a430 2023-12-22T08:54:04.679 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:54:04.680 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-12-22T08:54:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.680+0000 7f5be192e640 1 -- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5bbc06a430 msgr2=0x7f5bbc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.681+0000 7f5be192e640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5bbc06a430 0x7f5bbc06c8f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc150300 tx=0x7f5bc4008040 comp rx=0 tx=0).stop 2023-12-22T08:54:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.681+0000 7f5be192e640 1 -- 172.21.15.38:0/3751349484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bdc0b4280 msgr2=0x7f5bdc143e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.681+0000 7f5be192e640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bdc0b4280 0x7f5bdc143e40 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc037040 tx=0x7f5bcc004a40 comp rx=0 tx=0).stop 2023-12-22T08:54:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.681+0000 7f5be192e640 1 -- 172.21.15.38:0/3751349484 shutdown_connections 2023-12-22T08:54:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.681+0000 7f5be192e640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bdc0c9970 0x7f5bdc149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.681+0000 7f5be192e640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bdc159a80 0x7f5bdc0c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.681+0000 7f5be192e640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f5bbc06a430 0x7f5bbc06c8f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.681+0000 7f5be192e640 1 --2- 172.21.15.38:0/3751349484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bdc0b4280 0x7f5bdc143e40 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.681+0000 7f5be192e640 1 -- 172.21.15.38:0/3751349484 >> 172.21.15.38:0/3751349484 conn(0x7f5bdc0cf070 msgr2=0x7f5bdc0ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.681+0000 7f5be192e640 1 -- 172.21.15.38:0/3751349484 shutdown_connections 2023-12-22T08:54:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.681+0000 7f5be192e640 1 -- 172.21.15.38:0/3751349484 wait complete. 2023-12-22T08:54:04.699 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":617,"stamp":"2023-12-22T08:54:04.667685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9835,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552664,"statfs":{"total":1600000000,"available":1589928755,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003371"},"pg_stats":[{"pgid":"1.0","version":"197'119","reported_seq":339,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-12-22T08:53:59.842081+0000","last_change":"2023-12-22T08:53:59.842164+0000","last_active":"2023-12-22T08:53:59.842081+0000","last_peered":"2023-12-22T08:53:59.842081+0000","last_clean":"2023-12-22T08:53:59.842081+0000","last_became_active":"2023-12-22T08:39:49.860130+0000","last_became_peered":"2023-12-22T08:39:49.860130+0000","last_unstale":"2023-12-22T08:53:59.842081+0000","last_undegraded":"2023-12-22T08:53:59.842081+0000","last_fullsized":"2023-12-22T08:53:59.842081+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"197'119","last_scrub_stamp":"2023-12-22T08:53:59.842053+0000","last_deep_scrub":"197'119","last_deep_scrub_stamp":"2023-12-22T08:53:59.842053+0000","last_clean_scrub_stamp":"2023-12-22T08:53:59.842053+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:43:30.031273+0000","scrub_duration":0.0048956449999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0900000000000001,"15min":1.0880000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58199999999999996},"max":{"1min":1.5309999999999999,"5min":1.8700000000000001,"15min":2.0249999999999999},"last":1.034},{"interface":"front","average":{"1min":1.097,"5min":1.1100000000000001,"15min":1.095},"min":{"1min":0.71799999999999997,"5min":0.71299999999999997,"15min":0.70099999999999996},"max":{"1min":1.3600000000000001,"5min":1.6499999999999999,"15min":1.6819999999999999},"last":0.80200000000000005}]},{"osd":1,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2709999999999999,"15min":1.212},"min":{"1min":0.85599999999999998,"5min":0.70899999999999996,"15min":0.64200000000000002},"max":{"1min":1.671,"5min":1.6779999999999999,"15min":1.905},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.2769999999999999,"15min":1.228},"min":{"1min":0.83399999999999996,"5min":0.78800000000000003,"15min":0.67100000000000004},"max":{"1min":1.5289999999999999,"5min":1.758,"15min":1.865},"last":1.153}]},{"osd":2,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.204,"15min":1.151},"min":{"1min":0.79400000000000004,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.5309999999999999,"5min":1.7150000000000001,"15min":2.0150000000000001},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.2270000000000001,"15min":1.22},"min":{"1min":0.81699999999999995,"5min":0.76100000000000001,"15min":0.68700000000000006},"max":{"1min":1.5640000000000001,"5min":1.7030000000000001,"15min":2.1379999999999999},"last":1.571}]},{"osd":3,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2649999999999999,"15min":1.2050000000000001},"min":{"1min":0.92800000000000005,"5min":0.875,"15min":0.71399999999999997},"max":{"1min":1.5900000000000001,"5min":1.766,"15min":2.0680000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3100000000000001},"min":{"1min":0.98999999999999999,"5min":0.78000000000000003,"15min":0.71799999999999997},"max":{"1min":1.633,"5min":1.778,"15min":2.2959999999999998},"last":1.415}]},{"osd":4,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1879999999999999,"15min":1.2},"min":{"1min":0.79800000000000004,"5min":0.56699999999999995,"15min":0.48699999999999999},"max":{"1min":1.5349999999999999,"5min":1.7430000000000001,"15min":2.0760000000000001},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.282,"15min":1.274},"min":{"1min":0.82399999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6279999999999999,"5min":1.899,"15min":2.2749999999999999},"last":1.625}]},{"osd":5,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.304,"15min":1.355},"min":{"1min":0.99399999999999999,"5min":0.60699999999999998,"15min":0.51800000000000002},"max":{"1min":1.76,"5min":1.8280000000000001,"15min":2.4300000000000002},"last":1.679},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3260000000000001,"15min":1.3620000000000001},"min":{"1min":1.0089999999999999,"5min":0.627,"15min":0.623},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.3410000000000002},"last":1.526}]},{"osd":6,"last update":"Fri Dec 22 08:53:16 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.4990000000000001},"min":{"1min":0.98699999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":2.355},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.4550000000000001,"15min":1.482},"min":{"1min":1.097,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.137,"5min":2.137,"15min":2.4849999999999999},"last":1.716}]}]},{"osd":6,"up_from":13,"seq":55834575021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.123,"15min":1.2230000000000001},"min":{"1min":0.70699999999999996,"5min":0.66000000000000003,"15min":0.42099999999999999},"max":{"1min":1.3799999999999999,"5min":1.6519999999999999,"15min":28.361000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1759999999999999,"15min":1.1519999999999999},"min":{"1min":0.90700000000000003,"5min":0.629,"15min":0.629},"max":{"1min":1.5629999999999999,"5min":1.675,"15min":3.0670000000000002},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.113,"15min":1.0900000000000001},"min":{"1min":0.85299999999999998,"5min":0.71499999999999997,"15min":0.58999999999999997},"max":{"1min":1.655,"5min":1.655,"15min":2.1150000000000002},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.248,"5min":1.234,"15min":1.25},"min":{"1min":0.93200000000000005,"5min":0.74299999999999999,"15min":0.63100000000000001},"max":{"1min":1.762,"5min":1.762,"15min":15.324999999999999},"last":1.1639999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.246,"15min":1.2989999999999999},"min":{"1min":0.94899999999999995,"5min":0.79800000000000004,"15min":0.65700000000000003},"max":{"1min":1.8899999999999999,"5min":1.9259999999999999,"15min":15.422000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.198,"5min":1.23,"15min":1.2490000000000001},"min":{"1min":0.90500000000000003,"5min":0.81100000000000005,"15min":0.58599999999999997},"max":{"1min":1.5620000000000001,"5min":1.7,"15min":10.173999999999999},"last":0.98999999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.29,"15min":1.3320000000000001},"min":{"1min":0.90400000000000003,"5min":0.877,"15min":0.72899999999999998},"max":{"1min":1.6379999999999999,"5min":1.671,"15min":10.096},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.276,"15min":1.258},"min":{"1min":0.86499999999999999,"5min":0.83199999999999996,"15min":0.71399999999999997},"max":{"1min":1.7010000000000001,"5min":1.702,"15min":2.3889999999999998},"last":1.0389999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2470000000000001,"15min":1.3720000000000001},"min":{"1min":0.83199999999999996,"5min":0.64200000000000002,"15min":0.52000000000000002},"max":{"1min":1.794,"5min":1.794,"15min":15.378},"last":1.361},{"interface":"front","average":{"1min":1.383,"5min":1.3400000000000001,"15min":1.4179999999999999},"min":{"1min":1.071,"5min":0.80700000000000005,"15min":0.68999999999999995},"max":{"1min":1.802,"5min":1.802,"15min":13.178000000000001},"last":0.90800000000000003}]},{"osd":5,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.2410000000000001,"15min":1.365},"min":{"1min":0.83399999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.855,"5min":1.855,"15min":19.995000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4339999999999999,"15min":1.5449999999999999},"min":{"1min":1.125,"5min":0.98499999999999999,"15min":0.67600000000000005},"max":{"1min":1.9850000000000001,"5min":2.1989999999999998,"15min":15.679},"last":1.276}]},{"osd":7,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.46,"15min":1.522},"min":{"1min":1.0900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.746,"5min":1.845,"15min":3.2429999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.4610000000000001,"15min":1.4890000000000001},"min":{"1min":1.046,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.927,"5min":1.972,"15min":4.6609999999999996},"last":1.446}]}]},{"osd":5,"up_from":13,"seq":55834575021,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1660,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193651,"statfs":{"total":200000000,"available":198299210,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.155,"15min":1.105},"min":{"1min":0.80200000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6850000000000001,"5min":1.8939999999999999,"15min":1.944},"last":1.111},{"interface":"front","average":{"1min":1.103,"5min":1.1479999999999999,"15min":1.121},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.65300000000000002},"max":{"1min":1.51,"5min":1.9279999999999999,"15min":3.1379999999999999},"last":1.444}]},{"osd":1,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1739999999999999,"15min":1.139},"min":{"1min":0.67400000000000004,"5min":0.625,"15min":0.625},"max":{"1min":1.4159999999999999,"5min":1.714,"15min":2.79},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1950000000000001,"15min":1.109},"min":{"1min":0.82299999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.462,"5min":1.7430000000000001,"15min":1.7509999999999999},"last":1.5049999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1850000000000001,"15min":1.1579999999999999},"min":{"1min":0.77200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.403,"5min":1.675,"15min":1.8819999999999999},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2949999999999999,"15min":1.2330000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.74299999999999999},"max":{"1min":1.552,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.2070000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2549999999999999,"15min":1.222},"min":{"1min":0.85899999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5920000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.327,"15min":1.284},"min":{"1min":0.74199999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.772,"5min":1.875,"15min":2.1499999999999999},"last":1.3560000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2709999999999999,"15min":1.2569999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.57899999999999996},"max":{"1min":1.583,"5min":1.8380000000000001,"15min":1.853},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2769999999999999,"15min":1.2629999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"max":{"1min":1.5600000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.6699999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3420000000000001,"15min":1.3280000000000001},"min":{"1min":0.65200000000000002,"5min":0.55300000000000005,"15min":0.54600000000000004},"max":{"1min":1.663,"5min":1.792,"15min":1.821},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.4219999999999999,"15min":1.4119999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.601,"5min":1.952,"15min":2.8780000000000001},"last":1.546}]},{"osd":7,"last update":"Fri Dec 22 08:53:13 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.4079999999999999,"15min":1.3999999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.673,"5min":2.0960000000000001,"15min":2.2189999999999999},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4770000000000001,"15min":1.498},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9139999999999999,"5min":2.056,"15min":4.7249999999999996},"last":1.6399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.1180000000000001,"15min":1.0529999999999999},"min":{"1min":0.66600000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3540000000000001,"5min":6.4969999999999999,"15min":6.4969999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1499999999999999,"15min":1.1279999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.58199999999999996},"max":{"1min":1.4910000000000001,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":1.0609999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.171,"15min":1.111},"min":{"1min":0.86599999999999999,"5min":0.63200000000000001,"15min":0.54100000000000004},"max":{"1min":1.679,"5min":6.2999999999999998,"15min":6.2999999999999998},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.3280000000000001,"15min":1.1819999999999999},"min":{"1min":0.82199999999999995,"5min":0.79100000000000004,"15min":0.57399999999999995},"max":{"1min":1.4430000000000001,"5min":17.562999999999999,"15min":17.562999999999999},"last":0.84499999999999997}]},{"osd":2,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.262,"15min":1.1899999999999999},"min":{"1min":0.86299999999999999,"5min":0.78600000000000003,"15min":0.65700000000000003},"max":{"1min":1.4770000000000001,"5min":9.0329999999999995,"15min":9.0329999999999995},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.3049999999999999,"15min":1.246},"min":{"1min":0.85099999999999998,"5min":0.748,"15min":0.748},"max":{"1min":1.6180000000000001,"5min":8.2029999999999994,"15min":8.2029999999999994},"last":1.321}]},{"osd":3,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3400000000000001,"15min":1.256},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.68500000000000005},"max":{"1min":1.5469999999999999,"5min":8.8160000000000007,"15min":8.8160000000000007},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.351,"5min":1.385,"15min":1.3100000000000001},"min":{"1min":1.0620000000000001,"5min":0.82299999999999995,"15min":0.82099999999999995},"max":{"1min":1.714,"5min":10.157999999999999,"15min":10.157999999999999},"last":1.2}]},{"osd":5,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.266,"15min":1.2010000000000001},"min":{"1min":0.79400000000000004,"5min":0.67900000000000005,"15min":0.52400000000000002},"max":{"1min":1.6899999999999999,"5min":7.056,"15min":7.056},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.4990000000000001,"15min":1.4399999999999999},"min":{"1min":1.0449999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.5920000000000001,"5min":9.0700000000000003,"15min":9.0700000000000003},"last":1.2629999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.363,"15min":1.3200000000000001},"min":{"1min":0.82499999999999996,"5min":0.62,"15min":0.58599999999999997},"max":{"1min":1.8049999999999999,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":1.375},{"interface":"front","average":{"1min":1.345,"5min":1.3600000000000001,"15min":1.302},"min":{"1min":0.95899999999999996,"5min":0.82399999999999995,"15min":0.59199999999999997},"max":{"1min":2.052,"5min":5.2089999999999996,"15min":5.2089999999999996},"last":1.474}]},{"osd":7,"last update":"Fri Dec 22 08:53:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4910000000000001,"15min":1.4339999999999999},"min":{"1min":1.022,"5min":0.70199999999999996,"15min":0.67300000000000004},"max":{"1min":1.7170000000000001,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":1.788},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.581,"15min":1.5149999999999999},"min":{"1min":1.3680000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.8740000000000001,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.516}]}]},{"osd":3,"up_from":13,"seq":55834575021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.39800000000000002},"max":{"1min":1.4139999999999999,"5min":1.4770000000000001,"15min":1.8340000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.999,"15min":0.95099999999999996},"min":{"1min":0.65900000000000003,"5min":0.44,"15min":0.38900000000000001},"max":{"1min":1.482,"5min":1.5249999999999999,"15min":2.5270000000000001},"last":0.87}]},{"osd":1,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.002,"15min":0.91900000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.34499999999999997},"max":{"1min":1.3999999999999999,"5min":1.772,"15min":1.772},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.252,"15min":1.1830000000000001},"min":{"1min":0.754,"5min":0.53700000000000003,"15min":0.46200000000000002},"max":{"1min":1.6619999999999999,"5min":1.825,"15min":1.861},"last":1.333}]},{"osd":2,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1619999999999999,"15min":1.079},"min":{"1min":0.64400000000000002,"5min":0.625,"15min":0.41899999999999998},"max":{"1min":1.619,"5min":1.659,"15min":1.7350000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.1990000000000001,"15min":1.165},"min":{"1min":0.77600000000000002,"5min":0.69799999999999995,"15min":0.45100000000000001},"max":{"1min":1.6859999999999999,"5min":1.8120000000000001,"15min":1.9570000000000001},"last":1.2090000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2450000000000001,"15min":1.2290000000000001},"min":{"1min":0.83299999999999996,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5900000000000001,"5min":1.6870000000000001,"15min":2.7210000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.351,"15min":1.296},"min":{"1min":0.96799999999999997,"5min":0.873,"15min":0.745},"max":{"1min":1.546,"5min":1.9850000000000001,"15min":2.3999999999999999},"last":1.407}]},{"osd":5,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4259999999999999,"15min":1.349},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.66700000000000004},"max":{"1min":1.6950000000000001,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.171},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.411,"15min":1.399},"min":{"1min":1.0009999999999999,"5min":0.78600000000000003,"15min":0.73699999999999999},"max":{"1min":1.762,"5min":2.2629999999999999,"15min":2.3839999999999999},"last":1.2769999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4890000000000001,"15min":1.4550000000000001},"min":{"1min":1.099,"5min":1.008,"15min":0.88100000000000001},"max":{"1min":1.768,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.4059999999999999,"15min":1.379},"min":{"1min":0.97299999999999998,"5min":0.84899999999999998,"15min":0.75900000000000001},"max":{"1min":1.9590000000000001,"5min":1.968,"15min":2.8250000000000002},"last":1.2310000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:53:17 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4770000000000001,"15min":1.419},"min":{"1min":1.0409999999999999,"5min":0.91600000000000004,"15min":0.77100000000000002},"max":{"1min":1.891,"5min":2.056,"15min":2.7850000000000001},"last":1.361},{"interface":"front","average":{"1min":1.476,"5min":1.5189999999999999,"15min":1.452},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.80600000000000005},"max":{"1min":1.869,"5min":2.2290000000000001,"15min":2.3740000000000001},"last":1.304}]}]},{"osd":2,"up_from":13,"seq":55834575021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88400000000000001,"15min":0.86199999999999999},"min":{"1min":0.57299999999999995,"5min":0.432,"15min":0.32000000000000001},"max":{"1min":1.278,"5min":1.8340000000000001,"15min":6.8879999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.03,"5min":0.98899999999999999,"15min":0.94899999999999995},"min":{"1min":0.64700000000000002,"5min":0.39100000000000001,"15min":0.35799999999999998},"max":{"1min":1.5389999999999999,"5min":1.7589999999999999,"15min":4.5510000000000002},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.92600000000000005,"15min":0.95599999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":11.308999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.111,"15min":1.046},"min":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.44600000000000001},"max":{"1min":1.4650000000000001,"5min":1.738,"15min":2.9889999999999999},"last":0.83599999999999997}]},{"osd":3,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.179,"15min":1.135},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":1.6439999999999999,"5min":1.772,"15min":13.087999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.246,"15min":1.23},"min":{"1min":0.71899999999999997,"5min":0.61299999999999999,"15min":0.52300000000000002},"max":{"1min":1.585,"5min":2.0720000000000001,"15min":12.289999999999999},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.369,"15min":1.3420000000000001},"min":{"1min":1.0660000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":3.5249999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.337},"min":{"1min":0.83799999999999997,"5min":0.80500000000000005,"15min":0.61499999999999999},"max":{"1min":1.871,"5min":2.0539999999999998,"15min":13.927},"last":1.3779999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3819999999999999,"15min":1.3759999999999999},"min":{"1min":1.0489999999999999,"5min":0.70299999999999996,"15min":0.64000000000000001},"max":{"1min":1.724,"5min":1.9750000000000001,"15min":11.003},"last":1.548},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3600000000000001,"15min":1.347},"min":{"1min":1.002,"5min":0.504,"15min":0.504},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":13.129},"last":1.0469999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.389,"15min":1.371},"min":{"1min":0.88500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.8999999999999999,"5min":1.978,"15min":8.1609999999999996},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.498,"15min":1.464},"min":{"1min":0.93899999999999995,"5min":0.89900000000000002,"15min":0.69999999999999996},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":6.8150000000000004},"last":0.88300000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:53:24 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4419999999999999,"15min":1.425},"min":{"1min":0.78600000000000003,"5min":0.76200000000000001,"15min":0.61299999999999999},"max":{"1min":2.0270000000000001,"5min":2.1309999999999998,"15min":10.948},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.4950000000000001,"15min":1.496},"min":{"1min":1.0780000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":9.0239999999999991},"last":1.4079999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575021,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1661,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193650,"statfs":{"total":200000000,"available":198298191,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":0.98499999999999999},"min":{"1min":0.56499999999999995,"5min":0.36899999999999999,"15min":0.36199999999999999},"max":{"1min":2.5680000000000001,"5min":23.059000000000001,"15min":23.059000000000001},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.026,"5min":1.1819999999999999,"15min":1.1140000000000001},"min":{"1min":0.59799999999999998,"5min":0.41099999999999998,"15min":0.39900000000000002},"max":{"1min":1.3939999999999999,"5min":9.9749999999999996,"15min":9.9749999999999996},"last":0.79700000000000004}]},{"osd":2,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.286,"15min":1.0700000000000001},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.45500000000000002},"max":{"1min":7.9880000000000004,"5min":22.977,"15min":22.977},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.117,"15min":1.034},"min":{"1min":0.52300000000000002,"5min":0.48999999999999999,"15min":0.34999999999999998},"max":{"1min":9.4440000000000008,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.61799999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.3400000000000001,"15min":1.274},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.51800000000000002},"max":{"1min":1.7050000000000001,"5min":1.9770000000000001,"15min":2.5169999999999999},"last":1.246},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.1499999999999999,"15min":1.0580000000000001},"min":{"1min":0.622,"5min":0.58699999999999997,"15min":0.47799999999999998},"max":{"1min":5.3470000000000004,"5min":5.3470000000000004,"15min":5.3470000000000004},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.5229999999999999,"15min":1.3600000000000001},"min":{"1min":0.82399999999999995,"5min":0.73999999999999999,"15min":0.58699999999999997},"max":{"1min":2.7069999999999999,"5min":23.145,"15min":23.145},"last":1.367},{"interface":"front","average":{"1min":1.345,"5min":1.5209999999999999,"15min":1.431},"min":{"1min":0.89200000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.6699999999999999,"5min":9.9299999999999997,"15min":9.9299999999999997},"last":1.2050000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.323,"15min":1.278},"min":{"1min":0.80300000000000005,"5min":0.77700000000000002,"15min":0.58699999999999997},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":4.6399999999999997},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.6180000000000001,"15min":1.4510000000000001},"min":{"1min":0.90400000000000003,"5min":0.71699999999999997,"15min":0.66800000000000004},"max":{"1min":2.758,"5min":23.105,"15min":23.105},"last":1.458}]},{"osd":6,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.381,"15min":1.3340000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.65200000000000002},"max":{"1min":3.3380000000000001,"5min":3.3380000000000001,"15min":4.5819999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.486,"5min":1.726,"15min":1.516},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.67200000000000004},"max":{"1min":2.657,"5min":24.341999999999999,"15min":24.341999999999999},"last":1.175}]},{"osd":7,"last update":"Fri Dec 22 08:53:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4390000000000001,"15min":1.4339999999999999},"min":{"1min":0.88400000000000001,"5min":0.78800000000000003,"15min":0.64400000000000002},"max":{"1min":1.732,"5min":2.0870000000000002,"15min":2.4889999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.514,"5min":1.472,"15min":1.4430000000000001},"min":{"1min":0.96199999999999997,"5min":0.82099999999999995,"15min":0.66200000000000003},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":4.508},"last":1.137}]}]},{"osd":0,"up_from":13,"seq":55834575021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":0.94699999999999995,"15min":0.84699999999999998},"min":{"1min":0.61399999999999999,"5min":0.432,"15min":0.36599999999999999},"max":{"1min":7.3499999999999996,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.042,"15min":0.96399999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.33700000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.0660000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90300000000000002,"15min":0.85599999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.373},"max":{"1min":1.617,"5min":1.617,"15min":1.6739999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.056,"15min":1.02},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.40000000000000002},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":2.1219999999999999},"last":0.92600000000000005}]},{"osd":3,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.288,"15min":1.1599999999999999},"min":{"1min":0.65200000000000002,"5min":0.56299999999999994,"15min":0.44500000000000001},"max":{"1min":7.6550000000000002,"5min":7.6550000000000002,"15min":7.6550000000000002},"last":1.212},{"interface":"front","average":{"1min":1.24,"5min":1.3280000000000001,"15min":1.2090000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.39100000000000001},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":2.145},"last":1.3149999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0049999999999999,"5min":1.4910000000000001,"15min":1.367},"min":{"1min":0.88,"5min":0.81200000000000006,"15min":0.70799999999999996},"max":{"1min":7.7370000000000001,"5min":7.7370000000000001,"15min":7.7370000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.609,"5min":1.4370000000000001,"15min":1.335},"min":{"1min":0.93500000000000005,"5min":0.82999999999999996,"15min":0.70599999999999996},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":1.117}]},{"osd":5,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.335},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.59299999999999997},"max":{"1min":2.843,"5min":2.843,"15min":5.4290000000000003},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.831,"5min":1.46,"15min":1.361},"min":{"1min":1.048,"5min":0.85799999999999998,"15min":0.73599999999999999},"max":{"1min":7.8579999999999997,"5min":7.8579999999999997,"15min":7.8579999999999997},"last":1.044}]},{"osd":6,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.4019999999999999,"15min":1.353},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.64800000000000002},"max":{"1min":1.7609999999999999,"5min":1.9330000000000001,"15min":2.4420000000000002},"last":1.484},{"interface":"front","average":{"1min":1.458,"5min":1.52,"15min":1.4610000000000001},"min":{"1min":0.97099999999999997,"5min":0.95799999999999996,"15min":0.69099999999999995},"max":{"1min":2.1070000000000002,"5min":2.109,"15min":2.577},"last":1.429}]},{"osd":7,"last update":"Fri Dec 22 08:53:23 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.508,"15min":1.4430000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.755},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":1.27},{"interface":"front","average":{"1min":1.9810000000000001,"5min":1.595,"15min":1.4770000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":7.8029999999999999,"5min":7.8029999999999999,"15min":7.8029999999999999},"last":1.2450000000000001}]}]}],"pool_statfs":[]}} 2023-12-22T08:54:04.703 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-22T08:54:04.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.924+0000 7f25855c4640 1 Processor -- start 2023-12-22T08:54:04.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.925+0000 7f25855c4640 1 -- start start 2023-12-22T08:54:04.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.926+0000 7f25855c4640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f258015ad90 0x7f25800caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.926+0000 7f25855c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f258015e050 0x7f25800cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.926+0000 7f25855c4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258015e630 con 0x7f2580161bb0 2023-12-22T08:54:04.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.926+0000 7f25855c4640 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25800ce2c0 con 0x7f258015ad90 2023-12-22T08:54:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.926+0000 7f25855c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258015e910 con 0x7f258015e050 2023-12-22T08:54:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.926+0000 7f257ffff640 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f258015ad90 0x7f25800caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.926+0000 7f257f7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2580161bb0 0x7f258015d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52872/0 (socket says 172.21.15.38:52872) 2023-12-22T08:54:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.926+0000 7f257f7fe640 1 -- 172.21.15.38:0/611465461 learned_addr learned my addr 172.21.15.38:0/611465461 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:54:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.927+0000 7f2584dc3640 1 --2- 172.21.15.38:0/611465461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f258015e050 0x7f25800cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.927+0000 7f257ffff640 1 -- 172.21.15.38:0/611465461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f258015e050 msgr2=0x7f25800cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.927+0000 7f257ffff640 1 --2- 172.21.15.38:0/611465461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f258015e050 0x7f25800cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.927+0000 7f257ffff640 1 -- 172.21.15.38:0/611465461 >> v1:172.21.15.38:6789/0 conn(0x7f2580161bb0 legacy=0x7f258015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.927+0000 7f257ffff640 1 -- 172.21.15.38:0/611465461 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25801610d0 con 0x7f258015ad90 2023-12-22T08:54:04.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.927+0000 7f257effd640 1 -- 172.21.15.38:0/611465461 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650431380 0 0) 0x7f258015e630 con 0x7f2580161bb0 2023-12-22T08:54:04.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.928+0000 7f257ffff640 1 --2- 172.21.15.38:0/611465461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f258015ad90 0x7f25800caed0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f2570009dc0 tx=0x7f257002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58eb30560df0c0c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:04.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.928+0000 7f257effd640 1 -- 172.21.15.38:0/611465461 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257002cc40 con 0x7f258015ad90 2023-12-22T08:54:04.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.928+0000 7f257effd640 1 -- 172.21.15.38:0/611465461 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257002cda0 con 0x7f258015ad90 2023-12-22T08:54:04.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.928+0000 7f257effd640 1 -- 172.21.15.38:0/611465461 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570034660 con 0x7f258015ad90 2023-12-22T08:54:04.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.929+0000 7f25855c4640 1 -- 172.21.15.38:0/611465461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f258015ad90 msgr2=0x7f25800caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.929+0000 7f25855c4640 1 --2- 172.21.15.38:0/611465461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f258015ad90 0x7f25800caed0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f2570009dc0 tx=0x7f257002be90 comp rx=0 tx=0).stop 2023-12-22T08:54:04.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.929+0000 7f25855c4640 1 -- 172.21.15.38:0/611465461 shutdown_connections 2023-12-22T08:54:04.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.929+0000 7f25855c4640 1 --2- 172.21.15.38:0/611465461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f258015e050 0x7f25800cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.929+0000 7f25855c4640 1 --2- 172.21.15.38:0/611465461 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f258015ad90 0x7f25800caed0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.929+0000 7f25855c4640 1 -- 172.21.15.38:0/611465461 >> 172.21.15.38:0/611465461 conn(0x7f25800d31c0 msgr2=0x7f25800d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:04.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.929+0000 7f25855c4640 1 -- 172.21.15.38:0/611465461 shutdown_connections 2023-12-22T08:54:04.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.929+0000 7f25855c4640 1 -- 172.21.15.38:0/611465461 wait complete. 2023-12-22T08:54:04.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.931+0000 7f25855c4640 1 Processor -- start 2023-12-22T08:54:04.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.931+0000 7f25855c4640 1 -- start start 2023-12-22T08:54:04.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.932+0000 7f25855c4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f258015ad90 0x7f25801f6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.932+0000 7f25855c4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f258015e050 0x7f25800b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.932+0000 7f25855c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2580161bb0 0x7f2580157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.932+0000 7f25855c4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25800c68a0 con 0x7f258015e050 2023-12-22T08:54:04.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.932+0000 7f25855c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2580156e00 con 0x7f2580161bb0 2023-12-22T08:54:04.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.932+0000 7f25855c4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25801f6b50 con 0x7f258015ad90 2023-12-22T08:54:04.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.932+0000 7f257f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f258015e050 0x7f25800b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.932+0000 7f257f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f258015e050 0x7f25800b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33224/0 (socket says 172.21.15.38:33224) 2023-12-22T08:54:04.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.932+0000 7f257f7fe640 1 -- 172.21.15.38:0/4014917450 learned_addr learned my addr 172.21.15.38:0/4014917450 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:04.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.932+0000 7f257ffff640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f258015ad90 0x7f25801f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.933+0000 7f257f7fe640 1 -- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f258015ad90 msgr2=0x7f25801f6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.933+0000 7f257f7fe640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f258015ad90 0x7f25801f6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.933+0000 7f257f7fe640 1 -- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2580161bb0 msgr2=0x7f2580157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:04.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.933+0000 7f257f7fe640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2580161bb0 0x7f2580157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:04.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.933+0000 7f257f7fe640 1 -- 172.21.15.38:0/4014917450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570009a70 con 0x7f258015e050 2023-12-22T08:54:04.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.933+0000 7f257ffff640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f258015ad90 0x7f25801f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:04.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.933+0000 7f257f7fe640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f258015e050 0x7f25800b2560 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f256800c460 tx=0x7f256800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.933+0000 7f257cff9640 1 -- 172.21.15.38:0/4014917450 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25680074e0 con 0x7f258015e050 2023-12-22T08:54:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.933+0000 7f257cff9640 1 -- 172.21.15.38:0/4014917450 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2568007660 con 0x7f258015e050 2023-12-22T08:54:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.933+0000 7f25855c4640 1 -- 172.21.15.38:0/4014917450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25800b2aa0 con 0x7f258015e050 2023-12-22T08:54:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.933+0000 7f257cff9640 1 -- 172.21.15.38:0/4014917450 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568004a20 con 0x7f258015e050 2023-12-22T08:54:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.933+0000 7f25855c4640 1 -- 172.21.15.38:0/4014917450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2580157330 con 0x7f258015e050 2023-12-22T08:54:04.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.935+0000 7f25855c4640 1 -- 172.21.15.38:0/4014917450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2580061910 con 0x7f258015e050 2023-12-22T08:54:04.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.935+0000 7f257cff9640 1 -- 172.21.15.38:0/4014917450 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2568004b80 con 0x7f258015e050 2023-12-22T08:54:04.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.936+0000 7f257cff9640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f256006a430 0x7f256006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:04.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.936+0000 7f257cff9640 1 -- 172.21.15.38:0/4014917450 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2568087a90 con 0x7f258015e050 2023-12-22T08:54:04.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.937+0000 7f257ffff640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f256006a430 0x7f256006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:04.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.938+0000 7f257ffff640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f256006a430 0x7f256006c8f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2570036000 tx=0x7f2570030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:04.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:04.941+0000 7f257cff9640 1 -- 172.21.15.38:0/4014917450 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2568053380 con 0x7f258015e050 2023-12-22T08:54:05.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.137+0000 7f25855c4640 1 -- 172.21.15.38:0/4014917450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f25800c6ad0 con 0x7f258015e050 2023-12-22T08:54:05.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.144+0000 7f257cff9640 1 -- 172.21.15.38:0/4014917450 <== mon.0 v2:172.21.15.38:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2568001170 con 0x7f258015e050 2023-12-22T08:54:05.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.144+0000 7f257cff9640 1 -- 172.21.15.38:0/4014917450 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f25680180c0 con 0x7f258015e050 2023-12-22T08:54:05.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.147+0000 7f25855c4640 1 -- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f256006a430 msgr2=0x7f256006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:05.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.147+0000 7f25855c4640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f256006a430 0x7f256006c8f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2570036000 tx=0x7f2570030000 comp rx=0 tx=0).stop 2023-12-22T08:54:05.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.147+0000 7f25855c4640 1 -- 172.21.15.38:0/4014917450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f258015e050 msgr2=0x7f25800b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.147+0000 7f25855c4640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f258015e050 0x7f25800b2560 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f256800c460 tx=0x7f256800c920 comp rx=0 tx=0).stop 2023-12-22T08:54:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.147+0000 7f25855c4640 1 -- 172.21.15.38:0/4014917450 shutdown_connections 2023-12-22T08:54:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.147+0000 7f25855c4640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2580161bb0 0x7f2580157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.147+0000 7f25855c4640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f256006a430 0x7f256006c8f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.148+0000 7f25855c4640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f258015e050 0x7f25800b2560 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.148+0000 7f25855c4640 1 --2- 172.21.15.38:0/4014917450 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f258015ad90 0x7f25801f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.148+0000 7f25855c4640 1 -- 172.21.15.38:0/4014917450 >> 172.21.15.38:0/4014917450 conn(0x7f25800d31c0 msgr2=0x7f25800cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.148+0000 7f25855c4640 1 -- 172.21.15.38:0/4014917450 shutdown_connections 2023-12-22T08:54:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.148+0000 7f25855c4640 1 -- 172.21.15.38:0/4014917450 wait complete. 2023-12-22T08:54:05.169 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:54:05.170 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:54:05.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.395+0000 7f95b6181640 1 Processor -- start 2023-12-22T08:54:05.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.395+0000 7f95b6181640 1 -- start start 2023-12-22T08:54:05.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.397+0000 7f95b6181640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b00b2050 0x7f95b00b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:05.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.397+0000 7f95b6181640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b01450f0 con 0x7f95b0144d10 2023-12-22T08:54:05.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.397+0000 7f95b6181640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b00b29f0 con 0x7f95b0070800 2023-12-22T08:54:05.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.397+0000 7f95b6181640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00cc840 con 0x7f95b00b2050 2023-12-22T08:54:05.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.397+0000 7f95af7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f95b0144d10 0x7f95b00cc130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:52882/0 (socket says 172.21.15.38:52882) 2023-12-22T08:54:05.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.397+0000 7f95af7fe640 1 -- 172.21.15.38:0/3573627957 learned_addr learned my addr 172.21.15.38:0/3573627957 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-12-22T08:54:05.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.398+0000 7f95aeffd640 1 --2- 172.21.15.38:0/3573627957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b00b2050 0x7f95b00b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:05.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.398+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778966330 0 0) 0x7f95b01450f0 con 0x7f95b0144d10 2023-12-22T08:54:05.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.398+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9598003520 con 0x7f95b0144d10 2023-12-22T08:54:05.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.398+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 719929175 0 0) 0x7f9598003520 con 0x7f95b0144d10 2023-12-22T08:54:05.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.398+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b00b2050 msgr2=0x7f95b00b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:05.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.398+0000 7f95ae7fc640 1 --2- 172.21.15.38:0/3573627957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b00b2050 0x7f95b00b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.398+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 >> v1:172.21.15.89:6789/0 conn(0x7f95b0070800 legacy=0x7f95b0070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:05.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.398+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b00ce010 con 0x7f95b0144d10 2023-12-22T08:54:05.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.398+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3764248953 0 0) 0x7f95a0001670 con 0x7f95b0144d10 2023-12-22T08:54:05.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.398+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 >> v1:172.21.15.38:6789/0 conn(0x7f95b0144d10 legacy=0x7f95b00cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:05.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.398+0000 7f95ae7fc640 1 --2- 172.21.15.38:0/3573627957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b00b2050 0x7f95980039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:05.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.398+0000 7f95ae7fc640 1 --2- 172.21.15.38:0/3573627957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9598003f20 0x7f95980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:05.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.399+0000 7f95ae7fc640 1 --2- 172.21.15.38:0/3573627957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9598004d00 0x7f9598005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:05.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.399+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00cc840 con 0x7f9598004d00 2023-12-22T08:54:05.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.399+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959800ba60 con 0x7f9598003f20 2023-12-22T08:54:05.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.399+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959800bc20 con 0x7f95b00b2050 2023-12-22T08:54:05.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.399+0000 7f95affff640 1 --2- 172.21.15.38:0/3573627957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9598004d00 0x7f9598005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:05.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.399+0000 7f95af7fe640 1 --2- 172.21.15.38:0/3573627957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b00b2050 0x7f95980039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:05.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.399+0000 7f95aeffd640 1 --2- 172.21.15.38:0/3573627957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9598003f20 0x7f95980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:05.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.399+0000 7f95affff640 1 -- 172.21.15.38:0/3573627957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b00b2050 msgr2=0x7f95980039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:05.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.399+0000 7f95affff640 1 --2- 172.21.15.38:0/3573627957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b00b2050 0x7f95980039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.399+0000 7f95affff640 1 -- 172.21.15.38:0/3573627957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9598003f20 msgr2=0x7f95980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:54:05.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.399+0000 7f95affff640 1 --2- 172.21.15.38:0/3573627957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9598003f20 0x7f95980047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.399+0000 7f95affff640 1 -- 172.21.15.38:0/3573627957 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598003520 con 0x7f9598004d00 2023-12-22T08:54:05.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.400+0000 7f95affff640 1 --2- 172.21.15.38:0/3573627957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9598004d00 0x7f9598005180 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001e50 tx=0x7f95980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ae3f16daaa6b45 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:05.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.401+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8003b70 con 0x7f9598004d00 2023-12-22T08:54:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.401+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f95a8003cd0 con 0x7f9598004d00 2023-12-22T08:54:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.401+0000 7f95ae7fc640 1 -- 172.21.15.38:0/3573627957 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8005330 con 0x7f9598004d00 2023-12-22T08:54:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.401+0000 7f95b6181640 1 -- 172.21.15.38:0/3573627957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9598004d00 msgr2=0x7f9598005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.401+0000 7f95b6181640 1 --2- 172.21.15.38:0/3573627957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9598004d00 0x7f9598005180 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f95a8001e50 tx=0x7f95980057f0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.401+0000 7f95affff640 1 -- 172.21.15.38:0/3573627957 reap_dead start 2023-12-22T08:54:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.401+0000 7f95b6181640 1 -- 172.21.15.38:0/3573627957 shutdown_connections 2023-12-22T08:54:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.401+0000 7f95b6181640 1 -- 172.21.15.38:0/3573627957 >> 172.21.15.38:0/3573627957 conn(0x7f95b00cf070 msgr2=0x7f95b00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.402+0000 7f95b6181640 1 -- 172.21.15.38:0/3573627957 shutdown_connections 2023-12-22T08:54:05.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.402+0000 7f95b6181640 1 -- 172.21.15.38:0/3573627957 wait complete. 2023-12-22T08:54:05.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.403+0000 7f95b6181640 1 Processor -- start 2023-12-22T08:54:05.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.403+0000 7f95b6181640 1 -- start start 2023-12-22T08:54:05.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.404+0000 7f95b6181640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9598004d00 0x7f95b0143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:05.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.404+0000 7f95b6181640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95b0158190 0x7f95b01585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:05.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.404+0000 7f95b6181640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b0156340 0x7f95b01567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:05.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.404+0000 7f95b6181640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0158b30 con 0x7f95b0158190 2023-12-22T08:54:05.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.404+0000 7f95b6181640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b01e5fc0 con 0x7f9598004d00 2023-12-22T08:54:05.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.404+0000 7f95b6181640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0156d00 con 0x7f95b0156340 2023-12-22T08:54:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.405+0000 7f95aeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95b0158190 0x7f95b01585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.405+0000 7f95aeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95b0158190 0x7f95b01585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33250/0 (socket says 172.21.15.38:33250) 2023-12-22T08:54:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.405+0000 7f95aeffd640 1 -- 172.21.15.38:0/1164461558 learned_addr learned my addr 172.21.15.38:0/1164461558 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-12-22T08:54:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.405+0000 7f95af7fe640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9598004d00 0x7f95b0143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.405+0000 7f95affff640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b0156340 0x7f95b01567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.405+0000 7f95aeffd640 1 -- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b0156340 msgr2=0x7f95b01567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.405+0000 7f95aeffd640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b0156340 0x7f95b01567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.405+0000 7f95aeffd640 1 -- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9598004d00 msgr2=0x7f95b0143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.405+0000 7f95aeffd640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9598004d00 0x7f95b0143ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.405+0000 7f95aeffd640 1 -- 172.21.15.38:0/1164461558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0158d50 con 0x7f95b0158190 2023-12-22T08:54:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.405+0000 7f95af7fe640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9598004d00 0x7f95b0143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.405+0000 7f95affff640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b0156340 0x7f95b01567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:54:05.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.406+0000 7f95aeffd640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95b0158190 0x7f95b01585f0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f95a4010860 tx=0x7f95a4010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:05.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.406+0000 7f9597fff640 1 -- 172.21.15.38:0/1164461558 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4009610 con 0x7f95b0158190 2023-12-22T08:54:05.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.406+0000 7f9597fff640 1 -- 172.21.15.38:0/1164461558 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f95a400eb60 con 0x7f95b0158190 2023-12-22T08:54:05.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.406+0000 7f9597fff640 1 -- 172.21.15.38:0/1164461558 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a401c400 con 0x7f95b0158190 2023-12-22T08:54:05.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.406+0000 7f95b6181640 1 -- 172.21.15.38:0/1164461558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b0159030 con 0x7f95b0158190 2023-12-22T08:54:05.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.406+0000 7f95b6181640 1 -- 172.21.15.38:0/1164461558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b0159310 con 0x7f95b0158190 2023-12-22T08:54:05.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.407+0000 7f95b6181640 1 -- 172.21.15.38:0/1164461558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b0061910 con 0x7f95b0158190 2023-12-22T08:54:05.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.408+0000 7f9597fff640 1 -- 172.21.15.38:0/1164461558 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f95a401c560 con 0x7f95b0158190 2023-12-22T08:54:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.409+0000 7f9597fff640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959c06a480 0x7f959c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:54:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.409+0000 7f9597fff640 1 -- 172.21.15.38:0/1164461558 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f95a4088d10 con 0x7f95b0158190 2023-12-22T08:54:05.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.410+0000 7f95af7fe640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959c06a480 0x7f959c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:54:05.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.411+0000 7f95af7fe640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959c06a480 0x7f959c06c940 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f95a0001c80 tx=0x7f95a0001d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:54:05.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.414+0000 7f9597fff640 1 -- 172.21.15.38:0/1164461558 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f95a408e020 con 0x7f95b0158190 2023-12-22T08:54:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.644+0000 7f95b6181640 1 -- 172.21.15.38:0/1164461558 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95b00cb8e0 con 0x7f95b0158190 2023-12-22T08:54:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.645+0000 7f9597fff640 1 -- 172.21.15.38:0/1164461558 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f95a4054570 con 0x7f95b0158190 2023-12-22T08:54:05.646 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-12-22T08:54:05.646 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":88,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2952705616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2952705616},{"type":"v1","addr":"172.21.15.89:6835","nonce":2952705616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/3842752964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":3842752964},{"type":"v1","addr":"172.21.15.89:6837","nonce":3842752964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6834/261655608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":261655608},{"type":"v1","addr":"172.21.15.38:6834","nonce":261655608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9312,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/428443581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6833","nonce":428443581},{"type":"v1","addr":"172.21.15.38:6835","nonce":428443581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[]} 2023-12-22T08:54:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 88 2023-12-22T08:54:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.647+0000 7f95b6181640 1 -- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959c06a480 msgr2=0x7f959c06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.648+0000 7f95b6181640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959c06a480 0x7f959c06c940 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f95a0001c80 tx=0x7f95a0001d70 comp rx=0 tx=0).stop 2023-12-22T08:54:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.648+0000 7f95b6181640 1 -- 172.21.15.38:0/1164461558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95b0158190 msgr2=0x7f95b01585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:54:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.648+0000 7f95b6181640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95b0158190 0x7f95b01585f0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f95a4010860 tx=0x7f95a4010d20 comp rx=0 tx=0).stop 2023-12-22T08:54:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.648+0000 7f95b6181640 1 -- 172.21.15.38:0/1164461558 shutdown_connections 2023-12-22T08:54:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.648+0000 7f95b6181640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95b0156340 0x7f95b01567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.648+0000 7f95b6181640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:6832/83768,v1:172.21.15.89:6833/83768] conn(0x7f959c06a480 0x7f959c06c940 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.648+0000 7f95b6181640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95b0158190 0x7f95b01585f0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.648+0000 7f95b6181640 1 --2- 172.21.15.38:0/1164461558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9598004d00 0x7f95b0143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:54:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.648+0000 7f95b6181640 1 -- 172.21.15.38:0/1164461558 >> 172.21.15.38:0/1164461558 conn(0x7f95b00cf070 msgr2=0x7f95b0142300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:54:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.648+0000 7f95b6181640 1 -- 172.21.15.38:0/1164461558 shutdown_connections 2023-12-22T08:54:05.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-12-22T08:54:05.648+0000 7f95b6181640 1 -- 172.21.15.38:0/1164461558 wait complete. 2023-12-22T08:54:05.670 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-22T08:54:05.670 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-22T08:54:05.670 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T08:54:05.670 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:05.689 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T08:54:05.690 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T08:54:05.690 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:05.754 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T08:54:05.754 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T08:54:05.754 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:05.775 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T08:54:05.776 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T08:54:05.776 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:05.842 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T08:54:05.842 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-22T08:54:05.842 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-22T08:54:05.842 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:05.905 INFO:tasks.ceph.osd.0:Stopped 2023-12-22T08:54:05.906 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-22T08:54:05.906 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:05.984 INFO:tasks.ceph.osd.1:Stopped 2023-12-22T08:54:05.984 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-22T08:54:05.984 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:06.081 INFO:tasks.ceph.osd.2:Stopped 2023-12-22T08:54:06.081 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-22T08:54:06.081 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:06.150 INFO:tasks.ceph.osd.3:Stopped 2023-12-22T08:54:06.150 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-22T08:54:06.150 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:06.200 INFO:tasks.ceph.osd.4:Stopped 2023-12-22T08:54:06.200 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-22T08:54:06.200 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:06.274 INFO:tasks.ceph.osd.5:Stopped 2023-12-22T08:54:06.274 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-22T08:54:06.274 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:06.345 INFO:tasks.ceph.osd.6:Stopped 2023-12-22T08:54:06.345 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-22T08:54:06.345 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:06.437 INFO:tasks.ceph.osd.7:Stopped 2023-12-22T08:54:06.437 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-22T08:54:06.438 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-22T08:54:06.438 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:08.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-12-22T08:54:12.539 INFO:tasks.ceph.mgr.y:Stopped 2023-12-22T08:54:12.540 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-22T08:54:12.540 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:12.638 INFO:tasks.ceph.mgr.x:Stopped 2023-12-22T08:54:12.639 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-22T08:54:12.639 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-22T08:54:12.639 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:12.691 INFO:tasks.ceph.mon.a:Stopped 2023-12-22T08:54:12.691 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-22T08:54:12.691 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:12.735 INFO:tasks.ceph.mon.b:Stopped 2023-12-22T08:54:12.735 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-22T08:54:12.735 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:54:12.772 INFO:tasks.ceph.mon.c:Stopped 2023-12-22T08:54:12.772 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-22T08:54:12.772 DEBUG:teuthology.orchestra.run.smithi038:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-22T08:54:12.896 INFO:teuthology.orchestra.run.smithi038.stdout:2023-12-22T08:39:46.852629+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench result of 132676.695728 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.0. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-12-22T08:54:12.897 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-12-22T08:54:12.898 DEBUG:teuthology.orchestra.run.smithi038:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-22T08:54:12.992 DEBUG:teuthology.orchestra.run.smithi038:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-22T08:54:13.090 DEBUG:teuthology.orchestra.run.smithi038:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-22T08:54:13.183 INFO:teuthology.orchestra.run.smithi038.stdout:2023-12-22T08:39:46.852629+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench result of 132676.695728 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.0. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-12-22T08:54:13.184 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:54:13.184 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-22T08:54:13.421 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:54:13.421 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-22T08:54:13.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:54:13.600 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-22T08:54:13.770 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:54:13.770 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-22T08:54:13.861 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-12-22T08:54:13.945 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:54:13.945 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-22T08:54:14.252 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:54:14.253 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-22T08:54:14.408 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:54:14.408 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-22T08:54:14.564 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:54:14.565 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-22T08:54:14.691 INFO:tasks.ceph:Archiving mon data... 2023-12-22T08:54:14.693 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286/data/mon.a.tgz 2023-12-22T08:54:14.693 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2023-12-22T08:54:14.758 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.AGejuay1Jn 2023-12-22T08:54:14.758 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.AGejuay1Jn 2023-12-22T08:54:14.981 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.AGejuay1Jn 2023-12-22T08:54:15.146 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.AGejuay1Jn is 479KB 2023-12-22T08:54:15.265 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.AGejuay1Jn 2023-12-22T08:54:15.328 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286/data/mon.b.tgz 2023-12-22T08:54:15.328 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-22T08:54:15.387 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.8EgtdSgErG 2023-12-22T08:54:15.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8EgtdSgErG 2023-12-22T08:54:15.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.8EgtdSgErG 2023-12-22T08:54:15.754 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.8EgtdSgErG is 505KB 2023-12-22T08:54:15.866 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.8EgtdSgErG 2023-12-22T08:54:15.928 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286/data/mon.c.tgz 2023-12-22T08:54:15.928 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-22T08:54:15.980 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.AWak33m3Ds 2023-12-22T08:54:15.981 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.AWak33m3Ds 2023-12-22T08:54:16.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.AWak33m3Ds 2023-12-22T08:54:16.336 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.AWak33m3Ds is 505KB 2023-12-22T08:54:16.446 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.AWak33m3Ds 2023-12-22T08:54:16.505 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-22T08:54:16.506 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-22T08:54:16.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-22T08:54:16.619 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-22T08:54:16.619 DEBUG:teuthology.orchestra.run.smithi038:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-22T08:54:16.628 DEBUG:teuthology.orchestra.run.smithi089:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-22T08:54:16.735 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-22T08:54:16.736 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-22T08:54:16.750 INFO:tasks.ceph:Archiving crash dumps... 2023-12-22T08:54:16.752 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286/remote/smithi038/crash 2023-12-22T08:54:16.753 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-22T08:54:16.841 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286/remote/smithi089/crash 2023-12-22T08:54:16.841 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-22T08:54:16.944 INFO:tasks.ceph:Shutting down logrotate 2023-12-22T08:54:16.944 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:54:16.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:54:17.093 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-22T08:54:17.203 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-22T08:54:17.308 INFO:tasks.ceph:Compressing logs... 2023-12-22T08:54:17.308 DEBUG:teuthology.orchestra.run.smithi038:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-22T08:54:17.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-22T08:54:22.936 INFO:tasks.ceph:Archiving logs... 2023-12-22T08:54:22.936 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286/remote/smithi038/log 2023-12-22T08:54:22.937 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-22T08:54:24.268 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286/remote/smithi089/log 2023-12-22T08:54:24.269 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-22T08:54:24.933 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-22T08:54:24.943 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-22T08:54:24.943 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-22T08:54:24.950 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-22T08:54:25.097 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-22T08:54:25.107 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-22T08:54:25.107 DEBUG:teuthology.orchestra.run.smithi038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T08:54:25.116 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T08:54:25.166 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2023-12-22T08:54:25.174 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2023-12-22T08:54:25.176 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-22T08:54:25.176 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2023-12-22T08:54:25.176 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 +843us[ +843us] +/- 66ms 2023-12-22T08:54:25.176 INFO:teuthology.orchestra.run.smithi038.stdout:^* hv02.front.sepia.ceph.com 3 7 377 82 +139us[ +156us] +/- 56ms 2023-12-22T08:54:25.176 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 -918us[ -918us] +/- 70ms 2023-12-22T08:54:25.176 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:54:25.184 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-22T08:54:25.184 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-12-22T08:54:25.184 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 17 +804us[ +857us] +/- 66ms 2023-12-22T08:54:25.185 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv02.front.sepia.ceph.com 3 6 377 17 +139us[ +192us] +/- 57ms 2023-12-22T08:54:25.185 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 -951us[ -899us] +/- 70ms 2023-12-22T08:54:25.185 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:54:25.186 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-22T08:54:25.196 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-22T08:54:25.197 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-22T08:54:25.206 DEBUG:teuthology.orchestra.run.smithi038:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-22T08:54:25.511 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-22T08:54:25.781 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-22T08:54:25.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:54:25.902 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-22T08:54:26.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:54:26.015 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-22T08:54:26.027 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-22T08:54:26.044 INFO:teuthology.task.internal:Duration was 1695.969041 seconds 2023-12-22T08:54:26.045 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-22T08:54:26.054 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-22T08:54:26.054 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-22T08:54:26.063 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-22T08:54:26.223 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-22T08:54:26.234 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-22T08:54:26.698 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-22T08:54:26.698 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi038.front.sepia.ceph.com 2023-12-22T08:54:26.698 DEBUG:teuthology.orchestra.run.smithi038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-22T08:54:26.771 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2023-12-22T08:54:26.771 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-22T08:54:26.849 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-22T08:54:26.850 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-22T08:54:26.858 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-22T08:54:26.959 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-22T08:54:26.959 DEBUG:teuthology.orchestra.run.smithi038:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-22T08:54:26.965 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-22T08:54:27.186 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-22T08:54:27.198 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-22T08:54:27.198 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-22T08:54:27.304 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-22T08:54:27.409 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-22T08:54:27.420 DEBUG:teuthology.orchestra.run.smithi038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-22T08:54:27.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-22T08:54:27.543 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = core 2023-12-22T08:54:27.544 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2023-12-22T08:54:27.602 DEBUG:teuthology.orchestra.run.smithi038:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-22T08:54:27.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:54:27.653 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-22T08:54:27.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:54:27.710 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-22T08:54:27.723 INFO:teuthology.task.internal:Transferring archived files... 2023-12-22T08:54:27.723 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286/remote/smithi038 2023-12-22T08:54:27.724 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-22T08:54:27.847 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286/remote/smithi089 2023-12-22T08:54:27.847 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-22T08:54:27.958 INFO:teuthology.task.internal:Removing archive directory... 2023-12-22T08:54:27.958 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-22T08:54:27.968 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-22T08:54:28.027 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-22T08:54:28.040 INFO:teuthology.task.internal:Not uploading archives. 2023-12-22T08:54:28.040 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-22T08:54:28.121 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-22T08:54:28.121 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-22T08:54:28.131 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-22T08:54:28.185 INFO:teuthology.orchestra.run.smithi038.stdout: 394732 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 22 08:54 /home/ubuntu/cephtest 2023-12-22T08:54:28.190 INFO:teuthology.orchestra.run.smithi089.stdout: 393429 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 22 08:54 /home/ubuntu/cephtest 2023-12-22T08:54:28.193 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-22T08:54:28.207 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-22T08:54:28.232 INFO:teuthology.nuke:Checking targets against current locks 2023-12-22T08:54:28.261 DEBUG:teuthology.nuke:shortname: smithi038 2023-12-22T08:54:28.262 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T08:54:28.286 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:12:01.420872', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNE9elxAczHrM6urpdArnbg2TFLF1wkSBp3viqQLTId2ooi52+E1VQB/nkduBlv/u+/UIxEfJEPMgyyY0BecKkA='} 2023-12-22T08:54:28.290 DEBUG:teuthology.nuke:shortname: smithi089 2023-12-22T08:54:28.290 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T08:54:28.308 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499286', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:12:01.422159', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKNmjedloL64n43IMt3Mcm+izzdIOLcGF9cnDSrqCjfmmVsYH5+0UNlLIyr0oEhuIBgJ4vkcAwEiVNEtgl9V+PY='} 2023-12-22T08:54:28.338 INFO:teuthology.orchestra.console.smithi038:Power off 2023-12-22T08:54:28.339 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T08:54:28.363 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2023-12-22T08:54:28.364 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:54:28.381 INFO:teuthology.orchestra.console.smithi089:Power off 2023-12-22T08:54:28.382 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T08:54:28.395 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-22T08:54:28.407 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-12-22T08:54:28.407 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:54:28.429 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-22T08:54:32.396 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:54:32.430 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:54:32.506 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-22T08:54:32.539 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-22T08:54:36.509 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:54:36.540 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:54:36.621 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-12-22T08:54:36.651 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-22T08:54:40.623 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:54:40.652 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:54:40.734 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-12-22T08:54:40.762 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-12-22T08:54:40.835 INFO:teuthology.orchestra.console.smithi038:Power off completed 2023-12-22T08:54:40.863 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-12-22T08:54:40.969 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 623393c9d50c04c7ea1d88824b8e92712e3e5611 client.1-kernel-sha1: 623393c9d50c04c7ea1d88824b8e92712e3e5611 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1695.9690408706665 failure_reason: '"2023-12-22T08:39:46.852629+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench result of 132676.695728 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.0. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_rishabh@teuthology success: false 2023-12-22T08:54:40.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:54:41.052 INFO:teuthology.run:FAIL